-- Logs begin at Wed 2022-10-26 12:20:13 UTC, end at Wed 2022-10-26 14:45:30 UTC. -- Oct 26 12:52:05.639999 n-d-862686-1 systemd[1]: Starting Devstack devstack@n-api.service... Oct 26 12:52:05.647367 n-d-862686-1 devstack@n-api.service[104592]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 26 12:52:05.649408 n-d-862686-1 devstack@n-api.service[104592]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 26 12:52:05 2022] *** Oct 26 12:52:05.649408 n-d-862686-1 devstack@n-api.service[104592]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 26 12:52:05.649408 n-d-862686-1 devstack@n-api.service[104592]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 26 12:52:05.649408 n-d-862686-1 devstack@n-api.service[104592]: nodename: n-d-862686-1 Oct 26 12:52:05.649408 n-d-862686-1 devstack@n-api.service[104592]: machine: x86_64 Oct 26 12:52:05.649408 n-d-862686-1 devstack@n-api.service[104592]: clock source: unix Oct 26 12:52:05.649408 n-d-862686-1 devstack@n-api.service[104592]: pcre jit disabled Oct 26 12:52:05.649408 n-d-862686-1 devstack@n-api.service[104592]: detected number of CPU cores: 4 Oct 26 12:52:05.649981 n-d-862686-1 devstack@n-api.service[104592]: current working directory: / Oct 26 12:52:05.649981 n-d-862686-1 devstack@n-api.service[104592]: detected binary path: /usr/bin/uwsgi-core Oct 26 12:52:05.649981 n-d-862686-1 devstack@n-api.service[104592]: your processes number limit is 47680 Oct 26 12:52:05.649981 n-d-862686-1 devstack@n-api.service[104592]: your memory page size is 4096 bytes Oct 26 12:52:05.649981 n-d-862686-1 devstack@n-api.service[104592]: detected max file descriptor number: 2048 Oct 26 12:52:05.649981 n-d-862686-1 devstack@n-api.service[104592]: lock engine: pthread robust mutexes Oct 26 12:52:05.651221 n-d-862686-1 devstack@n-api.service[104592]: thunder lock: enabled Oct 26 12:52:05.651221 n-d-862686-1 devstack@n-api.service[104592]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 26 12:52:05.651221 n-d-862686-1 devstack@n-api.service[104592]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 26 12:52:05.689836 n-d-862686-1 devstack@n-api.service[104592]: Python main interpreter initialized at 0x5626ebeb99c0 Oct 26 12:52:05.689836 n-d-862686-1 devstack@n-api.service[104592]: python threads support enabled Oct 26 12:52:05.689836 n-d-862686-1 devstack@n-api.service[104592]: your server socket listen backlog is limited to 100 connections Oct 26 12:52:05.689836 n-d-862686-1 devstack@n-api.service[104592]: your mercy for graceful operations on workers is 90 seconds Oct 26 12:52:05.690213 n-d-862686-1 devstack@n-api.service[104592]: mapped 403077 bytes (393 KB) for 2 cores Oct 26 12:52:05.690290 n-d-862686-1 devstack@n-api.service[104592]: *** Operational MODE: preforking *** Oct 26 12:52:05.690502 n-d-862686-1 devstack@n-api.service[104592]: *** uWSGI is running in multiple interpreter mode *** Oct 26 12:52:05.690502 n-d-862686-1 devstack@n-api.service[104592]: spawned uWSGI master process (pid: 104592) Oct 26 12:52:05.690713 n-d-862686-1 systemd[1]: Started Devstack devstack@n-api.service. Oct 26 12:52:05.691272 n-d-862686-1 devstack@n-api.service[104592]: spawned uWSGI worker 1 (pid: 104593, cores: 1) Oct 26 12:52:05.693766 n-d-862686-1 devstack@n-api.service[104592]: spawned uWSGI worker 2 (pid: 104594, cores: 1) Oct 26 12:52:05.693766 n-d-862686-1 devstack@n-api.service[104592]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 26 12:52:06.349437 n-d-862686-1 devstack@n-api.service[104594]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 26 12:52:06.359465 n-d-862686-1 devstack@n-api.service[104593]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 26 12:52:07.423254 n-d-862686-1 devstack@n-api.service[104594]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 26 12:52:07.423254 n-d-862686-1 devstack@n-api.service[104594]: from cryptography.utils import int_from_bytes Oct 26 12:52:07.423885 n-d-862686-1 devstack@n-api.service[104594]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 26 12:52:07.423885 n-d-862686-1 devstack@n-api.service[104594]: from cryptography.utils import int_from_bytes Oct 26 12:52:07.426219 n-d-862686-1 devstack@n-api.service[104593]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 26 12:52:07.426219 n-d-862686-1 devstack@n-api.service[104593]: from cryptography.utils import int_from_bytes Oct 26 12:52:07.426643 n-d-862686-1 devstack@n-api.service[104593]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 26 12:52:07.426643 n-d-862686-1 devstack@n-api.service[104593]: from cryptography.utils import int_from_bytes Oct 26 12:52:09.903437 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 26 12:52:09.903921 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 26 12:52:09.904212 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 26 12:52:09.904545 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 26 12:52:09.904906 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 26 12:52:09.904906 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 26 12:52:09.905074 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 26 12:52:09.905167 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.905319 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 26 12:52:09.905511 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.905705 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 26 12:52:09.905840 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.905962 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 26 12:52:09.906154 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.906352 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.906481 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.906676 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.906775 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.906999 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.907084 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.907316 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.907401 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.907646 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.907733 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.907935 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.908019 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.908244 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.908339 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.908563 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.908662 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-862686-1 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.908878 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.908974 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.909135 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.909233 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.909448 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.909566 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.909797 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.909881 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-862686-1 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.910100 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.910201 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.910413 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.910519 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.910711 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.910795 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.911024 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.911208 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.911318 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.912360 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.912495 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.912604 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.912702 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.912702 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.912842 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.912931 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.913009 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.913090 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.913163 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.913246 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.913323 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.913416 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.913654 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.913814 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.913974 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.914098 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.914268 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.914365 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.914578 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.914726 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-862686-1 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.914887 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.915039 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.915211 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.915348 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.916057 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.916191 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.916534 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-862686-1 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.916784 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.916876 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.917036 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.917159 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.917334 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.917475 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.917683 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.917913 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.918126 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.918270 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.918358 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.918587 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.918673 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.918910 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.919003 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.919225 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.919323 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.919531 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.919616 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.919829 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.919926 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.920141 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.920244 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.920448 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.920595 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.920763 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.920871 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.921064 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.921160 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.921365 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.921450 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.921638 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.921735 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.921944 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.922029 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.922268 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.922354 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.922586 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.922679 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.922836 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.922922 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.923137 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.923232 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.923384 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.923474 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.923700 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.923786 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.924018 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.924104 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.924305 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.924397 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.924555 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.924648 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.924873 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.924968 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.925189 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.925274 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.925499 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.925587 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.925813 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.925910 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.926113 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.926199 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.926414 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.926499 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.926740 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.926829 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.927049 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.927135 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.927356 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.927441 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.927663 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.927758 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.927976 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.928060 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.928289 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.928381 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.928598 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.928683 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.928906 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.929060 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.929210 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.929358 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.929561 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.929651 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.929863 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.929949 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.930172 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.930268 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.930486 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.930596 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.930793 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.930904 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.931093 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.931832 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.932126 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.932214 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.932355 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.932451 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.932599 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.932696 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.932907 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.932994 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.933153 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.933251 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.933450 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.933620 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.933779 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.933889 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.934094 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.934192 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.934400 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.934506 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.934702 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.934797 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.935006 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.935102 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.935303 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.935398 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.935606 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.935710 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.935908 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.936003 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.936209 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.936305 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.936509 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.936604 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.936810 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.936904 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.937113 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.937208 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.937412 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.937528 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.937740 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.937835 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.938041 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.938143 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.938340 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.938436 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.938640 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.938774 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.938946 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.939117 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.939248 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.939376 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.939534 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.939672 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.939837 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.939973 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.940140 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.940292 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.940452 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.940564 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.940753 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.940838 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.941054 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.941145 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.941359 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.941443 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.941684 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.941778 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.941989 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.942075 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.942292 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.942385 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.942592 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.942676 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.942893 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.942979 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.943196 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.943353 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.943489 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.943574 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.943790 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.943875 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.944100 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.944199 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.944399 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.944484 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.944698 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.944783 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.944997 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.945098 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.945296 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.945381 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.945616 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.945707 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.945919 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.946006 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.946218 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.946310 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.946512 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.946605 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.946839 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.946969 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.947145 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.947271 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.947464 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.947552 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.947767 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.947854 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.948065 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.948149 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.948363 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.948449 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.948676 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.948763 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.948982 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.949065 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.949290 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.949385 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.949617 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.949707 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.949936 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 12:52:09.950021 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.950275 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.950378 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.950601 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.950737 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.950914 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.951037 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.951224 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.951319 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.951534 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.951622 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.951857 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.951950 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.952169 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.952262 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.952475 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.952560 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.952779 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.952879 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.953093 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.953179 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.953404 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.953507 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.953757 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.953879 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.954068 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.954166 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.954376 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.954461 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.954692 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.954792 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.954999 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.955086 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.955313 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.955400 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.955627 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.955712 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.955942 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.956028 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.956249 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.956335 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.956570 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.956655 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.956897 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.956991 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.957202 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.957294 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.957532 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.957635 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.957850 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.957943 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.958158 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.958243 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.958467 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.958562 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.958770 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.958865 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.959111 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.959197 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.959418 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.959518 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.959725 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.959809 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.960032 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.960116 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.960341 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.960438 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.960663 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.960756 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.960980 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.961067 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.961280 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.961377 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.961627 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.961723 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.961921 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.962018 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.962233 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.962321 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.962582 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.962667 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.962890 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.962975 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.963201 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.963290 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.963509 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.963600 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.963818 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.963905 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.964131 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.964219 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.964439 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.964525 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.964748 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.964834 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.965055 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.965142 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.965355 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.965440 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.965682 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.965770 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.965984 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.966072 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.966289 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.966374 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.966587 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.966681 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.966890 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.966982 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.967198 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.967284 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.967497 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.967593 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.967798 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.967890 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.968113 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.968198 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.968419 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.968518 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.968725 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.968812 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.969034 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.969126 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.969337 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.969436 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.969678 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.969765 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.969978 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.970062 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.970280 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.970368 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.970587 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.970729 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.970895 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.970996 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.971194 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.971332 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.971499 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.971592 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.971800 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.971885 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.972108 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.972195 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.972424 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.972508 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.972719 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.972802 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.973025 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.973111 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.973331 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.973416 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.973659 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.973759 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.973970 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.974055 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.974275 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.974359 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.974584 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.974679 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.974894 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.974978 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.975220 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.975312 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.975521 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.975615 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.975833 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.975917 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.976151 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.976235 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.976465 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.976558 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.976767 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.976852 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.977073 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.977160 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.977372 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.977459 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.977700 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.977802 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.978504 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.978602 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.978817 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.978912 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.979125 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.979206 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.979408 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.979552 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.979708 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.979796 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.980007 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.980093 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.980309 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.980401 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.980620 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.980707 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.980923 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.981018 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.981219 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.981317 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.981542 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.981634 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.981844 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.981930 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.982164 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.982260 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.982466 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.982565 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.982771 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.982856 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.983072 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.983167 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.983412 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.983504 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.983717 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.983804 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.984029 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.984122 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.984342 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.984430 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.984649 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.984734 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.984958 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.985046 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.985268 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.985354 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.985608 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.985709 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.985916 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.986002 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.986221 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.986306 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.986531 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.986615 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.986838 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.986923 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.987154 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.987239 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.987460 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.987552 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.987778 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.987919 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.988075 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.988212 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.988376 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.988515 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.988691 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.988825 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.989013 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.989147 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.989318 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.989460 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.989652 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.989779 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.989955 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.990095 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.990265 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.990407 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.990556 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.990691 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.990867 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.990956 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.991176 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.991319 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.991485 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.991615 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.991801 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.991890 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.992109 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.992304 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.992437 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.992567 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.992722 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.992853 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.993042 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.993175 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.993347 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.993510 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.994267 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.994500 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.994593 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.994673 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.994895 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.994990 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.995221 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.995306 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.995554 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.995652 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.995864 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.995950 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.996176 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.996269 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.996494 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.996582 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.996805 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.996890 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.997113 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.997207 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.997423 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.997549 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.997751 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.997837 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.998055 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.998163 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.998362 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.998449 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.998672 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.998765 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.998977 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.999072 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.999281 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.999367 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.999584 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.999722 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.999896 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:09.999990 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.000199 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.000291 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.000499 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.000585 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.000800 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.000895 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.001108 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.001204 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.001415 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.001565 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.001746 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.001837 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.002050 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.002135 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.002361 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.002446 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.002670 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.002755 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.002972 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.003058 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.003290 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.003374 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.003594 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.003680 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.003896 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.003982 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.004196 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.004562 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.004772 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.004858 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.005095 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.005180 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.005399 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.005552 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.005723 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.005808 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.006026 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.006110 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.006338 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.006439 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.006645 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.006730 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.006950 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.007042 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.007254 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.007347 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.007558 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.007643 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.007867 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.007951 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.008175 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.008269 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.008480 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.008565 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.008788 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.008882 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.009089 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.009176 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.009421 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.009529 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.009763 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.009861 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.010083 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.010170 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.010386 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.010473 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.010691 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.010776 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.010997 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.011125 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.011296 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.011382 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.011603 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.011724 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.011913 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.012011 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.012254 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.012475 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.012561 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.012809 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.012896 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.013123 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.013208 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.013438 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.013727 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.013830 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.014063 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.014162 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.014381 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.014467 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.014717 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.014811 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.015018 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.015105 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.015320 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.015416 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.015625 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.015711 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.015926 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.016062 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.016227 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.016313 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.016533 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.016619 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.016834 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.016928 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.017135 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.017221 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.017436 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.017609 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.017767 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.017867 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.018068 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.018171 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.018366 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.018453 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.018661 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.018755 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.018962 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.019048 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.019262 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.019346 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.019561 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.019649 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.019859 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.019943 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.020157 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.020241 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.020470 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.020556 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.020769 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.020854 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.021069 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.021155 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.021370 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.021466 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.021693 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.021820 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.022008 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.022094 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.022314 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.022401 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.022618 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.022705 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.022918 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.023019 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.023260 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.023346 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.023564 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.023650 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.023864 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.023958 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.024185 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.024271 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.024488 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.024572 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.024789 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.025422 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.025646 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.025736 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.025957 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.026096 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.026263 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.026408 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.026564 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.026718 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.026872 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.027025 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.027178 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.027337 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.027483 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.027647 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.027788 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.027954 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.028087 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.028268 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.028392 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.028580 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.028692 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.028890 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.028985 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.029201 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.029286 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.029533 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.029626 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.029846 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.029935 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.030143 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.030249 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.030458 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.030544 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.030767 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.030854 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.031072 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.031157 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.031369 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.031455 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.031678 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.031764 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.031977 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.032073 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.032277 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.032365 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.032577 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.032665 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.032879 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.032965 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.033186 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.033283 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.033503 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.033593 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.033816 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.033912 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.034120 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.034219 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.034424 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.034518 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.034724 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.034809 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.035027 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.035120 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.035323 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.035409 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.035620 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.035706 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.035923 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.036018 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.036235 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.036330 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.036543 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.036628 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.036843 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.036930 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.037146 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.037232 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.037442 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.037548 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.037764 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.037853 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.038065 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.038160 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.038368 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.038463 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.038664 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.038753 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.038961 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.039053 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.039257 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.039343 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.039555 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.039643 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.039854 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.039939 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.040153 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.040248 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.040517 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.040611 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.040798 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.040935 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.041250 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.041343 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.041578 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.041675 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.041906 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.042031 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.042204 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.042302 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.042509 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.042595 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.042815 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.042900 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.043120 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.043215 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.043447 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.043531 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.043756 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.043850 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.044064 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.044151 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.044373 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.044458 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.044674 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.044766 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.044985 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.045072 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.045294 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.045380 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.045627 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.045729 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.045931 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.046018 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.046232 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.046324 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.046547 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.046631 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.046853 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.046946 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.047161 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.047246 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.047465 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.047549 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.047771 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.047858 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.048087 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.048170 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.048389 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.048556 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.048695 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.048794 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.049004 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.049098 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.049306 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.049401 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.049637 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.049735 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.049947 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.050044 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.050256 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.050350 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.050566 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.050658 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.050871 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.050959 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.051179 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.051275 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.051488 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.051580 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.051785 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.051869 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.052092 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.052186 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.052398 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.052484 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.052698 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.052783 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.053007 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.053093 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.053313 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.053400 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.053637 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.053727 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.053944 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.054031 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.054244 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.054336 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.054552 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.054638 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.054854 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.054941 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.055157 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.055276 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.055465 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.055584 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.055770 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.055891 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.056591 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.056710 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.056991 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.057227 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.057423 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.057570 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.057764 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.057888 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.058078 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.058199 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.058386 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.058502 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.058700 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.058919 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.059011 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.059230 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.059317 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.059540 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.059627 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.059848 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.059943 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.060152 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.060309 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.060453 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.060622 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.060759 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.060936 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.061082 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.061246 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.061386 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.061586 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.061723 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.061892 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.062013 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.062202 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.062333 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.062525 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.062634 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.062832 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.062951 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.063137 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.063363 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.063450 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.063671 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.063766 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.063979 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.064113 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.064350 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.064435 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.064681 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.064774 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.064987 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.065079 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.065307 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.065399 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.065651 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.065764 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.065975 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.066117 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.066278 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.066366 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.066588 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.066673 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.066893 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.066980 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.067212 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.067308 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.067532 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.067619 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.067840 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.067928 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.068150 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.068243 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.068452 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.068607 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.068771 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.068867 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.069088 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.069174 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.069395 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.069510 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.069723 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.069821 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.070050 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.070138 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.070375 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.070479 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.070689 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.070782 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.071012 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.071099 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.071338 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.071435 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.071660 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.071868 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.071988 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.072099 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.072312 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.072505 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.072600 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.072837 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.072931 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.073147 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.073243 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.073454 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.073585 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.073790 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.073876 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.074096 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.074195 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.074397 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.074482 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.074698 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.074784 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.074997 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.075090 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.075310 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.075395 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.075604 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.075690 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.075918 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.076005 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.076225 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.076309 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.076528 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.076614 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.076844 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.076930 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.077144 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.077230 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.077463 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.077615 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.077793 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.077903 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.078094 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.078194 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.078393 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.078492 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.078691 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.078791 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.079022 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.079107 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.079320 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.079416 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.079623 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.079708 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.079925 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.080010 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.080228 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.080324 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.080546 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.080637 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.080858 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.080942 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.081177 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.081270 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.081521 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.081611 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.081851 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.081951 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.082161 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.082259 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.082491 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.082578 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.082792 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.082878 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.083093 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.083180 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.083398 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.083484 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.083704 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.083796 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.084003 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.084091 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.084303 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.084396 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.084605 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.084701 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.084902 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.084995 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.085476 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.085601 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.085683 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.085768 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.085857 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.085937 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.086097 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.086184 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.086411 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.086508 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.086714 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.086807 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.087014 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.087101 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.087313 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.087963 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.088123 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.088232 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.088461 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.088554 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.088761 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.088894 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.089082 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.089168 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.089386 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.089471 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.089729 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.089828 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.090042 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.090128 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.090353 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.090439 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.090664 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.090811 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.090975 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.091089 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.091286 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.091376 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.091597 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.091684 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.091913 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.092033 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.092217 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.092320 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.092527 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.092626 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.092837 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.092935 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.093147 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.093245 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.093459 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.093685 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.093788 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.094023 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.094111 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.094337 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.094426 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.094648 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.094743 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.094958 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.095199 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.095299 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.095600 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.095703 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.095845 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.095940 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.096156 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.096325 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.096463 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.096549 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.096769 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.096856 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.097080 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.097167 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.097391 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.097505 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.097728 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.097816 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.098040 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.098191 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.098351 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.098438 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.098658 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.098744 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.098972 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.099073 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.099278 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.099366 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.099620 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.099715 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.099930 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.100016 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.100235 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.100331 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.100545 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.100642 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.100854 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.100941 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.101164 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.101251 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.101474 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.101583 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.101805 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.101902 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.102113 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.102202 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.102420 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.102517 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.102727 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.102815 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.103085 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.103239 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.103462 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.103552 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.103690 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.103816 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.103998 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.104103 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.104311 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.104428 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.104626 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.104722 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.104932 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.105032 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.105242 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.105329 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.105576 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.105666 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.105910 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.106092 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.106228 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.106403 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.106541 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.106735 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.106855 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.107059 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.107169 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.107379 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.107689 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.107777 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.107999 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.108086 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.108321 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.108407 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.108624 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.108717 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.108925 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.109012 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.109233 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.109328 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.109558 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.109649 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.109862 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.109951 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.110177 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.110262 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.110483 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.110577 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.110780 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.110865 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.111090 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.111174 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.111391 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.111484 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.111709 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.111916 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.112072 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.112258 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.112347 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.112571 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.112659 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.112897 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.112998 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.113217 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.113430 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.113557 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.113798 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.113885 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.114117 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.114205 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.114446 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.114533 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.114760 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.114852 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.115070 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.115156 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.115375 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.115461 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.115673 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.115764 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.115975 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.116079 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.116280 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.116368 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.116583 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.116669 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.116881 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.116967 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.117184 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.117270 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.117507 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.117596 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.117812 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.117911 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.118114 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.118209 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.118414 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.118507 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.119251 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.119353 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.119555 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.119786 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.119973 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.120099 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.120285 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.120407 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.120592 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.120712 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.120900 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.121016 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.121212 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.121328 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.121537 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.121667 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.121845 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.121975 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.122153 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.122277 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.122460 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.122585 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.122768 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.122937 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.123071 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.123246 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.123380 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.123548 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.123682 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.123868 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.123990 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.124169 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.124341 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.124477 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.124651 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.124789 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.124955 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.125141 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.125277 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.125416 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.125602 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.125752 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.125907 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.126045 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.126220 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.126390 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.126529 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.126703 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.126852 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.127161 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.127246 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.127473 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.127559 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.127819 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.127906 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.128133 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.128218 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.128479 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.128671 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.128766 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.129011 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.129097 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.129636 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.129742 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.129968 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.130055 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.130276 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.130362 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.130582 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.130675 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.130887 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.130975 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.131192 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.131283 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.131494 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.131580 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.131802 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.131897 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.132107 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.132204 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.132413 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.132508 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.132717 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.132803 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.133020 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.133116 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.133324 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.133513 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.133653 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.133739 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.133957 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.134043 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.134309 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.134424 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.134646 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.134732 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.134957 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.135044 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.135265 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.135353 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.135573 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.135667 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.135882 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.135969 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.136195 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.136294 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.136516 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.136602 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.136824 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.136913 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.137131 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.137218 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.137437 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.137537 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.137776 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.137863 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.138089 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.138177 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.138400 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.138486 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.138700 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.138795 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.139009 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.139327 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.139412 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.139648 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.139781 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.139963 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.140050 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.140271 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.140356 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.140575 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.140895 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.140988 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.141214 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.141309 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.141541 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.141633 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.141861 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.141958 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.142169 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.142303 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.142496 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.142590 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.142820 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.142907 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.143135 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.143221 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.143453 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.143539 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.143754 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.143841 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.144056 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.144142 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.144364 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.144459 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.144669 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.144756 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.144982 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.145069 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.145287 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.145382 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.145652 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.145739 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.145960 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.146046 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.146262 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.146359 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.146562 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.146649 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.146859 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.146945 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.147156 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.147251 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.147455 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.147541 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.147757 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.147843 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.148053 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.148141 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.148351 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.148437 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.148650 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.148737 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.148950 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.149036 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.149249 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.149335 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.149571 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.149661 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.150384 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.150536 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.150681 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.150769 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.150987 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.151103 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.151277 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.151364 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.151574 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.151672 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.151873 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.151968 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.152172 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.152258 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.152477 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.152563 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.152781 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.152887 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.153088 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.153175 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.153392 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.153508 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.153734 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.153833 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.154039 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.154126 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.154355 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.154440 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.154674 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.154761 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.154981 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.155068 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.155282 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.155368 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.155597 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.155683 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.155897 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.155983 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.156212 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.156340 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.156509 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.156597 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.156812 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.156899 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.157115 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.157201 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.157418 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.157612 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.157752 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.157838 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.158065 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.158165 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.158365 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.158457 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.158669 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.158754 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.158976 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.159071 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.159286 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.159372 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.159598 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.159683 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.159903 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.159998 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.160225 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.160312 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.160533 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.160619 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.160838 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.160925 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.161140 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.161227 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.161444 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.161552 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.161780 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.161894 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.162088 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.162211 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.162397 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.162649 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.162863 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.162951 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.163030 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.163259 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.163399 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.163568 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.163656 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.163891 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.163976 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.164197 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.164282 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.164503 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.164590 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.164816 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.164900 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.165133 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.165225 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.165572 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.165670 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.165850 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.165963 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.166265 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.166369 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.166593 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.166690 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.166905 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.167028 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.167215 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.167344 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.167516 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.167688 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.167788 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 26 12:52:10.168017 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.168334 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.168649 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.168956 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 12:52:10.169200 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 26 12:52:10.321044 n-d-862686-1 devstack@n-api.service[104594]: INFO dbcounter [None req-c68d11a1-18a3-4ba0-89f0-92782aecc3b0 None None] Registered counter for database nova_api Oct 26 12:52:10.322547 n-d-862686-1 devstack@n-api.service[104593]: INFO dbcounter [None req-03dc7b0f-8958-4871-85b7-6f251a6c119c None None] Registered counter for database nova_api Oct 26 12:52:10.343152 n-d-862686-1 devstack@n-api.service[104594]: DEBUG oslo_db.sqlalchemy.engines [None req-c68d11a1-18a3-4ba0-89f0-92782aecc3b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104594) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 12:52:10.344905 n-d-862686-1 devstack@n-api.service[104593]: DEBUG oslo_db.sqlalchemy.engines [None req-03dc7b0f-8958-4871-85b7-6f251a6c119c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104593) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 12:52:10.349858 n-d-862686-1 devstack@n-api.service[104594]: DEBUG dbcounter [-] [104594] Writer thread running {{(pid=104594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 12:52:10.351542 n-d-862686-1 devstack@n-api.service[104593]: DEBUG dbcounter [-] [104593] Writer thread running {{(pid=104593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 12:52:10.407283 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.context [None req-c68d11a1-18a3-4ba0-89f0-92782aecc3b0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2e5960f1-3c3d-401b-877c-fe82eb67bd3f(cell1) {{(pid=104594) load_cells /opt/stack/nova/nova/context.py:464}} Oct 26 12:52:10.409280 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.context [None req-03dc7b0f-8958-4871-85b7-6f251a6c119c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2e5960f1-3c3d-401b-877c-fe82eb67bd3f(cell1) {{(pid=104593) load_cells /opt/stack/nova/nova/context.py:464}} Oct 26 12:52:10.411083 n-d-862686-1 devstack@n-api.service[104594]: DEBUG oslo_concurrency.lockutils [None req-c68d11a1-18a3-4ba0-89f0-92782aecc3b0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 12:52:10.411548 n-d-862686-1 devstack@n-api.service[104594]: DEBUG oslo_concurrency.lockutils [None req-c68d11a1-18a3-4ba0-89f0-92782aecc3b0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 12:52:10.413116 n-d-862686-1 devstack@n-api.service[104593]: DEBUG oslo_concurrency.lockutils [None req-03dc7b0f-8958-4871-85b7-6f251a6c119c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 12:52:10.413226 n-d-862686-1 devstack@n-api.service[104594]: DEBUG oslo_concurrency.lockutils [None req-c68d11a1-18a3-4ba0-89f0-92782aecc3b0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 12:52:10.413620 n-d-862686-1 devstack@n-api.service[104593]: DEBUG oslo_concurrency.lockutils [None req-03dc7b0f-8958-4871-85b7-6f251a6c119c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 12:52:10.413842 n-d-862686-1 devstack@n-api.service[104594]: DEBUG oslo_concurrency.lockutils [None req-c68d11a1-18a3-4ba0-89f0-92782aecc3b0 None None] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 12:52:10.414282 n-d-862686-1 devstack@n-api.service[104594]: DEBUG oslo_concurrency.lockutils [None req-c68d11a1-18a3-4ba0-89f0-92782aecc3b0 None None] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 12:52:10.415209 n-d-862686-1 devstack@n-api.service[104593]: DEBUG oslo_concurrency.lockutils [None req-03dc7b0f-8958-4871-85b7-6f251a6c119c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 12:52:10.415951 n-d-862686-1 devstack@n-api.service[104593]: DEBUG oslo_concurrency.lockutils [None req-03dc7b0f-8958-4871-85b7-6f251a6c119c None None] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 12:52:10.416295 n-d-862686-1 devstack@n-api.service[104594]: DEBUG oslo_concurrency.lockutils [None req-c68d11a1-18a3-4ba0-89f0-92782aecc3b0 None None] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 12:52:10.416389 n-d-862686-1 devstack@n-api.service[104593]: DEBUG oslo_concurrency.lockutils [None req-03dc7b0f-8958-4871-85b7-6f251a6c119c None None] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 12:52:10.418284 n-d-862686-1 devstack@n-api.service[104594]: INFO dbcounter [None req-c68d11a1-18a3-4ba0-89f0-92782aecc3b0 None None] Registered counter for database nova_cell0 Oct 26 12:52:10.418389 n-d-862686-1 devstack@n-api.service[104593]: DEBUG oslo_concurrency.lockutils [None req-03dc7b0f-8958-4871-85b7-6f251a6c119c None None] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 12:52:10.420372 n-d-862686-1 devstack@n-api.service[104593]: INFO dbcounter [None req-03dc7b0f-8958-4871-85b7-6f251a6c119c None None] Registered counter for database nova_cell0 Oct 26 12:52:10.422321 n-d-862686-1 devstack@n-api.service[104594]: INFO dbcounter [None req-c68d11a1-18a3-4ba0-89f0-92782aecc3b0 None None] Registered counter for database nova_cell1 Oct 26 12:52:10.424393 n-d-862686-1 devstack@n-api.service[104593]: INFO dbcounter [None req-03dc7b0f-8958-4871-85b7-6f251a6c119c None None] Registered counter for database nova_cell1 Oct 26 12:52:10.429653 n-d-862686-1 devstack@n-api.service[104594]: DEBUG oslo_db.sqlalchemy.engines [None req-c68d11a1-18a3-4ba0-89f0-92782aecc3b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104594) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 12:52:10.431906 n-d-862686-1 devstack@n-api.service[104594]: DEBUG oslo_db.sqlalchemy.engines [None req-c68d11a1-18a3-4ba0-89f0-92782aecc3b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104594) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 12:52:10.432792 n-d-862686-1 devstack@n-api.service[104593]: DEBUG oslo_db.sqlalchemy.engines [None req-03dc7b0f-8958-4871-85b7-6f251a6c119c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104593) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 12:52:10.434661 n-d-862686-1 devstack@n-api.service[104593]: DEBUG oslo_db.sqlalchemy.engines [None req-03dc7b0f-8958-4871-85b7-6f251a6c119c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104593) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 12:52:10.437859 n-d-862686-1 devstack@n-api.service[104594]: DEBUG dbcounter [-] [104594] Writer thread running {{(pid=104594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 12:52:10.439355 n-d-862686-1 devstack@n-api.service[104594]: DEBUG dbcounter [-] [104594] Writer thread running {{(pid=104594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 12:52:10.439461 n-d-862686-1 devstack@n-api.service[104593]: DEBUG dbcounter [-] [104593] Writer thread running {{(pid=104593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 12:52:10.576673 n-d-862686-1 devstack@n-api.service[104593]: DEBUG dbcounter [-] [104593] Writer thread running {{(pid=104593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 12:52:10.584684 n-d-862686-1 devstack@n-api.service[104594]: INFO dbcounter [None req-c68d11a1-18a3-4ba0-89f0-92782aecc3b0 None None] Registered counter for database nova_cell0 Oct 26 12:52:10.586396 n-d-862686-1 devstack@n-api.service[104593]: INFO dbcounter [None req-03dc7b0f-8958-4871-85b7-6f251a6c119c None None] Registered counter for database nova_cell0 Oct 26 12:52:10.594047 n-d-862686-1 devstack@n-api.service[104594]: DEBUG oslo_db.sqlalchemy.engines [None req-c68d11a1-18a3-4ba0-89f0-92782aecc3b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104594) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 12:52:10.596010 n-d-862686-1 devstack@n-api.service[104593]: DEBUG oslo_db.sqlalchemy.engines [None req-03dc7b0f-8958-4871-85b7-6f251a6c119c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104593) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 12:52:10.598858 n-d-862686-1 devstack@n-api.service[104594]: DEBUG dbcounter [-] [104594] Writer thread running {{(pid=104594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 12:52:10.600691 n-d-862686-1 devstack@n-api.service[104593]: DEBUG dbcounter [-] [104593] Writer thread running {{(pid=104593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 12:52:10.935734 n-d-862686-1 devstack@n-api.service[104593]: WARNING keystonemiddleware.auth_token [None req-03dc7b0f-8958-4871-85b7-6f251a6c119c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 26 12:52:10.938352 n-d-862686-1 devstack@n-api.service[104594]: WARNING keystonemiddleware.auth_token [None req-c68d11a1-18a3-4ba0-89f0-92782aecc3b0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 26 12:52:10.942928 n-d-862686-1 devstack@n-api.service[104593]: WARNING keystonemiddleware.auth_token [None req-03dc7b0f-8958-4871-85b7-6f251a6c119c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 26 12:52:10.945569 n-d-862686-1 devstack@n-api.service[104594]: WARNING keystonemiddleware.auth_token [None req-c68d11a1-18a3-4ba0-89f0-92782aecc3b0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 26 12:52:11.285240 n-d-862686-1 devstack@n-api.service[104593]: WARNING keystonemiddleware.auth_token [None req-03dc7b0f-8958-4871-85b7-6f251a6c119c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 26 12:52:11.289520 n-d-862686-1 devstack@n-api.service[104594]: WARNING keystonemiddleware.auth_token [None req-c68d11a1-18a3-4ba0-89f0-92782aecc3b0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 26 12:52:11.291923 n-d-862686-1 devstack@n-api.service[104593]: WARNING keystonemiddleware.auth_token [None req-03dc7b0f-8958-4871-85b7-6f251a6c119c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 26 12:52:11.295968 n-d-862686-1 devstack@n-api.service[104594]: WARNING keystonemiddleware.auth_token [None req-c68d11a1-18a3-4ba0-89f0-92782aecc3b0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 26 12:52:11.297160 n-d-862686-1 devstack@n-api.service[104593]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5626ebeb99c0 pid: 104593 (default app) Oct 26 12:52:11.299217 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi [None req-03dc7b0f-8958-4871-85b7-6f251a6c119c None None] Calling method '>' {{(pid=104593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 12:52:11.300384 n-d-862686-1 devstack@n-api.service[104593]: INFO nova.api.openstack.requestlog [None req-03dc7b0f-8958-4871-85b7-6f251a6c119c None None] 10.222.0.40 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001683 Oct 26 12:52:11.300791 n-d-862686-1 devstack@n-api.service[104593]: [pid: 104593|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 788 bytes} [Wed Oct 26 12:52:11 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 12:52:11.301283 n-d-862686-1 devstack@n-api.service[104594]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5626ebeb99c0 pid: 104594 (default app) Oct 26 12:53:33.022991 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi [None req-03dc7b0f-8958-4871-85b7-6f251a6c119c None None] Calling method '>' {{(pid=104593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 12:53:33.024187 n-d-862686-1 devstack@n-api.service[104593]: INFO nova.api.openstack.requestlog [None req-03dc7b0f-8958-4871-85b7-6f251a6c119c None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001737 Oct 26 12:53:33.026069 n-d-862686-1 devstack@n-api.service[104593]: [pid: 104593|app: 0|req: 2/2] 10.222.0.40 () {54 vars in 931 bytes} [Wed Oct 26 12:53:33 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 12:53:33.038092 n-d-862686-1 devstack@n-api.service[104594]: DEBUG dbcounter [-] [104594] Writing DB stats nova_api:SELECT=3 {{(pid=104594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 12:53:33.039198 n-d-862686-1 devstack@n-api.service[104594]: DEBUG dbcounter [-] [104594] Writing DB stats nova_cell1:SELECT=3 {{(pid=104594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 12:53:33.040322 n-d-862686-1 devstack@n-api.service[104594]: DEBUG dbcounter [-] [104594] Writing DB stats nova_cell0:SELECT=3 {{(pid=104594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 12:53:33.042384 n-d-862686-1 devstack@n-api.service[104594]: DEBUG dbcounter [-] [104594] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 12:53:33.923106 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi [None req-e1723a58-ee99-4b7c-bc8e-51ad24711dd0 admin admin] Calling method '>' {{(pid=104594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 12:53:33.957330 n-d-862686-1 devstack@n-api.service[104594]: INFO nova.api.openstack.requestlog [None req-e1723a58-ee99-4b7c-bc8e-51ad24711dd0 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.924266 Oct 26 12:53:33.958136 n-d-862686-1 devstack@n-api.service[104594]: [pid: 104594|app: 0|req: 1/3] 10.222.0.40 () {60 vars in 1292 bytes} [Wed Oct 26 12:53:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 12:53:36.631861 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi [None req-03dc7b0f-8958-4871-85b7-6f251a6c119c None None] Calling method '>' {{(pid=104593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 12:53:36.632870 n-d-862686-1 devstack@n-api.service[104593]: INFO nova.api.openstack.requestlog [None req-03dc7b0f-8958-4871-85b7-6f251a6c119c None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001683 Oct 26 12:53:36.633259 n-d-862686-1 devstack@n-api.service[104593]: [pid: 104593|app: 0|req: 3/4] 10.222.0.40 () {54 vars in 931 bytes} [Wed Oct 26 12:53:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 12:53:37.077862 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi [None req-b2ade43a-ca0f-4d9d-a6a3-a61067838f9e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "disk": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "c1", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=104594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 12:53:37.128273 n-d-862686-1 devstack@n-api.service[104594]: INFO nova.api.openstack.requestlog [None req-b2ade43a-ca0f-4d9d-a6a3-a61067838f9e admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.486743 Oct 26 12:53:37.129457 n-d-862686-1 devstack@n-api.service[104594]: [pid: 104594|app: 0|req: 2/5] 10.222.0.40 () {64 vars in 1283 bytes} [Wed Oct 26 12:53:36 2022] POST /compute/v2.1/flavors => generated 407 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 12:53:37.142690 n-d-862686-1 devstack@n-api.service[104593]: DEBUG dbcounter [-] [104593] Writing DB stats nova_api:SELECT=3 {{(pid=104593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 12:53:37.143482 n-d-862686-1 devstack@n-api.service[104593]: DEBUG dbcounter [-] [104593] Writing DB stats nova_cell0:SELECT=3 {{(pid=104593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 12:53:37.144447 n-d-862686-1 devstack@n-api.service[104593]: DEBUG dbcounter [-] [104593] Writing DB stats nova_cell1:SELECT=3 {{(pid=104593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 12:53:37.145171 n-d-862686-1 devstack@n-api.service[104593]: DEBUG dbcounter [-] [104593] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 12:53:37.350909 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi [None req-7d6a2d45-d203-4945-b601-44f85d5e4411 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 12:53:37.420652 n-d-862686-1 devstack@n-api.service[104593]: INFO nova.api.openstack.requestlog [None req-7d6a2d45-d203-4945-b601-44f85d5e4411 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.282626 Oct 26 12:53:37.420878 n-d-862686-1 devstack@n-api.service[104593]: [pid: 104593|app: 0|req: 4/6] 10.222.0.40 () {64 vars in 1336 bytes} [Wed Oct 26 12:53:37 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 12:53:40.075852 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi [None req-b2ade43a-ca0f-4d9d-a6a3-a61067838f9e admin admin] Calling method '>' {{(pid=104594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 12:53:40.077048 n-d-862686-1 devstack@n-api.service[104594]: INFO nova.api.openstack.requestlog [None req-b2ade43a-ca0f-4d9d-a6a3-a61067838f9e admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001653 Oct 26 12:53:40.077609 n-d-862686-1 devstack@n-api.service[104594]: [pid: 104594|app: 0|req: 3/7] 10.222.0.40 () {54 vars in 931 bytes} [Wed Oct 26 12:53:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 12:53:40.886754 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi [None req-0b59be7c-675a-489e-8e1f-70b2bca37d2a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0, "id": "d1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds512M", "vcpus": 1}} {{(pid=104593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 12:53:40.948467 n-d-862686-1 devstack@n-api.service[104593]: INFO nova.api.openstack.requestlog [None req-0b59be7c-675a-489e-8e1f-70b2bca37d2a admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.864552 Oct 26 12:53:40.949058 n-d-862686-1 devstack@n-api.service[104593]: [pid: 104593|app: 0|req: 5/8] 10.222.0.40 () {64 vars in 1283 bytes} [Wed Oct 26 12:53:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 26 12:53:40.963049 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi [None req-3e7b1bcd-9715-490c-b55a-4d5f093a6eea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 12:53:41.018958 n-d-862686-1 devstack@n-api.service[104594]: INFO nova.api.openstack.requestlog [None req-3e7b1bcd-9715-490c-b55a-4d5f093a6eea admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.061358 Oct 26 12:53:41.020150 n-d-862686-1 devstack@n-api.service[104594]: [pid: 104594|app: 0|req: 4/9] 10.222.0.40 () {64 vars in 1336 bytes} [Wed Oct 26 12:53:40 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 12:53:44.097319 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi [None req-0b59be7c-675a-489e-8e1f-70b2bca37d2a admin admin] Calling method '>' {{(pid=104593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 12:53:44.097319 n-d-862686-1 devstack@n-api.service[104593]: INFO nova.api.openstack.requestlog [None req-0b59be7c-675a-489e-8e1f-70b2bca37d2a admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001558 Oct 26 12:53:44.099018 n-d-862686-1 devstack@n-api.service[104593]: [pid: 104593|app: 0|req: 6/10] 10.222.0.40 () {54 vars in 931 bytes} [Wed Oct 26 12:53:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 12:53:44.581910 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi [None req-6d78c72a-ad50-4792-9a21-c4afabd467d0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "ram": 1024, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "disk": 10}} {{(pid=104594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 12:53:44.601850 n-d-862686-1 devstack@n-api.service[104594]: INFO nova.api.openstack.requestlog [None req-6d78c72a-ad50-4792-9a21-c4afabd467d0 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.494304 Oct 26 12:53:44.609631 n-d-862686-1 devstack@n-api.service[104594]: [pid: 104594|app: 0|req: 5/11] 10.222.0.40 () {64 vars in 1283 bytes} [Wed Oct 26 12:53:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 26 12:53:44.614866 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi [None req-e6002fdf-5e45-4cd6-84e6-ea2785b2e87e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 12:53:44.645496 n-d-862686-1 devstack@n-api.service[104593]: INFO nova.api.openstack.requestlog [None req-e6002fdf-5e45-4cd6-84e6-ea2785b2e87e admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034480 Oct 26 12:53:44.653562 n-d-862686-1 devstack@n-api.service[104593]: [pid: 104593|app: 0|req: 7/12] 10.222.0.40 () {64 vars in 1336 bytes} [Wed Oct 26 12:53:44 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 12:53:47.289837 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi [None req-6d78c72a-ad50-4792-9a21-c4afabd467d0 admin admin] Calling method '>' {{(pid=104594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 12:53:47.291496 n-d-862686-1 devstack@n-api.service[104594]: INFO nova.api.openstack.requestlog [None req-6d78c72a-ad50-4792-9a21-c4afabd467d0 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002202 Oct 26 12:53:47.291927 n-d-862686-1 devstack@n-api.service[104594]: [pid: 104594|app: 0|req: 6/13] 10.222.0.40 () {54 vars in 931 bytes} [Wed Oct 26 12:53:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 12:53:47.759511 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi [None req-c7b5d669-af65-41e2-b281-760094088ec2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "ram": 2048, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 2, "name": "ds2G", "rxtx_factor": 1.0}} {{(pid=104593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 12:53:47.780775 n-d-862686-1 devstack@n-api.service[104593]: INFO nova.api.openstack.requestlog [None req-c7b5d669-af65-41e2-b281-760094088ec2 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.481955 Oct 26 12:53:47.788548 n-d-862686-1 devstack@n-api.service[104593]: [pid: 104593|app: 0|req: 8/14] 10.222.0.40 () {64 vars in 1283 bytes} [Wed Oct 26 12:53:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 12:53:47.794819 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi [None req-398e608c-f309-483e-ab70-57bc2a97063b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 12:53:47.830027 n-d-862686-1 devstack@n-api.service[104594]: INFO nova.api.openstack.requestlog [None req-398e608c-f309-483e-ab70-57bc2a97063b admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038975 Oct 26 12:53:47.830639 n-d-862686-1 devstack@n-api.service[104594]: [pid: 104594|app: 0|req: 7/15] 10.222.0.40 () {64 vars in 1336 bytes} [Wed Oct 26 12:53:47 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 12:53:50.535191 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi [None req-c7b5d669-af65-41e2-b281-760094088ec2 admin admin] Calling method '>' {{(pid=104593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 12:53:50.536797 n-d-862686-1 devstack@n-api.service[104593]: INFO nova.api.openstack.requestlog [None req-c7b5d669-af65-41e2-b281-760094088ec2 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002050 Oct 26 12:53:50.554062 n-d-862686-1 devstack@n-api.service[104593]: [pid: 104593|app: 0|req: 9/16] 10.222.0.40 () {54 vars in 931 bytes} [Wed Oct 26 12:53:50 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 12:53:51.010573 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi [None req-0c82a591-c83b-47d6-a69e-75b9d9880f9f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "d4", "rxtx_factor": 1.0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "swap": 0, "disk": 20, "os-flavor-access:is_public": true}} {{(pid=104594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 12:53:51.036512 n-d-862686-1 devstack@n-api.service[104594]: INFO nova.api.openstack.requestlog [None req-0c82a591-c83b-47d6-a69e-75b9d9880f9f admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.492032 Oct 26 12:53:51.050837 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi [None req-79d2d88f-2d4a-40e5-aae8-b88b1582d8e6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 12:53:51.056343 n-d-862686-1 devstack@n-api.service[104594]: [pid: 104594|app: 0|req: 8/17] 10.222.0.40 () {64 vars in 1283 bytes} [Wed Oct 26 12:53:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 26 12:53:51.081775 n-d-862686-1 devstack@n-api.service[104593]: INFO nova.api.openstack.requestlog [None req-79d2d88f-2d4a-40e5-aae8-b88b1582d8e6 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034654 Oct 26 12:53:51.091317 n-d-862686-1 devstack@n-api.service[104593]: [pid: 104593|app: 0|req: 10/18] 10.222.0.40 () {64 vars in 1336 bytes} [Wed Oct 26 12:53:51 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 12:53:53.747849 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi [None req-0c82a591-c83b-47d6-a69e-75b9d9880f9f admin admin] Calling method '>' {{(pid=104594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 12:53:53.748892 n-d-862686-1 devstack@n-api.service[104594]: INFO nova.api.openstack.requestlog [None req-0c82a591-c83b-47d6-a69e-75b9d9880f9f admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Oct 26 12:53:53.749303 n-d-862686-1 devstack@n-api.service[104594]: [pid: 104594|app: 0|req: 9/19] 10.222.0.40 () {54 vars in 931 bytes} [Wed Oct 26 12:53:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 12:53:54.174746 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi [None req-a6760bed-ebc7-442e-be26-e4c2eafb7fba admin admin] Calling method '>' {{(pid=104593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 12:53:54.199603 n-d-862686-1 devstack@n-api.service[104593]: INFO nova.api.openstack.requestlog [None req-a6760bed-ebc7-442e-be26-e4c2eafb7fba admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.444069 Oct 26 12:53:54.200141 n-d-862686-1 devstack@n-api.service[104593]: [pid: 104593|app: 0|req: 11/20] 10.222.0.40 () {60 vars in 1292 bytes} [Wed Oct 26 12:53:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 12:53:57.443991 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi [None req-0c82a591-c83b-47d6-a69e-75b9d9880f9f admin admin] Calling method '>' {{(pid=104594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 12:53:57.444929 n-d-862686-1 devstack@n-api.service[104594]: INFO nova.api.openstack.requestlog [None req-0c82a591-c83b-47d6-a69e-75b9d9880f9f admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Oct 26 12:53:57.445502 n-d-862686-1 devstack@n-api.service[104594]: [pid: 104594|app: 0|req: 10/21] 10.222.0.40 () {54 vars in 931 bytes} [Wed Oct 26 12:53:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 12:53:57.860898 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi [None req-d24d24d7-aa49-4c70-aade-b4554648a5c5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "1", "ram": 512, "os-flavor-access:is_public": true, "name": "m1.tiny", "disk": 1, "swap": 0, "vcpus": 1}} {{(pid=104593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 12:53:57.885797 n-d-862686-1 devstack@n-api.service[104593]: INFO nova.api.openstack.requestlog [None req-d24d24d7-aa49-4c70-aade-b4554648a5c5 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.433948 Oct 26 12:53:57.886369 n-d-862686-1 devstack@n-api.service[104593]: [pid: 104593|app: 0|req: 12/22] 10.222.0.40 () {64 vars in 1283 bytes} [Wed Oct 26 12:53:57 2022] POST /compute/v2.1/flavors => generated 402 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 12:53:57.899109 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi [None req-7db25de8-f875-4b3f-86d6-878bdcd23919 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 12:53:57.926947 n-d-862686-1 devstack@n-api.service[104594]: INFO nova.api.openstack.requestlog [None req-7db25de8-f875-4b3f-86d6-878bdcd23919 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031827 Oct 26 12:53:57.927540 n-d-862686-1 devstack@n-api.service[104594]: [pid: 104594|app: 0|req: 11/23] 10.222.0.40 () {64 vars in 1333 bytes} [Wed Oct 26 12:53:57 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 12:54:00.535364 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi [None req-d24d24d7-aa49-4c70-aade-b4554648a5c5 admin admin] Calling method '>' {{(pid=104593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 12:54:00.536381 n-d-862686-1 devstack@n-api.service[104593]: INFO nova.api.openstack.requestlog [None req-d24d24d7-aa49-4c70-aade-b4554648a5c5 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Oct 26 12:54:00.536794 n-d-862686-1 devstack@n-api.service[104593]: [pid: 104593|app: 0|req: 13/24] 10.222.0.40 () {54 vars in 931 bytes} [Wed Oct 26 12:54:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 12:54:00.929213 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi [None req-10cbfb58-171d-4496-8f19-13dd31e9e6cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "name": "m1.small", "id": "2", "disk": 20}} {{(pid=104594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 12:54:00.950697 n-d-862686-1 devstack@n-api.service[104594]: INFO nova.api.openstack.requestlog [None req-10cbfb58-171d-4496-8f19-13dd31e9e6cd admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.407338 Oct 26 12:54:00.951258 n-d-862686-1 devstack@n-api.service[104594]: [pid: 104594|app: 0|req: 12/25] 10.222.0.40 () {64 vars in 1283 bytes} [Wed Oct 26 12:54:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 12:54:00.963366 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi [None req-4f729648-d9e1-4790-ace9-f9949bc01fd4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 12:54:00.988412 n-d-862686-1 devstack@n-api.service[104593]: INFO nova.api.openstack.requestlog [None req-4f729648-d9e1-4790-ace9-f9949bc01fd4 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028847 Oct 26 12:54:00.988988 n-d-862686-1 devstack@n-api.service[104593]: [pid: 104593|app: 0|req: 14/26] 10.222.0.40 () {64 vars in 1333 bytes} [Wed Oct 26 12:54:00 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 12:54:03.610552 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi [None req-10cbfb58-171d-4496-8f19-13dd31e9e6cd admin admin] Calling method '>' {{(pid=104594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 12:54:03.611562 n-d-862686-1 devstack@n-api.service[104594]: INFO nova.api.openstack.requestlog [None req-10cbfb58-171d-4496-8f19-13dd31e9e6cd admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Oct 26 12:54:03.612229 n-d-862686-1 devstack@n-api.service[104594]: [pid: 104594|app: 0|req: 13/27] 10.222.0.40 () {54 vars in 931 bytes} [Wed Oct 26 12:54:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 12:54:03.973949 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi [None req-6b53cff3-82b1-4f54-b543-e8b2ad4bbb32 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "swap": 0, "vcpus": 2, "ram": 4096, "name": "m1.medium"}} {{(pid=104593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 12:54:04.000623 n-d-862686-1 devstack@n-api.service[104593]: INFO nova.api.openstack.requestlog [None req-6b53cff3-82b1-4f54-b543-e8b2ad4bbb32 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.381600 Oct 26 12:54:04.001178 n-d-862686-1 devstack@n-api.service[104593]: [pid: 104593|app: 0|req: 15/28] 10.222.0.40 () {64 vars in 1283 bytes} [Wed Oct 26 12:54:03 2022] POST /compute/v2.1/flavors => generated 406 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 12:54:04.013636 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi [None req-11815135-c048-4d7b-822e-b9b73e51a749 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 12:54:04.018580 n-d-862686-1 devstack@n-api.service[104594]: DEBUG dbcounter [-] [104594] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=104594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 12:54:04.044475 n-d-862686-1 devstack@n-api.service[104594]: INFO nova.api.openstack.requestlog [None req-11815135-c048-4d7b-822e-b9b73e51a749 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034556 Oct 26 12:54:04.045546 n-d-862686-1 devstack@n-api.service[104594]: [pid: 104594|app: 0|req: 14/29] 10.222.0.40 () {64 vars in 1333 bytes} [Wed Oct 26 12:54:04 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 12:54:06.791970 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi [None req-6b53cff3-82b1-4f54-b543-e8b2ad4bbb32 admin admin] Calling method '>' {{(pid=104593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 12:54:06.792978 n-d-862686-1 devstack@n-api.service[104593]: INFO nova.api.openstack.requestlog [None req-6b53cff3-82b1-4f54-b543-e8b2ad4bbb32 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Oct 26 12:54:06.794841 n-d-862686-1 devstack@n-api.service[104593]: [pid: 104593|app: 0|req: 16/30] 10.222.0.40 () {54 vars in 931 bytes} [Wed Oct 26 12:54:06 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 12:54:07.236328 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi [None req-274fd3a9-fd1d-44ff-8bd5-0f182c7ff701 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "4", "os-flavor-access:is_public": true, "swap": 0, "disk": 80, "ram": 8192, "name": "m1.large"}} {{(pid=104594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 12:54:07.257958 n-d-862686-1 devstack@n-api.service[104594]: INFO nova.api.openstack.requestlog [None req-274fd3a9-fd1d-44ff-8bd5-0f182c7ff701 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.456350 Oct 26 12:54:07.266074 n-d-862686-1 devstack@n-api.service[104594]: [pid: 104594|app: 0|req: 15/31] 10.222.0.40 () {64 vars in 1283 bytes} [Wed Oct 26 12:54:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 12:54:07.271148 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi [None req-50230a52-d655-4290-9818-cf9789dadb82 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 12:54:07.300074 n-d-862686-1 devstack@n-api.service[104593]: INFO nova.api.openstack.requestlog [None req-50230a52-d655-4290-9818-cf9789dadb82 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032565 Oct 26 12:54:07.300811 n-d-862686-1 devstack@n-api.service[104593]: [pid: 104593|app: 0|req: 17/32] 10.222.0.40 () {64 vars in 1333 bytes} [Wed Oct 26 12:54:07 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 12:54:09.939799 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi [None req-274fd3a9-fd1d-44ff-8bd5-0f182c7ff701 admin admin] Calling method '>' {{(pid=104594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 12:54:09.940807 n-d-862686-1 devstack@n-api.service[104594]: INFO nova.api.openstack.requestlog [None req-274fd3a9-fd1d-44ff-8bd5-0f182c7ff701 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Oct 26 12:54:09.941370 n-d-862686-1 devstack@n-api.service[104594]: [pid: 104594|app: 0|req: 16/33] 10.222.0.40 () {54 vars in 931 bytes} [Wed Oct 26 12:54:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 12:54:10.386466 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi [None req-019394a4-a044-4ffb-9193-b1fe05fe315e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 160, "ram": 16384, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "5", "name": "m1.xlarge", "swap": 0}} {{(pid=104593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 12:54:10.396042 n-d-862686-1 devstack@n-api.service[104593]: DEBUG dbcounter [-] [104593] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=104593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 12:54:10.411801 n-d-862686-1 devstack@n-api.service[104593]: INFO nova.api.openstack.requestlog [None req-019394a4-a044-4ffb-9193-b1fe05fe315e admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.464035 Oct 26 12:54:10.412351 n-d-862686-1 devstack@n-api.service[104593]: [pid: 104593|app: 0|req: 18/34] 10.222.0.40 () {64 vars in 1283 bytes} [Wed Oct 26 12:54:09 2022] POST /compute/v2.1/flavors => generated 408 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 12:54:10.424820 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi [None req-bc2c3a81-60b5-49e0-8935-c5d3470b436b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 12:54:10.451220 n-d-862686-1 devstack@n-api.service[104594]: INFO nova.api.openstack.requestlog [None req-bc2c3a81-60b5-49e0-8935-c5d3470b436b admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029953 Oct 26 12:54:10.451719 n-d-862686-1 devstack@n-api.service[104594]: [pid: 104594|app: 0|req: 17/35] 10.222.0.40 () {64 vars in 1333 bytes} [Wed Oct 26 12:54:10 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 12:54:31.334389 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi [None req-019394a4-a044-4ffb-9193-b1fe05fe315e admin admin] Calling method '>' {{(pid=104593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 12:54:31.335402 n-d-862686-1 devstack@n-api.service[104593]: INFO nova.api.openstack.requestlog [None req-019394a4-a044-4ffb-9193-b1fe05fe315e admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Oct 26 12:54:31.335801 n-d-862686-1 devstack@n-api.service[104593]: [pid: 104593|app: 0|req: 19/36] 10.222.0.40 () {54 vars in 931 bytes} [Wed Oct 26 12:54:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 12:54:31.346887 n-d-862686-1 devstack@n-api.service[104594]: DEBUG dbcounter [-] [104594] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=104594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 12:54:31.734857 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi [None req-7df74191-bfc4-48c6-869a-3877e4bfaae6 admin admin] Calling method '>' {{(pid=104594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 12:54:31.753205 n-d-862686-1 devstack@n-api.service[104594]: INFO nova.api.openstack.requestlog [None req-7df74191-bfc4-48c6-869a-3877e4bfaae6 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.410762 Oct 26 12:54:31.753698 n-d-862686-1 devstack@n-api.service[104594]: [pid: 104594|app: 0|req: 18/37] 10.222.0.40 () {60 vars in 1292 bytes} [Wed Oct 26 12:54:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 12:54:33.068942 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi [None req-019394a4-a044-4ffb-9193-b1fe05fe315e admin admin] Calling method '>' {{(pid=104593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 12:54:33.070034 n-d-862686-1 devstack@n-api.service[104593]: INFO nova.api.openstack.requestlog [None req-019394a4-a044-4ffb-9193-b1fe05fe315e admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Oct 26 12:54:33.070421 n-d-862686-1 devstack@n-api.service[104593]: [pid: 104593|app: 0|req: 20/38] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Oct 26 12:54:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 12:54:33.619958 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi [None req-78aefe17-7fb2-4aaa-9833-9af2f2c30c12 admin admin] Calling method '>' {{(pid=104594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 12:54:33.625230 n-d-862686-1 devstack@n-api.service[104594]: INFO nova.api.openstack.wsgi [None req-78aefe17-7fb2-4aaa-9833-9af2f2c30c12 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 26 12:54:33.628442 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi [None req-78aefe17-7fb2-4aaa-9833-9af2f2c30c12 admin admin] Request method failure captured: Oct 26 12:54:33.628442 n-d-862686-1 devstack@n-api.service[104594]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 26 12:54:33.628442 n-d-862686-1 devstack@n-api.service[104594]: Accept: application/json Oct 26 12:54:33.628442 n-d-862686-1 devstack@n-api.service[104594]: Accept-Encoding: gzip, deflate Oct 26 12:54:33.628442 n-d-862686-1 devstack@n-api.service[104594]: Connection: keep-alive Oct 26 12:54:33.628442 n-d-862686-1 devstack@n-api.service[104594]: Content-Length: 0 Oct 26 12:54:33.628442 n-d-862686-1 devstack@n-api.service[104594]: Host: 10.222.0.40 Oct 26 12:54:33.628442 n-d-862686-1 devstack@n-api.service[104594]: Openstack-Api-Version: compute 2.92 Oct 26 12:54:33.628442 n-d-862686-1 devstack@n-api.service[104594]: Openstack-System-Scope: None Oct 26 12:54:33.628442 n-d-862686-1 devstack@n-api.service[104594]: User-Agent: python-novaclient Oct 26 12:54:33.628442 n-d-862686-1 devstack@n-api.service[104594]: X-Auth-Token: gAAAAABjWS4I_7x4VRgLEAMnanVIlSdbTC6nhLEzfyW03JaroxPbKwj_I3tK75yDW4OA4P9Ev5eJe10XzCcoCkIGbBuSasaifGF7RjZ-l5YKHlzugvsndOk-NQtP77GO4fUqfpfB94CLr_uA1IeVn165ydJrdQkjdw4JNBscRacxMsaQEw1Rw1k Oct 26 12:54:33.628442 n-d-862686-1 devstack@n-api.service[104594]: X-Domain-Id: None Oct 26 12:54:33.628442 n-d-862686-1 devstack@n-api.service[104594]: X-Domain-Name: None Oct 26 12:54:33.628442 n-d-862686-1 devstack@n-api.service[104594]: X-Identity-Status: Confirmed Oct 26 12:54:33.628442 n-d-862686-1 devstack@n-api.service[104594]: X-Is-Admin-Project: True Oct 26 12:54:33.628442 n-d-862686-1 devstack@n-api.service[104594]: X-Openstack-Nova-Api-Version: 2.92 Oct 26 12:54:33.628442 n-d-862686-1 devstack@n-api.service[104594]: X-Project-Domain-Id: default Oct 26 12:54:33.628442 n-d-862686-1 devstack@n-api.service[104594]: X-Project-Domain-Name: Default Oct 26 12:54:33.628442 n-d-862686-1 devstack@n-api.service[104594]: X-Project-Id: a7f94c509007485eababf73351c71bc7 Oct 26 12:54:33.628442 n-d-862686-1 devstack@n-api.service[104594]: X-Project-Name: admin Oct 26 12:54:33.628442 n-d-862686-1 devstack@n-api.service[104594]: X-Role: admin,member,reader Oct 26 12:54:33.628442 n-d-862686-1 devstack@n-api.service[104594]: X-Roles: admin,member,reader Oct 26 12:54:33.630076 n-d-862686-1 devstack@n-api.service[104594]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a7f94c509007485eababf73351c71bc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a7f94c509007485eababf73351c71bc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a7f94c509007485eababf73351c71bc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a7f94c509007485eababf73351c71bc7"}]}] Oct 26 12:54:33.630076 n-d-862686-1 devstack@n-api.service[104594]: X-Tenant: admin Oct 26 12:54:33.630076 n-d-862686-1 devstack@n-api.service[104594]: X-Tenant-Id: a7f94c509007485eababf73351c71bc7 Oct 26 12:54:33.630076 n-d-862686-1 devstack@n-api.service[104594]: X-Tenant-Name: admin Oct 26 12:54:33.630076 n-d-862686-1 devstack@n-api.service[104594]: X-User: admin Oct 26 12:54:33.630076 n-d-862686-1 devstack@n-api.service[104594]: X-User-Domain-Id: default Oct 26 12:54:33.630076 n-d-862686-1 devstack@n-api.service[104594]: X-User-Domain-Name: Default Oct 26 12:54:33.630076 n-d-862686-1 devstack@n-api.service[104594]: X-User-Id: 6fb5207776a84aff85c5c1a278383c7f Oct 26 12:54:33.630076 n-d-862686-1 devstack@n-api.service[104594]: X-User-Name: admin Oct 26 12:54:33.630076 n-d-862686-1 devstack@n-api.service[104594]: method: > Oct 26 12:54:33.630076 n-d-862686-1 devstack@n-api.service[104594]: exception: Flavor 42 could not be found. Oct 26 12:54:33.630076 n-d-862686-1 devstack@n-api.service[104594]: action_args: {'id': '42'} Oct 26 12:54:33.630076 n-d-862686-1 devstack@n-api.service[104594]: {{(pid=104594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 12:54:33.630076 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 12:54:33.631149 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 26 12:54:33.631149 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 26 12:54:33.631149 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 26 12:54:33.631149 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 26 12:54:33.631149 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 12:54:33.631149 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 12:54:33.631149 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 26 12:54:33.631149 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 26 12:54:33.631149 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 26 12:54:33.631149 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 12:54:33.631149 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 26 12:54:33.631149 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 26 12:54:33.631149 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 26 12:54:33.631149 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi Oct 26 12:54:33.631149 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 12:54:33.631149 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi Oct 26 12:54:33.631149 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 12:54:33.631149 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 12:54:33.631149 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 12:54:33.632917 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 12:54:33.632917 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 12:54:33.632917 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 12:54:33.632917 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 12:54:33.632917 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 26 12:54:33.632917 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 12:54:33.632917 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 26 12:54:33.632917 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi Oct 26 12:54:33.632917 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 12:54:33.632917 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi Oct 26 12:54:33.632917 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 12:54:33.632917 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 12:54:33.632917 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 12:54:33.632917 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 12:54:33.632917 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 12:54:33.632917 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 26 12:54:33.632917 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi Oct 26 12:54:33.632917 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi [None req-78aefe17-7fb2-4aaa-9833-9af2f2c30c12 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 12:54:33.635018 n-d-862686-1 devstack@n-api.service[104594]: INFO nova.api.openstack.requestlog [None req-78aefe17-7fb2-4aaa-9833-9af2f2c30c12 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.395071 Oct 26 12:54:33.635018 n-d-862686-1 devstack@n-api.service[104594]: [pid: 104594|app: 0|req: 19/39] 10.222.0.40 () {60 vars in 1190 bytes} [Wed Oct 26 12:54:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 26 12:54:33.640871 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi [None req-c6fa0dfc-a792-4d2c-b761-b744d69ba328 admin admin] Calling method '>' {{(pid=104593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 12:54:33.662789 n-d-862686-1 devstack@n-api.service[104593]: INFO nova.api.openstack.requestlog [None req-c6fa0dfc-a792-4d2c-b761-b744d69ba328 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026124 Oct 26 12:54:33.663334 n-d-862686-1 devstack@n-api.service[104593]: [pid: 104593|app: 0|req: 21/40] 10.222.0.40 () {60 vars in 1210 bytes} [Wed Oct 26 12:54:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 12:54:33.674561 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi [None req-053a0e76-caa9-4b1f-b286-a3b08a0b785e admin admin] Calling method '>' {{(pid=104594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 12:54:33.696653 n-d-862686-1 devstack@n-api.service[104594]: INFO nova.api.openstack.requestlog [None req-053a0e76-caa9-4b1f-b286-a3b08a0b785e admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026484 Oct 26 12:54:33.697182 n-d-862686-1 devstack@n-api.service[104594]: [pid: 104594|app: 0|req: 20/41] 10.222.0.40 () {60 vars in 1210 bytes} [Wed Oct 26 12:54:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 12:54:33.706360 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi [None req-be7d9081-1466-4252-986e-bf66257bc4cc admin admin] Calling method '>' {{(pid=104593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 12:54:33.711607 n-d-862686-1 devstack@n-api.service[104593]: INFO nova.api.openstack.wsgi [None req-be7d9081-1466-4252-986e-bf66257bc4cc admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 26 12:54:33.714860 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi [None req-be7d9081-1466-4252-986e-bf66257bc4cc admin admin] Request method failure captured: Oct 26 12:54:33.714860 n-d-862686-1 devstack@n-api.service[104593]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 26 12:54:33.714860 n-d-862686-1 devstack@n-api.service[104593]: Accept: application/json Oct 26 12:54:33.714860 n-d-862686-1 devstack@n-api.service[104593]: Accept-Encoding: gzip, deflate Oct 26 12:54:33.714860 n-d-862686-1 devstack@n-api.service[104593]: Connection: keep-alive Oct 26 12:54:33.714860 n-d-862686-1 devstack@n-api.service[104593]: Content-Length: 0 Oct 26 12:54:33.714860 n-d-862686-1 devstack@n-api.service[104593]: Host: 10.222.0.40 Oct 26 12:54:33.714860 n-d-862686-1 devstack@n-api.service[104593]: Openstack-Api-Version: compute 2.92 Oct 26 12:54:33.714860 n-d-862686-1 devstack@n-api.service[104593]: Openstack-System-Scope: None Oct 26 12:54:33.714860 n-d-862686-1 devstack@n-api.service[104593]: User-Agent: python-novaclient Oct 26 12:54:33.714860 n-d-862686-1 devstack@n-api.service[104593]: X-Auth-Token: gAAAAABjWS4I_7x4VRgLEAMnanVIlSdbTC6nhLEzfyW03JaroxPbKwj_I3tK75yDW4OA4P9Ev5eJe10XzCcoCkIGbBuSasaifGF7RjZ-l5YKHlzugvsndOk-NQtP77GO4fUqfpfB94CLr_uA1IeVn165ydJrdQkjdw4JNBscRacxMsaQEw1Rw1k Oct 26 12:54:33.714860 n-d-862686-1 devstack@n-api.service[104593]: X-Domain-Id: None Oct 26 12:54:33.714860 n-d-862686-1 devstack@n-api.service[104593]: X-Domain-Name: None Oct 26 12:54:33.714860 n-d-862686-1 devstack@n-api.service[104593]: X-Identity-Status: Confirmed Oct 26 12:54:33.714860 n-d-862686-1 devstack@n-api.service[104593]: X-Is-Admin-Project: True Oct 26 12:54:33.714860 n-d-862686-1 devstack@n-api.service[104593]: X-Openstack-Nova-Api-Version: 2.92 Oct 26 12:54:33.714860 n-d-862686-1 devstack@n-api.service[104593]: X-Project-Domain-Id: default Oct 26 12:54:33.714860 n-d-862686-1 devstack@n-api.service[104593]: X-Project-Domain-Name: Default Oct 26 12:54:33.714860 n-d-862686-1 devstack@n-api.service[104593]: X-Project-Id: a7f94c509007485eababf73351c71bc7 Oct 26 12:54:33.714860 n-d-862686-1 devstack@n-api.service[104593]: X-Project-Name: admin Oct 26 12:54:33.714860 n-d-862686-1 devstack@n-api.service[104593]: X-Role: admin,member,reader Oct 26 12:54:33.714860 n-d-862686-1 devstack@n-api.service[104593]: X-Roles: admin,member,reader Oct 26 12:54:33.716378 n-d-862686-1 devstack@n-api.service[104593]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a7f94c509007485eababf73351c71bc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a7f94c509007485eababf73351c71bc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a7f94c509007485eababf73351c71bc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a7f94c509007485eababf73351c71bc7"}]}] Oct 26 12:54:33.716378 n-d-862686-1 devstack@n-api.service[104593]: X-Tenant: admin Oct 26 12:54:33.716378 n-d-862686-1 devstack@n-api.service[104593]: X-Tenant-Id: a7f94c509007485eababf73351c71bc7 Oct 26 12:54:33.716378 n-d-862686-1 devstack@n-api.service[104593]: X-Tenant-Name: admin Oct 26 12:54:33.716378 n-d-862686-1 devstack@n-api.service[104593]: X-User: admin Oct 26 12:54:33.716378 n-d-862686-1 devstack@n-api.service[104593]: X-User-Domain-Id: default Oct 26 12:54:33.716378 n-d-862686-1 devstack@n-api.service[104593]: X-User-Domain-Name: Default Oct 26 12:54:33.716378 n-d-862686-1 devstack@n-api.service[104593]: X-User-Id: 6fb5207776a84aff85c5c1a278383c7f Oct 26 12:54:33.716378 n-d-862686-1 devstack@n-api.service[104593]: X-User-Name: admin Oct 26 12:54:33.716378 n-d-862686-1 devstack@n-api.service[104593]: method: > Oct 26 12:54:33.716378 n-d-862686-1 devstack@n-api.service[104593]: exception: Flavor 42 could not be found. Oct 26 12:54:33.716378 n-d-862686-1 devstack@n-api.service[104593]: action_args: {'id': '42'} Oct 26 12:54:33.716378 n-d-862686-1 devstack@n-api.service[104593]: {{(pid=104593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 12:54:33.716378 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 12:54:33.717352 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 26 12:54:33.717352 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 26 12:54:33.717352 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 26 12:54:33.717352 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 26 12:54:33.717352 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 12:54:33.717352 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 12:54:33.717352 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 26 12:54:33.717352 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 26 12:54:33.717352 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 26 12:54:33.717352 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 12:54:33.717352 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 26 12:54:33.717352 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 26 12:54:33.717352 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 26 12:54:33.717352 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi Oct 26 12:54:33.717352 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 12:54:33.717352 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi Oct 26 12:54:33.717352 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 12:54:33.717352 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 12:54:33.717352 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 12:54:33.719022 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 12:54:33.719022 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 12:54:33.719022 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 12:54:33.719022 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 12:54:33.719022 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 26 12:54:33.719022 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 12:54:33.719022 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 26 12:54:33.719022 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi Oct 26 12:54:33.719022 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 12:54:33.719022 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi Oct 26 12:54:33.719022 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 12:54:33.719022 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 12:54:33.719022 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 12:54:33.719022 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 12:54:33.719022 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 12:54:33.719022 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 26 12:54:33.719022 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi Oct 26 12:54:33.719022 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi [None req-be7d9081-1466-4252-986e-bf66257bc4cc admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 12:54:33.720230 n-d-862686-1 devstack@n-api.service[104593]: INFO nova.api.openstack.requestlog [None req-be7d9081-1466-4252-986e-bf66257bc4cc admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013461 Oct 26 12:54:33.720230 n-d-862686-1 devstack@n-api.service[104593]: [pid: 104593|app: 0|req: 22/42] 10.222.0.40 () {60 vars in 1190 bytes} [Wed Oct 26 12:54:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 26 12:54:34.933613 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi [None req-053a0e76-caa9-4b1f-b286-a3b08a0b785e admin admin] Calling method '>' {{(pid=104594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 12:54:34.934626 n-d-862686-1 devstack@n-api.service[104594]: INFO nova.api.openstack.requestlog [None req-053a0e76-caa9-4b1f-b286-a3b08a0b785e admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Oct 26 12:54:34.935032 n-d-862686-1 devstack@n-api.service[104594]: [pid: 104594|app: 0|req: 21/43] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Oct 26 12:54:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 12:54:35.462148 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi [None req-524d5880-daab-4779-b269-8c02c95a4c7b admin admin] Calling method '>' {{(pid=104593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 12:54:35.467149 n-d-862686-1 devstack@n-api.service[104593]: INFO nova.api.openstack.wsgi [None req-524d5880-daab-4779-b269-8c02c95a4c7b admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 26 12:54:35.468628 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi [None req-524d5880-daab-4779-b269-8c02c95a4c7b admin admin] Request method failure captured: Oct 26 12:54:35.468628 n-d-862686-1 devstack@n-api.service[104593]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 26 12:54:35.468628 n-d-862686-1 devstack@n-api.service[104593]: Accept: application/json Oct 26 12:54:35.468628 n-d-862686-1 devstack@n-api.service[104593]: Accept-Encoding: gzip, deflate Oct 26 12:54:35.468628 n-d-862686-1 devstack@n-api.service[104593]: Connection: keep-alive Oct 26 12:54:35.468628 n-d-862686-1 devstack@n-api.service[104593]: Content-Length: 0 Oct 26 12:54:35.468628 n-d-862686-1 devstack@n-api.service[104593]: Host: 10.222.0.40 Oct 26 12:54:35.468628 n-d-862686-1 devstack@n-api.service[104593]: Openstack-Api-Version: compute 2.92 Oct 26 12:54:35.468628 n-d-862686-1 devstack@n-api.service[104593]: Openstack-System-Scope: None Oct 26 12:54:35.468628 n-d-862686-1 devstack@n-api.service[104593]: User-Agent: python-novaclient Oct 26 12:54:35.468628 n-d-862686-1 devstack@n-api.service[104593]: X-Auth-Token: gAAAAABjWS4Kag2exxoHbTrTUeU18W9Gf23uGd3gE59cwkxwfzWxMRnVDLK0y7yVvZ33wwI7tFPdtqv1IxIrCOyNor_OYWKRljnhLOhNMSMBUZxSR0SLG6orQQERXSoBP75UmFYbcpUZZ9tQpAfSKMZVHtIm1N6oIssqoIw99pLT7OUWqD8LJ50 Oct 26 12:54:35.468628 n-d-862686-1 devstack@n-api.service[104593]: X-Domain-Id: None Oct 26 12:54:35.468628 n-d-862686-1 devstack@n-api.service[104593]: X-Domain-Name: None Oct 26 12:54:35.468628 n-d-862686-1 devstack@n-api.service[104593]: X-Identity-Status: Confirmed Oct 26 12:54:35.468628 n-d-862686-1 devstack@n-api.service[104593]: X-Is-Admin-Project: True Oct 26 12:54:35.468628 n-d-862686-1 devstack@n-api.service[104593]: X-Openstack-Nova-Api-Version: 2.92 Oct 26 12:54:35.468628 n-d-862686-1 devstack@n-api.service[104593]: X-Project-Domain-Id: default Oct 26 12:54:35.468628 n-d-862686-1 devstack@n-api.service[104593]: X-Project-Domain-Name: Default Oct 26 12:54:35.468628 n-d-862686-1 devstack@n-api.service[104593]: X-Project-Id: a7f94c509007485eababf73351c71bc7 Oct 26 12:54:35.468628 n-d-862686-1 devstack@n-api.service[104593]: X-Project-Name: admin Oct 26 12:54:35.468628 n-d-862686-1 devstack@n-api.service[104593]: X-Role: admin,member,reader Oct 26 12:54:35.468628 n-d-862686-1 devstack@n-api.service[104593]: X-Roles: admin,member,reader Oct 26 12:54:35.470142 n-d-862686-1 devstack@n-api.service[104593]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a7f94c509007485eababf73351c71bc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a7f94c509007485eababf73351c71bc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a7f94c509007485eababf73351c71bc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a7f94c509007485eababf73351c71bc7"}]}] Oct 26 12:54:35.470142 n-d-862686-1 devstack@n-api.service[104593]: X-Tenant: admin Oct 26 12:54:35.470142 n-d-862686-1 devstack@n-api.service[104593]: X-Tenant-Id: a7f94c509007485eababf73351c71bc7 Oct 26 12:54:35.470142 n-d-862686-1 devstack@n-api.service[104593]: X-Tenant-Name: admin Oct 26 12:54:35.470142 n-d-862686-1 devstack@n-api.service[104593]: X-User: admin Oct 26 12:54:35.470142 n-d-862686-1 devstack@n-api.service[104593]: X-User-Domain-Id: default Oct 26 12:54:35.470142 n-d-862686-1 devstack@n-api.service[104593]: X-User-Domain-Name: Default Oct 26 12:54:35.470142 n-d-862686-1 devstack@n-api.service[104593]: X-User-Id: 6fb5207776a84aff85c5c1a278383c7f Oct 26 12:54:35.470142 n-d-862686-1 devstack@n-api.service[104593]: X-User-Name: admin Oct 26 12:54:35.470142 n-d-862686-1 devstack@n-api.service[104593]: method: > Oct 26 12:54:35.470142 n-d-862686-1 devstack@n-api.service[104593]: exception: Flavor 84 could not be found. Oct 26 12:54:35.470142 n-d-862686-1 devstack@n-api.service[104593]: action_args: {'id': '84'} Oct 26 12:54:35.470142 n-d-862686-1 devstack@n-api.service[104593]: {{(pid=104593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 12:54:35.470142 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 12:54:35.471041 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 26 12:54:35.471041 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 26 12:54:35.471041 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 26 12:54:35.471041 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 26 12:54:35.471041 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 12:54:35.471041 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 12:54:35.471041 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 26 12:54:35.471041 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 26 12:54:35.471041 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 26 12:54:35.471041 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 12:54:35.471041 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 26 12:54:35.471041 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 26 12:54:35.471041 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 26 12:54:35.471041 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi Oct 26 12:54:35.471041 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 12:54:35.471041 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi Oct 26 12:54:35.471041 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 12:54:35.471041 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 12:54:35.471041 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 12:54:35.472385 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 12:54:35.472385 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 12:54:35.472385 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 12:54:35.472385 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 12:54:35.472385 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 26 12:54:35.472385 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 12:54:35.472385 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 26 12:54:35.472385 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi Oct 26 12:54:35.472385 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 12:54:35.472385 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi Oct 26 12:54:35.472385 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 12:54:35.472385 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 12:54:35.472385 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 12:54:35.472385 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 12:54:35.472385 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 12:54:35.472385 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 26 12:54:35.472385 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi Oct 26 12:54:35.472385 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi [None req-524d5880-daab-4779-b269-8c02c95a4c7b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 12:54:35.473684 n-d-862686-1 devstack@n-api.service[104593]: INFO nova.api.openstack.requestlog [None req-524d5880-daab-4779-b269-8c02c95a4c7b admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.399388 Oct 26 12:54:35.473684 n-d-862686-1 devstack@n-api.service[104593]: [pid: 104593|app: 0|req: 23/44] 10.222.0.40 () {60 vars in 1190 bytes} [Wed Oct 26 12:54:35 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 26 12:54:35.480480 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi [None req-774ca7b0-e8b5-4edf-9f5f-7108fba7cdec admin admin] Calling method '>' {{(pid=104594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 12:54:35.496635 n-d-862686-1 devstack@n-api.service[104594]: INFO nova.api.openstack.requestlog [None req-774ca7b0-e8b5-4edf-9f5f-7108fba7cdec admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020336 Oct 26 12:54:35.497164 n-d-862686-1 devstack@n-api.service[104594]: [pid: 104594|app: 0|req: 22/45] 10.222.0.40 () {60 vars in 1210 bytes} [Wed Oct 26 12:54:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 12:54:35.506786 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi [None req-44a445c2-ae14-499a-abc5-ae4b674b74f3 admin admin] Calling method '>' {{(pid=104593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 12:54:35.522217 n-d-862686-1 devstack@n-api.service[104593]: INFO nova.api.openstack.requestlog [None req-44a445c2-ae14-499a-abc5-ae4b674b74f3 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019279 Oct 26 12:54:35.522737 n-d-862686-1 devstack@n-api.service[104593]: [pid: 104593|app: 0|req: 24/46] 10.222.0.40 () {60 vars in 1210 bytes} [Wed Oct 26 12:54:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 12:54:35.532763 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi [None req-e126f29a-f558-41bc-9d89-9b0593b26fb7 admin admin] Calling method '>' {{(pid=104594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 12:54:35.537672 n-d-862686-1 devstack@n-api.service[104594]: INFO nova.api.openstack.wsgi [None req-e126f29a-f558-41bc-9d89-9b0593b26fb7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 26 12:54:35.539154 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi [None req-e126f29a-f558-41bc-9d89-9b0593b26fb7 admin admin] Request method failure captured: Oct 26 12:54:35.539154 n-d-862686-1 devstack@n-api.service[104594]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 26 12:54:35.539154 n-d-862686-1 devstack@n-api.service[104594]: Accept: application/json Oct 26 12:54:35.539154 n-d-862686-1 devstack@n-api.service[104594]: Accept-Encoding: gzip, deflate Oct 26 12:54:35.539154 n-d-862686-1 devstack@n-api.service[104594]: Connection: keep-alive Oct 26 12:54:35.539154 n-d-862686-1 devstack@n-api.service[104594]: Content-Length: 0 Oct 26 12:54:35.539154 n-d-862686-1 devstack@n-api.service[104594]: Host: 10.222.0.40 Oct 26 12:54:35.539154 n-d-862686-1 devstack@n-api.service[104594]: Openstack-Api-Version: compute 2.92 Oct 26 12:54:35.539154 n-d-862686-1 devstack@n-api.service[104594]: Openstack-System-Scope: None Oct 26 12:54:35.539154 n-d-862686-1 devstack@n-api.service[104594]: User-Agent: python-novaclient Oct 26 12:54:35.539154 n-d-862686-1 devstack@n-api.service[104594]: X-Auth-Token: gAAAAABjWS4Kag2exxoHbTrTUeU18W9Gf23uGd3gE59cwkxwfzWxMRnVDLK0y7yVvZ33wwI7tFPdtqv1IxIrCOyNor_OYWKRljnhLOhNMSMBUZxSR0SLG6orQQERXSoBP75UmFYbcpUZZ9tQpAfSKMZVHtIm1N6oIssqoIw99pLT7OUWqD8LJ50 Oct 26 12:54:35.539154 n-d-862686-1 devstack@n-api.service[104594]: X-Domain-Id: None Oct 26 12:54:35.539154 n-d-862686-1 devstack@n-api.service[104594]: X-Domain-Name: None Oct 26 12:54:35.539154 n-d-862686-1 devstack@n-api.service[104594]: X-Identity-Status: Confirmed Oct 26 12:54:35.539154 n-d-862686-1 devstack@n-api.service[104594]: X-Is-Admin-Project: True Oct 26 12:54:35.539154 n-d-862686-1 devstack@n-api.service[104594]: X-Openstack-Nova-Api-Version: 2.92 Oct 26 12:54:35.539154 n-d-862686-1 devstack@n-api.service[104594]: X-Project-Domain-Id: default Oct 26 12:54:35.539154 n-d-862686-1 devstack@n-api.service[104594]: X-Project-Domain-Name: Default Oct 26 12:54:35.539154 n-d-862686-1 devstack@n-api.service[104594]: X-Project-Id: a7f94c509007485eababf73351c71bc7 Oct 26 12:54:35.539154 n-d-862686-1 devstack@n-api.service[104594]: X-Project-Name: admin Oct 26 12:54:35.539154 n-d-862686-1 devstack@n-api.service[104594]: X-Role: admin,member,reader Oct 26 12:54:35.539154 n-d-862686-1 devstack@n-api.service[104594]: X-Roles: admin,member,reader Oct 26 12:54:35.541352 n-d-862686-1 devstack@n-api.service[104594]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a7f94c509007485eababf73351c71bc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a7f94c509007485eababf73351c71bc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a7f94c509007485eababf73351c71bc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a7f94c509007485eababf73351c71bc7"}]}] Oct 26 12:54:35.541352 n-d-862686-1 devstack@n-api.service[104594]: X-Tenant: admin Oct 26 12:54:35.541352 n-d-862686-1 devstack@n-api.service[104594]: X-Tenant-Id: a7f94c509007485eababf73351c71bc7 Oct 26 12:54:35.541352 n-d-862686-1 devstack@n-api.service[104594]: X-Tenant-Name: admin Oct 26 12:54:35.541352 n-d-862686-1 devstack@n-api.service[104594]: X-User: admin Oct 26 12:54:35.541352 n-d-862686-1 devstack@n-api.service[104594]: X-User-Domain-Id: default Oct 26 12:54:35.541352 n-d-862686-1 devstack@n-api.service[104594]: X-User-Domain-Name: Default Oct 26 12:54:35.541352 n-d-862686-1 devstack@n-api.service[104594]: X-User-Id: 6fb5207776a84aff85c5c1a278383c7f Oct 26 12:54:35.541352 n-d-862686-1 devstack@n-api.service[104594]: X-User-Name: admin Oct 26 12:54:35.541352 n-d-862686-1 devstack@n-api.service[104594]: method: > Oct 26 12:54:35.541352 n-d-862686-1 devstack@n-api.service[104594]: exception: Flavor 84 could not be found. Oct 26 12:54:35.541352 n-d-862686-1 devstack@n-api.service[104594]: action_args: {'id': '84'} Oct 26 12:54:35.541352 n-d-862686-1 devstack@n-api.service[104594]: {{(pid=104594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 12:54:35.541352 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 12:54:35.542412 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 26 12:54:35.542412 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 26 12:54:35.542412 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 26 12:54:35.542412 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 26 12:54:35.542412 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 12:54:35.542412 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 12:54:35.542412 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 26 12:54:35.542412 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 26 12:54:35.542412 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 26 12:54:35.542412 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 12:54:35.542412 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 26 12:54:35.542412 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 26 12:54:35.542412 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 26 12:54:35.542412 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi Oct 26 12:54:35.542412 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 12:54:35.542412 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi Oct 26 12:54:35.542412 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 12:54:35.542412 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 12:54:35.542412 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 12:54:35.544115 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 12:54:35.544115 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 12:54:35.544115 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 12:54:35.544115 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 12:54:35.544115 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 26 12:54:35.544115 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 12:54:35.544115 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 26 12:54:35.544115 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi Oct 26 12:54:35.544115 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 12:54:35.544115 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi Oct 26 12:54:35.544115 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 12:54:35.544115 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 12:54:35.544115 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 12:54:35.544115 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 12:54:35.544115 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 12:54:35.544115 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 26 12:54:35.544115 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi Oct 26 12:54:35.544115 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi [None req-e126f29a-f558-41bc-9d89-9b0593b26fb7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 12:54:35.545360 n-d-862686-1 devstack@n-api.service[104594]: INFO nova.api.openstack.requestlog [None req-e126f29a-f558-41bc-9d89-9b0593b26fb7 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012499 Oct 26 12:54:35.545360 n-d-862686-1 devstack@n-api.service[104594]: [pid: 104594|app: 0|req: 23/47] 10.222.0.40 () {60 vars in 1190 bytes} [Wed Oct 26 12:54:35 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 26 12:54:36.752707 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi [None req-44a445c2-ae14-499a-abc5-ae4b674b74f3 admin admin] Calling method '>' {{(pid=104593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 12:54:36.753737 n-d-862686-1 devstack@n-api.service[104593]: INFO nova.api.openstack.requestlog [None req-44a445c2-ae14-499a-abc5-ae4b674b74f3 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Oct 26 12:54:36.754128 n-d-862686-1 devstack@n-api.service[104593]: [pid: 104593|app: 0|req: 25/48] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Oct 26 12:54:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 12:54:37.272918 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi [None req-a9715a85-aff4-4b50-b673-99c5995d22f2 admin admin] Calling method '>' {{(pid=104594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 12:54:37.278794 n-d-862686-1 devstack@n-api.service[104594]: INFO nova.api.openstack.wsgi [None req-a9715a85-aff4-4b50-b673-99c5995d22f2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 26 12:54:37.280271 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi [None req-a9715a85-aff4-4b50-b673-99c5995d22f2 admin admin] Request method failure captured: Oct 26 12:54:37.280271 n-d-862686-1 devstack@n-api.service[104594]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 26 12:54:37.280271 n-d-862686-1 devstack@n-api.service[104594]: Accept: application/json Oct 26 12:54:37.280271 n-d-862686-1 devstack@n-api.service[104594]: Accept-Encoding: gzip, deflate Oct 26 12:54:37.280271 n-d-862686-1 devstack@n-api.service[104594]: Connection: keep-alive Oct 26 12:54:37.280271 n-d-862686-1 devstack@n-api.service[104594]: Content-Length: 0 Oct 26 12:54:37.280271 n-d-862686-1 devstack@n-api.service[104594]: Host: 10.222.0.40 Oct 26 12:54:37.280271 n-d-862686-1 devstack@n-api.service[104594]: Openstack-Api-Version: compute 2.92 Oct 26 12:54:37.280271 n-d-862686-1 devstack@n-api.service[104594]: Openstack-System-Scope: None Oct 26 12:54:37.280271 n-d-862686-1 devstack@n-api.service[104594]: User-Agent: python-novaclient Oct 26 12:54:37.280271 n-d-862686-1 devstack@n-api.service[104594]: X-Auth-Token: gAAAAABjWS4MpKGLFIXeX1xKe_19bmPFG4xpb4mwmlE3FigacxsufXLD09vJBRtyeDHArcs4PWzc6eTTeLBrN29HyEhK-uVYRpAda0f4YKUwMdnqlmFeiYihpXYvfyGjSLW84bSL5RtCUESsxYQs7aoxabTrWOJoWHlxzRIZLNSI9K37qsat2zY Oct 26 12:54:37.280271 n-d-862686-1 devstack@n-api.service[104594]: X-Domain-Id: None Oct 26 12:54:37.280271 n-d-862686-1 devstack@n-api.service[104594]: X-Domain-Name: None Oct 26 12:54:37.280271 n-d-862686-1 devstack@n-api.service[104594]: X-Identity-Status: Confirmed Oct 26 12:54:37.280271 n-d-862686-1 devstack@n-api.service[104594]: X-Is-Admin-Project: True Oct 26 12:54:37.280271 n-d-862686-1 devstack@n-api.service[104594]: X-Openstack-Nova-Api-Version: 2.92 Oct 26 12:54:37.280271 n-d-862686-1 devstack@n-api.service[104594]: X-Project-Domain-Id: default Oct 26 12:54:37.280271 n-d-862686-1 devstack@n-api.service[104594]: X-Project-Domain-Name: Default Oct 26 12:54:37.280271 n-d-862686-1 devstack@n-api.service[104594]: X-Project-Id: a7f94c509007485eababf73351c71bc7 Oct 26 12:54:37.280271 n-d-862686-1 devstack@n-api.service[104594]: X-Project-Name: admin Oct 26 12:54:37.280271 n-d-862686-1 devstack@n-api.service[104594]: X-Role: admin,member,reader Oct 26 12:54:37.280271 n-d-862686-1 devstack@n-api.service[104594]: X-Roles: admin,member,reader Oct 26 12:54:37.281983 n-d-862686-1 devstack@n-api.service[104594]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a7f94c509007485eababf73351c71bc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a7f94c509007485eababf73351c71bc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a7f94c509007485eababf73351c71bc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a7f94c509007485eababf73351c71bc7"}]}] Oct 26 12:54:37.281983 n-d-862686-1 devstack@n-api.service[104594]: X-Tenant: admin Oct 26 12:54:37.281983 n-d-862686-1 devstack@n-api.service[104594]: X-Tenant-Id: a7f94c509007485eababf73351c71bc7 Oct 26 12:54:37.281983 n-d-862686-1 devstack@n-api.service[104594]: X-Tenant-Name: admin Oct 26 12:54:37.281983 n-d-862686-1 devstack@n-api.service[104594]: X-User: admin Oct 26 12:54:37.281983 n-d-862686-1 devstack@n-api.service[104594]: X-User-Domain-Id: default Oct 26 12:54:37.281983 n-d-862686-1 devstack@n-api.service[104594]: X-User-Domain-Name: Default Oct 26 12:54:37.281983 n-d-862686-1 devstack@n-api.service[104594]: X-User-Id: 6fb5207776a84aff85c5c1a278383c7f Oct 26 12:54:37.281983 n-d-862686-1 devstack@n-api.service[104594]: X-User-Name: admin Oct 26 12:54:37.281983 n-d-862686-1 devstack@n-api.service[104594]: method: > Oct 26 12:54:37.281983 n-d-862686-1 devstack@n-api.service[104594]: exception: Flavor 451 could not be found. Oct 26 12:54:37.281983 n-d-862686-1 devstack@n-api.service[104594]: action_args: {'id': '451'} Oct 26 12:54:37.281983 n-d-862686-1 devstack@n-api.service[104594]: {{(pid=104594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 12:54:37.281983 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 12:54:37.282889 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 26 12:54:37.282889 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 26 12:54:37.282889 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 26 12:54:37.282889 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 26 12:54:37.282889 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 12:54:37.282889 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 12:54:37.282889 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 26 12:54:37.282889 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 26 12:54:37.282889 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 26 12:54:37.282889 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 12:54:37.282889 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 26 12:54:37.282889 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 26 12:54:37.282889 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 26 12:54:37.282889 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi Oct 26 12:54:37.282889 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 12:54:37.282889 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi Oct 26 12:54:37.282889 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 12:54:37.282889 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 12:54:37.282889 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 12:54:37.284273 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 12:54:37.284273 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 12:54:37.284273 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 12:54:37.284273 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 12:54:37.284273 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 26 12:54:37.284273 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 12:54:37.284273 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 26 12:54:37.284273 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi Oct 26 12:54:37.284273 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 12:54:37.284273 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi Oct 26 12:54:37.284273 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 12:54:37.284273 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 12:54:37.284273 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 12:54:37.284273 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 12:54:37.284273 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 12:54:37.284273 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 26 12:54:37.284273 n-d-862686-1 devstack@n-api.service[104594]: ERROR nova.api.openstack.wsgi Oct 26 12:54:37.284273 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi [None req-a9715a85-aff4-4b50-b673-99c5995d22f2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 12:54:37.285342 n-d-862686-1 devstack@n-api.service[104594]: INFO nova.api.openstack.requestlog [None req-a9715a85-aff4-4b50-b673-99c5995d22f2 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.391273 Oct 26 12:54:37.285342 n-d-862686-1 devstack@n-api.service[104594]: [pid: 104594|app: 0|req: 24/49] 10.222.0.40 () {60 vars in 1193 bytes} [Wed Oct 26 12:54:36 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 26 12:54:37.291231 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi [None req-6f2212ff-6147-4349-9a07-87330daa4861 admin admin] Calling method '>' {{(pid=104593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 12:54:37.306457 n-d-862686-1 devstack@n-api.service[104593]: INFO nova.api.openstack.requestlog [None req-6f2212ff-6147-4349-9a07-87330daa4861 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018785 Oct 26 12:54:37.306981 n-d-862686-1 devstack@n-api.service[104593]: [pid: 104593|app: 0|req: 26/50] 10.222.0.40 () {60 vars in 1210 bytes} [Wed Oct 26 12:54:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 12:54:37.316252 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi [None req-054c2896-0b2c-47a4-8eb0-5daf3f65fc3e admin admin] Calling method '>' {{(pid=104594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 12:54:37.331483 n-d-862686-1 devstack@n-api.service[104594]: INFO nova.api.openstack.requestlog [None req-054c2896-0b2c-47a4-8eb0-5daf3f65fc3e admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018748 Oct 26 12:54:37.332011 n-d-862686-1 devstack@n-api.service[104594]: [pid: 104594|app: 0|req: 25/51] 10.222.0.40 () {60 vars in 1210 bytes} [Wed Oct 26 12:54:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 12:54:37.341258 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi [None req-6bedfaf9-f88d-4b6b-a5ae-193d98f9938c admin admin] Calling method '>' {{(pid=104593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 12:54:37.346271 n-d-862686-1 devstack@n-api.service[104593]: INFO nova.api.openstack.wsgi [None req-6bedfaf9-f88d-4b6b-a5ae-193d98f9938c admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 26 12:54:37.347761 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi [None req-6bedfaf9-f88d-4b6b-a5ae-193d98f9938c admin admin] Request method failure captured: Oct 26 12:54:37.347761 n-d-862686-1 devstack@n-api.service[104593]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 26 12:54:37.347761 n-d-862686-1 devstack@n-api.service[104593]: Accept: application/json Oct 26 12:54:37.347761 n-d-862686-1 devstack@n-api.service[104593]: Accept-Encoding: gzip, deflate Oct 26 12:54:37.347761 n-d-862686-1 devstack@n-api.service[104593]: Connection: keep-alive Oct 26 12:54:37.347761 n-d-862686-1 devstack@n-api.service[104593]: Content-Length: 0 Oct 26 12:54:37.347761 n-d-862686-1 devstack@n-api.service[104593]: Host: 10.222.0.40 Oct 26 12:54:37.347761 n-d-862686-1 devstack@n-api.service[104593]: Openstack-Api-Version: compute 2.92 Oct 26 12:54:37.347761 n-d-862686-1 devstack@n-api.service[104593]: Openstack-System-Scope: None Oct 26 12:54:37.347761 n-d-862686-1 devstack@n-api.service[104593]: User-Agent: python-novaclient Oct 26 12:54:37.347761 n-d-862686-1 devstack@n-api.service[104593]: X-Auth-Token: gAAAAABjWS4MpKGLFIXeX1xKe_19bmPFG4xpb4mwmlE3FigacxsufXLD09vJBRtyeDHArcs4PWzc6eTTeLBrN29HyEhK-uVYRpAda0f4YKUwMdnqlmFeiYihpXYvfyGjSLW84bSL5RtCUESsxYQs7aoxabTrWOJoWHlxzRIZLNSI9K37qsat2zY Oct 26 12:54:37.347761 n-d-862686-1 devstack@n-api.service[104593]: X-Domain-Id: None Oct 26 12:54:37.347761 n-d-862686-1 devstack@n-api.service[104593]: X-Domain-Name: None Oct 26 12:54:37.347761 n-d-862686-1 devstack@n-api.service[104593]: X-Identity-Status: Confirmed Oct 26 12:54:37.347761 n-d-862686-1 devstack@n-api.service[104593]: X-Is-Admin-Project: True Oct 26 12:54:37.347761 n-d-862686-1 devstack@n-api.service[104593]: X-Openstack-Nova-Api-Version: 2.92 Oct 26 12:54:37.347761 n-d-862686-1 devstack@n-api.service[104593]: X-Project-Domain-Id: default Oct 26 12:54:37.347761 n-d-862686-1 devstack@n-api.service[104593]: X-Project-Domain-Name: Default Oct 26 12:54:37.347761 n-d-862686-1 devstack@n-api.service[104593]: X-Project-Id: a7f94c509007485eababf73351c71bc7 Oct 26 12:54:37.347761 n-d-862686-1 devstack@n-api.service[104593]: X-Project-Name: admin Oct 26 12:54:37.347761 n-d-862686-1 devstack@n-api.service[104593]: X-Role: admin,member,reader Oct 26 12:54:37.347761 n-d-862686-1 devstack@n-api.service[104593]: X-Roles: admin,member,reader Oct 26 12:54:37.349236 n-d-862686-1 devstack@n-api.service[104593]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a7f94c509007485eababf73351c71bc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a7f94c509007485eababf73351c71bc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a7f94c509007485eababf73351c71bc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a7f94c509007485eababf73351c71bc7"}]}] Oct 26 12:54:37.349236 n-d-862686-1 devstack@n-api.service[104593]: X-Tenant: admin Oct 26 12:54:37.349236 n-d-862686-1 devstack@n-api.service[104593]: X-Tenant-Id: a7f94c509007485eababf73351c71bc7 Oct 26 12:54:37.349236 n-d-862686-1 devstack@n-api.service[104593]: X-Tenant-Name: admin Oct 26 12:54:37.349236 n-d-862686-1 devstack@n-api.service[104593]: X-User: admin Oct 26 12:54:37.349236 n-d-862686-1 devstack@n-api.service[104593]: X-User-Domain-Id: default Oct 26 12:54:37.349236 n-d-862686-1 devstack@n-api.service[104593]: X-User-Domain-Name: Default Oct 26 12:54:37.349236 n-d-862686-1 devstack@n-api.service[104593]: X-User-Id: 6fb5207776a84aff85c5c1a278383c7f Oct 26 12:54:37.349236 n-d-862686-1 devstack@n-api.service[104593]: X-User-Name: admin Oct 26 12:54:37.349236 n-d-862686-1 devstack@n-api.service[104593]: method: > Oct 26 12:54:37.349236 n-d-862686-1 devstack@n-api.service[104593]: exception: Flavor 451 could not be found. Oct 26 12:54:37.349236 n-d-862686-1 devstack@n-api.service[104593]: action_args: {'id': '451'} Oct 26 12:54:37.349236 n-d-862686-1 devstack@n-api.service[104593]: {{(pid=104593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 12:54:37.349236 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 12:54:37.350407 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 26 12:54:37.350407 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 26 12:54:37.350407 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 26 12:54:37.350407 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 26 12:54:37.350407 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 12:54:37.350407 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 12:54:37.350407 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 26 12:54:37.350407 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 26 12:54:37.350407 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 26 12:54:37.350407 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 12:54:37.350407 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 26 12:54:37.350407 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 26 12:54:37.350407 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 26 12:54:37.350407 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi Oct 26 12:54:37.350407 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 12:54:37.350407 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi Oct 26 12:54:37.350407 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 12:54:37.350407 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 12:54:37.350407 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 12:54:37.352021 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 12:54:37.352021 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 12:54:37.352021 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 12:54:37.352021 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 12:54:37.352021 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 26 12:54:37.352021 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 12:54:37.352021 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 26 12:54:37.352021 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi Oct 26 12:54:37.352021 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 12:54:37.352021 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi Oct 26 12:54:37.352021 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 12:54:37.352021 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 12:54:37.352021 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 12:54:37.352021 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 12:54:37.352021 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 12:54:37.352021 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 26 12:54:37.352021 n-d-862686-1 devstack@n-api.service[104593]: ERROR nova.api.openstack.wsgi Oct 26 12:54:37.352021 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi [None req-6bedfaf9-f88d-4b6b-a5ae-193d98f9938c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 12:54:37.353410 n-d-862686-1 devstack@n-api.service[104593]: INFO nova.api.openstack.requestlog [None req-6bedfaf9-f88d-4b6b-a5ae-193d98f9938c admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011513 Oct 26 12:54:37.353410 n-d-862686-1 devstack@n-api.service[104593]: [pid: 104593|app: 0|req: 27/52] 10.222.0.40 () {60 vars in 1193 bytes} [Wed Oct 26 12:54:37 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 26 12:54:38.550193 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi [None req-054c2896-0b2c-47a4-8eb0-5daf3f65fc3e admin admin] Calling method '>' {{(pid=104594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 12:54:38.551207 n-d-862686-1 devstack@n-api.service[104594]: INFO nova.api.openstack.requestlog [None req-054c2896-0b2c-47a4-8eb0-5daf3f65fc3e admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Oct 26 12:54:38.551609 n-d-862686-1 devstack@n-api.service[104594]: [pid: 104594|app: 0|req: 26/53] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Oct 26 12:54:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 12:54:39.073254 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi [None req-7430a3a9-ad83-4a9c-b68e-b09a18285a42 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 12:54:39.093789 n-d-862686-1 devstack@n-api.service[104593]: INFO nova.api.openstack.requestlog [None req-7430a3a9-ad83-4a9c-b68e-b09a18285a42 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.404222 Oct 26 12:54:39.094313 n-d-862686-1 devstack@n-api.service[104593]: [pid: 104593|app: 0|req: 28/54] 10.222.0.40 () {64 vars in 1235 bytes} [Wed Oct 26 12:54:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 12:54:40.302395 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi [None req-054c2896-0b2c-47a4-8eb0-5daf3f65fc3e admin admin] Calling method '>' {{(pid=104594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 12:54:40.303405 n-d-862686-1 devstack@n-api.service[104594]: INFO nova.api.openstack.requestlog [None req-054c2896-0b2c-47a4-8eb0-5daf3f65fc3e admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Oct 26 12:54:40.303840 n-d-862686-1 devstack@n-api.service[104594]: [pid: 104594|app: 0|req: 27/55] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Oct 26 12:54:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 12:54:40.831865 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi [None req-d7bdba34-867e-4508-bf9c-7c437ae98243 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 12:54:40.850271 n-d-862686-1 devstack@n-api.service[104593]: INFO nova.api.openstack.requestlog [None req-d7bdba34-867e-4508-bf9c-7c437ae98243 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.406687 Oct 26 12:54:40.850810 n-d-862686-1 devstack@n-api.service[104593]: [pid: 104593|app: 0|req: 29/56] 10.222.0.40 () {64 vars in 1235 bytes} [Wed Oct 26 12:54:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 12:54:42.057209 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi [None req-054c2896-0b2c-47a4-8eb0-5daf3f65fc3e admin admin] Calling method '>' {{(pid=104594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 12:54:42.058276 n-d-862686-1 devstack@n-api.service[104594]: INFO nova.api.openstack.requestlog [None req-054c2896-0b2c-47a4-8eb0-5daf3f65fc3e admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Oct 26 12:54:42.058678 n-d-862686-1 devstack@n-api.service[104594]: [pid: 104594|app: 0|req: 28/57] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Oct 26 12:54:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 12:54:42.577210 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi [None req-0cb7309b-ac07-459c-b968-3613ee2e2cb8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 12:54:42.596665 n-d-862686-1 devstack@n-api.service[104593]: INFO nova.api.openstack.requestlog [None req-0cb7309b-ac07-459c-b968-3613ee2e2cb8 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.402253 Oct 26 12:54:42.597209 n-d-862686-1 devstack@n-api.service[104593]: [pid: 104593|app: 0|req: 30/58] 10.222.0.40 () {64 vars in 1235 bytes} [Wed Oct 26 12:54:42 2022] POST /compute/v2.1/flavors => generated 407 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 12:54:43.795892 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi [None req-054c2896-0b2c-47a4-8eb0-5daf3f65fc3e admin admin] Calling method '>' {{(pid=104594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 12:54:43.796898 n-d-862686-1 devstack@n-api.service[104594]: INFO nova.api.openstack.requestlog [None req-054c2896-0b2c-47a4-8eb0-5daf3f65fc3e admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Oct 26 12:54:43.797324 n-d-862686-1 devstack@n-api.service[104594]: [pid: 104594|app: 0|req: 29/59] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Oct 26 12:54:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 12:54:44.321901 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi [None req-3c06acf3-fc2d-493c-8f63-39f747b2a03f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 12:54:44.340150 n-d-862686-1 devstack@n-api.service[104593]: INFO nova.api.openstack.requestlog [None req-3c06acf3-fc2d-493c-8f63-39f747b2a03f admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.402020 Oct 26 12:54:44.340684 n-d-862686-1 devstack@n-api.service[104593]: [pid: 104593|app: 0|req: 31/60] 10.222.0.40 () {64 vars in 1235 bytes} [Wed Oct 26 12:54:43 2022] POST /compute/v2.1/flavors => generated 409 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 12:54:45.546841 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi [None req-054c2896-0b2c-47a4-8eb0-5daf3f65fc3e admin admin] Calling method '>' {{(pid=104594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 12:54:45.547854 n-d-862686-1 devstack@n-api.service[104594]: INFO nova.api.openstack.requestlog [None req-054c2896-0b2c-47a4-8eb0-5daf3f65fc3e admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Oct 26 12:54:45.548262 n-d-862686-1 devstack@n-api.service[104594]: [pid: 104594|app: 0|req: 30/61] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Oct 26 12:54:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 12:54:46.075638 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi [None req-3a5b971f-035a-453c-8824-06c6b4cb24e8 admin admin] Calling method '>' {{(pid=104593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 12:54:46.096110 n-d-862686-1 devstack@n-api.service[104593]: INFO nova.api.openstack.requestlog [None req-3a5b971f-035a-453c-8824-06c6b4cb24e8 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.408341 Oct 26 12:54:46.096629 n-d-862686-1 devstack@n-api.service[104593]: [pid: 104593|app: 0|req: 32/62] 10.222.0.40 () {60 vars in 1202 bytes} [Wed Oct 26 12:54:45 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 12:55:42.852685 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi [None req-054c2896-0b2c-47a4-8eb0-5daf3f65fc3e admin admin] Calling method '>' {{(pid=104594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 12:55:42.853747 n-d-862686-1 devstack@n-api.service[104594]: INFO nova.api.openstack.requestlog [None req-054c2896-0b2c-47a4-8eb0-5daf3f65fc3e admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Oct 26 12:55:42.854153 n-d-862686-1 devstack@n-api.service[104594]: [pid: 104594|app: 0|req: 31/63] 10.222.0.40 () {54 vars in 931 bytes} [Wed Oct 26 12:55:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 12:55:42.864668 n-d-862686-1 devstack@n-api.service[104593]: DEBUG dbcounter [-] [104593] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=104593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 12:55:43.247183 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi [None req-d905099f-2f5f-47dd-a088-42f29d491665 admin admin] Calling method '>' {{(pid=104593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 12:55:43.267355 n-d-862686-1 devstack@n-api.service[104593]: INFO nova.api.openstack.requestlog [None req-d905099f-2f5f-47dd-a088-42f29d491665 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.407201 Oct 26 12:55:43.267896 n-d-862686-1 devstack@n-api.service[104593]: [pid: 104593|app: 0|req: 33/64] 10.222.0.40 () {60 vars in 1292 bytes} [Wed Oct 26 12:55:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 12:55:43.290760 n-d-862686-1 devstack@n-api.service[104594]: DEBUG dbcounter [-] [104594] Writing DB stats nova_api:SELECT=14 {{(pid=104594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 12:55:43.294478 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi [None req-7bd5124e-19ad-481c-9007-64cffd3d192e admin admin] Calling method '>' {{(pid=104594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 12:55:43.301918 n-d-862686-1 devstack@n-api.service[104594]: INFO nova.api.openstack.requestlog [None req-7bd5124e-19ad-481c-9007-64cffd3d192e admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012571 Oct 26 12:55:43.302439 n-d-862686-1 devstack@n-api.service[104594]: [pid: 104594|app: 0|req: 32/65] 10.222.0.40 () {60 vars in 1283 bytes} [Wed Oct 26 12:55:43 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 12:55:43.314224 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi [None req-f3a99daf-7906-4155-8973-fd6883c30a98 admin admin] Calling method '>' {{(pid=104593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 12:55:43.321583 n-d-862686-1 devstack@n-api.service[104593]: INFO nova.api.openstack.requestlog [None req-f3a99daf-7906-4155-8973-fd6883c30a98 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010933 Oct 26 12:55:43.322112 n-d-862686-1 devstack@n-api.service[104593]: [pid: 104593|app: 0|req: 34/66] 10.222.0.40 () {60 vars in 1286 bytes} [Wed Oct 26 12:55:43 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 12:55:43.333304 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi [None req-4c9c2d79-4e35-422a-a0db-e8d7cce64065 admin admin] Calling method '>' {{(pid=104594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 12:55:43.341041 n-d-862686-1 devstack@n-api.service[104594]: INFO nova.api.openstack.requestlog [None req-4c9c2d79-4e35-422a-a0db-e8d7cce64065 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011248 Oct 26 12:55:43.341589 n-d-862686-1 devstack@n-api.service[104594]: [pid: 104594|app: 0|req: 33/67] 10.222.0.40 () {60 vars in 1286 bytes} [Wed Oct 26 12:55:43 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 12:55:43.353375 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi [None req-5aa6e736-1725-45de-bdbb-6b62ac2d1df6 admin admin] Calling method '>' {{(pid=104593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 12:55:43.360476 n-d-862686-1 devstack@n-api.service[104593]: INFO nova.api.openstack.requestlog [None req-5aa6e736-1725-45de-bdbb-6b62ac2d1df6 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011274 Oct 26 12:55:43.360991 n-d-862686-1 devstack@n-api.service[104593]: [pid: 104593|app: 0|req: 35/68] 10.222.0.40 () {60 vars in 1283 bytes} [Wed Oct 26 12:55:43 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:00:58.180966 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi [None req-4c9c2d79-4e35-422a-a0db-e8d7cce64065 admin admin] Calling method '>' {{(pid=104594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:00:58.182029 n-d-862686-1 devstack@n-api.service[104594]: INFO nova.api.openstack.requestlog [None req-4c9c2d79-4e35-422a-a0db-e8d7cce64065 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Oct 26 13:00:58.182423 n-d-862686-1 devstack@n-api.service[104594]: [pid: 104594|app: 0|req: 34/69] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Oct 26 13:00:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:00:58.326035 n-d-862686-1 devstack@n-api.service[104593]: DEBUG dbcounter [-] [104593] Writing DB stats nova_api:SELECT=6 {{(pid=104593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:00:58.466825 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi [None req-b00d475d-cc32-4414-b582-d81a9c48bf0f admin admin] Calling method '>' {{(pid=104593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:00:58.471533 n-d-862686-1 devstack@n-api.service[104593]: DEBUG oslo_concurrency.lockutils [None req-b00d475d-cc32-4414-b582-d81a9c48bf0f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:00:58.472007 n-d-862686-1 devstack@n-api.service[104593]: DEBUG oslo_concurrency.lockutils [None req-b00d475d-cc32-4414-b582-d81a9c48bf0f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:00:58.472436 n-d-862686-1 devstack@n-api.service[104593]: DEBUG oslo_concurrency.lockutils [None req-b00d475d-cc32-4414-b582-d81a9c48bf0f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:00:58.473154 n-d-862686-1 devstack@n-api.service[104593]: DEBUG oslo_concurrency.lockutils [None req-b00d475d-cc32-4414-b582-d81a9c48bf0f admin admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:00:58.473632 n-d-862686-1 devstack@n-api.service[104593]: DEBUG oslo_concurrency.lockutils [None req-b00d475d-cc32-4414-b582-d81a9c48bf0f admin admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:00:58.474054 n-d-862686-1 devstack@n-api.service[104593]: DEBUG oslo_concurrency.lockutils [None req-b00d475d-cc32-4414-b582-d81a9c48bf0f admin admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:00:58.512622 n-d-862686-1 devstack@n-api.service[104593]: INFO nova.api.openstack.requestlog [None req-b00d475d-cc32-4414-b582-d81a9c48bf0f admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.187731 Oct 26 13:00:58.513173 n-d-862686-1 devstack@n-api.service[104593]: [pid: 104593|app: 0|req: 36/70] 10.222.0.40 () {60 vars in 1193 bytes} [Wed Oct 26 13:00:58 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:00:59.576414 n-d-862686-1 devstack@n-api.service[104594]: DEBUG nova.api.openstack.wsgi [None req-4c9c2d79-4e35-422a-a0db-e8d7cce64065 admin admin] Calling method '>' {{(pid=104594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:00:59.577415 n-d-862686-1 devstack@n-api.service[104594]: INFO nova.api.openstack.requestlog [None req-4c9c2d79-4e35-422a-a0db-e8d7cce64065 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Oct 26 13:00:59.577833 n-d-862686-1 devstack@n-api.service[104594]: [pid: 104594|app: 0|req: 35/71] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Oct 26 13:00:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:00:59.770891 n-d-862686-1 devstack@n-api.service[104593]: DEBUG nova.api.openstack.wsgi [None req-ecb5c8bc-cf9c-42a0-bc64-78a2614f8fe6 admin admin] Calling method '>' {{(pid=104593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:00:59.775057 n-d-862686-1 devstack@n-api.service[104593]: DEBUG oslo_concurrency.lockutils [None req-ecb5c8bc-cf9c-42a0-bc64-78a2614f8fe6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:00:59.775527 n-d-862686-1 devstack@n-api.service[104593]: DEBUG oslo_concurrency.lockutils [None req-ecb5c8bc-cf9c-42a0-bc64-78a2614f8fe6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:00:59.775978 n-d-862686-1 devstack@n-api.service[104593]: DEBUG oslo_concurrency.lockutils [None req-ecb5c8bc-cf9c-42a0-bc64-78a2614f8fe6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:00:59.776678 n-d-862686-1 devstack@n-api.service[104593]: DEBUG oslo_concurrency.lockutils [None req-ecb5c8bc-cf9c-42a0-bc64-78a2614f8fe6 admin admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:00:59.777117 n-d-862686-1 devstack@n-api.service[104593]: DEBUG oslo_concurrency.lockutils [None req-ecb5c8bc-cf9c-42a0-bc64-78a2614f8fe6 admin admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:00:59.777614 n-d-862686-1 devstack@n-api.service[104593]: DEBUG oslo_concurrency.lockutils [None req-ecb5c8bc-cf9c-42a0-bc64-78a2614f8fe6 admin admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:00:59.799930 n-d-862686-1 devstack@n-api.service[104593]: INFO nova.api.openstack.requestlog [None req-ecb5c8bc-cf9c-42a0-bc64-78a2614f8fe6 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.080230 Oct 26 13:00:59.800462 n-d-862686-1 devstack@n-api.service[104593]: [pid: 104593|app: 0|req: 37/72] 10.222.0.40 () {60 vars in 1193 bytes} [Wed Oct 26 13:00:59 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:01:49.591816 n-d-862686-1 devstack@n-api.service[104592]: Wed Oct 26 13:01:49 2022 - graceful shutdown triggered... Oct 26 13:01:49.591959 n-d-862686-1 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 26 13:01:49.592872 n-d-862686-1 devstack@n-api.service[104593]: Gracefully killing worker 1 (pid: 104593)... Oct 26 13:01:49.593840 n-d-862686-1 devstack@n-api.service[104594]: Gracefully killing worker 2 (pid: 104594)... Oct 26 13:01:49.721227 n-d-862686-1 devstack@n-api.service[104594]: DEBUG dbcounter [-] [104594] Writing DB stats nova_api:SELECT=4 {{(pid=104594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:01:50.593963 n-d-862686-1 devstack@n-api.service[104592]: worker 1 buried after 1 seconds Oct 26 13:01:50.593963 n-d-862686-1 devstack@n-api.service[104592]: worker 2 buried after 1 seconds Oct 26 13:01:50.593963 n-d-862686-1 devstack@n-api.service[104592]: goodbye to uWSGI. Oct 26 13:01:50.595528 n-d-862686-1 systemd[1]: devstack@n-api.service: Succeeded. Oct 26 13:01:50.596092 n-d-862686-1 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 26 13:01:50.598882 n-d-862686-1 systemd[1]: Starting Devstack devstack@n-api.service... Oct 26 13:01:50.614860 n-d-862686-1 devstack@n-api.service[120581]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 26 13:01:50.628326 n-d-862686-1 devstack@n-api.service[120581]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 26 13:01:50 2022] *** Oct 26 13:01:50.628326 n-d-862686-1 devstack@n-api.service[120581]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 26 13:01:50.628326 n-d-862686-1 devstack@n-api.service[120581]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 26 13:01:50.628326 n-d-862686-1 devstack@n-api.service[120581]: nodename: n-d-862686-1 Oct 26 13:01:50.628326 n-d-862686-1 devstack@n-api.service[120581]: machine: x86_64 Oct 26 13:01:50.628326 n-d-862686-1 devstack@n-api.service[120581]: clock source: unix Oct 26 13:01:50.628326 n-d-862686-1 devstack@n-api.service[120581]: pcre jit disabled Oct 26 13:01:50.628326 n-d-862686-1 devstack@n-api.service[120581]: detected number of CPU cores: 4 Oct 26 13:01:50.628326 n-d-862686-1 devstack@n-api.service[120581]: current working directory: / Oct 26 13:01:50.628326 n-d-862686-1 devstack@n-api.service[120581]: detected binary path: /usr/bin/uwsgi-core Oct 26 13:01:50.628326 n-d-862686-1 devstack@n-api.service[120581]: your processes number limit is 47680 Oct 26 13:01:50.628326 n-d-862686-1 devstack@n-api.service[120581]: your memory page size is 4096 bytes Oct 26 13:01:50.629262 n-d-862686-1 devstack@n-api.service[120581]: detected max file descriptor number: 2048 Oct 26 13:01:50.629262 n-d-862686-1 devstack@n-api.service[120581]: lock engine: pthread robust mutexes Oct 26 13:01:50.629262 n-d-862686-1 devstack@n-api.service[120581]: thunder lock: enabled Oct 26 13:01:50.629262 n-d-862686-1 devstack@n-api.service[120581]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 26 13:01:50.629262 n-d-862686-1 devstack@n-api.service[120581]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 26 13:01:50.670420 n-d-862686-1 devstack@n-api.service[120581]: Python main interpreter initialized at 0x555d5fef69c0 Oct 26 13:01:50.670420 n-d-862686-1 devstack@n-api.service[120581]: python threads support enabled Oct 26 13:01:50.670420 n-d-862686-1 devstack@n-api.service[120581]: your server socket listen backlog is limited to 100 connections Oct 26 13:01:50.670420 n-d-862686-1 devstack@n-api.service[120581]: your mercy for graceful operations on workers is 90 seconds Oct 26 13:01:50.670868 n-d-862686-1 devstack@n-api.service[120581]: mapped 403077 bytes (393 KB) for 2 cores Oct 26 13:01:50.670868 n-d-862686-1 devstack@n-api.service[120581]: *** Operational MODE: preforking *** Oct 26 13:01:50.671108 n-d-862686-1 devstack@n-api.service[120581]: *** uWSGI is running in multiple interpreter mode *** Oct 26 13:01:50.671108 n-d-862686-1 devstack@n-api.service[120581]: spawned uWSGI master process (pid: 120581) Oct 26 13:01:50.671314 n-d-862686-1 systemd[1]: Started Devstack devstack@n-api.service. Oct 26 13:01:50.673425 n-d-862686-1 devstack@n-api.service[120581]: spawned uWSGI worker 1 (pid: 120597, cores: 1) Oct 26 13:01:50.673425 n-d-862686-1 devstack@n-api.service[120581]: spawned uWSGI worker 2 (pid: 120598, cores: 1) Oct 26 13:01:50.673425 n-d-862686-1 devstack@n-api.service[120581]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 26 13:01:51.333947 n-d-862686-1 devstack@n-api.service[120597]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 26 13:01:51.337129 n-d-862686-1 devstack@n-api.service[120598]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 26 13:01:52.599303 n-d-862686-1 devstack@n-api.service[120597]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 26 13:01:52.599303 n-d-862686-1 devstack@n-api.service[120597]: from cryptography.utils import int_from_bytes Oct 26 13:01:52.599926 n-d-862686-1 devstack@n-api.service[120597]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 26 13:01:52.599926 n-d-862686-1 devstack@n-api.service[120597]: from cryptography.utils import int_from_bytes Oct 26 13:01:52.600580 n-d-862686-1 devstack@n-api.service[120598]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 26 13:01:52.600580 n-d-862686-1 devstack@n-api.service[120598]: from cryptography.utils import int_from_bytes Oct 26 13:01:52.601091 n-d-862686-1 devstack@n-api.service[120598]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 26 13:01:52.601091 n-d-862686-1 devstack@n-api.service[120598]: from cryptography.utils import int_from_bytes Oct 26 13:01:55.063379 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 26 13:01:55.064077 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 26 13:01:55.064162 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 26 13:01:55.065109 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 26 13:01:55.065109 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 26 13:01:55.065109 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.065446 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.065813 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.066136 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.066470 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.066784 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.067107 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.067432 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.067761 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.068024 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.068548 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.068880 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-862686-1 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.069210 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.069553 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.069871 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.070196 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.070512 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.070843 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.071163 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.071664 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.072785 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.072785 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.072965 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.073909 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.074319 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.074641 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.074969 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.075283 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.075615 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.075931 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.076334 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-862686-1 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.076660 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.076978 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.077295 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.077711 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 26 13:01:55.078113 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.078214 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 26 13:01:55.078304 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.078386 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.078510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 26 13:01:55.078654 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.078881 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 26 13:01:55.078990 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.079146 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 26 13:01:55.079281 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.079542 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.079630 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.079876 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.079974 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.080209 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.080306 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.080536 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.080637 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.080842 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.080943 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.081158 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.081250 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.081475 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.081584 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.081824 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.081913 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.082135 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.082230 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.082411 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.082522 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.082687 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.082776 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.082999 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.083161 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-862686-1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.083327 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.083499 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.083653 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.083816 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.083982 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.084135 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.084227 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.084459 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.084550 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.084771 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.084861 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.085100 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.085198 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.085411 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.085559 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.085755 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.085950 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.086061 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.086270 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.086361 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.086582 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.086672 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.086898 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.086987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.087243 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.087341 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.087550 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.087646 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.087865 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.087963 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.088183 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.088281 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.088495 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.088584 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.088851 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.089046 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.089241 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.089383 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.089666 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-862686-1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.089817 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.089990 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.090090 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.090316 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.090417 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.090634 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.090723 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.091020 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.091120 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.091332 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.091433 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.091655 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.091747 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.091977 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.092076 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.092290 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.092425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.092600 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.092707 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.092912 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.093001 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.093235 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.093332 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.093601 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.093746 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.093922 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.094022 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.094165 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.094273 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.094469 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.094573 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.094781 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.094927 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.095105 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.095245 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.095415 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.095558 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.095725 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.095826 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.095980 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.096120 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.096298 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.096434 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.096620 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.096716 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.096931 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.097028 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.097239 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.097336 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.097521 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.097626 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.097784 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.097890 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.098112 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.098213 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.098442 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.098545 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.098748 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.098896 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.099059 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.099149 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.099368 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.099457 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.099679 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.099776 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.099995 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.100090 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.100302 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.100391 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.100614 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.100758 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.100922 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.101066 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.101232 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.101334 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.101584 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.101672 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.101884 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.101998 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.102218 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.102547 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.102783 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.102954 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.103215 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.103336 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.103532 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.103635 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.103874 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.103973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.104705 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.104895 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.105023 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.105158 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.105417 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.105710 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.105902 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.106010 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.106238 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.106342 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.106552 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.106671 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.106890 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.107002 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.107197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.107298 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.107516 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.107615 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.107814 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.107914 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.108126 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.108229 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.108434 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.108546 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.108745 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.108851 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.109073 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.109223 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.109368 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.109555 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.109758 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.109905 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.110060 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.110204 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.110395 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.110576 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.110753 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.110920 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.111066 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.111231 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.111383 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.111542 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.111696 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.111841 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.111992 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.112154 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.112325 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.112567 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.112784 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.112986 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.113139 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.113285 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.113469 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.113681 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.113832 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.113978 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.114167 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.114335 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.114481 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.114688 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.114837 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.114982 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.115136 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.115289 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.115435 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.115579 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.115731 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.115891 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.116037 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.116180 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.116365 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.116524 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.116677 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.116838 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.116984 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.117180 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.117337 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.117555 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.117711 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.117867 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.118013 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.118163 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.118331 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.118530 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.118727 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.118934 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.119088 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.119249 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.119403 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.119548 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.119736 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.120548 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.120741 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.120741 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.121067 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.121235 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.121391 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.121580 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.121801 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.121961 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.121961 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.122266 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.122425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.122616 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.122769 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.122914 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.123058 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.123204 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.123402 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.123552 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.123696 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.123849 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.124497 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.124667 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.124816 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.124987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.125144 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.125297 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.125448 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 13:01:55.125660 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.125809 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.125975 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.126123 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.126268 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.126412 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.126555 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.126709 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.126862 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.127007 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.127160 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.127313 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.127466 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.127626 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.127789 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.127935 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.128086 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.128239 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.128391 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.128545 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.128697 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.128841 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.128984 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.129127 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.129271 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.129424 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.129609 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.129765 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.129920 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.130072 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.130226 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.130372 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.130515 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.130659 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.130803 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.130803 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.131093 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.131238 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.131382 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.131537 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.131692 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.131838 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.132007 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.132160 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.132304 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.132448 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.132591 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.132778 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.133005 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.133167 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.133321 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.133473 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.133657 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.133829 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.133974 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.134126 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.134271 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.134430 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.134576 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.134733 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.134879 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.135029 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.135180 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.135331 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.135510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.135689 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.136096 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.136251 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.136402 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.136547 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.136692 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.136845 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.136996 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.137142 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.137294 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.137445 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.137636 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.137785 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.137938 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.138082 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.138225 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.138370 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.138523 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.138668 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.138812 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.138956 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.139106 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.139251 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.139410 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.139556 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.139700 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.139854 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.139998 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.140142 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.140298 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.140444 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.140594 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.140740 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.140885 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.141044 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.141196 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.141340 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.141526 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.141690 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.141861 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.142028 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.142175 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.142328 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.142473 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.142625 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.142822 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.142984 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.143130 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.143282 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.143427 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.143571 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.143765 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.143927 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.144082 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.144896 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.145054 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.145201 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.145355 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.145531 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.145694 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.145842 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.145986 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.146130 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.146288 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.146459 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.146612 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.146757 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.146901 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.147053 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.147208 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.147362 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.147515 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.147668 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.147820 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.147972 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.148127 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.148273 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.148426 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.148571 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.148715 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.148869 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.149015 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.149159 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.149304 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.149448 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.149628 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.149788 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.149934 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.150085 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.150085 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.150380 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.150714 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.150876 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.151022 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.151204 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.151352 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.151637 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.151803 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.151978 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.152126 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.152271 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.152432 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.152587 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.152759 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.152958 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.153116 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.153268 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.153422 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.153624 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.153791 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.153937 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.154088 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.154234 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.154378 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.154531 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.154700 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.154846 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.154990 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.155142 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.155286 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.155430 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.155584 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.155729 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.155879 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.156023 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.156174 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.156326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.156326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.156635 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.156801 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.156946 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.157097 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.157251 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.157396 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.157557 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.157709 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.157854 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.157997 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.158158 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.158304 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.158448 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.158614 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.158768 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.158914 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.159072 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.159218 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.159361 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.159512 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.159658 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.159813 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.159969 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.159969 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.160260 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.160411 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.160571 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.160725 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.160877 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.161022 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.161166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.161317 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.161470 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.161670 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.161832 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.161990 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.162135 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.162286 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.162440 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.162665 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.162823 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.163017 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.163179 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.163332 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.163490 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.163651 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.163811 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.163970 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.164123 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.164312 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.164483 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.164650 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.164802 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.164963 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.165197 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.165368 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.165557 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.165717 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.165877 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.166031 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.166190 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.166342 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.166508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.167168 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.167357 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.167511 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.167671 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.167834 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.168001 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.168162 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.168314 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.168504 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.168668 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.168821 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.168981 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.169135 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.169285 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.169455 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.169764 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.169937 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.170233 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.170391 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.170544 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.170695 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.170695 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.171007 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.171167 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.172008 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.172141 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.172267 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.172391 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.172514 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.172636 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.172749 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.172866 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.172984 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.173102 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.173234 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.173387 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.173559 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.173708 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.173831 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.173952 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.174062 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.174171 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.174280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.174396 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.174529 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.174677 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.174792 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.174910 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.175028 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.175138 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.175254 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.175377 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.175495 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.175612 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.175721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.175830 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.175938 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.177034 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.177160 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.177273 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.177391 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.177522 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.177522 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.177772 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.177884 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.178000 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.178117 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.178233 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.178233 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.178542 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.178676 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.178794 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.178913 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.179035 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.179159 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.179270 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.179386 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.179522 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.179782 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.179908 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.180028 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.180137 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.180245 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.180363 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.180479 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.180588 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.180695 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.180891 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.181008 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.181130 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.181247 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.181356 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.181471 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.181616 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.181728 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.181850 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.181960 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.182074 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.182184 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.182291 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.182445 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.182579 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.182697 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.182821 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.182931 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.183050 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.183174 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.183291 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.183399 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.183523 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.183655 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.183774 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.183908 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.184037 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.184155 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.184264 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.184382 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.184509 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.184627 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.184744 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.184861 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.184976 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.185103 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.185256 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.185256 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.185470 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.185972 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.186102 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.186214 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.186331 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.186459 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.186570 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.186709 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.187296 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.187434 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.187606 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.187754 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.187904 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.188049 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.188192 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.188346 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.188524 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.188738 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.188886 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.189036 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.189187 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.189340 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.189340 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.189658 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.189948 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.190097 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.190248 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.190401 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.190544 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.190702 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.190845 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.191078 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.191759 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.191928 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.192082 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.192227 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.192440 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.192586 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.192728 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.192869 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.193050 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.193204 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.193383 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.193551 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.193707 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.193856 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.194017 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.194166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.194331 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.194480 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.194638 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.194787 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.194936 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.195084 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.195255 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.195406 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.195556 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.195704 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.195852 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.196009 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.196167 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.196325 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.196482 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.196771 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.197392 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.197643 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.197896 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.198549 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.198698 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.198934 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.199248 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.199416 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.199576 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.199734 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.200028 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.200194 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.200352 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.200512 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.200663 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.200821 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.200982 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.201222 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.201454 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.201631 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.201783 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.201931 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.202090 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.202240 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.202403 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.202403 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.202705 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.202863 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.203019 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.203179 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.203338 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.203496 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.203655 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.203805 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.203954 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.204116 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.204274 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.204424 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.204572 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.204727 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.204885 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.205054 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.205212 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.205361 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.205527 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.205683 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.205833 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.205997 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.206148 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.206304 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.206461 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.206611 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.206758 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.206923 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.207505 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.207678 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.207838 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.208085 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.208254 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.208406 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.208554 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.208703 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.208910 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.209130 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.209295 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.209451 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.209659 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.209828 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.210108 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.210277 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.210442 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.210592 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.210750 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.210907 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.211067 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.211242 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.211472 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.211627 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.211775 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.211923 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.212082 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.212239 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.212398 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.212547 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.213217 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.213389 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.213593 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.214465 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.214629 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.214780 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.214929 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.215084 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.215233 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.215410 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.215560 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.215715 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.215872 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.216028 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.216184 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.216343 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.216499 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.216649 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.216805 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.216954 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.217117 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.217528 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.217851 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.218001 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.218260 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.218418 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.218582 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.218749 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.218983 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.219155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.219386 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.219543 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.219706 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.219864 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.220248 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.220487 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.220648 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.220813 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.220964 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.221120 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.221270 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.221418 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.221690 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.221859 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.222011 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.222011 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.222295 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.222455 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.222612 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.222775 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.222932 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.223088 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.223246 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.223396 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.223553 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.223712 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.223867 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.224027 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.224176 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.224331 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.224543 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.224699 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.224855 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.225005 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.225161 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.225161 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.225454 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.225454 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.225454 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.225910 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.226058 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.226213 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.226386 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.226534 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.226689 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.226840 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.226989 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.227267 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.227662 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.227904 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.228163 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.228414 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.228577 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.228738 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.228896 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.229068 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.229218 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.229434 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.229806 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.230032 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.230187 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.230486 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.230644 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.230795 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.230952 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.231117 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.231275 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.231426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.231594 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.231827 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.231996 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.232164 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.232321 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.232470 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.232630 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.232779 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.232937 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.233089 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.233245 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.233396 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.233603 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.233768 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.233935 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.234086 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.234235 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.234392 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.234549 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.234706 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.234865 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.235021 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.235172 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.235172 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.235475 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.235706 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.235870 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.236018 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.236167 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.236316 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.236473 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.236632 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.236782 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.236930 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.237093 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.237254 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.237405 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.237808 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.238069 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.238333 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.238596 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.238753 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.238904 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.239067 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.239226 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.239376 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.239540 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.239690 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.239930 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.239930 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.239930 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.240517 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.240517 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.240822 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.240822 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.241123 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.241123 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.241413 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.241641 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.241819 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.242051 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.242213 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.242362 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.242524 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.242684 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.242832 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.242990 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.243153 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.243311 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.243460 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.243618 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.243775 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.243924 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.244078 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.244227 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.244376 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.244547 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.244712 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.244878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.245049 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.245278 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.245453 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.245642 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.245803 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.245959 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.246108 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.246268 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.246427 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.246576 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.246736 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.246736 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.247025 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.247025 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.247334 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.247334 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.247643 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.248012 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.248252 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.248502 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.248763 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.248931 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.249088 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.249257 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.249414 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.249606 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.249766 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.249945 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.250163 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.250325 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.250612 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.250786 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.250938 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.251096 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.251245 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.251395 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.251562 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.251727 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.251878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.252046 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.252263 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.252417 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.252573 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.252738 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.252888 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.253046 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.253196 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.253344 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.253553 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.253728 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.253880 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.254031 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.254180 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.254330 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.254487 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.254636 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.254791 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.254948 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.255106 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.255263 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.255427 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.255595 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.255746 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.255893 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.256041 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.256190 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.256354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.256504 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.256659 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.256817 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.256980 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.257148 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.257308 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.257466 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.257466 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.257796 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.258175 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.258428 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.258681 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.258933 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.259089 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.259238 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.259389 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.259620 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.259773 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.259943 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.261622 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.261803 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.261963 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.262126 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.262294 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.262522 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.262677 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.262828 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.262987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.263138 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.263288 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.263437 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.263588 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.263765 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.263925 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.264084 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.264241 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.264399 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.264550 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.264699 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.264857 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.265008 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.265165 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.265463 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.265708 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.265884 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.266058 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.266210 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.266368 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.266526 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.266677 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.266840 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.267008 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.267166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.267325 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.267489 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.267647 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.267808 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.267960 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.268407 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.268407 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.268938 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.269190 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.269359 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.269554 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.269714 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.269879 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.270029 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.270185 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.270344 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.270493 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.270657 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.270805 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.270963 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.271131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.271282 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.271282 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.271787 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.271945 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.272102 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.272262 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.272414 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.272648 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.272803 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.272978 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.273129 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.273287 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.273445 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.273684 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.273847 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.273998 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.274162 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.274339 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.274614 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.274777 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.274928 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.275089 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.275248 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.275399 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.275566 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.275716 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.275864 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.276012 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.276242 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.276409 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.276561 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.276710 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.276859 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.277040 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.277191 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.277340 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.277513 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.277680 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.277833 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.277991 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.278141 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.278540 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.278783 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.278964 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.279218 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.279471 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.279471 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.279780 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.279946 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.280105 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.280265 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.280415 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.280572 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.280729 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.280887 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.281043 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.281203 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.281354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.281575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.281937 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.282095 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.282244 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.282244 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.282540 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.282745 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.282898 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.283046 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.283203 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.283203 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.283506 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.283658 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.283824 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.283982 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.284145 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.284302 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.284453 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.284628 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.284846 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.285009 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.285169 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.285318 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.285467 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.285641 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.285801 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.285961 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.286120 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.286278 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.286427 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.286577 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.286734 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.286902 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.287065 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.287214 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.287371 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.287535 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.287694 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.287863 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.288014 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.288014 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.288304 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.288693 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.288940 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.289108 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.289361 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.289628 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.289797 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.289955 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.290121 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.290121 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.290424 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.290575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.290724 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.290876 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.291039 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.291196 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.291196 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.291489 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.291644 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.292513 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.292674 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.292837 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.292995 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.293145 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.293301 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.293457 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.293745 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.293902 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.294067 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.294217 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.294379 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.294552 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.294710 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.294876 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.295122 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.295285 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.295442 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.295606 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.295757 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.295906 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.296056 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.296204 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.296353 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.296515 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.296672 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.296974 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.297161 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.297428 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.297628 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.297628 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.297926 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.298085 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.298236 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.298385 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.298565 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.298975 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.299217 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.299401 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.299672 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.299933 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.300097 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.300258 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.300408 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.300557 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.300557 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.300849 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.301008 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.301159 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.301316 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.301466 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.301785 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.301947 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.302115 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.302265 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.302631 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.302788 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.302946 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.303106 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.303264 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.303423 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.303573 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.303721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.303870 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.304034 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.304192 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.304360 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.304519 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.304675 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.304832 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.304991 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.305797 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.305975 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.306127 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.306284 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.306445 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.306603 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.306753 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.306912 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.307061 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.307355 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.307581 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.307843 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.308092 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.308253 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.308412 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.308564 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.308741 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.309136 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.309136 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.309589 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.309869 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.310122 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.310293 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.310444 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.310600 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.310753 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.310910 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.311074 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.311233 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.311390 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.311553 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.311710 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.311881 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.312203 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.312203 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.312513 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.312855 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.313007 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.313165 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.313325 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.313541 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.313708 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.313860 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.314010 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.314174 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.314343 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.314343 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.314628 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.314777 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.314928 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.315085 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.315260 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.315482 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.315643 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.315793 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.315952 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.316118 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.316269 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.316437 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.316594 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.316745 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.316900 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.317059 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.317218 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.317368 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.317535 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.317702 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.317867 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.318029 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.318126 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.318199 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.318330 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.318422 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.318516 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.318600 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.318690 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.318774 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.318856 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.318945 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.319404 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.319604 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.319722 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.319841 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.319961 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.320086 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.320306 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.320519 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.320645 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.320645 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.320860 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.320981 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.321099 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.321211 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.321320 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.321429 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.321571 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.321707 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.321819 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.321928 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.322037 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.322146 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.322264 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.322387 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.322506 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.322617 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.323451 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.323660 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.323868 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.323995 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.324113 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.324230 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.324349 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.324466 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.324626 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.324743 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.324862 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.324973 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.325087 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.325198 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.325392 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.325632 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.325749 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.325866 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.325985 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.326110 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.326228 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.326357 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.326469 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.326579 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.326697 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.326818 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.326936 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.327048 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.327157 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.327274 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.327392 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.327512 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.327641 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.327752 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.327862 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.327971 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.328080 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.328200 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.328335 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.328446 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.328556 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.328665 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.328665 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.328881 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.329000 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.329112 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.329461 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.329617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.329617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.329933 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.330057 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.330178 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.330178 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.330514 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.330729 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.330845 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.330845 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.331064 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.331064 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.331283 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.331394 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.331512 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.331629 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.331748 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.331866 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.331989 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.332132 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.332263 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.332391 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.332521 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.332650 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.332806 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.333207 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.333207 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.333207 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.333207 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.333666 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.333789 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.333789 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.334013 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.334132 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.334244 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.334367 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.334486 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.334603 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.334714 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.334824 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.334934 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.335053 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.335171 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.335282 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.335391 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.335507 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.335643 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.335837 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.335954 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.336064 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.336183 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.336302 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.336422 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.336541 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.336652 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.336762 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.336873 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.336982 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.337101 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.337212 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.337330 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.337441 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.337616 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.337750 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.337870 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.337982 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.338098 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.338211 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.338337 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.338462 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.338621 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.338741 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.338853 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.338962 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.339072 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.339196 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.339327 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.339662 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.339804 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.340002 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.340122 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.340243 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.340362 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.340491 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.340720 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.340926 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.341041 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.341162 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.341281 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.341400 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.341531 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.341647 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.341788 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.341902 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 26 13:01:55.342012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.342012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.342012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.342012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.342012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.342012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.342012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.342012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.342832 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.342832 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.342832 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.342832 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.342832 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.342832 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.342832 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.342832 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.343858 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.343858 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.343858 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.343858 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.343858 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.343858 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.343858 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.343858 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.344686 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.344686 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.344686 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.344686 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.344686 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.344686 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.344686 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.344686 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.345527 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.345527 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.345527 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.345527 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.345527 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.345527 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.345527 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.345527 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.346476 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.346476 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.346476 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.346476 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.346476 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.346476 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.346476 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.346476 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.347343 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.347343 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 13:01:55.347343 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 26 13:01:55.392674 n-d-862686-1 devstack@n-api.service[120597]: INFO dbcounter [None req-8a504190-3121-4711-9162-8e394a1bc4af None None] Registered counter for database nova_api Oct 26 13:01:55.413767 n-d-862686-1 devstack@n-api.service[120598]: INFO dbcounter [None req-564d170d-9956-44b1-9f52-a2ee781db653 None None] Registered counter for database nova_api Oct 26 13:01:55.414093 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_db.sqlalchemy.engines [None req-8a504190-3121-4711-9162-8e394a1bc4af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120597) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 13:01:55.421285 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writer thread running {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 13:01:55.435138 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_db.sqlalchemy.engines [None req-564d170d-9956-44b1-9f52-a2ee781db653 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120598) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 13:01:55.441904 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writer thread running {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 13:01:55.478682 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.context [None req-8a504190-3121-4711-9162-8e394a1bc4af None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2e5960f1-3c3d-401b-877c-fe82eb67bd3f(cell1) {{(pid=120597) load_cells /opt/stack/nova/nova/context.py:464}} Oct 26 13:01:55.482919 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8a504190-3121-4711-9162-8e394a1bc4af None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:01:55.483403 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8a504190-3121-4711-9162-8e394a1bc4af None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:01:55.484984 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8a504190-3121-4711-9162-8e394a1bc4af None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:01:55.485743 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8a504190-3121-4711-9162-8e394a1bc4af None None] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:01:55.486204 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8a504190-3121-4711-9162-8e394a1bc4af None None] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:01:55.488262 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8a504190-3121-4711-9162-8e394a1bc4af None None] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:01:55.490327 n-d-862686-1 devstack@n-api.service[120597]: INFO dbcounter [None req-8a504190-3121-4711-9162-8e394a1bc4af None None] Registered counter for database nova_cell0 Oct 26 13:01:55.494559 n-d-862686-1 devstack@n-api.service[120597]: INFO dbcounter [None req-8a504190-3121-4711-9162-8e394a1bc4af None None] Registered counter for database nova_cell1 Oct 26 13:01:55.501883 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.context [None req-564d170d-9956-44b1-9f52-a2ee781db653 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2e5960f1-3c3d-401b-877c-fe82eb67bd3f(cell1) {{(pid=120598) load_cells /opt/stack/nova/nova/context.py:464}} Oct 26 13:01:55.502405 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_db.sqlalchemy.engines [None req-8a504190-3121-4711-9162-8e394a1bc4af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120597) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 13:01:55.504537 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_db.sqlalchemy.engines [None req-8a504190-3121-4711-9162-8e394a1bc4af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120597) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 13:01:55.506370 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-564d170d-9956-44b1-9f52-a2ee781db653 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:01:55.506860 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-564d170d-9956-44b1-9f52-a2ee781db653 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:01:55.508555 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-564d170d-9956-44b1-9f52-a2ee781db653 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:01:55.509290 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-564d170d-9956-44b1-9f52-a2ee781db653 None None] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:01:55.509535 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writer thread running {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 13:01:55.509774 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-564d170d-9956-44b1-9f52-a2ee781db653 None None] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:01:55.513013 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writer thread running {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 13:01:55.513897 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-564d170d-9956-44b1-9f52-a2ee781db653 None None] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:01:55.516559 n-d-862686-1 devstack@n-api.service[120598]: INFO dbcounter [None req-564d170d-9956-44b1-9f52-a2ee781db653 None None] Registered counter for database nova_cell0 Oct 26 13:01:55.520321 n-d-862686-1 devstack@n-api.service[120598]: INFO dbcounter [None req-564d170d-9956-44b1-9f52-a2ee781db653 None None] Registered counter for database nova_cell1 Oct 26 13:01:55.528420 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_db.sqlalchemy.engines [None req-564d170d-9956-44b1-9f52-a2ee781db653 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120598) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 13:01:55.530805 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_db.sqlalchemy.engines [None req-564d170d-9956-44b1-9f52-a2ee781db653 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120598) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 13:01:55.535357 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writer thread running {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 13:01:55.660993 n-d-862686-1 devstack@n-api.service[120597]: INFO dbcounter [None req-8a504190-3121-4711-9162-8e394a1bc4af None None] Registered counter for database nova_cell0 Oct 26 13:01:55.669242 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_db.sqlalchemy.engines [None req-8a504190-3121-4711-9162-8e394a1bc4af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120597) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 13:01:55.674226 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writer thread running {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 13:01:55.678186 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writer thread running {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 13:01:55.688310 n-d-862686-1 devstack@n-api.service[120598]: INFO dbcounter [None req-564d170d-9956-44b1-9f52-a2ee781db653 None None] Registered counter for database nova_cell0 Oct 26 13:01:55.695304 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_db.sqlalchemy.engines [None req-564d170d-9956-44b1-9f52-a2ee781db653 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120598) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 13:01:55.700329 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writer thread running {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 13:01:55.997229 n-d-862686-1 devstack@n-api.service[120597]: WARNING keystonemiddleware.auth_token [None req-8a504190-3121-4711-9162-8e394a1bc4af None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 26 13:01:56.004416 n-d-862686-1 devstack@n-api.service[120597]: WARNING keystonemiddleware.auth_token [None req-8a504190-3121-4711-9162-8e394a1bc4af None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 26 13:01:56.021101 n-d-862686-1 devstack@n-api.service[120598]: WARNING keystonemiddleware.auth_token [None req-564d170d-9956-44b1-9f52-a2ee781db653 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 26 13:01:56.028454 n-d-862686-1 devstack@n-api.service[120598]: WARNING keystonemiddleware.auth_token [None req-564d170d-9956-44b1-9f52-a2ee781db653 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 26 13:01:56.347772 n-d-862686-1 devstack@n-api.service[120597]: WARNING keystonemiddleware.auth_token [None req-8a504190-3121-4711-9162-8e394a1bc4af None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 26 13:01:56.354628 n-d-862686-1 devstack@n-api.service[120597]: WARNING keystonemiddleware.auth_token [None req-8a504190-3121-4711-9162-8e394a1bc4af None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 26 13:01:56.360567 n-d-862686-1 devstack@n-api.service[120597]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555d5fef69c0 pid: 120597 (default app) Oct 26 13:01:56.371639 n-d-862686-1 devstack@n-api.service[120598]: WARNING keystonemiddleware.auth_token [None req-564d170d-9956-44b1-9f52-a2ee781db653 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 26 13:01:56.377656 n-d-862686-1 devstack@n-api.service[120598]: WARNING keystonemiddleware.auth_token [None req-564d170d-9956-44b1-9f52-a2ee781db653 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 26 13:01:56.382991 n-d-862686-1 devstack@n-api.service[120598]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555d5fef69c0 pid: 120598 (default app) Oct 26 13:02:36.366016 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:02:36.367464 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:02:36.368422 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:02:36.370018 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:02:36.744641 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:02:36.746211 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:02:36.747474 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:02:36.748242 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:02:37.562753 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3d2bf7cd-633d-4597-8b00-8676bdb52b13 tempest-AZAdminNegativeTestJSON-1628348185 tempest-AZAdminNegativeTestJSON-1628348185-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:37.564420 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3d2bf7cd-633d-4597-8b00-8676bdb52b13 tempest-AZAdminNegativeTestJSON-1628348185 tempest-AZAdminNegativeTestJSON-1628348185-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '1209e3fd135343359fa932077a909d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95ca9d5d32c4c4d816304ef986bae41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:02:37.567566 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3d2bf7cd-633d-4597-8b00-8676bdb52b13 tempest-AZAdminNegativeTestJSON-1628348185 tempest-AZAdminNegativeTestJSON-1628348185-project] Request method failure captured: Oct 26 13:02:37.567566 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 26 13:02:37.567566 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:02:37.567566 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:02:37.567566 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:02:37.567566 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:02:37.567566 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:02:37.567566 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:02:37.567566 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:02:37.567566 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:02:37.567566 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWS_qDAQR1CO2OJD8QmsqKPuqD1JWwMH0ruS29f2l4dn5h4zQXREMENc7d7ypp8IKXD_sm8YpfcZwEighCGBEXD8ynhJbG7L3K5pgQvGyzzez7m-urkNdjy8NfXW28-4LeedVKm5cbf93zPO-Yn32xfDW1tNH3LRhl3jN1ArlMJx0eG0 Oct 26 13:02:37.567566 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:02:37.567566 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:02:37.567566 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:02:37.567566 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:02:37.567566 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:02:37.567566 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:02:37.567566 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: f95ca9d5d32c4c4d816304ef986bae41 Oct 26 13:02:37.567566 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1628348185 Oct 26 13:02:37.567566 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:02:37.567566 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:02:37.569146 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f95ca9d5d32c4c4d816304ef986bae41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f95ca9d5d32c4c4d816304ef986bae41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f95ca9d5d32c4c4d816304ef986bae41"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f95ca9d5d32c4c4d816304ef986bae41"}]}] Oct 26 13:02:37.569146 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-AZAdminNegativeTestJSON-1628348185 Oct 26 13:02:37.569146 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: f95ca9d5d32c4c4d816304ef986bae41 Oct 26 13:02:37.569146 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1628348185 Oct 26 13:02:37.569146 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-AZAdminNegativeTestJSON-1628348185-project Oct 26 13:02:37.569146 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:02:37.569146 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:02:37.569146 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 1209e3fd135343359fa932077a909d58 Oct 26 13:02:37.569146 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-AZAdminNegativeTestJSON-1628348185-project Oct 26 13:02:37.569146 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:02:37.569146 n-d-862686-1 devstack@n-api.service[120598]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 26 13:02:37.569146 n-d-862686-1 devstack@n-api.service[120598]: action_args: {} Oct 26 13:02:37.570222 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:02:37.570222 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:37.570222 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:37.570222 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:37.570222 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:02:37.570222 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:02:37.570222 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:02:37.570222 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:02:37.570222 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 26 13:02:37.570222 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 26 13:02:37.570222 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 13:02:37.570222 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 13:02:37.570222 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 13:02:37.570222 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 13:02:37.570222 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 13:02:37.570222 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 13:02:37.570222 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 13:02:37.570222 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 13:02:37.570222 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 13:02:37.571676 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 13:02:37.571676 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 13:02:37.571676 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 13:02:37.571676 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 13:02:37.571676 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 13:02:37.571676 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 26 13:02:37.571676 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:37.571676 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:37.571676 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:37.571676 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:37.571676 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:37.571676 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:37.571676 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 13:02:37.571676 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 13:02:37.571676 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 26 13:02:37.571676 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:37.571676 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3d2bf7cd-633d-4597-8b00-8676bdb52b13 tempest-AZAdminNegativeTestJSON-1628348185 tempest-AZAdminNegativeTestJSON-1628348185-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:02:37.573382 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3d2bf7cd-633d-4597-8b00-8676bdb52b13 tempest-AZAdminNegativeTestJSON-1628348185 tempest-AZAdminNegativeTestJSON-1628348185-project] 10.222.0.40 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.832498 Oct 26 13:02:37.573382 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1/1] 10.222.0.40 () {58 vars in 1185 bytes} [Wed Oct 26 13:02:36 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 835 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:02:37.594394 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-020aee01-763f-4f88-bb6c-999330532969 tempest-AggregatesAdminTestV241-495959404 tempest-AggregatesAdminTestV241-495959404-project-admin] Calling method '.version_select at 0x7f673407fee0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:37.605563 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-020aee01-763f-4f88-bb6c-999330532969 tempest-AggregatesAdminTestV241-495959404 tempest-AggregatesAdminTestV241-495959404-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2e5960f1-3c3d-401b-877c-fe82eb67bd3f(cell1) {{(pid=120597) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 26 13:02:37.606393 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-020aee01-763f-4f88-bb6c-999330532969 tempest-AggregatesAdminTestV241-495959404 tempest-AggregatesAdminTestV241-495959404-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:37.606951 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-020aee01-763f-4f88-bb6c-999330532969 tempest-AggregatesAdminTestV241-495959404 tempest-AggregatesAdminTestV241-495959404-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:37.607457 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-020aee01-763f-4f88-bb6c-999330532969 tempest-AggregatesAdminTestV241-495959404 tempest-AggregatesAdminTestV241-495959404-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:37.635879 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-020aee01-763f-4f88-bb6c-999330532969 tempest-AggregatesAdminTestV241-495959404 tempest-AggregatesAdminTestV241-495959404-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:37.636774 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-020aee01-763f-4f88-bb6c-999330532969 tempest-AggregatesAdminTestV241-495959404 tempest-AggregatesAdminTestV241-495959404-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:37.637215 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-020aee01-763f-4f88-bb6c-999330532969 tempest-AggregatesAdminTestV241-495959404 tempest-AggregatesAdminTestV241-495959404-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:37.650249 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-020aee01-763f-4f88-bb6c-999330532969 tempest-AggregatesAdminTestV241-495959404 tempest-AggregatesAdminTestV241-495959404-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:37.650761 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-020aee01-763f-4f88-bb6c-999330532969 tempest-AggregatesAdminTestV241-495959404 tempest-AggregatesAdminTestV241-495959404-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:37.651195 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-020aee01-763f-4f88-bb6c-999330532969 tempest-AggregatesAdminTestV241-495959404 tempest-AggregatesAdminTestV241-495959404-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:37.657463 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-020aee01-763f-4f88-bb6c-999330532969 tempest-AggregatesAdminTestV241-495959404 tempest-AggregatesAdminTestV241-495959404-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 1.296681 Oct 26 13:02:37.658063 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1/2] 10.222.0.40 () {60 vars in 1208 bytes} [Wed Oct 26 13:02:36 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:02:37.812669 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cb2185e9-3bc9-4633-9ebd-3c2a4464e5a2 tempest-FlavorsExtraSpecsNegativeTestJSON-111070355 tempest-FlavorsExtraSpecsNegativeTestJSON-111070355-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-403709279", "ram": 512, "vcpus": 1, "disk": 10, "id": 1794496481, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:37.871409 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cb2185e9-3bc9-4633-9ebd-3c2a4464e5a2 tempest-FlavorsExtraSpecsNegativeTestJSON-111070355 tempest-FlavorsExtraSpecsNegativeTestJSON-111070355-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.300377 Oct 26 13:02:37.872566 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2/3] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:02:37 2022] POST /compute/v2.1/flavors => generated 415 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:02:37.989090 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7b655e8a-7bfc-4233-8213-b8624791e08f tempest-FlavorsAccessTestJSON-1946482852 tempest-FlavorsAccessTestJSON-1946482852-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1744939086", "id": 210646257, "os-flavor-access:is_public": "False"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:38.049496 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2dfa2e9d-7a35-41d4-8867-0908d278c985 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:38.053267 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2dfa2e9d-7a35-41d4-8867-0908d278c985 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:38.053775 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2dfa2e9d-7a35-41d4-8867-0908d278c985 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:38.054203 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2dfa2e9d-7a35-41d4-8867-0908d278c985 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:38.054913 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2dfa2e9d-7a35-41d4-8867-0908d278c985 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:38.055359 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2dfa2e9d-7a35-41d4-8867-0908d278c985 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:38.055773 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2dfa2e9d-7a35-41d4-8867-0908d278c985 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:38.061727 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7b655e8a-7bfc-4233-8213-b8624791e08f tempest-FlavorsAccessTestJSON-1946482852 tempest-FlavorsAccessTestJSON-1946482852-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.385225 Oct 26 13:02:38.063000 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2/4] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:02:37 2022] POST /compute/v2.1/flavors => generated 428 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:02:38.100674 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2dfa2e9d-7a35-41d4-8867-0908d278c985 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.226905 Oct 26 13:02:38.101243 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3/5] 10.222.0.40 () {58 vars in 1176 bytes} [Wed Oct 26 13:02:37 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:02:38.288028 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8f509c9b-644c-4d27-a930-0af0d3d55a54 tempest-HostsAdminNegativeTestJSON-2144614408 tempest-HostsAdminNegativeTestJSON-2144614408-project-admin] Calling method '.version_select at 0x7f67340a5f70>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:38.302931 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8f509c9b-644c-4d27-a930-0af0d3d55a54 tempest-HostsAdminNegativeTestJSON-2144614408 tempest-HostsAdminNegativeTestJSON-2144614408-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:38.303615 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8f509c9b-644c-4d27-a930-0af0d3d55a54 tempest-HostsAdminNegativeTestJSON-2144614408 tempest-HostsAdminNegativeTestJSON-2144614408-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:38.304271 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8f509c9b-644c-4d27-a930-0af0d3d55a54 tempest-HostsAdminNegativeTestJSON-2144614408 tempest-HostsAdminNegativeTestJSON-2144614408-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:38.305211 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8f509c9b-644c-4d27-a930-0af0d3d55a54 tempest-HostsAdminNegativeTestJSON-2144614408 tempest-HostsAdminNegativeTestJSON-2144614408-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:38.305834 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8f509c9b-644c-4d27-a930-0af0d3d55a54 tempest-HostsAdminNegativeTestJSON-2144614408 tempest-HostsAdminNegativeTestJSON-2144614408-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:38.306289 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8f509c9b-644c-4d27-a930-0af0d3d55a54 tempest-HostsAdminNegativeTestJSON-2144614408 tempest-HostsAdminNegativeTestJSON-2144614408-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:38.353031 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8f509c9b-644c-4d27-a930-0af0d3d55a54 tempest-HostsAdminNegativeTestJSON-2144614408 tempest-HostsAdminNegativeTestJSON-2144614408-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.288546 Oct 26 13:02:38.358296 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3/6] 10.222.0.40 () {58 vars in 1128 bytes} [Wed Oct 26 13:02:38 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:02:38.363215 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e711a8fa-11f3-4672-9f97-75676df61042 tempest-AggregatesAdminTestV241-495959404 tempest-AggregatesAdminTestV241-495959404-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1385123580"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:38.366818 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.aggregate [None req-e711a8fa-11f3-4672-9f97-75676df61042 tempest-AggregatesAdminTestV241-495959404 tempest-AggregatesAdminTestV241-495959404-project-admin] Generated uuid b66cbbf4-77ef-4dcb-99ae-3bac26215ae3 for aggregate {{(pid=120597) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 26 13:02:38.407752 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-17d966b1-099c-4dcb-a5f3-bc31bb84d68b tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Calling method '.version_select at 0x7f6733eeb310>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:38.415851 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-17d966b1-099c-4dcb-a5f3-bc31bb84d68b tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2e5960f1-3c3d-401b-877c-fe82eb67bd3f(cell1) {{(pid=120598) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 26 13:02:38.417585 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17d966b1-099c-4dcb-a5f3-bc31bb84d68b tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:38.418363 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17d966b1-099c-4dcb-a5f3-bc31bb84d68b tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:38.419007 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17d966b1-099c-4dcb-a5f3-bc31bb84d68b tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:38.451549 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17d966b1-099c-4dcb-a5f3-bc31bb84d68b tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:38.452332 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17d966b1-099c-4dcb-a5f3-bc31bb84d68b tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:38.452947 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17d966b1-099c-4dcb-a5f3-bc31bb84d68b tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:38.457974 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e711a8fa-11f3-4672-9f97-75676df61042 tempest-AggregatesAdminTestV241-495959404 tempest-AggregatesAdminTestV241-495959404-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.098248 Oct 26 13:02:38.459174 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 4/7] 10.222.0.40 () {62 vars in 1205 bytes} [Wed Oct 26 13:02:38 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:02:38.487243 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17d966b1-099c-4dcb-a5f3-bc31bb84d68b tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:38.488291 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17d966b1-099c-4dcb-a5f3-bc31bb84d68b tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:38.488837 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17d966b1-099c-4dcb-a5f3-bc31bb84d68b tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:38.502572 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-17d966b1-099c-4dcb-a5f3-bc31bb84d68b tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.399653 Oct 26 13:02:38.505430 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 4/8] 10.222.0.40 () {58 vars in 1167 bytes} [Wed Oct 26 13:02:38 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:02:38.512268 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b57154b5-b739-4e1b-8fb5-6454a6888467 tempest-FlavorsAccessTestJSON-1946482852 tempest-FlavorsAccessTestJSON-1946482852-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "739cba2464f644e6b41109994c83158f"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:38.618181 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5f8017e3-273f-42e9-8aa4-8443776b4213 tempest-FlavorsExtraSpecsNegativeTestJSON-48227156 tempest-FlavorsExtraSpecsNegativeTestJSON-48227156-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:38.658193 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-5f8017e3-273f-42e9-8aa4-8443776b4213 tempest-FlavorsExtraSpecsNegativeTestJSON-48227156 tempest-FlavorsExtraSpecsNegativeTestJSON-48227156-project] HTTP exception thrown: Flavor 1794496481 has no extra specs with key hw:cpu_thread_policy. Oct 26 13:02:38.660304 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5f8017e3-273f-42e9-8aa4-8443776b4213 tempest-FlavorsExtraSpecsNegativeTestJSON-48227156 tempest-FlavorsExtraSpecsNegativeTestJSON-48227156-project] Request method failure captured: Oct 26 13:02:38.660304 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/flavors/1794496481/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 26 13:02:38.660304 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:02:38.660304 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:02:38.660304 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:02:38.660304 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:02:38.660304 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:02:38.660304 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:02:38.660304 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:02:38.660304 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:02:38.660304 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWS_qmhfz_Zu2HS4pAki-8sKXb_zsOEUcwu5FS8Bs20j4KMgQXhgn1t5kfRiuwdEohTARDDkIJqatyD3ocjV3n1snehmU39fRcOWpKqO0-AwMLGdOgVzPLoXKApuP1V_Lc2iI9pUItVV5pewT5Jqg7FWyjainrUT2pAAa0VoOqAZVm58 Oct 26 13:02:38.660304 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:02:38.660304 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:02:38.660304 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:02:38.660304 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:02:38.660304 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:02:38.660304 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:02:38.660304 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 1c71d432293741edba68c65f5c23004b Oct 26 13:02:38.660304 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-48227156 Oct 26 13:02:38.660304 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:02:38.660304 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:02:38.661523 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1c71d432293741edba68c65f5c23004b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1c71d432293741edba68c65f5c23004b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1c71d432293741edba68c65f5c23004b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1c71d432293741edba68c65f5c23004b"}]}] Oct 26 13:02:38.661523 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-48227156 Oct 26 13:02:38.661523 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 1c71d432293741edba68c65f5c23004b Oct 26 13:02:38.661523 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-48227156 Oct 26 13:02:38.661523 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-48227156-project Oct 26 13:02:38.661523 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:02:38.661523 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:02:38.661523 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 4cc5d3cd70314f1e8041ecf090ab3a20 Oct 26 13:02:38.661523 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-48227156-project Oct 26 13:02:38.661523 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:02:38.661523 n-d-862686-1 devstack@n-api.service[120597]: exception: Flavor 1794496481 has no extra specs with key hw:cpu_thread_policy. Oct 26 13:02:38.662437 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'flavor_id': '1794496481', 'id': 'hw:cpu_thread_policy'} Oct 26 13:02:38.662437 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:02:38.662437 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:38.662437 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 26 13:02:38.662437 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 26 13:02:38.662437 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 26 13:02:38.662437 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:38.662437 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:38.662437 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:38.662437 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:38.662437 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:38.662437 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:38.662437 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:02:38.662437 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:02:38.662437 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:02:38.662437 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:02:38.662437 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 26 13:02:38.662437 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 26 13:02:38.662437 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1794496481 has no extra specs with key hw:cpu_thread_policy. Oct 26 13:02:38.662437 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:38.662437 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:38.662437 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:38.663392 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:38.663392 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:38.663392 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:38.663392 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:02:38.663392 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:02:38.663392 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1794496481 has no extra specs with key hw:cpu_thread_policy. Oct 26 13:02:38.663392 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:38.663392 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5f8017e3-273f-42e9-8aa4-8443776b4213 tempest-FlavorsExtraSpecsNegativeTestJSON-48227156 tempest-FlavorsExtraSpecsNegativeTestJSON-48227156-project] Returning 404 to user: Flavor 1794496481 has no extra specs with key hw:cpu_thread_policy. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:02:38.663392 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5f8017e3-273f-42e9-8aa4-8443776b4213 tempest-FlavorsExtraSpecsNegativeTestJSON-48227156 tempest-FlavorsExtraSpecsNegativeTestJSON-48227156-project] 10.222.0.40 "GET /compute/v2.1/flavors/1794496481/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.201482 Oct 26 13:02:38.663392 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 5/9] 10.222.0.40 () {58 vars in 1266 bytes} [Wed Oct 26 13:02:38 2022] GET /compute/v2.1/flavors/1794496481/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 203 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:02:38.784608 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b57154b5-b739-4e1b-8fb5-6454a6888467 tempest-FlavorsAccessTestJSON-1946482852 tempest-FlavorsAccessTestJSON-1946482852-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/210646257/action" status: 200 len: 96 microversion: 2.1 time: 0.278042 Oct 26 13:02:38.785200 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 5/10] 10.222.0.40 () {60 vars in 1197 bytes} [Wed Oct 26 13:02:38 2022] POST /compute/v2.1/flavors/210646257/action => generated 96 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:02:38.789753 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ac4e8834-3e69-48ef-9276-a335794c8f21 tempest-AggregatesAdminTestV241-495959404 tempest-AggregatesAdminTestV241-495959404-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-428399058"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:38.861715 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0dcf64c5-af9d-4d8a-8e55-d0e4bd550cee tempest-HostsAdminNegativeTestJSON-1055221838 tempest-HostsAdminNegativeTestJSON-1055221838-project] Calling method '.version_select at 0x7f67336670d0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:38.865075 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0dcf64c5-af9d-4d8a-8e55-d0e4bd550cee tempest-HostsAdminNegativeTestJSON-1055221838 tempest-HostsAdminNegativeTestJSON-1055221838-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '71ad5b5b4c8f4c8c91cf81b97980b0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92097efddaf64433973f5e72da0ac63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:02:38.868692 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0dcf64c5-af9d-4d8a-8e55-d0e4bd550cee tempest-HostsAdminNegativeTestJSON-1055221838 tempest-HostsAdminNegativeTestJSON-1055221838-project] Request method failure captured: Oct 26 13:02:38.868692 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 26 13:02:38.868692 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:02:38.868692 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:02:38.868692 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:02:38.868692 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:02:38.868692 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:02:38.868692 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:02:38.868692 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:02:38.868692 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:02:38.868692 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWS_rq7MnvS4et4d81O3jmRwenIi5cbjrQrZDx-cyYszVacFh7rurIgioH5Dl8fDM80iXWWxn8PkSMFINPvhvIxVLOjEfLOWFWTjR4yXdUmpiIgcyWPP0w5fC0j9xcTIXTzMl9xcq8Z2FmEfG8d6v_X5YGx1oxTXCQd1aUScoi0d80a0 Oct 26 13:02:38.868692 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:02:38.868692 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:02:38.868692 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:02:38.868692 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:02:38.868692 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:02:38.868692 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:02:38.868692 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 92097efddaf64433973f5e72da0ac63a Oct 26 13:02:38.868692 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1055221838 Oct 26 13:02:38.868692 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:02:38.868692 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:02:38.870840 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/92097efddaf64433973f5e72da0ac63a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/92097efddaf64433973f5e72da0ac63a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_92097efddaf64433973f5e72da0ac63a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/92097efddaf64433973f5e72da0ac63a"}]}] Oct 26 13:02:38.870840 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1055221838 Oct 26 13:02:38.870840 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 92097efddaf64433973f5e72da0ac63a Oct 26 13:02:38.870840 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1055221838 Oct 26 13:02:38.870840 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-HostsAdminNegativeTestJSON-1055221838-project Oct 26 13:02:38.870840 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:02:38.870840 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:02:38.870840 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 71ad5b5b4c8f4c8c91cf81b97980b0ea Oct 26 13:02:38.870840 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1055221838-project Oct 26 13:02:38.870840 n-d-862686-1 devstack@n-api.service[120597]: method: Oct 26 13:02:38.870840 n-d-862686-1 devstack@n-api.service[120597]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 26 13:02:38.870840 n-d-862686-1 devstack@n-api.service[120597]: action_args: {} Oct 26 13:02:38.870840 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:02:38.871551 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:38.871551 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:38.871551 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:38.871551 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:02:38.871551 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:02:38.871551 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:02:38.871551 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:02:38.871551 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 26 13:02:38.871551 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:02:38.871551 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:02:38.871551 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:02:38.871551 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 26 13:02:38.871551 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 26 13:02:38.871551 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 13:02:38.871551 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 13:02:38.871551 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 13:02:38.871551 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 13:02:38.871551 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 13:02:38.871551 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 13:02:38.872557 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 13:02:38.872557 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 13:02:38.872557 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 13:02:38.872557 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 13:02:38.872557 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 13:02:38.872557 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 13:02:38.872557 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 13:02:38.872557 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 13:02:38.872557 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 26 13:02:38.872557 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:38.872557 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:38.872557 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:38.872557 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:38.872557 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:38.872557 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:38.872557 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 13:02:38.872557 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 13:02:38.872557 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 26 13:02:38.872557 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:38.874269 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0dcf64c5-af9d-4d8a-8e55-d0e4bd550cee tempest-HostsAdminNegativeTestJSON-1055221838 tempest-HostsAdminNegativeTestJSON-1055221838-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:02:38.875271 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0dcf64c5-af9d-4d8a-8e55-d0e4bd550cee tempest-HostsAdminNegativeTestJSON-1055221838 tempest-HostsAdminNegativeTestJSON-1055221838-project] 10.222.0.40 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.211867 Oct 26 13:02:38.875938 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 6/11] 10.222.0.40 () {58 vars in 1128 bytes} [Wed Oct 26 13:02:38 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 213 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:02:38.887441 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a43b5ead-baf3-4130-a98b-f65c41c69106 tempest-FlavorsExtraSpecsNegativeTestJSON-48227156 tempest-FlavorsExtraSpecsNegativeTestJSON-48227156-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:38.896190 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a43b5ead-baf3-4130-a98b-f65c41c69106 tempest-FlavorsExtraSpecsNegativeTestJSON-48227156 tempest-FlavorsExtraSpecsNegativeTestJSON-48227156-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '4cc5d3cd70314f1e8041ecf090ab3a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c71d432293741edba68c65f5c23004b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:02:38.901280 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a43b5ead-baf3-4130-a98b-f65c41c69106 tempest-FlavorsExtraSpecsNegativeTestJSON-48227156 tempest-FlavorsExtraSpecsNegativeTestJSON-48227156-project] Request method failure captured: Oct 26 13:02:38.901280 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/flavors/1794496481/os-extra_specs HTTP/1.1 Oct 26 13:02:38.901280 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:02:38.901280 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:02:38.901280 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:02:38.901280 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 66 Oct 26 13:02:38.901280 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:02:38.901280 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:02:38.901280 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:02:38.901280 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:02:38.901280 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWS_qmhfz_Zu2HS4pAki-8sKXb_zsOEUcwu5FS8Bs20j4KMgQXhgn1t5kfRiuwdEohTARDDkIJqatyD3ocjV3n1snehmU39fRcOWpKqO0-AwMLGdOgVzPLoXKApuP1V_Lc2iI9pUItVV5pewT5Jqg7FWyjainrUT2pAAa0VoOqAZVm58 Oct 26 13:02:38.901280 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:02:38.901280 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:02:38.901280 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:02:38.901280 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:02:38.901280 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:02:38.901280 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:02:38.901280 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 1c71d432293741edba68c65f5c23004b Oct 26 13:02:38.901280 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-48227156 Oct 26 13:02:38.901280 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:02:38.901280 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:02:38.902458 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1c71d432293741edba68c65f5c23004b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1c71d432293741edba68c65f5c23004b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1c71d432293741edba68c65f5c23004b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1c71d432293741edba68c65f5c23004b"}]}] Oct 26 13:02:38.902458 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-48227156 Oct 26 13:02:38.902458 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 1c71d432293741edba68c65f5c23004b Oct 26 13:02:38.902458 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-48227156 Oct 26 13:02:38.902458 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-48227156-project Oct 26 13:02:38.902458 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:02:38.902458 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:02:38.902458 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 4cc5d3cd70314f1e8041ecf090ab3a20 Oct 26 13:02:38.902458 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-48227156-project Oct 26 13:02:38.902458 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:02:38.902458 n-d-862686-1 devstack@n-api.service[120597]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 26 13:02:38.902458 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:02:38.903116 n-d-862686-1 devstack@n-api.service[120597]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 26 13:02:38.903116 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'flavor_id': '1794496481', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 26 13:02:38.903116 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:02:38.903116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:38.903116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:38.903116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:38.903116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:02:38.903116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:02:38.903116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:02:38.903116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:02:38.903116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:02:38.903116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:02:38.903116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 26 13:02:38.903116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 26 13:02:38.903116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 13:02:38.903116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 13:02:38.903116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 13:02:38.903116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 13:02:38.903116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 13:02:38.904131 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 13:02:38.904131 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 13:02:38.904131 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 13:02:38.904131 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 13:02:38.904131 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 13:02:38.904131 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 13:02:38.904131 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 13:02:38.904131 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 13:02:38.904131 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 13:02:38.904131 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 26 13:02:38.904131 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:38.904131 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:38.904131 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:38.904131 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:38.904131 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:38.904131 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:38.904131 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 13:02:38.904131 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 13:02:38.904131 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 26 13:02:38.904131 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:38.906796 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a43b5ead-baf3-4130-a98b-f65c41c69106 tempest-FlavorsExtraSpecsNegativeTestJSON-48227156 tempest-FlavorsExtraSpecsNegativeTestJSON-48227156-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:02:38.907773 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a43b5ead-baf3-4130-a98b-f65c41c69106 tempest-FlavorsExtraSpecsNegativeTestJSON-48227156 tempest-FlavorsExtraSpecsNegativeTestJSON-48227156-project] 10.222.0.40 "POST /compute/v2.1/flavors/1794496481/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.025309 Oct 26 13:02:38.908466 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 7/12] 10.222.0.40 () {60 vars in 1224 bytes} [Wed Oct 26 13:02:38 2022] POST /compute/v2.1/flavors/1794496481/os-extra_specs => generated 124 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:02:38.957587 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ac4e8834-3e69-48ef-9276-a335794c8f21 tempest-AggregatesAdminTestV241-495959404 tempest-AggregatesAdminTestV241-495959404-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.170566 Oct 26 13:02:38.959234 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 6/13] 10.222.0.40 () {62 vars in 1210 bytes} [Wed Oct 26 13:02:38 2022] PUT /compute/v2.1/os-aggregates/1 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:02:38.966126 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4bb8577c-d022-4316-8ff2-d367450e302c tempest-HostsAdminNegativeTestJSON-1055221838 tempest-HostsAdminNegativeTestJSON-1055221838-project] Calling method '.version_select at 0x7f6733e16790>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:38.968232 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4bb8577c-d022-4316-8ff2-d367450e302c tempest-HostsAdminNegativeTestJSON-1055221838 tempest-HostsAdminNegativeTestJSON-1055221838-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '71ad5b5b4c8f4c8c91cf81b97980b0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92097efddaf64433973f5e72da0ac63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:02:38.970617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4bb8577c-d022-4316-8ff2-d367450e302c tempest-HostsAdminNegativeTestJSON-1055221838 tempest-HostsAdminNegativeTestJSON-1055221838-project] Request method failure captured: Oct 26 13:02:38.970617 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/os-hosts/n-d-862686-1/reboot HTTP/1.1 Oct 26 13:02:38.970617 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:02:38.970617 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:02:38.970617 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:02:38.970617 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:02:38.970617 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:02:38.970617 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:02:38.970617 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:02:38.970617 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:02:38.970617 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWS_rq7MnvS4et4d81O3jmRwenIi5cbjrQrZDx-cyYszVacFh7rurIgioH5Dl8fDM80iXWWxn8PkSMFINPvhvIxVLOjEfLOWFWTjR4yXdUmpiIgcyWPP0w5fC0j9xcTIXTzMl9xcq8Z2FmEfG8d6v_X5YGx1oxTXCQd1aUScoi0d80a0 Oct 26 13:02:38.970617 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:02:38.970617 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:02:38.970617 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:02:38.970617 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:02:38.970617 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:02:38.970617 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:02:38.970617 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 92097efddaf64433973f5e72da0ac63a Oct 26 13:02:38.970617 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1055221838 Oct 26 13:02:38.970617 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:02:38.970617 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:02:38.971848 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/92097efddaf64433973f5e72da0ac63a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/92097efddaf64433973f5e72da0ac63a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_92097efddaf64433973f5e72da0ac63a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/92097efddaf64433973f5e72da0ac63a"}]}] Oct 26 13:02:38.971848 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1055221838 Oct 26 13:02:38.971848 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 92097efddaf64433973f5e72da0ac63a Oct 26 13:02:38.971848 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1055221838 Oct 26 13:02:38.971848 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-HostsAdminNegativeTestJSON-1055221838-project Oct 26 13:02:38.971848 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:02:38.971848 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:02:38.971848 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 71ad5b5b4c8f4c8c91cf81b97980b0ea Oct 26 13:02:38.971848 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1055221838-project Oct 26 13:02:38.971848 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:02:38.971848 n-d-862686-1 devstack@n-api.service[120598]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 26 13:02:38.971848 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'n-d-862686-1'} Oct 26 13:02:38.971848 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:02:38.972613 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:38.972613 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:38.972613 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:38.972613 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:02:38.972613 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:02:38.972613 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:02:38.972613 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:02:38.972613 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:02:38.972613 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:02:38.972613 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 26 13:02:38.972613 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 26 13:02:38.972613 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 13:02:38.972613 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 13:02:38.972613 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 13:02:38.972613 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 13:02:38.972613 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 13:02:38.972613 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 13:02:38.972613 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 13:02:38.972613 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 13:02:38.973778 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 13:02:38.973778 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 13:02:38.973778 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 13:02:38.973778 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 13:02:38.973778 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 13:02:38.973778 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 13:02:38.973778 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 26 13:02:38.973778 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:38.973778 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:38.973778 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:38.973778 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:38.973778 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:38.973778 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:38.973778 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 13:02:38.973778 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 13:02:38.973778 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 26 13:02:38.973778 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:38.974808 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4bb8577c-d022-4316-8ff2-d367450e302c tempest-HostsAdminNegativeTestJSON-1055221838 tempest-HostsAdminNegativeTestJSON-1055221838-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:02:38.975168 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4bb8577c-d022-4316-8ff2-d367450e302c tempest-HostsAdminNegativeTestJSON-1055221838 tempest-HostsAdminNegativeTestJSON-1055221838-project] 10.222.0.40 "GET /compute/v2.1/os-hosts/n-d-862686-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.014395 Oct 26 13:02:38.975749 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 7/14] 10.222.0.40 () {58 vars in 1188 bytes} [Wed Oct 26 13:02:38 2022] GET /compute/v2.1/os-hosts/n-d-862686-1/reboot => generated 111 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:02:38.983543 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-42976a72-d583-4e8d-b168-badb4407f389 tempest-FlavorsExtraSpecsNegativeTestJSON-111070355 tempest-FlavorsExtraSpecsNegativeTestJSON-111070355-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:39.032082 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-42976a72-d583-4e8d-b168-badb4407f389 tempest-FlavorsExtraSpecsNegativeTestJSON-111070355 tempest-FlavorsExtraSpecsNegativeTestJSON-111070355-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/1794496481/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.054542 Oct 26 13:02:39.032853 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 8/15] 10.222.0.40 () {60 vars in 1224 bytes} [Wed Oct 26 13:02:38 2022] POST /compute/v2.1/flavors/1794496481/os-extra_specs => generated 66 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:02:39.038530 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-da41f441-e740-4a89-a656-9b7a12590d5b tempest-AggregatesAdminTestV241-495959404 tempest-AggregatesAdminTestV241-495959404-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:39.048802 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-da41f441-e740-4a89-a656-9b7a12590d5b tempest-AggregatesAdminTestV241-495959404 tempest-AggregatesAdminTestV241-495959404-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.014539 Oct 26 13:02:39.049373 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 9/16] 10.222.0.40 () {60 vars in 1190 bytes} [Wed Oct 26 13:02:39 2022] GET /compute/v2.1/os-aggregates/1 => generated 298 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:02:39.054628 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3c636ff1-aa3b-4c37-b96a-e90b438e4643 tempest-HostsAdminNegativeTestJSON-2144614408 tempest-HostsAdminNegativeTestJSON-2144614408-project-admin] Calling method '.version_select at 0x7f6733e16550>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:39.069841 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-3c636ff1-aa3b-4c37-b96a-e90b438e4643 tempest-HostsAdminNegativeTestJSON-2144614408 tempest-HostsAdminNegativeTestJSON-2144614408-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 13:02:39.075114 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3c636ff1-aa3b-4c37-b96a-e90b438e4643 tempest-HostsAdminNegativeTestJSON-2144614408 tempest-HostsAdminNegativeTestJSON-2144614408-project-admin] Request method failure captured: Oct 26 13:02:39.075114 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 26 13:02:39.075114 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:02:39.075114 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:02:39.075114 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:02:39.075114 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:02:39.075114 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:02:39.075114 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:02:39.075114 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:02:39.075114 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:02:39.075114 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWS_tAZ0VmO2F-wgFz6_GLWUsfGRnrrflH4ysHXneNBZakeUQBj94ut6RP0Y6UFp_yB8hb6qbmQm9fRFHIAvluQVTs2zgD11zffCEEuQWB6o06WZCSERzpKkCy4di839Ej5dZG61U2o_k2XvbH3SSLVFcXBnzv4kjEvWAAJLLxZRXjgQ Oct 26 13:02:39.075114 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:02:39.075114 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:02:39.075114 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:02:39.075114 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:02:39.075114 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:02:39.075114 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:02:39.075114 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 92887387258c4611b5dca0b0fe3f8d48 Oct 26 13:02:39.075114 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2144614408 Oct 26 13:02:39.075114 n-d-862686-1 devstack@n-api.service[120598]: X-Role: admin,member,reader Oct 26 13:02:39.075114 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: admin,member,reader Oct 26 13:02:39.076453 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/92887387258c4611b5dca0b0fe3f8d48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/92887387258c4611b5dca0b0fe3f8d48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_92887387258c4611b5dca0b0fe3f8d48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/92887387258c4611b5dca0b0fe3f8d48"}]}] Oct 26 13:02:39.076453 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2144614408 Oct 26 13:02:39.076453 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 92887387258c4611b5dca0b0fe3f8d48 Oct 26 13:02:39.076453 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2144614408 Oct 26 13:02:39.076453 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-HostsAdminNegativeTestJSON-2144614408-project-admin Oct 26 13:02:39.076453 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:02:39.076453 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:02:39.076453 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 243dbb4713ae4cfea3b1884045b7b243 Oct 26 13:02:39.076453 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2144614408-project-admin Oct 26 13:02:39.076453 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:02:39.076453 n-d-862686-1 devstack@n-api.service[120598]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 13:02:39.076453 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'nonexistent_hostname'} Oct 26 13:02:39.076453 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:02:39.077255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:39.077255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 26 13:02:39.077255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 26 13:02:39.077255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 26 13:02:39.077255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 26 13:02:39.077255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 13:02:39.077255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 13:02:39.077255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 13:02:39.077255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 13:02:39.077255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 26 13:02:39.077255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 26 13:02:39.077255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 26 13:02:39.077255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 26 13:02:39.077255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 13:02:39.077255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 13:02:39.077255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 26 13:02:39.077255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 26 13:02:39.077255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 13:02:39.077255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 13:02:39.078364 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 26 13:02:39.078364 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 26 13:02:39.078364 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 13:02:39.078364 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.078364 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:39.078364 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.078364 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:39.078364 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:39.078364 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:39.078364 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:02:39.078364 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:02:39.078364 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:02:39.078364 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:02:39.078364 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:02:39.078364 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:02:39.078364 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 26 13:02:39.078364 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 26 13:02:39.078364 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 26 13:02:39.078364 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:02:39.081564 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 13:02:39.081564 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.081564 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:39.081564 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.081564 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:39.081564 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:39.081564 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:39.081564 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:02:39.081564 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:02:39.081564 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 13:02:39.081564 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.081564 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3c636ff1-aa3b-4c37-b96a-e90b438e4643 tempest-HostsAdminNegativeTestJSON-2144614408 tempest-HostsAdminNegativeTestJSON-2144614408-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:02:39.081564 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3c636ff1-aa3b-4c37-b96a-e90b438e4643 tempest-HostsAdminNegativeTestJSON-2144614408 tempest-HostsAdminNegativeTestJSON-2144614408-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.026218 Oct 26 13:02:39.081564 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 10/17] 10.222.0.40 () {58 vars in 1212 bytes} [Wed Oct 26 13:02:39 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:02:39.084053 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-381319c1-0903-410c-bc52-0ffd284d9479 tempest-FlavorsExtraSpecsNegativeTestJSON-48227156 tempest-FlavorsExtraSpecsNegativeTestJSON-48227156-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:39.085575 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-381319c1-0903-410c-bc52-0ffd284d9479 tempest-FlavorsExtraSpecsNegativeTestJSON-48227156 tempest-FlavorsExtraSpecsNegativeTestJSON-48227156-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '4cc5d3cd70314f1e8041ecf090ab3a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c71d432293741edba68c65f5c23004b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:02:39.087292 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-381319c1-0903-410c-bc52-0ffd284d9479 tempest-FlavorsExtraSpecsNegativeTestJSON-48227156 tempest-FlavorsExtraSpecsNegativeTestJSON-48227156-project] Request method failure captured: Oct 26 13:02:39.087292 n-d-862686-1 devstack@n-api.service[120598]: request: DELETE /compute/v2.1/flavors/1794496481/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 26 13:02:39.087292 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:02:39.087292 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:02:39.087292 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:02:39.087292 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:02:39.087292 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:02:39.087292 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:02:39.087292 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:02:39.087292 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:02:39.087292 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWS_qmhfz_Zu2HS4pAki-8sKXb_zsOEUcwu5FS8Bs20j4KMgQXhgn1t5kfRiuwdEohTARDDkIJqatyD3ocjV3n1snehmU39fRcOWpKqO0-AwMLGdOgVzPLoXKApuP1V_Lc2iI9pUItVV5pewT5Jqg7FWyjainrUT2pAAa0VoOqAZVm58 Oct 26 13:02:39.087292 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:02:39.087292 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:02:39.087292 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:02:39.087292 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:02:39.087292 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:02:39.087292 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:02:39.087292 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 1c71d432293741edba68c65f5c23004b Oct 26 13:02:39.087292 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-48227156 Oct 26 13:02:39.087292 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:02:39.087292 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:02:39.088542 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1c71d432293741edba68c65f5c23004b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1c71d432293741edba68c65f5c23004b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1c71d432293741edba68c65f5c23004b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1c71d432293741edba68c65f5c23004b"}]}] Oct 26 13:02:39.088542 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-48227156 Oct 26 13:02:39.088542 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 1c71d432293741edba68c65f5c23004b Oct 26 13:02:39.088542 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-48227156 Oct 26 13:02:39.088542 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-48227156-project Oct 26 13:02:39.088542 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:02:39.088542 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:02:39.088542 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 4cc5d3cd70314f1e8041ecf090ab3a20 Oct 26 13:02:39.088542 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-48227156-project Oct 26 13:02:39.088542 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:02:39.088542 n-d-862686-1 devstack@n-api.service[120598]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 26 13:02:39.089933 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'flavor_id': '1794496481', 'id': 'hw:numa_nodes'} Oct 26 13:02:39.089933 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:02:39.089933 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:39.089933 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:39.089933 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:39.089933 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:02:39.089933 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:02:39.089933 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:02:39.089933 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:02:39.089933 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 26 13:02:39.089933 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 26 13:02:39.089933 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 13:02:39.089933 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 13:02:39.089933 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 13:02:39.089933 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 13:02:39.089933 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 13:02:39.089933 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 13:02:39.089933 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 13:02:39.089933 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 13:02:39.089933 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 13:02:39.092799 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 13:02:39.092799 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 13:02:39.092799 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 13:02:39.092799 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 13:02:39.092799 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 13:02:39.092799 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 26 13:02:39.092799 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.092799 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:39.092799 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.092799 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:39.092799 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:39.092799 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:39.092799 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 13:02:39.092799 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 13:02:39.092799 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 26 13:02:39.092799 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.092799 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-381319c1-0903-410c-bc52-0ffd284d9479 tempest-FlavorsExtraSpecsNegativeTestJSON-48227156 tempest-FlavorsExtraSpecsNegativeTestJSON-48227156-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:02:39.094025 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-381319c1-0903-410c-bc52-0ffd284d9479 tempest-FlavorsExtraSpecsNegativeTestJSON-48227156 tempest-FlavorsExtraSpecsNegativeTestJSON-48227156-project] 10.222.0.40 "DELETE /compute/v2.1/flavors/1794496481/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.010267 Oct 26 13:02:39.094025 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 11/18] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Oct 26 13:02:39 2022] DELETE /compute/v2.1/flavors/1794496481/os-extra_specs/hw:numa_nodes => generated 124 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:02:39.094025 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0fb653c0-b280-481c-bfd1-a93feab00a5c tempest-AggregatesAdminTestV241-495959404 tempest-AggregatesAdminTestV241-495959404-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862686-1"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:39.104916 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0fb653c0-b280-481c-bfd1-a93feab00a5c tempest-AggregatesAdminTestV241-495959404 tempest-AggregatesAdminTestV241-495959404-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:39.105666 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0fb653c0-b280-481c-bfd1-a93feab00a5c tempest-AggregatesAdminTestV241-495959404 tempest-AggregatesAdminTestV241-495959404-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:39.106106 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0fb653c0-b280-481c-bfd1-a93feab00a5c tempest-AggregatesAdminTestV241-495959404 tempest-AggregatesAdminTestV241-495959404-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:39.226865 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-012b291a-bf4d-460c-8914-3e0242f71fa4 tempest-FlavorsAccessTestJSON-676472673 tempest-FlavorsAccessTestJSON-676472673-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:39.265177 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-012b291a-bf4d-460c-8914-3e0242f71fa4 tempest-FlavorsAccessTestJSON-676472673 tempest-FlavorsAccessTestJSON-676472673-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.355431 Oct 26 13:02:39.266604 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 8/19] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:02:38 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:02:39.271852 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f06225c9-c759-47e0-80c6-fc4f687fbee7 tempest-HostsAdminNegativeTestJSON-1055221838 tempest-HostsAdminNegativeTestJSON-1055221838-project] Calling method '.version_select at 0x7f673361cd30>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:39.274428 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f06225c9-c759-47e0-80c6-fc4f687fbee7 tempest-HostsAdminNegativeTestJSON-1055221838 tempest-HostsAdminNegativeTestJSON-1055221838-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '71ad5b5b4c8f4c8c91cf81b97980b0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92097efddaf64433973f5e72da0ac63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:02:39.276804 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f06225c9-c759-47e0-80c6-fc4f687fbee7 tempest-HostsAdminNegativeTestJSON-1055221838 tempest-HostsAdminNegativeTestJSON-1055221838-project] Request method failure captured: Oct 26 13:02:39.276804 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/os-hosts/n-d-862686-1 HTTP/1.1 Oct 26 13:02:39.276804 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:02:39.276804 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:02:39.276804 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:02:39.276804 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:02:39.276804 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:02:39.276804 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:02:39.276804 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:02:39.276804 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:02:39.276804 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWS_rq7MnvS4et4d81O3jmRwenIi5cbjrQrZDx-cyYszVacFh7rurIgioH5Dl8fDM80iXWWxn8PkSMFINPvhvIxVLOjEfLOWFWTjR4yXdUmpiIgcyWPP0w5fC0j9xcTIXTzMl9xcq8Z2FmEfG8d6v_X5YGx1oxTXCQd1aUScoi0d80a0 Oct 26 13:02:39.276804 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:02:39.276804 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:02:39.276804 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:02:39.276804 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:02:39.276804 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:02:39.276804 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:02:39.276804 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 92097efddaf64433973f5e72da0ac63a Oct 26 13:02:39.276804 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1055221838 Oct 26 13:02:39.276804 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:02:39.276804 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:02:39.278039 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/92097efddaf64433973f5e72da0ac63a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/92097efddaf64433973f5e72da0ac63a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_92097efddaf64433973f5e72da0ac63a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/92097efddaf64433973f5e72da0ac63a"}]}] Oct 26 13:02:39.278039 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1055221838 Oct 26 13:02:39.278039 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 92097efddaf64433973f5e72da0ac63a Oct 26 13:02:39.278039 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1055221838 Oct 26 13:02:39.278039 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-HostsAdminNegativeTestJSON-1055221838-project Oct 26 13:02:39.278039 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:02:39.278039 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:02:39.278039 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 71ad5b5b4c8f4c8c91cf81b97980b0ea Oct 26 13:02:39.278039 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1055221838-project Oct 26 13:02:39.278039 n-d-862686-1 devstack@n-api.service[120597]: method: Oct 26 13:02:39.278039 n-d-862686-1 devstack@n-api.service[120597]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 26 13:02:39.278039 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'n-d-862686-1'} Oct 26 13:02:39.278039 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:02:39.278757 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:39.278757 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:39.278757 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:39.278757 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:02:39.278757 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:02:39.278757 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:02:39.278757 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:02:39.278757 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:02:39.278757 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:02:39.278757 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 26 13:02:39.278757 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 26 13:02:39.278757 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 13:02:39.278757 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 13:02:39.278757 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 13:02:39.278757 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 13:02:39.278757 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 13:02:39.278757 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 13:02:39.278757 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 13:02:39.278757 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 13:02:39.279789 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 13:02:39.279789 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 13:02:39.279789 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 13:02:39.279789 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 13:02:39.279789 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 13:02:39.279789 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 13:02:39.279789 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 26 13:02:39.279789 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.279789 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:39.279789 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.279789 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:39.279789 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:39.279789 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:39.279789 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 13:02:39.279789 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 13:02:39.279789 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 26 13:02:39.279789 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.282444 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f06225c9-c759-47e0-80c6-fc4f687fbee7 tempest-HostsAdminNegativeTestJSON-1055221838 tempest-HostsAdminNegativeTestJSON-1055221838-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:02:39.283444 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f06225c9-c759-47e0-80c6-fc4f687fbee7 tempest-HostsAdminNegativeTestJSON-1055221838 tempest-HostsAdminNegativeTestJSON-1055221838-project] 10.222.0.40 "GET /compute/v2.1/os-hosts/n-d-862686-1" status: 403 len: 109 microversion: 2.1 time: 0.015661 Oct 26 13:02:39.284487 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 9/20] 10.222.0.40 () {58 vars in 1167 bytes} [Wed Oct 26 13:02:39 2022] GET /compute/v2.1/os-hosts/n-d-862686-1 => generated 109 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:02:39.290074 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f52878c6-c3eb-4622-b159-b0ed5496c56c tempest-FlavorsExtraSpecsNegativeTestJSON-111070355 tempest-FlavorsExtraSpecsNegativeTestJSON-111070355-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:39.338643 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f52878c6-c3eb-4622-b159-b0ed5496c56c tempest-FlavorsExtraSpecsNegativeTestJSON-111070355 tempest-FlavorsExtraSpecsNegativeTestJSON-111070355-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/1794496481/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.052166 Oct 26 13:02:39.340707 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 10/21] 10.222.0.40 () {60 vars in 1224 bytes} [Wed Oct 26 13:02:39 2022] POST /compute/v2.1/flavors/1794496481/os-extra_specs => generated 66 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:02:39.348374 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e9f83a64-83ad-479b-b034-33d3bba9a9c2 tempest-FlavorsAccessTestJSON-1946482852 tempest-FlavorsAccessTestJSON-1946482852-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "739cba2464f644e6b41109994c83158f"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:39.673456 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0fb653c0-b280-481c-bfd1-a93feab00a5c tempest-AggregatesAdminTestV241-495959404 tempest-AggregatesAdminTestV241-495959404-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 313 microversion: 2.41 time: 0.582589 Oct 26 13:02:39.674261 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 12/22] 10.222.0.40 () {62 vars in 1232 bytes} [Wed Oct 26 13:02:39 2022] POST /compute/v2.1/os-aggregates/1/action => generated 313 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:02:39.679520 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-90376404-2f63-4ae6-8ab7-25e4b2618d8d tempest-HostsAdminNegativeTestJSON-2144614408 tempest-HostsAdminNegativeTestJSON-2144614408-project-admin] Calling method '.version_select at 0x7f6733522310>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:39.687651 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-90376404-2f63-4ae6-8ab7-25e4b2618d8d tempest-HostsAdminNegativeTestJSON-2144614408 tempest-HostsAdminNegativeTestJSON-2144614408-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 13:02:39.689255 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-90376404-2f63-4ae6-8ab7-25e4b2618d8d tempest-HostsAdminNegativeTestJSON-2144614408 tempest-HostsAdminNegativeTestJSON-2144614408-project-admin] Request method failure captured: Oct 26 13:02:39.689255 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 26 13:02:39.689255 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:02:39.689255 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:02:39.689255 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:02:39.689255 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:02:39.689255 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:02:39.689255 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:02:39.689255 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:02:39.689255 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:02:39.689255 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWS_tAZ0VmO2F-wgFz6_GLWUsfGRnrrflH4ysHXneNBZakeUQBj94ut6RP0Y6UFp_yB8hb6qbmQm9fRFHIAvluQVTs2zgD11zffCEEuQWB6o06WZCSERzpKkCy4di839Ej5dZG61U2o_k2XvbH3SSLVFcXBnzv4kjEvWAAJLLxZRXjgQ Oct 26 13:02:39.689255 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:02:39.689255 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:02:39.689255 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:02:39.689255 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:02:39.689255 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:02:39.689255 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:02:39.689255 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 92887387258c4611b5dca0b0fe3f8d48 Oct 26 13:02:39.689255 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2144614408 Oct 26 13:02:39.689255 n-d-862686-1 devstack@n-api.service[120598]: X-Role: admin,member,reader Oct 26 13:02:39.689255 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: admin,member,reader Oct 26 13:02:39.690547 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/92887387258c4611b5dca0b0fe3f8d48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/92887387258c4611b5dca0b0fe3f8d48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_92887387258c4611b5dca0b0fe3f8d48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/92887387258c4611b5dca0b0fe3f8d48"}]}] Oct 26 13:02:39.690547 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2144614408 Oct 26 13:02:39.690547 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 92887387258c4611b5dca0b0fe3f8d48 Oct 26 13:02:39.690547 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2144614408 Oct 26 13:02:39.690547 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-HostsAdminNegativeTestJSON-2144614408-project-admin Oct 26 13:02:39.690547 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:02:39.690547 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:02:39.690547 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 243dbb4713ae4cfea3b1884045b7b243 Oct 26 13:02:39.690547 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2144614408-project-admin Oct 26 13:02:39.690547 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:02:39.690547 n-d-862686-1 devstack@n-api.service[120598]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 13:02:39.690547 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'nonexistent_hostname'} Oct 26 13:02:39.690547 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:02:39.691289 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:39.691289 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 26 13:02:39.691289 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 26 13:02:39.691289 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 13:02:39.691289 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 13:02:39.691289 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 26 13:02:39.691289 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 26 13:02:39.691289 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 13:02:39.691289 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 13:02:39.691289 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 26 13:02:39.691289 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 26 13:02:39.691289 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 13:02:39.691289 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.691289 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:39.691289 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.691289 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:39.691289 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:39.691289 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:39.691289 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:02:39.692342 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:02:39.692342 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:02:39.692342 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:02:39.692342 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:02:39.692342 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:02:39.692342 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 26 13:02:39.692342 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:02:39.692342 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 13:02:39.692342 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.692342 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:39.692342 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.692342 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:39.692342 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:39.692342 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:39.692342 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:02:39.692342 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:02:39.692342 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 13:02:39.692342 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.693341 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e9f83a64-83ad-479b-b034-33d3bba9a9c2 tempest-FlavorsAccessTestJSON-1946482852 tempest-FlavorsAccessTestJSON-1946482852-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/210646257/action" status: 200 len: 21 microversion: 2.1 time: 0.350611 Oct 26 13:02:39.693790 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 11/23] 10.222.0.40 () {60 vars in 1197 bytes} [Wed Oct 26 13:02:39 2022] POST /compute/v2.1/flavors/210646257/action => generated 21 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:02:39.694875 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-90376404-2f63-4ae6-8ab7-25e4b2618d8d tempest-HostsAdminNegativeTestJSON-2144614408 tempest-HostsAdminNegativeTestJSON-2144614408-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:02:39.696210 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-90376404-2f63-4ae6-8ab7-25e4b2618d8d tempest-HostsAdminNegativeTestJSON-2144614408 tempest-HostsAdminNegativeTestJSON-2144614408-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.020688 Oct 26 13:02:39.697156 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 13/24] 10.222.0.40 () {58 vars in 1191 bytes} [Wed Oct 26 13:02:39 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:02:39.702064 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6141310d-bcbb-4696-acff-ba612df3922f tempest-AggregatesAdminTestV241-495959404 tempest-AggregatesAdminTestV241-495959404-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862686-1"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:39.702793 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f33e891e-e5bc-4ede-bbd3-54a4161a08b0 tempest-FlavorsExtraSpecsNegativeTestJSON-48227156 tempest-FlavorsExtraSpecsNegativeTestJSON-48227156-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:39.706171 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f33e891e-e5bc-4ede-bbd3-54a4161a08b0 tempest-FlavorsExtraSpecsNegativeTestJSON-48227156 tempest-FlavorsExtraSpecsNegativeTestJSON-48227156-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '4cc5d3cd70314f1e8041ecf090ab3a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c71d432293741edba68c65f5c23004b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:02:39.707747 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f33e891e-e5bc-4ede-bbd3-54a4161a08b0 tempest-FlavorsExtraSpecsNegativeTestJSON-48227156 tempest-FlavorsExtraSpecsNegativeTestJSON-48227156-project] Request method failure captured: Oct 26 13:02:39.707747 n-d-862686-1 devstack@n-api.service[120597]: request: PUT /compute/v2.1/flavors/1794496481/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 26 13:02:39.707747 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:02:39.707747 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:02:39.707747 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:02:39.707747 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 22 Oct 26 13:02:39.707747 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:02:39.707747 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:02:39.707747 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:02:39.707747 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:02:39.707747 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWS_qmhfz_Zu2HS4pAki-8sKXb_zsOEUcwu5FS8Bs20j4KMgQXhgn1t5kfRiuwdEohTARDDkIJqatyD3ocjV3n1snehmU39fRcOWpKqO0-AwMLGdOgVzPLoXKApuP1V_Lc2iI9pUItVV5pewT5Jqg7FWyjainrUT2pAAa0VoOqAZVm58 Oct 26 13:02:39.707747 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:02:39.707747 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:02:39.707747 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:02:39.707747 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:02:39.707747 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:02:39.707747 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:02:39.707747 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 1c71d432293741edba68c65f5c23004b Oct 26 13:02:39.707747 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-48227156 Oct 26 13:02:39.707747 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:02:39.707747 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:02:39.708919 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1c71d432293741edba68c65f5c23004b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1c71d432293741edba68c65f5c23004b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1c71d432293741edba68c65f5c23004b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1c71d432293741edba68c65f5c23004b"}]}] Oct 26 13:02:39.708919 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-48227156 Oct 26 13:02:39.708919 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 1c71d432293741edba68c65f5c23004b Oct 26 13:02:39.708919 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-48227156 Oct 26 13:02:39.708919 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-48227156-project Oct 26 13:02:39.708919 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:02:39.708919 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:02:39.708919 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 4cc5d3cd70314f1e8041ecf090ab3a20 Oct 26 13:02:39.708919 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-48227156-project Oct 26 13:02:39.708919 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:02:39.708919 n-d-862686-1 devstack@n-api.service[120597]: {"hw:numa_nodes": "1"} Oct 26 13:02:39.708919 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:02:39.708919 n-d-862686-1 devstack@n-api.service[120597]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 26 13:02:39.709827 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'flavor_id': '1794496481', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 26 13:02:39.709827 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:02:39.709827 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:39.709827 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:39.709827 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:39.709827 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:02:39.709827 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:02:39.709827 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:02:39.709827 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:02:39.709827 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:02:39.709827 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:02:39.709827 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 26 13:02:39.709827 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 26 13:02:39.709827 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 13:02:39.709827 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 13:02:39.709827 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 13:02:39.709827 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 13:02:39.709827 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 13:02:39.709827 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 13:02:39.710809 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 13:02:39.710809 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 13:02:39.710809 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 13:02:39.710809 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 13:02:39.710809 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 13:02:39.710809 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 13:02:39.710809 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 13:02:39.710809 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 13:02:39.710809 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 26 13:02:39.710809 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.710809 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:39.710809 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.710809 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:39.710809 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:39.710809 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:39.710809 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 13:02:39.710809 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 13:02:39.710809 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 26 13:02:39.710809 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.711898 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f33e891e-e5bc-4ede-bbd3-54a4161a08b0 tempest-FlavorsExtraSpecsNegativeTestJSON-48227156 tempest-FlavorsExtraSpecsNegativeTestJSON-48227156-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:02:39.711898 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f33e891e-e5bc-4ede-bbd3-54a4161a08b0 tempest-FlavorsExtraSpecsNegativeTestJSON-48227156 tempest-FlavorsExtraSpecsNegativeTestJSON-48227156-project] 10.222.0.40 "PUT /compute/v2.1/flavors/1794496481/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.014565 Oct 26 13:02:39.713729 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6141310d-bcbb-4696-acff-ba612df3922f tempest-AggregatesAdminTestV241-495959404 tempest-AggregatesAdminTestV241-495959404-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:39.714223 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6141310d-bcbb-4696-acff-ba612df3922f tempest-AggregatesAdminTestV241-495959404 tempest-AggregatesAdminTestV241-495959404-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:39.714891 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6141310d-bcbb-4696-acff-ba612df3922f tempest-AggregatesAdminTestV241-495959404 tempest-AggregatesAdminTestV241-495959404-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:39.715864 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 12/25] 10.222.0.40 () {60 vars in 1265 bytes} [Wed Oct 26 13:02:39 2022] PUT /compute/v2.1/flavors/1794496481/os-extra_specs/hw:numa_nodes => generated 124 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:02:39.720521 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2d9af211-3f38-4b5e-a8d8-7763b61446fe tempest-FlavorsAccessTestJSON-676472673 tempest-FlavorsAccessTestJSON-676472673-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:39.743903 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2d9af211-3f38-4b5e-a8d8-7763b61446fe tempest-FlavorsAccessTestJSON-676472673 tempest-FlavorsAccessTestJSON-676472673-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5396 microversion: 2.1 time: 0.026902 Oct 26 13:02:39.757386 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 13/26] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:02:39 2022] GET /compute/v2.1/flavors/detail => generated 5396 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:02:39.757386 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-92fc0dd7-a439-48e0-bc6a-5249c8cbf18a tempest-HostsAdminNegativeTestJSON-1055221838 tempest-HostsAdminNegativeTestJSON-1055221838-project] Calling method '.version_select at 0x7f6733572940>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:39.757386 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-92fc0dd7-a439-48e0-bc6a-5249c8cbf18a tempest-HostsAdminNegativeTestJSON-1055221838 tempest-HostsAdminNegativeTestJSON-1055221838-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '71ad5b5b4c8f4c8c91cf81b97980b0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92097efddaf64433973f5e72da0ac63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:02:39.757386 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-92fc0dd7-a439-48e0-bc6a-5249c8cbf18a tempest-HostsAdminNegativeTestJSON-1055221838 tempest-HostsAdminNegativeTestJSON-1055221838-project] Request method failure captured: Oct 26 13:02:39.757386 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/os-hosts/n-d-862686-1/shutdown HTTP/1.1 Oct 26 13:02:39.757386 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:02:39.757386 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:02:39.757386 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:02:39.757386 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:02:39.757386 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:02:39.757386 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:02:39.757386 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:02:39.757386 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:02:39.758191 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWS_rq7MnvS4et4d81O3jmRwenIi5cbjrQrZDx-cyYszVacFh7rurIgioH5Dl8fDM80iXWWxn8PkSMFINPvhvIxVLOjEfLOWFWTjR4yXdUmpiIgcyWPP0w5fC0j9xcTIXTzMl9xcq8Z2FmEfG8d6v_X5YGx1oxTXCQd1aUScoi0d80a0 Oct 26 13:02:39.758191 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:02:39.758191 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:02:39.758191 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:02:39.758191 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:02:39.758191 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:02:39.758191 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:02:39.758191 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 92097efddaf64433973f5e72da0ac63a Oct 26 13:02:39.758191 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1055221838 Oct 26 13:02:39.758191 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:02:39.758191 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:02:39.758191 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/92097efddaf64433973f5e72da0ac63a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/92097efddaf64433973f5e72da0ac63a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_92097efddaf64433973f5e72da0ac63a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/92097efddaf64433973f5e72da0ac63a"}]}] Oct 26 13:02:39.758191 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1055221838 Oct 26 13:02:39.758191 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 92097efddaf64433973f5e72da0ac63a Oct 26 13:02:39.758191 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1055221838 Oct 26 13:02:39.758933 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-HostsAdminNegativeTestJSON-1055221838-project Oct 26 13:02:39.758933 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:02:39.758933 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:02:39.758933 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 71ad5b5b4c8f4c8c91cf81b97980b0ea Oct 26 13:02:39.758933 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1055221838-project Oct 26 13:02:39.758933 n-d-862686-1 devstack@n-api.service[120597]: method: Oct 26 13:02:39.758933 n-d-862686-1 devstack@n-api.service[120597]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 26 13:02:39.758933 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'n-d-862686-1'} Oct 26 13:02:39.758933 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:02:39.758933 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:39.758933 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:39.758933 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:39.758933 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:02:39.758933 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:02:39.758933 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:02:39.758933 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:02:39.758933 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:02:39.758933 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:02:39.758933 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 26 13:02:39.758933 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 26 13:02:39.758933 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 13:02:39.758933 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 13:02:39.758933 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 13:02:39.762171 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 13:02:39.762171 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 13:02:39.762171 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 13:02:39.762171 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 13:02:39.762171 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 13:02:39.762171 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 13:02:39.762171 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 13:02:39.762171 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 13:02:39.762171 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 13:02:39.762171 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 13:02:39.762171 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 13:02:39.762171 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 26 13:02:39.762171 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.762171 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:39.762171 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.762171 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:39.762171 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:39.762171 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:39.762171 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 13:02:39.762171 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 13:02:39.766582 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 26 13:02:39.766582 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.766582 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-92fc0dd7-a439-48e0-bc6a-5249c8cbf18a tempest-HostsAdminNegativeTestJSON-1055221838 tempest-HostsAdminNegativeTestJSON-1055221838-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:02:39.766582 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-92fc0dd7-a439-48e0-bc6a-5249c8cbf18a tempest-HostsAdminNegativeTestJSON-1055221838 tempest-HostsAdminNegativeTestJSON-1055221838-project] 10.222.0.40 "GET /compute/v2.1/os-hosts/n-d-862686-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.008693 Oct 26 13:02:39.766582 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 14/27] 10.222.0.40 () {58 vars in 1194 bytes} [Wed Oct 26 13:02:39 2022] GET /compute/v2.1/os-hosts/n-d-862686-1/shutdown => generated 113 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:02:39.774873 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-82d86a7d-4dc4-41b6-bca6-5f6cc24c9271 tempest-FlavorsExtraSpecsNegativeTestJSON-111070355 tempest-FlavorsExtraSpecsNegativeTestJSON-111070355-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:39.786796 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-82d86a7d-4dc4-41b6-bca6-5f6cc24c9271 tempest-FlavorsExtraSpecsNegativeTestJSON-111070355 tempest-FlavorsExtraSpecsNegativeTestJSON-111070355-project-admin] HTTP exception thrown: Flavor 1794496481 has no extra specs with key hw:cpu_thread_policy. Oct 26 13:02:39.788493 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-82d86a7d-4dc4-41b6-bca6-5f6cc24c9271 tempest-FlavorsExtraSpecsNegativeTestJSON-111070355 tempest-FlavorsExtraSpecsNegativeTestJSON-111070355-project-admin] Request method failure captured: Oct 26 13:02:39.788493 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/flavors/1794496481/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 26 13:02:39.788493 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:02:39.788493 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:02:39.788493 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:02:39.788493 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:02:39.788493 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:02:39.788493 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:02:39.788493 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:02:39.788493 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:02:39.788493 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWS_sC8QfyoHhuMBuhMrpTA_6hNrqVAvDU072SzjQ0jTTS9C0SoKetdyL32tFcoho1ucT_r8YenCNs_0ox3iVcbAmyyHS7YQiaDyqj-4oKqS-teothHp-SLGZ55dKZdJPqz85AydZmm6YbC3Zc-VpW3p6_wK606NV_xOg4X0ptZ21tcg Oct 26 13:02:39.788493 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:02:39.788493 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:02:39.788493 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:02:39.788493 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:02:39.788493 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:02:39.788493 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:02:39.788493 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 1368cda43da0406da2443c38d6e6df9b Oct 26 13:02:39.788493 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-111070355 Oct 26 13:02:39.788493 n-d-862686-1 devstack@n-api.service[120597]: X-Role: admin,member,reader Oct 26 13:02:39.788493 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: admin,member,reader Oct 26 13:02:39.789756 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1368cda43da0406da2443c38d6e6df9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1368cda43da0406da2443c38d6e6df9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1368cda43da0406da2443c38d6e6df9b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1368cda43da0406da2443c38d6e6df9b"}]}] Oct 26 13:02:39.789756 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-111070355 Oct 26 13:02:39.789756 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 1368cda43da0406da2443c38d6e6df9b Oct 26 13:02:39.789756 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-111070355 Oct 26 13:02:39.789756 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-111070355-project-admin Oct 26 13:02:39.789756 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:02:39.789756 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:02:39.789756 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: e448098219854b7ba0cc1ed80de55a3c Oct 26 13:02:39.789756 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-111070355-project-admin Oct 26 13:02:39.789756 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:02:39.789756 n-d-862686-1 devstack@n-api.service[120597]: exception: Flavor 1794496481 has no extra specs with key hw:cpu_thread_policy. Oct 26 13:02:39.790418 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'flavor_id': '1794496481', 'id': 'hw:cpu_thread_policy'} Oct 26 13:02:39.790418 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:02:39.790418 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:39.790418 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 26 13:02:39.790418 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 26 13:02:39.790418 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 26 13:02:39.790418 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.790418 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:39.790418 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.790418 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:39.790418 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:39.790418 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:39.790418 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:02:39.790418 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:02:39.790418 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:02:39.790418 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:02:39.790418 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 26 13:02:39.790418 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 26 13:02:39.790418 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1794496481 has no extra specs with key hw:cpu_thread_policy. Oct 26 13:02:39.790418 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.790418 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:39.790418 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.793063 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:39.793063 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:39.793063 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:39.793063 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:02:39.793063 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:02:39.793063 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1794496481 has no extra specs with key hw:cpu_thread_policy. Oct 26 13:02:39.793063 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.793063 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-82d86a7d-4dc4-41b6-bca6-5f6cc24c9271 tempest-FlavorsExtraSpecsNegativeTestJSON-111070355 tempest-FlavorsExtraSpecsNegativeTestJSON-111070355-project-admin] Returning 404 to user: Flavor 1794496481 has no extra specs with key hw:cpu_thread_policy. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:02:39.793063 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-82d86a7d-4dc4-41b6-bca6-5f6cc24c9271 tempest-FlavorsExtraSpecsNegativeTestJSON-111070355 tempest-FlavorsExtraSpecsNegativeTestJSON-111070355-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1794496481/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.025754 Oct 26 13:02:39.795630 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 15/28] 10.222.0.40 () {58 vars in 1269 bytes} [Wed Oct 26 13:02:39 2022] DELETE /compute/v2.1/flavors/1794496481/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:02:39.800715 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7478538c-c786-419f-955b-b70036f9a050 tempest-FlavorsAccessTestJSON-1946482852 tempest-FlavorsAccessTestJSON-1946482852-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:39.835482 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7478538c-c786-419f-955b-b70036f9a050 tempest-FlavorsAccessTestJSON-1946482852 tempest-FlavorsAccessTestJSON-1946482852-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/210646257" status: 202 len: 0 microversion: 2.1 time: 0.038522 Oct 26 13:02:39.836263 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 16/29] 10.222.0.40 () {58 vars in 1158 bytes} [Wed Oct 26 13:02:39 2022] DELETE /compute/v2.1/flavors/210646257 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:02:39.842582 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-048feb11-044f-47ca-9b95-f8311dd3f198 tempest-HostsAdminNegativeTestJSON-2144614408 tempest-HostsAdminNegativeTestJSON-2144614408-project-admin] Calling method '.version_select at 0x7f673361cf70>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:39.863754 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-048feb11-044f-47ca-9b95-f8311dd3f198 tempest-HostsAdminNegativeTestJSON-2144614408 tempest-HostsAdminNegativeTestJSON-2144614408-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 13:02:39.868952 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-048feb11-044f-47ca-9b95-f8311dd3f198 tempest-HostsAdminNegativeTestJSON-2144614408 tempest-HostsAdminNegativeTestJSON-2144614408-project-admin] Request method failure captured: Oct 26 13:02:39.868952 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 26 13:02:39.868952 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:02:39.868952 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:02:39.868952 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:02:39.868952 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:02:39.868952 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:02:39.868952 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:02:39.868952 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:02:39.868952 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:02:39.868952 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWS_tAZ0VmO2F-wgFz6_GLWUsfGRnrrflH4ysHXneNBZakeUQBj94ut6RP0Y6UFp_yB8hb6qbmQm9fRFHIAvluQVTs2zgD11zffCEEuQWB6o06WZCSERzpKkCy4di839Ej5dZG61U2o_k2XvbH3SSLVFcXBnzv4kjEvWAAJLLxZRXjgQ Oct 26 13:02:39.868952 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:02:39.868952 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:02:39.868952 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:02:39.868952 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:02:39.868952 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:02:39.868952 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:02:39.868952 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 92887387258c4611b5dca0b0fe3f8d48 Oct 26 13:02:39.868952 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2144614408 Oct 26 13:02:39.868952 n-d-862686-1 devstack@n-api.service[120597]: X-Role: admin,member,reader Oct 26 13:02:39.868952 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: admin,member,reader Oct 26 13:02:39.870140 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/92887387258c4611b5dca0b0fe3f8d48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/92887387258c4611b5dca0b0fe3f8d48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_92887387258c4611b5dca0b0fe3f8d48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/92887387258c4611b5dca0b0fe3f8d48"}]}] Oct 26 13:02:39.870140 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2144614408 Oct 26 13:02:39.870140 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 92887387258c4611b5dca0b0fe3f8d48 Oct 26 13:02:39.870140 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2144614408 Oct 26 13:02:39.870140 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-HostsAdminNegativeTestJSON-2144614408-project-admin Oct 26 13:02:39.870140 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:02:39.870140 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:02:39.870140 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 243dbb4713ae4cfea3b1884045b7b243 Oct 26 13:02:39.870140 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2144614408-project-admin Oct 26 13:02:39.870140 n-d-862686-1 devstack@n-api.service[120597]: method: Oct 26 13:02:39.870140 n-d-862686-1 devstack@n-api.service[120597]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 13:02:39.870140 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'nonexistent_hostname'} Oct 26 13:02:39.870140 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:02:39.870762 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:39.870762 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 26 13:02:39.870762 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 26 13:02:39.870762 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 26 13:02:39.870762 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 26 13:02:39.870762 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 13:02:39.870762 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 13:02:39.870762 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 13:02:39.870762 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 13:02:39.870762 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 26 13:02:39.870762 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 26 13:02:39.870762 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 26 13:02:39.870762 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 26 13:02:39.870762 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 13:02:39.870762 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 13:02:39.870762 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 26 13:02:39.870762 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 26 13:02:39.870762 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 13:02:39.870762 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 13:02:39.871709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 26 13:02:39.871709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 26 13:02:39.871709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 13:02:39.871709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.871709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:39.871709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.871709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:39.871709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:39.871709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:39.871709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:02:39.871709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:02:39.871709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:02:39.871709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:02:39.871709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:02:39.871709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:02:39.871709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 26 13:02:39.871709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 26 13:02:39.871709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 26 13:02:39.871709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:02:39.872690 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 13:02:39.872690 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.872690 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:39.872690 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.872690 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:39.872690 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:39.872690 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:39.872690 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:02:39.872690 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:02:39.872690 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 13:02:39.872690 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.872690 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-048feb11-044f-47ca-9b95-f8311dd3f198 tempest-HostsAdminNegativeTestJSON-2144614408 tempest-HostsAdminNegativeTestJSON-2144614408-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:02:39.872690 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-048feb11-044f-47ca-9b95-f8311dd3f198 tempest-HostsAdminNegativeTestJSON-2144614408 tempest-HostsAdminNegativeTestJSON-2144614408-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.033107 Oct 26 13:02:39.877526 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 17/30] 10.222.0.40 () {58 vars in 1218 bytes} [Wed Oct 26 13:02:39 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:02:39.882651 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1246a1d5-d398-4c73-8663-12521c7628d1 tempest-FlavorsExtraSpecsNegativeTestJSON-111070355 tempest-FlavorsExtraSpecsNegativeTestJSON-111070355-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:39.889834 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-1246a1d5-d398-4c73-8663-12521c7628d1 tempest-FlavorsExtraSpecsNegativeTestJSON-111070355 tempest-FlavorsExtraSpecsNegativeTestJSON-111070355-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 26 13:02:39.891995 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1246a1d5-d398-4c73-8663-12521c7628d1 tempest-FlavorsExtraSpecsNegativeTestJSON-111070355 tempest-FlavorsExtraSpecsNegativeTestJSON-111070355-project-admin] Request method failure captured: Oct 26 13:02:39.891995 n-d-862686-1 devstack@n-api.service[120597]: request: PUT /compute/v2.1/flavors/1794496481/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 26 13:02:39.891995 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:02:39.891995 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:02:39.891995 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:02:39.891995 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 27 Oct 26 13:02:39.891995 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:02:39.891995 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:02:39.891995 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:02:39.891995 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:02:39.891995 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWS_sC8QfyoHhuMBuhMrpTA_6hNrqVAvDU072SzjQ0jTTS9C0SoKetdyL32tFcoho1ucT_r8YenCNs_0ox3iVcbAmyyHS7YQiaDyqj-4oKqS-teothHp-SLGZ55dKZdJPqz85AydZmm6YbC3Zc-VpW3p6_wK606NV_xOg4X0ptZ21tcg Oct 26 13:02:39.891995 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:02:39.891995 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:02:39.891995 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:02:39.891995 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:02:39.891995 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:02:39.891995 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:02:39.891995 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 1368cda43da0406da2443c38d6e6df9b Oct 26 13:02:39.891995 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-111070355 Oct 26 13:02:39.891995 n-d-862686-1 devstack@n-api.service[120597]: X-Role: admin,member,reader Oct 26 13:02:39.891995 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: admin,member,reader Oct 26 13:02:39.893301 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1368cda43da0406da2443c38d6e6df9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1368cda43da0406da2443c38d6e6df9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1368cda43da0406da2443c38d6e6df9b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1368cda43da0406da2443c38d6e6df9b"}]}] Oct 26 13:02:39.893301 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-111070355 Oct 26 13:02:39.893301 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 1368cda43da0406da2443c38d6e6df9b Oct 26 13:02:39.893301 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-111070355 Oct 26 13:02:39.893301 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-111070355-project-admin Oct 26 13:02:39.893301 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:02:39.893301 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:02:39.893301 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: e448098219854b7ba0cc1ed80de55a3c Oct 26 13:02:39.893301 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-111070355-project-admin Oct 26 13:02:39.893301 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:02:39.893301 n-d-862686-1 devstack@n-api.service[120597]: {"hw:cpu_policy": "shared"} Oct 26 13:02:39.893301 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:02:39.893301 n-d-862686-1 devstack@n-api.service[120597]: exception: Request body and URI mismatch Oct 26 13:02:39.894005 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'flavor_id': '1794496481', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 26 13:02:39.894005 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:02:39.894005 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:39.894005 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:39.894005 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:39.894005 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:02:39.894005 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:02:39.894005 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:02:39.894005 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:02:39.894005 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:02:39.894005 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:02:39.894005 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 26 13:02:39.894005 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 26 13:02:39.894005 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 26 13:02:39.894005 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.894005 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:39.894005 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.894005 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:39.894005 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:39.894005 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:39.895086 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:02:39.895086 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:02:39.895086 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 26 13:02:39.895086 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.896393 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1246a1d5-d398-4c73-8663-12521c7628d1 tempest-FlavorsExtraSpecsNegativeTestJSON-111070355 tempest-FlavorsExtraSpecsNegativeTestJSON-111070355-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:02:39.896507 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6141310d-bcbb-4696-acff-ba612df3922f tempest-AggregatesAdminTestV241-495959404 tempest-AggregatesAdminTestV241-495959404-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 298 microversion: 2.41 time: 0.197171 Oct 26 13:02:39.904625 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 14/31] 10.222.0.40 () {62 vars in 1232 bytes} [Wed Oct 26 13:02:39 2022] POST /compute/v2.1/os-aggregates/1/action => generated 298 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:02:39.905121 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d6456941-db12-406f-a5b5-5a95f00ba3e8 tempest-FlavorsAccessTestJSON-1946482852 tempest-FlavorsAccessTestJSON-1946482852-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:39.906172 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1246a1d5-d398-4c73-8663-12521c7628d1 tempest-FlavorsExtraSpecsNegativeTestJSON-111070355 tempest-FlavorsExtraSpecsNegativeTestJSON-111070355-project-admin] 10.222.0.40 "PUT /compute/v2.1/flavors/1794496481/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.018877 Oct 26 13:02:39.907784 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 18/32] 10.222.0.40 () {60 vars in 1265 bytes} [Wed Oct 26 13:02:39 2022] PUT /compute/v2.1/flavors/1794496481/os-extra_specs/hw:numa_nodes => generated 73 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 26 13:02:39.913000 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-91e71c3c-5d8b-415a-ae06-4591f3077b32 tempest-HostsAdminNegativeTestJSON-1055221838 tempest-HostsAdminNegativeTestJSON-1055221838-project] Calling method '.version_select at 0x7f67334ccd30>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:39.915549 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-91e71c3c-5d8b-415a-ae06-4591f3077b32 tempest-HostsAdminNegativeTestJSON-1055221838 tempest-HostsAdminNegativeTestJSON-1055221838-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '71ad5b5b4c8f4c8c91cf81b97980b0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92097efddaf64433973f5e72da0ac63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:02:39.917327 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-91e71c3c-5d8b-415a-ae06-4591f3077b32 tempest-HostsAdminNegativeTestJSON-1055221838 tempest-HostsAdminNegativeTestJSON-1055221838-project] Request method failure captured: Oct 26 13:02:39.917327 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/os-hosts/n-d-862686-1/startup HTTP/1.1 Oct 26 13:02:39.917327 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:02:39.917327 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:02:39.917327 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:02:39.917327 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:02:39.917327 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:02:39.917327 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:02:39.917327 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:02:39.917327 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:02:39.917327 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWS_rq7MnvS4et4d81O3jmRwenIi5cbjrQrZDx-cyYszVacFh7rurIgioH5Dl8fDM80iXWWxn8PkSMFINPvhvIxVLOjEfLOWFWTjR4yXdUmpiIgcyWPP0w5fC0j9xcTIXTzMl9xcq8Z2FmEfG8d6v_X5YGx1oxTXCQd1aUScoi0d80a0 Oct 26 13:02:39.917327 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:02:39.917327 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:02:39.917327 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:02:39.917327 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:02:39.917327 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:02:39.917327 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:02:39.917327 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 92097efddaf64433973f5e72da0ac63a Oct 26 13:02:39.917327 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1055221838 Oct 26 13:02:39.917327 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:02:39.917327 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:02:39.918750 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/92097efddaf64433973f5e72da0ac63a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/92097efddaf64433973f5e72da0ac63a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_92097efddaf64433973f5e72da0ac63a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/92097efddaf64433973f5e72da0ac63a"}]}] Oct 26 13:02:39.918750 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1055221838 Oct 26 13:02:39.918750 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 92097efddaf64433973f5e72da0ac63a Oct 26 13:02:39.918750 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1055221838 Oct 26 13:02:39.918750 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-HostsAdminNegativeTestJSON-1055221838-project Oct 26 13:02:39.918750 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:02:39.918750 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:02:39.918750 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 71ad5b5b4c8f4c8c91cf81b97980b0ea Oct 26 13:02:39.918750 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1055221838-project Oct 26 13:02:39.918750 n-d-862686-1 devstack@n-api.service[120597]: method: Oct 26 13:02:39.918750 n-d-862686-1 devstack@n-api.service[120597]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 26 13:02:39.918750 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'n-d-862686-1'} Oct 26 13:02:39.918750 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:02:39.919522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:39.919522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:39.919522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:39.919522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:02:39.919522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:02:39.919522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:02:39.919522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:02:39.919522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:02:39.919522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:02:39.919522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 26 13:02:39.919522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 26 13:02:39.919522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 13:02:39.919522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 13:02:39.919522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 13:02:39.919522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 13:02:39.919522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 13:02:39.919522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 13:02:39.919522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 13:02:39.919522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 13:02:39.921363 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 13:02:39.921363 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 13:02:39.921363 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 13:02:39.921363 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 13:02:39.921363 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 13:02:39.921363 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 13:02:39.921363 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 26 13:02:39.921363 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.921363 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:39.921363 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.921363 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:39.921363 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:39.921363 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:39.921363 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 13:02:39.921363 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 13:02:39.921363 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 26 13:02:39.921363 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.922246 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-91e71c3c-5d8b-415a-ae06-4591f3077b32 tempest-HostsAdminNegativeTestJSON-1055221838 tempest-HostsAdminNegativeTestJSON-1055221838-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:02:39.922246 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-91e71c3c-5d8b-415a-ae06-4591f3077b32 tempest-HostsAdminNegativeTestJSON-1055221838 tempest-HostsAdminNegativeTestJSON-1055221838-project] 10.222.0.40 "GET /compute/v2.1/os-hosts/n-d-862686-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.009858 Oct 26 13:02:39.924065 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 19/33] 10.222.0.40 () {58 vars in 1191 bytes} [Wed Oct 26 13:02:39 2022] GET /compute/v2.1/os-hosts/n-d-862686-1/startup => generated 110 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:02:39.928574 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-870f3e36-c30d-4841-8b26-c60cd2185dfa tempest-AggregatesAdminTestV241-495959404 tempest-AggregatesAdminTestV241-495959404-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:39.952061 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d6456941-db12-406f-a5b5-5a95f00ba3e8 tempest-FlavorsAccessTestJSON-1946482852 tempest-FlavorsAccessTestJSON-1946482852-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5396 microversion: 2.1 time: 0.052733 Oct 26 13:02:39.952753 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 15/34] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:02:39 2022] GET /compute/v2.1/flavors/detail => generated 5396 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:02:39.965041 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-17d1f619-0734-4cb8-a55a-f9a1475a77dd tempest-FlavorsExtraSpecsNegativeTestJSON-111070355 tempest-FlavorsExtraSpecsNegativeTestJSON-111070355-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:39.965230 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-870f3e36-c30d-4841-8b26-c60cd2185dfa tempest-AggregatesAdminTestV241-495959404 tempest-AggregatesAdminTestV241-495959404-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.036967 Oct 26 13:02:39.965230 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 20/35] 10.222.0.40 () {60 vars in 1193 bytes} [Wed Oct 26 13:02:39 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:02:39.969153 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-17d1f619-0734-4cb8-a55a-f9a1475a77dd tempest-FlavorsExtraSpecsNegativeTestJSON-111070355 tempest-FlavorsExtraSpecsNegativeTestJSON-111070355-project-admin] Request method failure captured: Oct 26 13:02:39.969153 n-d-862686-1 devstack@n-api.service[120598]: request: PUT /compute/v2.1/flavors/1794496481/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 26 13:02:39.969153 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:02:39.969153 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:02:39.969153 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:02:39.969153 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 49 Oct 26 13:02:39.969153 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:02:39.969153 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:02:39.969153 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:02:39.969153 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:02:39.969153 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWS_sC8QfyoHhuMBuhMrpTA_6hNrqVAvDU072SzjQ0jTTS9C0SoKetdyL32tFcoho1ucT_r8YenCNs_0ox3iVcbAmyyHS7YQiaDyqj-4oKqS-teothHp-SLGZ55dKZdJPqz85AydZmm6YbC3Zc-VpW3p6_wK606NV_xOg4X0ptZ21tcg Oct 26 13:02:39.969153 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:02:39.969153 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:02:39.969153 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:02:39.969153 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:02:39.969153 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:02:39.969153 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:02:39.969153 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 1368cda43da0406da2443c38d6e6df9b Oct 26 13:02:39.969153 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-111070355 Oct 26 13:02:39.969153 n-d-862686-1 devstack@n-api.service[120598]: X-Role: admin,member,reader Oct 26 13:02:39.969153 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: admin,member,reader Oct 26 13:02:39.970502 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1368cda43da0406da2443c38d6e6df9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1368cda43da0406da2443c38d6e6df9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1368cda43da0406da2443c38d6e6df9b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1368cda43da0406da2443c38d6e6df9b"}]}] Oct 26 13:02:39.970502 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-111070355 Oct 26 13:02:39.970502 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 1368cda43da0406da2443c38d6e6df9b Oct 26 13:02:39.970502 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-111070355 Oct 26 13:02:39.970502 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-111070355-project-admin Oct 26 13:02:39.970502 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:02:39.970502 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:02:39.970502 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: e448098219854b7ba0cc1ed80de55a3c Oct 26 13:02:39.970502 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-111070355-project-admin Oct 26 13:02:39.970502 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:02:39.970502 n-d-862686-1 devstack@n-api.service[120598]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 26 13:02:39.970502 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:02:39.971297 n-d-862686-1 devstack@n-api.service[120598]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 26 13:02:39.971297 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'flavor_id': '1794496481', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 26 13:02:39.971297 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:02:39.971297 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:39.971297 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 13:02:39.971297 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 13:02:39.971297 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 13:02:39.971297 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise error Oct 26 13:02:39.971297 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 26 13:02:39.971297 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.971297 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 26 13:02:39.971297 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 26 13:02:39.971297 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 26 13:02:39.971297 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 26 13:02:39.971297 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 26 13:02:39.971297 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 26 13:02:39.971297 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 26 13:02:39.971297 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 26 13:02:39.971297 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.971297 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi On instance: Oct 26 13:02:39.971297 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 26 13:02:39.971297 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.972526 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:39.972526 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.972526 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:39.972526 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:39.972526 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:39.972526 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:02:39.972526 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:02:39.972526 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:02:39.972526 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:02:39.972526 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 13:02:39.972526 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 13:02:39.972526 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 13:02:39.972526 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 13:02:39.972526 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 13:02:39.972526 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 13:02:39.972526 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 26 13:02:39.972526 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.972526 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:39.972526 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.972526 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:39.975357 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:39.975357 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:39.975357 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 13:02:39.975357 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 13:02:39.975357 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 26 13:02:39.975357 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.975357 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-17d1f619-0734-4cb8-a55a-f9a1475a77dd tempest-FlavorsExtraSpecsNegativeTestJSON-111070355 tempest-FlavorsExtraSpecsNegativeTestJSON-111070355-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:02:39.975357 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-17d1f619-0734-4cb8-a55a-f9a1475a77dd tempest-FlavorsExtraSpecsNegativeTestJSON-111070355 tempest-FlavorsExtraSpecsNegativeTestJSON-111070355-project-admin] 10.222.0.40 "PUT /compute/v2.1/flavors/1794496481/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.016846 Oct 26 13:02:39.975357 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 16/36] 10.222.0.40 () {60 vars in 1265 bytes} [Wed Oct 26 13:02:39 2022] PUT /compute/v2.1/flavors/1794496481/os-extra_specs/hw:numa_nodes => generated 117 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:02:39.981540 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-14933687-07cd-4cfb-9e85-b5d0a8b38518 tempest-HostsAdminNegativeTestJSON-2144614408 tempest-HostsAdminNegativeTestJSON-2144614408-project-admin] Calling method '.version_select at 0x7f67334cc670>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:39.991403 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-14933687-07cd-4cfb-9e85-b5d0a8b38518 tempest-HostsAdminNegativeTestJSON-2144614408 tempest-HostsAdminNegativeTestJSON-2144614408-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 13:02:39.993154 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-14933687-07cd-4cfb-9e85-b5d0a8b38518 tempest-HostsAdminNegativeTestJSON-2144614408 tempest-HostsAdminNegativeTestJSON-2144614408-project-admin] Request method failure captured: Oct 26 13:02:39.993154 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 26 13:02:39.993154 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:02:39.993154 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:02:39.993154 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:02:39.993154 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:02:39.993154 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:02:39.993154 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:02:39.993154 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:02:39.993154 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:02:39.993154 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWS_tAZ0VmO2F-wgFz6_GLWUsfGRnrrflH4ysHXneNBZakeUQBj94ut6RP0Y6UFp_yB8hb6qbmQm9fRFHIAvluQVTs2zgD11zffCEEuQWB6o06WZCSERzpKkCy4di839Ej5dZG61U2o_k2XvbH3SSLVFcXBnzv4kjEvWAAJLLxZRXjgQ Oct 26 13:02:39.993154 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:02:39.993154 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:02:39.993154 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:02:39.993154 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:02:39.993154 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:02:39.993154 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:02:39.993154 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 92887387258c4611b5dca0b0fe3f8d48 Oct 26 13:02:39.993154 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2144614408 Oct 26 13:02:39.993154 n-d-862686-1 devstack@n-api.service[120597]: X-Role: admin,member,reader Oct 26 13:02:39.993154 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: admin,member,reader Oct 26 13:02:39.994245 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/92887387258c4611b5dca0b0fe3f8d48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/92887387258c4611b5dca0b0fe3f8d48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_92887387258c4611b5dca0b0fe3f8d48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/92887387258c4611b5dca0b0fe3f8d48"}]}] Oct 26 13:02:39.994245 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2144614408 Oct 26 13:02:39.994245 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 92887387258c4611b5dca0b0fe3f8d48 Oct 26 13:02:39.994245 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2144614408 Oct 26 13:02:39.994245 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-HostsAdminNegativeTestJSON-2144614408-project-admin Oct 26 13:02:39.994245 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:02:39.994245 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:02:39.994245 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 243dbb4713ae4cfea3b1884045b7b243 Oct 26 13:02:39.994245 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2144614408-project-admin Oct 26 13:02:39.994245 n-d-862686-1 devstack@n-api.service[120597]: method: Oct 26 13:02:39.994245 n-d-862686-1 devstack@n-api.service[120597]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 13:02:39.994245 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'nonexistent_hostname'} Oct 26 13:02:39.994245 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:02:39.994969 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:39.994969 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 26 13:02:39.994969 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 26 13:02:39.994969 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 26 13:02:39.994969 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 26 13:02:39.994969 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 13:02:39.994969 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 13:02:39.994969 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 13:02:39.994969 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 13:02:39.994969 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 26 13:02:39.994969 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 26 13:02:39.994969 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 26 13:02:39.994969 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 26 13:02:39.994969 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 13:02:39.994969 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 13:02:39.994969 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 26 13:02:39.994969 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 26 13:02:39.994969 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 13:02:39.994969 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 13:02:39.995861 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 26 13:02:39.995861 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 26 13:02:39.995861 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 13:02:39.995861 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.995861 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:39.995861 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.995861 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:39.995861 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:39.995861 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:39.995861 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:02:39.995861 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:02:39.995861 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:02:39.995861 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:02:39.995861 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:02:39.995861 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:02:39.995861 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 26 13:02:39.995861 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 26 13:02:39.995861 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 26 13:02:39.995861 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:02:39.996807 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 13:02:39.996807 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.996807 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:39.996807 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.996807 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:39.996807 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:39.996807 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:39.996807 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:02:39.996807 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:02:39.996807 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 13:02:39.996807 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:39.996807 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-14933687-07cd-4cfb-9e85-b5d0a8b38518 tempest-HostsAdminNegativeTestJSON-2144614408 tempest-HostsAdminNegativeTestJSON-2144614408-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:02:39.996807 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-14933687-07cd-4cfb-9e85-b5d0a8b38518 tempest-HostsAdminNegativeTestJSON-2144614408 tempest-HostsAdminNegativeTestJSON-2144614408-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.027064 Oct 26 13:02:40.001411 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 21/37] 10.222.0.40 () {58 vars in 1215 bytes} [Wed Oct 26 13:02:39 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:02:40.006626 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a7628482-4e38-4b29-a01a-2961f26f973b tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-705689439"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:40.010514 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.aggregate [None req-a7628482-4e38-4b29-a01a-2961f26f973b tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Generated uuid 9673fcb7-8b2c-43d1-a260-5afc351e1a95 for aggregate {{(pid=120597) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 26 13:02:40.031716 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a7628482-4e38-4b29-a01a-2961f26f973b tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.029198 Oct 26 13:02:40.032974 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 22/38] 10.222.0.40 () {60 vars in 1164 bytes} [Wed Oct 26 13:02:40 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:02:40.037749 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6e755030-1002-4810-b1ef-a1de7c35b746 tempest-FlavorsExtraSpecsNegativeTestJSON-111070355 tempest-FlavorsExtraSpecsNegativeTestJSON-111070355-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:40.060230 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6e755030-1002-4810-b1ef-a1de7c35b746 tempest-FlavorsExtraSpecsNegativeTestJSON-111070355 tempest-FlavorsExtraSpecsNegativeTestJSON-111070355-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1794496481" status: 202 len: 0 microversion: 2.1 time: 0.025681 Oct 26 13:02:40.064298 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 23/39] 10.222.0.40 () {58 vars in 1161 bytes} [Wed Oct 26 13:02:40 2022] DELETE /compute/v2.1/flavors/1794496481 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:02:40.065816 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-82c10c2d-055e-4299-a52e-86d7f35271be tempest-FlavorsAccessTestJSON-1946482852 tempest-FlavorsAccessTestJSON-1946482852-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-310394725", "id": 1939963939, "os-flavor-access:is_public": "False"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:40.087438 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-82c10c2d-055e-4299-a52e-86d7f35271be tempest-FlavorsAccessTestJSON-1946482852 tempest-FlavorsAccessTestJSON-1946482852-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.025477 Oct 26 13:02:40.088382 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 24/40] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:02:40 2022] POST /compute/v2.1/flavors => generated 430 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:02:40.094227 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-233f865a-7a51-4f42-a259-5c5655fe4e5f tempest-HostsAdminNegativeTestJSON-2144614408 tempest-HostsAdminNegativeTestJSON-2144614408-project-admin] Action: 'update', calling method: .version_select at 0x7f67334e5700>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:40.099433 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-233f865a-7a51-4f42-a259-5c5655fe4e5f tempest-HostsAdminNegativeTestJSON-2144614408 tempest-HostsAdminNegativeTestJSON-2144614408-project-admin] Request method failure captured: Oct 26 13:02:40.099433 n-d-862686-1 devstack@n-api.service[120597]: request: PUT /compute/v2.1/os-hosts/n-d-862686-1 HTTP/1.1 Oct 26 13:02:40.099433 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:02:40.099433 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:02:40.099433 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:02:40.099433 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 51 Oct 26 13:02:40.099433 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:02:40.099433 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:02:40.099433 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:02:40.099433 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:02:40.099433 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWS_tAZ0VmO2F-wgFz6_GLWUsfGRnrrflH4ysHXneNBZakeUQBj94ut6RP0Y6UFp_yB8hb6qbmQm9fRFHIAvluQVTs2zgD11zffCEEuQWB6o06WZCSERzpKkCy4di839Ej5dZG61U2o_k2XvbH3SSLVFcXBnzv4kjEvWAAJLLxZRXjgQ Oct 26 13:02:40.099433 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:02:40.099433 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:02:40.099433 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:02:40.099433 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:02:40.099433 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:02:40.099433 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:02:40.099433 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 92887387258c4611b5dca0b0fe3f8d48 Oct 26 13:02:40.099433 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2144614408 Oct 26 13:02:40.099433 n-d-862686-1 devstack@n-api.service[120597]: X-Role: admin,member,reader Oct 26 13:02:40.099433 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: admin,member,reader Oct 26 13:02:40.100488 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/92887387258c4611b5dca0b0fe3f8d48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/92887387258c4611b5dca0b0fe3f8d48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_92887387258c4611b5dca0b0fe3f8d48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/92887387258c4611b5dca0b0fe3f8d48"}]}] Oct 26 13:02:40.100488 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2144614408 Oct 26 13:02:40.100488 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 92887387258c4611b5dca0b0fe3f8d48 Oct 26 13:02:40.100488 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2144614408 Oct 26 13:02:40.100488 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-HostsAdminNegativeTestJSON-2144614408-project-admin Oct 26 13:02:40.100488 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:02:40.100488 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:02:40.100488 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 243dbb4713ae4cfea3b1884045b7b243 Oct 26 13:02:40.100488 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2144614408-project-admin Oct 26 13:02:40.100488 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:02:40.100488 n-d-862686-1 devstack@n-api.service[120597]: {"status": "enable", "maintenance_mode": "invalid"} Oct 26 13:02:40.100488 n-d-862686-1 devstack@n-api.service[120597]: method: Oct 26 13:02:40.100488 n-d-862686-1 devstack@n-api.service[120597]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 26 13:02:40.101157 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'n-d-862686-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 26 13:02:40.101157 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:02:40.101157 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:40.101157 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 13:02:40.101157 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 13:02:40.101157 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 13:02:40.101157 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise error Oct 26 13:02:40.101157 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 26 13:02:40.101157 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:40.101157 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 26 13:02:40.101157 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 26 13:02:40.101157 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi 'disable', Oct 26 13:02:40.101157 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi 'Enable', Oct 26 13:02:40.101157 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi 'Disable', Oct 26 13:02:40.101157 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 26 13:02:40.101157 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 26 13:02:40.101157 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 26 13:02:40.101157 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:40.101157 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi On instance: Oct 26 13:02:40.101157 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi 'invalid' Oct 26 13:02:40.101157 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:40.101157 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:40.101157 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:40.101157 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:40.101157 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:40.102414 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:40.102414 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:02:40.102414 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:02:40.102414 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:02:40.102414 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:02:40.102414 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:02:40.102414 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:02:40.102414 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 13:02:40.102414 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 13:02:40.102414 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 13:02:40.102414 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 13:02:40.102414 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 13:02:40.102414 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 13:02:40.102414 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 26 13:02:40.102414 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:40.102414 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:40.102414 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:40.102414 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:40.102414 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:40.103378 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:40.103378 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 13:02:40.103378 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 13:02:40.103378 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 26 13:02:40.103378 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:40.103378 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-233f865a-7a51-4f42-a259-5c5655fe4e5f tempest-HostsAdminNegativeTestJSON-2144614408 tempest-HostsAdminNegativeTestJSON-2144614408-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:02:40.103378 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-233f865a-7a51-4f42-a259-5c5655fe4e5f tempest-HostsAdminNegativeTestJSON-2144614408 tempest-HostsAdminNegativeTestJSON-2144614408-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-hosts/n-d-862686-1" status: 400 len: 199 microversion: 2.1 time: 0.013459 Oct 26 13:02:40.109830 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 25/41] 10.222.0.40 () {60 vars in 1187 bytes} [Wed Oct 26 13:02:40 2022] PUT /compute/v2.1/os-hosts/n-d-862686-1 => generated 199 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:02:40.113796 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2461b1ae-7fd6-4fee-9fbe-77260f3d0143 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862686-1"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:40.127738 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2461b1ae-7fd6-4fee-9fbe-77260f3d0143 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:40.128229 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2461b1ae-7fd6-4fee-9fbe-77260f3d0143 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:40.128668 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2461b1ae-7fd6-4fee-9fbe-77260f3d0143 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:40.142871 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9534f629-bd21-46c8-9c3c-3632ebb5d005 tempest-AZAdminV2TestJSON-1204544273 tempest-AZAdminV2TestJSON-1204544273-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:40.144580 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9534f629-bd21-46c8-9c3c-3632ebb5d005 tempest-AZAdminV2TestJSON-1204544273 tempest-AZAdminV2TestJSON-1204544273-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:40.145069 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9534f629-bd21-46c8-9c3c-3632ebb5d005 tempest-AZAdminV2TestJSON-1204544273 tempest-AZAdminV2TestJSON-1204544273-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:40.145518 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9534f629-bd21-46c8-9c3c-3632ebb5d005 tempest-AZAdminV2TestJSON-1204544273 tempest-AZAdminV2TestJSON-1204544273-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:40.146397 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9534f629-bd21-46c8-9c3c-3632ebb5d005 tempest-AZAdminV2TestJSON-1204544273 tempest-AZAdminV2TestJSON-1204544273-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:40.146858 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9534f629-bd21-46c8-9c3c-3632ebb5d005 tempest-AZAdminV2TestJSON-1204544273 tempest-AZAdminV2TestJSON-1204544273-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:40.147274 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9534f629-bd21-46c8-9c3c-3632ebb5d005 tempest-AZAdminV2TestJSON-1204544273 tempest-AZAdminV2TestJSON-1204544273-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:40.176425 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9534f629-bd21-46c8-9c3c-3632ebb5d005 tempest-AZAdminV2TestJSON-1204544273 tempest-AZAdminV2TestJSON-1204544273-project-admin] 10.222.0.40 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.203769 Oct 26 13:02:40.177138 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 17/42] 10.222.0.40 () {58 vars in 1164 bytes} [Wed Oct 26 13:02:39 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:02:40.186530 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4229f5ef-ed68-45aa-82d3-aeb60db7ef05 tempest-FlavorsExtraSpecsNegativeTestJSON-111070355 tempest-FlavorsExtraSpecsNegativeTestJSON-111070355-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:40.210324 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4229f5ef-ed68-45aa-82d3-aeb60db7ef05 tempest-FlavorsExtraSpecsNegativeTestJSON-111070355 tempest-FlavorsExtraSpecsNegativeTestJSON-111070355-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031889 Oct 26 13:02:40.211017 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 18/43] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:02:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:02:40.218008 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7d01bc4f-1a07-4821-bfcb-235e5b08affc tempest-FlavorsAccessTestJSON-1946482852 tempest-FlavorsAccessTestJSON-1946482852-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:40.231389 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7d01bc4f-1a07-4821-bfcb-235e5b08affc tempest-FlavorsAccessTestJSON-1946482852 tempest-FlavorsAccessTestJSON-1946482852-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/1939963939/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.019260 Oct 26 13:02:40.232332 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 19/44] 10.222.0.40 () {58 vars in 1209 bytes} [Wed Oct 26 13:02:40 2022] GET /compute/v2.1/flavors/1939963939/os-flavor-access => generated 21 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:02:40.236900 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7596aa82-266a-40cd-b619-f2d7ab6809d3 tempest-HostsAdminNegativeTestJSON-2144614408 tempest-HostsAdminNegativeTestJSON-2144614408-project-admin] Action: 'update', calling method: .version_select at 0x7f67334e0d30>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:40.240976 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7596aa82-266a-40cd-b619-f2d7ab6809d3 tempest-HostsAdminNegativeTestJSON-2144614408 tempest-HostsAdminNegativeTestJSON-2144614408-project-admin] Request method failure captured: Oct 26 13:02:40.240976 n-d-862686-1 devstack@n-api.service[120598]: request: PUT /compute/v2.1/os-hosts/n-d-862686-1 HTTP/1.1 Oct 26 13:02:40.240976 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:02:40.240976 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:02:40.240976 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:02:40.240976 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 51 Oct 26 13:02:40.240976 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:02:40.240976 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:02:40.240976 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:02:40.240976 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:02:40.240976 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWS_tAZ0VmO2F-wgFz6_GLWUsfGRnrrflH4ysHXneNBZakeUQBj94ut6RP0Y6UFp_yB8hb6qbmQm9fRFHIAvluQVTs2zgD11zffCEEuQWB6o06WZCSERzpKkCy4di839Ej5dZG61U2o_k2XvbH3SSLVFcXBnzv4kjEvWAAJLLxZRXjgQ Oct 26 13:02:40.240976 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:02:40.240976 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:02:40.240976 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:02:40.240976 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:02:40.240976 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:02:40.240976 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:02:40.240976 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 92887387258c4611b5dca0b0fe3f8d48 Oct 26 13:02:40.240976 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2144614408 Oct 26 13:02:40.240976 n-d-862686-1 devstack@n-api.service[120598]: X-Role: admin,member,reader Oct 26 13:02:40.240976 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: admin,member,reader Oct 26 13:02:40.242303 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/92887387258c4611b5dca0b0fe3f8d48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/92887387258c4611b5dca0b0fe3f8d48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_92887387258c4611b5dca0b0fe3f8d48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/92887387258c4611b5dca0b0fe3f8d48"}]}] Oct 26 13:02:40.242303 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2144614408 Oct 26 13:02:40.242303 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 92887387258c4611b5dca0b0fe3f8d48 Oct 26 13:02:40.242303 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2144614408 Oct 26 13:02:40.242303 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-HostsAdminNegativeTestJSON-2144614408-project-admin Oct 26 13:02:40.242303 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:02:40.242303 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:02:40.242303 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 243dbb4713ae4cfea3b1884045b7b243 Oct 26 13:02:40.242303 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2144614408-project-admin Oct 26 13:02:40.242303 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:02:40.242303 n-d-862686-1 devstack@n-api.service[120598]: {"status": "invalid", "maintenance_mode": "enable"} Oct 26 13:02:40.242303 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:02:40.242303 n-d-862686-1 devstack@n-api.service[120598]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 26 13:02:40.243088 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'n-d-862686-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 26 13:02:40.243088 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:02:40.243088 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:40.243088 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 13:02:40.243088 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 13:02:40.243088 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 13:02:40.243088 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise error Oct 26 13:02:40.243088 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 26 13:02:40.243088 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:40.243088 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 26 13:02:40.243088 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 26 13:02:40.243088 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi 'disable', Oct 26 13:02:40.243088 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi 'Enable', Oct 26 13:02:40.243088 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi 'Disable', Oct 26 13:02:40.243088 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 26 13:02:40.243088 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 26 13:02:40.243088 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 26 13:02:40.243088 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:40.243088 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi On instance: Oct 26 13:02:40.243088 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi 'invalid' Oct 26 13:02:40.243088 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:40.243088 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:40.243088 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:40.243088 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:40.243088 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:40.245213 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:40.245213 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:02:40.245213 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:02:40.245213 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:02:40.245213 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:02:40.245213 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:02:40.245213 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:02:40.245213 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 13:02:40.245213 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 13:02:40.245213 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 13:02:40.245213 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 13:02:40.245213 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 13:02:40.245213 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 13:02:40.245213 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 26 13:02:40.245213 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:40.245213 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:40.245213 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:40.245213 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:40.245213 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:40.246394 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:40.246394 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 13:02:40.246394 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 13:02:40.246394 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 26 13:02:40.246394 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:40.246394 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7596aa82-266a-40cd-b619-f2d7ab6809d3 tempest-HostsAdminNegativeTestJSON-2144614408 tempest-HostsAdminNegativeTestJSON-2144614408-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:02:40.246394 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7596aa82-266a-40cd-b619-f2d7ab6809d3 tempest-HostsAdminNegativeTestJSON-2144614408 tempest-HostsAdminNegativeTestJSON-2144614408-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-hosts/n-d-862686-1" status: 400 len: 189 microversion: 2.1 time: 0.008955 Oct 26 13:02:40.247530 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 20/45] 10.222.0.40 () {60 vars in 1187 bytes} [Wed Oct 26 13:02:40 2022] PUT /compute/v2.1/os-hosts/n-d-862686-1 => generated 189 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:02:40.253177 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c75153a9-b9c9-4075-a157-c9c885474087 tempest-AZAdminV2TestJSON-1204544273 tempest-AZAdminV2TestJSON-1204544273-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:40.255580 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c75153a9-b9c9-4075-a157-c9c885474087 tempest-AZAdminV2TestJSON-1204544273 tempest-AZAdminV2TestJSON-1204544273-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:40.256066 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c75153a9-b9c9-4075-a157-c9c885474087 tempest-AZAdminV2TestJSON-1204544273 tempest-AZAdminV2TestJSON-1204544273-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:40.256508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c75153a9-b9c9-4075-a157-c9c885474087 tempest-AZAdminV2TestJSON-1204544273 tempest-AZAdminV2TestJSON-1204544273-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:40.257235 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c75153a9-b9c9-4075-a157-c9c885474087 tempest-AZAdminV2TestJSON-1204544273 tempest-AZAdminV2TestJSON-1204544273-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:40.257728 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c75153a9-b9c9-4075-a157-c9c885474087 tempest-AZAdminV2TestJSON-1204544273 tempest-AZAdminV2TestJSON-1204544273-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:40.258156 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c75153a9-b9c9-4075-a157-c9c885474087 tempest-AZAdminV2TestJSON-1204544273 tempest-AZAdminV2TestJSON-1204544273-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:40.281555 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c75153a9-b9c9-4075-a157-c9c885474087 tempest-AZAdminV2TestJSON-1204544273 tempest-AZAdminV2TestJSON-1204544273-project-admin] 10.222.0.40 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.033068 Oct 26 13:02:40.282143 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 21/46] 10.222.0.40 () {58 vars in 1185 bytes} [Wed Oct 26 13:02:40 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:02:40.286421 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-97186e4c-f96e-4a54-b05b-aa1a8f2d49dd tempest-FlavorsAccessTestJSON-1946482852 tempest-FlavorsAccessTestJSON-1946482852-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:40.314835 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-97186e4c-f96e-4a54-b05b-aa1a8f2d49dd tempest-FlavorsAccessTestJSON-1946482852 tempest-FlavorsAccessTestJSON-1946482852-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1939963939" status: 202 len: 0 microversion: 2.1 time: 0.031648 Oct 26 13:02:40.315417 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 22/47] 10.222.0.40 () {58 vars in 1161 bytes} [Wed Oct 26 13:02:40 2022] DELETE /compute/v2.1/flavors/1939963939 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:02:40.326091 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e81081e5-886e-43b6-abea-9558e16179f7 tempest-HostsAdminNegativeTestJSON-1055221838 tempest-HostsAdminNegativeTestJSON-1055221838-project] Action: 'update', calling method: .version_select at 0x7f67334d75e0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:40.329990 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e81081e5-886e-43b6-abea-9558e16179f7 tempest-HostsAdminNegativeTestJSON-1055221838 tempest-HostsAdminNegativeTestJSON-1055221838-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '71ad5b5b4c8f4c8c91cf81b97980b0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92097efddaf64433973f5e72da0ac63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:02:40.331574 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e81081e5-886e-43b6-abea-9558e16179f7 tempest-HostsAdminNegativeTestJSON-1055221838 tempest-HostsAdminNegativeTestJSON-1055221838-project] Request method failure captured: Oct 26 13:02:40.331574 n-d-862686-1 devstack@n-api.service[120598]: request: PUT /compute/v2.1/os-hosts/n-d-862686-1 HTTP/1.1 Oct 26 13:02:40.331574 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:02:40.331574 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:02:40.331574 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:02:40.331574 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 50 Oct 26 13:02:40.331574 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:02:40.331574 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:02:40.331574 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:02:40.331574 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:02:40.331574 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWS_rq7MnvS4et4d81O3jmRwenIi5cbjrQrZDx-cyYszVacFh7rurIgioH5Dl8fDM80iXWWxn8PkSMFINPvhvIxVLOjEfLOWFWTjR4yXdUmpiIgcyWPP0w5fC0j9xcTIXTzMl9xcq8Z2FmEfG8d6v_X5YGx1oxTXCQd1aUScoi0d80a0 Oct 26 13:02:40.331574 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:02:40.331574 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:02:40.331574 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:02:40.331574 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:02:40.331574 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:02:40.331574 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:02:40.331574 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 92097efddaf64433973f5e72da0ac63a Oct 26 13:02:40.331574 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1055221838 Oct 26 13:02:40.331574 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:02:40.331574 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:02:40.332821 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/92097efddaf64433973f5e72da0ac63a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/92097efddaf64433973f5e72da0ac63a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_92097efddaf64433973f5e72da0ac63a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/92097efddaf64433973f5e72da0ac63a"}]}] Oct 26 13:02:40.332821 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1055221838 Oct 26 13:02:40.332821 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 92097efddaf64433973f5e72da0ac63a Oct 26 13:02:40.332821 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1055221838 Oct 26 13:02:40.332821 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-HostsAdminNegativeTestJSON-1055221838-project Oct 26 13:02:40.332821 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:02:40.332821 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:02:40.332821 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 71ad5b5b4c8f4c8c91cf81b97980b0ea Oct 26 13:02:40.332821 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1055221838-project Oct 26 13:02:40.332821 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:02:40.332821 n-d-862686-1 devstack@n-api.service[120598]: {"status": "enable", "maintenance_mode": "enable"} Oct 26 13:02:40.332821 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:02:40.332821 n-d-862686-1 devstack@n-api.service[120598]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 26 13:02:40.332821 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'n-d-862686-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 26 13:02:40.334124 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:02:40.334124 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:40.334124 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:40.334124 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:40.334124 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:02:40.334124 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:02:40.334124 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:02:40.334124 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:02:40.334124 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:02:40.334124 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:02:40.334124 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:02:40.334124 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:02:40.334124 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 26 13:02:40.334124 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 26 13:02:40.334124 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 13:02:40.334124 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 13:02:40.334124 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 13:02:40.334124 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 13:02:40.334124 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 13:02:40.334124 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 13:02:40.335288 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 13:02:40.335288 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 13:02:40.335288 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 13:02:40.335288 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 13:02:40.335288 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 13:02:40.335288 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 13:02:40.335288 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 13:02:40.335288 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 13:02:40.335288 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 26 13:02:40.335288 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:40.335288 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:40.335288 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:40.335288 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:40.335288 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:40.335288 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:40.335288 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 13:02:40.335288 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 13:02:40.335288 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 26 13:02:40.335288 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:40.336397 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e81081e5-886e-43b6-abea-9558e16179f7 tempest-HostsAdminNegativeTestJSON-1055221838 tempest-HostsAdminNegativeTestJSON-1055221838-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:02:40.336397 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e81081e5-886e-43b6-abea-9558e16179f7 tempest-HostsAdminNegativeTestJSON-1055221838 tempest-HostsAdminNegativeTestJSON-1055221838-project] 10.222.0.40 "PUT /compute/v2.1/os-hosts/n-d-862686-1" status: 403 len: 111 microversion: 2.1 time: 0.016442 Oct 26 13:02:40.336397 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 23/48] 10.222.0.40 () {60 vars in 1187 bytes} [Wed Oct 26 13:02:40 2022] PUT /compute/v2.1/os-hosts/n-d-862686-1 => generated 111 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:02:40.342502 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1653feab-9888-4868-a06e-a76afcbc917e tempest-FlavorsAccessTestJSON-1946482852 tempest-FlavorsAccessTestJSON-1946482852-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:40.364773 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1653feab-9888-4868-a06e-a76afcbc917e tempest-FlavorsAccessTestJSON-1946482852 tempest-FlavorsAccessTestJSON-1946482852-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030313 Oct 26 13:02:40.365362 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 24/49] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:02:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:02:40.370507 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c895d796-ff8d-491a-a4d9-832e561a6109 tempest-HostsAdminNegativeTestJSON-2144614408 tempest-HostsAdminNegativeTestJSON-2144614408-project-admin] Action: 'update', calling method: .version_select at 0x7f67334323a0>, body: {"status": null, "maintenance_mode": null} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:40.374286 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c895d796-ff8d-491a-a4d9-832e561a6109 tempest-HostsAdminNegativeTestJSON-2144614408 tempest-HostsAdminNegativeTestJSON-2144614408-project-admin] Request method failure captured: Oct 26 13:02:40.374286 n-d-862686-1 devstack@n-api.service[120598]: request: PUT /compute/v2.1/os-hosts/n-d-862686-1 HTTP/1.1 Oct 26 13:02:40.374286 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:02:40.374286 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:02:40.374286 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:02:40.374286 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 42 Oct 26 13:02:40.374286 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:02:40.374286 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:02:40.374286 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:02:40.374286 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:02:40.374286 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWS_tAZ0VmO2F-wgFz6_GLWUsfGRnrrflH4ysHXneNBZakeUQBj94ut6RP0Y6UFp_yB8hb6qbmQm9fRFHIAvluQVTs2zgD11zffCEEuQWB6o06WZCSERzpKkCy4di839Ej5dZG61U2o_k2XvbH3SSLVFcXBnzv4kjEvWAAJLLxZRXjgQ Oct 26 13:02:40.374286 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:02:40.374286 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:02:40.374286 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:02:40.374286 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:02:40.374286 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:02:40.374286 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:02:40.374286 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 92887387258c4611b5dca0b0fe3f8d48 Oct 26 13:02:40.374286 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2144614408 Oct 26 13:02:40.374286 n-d-862686-1 devstack@n-api.service[120598]: X-Role: admin,member,reader Oct 26 13:02:40.374286 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: admin,member,reader Oct 26 13:02:40.375649 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/92887387258c4611b5dca0b0fe3f8d48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/92887387258c4611b5dca0b0fe3f8d48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_92887387258c4611b5dca0b0fe3f8d48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/92887387258c4611b5dca0b0fe3f8d48"}]}] Oct 26 13:02:40.375649 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2144614408 Oct 26 13:02:40.375649 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 92887387258c4611b5dca0b0fe3f8d48 Oct 26 13:02:40.375649 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2144614408 Oct 26 13:02:40.375649 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-HostsAdminNegativeTestJSON-2144614408-project-admin Oct 26 13:02:40.375649 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:02:40.375649 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:02:40.375649 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 243dbb4713ae4cfea3b1884045b7b243 Oct 26 13:02:40.375649 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2144614408-project-admin Oct 26 13:02:40.375649 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:02:40.375649 n-d-862686-1 devstack@n-api.service[120598]: {"status": null, "maintenance_mode": null} Oct 26 13:02:40.375649 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:02:40.375649 n-d-862686-1 devstack@n-api.service[120598]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 26 13:02:40.375649 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'n-d-862686-1', 'body': {'status': None, 'maintenance_mode': None}} Oct 26 13:02:40.376519 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:02:40.376519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:40.376519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 13:02:40.376519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 13:02:40.376519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 13:02:40.376519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise error Oct 26 13:02:40.376519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 26 13:02:40.376519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:40.376519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 26 13:02:40.376519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 26 13:02:40.376519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi 'disable', Oct 26 13:02:40.376519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi 'Enable', Oct 26 13:02:40.376519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi 'Disable', Oct 26 13:02:40.376519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 26 13:02:40.376519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 26 13:02:40.376519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 26 13:02:40.376519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:40.376519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi On instance: Oct 26 13:02:40.376519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi None Oct 26 13:02:40.376519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:40.376519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:40.376519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:40.376519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:40.376519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:40.376519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:40.378775 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:02:40.378775 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:02:40.378775 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:02:40.378775 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:02:40.378775 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:02:40.378775 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:02:40.378775 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 13:02:40.378775 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 13:02:40.378775 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 13:02:40.378775 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 13:02:40.378775 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 13:02:40.378775 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 13:02:40.378775 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 26 13:02:40.378775 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:40.378775 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:40.378775 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:40.378775 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:40.378775 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:40.378775 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:40.379772 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 13:02:40.379772 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 13:02:40.379772 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 26 13:02:40.379772 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:40.379772 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c895d796-ff8d-491a-a4d9-832e561a6109 tempest-HostsAdminNegativeTestJSON-2144614408 tempest-HostsAdminNegativeTestJSON-2144614408-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:02:40.379772 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c895d796-ff8d-491a-a4d9-832e561a6109 tempest-HostsAdminNegativeTestJSON-2144614408 tempest-HostsAdminNegativeTestJSON-2144614408-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-hosts/n-d-862686-1" status: 400 len: 127 microversion: 2.1 time: 0.009188 Oct 26 13:02:40.379772 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 25/50] 10.222.0.40 () {60 vars in 1187 bytes} [Wed Oct 26 13:02:40 2022] PUT /compute/v2.1/os-hosts/n-d-862686-1 => generated 127 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:02:40.387945 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a775f21e-b0c1-4878-a49e-d7c4629a5693 tempest-HostsAdminNegativeTestJSON-2144614408 tempest-HostsAdminNegativeTestJSON-2144614408-project-admin] Action: 'update', calling method: .version_select at 0x7f67334d7940>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:40.391092 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.hosts [None req-a775f21e-b0c1-4878-a49e-d7c4629a5693 tempest-HostsAdminNegativeTestJSON-2144614408 tempest-HostsAdminNegativeTestJSON-2144614408-project-admin] Enabling host nonexistent_hostname. Oct 26 13:02:40.399587 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-a775f21e-b0c1-4878-a49e-d7c4629a5693 tempest-HostsAdminNegativeTestJSON-2144614408 tempest-HostsAdminNegativeTestJSON-2144614408-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 13:02:40.402381 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a775f21e-b0c1-4878-a49e-d7c4629a5693 tempest-HostsAdminNegativeTestJSON-2144614408 tempest-HostsAdminNegativeTestJSON-2144614408-project-admin] Request method failure captured: Oct 26 13:02:40.402381 n-d-862686-1 devstack@n-api.service[120598]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 26 13:02:40.402381 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:02:40.402381 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:02:40.402381 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:02:40.402381 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 50 Oct 26 13:02:40.402381 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:02:40.402381 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:02:40.402381 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:02:40.402381 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:02:40.402381 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWS_tAZ0VmO2F-wgFz6_GLWUsfGRnrrflH4ysHXneNBZakeUQBj94ut6RP0Y6UFp_yB8hb6qbmQm9fRFHIAvluQVTs2zgD11zffCEEuQWB6o06WZCSERzpKkCy4di839Ej5dZG61U2o_k2XvbH3SSLVFcXBnzv4kjEvWAAJLLxZRXjgQ Oct 26 13:02:40.402381 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:02:40.402381 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:02:40.402381 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:02:40.402381 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:02:40.402381 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:02:40.402381 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:02:40.402381 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 92887387258c4611b5dca0b0fe3f8d48 Oct 26 13:02:40.402381 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2144614408 Oct 26 13:02:40.402381 n-d-862686-1 devstack@n-api.service[120598]: X-Role: admin,member,reader Oct 26 13:02:40.402381 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: admin,member,reader Oct 26 13:02:40.403823 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/92887387258c4611b5dca0b0fe3f8d48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/92887387258c4611b5dca0b0fe3f8d48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_92887387258c4611b5dca0b0fe3f8d48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/92887387258c4611b5dca0b0fe3f8d48"}]}] Oct 26 13:02:40.403823 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2144614408 Oct 26 13:02:40.403823 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 92887387258c4611b5dca0b0fe3f8d48 Oct 26 13:02:40.403823 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2144614408 Oct 26 13:02:40.403823 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-HostsAdminNegativeTestJSON-2144614408-project-admin Oct 26 13:02:40.403823 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:02:40.403823 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:02:40.403823 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 243dbb4713ae4cfea3b1884045b7b243 Oct 26 13:02:40.403823 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2144614408-project-admin Oct 26 13:02:40.403823 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:02:40.403823 n-d-862686-1 devstack@n-api.service[120598]: {"status": "enable", "maintenance_mode": "enable"} Oct 26 13:02:40.403823 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:02:40.403823 n-d-862686-1 devstack@n-api.service[120598]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 13:02:40.403823 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 26 13:02:40.404624 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:02:40.404624 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:40.404624 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 26 13:02:40.404624 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 26 13:02:40.404624 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 26 13:02:40.404624 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 26 13:02:40.404624 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 13:02:40.404624 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 13:02:40.404624 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 13:02:40.404624 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 13:02:40.404624 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 26 13:02:40.404624 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 26 13:02:40.404624 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 26 13:02:40.404624 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 26 13:02:40.404624 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 13:02:40.404624 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 13:02:40.404624 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 26 13:02:40.404624 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 26 13:02:40.405950 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 13:02:40.405950 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 13:02:40.405950 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 26 13:02:40.405950 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 26 13:02:40.405950 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 13:02:40.405950 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:40.405950 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:40.405950 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:40.405950 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:40.405950 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:40.405950 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:40.405950 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:02:40.405950 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:02:40.405950 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:02:40.405950 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:02:40.405950 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:02:40.405950 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:02:40.405950 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:02:40.405950 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:02:40.405950 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 26 13:02:40.407249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 26 13:02:40.407249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 26 13:02:40.407249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:02:40.407249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 13:02:40.407249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:40.407249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:40.407249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:40.407249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:40.407249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:40.407249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:40.407249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:02:40.407249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:02:40.407249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 13:02:40.407249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:40.407249 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a775f21e-b0c1-4878-a49e-d7c4629a5693 tempest-HostsAdminNegativeTestJSON-2144614408 tempest-HostsAdminNegativeTestJSON-2144614408-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:02:40.407978 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a775f21e-b0c1-4878-a49e-d7c4629a5693 tempest-HostsAdminNegativeTestJSON-2144614408 tempest-HostsAdminNegativeTestJSON-2144614408-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.020509 Oct 26 13:02:40.407978 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 26/51] 10.222.0.40 () {60 vars in 1211 bytes} [Wed Oct 26 13:02:40 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:02:41.216173 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2461b1ae-7fd6-4fee-9fbe-77260f3d0143 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 241 microversion: 2.1 time: 1.110121 Oct 26 13:02:41.224154 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 26/52] 10.222.0.40 () {60 vars in 1191 bytes} [Wed Oct 26 13:02:40 2022] POST /compute/v2.1/os-aggregates/2/action => generated 241 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:02:41.231378 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c054abaf-e8e7-4b97-9808-2ed5c27dc583 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862686-1"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:41.254118 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c054abaf-e8e7-4b97-9808-2ed5c27dc583 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:41.256034 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c054abaf-e8e7-4b97-9808-2ed5c27dc583 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:41.256488 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c054abaf-e8e7-4b97-9808-2ed5c27dc583 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:41.306692 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-c054abaf-e8e7-4b97-9808-2ed5c27dc583 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] HTTP exception thrown: Aggregate 2 already has host n-h1-862686-1. Oct 26 13:02:41.324817 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c054abaf-e8e7-4b97-9808-2ed5c27dc583 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Request method failure captured: Oct 26 13:02:41.324817 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Oct 26 13:02:41.324817 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:02:41.324817 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:02:41.324817 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:02:41.324817 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 39 Oct 26 13:02:41.324817 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:02:41.324817 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:02:41.324817 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:02:41.324817 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:02:41.324817 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWS_sfFRcMzjEYCQSXneDm5toGZqZB16WOH-Qo-4Bz_te2no6v1TsESTknsuuI11u4x_4c5NiHEEusXv1wJkBD8bTSxEE6bBphxZSEWFwa4Nvl0KEZhzS3PnReyi2f2CzNz2Pl85lqWxrTQ5TVaKv5_KO-GQon2hwsILTZXHj2hYN2Gg Oct 26 13:02:41.324817 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:02:41.324817 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:02:41.324817 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:02:41.324817 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:02:41.324817 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:02:41.324817 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:02:41.324817 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 6e3d346ad1fa46fb955330afa42acf9f Oct 26 13:02:41.324817 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-710602825 Oct 26 13:02:41.324817 n-d-862686-1 devstack@n-api.service[120598]: X-Role: admin,member,reader Oct 26 13:02:41.324817 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: admin,member,reader Oct 26 13:02:41.325922 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6e3d346ad1fa46fb955330afa42acf9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6e3d346ad1fa46fb955330afa42acf9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6e3d346ad1fa46fb955330afa42acf9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6e3d346ad1fa46fb955330afa42acf9f"}]}] Oct 26 13:02:41.325922 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-710602825 Oct 26 13:02:41.325922 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 6e3d346ad1fa46fb955330afa42acf9f Oct 26 13:02:41.325922 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-710602825 Oct 26 13:02:41.325922 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin Oct 26 13:02:41.325922 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:02:41.325922 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:02:41.325922 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: e106beb4f1bd44acbbd3a88dddef9303 Oct 26 13:02:41.325922 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin Oct 26 13:02:41.325922 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:02:41.325922 n-d-862686-1 devstack@n-api.service[120598]: {"add_host": {"host": "n-h1-862686-1"}} Oct 26 13:02:41.325922 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:02:41.325922 n-d-862686-1 devstack@n-api.service[120598]: exception: Aggregate 2 already has host n-h1-862686-1. Oct 26 13:02:41.326571 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h1-862686-1'}}} Oct 26 13:02:41.326571 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:02:41.326571 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:41.326571 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 26 13:02:41.326571 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 26 13:02:41.326571 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 26 13:02:41.326571 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 26 13:02:41.326571 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 26 13:02:41.326571 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 26 13:02:41.326571 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 26 13:02:41.326571 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 26 13:02:41.326571 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 26 13:02:41.326571 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 26 13:02:41.326571 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 26 13:02:41.326571 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result.read() Oct 26 13:02:41.326571 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 26 13:02:41.326571 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 26 13:02:41.326571 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 26 13:02:41.326571 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 26 13:02:41.327500 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 26 13:02:41.327500 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 26 13:02:41.327500 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 26 13:02:41.327500 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 26 13:02:41.327500 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-862686-1-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 26 13:02:41.327500 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:41.327500 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 26 13:02:41.327500 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:41.327500 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:41.327500 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 26 13:02:41.327500 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 26 13:02:41.327500 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 26 13:02:41.327500 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi session.flush() Oct 26 13:02:41.327500 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 26 13:02:41.327500 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 26 13:02:41.327500 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 26 13:02:41.327500 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 26 13:02:41.327500 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 26 13:02:41.327500 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 26 13:02:41.328453 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 26 13:02:41.328453 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception Oct 26 13:02:41.328453 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 26 13:02:41.328453 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 26 13:02:41.328453 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 26 13:02:41.328453 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 26 13:02:41.328453 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 26 13:02:41.328453 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 26 13:02:41.328453 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 26 13:02:41.328453 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 26 13:02:41.328453 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 26 13:02:41.328453 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 26 13:02:41.328453 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 26 13:02:41.328453 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 26 13:02:41.328453 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 26 13:02:41.328453 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 26 13:02:41.328453 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 26 13:02:41.328453 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 26 13:02:41.329431 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 26 13:02:41.329431 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 26 13:02:41.329431 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 26 13:02:41.329431 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 26 13:02:41.329431 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 26 13:02:41.329431 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception Oct 26 13:02:41.329431 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 26 13:02:41.329431 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 26 13:02:41.329431 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 26 13:02:41.329431 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 26 13:02:41.329431 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 26 13:02:41.329431 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 26 13:02:41.329431 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 26 13:02:41.329431 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 26 13:02:41.329431 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 26 13:02:41.329431 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 26 13:02:41.329431 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 26 13:02:41.329431 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result.read() Oct 26 13:02:41.333114 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 26 13:02:41.333114 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 26 13:02:41.333114 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 26 13:02:41.333114 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 26 13:02:41.333114 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 26 13:02:41.333114 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 26 13:02:41.333114 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 26 13:02:41.333114 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 26 13:02:41.333114 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-862686-1-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 26 13:02:41.333114 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 26 13:02:41.333114 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 26, 13, 2, 41, 297382), 'updated_at': None, 'host': 'n-h1-862686-1', 'aggregate_id': 2}] Oct 26 13:02:41.333114 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 26 13:02:41.333114 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:41.333114 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:41.333114 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:41.333114 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:41.333114 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 26 13:02:41.335876 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 26 13:02:41.335876 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 26 13:02:41.335876 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 26 13:02:41.335876 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 13:02:41.335876 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 13:02:41.335876 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 13:02:41.335876 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 13:02:41.335876 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 26 13:02:41.335876 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 26 13:02:41.335876 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 26 13:02:41.335876 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 26 13:02:41.335876 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 26 13:02:41.335876 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 26 13:02:41.335876 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 26 13:02:41.335876 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 26 13:02:41.335876 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 26 13:02:41.335876 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 26 13:02:41.335876 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 2 already has host n-h1-862686-1. Oct 26 13:02:41.335876 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:41.335876 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:41.339309 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:41.339309 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:41.339309 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:41.339309 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:41.339309 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:02:41.339309 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:02:41.339309 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:02:41.339309 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:02:41.339309 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:02:41.339309 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:02:41.339309 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 26 13:02:41.339309 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 26 13:02:41.339309 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 2 already has host n-h1-862686-1. Oct 26 13:02:41.339309 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:41.339309 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:41.339309 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:41.339309 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:41.339309 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:41.339309 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:41.339309 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:02:41.339309 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:02:41.342358 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 2 already has host n-h1-862686-1. Oct 26 13:02:41.342358 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:41.342358 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c054abaf-e8e7-4b97-9808-2ed5c27dc583 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Returning 409 to user: Aggregate 2 already has host n-h1-862686-1. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:02:41.342358 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c054abaf-e8e7-4b97-9808-2ed5c27dc583 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/2/action" status: 409 len: 95 microversion: 2.1 time: 0.101332 Oct 26 13:02:41.342358 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 27/53] 10.222.0.40 () {60 vars in 1191 bytes} [Wed Oct 26 13:02:41 2022] POST /compute/v2.1/os-aggregates/2/action => generated 95 bytes in 111 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 26 13:02:41.343273 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6a7d0b56-b0e6-4f71-a2cb-fd21e8d15735 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862686-1"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:41.354339 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6a7d0b56-b0e6-4f71-a2cb-fd21e8d15735 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:41.355035 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6a7d0b56-b0e6-4f71-a2cb-fd21e8d15735 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:41.355668 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6a7d0b56-b0e6-4f71-a2cb-fd21e8d15735 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:41.537080 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6a7d0b56-b0e6-4f71-a2cb-fd21e8d15735 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 226 microversion: 2.1 time: 0.204534 Oct 26 13:02:41.538658 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 27/54] 10.222.0.40 () {60 vars in 1191 bytes} [Wed Oct 26 13:02:41 2022] POST /compute/v2.1/os-aggregates/2/action => generated 226 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:02:41.551042 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5c219bae-7e2e-4f90-abdf-d3ae1a0a7ac5 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:41.606643 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5c219bae-7e2e-4f90-abdf-d3ae1a0a7ac5 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.055816 Oct 26 13:02:41.609169 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 28/55] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 26 13:02:41 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 26 13:02:41.625308 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1285edfb-5262-4e15-ab3e-07dbe0e8cd1b tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1885675523"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:41.633905 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.aggregate [None req-1285edfb-5262-4e15-ab3e-07dbe0e8cd1b tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Generated uuid b9096c40-1c00-450c-83b4-06e6333b1809 for aggregate {{(pid=120597) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 26 13:02:41.674122 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1285edfb-5262-4e15-ab3e-07dbe0e8cd1b tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.058945 Oct 26 13:02:41.675469 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 28/56] 10.222.0.40 () {60 vars in 1164 bytes} [Wed Oct 26 13:02:41 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:02:41.690884 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2e6b2fbf-971b-4a2b-b298-eb798bdfc9ef tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-49435336", "name": "tempest-test_aggregate-898686839"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:41.727953 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.aggregate [None req-2e6b2fbf-971b-4a2b-b298-eb798bdfc9ef tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Generated uuid b0f01c2f-c441-4235-b0c7-fe5dd4ca23e6 for aggregate {{(pid=120598) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 26 13:02:41.742176 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:02:41.849873 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2e6b2fbf-971b-4a2b-b298-eb798bdfc9ef tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 219 microversion: 2.1 time: 0.169450 Oct 26 13:02:41.860817 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 29/57] 10.222.0.40 () {60 vars in 1165 bytes} [Wed Oct 26 13:02:41 2022] POST /compute/v2.1/os-aggregates => generated 219 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:02:41.870812 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a98e3fa3-9bde-426b-8cbb-7719b560cccb tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:41.896282 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a98e3fa3-9bde-426b-8cbb-7719b560cccb tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates" status: 200 len: 512 microversion: 2.1 time: 0.033557 Oct 26 13:02:41.905978 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 30/58] 10.222.0.40 () {58 vars in 1143 bytes} [Wed Oct 26 13:02:41 2022] GET /compute/v2.1/os-aggregates => generated 512 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:02:41.911199 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-01feb272-00f1-4182-a4b6-d46c8fd8ebd0 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862686-1"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:41.929091 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-01feb272-00f1-4182-a4b6-d46c8fd8ebd0 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:41.929933 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-01feb272-00f1-4182-a4b6-d46c8fd8ebd0 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:41.930545 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-01feb272-00f1-4182-a4b6-d46c8fd8ebd0 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:42.190641 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-01feb272-00f1-4182-a4b6-d46c8fd8ebd0 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 310 microversion: 2.1 time: 0.282151 Oct 26 13:02:42.193447 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 31/59] 10.222.0.40 () {60 vars in 1191 bytes} [Wed Oct 26 13:02:41 2022] POST /compute/v2.1/os-aggregates/4/action => generated 310 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:02:42.260712 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2e8fc47e-b045-4b51-932a-0eeaac0e6488 tempest-AggregatesAdminNegativeTestJSON-1101699066 tempest-AggregatesAdminNegativeTestJSON-1101699066-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862686-1"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:42.265851 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2e8fc47e-b045-4b51-932a-0eeaac0e6488 tempest-AggregatesAdminNegativeTestJSON-1101699066 tempest-AggregatesAdminNegativeTestJSON-1101699066-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'c55cf0dfb51746b9bda068c3536498e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca406a2b27e4b838ab039466e2c8588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:02:42.273438 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2e8fc47e-b045-4b51-932a-0eeaac0e6488 tempest-AggregatesAdminNegativeTestJSON-1101699066 tempest-AggregatesAdminNegativeTestJSON-1101699066-project] Request method failure captured: Oct 26 13:02:42.273438 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/os-aggregates/3/action HTTP/1.1 Oct 26 13:02:42.273438 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:02:42.273438 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:02:42.273438 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:02:42.273438 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 39 Oct 26 13:02:42.273438 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:02:42.273438 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:02:42.273438 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:02:42.273438 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:02:42.273438 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWS_q5eJmOK4ObBzLIlJBKV6OCfiIV-QcmIR657jRoGCyQAl3QGmOC9CHBOCGDaiAoz-GgK0-qde7Owt6-n2kciN9-qghTs38KEdzNc_n7Bm-Ne2HM1GbxBzGTMGgaHtR_LD1weACUuo2_1jFmGMlVcXyzKDJabONz85MsQqCMinK4Uk Oct 26 13:02:42.273438 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:02:42.273438 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:02:42.273438 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:02:42.273438 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:02:42.273438 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:02:42.273438 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:02:42.273438 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 5ca406a2b27e4b838ab039466e2c8588 Oct 26 13:02:42.273438 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1101699066 Oct 26 13:02:42.273438 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:02:42.273438 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:02:42.274823 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5ca406a2b27e4b838ab039466e2c8588"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5ca406a2b27e4b838ab039466e2c8588"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5ca406a2b27e4b838ab039466e2c8588"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5ca406a2b27e4b838ab039466e2c8588"}]}] Oct 26 13:02:42.274823 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1101699066 Oct 26 13:02:42.274823 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 5ca406a2b27e4b838ab039466e2c8588 Oct 26 13:02:42.274823 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1101699066 Oct 26 13:02:42.274823 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-AggregatesAdminNegativeTestJSON-1101699066-project Oct 26 13:02:42.274823 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:02:42.274823 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:02:42.274823 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: c55cf0dfb51746b9bda068c3536498e2 Oct 26 13:02:42.274823 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1101699066-project Oct 26 13:02:42.274823 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:02:42.274823 n-d-862686-1 devstack@n-api.service[120597]: {"add_host": {"host": "n-h1-862686-1"}} Oct 26 13:02:42.274823 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:02:42.274823 n-d-862686-1 devstack@n-api.service[120597]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 26 13:02:42.275679 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '3', 'body': {'add_host': {'host': 'n-h1-862686-1'}}} Oct 26 13:02:42.275679 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:02:42.275679 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:42.275679 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:42.275679 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:42.275679 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:02:42.275679 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:02:42.275679 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:02:42.275679 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:02:42.275679 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:02:42.275679 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:02:42.275679 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 26 13:02:42.275679 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 26 13:02:42.275679 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 13:02:42.275679 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 13:02:42.275679 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 13:02:42.275679 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 13:02:42.275679 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 13:02:42.275679 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 13:02:42.276672 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 13:02:42.276672 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 13:02:42.276672 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 13:02:42.276672 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 13:02:42.276672 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 13:02:42.276672 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 13:02:42.276672 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 13:02:42.276672 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 13:02:42.276672 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 26 13:02:42.276672 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:42.276672 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:42.276672 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:42.276672 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:42.276672 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:42.276672 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:42.276672 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 13:02:42.276672 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 13:02:42.276672 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 26 13:02:42.276672 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:42.277789 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2e8fc47e-b045-4b51-932a-0eeaac0e6488 tempest-AggregatesAdminNegativeTestJSON-1101699066 tempest-AggregatesAdminNegativeTestJSON-1101699066-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:02:42.279416 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2e8fc47e-b045-4b51-932a-0eeaac0e6488 tempest-AggregatesAdminNegativeTestJSON-1101699066 tempest-AggregatesAdminNegativeTestJSON-1101699066-project] 10.222.0.40 "POST /compute/v2.1/os-aggregates/3/action" status: 403 len: 118 microversion: 2.1 time: 0.583170 Oct 26 13:02:42.283521 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 29/60] 10.222.0.40 () {60 vars in 1191 bytes} [Wed Oct 26 13:02:41 2022] POST /compute/v2.1/os-aggregates/3/action => generated 118 bytes in 588 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:02:42.296147 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2075788c-0063-4500-a754-82af6d329148 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:42.360474 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2075788c-0063-4500-a754-82af6d329148 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.072218 Oct 26 13:02:42.363219 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 32/61] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 26 13:02:42 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 26 13:02:42.376123 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e9211b8b-241d-4ea9-9390-ae7369021949 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-409557166"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:42.380351 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.aggregate [None req-e9211b8b-241d-4ea9-9390-ae7369021949 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Generated uuid 12193ffa-e7cc-41f4-9498-4b27a37227c2 for aggregate {{(pid=120597) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 26 13:02:42.406593 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e9211b8b-241d-4ea9-9390-ae7369021949 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.036587 Oct 26 13:02:42.407409 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 30/62] 10.222.0.40 () {60 vars in 1164 bytes} [Wed Oct 26 13:02:42 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:02:42.420293 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c1cb0d39-1cca-4cdf-a9a9-ac5d097419eb tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-31672132"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:42.448381 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c1cb0d39-1cca-4cdf-a9a9-ac5d097419eb tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:42.449068 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c1cb0d39-1cca-4cdf-a9a9-ac5d097419eb tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:42.449527 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c1cb0d39-1cca-4cdf-a9a9-ac5d097419eb tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:42.468444 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c1cb0d39-1cca-4cdf-a9a9-ac5d097419eb tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:42.468945 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c1cb0d39-1cca-4cdf-a9a9-ac5d097419eb tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:42.469471 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c1cb0d39-1cca-4cdf-a9a9-ac5d097419eb tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:42.477123 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-c1cb0d39-1cca-4cdf-a9a9-ac5d097419eb tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-31672132 could not be found. Oct 26 13:02:42.480606 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c1cb0d39-1cca-4cdf-a9a9-ac5d097419eb tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Request method failure captured: Oct 26 13:02:42.480606 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/os-aggregates/5/action HTTP/1.1 Oct 26 13:02:42.480606 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:02:42.480606 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:02:42.480606 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:02:42.480606 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 56 Oct 26 13:02:42.480606 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:02:42.480606 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:02:42.480606 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:02:42.480606 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:02:42.480606 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWS_sfFRcMzjEYCQSXneDm5toGZqZB16WOH-Qo-4Bz_te2no6v1TsESTknsuuI11u4x_4c5NiHEEusXv1wJkBD8bTSxEE6bBphxZSEWFwa4Nvl0KEZhzS3PnReyi2f2CzNz2Pl85lqWxrTQ5TVaKv5_KO-GQon2hwsILTZXHj2hYN2Gg Oct 26 13:02:42.480606 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:02:42.480606 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:02:42.480606 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:02:42.480606 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:02:42.480606 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:02:42.480606 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:02:42.480606 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 6e3d346ad1fa46fb955330afa42acf9f Oct 26 13:02:42.480606 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-710602825 Oct 26 13:02:42.480606 n-d-862686-1 devstack@n-api.service[120598]: X-Role: admin,member,reader Oct 26 13:02:42.480606 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: admin,member,reader Oct 26 13:02:42.481705 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6e3d346ad1fa46fb955330afa42acf9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6e3d346ad1fa46fb955330afa42acf9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6e3d346ad1fa46fb955330afa42acf9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6e3d346ad1fa46fb955330afa42acf9f"}]}] Oct 26 13:02:42.481705 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-710602825 Oct 26 13:02:42.481705 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 6e3d346ad1fa46fb955330afa42acf9f Oct 26 13:02:42.481705 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-710602825 Oct 26 13:02:42.481705 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin Oct 26 13:02:42.481705 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:02:42.481705 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:02:42.481705 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: e106beb4f1bd44acbbd3a88dddef9303 Oct 26 13:02:42.481705 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin Oct 26 13:02:42.481705 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:02:42.481705 n-d-862686-1 devstack@n-api.service[120598]: {"add_host": {"host": "tempest-nonexist_host-31672132"}} Oct 26 13:02:42.481705 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:02:42.481705 n-d-862686-1 devstack@n-api.service[120598]: exception: Compute host tempest-nonexist_host-31672132 could not be found. Oct 26 13:02:42.482339 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '5', 'body': {'add_host': {'host': 'tempest-nonexist_host-31672132'}}} Oct 26 13:02:42.482339 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:02:42.482339 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:42.482339 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 26 13:02:42.482339 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 26 13:02:42.482339 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 13:02:42.482339 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 13:02:42.482339 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 26 13:02:42.482339 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 26 13:02:42.482339 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 13:02:42.482339 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 13:02:42.482339 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 26 13:02:42.482339 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 26 13:02:42.482339 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-31672132' is not mapped to any cell Oct 26 13:02:42.482339 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:42.482339 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:42.482339 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:42.482339 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:42.482339 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 26 13:02:42.483270 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 26 13:02:42.483270 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 26 13:02:42.483270 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 26 13:02:42.483270 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 26 13:02:42.483270 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:42.483270 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:42.483270 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:42.483270 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:42.483270 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 26 13:02:42.483270 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 26 13:02:42.483270 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 26 13:02:42.483270 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 26 13:02:42.483270 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 13:02:42.483270 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 13:02:42.483270 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 13:02:42.483270 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 13:02:42.483270 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 26 13:02:42.483270 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 26 13:02:42.483270 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 26 13:02:42.483270 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 26 13:02:42.484543 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 26 13:02:42.484543 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 26 13:02:42.484543 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-31672132 could not be found. Oct 26 13:02:42.484543 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:42.484543 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:42.484543 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:42.484543 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:42.484543 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:42.484543 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:42.484543 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:02:42.484543 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:02:42.484543 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:02:42.484543 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:02:42.484543 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:02:42.484543 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:02:42.484543 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 26 13:02:42.484543 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:02:42.484543 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-31672132 could not be found. Oct 26 13:02:42.484543 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:42.484543 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:42.484543 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:42.485730 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:42.485730 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:42.485730 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:42.485730 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:02:42.485730 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:02:42.485730 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-31672132 could not be found. Oct 26 13:02:42.485730 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:42.485730 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c1cb0d39-1cca-4cdf-a9a9-ac5d097419eb tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-31672132 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:02:42.485730 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c1cb0d39-1cca-4cdf-a9a9-ac5d097419eb tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/5/action" status: 404 len: 109 microversion: 2.1 time: 0.067226 Oct 26 13:02:42.485730 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 33/63] 10.222.0.40 () {60 vars in 1191 bytes} [Wed Oct 26 13:02:42 2022] POST /compute/v2.1/os-aggregates/5/action => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:02:42.491445 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e0b9ee50-2b21-4e2f-a49f-52a31224a011 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:42.499093 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=7,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=10 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:02:42.518817 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e0b9ee50-2b21-4e2f-a49f-52a31224a011 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.030910 Oct 26 13:02:42.519396 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 31/64] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 26 13:02:42 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 26 13:02:42.528621 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d44d1ecc-f581-4c4f-958f-a6299136d04a tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:42.532418 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d44d1ecc-f581-4c4f-958f-a6299136d04a tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Request method failure captured: Oct 26 13:02:42.532418 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 26 13:02:42.532418 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:02:42.532418 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:02:42.532418 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:02:42.532418 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 283 Oct 26 13:02:42.532418 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:02:42.532418 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:02:42.532418 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:02:42.532418 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:02:42.532418 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWS_sfFRcMzjEYCQSXneDm5toGZqZB16WOH-Qo-4Bz_te2no6v1TsESTknsuuI11u4x_4c5NiHEEusXv1wJkBD8bTSxEE6bBphxZSEWFwa4Nvl0KEZhzS3PnReyi2f2CzNz2Pl85lqWxrTQ5TVaKv5_KO-GQon2hwsILTZXHj2hYN2Gg Oct 26 13:02:42.532418 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:02:42.532418 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:02:42.532418 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:02:42.532418 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:02:42.532418 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:02:42.532418 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:02:42.532418 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 6e3d346ad1fa46fb955330afa42acf9f Oct 26 13:02:42.532418 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-710602825 Oct 26 13:02:42.532418 n-d-862686-1 devstack@n-api.service[120598]: X-Role: admin,member,reader Oct 26 13:02:42.532418 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: admin,member,reader Oct 26 13:02:42.533771 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6e3d346ad1fa46fb955330afa42acf9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6e3d346ad1fa46fb955330afa42acf9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6e3d346ad1fa46fb955330afa42acf9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6e3d346ad1fa46fb955330afa42acf9f"}]}] Oct 26 13:02:42.533771 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-710602825 Oct 26 13:02:42.533771 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 6e3d346ad1fa46fb955330afa42acf9f Oct 26 13:02:42.533771 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-710602825 Oct 26 13:02:42.533771 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin Oct 26 13:02:42.533771 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:02:42.533771 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:02:42.533771 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: e106beb4f1bd44acbbd3a88dddef9303 Oct 26 13:02:42.533771 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin Oct 26 13:02:42.533771 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:02:42.534381 n-d-862686-1 devstack@n-api.service[120598]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 26 13:02:42.534381 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:02:42.534381 n-d-862686-1 devstack@n-api.service[120598]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 26 13:02:42.534381 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 26 13:02:42.534381 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:02:42.534381 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:42.534381 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 13:02:42.534381 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 13:02:42.534381 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 13:02:42.534381 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise error Oct 26 13:02:42.534991 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 26 13:02:42.534991 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:42.534991 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 26 13:02:42.534991 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 26 13:02:42.534991 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:42.534991 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 26 13:02:42.534991 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 26 13:02:42.534991 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:42.534991 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:42.534991 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:42.534991 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:42.534991 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:42.534991 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:42.534991 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:02:42.534991 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:02:42.534991 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:02:42.534991 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:02:42.535910 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:02:42.535910 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:02:42.535910 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 13:02:42.535910 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 13:02:42.535910 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 13:02:42.535910 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 13:02:42.535910 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 13:02:42.535910 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 13:02:42.535910 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 26 13:02:42.535910 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:42.535910 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:42.535910 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:42.535910 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:42.535910 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:42.535910 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:42.536713 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 13:02:42.536713 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 13:02:42.536713 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 26 13:02:42.536713 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:42.538918 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d44d1ecc-f581-4c4f-958f-a6299136d04a tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:02:42.540516 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d44d1ecc-f581-4c4f-958f-a6299136d04a tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.015659 Oct 26 13:02:42.542652 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 34/65] 10.222.0.40 () {60 vars in 1165 bytes} [Wed Oct 26 13:02:42 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:02:42.554558 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cb3047d8-a4b2-4d94-ab6a-4adbf8d2df89 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:42.559978 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cb3047d8-a4b2-4d94-ab6a-4adbf8d2df89 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Request method failure captured: Oct 26 13:02:42.559978 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 26 13:02:42.559978 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:02:42.559978 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:02:42.559978 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:02:42.559978 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 27 Oct 26 13:02:42.559978 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:02:42.559978 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:02:42.559978 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:02:42.559978 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:02:42.559978 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWS_sfFRcMzjEYCQSXneDm5toGZqZB16WOH-Qo-4Bz_te2no6v1TsESTknsuuI11u4x_4c5NiHEEusXv1wJkBD8bTSxEE6bBphxZSEWFwa4Nvl0KEZhzS3PnReyi2f2CzNz2Pl85lqWxrTQ5TVaKv5_KO-GQon2hwsILTZXHj2hYN2Gg Oct 26 13:02:42.559978 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:02:42.559978 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:02:42.559978 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:02:42.559978 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:02:42.559978 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:02:42.559978 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:02:42.559978 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 6e3d346ad1fa46fb955330afa42acf9f Oct 26 13:02:42.559978 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-710602825 Oct 26 13:02:42.559978 n-d-862686-1 devstack@n-api.service[120597]: X-Role: admin,member,reader Oct 26 13:02:42.559978 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: admin,member,reader Oct 26 13:02:42.561062 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6e3d346ad1fa46fb955330afa42acf9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6e3d346ad1fa46fb955330afa42acf9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6e3d346ad1fa46fb955330afa42acf9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6e3d346ad1fa46fb955330afa42acf9f"}]}] Oct 26 13:02:42.561062 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-710602825 Oct 26 13:02:42.561062 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 6e3d346ad1fa46fb955330afa42acf9f Oct 26 13:02:42.561062 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-710602825 Oct 26 13:02:42.561062 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin Oct 26 13:02:42.561062 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:02:42.561062 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:02:42.561062 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: e106beb4f1bd44acbbd3a88dddef9303 Oct 26 13:02:42.561062 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin Oct 26 13:02:42.561062 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:02:42.561062 n-d-862686-1 devstack@n-api.service[120597]: {"aggregate": {"name": ""}} Oct 26 13:02:42.561062 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:02:42.561062 n-d-862686-1 devstack@n-api.service[120597]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 26 13:02:42.562050 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 26 13:02:42.562050 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:02:42.562050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:42.562050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 13:02:42.562050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 13:02:42.562050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 13:02:42.562050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise error Oct 26 13:02:42.562050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 26 13:02:42.562050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:42.562050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 26 13:02:42.562050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 26 13:02:42.562050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:42.562050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 26 13:02:42.562050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi '' Oct 26 13:02:42.562050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:42.562050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:42.562050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:42.562050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:42.562050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:42.562050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:42.562050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:02:42.562050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:02:42.562050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:02:42.563358 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:02:42.563358 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:02:42.563358 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:02:42.563358 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 13:02:42.563358 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 13:02:42.563358 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 13:02:42.563358 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 13:02:42.563358 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 13:02:42.563358 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 13:02:42.563358 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 26 13:02:42.563358 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:42.563358 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:42.563358 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:42.563358 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:42.563358 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:42.563358 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:42.563358 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 13:02:42.563358 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 13:02:42.563358 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 26 13:02:42.563358 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:42.564351 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cb3047d8-a4b2-4d94-ab6a-4adbf8d2df89 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:02:42.564351 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cb3047d8-a4b2-4d94-ab6a-4adbf8d2df89 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.011770 Oct 26 13:02:42.564351 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 32/66] 10.222.0.40 () {60 vars in 1164 bytes} [Wed Oct 26 13:02:42 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:02:42.572258 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-45d182b6-6061-43ac-aa10-20aa40128d5a tempest-AggregatesAdminNegativeTestJSON-1101699066 tempest-AggregatesAdminNegativeTestJSON-1101699066-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1271538663"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:42.576943 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-45d182b6-6061-43ac-aa10-20aa40128d5a tempest-AggregatesAdminNegativeTestJSON-1101699066 tempest-AggregatesAdminNegativeTestJSON-1101699066-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'c55cf0dfb51746b9bda068c3536498e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca406a2b27e4b838ab039466e2c8588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:02:42.579568 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-45d182b6-6061-43ac-aa10-20aa40128d5a tempest-AggregatesAdminNegativeTestJSON-1101699066 tempest-AggregatesAdminNegativeTestJSON-1101699066-project] Request method failure captured: Oct 26 13:02:42.579568 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 26 13:02:42.579568 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:02:42.579568 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:02:42.579568 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:02:42.579568 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 60 Oct 26 13:02:42.579568 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:02:42.579568 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:02:42.579568 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:02:42.579568 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:02:42.579568 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWS_q5eJmOK4ObBzLIlJBKV6OCfiIV-QcmIR657jRoGCyQAl3QGmOC9CHBOCGDaiAoz-GgK0-qde7Owt6-n2kciN9-qghTs38KEdzNc_n7Bm-Ne2HM1GbxBzGTMGgaHtR_LD1weACUuo2_1jFmGMlVcXyzKDJabONz85MsQqCMinK4Uk Oct 26 13:02:42.579568 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:02:42.579568 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:02:42.579568 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:02:42.579568 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:02:42.579568 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:02:42.579568 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:02:42.579568 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 5ca406a2b27e4b838ab039466e2c8588 Oct 26 13:02:42.579568 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1101699066 Oct 26 13:02:42.579568 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:02:42.579568 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:02:42.580642 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5ca406a2b27e4b838ab039466e2c8588"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5ca406a2b27e4b838ab039466e2c8588"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5ca406a2b27e4b838ab039466e2c8588"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5ca406a2b27e4b838ab039466e2c8588"}]}] Oct 26 13:02:42.580642 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1101699066 Oct 26 13:02:42.580642 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 5ca406a2b27e4b838ab039466e2c8588 Oct 26 13:02:42.580642 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1101699066 Oct 26 13:02:42.580642 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-AggregatesAdminNegativeTestJSON-1101699066-project Oct 26 13:02:42.580642 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:02:42.580642 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:02:42.580642 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: c55cf0dfb51746b9bda068c3536498e2 Oct 26 13:02:42.580642 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1101699066-project Oct 26 13:02:42.580642 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:02:42.580642 n-d-862686-1 devstack@n-api.service[120597]: {"aggregate": {"name": "tempest-test_aggregate-1271538663"}} Oct 26 13:02:42.580642 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:02:42.580642 n-d-862686-1 devstack@n-api.service[120597]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 26 13:02:42.581302 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1271538663'}}} Oct 26 13:02:42.581302 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:02:42.581302 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:42.581302 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:42.581302 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:42.581302 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:02:42.581302 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:02:42.581302 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:02:42.581302 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:02:42.581302 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:02:42.581302 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:02:42.581302 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:02:42.581302 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:02:42.581302 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 26 13:02:42.581302 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 26 13:02:42.581302 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 13:02:42.581302 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 13:02:42.581302 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 13:02:42.581302 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 13:02:42.582257 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 13:02:42.582257 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 13:02:42.582257 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 13:02:42.582257 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 13:02:42.582257 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 13:02:42.582257 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 13:02:42.582257 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 13:02:42.582257 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 13:02:42.582257 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 13:02:42.582257 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 13:02:42.582257 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 26 13:02:42.582257 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:42.582257 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:42.582257 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:42.582257 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:42.582257 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:42.582257 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:42.582257 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 13:02:42.582257 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 13:02:42.582257 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 26 13:02:42.583243 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:42.584703 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-45d182b6-6061-43ac-aa10-20aa40128d5a tempest-AggregatesAdminNegativeTestJSON-1101699066 tempest-AggregatesAdminNegativeTestJSON-1101699066-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:02:42.585836 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-45d182b6-6061-43ac-aa10-20aa40128d5a tempest-AggregatesAdminNegativeTestJSON-1101699066 tempest-AggregatesAdminNegativeTestJSON-1101699066-project] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.018540 Oct 26 13:02:42.591495 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 33/67] 10.222.0.40 () {60 vars in 1164 bytes} [Wed Oct 26 13:02:42 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 26 13:02:42.596568 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-019a9759-f270-4003-9e85-02a4e9b917ec tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-902510633"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:42.604324 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.aggregate [None req-019a9759-f270-4003-9e85-02a4e9b917ec tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Generated uuid b713a5bc-af96-4bab-8b39-a694ebb89869 for aggregate {{(pid=120597) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 26 13:02:42.628341 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-019a9759-f270-4003-9e85-02a4e9b917ec tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.035481 Oct 26 13:02:42.629287 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 34/68] 10.222.0.40 () {60 vars in 1164 bytes} [Wed Oct 26 13:02:42 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:02:42.643545 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5ffb27cd-6804-466f-b719-537dbbc6d646 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-902510633"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:42.648519 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.aggregate [None req-5ffb27cd-6804-466f-b719-537dbbc6d646 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Generated uuid ab5bdcd7-f53b-4e41-bcb0-50ec1034066f for aggregate {{(pid=120597) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 26 13:02:42.659599 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-5ffb27cd-6804-466f-b719-537dbbc6d646 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-902510633 already exists. Oct 26 13:02:42.662152 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5ffb27cd-6804-466f-b719-537dbbc6d646 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Request method failure captured: Oct 26 13:02:42.662152 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 26 13:02:42.662152 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:02:42.662152 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:02:42.662152 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:02:42.662152 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 59 Oct 26 13:02:42.662152 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:02:42.662152 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:02:42.662152 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:02:42.662152 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:02:42.662152 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWS_sfFRcMzjEYCQSXneDm5toGZqZB16WOH-Qo-4Bz_te2no6v1TsESTknsuuI11u4x_4c5NiHEEusXv1wJkBD8bTSxEE6bBphxZSEWFwa4Nvl0KEZhzS3PnReyi2f2CzNz2Pl85lqWxrTQ5TVaKv5_KO-GQon2hwsILTZXHj2hYN2Gg Oct 26 13:02:42.662152 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:02:42.662152 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:02:42.662152 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:02:42.662152 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:02:42.662152 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:02:42.662152 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:02:42.662152 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 6e3d346ad1fa46fb955330afa42acf9f Oct 26 13:02:42.662152 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-710602825 Oct 26 13:02:42.662152 n-d-862686-1 devstack@n-api.service[120597]: X-Role: admin,member,reader Oct 26 13:02:42.662152 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: admin,member,reader Oct 26 13:02:42.663257 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6e3d346ad1fa46fb955330afa42acf9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6e3d346ad1fa46fb955330afa42acf9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6e3d346ad1fa46fb955330afa42acf9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6e3d346ad1fa46fb955330afa42acf9f"}]}] Oct 26 13:02:42.663257 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-710602825 Oct 26 13:02:42.663257 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 6e3d346ad1fa46fb955330afa42acf9f Oct 26 13:02:42.663257 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-710602825 Oct 26 13:02:42.663257 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin Oct 26 13:02:42.663257 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:02:42.663257 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:02:42.663257 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: e106beb4f1bd44acbbd3a88dddef9303 Oct 26 13:02:42.663257 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin Oct 26 13:02:42.663257 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:02:42.663257 n-d-862686-1 devstack@n-api.service[120597]: {"aggregate": {"name": "tempest-test_aggregate-902510633"}} Oct 26 13:02:42.663257 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:02:42.663257 n-d-862686-1 devstack@n-api.service[120597]: exception: Aggregate tempest-test_aggregate-902510633 already exists. Oct 26 13:02:42.663930 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-902510633'}}} Oct 26 13:02:42.663930 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:02:42.663930 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:42.663930 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 26 13:02:42.663930 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 26 13:02:42.663930 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 26 13:02:42.663930 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 26 13:02:42.663930 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 13:02:42.663930 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 13:02:42.663930 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 13:02:42.663930 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 13:02:42.663930 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 26 13:02:42.663930 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 26 13:02:42.663930 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 26 13:02:42.663930 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 26 13:02:42.663930 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 26 13:02:42.663930 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 26 13:02:42.663930 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 26 13:02:42.663930 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 26 13:02:42.664950 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 13:02:42.664950 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 13:02:42.664950 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 26 13:02:42.664950 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 26 13:02:42.664950 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-902510633 already exists. Oct 26 13:02:42.664950 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:42.664950 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:42.664950 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:42.664950 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:42.664950 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:42.664950 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:42.664950 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:02:42.664950 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:02:42.664950 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:02:42.664950 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:02:42.664950 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:02:42.664950 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:02:42.664950 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:02:42.664950 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:02:42.664950 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 26 13:02:42.666015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 26 13:02:42.666015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-902510633 already exists. Oct 26 13:02:42.666015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:42.666015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:42.666015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:42.666015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:42.666015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:42.666015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:42.666015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:02:42.666015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:02:42.666015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-902510633 already exists. Oct 26 13:02:42.666015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:42.668378 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5ffb27cd-6804-466f-b719-537dbbc6d646 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-902510633 already exists. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:02:42.669231 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5ffb27cd-6804-466f-b719-537dbbc6d646 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.031456 Oct 26 13:02:42.673020 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 35/69] 10.222.0.40 () {60 vars in 1164 bytes} [Wed Oct 26 13:02:42 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 33 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:02:42.679449 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8cec8644-60a7-40a5-8192-2f42e684e53a tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:42.704350 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8cec8644-60a7-40a5-8192-2f42e684e53a tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.030057 Oct 26 13:02:42.704934 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 36/70] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 26 13:02:42 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 26 13:02:42.716685 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c0e51fdd-df59-4bca-a9f2-66506665328b tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-512317798"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:42.720781 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.aggregate [None req-c0e51fdd-df59-4bca-a9f2-66506665328b tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Generated uuid fec5194d-9c00-42d6-857c-a1abbb40e07b for aggregate {{(pid=120597) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 26 13:02:42.750204 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c0e51fdd-df59-4bca-a9f2-66506665328b tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.038316 Oct 26 13:02:42.753326 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 37/71] 10.222.0.40 () {60 vars in 1164 bytes} [Wed Oct 26 13:02:42 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:02:42.763921 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7eb06336-ac30-45f1-875b-e2f824c0e26f tempest-AggregatesAdminNegativeTestJSON-1101699066 tempest-AggregatesAdminNegativeTestJSON-1101699066-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:42.765411 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7eb06336-ac30-45f1-875b-e2f824c0e26f tempest-AggregatesAdminNegativeTestJSON-1101699066 tempest-AggregatesAdminNegativeTestJSON-1101699066-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'c55cf0dfb51746b9bda068c3536498e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca406a2b27e4b838ab039466e2c8588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:02:42.766965 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7eb06336-ac30-45f1-875b-e2f824c0e26f tempest-AggregatesAdminNegativeTestJSON-1101699066 tempest-AggregatesAdminNegativeTestJSON-1101699066-project] Request method failure captured: Oct 26 13:02:42.766965 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 26 13:02:42.766965 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:02:42.766965 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:02:42.766965 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:02:42.766965 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:02:42.766965 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:02:42.766965 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:02:42.766965 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:02:42.766965 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:02:42.766965 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWS_q5eJmOK4ObBzLIlJBKV6OCfiIV-QcmIR657jRoGCyQAl3QGmOC9CHBOCGDaiAoz-GgK0-qde7Owt6-n2kciN9-qghTs38KEdzNc_n7Bm-Ne2HM1GbxBzGTMGgaHtR_LD1weACUuo2_1jFmGMlVcXyzKDJabONz85MsQqCMinK4Uk Oct 26 13:02:42.766965 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:02:42.766965 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:02:42.766965 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:02:42.766965 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:02:42.766965 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:02:42.766965 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:02:42.766965 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 5ca406a2b27e4b838ab039466e2c8588 Oct 26 13:02:42.766965 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1101699066 Oct 26 13:02:42.766965 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:02:42.766965 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:02:42.768085 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5ca406a2b27e4b838ab039466e2c8588"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5ca406a2b27e4b838ab039466e2c8588"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5ca406a2b27e4b838ab039466e2c8588"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5ca406a2b27e4b838ab039466e2c8588"}]}] Oct 26 13:02:42.768085 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1101699066 Oct 26 13:02:42.768085 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 5ca406a2b27e4b838ab039466e2c8588 Oct 26 13:02:42.768085 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1101699066 Oct 26 13:02:42.768085 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-AggregatesAdminNegativeTestJSON-1101699066-project Oct 26 13:02:42.768085 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:02:42.768085 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:02:42.768085 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: c55cf0dfb51746b9bda068c3536498e2 Oct 26 13:02:42.768085 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1101699066-project Oct 26 13:02:42.768085 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:02:42.768085 n-d-862686-1 devstack@n-api.service[120597]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 26 13:02:42.768085 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '7'} Oct 26 13:02:42.768700 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:02:42.768700 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:42.768700 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:42.768700 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:42.768700 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:02:42.768700 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:02:42.768700 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:02:42.768700 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:02:42.768700 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 26 13:02:42.768700 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 26 13:02:42.768700 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 13:02:42.768700 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 13:02:42.768700 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 13:02:42.768700 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 13:02:42.768700 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 13:02:42.768700 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 13:02:42.768700 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 13:02:42.768700 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 13:02:42.768700 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 13:02:42.769694 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 13:02:42.769694 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 13:02:42.769694 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 13:02:42.769694 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 13:02:42.769694 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 13:02:42.769694 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 26 13:02:42.769694 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:42.769694 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:42.769694 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:42.769694 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:42.769694 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:42.769694 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:42.769694 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 13:02:42.769694 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 13:02:42.769694 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 26 13:02:42.769694 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:42.769694 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7eb06336-ac30-45f1-875b-e2f824c0e26f tempest-AggregatesAdminNegativeTestJSON-1101699066 tempest-AggregatesAdminNegativeTestJSON-1101699066-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:02:42.770645 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7eb06336-ac30-45f1-875b-e2f824c0e26f tempest-AggregatesAdminNegativeTestJSON-1101699066 tempest-AggregatesAdminNegativeTestJSON-1101699066-project] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/7" status: 403 len: 116 microversion: 2.1 time: 0.008860 Oct 26 13:02:42.770645 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 38/72] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 26 13:02:42 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 116 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 26 13:02:42.783274 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-de5cc551-ee1f-4377-a787-07d5cd6c6648 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:42.828796 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-de5cc551-ee1f-4377-a787-07d5cd6c6648 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.051043 Oct 26 13:02:42.829639 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 39/73] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 26 13:02:42 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 26 13:02:42.841087 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2427c210-927a-485f-ad00-a13cf3734ccc tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:42.855295 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-2427c210-927a-485f-ad00-a13cf3734ccc tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 26 13:02:42.857404 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2427c210-927a-485f-ad00-a13cf3734ccc tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Request method failure captured: Oct 26 13:02:42.857404 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 26 13:02:42.857404 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:02:42.857404 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:02:42.857404 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:02:42.857404 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:02:42.857404 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:02:42.857404 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:02:42.857404 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:02:42.857404 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:02:42.857404 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWS_sfFRcMzjEYCQSXneDm5toGZqZB16WOH-Qo-4Bz_te2no6v1TsESTknsuuI11u4x_4c5NiHEEusXv1wJkBD8bTSxEE6bBphxZSEWFwa4Nvl0KEZhzS3PnReyi2f2CzNz2Pl85lqWxrTQ5TVaKv5_KO-GQon2hwsILTZXHj2hYN2Gg Oct 26 13:02:42.857404 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:02:42.857404 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:02:42.857404 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:02:42.857404 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:02:42.857404 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:02:42.857404 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:02:42.857404 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 6e3d346ad1fa46fb955330afa42acf9f Oct 26 13:02:42.857404 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-710602825 Oct 26 13:02:42.857404 n-d-862686-1 devstack@n-api.service[120597]: X-Role: admin,member,reader Oct 26 13:02:42.857404 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: admin,member,reader Oct 26 13:02:42.858545 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6e3d346ad1fa46fb955330afa42acf9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6e3d346ad1fa46fb955330afa42acf9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6e3d346ad1fa46fb955330afa42acf9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6e3d346ad1fa46fb955330afa42acf9f"}]}] Oct 26 13:02:42.858545 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-710602825 Oct 26 13:02:42.858545 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 6e3d346ad1fa46fb955330afa42acf9f Oct 26 13:02:42.858545 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-710602825 Oct 26 13:02:42.858545 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin Oct 26 13:02:42.858545 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:02:42.858545 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:02:42.858545 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: e106beb4f1bd44acbbd3a88dddef9303 Oct 26 13:02:42.858545 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin Oct 26 13:02:42.858545 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:02:42.858545 n-d-862686-1 devstack@n-api.service[120597]: exception: Aggregate -1 could not be found. Oct 26 13:02:42.858545 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '-1'} Oct 26 13:02:42.859180 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:02:42.859180 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:42.859180 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 26 13:02:42.859180 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 26 13:02:42.859180 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 26 13:02:42.859180 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 26 13:02:42.859180 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 13:02:42.859180 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 13:02:42.859180 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 13:02:42.859180 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 13:02:42.859180 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 26 13:02:42.859180 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 26 13:02:42.859180 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 26 13:02:42.859180 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 26 13:02:42.859180 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 13:02:42.859180 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 13:02:42.859180 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 26 13:02:42.859180 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 26 13:02:42.859180 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 13:02:42.860110 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 13:02:42.860110 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 26 13:02:42.860110 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 26 13:02:42.860110 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 26 13:02:42.860110 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:42.860110 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:42.860110 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:42.860110 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:42.860110 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:42.860110 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:42.860110 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:02:42.860110 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:02:42.860110 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:02:42.860110 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:02:42.860110 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 26 13:02:42.860110 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:02:42.860110 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 26 13:02:42.860110 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:42.860110 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:42.860110 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:42.860110 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:42.861123 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:42.861123 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:42.861123 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:02:42.861123 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:02:42.861123 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 26 13:02:42.861123 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:42.862334 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2427c210-927a-485f-ad00-a13cf3734ccc tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:02:42.863161 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2427c210-927a-485f-ad00-a13cf3734ccc tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.027993 Oct 26 13:02:42.863739 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 40/74] 10.222.0.40 () {58 vars in 1155 bytes} [Wed Oct 26 13:02:42 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:02:42.882663 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-62c93dc8-9e91-48e6-8c06-33106b69db18 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1967537186"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:42.888673 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.aggregate [None req-62c93dc8-9e91-48e6-8c06-33106b69db18 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Generated uuid 601880c3-ab3d-45e3-87a5-d9639b761fc0 for aggregate {{(pid=120597) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 26 13:02:42.924286 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-62c93dc8-9e91-48e6-8c06-33106b69db18 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.054875 Oct 26 13:02:42.925727 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 41/75] 10.222.0.40 () {60 vars in 1164 bytes} [Wed Oct 26 13:02:42 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:02:42.938674 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-602754a1-12ea-4bf3-a241-98d45e789eab tempest-AggregatesAdminNegativeTestJSON-1101699066 tempest-AggregatesAdminNegativeTestJSON-1101699066-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:42.941836 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-602754a1-12ea-4bf3-a241-98d45e789eab tempest-AggregatesAdminNegativeTestJSON-1101699066 tempest-AggregatesAdminNegativeTestJSON-1101699066-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'c55cf0dfb51746b9bda068c3536498e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca406a2b27e4b838ab039466e2c8588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:02:42.943733 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-602754a1-12ea-4bf3-a241-98d45e789eab tempest-AggregatesAdminNegativeTestJSON-1101699066 tempest-AggregatesAdminNegativeTestJSON-1101699066-project] Request method failure captured: Oct 26 13:02:42.943733 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Oct 26 13:02:42.943733 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:02:42.943733 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:02:42.943733 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:02:42.943733 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:02:42.943733 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:02:42.943733 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:02:42.943733 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:02:42.943733 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:02:42.943733 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWS_q5eJmOK4ObBzLIlJBKV6OCfiIV-QcmIR657jRoGCyQAl3QGmOC9CHBOCGDaiAoz-GgK0-qde7Owt6-n2kciN9-qghTs38KEdzNc_n7Bm-Ne2HM1GbxBzGTMGgaHtR_LD1weACUuo2_1jFmGMlVcXyzKDJabONz85MsQqCMinK4Uk Oct 26 13:02:42.943733 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:02:42.943733 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:02:42.943733 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:02:42.943733 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:02:42.943733 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:02:42.943733 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:02:42.943733 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 5ca406a2b27e4b838ab039466e2c8588 Oct 26 13:02:42.943733 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1101699066 Oct 26 13:02:42.943733 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:02:42.943733 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:02:42.944956 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5ca406a2b27e4b838ab039466e2c8588"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5ca406a2b27e4b838ab039466e2c8588"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5ca406a2b27e4b838ab039466e2c8588"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5ca406a2b27e4b838ab039466e2c8588"}]}] Oct 26 13:02:42.944956 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1101699066 Oct 26 13:02:42.944956 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 5ca406a2b27e4b838ab039466e2c8588 Oct 26 13:02:42.944956 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1101699066 Oct 26 13:02:42.944956 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-AggregatesAdminNegativeTestJSON-1101699066-project Oct 26 13:02:42.944956 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:02:42.944956 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:02:42.944956 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: c55cf0dfb51746b9bda068c3536498e2 Oct 26 13:02:42.944956 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1101699066-project Oct 26 13:02:42.944956 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:02:42.944956 n-d-862686-1 devstack@n-api.service[120597]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 26 13:02:42.944956 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '8'} Oct 26 13:02:42.945754 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:02:42.945754 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:42.945754 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:42.945754 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:42.945754 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:02:42.945754 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:02:42.945754 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:02:42.945754 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:02:42.945754 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 26 13:02:42.945754 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 26 13:02:42.945754 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 13:02:42.945754 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 13:02:42.945754 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 13:02:42.945754 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 13:02:42.945754 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 13:02:42.945754 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 13:02:42.945754 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 13:02:42.945754 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 13:02:42.945754 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 13:02:42.946664 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 13:02:42.946664 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 13:02:42.946664 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 13:02:42.946664 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 13:02:42.946664 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 13:02:42.946664 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 26 13:02:42.946664 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:42.946664 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:42.946664 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:42.946664 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:42.946664 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:42.946664 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:42.946664 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 13:02:42.946664 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 13:02:42.946664 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 26 13:02:42.946664 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:42.946664 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-602754a1-12ea-4bf3-a241-98d45e789eab tempest-AggregatesAdminNegativeTestJSON-1101699066 tempest-AggregatesAdminNegativeTestJSON-1101699066-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:02:42.947816 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-602754a1-12ea-4bf3-a241-98d45e789eab tempest-AggregatesAdminNegativeTestJSON-1101699066 tempest-AggregatesAdminNegativeTestJSON-1101699066-project] 10.222.0.40 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.013135 Oct 26 13:02:42.948880 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 42/76] 10.222.0.40 () {58 vars in 1149 bytes} [Wed Oct 26 13:02:42 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:02:42.957064 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-db7e69c6-d70f-4724-a9c2-93a313eeb561 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:42.987685 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-db7e69c6-d70f-4724-a9c2-93a313eeb561 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.034545 Oct 26 13:02:42.988609 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 43/77] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 26 13:02:42 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 26 13:02:42.998865 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-58369906-8e38-49fa-b6c2-de3e2e971e81 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:43.007113 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-58369906-8e38-49fa-b6c2-de3e2e971e81 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 26 13:02:43.008657 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-58369906-8e38-49fa-b6c2-de3e2e971e81 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Request method failure captured: Oct 26 13:02:43.008657 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 26 13:02:43.008657 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:02:43.008657 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:02:43.008657 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:02:43.008657 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:02:43.008657 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:02:43.008657 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:02:43.008657 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:02:43.008657 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:02:43.008657 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWS_sfFRcMzjEYCQSXneDm5toGZqZB16WOH-Qo-4Bz_te2no6v1TsESTknsuuI11u4x_4c5NiHEEusXv1wJkBD8bTSxEE6bBphxZSEWFwa4Nvl0KEZhzS3PnReyi2f2CzNz2Pl85lqWxrTQ5TVaKv5_KO-GQon2hwsILTZXHj2hYN2Gg Oct 26 13:02:43.008657 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:02:43.008657 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:02:43.008657 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:02:43.008657 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:02:43.008657 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:02:43.008657 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:02:43.008657 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 6e3d346ad1fa46fb955330afa42acf9f Oct 26 13:02:43.008657 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-710602825 Oct 26 13:02:43.008657 n-d-862686-1 devstack@n-api.service[120597]: X-Role: admin,member,reader Oct 26 13:02:43.008657 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: admin,member,reader Oct 26 13:02:43.009952 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6e3d346ad1fa46fb955330afa42acf9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6e3d346ad1fa46fb955330afa42acf9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6e3d346ad1fa46fb955330afa42acf9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6e3d346ad1fa46fb955330afa42acf9f"}]}] Oct 26 13:02:43.009952 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-710602825 Oct 26 13:02:43.009952 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 6e3d346ad1fa46fb955330afa42acf9f Oct 26 13:02:43.009952 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-710602825 Oct 26 13:02:43.009952 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin Oct 26 13:02:43.009952 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:02:43.009952 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:02:43.009952 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: e106beb4f1bd44acbbd3a88dddef9303 Oct 26 13:02:43.009952 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin Oct 26 13:02:43.009952 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:02:43.009952 n-d-862686-1 devstack@n-api.service[120597]: exception: Aggregate -1 could not be found. Oct 26 13:02:43.009952 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '-1'} Oct 26 13:02:43.010801 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:02:43.010801 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:43.010801 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 26 13:02:43.010801 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 26 13:02:43.010801 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 26 13:02:43.010801 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 26 13:02:43.010801 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 13:02:43.010801 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 13:02:43.010801 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 26 13:02:43.010801 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 26 13:02:43.010801 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 13:02:43.010801 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 13:02:43.010801 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 26 13:02:43.010801 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 26 13:02:43.010801 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 26 13:02:43.010801 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:43.010801 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:43.010801 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:43.010801 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:43.010801 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:43.012043 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:43.012043 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:02:43.012043 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:02:43.012043 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:02:43.012043 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:02:43.012043 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 26 13:02:43.012043 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:02:43.012043 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 26 13:02:43.012043 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:43.012043 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:43.012043 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:43.012043 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:43.012043 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:43.012043 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:43.012043 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:02:43.012043 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:02:43.012043 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 26 13:02:43.012043 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:43.012976 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-58369906-8e38-49fa-b6c2-de3e2e971e81 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:02:43.012976 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-58369906-8e38-49fa-b6c2-de3e2e971e81 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.016422 Oct 26 13:02:43.012976 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 44/78] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 26 13:02:42 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 26 13:02:43.022848 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-37c11ca0-6386-49c4-9b05-2c9259997ca9 tempest-AggregatesAdminNegativeTestJSON-1101699066 tempest-AggregatesAdminNegativeTestJSON-1101699066-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:43.025217 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-37c11ca0-6386-49c4-9b05-2c9259997ca9 tempest-AggregatesAdminNegativeTestJSON-1101699066 tempest-AggregatesAdminNegativeTestJSON-1101699066-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'c55cf0dfb51746b9bda068c3536498e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca406a2b27e4b838ab039466e2c8588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:02:43.027425 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-37c11ca0-6386-49c4-9b05-2c9259997ca9 tempest-AggregatesAdminNegativeTestJSON-1101699066 tempest-AggregatesAdminNegativeTestJSON-1101699066-project] Request method failure captured: Oct 26 13:02:43.027425 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 26 13:02:43.027425 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:02:43.027425 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:02:43.027425 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:02:43.027425 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:02:43.027425 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:02:43.027425 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:02:43.027425 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:02:43.027425 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:02:43.027425 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWS_q5eJmOK4ObBzLIlJBKV6OCfiIV-QcmIR657jRoGCyQAl3QGmOC9CHBOCGDaiAoz-GgK0-qde7Owt6-n2kciN9-qghTs38KEdzNc_n7Bm-Ne2HM1GbxBzGTMGgaHtR_LD1weACUuo2_1jFmGMlVcXyzKDJabONz85MsQqCMinK4Uk Oct 26 13:02:43.027425 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:02:43.027425 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:02:43.027425 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:02:43.027425 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:02:43.027425 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:02:43.027425 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:02:43.027425 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 5ca406a2b27e4b838ab039466e2c8588 Oct 26 13:02:43.027425 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1101699066 Oct 26 13:02:43.027425 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:02:43.027425 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:02:43.028571 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5ca406a2b27e4b838ab039466e2c8588"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5ca406a2b27e4b838ab039466e2c8588"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5ca406a2b27e4b838ab039466e2c8588"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5ca406a2b27e4b838ab039466e2c8588"}]}] Oct 26 13:02:43.028571 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1101699066 Oct 26 13:02:43.028571 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 5ca406a2b27e4b838ab039466e2c8588 Oct 26 13:02:43.028571 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1101699066 Oct 26 13:02:43.028571 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-AggregatesAdminNegativeTestJSON-1101699066-project Oct 26 13:02:43.028571 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:02:43.028571 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:02:43.028571 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: c55cf0dfb51746b9bda068c3536498e2 Oct 26 13:02:43.028571 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1101699066-project Oct 26 13:02:43.028571 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:02:43.028571 n-d-862686-1 devstack@n-api.service[120597]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 26 13:02:43.028571 n-d-862686-1 devstack@n-api.service[120597]: action_args: {} Oct 26 13:02:43.029456 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:02:43.029456 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:43.029456 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:43.029456 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:43.029456 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:02:43.029456 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:02:43.029456 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:02:43.029456 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:02:43.029456 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 26 13:02:43.029456 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 26 13:02:43.029456 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 13:02:43.029456 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 13:02:43.029456 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 13:02:43.029456 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 13:02:43.029456 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 13:02:43.029456 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 13:02:43.029456 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 13:02:43.029456 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 13:02:43.029456 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 13:02:43.030562 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 13:02:43.030562 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 13:02:43.030562 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 13:02:43.030562 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 13:02:43.030562 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 13:02:43.030562 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 26 13:02:43.030562 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:43.030562 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:43.030562 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:43.030562 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:43.030562 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:43.030562 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:43.030562 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 13:02:43.030562 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 13:02:43.030562 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 26 13:02:43.030562 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:02:43.030562 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-37c11ca0-6386-49c4-9b05-2c9259997ca9 tempest-AggregatesAdminNegativeTestJSON-1101699066 tempest-AggregatesAdminNegativeTestJSON-1101699066-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:02:43.031533 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-37c11ca0-6386-49c4-9b05-2c9259997ca9 tempest-AggregatesAdminNegativeTestJSON-1101699066 tempest-AggregatesAdminNegativeTestJSON-1101699066-project] 10.222.0.40 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.011334 Oct 26 13:02:43.031533 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 45/79] 10.222.0.40 () {58 vars in 1143 bytes} [Wed Oct 26 13:02:43 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 26 13:02:43.256557 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-16b84158-65f5-4175-9511-ddba1fe72b3f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1951795011", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "availability_zone": "tempest-test_az-49435336"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:43.279350 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-16b84158-65f5-4175-9511-ddba1fe72b3f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:43.279957 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-16b84158-65f5-4175-9511-ddba1fe72b3f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:43.280622 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-16b84158-65f5-4175-9511-ddba1fe72b3f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:43.281369 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-16b84158-65f5-4175-9511-ddba1fe72b3f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:43.281856 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-16b84158-65f5-4175-9511-ddba1fe72b3f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:43.282284 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-16b84158-65f5-4175-9511-ddba1fe72b3f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:44.479122 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-16b84158-65f5-4175-9511-ddba1fe72b3f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] validate_networks() for None {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:02:44.763137 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-16b84158-65f5-4175-9511-ddba1fe72b3f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:02:44.764112 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-16b84158-65f5-4175-9511-ddba1fe72b3f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:02:44.764948 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-16b84158-65f5-4175-9511-ddba1fe72b3f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:02:44.765539 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-16b84158-65f5-4175-9511-ddba1fe72b3f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:02:44.766165 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-16b84158-65f5-4175-9511-ddba1fe72b3f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:02:44.783414 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-16b84158-65f5-4175-9511-ddba1fe72b3f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:44.784153 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-16b84158-65f5-4175-9511-ddba1fe72b3f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:44.784893 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-16b84158-65f5-4175-9511-ddba1fe72b3f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:44.785821 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-16b84158-65f5-4175-9511-ddba1fe72b3f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:44.786514 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-16b84158-65f5-4175-9511-ddba1fe72b3f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:44.787074 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-16b84158-65f5-4175-9511-ddba1fe72b3f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:44.824291 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-16b84158-65f5-4175-9511-ddba1fe72b3f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Getting quotas for project dc559afd836047ccbeba91fca9c0d527. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:02:44.836385 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-16b84158-65f5-4175-9511-ddba1fe72b3f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Getting quotas for user 1db8f8e223a145abbe4a20edb9ce60d4 and project dc559afd836047ccbeba91fca9c0d527. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:02:44.850364 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-16b84158-65f5-4175-9511-ddba1fe72b3f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:02:44.853698 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-16b84158-65f5-4175-9511-ddba1fe72b3f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] [instance: 5984db52-3d30-4265-af13-6d9c16b63159] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:02:44.940197 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-16b84158-65f5-4175-9511-ddba1fe72b3f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.374245 Oct 26 13:02:44.940826 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 35/80] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:02:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2376 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:02:44.953224 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-24c6fee4-80b5-4c76-9480-810736ed71dc tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:44.953872 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-24c6fee4-80b5-4c76-9480-810736ed71dc tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] [instance: 5984db52-3d30-4265-af13-6d9c16b63159] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:02:45.112693 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0ba5eb17-aa9d-4135-a09b-fefe2c240b0d tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-446493944", "id": 1720237417, "os-flavor-access:is_public": "True"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:45.118929 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-24c6fee4-80b5-4c76-9480-810736ed71dc tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db8f8e223a145abbe4a20edb9ce60d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc559afd836047ccbeba91fca9c0d527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:02:45.138738 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0ba5eb17-aa9d-4135-a09b-fefe2c240b0d tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.305804 Oct 26 13:02:45.139733 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 46/81] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:02:44 2022] POST /compute/v2.1/flavors => generated 429 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:02:45.140318 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-24c6fee4-80b5-4c76-9480-810736ed71dc tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] 10.222.0.40 "GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159" status: 200 len: 1241 microversion: 2.1 time: 0.191054 Oct 26 13:02:45.140890 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 36/82] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:02:44 2022] GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159 => generated 1241 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:02:45.162306 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-65184921-f641-4076-938b-c51bc2e225a4 tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:45.183556 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-65184921-f641-4076-938b-c51bc2e225a4 tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1720237417" status: 202 len: 0 microversion: 2.1 time: 0.031830 Oct 26 13:02:45.189026 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 47/83] 10.222.0.40 () {58 vars in 1161 bytes} [Wed Oct 26 13:02:45 2022] DELETE /compute/v2.1/flavors/1720237417 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:02:45.193807 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a54ed813-7b43-4d79-ba49-f0cee9e952df tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:45.218026 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a54ed813-7b43-4d79-ba49-f0cee9e952df tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028723 Oct 26 13:02:45.219145 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 37/84] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:02:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:02:45.239153 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1157ec41-33d4-452d-bd15-5e36b53a71ed tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1999774652", "id": 78178640, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:45.262911 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1157ec41-33d4-452d-bd15-5e36b53a71ed tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.027060 Oct 26 13:02:45.263936 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 48/85] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:02:45 2022] POST /compute/v2.1/flavors => generated 411 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:02:45.276474 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f14847b4-a053-45a3-b4e7-447783e604c3 tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:45.301821 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f14847b4-a053-45a3-b4e7-447783e604c3 tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.029882 Oct 26 13:02:45.302467 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 38/86] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:02:45 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:02:45.320860 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-37d76a0b-a865-4a95-a4cb-e24e1333c776 tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:45.342761 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-37d76a0b-a865-4a95-a4cb-e24e1333c776 tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/78178640" status: 202 len: 0 microversion: 2.1 time: 0.025373 Oct 26 13:02:45.343559 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 49/87] 10.222.0.40 () {58 vars in 1155 bytes} [Wed Oct 26 13:02:45 2022] DELETE /compute/v2.1/flavors/78178640 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:02:45.355136 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d54999b7-2bb9-4700-81da-e33c01c3e250 tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:45.378080 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d54999b7-2bb9-4700-81da-e33c01c3e250 tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029699 Oct 26 13:02:45.378655 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 39/88] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:02:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:02:45.399833 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f04b50aa-54de-44f0-9594-3f4d046d9ffc tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1940255739", "id": 1380408874, "os-flavor-access:is_public": "True"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:45.425365 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f04b50aa-54de-44f0-9594-3f4d046d9ffc tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.030282 Oct 26 13:02:45.426190 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 50/89] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:02:45 2022] POST /compute/v2.1/flavors => generated 429 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:02:45.438962 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-18ad3b1e-ef7c-4876-a6c3-6a5ab4d5ea8e tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:45.464131 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-18ad3b1e-ef7c-4876-a6c3-6a5ab4d5ea8e tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1380408874" status: 202 len: 0 microversion: 2.1 time: 0.027940 Oct 26 13:02:45.465915 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 40/90] 10.222.0.40 () {58 vars in 1161 bytes} [Wed Oct 26 13:02:45 2022] DELETE /compute/v2.1/flavors/1380408874 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:02:45.474910 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e7512834-df80-4ab8-a4c2-2d4bbcea1b15 tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:45.509250 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e7512834-df80-4ab8-a4c2-2d4bbcea1b15 tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038849 Oct 26 13:02:45.510538 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 51/91] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:02:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:02:45.532755 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-28cc201b-5e1c-42a0-9143-f7d4d8c7b4a5 tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-621567488", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:45.565652 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-28cc201b-5e1c-42a0-9143-f7d4d8c7b4a5 tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.037682 Oct 26 13:02:45.574291 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 41/92] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:02:45 2022] POST /compute/v2.1/flavors => generated 506 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:02:45.578716 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-065ea678-99d5-446b-9014-4728ea7ab7a2 tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:45.606367 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-065ea678-99d5-446b-9014-4728ea7ab7a2 tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/a70b27d2-848a-4edc-a706-a9b7c9f93e83" status: 202 len: 0 microversion: 2.1 time: 0.031243 Oct 26 13:02:45.607459 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 52/93] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:02:45 2022] DELETE /compute/v2.1/flavors/a70b27d2-848a-4edc-a706-a9b7c9f93e83 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 13:02:45.616131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6975b650-cc83-4d47-8311-153b9d270cd5 tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:45.661711 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6975b650-cc83-4d47-8311-153b9d270cd5 tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046973 Oct 26 13:02:45.662969 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 42/94] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:02:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:02:45.682787 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-61629dfb-561b-49ad-a953-3beb75395234 tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1403027468", "id": "df3cc011-5d5f-42b5-af7d-39cd5a7207d6", "os-flavor-access:is_public": "True"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:45.713788 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-61629dfb-561b-49ad-a953-3beb75395234 tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.033370 Oct 26 13:02:45.721296 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 53/95] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:02:45 2022] POST /compute/v2.1/flavors => generated 507 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:02:45.727907 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-53d03cf9-41d0-49d6-aaea-94f398e172db tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:45.765956 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-53d03cf9-41d0-49d6-aaea-94f398e172db tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/df3cc011-5d5f-42b5-af7d-39cd5a7207d6" status: 202 len: 0 microversion: 2.1 time: 0.039887 Oct 26 13:02:45.769563 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 43/96] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:02:45 2022] DELETE /compute/v2.1/flavors/df3cc011-5d5f-42b5-af7d-39cd5a7207d6 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:02:45.777370 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b4b15452-4715-4f16-8380-1ae3dc1a0de4 tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:45.826775 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b4b15452-4715-4f16-8380-1ae3dc1a0de4 tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.055382 Oct 26 13:02:45.831390 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 54/97] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:02:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:02:45.856952 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-39c7e802-a12d-453e-b63d-e1ba44a712bd tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1001966365", "id": 663727141, "os-flavor-access:is_public": "True"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:45.902579 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-39c7e802-a12d-453e-b63d-e1ba44a712bd tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.050272 Oct 26 13:02:45.908656 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 44/98] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:02:45 2022] POST /compute/v2.1/flavors => generated 411 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:02:45.920611 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a4ae5836-abc9-4bcc-804e-5beeb4e8a2cf tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:45.928411 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a4ae5836-abc9-4bcc-804e-5beeb4e8a2cf tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/663727141" status: 200 len: 411 microversion: 2.1 time: 0.012347 Oct 26 13:02:45.928967 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 55/99] 10.222.0.40 () {58 vars in 1155 bytes} [Wed Oct 26 13:02:45 2022] GET /compute/v2.1/flavors/663727141 => generated 411 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:02:46.164906 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-70609fbb-537f-483c-8d2d-77aa1acce832 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:46.165677 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-70609fbb-537f-483c-8d2d-77aa1acce832 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] [instance: 5984db52-3d30-4265-af13-6d9c16b63159] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:02:46.321583 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4b219f85-5fd4-43c3-aa81-62d3d53cf16c tempest-FlavorsAdminTestJSON-823578608 tempest-FlavorsAdminTestJSON-823578608-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:46.362923 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4b219f85-5fd4-43c3-aa81-62d3d53cf16c tempest-FlavorsAdminTestJSON-823578608 tempest-FlavorsAdminTestJSON-823578608-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.423132 Oct 26 13:02:46.378476 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 45/100] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:02:45 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:02:46.383800 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-57a9a9b9-9eba-4bf6-8c56-177d4c75b184 tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:46.407459 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-57a9a9b9-9eba-4bf6-8c56-177d4c75b184 tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/663727141" status: 202 len: 0 microversion: 2.1 time: 0.027561 Oct 26 13:02:46.408166 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 46/101] 10.222.0.40 () {58 vars in 1158 bytes} [Wed Oct 26 13:02:46 2022] DELETE /compute/v2.1/flavors/663727141 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:02:46.417468 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-830e5614-1716-458e-98ef-c1b1850f765e tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:46.446864 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-830e5614-1716-458e-98ef-c1b1850f765e tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030043 Oct 26 13:02:46.448592 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 47/102] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:02:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:02:46.469801 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5148967e-c670-4aaf-8a30-d1bf7196e0af tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1000921789", "id": 222093283, "os-flavor-access:is_public": "False"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:46.492926 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5148967e-c670-4aaf-8a30-d1bf7196e0af tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.027937 Oct 26 13:02:46.494684 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 48/103] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:02:46 2022] POST /compute/v2.1/flavors => generated 427 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:02:46.515251 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1cd58f23-db63-4980-a139-11126ce0f4f6 tempest-FlavorsAdminTestJSON-823578608 tempest-FlavorsAdminTestJSON-823578608-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "222093283"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:46.537118 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-1cd58f23-db63-4980-a139-11126ce0f4f6 tempest-FlavorsAdminTestJSON-823578608 tempest-FlavorsAdminTestJSON-823578608-project] HTTP exception thrown: Flavor 222093283 could not be found. Oct 26 13:02:46.554148 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1cd58f23-db63-4980-a139-11126ce0f4f6 tempest-FlavorsAdminTestJSON-823578608 tempest-FlavorsAdminTestJSON-823578608-project] Request method failure captured: Oct 26 13:02:46.554148 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 13:02:46.554148 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:02:46.554148 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:02:46.554148 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:02:46.554148 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 106 Oct 26 13:02:46.554148 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:02:46.554148 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:02:46.554148 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:02:46.554148 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:02:46.554148 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWS_yJcu7hrEs1hQ44XoUXcQot471XeVt8I7l7Rbn08U0kUvxeQdzqsZ_bVzR3DrD7ABY1kgfXjJr7eNeKG1Swk111Ezp454Mly6pho4hvUOTy1yTO6zzPQ2WrXmmLDYauomn7Ho-LOaTKgzrb9JLgQvky-KfqJ2JPWThG559Izj5kN0 Oct 26 13:02:46.554148 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:02:46.554148 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:02:46.554148 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:02:46.554148 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:02:46.554148 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:02:46.554148 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:02:46.554148 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 9b16a06a777a468e84a0f2ea23230c0f Oct 26 13:02:46.554148 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-FlavorsAdminTestJSON-823578608 Oct 26 13:02:46.554148 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:02:46.554148 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:02:46.555541 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9b16a06a777a468e84a0f2ea23230c0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9b16a06a777a468e84a0f2ea23230c0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9b16a06a777a468e84a0f2ea23230c0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9b16a06a777a468e84a0f2ea23230c0f"}]}] Oct 26 13:02:46.555541 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-FlavorsAdminTestJSON-823578608 Oct 26 13:02:46.555541 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 9b16a06a777a468e84a0f2ea23230c0f Oct 26 13:02:46.555541 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-823578608 Oct 26 13:02:46.555541 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-FlavorsAdminTestJSON-823578608-project Oct 26 13:02:46.555541 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:02:46.555541 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:02:46.555541 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: e41414c8425a4ebd879f056c23c055c8 Oct 26 13:02:46.555541 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-FlavorsAdminTestJSON-823578608-project Oct 26 13:02:46.555541 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:02:46.555541 n-d-862686-1 devstack@n-api.service[120598]: {"server": {"name": "test", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "222093283"}} Oct 26 13:02:46.555541 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:02:46.555541 n-d-862686-1 devstack@n-api.service[120598]: exception: Flavor 222093283 could not be found. Oct 26 13:02:46.556359 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '762c20f4-0f9b-45cb-bd95-cf21a747b33b', 'flavorRef': '222093283'}}} Oct 26 13:02:46.556359 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:02:46.556359 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:46.556359 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 26 13:02:46.556359 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 26 13:02:46.556359 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 26 13:02:46.556359 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 26 13:02:46.556359 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 13:02:46.556359 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 13:02:46.556359 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 26 13:02:46.556359 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 26 13:02:46.556359 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 26 13:02:46.556359 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:02:46.556359 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 26 13:02:46.556359 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 26 13:02:46.556359 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 222093283 could not be found. Oct 26 13:02:46.556359 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:46.556359 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:46.556359 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:46.556359 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:46.558129 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:46.558129 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:46.558129 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:02:46.558129 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:02:46.558129 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:02:46.558129 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:02:46.558129 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:02:46.558129 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:02:46.558129 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:02:46.558129 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:02:46.558129 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:02:46.558129 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:02:46.558129 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 26 13:02:46.558129 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 26 13:02:46.558129 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 26 13:02:46.558129 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 222093283 could not be found. Oct 26 13:02:46.558129 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:46.558129 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:02:46.558129 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:46.558129 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:02:46.558129 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:02:46.559909 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:02:46.559909 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:02:46.559909 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:02:46.559909 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 222093283 could not be found. Oct 26 13:02:46.559909 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:02:46.559909 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1cd58f23-db63-4980-a139-11126ce0f4f6 tempest-FlavorsAdminTestJSON-823578608 tempest-FlavorsAdminTestJSON-823578608-project] Returning 400 to user: Flavor 222093283 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:02:46.560393 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1cd58f23-db63-4980-a139-11126ce0f4f6 tempest-FlavorsAdminTestJSON-823578608 tempest-FlavorsAdminTestJSON-823578608-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.056284 Oct 26 13:02:46.561124 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 49/104] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:02:46 2022] POST /compute/v2.1/servers => generated 80 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 26 13:02:46.569698 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c15d3de3-7f40-445e-b6e5-4d281fa19c76 tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:46.585202 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=8,nova_api:DELETE=13 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:02:46.608343 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c15d3de3-7f40-445e-b6e5-4d281fa19c76 tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/222093283" status: 202 len: 0 microversion: 2.1 time: 0.040867 Oct 26 13:02:46.613858 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 50/105] 10.222.0.40 () {58 vars in 1158 bytes} [Wed Oct 26 13:02:46 2022] DELETE /compute/v2.1/flavors/222093283 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 13:02:46.622477 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0abf057a-711b-444a-991b-26eee8d31d02 tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:46.652979 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0abf057a-711b-444a-991b-26eee8d31d02 tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037719 Oct 26 13:02:46.673743 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 51/106] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:02:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:02:46.680058 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a54cf2bc-f28e-4916-bb2f-cec525cb7ab4 tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2030594684", "id": 1507175613, "os-flavor-access:is_public": "False"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:46.712879 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a54cf2bc-f28e-4916-bb2f-cec525cb7ab4 tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.037404 Oct 26 13:02:46.714241 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 52/107] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:02:46 2022] POST /compute/v2.1/flavors => generated 415 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:02:46.726943 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e25f5686-e317-460d-845f-93f761ac4e1e tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1736214205", "id": 1884294392, "os-flavor-access:is_public": "True"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:46.767403 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e25f5686-e317-460d-845f-93f761ac4e1e tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.044058 Oct 26 13:02:46.773866 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 53/108] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:02:46 2022] POST /compute/v2.1/flavors => generated 414 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:02:46.781407 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-842e0e99-fe18-4439-bdaf-01f37a1f0fad tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:46.800748 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-842e0e99-fe18-4439-bdaf-01f37a1f0fad tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 418 microversion: 2.1 time: 0.022891 Oct 26 13:02:46.801891 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 54/109] 10.222.0.40 () {58 vars in 1169 bytes} [Wed Oct 26 13:02:46 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 418 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:02:46.816268 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-62dd5b9a-3950-49f1-8e5a-da759e7efcb4 tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:46.830402 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-62dd5b9a-3950-49f1-8e5a-da759e7efcb4 tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 418 microversion: 2.1 time: 0.017946 Oct 26 13:02:46.838163 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 55/110] 10.222.0.40 () {58 vars in 1177 bytes} [Wed Oct 26 13:02:46 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 418 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:02:46.851534 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b810f46d-d99f-4827-8097-7214a42799bd tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:46.873307 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b810f46d-d99f-4827-8097-7214a42799bd tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 418 microversion: 2.1 time: 0.026572 Oct 26 13:02:46.874245 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 56/111] 10.222.0.40 () {58 vars in 1171 bytes} [Wed Oct 26 13:02:46 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 418 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:02:46.888872 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-95e74696-cda2-4b82-91a8-3934a1c0947f tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:46.925965 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-95e74696-cda2-4b82-91a8-3934a1c0947f tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 418 microversion: 2.1 time: 0.041613 Oct 26 13:02:46.926916 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 57/112] 10.222.0.40 () {58 vars in 1169 bytes} [Wed Oct 26 13:02:46 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 418 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:02:46.950002 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-71640717-65e0-4943-878c-50999a15c81a tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:46.977141 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-71640717-65e0-4943-878c-50999a15c81a tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5395 microversion: 2.1 time: 0.031465 Oct 26 13:02:46.979796 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 58/113] 10.222.0.40 () {58 vars in 1169 bytes} [Wed Oct 26 13:02:46 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5395 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:02:47.005581 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-73c1f508-70d5-406e-9b08-62df71c8c99c tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:47.054731 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-73c1f508-70d5-406e-9b08-62df71c8c99c tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5395 microversion: 2.1 time: 0.057033 Oct 26 13:02:47.057598 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 59/114] 10.222.0.40 () {58 vars in 1175 bytes} [Wed Oct 26 13:02:46 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5395 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:02:47.080161 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9887c79f-ac3b-44c6-b00c-b796e1747852 tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:47.128489 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9887c79f-ac3b-44c6-b00c-b796e1747852 tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5395 microversion: 2.1 time: 0.053616 Oct 26 13:02:47.131188 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 60/115] 10.222.0.40 () {58 vars in 1173 bytes} [Wed Oct 26 13:02:47 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5395 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:02:47.150895 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d3c89a83-db0a-4047-898a-ad8c89e0d14b tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:47.200968 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d3c89a83-db0a-4047-898a-ad8c89e0d14b tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5395 microversion: 2.1 time: 0.054022 Oct 26 13:02:47.202149 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 61/116] 10.222.0.40 () {58 vars in 1169 bytes} [Wed Oct 26 13:02:47 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5395 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:02:47.223952 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-80c0c815-1842-46bf-afa6-e31449b4d1de tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:47.249312 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-80c0c815-1842-46bf-afa6-e31449b4d1de tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1884294392" status: 202 len: 0 microversion: 2.1 time: 0.030905 Oct 26 13:02:47.251886 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 62/117] 10.222.0.40 () {58 vars in 1161 bytes} [Wed Oct 26 13:02:47 2022] DELETE /compute/v2.1/flavors/1884294392 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 13:02:47.263230 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-422b9e16-9b74-4204-b7fb-9363af729875 tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:47.291827 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-422b9e16-9b74-4204-b7fb-9363af729875 tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034524 Oct 26 13:02:47.293652 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 63/118] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:02:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:02:47.311334 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-301d3d35-7a52-4ec4-b2cb-a015169615ad tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:47.330527 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-301d3d35-7a52-4ec4-b2cb-a015169615ad tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1507175613" status: 202 len: 0 microversion: 2.1 time: 0.022755 Oct 26 13:02:47.331327 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 64/119] 10.222.0.40 () {58 vars in 1161 bytes} [Wed Oct 26 13:02:47 2022] DELETE /compute/v2.1/flavors/1507175613 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 13:02:47.341666 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a9af8ea6-af16-402f-87eb-78d3acab322d tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:47.367007 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a9af8ea6-af16-402f-87eb-78d3acab322d tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031562 Oct 26 13:02:47.381882 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 65/120] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:02:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:02:47.389233 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f8e42ae2-da62-46ef-8440-4126b217dd29 tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1674886589", "id": 1400872763, "os-flavor-access:is_public": "False"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:47.411744 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f8e42ae2-da62-46ef-8440-4126b217dd29 tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.027307 Oct 26 13:02:47.412337 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 66/121] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:02:47 2022] POST /compute/v2.1/flavors => generated 415 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:02:47.428473 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0eb5c5e8-e441-476d-8038-f6fb095f282e tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:47.465258 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0eb5c5e8-e441-476d-8038-f6fb095f282e tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044088 Oct 26 13:02:47.477977 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 67/122] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:02:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:02:47.493467 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9fa26de0-e1bd-4636-8648-4e492aa86073 tempest-FlavorsAdminTestJSON-823578608 tempest-FlavorsAdminTestJSON-823578608-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:47.534047 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9fa26de0-e1bd-4636-8648-4e492aa86073 tempest-FlavorsAdminTestJSON-823578608 tempest-FlavorsAdminTestJSON-823578608-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048454 Oct 26 13:02:47.534821 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 68/123] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:02:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:02:47.572987 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-794297da-e217-46d6-9acc-6ff207d0aebe tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:47.617385 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-794297da-e217-46d6-9acc-6ff207d0aebe tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1400872763" status: 202 len: 0 microversion: 2.1 time: 0.054876 Oct 26 13:02:47.618081 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 69/124] 10.222.0.40 () {58 vars in 1161 bytes} [Wed Oct 26 13:02:47 2022] DELETE /compute/v2.1/flavors/1400872763 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:02:47.638703 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2c087b8b-77e1-4e97-830c-9e213178839f tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:47.704676 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2c087b8b-77e1-4e97-830c-9e213178839f tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.080517 Oct 26 13:02:47.705355 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 70/125] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:02:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:02:47.730493 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d8bf83be-d398-4661-871b-47294d3a4c45 tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-41815994", "id": 927411999, "os-flavor-access:is_public": "True"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:47.785109 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d8bf83be-d398-4661-871b-47294d3a4c45 tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.1 time: 0.061346 Oct 26 13:02:47.787075 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 71/126] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:02:47 2022] POST /compute/v2.1/flavors => generated 409 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:02:47.808149 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ee68fafa-8c04-416c-aa9a-d4be19700178 tempest-FlavorsAdminTestJSON-823578608 tempest-FlavorsAdminTestJSON-823578608-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:47.858303 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ee68fafa-8c04-416c-aa9a-d4be19700178 tempest-FlavorsAdminTestJSON-823578608 tempest-FlavorsAdminTestJSON-823578608-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5390 microversion: 2.1 time: 0.062216 Oct 26 13:02:47.868564 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 72/127] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:02:47 2022] GET /compute/v2.1/flavors/detail => generated 5390 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:02:47.881680 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-70609fbb-537f-483c-8d2d-77aa1acce832 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db8f8e223a145abbe4a20edb9ce60d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc559afd836047ccbeba91fca9c0d527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:02:47.905266 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-20415f76-04fb-4f93-93ad-c176bd6203bf tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:47.921263 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-70609fbb-537f-483c-8d2d-77aa1acce832 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] 10.222.0.40 "GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159" status: 200 len: 1241 microversion: 2.1 time: 1.760177 Oct 26 13:02:47.923786 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 56/128] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:02:46 2022] GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159 => generated 1241 bytes in 1763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:02:47.954044 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-20415f76-04fb-4f93-93ad-c176bd6203bf tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/927411999" status: 202 len: 0 microversion: 2.1 time: 0.053538 Oct 26 13:02:47.960058 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 73/129] 10.222.0.40 () {58 vars in 1158 bytes} [Wed Oct 26 13:02:47 2022] DELETE /compute/v2.1/flavors/927411999 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 13:02:47.971515 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1f35fe43-42bf-4602-a8b5-1edacb213888 tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:48.044958 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1f35fe43-42bf-4602-a8b5-1edacb213888 tempest-FlavorsAdminTestJSON-103502858 tempest-FlavorsAdminTestJSON-103502858-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.082495 Oct 26 13:02:48.049522 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 57/130] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:02:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:02:48.953145 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3643ad62-1b97-44d0-92e8-f20207e1bfe4 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:48.954639 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3643ad62-1b97-44d0-92e8-f20207e1bfe4 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] [instance: 5984db52-3d30-4265-af13-6d9c16b63159] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:02:48.974331 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3643ad62-1b97-44d0-92e8-f20207e1bfe4 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:48.977733 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3643ad62-1b97-44d0-92e8-f20207e1bfe4 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:48.979039 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3643ad62-1b97-44d0-92e8-f20207e1bfe4 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:48.980664 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3643ad62-1b97-44d0-92e8-f20207e1bfe4 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:48.983194 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3643ad62-1b97-44d0-92e8-f20207e1bfe4 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:48.985881 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3643ad62-1b97-44d0-92e8-f20207e1bfe4 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:49.292831 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:02:49.507535 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3643ad62-1b97-44d0-92e8-f20207e1bfe4 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db8f8e223a145abbe4a20edb9ce60d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc559afd836047ccbeba91fca9c0d527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:02:49.524417 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3643ad62-1b97-44d0-92e8-f20207e1bfe4 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] 10.222.0.40 "GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159" status: 200 len: 1295 microversion: 2.1 time: 0.578030 Oct 26 13:02:49.559674 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 74/131] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:02:48 2022] GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159 => generated 1295 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:02:50.052854 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fa6c4fcf-bea0-47bd-a206-b1389e82a458 tempest-FlavorsV261TestJSON-1914774985 tempest-FlavorsV261TestJSON-1914774985-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1056703423", "id": 864549024, "os-flavor-access:is_public": "True"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:50.106216 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fa6c4fcf-bea0-47bd-a206-b1389e82a458 tempest-FlavorsV261TestJSON-1914774985 tempest-FlavorsV261TestJSON-1914774985-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.61 time: 0.820936 Oct 26 13:02:50.110865 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 58/132] 10.222.0.40 () {62 vars in 1188 bytes} [Wed Oct 26 13:02:49 2022] POST /compute/v2.1/flavors => generated 465 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:02:50.844003 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b52245a6-0675-46a6-ae96-e4f564fe763f tempest-FlavorsV261TestJSON-503509219 tempest-FlavorsV261TestJSON-503509219-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:50.881629 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b52245a6-0675-46a6-ae96-e4f564fe763f tempest-FlavorsV261TestJSON-503509219 tempest-FlavorsV261TestJSON-503509219-project] 10.222.0.40 "GET /compute/v2.1/flavors/864549024" status: 200 len: 465 microversion: 2.61 time: 0.761406 Oct 26 13:02:50.887968 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 75/133] 10.222.0.40 () {60 vars in 1196 bytes} [Wed Oct 26 13:02:50 2022] GET /compute/v2.1/flavors/864549024 => generated 465 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:02:50.910898 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7b673070-b9ce-4739-82e0-016abac0491f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:50.911731 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7b673070-b9ce-4739-82e0-016abac0491f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] [instance: 5984db52-3d30-4265-af13-6d9c16b63159] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:02:50.944641 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7b673070-b9ce-4739-82e0-016abac0491f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:50.946802 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7b673070-b9ce-4739-82e0-016abac0491f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:50.948877 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7b673070-b9ce-4739-82e0-016abac0491f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:50.949936 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7b673070-b9ce-4739-82e0-016abac0491f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:50.956505 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7b673070-b9ce-4739-82e0-016abac0491f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:50.957379 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7b673070-b9ce-4739-82e0-016abac0491f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:51.374270 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=16 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:02:51.479250 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7b673070-b9ce-4739-82e0-016abac0491f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db8f8e223a145abbe4a20edb9ce60d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc559afd836047ccbeba91fca9c0d527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:02:51.496869 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7b673070-b9ce-4739-82e0-016abac0491f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] 10.222.0.40 "GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159" status: 200 len: 1337 microversion: 2.1 time: 0.607473 Oct 26 13:02:51.497451 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 76/134] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:02:50 2022] GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159 => generated 1337 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:02:51.514206 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4a442b2b-7705-49d8-b84c-61b8ef701f48 tempest-FlavorsV261TestJSON-1914774985 tempest-FlavorsV261TestJSON-1914774985-project-admin] Action: 'update', calling method: .version_select at 0x7f6734452f70>, body: {"flavor": {"description": "new"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:51.589986 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d521ab95-66ec-4852-80c5-5af6561a8875 tempest-FlavorMetadataValidation-2054983836 tempest-FlavorMetadataValidation-2054983836-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-396275778", "id": 666636414, "os-flavor-access:is_public": "True"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:51.615935 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4a442b2b-7705-49d8-b84c-61b8ef701f48 tempest-FlavorsV261TestJSON-1914774985 tempest-FlavorsV261TestJSON-1914774985-project-admin] 10.222.0.40 "PUT /compute/v2.1/flavors/864549024" status: 200 len: 466 microversion: 2.61 time: 0.115271 Oct 26 13:02:51.618142 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 77/135] 10.222.0.40 () {62 vars in 1216 bytes} [Wed Oct 26 13:02:51 2022] PUT /compute/v2.1/flavors/864549024 => generated 466 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:02:51.647516 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d521ab95-66ec-4852-80c5-5af6561a8875 tempest-FlavorMetadataValidation-2054983836 tempest-FlavorMetadataValidation-2054983836-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.86 time: 1.132424 Oct 26 13:02:51.652478 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 59/136] 10.222.0.40 () {62 vars in 1188 bytes} [Wed Oct 26 13:02:50 2022] POST /compute/v2.1/flavors => generated 467 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:02:51.660437 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-75e1aaad-a2bb-4419-997d-be3664868c71 tempest-FlavorsV261TestJSON-503509219 tempest-FlavorsV261TestJSON-503509219-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:51.735894 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-75e1aaad-a2bb-4419-997d-be3664868c71 tempest-FlavorsV261TestJSON-503509219 tempest-FlavorsV261TestJSON-503509219-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 6705 microversion: 2.61 time: 0.078691 Oct 26 13:02:51.739277 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 60/137] 10.222.0.40 () {60 vars in 1187 bytes} [Wed Oct 26 13:02:51 2022] GET /compute/v2.1/flavors/detail => generated 6705 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:02:51.745858 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8822f801-51e1-4dc5-b36d-68b11f2eb2a6 tempest-FlavorMetadataValidation-2054983836 tempest-FlavorMetadataValidation-2054983836-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:52.172032 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=17,nova_api:INSERT=9 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:02:52.209234 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8822f801-51e1-4dc5-b36d-68b11f2eb2a6 tempest-FlavorMetadataValidation-2054983836 tempest-FlavorMetadataValidation-2054983836-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/666636414/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.468488 Oct 26 13:02:52.210706 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 61/138] 10.222.0.40 () {62 vars in 1262 bytes} [Wed Oct 26 13:02:51 2022] POST /compute/v2.1/flavors/666636414/os-extra_specs => generated 62 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:02:52.219824 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ac293665-78e1-4f4e-8084-0140ae777950 tempest-FlavorsV261TestJSON-503509219 tempest-FlavorsV261TestJSON-503509219-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:52.269727 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ac293665-78e1-4f4e-8084-0140ae777950 tempest-FlavorsV261TestJSON-503509219 tempest-FlavorsV261TestJSON-503509219-project] 10.222.0.40 "GET /compute/v2.1/flavors" status: 200 len: 3422 microversion: 2.61 time: 0.056747 Oct 26 13:02:52.281503 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 62/139] 10.222.0.40 () {60 vars in 1166 bytes} [Wed Oct 26 13:02:52 2022] GET /compute/v2.1/flavors => generated 3422 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:02:52.281692 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0522042d-8c66-45de-b4b4-fd6304c1bb9a tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Calling method '.version_select at 0x7f673319d9d0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:52.283991 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0522042d-8c66-45de-b4b4-fd6304c1bb9a tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:52.286656 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0522042d-8c66-45de-b4b4-fd6304c1bb9a tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:52.286656 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0522042d-8c66-45de-b4b4-fd6304c1bb9a tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:52.378706 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0522042d-8c66-45de-b4b4-fd6304c1bb9a tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:52.386493 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0522042d-8c66-45de-b4b4-fd6304c1bb9a tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:52.387337 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0522042d-8c66-45de-b4b4-fd6304c1bb9a tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:52.425420 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0522042d-8c66-45de-b4b4-fd6304c1bb9a tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:52.425940 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0522042d-8c66-45de-b4b4-fd6304c1bb9a tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:52.440370 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0522042d-8c66-45de-b4b4-fd6304c1bb9a tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:52.462388 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0522042d-8c66-45de-b4b4-fd6304c1bb9a tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.842894 Oct 26 13:02:52.464173 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 78/140] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:02:51 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:02:52.468862 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-342f8783-2f88-4adf-b47d-13cdbb5865fe tempest-FlavorMetadataValidation-2054983836 tempest-FlavorMetadataValidation-2054983836-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:52.515262 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=15,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:02:52.552799 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-342f8783-2f88-4adf-b47d-13cdbb5865fe tempest-FlavorMetadataValidation-2054983836 tempest-FlavorMetadataValidation-2054983836-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/666636414" status: 202 len: 0 microversion: 2.86 time: 0.087432 Oct 26 13:02:52.560148 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 79/141] 10.222.0.40 () {60 vars in 1199 bytes} [Wed Oct 26 13:02:52 2022] DELETE /compute/v2.1/flavors/666636414 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:02:52.566686 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3a329e37-5502-4a23-8217-7492ff322453 tempest-FlavorsV261TestJSON-1914774985 tempest-FlavorsV261TestJSON-1914774985-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:52.615853 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3a329e37-5502-4a23-8217-7492ff322453 tempest-FlavorsV261TestJSON-1914774985 tempest-FlavorsV261TestJSON-1914774985-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/864549024" status: 202 len: 0 microversion: 2.61 time: 0.054156 Oct 26 13:02:52.617037 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 80/142] 10.222.0.40 () {60 vars in 1199 bytes} [Wed Oct 26 13:02:52 2022] DELETE /compute/v2.1/flavors/864549024 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:02:52.635720 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9e9ed6e4-b706-4498-804c-8b66d2d0452f tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Calling method '.version_select at 0x7f6733083af0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:52.638226 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e9ed6e4-b706-4498-804c-8b66d2d0452f tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:52.638764 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e9ed6e4-b706-4498-804c-8b66d2d0452f tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:52.640390 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e9ed6e4-b706-4498-804c-8b66d2d0452f tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:52.679077 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e9ed6e4-b706-4498-804c-8b66d2d0452f tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:52.680672 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e9ed6e4-b706-4498-804c-8b66d2d0452f tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:52.683607 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e9ed6e4-b706-4498-804c-8b66d2d0452f tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:52.710466 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e9ed6e4-b706-4498-804c-8b66d2d0452f tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:52.712424 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e9ed6e4-b706-4498-804c-8b66d2d0452f tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:52.715574 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e9ed6e4-b706-4498-804c-8b66d2d0452f tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:52.749034 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9e9ed6e4-b706-4498-804c-8b66d2d0452f tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1504 microversion: 2.1 time: 0.130533 Oct 26 13:02:52.750574 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 81/143] 10.222.0.40 () {58 vars in 1167 bytes} [Wed Oct 26 13:02:52 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1504 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:02:52.758185 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-990fd12a-5c3d-4c22-a9d8-075075c07146 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:52.759084 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-990fd12a-5c3d-4c22-a9d8-075075c07146 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] [instance: 5984db52-3d30-4265-af13-6d9c16b63159] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:02:52.783718 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-990fd12a-5c3d-4c22-a9d8-075075c07146 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:52.795972 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-990fd12a-5c3d-4c22-a9d8-075075c07146 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:52.800174 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-990fd12a-5c3d-4c22-a9d8-075075c07146 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:52.802265 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-990fd12a-5c3d-4c22-a9d8-075075c07146 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:52.804689 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-990fd12a-5c3d-4c22-a9d8-075075c07146 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:52.805155 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-990fd12a-5c3d-4c22-a9d8-075075c07146 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:52.863478 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7053fc90-48dc-4383-9864-7213e8c89041 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-140584683", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:53.075021 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-7053fc90-48dc-4383-9864-7213e8c89041 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] validate_networks() for None {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:02:53.291362 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-990fd12a-5c3d-4c22-a9d8-075075c07146 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db8f8e223a145abbe4a20edb9ce60d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc559afd836047ccbeba91fca9c0d527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:02:53.300731 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-990fd12a-5c3d-4c22-a9d8-075075c07146 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] 10.222.0.40 "GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159" status: 200 len: 1337 microversion: 2.1 time: 0.548921 Oct 26 13:02:53.301632 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 82/144] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:02:52 2022] GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159 => generated 1337 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:02:53.315655 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-af977ded-8305-4c61-a458-01d1475c2577 tempest-FlavorMetadataValidation-2054983836 tempest-FlavorMetadataValidation-2054983836-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:53.350029 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-af977ded-8305-4c61-a458-01d1475c2577 tempest-FlavorMetadataValidation-2054983836 tempest-FlavorMetadataValidation-2054983836-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.047456 Oct 26 13:02:53.364526 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 83/145] 10.222.0.40 () {60 vars in 1187 bytes} [Wed Oct 26 13:02:53 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:02:53.380502 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-861dc20a-c7b4-4b69-ac39-7a8e0af196cb tempest-FlavorsV261TestJSON-1914774985 tempest-FlavorsV261TestJSON-1914774985-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:53.419853 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-861dc20a-c7b4-4b69-ac39-7a8e0af196cb tempest-FlavorsV261TestJSON-1914774985 tempest-FlavorsV261TestJSON-1914774985-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.053128 Oct 26 13:02:53.430157 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 84/146] 10.222.0.40 () {60 vars in 1187 bytes} [Wed Oct 26 13:02:53 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:02:53.430157 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cdf90174-7e5c-4db0-ad6d-78b88879248d tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Calling method '.version_select at 0x7f67330a1550>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:53.430157 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cdf90174-7e5c-4db0-ad6d-78b88879248d tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:53.430157 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cdf90174-7e5c-4db0-ad6d-78b88879248d tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:53.430589 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cdf90174-7e5c-4db0-ad6d-78b88879248d tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:53.447721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cdf90174-7e5c-4db0-ad6d-78b88879248d tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:53.448337 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cdf90174-7e5c-4db0-ad6d-78b88879248d tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:53.448835 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cdf90174-7e5c-4db0-ad6d-78b88879248d tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:53.487467 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cdf90174-7e5c-4db0-ad6d-78b88879248d tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:53.488213 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cdf90174-7e5c-4db0-ad6d-78b88879248d tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:53.488843 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cdf90174-7e5c-4db0-ad6d-78b88879248d tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:53.497770 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cdf90174-7e5c-4db0-ad6d-78b88879248d tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.075764 Oct 26 13:02:53.498973 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 85/147] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:02:53 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:02:53.511316 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5c52ce2b-722c-48ab-900d-4440c516fc62 tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Calling method '.version_select at 0x7f67330a1790>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:53.515030 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c52ce2b-722c-48ab-900d-4440c516fc62 tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:53.515953 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c52ce2b-722c-48ab-900d-4440c516fc62 tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:53.517803 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c52ce2b-722c-48ab-900d-4440c516fc62 tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:53.539322 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c52ce2b-722c-48ab-900d-4440c516fc62 tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:53.540126 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c52ce2b-722c-48ab-900d-4440c516fc62 tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:53.540874 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c52ce2b-722c-48ab-900d-4440c516fc62 tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:53.551351 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5c52ce2b-722c-48ab-900d-4440c516fc62 tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.045749 Oct 26 13:02:53.552753 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 86/148] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 26 13:02:53 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:02:53.582075 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3691bd35-4521-4c45-bd55-a3aac320985c tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Calling method '.version_select at 0x7f67330a1b80>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:53.585065 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3691bd35-4521-4c45-bd55-a3aac320985c tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:53.586634 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3691bd35-4521-4c45-bd55-a3aac320985c tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:53.587404 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3691bd35-4521-4c45-bd55-a3aac320985c tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:53.639888 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3691bd35-4521-4c45-bd55-a3aac320985c tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.068653 Oct 26 13:02:53.645337 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 87/149] 10.222.0.40 () {58 vars in 1179 bytes} [Wed Oct 26 13:02:53 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:02:53.664505 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-132d9072-afdb-482a-8864-3889eb5fee1e tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Calling method '.version_select at 0x7f67330a1d30>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:53.674569 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-132d9072-afdb-482a-8864-3889eb5fee1e tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:53.676532 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-132d9072-afdb-482a-8864-3889eb5fee1e tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:53.677206 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-132d9072-afdb-482a-8864-3889eb5fee1e tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:53.716307 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-132d9072-afdb-482a-8864-3889eb5fee1e tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:53.717183 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-132d9072-afdb-482a-8864-3889eb5fee1e tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:53.718510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-132d9072-afdb-482a-8864-3889eb5fee1e tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:53.731056 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-132d9072-afdb-482a-8864-3889eb5fee1e tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:53.731892 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-132d9072-afdb-482a-8864-3889eb5fee1e tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:53.732558 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-132d9072-afdb-482a-8864-3889eb5fee1e tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:53.739576 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-132d9072-afdb-482a-8864-3889eb5fee1e tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.081742 Oct 26 13:02:53.740933 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 88/150] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:02:53 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:02:53.760889 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9eba4421-3b1f-47af-95e5-c1775bd3068b tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Calling method '.version_select at 0x7f67330a1160>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:53.773112 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9eba4421-3b1f-47af-95e5-c1775bd3068b tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:53.774542 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9eba4421-3b1f-47af-95e5-c1775bd3068b tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:53.775040 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9eba4421-3b1f-47af-95e5-c1775bd3068b tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:53.814319 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9eba4421-3b1f-47af-95e5-c1775bd3068b tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:53.814837 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9eba4421-3b1f-47af-95e5-c1775bd3068b tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:53.815371 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9eba4421-3b1f-47af-95e5-c1775bd3068b tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:53.834836 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9eba4421-3b1f-47af-95e5-c1775bd3068b tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.086177 Oct 26 13:02:53.846047 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 89/151] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 26 13:02:53 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:02:53.861155 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-40805158-b808-496b-b78f-d0513f2d744f tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Calling method '.version_select at 0x7f67330a1940>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:53.876270 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-40805158-b808-496b-b78f-d0513f2d744f tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:53.876771 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-40805158-b808-496b-b78f-d0513f2d744f tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:53.877214 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-40805158-b808-496b-b78f-d0513f2d744f tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:53.905896 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-40805158-b808-496b-b78f-d0513f2d744f tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:53.906405 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-40805158-b808-496b-b78f-d0513f2d744f tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:53.906851 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-40805158-b808-496b-b78f-d0513f2d744f tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:53.919699 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-40805158-b808-496b-b78f-d0513f2d744f tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 757 microversion: 2.1 time: 0.068336 Oct 26 13:02:53.921703 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 90/152] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 26 13:02:53 2022] GET /compute/v2.1/os-hypervisors/2 => generated 757 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:02:53.939451 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3bf073d2-3576-42d2-8218-4ceabc7c0364 tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Calling method '.version_select at 0x7f673306ea60>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:53.944703 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bf073d2-3576-42d2-8218-4ceabc7c0364 tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:53.946778 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bf073d2-3576-42d2-8218-4ceabc7c0364 tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:53.952294 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bf073d2-3576-42d2-8218-4ceabc7c0364 tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:53.984434 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bf073d2-3576-42d2-8218-4ceabc7c0364 tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:53.985090 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bf073d2-3576-42d2-8218-4ceabc7c0364 tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:53.985888 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bf073d2-3576-42d2-8218-4ceabc7c0364 tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:54.036183 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bf073d2-3576-42d2-8218-4ceabc7c0364 tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:54.040600 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bf073d2-3576-42d2-8218-4ceabc7c0364 tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:54.043609 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bf073d2-3576-42d2-8218-4ceabc7c0364 tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:54.077888 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bf073d2-3576-42d2-8218-4ceabc7c0364 tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Acquiring lock "compute-rpcapi-router" {{(pid=120598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 26 13:02:54.080073 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bf073d2-3576-42d2-8218-4ceabc7c0364 tempest-HypervisorAdminTestJSON-345308501 tempest-HypervisorAdminTestJSON-345308501-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=120598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 26 13:02:54.083224 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e2d3556-f158-4dbd-bf07-274189dbb033 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:54.084684 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e2d3556-f158-4dbd-bf07-274189dbb033 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:54.086214 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e2d3556-f158-4dbd-bf07-274189dbb033 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:54.090237 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e2d3556-f158-4dbd-bf07-274189dbb033 None None] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:54.091368 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e2d3556-f158-4dbd-bf07-274189dbb033 None None] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:54.093400 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e2d3556-f158-4dbd-bf07-274189dbb033 None None] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:54.124781 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.compute.rpcapi [None req-9e2d3556-f158-4dbd-bf07-274189dbb033 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 26 13:02:54.137063 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e2d3556-f158-4dbd-bf07-274189dbb033 None None] Releasing lock "compute-rpcapi-router" {{(pid=120598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 26 13:02:54.216092 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9e2d3556-f158-4dbd-bf07-274189dbb033 None None] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.280565 Oct 26 13:02:54.229644 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 91/153] 10.222.0.40 () {58 vars in 1173 bytes} [Wed Oct 26 13:02:53 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:02:54.332396 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ba24a7c0-6688-432b-9ab5-706a0b4c2493 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:54.333139 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ba24a7c0-6688-432b-9ab5-706a0b4c2493 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] [instance: 5984db52-3d30-4265-af13-6d9c16b63159] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:02:54.351106 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ba24a7c0-6688-432b-9ab5-706a0b4c2493 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:54.351667 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ba24a7c0-6688-432b-9ab5-706a0b4c2493 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:54.352077 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ba24a7c0-6688-432b-9ab5-706a0b4c2493 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:54.352801 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ba24a7c0-6688-432b-9ab5-706a0b4c2493 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:54.362049 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ba24a7c0-6688-432b-9ab5-706a0b4c2493 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:54.363052 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ba24a7c0-6688-432b-9ab5-706a0b4c2493 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:54.433166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:02:54.457063 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-7053fc90-48dc-4383-9864-7213e8c89041 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:02:54.460830 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-7053fc90-48dc-4383-9864-7213e8c89041 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:02:54.461802 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-7053fc90-48dc-4383-9864-7213e8c89041 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:02:54.462504 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-7053fc90-48dc-4383-9864-7213e8c89041 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:02:54.463588 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-7053fc90-48dc-4383-9864-7213e8c89041 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:02:54.522444 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7053fc90-48dc-4383-9864-7213e8c89041 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:54.523438 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7053fc90-48dc-4383-9864-7213e8c89041 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:54.528892 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7053fc90-48dc-4383-9864-7213e8c89041 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:54.535422 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7053fc90-48dc-4383-9864-7213e8c89041 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:54.539281 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7053fc90-48dc-4383-9864-7213e8c89041 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:54.541958 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7053fc90-48dc-4383-9864-7213e8c89041 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:54.743415 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-7053fc90-48dc-4383-9864-7213e8c89041 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Getting quotas for project 443f71d3ffde486b9072df264fea2f53. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:02:54.770584 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-7053fc90-48dc-4383-9864-7213e8c89041 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Getting quotas for user 03335593029b48dfb19fc9cdf6b382b0 and project 443f71d3ffde486b9072df264fea2f53. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:02:54.820447 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7053fc90-48dc-4383-9864-7213e8c89041 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:02:54.841333 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7053fc90-48dc-4383-9864-7213e8c89041 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:02:55.008107 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7053fc90-48dc-4383-9864-7213e8c89041 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.735015 Oct 26 13:02:55.013334 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 63/154] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:02:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:02:55.034776 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-58a886a0-8049-417d-966c-f0cf3934f4cc tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:55.045908 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-58a886a0-8049-417d-966c-f0cf3934f4cc tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:02:55.130056 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=8 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:02:55.258522 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ba24a7c0-6688-432b-9ab5-706a0b4c2493 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db8f8e223a145abbe4a20edb9ce60d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc559afd836047ccbeba91fca9c0d527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:02:55.271786 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ba24a7c0-6688-432b-9ab5-706a0b4c2493 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] 10.222.0.40 "GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159" status: 200 len: 1337 microversion: 2.1 time: 0.943629 Oct 26 13:02:55.278667 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 92/155] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:02:54 2022] GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159 => generated 1337 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:02:55.997351 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-58a886a0-8049-417d-966c-f0cf3934f4cc tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:02:56.005788 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-58a886a0-8049-417d-966c-f0cf3934f4cc tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1212 microversion: 2.1 time: 0.987650 Oct 26 13:02:56.006379 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 64/156] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:02:55 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1212 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:02:56.318822 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0ee64ed1-e328-42e1-9617-856613131c3f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:56.320238 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0ee64ed1-e328-42e1-9617-856613131c3f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] [instance: 5984db52-3d30-4265-af13-6d9c16b63159] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:02:56.369361 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ee64ed1-e328-42e1-9617-856613131c3f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:56.375307 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ee64ed1-e328-42e1-9617-856613131c3f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:56.376795 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ee64ed1-e328-42e1-9617-856613131c3f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:56.377835 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ee64ed1-e328-42e1-9617-856613131c3f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:56.389352 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ee64ed1-e328-42e1-9617-856613131c3f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:56.396981 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ee64ed1-e328-42e1-9617-856613131c3f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:56.970794 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0ee64ed1-e328-42e1-9617-856613131c3f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db8f8e223a145abbe4a20edb9ce60d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc559afd836047ccbeba91fca9c0d527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:02:56.991841 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0ee64ed1-e328-42e1-9617-856613131c3f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] 10.222.0.40 "GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159" status: 200 len: 1337 microversion: 2.1 time: 0.676115 Oct 26 13:02:57.008208 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 93/157] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:02:56 2022] GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159 => generated 1337 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:02:57.036224 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dd12fb74-1134-433e-ae6f-ef50f728b8f8 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:57.036879 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-dd12fb74-1134-433e-ae6f-ef50f728b8f8 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:02:57.818022 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-dd12fb74-1134-433e-ae6f-ef50f728b8f8 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:02:57.849457 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-dd12fb74-1134-433e-ae6f-ef50f728b8f8 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1212 microversion: 2.1 time: 0.818662 Oct 26 13:02:57.852158 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 65/158] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:02:57 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1212 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:02:58.017955 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d5f8dba0-0149-488f-a5d0-ff7cf730432d tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:58.020247 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d5f8dba0-0149-488f-a5d0-ff7cf730432d tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] [instance: 5984db52-3d30-4265-af13-6d9c16b63159] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:02:58.037981 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5f8dba0-0149-488f-a5d0-ff7cf730432d tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:58.038677 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5f8dba0-0149-488f-a5d0-ff7cf730432d tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:58.040315 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5f8dba0-0149-488f-a5d0-ff7cf730432d tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:58.042448 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5f8dba0-0149-488f-a5d0-ff7cf730432d tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:58.052786 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5f8dba0-0149-488f-a5d0-ff7cf730432d tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:58.058354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5f8dba0-0149-488f-a5d0-ff7cf730432d tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:58.461426 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d5f8dba0-0149-488f-a5d0-ff7cf730432d tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db8f8e223a145abbe4a20edb9ce60d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc559afd836047ccbeba91fca9c0d527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:02:58.472855 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d5f8dba0-0149-488f-a5d0-ff7cf730432d tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] 10.222.0.40 "GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159" status: 200 len: 1337 microversion: 2.1 time: 0.459984 Oct 26 13:02:58.491786 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 94/159] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:02:58 2022] GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159 => generated 1337 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:02:58.883106 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-35b56e9f-e8e4-4e93-a882-7c17cdf4bb6d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:58.883240 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-35b56e9f-e8e4-4e93-a882-7c17cdf4bb6d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:02:58.900829 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-35b56e9f-e8e4-4e93-a882-7c17cdf4bb6d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:58.901290 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-35b56e9f-e8e4-4e93-a882-7c17cdf4bb6d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:58.904654 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-35b56e9f-e8e4-4e93-a882-7c17cdf4bb6d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:58.913163 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-35b56e9f-e8e4-4e93-a882-7c17cdf4bb6d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:58.914670 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-35b56e9f-e8e4-4e93-a882-7c17cdf4bb6d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:58.915975 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-35b56e9f-e8e4-4e93-a882-7c17cdf4bb6d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:59.082887 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-35b56e9f-e8e4-4e93-a882-7c17cdf4bb6d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:02:59.099613 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-35b56e9f-e8e4-4e93-a882-7c17cdf4bb6d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1270 microversion: 2.1 time: 0.224680 Oct 26 13:02:59.103542 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 95/160] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:02:58 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1270 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:02:59.638348 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-998d2146-df11-49df-81e6-e32a098ada83 req-b17752d6-f51b-4053-8215-2c73c94d531f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5984db52-3d30-4265-af13-6d9c16b63159", "tag": "ff83dcc1-3e55-4a32-82d7-062ae132ad46"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:02:59.671747 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-998d2146-df11-49df-81e6-e32a098ada83 req-b17752d6-f51b-4053-8215-2c73c94d531f service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:59.674210 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-998d2146-df11-49df-81e6-e32a098ada83 req-b17752d6-f51b-4053-8215-2c73c94d531f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:59.675839 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-998d2146-df11-49df-81e6-e32a098ada83 req-b17752d6-f51b-4053-8215-2c73c94d531f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:59.772870 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-998d2146-df11-49df-81e6-e32a098ada83 req-b17752d6-f51b-4053-8215-2c73c94d531f service nova] Creating event network-changed:ff83dcc1-3e55-4a32-82d7-062ae132ad46 for instance 5984db52-3d30-4265-af13-6d9c16b63159 on n-h2-862686-1 Oct 26 13:02:59.774251 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-998d2146-df11-49df-81e6-e32a098ada83 req-b17752d6-f51b-4053-8215-2c73c94d531f service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120597) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 26 13:02:59.777598 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-998d2146-df11-49df-81e6-e32a098ada83 req-b17752d6-f51b-4053-8215-2c73c94d531f service nova] Acquired lock "compute-rpcapi-router" {{(pid=120597) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 26 13:02:59.778821 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd26a438-a1e4-4b07-b333-80992b428b13 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:59.782226 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd26a438-a1e4-4b07-b333-80992b428b13 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:59.785735 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd26a438-a1e4-4b07-b333-80992b428b13 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:59.786912 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd26a438-a1e4-4b07-b333-80992b428b13 None None] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:59.787588 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd26a438-a1e4-4b07-b333-80992b428b13 None None] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:59.788213 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd26a438-a1e4-4b07-b333-80992b428b13 None None] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:59.812718 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.compute.rpcapi [None req-fd26a438-a1e4-4b07-b333-80992b428b13 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 26 13:02:59.815106 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd26a438-a1e4-4b07-b333-80992b428b13 None None] Releasing lock "compute-rpcapi-router" {{(pid=120597) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 26 13:02:59.869911 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fd26a438-a1e4-4b07-b333-80992b428b13 None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.061778 Oct 26 13:02:59.873985 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 66/161] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:02:59.895673 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9f22a744-01bd-49a0-98e4-a38e24da96ee tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:02:59.896405 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9f22a744-01bd-49a0-98e4-a38e24da96ee tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] [instance: 5984db52-3d30-4265-af13-6d9c16b63159] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:02:59.920432 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f22a744-01bd-49a0-98e4-a38e24da96ee tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:59.920936 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f22a744-01bd-49a0-98e4-a38e24da96ee tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:59.921384 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f22a744-01bd-49a0-98e4-a38e24da96ee tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:59.922925 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f22a744-01bd-49a0-98e4-a38e24da96ee tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:02:59.923403 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f22a744-01bd-49a0-98e4-a38e24da96ee tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:02:59.923845 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f22a744-01bd-49a0-98e4-a38e24da96ee tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:02:59.960032 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-edd60671-bef1-4834-a38a-b9e157572a1f tempest-FlavorsExtraSpecsTestJSON-575491547 tempest-FlavorsExtraSpecsTestJSON-575491547-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1866942816", "ram": 512, "vcpus": 1, "disk": 10, "id": 1600943620, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:00.012751 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-edd60671-bef1-4834-a38a-b9e157572a1f tempest-FlavorsExtraSpecsTestJSON-575491547 tempest-FlavorsExtraSpecsTestJSON-575491547-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.794938 Oct 26 13:03:00.016686 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 96/162] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:02:59 2022] POST /compute/v2.1/flavors => generated 416 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:03:00.054517 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9ed658e8-a8e8-4466-9810-2b07d2fac9f9 tempest-FlavorsExtraSpecsTestJSON-575491547 tempest-FlavorsExtraSpecsTestJSON-575491547-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:00.142009 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9ed658e8-a8e8-4466-9810-2b07d2fac9f9 tempest-FlavorsExtraSpecsTestJSON-575491547 tempest-FlavorsExtraSpecsTestJSON-575491547-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/1600943620/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.115919 Oct 26 13:03:00.144979 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 97/163] 10.222.0.40 () {60 vars in 1224 bytes} [Wed Oct 26 13:03:00 2022] POST /compute/v2.1/flavors/1600943620/os-extra_specs => generated 66 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:03:00.156631 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-00fa1ec9-9dd1-493f-9c6d-0eef7c81baf9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:00.157269 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-00fa1ec9-9dd1-493f-9c6d-0eef7c81baf9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:00.174942 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-00fa1ec9-9dd1-493f-9c6d-0eef7c81baf9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:00.176141 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-00fa1ec9-9dd1-493f-9c6d-0eef7c81baf9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:00.176604 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-00fa1ec9-9dd1-493f-9c6d-0eef7c81baf9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:00.177347 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-00fa1ec9-9dd1-493f-9c6d-0eef7c81baf9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:00.177879 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-00fa1ec9-9dd1-493f-9c6d-0eef7c81baf9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:00.178399 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-00fa1ec9-9dd1-493f-9c6d-0eef7c81baf9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:00.357704 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-00fa1ec9-9dd1-493f-9c6d-0eef7c81baf9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:00.393636 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-00fa1ec9-9dd1-493f-9c6d-0eef7c81baf9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1270 microversion: 2.1 time: 0.242476 Oct 26 13:03:00.394293 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 98/164] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:00 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1270 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:00.796564 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9f22a744-01bd-49a0-98e4-a38e24da96ee tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db8f8e223a145abbe4a20edb9ce60d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc559afd836047ccbeba91fca9c0d527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:00.820232 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9f22a744-01bd-49a0-98e4-a38e24da96ee tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] 10.222.0.40 "GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159" status: 200 len: 1337 microversion: 2.1 time: 0.941902 Oct 26 13:03:00.821077 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 67/165] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:02:59 2022] GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159 => generated 1337 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:01.081434 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1d84d93c-ac8c-4077-848c-3828c1c1622a tempest-FlavorsExtraSpecsTestJSON-1760959217 tempest-FlavorsExtraSpecsTestJSON-1760959217-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:01.106362 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1d84d93c-ac8c-4077-848c-3828c1c1622a tempest-FlavorsExtraSpecsTestJSON-1760959217 tempest-FlavorsExtraSpecsTestJSON-1760959217-project] 10.222.0.40 "GET /compute/v2.1/flavors/1600943620/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.710951 Oct 26 13:03:01.106954 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 99/166] 10.222.0.40 () {58 vars in 1203 bytes} [Wed Oct 26 13:03:00 2022] GET /compute/v2.1/flavors/1600943620/os-extra_specs => generated 66 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:03:01.122443 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-926f18d1-13e3-4737-ac72-c377db4d1916 tempest-FlavorsExtraSpecsTestJSON-575491547 tempest-FlavorsExtraSpecsTestJSON-575491547-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:01.185511 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-926f18d1-13e3-4737-ac72-c377db4d1916 tempest-FlavorsExtraSpecsTestJSON-575491547 tempest-FlavorsExtraSpecsTestJSON-575491547-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/1600943620/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.068358 Oct 26 13:03:01.192658 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 68/167] 10.222.0.40 () {60 vars in 1224 bytes} [Wed Oct 26 13:03:01 2022] POST /compute/v2.1/flavors/1600943620/os-extra_specs => generated 66 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:03:01.200783 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4a606bb2-968b-49f8-9356-caeb3cce86d5 tempest-FlavorsExtraSpecsTestJSON-1760959217 tempest-FlavorsExtraSpecsTestJSON-1760959217-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:01.227053 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4a606bb2-968b-49f8-9356-caeb3cce86d5 tempest-FlavorsExtraSpecsTestJSON-1760959217 tempest-FlavorsExtraSpecsTestJSON-1760959217-project] 10.222.0.40 "GET /compute/v2.1/flavors/1600943620/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.030972 Oct 26 13:03:01.227897 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 100/168] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Oct 26 13:03:01 2022] GET /compute/v2.1/flavors/1600943620/os-extra_specs/hw:numa_nodes => generated 22 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:03:01.240880 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-caf44320-cb1f-4e48-a193-85b69bc5c081 tempest-FlavorsExtraSpecsTestJSON-575491547 tempest-FlavorsExtraSpecsTestJSON-575491547-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:01.292638 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-caf44320-cb1f-4e48-a193-85b69bc5c081 tempest-FlavorsExtraSpecsTestJSON-575491547 tempest-FlavorsExtraSpecsTestJSON-575491547-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/1600943620/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.055822 Oct 26 13:03:01.294505 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 69/169] 10.222.0.40 () {60 vars in 1224 bytes} [Wed Oct 26 13:03:01 2022] POST /compute/v2.1/flavors/1600943620/os-extra_specs => generated 66 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:03:01.303143 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-84d7d29e-67d0-4303-84d6-47561b64086b tempest-FlavorsExtraSpecsTestJSON-575491547 tempest-FlavorsExtraSpecsTestJSON-575491547-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:01.317007 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-84d7d29e-67d0-4303-84d6-47561b64086b tempest-FlavorsExtraSpecsTestJSON-575491547 tempest-FlavorsExtraSpecsTestJSON-575491547-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/1600943620/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.017507 Oct 26 13:03:01.318197 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 101/170] 10.222.0.40 () {58 vars in 1203 bytes} [Wed Oct 26 13:03:01 2022] GET /compute/v2.1/flavors/1600943620/os-extra_specs => generated 66 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:03:01.328370 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7ff84cb9-9155-4494-a28c-5945926ffa7b tempest-FlavorsExtraSpecsTestJSON-575491547 tempest-FlavorsExtraSpecsTestJSON-575491547-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:01.429871 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7ff84cb9-9155-4494-a28c-5945926ffa7b tempest-FlavorsExtraSpecsTestJSON-575491547 tempest-FlavorsExtraSpecsTestJSON-575491547-project-admin] 10.222.0.40 "PUT /compute/v2.1/flavors/1600943620/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.099853 Oct 26 13:03:01.440455 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2634ef22-080c-4f0a-89c3-b75ec8637b89 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:01.441139 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2634ef22-080c-4f0a-89c3-b75ec8637b89 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:01.441457 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 70/171] 10.222.0.40 () {60 vars in 1265 bytes} [Wed Oct 26 13:03:01 2022] PUT /compute/v2.1/flavors/1600943620/os-extra_specs/hw:numa_nodes => generated 22 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:03:01.448465 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2634ef22-080c-4f0a-89c3-b75ec8637b89 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:01.455826 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2634ef22-080c-4f0a-89c3-b75ec8637b89 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:01.456923 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c3ba8096-6ce6-43d9-8148-2af0d0265379 tempest-FlavorsExtraSpecsTestJSON-575491547 tempest-FlavorsExtraSpecsTestJSON-575491547-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:01.459286 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2634ef22-080c-4f0a-89c3-b75ec8637b89 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:01.460418 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2634ef22-080c-4f0a-89c3-b75ec8637b89 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:01.461875 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2634ef22-080c-4f0a-89c3-b75ec8637b89 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:01.464719 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2634ef22-080c-4f0a-89c3-b75ec8637b89 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:01.507068 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c3ba8096-6ce6-43d9-8148-2af0d0265379 tempest-FlavorsExtraSpecsTestJSON-575491547 tempest-FlavorsExtraSpecsTestJSON-575491547-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/1600943620/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.060653 Oct 26 13:03:01.510579 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 71/172] 10.222.0.40 () {58 vars in 1203 bytes} [Wed Oct 26 13:03:01 2022] GET /compute/v2.1/flavors/1600943620/os-extra_specs => generated 66 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:03:01.524068 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5b61da90-7d03-41d9-8d06-f83c7447b6d8 tempest-FlavorsExtraSpecsTestJSON-575491547 tempest-FlavorsExtraSpecsTestJSON-575491547-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:01.585265 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5b61da90-7d03-41d9-8d06-f83c7447b6d8 tempest-FlavorsExtraSpecsTestJSON-575491547 tempest-FlavorsExtraSpecsTestJSON-575491547-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1600943620/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.064835 Oct 26 13:03:01.589801 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 72/173] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Oct 26 13:03:01 2022] DELETE /compute/v2.1/flavors/1600943620/os-extra_specs/hw:numa_nodes => generated 0 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 26 13:03:01.596739 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cacb3f31-d0ce-43ae-bb51-5b55584a2daf tempest-FlavorsExtraSpecsTestJSON-575491547 tempest-FlavorsExtraSpecsTestJSON-575491547-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:01.639986 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cacb3f31-d0ce-43ae-bb51-5b55584a2daf tempest-FlavorsExtraSpecsTestJSON-575491547 tempest-FlavorsExtraSpecsTestJSON-575491547-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1600943620/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.049017 Oct 26 13:03:01.640873 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 73/174] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Oct 26 13:03:01 2022] DELETE /compute/v2.1/flavors/1600943620/os-extra_specs/hw:cpu_policy => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 26 13:03:01.648456 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fbf063ff-5ec2-4ecc-aa78-1af2ed4310e9 tempest-FlavorsExtraSpecsTestJSON-575491547 tempest-FlavorsExtraSpecsTestJSON-575491547-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:01.664832 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fbf063ff-5ec2-4ecc-aa78-1af2ed4310e9 tempest-FlavorsExtraSpecsTestJSON-575491547 tempest-FlavorsExtraSpecsTestJSON-575491547-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/1600943620/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.019694 Oct 26 13:03:01.665692 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 74/175] 10.222.0.40 () {58 vars in 1203 bytes} [Wed Oct 26 13:03:01 2022] GET /compute/v2.1/flavors/1600943620/os-extra_specs => generated 19 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 26 13:03:01.678155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-75ba2df2-00d1-43ae-a803-7a1808a9dd95 tempest-FlavorsExtraSpecsTestJSON-575491547 tempest-FlavorsExtraSpecsTestJSON-575491547-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:01.709906 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2634ef22-080c-4f0a-89c3-b75ec8637b89 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:01.720869 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-75ba2df2-00d1-43ae-a803-7a1808a9dd95 tempest-FlavorsExtraSpecsTestJSON-575491547 tempest-FlavorsExtraSpecsTestJSON-575491547-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1600943620" status: 202 len: 0 microversion: 2.1 time: 0.046191 Oct 26 13:03:01.721791 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 75/176] 10.222.0.40 () {58 vars in 1161 bytes} [Wed Oct 26 13:03:01 2022] DELETE /compute/v2.1/flavors/1600943620 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:03:01.729831 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2634ef22-080c-4f0a-89c3-b75ec8637b89 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1270 microversion: 2.1 time: 0.283891 Oct 26 13:03:01.729942 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-25185f72-385e-4d83-acf3-71c12ee7840f tempest-FlavorsExtraSpecsTestJSON-575491547 tempest-FlavorsExtraSpecsTestJSON-575491547-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:01.735375 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 102/177] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:01 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1270 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:03:01.760165 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=71,nova_api:SAVEPOINT=9,nova_api:INSERT=5,nova_api:RELEASE=9,nova_api:UPDATE=1,nova_api:DELETE=5 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:03:01.768112 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-25185f72-385e-4d83-acf3-71c12ee7840f tempest-FlavorsExtraSpecsTestJSON-575491547 tempest-FlavorsExtraSpecsTestJSON-575491547-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042189 Oct 26 13:03:01.769399 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 76/178] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:03:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:03:01.854424 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-46c89adc-4eae-45ad-a16b-81d4a7e4849a tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:01.855158 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-46c89adc-4eae-45ad-a16b-81d4a7e4849a tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] [instance: 5984db52-3d30-4265-af13-6d9c16b63159] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:01.892587 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46c89adc-4eae-45ad-a16b-81d4a7e4849a tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:01.901944 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46c89adc-4eae-45ad-a16b-81d4a7e4849a tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:01.903480 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46c89adc-4eae-45ad-a16b-81d4a7e4849a tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:01.907042 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46c89adc-4eae-45ad-a16b-81d4a7e4849a tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:01.908436 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46c89adc-4eae-45ad-a16b-81d4a7e4849a tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:01.910860 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46c89adc-4eae-45ad-a16b-81d4a7e4849a tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:02.446081 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-46c89adc-4eae-45ad-a16b-81d4a7e4849a tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db8f8e223a145abbe4a20edb9ce60d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc559afd836047ccbeba91fca9c0d527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:02.455264 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-46c89adc-4eae-45ad-a16b-81d4a7e4849a tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] 10.222.0.40 "GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159" status: 200 len: 1337 microversion: 2.1 time: 0.611212 Oct 26 13:03:02.469922 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 103/179] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:01 2022] GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159 => generated 1337 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:02.753371 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-619b62b8-0cba-4ba9-9234-b33aca0572cf tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:02.754156 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-619b62b8-0cba-4ba9-9234-b33aca0572cf tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:02.777199 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-619b62b8-0cba-4ba9-9234-b33aca0572cf tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:02.780341 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-619b62b8-0cba-4ba9-9234-b33aca0572cf tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:02.781698 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-619b62b8-0cba-4ba9-9234-b33aca0572cf tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:02.785208 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-619b62b8-0cba-4ba9-9234-b33aca0572cf tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:02.790217 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-619b62b8-0cba-4ba9-9234-b33aca0572cf tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:02.790926 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-619b62b8-0cba-4ba9-9234-b33aca0572cf tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:03.491860 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d6ad96a1-06b7-4100-bf82-46bd63add72c tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:03.492632 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d6ad96a1-06b7-4100-bf82-46bd63add72c tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] [instance: 5984db52-3d30-4265-af13-6d9c16b63159] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:03.505835 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6ad96a1-06b7-4100-bf82-46bd63add72c tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:03.506320 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6ad96a1-06b7-4100-bf82-46bd63add72c tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:03.506761 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6ad96a1-06b7-4100-bf82-46bd63add72c tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:03.507471 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6ad96a1-06b7-4100-bf82-46bd63add72c tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:03.507928 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6ad96a1-06b7-4100-bf82-46bd63add72c tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:03.508347 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6ad96a1-06b7-4100-bf82-46bd63add72c tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:03.674882 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-619b62b8-0cba-4ba9-9234-b33aca0572cf tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:03.688124 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-619b62b8-0cba-4ba9-9234-b33aca0572cf tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1312 microversion: 2.1 time: 0.939308 Oct 26 13:03:03.689234 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 77/180] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:02 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1312 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:04.116686 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d6ad96a1-06b7-4100-bf82-46bd63add72c tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db8f8e223a145abbe4a20edb9ce60d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc559afd836047ccbeba91fca9c0d527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:04.126053 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=14 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:03:04.130762 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d6ad96a1-06b7-4100-bf82-46bd63add72c tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] 10.222.0.40 "GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159" status: 200 len: 1337 microversion: 2.1 time: 0.642609 Oct 26 13:03:04.153196 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 104/181] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:03 2022] GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159 => generated 1337 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:03:04.714396 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a607c0d9-4870-40ea-b9f6-eb2953eed6cb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:04.715141 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a607c0d9-4870-40ea-b9f6-eb2953eed6cb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:04.732692 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a607c0d9-4870-40ea-b9f6-eb2953eed6cb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:04.733574 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a607c0d9-4870-40ea-b9f6-eb2953eed6cb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:04.736596 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a607c0d9-4870-40ea-b9f6-eb2953eed6cb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:04.739573 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a607c0d9-4870-40ea-b9f6-eb2953eed6cb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:04.742939 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a607c0d9-4870-40ea-b9f6-eb2953eed6cb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:04.753321 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a607c0d9-4870-40ea-b9f6-eb2953eed6cb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:05.161290 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1b660d61-d28f-4096-8803-69e6eeb3a6c3 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:05.162801 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1b660d61-d28f-4096-8803-69e6eeb3a6c3 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] [instance: 5984db52-3d30-4265-af13-6d9c16b63159] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:05.174148 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b660d61-d28f-4096-8803-69e6eeb3a6c3 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:05.174920 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b660d61-d28f-4096-8803-69e6eeb3a6c3 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:05.176122 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b660d61-d28f-4096-8803-69e6eeb3a6c3 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:05.176989 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b660d61-d28f-4096-8803-69e6eeb3a6c3 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:05.186939 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b660d61-d28f-4096-8803-69e6eeb3a6c3 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:05.188788 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b660d61-d28f-4096-8803-69e6eeb3a6c3 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:05.559560 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1b660d61-d28f-4096-8803-69e6eeb3a6c3 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db8f8e223a145abbe4a20edb9ce60d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc559afd836047ccbeba91fca9c0d527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:05.567898 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1b660d61-d28f-4096-8803-69e6eeb3a6c3 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] 10.222.0.40 "GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159" status: 200 len: 1337 microversion: 2.1 time: 0.411340 Oct 26 13:03:05.568477 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 105/182] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:05 2022] GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159 => generated 1337 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:05.928348 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a607c0d9-4870-40ea-b9f6-eb2953eed6cb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:05.941374 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a607c0d9-4870-40ea-b9f6-eb2953eed6cb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1312 microversion: 2.1 time: 1.231385 Oct 26 13:03:05.942001 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 78/183] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:04 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1312 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:06.596056 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5047e246-e42b-4a3b-85cb-cadabcf1ba19 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:06.597806 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5047e246-e42b-4a3b-85cb-cadabcf1ba19 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] [instance: 5984db52-3d30-4265-af13-6d9c16b63159] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:06.616086 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5047e246-e42b-4a3b-85cb-cadabcf1ba19 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:06.616532 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5047e246-e42b-4a3b-85cb-cadabcf1ba19 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:06.616979 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5047e246-e42b-4a3b-85cb-cadabcf1ba19 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:06.617728 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5047e246-e42b-4a3b-85cb-cadabcf1ba19 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:06.625877 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5047e246-e42b-4a3b-85cb-cadabcf1ba19 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:06.631361 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5047e246-e42b-4a3b-85cb-cadabcf1ba19 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:07.198796 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5047e246-e42b-4a3b-85cb-cadabcf1ba19 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db8f8e223a145abbe4a20edb9ce60d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc559afd836047ccbeba91fca9c0d527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:07.238437 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5047e246-e42b-4a3b-85cb-cadabcf1ba19 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] 10.222.0.40 "GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159" status: 200 len: 1337 microversion: 2.1 time: 0.647257 Oct 26 13:03:07.246895 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 106/184] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:06 2022] GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159 => generated 1337 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:07.285514 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-abd331cb-9248-4a72-8fe5-46251a94ef2b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:07.289767 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-abd331cb-9248-4a72-8fe5-46251a94ef2b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:07.333178 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-abd331cb-9248-4a72-8fe5-46251a94ef2b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:07.338419 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-abd331cb-9248-4a72-8fe5-46251a94ef2b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:07.343707 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-abd331cb-9248-4a72-8fe5-46251a94ef2b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:07.346977 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-abd331cb-9248-4a72-8fe5-46251a94ef2b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:07.350459 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-abd331cb-9248-4a72-8fe5-46251a94ef2b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:07.351016 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-abd331cb-9248-4a72-8fe5-46251a94ef2b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:07.747402 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3c61c90b-4473-4822-887b-154e1d21920f tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Calling method '.version_select at 0x7f67331f3af0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:07.754343 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3c61c90b-4473-4822-887b-154e1d21920f tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:07.755572 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3c61c90b-4473-4822-887b-154e1d21920f tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:07.756308 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3c61c90b-4473-4822-887b-154e1d21920f tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:07.757778 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3c61c90b-4473-4822-887b-154e1d21920f tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:07.759968 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3c61c90b-4473-4822-887b-154e1d21920f tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:07.761234 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3c61c90b-4473-4822-887b-154e1d21920f tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:07.831622 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=12 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:03:07.838185 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3c61c90b-4473-4822-887b-154e1d21920f tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts" status: 200 len: 396 microversion: 2.1 time: 1.168026 Oct 26 13:03:07.840484 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 79/185] 10.222.0.40 () {58 vars in 1128 bytes} [Wed Oct 26 13:03:06 2022] GET /compute/v2.1/os-hosts => generated 396 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:07.862998 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1ecf8d1a-7804-4e7f-af3b-dbea066ffbcb tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Calling method '.version_select at 0x7f67332d8550>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:07.885205 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1ecf8d1a-7804-4e7f-af3b-dbea066ffbcb tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:07.886115 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1ecf8d1a-7804-4e7f-af3b-dbea066ffbcb tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:07.886735 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1ecf8d1a-7804-4e7f-af3b-dbea066ffbcb tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:07.888844 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1ecf8d1a-7804-4e7f-af3b-dbea066ffbcb tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:07.890158 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1ecf8d1a-7804-4e7f-af3b-dbea066ffbcb tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:07.891965 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1ecf8d1a-7804-4e7f-af3b-dbea066ffbcb tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:07.959782 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1ecf8d1a-7804-4e7f-af3b-dbea066ffbcb tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 396 microversion: 2.1 time: 0.111750 Oct 26 13:03:07.962299 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 80/186] 10.222.0.40 () {58 vars in 1139 bytes} [Wed Oct 26 13:03:07 2022] GET /compute/v2.1/os-hosts?zone= => generated 396 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:07.973744 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0316c029-08bf-4956-b486-166322488a59 tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Calling method '.version_select at 0x7f67332d8940>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:07.985359 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0316c029-08bf-4956-b486-166322488a59 tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:07.986173 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0316c029-08bf-4956-b486-166322488a59 tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:07.990666 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0316c029-08bf-4956-b486-166322488a59 tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:07.991670 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0316c029-08bf-4956-b486-166322488a59 tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:07.992926 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0316c029-08bf-4956-b486-166322488a59 tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:07.995120 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0316c029-08bf-4956-b486-166322488a59 tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:08.048108 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0316c029-08bf-4956-b486-166322488a59 tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.071372 Oct 26 13:03:08.049647 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 81/187] 10.222.0.40 () {58 vars in 1145 bytes} [Wed Oct 26 13:03:07 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:03:08.260566 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-abd331cb-9248-4a72-8fe5-46251a94ef2b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:08.264082 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-55416d98-9402-4bfa-95e9-18b4232eae8c tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-101040821", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:08.277589 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-abd331cb-9248-4a72-8fe5-46251a94ef2b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1312 microversion: 2.1 time: 1.029597 Oct 26 13:03:08.301693 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 107/188] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:07 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1312 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:08.307767 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a21d70d7-ef7b-4d45-9117-ad4a86c6b7a4 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:08.316520 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a21d70d7-ef7b-4d45-9117-ad4a86c6b7a4 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] [instance: 5984db52-3d30-4265-af13-6d9c16b63159] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:08.336836 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a21d70d7-ef7b-4d45-9117-ad4a86c6b7a4 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:08.341022 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a21d70d7-ef7b-4d45-9117-ad4a86c6b7a4 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:08.342186 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a21d70d7-ef7b-4d45-9117-ad4a86c6b7a4 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:08.344141 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a21d70d7-ef7b-4d45-9117-ad4a86c6b7a4 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:08.345261 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a21d70d7-ef7b-4d45-9117-ad4a86c6b7a4 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:08.347104 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a21d70d7-ef7b-4d45-9117-ad4a86c6b7a4 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:08.440393 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-55416d98-9402-4bfa-95e9-18b4232eae8c tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] validate_networks() for None {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:03:08.819493 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a21d70d7-ef7b-4d45-9117-ad4a86c6b7a4 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db8f8e223a145abbe4a20edb9ce60d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc559afd836047ccbeba91fca9c0d527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:08.829186 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a21d70d7-ef7b-4d45-9117-ad4a86c6b7a4 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] 10.222.0.40 "GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159" status: 200 len: 1337 microversion: 2.1 time: 0.525987 Oct 26 13:03:08.830048 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 108/189] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:08 2022] GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159 => generated 1337 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:09.160935 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-55416d98-9402-4bfa-95e9-18b4232eae8c tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:03:09.161420 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-55416d98-9402-4bfa-95e9-18b4232eae8c tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:03:09.161981 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-55416d98-9402-4bfa-95e9-18b4232eae8c tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:03:09.162405 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-55416d98-9402-4bfa-95e9-18b4232eae8c tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:03:09.162871 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-55416d98-9402-4bfa-95e9-18b4232eae8c tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:03:09.185900 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-55416d98-9402-4bfa-95e9-18b4232eae8c tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:09.188606 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-55416d98-9402-4bfa-95e9-18b4232eae8c tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:09.204000 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-55416d98-9402-4bfa-95e9-18b4232eae8c tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:09.206619 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-55416d98-9402-4bfa-95e9-18b4232eae8c tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:09.208795 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-55416d98-9402-4bfa-95e9-18b4232eae8c tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:09.210599 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-55416d98-9402-4bfa-95e9-18b4232eae8c tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:09.271556 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-55416d98-9402-4bfa-95e9-18b4232eae8c tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Getting quotas for project d4e2b56ef8db404ca0372e0a9c5f9b16. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:03:09.282554 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-55416d98-9402-4bfa-95e9-18b4232eae8c tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Getting quotas for user 999ac729ed1f4456857c8671d4b9be8a and project d4e2b56ef8db404ca0372e0a9c5f9b16. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:03:09.308367 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-19e5214f-6b81-455c-9867-f820f31b6a89 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:09.309164 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-19e5214f-6b81-455c-9867-f820f31b6a89 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:09.317639 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-55416d98-9402-4bfa-95e9-18b4232eae8c tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:03:09.321280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-19e5214f-6b81-455c-9867-f820f31b6a89 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:09.324065 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-55416d98-9402-4bfa-95e9-18b4232eae8c tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] [instance: 32f65838-4cb1-4465-977b-2d320a3e3858] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:03:09.341910 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-19e5214f-6b81-455c-9867-f820f31b6a89 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:09.342390 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-19e5214f-6b81-455c-9867-f820f31b6a89 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:09.343432 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-19e5214f-6b81-455c-9867-f820f31b6a89 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:09.344133 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-19e5214f-6b81-455c-9867-f820f31b6a89 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:09.344775 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-19e5214f-6b81-455c-9867-f820f31b6a89 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:09.445969 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-55416d98-9402-4bfa-95e9-18b4232eae8c tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.392978 Oct 26 13:03:09.448798 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 82/190] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:03:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1398 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:03:09.470869 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f538b04b-8425-46b4-9183-a5b0a613041f tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:09.471649 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f538b04b-8425-46b4-9183-a5b0a613041f tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] [instance: 32f65838-4cb1-4465-977b-2d320a3e3858] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:09.687721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-19e5214f-6b81-455c-9867-f820f31b6a89 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:09.699349 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-19e5214f-6b81-455c-9867-f820f31b6a89 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1312 microversion: 2.1 time: 0.394903 Oct 26 13:03:09.722114 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 109/191] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:09 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1312 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:03:09.749220 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f538b04b-8425-46b4-9183-a5b0a613041f tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999ac729ed1f4456857c8671d4b9be8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e2b56ef8db404ca0372e0a9c5f9b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:09.761383 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f538b04b-8425-46b4-9183-a5b0a613041f tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] 10.222.0.40 "GET /compute/v2.1/servers/32f65838-4cb1-4465-977b-2d320a3e3858" status: 200 len: 1218 microversion: 2.1 time: 0.297913 Oct 26 13:03:09.776275 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 83/192] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:09 2022] GET /compute/v2.1/servers/32f65838-4cb1-4465-977b-2d320a3e3858 => generated 1218 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:09.854908 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-11f9c9d5-dd17-48d4-9758-1b3670034aac tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:09.855801 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-11f9c9d5-dd17-48d4-9758-1b3670034aac tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] [instance: 5984db52-3d30-4265-af13-6d9c16b63159] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:09.875590 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11f9c9d5-dd17-48d4-9758-1b3670034aac tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:09.876468 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11f9c9d5-dd17-48d4-9758-1b3670034aac tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:09.877215 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11f9c9d5-dd17-48d4-9758-1b3670034aac tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:09.878295 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11f9c9d5-dd17-48d4-9758-1b3670034aac tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:09.878974 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11f9c9d5-dd17-48d4-9758-1b3670034aac tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:09.880739 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11f9c9d5-dd17-48d4-9758-1b3670034aac tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:10.481177 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-26173d82-cd79-41be-8dda-c66fe3c9a5aa req-8ce87619-e426-4fed-ab9e-bfd321220050 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c858b29-db9e-4d65-af6d-86b6e1d36c45", "tag": "fbefc9ba-9ae6-4d00-93d2-059d7c60c35f"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:10.509184 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-26173d82-cd79-41be-8dda-c66fe3c9a5aa req-8ce87619-e426-4fed-ab9e-bfd321220050 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:10.514716 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-26173d82-cd79-41be-8dda-c66fe3c9a5aa req-8ce87619-e426-4fed-ab9e-bfd321220050 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:10.515657 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-26173d82-cd79-41be-8dda-c66fe3c9a5aa req-8ce87619-e426-4fed-ab9e-bfd321220050 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:10.539410 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-26173d82-cd79-41be-8dda-c66fe3c9a5aa req-8ce87619-e426-4fed-ab9e-bfd321220050 service nova] Creating event network-changed:fbefc9ba-9ae6-4d00-93d2-059d7c60c35f for instance 3c858b29-db9e-4d65-af6d-86b6e1d36c45 on n-h1-862686-1 Oct 26 13:03:10.563782 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-26173d82-cd79-41be-8dda-c66fe3c9a5aa req-8ce87619-e426-4fed-ab9e-bfd321220050 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087454 Oct 26 13:03:10.564680 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 84/193] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:10.720251 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-11f9c9d5-dd17-48d4-9758-1b3670034aac tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db8f8e223a145abbe4a20edb9ce60d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc559afd836047ccbeba91fca9c0d527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:10.736222 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-81a24509-5e53-44fd-9c39-b2ac867f2dd8 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:10.737468 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-81a24509-5e53-44fd-9c39-b2ac867f2dd8 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:10.751172 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81a24509-5e53-44fd-9c39-b2ac867f2dd8 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:10.751688 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81a24509-5e53-44fd-9c39-b2ac867f2dd8 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:10.756499 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-11f9c9d5-dd17-48d4-9758-1b3670034aac tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] 10.222.0.40 "GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159" status: 200 len: 1337 microversion: 2.1 time: 0.906132 Oct 26 13:03:10.758754 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 110/194] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:09 2022] GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159 => generated 1337 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:10.767533 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81a24509-5e53-44fd-9c39-b2ac867f2dd8 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:10.769288 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81a24509-5e53-44fd-9c39-b2ac867f2dd8 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:10.770946 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81a24509-5e53-44fd-9c39-b2ac867f2dd8 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:10.771611 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81a24509-5e53-44fd-9c39-b2ac867f2dd8 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:10.790163 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b713e803-6cf0-45d4-bddc-a1f0dac5df41 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:10.791598 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b713e803-6cf0-45d4-bddc-a1f0dac5df41 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] [instance: 32f65838-4cb1-4465-977b-2d320a3e3858] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:10.805134 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b713e803-6cf0-45d4-bddc-a1f0dac5df41 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:10.808275 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b713e803-6cf0-45d4-bddc-a1f0dac5df41 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:10.808869 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b713e803-6cf0-45d4-bddc-a1f0dac5df41 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:10.810045 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b713e803-6cf0-45d4-bddc-a1f0dac5df41 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:10.812058 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b713e803-6cf0-45d4-bddc-a1f0dac5df41 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:10.813416 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b713e803-6cf0-45d4-bddc-a1f0dac5df41 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:11.242006 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b713e803-6cf0-45d4-bddc-a1f0dac5df41 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999ac729ed1f4456857c8671d4b9be8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e2b56ef8db404ca0372e0a9c5f9b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:11.263042 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b713e803-6cf0-45d4-bddc-a1f0dac5df41 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] 10.222.0.40 "GET /compute/v2.1/servers/32f65838-4cb1-4465-977b-2d320a3e3858" status: 200 len: 1214 microversion: 2.1 time: 0.475706 Oct 26 13:03:11.263669 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 111/195] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:10 2022] GET /compute/v2.1/servers/32f65838-4cb1-4465-977b-2d320a3e3858 => generated 1214 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:03:11.463783 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-81a24509-5e53-44fd-9c39-b2ac867f2dd8 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:11.499177 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-81a24509-5e53-44fd-9c39-b2ac867f2dd8 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1312 microversion: 2.1 time: 0.768610 Oct 26 13:03:11.504250 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 85/196] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:10 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1312 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:11.784303 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6ba4ae8e-1baf-447d-b555-b7cdcf0fc71b tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:11.786229 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6ba4ae8e-1baf-447d-b555-b7cdcf0fc71b tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] [instance: 5984db52-3d30-4265-af13-6d9c16b63159] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:11.797418 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ba4ae8e-1baf-447d-b555-b7cdcf0fc71b tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:11.797964 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ba4ae8e-1baf-447d-b555-b7cdcf0fc71b tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:11.798469 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ba4ae8e-1baf-447d-b555-b7cdcf0fc71b tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:11.801961 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ba4ae8e-1baf-447d-b555-b7cdcf0fc71b tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:11.814268 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ba4ae8e-1baf-447d-b555-b7cdcf0fc71b tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:11.821070 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ba4ae8e-1baf-447d-b555-b7cdcf0fc71b tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:12.380056 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-a644b617-dbb8-4b70-bcb2-891ee843c7a7 req-08c484f2-0823-482d-956e-0f1bdbdba25e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5984db52-3d30-4265-af13-6d9c16b63159", "name": "network-vif-plugged", "status": "completed", "tag": "ff83dcc1-3e55-4a32-82d7-062ae132ad46"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:12.414930 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a644b617-dbb8-4b70-bcb2-891ee843c7a7 req-08c484f2-0823-482d-956e-0f1bdbdba25e service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:12.415602 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a644b617-dbb8-4b70-bcb2-891ee843c7a7 req-08c484f2-0823-482d-956e-0f1bdbdba25e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:12.417090 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a644b617-dbb8-4b70-bcb2-891ee843c7a7 req-08c484f2-0823-482d-956e-0f1bdbdba25e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:12.441631 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-a644b617-dbb8-4b70-bcb2-891ee843c7a7 req-08c484f2-0823-482d-956e-0f1bdbdba25e service nova] Creating event network-vif-plugged:ff83dcc1-3e55-4a32-82d7-062ae132ad46 for instance 5984db52-3d30-4265-af13-6d9c16b63159 on n-h2-862686-1 Oct 26 13:03:12.455505 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-a644b617-dbb8-4b70-bcb2-891ee843c7a7 req-08c484f2-0823-482d-956e-0f1bdbdba25e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.397134 Oct 26 13:03:12.456798 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 86/197] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:12.467241 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cb9c6297-998e-48e6-a076-c1756b9f9438 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:12.474480 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cb9c6297-998e-48e6-a076-c1756b9f9438 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] [instance: 32f65838-4cb1-4465-977b-2d320a3e3858] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:12.488123 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb9c6297-998e-48e6-a076-c1756b9f9438 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:12.488879 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb9c6297-998e-48e6-a076-c1756b9f9438 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:12.489577 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb9c6297-998e-48e6-a076-c1756b9f9438 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:12.493150 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb9c6297-998e-48e6-a076-c1756b9f9438 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:12.494210 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb9c6297-998e-48e6-a076-c1756b9f9438 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:12.494936 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb9c6297-998e-48e6-a076-c1756b9f9438 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:12.927789 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6ba4ae8e-1baf-447d-b555-b7cdcf0fc71b tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db8f8e223a145abbe4a20edb9ce60d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc559afd836047ccbeba91fca9c0d527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:12.939001 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6ba4ae8e-1baf-447d-b555-b7cdcf0fc71b tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] 10.222.0.40 "GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159" status: 200 len: 1337 microversion: 2.1 time: 1.158709 Oct 26 13:03:12.945208 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 112/198] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:11 2022] GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159 => generated 1337 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:12.951172 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7ae28cdc-2774-42c0-913f-d6b6c49c1cdc tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:12.954893 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7ae28cdc-2774-42c0-913f-d6b6c49c1cdc tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:12.955314 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cb9c6297-998e-48e6-a076-c1756b9f9438 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999ac729ed1f4456857c8671d4b9be8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e2b56ef8db404ca0372e0a9c5f9b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:12.967855 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ae28cdc-2774-42c0-913f-d6b6c49c1cdc tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:12.970175 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ae28cdc-2774-42c0-913f-d6b6c49c1cdc tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:12.970799 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ae28cdc-2774-42c0-913f-d6b6c49c1cdc tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:12.971017 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cb9c6297-998e-48e6-a076-c1756b9f9438 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] 10.222.0.40 "GET /compute/v2.1/servers/32f65838-4cb1-4465-977b-2d320a3e3858" status: 200 len: 1276 microversion: 2.1 time: 0.512677 Oct 26 13:03:12.971642 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 87/199] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:12 2022] GET /compute/v2.1/servers/32f65838-4cb1-4465-977b-2d320a3e3858 => generated 1276 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:12.985625 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ae28cdc-2774-42c0-913f-d6b6c49c1cdc tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:12.985625 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ae28cdc-2774-42c0-913f-d6b6c49c1cdc tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:12.985625 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ae28cdc-2774-42c0-913f-d6b6c49c1cdc tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:13.202112 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0759b371-d67f-472f-8099-5e8b6159f243 tempest-FlavorsV255TestJSON-358984407 tempest-FlavorsV255TestJSON-358984407-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-136506770", "id": 457166079, "os-flavor-access:is_public": "True"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:13.235736 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0759b371-d67f-472f-8099-5e8b6159f243 tempest-FlavorsV255TestJSON-358984407 tempest-FlavorsV255TestJSON-358984407-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 445 microversion: 2.55 time: 0.248256 Oct 26 13:03:13.246485 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 88/200] 10.222.0.40 () {62 vars in 1188 bytes} [Wed Oct 26 13:03:12 2022] POST /compute/v2.1/flavors => generated 445 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:03:13.494662 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-af8b75e0-5d51-4eed-a35a-47a9c48cdf0a tempest-FlavorsV255TestJSON-275884410 tempest-FlavorsV255TestJSON-275884410-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:13.509179 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-af8b75e0-5d51-4eed-a35a-47a9c48cdf0a tempest-FlavorsV255TestJSON-275884410 tempest-FlavorsV255TestJSON-275884410-project] 10.222.0.40 "GET /compute/v2.1/flavors/457166079" status: 200 len: 445 microversion: 2.55 time: 0.260568 Oct 26 13:03:13.521884 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 89/201] 10.222.0.40 () {60 vars in 1196 bytes} [Wed Oct 26 13:03:13 2022] GET /compute/v2.1/flavors/457166079 => generated 445 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:03:13.532334 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9e250e25-53f1-4ef8-93aa-4c295991d485 tempest-FlavorsV255TestJSON-358984407 tempest-FlavorsV255TestJSON-358984407-project-admin] Action: 'update', calling method: .version_select at 0x7f6734452b80>, body: {"flavor": {"description": "new"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:13.652308 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9e250e25-53f1-4ef8-93aa-4c295991d485 tempest-FlavorsV255TestJSON-358984407 tempest-FlavorsV255TestJSON-358984407-project-admin] 10.222.0.40 "PUT /compute/v2.1/flavors/457166079" status: 200 len: 446 microversion: 2.55 time: 0.127826 Oct 26 13:03:13.663615 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7ae28cdc-2774-42c0-913f-d6b6c49c1cdc tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:13.664199 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 90/202] 10.222.0.40 () {62 vars in 1216 bytes} [Wed Oct 26 13:03:13 2022] PUT /compute/v2.1/flavors/457166079 => generated 446 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:03:13.675842 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7ae28cdc-2774-42c0-913f-d6b6c49c1cdc tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1312 microversion: 2.1 time: 0.729301 Oct 26 13:03:13.677605 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-70d979cd-4118-440c-9c8b-f5fc41d749cd tempest-FlavorsV255TestJSON-275884410 tempest-FlavorsV255TestJSON-275884410-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:13.678356 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 113/203] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:12 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1312 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:13.708258 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-70d979cd-4118-440c-9c8b-f5fc41d749cd tempest-FlavorsV255TestJSON-275884410 tempest-FlavorsV255TestJSON-275884410-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5721 microversion: 2.55 time: 0.042693 Oct 26 13:03:13.722623 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 91/204] 10.222.0.40 () {60 vars in 1187 bytes} [Wed Oct 26 13:03:13 2022] GET /compute/v2.1/flavors/detail => generated 5721 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:03:13.732021 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2539da0e-b68c-41ed-ac51-a11dfc3e4ec5 tempest-FlavorsV255TestJSON-275884410 tempest-FlavorsV255TestJSON-275884410-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:13.763652 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2539da0e-b68c-41ed-ac51-a11dfc3e4ec5 tempest-FlavorsV255TestJSON-275884410 tempest-FlavorsV255TestJSON-275884410-project] 10.222.0.40 "GET /compute/v2.1/flavors" status: 200 len: 3153 microversion: 2.55 time: 0.037042 Oct 26 13:03:13.764550 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 114/205] 10.222.0.40 () {60 vars in 1166 bytes} [Wed Oct 26 13:03:13 2022] GET /compute/v2.1/flavors => generated 3153 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:03:13.782275 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5824088f-3639-4a27-8a9c-e08a0cdd46dc tempest-FlavorsV255TestJSON-358984407 tempest-FlavorsV255TestJSON-358984407-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:13.819416 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5824088f-3639-4a27-8a9c-e08a0cdd46dc tempest-FlavorsV255TestJSON-358984407 tempest-FlavorsV255TestJSON-358984407-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/457166079" status: 202 len: 0 microversion: 2.55 time: 0.038015 Oct 26 13:03:13.819416 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 92/206] 10.222.0.40 () {60 vars in 1199 bytes} [Wed Oct 26 13:03:13 2022] DELETE /compute/v2.1/flavors/457166079 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:03:13.825947 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-716fdd15-8519-48b2-9e99-eb3f4d65e9ac tempest-FlavorsV255TestJSON-358984407 tempest-FlavorsV255TestJSON-358984407-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:13.865647 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-716fdd15-8519-48b2-9e99-eb3f4d65e9ac tempest-FlavorsV255TestJSON-358984407 tempest-FlavorsV255TestJSON-358984407-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.045270 Oct 26 13:03:13.866749 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 115/207] 10.222.0.40 () {60 vars in 1187 bytes} [Wed Oct 26 13:03:13 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:03:13.972182 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-582fbc40-f835-463e-9480-b07a9c0533d0 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:13.973147 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-582fbc40-f835-463e-9480-b07a9c0533d0 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] [instance: 5984db52-3d30-4265-af13-6d9c16b63159] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:13.984640 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-582fbc40-f835-463e-9480-b07a9c0533d0 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:13.985142 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-582fbc40-f835-463e-9480-b07a9c0533d0 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:13.985616 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-582fbc40-f835-463e-9480-b07a9c0533d0 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:13.986327 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-582fbc40-f835-463e-9480-b07a9c0533d0 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:13.999143 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-582fbc40-f835-463e-9480-b07a9c0533d0 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:13.999665 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-582fbc40-f835-463e-9480-b07a9c0533d0 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:14.004542 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-896dc759-23d9-4999-8100-3fd182c5fbac tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:14.005281 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-896dc759-23d9-4999-8100-3fd182c5fbac tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] [instance: 32f65838-4cb1-4465-977b-2d320a3e3858] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:14.033344 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-896dc759-23d9-4999-8100-3fd182c5fbac tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:14.034137 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-896dc759-23d9-4999-8100-3fd182c5fbac tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:14.036650 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-896dc759-23d9-4999-8100-3fd182c5fbac tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:14.040252 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-896dc759-23d9-4999-8100-3fd182c5fbac tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:14.041154 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-896dc759-23d9-4999-8100-3fd182c5fbac tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:14.042480 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-896dc759-23d9-4999-8100-3fd182c5fbac tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:14.074952 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:03:14.393830 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-896dc759-23d9-4999-8100-3fd182c5fbac tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999ac729ed1f4456857c8671d4b9be8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e2b56ef8db404ca0372e0a9c5f9b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:14.409613 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-896dc759-23d9-4999-8100-3fd182c5fbac tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] 10.222.0.40 "GET /compute/v2.1/servers/32f65838-4cb1-4465-977b-2d320a3e3858" status: 200 len: 1276 microversion: 2.1 time: 0.413524 Oct 26 13:03:14.410460 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 116/208] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:13 2022] GET /compute/v2.1/servers/32f65838-4cb1-4465-977b-2d320a3e3858 => generated 1276 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:14.592756 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-582fbc40-f835-463e-9480-b07a9c0533d0 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db8f8e223a145abbe4a20edb9ce60d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc559afd836047ccbeba91fca9c0d527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:14.601861 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-582fbc40-f835-463e-9480-b07a9c0533d0 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] 10.222.0.40 "GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159" status: 200 len: 1337 microversion: 2.1 time: 0.633559 Oct 26 13:03:14.606018 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 93/209] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:13 2022] GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159 => generated 1337 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:14.706858 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-73537359-8936-45f7-9983-9b53d376301a tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:14.709183 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-73537359-8936-45f7-9983-9b53d376301a tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:14.721889 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:DELETE=4,nova_api:SELECT=89,nova_api:INSERT=3,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:03:14.724748 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73537359-8936-45f7-9983-9b53d376301a tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:14.725399 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73537359-8936-45f7-9983-9b53d376301a tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:14.726065 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73537359-8936-45f7-9983-9b53d376301a tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:14.730270 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73537359-8936-45f7-9983-9b53d376301a tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:14.731249 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73537359-8936-45f7-9983-9b53d376301a tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:14.731893 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73537359-8936-45f7-9983-9b53d376301a tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:15.000399 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-73537359-8936-45f7-9983-9b53d376301a tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:15.018354 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-73537359-8936-45f7-9983-9b53d376301a tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1312 microversion: 2.1 time: 0.318952 Oct 26 13:03:15.020105 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 117/210] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:14 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1312 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:15.435495 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-752dae8c-9bdd-4e00-9735-68e1a8422f27 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:15.436127 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-752dae8c-9bdd-4e00-9735-68e1a8422f27 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] [instance: 32f65838-4cb1-4465-977b-2d320a3e3858] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:15.453629 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-752dae8c-9bdd-4e00-9735-68e1a8422f27 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:15.454128 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-752dae8c-9bdd-4e00-9735-68e1a8422f27 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:15.454569 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-752dae8c-9bdd-4e00-9735-68e1a8422f27 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:15.455279 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-752dae8c-9bdd-4e00-9735-68e1a8422f27 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:15.455733 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-752dae8c-9bdd-4e00-9735-68e1a8422f27 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:15.456158 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-752dae8c-9bdd-4e00-9735-68e1a8422f27 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:15.632257 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-17abd890-4cd7-4201-9b68-74254862676f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:15.633140 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-17abd890-4cd7-4201-9b68-74254862676f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] [instance: 5984db52-3d30-4265-af13-6d9c16b63159] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:15.647836 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17abd890-4cd7-4201-9b68-74254862676f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:15.648563 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17abd890-4cd7-4201-9b68-74254862676f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:15.664311 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17abd890-4cd7-4201-9b68-74254862676f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:15.665262 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17abd890-4cd7-4201-9b68-74254862676f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:15.666714 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17abd890-4cd7-4201-9b68-74254862676f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:15.668061 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17abd890-4cd7-4201-9b68-74254862676f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:15.963895 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-752dae8c-9bdd-4e00-9735-68e1a8422f27 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999ac729ed1f4456857c8671d4b9be8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e2b56ef8db404ca0372e0a9c5f9b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:15.976168 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-752dae8c-9bdd-4e00-9735-68e1a8422f27 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] 10.222.0.40 "GET /compute/v2.1/servers/32f65838-4cb1-4465-977b-2d320a3e3858" status: 200 len: 1318 microversion: 2.1 time: 0.546174 Oct 26 13:03:15.977329 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 94/211] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:15 2022] GET /compute/v2.1/servers/32f65838-4cb1-4465-977b-2d320a3e3858 => generated 1318 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:16.044789 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-42d72efb-5c9c-4960-a9b7-044505d5d1c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:16.046285 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-42d72efb-5c9c-4960-a9b7-044505d5d1c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:16.064868 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-42d72efb-5c9c-4960-a9b7-044505d5d1c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:16.066185 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-42d72efb-5c9c-4960-a9b7-044505d5d1c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:16.069557 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-42d72efb-5c9c-4960-a9b7-044505d5d1c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:16.070528 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-42d72efb-5c9c-4960-a9b7-044505d5d1c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:16.072491 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-42d72efb-5c9c-4960-a9b7-044505d5d1c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:16.074423 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-42d72efb-5c9c-4960-a9b7-044505d5d1c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:16.250152 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-17abd890-4cd7-4201-9b68-74254862676f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db8f8e223a145abbe4a20edb9ce60d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc559afd836047ccbeba91fca9c0d527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:16.261091 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-17abd890-4cd7-4201-9b68-74254862676f tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] 10.222.0.40 "GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159" status: 200 len: 1487 microversion: 2.1 time: 0.633276 Oct 26 13:03:16.280504 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 118/212] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:15 2022] GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159 => generated 1487 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:16.292908 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d724b3d1-6901-4634-a810-c5d51bb1369a tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:16.297444 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d724b3d1-6901-4634-a810-c5d51bb1369a tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] [instance: 5984db52-3d30-4265-af13-6d9c16b63159] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:16.311739 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d724b3d1-6901-4634-a810-c5d51bb1369a tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:16.312568 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d724b3d1-6901-4634-a810-c5d51bb1369a tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:16.314691 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d724b3d1-6901-4634-a810-c5d51bb1369a tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:16.317125 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d724b3d1-6901-4634-a810-c5d51bb1369a tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:16.317858 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d724b3d1-6901-4634-a810-c5d51bb1369a tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:16.319100 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d724b3d1-6901-4634-a810-c5d51bb1369a tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:16.576392 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-42d72efb-5c9c-4960-a9b7-044505d5d1c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:16.588049 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-42d72efb-5c9c-4960-a9b7-044505d5d1c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1312 microversion: 2.1 time: 0.548702 Oct 26 13:03:16.602650 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 95/213] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:16 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1312 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:17.007084 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-728a8e78-1b40-414f-86c5-3a950087dfec tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:17.007767 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-728a8e78-1b40-414f-86c5-3a950087dfec tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] [instance: 32f65838-4cb1-4465-977b-2d320a3e3858] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:17.015862 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-728a8e78-1b40-414f-86c5-3a950087dfec tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:17.016360 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-728a8e78-1b40-414f-86c5-3a950087dfec tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:17.016800 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-728a8e78-1b40-414f-86c5-3a950087dfec tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:17.017549 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-728a8e78-1b40-414f-86c5-3a950087dfec tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:17.018191 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-728a8e78-1b40-414f-86c5-3a950087dfec tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:17.019156 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-728a8e78-1b40-414f-86c5-3a950087dfec tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:17.436636 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-728a8e78-1b40-414f-86c5-3a950087dfec tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999ac729ed1f4456857c8671d4b9be8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e2b56ef8db404ca0372e0a9c5f9b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:17.447877 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-728a8e78-1b40-414f-86c5-3a950087dfec tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] 10.222.0.40 "GET /compute/v2.1/servers/32f65838-4cb1-4465-977b-2d320a3e3858" status: 200 len: 1318 microversion: 2.1 time: 0.443258 Oct 26 13:03:17.477171 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 96/214] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:17 2022] GET /compute/v2.1/servers/32f65838-4cb1-4465-977b-2d320a3e3858 => generated 1318 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:17.614951 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-43a0acf8-3c0e-4003-ace9-dc8e7f642939 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:17.615583 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-43a0acf8-3c0e-4003-ace9-dc8e7f642939 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:17.624521 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-43a0acf8-3c0e-4003-ace9-dc8e7f642939 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:17.630108 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-43a0acf8-3c0e-4003-ace9-dc8e7f642939 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:17.630630 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-43a0acf8-3c0e-4003-ace9-dc8e7f642939 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:17.631610 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-43a0acf8-3c0e-4003-ace9-dc8e7f642939 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:17.632079 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-43a0acf8-3c0e-4003-ace9-dc8e7f642939 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:17.632711 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-43a0acf8-3c0e-4003-ace9-dc8e7f642939 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:17.832298 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d724b3d1-6901-4634-a810-c5d51bb1369a tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159" status: 200 len: 1638 microversion: 2.1 time: 1.543838 Oct 26 13:03:17.835667 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 119/215] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:16 2022] GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159 => generated 1638 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:03:17.862990 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c298e54e-6f05-4d59-ac3a-f3880011151c tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:17.862990 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c298e54e-6f05-4d59-ac3a-f3880011151c tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] [instance: 5984db52-3d30-4265-af13-6d9c16b63159] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:17.883298 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c298e54e-6f05-4d59-ac3a-f3880011151c tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:17.883798 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c298e54e-6f05-4d59-ac3a-f3880011151c tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:17.884302 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c298e54e-6f05-4d59-ac3a-f3880011151c tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:17.885522 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c298e54e-6f05-4d59-ac3a-f3880011151c tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:17.886176 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c298e54e-6f05-4d59-ac3a-f3880011151c tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:17.886606 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c298e54e-6f05-4d59-ac3a-f3880011151c tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:17.948784 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c298e54e-6f05-4d59-ac3a-f3880011151c tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] [instance: 5984db52-3d30-4265-af13-6d9c16b63159] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:03:18.107717 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-43a0acf8-3c0e-4003-ace9-dc8e7f642939 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:18.123023 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-43a0acf8-3c0e-4003-ace9-dc8e7f642939 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1312 microversion: 2.1 time: 0.511602 Oct 26 13:03:18.125135 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 97/216] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:17 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1312 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:18.205168 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c298e54e-6f05-4d59-ac3a-f3880011151c tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159" status: 204 len: 0 microversion: 2.1 time: 0.345749 Oct 26 13:03:18.207398 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 120/217] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:03:17 2022] DELETE /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 26 13:03:18.221298 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f18f2958-4012-4cbb-b297-d74230542781 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:18.221942 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f18f2958-4012-4cbb-b297-d74230542781 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] [instance: 5984db52-3d30-4265-af13-6d9c16b63159] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:18.243258 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f18f2958-4012-4cbb-b297-d74230542781 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:18.252885 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f18f2958-4012-4cbb-b297-d74230542781 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:18.253693 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f18f2958-4012-4cbb-b297-d74230542781 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:18.254564 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f18f2958-4012-4cbb-b297-d74230542781 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:18.258309 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f18f2958-4012-4cbb-b297-d74230542781 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:18.258894 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f18f2958-4012-4cbb-b297-d74230542781 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:18.476202 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-55952638-f27a-42ef-8c33-192a8e69533d tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:18.477876 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-55952638-f27a-42ef-8c33-192a8e69533d tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] [instance: 32f65838-4cb1-4465-977b-2d320a3e3858] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:18.485442 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55952638-f27a-42ef-8c33-192a8e69533d tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:18.487418 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55952638-f27a-42ef-8c33-192a8e69533d tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:18.488085 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55952638-f27a-42ef-8c33-192a8e69533d tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:18.489170 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55952638-f27a-42ef-8c33-192a8e69533d tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:18.489797 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55952638-f27a-42ef-8c33-192a8e69533d tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:18.491288 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55952638-f27a-42ef-8c33-192a8e69533d tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:18.525740 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f18f2958-4012-4cbb-b297-d74230542781 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db8f8e223a145abbe4a20edb9ce60d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc559afd836047ccbeba91fca9c0d527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:18.548281 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f18f2958-4012-4cbb-b297-d74230542781 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] 10.222.0.40 "GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159" status: 200 len: 1493 microversion: 2.1 time: 0.333023 Oct 26 13:03:18.552262 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 98/218] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:18 2022] GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159 => generated 1493 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:18.922642 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-55952638-f27a-42ef-8c33-192a8e69533d tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999ac729ed1f4456857c8671d4b9be8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e2b56ef8db404ca0372e0a9c5f9b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:18.934423 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-55952638-f27a-42ef-8c33-192a8e69533d tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] 10.222.0.40 "GET /compute/v2.1/servers/32f65838-4cb1-4465-977b-2d320a3e3858" status: 200 len: 1318 microversion: 2.1 time: 0.464143 Oct 26 13:03:18.949748 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 121/219] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:18 2022] GET /compute/v2.1/servers/32f65838-4cb1-4465-977b-2d320a3e3858 => generated 1318 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:19.014358 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-7e8a1774-89f5-4de1-be9f-5653fb12cdc8 req-d39c6775-a649-47a2-a4c8-954437bd6ec9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32f65838-4cb1-4465-977b-2d320a3e3858", "tag": "6503d4b6-a910-49e8-bb75-864fa2fe4537"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:19.039417 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-7e8a1774-89f5-4de1-be9f-5653fb12cdc8 req-d39c6775-a649-47a2-a4c8-954437bd6ec9 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:19.041347 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-7e8a1774-89f5-4de1-be9f-5653fb12cdc8 req-d39c6775-a649-47a2-a4c8-954437bd6ec9 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:19.041977 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-7e8a1774-89f5-4de1-be9f-5653fb12cdc8 req-d39c6775-a649-47a2-a4c8-954437bd6ec9 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:19.056477 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-7e8a1774-89f5-4de1-be9f-5653fb12cdc8 req-d39c6775-a649-47a2-a4c8-954437bd6ec9 service nova] Creating event network-changed:6503d4b6-a910-49e8-bb75-864fa2fe4537 for instance 32f65838-4cb1-4465-977b-2d320a3e3858 on n-h1-862686-1 Oct 26 13:03:19.064525 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-7e8a1774-89f5-4de1-be9f-5653fb12cdc8 req-d39c6775-a649-47a2-a4c8-954437bd6ec9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.369127 Oct 26 13:03:19.066383 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 99/220] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:03:19.099324 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-5367fb1c-021f-4a0e-bb23-d06012c0c2b4 req-04bd5d2a-03e7-4e92-84b2-8e0ce7d1b821 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c858b29-db9e-4d65-af6d-86b6e1d36c45", "name": "network-vif-plugged", "status": "completed", "tag": "fbefc9ba-9ae6-4d00-93d2-059d7c60c35f"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:19.123271 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-5367fb1c-021f-4a0e-bb23-d06012c0c2b4 req-04bd5d2a-03e7-4e92-84b2-8e0ce7d1b821 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:19.127564 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-5367fb1c-021f-4a0e-bb23-d06012c0c2b4 req-04bd5d2a-03e7-4e92-84b2-8e0ce7d1b821 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:19.130281 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-5367fb1c-021f-4a0e-bb23-d06012c0c2b4 req-04bd5d2a-03e7-4e92-84b2-8e0ce7d1b821 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:19.163745 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-5367fb1c-021f-4a0e-bb23-d06012c0c2b4 req-04bd5d2a-03e7-4e92-84b2-8e0ce7d1b821 service nova] Creating event network-vif-plugged:fbefc9ba-9ae6-4d00-93d2-059d7c60c35f for instance 3c858b29-db9e-4d65-af6d-86b6e1d36c45 on n-h1-862686-1 Oct 26 13:03:19.176196 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-5367fb1c-021f-4a0e-bb23-d06012c0c2b4 req-04bd5d2a-03e7-4e92-84b2-8e0ce7d1b821 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081095 Oct 26 13:03:19.178936 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 100/221] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:03:19.198897 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-da21e04c-55aa-4b4b-9c3b-d11891a4d211 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:19.203803 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-da21e04c-55aa-4b4b-9c3b-d11891a4d211 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:19.213120 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-da21e04c-55aa-4b4b-9c3b-d11891a4d211 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:19.214030 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-da21e04c-55aa-4b4b-9c3b-d11891a4d211 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:19.214630 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-da21e04c-55aa-4b4b-9c3b-d11891a4d211 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:19.215481 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-da21e04c-55aa-4b4b-9c3b-d11891a4d211 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:19.216461 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-da21e04c-55aa-4b4b-9c3b-d11891a4d211 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:19.217051 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-da21e04c-55aa-4b4b-9c3b-d11891a4d211 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:19.263512 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=12 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:03:19.499836 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-dd46fe34-0d7c-4cbd-b2b7-04ce579c843f tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:19.513755 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-dd46fe34-0d7c-4cbd-b2b7-04ce579c843f tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.551915 Oct 26 13:03:19.524631 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 122/222] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 26 13:03:18 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:19.696444 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-da21e04c-55aa-4b4b-9c3b-d11891a4d211 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:19.710854 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-da21e04c-55aa-4b4b-9c3b-d11891a4d211 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1312 microversion: 2.1 time: 0.529851 Oct 26 13:03:19.712226 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 101/223] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:19 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1312 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:19.726559 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fba267c1-a1ac-4e1a-b96e-ace476239e32 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:19.730304 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fba267c1-a1ac-4e1a-b96e-ace476239e32 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] [instance: 5984db52-3d30-4265-af13-6d9c16b63159] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:19.739234 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fba267c1-a1ac-4e1a-b96e-ace476239e32 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:19.740062 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fba267c1-a1ac-4e1a-b96e-ace476239e32 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:19.740600 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fba267c1-a1ac-4e1a-b96e-ace476239e32 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:19.741442 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fba267c1-a1ac-4e1a-b96e-ace476239e32 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:19.742323 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fba267c1-a1ac-4e1a-b96e-ace476239e32 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:19.742932 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fba267c1-a1ac-4e1a-b96e-ace476239e32 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:19.770151 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=8 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:03:19.891854 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bf42e619-49d1-43bd-a8c1-a26d8e3d5882 tempest-ServersWithSpecificFlavorTestJSON-25290177 tempest-ServersWithSpecificFlavorTestJSON-25290177-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-493566031", "id": 566667230, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:19.938552 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bf42e619-49d1-43bd-a8c1-a26d8e3d5882 tempest-ServersWithSpecificFlavorTestJSON-25290177 tempest-ServersWithSpecificFlavorTestJSON-25290177-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.411952 Oct 26 13:03:19.939959 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 123/224] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:03:19 2022] POST /compute/v2.1/flavors => generated 421 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:19.959443 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0f2e3e46-9fdb-443a-815f-3f6da9f1d5cf tempest-ServersWithSpecificFlavorTestJSON-25290177 tempest-ServersWithSpecificFlavorTestJSON-25290177-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:19.974320 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0f2e3e46-9fdb-443a-815f-3f6da9f1d5cf tempest-ServersWithSpecificFlavorTestJSON-25290177 tempest-ServersWithSpecificFlavorTestJSON-25290177-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.024727 Oct 26 13:03:19.977534 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 124/225] 10.222.0.40 () {58 vars in 1182 bytes} [Wed Oct 26 13:03:19 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:03:19.986975 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cc32d5a3-0c71-43ff-ae21-b005f0f0d640 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:19.987800 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cc32d5a3-0c71-43ff-ae21-b005f0f0d640 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] [instance: 32f65838-4cb1-4465-977b-2d320a3e3858] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:19.996056 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cc32d5a3-0c71-43ff-ae21-b005f0f0d640 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:19.997212 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cc32d5a3-0c71-43ff-ae21-b005f0f0d640 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:19.997696 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cc32d5a3-0c71-43ff-ae21-b005f0f0d640 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:19.998492 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cc32d5a3-0c71-43ff-ae21-b005f0f0d640 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:19.998934 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cc32d5a3-0c71-43ff-ae21-b005f0f0d640 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:19.999366 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cc32d5a3-0c71-43ff-ae21-b005f0f0d640 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:20.211709 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-cc32d5a3-0c71-43ff-ae21-b005f0f0d640 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999ac729ed1f4456857c8671d4b9be8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e2b56ef8db404ca0372e0a9c5f9b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:20.231524 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cc32d5a3-0c71-43ff-ae21-b005f0f0d640 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] 10.222.0.40 "GET /compute/v2.1/servers/32f65838-4cb1-4465-977b-2d320a3e3858" status: 200 len: 1318 microversion: 2.1 time: 0.248912 Oct 26 13:03:20.233873 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 125/226] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:19 2022] GET /compute/v2.1/servers/32f65838-4cb1-4465-977b-2d320a3e3858 => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:20.239980 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d877cdd0-fc4c-4edd-b7fb-a0ccbe49940a tempest-ServersWithSpecificFlavorTestJSON-25290177 tempest-ServersWithSpecificFlavorTestJSON-25290177-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-2060116197", "id": 780426335, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:20.263870 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d877cdd0-fc4c-4edd-b7fb-a0ccbe49940a tempest-ServersWithSpecificFlavorTestJSON-25290177 tempest-ServersWithSpecificFlavorTestJSON-25290177-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.028560 Oct 26 13:03:20.265135 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 126/227] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:03:20 2022] POST /compute/v2.1/flavors => generated 422 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:20.280101 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b80916cb-e1b0-412e-8b75-8fc73251fcf9 tempest-ServersWithSpecificFlavorTestJSON-25290177 tempest-ServersWithSpecificFlavorTestJSON-25290177-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:20.296148 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b80916cb-e1b0-412e-8b75-8fc73251fcf9 tempest-ServersWithSpecificFlavorTestJSON-25290177 tempest-ServersWithSpecificFlavorTestJSON-25290177-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.022808 Oct 26 13:03:20.297531 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 127/228] 10.222.0.40 () {58 vars in 1182 bytes} [Wed Oct 26 13:03:20 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:03:20.314189 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-370f97b7-8f72-49bb-93de-2d6cab0f2d13 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Action: 'create', calling method: .version_select at 0x7f6732f38820>, body: {"keypair": {"name": "tempest-keypair-1688437826", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImy8AkOfqZ6IvDmVC/1YfQr62KQnaH6uXolm8FuRZAskAVXDg5PUnHS3QSYAsCA990qkIiE5uEhhmXOIHnimKS0h9V1e0HJGou4Kuk9pXk0NeSkq31rTsI8N9WcUqWrRg=="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:20.404846 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-370f97b7-8f72-49bb-93de-2d6cab0f2d13 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Getting quotas for project 10521abb1c34417fa9369aaba9070968. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:03:20.428914 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-370f97b7-8f72-49bb-93de-2d6cab0f2d13 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Getting quotas for user 52f9391046054747bbfc1c3e6d65d4aa and project 10521abb1c34417fa9369aaba9070968. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:03:20.499857 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-370f97b7-8f72-49bb-93de-2d6cab0f2d13 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.191556 Oct 26 13:03:20.501291 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 128/229] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 13:03:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:20.523469 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fba267c1-a1ac-4e1a-b96e-ace476239e32 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db8f8e223a145abbe4a20edb9ce60d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc559afd836047ccbeba91fca9c0d527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:20.529127 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:03:20.544262 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fba267c1-a1ac-4e1a-b96e-ace476239e32 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] 10.222.0.40 "GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159" status: 200 len: 1493 microversion: 2.1 time: 0.819641 Oct 26 13:03:20.559713 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 102/230] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:19 2022] GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159 => generated 1493 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:20.739817 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-923319f1-340a-4832-b58e-ab544df63272 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:20.740455 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-923319f1-340a-4832-b58e-ab544df63272 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:20.754806 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-923319f1-340a-4832-b58e-ab544df63272 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:20.757128 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-923319f1-340a-4832-b58e-ab544df63272 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:20.759147 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-923319f1-340a-4832-b58e-ab544df63272 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:20.764587 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-923319f1-340a-4832-b58e-ab544df63272 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:20.765089 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-923319f1-340a-4832-b58e-ab544df63272 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:20.765555 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-923319f1-340a-4832-b58e-ab544df63272 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:21.203166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-923319f1-340a-4832-b58e-ab544df63272 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:21.223039 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-923319f1-340a-4832-b58e-ab544df63272 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1312 microversion: 2.1 time: 0.489072 Oct 26 13:03:21.224583 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 129/231] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:20 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1312 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:03:21.257607 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-80bc99e0-b645-4451-9a14-866980b15f87 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:21.258235 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-80bc99e0-b645-4451-9a14-866980b15f87 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] [instance: 32f65838-4cb1-4465-977b-2d320a3e3858] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:21.289047 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-80bc99e0-b645-4451-9a14-866980b15f87 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:21.291662 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-80bc99e0-b645-4451-9a14-866980b15f87 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:21.293645 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-80bc99e0-b645-4451-9a14-866980b15f87 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:21.299151 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-80bc99e0-b645-4451-9a14-866980b15f87 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:21.299668 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-80bc99e0-b645-4451-9a14-866980b15f87 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:21.300118 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-80bc99e0-b645-4451-9a14-866980b15f87 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:21.496479 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bc13261b-f9e7-46ae-819b-92125557ad45 tempest-HypervisorAdminV253TestBase-67683598 tempest-HypervisorAdminV253TestBase-67683598-project-admin] Calling method '.version_select at 0x7f673322cdc0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:21.502377 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc13261b-f9e7-46ae-819b-92125557ad45 tempest-HypervisorAdminV253TestBase-67683598 tempest-HypervisorAdminV253TestBase-67683598-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:21.504790 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc13261b-f9e7-46ae-819b-92125557ad45 tempest-HypervisorAdminV253TestBase-67683598 tempest-HypervisorAdminV253TestBase-67683598-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:21.505962 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc13261b-f9e7-46ae-819b-92125557ad45 tempest-HypervisorAdminV253TestBase-67683598 tempest-HypervisorAdminV253TestBase-67683598-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:21.543706 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc13261b-f9e7-46ae-819b-92125557ad45 tempest-HypervisorAdminV253TestBase-67683598 tempest-HypervisorAdminV253TestBase-67683598-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:21.544922 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc13261b-f9e7-46ae-819b-92125557ad45 tempest-HypervisorAdminV253TestBase-67683598 tempest-HypervisorAdminV253TestBase-67683598-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:21.545591 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc13261b-f9e7-46ae-819b-92125557ad45 tempest-HypervisorAdminV253TestBase-67683598 tempest-HypervisorAdminV253TestBase-67683598-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:21.603393 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc13261b-f9e7-46ae-819b-92125557ad45 tempest-HypervisorAdminV253TestBase-67683598 tempest-HypervisorAdminV253TestBase-67683598-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:21.604930 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc13261b-f9e7-46ae-819b-92125557ad45 tempest-HypervisorAdminV253TestBase-67683598 tempest-HypervisorAdminV253TestBase-67683598-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:21.605719 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc13261b-f9e7-46ae-819b-92125557ad45 tempest-HypervisorAdminV253TestBase-67683598 tempest-HypervisorAdminV253TestBase-67683598-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:21.636081 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc13261b-f9e7-46ae-819b-92125557ad45 tempest-HypervisorAdminV253TestBase-67683598 tempest-HypervisorAdminV253TestBase-67683598-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:21.636894 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc13261b-f9e7-46ae-819b-92125557ad45 tempest-HypervisorAdminV253TestBase-67683598 tempest-HypervisorAdminV253TestBase-67683598-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:21.637881 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc13261b-f9e7-46ae-819b-92125557ad45 tempest-HypervisorAdminV253TestBase-67683598 tempest-HypervisorAdminV253TestBase-67683598-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:21.691489 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc13261b-f9e7-46ae-819b-92125557ad45 tempest-HypervisorAdminV253TestBase-67683598 tempest-HypervisorAdminV253TestBase-67683598-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:21.692209 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc13261b-f9e7-46ae-819b-92125557ad45 tempest-HypervisorAdminV253TestBase-67683598 tempest-HypervisorAdminV253TestBase-67683598-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:21.693001 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc13261b-f9e7-46ae-819b-92125557ad45 tempest-HypervisorAdminV253TestBase-67683598 tempest-HypervisorAdminV253TestBase-67683598-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:21.718546 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bc13261b-f9e7-46ae-819b-92125557ad45 tempest-HypervisorAdminV253TestBase-67683598 tempest-HypervisorAdminV253TestBase-67683598-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1836 microversion: 2.53 time: 0.494955 Oct 26 13:03:21.736511 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 103/232] 10.222.0.40 () {60 vars in 1243 bytes} [Wed Oct 26 13:03:21 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1836 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:03:21.745021 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d882ce23-6c7d-49c1-b7e9-844ef56f8f38 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:21.752190 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d882ce23-6c7d-49c1-b7e9-844ef56f8f38 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] [instance: 5984db52-3d30-4265-af13-6d9c16b63159] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:21.761071 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d882ce23-6c7d-49c1-b7e9-844ef56f8f38 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:21.762490 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d882ce23-6c7d-49c1-b7e9-844ef56f8f38 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:21.763105 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d882ce23-6c7d-49c1-b7e9-844ef56f8f38 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:21.764589 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d882ce23-6c7d-49c1-b7e9-844ef56f8f38 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:21.767434 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d882ce23-6c7d-49c1-b7e9-844ef56f8f38 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:21.768102 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d882ce23-6c7d-49c1-b7e9-844ef56f8f38 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:21.802572 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-80bc99e0-b645-4451-9a14-866980b15f87 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999ac729ed1f4456857c8671d4b9be8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e2b56ef8db404ca0372e0a9c5f9b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:21.815082 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-80bc99e0-b645-4451-9a14-866980b15f87 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] 10.222.0.40 "GET /compute/v2.1/servers/32f65838-4cb1-4465-977b-2d320a3e3858" status: 200 len: 1318 microversion: 2.1 time: 0.561756 Oct 26 13:03:21.830102 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 130/233] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:21 2022] GET /compute/v2.1/servers/32f65838-4cb1-4465-977b-2d320a3e3858 => generated 1318 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:03:21.832464 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-ad18b723-af4e-4f1e-9e4a-85295919bf59 req-2eff6977-b316-421d-a7c9-b5e5314dfca5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5984db52-3d30-4265-af13-6d9c16b63159", "name": "network-vif-deleted", "tag": "ff83dcc1-3e55-4a32-82d7-062ae132ad46"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:21.862608 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ad18b723-af4e-4f1e-9e4a-85295919bf59 req-2eff6977-b316-421d-a7c9-b5e5314dfca5 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:21.863512 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ad18b723-af4e-4f1e-9e4a-85295919bf59 req-2eff6977-b316-421d-a7c9-b5e5314dfca5 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:21.863951 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ad18b723-af4e-4f1e-9e4a-85295919bf59 req-2eff6977-b316-421d-a7c9-b5e5314dfca5 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:21.916482 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-ad18b723-af4e-4f1e-9e4a-85295919bf59 req-2eff6977-b316-421d-a7c9-b5e5314dfca5 service nova] Creating event network-vif-deleted:ff83dcc1-3e55-4a32-82d7-062ae132ad46 for instance 5984db52-3d30-4265-af13-6d9c16b63159 on n-h2-862686-1 Oct 26 13:03:21.927770 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-ad18b723-af4e-4f1e-9e4a-85295919bf59 req-2eff6977-b316-421d-a7c9-b5e5314dfca5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108672 Oct 26 13:03:21.928561 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 131/234] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:21.944025 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-455d4996-e7bf-4e61-9468-cb7120060166 tempest-HypervisorAdminV253TestBase-67683598 tempest-HypervisorAdminV253TestBase-67683598-project-admin] Calling method '.version_select at 0x7f6732f38e50>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:21.949105 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-455d4996-e7bf-4e61-9468-cb7120060166 tempest-HypervisorAdminV253TestBase-67683598 tempest-HypervisorAdminV253TestBase-67683598-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:21.949610 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-455d4996-e7bf-4e61-9468-cb7120060166 tempest-HypervisorAdminV253TestBase-67683598 tempest-HypervisorAdminV253TestBase-67683598-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:21.950056 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-455d4996-e7bf-4e61-9468-cb7120060166 tempest-HypervisorAdminV253TestBase-67683598 tempest-HypervisorAdminV253TestBase-67683598-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:21.990955 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-455d4996-e7bf-4e61-9468-cb7120060166 tempest-HypervisorAdminV253TestBase-67683598 tempest-HypervisorAdminV253TestBase-67683598-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:21.991436 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-455d4996-e7bf-4e61-9468-cb7120060166 tempest-HypervisorAdminV253TestBase-67683598 tempest-HypervisorAdminV253TestBase-67683598-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:21.991867 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-455d4996-e7bf-4e61-9468-cb7120060166 tempest-HypervisorAdminV253TestBase-67683598 tempest-HypervisorAdminV253TestBase-67683598-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:22.056248 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d882ce23-6c7d-49c1-b7e9-844ef56f8f38 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db8f8e223a145abbe4a20edb9ce60d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc559afd836047ccbeba91fca9c0d527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:22.068685 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d882ce23-6c7d-49c1-b7e9-844ef56f8f38 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] 10.222.0.40 "GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159" status: 200 len: 1322 microversion: 2.1 time: 0.329741 Oct 26 13:03:22.070851 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 104/235] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:21 2022] GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159 => generated 1322 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:22.105703 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-455d4996-e7bf-4e61-9468-cb7120060166 tempest-HypervisorAdminV253TestBase-67683598 tempest-HypervisorAdminV253TestBase-67683598-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:22.106646 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-455d4996-e7bf-4e61-9468-cb7120060166 tempest-HypervisorAdminV253TestBase-67683598 tempest-HypervisorAdminV253TestBase-67683598-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:22.107245 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-455d4996-e7bf-4e61-9468-cb7120060166 tempest-HypervisorAdminV253TestBase-67683598 tempest-HypervisorAdminV253TestBase-67683598-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:22.121537 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-455d4996-e7bf-4e61-9468-cb7120060166 tempest-HypervisorAdminV253TestBase-67683598 tempest-HypervisorAdminV253TestBase-67683598-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:22.123099 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-455d4996-e7bf-4e61-9468-cb7120060166 tempest-HypervisorAdminV253TestBase-67683598 tempest-HypervisorAdminV253TestBase-67683598-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:22.123700 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-455d4996-e7bf-4e61-9468-cb7120060166 tempest-HypervisorAdminV253TestBase-67683598 tempest-HypervisorAdminV253TestBase-67683598-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:22.151731 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-455d4996-e7bf-4e61-9468-cb7120060166 tempest-HypervisorAdminV253TestBase-67683598 tempest-HypervisorAdminV253TestBase-67683598-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:22.152228 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-455d4996-e7bf-4e61-9468-cb7120060166 tempest-HypervisorAdminV253TestBase-67683598 tempest-HypervisorAdminV253TestBase-67683598-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:22.152655 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-455d4996-e7bf-4e61-9468-cb7120060166 tempest-HypervisorAdminV253TestBase-67683598 tempest-HypervisorAdminV253TestBase-67683598-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:22.159003 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-455d4996-e7bf-4e61-9468-cb7120060166 tempest-HypervisorAdminV253TestBase-67683598 tempest-HypervisorAdminV253TestBase-67683598-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 528 microversion: 2.53 time: 0.225615 Oct 26 13:03:22.159821 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 132/236] 10.222.0.40 () {60 vars in 1222 bytes} [Wed Oct 26 13:03:21 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 528 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:03:22.172599 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-90047a2d-df15-4a0a-af13-f704dba9bf24 tempest-HypervisorAdminV253TestBase-67683598 tempest-HypervisorAdminV253TestBase-67683598-project-admin] Calling method '.version_select at 0x7f67331f38b0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:22.176166 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90047a2d-df15-4a0a-af13-f704dba9bf24 tempest-HypervisorAdminV253TestBase-67683598 tempest-HypervisorAdminV253TestBase-67683598-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:22.176658 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90047a2d-df15-4a0a-af13-f704dba9bf24 tempest-HypervisorAdminV253TestBase-67683598 tempest-HypervisorAdminV253TestBase-67683598-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:22.177095 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90047a2d-df15-4a0a-af13-f704dba9bf24 tempest-HypervisorAdminV253TestBase-67683598 tempest-HypervisorAdminV253TestBase-67683598-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:22.225447 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90047a2d-df15-4a0a-af13-f704dba9bf24 tempest-HypervisorAdminV253TestBase-67683598 tempest-HypervisorAdminV253TestBase-67683598-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:22.225896 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90047a2d-df15-4a0a-af13-f704dba9bf24 tempest-HypervisorAdminV253TestBase-67683598 tempest-HypervisorAdminV253TestBase-67683598-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:22.226430 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90047a2d-df15-4a0a-af13-f704dba9bf24 tempest-HypervisorAdminV253TestBase-67683598 tempest-HypervisorAdminV253TestBase-67683598-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:22.245376 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-90047a2d-df15-4a0a-af13-f704dba9bf24 tempest-HypervisorAdminV253TestBase-67683598 tempest-HypervisorAdminV253TestBase-67683598-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/86d4df6d-55f6-40a9-bf34-274573717968" status: 200 len: 791 microversion: 2.53 time: 0.076445 Oct 26 13:03:22.246507 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 105/237] 10.222.0.40 () {60 vars in 1298 bytes} [Wed Oct 26 13:03:22 2022] GET /compute/v2.1/os-hypervisors/86d4df6d-55f6-40a9-bf34-274573717968 => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:03:22.263672 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8d688d11-ac4c-417c-aa1e-78d820943e77 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:22.264699 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8d688d11-ac4c-417c-aa1e-78d820943e77 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:22.274546 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d688d11-ac4c-417c-aa1e-78d820943e77 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:22.275692 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d688d11-ac4c-417c-aa1e-78d820943e77 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:22.286715 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d688d11-ac4c-417c-aa1e-78d820943e77 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:22.287744 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d688d11-ac4c-417c-aa1e-78d820943e77 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:22.288371 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d688d11-ac4c-417c-aa1e-78d820943e77 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:22.288946 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d688d11-ac4c-417c-aa1e-78d820943e77 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:22.841050 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-38425274-147d-4f34-a3c8-cbcadb209404 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:22.842289 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-38425274-147d-4f34-a3c8-cbcadb209404 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] [instance: 32f65838-4cb1-4465-977b-2d320a3e3858] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:22.845382 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:03:22.850496 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38425274-147d-4f34-a3c8-cbcadb209404 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:22.854088 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38425274-147d-4f34-a3c8-cbcadb209404 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:22.854734 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38425274-147d-4f34-a3c8-cbcadb209404 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:22.857524 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38425274-147d-4f34-a3c8-cbcadb209404 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:22.858204 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38425274-147d-4f34-a3c8-cbcadb209404 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:22.858791 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38425274-147d-4f34-a3c8-cbcadb209404 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:22.946253 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8d688d11-ac4c-417c-aa1e-78d820943e77 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:22.957381 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8d688d11-ac4c-417c-aa1e-78d820943e77 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1312 microversion: 2.1 time: 0.714650 Oct 26 13:03:22.961205 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 133/238] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:22 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1312 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:23.099608 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b0d9bfea-43f5-4c37-aec5-bbe4b08357cc tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:23.100502 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b0d9bfea-43f5-4c37-aec5-bbe4b08357cc tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] [instance: 5984db52-3d30-4265-af13-6d9c16b63159] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:23.113033 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b0d9bfea-43f5-4c37-aec5-bbe4b08357cc tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:23.115404 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b0d9bfea-43f5-4c37-aec5-bbe4b08357cc tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:23.116149 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b0d9bfea-43f5-4c37-aec5-bbe4b08357cc tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:23.117777 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b0d9bfea-43f5-4c37-aec5-bbe4b08357cc tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:23.118614 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b0d9bfea-43f5-4c37-aec5-bbe4b08357cc tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:23.119647 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b0d9bfea-43f5-4c37-aec5-bbe4b08357cc tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:23.153152 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-b0d9bfea-43f5-4c37-aec5-bbe4b08357cc tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] HTTP exception thrown: Instance 5984db52-3d30-4265-af13-6d9c16b63159 could not be found. Oct 26 13:03:23.156704 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b0d9bfea-43f5-4c37-aec5-bbe4b08357cc tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Request method failure captured: Oct 26 13:03:23.156704 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159 HTTP/1.1 Oct 26 13:03:23.156704 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:03:23.156704 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:03:23.156704 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:03:23.156704 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:03:23.156704 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:03:23.156704 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:03:23.156704 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:03:23.156704 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:03:23.156704 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWS_rUn6wRAv7ov-b9dW0vc_-EvSk28IQJoQlGc01D7PQuEK1gja2ZWk3H0LGB_sw7W9RxGXLwxIz9FvPUE7kuZ_XV9T91z2LF8JJTLHFIV2lW12auOcJTdmmql9PhTrJ1KpOoErbj7lRlCdbr3_wc3ygfrRaSNeuOEHlBm5aTu9sstM Oct 26 13:03:23.156704 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:03:23.156704 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:03:23.156704 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:03:23.156704 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:03:23.156704 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:03:23.156704 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:03:23.156704 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: dc559afd836047ccbeba91fca9c0d527 Oct 26 13:03:23.156704 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-AggregatesAdminTestJSON-1622236984 Oct 26 13:03:23.156704 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:03:23.156704 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:03:23.157927 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/dc559afd836047ccbeba91fca9c0d527"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dc559afd836047ccbeba91fca9c0d527"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_dc559afd836047ccbeba91fca9c0d527"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dc559afd836047ccbeba91fca9c0d527"}]}] Oct 26 13:03:23.157927 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-AggregatesAdminTestJSON-1622236984 Oct 26 13:03:23.157927 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: dc559afd836047ccbeba91fca9c0d527 Oct 26 13:03:23.157927 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1622236984 Oct 26 13:03:23.157927 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-AggregatesAdminTestJSON-1622236984-project Oct 26 13:03:23.157927 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:03:23.157927 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:03:23.157927 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 1db8f8e223a145abbe4a20edb9ce60d4 Oct 26 13:03:23.157927 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-AggregatesAdminTestJSON-1622236984-project Oct 26 13:03:23.157927 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:03:23.157927 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 5984db52-3d30-4265-af13-6d9c16b63159 could not be found. Oct 26 13:03:23.157927 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '5984db52-3d30-4265-af13-6d9c16b63159'} Oct 26 13:03:23.158594 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:03:23.158594 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:23.158594 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:03:23.158594 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:03:23.158594 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:03:23.158594 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:03:23.158594 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:03:23.158594 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:03:23.158594 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:03:23.158594 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:03:23.158594 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5984db52-3d30-4265-af13-6d9c16b63159 could not be found. Oct 26 13:03:23.158594 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:23.158594 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:23.158594 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:23.158594 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:23.158594 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:23.158594 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:23.158594 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:03:23.158594 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:03:23.158594 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:03:23.159717 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:03:23.159717 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:03:23.159717 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:03:23.159717 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:03:23.159717 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:03:23.159717 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:03:23.159717 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:03:23.159717 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5984db52-3d30-4265-af13-6d9c16b63159 could not be found. Oct 26 13:03:23.159717 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:23.159717 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:23.159717 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:23.159717 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:23.159717 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:23.159717 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:23.159717 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:03:23.159717 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:03:23.159717 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5984db52-3d30-4265-af13-6d9c16b63159 could not be found. Oct 26 13:03:23.159717 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:23.169256 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b0d9bfea-43f5-4c37-aec5-bbe4b08357cc tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Returning 404 to user: Instance 5984db52-3d30-4265-af13-6d9c16b63159 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:03:23.172270 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b0d9bfea-43f5-4c37-aec5-bbe4b08357cc tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] 10.222.0.40 "GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159" status: 404 len: 111 microversion: 2.1 time: 0.076254 Oct 26 13:03:23.174309 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 134/239] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:23 2022] GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 13:03:23.183159 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-88b57432-c586-4170-9200-aa638205f67d tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862686-1"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:23.196061 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88b57432-c586-4170-9200-aa638205f67d tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:23.196856 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88b57432-c586-4170-9200-aa638205f67d tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:23.197438 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88b57432-c586-4170-9200-aa638205f67d tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:23.263049 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-38425274-147d-4f34-a3c8-cbcadb209404 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999ac729ed1f4456857c8671d4b9be8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e2b56ef8db404ca0372e0a9c5f9b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:23.276054 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-38425274-147d-4f34-a3c8-cbcadb209404 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] 10.222.0.40 "GET /compute/v2.1/servers/32f65838-4cb1-4465-977b-2d320a3e3858" status: 200 len: 1318 microversion: 2.1 time: 0.435473 Oct 26 13:03:23.278656 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 106/240] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:22 2022] GET /compute/v2.1/servers/32f65838-4cb1-4465-977b-2d320a3e3858 => generated 1318 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:03:23.383607 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-88b57432-c586-4170-9200-aa638205f67d tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 295 microversion: 2.1 time: 0.204321 Oct 26 13:03:23.385524 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 135/241] 10.222.0.40 () {60 vars in 1191 bytes} [Wed Oct 26 13:03:23 2022] POST /compute/v2.1/os-aggregates/4/action => generated 295 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:23.421136 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8dcb2173-968a-4efe-810e-0e4e0cb5f4fa tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:23.488837 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8dcb2173-968a-4efe-810e-0e4e0cb5f4fa tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.091277 Oct 26 13:03:23.501040 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 107/242] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 26 13:03:23 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 26 13:03:23.503060 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0da09a2e-93f8-4e3d-ae52-f84e0be96107 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-363098932"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:23.506913 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.aggregate [None req-0da09a2e-93f8-4e3d-ae52-f84e0be96107 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Generated uuid e4f91490-5ae8-4066-8404-fb3f78a83bfd for aggregate {{(pid=120598) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 26 13:03:23.561518 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0da09a2e-93f8-4e3d-ae52-f84e0be96107 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.057085 Oct 26 13:03:23.562393 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 136/243] 10.222.0.40 () {60 vars in 1164 bytes} [Wed Oct 26 13:03:23 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:23.575574 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-815eea73-83f7-4e84-932c-0da1709c26d9 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862686-1"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:23.590066 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-815eea73-83f7-4e84-932c-0da1709c26d9 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:23.590819 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-815eea73-83f7-4e84-932c-0da1709c26d9 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:23.591414 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-815eea73-83f7-4e84-932c-0da1709c26d9 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:23.796002 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-815eea73-83f7-4e84-932c-0da1709c26d9 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 241 microversion: 2.1 time: 0.225348 Oct 26 13:03:23.797866 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 108/244] 10.222.0.40 () {60 vars in 1191 bytes} [Wed Oct 26 13:03:23 2022] POST /compute/v2.1/os-aggregates/9/action => generated 241 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:03:23.811581 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-09981f74-b644-42da-b058-55c49ecda6c5 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:23.821122 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-09981f74-b644-42da-b058-55c49ecda6c5 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 241 microversion: 2.1 time: 0.014795 Oct 26 13:03:23.830156 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 137/245] 10.222.0.40 () {58 vars in 1149 bytes} [Wed Oct 26 13:03:23 2022] GET /compute/v2.1/os-aggregates/9 => generated 241 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:23.835262 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6ba33b54-ce64-4fe7-bfca-3bda7f91a0f8 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862686-1"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:23.857372 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ba33b54-ce64-4fe7-bfca-3bda7f91a0f8 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:23.858134 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ba33b54-ce64-4fe7-bfca-3bda7f91a0f8 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:23.858889 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ba33b54-ce64-4fe7-bfca-3bda7f91a0f8 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:23.989947 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cad5f1b8-8a7c-4c0f-aaa3-f2a2bcf9ba72 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:23.991308 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cad5f1b8-8a7c-4c0f-aaa3-f2a2bcf9ba72 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:24.017977 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cad5f1b8-8a7c-4c0f-aaa3-f2a2bcf9ba72 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:24.018909 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cad5f1b8-8a7c-4c0f-aaa3-f2a2bcf9ba72 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:24.020241 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cad5f1b8-8a7c-4c0f-aaa3-f2a2bcf9ba72 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:24.024300 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cad5f1b8-8a7c-4c0f-aaa3-f2a2bcf9ba72 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:24.029215 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cad5f1b8-8a7c-4c0f-aaa3-f2a2bcf9ba72 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:24.037343 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cad5f1b8-8a7c-4c0f-aaa3-f2a2bcf9ba72 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:24.039457 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6ba33b54-ce64-4fe7-bfca-3bda7f91a0f8 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 226 microversion: 2.1 time: 0.208271 Oct 26 13:03:24.044663 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 109/246] 10.222.0.40 () {60 vars in 1191 bytes} [Wed Oct 26 13:03:23 2022] POST /compute/v2.1/os-aggregates/9/action => generated 226 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:24.066350 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-11f4cea0-d6a2-48cd-8129-c362adf6ce98 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:24.113381 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-11f4cea0-d6a2-48cd-8129-c362adf6ce98 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.062178 Oct 26 13:03:24.120353 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 110/247] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 26 13:03:24 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 26 13:03:24.125196 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-986d5b91-5f96-4ad7-b39b-fd98b8b54de5 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1015561864"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:24.134090 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.aggregate [None req-986d5b91-5f96-4ad7-b39b-fd98b8b54de5 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Generated uuid cc57b272-dc50-4179-9017-e5f7c8037c1d for aggregate {{(pid=120597) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 26 13:03:24.188320 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-986d5b91-5f96-4ad7-b39b-fd98b8b54de5 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.066601 Oct 26 13:03:24.189578 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 111/248] 10.222.0.40 () {60 vars in 1164 bytes} [Wed Oct 26 13:03:24 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:24.205320 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-df356bfc-91b8-4e0c-8621-38983958d21e tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862686-1"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:24.229649 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-df356bfc-91b8-4e0c-8621-38983958d21e tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:24.230152 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-df356bfc-91b8-4e0c-8621-38983958d21e tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:24.230591 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-df356bfc-91b8-4e0c-8621-38983958d21e tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:24.479077 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-cad5f1b8-8a7c-4c0f-aaa3-f2a2bcf9ba72 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:24.481426 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-df356bfc-91b8-4e0c-8621-38983958d21e tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 243 microversion: 2.1 time: 0.283407 Oct 26 13:03:24.482428 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 112/249] 10.222.0.40 () {60 vars in 1194 bytes} [Wed Oct 26 13:03:24 2022] POST /compute/v2.1/os-aggregates/10/action => generated 243 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:24.489261 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e1688c46-859a-41f5-9e60-852dc9469462 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:24.493223 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e1688c46-859a-41f5-9e60-852dc9469462 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] [instance: 32f65838-4cb1-4465-977b-2d320a3e3858] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:24.493726 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cad5f1b8-8a7c-4c0f-aaa3-f2a2bcf9ba72 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1461 microversion: 2.1 time: 0.512049 Oct 26 13:03:24.494622 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 138/250] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:23 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1461 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:24.501122 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1688c46-859a-41f5-9e60-852dc9469462 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:24.502952 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1688c46-859a-41f5-9e60-852dc9469462 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:24.503694 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1688c46-859a-41f5-9e60-852dc9469462 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:24.504873 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1688c46-859a-41f5-9e60-852dc9469462 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:24.505975 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1688c46-859a-41f5-9e60-852dc9469462 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:24.506625 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1688c46-859a-41f5-9e60-852dc9469462 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:24.510291 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7b45ece6-2e15-48d6-84d1-cc72fe731d48 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:24.521920 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7b45ece6-2e15-48d6-84d1-cc72fe731d48 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.025867 Oct 26 13:03:24.525882 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 139/251] 10.222.0.40 () {58 vars in 1143 bytes} [Wed Oct 26 13:03:24 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:25.046279 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ae814a13-ba29-45d0-b1f8-c3c341479a6f tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:25.047110 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ae814a13-ba29-45d0-b1f8-c3c341479a6f tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:25.057181 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae814a13-ba29-45d0-b1f8-c3c341479a6f tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:25.060410 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae814a13-ba29-45d0-b1f8-c3c341479a6f tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:25.061060 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae814a13-ba29-45d0-b1f8-c3c341479a6f tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:25.061987 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae814a13-ba29-45d0-b1f8-c3c341479a6f tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:25.063716 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae814a13-ba29-45d0-b1f8-c3c341479a6f tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:25.064940 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae814a13-ba29-45d0-b1f8-c3c341479a6f tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:25.098475 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:03:25.260284 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e1688c46-859a-41f5-9e60-852dc9469462 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999ac729ed1f4456857c8671d4b9be8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e2b56ef8db404ca0372e0a9c5f9b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:25.271077 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e1688c46-859a-41f5-9e60-852dc9469462 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] 10.222.0.40 "GET /compute/v2.1/servers/32f65838-4cb1-4465-977b-2d320a3e3858" status: 200 len: 1318 microversion: 2.1 time: 0.787241 Oct 26 13:03:25.271667 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 113/252] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:24 2022] GET /compute/v2.1/servers/32f65838-4cb1-4465-977b-2d320a3e3858 => generated 1318 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:25.283340 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ca11abaf-f2a6-4efa-b06e-e2964d8c5694 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862686-1"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:25.304795 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ca11abaf-f2a6-4efa-b06e-e2964d8c5694 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:25.305594 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ca11abaf-f2a6-4efa-b06e-e2964d8c5694 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:25.306714 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ca11abaf-f2a6-4efa-b06e-e2964d8c5694 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:25.594483 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ca11abaf-f2a6-4efa-b06e-e2964d8c5694 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 228 microversion: 2.1 time: 0.321487 Oct 26 13:03:25.600485 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 114/253] 10.222.0.40 () {60 vars in 1194 bytes} [Wed Oct 26 13:03:25 2022] POST /compute/v2.1/os-aggregates/10/action => generated 228 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:25.622589 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-7d0fdc36-c469-4561-b990-ba89d185ab71 req-b4d9c8de-1d55-4771-a57a-cff247aafddd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32f65838-4cb1-4465-977b-2d320a3e3858", "name": "network-vif-plugged", "status": "completed", "tag": "6503d4b6-a910-49e8-bb75-864fa2fe4537"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:25.643339 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-7d0fdc36-c469-4561-b990-ba89d185ab71 req-b4d9c8de-1d55-4771-a57a-cff247aafddd service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:25.645403 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-7d0fdc36-c469-4561-b990-ba89d185ab71 req-b4d9c8de-1d55-4771-a57a-cff247aafddd service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:25.645866 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-7d0fdc36-c469-4561-b990-ba89d185ab71 req-b4d9c8de-1d55-4771-a57a-cff247aafddd service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:25.664399 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-7d0fdc36-c469-4561-b990-ba89d185ab71 req-b4d9c8de-1d55-4771-a57a-cff247aafddd service nova] Creating event network-vif-plugged:6503d4b6-a910-49e8-bb75-864fa2fe4537 for instance 32f65838-4cb1-4465-977b-2d320a3e3858 on n-h1-862686-1 Oct 26 13:03:25.679198 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-7d0fdc36-c469-4561-b990-ba89d185ab71 req-b4d9c8de-1d55-4771-a57a-cff247aafddd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065835 Oct 26 13:03:25.679865 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 115/254] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:25.695011 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e7e1165d-90bf-4ade-8a9e-d3b1f9ad7c14 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:25.758676 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e7e1165d-90bf-4ade-8a9e-d3b1f9ad7c14 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.071047 Oct 26 13:03:25.761508 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 116/255] 10.222.0.40 () {58 vars in 1155 bytes} [Wed Oct 26 13:03:25 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 26 13:03:25.775713 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-eaa2e245-bcbf-45e9-9c53-3825137cdfd5 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-821167922"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:25.780543 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.aggregate [None req-eaa2e245-bcbf-45e9-9c53-3825137cdfd5 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Generated uuid 3931fc56-3be5-40a8-b879-1bcbd5321da5 for aggregate {{(pid=120597) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 26 13:03:25.828275 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-eaa2e245-bcbf-45e9-9c53-3825137cdfd5 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.061368 Oct 26 13:03:25.829170 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 117/256] 10.222.0.40 () {60 vars in 1164 bytes} [Wed Oct 26 13:03:25 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:25.841074 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7d145978-a892-493c-958c-47b4c31154e7 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862686-1"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:25.866704 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d145978-a892-493c-958c-47b4c31154e7 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:25.867227 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d145978-a892-493c-958c-47b4c31154e7 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:25.868669 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d145978-a892-493c-958c-47b4c31154e7 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:26.028717 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ae814a13-ba29-45d0-b1f8-c3c341479a6f tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1612 microversion: 2.1 time: 1.501687 Oct 26 13:03:26.029304 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 140/257] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:24 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1612 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:26.061150 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-12cf6d29-4d86-49e0-ac8e-81cc15dfe547 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:26.062582 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-12cf6d29-4d86-49e0-ac8e-81cc15dfe547 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:26.067417 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7d145978-a892-493c-958c-47b4c31154e7 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 242 microversion: 2.1 time: 0.230653 Oct 26 13:03:26.068599 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 118/258] 10.222.0.40 () {60 vars in 1194 bytes} [Wed Oct 26 13:03:25 2022] POST /compute/v2.1/os-aggregates/11/action => generated 242 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:03:26.071547 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-12cf6d29-4d86-49e0-ac8e-81cc15dfe547 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:26.073059 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-12cf6d29-4d86-49e0-ac8e-81cc15dfe547 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:26.073602 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-12cf6d29-4d86-49e0-ac8e-81cc15dfe547 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:26.074586 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-12cf6d29-4d86-49e0-ac8e-81cc15dfe547 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:26.075411 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-12cf6d29-4d86-49e0-ac8e-81cc15dfe547 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:26.076045 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-12cf6d29-4d86-49e0-ac8e-81cc15dfe547 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:26.081931 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f174eb08-f032-44b6-a028-a95b882915b8 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862686-1"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:26.093634 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f174eb08-f032-44b6-a028-a95b882915b8 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:26.094458 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f174eb08-f032-44b6-a028-a95b882915b8 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:26.095562 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f174eb08-f032-44b6-a028-a95b882915b8 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:26.286500 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f174eb08-f032-44b6-a028-a95b882915b8 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.206362 Oct 26 13:03:26.287295 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 119/259] 10.222.0.40 () {60 vars in 1194 bytes} [Wed Oct 26 13:03:26 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:03:26.301526 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a847713d-cb2c-4acf-abd9-74eec2dd0730 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1332951646", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "780426335", "adminPass": "***", "networks": [{"uuid": "9d8caa44-a218-4de4-8792-8a79982b84cb"}], "security_groups": [{"name": "tempest-securitygroup--1761964662"}], "key_name": "tempest-keypair-1688437826", "user_data": "}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:26.571891 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-12cf6d29-4d86-49e0-ac8e-81cc15dfe547 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'e9ccaad8c3e644a7b22ace8413875396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd672e8734b74406bb0fef1de5a88b7fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:26.572825 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-12cf6d29-4d86-49e0-ac8e-81cc15dfe547 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] flavor_id is None. Assuming migration. {{(pid=120598) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 26 13:03:26.573282 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-12cf6d29-4d86-49e0-ac8e-81cc15dfe547 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120598) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 26 13:03:26.607081 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-a847713d-cb2c-4acf-abd9-74eec2dd0730 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] validate_networks() for [('9d8caa44-a218-4de4-8792-8a79982b84cb', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:03:26.870294 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-12cf6d29-4d86-49e0-ac8e-81cc15dfe547 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45/action" status: 202 len: 0 microversion: 2.1 time: 0.819234 Oct 26 13:03:26.871553 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 141/260] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:03:26 2022] POST /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45/action => generated 0 bytes in 822 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 13:03:26.876920 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8c7b5af3-568f-42d5-b599-69f320b5aaf6 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:26.877860 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8c7b5af3-568f-42d5-b599-69f320b5aaf6 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] [instance: 32f65838-4cb1-4465-977b-2d320a3e3858] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:26.886421 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8c7b5af3-568f-42d5-b599-69f320b5aaf6 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:26.887145 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8c7b5af3-568f-42d5-b599-69f320b5aaf6 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:26.888649 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8c7b5af3-568f-42d5-b599-69f320b5aaf6 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:26.889702 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8c7b5af3-568f-42d5-b599-69f320b5aaf6 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:26.890325 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8c7b5af3-568f-42d5-b599-69f320b5aaf6 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:26.891219 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8c7b5af3-568f-42d5-b599-69f320b5aaf6 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:27.191098 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8c7b5af3-568f-42d5-b599-69f320b5aaf6 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999ac729ed1f4456857c8671d4b9be8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e2b56ef8db404ca0372e0a9c5f9b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:27.201750 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8c7b5af3-568f-42d5-b599-69f320b5aaf6 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] 10.222.0.40 "GET /compute/v2.1/servers/32f65838-4cb1-4465-977b-2d320a3e3858" status: 200 len: 1318 microversion: 2.1 time: 0.328665 Oct 26 13:03:27.203582 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 142/261] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:26 2022] GET /compute/v2.1/servers/32f65838-4cb1-4465-977b-2d320a3e3858 => generated 1318 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:27.208371 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3d3fe67d-18b7-4410-b980-fdc7155ad706 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:27.250394 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3d3fe67d-18b7-4410-b980-fdc7155ad706 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.045473 Oct 26 13:03:27.256110 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 143/262] 10.222.0.40 () {58 vars in 1155 bytes} [Wed Oct 26 13:03:27 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 26 13:03:27.271425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d6dbe69e-fcd4-465e-80da-9ce23848ecf5 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:27.272247 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d6dbe69e-fcd4-465e-80da-9ce23848ecf5 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:27.286184 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6dbe69e-fcd4-465e-80da-9ce23848ecf5 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:27.288635 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6dbe69e-fcd4-465e-80da-9ce23848ecf5 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:27.289102 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6dbe69e-fcd4-465e-80da-9ce23848ecf5 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:27.289850 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6dbe69e-fcd4-465e-80da-9ce23848ecf5 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:27.291102 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6dbe69e-fcd4-465e-80da-9ce23848ecf5 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:27.292309 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6dbe69e-fcd4-465e-80da-9ce23848ecf5 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:27.529772 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d6dbe69e-fcd4-465e-80da-9ce23848ecf5 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:27.538056 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d6dbe69e-fcd4-465e-80da-9ce23848ecf5 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1470 microversion: 2.1 time: 0.284302 Oct 26 13:03:27.538647 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 144/263] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:27 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1470 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:27.548475 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-dc6af42a-fa3a-4a6b-9340-38e4809107bc tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-330324376"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:27.557015 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.aggregate [None req-dc6af42a-fa3a-4a6b-9340-38e4809107bc tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Generated uuid 0039df89-d33a-4b4a-9108-8aded28dc85b for aggregate {{(pid=120598) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 26 13:03:27.587739 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:03:27.606226 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-dc6af42a-fa3a-4a6b-9340-38e4809107bc tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.066453 Oct 26 13:03:27.607926 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 145/264] 10.222.0.40 () {60 vars in 1164 bytes} [Wed Oct 26 13:03:27 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:27.615654 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1fa18ab3-f24b-43d5-ba9b-cbb63102bd94 tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Calling method '.version_select at 0x7f6732e51af0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:27.623288 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1fa18ab3-f24b-43d5-ba9b-cbb63102bd94 tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:27.624735 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1fa18ab3-f24b-43d5-ba9b-cbb63102bd94 tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:27.625535 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1fa18ab3-f24b-43d5-ba9b-cbb63102bd94 tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:27.628241 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1fa18ab3-f24b-43d5-ba9b-cbb63102bd94 tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:27.628945 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1fa18ab3-f24b-43d5-ba9b-cbb63102bd94 tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:27.629624 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1fa18ab3-f24b-43d5-ba9b-cbb63102bd94 tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:27.668277 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1fa18ab3-f24b-43d5-ba9b-cbb63102bd94 tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.058557 Oct 26 13:03:27.669257 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 146/265] 10.222.0.40 () {58 vars in 1128 bytes} [Wed Oct 26 13:03:27 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:27.686825 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-58923486-e27d-4c0b-8b43-677ef3c1bc13 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:27.722712 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-58923486-e27d-4c0b-8b43-677ef3c1bc13 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.051895 Oct 26 13:03:27.724457 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 147/266] 10.222.0.40 () {58 vars in 1155 bytes} [Wed Oct 26 13:03:27 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 26 13:03:27.736322 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fc0f0172-db04-4831-9a7e-e1c660dc3cd0 tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Calling method '.version_select at 0x7f6732e511f0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:27.746393 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fc0f0172-db04-4831-9a7e-e1c660dc3cd0 tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:27.748130 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fc0f0172-db04-4831-9a7e-e1c660dc3cd0 tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:27.751718 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fc0f0172-db04-4831-9a7e-e1c660dc3cd0 tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:27.753383 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fc0f0172-db04-4831-9a7e-e1c660dc3cd0 tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:27.755852 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fc0f0172-db04-4831-9a7e-e1c660dc3cd0 tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:27.758172 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fc0f0172-db04-4831-9a7e-e1c660dc3cd0 tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:27.799412 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fc0f0172-db04-4831-9a7e-e1c660dc3cd0 tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.073652 Oct 26 13:03:27.809472 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 148/267] 10.222.0.40 () {58 vars in 1155 bytes} [Wed Oct 26 13:03:27 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:27.815602 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fe68f3df-ece4-4a81-a1d3-6bbca3a9ed34 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:27.825413 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-fe68f3df-ece4-4a81-a1d3-6bbca3a9ed34 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Oct 26 13:03:27.827690 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fe68f3df-ece4-4a81-a1d3-6bbca3a9ed34 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Request method failure captured: Oct 26 13:03:27.827690 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/os-aggregates/12 HTTP/1.1 Oct 26 13:03:27.827690 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:03:27.827690 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:03:27.827690 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:03:27.827690 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:03:27.827690 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:03:27.827690 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:03:27.827690 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:03:27.827690 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:03:27.827690 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWS_t0hEf25VMr3GLQUes_d-ufZwXPHKPrjzSDS1ReCU0fcoRkY9XJJjsKKnHQyHKi9Egkjt6Wfokz141BmlWAJ48uL0LiC0m1po6Ewddh0uxZpc6BL7sbUwyBT5itssXBtIdXr2XXaEXHfvrCtt5h0tc2vZg-9TuMHwCon5MThHkoKQ Oct 26 13:03:27.827690 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:03:27.827690 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:03:27.827690 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:03:27.827690 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:03:27.827690 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:03:27.827690 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:03:27.827690 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: e4264ccdd9a444c5936712f4dddb90da Oct 26 13:03:27.827690 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-AggregatesAdminTestJSON-254509288 Oct 26 13:03:27.827690 n-d-862686-1 devstack@n-api.service[120598]: X-Role: admin,member,reader Oct 26 13:03:27.827690 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: admin,member,reader Oct 26 13:03:27.829078 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e4264ccdd9a444c5936712f4dddb90da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e4264ccdd9a444c5936712f4dddb90da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e4264ccdd9a444c5936712f4dddb90da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e4264ccdd9a444c5936712f4dddb90da"}]}] Oct 26 13:03:27.829078 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-AggregatesAdminTestJSON-254509288 Oct 26 13:03:27.829078 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: e4264ccdd9a444c5936712f4dddb90da Oct 26 13:03:27.829078 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-254509288 Oct 26 13:03:27.829078 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-AggregatesAdminTestJSON-254509288-project-admin Oct 26 13:03:27.829078 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:03:27.829078 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:03:27.829078 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: ac66c5ea9e2048d88c7005a8cbf44c48 Oct 26 13:03:27.829078 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-AggregatesAdminTestJSON-254509288-project-admin Oct 26 13:03:27.829078 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:03:27.829078 n-d-862686-1 devstack@n-api.service[120598]: exception: Aggregate 12 could not be found. Oct 26 13:03:27.829078 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '12'} Oct 26 13:03:27.829078 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:03:27.829979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:27.829979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 26 13:03:27.829979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 26 13:03:27.829979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 26 13:03:27.829979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 26 13:03:27.829979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 13:03:27.829979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 13:03:27.829979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 26 13:03:27.829979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 26 13:03:27.829979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 13:03:27.829979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 13:03:27.829979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 26 13:03:27.829979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 26 13:03:27.829979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Oct 26 13:03:27.829979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:27.829979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:27.829979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:27.829979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:27.829979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:27.831217 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:27.831217 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:03:27.831217 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:03:27.831217 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:03:27.831217 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:03:27.831217 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 26 13:03:27.831217 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:03:27.831217 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Oct 26 13:03:27.831217 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:27.831217 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:27.831217 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:27.831217 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:27.831217 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:27.831217 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:27.831217 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:03:27.831217 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:03:27.831217 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Oct 26 13:03:27.831217 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:27.833591 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fe68f3df-ece4-4a81-a1d3-6bbca3a9ed34 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:03:27.835858 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fe68f3df-ece4-4a81-a1d3-6bbca3a9ed34 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.024310 Oct 26 13:03:27.837164 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 149/268] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 26 13:03:27 2022] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:03:27.844990 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6a847709-3007-4bf0-9c6f-170aaa562fa9 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1563697282"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:27.850306 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.aggregate [None req-6a847709-3007-4bf0-9c6f-170aaa562fa9 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Generated uuid ade880b3-25bc-4a06-979d-77ef809212df for aggregate {{(pid=120598) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 26 13:03:27.907215 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6a847709-3007-4bf0-9c6f-170aaa562fa9 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.067131 Oct 26 13:03:27.907826 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 150/269] 10.222.0.40 () {60 vars in 1164 bytes} [Wed Oct 26 13:03:27 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:27.925782 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-91205fc9-b2f9-47a7-93e0-cf29cc3e62df tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Calling method '.version_select at 0x7f6732e3ba60>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:27.934752 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91205fc9-b2f9-47a7-93e0-cf29cc3e62df tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:27.935222 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91205fc9-b2f9-47a7-93e0-cf29cc3e62df tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:27.935666 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91205fc9-b2f9-47a7-93e0-cf29cc3e62df tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:27.941468 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91205fc9-b2f9-47a7-93e0-cf29cc3e62df tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:27.942177 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91205fc9-b2f9-47a7-93e0-cf29cc3e62df tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:27.942427 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91205fc9-b2f9-47a7-93e0-cf29cc3e62df tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:28.024638 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-91205fc9-b2f9-47a7-93e0-cf29cc3e62df tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.107214 Oct 26 13:03:28.032328 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 151/270] 10.222.0.40 () {58 vars in 1128 bytes} [Wed Oct 26 13:03:27 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:28.032876 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5a622fea-7bd4-4596-a115-08c7c969397d tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:28.047395 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-5a622fea-7bd4-4596-a115-08c7c969397d tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Oct 26 13:03:28.049072 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5a622fea-7bd4-4596-a115-08c7c969397d tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Request method failure captured: Oct 26 13:03:28.049072 n-d-862686-1 devstack@n-api.service[120598]: request: DELETE /compute/v2.1/os-aggregates/12 HTTP/1.1 Oct 26 13:03:28.049072 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:03:28.049072 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:03:28.049072 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:03:28.049072 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:03:28.049072 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:03:28.049072 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:03:28.049072 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:03:28.049072 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:03:28.049072 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWS_t0hEf25VMr3GLQUes_d-ufZwXPHKPrjzSDS1ReCU0fcoRkY9XJJjsKKnHQyHKi9Egkjt6Wfokz141BmlWAJ48uL0LiC0m1po6Ewddh0uxZpc6BL7sbUwyBT5itssXBtIdXr2XXaEXHfvrCtt5h0tc2vZg-9TuMHwCon5MThHkoKQ Oct 26 13:03:28.049072 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:03:28.049072 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:03:28.049072 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:03:28.049072 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:03:28.049072 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:03:28.049072 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:03:28.049072 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: e4264ccdd9a444c5936712f4dddb90da Oct 26 13:03:28.049072 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-AggregatesAdminTestJSON-254509288 Oct 26 13:03:28.049072 n-d-862686-1 devstack@n-api.service[120598]: X-Role: admin,member,reader Oct 26 13:03:28.049072 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: admin,member,reader Oct 26 13:03:28.050439 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e4264ccdd9a444c5936712f4dddb90da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e4264ccdd9a444c5936712f4dddb90da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e4264ccdd9a444c5936712f4dddb90da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e4264ccdd9a444c5936712f4dddb90da"}]}] Oct 26 13:03:28.050439 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-AggregatesAdminTestJSON-254509288 Oct 26 13:03:28.050439 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: e4264ccdd9a444c5936712f4dddb90da Oct 26 13:03:28.050439 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-254509288 Oct 26 13:03:28.050439 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-AggregatesAdminTestJSON-254509288-project-admin Oct 26 13:03:28.050439 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:03:28.050439 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:03:28.050439 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: ac66c5ea9e2048d88c7005a8cbf44c48 Oct 26 13:03:28.050439 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-AggregatesAdminTestJSON-254509288-project-admin Oct 26 13:03:28.050439 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:03:28.050439 n-d-862686-1 devstack@n-api.service[120598]: exception: Aggregate 12 could not be found. Oct 26 13:03:28.050439 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '12'} Oct 26 13:03:28.050439 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:03:28.051238 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:28.051238 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 26 13:03:28.051238 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 26 13:03:28.051238 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 26 13:03:28.051238 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 26 13:03:28.051238 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 13:03:28.051238 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 13:03:28.051238 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 13:03:28.051238 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 13:03:28.051238 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 26 13:03:28.051238 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 26 13:03:28.051238 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 26 13:03:28.051238 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 26 13:03:28.051238 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 13:03:28.051238 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 13:03:28.051238 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 26 13:03:28.051238 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 26 13:03:28.051238 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 13:03:28.051238 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 13:03:28.052657 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 26 13:03:28.052657 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 26 13:03:28.052657 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Oct 26 13:03:28.052657 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:28.052657 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:28.052657 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:28.052657 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:28.052657 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:28.052657 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:28.052657 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:03:28.052657 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:03:28.052657 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:03:28.052657 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:03:28.052657 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 26 13:03:28.052657 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:03:28.052657 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Oct 26 13:03:28.052657 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:28.052657 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:28.052657 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:28.052657 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:28.052657 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:28.054140 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:28.054140 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:03:28.054140 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:03:28.054140 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Oct 26 13:03:28.054140 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:28.054140 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5a622fea-7bd4-4596-a115-08c7c969397d tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:03:28.054140 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5a622fea-7bd4-4596-a115-08c7c969397d tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.022285 Oct 26 13:03:28.058211 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 152/271] 10.222.0.40 () {58 vars in 1155 bytes} [Wed Oct 26 13:03:28 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:03:28.064431 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e42442c9-a388-439a-8e28-407ffd9aca44 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862686-1"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:28.086719 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e42442c9-a388-439a-8e28-407ffd9aca44 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:28.087287 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e42442c9-a388-439a-8e28-407ffd9aca44 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:28.093323 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e42442c9-a388-439a-8e28-407ffd9aca44 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:28.276485 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e42442c9-a388-439a-8e28-407ffd9aca44 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 243 microversion: 2.1 time: 0.217131 Oct 26 13:03:28.277090 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 153/272] 10.222.0.40 () {60 vars in 1194 bytes} [Wed Oct 26 13:03:28 2022] POST /compute/v2.1/os-aggregates/13/action => generated 243 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:28.424844 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6581e7de-cbb4-4243-99e6-f27574df7069 tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] Calling method '.version_select at 0x7f6732ed9ee0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:28.509534 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6581e7de-cbb4-4243-99e6-f27574df7069 tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/56ecf288e1da4f65b224ffb411028c71" status: 200 len: 371 microversion: 2.1 time: 0.231114 Oct 26 13:03:28.510289 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 154/273] 10.222.0.40 () {58 vars in 1242 bytes} [Wed Oct 26 13:03:28 2022] GET /compute/v2.1/os-quota-sets/56ecf288e1da4f65b224ffb411028c71 => generated 371 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:28.515697 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cf3e5446-380a-4c63-b497-ca70900a0029 tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Calling method '.version_select at 0x7f6732da9820>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:28.523483 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf3e5446-380a-4c63-b497-ca70900a0029 tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:28.524231 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf3e5446-380a-4c63-b497-ca70900a0029 tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:28.525028 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf3e5446-380a-4c63-b497-ca70900a0029 tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:28.539572 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf3e5446-380a-4c63-b497-ca70900a0029 tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:28.541012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf3e5446-380a-4c63-b497-ca70900a0029 tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:28.542067 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf3e5446-380a-4c63-b497-ca70900a0029 tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:28.568600 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cf3e5446-380a-4c63-b497-ca70900a0029 tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts/n-h1-862686-1" status: 200 len: 598 microversion: 2.1 time: 0.057119 Oct 26 13:03:28.574180 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 155/274] 10.222.0.40 () {58 vars in 1170 bytes} [Wed Oct 26 13:03:28 2022] GET /compute/v2.1/os-hosts/n-h1-862686-1 => generated 598 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:28.579068 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d7e00763-af10-4e97-9718-01324d0bbee3 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-637256464", "name": "tempest-test_aggregate-470899085"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:28.584151 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.aggregate [None req-d7e00763-af10-4e97-9718-01324d0bbee3 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Generated uuid d2031273-104a-456b-ab2f-231d49f3c633 for aggregate {{(pid=120598) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 26 13:03:28.624804 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d7e00763-af10-4e97-9718-01324d0bbee3 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.049322 Oct 26 13:03:28.625927 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 156/275] 10.222.0.40 () {60 vars in 1165 bytes} [Wed Oct 26 13:03:28 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:28.648630 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-394b18c4-1c0c-4d99-aa6e-b7f30ca53e5b tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:28.649311 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-394b18c4-1c0c-4d99-aa6e-b7f30ca53e5b tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] [instance: 32f65838-4cb1-4465-977b-2d320a3e3858] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:28.657648 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-394b18c4-1c0c-4d99-aa6e-b7f30ca53e5b tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:28.659184 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-394b18c4-1c0c-4d99-aa6e-b7f30ca53e5b tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:28.660226 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-394b18c4-1c0c-4d99-aa6e-b7f30ca53e5b tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:28.660845 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-394b18c4-1c0c-4d99-aa6e-b7f30ca53e5b tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:28.661719 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-394b18c4-1c0c-4d99-aa6e-b7f30ca53e5b tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:28.662819 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-394b18c4-1c0c-4d99-aa6e-b7f30ca53e5b tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:28.826822 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-394b18c4-1c0c-4d99-aa6e-b7f30ca53e5b tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999ac729ed1f4456857c8671d4b9be8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e2b56ef8db404ca0372e0a9c5f9b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:28.840866 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-394b18c4-1c0c-4d99-aa6e-b7f30ca53e5b tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] 10.222.0.40 "GET /compute/v2.1/servers/32f65838-4cb1-4465-977b-2d320a3e3858" status: 200 len: 1467 microversion: 2.1 time: 0.213602 Oct 26 13:03:28.841378 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 157/276] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:28 2022] GET /compute/v2.1/servers/32f65838-4cb1-4465-977b-2d320a3e3858 => generated 1467 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:28.867105 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1dc9aa40-1adb-4ad0-8fcc-46c49ab6861f tempest-AggregatesAdminNegativeTestJSON-1101699066 tempest-AggregatesAdminNegativeTestJSON-1101699066-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862686-1"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:28.870576 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1dc9aa40-1adb-4ad0-8fcc-46c49ab6861f tempest-AggregatesAdminNegativeTestJSON-1101699066 tempest-AggregatesAdminNegativeTestJSON-1101699066-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'c55cf0dfb51746b9bda068c3536498e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca406a2b27e4b838ab039466e2c8588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:28.873109 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1dc9aa40-1adb-4ad0-8fcc-46c49ab6861f tempest-AggregatesAdminNegativeTestJSON-1101699066 tempest-AggregatesAdminNegativeTestJSON-1101699066-project] Request method failure captured: Oct 26 13:03:28.873109 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Oct 26 13:03:28.873109 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:03:28.873109 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:03:28.873109 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:03:28.873109 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 42 Oct 26 13:03:28.873109 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:03:28.873109 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:03:28.873109 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:03:28.873109 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:03:28.873109 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWS_q5eJmOK4ObBzLIlJBKV6OCfiIV-QcmIR657jRoGCyQAl3QGmOC9CHBOCGDaiAoz-GgK0-qde7Owt6-n2kciN9-qghTs38KEdzNc_n7Bm-Ne2HM1GbxBzGTMGgaHtR_LD1weACUuo2_1jFmGMlVcXyzKDJabONz85MsQqCMinK4Uk Oct 26 13:03:28.873109 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:03:28.873109 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:03:28.873109 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:03:28.873109 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:03:28.873109 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:03:28.873109 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:03:28.873109 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 5ca406a2b27e4b838ab039466e2c8588 Oct 26 13:03:28.873109 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1101699066 Oct 26 13:03:28.873109 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:03:28.873109 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:03:28.874534 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5ca406a2b27e4b838ab039466e2c8588"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5ca406a2b27e4b838ab039466e2c8588"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5ca406a2b27e4b838ab039466e2c8588"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5ca406a2b27e4b838ab039466e2c8588"}]}] Oct 26 13:03:28.874534 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1101699066 Oct 26 13:03:28.874534 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 5ca406a2b27e4b838ab039466e2c8588 Oct 26 13:03:28.874534 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1101699066 Oct 26 13:03:28.874534 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-AggregatesAdminNegativeTestJSON-1101699066-project Oct 26 13:03:28.874534 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:03:28.874534 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:03:28.874534 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: c55cf0dfb51746b9bda068c3536498e2 Oct 26 13:03:28.874534 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1101699066-project Oct 26 13:03:28.874534 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:03:28.874534 n-d-862686-1 devstack@n-api.service[120598]: {"remove_host": {"host": "n-h1-862686-1"}} Oct 26 13:03:28.874534 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:03:28.874534 n-d-862686-1 devstack@n-api.service[120598]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 26 13:03:28.875250 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '13', 'body': {'remove_host': {'host': 'n-h1-862686-1'}}} Oct 26 13:03:28.875250 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:03:28.875250 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:28.875250 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:28.875250 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:28.875250 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:03:28.875250 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:03:28.875250 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:03:28.875250 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:03:28.875250 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:03:28.875250 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:03:28.875250 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 26 13:03:28.875250 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 26 13:03:28.875250 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 13:03:28.875250 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 13:03:28.875250 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 13:03:28.875250 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 13:03:28.875250 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 13:03:28.875250 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 13:03:28.876279 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 13:03:28.876279 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 13:03:28.876279 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 13:03:28.876279 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 13:03:28.876279 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 13:03:28.876279 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 13:03:28.876279 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 13:03:28.876279 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 13:03:28.876279 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 26 13:03:28.876279 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:28.876279 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:28.876279 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:28.876279 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:28.876279 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:28.876279 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:28.876279 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 13:03:28.876279 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 13:03:28.876279 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 26 13:03:28.876279 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:28.877281 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1dc9aa40-1adb-4ad0-8fcc-46c49ab6861f tempest-AggregatesAdminNegativeTestJSON-1101699066 tempest-AggregatesAdminNegativeTestJSON-1101699066-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:03:28.877281 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1dc9aa40-1adb-4ad0-8fcc-46c49ab6861f tempest-AggregatesAdminNegativeTestJSON-1101699066 tempest-AggregatesAdminNegativeTestJSON-1101699066-project] 10.222.0.40 "POST /compute/v2.1/os-aggregates/13/action" status: 403 len: 121 microversion: 2.1 time: 0.011102 Oct 26 13:03:28.877281 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 158/277] 10.222.0.40 () {60 vars in 1194 bytes} [Wed Oct 26 13:03:28 2022] POST /compute/v2.1/os-aggregates/13/action => generated 121 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:03:28.881628 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e4b66404-87f8-4e8c-8915-623d866019f3 tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] Action: 'update', calling method: .version_select at 0x7f6732e3baf0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:28.891529 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-a847713d-cb2c-4acf-abd9-74eec2dd0730 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:03:28.891960 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-a847713d-cb2c-4acf-abd9-74eec2dd0730 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:03:28.892683 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-a847713d-cb2c-4acf-abd9-74eec2dd0730 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:03:28.893573 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-a847713d-cb2c-4acf-abd9-74eec2dd0730 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:03:28.894343 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-a847713d-cb2c-4acf-abd9-74eec2dd0730 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:03:28.909630 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a847713d-cb2c-4acf-abd9-74eec2dd0730 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:28.916455 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a847713d-cb2c-4acf-abd9-74eec2dd0730 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:28.916983 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a847713d-cb2c-4acf-abd9-74eec2dd0730 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:28.918719 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a847713d-cb2c-4acf-abd9-74eec2dd0730 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:28.919451 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a847713d-cb2c-4acf-abd9-74eec2dd0730 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:28.955886 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a847713d-cb2c-4acf-abd9-74eec2dd0730 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:29.005111 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-a847713d-cb2c-4acf-abd9-74eec2dd0730 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Getting quotas for project 10521abb1c34417fa9369aaba9070968. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:03:29.014051 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-a847713d-cb2c-4acf-abd9-74eec2dd0730 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Getting quotas for user 52f9391046054747bbfc1c3e6d65d4aa and project 10521abb1c34417fa9369aaba9070968. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:03:29.032308 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4b66404-87f8-4e8c-8915-623d866019f3 tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:29.032986 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4b66404-87f8-4e8c-8915-623d866019f3 tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:29.033606 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4b66404-87f8-4e8c-8915-623d866019f3 tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:29.034387 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4b66404-87f8-4e8c-8915-623d866019f3 tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:29.037810 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4b66404-87f8-4e8c-8915-623d866019f3 tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:29.038268 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4b66404-87f8-4e8c-8915-623d866019f3 tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:29.051946 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a847713d-cb2c-4acf-abd9-74eec2dd0730 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:03:29.058831 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a847713d-cb2c-4acf-abd9-74eec2dd0730 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] [instance: 380d16a8-2b4c-460b-9b36-884e7fb24812] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:03:29.163874 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a847713d-cb2c-4acf-abd9-74eec2dd0730 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.874139 Oct 26 13:03:29.167859 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 120/278] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:03:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 2880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:03:29.182113 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e4b66404-87f8-4e8c-8915-623d866019f3 tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/56ecf288e1da4f65b224ffb411028c71" status: 200 len: 328 microversion: 2.1 time: 0.305019 Oct 26 13:03:29.188272 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 159/279] 10.222.0.40 () {60 vars in 1262 bytes} [Wed Oct 26 13:03:28 2022] PUT /compute/v2.1/os-quota-sets/56ecf288e1da4f65b224ffb411028c71 => generated 328 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:29.195614 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6a311bf2-4871-4e7f-baa7-473ad2d1d072 tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Calling method '.version_select at 0x7f6732f273a0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:29.200583 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-91e453a0-6362-4752-8ec4-a6d79ba71e4a tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:29.203815 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-91e453a0-6362-4752-8ec4-a6d79ba71e4a tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:29.217083 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91e453a0-6362-4752-8ec4-a6d79ba71e4a tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:29.220009 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91e453a0-6362-4752-8ec4-a6d79ba71e4a tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:29.222475 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91e453a0-6362-4752-8ec4-a6d79ba71e4a tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:29.223476 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91e453a0-6362-4752-8ec4-a6d79ba71e4a tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:29.224323 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91e453a0-6362-4752-8ec4-a6d79ba71e4a tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:29.225225 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91e453a0-6362-4752-8ec4-a6d79ba71e4a tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:29.240932 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a311bf2-4871-4e7f-baa7-473ad2d1d072 tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:29.242816 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a311bf2-4871-4e7f-baa7-473ad2d1d072 tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:29.245007 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a311bf2-4871-4e7f-baa7-473ad2d1d072 tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:29.286610 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a311bf2-4871-4e7f-baa7-473ad2d1d072 tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:29.290224 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a311bf2-4871-4e7f-baa7-473ad2d1d072 tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:29.291468 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a311bf2-4871-4e7f-baa7-473ad2d1d072 tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:29.302949 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6a311bf2-4871-4e7f-baa7-473ad2d1d072 tempest-HostsAdminTestJSON-1884722552 tempest-HostsAdminTestJSON-1884722552-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts/n-h2-862686-1" status: 200 len: 332 microversion: 2.1 time: 0.113131 Oct 26 13:03:29.307591 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 160/280] 10.222.0.40 () {58 vars in 1170 bytes} [Wed Oct 26 13:03:29 2022] GET /compute/v2.1/os-hosts/n-h2-862686-1 => generated 332 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:29.340251 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d8d77263-9284-4772-b377-39112e7f2348 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:29.409381 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d8d77263-9284-4772-b377-39112e7f2348 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.100470 Oct 26 13:03:29.410648 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 161/281] 10.222.0.40 () {58 vars in 1155 bytes} [Wed Oct 26 13:03:29 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 26 13:03:29.669861 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-91e453a0-6362-4752-8ec4-a6d79ba71e4a tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:29.680027 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-91e453a0-6362-4752-8ec4-a6d79ba71e4a tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1470 microversion: 2.1 time: 0.509361 Oct 26 13:03:29.701422 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 121/282] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:29 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1470 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:29.738307 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e29540bd-2c5d-46ec-80b6-d2623bfc7849 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862686-1"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:29.795039 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e29540bd-2c5d-46ec-80b6-d2623bfc7849 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:29.795524 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e29540bd-2c5d-46ec-80b6-d2623bfc7849 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:29.795970 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e29540bd-2c5d-46ec-80b6-d2623bfc7849 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:29.869062 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6a1f6cde-4932-4eac-ab32-7ed8a1b083b6 tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1519330071", "block_migration": true, "disk_over_commit": false}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:29.872126 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6a1f6cde-4932-4eac-ab32-7ed8a1b083b6 tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] [instance: 32f65838-4cb1-4465-977b-2d320a3e3858] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:29.892751 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a1f6cde-4932-4eac-ab32-7ed8a1b083b6 tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:29.893383 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a1f6cde-4932-4eac-ab32-7ed8a1b083b6 tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:29.893812 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a1f6cde-4932-4eac-ab32-7ed8a1b083b6 tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:29.894396 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a1f6cde-4932-4eac-ab32-7ed8a1b083b6 tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:29.894850 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a1f6cde-4932-4eac-ab32-7ed8a1b083b6 tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:29.904523 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a1f6cde-4932-4eac-ab32-7ed8a1b083b6 tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:30.055471 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-6a1f6cde-4932-4eac-ab32-7ed8a1b083b6 tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] Lazy-loading 'flavor' on Instance uuid 32f65838-4cb1-4465-977b-2d320a3e3858 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:03:30.141843 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6a1f6cde-4932-4eac-ab32-7ed8a1b083b6 tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] [instance: 32f65838-4cb1-4465-977b-2d320a3e3858] Going to try to live migrate instance to tempest-host-1519330071 {{(pid=120598) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 26 13:03:30.151489 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-6a1f6cde-4932-4eac-ab32-7ed8a1b083b6 tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] HTTP exception thrown: Compute host tempest-host-1519330071 could not be found. Oct 26 13:03:30.154163 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e29540bd-2c5d-46ec-80b6-d2623bfc7849 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 228 microversion: 2.1 time: 0.449030 Oct 26 13:03:30.154788 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 122/283] 10.222.0.40 () {60 vars in 1194 bytes} [Wed Oct 26 13:03:29 2022] POST /compute/v2.1/os-aggregates/13/action => generated 228 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:30.157796 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6a1f6cde-4932-4eac-ab32-7ed8a1b083b6 tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] Request method failure captured: Oct 26 13:03:30.157796 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/servers/32f65838-4cb1-4465-977b-2d320a3e3858/action HTTP/1.1 Oct 26 13:03:30.157796 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:03:30.157796 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:03:30.157796 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:03:30.157796 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 107 Oct 26 13:03:30.157796 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:03:30.157796 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:03:30.157796 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:03:30.157796 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:03:30.157796 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTALlBnXIR8m4_ICr8Ny9UPFjVPhp9aF5ukwvqPGuLcaEeYAemBO1iud4nJxYqK6Qgt1EKvC2-PRegO9qr5FY2WiDuJFz3poifRUbjctz6DxtZ1SGb3my2Y2CQZyOWW947Qu0MRk617NOdSFFtHLHxlUP8Z-mZU74syt1pA4MFFFb-g Oct 26 13:03:30.157796 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:03:30.157796 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:03:30.157796 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:03:30.157796 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:03:30.157796 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:03:30.157796 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:03:30.157796 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: d382ca677cb847298c3f3d255b34808f Oct 26 13:03:30.157796 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-LiveMigrationNegativeTest-1165665104 Oct 26 13:03:30.157796 n-d-862686-1 devstack@n-api.service[120598]: X-Role: admin,member,reader Oct 26 13:03:30.157796 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: admin,member,reader Oct 26 13:03:30.159057 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d382ca677cb847298c3f3d255b34808f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d382ca677cb847298c3f3d255b34808f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d382ca677cb847298c3f3d255b34808f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d382ca677cb847298c3f3d255b34808f"}]}] Oct 26 13:03:30.159057 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-LiveMigrationNegativeTest-1165665104 Oct 26 13:03:30.159057 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: d382ca677cb847298c3f3d255b34808f Oct 26 13:03:30.159057 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1165665104 Oct 26 13:03:30.159057 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-LiveMigrationNegativeTest-1165665104-project-admin Oct 26 13:03:30.159057 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:03:30.159057 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:03:30.159057 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 73631c4458f7456f910e9754ef437ef9 Oct 26 13:03:30.159057 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-LiveMigrationNegativeTest-1165665104-project-admin Oct 26 13:03:30.159057 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:03:30.159057 n-d-862686-1 devstack@n-api.service[120598]: {"os-migrateLive": {"host": "tempest-host-1519330071", "block_migration": true, "disk_over_commit": false}} Oct 26 13:03:30.159057 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:03:30.159885 n-d-862686-1 devstack@n-api.service[120598]: exception: Compute host tempest-host-1519330071 could not be found. Oct 26 13:03:30.159885 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '32f65838-4cb1-4465-977b-2d320a3e3858', 'body': {'os-migrateLive': {'host': 'tempest-host-1519330071', 'block_migration': True, 'disk_over_commit': False}}} Oct 26 13:03:30.159885 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:03:30.159885 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:30.159885 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 26 13:03:30.159885 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 26 13:03:30.159885 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 26 13:03:30.159885 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 13:03:30.159885 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 26 13:03:30.159885 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 26 13:03:30.159885 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 26 13:03:30.159885 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 26 13:03:30.159885 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 26 13:03:30.159885 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 26 13:03:30.159885 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 26 13:03:30.159885 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 26 13:03:30.159885 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 26 13:03:30.159885 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 26 13:03:30.159885 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 26 13:03:30.160851 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 13:03:30.160851 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 26 13:03:30.160851 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 26 13:03:30.160851 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 26 13:03:30.160851 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 26 13:03:30.160851 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 13:03:30.160851 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 13:03:30.160851 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 26 13:03:30.160851 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 26 13:03:30.160851 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 26 13:03:30.160851 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:03:30.160851 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 26 13:03:30.160851 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 26 13:03:30.160851 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 26 13:03:30.160851 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 26 13:03:30.160851 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 26 13:03:30.160851 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 26 13:03:30.160851 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1519330071 could not be found. Oct 26 13:03:30.160851 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:30.162528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:30.162528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:30.162528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:30.162528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:30.162528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:30.162528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:03:30.162528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:03:30.162528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:03:30.162528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:03:30.162528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:03:30.162528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:03:30.162528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:03:30.162528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:03:30.162528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:03:30.162528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:03:30.162528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 26 13:03:30.162528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 26 13:03:30.162528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 26 13:03:30.162528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1519330071 could not be found. Oct 26 13:03:30.162528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:30.165135 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:30.165135 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:30.165135 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:30.165135 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:30.165135 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:30.165135 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:03:30.165135 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:03:30.165135 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1519330071 could not be found. Oct 26 13:03:30.165135 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:30.170241 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6a1f6cde-4932-4eac-ab32-7ed8a1b083b6 tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] Returning 400 to user: Compute host tempest-host-1519330071 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:03:30.171431 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6a1f6cde-4932-4eac-ab32-7ed8a1b083b6 tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/32f65838-4cb1-4465-977b-2d320a3e3858/action" status: 400 len: 100 microversion: 2.1 time: 0.758866 Oct 26 13:03:30.172440 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-061e8624-6308-4ffb-b962-dd0a321a496a tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:30.173188 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 162/284] 10.222.0.40 () {60 vars in 1279 bytes} [Wed Oct 26 13:03:29 2022] POST /compute/v2.1/servers/32f65838-4cb1-4465-977b-2d320a3e3858/action => generated 100 bytes in 762 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:03:30.179155 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5d0b2382-0897-4cae-b284-973bc0af3213 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:30.179901 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-061e8624-6308-4ffb-b962-dd0a321a496a tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] [instance: 380d16a8-2b4c-460b-9b36-884e7fb24812] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:30.190884 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-5d0b2382-0897-4cae-b284-973bc0af3213 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Oct 26 13:03:30.192774 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5d0b2382-0897-4cae-b284-973bc0af3213 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Request method failure captured: Oct 26 13:03:30.192774 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Oct 26 13:03:30.192774 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:03:30.192774 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:03:30.192774 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:03:30.192774 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:03:30.192774 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:03:30.192774 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:03:30.192774 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:03:30.192774 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:03:30.192774 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWS_t0hEf25VMr3GLQUes_d-ufZwXPHKPrjzSDS1ReCU0fcoRkY9XJJjsKKnHQyHKi9Egkjt6Wfokz141BmlWAJ48uL0LiC0m1po6Ewddh0uxZpc6BL7sbUwyBT5itssXBtIdXr2XXaEXHfvrCtt5h0tc2vZg-9TuMHwCon5MThHkoKQ Oct 26 13:03:30.192774 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:03:30.192774 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:03:30.192774 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:03:30.192774 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:03:30.192774 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:03:30.192774 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:03:30.192774 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: e4264ccdd9a444c5936712f4dddb90da Oct 26 13:03:30.192774 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-AggregatesAdminTestJSON-254509288 Oct 26 13:03:30.192774 n-d-862686-1 devstack@n-api.service[120598]: X-Role: admin,member,reader Oct 26 13:03:30.192774 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: admin,member,reader Oct 26 13:03:30.194011 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e4264ccdd9a444c5936712f4dddb90da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e4264ccdd9a444c5936712f4dddb90da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e4264ccdd9a444c5936712f4dddb90da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e4264ccdd9a444c5936712f4dddb90da"}]}] Oct 26 13:03:30.194011 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-AggregatesAdminTestJSON-254509288 Oct 26 13:03:30.194011 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: e4264ccdd9a444c5936712f4dddb90da Oct 26 13:03:30.194011 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-254509288 Oct 26 13:03:30.194011 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-AggregatesAdminTestJSON-254509288-project-admin Oct 26 13:03:30.194011 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:03:30.194011 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:03:30.194011 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: ac66c5ea9e2048d88c7005a8cbf44c48 Oct 26 13:03:30.194011 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-AggregatesAdminTestJSON-254509288-project-admin Oct 26 13:03:30.194011 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:03:30.194011 n-d-862686-1 devstack@n-api.service[120598]: exception: Aggregate 14 could not be found. Oct 26 13:03:30.194011 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '14'} Oct 26 13:03:30.194011 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:03:30.194708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:30.194708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 26 13:03:30.194708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 26 13:03:30.194708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 26 13:03:30.194708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 26 13:03:30.194708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 13:03:30.194708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 13:03:30.194708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 26 13:03:30.194708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 26 13:03:30.194708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 13:03:30.194708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 13:03:30.194708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 26 13:03:30.194708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 26 13:03:30.194708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Oct 26 13:03:30.194708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:30.194708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:30.194708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:30.194708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:30.194708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:30.195682 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:30.195682 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:03:30.195682 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:03:30.195682 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:03:30.195682 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:03:30.195682 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 26 13:03:30.195682 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:03:30.195682 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Oct 26 13:03:30.195682 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:30.195682 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:30.195682 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:30.195682 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:30.195682 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:30.195682 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:30.195682 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:03:30.195682 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:03:30.195682 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Oct 26 13:03:30.195682 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:30.197651 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=10,nova_api:INSERT=8 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:03:30.198867 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5d0b2382-0897-4cae-b284-973bc0af3213 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:03:30.200439 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5d0b2382-0897-4cae-b284-973bc0af3213 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.025988 Oct 26 13:03:30.205822 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 163/285] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 26 13:03:30 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:03:30.318808 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-061e8624-6308-4ffb-b962-dd0a321a496a tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f9391046054747bbfc1c3e6d65d4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10521abb1c34417fa9369aaba9070968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:30.329624 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-061e8624-6308-4ffb-b962-dd0a321a496a tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] 10.222.0.40 "GET /compute/v2.1/servers/380d16a8-2b4c-460b-9b36-884e7fb24812" status: 200 len: 1263 microversion: 2.1 time: 0.173714 Oct 26 13:03:30.331086 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 123/286] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:30 2022] GET /compute/v2.1/servers/380d16a8-2b4c-460b-9b36-884e7fb24812 => generated 1263 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:30.345300 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f3a5105a-d722-418e-9961-c9ef1221d6ea tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:30.414850 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f3a5105a-d722-418e-9961-c9ef1221d6ea tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.082172 Oct 26 13:03:30.415616 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 124/287] 10.222.0.40 () {58 vars in 1155 bytes} [Wed Oct 26 13:03:30 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 26 13:03:30.424842 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a10b2386-a25b-491e-8cdf-7ed2e82ff6f9 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:30.425496 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a10b2386-a25b-491e-8cdf-7ed2e82ff6f9 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] [instance: 32f65838-4cb1-4465-977b-2d320a3e3858] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:30.434117 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a10b2386-a25b-491e-8cdf-7ed2e82ff6f9 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:30.434882 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a10b2386-a25b-491e-8cdf-7ed2e82ff6f9 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:30.436028 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a10b2386-a25b-491e-8cdf-7ed2e82ff6f9 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:30.436896 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a10b2386-a25b-491e-8cdf-7ed2e82ff6f9 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:30.437528 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a10b2386-a25b-491e-8cdf-7ed2e82ff6f9 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:30.438278 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a10b2386-a25b-491e-8cdf-7ed2e82ff6f9 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:30.572499 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1e2273ba-9e81-4390-a984-89e4591066a7 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1159434232", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:30.709997 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-1e2273ba-9e81-4390-a984-89e4591066a7 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] validate_networks() for None {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:03:30.749947 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a10b2386-a25b-491e-8cdf-7ed2e82ff6f9 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999ac729ed1f4456857c8671d4b9be8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e2b56ef8db404ca0372e0a9c5f9b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:30.774444 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a10b2386-a25b-491e-8cdf-7ed2e82ff6f9 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] 10.222.0.40 "GET /compute/v2.1/servers/32f65838-4cb1-4465-977b-2d320a3e3858" status: 200 len: 1467 microversion: 2.1 time: 0.355501 Oct 26 13:03:30.775958 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 125/288] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:30 2022] GET /compute/v2.1/servers/32f65838-4cb1-4465-977b-2d320a3e3858 => generated 1467 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:30.782053 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ea9ed551-b169-4631-aac5-c19ecca11f55 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:30.801247 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-ea9ed551-b169-4631-aac5-c19ecca11f55 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Oct 26 13:03:30.804587 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ea9ed551-b169-4631-aac5-c19ecca11f55 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Request method failure captured: Oct 26 13:03:30.804587 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Oct 26 13:03:30.804587 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:03:30.804587 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:03:30.804587 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:03:30.804587 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:03:30.804587 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:03:30.804587 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:03:30.804587 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:03:30.804587 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:03:30.804587 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWS_t0hEf25VMr3GLQUes_d-ufZwXPHKPrjzSDS1ReCU0fcoRkY9XJJjsKKnHQyHKi9Egkjt6Wfokz141BmlWAJ48uL0LiC0m1po6Ewddh0uxZpc6BL7sbUwyBT5itssXBtIdXr2XXaEXHfvrCtt5h0tc2vZg-9TuMHwCon5MThHkoKQ Oct 26 13:03:30.804587 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:03:30.804587 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:03:30.804587 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:03:30.804587 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:03:30.804587 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:03:30.804587 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:03:30.804587 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: e4264ccdd9a444c5936712f4dddb90da Oct 26 13:03:30.804587 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-AggregatesAdminTestJSON-254509288 Oct 26 13:03:30.804587 n-d-862686-1 devstack@n-api.service[120597]: X-Role: admin,member,reader Oct 26 13:03:30.804587 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: admin,member,reader Oct 26 13:03:30.807040 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e4264ccdd9a444c5936712f4dddb90da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e4264ccdd9a444c5936712f4dddb90da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e4264ccdd9a444c5936712f4dddb90da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e4264ccdd9a444c5936712f4dddb90da"}]}] Oct 26 13:03:30.807040 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-AggregatesAdminTestJSON-254509288 Oct 26 13:03:30.807040 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: e4264ccdd9a444c5936712f4dddb90da Oct 26 13:03:30.807040 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-254509288 Oct 26 13:03:30.807040 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-AggregatesAdminTestJSON-254509288-project-admin Oct 26 13:03:30.807040 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:03:30.807040 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:03:30.807040 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: ac66c5ea9e2048d88c7005a8cbf44c48 Oct 26 13:03:30.807040 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-AggregatesAdminTestJSON-254509288-project-admin Oct 26 13:03:30.807040 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:03:30.807040 n-d-862686-1 devstack@n-api.service[120597]: exception: Aggregate 14 could not be found. Oct 26 13:03:30.807040 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '14'} Oct 26 13:03:30.807040 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:03:30.808552 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:30.808552 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 26 13:03:30.808552 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 26 13:03:30.808552 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 26 13:03:30.808552 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 26 13:03:30.808552 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 13:03:30.808552 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 13:03:30.808552 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 13:03:30.808552 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 13:03:30.808552 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 26 13:03:30.808552 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 26 13:03:30.808552 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 26 13:03:30.808552 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 26 13:03:30.808552 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 13:03:30.808552 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 13:03:30.808552 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 26 13:03:30.808552 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 26 13:03:30.808552 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 13:03:30.808552 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 13:03:30.810493 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 26 13:03:30.810493 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 26 13:03:30.810493 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Oct 26 13:03:30.810493 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:03:30.810493 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:30.810493 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:03:30.810493 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:30.810493 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:30.810493 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:30.810493 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:03:30.810493 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:03:30.810493 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:03:30.810493 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:03:30.810493 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 26 13:03:30.810493 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:03:30.810493 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Oct 26 13:03:30.810493 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:03:30.810493 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:30.810493 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:03:30.810493 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:30.810493 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:30.811788 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:30.811788 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:03:30.811788 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:03:30.811788 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Oct 26 13:03:30.811788 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:03:30.811788 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ea9ed551-b169-4631-aac5-c19ecca11f55 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:03:30.811788 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ea9ed551-b169-4631-aac5-c19ecca11f55 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.034086 Oct 26 13:03:30.820398 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 126/289] 10.222.0.40 () {58 vars in 1155 bytes} [Wed Oct 26 13:03:30 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:03:30.829570 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-02c9049d-8dd9-44e1-89a1-5b1b4479945d tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1757960606"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:30.837526 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.aggregate [None req-02c9049d-8dd9-44e1-89a1-5b1b4479945d tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Generated uuid 2edbd050-5ed1-49e8-95a2-0270ad0b9a9b for aggregate {{(pid=120597) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 26 13:03:30.905513 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-02c9049d-8dd9-44e1-89a1-5b1b4479945d tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.083917 Oct 26 13:03:30.906123 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 127/290] 10.222.0.40 () {60 vars in 1164 bytes} [Wed Oct 26 13:03:30 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:30.935316 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a4b23635-a905-4578-96c5-1caacfca732b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:30.936168 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a4b23635-a905-4578-96c5-1caacfca732b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:30.960240 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4b23635-a905-4578-96c5-1caacfca732b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:30.960917 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4b23635-a905-4578-96c5-1caacfca732b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:30.961525 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4b23635-a905-4578-96c5-1caacfca732b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:30.962564 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4b23635-a905-4578-96c5-1caacfca732b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:30.963167 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4b23635-a905-4578-96c5-1caacfca732b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:30.963737 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4b23635-a905-4578-96c5-1caacfca732b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:31.161942 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-1e2273ba-9e81-4390-a984-89e4591066a7 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:03:31.162403 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-1e2273ba-9e81-4390-a984-89e4591066a7 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:03:31.163623 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-1e2273ba-9e81-4390-a984-89e4591066a7 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:03:31.164118 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-1e2273ba-9e81-4390-a984-89e4591066a7 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:03:31.164721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-1e2273ba-9e81-4390-a984-89e4591066a7 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:03:31.177658 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1e2273ba-9e81-4390-a984-89e4591066a7 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:31.177658 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1e2273ba-9e81-4390-a984-89e4591066a7 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:31.177658 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1e2273ba-9e81-4390-a984-89e4591066a7 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:31.177658 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1e2273ba-9e81-4390-a984-89e4591066a7 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:31.177977 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1e2273ba-9e81-4390-a984-89e4591066a7 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:31.178163 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1e2273ba-9e81-4390-a984-89e4591066a7 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:31.202429 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-1e2273ba-9e81-4390-a984-89e4591066a7 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Getting quotas for project 56ecf288e1da4f65b224ffb411028c71. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:03:31.207038 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-1e2273ba-9e81-4390-a984-89e4591066a7 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Getting quotas for user 734498bc8a514af3b576008643b88351 and project 56ecf288e1da4f65b224ffb411028c71. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:03:31.218710 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.utils [None req-1e2273ba-9e81-4390-a984-89e4591066a7 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] cores quota exceeded for 56ecf288e1da4f65b224ffb411028c71, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120598) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 26 13:03:31.219550 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-1e2273ba-9e81-4390-a984-89e4591066a7 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 26 13:03:31.223145 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1e2273ba-9e81-4390-a984-89e4591066a7 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Request method failure captured: Oct 26 13:03:31.223145 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 13:03:31.223145 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:03:31.223145 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:03:31.223145 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:03:31.223145 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 145 Oct 26 13:03:31.223145 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:03:31.223145 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:03:31.223145 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:03:31.223145 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:03:31.223145 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTAe70Q_gEUWoxROpZBRWu2xmmQDBIWVtoKKVfTpdm_8tbKQVVT5VFq0ff5g8kdnZBJ2Vw0xbegys3GVg0PRu8W6rspWplVfPsDRsxeyFXN6wYsc_yPysctMCAAYVtLHPnCm5vKG1ru92FVKb0yRT7MEeJddqyRcfzCLvNNcQQ2scBY Oct 26 13:03:31.223145 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:03:31.223145 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:03:31.223145 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:03:31.223145 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:03:31.223145 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:03:31.223145 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:03:31.223145 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 56ecf288e1da4f65b224ffb411028c71 Oct 26 13:03:31.223145 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-QuotasAdminNegativeTest-211329314 Oct 26 13:03:31.223145 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:03:31.223145 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:03:31.224539 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/56ecf288e1da4f65b224ffb411028c71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/56ecf288e1da4f65b224ffb411028c71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_56ecf288e1da4f65b224ffb411028c71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/56ecf288e1da4f65b224ffb411028c71"}]}] Oct 26 13:03:31.224539 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-QuotasAdminNegativeTest-211329314 Oct 26 13:03:31.224539 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 56ecf288e1da4f65b224ffb411028c71 Oct 26 13:03:31.224539 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-211329314 Oct 26 13:03:31.224539 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-QuotasAdminNegativeTest-211329314-project Oct 26 13:03:31.224539 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:03:31.224539 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:03:31.224539 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 734498bc8a514af3b576008643b88351 Oct 26 13:03:31.224539 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-QuotasAdminNegativeTest-211329314-project Oct 26 13:03:31.224539 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:03:31.224539 n-d-862686-1 devstack@n-api.service[120598]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1159434232", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452"}} Oct 26 13:03:31.224539 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:03:31.230162 n-d-862686-1 devstack@n-api.service[120598]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 26 13:03:31.230162 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1159434232', 'imageRef': '762c20f4-0f9b-45cb-bd95-cf21a747b33b', 'flavorRef': '452'}}} Oct 26 13:03:31.230162 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:03:31.230162 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:31.230162 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 26 13:03:31.230162 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 26 13:03:31.230162 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 13:03:31.230162 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 13:03:31.230162 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 26 13:03:31.230162 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc Oct 26 13:03:31.230162 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 26 13:03:31.230162 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 26 13:03:31.230162 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 13:03:31.230162 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 13:03:31.230162 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 26 13:03:31.230162 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 26 13:03:31.230162 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 26 13:03:31.230162 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 26 13:03:31.231384 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 26 13:03:31.231384 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 26 13:03:31.231384 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 26 13:03:31.231384 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:31.231384 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:31.231384 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:31.231384 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:31.231384 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 26 13:03:31.231384 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 26 13:03:31.231384 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 26 13:03:31.231384 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 26 13:03:31.231384 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 26 13:03:31.231384 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 26 13:03:31.231384 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 26 13:03:31.231384 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 26 13:03:31.231384 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 26 13:03:31.231384 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 26 13:03:31.231384 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 26 13:03:31.231384 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:31.231384 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:31.231384 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:31.232709 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:31.232709 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:31.232709 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:31.232709 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:03:31.232709 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:03:31.232709 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:03:31.232709 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:03:31.232709 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:03:31.232709 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:03:31.232709 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:03:31.232709 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:03:31.232709 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:03:31.232709 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:03:31.232709 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 26 13:03:31.232709 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 26 13:03:31.232709 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 26 13:03:31.232709 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 26 13:03:31.232709 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:31.232709 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:31.232709 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:31.232709 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:31.235675 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:31.235675 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:31.235675 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:03:31.235675 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:03:31.235675 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 26 13:03:31.235675 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:31.235675 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1e2273ba-9e81-4390-a984-89e4591066a7 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:03:31.235675 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1e2273ba-9e81-4390-a984-89e4591066a7 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.017072 Oct 26 13:03:31.235675 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 164/291] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:03:30 2022] POST /compute/v2.1/servers => generated 111 bytes in 1019 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:03:31.236247 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-987f60a2-5915-44e7-a661-3023f77c94fd tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1428746510"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:31.237372 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.aggregate [None req-987f60a2-5915-44e7-a661-3023f77c94fd tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Generated uuid 2e45c625-87fa-4293-be0b-7b48884fe133 for aggregate {{(pid=120598) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 26 13:03:31.278021 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a4b23635-a905-4578-96c5-1caacfca732b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:31.283252 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-987f60a2-5915-44e7-a661-3023f77c94fd tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.056546 Oct 26 13:03:31.286308 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a4b23635-a905-4578-96c5-1caacfca732b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1470 microversion: 2.1 time: 0.371174 Oct 26 13:03:31.293277 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 128/293] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:30 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1470 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:31.294024 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 165/293] 10.222.0.40 () {60 vars in 1164 bytes} [Wed Oct 26 13:03:31 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:31.301142 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4d973d41-bac7-4eb3-ba05-6cdbd0fa3c90 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:31.311042 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-33cf5479-a0e7-4e39-b011-e46eb2a88b78 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-297608818", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:31.337009 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4d973d41-bac7-4eb3-ba05-6cdbd0fa3c90 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:31.338137 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4d973d41-bac7-4eb3-ba05-6cdbd0fa3c90 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:31.338652 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4d973d41-bac7-4eb3-ba05-6cdbd0fa3c90 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:31.355159 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4d973d41-bac7-4eb3-ba05-6cdbd0fa3c90 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:31.355649 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4d973d41-bac7-4eb3-ba05-6cdbd0fa3c90 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:31.356084 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4d973d41-bac7-4eb3-ba05-6cdbd0fa3c90 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:31.382861 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-33cf5479-a0e7-4e39-b011-e46eb2a88b78 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] validate_networks() for None {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:03:31.392063 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.compute.aggregates [None req-4d973d41-bac7-4eb3-ba05-6cdbd0fa3c90 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Failed to remove host nonexist_host from aggregate 15. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 26 13:03:31.395607 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-4d973d41-bac7-4eb3-ba05-6cdbd0fa3c90 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 15 Oct 26 13:03:31.397584 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4d973d41-bac7-4eb3-ba05-6cdbd0fa3c90 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Request method failure captured: Oct 26 13:03:31.397584 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/os-aggregates/15/action HTTP/1.1 Oct 26 13:03:31.397584 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:03:31.397584 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:03:31.397584 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:03:31.397584 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 42 Oct 26 13:03:31.397584 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:03:31.397584 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:03:31.397584 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:03:31.397584 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:03:31.397584 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWS_sfFRcMzjEYCQSXneDm5toGZqZB16WOH-Qo-4Bz_te2no6v1TsESTknsuuI11u4x_4c5NiHEEusXv1wJkBD8bTSxEE6bBphxZSEWFwa4Nvl0KEZhzS3PnReyi2f2CzNz2Pl85lqWxrTQ5TVaKv5_KO-GQon2hwsILTZXHj2hYN2Gg Oct 26 13:03:31.397584 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:03:31.397584 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:03:31.397584 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:03:31.397584 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:03:31.397584 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:03:31.397584 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:03:31.397584 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 6e3d346ad1fa46fb955330afa42acf9f Oct 26 13:03:31.397584 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-710602825 Oct 26 13:03:31.397584 n-d-862686-1 devstack@n-api.service[120597]: X-Role: admin,member,reader Oct 26 13:03:31.397584 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: admin,member,reader Oct 26 13:03:31.398986 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6e3d346ad1fa46fb955330afa42acf9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6e3d346ad1fa46fb955330afa42acf9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6e3d346ad1fa46fb955330afa42acf9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6e3d346ad1fa46fb955330afa42acf9f"}]}] Oct 26 13:03:31.398986 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-710602825 Oct 26 13:03:31.398986 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 6e3d346ad1fa46fb955330afa42acf9f Oct 26 13:03:31.398986 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-710602825 Oct 26 13:03:31.398986 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin Oct 26 13:03:31.398986 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:03:31.398986 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:03:31.398986 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: e106beb4f1bd44acbbd3a88dddef9303 Oct 26 13:03:31.398986 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin Oct 26 13:03:31.398986 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:03:31.398986 n-d-862686-1 devstack@n-api.service[120597]: {"remove_host": {"host": "nonexist_host"}} Oct 26 13:03:31.398986 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:03:31.398986 n-d-862686-1 devstack@n-api.service[120597]: exception: Cannot remove host nonexist_host in aggregate 15 Oct 26 13:03:31.400261 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '15', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 26 13:03:31.400261 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:03:31.400261 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:31.400261 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 26 13:03:31.400261 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 26 13:03:31.400261 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 13:03:31.400261 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 13:03:31.400261 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 26 13:03:31.400261 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 26 13:03:31.400261 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 13:03:31.400261 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 13:03:31.400261 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 26 13:03:31.400261 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 26 13:03:31.400261 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 26 13:03:31.400261 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:03:31.400261 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:31.400261 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:03:31.400261 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:31.400261 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 26 13:03:31.400261 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 26 13:03:31.401303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 26 13:03:31.401303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 26 13:03:31.401303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 26 13:03:31.401303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:03:31.401303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:31.401303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:03:31.401303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:31.401303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 26 13:03:31.401303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 26 13:03:31.401303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 26 13:03:31.401303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 26 13:03:31.401303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 13:03:31.401303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 13:03:31.401303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 13:03:31.401303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 13:03:31.401303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 26 13:03:31.401303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 26 13:03:31.401303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 26 13:03:31.401303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 26 13:03:31.401303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 26 13:03:31.402380 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 26 13:03:31.402380 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 26 13:03:31.402380 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:03:31.402380 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:31.402380 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:03:31.402380 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:31.402380 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:31.402380 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:31.402380 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:03:31.402380 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:03:31.402380 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:03:31.402380 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:03:31.402380 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:03:31.402380 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:03:31.402380 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 26 13:03:31.402380 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 26 13:03:31.402380 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 15 Oct 26 13:03:31.402380 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:03:31.402380 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:31.402380 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:03:31.402380 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:31.403453 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:31.403453 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:31.403453 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:03:31.403453 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:03:31.403453 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 15 Oct 26 13:03:31.403453 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:03:31.405459 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4d973d41-bac7-4eb3-ba05-6cdbd0fa3c90 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 15 {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:03:31.406517 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4d973d41-bac7-4eb3-ba05-6cdbd0fa3c90 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/15/action" status: 404 len: 94 microversion: 2.1 time: 0.114908 Oct 26 13:03:31.410523 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 129/294] 10.222.0.40 () {60 vars in 1194 bytes} [Wed Oct 26 13:03:31 2022] POST /compute/v2.1/os-aggregates/15/action => generated 94 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:03:31.415359 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-03f57b46-4b55-4c96-b1b8-bb1a216d1253 tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] Action: 'update', calling method: .version_select at 0x7f673322c3a0>, body: {"quota_set": {"cores": 20}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:31.727378 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-33cf5479-a0e7-4e39-b011-e46eb2a88b78 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:03:31.727907 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-33cf5479-a0e7-4e39-b011-e46eb2a88b78 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:03:31.728315 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-33cf5479-a0e7-4e39-b011-e46eb2a88b78 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:03:31.728722 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-33cf5479-a0e7-4e39-b011-e46eb2a88b78 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:03:31.729277 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-33cf5479-a0e7-4e39-b011-e46eb2a88b78 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:03:31.740729 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33cf5479-a0e7-4e39-b011-e46eb2a88b78 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:31.741753 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33cf5479-a0e7-4e39-b011-e46eb2a88b78 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:31.742483 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33cf5479-a0e7-4e39-b011-e46eb2a88b78 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:31.744319 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33cf5479-a0e7-4e39-b011-e46eb2a88b78 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:31.745027 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33cf5479-a0e7-4e39-b011-e46eb2a88b78 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:31.746506 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33cf5479-a0e7-4e39-b011-e46eb2a88b78 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:31.788122 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=4,nova_api:INSERT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:03:31.804928 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-33cf5479-a0e7-4e39-b011-e46eb2a88b78 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Getting quotas for project d4e2b56ef8db404ca0372e0a9c5f9b16. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:03:31.814052 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-33cf5479-a0e7-4e39-b011-e46eb2a88b78 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Getting quotas for user 999ac729ed1f4456857c8671d4b9be8a and project d4e2b56ef8db404ca0372e0a9c5f9b16. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:03:31.844068 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-33cf5479-a0e7-4e39-b011-e46eb2a88b78 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:03:31.848152 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-33cf5479-a0e7-4e39-b011-e46eb2a88b78 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] [instance: 3b17e574-b449-4b57-b82d-82303ec940ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:03:31.875664 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03f57b46-4b55-4c96-b1b8-bb1a216d1253 tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:31.876393 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03f57b46-4b55-4c96-b1b8-bb1a216d1253 tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:31.880772 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03f57b46-4b55-4c96-b1b8-bb1a216d1253 tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:31.882188 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03f57b46-4b55-4c96-b1b8-bb1a216d1253 tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:31.882881 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03f57b46-4b55-4c96-b1b8-bb1a216d1253 tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:31.883545 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03f57b46-4b55-4c96-b1b8-bb1a216d1253 tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:31.933857 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-33cf5479-a0e7-4e39-b011-e46eb2a88b78 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.634226 Oct 26 13:03:31.934776 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 166/295] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:03:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:03:31.944718 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-71d815e0-821f-4fb2-95f9-97109314de79 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:31.976487 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-71d815e0-821f-4fb2-95f9-97109314de79 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 228 microversion: 2.1 time: 0.036414 Oct 26 13:03:31.977378 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 167/296] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 26 13:03:31 2022] GET /compute/v2.1/os-aggregates/16 => generated 228 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:31.983600 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-26c105fc-105f-4f50-8adf-1c6db87dcf7d tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:31.984654 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-26c105fc-105f-4f50-8adf-1c6db87dcf7d tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] [instance: 380d16a8-2b4c-460b-9b36-884e7fb24812] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:31.993055 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26c105fc-105f-4f50-8adf-1c6db87dcf7d tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:31.994250 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26c105fc-105f-4f50-8adf-1c6db87dcf7d tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:31.995870 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26c105fc-105f-4f50-8adf-1c6db87dcf7d tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:31.996847 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26c105fc-105f-4f50-8adf-1c6db87dcf7d tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:31.997541 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26c105fc-105f-4f50-8adf-1c6db87dcf7d tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:31.998197 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26c105fc-105f-4f50-8adf-1c6db87dcf7d tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:32.008038 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-03f57b46-4b55-4c96-b1b8-bb1a216d1253 tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/56ecf288e1da4f65b224ffb411028c71" status: 200 len: 329 microversion: 2.1 time: 0.596185 Oct 26 13:03:32.008913 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 130/297] 10.222.0.40 () {60 vars in 1262 bytes} [Wed Oct 26 13:03:31 2022] PUT /compute/v2.1/os-quota-sets/56ecf288e1da4f65b224ffb411028c71 => generated 329 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:32.021405 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8a9b255a-2325-45cd-b6d3-25c2f2411cc5 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:32.070562 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8a9b255a-2325-45cd-b6d3-25c2f2411cc5 tempest-AggregatesAdminNegativeTestJSON-710602825 tempest-AggregatesAdminNegativeTestJSON-710602825-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.053595 Oct 26 13:03:32.073168 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 131/298] 10.222.0.40 () {58 vars in 1155 bytes} [Wed Oct 26 13:03:32 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 26 13:03:32.104754 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-26c105fc-105f-4f50-8adf-1c6db87dcf7d tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f9391046054747bbfc1c3e6d65d4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10521abb1c34417fa9369aaba9070968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:32.137060 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-26c105fc-105f-4f50-8adf-1c6db87dcf7d tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] 10.222.0.40 "GET /compute/v2.1/servers/380d16a8-2b4c-460b-9b36-884e7fb24812" status: 200 len: 1321 microversion: 2.1 time: 0.151799 Oct 26 13:03:32.140003 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 168/299] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:31 2022] GET /compute/v2.1/servers/380d16a8-2b4c-460b-9b36-884e7fb24812 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:32.145848 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-68a1656c-9807-4bc7-97a3-5a2d133f8217 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:32.146921 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-68a1656c-9807-4bc7-97a3-5a2d133f8217 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] [instance: 3b17e574-b449-4b57-b82d-82303ec940ab] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:32.241966 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-68a1656c-9807-4bc7-97a3-5a2d133f8217 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999ac729ed1f4456857c8671d4b9be8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e2b56ef8db404ca0372e0a9c5f9b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:32.250434 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-68a1656c-9807-4bc7-97a3-5a2d133f8217 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] 10.222.0.40 "GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab" status: 200 len: 1218 microversion: 2.1 time: 0.109304 Oct 26 13:03:32.251015 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 169/300] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:32 2022] GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab => generated 1218 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:32.279774 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1a5f5df6-67f9-49a8-b17e-c5589a38c681 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:32.364105 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1a5f5df6-67f9-49a8-b17e-c5589a38c681 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 266 microversion: 2.1 time: 0.110324 Oct 26 13:03:32.365297 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 170/301] 10.222.0.40 () {60 vars in 1194 bytes} [Wed Oct 26 13:03:32 2022] POST /compute/v2.1/os-aggregates/16/action => generated 266 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:32.372911 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e77da7f9-3569-4065-9a7c-7785dba4ecfc tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] Calling method '.version_select at 0x7f6732ce6af0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:32.396123 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c2c85270-5d29-4cb9-9372-a2e4c6f74c21 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-804816625", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "126fa8f9-6bcd-4196-bf93-7bb18cb15112"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:32.516872 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-c2c85270-5d29-4cb9-9372-a2e4c6f74c21 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] validate_networks() for [('126fa8f9-6bcd-4196-bf93-7bb18cb15112', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:03:32.754007 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e77da7f9-3569-4065-9a7c-7785dba4ecfc tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/56ecf288e1da4f65b224ffb411028c71" status: 200 len: 371 microversion: 2.1 time: 0.386065 Oct 26 13:03:32.754591 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 171/302] 10.222.0.40 () {58 vars in 1242 bytes} [Wed Oct 26 13:03:32 2022] GET /compute/v2.1/os-quota-sets/56ecf288e1da4f65b224ffb411028c71 => generated 371 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:32.771381 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-74e86344-8287-487a-9011-959463c0ae04 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:32.772974 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-74e86344-8287-487a-9011-959463c0ae04 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:32.792284 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74e86344-8287-487a-9011-959463c0ae04 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:32.797817 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74e86344-8287-487a-9011-959463c0ae04 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:32.798462 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74e86344-8287-487a-9011-959463c0ae04 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:32.799196 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74e86344-8287-487a-9011-959463c0ae04 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:32.799654 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74e86344-8287-487a-9011-959463c0ae04 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:32.800083 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74e86344-8287-487a-9011-959463c0ae04 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:33.073062 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-74e86344-8287-487a-9011-959463c0ae04 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:33.087723 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-74e86344-8287-487a-9011-959463c0ae04 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1475 microversion: 2.1 time: 0.331459 Oct 26 13:03:33.089001 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 172/303] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:32 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1475 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:33.098007 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-93370fc3-d723-4db8-ae57-110f6b5e1669 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:33.123470 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-93370fc3-d723-4db8-ae57-110f6b5e1669 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 242 microversion: 2.1 time: 0.033342 Oct 26 13:03:33.124055 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 173/304] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 26 13:03:33 2022] GET /compute/v2.1/os-aggregates/16 => generated 242 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:33.128357 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d3b2552e-1b13-4d8f-9070-243c69819cdd tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] Action: 'update', calling method: .version_select at 0x7f6732b89820>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:33.480290 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-c2c85270-5d29-4cb9-9372-a2e4c6f74c21 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:03:33.480771 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-c2c85270-5d29-4cb9-9372-a2e4c6f74c21 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:03:33.481171 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-c2c85270-5d29-4cb9-9372-a2e4c6f74c21 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:03:33.481599 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-c2c85270-5d29-4cb9-9372-a2e4c6f74c21 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:03:33.482009 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-c2c85270-5d29-4cb9-9372-a2e4c6f74c21 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:03:33.492754 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c2c85270-5d29-4cb9-9372-a2e4c6f74c21 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:33.493729 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c2c85270-5d29-4cb9-9372-a2e4c6f74c21 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:33.493729 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c2c85270-5d29-4cb9-9372-a2e4c6f74c21 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:33.497702 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c2c85270-5d29-4cb9-9372-a2e4c6f74c21 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:33.498237 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c2c85270-5d29-4cb9-9372-a2e4c6f74c21 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:33.498680 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c2c85270-5d29-4cb9-9372-a2e4c6f74c21 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:33.547621 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-c2c85270-5d29-4cb9-9372-a2e4c6f74c21 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Getting quotas for project 2f7b9165f0ff4c06a5d154ea24b17bac. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:03:33.553043 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-c2c85270-5d29-4cb9-9372-a2e4c6f74c21 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Getting quotas for user 27f4a513ca654b0abf9f972e07270c10 and project 2f7b9165f0ff4c06a5d154ea24b17bac. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:03:33.582747 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c2c85270-5d29-4cb9-9372-a2e4c6f74c21 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:03:33.585340 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c2c85270-5d29-4cb9-9372-a2e4c6f74c21 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3e395c36-3e81-4ca3-ab5c-a034d92f8288] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:03:33.684660 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c2c85270-5d29-4cb9-9372-a2e4c6f74c21 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.609912 Oct 26 13:03:33.685806 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 132/305] 10.222.0.40 () {62 vars in 1188 bytes} [Wed Oct 26 13:03:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1612 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 26 13:03:33.697846 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-887295f6-7270-4c68-9eb5-240f4fdd616b tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:33.781506 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-887295f6-7270-4c68-9eb5-240f4fdd616b tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.094452 Oct 26 13:03:33.782697 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 133/306] 10.222.0.40 () {58 vars in 1155 bytes} [Wed Oct 26 13:03:33 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 26 13:03:33.798134 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-814177e0-a066-4256-98cc-91ea7ec49664 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:33.798941 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-814177e0-a066-4256-98cc-91ea7ec49664 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] [instance: 380d16a8-2b4c-460b-9b36-884e7fb24812] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:33.813956 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-814177e0-a066-4256-98cc-91ea7ec49664 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:33.814736 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-814177e0-a066-4256-98cc-91ea7ec49664 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:33.816781 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-814177e0-a066-4256-98cc-91ea7ec49664 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:33.819373 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-814177e0-a066-4256-98cc-91ea7ec49664 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:33.823183 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-814177e0-a066-4256-98cc-91ea7ec49664 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:33.823896 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-814177e0-a066-4256-98cc-91ea7ec49664 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:33.926330 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3b2552e-1b13-4d8f-9070-243c69819cdd tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:33.934128 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3b2552e-1b13-4d8f-9070-243c69819cdd tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:33.940624 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3b2552e-1b13-4d8f-9070-243c69819cdd tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:33.941891 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3b2552e-1b13-4d8f-9070-243c69819cdd tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:33.947189 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3b2552e-1b13-4d8f-9070-243c69819cdd tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:33.948307 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3b2552e-1b13-4d8f-9070-243c69819cdd tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:34.090703 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d3b2552e-1b13-4d8f-9070-243c69819cdd tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/56ecf288e1da4f65b224ffb411028c71" status: 200 len: 328 microversion: 2.1 time: 0.965581 Oct 26 13:03:34.091911 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 174/307] 10.222.0.40 () {60 vars in 1262 bytes} [Wed Oct 26 13:03:33 2022] PUT /compute/v2.1/os-quota-sets/56ecf288e1da4f65b224ffb411028c71 => generated 328 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:34.108417 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d94129f7-ab57-4880-b71d-39aae2f74d85 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:34.110063 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d94129f7-ab57-4880-b71d-39aae2f74d85 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] [instance: 3b17e574-b449-4b57-b82d-82303ec940ab] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:34.121425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d94129f7-ab57-4880-b71d-39aae2f74d85 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:34.122121 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d94129f7-ab57-4880-b71d-39aae2f74d85 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:34.122705 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d94129f7-ab57-4880-b71d-39aae2f74d85 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:34.124730 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d94129f7-ab57-4880-b71d-39aae2f74d85 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:34.126349 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d94129f7-ab57-4880-b71d-39aae2f74d85 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:34.127223 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d94129f7-ab57-4880-b71d-39aae2f74d85 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:34.143263 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-814177e0-a066-4256-98cc-91ea7ec49664 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f9391046054747bbfc1c3e6d65d4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10521abb1c34417fa9369aaba9070968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:34.156946 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-814177e0-a066-4256-98cc-91ea7ec49664 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] 10.222.0.40 "GET /compute/v2.1/servers/380d16a8-2b4c-460b-9b36-884e7fb24812" status: 200 len: 1389 microversion: 2.1 time: 0.371770 Oct 26 13:03:34.158188 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 134/308] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:33 2022] GET /compute/v2.1/servers/380d16a8-2b4c-460b-9b36-884e7fb24812 => generated 1389 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:34.172037 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-48851559-c951-46e3-b88b-032fdb53831b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:34.172829 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-48851559-c951-46e3-b88b-032fdb53831b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3e395c36-3e81-4ca3-ab5c-a034d92f8288] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:34.275281 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d94129f7-ab57-4880-b71d-39aae2f74d85 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999ac729ed1f4456857c8671d4b9be8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e2b56ef8db404ca0372e0a9c5f9b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:34.302974 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d94129f7-ab57-4880-b71d-39aae2f74d85 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] 10.222.0.40 "GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab" status: 200 len: 1270 microversion: 2.1 time: 0.209042 Oct 26 13:03:34.309105 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 175/309] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:34 2022] GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab => generated 1270 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:34.316540 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-48851559-c951-46e3-b88b-032fdb53831b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:34.318149 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ed79925c-ae8e-4b08-a18a-e41221dc8445 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-903485108", "availability_zone": "tempest-test_az-721528280"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:34.325456 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.aggregate [None req-ed79925c-ae8e-4b08-a18a-e41221dc8445 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Generated uuid 3c546f05-208c-4e27-8a51-aa0cccd1d5f3 for aggregate {{(pid=120598) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 26 13:03:34.329471 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-48851559-c951-46e3-b88b-032fdb53831b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:34.333847 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-48851559-c951-46e3-b88b-032fdb53831b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:34.337732 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-48851559-c951-46e3-b88b-032fdb53831b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288" status: 200 len: 1261 microversion: 2.25 time: 0.175089 Oct 26 13:03:34.340006 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 135/310] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:03:34 2022] GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288 => generated 1261 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:03:34.355940 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e790c0fa-13da-44ad-96fa-b1b478ecd500 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:34.357303 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e790c0fa-13da-44ad-96fa-b1b478ecd500 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:34.369059 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e790c0fa-13da-44ad-96fa-b1b478ecd500 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:34.372766 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e790c0fa-13da-44ad-96fa-b1b478ecd500 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:34.373437 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e790c0fa-13da-44ad-96fa-b1b478ecd500 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:34.375921 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e790c0fa-13da-44ad-96fa-b1b478ecd500 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:34.377035 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e790c0fa-13da-44ad-96fa-b1b478ecd500 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:34.379163 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e790c0fa-13da-44ad-96fa-b1b478ecd500 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:34.399576 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:03:34.445358 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ed79925c-ae8e-4b08-a18a-e41221dc8445 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.131419 Oct 26 13:03:34.455072 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 176/311] 10.222.0.40 () {60 vars in 1165 bytes} [Wed Oct 26 13:03:34 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:34.467959 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c32cf807-c56d-46d5-a8e3-9fa4940ee8c4 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-903485108_new", "availability_zone": "tempest-test_az-721528280_new"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:34.552273 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c32cf807-c56d-46d5-a8e3-9fa4940ee8c4 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:34.554538 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c32cf807-c56d-46d5-a8e3-9fa4940ee8c4 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:34.555110 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c32cf807-c56d-46d5-a8e3-9fa4940ee8c4 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:34.663659 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c32cf807-c56d-46d5-a8e3-9fa4940ee8c4 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 334 microversion: 2.1 time: 0.207166 Oct 26 13:03:34.665060 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 177/312] 10.222.0.40 () {60 vars in 1173 bytes} [Wed Oct 26 13:03:34 2022] PUT /compute/v2.1/os-aggregates/17 => generated 334 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:34.680520 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3670e739-a4ce-4903-9d1e-e9ab855a6382 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1685594696", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:34.800818 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-3670e739-a4ce-4903-9d1e-e9ab855a6382 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] validate_networks() for None {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:03:34.949956 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e790c0fa-13da-44ad-96fa-b1b478ecd500 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:34.961597 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e790c0fa-13da-44ad-96fa-b1b478ecd500 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1475 microversion: 2.1 time: 0.620306 Oct 26 13:03:34.964807 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 136/313] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:34 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1475 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:34.980650 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7d14dc91-95c4-4781-b835-f96693e94bbf tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:35.017048 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7d14dc91-95c4-4781-b835-f96693e94bbf tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates" status: 200 len: 337 microversion: 2.1 time: 0.049230 Oct 26 13:03:35.025297 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 137/314] 10.222.0.40 () {58 vars in 1143 bytes} [Wed Oct 26 13:03:34 2022] GET /compute/v2.1/os-aggregates => generated 337 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:35.038312 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-497fe6a6-7416-45fb-8436-06493b063299 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:35.108430 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-497fe6a6-7416-45fb-8436-06493b063299 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.074788 Oct 26 13:03:35.109078 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 138/315] 10.222.0.40 () {58 vars in 1155 bytes} [Wed Oct 26 13:03:35 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 26 13:03:35.125151 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c6fd6d41-2134-4cb4-bbc9-fd0e240a43b9 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1176529736"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:35.140120 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.aggregate [None req-c6fd6d41-2134-4cb4-bbc9-fd0e240a43b9 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Generated uuid 9901cc98-cdae-48a8-b12b-8ef73a5af293 for aggregate {{(pid=120597) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 26 13:03:35.192997 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c6fd6d41-2134-4cb4-bbc9-fd0e240a43b9 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.078357 Oct 26 13:03:35.216452 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 139/316] 10.222.0.40 () {60 vars in 1164 bytes} [Wed Oct 26 13:03:35 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:35.238591 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f097257e-150f-4102-a4a2-4b8dee0e3dc4 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:35.241269 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f097257e-150f-4102-a4a2-4b8dee0e3dc4 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] [instance: 380d16a8-2b4c-460b-9b36-884e7fb24812] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:35.258840 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f097257e-150f-4102-a4a2-4b8dee0e3dc4 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:35.260732 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f097257e-150f-4102-a4a2-4b8dee0e3dc4 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:35.268538 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f097257e-150f-4102-a4a2-4b8dee0e3dc4 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:35.269925 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f097257e-150f-4102-a4a2-4b8dee0e3dc4 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:35.270871 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f097257e-150f-4102-a4a2-4b8dee0e3dc4 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:35.271520 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f097257e-150f-4102-a4a2-4b8dee0e3dc4 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:35.470196 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-3670e739-a4ce-4903-9d1e-e9ab855a6382 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:03:35.470954 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-3670e739-a4ce-4903-9d1e-e9ab855a6382 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:03:35.471723 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-3670e739-a4ce-4903-9d1e-e9ab855a6382 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:03:35.472130 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-3670e739-a4ce-4903-9d1e-e9ab855a6382 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:03:35.472607 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-3670e739-a4ce-4903-9d1e-e9ab855a6382 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:03:35.505352 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3670e739-a4ce-4903-9d1e-e9ab855a6382 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:35.506907 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3670e739-a4ce-4903-9d1e-e9ab855a6382 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:35.507462 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3670e739-a4ce-4903-9d1e-e9ab855a6382 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:35.511068 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3670e739-a4ce-4903-9d1e-e9ab855a6382 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:35.511690 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3670e739-a4ce-4903-9d1e-e9ab855a6382 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:35.512228 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3670e739-a4ce-4903-9d1e-e9ab855a6382 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:35.568137 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-3670e739-a4ce-4903-9d1e-e9ab855a6382 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Getting quotas for project 56ecf288e1da4f65b224ffb411028c71. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:03:35.577963 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-3670e739-a4ce-4903-9d1e-e9ab855a6382 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Getting quotas for user 734498bc8a514af3b576008643b88351 and project 56ecf288e1da4f65b224ffb411028c71. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:03:35.626885 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.utils [None req-3670e739-a4ce-4903-9d1e-e9ab855a6382 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] instances quota exceeded for 56ecf288e1da4f65b224ffb411028c71, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120598) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 26 13:03:35.627712 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-3670e739-a4ce-4903-9d1e-e9ab855a6382 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 26 13:03:35.631475 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3670e739-a4ce-4903-9d1e-e9ab855a6382 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Request method failure captured: Oct 26 13:03:35.631475 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 13:03:35.631475 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:03:35.631475 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:03:35.631475 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:03:35.631475 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 145 Oct 26 13:03:35.631475 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:03:35.631475 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:03:35.631475 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:03:35.631475 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:03:35.631475 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTAe70Q_gEUWoxROpZBRWu2xmmQDBIWVtoKKVfTpdm_8tbKQVVT5VFq0ff5g8kdnZBJ2Vw0xbegys3GVg0PRu8W6rspWplVfPsDRsxeyFXN6wYsc_yPysctMCAAYVtLHPnCm5vKG1ru92FVKb0yRT7MEeJddqyRcfzCLvNNcQQ2scBY Oct 26 13:03:35.631475 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:03:35.631475 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:03:35.631475 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:03:35.631475 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:03:35.631475 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:03:35.631475 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:03:35.631475 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 56ecf288e1da4f65b224ffb411028c71 Oct 26 13:03:35.631475 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-QuotasAdminNegativeTest-211329314 Oct 26 13:03:35.631475 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:03:35.631475 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:03:35.632716 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/56ecf288e1da4f65b224ffb411028c71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/56ecf288e1da4f65b224ffb411028c71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_56ecf288e1da4f65b224ffb411028c71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/56ecf288e1da4f65b224ffb411028c71"}]}] Oct 26 13:03:35.632716 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-QuotasAdminNegativeTest-211329314 Oct 26 13:03:35.632716 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 56ecf288e1da4f65b224ffb411028c71 Oct 26 13:03:35.632716 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-211329314 Oct 26 13:03:35.632716 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-QuotasAdminNegativeTest-211329314-project Oct 26 13:03:35.632716 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:03:35.632716 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:03:35.632716 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 734498bc8a514af3b576008643b88351 Oct 26 13:03:35.632716 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-QuotasAdminNegativeTest-211329314-project Oct 26 13:03:35.632716 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:03:35.632716 n-d-862686-1 devstack@n-api.service[120598]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1685594696", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452"}} Oct 26 13:03:35.632716 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:03:35.633539 n-d-862686-1 devstack@n-api.service[120598]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 26 13:03:35.633539 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1685594696', 'imageRef': '762c20f4-0f9b-45cb-bd95-cf21a747b33b', 'flavorRef': '452'}}} Oct 26 13:03:35.633539 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:03:35.633539 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:35.633539 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 26 13:03:35.633539 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 26 13:03:35.633539 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 13:03:35.633539 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 13:03:35.633539 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 26 13:03:35.633539 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc Oct 26 13:03:35.633539 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 26 13:03:35.633539 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 26 13:03:35.633539 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 13:03:35.633539 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 13:03:35.633539 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 26 13:03:35.633539 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 26 13:03:35.633539 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 26 13:03:35.633539 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 26 13:03:35.635294 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 26 13:03:35.635294 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 26 13:03:35.635294 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 26 13:03:35.635294 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:35.635294 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:35.635294 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:35.635294 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:35.635294 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 26 13:03:35.635294 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 26 13:03:35.635294 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 26 13:03:35.635294 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 26 13:03:35.635294 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 26 13:03:35.635294 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 26 13:03:35.635294 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 26 13:03:35.635294 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 26 13:03:35.635294 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 26 13:03:35.635294 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 26 13:03:35.635294 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 26 13:03:35.635294 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:35.635294 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:35.635294 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:35.636386 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:35.636386 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:35.636386 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:35.636386 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:03:35.636386 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:03:35.636386 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:03:35.636386 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:03:35.636386 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:03:35.636386 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:03:35.636386 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:03:35.636386 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:03:35.636386 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:03:35.636386 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:03:35.636386 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 26 13:03:35.636386 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 26 13:03:35.636386 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 26 13:03:35.636386 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 26 13:03:35.636386 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:35.636386 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:35.636386 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:35.636386 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:35.638909 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:35.638909 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:35.638909 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:03:35.638909 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:03:35.638909 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 26 13:03:35.638909 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:35.641027 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3670e739-a4ce-4903-9d1e-e9ab855a6382 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:03:35.642015 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3670e739-a4ce-4903-9d1e-e9ab855a6382 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.972819 Oct 26 13:03:35.643075 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 178/317] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:03:34 2022] POST /compute/v2.1/servers => generated 119 bytes in 974 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:03:35.650696 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a91e50c8-a130-47f2-81d4-507afffa9975 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:35.663742 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a91e50c8-a130-47f2-81d4-507afffa9975 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.018811 Oct 26 13:03:35.677668 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 179/318] 10.222.0.40 () {58 vars in 1143 bytes} [Wed Oct 26 13:03:35 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:35.688675 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a978c17b-1bea-4244-815e-fce9bdb76f8e tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:35.690868 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a978c17b-1bea-4244-815e-fce9bdb76f8e tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] [instance: 3b17e574-b449-4b57-b82d-82303ec940ab] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:35.698280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a978c17b-1bea-4244-815e-fce9bdb76f8e tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:35.700474 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a978c17b-1bea-4244-815e-fce9bdb76f8e tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:35.701182 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a978c17b-1bea-4244-815e-fce9bdb76f8e tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:35.703487 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a978c17b-1bea-4244-815e-fce9bdb76f8e tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:35.704187 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a978c17b-1bea-4244-815e-fce9bdb76f8e tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:35.707669 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a978c17b-1bea-4244-815e-fce9bdb76f8e tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:35.816328 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a978c17b-1bea-4244-815e-fce9bdb76f8e tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999ac729ed1f4456857c8671d4b9be8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e2b56ef8db404ca0372e0a9c5f9b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:35.820625 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:03:35.834300 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a978c17b-1bea-4244-815e-fce9bdb76f8e tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] 10.222.0.40 "GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab" status: 200 len: 1276 microversion: 2.1 time: 0.146572 Oct 26 13:03:35.846827 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 180/319] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:35 2022] GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab => generated 1276 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:35.862581 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-72fb839e-e9ea-4f8b-92da-3890556d1d77 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:35.863273 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-72fb839e-e9ea-4f8b-92da-3890556d1d77 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3e395c36-3e81-4ca3-ab5c-a034d92f8288] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:35.889320 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72fb839e-e9ea-4f8b-92da-3890556d1d77 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:35.889862 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72fb839e-e9ea-4f8b-92da-3890556d1d77 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:35.890300 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72fb839e-e9ea-4f8b-92da-3890556d1d77 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:35.891014 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72fb839e-e9ea-4f8b-92da-3890556d1d77 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:35.891469 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72fb839e-e9ea-4f8b-92da-3890556d1d77 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:35.891893 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72fb839e-e9ea-4f8b-92da-3890556d1d77 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:35.911350 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f097257e-150f-4102-a4a2-4b8dee0e3dc4 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f9391046054747bbfc1c3e6d65d4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10521abb1c34417fa9369aaba9070968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:35.923252 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f097257e-150f-4102-a4a2-4b8dee0e3dc4 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] 10.222.0.40 "GET /compute/v2.1/servers/380d16a8-2b4c-460b-9b36-884e7fb24812" status: 200 len: 1389 microversion: 2.1 time: 0.703115 Oct 26 13:03:35.934158 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 140/320] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:35 2022] GET /compute/v2.1/servers/380d16a8-2b4c-460b-9b36-884e7fb24812 => generated 1389 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:35.945573 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5a4948d6-2359-4d5b-b674-734289c3b488 tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] Action: 'update', calling method: .version_select at 0x7f67334cc550>, body: {"quota_set": {"instances": 10}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:35.997434 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-72fb839e-e9ea-4f8b-92da-3890556d1d77 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:36.016400 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-72fb839e-e9ea-4f8b-92da-3890556d1d77 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:36.017793 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-72fb839e-e9ea-4f8b-92da-3890556d1d77 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:36.020321 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-72fb839e-e9ea-4f8b-92da-3890556d1d77 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288" status: 200 len: 1313 microversion: 2.25 time: 0.165145 Oct 26 13:03:36.034261 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 181/321] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:03:35 2022] GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:03:36.043582 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8b0c67a7-4692-4ad9-8f26-6c7f934b9549 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:36.099859 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8b0c67a7-4692-4ad9-8f26-6c7f934b9549 tempest-AggregatesAdminTestJSON-254509288 tempest-AggregatesAdminTestJSON-254509288-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.076467 Oct 26 13:03:36.101596 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 182/322] 10.222.0.40 () {58 vars in 1155 bytes} [Wed Oct 26 13:03:36 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 26 13:03:36.114145 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-290bfa8c-6556-494c-a7c5-1851a878f775 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:36.117687 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-290bfa8c-6556-494c-a7c5-1851a878f775 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:36.139243 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-290bfa8c-6556-494c-a7c5-1851a878f775 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:36.139770 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-290bfa8c-6556-494c-a7c5-1851a878f775 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:36.140213 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-290bfa8c-6556-494c-a7c5-1851a878f775 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:36.146566 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-290bfa8c-6556-494c-a7c5-1851a878f775 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:36.146566 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-290bfa8c-6556-494c-a7c5-1851a878f775 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:36.147324 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-290bfa8c-6556-494c-a7c5-1851a878f775 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:36.553079 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5a4948d6-2359-4d5b-b674-734289c3b488 tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:36.553695 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5a4948d6-2359-4d5b-b674-734289c3b488 tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:36.557781 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5a4948d6-2359-4d5b-b674-734289c3b488 tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:36.558657 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5a4948d6-2359-4d5b-b674-734289c3b488 tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:36.559147 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5a4948d6-2359-4d5b-b674-734289c3b488 tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:36.559582 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5a4948d6-2359-4d5b-b674-734289c3b488 tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:36.687163 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=8,nova_api:INSERT=7,nova_api:UPDATE=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:03:36.687411 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-290bfa8c-6556-494c-a7c5-1851a878f775 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:36.692487 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5a4948d6-2359-4d5b-b674-734289c3b488 tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/56ecf288e1da4f65b224ffb411028c71" status: 200 len: 329 microversion: 2.1 time: 0.757152 Oct 26 13:03:36.697218 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-290bfa8c-6556-494c-a7c5-1851a878f775 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1475 microversion: 2.1 time: 0.594549 Oct 26 13:03:36.706348 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 141/323] 10.222.0.40 () {60 vars in 1262 bytes} [Wed Oct 26 13:03:35 2022] PUT /compute/v2.1/os-quota-sets/56ecf288e1da4f65b224ffb411028c71 => generated 329 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:36.716391 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 183/324] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:36 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1475 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:36.720595 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ca77ef89-0950-420f-bd67-04add489c28a tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:36.721116 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ca77ef89-0950-420f-bd67-04add489c28a tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] [instance: 5984db52-3d30-4265-af13-6d9c16b63159] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:36.723142 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-0311c578-7d2c-4221-805e-452c47c0a75c req-0c661120-703a-403e-92b4-07421f8280cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "380d16a8-2b4c-460b-9b36-884e7fb24812", "tag": "5b05c6bb-7da5-41d5-bafd-a4735efff806"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:36.735658 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-0311c578-7d2c-4221-805e-452c47c0a75c req-0c661120-703a-403e-92b4-07421f8280cd service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:36.736559 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-0311c578-7d2c-4221-805e-452c47c0a75c req-0c661120-703a-403e-92b4-07421f8280cd service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:36.737192 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-0311c578-7d2c-4221-805e-452c47c0a75c req-0c661120-703a-403e-92b4-07421f8280cd service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:36.742886 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ca77ef89-0950-420f-bd67-04add489c28a tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:36.744419 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ca77ef89-0950-420f-bd67-04add489c28a tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:36.746381 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ca77ef89-0950-420f-bd67-04add489c28a tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:36.751264 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ca77ef89-0950-420f-bd67-04add489c28a tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:36.751264 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ca77ef89-0950-420f-bd67-04add489c28a tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:36.751264 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ca77ef89-0950-420f-bd67-04add489c28a tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:36.754979 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-0311c578-7d2c-4221-805e-452c47c0a75c req-0c661120-703a-403e-92b4-07421f8280cd service nova] Creating event network-changed:5b05c6bb-7da5-41d5-bafd-a4735efff806 for instance 380d16a8-2b4c-460b-9b36-884e7fb24812 on n-h2-862686-1 Oct 26 13:03:36.767087 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-0311c578-7d2c-4221-805e-452c47c0a75c req-0c661120-703a-403e-92b4-07421f8280cd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049051 Oct 26 13:03:36.768167 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 184/325] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:36.775806 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5529e9c1-10b2-48bb-aaf9-ef9ab9bdf649 tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] Calling method '.version_select at 0x7f6732ba8940>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:36.790263 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-ca77ef89-0950-420f-bd67-04add489c28a tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] HTTP exception thrown: Instance 5984db52-3d30-4265-af13-6d9c16b63159 could not be found. Oct 26 13:03:36.793524 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ca77ef89-0950-420f-bd67-04add489c28a tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Request method failure captured: Oct 26 13:03:36.793524 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159 HTTP/1.1 Oct 26 13:03:36.793524 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:03:36.793524 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:03:36.793524 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:03:36.793524 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:03:36.793524 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:03:36.793524 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:03:36.793524 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:03:36.793524 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:03:36.793524 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWS_rUn6wRAv7ov-b9dW0vc_-EvSk28IQJoQlGc01D7PQuEK1gja2ZWk3H0LGB_sw7W9RxGXLwxIz9FvPUE7kuZ_XV9T91z2LF8JJTLHFIV2lW12auOcJTdmmql9PhTrJ1KpOoErbj7lRlCdbr3_wc3ygfrRaSNeuOEHlBm5aTu9sstM Oct 26 13:03:36.793524 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:03:36.793524 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:03:36.793524 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:03:36.793524 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:03:36.793524 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:03:36.793524 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:03:36.793524 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: dc559afd836047ccbeba91fca9c0d527 Oct 26 13:03:36.793524 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-AggregatesAdminTestJSON-1622236984 Oct 26 13:03:36.793524 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:03:36.793524 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:03:36.794817 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/dc559afd836047ccbeba91fca9c0d527"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dc559afd836047ccbeba91fca9c0d527"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_dc559afd836047ccbeba91fca9c0d527"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dc559afd836047ccbeba91fca9c0d527"}]}] Oct 26 13:03:36.794817 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-AggregatesAdminTestJSON-1622236984 Oct 26 13:03:36.794817 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: dc559afd836047ccbeba91fca9c0d527 Oct 26 13:03:36.794817 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1622236984 Oct 26 13:03:36.794817 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-AggregatesAdminTestJSON-1622236984-project Oct 26 13:03:36.794817 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:03:36.794817 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:03:36.794817 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 1db8f8e223a145abbe4a20edb9ce60d4 Oct 26 13:03:36.794817 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-AggregatesAdminTestJSON-1622236984-project Oct 26 13:03:36.794817 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:03:36.794817 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 5984db52-3d30-4265-af13-6d9c16b63159 could not be found. Oct 26 13:03:36.794817 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '5984db52-3d30-4265-af13-6d9c16b63159'} Oct 26 13:03:36.795477 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:03:36.795477 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:36.795477 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:03:36.795477 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:03:36.795477 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:03:36.795477 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:03:36.795477 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:03:36.795477 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:03:36.795477 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:03:36.795477 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:03:36.795477 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5984db52-3d30-4265-af13-6d9c16b63159 could not be found. Oct 26 13:03:36.795477 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:03:36.795477 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:36.795477 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:03:36.795477 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:36.795477 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:36.795477 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:36.795477 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:03:36.795477 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:03:36.795477 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:03:36.796505 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:03:36.796505 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:03:36.796505 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:03:36.796505 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:03:36.796505 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:03:36.796505 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:03:36.796505 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:03:36.796505 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:03:36.796505 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:03:36.796505 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5984db52-3d30-4265-af13-6d9c16b63159 could not be found. Oct 26 13:03:36.796505 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:03:36.796505 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:36.796505 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:03:36.796505 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:36.796505 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:36.796505 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:36.796505 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:03:36.796505 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:03:36.796505 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5984db52-3d30-4265-af13-6d9c16b63159 could not be found. Oct 26 13:03:36.796505 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:03:36.797667 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ca77ef89-0950-420f-bd67-04add489c28a tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Returning 404 to user: Instance 5984db52-3d30-4265-af13-6d9c16b63159 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:03:36.797667 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ca77ef89-0950-420f-bd67-04add489c28a tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159" status: 404 len: 111 microversion: 2.1 time: 0.087375 Oct 26 13:03:36.797667 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 142/326] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:03:36 2022] DELETE /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:03:36.809987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1a29140f-46ea-4fe0-b7d0-fb0d86c618c7 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:36.810612 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1a29140f-46ea-4fe0-b7d0-fb0d86c618c7 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] [instance: 5984db52-3d30-4265-af13-6d9c16b63159] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:36.828185 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a29140f-46ea-4fe0-b7d0-fb0d86c618c7 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:36.828684 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a29140f-46ea-4fe0-b7d0-fb0d86c618c7 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:36.829124 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a29140f-46ea-4fe0-b7d0-fb0d86c618c7 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:36.829874 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a29140f-46ea-4fe0-b7d0-fb0d86c618c7 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:36.830333 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a29140f-46ea-4fe0-b7d0-fb0d86c618c7 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:36.830761 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a29140f-46ea-4fe0-b7d0-fb0d86c618c7 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:36.854665 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-1a29140f-46ea-4fe0-b7d0-fb0d86c618c7 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] HTTP exception thrown: Instance 5984db52-3d30-4265-af13-6d9c16b63159 could not be found. Oct 26 13:03:36.856815 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1a29140f-46ea-4fe0-b7d0-fb0d86c618c7 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Request method failure captured: Oct 26 13:03:36.856815 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159 HTTP/1.1 Oct 26 13:03:36.856815 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:03:36.856815 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:03:36.856815 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:03:36.856815 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:03:36.856815 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:03:36.856815 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:03:36.856815 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:03:36.856815 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:03:36.856815 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWS_rUn6wRAv7ov-b9dW0vc_-EvSk28IQJoQlGc01D7PQuEK1gja2ZWk3H0LGB_sw7W9RxGXLwxIz9FvPUE7kuZ_XV9T91z2LF8JJTLHFIV2lW12auOcJTdmmql9PhTrJ1KpOoErbj7lRlCdbr3_wc3ygfrRaSNeuOEHlBm5aTu9sstM Oct 26 13:03:36.856815 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:03:36.856815 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:03:36.856815 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:03:36.856815 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:03:36.856815 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:03:36.856815 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:03:36.856815 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: dc559afd836047ccbeba91fca9c0d527 Oct 26 13:03:36.856815 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-AggregatesAdminTestJSON-1622236984 Oct 26 13:03:36.856815 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:03:36.856815 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:03:36.858133 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/dc559afd836047ccbeba91fca9c0d527"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dc559afd836047ccbeba91fca9c0d527"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_dc559afd836047ccbeba91fca9c0d527"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dc559afd836047ccbeba91fca9c0d527"}]}] Oct 26 13:03:36.858133 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-AggregatesAdminTestJSON-1622236984 Oct 26 13:03:36.858133 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: dc559afd836047ccbeba91fca9c0d527 Oct 26 13:03:36.858133 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1622236984 Oct 26 13:03:36.858133 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-AggregatesAdminTestJSON-1622236984-project Oct 26 13:03:36.858133 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:03:36.858133 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:03:36.858133 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 1db8f8e223a145abbe4a20edb9ce60d4 Oct 26 13:03:36.858133 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-AggregatesAdminTestJSON-1622236984-project Oct 26 13:03:36.858133 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:03:36.858133 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 5984db52-3d30-4265-af13-6d9c16b63159 could not be found. Oct 26 13:03:36.858133 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '5984db52-3d30-4265-af13-6d9c16b63159'} Oct 26 13:03:36.858944 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:03:36.858944 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:36.858944 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:03:36.858944 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:03:36.858944 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:03:36.858944 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:03:36.858944 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:03:36.858944 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:03:36.858944 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:03:36.858944 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:03:36.858944 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5984db52-3d30-4265-af13-6d9c16b63159 could not be found. Oct 26 13:03:36.858944 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:03:36.858944 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:36.858944 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:03:36.858944 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:36.858944 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:36.858944 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:36.858944 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:03:36.858944 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:03:36.858944 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:03:36.860180 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:03:36.860180 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:03:36.860180 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:03:36.860180 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:03:36.860180 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:03:36.860180 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:03:36.860180 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:03:36.860180 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5984db52-3d30-4265-af13-6d9c16b63159 could not be found. Oct 26 13:03:36.860180 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:03:36.860180 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:36.860180 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:03:36.860180 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:36.860180 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:36.860180 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:36.860180 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:03:36.860180 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:03:36.860180 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5984db52-3d30-4265-af13-6d9c16b63159 could not be found. Oct 26 13:03:36.860180 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:03:36.862009 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1a29140f-46ea-4fe0-b7d0-fb0d86c618c7 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] Returning 404 to user: Instance 5984db52-3d30-4265-af13-6d9c16b63159 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:03:36.862961 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1a29140f-46ea-4fe0-b7d0-fb0d86c618c7 tempest-AggregatesAdminTestJSON-1622236984 tempest-AggregatesAdminTestJSON-1622236984-project] 10.222.0.40 "GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159" status: 404 len: 111 microversion: 2.1 time: 0.061865 Oct 26 13:03:36.864971 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 143/327] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:36 2022] GET /compute/v2.1/servers/5984db52-3d30-4265-af13-6d9c16b63159 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:03:36.870535 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6619226e-634a-4fd7-9de3-861da2e71724 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:36.871292 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6619226e-634a-4fd7-9de3-861da2e71724 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] [instance: 3b17e574-b449-4b57-b82d-82303ec940ab] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:36.877906 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6619226e-634a-4fd7-9de3-861da2e71724 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:36.878851 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6619226e-634a-4fd7-9de3-861da2e71724 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:36.879477 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6619226e-634a-4fd7-9de3-861da2e71724 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:36.880379 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6619226e-634a-4fd7-9de3-861da2e71724 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:36.880943 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6619226e-634a-4fd7-9de3-861da2e71724 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:36.881469 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6619226e-634a-4fd7-9de3-861da2e71724 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:37.049569 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6619226e-634a-4fd7-9de3-861da2e71724 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999ac729ed1f4456857c8671d4b9be8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e2b56ef8db404ca0372e0a9c5f9b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:37.060002 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6619226e-634a-4fd7-9de3-861da2e71724 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] 10.222.0.40 "GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab" status: 200 len: 1276 microversion: 2.1 time: 0.193761 Oct 26 13:03:37.061091 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 144/328] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:36 2022] GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab => generated 1276 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:37.067817 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-37a9b8e5-49cb-48af-8b9d-6cf597d13294 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:37.068432 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-37a9b8e5-49cb-48af-8b9d-6cf597d13294 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] [instance: 380d16a8-2b4c-460b-9b36-884e7fb24812] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:37.076501 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37a9b8e5-49cb-48af-8b9d-6cf597d13294 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:37.077806 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37a9b8e5-49cb-48af-8b9d-6cf597d13294 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:37.078697 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37a9b8e5-49cb-48af-8b9d-6cf597d13294 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:37.082434 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37a9b8e5-49cb-48af-8b9d-6cf597d13294 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:37.082999 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37a9b8e5-49cb-48af-8b9d-6cf597d13294 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:37.083511 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37a9b8e5-49cb-48af-8b9d-6cf597d13294 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:37.211780 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5529e9c1-10b2-48bb-aaf9-ef9ab9bdf649 tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/56ecf288e1da4f65b224ffb411028c71" status: 200 len: 371 microversion: 2.1 time: 0.442183 Oct 26 13:03:37.221313 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 185/329] 10.222.0.40 () {58 vars in 1242 bytes} [Wed Oct 26 13:03:36 2022] GET /compute/v2.1/os-quota-sets/56ecf288e1da4f65b224ffb411028c71 => generated 371 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:37.231419 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6d833c02-9c47-4d3a-a2dd-48a7879bbebe tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:37.233594 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6d833c02-9c47-4d3a-a2dd-48a7879bbebe tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3e395c36-3e81-4ca3-ab5c-a034d92f8288] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:37.240722 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:03:37.247311 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d833c02-9c47-4d3a-a2dd-48a7879bbebe tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:37.247913 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d833c02-9c47-4d3a-a2dd-48a7879bbebe tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:37.248596 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d833c02-9c47-4d3a-a2dd-48a7879bbebe tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:37.249473 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d833c02-9c47-4d3a-a2dd-48a7879bbebe tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:37.251313 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d833c02-9c47-4d3a-a2dd-48a7879bbebe tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:37.251313 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d833c02-9c47-4d3a-a2dd-48a7879bbebe tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:37.340498 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6d833c02-9c47-4d3a-a2dd-48a7879bbebe tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:37.353266 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6d833c02-9c47-4d3a-a2dd-48a7879bbebe tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:37.355386 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6d833c02-9c47-4d3a-a2dd-48a7879bbebe tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:37.357656 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6d833c02-9c47-4d3a-a2dd-48a7879bbebe tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288" status: 200 len: 1319 microversion: 2.25 time: 0.134566 Oct 26 13:03:37.366815 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 186/330] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:03:37 2022] GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288 => generated 1319 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:03:37.680045 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0f461995-bd8f-48c2-9832-902c0f9261cf tempest-HypervisorAdminNegativeTestJSON-546950170 tempest-HypervisorAdminNegativeTestJSON-546950170-project] Calling method '.version_select at 0x7f6732b89940>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:37.681644 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0f461995-bd8f-48c2-9832-902c0f9261cf tempest-HypervisorAdminNegativeTestJSON-546950170 tempest-HypervisorAdminNegativeTestJSON-546950170-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '425f3413e030492789f278f3ec100aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ef17a4c9443928ddf48573ae83003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:37.685671 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0f461995-bd8f-48c2-9832-902c0f9261cf tempest-HypervisorAdminNegativeTestJSON-546950170 tempest-HypervisorAdminNegativeTestJSON-546950170-project] Request method failure captured: Oct 26 13:03:37.685671 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 26 13:03:37.685671 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:03:37.685671 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:03:37.685671 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:03:37.685671 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:03:37.685671 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:03:37.685671 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:03:37.685671 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:03:37.685671 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:03:37.685671 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTAn0QNs0exOTF-cABull-w6_qK1E88gM7MoKeKVr6LgmkK-a8KRPndj_wyPgnfZFC08BO2NnDhjuynJ9WnkBm7eYvRFpqw2gtj-FzHYEbezEb1z6rrV2h6eYvoQ9E90iGv7k8IScE1W2cP7YmjVpqUTyEgyoxZ9EdU4t0l0z8r9tkg Oct 26 13:03:37.685671 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:03:37.685671 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:03:37.685671 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:03:37.685671 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:03:37.685671 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:03:37.685671 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:03:37.685671 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: dc0ef17a4c9443928ddf48573ae83003 Oct 26 13:03:37.685671 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-546950170 Oct 26 13:03:37.685671 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:03:37.685671 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:03:37.687038 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/dc0ef17a4c9443928ddf48573ae83003"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dc0ef17a4c9443928ddf48573ae83003"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_dc0ef17a4c9443928ddf48573ae83003"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dc0ef17a4c9443928ddf48573ae83003"}]}] Oct 26 13:03:37.687038 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-546950170 Oct 26 13:03:37.687038 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: dc0ef17a4c9443928ddf48573ae83003 Oct 26 13:03:37.687038 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-546950170 Oct 26 13:03:37.687038 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-HypervisorAdminNegativeTestJSON-546950170-project Oct 26 13:03:37.687038 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:03:37.687038 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:03:37.687038 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 425f3413e030492789f278f3ec100aee Oct 26 13:03:37.687038 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-546950170-project Oct 26 13:03:37.687038 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:03:37.687038 n-d-862686-1 devstack@n-api.service[120598]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 26 13:03:37.687038 n-d-862686-1 devstack@n-api.service[120598]: action_args: {} Oct 26 13:03:37.687038 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:03:37.688318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:37.688318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:37.688318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:37.688318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:03:37.688318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:03:37.688318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:03:37.688318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:03:37.688318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:03:37.688318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:03:37.688318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 26 13:03:37.688318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 26 13:03:37.688318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 26 13:03:37.688318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 26 13:03:37.688318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 13:03:37.688318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 13:03:37.688318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 13:03:37.688318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 13:03:37.688318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 13:03:37.688318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 13:03:37.689425 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 13:03:37.689425 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 13:03:37.689425 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 13:03:37.689425 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 13:03:37.689425 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 13:03:37.689425 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 13:03:37.689425 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 13:03:37.689425 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 13:03:37.689425 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 26 13:03:37.689425 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:37.689425 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:37.689425 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:37.689425 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:37.689425 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:37.689425 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:37.689425 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 13:03:37.689425 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 13:03:37.689425 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 26 13:03:37.689425 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:37.691849 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0f461995-bd8f-48c2-9832-902c0f9261cf tempest-HypervisorAdminNegativeTestJSON-546950170 tempest-HypervisorAdminNegativeTestJSON-546950170-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:03:37.691849 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0f461995-bd8f-48c2-9832-902c0f9261cf tempest-HypervisorAdminNegativeTestJSON-546950170 tempest-HypervisorAdminNegativeTestJSON-546950170-project] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.319894 Oct 26 13:03:37.691849 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 187/331] 10.222.0.40 () {58 vars in 1167 bytes} [Wed Oct 26 13:03:37 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 323 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:03:37.701350 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-450a9c3c-a59d-492b-af68-944cf8e4a624 tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] Action: 'update', calling method: .version_select at 0x7f6732ba8700>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:37.998389 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-37a9b8e5-49cb-48af-8b9d-6cf597d13294 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f9391046054747bbfc1c3e6d65d4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10521abb1c34417fa9369aaba9070968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:38.019690 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-37a9b8e5-49cb-48af-8b9d-6cf597d13294 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] 10.222.0.40 "GET /compute/v2.1/servers/380d16a8-2b4c-460b-9b36-884e7fb24812" status: 200 len: 1389 microversion: 2.1 time: 0.952767 Oct 26 13:03:38.021657 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 145/332] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:37 2022] GET /compute/v2.1/servers/380d16a8-2b4c-460b-9b36-884e7fb24812 => generated 1389 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:38.038211 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8d1837f6-d56c-4394-88d8-45ead883d94e tempest-HypervisorAdminNegativeTestJSON-546950170 tempest-HypervisorAdminNegativeTestJSON-546950170-project] Calling method '.version_select at 0x7f67330bb1f0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:38.043744 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8d1837f6-d56c-4394-88d8-45ead883d94e tempest-HypervisorAdminNegativeTestJSON-546950170 tempest-HypervisorAdminNegativeTestJSON-546950170-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '425f3413e030492789f278f3ec100aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ef17a4c9443928ddf48573ae83003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:38.053896 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8d1837f6-d56c-4394-88d8-45ead883d94e tempest-HypervisorAdminNegativeTestJSON-546950170 tempest-HypervisorAdminNegativeTestJSON-546950170-project] Request method failure captured: Oct 26 13:03:38.053896 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 26 13:03:38.053896 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:03:38.053896 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:03:38.053896 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:03:38.053896 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:03:38.053896 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:03:38.053896 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:03:38.053896 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:03:38.053896 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:03:38.053896 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTAn0QNs0exOTF-cABull-w6_qK1E88gM7MoKeKVr6LgmkK-a8KRPndj_wyPgnfZFC08BO2NnDhjuynJ9WnkBm7eYvRFpqw2gtj-FzHYEbezEb1z6rrV2h6eYvoQ9E90iGv7k8IScE1W2cP7YmjVpqUTyEgyoxZ9EdU4t0l0z8r9tkg Oct 26 13:03:38.053896 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:03:38.053896 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:03:38.053896 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:03:38.053896 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:03:38.053896 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:03:38.053896 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:03:38.053896 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: dc0ef17a4c9443928ddf48573ae83003 Oct 26 13:03:38.053896 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-546950170 Oct 26 13:03:38.053896 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:03:38.053896 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:03:38.055259 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/dc0ef17a4c9443928ddf48573ae83003"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dc0ef17a4c9443928ddf48573ae83003"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_dc0ef17a4c9443928ddf48573ae83003"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dc0ef17a4c9443928ddf48573ae83003"}]}] Oct 26 13:03:38.055259 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-546950170 Oct 26 13:03:38.055259 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: dc0ef17a4c9443928ddf48573ae83003 Oct 26 13:03:38.055259 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-546950170 Oct 26 13:03:38.055259 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-HypervisorAdminNegativeTestJSON-546950170-project Oct 26 13:03:38.055259 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:03:38.055259 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:03:38.055259 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 425f3413e030492789f278f3ec100aee Oct 26 13:03:38.055259 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-546950170-project Oct 26 13:03:38.055259 n-d-862686-1 devstack@n-api.service[120597]: method: Oct 26 13:03:38.055259 n-d-862686-1 devstack@n-api.service[120597]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 26 13:03:38.055259 n-d-862686-1 devstack@n-api.service[120597]: action_args: {} Oct 26 13:03:38.055259 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:03:38.056984 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:38.056984 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:38.056984 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:38.056984 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:03:38.056984 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:03:38.056984 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:03:38.056984 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:03:38.056984 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:03:38.056984 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:03:38.056984 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 26 13:03:38.056984 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 26 13:03:38.056984 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 26 13:03:38.056984 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 26 13:03:38.056984 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 13:03:38.056984 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 13:03:38.056984 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 13:03:38.056984 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 13:03:38.056984 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 13:03:38.056984 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 13:03:38.059367 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 13:03:38.059367 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 13:03:38.059367 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 13:03:38.059367 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 13:03:38.059367 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 13:03:38.059367 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 13:03:38.059367 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 13:03:38.059367 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 13:03:38.059367 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 26 13:03:38.059367 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:03:38.059367 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:38.059367 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:03:38.059367 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:38.059367 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:38.059367 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:38.059367 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 13:03:38.059367 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 13:03:38.059367 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 26 13:03:38.059367 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:03:38.064821 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8d1837f6-d56c-4394-88d8-45ead883d94e tempest-HypervisorAdminNegativeTestJSON-546950170 tempest-HypervisorAdminNegativeTestJSON-546950170-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:03:38.066030 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8d1837f6-d56c-4394-88d8-45ead883d94e tempest-HypervisorAdminNegativeTestJSON-546950170 tempest-HypervisorAdminNegativeTestJSON-546950170-project] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.041970 Oct 26 13:03:38.071501 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 146/333] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:03:38 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 49 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:03:38.082826 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-86919b4f-5bc1-4cc9-ba5d-ae03c6e67a85 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:38.084032 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-86919b4f-5bc1-4cc9-ba5d-ae03c6e67a85 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:38.093728 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-86919b4f-5bc1-4cc9-ba5d-ae03c6e67a85 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:38.094547 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-86919b4f-5bc1-4cc9-ba5d-ae03c6e67a85 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:38.095556 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-86919b4f-5bc1-4cc9-ba5d-ae03c6e67a85 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:38.097035 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-86919b4f-5bc1-4cc9-ba5d-ae03c6e67a85 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:38.097752 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-86919b4f-5bc1-4cc9-ba5d-ae03c6e67a85 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:38.098618 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-86919b4f-5bc1-4cc9-ba5d-ae03c6e67a85 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:38.314888 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-450a9c3c-a59d-492b-af68-944cf8e4a624 tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:38.315400 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-450a9c3c-a59d-492b-af68-944cf8e4a624 tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:38.315817 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-450a9c3c-a59d-492b-af68-944cf8e4a624 tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:38.317155 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-450a9c3c-a59d-492b-af68-944cf8e4a624 tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:38.321031 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-450a9c3c-a59d-492b-af68-944cf8e4a624 tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:38.325043 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-450a9c3c-a59d-492b-af68-944cf8e4a624 tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:38.432573 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-450a9c3c-a59d-492b-af68-944cf8e4a624 tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/56ecf288e1da4f65b224ffb411028c71" status: 200 len: 325 microversion: 2.1 time: 0.740183 Oct 26 13:03:38.434725 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 188/334] 10.222.0.40 () {60 vars in 1262 bytes} [Wed Oct 26 13:03:37 2022] PUT /compute/v2.1/os-quota-sets/56ecf288e1da4f65b224ffb411028c71 => generated 325 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:38.442969 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bf6b34f9-ccfb-4e70-ba6d-25104293b8ed tempest-HypervisorAdminNegativeTestJSON-546950170 tempest-HypervisorAdminNegativeTestJSON-546950170-project] Calling method '.version_select at 0x7f6732ba8790>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:38.445316 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bf6b34f9-ccfb-4e70-ba6d-25104293b8ed tempest-HypervisorAdminNegativeTestJSON-546950170 tempest-HypervisorAdminNegativeTestJSON-546950170-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '425f3413e030492789f278f3ec100aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ef17a4c9443928ddf48573ae83003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:38.448671 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bf6b34f9-ccfb-4e70-ba6d-25104293b8ed tempest-HypervisorAdminNegativeTestJSON-546950170 tempest-HypervisorAdminNegativeTestJSON-546950170-project] Request method failure captured: Oct 26 13:03:38.448671 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 26 13:03:38.448671 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:03:38.448671 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:03:38.448671 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:03:38.448671 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:03:38.448671 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:03:38.448671 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:03:38.448671 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:03:38.448671 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:03:38.448671 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTAn0QNs0exOTF-cABull-w6_qK1E88gM7MoKeKVr6LgmkK-a8KRPndj_wyPgnfZFC08BO2NnDhjuynJ9WnkBm7eYvRFpqw2gtj-FzHYEbezEb1z6rrV2h6eYvoQ9E90iGv7k8IScE1W2cP7YmjVpqUTyEgyoxZ9EdU4t0l0z8r9tkg Oct 26 13:03:38.448671 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:03:38.448671 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:03:38.448671 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:03:38.448671 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:03:38.448671 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:03:38.448671 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:03:38.448671 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: dc0ef17a4c9443928ddf48573ae83003 Oct 26 13:03:38.448671 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-546950170 Oct 26 13:03:38.448671 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:03:38.448671 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:03:38.450497 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/dc0ef17a4c9443928ddf48573ae83003"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dc0ef17a4c9443928ddf48573ae83003"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_dc0ef17a4c9443928ddf48573ae83003"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dc0ef17a4c9443928ddf48573ae83003"}]}] Oct 26 13:03:38.450497 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-546950170 Oct 26 13:03:38.450497 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: dc0ef17a4c9443928ddf48573ae83003 Oct 26 13:03:38.450497 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-546950170 Oct 26 13:03:38.450497 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-HypervisorAdminNegativeTestJSON-546950170-project Oct 26 13:03:38.450497 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:03:38.450497 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:03:38.450497 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 425f3413e030492789f278f3ec100aee Oct 26 13:03:38.450497 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-546950170-project Oct 26 13:03:38.450497 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:03:38.450497 n-d-862686-1 devstack@n-api.service[120598]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 26 13:03:38.450497 n-d-862686-1 devstack@n-api.service[120598]: action_args: {} Oct 26 13:03:38.450497 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:03:38.451204 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:38.451204 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:38.451204 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:38.451204 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:03:38.451204 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:03:38.451204 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:03:38.451204 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:03:38.451204 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:03:38.451204 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:03:38.451204 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 26 13:03:38.451204 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 26 13:03:38.451204 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 13:03:38.451204 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 13:03:38.451204 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 13:03:38.451204 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 13:03:38.451204 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 13:03:38.451204 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 13:03:38.451204 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 13:03:38.451204 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 13:03:38.452305 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 13:03:38.452305 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 13:03:38.452305 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 13:03:38.452305 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 13:03:38.452305 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 13:03:38.452305 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 13:03:38.452305 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 26 13:03:38.452305 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:38.452305 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:38.452305 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:38.452305 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:38.452305 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:38.452305 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:38.452305 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 13:03:38.452305 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 13:03:38.452305 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 26 13:03:38.452305 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:38.455908 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bf6b34f9-ccfb-4e70-ba6d-25104293b8ed tempest-HypervisorAdminNegativeTestJSON-546950170 tempest-HypervisorAdminNegativeTestJSON-546950170-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:03:38.456933 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bf6b34f9-ccfb-4e70-ba6d-25104293b8ed tempest-HypervisorAdminNegativeTestJSON-546950170 tempest-HypervisorAdminNegativeTestJSON-546950170-project] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.021034 Oct 26 13:03:38.457960 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 189/335] 10.222.0.40 () {58 vars in 1179 bytes} [Wed Oct 26 13:03:38 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:03:38.463610 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e890ffdf-ad28-4340-8ee2-8ef684df8666 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:38.464452 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e890ffdf-ad28-4340-8ee2-8ef684df8666 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] [instance: 3b17e574-b449-4b57-b82d-82303ec940ab] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:38.471352 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e890ffdf-ad28-4340-8ee2-8ef684df8666 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:38.471921 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e890ffdf-ad28-4340-8ee2-8ef684df8666 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:38.472596 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e890ffdf-ad28-4340-8ee2-8ef684df8666 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:38.473949 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e890ffdf-ad28-4340-8ee2-8ef684df8666 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:38.475008 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e890ffdf-ad28-4340-8ee2-8ef684df8666 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:38.475918 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e890ffdf-ad28-4340-8ee2-8ef684df8666 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:38.559976 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-86919b4f-5bc1-4cc9-ba5d-ae03c6e67a85 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:38.578965 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-86919b4f-5bc1-4cc9-ba5d-ae03c6e67a85 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1475 microversion: 2.1 time: 0.505325 Oct 26 13:03:38.589878 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 147/336] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:38 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1475 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:38.600913 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e8d07c78-a84b-4f9a-8b4c-2fedf6c0a7f5 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:38.601802 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e8d07c78-a84b-4f9a-8b4c-2fedf6c0a7f5 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3e395c36-3e81-4ca3-ab5c-a034d92f8288] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:38.615060 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e8d07c78-a84b-4f9a-8b4c-2fedf6c0a7f5 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:38.617769 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e8d07c78-a84b-4f9a-8b4c-2fedf6c0a7f5 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:38.620653 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e8d07c78-a84b-4f9a-8b4c-2fedf6c0a7f5 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:38.621608 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e8d07c78-a84b-4f9a-8b4c-2fedf6c0a7f5 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:38.622227 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e8d07c78-a84b-4f9a-8b4c-2fedf6c0a7f5 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:38.624136 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e8d07c78-a84b-4f9a-8b4c-2fedf6c0a7f5 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:38.704311 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e890ffdf-ad28-4340-8ee2-8ef684df8666 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999ac729ed1f4456857c8671d4b9be8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e2b56ef8db404ca0372e0a9c5f9b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:38.715442 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e890ffdf-ad28-4340-8ee2-8ef684df8666 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] 10.222.0.40 "GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab" status: 200 len: 1318 microversion: 2.1 time: 0.256185 Oct 26 13:03:38.717701 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 190/337] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:38 2022] GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:39.004304 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e8d07c78-a84b-4f9a-8b4c-2fedf6c0a7f5 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:39.014336 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e8d07c78-a84b-4f9a-8b4c-2fedf6c0a7f5 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:39.020126 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e8d07c78-a84b-4f9a-8b4c-2fedf6c0a7f5 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:39.024393 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e8d07c78-a84b-4f9a-8b4c-2fedf6c0a7f5 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288" status: 200 len: 1361 microversion: 2.25 time: 0.430030 Oct 26 13:03:39.025266 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 148/338] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:03:38 2022] GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288 => generated 1361 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:03:39.031259 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2c9ba9b4-9fe6-4037-9b46-d15c919a3e54 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1565489039", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:39.060561 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3cc4f97b-f08a-4908-ba0e-193c9ff24b35 tempest-HypervisorAdminNegativeTestJSON-1953885601 tempest-HypervisorAdminNegativeTestJSON-1953885601-project-admin] Calling method '.version_select at 0x7f6732b32dc0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:39.062622 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cc4f97b-f08a-4908-ba0e-193c9ff24b35 tempest-HypervisorAdminNegativeTestJSON-1953885601 tempest-HypervisorAdminNegativeTestJSON-1953885601-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:39.063755 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cc4f97b-f08a-4908-ba0e-193c9ff24b35 tempest-HypervisorAdminNegativeTestJSON-1953885601 tempest-HypervisorAdminNegativeTestJSON-1953885601-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:39.064524 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cc4f97b-f08a-4908-ba0e-193c9ff24b35 tempest-HypervisorAdminNegativeTestJSON-1953885601 tempest-HypervisorAdminNegativeTestJSON-1953885601-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:39.096249 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cc4f97b-f08a-4908-ba0e-193c9ff24b35 tempest-HypervisorAdminNegativeTestJSON-1953885601 tempest-HypervisorAdminNegativeTestJSON-1953885601-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:39.096857 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cc4f97b-f08a-4908-ba0e-193c9ff24b35 tempest-HypervisorAdminNegativeTestJSON-1953885601 tempest-HypervisorAdminNegativeTestJSON-1953885601-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:39.097848 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cc4f97b-f08a-4908-ba0e-193c9ff24b35 tempest-HypervisorAdminNegativeTestJSON-1953885601 tempest-HypervisorAdminNegativeTestJSON-1953885601-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:39.114132 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cc4f97b-f08a-4908-ba0e-193c9ff24b35 tempest-HypervisorAdminNegativeTestJSON-1953885601 tempest-HypervisorAdminNegativeTestJSON-1953885601-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:39.114631 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cc4f97b-f08a-4908-ba0e-193c9ff24b35 tempest-HypervisorAdminNegativeTestJSON-1953885601 tempest-HypervisorAdminNegativeTestJSON-1953885601-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:39.115358 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cc4f97b-f08a-4908-ba0e-193c9ff24b35 tempest-HypervisorAdminNegativeTestJSON-1953885601 tempest-HypervisorAdminNegativeTestJSON-1953885601-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:39.124117 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3cc4f97b-f08a-4908-ba0e-193c9ff24b35 tempest-HypervisorAdminNegativeTestJSON-1953885601 tempest-HypervisorAdminNegativeTestJSON-1953885601-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.405127 Oct 26 13:03:39.124905 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 191/339] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:03:38 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:39.125839 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3cc4f97b-f08a-4908-ba0e-193c9ff24b35 tempest-HypervisorAdminNegativeTestJSON-1953885601 tempest-HypervisorAdminNegativeTestJSON-1953885601-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:39.126776 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3cc4f97b-f08a-4908-ba0e-193c9ff24b35 tempest-HypervisorAdminNegativeTestJSON-1953885601 tempest-HypervisorAdminNegativeTestJSON-1953885601-project-admin] 10.222.0.40 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001123 Oct 26 13:03:39.127095 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 192/340] 10.222.0.40 () {56 vars in 886 bytes} [Wed Oct 26 13:03:39 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 26 13:03:39.127219 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-2c9ba9b4-9fe6-4037-9b46-d15c919a3e54 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] validate_networks() for None {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:03:39.140034 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f9ee4aff-d9b7-4f68-9613-eade6537d144 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:39.140836 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f9ee4aff-d9b7-4f68-9613-eade6537d144 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] [instance: 380d16a8-2b4c-460b-9b36-884e7fb24812] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:39.147939 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f9ee4aff-d9b7-4f68-9613-eade6537d144 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:39.148424 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f9ee4aff-d9b7-4f68-9613-eade6537d144 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:39.149354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f9ee4aff-d9b7-4f68-9613-eade6537d144 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:39.150944 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f9ee4aff-d9b7-4f68-9613-eade6537d144 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:39.151894 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f9ee4aff-d9b7-4f68-9613-eade6537d144 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:39.152521 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f9ee4aff-d9b7-4f68-9613-eade6537d144 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:39.323205 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f9ee4aff-d9b7-4f68-9613-eade6537d144 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f9391046054747bbfc1c3e6d65d4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10521abb1c34417fa9369aaba9070968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:39.333016 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f9ee4aff-d9b7-4f68-9613-eade6537d144 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] 10.222.0.40 "GET /compute/v2.1/servers/380d16a8-2b4c-460b-9b36-884e7fb24812" status: 200 len: 1389 microversion: 2.1 time: 0.204608 Oct 26 13:03:39.334378 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 193/341] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:39 2022] GET /compute/v2.1/servers/380d16a8-2b4c-460b-9b36-884e7fb24812 => generated 1389 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:39.339248 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-912f7644-f5d4-4457-bcbd-83bcc389d0ca tempest-HypervisorAdminNegativeTestJSON-546950170 tempest-HypervisorAdminNegativeTestJSON-546950170-project] Calling method '.version_select at 0x7f6732ba85e0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:39.341032 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-912f7644-f5d4-4457-bcbd-83bcc389d0ca tempest-HypervisorAdminNegativeTestJSON-546950170 tempest-HypervisorAdminNegativeTestJSON-546950170-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '425f3413e030492789f278f3ec100aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ef17a4c9443928ddf48573ae83003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:39.342602 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-912f7644-f5d4-4457-bcbd-83bcc389d0ca tempest-HypervisorAdminNegativeTestJSON-546950170 tempest-HypervisorAdminNegativeTestJSON-546950170-project] Request method failure captured: Oct 26 13:03:39.342602 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 26 13:03:39.342602 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:03:39.342602 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:03:39.342602 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:03:39.342602 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:03:39.342602 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:03:39.342602 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:03:39.342602 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:03:39.342602 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:03:39.342602 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTAn0QNs0exOTF-cABull-w6_qK1E88gM7MoKeKVr6LgmkK-a8KRPndj_wyPgnfZFC08BO2NnDhjuynJ9WnkBm7eYvRFpqw2gtj-FzHYEbezEb1z6rrV2h6eYvoQ9E90iGv7k8IScE1W2cP7YmjVpqUTyEgyoxZ9EdU4t0l0z8r9tkg Oct 26 13:03:39.342602 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:03:39.342602 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:03:39.342602 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:03:39.342602 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:03:39.342602 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:03:39.342602 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:03:39.342602 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: dc0ef17a4c9443928ddf48573ae83003 Oct 26 13:03:39.342602 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-546950170 Oct 26 13:03:39.342602 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:03:39.342602 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:03:39.343840 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/dc0ef17a4c9443928ddf48573ae83003"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dc0ef17a4c9443928ddf48573ae83003"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_dc0ef17a4c9443928ddf48573ae83003"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dc0ef17a4c9443928ddf48573ae83003"}]}] Oct 26 13:03:39.343840 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-546950170 Oct 26 13:03:39.343840 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: dc0ef17a4c9443928ddf48573ae83003 Oct 26 13:03:39.343840 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-546950170 Oct 26 13:03:39.343840 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-HypervisorAdminNegativeTestJSON-546950170-project Oct 26 13:03:39.343840 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:03:39.343840 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:03:39.343840 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 425f3413e030492789f278f3ec100aee Oct 26 13:03:39.343840 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-546950170-project Oct 26 13:03:39.343840 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:03:39.343840 n-d-862686-1 devstack@n-api.service[120598]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 26 13:03:39.343840 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '1'} Oct 26 13:03:39.343840 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:03:39.344694 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:39.344694 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:39.344694 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:39.344694 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:03:39.344694 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:03:39.344694 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:03:39.344694 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:03:39.344694 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:03:39.344694 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:03:39.344694 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 26 13:03:39.344694 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 26 13:03:39.344694 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 13:03:39.344694 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 13:03:39.344694 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 13:03:39.344694 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 13:03:39.344694 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 13:03:39.344694 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 13:03:39.344694 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 13:03:39.344694 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 13:03:39.345963 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 13:03:39.345963 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 13:03:39.345963 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 13:03:39.345963 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 13:03:39.345963 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 13:03:39.345963 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 13:03:39.345963 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 26 13:03:39.345963 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:39.345963 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:39.345963 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:39.345963 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:39.345963 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:39.345963 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:39.345963 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 13:03:39.345963 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 13:03:39.345963 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 26 13:03:39.345963 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:39.348466 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-912f7644-f5d4-4457-bcbd-83bcc389d0ca tempest-HypervisorAdminNegativeTestJSON-546950170 tempest-HypervisorAdminNegativeTestJSON-546950170-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:03:39.350288 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-912f7644-f5d4-4457-bcbd-83bcc389d0ca tempest-HypervisorAdminNegativeTestJSON-546950170 tempest-HypervisorAdminNegativeTestJSON-546950170-project] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.014756 Oct 26 13:03:39.351372 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 194/342] 10.222.0.40 () {58 vars in 1173 bytes} [Wed Oct 26 13:03:39 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:03:39.366366 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b1b89f14-f6ad-4b2d-bfc0-8115463940fc tempest-HypervisorAdminNegativeTestJSON-1953885601 tempest-HypervisorAdminNegativeTestJSON-1953885601-project-admin] Calling method '.version_select at 0x7f6732b32b80>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:39.368222 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-b1b89f14-f6ad-4b2d-bfc0-8115463940fc tempest-HypervisorAdminNegativeTestJSON-1953885601 tempest-HypervisorAdminNegativeTestJSON-1953885601-project-admin] HTTP exception thrown: Hypervisor with ID 'ff38bbda-17bb-41da-8e28-7751aa24fd51' could not be found. Oct 26 13:03:39.378333 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b1b89f14-f6ad-4b2d-bfc0-8115463940fc tempest-HypervisorAdminNegativeTestJSON-1953885601 tempest-HypervisorAdminNegativeTestJSON-1953885601-project-admin] Request method failure captured: Oct 26 13:03:39.378333 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/os-hypervisors/ff38bbda-17bb-41da-8e28-7751aa24fd51/uptime HTTP/1.1 Oct 26 13:03:39.378333 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:03:39.378333 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:03:39.378333 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:03:39.378333 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:03:39.378333 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:03:39.378333 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:03:39.378333 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:03:39.378333 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:03:39.378333 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTApo9OS-RSm1Hm9Pdf0a8VHwoLzQL-Irgb0dzQ2Z0VXNy1JGQGuFUC9YuXs5F7qg9qz8ha0nZTps9RHbMnXQqjnuu_En4-p6Qrlf2vJX-_jm5sMRrBicRB1h9UHvH3vVyP-cKDnToFEiz5jMd9_k7yazwOjEmEPDgRs33k1R8QTqTw Oct 26 13:03:39.378333 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:03:39.378333 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:03:39.378333 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:03:39.378333 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:03:39.378333 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:03:39.378333 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:03:39.378333 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 64834e4a43a14380b26a2a68c563e438 Oct 26 13:03:39.378333 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1953885601 Oct 26 13:03:39.378333 n-d-862686-1 devstack@n-api.service[120598]: X-Role: admin,member,reader Oct 26 13:03:39.378333 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: admin,member,reader Oct 26 13:03:39.379666 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/64834e4a43a14380b26a2a68c563e438"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/64834e4a43a14380b26a2a68c563e438"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_64834e4a43a14380b26a2a68c563e438"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/64834e4a43a14380b26a2a68c563e438"}]}] Oct 26 13:03:39.379666 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1953885601 Oct 26 13:03:39.379666 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 64834e4a43a14380b26a2a68c563e438 Oct 26 13:03:39.379666 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1953885601 Oct 26 13:03:39.379666 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-HypervisorAdminNegativeTestJSON-1953885601-project-admin Oct 26 13:03:39.379666 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:03:39.379666 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:03:39.379666 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: f2b2534b197749d8b752db6a2260b3e2 Oct 26 13:03:39.379666 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1953885601-project-admin Oct 26 13:03:39.379666 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:03:39.379666 n-d-862686-1 devstack@n-api.service[120598]: exception: Hypervisor with ID 'ff38bbda-17bb-41da-8e28-7751aa24fd51' could not be found. Oct 26 13:03:39.379666 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'ff38bbda-17bb-41da-8e28-7751aa24fd51'} Oct 26 13:03:39.380366 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:03:39.380366 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:39.380366 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 26 13:03:39.380366 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 26 13:03:39.380366 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'ff38bbda-17bb-41da-8e28-7751aa24fd51' Oct 26 13:03:39.380366 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:39.380366 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:39.380366 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:39.380366 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:39.380366 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 26 13:03:39.380366 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 26 13:03:39.380366 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 26 13:03:39.380366 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 26 13:03:39.380366 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 26 13:03:39.380366 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:39.380366 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:39.380366 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:39.380366 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:39.380366 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 26 13:03:39.380366 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 26 13:03:39.380366 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 26 13:03:39.380366 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 26 13:03:39.381603 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 26 13:03:39.381603 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:39.381603 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:39.381603 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:39.381603 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:39.381603 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:39.381603 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:39.381603 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:03:39.381603 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:03:39.381603 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:03:39.381603 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:03:39.381603 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:03:39.381603 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:03:39.381603 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 26 13:03:39.381603 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 26 13:03:39.381603 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 26 13:03:39.381603 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 26 13:03:39.381603 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'ff38bbda-17bb-41da-8e28-7751aa24fd51' could not be found. Oct 26 13:03:39.381603 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:39.381603 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:39.381603 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:39.382743 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:39.382743 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:39.382743 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:39.382743 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:03:39.382743 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:03:39.382743 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'ff38bbda-17bb-41da-8e28-7751aa24fd51' could not be found. Oct 26 13:03:39.382743 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:39.382743 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b1b89f14-f6ad-4b2d-bfc0-8115463940fc tempest-HypervisorAdminNegativeTestJSON-1953885601 tempest-HypervisorAdminNegativeTestJSON-1953885601-project-admin] Returning 404 to user: Hypervisor with ID 'ff38bbda-17bb-41da-8e28-7751aa24fd51' could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:03:39.382743 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b1b89f14-f6ad-4b2d-bfc0-8115463940fc tempest-HypervisorAdminNegativeTestJSON-1953885601 tempest-HypervisorAdminNegativeTestJSON-1953885601-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/ff38bbda-17bb-41da-8e28-7751aa24fd51/uptime" status: 404 len: 123 microversion: 2.1 time: 0.021985 Oct 26 13:03:39.382743 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 195/343] 10.222.0.40 () {58 vars in 1278 bytes} [Wed Oct 26 13:03:39 2022] GET /compute/v2.1/os-hypervisors/ff38bbda-17bb-41da-8e28-7751aa24fd51/uptime => generated 123 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 13:03:39.395418 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7041bc9c-8dd8-4486-9daf-f4b3bd3fbe23 tempest-HypervisorAdminNegativeTestJSON-1953885601 tempest-HypervisorAdminNegativeTestJSON-1953885601-project-admin] Calling method '.version_select at 0x7f6732b32e50>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:39.397682 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7041bc9c-8dd8-4486-9daf-f4b3bd3fbe23 tempest-HypervisorAdminNegativeTestJSON-1953885601 tempest-HypervisorAdminNegativeTestJSON-1953885601-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:39.398432 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7041bc9c-8dd8-4486-9daf-f4b3bd3fbe23 tempest-HypervisorAdminNegativeTestJSON-1953885601 tempest-HypervisorAdminNegativeTestJSON-1953885601-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:39.399171 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7041bc9c-8dd8-4486-9daf-f4b3bd3fbe23 tempest-HypervisorAdminNegativeTestJSON-1953885601 tempest-HypervisorAdminNegativeTestJSON-1953885601-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:39.418814 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7041bc9c-8dd8-4486-9daf-f4b3bd3fbe23 tempest-HypervisorAdminNegativeTestJSON-1953885601 tempest-HypervisorAdminNegativeTestJSON-1953885601-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:39.419718 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7041bc9c-8dd8-4486-9daf-f4b3bd3fbe23 tempest-HypervisorAdminNegativeTestJSON-1953885601 tempest-HypervisorAdminNegativeTestJSON-1953885601-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:39.420162 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7041bc9c-8dd8-4486-9daf-f4b3bd3fbe23 tempest-HypervisorAdminNegativeTestJSON-1953885601 tempest-HypervisorAdminNegativeTestJSON-1953885601-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:39.433319 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7041bc9c-8dd8-4486-9daf-f4b3bd3fbe23 tempest-HypervisorAdminNegativeTestJSON-1953885601 tempest-HypervisorAdminNegativeTestJSON-1953885601-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:39.434047 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7041bc9c-8dd8-4486-9daf-f4b3bd3fbe23 tempest-HypervisorAdminNegativeTestJSON-1953885601 tempest-HypervisorAdminNegativeTestJSON-1953885601-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:39.434489 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7041bc9c-8dd8-4486-9daf-f4b3bd3fbe23 tempest-HypervisorAdminNegativeTestJSON-1953885601 tempest-HypervisorAdminNegativeTestJSON-1953885601-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:39.443258 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7041bc9c-8dd8-4486-9daf-f4b3bd3fbe23 tempest-HypervisorAdminNegativeTestJSON-1953885601 tempest-HypervisorAdminNegativeTestJSON-1953885601-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.053509 Oct 26 13:03:39.450243 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 196/344] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:03:39 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:39.456441 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ef30a906-99bd-4529-a33d-e5a3acaa3ed6 tempest-HypervisorAdminNegativeTestJSON-546950170 tempest-HypervisorAdminNegativeTestJSON-546950170-project] Calling method '.version_select at 0x7f6732e3baf0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:39.458544 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ef30a906-99bd-4529-a33d-e5a3acaa3ed6 tempest-HypervisorAdminNegativeTestJSON-546950170 tempest-HypervisorAdminNegativeTestJSON-546950170-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '425f3413e030492789f278f3ec100aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ef17a4c9443928ddf48573ae83003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:39.461639 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ef30a906-99bd-4529-a33d-e5a3acaa3ed6 tempest-HypervisorAdminNegativeTestJSON-546950170 tempest-HypervisorAdminNegativeTestJSON-546950170-project] Request method failure captured: Oct 26 13:03:39.461639 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 26 13:03:39.461639 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:03:39.461639 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:03:39.461639 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:03:39.461639 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:03:39.461639 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:03:39.461639 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:03:39.461639 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:03:39.461639 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:03:39.461639 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTAn0QNs0exOTF-cABull-w6_qK1E88gM7MoKeKVr6LgmkK-a8KRPndj_wyPgnfZFC08BO2NnDhjuynJ9WnkBm7eYvRFpqw2gtj-FzHYEbezEb1z6rrV2h6eYvoQ9E90iGv7k8IScE1W2cP7YmjVpqUTyEgyoxZ9EdU4t0l0z8r9tkg Oct 26 13:03:39.461639 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:03:39.461639 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:03:39.461639 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:03:39.461639 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:03:39.461639 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:03:39.461639 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:03:39.461639 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: dc0ef17a4c9443928ddf48573ae83003 Oct 26 13:03:39.461639 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-546950170 Oct 26 13:03:39.461639 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:03:39.461639 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:03:39.463566 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/dc0ef17a4c9443928ddf48573ae83003"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dc0ef17a4c9443928ddf48573ae83003"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_dc0ef17a4c9443928ddf48573ae83003"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dc0ef17a4c9443928ddf48573ae83003"}]}] Oct 26 13:03:39.463566 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-546950170 Oct 26 13:03:39.463566 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: dc0ef17a4c9443928ddf48573ae83003 Oct 26 13:03:39.463566 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-546950170 Oct 26 13:03:39.463566 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-HypervisorAdminNegativeTestJSON-546950170-project Oct 26 13:03:39.463566 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:03:39.463566 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:03:39.463566 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 425f3413e030492789f278f3ec100aee Oct 26 13:03:39.463566 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-546950170-project Oct 26 13:03:39.463566 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:03:39.463566 n-d-862686-1 devstack@n-api.service[120598]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 26 13:03:39.463566 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '1'} Oct 26 13:03:39.463566 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:03:39.469091 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:39.469091 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:39.469091 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:39.469091 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:03:39.469091 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:03:39.469091 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:03:39.469091 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:03:39.469091 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:03:39.469091 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:03:39.469091 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 26 13:03:39.469091 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 26 13:03:39.469091 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 26 13:03:39.469091 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 26 13:03:39.469091 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 13:03:39.469091 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 13:03:39.469091 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 13:03:39.469091 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 13:03:39.469091 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 13:03:39.469091 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 13:03:39.470274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 13:03:39.470274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 13:03:39.470274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 13:03:39.470274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 13:03:39.470274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 13:03:39.470274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 13:03:39.470274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 13:03:39.470274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 13:03:39.470274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 26 13:03:39.470274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:39.470274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:39.470274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:39.470274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:39.470274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:39.470274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:39.470274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 13:03:39.470274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 13:03:39.470274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 26 13:03:39.470274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:39.471308 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ef30a906-99bd-4529-a33d-e5a3acaa3ed6 tempest-HypervisorAdminNegativeTestJSON-546950170 tempest-HypervisorAdminNegativeTestJSON-546950170-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:03:39.471308 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ef30a906-99bd-4529-a33d-e5a3acaa3ed6 tempest-HypervisorAdminNegativeTestJSON-546950170 tempest-HypervisorAdminNegativeTestJSON-546950170-project] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.011783 Oct 26 13:03:39.471308 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 197/345] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 26 13:03:39 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:03:39.474649 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-78f971de-d4aa-4b9f-8cb3-e9adc5fa3218 tempest-HypervisorAdminNegativeTestJSON-1953885601 tempest-HypervisorAdminNegativeTestJSON-1953885601-project-admin] Calling method '.version_select at 0x7f6732ba8d30>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:39.476246 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-78f971de-d4aa-4b9f-8cb3-e9adc5fa3218 tempest-HypervisorAdminNegativeTestJSON-1953885601 tempest-HypervisorAdminNegativeTestJSON-1953885601-project-admin] HTTP exception thrown: Hypervisor with ID '3eda608a-f0b1-47af-b97a-61cd121d94b9' could not be found. Oct 26 13:03:39.478571 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-78f971de-d4aa-4b9f-8cb3-e9adc5fa3218 tempest-HypervisorAdminNegativeTestJSON-1953885601 tempest-HypervisorAdminNegativeTestJSON-1953885601-project-admin] Request method failure captured: Oct 26 13:03:39.478571 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/os-hypervisors/3eda608a-f0b1-47af-b97a-61cd121d94b9 HTTP/1.1 Oct 26 13:03:39.478571 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:03:39.478571 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:03:39.478571 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:03:39.478571 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:03:39.478571 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:03:39.478571 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:03:39.478571 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:03:39.478571 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:03:39.478571 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTApo9OS-RSm1Hm9Pdf0a8VHwoLzQL-Irgb0dzQ2Z0VXNy1JGQGuFUC9YuXs5F7qg9qz8ha0nZTps9RHbMnXQqjnuu_En4-p6Qrlf2vJX-_jm5sMRrBicRB1h9UHvH3vVyP-cKDnToFEiz5jMd9_k7yazwOjEmEPDgRs33k1R8QTqTw Oct 26 13:03:39.478571 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:03:39.478571 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:03:39.478571 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:03:39.478571 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:03:39.478571 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:03:39.478571 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:03:39.478571 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 64834e4a43a14380b26a2a68c563e438 Oct 26 13:03:39.478571 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1953885601 Oct 26 13:03:39.478571 n-d-862686-1 devstack@n-api.service[120598]: X-Role: admin,member,reader Oct 26 13:03:39.478571 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: admin,member,reader Oct 26 13:03:39.479846 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/64834e4a43a14380b26a2a68c563e438"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/64834e4a43a14380b26a2a68c563e438"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_64834e4a43a14380b26a2a68c563e438"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/64834e4a43a14380b26a2a68c563e438"}]}] Oct 26 13:03:39.479846 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1953885601 Oct 26 13:03:39.479846 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 64834e4a43a14380b26a2a68c563e438 Oct 26 13:03:39.479846 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1953885601 Oct 26 13:03:39.479846 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-HypervisorAdminNegativeTestJSON-1953885601-project-admin Oct 26 13:03:39.479846 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:03:39.479846 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:03:39.479846 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: f2b2534b197749d8b752db6a2260b3e2 Oct 26 13:03:39.479846 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1953885601-project-admin Oct 26 13:03:39.479846 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:03:39.479846 n-d-862686-1 devstack@n-api.service[120598]: exception: Hypervisor with ID '3eda608a-f0b1-47af-b97a-61cd121d94b9' could not be found. Oct 26 13:03:39.479846 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '3eda608a-f0b1-47af-b97a-61cd121d94b9'} Oct 26 13:03:39.481433 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:03:39.481433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:39.481433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 26 13:03:39.481433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 26 13:03:39.481433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '3eda608a-f0b1-47af-b97a-61cd121d94b9' Oct 26 13:03:39.481433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:39.481433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:39.481433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:39.481433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:39.481433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 26 13:03:39.481433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 26 13:03:39.481433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 26 13:03:39.481433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 26 13:03:39.481433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 26 13:03:39.481433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:39.481433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:39.481433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:39.481433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:39.481433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 26 13:03:39.481433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 26 13:03:39.481433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 26 13:03:39.481433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 26 13:03:39.488774 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 26 13:03:39.488774 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:39.488774 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:39.488774 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:39.488774 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:39.488774 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:39.488774 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:39.488774 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:03:39.488774 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:03:39.488774 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:03:39.488774 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:03:39.488774 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:03:39.488774 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:03:39.488774 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 26 13:03:39.488774 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 26 13:03:39.488774 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 26 13:03:39.488774 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 26 13:03:39.488774 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 26 13:03:39.488774 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 26 13:03:39.488774 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '3eda608a-f0b1-47af-b97a-61cd121d94b9' could not be found. Oct 26 13:03:39.490163 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:39.490163 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:39.490163 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:39.490163 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:39.490163 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:39.490163 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:39.490163 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:03:39.490163 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:03:39.490163 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '3eda608a-f0b1-47af-b97a-61cd121d94b9' could not be found. Oct 26 13:03:39.490163 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:39.490163 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-78f971de-d4aa-4b9f-8cb3-e9adc5fa3218 tempest-HypervisorAdminNegativeTestJSON-1953885601 tempest-HypervisorAdminNegativeTestJSON-1953885601-project-admin] Returning 404 to user: Hypervisor with ID '3eda608a-f0b1-47af-b97a-61cd121d94b9' could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:03:39.490163 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-78f971de-d4aa-4b9f-8cb3-e9adc5fa3218 tempest-HypervisorAdminNegativeTestJSON-1953885601 tempest-HypervisorAdminNegativeTestJSON-1953885601-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/3eda608a-f0b1-47af-b97a-61cd121d94b9" status: 404 len: 123 microversion: 2.1 time: 0.009257 Oct 26 13:03:39.490163 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 198/346] 10.222.0.40 () {58 vars in 1257 bytes} [Wed Oct 26 13:03:39 2022] GET /compute/v2.1/os-hypervisors/3eda608a-f0b1-47af-b97a-61cd121d94b9 => generated 123 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:03:39.614577 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-91e3337b-9431-4c6e-bcb8-7113d9d2b5c3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:39.615329 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-91e3337b-9431-4c6e-bcb8-7113d9d2b5c3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:39.624383 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91e3337b-9431-4c6e-bcb8-7113d9d2b5c3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:39.625545 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91e3337b-9431-4c6e-bcb8-7113d9d2b5c3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:39.626066 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91e3337b-9431-4c6e-bcb8-7113d9d2b5c3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:39.627682 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91e3337b-9431-4c6e-bcb8-7113d9d2b5c3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:39.628218 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91e3337b-9431-4c6e-bcb8-7113d9d2b5c3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:39.631012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91e3337b-9431-4c6e-bcb8-7113d9d2b5c3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:39.716233 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-2c9ba9b4-9fe6-4037-9b46-d15c919a3e54 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:03:39.717018 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-2c9ba9b4-9fe6-4037-9b46-d15c919a3e54 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:03:39.717681 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-2c9ba9b4-9fe6-4037-9b46-d15c919a3e54 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:03:39.718384 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-2c9ba9b4-9fe6-4037-9b46-d15c919a3e54 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:03:39.718929 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-2c9ba9b4-9fe6-4037-9b46-d15c919a3e54 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:03:39.741215 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2c9ba9b4-9fe6-4037-9b46-d15c919a3e54 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:39.741716 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2c9ba9b4-9fe6-4037-9b46-d15c919a3e54 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:39.742147 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2c9ba9b4-9fe6-4037-9b46-d15c919a3e54 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:39.742858 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2c9ba9b4-9fe6-4037-9b46-d15c919a3e54 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:39.744007 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2c9ba9b4-9fe6-4037-9b46-d15c919a3e54 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:39.744574 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2c9ba9b4-9fe6-4037-9b46-d15c919a3e54 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:39.781768 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-2c9ba9b4-9fe6-4037-9b46-d15c919a3e54 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Getting quotas for project 56ecf288e1da4f65b224ffb411028c71. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:03:39.792870 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-2c9ba9b4-9fe6-4037-9b46-d15c919a3e54 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Getting quotas for user 734498bc8a514af3b576008643b88351 and project 56ecf288e1da4f65b224ffb411028c71. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:03:39.819346 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-91e3337b-9431-4c6e-bcb8-7113d9d2b5c3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:39.822621 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.utils [None req-2c9ba9b4-9fe6-4037-9b46-d15c919a3e54 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] ram quota exceeded for 56ecf288e1da4f65b224ffb411028c71, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120597) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 26 13:03:39.825238 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-2c9ba9b4-9fe6-4037-9b46-d15c919a3e54 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 26 13:03:39.831512 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-91e3337b-9431-4c6e-bcb8-7113d9d2b5c3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1475 microversion: 2.1 time: 0.224706 Oct 26 13:03:39.836646 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2c9ba9b4-9fe6-4037-9b46-d15c919a3e54 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Request method failure captured: Oct 26 13:03:39.836646 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 13:03:39.836646 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:03:39.836646 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:03:39.836646 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:03:39.836646 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 145 Oct 26 13:03:39.836646 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:03:39.836646 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:03:39.836646 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:03:39.836646 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:03:39.836646 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTAe70Q_gEUWoxROpZBRWu2xmmQDBIWVtoKKVfTpdm_8tbKQVVT5VFq0ff5g8kdnZBJ2Vw0xbegys3GVg0PRu8W6rspWplVfPsDRsxeyFXN6wYsc_yPysctMCAAYVtLHPnCm5vKG1ru92FVKb0yRT7MEeJddqyRcfzCLvNNcQQ2scBY Oct 26 13:03:39.836646 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:03:39.836646 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:03:39.836646 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:03:39.836646 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:03:39.836646 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:03:39.836646 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:03:39.836646 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 56ecf288e1da4f65b224ffb411028c71 Oct 26 13:03:39.836646 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-QuotasAdminNegativeTest-211329314 Oct 26 13:03:39.836646 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:03:39.836646 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:03:39.838539 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/56ecf288e1da4f65b224ffb411028c71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/56ecf288e1da4f65b224ffb411028c71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_56ecf288e1da4f65b224ffb411028c71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/56ecf288e1da4f65b224ffb411028c71"}]}] Oct 26 13:03:39.838539 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-QuotasAdminNegativeTest-211329314 Oct 26 13:03:39.838539 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 56ecf288e1da4f65b224ffb411028c71 Oct 26 13:03:39.838539 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-211329314 Oct 26 13:03:39.838539 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-QuotasAdminNegativeTest-211329314-project Oct 26 13:03:39.838539 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:03:39.838539 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:03:39.838539 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 734498bc8a514af3b576008643b88351 Oct 26 13:03:39.838539 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-QuotasAdminNegativeTest-211329314-project Oct 26 13:03:39.838539 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:03:39.838539 n-d-862686-1 devstack@n-api.service[120597]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1565489039", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452"}} Oct 26 13:03:39.838539 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:03:39.839188 n-d-862686-1 devstack@n-api.service[120597]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 26 13:03:39.839188 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1565489039', 'imageRef': '762c20f4-0f9b-45cb-bd95-cf21a747b33b', 'flavorRef': '452'}}} Oct 26 13:03:39.839188 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:03:39.839188 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:39.839188 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 26 13:03:39.839188 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 26 13:03:39.839188 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 13:03:39.839188 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 13:03:39.839188 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 26 13:03:39.839188 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc Oct 26 13:03:39.839188 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 26 13:03:39.839188 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 26 13:03:39.839188 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 13:03:39.839188 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 13:03:39.839188 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 26 13:03:39.839188 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 26 13:03:39.839188 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 26 13:03:39.839188 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 26 13:03:39.840119 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 26 13:03:39.840119 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 26 13:03:39.840119 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 26 13:03:39.840119 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:03:39.840119 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:39.840119 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:03:39.840119 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:39.840119 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 26 13:03:39.840119 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 26 13:03:39.840119 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 26 13:03:39.840119 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 26 13:03:39.840119 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 26 13:03:39.840119 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 26 13:03:39.840119 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 26 13:03:39.840119 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 26 13:03:39.840119 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 26 13:03:39.840119 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 26 13:03:39.840119 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 26 13:03:39.840119 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:03:39.840119 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:39.840119 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:03:39.841218 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:39.841218 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:39.841218 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:39.841218 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:03:39.841218 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:03:39.841218 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:03:39.841218 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:03:39.841218 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:03:39.841218 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:03:39.841218 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:03:39.841218 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:03:39.841218 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:03:39.841218 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:03:39.841218 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 26 13:03:39.841218 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 26 13:03:39.841218 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 26 13:03:39.841218 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 26 13:03:39.841218 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:03:39.841218 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:39.841218 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:03:39.841218 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:39.842365 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:39.842365 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:39.842365 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:03:39.842365 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:03:39.842365 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 26 13:03:39.842365 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:03:39.845437 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2c9ba9b4-9fe6-4037-9b46-d15c919a3e54 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:03:39.846321 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 199/347] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:39 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1475 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:39.849030 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2c9ba9b4-9fe6-4037-9b46-d15c919a3e54 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.818984 Oct 26 13:03:39.849891 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 149/348] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:03:39 2022] POST /compute/v2.1/servers => generated 110 bytes in 823 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:03:39.854725 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a0caef7e-d730-4932-93f3-fc21f95033bb tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:39.855322 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a0caef7e-d730-4932-93f3-fc21f95033bb tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] [instance: 3b17e574-b449-4b57-b82d-82303ec940ab] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:39.861913 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0caef7e-d730-4932-93f3-fc21f95033bb tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:39.862405 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0caef7e-d730-4932-93f3-fc21f95033bb tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:39.862844 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0caef7e-d730-4932-93f3-fc21f95033bb tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:39.863542 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0caef7e-d730-4932-93f3-fc21f95033bb tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:39.863995 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0caef7e-d730-4932-93f3-fc21f95033bb tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:39.864416 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0caef7e-d730-4932-93f3-fc21f95033bb tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:39.870015 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-52638585-b10f-4b97-b9d4-2e4788e82a79 tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] Action: 'update', calling method: .version_select at 0x7f6733138280>, body: {"quota_set": {"ram": 51200}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:40.048794 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a0caef7e-d730-4932-93f3-fc21f95033bb tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999ac729ed1f4456857c8671d4b9be8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e2b56ef8db404ca0372e0a9c5f9b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:40.057452 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a0caef7e-d730-4932-93f3-fc21f95033bb tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] 10.222.0.40 "GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab" status: 200 len: 1318 microversion: 2.1 time: 0.209975 Oct 26 13:03:40.059003 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 200/349] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:39 2022] GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:40.071332 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a92165e1-a4b1-4b41-a513-0e4a60e73df2 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:40.075754 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a92165e1-a4b1-4b41-a513-0e4a60e73df2 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3e395c36-3e81-4ca3-ab5c-a034d92f8288] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:40.089274 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a92165e1-a4b1-4b41-a513-0e4a60e73df2 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:40.091912 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a92165e1-a4b1-4b41-a513-0e4a60e73df2 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:40.092902 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a92165e1-a4b1-4b41-a513-0e4a60e73df2 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:40.096036 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a92165e1-a4b1-4b41-a513-0e4a60e73df2 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:40.096559 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a92165e1-a4b1-4b41-a513-0e4a60e73df2 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:40.097307 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a92165e1-a4b1-4b41-a513-0e4a60e73df2 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:40.329840 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a92165e1-a4b1-4b41-a513-0e4a60e73df2 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:40.341217 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a92165e1-a4b1-4b41-a513-0e4a60e73df2 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:40.343273 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a92165e1-a4b1-4b41-a513-0e4a60e73df2 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:40.345882 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a92165e1-a4b1-4b41-a513-0e4a60e73df2 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288" status: 200 len: 1361 microversion: 2.25 time: 0.285660 Oct 26 13:03:40.363275 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 201/350] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:03:40 2022] GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288 => generated 1361 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:03:40.374714 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1be85834-ae73-4806-b568-3f21220336a2 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:40.375677 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1be85834-ae73-4806-b568-3f21220336a2 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] [instance: 380d16a8-2b4c-460b-9b36-884e7fb24812] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:40.383551 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1be85834-ae73-4806-b568-3f21220336a2 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:40.384887 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1be85834-ae73-4806-b568-3f21220336a2 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:40.385770 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1be85834-ae73-4806-b568-3f21220336a2 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:40.386680 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1be85834-ae73-4806-b568-3f21220336a2 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:40.387710 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1be85834-ae73-4806-b568-3f21220336a2 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:40.389237 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1be85834-ae73-4806-b568-3f21220336a2 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:40.519784 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52638585-b10f-4b97-b9d4-2e4788e82a79 tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:40.522386 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52638585-b10f-4b97-b9d4-2e4788e82a79 tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:40.526458 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52638585-b10f-4b97-b9d4-2e4788e82a79 tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:40.528053 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52638585-b10f-4b97-b9d4-2e4788e82a79 tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:40.528757 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52638585-b10f-4b97-b9d4-2e4788e82a79 tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:40.530159 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52638585-b10f-4b97-b9d4-2e4788e82a79 tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:40.625353 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-52638585-b10f-4b97-b9d4-2e4788e82a79 tempest-QuotasAdminNegativeTest-2103859183 tempest-QuotasAdminNegativeTest-2103859183-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/56ecf288e1da4f65b224ffb411028c71" status: 200 len: 329 microversion: 2.1 time: 0.768020 Oct 26 13:03:40.626512 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 150/351] 10.222.0.40 () {60 vars in 1262 bytes} [Wed Oct 26 13:03:39 2022] PUT /compute/v2.1/os-quota-sets/56ecf288e1da4f65b224ffb411028c71 => generated 329 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:40.631421 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-b0b491b5-f6c0-492c-8d1b-5e87e20bbe8d req-4b97592f-c81b-4341-a2fc-cdf83001e18b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b17e574-b449-4b57-b82d-82303ec940ab", "tag": "90575c26-418d-4416-b33a-4e61e0fa2a53"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:40.643226 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-b0b491b5-f6c0-492c-8d1b-5e87e20bbe8d req-4b97592f-c81b-4341-a2fc-cdf83001e18b service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:40.643708 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-b0b491b5-f6c0-492c-8d1b-5e87e20bbe8d req-4b97592f-c81b-4341-a2fc-cdf83001e18b service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:40.644141 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-b0b491b5-f6c0-492c-8d1b-5e87e20bbe8d req-4b97592f-c81b-4341-a2fc-cdf83001e18b service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:40.655214 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-b0b491b5-f6c0-492c-8d1b-5e87e20bbe8d req-4b97592f-c81b-4341-a2fc-cdf83001e18b service nova] Creating event network-changed:90575c26-418d-4416-b33a-4e61e0fa2a53 for instance 3b17e574-b449-4b57-b82d-82303ec940ab on n-h2-862686-1 Oct 26 13:03:40.660541 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-b0b491b5-f6c0-492c-8d1b-5e87e20bbe8d req-4b97592f-c81b-4341-a2fc-cdf83001e18b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032528 Oct 26 13:03:40.661150 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 151/352] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:40.667356 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e141dbda-4d86-41dc-83b7-b705e3cd9636 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Action: 'update', calling method: .version_select at 0x7f67331011f0>, body: {"quota_set": {"ram": 0}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:40.673737 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e141dbda-4d86-41dc-83b7-b705e3cd9636 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '734498bc8a514af3b576008643b88351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ecf288e1da4f65b224ffb411028c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:40.676896 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e141dbda-4d86-41dc-83b7-b705e3cd9636 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Request method failure captured: Oct 26 13:03:40.676896 n-d-862686-1 devstack@n-api.service[120597]: request: PUT /compute/v2.1/os-quota-sets/56ecf288e1da4f65b224ffb411028c71 HTTP/1.1 Oct 26 13:03:40.676896 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:03:40.676896 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:03:40.676896 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:03:40.676896 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 25 Oct 26 13:03:40.676896 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:03:40.676896 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:03:40.676896 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:03:40.676896 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:03:40.676896 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTAe70Q_gEUWoxROpZBRWu2xmmQDBIWVtoKKVfTpdm_8tbKQVVT5VFq0ff5g8kdnZBJ2Vw0xbegys3GVg0PRu8W6rspWplVfPsDRsxeyFXN6wYsc_yPysctMCAAYVtLHPnCm5vKG1ru92FVKb0yRT7MEeJddqyRcfzCLvNNcQQ2scBY Oct 26 13:03:40.676896 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:03:40.676896 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:03:40.676896 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:03:40.676896 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:03:40.676896 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:03:40.676896 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:03:40.676896 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 56ecf288e1da4f65b224ffb411028c71 Oct 26 13:03:40.676896 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-QuotasAdminNegativeTest-211329314 Oct 26 13:03:40.676896 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:03:40.676896 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:03:40.678398 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/56ecf288e1da4f65b224ffb411028c71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/56ecf288e1da4f65b224ffb411028c71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_56ecf288e1da4f65b224ffb411028c71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/56ecf288e1da4f65b224ffb411028c71"}]}] Oct 26 13:03:40.678398 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-QuotasAdminNegativeTest-211329314 Oct 26 13:03:40.678398 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 56ecf288e1da4f65b224ffb411028c71 Oct 26 13:03:40.678398 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-211329314 Oct 26 13:03:40.678398 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-QuotasAdminNegativeTest-211329314-project Oct 26 13:03:40.678398 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:03:40.678398 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:03:40.678398 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 734498bc8a514af3b576008643b88351 Oct 26 13:03:40.678398 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-QuotasAdminNegativeTest-211329314-project Oct 26 13:03:40.678398 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:03:40.678398 n-d-862686-1 devstack@n-api.service[120597]: {"quota_set": {"ram": 0}} Oct 26 13:03:40.678398 n-d-862686-1 devstack@n-api.service[120597]: method: Oct 26 13:03:40.678398 n-d-862686-1 devstack@n-api.service[120597]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 26 13:03:40.678398 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '56ecf288e1da4f65b224ffb411028c71', 'body': {'quota_set': {'ram': 0}}} Oct 26 13:03:40.679325 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:03:40.679325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:40.679325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:40.679325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:40.679325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:03:40.679325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:03:40.679325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:03:40.679325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:03:40.679325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:03:40.679325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:03:40.679325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:03:40.679325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:03:40.679325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 26 13:03:40.679325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 26 13:03:40.679325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 26 13:03:40.679325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:03:40.679325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 26 13:03:40.679325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:03:40.679325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 26 13:03:40.680560 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 26 13:03:40.680560 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 13:03:40.680560 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 13:03:40.680560 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 13:03:40.680560 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 13:03:40.680560 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 13:03:40.680560 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 13:03:40.680560 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 13:03:40.680560 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 13:03:40.680560 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 13:03:40.680560 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 13:03:40.680560 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 13:03:40.680560 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 13:03:40.680560 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 13:03:40.680560 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 13:03:40.680560 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 26 13:03:40.680560 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:03:40.680560 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:40.680560 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:03:40.680560 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:40.682827 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:40.682827 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:40.682827 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 13:03:40.682827 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 13:03:40.682827 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 26 13:03:40.682827 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:03:40.684266 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e141dbda-4d86-41dc-83b7-b705e3cd9636 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:03:40.685395 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e141dbda-4d86-41dc-83b7-b705e3cd9636 tempest-QuotasAdminNegativeTest-211329314 tempest-QuotasAdminNegativeTest-211329314-project] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/56ecf288e1da4f65b224ffb411028c71" status: 403 len: 116 microversion: 2.1 time: 0.022866 Oct 26 13:03:40.686459 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 152/353] 10.222.0.40 () {60 vars in 1262 bytes} [Wed Oct 26 13:03:40 2022] PUT /compute/v2.1/os-quota-sets/56ecf288e1da4f65b224ffb411028c71 => generated 116 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:03:40.737333 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1be85834-ae73-4806-b568-3f21220336a2 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f9391046054747bbfc1c3e6d65d4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10521abb1c34417fa9369aaba9070968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:40.748777 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1be85834-ae73-4806-b568-3f21220336a2 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] 10.222.0.40 "GET /compute/v2.1/servers/380d16a8-2b4c-460b-9b36-884e7fb24812" status: 200 len: 1389 microversion: 2.1 time: 0.379539 Oct 26 13:03:40.749857 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 202/354] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:40 2022] GET /compute/v2.1/servers/380d16a8-2b4c-460b-9b36-884e7fb24812 => generated 1389 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:40.864537 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-17b30f8b-039c-4970-bbb8-ceac019dad51 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:40.865234 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-17b30f8b-039c-4970-bbb8-ceac019dad51 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:40.878472 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17b30f8b-039c-4970-bbb8-ceac019dad51 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:40.879288 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17b30f8b-039c-4970-bbb8-ceac019dad51 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:40.879698 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17b30f8b-039c-4970-bbb8-ceac019dad51 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:40.880732 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17b30f8b-039c-4970-bbb8-ceac019dad51 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:40.881327 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17b30f8b-039c-4970-bbb8-ceac019dad51 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:40.882166 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17b30f8b-039c-4970-bbb8-ceac019dad51 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:41.084433 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-49d99d55-1241-4305-b7f1-765bb4db9144 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:41.085427 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-49d99d55-1241-4305-b7f1-765bb4db9144 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] [instance: 3b17e574-b449-4b57-b82d-82303ec940ab] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:41.095939 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-49d99d55-1241-4305-b7f1-765bb4db9144 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:41.096950 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-49d99d55-1241-4305-b7f1-765bb4db9144 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:41.097841 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-49d99d55-1241-4305-b7f1-765bb4db9144 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:41.100004 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-49d99d55-1241-4305-b7f1-765bb4db9144 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:41.100764 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-49d99d55-1241-4305-b7f1-765bb4db9144 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:41.101576 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-49d99d55-1241-4305-b7f1-765bb4db9144 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:41.406523 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-49d99d55-1241-4305-b7f1-765bb4db9144 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999ac729ed1f4456857c8671d4b9be8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e2b56ef8db404ca0372e0a9c5f9b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:41.417527 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-49d99d55-1241-4305-b7f1-765bb4db9144 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] 10.222.0.40 "GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab" status: 200 len: 1318 microversion: 2.1 time: 0.338878 Oct 26 13:03:41.419990 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 203/355] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:41 2022] GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab => generated 1318 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:03:41.429516 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7b3b6a83-56d7-498d-a811-c62b6eb60e3f tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:41.430672 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7b3b6a83-56d7-498d-a811-c62b6eb60e3f tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3e395c36-3e81-4ca3-ab5c-a034d92f8288] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:41.451939 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7b3b6a83-56d7-498d-a811-c62b6eb60e3f tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:41.452652 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7b3b6a83-56d7-498d-a811-c62b6eb60e3f tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:41.453252 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7b3b6a83-56d7-498d-a811-c62b6eb60e3f tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:41.454810 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7b3b6a83-56d7-498d-a811-c62b6eb60e3f tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:41.455648 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7b3b6a83-56d7-498d-a811-c62b6eb60e3f tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:41.456960 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7b3b6a83-56d7-498d-a811-c62b6eb60e3f tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:41.491414 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-17b30f8b-039c-4970-bbb8-ceac019dad51 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:41.501531 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-17b30f8b-039c-4970-bbb8-ceac019dad51 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1475 microversion: 2.1 time: 0.642463 Oct 26 13:03:41.505884 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 153/356] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:40 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1475 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:41.774049 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e29529af-4781-4409-9e8d-0559ac1118db tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:41.775850 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e29529af-4781-4409-9e8d-0559ac1118db tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] [instance: 380d16a8-2b4c-460b-9b36-884e7fb24812] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:41.787603 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e29529af-4781-4409-9e8d-0559ac1118db tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:41.788109 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e29529af-4781-4409-9e8d-0559ac1118db tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:41.788547 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e29529af-4781-4409-9e8d-0559ac1118db tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:41.792062 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e29529af-4781-4409-9e8d-0559ac1118db tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:41.792556 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e29529af-4781-4409-9e8d-0559ac1118db tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:41.794083 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e29529af-4781-4409-9e8d-0559ac1118db tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:42.003428 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7b3b6a83-56d7-498d-a811-c62b6eb60e3f tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:42.017178 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7b3b6a83-56d7-498d-a811-c62b6eb60e3f tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:42.018688 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7b3b6a83-56d7-498d-a811-c62b6eb60e3f tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:42.019809 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7b3b6a83-56d7-498d-a811-c62b6eb60e3f tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288" status: 200 len: 1361 microversion: 2.25 time: 0.597365 Oct 26 13:03:42.024353 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 204/357] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:03:41 2022] GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288 => generated 1361 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:03:42.141707 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e29529af-4781-4409-9e8d-0559ac1118db tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f9391046054747bbfc1c3e6d65d4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10521abb1c34417fa9369aaba9070968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:42.153584 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e29529af-4781-4409-9e8d-0559ac1118db tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] 10.222.0.40 "GET /compute/v2.1/servers/380d16a8-2b4c-460b-9b36-884e7fb24812" status: 200 len: 1389 microversion: 2.1 time: 0.381140 Oct 26 13:03:42.159305 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 154/358] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:41 2022] GET /compute/v2.1/servers/380d16a8-2b4c-460b-9b36-884e7fb24812 => generated 1389 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:42.362516 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-81701046-33dd-497d-91fa-ea09c5a0d74e tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1274825378", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:42.425953 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-81701046-33dd-497d-91fa-ea09c5a0d74e tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] validate_networks() for None {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:03:42.447522 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bb65b696-2704-4afd-a83e-3ba61f2855ff tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:42.448135 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bb65b696-2704-4afd-a83e-3ba61f2855ff tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] [instance: 3b17e574-b449-4b57-b82d-82303ec940ab] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:42.455044 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb65b696-2704-4afd-a83e-3ba61f2855ff tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:42.455725 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb65b696-2704-4afd-a83e-3ba61f2855ff tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:42.456973 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb65b696-2704-4afd-a83e-3ba61f2855ff tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:42.457714 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb65b696-2704-4afd-a83e-3ba61f2855ff tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:42.458187 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb65b696-2704-4afd-a83e-3ba61f2855ff tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:42.458597 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb65b696-2704-4afd-a83e-3ba61f2855ff tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:42.643840 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bb65b696-2704-4afd-a83e-3ba61f2855ff tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999ac729ed1f4456857c8671d4b9be8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e2b56ef8db404ca0372e0a9c5f9b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:42.654975 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bb65b696-2704-4afd-a83e-3ba61f2855ff tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] 10.222.0.40 "GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab" status: 200 len: 1318 microversion: 2.1 time: 0.212234 Oct 26 13:03:42.656512 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 155/359] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:42 2022] GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:03:42.663170 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-341475fd-7c50-4b3c-b483-9bedf7cf1cfd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:42.664060 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-341475fd-7c50-4b3c-b483-9bedf7cf1cfd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:42.673808 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-341475fd-7c50-4b3c-b483-9bedf7cf1cfd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:42.674585 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-341475fd-7c50-4b3c-b483-9bedf7cf1cfd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:42.675218 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-341475fd-7c50-4b3c-b483-9bedf7cf1cfd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:42.676118 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-341475fd-7c50-4b3c-b483-9bedf7cf1cfd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:42.676949 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-341475fd-7c50-4b3c-b483-9bedf7cf1cfd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:42.677630 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-341475fd-7c50-4b3c-b483-9bedf7cf1cfd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:42.803100 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-81701046-33dd-497d-91fa-ea09c5a0d74e tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:03:42.803547 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-81701046-33dd-497d-91fa-ea09c5a0d74e tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:03:42.804027 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-81701046-33dd-497d-91fa-ea09c5a0d74e tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:03:42.804577 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-81701046-33dd-497d-91fa-ea09c5a0d74e tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:03:42.805189 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-81701046-33dd-497d-91fa-ea09c5a0d74e tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:03:42.817274 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81701046-33dd-497d-91fa-ea09c5a0d74e tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:42.818030 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81701046-33dd-497d-91fa-ea09c5a0d74e tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:42.818476 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81701046-33dd-497d-91fa-ea09c5a0d74e tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:42.819215 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81701046-33dd-497d-91fa-ea09c5a0d74e tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:42.819674 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81701046-33dd-497d-91fa-ea09c5a0d74e tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:42.820100 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81701046-33dd-497d-91fa-ea09c5a0d74e tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:42.842386 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-81701046-33dd-497d-91fa-ea09c5a0d74e tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Getting quotas for project 81334bcb49d84a529558a88b02b6ef55. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:03:42.848941 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-81701046-33dd-497d-91fa-ea09c5a0d74e tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Getting quotas for user c240bdb5dd7249c79d9620637d0c6e3b and project 81334bcb49d84a529558a88b02b6ef55. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:03:42.864940 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-81701046-33dd-497d-91fa-ea09c5a0d74e tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:03:42.869083 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-81701046-33dd-497d-91fa-ea09c5a0d74e tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] [instance: ea0c61fb-9bc2-42d7-960e-4859c4e6f172] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:03:42.883797 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-341475fd-7c50-4b3c-b483-9bedf7cf1cfd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:42.897697 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-341475fd-7c50-4b3c-b483-9bedf7cf1cfd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1475 microversion: 2.1 time: 0.238763 Oct 26 13:03:42.913512 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 156/360] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:42 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1475 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:42.943349 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-f70df117-e06e-4518-b1af-debbbcca12a2 req-fec907cb-d010-41ce-90d6-bc2a761f7d0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e395c36-3e81-4ca3-ab5c-a034d92f8288", "tag": "d76e25b3-751c-4d09-9c27-caeb06dd7081"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:42.975260 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-f70df117-e06e-4518-b1af-debbbcca12a2 req-fec907cb-d010-41ce-90d6-bc2a761f7d0e service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:42.975966 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-f70df117-e06e-4518-b1af-debbbcca12a2 req-fec907cb-d010-41ce-90d6-bc2a761f7d0e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:42.978135 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-f70df117-e06e-4518-b1af-debbbcca12a2 req-fec907cb-d010-41ce-90d6-bc2a761f7d0e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:42.983725 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-81701046-33dd-497d-91fa-ea09c5a0d74e tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.957458 Oct 26 13:03:42.984587 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 205/361] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:03:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:03:42.997419 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-084a0c11-1b94-4e24-8919-8d5282ab4395 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:42.998487 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-084a0c11-1b94-4e24-8919-8d5282ab4395 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] [instance: ea0c61fb-9bc2-42d7-960e-4859c4e6f172] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:43.002355 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-f70df117-e06e-4518-b1af-debbbcca12a2 req-fec907cb-d010-41ce-90d6-bc2a761f7d0e service nova] Creating event network-changed:d76e25b3-751c-4d09-9c27-caeb06dd7081 for instance 3e395c36-3e81-4ca3-ab5c-a034d92f8288 on n-h1-862686-1 Oct 26 13:03:43.013649 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-f70df117-e06e-4518-b1af-debbbcca12a2 req-fec907cb-d010-41ce-90d6-bc2a761f7d0e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075530 Oct 26 13:03:43.015961 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 157/362] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:43.047433 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f3b9bb93-af9a-448f-a708-d5294bd18754 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:43.048786 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f3b9bb93-af9a-448f-a708-d5294bd18754 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3e395c36-3e81-4ca3-ab5c-a034d92f8288] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:43.061073 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-084a0c11-1b94-4e24-8919-8d5282ab4395 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c240bdb5dd7249c79d9620637d0c6e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81334bcb49d84a529558a88b02b6ef55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:43.062611 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3b9bb93-af9a-448f-a708-d5294bd18754 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:43.064749 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3b9bb93-af9a-448f-a708-d5294bd18754 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:43.066326 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3b9bb93-af9a-448f-a708-d5294bd18754 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:43.067149 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3b9bb93-af9a-448f-a708-d5294bd18754 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:43.070440 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3b9bb93-af9a-448f-a708-d5294bd18754 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:43.071050 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3b9bb93-af9a-448f-a708-d5294bd18754 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:43.072661 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-084a0c11-1b94-4e24-8919-8d5282ab4395 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] 10.222.0.40 "GET /compute/v2.1/servers/ea0c61fb-9bc2-42d7-960e-4859c4e6f172" status: 200 len: 1220 microversion: 2.1 time: 0.080621 Oct 26 13:03:43.081452 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 206/363] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:42 2022] GET /compute/v2.1/servers/ea0c61fb-9bc2-42d7-960e-4859c4e6f172 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:03:43.185606 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-19eabd1b-4295-4318-aaf4-cbe16c68875b tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:43.186235 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-19eabd1b-4295-4318-aaf4-cbe16c68875b tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] [instance: 380d16a8-2b4c-460b-9b36-884e7fb24812] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:43.202328 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-19eabd1b-4295-4318-aaf4-cbe16c68875b tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:43.202873 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-19eabd1b-4295-4318-aaf4-cbe16c68875b tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:43.203232 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-19eabd1b-4295-4318-aaf4-cbe16c68875b tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:43.204389 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-19eabd1b-4295-4318-aaf4-cbe16c68875b tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:43.204389 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-19eabd1b-4295-4318-aaf4-cbe16c68875b tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:43.204807 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-19eabd1b-4295-4318-aaf4-cbe16c68875b tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:43.367805 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f3b9bb93-af9a-448f-a708-d5294bd18754 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:43.383121 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f3b9bb93-af9a-448f-a708-d5294bd18754 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:43.388418 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f3b9bb93-af9a-448f-a708-d5294bd18754 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:43.391894 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f3b9bb93-af9a-448f-a708-d5294bd18754 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288" status: 200 len: 1361 microversion: 2.25 time: 0.349822 Oct 26 13:03:43.394229 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 158/364] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:03:43 2022] GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288 => generated 1361 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:03:43.636091 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-9c716031-4b7f-4b9f-b66c-a2670e5c7c28 req-f6c5eaa6-ed85-4f33-a52f-a9013ab12e8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "380d16a8-2b4c-460b-9b36-884e7fb24812", "name": "network-vif-plugged", "status": "completed", "tag": "5b05c6bb-7da5-41d5-bafd-a4735efff806"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:43.657543 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-19eabd1b-4295-4318-aaf4-cbe16c68875b tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f9391046054747bbfc1c3e6d65d4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10521abb1c34417fa9369aaba9070968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:43.660662 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9c716031-4b7f-4b9f-b66c-a2670e5c7c28 req-f6c5eaa6-ed85-4f33-a52f-a9013ab12e8f service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:43.664266 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9c716031-4b7f-4b9f-b66c-a2670e5c7c28 req-f6c5eaa6-ed85-4f33-a52f-a9013ab12e8f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:43.664965 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9c716031-4b7f-4b9f-b66c-a2670e5c7c28 req-f6c5eaa6-ed85-4f33-a52f-a9013ab12e8f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:43.680422 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-19eabd1b-4295-4318-aaf4-cbe16c68875b tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] 10.222.0.40 "GET /compute/v2.1/servers/380d16a8-2b4c-460b-9b36-884e7fb24812" status: 200 len: 1389 microversion: 2.1 time: 0.496627 Oct 26 13:03:43.695585 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-9c716031-4b7f-4b9f-b66c-a2670e5c7c28 req-f6c5eaa6-ed85-4f33-a52f-a9013ab12e8f service nova] Creating event network-vif-plugged:5b05c6bb-7da5-41d5-bafd-a4735efff806 for instance 380d16a8-2b4c-460b-9b36-884e7fb24812 on n-h2-862686-1 Oct 26 13:03:43.701117 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 207/365] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:43 2022] GET /compute/v2.1/servers/380d16a8-2b4c-460b-9b36-884e7fb24812 => generated 1389 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:03:43.709648 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-9c716031-4b7f-4b9f-b66c-a2670e5c7c28 req-f6c5eaa6-ed85-4f33-a52f-a9013ab12e8f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078455 Oct 26 13:03:43.718532 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 159/366] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:03:43.720579 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b7d18614-a502-43bb-a9e3-808839e67873 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:43.722409 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b7d18614-a502-43bb-a9e3-808839e67873 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] [instance: 3b17e574-b449-4b57-b82d-82303ec940ab] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:43.739972 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b7d18614-a502-43bb-a9e3-808839e67873 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:43.741951 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b7d18614-a502-43bb-a9e3-808839e67873 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:43.743652 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b7d18614-a502-43bb-a9e3-808839e67873 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:43.747166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b7d18614-a502-43bb-a9e3-808839e67873 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:43.749798 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b7d18614-a502-43bb-a9e3-808839e67873 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:43.750431 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b7d18614-a502-43bb-a9e3-808839e67873 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:43.927785 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-81baa9d7-9d28-4e8b-8216-416646f3c211 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:43.928965 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-81baa9d7-9d28-4e8b-8216-416646f3c211 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:43.942584 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81baa9d7-9d28-4e8b-8216-416646f3c211 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:43.944984 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81baa9d7-9d28-4e8b-8216-416646f3c211 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:43.948582 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81baa9d7-9d28-4e8b-8216-416646f3c211 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:43.949571 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81baa9d7-9d28-4e8b-8216-416646f3c211 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:43.950744 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81baa9d7-9d28-4e8b-8216-416646f3c211 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:43.952590 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81baa9d7-9d28-4e8b-8216-416646f3c211 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:44.125448 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b7d18614-a502-43bb-a9e3-808839e67873 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999ac729ed1f4456857c8671d4b9be8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e2b56ef8db404ca0372e0a9c5f9b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:44.138179 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b7d18614-a502-43bb-a9e3-808839e67873 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] 10.222.0.40 "GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab" status: 200 len: 1318 microversion: 2.1 time: 0.429386 Oct 26 13:03:44.139974 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 208/367] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:43 2022] GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab => generated 1318 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:44.145555 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-927dbd8c-dae9-4a68-9d03-1f2040b9a891 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:44.147107 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-927dbd8c-dae9-4a68-9d03-1f2040b9a891 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] [instance: ea0c61fb-9bc2-42d7-960e-4859c4e6f172] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:44.172091 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-927dbd8c-dae9-4a68-9d03-1f2040b9a891 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:44.172839 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-927dbd8c-dae9-4a68-9d03-1f2040b9a891 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:44.175866 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-927dbd8c-dae9-4a68-9d03-1f2040b9a891 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:44.176768 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-927dbd8c-dae9-4a68-9d03-1f2040b9a891 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:44.178363 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-927dbd8c-dae9-4a68-9d03-1f2040b9a891 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:44.179336 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-927dbd8c-dae9-4a68-9d03-1f2040b9a891 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:44.221049 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:03:44.282551 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-927dbd8c-dae9-4a68-9d03-1f2040b9a891 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c240bdb5dd7249c79d9620637d0c6e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81334bcb49d84a529558a88b02b6ef55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:44.296492 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-927dbd8c-dae9-4a68-9d03-1f2040b9a891 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] 10.222.0.40 "GET /compute/v2.1/servers/ea0c61fb-9bc2-42d7-960e-4859c4e6f172" status: 200 len: 1216 microversion: 2.1 time: 0.154162 Oct 26 13:03:44.317230 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 209/368] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:44 2022] GET /compute/v2.1/servers/ea0c61fb-9bc2-42d7-960e-4859c4e6f172 => generated 1216 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:44.419842 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-955bdc29-29fb-4733-b0f3-da3adc253117 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:44.420458 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-955bdc29-29fb-4733-b0f3-da3adc253117 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3e395c36-3e81-4ca3-ab5c-a034d92f8288] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:44.435883 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-955bdc29-29fb-4733-b0f3-da3adc253117 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:44.436458 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-955bdc29-29fb-4733-b0f3-da3adc253117 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:44.436825 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-955bdc29-29fb-4733-b0f3-da3adc253117 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:44.437632 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-955bdc29-29fb-4733-b0f3-da3adc253117 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:44.438038 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-955bdc29-29fb-4733-b0f3-da3adc253117 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:44.438667 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-955bdc29-29fb-4733-b0f3-da3adc253117 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:44.648877 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-955bdc29-29fb-4733-b0f3-da3adc253117 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:44.660257 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-955bdc29-29fb-4733-b0f3-da3adc253117 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:44.663576 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-955bdc29-29fb-4733-b0f3-da3adc253117 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:44.664915 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-955bdc29-29fb-4733-b0f3-da3adc253117 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288" status: 200 len: 1361 microversion: 2.25 time: 0.249766 Oct 26 13:03:44.678671 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 210/369] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:03:44 2022] GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288 => generated 1361 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:03:44.708852 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-81baa9d7-9d28-4e8b-8216-416646f3c211 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:44.712963 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-37dba296-56a4-4486-9a5c-f66c39b94045 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:44.713816 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-37dba296-56a4-4486-9a5c-f66c39b94045 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] [instance: 380d16a8-2b4c-460b-9b36-884e7fb24812] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:44.719948 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-37dba296-56a4-4486-9a5c-f66c39b94045 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:44.720521 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-37dba296-56a4-4486-9a5c-f66c39b94045 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:44.721045 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-37dba296-56a4-4486-9a5c-f66c39b94045 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:44.721842 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-37dba296-56a4-4486-9a5c-f66c39b94045 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:44.722493 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-37dba296-56a4-4486-9a5c-f66c39b94045 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:44.722984 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-37dba296-56a4-4486-9a5c-f66c39b94045 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:44.723925 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-81baa9d7-9d28-4e8b-8216-416646f3c211 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1475 microversion: 2.1 time: 0.800437 Oct 26 13:03:44.739322 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 160/370] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:43 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1475 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:44.944074 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-37dba296-56a4-4486-9a5c-f66c39b94045 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f9391046054747bbfc1c3e6d65d4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10521abb1c34417fa9369aaba9070968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:44.971654 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-37dba296-56a4-4486-9a5c-f66c39b94045 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] 10.222.0.40 "GET /compute/v2.1/servers/380d16a8-2b4c-460b-9b36-884e7fb24812" status: 200 len: 1389 microversion: 2.1 time: 0.263116 Oct 26 13:03:44.975263 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 211/371] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:44 2022] GET /compute/v2.1/servers/380d16a8-2b4c-460b-9b36-884e7fb24812 => generated 1389 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:03:45.171021 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a571db8e-068a-4078-9919-ce49d0581e48 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:45.171590 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a571db8e-068a-4078-9919-ce49d0581e48 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] [instance: 3b17e574-b449-4b57-b82d-82303ec940ab] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:45.179076 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a571db8e-068a-4078-9919-ce49d0581e48 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:45.180331 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a571db8e-068a-4078-9919-ce49d0581e48 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:45.180331 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a571db8e-068a-4078-9919-ce49d0581e48 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:45.181874 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a571db8e-068a-4078-9919-ce49d0581e48 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:45.182409 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a571db8e-068a-4078-9919-ce49d0581e48 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:45.182843 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a571db8e-068a-4078-9919-ce49d0581e48 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:45.324624 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d31bd301-8d0a-4bf2-a785-f89c4c2b78b9 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:45.325537 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d31bd301-8d0a-4bf2-a785-f89c4c2b78b9 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] [instance: ea0c61fb-9bc2-42d7-960e-4859c4e6f172] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:45.339046 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d31bd301-8d0a-4bf2-a785-f89c4c2b78b9 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:45.343246 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d31bd301-8d0a-4bf2-a785-f89c4c2b78b9 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:45.344138 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d31bd301-8d0a-4bf2-a785-f89c4c2b78b9 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:45.345109 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d31bd301-8d0a-4bf2-a785-f89c4c2b78b9 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:45.351296 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d31bd301-8d0a-4bf2-a785-f89c4c2b78b9 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:45.352076 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d31bd301-8d0a-4bf2-a785-f89c4c2b78b9 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:45.385218 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a571db8e-068a-4078-9919-ce49d0581e48 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999ac729ed1f4456857c8671d4b9be8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e2b56ef8db404ca0372e0a9c5f9b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:45.398962 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a571db8e-068a-4078-9919-ce49d0581e48 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] 10.222.0.40 "GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab" status: 200 len: 1318 microversion: 2.1 time: 0.237966 Oct 26 13:03:45.400154 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 161/372] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:45 2022] GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:45.467850 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d31bd301-8d0a-4bf2-a785-f89c4c2b78b9 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c240bdb5dd7249c79d9620637d0c6e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81334bcb49d84a529558a88b02b6ef55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:45.479620 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d31bd301-8d0a-4bf2-a785-f89c4c2b78b9 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] 10.222.0.40 "GET /compute/v2.1/servers/ea0c61fb-9bc2-42d7-960e-4859c4e6f172" status: 200 len: 1272 microversion: 2.1 time: 0.159386 Oct 26 13:03:45.480719 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 212/373] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:45 2022] GET /compute/v2.1/servers/ea0c61fb-9bc2-42d7-960e-4859c4e6f172 => generated 1272 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:45.692304 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5d8e8632-8e0a-43b1-bdcd-b35c4817162f tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:45.693326 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5d8e8632-8e0a-43b1-bdcd-b35c4817162f tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3e395c36-3e81-4ca3-ab5c-a034d92f8288] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:45.707440 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d8e8632-8e0a-43b1-bdcd-b35c4817162f tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:45.708541 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d8e8632-8e0a-43b1-bdcd-b35c4817162f tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:45.709205 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d8e8632-8e0a-43b1-bdcd-b35c4817162f tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:45.717623 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d8e8632-8e0a-43b1-bdcd-b35c4817162f tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:45.718221 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d8e8632-8e0a-43b1-bdcd-b35c4817162f tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:45.718708 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d8e8632-8e0a-43b1-bdcd-b35c4817162f tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:45.749623 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-aee80949-3dd8-4c7f-8935-85a6c46c8bda tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:45.750230 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-aee80949-3dd8-4c7f-8935-85a6c46c8bda tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:45.762062 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aee80949-3dd8-4c7f-8935-85a6c46c8bda tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:45.763117 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aee80949-3dd8-4c7f-8935-85a6c46c8bda tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:45.764569 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aee80949-3dd8-4c7f-8935-85a6c46c8bda tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:45.766779 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aee80949-3dd8-4c7f-8935-85a6c46c8bda tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:45.768942 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aee80949-3dd8-4c7f-8935-85a6c46c8bda tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:45.772977 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aee80949-3dd8-4c7f-8935-85a6c46c8bda tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:46.150012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-aee80949-3dd8-4c7f-8935-85a6c46c8bda tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:46.161590 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-aee80949-3dd8-4c7f-8935-85a6c46c8bda tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1475 microversion: 2.1 time: 0.415330 Oct 26 13:03:46.162410 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 213/374] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:45 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1475 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:03:46.254450 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5d8e8632-8e0a-43b1-bdcd-b35c4817162f tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:46.267660 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5d8e8632-8e0a-43b1-bdcd-b35c4817162f tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:46.272042 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5d8e8632-8e0a-43b1-bdcd-b35c4817162f tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:46.274166 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5d8e8632-8e0a-43b1-bdcd-b35c4817162f tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288" status: 200 len: 1361 microversion: 2.25 time: 0.585753 Oct 26 13:03:46.278959 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 162/375] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:03:45 2022] GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288 => generated 1361 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:03:46.287285 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-01641fae-4f3c-4802-ae88-f1ad83211050 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:46.287894 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-01641fae-4f3c-4802-ae88-f1ad83211050 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] [instance: 380d16a8-2b4c-460b-9b36-884e7fb24812] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:46.307307 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-01641fae-4f3c-4802-ae88-f1ad83211050 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:46.307816 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-01641fae-4f3c-4802-ae88-f1ad83211050 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:46.309885 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-01641fae-4f3c-4802-ae88-f1ad83211050 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:46.313688 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-01641fae-4f3c-4802-ae88-f1ad83211050 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:46.314717 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-01641fae-4f3c-4802-ae88-f1ad83211050 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:46.315170 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-01641fae-4f3c-4802-ae88-f1ad83211050 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:46.320557 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:03:46.572964 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-01641fae-4f3c-4802-ae88-f1ad83211050 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f9391046054747bbfc1c3e6d65d4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10521abb1c34417fa9369aaba9070968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:46.594190 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-01641fae-4f3c-4802-ae88-f1ad83211050 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] 10.222.0.40 "GET /compute/v2.1/servers/380d16a8-2b4c-460b-9b36-884e7fb24812" status: 200 len: 1586 microversion: 2.1 time: 0.314051 Oct 26 13:03:46.595072 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 163/376] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:46 2022] GET /compute/v2.1/servers/380d16a8-2b4c-460b-9b36-884e7fb24812 => generated 1586 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:46.621317 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f7e5e0f4-1d24-4311-9324-8f0ce97457ff tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:46.622536 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f7e5e0f4-1d24-4311-9324-8f0ce97457ff tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] [instance: 3b17e574-b449-4b57-b82d-82303ec940ab] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:46.629476 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f7e5e0f4-1d24-4311-9324-8f0ce97457ff tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:46.630162 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f7e5e0f4-1d24-4311-9324-8f0ce97457ff tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:46.630751 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f7e5e0f4-1d24-4311-9324-8f0ce97457ff tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:46.631623 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f7e5e0f4-1d24-4311-9324-8f0ce97457ff tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:46.632418 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f7e5e0f4-1d24-4311-9324-8f0ce97457ff tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:46.632992 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f7e5e0f4-1d24-4311-9324-8f0ce97457ff tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:46.633273 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7bd4a5b3-3a20-4243-9364-b5e9b970ab44 tempest-InstanceUsageAuditLogNegativeTestJSON-578007312 tempest-InstanceUsageAuditLogNegativeTestJSON-578007312-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:46.636889 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-7bd4a5b3-3a20-4243-9364-b5e9b970ab44 tempest-InstanceUsageAuditLogNegativeTestJSON-578007312 tempest-InstanceUsageAuditLogNegativeTestJSON-578007312-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 26 13:03:46.648331 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7bd4a5b3-3a20-4243-9364-b5e9b970ab44 tempest-InstanceUsageAuditLogNegativeTestJSON-578007312 tempest-InstanceUsageAuditLogNegativeTestJSON-578007312-project-admin] Request method failure captured: Oct 26 13:03:46.648331 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 26 13:03:46.648331 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:03:46.648331 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:03:46.648331 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:03:46.648331 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:03:46.648331 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:03:46.648331 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:03:46.648331 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:03:46.648331 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:03:46.648331 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTAxr4EPHIJURXhaEPndQ997CCI8g-6FEIHmp57EEEth4lRvpEk73kPWOi1C00W_5UX_EtZoXHlvRVPIDkbT1wUTYR3nDXWzGpat-uC2NrFxliYMrmmmzrgZuXBWyxpj4-77t2ozfVZVDp2CKS_z7pacEQRezgxNU68PEq-BaRZ2tS0 Oct 26 13:03:46.648331 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:03:46.648331 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:03:46.648331 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:03:46.648331 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:03:46.648331 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:03:46.648331 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:03:46.648331 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 54b7a09a3376404996026fe0636e7bed Oct 26 13:03:46.648331 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-578007312 Oct 26 13:03:46.648331 n-d-862686-1 devstack@n-api.service[120598]: X-Role: admin,member,reader Oct 26 13:03:46.648331 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: admin,member,reader Oct 26 13:03:46.650743 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/54b7a09a3376404996026fe0636e7bed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/54b7a09a3376404996026fe0636e7bed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_54b7a09a3376404996026fe0636e7bed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/54b7a09a3376404996026fe0636e7bed"}]}] Oct 26 13:03:46.650743 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-578007312 Oct 26 13:03:46.650743 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 54b7a09a3376404996026fe0636e7bed Oct 26 13:03:46.650743 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-578007312 Oct 26 13:03:46.650743 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-578007312-project-admin Oct 26 13:03:46.650743 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:03:46.650743 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:03:46.650743 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 42be0a2640644e3782c971fc20bf7d15 Oct 26 13:03:46.650743 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-578007312-project-admin Oct 26 13:03:46.650743 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:03:46.650743 n-d-862686-1 devstack@n-api.service[120598]: exception: Invalid timestamp for date invalid_time Oct 26 13:03:46.651526 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'invalid_time'} Oct 26 13:03:46.651526 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:03:46.651526 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:46.651526 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 26 13:03:46.651526 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 26 13:03:46.651526 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 26 13:03:46.651526 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 26 13:03:46.651526 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 26 13:03:46.651526 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 26 13:03:46.651526 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 26 13:03:46.651526 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:46.651526 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:46.651526 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:46.651526 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:46.651526 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:46.651526 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:46.651526 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:03:46.651526 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:03:46.651526 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:03:46.651526 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:03:46.652901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 26 13:03:46.652901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 26 13:03:46.652901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 26 13:03:46.652901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:46.652901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:46.652901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:46.652901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:46.652901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:46.652901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:46.652901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:03:46.652901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:03:46.652901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 26 13:03:46.652901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:46.652901 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7bd4a5b3-3a20-4243-9364-b5e9b970ab44 tempest-InstanceUsageAuditLogNegativeTestJSON-578007312 tempest-InstanceUsageAuditLogNegativeTestJSON-578007312-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:03:46.652901 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7bd4a5b3-3a20-4243-9364-b5e9b970ab44 tempest-InstanceUsageAuditLogNegativeTestJSON-578007312 tempest-InstanceUsageAuditLogNegativeTestJSON-578007312-project-admin] 10.222.0.40 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.489289 Oct 26 13:03:46.659070 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 214/377] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Oct 26 13:03:46 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 496 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 26 13:03:46.667288 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-50372b39-a594-4ef7-a7fb-18c183297b88 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:46.673449 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-50372b39-a594-4ef7-a7fb-18c183297b88 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] [instance: ea0c61fb-9bc2-42d7-960e-4859c4e6f172] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:46.691484 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50372b39-a594-4ef7-a7fb-18c183297b88 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:46.692517 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50372b39-a594-4ef7-a7fb-18c183297b88 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:46.694328 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50372b39-a594-4ef7-a7fb-18c183297b88 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:46.694850 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50372b39-a594-4ef7-a7fb-18c183297b88 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:46.695799 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50372b39-a594-4ef7-a7fb-18c183297b88 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:46.695799 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50372b39-a594-4ef7-a7fb-18c183297b88 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:46.801500 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-50372b39-a594-4ef7-a7fb-18c183297b88 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c240bdb5dd7249c79d9620637d0c6e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81334bcb49d84a529558a88b02b6ef55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:46.810408 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-50372b39-a594-4ef7-a7fb-18c183297b88 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] 10.222.0.40 "GET /compute/v2.1/servers/ea0c61fb-9bc2-42d7-960e-4859c4e6f172" status: 200 len: 1278 microversion: 2.1 time: 0.149997 Oct 26 13:03:46.810987 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 215/378] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:46 2022] GET /compute/v2.1/servers/ea0c61fb-9bc2-42d7-960e-4859c4e6f172 => generated 1278 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:46.816178 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8b052a40-64a2-4684-8528-4294cb06c1e7 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:46.816850 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8b052a40-64a2-4684-8528-4294cb06c1e7 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] [instance: 380d16a8-2b4c-460b-9b36-884e7fb24812] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:46.823739 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b052a40-64a2-4684-8528-4294cb06c1e7 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:46.824482 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b052a40-64a2-4684-8528-4294cb06c1e7 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:46.825152 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b052a40-64a2-4684-8528-4294cb06c1e7 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:46.826203 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b052a40-64a2-4684-8528-4294cb06c1e7 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:46.826808 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b052a40-64a2-4684-8528-4294cb06c1e7 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:46.827384 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b052a40-64a2-4684-8528-4294cb06c1e7 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:46.949453 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f7e5e0f4-1d24-4311-9324-8f0ce97457ff tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999ac729ed1f4456857c8671d4b9be8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e2b56ef8db404ca0372e0a9c5f9b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:46.950170 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8b052a40-64a2-4684-8528-4294cb06c1e7 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] 10.222.0.40 "GET /compute/v2.1/servers/380d16a8-2b4c-460b-9b36-884e7fb24812/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.137465 Oct 26 13:03:46.951240 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 216/379] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 26 13:03:46 2022] GET /compute/v2.1/servers/380d16a8-2b4c-460b-9b36-884e7fb24812/os-interface => generated 284 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:46.975810 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f7e5e0f4-1d24-4311-9324-8f0ce97457ff tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] 10.222.0.40 "GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab" status: 200 len: 1318 microversion: 2.1 time: 0.360435 Oct 26 13:03:46.989508 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 164/380] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:46 2022] GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab => generated 1318 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:47.296181 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b85f4da1-8704-4285-9953-fe185993ae0a tempest-HypervisorAdminUnderV252Test-972237905 tempest-HypervisorAdminUnderV252Test-972237905-project-admin] Calling method '.version_select at 0x7f6733101f70>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:47.297777 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b85f4da1-8704-4285-9953-fe185993ae0a tempest-HypervisorAdminUnderV252Test-972237905 tempest-HypervisorAdminUnderV252Test-972237905-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:47.298277 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b85f4da1-8704-4285-9953-fe185993ae0a tempest-HypervisorAdminUnderV252Test-972237905 tempest-HypervisorAdminUnderV252Test-972237905-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:47.298766 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b85f4da1-8704-4285-9953-fe185993ae0a tempest-HypervisorAdminUnderV252Test-972237905 tempest-HypervisorAdminUnderV252Test-972237905-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:47.366043 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b85f4da1-8704-4285-9953-fe185993ae0a tempest-HypervisorAdminUnderV252Test-972237905 tempest-HypervisorAdminUnderV252Test-972237905-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:47.366706 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b85f4da1-8704-4285-9953-fe185993ae0a tempest-HypervisorAdminUnderV252Test-972237905 tempest-HypervisorAdminUnderV252Test-972237905-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:47.367846 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b85f4da1-8704-4285-9953-fe185993ae0a tempest-HypervisorAdminUnderV252Test-972237905 tempest-HypervisorAdminUnderV252Test-972237905-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:47.398135 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1e214a73-5163-4375-bf96-3442096006aa tempest-InstanceUsageAuditLogNegativeTestJSON-131587069 tempest-InstanceUsageAuditLogNegativeTestJSON-131587069-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:47.400372 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1e214a73-5163-4375-bf96-3442096006aa tempest-InstanceUsageAuditLogNegativeTestJSON-131587069 tempest-InstanceUsageAuditLogNegativeTestJSON-131587069-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '110f4b46ceb549388c0a0c4e8deb8ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465c42a414704f5bb6cdab34346e5f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:47.403022 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1e214a73-5163-4375-bf96-3442096006aa tempest-InstanceUsageAuditLogNegativeTestJSON-131587069 tempest-InstanceUsageAuditLogNegativeTestJSON-131587069-project] Request method failure captured: Oct 26 13:03:47.403022 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 26 13:03:47.403022 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:03:47.403022 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:03:47.403022 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:03:47.403022 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:03:47.403022 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:03:47.403022 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:03:47.403022 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:03:47.403022 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:03:47.403022 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTAwf62UudWh2tq3mww-8dUiR9zW2fHUDoBPKo1tmOGr0J2xbGBvVXBVybCzi8fmWFW9UNy18ON_LwBOO_ZPGIISmOzh5o9LwBK5eR6xA219CD8qzQqe2wYBIfxElD1ytO_jpA4tPS-ogI_EBevx2XiALMR7fv-5psoIJLvxgNsxidM Oct 26 13:03:47.403022 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:03:47.403022 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:03:47.403022 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:03:47.403022 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:03:47.403022 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:03:47.403022 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:03:47.403022 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 465c42a414704f5bb6cdab34346e5f86 Oct 26 13:03:47.403022 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-131587069 Oct 26 13:03:47.403022 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:03:47.403022 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:03:47.404311 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/465c42a414704f5bb6cdab34346e5f86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/465c42a414704f5bb6cdab34346e5f86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_465c42a414704f5bb6cdab34346e5f86"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/465c42a414704f5bb6cdab34346e5f86"}]}] Oct 26 13:03:47.404311 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-131587069 Oct 26 13:03:47.404311 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 465c42a414704f5bb6cdab34346e5f86 Oct 26 13:03:47.404311 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-131587069 Oct 26 13:03:47.404311 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-131587069-project Oct 26 13:03:47.404311 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:03:47.404311 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:03:47.404311 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 110f4b46ceb549388c0a0c4e8deb8ce8 Oct 26 13:03:47.404311 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-131587069-project Oct 26 13:03:47.404311 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:03:47.404907 n-d-862686-1 devstack@n-api.service[120598]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 26 13:03:47.404907 n-d-862686-1 devstack@n-api.service[120598]: action_args: {} Oct 26 13:03:47.404907 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:03:47.404907 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:47.404907 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:47.404907 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:47.404907 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:03:47.404907 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:03:47.404907 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:03:47.404907 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:03:47.404907 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 26 13:03:47.404907 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 26 13:03:47.404907 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 13:03:47.404907 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 13:03:47.404907 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 13:03:47.404907 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 13:03:47.404907 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 13:03:47.404907 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 13:03:47.404907 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 13:03:47.404907 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 13:03:47.406172 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 13:03:47.406172 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 13:03:47.406172 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 13:03:47.406172 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 13:03:47.406172 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 13:03:47.406172 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 13:03:47.406172 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 26 13:03:47.406172 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:47.406172 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:47.406172 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:47.406172 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:47.406172 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:47.406172 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:47.406172 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 13:03:47.406172 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 13:03:47.406172 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 26 13:03:47.406172 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:47.407226 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b85f4da1-8704-4285-9953-fe185993ae0a tempest-HypervisorAdminUnderV252Test-972237905 tempest-HypervisorAdminUnderV252Test-972237905-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:47.407226 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b85f4da1-8704-4285-9953-fe185993ae0a tempest-HypervisorAdminUnderV252Test-972237905 tempest-HypervisorAdminUnderV252Test-972237905-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:47.407226 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b85f4da1-8704-4285-9953-fe185993ae0a tempest-HypervisorAdminUnderV252Test-972237905 tempest-HypervisorAdminUnderV252Test-972237905-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:47.412023 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1e214a73-5163-4375-bf96-3442096006aa tempest-InstanceUsageAuditLogNegativeTestJSON-131587069 tempest-InstanceUsageAuditLogNegativeTestJSON-131587069-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:03:47.412784 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1e214a73-5163-4375-bf96-3442096006aa tempest-InstanceUsageAuditLogNegativeTestJSON-131587069 tempest-InstanceUsageAuditLogNegativeTestJSON-131587069-project] 10.222.0.40 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.459960 Oct 26 13:03:47.413506 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 217/381] 10.222.0.40 () {58 vars in 1185 bytes} [Wed Oct 26 13:03:46 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 461 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:03:47.427255 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-c8a32931-319c-4438-98a0-52085f460670 req-54bec70a-c416-49d1-a63a-3caa5b027daf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e395c36-3e81-4ca3-ab5c-a034d92f8288", "name": "network-vif-plugged", "status": "completed", "tag": "d76e25b3-751c-4d09-9c27-caeb06dd7081"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:47.438937 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b85f4da1-8704-4285-9953-fe185993ae0a tempest-HypervisorAdminUnderV252Test-972237905 tempest-HypervisorAdminUnderV252Test-972237905-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.449532 Oct 26 13:03:47.439851 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 165/382] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:03:46 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:47.456521 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-67c581bd-fbe4-4908-a32e-c37d6f2ccd4b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:47.458516 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-67c581bd-fbe4-4908-a32e-c37d6f2ccd4b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:47.461838 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-c8a32931-319c-4438-98a0-52085f460670 req-54bec70a-c416-49d1-a63a-3caa5b027daf service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:47.469714 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-c8a32931-319c-4438-98a0-52085f460670 req-54bec70a-c416-49d1-a63a-3caa5b027daf service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:47.470200 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-c8a32931-319c-4438-98a0-52085f460670 req-54bec70a-c416-49d1-a63a-3caa5b027daf service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:47.484664 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-67c581bd-fbe4-4908-a32e-c37d6f2ccd4b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:47.485154 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-67c581bd-fbe4-4908-a32e-c37d6f2ccd4b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:47.485624 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-67c581bd-fbe4-4908-a32e-c37d6f2ccd4b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:47.487239 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-67c581bd-fbe4-4908-a32e-c37d6f2ccd4b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:47.487849 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-67c581bd-fbe4-4908-a32e-c37d6f2ccd4b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:47.488421 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-67c581bd-fbe4-4908-a32e-c37d6f2ccd4b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:47.502100 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-c8a32931-319c-4438-98a0-52085f460670 req-54bec70a-c416-49d1-a63a-3caa5b027daf service nova] Creating event network-vif-plugged:d76e25b3-751c-4d09-9c27-caeb06dd7081 for instance 3e395c36-3e81-4ca3-ab5c-a034d92f8288 on n-h1-862686-1 Oct 26 13:03:47.511100 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-c8a32931-319c-4438-98a0-52085f460670 req-54bec70a-c416-49d1-a63a-3caa5b027daf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096288 Oct 26 13:03:47.514040 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 218/383] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:47.546595 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d23d488e-7c04-4acd-9003-be3b28c63832 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:47.547816 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d23d488e-7c04-4acd-9003-be3b28c63832 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3e395c36-3e81-4ca3-ab5c-a034d92f8288] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:47.573589 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d23d488e-7c04-4acd-9003-be3b28c63832 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:47.574465 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d23d488e-7c04-4acd-9003-be3b28c63832 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:47.575135 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d23d488e-7c04-4acd-9003-be3b28c63832 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:47.576064 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d23d488e-7c04-4acd-9003-be3b28c63832 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:47.576989 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d23d488e-7c04-4acd-9003-be3b28c63832 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:47.577691 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d23d488e-7c04-4acd-9003-be3b28c63832 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:47.947676 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-67c581bd-fbe4-4908-a32e-c37d6f2ccd4b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:47.965303 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-67c581bd-fbe4-4908-a32e-c37d6f2ccd4b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1475 microversion: 2.1 time: 0.522921 Oct 26 13:03:47.968169 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 166/384] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:47 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1475 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:47.977580 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0581686d-353d-4f13-b9e9-07814aa701c8 tempest-InstanceUsageAuditLogNegativeTestJSON-131587069 tempest-InstanceUsageAuditLogNegativeTestJSON-131587069-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:47.979822 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0581686d-353d-4f13-b9e9-07814aa701c8 tempest-InstanceUsageAuditLogNegativeTestJSON-131587069 tempest-InstanceUsageAuditLogNegativeTestJSON-131587069-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '110f4b46ceb549388c0a0c4e8deb8ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465c42a414704f5bb6cdab34346e5f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:47.981949 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0581686d-353d-4f13-b9e9-07814aa701c8 tempest-InstanceUsageAuditLogNegativeTestJSON-131587069 tempest-InstanceUsageAuditLogNegativeTestJSON-131587069-project] Request method failure captured: Oct 26 13:03:47.981949 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-26%2013:03:47 HTTP/1.1 Oct 26 13:03:47.981949 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:03:47.981949 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:03:47.981949 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:03:47.981949 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:03:47.981949 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:03:47.981949 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:03:47.981949 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:03:47.981949 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:03:47.981949 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTAwf62UudWh2tq3mww-8dUiR9zW2fHUDoBPKo1tmOGr0J2xbGBvVXBVybCzi8fmWFW9UNy18ON_LwBOO_ZPGIISmOzh5o9LwBK5eR6xA219CD8qzQqe2wYBIfxElD1ytO_jpA4tPS-ogI_EBevx2XiALMR7fv-5psoIJLvxgNsxidM Oct 26 13:03:47.981949 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:03:47.981949 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:03:47.981949 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:03:47.981949 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:03:47.981949 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:03:47.981949 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:03:47.981949 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 465c42a414704f5bb6cdab34346e5f86 Oct 26 13:03:47.981949 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-131587069 Oct 26 13:03:47.981949 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:03:47.981949 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:03:47.983243 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/465c42a414704f5bb6cdab34346e5f86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/465c42a414704f5bb6cdab34346e5f86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_465c42a414704f5bb6cdab34346e5f86"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/465c42a414704f5bb6cdab34346e5f86"}]}] Oct 26 13:03:47.983243 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-131587069 Oct 26 13:03:47.983243 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 465c42a414704f5bb6cdab34346e5f86 Oct 26 13:03:47.983243 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-131587069 Oct 26 13:03:47.983243 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-131587069-project Oct 26 13:03:47.983243 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:03:47.983243 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:03:47.983243 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 110f4b46ceb549388c0a0c4e8deb8ce8 Oct 26 13:03:47.983243 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-131587069-project Oct 26 13:03:47.983243 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:03:47.983783 n-d-862686-1 devstack@n-api.service[120597]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 26 13:03:47.983783 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '2022-10-26 13:03:47'} Oct 26 13:03:47.983783 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:03:47.983783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:47.983783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:47.983783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:47.983783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:03:47.983783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:03:47.983783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:03:47.983783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:03:47.983783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 26 13:03:47.983783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 26 13:03:47.983783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 13:03:47.983783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 13:03:47.983783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 13:03:47.983783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 13:03:47.983783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 13:03:47.983783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 13:03:47.983783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 13:03:47.983783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 13:03:47.984959 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 13:03:47.984959 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 13:03:47.984959 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 13:03:47.984959 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 13:03:47.984959 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 13:03:47.984959 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 13:03:47.984959 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 26 13:03:47.984959 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:03:47.984959 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:47.984959 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:03:47.984959 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:47.984959 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:47.984959 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:47.984959 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 13:03:47.984959 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 13:03:47.984959 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 26 13:03:47.984959 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:03:47.988108 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0581686d-353d-4f13-b9e9-07814aa701c8 tempest-InstanceUsageAuditLogNegativeTestJSON-131587069 tempest-InstanceUsageAuditLogNegativeTestJSON-131587069-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:03:47.989459 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0581686d-353d-4f13-b9e9-07814aa701c8 tempest-InstanceUsageAuditLogNegativeTestJSON-131587069 tempest-InstanceUsageAuditLogNegativeTestJSON-131587069-project] 10.222.0.40 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-26 13:03:47" status: 403 len: 128 microversion: 2.1 time: 0.020050 Oct 26 13:03:47.990202 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 167/385] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Oct 26 13:03:47 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-26%2013%3A03%3A47 => generated 128 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:03:47.999427 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-34734bf5-9d51-4137-ad2e-cb153c524b52 tempest-HypervisorAdminUnderV252Test-972237905 tempest-HypervisorAdminUnderV252Test-972237905-project-admin] Calling method '.version_select at 0x7f67331388b0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:48.001457 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-34734bf5-9d51-4137-ad2e-cb153c524b52 tempest-HypervisorAdminUnderV252Test-972237905 tempest-HypervisorAdminUnderV252Test-972237905-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:48.002240 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-34734bf5-9d51-4137-ad2e-cb153c524b52 tempest-HypervisorAdminUnderV252Test-972237905 tempest-HypervisorAdminUnderV252Test-972237905-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:48.004023 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-34734bf5-9d51-4137-ad2e-cb153c524b52 tempest-HypervisorAdminUnderV252Test-972237905 tempest-HypervisorAdminUnderV252Test-972237905-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:48.030379 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-34734bf5-9d51-4137-ad2e-cb153c524b52 tempest-HypervisorAdminUnderV252Test-972237905 tempest-HypervisorAdminUnderV252Test-972237905-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:48.030886 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-34734bf5-9d51-4137-ad2e-cb153c524b52 tempest-HypervisorAdminUnderV252Test-972237905 tempest-HypervisorAdminUnderV252Test-972237905-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:48.031326 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-34734bf5-9d51-4137-ad2e-cb153c524b52 tempest-HypervisorAdminUnderV252Test-972237905 tempest-HypervisorAdminUnderV252Test-972237905-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:48.060742 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-34734bf5-9d51-4137-ad2e-cb153c524b52 tempest-HypervisorAdminUnderV252Test-972237905 tempest-HypervisorAdminUnderV252Test-972237905-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:48.061467 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-34734bf5-9d51-4137-ad2e-cb153c524b52 tempest-HypervisorAdminUnderV252Test-972237905 tempest-HypervisorAdminUnderV252Test-972237905-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:48.062390 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-34734bf5-9d51-4137-ad2e-cb153c524b52 tempest-HypervisorAdminUnderV252Test-972237905 tempest-HypervisorAdminUnderV252Test-972237905-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:48.071099 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-34734bf5-9d51-4137-ad2e-cb153c524b52 tempest-HypervisorAdminUnderV252Test-972237905 tempest-HypervisorAdminUnderV252Test-972237905-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/n-h2-862686-1/servers" status: 200 len: 354 microversion: 2.1 time: 0.079209 Oct 26 13:03:48.072885 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 168/386] 10.222.0.40 () {58 vars in 1212 bytes} [Wed Oct 26 13:03:47 2022] GET /compute/v2.1/os-hypervisors/n-h2-862686-1/servers => generated 354 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:48.078816 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0b694b27-3315-4d81-a6a9-e5cdefc9cac0 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:48.079861 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0b694b27-3315-4d81-a6a9-e5cdefc9cac0 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] [instance: ea0c61fb-9bc2-42d7-960e-4859c4e6f172] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:48.090196 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b694b27-3315-4d81-a6a9-e5cdefc9cac0 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:48.090894 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b694b27-3315-4d81-a6a9-e5cdefc9cac0 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:48.091527 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b694b27-3315-4d81-a6a9-e5cdefc9cac0 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:48.092217 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b694b27-3315-4d81-a6a9-e5cdefc9cac0 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:48.092660 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b694b27-3315-4d81-a6a9-e5cdefc9cac0 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:48.093249 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b694b27-3315-4d81-a6a9-e5cdefc9cac0 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:48.386507 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d23d488e-7c04-4acd-9003-be3b28c63832 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:48.397993 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d23d488e-7c04-4acd-9003-be3b28c63832 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:48.403837 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d23d488e-7c04-4acd-9003-be3b28c63832 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:48.405339 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d23d488e-7c04-4acd-9003-be3b28c63832 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288" status: 200 len: 1361 microversion: 2.25 time: 0.888724 Oct 26 13:03:48.408836 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0b694b27-3315-4d81-a6a9-e5cdefc9cac0 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c240bdb5dd7249c79d9620637d0c6e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81334bcb49d84a529558a88b02b6ef55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:48.417405 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0b694b27-3315-4d81-a6a9-e5cdefc9cac0 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] 10.222.0.40 "GET /compute/v2.1/servers/ea0c61fb-9bc2-42d7-960e-4859c4e6f172" status: 200 len: 1320 microversion: 2.1 time: 0.343207 Oct 26 13:03:48.422327 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 219/387] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:03:47 2022] GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288 => generated 1361 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:03:48.434135 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 169/388] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:48 2022] GET /compute/v2.1/servers/ea0c61fb-9bc2-42d7-960e-4859c4e6f172 => generated 1320 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:48.436408 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fe1b81c0-3fe2-4a79-bf0c-9b96286e3e0c tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:48.437328 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fe1b81c0-3fe2-4a79-bf0c-9b96286e3e0c tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] [instance: 3b17e574-b449-4b57-b82d-82303ec940ab] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:48.450773 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe1b81c0-3fe2-4a79-bf0c-9b96286e3e0c tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:48.450937 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a878c59d-ab0b-4fcd-b2eb-eaddf7314532 tempest-HypervisorAdminUnderV252Test-972237905 tempest-HypervisorAdminUnderV252Test-972237905-project-admin] Calling method '.version_select at 0x7f6733101670>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:48.452854 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a878c59d-ab0b-4fcd-b2eb-eaddf7314532 tempest-HypervisorAdminUnderV252Test-972237905 tempest-HypervisorAdminUnderV252Test-972237905-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:48.453341 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a878c59d-ab0b-4fcd-b2eb-eaddf7314532 tempest-HypervisorAdminUnderV252Test-972237905 tempest-HypervisorAdminUnderV252Test-972237905-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:48.453820 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a878c59d-ab0b-4fcd-b2eb-eaddf7314532 tempest-HypervisorAdminUnderV252Test-972237905 tempest-HypervisorAdminUnderV252Test-972237905-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:48.453962 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe1b81c0-3fe2-4a79-bf0c-9b96286e3e0c tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:48.454471 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe1b81c0-3fe2-4a79-bf0c-9b96286e3e0c tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:48.457651 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe1b81c0-3fe2-4a79-bf0c-9b96286e3e0c tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:48.458199 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe1b81c0-3fe2-4a79-bf0c-9b96286e3e0c tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:48.458702 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe1b81c0-3fe2-4a79-bf0c-9b96286e3e0c tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:48.477334 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a878c59d-ab0b-4fcd-b2eb-eaddf7314532 tempest-HypervisorAdminUnderV252Test-972237905 tempest-HypervisorAdminUnderV252Test-972237905-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:48.478427 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a878c59d-ab0b-4fcd-b2eb-eaddf7314532 tempest-HypervisorAdminUnderV252Test-972237905 tempest-HypervisorAdminUnderV252Test-972237905-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:48.479041 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a878c59d-ab0b-4fcd-b2eb-eaddf7314532 tempest-HypervisorAdminUnderV252Test-972237905 tempest-HypervisorAdminUnderV252Test-972237905-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:48.489277 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a878c59d-ab0b-4fcd-b2eb-eaddf7314532 tempest-HypervisorAdminUnderV252Test-972237905 tempest-HypervisorAdminUnderV252Test-972237905-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:48.489799 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a878c59d-ab0b-4fcd-b2eb-eaddf7314532 tempest-HypervisorAdminUnderV252Test-972237905 tempest-HypervisorAdminUnderV252Test-972237905-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:48.490240 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a878c59d-ab0b-4fcd-b2eb-eaddf7314532 tempest-HypervisorAdminUnderV252Test-972237905 tempest-HypervisorAdminUnderV252Test-972237905-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:48.497129 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a878c59d-ab0b-4fcd-b2eb-eaddf7314532 tempest-HypervisorAdminUnderV252Test-972237905 tempest-HypervisorAdminUnderV252Test-972237905-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.061780 Oct 26 13:03:48.498296 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 170/389] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:03:48 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:48.508532 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-82c890ed-aeb7-44ac-b985-9d5d8bc2bf45 tempest-HypervisorAdminUnderV252Test-972237905 tempest-HypervisorAdminUnderV252Test-972237905-project-admin] Calling method '.version_select at 0x7f67330bb4c0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:48.511333 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-82c890ed-aeb7-44ac-b985-9d5d8bc2bf45 tempest-HypervisorAdminUnderV252Test-972237905 tempest-HypervisorAdminUnderV252Test-972237905-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:48.512221 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-82c890ed-aeb7-44ac-b985-9d5d8bc2bf45 tempest-HypervisorAdminUnderV252Test-972237905 tempest-HypervisorAdminUnderV252Test-972237905-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:48.513164 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-82c890ed-aeb7-44ac-b985-9d5d8bc2bf45 tempest-HypervisorAdminUnderV252Test-972237905 tempest-HypervisorAdminUnderV252Test-972237905-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:48.526831 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-82c890ed-aeb7-44ac-b985-9d5d8bc2bf45 tempest-HypervisorAdminUnderV252Test-972237905 tempest-HypervisorAdminUnderV252Test-972237905-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:48.527424 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-82c890ed-aeb7-44ac-b985-9d5d8bc2bf45 tempest-HypervisorAdminUnderV252Test-972237905 tempest-HypervisorAdminUnderV252Test-972237905-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:48.527925 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-82c890ed-aeb7-44ac-b985-9d5d8bc2bf45 tempest-HypervisorAdminUnderV252Test-972237905 tempest-HypervisorAdminUnderV252Test-972237905-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:48.534894 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-82c890ed-aeb7-44ac-b985-9d5d8bc2bf45 tempest-HypervisorAdminUnderV252Test-972237905 tempest-HypervisorAdminUnderV252Test-972237905-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/n-h2-862686-1/search" status: 200 len: 104 microversion: 2.1 time: 0.030463 Oct 26 13:03:48.536016 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 171/390] 10.222.0.40 () {58 vars in 1209 bytes} [Wed Oct 26 13:03:48 2022] GET /compute/v2.1/os-hypervisors/n-h2-862686-1/search => generated 104 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:03:48.575292 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-fd177aa2-3109-4935-b720-7215169f83f3 req-94a64094-edd1-40d5-9126-238f66ef2227 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea0c61fb-9bc2-42d7-960e-4859c4e6f172", "tag": "5c755cc5-72dd-4533-95c4-5ccec85cb869"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:48.590254 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-fd177aa2-3109-4935-b720-7215169f83f3 req-94a64094-edd1-40d5-9126-238f66ef2227 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:48.591557 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-fd177aa2-3109-4935-b720-7215169f83f3 req-94a64094-edd1-40d5-9126-238f66ef2227 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:48.592304 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-fd177aa2-3109-4935-b720-7215169f83f3 req-94a64094-edd1-40d5-9126-238f66ef2227 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:48.606174 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-fd177aa2-3109-4935-b720-7215169f83f3 req-94a64094-edd1-40d5-9126-238f66ef2227 service nova] Creating event network-changed:5c755cc5-72dd-4533-95c4-5ccec85cb869 for instance ea0c61fb-9bc2-42d7-960e-4859c4e6f172 on n-h2-862686-1 Oct 26 13:03:48.612536 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-fd177aa2-3109-4935-b720-7215169f83f3 req-94a64094-edd1-40d5-9126-238f66ef2227 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046442 Oct 26 13:03:48.614070 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 172/391] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:48.898000 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fe1b81c0-3fe2-4a79-bf0c-9b96286e3e0c tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999ac729ed1f4456857c8671d4b9be8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e2b56ef8db404ca0372e0a9c5f9b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:48.914358 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fe1b81c0-3fe2-4a79-bf0c-9b96286e3e0c tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] 10.222.0.40 "GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab" status: 200 len: 1318 microversion: 2.1 time: 0.488949 Oct 26 13:03:48.915951 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 220/392] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:48 2022] GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab => generated 1318 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:48.995814 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e0ddf362-e520-4e7a-9f8f-250b7195c317 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:48.996874 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e0ddf362-e520-4e7a-9f8f-250b7195c317 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:49.003177 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e0ddf362-e520-4e7a-9f8f-250b7195c317 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:49.003767 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e0ddf362-e520-4e7a-9f8f-250b7195c317 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:49.004426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e0ddf362-e520-4e7a-9f8f-250b7195c317 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:49.005427 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e0ddf362-e520-4e7a-9f8f-250b7195c317 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:49.006141 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e0ddf362-e520-4e7a-9f8f-250b7195c317 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:49.006637 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e0ddf362-e520-4e7a-9f8f-250b7195c317 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:49.253290 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e0ddf362-e520-4e7a-9f8f-250b7195c317 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:49.262031 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e0ddf362-e520-4e7a-9f8f-250b7195c317 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1475 microversion: 2.1 time: 0.270987 Oct 26 13:03:49.264073 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 173/393] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:48 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1475 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:49.436244 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b26772a2-79c7-434a-90ac-652aa91dacfb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:49.437694 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b26772a2-79c7-434a-90ac-652aa91dacfb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3e395c36-3e81-4ca3-ab5c-a034d92f8288] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:49.452566 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9e3f7a4e-a965-40c1-8c9c-285b24e59994 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:49.453834 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9e3f7a4e-a965-40c1-8c9c-285b24e59994 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] [instance: ea0c61fb-9bc2-42d7-960e-4859c4e6f172] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:49.460854 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b26772a2-79c7-434a-90ac-652aa91dacfb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:49.461674 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b26772a2-79c7-434a-90ac-652aa91dacfb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:49.464906 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9e3f7a4e-a965-40c1-8c9c-285b24e59994 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:49.465786 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b26772a2-79c7-434a-90ac-652aa91dacfb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:49.466618 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b26772a2-79c7-434a-90ac-652aa91dacfb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:49.467289 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b26772a2-79c7-434a-90ac-652aa91dacfb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:49.468168 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b26772a2-79c7-434a-90ac-652aa91dacfb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:49.471213 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9e3f7a4e-a965-40c1-8c9c-285b24e59994 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:49.472036 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9e3f7a4e-a965-40c1-8c9c-285b24e59994 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:49.472953 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9e3f7a4e-a965-40c1-8c9c-285b24e59994 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:49.489711 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9e3f7a4e-a965-40c1-8c9c-285b24e59994 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:49.490262 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9e3f7a4e-a965-40c1-8c9c-285b24e59994 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:49.718974 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b26772a2-79c7-434a-90ac-652aa91dacfb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:49.728167 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b26772a2-79c7-434a-90ac-652aa91dacfb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:49.731852 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b26772a2-79c7-434a-90ac-652aa91dacfb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:49.739589 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b26772a2-79c7-434a-90ac-652aa91dacfb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288" status: 200 len: 1556 microversion: 2.25 time: 0.302081 Oct 26 13:03:49.740799 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 221/394] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:03:49 2022] GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288 => generated 1556 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:03:49.750519 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a979b615-4565-417b-84c5-78c727b79bbf tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:49.757467 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a979b615-4565-417b-84c5-78c727b79bbf tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] [instance: 380d16a8-2b4c-460b-9b36-884e7fb24812] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:49.780329 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a979b615-4565-417b-84c5-78c727b79bbf tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:49.780832 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a979b615-4565-417b-84c5-78c727b79bbf tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:49.781294 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a979b615-4565-417b-84c5-78c727b79bbf tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:49.784093 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a979b615-4565-417b-84c5-78c727b79bbf tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:49.785256 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a979b615-4565-417b-84c5-78c727b79bbf tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:49.787030 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a979b615-4565-417b-84c5-78c727b79bbf tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:49.827025 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9e3f7a4e-a965-40c1-8c9c-285b24e59994 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c240bdb5dd7249c79d9620637d0c6e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81334bcb49d84a529558a88b02b6ef55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:49.838892 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9e3f7a4e-a965-40c1-8c9c-285b24e59994 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] 10.222.0.40 "GET /compute/v2.1/servers/ea0c61fb-9bc2-42d7-960e-4859c4e6f172" status: 200 len: 1320 microversion: 2.1 time: 0.394499 Oct 26 13:03:49.854872 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 174/395] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:49 2022] GET /compute/v2.1/servers/ea0c61fb-9bc2-42d7-960e-4859c4e6f172 => generated 1320 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:49.861364 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-d7b1aecb-148b-4960-8680-99b2c5cdbee4 req-4bc7df1e-9206-4788-b65b-dacdb56fc4b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "380d16a8-2b4c-460b-9b36-884e7fb24812", "tag": "5b05c6bb-7da5-41d5-bafd-a4735efff806"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:49.872141 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d7b1aecb-148b-4960-8680-99b2c5cdbee4 req-4bc7df1e-9206-4788-b65b-dacdb56fc4b4 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:49.872618 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d7b1aecb-148b-4960-8680-99b2c5cdbee4 req-4bc7df1e-9206-4788-b65b-dacdb56fc4b4 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:49.873046 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d7b1aecb-148b-4960-8680-99b2c5cdbee4 req-4bc7df1e-9206-4788-b65b-dacdb56fc4b4 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:49.892110 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-d7b1aecb-148b-4960-8680-99b2c5cdbee4 req-4bc7df1e-9206-4788-b65b-dacdb56fc4b4 service nova] Creating event network-changed:5b05c6bb-7da5-41d5-bafd-a4735efff806 for instance 380d16a8-2b4c-460b-9b36-884e7fb24812 on n-h2-862686-1 Oct 26 13:03:49.907344 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-d7b1aecb-148b-4960-8680-99b2c5cdbee4 req-4bc7df1e-9206-4788-b65b-dacdb56fc4b4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051139 Oct 26 13:03:49.909172 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 175/396] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:49.914642 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-e7184bd8-38ea-4262-9fc4-9433ecd65d64 req-fad12c1b-d44a-44e4-a8c4-9fd24717c2bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b17e574-b449-4b57-b82d-82303ec940ab", "name": "network-vif-plugged", "status": "completed", "tag": "90575c26-418d-4416-b33a-4e61e0fa2a53"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:49.933938 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-e7184bd8-38ea-4262-9fc4-9433ecd65d64 req-fad12c1b-d44a-44e4-a8c4-9fd24717c2bc service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:49.935834 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-e7184bd8-38ea-4262-9fc4-9433ecd65d64 req-fad12c1b-d44a-44e4-a8c4-9fd24717c2bc service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:49.943372 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-e7184bd8-38ea-4262-9fc4-9433ecd65d64 req-fad12c1b-d44a-44e4-a8c4-9fd24717c2bc service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:49.966170 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-e7184bd8-38ea-4262-9fc4-9433ecd65d64 req-fad12c1b-d44a-44e4-a8c4-9fd24717c2bc service nova] Creating event network-vif-plugged:90575c26-418d-4416-b33a-4e61e0fa2a53 for instance 3b17e574-b449-4b57-b82d-82303ec940ab on n-h2-862686-1 Oct 26 13:03:49.975614 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-e7184bd8-38ea-4262-9fc4-9433ecd65d64 req-fad12c1b-d44a-44e4-a8c4-9fd24717c2bc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062902 Oct 26 13:03:49.976778 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 176/397] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:50.008228 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a979b615-4565-417b-84c5-78c727b79bbf tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f9391046054747bbfc1c3e6d65d4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10521abb1c34417fa9369aaba9070968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:50.019593 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a979b615-4565-417b-84c5-78c727b79bbf tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] 10.222.0.40 "GET /compute/v2.1/servers/380d16a8-2b4c-460b-9b36-884e7fb24812" status: 200 len: 1586 microversion: 2.1 time: 0.277176 Oct 26 13:03:50.021238 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 222/398] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:49 2022] GET /compute/v2.1/servers/380d16a8-2b4c-460b-9b36-884e7fb24812 => generated 1586 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:50.029901 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b3a417f2-5ec3-4aa2-aa72-e12c07723d42 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:50.030864 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b3a417f2-5ec3-4aa2-aa72-e12c07723d42 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] [instance: 3b17e574-b449-4b57-b82d-82303ec940ab] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:50.038234 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3a417f2-5ec3-4aa2-aa72-e12c07723d42 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:50.039232 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3a417f2-5ec3-4aa2-aa72-e12c07723d42 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:50.040036 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3a417f2-5ec3-4aa2-aa72-e12c07723d42 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:50.041629 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3a417f2-5ec3-4aa2-aa72-e12c07723d42 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:50.042130 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3a417f2-5ec3-4aa2-aa72-e12c07723d42 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:50.042543 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3a417f2-5ec3-4aa2-aa72-e12c07723d42 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:50.513666 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b3a417f2-5ec3-4aa2-aa72-e12c07723d42 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999ac729ed1f4456857c8671d4b9be8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e2b56ef8db404ca0372e0a9c5f9b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:50.521893 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b3a417f2-5ec3-4aa2-aa72-e12c07723d42 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] 10.222.0.40 "GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab" status: 200 len: 1318 microversion: 2.1 time: 0.499025 Oct 26 13:03:50.538407 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 223/399] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:50 2022] GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab => generated 1318 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:50.547189 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=14 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:03:50.549096 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7f674c11-c0db-4b5c-a86d-302f6111ffb7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:50.549926 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7f674c11-c0db-4b5c-a86d-302f6111ffb7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:50.559480 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f674c11-c0db-4b5c-a86d-302f6111ffb7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:50.560325 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f674c11-c0db-4b5c-a86d-302f6111ffb7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:50.560969 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f674c11-c0db-4b5c-a86d-302f6111ffb7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:50.562041 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f674c11-c0db-4b5c-a86d-302f6111ffb7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:50.562710 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f674c11-c0db-4b5c-a86d-302f6111ffb7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:50.563221 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f674c11-c0db-4b5c-a86d-302f6111ffb7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:50.616406 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=46 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:03:50.724679 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c16b4430-ce11-43a2-a138-b508b73b2142 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:50.725384 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c16b4430-ce11-43a2-a138-b508b73b2142 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] [instance: 3e395c36-3e81-4ca3-ab5c-a034d92f8288] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:50.733309 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c16b4430-ce11-43a2-a138-b508b73b2142 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:50.734277 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c16b4430-ce11-43a2-a138-b508b73b2142 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:50.735083 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c16b4430-ce11-43a2-a138-b508b73b2142 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:50.735931 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c16b4430-ce11-43a2-a138-b508b73b2142 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:50.736532 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c16b4430-ce11-43a2-a138-b508b73b2142 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:50.737103 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c16b4430-ce11-43a2-a138-b508b73b2142 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:50.976376 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7f674c11-c0db-4b5c-a86d-302f6111ffb7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:50.984921 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7f674c11-c0db-4b5c-a86d-302f6111ffb7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1475 microversion: 2.1 time: 0.444599 Oct 26 13:03:50.998379 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 224/400] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:50 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1475 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:51.013092 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fa907221-136b-4028-b7ed-3c13b95c4a3b tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:51.014100 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fa907221-136b-4028-b7ed-3c13b95c4a3b tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] [instance: ea0c61fb-9bc2-42d7-960e-4859c4e6f172] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:51.021286 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa907221-136b-4028-b7ed-3c13b95c4a3b tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:51.022277 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa907221-136b-4028-b7ed-3c13b95c4a3b tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:51.022934 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa907221-136b-4028-b7ed-3c13b95c4a3b tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:51.024084 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa907221-136b-4028-b7ed-3c13b95c4a3b tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:51.025015 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa907221-136b-4028-b7ed-3c13b95c4a3b tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:51.025740 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa907221-136b-4028-b7ed-3c13b95c4a3b tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:51.249985 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fa907221-136b-4028-b7ed-3c13b95c4a3b tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c240bdb5dd7249c79d9620637d0c6e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81334bcb49d84a529558a88b02b6ef55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:51.264249 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fa907221-136b-4028-b7ed-3c13b95c4a3b tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] 10.222.0.40 "GET /compute/v2.1/servers/ea0c61fb-9bc2-42d7-960e-4859c4e6f172" status: 200 len: 1320 microversion: 2.1 time: 0.264404 Oct 26 13:03:51.265959 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 225/401] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:50 2022] GET /compute/v2.1/servers/ea0c61fb-9bc2-42d7-960e-4859c4e6f172 => generated 1320 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:51.527237 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-c16b4430-ce11-43a2-a138-b508b73b2142 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lazy-loading 'services' on Instance uuid 3e395c36-3e81-4ca3-ab5c-a034d92f8288 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:03:51.550547 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9db4e63a-d78d-4edc-8ed2-02b4f0186d52 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:51.551863 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9db4e63a-d78d-4edc-8ed2-02b4f0186d52 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] [instance: 3b17e574-b449-4b57-b82d-82303ec940ab] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:51.566500 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9db4e63a-d78d-4edc-8ed2-02b4f0186d52 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:51.567191 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9db4e63a-d78d-4edc-8ed2-02b4f0186d52 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:51.569624 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9db4e63a-d78d-4edc-8ed2-02b4f0186d52 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:51.570408 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9db4e63a-d78d-4edc-8ed2-02b4f0186d52 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:51.570873 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9db4e63a-d78d-4edc-8ed2-02b4f0186d52 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:51.571326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9db4e63a-d78d-4edc-8ed2-02b4f0186d52 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:51.626308 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c16b4430-ce11-43a2-a138-b508b73b2142 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288" status: 200 len: 2048 microversion: 2.25 time: 1.646731 Oct 26 13:03:51.650668 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 177/402] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:03:49 2022] GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288 => generated 2048 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:03:51.667346 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1232dcc4-b4f8-4d4c-a9ac-3563ff1e07c5 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:51.667346 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1232dcc4-b4f8-4d4c-a9ac-3563ff1e07c5 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] [instance: 3e395c36-3e81-4ca3-ab5c-a034d92f8288] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:51.674632 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1232dcc4-b4f8-4d4c-a9ac-3563ff1e07c5 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:51.675271 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1232dcc4-b4f8-4d4c-a9ac-3563ff1e07c5 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:51.675722 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1232dcc4-b4f8-4d4c-a9ac-3563ff1e07c5 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:51.676578 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1232dcc4-b4f8-4d4c-a9ac-3563ff1e07c5 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:51.677047 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1232dcc4-b4f8-4d4c-a9ac-3563ff1e07c5 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:51.677495 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1232dcc4-b4f8-4d4c-a9ac-3563ff1e07c5 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:51.846640 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9db4e63a-d78d-4edc-8ed2-02b4f0186d52 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999ac729ed1f4456857c8671d4b9be8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e2b56ef8db404ca0372e0a9c5f9b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:51.857406 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9db4e63a-d78d-4edc-8ed2-02b4f0186d52 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] 10.222.0.40 "GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab" status: 200 len: 1318 microversion: 2.1 time: 0.312394 Oct 26 13:03:51.875657 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 226/403] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:51 2022] GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab => generated 1318 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:52.017655 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3abfc608-5637-41cb-bc3e-9af2dc9706f7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:52.018694 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3abfc608-5637-41cb-bc3e-9af2dc9706f7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:52.036421 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3abfc608-5637-41cb-bc3e-9af2dc9706f7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:52.037145 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3abfc608-5637-41cb-bc3e-9af2dc9706f7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:52.038021 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3abfc608-5637-41cb-bc3e-9af2dc9706f7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:52.039559 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3abfc608-5637-41cb-bc3e-9af2dc9706f7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:52.043562 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3abfc608-5637-41cb-bc3e-9af2dc9706f7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:52.045955 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3abfc608-5637-41cb-bc3e-9af2dc9706f7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:52.152468 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-1232dcc4-b4f8-4d4c-a9ac-3563ff1e07c5 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lazy-loading 'services' on Instance uuid 3e395c36-3e81-4ca3-ab5c-a034d92f8288 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:03:52.180225 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1232dcc4-b4f8-4d4c-a9ac-3563ff1e07c5 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288" status: 200 len: 2048 microversion: 2.25 time: 0.519007 Oct 26 13:03:52.182400 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 178/404] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:03:51 2022] GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288 => generated 2048 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:03:52.208593 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-254951b5-bd28-4ada-8ca8-b0e38df220f6 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:52.213975 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-254951b5-bd28-4ada-8ca8-b0e38df220f6 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:52.214663 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-254951b5-bd28-4ada-8ca8-b0e38df220f6 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:52.215289 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-254951b5-bd28-4ada-8ca8-b0e38df220f6 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:52.216172 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-254951b5-bd28-4ada-8ca8-b0e38df220f6 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:52.216770 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-254951b5-bd28-4ada-8ca8-b0e38df220f6 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:52.217331 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-254951b5-bd28-4ada-8ca8-b0e38df220f6 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:52.241834 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:03:52.257192 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-254951b5-bd28-4ada-8ca8-b0e38df220f6 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.052465 Oct 26 13:03:52.268020 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 179/405] 10.222.0.40 () {60 vars in 1217 bytes} [Wed Oct 26 13:03:52 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:03:52.273787 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3253a071-a519-444c-979c-363199666820 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862686-1", "block_migration": "auto"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:52.277535 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3253a071-a519-444c-979c-363199666820 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] [instance: 3e395c36-3e81-4ca3-ab5c-a034d92f8288] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:52.286078 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3253a071-a519-444c-979c-363199666820 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:52.286531 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3253a071-a519-444c-979c-363199666820 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:52.287001 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3253a071-a519-444c-979c-363199666820 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:52.287987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3253a071-a519-444c-979c-363199666820 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:52.288420 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3253a071-a519-444c-979c-363199666820 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:52.288851 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3253a071-a519-444c-979c-363199666820 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:52.312067 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3abfc608-5637-41cb-bc3e-9af2dc9706f7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:52.329525 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3abfc608-5637-41cb-bc3e-9af2dc9706f7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1475 microversion: 2.1 time: 0.315852 Oct 26 13:03:52.337964 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 227/406] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:52 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1475 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:52.348746 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e72b5c87-dc2a-4b2c-8a72-06c20433cb48 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:52.358331 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e72b5c87-dc2a-4b2c-8a72-06c20433cb48 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] [instance: ea0c61fb-9bc2-42d7-960e-4859c4e6f172] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:52.371911 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e72b5c87-dc2a-4b2c-8a72-06c20433cb48 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:52.372559 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e72b5c87-dc2a-4b2c-8a72-06c20433cb48 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:52.373124 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e72b5c87-dc2a-4b2c-8a72-06c20433cb48 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:52.373973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e72b5c87-dc2a-4b2c-8a72-06c20433cb48 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:52.374753 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e72b5c87-dc2a-4b2c-8a72-06c20433cb48 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:52.375429 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e72b5c87-dc2a-4b2c-8a72-06c20433cb48 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:52.379666 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-3253a071-a519-444c-979c-363199666820 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lazy-loading 'flavor' on Instance uuid 3e395c36-3e81-4ca3-ab5c-a034d92f8288 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:03:52.441915 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3253a071-a519-444c-979c-363199666820 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] [instance: 3e395c36-3e81-4ca3-ab5c-a034d92f8288] Going to try to live migrate instance to n-h2-862686-1 {{(pid=120597) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 26 13:03:52.573652 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e72b5c87-dc2a-4b2c-8a72-06c20433cb48 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c240bdb5dd7249c79d9620637d0c6e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81334bcb49d84a529558a88b02b6ef55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:52.583265 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:03:52.583574 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e72b5c87-dc2a-4b2c-8a72-06c20433cb48 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] 10.222.0.40 "GET /compute/v2.1/servers/ea0c61fb-9bc2-42d7-960e-4859c4e6f172" status: 200 len: 1320 microversion: 2.1 time: 0.243496 Oct 26 13:03:52.598553 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 228/407] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:52 2022] GET /compute/v2.1/servers/ea0c61fb-9bc2-42d7-960e-4859c4e6f172 => generated 1320 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:52.884834 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-75b760ff-c11a-4a5d-8535-7c05c08d2753 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:52.885686 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-75b760ff-c11a-4a5d-8535-7c05c08d2753 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] [instance: 3b17e574-b449-4b57-b82d-82303ec940ab] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:52.888270 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=20 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:03:52.895690 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:03:52.900278 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-75b760ff-c11a-4a5d-8535-7c05c08d2753 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:52.900413 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-75b760ff-c11a-4a5d-8535-7c05c08d2753 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:52.900872 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-75b760ff-c11a-4a5d-8535-7c05c08d2753 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:52.901602 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-75b760ff-c11a-4a5d-8535-7c05c08d2753 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:52.903298 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-75b760ff-c11a-4a5d-8535-7c05c08d2753 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:52.903605 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-75b760ff-c11a-4a5d-8535-7c05c08d2753 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:52.911502 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:03:53.068801 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-75b760ff-c11a-4a5d-8535-7c05c08d2753 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999ac729ed1f4456857c8671d4b9be8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e2b56ef8db404ca0372e0a9c5f9b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:53.071857 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=62 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:03:53.081768 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-75b760ff-c11a-4a5d-8535-7c05c08d2753 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] 10.222.0.40 "GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab" status: 200 len: 1468 microversion: 2.1 time: 0.201568 Oct 26 13:03:53.082530 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 229/408] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:52 2022] GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab => generated 1468 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:53.112578 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1d2ea97d-968f-4019-8465-29670ee08d9f tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:53.113555 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1d2ea97d-968f-4019-8465-29670ee08d9f tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] [instance: 3b17e574-b449-4b57-b82d-82303ec940ab] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:53.126906 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1d2ea97d-968f-4019-8465-29670ee08d9f tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:53.127542 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1d2ea97d-968f-4019-8465-29670ee08d9f tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:53.128422 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1d2ea97d-968f-4019-8465-29670ee08d9f tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:53.129877 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1d2ea97d-968f-4019-8465-29670ee08d9f tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:53.130415 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1d2ea97d-968f-4019-8465-29670ee08d9f tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:53.130969 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1d2ea97d-968f-4019-8465-29670ee08d9f tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:53.210832 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-1d2ea97d-968f-4019-8465-29670ee08d9f tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] Lazy-loading 'flavor' on Instance uuid 3b17e574-b449-4b57-b82d-82303ec940ab {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:03:53.310701 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1d2ea97d-968f-4019-8465-29670ee08d9f tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab/action" status: 202 len: 0 microversion: 2.1 time: 0.202142 Oct 26 13:03:53.312050 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 230/409] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:03:53 2022] POST /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:03:53.325296 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8efa2f87-48f9-4f00-ab91-45ccb0c160ef tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:53.326372 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8efa2f87-48f9-4f00-ab91-45ccb0c160ef tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] [instance: 3b17e574-b449-4b57-b82d-82303ec940ab] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:53.334942 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8efa2f87-48f9-4f00-ab91-45ccb0c160ef tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:53.335652 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8efa2f87-48f9-4f00-ab91-45ccb0c160ef tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:53.336271 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8efa2f87-48f9-4f00-ab91-45ccb0c160ef tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:53.337761 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8efa2f87-48f9-4f00-ab91-45ccb0c160ef tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:53.338639 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8efa2f87-48f9-4f00-ab91-45ccb0c160ef tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:53.339080 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8efa2f87-48f9-4f00-ab91-45ccb0c160ef tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:53.499179 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8efa2f87-48f9-4f00-ab91-45ccb0c160ef tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999ac729ed1f4456857c8671d4b9be8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e2b56ef8db404ca0372e0a9c5f9b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:53.508636 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8efa2f87-48f9-4f00-ab91-45ccb0c160ef tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] 10.222.0.40 "GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab" status: 200 len: 1476 microversion: 2.1 time: 0.191899 Oct 26 13:03:53.510468 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 231/410] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:53 2022] GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab => generated 1476 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:53.526389 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e4a40fbc-2fa1-4de0-bcfb-41da3a313dc8 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:53.527102 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e4a40fbc-2fa1-4de0-bcfb-41da3a313dc8 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:53.533386 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4a40fbc-2fa1-4de0-bcfb-41da3a313dc8 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:53.534084 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4a40fbc-2fa1-4de0-bcfb-41da3a313dc8 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:53.534665 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4a40fbc-2fa1-4de0-bcfb-41da3a313dc8 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:53.535527 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4a40fbc-2fa1-4de0-bcfb-41da3a313dc8 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:53.536136 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4a40fbc-2fa1-4de0-bcfb-41da3a313dc8 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:53.536560 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4a40fbc-2fa1-4de0-bcfb-41da3a313dc8 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:53.700095 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e4a40fbc-2fa1-4de0-bcfb-41da3a313dc8 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:53.708488 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e4a40fbc-2fa1-4de0-bcfb-41da3a313dc8 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1475 microversion: 2.1 time: 0.196870 Oct 26 13:03:53.709165 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 232/411] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:53 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1475 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:53.716014 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-9f53fb15-3757-4557-b552-bb3da4f2ee76 req-1f3fa9ec-0176-4544-89cd-e1510c4a827b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea0c61fb-9bc2-42d7-960e-4859c4e6f172", "name": "network-vif-plugged", "status": "completed", "tag": "5c755cc5-72dd-4533-95c4-5ccec85cb869"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:53.725740 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9f53fb15-3757-4557-b552-bb3da4f2ee76 req-1f3fa9ec-0176-4544-89cd-e1510c4a827b service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:53.726408 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9f53fb15-3757-4557-b552-bb3da4f2ee76 req-1f3fa9ec-0176-4544-89cd-e1510c4a827b service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:53.726734 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9f53fb15-3757-4557-b552-bb3da4f2ee76 req-1f3fa9ec-0176-4544-89cd-e1510c4a827b service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:53.739939 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-9f53fb15-3757-4557-b552-bb3da4f2ee76 req-1f3fa9ec-0176-4544-89cd-e1510c4a827b service nova] Creating event network-vif-plugged:5c755cc5-72dd-4533-95c4-5ccec85cb869 for instance ea0c61fb-9bc2-42d7-960e-4859c4e6f172 on n-h2-862686-1 Oct 26 13:03:53.745925 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-9f53fb15-3757-4557-b552-bb3da4f2ee76 req-1f3fa9ec-0176-4544-89cd-e1510c4a827b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035379 Oct 26 13:03:53.746731 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 233/412] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:53.751732 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f620f04f-e4e9-44ae-a284-63eebae07738 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:53.752425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f620f04f-e4e9-44ae-a284-63eebae07738 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] [instance: ea0c61fb-9bc2-42d7-960e-4859c4e6f172] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:53.758434 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f620f04f-e4e9-44ae-a284-63eebae07738 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:53.759000 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f620f04f-e4e9-44ae-a284-63eebae07738 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:53.759761 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f620f04f-e4e9-44ae-a284-63eebae07738 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:53.760213 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f620f04f-e4e9-44ae-a284-63eebae07738 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:53.760663 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f620f04f-e4e9-44ae-a284-63eebae07738 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:53.761264 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f620f04f-e4e9-44ae-a284-63eebae07738 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:53.958273 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f620f04f-e4e9-44ae-a284-63eebae07738 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c240bdb5dd7249c79d9620637d0c6e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81334bcb49d84a529558a88b02b6ef55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:53.968496 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f620f04f-e4e9-44ae-a284-63eebae07738 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] 10.222.0.40 "GET /compute/v2.1/servers/ea0c61fb-9bc2-42d7-960e-4859c4e6f172" status: 200 len: 1320 microversion: 2.1 time: 0.220583 Oct 26 13:03:53.970192 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 234/413] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:53 2022] GET /compute/v2.1/servers/ea0c61fb-9bc2-42d7-960e-4859c4e6f172 => generated 1320 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:54.369729 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1db4cfb3-abc0-4031-8bd2-f3451fa7e272 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1709534862", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:54.437632 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-1db4cfb3-abc0-4031-8bd2-f3451fa7e272 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] validate_networks() for None {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:03:54.749630 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-1db4cfb3-abc0-4031-8bd2-f3451fa7e272 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:03:54.750214 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-1db4cfb3-abc0-4031-8bd2-f3451fa7e272 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:03:54.750519 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-1db4cfb3-abc0-4031-8bd2-f3451fa7e272 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:03:54.750927 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-1db4cfb3-abc0-4031-8bd2-f3451fa7e272 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:03:54.751345 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-1db4cfb3-abc0-4031-8bd2-f3451fa7e272 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:03:54.760862 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1db4cfb3-abc0-4031-8bd2-f3451fa7e272 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:54.761344 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1db4cfb3-abc0-4031-8bd2-f3451fa7e272 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:54.761804 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1db4cfb3-abc0-4031-8bd2-f3451fa7e272 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:54.762525 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1db4cfb3-abc0-4031-8bd2-f3451fa7e272 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:54.763246 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1db4cfb3-abc0-4031-8bd2-f3451fa7e272 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:54.763669 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1db4cfb3-abc0-4031-8bd2-f3451fa7e272 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:54.780671 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-1db4cfb3-abc0-4031-8bd2-f3451fa7e272 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Getting quotas for project a588d8f9d1bd40d1b1dc487da7c572cd. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:03:54.784648 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-1db4cfb3-abc0-4031-8bd2-f3451fa7e272 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Getting quotas for user d6506f19875d47ef81996f0c66a009ff and project a588d8f9d1bd40d1b1dc487da7c572cd. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:03:54.796998 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1db4cfb3-abc0-4031-8bd2-f3451fa7e272 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:03:54.799365 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1db4cfb3-abc0-4031-8bd2-f3451fa7e272 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] [instance: 710484b5-6fbe-4a33-8585-a5117a34262d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:03:54.844160 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1db4cfb3-abc0-4031-8bd2-f3451fa7e272 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.754501 Oct 26 13:03:54.851074 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 235/414] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:03:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 26 13:03:55.052115 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-146f7a15-03b7-417f-9640-b71aae6a0b51 tempest-TenantUsagesNegativeTestJSON-863491930 tempest-TenantUsagesNegativeTestJSON-863491930-project-admin] 10.222.0.40 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-25T13%3A03%3A54.395158&end=2022-10-27T13%3A03%3A54.395158" status: 404 len: 112 microversion: - time: 0.205901 Oct 26 13:03:55.052858 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 236/415] 10.222.0.40 () {58 vars in 1316 bytes} [Wed Oct 26 13:03:54 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-25T13%3A03%3A54.395158&end=2022-10-27T13%3A03%3A54.395158 => generated 112 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 26 13:03:55.058503 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cf79ad52-2139-44d7-9e42-d8f3aaa2a6e0 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:55.059126 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cf79ad52-2139-44d7-9e42-d8f3aaa2a6e0 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] [instance: 3b17e574-b449-4b57-b82d-82303ec940ab] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:55.061733 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3253a071-a519-444c-979c-363199666820 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288/action" status: 202 len: 0 microversion: 2.25 time: 2.792296 Oct 26 13:03:55.062698 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 180/416] 10.222.0.40 () {62 vars in 1319 bytes} [Wed Oct 26 13:03:52 2022] POST /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288/action => generated 0 bytes in 2794 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:03:55.075159 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf79ad52-2139-44d7-9e42-d8f3aaa2a6e0 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:55.075652 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf79ad52-2139-44d7-9e42-d8f3aaa2a6e0 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:55.076116 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf79ad52-2139-44d7-9e42-d8f3aaa2a6e0 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:55.076818 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf79ad52-2139-44d7-9e42-d8f3aaa2a6e0 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:55.077435 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf79ad52-2139-44d7-9e42-d8f3aaa2a6e0 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:55.078754 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf79ad52-2139-44d7-9e42-d8f3aaa2a6e0 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:55.138524 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-97ed5f6e-01c5-49bc-8109-a34acb195544 tempest-HypervisorAdminV228Test-1788660347 tempest-HypervisorAdminV228Test-1788660347-project-admin] Calling method '.version_select at 0x7f6732f5a9d0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:55.140333 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-97ed5f6e-01c5-49bc-8109-a34acb195544 tempest-HypervisorAdminV228Test-1788660347 tempest-HypervisorAdminV228Test-1788660347-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:55.140818 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-97ed5f6e-01c5-49bc-8109-a34acb195544 tempest-HypervisorAdminV228Test-1788660347 tempest-HypervisorAdminV228Test-1788660347-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:55.141255 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-97ed5f6e-01c5-49bc-8109-a34acb195544 tempest-HypervisorAdminV228Test-1788660347 tempest-HypervisorAdminV228Test-1788660347-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:55.168536 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-97ed5f6e-01c5-49bc-8109-a34acb195544 tempest-HypervisorAdminV228Test-1788660347 tempest-HypervisorAdminV228Test-1788660347-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:55.169274 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-97ed5f6e-01c5-49bc-8109-a34acb195544 tempest-HypervisorAdminV228Test-1788660347 tempest-HypervisorAdminV228Test-1788660347-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:55.169797 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-97ed5f6e-01c5-49bc-8109-a34acb195544 tempest-HypervisorAdminV228Test-1788660347 tempest-HypervisorAdminV228Test-1788660347-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:55.180243 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-97ed5f6e-01c5-49bc-8109-a34acb195544 tempest-HypervisorAdminV228Test-1788660347 tempest-HypervisorAdminV228Test-1788660347-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:55.181573 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-97ed5f6e-01c5-49bc-8109-a34acb195544 tempest-HypervisorAdminV228Test-1788660347 tempest-HypervisorAdminV228Test-1788660347-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:55.182078 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-97ed5f6e-01c5-49bc-8109-a34acb195544 tempest-HypervisorAdminV228Test-1788660347 tempest-HypervisorAdminV228Test-1788660347-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:55.188531 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-97ed5f6e-01c5-49bc-8109-a34acb195544 tempest-HypervisorAdminV228Test-1788660347 tempest-HypervisorAdminV228Test-1788660347-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.124638 Oct 26 13:03:55.189383 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 181/417] 10.222.0.40 () {60 vars in 1187 bytes} [Wed Oct 26 13:03:55 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:03:55.194858 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4dfda895-ab97-4a26-baaa-3c15e8eaacc4 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:55.196058 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4dfda895-ab97-4a26-baaa-3c15e8eaacc4 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:55.202350 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4dfda895-ab97-4a26-baaa-3c15e8eaacc4 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:55.202840 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4dfda895-ab97-4a26-baaa-3c15e8eaacc4 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:55.203482 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4dfda895-ab97-4a26-baaa-3c15e8eaacc4 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:55.204182 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4dfda895-ab97-4a26-baaa-3c15e8eaacc4 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:55.204635 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4dfda895-ab97-4a26-baaa-3c15e8eaacc4 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:55.205055 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4dfda895-ab97-4a26-baaa-3c15e8eaacc4 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:55.284799 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-cf79ad52-2139-44d7-9e42-d8f3aaa2a6e0 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999ac729ed1f4456857c8671d4b9be8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e2b56ef8db404ca0372e0a9c5f9b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:55.298834 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cf79ad52-2139-44d7-9e42-d8f3aaa2a6e0 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] 10.222.0.40 "GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab" status: 200 len: 1459 microversion: 2.1 time: 0.244737 Oct 26 13:03:55.299760 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 237/418] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:55 2022] GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab => generated 1459 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:55.312986 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c68f71b3-319b-468a-be4b-27256c78f251 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:55.315393 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c68f71b3-319b-468a-be4b-27256c78f251 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] [instance: 710484b5-6fbe-4a33-8585-a5117a34262d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:55.380954 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c68f71b3-319b-468a-be4b-27256c78f251 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6506f19875d47ef81996f0c66a009ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588d8f9d1bd40d1b1dc487da7c572cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:55.382609 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4dfda895-ab97-4a26-baaa-3c15e8eaacc4 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:55.390560 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c68f71b3-319b-468a-be4b-27256c78f251 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] 10.222.0.40 "GET /compute/v2.1/servers/710484b5-6fbe-4a33-8585-a5117a34262d" status: 200 len: 1223 microversion: 2.1 time: 0.089296 Oct 26 13:03:55.391143 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 238/419] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:55 2022] GET /compute/v2.1/servers/710484b5-6fbe-4a33-8585-a5117a34262d => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:55.396047 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d01affa4-fa2a-4f91-8960-5b3c04c59dc7 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:55.396830 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d01affa4-fa2a-4f91-8960-5b3c04c59dc7 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] [instance: ea0c61fb-9bc2-42d7-960e-4859c4e6f172] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:55.405820 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d01affa4-fa2a-4f91-8960-5b3c04c59dc7 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:55.406513 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d01affa4-fa2a-4f91-8960-5b3c04c59dc7 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:55.406953 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d01affa4-fa2a-4f91-8960-5b3c04c59dc7 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:55.407651 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d01affa4-fa2a-4f91-8960-5b3c04c59dc7 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:55.408106 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d01affa4-fa2a-4f91-8960-5b3c04c59dc7 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:55.408527 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d01affa4-fa2a-4f91-8960-5b3c04c59dc7 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:55.412557 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4dfda895-ab97-4a26-baaa-3c15e8eaacc4 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1475 microversion: 2.1 time: 0.221434 Oct 26 13:03:55.422788 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 182/420] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:55 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1475 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:55.428412 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-264b75c9-92dc-4509-8e53-8842fad5b9bf tempest-TenantUsagesNegativeTestJSON-863491930 tempest-TenantUsagesNegativeTestJSON-863491930-project-admin] Calling method '.version_select at 0x7f6732ea8c10>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:55.442597 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-264b75c9-92dc-4509-8e53-8842fad5b9bf tempest-TenantUsagesNegativeTestJSON-863491930 tempest-TenantUsagesNegativeTestJSON-863491930-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 26 13:03:55.444359 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-264b75c9-92dc-4509-8e53-8842fad5b9bf tempest-TenantUsagesNegativeTestJSON-863491930 tempest-TenantUsagesNegativeTestJSON-863491930-project-admin] Request method failure captured: Oct 26 13:03:55.444359 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/os-simple-tenant-usage/e335631e0253405d887dfbff8a82dfeb?start=2022-10-27T13%3A03%3A54.395158&end=2022-10-25T13%3A03%3A54.395158 HTTP/1.1 Oct 26 13:03:55.444359 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:03:55.444359 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:03:55.444359 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:03:55.444359 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:03:55.444359 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:03:55.444359 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:03:55.444359 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:03:55.444359 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:03:55.444359 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTA6kNE6-aLRwDru8CUG3fhPuC_C5YhLhLEa9PAlAeIbmtmIk09KN-t1i1BKdY5nF8lkZNsVdDkhWttX7tbKJimPAGAOR9X4s_rTa_UWBqSKJ1eHq5ypH4aqryMNE2OqKlY448pR7qw9PmwW6fHzC5mk3DFLMeIXNkUmf8AtPDkTdss Oct 26 13:03:55.444359 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:03:55.444359 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:03:55.444359 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:03:55.444359 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:03:55.444359 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:03:55.444359 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:03:55.444359 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 7094a8ae213d43f8ba628ddebb7a266d Oct 26 13:03:55.444359 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-863491930 Oct 26 13:03:55.444359 n-d-862686-1 devstack@n-api.service[120597]: X-Role: admin,member,reader Oct 26 13:03:55.444359 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: admin,member,reader Oct 26 13:03:55.445838 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7094a8ae213d43f8ba628ddebb7a266d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7094a8ae213d43f8ba628ddebb7a266d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7094a8ae213d43f8ba628ddebb7a266d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7094a8ae213d43f8ba628ddebb7a266d"}]}] Oct 26 13:03:55.445838 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-863491930 Oct 26 13:03:55.445838 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 7094a8ae213d43f8ba628ddebb7a266d Oct 26 13:03:55.445838 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-863491930 Oct 26 13:03:55.445838 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-TenantUsagesNegativeTestJSON-863491930-project-admin Oct 26 13:03:55.445838 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:03:55.445838 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:03:55.445838 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 912d99781e674139bd9af88bae350d28 Oct 26 13:03:55.445838 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-863491930-project-admin Oct 26 13:03:55.445838 n-d-862686-1 devstack@n-api.service[120597]: method: Oct 26 13:03:55.445838 n-d-862686-1 devstack@n-api.service[120597]: exception: Invalid start time. The start time cannot occur after the end time. Oct 26 13:03:55.445838 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'e335631e0253405d887dfbff8a82dfeb'} Oct 26 13:03:55.446580 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:03:55.446580 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:55.446580 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:55.446580 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:55.446580 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:03:55.446580 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:03:55.446580 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:03:55.446580 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:03:55.446580 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 26 13:03:55.446580 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:03:55.446580 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:03:55.446580 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:03:55.446580 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 26 13:03:55.446580 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 26 13:03:55.446580 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 26 13:03:55.446580 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 26 13:03:55.446580 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 26 13:03:55.446580 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 26 13:03:55.446580 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 26 13:03:55.447783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:03:55.447783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:55.447783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:03:55.447783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:55.447783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:55.447783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:55.447783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:03:55.447783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:03:55.447783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 26 13:03:55.447783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:03:55.447783 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-264b75c9-92dc-4509-8e53-8842fad5b9bf tempest-TenantUsagesNegativeTestJSON-863491930 tempest-TenantUsagesNegativeTestJSON-863491930-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:03:55.447783 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-264b75c9-92dc-4509-8e53-8842fad5b9bf tempest-TenantUsagesNegativeTestJSON-863491930 tempest-TenantUsagesNegativeTestJSON-863491930-project-admin] 10.222.0.40 "GET /compute/v2.1/os-simple-tenant-usage/e335631e0253405d887dfbff8a82dfeb?start=2022-10-27T13%3A03%3A54.395158&end=2022-10-25T13%3A03%3A54.395158" status: 400 len: 111 microversion: 2.1 time: 0.021734 Oct 26 13:03:55.448479 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 183/421] 10.222.0.40 () {58 vars in 1412 bytes} [Wed Oct 26 13:03:55 2022] GET /compute/v2.1/os-simple-tenant-usage/e335631e0253405d887dfbff8a82dfeb?start=2022-10-27T13%3A03%3A54.395158&end=2022-10-25T13%3A03%3A54.395158 => generated 111 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:03:55.458965 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a16c432f-b45e-4905-a433-66bf6d92bf62 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:55.459585 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a16c432f-b45e-4905-a433-66bf6d92bf62 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3e395c36-3e81-4ca3-ab5c-a034d92f8288] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:55.471840 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a16c432f-b45e-4905-a433-66bf6d92bf62 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:55.472327 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a16c432f-b45e-4905-a433-66bf6d92bf62 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:55.472763 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a16c432f-b45e-4905-a433-66bf6d92bf62 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:55.473467 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a16c432f-b45e-4905-a433-66bf6d92bf62 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:55.486825 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a16c432f-b45e-4905-a433-66bf6d92bf62 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:55.486825 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a16c432f-b45e-4905-a433-66bf6d92bf62 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:55.584700 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d01affa4-fa2a-4f91-8960-5b3c04c59dc7 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c240bdb5dd7249c79d9620637d0c6e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81334bcb49d84a529558a88b02b6ef55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:55.598932 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d01affa4-fa2a-4f91-8960-5b3c04c59dc7 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] 10.222.0.40 "GET /compute/v2.1/servers/ea0c61fb-9bc2-42d7-960e-4859c4e6f172" status: 200 len: 1470 microversion: 2.1 time: 0.206719 Oct 26 13:03:55.599524 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 239/422] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:55 2022] GET /compute/v2.1/servers/ea0c61fb-9bc2-42d7-960e-4859c4e6f172 => generated 1470 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:55.617743 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f6ebfa53-5c25-4696-a875-c9a3985daf4c tempest-HypervisorAdminV228Test-1788660347 tempest-HypervisorAdminV228Test-1788660347-project-admin] Calling method '.version_select at 0x7f6732b9a040>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:55.620477 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6ebfa53-5c25-4696-a875-c9a3985daf4c tempest-HypervisorAdminV228Test-1788660347 tempest-HypervisorAdminV228Test-1788660347-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:55.621188 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6ebfa53-5c25-4696-a875-c9a3985daf4c tempest-HypervisorAdminV228Test-1788660347 tempest-HypervisorAdminV228Test-1788660347-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:55.621711 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6ebfa53-5c25-4696-a875-c9a3985daf4c tempest-HypervisorAdminV228Test-1788660347 tempest-HypervisorAdminV228Test-1788660347-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:55.644577 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6ebfa53-5c25-4696-a875-c9a3985daf4c tempest-HypervisorAdminV228Test-1788660347 tempest-HypervisorAdminV228Test-1788660347-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:55.645339 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6ebfa53-5c25-4696-a875-c9a3985daf4c tempest-HypervisorAdminV228Test-1788660347 tempest-HypervisorAdminV228Test-1788660347-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:55.646116 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6ebfa53-5c25-4696-a875-c9a3985daf4c tempest-HypervisorAdminV228Test-1788660347 tempest-HypervisorAdminV228Test-1788660347-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:55.655633 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f6ebfa53-5c25-4696-a875-c9a3985daf4c tempest-HypervisorAdminV228Test-1788660347 tempest-HypervisorAdminV228Test-1788660347-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.054521 Oct 26 13:03:55.656782 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 240/423] 10.222.0.40 () {60 vars in 1193 bytes} [Wed Oct 26 13:03:55 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:03:55.661887 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cc667db4-1554-472f-9ed1-ed3fb0272cd2 tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:55.662911 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cc667db4-1554-472f-9ed1-ed3fb0272cd2 tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] [instance: 3b17e574-b449-4b57-b82d-82303ec940ab] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:55.673077 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cc667db4-1554-472f-9ed1-ed3fb0272cd2 tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:55.673951 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cc667db4-1554-472f-9ed1-ed3fb0272cd2 tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:55.674892 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cc667db4-1554-472f-9ed1-ed3fb0272cd2 tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:55.676580 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cc667db4-1554-472f-9ed1-ed3fb0272cd2 tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:55.678048 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cc667db4-1554-472f-9ed1-ed3fb0272cd2 tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:55.678643 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cc667db4-1554-472f-9ed1-ed3fb0272cd2 tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:55.779160 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a16c432f-b45e-4905-a433-66bf6d92bf62 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:55.788335 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a16c432f-b45e-4905-a433-66bf6d92bf62 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:55.795167 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a16c432f-b45e-4905-a433-66bf6d92bf62 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:55.796674 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a16c432f-b45e-4905-a433-66bf6d92bf62 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288" status: 200 len: 1566 microversion: 2.25 time: 0.349429 Oct 26 13:03:55.802515 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 184/424] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:03:55 2022] GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288 => generated 1566 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:03:56.022709 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8cce2be4-ff69-4fb5-8bde-b4738642e715 tempest-TenantUsagesNegativeTestJSON-1013195800 tempest-TenantUsagesNegativeTestJSON-1013195800-project] Calling method '.version_select at 0x7f6733024670>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:56.027338 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8cce2be4-ff69-4fb5-8bde-b4738642e715 tempest-TenantUsagesNegativeTestJSON-1013195800 tempest-TenantUsagesNegativeTestJSON-1013195800-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '659ec7749e9a464296f60e27762ddbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e335631e0253405d887dfbff8a82dfeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:56.029656 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8cce2be4-ff69-4fb5-8bde-b4738642e715 tempest-TenantUsagesNegativeTestJSON-1013195800 tempest-TenantUsagesNegativeTestJSON-1013195800-project] Request method failure captured: Oct 26 13:03:56.029656 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-25T13%3A03%3A54.395158&end=2022-10-27T13%3A03%3A54.395158&detailed=1 HTTP/1.1 Oct 26 13:03:56.029656 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:03:56.029656 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:03:56.029656 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:03:56.029656 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:03:56.029656 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:03:56.029656 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:03:56.029656 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:03:56.029656 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:03:56.029656 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTA4Vg9ULAdbiufhl4F2yGr5trkC4L3iRpi9FTGULdwNgKo-e_Cg1fijFzLn4p_qgQVVR68Nnk5705y_bRG1cbqtqXMtAQHUek7PZdnQ9wwYJdT8CmY3FimC2RhWMiN7wlGX6XmDgrsLL_gZMDQiHpXYEU4RRszNjfj1NBOZdFdt9F8 Oct 26 13:03:56.029656 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:03:56.029656 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:03:56.029656 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:03:56.029656 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:03:56.029656 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:03:56.029656 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:03:56.029656 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: e335631e0253405d887dfbff8a82dfeb Oct 26 13:03:56.029656 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1013195800 Oct 26 13:03:56.029656 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:03:56.029656 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:03:56.030979 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e335631e0253405d887dfbff8a82dfeb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e335631e0253405d887dfbff8a82dfeb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e335631e0253405d887dfbff8a82dfeb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e335631e0253405d887dfbff8a82dfeb"}]}] Oct 26 13:03:56.030979 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1013195800 Oct 26 13:03:56.030979 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: e335631e0253405d887dfbff8a82dfeb Oct 26 13:03:56.030979 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1013195800 Oct 26 13:03:56.030979 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-TenantUsagesNegativeTestJSON-1013195800-project Oct 26 13:03:56.030979 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:03:56.030979 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:03:56.030979 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 659ec7749e9a464296f60e27762ddbaa Oct 26 13:03:56.030979 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1013195800-project Oct 26 13:03:56.030979 n-d-862686-1 devstack@n-api.service[120597]: method: Oct 26 13:03:56.030979 n-d-862686-1 devstack@n-api.service[120597]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 26 13:03:56.030979 n-d-862686-1 devstack@n-api.service[120597]: action_args: {} Oct 26 13:03:56.030979 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:03:56.031689 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:56.031689 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:56.031689 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:56.031689 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:03:56.031689 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:03:56.031689 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:03:56.031689 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:03:56.031689 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 26 13:03:56.031689 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:03:56.031689 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:03:56.031689 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:03:56.031689 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 26 13:03:56.031689 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 26 13:03:56.031689 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 26 13:03:56.031689 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 26 13:03:56.031689 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 13:03:56.031689 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 13:03:56.031689 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 13:03:56.031689 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 13:03:56.033468 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 13:03:56.033468 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 13:03:56.033468 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 13:03:56.033468 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 13:03:56.033468 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 13:03:56.033468 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 13:03:56.033468 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 13:03:56.033468 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 13:03:56.033468 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 13:03:56.033468 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 13:03:56.033468 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 26 13:03:56.033468 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:03:56.033468 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:56.033468 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:03:56.033468 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:56.033468 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:56.033468 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:56.033468 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 13:03:56.033468 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 13:03:56.034519 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 26 13:03:56.034519 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:03:56.036075 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8cce2be4-ff69-4fb5-8bde-b4738642e715 tempest-TenantUsagesNegativeTestJSON-1013195800 tempest-TenantUsagesNegativeTestJSON-1013195800-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:03:56.037345 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8cce2be4-ff69-4fb5-8bde-b4738642e715 tempest-TenantUsagesNegativeTestJSON-1013195800 tempest-TenantUsagesNegativeTestJSON-1013195800-project] 10.222.0.40 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-25T13%3A03%3A54.395158&end=2022-10-27T13%3A03%3A54.395158&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.233400 Oct 26 13:03:56.042249 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 185/425] 10.222.0.40 () {58 vars in 1335 bytes} [Wed Oct 26 13:03:55 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-25T13%3A03%3A54.395158&end=2022-10-27T13%3A03%3A54.395158&detailed=1 => generated 123 bytes in 239 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:03:56.064082 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cc667db4-1554-472f-9ed1-ed3fb0272cd2 tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab" status: 200 len: 1610 microversion: 2.1 time: 0.406068 Oct 26 13:03:56.074938 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 241/426] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:55 2022] GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab => generated 1610 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:56.086601 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b392bfe4-a422-4d2d-86d7-d70acf621006 tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:56.092858 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b392bfe4-a422-4d2d-86d7-d70acf621006 tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:56.093353 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b392bfe4-a422-4d2d-86d7-d70acf621006 tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:56.093814 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b392bfe4-a422-4d2d-86d7-d70acf621006 tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:56.094734 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b392bfe4-a422-4d2d-86d7-d70acf621006 tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:56.095195 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b392bfe4-a422-4d2d-86d7-d70acf621006 tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:56.095619 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b392bfe4-a422-4d2d-86d7-d70acf621006 tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:56.137200 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b392bfe4-a422-4d2d-86d7-d70acf621006 tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.054103 Oct 26 13:03:56.138089 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 242/427] 10.222.0.40 () {58 vars in 1176 bytes} [Wed Oct 26 13:03:56 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:03:56.158188 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fcd790ed-c80b-4216-9f4e-9a7b0bc73bcb tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-862686-1", "block_migration": true, "disk_over_commit": false}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:56.161273 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fcd790ed-c80b-4216-9f4e-9a7b0bc73bcb tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] [instance: 3b17e574-b449-4b57-b82d-82303ec940ab] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:56.168713 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fcd790ed-c80b-4216-9f4e-9a7b0bc73bcb tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:56.169186 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fcd790ed-c80b-4216-9f4e-9a7b0bc73bcb tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:56.169824 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fcd790ed-c80b-4216-9f4e-9a7b0bc73bcb tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:56.170701 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fcd790ed-c80b-4216-9f4e-9a7b0bc73bcb tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:56.171149 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fcd790ed-c80b-4216-9f4e-9a7b0bc73bcb tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:56.171897 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fcd790ed-c80b-4216-9f4e-9a7b0bc73bcb tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:56.201956 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-fcd790ed-c80b-4216-9f4e-9a7b0bc73bcb tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] Lazy-loading 'flavor' on Instance uuid 3b17e574-b449-4b57-b82d-82303ec940ab {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:03:56.216519 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-fcd790ed-c80b-4216-9f4e-9a7b0bc73bcb tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 3b17e574-b449-4b57-b82d-82303ec940ab while it is in vm_state suspended Oct 26 13:03:56.218751 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fcd790ed-c80b-4216-9f4e-9a7b0bc73bcb tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] Request method failure captured: Oct 26 13:03:56.218751 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab/action HTTP/1.1 Oct 26 13:03:56.218751 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:03:56.218751 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:03:56.218751 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:03:56.218751 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 97 Oct 26 13:03:56.218751 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:03:56.218751 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:03:56.218751 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:03:56.218751 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:03:56.218751 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTALlBnXIR8m4_ICr8Ny9UPFjVPhp9aF5ukwvqPGuLcaEeYAemBO1iud4nJxYqK6Qgt1EKvC2-PRegO9qr5FY2WiDuJFz3poifRUbjctz6DxtZ1SGb3my2Y2CQZyOWW947Qu0MRk617NOdSFFtHLHxlUP8Z-mZU74syt1pA4MFFFb-g Oct 26 13:03:56.218751 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:03:56.218751 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:03:56.218751 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:03:56.218751 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:03:56.218751 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:03:56.218751 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:03:56.218751 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: d382ca677cb847298c3f3d255b34808f Oct 26 13:03:56.218751 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-LiveMigrationNegativeTest-1165665104 Oct 26 13:03:56.218751 n-d-862686-1 devstack@n-api.service[120598]: X-Role: admin,member,reader Oct 26 13:03:56.218751 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: admin,member,reader Oct 26 13:03:56.220354 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d382ca677cb847298c3f3d255b34808f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d382ca677cb847298c3f3d255b34808f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d382ca677cb847298c3f3d255b34808f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d382ca677cb847298c3f3d255b34808f"}]}] Oct 26 13:03:56.220354 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-LiveMigrationNegativeTest-1165665104 Oct 26 13:03:56.220354 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: d382ca677cb847298c3f3d255b34808f Oct 26 13:03:56.220354 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1165665104 Oct 26 13:03:56.220354 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-LiveMigrationNegativeTest-1165665104-project-admin Oct 26 13:03:56.220354 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:03:56.220354 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:03:56.220354 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 73631c4458f7456f910e9754ef437ef9 Oct 26 13:03:56.220354 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-LiveMigrationNegativeTest-1165665104-project-admin Oct 26 13:03:56.220354 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:03:56.220354 n-d-862686-1 devstack@n-api.service[120598]: {"os-migrateLive": {"host": "n-h1-862686-1", "block_migration": true, "disk_over_commit": false}} Oct 26 13:03:56.220354 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:03:56.221168 n-d-862686-1 devstack@n-api.service[120598]: exception: Cannot 'os-migrateLive' instance 3b17e574-b449-4b57-b82d-82303ec940ab while it is in vm_state suspended Oct 26 13:03:56.221168 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '3b17e574-b449-4b57-b82d-82303ec940ab', 'body': {'os-migrateLive': {'host': 'n-h1-862686-1', 'block_migration': True, 'disk_over_commit': False}}} Oct 26 13:03:56.221168 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:03:56.221168 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:56.221168 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 26 13:03:56.221168 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 26 13:03:56.221168 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 26 13:03:56.221168 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 13:03:56.221168 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 26 13:03:56.221168 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 26 13:03:56.221168 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 26 13:03:56.221168 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 26 13:03:56.221168 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 26 13:03:56.221168 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 26 13:03:56.221168 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 26 13:03:56.221168 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 26 13:03:56.221168 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 26 13:03:56.221168 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 26 13:03:56.222395 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 26 13:03:56.222395 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 13:03:56.222395 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 26 13:03:56.222395 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 26 13:03:56.222395 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3b17e574-b449-4b57-b82d-82303ec940ab in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 26 13:03:56.222395 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:56.222395 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:56.222395 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:56.222395 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:56.222395 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:56.222395 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:56.222395 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:03:56.222395 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:03:56.222395 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:03:56.222395 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:03:56.222395 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:03:56.222395 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:03:56.222395 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:03:56.222395 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:03:56.222395 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:03:56.223485 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:03:56.223485 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 26 13:03:56.223485 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 26 13:03:56.223485 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 26 13:03:56.223485 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 26 13:03:56.223485 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 26 13:03:56.223485 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 3b17e574-b449-4b57-b82d-82303ec940ab while it is in vm_state suspended Oct 26 13:03:56.223485 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:56.223485 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:03:56.223485 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:56.223485 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:03:56.223485 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:03:56.223485 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:03:56.223485 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:03:56.223485 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:03:56.223485 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 3b17e574-b449-4b57-b82d-82303ec940ab while it is in vm_state suspended Oct 26 13:03:56.223485 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:03:56.224395 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fcd790ed-c80b-4216-9f4e-9a7b0bc73bcb tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 3b17e574-b449-4b57-b82d-82303ec940ab while it is in vm_state suspended {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:03:56.226475 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fcd790ed-c80b-4216-9f4e-9a7b0bc73bcb tempest-LiveMigrationNegativeTest-1165665104 tempest-LiveMigrationNegativeTest-1165665104-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab/action" status: 409 len: 155 microversion: 2.1 time: 0.072195 Oct 26 13:03:56.233333 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 243/428] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:03:56 2022] POST /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab/action => generated 155 bytes in 74 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:03:56.241763 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-594d64e8-e42f-4eab-9bba-f5243203680f tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:56.242615 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-594d64e8-e42f-4eab-9bba-f5243203680f tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] [instance: 3b17e574-b449-4b57-b82d-82303ec940ab] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:56.250425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-594d64e8-e42f-4eab-9bba-f5243203680f tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:56.251531 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-594d64e8-e42f-4eab-9bba-f5243203680f tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:56.253027 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-594d64e8-e42f-4eab-9bba-f5243203680f tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:56.254136 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-594d64e8-e42f-4eab-9bba-f5243203680f tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:56.255548 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-594d64e8-e42f-4eab-9bba-f5243203680f tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:56.256147 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-594d64e8-e42f-4eab-9bba-f5243203680f tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:56.298541 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-594d64e8-e42f-4eab-9bba-f5243203680f tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] [instance: 3b17e574-b449-4b57-b82d-82303ec940ab] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:03:56.418405 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-594d64e8-e42f-4eab-9bba-f5243203680f tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab" status: 204 len: 0 microversion: 2.1 time: 0.182715 Oct 26 13:03:56.419428 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 244/429] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:03:56 2022] DELETE /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:03:56.431495 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-01e36c7d-96bd-4829-8041-e722bb73d309 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:56.434121 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-01e36c7d-96bd-4829-8041-e722bb73d309 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] [instance: 710484b5-6fbe-4a33-8585-a5117a34262d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:56.454491 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-01e36c7d-96bd-4829-8041-e722bb73d309 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:56.457231 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-01e36c7d-96bd-4829-8041-e722bb73d309 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:56.457890 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-01e36c7d-96bd-4829-8041-e722bb73d309 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:56.461416 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-01e36c7d-96bd-4829-8041-e722bb73d309 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:56.462476 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-01e36c7d-96bd-4829-8041-e722bb73d309 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:56.462922 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-01e36c7d-96bd-4829-8041-e722bb73d309 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:56.471094 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ffe79290-7c4d-4f52-9b10-fd03205959eb tempest-DeleteServersAdminTestJSON-1586240307 tempest-DeleteServersAdminTestJSON-1586240307-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:56.471573 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ffe79290-7c4d-4f52-9b10-fd03205959eb tempest-DeleteServersAdminTestJSON-1586240307 tempest-DeleteServersAdminTestJSON-1586240307-project-admin] [instance: ea0c61fb-9bc2-42d7-960e-4859c4e6f172] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:56.489263 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ffe79290-7c4d-4f52-9b10-fd03205959eb tempest-DeleteServersAdminTestJSON-1586240307 tempest-DeleteServersAdminTestJSON-1586240307-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:56.489793 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ffe79290-7c4d-4f52-9b10-fd03205959eb tempest-DeleteServersAdminTestJSON-1586240307 tempest-DeleteServersAdminTestJSON-1586240307-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:56.490226 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ffe79290-7c4d-4f52-9b10-fd03205959eb tempest-DeleteServersAdminTestJSON-1586240307 tempest-DeleteServersAdminTestJSON-1586240307-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:56.490919 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ffe79290-7c4d-4f52-9b10-fd03205959eb tempest-DeleteServersAdminTestJSON-1586240307 tempest-DeleteServersAdminTestJSON-1586240307-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:56.491533 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ffe79290-7c4d-4f52-9b10-fd03205959eb tempest-DeleteServersAdminTestJSON-1586240307 tempest-DeleteServersAdminTestJSON-1586240307-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:56.492316 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ffe79290-7c4d-4f52-9b10-fd03205959eb tempest-DeleteServersAdminTestJSON-1586240307 tempest-DeleteServersAdminTestJSON-1586240307-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:56.552354 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ffe79290-7c4d-4f52-9b10-fd03205959eb tempest-DeleteServersAdminTestJSON-1586240307 tempest-DeleteServersAdminTestJSON-1586240307-project-admin] [instance: ea0c61fb-9bc2-42d7-960e-4859c4e6f172] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:03:56.583208 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-01e36c7d-96bd-4829-8041-e722bb73d309 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6506f19875d47ef81996f0c66a009ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588d8f9d1bd40d1b1dc487da7c572cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:56.594567 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-01e36c7d-96bd-4829-8041-e722bb73d309 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] 10.222.0.40 "GET /compute/v2.1/servers/710484b5-6fbe-4a33-8585-a5117a34262d" status: 200 len: 1293 microversion: 2.1 time: 0.172978 Oct 26 13:03:56.595832 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 245/430] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:56 2022] GET /compute/v2.1/servers/710484b5-6fbe-4a33-8585-a5117a34262d => generated 1293 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:56.600837 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5f9005c2-6ed5-4ef3-97f0-48cb0d92d0c6 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:56.601618 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5f9005c2-6ed5-4ef3-97f0-48cb0d92d0c6 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] [instance: 3b17e574-b449-4b57-b82d-82303ec940ab] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:56.608382 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5f9005c2-6ed5-4ef3-97f0-48cb0d92d0c6 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:56.608871 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5f9005c2-6ed5-4ef3-97f0-48cb0d92d0c6 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:56.609309 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5f9005c2-6ed5-4ef3-97f0-48cb0d92d0c6 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:56.610126 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5f9005c2-6ed5-4ef3-97f0-48cb0d92d0c6 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:56.610574 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5f9005c2-6ed5-4ef3-97f0-48cb0d92d0c6 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:56.611001 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5f9005c2-6ed5-4ef3-97f0-48cb0d92d0c6 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:56.677030 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ffe79290-7c4d-4f52-9b10-fd03205959eb tempest-DeleteServersAdminTestJSON-1586240307 tempest-DeleteServersAdminTestJSON-1586240307-project-admin] 10.222.0.40 "DELETE /compute/v2.1/servers/ea0c61fb-9bc2-42d7-960e-4859c4e6f172" status: 204 len: 0 microversion: 2.1 time: 0.632939 Oct 26 13:03:56.678005 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 186/431] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:03:56 2022] DELETE /compute/v2.1/servers/ea0c61fb-9bc2-42d7-960e-4859c4e6f172 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:03:56.684255 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9f6e69bd-b78a-4066-8eae-e7636cd3546e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:56.685696 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9f6e69bd-b78a-4066-8eae-e7636cd3546e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:56.691738 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f6e69bd-b78a-4066-8eae-e7636cd3546e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:56.692231 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f6e69bd-b78a-4066-8eae-e7636cd3546e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:56.692667 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f6e69bd-b78a-4066-8eae-e7636cd3546e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:56.693372 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f6e69bd-b78a-4066-8eae-e7636cd3546e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:56.693880 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f6e69bd-b78a-4066-8eae-e7636cd3546e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:56.694308 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f6e69bd-b78a-4066-8eae-e7636cd3546e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:56.829470 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5f9005c2-6ed5-4ef3-97f0-48cb0d92d0c6 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999ac729ed1f4456857c8671d4b9be8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e2b56ef8db404ca0372e0a9c5f9b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:56.835237 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:03:56.844880 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5f9005c2-6ed5-4ef3-97f0-48cb0d92d0c6 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] 10.222.0.40 "GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab" status: 200 len: 1465 microversion: 2.1 time: 0.247491 Oct 26 13:03:56.846087 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 246/432] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:56 2022] GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab => generated 1465 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:56.876649 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-63b14e3d-4a4e-4119-814b-8079e5c7456b tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:56.879234 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-63b14e3d-4a4e-4119-814b-8079e5c7456b tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] [instance: ea0c61fb-9bc2-42d7-960e-4859c4e6f172] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:56.888789 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63b14e3d-4a4e-4119-814b-8079e5c7456b tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:56.890445 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63b14e3d-4a4e-4119-814b-8079e5c7456b tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:56.891281 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63b14e3d-4a4e-4119-814b-8079e5c7456b tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:56.892655 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63b14e3d-4a4e-4119-814b-8079e5c7456b tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:56.893334 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63b14e3d-4a4e-4119-814b-8079e5c7456b tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:56.896588 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63b14e3d-4a4e-4119-814b-8079e5c7456b tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:57.064237 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9f6e69bd-b78a-4066-8eae-e7636cd3546e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:57.080692 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9f6e69bd-b78a-4066-8eae-e7636cd3546e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1474 microversion: 2.1 time: 0.400645 Oct 26 13:03:57.099955 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 187/433] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:56 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1474 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:57.101302 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-63b14e3d-4a4e-4119-814b-8079e5c7456b tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c240bdb5dd7249c79d9620637d0c6e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81334bcb49d84a529558a88b02b6ef55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:57.113911 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-63b14e3d-4a4e-4119-814b-8079e5c7456b tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] 10.222.0.40 "GET /compute/v2.1/servers/ea0c61fb-9bc2-42d7-960e-4859c4e6f172" status: 200 len: 1476 microversion: 2.1 time: 0.265822 Oct 26 13:03:57.115564 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 247/434] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:56 2022] GET /compute/v2.1/servers/ea0c61fb-9bc2-42d7-960e-4859c4e6f172 => generated 1476 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:57.116504 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0695ae8f-f561-4b5e-ae11-41af29b19001 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:57.117145 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0695ae8f-f561-4b5e-ae11-41af29b19001 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3e395c36-3e81-4ca3-ab5c-a034d92f8288] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:57.132850 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0695ae8f-f561-4b5e-ae11-41af29b19001 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:57.134483 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-1c0eee78-bdbd-459d-a8ad-dd227e968e94 req-525057f1-1648-4278-8fd1-8510c36f2a3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c858b29-db9e-4d65-af6d-86b6e1d36c45", "name": "network-vif-unplugged", "status": "completed", "tag": "fbefc9ba-9ae6-4d00-93d2-059d7c60c35f"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:57.134825 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0695ae8f-f561-4b5e-ae11-41af29b19001 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:57.135335 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0695ae8f-f561-4b5e-ae11-41af29b19001 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:57.136127 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0695ae8f-f561-4b5e-ae11-41af29b19001 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:57.140639 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0695ae8f-f561-4b5e-ae11-41af29b19001 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:57.141225 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0695ae8f-f561-4b5e-ae11-41af29b19001 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:57.155984 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-1c0eee78-bdbd-459d-a8ad-dd227e968e94 req-525057f1-1648-4278-8fd1-8510c36f2a3d service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:57.161168 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-1c0eee78-bdbd-459d-a8ad-dd227e968e94 req-525057f1-1648-4278-8fd1-8510c36f2a3d service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:57.161745 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-1c0eee78-bdbd-459d-a8ad-dd227e968e94 req-525057f1-1648-4278-8fd1-8510c36f2a3d service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:57.182504 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-1c0eee78-bdbd-459d-a8ad-dd227e968e94 req-525057f1-1648-4278-8fd1-8510c36f2a3d service nova] Creating event network-vif-unplugged:fbefc9ba-9ae6-4d00-93d2-059d7c60c35f for instance 3c858b29-db9e-4d65-af6d-86b6e1d36c45 on n-h2-862686-1 Oct 26 13:03:57.195956 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [req-1c0eee78-bdbd-459d-a8ad-dd227e968e94 req-525057f1-1648-4278-8fd1-8510c36f2a3d service nova] Instance 3c858b29-db9e-4d65-af6d-86b6e1d36c45 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862686-1', 'n-h1-862686-1'} {{(pid=120598) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 13:03:57.222631 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-1c0eee78-bdbd-459d-a8ad-dd227e968e94 req-525057f1-1648-4278-8fd1-8510c36f2a3d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086808 Oct 26 13:03:57.223680 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 248/435] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:03:57.518523 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0695ae8f-f561-4b5e-ae11-41af29b19001 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:57.528687 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0695ae8f-f561-4b5e-ae11-41af29b19001 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:57.530736 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0695ae8f-f561-4b5e-ae11-41af29b19001 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:57.532455 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0695ae8f-f561-4b5e-ae11-41af29b19001 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288" status: 200 len: 1566 microversion: 2.25 time: 0.431283 Oct 26 13:03:57.533439 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 188/436] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:03:57 2022] GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288 => generated 1566 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:03:57.625106 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1dd5da6f-d28c-4186-b904-d9a5eb93102e tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:57.626102 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1dd5da6f-d28c-4186-b904-d9a5eb93102e tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] [instance: 710484b5-6fbe-4a33-8585-a5117a34262d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:57.650883 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1dd5da6f-d28c-4186-b904-d9a5eb93102e tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:57.652821 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1dd5da6f-d28c-4186-b904-d9a5eb93102e tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:57.653606 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1dd5da6f-d28c-4186-b904-d9a5eb93102e tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:57.655811 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1dd5da6f-d28c-4186-b904-d9a5eb93102e tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:57.660517 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1dd5da6f-d28c-4186-b904-d9a5eb93102e tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:57.661304 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1dd5da6f-d28c-4186-b904-d9a5eb93102e tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:57.801428 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1dd5da6f-d28c-4186-b904-d9a5eb93102e tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6506f19875d47ef81996f0c66a009ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588d8f9d1bd40d1b1dc487da7c572cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:57.813928 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1dd5da6f-d28c-4186-b904-d9a5eb93102e tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] 10.222.0.40 "GET /compute/v2.1/servers/710484b5-6fbe-4a33-8585-a5117a34262d" status: 200 len: 1281 microversion: 2.1 time: 0.192592 Oct 26 13:03:57.815613 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 249/437] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:57 2022] GET /compute/v2.1/servers/710484b5-6fbe-4a33-8585-a5117a34262d => generated 1281 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:57.874604 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9306f774-10f5-40ae-9ec8-130ec818cb4f tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:57.875823 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9306f774-10f5-40ae-9ec8-130ec818cb4f tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] [instance: 3b17e574-b449-4b57-b82d-82303ec940ab] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:57.886630 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9306f774-10f5-40ae-9ec8-130ec818cb4f tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:57.887403 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9306f774-10f5-40ae-9ec8-130ec818cb4f tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:57.888194 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9306f774-10f5-40ae-9ec8-130ec818cb4f tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:57.888906 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9306f774-10f5-40ae-9ec8-130ec818cb4f tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:57.889808 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9306f774-10f5-40ae-9ec8-130ec818cb4f tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:57.890924 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9306f774-10f5-40ae-9ec8-130ec818cb4f tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:58.111540 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c00bbb85-d796-4fe5-84c3-94bc0bf429d1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:58.113012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c00bbb85-d796-4fe5-84c3-94bc0bf429d1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:58.126702 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c00bbb85-d796-4fe5-84c3-94bc0bf429d1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:58.127958 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c00bbb85-d796-4fe5-84c3-94bc0bf429d1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:58.128604 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c00bbb85-d796-4fe5-84c3-94bc0bf429d1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:58.129639 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c00bbb85-d796-4fe5-84c3-94bc0bf429d1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:58.130980 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c00bbb85-d796-4fe5-84c3-94bc0bf429d1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:58.131716 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c00bbb85-d796-4fe5-84c3-94bc0bf429d1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:58.271901 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9306f774-10f5-40ae-9ec8-130ec818cb4f tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999ac729ed1f4456857c8671d4b9be8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e2b56ef8db404ca0372e0a9c5f9b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:58.284510 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9306f774-10f5-40ae-9ec8-130ec818cb4f tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] 10.222.0.40 "GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab" status: 200 len: 1465 microversion: 2.1 time: 0.419282 Oct 26 13:03:58.297509 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 189/438] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:57 2022] GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab => generated 1465 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:58.297829 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c00bbb85-d796-4fe5-84c3-94bc0bf429d1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:58.297965 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7053ff59-8ea1-4fcc-bee0-0b3ba6dc1320 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:58.297965 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7053ff59-8ea1-4fcc-bee0-0b3ba6dc1320 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] [instance: ea0c61fb-9bc2-42d7-960e-4859c4e6f172] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:58.303917 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c00bbb85-d796-4fe5-84c3-94bc0bf429d1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1474 microversion: 2.1 time: 0.196769 Oct 26 13:03:58.304087 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7053ff59-8ea1-4fcc-bee0-0b3ba6dc1320 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:58.304087 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7053ff59-8ea1-4fcc-bee0-0b3ba6dc1320 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:58.304260 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 250/439] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:58 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1474 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:03:58.306488 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7053ff59-8ea1-4fcc-bee0-0b3ba6dc1320 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:58.307332 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7053ff59-8ea1-4fcc-bee0-0b3ba6dc1320 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:58.307881 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7053ff59-8ea1-4fcc-bee0-0b3ba6dc1320 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:58.308419 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7053ff59-8ea1-4fcc-bee0-0b3ba6dc1320 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:58.564380 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5f1bbcc0-2b74-480b-82b2-b7d4e818ef6b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:58.564993 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5f1bbcc0-2b74-480b-82b2-b7d4e818ef6b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3e395c36-3e81-4ca3-ab5c-a034d92f8288] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:58.572104 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5f1bbcc0-2b74-480b-82b2-b7d4e818ef6b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:58.572609 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5f1bbcc0-2b74-480b-82b2-b7d4e818ef6b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:58.573110 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5f1bbcc0-2b74-480b-82b2-b7d4e818ef6b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:58.574220 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5f1bbcc0-2b74-480b-82b2-b7d4e818ef6b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:58.574944 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5f1bbcc0-2b74-480b-82b2-b7d4e818ef6b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:58.575413 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5f1bbcc0-2b74-480b-82b2-b7d4e818ef6b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:58.590068 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7053ff59-8ea1-4fcc-bee0-0b3ba6dc1320 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c240bdb5dd7249c79d9620637d0c6e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81334bcb49d84a529558a88b02b6ef55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:58.598887 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7053ff59-8ea1-4fcc-bee0-0b3ba6dc1320 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] 10.222.0.40 "GET /compute/v2.1/servers/ea0c61fb-9bc2-42d7-960e-4859c4e6f172" status: 200 len: 1476 microversion: 2.1 time: 0.312188 Oct 26 13:03:58.599792 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 190/440] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:58 2022] GET /compute/v2.1/servers/ea0c61fb-9bc2-42d7-960e-4859c4e6f172 => generated 1476 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:58.769834 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5f1bbcc0-2b74-480b-82b2-b7d4e818ef6b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:58.779634 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5f1bbcc0-2b74-480b-82b2-b7d4e818ef6b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:58.781786 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5f1bbcc0-2b74-480b-82b2-b7d4e818ef6b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:58.783752 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5f1bbcc0-2b74-480b-82b2-b7d4e818ef6b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288" status: 200 len: 1566 microversion: 2.25 time: 0.223032 Oct 26 13:03:58.797510 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 251/441] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:03:58 2022] GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288 => generated 1566 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:03:58.845166 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-75a36a74-b809-4f16-86c9-52fac826dcc6 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:58.845802 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-75a36a74-b809-4f16-86c9-52fac826dcc6 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] [instance: 710484b5-6fbe-4a33-8585-a5117a34262d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:58.855808 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-75a36a74-b809-4f16-86c9-52fac826dcc6 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:58.856302 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-75a36a74-b809-4f16-86c9-52fac826dcc6 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:58.856741 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-75a36a74-b809-4f16-86c9-52fac826dcc6 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:58.857730 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-75a36a74-b809-4f16-86c9-52fac826dcc6 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:58.858392 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-75a36a74-b809-4f16-86c9-52fac826dcc6 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:58.858948 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-75a36a74-b809-4f16-86c9-52fac826dcc6 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:59.284396 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-d6f10f09-6053-4863-b8cf-5cdcaedc3342 req-99742f31-8bfd-4b46-baeb-ba8659588ba3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c858b29-db9e-4d65-af6d-86b6e1d36c45", "tag": "fbefc9ba-9ae6-4d00-93d2-059d7c60c35f"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:03:59.300488 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-d6f10f09-6053-4863-b8cf-5cdcaedc3342 req-99742f31-8bfd-4b46-baeb-ba8659588ba3 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:59.301600 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-d6f10f09-6053-4863-b8cf-5cdcaedc3342 req-99742f31-8bfd-4b46-baeb-ba8659588ba3 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:59.302041 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-d6f10f09-6053-4863-b8cf-5cdcaedc3342 req-99742f31-8bfd-4b46-baeb-ba8659588ba3 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:59.320134 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-d6f10f09-6053-4863-b8cf-5cdcaedc3342 req-99742f31-8bfd-4b46-baeb-ba8659588ba3 service nova] Creating event network-changed:fbefc9ba-9ae6-4d00-93d2-059d7c60c35f for instance 3c858b29-db9e-4d65-af6d-86b6e1d36c45 on n-h2-862686-1 Oct 26 13:03:59.328594 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [req-d6f10f09-6053-4863-b8cf-5cdcaedc3342 req-99742f31-8bfd-4b46-baeb-ba8659588ba3 service nova] Instance 3c858b29-db9e-4d65-af6d-86b6e1d36c45 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862686-1', 'n-h1-862686-1'} {{(pid=120598) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 13:03:59.347037 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-d6f10f09-6053-4863-b8cf-5cdcaedc3342 req-99742f31-8bfd-4b46-baeb-ba8659588ba3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066840 Oct 26 13:03:59.348343 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 252/442] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:03:59.371104 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-272ba75c-479e-4ec1-af2a-af8ea71a08ae tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:59.373408 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-272ba75c-479e-4ec1-af2a-af8ea71a08ae tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] [instance: 3b17e574-b449-4b57-b82d-82303ec940ab] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:59.381888 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-272ba75c-479e-4ec1-af2a-af8ea71a08ae tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:59.382736 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-272ba75c-479e-4ec1-af2a-af8ea71a08ae tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:59.383504 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-272ba75c-479e-4ec1-af2a-af8ea71a08ae tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:59.385299 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-272ba75c-479e-4ec1-af2a-af8ea71a08ae tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:59.386068 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-272ba75c-479e-4ec1-af2a-af8ea71a08ae tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:59.386927 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-272ba75c-479e-4ec1-af2a-af8ea71a08ae tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:59.484616 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-75a36a74-b809-4f16-86c9-52fac826dcc6 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6506f19875d47ef81996f0c66a009ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588d8f9d1bd40d1b1dc487da7c572cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:59.499994 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-75a36a74-b809-4f16-86c9-52fac826dcc6 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] 10.222.0.40 "GET /compute/v2.1/servers/710484b5-6fbe-4a33-8585-a5117a34262d" status: 200 len: 1323 microversion: 2.1 time: 0.659017 Oct 26 13:03:59.517454 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 191/443] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:58 2022] GET /compute/v2.1/servers/710484b5-6fbe-4a33-8585-a5117a34262d => generated 1323 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:59.517454 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-54c972fc-a7cf-40b4-9105-1c479a6c327f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:59.517454 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-54c972fc-a7cf-40b4-9105-1c479a6c327f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:59.520199 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54c972fc-a7cf-40b4-9105-1c479a6c327f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:59.520874 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54c972fc-a7cf-40b4-9105-1c479a6c327f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:59.521450 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54c972fc-a7cf-40b4-9105-1c479a6c327f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:59.522892 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54c972fc-a7cf-40b4-9105-1c479a6c327f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:59.523350 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54c972fc-a7cf-40b4-9105-1c479a6c327f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:59.523774 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54c972fc-a7cf-40b4-9105-1c479a6c327f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:59.839582 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-272ba75c-479e-4ec1-af2a-af8ea71a08ae tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999ac729ed1f4456857c8671d4b9be8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e2b56ef8db404ca0372e0a9c5f9b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:03:59.847506 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-272ba75c-479e-4ec1-af2a-af8ea71a08ae tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] 10.222.0.40 "GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab" status: 200 len: 1465 microversion: 2.1 time: 0.497810 Oct 26 13:03:59.868811 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 253/444] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:59 2022] GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab => generated 1465 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:03:59.878179 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cacb0f58-14ba-4f36-b980-659863af7166 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:03:59.882229 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cacb0f58-14ba-4f36-b980-659863af7166 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] [instance: ea0c61fb-9bc2-42d7-960e-4859c4e6f172] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:03:59.907145 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cacb0f58-14ba-4f36-b980-659863af7166 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:59.907659 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cacb0f58-14ba-4f36-b980-659863af7166 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:59.908074 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cacb0f58-14ba-4f36-b980-659863af7166 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:03:59.908779 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cacb0f58-14ba-4f36-b980-659863af7166 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:03:59.909228 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cacb0f58-14ba-4f36-b980-659863af7166 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:03:59.909675 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cacb0f58-14ba-4f36-b980-659863af7166 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:00.107215 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-54c972fc-a7cf-40b4-9105-1c479a6c327f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:00.126887 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-54c972fc-a7cf-40b4-9105-1c479a6c327f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1474 microversion: 2.1 time: 0.617784 Oct 26 13:04:00.131477 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 192/445] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:59 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1474 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:00.153208 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1aa6f92c-597b-4794-a19d-9ce3aa111a7b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:00.154274 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1aa6f92c-597b-4794-a19d-9ce3aa111a7b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3e395c36-3e81-4ca3-ab5c-a034d92f8288] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:00.165204 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1aa6f92c-597b-4794-a19d-9ce3aa111a7b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:00.166966 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1aa6f92c-597b-4794-a19d-9ce3aa111a7b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:00.169229 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1aa6f92c-597b-4794-a19d-9ce3aa111a7b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:00.172082 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1aa6f92c-597b-4794-a19d-9ce3aa111a7b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:00.173605 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1aa6f92c-597b-4794-a19d-9ce3aa111a7b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:00.174266 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1aa6f92c-597b-4794-a19d-9ce3aa111a7b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:00.473129 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-cacb0f58-14ba-4f36-b980-659863af7166 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c240bdb5dd7249c79d9620637d0c6e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81334bcb49d84a529558a88b02b6ef55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:00.481279 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cacb0f58-14ba-4f36-b980-659863af7166 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] 10.222.0.40 "GET /compute/v2.1/servers/ea0c61fb-9bc2-42d7-960e-4859c4e6f172" status: 200 len: 1476 microversion: 2.1 time: 0.610790 Oct 26 13:04:00.490482 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 254/446] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:03:59 2022] GET /compute/v2.1/servers/ea0c61fb-9bc2-42d7-960e-4859c4e6f172 => generated 1476 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:00.899826 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-33ebfe76-c461-4c00-a4cd-cfaab7f4c993 tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Calling method '.version_select at 0x7f6732a618b0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:00.943984 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1aa6f92c-597b-4794-a19d-9ce3aa111a7b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:00.963652 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1aa6f92c-597b-4794-a19d-9ce3aa111a7b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:00.966665 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1aa6f92c-597b-4794-a19d-9ce3aa111a7b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:00.969029 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1aa6f92c-597b-4794-a19d-9ce3aa111a7b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288" status: 200 len: 1566 microversion: 2.25 time: 0.835946 Oct 26 13:04:00.970371 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 193/447] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:00 2022] GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288 => generated 1566 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:00.990293 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-7293de7c-8620-4cd5-bbe7-c48de49b6511 req-a7cd7fcf-6b07-40ec-80d7-970a8b4d03c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea0c61fb-9bc2-42d7-960e-4859c4e6f172", "name": "network-vif-deleted", "tag": "5c755cc5-72dd-4533-95c4-5ccec85cb869"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:01.011130 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-33ebfe76-c461-4c00-a4cd-cfaab7f4c993 tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/2ed12a4393364b0abd5647c0f0fd8cf4" status: 200 len: 371 microversion: 2.1 time: 0.517562 Oct 26 13:04:01.013772 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 255/448] 10.222.0.40 () {58 vars in 1242 bytes} [Wed Oct 26 13:04:00 2022] GET /compute/v2.1/os-quota-sets/2ed12a4393364b0abd5647c0f0fd8cf4 => generated 371 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:01.018361 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-7293de7c-8620-4cd5-bbe7-c48de49b6511 req-a7cd7fcf-6b07-40ec-80d7-970a8b4d03c0 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:01.020337 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-7293de7c-8620-4cd5-bbe7-c48de49b6511 req-a7cd7fcf-6b07-40ec-80d7-970a8b4d03c0 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:01.021560 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-7293de7c-8620-4cd5-bbe7-c48de49b6511 req-a7cd7fcf-6b07-40ec-80d7-970a8b4d03c0 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:01.027703 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e5d23e1d-04fa-4183-8e64-aaeac0f9c6d7 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:01.031121 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e5d23e1d-04fa-4183-8e64-aaeac0f9c6d7 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] [instance: 710484b5-6fbe-4a33-8585-a5117a34262d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:01.048726 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e5d23e1d-04fa-4183-8e64-aaeac0f9c6d7 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:01.049217 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e5d23e1d-04fa-4183-8e64-aaeac0f9c6d7 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:01.049681 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e5d23e1d-04fa-4183-8e64-aaeac0f9c6d7 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:01.050386 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e5d23e1d-04fa-4183-8e64-aaeac0f9c6d7 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:01.050841 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e5d23e1d-04fa-4183-8e64-aaeac0f9c6d7 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:01.051260 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e5d23e1d-04fa-4183-8e64-aaeac0f9c6d7 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:01.053619 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-7293de7c-8620-4cd5-bbe7-c48de49b6511 req-a7cd7fcf-6b07-40ec-80d7-970a8b4d03c0 service nova] Creating event network-vif-deleted:5c755cc5-72dd-4533-95c4-5ccec85cb869 for instance ea0c61fb-9bc2-42d7-960e-4859c4e6f172 on n-h2-862686-1 Oct 26 13:04:01.061698 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-7293de7c-8620-4cd5-bbe7-c48de49b6511 req-a7cd7fcf-6b07-40ec-80d7-970a8b4d03c0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089313 Oct 26 13:04:01.063259 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 194/449] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:01.070992 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-350c7b0a-e4d7-4adf-932e-da665b1bccb8 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:01.071990 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-350c7b0a-e4d7-4adf-932e-da665b1bccb8 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] [instance: 3b17e574-b449-4b57-b82d-82303ec940ab] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:01.082796 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-350c7b0a-e4d7-4adf-932e-da665b1bccb8 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:01.083342 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-350c7b0a-e4d7-4adf-932e-da665b1bccb8 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:01.084106 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-350c7b0a-e4d7-4adf-932e-da665b1bccb8 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:01.085004 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-350c7b0a-e4d7-4adf-932e-da665b1bccb8 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:01.085705 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-350c7b0a-e4d7-4adf-932e-da665b1bccb8 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:01.086216 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-350c7b0a-e4d7-4adf-932e-da665b1bccb8 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:01.234420 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e5d23e1d-04fa-4183-8e64-aaeac0f9c6d7 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6506f19875d47ef81996f0c66a009ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588d8f9d1bd40d1b1dc487da7c572cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:01.245453 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e5d23e1d-04fa-4183-8e64-aaeac0f9c6d7 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] 10.222.0.40 "GET /compute/v2.1/servers/710484b5-6fbe-4a33-8585-a5117a34262d" status: 200 len: 1323 microversion: 2.1 time: 0.229494 Oct 26 13:04:01.246336 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 256/450] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:01 2022] GET /compute/v2.1/servers/710484b5-6fbe-4a33-8585-a5117a34262d => generated 1323 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:01.270537 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5b740f39-f56c-4580-8fa9-ec611c2c1934 tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Action: 'update', calling method: .version_select at 0x7f6732acc5e0>, body: {"quota_set": {"ram": "5120"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:01.374868 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b740f39-f56c-4580-8fa9-ec611c2c1934 tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:01.375515 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b740f39-f56c-4580-8fa9-ec611c2c1934 tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:01.376263 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b740f39-f56c-4580-8fa9-ec611c2c1934 tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:01.377159 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b740f39-f56c-4580-8fa9-ec611c2c1934 tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:01.377795 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b740f39-f56c-4580-8fa9-ec611c2c1934 tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:01.378572 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b740f39-f56c-4580-8fa9-ec611c2c1934 tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:01.494899 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5b740f39-f56c-4580-8fa9-ec611c2c1934 tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/2ed12a4393364b0abd5647c0f0fd8cf4" status: 200 len: 328 microversion: 2.1 time: 0.228435 Oct 26 13:04:01.496301 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 257/451] 10.222.0.40 () {60 vars in 1262 bytes} [Wed Oct 26 13:04:01 2022] PUT /compute/v2.1/os-quota-sets/2ed12a4393364b0abd5647c0f0fd8cf4 => generated 328 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:01.503302 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d1f7c650-dda2-4a88-92c7-8a06ac53d54e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:01.504213 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d1f7c650-dda2-4a88-92c7-8a06ac53d54e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:01.517061 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d1f7c650-dda2-4a88-92c7-8a06ac53d54e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:01.532949 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d1f7c650-dda2-4a88-92c7-8a06ac53d54e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:01.534308 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d1f7c650-dda2-4a88-92c7-8a06ac53d54e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:01.535426 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d1f7c650-dda2-4a88-92c7-8a06ac53d54e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:01.537584 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d1f7c650-dda2-4a88-92c7-8a06ac53d54e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:01.538761 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d1f7c650-dda2-4a88-92c7-8a06ac53d54e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:01.715299 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-350c7b0a-e4d7-4adf-932e-da665b1bccb8 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999ac729ed1f4456857c8671d4b9be8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e2b56ef8db404ca0372e0a9c5f9b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:01.726087 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-350c7b0a-e4d7-4adf-932e-da665b1bccb8 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] 10.222.0.40 "GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab" status: 200 len: 1465 microversion: 2.1 time: 0.661405 Oct 26 13:04:01.741740 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 195/452] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:01 2022] GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab => generated 1465 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:01.748266 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-481ca628-4b8f-4eb4-bb9f-4d6c00957c19 req-37a8d9a7-5142-49b9-af84-c77d8ef0ffb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e395c36-3e81-4ca3-ab5c-a034d92f8288", "name": "network-vif-unplugged", "status": "completed", "tag": "d76e25b3-751c-4d09-9c27-caeb06dd7081"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:01.771181 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-481ca628-4b8f-4eb4-bb9f-4d6c00957c19 req-37a8d9a7-5142-49b9-af84-c77d8ef0ffb5 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:01.771662 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-481ca628-4b8f-4eb4-bb9f-4d6c00957c19 req-37a8d9a7-5142-49b9-af84-c77d8ef0ffb5 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:01.774108 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-481ca628-4b8f-4eb4-bb9f-4d6c00957c19 req-37a8d9a7-5142-49b9-af84-c77d8ef0ffb5 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:01.815174 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-481ca628-4b8f-4eb4-bb9f-4d6c00957c19 req-37a8d9a7-5142-49b9-af84-c77d8ef0ffb5 service nova] Creating event network-vif-unplugged:d76e25b3-751c-4d09-9c27-caeb06dd7081 for instance 3e395c36-3e81-4ca3-ab5c-a034d92f8288 on n-h1-862686-1 Oct 26 13:04:01.828838 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-481ca628-4b8f-4eb4-bb9f-4d6c00957c19 req-37a8d9a7-5142-49b9-af84-c77d8ef0ffb5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085252 Oct 26 13:04:01.829455 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 196/453] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:01.847438 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-340c8ffa-2179-4a46-9f29-178fd1b78f90 tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:01.878686 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-340c8ffa-2179-4a46-9f29-178fd1b78f90 tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-quota-sets/2ed12a4393364b0abd5647c0f0fd8cf4" status: 202 len: 0 microversion: 2.1 time: 0.047849 Oct 26 13:04:01.882121 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 197/454] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Oct 26 13:04:01 2022] DELETE /compute/v2.1/os-quota-sets/2ed12a4393364b0abd5647c0f0fd8cf4 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:04:01.889978 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-03d06bdc-45f3-471e-b166-5a224f65a63f tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:01.891761 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-03d06bdc-45f3-471e-b166-5a224f65a63f tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] [instance: ea0c61fb-9bc2-42d7-960e-4859c4e6f172] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:01.904690 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03d06bdc-45f3-471e-b166-5a224f65a63f tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:01.906888 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03d06bdc-45f3-471e-b166-5a224f65a63f tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:01.908486 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03d06bdc-45f3-471e-b166-5a224f65a63f tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:01.912118 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03d06bdc-45f3-471e-b166-5a224f65a63f tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:01.916505 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03d06bdc-45f3-471e-b166-5a224f65a63f tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:01.918318 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03d06bdc-45f3-471e-b166-5a224f65a63f tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:01.951937 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d1f7c650-dda2-4a88-92c7-8a06ac53d54e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:01.955791 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-03d06bdc-45f3-471e-b166-5a224f65a63f tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] HTTP exception thrown: Instance ea0c61fb-9bc2-42d7-960e-4859c4e6f172 could not be found. Oct 26 13:04:01.960356 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-03d06bdc-45f3-471e-b166-5a224f65a63f tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Request method failure captured: Oct 26 13:04:01.960356 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/ea0c61fb-9bc2-42d7-960e-4859c4e6f172 HTTP/1.1 Oct 26 13:04:01.960356 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:04:01.960356 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:04:01.960356 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:04:01.960356 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:04:01.960356 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:04:01.960356 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:04:01.960356 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:04:01.960356 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:04:01.960356 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTAsvL_mOVwVHFRIgqhMVDGVQnaU1Lsyvu6BwTswQ2wBT-qReJV0YHc-AAmO2bNNtxL3uV9ooCe7l3ooI3NQaC282z1IaNoyhH-svGIe_GFEWrP0_rldvJvaH2HPQ6eMb_GFw9Q0kuM1Mbt6h7W-lyi3GMjD50hXcB1wLxKlSq8Mv40 Oct 26 13:04:01.960356 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:04:01.960356 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:04:01.960356 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:04:01.960356 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:04:01.960356 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:04:01.960356 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:04:01.960356 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 81334bcb49d84a529558a88b02b6ef55 Oct 26 13:04:01.960356 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-DeleteServersAdminTestJSON-712867320 Oct 26 13:04:01.960356 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:04:01.960356 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:04:01.961610 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/81334bcb49d84a529558a88b02b6ef55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/81334bcb49d84a529558a88b02b6ef55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_81334bcb49d84a529558a88b02b6ef55"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/81334bcb49d84a529558a88b02b6ef55"}]}] Oct 26 13:04:01.961610 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-DeleteServersAdminTestJSON-712867320 Oct 26 13:04:01.961610 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 81334bcb49d84a529558a88b02b6ef55 Oct 26 13:04:01.961610 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-712867320 Oct 26 13:04:01.961610 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-DeleteServersAdminTestJSON-712867320-project Oct 26 13:04:01.961610 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:04:01.961610 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:04:01.961610 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: c240bdb5dd7249c79d9620637d0c6e3b Oct 26 13:04:01.961610 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-DeleteServersAdminTestJSON-712867320-project Oct 26 13:04:01.961610 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:04:01.961610 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance ea0c61fb-9bc2-42d7-960e-4859c4e6f172 could not be found. Oct 26 13:04:01.961610 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'ea0c61fb-9bc2-42d7-960e-4859c4e6f172'} Oct 26 13:04:01.962325 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:04:01.962325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:01.962325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:04:01.962325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:04:01.962325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:04:01.962325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:04:01.962325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:04:01.962325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:04:01.962325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:04:01.962325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:04:01.962325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea0c61fb-9bc2-42d7-960e-4859c4e6f172 could not be found. Oct 26 13:04:01.962325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:04:01.962325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:04:01.962325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:04:01.962325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:01.962325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:04:01.962325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:04:01.962325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:04:01.962325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:04:01.962325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:04:01.963409 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:04:01.963409 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:04:01.963409 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:04:01.963409 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:04:01.963409 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:04:01.963409 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:04:01.963409 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:04:01.963409 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea0c61fb-9bc2-42d7-960e-4859c4e6f172 could not be found. Oct 26 13:04:01.963409 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:04:01.963409 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:04:01.963409 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:04:01.963409 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:01.963409 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:04:01.963409 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:04:01.963409 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:04:01.963409 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:04:01.963409 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea0c61fb-9bc2-42d7-960e-4859c4e6f172 could not be found. Oct 26 13:04:01.963409 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:04:01.973437 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d1f7c650-dda2-4a88-92c7-8a06ac53d54e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1474 microversion: 2.1 time: 0.475606 Oct 26 13:04:01.973875 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-03d06bdc-45f3-471e-b166-5a224f65a63f tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Returning 404 to user: Instance ea0c61fb-9bc2-42d7-960e-4859c4e6f172 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:04:01.974554 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 258/455] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:01 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1474 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:01.975561 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-03d06bdc-45f3-471e-b166-5a224f65a63f tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] 10.222.0.40 "GET /compute/v2.1/servers/ea0c61fb-9bc2-42d7-960e-4859c4e6f172" status: 404 len: 111 microversion: 2.1 time: 0.091624 Oct 26 13:04:01.976875 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 198/456] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:01 2022] GET /compute/v2.1/servers/ea0c61fb-9bc2-42d7-960e-4859c4e6f172 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:04:01.990832 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4101ad84-83c7-4f0f-bbd7-d40dc8b5030b tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Calling method '.version_select at 0x7f6732a3bc10>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:02.005702 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f0f8282e-6a04-4850-9f5b-89d646a24995 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:02.007253 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f0f8282e-6a04-4850-9f5b-89d646a24995 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3e395c36-3e81-4ca3-ab5c-a034d92f8288] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:02.022192 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f0f8282e-6a04-4850-9f5b-89d646a24995 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:02.024474 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f0f8282e-6a04-4850-9f5b-89d646a24995 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:02.025600 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f0f8282e-6a04-4850-9f5b-89d646a24995 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:02.026847 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f0f8282e-6a04-4850-9f5b-89d646a24995 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:02.027504 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f0f8282e-6a04-4850-9f5b-89d646a24995 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:02.028267 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f0f8282e-6a04-4850-9f5b-89d646a24995 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:02.144204 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4101ad84-83c7-4f0f-bbd7-d40dc8b5030b tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/2ed12a4393364b0abd5647c0f0fd8cf4" status: 200 len: 371 microversion: 2.1 time: 0.167419 Oct 26 13:04:02.146197 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 259/457] 10.222.0.40 () {58 vars in 1242 bytes} [Wed Oct 26 13:04:01 2022] GET /compute/v2.1/os-quota-sets/2ed12a4393364b0abd5647c0f0fd8cf4 => generated 371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:02.181930 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-47eaabad-9537-4074-9c3b-b45706b54acf tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1321092267", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:02.223853 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:04:02.235561 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:04:02.293449 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-47eaabad-9537-4074-9c3b-b45706b54acf tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] validate_networks() for None {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:04:02.504993 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f0f8282e-6a04-4850-9f5b-89d646a24995 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:02.518515 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f0f8282e-6a04-4850-9f5b-89d646a24995 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:02.520134 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f0f8282e-6a04-4850-9f5b-89d646a24995 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:02.521469 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f0f8282e-6a04-4850-9f5b-89d646a24995 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288" status: 200 len: 1566 microversion: 2.25 time: 0.525432 Oct 26 13:04:02.522906 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 199/458] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:01 2022] GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288 => generated 1566 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:04:02.529827 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fff4e9fb-a5db-4c20-bade-1454a24d05ee tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:02.530569 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fff4e9fb-a5db-4c20-bade-1454a24d05ee tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] [instance: 710484b5-6fbe-4a33-8585-a5117a34262d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:02.537124 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fff4e9fb-a5db-4c20-bade-1454a24d05ee tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:02.537748 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fff4e9fb-a5db-4c20-bade-1454a24d05ee tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:02.538280 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fff4e9fb-a5db-4c20-bade-1454a24d05ee tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:02.539136 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fff4e9fb-a5db-4c20-bade-1454a24d05ee tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:02.539733 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fff4e9fb-a5db-4c20-bade-1454a24d05ee tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:02.541049 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fff4e9fb-a5db-4c20-bade-1454a24d05ee tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:02.847945 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fff4e9fb-a5db-4c20-bade-1454a24d05ee tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6506f19875d47ef81996f0c66a009ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588d8f9d1bd40d1b1dc487da7c572cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:02.855935 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:04:02.859930 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fff4e9fb-a5db-4c20-bade-1454a24d05ee tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] 10.222.0.40 "GET /compute/v2.1/servers/710484b5-6fbe-4a33-8585-a5117a34262d" status: 200 len: 1323 microversion: 2.1 time: 0.335576 Oct 26 13:04:02.912200 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 200/459] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:02 2022] GET /compute/v2.1/servers/710484b5-6fbe-4a33-8585-a5117a34262d => generated 1323 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:02.914615 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-47eaabad-9537-4074-9c3b-b45706b54acf tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:04:02.916056 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-47eaabad-9537-4074-9c3b-b45706b54acf tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:04:02.916739 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-47eaabad-9537-4074-9c3b-b45706b54acf tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:04:02.917275 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-47eaabad-9537-4074-9c3b-b45706b54acf tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:04:02.918499 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2f562ace-18c8-4b0c-9c46-36c84b018d72 tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Calling method '.version_select at 0x7f6732e638b0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:02.918778 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-47eaabad-9537-4074-9c3b-b45706b54acf tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:04:02.960953 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47eaabad-9537-4074-9c3b-b45706b54acf tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:02.961835 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47eaabad-9537-4074-9c3b-b45706b54acf tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:02.962493 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47eaabad-9537-4074-9c3b-b45706b54acf tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:02.963457 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47eaabad-9537-4074-9c3b-b45706b54acf tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:02.964066 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47eaabad-9537-4074-9c3b-b45706b54acf tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:02.964641 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47eaabad-9537-4074-9c3b-b45706b54acf tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:02.984994 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-47eaabad-9537-4074-9c3b-b45706b54acf tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Getting quotas for project 81334bcb49d84a529558a88b02b6ef55. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:04:02.989210 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-47eaabad-9537-4074-9c3b-b45706b54acf tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Getting quotas for user c240bdb5dd7249c79d9620637d0c6e3b and project 81334bcb49d84a529558a88b02b6ef55. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:04:03.005254 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-47eaabad-9537-4074-9c3b-b45706b54acf tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:04:03.009675 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-47eaabad-9537-4074-9c3b-b45706b54acf tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] [instance: 94b34e04-9a27-4158-aff1-95f37f1c7a58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:04:03.078755 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-47eaabad-9537-4074-9c3b-b45706b54acf tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.901708 Oct 26 13:04:03.080011 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 260/460] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:04:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 26 13:04:03.090818 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5fe392de-0e96-4cbc-92b6-c119eee6abe7 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:03.093161 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5fe392de-0e96-4cbc-92b6-c119eee6abe7 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] [instance: 3b17e574-b449-4b57-b82d-82303ec940ab] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:03.102176 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5fe392de-0e96-4cbc-92b6-c119eee6abe7 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:03.104217 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5fe392de-0e96-4cbc-92b6-c119eee6abe7 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:03.104901 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5fe392de-0e96-4cbc-92b6-c119eee6abe7 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:03.106448 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5fe392de-0e96-4cbc-92b6-c119eee6abe7 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:03.107063 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5fe392de-0e96-4cbc-92b6-c119eee6abe7 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:03.107787 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5fe392de-0e96-4cbc-92b6-c119eee6abe7 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:03.151332 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5fe392de-0e96-4cbc-92b6-c119eee6abe7 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:03.152071 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5fe392de-0e96-4cbc-92b6-c119eee6abe7 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:03.153326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5fe392de-0e96-4cbc-92b6-c119eee6abe7 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:03.154007 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-5fe392de-0e96-4cbc-92b6-c119eee6abe7 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lazy-loading 'fault' on Instance uuid 3b17e574-b449-4b57-b82d-82303ec940ab {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:04:03.222577 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5fe392de-0e96-4cbc-92b6-c119eee6abe7 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999ac729ed1f4456857c8671d4b9be8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e2b56ef8db404ca0372e0a9c5f9b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:03.246570 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5fe392de-0e96-4cbc-92b6-c119eee6abe7 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] 10.222.0.40 "GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab" status: 200 len: 1308 microversion: 2.1 time: 0.162027 Oct 26 13:04:03.248685 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 261/461] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:03 2022] GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab => generated 1308 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:03.255489 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d0f1d183-aae2-453d-a81a-54845b50b569 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:03.256115 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d0f1d183-aae2-453d-a81a-54845b50b569 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:03.263776 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0f1d183-aae2-453d-a81a-54845b50b569 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:03.264273 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0f1d183-aae2-453d-a81a-54845b50b569 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:03.264742 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0f1d183-aae2-453d-a81a-54845b50b569 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:03.265456 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0f1d183-aae2-453d-a81a-54845b50b569 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:03.266004 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0f1d183-aae2-453d-a81a-54845b50b569 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:03.266409 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0f1d183-aae2-453d-a81a-54845b50b569 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:03.335952 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2f562ace-18c8-4b0c-9c46-36c84b018d72 tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/ee91dec30d8c42138ef2d65c92c5b173/defaults" status: 200 len: 371 microversion: 2.1 time: 0.422370 Oct 26 13:04:03.338003 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 201/462] 10.222.0.40 () {58 vars in 1269 bytes} [Wed Oct 26 13:04:02 2022] GET /compute/v2.1/os-quota-sets/ee91dec30d8c42138ef2d65c92c5b173/defaults => generated 371 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:03.348537 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-873e268b-994e-4cc4-a0e7-241279e251d9 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:03.369759 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-873e268b-994e-4cc4-a0e7-241279e251d9 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] [instance: 94b34e04-9a27-4158-aff1-95f37f1c7a58] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:03.476384 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-873e268b-994e-4cc4-a0e7-241279e251d9 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c240bdb5dd7249c79d9620637d0c6e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81334bcb49d84a529558a88b02b6ef55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:03.484228 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-873e268b-994e-4cc4-a0e7-241279e251d9 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] 10.222.0.40 "GET /compute/v2.1/servers/94b34e04-9a27-4158-aff1-95f37f1c7a58" status: 200 len: 1220 microversion: 2.1 time: 0.145041 Oct 26 13:04:03.484799 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 202/463] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:03 2022] GET /compute/v2.1/servers/94b34e04-9a27-4158-aff1-95f37f1c7a58 => generated 1220 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:03.545872 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d0f1d183-aae2-453d-a81a-54845b50b569 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:03.552119 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4c7fa21e-645b-4e2b-ba9c-33120247f0ef tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:03.552906 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4c7fa21e-645b-4e2b-ba9c-33120247f0ef tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3e395c36-3e81-4ca3-ab5c-a034d92f8288] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:03.561373 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d0f1d183-aae2-453d-a81a-54845b50b569 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1472 microversion: 2.1 time: 0.309286 Oct 26 13:04:03.562394 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 262/464] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:03 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1472 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:03.571953 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4c7fa21e-645b-4e2b-ba9c-33120247f0ef tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:03.574247 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4c7fa21e-645b-4e2b-ba9c-33120247f0ef tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:03.575134 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4c7fa21e-645b-4e2b-ba9c-33120247f0ef tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:03.594194 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4c7fa21e-645b-4e2b-ba9c-33120247f0ef tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:03.594669 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4c7fa21e-645b-4e2b-ba9c-33120247f0ef tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:03.595109 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4c7fa21e-645b-4e2b-ba9c-33120247f0ef tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:03.825815 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9fa4364c-6091-49a6-ad21-479ff253b864 tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Action: 'update', calling method: .version_select at 0x7f6732a619d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:03.985842 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4c7fa21e-645b-4e2b-ba9c-33120247f0ef tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:04.003002 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4c7fa21e-645b-4e2b-ba9c-33120247f0ef tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:04.004562 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4c7fa21e-645b-4e2b-ba9c-33120247f0ef tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:04.008354 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4c7fa21e-645b-4e2b-ba9c-33120247f0ef tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288" status: 200 len: 1566 microversion: 2.25 time: 0.457919 Oct 26 13:04:04.009798 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 203/465] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:03 2022] GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288 => generated 1566 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:04:04.028367 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2a0c9ebd-f3dd-49fb-8628-f2fc2e4f3c54 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:04.029007 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2a0c9ebd-f3dd-49fb-8628-f2fc2e4f3c54 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] [instance: 710484b5-6fbe-4a33-8585-a5117a34262d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:04.043849 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2a0c9ebd-f3dd-49fb-8628-f2fc2e4f3c54 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:04.044366 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2a0c9ebd-f3dd-49fb-8628-f2fc2e4f3c54 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:04.044805 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2a0c9ebd-f3dd-49fb-8628-f2fc2e4f3c54 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:04.049847 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2a0c9ebd-f3dd-49fb-8628-f2fc2e4f3c54 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:04.053328 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2a0c9ebd-f3dd-49fb-8628-f2fc2e4f3c54 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:04.054008 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2a0c9ebd-f3dd-49fb-8628-f2fc2e4f3c54 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:04.115446 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9fa4364c-6091-49a6-ad21-479ff253b864 tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:04.116722 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9fa4364c-6091-49a6-ad21-479ff253b864 tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:04.117364 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9fa4364c-6091-49a6-ad21-479ff253b864 tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:04.118580 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9fa4364c-6091-49a6-ad21-479ff253b864 tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:04.119451 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9fa4364c-6091-49a6-ad21-479ff253b864 tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:04.120144 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9fa4364c-6091-49a6-ad21-479ff253b864 tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:04.206706 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9fa4364c-6091-49a6-ad21-479ff253b864 tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/0f0750fe70f84dffb2e59c3ed820f91d" status: 200 len: 328 microversion: 2.1 time: 0.388383 Oct 26 13:04:04.208129 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 263/466] 10.222.0.40 () {60 vars in 1262 bytes} [Wed Oct 26 13:04:03 2022] PUT /compute/v2.1/os-quota-sets/0f0750fe70f84dffb2e59c3ed820f91d => generated 328 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:04:04.213190 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-e704106c-3ee0-4a62-9bb9-3f8ed19b51c7 req-bf88a61c-09ff-4312-b283-e1387f74e69c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b17e574-b449-4b57-b82d-82303ec940ab", "name": "network-vif-deleted", "tag": "90575c26-418d-4416-b33a-4e61e0fa2a53"}, {"name": "network-changed", "server_uuid": "710484b5-6fbe-4a33-8585-a5117a34262d", "tag": "370eaf81-0d79-492b-b9bd-a7d2d47e66ef"}, {"name": "network-changed", "server_uuid": "3e395c36-3e81-4ca3-ab5c-a034d92f8288", "tag": "d76e25b3-751c-4d09-9c27-caeb06dd7081"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:04.227359 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e704106c-3ee0-4a62-9bb9-3f8ed19b51c7 req-bf88a61c-09ff-4312-b283-e1387f74e69c service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:04.228074 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e704106c-3ee0-4a62-9bb9-3f8ed19b51c7 req-bf88a61c-09ff-4312-b283-e1387f74e69c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:04.228700 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e704106c-3ee0-4a62-9bb9-3f8ed19b51c7 req-bf88a61c-09ff-4312-b283-e1387f74e69c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:04.245830 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-e704106c-3ee0-4a62-9bb9-3f8ed19b51c7 req-bf88a61c-09ff-4312-b283-e1387f74e69c service nova] Creating event network-vif-deleted:90575c26-418d-4416-b33a-4e61e0fa2a53 for instance 3b17e574-b449-4b57-b82d-82303ec940ab on n-h2-862686-1 Oct 26 13:04:04.246574 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-e704106c-3ee0-4a62-9bb9-3f8ed19b51c7 req-bf88a61c-09ff-4312-b283-e1387f74e69c service nova] Creating event network-changed:370eaf81-0d79-492b-b9bd-a7d2d47e66ef for instance 710484b5-6fbe-4a33-8585-a5117a34262d on n-h1-862686-1 Oct 26 13:04:04.247226 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-e704106c-3ee0-4a62-9bb9-3f8ed19b51c7 req-bf88a61c-09ff-4312-b283-e1387f74e69c service nova] Creating event network-changed:d76e25b3-751c-4d09-9c27-caeb06dd7081 for instance 3e395c36-3e81-4ca3-ab5c-a034d92f8288 on n-h1-862686-1 Oct 26 13:04:04.263112 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-e704106c-3ee0-4a62-9bb9-3f8ed19b51c7 req-bf88a61c-09ff-4312-b283-e1387f74e69c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.053406 Oct 26 13:04:04.264194 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 264/467] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:04.270429 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-37e68031-1415-46f7-97a8-b6735d1ebe3e tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Calling method '.version_select at 0x7f6732a61c10>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:04.356038 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-37e68031-1415-46f7-97a8-b6735d1ebe3e tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:04.356529 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-37e68031-1415-46f7-97a8-b6735d1ebe3e tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:04.356961 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-37e68031-1415-46f7-97a8-b6735d1ebe3e tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:04.357841 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-37e68031-1415-46f7-97a8-b6735d1ebe3e tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:04.358295 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-37e68031-1415-46f7-97a8-b6735d1ebe3e tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:04.358718 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-37e68031-1415-46f7-97a8-b6735d1ebe3e tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:04.378860 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-37e68031-1415-46f7-97a8-b6735d1ebe3e tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/0f0750fe70f84dffb2e59c3ed820f91d/detail" status: 200 len: 916 microversion: 2.1 time: 0.113384 Oct 26 13:04:04.389518 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 265/468] 10.222.0.40 () {58 vars in 1263 bytes} [Wed Oct 26 13:04:04 2022] GET /compute/v2.1/os-quota-sets/0f0750fe70f84dffb2e59c3ed820f91d/detail => generated 916 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:04.389518 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-54f7f8d7-b005-42c3-9b74-ccc215ef1bf6 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:04.389518 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-54f7f8d7-b005-42c3-9b74-ccc215ef1bf6 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] [instance: 3b17e574-b449-4b57-b82d-82303ec940ab] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:04.399118 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54f7f8d7-b005-42c3-9b74-ccc215ef1bf6 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:04.400162 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54f7f8d7-b005-42c3-9b74-ccc215ef1bf6 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:04.400601 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54f7f8d7-b005-42c3-9b74-ccc215ef1bf6 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:04.401311 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54f7f8d7-b005-42c3-9b74-ccc215ef1bf6 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:04.407025 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2a0c9ebd-f3dd-49fb-8628-f2fc2e4f3c54 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6506f19875d47ef81996f0c66a009ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588d8f9d1bd40d1b1dc487da7c572cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:04.411954 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54f7f8d7-b005-42c3-9b74-ccc215ef1bf6 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:04.412545 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54f7f8d7-b005-42c3-9b74-ccc215ef1bf6 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:04.416471 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2a0c9ebd-f3dd-49fb-8628-f2fc2e4f3c54 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] 10.222.0.40 "GET /compute/v2.1/servers/710484b5-6fbe-4a33-8585-a5117a34262d" status: 200 len: 1323 microversion: 2.1 time: 0.403403 Oct 26 13:04:04.417055 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 204/469] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:04 2022] GET /compute/v2.1/servers/710484b5-6fbe-4a33-8585-a5117a34262d => generated 1323 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:04.432110 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-54f7f8d7-b005-42c3-9b74-ccc215ef1bf6 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] HTTP exception thrown: Instance 3b17e574-b449-4b57-b82d-82303ec940ab could not be found. Oct 26 13:04:04.432110 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-54f7f8d7-b005-42c3-9b74-ccc215ef1bf6 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Request method failure captured: Oct 26 13:04:04.432110 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab HTTP/1.1 Oct 26 13:04:04.432110 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:04:04.432110 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:04:04.432110 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:04:04.432110 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:04:04.432110 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:04:04.432110 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:04:04.432110 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:04:04.432110 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:04:04.432110 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTAIUlcDdvmXcYellMsasLNnqn0BGOjlhXLtrj8OAOrd7AKrqP4ESBCsTpNYa2XiyP0VRRVWRpvMrmtt-VPOQq4DNs_D8viXIzsESxkjhi5d63I0jDreZ00025XqPpgeqh3e_ihULNHbs7l4t26vsoGVUK3DE4liqEZTrzkNSO_wESU Oct 26 13:04:04.432110 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:04:04.432110 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:04:04.432110 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:04:04.432110 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:04:04.432110 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:04:04.432110 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:04:04.432110 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: d4e2b56ef8db404ca0372e0a9c5f9b16 Oct 26 13:04:04.432110 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-LiveMigrationNegativeTest-1505843340 Oct 26 13:04:04.432110 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:04:04.432110 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:04:04.433567 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d4e2b56ef8db404ca0372e0a9c5f9b16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d4e2b56ef8db404ca0372e0a9c5f9b16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d4e2b56ef8db404ca0372e0a9c5f9b16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d4e2b56ef8db404ca0372e0a9c5f9b16"}]}] Oct 26 13:04:04.433567 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-LiveMigrationNegativeTest-1505843340 Oct 26 13:04:04.433567 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: d4e2b56ef8db404ca0372e0a9c5f9b16 Oct 26 13:04:04.433567 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1505843340 Oct 26 13:04:04.433567 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-LiveMigrationNegativeTest-1505843340-project Oct 26 13:04:04.433567 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:04:04.433567 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:04:04.433567 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 999ac729ed1f4456857c8671d4b9be8a Oct 26 13:04:04.433567 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-LiveMigrationNegativeTest-1505843340-project Oct 26 13:04:04.433567 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:04:04.433567 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 3b17e574-b449-4b57-b82d-82303ec940ab could not be found. Oct 26 13:04:04.433567 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '3b17e574-b449-4b57-b82d-82303ec940ab'} Oct 26 13:04:04.434260 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:04:04.434260 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:04.434260 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:04:04.434260 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:04:04.434260 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:04:04.434260 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:04:04.434260 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:04:04.434260 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:04:04.434260 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:04:04.434260 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:04:04.434260 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b17e574-b449-4b57-b82d-82303ec940ab could not be found. Oct 26 13:04:04.434260 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:04.434260 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:04:04.434260 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:04.434260 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:04.434260 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:04:04.434260 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:04:04.434260 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:04:04.434260 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:04:04.434260 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:04:04.435329 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:04:04.435329 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:04:04.435329 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:04:04.435329 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:04:04.435329 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:04:04.435329 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:04:04.435329 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:04:04.435329 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b17e574-b449-4b57-b82d-82303ec940ab could not be found. Oct 26 13:04:04.435329 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:04.435329 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:04:04.435329 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:04.435329 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:04.435329 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:04:04.435329 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:04:04.435329 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:04:04.435329 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:04:04.435329 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b17e574-b449-4b57-b82d-82303ec940ab could not be found. Oct 26 13:04:04.435329 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:04.436324 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-54f7f8d7-b005-42c3-9b74-ccc215ef1bf6 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Returning 404 to user: Instance 3b17e574-b449-4b57-b82d-82303ec940ab could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:04:04.436324 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-54f7f8d7-b005-42c3-9b74-ccc215ef1bf6 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] 10.222.0.40 "GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab" status: 404 len: 111 microversion: 2.1 time: 0.050583 Oct 26 13:04:04.436324 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 266/470] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:04 2022] GET /compute/v2.1/servers/3b17e574-b449-4b57-b82d-82303ec940ab => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:04:04.442121 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1ec16c65-cc32-4ab7-93a8-6d9bab518184 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:04.442632 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1ec16c65-cc32-4ab7-93a8-6d9bab518184 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] [instance: 32f65838-4cb1-4465-977b-2d320a3e3858] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:04.455514 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1ec16c65-cc32-4ab7-93a8-6d9bab518184 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:04.456003 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1ec16c65-cc32-4ab7-93a8-6d9bab518184 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:04.456433 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1ec16c65-cc32-4ab7-93a8-6d9bab518184 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:04.457139 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1ec16c65-cc32-4ab7-93a8-6d9bab518184 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:04.457627 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1ec16c65-cc32-4ab7-93a8-6d9bab518184 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:04.458054 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1ec16c65-cc32-4ab7-93a8-6d9bab518184 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:04.508289 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-36398333-0317-4559-a06e-c977d0c90d91 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:04.509956 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-36398333-0317-4559-a06e-c977d0c90d91 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] [instance: 94b34e04-9a27-4158-aff1-95f37f1c7a58] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:04.519810 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-36398333-0317-4559-a06e-c977d0c90d91 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:04.520270 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-36398333-0317-4559-a06e-c977d0c90d91 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:04.526437 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-36398333-0317-4559-a06e-c977d0c90d91 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:04.527462 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-36398333-0317-4559-a06e-c977d0c90d91 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:04.528100 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-36398333-0317-4559-a06e-c977d0c90d91 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:04.531325 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1ec16c65-cc32-4ab7-93a8-6d9bab518184 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] [instance: 32f65838-4cb1-4465-977b-2d320a3e3858] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:04:04.532953 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-36398333-0317-4559-a06e-c977d0c90d91 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:04.707312 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-36398333-0317-4559-a06e-c977d0c90d91 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c240bdb5dd7249c79d9620637d0c6e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81334bcb49d84a529558a88b02b6ef55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:04.715782 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1ec16c65-cc32-4ab7-93a8-6d9bab518184 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] 10.222.0.40 "DELETE /compute/v2.1/servers/32f65838-4cb1-4465-977b-2d320a3e3858" status: 204 len: 0 microversion: 2.1 time: 0.278691 Oct 26 13:04:04.717244 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 205/471] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:04:04 2022] DELETE /compute/v2.1/servers/32f65838-4cb1-4465-977b-2d320a3e3858 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:04:04.722747 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-aacb66d2-c99d-471f-b00e-97c2324e358b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:04.724271 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-aacb66d2-c99d-471f-b00e-97c2324e358b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:04.728378 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-36398333-0317-4559-a06e-c977d0c90d91 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] 10.222.0.40 "GET /compute/v2.1/servers/94b34e04-9a27-4158-aff1-95f37f1c7a58" status: 200 len: 1272 microversion: 2.1 time: 0.224010 Oct 26 13:04:04.735708 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 267/472] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:04 2022] GET /compute/v2.1/servers/94b34e04-9a27-4158-aff1-95f37f1c7a58 => generated 1272 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:04.740219 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aacb66d2-c99d-471f-b00e-97c2324e358b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:04.740460 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c54fa89d-c698-4364-9eb5-3bada024bd38 tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Action: 'update', calling method: .version_select at 0x7f6732acc670>, body: {"quota_set": {"ram": "2048"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:04.741136 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aacb66d2-c99d-471f-b00e-97c2324e358b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:04.741787 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aacb66d2-c99d-471f-b00e-97c2324e358b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:04.742686 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aacb66d2-c99d-471f-b00e-97c2324e358b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:04.743863 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aacb66d2-c99d-471f-b00e-97c2324e358b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:04.744615 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aacb66d2-c99d-471f-b00e-97c2324e358b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:04.851228 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c54fa89d-c698-4364-9eb5-3bada024bd38 tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:04.852163 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c54fa89d-c698-4364-9eb5-3bada024bd38 tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:04.852686 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c54fa89d-c698-4364-9eb5-3bada024bd38 tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:04.854078 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c54fa89d-c698-4364-9eb5-3bada024bd38 tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:04.854571 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c54fa89d-c698-4364-9eb5-3bada024bd38 tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:04.855134 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c54fa89d-c698-4364-9eb5-3bada024bd38 tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:04.916639 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c54fa89d-c698-4364-9eb5-3bada024bd38 tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:04.917420 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c54fa89d-c698-4364-9eb5-3bada024bd38 tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:04.918066 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c54fa89d-c698-4364-9eb5-3bada024bd38 tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:04.918978 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c54fa89d-c698-4364-9eb5-3bada024bd38 tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:04.920239 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c54fa89d-c698-4364-9eb5-3bada024bd38 tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:04.920915 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c54fa89d-c698-4364-9eb5-3bada024bd38 tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:05.034793 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c54fa89d-c698-4364-9eb5-3bada024bd38 tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/0f0750fe70f84dffb2e59c3ed820f91d?user_id=b0a4311a65a341d88eb1b380b5ad2baa" status: 200 len: 328 microversion: 2.1 time: 0.297142 Oct 26 13:04:05.036434 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 268/473] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Oct 26 13:04:04 2022] PUT /compute/v2.1/os-quota-sets/0f0750fe70f84dffb2e59c3ed820f91d?user_id=b0a4311a65a341d88eb1b380b5ad2baa => generated 328 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:05.043796 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-878378a3-624d-4be4-8189-d767eeaae1b8 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:05.045659 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-878378a3-624d-4be4-8189-d767eeaae1b8 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] [instance: 32f65838-4cb1-4465-977b-2d320a3e3858] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:05.055966 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-878378a3-624d-4be4-8189-d767eeaae1b8 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:05.057964 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-878378a3-624d-4be4-8189-d767eeaae1b8 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:05.058651 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-878378a3-624d-4be4-8189-d767eeaae1b8 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:05.059563 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-878378a3-624d-4be4-8189-d767eeaae1b8 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:05.060389 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-878378a3-624d-4be4-8189-d767eeaae1b8 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:05.061167 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-878378a3-624d-4be4-8189-d767eeaae1b8 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:05.201772 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-aacb66d2-c99d-471f-b00e-97c2324e358b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:05.213133 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-aacb66d2-c99d-471f-b00e-97c2324e358b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1469 microversion: 2.1 time: 0.491263 Oct 26 13:04:05.213769 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 206/474] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:04 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1469 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:05.218585 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-68ef7cac-c038-4bf6-a338-812c8dbaf130 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:05.219370 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-68ef7cac-c038-4bf6-a338-812c8dbaf130 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3e395c36-3e81-4ca3-ab5c-a034d92f8288] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:05.237108 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-68ef7cac-c038-4bf6-a338-812c8dbaf130 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:05.237980 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-68ef7cac-c038-4bf6-a338-812c8dbaf130 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:05.238578 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-68ef7cac-c038-4bf6-a338-812c8dbaf130 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:05.246018 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-68ef7cac-c038-4bf6-a338-812c8dbaf130 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:05.246759 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-68ef7cac-c038-4bf6-a338-812c8dbaf130 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:05.247418 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-68ef7cac-c038-4bf6-a338-812c8dbaf130 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:05.419881 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-878378a3-624d-4be4-8189-d767eeaae1b8 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999ac729ed1f4456857c8671d4b9be8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e2b56ef8db404ca0372e0a9c5f9b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:05.437457 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-878378a3-624d-4be4-8189-d767eeaae1b8 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] 10.222.0.40 "GET /compute/v2.1/servers/32f65838-4cb1-4465-977b-2d320a3e3858" status: 200 len: 1473 microversion: 2.1 time: 0.392888 Oct 26 13:04:05.438507 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 269/475] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:05 2022] GET /compute/v2.1/servers/32f65838-4cb1-4465-977b-2d320a3e3858 => generated 1473 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:05.450840 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bb1ab3bb-15f5-470a-a1f1-2c03c0e78890 tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Calling method '.version_select at 0x7f6732a619d0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:05.613783 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bb1ab3bb-15f5-470a-a1f1-2c03c0e78890 tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/0f0750fe70f84dffb2e59c3ed820f91d?user_id=b0a4311a65a341d88eb1b380b5ad2baa" status: 200 len: 370 microversion: 2.1 time: 0.173940 Oct 26 13:04:05.614826 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 270/476] 10.222.0.40 () {58 vars in 1323 bytes} [Wed Oct 26 13:04:05 2022] GET /compute/v2.1/os-quota-sets/0f0750fe70f84dffb2e59c3ed820f91d?user_id=b0a4311a65a341d88eb1b380b5ad2baa => generated 370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:05.637292 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-68ef7cac-c038-4bf6-a338-812c8dbaf130 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:05.647990 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bed65b34-80ec-4470-acad-73e32cc3a180 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:05.650382 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-68ef7cac-c038-4bf6-a338-812c8dbaf130 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:05.651933 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bed65b34-80ec-4470-acad-73e32cc3a180 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:05.665916 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-68ef7cac-c038-4bf6-a338-812c8dbaf130 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:05.667600 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-68ef7cac-c038-4bf6-a338-812c8dbaf130 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288" status: 200 len: 1566 microversion: 2.25 time: 0.452691 Oct 26 13:04:05.669540 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 207/477] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:05 2022] GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288 => generated 1566 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:05.674206 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bed65b34-80ec-4470-acad-73e32cc3a180 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:05.674894 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bed65b34-80ec-4470-acad-73e32cc3a180 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:05.676167 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bed65b34-80ec-4470-acad-73e32cc3a180 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:05.679674 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-22330275-7ed9-47f8-8368-bb6dccdb51ac tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:05.681169 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bed65b34-80ec-4470-acad-73e32cc3a180 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:05.683903 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bed65b34-80ec-4470-acad-73e32cc3a180 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:05.685398 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bed65b34-80ec-4470-acad-73e32cc3a180 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:05.689611 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-22330275-7ed9-47f8-8368-bb6dccdb51ac tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] [instance: 710484b5-6fbe-4a33-8585-a5117a34262d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:05.718928 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22330275-7ed9-47f8-8368-bb6dccdb51ac tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:05.720749 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22330275-7ed9-47f8-8368-bb6dccdb51ac tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:05.721373 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22330275-7ed9-47f8-8368-bb6dccdb51ac tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:05.724570 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22330275-7ed9-47f8-8368-bb6dccdb51ac tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:05.725375 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22330275-7ed9-47f8-8368-bb6dccdb51ac tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:05.726189 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22330275-7ed9-47f8-8368-bb6dccdb51ac tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:05.769629 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:04:05.894894 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bed65b34-80ec-4470-acad-73e32cc3a180 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "POST /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45/action" status: 204 len: 0 microversion: 2.1 time: 0.265000 Oct 26 13:04:05.896052 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 271/478] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:04:05 2022] POST /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45/action => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:04:05.901407 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2d1840d3-7581-4ae4-a1ce-5c55b8ba527c tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:05.910696 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2d1840d3-7581-4ae4-a1ce-5c55b8ba527c tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] [instance: 94b34e04-9a27-4158-aff1-95f37f1c7a58] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:05.920260 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d1840d3-7581-4ae4-a1ce-5c55b8ba527c tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:05.925365 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d1840d3-7581-4ae4-a1ce-5c55b8ba527c tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:05.926079 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d1840d3-7581-4ae4-a1ce-5c55b8ba527c tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:05.927003 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d1840d3-7581-4ae4-a1ce-5c55b8ba527c tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:05.927587 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d1840d3-7581-4ae4-a1ce-5c55b8ba527c tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:05.933090 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d1840d3-7581-4ae4-a1ce-5c55b8ba527c tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:06.115308 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2d1840d3-7581-4ae4-a1ce-5c55b8ba527c tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c240bdb5dd7249c79d9620637d0c6e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81334bcb49d84a529558a88b02b6ef55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:06.130355 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2d1840d3-7581-4ae4-a1ce-5c55b8ba527c tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] 10.222.0.40 "GET /compute/v2.1/servers/94b34e04-9a27-4158-aff1-95f37f1c7a58" status: 200 len: 1278 microversion: 2.1 time: 0.232983 Oct 26 13:04:06.131286 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 272/479] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:05 2022] GET /compute/v2.1/servers/94b34e04-9a27-4158-aff1-95f37f1c7a58 => generated 1278 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:06.138225 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2c8322fe-aac7-49f5-b38d-5469142945f2 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:06.143949 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2c8322fe-aac7-49f5-b38d-5469142945f2 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:06.163882 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2c8322fe-aac7-49f5-b38d-5469142945f2 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:06.164505 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2c8322fe-aac7-49f5-b38d-5469142945f2 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:06.165137 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2c8322fe-aac7-49f5-b38d-5469142945f2 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:06.165967 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2c8322fe-aac7-49f5-b38d-5469142945f2 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:06.167282 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2c8322fe-aac7-49f5-b38d-5469142945f2 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:06.167804 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2c8322fe-aac7-49f5-b38d-5469142945f2 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:06.272135 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-22330275-7ed9-47f8-8368-bb6dccdb51ac tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6506f19875d47ef81996f0c66a009ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588d8f9d1bd40d1b1dc487da7c572cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:06.280766 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-22330275-7ed9-47f8-8368-bb6dccdb51ac tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] 10.222.0.40 "GET /compute/v2.1/servers/710484b5-6fbe-4a33-8585-a5117a34262d" status: 200 len: 1323 microversion: 2.1 time: 0.608420 Oct 26 13:04:06.281349 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 208/480] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:05 2022] GET /compute/v2.1/servers/710484b5-6fbe-4a33-8585-a5117a34262d => generated 1323 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:06.300484 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a270e0e0-687f-4a94-a64c-806a28b212fa tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Calling method '.version_select at 0x7f67331668b0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:06.512757 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2c8322fe-aac7-49f5-b38d-5469142945f2 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:06.530012 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2c8322fe-aac7-49f5-b38d-5469142945f2 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1469 microversion: 2.1 time: 0.397354 Oct 26 13:04:06.536660 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 273/481] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:06 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1469 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:06.544597 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-69c6f8b3-2ae5-4b07-92fc-c9704d5f404e tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:06.557593 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-69c6f8b3-2ae5-4b07-92fc-c9704d5f404e tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] [instance: 32f65838-4cb1-4465-977b-2d320a3e3858] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:06.577188 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-69c6f8b3-2ae5-4b07-92fc-c9704d5f404e tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:06.580357 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-69c6f8b3-2ae5-4b07-92fc-c9704d5f404e tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:06.582851 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-69c6f8b3-2ae5-4b07-92fc-c9704d5f404e tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:06.583861 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-69c6f8b3-2ae5-4b07-92fc-c9704d5f404e tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:06.587596 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a270e0e0-687f-4a94-a64c-806a28b212fa tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/ee91dec30d8c42138ef2d65c92c5b173/defaults" status: 200 len: 371 microversion: 2.1 time: 0.291187 Oct 26 13:04:06.589466 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-69c6f8b3-2ae5-4b07-92fc-c9704d5f404e tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:06.589707 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 209/482] 10.222.0.40 () {58 vars in 1269 bytes} [Wed Oct 26 13:04:06 2022] GET /compute/v2.1/os-quota-sets/ee91dec30d8c42138ef2d65c92c5b173/defaults => generated 371 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:04:06.590342 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-69c6f8b3-2ae5-4b07-92fc-c9704d5f404e tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:06.609331 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-42ad7f22-fd64-4eab-8883-825e7323855f tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Action: 'update', calling method: .version_select at 0x7f6732ea8af0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:06.725124 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-42ad7f22-fd64-4eab-8883-825e7323855f tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:06.725895 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-42ad7f22-fd64-4eab-8883-825e7323855f tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:06.726566 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-42ad7f22-fd64-4eab-8883-825e7323855f tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:06.728738 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-42ad7f22-fd64-4eab-8883-825e7323855f tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:06.729415 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-42ad7f22-fd64-4eab-8883-825e7323855f tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:06.730023 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-42ad7f22-fd64-4eab-8883-825e7323855f tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:06.886707 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=7 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:04:07.092460 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-42ad7f22-fd64-4eab-8883-825e7323855f tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/ee91dec30d8c42138ef2d65c92c5b173" status: 200 len: 329 microversion: 2.1 time: 0.494719 Oct 26 13:04:07.094658 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 210/483] 10.222.0.40 () {60 vars in 1263 bytes} [Wed Oct 26 13:04:06 2022] PUT /compute/v2.1/os-quota-sets/ee91dec30d8c42138ef2d65c92c5b173 => generated 329 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:07.101378 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-64c51757-42ea-4c25-a32a-3e6dbf0f9087 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:07.102916 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-64c51757-42ea-4c25-a32a-3e6dbf0f9087 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3e395c36-3e81-4ca3-ab5c-a034d92f8288] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:07.110889 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64c51757-42ea-4c25-a32a-3e6dbf0f9087 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:07.112764 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64c51757-42ea-4c25-a32a-3e6dbf0f9087 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:07.114110 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64c51757-42ea-4c25-a32a-3e6dbf0f9087 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:07.115062 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64c51757-42ea-4c25-a32a-3e6dbf0f9087 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:07.115734 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64c51757-42ea-4c25-a32a-3e6dbf0f9087 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:07.116372 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64c51757-42ea-4c25-a32a-3e6dbf0f9087 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:07.168898 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-69c6f8b3-2ae5-4b07-92fc-c9704d5f404e tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999ac729ed1f4456857c8671d4b9be8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e2b56ef8db404ca0372e0a9c5f9b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:07.177086 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-69c6f8b3-2ae5-4b07-92fc-c9704d5f404e tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] 10.222.0.40 "GET /compute/v2.1/servers/32f65838-4cb1-4465-977b-2d320a3e3858" status: 200 len: 1473 microversion: 2.1 time: 0.638971 Oct 26 13:04:07.177696 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 274/484] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:06 2022] GET /compute/v2.1/servers/32f65838-4cb1-4465-977b-2d320a3e3858 => generated 1473 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:07.182138 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4cf60276-fe6f-4946-8f4a-ff156397049f tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Action: 'update', calling method: .version_select at 0x7f6732acc040>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:07.348847 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cf60276-fe6f-4946-8f4a-ff156397049f tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:07.349253 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cf60276-fe6f-4946-8f4a-ff156397049f tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:07.349789 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cf60276-fe6f-4946-8f4a-ff156397049f tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:07.350543 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cf60276-fe6f-4946-8f4a-ff156397049f tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:07.350994 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cf60276-fe6f-4946-8f4a-ff156397049f tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:07.351422 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cf60276-fe6f-4946-8f4a-ff156397049f tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:07.480770 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:04:07.673159 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-64c51757-42ea-4c25-a32a-3e6dbf0f9087 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:07.693575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-64c51757-42ea-4c25-a32a-3e6dbf0f9087 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:07.695116 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-64c51757-42ea-4c25-a32a-3e6dbf0f9087 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:07.696489 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-64c51757-42ea-4c25-a32a-3e6dbf0f9087 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288" status: 200 len: 1566 microversion: 2.25 time: 0.600336 Oct 26 13:04:07.718781 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 211/485] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:07 2022] GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288 => generated 1566 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:07.758011 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d4486d3f-3a0e-4d27-a301-d7b6890b7a49 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:07.760042 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d4486d3f-3a0e-4d27-a301-d7b6890b7a49 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] [instance: 94b34e04-9a27-4158-aff1-95f37f1c7a58] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:07.788583 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d4486d3f-3a0e-4d27-a301-d7b6890b7a49 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:07.791266 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d4486d3f-3a0e-4d27-a301-d7b6890b7a49 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:07.792086 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d4486d3f-3a0e-4d27-a301-d7b6890b7a49 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:07.793904 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d4486d3f-3a0e-4d27-a301-d7b6890b7a49 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:07.794539 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d4486d3f-3a0e-4d27-a301-d7b6890b7a49 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:07.806712 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d4486d3f-3a0e-4d27-a301-d7b6890b7a49 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:08.109736 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4cf60276-fe6f-4946-8f4a-ff156397049f tempest-QuotasAdminTestJSON-1386947606 tempest-QuotasAdminTestJSON-1386947606-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/ee91dec30d8c42138ef2d65c92c5b173" status: 200 len: 329 microversion: 2.1 time: 0.930849 Oct 26 13:04:08.117827 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 275/486] 10.222.0.40 () {60 vars in 1263 bytes} [Wed Oct 26 13:04:07 2022] PUT /compute/v2.1/os-quota-sets/ee91dec30d8c42138ef2d65c92c5b173 => generated 329 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:08.129987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d4486d3f-3a0e-4d27-a301-d7b6890b7a49 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c240bdb5dd7249c79d9620637d0c6e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81334bcb49d84a529558a88b02b6ef55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:08.139108 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d4486d3f-3a0e-4d27-a301-d7b6890b7a49 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] 10.222.0.40 "GET /compute/v2.1/servers/94b34e04-9a27-4158-aff1-95f37f1c7a58" status: 200 len: 1278 microversion: 2.1 time: 0.418699 Oct 26 13:04:08.139518 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-eb1de511-dd65-4163-b3c7-da1eeaca8de7 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:08.141832 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-eb1de511-dd65-4163-b3c7-da1eeaca8de7 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] [instance: 710484b5-6fbe-4a33-8585-a5117a34262d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:08.143668 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 212/487] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:07 2022] GET /compute/v2.1/servers/94b34e04-9a27-4158-aff1-95f37f1c7a58 => generated 1278 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:08.148350 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c49575d0-a6f2-420a-98ce-27e315304fed tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:08.148937 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c49575d0-a6f2-420a-98ce-27e315304fed tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:08.154594 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb1de511-dd65-4163-b3c7-da1eeaca8de7 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:08.166321 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb1de511-dd65-4163-b3c7-da1eeaca8de7 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:08.166928 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb1de511-dd65-4163-b3c7-da1eeaca8de7 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:08.170104 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb1de511-dd65-4163-b3c7-da1eeaca8de7 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:08.174289 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb1de511-dd65-4163-b3c7-da1eeaca8de7 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:08.174907 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb1de511-dd65-4163-b3c7-da1eeaca8de7 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:08.178594 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c49575d0-a6f2-420a-98ce-27e315304fed tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:08.179307 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c49575d0-a6f2-420a-98ce-27e315304fed tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:08.179927 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c49575d0-a6f2-420a-98ce-27e315304fed tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:08.181009 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c49575d0-a6f2-420a-98ce-27e315304fed tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:08.184516 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c49575d0-a6f2-420a-98ce-27e315304fed tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:08.185155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c49575d0-a6f2-420a-98ce-27e315304fed tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:08.895835 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c49575d0-a6f2-420a-98ce-27e315304fed tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:08.907186 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c49575d0-a6f2-420a-98ce-27e315304fed tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1469 microversion: 2.1 time: 0.762398 Oct 26 13:04:08.909769 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 213/488] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:08 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1469 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:08.919999 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-1a81cc77-9913-443e-ac44-ec1270145eb4 req-a318c79e-f4be-4f7f-9832-6c9f36ac0100 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32f65838-4cb1-4465-977b-2d320a3e3858", "name": "network-vif-deleted", "tag": "6503d4b6-a910-49e8-bb75-864fa2fe4537"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:08.948572 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-1a81cc77-9913-443e-ac44-ec1270145eb4 req-a318c79e-f4be-4f7f-9832-6c9f36ac0100 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:08.949442 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-1a81cc77-9913-443e-ac44-ec1270145eb4 req-a318c79e-f4be-4f7f-9832-6c9f36ac0100 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:08.950155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-1a81cc77-9913-443e-ac44-ec1270145eb4 req-a318c79e-f4be-4f7f-9832-6c9f36ac0100 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:08.976972 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-1a81cc77-9913-443e-ac44-ec1270145eb4 req-a318c79e-f4be-4f7f-9832-6c9f36ac0100 service nova] Creating event network-vif-deleted:6503d4b6-a910-49e8-bb75-864fa2fe4537 for instance 32f65838-4cb1-4465-977b-2d320a3e3858 on n-h1-862686-1 Oct 26 13:04:08.989104 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-1a81cc77-9913-443e-ac44-ec1270145eb4 req-a318c79e-f4be-4f7f-9832-6c9f36ac0100 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076275 Oct 26 13:04:08.990353 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 214/489] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:09.006717 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8fdc82ca-c45e-405e-8102-2530efaf359b tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:09.009247 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8fdc82ca-c45e-405e-8102-2530efaf359b tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] [instance: 32f65838-4cb1-4465-977b-2d320a3e3858] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:09.018232 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8fdc82ca-c45e-405e-8102-2530efaf359b tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:09.018963 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8fdc82ca-c45e-405e-8102-2530efaf359b tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:09.019833 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8fdc82ca-c45e-405e-8102-2530efaf359b tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:09.021393 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8fdc82ca-c45e-405e-8102-2530efaf359b tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:09.023584 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8fdc82ca-c45e-405e-8102-2530efaf359b tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:09.025196 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8fdc82ca-c45e-405e-8102-2530efaf359b tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:09.087807 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8fdc82ca-c45e-405e-8102-2530efaf359b tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:09.088943 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8fdc82ca-c45e-405e-8102-2530efaf359b tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:09.093142 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8fdc82ca-c45e-405e-8102-2530efaf359b tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:09.094113 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-8fdc82ca-c45e-405e-8102-2530efaf359b tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lazy-loading 'fault' on Instance uuid 32f65838-4cb1-4465-977b-2d320a3e3858 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:04:09.128281 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-eb1de511-dd65-4163-b3c7-da1eeaca8de7 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6506f19875d47ef81996f0c66a009ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588d8f9d1bd40d1b1dc487da7c572cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:09.140417 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-eb1de511-dd65-4163-b3c7-da1eeaca8de7 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] 10.222.0.40 "GET /compute/v2.1/servers/710484b5-6fbe-4a33-8585-a5117a34262d" status: 200 len: 1323 microversion: 2.1 time: 1.025756 Oct 26 13:04:09.145235 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 276/490] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:08 2022] GET /compute/v2.1/servers/710484b5-6fbe-4a33-8585-a5117a34262d => generated 1323 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:09.175144 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-531cc00a-cd0d-410b-b153-46188d060f26 req-d3fb8dc1-efc2-4f78-bc39-ae9abe6cdbbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c858b29-db9e-4d65-af6d-86b6e1d36c45", "name": "network-vif-plugged", "status": "completed", "tag": "fbefc9ba-9ae6-4d00-93d2-059d7c60c35f"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:09.201414 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-531cc00a-cd0d-410b-b153-46188d060f26 req-d3fb8dc1-efc2-4f78-bc39-ae9abe6cdbbf service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:09.202429 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-531cc00a-cd0d-410b-b153-46188d060f26 req-d3fb8dc1-efc2-4f78-bc39-ae9abe6cdbbf service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:09.203311 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-531cc00a-cd0d-410b-b153-46188d060f26 req-d3fb8dc1-efc2-4f78-bc39-ae9abe6cdbbf service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:09.222609 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8fdc82ca-c45e-405e-8102-2530efaf359b tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999ac729ed1f4456857c8671d4b9be8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e2b56ef8db404ca0372e0a9c5f9b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:09.223647 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-531cc00a-cd0d-410b-b153-46188d060f26 req-d3fb8dc1-efc2-4f78-bc39-ae9abe6cdbbf service nova] Creating event network-vif-plugged:fbefc9ba-9ae6-4d00-93d2-059d7c60c35f for instance 3c858b29-db9e-4d65-af6d-86b6e1d36c45 on n-h2-862686-1 Oct 26 13:04:09.233867 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8fdc82ca-c45e-405e-8102-2530efaf359b tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] 10.222.0.40 "GET /compute/v2.1/servers/32f65838-4cb1-4465-977b-2d320a3e3858" status: 200 len: 1308 microversion: 2.1 time: 0.241637 Oct 26 13:04:09.234668 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 215/491] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:08 2022] GET /compute/v2.1/servers/32f65838-4cb1-4465-977b-2d320a3e3858 => generated 1308 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:09.235789 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [req-531cc00a-cd0d-410b-b153-46188d060f26 req-d3fb8dc1-efc2-4f78-bc39-ae9abe6cdbbf service nova] Instance 3c858b29-db9e-4d65-af6d-86b6e1d36c45 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862686-1', 'n-h1-862686-1'} {{(pid=120598) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 13:04:09.245811 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-73a599d0-158e-4556-9528-149fe31d3c80 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:09.245811 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-73a599d0-158e-4556-9528-149fe31d3c80 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3e395c36-3e81-4ca3-ab5c-a034d92f8288] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:09.256203 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-531cc00a-cd0d-410b-b153-46188d060f26 req-d3fb8dc1-efc2-4f78-bc39-ae9abe6cdbbf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105143 Oct 26 13:04:09.257016 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 277/492] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:09.268692 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73a599d0-158e-4556-9528-149fe31d3c80 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:09.269721 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73a599d0-158e-4556-9528-149fe31d3c80 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:09.270174 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73a599d0-158e-4556-9528-149fe31d3c80 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:09.270395 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-843f5fb0-d52e-49de-9532-7bb112a17737 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:09.270897 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73a599d0-158e-4556-9528-149fe31d3c80 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:09.271363 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73a599d0-158e-4556-9528-149fe31d3c80 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:09.271794 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73a599d0-158e-4556-9528-149fe31d3c80 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:09.271946 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-843f5fb0-d52e-49de-9532-7bb112a17737 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] [instance: 94b34e04-9a27-4158-aff1-95f37f1c7a58] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:09.286774 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-843f5fb0-d52e-49de-9532-7bb112a17737 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:09.287483 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-843f5fb0-d52e-49de-9532-7bb112a17737 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:09.288028 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-843f5fb0-d52e-49de-9532-7bb112a17737 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:09.288880 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-843f5fb0-d52e-49de-9532-7bb112a17737 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:09.290824 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-843f5fb0-d52e-49de-9532-7bb112a17737 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:09.291420 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-843f5fb0-d52e-49de-9532-7bb112a17737 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:09.542488 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-843f5fb0-d52e-49de-9532-7bb112a17737 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c240bdb5dd7249c79d9620637d0c6e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81334bcb49d84a529558a88b02b6ef55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:09.553882 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-843f5fb0-d52e-49de-9532-7bb112a17737 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] 10.222.0.40 "GET /compute/v2.1/servers/94b34e04-9a27-4158-aff1-95f37f1c7a58" status: 200 len: 1320 microversion: 2.1 time: 0.291905 Oct 26 13:04:09.570158 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 278/493] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:09 2022] GET /compute/v2.1/servers/94b34e04-9a27-4158-aff1-95f37f1c7a58 => generated 1320 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:09.937600 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1435bd7a-c0c4-4541-87a8-0e194a36a9e8 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:09.938963 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1435bd7a-c0c4-4541-87a8-0e194a36a9e8 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:09.955545 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1435bd7a-c0c4-4541-87a8-0e194a36a9e8 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:09.959278 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1435bd7a-c0c4-4541-87a8-0e194a36a9e8 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:09.959750 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1435bd7a-c0c4-4541-87a8-0e194a36a9e8 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:09.963354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1435bd7a-c0c4-4541-87a8-0e194a36a9e8 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:09.965076 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1435bd7a-c0c4-4541-87a8-0e194a36a9e8 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:09.965728 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1435bd7a-c0c4-4541-87a8-0e194a36a9e8 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:10.349086 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-73a599d0-158e-4556-9528-149fe31d3c80 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:10.364948 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-73a599d0-158e-4556-9528-149fe31d3c80 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:10.366507 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-73a599d0-158e-4556-9528-149fe31d3c80 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:10.367781 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-73a599d0-158e-4556-9528-149fe31d3c80 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288" status: 200 len: 1566 microversion: 2.25 time: 1.132354 Oct 26 13:04:10.382851 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 216/494] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:09 2022] GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288 => generated 1566 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:10.394417 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6029aa4b-404a-4d66-bb1f-a317395b4438 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:10.397763 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6029aa4b-404a-4d66-bb1f-a317395b4438 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] [instance: 710484b5-6fbe-4a33-8585-a5117a34262d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:10.411475 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6029aa4b-404a-4d66-bb1f-a317395b4438 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:10.414053 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6029aa4b-404a-4d66-bb1f-a317395b4438 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:10.414671 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6029aa4b-404a-4d66-bb1f-a317395b4438 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:10.420420 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6029aa4b-404a-4d66-bb1f-a317395b4438 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:10.421147 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6029aa4b-404a-4d66-bb1f-a317395b4438 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:10.421776 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6029aa4b-404a-4d66-bb1f-a317395b4438 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:10.533893 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1435bd7a-c0c4-4541-87a8-0e194a36a9e8 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:10.547515 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1435bd7a-c0c4-4541-87a8-0e194a36a9e8 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1461 microversion: 2.1 time: 0.614493 Oct 26 13:04:10.550228 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 279/495] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:09 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1461 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:04:10.565372 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4a190fa6-32e1-4b8f-9155-89106c0ba078 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:10.572705 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4a190fa6-32e1-4b8f-9155-89106c0ba078 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] [instance: 32f65838-4cb1-4465-977b-2d320a3e3858] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:10.592723 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a190fa6-32e1-4b8f-9155-89106c0ba078 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:10.593224 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a190fa6-32e1-4b8f-9155-89106c0ba078 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:10.595892 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a190fa6-32e1-4b8f-9155-89106c0ba078 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:10.598436 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a190fa6-32e1-4b8f-9155-89106c0ba078 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:10.599091 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a190fa6-32e1-4b8f-9155-89106c0ba078 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:10.599800 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a190fa6-32e1-4b8f-9155-89106c0ba078 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:10.661400 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-4a190fa6-32e1-4b8f-9155-89106c0ba078 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] HTTP exception thrown: Instance 32f65838-4cb1-4465-977b-2d320a3e3858 could not be found. Oct 26 13:04:10.667223 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4a190fa6-32e1-4b8f-9155-89106c0ba078 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Request method failure captured: Oct 26 13:04:10.667223 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/32f65838-4cb1-4465-977b-2d320a3e3858 HTTP/1.1 Oct 26 13:04:10.667223 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:04:10.667223 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:04:10.667223 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:04:10.667223 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:04:10.667223 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:04:10.667223 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:04:10.667223 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:04:10.667223 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:04:10.667223 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTAIUlcDdvmXcYellMsasLNnqn0BGOjlhXLtrj8OAOrd7AKrqP4ESBCsTpNYa2XiyP0VRRVWRpvMrmtt-VPOQq4DNs_D8viXIzsESxkjhi5d63I0jDreZ00025XqPpgeqh3e_ihULNHbs7l4t26vsoGVUK3DE4liqEZTrzkNSO_wESU Oct 26 13:04:10.667223 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:04:10.667223 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:04:10.667223 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:04:10.667223 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:04:10.667223 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:04:10.667223 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:04:10.667223 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: d4e2b56ef8db404ca0372e0a9c5f9b16 Oct 26 13:04:10.667223 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-LiveMigrationNegativeTest-1505843340 Oct 26 13:04:10.667223 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:04:10.667223 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:04:10.668507 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d4e2b56ef8db404ca0372e0a9c5f9b16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d4e2b56ef8db404ca0372e0a9c5f9b16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d4e2b56ef8db404ca0372e0a9c5f9b16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d4e2b56ef8db404ca0372e0a9c5f9b16"}]}] Oct 26 13:04:10.668507 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-LiveMigrationNegativeTest-1505843340 Oct 26 13:04:10.668507 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: d4e2b56ef8db404ca0372e0a9c5f9b16 Oct 26 13:04:10.668507 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1505843340 Oct 26 13:04:10.668507 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-LiveMigrationNegativeTest-1505843340-project Oct 26 13:04:10.668507 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:04:10.668507 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:04:10.668507 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 999ac729ed1f4456857c8671d4b9be8a Oct 26 13:04:10.668507 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-LiveMigrationNegativeTest-1505843340-project Oct 26 13:04:10.668507 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:04:10.668507 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 32f65838-4cb1-4465-977b-2d320a3e3858 could not be found. Oct 26 13:04:10.668507 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '32f65838-4cb1-4465-977b-2d320a3e3858'} Oct 26 13:04:10.669185 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:04:10.669185 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:10.669185 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:04:10.669185 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:04:10.669185 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:04:10.669185 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:04:10.669185 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:04:10.669185 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:04:10.669185 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:04:10.669185 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:04:10.669185 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32f65838-4cb1-4465-977b-2d320a3e3858 could not be found. Oct 26 13:04:10.669185 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:10.669185 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:04:10.669185 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:10.669185 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:10.669185 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:04:10.669185 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:04:10.669185 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:04:10.669185 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:04:10.669185 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:04:10.670438 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:04:10.670438 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:04:10.670438 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:04:10.670438 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:04:10.670438 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:04:10.670438 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:04:10.670438 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:04:10.670438 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32f65838-4cb1-4465-977b-2d320a3e3858 could not be found. Oct 26 13:04:10.670438 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:10.670438 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:04:10.670438 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:10.670438 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:10.670438 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:04:10.670438 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:04:10.670438 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:04:10.670438 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:04:10.670438 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32f65838-4cb1-4465-977b-2d320a3e3858 could not be found. Oct 26 13:04:10.670438 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:10.673024 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4a190fa6-32e1-4b8f-9155-89106c0ba078 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] Returning 404 to user: Instance 32f65838-4cb1-4465-977b-2d320a3e3858 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:04:10.675561 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4a190fa6-32e1-4b8f-9155-89106c0ba078 tempest-LiveMigrationNegativeTest-1505843340 tempest-LiveMigrationNegativeTest-1505843340-project] 10.222.0.40 "GET /compute/v2.1/servers/32f65838-4cb1-4465-977b-2d320a3e3858" status: 404 len: 111 microversion: 2.1 time: 0.124222 Oct 26 13:04:10.679864 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 280/496] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:10 2022] GET /compute/v2.1/servers/32f65838-4cb1-4465-977b-2d320a3e3858 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:04:10.702669 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-10e7cfa3-96f7-403b-b575-839dc06b4966 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:10.711119 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-10e7cfa3-96f7-403b-b575-839dc06b4966 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:10.724497 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10e7cfa3-96f7-403b-b575-839dc06b4966 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:10.725180 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10e7cfa3-96f7-403b-b575-839dc06b4966 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:10.725928 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10e7cfa3-96f7-403b-b575-839dc06b4966 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:10.726818 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10e7cfa3-96f7-403b-b575-839dc06b4966 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:10.727543 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10e7cfa3-96f7-403b-b575-839dc06b4966 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:10.728313 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10e7cfa3-96f7-403b-b575-839dc06b4966 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:10.799643 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6029aa4b-404a-4d66-bb1f-a317395b4438 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6506f19875d47ef81996f0c66a009ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588d8f9d1bd40d1b1dc487da7c572cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:10.810109 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6029aa4b-404a-4d66-bb1f-a317395b4438 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] 10.222.0.40 "GET /compute/v2.1/servers/710484b5-6fbe-4a33-8585-a5117a34262d" status: 200 len: 1323 microversion: 2.1 time: 0.425205 Oct 26 13:04:10.825522 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 217/497] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:10 2022] GET /compute/v2.1/servers/710484b5-6fbe-4a33-8585-a5117a34262d => generated 1323 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:10.829134 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-709f3845-cb3f-4825-a2e0-bef2e2d1f432 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:10.829318 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-709f3845-cb3f-4825-a2e0-bef2e2d1f432 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] [instance: 94b34e04-9a27-4158-aff1-95f37f1c7a58] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:10.846985 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-709f3845-cb3f-4825-a2e0-bef2e2d1f432 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:10.847840 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-709f3845-cb3f-4825-a2e0-bef2e2d1f432 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:10.848294 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-709f3845-cb3f-4825-a2e0-bef2e2d1f432 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:10.849015 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-709f3845-cb3f-4825-a2e0-bef2e2d1f432 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:10.849509 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-709f3845-cb3f-4825-a2e0-bef2e2d1f432 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:10.851914 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-709f3845-cb3f-4825-a2e0-bef2e2d1f432 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:11.152339 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-10e7cfa3-96f7-403b-b575-839dc06b4966 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1612 microversion: 2.1 time: 0.470909 Oct 26 13:04:11.166746 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 281/498] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:10 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1612 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:11.272299 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-709f3845-cb3f-4825-a2e0-bef2e2d1f432 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c240bdb5dd7249c79d9620637d0c6e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81334bcb49d84a529558a88b02b6ef55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:11.283089 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-709f3845-cb3f-4825-a2e0-bef2e2d1f432 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] 10.222.0.40 "GET /compute/v2.1/servers/94b34e04-9a27-4158-aff1-95f37f1c7a58" status: 200 len: 1320 microversion: 2.1 time: 0.468034 Oct 26 13:04:11.288719 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 218/499] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:10 2022] GET /compute/v2.1/servers/94b34e04-9a27-4158-aff1-95f37f1c7a58 => generated 1320 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:11.303591 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-582e93c8-817f-4c4b-b442-ee29c334c209 req-8bb0cab8-ca01-4fcd-87b4-570b3b874a58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94b34e04-9a27-4158-aff1-95f37f1c7a58", "tag": "80b659d1-4b85-4552-9b75-2213e7463923"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:11.341505 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-582e93c8-817f-4c4b-b442-ee29c334c209 req-8bb0cab8-ca01-4fcd-87b4-570b3b874a58 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:11.342007 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-582e93c8-817f-4c4b-b442-ee29c334c209 req-8bb0cab8-ca01-4fcd-87b4-570b3b874a58 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:11.345745 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-582e93c8-817f-4c4b-b442-ee29c334c209 req-8bb0cab8-ca01-4fcd-87b4-570b3b874a58 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:11.374611 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-582e93c8-817f-4c4b-b442-ee29c334c209 req-8bb0cab8-ca01-4fcd-87b4-570b3b874a58 service nova] Creating event network-changed:80b659d1-4b85-4552-9b75-2213e7463923 for instance 94b34e04-9a27-4158-aff1-95f37f1c7a58 on n-h2-862686-1 Oct 26 13:04:11.389847 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-582e93c8-817f-4c4b-b442-ee29c334c209 req-8bb0cab8-ca01-4fcd-87b4-570b3b874a58 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096549 Oct 26 13:04:11.390609 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 219/500] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:11.403406 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c0624a81-d2eb-40bb-aa16-54b1210d09c9 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Calling method '.version_select at 0x7f6732da41f0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:11.417067 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0624a81-d2eb-40bb-aa16-54b1210d09c9 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:11.417807 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0624a81-d2eb-40bb-aa16-54b1210d09c9 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:11.418408 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0624a81-d2eb-40bb-aa16-54b1210d09c9 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:11.451156 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c0624a81-d2eb-40bb-aa16-54b1210d09c9 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 791 microversion: 2.1 time: 0.058724 Oct 26 13:04:11.457957 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 220/501] 10.222.0.40 () {58 vars in 1143 bytes} [Wed Oct 26 13:04:11 2022] GET /compute/v2.1/os-migrations => generated 791 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:11.463524 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e33128e9-2eb7-4c92-9886-ab63eb820de8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:11.464263 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e33128e9-2eb7-4c92-9886-ab63eb820de8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3e395c36-3e81-4ca3-ab5c-a034d92f8288] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:11.485258 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e33128e9-2eb7-4c92-9886-ab63eb820de8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:11.485800 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e33128e9-2eb7-4c92-9886-ab63eb820de8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:11.486241 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e33128e9-2eb7-4c92-9886-ab63eb820de8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:11.487142 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e33128e9-2eb7-4c92-9886-ab63eb820de8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:11.487779 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e33128e9-2eb7-4c92-9886-ab63eb820de8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:11.488412 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e33128e9-2eb7-4c92-9886-ab63eb820de8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:11.502782 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:04:11.555462 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d658b4b2-5835-42f1-9a3b-661198f12940 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-857706300", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "d5dfe2c9-28ca-4cae-a6cc-e2ee7f3499d9"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:11.678465 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-d658b4b2-5835-42f1-9a3b-661198f12940 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] validate_networks() for [('d5dfe2c9-28ca-4cae-a6cc-e2ee7f3499d9', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:04:12.117405 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e33128e9-2eb7-4c92-9886-ab63eb820de8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:12.135318 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e33128e9-2eb7-4c92-9886-ab63eb820de8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:12.136999 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e33128e9-2eb7-4c92-9886-ab63eb820de8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:12.138456 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e33128e9-2eb7-4c92-9886-ab63eb820de8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288" status: 200 len: 1566 microversion: 2.25 time: 0.679317 Oct 26 13:04:12.139883 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 221/502] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:11 2022] GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288 => generated 1566 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:12.181390 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-c76d9898-a728-42b5-8bc4-b6fcef08b3b2 req-61665e00-b5ec-478b-96a3-f636e280b442 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "710484b5-6fbe-4a33-8585-a5117a34262d", "name": "network-vif-plugged", "status": "completed", "tag": "370eaf81-0d79-492b-b9bd-a7d2d47e66ef"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:12.214788 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-c76d9898-a728-42b5-8bc4-b6fcef08b3b2 req-61665e00-b5ec-478b-96a3-f636e280b442 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:12.225814 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-c76d9898-a728-42b5-8bc4-b6fcef08b3b2 req-61665e00-b5ec-478b-96a3-f636e280b442 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:12.228435 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-c76d9898-a728-42b5-8bc4-b6fcef08b3b2 req-61665e00-b5ec-478b-96a3-f636e280b442 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:12.258367 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-c76d9898-a728-42b5-8bc4-b6fcef08b3b2 req-61665e00-b5ec-478b-96a3-f636e280b442 service nova] Creating event network-vif-plugged:370eaf81-0d79-492b-b9bd-a7d2d47e66ef for instance 710484b5-6fbe-4a33-8585-a5117a34262d on n-h1-862686-1 Oct 26 13:04:12.266323 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-c76d9898-a728-42b5-8bc4-b6fcef08b3b2 req-61665e00-b5ec-478b-96a3-f636e280b442 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093053 Oct 26 13:04:12.267224 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 222/503] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:12.277905 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f7e503ab-5c29-4705-9d3b-4d0342c5c99b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1115392646", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:12.402945 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-f7e503ab-5c29-4705-9d3b-4d0342c5c99b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] validate_networks() for None {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:04:12.587827 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-d658b4b2-5835-42f1-9a3b-661198f12940 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:04:12.589162 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-d658b4b2-5835-42f1-9a3b-661198f12940 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:04:12.589852 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-d658b4b2-5835-42f1-9a3b-661198f12940 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:04:12.590413 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-d658b4b2-5835-42f1-9a3b-661198f12940 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:04:12.591316 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-d658b4b2-5835-42f1-9a3b-661198f12940 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:04:12.601596 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d658b4b2-5835-42f1-9a3b-661198f12940 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:12.602371 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d658b4b2-5835-42f1-9a3b-661198f12940 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:12.603689 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d658b4b2-5835-42f1-9a3b-661198f12940 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:12.604767 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d658b4b2-5835-42f1-9a3b-661198f12940 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:12.605400 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d658b4b2-5835-42f1-9a3b-661198f12940 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:12.607726 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d658b4b2-5835-42f1-9a3b-661198f12940 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:12.637002 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-d658b4b2-5835-42f1-9a3b-661198f12940 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Getting quotas for project ec66df09b6114f5dbd6678d5e848c737. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:04:12.642122 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-d658b4b2-5835-42f1-9a3b-661198f12940 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Getting quotas for user 241a2299894849c889ee7f1100a9823d and project ec66df09b6114f5dbd6678d5e848c737. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:04:12.658500 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d658b4b2-5835-42f1-9a3b-661198f12940 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:04:12.662071 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d658b4b2-5835-42f1-9a3b-661198f12940 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: dffc2812-b18a-4227-932f-3db590d7bc6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:04:12.722206 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d658b4b2-5835-42f1-9a3b-661198f12940 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.550908 Oct 26 13:04:12.730113 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 282/504] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:04:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:04:12.735512 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0891bd5b-f5e2-4ff0-abc3-735ebd85b494 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:12.736335 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0891bd5b-f5e2-4ff0-abc3-735ebd85b494 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] [instance: 710484b5-6fbe-4a33-8585-a5117a34262d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:12.744215 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0891bd5b-f5e2-4ff0-abc3-735ebd85b494 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:12.745536 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0891bd5b-f5e2-4ff0-abc3-735ebd85b494 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:12.746137 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0891bd5b-f5e2-4ff0-abc3-735ebd85b494 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:12.746953 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0891bd5b-f5e2-4ff0-abc3-735ebd85b494 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:12.747517 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0891bd5b-f5e2-4ff0-abc3-735ebd85b494 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:12.748046 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0891bd5b-f5e2-4ff0-abc3-735ebd85b494 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:13.030617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0891bd5b-f5e2-4ff0-abc3-735ebd85b494 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6506f19875d47ef81996f0c66a009ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588d8f9d1bd40d1b1dc487da7c572cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:13.043494 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0891bd5b-f5e2-4ff0-abc3-735ebd85b494 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] 10.222.0.40 "GET /compute/v2.1/servers/710484b5-6fbe-4a33-8585-a5117a34262d" status: 200 len: 1323 microversion: 2.1 time: 0.311206 Oct 26 13:04:13.044552 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 283/505] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:12 2022] GET /compute/v2.1/servers/710484b5-6fbe-4a33-8585-a5117a34262d => generated 1323 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:13.049745 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a4b1dcbc-2df7-4b21-8aff-118da8701e97 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:13.050584 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a4b1dcbc-2df7-4b21-8aff-118da8701e97 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] [instance: 94b34e04-9a27-4158-aff1-95f37f1c7a58] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:13.057252 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4b1dcbc-2df7-4b21-8aff-118da8701e97 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:13.058046 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4b1dcbc-2df7-4b21-8aff-118da8701e97 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:13.058724 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4b1dcbc-2df7-4b21-8aff-118da8701e97 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:13.060332 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4b1dcbc-2df7-4b21-8aff-118da8701e97 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:13.061069 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4b1dcbc-2df7-4b21-8aff-118da8701e97 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:13.062010 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4b1dcbc-2df7-4b21-8aff-118da8701e97 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:13.193404 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-f7e503ab-5c29-4705-9d3b-4d0342c5c99b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:04:13.193870 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-f7e503ab-5c29-4705-9d3b-4d0342c5c99b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:04:13.194359 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-f7e503ab-5c29-4705-9d3b-4d0342c5c99b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:04:13.195569 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-f7e503ab-5c29-4705-9d3b-4d0342c5c99b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:04:13.196634 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-f7e503ab-5c29-4705-9d3b-4d0342c5c99b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:04:13.214099 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f7e503ab-5c29-4705-9d3b-4d0342c5c99b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:13.214612 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f7e503ab-5c29-4705-9d3b-4d0342c5c99b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:13.216990 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f7e503ab-5c29-4705-9d3b-4d0342c5c99b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:13.217840 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f7e503ab-5c29-4705-9d3b-4d0342c5c99b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:13.218476 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f7e503ab-5c29-4705-9d3b-4d0342c5c99b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:13.218819 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f7e503ab-5c29-4705-9d3b-4d0342c5c99b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:13.243937 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-f7e503ab-5c29-4705-9d3b-4d0342c5c99b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Getting quotas for project 443f71d3ffde486b9072df264fea2f53. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:04:13.248349 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-f7e503ab-5c29-4705-9d3b-4d0342c5c99b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Getting quotas for user 03335593029b48dfb19fc9cdf6b382b0 and project 443f71d3ffde486b9072df264fea2f53. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:04:13.264739 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f7e503ab-5c29-4705-9d3b-4d0342c5c99b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:04:13.267697 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f7e503ab-5c29-4705-9d3b-4d0342c5c99b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 7da4bb85-b577-4608-a7c0-3320721cb997] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:04:13.356062 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f7e503ab-5c29-4705-9d3b-4d0342c5c99b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.082637 Oct 26 13:04:13.357545 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 223/506] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:04:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1085 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:04:13.367149 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f1727db4-b92d-49fa-b015-34d4308e5a3f tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:13.368354 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f1727db4-b92d-49fa-b015-34d4308e5a3f tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: dffc2812-b18a-4227-932f-3db590d7bc6f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:13.371097 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a4b1dcbc-2df7-4b21-8aff-118da8701e97 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c240bdb5dd7249c79d9620637d0c6e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81334bcb49d84a529558a88b02b6ef55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:13.393596 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a4b1dcbc-2df7-4b21-8aff-118da8701e97 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] 10.222.0.40 "GET /compute/v2.1/servers/94b34e04-9a27-4158-aff1-95f37f1c7a58" status: 200 len: 1320 microversion: 2.1 time: 0.341995 Oct 26 13:04:13.402258 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 284/507] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:13 2022] GET /compute/v2.1/servers/94b34e04-9a27-4158-aff1-95f37f1c7a58 => generated 1320 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:13.415622 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-01227987-e349-440b-b976-e279ea1abac7 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:13.418960 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-01227987-e349-440b-b976-e279ea1abac7 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3e395c36-3e81-4ca3-ab5c-a034d92f8288] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:13.429978 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-01227987-e349-440b-b976-e279ea1abac7 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:13.431091 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-01227987-e349-440b-b976-e279ea1abac7 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:13.432255 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-01227987-e349-440b-b976-e279ea1abac7 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:13.432989 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-01227987-e349-440b-b976-e279ea1abac7 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:13.433445 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-01227987-e349-440b-b976-e279ea1abac7 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:13.445041 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-01227987-e349-440b-b976-e279ea1abac7 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:13.511442 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f1727db4-b92d-49fa-b015-34d4308e5a3f tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241a2299894849c889ee7f1100a9823d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec66df09b6114f5dbd6678d5e848c737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:13.531697 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f1727db4-b92d-49fa-b015-34d4308e5a3f tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] 10.222.0.40 "GET /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f" status: 200 len: 1223 microversion: 2.1 time: 0.172874 Oct 26 13:04:13.532930 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 224/508] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:13 2022] GET /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f => generated 1223 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:13.538581 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d2b2311f-0d9e-4c31-9619-ff45f24c95a2 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:13.539459 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d2b2311f-0d9e-4c31-9619-ff45f24c95a2 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 7da4bb85-b577-4608-a7c0-3320721cb997] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:13.729516 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d2b2311f-0d9e-4c31-9619-ff45f24c95a2 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:13.737272 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d2b2311f-0d9e-4c31-9619-ff45f24c95a2 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997" status: 200 len: 1213 microversion: 2.1 time: 0.202240 Oct 26 13:04:13.737861 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 225/509] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:13 2022] GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997 => generated 1213 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:13.811397 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-01227987-e349-440b-b976-e279ea1abac7 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:13.820742 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-01227987-e349-440b-b976-e279ea1abac7 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:13.823158 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-01227987-e349-440b-b976-e279ea1abac7 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:13.824321 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-01227987-e349-440b-b976-e279ea1abac7 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288" status: 200 len: 1566 microversion: 2.25 time: 0.420958 Oct 26 13:04:13.824877 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 285/510] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:13 2022] GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288 => generated 1566 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:14.072768 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f2b2de25-f097-4a2b-8207-52df92ed3719 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:14.073810 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f2b2de25-f097-4a2b-8207-52df92ed3719 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] [instance: 710484b5-6fbe-4a33-8585-a5117a34262d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:14.091738 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2b2de25-f097-4a2b-8207-52df92ed3719 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:14.092434 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2b2de25-f097-4a2b-8207-52df92ed3719 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:14.093178 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2b2de25-f097-4a2b-8207-52df92ed3719 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:14.094098 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2b2de25-f097-4a2b-8207-52df92ed3719 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:14.094848 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2b2de25-f097-4a2b-8207-52df92ed3719 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:14.095443 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2b2de25-f097-4a2b-8207-52df92ed3719 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:14.430072 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5f2c942b-fc59-497d-ba58-e57f14a83ab9 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:14.431541 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5f2c942b-fc59-497d-ba58-e57f14a83ab9 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] [instance: 94b34e04-9a27-4158-aff1-95f37f1c7a58] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:14.458323 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5f2c942b-fc59-497d-ba58-e57f14a83ab9 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:14.459525 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5f2c942b-fc59-497d-ba58-e57f14a83ab9 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:14.460210 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5f2c942b-fc59-497d-ba58-e57f14a83ab9 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:14.462266 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5f2c942b-fc59-497d-ba58-e57f14a83ab9 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:14.463192 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5f2c942b-fc59-497d-ba58-e57f14a83ab9 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:14.463904 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5f2c942b-fc59-497d-ba58-e57f14a83ab9 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:14.715016 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5f2c942b-fc59-497d-ba58-e57f14a83ab9 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c240bdb5dd7249c79d9620637d0c6e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81334bcb49d84a529558a88b02b6ef55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:14.731220 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5f2c942b-fc59-497d-ba58-e57f14a83ab9 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] 10.222.0.40 "GET /compute/v2.1/servers/94b34e04-9a27-4158-aff1-95f37f1c7a58" status: 200 len: 1320 microversion: 2.1 time: 0.306457 Oct 26 13:04:14.732106 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 286/511] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:14 2022] GET /compute/v2.1/servers/94b34e04-9a27-4158-aff1-95f37f1c7a58 => generated 1320 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:14.744818 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4f6a767f-8b85-4b5e-8f45-8e61ddbf736f tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:14.748237 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4f6a767f-8b85-4b5e-8f45-8e61ddbf736f tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: dffc2812-b18a-4227-932f-3db590d7bc6f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:14.762942 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f6a767f-8b85-4b5e-8f45-8e61ddbf736f tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:14.763928 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f6a767f-8b85-4b5e-8f45-8e61ddbf736f tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:14.764573 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f6a767f-8b85-4b5e-8f45-8e61ddbf736f tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:14.765503 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f6a767f-8b85-4b5e-8f45-8e61ddbf736f tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:14.766202 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f6a767f-8b85-4b5e-8f45-8e61ddbf736f tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:14.767986 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f6a767f-8b85-4b5e-8f45-8e61ddbf736f tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:14.827537 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f2b2de25-f097-4a2b-8207-52df92ed3719 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6506f19875d47ef81996f0c66a009ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588d8f9d1bd40d1b1dc487da7c572cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:14.836274 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f2b2de25-f097-4a2b-8207-52df92ed3719 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] 10.222.0.40 "GET /compute/v2.1/servers/710484b5-6fbe-4a33-8585-a5117a34262d" status: 200 len: 1472 microversion: 2.1 time: 0.768135 Oct 26 13:04:14.848588 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 226/512] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:14 2022] GET /compute/v2.1/servers/710484b5-6fbe-4a33-8585-a5117a34262d => generated 1472 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:14.854055 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2a980034-4970-495a-ae16-9f306c7fe599 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:14.857422 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2a980034-4970-495a-ae16-9f306c7fe599 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 7da4bb85-b577-4608-a7c0-3320721cb997] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:14.863831 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2a980034-4970-495a-ae16-9f306c7fe599 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:14.864679 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2a980034-4970-495a-ae16-9f306c7fe599 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:14.865326 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2a980034-4970-495a-ae16-9f306c7fe599 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:14.866239 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2a980034-4970-495a-ae16-9f306c7fe599 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:14.866868 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2a980034-4970-495a-ae16-9f306c7fe599 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:14.867465 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2a980034-4970-495a-ae16-9f306c7fe599 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:14.885727 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4f6a767f-8b85-4b5e-8f45-8e61ddbf736f tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241a2299894849c889ee7f1100a9823d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec66df09b6114f5dbd6678d5e848c737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:14.896967 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4f6a767f-8b85-4b5e-8f45-8e61ddbf736f tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] 10.222.0.40 "GET /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f" status: 200 len: 1275 microversion: 2.1 time: 0.162663 Oct 26 13:04:14.898142 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 287/513] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:14 2022] GET /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f => generated 1275 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:14.904883 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-99637e8d-1517-44b1-955a-a673df052045 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:14.905765 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-99637e8d-1517-44b1-955a-a673df052045 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3e395c36-3e81-4ca3-ab5c-a034d92f8288] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:14.915484 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99637e8d-1517-44b1-955a-a673df052045 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:14.916173 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99637e8d-1517-44b1-955a-a673df052045 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:14.916879 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99637e8d-1517-44b1-955a-a673df052045 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:14.917775 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99637e8d-1517-44b1-955a-a673df052045 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:14.918731 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99637e8d-1517-44b1-955a-a673df052045 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:14.929967 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99637e8d-1517-44b1-955a-a673df052045 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:15.010034 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2a980034-4970-495a-ae16-9f306c7fe599 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:15.020551 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2a980034-4970-495a-ae16-9f306c7fe599 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997" status: 200 len: 1209 microversion: 2.1 time: 0.170455 Oct 26 13:04:15.049633 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 227/514] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:14 2022] GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997 => generated 1209 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:15.057846 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bef1ca67-3d08-4803-8920-f9b18a4cde68 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:15.058814 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bef1ca67-3d08-4803-8920-f9b18a4cde68 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] [instance: 710484b5-6fbe-4a33-8585-a5117a34262d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:15.071921 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bef1ca67-3d08-4803-8920-f9b18a4cde68 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:15.078208 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bef1ca67-3d08-4803-8920-f9b18a4cde68 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:15.079013 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bef1ca67-3d08-4803-8920-f9b18a4cde68 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:15.080185 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bef1ca67-3d08-4803-8920-f9b18a4cde68 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:15.080895 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bef1ca67-3d08-4803-8920-f9b18a4cde68 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:15.081592 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bef1ca67-3d08-4803-8920-f9b18a4cde68 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:15.129064 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bef1ca67-3d08-4803-8920-f9b18a4cde68 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'd6506f19875d47ef81996f0c66a009ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588d8f9d1bd40d1b1dc487da7c572cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:15.131981 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bef1ca67-3d08-4803-8920-f9b18a4cde68 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Request method failure captured: Oct 26 13:04:15.131981 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/710484b5-6fbe-4a33-8585-a5117a34262d/diagnostics HTTP/1.1 Oct 26 13:04:15.131981 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:04:15.131981 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:04:15.131981 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:04:15.131981 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:04:15.131981 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:04:15.131981 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:04:15.131981 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:04:15.131981 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:04:15.131981 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTA4AKucHEEIJlcwT6lgEl9Bv-HghBh83e8UYffVpko9S_kcJOGo7NAa8iIMVTj4omJsJfU866BNBb2Xj-lZ_Y2Hw8H3VfVS9It9mRvz5amM6mCwSJOkSqsvoBK_sOoewi2f6MSWX-IAlyulpGNHSeftHuixq0ziBEaU4H2ZArQo2eU Oct 26 13:04:15.131981 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:04:15.131981 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:04:15.131981 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:04:15.131981 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:04:15.131981 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:04:15.131981 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:04:15.131981 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: a588d8f9d1bd40d1b1dc487da7c572cd Oct 26 13:04:15.131981 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-738840969 Oct 26 13:04:15.131981 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:04:15.131981 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:04:15.133658 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a588d8f9d1bd40d1b1dc487da7c572cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a588d8f9d1bd40d1b1dc487da7c572cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a588d8f9d1bd40d1b1dc487da7c572cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a588d8f9d1bd40d1b1dc487da7c572cd"}]}] Oct 26 13:04:15.133658 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-738840969 Oct 26 13:04:15.133658 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: a588d8f9d1bd40d1b1dc487da7c572cd Oct 26 13:04:15.133658 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-738840969 Oct 26 13:04:15.133658 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServerDiagnosticsNegativeTest-738840969-project Oct 26 13:04:15.133658 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:04:15.133658 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:04:15.133658 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: d6506f19875d47ef81996f0c66a009ff Oct 26 13:04:15.133658 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-738840969-project Oct 26 13:04:15.133658 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:04:15.133658 n-d-862686-1 devstack@n-api.service[120597]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 26 13:04:15.134433 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'server_id': '710484b5-6fbe-4a33-8585-a5117a34262d'} Oct 26 13:04:15.134433 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:04:15.134433 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:15.134433 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:04:15.134433 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:04:15.134433 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:04:15.134433 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:04:15.134433 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:04:15.134433 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:04:15.134433 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 26 13:04:15.134433 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 26 13:04:15.134433 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 13:04:15.134433 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 13:04:15.134433 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 13:04:15.134433 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 13:04:15.134433 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 13:04:15.134433 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 13:04:15.134433 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 13:04:15.134433 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 13:04:15.134433 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 13:04:15.135631 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 13:04:15.135631 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 13:04:15.135631 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 13:04:15.135631 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 13:04:15.135631 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 13:04:15.135631 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 26 13:04:15.135631 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:04:15.135631 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:04:15.135631 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:04:15.135631 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:15.135631 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:04:15.135631 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:04:15.135631 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 13:04:15.135631 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 13:04:15.135631 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 26 13:04:15.135631 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:04:15.139061 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bef1ca67-3d08-4803-8920-f9b18a4cde68 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:04:15.140182 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bef1ca67-3d08-4803-8920-f9b18a4cde68 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] 10.222.0.40 "GET /compute/v2.1/servers/710484b5-6fbe-4a33-8585-a5117a34262d/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.089271 Oct 26 13:04:15.141061 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 228/515] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 26 13:04:15 2022] GET /compute/v2.1/servers/710484b5-6fbe-4a33-8585-a5117a34262d/diagnostics => generated 117 bytes in 91 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:04:15.157585 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bac18ab7-a9c7-469e-b1ed-5cc8a484df14 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:15.158087 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bac18ab7-a9c7-469e-b1ed-5cc8a484df14 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] [instance: 710484b5-6fbe-4a33-8585-a5117a34262d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:15.173228 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bac18ab7-a9c7-469e-b1ed-5cc8a484df14 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:15.179550 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bac18ab7-a9c7-469e-b1ed-5cc8a484df14 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:15.180512 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bac18ab7-a9c7-469e-b1ed-5cc8a484df14 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:15.182435 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bac18ab7-a9c7-469e-b1ed-5cc8a484df14 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:15.183467 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bac18ab7-a9c7-469e-b1ed-5cc8a484df14 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:15.185012 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bac18ab7-a9c7-469e-b1ed-5cc8a484df14 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:15.255763 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-99637e8d-1517-44b1-955a-a673df052045 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:15.261735 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:04:15.272394 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bac18ab7-a9c7-469e-b1ed-5cc8a484df14 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] [instance: 710484b5-6fbe-4a33-8585-a5117a34262d] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:04:15.276914 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-99637e8d-1517-44b1-955a-a673df052045 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:15.278434 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-99637e8d-1517-44b1-955a-a673df052045 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:15.280022 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-99637e8d-1517-44b1-955a-a673df052045 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288" status: 200 len: 1566 microversion: 2.25 time: 0.380951 Oct 26 13:04:15.281141 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 288/516] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:14 2022] GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288 => generated 1566 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:15.529659 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bac18ab7-a9c7-469e-b1ed-5cc8a484df14 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] 10.222.0.40 "DELETE /compute/v2.1/servers/710484b5-6fbe-4a33-8585-a5117a34262d" status: 204 len: 0 microversion: 2.1 time: 0.381912 Oct 26 13:04:15.537908 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 229/517] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:04:15 2022] DELETE /compute/v2.1/servers/710484b5-6fbe-4a33-8585-a5117a34262d => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:04:15.561773 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1df7effd-531b-4bc6-84ee-ba079255afe4 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:15.563043 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1df7effd-531b-4bc6-84ee-ba079255afe4 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] [instance: 710484b5-6fbe-4a33-8585-a5117a34262d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:15.599507 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1df7effd-531b-4bc6-84ee-ba079255afe4 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:15.600107 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1df7effd-531b-4bc6-84ee-ba079255afe4 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:15.603410 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1df7effd-531b-4bc6-84ee-ba079255afe4 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:15.604176 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1df7effd-531b-4bc6-84ee-ba079255afe4 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:15.608888 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1df7effd-531b-4bc6-84ee-ba079255afe4 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:15.611514 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1df7effd-531b-4bc6-84ee-ba079255afe4 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:15.859400 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-da319299-4d09-4eaf-a029-4d712e2c7578 tempest-QuotasAdminTestV257-2000098954 tempest-QuotasAdminTestV257-2000098954-project-admin] Action: 'update', calling method: .version_select at 0x7f67329f5160>, body: {"quota_set": {"ram": "5120"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:16.002368 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1df7effd-531b-4bc6-84ee-ba079255afe4 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6506f19875d47ef81996f0c66a009ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588d8f9d1bd40d1b1dc487da7c572cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:16.020312 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1df7effd-531b-4bc6-84ee-ba079255afe4 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] 10.222.0.40 "GET /compute/v2.1/servers/710484b5-6fbe-4a33-8585-a5117a34262d" status: 200 len: 1478 microversion: 2.1 time: 0.475525 Oct 26 13:04:16.021236 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 230/518] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:15 2022] GET /compute/v2.1/servers/710484b5-6fbe-4a33-8585-a5117a34262d => generated 1478 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:16.033815 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-afee48a8-0b72-46a8-a814-10245b919480 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:16.036505 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-afee48a8-0b72-46a8-a814-10245b919480 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] [instance: 94b34e04-9a27-4158-aff1-95f37f1c7a58] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:16.052252 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-afee48a8-0b72-46a8-a814-10245b919480 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:16.053338 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-afee48a8-0b72-46a8-a814-10245b919480 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:16.054170 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-afee48a8-0b72-46a8-a814-10245b919480 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:16.055093 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-afee48a8-0b72-46a8-a814-10245b919480 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:16.056346 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-afee48a8-0b72-46a8-a814-10245b919480 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:16.056982 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-afee48a8-0b72-46a8-a814-10245b919480 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:16.241738 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da319299-4d09-4eaf-a029-4d712e2c7578 tempest-QuotasAdminTestV257-2000098954 tempest-QuotasAdminTestV257-2000098954-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:16.244354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da319299-4d09-4eaf-a029-4d712e2c7578 tempest-QuotasAdminTestV257-2000098954 tempest-QuotasAdminTestV257-2000098954-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:16.245578 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da319299-4d09-4eaf-a029-4d712e2c7578 tempest-QuotasAdminTestV257-2000098954 tempest-QuotasAdminTestV257-2000098954-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:16.261775 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da319299-4d09-4eaf-a029-4d712e2c7578 tempest-QuotasAdminTestV257-2000098954 tempest-QuotasAdminTestV257-2000098954-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:16.266808 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da319299-4d09-4eaf-a029-4d712e2c7578 tempest-QuotasAdminTestV257-2000098954 tempest-QuotasAdminTestV257-2000098954-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:16.267721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da319299-4d09-4eaf-a029-4d712e2c7578 tempest-QuotasAdminTestV257-2000098954 tempest-QuotasAdminTestV257-2000098954-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:16.297966 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:UPDATE=13,nova_api:SELECT=72,nova_api:INSERT=15 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:04:16.345166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:04:16.367425 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-da319299-4d09-4eaf-a029-4d712e2c7578 tempest-QuotasAdminTestV257-2000098954 tempest-QuotasAdminTestV257-2000098954-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/715d2337b61b457dabe51204c11efde9" status: 200 len: 148 microversion: 2.57 time: 1.058662 Oct 26 13:04:16.368127 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 289/519] 10.222.0.40 () {62 vars in 1303 bytes} [Wed Oct 26 13:04:15 2022] PUT /compute/v2.1/os-quota-sets/715d2337b61b457dabe51204c11efde9 => generated 148 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 26 13:04:16.379947 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cc5ece98-fb4f-4296-b0bb-7f876171fa0d tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:16.381103 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cc5ece98-fb4f-4296-b0bb-7f876171fa0d tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: dffc2812-b18a-4227-932f-3db590d7bc6f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:16.392003 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cc5ece98-fb4f-4296-b0bb-7f876171fa0d tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:16.392458 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cc5ece98-fb4f-4296-b0bb-7f876171fa0d tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:16.393207 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cc5ece98-fb4f-4296-b0bb-7f876171fa0d tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:16.394092 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cc5ece98-fb4f-4296-b0bb-7f876171fa0d tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:16.394685 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cc5ece98-fb4f-4296-b0bb-7f876171fa0d tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:16.395431 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cc5ece98-fb4f-4296-b0bb-7f876171fa0d tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:16.488520 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-cc5ece98-fb4f-4296-b0bb-7f876171fa0d tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241a2299894849c889ee7f1100a9823d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec66df09b6114f5dbd6678d5e848c737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:16.498113 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cc5ece98-fb4f-4296-b0bb-7f876171fa0d tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] 10.222.0.40 "GET /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f" status: 200 len: 1281 microversion: 2.1 time: 0.128814 Oct 26 13:04:16.517854 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 290/520] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:16 2022] GET /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f => generated 1281 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:16.527531 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e6a8c83c-f7cf-4de4-9424-d94bccff891f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:16.528147 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e6a8c83c-f7cf-4de4-9424-d94bccff891f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 7da4bb85-b577-4608-a7c0-3320721cb997] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:16.539002 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6a8c83c-f7cf-4de4-9424-d94bccff891f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:16.541311 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6a8c83c-f7cf-4de4-9424-d94bccff891f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:16.541830 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6a8c83c-f7cf-4de4-9424-d94bccff891f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:16.542555 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6a8c83c-f7cf-4de4-9424-d94bccff891f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:16.543085 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6a8c83c-f7cf-4de4-9424-d94bccff891f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:16.543510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6a8c83c-f7cf-4de4-9424-d94bccff891f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:16.599846 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-afee48a8-0b72-46a8-a814-10245b919480 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c240bdb5dd7249c79d9620637d0c6e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81334bcb49d84a529558a88b02b6ef55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:16.623988 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-afee48a8-0b72-46a8-a814-10245b919480 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] 10.222.0.40 "GET /compute/v2.1/servers/94b34e04-9a27-4158-aff1-95f37f1c7a58" status: 200 len: 1320 microversion: 2.1 time: 0.594831 Oct 26 13:04:16.631944 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e6a8c83c-f7cf-4de4-9424-d94bccff891f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:16.641988 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 231/521] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:16 2022] GET /compute/v2.1/servers/94b34e04-9a27-4158-aff1-95f37f1c7a58 => generated 1320 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:16.646580 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e6a8c83c-f7cf-4de4-9424-d94bccff891f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997" status: 200 len: 1271 microversion: 2.1 time: 0.129561 Oct 26 13:04:16.647461 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 291/522] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:16 2022] GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997 => generated 1271 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:16.652659 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3af6a348-464e-4f5e-94bc-37a8944be329 tempest-QuotasAdminTestV257-2000098954 tempest-QuotasAdminTestV257-2000098954-project-admin] Calling method '.version_select at 0x7f6732a13f70>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:16.653454 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-69711b39-05b9-4a31-9c5a-bc3231c12d28 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:16.654092 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-69711b39-05b9-4a31-9c5a-bc3231c12d28 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3e395c36-3e81-4ca3-ab5c-a034d92f8288] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:16.667682 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69711b39-05b9-4a31-9c5a-bc3231c12d28 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:16.668522 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69711b39-05b9-4a31-9c5a-bc3231c12d28 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:16.668961 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69711b39-05b9-4a31-9c5a-bc3231c12d28 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:16.669691 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69711b39-05b9-4a31-9c5a-bc3231c12d28 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:16.670402 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69711b39-05b9-4a31-9c5a-bc3231c12d28 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:16.670958 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69711b39-05b9-4a31-9c5a-bc3231c12d28 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:16.966282 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3af6a348-464e-4f5e-94bc-37a8944be329 tempest-QuotasAdminTestV257-2000098954 tempest-QuotasAdminTestV257-2000098954-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:16.966772 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3af6a348-464e-4f5e-94bc-37a8944be329 tempest-QuotasAdminTestV257-2000098954 tempest-QuotasAdminTestV257-2000098954-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:16.967208 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3af6a348-464e-4f5e-94bc-37a8944be329 tempest-QuotasAdminTestV257-2000098954 tempest-QuotasAdminTestV257-2000098954-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:16.967932 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3af6a348-464e-4f5e-94bc-37a8944be329 tempest-QuotasAdminTestV257-2000098954 tempest-QuotasAdminTestV257-2000098954-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:16.968892 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3af6a348-464e-4f5e-94bc-37a8944be329 tempest-QuotasAdminTestV257-2000098954 tempest-QuotasAdminTestV257-2000098954-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:16.969337 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3af6a348-464e-4f5e-94bc-37a8944be329 tempest-QuotasAdminTestV257-2000098954 tempest-QuotasAdminTestV257-2000098954-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:17.001622 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3af6a348-464e-4f5e-94bc-37a8944be329 tempest-QuotasAdminTestV257-2000098954 tempest-QuotasAdminTestV257-2000098954-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/715d2337b61b457dabe51204c11efde9/detail" status: 200 len: 463 microversion: 2.57 time: 0.352591 Oct 26 13:04:17.002695 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 292/523] 10.222.0.40 () {60 vars in 1304 bytes} [Wed Oct 26 13:04:16 2022] GET /compute/v2.1/os-quota-sets/715d2337b61b457dabe51204c11efde9/detail => generated 463 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:04:17.083479 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-69711b39-05b9-4a31-9c5a-bc3231c12d28 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:17.103983 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-69711b39-05b9-4a31-9c5a-bc3231c12d28 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:17.105758 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-69711b39-05b9-4a31-9c5a-bc3231c12d28 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:17.107091 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-69711b39-05b9-4a31-9c5a-bc3231c12d28 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288" status: 200 len: 1556 microversion: 2.25 time: 0.463850 Oct 26 13:04:17.107814 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 232/524] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:16 2022] GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288 => generated 1556 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:17.135620 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3ac4da91-9bb9-467f-90d0-c1f7c913b0a0 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:17.146416 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3ac4da91-9bb9-467f-90d0-c1f7c913b0a0 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] [instance: 710484b5-6fbe-4a33-8585-a5117a34262d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:17.153541 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3ac4da91-9bb9-467f-90d0-c1f7c913b0a0 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:17.154252 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3ac4da91-9bb9-467f-90d0-c1f7c913b0a0 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:17.154858 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3ac4da91-9bb9-467f-90d0-c1f7c913b0a0 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:17.155737 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3ac4da91-9bb9-467f-90d0-c1f7c913b0a0 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:17.159981 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3ac4da91-9bb9-467f-90d0-c1f7c913b0a0 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:17.160634 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3ac4da91-9bb9-467f-90d0-c1f7c913b0a0 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:17.225515 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8e4062dc-0cbb-4b3c-9368-b1603a61073d tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1682888422", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:17.278853 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-8e4062dc-0cbb-4b3c-9368-b1603a61073d tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] validate_networks() for None {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:04:17.546619 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3ac4da91-9bb9-467f-90d0-c1f7c913b0a0 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6506f19875d47ef81996f0c66a009ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588d8f9d1bd40d1b1dc487da7c572cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:17.565886 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3ac4da91-9bb9-467f-90d0-c1f7c913b0a0 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] 10.222.0.40 "GET /compute/v2.1/servers/710484b5-6fbe-4a33-8585-a5117a34262d" status: 200 len: 1478 microversion: 2.1 time: 0.442730 Oct 26 13:04:17.566491 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 233/525] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:17 2022] GET /compute/v2.1/servers/710484b5-6fbe-4a33-8585-a5117a34262d => generated 1478 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:17.591438 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bbe2345d-e294-4011-bc5b-ac1de8f0fe14 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Calling method '.version_select at 0x7f6732d01430>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:17.607772 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bbe2345d-e294-4011-bc5b-ac1de8f0fe14 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:17.609164 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bbe2345d-e294-4011-bc5b-ac1de8f0fe14 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:17.624239 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bbe2345d-e294-4011-bc5b-ac1de8f0fe14 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:17.629737 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-8e4062dc-0cbb-4b3c-9368-b1603a61073d tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:04:17.630930 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-8e4062dc-0cbb-4b3c-9368-b1603a61073d tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:04:17.631508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-8e4062dc-0cbb-4b3c-9368-b1603a61073d tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:04:17.632155 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-8e4062dc-0cbb-4b3c-9368-b1603a61073d tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:04:17.632769 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-8e4062dc-0cbb-4b3c-9368-b1603a61073d tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:04:17.654670 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e4062dc-0cbb-4b3c-9368-b1603a61073d tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:17.655514 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e4062dc-0cbb-4b3c-9368-b1603a61073d tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:17.656159 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e4062dc-0cbb-4b3c-9368-b1603a61073d tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:17.657118 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e4062dc-0cbb-4b3c-9368-b1603a61073d tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:17.657243 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bbe2345d-e294-4011-bc5b-ac1de8f0fe14 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 1104 microversion: 2.25 time: 0.076612 Oct 26 13:04:17.657938 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 234/526] 10.222.0.40 () {60 vars in 1184 bytes} [Wed Oct 26 13:04:17 2022] GET /compute/v2.1/os-migrations => generated 1104 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:17.669145 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e4062dc-0cbb-4b3c-9368-b1603a61073d tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:17.669954 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e4062dc-0cbb-4b3c-9368-b1603a61073d tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:17.671950 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-27cc06f9-190a-459c-a616-d78723c247d0 tempest-QuotasAdminTestV257-2000098954 tempest-QuotasAdminTestV257-2000098954-project-admin] Action: 'update', calling method: .version_select at 0x7f67331014c0>, body: {"quota_set": {"ram": "2048"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:17.731672 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-8e4062dc-0cbb-4b3c-9368-b1603a61073d tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Getting quotas for project d6515917885c4f3cb5fb19e05f4e5e2b. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:04:17.760752 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-8e4062dc-0cbb-4b3c-9368-b1603a61073d tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Getting quotas for user b6cddfeca4ce49788143b2bf4b30545f and project d6515917885c4f3cb5fb19e05f4e5e2b. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:04:17.799727 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8e4062dc-0cbb-4b3c-9368-b1603a61073d tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:04:17.802314 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8e4062dc-0cbb-4b3c-9368-b1603a61073d tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 4c694a16-fdba-414f-9122-1899cc715565] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:04:17.857584 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-27cc06f9-190a-459c-a616-d78723c247d0 tempest-QuotasAdminTestV257-2000098954 tempest-QuotasAdminTestV257-2000098954-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:17.858087 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-27cc06f9-190a-459c-a616-d78723c247d0 tempest-QuotasAdminTestV257-2000098954 tempest-QuotasAdminTestV257-2000098954-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:17.858530 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-27cc06f9-190a-459c-a616-d78723c247d0 tempest-QuotasAdminTestV257-2000098954 tempest-QuotasAdminTestV257-2000098954-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:17.859257 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-27cc06f9-190a-459c-a616-d78723c247d0 tempest-QuotasAdminTestV257-2000098954 tempest-QuotasAdminTestV257-2000098954-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:17.859714 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-27cc06f9-190a-459c-a616-d78723c247d0 tempest-QuotasAdminTestV257-2000098954 tempest-QuotasAdminTestV257-2000098954-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:17.871967 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-27cc06f9-190a-459c-a616-d78723c247d0 tempest-QuotasAdminTestV257-2000098954 tempest-QuotasAdminTestV257-2000098954-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:17.927569 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-27cc06f9-190a-459c-a616-d78723c247d0 tempest-QuotasAdminTestV257-2000098954 tempest-QuotasAdminTestV257-2000098954-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:17.928562 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-27cc06f9-190a-459c-a616-d78723c247d0 tempest-QuotasAdminTestV257-2000098954 tempest-QuotasAdminTestV257-2000098954-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:17.929206 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-27cc06f9-190a-459c-a616-d78723c247d0 tempest-QuotasAdminTestV257-2000098954 tempest-QuotasAdminTestV257-2000098954-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:17.930207 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-27cc06f9-190a-459c-a616-d78723c247d0 tempest-QuotasAdminTestV257-2000098954 tempest-QuotasAdminTestV257-2000098954-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:17.932215 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-27cc06f9-190a-459c-a616-d78723c247d0 tempest-QuotasAdminTestV257-2000098954 tempest-QuotasAdminTestV257-2000098954-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:17.933909 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-27cc06f9-190a-459c-a616-d78723c247d0 tempest-QuotasAdminTestV257-2000098954 tempest-QuotasAdminTestV257-2000098954-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:17.944922 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8e4062dc-0cbb-4b3c-9368-b1603a61073d tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.914601 Oct 26 13:04:17.945820 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 293/527] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:04:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:04:17.965865 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=10,nova_api:UPDATE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:04:17.966346 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e5566189-aec1-4bcd-829f-a5ed4092907b tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:17.988025 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e5566189-aec1-4bcd-829f-a5ed4092907b tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: dffc2812-b18a-4227-932f-3db590d7bc6f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:18.004158 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e5566189-aec1-4bcd-829f-a5ed4092907b tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:18.006913 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e5566189-aec1-4bcd-829f-a5ed4092907b tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:18.007725 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e5566189-aec1-4bcd-829f-a5ed4092907b tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:18.009618 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e5566189-aec1-4bcd-829f-a5ed4092907b tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:18.010443 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e5566189-aec1-4bcd-829f-a5ed4092907b tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:18.011108 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e5566189-aec1-4bcd-829f-a5ed4092907b tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:18.059692 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-27cc06f9-190a-459c-a616-d78723c247d0 tempest-QuotasAdminTestV257-2000098954 tempest-QuotasAdminTestV257-2000098954-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/715d2337b61b457dabe51204c11efde9?user_id=21cffecd66f74c688ed0d88029f446ac" status: 200 len: 148 microversion: 2.57 time: 0.400646 Oct 26 13:04:18.067337 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 235/528] 10.222.0.40 () {62 vars in 1384 bytes} [Wed Oct 26 13:04:17 2022] PUT /compute/v2.1/os-quota-sets/715d2337b61b457dabe51204c11efde9?user_id=21cffecd66f74c688ed0d88029f446ac => generated 148 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:04:18.088010 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-38464f44-8efc-47ff-aab4-fe10a7513f1d tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:18.090499 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-38464f44-8efc-47ff-aab4-fe10a7513f1d tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] [instance: 94b34e04-9a27-4158-aff1-95f37f1c7a58] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:18.105741 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38464f44-8efc-47ff-aab4-fe10a7513f1d tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:18.106476 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38464f44-8efc-47ff-aab4-fe10a7513f1d tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:18.107122 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38464f44-8efc-47ff-aab4-fe10a7513f1d tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:18.109223 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38464f44-8efc-47ff-aab4-fe10a7513f1d tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:18.111317 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38464f44-8efc-47ff-aab4-fe10a7513f1d tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:18.111980 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38464f44-8efc-47ff-aab4-fe10a7513f1d tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:18.424230 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e5566189-aec1-4bcd-829f-a5ed4092907b tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241a2299894849c889ee7f1100a9823d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec66df09b6114f5dbd6678d5e848c737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:18.436102 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e5566189-aec1-4bcd-829f-a5ed4092907b tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] 10.222.0.40 "GET /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f" status: 200 len: 1323 microversion: 2.1 time: 0.473756 Oct 26 13:04:18.440062 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 294/529] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:17 2022] GET /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f => generated 1323 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:18.450291 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4d10d52e-914a-4e07-9118-40391d65b82c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:18.452830 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4d10d52e-914a-4e07-9118-40391d65b82c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 7da4bb85-b577-4608-a7c0-3320721cb997] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:18.473536 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d10d52e-914a-4e07-9118-40391d65b82c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:18.475268 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d10d52e-914a-4e07-9118-40391d65b82c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:18.477880 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d10d52e-914a-4e07-9118-40391d65b82c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:18.483718 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d10d52e-914a-4e07-9118-40391d65b82c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:18.488734 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d10d52e-914a-4e07-9118-40391d65b82c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:18.488734 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d10d52e-914a-4e07-9118-40391d65b82c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:18.859080 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4d10d52e-914a-4e07-9118-40391d65b82c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:18.869027 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4d10d52e-914a-4e07-9118-40391d65b82c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997" status: 200 len: 1313 microversion: 2.1 time: 0.427543 Oct 26 13:04:18.873577 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 295/530] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:18 2022] GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997 => generated 1313 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:18.887068 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f5b0c099-5430-4ce2-be10-97c7966cf0c3 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:18.891849 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f5b0c099-5430-4ce2-be10-97c7966cf0c3 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] [instance: 3e395c36-3e81-4ca3-ab5c-a034d92f8288] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:18.899665 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5b0c099-5430-4ce2-be10-97c7966cf0c3 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:18.900827 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5b0c099-5430-4ce2-be10-97c7966cf0c3 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:18.910079 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5b0c099-5430-4ce2-be10-97c7966cf0c3 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:18.911632 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5b0c099-5430-4ce2-be10-97c7966cf0c3 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:18.914369 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5b0c099-5430-4ce2-be10-97c7966cf0c3 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:18.915502 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5b0c099-5430-4ce2-be10-97c7966cf0c3 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:19.056923 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-38464f44-8efc-47ff-aab4-fe10a7513f1d tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c240bdb5dd7249c79d9620637d0c6e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81334bcb49d84a529558a88b02b6ef55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:19.066348 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-38464f44-8efc-47ff-aab4-fe10a7513f1d tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] 10.222.0.40 "GET /compute/v2.1/servers/94b34e04-9a27-4158-aff1-95f37f1c7a58" status: 200 len: 1320 microversion: 2.1 time: 0.993638 Oct 26 13:04:19.091671 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 236/531] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:18 2022] GET /compute/v2.1/servers/94b34e04-9a27-4158-aff1-95f37f1c7a58 => generated 1320 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:19.096558 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-f5b0c099-5430-4ce2-be10-97c7966cf0c3 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lazy-loading 'services' on Instance uuid 3e395c36-3e81-4ca3-ab5c-a034d92f8288 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:04:19.106905 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f76197cc-d853-497d-894c-da6c1bfc8d78 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:19.107506 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f76197cc-d853-497d-894c-da6c1bfc8d78 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 4c694a16-fdba-414f-9122-1899cc715565] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:19.119113 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f76197cc-d853-497d-894c-da6c1bfc8d78 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:19.119838 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f76197cc-d853-497d-894c-da6c1bfc8d78 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:19.120278 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f76197cc-d853-497d-894c-da6c1bfc8d78 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:19.120982 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f76197cc-d853-497d-894c-da6c1bfc8d78 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:19.121434 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f76197cc-d853-497d-894c-da6c1bfc8d78 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:19.121910 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f76197cc-d853-497d-894c-da6c1bfc8d78 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:19.157142 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f5b0c099-5430-4ce2-be10-97c7966cf0c3 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288" status: 200 len: 2048 microversion: 2.25 time: 0.281411 Oct 26 13:04:19.157887 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 296/532] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:18 2022] GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288 => generated 2048 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:19.162578 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-330a769c-e798-4e9b-9283-cb04faf46f36 req-6cc95527-b9cb-4b84-83c4-03d60a763082 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94b34e04-9a27-4158-aff1-95f37f1c7a58", "name": "network-vif-plugged", "status": "completed", "tag": "80b659d1-4b85-4552-9b75-2213e7463923"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:19.172611 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-330a769c-e798-4e9b-9283-cb04faf46f36 req-6cc95527-b9cb-4b84-83c4-03d60a763082 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:19.173212 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-330a769c-e798-4e9b-9283-cb04faf46f36 req-6cc95527-b9cb-4b84-83c4-03d60a763082 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:19.173914 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-330a769c-e798-4e9b-9283-cb04faf46f36 req-6cc95527-b9cb-4b84-83c4-03d60a763082 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:19.192403 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-330a769c-e798-4e9b-9283-cb04faf46f36 req-6cc95527-b9cb-4b84-83c4-03d60a763082 service nova] Creating event network-vif-plugged:80b659d1-4b85-4552-9b75-2213e7463923 for instance 94b34e04-9a27-4158-aff1-95f37f1c7a58 on n-h2-862686-1 Oct 26 13:04:19.198661 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-330a769c-e798-4e9b-9283-cb04faf46f36 req-6cc95527-b9cb-4b84-83c4-03d60a763082 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039352 Oct 26 13:04:19.199325 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 297/533] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:19.205200 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2745e4c0-755c-4888-b5cf-a81a108c6b9a tempest-QuotasAdminTestV257-2000098954 tempest-QuotasAdminTestV257-2000098954-project-admin] Calling method '.version_select at 0x7f67329f5550>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:19.206270 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f76197cc-d853-497d-894c-da6c1bfc8d78 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:19.237634 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f76197cc-d853-497d-894c-da6c1bfc8d78 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/4c694a16-fdba-414f-9122-1899cc715565" status: 200 len: 1213 microversion: 2.1 time: 0.134714 Oct 26 13:04:19.239275 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 237/534] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:19 2022] GET /compute/v2.1/servers/4c694a16-fdba-414f-9122-1899cc715565 => generated 1213 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:19.248683 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1759de19-cdb6-4b62-ae0e-7d0dfac88e73 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:19.250119 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1759de19-cdb6-4b62-ae0e-7d0dfac88e73 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] [instance: 710484b5-6fbe-4a33-8585-a5117a34262d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:19.263485 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1759de19-cdb6-4b62-ae0e-7d0dfac88e73 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:19.264792 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1759de19-cdb6-4b62-ae0e-7d0dfac88e73 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:19.265794 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1759de19-cdb6-4b62-ae0e-7d0dfac88e73 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:19.267157 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1759de19-cdb6-4b62-ae0e-7d0dfac88e73 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:19.267869 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1759de19-cdb6-4b62-ae0e-7d0dfac88e73 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:19.268577 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1759de19-cdb6-4b62-ae0e-7d0dfac88e73 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:19.327806 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2745e4c0-755c-4888-b5cf-a81a108c6b9a tempest-QuotasAdminTestV257-2000098954 tempest-QuotasAdminTestV257-2000098954-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/715d2337b61b457dabe51204c11efde9?user_id=21cffecd66f74c688ed0d88029f446ac" status: 200 len: 190 microversion: 2.57 time: 0.126427 Oct 26 13:04:19.345581 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1759de19-cdb6-4b62-ae0e-7d0dfac88e73 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:19.346321 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 298/535] 10.222.0.40 () {60 vars in 1364 bytes} [Wed Oct 26 13:04:19 2022] GET /compute/v2.1/os-quota-sets/715d2337b61b457dabe51204c11efde9?user_id=21cffecd66f74c688ed0d88029f446ac => generated 190 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:04:19.346878 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1759de19-cdb6-4b62-ae0e-7d0dfac88e73 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:19.347613 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1759de19-cdb6-4b62-ae0e-7d0dfac88e73 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:19.348245 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-1759de19-cdb6-4b62-ae0e-7d0dfac88e73 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lazy-loading 'fault' on Instance uuid 710484b5-6fbe-4a33-8585-a5117a34262d {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:04:19.356537 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-05bdb83a-ca6c-44fc-91c8-a0e07a5ba5b4 req-eed0cf0c-cc68-4fc2-a1a5-486a664096ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "710484b5-6fbe-4a33-8585-a5117a34262d", "name": "network-vif-deleted", "tag": "370eaf81-0d79-492b-b9bd-a7d2d47e66ef"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:19.369541 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-05bdb83a-ca6c-44fc-91c8-a0e07a5ba5b4 req-eed0cf0c-cc68-4fc2-a1a5-486a664096ae service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:19.370273 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-05bdb83a-ca6c-44fc-91c8-a0e07a5ba5b4 req-eed0cf0c-cc68-4fc2-a1a5-486a664096ae service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:19.370897 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-05bdb83a-ca6c-44fc-91c8-a0e07a5ba5b4 req-eed0cf0c-cc68-4fc2-a1a5-486a664096ae service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:19.385914 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-05bdb83a-ca6c-44fc-91c8-a0e07a5ba5b4 req-eed0cf0c-cc68-4fc2-a1a5-486a664096ae service nova] Creating event network-vif-deleted:370eaf81-0d79-492b-b9bd-a7d2d47e66ef for instance 710484b5-6fbe-4a33-8585-a5117a34262d on n-h1-862686-1 Oct 26 13:04:19.392275 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-05bdb83a-ca6c-44fc-91c8-a0e07a5ba5b4 req-eed0cf0c-cc68-4fc2-a1a5-486a664096ae service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041816 Oct 26 13:04:19.393538 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 299/536] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:19.402254 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f3793e52-1da5-4782-bbc3-5486960715e9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1608085829", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "126fa8f9-6bcd-4196-bf93-7bb18cb15112"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:19.484185 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-f3793e52-1da5-4782-bbc3-5486960715e9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] validate_networks() for [('126fa8f9-6bcd-4196-bf93-7bb18cb15112', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:04:19.532229 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1759de19-cdb6-4b62-ae0e-7d0dfac88e73 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6506f19875d47ef81996f0c66a009ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588d8f9d1bd40d1b1dc487da7c572cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:19.543003 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1759de19-cdb6-4b62-ae0e-7d0dfac88e73 tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] 10.222.0.40 "GET /compute/v2.1/servers/710484b5-6fbe-4a33-8585-a5117a34262d" status: 200 len: 1313 microversion: 2.1 time: 0.302137 Oct 26 13:04:19.543573 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 238/537] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:19 2022] GET /compute/v2.1/servers/710484b5-6fbe-4a33-8585-a5117a34262d => generated 1313 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:19.559331 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-273e8586-6832-4c0c-83a8-dd728c31bceb tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:19.559931 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-273e8586-6832-4c0c-83a8-dd728c31bceb tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: dffc2812-b18a-4227-932f-3db590d7bc6f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:19.569162 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-273e8586-6832-4c0c-83a8-dd728c31bceb tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:19.569694 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-273e8586-6832-4c0c-83a8-dd728c31bceb tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:19.570234 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-273e8586-6832-4c0c-83a8-dd728c31bceb tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:19.571063 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-273e8586-6832-4c0c-83a8-dd728c31bceb tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:19.571597 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-273e8586-6832-4c0c-83a8-dd728c31bceb tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:19.572201 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-273e8586-6832-4c0c-83a8-dd728c31bceb tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:19.912150 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-273e8586-6832-4c0c-83a8-dd728c31bceb tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241a2299894849c889ee7f1100a9823d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec66df09b6114f5dbd6678d5e848c737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:19.924699 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-273e8586-6832-4c0c-83a8-dd728c31bceb tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] 10.222.0.40 "GET /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f" status: 200 len: 1323 microversion: 2.1 time: 0.379950 Oct 26 13:04:19.926494 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 239/538] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:19 2022] GET /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f => generated 1323 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:19.936875 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-0b8c2622-5a21-42fe-953a-6a1e241013d3 req-4ad9e91f-7865-4649-84f3-f3676e87c1e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dffc2812-b18a-4227-932f-3db590d7bc6f", "tag": "eefbc12d-6331-420c-be7b-da952bc9d1cf"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:19.956533 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-0b8c2622-5a21-42fe-953a-6a1e241013d3 req-4ad9e91f-7865-4649-84f3-f3676e87c1e9 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:19.957250 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-0b8c2622-5a21-42fe-953a-6a1e241013d3 req-4ad9e91f-7865-4649-84f3-f3676e87c1e9 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:19.957721 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-0b8c2622-5a21-42fe-953a-6a1e241013d3 req-4ad9e91f-7865-4649-84f3-f3676e87c1e9 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:19.969861 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-0b8c2622-5a21-42fe-953a-6a1e241013d3 req-4ad9e91f-7865-4649-84f3-f3676e87c1e9 service nova] Creating event network-changed:eefbc12d-6331-420c-be7b-da952bc9d1cf for instance dffc2812-b18a-4227-932f-3db590d7bc6f on n-h2-862686-1 Oct 26 13:04:19.975330 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-0b8c2622-5a21-42fe-953a-6a1e241013d3 req-4ad9e91f-7865-4649-84f3-f3676e87c1e9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047423 Oct 26 13:04:19.976514 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 240/539] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:19.982843 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d8dd466d-f3ce-40fa-b54e-6408c3c7e90f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:19.983901 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d8dd466d-f3ce-40fa-b54e-6408c3c7e90f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 7da4bb85-b577-4608-a7c0-3320721cb997] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:19.991691 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8dd466d-f3ce-40fa-b54e-6408c3c7e90f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:19.992696 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8dd466d-f3ce-40fa-b54e-6408c3c7e90f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:19.993774 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8dd466d-f3ce-40fa-b54e-6408c3c7e90f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:19.995139 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8dd466d-f3ce-40fa-b54e-6408c3c7e90f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:19.995816 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8dd466d-f3ce-40fa-b54e-6408c3c7e90f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:19.996587 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8dd466d-f3ce-40fa-b54e-6408c3c7e90f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:20.003721 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:04:20.072928 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-f3793e52-1da5-4782-bbc3-5486960715e9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:04:20.073382 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-f3793e52-1da5-4782-bbc3-5486960715e9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:04:20.074221 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-f3793e52-1da5-4782-bbc3-5486960715e9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:04:20.074797 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-f3793e52-1da5-4782-bbc3-5486960715e9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:04:20.075220 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-f3793e52-1da5-4782-bbc3-5486960715e9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:04:20.098494 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f3793e52-1da5-4782-bbc3-5486960715e9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:20.100053 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f3793e52-1da5-4782-bbc3-5486960715e9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:20.100565 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f3793e52-1da5-4782-bbc3-5486960715e9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:20.102825 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f3793e52-1da5-4782-bbc3-5486960715e9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:20.103681 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f3793e52-1da5-4782-bbc3-5486960715e9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:20.104292 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f3793e52-1da5-4782-bbc3-5486960715e9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:20.130330 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-f3793e52-1da5-4782-bbc3-5486960715e9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Getting quotas for project 2f7b9165f0ff4c06a5d154ea24b17bac. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:04:20.135444 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-f3793e52-1da5-4782-bbc3-5486960715e9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Getting quotas for user 27f4a513ca654b0abf9f972e07270c10 and project 2f7b9165f0ff4c06a5d154ea24b17bac. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:04:20.154438 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f3793e52-1da5-4782-bbc3-5486960715e9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:04:20.177615 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f3793e52-1da5-4782-bbc3-5486960715e9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: a28883a5-9f17-4514-823e-7b33a316d33c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:04:20.285307 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f3793e52-1da5-4782-bbc3-5486960715e9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.887129 Oct 26 13:04:20.285307 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 300/540] 10.222.0.40 () {62 vars in 1188 bytes} [Wed Oct 26 13:04:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 889 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 26 13:04:20.288180 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ec342613-3c03-44b1-b2e1-becbe059bf2f tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:20.288891 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ec342613-3c03-44b1-b2e1-becbe059bf2f tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] [instance: 94b34e04-9a27-4158-aff1-95f37f1c7a58] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:20.297180 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec342613-3c03-44b1-b2e1-becbe059bf2f tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:20.297874 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec342613-3c03-44b1-b2e1-becbe059bf2f tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:20.298197 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec342613-3c03-44b1-b2e1-becbe059bf2f tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:20.299064 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec342613-3c03-44b1-b2e1-becbe059bf2f tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:20.299629 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec342613-3c03-44b1-b2e1-becbe059bf2f tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:20.300101 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec342613-3c03-44b1-b2e1-becbe059bf2f tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:20.319491 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d8dd466d-f3ce-40fa-b54e-6408c3c7e90f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:20.329082 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d8dd466d-f3ce-40fa-b54e-6408c3c7e90f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997" status: 200 len: 1313 microversion: 2.1 time: 0.350349 Oct 26 13:04:20.330676 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 241/541] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:19 2022] GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997 => generated 1313 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:20.345736 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-27147bea-1139-4b80-8cdf-8ee1df9ba931 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:20.346575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-27147bea-1139-4b80-8cdf-8ee1df9ba931 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 4c694a16-fdba-414f-9122-1899cc715565] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:20.354581 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-27147bea-1139-4b80-8cdf-8ee1df9ba931 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:20.355318 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-27147bea-1139-4b80-8cdf-8ee1df9ba931 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:20.356501 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-27147bea-1139-4b80-8cdf-8ee1df9ba931 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:20.357431 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-27147bea-1139-4b80-8cdf-8ee1df9ba931 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:20.358101 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-27147bea-1139-4b80-8cdf-8ee1df9ba931 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:20.358709 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-27147bea-1139-4b80-8cdf-8ee1df9ba931 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:20.449597 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-27147bea-1139-4b80-8cdf-8ee1df9ba931 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:20.466988 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-27147bea-1139-4b80-8cdf-8ee1df9ba931 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/4c694a16-fdba-414f-9122-1899cc715565" status: 200 len: 1275 microversion: 2.1 time: 0.131674 Oct 26 13:04:20.467741 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 242/542] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:20 2022] GET /compute/v2.1/servers/4c694a16-fdba-414f-9122-1899cc715565 => generated 1275 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:20.473112 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1607603d-2918-4157-a8a8-51450a1ac421 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:20.474033 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1607603d-2918-4157-a8a8-51450a1ac421 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: a28883a5-9f17-4514-823e-7b33a316d33c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:20.624188 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1607603d-2918-4157-a8a8-51450a1ac421 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:20.638650 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1607603d-2918-4157-a8a8-51450a1ac421 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:20.640059 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1607603d-2918-4157-a8a8-51450a1ac421 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:20.641160 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1607603d-2918-4157-a8a8-51450a1ac421 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c" status: 200 len: 1262 microversion: 2.25 time: 0.172012 Oct 26 13:04:20.641747 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 243/543] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:20 2022] GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c => generated 1262 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:20.653622 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ab63b6c4-12e9-414d-b49f-d7098fd8e70b tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:20.654630 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ab63b6c4-12e9-414d-b49f-d7098fd8e70b tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] [instance: 710484b5-6fbe-4a33-8585-a5117a34262d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:20.668294 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ab63b6c4-12e9-414d-b49f-d7098fd8e70b tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:20.669189 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ab63b6c4-12e9-414d-b49f-d7098fd8e70b tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:20.669869 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ab63b6c4-12e9-414d-b49f-d7098fd8e70b tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:20.672040 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ab63b6c4-12e9-414d-b49f-d7098fd8e70b tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:20.676847 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ab63b6c4-12e9-414d-b49f-d7098fd8e70b tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:20.677042 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ec342613-3c03-44b1-b2e1-becbe059bf2f tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c240bdb5dd7249c79d9620637d0c6e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81334bcb49d84a529558a88b02b6ef55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:20.678093 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ab63b6c4-12e9-414d-b49f-d7098fd8e70b tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:20.685342 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ec342613-3c03-44b1-b2e1-becbe059bf2f tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] 10.222.0.40 "GET /compute/v2.1/servers/94b34e04-9a27-4158-aff1-95f37f1c7a58" status: 200 len: 1320 microversion: 2.1 time: 0.401208 Oct 26 13:04:20.709158 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 301/544] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:20 2022] GET /compute/v2.1/servers/94b34e04-9a27-4158-aff1-95f37f1c7a58 => generated 1320 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:20.711270 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-ab63b6c4-12e9-414d-b49f-d7098fd8e70b tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] HTTP exception thrown: Instance 710484b5-6fbe-4a33-8585-a5117a34262d could not be found. Oct 26 13:04:20.715849 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ab63b6c4-12e9-414d-b49f-d7098fd8e70b tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Request method failure captured: Oct 26 13:04:20.715849 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/710484b5-6fbe-4a33-8585-a5117a34262d HTTP/1.1 Oct 26 13:04:20.715849 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:04:20.715849 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:04:20.715849 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:04:20.715849 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:04:20.715849 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:04:20.715849 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:04:20.715849 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:04:20.715849 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:04:20.715849 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTA4AKucHEEIJlcwT6lgEl9Bv-HghBh83e8UYffVpko9S_kcJOGo7NAa8iIMVTj4omJsJfU866BNBb2Xj-lZ_Y2Hw8H3VfVS9It9mRvz5amM6mCwSJOkSqsvoBK_sOoewi2f6MSWX-IAlyulpGNHSeftHuixq0ziBEaU4H2ZArQo2eU Oct 26 13:04:20.715849 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:04:20.715849 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:04:20.715849 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:04:20.715849 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:04:20.715849 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:04:20.715849 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:04:20.715849 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: a588d8f9d1bd40d1b1dc487da7c572cd Oct 26 13:04:20.715849 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-738840969 Oct 26 13:04:20.715849 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:04:20.715849 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:04:20.717278 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a588d8f9d1bd40d1b1dc487da7c572cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a588d8f9d1bd40d1b1dc487da7c572cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a588d8f9d1bd40d1b1dc487da7c572cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a588d8f9d1bd40d1b1dc487da7c572cd"}]}] Oct 26 13:04:20.717278 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-738840969 Oct 26 13:04:20.717278 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: a588d8f9d1bd40d1b1dc487da7c572cd Oct 26 13:04:20.717278 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-738840969 Oct 26 13:04:20.717278 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServerDiagnosticsNegativeTest-738840969-project Oct 26 13:04:20.717278 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:04:20.717278 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:04:20.717278 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: d6506f19875d47ef81996f0c66a009ff Oct 26 13:04:20.717278 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-738840969-project Oct 26 13:04:20.717278 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:04:20.717278 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 710484b5-6fbe-4a33-8585-a5117a34262d could not be found. Oct 26 13:04:20.717278 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '710484b5-6fbe-4a33-8585-a5117a34262d'} Oct 26 13:04:20.718143 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:04:20.718143 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:20.718143 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:04:20.718143 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:04:20.718143 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:04:20.718143 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:04:20.718143 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:04:20.718143 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:04:20.718143 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:04:20.718143 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:04:20.718143 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 710484b5-6fbe-4a33-8585-a5117a34262d could not be found. Oct 26 13:04:20.718143 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:04:20.718143 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:04:20.718143 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:04:20.718143 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:20.718143 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:04:20.718143 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:04:20.718143 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:04:20.718143 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:04:20.718143 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:04:20.719325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:04:20.719325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:04:20.719325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:04:20.719325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:04:20.719325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:04:20.719325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:04:20.719325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:04:20.719325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 710484b5-6fbe-4a33-8585-a5117a34262d could not be found. Oct 26 13:04:20.719325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:04:20.719325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:04:20.719325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:04:20.719325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:20.719325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:04:20.719325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:04:20.719325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:04:20.719325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:04:20.719325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 710484b5-6fbe-4a33-8585-a5117a34262d could not be found. Oct 26 13:04:20.719325 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:04:20.720369 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ab63b6c4-12e9-414d-b49f-d7098fd8e70b tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] Returning 404 to user: Instance 710484b5-6fbe-4a33-8585-a5117a34262d could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:04:20.720369 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ab63b6c4-12e9-414d-b49f-d7098fd8e70b tempest-ServerDiagnosticsNegativeTest-738840969 tempest-ServerDiagnosticsNegativeTest-738840969-project] 10.222.0.40 "GET /compute/v2.1/servers/710484b5-6fbe-4a33-8585-a5117a34262d" status: 404 len: 111 microversion: 2.1 time: 0.077191 Oct 26 13:04:20.742942 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 244/545] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:20 2022] GET /compute/v2.1/servers/710484b5-6fbe-4a33-8585-a5117a34262d => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:04:20.949442 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9952f983-39ad-4b4c-b23f-aaf56e54a0e2 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:20.950123 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9952f983-39ad-4b4c-b23f-aaf56e54a0e2 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: dffc2812-b18a-4227-932f-3db590d7bc6f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:20.963413 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9952f983-39ad-4b4c-b23f-aaf56e54a0e2 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:20.966645 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9952f983-39ad-4b4c-b23f-aaf56e54a0e2 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:20.974094 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9952f983-39ad-4b4c-b23f-aaf56e54a0e2 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:20.979124 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9952f983-39ad-4b4c-b23f-aaf56e54a0e2 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:20.985636 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9952f983-39ad-4b4c-b23f-aaf56e54a0e2 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:20.987584 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9952f983-39ad-4b4c-b23f-aaf56e54a0e2 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:21.296496 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9952f983-39ad-4b4c-b23f-aaf56e54a0e2 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241a2299894849c889ee7f1100a9823d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec66df09b6114f5dbd6678d5e848c737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:21.306010 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9952f983-39ad-4b4c-b23f-aaf56e54a0e2 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] 10.222.0.40 "GET /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f" status: 200 len: 1323 microversion: 2.1 time: 0.361404 Oct 26 13:04:21.307086 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 302/546] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:20 2022] GET /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f => generated 1323 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:21.361696 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f2c17c9a-3e8b-4a8c-9259-30e5ad0e3d1f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:21.362474 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f2c17c9a-3e8b-4a8c-9259-30e5ad0e3d1f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 7da4bb85-b577-4608-a7c0-3320721cb997] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:21.372254 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2c17c9a-3e8b-4a8c-9259-30e5ad0e3d1f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:21.373012 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2c17c9a-3e8b-4a8c-9259-30e5ad0e3d1f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:21.373475 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2c17c9a-3e8b-4a8c-9259-30e5ad0e3d1f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:21.374727 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2c17c9a-3e8b-4a8c-9259-30e5ad0e3d1f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:21.375270 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2c17c9a-3e8b-4a8c-9259-30e5ad0e3d1f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:21.375639 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2c17c9a-3e8b-4a8c-9259-30e5ad0e3d1f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:21.489823 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-176914c2-2159-4e57-be17-f797215cfd46 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:21.490435 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-176914c2-2159-4e57-be17-f797215cfd46 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 4c694a16-fdba-414f-9122-1899cc715565] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:21.502180 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-176914c2-2159-4e57-be17-f797215cfd46 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:21.502683 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-176914c2-2159-4e57-be17-f797215cfd46 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:21.503525 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-176914c2-2159-4e57-be17-f797215cfd46 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:21.504658 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-176914c2-2159-4e57-be17-f797215cfd46 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:21.505258 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-176914c2-2159-4e57-be17-f797215cfd46 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:21.506135 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-176914c2-2159-4e57-be17-f797215cfd46 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:21.756449 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f2c17c9a-3e8b-4a8c-9259-30e5ad0e3d1f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:21.768033 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f2c17c9a-3e8b-4a8c-9259-30e5ad0e3d1f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997" status: 200 len: 1313 microversion: 2.1 time: 0.415502 Oct 26 13:04:21.768856 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 245/547] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:21 2022] GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997 => generated 1313 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:21.793611 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7420bdd6-efb9-467a-82bf-0fb8075c9b17 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:21.794603 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7420bdd6-efb9-467a-82bf-0fb8075c9b17 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: a28883a5-9f17-4514-823e-7b33a316d33c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:21.810043 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7420bdd6-efb9-467a-82bf-0fb8075c9b17 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:21.810875 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7420bdd6-efb9-467a-82bf-0fb8075c9b17 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:21.812687 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7420bdd6-efb9-467a-82bf-0fb8075c9b17 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:21.813721 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7420bdd6-efb9-467a-82bf-0fb8075c9b17 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:21.814405 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7420bdd6-efb9-467a-82bf-0fb8075c9b17 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:21.815069 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7420bdd6-efb9-467a-82bf-0fb8075c9b17 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:21.971287 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7420bdd6-efb9-467a-82bf-0fb8075c9b17 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:21.986570 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7420bdd6-efb9-467a-82bf-0fb8075c9b17 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:21.990014 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7420bdd6-efb9-467a-82bf-0fb8075c9b17 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:21.993360 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7420bdd6-efb9-467a-82bf-0fb8075c9b17 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c" status: 200 len: 1322 microversion: 2.25 time: 0.223101 Oct 26 13:04:22.010347 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-176914c2-2159-4e57-be17-f797215cfd46 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:22.017845 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 246/548] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:21 2022] GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:22.021035 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-176914c2-2159-4e57-be17-f797215cfd46 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/4c694a16-fdba-414f-9122-1899cc715565" status: 200 len: 1317 microversion: 2.1 time: 0.534449 Oct 26 13:04:22.021940 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 303/549] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:21 2022] GET /compute/v2.1/servers/4c694a16-fdba-414f-9122-1899cc715565 => generated 1317 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:22.026789 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b122a803-d2fb-4be3-a010-740143d424db tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:22.027560 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-d80929d5-145c-4704-85fa-688f1999a194 req-0b327ab1-c561-49fc-98e7-dd01f382e661 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7da4bb85-b577-4608-a7c0-3320721cb997", "tag": "612e62d8-c0dd-48c8-889d-f05c9055db41"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:22.027848 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b122a803-d2fb-4be3-a010-740143d424db tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] [instance: 94b34e04-9a27-4158-aff1-95f37f1c7a58] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:22.034193 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b122a803-d2fb-4be3-a010-740143d424db tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:22.035351 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b122a803-d2fb-4be3-a010-740143d424db tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:22.035990 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b122a803-d2fb-4be3-a010-740143d424db tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:22.036899 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b122a803-d2fb-4be3-a010-740143d424db tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:22.037362 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b122a803-d2fb-4be3-a010-740143d424db tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:22.037825 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b122a803-d2fb-4be3-a010-740143d424db tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:22.044603 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-d80929d5-145c-4704-85fa-688f1999a194 req-0b327ab1-c561-49fc-98e7-dd01f382e661 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:22.045592 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-d80929d5-145c-4704-85fa-688f1999a194 req-0b327ab1-c561-49fc-98e7-dd01f382e661 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:22.046198 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-d80929d5-145c-4704-85fa-688f1999a194 req-0b327ab1-c561-49fc-98e7-dd01f382e661 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:22.065368 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-d80929d5-145c-4704-85fa-688f1999a194 req-0b327ab1-c561-49fc-98e7-dd01f382e661 service nova] Creating event network-changed:612e62d8-c0dd-48c8-889d-f05c9055db41 for instance 7da4bb85-b577-4608-a7c0-3320721cb997 on n-h2-862686-1 Oct 26 13:04:22.075135 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-d80929d5-145c-4704-85fa-688f1999a194 req-0b327ab1-c561-49fc-98e7-dd01f382e661 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048181 Oct 26 13:04:22.076071 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 304/550] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:22.329817 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ddb1d87c-f3c2-4a1d-b9b4-0b4fdf1fb292 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:22.330720 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ddb1d87c-f3c2-4a1d-b9b4-0b4fdf1fb292 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: dffc2812-b18a-4227-932f-3db590d7bc6f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:22.338922 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ddb1d87c-f3c2-4a1d-b9b4-0b4fdf1fb292 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:22.339666 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ddb1d87c-f3c2-4a1d-b9b4-0b4fdf1fb292 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:22.340163 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ddb1d87c-f3c2-4a1d-b9b4-0b4fdf1fb292 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:22.340861 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ddb1d87c-f3c2-4a1d-b9b4-0b4fdf1fb292 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:22.341639 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ddb1d87c-f3c2-4a1d-b9b4-0b4fdf1fb292 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:22.343109 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ddb1d87c-f3c2-4a1d-b9b4-0b4fdf1fb292 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:22.400378 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b122a803-d2fb-4be3-a010-740143d424db tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c240bdb5dd7249c79d9620637d0c6e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81334bcb49d84a529558a88b02b6ef55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:22.410482 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b122a803-d2fb-4be3-a010-740143d424db tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] 10.222.0.40 "GET /compute/v2.1/servers/94b34e04-9a27-4158-aff1-95f37f1c7a58" status: 200 len: 1469 microversion: 2.1 time: 0.390119 Oct 26 13:04:22.411528 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 247/551] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:22 2022] GET /compute/v2.1/servers/94b34e04-9a27-4158-aff1-95f37f1c7a58 => generated 1469 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:22.449680 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-47147a13-42cb-4156-bc32-380a8cc787a9 tempest-DeleteServersAdminTestJSON-1586240307 tempest-DeleteServersAdminTestJSON-1586240307-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:22.452531 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-47147a13-42cb-4156-bc32-380a8cc787a9 tempest-DeleteServersAdminTestJSON-1586240307 tempest-DeleteServersAdminTestJSON-1586240307-project-admin] [instance: 94b34e04-9a27-4158-aff1-95f37f1c7a58] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:22.459309 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-47147a13-42cb-4156-bc32-380a8cc787a9 tempest-DeleteServersAdminTestJSON-1586240307 tempest-DeleteServersAdminTestJSON-1586240307-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:22.460018 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-47147a13-42cb-4156-bc32-380a8cc787a9 tempest-DeleteServersAdminTestJSON-1586240307 tempest-DeleteServersAdminTestJSON-1586240307-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:22.460618 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-47147a13-42cb-4156-bc32-380a8cc787a9 tempest-DeleteServersAdminTestJSON-1586240307 tempest-DeleteServersAdminTestJSON-1586240307-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:22.462080 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-47147a13-42cb-4156-bc32-380a8cc787a9 tempest-DeleteServersAdminTestJSON-1586240307 tempest-DeleteServersAdminTestJSON-1586240307-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:22.463568 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-47147a13-42cb-4156-bc32-380a8cc787a9 tempest-DeleteServersAdminTestJSON-1586240307 tempest-DeleteServersAdminTestJSON-1586240307-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:22.464534 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-47147a13-42cb-4156-bc32-380a8cc787a9 tempest-DeleteServersAdminTestJSON-1586240307 tempest-DeleteServersAdminTestJSON-1586240307-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:22.592250 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-47147a13-42cb-4156-bc32-380a8cc787a9 tempest-DeleteServersAdminTestJSON-1586240307 tempest-DeleteServersAdminTestJSON-1586240307-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/94b34e04-9a27-4158-aff1-95f37f1c7a58/action" status: 202 len: 0 microversion: 2.1 time: 0.150853 Oct 26 13:04:22.593695 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 248/552] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:04:22 2022] POST /compute/v2.1/servers/94b34e04-9a27-4158-aff1-95f37f1c7a58/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:04:22.595277 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ddb1d87c-f3c2-4a1d-b9b4-0b4fdf1fb292 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241a2299894849c889ee7f1100a9823d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec66df09b6114f5dbd6678d5e848c737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:22.604717 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2f28f8e3-2fcc-483a-b071-88725955df81 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:22.605467 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2f28f8e3-2fcc-483a-b071-88725955df81 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] [instance: 94b34e04-9a27-4158-aff1-95f37f1c7a58] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:22.609664 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ddb1d87c-f3c2-4a1d-b9b4-0b4fdf1fb292 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] 10.222.0.40 "GET /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f" status: 200 len: 1323 microversion: 2.1 time: 0.284146 Oct 26 13:04:22.621668 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2f28f8e3-2fcc-483a-b071-88725955df81 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:22.622804 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2f28f8e3-2fcc-483a-b071-88725955df81 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:22.623582 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2f28f8e3-2fcc-483a-b071-88725955df81 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:22.624590 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2f28f8e3-2fcc-483a-b071-88725955df81 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:22.625277 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2f28f8e3-2fcc-483a-b071-88725955df81 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:22.626136 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2f28f8e3-2fcc-483a-b071-88725955df81 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:22.639238 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 305/553] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:22 2022] GET /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f => generated 1323 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:22.682272 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2f28f8e3-2fcc-483a-b071-88725955df81 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:22.682768 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2f28f8e3-2fcc-483a-b071-88725955df81 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:22.683210 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2f28f8e3-2fcc-483a-b071-88725955df81 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:22.683731 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-2f28f8e3-2fcc-483a-b071-88725955df81 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lazy-loading 'fault' on Instance uuid 94b34e04-9a27-4158-aff1-95f37f1c7a58 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:04:22.778715 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-06439a7c-b5f9-47e6-a7e8-6a0c3f78013d req-ff830cdc-f471-4bb6-a010-898d11ef0f22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c694a16-fdba-414f-9122-1899cc715565", "tag": "ada02b45-c859-4cf1-a9a4-d28591f7a07b"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:22.790903 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-06439a7c-b5f9-47e6-a7e8-6a0c3f78013d req-ff830cdc-f471-4bb6-a010-898d11ef0f22 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:22.791984 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-06439a7c-b5f9-47e6-a7e8-6a0c3f78013d req-ff830cdc-f471-4bb6-a010-898d11ef0f22 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:22.792636 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-06439a7c-b5f9-47e6-a7e8-6a0c3f78013d req-ff830cdc-f471-4bb6-a010-898d11ef0f22 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:22.807558 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-06439a7c-b5f9-47e6-a7e8-6a0c3f78013d req-ff830cdc-f471-4bb6-a010-898d11ef0f22 service nova] Creating event network-changed:ada02b45-c859-4cf1-a9a4-d28591f7a07b for instance 4c694a16-fdba-414f-9122-1899cc715565 on n-h1-862686-1 Oct 26 13:04:22.813472 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-06439a7c-b5f9-47e6-a7e8-6a0c3f78013d req-ff830cdc-f471-4bb6-a010-898d11ef0f22 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038917 Oct 26 13:04:22.814723 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 306/554] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:22.820585 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-655f2b94-af54-43f7-997e-ae3c209d3338 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:22.822286 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-655f2b94-af54-43f7-997e-ae3c209d3338 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 7da4bb85-b577-4608-a7c0-3320721cb997] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:22.830196 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-655f2b94-af54-43f7-997e-ae3c209d3338 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:22.830700 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-655f2b94-af54-43f7-997e-ae3c209d3338 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:22.831141 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-655f2b94-af54-43f7-997e-ae3c209d3338 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:22.831922 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-655f2b94-af54-43f7-997e-ae3c209d3338 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:22.832394 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-655f2b94-af54-43f7-997e-ae3c209d3338 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:22.832820 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-655f2b94-af54-43f7-997e-ae3c209d3338 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:23.143495 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2f28f8e3-2fcc-483a-b071-88725955df81 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c240bdb5dd7249c79d9620637d0c6e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81334bcb49d84a529558a88b02b6ef55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:23.148315 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-655f2b94-af54-43f7-997e-ae3c209d3338 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:23.158953 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2f28f8e3-2fcc-483a-b071-88725955df81 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] 10.222.0.40 "GET /compute/v2.1/servers/94b34e04-9a27-4158-aff1-95f37f1c7a58" status: 200 len: 1452 microversion: 2.1 time: 0.560948 Oct 26 13:04:23.163044 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 249/555] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:22 2022] GET /compute/v2.1/servers/94b34e04-9a27-4158-aff1-95f37f1c7a58 => generated 1452 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:23.167163 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-655f2b94-af54-43f7-997e-ae3c209d3338 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997" status: 200 len: 1313 microversion: 2.1 time: 0.350817 Oct 26 13:04:23.167736 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 307/556] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:22 2022] GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997 => generated 1313 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:23.181003 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-090f6116-b385-420d-b207-e6f2dec8aefc tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:23.181003 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-090f6116-b385-420d-b207-e6f2dec8aefc tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: a28883a5-9f17-4514-823e-7b33a316d33c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:23.195420 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a786483a-5b23-417b-8ac9-9a3928c6f925 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:23.196658 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a786483a-5b23-417b-8ac9-9a3928c6f925 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 4c694a16-fdba-414f-9122-1899cc715565] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:23.204180 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-090f6116-b385-420d-b207-e6f2dec8aefc tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:23.204808 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-090f6116-b385-420d-b207-e6f2dec8aefc tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:23.205253 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-090f6116-b385-420d-b207-e6f2dec8aefc tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:23.205975 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-090f6116-b385-420d-b207-e6f2dec8aefc tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:23.207771 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-090f6116-b385-420d-b207-e6f2dec8aefc tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:23.209729 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-090f6116-b385-420d-b207-e6f2dec8aefc tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:23.215137 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a786483a-5b23-417b-8ac9-9a3928c6f925 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:23.215636 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a786483a-5b23-417b-8ac9-9a3928c6f925 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:23.218178 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a786483a-5b23-417b-8ac9-9a3928c6f925 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:23.218919 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a786483a-5b23-417b-8ac9-9a3928c6f925 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:23.219379 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a786483a-5b23-417b-8ac9-9a3928c6f925 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:23.219957 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a786483a-5b23-417b-8ac9-9a3928c6f925 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:23.375268 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-090f6116-b385-420d-b207-e6f2dec8aefc tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:23.398704 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-090f6116-b385-420d-b207-e6f2dec8aefc tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:23.401554 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-090f6116-b385-420d-b207-e6f2dec8aefc tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:23.403935 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-090f6116-b385-420d-b207-e6f2dec8aefc tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c" status: 200 len: 1320 microversion: 2.25 time: 0.239580 Oct 26 13:04:23.420955 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 250/557] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:23 2022] GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c => generated 1320 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:23.432053 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a786483a-5b23-417b-8ac9-9a3928c6f925 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:23.434355 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9aadc70e-e496-4c96-a2ae-7e61ec2b04b4 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:23.436734 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9aadc70e-e496-4c96-a2ae-7e61ec2b04b4 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] [instance: 94b34e04-9a27-4158-aff1-95f37f1c7a58] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:23.445222 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9aadc70e-e496-4c96-a2ae-7e61ec2b04b4 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:23.445408 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a786483a-5b23-417b-8ac9-9a3928c6f925 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/4c694a16-fdba-414f-9122-1899cc715565" status: 200 len: 1317 microversion: 2.1 time: 0.268309 Oct 26 13:04:23.446915 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9aadc70e-e496-4c96-a2ae-7e61ec2b04b4 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:23.447599 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9aadc70e-e496-4c96-a2ae-7e61ec2b04b4 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:23.448654 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9aadc70e-e496-4c96-a2ae-7e61ec2b04b4 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:23.449293 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 308/558] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:23 2022] GET /compute/v2.1/servers/4c694a16-fdba-414f-9122-1899cc715565 => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:23.449841 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9aadc70e-e496-4c96-a2ae-7e61ec2b04b4 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:23.450697 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9aadc70e-e496-4c96-a2ae-7e61ec2b04b4 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:23.489287 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9aadc70e-e496-4c96-a2ae-7e61ec2b04b4 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] [instance: 94b34e04-9a27-4158-aff1-95f37f1c7a58] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:04:23.639797 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-956ac910-3dc5-465c-909c-28b3f8a5e04e tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:23.640762 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-956ac910-3dc5-465c-909c-28b3f8a5e04e tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: dffc2812-b18a-4227-932f-3db590d7bc6f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:23.641062 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9aadc70e-e496-4c96-a2ae-7e61ec2b04b4 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] 10.222.0.40 "DELETE /compute/v2.1/servers/94b34e04-9a27-4158-aff1-95f37f1c7a58" status: 204 len: 0 microversion: 2.1 time: 0.213494 Oct 26 13:04:23.645792 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 251/559] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:04:23 2022] DELETE /compute/v2.1/servers/94b34e04-9a27-4158-aff1-95f37f1c7a58 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:04:23.653559 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-371bc436-df88-4afe-a32f-936b783b511e tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:23.654759 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-371bc436-df88-4afe-a32f-936b783b511e tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] [instance: 94b34e04-9a27-4158-aff1-95f37f1c7a58] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:23.658323 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-956ac910-3dc5-465c-909c-28b3f8a5e04e tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:23.658864 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-956ac910-3dc5-465c-909c-28b3f8a5e04e tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:23.659298 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-956ac910-3dc5-465c-909c-28b3f8a5e04e tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:23.662954 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-371bc436-df88-4afe-a32f-936b783b511e tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:23.663779 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-371bc436-df88-4afe-a32f-936b783b511e tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:23.664855 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-371bc436-df88-4afe-a32f-936b783b511e tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:23.665304 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-956ac910-3dc5-465c-909c-28b3f8a5e04e tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:23.666393 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-371bc436-df88-4afe-a32f-936b783b511e tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:23.667083 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-371bc436-df88-4afe-a32f-936b783b511e tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:23.668376 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-371bc436-df88-4afe-a32f-936b783b511e tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:23.670107 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-956ac910-3dc5-465c-909c-28b3f8a5e04e tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:23.671470 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-956ac910-3dc5-465c-909c-28b3f8a5e04e tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:23.759044 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-371bc436-df88-4afe-a32f-936b783b511e tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:23.761198 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-371bc436-df88-4afe-a32f-936b783b511e tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:23.761893 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-371bc436-df88-4afe-a32f-936b783b511e tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:23.764072 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-371bc436-df88-4afe-a32f-936b783b511e tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lazy-loading 'fault' on Instance uuid 94b34e04-9a27-4158-aff1-95f37f1c7a58 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:04:24.014296 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-956ac910-3dc5-465c-909c-28b3f8a5e04e tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241a2299894849c889ee7f1100a9823d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec66df09b6114f5dbd6678d5e848c737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:24.031792 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-956ac910-3dc5-465c-909c-28b3f8a5e04e tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] 10.222.0.40 "GET /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f" status: 200 len: 1323 microversion: 2.1 time: 0.391405 Oct 26 13:04:24.031792 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 309/560] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:23 2022] GET /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f => generated 1323 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:04:24.203942 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-42d700ee-6c0b-4db8-ab2e-0440eb29a86b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:24.203942 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-42d700ee-6c0b-4db8-ab2e-0440eb29a86b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 7da4bb85-b577-4608-a7c0-3320721cb997] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:24.211588 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42d700ee-6c0b-4db8-ab2e-0440eb29a86b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:24.212767 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42d700ee-6c0b-4db8-ab2e-0440eb29a86b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:24.214165 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42d700ee-6c0b-4db8-ab2e-0440eb29a86b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:24.215430 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42d700ee-6c0b-4db8-ab2e-0440eb29a86b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:24.215917 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42d700ee-6c0b-4db8-ab2e-0440eb29a86b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:24.216359 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42d700ee-6c0b-4db8-ab2e-0440eb29a86b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:24.234251 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-371bc436-df88-4afe-a32f-936b783b511e tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c240bdb5dd7249c79d9620637d0c6e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81334bcb49d84a529558a88b02b6ef55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:24.254159 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-371bc436-df88-4afe-a32f-936b783b511e tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] 10.222.0.40 "GET /compute/v2.1/servers/94b34e04-9a27-4158-aff1-95f37f1c7a58" status: 200 len: 1458 microversion: 2.1 time: 0.594576 Oct 26 13:04:24.254799 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 252/561] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:23 2022] GET /compute/v2.1/servers/94b34e04-9a27-4158-aff1-95f37f1c7a58 => generated 1458 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:24.408171 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-42d700ee-6c0b-4db8-ab2e-0440eb29a86b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:24.417128 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-42d700ee-6c0b-4db8-ab2e-0440eb29a86b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997" status: 200 len: 1313 microversion: 2.1 time: 0.218437 Oct 26 13:04:24.418136 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 310/562] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:24 2022] GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997 => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:24.437995 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c314aedc-65a2-46db-a182-9fcc035e4905 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:24.439355 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c314aedc-65a2-46db-a182-9fcc035e4905 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: a28883a5-9f17-4514-823e-7b33a316d33c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:24.452065 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c314aedc-65a2-46db-a182-9fcc035e4905 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:24.452565 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c314aedc-65a2-46db-a182-9fcc035e4905 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:24.453301 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c314aedc-65a2-46db-a182-9fcc035e4905 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:24.453930 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c314aedc-65a2-46db-a182-9fcc035e4905 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:24.454390 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c314aedc-65a2-46db-a182-9fcc035e4905 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:24.454818 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c314aedc-65a2-46db-a182-9fcc035e4905 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:24.471744 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-84e2e5d2-a3de-4a4b-a95e-7fbc96546682 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:24.472928 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-84e2e5d2-a3de-4a4b-a95e-7fbc96546682 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 4c694a16-fdba-414f-9122-1899cc715565] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:24.482398 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84e2e5d2-a3de-4a4b-a95e-7fbc96546682 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:24.483368 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84e2e5d2-a3de-4a4b-a95e-7fbc96546682 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:24.484946 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84e2e5d2-a3de-4a4b-a95e-7fbc96546682 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:24.486110 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84e2e5d2-a3de-4a4b-a95e-7fbc96546682 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:24.486799 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84e2e5d2-a3de-4a4b-a95e-7fbc96546682 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:24.487568 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84e2e5d2-a3de-4a4b-a95e-7fbc96546682 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:24.525077 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:04:24.671049 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-84e2e5d2-a3de-4a4b-a95e-7fbc96546682 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:24.689461 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-84e2e5d2-a3de-4a4b-a95e-7fbc96546682 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/4c694a16-fdba-414f-9122-1899cc715565" status: 200 len: 1317 microversion: 2.1 time: 0.224210 Oct 26 13:04:24.698595 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 311/563] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:24 2022] GET /compute/v2.1/servers/4c694a16-fdba-414f-9122-1899cc715565 => generated 1317 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:24.720143 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c314aedc-65a2-46db-a182-9fcc035e4905 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:24.732773 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c314aedc-65a2-46db-a182-9fcc035e4905 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:24.735036 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c314aedc-65a2-46db-a182-9fcc035e4905 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:24.735997 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c314aedc-65a2-46db-a182-9fcc035e4905 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c" status: 200 len: 1362 microversion: 2.25 time: 0.301865 Oct 26 13:04:24.736780 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 253/564] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:24 2022] GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c => generated 1362 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:24.850251 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-7a583533-04da-4f4f-90ab-9146188735e6 req-4e32625a-2ab1-41b5-9dfe-265c348649f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a28883a5-9f17-4514-823e-7b33a316d33c", "tag": "aadc618b-ef02-4624-a6f3-811fbef8dddd"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:24.869059 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-7a583533-04da-4f4f-90ab-9146188735e6 req-4e32625a-2ab1-41b5-9dfe-265c348649f6 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:24.869776 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-7a583533-04da-4f4f-90ab-9146188735e6 req-4e32625a-2ab1-41b5-9dfe-265c348649f6 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:24.870539 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-7a583533-04da-4f4f-90ab-9146188735e6 req-4e32625a-2ab1-41b5-9dfe-265c348649f6 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:24.892287 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-7a583533-04da-4f4f-90ab-9146188735e6 req-4e32625a-2ab1-41b5-9dfe-265c348649f6 service nova] Creating event network-changed:aadc618b-ef02-4624-a6f3-811fbef8dddd for instance a28883a5-9f17-4514-823e-7b33a316d33c on n-h1-862686-1 Oct 26 13:04:24.908898 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-7a583533-04da-4f4f-90ab-9146188735e6 req-4e32625a-2ab1-41b5-9dfe-265c348649f6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055114 Oct 26 13:04:24.909783 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 312/565] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:25.062229 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-45f4845b-76a1-4d85-9981-57533f388654 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:25.065035 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-45f4845b-76a1-4d85-9981-57533f388654 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: dffc2812-b18a-4227-932f-3db590d7bc6f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:25.091183 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-45f4845b-76a1-4d85-9981-57533f388654 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:25.095854 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-45f4845b-76a1-4d85-9981-57533f388654 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:25.096298 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-45f4845b-76a1-4d85-9981-57533f388654 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:25.097033 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-45f4845b-76a1-4d85-9981-57533f388654 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:25.097508 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-45f4845b-76a1-4d85-9981-57533f388654 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:25.097943 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-45f4845b-76a1-4d85-9981-57533f388654 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:25.630465 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-45f4845b-76a1-4d85-9981-57533f388654 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241a2299894849c889ee7f1100a9823d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec66df09b6114f5dbd6678d5e848c737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:25.644952 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-45f4845b-76a1-4d85-9981-57533f388654 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] 10.222.0.40 "GET /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f" status: 200 len: 1323 microversion: 2.1 time: 0.594844 Oct 26 13:04:25.649330 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 254/566] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:25 2022] GET /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f => generated 1323 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:25.663365 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6f145c2d-d1e4-427d-a45a-17aa37b1bd68 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:25.664158 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6f145c2d-d1e4-427d-a45a-17aa37b1bd68 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] [instance: 94b34e04-9a27-4158-aff1-95f37f1c7a58] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:25.674404 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f145c2d-d1e4-427d-a45a-17aa37b1bd68 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:25.682239 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f145c2d-d1e4-427d-a45a-17aa37b1bd68 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:25.682992 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f145c2d-d1e4-427d-a45a-17aa37b1bd68 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:25.685823 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f145c2d-d1e4-427d-a45a-17aa37b1bd68 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:25.687842 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f145c2d-d1e4-427d-a45a-17aa37b1bd68 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:25.691426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f145c2d-d1e4-427d-a45a-17aa37b1bd68 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:25.747006 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:04:25.767425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-031338d0-1c88-413e-bfe3-6505b2bf059f tempest-ServicesAdminNegativeTestJSON-990799083 tempest-ServicesAdminNegativeTestJSON-990799083-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:25.772935 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-031338d0-1c88-413e-bfe3-6505b2bf059f tempest-ServicesAdminNegativeTestJSON-990799083 tempest-ServicesAdminNegativeTestJSON-990799083-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:25.775851 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-031338d0-1c88-413e-bfe3-6505b2bf059f tempest-ServicesAdminNegativeTestJSON-990799083 tempest-ServicesAdminNegativeTestJSON-990799083-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:25.777841 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-031338d0-1c88-413e-bfe3-6505b2bf059f tempest-ServicesAdminNegativeTestJSON-990799083 tempest-ServicesAdminNegativeTestJSON-990799083-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:25.778847 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-031338d0-1c88-413e-bfe3-6505b2bf059f tempest-ServicesAdminNegativeTestJSON-990799083 tempest-ServicesAdminNegativeTestJSON-990799083-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:25.779620 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f145c2d-d1e4-427d-a45a-17aa37b1bd68 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:25.781341 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-031338d0-1c88-413e-bfe3-6505b2bf059f tempest-ServicesAdminNegativeTestJSON-990799083 tempest-ServicesAdminNegativeTestJSON-990799083-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:25.781816 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-031338d0-1c88-413e-bfe3-6505b2bf059f tempest-ServicesAdminNegativeTestJSON-990799083 tempest-ServicesAdminNegativeTestJSON-990799083-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:25.782342 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f145c2d-d1e4-427d-a45a-17aa37b1bd68 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:25.782952 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f145c2d-d1e4-427d-a45a-17aa37b1bd68 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:25.783414 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-6f145c2d-d1e4-427d-a45a-17aa37b1bd68 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lazy-loading 'fault' on Instance uuid 94b34e04-9a27-4158-aff1-95f37f1c7a58 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:04:25.792316 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=30 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:04:25.830308 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-031338d0-1c88-413e-bfe3-6505b2bf059f tempest-ServicesAdminNegativeTestJSON-990799083 tempest-ServicesAdminNegativeTestJSON-990799083-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.584752 Oct 26 13:04:25.831515 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 313/567] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 26 13:04:25 2022] GET /compute/v2.1/os-services => generated 944 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:04:25.837071 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7f265495-994f-4948-976c-9aa563641744 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:25.838115 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7f265495-994f-4948-976c-9aa563641744 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 7da4bb85-b577-4608-a7c0-3320721cb997] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:25.851532 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f265495-994f-4948-976c-9aa563641744 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:25.852889 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f265495-994f-4948-976c-9aa563641744 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:25.854139 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f265495-994f-4948-976c-9aa563641744 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:25.855194 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f265495-994f-4948-976c-9aa563641744 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:25.855808 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f265495-994f-4948-976c-9aa563641744 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:25.856510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f265495-994f-4948-976c-9aa563641744 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:26.095692 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7f265495-994f-4948-976c-9aa563641744 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:26.119097 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7f265495-994f-4948-976c-9aa563641744 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997" status: 200 len: 1313 microversion: 2.1 time: 0.285054 Oct 26 13:04:26.120676 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 314/568] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:25 2022] GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997 => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:26.131043 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-90694a3f-59ca-42b7-9e51-ac1a643af183 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:26.132285 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-90694a3f-59ca-42b7-9e51-ac1a643af183 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 4c694a16-fdba-414f-9122-1899cc715565] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:26.147012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90694a3f-59ca-42b7-9e51-ac1a643af183 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:26.147531 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90694a3f-59ca-42b7-9e51-ac1a643af183 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:26.147969 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90694a3f-59ca-42b7-9e51-ac1a643af183 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:26.148704 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90694a3f-59ca-42b7-9e51-ac1a643af183 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:26.150205 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90694a3f-59ca-42b7-9e51-ac1a643af183 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:26.150636 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90694a3f-59ca-42b7-9e51-ac1a643af183 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:26.364430 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-90694a3f-59ca-42b7-9e51-ac1a643af183 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:26.373544 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-90694a3f-59ca-42b7-9e51-ac1a643af183 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/4c694a16-fdba-414f-9122-1899cc715565" status: 200 len: 1317 microversion: 2.1 time: 0.251012 Oct 26 13:04:26.374454 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 315/569] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:26 2022] GET /compute/v2.1/servers/4c694a16-fdba-414f-9122-1899cc715565 => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:26.379688 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-029809ba-6a7c-4978-8d55-353df109b18a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:26.380599 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-029809ba-6a7c-4978-8d55-353df109b18a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: a28883a5-9f17-4514-823e-7b33a316d33c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:26.387215 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-029809ba-6a7c-4978-8d55-353df109b18a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:26.387703 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-029809ba-6a7c-4978-8d55-353df109b18a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:26.388389 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-029809ba-6a7c-4978-8d55-353df109b18a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:26.390087 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-029809ba-6a7c-4978-8d55-353df109b18a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:26.391020 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-029809ba-6a7c-4978-8d55-353df109b18a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:26.391484 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-029809ba-6a7c-4978-8d55-353df109b18a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:26.438657 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6f145c2d-d1e4-427d-a45a-17aa37b1bd68 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c240bdb5dd7249c79d9620637d0c6e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81334bcb49d84a529558a88b02b6ef55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:26.446366 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6f145c2d-d1e4-427d-a45a-17aa37b1bd68 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] 10.222.0.40 "GET /compute/v2.1/servers/94b34e04-9a27-4158-aff1-95f37f1c7a58" status: 200 len: 1458 microversion: 2.1 time: 0.795821 Oct 26 13:04:26.447163 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 255/570] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:25 2022] GET /compute/v2.1/servers/94b34e04-9a27-4158-aff1-95f37f1c7a58 => generated 1458 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:26.466888 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dc5d377e-8568-4830-a513-92c982162c9a tempest-ServicesAdminNegativeTestJSON-990799083 tempest-ServicesAdminNegativeTestJSON-990799083-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:26.470970 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc5d377e-8568-4830-a513-92c982162c9a tempest-ServicesAdminNegativeTestJSON-990799083 tempest-ServicesAdminNegativeTestJSON-990799083-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:26.471448 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc5d377e-8568-4830-a513-92c982162c9a tempest-ServicesAdminNegativeTestJSON-990799083 tempest-ServicesAdminNegativeTestJSON-990799083-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:26.471988 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc5d377e-8568-4830-a513-92c982162c9a tempest-ServicesAdminNegativeTestJSON-990799083 tempest-ServicesAdminNegativeTestJSON-990799083-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:26.472714 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc5d377e-8568-4830-a513-92c982162c9a tempest-ServicesAdminNegativeTestJSON-990799083 tempest-ServicesAdminNegativeTestJSON-990799083-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:26.473160 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc5d377e-8568-4830-a513-92c982162c9a tempest-ServicesAdminNegativeTestJSON-990799083 tempest-ServicesAdminNegativeTestJSON-990799083-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:26.473612 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc5d377e-8568-4830-a513-92c982162c9a tempest-ServicesAdminNegativeTestJSON-990799083 tempest-ServicesAdminNegativeTestJSON-990799083-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:26.499993 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-dc5d377e-8568-4830-a513-92c982162c9a tempest-ServicesAdminNegativeTestJSON-990799083 tempest-ServicesAdminNegativeTestJSON-990799083-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.037179 Oct 26 13:04:26.500772 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 256/571] 10.222.0.40 () {58 vars in 1170 bytes} [Wed Oct 26 13:04:26 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:26.535865 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-029809ba-6a7c-4978-8d55-353df109b18a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:26.545867 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-029809ba-6a7c-4978-8d55-353df109b18a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:26.547610 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-029809ba-6a7c-4978-8d55-353df109b18a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:26.548862 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-029809ba-6a7c-4978-8d55-353df109b18a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c" status: 200 len: 1362 microversion: 2.25 time: 0.173585 Oct 26 13:04:26.549830 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 316/572] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:26 2022] GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:26.554424 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-551e8ceb-87f6-4cc0-9bc2-22db9dfb6e65 tempest-ServicesAdminNegativeTestJSON-990799083 tempest-ServicesAdminNegativeTestJSON-990799083-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:26.559004 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-551e8ceb-87f6-4cc0-9bc2-22db9dfb6e65 tempest-ServicesAdminNegativeTestJSON-990799083 tempest-ServicesAdminNegativeTestJSON-990799083-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:26.559583 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-551e8ceb-87f6-4cc0-9bc2-22db9dfb6e65 tempest-ServicesAdminNegativeTestJSON-990799083 tempest-ServicesAdminNegativeTestJSON-990799083-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:26.560097 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-551e8ceb-87f6-4cc0-9bc2-22db9dfb6e65 tempest-ServicesAdminNegativeTestJSON-990799083 tempest-ServicesAdminNegativeTestJSON-990799083-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:26.560905 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-551e8ceb-87f6-4cc0-9bc2-22db9dfb6e65 tempest-ServicesAdminNegativeTestJSON-990799083 tempest-ServicesAdminNegativeTestJSON-990799083-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:26.561437 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-551e8ceb-87f6-4cc0-9bc2-22db9dfb6e65 tempest-ServicesAdminNegativeTestJSON-990799083 tempest-ServicesAdminNegativeTestJSON-990799083-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:26.562033 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-551e8ceb-87f6-4cc0-9bc2-22db9dfb6e65 tempest-ServicesAdminNegativeTestJSON-990799083 tempest-ServicesAdminNegativeTestJSON-990799083-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:26.576185 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:04:26.592879 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-551e8ceb-87f6-4cc0-9bc2-22db9dfb6e65 tempest-ServicesAdminNegativeTestJSON-990799083 tempest-ServicesAdminNegativeTestJSON-990799083-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.041883 Oct 26 13:04:26.593807 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 317/573] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 26 13:04:26 2022] GET /compute/v2.1/os-services => generated 944 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:26.607948 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5164bc0b-d8ee-431f-82ea-9c28c02c3587 tempest-ServicesAdminNegativeTestJSON-990799083 tempest-ServicesAdminNegativeTestJSON-990799083-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:26.611953 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5164bc0b-d8ee-431f-82ea-9c28c02c3587 tempest-ServicesAdminNegativeTestJSON-990799083 tempest-ServicesAdminNegativeTestJSON-990799083-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:26.612351 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5164bc0b-d8ee-431f-82ea-9c28c02c3587 tempest-ServicesAdminNegativeTestJSON-990799083 tempest-ServicesAdminNegativeTestJSON-990799083-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:26.613054 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5164bc0b-d8ee-431f-82ea-9c28c02c3587 tempest-ServicesAdminNegativeTestJSON-990799083 tempest-ServicesAdminNegativeTestJSON-990799083-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:26.614196 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5164bc0b-d8ee-431f-82ea-9c28c02c3587 tempest-ServicesAdminNegativeTestJSON-990799083 tempest-ServicesAdminNegativeTestJSON-990799083-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:26.614709 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5164bc0b-d8ee-431f-82ea-9c28c02c3587 tempest-ServicesAdminNegativeTestJSON-990799083 tempest-ServicesAdminNegativeTestJSON-990799083-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:26.615145 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5164bc0b-d8ee-431f-82ea-9c28c02c3587 tempest-ServicesAdminNegativeTestJSON-990799083 tempest-ServicesAdminNegativeTestJSON-990799083-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:26.648688 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5164bc0b-d8ee-431f-82ea-9c28c02c3587 tempest-ServicesAdminNegativeTestJSON-990799083 tempest-ServicesAdminNegativeTestJSON-990799083-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?host=n-d-862686-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.045406 Oct 26 13:04:26.658047 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 318/574] 10.222.0.40 () {58 vars in 1194 bytes} [Wed Oct 26 13:04:26 2022] GET /compute/v2.1/os-services?host=n-d-862686-1&binary=xxx => generated 16 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:04:26.663508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3983e0cc-cab3-4a43-aff6-41a9779644a6 tempest-ServicesAdminNegativeTestJSON-990799083 tempest-ServicesAdminNegativeTestJSON-990799083-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:26.668018 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3983e0cc-cab3-4a43-aff6-41a9779644a6 tempest-ServicesAdminNegativeTestJSON-990799083 tempest-ServicesAdminNegativeTestJSON-990799083-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:26.668517 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3983e0cc-cab3-4a43-aff6-41a9779644a6 tempest-ServicesAdminNegativeTestJSON-990799083 tempest-ServicesAdminNegativeTestJSON-990799083-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:26.668961 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3983e0cc-cab3-4a43-aff6-41a9779644a6 tempest-ServicesAdminNegativeTestJSON-990799083 tempest-ServicesAdminNegativeTestJSON-990799083-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:26.669772 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3983e0cc-cab3-4a43-aff6-41a9779644a6 tempest-ServicesAdminNegativeTestJSON-990799083 tempest-ServicesAdminNegativeTestJSON-990799083-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:26.670235 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3983e0cc-cab3-4a43-aff6-41a9779644a6 tempest-ServicesAdminNegativeTestJSON-990799083 tempest-ServicesAdminNegativeTestJSON-990799083-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:26.670654 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3983e0cc-cab3-4a43-aff6-41a9779644a6 tempest-ServicesAdminNegativeTestJSON-990799083 tempest-ServicesAdminNegativeTestJSON-990799083-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:26.671553 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-22d88e17-d957-4a59-aa02-6754f355d7e2 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-249575106", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": "none"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:26.698998 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3983e0cc-cab3-4a43-aff6-41a9779644a6 tempest-ServicesAdminNegativeTestJSON-990799083 tempest-ServicesAdminNegativeTestJSON-990799083-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.039872 Oct 26 13:04:26.699689 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 319/575] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 26 13:04:26 2022] GET /compute/v2.1/os-services => generated 944 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:26.712168 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8ab089c5-23b6-4a78-8396-8dd1a494c5f3 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:26.712784 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8ab089c5-23b6-4a78-8396-8dd1a494c5f3 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: dffc2812-b18a-4227-932f-3db590d7bc6f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:26.718817 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8ab089c5-23b6-4a78-8396-8dd1a494c5f3 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:26.719308 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8ab089c5-23b6-4a78-8396-8dd1a494c5f3 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:26.719747 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8ab089c5-23b6-4a78-8396-8dd1a494c5f3 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:26.720448 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8ab089c5-23b6-4a78-8396-8dd1a494c5f3 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:26.720903 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8ab089c5-23b6-4a78-8396-8dd1a494c5f3 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:26.721315 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8ab089c5-23b6-4a78-8396-8dd1a494c5f3 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:26.756690 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-22d88e17-d957-4a59-aa02-6754f355d7e2 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:04:26.757327 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-22d88e17-d957-4a59-aa02-6754f355d7e2 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:04:26.757989 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-22d88e17-d957-4a59-aa02-6754f355d7e2 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:04:26.759125 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-22d88e17-d957-4a59-aa02-6754f355d7e2 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:04:26.759707 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-22d88e17-d957-4a59-aa02-6754f355d7e2 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:04:26.770786 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22d88e17-d957-4a59-aa02-6754f355d7e2 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:26.771569 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22d88e17-d957-4a59-aa02-6754f355d7e2 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:26.772158 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22d88e17-d957-4a59-aa02-6754f355d7e2 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:26.773637 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22d88e17-d957-4a59-aa02-6754f355d7e2 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:26.774442 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22d88e17-d957-4a59-aa02-6754f355d7e2 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:26.775048 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22d88e17-d957-4a59-aa02-6754f355d7e2 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:26.794468 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-22d88e17-d957-4a59-aa02-6754f355d7e2 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Getting quotas for project bf8588dfed474a68a5c2bb6b3b38eacb. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:04:26.798993 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-22d88e17-d957-4a59-aa02-6754f355d7e2 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Getting quotas for user 29fc067b89b248259a5db3d1038a0646 and project bf8588dfed474a68a5c2bb6b3b38eacb. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:04:26.812608 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-22d88e17-d957-4a59-aa02-6754f355d7e2 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:04:26.815612 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-22d88e17-d957-4a59-aa02-6754f355d7e2 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:04:26.874420 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-22d88e17-d957-4a59-aa02-6754f355d7e2 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.372324 Oct 26 13:04:26.875976 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 257/576] 10.222.0.40 () {62 vars in 1188 bytes} [Wed Oct 26 13:04:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 375 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 26 13:04:26.881052 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e8bcca03-edf7-4018-bc69-5c6847c5ad2a tempest-ServicesAdminNegativeTestJSON-990799083 tempest-ServicesAdminNegativeTestJSON-990799083-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:26.887149 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e8bcca03-edf7-4018-bc69-5c6847c5ad2a tempest-ServicesAdminNegativeTestJSON-990799083 tempest-ServicesAdminNegativeTestJSON-990799083-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:26.887973 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e8bcca03-edf7-4018-bc69-5c6847c5ad2a tempest-ServicesAdminNegativeTestJSON-990799083 tempest-ServicesAdminNegativeTestJSON-990799083-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:26.888831 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e8bcca03-edf7-4018-bc69-5c6847c5ad2a tempest-ServicesAdminNegativeTestJSON-990799083 tempest-ServicesAdminNegativeTestJSON-990799083-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:26.889775 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e8bcca03-edf7-4018-bc69-5c6847c5ad2a tempest-ServicesAdminNegativeTestJSON-990799083 tempest-ServicesAdminNegativeTestJSON-990799083-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:26.890416 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e8bcca03-edf7-4018-bc69-5c6847c5ad2a tempest-ServicesAdminNegativeTestJSON-990799083 tempest-ServicesAdminNegativeTestJSON-990799083-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:26.891150 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e8bcca03-edf7-4018-bc69-5c6847c5ad2a tempest-ServicesAdminNegativeTestJSON-990799083 tempest-ServicesAdminNegativeTestJSON-990799083-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:26.927273 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e8bcca03-edf7-4018-bc69-5c6847c5ad2a tempest-ServicesAdminNegativeTestJSON-990799083 tempest-ServicesAdminNegativeTestJSON-990799083-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.049880 Oct 26 13:04:26.932965 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 258/577] 10.222.0.40 () {58 vars in 1198 bytes} [Wed Oct 26 13:04:26 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:04:26.939265 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-60a2e061-d648-4143-948c-462a6f8d03ad tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:26.941923 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-60a2e061-d648-4143-948c-462a6f8d03ad tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:27.079601 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-60a2e061-d648-4143-948c-462a6f8d03ad tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:27.090057 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8ab089c5-23b6-4a78-8396-8dd1a494c5f3 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241a2299894849c889ee7f1100a9823d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec66df09b6114f5dbd6678d5e848c737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:27.094457 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-60a2e061-d648-4143-948c-462a6f8d03ad tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:27.099109 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8ab089c5-23b6-4a78-8396-8dd1a494c5f3 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] 10.222.0.40 "GET /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f" status: 200 len: 1323 microversion: 2.1 time: 0.391378 Oct 26 13:04:27.099586 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-60a2e061-d648-4143-948c-462a6f8d03ad tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:27.103782 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 320/578] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:26 2022] GET /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f => generated 1323 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:27.110263 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:04:27.111884 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-60a2e061-d648-4143-948c-462a6f8d03ad tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] 10.222.0.40 "PUT /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 200 len: 1358 microversion: 2.75 time: 0.182371 Oct 26 13:04:27.116403 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 259/579] 10.222.0.40 () {62 vars in 1297 bytes} [Wed Oct 26 13:04:26 2022] PUT /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:27.150260 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-64994728-1e96-4ca1-a015-583903deb689 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:27.150986 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-64994728-1e96-4ca1-a015-583903deb689 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 7da4bb85-b577-4608-a7c0-3320721cb997] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:27.165179 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64994728-1e96-4ca1-a015-583903deb689 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:27.167243 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64994728-1e96-4ca1-a015-583903deb689 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:27.169634 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64994728-1e96-4ca1-a015-583903deb689 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:27.170893 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64994728-1e96-4ca1-a015-583903deb689 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:27.173735 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64994728-1e96-4ca1-a015-583903deb689 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:27.174637 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64994728-1e96-4ca1-a015-583903deb689 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:27.324235 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e64449d8-e1f1-47bd-9114-ea48fa6c9080 tempest-ServicesAdminNegativeTestJSON-730250939 tempest-ServicesAdminNegativeTestJSON-730250939-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:27.344533 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e64449d8-e1f1-47bd-9114-ea48fa6c9080 tempest-ServicesAdminNegativeTestJSON-730250939 tempest-ServicesAdminNegativeTestJSON-730250939-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '84f5211860824ae9b02884dcef6f8285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dba1b2e5cf4366a744b93845a8c8ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:27.349244 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e64449d8-e1f1-47bd-9114-ea48fa6c9080 tempest-ServicesAdminNegativeTestJSON-730250939 tempest-ServicesAdminNegativeTestJSON-730250939-project] Request method failure captured: Oct 26 13:04:27.349244 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 26 13:04:27.349244 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:04:27.349244 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:04:27.349244 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:04:27.349244 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:04:27.349244 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:04:27.349244 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:04:27.349244 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:04:27.349244 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:04:27.349244 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTBYH3OtGXi-XFBQglx8d-FH8ut82dOIs4uBVSeBFd_UnTiJg7dGPFzyL00R_6rQ0YPEx_wIDRnx1jbGClDQCF58mVRJzLrgTR5V1bxeks9i1myZeb0-V8xNfTQxSKjtYX1HMHbGWhkbumPmd4FafPLObSQGJgdAsrQdE6Bikid51Mw Oct 26 13:04:27.349244 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:04:27.349244 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:04:27.349244 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:04:27.349244 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:04:27.349244 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:04:27.349244 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:04:27.349244 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: a6dba1b2e5cf4366a744b93845a8c8ef Oct 26 13:04:27.349244 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-730250939 Oct 26 13:04:27.349244 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:04:27.349244 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:04:27.350813 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a6dba1b2e5cf4366a744b93845a8c8ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a6dba1b2e5cf4366a744b93845a8c8ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a6dba1b2e5cf4366a744b93845a8c8ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a6dba1b2e5cf4366a744b93845a8c8ef"}]}] Oct 26 13:04:27.350813 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-730250939 Oct 26 13:04:27.350813 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: a6dba1b2e5cf4366a744b93845a8c8ef Oct 26 13:04:27.350813 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-730250939 Oct 26 13:04:27.350813 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServicesAdminNegativeTestJSON-730250939-project Oct 26 13:04:27.350813 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:04:27.350813 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:04:27.350813 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 84f5211860824ae9b02884dcef6f8285 Oct 26 13:04:27.350813 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-730250939-project Oct 26 13:04:27.350813 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:04:27.350813 n-d-862686-1 devstack@n-api.service[120598]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 26 13:04:27.350813 n-d-862686-1 devstack@n-api.service[120598]: action_args: {} Oct 26 13:04:27.359014 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:04:27.359014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:27.359014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:04:27.359014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:04:27.359014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:04:27.359014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:04:27.359014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 26 13:04:27.359014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:04:27.359014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 26 13:04:27.359014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:04:27.359014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:04:27.359014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:04:27.359014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 26 13:04:27.359014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 26 13:04:27.359014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 13:04:27.359014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 13:04:27.359014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 13:04:27.359014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 13:04:27.359014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 13:04:27.360291 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 13:04:27.360291 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 13:04:27.360291 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 13:04:27.360291 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 13:04:27.360291 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 13:04:27.360291 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 13:04:27.360291 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 13:04:27.360291 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 13:04:27.360291 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 13:04:27.360291 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 26 13:04:27.360291 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:27.360291 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:04:27.360291 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:27.360291 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:27.360291 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:04:27.360291 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:04:27.360291 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 13:04:27.360291 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 13:04:27.360291 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 26 13:04:27.360291 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:27.361776 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e64449d8-e1f1-47bd-9114-ea48fa6c9080 tempest-ServicesAdminNegativeTestJSON-730250939 tempest-ServicesAdminNegativeTestJSON-730250939-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:04:27.361776 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e64449d8-e1f1-47bd-9114-ea48fa6c9080 tempest-ServicesAdminNegativeTestJSON-730250939 tempest-ServicesAdminNegativeTestJSON-730250939-project] 10.222.0.40 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.245997 Oct 26 13:04:27.361776 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 321/580] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 26 13:04:27 2022] GET /compute/v2.1/os-services => generated 112 bytes in 248 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:04:27.374030 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-135fc0e7-3c7a-4626-a10b-6903416fa4a4 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:27.374545 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-135fc0e7-3c7a-4626-a10b-6903416fa4a4 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:27.634178 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-135fc0e7-3c7a-4626-a10b-6903416fa4a4 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:27.645886 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-135fc0e7-3c7a-4626-a10b-6903416fa4a4 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:27.650475 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-135fc0e7-3c7a-4626-a10b-6903416fa4a4 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:27.663253 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-135fc0e7-3c7a-4626-a10b-6903416fa4a4 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] 10.222.0.40 "GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 200 len: 1358 microversion: 2.75 time: 0.308871 Oct 26 13:04:27.664746 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 322/581] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:27 2022] GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 1358 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:27.671266 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-be072139-f21e-4705-9f77-cb55d0ec8946 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:27.672433 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-be072139-f21e-4705-9f77-cb55d0ec8946 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 4c694a16-fdba-414f-9122-1899cc715565] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:27.683862 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be072139-f21e-4705-9f77-cb55d0ec8946 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:27.684759 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be072139-f21e-4705-9f77-cb55d0ec8946 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:27.692612 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be072139-f21e-4705-9f77-cb55d0ec8946 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:27.693881 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be072139-f21e-4705-9f77-cb55d0ec8946 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:27.695230 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be072139-f21e-4705-9f77-cb55d0ec8946 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:27.695675 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be072139-f21e-4705-9f77-cb55d0ec8946 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:27.733970 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-64994728-1e96-4ca1-a015-583903deb689 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:27.747906 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-64994728-1e96-4ca1-a015-583903deb689 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997" status: 200 len: 1313 microversion: 2.1 time: 0.602123 Oct 26 13:04:27.748617 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 260/582] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:27 2022] GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997 => generated 1313 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:04:27.753261 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2a59b621-8df4-4f34-afc6-57fcea196633 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:27.753894 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2a59b621-8df4-4f34-afc6-57fcea196633 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] [instance: 94b34e04-9a27-4158-aff1-95f37f1c7a58] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:27.762457 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2a59b621-8df4-4f34-afc6-57fcea196633 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:27.762967 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2a59b621-8df4-4f34-afc6-57fcea196633 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:27.763692 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2a59b621-8df4-4f34-afc6-57fcea196633 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:27.764361 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2a59b621-8df4-4f34-afc6-57fcea196633 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:27.765100 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2a59b621-8df4-4f34-afc6-57fcea196633 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:27.765755 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2a59b621-8df4-4f34-afc6-57fcea196633 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:27.843157 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2a59b621-8df4-4f34-afc6-57fcea196633 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:27.844461 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2a59b621-8df4-4f34-afc6-57fcea196633 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:27.845062 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2a59b621-8df4-4f34-afc6-57fcea196633 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:27.845695 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-2a59b621-8df4-4f34-afc6-57fcea196633 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lazy-loading 'fault' on Instance uuid 94b34e04-9a27-4158-aff1-95f37f1c7a58 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:04:27.902158 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2a59b621-8df4-4f34-afc6-57fcea196633 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c240bdb5dd7249c79d9620637d0c6e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81334bcb49d84a529558a88b02b6ef55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:27.913431 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2a59b621-8df4-4f34-afc6-57fcea196633 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] 10.222.0.40 "GET /compute/v2.1/servers/94b34e04-9a27-4158-aff1-95f37f1c7a58" status: 200 len: 1310 microversion: 2.1 time: 0.163775 Oct 26 13:04:27.929891 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 261/583] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:27 2022] GET /compute/v2.1/servers/94b34e04-9a27-4158-aff1-95f37f1c7a58 => generated 1310 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:27.939224 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-128a02ba-ac96-4ae9-a0b0-e775812b8b80 req-b9a3908a-9ed2-4295-9187-479c1e483697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94b34e04-9a27-4158-aff1-95f37f1c7a58", "name": "network-vif-deleted", "tag": "80b659d1-4b85-4552-9b75-2213e7463923"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:27.951045 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-128a02ba-ac96-4ae9-a0b0-e775812b8b80 req-b9a3908a-9ed2-4295-9187-479c1e483697 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:27.951783 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-128a02ba-ac96-4ae9-a0b0-e775812b8b80 req-b9a3908a-9ed2-4295-9187-479c1e483697 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:27.952430 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-128a02ba-ac96-4ae9-a0b0-e775812b8b80 req-b9a3908a-9ed2-4295-9187-479c1e483697 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:27.966502 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-128a02ba-ac96-4ae9-a0b0-e775812b8b80 req-b9a3908a-9ed2-4295-9187-479c1e483697 service nova] Creating event network-vif-deleted:80b659d1-4b85-4552-9b75-2213e7463923 for instance 94b34e04-9a27-4158-aff1-95f37f1c7a58 on n-h2-862686-1 Oct 26 13:04:27.973528 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-128a02ba-ac96-4ae9-a0b0-e775812b8b80 req-b9a3908a-9ed2-4295-9187-479c1e483697 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040320 Oct 26 13:04:27.979489 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 262/584] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:27.986112 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8897802a-817f-4f14-8cd9-c6cc5abaa75d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:27.987149 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8897802a-817f-4f14-8cd9-c6cc5abaa75d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: a28883a5-9f17-4514-823e-7b33a316d33c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:27.996816 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8897802a-817f-4f14-8cd9-c6cc5abaa75d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:27.997584 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8897802a-817f-4f14-8cd9-c6cc5abaa75d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:27.998447 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8897802a-817f-4f14-8cd9-c6cc5abaa75d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:27.999591 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8897802a-817f-4f14-8cd9-c6cc5abaa75d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:28.000433 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8897802a-817f-4f14-8cd9-c6cc5abaa75d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:28.001074 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8897802a-817f-4f14-8cd9-c6cc5abaa75d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:28.072917 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-be072139-f21e-4705-9f77-cb55d0ec8946 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:28.083996 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-be072139-f21e-4705-9f77-cb55d0ec8946 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/4c694a16-fdba-414f-9122-1899cc715565" status: 200 len: 1317 microversion: 2.1 time: 0.417365 Oct 26 13:04:28.085392 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 323/585] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:27 2022] GET /compute/v2.1/servers/4c694a16-fdba-414f-9122-1899cc715565 => generated 1317 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:28.098890 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5fac82a8-e23e-465e-ae21-fb8e70c90e7d tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:28.103711 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5fac82a8-e23e-465e-ae21-fb8e70c90e7d tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] [instance: 380d16a8-2b4c-460b-9b36-884e7fb24812] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:28.113558 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5fac82a8-e23e-465e-ae21-fb8e70c90e7d tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:28.114927 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5fac82a8-e23e-465e-ae21-fb8e70c90e7d tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:28.115805 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5fac82a8-e23e-465e-ae21-fb8e70c90e7d tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:28.116667 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5fac82a8-e23e-465e-ae21-fb8e70c90e7d tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:28.117300 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5fac82a8-e23e-465e-ae21-fb8e70c90e7d tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:28.118539 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5fac82a8-e23e-465e-ae21-fb8e70c90e7d tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:28.183381 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5fac82a8-e23e-465e-ae21-fb8e70c90e7d tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] [instance: 380d16a8-2b4c-460b-9b36-884e7fb24812] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:04:28.207248 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8897802a-817f-4f14-8cd9-c6cc5abaa75d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:28.218645 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8897802a-817f-4f14-8cd9-c6cc5abaa75d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:28.222458 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8897802a-817f-4f14-8cd9-c6cc5abaa75d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:28.223769 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8897802a-817f-4f14-8cd9-c6cc5abaa75d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c" status: 200 len: 1362 microversion: 2.25 time: 0.242881 Oct 26 13:04:28.224964 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 263/586] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:27 2022] GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c => generated 1362 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:28.232798 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-31a40ec7-afe5-446a-8fe0-dfd499f5f33e tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:28.233820 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-31a40ec7-afe5-446a-8fe0-dfd499f5f33e tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: dffc2812-b18a-4227-932f-3db590d7bc6f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:28.244215 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31a40ec7-afe5-446a-8fe0-dfd499f5f33e tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:28.245011 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31a40ec7-afe5-446a-8fe0-dfd499f5f33e tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:28.245619 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31a40ec7-afe5-446a-8fe0-dfd499f5f33e tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:28.246575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31a40ec7-afe5-446a-8fe0-dfd499f5f33e tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:28.247245 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31a40ec7-afe5-446a-8fe0-dfd499f5f33e tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:28.247875 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31a40ec7-afe5-446a-8fe0-dfd499f5f33e tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:28.349219 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5fac82a8-e23e-465e-ae21-fb8e70c90e7d tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] 10.222.0.40 "DELETE /compute/v2.1/servers/380d16a8-2b4c-460b-9b36-884e7fb24812" status: 204 len: 0 microversion: 2.1 time: 0.262302 Oct 26 13:04:28.350240 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 324/587] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:04:28 2022] DELETE /compute/v2.1/servers/380d16a8-2b4c-460b-9b36-884e7fb24812 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:04:28.467736 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-6e6e37f4-4e42-4447-b787-277312511cfe req-b0bdeb88-dd08-402d-b956-0ca053f840d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7da4bb85-b577-4608-a7c0-3320721cb997", "name": "network-vif-plugged", "status": "completed", "tag": "612e62d8-c0dd-48c8-889d-f05c9055db41"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:28.481559 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-6e6e37f4-4e42-4447-b787-277312511cfe req-b0bdeb88-dd08-402d-b956-0ca053f840d1 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:28.482053 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-6e6e37f4-4e42-4447-b787-277312511cfe req-b0bdeb88-dd08-402d-b956-0ca053f840d1 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:28.482477 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-6e6e37f4-4e42-4447-b787-277312511cfe req-b0bdeb88-dd08-402d-b956-0ca053f840d1 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:28.508213 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-6e6e37f4-4e42-4447-b787-277312511cfe req-b0bdeb88-dd08-402d-b956-0ca053f840d1 service nova] Creating event network-vif-plugged:612e62d8-c0dd-48c8-889d-f05c9055db41 for instance 7da4bb85-b577-4608-a7c0-3320721cb997 on n-h2-862686-1 Oct 26 13:04:28.512501 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-31a40ec7-afe5-446a-8fe0-dfd499f5f33e tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241a2299894849c889ee7f1100a9823d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec66df09b6114f5dbd6678d5e848c737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:28.514125 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-6e6e37f4-4e42-4447-b787-277312511cfe req-b0bdeb88-dd08-402d-b956-0ca053f840d1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056485 Oct 26 13:04:28.515155 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 325/588] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:28.521829 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-af973945-6256-42cb-898b-33050c982a92 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1656433415", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "566667230", "adminPass": "***", "networks": [{"uuid": "9d8caa44-a218-4de4-8792-8a79982b84cb"}], "security_groups": [{"name": "tempest-securitygroup--1761964662"}], "key_name": "tempest-keypair-1688437826", "user_data": "}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:28.522651 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-31a40ec7-afe5-446a-8fe0-dfd499f5f33e tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] 10.222.0.40 "GET /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f" status: 200 len: 1323 microversion: 2.1 time: 0.296526 Oct 26 13:04:28.523757 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 264/589] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:28 2022] GET /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f => generated 1323 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:28.684608 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-af973945-6256-42cb-898b-33050c982a92 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] validate_networks() for [('9d8caa44-a218-4de4-8792-8a79982b84cb', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:04:28.695229 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2b0d2ce0-5ee9-458e-9d74-98826d6f0da9 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:28.696167 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2b0d2ce0-5ee9-458e-9d74-98826d6f0da9 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:28.704712 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b0d2ce0-5ee9-458e-9d74-98826d6f0da9 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:28.705548 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b0d2ce0-5ee9-458e-9d74-98826d6f0da9 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:28.706181 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b0d2ce0-5ee9-458e-9d74-98826d6f0da9 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:28.707210 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b0d2ce0-5ee9-458e-9d74-98826d6f0da9 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:28.707863 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b0d2ce0-5ee9-458e-9d74-98826d6f0da9 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:28.708491 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b0d2ce0-5ee9-458e-9d74-98826d6f0da9 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:28.881042 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2b0d2ce0-5ee9-458e-9d74-98826d6f0da9 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:28.897351 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2b0d2ce0-5ee9-458e-9d74-98826d6f0da9 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:28.905416 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2b0d2ce0-5ee9-458e-9d74-98826d6f0da9 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:28.913806 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2b0d2ce0-5ee9-458e-9d74-98826d6f0da9 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] 10.222.0.40 "GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 200 len: 1418 microversion: 2.75 time: 0.222388 Oct 26 13:04:28.914404 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 265/590] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:28 2022] GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 1418 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:04:28.925301 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-90a53540-cc97-401a-bcdb-fe28b4be2100 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:28.926155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-90a53540-cc97-401a-bcdb-fe28b4be2100 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 7da4bb85-b577-4608-a7c0-3320721cb997] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:28.933874 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90a53540-cc97-401a-bcdb-fe28b4be2100 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:28.934563 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90a53540-cc97-401a-bcdb-fe28b4be2100 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:28.935294 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90a53540-cc97-401a-bcdb-fe28b4be2100 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:28.937678 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90a53540-cc97-401a-bcdb-fe28b4be2100 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:28.938338 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90a53540-cc97-401a-bcdb-fe28b4be2100 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:28.938767 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90a53540-cc97-401a-bcdb-fe28b4be2100 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:29.111208 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-90a53540-cc97-401a-bcdb-fe28b4be2100 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:29.123189 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-90a53540-cc97-401a-bcdb-fe28b4be2100 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997" status: 200 len: 1313 microversion: 2.1 time: 0.205698 Oct 26 13:04:29.124900 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 266/591] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:28 2022] GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997 => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:29.130141 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cbf9bdce-4e36-4ee5-94e4-54221570d213 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:29.131036 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cbf9bdce-4e36-4ee5-94e4-54221570d213 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] [instance: 94b34e04-9a27-4158-aff1-95f37f1c7a58] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:29.139421 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cbf9bdce-4e36-4ee5-94e4-54221570d213 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:29.140197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cbf9bdce-4e36-4ee5-94e4-54221570d213 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:29.140827 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cbf9bdce-4e36-4ee5-94e4-54221570d213 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:29.141778 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cbf9bdce-4e36-4ee5-94e4-54221570d213 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:29.142588 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cbf9bdce-4e36-4ee5-94e4-54221570d213 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:29.143256 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cbf9bdce-4e36-4ee5-94e4-54221570d213 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:29.185171 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cbf9bdce-4e36-4ee5-94e4-54221570d213 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:29.186567 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cbf9bdce-4e36-4ee5-94e4-54221570d213 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:29.187227 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cbf9bdce-4e36-4ee5-94e4-54221570d213 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:29.187902 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-cbf9bdce-4e36-4ee5-94e4-54221570d213 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lazy-loading 'fault' on Instance uuid 94b34e04-9a27-4158-aff1-95f37f1c7a58 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:04:29.251471 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cbf9bdce-4e36-4ee5-94e4-54221570d213 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c240bdb5dd7249c79d9620637d0c6e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81334bcb49d84a529558a88b02b6ef55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:29.268049 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cbf9bdce-4e36-4ee5-94e4-54221570d213 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] 10.222.0.40 "GET /compute/v2.1/servers/94b34e04-9a27-4158-aff1-95f37f1c7a58" status: 200 len: 1310 microversion: 2.1 time: 0.141646 Oct 26 13:04:29.270732 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 267/592] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:29 2022] GET /compute/v2.1/servers/94b34e04-9a27-4158-aff1-95f37f1c7a58 => generated 1310 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:29.277041 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-801d1ba1-132f-462a-8dee-7609224452b6 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:29.279039 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-801d1ba1-132f-462a-8dee-7609224452b6 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 4c694a16-fdba-414f-9122-1899cc715565] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:29.286781 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-801d1ba1-132f-462a-8dee-7609224452b6 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:29.287520 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-801d1ba1-132f-462a-8dee-7609224452b6 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:29.288144 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-801d1ba1-132f-462a-8dee-7609224452b6 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:29.290529 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-801d1ba1-132f-462a-8dee-7609224452b6 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:29.292046 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-801d1ba1-132f-462a-8dee-7609224452b6 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:29.294119 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-801d1ba1-132f-462a-8dee-7609224452b6 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:29.430312 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-af973945-6256-42cb-898b-33050c982a92 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:04:29.431443 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-af973945-6256-42cb-898b-33050c982a92 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:04:29.431983 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-af973945-6256-42cb-898b-33050c982a92 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:04:29.432400 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-af973945-6256-42cb-898b-33050c982a92 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:04:29.433875 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-af973945-6256-42cb-898b-33050c982a92 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:04:29.452087 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af973945-6256-42cb-898b-33050c982a92 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:29.452584 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af973945-6256-42cb-898b-33050c982a92 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:29.453305 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af973945-6256-42cb-898b-33050c982a92 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:29.454107 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af973945-6256-42cb-898b-33050c982a92 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:29.454754 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af973945-6256-42cb-898b-33050c982a92 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:29.455354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af973945-6256-42cb-898b-33050c982a92 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:29.482194 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-af973945-6256-42cb-898b-33050c982a92 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Getting quotas for project 10521abb1c34417fa9369aaba9070968. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:04:29.488557 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-af973945-6256-42cb-898b-33050c982a92 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Getting quotas for user 52f9391046054747bbfc1c3e6d65d4aa and project 10521abb1c34417fa9369aaba9070968. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:04:29.501814 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-af973945-6256-42cb-898b-33050c982a92 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:04:29.505671 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-af973945-6256-42cb-898b-33050c982a92 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] [instance: 480f7c70-2963-4887-b8f8-ea3737880136] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:04:29.522344 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-801d1ba1-132f-462a-8dee-7609224452b6 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:29.540891 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-801d1ba1-132f-462a-8dee-7609224452b6 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/4c694a16-fdba-414f-9122-1899cc715565" status: 200 len: 1317 microversion: 2.1 time: 0.267966 Oct 26 13:04:29.542087 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 268/593] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:29 2022] GET /compute/v2.1/servers/4c694a16-fdba-414f-9122-1899cc715565 => generated 1317 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:29.558550 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d748740a-cb09-411c-9188-2c6866f0c832 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:29.560167 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d748740a-cb09-411c-9188-2c6866f0c832 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: a28883a5-9f17-4514-823e-7b33a316d33c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:29.568633 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d748740a-cb09-411c-9188-2c6866f0c832 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:29.569310 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d748740a-cb09-411c-9188-2c6866f0c832 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:29.570055 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d748740a-cb09-411c-9188-2c6866f0c832 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:29.570960 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d748740a-cb09-411c-9188-2c6866f0c832 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:29.571510 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d748740a-cb09-411c-9188-2c6866f0c832 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:29.572034 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d748740a-cb09-411c-9188-2c6866f0c832 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:29.590718 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-af973945-6256-42cb-898b-33050c982a92 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.074359 Oct 26 13:04:29.592229 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 326/594] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:04:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 1076 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:04:29.597825 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d993a9c5-33c4-4e02-aa8b-924349e7ccd3 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:29.598441 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d993a9c5-33c4-4e02-aa8b-924349e7ccd3 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: dffc2812-b18a-4227-932f-3db590d7bc6f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:29.607484 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d993a9c5-33c4-4e02-aa8b-924349e7ccd3 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:29.608268 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d993a9c5-33c4-4e02-aa8b-924349e7ccd3 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:29.609078 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d993a9c5-33c4-4e02-aa8b-924349e7ccd3 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:29.609965 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d993a9c5-33c4-4e02-aa8b-924349e7ccd3 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:29.610570 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d993a9c5-33c4-4e02-aa8b-924349e7ccd3 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:29.611145 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d993a9c5-33c4-4e02-aa8b-924349e7ccd3 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:29.857726 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d748740a-cb09-411c-9188-2c6866f0c832 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:29.879143 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d748740a-cb09-411c-9188-2c6866f0c832 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:29.889042 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d748740a-cb09-411c-9188-2c6866f0c832 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:29.892322 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d748740a-cb09-411c-9188-2c6866f0c832 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c" status: 200 len: 1362 microversion: 2.25 time: 0.348434 Oct 26 13:04:29.893456 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 269/595] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:29 2022] GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c => generated 1362 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:29.903557 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d6166336-6950-4386-8968-620d0f75127a tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:29.904739 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d6166336-6950-4386-8968-620d0f75127a tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] [instance: 480f7c70-2963-4887-b8f8-ea3737880136] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:29.920718 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d993a9c5-33c4-4e02-aa8b-924349e7ccd3 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241a2299894849c889ee7f1100a9823d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec66df09b6114f5dbd6678d5e848c737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:29.932193 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d993a9c5-33c4-4e02-aa8b-924349e7ccd3 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] 10.222.0.40 "GET /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f" status: 200 len: 1323 microversion: 2.1 time: 0.338519 Oct 26 13:04:29.934104 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 327/596] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:29 2022] GET /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f => generated 1323 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:29.945593 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c823bf77-0997-4fd0-831d-21b962b0de02 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:29.946278 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c823bf77-0997-4fd0-831d-21b962b0de02 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:29.964445 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c823bf77-0997-4fd0-831d-21b962b0de02 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:29.964950 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c823bf77-0997-4fd0-831d-21b962b0de02 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:29.965386 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c823bf77-0997-4fd0-831d-21b962b0de02 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:29.967542 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c823bf77-0997-4fd0-831d-21b962b0de02 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:29.968024 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c823bf77-0997-4fd0-831d-21b962b0de02 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:29.968445 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c823bf77-0997-4fd0-831d-21b962b0de02 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:30.016391 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d6166336-6950-4386-8968-620d0f75127a tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f9391046054747bbfc1c3e6d65d4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10521abb1c34417fa9369aaba9070968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:30.029259 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d6166336-6950-4386-8968-620d0f75127a tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] 10.222.0.40 "GET /compute/v2.1/servers/480f7c70-2963-4887-b8f8-ea3737880136" status: 200 len: 1263 microversion: 2.1 time: 0.133628 Oct 26 13:04:30.029929 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 270/597] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:29 2022] GET /compute/v2.1/servers/480f7c70-2963-4887-b8f8-ea3737880136 => generated 1263 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:30.155578 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3097761f-83cf-4cb1-bd30-69c8500df0fb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:30.156765 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3097761f-83cf-4cb1-bd30-69c8500df0fb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 7da4bb85-b577-4608-a7c0-3320721cb997] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:30.174024 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3097761f-83cf-4cb1-bd30-69c8500df0fb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:30.175614 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3097761f-83cf-4cb1-bd30-69c8500df0fb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:30.177994 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3097761f-83cf-4cb1-bd30-69c8500df0fb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:30.179447 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3097761f-83cf-4cb1-bd30-69c8500df0fb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:30.179946 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3097761f-83cf-4cb1-bd30-69c8500df0fb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:30.181916 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3097761f-83cf-4cb1-bd30-69c8500df0fb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:30.238047 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c823bf77-0997-4fd0-831d-21b962b0de02 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:30.259030 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c823bf77-0997-4fd0-831d-21b962b0de02 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:30.261706 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c823bf77-0997-4fd0-831d-21b962b0de02 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:30.268969 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c823bf77-0997-4fd0-831d-21b962b0de02 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] 10.222.0.40 "GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 200 len: 1416 microversion: 2.75 time: 0.330097 Oct 26 13:04:30.276384 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 328/598] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:29 2022] GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 1416 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:04:30.299930 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a5c4a2e6-d11d-4b95-b8b4-5c9577e88bca tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:30.301081 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a5c4a2e6-d11d-4b95-b8b4-5c9577e88bca tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] [instance: 94b34e04-9a27-4158-aff1-95f37f1c7a58] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:30.327377 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5c4a2e6-d11d-4b95-b8b4-5c9577e88bca tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:30.329185 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5c4a2e6-d11d-4b95-b8b4-5c9577e88bca tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:30.329928 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5c4a2e6-d11d-4b95-b8b4-5c9577e88bca tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:30.332482 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5c4a2e6-d11d-4b95-b8b4-5c9577e88bca tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:30.333205 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5c4a2e6-d11d-4b95-b8b4-5c9577e88bca tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:30.333771 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5c4a2e6-d11d-4b95-b8b4-5c9577e88bca tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:30.350169 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-a5c4a2e6-d11d-4b95-b8b4-5c9577e88bca tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] HTTP exception thrown: Instance 94b34e04-9a27-4158-aff1-95f37f1c7a58 could not be found. Oct 26 13:04:30.352168 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a5c4a2e6-d11d-4b95-b8b4-5c9577e88bca tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Request method failure captured: Oct 26 13:04:30.352168 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/94b34e04-9a27-4158-aff1-95f37f1c7a58 HTTP/1.1 Oct 26 13:04:30.352168 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:04:30.352168 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:04:30.352168 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:04:30.352168 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:04:30.352168 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:04:30.352168 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:04:30.352168 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:04:30.352168 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:04:30.352168 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTAsvL_mOVwVHFRIgqhMVDGVQnaU1Lsyvu6BwTswQ2wBT-qReJV0YHc-AAmO2bNNtxL3uV9ooCe7l3ooI3NQaC282z1IaNoyhH-svGIe_GFEWrP0_rldvJvaH2HPQ6eMb_GFw9Q0kuM1Mbt6h7W-lyi3GMjD50hXcB1wLxKlSq8Mv40 Oct 26 13:04:30.352168 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:04:30.352168 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:04:30.352168 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:04:30.352168 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:04:30.352168 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:04:30.352168 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:04:30.352168 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 81334bcb49d84a529558a88b02b6ef55 Oct 26 13:04:30.352168 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-DeleteServersAdminTestJSON-712867320 Oct 26 13:04:30.352168 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:04:30.352168 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:04:30.353630 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/81334bcb49d84a529558a88b02b6ef55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/81334bcb49d84a529558a88b02b6ef55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_81334bcb49d84a529558a88b02b6ef55"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/81334bcb49d84a529558a88b02b6ef55"}]}] Oct 26 13:04:30.353630 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-DeleteServersAdminTestJSON-712867320 Oct 26 13:04:30.353630 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 81334bcb49d84a529558a88b02b6ef55 Oct 26 13:04:30.353630 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-712867320 Oct 26 13:04:30.353630 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-DeleteServersAdminTestJSON-712867320-project Oct 26 13:04:30.353630 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:04:30.353630 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:04:30.353630 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: c240bdb5dd7249c79d9620637d0c6e3b Oct 26 13:04:30.353630 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-DeleteServersAdminTestJSON-712867320-project Oct 26 13:04:30.353630 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:04:30.353630 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 94b34e04-9a27-4158-aff1-95f37f1c7a58 could not be found. Oct 26 13:04:30.353630 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '94b34e04-9a27-4158-aff1-95f37f1c7a58'} Oct 26 13:04:30.354356 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:04:30.354356 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:30.354356 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:04:30.354356 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:04:30.354356 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:04:30.354356 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:04:30.354356 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:04:30.354356 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:04:30.354356 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:04:30.354356 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:04:30.354356 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94b34e04-9a27-4158-aff1-95f37f1c7a58 could not be found. Oct 26 13:04:30.354356 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:30.354356 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:04:30.354356 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:30.354356 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:30.354356 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:04:30.354356 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:04:30.354356 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:04:30.354356 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:04:30.354356 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:04:30.355451 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:04:30.355451 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:04:30.355451 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:04:30.355451 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:04:30.355451 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:04:30.355451 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:04:30.355451 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:04:30.355451 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94b34e04-9a27-4158-aff1-95f37f1c7a58 could not be found. Oct 26 13:04:30.355451 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:30.355451 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:04:30.355451 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:30.355451 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:30.355451 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:04:30.355451 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:04:30.355451 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:04:30.355451 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:04:30.355451 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94b34e04-9a27-4158-aff1-95f37f1c7a58 could not be found. Oct 26 13:04:30.355451 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:30.357848 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a5c4a2e6-d11d-4b95-b8b4-5c9577e88bca tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Returning 404 to user: Instance 94b34e04-9a27-4158-aff1-95f37f1c7a58 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:04:30.358918 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a5c4a2e6-d11d-4b95-b8b4-5c9577e88bca tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] 10.222.0.40 "GET /compute/v2.1/servers/94b34e04-9a27-4158-aff1-95f37f1c7a58" status: 404 len: 111 microversion: 2.1 time: 0.064764 Oct 26 13:04:30.359990 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 329/599] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:30 2022] GET /compute/v2.1/servers/94b34e04-9a27-4158-aff1-95f37f1c7a58 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 13:04:30.372605 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-323f4a75-01de-4120-b166-ca2e4bae2b74 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:30.373454 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-323f4a75-01de-4120-b166-ca2e4bae2b74 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] [instance: 94b34e04-9a27-4158-aff1-95f37f1c7a58] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:30.381275 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-323f4a75-01de-4120-b166-ca2e4bae2b74 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:30.382138 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-323f4a75-01de-4120-b166-ca2e4bae2b74 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:30.382577 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-323f4a75-01de-4120-b166-ca2e4bae2b74 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:30.384298 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-323f4a75-01de-4120-b166-ca2e4bae2b74 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:30.385347 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-323f4a75-01de-4120-b166-ca2e4bae2b74 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:30.386324 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-323f4a75-01de-4120-b166-ca2e4bae2b74 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:30.403953 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-323f4a75-01de-4120-b166-ca2e4bae2b74 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] HTTP exception thrown: Instance 94b34e04-9a27-4158-aff1-95f37f1c7a58 could not be found. Oct 26 13:04:30.406585 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-323f4a75-01de-4120-b166-ca2e4bae2b74 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Request method failure captured: Oct 26 13:04:30.406585 n-d-862686-1 devstack@n-api.service[120598]: request: DELETE /compute/v2.1/servers/94b34e04-9a27-4158-aff1-95f37f1c7a58 HTTP/1.1 Oct 26 13:04:30.406585 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:04:30.406585 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:04:30.406585 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:04:30.406585 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:04:30.406585 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:04:30.406585 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:04:30.406585 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:04:30.406585 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:04:30.406585 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTAsvL_mOVwVHFRIgqhMVDGVQnaU1Lsyvu6BwTswQ2wBT-qReJV0YHc-AAmO2bNNtxL3uV9ooCe7l3ooI3NQaC282z1IaNoyhH-svGIe_GFEWrP0_rldvJvaH2HPQ6eMb_GFw9Q0kuM1Mbt6h7W-lyi3GMjD50hXcB1wLxKlSq8Mv40 Oct 26 13:04:30.406585 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:04:30.406585 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:04:30.406585 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:04:30.406585 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:04:30.406585 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:04:30.406585 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:04:30.406585 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 81334bcb49d84a529558a88b02b6ef55 Oct 26 13:04:30.406585 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-DeleteServersAdminTestJSON-712867320 Oct 26 13:04:30.406585 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:04:30.406585 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:04:30.407854 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/81334bcb49d84a529558a88b02b6ef55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/81334bcb49d84a529558a88b02b6ef55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_81334bcb49d84a529558a88b02b6ef55"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/81334bcb49d84a529558a88b02b6ef55"}]}] Oct 26 13:04:30.407854 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-DeleteServersAdminTestJSON-712867320 Oct 26 13:04:30.407854 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 81334bcb49d84a529558a88b02b6ef55 Oct 26 13:04:30.407854 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-712867320 Oct 26 13:04:30.407854 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-DeleteServersAdminTestJSON-712867320-project Oct 26 13:04:30.407854 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:04:30.407854 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:04:30.407854 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: c240bdb5dd7249c79d9620637d0c6e3b Oct 26 13:04:30.407854 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-DeleteServersAdminTestJSON-712867320-project Oct 26 13:04:30.407854 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:04:30.407854 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 94b34e04-9a27-4158-aff1-95f37f1c7a58 could not be found. Oct 26 13:04:30.407854 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '94b34e04-9a27-4158-aff1-95f37f1c7a58'} Oct 26 13:04:30.408621 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:04:30.408621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:30.408621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:04:30.408621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:04:30.408621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:04:30.408621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:04:30.408621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:04:30.408621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:04:30.408621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:04:30.408621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:04:30.408621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94b34e04-9a27-4158-aff1-95f37f1c7a58 could not be found. Oct 26 13:04:30.408621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:30.408621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:04:30.408621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:30.408621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:30.408621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:04:30.408621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:04:30.408621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:04:30.408621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:04:30.408621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:04:30.409890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:04:30.409890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:04:30.409890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:04:30.409890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:04:30.409890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:04:30.409890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:04:30.409890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:04:30.409890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:04:30.409890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:04:30.409890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94b34e04-9a27-4158-aff1-95f37f1c7a58 could not be found. Oct 26 13:04:30.409890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:30.409890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:04:30.409890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:30.409890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:30.409890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:04:30.409890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:04:30.409890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:04:30.409890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:04:30.409890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94b34e04-9a27-4158-aff1-95f37f1c7a58 could not be found. Oct 26 13:04:30.409890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:30.411709 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-323f4a75-01de-4120-b166-ca2e4bae2b74 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Returning 404 to user: Instance 94b34e04-9a27-4158-aff1-95f37f1c7a58 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:04:30.412563 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-323f4a75-01de-4120-b166-ca2e4bae2b74 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] 10.222.0.40 "DELETE /compute/v2.1/servers/94b34e04-9a27-4158-aff1-95f37f1c7a58" status: 404 len: 111 microversion: 2.1 time: 0.045220 Oct 26 13:04:30.413110 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 330/600] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:04:30 2022] DELETE /compute/v2.1/servers/94b34e04-9a27-4158-aff1-95f37f1c7a58 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:04:30.424407 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c09a7964-a429-42c2-805f-3da9e7cec7e1 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:30.425146 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c09a7964-a429-42c2-805f-3da9e7cec7e1 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] [instance: 94b34e04-9a27-4158-aff1-95f37f1c7a58] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:30.434008 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c09a7964-a429-42c2-805f-3da9e7cec7e1 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:30.434611 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c09a7964-a429-42c2-805f-3da9e7cec7e1 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:30.435744 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c09a7964-a429-42c2-805f-3da9e7cec7e1 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:30.436582 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c09a7964-a429-42c2-805f-3da9e7cec7e1 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:30.437058 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c09a7964-a429-42c2-805f-3da9e7cec7e1 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:30.438259 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c09a7964-a429-42c2-805f-3da9e7cec7e1 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:30.465899 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-c09a7964-a429-42c2-805f-3da9e7cec7e1 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] HTTP exception thrown: Instance 94b34e04-9a27-4158-aff1-95f37f1c7a58 could not be found. Oct 26 13:04:30.467733 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c09a7964-a429-42c2-805f-3da9e7cec7e1 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Request method failure captured: Oct 26 13:04:30.467733 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/94b34e04-9a27-4158-aff1-95f37f1c7a58 HTTP/1.1 Oct 26 13:04:30.467733 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:04:30.467733 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:04:30.467733 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:04:30.467733 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:04:30.467733 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:04:30.467733 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:04:30.467733 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:04:30.467733 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:04:30.467733 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTAsvL_mOVwVHFRIgqhMVDGVQnaU1Lsyvu6BwTswQ2wBT-qReJV0YHc-AAmO2bNNtxL3uV9ooCe7l3ooI3NQaC282z1IaNoyhH-svGIe_GFEWrP0_rldvJvaH2HPQ6eMb_GFw9Q0kuM1Mbt6h7W-lyi3GMjD50hXcB1wLxKlSq8Mv40 Oct 26 13:04:30.467733 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:04:30.467733 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:04:30.467733 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:04:30.467733 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:04:30.467733 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:04:30.467733 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:04:30.467733 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 81334bcb49d84a529558a88b02b6ef55 Oct 26 13:04:30.467733 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-DeleteServersAdminTestJSON-712867320 Oct 26 13:04:30.467733 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:04:30.467733 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:04:30.469361 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/81334bcb49d84a529558a88b02b6ef55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/81334bcb49d84a529558a88b02b6ef55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_81334bcb49d84a529558a88b02b6ef55"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/81334bcb49d84a529558a88b02b6ef55"}]}] Oct 26 13:04:30.469361 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-DeleteServersAdminTestJSON-712867320 Oct 26 13:04:30.469361 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 81334bcb49d84a529558a88b02b6ef55 Oct 26 13:04:30.469361 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-712867320 Oct 26 13:04:30.469361 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-DeleteServersAdminTestJSON-712867320-project Oct 26 13:04:30.469361 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:04:30.469361 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:04:30.469361 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: c240bdb5dd7249c79d9620637d0c6e3b Oct 26 13:04:30.469361 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-DeleteServersAdminTestJSON-712867320-project Oct 26 13:04:30.469361 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:04:30.469361 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 94b34e04-9a27-4158-aff1-95f37f1c7a58 could not be found. Oct 26 13:04:30.469361 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '94b34e04-9a27-4158-aff1-95f37f1c7a58'} Oct 26 13:04:30.470336 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:04:30.470336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:30.470336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:04:30.470336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:04:30.470336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:04:30.470336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:04:30.470336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:04:30.470336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:04:30.470336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:04:30.470336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:04:30.470336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94b34e04-9a27-4158-aff1-95f37f1c7a58 could not be found. Oct 26 13:04:30.470336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:30.470336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:04:30.470336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:30.470336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:30.470336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:04:30.470336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:04:30.470336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:04:30.470336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:04:30.470336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:04:30.471767 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:04:30.471767 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:04:30.471767 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:04:30.471767 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:04:30.471767 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:04:30.471767 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:04:30.471767 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:04:30.471767 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94b34e04-9a27-4158-aff1-95f37f1c7a58 could not be found. Oct 26 13:04:30.471767 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:30.471767 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:04:30.471767 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:30.471767 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:30.471767 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:04:30.471767 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:04:30.471767 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:04:30.471767 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:04:30.471767 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94b34e04-9a27-4158-aff1-95f37f1c7a58 could not be found. Oct 26 13:04:30.471767 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:30.472745 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c09a7964-a429-42c2-805f-3da9e7cec7e1 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Returning 404 to user: Instance 94b34e04-9a27-4158-aff1-95f37f1c7a58 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:04:30.472745 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c09a7964-a429-42c2-805f-3da9e7cec7e1 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] 10.222.0.40 "GET /compute/v2.1/servers/94b34e04-9a27-4158-aff1-95f37f1c7a58" status: 404 len: 111 microversion: 2.1 time: 0.053365 Oct 26 13:04:30.475065 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 331/601] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:30 2022] GET /compute/v2.1/servers/94b34e04-9a27-4158-aff1-95f37f1c7a58 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:04:30.484046 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a4867195-f4eb-4a52-8a7b-af5ce776fe73 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:30.484544 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a4867195-f4eb-4a52-8a7b-af5ce776fe73 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] [instance: ea0c61fb-9bc2-42d7-960e-4859c4e6f172] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:30.490535 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4867195-f4eb-4a52-8a7b-af5ce776fe73 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:30.491028 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4867195-f4eb-4a52-8a7b-af5ce776fe73 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:30.491457 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4867195-f4eb-4a52-8a7b-af5ce776fe73 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:30.492162 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4867195-f4eb-4a52-8a7b-af5ce776fe73 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:30.493128 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4867195-f4eb-4a52-8a7b-af5ce776fe73 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:30.493721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4867195-f4eb-4a52-8a7b-af5ce776fe73 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:30.507866 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-a4867195-f4eb-4a52-8a7b-af5ce776fe73 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] HTTP exception thrown: Instance ea0c61fb-9bc2-42d7-960e-4859c4e6f172 could not be found. Oct 26 13:04:30.510407 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a4867195-f4eb-4a52-8a7b-af5ce776fe73 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Request method failure captured: Oct 26 13:04:30.510407 n-d-862686-1 devstack@n-api.service[120598]: request: DELETE /compute/v2.1/servers/ea0c61fb-9bc2-42d7-960e-4859c4e6f172 HTTP/1.1 Oct 26 13:04:30.510407 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:04:30.510407 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:04:30.510407 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:04:30.510407 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:04:30.510407 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:04:30.510407 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:04:30.510407 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:04:30.510407 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:04:30.510407 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTAsvL_mOVwVHFRIgqhMVDGVQnaU1Lsyvu6BwTswQ2wBT-qReJV0YHc-AAmO2bNNtxL3uV9ooCe7l3ooI3NQaC282z1IaNoyhH-svGIe_GFEWrP0_rldvJvaH2HPQ6eMb_GFw9Q0kuM1Mbt6h7W-lyi3GMjD50hXcB1wLxKlSq8Mv40 Oct 26 13:04:30.510407 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:04:30.510407 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:04:30.510407 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:04:30.510407 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:04:30.510407 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:04:30.510407 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:04:30.510407 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 81334bcb49d84a529558a88b02b6ef55 Oct 26 13:04:30.510407 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-DeleteServersAdminTestJSON-712867320 Oct 26 13:04:30.510407 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:04:30.510407 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:04:30.511917 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/81334bcb49d84a529558a88b02b6ef55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/81334bcb49d84a529558a88b02b6ef55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_81334bcb49d84a529558a88b02b6ef55"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/81334bcb49d84a529558a88b02b6ef55"}]}] Oct 26 13:04:30.511917 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-DeleteServersAdminTestJSON-712867320 Oct 26 13:04:30.511917 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 81334bcb49d84a529558a88b02b6ef55 Oct 26 13:04:30.511917 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-712867320 Oct 26 13:04:30.511917 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-DeleteServersAdminTestJSON-712867320-project Oct 26 13:04:30.511917 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:04:30.511917 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:04:30.511917 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: c240bdb5dd7249c79d9620637d0c6e3b Oct 26 13:04:30.511917 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-DeleteServersAdminTestJSON-712867320-project Oct 26 13:04:30.511917 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:04:30.511917 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance ea0c61fb-9bc2-42d7-960e-4859c4e6f172 could not be found. Oct 26 13:04:30.511917 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'ea0c61fb-9bc2-42d7-960e-4859c4e6f172'} Oct 26 13:04:30.512715 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:04:30.512715 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:30.512715 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:04:30.512715 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:04:30.512715 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:04:30.512715 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:04:30.512715 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:04:30.512715 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:04:30.512715 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:04:30.512715 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:04:30.512715 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea0c61fb-9bc2-42d7-960e-4859c4e6f172 could not be found. Oct 26 13:04:30.512715 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:30.512715 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:04:30.512715 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:30.512715 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:30.512715 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:04:30.512715 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:04:30.512715 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:04:30.512715 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:04:30.512715 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:04:30.514350 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:04:30.514350 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:04:30.514350 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:04:30.514350 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:04:30.514350 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:04:30.514350 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:04:30.514350 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:04:30.514350 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:04:30.514350 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:04:30.514350 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea0c61fb-9bc2-42d7-960e-4859c4e6f172 could not be found. Oct 26 13:04:30.514350 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:30.514350 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:04:30.514350 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:30.514350 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:30.514350 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:04:30.514350 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:04:30.514350 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:04:30.514350 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:04:30.514350 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea0c61fb-9bc2-42d7-960e-4859c4e6f172 could not be found. Oct 26 13:04:30.514350 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:30.515646 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a4867195-f4eb-4a52-8a7b-af5ce776fe73 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Returning 404 to user: Instance ea0c61fb-9bc2-42d7-960e-4859c4e6f172 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:04:30.515646 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a4867195-f4eb-4a52-8a7b-af5ce776fe73 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ea0c61fb-9bc2-42d7-960e-4859c4e6f172" status: 404 len: 111 microversion: 2.1 time: 0.035706 Oct 26 13:04:30.515646 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 332/602] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:04:30 2022] DELETE /compute/v2.1/servers/ea0c61fb-9bc2-42d7-960e-4859c4e6f172 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:04:30.520750 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0619cb3e-371e-4852-8425-76d62281d6f5 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:30.521472 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0619cb3e-371e-4852-8425-76d62281d6f5 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] [instance: ea0c61fb-9bc2-42d7-960e-4859c4e6f172] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:30.528465 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0619cb3e-371e-4852-8425-76d62281d6f5 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:30.528953 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0619cb3e-371e-4852-8425-76d62281d6f5 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:30.529422 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0619cb3e-371e-4852-8425-76d62281d6f5 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:30.530145 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0619cb3e-371e-4852-8425-76d62281d6f5 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:30.530600 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0619cb3e-371e-4852-8425-76d62281d6f5 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:30.531023 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0619cb3e-371e-4852-8425-76d62281d6f5 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:30.551592 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-0619cb3e-371e-4852-8425-76d62281d6f5 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] HTTP exception thrown: Instance ea0c61fb-9bc2-42d7-960e-4859c4e6f172 could not be found. Oct 26 13:04:30.553124 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0619cb3e-371e-4852-8425-76d62281d6f5 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Request method failure captured: Oct 26 13:04:30.553124 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/ea0c61fb-9bc2-42d7-960e-4859c4e6f172 HTTP/1.1 Oct 26 13:04:30.553124 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:04:30.553124 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:04:30.553124 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:04:30.553124 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:04:30.553124 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:04:30.553124 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:04:30.553124 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:04:30.553124 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:04:30.553124 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTAsvL_mOVwVHFRIgqhMVDGVQnaU1Lsyvu6BwTswQ2wBT-qReJV0YHc-AAmO2bNNtxL3uV9ooCe7l3ooI3NQaC282z1IaNoyhH-svGIe_GFEWrP0_rldvJvaH2HPQ6eMb_GFw9Q0kuM1Mbt6h7W-lyi3GMjD50hXcB1wLxKlSq8Mv40 Oct 26 13:04:30.553124 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:04:30.553124 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:04:30.553124 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:04:30.553124 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:04:30.553124 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:04:30.553124 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:04:30.553124 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 81334bcb49d84a529558a88b02b6ef55 Oct 26 13:04:30.553124 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-DeleteServersAdminTestJSON-712867320 Oct 26 13:04:30.553124 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:04:30.553124 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:04:30.554598 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/81334bcb49d84a529558a88b02b6ef55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/81334bcb49d84a529558a88b02b6ef55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_81334bcb49d84a529558a88b02b6ef55"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/81334bcb49d84a529558a88b02b6ef55"}]}] Oct 26 13:04:30.554598 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-DeleteServersAdminTestJSON-712867320 Oct 26 13:04:30.554598 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 81334bcb49d84a529558a88b02b6ef55 Oct 26 13:04:30.554598 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-712867320 Oct 26 13:04:30.554598 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-DeleteServersAdminTestJSON-712867320-project Oct 26 13:04:30.554598 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:04:30.554598 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:04:30.554598 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: c240bdb5dd7249c79d9620637d0c6e3b Oct 26 13:04:30.554598 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-DeleteServersAdminTestJSON-712867320-project Oct 26 13:04:30.554598 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:04:30.554598 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance ea0c61fb-9bc2-42d7-960e-4859c4e6f172 could not be found. Oct 26 13:04:30.554598 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'ea0c61fb-9bc2-42d7-960e-4859c4e6f172'} Oct 26 13:04:30.555386 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:04:30.555386 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:30.555386 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:04:30.555386 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:04:30.555386 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:04:30.555386 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:04:30.555386 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:04:30.555386 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:04:30.555386 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:04:30.555386 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:04:30.555386 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea0c61fb-9bc2-42d7-960e-4859c4e6f172 could not be found. Oct 26 13:04:30.555386 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:30.555386 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:04:30.555386 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:30.555386 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:30.555386 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:04:30.555386 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:04:30.555386 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:04:30.555386 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:04:30.555386 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:04:30.556693 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:04:30.556693 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:04:30.556693 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:04:30.556693 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:04:30.556693 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:04:30.556693 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:04:30.556693 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:04:30.556693 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea0c61fb-9bc2-42d7-960e-4859c4e6f172 could not be found. Oct 26 13:04:30.556693 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:30.556693 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:04:30.556693 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:30.556693 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:30.556693 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:04:30.556693 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:04:30.556693 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:04:30.556693 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:04:30.556693 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea0c61fb-9bc2-42d7-960e-4859c4e6f172 could not be found. Oct 26 13:04:30.556693 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:30.559899 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0619cb3e-371e-4852-8425-76d62281d6f5 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] Returning 404 to user: Instance ea0c61fb-9bc2-42d7-960e-4859c4e6f172 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:04:30.559899 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0619cb3e-371e-4852-8425-76d62281d6f5 tempest-DeleteServersAdminTestJSON-712867320 tempest-DeleteServersAdminTestJSON-712867320-project] 10.222.0.40 "GET /compute/v2.1/servers/ea0c61fb-9bc2-42d7-960e-4859c4e6f172" status: 404 len: 111 microversion: 2.1 time: 0.037623 Oct 26 13:04:30.559899 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 333/603] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:30 2022] GET /compute/v2.1/servers/ea0c61fb-9bc2-42d7-960e-4859c4e6f172 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:04:30.560234 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3097761f-83cf-4cb1-bd30-69c8500df0fb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:30.568634 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3097761f-83cf-4cb1-bd30-69c8500df0fb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997" status: 200 len: 1313 microversion: 2.1 time: 0.421027 Oct 26 13:04:30.571878 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 271/604] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:30 2022] GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997 => generated 1313 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:04:30.579088 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-bd612d2d-398d-4074-b7e4-92f4512ebd12 req-a1b184db-22ed-43b5-927b-b5e6983f96b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dffc2812-b18a-4227-932f-3db590d7bc6f", "name": "network-vif-plugged", "status": "completed", "tag": "eefbc12d-6331-420c-be7b-da952bc9d1cf"}, {"server_uuid": "4c694a16-fdba-414f-9122-1899cc715565", "name": "network-vif-plugged", "status": "completed", "tag": "ada02b45-c859-4cf1-a9a4-d28591f7a07b"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:30.579686 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b0b01ba3-e26d-4767-9c64-1fcfc9621a84 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:30.580491 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b0b01ba3-e26d-4767-9c64-1fcfc9621a84 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 4c694a16-fdba-414f-9122-1899cc715565] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:30.590850 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b0b01ba3-e26d-4767-9c64-1fcfc9621a84 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:30.591536 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b0b01ba3-e26d-4767-9c64-1fcfc9621a84 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:30.592347 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-bd612d2d-398d-4074-b7e4-92f4512ebd12 req-a1b184db-22ed-43b5-927b-b5e6983f96b2 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:30.593009 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-bd612d2d-398d-4074-b7e4-92f4512ebd12 req-a1b184db-22ed-43b5-927b-b5e6983f96b2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:30.593320 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b0b01ba3-e26d-4767-9c64-1fcfc9621a84 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:30.593865 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-bd612d2d-398d-4074-b7e4-92f4512ebd12 req-a1b184db-22ed-43b5-927b-b5e6983f96b2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:30.594297 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b0b01ba3-e26d-4767-9c64-1fcfc9621a84 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:30.594773 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b0b01ba3-e26d-4767-9c64-1fcfc9621a84 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:30.595207 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b0b01ba3-e26d-4767-9c64-1fcfc9621a84 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:30.610648 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-bd612d2d-398d-4074-b7e4-92f4512ebd12 req-a1b184db-22ed-43b5-927b-b5e6983f96b2 service nova] Creating event network-vif-plugged:eefbc12d-6331-420c-be7b-da952bc9d1cf for instance dffc2812-b18a-4227-932f-3db590d7bc6f on n-h2-862686-1 Oct 26 13:04:30.611289 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-bd612d2d-398d-4074-b7e4-92f4512ebd12 req-a1b184db-22ed-43b5-927b-b5e6983f96b2 service nova] Creating event network-vif-plugged:ada02b45-c859-4cf1-a9a4-d28591f7a07b for instance 4c694a16-fdba-414f-9122-1899cc715565 on n-h1-862686-1 Oct 26 13:04:30.627982 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-bd612d2d-398d-4074-b7e4-92f4512ebd12 req-a1b184db-22ed-43b5-927b-b5e6983f96b2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.070395 Oct 26 13:04:30.629060 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 334/605] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:30.924981 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-526b7c84-3661-4ac7-a9de-bd500ffd8f26 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:30.925831 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-526b7c84-3661-4ac7-a9de-bd500ffd8f26 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: a28883a5-9f17-4514-823e-7b33a316d33c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:30.932783 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-526b7c84-3661-4ac7-a9de-bd500ffd8f26 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:30.933433 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-526b7c84-3661-4ac7-a9de-bd500ffd8f26 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:30.933987 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-526b7c84-3661-4ac7-a9de-bd500ffd8f26 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:30.934921 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-526b7c84-3661-4ac7-a9de-bd500ffd8f26 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:30.935975 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-526b7c84-3661-4ac7-a9de-bd500ffd8f26 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:30.936644 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-526b7c84-3661-4ac7-a9de-bd500ffd8f26 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:31.006701 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b0b01ba3-e26d-4767-9c64-1fcfc9621a84 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:31.022148 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b0b01ba3-e26d-4767-9c64-1fcfc9621a84 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/4c694a16-fdba-414f-9122-1899cc715565" status: 200 len: 1317 microversion: 2.1 time: 0.447757 Oct 26 13:04:31.022743 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 272/606] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:30 2022] GET /compute/v2.1/servers/4c694a16-fdba-414f-9122-1899cc715565 => generated 1317 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:31.048131 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-13f03956-8823-48a2-bb8c-34afe10888b2 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:31.049127 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-13f03956-8823-48a2-bb8c-34afe10888b2 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: dffc2812-b18a-4227-932f-3db590d7bc6f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:31.072222 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-13f03956-8823-48a2-bb8c-34afe10888b2 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:31.086970 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-13f03956-8823-48a2-bb8c-34afe10888b2 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:31.087872 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-13f03956-8823-48a2-bb8c-34afe10888b2 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:31.088898 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-13f03956-8823-48a2-bb8c-34afe10888b2 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:31.089673 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-13f03956-8823-48a2-bb8c-34afe10888b2 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:31.094224 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-13f03956-8823-48a2-bb8c-34afe10888b2 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:31.456461 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-526b7c84-3661-4ac7-a9de-bd500ffd8f26 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:31.466675 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-526b7c84-3661-4ac7-a9de-bd500ffd8f26 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:31.470101 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-526b7c84-3661-4ac7-a9de-bd500ffd8f26 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:31.471525 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-526b7c84-3661-4ac7-a9de-bd500ffd8f26 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c" status: 200 len: 1362 microversion: 2.25 time: 0.551585 Oct 26 13:04:31.472391 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 335/607] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:30 2022] GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c => generated 1362 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:31.478137 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4e957cbc-29c9-4762-bf37-1e9ed72342d2 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:31.479161 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4e957cbc-29c9-4762-bf37-1e9ed72342d2 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] [instance: 480f7c70-2963-4887-b8f8-ea3737880136] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:31.486686 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e957cbc-29c9-4762-bf37-1e9ed72342d2 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:31.487414 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e957cbc-29c9-4762-bf37-1e9ed72342d2 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:31.488048 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e957cbc-29c9-4762-bf37-1e9ed72342d2 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:31.489127 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e957cbc-29c9-4762-bf37-1e9ed72342d2 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:31.489990 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e957cbc-29c9-4762-bf37-1e9ed72342d2 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:31.490677 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e957cbc-29c9-4762-bf37-1e9ed72342d2 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:31.541703 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-13f03956-8823-48a2-bb8c-34afe10888b2 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241a2299894849c889ee7f1100a9823d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec66df09b6114f5dbd6678d5e848c737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:31.551559 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-13f03956-8823-48a2-bb8c-34afe10888b2 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] 10.222.0.40 "GET /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f" status: 200 len: 1323 microversion: 2.1 time: 0.512915 Oct 26 13:04:31.552296 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 273/608] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:31 2022] GET /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f => generated 1323 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:31.557979 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d0e8cf95-6cec-4d51-aa24-ec041aaf09b8 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:31.558874 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d0e8cf95-6cec-4d51-aa24-ec041aaf09b8 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:31.565112 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d0e8cf95-6cec-4d51-aa24-ec041aaf09b8 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:31.565844 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d0e8cf95-6cec-4d51-aa24-ec041aaf09b8 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:31.566810 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d0e8cf95-6cec-4d51-aa24-ec041aaf09b8 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:31.567676 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d0e8cf95-6cec-4d51-aa24-ec041aaf09b8 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:31.568332 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d0e8cf95-6cec-4d51-aa24-ec041aaf09b8 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:31.569043 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d0e8cf95-6cec-4d51-aa24-ec041aaf09b8 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:31.588280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4e957cbc-29c9-4762-bf37-1e9ed72342d2 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f9391046054747bbfc1c3e6d65d4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10521abb1c34417fa9369aaba9070968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:31.603635 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4e957cbc-29c9-4762-bf37-1e9ed72342d2 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] 10.222.0.40 "GET /compute/v2.1/servers/480f7c70-2963-4887-b8f8-ea3737880136" status: 200 len: 1259 microversion: 2.1 time: 0.129884 Oct 26 13:04:31.610465 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 336/609] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:31 2022] GET /compute/v2.1/servers/480f7c70-2963-4887-b8f8-ea3737880136 => generated 1259 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:31.617246 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ab347ae1-5645-464f-bd26-d3211e776862 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:31.619193 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ab347ae1-5645-464f-bd26-d3211e776862 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 7da4bb85-b577-4608-a7c0-3320721cb997] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:31.627204 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab347ae1-5645-464f-bd26-d3211e776862 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:31.628203 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab347ae1-5645-464f-bd26-d3211e776862 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:31.628681 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab347ae1-5645-464f-bd26-d3211e776862 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:31.629782 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab347ae1-5645-464f-bd26-d3211e776862 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:31.630797 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab347ae1-5645-464f-bd26-d3211e776862 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:31.631439 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab347ae1-5645-464f-bd26-d3211e776862 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:31.636994 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:04:31.690587 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d0e8cf95-6cec-4d51-aa24-ec041aaf09b8 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:31.716810 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d0e8cf95-6cec-4d51-aa24-ec041aaf09b8 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:31.718961 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d0e8cf95-6cec-4d51-aa24-ec041aaf09b8 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:31.724883 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d0e8cf95-6cec-4d51-aa24-ec041aaf09b8 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] 10.222.0.40 "GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 200 len: 1416 microversion: 2.75 time: 0.171365 Oct 26 13:04:31.725595 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 274/610] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:31 2022] GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 1416 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:31.970154 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ab347ae1-5645-464f-bd26-d3211e776862 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:31.985523 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ab347ae1-5645-464f-bd26-d3211e776862 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997" status: 200 len: 1462 microversion: 2.1 time: 0.373529 Oct 26 13:04:32.002111 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 337/611] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:31 2022] GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997 => generated 1462 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:32.016116 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-05cf8f4d-fa9c-4e2b-a298-5db428d4b6e3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:32.018651 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-05cf8f4d-fa9c-4e2b-a298-5db428d4b6e3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 7da4bb85-b577-4608-a7c0-3320721cb997] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:32.026981 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05cf8f4d-fa9c-4e2b-a298-5db428d4b6e3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:32.027704 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05cf8f4d-fa9c-4e2b-a298-5db428d4b6e3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:32.028328 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05cf8f4d-fa9c-4e2b-a298-5db428d4b6e3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:32.029202 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05cf8f4d-fa9c-4e2b-a298-5db428d4b6e3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:32.030016 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05cf8f4d-fa9c-4e2b-a298-5db428d4b6e3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:32.030775 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05cf8f4d-fa9c-4e2b-a298-5db428d4b6e3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:32.045222 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-066fd532-c7c2-4907-adc2-96d22fcdf680 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:32.046165 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-066fd532-c7c2-4907-adc2-96d22fcdf680 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 4c694a16-fdba-414f-9122-1899cc715565] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:32.057186 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-066fd532-c7c2-4907-adc2-96d22fcdf680 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:32.057891 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-066fd532-c7c2-4907-adc2-96d22fcdf680 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:32.060839 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-066fd532-c7c2-4907-adc2-96d22fcdf680 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:32.066548 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-066fd532-c7c2-4907-adc2-96d22fcdf680 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:32.067261 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-066fd532-c7c2-4907-adc2-96d22fcdf680 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:32.067865 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-066fd532-c7c2-4907-adc2-96d22fcdf680 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:32.410024 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-066fd532-c7c2-4907-adc2-96d22fcdf680 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:32.430401 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-066fd532-c7c2-4907-adc2-96d22fcdf680 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/4c694a16-fdba-414f-9122-1899cc715565" status: 200 len: 1317 microversion: 2.1 time: 0.389275 Oct 26 13:04:32.433515 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 338/612] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:32 2022] GET /compute/v2.1/servers/4c694a16-fdba-414f-9122-1899cc715565 => generated 1317 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:04:32.502514 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-026ed87d-d475-4fd8-a888-f935104e1dad tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:32.503903 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-026ed87d-d475-4fd8-a888-f935104e1dad tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: a28883a5-9f17-4514-823e-7b33a316d33c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:32.511096 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-026ed87d-d475-4fd8-a888-f935104e1dad tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:32.511693 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-026ed87d-d475-4fd8-a888-f935104e1dad tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:32.512200 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-026ed87d-d475-4fd8-a888-f935104e1dad tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:32.513158 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-026ed87d-d475-4fd8-a888-f935104e1dad tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:32.513957 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-026ed87d-d475-4fd8-a888-f935104e1dad tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:32.514628 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-026ed87d-d475-4fd8-a888-f935104e1dad tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:32.520355 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-05cf8f4d-fa9c-4e2b-a298-5db428d4b6e3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:32.527627 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-05cf8f4d-fa9c-4e2b-a298-5db428d4b6e3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 7da4bb85-b577-4608-a7c0-3320721cb997] Old instance type m1.heat2, new instance type m1.heat {{(pid=120597) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 26 13:04:32.535737 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:04:32.541225 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-05cf8f4d-fa9c-4e2b-a298-5db428d4b6e3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:04:32.543864 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-05cf8f4d-fa9c-4e2b-a298-5db428d4b6e3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:04:32.546898 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-05cf8f4d-fa9c-4e2b-a298-5db428d4b6e3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:04:32.547814 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-05cf8f4d-fa9c-4e2b-a298-5db428d4b6e3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:04:32.550197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-05cf8f4d-fa9c-4e2b-a298-5db428d4b6e3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:04:32.797602 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-026ed87d-d475-4fd8-a888-f935104e1dad tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:32.810728 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-026ed87d-d475-4fd8-a888-f935104e1dad tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:32.813548 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-026ed87d-d475-4fd8-a888-f935104e1dad tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:32.817319 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-026ed87d-d475-4fd8-a888-f935104e1dad tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c" status: 200 len: 1362 microversion: 2.25 time: 0.321134 Oct 26 13:04:32.818180 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 339/613] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:32 2022] GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c => generated 1362 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:32.838613 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6e91bd5b-e5fc-4623-a648-2fa68254154b tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:32.839522 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6e91bd5b-e5fc-4623-a648-2fa68254154b tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: dffc2812-b18a-4227-932f-3db590d7bc6f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:32.852084 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e91bd5b-e5fc-4623-a648-2fa68254154b tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:32.853328 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e91bd5b-e5fc-4623-a648-2fa68254154b tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:32.853961 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e91bd5b-e5fc-4623-a648-2fa68254154b tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:32.855724 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e91bd5b-e5fc-4623-a648-2fa68254154b tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:32.856333 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e91bd5b-e5fc-4623-a648-2fa68254154b tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:32.857036 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e91bd5b-e5fc-4623-a648-2fa68254154b tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:32.913236 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-05cf8f4d-fa9c-4e2b-a298-5db428d4b6e3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "POST /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997/action" status: 202 len: 0 microversion: 2.1 time: 0.902065 Oct 26 13:04:32.915318 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 275/614] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:04:32 2022] POST /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997/action => generated 0 bytes in 909 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:04:32.939830 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-556c57ca-0ab1-464f-8a0c-9b382bbddca8 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:32.940718 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-556c57ca-0ab1-464f-8a0c-9b382bbddca8 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] [instance: 480f7c70-2963-4887-b8f8-ea3737880136] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:32.955537 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-556c57ca-0ab1-464f-8a0c-9b382bbddca8 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:32.956030 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-556c57ca-0ab1-464f-8a0c-9b382bbddca8 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:32.956465 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-556c57ca-0ab1-464f-8a0c-9b382bbddca8 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:32.958111 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-556c57ca-0ab1-464f-8a0c-9b382bbddca8 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:32.961995 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-556c57ca-0ab1-464f-8a0c-9b382bbddca8 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:32.962756 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-556c57ca-0ab1-464f-8a0c-9b382bbddca8 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:33.138912 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-556c57ca-0ab1-464f-8a0c-9b382bbddca8 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f9391046054747bbfc1c3e6d65d4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10521abb1c34417fa9369aaba9070968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:33.149552 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-556c57ca-0ab1-464f-8a0c-9b382bbddca8 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] 10.222.0.40 "GET /compute/v2.1/servers/480f7c70-2963-4887-b8f8-ea3737880136" status: 200 len: 1315 microversion: 2.1 time: 0.225841 Oct 26 13:04:33.166787 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 276/615] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:32 2022] GET /compute/v2.1/servers/480f7c70-2963-4887-b8f8-ea3737880136 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:33.173116 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-9fa0d785-07b7-4ab5-ac18-6cde44f5abda req-b73c8e31-5f87-4d66-a396-1b853fcc85bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a28883a5-9f17-4514-823e-7b33a316d33c", "name": "network-vif-plugged", "status": "completed", "tag": "aadc618b-ef02-4624-a6f3-811fbef8dddd"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:33.186940 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9fa0d785-07b7-4ab5-ac18-6cde44f5abda req-b73c8e31-5f87-4d66-a396-1b853fcc85bb service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:33.187616 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9fa0d785-07b7-4ab5-ac18-6cde44f5abda req-b73c8e31-5f87-4d66-a396-1b853fcc85bb service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:33.188207 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9fa0d785-07b7-4ab5-ac18-6cde44f5abda req-b73c8e31-5f87-4d66-a396-1b853fcc85bb service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:33.216800 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-9fa0d785-07b7-4ab5-ac18-6cde44f5abda req-b73c8e31-5f87-4d66-a396-1b853fcc85bb service nova] Creating event network-vif-plugged:aadc618b-ef02-4624-a6f3-811fbef8dddd for instance a28883a5-9f17-4514-823e-7b33a316d33c on n-h1-862686-1 Oct 26 13:04:33.235300 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-9fa0d785-07b7-4ab5-ac18-6cde44f5abda req-b73c8e31-5f87-4d66-a396-1b853fcc85bb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064704 Oct 26 13:04:33.237071 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 277/616] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:33.251541 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8bba1740-e640-4ecc-bad2-daa9accb0c33 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:33.254163 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8bba1740-e640-4ecc-bad2-daa9accb0c33 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:33.271492 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8bba1740-e640-4ecc-bad2-daa9accb0c33 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:33.272533 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8bba1740-e640-4ecc-bad2-daa9accb0c33 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:33.275183 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8bba1740-e640-4ecc-bad2-daa9accb0c33 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:33.277956 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8bba1740-e640-4ecc-bad2-daa9accb0c33 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:33.279709 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8bba1740-e640-4ecc-bad2-daa9accb0c33 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:33.280254 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8bba1740-e640-4ecc-bad2-daa9accb0c33 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:33.310621 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6e91bd5b-e5fc-4623-a648-2fa68254154b tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241a2299894849c889ee7f1100a9823d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec66df09b6114f5dbd6678d5e848c737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:33.323697 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6e91bd5b-e5fc-4623-a648-2fa68254154b tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] 10.222.0.40 "GET /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f" status: 200 len: 1323 microversion: 2.1 time: 0.500808 Oct 26 13:04:33.330061 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 340/617] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:32 2022] GET /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f => generated 1323 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:33.345319 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-ec73212d-0f04-4480-ad2c-570c72c520c5 req-23858719-938f-467a-a77b-11d326d5d633 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "380d16a8-2b4c-460b-9b36-884e7fb24812", "name": "network-vif-deleted", "tag": "5b05c6bb-7da5-41d5-bafd-a4735efff806"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:33.401998 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ec73212d-0f04-4480-ad2c-570c72c520c5 req-23858719-938f-467a-a77b-11d326d5d633 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:33.403775 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ec73212d-0f04-4480-ad2c-570c72c520c5 req-23858719-938f-467a-a77b-11d326d5d633 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:33.404650 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ec73212d-0f04-4480-ad2c-570c72c520c5 req-23858719-938f-467a-a77b-11d326d5d633 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:33.466391 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-ec73212d-0f04-4480-ad2c-570c72c520c5 req-23858719-938f-467a-a77b-11d326d5d633 service nova] Creating event network-vif-deleted:5b05c6bb-7da5-41d5-bafd-a4735efff806 for instance 380d16a8-2b4c-460b-9b36-884e7fb24812 on n-h2-862686-1 Oct 26 13:04:33.484170 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-ec73212d-0f04-4480-ad2c-570c72c520c5 req-23858719-938f-467a-a77b-11d326d5d633 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152087 Oct 26 13:04:33.485409 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 341/618] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:33.494929 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-44ea2717-8a41-439c-81e1-6e64e3362b84 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:33.496017 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-44ea2717-8a41-439c-81e1-6e64e3362b84 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 7da4bb85-b577-4608-a7c0-3320721cb997] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:33.505721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-44ea2717-8a41-439c-81e1-6e64e3362b84 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:33.506848 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-44ea2717-8a41-439c-81e1-6e64e3362b84 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:33.507455 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-44ea2717-8a41-439c-81e1-6e64e3362b84 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:33.509797 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-44ea2717-8a41-439c-81e1-6e64e3362b84 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:33.510713 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-44ea2717-8a41-439c-81e1-6e64e3362b84 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:33.512081 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-44ea2717-8a41-439c-81e1-6e64e3362b84 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:33.573172 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8bba1740-e640-4ecc-bad2-daa9accb0c33 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:33.590260 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8bba1740-e640-4ecc-bad2-daa9accb0c33 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:33.594325 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8bba1740-e640-4ecc-bad2-daa9accb0c33 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:33.621637 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8bba1740-e640-4ecc-bad2-daa9accb0c33 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] 10.222.0.40 "GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 200 len: 1437 microversion: 2.75 time: 0.380004 Oct 26 13:04:33.622480 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 278/619] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:33 2022] GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 1437 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:33.641743 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5922be72-2b85-4c60-93c2-43586d3ddf69 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:33.646988 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5922be72-2b85-4c60-93c2-43586d3ddf69 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 4c694a16-fdba-414f-9122-1899cc715565] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:33.669538 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5922be72-2b85-4c60-93c2-43586d3ddf69 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:33.670055 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5922be72-2b85-4c60-93c2-43586d3ddf69 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:33.673745 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5922be72-2b85-4c60-93c2-43586d3ddf69 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:33.674567 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5922be72-2b85-4c60-93c2-43586d3ddf69 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:33.675048 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5922be72-2b85-4c60-93c2-43586d3ddf69 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:33.681726 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5922be72-2b85-4c60-93c2-43586d3ddf69 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:34.152851 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5922be72-2b85-4c60-93c2-43586d3ddf69 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:34.162176 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5922be72-2b85-4c60-93c2-43586d3ddf69 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/4c694a16-fdba-414f-9122-1899cc715565" status: 200 len: 1466 microversion: 2.1 time: 0.536257 Oct 26 13:04:34.162744 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 279/620] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:33 2022] GET /compute/v2.1/servers/4c694a16-fdba-414f-9122-1899cc715565 => generated 1466 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:34.172586 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e1769cc9-65f1-49f1-805a-b1afb87fe4f8 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:34.176284 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e1769cc9-65f1-49f1-805a-b1afb87fe4f8 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:34.200701 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1769cc9-65f1-49f1-805a-b1afb87fe4f8 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:34.201468 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1769cc9-65f1-49f1-805a-b1afb87fe4f8 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:34.202098 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1769cc9-65f1-49f1-805a-b1afb87fe4f8 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:34.202981 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1769cc9-65f1-49f1-805a-b1afb87fe4f8 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:34.205928 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1769cc9-65f1-49f1-805a-b1afb87fe4f8 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:34.206611 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1769cc9-65f1-49f1-805a-b1afb87fe4f8 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:34.343958 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-44ea2717-8a41-439c-81e1-6e64e3362b84 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:34.357030 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-44ea2717-8a41-439c-81e1-6e64e3362b84 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997" status: 200 len: 1471 microversion: 2.1 time: 0.868742 Oct 26 13:04:34.357662 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 342/621] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:33 2022] GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997 => generated 1471 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:34.372526 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0d58f9e9-4dd6-4528-95c5-07efe0634448 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:34.373168 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0d58f9e9-4dd6-4528-95c5-07efe0634448 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: a28883a5-9f17-4514-823e-7b33a316d33c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:34.394183 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d58f9e9-4dd6-4528-95c5-07efe0634448 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:34.401821 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-e1769cc9-65f1-49f1-805a-b1afb87fe4f8 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:04:34.402361 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d58f9e9-4dd6-4528-95c5-07efe0634448 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:34.402829 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d58f9e9-4dd6-4528-95c5-07efe0634448 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:34.403413 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-e1769cc9-65f1-49f1-805a-b1afb87fe4f8 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:04:34.403587 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d58f9e9-4dd6-4528-95c5-07efe0634448 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:34.404048 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d58f9e9-4dd6-4528-95c5-07efe0634448 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:34.404478 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d58f9e9-4dd6-4528-95c5-07efe0634448 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:34.405663 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-e1769cc9-65f1-49f1-805a-b1afb87fe4f8 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:04:34.410024 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-e1769cc9-65f1-49f1-805a-b1afb87fe4f8 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:04:34.410680 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-e1769cc9-65f1-49f1-805a-b1afb87fe4f8 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:04:34.583476 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e1769cc9-65f1-49f1-805a-b1afb87fe4f8 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:34.597542 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1769cc9-65f1-49f1-805a-b1afb87fe4f8 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:34.599298 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1769cc9-65f1-49f1-805a-b1afb87fe4f8 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:34.599977 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1769cc9-65f1-49f1-805a-b1afb87fe4f8 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:34.601189 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1769cc9-65f1-49f1-805a-b1afb87fe4f8 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:34.603761 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1769cc9-65f1-49f1-805a-b1afb87fe4f8 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:34.604608 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1769cc9-65f1-49f1-805a-b1afb87fe4f8 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:34.861802 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e1769cc9-65f1-49f1-805a-b1afb87fe4f8 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:34.871034 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e1769cc9-65f1-49f1-805a-b1afb87fe4f8 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:34.875241 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e1769cc9-65f1-49f1-805a-b1afb87fe4f8 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:34.902778 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e1769cc9-65f1-49f1-805a-b1afb87fe4f8 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] 10.222.0.40 "POST /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3/action" status: 202 len: 1494 microversion: 2.75 time: 0.735848 Oct 26 13:04:34.904102 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 280/622] 10.222.0.40 () {62 vars in 1319 bytes} [Wed Oct 26 13:04:34 2022] POST /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3/action => generated 1494 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 26 13:04:34.913618 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-938315f8-425d-4a03-999d-587136e10d70 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:34.917705 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-938315f8-425d-4a03-999d-587136e10d70 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] [instance: 480f7c70-2963-4887-b8f8-ea3737880136] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:34.939384 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-938315f8-425d-4a03-999d-587136e10d70 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:34.940140 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-938315f8-425d-4a03-999d-587136e10d70 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:34.940776 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-938315f8-425d-4a03-999d-587136e10d70 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:34.942407 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-938315f8-425d-4a03-999d-587136e10d70 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:34.945032 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-938315f8-425d-4a03-999d-587136e10d70 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:34.945725 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-938315f8-425d-4a03-999d-587136e10d70 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:35.152633 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-938315f8-425d-4a03-999d-587136e10d70 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f9391046054747bbfc1c3e6d65d4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10521abb1c34417fa9369aaba9070968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:35.168039 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-938315f8-425d-4a03-999d-587136e10d70 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] 10.222.0.40 "GET /compute/v2.1/servers/480f7c70-2963-4887-b8f8-ea3737880136" status: 200 len: 1321 microversion: 2.1 time: 0.262651 Oct 26 13:04:35.194914 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 281/623] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:34 2022] GET /compute/v2.1/servers/480f7c70-2963-4887-b8f8-ea3737880136 => generated 1321 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:35.211966 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0d58f9e9-4dd6-4528-95c5-07efe0634448 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:35.235489 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0d58f9e9-4dd6-4528-95c5-07efe0634448 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:35.241899 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0d58f9e9-4dd6-4528-95c5-07efe0634448 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:35.253864 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0d58f9e9-4dd6-4528-95c5-07efe0634448 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c" status: 200 len: 1362 microversion: 2.25 time: 0.889403 Oct 26 13:04:35.271075 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 343/624] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:34 2022] GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c => generated 1362 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:35.288516 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8fe99f93-7408-4b1b-ab02-b9b65feb133d tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:35.289316 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8fe99f93-7408-4b1b-ab02-b9b65feb133d tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: dffc2812-b18a-4227-932f-3db590d7bc6f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:35.297801 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8fe99f93-7408-4b1b-ab02-b9b65feb133d tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:35.299177 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8fe99f93-7408-4b1b-ab02-b9b65feb133d tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:35.300774 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8fe99f93-7408-4b1b-ab02-b9b65feb133d tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:35.305947 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8fe99f93-7408-4b1b-ab02-b9b65feb133d tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:35.306740 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8fe99f93-7408-4b1b-ab02-b9b65feb133d tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:35.307571 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8fe99f93-7408-4b1b-ab02-b9b65feb133d tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:35.777334 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8fe99f93-7408-4b1b-ab02-b9b65feb133d tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241a2299894849c889ee7f1100a9823d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec66df09b6114f5dbd6678d5e848c737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:35.796715 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8fe99f93-7408-4b1b-ab02-b9b65feb133d tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] 10.222.0.40 "GET /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f" status: 200 len: 1517 microversion: 2.1 time: 0.522013 Oct 26 13:04:35.840120 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 344/625] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:35 2022] GET /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f => generated 1517 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:35.857139 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-30079510-3d1c-44ac-8ea3-097cbf22c878 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:35.868697 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-30079510-3d1c-44ac-8ea3-097cbf22c878 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:35.894172 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-94f11e0f-978c-4976-ad72-91b144d4c1d6 tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:35.895060 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-94f11e0f-978c-4976-ad72-91b144d4c1d6 tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] [instance: 4c694a16-fdba-414f-9122-1899cc715565] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:35.895818 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30079510-3d1c-44ac-8ea3-097cbf22c878 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:35.902085 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30079510-3d1c-44ac-8ea3-097cbf22c878 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:35.902792 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30079510-3d1c-44ac-8ea3-097cbf22c878 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:35.903739 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30079510-3d1c-44ac-8ea3-097cbf22c878 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:35.906731 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30079510-3d1c-44ac-8ea3-097cbf22c878 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:35.907644 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30079510-3d1c-44ac-8ea3-097cbf22c878 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:35.917134 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-94f11e0f-978c-4976-ad72-91b144d4c1d6 tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:35.924867 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-94f11e0f-978c-4976-ad72-91b144d4c1d6 tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:35.925449 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-94f11e0f-978c-4976-ad72-91b144d4c1d6 tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:35.934742 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-94f11e0f-978c-4976-ad72-91b144d4c1d6 tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:35.937320 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-94f11e0f-978c-4976-ad72-91b144d4c1d6 tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:35.938122 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-94f11e0f-978c-4976-ad72-91b144d4c1d6 tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:36.137992 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-30079510-3d1c-44ac-8ea3-097cbf22c878 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:36.153670 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-30079510-3d1c-44ac-8ea3-097cbf22c878 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:36.157958 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-30079510-3d1c-44ac-8ea3-097cbf22c878 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:36.178577 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-30079510-3d1c-44ac-8ea3-097cbf22c878 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] 10.222.0.40 "GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 200 len: 1446 microversion: 2.75 time: 0.332624 Oct 26 13:04:36.185903 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 345/626] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:35 2022] GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 1446 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:36.191334 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3bc511ae-eb47-4965-bd88-d52fdad5ae38 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:36.196686 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3bc511ae-eb47-4965-bd88-d52fdad5ae38 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 7da4bb85-b577-4608-a7c0-3320721cb997] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:36.217772 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bc511ae-eb47-4965-bd88-d52fdad5ae38 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:36.219008 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bc511ae-eb47-4965-bd88-d52fdad5ae38 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:36.219509 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bc511ae-eb47-4965-bd88-d52fdad5ae38 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:36.220425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bc511ae-eb47-4965-bd88-d52fdad5ae38 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:36.222375 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bc511ae-eb47-4965-bd88-d52fdad5ae38 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:36.223099 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bc511ae-eb47-4965-bd88-d52fdad5ae38 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:36.501377 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3bc511ae-eb47-4965-bd88-d52fdad5ae38 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:36.513074 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3bc511ae-eb47-4965-bd88-d52fdad5ae38 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997" status: 200 len: 1471 microversion: 2.1 time: 0.325691 Oct 26 13:04:36.513972 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 346/627] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:36 2022] GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997 => generated 1471 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:36.524601 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-123d3999-ed9f-4d2f-94ec-0ef74f46c003 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Action: 'create', calling method: .version_select at 0x7f67329ed310>, body: {"pool": null} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:36.900815 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=15 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:04:37.066224 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-94f11e0f-978c-4976-ad72-91b144d4c1d6 tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4c694a16-fdba-414f-9122-1899cc715565" status: 200 len: 1617 microversion: 2.1 time: 1.860743 Oct 26 13:04:37.073432 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 282/628] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:35 2022] GET /compute/v2.1/servers/4c694a16-fdba-414f-9122-1899cc715565 => generated 1617 bytes in 1878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:37.078908 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2de34de9-637d-4eb1-8772-c191b7de04e0 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:37.081889 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2de34de9-637d-4eb1-8772-c191b7de04e0 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] [instance: 480f7c70-2963-4887-b8f8-ea3737880136] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:37.093504 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2de34de9-637d-4eb1-8772-c191b7de04e0 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:37.095943 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2de34de9-637d-4eb1-8772-c191b7de04e0 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:37.098167 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2de34de9-637d-4eb1-8772-c191b7de04e0 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:37.099640 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2de34de9-637d-4eb1-8772-c191b7de04e0 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:37.101194 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2de34de9-637d-4eb1-8772-c191b7de04e0 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:37.102511 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2de34de9-637d-4eb1-8772-c191b7de04e0 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:37.451977 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2de34de9-637d-4eb1-8772-c191b7de04e0 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f9391046054747bbfc1c3e6d65d4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10521abb1c34417fa9369aaba9070968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:37.463787 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2de34de9-637d-4eb1-8772-c191b7de04e0 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] 10.222.0.40 "GET /compute/v2.1/servers/480f7c70-2963-4887-b8f8-ea3737880136" status: 200 len: 1389 microversion: 2.1 time: 0.388881 Oct 26 13:04:37.464664 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 283/629] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:37 2022] GET /compute/v2.1/servers/480f7c70-2963-4887-b8f8-ea3737880136 => generated 1389 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:37.482366 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3e68b70c-27a3-4713-80e6-3de03ccdb296 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:37.482974 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3e68b70c-27a3-4713-80e6-3de03ccdb296 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: a28883a5-9f17-4514-823e-7b33a316d33c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:37.489386 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3e68b70c-27a3-4713-80e6-3de03ccdb296 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:37.490166 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3e68b70c-27a3-4713-80e6-3de03ccdb296 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:37.490606 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3e68b70c-27a3-4713-80e6-3de03ccdb296 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:37.491332 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3e68b70c-27a3-4713-80e6-3de03ccdb296 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:37.491788 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3e68b70c-27a3-4713-80e6-3de03ccdb296 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:37.492208 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3e68b70c-27a3-4713-80e6-3de03ccdb296 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:37.780531 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3e68b70c-27a3-4713-80e6-3de03ccdb296 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:37.803758 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3e68b70c-27a3-4713-80e6-3de03ccdb296 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:37.806181 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3e68b70c-27a3-4713-80e6-3de03ccdb296 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:37.809501 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3e68b70c-27a3-4713-80e6-3de03ccdb296 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c" status: 200 len: 1557 microversion: 2.25 time: 0.343679 Oct 26 13:04:37.826111 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 284/630] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:37 2022] GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c => generated 1557 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:38.116223 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4d64d572-3c6e-4425-8eba-0d14252aa3db tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1795341156", "id": 565955063, "os-flavor-access:is_public": "False"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:38.142486 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4d64d572-3c6e-4425-8eba-0d14252aa3db tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.331246 Oct 26 13:04:38.151739 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 285/631] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:04:37 2022] POST /compute/v2.1/flavors => generated 436 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:38.157125 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-46d4c565-d40f-4247-9aec-b1bda359a198 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Action: 'create', calling method: .version_select at 0x7f6732b07dc0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-457381314", "policies": ["affinity"]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:38.177574 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=71 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:04:38.179091 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-46d4c565-d40f-4247-9aec-b1bda359a198 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Getting quotas for project d6515917885c4f3cb5fb19e05f4e5e2b. Resources: {'server_groups'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:04:38.185774 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-46d4c565-d40f-4247-9aec-b1bda359a198 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Getting quotas for user b6cddfeca4ce49788143b2bf4b30545f and project d6515917885c4f3cb5fb19e05f4e5e2b. Resources: {'server_groups'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:04:38.248703 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-46d4c565-d40f-4247-9aec-b1bda359a198 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Getting quotas for project d6515917885c4f3cb5fb19e05f4e5e2b. Resources: {'server_groups'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:04:38.252767 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:04:38.253903 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-46d4c565-d40f-4247-9aec-b1bda359a198 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Getting quotas for user b6cddfeca4ce49788143b2bf4b30545f and project d6515917885c4f3cb5fb19e05f4e5e2b. Resources: {'server_groups'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:04:38.268819 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-46d4c565-d40f-4247-9aec-b1bda359a198 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.115547 Oct 26 13:04:38.269692 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 286/632] 10.222.0.40 () {60 vars in 1174 bytes} [Wed Oct 26 13:04:38 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:38.285298 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-14eaa6aa-e536-4748-bc73-50326cb9e0f9 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:38.288340 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-14eaa6aa-e536-4748-bc73-50326cb9e0f9 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:38.295973 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-14eaa6aa-e536-4748-bc73-50326cb9e0f9 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:38.296804 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-14eaa6aa-e536-4748-bc73-50326cb9e0f9 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:38.297416 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-14eaa6aa-e536-4748-bc73-50326cb9e0f9 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:38.298292 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-14eaa6aa-e536-4748-bc73-50326cb9e0f9 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:38.298892 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-14eaa6aa-e536-4748-bc73-50326cb9e0f9 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:38.299452 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-14eaa6aa-e536-4748-bc73-50326cb9e0f9 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:38.419434 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-14eaa6aa-e536-4748-bc73-50326cb9e0f9 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:38.433954 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-14eaa6aa-e536-4748-bc73-50326cb9e0f9 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:38.436690 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-14eaa6aa-e536-4748-bc73-50326cb9e0f9 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:38.459750 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-14eaa6aa-e536-4748-bc73-50326cb9e0f9 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] 10.222.0.40 "GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 200 len: 1446 microversion: 2.75 time: 0.186497 Oct 26 13:04:38.479669 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 287/633] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:38 2022] GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 1446 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:38.489806 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-91eb133a-9e11-498c-a6b8-8602ee307eef tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:38.490431 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-91eb133a-9e11-498c-a6b8-8602ee307eef tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 7da4bb85-b577-4608-a7c0-3320721cb997] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:38.517652 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91eb133a-9e11-498c-a6b8-8602ee307eef tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:38.518867 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91eb133a-9e11-498c-a6b8-8602ee307eef tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:38.519311 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91eb133a-9e11-498c-a6b8-8602ee307eef tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:38.520053 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91eb133a-9e11-498c-a6b8-8602ee307eef tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:38.520504 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91eb133a-9e11-498c-a6b8-8602ee307eef tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:38.521266 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91eb133a-9e11-498c-a6b8-8602ee307eef tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:38.714302 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-91eb133a-9e11-498c-a6b8-8602ee307eef tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:38.722679 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-91eb133a-9e11-498c-a6b8-8602ee307eef tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997" status: 200 len: 1471 microversion: 2.1 time: 0.241848 Oct 26 13:04:38.723661 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 288/634] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:38 2022] GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997 => generated 1471 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:38.729321 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-26bed1c4-eb6e-487f-be51-43fbe53e37d5 req-fbce3235-5ff5-4f8d-9915-0e7b573b400c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "480f7c70-2963-4887-b8f8-ea3737880136", "tag": "f46f1d3b-c223-4e80-8cb0-2fc5b785324f"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:38.739360 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-26bed1c4-eb6e-487f-be51-43fbe53e37d5 req-fbce3235-5ff5-4f8d-9915-0e7b573b400c service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:38.739962 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-26bed1c4-eb6e-487f-be51-43fbe53e37d5 req-fbce3235-5ff5-4f8d-9915-0e7b573b400c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:38.741727 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-26bed1c4-eb6e-487f-be51-43fbe53e37d5 req-fbce3235-5ff5-4f8d-9915-0e7b573b400c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:38.756395 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-26bed1c4-eb6e-487f-be51-43fbe53e37d5 req-fbce3235-5ff5-4f8d-9915-0e7b573b400c service nova] Creating event network-changed:f46f1d3b-c223-4e80-8cb0-2fc5b785324f for instance 480f7c70-2963-4887-b8f8-ea3737880136 on n-h1-862686-1 Oct 26 13:04:38.763178 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-26bed1c4-eb6e-487f-be51-43fbe53e37d5 req-fbce3235-5ff5-4f8d-9915-0e7b573b400c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038284 Oct 26 13:04:38.764442 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 289/635] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:38.769995 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-03e9b767-9cfd-45b0-9e0f-79690762e66c tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:38.770794 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-03e9b767-9cfd-45b0-9e0f-79690762e66c tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] [instance: a28883a5-9f17-4514-823e-7b33a316d33c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:38.778817 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03e9b767-9cfd-45b0-9e0f-79690762e66c tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:38.779449 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03e9b767-9cfd-45b0-9e0f-79690762e66c tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:38.779947 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03e9b767-9cfd-45b0-9e0f-79690762e66c tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:38.780761 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03e9b767-9cfd-45b0-9e0f-79690762e66c tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:38.781310 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03e9b767-9cfd-45b0-9e0f-79690762e66c tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:38.781854 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03e9b767-9cfd-45b0-9e0f-79690762e66c tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:38.933298 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-03e9b767-9cfd-45b0-9e0f-79690762e66c tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lazy-loading 'services' on Instance uuid a28883a5-9f17-4514-823e-7b33a316d33c {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:04:38.948660 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-03e9b767-9cfd-45b0-9e0f-79690762e66c tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c" status: 200 len: 2050 microversion: 2.25 time: 0.182884 Oct 26 13:04:38.950031 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 290/636] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:38 2022] GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c => generated 2050 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:38.954885 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-51e9e78e-ab83-4872-b2e8-90bca6bcb6d9 tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "baca4af5124d4fc8afd6d3324c433880"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:39.045089 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-51e9e78e-ab83-4872-b2e8-90bca6bcb6d9 tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/565955063/action" status: 200 len: 96 microversion: 2.1 time: 0.093860 Oct 26 13:04:39.046008 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 291/637] 10.222.0.40 () {60 vars in 1197 bytes} [Wed Oct 26 13:04:38 2022] POST /compute/v2.1/flavors/565955063/action => generated 96 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:04:39.058418 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2fc2526a-c5b8-4832-9bbf-e6706d238f24 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1863167764", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "c60de25a-4a7c-479c-a06e-5f66faf76b57"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:39.090753 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-123d3999-ed9f-4d2f-94ec-0ef74f46c003 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.574736 Oct 26 13:04:39.105542 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 347/638] 10.222.0.40 () {60 vars in 1170 bytes} [Wed Oct 26 13:04:36 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:39.110064 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4bd32ee6-ae16-480e-b9eb-422fc5507e76 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:39.110705 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4bd32ee6-ae16-480e-b9eb-422fc5507e76 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] [instance: 480f7c70-2963-4887-b8f8-ea3737880136] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:39.125603 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4bd32ee6-ae16-480e-b9eb-422fc5507e76 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:39.126103 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4bd32ee6-ae16-480e-b9eb-422fc5507e76 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:39.126542 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4bd32ee6-ae16-480e-b9eb-422fc5507e76 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:39.128190 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4bd32ee6-ae16-480e-b9eb-422fc5507e76 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:39.129042 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4bd32ee6-ae16-480e-b9eb-422fc5507e76 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:39.129582 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4bd32ee6-ae16-480e-b9eb-422fc5507e76 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:39.131677 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-2fc2526a-c5b8-4832-9bbf-e6706d238f24 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] validate_networks() for None {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:04:39.392501 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-2fc2526a-c5b8-4832-9bbf-e6706d238f24 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:04:39.392920 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-2fc2526a-c5b8-4832-9bbf-e6706d238f24 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:04:39.393660 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-2fc2526a-c5b8-4832-9bbf-e6706d238f24 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:04:39.394635 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-2fc2526a-c5b8-4832-9bbf-e6706d238f24 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:04:39.395049 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-2fc2526a-c5b8-4832-9bbf-e6706d238f24 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:04:39.407183 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4bd32ee6-ae16-480e-b9eb-422fc5507e76 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f9391046054747bbfc1c3e6d65d4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10521abb1c34417fa9369aaba9070968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:39.419451 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4bd32ee6-ae16-480e-b9eb-422fc5507e76 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] 10.222.0.40 "GET /compute/v2.1/servers/480f7c70-2963-4887-b8f8-ea3737880136" status: 200 len: 1389 microversion: 2.1 time: 0.319597 Oct 26 13:04:39.423613 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2fc2526a-c5b8-4832-9bbf-e6706d238f24 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:39.424311 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2fc2526a-c5b8-4832-9bbf-e6706d238f24 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:39.424747 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2fc2526a-c5b8-4832-9bbf-e6706d238f24 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:39.425521 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2fc2526a-c5b8-4832-9bbf-e6706d238f24 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:39.425954 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2fc2526a-c5b8-4832-9bbf-e6706d238f24 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:39.426383 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2fc2526a-c5b8-4832-9bbf-e6706d238f24 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:39.430713 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 348/639] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:39 2022] GET /compute/v2.1/servers/480f7c70-2963-4887-b8f8-ea3737880136 => generated 1389 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:39.441828 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-52bccaaf-10d5-4ff7-ba1a-9ecb348be9c3 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:39.442773 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-52bccaaf-10d5-4ff7-ba1a-9ecb348be9c3 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] [instance: a28883a5-9f17-4514-823e-7b33a316d33c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:39.452097 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-52bccaaf-10d5-4ff7-ba1a-9ecb348be9c3 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:39.452705 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-52bccaaf-10d5-4ff7-ba1a-9ecb348be9c3 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:39.452975 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-2fc2526a-c5b8-4832-9bbf-e6706d238f24 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Getting quotas for project d6515917885c4f3cb5fb19e05f4e5e2b. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:04:39.453333 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-52bccaaf-10d5-4ff7-ba1a-9ecb348be9c3 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:39.454968 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-52bccaaf-10d5-4ff7-ba1a-9ecb348be9c3 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:39.456247 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-52bccaaf-10d5-4ff7-ba1a-9ecb348be9c3 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:39.457199 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-52bccaaf-10d5-4ff7-ba1a-9ecb348be9c3 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:39.457923 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-2fc2526a-c5b8-4832-9bbf-e6706d238f24 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Getting quotas for user b6cddfeca4ce49788143b2bf4b30545f and project d6515917885c4f3cb5fb19e05f4e5e2b. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:04:39.476131 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2fc2526a-c5b8-4832-9bbf-e6706d238f24 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Going to run 2 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:04:39.478120 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=9 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:04:39.480530 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2fc2526a-c5b8-4832-9bbf-e6706d238f24 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 025e46ee-bd4b-4c43-96ce-ee086ecafe24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:04:39.502012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=26 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:04:39.530719 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-2fc2526a-c5b8-4832-9bbf-e6706d238f24 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120597) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 26 13:04:39.550384 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-2fc2526a-c5b8-4832-9bbf-e6706d238f24 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Getting quotas for project d6515917885c4f3cb5fb19e05f4e5e2b. Resources: {'server_group_members'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:04:39.555899 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-2fc2526a-c5b8-4832-9bbf-e6706d238f24 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Getting quotas for user b6cddfeca4ce49788143b2bf4b30545f and project d6515917885c4f3cb5fb19e05f4e5e2b. Resources: {'server_group_members'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:04:39.620752 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-2fc2526a-c5b8-4832-9bbf-e6706d238f24 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Getting quotas for project d6515917885c4f3cb5fb19e05f4e5e2b. Resources: {'server_group_members'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:04:39.650346 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-2fc2526a-c5b8-4832-9bbf-e6706d238f24 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Getting quotas for user b6cddfeca4ce49788143b2bf4b30545f and project d6515917885c4f3cb5fb19e05f4e5e2b. Resources: {'server_group_members'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:04:39.675356 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2fc2526a-c5b8-4832-9bbf-e6706d238f24 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 60c4cea5-3b00-4614-a70d-e3fd589cc408] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=025e46ee-bd4b-4c43-96ce-ee086ecafe24,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:04:39.718907 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-52bccaaf-10d5-4ff7-ba1a-9ecb348be9c3 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lazy-loading 'services' on Instance uuid a28883a5-9f17-4514-823e-7b33a316d33c {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:04:39.737169 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-52bccaaf-10d5-4ff7-ba1a-9ecb348be9c3 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c" status: 200 len: 2050 microversion: 2.25 time: 0.304861 Oct 26 13:04:39.749784 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 349/640] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:39 2022] GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c => generated 2050 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:39.754808 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d2f64618-0c26-4d1b-8c1f-fd4aa1964436 tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "baca4af5124d4fc8afd6d3324c433880"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:39.766173 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-2fc2526a-c5b8-4832-9bbf-e6706d238f24 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Getting quotas for project d6515917885c4f3cb5fb19e05f4e5e2b. Resources: {'server_group_members'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:04:39.770257 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-2fc2526a-c5b8-4832-9bbf-e6706d238f24 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Getting quotas for user b6cddfeca4ce49788143b2bf4b30545f and project d6515917885c4f3cb5fb19e05f4e5e2b. Resources: {'server_group_members'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:04:39.855087 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:04:39.864649 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-d2f64618-0c26-4d1b-8c1f-fd4aa1964436 tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] HTTP exception thrown: Flavor access already exists for flavor 35 and project baca4af5124d4fc8afd6d3324c433880 combination. Oct 26 13:04:39.869151 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-2fc2526a-c5b8-4832-9bbf-e6706d238f24 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Getting quotas for project d6515917885c4f3cb5fb19e05f4e5e2b. Resources: {'server_group_members'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:04:39.869621 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d2f64618-0c26-4d1b-8c1f-fd4aa1964436 tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] Request method failure captured: Oct 26 13:04:39.869621 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/flavors/565955063/action HTTP/1.1 Oct 26 13:04:39.869621 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:04:39.869621 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:04:39.869621 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:04:39.869621 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 67 Oct 26 13:04:39.869621 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:04:39.869621 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:04:39.869621 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:04:39.869621 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:04:39.869621 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTBjz7Ob92vI8y9nVsPziDCdgyCdrZDFJEJj3VDIB6QRF0O51WGHUqwqMrWG-Ag_mqGjpbhd-IeyG8qGnK_ssxP7bK82kDy7LxeoIrk9wXV92vFHRD8B7Q5FmP5PrBnVTJZ-rwEGNT1lbW7wCHXy6BQ9NMTz0ToQ5Pkh1-vbY2StBP0 Oct 26 13:04:39.869621 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:04:39.869621 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:04:39.869621 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:04:39.869621 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:04:39.869621 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:04:39.869621 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:04:39.869621 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: fc733493a2fc4ef39d4c546bcc305ba2 Oct 26 13:04:39.869621 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1352174068 Oct 26 13:04:39.869621 n-d-862686-1 devstack@n-api.service[120598]: X-Role: admin,member,reader Oct 26 13:04:39.869621 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: admin,member,reader Oct 26 13:04:39.871128 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fc733493a2fc4ef39d4c546bcc305ba2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fc733493a2fc4ef39d4c546bcc305ba2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fc733493a2fc4ef39d4c546bcc305ba2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fc733493a2fc4ef39d4c546bcc305ba2"}]}] Oct 26 13:04:39.871128 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1352174068 Oct 26 13:04:39.871128 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: fc733493a2fc4ef39d4c546bcc305ba2 Oct 26 13:04:39.871128 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1352174068 Oct 26 13:04:39.871128 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin Oct 26 13:04:39.871128 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:04:39.871128 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:04:39.871128 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: c4602331e2ba4f8f84c8e9d32ac7ea2b Oct 26 13:04:39.871128 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin Oct 26 13:04:39.871128 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:04:39.871128 n-d-862686-1 devstack@n-api.service[120598]: {"addTenantAccess": {"tenant": "baca4af5124d4fc8afd6d3324c433880"}} Oct 26 13:04:39.871128 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:04:39.871987 n-d-862686-1 devstack@n-api.service[120598]: exception: Flavor access already exists for flavor 35 and project baca4af5124d4fc8afd6d3324c433880 combination. Oct 26 13:04:39.871987 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '565955063', 'body': {'addTenantAccess': {'tenant': 'baca4af5124d4fc8afd6d3324c433880'}}} Oct 26 13:04:39.871987 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:04:39.871987 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:39.871987 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 26 13:04:39.871987 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 26 13:04:39.871987 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 26 13:04:39.871987 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 26 13:04:39.871987 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 26 13:04:39.871987 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 26 13:04:39.871987 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 26 13:04:39.871987 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 26 13:04:39.871987 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 26 13:04:39.871987 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 26 13:04:39.871987 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 26 13:04:39.871987 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result.read() Oct 26 13:04:39.871987 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 26 13:04:39.871987 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 26 13:04:39.873213 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 26 13:04:39.873213 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 26 13:04:39.873213 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 26 13:04:39.873213 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 26 13:04:39.873213 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 26 13:04:39.873213 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 26 13:04:39.873213 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '35-baca4af5124d4fc8afd6d3324c433880' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 26 13:04:39.873213 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:39.873213 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 26 13:04:39.873213 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:39.873213 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:39.873213 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 26 13:04:39.873213 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 26 13:04:39.873213 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 26 13:04:39.873213 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi session.flush() Oct 26 13:04:39.873213 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 26 13:04:39.873213 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 26 13:04:39.873213 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 26 13:04:39.873213 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 26 13:04:39.874545 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 26 13:04:39.874545 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 26 13:04:39.874545 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 26 13:04:39.874545 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception Oct 26 13:04:39.874545 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 26 13:04:39.874545 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 26 13:04:39.874545 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 26 13:04:39.874545 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 26 13:04:39.874545 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 26 13:04:39.874545 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 26 13:04:39.874545 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 26 13:04:39.874545 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 26 13:04:39.874545 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 26 13:04:39.874545 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 26 13:04:39.874545 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 26 13:04:39.874545 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 26 13:04:39.874545 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 26 13:04:39.874545 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 26 13:04:39.875849 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 26 13:04:39.875849 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 26 13:04:39.875849 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 26 13:04:39.875849 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 26 13:04:39.875849 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 26 13:04:39.875849 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 26 13:04:39.875849 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 26 13:04:39.875849 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception Oct 26 13:04:39.875849 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 26 13:04:39.875849 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 26 13:04:39.875849 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 26 13:04:39.875849 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 26 13:04:39.875849 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 26 13:04:39.875849 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 26 13:04:39.875849 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 26 13:04:39.875849 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 26 13:04:39.875849 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 26 13:04:39.875849 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 26 13:04:39.877442 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 26 13:04:39.877442 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result.read() Oct 26 13:04:39.877442 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 26 13:04:39.877442 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 26 13:04:39.877442 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 26 13:04:39.877442 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 26 13:04:39.877442 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 26 13:04:39.877442 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 26 13:04:39.877442 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 26 13:04:39.877442 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 26 13:04:39.877442 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '35-baca4af5124d4fc8afd6d3324c433880' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 26 13:04:39.877442 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 26 13:04:39.877442 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 26, 13, 4, 39, 856568), 'updated_at': None, 'flavor_id': 35, 'project_id': 'baca4af5124d4fc8afd6d3324c433880'}] Oct 26 13:04:39.877442 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 26 13:04:39.877442 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:39.877442 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:04:39.877442 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:39.887148 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:39.887148 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 26 13:04:39.887148 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 26 13:04:39.887148 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 26 13:04:39.887148 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 26 13:04:39.887148 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 26 13:04:39.887148 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 26 13:04:39.887148 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 26 13:04:39.887148 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 26 13:04:39.887148 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 26 13:04:39.887148 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 26 13:04:39.887148 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 13:04:39.887148 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 13:04:39.887148 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 26 13:04:39.887148 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 26 13:04:39.887148 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 35 and project baca4af5124d4fc8afd6d3324c433880 combination. Oct 26 13:04:39.887148 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:39.887148 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:04:39.887148 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:39.890852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:39.890852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:04:39.890852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:04:39.890852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:04:39.890852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:04:39.890852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:04:39.890852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:04:39.890852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:04:39.890852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:04:39.890852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 26 13:04:39.890852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 26 13:04:39.890852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 35 and project baca4af5124d4fc8afd6d3324c433880 combination. Oct 26 13:04:39.890852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:39.890852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:04:39.890852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:39.890852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:39.890852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:04:39.890852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:04:39.890852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:04:39.890852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:04:39.894490 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 35 and project baca4af5124d4fc8afd6d3324c433880 combination. Oct 26 13:04:39.894490 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:39.894490 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d2f64618-0c26-4d1b-8c1f-fd4aa1964436 tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] Returning 409 to user: Flavor access already exists for flavor 35 and project baca4af5124d4fc8afd6d3324c433880 combination. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:04:39.894490 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d2f64618-0c26-4d1b-8c1f-fd4aa1964436 tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/565955063/action" status: 409 len: 152 microversion: 2.1 time: 0.140492 Oct 26 13:04:39.894490 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 350/641] 10.222.0.40 () {60 vars in 1197 bytes} [Wed Oct 26 13:04:39 2022] POST /compute/v2.1/flavors/565955063/action => generated 152 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:04:39.895835 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-2fc2526a-c5b8-4832-9bbf-e6706d238f24 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Getting quotas for user b6cddfeca4ce49788143b2bf4b30545f and project d6515917885c4f3cb5fb19e05f4e5e2b. Resources: {'server_group_members'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:04:39.895994 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-94d23324-843c-4117-bdf4-05ea54aec920 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1732118443", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "d5dfe2c9-28ca-4cae-a6cc-e2ee7f3499d9"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:39.945413 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2fc2526a-c5b8-4832-9bbf-e6706d238f24 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.892857 Oct 26 13:04:39.950265 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 292/642] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:04:39 2022] POST /compute/v2.1/servers => generated 32 bytes in 898 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 26 13:04:39.957880 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8ffcfce6-c2f7-4e11-ae21-9c961c3335bf tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:39.958923 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8ffcfce6-c2f7-4e11-ae21-9c961c3335bf tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:39.967471 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-94d23324-843c-4117-bdf4-05ea54aec920 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] validate_networks() for [('d5dfe2c9-28ca-4cae-a6cc-e2ee7f3499d9', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:04:39.967824 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8ffcfce6-c2f7-4e11-ae21-9c961c3335bf tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:39.968547 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8ffcfce6-c2f7-4e11-ae21-9c961c3335bf tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:39.969134 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8ffcfce6-c2f7-4e11-ae21-9c961c3335bf tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:39.970028 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8ffcfce6-c2f7-4e11-ae21-9c961c3335bf tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:39.970675 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8ffcfce6-c2f7-4e11-ae21-9c961c3335bf tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:39.972317 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8ffcfce6-c2f7-4e11-ae21-9c961c3335bf tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:40.000397 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:04:40.346529 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8ffcfce6-c2f7-4e11-ae21-9c961c3335bf tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:40.359025 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8ffcfce6-c2f7-4e11-ae21-9c961c3335bf tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:40.384252 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8ffcfce6-c2f7-4e11-ae21-9c961c3335bf tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:40.399826 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8ffcfce6-c2f7-4e11-ae21-9c961c3335bf tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] 10.222.0.40 "GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 200 len: 1446 microversion: 2.75 time: 0.448117 Oct 26 13:04:40.400606 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 293/643] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:39 2022] GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 1446 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:40.407115 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d3f7b2eb-9de7-48a5-bcf3-51db4fec640b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:40.407747 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d3f7b2eb-9de7-48a5-bcf3-51db4fec640b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 7da4bb85-b577-4608-a7c0-3320721cb997] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:40.413998 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d3f7b2eb-9de7-48a5-bcf3-51db4fec640b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:40.415117 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d3f7b2eb-9de7-48a5-bcf3-51db4fec640b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:40.415786 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d3f7b2eb-9de7-48a5-bcf3-51db4fec640b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:40.416716 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d3f7b2eb-9de7-48a5-bcf3-51db4fec640b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:40.417334 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d3f7b2eb-9de7-48a5-bcf3-51db4fec640b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:40.417940 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d3f7b2eb-9de7-48a5-bcf3-51db4fec640b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:40.686342 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d3f7b2eb-9de7-48a5-bcf3-51db4fec640b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:40.696769 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d3f7b2eb-9de7-48a5-bcf3-51db4fec640b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997" status: 200 len: 1476 microversion: 2.1 time: 0.294483 Oct 26 13:04:40.697458 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 294/644] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:40 2022] GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997 => generated 1476 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:40.704494 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8449cdee-5478-4c7b-ae1d-f3c61ed0bdcf tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:40.714587 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8449cdee-5478-4c7b-ae1d-f3c61ed0bdcf tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:40.715018 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8449cdee-5478-4c7b-ae1d-f3c61ed0bdcf tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:40.716115 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8449cdee-5478-4c7b-ae1d-f3c61ed0bdcf tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:40.717078 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8449cdee-5478-4c7b-ae1d-f3c61ed0bdcf tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:40.717734 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8449cdee-5478-4c7b-ae1d-f3c61ed0bdcf tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:40.719089 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8449cdee-5478-4c7b-ae1d-f3c61ed0bdcf tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:40.764718 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:04:40.773031 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8449cdee-5478-4c7b-ae1d-f3c61ed0bdcf tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.074330 Oct 26 13:04:40.773736 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 295/645] 10.222.0.40 () {60 vars in 1217 bytes} [Wed Oct 26 13:04:40 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:04:40.779357 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f1891dcb-22f6-4053-908b-6e77fbde6087 tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "baca4af5124d4fc8afd6d3324c433880"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:40.936960 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f1891dcb-22f6-4053-908b-6e77fbde6087 tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/565955063/action" status: 200 len: 21 microversion: 2.1 time: 0.161358 Oct 26 13:04:40.938713 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 296/646] 10.222.0.40 () {60 vars in 1197 bytes} [Wed Oct 26 13:04:40 2022] POST /compute/v2.1/flavors/565955063/action => generated 21 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:04:40.944156 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c9e2f86a-8df3-4a5e-99e4-9254ec1970d0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:40.954127 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c9e2f86a-8df3-4a5e-99e4-9254ec1970d0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:40.955724 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c9e2f86a-8df3-4a5e-99e4-9254ec1970d0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Searching by: {'deleted': False, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b'} {{(pid=120597) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:04:40.965394 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c9e2f86a-8df3-4a5e-99e4-9254ec1970d0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:40.966590 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c9e2f86a-8df3-4a5e-99e4-9254ec1970d0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:40.967509 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c9e2f86a-8df3-4a5e-99e4-9254ec1970d0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:40.968444 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c9e2f86a-8df3-4a5e-99e4-9254ec1970d0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:40.969532 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c9e2f86a-8df3-4a5e-99e4-9254ec1970d0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:40.970171 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c9e2f86a-8df3-4a5e-99e4-9254ec1970d0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:41.172104 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-94d23324-843c-4117-bdf4-05ea54aec920 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:04:41.173140 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-94d23324-843c-4117-bdf4-05ea54aec920 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:04:41.174108 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-94d23324-843c-4117-bdf4-05ea54aec920 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:04:41.174724 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-94d23324-843c-4117-bdf4-05ea54aec920 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:04:41.175282 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-94d23324-843c-4117-bdf4-05ea54aec920 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:04:41.195815 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-94d23324-843c-4117-bdf4-05ea54aec920 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:41.196627 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-94d23324-843c-4117-bdf4-05ea54aec920 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:41.197214 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-94d23324-843c-4117-bdf4-05ea54aec920 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:41.198147 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-94d23324-843c-4117-bdf4-05ea54aec920 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:41.199641 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-94d23324-843c-4117-bdf4-05ea54aec920 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:41.205429 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-94d23324-843c-4117-bdf4-05ea54aec920 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:41.257831 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-94d23324-843c-4117-bdf4-05ea54aec920 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Getting quotas for project ec66df09b6114f5dbd6678d5e848c737. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:04:41.263631 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-94d23324-843c-4117-bdf4-05ea54aec920 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Getting quotas for user 241a2299894849c889ee7f1100a9823d and project ec66df09b6114f5dbd6678d5e848c737. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:04:41.276817 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-94d23324-843c-4117-bdf4-05ea54aec920 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:04:41.279479 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-94d23324-843c-4117-bdf4-05ea54aec920 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: 379653d7-e043-474c-9fdd-3d0f663caed1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:04:41.346128 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-94d23324-843c-4117-bdf4-05ea54aec920 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.463967 Oct 26 13:04:41.347452 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 351/647] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:04:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1466 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:04:41.352938 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-568b98ba-cda2-494b-9439-276d2aead169 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:41.354132 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-568b98ba-cda2-494b-9439-276d2aead169 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] [instance: 480f7c70-2963-4887-b8f8-ea3737880136] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:41.361447 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-568b98ba-cda2-494b-9439-276d2aead169 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:41.362385 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-568b98ba-cda2-494b-9439-276d2aead169 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:41.363078 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-568b98ba-cda2-494b-9439-276d2aead169 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:41.364027 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-568b98ba-cda2-494b-9439-276d2aead169 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:41.364675 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-568b98ba-cda2-494b-9439-276d2aead169 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:41.365263 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-568b98ba-cda2-494b-9439-276d2aead169 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:41.388648 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.multi_cell_list [None req-c9e2f86a-8df3-4a5e-99e4-9254ec1970d0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120597) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 13:04:41.505599 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c9e2f86a-8df3-4a5e-99e4-9254ec1970d0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 0.565095 Oct 26 13:04:41.506247 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 297/648] 10.222.0.40 () {58 vars in 1125 bytes} [Wed Oct 26 13:04:40 2022] GET /compute/v2.1/servers => generated 1004 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:41.520572 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b71cf99c-d103-4a7f-bff3-d48df4720bff tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:41.521117 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b71cf99c-d103-4a7f-bff3-d48df4720bff tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] [instance: a28883a5-9f17-4514-823e-7b33a316d33c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:41.529771 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b71cf99c-d103-4a7f-bff3-d48df4720bff tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:41.530139 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b71cf99c-d103-4a7f-bff3-d48df4720bff tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:41.530634 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b71cf99c-d103-4a7f-bff3-d48df4720bff tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:41.531354 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b71cf99c-d103-4a7f-bff3-d48df4720bff tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:41.531956 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b71cf99c-d103-4a7f-bff3-d48df4720bff tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:41.532387 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b71cf99c-d103-4a7f-bff3-d48df4720bff tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:41.573519 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-568b98ba-cda2-494b-9439-276d2aead169 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f9391046054747bbfc1c3e6d65d4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10521abb1c34417fa9369aaba9070968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:41.603544 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-568b98ba-cda2-494b-9439-276d2aead169 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] 10.222.0.40 "GET /compute/v2.1/servers/480f7c70-2963-4887-b8f8-ea3737880136" status: 200 len: 1389 microversion: 2.1 time: 0.254727 Oct 26 13:04:41.615450 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 352/649] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:41 2022] GET /compute/v2.1/servers/480f7c70-2963-4887-b8f8-ea3737880136 => generated 1389 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:41.636873 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f2230157-505e-482b-89f7-4dbe57585951 tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:41.666212 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b71cf99c-d103-4a7f-bff3-d48df4720bff tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c/action" status: 202 len: 0 microversion: 2.25 time: 0.145398 Oct 26 13:04:41.670501 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 298/650] 10.222.0.40 () {62 vars in 1319 bytes} [Wed Oct 26 13:04:41 2022] POST /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:04:41.690463 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f2230157-505e-482b-89f7-4dbe57585951 tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/565955063" status: 202 len: 0 microversion: 2.1 time: 0.070410 Oct 26 13:04:41.691551 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 353/651] 10.222.0.40 () {58 vars in 1158 bytes} [Wed Oct 26 13:04:41 2022] DELETE /compute/v2.1/flavors/565955063 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:04:41.701642 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2be0d1d7-63d0-46f7-8921-5ec90f6765a5 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:41.702491 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2be0d1d7-63d0-46f7-8921-5ec90f6765a5 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: 379653d7-e043-474c-9fdd-3d0f663caed1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:41.783473 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2be0d1d7-63d0-46f7-8921-5ec90f6765a5 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241a2299894849c889ee7f1100a9823d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec66df09b6114f5dbd6678d5e848c737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:41.792389 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2be0d1d7-63d0-46f7-8921-5ec90f6765a5 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] 10.222.0.40 "GET /compute/v2.1/servers/379653d7-e043-474c-9fdd-3d0f663caed1" status: 200 len: 1224 microversion: 2.1 time: 0.099512 Oct 26 13:04:41.809357 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 354/652] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:41 2022] GET /compute/v2.1/servers/379653d7-e043-474c-9fdd-3d0f663caed1 => generated 1224 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:41.815089 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f6d1c501-7a2d-4387-a9df-7913980cde4c tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:41.815815 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-eb486a89-e397-46af-b881-c6ab72bb428f tempest-FloatingIPDetailsTestJSON-988510931 tempest-FloatingIPDetailsTestJSON-988510931-project] Action: 'create', calling method: .version_select at 0x7f6732ccdf70>, body: {"pool": null} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:41.816053 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f6d1c501-7a2d-4387-a9df-7913980cde4c tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:41.827771 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6d1c501-7a2d-4387-a9df-7913980cde4c tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:41.829147 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6d1c501-7a2d-4387-a9df-7913980cde4c tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:41.831616 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6d1c501-7a2d-4387-a9df-7913980cde4c tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:41.832953 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6d1c501-7a2d-4387-a9df-7913980cde4c tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:41.833665 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6d1c501-7a2d-4387-a9df-7913980cde4c tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:41.834272 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6d1c501-7a2d-4387-a9df-7913980cde4c tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:41.912640 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f6d1c501-7a2d-4387-a9df-7913980cde4c tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:41.924763 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f6d1c501-7a2d-4387-a9df-7913980cde4c tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:41.926758 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f6d1c501-7a2d-4387-a9df-7913980cde4c tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:41.935629 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f6d1c501-7a2d-4387-a9df-7913980cde4c tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] 10.222.0.40 "GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 200 len: 1446 microversion: 2.75 time: 0.124781 Oct 26 13:04:41.937594 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 355/653] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:41 2022] GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 1446 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:41.957992 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0b975006-787f-402d-a33c-1336fae610c9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:41.962894 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0b975006-787f-402d-a33c-1336fae610c9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 025e46ee-bd4b-4c43-96ce-ee086ecafe24] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:41.977690 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0b975006-787f-402d-a33c-1336fae610c9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:41.978208 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0b975006-787f-402d-a33c-1336fae610c9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:41.978652 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0b975006-787f-402d-a33c-1336fae610c9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:41.979386 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0b975006-787f-402d-a33c-1336fae610c9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:41.979859 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0b975006-787f-402d-a33c-1336fae610c9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:41.980296 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0b975006-787f-402d-a33c-1336fae610c9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:42.132142 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0b975006-787f-402d-a33c-1336fae610c9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:42.146529 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0b975006-787f-402d-a33c-1336fae610c9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/025e46ee-bd4b-4c43-96ce-ee086ecafe24" status: 200 len: 1271 microversion: 2.1 time: 0.197472 Oct 26 13:04:42.159457 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 356/654] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:41 2022] GET /compute/v2.1/servers/025e46ee-bd4b-4c43-96ce-ee086ecafe24 => generated 1271 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:42.169459 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-93d5feb7-f738-4658-b1bf-17647a07917a tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:42.175603 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-93d5feb7-f738-4658-b1bf-17647a07917a tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] [instance: a28883a5-9f17-4514-823e-7b33a316d33c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:42.187989 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-93d5feb7-f738-4658-b1bf-17647a07917a tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:42.188494 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-93d5feb7-f738-4658-b1bf-17647a07917a tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:42.193273 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-93d5feb7-f738-4658-b1bf-17647a07917a tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:42.194058 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-93d5feb7-f738-4658-b1bf-17647a07917a tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:42.194540 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-93d5feb7-f738-4658-b1bf-17647a07917a tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:42.194975 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-93d5feb7-f738-4658-b1bf-17647a07917a tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:42.431120 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-93d5feb7-f738-4658-b1bf-17647a07917a tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lazy-loading 'services' on Instance uuid a28883a5-9f17-4514-823e-7b33a316d33c {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:04:42.452570 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-93d5feb7-f738-4658-b1bf-17647a07917a tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c" status: 200 len: 2035 microversion: 2.25 time: 0.290794 Oct 26 13:04:42.460163 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 357/655] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:42 2022] GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c => generated 2035 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:42.473218 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bff6a840-121c-47bb-a096-45526a7fa29a tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:42.499346 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bff6a840-121c-47bb-a096-45526a7fa29a tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.037485 Oct 26 13:04:42.500963 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 358/656] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:04:42 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:42.509618 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-dc3a4b7c-4265-4a41-ab18-69c1e696d2c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:42.510928 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-dc3a4b7c-4265-4a41-ab18-69c1e696d2c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 7da4bb85-b577-4608-a7c0-3320721cb997] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:42.535352 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc3a4b7c-4265-4a41-ab18-69c1e696d2c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:42.535862 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc3a4b7c-4265-4a41-ab18-69c1e696d2c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:42.536311 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc3a4b7c-4265-4a41-ab18-69c1e696d2c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:42.537129 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc3a4b7c-4265-4a41-ab18-69c1e696d2c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:42.537469 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc3a4b7c-4265-4a41-ab18-69c1e696d2c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:42.537916 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc3a4b7c-4265-4a41-ab18-69c1e696d2c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:42.583132 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:04:42.783372 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-dc3a4b7c-4265-4a41-ab18-69c1e696d2c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:42.794295 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-dc3a4b7c-4265-4a41-ab18-69c1e696d2c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997" status: 200 len: 1476 microversion: 2.1 time: 0.290684 Oct 26 13:04:42.795366 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 359/657] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:42 2022] GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997 => generated 1476 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:42.800725 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-12408d00-d22f-41c4-9428-8fa6edc71507 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862686-1", "block_migration": "auto"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:42.803383 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-12408d00-d22f-41c4-9428-8fa6edc71507 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] [instance: a28883a5-9f17-4514-823e-7b33a316d33c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:42.813544 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-12408d00-d22f-41c4-9428-8fa6edc71507 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:42.814656 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-12408d00-d22f-41c4-9428-8fa6edc71507 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:42.815313 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-12408d00-d22f-41c4-9428-8fa6edc71507 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:42.816361 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-12408d00-d22f-41c4-9428-8fa6edc71507 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:42.816823 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-12408d00-d22f-41c4-9428-8fa6edc71507 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:42.817246 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-12408d00-d22f-41c4-9428-8fa6edc71507 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:42.849351 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-12408d00-d22f-41c4-9428-8fa6edc71507 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lazy-loading 'flavor' on Instance uuid a28883a5-9f17-4514-823e-7b33a316d33c {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:04:42.863968 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-12408d00-d22f-41c4-9428-8fa6edc71507 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] [instance: a28883a5-9f17-4514-823e-7b33a316d33c] Going to try to live migrate instance to n-h2-862686-1 {{(pid=120598) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 26 13:04:44.677908 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-12408d00-d22f-41c4-9428-8fa6edc71507 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c/action" status: 202 len: 0 microversion: 2.25 time: 1.881602 Oct 26 13:04:44.678662 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 360/658] 10.222.0.40 () {62 vars in 1319 bytes} [Wed Oct 26 13:04:42 2022] POST /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c/action => generated 0 bytes in 1883 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:04:44.687370 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f0b0ffdb-7a20-4d45-8e5e-fa12728c9b05 tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1251330888", "id": 24486973, "os-flavor-access:is_public": "True"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:44.728014 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f0b0ffdb-7a20-4d45-8e5e-fa12728c9b05 tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 432 microversion: 2.1 time: 0.044122 Oct 26 13:04:44.728958 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 361/659] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:04:44 2022] POST /compute/v2.1/flavors => generated 432 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:44.743315 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-94865150-ea19-45e7-a326-88738352722f tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:44.744447 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-94865150-ea19-45e7-a326-88738352722f tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] [instance: 480f7c70-2963-4887-b8f8-ea3737880136] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:44.752497 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-94865150-ea19-45e7-a326-88738352722f tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:44.752716 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-94865150-ea19-45e7-a326-88738352722f tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:44.755266 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-94865150-ea19-45e7-a326-88738352722f tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:44.755266 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-94865150-ea19-45e7-a326-88738352722f tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:44.755600 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-94865150-ea19-45e7-a326-88738352722f tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:44.756026 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-94865150-ea19-45e7-a326-88738352722f tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:44.831295 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-eb486a89-e397-46af-b881-c6ab72bb428f tempest-FloatingIPDetailsTestJSON-988510931 tempest-FloatingIPDetailsTestJSON-988510931-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.162724 Oct 26 13:04:44.848707 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 299/660] 10.222.0.40 () {60 vars in 1170 bytes} [Wed Oct 26 13:04:41 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:44.924111 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c523e326-0fb2-4ed7-a7d9-b961ae7a4d24 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:44.928635 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c523e326-0fb2-4ed7-a7d9-b961ae7a4d24 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: 379653d7-e043-474c-9fdd-3d0f663caed1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:44.967042 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c523e326-0fb2-4ed7-a7d9-b961ae7a4d24 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:44.970825 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c523e326-0fb2-4ed7-a7d9-b961ae7a4d24 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:44.971420 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c523e326-0fb2-4ed7-a7d9-b961ae7a4d24 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:44.973164 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c523e326-0fb2-4ed7-a7d9-b961ae7a4d24 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:44.973694 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c523e326-0fb2-4ed7-a7d9-b961ae7a4d24 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:44.974151 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c523e326-0fb2-4ed7-a7d9-b961ae7a4d24 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:45.207563 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c523e326-0fb2-4ed7-a7d9-b961ae7a4d24 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241a2299894849c889ee7f1100a9823d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec66df09b6114f5dbd6678d5e848c737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:45.220884 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c523e326-0fb2-4ed7-a7d9-b961ae7a4d24 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] 10.222.0.40 "GET /compute/v2.1/servers/379653d7-e043-474c-9fdd-3d0f663caed1" status: 200 len: 1282 microversion: 2.1 time: 0.369059 Oct 26 13:04:45.221522 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 300/661] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:44 2022] GET /compute/v2.1/servers/379653d7-e043-474c-9fdd-3d0f663caed1 => generated 1282 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:45.236052 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f681f9c0-aede-4682-8c9d-b35c656369fa tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:45.237325 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f681f9c0-aede-4682-8c9d-b35c656369fa tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:45.255302 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f681f9c0-aede-4682-8c9d-b35c656369fa tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:45.256141 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f681f9c0-aede-4682-8c9d-b35c656369fa tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:45.256897 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f681f9c0-aede-4682-8c9d-b35c656369fa tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:45.257905 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f681f9c0-aede-4682-8c9d-b35c656369fa tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:45.259624 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f681f9c0-aede-4682-8c9d-b35c656369fa tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:45.260240 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f681f9c0-aede-4682-8c9d-b35c656369fa tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:45.318612 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-94865150-ea19-45e7-a326-88738352722f tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f9391046054747bbfc1c3e6d65d4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10521abb1c34417fa9369aaba9070968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:45.332304 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-94865150-ea19-45e7-a326-88738352722f tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] 10.222.0.40 "GET /compute/v2.1/servers/480f7c70-2963-4887-b8f8-ea3737880136" status: 200 len: 1389 microversion: 2.1 time: 0.597694 Oct 26 13:04:45.333551 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 362/662] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:44 2022] GET /compute/v2.1/servers/480f7c70-2963-4887-b8f8-ea3737880136 => generated 1389 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:45.347923 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3672422c-9ad1-42e7-9f81-3091d1ad7554 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:45.348773 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3672422c-9ad1-42e7-9f81-3091d1ad7554 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 025e46ee-bd4b-4c43-96ce-ee086ecafe24] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:45.364940 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3672422c-9ad1-42e7-9f81-3091d1ad7554 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:45.370994 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3672422c-9ad1-42e7-9f81-3091d1ad7554 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:45.371682 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3672422c-9ad1-42e7-9f81-3091d1ad7554 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:45.372604 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3672422c-9ad1-42e7-9f81-3091d1ad7554 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:45.373247 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3672422c-9ad1-42e7-9f81-3091d1ad7554 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:45.373711 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3672422c-9ad1-42e7-9f81-3091d1ad7554 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:45.469752 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f681f9c0-aede-4682-8c9d-b35c656369fa tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:45.483639 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f681f9c0-aede-4682-8c9d-b35c656369fa tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:45.485109 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f681f9c0-aede-4682-8c9d-b35c656369fa tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:45.496032 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f681f9c0-aede-4682-8c9d-b35c656369fa tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] 10.222.0.40 "GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 200 len: 1446 microversion: 2.75 time: 0.271124 Oct 26 13:04:45.496633 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 301/663] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:45 2022] GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 1446 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:45.501160 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-cb632523-7efd-4ed3-93b4-0c123e8d011a req-e605269b-7f11-4f33-ae96-c4f9b13b2da1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "480f7c70-2963-4887-b8f8-ea3737880136", "name": "network-vif-plugged", "status": "completed", "tag": "f46f1d3b-c223-4e80-8cb0-2fc5b785324f"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:45.530340 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-cb632523-7efd-4ed3-93b4-0c123e8d011a req-e605269b-7f11-4f33-ae96-c4f9b13b2da1 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:45.530831 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-cb632523-7efd-4ed3-93b4-0c123e8d011a req-e605269b-7f11-4f33-ae96-c4f9b13b2da1 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:45.542020 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-cb632523-7efd-4ed3-93b4-0c123e8d011a req-e605269b-7f11-4f33-ae96-c4f9b13b2da1 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:45.560225 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-cb632523-7efd-4ed3-93b4-0c123e8d011a req-e605269b-7f11-4f33-ae96-c4f9b13b2da1 service nova] Creating event network-vif-plugged:f46f1d3b-c223-4e80-8cb0-2fc5b785324f for instance 480f7c70-2963-4887-b8f8-ea3737880136 on n-h1-862686-1 Oct 26 13:04:45.566521 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-cb632523-7efd-4ed3-93b4-0c123e8d011a req-e605269b-7f11-4f33-ae96-c4f9b13b2da1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068086 Oct 26 13:04:45.567362 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 302/664] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:45.587614 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cb35c477-4222-48f9-bf97-7184f0de2d3a tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:45.589636 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cb35c477-4222-48f9-bf97-7184f0de2d3a tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 7da4bb85-b577-4608-a7c0-3320721cb997] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:45.600513 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb35c477-4222-48f9-bf97-7184f0de2d3a tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:45.601117 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb35c477-4222-48f9-bf97-7184f0de2d3a tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:45.601707 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb35c477-4222-48f9-bf97-7184f0de2d3a tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:45.603253 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb35c477-4222-48f9-bf97-7184f0de2d3a tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:45.603828 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb35c477-4222-48f9-bf97-7184f0de2d3a tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:45.604364 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb35c477-4222-48f9-bf97-7184f0de2d3a tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:45.770395 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3672422c-9ad1-42e7-9f81-3091d1ad7554 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:45.782837 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3672422c-9ad1-42e7-9f81-3091d1ad7554 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/025e46ee-bd4b-4c43-96ce-ee086ecafe24" status: 200 len: 1319 microversion: 2.1 time: 0.447995 Oct 26 13:04:45.796576 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 363/665] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:45 2022] GET /compute/v2.1/servers/025e46ee-bd4b-4c43-96ce-ee086ecafe24 => generated 1319 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:45.816056 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-09fb8fa1-00fd-4770-9042-51b441c505b3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:45.816681 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-09fb8fa1-00fd-4770-9042-51b441c505b3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: a28883a5-9f17-4514-823e-7b33a316d33c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:45.834973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-09fb8fa1-00fd-4770-9042-51b441c505b3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:45.839704 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-09fb8fa1-00fd-4770-9042-51b441c505b3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:45.843780 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-09fb8fa1-00fd-4770-9042-51b441c505b3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:45.845581 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-09fb8fa1-00fd-4770-9042-51b441c505b3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:45.846871 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-09fb8fa1-00fd-4770-9042-51b441c505b3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:45.849194 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-09fb8fa1-00fd-4770-9042-51b441c505b3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:46.357559 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-09fb8fa1-00fd-4770-9042-51b441c505b3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:46.370699 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-09fb8fa1-00fd-4770-9042-51b441c505b3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:46.372299 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-09fb8fa1-00fd-4770-9042-51b441c505b3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:46.373725 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-09fb8fa1-00fd-4770-9042-51b441c505b3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c" status: 200 len: 1567 microversion: 2.25 time: 0.575849 Oct 26 13:04:46.374669 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 364/666] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:45 2022] GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c => generated 1567 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:46.380289 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-099c339b-a616-4c1c-8fba-03e859a0e7fe tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:46.392895 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-099c339b-a616-4c1c-8fba-03e859a0e7fe tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 26 13:04:46.396049 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-099c339b-a616-4c1c-8fba-03e859a0e7fe tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] Request method failure captured: Oct 26 13:04:46.396049 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/flavors/24486973/os-flavor-access HTTP/1.1 Oct 26 13:04:46.396049 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:04:46.396049 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:04:46.396049 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:04:46.396049 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:04:46.396049 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:04:46.396049 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:04:46.396049 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:04:46.396049 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:04:46.396049 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTBjz7Ob92vI8y9nVsPziDCdgyCdrZDFJEJj3VDIB6QRF0O51WGHUqwqMrWG-Ag_mqGjpbhd-IeyG8qGnK_ssxP7bK82kDy7LxeoIrk9wXV92vFHRD8B7Q5FmP5PrBnVTJZ-rwEGNT1lbW7wCHXy6BQ9NMTz0ToQ5Pkh1-vbY2StBP0 Oct 26 13:04:46.396049 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:04:46.396049 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:04:46.396049 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:04:46.396049 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:04:46.396049 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:04:46.396049 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:04:46.396049 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: fc733493a2fc4ef39d4c546bcc305ba2 Oct 26 13:04:46.396049 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1352174068 Oct 26 13:04:46.396049 n-d-862686-1 devstack@n-api.service[120598]: X-Role: admin,member,reader Oct 26 13:04:46.396049 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: admin,member,reader Oct 26 13:04:46.397429 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fc733493a2fc4ef39d4c546bcc305ba2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fc733493a2fc4ef39d4c546bcc305ba2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fc733493a2fc4ef39d4c546bcc305ba2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fc733493a2fc4ef39d4c546bcc305ba2"}]}] Oct 26 13:04:46.397429 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1352174068 Oct 26 13:04:46.397429 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: fc733493a2fc4ef39d4c546bcc305ba2 Oct 26 13:04:46.397429 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1352174068 Oct 26 13:04:46.397429 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin Oct 26 13:04:46.397429 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:04:46.397429 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:04:46.397429 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: c4602331e2ba4f8f84c8e9d32ac7ea2b Oct 26 13:04:46.397429 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin Oct 26 13:04:46.397429 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:04:46.397429 n-d-862686-1 devstack@n-api.service[120598]: exception: Access list not available for public flavors. Oct 26 13:04:46.397429 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'flavor_id': '24486973'} Oct 26 13:04:46.398207 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:04:46.398207 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:46.398207 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:04:46.398207 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:04:46.398207 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:04:46.398207 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:04:46.398207 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:04:46.398207 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:04:46.398207 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 26 13:04:46.398207 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 26 13:04:46.398207 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 26 13:04:46.398207 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:46.398207 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:04:46.398207 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:46.398207 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:46.398207 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:04:46.398207 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:04:46.398207 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:04:46.398207 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:04:46.398207 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 26 13:04:46.398207 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:46.400268 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-099c339b-a616-4c1c-8fba-03e859a0e7fe tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:04:46.400268 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-099c339b-a616-4c1c-8fba-03e859a0e7fe tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/24486973/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.022192 Oct 26 13:04:46.403068 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 365/667] 10.222.0.40 () {58 vars in 1203 bytes} [Wed Oct 26 13:04:46 2022] GET /compute/v2.1/flavors/24486973/os-flavor-access => generated 91 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:04:46.410555 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5e3feb1c-ecaa-40e4-a86b-c896412c67c9 tempest-FloatingIPDetailsTestJSON-988510931 tempest-FloatingIPDetailsTestJSON-988510931-project] Action: 'create', calling method: .version_select at 0x7f67329071f0>, body: {"pool": null} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:46.475513 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cb35c477-4222-48f9-bf97-7184f0de2d3a tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:46.484471 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cb35c477-4222-48f9-bf97-7184f0de2d3a tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997" status: 200 len: 1476 microversion: 2.1 time: 0.915343 Oct 26 13:04:46.489895 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 303/668] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:45 2022] GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997 => generated 1476 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:46.496409 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ba17402a-06d8-4150-b4d3-6ece904fa761 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:46.501908 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ba17402a-06d8-4150-b4d3-6ece904fa761 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: 379653d7-e043-474c-9fdd-3d0f663caed1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:46.517972 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ba17402a-06d8-4150-b4d3-6ece904fa761 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:46.518892 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ba17402a-06d8-4150-b4d3-6ece904fa761 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:46.519576 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ba17402a-06d8-4150-b4d3-6ece904fa761 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:46.520550 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ba17402a-06d8-4150-b4d3-6ece904fa761 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:46.521222 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ba17402a-06d8-4150-b4d3-6ece904fa761 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:46.521910 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ba17402a-06d8-4150-b4d3-6ece904fa761 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:46.995491 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ba17402a-06d8-4150-b4d3-6ece904fa761 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241a2299894849c889ee7f1100a9823d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec66df09b6114f5dbd6678d5e848c737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:47.004565 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ba17402a-06d8-4150-b4d3-6ece904fa761 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] 10.222.0.40 "GET /compute/v2.1/servers/379653d7-e043-474c-9fdd-3d0f663caed1" status: 200 len: 1324 microversion: 2.1 time: 0.513123 Oct 26 13:04:47.005144 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 304/669] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:46 2022] GET /compute/v2.1/servers/379653d7-e043-474c-9fdd-3d0f663caed1 => generated 1324 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:47.014531 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-54ad2ac3-2104-4a16-b1e9-1fa0eb419ebd tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:47.015378 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-54ad2ac3-2104-4a16-b1e9-1fa0eb419ebd tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] [instance: 480f7c70-2963-4887-b8f8-ea3737880136] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:47.025608 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54ad2ac3-2104-4a16-b1e9-1fa0eb419ebd tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:47.026104 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54ad2ac3-2104-4a16-b1e9-1fa0eb419ebd tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:47.026537 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54ad2ac3-2104-4a16-b1e9-1fa0eb419ebd tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:47.027428 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54ad2ac3-2104-4a16-b1e9-1fa0eb419ebd tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:47.027894 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54ad2ac3-2104-4a16-b1e9-1fa0eb419ebd tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:47.028366 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54ad2ac3-2104-4a16-b1e9-1fa0eb419ebd tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:47.448807 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-54ad2ac3-2104-4a16-b1e9-1fa0eb419ebd tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f9391046054747bbfc1c3e6d65d4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10521abb1c34417fa9369aaba9070968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:47.459582 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-54ad2ac3-2104-4a16-b1e9-1fa0eb419ebd tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] 10.222.0.40 "GET /compute/v2.1/servers/480f7c70-2963-4887-b8f8-ea3737880136" status: 200 len: 1389 microversion: 2.1 time: 0.453085 Oct 26 13:04:47.460306 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 305/670] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:47 2022] GET /compute/v2.1/servers/480f7c70-2963-4887-b8f8-ea3737880136 => generated 1389 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:47.465121 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d8f6d868-1083-4b0d-8cc7-e178a09ae466 tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:47.489934 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d8f6d868-1083-4b0d-8cc7-e178a09ae466 tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/24486973" status: 202 len: 0 microversion: 2.1 time: 0.027561 Oct 26 13:04:47.490577 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 306/671] 10.222.0.40 () {58 vars in 1155 bytes} [Wed Oct 26 13:04:47 2022] DELETE /compute/v2.1/flavors/24486973 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:04:47.497888 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-78c01114-59a8-4cf8-b9c7-923dbaeda7b9 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:47.498094 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-78c01114-59a8-4cf8-b9c7-923dbaeda7b9 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:47.509400 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78c01114-59a8-4cf8-b9c7-923dbaeda7b9 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:47.509848 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78c01114-59a8-4cf8-b9c7-923dbaeda7b9 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:47.510292 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78c01114-59a8-4cf8-b9c7-923dbaeda7b9 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:47.511017 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78c01114-59a8-4cf8-b9c7-923dbaeda7b9 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:47.511468 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78c01114-59a8-4cf8-b9c7-923dbaeda7b9 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:47.511988 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78c01114-59a8-4cf8-b9c7-923dbaeda7b9 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:47.657034 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-78c01114-59a8-4cf8-b9c7-923dbaeda7b9 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:47.671071 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-78c01114-59a8-4cf8-b9c7-923dbaeda7b9 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:47.672541 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-78c01114-59a8-4cf8-b9c7-923dbaeda7b9 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:47.678490 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-78c01114-59a8-4cf8-b9c7-923dbaeda7b9 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] 10.222.0.40 "GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 200 len: 1446 microversion: 2.75 time: 0.186844 Oct 26 13:04:47.680084 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 307/672] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:47 2022] GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 1446 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:47.712744 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a45c058e-a8d4-49ee-9f77-0ca89167be90 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:47.714017 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a45c058e-a8d4-49ee-9f77-0ca89167be90 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 025e46ee-bd4b-4c43-96ce-ee086ecafe24] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:47.721772 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a45c058e-a8d4-49ee-9f77-0ca89167be90 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:47.722443 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a45c058e-a8d4-49ee-9f77-0ca89167be90 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:47.722896 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a45c058e-a8d4-49ee-9f77-0ca89167be90 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:47.723640 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a45c058e-a8d4-49ee-9f77-0ca89167be90 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:47.724170 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a45c058e-a8d4-49ee-9f77-0ca89167be90 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:47.725615 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a45c058e-a8d4-49ee-9f77-0ca89167be90 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:48.200697 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5e3feb1c-ecaa-40e4-a86b-c896412c67c9 tempest-FloatingIPDetailsTestJSON-988510931 tempest-FloatingIPDetailsTestJSON-988510931-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.796470 Oct 26 13:04:48.209421 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 366/673] 10.222.0.40 () {60 vars in 1170 bytes} [Wed Oct 26 13:04:46 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1798 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:48.209421 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-704f0f15-3248-4db9-ab24-6be049723405 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:48.209421 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-704f0f15-3248-4db9-ab24-6be049723405 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: a28883a5-9f17-4514-823e-7b33a316d33c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:48.215572 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-704f0f15-3248-4db9-ab24-6be049723405 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:48.216190 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-704f0f15-3248-4db9-ab24-6be049723405 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:48.216709 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-704f0f15-3248-4db9-ab24-6be049723405 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:48.218050 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-704f0f15-3248-4db9-ab24-6be049723405 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:48.218050 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-704f0f15-3248-4db9-ab24-6be049723405 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:48.218542 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-704f0f15-3248-4db9-ab24-6be049723405 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:48.435008 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-704f0f15-3248-4db9-ab24-6be049723405 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:48.443707 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-704f0f15-3248-4db9-ab24-6be049723405 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:48.445308 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-704f0f15-3248-4db9-ab24-6be049723405 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:48.446950 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-704f0f15-3248-4db9-ab24-6be049723405 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c" status: 200 len: 1567 microversion: 2.25 time: 0.243894 Oct 26 13:04:48.447600 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 367/674] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:48 2022] GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c => generated 1567 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:48.452433 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5fdf0735-e55e-48f1-b6aa-0907d1fee6bd tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:48.468773 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a45c058e-a8d4-49ee-9f77-0ca89167be90 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:48.475595 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5fdf0735-e55e-48f1-b6aa-0907d1fee6bd tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.026673 Oct 26 13:04:48.477770 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a45c058e-a8d4-49ee-9f77-0ca89167be90 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/025e46ee-bd4b-4c43-96ce-ee086ecafe24" status: 200 len: 1319 microversion: 2.1 time: 0.795798 Oct 26 13:04:48.490557 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 308/675] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:47 2022] GET /compute/v2.1/servers/025e46ee-bd4b-4c43-96ce-ee086ecafe24 => generated 1319 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:48.491162 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 368/676] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:04:48 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:48.500601 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-c59f518f-6a4e-4a79-8f53-74ce9b19f024 req-e49413a2-c005-4e8e-8d5b-30cd76679d27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60c4cea5-3b00-4614-a70d-e3fd589cc408", "tag": "79a7de1e-4128-41b8-bbb9-aea414b689c4"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:48.500832 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3384d6a7-6451-41ff-a9c0-61b1bc0d44e3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:48.501361 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3384d6a7-6451-41ff-a9c0-61b1bc0d44e3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 7da4bb85-b577-4608-a7c0-3320721cb997] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:48.507714 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3384d6a7-6451-41ff-a9c0-61b1bc0d44e3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:48.508452 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3384d6a7-6451-41ff-a9c0-61b1bc0d44e3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:48.508915 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3384d6a7-6451-41ff-a9c0-61b1bc0d44e3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:48.509672 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3384d6a7-6451-41ff-a9c0-61b1bc0d44e3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:48.510141 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3384d6a7-6451-41ff-a9c0-61b1bc0d44e3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:48.510579 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3384d6a7-6451-41ff-a9c0-61b1bc0d44e3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:48.512830 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-c59f518f-6a4e-4a79-8f53-74ce9b19f024 req-e49413a2-c005-4e8e-8d5b-30cd76679d27 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:48.513852 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-c59f518f-6a4e-4a79-8f53-74ce9b19f024 req-e49413a2-c005-4e8e-8d5b-30cd76679d27 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:48.514501 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-c59f518f-6a4e-4a79-8f53-74ce9b19f024 req-e49413a2-c005-4e8e-8d5b-30cd76679d27 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:48.527406 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-c59f518f-6a4e-4a79-8f53-74ce9b19f024 req-e49413a2-c005-4e8e-8d5b-30cd76679d27 service nova] Creating event network-changed:79a7de1e-4128-41b8-bbb9-aea414b689c4 for instance 60c4cea5-3b00-4614-a70d-e3fd589cc408 on n-h2-862686-1 Oct 26 13:04:48.532791 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-c59f518f-6a4e-4a79-8f53-74ce9b19f024 req-e49413a2-c005-4e8e-8d5b-30cd76679d27 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040134 Oct 26 13:04:48.533765 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 309/677] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:48.539467 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-5c2975b2-858c-44e3-83e1-4f24178a41db req-86c418ef-8b1e-4a17-a7e7-37e29a83ac04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "025e46ee-bd4b-4c43-96ce-ee086ecafe24", "tag": "c77ced81-786f-403c-bb03-35100bde9f26"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:48.550090 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-5c2975b2-858c-44e3-83e1-4f24178a41db req-86c418ef-8b1e-4a17-a7e7-37e29a83ac04 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:48.550952 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-5c2975b2-858c-44e3-83e1-4f24178a41db req-86c418ef-8b1e-4a17-a7e7-37e29a83ac04 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:48.551726 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-5c2975b2-858c-44e3-83e1-4f24178a41db req-86c418ef-8b1e-4a17-a7e7-37e29a83ac04 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:48.565027 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-5c2975b2-858c-44e3-83e1-4f24178a41db req-86c418ef-8b1e-4a17-a7e7-37e29a83ac04 service nova] Creating event network-changed:c77ced81-786f-403c-bb03-35100bde9f26 for instance 025e46ee-bd4b-4c43-96ce-ee086ecafe24 on n-h2-862686-1 Oct 26 13:04:48.570324 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-5c2975b2-858c-44e3-83e1-4f24178a41db req-86c418ef-8b1e-4a17-a7e7-37e29a83ac04 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034816 Oct 26 13:04:48.571978 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 310/678] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:48.577649 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4aa9414d-5079-40f9-8f50-cc53dc72cbe0 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:48.578690 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4aa9414d-5079-40f9-8f50-cc53dc72cbe0 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: 379653d7-e043-474c-9fdd-3d0f663caed1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:48.586609 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4aa9414d-5079-40f9-8f50-cc53dc72cbe0 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:48.587194 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4aa9414d-5079-40f9-8f50-cc53dc72cbe0 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:48.587883 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4aa9414d-5079-40f9-8f50-cc53dc72cbe0 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:48.588669 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4aa9414d-5079-40f9-8f50-cc53dc72cbe0 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:48.589192 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4aa9414d-5079-40f9-8f50-cc53dc72cbe0 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:48.589722 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4aa9414d-5079-40f9-8f50-cc53dc72cbe0 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:48.909124 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3384d6a7-6451-41ff-a9c0-61b1bc0d44e3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:48.917499 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3384d6a7-6451-41ff-a9c0-61b1bc0d44e3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997" status: 200 len: 1476 microversion: 2.1 time: 0.425381 Oct 26 13:04:48.918101 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 369/679] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:48 2022] GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997 => generated 1476 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:48.923168 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9135a29b-0a48-4110-9716-866e6af6af34 tempest-FloatingIPDetailsTestJSON-988510931 tempest-FloatingIPDetailsTestJSON-988510931-project] Action: 'create', calling method: .version_select at 0x7f6732a13790>, body: {"pool": null} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:48.981687 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4aa9414d-5079-40f9-8f50-cc53dc72cbe0 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241a2299894849c889ee7f1100a9823d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec66df09b6114f5dbd6678d5e848c737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:48.990054 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4aa9414d-5079-40f9-8f50-cc53dc72cbe0 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] 10.222.0.40 "GET /compute/v2.1/servers/379653d7-e043-474c-9fdd-3d0f663caed1" status: 200 len: 1324 microversion: 2.1 time: 0.416459 Oct 26 13:04:48.991183 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 311/680] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:48 2022] GET /compute/v2.1/servers/379653d7-e043-474c-9fdd-3d0f663caed1 => generated 1324 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:48.997722 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0614e5a2-664a-4d9a-b32e-7985cee80a4e tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:48.998495 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0614e5a2-664a-4d9a-b32e-7985cee80a4e tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] [instance: 480f7c70-2963-4887-b8f8-ea3737880136] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:49.011006 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0614e5a2-664a-4d9a-b32e-7985cee80a4e tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:49.011782 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0614e5a2-664a-4d9a-b32e-7985cee80a4e tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:49.012229 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0614e5a2-664a-4d9a-b32e-7985cee80a4e tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:49.012945 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0614e5a2-664a-4d9a-b32e-7985cee80a4e tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:49.013406 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0614e5a2-664a-4d9a-b32e-7985cee80a4e tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:49.014120 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0614e5a2-664a-4d9a-b32e-7985cee80a4e tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:49.384592 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0614e5a2-664a-4d9a-b32e-7985cee80a4e tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f9391046054747bbfc1c3e6d65d4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10521abb1c34417fa9369aaba9070968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:49.393082 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0614e5a2-664a-4d9a-b32e-7985cee80a4e tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] 10.222.0.40 "GET /compute/v2.1/servers/480f7c70-2963-4887-b8f8-ea3737880136" status: 200 len: 1586 microversion: 2.1 time: 0.400581 Oct 26 13:04:49.406333 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 312/681] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:48 2022] GET /compute/v2.1/servers/480f7c70-2963-4887-b8f8-ea3737880136 => generated 1586 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:49.418025 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0a780987-8090-40be-a89c-da430dc9d7e7 tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-637542277", "id": 923717037, "os-flavor-access:is_public": "False"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:49.440179 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0a780987-8090-40be-a89c-da430dc9d7e7 tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.026541 Oct 26 13:04:49.440911 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 313/682] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:04:49 2022] POST /compute/v2.1/flavors => generated 435 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:49.446232 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9cb13c19-b4b1-44a3-884e-a28ca3ef22c5 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:49.447218 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9cb13c19-b4b1-44a3-884e-a28ca3ef22c5 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:49.453747 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9cb13c19-b4b1-44a3-884e-a28ca3ef22c5 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:49.454343 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9cb13c19-b4b1-44a3-884e-a28ca3ef22c5 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:49.454844 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9cb13c19-b4b1-44a3-884e-a28ca3ef22c5 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:49.455620 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9cb13c19-b4b1-44a3-884e-a28ca3ef22c5 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:49.456163 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9cb13c19-b4b1-44a3-884e-a28ca3ef22c5 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:49.456783 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9cb13c19-b4b1-44a3-884e-a28ca3ef22c5 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:49.556501 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9cb13c19-b4b1-44a3-884e-a28ca3ef22c5 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:49.568886 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9cb13c19-b4b1-44a3-884e-a28ca3ef22c5 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:49.571578 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9cb13c19-b4b1-44a3-884e-a28ca3ef22c5 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:49.580692 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9cb13c19-b4b1-44a3-884e-a28ca3ef22c5 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] 10.222.0.40 "GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 200 len: 1446 microversion: 2.75 time: 0.138367 Oct 26 13:04:49.581691 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 314/683] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:49 2022] GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 1446 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:49.588789 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-decefb57-82e1-4edc-94a1-f1794d46865e tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:49.589560 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-decefb57-82e1-4edc-94a1-f1794d46865e tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] [instance: 480f7c70-2963-4887-b8f8-ea3737880136] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:49.605785 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-decefb57-82e1-4edc-94a1-f1794d46865e tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:49.607560 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-decefb57-82e1-4edc-94a1-f1794d46865e tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:49.610040 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-decefb57-82e1-4edc-94a1-f1794d46865e tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:49.610998 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-decefb57-82e1-4edc-94a1-f1794d46865e tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:49.612945 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-decefb57-82e1-4edc-94a1-f1794d46865e tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:49.613551 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-decefb57-82e1-4edc-94a1-f1794d46865e tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:49.634200 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:04:49.775252 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-decefb57-82e1-4edc-94a1-f1794d46865e tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] 10.222.0.40 "GET /compute/v2.1/servers/480f7c70-2963-4887-b8f8-ea3737880136/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.191850 Oct 26 13:04:49.784053 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 315/684] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 26 13:04:49 2022] GET /compute/v2.1/servers/480f7c70-2963-4887-b8f8-ea3737880136/os-interface => generated 284 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:49.899509 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=29 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:04:50.051090 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-911d073c-028b-4023-8990-8d39203f4ae1 tempest-FlavorsAccessNegativeTestJSON-489887067 tempest-FlavorsAccessNegativeTestJSON-489887067-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "baca4af5124d4fc8afd6d3324c433880"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:50.062815 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-911d073c-028b-4023-8990-8d39203f4ae1 tempest-FlavorsAccessNegativeTestJSON-489887067 tempest-FlavorsAccessNegativeTestJSON-489887067-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '8ea86714902245c8b0acca468d3568e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baca4af5124d4fc8afd6d3324c433880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:50.065057 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-911d073c-028b-4023-8990-8d39203f4ae1 tempest-FlavorsAccessNegativeTestJSON-489887067 tempest-FlavorsAccessNegativeTestJSON-489887067-project] Request method failure captured: Oct 26 13:04:50.065057 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/flavors/923717037/action HTTP/1.1 Oct 26 13:04:50.065057 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:04:50.065057 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:04:50.065057 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:04:50.065057 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 67 Oct 26 13:04:50.065057 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:04:50.065057 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:04:50.065057 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:04:50.065057 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:04:50.065057 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTBiWERMSl_-T4GqAxX_5Opj79qpGz4tDbc5io8UeeWd4g1V1U_HAS6RnK3uyWSB080L83icQgUUoL4m21uR1Rc8Ap4yMnFM_gpNAwfrnIlg-lE5Euh6-w8TeXQNIdtqE5MizoqEdAukYaVhKu8yt1iIFWsIzJFt_1oDlH7u7CG6QnU Oct 26 13:04:50.065057 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:04:50.065057 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:04:50.065057 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:04:50.065057 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:04:50.065057 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:04:50.065057 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:04:50.065057 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: baca4af5124d4fc8afd6d3324c433880 Oct 26 13:04:50.065057 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-489887067 Oct 26 13:04:50.065057 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:04:50.065057 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:04:50.066594 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/baca4af5124d4fc8afd6d3324c433880"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/baca4af5124d4fc8afd6d3324c433880"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_baca4af5124d4fc8afd6d3324c433880"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/baca4af5124d4fc8afd6d3324c433880"}]}] Oct 26 13:04:50.066594 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-489887067 Oct 26 13:04:50.066594 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: baca4af5124d4fc8afd6d3324c433880 Oct 26 13:04:50.066594 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-489887067 Oct 26 13:04:50.066594 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-FlavorsAccessNegativeTestJSON-489887067-project Oct 26 13:04:50.066594 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:04:50.066594 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:04:50.066594 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 8ea86714902245c8b0acca468d3568e5 Oct 26 13:04:50.066594 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-489887067-project Oct 26 13:04:50.066594 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:04:50.066594 n-d-862686-1 devstack@n-api.service[120597]: {"addTenantAccess": {"tenant": "baca4af5124d4fc8afd6d3324c433880"}} Oct 26 13:04:50.066594 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:04:50.067403 n-d-862686-1 devstack@n-api.service[120597]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 26 13:04:50.067403 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '923717037', 'body': {'addTenantAccess': {'tenant': 'baca4af5124d4fc8afd6d3324c433880'}}} Oct 26 13:04:50.067403 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:04:50.067403 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:50.067403 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:04:50.067403 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:04:50.067403 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:04:50.067403 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:04:50.067403 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:04:50.067403 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:04:50.067403 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:04:50.067403 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:04:50.067403 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 26 13:04:50.067403 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 26 13:04:50.067403 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 13:04:50.067403 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 13:04:50.067403 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 13:04:50.067403 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 13:04:50.067403 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 13:04:50.068766 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 13:04:50.068766 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 13:04:50.068766 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 13:04:50.068766 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 13:04:50.068766 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 13:04:50.068766 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 13:04:50.068766 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 13:04:50.068766 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 13:04:50.068766 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 13:04:50.068766 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 26 13:04:50.068766 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:04:50.068766 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:04:50.068766 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:04:50.068766 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:50.068766 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:04:50.068766 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:04:50.068766 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 13:04:50.068766 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 13:04:50.068766 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 26 13:04:50.068766 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:04:50.073915 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-911d073c-028b-4023-8990-8d39203f4ae1 tempest-FlavorsAccessNegativeTestJSON-489887067 tempest-FlavorsAccessNegativeTestJSON-489887067-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:04:50.074987 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-911d073c-028b-4023-8990-8d39203f4ae1 tempest-FlavorsAccessNegativeTestJSON-489887067 tempest-FlavorsAccessNegativeTestJSON-489887067-project] 10.222.0.40 "POST /compute/v2.1/flavors/923717037/action" status: 403 len: 130 microversion: 2.1 time: 0.289490 Oct 26 13:04:50.082283 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 316/685] 10.222.0.40 () {60 vars in 1197 bytes} [Wed Oct 26 13:04:49 2022] POST /compute/v2.1/flavors/923717037/action => generated 130 bytes in 297 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:04:50.090696 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5715b593-5128-4c96-abf8-e917a4c865e4 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:50.092064 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5715b593-5128-4c96-abf8-e917a4c865e4 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: a28883a5-9f17-4514-823e-7b33a316d33c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:50.104211 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5715b593-5128-4c96-abf8-e917a4c865e4 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:50.105005 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5715b593-5128-4c96-abf8-e917a4c865e4 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:50.105688 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5715b593-5128-4c96-abf8-e917a4c865e4 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:50.106655 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5715b593-5128-4c96-abf8-e917a4c865e4 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:50.107295 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5715b593-5128-4c96-abf8-e917a4c865e4 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:50.107915 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5715b593-5128-4c96-abf8-e917a4c865e4 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:50.114282 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9135a29b-0a48-4110-9716-866e6af6af34 tempest-FloatingIPDetailsTestJSON-988510931 tempest-FloatingIPDetailsTestJSON-988510931-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.194694 Oct 26 13:04:50.116825 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 370/686] 10.222.0.40 () {60 vars in 1170 bytes} [Wed Oct 26 13:04:48 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:50.131843 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-003fa610-7c6b-4d68-a1dd-ca6079ed4691 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:50.135133 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-003fa610-7c6b-4d68-a1dd-ca6079ed4691 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 025e46ee-bd4b-4c43-96ce-ee086ecafe24] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:50.152858 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-003fa610-7c6b-4d68-a1dd-ca6079ed4691 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:50.153776 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-003fa610-7c6b-4d68-a1dd-ca6079ed4691 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:50.154580 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-003fa610-7c6b-4d68-a1dd-ca6079ed4691 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:50.155921 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-003fa610-7c6b-4d68-a1dd-ca6079ed4691 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:50.157062 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-003fa610-7c6b-4d68-a1dd-ca6079ed4691 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:50.157894 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-003fa610-7c6b-4d68-a1dd-ca6079ed4691 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:50.317135 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-003fa610-7c6b-4d68-a1dd-ca6079ed4691 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:50.325437 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-003fa610-7c6b-4d68-a1dd-ca6079ed4691 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/025e46ee-bd4b-4c43-96ce-ee086ecafe24" status: 200 len: 1319 microversion: 2.1 time: 0.206305 Oct 26 13:04:50.326045 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 371/687] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:50 2022] GET /compute/v2.1/servers/025e46ee-bd4b-4c43-96ce-ee086ecafe24 => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:50.330477 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-63f7c45d-16e0-445c-a86d-d7222baeee36 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:50.331325 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-63f7c45d-16e0-445c-a86d-d7222baeee36 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 7da4bb85-b577-4608-a7c0-3320721cb997] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:50.338908 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63f7c45d-16e0-445c-a86d-d7222baeee36 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:50.339390 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63f7c45d-16e0-445c-a86d-d7222baeee36 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:50.339824 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63f7c45d-16e0-445c-a86d-d7222baeee36 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:50.340512 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63f7c45d-16e0-445c-a86d-d7222baeee36 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:50.341150 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63f7c45d-16e0-445c-a86d-d7222baeee36 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:50.341599 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63f7c45d-16e0-445c-a86d-d7222baeee36 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:50.483142 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-63f7c45d-16e0-445c-a86d-d7222baeee36 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:50.491233 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-63f7c45d-16e0-445c-a86d-d7222baeee36 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997" status: 200 len: 1476 microversion: 2.1 time: 0.164058 Oct 26 13:04:50.491896 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 372/688] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:50 2022] GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997 => generated 1476 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:50.493195 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5715b593-5128-4c96-abf8-e917a4c865e4 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:50.497713 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f0a92cdf-85b5-48bc-93fd-9b030d48c793 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:50.498317 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f0a92cdf-85b5-48bc-93fd-9b030d48c793 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: 379653d7-e043-474c-9fdd-3d0f663caed1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:50.502795 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5715b593-5128-4c96-abf8-e917a4c865e4 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:50.504526 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5715b593-5128-4c96-abf8-e917a4c865e4 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:50.504749 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0a92cdf-85b5-48bc-93fd-9b030d48c793 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:50.505573 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0a92cdf-85b5-48bc-93fd-9b030d48c793 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:50.506160 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5715b593-5128-4c96-abf8-e917a4c865e4 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c" status: 200 len: 1567 microversion: 2.25 time: 0.422655 Oct 26 13:04:50.506275 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0a92cdf-85b5-48bc-93fd-9b030d48c793 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:50.507645 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0a92cdf-85b5-48bc-93fd-9b030d48c793 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:50.508617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0a92cdf-85b5-48bc-93fd-9b030d48c793 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:50.509355 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0a92cdf-85b5-48bc-93fd-9b030d48c793 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:50.518449 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 317/689] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:50 2022] GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c => generated 1567 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:50.527835 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-291ed675-5645-4dd5-9ea2-c2c6b022928e tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:50.547063 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-291ed675-5645-4dd5-9ea2-c2c6b022928e tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/923717037" status: 202 len: 0 microversion: 2.1 time: 0.027331 Oct 26 13:04:50.547681 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 318/690] 10.222.0.40 () {58 vars in 1158 bytes} [Wed Oct 26 13:04:50 2022] DELETE /compute/v2.1/flavors/923717037 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:04:50.552926 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-63fdee26-632b-4fa7-8091-12d9add003c4 tempest-FloatingIPDetailsTestJSON-988510931 tempest-FloatingIPDetailsTestJSON-988510931-project] Action: 'create', calling method: .version_select at 0x7f6732d1ca60>, body: {"pool": null} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:50.648060 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f0a92cdf-85b5-48bc-93fd-9b030d48c793 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241a2299894849c889ee7f1100a9823d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec66df09b6114f5dbd6678d5e848c737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:50.657118 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f0a92cdf-85b5-48bc-93fd-9b030d48c793 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] 10.222.0.40 "GET /compute/v2.1/servers/379653d7-e043-474c-9fdd-3d0f663caed1" status: 200 len: 1324 microversion: 2.1 time: 0.163818 Oct 26 13:04:50.657721 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 373/691] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:50 2022] GET /compute/v2.1/servers/379653d7-e043-474c-9fdd-3d0f663caed1 => generated 1324 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:50.662626 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1373789d-b46a-48bf-8cc7-901206d55055 tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:50.684931 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1373789d-b46a-48bf-8cc7-901206d55055 tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.026169 Oct 26 13:04:50.685550 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 374/692] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:04:50 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:50.690021 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f0dc59bd-f686-40e9-8da5-8c9e5fbbc2b3 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:50.690750 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f0dc59bd-f686-40e9-8da5-8c9e5fbbc2b3 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:50.696920 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0dc59bd-f686-40e9-8da5-8c9e5fbbc2b3 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:50.697785 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0dc59bd-f686-40e9-8da5-8c9e5fbbc2b3 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:50.697785 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0dc59bd-f686-40e9-8da5-8c9e5fbbc2b3 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:50.698889 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0dc59bd-f686-40e9-8da5-8c9e5fbbc2b3 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:50.698889 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0dc59bd-f686-40e9-8da5-8c9e5fbbc2b3 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:50.699382 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0dc59bd-f686-40e9-8da5-8c9e5fbbc2b3 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:50.767936 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f0dc59bd-f686-40e9-8da5-8c9e5fbbc2b3 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:50.777173 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f0dc59bd-f686-40e9-8da5-8c9e5fbbc2b3 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:50.778663 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f0dc59bd-f686-40e9-8da5-8c9e5fbbc2b3 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:50.784035 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f0dc59bd-f686-40e9-8da5-8c9e5fbbc2b3 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] 10.222.0.40 "GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 200 len: 1446 microversion: 2.75 time: 0.097511 Oct 26 13:04:50.784620 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 375/693] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:50 2022] GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 1446 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:50.790150 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-c0d3fd4e-bc9b-457a-909f-c53afb0c0907 req-76d3d6a2-6dc9-491d-9000-20bb580ea171 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a28883a5-9f17-4514-823e-7b33a316d33c", "name": "network-vif-unplugged", "status": "completed", "tag": "aadc618b-ef02-4624-a6f3-811fbef8dddd"}, {"name": "network-changed", "server_uuid": "379653d7-e043-474c-9fdd-3d0f663caed1", "tag": "4cf33acb-9743-43dc-b7bb-9af2984d2817"}, {"name": "network-changed", "server_uuid": "a28883a5-9f17-4514-823e-7b33a316d33c", "tag": "aadc618b-ef02-4624-a6f3-811fbef8dddd"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:50.801163 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-c0d3fd4e-bc9b-457a-909f-c53afb0c0907 req-76d3d6a2-6dc9-491d-9000-20bb580ea171 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:50.801835 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-c0d3fd4e-bc9b-457a-909f-c53afb0c0907 req-76d3d6a2-6dc9-491d-9000-20bb580ea171 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:50.802101 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-c0d3fd4e-bc9b-457a-909f-c53afb0c0907 req-76d3d6a2-6dc9-491d-9000-20bb580ea171 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:50.815525 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-c0d3fd4e-bc9b-457a-909f-c53afb0c0907 req-76d3d6a2-6dc9-491d-9000-20bb580ea171 service nova] Creating event network-vif-unplugged:aadc618b-ef02-4624-a6f3-811fbef8dddd for instance a28883a5-9f17-4514-823e-7b33a316d33c on n-h1-862686-1 Oct 26 13:04:50.816033 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-c0d3fd4e-bc9b-457a-909f-c53afb0c0907 req-76d3d6a2-6dc9-491d-9000-20bb580ea171 service nova] Creating event network-changed:4cf33acb-9743-43dc-b7bb-9af2984d2817 for instance 379653d7-e043-474c-9fdd-3d0f663caed1 on n-h1-862686-1 Oct 26 13:04:50.816533 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-c0d3fd4e-bc9b-457a-909f-c53afb0c0907 req-76d3d6a2-6dc9-491d-9000-20bb580ea171 service nova] Creating event network-changed:aadc618b-ef02-4624-a6f3-811fbef8dddd for instance a28883a5-9f17-4514-823e-7b33a316d33c on n-h1-862686-1 Oct 26 13:04:50.824358 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-c0d3fd4e-bc9b-457a-909f-c53afb0c0907 req-76d3d6a2-6dc9-491d-9000-20bb580ea171 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.038490 Oct 26 13:04:50.824985 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 376/694] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:50.830384 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d460f692-d458-45ac-937c-d7bcf9197df8 tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-652621570", "id": 1669261372, "os-flavor-access:is_public": "False"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:50.849355 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d460f692-d458-45ac-937c-d7bcf9197df8 tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.022921 Oct 26 13:04:50.850429 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 377/695] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:04:50 2022] POST /compute/v2.1/flavors => generated 438 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:50.864458 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-76b4c447-6992-4b79-8e0d-ba3acf36d332 tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "baca4af5124d4fc8afd6d3324c433880"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:50.947875 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-76b4c447-6992-4b79-8e0d-ba3acf36d332 tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/1669261372/action" status: 200 len: 97 microversion: 2.1 time: 0.088536 Oct 26 13:04:50.948487 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 378/696] 10.222.0.40 () {60 vars in 1200 bytes} [Wed Oct 26 13:04:50 2022] POST /compute/v2.1/flavors/1669261372/action => generated 97 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 26 13:04:50.958826 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-77b9241e-7969-4c3d-8af2-030312915382 tempest-FlavorsAccessNegativeTestJSON-489887067 tempest-FlavorsAccessNegativeTestJSON-489887067-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "baca4af5124d4fc8afd6d3324c433880"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:50.963100 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-77b9241e-7969-4c3d-8af2-030312915382 tempest-FlavorsAccessNegativeTestJSON-489887067 tempest-FlavorsAccessNegativeTestJSON-489887067-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '8ea86714902245c8b0acca468d3568e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baca4af5124d4fc8afd6d3324c433880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:50.964941 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-77b9241e-7969-4c3d-8af2-030312915382 tempest-FlavorsAccessNegativeTestJSON-489887067 tempest-FlavorsAccessNegativeTestJSON-489887067-project] Request method failure captured: Oct 26 13:04:50.964941 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/flavors/1669261372/action HTTP/1.1 Oct 26 13:04:50.964941 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:04:50.964941 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:04:50.964941 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:04:50.964941 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 70 Oct 26 13:04:50.964941 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:04:50.964941 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:04:50.964941 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:04:50.964941 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:04:50.964941 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTBiWERMSl_-T4GqAxX_5Opj79qpGz4tDbc5io8UeeWd4g1V1U_HAS6RnK3uyWSB080L83icQgUUoL4m21uR1Rc8Ap4yMnFM_gpNAwfrnIlg-lE5Euh6-w8TeXQNIdtqE5MizoqEdAukYaVhKu8yt1iIFWsIzJFt_1oDlH7u7CG6QnU Oct 26 13:04:50.964941 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:04:50.964941 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:04:50.964941 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:04:50.964941 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:04:50.964941 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:04:50.964941 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:04:50.964941 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: baca4af5124d4fc8afd6d3324c433880 Oct 26 13:04:50.964941 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-489887067 Oct 26 13:04:50.964941 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:04:50.964941 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:04:50.966279 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/baca4af5124d4fc8afd6d3324c433880"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/baca4af5124d4fc8afd6d3324c433880"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_baca4af5124d4fc8afd6d3324c433880"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/baca4af5124d4fc8afd6d3324c433880"}]}] Oct 26 13:04:50.966279 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-489887067 Oct 26 13:04:50.966279 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: baca4af5124d4fc8afd6d3324c433880 Oct 26 13:04:50.966279 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-489887067 Oct 26 13:04:50.966279 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-FlavorsAccessNegativeTestJSON-489887067-project Oct 26 13:04:50.966279 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:04:50.966279 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:04:50.966279 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 8ea86714902245c8b0acca468d3568e5 Oct 26 13:04:50.966279 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-489887067-project Oct 26 13:04:50.966279 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:04:50.966279 n-d-862686-1 devstack@n-api.service[120598]: {"removeTenantAccess": {"tenant": "baca4af5124d4fc8afd6d3324c433880"}} Oct 26 13:04:50.966279 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:04:50.967067 n-d-862686-1 devstack@n-api.service[120598]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 26 13:04:50.967067 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '1669261372', 'body': {'removeTenantAccess': {'tenant': 'baca4af5124d4fc8afd6d3324c433880'}}} Oct 26 13:04:50.967067 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:04:50.967067 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:50.967067 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:04:50.967067 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:04:50.967067 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:04:50.967067 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:04:50.967067 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:04:50.967067 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:04:50.967067 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:04:50.967067 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:04:50.967067 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 26 13:04:50.967067 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi context.can( Oct 26 13:04:50.967067 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 13:04:50.967067 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 13:04:50.967067 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 13:04:50.967067 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 13:04:50.967067 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 13:04:50.967067 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 13:04:50.968315 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 13:04:50.968315 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 13:04:50.968315 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 13:04:50.968315 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 13:04:50.968315 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 13:04:50.968315 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 13:04:50.968315 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 13:04:50.968315 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 13:04:50.968315 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 26 13:04:50.968315 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:50.968315 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:04:50.968315 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:50.968315 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:50.968315 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:04:50.968315 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:04:50.968315 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 13:04:50.968315 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 13:04:50.968315 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 26 13:04:50.968315 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:50.969573 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-77b9241e-7969-4c3d-8af2-030312915382 tempest-FlavorsAccessNegativeTestJSON-489887067 tempest-FlavorsAccessNegativeTestJSON-489887067-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:04:50.969573 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-77b9241e-7969-4c3d-8af2-030312915382 tempest-FlavorsAccessNegativeTestJSON-489887067 tempest-FlavorsAccessNegativeTestJSON-489887067-project] 10.222.0.40 "POST /compute/v2.1/flavors/1669261372/action" status: 403 len: 133 microversion: 2.1 time: 0.011633 Oct 26 13:04:50.969573 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 379/697] 10.222.0.40 () {60 vars in 1200 bytes} [Wed Oct 26 13:04:50 2022] POST /compute/v2.1/flavors/1669261372/action => generated 133 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:04:50.975123 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-39827b2e-de51-4679-92ec-c8ac8cda962a tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "baca4af5124d4fc8afd6d3324c433880"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:51.029655 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:04:51.048425 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-39827b2e-de51-4679-92ec-c8ac8cda962a tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/1669261372/action" status: 200 len: 21 microversion: 2.1 time: 0.076936 Oct 26 13:04:51.049019 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 380/698] 10.222.0.40 () {60 vars in 1200 bytes} [Wed Oct 26 13:04:50 2022] POST /compute/v2.1/flavors/1669261372/action => generated 21 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:04:51.059016 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2a540b1c-bd83-4660-ae25-bd285471612b tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:51.069738 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=87,nova_api:DELETE=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:04:51.077447 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2a540b1c-bd83-4660-ae25-bd285471612b tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1669261372" status: 202 len: 0 microversion: 2.1 time: 0.022249 Oct 26 13:04:51.078419 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 381/699] 10.222.0.40 () {58 vars in 1161 bytes} [Wed Oct 26 13:04:51 2022] DELETE /compute/v2.1/flavors/1669261372 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 13:04:51.086085 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b62f619a-8254-462c-9b92-445a44966b6b tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:51.108864 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b62f619a-8254-462c-9b92-445a44966b6b tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.026551 Oct 26 13:04:51.109854 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 382/700] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:04:51 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:04:51.130106 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cd8b5c02-e27a-4dfc-aa99-5865a56b9a0a tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1058942944", "id": 113450421, "os-flavor-access:is_public": "False"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:51.148251 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cd8b5c02-e27a-4dfc-aa99-5865a56b9a0a tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.021848 Oct 26 13:04:51.149080 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 383/701] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:04:51 2022] POST /compute/v2.1/flavors => generated 436 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:51.161344 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c328e10d-90a9-40e8-8a9b-e846b8601605 tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2194729cbfdf4f32848bc44b1a54a184"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:51.223560 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-c328e10d-90a9-40e8-8a9b-e846b8601605 tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] HTTP exception thrown: Flavor access not found for 39 / 2194729cbfdf4f32848bc44b1a54a184 combination. Oct 26 13:04:51.225449 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c328e10d-90a9-40e8-8a9b-e846b8601605 tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] Request method failure captured: Oct 26 13:04:51.225449 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/flavors/113450421/action HTTP/1.1 Oct 26 13:04:51.225449 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:04:51.225449 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:04:51.225449 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:04:51.225449 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 70 Oct 26 13:04:51.225449 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:04:51.225449 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:04:51.225449 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:04:51.225449 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:04:51.225449 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTBjz7Ob92vI8y9nVsPziDCdgyCdrZDFJEJj3VDIB6QRF0O51WGHUqwqMrWG-Ag_mqGjpbhd-IeyG8qGnK_ssxP7bK82kDy7LxeoIrk9wXV92vFHRD8B7Q5FmP5PrBnVTJZ-rwEGNT1lbW7wCHXy6BQ9NMTz0ToQ5Pkh1-vbY2StBP0 Oct 26 13:04:51.225449 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:04:51.225449 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:04:51.225449 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:04:51.225449 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:04:51.225449 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:04:51.225449 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:04:51.225449 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: fc733493a2fc4ef39d4c546bcc305ba2 Oct 26 13:04:51.225449 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1352174068 Oct 26 13:04:51.225449 n-d-862686-1 devstack@n-api.service[120598]: X-Role: admin,member,reader Oct 26 13:04:51.225449 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: admin,member,reader Oct 26 13:04:51.227272 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fc733493a2fc4ef39d4c546bcc305ba2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fc733493a2fc4ef39d4c546bcc305ba2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fc733493a2fc4ef39d4c546bcc305ba2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fc733493a2fc4ef39d4c546bcc305ba2"}]}] Oct 26 13:04:51.227272 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1352174068 Oct 26 13:04:51.227272 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: fc733493a2fc4ef39d4c546bcc305ba2 Oct 26 13:04:51.227272 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1352174068 Oct 26 13:04:51.227272 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin Oct 26 13:04:51.227272 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:04:51.227272 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:04:51.227272 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: c4602331e2ba4f8f84c8e9d32ac7ea2b Oct 26 13:04:51.227272 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin Oct 26 13:04:51.227272 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:04:51.227272 n-d-862686-1 devstack@n-api.service[120598]: {"removeTenantAccess": {"tenant": "2194729cbfdf4f32848bc44b1a54a184"}} Oct 26 13:04:51.227272 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:04:51.228099 n-d-862686-1 devstack@n-api.service[120598]: exception: Flavor access not found for 39 / 2194729cbfdf4f32848bc44b1a54a184 combination. Oct 26 13:04:51.228099 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '113450421', 'body': {'removeTenantAccess': {'tenant': '2194729cbfdf4f32848bc44b1a54a184'}}} Oct 26 13:04:51.228099 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:04:51.228099 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:51.228099 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 26 13:04:51.228099 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 26 13:04:51.228099 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 26 13:04:51.228099 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 26 13:04:51.228099 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 26 13:04:51.228099 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 26 13:04:51.228099 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 26 13:04:51.228099 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 26 13:04:51.228099 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 26 13:04:51.228099 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 26 13:04:51.228099 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 13:04:51.228099 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 13:04:51.228099 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 26 13:04:51.228099 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 26 13:04:51.229202 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 39 / 2194729cbfdf4f32848bc44b1a54a184 combination. Oct 26 13:04:51.229202 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:51.229202 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:04:51.229202 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:51.229202 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:51.229202 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:04:51.229202 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:04:51.229202 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:04:51.229202 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:04:51.229202 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:04:51.229202 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:04:51.229202 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:04:51.229202 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:04:51.229202 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 26 13:04:51.229202 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:04:51.229202 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 39 / 2194729cbfdf4f32848bc44b1a54a184 combination. Oct 26 13:04:51.229202 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:51.229202 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:04:51.229202 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:51.229202 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:51.230470 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:04:51.230470 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:04:51.230470 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:04:51.230470 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:04:51.230470 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 39 / 2194729cbfdf4f32848bc44b1a54a184 combination. Oct 26 13:04:51.230470 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:51.230470 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c328e10d-90a9-40e8-8a9b-e846b8601605 tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] Returning 404 to user: Flavor access not found for 39 / 2194729cbfdf4f32848bc44b1a54a184 combination. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:04:51.230470 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c328e10d-90a9-40e8-8a9b-e846b8601605 tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/113450421/action" status: 404 len: 124 microversion: 2.1 time: 0.069273 Oct 26 13:04:51.230470 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 384/702] 10.222.0.40 () {60 vars in 1197 bytes} [Wed Oct 26 13:04:51 2022] POST /compute/v2.1/flavors/113450421/action => generated 124 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 13:04:51.237939 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-762a6944-2950-4abd-ae73-f7a548d6436d tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:51.243983 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:04:51.255285 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-762a6944-2950-4abd-ae73-f7a548d6436d tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/113450421" status: 202 len: 0 microversion: 2.1 time: 0.022300 Oct 26 13:04:51.255864 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 385/703] 10.222.0.40 () {58 vars in 1158 bytes} [Wed Oct 26 13:04:51 2022] DELETE /compute/v2.1/flavors/113450421 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 13:04:51.264844 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6bee9c2f-b49a-48c9-a092-37a96c2b7f0f tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:51.287264 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6bee9c2f-b49a-48c9-a092-37a96c2b7f0f tempest-FlavorsAccessNegativeTestJSON-1352174068 tempest-FlavorsAccessNegativeTestJSON-1352174068-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.026583 Oct 26 13:04:51.287850 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 386/704] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:04:51 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:04:51.349426 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-66674b59-78e0-4543-a53a-e6211c368ba5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:51.350351 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-66674b59-78e0-4543-a53a-e6211c368ba5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 025e46ee-bd4b-4c43-96ce-ee086ecafe24] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:51.357946 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-66674b59-78e0-4543-a53a-e6211c368ba5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:51.358640 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-66674b59-78e0-4543-a53a-e6211c368ba5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:51.359279 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-66674b59-78e0-4543-a53a-e6211c368ba5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:51.360138 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-66674b59-78e0-4543-a53a-e6211c368ba5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:51.360653 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-66674b59-78e0-4543-a53a-e6211c368ba5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:51.361031 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-66674b59-78e0-4543-a53a-e6211c368ba5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:51.507818 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-66674b59-78e0-4543-a53a-e6211c368ba5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:51.518660 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-66674b59-78e0-4543-a53a-e6211c368ba5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/025e46ee-bd4b-4c43-96ce-ee086ecafe24" status: 200 len: 1319 microversion: 2.1 time: 0.174158 Oct 26 13:04:51.519350 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 387/705] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:51 2022] GET /compute/v2.1/servers/025e46ee-bd4b-4c43-96ce-ee086ecafe24 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:04:51.527801 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-31a07569-85ee-4305-821d-d1ed47f1b0c2 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:51.529613 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-31a07569-85ee-4305-821d-d1ed47f1b0c2 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 7da4bb85-b577-4608-a7c0-3320721cb997] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:51.536457 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31a07569-85ee-4305-821d-d1ed47f1b0c2 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:51.537170 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31a07569-85ee-4305-821d-d1ed47f1b0c2 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:51.538476 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31a07569-85ee-4305-821d-d1ed47f1b0c2 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:51.539728 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31a07569-85ee-4305-821d-d1ed47f1b0c2 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:51.540425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31a07569-85ee-4305-821d-d1ed47f1b0c2 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:51.540961 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31a07569-85ee-4305-821d-d1ed47f1b0c2 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:51.711668 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-31a07569-85ee-4305-821d-d1ed47f1b0c2 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:51.720360 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-31a07569-85ee-4305-821d-d1ed47f1b0c2 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997" status: 200 len: 1476 microversion: 2.1 time: 0.199233 Oct 26 13:04:51.721215 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 388/706] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:51 2022] GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997 => generated 1476 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:51.725759 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ef271dab-8b71-4a56-8f8d-9db7b5381aba tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:51.726465 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ef271dab-8b71-4a56-8f8d-9db7b5381aba tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: a28883a5-9f17-4514-823e-7b33a316d33c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:51.738915 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef271dab-8b71-4a56-8f8d-9db7b5381aba tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:51.739944 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef271dab-8b71-4a56-8f8d-9db7b5381aba tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:51.740929 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef271dab-8b71-4a56-8f8d-9db7b5381aba tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:51.741761 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef271dab-8b71-4a56-8f8d-9db7b5381aba tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:51.743302 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef271dab-8b71-4a56-8f8d-9db7b5381aba tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:51.743572 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef271dab-8b71-4a56-8f8d-9db7b5381aba tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:51.788295 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=8 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:04:51.937114 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ef271dab-8b71-4a56-8f8d-9db7b5381aba tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:51.946872 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ef271dab-8b71-4a56-8f8d-9db7b5381aba tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:51.948570 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ef271dab-8b71-4a56-8f8d-9db7b5381aba tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:51.965326 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ef271dab-8b71-4a56-8f8d-9db7b5381aba tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c" status: 200 len: 1567 microversion: 2.25 time: 0.240309 Oct 26 13:04:51.966630 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 389/707] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:51 2022] GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c => generated 1567 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:51.971537 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-15781ffa-9235-4be4-92e2-cd54ca7b89f8 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:51.972142 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-15781ffa-9235-4be4-92e2-cd54ca7b89f8 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: 379653d7-e043-474c-9fdd-3d0f663caed1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:51.999341 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15781ffa-9235-4be4-92e2-cd54ca7b89f8 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:51.999989 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15781ffa-9235-4be4-92e2-cd54ca7b89f8 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:52.000609 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15781ffa-9235-4be4-92e2-cd54ca7b89f8 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:52.001539 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15781ffa-9235-4be4-92e2-cd54ca7b89f8 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:52.002162 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15781ffa-9235-4be4-92e2-cd54ca7b89f8 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:52.002852 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15781ffa-9235-4be4-92e2-cd54ca7b89f8 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:52.231824 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-15781ffa-9235-4be4-92e2-cd54ca7b89f8 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241a2299894849c889ee7f1100a9823d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec66df09b6114f5dbd6678d5e848c737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:52.243362 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:04:52.247703 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-15781ffa-9235-4be4-92e2-cd54ca7b89f8 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] 10.222.0.40 "GET /compute/v2.1/servers/379653d7-e043-474c-9fdd-3d0f663caed1" status: 200 len: 1324 microversion: 2.1 time: 0.279677 Oct 26 13:04:52.248953 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 390/708] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:51 2022] GET /compute/v2.1/servers/379653d7-e043-474c-9fdd-3d0f663caed1 => generated 1324 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:52.272584 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-26bb59ba-c8fb-4cba-bd09-35e65197ca79 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:52.274271 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-26bb59ba-c8fb-4cba-bd09-35e65197ca79 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:52.287769 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26bb59ba-c8fb-4cba-bd09-35e65197ca79 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:52.290214 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26bb59ba-c8fb-4cba-bd09-35e65197ca79 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:52.291012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26bb59ba-c8fb-4cba-bd09-35e65197ca79 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:52.293120 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26bb59ba-c8fb-4cba-bd09-35e65197ca79 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:52.293526 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26bb59ba-c8fb-4cba-bd09-35e65197ca79 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:52.293974 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26bb59ba-c8fb-4cba-bd09-35e65197ca79 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:52.402955 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-26bb59ba-c8fb-4cba-bd09-35e65197ca79 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:52.413203 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-26bb59ba-c8fb-4cba-bd09-35e65197ca79 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:52.416013 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-26bb59ba-c8fb-4cba-bd09-35e65197ca79 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:52.421540 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-26bb59ba-c8fb-4cba-bd09-35e65197ca79 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] 10.222.0.40 "GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 200 len: 1446 microversion: 2.75 time: 0.170761 Oct 26 13:04:52.422302 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 391/709] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:52 2022] GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 1446 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:52.545679 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f9bfffa1-2815-4e03-bb0a-d33091118616 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:52.546423 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f9bfffa1-2815-4e03-bb0a-d33091118616 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 025e46ee-bd4b-4c43-96ce-ee086ecafe24] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:52.555664 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f9bfffa1-2815-4e03-bb0a-d33091118616 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:52.556382 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f9bfffa1-2815-4e03-bb0a-d33091118616 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:52.556965 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f9bfffa1-2815-4e03-bb0a-d33091118616 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:52.557936 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f9bfffa1-2815-4e03-bb0a-d33091118616 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:52.558482 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f9bfffa1-2815-4e03-bb0a-d33091118616 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:52.559000 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f9bfffa1-2815-4e03-bb0a-d33091118616 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:52.780079 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f9bfffa1-2815-4e03-bb0a-d33091118616 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:52.787950 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f9bfffa1-2815-4e03-bb0a-d33091118616 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/025e46ee-bd4b-4c43-96ce-ee086ecafe24" status: 200 len: 1319 microversion: 2.1 time: 0.247047 Oct 26 13:04:52.789577 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 392/710] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:52 2022] GET /compute/v2.1/servers/025e46ee-bd4b-4c43-96ce-ee086ecafe24 => generated 1319 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:04:52.794442 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3bd85efd-a826-4c4b-9366-562b767ac62c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:52.795054 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3bd85efd-a826-4c4b-9366-562b767ac62c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 7da4bb85-b577-4608-a7c0-3320721cb997] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:52.802438 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bd85efd-a826-4c4b-9366-562b767ac62c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:52.803028 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bd85efd-a826-4c4b-9366-562b767ac62c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:52.804044 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bd85efd-a826-4c4b-9366-562b767ac62c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:52.804856 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bd85efd-a826-4c4b-9366-562b767ac62c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:52.805402 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bd85efd-a826-4c4b-9366-562b767ac62c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:52.806066 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bd85efd-a826-4c4b-9366-562b767ac62c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:53.011177 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3bd85efd-a826-4c4b-9366-562b767ac62c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:53.022741 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3bd85efd-a826-4c4b-9366-562b767ac62c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997" status: 200 len: 1476 microversion: 2.1 time: 0.231977 Oct 26 13:04:53.023334 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 393/711] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:52 2022] GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997 => generated 1476 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:53.042940 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2ab99176-9132-4636-80c1-078ef64a4bcb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:53.043560 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2ab99176-9132-4636-80c1-078ef64a4bcb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: a28883a5-9f17-4514-823e-7b33a316d33c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:53.067289 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ab99176-9132-4636-80c1-078ef64a4bcb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:53.067801 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ab99176-9132-4636-80c1-078ef64a4bcb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:53.068258 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ab99176-9132-4636-80c1-078ef64a4bcb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:53.068974 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ab99176-9132-4636-80c1-078ef64a4bcb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:53.071492 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ab99176-9132-4636-80c1-078ef64a4bcb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:53.072174 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ab99176-9132-4636-80c1-078ef64a4bcb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:53.256550 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2ab99176-9132-4636-80c1-078ef64a4bcb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:53.270441 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2ab99176-9132-4636-80c1-078ef64a4bcb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:53.271700 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2ab99176-9132-4636-80c1-078ef64a4bcb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:53.272894 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2ab99176-9132-4636-80c1-078ef64a4bcb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c" status: 200 len: 1567 microversion: 2.25 time: 0.247232 Oct 26 13:04:53.297970 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 394/712] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:53 2022] GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c => generated 1567 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:53.309340 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8c241cd5-b919-455c-bd2e-669b2f48aaa7 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:53.311457 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8c241cd5-b919-455c-bd2e-669b2f48aaa7 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: 379653d7-e043-474c-9fdd-3d0f663caed1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:53.327636 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8c241cd5-b919-455c-bd2e-669b2f48aaa7 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:53.328145 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8c241cd5-b919-455c-bd2e-669b2f48aaa7 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:53.328621 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8c241cd5-b919-455c-bd2e-669b2f48aaa7 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:53.329348 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8c241cd5-b919-455c-bd2e-669b2f48aaa7 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:53.329850 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8c241cd5-b919-455c-bd2e-669b2f48aaa7 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:53.330276 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8c241cd5-b919-455c-bd2e-669b2f48aaa7 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:53.656545 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8c241cd5-b919-455c-bd2e-669b2f48aaa7 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241a2299894849c889ee7f1100a9823d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec66df09b6114f5dbd6678d5e848c737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:53.668707 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8c241cd5-b919-455c-bd2e-669b2f48aaa7 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] 10.222.0.40 "GET /compute/v2.1/servers/379653d7-e043-474c-9fdd-3d0f663caed1" status: 200 len: 1324 microversion: 2.1 time: 0.368598 Oct 26 13:04:53.670492 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 395/713] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:53 2022] GET /compute/v2.1/servers/379653d7-e043-474c-9fdd-3d0f663caed1 => generated 1324 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:53.676847 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-19c4bf67-224c-4bdf-9295-873096946056 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:53.677764 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-19c4bf67-224c-4bdf-9295-873096946056 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] [instance: 480f7c70-2963-4887-b8f8-ea3737880136] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:53.685347 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-19c4bf67-224c-4bdf-9295-873096946056 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:53.686180 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-19c4bf67-224c-4bdf-9295-873096946056 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:53.687024 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-19c4bf67-224c-4bdf-9295-873096946056 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:53.687986 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-19c4bf67-224c-4bdf-9295-873096946056 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:53.688656 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-19c4bf67-224c-4bdf-9295-873096946056 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:53.689339 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-19c4bf67-224c-4bdf-9295-873096946056 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:53.907366 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-19c4bf67-224c-4bdf-9295-873096946056 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f9391046054747bbfc1c3e6d65d4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10521abb1c34417fa9369aaba9070968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:53.918289 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-19c4bf67-224c-4bdf-9295-873096946056 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] 10.222.0.40 "GET /compute/v2.1/servers/480f7c70-2963-4887-b8f8-ea3737880136" status: 200 len: 1586 microversion: 2.1 time: 0.245848 Oct 26 13:04:53.919944 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 396/714] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:53 2022] GET /compute/v2.1/servers/480f7c70-2963-4887-b8f8-ea3737880136 => generated 1586 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:53.945060 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-363cee35-6448-44a5-ab6c-d513cf89f838 req-9de14d20-8512-448f-9e07-fb04c0aeeade service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "480f7c70-2963-4887-b8f8-ea3737880136", "tag": "f46f1d3b-c223-4e80-8cb0-2fc5b785324f"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:53.960265 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-363cee35-6448-44a5-ab6c-d513cf89f838 req-9de14d20-8512-448f-9e07-fb04c0aeeade service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:53.961084 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-363cee35-6448-44a5-ab6c-d513cf89f838 req-9de14d20-8512-448f-9e07-fb04c0aeeade service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:53.961863 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-363cee35-6448-44a5-ab6c-d513cf89f838 req-9de14d20-8512-448f-9e07-fb04c0aeeade service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:53.975162 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-363cee35-6448-44a5-ab6c-d513cf89f838 req-9de14d20-8512-448f-9e07-fb04c0aeeade service nova] Creating event network-changed:f46f1d3b-c223-4e80-8cb0-2fc5b785324f for instance 480f7c70-2963-4887-b8f8-ea3737880136 on n-h1-862686-1 Oct 26 13:04:53.982410 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-363cee35-6448-44a5-ab6c-d513cf89f838 req-9de14d20-8512-448f-9e07-fb04c0aeeade service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045511 Oct 26 13:04:53.983652 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 397/715] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:53.991507 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a963b085-1b95-4ab1-878e-b6390800f6ce tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:53.993008 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a963b085-1b95-4ab1-878e-b6390800f6ce tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:53.999925 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a963b085-1b95-4ab1-878e-b6390800f6ce tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:54.001271 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a963b085-1b95-4ab1-878e-b6390800f6ce tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:54.001947 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a963b085-1b95-4ab1-878e-b6390800f6ce tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:54.002908 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a963b085-1b95-4ab1-878e-b6390800f6ce tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:54.003569 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a963b085-1b95-4ab1-878e-b6390800f6ce tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:54.004572 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a963b085-1b95-4ab1-878e-b6390800f6ce tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:54.191168 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a963b085-1b95-4ab1-878e-b6390800f6ce tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:54.205408 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a963b085-1b95-4ab1-878e-b6390800f6ce tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:54.208310 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a963b085-1b95-4ab1-878e-b6390800f6ce tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:54.217816 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a963b085-1b95-4ab1-878e-b6390800f6ce tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] 10.222.0.40 "GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 200 len: 1446 microversion: 2.75 time: 0.232630 Oct 26 13:04:54.241870 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 398/716] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:53 2022] GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 1446 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:54.250144 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-566afff5-8324-4c40-b66b-de86c95aea58 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:54.251093 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-566afff5-8324-4c40-b66b-de86c95aea58 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 025e46ee-bd4b-4c43-96ce-ee086ecafe24] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:54.257638 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-566afff5-8324-4c40-b66b-de86c95aea58 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:54.258833 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-566afff5-8324-4c40-b66b-de86c95aea58 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:54.259676 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-566afff5-8324-4c40-b66b-de86c95aea58 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:54.260535 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-566afff5-8324-4c40-b66b-de86c95aea58 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:54.261152 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-566afff5-8324-4c40-b66b-de86c95aea58 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:54.261756 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-566afff5-8324-4c40-b66b-de86c95aea58 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:54.514659 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-63fdee26-632b-4fa7-8091-12d9add003c4 tempest-FloatingIPDetailsTestJSON-988510931 tempest-FloatingIPDetailsTestJSON-988510931-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.965599 Oct 26 13:04:54.517966 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 319/717] 10.222.0.40 () {60 vars in 1170 bytes} [Wed Oct 26 13:04:50 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3970 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:54.525594 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d3dea63a-d845-4f27-bb6e-bfe3ab2c70ef tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:54.534803 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d3dea63a-d845-4f27-bb6e-bfe3ab2c70ef tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 7da4bb85-b577-4608-a7c0-3320721cb997] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:54.538129 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-566afff5-8324-4c40-b66b-de86c95aea58 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:54.548215 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-566afff5-8324-4c40-b66b-de86c95aea58 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/025e46ee-bd4b-4c43-96ce-ee086ecafe24" status: 200 len: 1319 microversion: 2.1 time: 0.303721 Oct 26 13:04:54.548786 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d3dea63a-d845-4f27-bb6e-bfe3ab2c70ef tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:54.549509 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d3dea63a-d845-4f27-bb6e-bfe3ab2c70ef tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:54.550282 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d3dea63a-d845-4f27-bb6e-bfe3ab2c70ef tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:54.551180 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 399/718] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:54 2022] GET /compute/v2.1/servers/025e46ee-bd4b-4c43-96ce-ee086ecafe24 => generated 1319 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:54.552064 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d3dea63a-d845-4f27-bb6e-bfe3ab2c70ef tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:54.552881 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d3dea63a-d845-4f27-bb6e-bfe3ab2c70ef tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:54.553658 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d3dea63a-d845-4f27-bb6e-bfe3ab2c70ef tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:54.567003 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5b55af68-e5e5-495d-9904-1a746456b168 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:54.567597 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5b55af68-e5e5-495d-9904-1a746456b168 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: a28883a5-9f17-4514-823e-7b33a316d33c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:54.584463 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b55af68-e5e5-495d-9904-1a746456b168 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:54.585096 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b55af68-e5e5-495d-9904-1a746456b168 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:54.585834 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b55af68-e5e5-495d-9904-1a746456b168 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:54.589163 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b55af68-e5e5-495d-9904-1a746456b168 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:54.591117 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b55af68-e5e5-495d-9904-1a746456b168 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:54.591700 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b55af68-e5e5-495d-9904-1a746456b168 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:54.874250 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d3dea63a-d845-4f27-bb6e-bfe3ab2c70ef tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:54.875642 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5b55af68-e5e5-495d-9904-1a746456b168 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:54.886599 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d3dea63a-d845-4f27-bb6e-bfe3ab2c70ef tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997" status: 200 len: 1476 microversion: 2.1 time: 0.367027 Oct 26 13:04:54.888483 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5b55af68-e5e5-495d-9904-1a746456b168 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:54.890872 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 320/719] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:54 2022] GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997 => generated 1476 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:54.892667 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5b55af68-e5e5-495d-9904-1a746456b168 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:54.895209 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5b55af68-e5e5-495d-9904-1a746456b168 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c" status: 200 len: 1567 microversion: 2.25 time: 0.341624 Oct 26 13:04:54.896071 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 400/720] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:54 2022] GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c => generated 1567 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:54.900740 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-f5ef4905-bc3f-4f6a-bc48-d90bee89f68b req-43b6b117-c9f7-48c2-856d-7fa1af08d802 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60c4cea5-3b00-4614-a70d-e3fd589cc408", "name": "network-vif-plugged", "status": "completed", "tag": "79a7de1e-4128-41b8-bbb9-aea414b689c4"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:54.924104 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bfa164ce-0b82-42fd-95f3-97382f724c60 tempest-FloatingIPDetailsTestJSON-988510931 tempest-FloatingIPDetailsTestJSON-988510931-project] Calling method '.version_select at 0x7f6732b89af0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:54.932287 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-f5ef4905-bc3f-4f6a-bc48-d90bee89f68b req-43b6b117-c9f7-48c2-856d-7fa1af08d802 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:54.932888 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-f5ef4905-bc3f-4f6a-bc48-d90bee89f68b req-43b6b117-c9f7-48c2-856d-7fa1af08d802 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:54.933545 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-f5ef4905-bc3f-4f6a-bc48-d90bee89f68b req-43b6b117-c9f7-48c2-856d-7fa1af08d802 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:54.954293 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-f5ef4905-bc3f-4f6a-bc48-d90bee89f68b req-43b6b117-c9f7-48c2-856d-7fa1af08d802 service nova] Creating event network-vif-plugged:79a7de1e-4128-41b8-bbb9-aea414b689c4 for instance 60c4cea5-3b00-4614-a70d-e3fd589cc408 on n-h2-862686-1 Oct 26 13:04:54.964903 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-f5ef4905-bc3f-4f6a-bc48-d90bee89f68b req-43b6b117-c9f7-48c2-856d-7fa1af08d802 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071890 Oct 26 13:04:54.972742 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 321/721] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:54.987734 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a5ba9554-2aeb-43d6-8cae-3bed23e86f9d tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:54.991352 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a5ba9554-2aeb-43d6-8cae-3bed23e86f9d tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: 379653d7-e043-474c-9fdd-3d0f663caed1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:55.009775 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5ba9554-2aeb-43d6-8cae-3bed23e86f9d tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:55.011041 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5ba9554-2aeb-43d6-8cae-3bed23e86f9d tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:55.014843 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5ba9554-2aeb-43d6-8cae-3bed23e86f9d tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:55.015655 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5ba9554-2aeb-43d6-8cae-3bed23e86f9d tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:55.016262 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5ba9554-2aeb-43d6-8cae-3bed23e86f9d tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:55.016880 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5ba9554-2aeb-43d6-8cae-3bed23e86f9d tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:55.233240 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bfa164ce-0b82-42fd-95f3-97382f724c60 tempest-FloatingIPDetailsTestJSON-988510931 tempest-FloatingIPDetailsTestJSON-988510931-project] 10.222.0.40 "GET /compute/v2.1/os-floating-ips/00ffbf85-1810-4289-94cf-b808934abccc" status: 200 len: 142 microversion: 2.1 time: 0.320626 Oct 26 13:04:55.242055 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 401/722] 10.222.0.40 () {58 vars in 1260 bytes} [Wed Oct 26 13:04:54 2022] GET /compute/v2.1/os-floating-ips/00ffbf85-1810-4289-94cf-b808934abccc => generated 142 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:55.249424 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d884d3ad-6f7a-409c-a718-552676f6941d tempest-FloatingIPDetailsTestJSON-988510931 tempest-FloatingIPDetailsTestJSON-988510931-project] Calling method '.version_select at 0x7f6732981940>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:55.285571 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a5ba9554-2aeb-43d6-8cae-3bed23e86f9d tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241a2299894849c889ee7f1100a9823d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec66df09b6114f5dbd6678d5e848c737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:55.296456 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a5ba9554-2aeb-43d6-8cae-3bed23e86f9d tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] 10.222.0.40 "GET /compute/v2.1/servers/379653d7-e043-474c-9fdd-3d0f663caed1" status: 200 len: 1324 microversion: 2.1 time: 0.320899 Oct 26 13:04:55.296916 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 322/723] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:54 2022] GET /compute/v2.1/servers/379653d7-e043-474c-9fdd-3d0f663caed1 => generated 1324 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:55.302618 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6e5aa635-56bc-4fe6-a28f-0b9dcb78f1f0 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:55.303501 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6e5aa635-56bc-4fe6-a28f-0b9dcb78f1f0 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:55.311632 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e5aa635-56bc-4fe6-a28f-0b9dcb78f1f0 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:55.312411 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e5aa635-56bc-4fe6-a28f-0b9dcb78f1f0 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:55.313088 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e5aa635-56bc-4fe6-a28f-0b9dcb78f1f0 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:55.314023 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e5aa635-56bc-4fe6-a28f-0b9dcb78f1f0 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:55.314673 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e5aa635-56bc-4fe6-a28f-0b9dcb78f1f0 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:55.315316 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e5aa635-56bc-4fe6-a28f-0b9dcb78f1f0 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:55.431276 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6e5aa635-56bc-4fe6-a28f-0b9dcb78f1f0 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:55.441674 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6e5aa635-56bc-4fe6-a28f-0b9dcb78f1f0 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:55.443402 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6e5aa635-56bc-4fe6-a28f-0b9dcb78f1f0 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:55.451648 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6e5aa635-56bc-4fe6-a28f-0b9dcb78f1f0 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] 10.222.0.40 "GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 200 len: 1446 microversion: 2.75 time: 0.153354 Oct 26 13:04:55.465539 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 323/724] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:55 2022] GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 1446 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:55.574854 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c1b6aaf2-ac8e-497e-9528-e039e9bf6596 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:55.575453 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c1b6aaf2-ac8e-497e-9528-e039e9bf6596 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 025e46ee-bd4b-4c43-96ce-ee086ecafe24] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:55.585066 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c1b6aaf2-ac8e-497e-9528-e039e9bf6596 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:55.587458 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c1b6aaf2-ac8e-497e-9528-e039e9bf6596 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:55.591627 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c1b6aaf2-ac8e-497e-9528-e039e9bf6596 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:55.592588 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c1b6aaf2-ac8e-497e-9528-e039e9bf6596 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:55.593333 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c1b6aaf2-ac8e-497e-9528-e039e9bf6596 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:55.593975 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c1b6aaf2-ac8e-497e-9528-e039e9bf6596 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:55.868301 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c1b6aaf2-ac8e-497e-9528-e039e9bf6596 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:55.888120 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c1b6aaf2-ac8e-497e-9528-e039e9bf6596 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/025e46ee-bd4b-4c43-96ce-ee086ecafe24" status: 200 len: 1319 microversion: 2.1 time: 0.318399 Oct 26 13:04:55.889405 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 324/725] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:55 2022] GET /compute/v2.1/servers/025e46ee-bd4b-4c43-96ce-ee086ecafe24 => generated 1319 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:04:55.916229 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d270382c-40db-4b9b-93d8-781bc48e6837 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:55.916840 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d270382c-40db-4b9b-93d8-781bc48e6837 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 7da4bb85-b577-4608-a7c0-3320721cb997] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:55.929145 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d270382c-40db-4b9b-93d8-781bc48e6837 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:55.929675 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d270382c-40db-4b9b-93d8-781bc48e6837 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:55.930686 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d270382c-40db-4b9b-93d8-781bc48e6837 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:55.931396 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d270382c-40db-4b9b-93d8-781bc48e6837 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:55.931851 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d270382c-40db-4b9b-93d8-781bc48e6837 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:55.932277 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d270382c-40db-4b9b-93d8-781bc48e6837 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:56.142662 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d270382c-40db-4b9b-93d8-781bc48e6837 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:56.151219 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d270382c-40db-4b9b-93d8-781bc48e6837 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997" status: 200 len: 1476 microversion: 2.1 time: 0.239103 Oct 26 13:04:56.152326 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 325/726] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:55 2022] GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997 => generated 1476 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:04:56.157069 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-111d2852-0dc6-4867-87a9-c519a81ed17c tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:56.157852 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-111d2852-0dc6-4867-87a9-c519a81ed17c tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: a28883a5-9f17-4514-823e-7b33a316d33c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:56.165334 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-111d2852-0dc6-4867-87a9-c519a81ed17c tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:56.166061 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-111d2852-0dc6-4867-87a9-c519a81ed17c tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:56.167057 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-111d2852-0dc6-4867-87a9-c519a81ed17c tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:56.168255 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-111d2852-0dc6-4867-87a9-c519a81ed17c tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:56.169002 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-111d2852-0dc6-4867-87a9-c519a81ed17c tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:56.169432 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-111d2852-0dc6-4867-87a9-c519a81ed17c tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:56.265274 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d884d3ad-6f7a-409c-a718-552676f6941d tempest-FloatingIPDetailsTestJSON-988510931 tempest-FloatingIPDetailsTestJSON-988510931-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/00ffbf85-1810-4289-94cf-b808934abccc" status: 202 len: 0 microversion: 2.1 time: 1.020854 Oct 26 13:04:56.270310 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 402/727] 10.222.0.40 () {58 vars in 1263 bytes} [Wed Oct 26 13:04:55 2022] DELETE /compute/v2.1/os-floating-ips/00ffbf85-1810-4289-94cf-b808934abccc => generated 0 bytes in 1027 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 13:04:56.276287 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8e5bfff6-9ae9-47ae-80f5-5f1f5ee7a9d6 tempest-FloatingIPDetailsTestJSON-988510931 tempest-FloatingIPDetailsTestJSON-988510931-project] Calling method '.version_select at 0x7f6732981af0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:56.343419 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-111d2852-0dc6-4867-87a9-c519a81ed17c tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:56.352604 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-111d2852-0dc6-4867-87a9-c519a81ed17c tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:56.354092 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-111d2852-0dc6-4867-87a9-c519a81ed17c tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:56.355254 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-111d2852-0dc6-4867-87a9-c519a81ed17c tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c" status: 200 len: 1567 microversion: 2.25 time: 0.201707 Oct 26 13:04:56.365512 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 326/728] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:56 2022] GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c => generated 1567 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:56.365512 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9a416d4b-e5ad-42cf-8c66-438196c5f2f6 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:56.365512 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9a416d4b-e5ad-42cf-8c66-438196c5f2f6 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: 379653d7-e043-474c-9fdd-3d0f663caed1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:56.369531 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9a416d4b-e5ad-42cf-8c66-438196c5f2f6 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:56.369531 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9a416d4b-e5ad-42cf-8c66-438196c5f2f6 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:56.369794 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9a416d4b-e5ad-42cf-8c66-438196c5f2f6 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:56.370427 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9a416d4b-e5ad-42cf-8c66-438196c5f2f6 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:56.370880 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9a416d4b-e5ad-42cf-8c66-438196c5f2f6 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:56.371295 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9a416d4b-e5ad-42cf-8c66-438196c5f2f6 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:56.633672 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9a416d4b-e5ad-42cf-8c66-438196c5f2f6 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241a2299894849c889ee7f1100a9823d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec66df09b6114f5dbd6678d5e848c737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:56.641941 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9a416d4b-e5ad-42cf-8c66-438196c5f2f6 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] 10.222.0.40 "GET /compute/v2.1/servers/379653d7-e043-474c-9fdd-3d0f663caed1" status: 200 len: 1324 microversion: 2.1 time: 0.284674 Oct 26 13:04:56.653758 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 327/729] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:56 2022] GET /compute/v2.1/servers/379653d7-e043-474c-9fdd-3d0f663caed1 => generated 1324 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:56.659288 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-822e3157-8442-4847-aa9c-423eeaf5088e tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:56.660997 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-822e3157-8442-4847-aa9c-423eeaf5088e tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:56.672790 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-822e3157-8442-4847-aa9c-423eeaf5088e tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:56.677723 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-822e3157-8442-4847-aa9c-423eeaf5088e tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:56.678547 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-822e3157-8442-4847-aa9c-423eeaf5088e tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:56.679500 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-822e3157-8442-4847-aa9c-423eeaf5088e tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:56.680145 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-822e3157-8442-4847-aa9c-423eeaf5088e tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:56.680864 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-822e3157-8442-4847-aa9c-423eeaf5088e tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:56.732934 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8e5bfff6-9ae9-47ae-80f5-5f1f5ee7a9d6 tempest-FloatingIPDetailsTestJSON-988510931 tempest-FloatingIPDetailsTestJSON-988510931-project] 10.222.0.40 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.460450 Oct 26 13:04:56.738990 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 403/730] 10.222.0.40 () {58 vars in 1164 bytes} [Wed Oct 26 13:04:56 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:04:56.746431 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1cb8ff22-5589-430c-81d1-b98d6e7c2cfc tempest-FloatingIPDetailsTestJSON-988510931 tempest-FloatingIPDetailsTestJSON-988510931-project] Calling method '.version_select at 0x7f67329f5f70>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:56.813262 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-822e3157-8442-4847-aa9c-423eeaf5088e tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:56.823206 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-822e3157-8442-4847-aa9c-423eeaf5088e tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:56.827170 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-822e3157-8442-4847-aa9c-423eeaf5088e tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:56.838465 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-822e3157-8442-4847-aa9c-423eeaf5088e tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] 10.222.0.40 "GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 200 len: 1446 microversion: 2.75 time: 0.183382 Oct 26 13:04:56.853105 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 328/731] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:56 2022] GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 1446 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:57.024617 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1cb8ff22-5589-430c-81d1-b98d6e7c2cfc tempest-FloatingIPDetailsTestJSON-988510931 tempest-FloatingIPDetailsTestJSON-988510931-project] 10.222.0.40 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 0.283611 Oct 26 13:04:57.025454 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 404/732] 10.222.0.40 () {58 vars in 1149 bytes} [Wed Oct 26 13:04:56 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:04:57.031212 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fdfeb297-77bd-4d83-ac03-99fafa7995f8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:57.032028 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fdfeb297-77bd-4d83-ac03-99fafa7995f8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 025e46ee-bd4b-4c43-96ce-ee086ecafe24] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:57.043291 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fdfeb297-77bd-4d83-ac03-99fafa7995f8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:57.043897 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fdfeb297-77bd-4d83-ac03-99fafa7995f8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:57.044553 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fdfeb297-77bd-4d83-ac03-99fafa7995f8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:57.045329 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fdfeb297-77bd-4d83-ac03-99fafa7995f8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:57.046254 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fdfeb297-77bd-4d83-ac03-99fafa7995f8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:57.046860 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fdfeb297-77bd-4d83-ac03-99fafa7995f8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:57.051390 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f2b70d80-4f7c-4809-b010-4c39f7611d68 tempest-HypervisorAdminNegativeUnderV252Test-495816437 tempest-HypervisorAdminNegativeUnderV252Test-495816437-project-admin] Calling method '.version_select at 0x7f673322c8b0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:57.053147 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2b70d80-4f7c-4809-b010-4c39f7611d68 tempest-HypervisorAdminNegativeUnderV252Test-495816437 tempest-HypervisorAdminNegativeUnderV252Test-495816437-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:57.053656 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2b70d80-4f7c-4809-b010-4c39f7611d68 tempest-HypervisorAdminNegativeUnderV252Test-495816437 tempest-HypervisorAdminNegativeUnderV252Test-495816437-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:57.054115 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2b70d80-4f7c-4809-b010-4c39f7611d68 tempest-HypervisorAdminNegativeUnderV252Test-495816437 tempest-HypervisorAdminNegativeUnderV252Test-495816437-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:57.070247 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2b70d80-4f7c-4809-b010-4c39f7611d68 tempest-HypervisorAdminNegativeUnderV252Test-495816437 tempest-HypervisorAdminNegativeUnderV252Test-495816437-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:57.070760 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2b70d80-4f7c-4809-b010-4c39f7611d68 tempest-HypervisorAdminNegativeUnderV252Test-495816437 tempest-HypervisorAdminNegativeUnderV252Test-495816437-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:57.071189 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2b70d80-4f7c-4809-b010-4c39f7611d68 tempest-HypervisorAdminNegativeUnderV252Test-495816437 tempest-HypervisorAdminNegativeUnderV252Test-495816437-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:57.081410 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2b70d80-4f7c-4809-b010-4c39f7611d68 tempest-HypervisorAdminNegativeUnderV252Test-495816437 tempest-HypervisorAdminNegativeUnderV252Test-495816437-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:57.081923 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2b70d80-4f7c-4809-b010-4c39f7611d68 tempest-HypervisorAdminNegativeUnderV252Test-495816437 tempest-HypervisorAdminNegativeUnderV252Test-495816437-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:57.082358 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2b70d80-4f7c-4809-b010-4c39f7611d68 tempest-HypervisorAdminNegativeUnderV252Test-495816437 tempest-HypervisorAdminNegativeUnderV252Test-495816437-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:57.089570 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f2b70d80-4f7c-4809-b010-4c39f7611d68 tempest-HypervisorAdminNegativeUnderV252Test-495816437 tempest-HypervisorAdminNegativeUnderV252Test-495816437-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.242047 Oct 26 13:04:57.090148 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 329/733] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:04:56 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:57.095228 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-8f1e62db-b1d4-41ac-af31-f854070cdbdd req-65f409d1-0dac-4311-b68a-9274edc4a6a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "379653d7-e043-474c-9fdd-3d0f663caed1", "name": "network-vif-plugged", "status": "completed", "tag": "4cf33acb-9743-43dc-b7bb-9af2984d2817"}, {"server_uuid": "025e46ee-bd4b-4c43-96ce-ee086ecafe24", "name": "network-vif-plugged", "status": "completed", "tag": "c77ced81-786f-403c-bb03-35100bde9f26"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:57.106429 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-8f1e62db-b1d4-41ac-af31-f854070cdbdd req-65f409d1-0dac-4311-b68a-9274edc4a6a4 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:57.107108 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-8f1e62db-b1d4-41ac-af31-f854070cdbdd req-65f409d1-0dac-4311-b68a-9274edc4a6a4 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:57.107690 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-8f1e62db-b1d4-41ac-af31-f854070cdbdd req-65f409d1-0dac-4311-b68a-9274edc4a6a4 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:57.122387 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-8f1e62db-b1d4-41ac-af31-f854070cdbdd req-65f409d1-0dac-4311-b68a-9274edc4a6a4 service nova] Creating event network-vif-plugged:4cf33acb-9743-43dc-b7bb-9af2984d2817 for instance 379653d7-e043-474c-9fdd-3d0f663caed1 on n-h1-862686-1 Oct 26 13:04:57.122892 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-8f1e62db-b1d4-41ac-af31-f854070cdbdd req-65f409d1-0dac-4311-b68a-9274edc4a6a4 service nova] Creating event network-vif-plugged:c77ced81-786f-403c-bb03-35100bde9f26 for instance 025e46ee-bd4b-4c43-96ce-ee086ecafe24 on n-h2-862686-1 Oct 26 13:04:57.132097 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-8f1e62db-b1d4-41ac-af31-f854070cdbdd req-65f409d1-0dac-4311-b68a-9274edc4a6a4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040587 Oct 26 13:04:57.133033 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 330/734] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:57.140527 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-067a926b-b579-4789-9412-1a5b2a7d34b7 tempest-FloatingIPDetailsTestJSON-988510931 tempest-FloatingIPDetailsTestJSON-988510931-project] Calling method '.version_select at 0x7f6732d358b0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:57.214250 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fdfeb297-77bd-4d83-ac03-99fafa7995f8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:57.223003 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fdfeb297-77bd-4d83-ac03-99fafa7995f8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/025e46ee-bd4b-4c43-96ce-ee086ecafe24" status: 200 len: 1319 microversion: 2.1 time: 0.196167 Oct 26 13:04:57.223977 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 405/735] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:57 2022] GET /compute/v2.1/servers/025e46ee-bd4b-4c43-96ce-ee086ecafe24 => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:57.350314 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0e6bf40b-5dc1-4524-8735-17cd60befb53 tempest-HypervisorAdminNegativeUnderV252Test-931947302 tempest-HypervisorAdminNegativeUnderV252Test-931947302-project] Calling method '.version_select at 0x7f67329ed790>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:57.352781 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0e6bf40b-5dc1-4524-8735-17cd60befb53 tempest-HypervisorAdminNegativeUnderV252Test-931947302 tempest-HypervisorAdminNegativeUnderV252Test-931947302-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'b9b1d1f04fe14363be4dec74e43536cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47130297d82d4cae801f1cde32d040b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:57.354512 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0e6bf40b-5dc1-4524-8735-17cd60befb53 tempest-HypervisorAdminNegativeUnderV252Test-931947302 tempest-HypervisorAdminNegativeUnderV252Test-931947302-project] Request method failure captured: Oct 26 13:04:57.354512 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/os-hypervisors/n-h2-862686-1/search HTTP/1.1 Oct 26 13:04:57.354512 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:04:57.354512 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:04:57.354512 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:04:57.354512 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:04:57.354512 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:04:57.354512 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:04:57.354512 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:04:57.354512 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:04:57.354512 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTB3MP3Gj_p7_Z1TGPZt4_QyQPDRudNS3n1_rh1AqVDJIYJcFtZquDBnVJ389eO2HrGq-K0WViEuK92Nvyi6bG_NLlDYmLExwMHLS3L-4BxcunVmAjH7_Xr3pGZdwKWpseCjye_SCgJJrtzzEHikdcGcdt3pI67C7R1vOmU_Byo5dVA Oct 26 13:04:57.354512 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:04:57.354512 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:04:57.354512 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:04:57.354512 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:04:57.354512 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:04:57.354512 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:04:57.354512 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 47130297d82d4cae801f1cde32d040b0 Oct 26 13:04:57.354512 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-931947302 Oct 26 13:04:57.354512 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:04:57.354512 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:04:57.356010 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/47130297d82d4cae801f1cde32d040b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/47130297d82d4cae801f1cde32d040b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_47130297d82d4cae801f1cde32d040b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/47130297d82d4cae801f1cde32d040b0"}]}] Oct 26 13:04:57.356010 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-931947302 Oct 26 13:04:57.356010 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 47130297d82d4cae801f1cde32d040b0 Oct 26 13:04:57.356010 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-931947302 Oct 26 13:04:57.356010 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-931947302-project Oct 26 13:04:57.356010 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:04:57.356010 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:04:57.356010 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: b9b1d1f04fe14363be4dec74e43536cf Oct 26 13:04:57.356010 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-931947302-project Oct 26 13:04:57.356010 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:04:57.356010 n-d-862686-1 devstack@n-api.service[120598]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 26 13:04:57.356010 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'n-h2-862686-1'} Oct 26 13:04:57.356901 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:04:57.356901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:57.356901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:04:57.356901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:04:57.356901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:04:57.356901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:04:57.356901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:04:57.356901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:04:57.356901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:04:57.356901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:04:57.356901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 26 13:04:57.356901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 26 13:04:57.356901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 13:04:57.356901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 13:04:57.356901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 13:04:57.356901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 13:04:57.356901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 13:04:57.356901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 13:04:57.356901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 13:04:57.358359 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 13:04:57.358359 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 13:04:57.358359 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 13:04:57.358359 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 13:04:57.358359 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 13:04:57.358359 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 13:04:57.358359 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 13:04:57.358359 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 26 13:04:57.358359 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:57.358359 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:04:57.358359 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:57.358359 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:57.358359 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:04:57.358359 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:04:57.358359 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 13:04:57.358359 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 13:04:57.358359 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 26 13:04:57.358359 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:57.360336 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0e6bf40b-5dc1-4524-8735-17cd60befb53 tempest-HypervisorAdminNegativeUnderV252Test-931947302 tempest-HypervisorAdminNegativeUnderV252Test-931947302-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:04:57.360336 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0e6bf40b-5dc1-4524-8735-17cd60befb53 tempest-HypervisorAdminNegativeUnderV252Test-931947302 tempest-HypervisorAdminNegativeUnderV252Test-931947302-project] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/n-h2-862686-1/search" status: 403 len: 117 microversion: 2.1 time: 0.130756 Oct 26 13:04:57.360336 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 406/736] 10.222.0.40 () {58 vars in 1209 bytes} [Wed Oct 26 13:04:57 2022] GET /compute/v2.1/os-hypervisors/n-h2-862686-1/search => generated 117 bytes in 132 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:04:57.360858 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-55acc14f-1b88-4951-bce9-2a592e42862c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:57.361471 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-55acc14f-1b88-4951-bce9-2a592e42862c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 7da4bb85-b577-4608-a7c0-3320721cb997] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:57.369254 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55acc14f-1b88-4951-bce9-2a592e42862c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:57.369780 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55acc14f-1b88-4951-bce9-2a592e42862c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:57.370224 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55acc14f-1b88-4951-bce9-2a592e42862c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:57.370965 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55acc14f-1b88-4951-bce9-2a592e42862c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:57.371611 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55acc14f-1b88-4951-bce9-2a592e42862c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:57.372043 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55acc14f-1b88-4951-bce9-2a592e42862c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:57.512679 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-55acc14f-1b88-4951-bce9-2a592e42862c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:57.520794 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-55acc14f-1b88-4951-bce9-2a592e42862c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997" status: 200 len: 1475 microversion: 2.1 time: 0.163425 Oct 26 13:04:57.521368 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 407/737] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:57 2022] GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997 => generated 1475 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:57.537346 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-86a44f45-9478-4a60-8e41-1b7d8cc0d00b tempest-HypervisorAdminNegativeUnderV252Test-495816437 tempest-HypervisorAdminNegativeUnderV252Test-495816437-project-admin] Calling method '.version_select at 0x7f6732981700>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:57.537346 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-86a44f45-9478-4a60-8e41-1b7d8cc0d00b tempest-HypervisorAdminNegativeUnderV252Test-495816437 tempest-HypervisorAdminNegativeUnderV252Test-495816437-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:57.537346 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-86a44f45-9478-4a60-8e41-1b7d8cc0d00b tempest-HypervisorAdminNegativeUnderV252Test-495816437 tempest-HypervisorAdminNegativeUnderV252Test-495816437-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:57.537346 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-86a44f45-9478-4a60-8e41-1b7d8cc0d00b tempest-HypervisorAdminNegativeUnderV252Test-495816437 tempest-HypervisorAdminNegativeUnderV252Test-495816437-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:57.543871 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-86a44f45-9478-4a60-8e41-1b7d8cc0d00b tempest-HypervisorAdminNegativeUnderV252Test-495816437 tempest-HypervisorAdminNegativeUnderV252Test-495816437-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 26 13:04:57.545283 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-86a44f45-9478-4a60-8e41-1b7d8cc0d00b tempest-HypervisorAdminNegativeUnderV252Test-495816437 tempest-HypervisorAdminNegativeUnderV252Test-495816437-project-admin] Request method failure captured: Oct 26 13:04:57.545283 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 26 13:04:57.545283 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:04:57.545283 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:04:57.545283 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:04:57.545283 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:04:57.545283 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:04:57.545283 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:04:57.545283 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:04:57.545283 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:04:57.545283 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTB43VAM-0qCinVKRV32_HeRkrVhhtnCLiovTm9yB_Eyu5R4ZdEKPdclSp-iPapjWk3AWPd9m4ErRU2XOWalmZezKCB3CqJy9ned1gz22ecIlNdjusE1G8jHYyKDiOODQ68f_N1V1xpdvTvk744mey3tCPPZCc9ac9sP-3wXHBcAH-I Oct 26 13:04:57.545283 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:04:57.545283 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:04:57.545283 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:04:57.545283 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:04:57.545283 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:04:57.545283 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:04:57.545283 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 968c008c347b454ca62e9152e6ee29e5 Oct 26 13:04:57.545283 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-495816437 Oct 26 13:04:57.545283 n-d-862686-1 devstack@n-api.service[120598]: X-Role: admin,member,reader Oct 26 13:04:57.545283 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: admin,member,reader Oct 26 13:04:57.546792 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/968c008c347b454ca62e9152e6ee29e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/968c008c347b454ca62e9152e6ee29e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_968c008c347b454ca62e9152e6ee29e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/968c008c347b454ca62e9152e6ee29e5"}]}] Oct 26 13:04:57.546792 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-495816437 Oct 26 13:04:57.546792 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 968c008c347b454ca62e9152e6ee29e5 Oct 26 13:04:57.546792 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-495816437 Oct 26 13:04:57.546792 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-495816437-project-admin Oct 26 13:04:57.546792 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:04:57.546792 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:04:57.546792 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 936824d2548e421db37b8e64fa780e3f Oct 26 13:04:57.546792 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-495816437-project-admin Oct 26 13:04:57.546792 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:04:57.546792 n-d-862686-1 devstack@n-api.service[120598]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 26 13:04:57.546792 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 26 13:04:57.547663 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:04:57.547663 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:57.547663 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:04:57.547663 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:04:57.547663 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:04:57.547663 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:04:57.547663 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:04:57.547663 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:04:57.547663 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:04:57.547663 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:04:57.547663 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 26 13:04:57.547663 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 26 13:04:57.547663 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 26 13:04:57.547663 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 26 13:04:57.547663 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 26 13:04:57.547663 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:57.547663 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:04:57.547663 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:57.547663 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:57.547663 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:04:57.549013 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:04:57.549013 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:04:57.549013 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:04:57.549013 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 26 13:04:57.549013 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:57.549013 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-86a44f45-9478-4a60-8e41-1b7d8cc0d00b tempest-HypervisorAdminNegativeUnderV252Test-495816437 tempest-HypervisorAdminNegativeUnderV252Test-495816437-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:04:57.549013 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-86a44f45-9478-4a60-8e41-1b7d8cc0d00b tempest-HypervisorAdminNegativeUnderV252Test-495816437 tempest-HypervisorAdminNegativeUnderV252Test-495816437-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.024372 Oct 26 13:04:57.549013 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 408/738] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Oct 26 13:04:57 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:04:57.552088 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-921cbba4-1e9b-44cb-b828-ff4186ae8a80 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:57.552557 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-921cbba4-1e9b-44cb-b828-ff4186ae8a80 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: a28883a5-9f17-4514-823e-7b33a316d33c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:57.558426 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-921cbba4-1e9b-44cb-b828-ff4186ae8a80 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:57.558898 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-921cbba4-1e9b-44cb-b828-ff4186ae8a80 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:57.559338 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-921cbba4-1e9b-44cb-b828-ff4186ae8a80 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:57.560038 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-921cbba4-1e9b-44cb-b828-ff4186ae8a80 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:57.560508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-921cbba4-1e9b-44cb-b828-ff4186ae8a80 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:57.560937 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-921cbba4-1e9b-44cb-b828-ff4186ae8a80 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:57.705708 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-921cbba4-1e9b-44cb-b828-ff4186ae8a80 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:57.714778 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-921cbba4-1e9b-44cb-b828-ff4186ae8a80 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:57.716405 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-921cbba4-1e9b-44cb-b828-ff4186ae8a80 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:57.717711 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-921cbba4-1e9b-44cb-b828-ff4186ae8a80 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c" status: 200 len: 1567 microversion: 2.25 time: 0.169340 Oct 26 13:04:57.718383 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 409/739] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:57 2022] GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:57.723281 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a53f08b4-7b10-4d27-b708-972171189d2a tempest-HypervisorAdminNegativeUnderV252Test-495816437 tempest-HypervisorAdminNegativeUnderV252Test-495816437-project-admin] Calling method '.version_select at 0x7f67328f3550>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:57.725166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a53f08b4-7b10-4d27-b708-972171189d2a tempest-HypervisorAdminNegativeUnderV252Test-495816437 tempest-HypervisorAdminNegativeUnderV252Test-495816437-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:57.725695 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a53f08b4-7b10-4d27-b708-972171189d2a tempest-HypervisorAdminNegativeUnderV252Test-495816437 tempest-HypervisorAdminNegativeUnderV252Test-495816437-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:57.726135 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a53f08b4-7b10-4d27-b708-972171189d2a tempest-HypervisorAdminNegativeUnderV252Test-495816437 tempest-HypervisorAdminNegativeUnderV252Test-495816437-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:57.741080 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a53f08b4-7b10-4d27-b708-972171189d2a tempest-HypervisorAdminNegativeUnderV252Test-495816437 tempest-HypervisorAdminNegativeUnderV252Test-495816437-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:57.741599 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a53f08b4-7b10-4d27-b708-972171189d2a tempest-HypervisorAdminNegativeUnderV252Test-495816437 tempest-HypervisorAdminNegativeUnderV252Test-495816437-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:57.742043 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a53f08b4-7b10-4d27-b708-972171189d2a tempest-HypervisorAdminNegativeUnderV252Test-495816437 tempest-HypervisorAdminNegativeUnderV252Test-495816437-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:57.752651 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a53f08b4-7b10-4d27-b708-972171189d2a tempest-HypervisorAdminNegativeUnderV252Test-495816437 tempest-HypervisorAdminNegativeUnderV252Test-495816437-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:57.753163 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a53f08b4-7b10-4d27-b708-972171189d2a tempest-HypervisorAdminNegativeUnderV252Test-495816437 tempest-HypervisorAdminNegativeUnderV252Test-495816437-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:57.753646 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a53f08b4-7b10-4d27-b708-972171189d2a tempest-HypervisorAdminNegativeUnderV252Test-495816437 tempest-HypervisorAdminNegativeUnderV252Test-495816437-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:57.759629 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a53f08b4-7b10-4d27-b708-972171189d2a tempest-HypervisorAdminNegativeUnderV252Test-495816437 tempest-HypervisorAdminNegativeUnderV252Test-495816437-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.040164 Oct 26 13:04:57.760264 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 410/740] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:04:57 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:04:57.770536 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c8117416-2bba-46a8-ab17-1cb848febfde tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:57.770959 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c8117416-2bba-46a8-ab17-1cb848febfde tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: 379653d7-e043-474c-9fdd-3d0f663caed1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:57.776980 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c8117416-2bba-46a8-ab17-1cb848febfde tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:57.777238 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c8117416-2bba-46a8-ab17-1cb848febfde tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:57.777717 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c8117416-2bba-46a8-ab17-1cb848febfde tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:57.778422 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c8117416-2bba-46a8-ab17-1cb848febfde tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:57.778881 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c8117416-2bba-46a8-ab17-1cb848febfde tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:57.779558 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c8117416-2bba-46a8-ab17-1cb848febfde tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:57.915265 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c8117416-2bba-46a8-ab17-1cb848febfde tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241a2299894849c889ee7f1100a9823d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec66df09b6114f5dbd6678d5e848c737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:57.923105 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c8117416-2bba-46a8-ab17-1cb848febfde tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] 10.222.0.40 "GET /compute/v2.1/servers/379653d7-e043-474c-9fdd-3d0f663caed1" status: 200 len: 1324 microversion: 2.1 time: 0.161866 Oct 26 13:04:57.923671 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 411/741] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:57 2022] GET /compute/v2.1/servers/379653d7-e043-474c-9fdd-3d0f663caed1 => generated 1324 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:57.930898 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d4b487c6-64fe-4ac1-8252-ef8f8aaa878c tempest-HypervisorAdminNegativeUnderV252Test-931947302 tempest-HypervisorAdminNegativeUnderV252Test-931947302-project] Calling method '.version_select at 0x7f6732acc040>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:57.930898 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d4b487c6-64fe-4ac1-8252-ef8f8aaa878c tempest-HypervisorAdminNegativeUnderV252Test-931947302 tempest-HypervisorAdminNegativeUnderV252Test-931947302-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'b9b1d1f04fe14363be4dec74e43536cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47130297d82d4cae801f1cde32d040b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:57.933131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d4b487c6-64fe-4ac1-8252-ef8f8aaa878c tempest-HypervisorAdminNegativeUnderV252Test-931947302 tempest-HypervisorAdminNegativeUnderV252Test-931947302-project] Request method failure captured: Oct 26 13:04:57.933131 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 26 13:04:57.933131 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:04:57.933131 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:04:57.933131 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:04:57.933131 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:04:57.933131 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:04:57.933131 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:04:57.933131 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:04:57.933131 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:04:57.933131 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTB3MP3Gj_p7_Z1TGPZt4_QyQPDRudNS3n1_rh1AqVDJIYJcFtZquDBnVJ389eO2HrGq-K0WViEuK92Nvyi6bG_NLlDYmLExwMHLS3L-4BxcunVmAjH7_Xr3pGZdwKWpseCjye_SCgJJrtzzEHikdcGcdt3pI67C7R1vOmU_Byo5dVA Oct 26 13:04:57.933131 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:04:57.933131 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:04:57.933131 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:04:57.933131 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:04:57.933131 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:04:57.933131 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:04:57.933131 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 47130297d82d4cae801f1cde32d040b0 Oct 26 13:04:57.933131 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-931947302 Oct 26 13:04:57.933131 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:04:57.933131 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:04:57.934803 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/47130297d82d4cae801f1cde32d040b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/47130297d82d4cae801f1cde32d040b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_47130297d82d4cae801f1cde32d040b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/47130297d82d4cae801f1cde32d040b0"}]}] Oct 26 13:04:57.934803 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-931947302 Oct 26 13:04:57.934803 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 47130297d82d4cae801f1cde32d040b0 Oct 26 13:04:57.934803 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-931947302 Oct 26 13:04:57.934803 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-931947302-project Oct 26 13:04:57.934803 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:04:57.934803 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:04:57.934803 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: b9b1d1f04fe14363be4dec74e43536cf Oct 26 13:04:57.934803 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-931947302-project Oct 26 13:04:57.934803 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:04:57.934803 n-d-862686-1 devstack@n-api.service[120598]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 26 13:04:57.934803 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '1'} Oct 26 13:04:57.935646 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:04:57.935646 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:57.935646 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:04:57.935646 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:04:57.935646 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:04:57.935646 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:04:57.935646 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:04:57.935646 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:04:57.935646 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:04:57.935646 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:04:57.935646 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 26 13:04:57.935646 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 26 13:04:57.935646 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 13:04:57.935646 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 13:04:57.935646 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 13:04:57.935646 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 13:04:57.935646 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 13:04:57.935646 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 13:04:57.935646 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 13:04:57.937014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 13:04:57.937014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 13:04:57.937014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 13:04:57.937014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 13:04:57.937014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 13:04:57.937014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 13:04:57.937014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 13:04:57.937014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 26 13:04:57.937014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:57.937014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:04:57.937014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:57.937014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:57.937014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:04:57.937014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:04:57.937014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 13:04:57.937014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 13:04:57.937014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 26 13:04:57.937014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:57.938729 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d4b487c6-64fe-4ac1-8252-ef8f8aaa878c tempest-HypervisorAdminNegativeUnderV252Test-931947302 tempest-HypervisorAdminNegativeUnderV252Test-931947302-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:04:57.938729 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d4b487c6-64fe-4ac1-8252-ef8f8aaa878c tempest-HypervisorAdminNegativeUnderV252Test-931947302 tempest-HypervisorAdminNegativeUnderV252Test-931947302-project] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.009893 Oct 26 13:04:57.938729 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 412/742] 10.222.0.40 () {58 vars in 1176 bytes} [Wed Oct 26 13:04:57 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:04:57.942049 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fd0a897b-dac2-4c75-a89d-db4e674460ee tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:57.942659 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fd0a897b-dac2-4c75-a89d-db4e674460ee tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:57.949939 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd0a897b-dac2-4c75-a89d-db4e674460ee tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:57.950429 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd0a897b-dac2-4c75-a89d-db4e674460ee tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:57.950865 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd0a897b-dac2-4c75-a89d-db4e674460ee tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:57.951561 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd0a897b-dac2-4c75-a89d-db4e674460ee tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:57.952015 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd0a897b-dac2-4c75-a89d-db4e674460ee tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:57.952439 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd0a897b-dac2-4c75-a89d-db4e674460ee tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:58.019690 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fd0a897b-dac2-4c75-a89d-db4e674460ee tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:58.028234 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fd0a897b-dac2-4c75-a89d-db4e674460ee tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:58.029722 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fd0a897b-dac2-4c75-a89d-db4e674460ee tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:58.034555 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fd0a897b-dac2-4c75-a89d-db4e674460ee tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] 10.222.0.40 "GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 200 len: 1446 microversion: 2.75 time: 0.097667 Oct 26 13:04:58.035126 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 413/743] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:57 2022] GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 1446 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:58.039950 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a19a58e2-2aa1-4cee-8430-287bbd8847fa tempest-HypervisorAdminNegativeUnderV252Test-495816437 tempest-HypervisorAdminNegativeUnderV252Test-495816437-project-admin] Calling method '.version_select at 0x7f6732907e50>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:58.041798 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a19a58e2-2aa1-4cee-8430-287bbd8847fa tempest-HypervisorAdminNegativeUnderV252Test-495816437 tempest-HypervisorAdminNegativeUnderV252Test-495816437-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:58.042282 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a19a58e2-2aa1-4cee-8430-287bbd8847fa tempest-HypervisorAdminNegativeUnderV252Test-495816437 tempest-HypervisorAdminNegativeUnderV252Test-495816437-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:58.042711 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a19a58e2-2aa1-4cee-8430-287bbd8847fa tempest-HypervisorAdminNegativeUnderV252Test-495816437 tempest-HypervisorAdminNegativeUnderV252Test-495816437-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:58.051109 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-a19a58e2-2aa1-4cee-8430-287bbd8847fa tempest-HypervisorAdminNegativeUnderV252Test-495816437 tempest-HypervisorAdminNegativeUnderV252Test-495816437-project-admin] HTTP exception thrown: No hypervisor matching 'ff2d225d-9494-4cf6-bfda-1a5a35427e2a' could be found. Oct 26 13:04:58.052445 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a19a58e2-2aa1-4cee-8430-287bbd8847fa tempest-HypervisorAdminNegativeUnderV252Test-495816437 tempest-HypervisorAdminNegativeUnderV252Test-495816437-project-admin] Request method failure captured: Oct 26 13:04:58.052445 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/os-hypervisors/ff2d225d-9494-4cf6-bfda-1a5a35427e2a/servers HTTP/1.1 Oct 26 13:04:58.052445 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:04:58.052445 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:04:58.052445 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:04:58.052445 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:04:58.052445 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:04:58.052445 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:04:58.052445 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:04:58.052445 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:04:58.052445 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTB43VAM-0qCinVKRV32_HeRkrVhhtnCLiovTm9yB_Eyu5R4ZdEKPdclSp-iPapjWk3AWPd9m4ErRU2XOWalmZezKCB3CqJy9ned1gz22ecIlNdjusE1G8jHYyKDiOODQ68f_N1V1xpdvTvk744mey3tCPPZCc9ac9sP-3wXHBcAH-I Oct 26 13:04:58.052445 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:04:58.052445 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:04:58.052445 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:04:58.052445 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:04:58.052445 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:04:58.052445 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:04:58.052445 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 968c008c347b454ca62e9152e6ee29e5 Oct 26 13:04:58.052445 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-495816437 Oct 26 13:04:58.052445 n-d-862686-1 devstack@n-api.service[120598]: X-Role: admin,member,reader Oct 26 13:04:58.052445 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: admin,member,reader Oct 26 13:04:58.053726 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/968c008c347b454ca62e9152e6ee29e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/968c008c347b454ca62e9152e6ee29e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_968c008c347b454ca62e9152e6ee29e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/968c008c347b454ca62e9152e6ee29e5"}]}] Oct 26 13:04:58.053726 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-495816437 Oct 26 13:04:58.053726 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 968c008c347b454ca62e9152e6ee29e5 Oct 26 13:04:58.053726 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-495816437 Oct 26 13:04:58.053726 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-495816437-project-admin Oct 26 13:04:58.053726 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:04:58.053726 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:04:58.053726 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 936824d2548e421db37b8e64fa780e3f Oct 26 13:04:58.053726 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-495816437-project-admin Oct 26 13:04:58.053726 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:04:58.053726 n-d-862686-1 devstack@n-api.service[120598]: exception: No hypervisor matching 'ff2d225d-9494-4cf6-bfda-1a5a35427e2a' could be found. Oct 26 13:04:58.053726 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'ff2d225d-9494-4cf6-bfda-1a5a35427e2a'} Oct 26 13:04:58.054465 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:04:58.054465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:58.054465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:04:58.054465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:04:58.054465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:04:58.054465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:04:58.054465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:04:58.054465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:04:58.054465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:04:58.054465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:04:58.054465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 26 13:04:58.054465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 26 13:04:58.054465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 26 13:04:58.054465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 26 13:04:58.054465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'ff2d225d-9494-4cf6-bfda-1a5a35427e2a' could be found. Oct 26 13:04:58.054465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:58.054465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:04:58.054465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:58.054465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:04:58.056845 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:04:58.056845 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:04:58.056845 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:04:58.056845 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:04:58.056845 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'ff2d225d-9494-4cf6-bfda-1a5a35427e2a' could be found. Oct 26 13:04:58.056845 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:04:58.056845 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a19a58e2-2aa1-4cee-8430-287bbd8847fa tempest-HypervisorAdminNegativeUnderV252Test-495816437 tempest-HypervisorAdminNegativeUnderV252Test-495816437-project-admin] Returning 404 to user: No hypervisor matching 'ff2d225d-9494-4cf6-bfda-1a5a35427e2a' could be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:04:58.056845 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a19a58e2-2aa1-4cee-8430-287bbd8847fa tempest-HypervisorAdminNegativeUnderV252Test-495816437 tempest-HypervisorAdminNegativeUnderV252Test-495816437-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/ff2d225d-9494-4cf6-bfda-1a5a35427e2a/servers" status: 404 len: 123 microversion: 2.1 time: 0.017762 Oct 26 13:04:58.056845 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 414/744] 10.222.0.40 () {58 vars in 1281 bytes} [Wed Oct 26 13:04:58 2022] GET /compute/v2.1/os-hypervisors/ff2d225d-9494-4cf6-bfda-1a5a35427e2a/servers => generated 123 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:04:58.245978 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6da52242-1117-42bd-ba0a-eb3f095b1c08 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:58.246691 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6da52242-1117-42bd-ba0a-eb3f095b1c08 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 025e46ee-bd4b-4c43-96ce-ee086ecafe24] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:58.255489 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6da52242-1117-42bd-ba0a-eb3f095b1c08 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:58.255794 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6da52242-1117-42bd-ba0a-eb3f095b1c08 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:58.256300 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6da52242-1117-42bd-ba0a-eb3f095b1c08 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:58.257060 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6da52242-1117-42bd-ba0a-eb3f095b1c08 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:58.257760 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6da52242-1117-42bd-ba0a-eb3f095b1c08 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:58.258313 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6da52242-1117-42bd-ba0a-eb3f095b1c08 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:58.280725 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:04:58.435461 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6da52242-1117-42bd-ba0a-eb3f095b1c08 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:58.445000 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6da52242-1117-42bd-ba0a-eb3f095b1c08 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/025e46ee-bd4b-4c43-96ce-ee086ecafe24" status: 200 len: 1319 microversion: 2.1 time: 0.203130 Oct 26 13:04:58.446122 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 415/745] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:58 2022] GET /compute/v2.1/servers/025e46ee-bd4b-4c43-96ce-ee086ecafe24 => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:04:58.545692 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7f852dbf-7bab-407b-859a-7c9c1b42736e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:58.546604 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7f852dbf-7bab-407b-859a-7c9c1b42736e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 7da4bb85-b577-4608-a7c0-3320721cb997] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:58.553316 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f852dbf-7bab-407b-859a-7c9c1b42736e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:58.553890 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f852dbf-7bab-407b-859a-7c9c1b42736e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:58.554556 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f852dbf-7bab-407b-859a-7c9c1b42736e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:58.555269 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f852dbf-7bab-407b-859a-7c9c1b42736e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:58.555840 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f852dbf-7bab-407b-859a-7c9c1b42736e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:58.556490 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f852dbf-7bab-407b-859a-7c9c1b42736e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:58.779400 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-067a926b-b579-4789-9412-1a5b2a7d34b7 tempest-FloatingIPDetailsTestJSON-988510931 tempest-FloatingIPDetailsTestJSON-988510931-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/32bf1b81-e133-4862-97f0-06ad66cdeab2" status: 202 len: 0 microversion: 2.1 time: 1.644682 Oct 26 13:04:58.785903 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 331/746] 10.222.0.40 () {58 vars in 1263 bytes} [Wed Oct 26 13:04:57 2022] DELETE /compute/v2.1/os-floating-ips/32bf1b81-e133-4862-97f0-06ad66cdeab2 => generated 0 bytes in 1651 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:04:58.791629 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e1385332-4058-4d8d-9891-1c3707b09b22 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:58.792485 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e1385332-4058-4d8d-9891-1c3707b09b22 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: a28883a5-9f17-4514-823e-7b33a316d33c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:58.801232 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1385332-4058-4d8d-9891-1c3707b09b22 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:58.802042 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1385332-4058-4d8d-9891-1c3707b09b22 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:58.802625 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1385332-4058-4d8d-9891-1c3707b09b22 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:58.803778 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1385332-4058-4d8d-9891-1c3707b09b22 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:58.804544 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1385332-4058-4d8d-9891-1c3707b09b22 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:58.805474 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1385332-4058-4d8d-9891-1c3707b09b22 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:58.814066 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7f852dbf-7bab-407b-859a-7c9c1b42736e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:58.823011 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7f852dbf-7bab-407b-859a-7c9c1b42736e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997" status: 200 len: 1475 microversion: 2.1 time: 0.281348 Oct 26 13:04:58.823696 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 416/747] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:58 2022] GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997 => generated 1475 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:58.850386 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-699f6be6-a6ce-4ddb-900f-90445c42c5ed tempest-FloatingIPDetailsTestJSON-988510931 tempest-FloatingIPDetailsTestJSON-988510931-project] Calling method '.version_select at 0x7f6732a3b700>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:59.048915 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e1385332-4058-4d8d-9891-1c3707b09b22 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:59.062324 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e1385332-4058-4d8d-9891-1c3707b09b22 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:59.063984 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e1385332-4058-4d8d-9891-1c3707b09b22 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:59.065200 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e1385332-4058-4d8d-9891-1c3707b09b22 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c" status: 200 len: 1542 microversion: 2.25 time: 0.278152 Oct 26 13:04:59.065893 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 332/748] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:58 2022] GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c => generated 1542 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:59.077568 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-11829b0c-a114-4f89-a9d2-b92c0f63f029 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:59.081137 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-11829b0c-a114-4f89-a9d2-b92c0f63f029 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: 379653d7-e043-474c-9fdd-3d0f663caed1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:59.091917 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-11829b0c-a114-4f89-a9d2-b92c0f63f029 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:59.092409 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-11829b0c-a114-4f89-a9d2-b92c0f63f029 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:59.092849 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-11829b0c-a114-4f89-a9d2-b92c0f63f029 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:59.093588 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-11829b0c-a114-4f89-a9d2-b92c0f63f029 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:59.094042 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-11829b0c-a114-4f89-a9d2-b92c0f63f029 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:59.094467 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-11829b0c-a114-4f89-a9d2-b92c0f63f029 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:59.244555 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-11829b0c-a114-4f89-a9d2-b92c0f63f029 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241a2299894849c889ee7f1100a9823d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec66df09b6114f5dbd6678d5e848c737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:59.253045 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-11829b0c-a114-4f89-a9d2-b92c0f63f029 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] 10.222.0.40 "GET /compute/v2.1/servers/379653d7-e043-474c-9fdd-3d0f663caed1" status: 200 len: 1519 microversion: 2.1 time: 0.185721 Oct 26 13:04:59.254336 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 333/749] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:59 2022] GET /compute/v2.1/servers/379653d7-e043-474c-9fdd-3d0f663caed1 => generated 1519 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:04:59.260566 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b6fa0554-c23e-4450-ae62-69bf00675794 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:59.261294 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b6fa0554-c23e-4450-ae62-69bf00675794 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:59.264638 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=7,nova_api:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:04:59.268492 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6fa0554-c23e-4450-ae62-69bf00675794 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:59.269197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6fa0554-c23e-4450-ae62-69bf00675794 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:59.269952 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6fa0554-c23e-4450-ae62-69bf00675794 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:59.270868 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6fa0554-c23e-4450-ae62-69bf00675794 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:59.271651 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6fa0554-c23e-4450-ae62-69bf00675794 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:59.272470 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6fa0554-c23e-4450-ae62-69bf00675794 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:59.341117 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b6fa0554-c23e-4450-ae62-69bf00675794 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:59.349172 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b6fa0554-c23e-4450-ae62-69bf00675794 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:59.350703 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b6fa0554-c23e-4450-ae62-69bf00675794 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:04:59.355605 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b6fa0554-c23e-4450-ae62-69bf00675794 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] 10.222.0.40 "GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 200 len: 1446 microversion: 2.75 time: 0.100110 Oct 26 13:04:59.356169 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 334/750] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:59 2022] GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 1446 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:59.360678 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5ac5d2a3-61c7-4a4a-8d6e-38711807c6e5 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Calling method '.version_select at 0x7f6732d1cf70>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:59.364253 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ac5d2a3-61c7-4a4a-8d6e-38711807c6e5 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:59.364740 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ac5d2a3-61c7-4a4a-8d6e-38711807c6e5 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:59.365178 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ac5d2a3-61c7-4a4a-8d6e-38711807c6e5 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:59.374590 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5ac5d2a3-61c7-4a4a-8d6e-38711807c6e5 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 1950 microversion: 2.25 time: 0.017229 Oct 26 13:04:59.375354 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 335/751] 10.222.0.40 () {60 vars in 1184 bytes} [Wed Oct 26 13:04:59 2022] GET /compute/v2.1/os-migrations => generated 1950 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:59.380547 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-26293f82-7853-4880-baaf-dba6642ea034 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Action: 'action', calling method: .version_select at 0x7f673430caf0>, body: {"addFloatingIp": {"address": "172.25.6.186"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:04:59.383698 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-26293f82-7853-4880-baaf-dba6642ea034 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: dffc2812-b18a-4227-932f-3db590d7bc6f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:59.389982 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26293f82-7853-4880-baaf-dba6642ea034 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:59.390476 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26293f82-7853-4880-baaf-dba6642ea034 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:59.390949 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26293f82-7853-4880-baaf-dba6642ea034 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:59.391648 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26293f82-7853-4880-baaf-dba6642ea034 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:59.392106 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26293f82-7853-4880-baaf-dba6642ea034 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:59.392534 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26293f82-7853-4880-baaf-dba6642ea034 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:59.459306 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26293f82-7853-4880-baaf-dba6642ea034 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "refresh_cache-dffc2812-b18a-4227-932f-3db590d7bc6f" {{(pid=120597) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 26 13:04:59.459661 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26293f82-7853-4880-baaf-dba6642ea034 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquired lock "refresh_cache-dffc2812-b18a-4227-932f-3db590d7bc6f" {{(pid=120597) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 26 13:04:59.793626 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-699f6be6-a6ce-4ddb-900f-90445c42c5ed tempest-FloatingIPDetailsTestJSON-988510931 tempest-FloatingIPDetailsTestJSON-988510931-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/9ff7acda-2a93-4297-ba79-d5fba2053cae" status: 202 len: 0 microversion: 2.1 time: 0.968795 Oct 26 13:04:59.797167 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 417/752] 10.222.0.40 () {58 vars in 1263 bytes} [Wed Oct 26 13:04:58 2022] DELETE /compute/v2.1/os-floating-ips/9ff7acda-2a93-4297-ba79-d5fba2053cae => generated 0 bytes in 970 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:04:59.799471 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d16f5de2-40cc-4dc9-b857-2563f7941784 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:59.800075 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d16f5de2-40cc-4dc9-b857-2563f7941784 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] [instance: a28883a5-9f17-4514-823e-7b33a316d33c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:59.806084 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d16f5de2-40cc-4dc9-b857-2563f7941784 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:59.806570 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d16f5de2-40cc-4dc9-b857-2563f7941784 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:59.807179 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d16f5de2-40cc-4dc9-b857-2563f7941784 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:59.808070 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d16f5de2-40cc-4dc9-b857-2563f7941784 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:59.808538 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d16f5de2-40cc-4dc9-b857-2563f7941784 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:59.808967 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d16f5de2-40cc-4dc9-b857-2563f7941784 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:59.954433 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-d16f5de2-40cc-4dc9-b857-2563f7941784 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lazy-loading 'services' on Instance uuid a28883a5-9f17-4514-823e-7b33a316d33c {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:04:59.968708 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d16f5de2-40cc-4dc9-b857-2563f7941784 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c" status: 200 len: 2035 microversion: 2.25 time: 0.173410 Oct 26 13:04:59.969276 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 418/753] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:04:59 2022] GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c => generated 2035 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:04:59.974127 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0f8f09e7-7ed1-47b3-acb6-0f2fc9987e75 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:04:59.974951 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0f8f09e7-7ed1-47b3-acb6-0f2fc9987e75 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 025e46ee-bd4b-4c43-96ce-ee086ecafe24] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:04:59.981436 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f8f09e7-7ed1-47b3-acb6-0f2fc9987e75 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:59.982028 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f8f09e7-7ed1-47b3-acb6-0f2fc9987e75 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:59.982689 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f8f09e7-7ed1-47b3-acb6-0f2fc9987e75 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:04:59.983602 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f8f09e7-7ed1-47b3-acb6-0f2fc9987e75 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:04:59.984270 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f8f09e7-7ed1-47b3-acb6-0f2fc9987e75 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:04:59.984896 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f8f09e7-7ed1-47b3-acb6-0f2fc9987e75 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:00.153325 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0f8f09e7-7ed1-47b3-acb6-0f2fc9987e75 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:00.162030 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0f8f09e7-7ed1-47b3-acb6-0f2fc9987e75 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/025e46ee-bd4b-4c43-96ce-ee086ecafe24" status: 200 len: 1469 microversion: 2.1 time: 0.191491 Oct 26 13:05:00.172411 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 419/754] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:04:59 2022] GET /compute/v2.1/servers/025e46ee-bd4b-4c43-96ce-ee086ecafe24 => generated 1469 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:00.172411 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-62973895-99ba-482e-838b-0fda379d9178 tempest-FloatingIPDetailsTestJSON-988510931 tempest-FloatingIPDetailsTestJSON-988510931-project] Calling method '.version_select at 0x7f6732b32550>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:00.791862 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-26293f82-7853-4880-baaf-dba6642ea034 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: dffc2812-b18a-4227-932f-3db590d7bc6f] Building network info cache for instance {{(pid=120597) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 26 13:05:01.067632 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-62973895-99ba-482e-838b-0fda379d9178 tempest-FloatingIPDetailsTestJSON-988510931 tempest-FloatingIPDetailsTestJSON-988510931-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/f2deb118-a9c9-4069-aa55-00f099f1c657" status: 202 len: 0 microversion: 2.1 time: 0.903614 Oct 26 13:05:01.070868 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 420/755] 10.222.0.40 () {58 vars in 1263 bytes} [Wed Oct 26 13:05:00 2022] DELETE /compute/v2.1/os-floating-ips/f2deb118-a9c9-4069-aa55-00f099f1c657 => generated 0 bytes in 905 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:05:01.076698 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8b4cb357-32a7-45f5-896e-a770f4d67244 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:01.077326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8b4cb357-32a7-45f5-896e-a770f4d67244 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 7da4bb85-b577-4608-a7c0-3320721cb997] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:01.090021 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b4cb357-32a7-45f5-896e-a770f4d67244 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:01.090524 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b4cb357-32a7-45f5-896e-a770f4d67244 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:01.090966 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b4cb357-32a7-45f5-896e-a770f4d67244 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:01.091691 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b4cb357-32a7-45f5-896e-a770f4d67244 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:01.097451 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b4cb357-32a7-45f5-896e-a770f4d67244 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:01.097948 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b4cb357-32a7-45f5-896e-a770f4d67244 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:01.384708 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8b4cb357-32a7-45f5-896e-a770f4d67244 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:01.394889 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8b4cb357-32a7-45f5-896e-a770f4d67244 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997" status: 200 len: 1470 microversion: 2.1 time: 0.324873 Oct 26 13:05:01.396659 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 421/756] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:01 2022] GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997 => generated 1470 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:01.413726 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-29e7391f-b3d7-4ec4-8e1a-b1a9222d1a52 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Action: 'create', calling method: .version_select at 0x7f6732b898b0>, body: {"keypair": {"name": "tempest-keypair-1087202563", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0aohs0ce3S1bHIuSvPqGP5t+xWcdEr08cSwe+30BL9Zcy9K6u0O6x5iU3NjVvxqUSdVWvA+s/GSin+DBSp4s2jAOK1uCwn7kQCC2lelapdBsiHmX5LXaEHKDdq6ON9zg=="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:01.462084 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-29e7391f-b3d7-4ec4-8e1a-b1a9222d1a52 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Getting quotas for project 2f7b9165f0ff4c06a5d154ea24b17bac. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:05:01.478735 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-29e7391f-b3d7-4ec4-8e1a-b1a9222d1a52 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Getting quotas for user 27f4a513ca654b0abf9f972e07270c10 and project 2f7b9165f0ff4c06a5d154ea24b17bac. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:05:01.528553 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-29e7391f-b3d7-4ec4-8e1a-b1a9222d1a52 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.129866 Oct 26 13:05:01.531237 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 422/757] 10.222.0.40 () {62 vars in 1200 bytes} [Wed Oct 26 13:05:01 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 133 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 26 13:05:01.548089 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c723acaf-4211-4d2c-a625-1039e129b8c4 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:01.548934 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c723acaf-4211-4d2c-a625-1039e129b8c4 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 60c4cea5-3b00-4614-a70d-e3fd589cc408] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:01.562963 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c723acaf-4211-4d2c-a625-1039e129b8c4 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:01.563472 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c723acaf-4211-4d2c-a625-1039e129b8c4 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:01.568011 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c723acaf-4211-4d2c-a625-1039e129b8c4 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:01.568981 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c723acaf-4211-4d2c-a625-1039e129b8c4 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:01.570886 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c723acaf-4211-4d2c-a625-1039e129b8c4 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:01.576265 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c723acaf-4211-4d2c-a625-1039e129b8c4 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:01.890273 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c723acaf-4211-4d2c-a625-1039e129b8c4 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:01.902884 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c723acaf-4211-4d2c-a625-1039e129b8c4 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/60c4cea5-3b00-4614-a70d-e3fd589cc408" status: 200 len: 1469 microversion: 2.1 time: 0.370244 Oct 26 13:05:01.908300 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 423/758] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:01 2022] GET /compute/v2.1/servers/60c4cea5-3b00-4614-a70d-e3fd589cc408 => generated 1469 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:01.913859 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-29a182f2-03a2-4a86-8e7b-ed129ae4b70b tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:01.919860 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-29a182f2-03a2-4a86-8e7b-ed129ae4b70b tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:01.939164 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29a182f2-03a2-4a86-8e7b-ed129ae4b70b tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:01.941430 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29a182f2-03a2-4a86-8e7b-ed129ae4b70b tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:01.942210 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29a182f2-03a2-4a86-8e7b-ed129ae4b70b tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:01.943278 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29a182f2-03a2-4a86-8e7b-ed129ae4b70b tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:01.943906 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29a182f2-03a2-4a86-8e7b-ed129ae4b70b tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:01.946653 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29a182f2-03a2-4a86-8e7b-ed129ae4b70b tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:02.043899 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-26293f82-7853-4880-baaf-dba6642ea034 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: dffc2812-b18a-4227-932f-3db590d7bc6f] Updating instance_info_cache with network_info: [{"id": "eefbc12d-6331-420c-be7b-da952bc9d1cf", "address": "fa:16:3e:b6:63:ec", "network": {"id": "d5dfe2c9-28ca-4cae-a6cc-e2ee7f3499d9", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-21236752-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ec66df09b6114f5dbd6678d5e848c737", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapeefbc12d-63", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120597) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 26 13:05:02.065710 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26293f82-7853-4880-baaf-dba6642ea034 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Releasing lock "refresh_cache-dffc2812-b18a-4227-932f-3db590d7bc6f" {{(pid=120597) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 26 13:05:02.066947 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-26293f82-7853-4880-baaf-dba6642ea034 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] 10.222.0.40 "POST /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f/action" status: 202 len: 0 microversion: 2.1 time: 2.690486 Oct 26 13:05:02.072282 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 336/759] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:04:59 2022] POST /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f/action => generated 0 bytes in 2696 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 26 13:05:02.077463 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-a233b39f-98c0-4fce-80b5-eb84156086f3 req-9aa8a21f-fa09-46b2-9949-c3a6f14825a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7da4bb85-b577-4608-a7c0-3320721cb997", "name": "network-vif-unplugged", "status": "completed", "tag": "612e62d8-c0dd-48c8-889d-f05c9055db41"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:02.088625 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a233b39f-98c0-4fce-80b5-eb84156086f3 req-9aa8a21f-fa09-46b2-9949-c3a6f14825a2 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:02.089110 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a233b39f-98c0-4fce-80b5-eb84156086f3 req-9aa8a21f-fa09-46b2-9949-c3a6f14825a2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:02.089579 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a233b39f-98c0-4fce-80b5-eb84156086f3 req-9aa8a21f-fa09-46b2-9949-c3a6f14825a2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:02.102775 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-a233b39f-98c0-4fce-80b5-eb84156086f3 req-9aa8a21f-fa09-46b2-9949-c3a6f14825a2 service nova] Creating event network-vif-unplugged:612e62d8-c0dd-48c8-889d-f05c9055db41 for instance 7da4bb85-b577-4608-a7c0-3320721cb997 on n-h2-862686-1 Oct 26 13:05:02.112323 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [req-a233b39f-98c0-4fce-80b5-eb84156086f3 req-9aa8a21f-fa09-46b2-9949-c3a6f14825a2 service nova] Instance 7da4bb85-b577-4608-a7c0-3320721cb997 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862686-1'} {{(pid=120597) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 13:05:02.119795 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-a233b39f-98c0-4fce-80b5-eb84156086f3 req-9aa8a21f-fa09-46b2-9949-c3a6f14825a2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045971 Oct 26 13:05:02.121827 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 337/760] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:05:02.128073 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-566d7d88-51eb-4e47-b479-d83fee530fc1 req-61735b4d-94d4-42c7-96df-3c2fb8126e03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dffc2812-b18a-4227-932f-3db590d7bc6f", "tag": "eefbc12d-6331-420c-be7b-da952bc9d1cf"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:02.139609 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-566d7d88-51eb-4e47-b479-d83fee530fc1 req-61735b4d-94d4-42c7-96df-3c2fb8126e03 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:02.140325 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-566d7d88-51eb-4e47-b479-d83fee530fc1 req-61735b4d-94d4-42c7-96df-3c2fb8126e03 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:02.140932 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-566d7d88-51eb-4e47-b479-d83fee530fc1 req-61735b4d-94d4-42c7-96df-3c2fb8126e03 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:02.146305 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:05:02.155177 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-566d7d88-51eb-4e47-b479-d83fee530fc1 req-61735b4d-94d4-42c7-96df-3c2fb8126e03 service nova] Creating event network-changed:eefbc12d-6331-420c-be7b-da952bc9d1cf for instance dffc2812-b18a-4227-932f-3db590d7bc6f on n-h2-862686-1 Oct 26 13:05:02.161271 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-566d7d88-51eb-4e47-b479-d83fee530fc1 req-61735b4d-94d4-42c7-96df-3c2fb8126e03 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037766 Oct 26 13:05:02.162364 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 338/761] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:05:02.169167 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bbc1b21f-db92-4b44-a7b8-5d5a156e7c45 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:02.170280 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bbc1b21f-db92-4b44-a7b8-5d5a156e7c45 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 7da4bb85-b577-4608-a7c0-3320721cb997] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:02.180581 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bbc1b21f-db92-4b44-a7b8-5d5a156e7c45 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:02.181198 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bbc1b21f-db92-4b44-a7b8-5d5a156e7c45 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:02.181848 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bbc1b21f-db92-4b44-a7b8-5d5a156e7c45 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:02.182733 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bbc1b21f-db92-4b44-a7b8-5d5a156e7c45 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:02.183398 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bbc1b21f-db92-4b44-a7b8-5d5a156e7c45 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:02.184026 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bbc1b21f-db92-4b44-a7b8-5d5a156e7c45 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:02.264219 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bbc1b21f-db92-4b44-a7b8-5d5a156e7c45 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "POST /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997/action" status: 204 len: 0 microversion: 2.1 time: 0.099354 Oct 26 13:05:02.264776 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 339/762] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:05:02 2022] POST /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997/action => generated 0 bytes in 102 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:05:02.271140 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-423d5606-91a0-4716-ae56-3eb1661cf0cd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:02.278164 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-423d5606-91a0-4716-ae56-3eb1661cf0cd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:02.279788 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-423d5606-91a0-4716-ae56-3eb1661cf0cd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Searching by: {'reservation_id': 'r-d6i57yoj', 'deleted': False, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b'} {{(pid=120597) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:05:02.287514 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-423d5606-91a0-4716-ae56-3eb1661cf0cd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:02.288276 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-423d5606-91a0-4716-ae56-3eb1661cf0cd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:02.288923 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-423d5606-91a0-4716-ae56-3eb1661cf0cd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:02.290443 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-423d5606-91a0-4716-ae56-3eb1661cf0cd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:02.291236 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-423d5606-91a0-4716-ae56-3eb1661cf0cd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:02.291851 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-423d5606-91a0-4716-ae56-3eb1661cf0cd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:02.414611 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-29a182f2-03a2-4a86-8e7b-ed129ae4b70b tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:02.425019 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-29a182f2-03a2-4a86-8e7b-ed129ae4b70b tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:02.426901 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-29a182f2-03a2-4a86-8e7b-ed129ae4b70b tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:02.434428 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-29a182f2-03a2-4a86-8e7b-ed129ae4b70b tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] 10.222.0.40 "GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 200 len: 1464 microversion: 2.75 time: 0.524891 Oct 26 13:05:02.435283 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 424/763] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:05:01 2022] GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 1464 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:05:02.477028 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.multi_cell_list [None req-423d5606-91a0-4716-ae56-3eb1661cf0cd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120597) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 13:05:02.574429 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-423d5606-91a0-4716-ae56-3eb1661cf0cd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:02.594339 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-423d5606-91a0-4716-ae56-3eb1661cf0cd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:02.595574 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-423d5606-91a0-4716-ae56-3eb1661cf0cd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:02.596703 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-423d5606-91a0-4716-ae56-3eb1661cf0cd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:02.689385 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-26c4961b-7904-409f-ac80-5210cdc43b59 tempest-InstanceUsageAuditLogTestJSON-111304973 tempest-InstanceUsageAuditLogTestJSON-111304973-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:02.734447 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-26c4961b-7904-409f-ac80-5210cdc43b59 tempest-InstanceUsageAuditLogTestJSON-111304973 tempest-InstanceUsageAuditLogTestJSON-111304973-project-admin] 10.222.0.40 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-26 13:05:02" status: 200 len: 318 microversion: 2.1 time: 0.297254 Oct 26 13:05:02.735436 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 425/764] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Oct 26 13:05:02 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-26%2013%3A05%3A02 => generated 318 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:05:02.745511 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d43742c2-a907-472e-8077-3d6e641c2b08 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Action: 'action', calling method: .version_select at 0x7f6734cbee50>, body: {"addFloatingIp": {"address": "172.25.6.186"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:02.752443 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d43742c2-a907-472e-8077-3d6e641c2b08 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: 379653d7-e043-474c-9fdd-3d0f663caed1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:02.767592 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d43742c2-a907-472e-8077-3d6e641c2b08 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:02.768635 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d43742c2-a907-472e-8077-3d6e641c2b08 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:02.769563 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d43742c2-a907-472e-8077-3d6e641c2b08 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:02.775398 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d43742c2-a907-472e-8077-3d6e641c2b08 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:02.776738 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d43742c2-a907-472e-8077-3d6e641c2b08 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:02.777508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d43742c2-a907-472e-8077-3d6e641c2b08 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:02.883539 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d43742c2-a907-472e-8077-3d6e641c2b08 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "refresh_cache-379653d7-e043-474c-9fdd-3d0f663caed1" {{(pid=120598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 26 13:05:02.884516 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d43742c2-a907-472e-8077-3d6e641c2b08 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquired lock "refresh_cache-379653d7-e043-474c-9fdd-3d0f663caed1" {{(pid=120598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 26 13:05:03.037191 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-423d5606-91a0-4716-ae56-3eb1661cf0cd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/detail?reservation_id=r-d6i57yoj" status: 200 len: 2931 microversion: 2.1 time: 0.770934 Oct 26 13:05:03.052021 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 340/765] 10.222.0.40 () {58 vars in 1197 bytes} [Wed Oct 26 13:05:02 2022] GET /compute/v2.1/servers/detail?reservation_id=r-d6i57yoj => generated 2931 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:03.063732 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d242d721-e5c1-4ed9-ba97-cf2ec6748abd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:03.064731 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d242d721-e5c1-4ed9-ba97-cf2ec6748abd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 7da4bb85-b577-4608-a7c0-3320721cb997] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:03.102219 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d242d721-e5c1-4ed9-ba97-cf2ec6748abd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:03.105408 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d242d721-e5c1-4ed9-ba97-cf2ec6748abd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:03.106791 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d242d721-e5c1-4ed9-ba97-cf2ec6748abd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:03.108658 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d242d721-e5c1-4ed9-ba97-cf2ec6748abd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:03.109352 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d242d721-e5c1-4ed9-ba97-cf2ec6748abd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:03.110083 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d242d721-e5c1-4ed9-ba97-cf2ec6748abd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:03.468767 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d242d721-e5c1-4ed9-ba97-cf2ec6748abd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:03.491557 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d242d721-e5c1-4ed9-ba97-cf2ec6748abd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997" status: 200 len: 1470 microversion: 2.1 time: 0.437356 Oct 26 13:05:03.492744 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 341/766] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:03 2022] GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997 => generated 1470 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:03.529086 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c560aba0-a3c3-4de3-bbd7-0931d7546130 tempest-InstanceUsageAuditLogTestJSON-111304973 tempest-InstanceUsageAuditLogTestJSON-111304973-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:03.567690 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c560aba0-a3c3-4de3-bbd7-0931d7546130 tempest-InstanceUsageAuditLogTestJSON-111304973 tempest-InstanceUsageAuditLogTestJSON-111304973-project-admin] 10.222.0.40 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.073244 Oct 26 13:05:03.568403 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 342/767] 10.222.0.40 () {58 vars in 1185 bytes} [Wed Oct 26 13:05:03 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:05:03.573117 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-322aaa6a-b048-4a4e-a368-33a457ec3754 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:03.601412 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.compute.server_groups [None req-322aaa6a-b048-4a4e-a368-33a457ec3754 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Querying cell 2e5960f1-3c3d-401b-877c-fe82eb67bd3f(cell1) for 2 instances {{(pid=120597) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 26 13:05:03.603068 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-322aaa6a-b048-4a4e-a368-33a457ec3754 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:03.603625 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-322aaa6a-b048-4a4e-a368-33a457ec3754 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:03.604284 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-322aaa6a-b048-4a4e-a368-33a457ec3754 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:03.652529 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-322aaa6a-b048-4a4e-a368-33a457ec3754 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups/c60de25a-4a7c-479c-a06e-5f66faf76b57" status: 200 len: 265 microversion: 2.1 time: 0.080350 Oct 26 13:05:03.653532 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 343/768] 10.222.0.40 () {58 vars in 1263 bytes} [Wed Oct 26 13:05:03 2022] GET /compute/v2.1/os-server-groups/c60de25a-4a7c-479c-a06e-5f66faf76b57 => generated 265 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:05:03.663986 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e48543f3-f75c-4c57-929c-20f11b6c3862 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:03.665344 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e48543f3-f75c-4c57-929c-20f11b6c3862 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:03.672166 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e48543f3-f75c-4c57-929c-20f11b6c3862 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:03.672990 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e48543f3-f75c-4c57-929c-20f11b6c3862 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:03.673648 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e48543f3-f75c-4c57-929c-20f11b6c3862 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:03.674507 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e48543f3-f75c-4c57-929c-20f11b6c3862 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:03.675115 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e48543f3-f75c-4c57-929c-20f11b6c3862 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:03.675690 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e48543f3-f75c-4c57-929c-20f11b6c3862 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:03.851103 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e48543f3-f75c-4c57-929c-20f11b6c3862 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:03.879472 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e48543f3-f75c-4c57-929c-20f11b6c3862 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:03.882788 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e48543f3-f75c-4c57-929c-20f11b6c3862 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:03.892088 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e48543f3-f75c-4c57-929c-20f11b6c3862 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] 10.222.0.40 "GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 200 len: 1452 microversion: 2.75 time: 0.237233 Oct 26 13:05:03.892827 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 344/769] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:05:03 2022] GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 1452 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:05:03.897890 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f0015d89-0860-43ae-815f-6d7f0b2be3e0 tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:03.899939 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f0015d89-0860-43ae-815f-6d7f0b2be3e0 tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] [instance: 025e46ee-bd4b-4c43-96ce-ee086ecafe24] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:03.906719 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f0015d89-0860-43ae-815f-6d7f0b2be3e0 tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:03.907689 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f0015d89-0860-43ae-815f-6d7f0b2be3e0 tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:03.909112 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f0015d89-0860-43ae-815f-6d7f0b2be3e0 tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:03.910347 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f0015d89-0860-43ae-815f-6d7f0b2be3e0 tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:03.911077 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f0015d89-0860-43ae-815f-6d7f0b2be3e0 tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:03.911712 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f0015d89-0860-43ae-815f-6d7f0b2be3e0 tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:04.125798 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f0015d89-0860-43ae-815f-6d7f0b2be3e0 tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/025e46ee-bd4b-4c43-96ce-ee086ecafe24" status: 200 len: 1620 microversion: 2.1 time: 0.231609 Oct 26 13:05:04.127484 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 345/770] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:03 2022] GET /compute/v2.1/servers/025e46ee-bd4b-4c43-96ce-ee086ecafe24 => generated 1620 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:04.166288 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6a3792f1-5aa4-481d-9b7f-a9c02287a1ea tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:04.167281 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6a3792f1-5aa4-481d-9b7f-a9c02287a1ea tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] [instance: 60c4cea5-3b00-4614-a70d-e3fd589cc408] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:04.181177 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6a3792f1-5aa4-481d-9b7f-a9c02287a1ea tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:04.181800 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6a3792f1-5aa4-481d-9b7f-a9c02287a1ea tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:04.182314 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6a3792f1-5aa4-481d-9b7f-a9c02287a1ea tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:04.188126 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6a3792f1-5aa4-481d-9b7f-a9c02287a1ea tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:04.188697 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6a3792f1-5aa4-481d-9b7f-a9c02287a1ea tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:04.189208 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6a3792f1-5aa4-481d-9b7f-a9c02287a1ea tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:04.479617 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6a3792f1-5aa4-481d-9b7f-a9c02287a1ea tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/60c4cea5-3b00-4614-a70d-e3fd589cc408" status: 200 len: 1620 microversion: 2.1 time: 0.323900 Oct 26 13:05:04.480560 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 346/771] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:04 2022] GET /compute/v2.1/servers/60c4cea5-3b00-4614-a70d-e3fd589cc408 => generated 1620 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:04.508867 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b0d574af-18f2-4e6c-aaf3-23a9a62aedf1 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Action: 'create', calling method: .version_select at 0x7f6732d11d30>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1226948286", "policies": ["anti-affinity"]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:04.549465 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-b0d574af-18f2-4e6c-aaf3-23a9a62aedf1 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Getting quotas for project d6515917885c4f3cb5fb19e05f4e5e2b. Resources: {'server_groups'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:05:04.559980 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-b0d574af-18f2-4e6c-aaf3-23a9a62aedf1 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Getting quotas for user b6cddfeca4ce49788143b2bf4b30545f and project d6515917885c4f3cb5fb19e05f4e5e2b. Resources: {'server_groups'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:05:04.664865 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-b0d574af-18f2-4e6c-aaf3-23a9a62aedf1 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Getting quotas for project d6515917885c4f3cb5fb19e05f4e5e2b. Resources: {'server_groups'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:05:04.672630 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-b0d574af-18f2-4e6c-aaf3-23a9a62aedf1 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Getting quotas for user b6cddfeca4ce49788143b2bf4b30545f and project d6515917885c4f3cb5fb19e05f4e5e2b. Resources: {'server_groups'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:05:04.708464 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b0d574af-18f2-4e6c-aaf3-23a9a62aedf1 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.204400 Oct 26 13:05:04.710333 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 347/772] 10.222.0.40 () {60 vars in 1174 bytes} [Wed Oct 26 13:05:04 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:05:04.726396 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ceee9954-8a50-4a35-af2a-310dc8ff10ad tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:04.728001 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ceee9954-8a50-4a35-af2a-310dc8ff10ad tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 7da4bb85-b577-4608-a7c0-3320721cb997] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:04.742896 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ceee9954-8a50-4a35-af2a-310dc8ff10ad tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:04.745626 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ceee9954-8a50-4a35-af2a-310dc8ff10ad tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:04.746399 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ceee9954-8a50-4a35-af2a-310dc8ff10ad tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:04.748739 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ceee9954-8a50-4a35-af2a-310dc8ff10ad tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:04.751236 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ceee9954-8a50-4a35-af2a-310dc8ff10ad tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:04.751886 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ceee9954-8a50-4a35-af2a-310dc8ff10ad tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:05.010684 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ceee9954-8a50-4a35-af2a-310dc8ff10ad tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:05.020215 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ceee9954-8a50-4a35-af2a-310dc8ff10ad tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997" status: 200 len: 1470 microversion: 2.1 time: 0.307047 Oct 26 13:05:05.032715 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 348/773] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:04 2022] GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997 => generated 1470 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:05.045381 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-aaed42c9-c07a-416c-8830-05acb7073d5f tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1213136276", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "a574f105-f9c7-4f29-b8cf-d00793343b3a"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:05.148145 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-aaed42c9-c07a-416c-8830-05acb7073d5f tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] validate_networks() for None {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:05:05.589041 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-aaed42c9-c07a-416c-8830-05acb7073d5f tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:05:05.589845 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-aaed42c9-c07a-416c-8830-05acb7073d5f tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:05:05.590488 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-aaed42c9-c07a-416c-8830-05acb7073d5f tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:05:05.591041 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-aaed42c9-c07a-416c-8830-05acb7073d5f tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:05:05.591740 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-aaed42c9-c07a-416c-8830-05acb7073d5f tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:05:05.609611 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aaed42c9-c07a-416c-8830-05acb7073d5f tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:05.610177 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aaed42c9-c07a-416c-8830-05acb7073d5f tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:05.610508 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aaed42c9-c07a-416c-8830-05acb7073d5f tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:05.611230 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aaed42c9-c07a-416c-8830-05acb7073d5f tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:05.611681 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aaed42c9-c07a-416c-8830-05acb7073d5f tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:05.612090 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aaed42c9-c07a-416c-8830-05acb7073d5f tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:05.676687 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-aaed42c9-c07a-416c-8830-05acb7073d5f tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Getting quotas for project d6515917885c4f3cb5fb19e05f4e5e2b. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:05:05.683613 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-aaed42c9-c07a-416c-8830-05acb7073d5f tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Getting quotas for user b6cddfeca4ce49788143b2bf4b30545f and project d6515917885c4f3cb5fb19e05f4e5e2b. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:05:05.703648 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-aaed42c9-c07a-416c-8830-05acb7073d5f tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Going to run 2 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:05:05.706210 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-aaed42c9-c07a-416c-8830-05acb7073d5f tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 3c9dbe46-9160-491b-9efd-074333ee4d8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:05:05.823053 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-aaed42c9-c07a-416c-8830-05acb7073d5f tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Getting quotas for project d6515917885c4f3cb5fb19e05f4e5e2b. Resources: {'server_group_members'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:05:05.828540 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-aaed42c9-c07a-416c-8830-05acb7073d5f tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Getting quotas for user b6cddfeca4ce49788143b2bf4b30545f and project d6515917885c4f3cb5fb19e05f4e5e2b. Resources: {'server_group_members'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:05:05.921184 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-aaed42c9-c07a-416c-8830-05acb7073d5f tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Getting quotas for project d6515917885c4f3cb5fb19e05f4e5e2b. Resources: {'server_group_members'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:05:05.932939 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-aaed42c9-c07a-416c-8830-05acb7073d5f tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Getting quotas for user b6cddfeca4ce49788143b2bf4b30545f and project d6515917885c4f3cb5fb19e05f4e5e2b. Resources: {'server_group_members'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:05:05.966514 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-aaed42c9-c07a-416c-8830-05acb7073d5f tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 2358d550-6ed6-4529-b268-ffdf82f228ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=3c9dbe46-9160-491b-9efd-074333ee4d8c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:05:06.034496 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:05:06.065159 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-aaed42c9-c07a-416c-8830-05acb7073d5f tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Getting quotas for project d6515917885c4f3cb5fb19e05f4e5e2b. Resources: {'server_group_members'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:05:06.091421 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-aaed42c9-c07a-416c-8830-05acb7073d5f tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Getting quotas for user b6cddfeca4ce49788143b2bf4b30545f and project d6515917885c4f3cb5fb19e05f4e5e2b. Resources: {'server_group_members'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:05:06.147465 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-aaed42c9-c07a-416c-8830-05acb7073d5f tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Getting quotas for project d6515917885c4f3cb5fb19e05f4e5e2b. Resources: {'server_group_members'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:05:06.154644 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-aaed42c9-c07a-416c-8830-05acb7073d5f tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Getting quotas for user b6cddfeca4ce49788143b2bf4b30545f and project d6515917885c4f3cb5fb19e05f4e5e2b. Resources: {'server_group_members'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:05:06.201501 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-aaed42c9-c07a-416c-8830-05acb7073d5f tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.166550 Oct 26 13:05:06.202650 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 349/774] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:05:05 2022] POST /compute/v2.1/servers => generated 32 bytes in 1169 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 26 13:05:06.207873 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5d48bc0c-2edb-4f3a-ac1b-97dd40f38c09 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:06.208506 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5d48bc0c-2edb-4f3a-ac1b-97dd40f38c09 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:06.215897 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d48bc0c-2edb-4f3a-ac1b-97dd40f38c09 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:06.216326 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d48bc0c-2edb-4f3a-ac1b-97dd40f38c09 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:06.216824 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d48bc0c-2edb-4f3a-ac1b-97dd40f38c09 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:06.217629 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d48bc0c-2edb-4f3a-ac1b-97dd40f38c09 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:06.218078 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d48bc0c-2edb-4f3a-ac1b-97dd40f38c09 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:06.218495 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d48bc0c-2edb-4f3a-ac1b-97dd40f38c09 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:06.339856 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5d48bc0c-2edb-4f3a-ac1b-97dd40f38c09 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:06.348915 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5d48bc0c-2edb-4f3a-ac1b-97dd40f38c09 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:06.350705 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5d48bc0c-2edb-4f3a-ac1b-97dd40f38c09 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:06.356788 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5d48bc0c-2edb-4f3a-ac1b-97dd40f38c09 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] 10.222.0.40 "GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 200 len: 1437 microversion: 2.75 time: 0.152935 Oct 26 13:05:06.357476 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 350/775] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:05:06 2022] GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 1437 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:05:06.362492 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-b30191ae-e194-418b-8aa8-386c7653a11e req-5cdcc46d-f783-453c-be78-618ef949508b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7da4bb85-b577-4608-a7c0-3320721cb997", "name": "network-vif-plugged", "status": "completed", "tag": "612e62d8-c0dd-48c8-889d-f05c9055db41"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:06.372067 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-b30191ae-e194-418b-8aa8-386c7653a11e req-5cdcc46d-f783-453c-be78-618ef949508b service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:06.372819 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-b30191ae-e194-418b-8aa8-386c7653a11e req-5cdcc46d-f783-453c-be78-618ef949508b service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:06.373449 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-b30191ae-e194-418b-8aa8-386c7653a11e req-5cdcc46d-f783-453c-be78-618ef949508b service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:06.389474 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-b30191ae-e194-418b-8aa8-386c7653a11e req-5cdcc46d-f783-453c-be78-618ef949508b service nova] Creating event network-vif-plugged:612e62d8-c0dd-48c8-889d-f05c9055db41 for instance 7da4bb85-b577-4608-a7c0-3320721cb997 on n-h2-862686-1 Oct 26 13:05:06.395264 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-b30191ae-e194-418b-8aa8-386c7653a11e req-5cdcc46d-f783-453c-be78-618ef949508b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036302 Oct 26 13:05:06.396503 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 351/776] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:05:06.404298 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-756bf131-3fbc-48a7-993f-82af047af056 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:06.405281 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-756bf131-3fbc-48a7-993f-82af047af056 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 7da4bb85-b577-4608-a7c0-3320721cb997] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:06.411946 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-756bf131-3fbc-48a7-993f-82af047af056 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:06.412696 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-756bf131-3fbc-48a7-993f-82af047af056 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:06.413334 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-756bf131-3fbc-48a7-993f-82af047af056 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:06.414537 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-756bf131-3fbc-48a7-993f-82af047af056 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:06.415293 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-756bf131-3fbc-48a7-993f-82af047af056 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:06.415922 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-756bf131-3fbc-48a7-993f-82af047af056 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:06.581140 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-756bf131-3fbc-48a7-993f-82af047af056 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:06.592727 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-756bf131-3fbc-48a7-993f-82af047af056 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997" status: 200 len: 1462 microversion: 2.1 time: 0.194097 Oct 26 13:05:06.593701 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 352/777] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:06 2022] GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997 => generated 1462 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:06.600550 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d93f2d24-6bf2-4bab-8ff5-c29d4474b9b5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:06.606555 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d93f2d24-6bf2-4bab-8ff5-c29d4474b9b5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:06.607760 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d93f2d24-6bf2-4bab-8ff5-c29d4474b9b5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Searching by: {'deleted': False, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b'} {{(pid=120597) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:05:06.630205 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d93f2d24-6bf2-4bab-8ff5-c29d4474b9b5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:06.632761 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d93f2d24-6bf2-4bab-8ff5-c29d4474b9b5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:06.634234 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d93f2d24-6bf2-4bab-8ff5-c29d4474b9b5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:06.635594 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d93f2d24-6bf2-4bab-8ff5-c29d4474b9b5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:06.637017 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d93f2d24-6bf2-4bab-8ff5-c29d4474b9b5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:06.638578 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d93f2d24-6bf2-4bab-8ff5-c29d4474b9b5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:06.691872 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.multi_cell_list [None req-d93f2d24-6bf2-4bab-8ff5-c29d4474b9b5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=120597) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 13:05:06.725952 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d93f2d24-6bf2-4bab-8ff5-c29d4474b9b5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 1666 microversion: 2.1 time: 0.129771 Oct 26 13:05:06.727701 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 353/778] 10.222.0.40 () {58 vars in 1125 bytes} [Wed Oct 26 13:05:06 2022] GET /compute/v2.1/servers => generated 1666 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:07.066219 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e3f9ceab-42d4-46a4-86d2-26ba0fb04480 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:07.066219 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e3f9ceab-42d4-46a4-86d2-26ba0fb04480 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:07.077894 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3f9ceab-42d4-46a4-86d2-26ba0fb04480 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:07.082542 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3f9ceab-42d4-46a4-86d2-26ba0fb04480 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:07.084320 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3f9ceab-42d4-46a4-86d2-26ba0fb04480 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:07.086919 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3f9ceab-42d4-46a4-86d2-26ba0fb04480 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:07.087579 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3f9ceab-42d4-46a4-86d2-26ba0fb04480 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:07.088845 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3f9ceab-42d4-46a4-86d2-26ba0fb04480 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:07.254617 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-e3f9ceab-42d4-46a4-86d2-26ba0fb04480 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:05:07.254617 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-e3f9ceab-42d4-46a4-86d2-26ba0fb04480 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:05:07.255573 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-e3f9ceab-42d4-46a4-86d2-26ba0fb04480 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:05:07.255573 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-e3f9ceab-42d4-46a4-86d2-26ba0fb04480 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:05:07.255808 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-e3f9ceab-42d4-46a4-86d2-26ba0fb04480 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:05:07.373576 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e3f9ceab-42d4-46a4-86d2-26ba0fb04480 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:07.391716 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3f9ceab-42d4-46a4-86d2-26ba0fb04480 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:07.392225 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3f9ceab-42d4-46a4-86d2-26ba0fb04480 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:07.392674 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3f9ceab-42d4-46a4-86d2-26ba0fb04480 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:07.395695 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3f9ceab-42d4-46a4-86d2-26ba0fb04480 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:07.396794 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3f9ceab-42d4-46a4-86d2-26ba0fb04480 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:07.397414 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3f9ceab-42d4-46a4-86d2-26ba0fb04480 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:07.545800 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:05:07.637269 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-e3f9ceab-42d4-46a4-86d2-26ba0fb04480 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lazy-loading 'services' on Instance uuid ee752331-9c49-4c73-ac1e-2c38175ed9f3 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:05:07.663456 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e3f9ceab-42d4-46a4-86d2-26ba0fb04480 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3/action" status: 202 len: 1940 microversion: 2.75 time: 0.934389 Oct 26 13:05:07.666410 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 354/779] 10.222.0.40 () {62 vars in 1319 bytes} [Wed Oct 26 13:05:06 2022] POST /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3/action => generated 1940 bytes in 938 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 26 13:05:07.671815 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2530cf67-307a-4c91-af26-f68ed9d0ceae tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:07.672632 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2530cf67-307a-4c91-af26-f68ed9d0ceae tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 7da4bb85-b577-4608-a7c0-3320721cb997] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:07.680274 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2530cf67-307a-4c91-af26-f68ed9d0ceae tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:07.681289 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2530cf67-307a-4c91-af26-f68ed9d0ceae tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:07.690232 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2530cf67-307a-4c91-af26-f68ed9d0ceae tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:07.691520 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2530cf67-307a-4c91-af26-f68ed9d0ceae tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:07.692383 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2530cf67-307a-4c91-af26-f68ed9d0ceae tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:07.692961 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2530cf67-307a-4c91-af26-f68ed9d0ceae tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:07.916663 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2530cf67-307a-4c91-af26-f68ed9d0ceae tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:07.922301 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.network.neutron [None req-d43742c2-a907-472e-8077-3d6e641c2b08 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: 379653d7-e043-474c-9fdd-3d0f663caed1] re-assign floating IP 172.25.6.186 from instance dffc2812-b18a-4227-932f-3db590d7bc6f Oct 26 13:05:07.927723 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2530cf67-307a-4c91-af26-f68ed9d0ceae tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997" status: 200 len: 1462 microversion: 2.1 time: 0.259965 Oct 26 13:05:07.941508 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 355/780] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:07 2022] GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997 => generated 1462 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:07.942746 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7d692fe0-c558-444f-9336-8ab4a48e7e11 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:07.943401 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7d692fe0-c558-444f-9336-8ab4a48e7e11 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 2358d550-6ed6-4529-b268-ffdf82f228ff] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:07.957669 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d692fe0-c558-444f-9336-8ab4a48e7e11 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:07.961469 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d692fe0-c558-444f-9336-8ab4a48e7e11 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:07.961469 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d692fe0-c558-444f-9336-8ab4a48e7e11 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:07.961469 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d692fe0-c558-444f-9336-8ab4a48e7e11 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:07.961469 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d692fe0-c558-444f-9336-8ab4a48e7e11 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:07.961859 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d692fe0-c558-444f-9336-8ab4a48e7e11 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:08.044586 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7d692fe0-c558-444f-9336-8ab4a48e7e11 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:08.051661 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-d43742c2-a907-472e-8077-3d6e641c2b08 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: dffc2812-b18a-4227-932f-3db590d7bc6f] Building network info cache for instance {{(pid=120598) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 26 13:05:08.063286 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7d692fe0-c558-444f-9336-8ab4a48e7e11 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/2358d550-6ed6-4529-b268-ffdf82f228ff" status: 200 len: 1271 microversion: 2.1 time: 0.129425 Oct 26 13:05:08.064824 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 356/781] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:07 2022] GET /compute/v2.1/servers/2358d550-6ed6-4529-b268-ffdf82f228ff => generated 1271 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:08.069904 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-aac6155c-9c7e-4285-b29c-94edbd8154a9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-535760718", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "126fa8f9-6bcd-4196-bf93-7bb18cb15112"}], "security_groups": [{"name": "tempest-securitygroup--1659261302"}], "key_name": "tempest-keypair-1087202563", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:08.275192 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-aac6155c-9c7e-4285-b29c-94edbd8154a9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] validate_networks() for [('126fa8f9-6bcd-4196-bf93-7bb18cb15112', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:05:09.572328 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-aac6155c-9c7e-4285-b29c-94edbd8154a9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:05:09.573530 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-aac6155c-9c7e-4285-b29c-94edbd8154a9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:05:09.574222 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-aac6155c-9c7e-4285-b29c-94edbd8154a9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:05:09.574791 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-aac6155c-9c7e-4285-b29c-94edbd8154a9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:05:09.575370 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-aac6155c-9c7e-4285-b29c-94edbd8154a9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:05:09.589294 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aac6155c-9c7e-4285-b29c-94edbd8154a9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:09.590440 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aac6155c-9c7e-4285-b29c-94edbd8154a9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:09.591041 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aac6155c-9c7e-4285-b29c-94edbd8154a9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:09.592568 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aac6155c-9c7e-4285-b29c-94edbd8154a9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:09.593398 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aac6155c-9c7e-4285-b29c-94edbd8154a9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:09.594008 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aac6155c-9c7e-4285-b29c-94edbd8154a9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:09.623633 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-aac6155c-9c7e-4285-b29c-94edbd8154a9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Getting quotas for project 2f7b9165f0ff4c06a5d154ea24b17bac. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:05:09.629915 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-aac6155c-9c7e-4285-b29c-94edbd8154a9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Getting quotas for user 27f4a513ca654b0abf9f972e07270c10 and project 2f7b9165f0ff4c06a5d154ea24b17bac. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:05:09.647259 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-aac6155c-9c7e-4285-b29c-94edbd8154a9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:05:09.653723 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-aac6155c-9c7e-4285-b29c-94edbd8154a9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:05:09.776612 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-d43742c2-a907-472e-8077-3d6e641c2b08 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: dffc2812-b18a-4227-932f-3db590d7bc6f] Updating instance_info_cache with network_info: [{"id": "eefbc12d-6331-420c-be7b-da952bc9d1cf", "address": "fa:16:3e:b6:63:ec", "network": {"id": "d5dfe2c9-28ca-4cae-a6cc-e2ee7f3499d9", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-21236752-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ec66df09b6114f5dbd6678d5e848c737", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapeefbc12d-63", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120598) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 26 13:05:09.805997 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-aac6155c-9c7e-4285-b29c-94edbd8154a9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 1.739669 Oct 26 13:05:09.814832 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 357/782] 10.222.0.40 () {62 vars in 1188 bytes} [Wed Oct 26 13:05:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 1749 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 26 13:05:09.824514 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-d43742c2-a907-472e-8077-3d6e641c2b08 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: 379653d7-e043-474c-9fdd-3d0f663caed1] Building network info cache for instance {{(pid=120598) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 26 13:05:09.837243 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b3f4521c-fffe-4734-a2de-a886b564546b tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:09.839394 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b3f4521c-fffe-4734-a2de-a886b564546b tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:09.873364 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b3f4521c-fffe-4734-a2de-a886b564546b tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:09.876646 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b3f4521c-fffe-4734-a2de-a886b564546b tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:09.877304 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b3f4521c-fffe-4734-a2de-a886b564546b tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:09.878252 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b3f4521c-fffe-4734-a2de-a886b564546b tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:09.879024 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b3f4521c-fffe-4734-a2de-a886b564546b tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:09.880388 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b3f4521c-fffe-4734-a2de-a886b564546b tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:10.086954 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-b3f4521c-fffe-4734-a2de-a886b564546b tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lazy-loading 'services' on Instance uuid ee752331-9c49-4c73-ac1e-2c38175ed9f3 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:05:10.121123 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b3f4521c-fffe-4734-a2de-a886b564546b tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 200 len: 1927 microversion: 2.75 time: 0.304836 Oct 26 13:05:10.122107 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 358/783] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:05:09 2022] GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 1927 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:05:10.128745 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-78799ba1-e509-4cd7-821c-4f71533b9dbf req-74e62140-b170-41e0-a72a-a3974bdbf1df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dffc2812-b18a-4227-932f-3db590d7bc6f", "tag": "eefbc12d-6331-420c-be7b-da952bc9d1cf"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:10.154162 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-78799ba1-e509-4cd7-821c-4f71533b9dbf req-74e62140-b170-41e0-a72a-a3974bdbf1df service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:10.154908 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-78799ba1-e509-4cd7-821c-4f71533b9dbf req-74e62140-b170-41e0-a72a-a3974bdbf1df service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:10.155503 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-78799ba1-e509-4cd7-821c-4f71533b9dbf req-74e62140-b170-41e0-a72a-a3974bdbf1df service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:10.168828 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-78799ba1-e509-4cd7-821c-4f71533b9dbf req-74e62140-b170-41e0-a72a-a3974bdbf1df service nova] Creating event network-changed:eefbc12d-6331-420c-be7b-da952bc9d1cf for instance dffc2812-b18a-4227-932f-3db590d7bc6f on n-h2-862686-1 Oct 26 13:05:10.182412 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-78799ba1-e509-4cd7-821c-4f71533b9dbf req-74e62140-b170-41e0-a72a-a3974bdbf1df service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058656 Oct 26 13:05:10.183966 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 359/784] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:05:10.191099 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e2fc3ba0-c335-43f0-bbf1-92696ab15fc2 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Action: 'create', calling method: .version_select at 0x7f6732879ca0>, body: {"keypair": {"name": "tempest-keypair-1672155377", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPU33iPPLFxwXSCT1r+QxMIQxdQnib9svmrtZv4EFnllqBq56w4kLmoxX1FsRSiO8XtY4Jopzb8OMq5jCZsta0p+NlxkEbGQKjDdd1AQ3WIA3OIG7fBJP9EuOohKzvhe7A=="}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:10.236322 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-e2fc3ba0-c335-43f0-bbf1-92696ab15fc2 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Getting quotas for project 443f71d3ffde486b9072df264fea2f53. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:05:10.243350 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-e2fc3ba0-c335-43f0-bbf1-92696ab15fc2 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Getting quotas for user 03335593029b48dfb19fc9cdf6b382b0 and project 443f71d3ffde486b9072df264fea2f53. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:05:10.278566 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e2fc3ba0-c335-43f0-bbf1-92696ab15fc2 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.091983 Oct 26 13:05:10.279809 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 360/785] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 13:05:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:05:10.551785 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-978ee62a-8668-4dc6-9030-d9669523bab9 tempest-QuotasAdminTestV236-660208748 tempest-QuotasAdminTestV236-660208748-project-admin] Action: 'update', calling method: .version_select at 0x7f6732af93a0>, body: {"quota_set": {"ram": "5120"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:10.674861 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-978ee62a-8668-4dc6-9030-d9669523bab9 tempest-QuotasAdminTestV236-660208748 tempest-QuotasAdminTestV236-660208748-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:10.680969 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-978ee62a-8668-4dc6-9030-d9669523bab9 tempest-QuotasAdminTestV236-660208748 tempest-QuotasAdminTestV236-660208748-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:10.681554 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-978ee62a-8668-4dc6-9030-d9669523bab9 tempest-QuotasAdminTestV236-660208748 tempest-QuotasAdminTestV236-660208748-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:10.683048 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-978ee62a-8668-4dc6-9030-d9669523bab9 tempest-QuotasAdminTestV236-660208748 tempest-QuotasAdminTestV236-660208748-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:10.685640 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-978ee62a-8668-4dc6-9030-d9669523bab9 tempest-QuotasAdminTestV236-660208748 tempest-QuotasAdminTestV236-660208748-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:10.686267 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-978ee62a-8668-4dc6-9030-d9669523bab9 tempest-QuotasAdminTestV236-660208748 tempest-QuotasAdminTestV236-660208748-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:10.838663 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-978ee62a-8668-4dc6-9030-d9669523bab9 tempest-QuotasAdminTestV236-660208748 tempest-QuotasAdminTestV236-660208748-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/2f9eae055ba04c3380874a273da790a1" status: 200 len: 240 microversion: 2.36 time: 0.555989 Oct 26 13:05:10.847624 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 361/786] 10.222.0.40 () {62 vars in 1303 bytes} [Wed Oct 26 13:05:10 2022] PUT /compute/v2.1/os-quota-sets/2f9eae055ba04c3380874a273da790a1 => generated 240 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:05:10.856858 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-43903c01-64b3-42f3-81c7-0eb92dde4cbd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:10.857670 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-43903c01-64b3-42f3-81c7-0eb92dde4cbd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 2358d550-6ed6-4529-b268-ffdf82f228ff] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:10.859695 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:INSERT=9,nova_api:SELECT=91 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:05:10.875251 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-43903c01-64b3-42f3-81c7-0eb92dde4cbd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:10.876204 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-43903c01-64b3-42f3-81c7-0eb92dde4cbd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:10.886018 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-43903c01-64b3-42f3-81c7-0eb92dde4cbd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:10.889400 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-43903c01-64b3-42f3-81c7-0eb92dde4cbd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:10.889953 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-43903c01-64b3-42f3-81c7-0eb92dde4cbd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:10.890739 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-43903c01-64b3-42f3-81c7-0eb92dde4cbd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:11.152048 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-43903c01-64b3-42f3-81c7-0eb92dde4cbd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:11.162279 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-43903c01-64b3-42f3-81c7-0eb92dde4cbd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/2358d550-6ed6-4529-b268-ffdf82f228ff" status: 200 len: 1277 microversion: 2.1 time: 0.313453 Oct 26 13:05:11.167249 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 362/787] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:10 2022] GET /compute/v2.1/servers/2358d550-6ed6-4529-b268-ffdf82f228ff => generated 1277 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:11.172752 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8efecfdd-7e41-42fd-a6ad-3eabf36801f7 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:11.188624 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8efecfdd-7e41-42fd-a6ad-3eabf36801f7 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:11.217600 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8efecfdd-7e41-42fd-a6ad-3eabf36801f7 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:11.222408 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8efecfdd-7e41-42fd-a6ad-3eabf36801f7 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:11.227840 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8efecfdd-7e41-42fd-a6ad-3eabf36801f7 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:11.228697 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8efecfdd-7e41-42fd-a6ad-3eabf36801f7 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:11.229182 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8efecfdd-7e41-42fd-a6ad-3eabf36801f7 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:11.229657 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8efecfdd-7e41-42fd-a6ad-3eabf36801f7 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:11.490123 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-d43742c2-a907-472e-8077-3d6e641c2b08 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: 379653d7-e043-474c-9fdd-3d0f663caed1] Updating instance_info_cache with network_info: [{"id": "4cf33acb-9743-43dc-b7bb-9af2984d2817", "address": "fa:16:3e:bd:4e:32", "network": {"id": "d5dfe2c9-28ca-4cae-a6cc-e2ee7f3499d9", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-21236752-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ec66df09b6114f5dbd6678d5e848c737", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap4cf33acb-97", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120598) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 26 13:05:11.513346 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8efecfdd-7e41-42fd-a6ad-3eabf36801f7 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:11.518913 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d43742c2-a907-472e-8077-3d6e641c2b08 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Releasing lock "refresh_cache-379653d7-e043-474c-9fdd-3d0f663caed1" {{(pid=120598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 26 13:05:11.519784 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d43742c2-a907-472e-8077-3d6e641c2b08 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] 10.222.0.40 "POST /compute/v2.1/servers/379653d7-e043-474c-9fdd-3d0f663caed1/action" status: 202 len: 0 microversion: 2.1 time: 8.783214 Oct 26 13:05:11.525846 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 426/788] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:05:02 2022] POST /compute/v2.1/servers/379653d7-e043-474c-9fdd-3d0f663caed1/action => generated 0 bytes in 8789 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 26 13:05:11.531245 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8efecfdd-7e41-42fd-a6ad-3eabf36801f7 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:11.531858 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d6933b6e-210e-40d5-9fec-460ec35ee922 tempest-QuotasAdminTestV236-660208748 tempest-QuotasAdminTestV236-660208748-project-admin] Calling method '.version_select at 0x7f67329dd670>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:11.534424 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8efecfdd-7e41-42fd-a6ad-3eabf36801f7 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:11.537793 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8efecfdd-7e41-42fd-a6ad-3eabf36801f7 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924" status: 200 len: 1337 microversion: 2.25 time: 0.368405 Oct 26 13:05:11.541366 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 363/789] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:05:11 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 => generated 1337 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:05:11.566946 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b201c915-13bc-404c-9089-2481859f72bd tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:11.568179 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b201c915-13bc-404c-9089-2481859f72bd tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:11.614808 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b201c915-13bc-404c-9089-2481859f72bd tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:11.616944 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b201c915-13bc-404c-9089-2481859f72bd tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:11.618718 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b201c915-13bc-404c-9089-2481859f72bd tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:11.622178 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b201c915-13bc-404c-9089-2481859f72bd tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:11.622897 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b201c915-13bc-404c-9089-2481859f72bd tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:11.625735 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b201c915-13bc-404c-9089-2481859f72bd tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:11.819660 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-b201c915-13bc-404c-9089-2481859f72bd tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lazy-loading 'services' on Instance uuid ee752331-9c49-4c73-ac1e-2c38175ed9f3 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:05:11.864711 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b201c915-13bc-404c-9089-2481859f72bd tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 200 len: 1927 microversion: 2.75 time: 0.321601 Oct 26 13:05:11.866059 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 364/790] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:05:11 2022] GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 1927 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:05:11.871807 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-185d21c1-c3f8-4e09-ac93-c7d5bf20690e tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Action: 'action', calling method: .version_select at 0x7f673430cc10>, body: {"removeFloatingIp": {"address": "172.25.6.186"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:11.997580 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:DELETE=5,nova_api:SELECT=93,nova_api:INSERT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:05:12.013341 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6933b6e-210e-40d5-9fec-460ec35ee922 tempest-QuotasAdminTestV236-660208748 tempest-QuotasAdminTestV236-660208748-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:12.013846 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6933b6e-210e-40d5-9fec-460ec35ee922 tempest-QuotasAdminTestV236-660208748 tempest-QuotasAdminTestV236-660208748-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:12.014547 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6933b6e-210e-40d5-9fec-460ec35ee922 tempest-QuotasAdminTestV236-660208748 tempest-QuotasAdminTestV236-660208748-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:12.015270 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6933b6e-210e-40d5-9fec-460ec35ee922 tempest-QuotasAdminTestV236-660208748 tempest-QuotasAdminTestV236-660208748-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:12.015721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6933b6e-210e-40d5-9fec-460ec35ee922 tempest-QuotasAdminTestV236-660208748 tempest-QuotasAdminTestV236-660208748-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:12.016348 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6933b6e-210e-40d5-9fec-460ec35ee922 tempest-QuotasAdminTestV236-660208748 tempest-QuotasAdminTestV236-660208748-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:12.064020 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d6933b6e-210e-40d5-9fec-460ec35ee922 tempest-QuotasAdminTestV236-660208748 tempest-QuotasAdminTestV236-660208748-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/2f9eae055ba04c3380874a273da790a1/detail" status: 200 len: 672 microversion: 2.36 time: 0.536652 Oct 26 13:05:12.065367 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 427/791] 10.222.0.40 () {60 vars in 1304 bytes} [Wed Oct 26 13:05:11 2022] GET /compute/v2.1/os-quota-sets/2f9eae055ba04c3380874a273da790a1/detail => generated 672 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:05:12.199946 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2f0e0162-8f00-4be4-a5f1-9d2dca1f53eb tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:12.201107 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2f0e0162-8f00-4be4-a5f1-9d2dca1f53eb tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 2358d550-6ed6-4529-b268-ffdf82f228ff] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:12.213201 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f0e0162-8f00-4be4-a5f1-9d2dca1f53eb tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:12.217707 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f0e0162-8f00-4be4-a5f1-9d2dca1f53eb tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:12.218407 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f0e0162-8f00-4be4-a5f1-9d2dca1f53eb tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:12.219390 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f0e0162-8f00-4be4-a5f1-9d2dca1f53eb tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:12.220530 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f0e0162-8f00-4be4-a5f1-9d2dca1f53eb tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:12.223724 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f0e0162-8f00-4be4-a5f1-9d2dca1f53eb tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:12.465134 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-185d21c1-c3f8-4e09-ac93-c7d5bf20690e tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: 379653d7-e043-474c-9fdd-3d0f663caed1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:12.475322 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-185d21c1-c3f8-4e09-ac93-c7d5bf20690e tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:12.477292 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-185d21c1-c3f8-4e09-ac93-c7d5bf20690e tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:12.481452 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-185d21c1-c3f8-4e09-ac93-c7d5bf20690e tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:12.484003 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-185d21c1-c3f8-4e09-ac93-c7d5bf20690e tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:12.486094 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-185d21c1-c3f8-4e09-ac93-c7d5bf20690e tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:12.487708 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-185d21c1-c3f8-4e09-ac93-c7d5bf20690e tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:12.846275 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2f0e0162-8f00-4be4-a5f1-9d2dca1f53eb tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:12.858596 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2f0e0162-8f00-4be4-a5f1-9d2dca1f53eb tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/2358d550-6ed6-4529-b268-ffdf82f228ff" status: 200 len: 1319 microversion: 2.1 time: 0.667931 Oct 26 13:05:12.874495 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 428/792] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:12 2022] GET /compute/v2.1/servers/2358d550-6ed6-4529-b268-ffdf82f228ff => generated 1319 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:05:12.881421 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-2dcd97d4-50c9-40e2-bcc3-cb5db40b5ba5 req-9e94c244-efbb-41fb-8088-dc58502fc6a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "379653d7-e043-474c-9fdd-3d0f663caed1", "tag": "4cf33acb-9743-43dc-b7bb-9af2984d2817"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:12.897110 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-2dcd97d4-50c9-40e2-bcc3-cb5db40b5ba5 req-9e94c244-efbb-41fb-8088-dc58502fc6a9 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:12.898126 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-2dcd97d4-50c9-40e2-bcc3-cb5db40b5ba5 req-9e94c244-efbb-41fb-8088-dc58502fc6a9 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:12.899509 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-2dcd97d4-50c9-40e2-bcc3-cb5db40b5ba5 req-9e94c244-efbb-41fb-8088-dc58502fc6a9 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:12.914932 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-2dcd97d4-50c9-40e2-bcc3-cb5db40b5ba5 req-9e94c244-efbb-41fb-8088-dc58502fc6a9 service nova] Creating event network-changed:4cf33acb-9743-43dc-b7bb-9af2984d2817 for instance 379653d7-e043-474c-9fdd-3d0f663caed1 on n-h1-862686-1 Oct 26 13:05:12.923493 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-2dcd97d4-50c9-40e2-bcc3-cb5db40b5ba5 req-9e94c244-efbb-41fb-8088-dc58502fc6a9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047027 Oct 26 13:05:12.925091 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 429/793] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:05:12.968048 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-06cd2d68-d220-4b0d-aecd-ac9d43e70fd4 tempest-QuotasAdminTestV236-660208748 tempest-QuotasAdminTestV236-660208748-project-admin] Action: 'update', calling method: .version_select at 0x7f6732907430>, body: {"quota_set": {"ram": "2048"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:13.389116 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06cd2d68-d220-4b0d-aecd-ac9d43e70fd4 tempest-QuotasAdminTestV236-660208748 tempest-QuotasAdminTestV236-660208748-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:13.389671 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06cd2d68-d220-4b0d-aecd-ac9d43e70fd4 tempest-QuotasAdminTestV236-660208748 tempest-QuotasAdminTestV236-660208748-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:13.390112 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06cd2d68-d220-4b0d-aecd-ac9d43e70fd4 tempest-QuotasAdminTestV236-660208748 tempest-QuotasAdminTestV236-660208748-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:13.390845 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06cd2d68-d220-4b0d-aecd-ac9d43e70fd4 tempest-QuotasAdminTestV236-660208748 tempest-QuotasAdminTestV236-660208748-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:13.391304 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06cd2d68-d220-4b0d-aecd-ac9d43e70fd4 tempest-QuotasAdminTestV236-660208748 tempest-QuotasAdminTestV236-660208748-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:13.391752 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06cd2d68-d220-4b0d-aecd-ac9d43e70fd4 tempest-QuotasAdminTestV236-660208748 tempest-QuotasAdminTestV236-660208748-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:13.432853 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06cd2d68-d220-4b0d-aecd-ac9d43e70fd4 tempest-QuotasAdminTestV236-660208748 tempest-QuotasAdminTestV236-660208748-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:13.433235 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06cd2d68-d220-4b0d-aecd-ac9d43e70fd4 tempest-QuotasAdminTestV236-660208748 tempest-QuotasAdminTestV236-660208748-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:13.433712 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06cd2d68-d220-4b0d-aecd-ac9d43e70fd4 tempest-QuotasAdminTestV236-660208748 tempest-QuotasAdminTestV236-660208748-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:13.434517 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06cd2d68-d220-4b0d-aecd-ac9d43e70fd4 tempest-QuotasAdminTestV236-660208748 tempest-QuotasAdminTestV236-660208748-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:13.434982 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06cd2d68-d220-4b0d-aecd-ac9d43e70fd4 tempest-QuotasAdminTestV236-660208748 tempest-QuotasAdminTestV236-660208748-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:13.435424 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06cd2d68-d220-4b0d-aecd-ac9d43e70fd4 tempest-QuotasAdminTestV236-660208748 tempest-QuotasAdminTestV236-660208748-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:13.492523 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-06cd2d68-d220-4b0d-aecd-ac9d43e70fd4 tempest-QuotasAdminTestV236-660208748 tempest-QuotasAdminTestV236-660208748-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/2f9eae055ba04c3380874a273da790a1?user_id=000e427bb56c423dbae2a61defaf40b1" status: 200 len: 240 microversion: 2.36 time: 0.565032 Oct 26 13:05:13.494122 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 430/794] 10.222.0.40 () {62 vars in 1384 bytes} [Wed Oct 26 13:05:12 2022] PUT /compute/v2.1/os-quota-sets/2f9eae055ba04c3380874a273da790a1?user_id=000e427bb56c423dbae2a61defaf40b1 => generated 240 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:05:13.502372 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5e260163-9956-49ac-be2e-97d6aea828ee tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:13.503160 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5e260163-9956-49ac-be2e-97d6aea828ee tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:13.512507 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5e260163-9956-49ac-be2e-97d6aea828ee tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:13.513280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5e260163-9956-49ac-be2e-97d6aea828ee tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:13.514167 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5e260163-9956-49ac-be2e-97d6aea828ee tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:13.515109 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5e260163-9956-49ac-be2e-97d6aea828ee tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:13.515599 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5e260163-9956-49ac-be2e-97d6aea828ee tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:13.516006 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5e260163-9956-49ac-be2e-97d6aea828ee tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:13.547641 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-185d21c1-c3f8-4e09-ac93-c7d5bf20690e tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] HTTP exception thrown: Floating IP 172.25.6.186 is not associated with instance dffc2812-b18a-4227-932f-3db590d7bc6f. Oct 26 13:05:13.551036 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-185d21c1-c3f8-4e09-ac93-c7d5bf20690e tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Request method failure captured: Oct 26 13:05:13.551036 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f/action HTTP/1.1 Oct 26 13:05:13.551036 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:05:13.551036 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:05:13.551036 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:05:13.551036 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 49 Oct 26 13:05:13.551036 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:05:13.551036 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:05:13.551036 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:05:13.551036 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:05:13.551036 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTBKlCssWTS3uIuvlb3qZMdrcWLduqRK6y7lYGMWJKaDHyabA3HHbK1QJy8wrLendLe8dvg8CEJOPjdcSkeq6wxwfMyXdDGwE64sIJ83eNlGzDxyhs0m4j6793IdF74Jx8R93iNbASvgGAA564NMv82dimk84r03I-CCjsHCyFlT9wI Oct 26 13:05:13.551036 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:05:13.551036 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:05:13.551036 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:05:13.551036 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:05:13.551036 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:05:13.551036 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:05:13.551036 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: ec66df09b6114f5dbd6678d5e848c737 Oct 26 13:05:13.551036 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1445427066 Oct 26 13:05:13.551036 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:05:13.551036 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:05:13.552381 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ec66df09b6114f5dbd6678d5e848c737"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ec66df09b6114f5dbd6678d5e848c737"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ec66df09b6114f5dbd6678d5e848c737"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ec66df09b6114f5dbd6678d5e848c737"}]}] Oct 26 13:05:13.552381 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1445427066 Oct 26 13:05:13.552381 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: ec66df09b6114f5dbd6678d5e848c737 Oct 26 13:05:13.552381 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1445427066 Oct 26 13:05:13.552381 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-FloatingIPsAssociationTestJSON-1445427066-project Oct 26 13:05:13.552381 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:05:13.552381 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:05:13.552381 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 241a2299894849c889ee7f1100a9823d Oct 26 13:05:13.552381 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1445427066-project Oct 26 13:05:13.552381 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:05:13.552381 n-d-862686-1 devstack@n-api.service[120597]: {"removeFloatingIp": {"address": "172.25.6.186"}} Oct 26 13:05:13.552381 n-d-862686-1 devstack@n-api.service[120597]: method: Oct 26 13:05:13.552381 n-d-862686-1 devstack@n-api.service[120597]: exception: Floating IP 172.25.6.186 is not associated with instance dffc2812-b18a-4227-932f-3db590d7bc6f. Oct 26 13:05:13.553187 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'dffc2812-b18a-4227-932f-3db590d7bc6f', 'body': {'removeFloatingIp': {'address': '172.25.6.186'}}} Oct 26 13:05:13.553187 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:05:13.553187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:05:13.553187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:05:13.553187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:05:13.553187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:05:13.553187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:05:13.553187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:05:13.553187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:05:13.553187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:05:13.553187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:05:13.553187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:05:13.553187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:05:13.553187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 26 13:05:13.553187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 26 13:05:13.553187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.6.186 is not associated with instance dffc2812-b18a-4227-932f-3db590d7bc6f. Oct 26 13:05:13.553187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:05:13.553187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:05:13.553187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:05:13.553187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:05:13.555311 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:05:13.555311 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:05:13.555311 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:05:13.555311 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:05:13.555311 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.6.186 is not associated with instance dffc2812-b18a-4227-932f-3db590d7bc6f. Oct 26 13:05:13.555311 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:05:13.555861 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-185d21c1-c3f8-4e09-ac93-c7d5bf20690e tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Returning 409 to user: Floating IP 172.25.6.186 is not associated with instance dffc2812-b18a-4227-932f-3db590d7bc6f. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:05:13.556711 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-185d21c1-c3f8-4e09-ac93-c7d5bf20690e tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] 10.222.0.40 "POST /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f/action" status: 409 len: 146 microversion: 2.1 time: 1.689552 Oct 26 13:05:13.557316 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 365/795] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:05:11 2022] POST /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f/action => generated 146 bytes in 1691 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:05:13.563783 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-62ad5099-18a2-4b03-a56c-bb151fdbcc13 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:13.564409 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-62ad5099-18a2-4b03-a56c-bb151fdbcc13 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:13.571007 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-62ad5099-18a2-4b03-a56c-bb151fdbcc13 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:13.571652 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-62ad5099-18a2-4b03-a56c-bb151fdbcc13 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:13.572090 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-62ad5099-18a2-4b03-a56c-bb151fdbcc13 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:13.572984 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-62ad5099-18a2-4b03-a56c-bb151fdbcc13 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:13.573669 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-62ad5099-18a2-4b03-a56c-bb151fdbcc13 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:13.574272 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-62ad5099-18a2-4b03-a56c-bb151fdbcc13 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:13.748596 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-62ad5099-18a2-4b03-a56c-bb151fdbcc13 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lazy-loading 'services' on Instance uuid ee752331-9c49-4c73-ac1e-2c38175ed9f3 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:05:13.772550 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-62ad5099-18a2-4b03-a56c-bb151fdbcc13 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 200 len: 1927 microversion: 2.75 time: 0.213959 Oct 26 13:05:13.778693 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 366/796] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:05:13 2022] GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 1927 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:05:13.784614 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-824274f0-790b-422b-818d-5f4c2d3f9841 tempest-QuotasAdminTestV236-660208748 tempest-QuotasAdminTestV236-660208748-project-admin] Calling method '.version_select at 0x7f67327d6f70>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:13.908188 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5e260163-9956-49ac-be2e-97d6aea828ee tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:13.917278 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5e260163-9956-49ac-be2e-97d6aea828ee tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:13.919123 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5e260163-9956-49ac-be2e-97d6aea828ee tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:13.920515 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5e260163-9956-49ac-be2e-97d6aea828ee tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924" status: 200 len: 1343 microversion: 2.25 time: 0.425305 Oct 26 13:05:13.934897 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 431/797] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:05:13 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 => generated 1343 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:05:13.949189 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9b5e2384-7d83-47d0-8068-5beb951e7569 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Action: 'action', calling method: .version_select at 0x7f6734560310>, body: {"removeFloatingIp": {"address": "172.25.6.186"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:13.971684 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-824274f0-790b-422b-818d-5f4c2d3f9841 tempest-QuotasAdminTestV236-660208748 tempest-QuotasAdminTestV236-660208748-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/2f9eae055ba04c3380874a273da790a1?user_id=000e427bb56c423dbae2a61defaf40b1" status: 200 len: 282 microversion: 2.36 time: 0.190919 Oct 26 13:05:13.973139 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 367/798] 10.222.0.40 () {60 vars in 1364 bytes} [Wed Oct 26 13:05:13 2022] GET /compute/v2.1/os-quota-sets/2f9eae055ba04c3380874a273da790a1?user_id=000e427bb56c423dbae2a61defaf40b1 => generated 282 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:05:13.986485 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-282d84a9-97ab-42b6-8c11-76e0282d4a5a tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:13.987349 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-282d84a9-97ab-42b6-8c11-76e0282d4a5a tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 2358d550-6ed6-4529-b268-ffdf82f228ff] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:13.997899 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-282d84a9-97ab-42b6-8c11-76e0282d4a5a tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:13.998852 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-282d84a9-97ab-42b6-8c11-76e0282d4a5a tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:13.999567 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-282d84a9-97ab-42b6-8c11-76e0282d4a5a tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:14.000600 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-282d84a9-97ab-42b6-8c11-76e0282d4a5a tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:14.001277 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-282d84a9-97ab-42b6-8c11-76e0282d4a5a tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:14.002275 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-282d84a9-97ab-42b6-8c11-76e0282d4a5a tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:14.263272 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9b5e2384-7d83-47d0-8068-5beb951e7569 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: 379653d7-e043-474c-9fdd-3d0f663caed1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:14.279447 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b5e2384-7d83-47d0-8068-5beb951e7569 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:14.282349 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b5e2384-7d83-47d0-8068-5beb951e7569 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:14.302858 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b5e2384-7d83-47d0-8068-5beb951e7569 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:14.307792 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b5e2384-7d83-47d0-8068-5beb951e7569 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:14.309063 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b5e2384-7d83-47d0-8068-5beb951e7569 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:14.309882 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b5e2384-7d83-47d0-8068-5beb951e7569 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:14.660801 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-282d84a9-97ab-42b6-8c11-76e0282d4a5a tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:14.674632 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-282d84a9-97ab-42b6-8c11-76e0282d4a5a tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/2358d550-6ed6-4529-b268-ffdf82f228ff" status: 200 len: 1319 microversion: 2.1 time: 0.699739 Oct 26 13:05:14.686835 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 368/799] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:13 2022] GET /compute/v2.1/servers/2358d550-6ed6-4529-b268-ffdf82f228ff => generated 1319 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:14.697826 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a2a49352-bad6-4812-a2b2-59b4fee1e49c tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Calling method '.version_select at 0x7f6732af98b0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:14.701828 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2a49352-bad6-4812-a2b2-59b4fee1e49c tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:14.702577 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2a49352-bad6-4812-a2b2-59b4fee1e49c tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:14.703285 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2a49352-bad6-4812-a2b2-59b4fee1e49c tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:14.714007 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a2a49352-bad6-4812-a2b2-59b4fee1e49c tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 1570 microversion: 2.1 time: 0.025516 Oct 26 13:05:14.715442 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 369/800] 10.222.0.40 () {58 vars in 1143 bytes} [Wed Oct 26 13:05:14 2022] GET /compute/v2.1/os-migrations => generated 1570 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:14.741932 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-b2abd845-8546-4825-bbe9-bbb9c6808bc8 req-c4f30b2c-e37e-4709-9872-3b83645ab68e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c9dbe46-9160-491b-9efd-074333ee4d8c", "tag": "166b9e43-0e45-4f63-b683-f951ebddd062"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:14.756358 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-b2abd845-8546-4825-bbe9-bbb9c6808bc8 req-c4f30b2c-e37e-4709-9872-3b83645ab68e service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:14.758997 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-b2abd845-8546-4825-bbe9-bbb9c6808bc8 req-c4f30b2c-e37e-4709-9872-3b83645ab68e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:14.759849 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-b2abd845-8546-4825-bbe9-bbb9c6808bc8 req-c4f30b2c-e37e-4709-9872-3b83645ab68e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:14.778777 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-b2abd845-8546-4825-bbe9-bbb9c6808bc8 req-c4f30b2c-e37e-4709-9872-3b83645ab68e service nova] Creating event network-changed:166b9e43-0e45-4f63-b683-f951ebddd062 for instance 3c9dbe46-9160-491b-9efd-074333ee4d8c on n-h1-862686-1 Oct 26 13:05:14.785469 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-b2abd845-8546-4825-bbe9-bbb9c6808bc8 req-c4f30b2c-e37e-4709-9872-3b83645ab68e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068089 Oct 26 13:05:14.787204 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 370/801] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:05:14.794382 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dc74b5c0-08fe-4149-bfa0-76f5bdccda40 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:14.803908 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-dc74b5c0-08fe-4149-bfa0-76f5bdccda40 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015103 Oct 26 13:05:14.809728 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 371/802] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 26 13:05:14 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:05:14.813275 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b5e2384-7d83-47d0-8068-5beb951e7569 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "refresh_cache-379653d7-e043-474c-9fdd-3d0f663caed1" {{(pid=120598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 26 13:05:14.814088 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b5e2384-7d83-47d0-8068-5beb951e7569 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquired lock "refresh_cache-379653d7-e043-474c-9fdd-3d0f663caed1" {{(pid=120598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 26 13:05:14.824580 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-757a64e3-88d0-430b-b12b-895e5abe5b2a tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:14.826291 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-757a64e3-88d0-430b-b12b-895e5abe5b2a tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:14.834815 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-757a64e3-88d0-430b-b12b-895e5abe5b2a tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:14.835796 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-757a64e3-88d0-430b-b12b-895e5abe5b2a tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:14.837901 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-757a64e3-88d0-430b-b12b-895e5abe5b2a tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:14.838700 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-757a64e3-88d0-430b-b12b-895e5abe5b2a tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:14.842602 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-757a64e3-88d0-430b-b12b-895e5abe5b2a tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:14.843037 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-757a64e3-88d0-430b-b12b-895e5abe5b2a tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:15.087911 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-757a64e3-88d0-430b-b12b-895e5abe5b2a tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lazy-loading 'services' on Instance uuid ee752331-9c49-4c73-ac1e-2c38175ed9f3 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:05:15.136830 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-757a64e3-88d0-430b-b12b-895e5abe5b2a tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 200 len: 1927 microversion: 2.75 time: 0.330044 Oct 26 13:05:15.139351 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 372/803] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:05:14 2022] GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 1927 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:05:15.166023 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-81dc385c-5636-454a-afc7-0a7e18a652db tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1102669246", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:15.208960 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-81dc385c-5636-454a-afc7-0a7e18a652db tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.049385 Oct 26 13:05:15.209587 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 373/804] 10.222.0.40 () {60 vars in 1146 bytes} [Wed Oct 26 13:05:15 2022] POST /compute/v2.1/flavors => generated 499 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:05:15.222730 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-948e3b3e-d3de-4109-bde0-03639218856e tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:15.229160 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-948e3b3e-d3de-4109-bde0-03639218856e tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:15.238392 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-948e3b3e-d3de-4109-bde0-03639218856e tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:15.239719 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-948e3b3e-d3de-4109-bde0-03639218856e tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:15.240559 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-948e3b3e-d3de-4109-bde0-03639218856e tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:15.242521 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-948e3b3e-d3de-4109-bde0-03639218856e tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:15.243288 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-948e3b3e-d3de-4109-bde0-03639218856e tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:15.243958 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-948e3b3e-d3de-4109-bde0-03639218856e tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:15.632561 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-948e3b3e-d3de-4109-bde0-03639218856e tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:15.644041 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-948e3b3e-d3de-4109-bde0-03639218856e tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:15.646183 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-948e3b3e-d3de-4109-bde0-03639218856e tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:15.647476 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-948e3b3e-d3de-4109-bde0-03639218856e tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924" status: 200 len: 1411 microversion: 2.25 time: 0.434136 Oct 26 13:05:15.648118 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 374/805] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:05:15 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 => generated 1411 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:05:15.661025 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-73b84246-9765-455f-8993-fd7a515a74ec tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:15.672574 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-73b84246-9765-455f-8993-fd7a515a74ec tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.022117 Oct 26 13:05:15.673878 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 375/806] 10.222.0.40 () {58 vars in 1182 bytes} [Wed Oct 26 13:05:15 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:05:15.700587 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0fc43933-aa7d-4d41-957d-7143ca74724c tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:15.701197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0fc43933-aa7d-4d41-957d-7143ca74724c tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 2358d550-6ed6-4529-b268-ffdf82f228ff] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:15.707107 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0fc43933-aa7d-4d41-957d-7143ca74724c tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:15.707918 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0fc43933-aa7d-4d41-957d-7143ca74724c tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:15.708514 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0fc43933-aa7d-4d41-957d-7143ca74724c tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:15.709269 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0fc43933-aa7d-4d41-957d-7143ca74724c tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:15.709823 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0fc43933-aa7d-4d41-957d-7143ca74724c tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:15.710489 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0fc43933-aa7d-4d41-957d-7143ca74724c tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:15.931316 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0fc43933-aa7d-4d41-957d-7143ca74724c tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:15.939572 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0fc43933-aa7d-4d41-957d-7143ca74724c tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/2358d550-6ed6-4529-b268-ffdf82f228ff" status: 200 len: 1319 microversion: 2.1 time: 0.242871 Oct 26 13:05:15.940374 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 376/807] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:15 2022] GET /compute/v2.1/servers/2358d550-6ed6-4529-b268-ffdf82f228ff => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:05:15.946033 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-84c6749f-25cf-492a-b954-9a5c32de89b1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1798369226", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "bdaded09-0e46-4d65-bf81-f885dd5c6898"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:16.005212 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-84c6749f-25cf-492a-b954-9a5c32de89b1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] validate_networks() for None {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:05:16.526481 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-9b5e2384-7d83-47d0-8068-5beb951e7569 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: 379653d7-e043-474c-9fdd-3d0f663caed1] Building network info cache for instance {{(pid=120598) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 26 13:05:16.582456 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-84c6749f-25cf-492a-b954-9a5c32de89b1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:05:16.583155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-84c6749f-25cf-492a-b954-9a5c32de89b1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:05:16.583790 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-84c6749f-25cf-492a-b954-9a5c32de89b1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:05:16.584378 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-84c6749f-25cf-492a-b954-9a5c32de89b1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:05:16.585173 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-84c6749f-25cf-492a-b954-9a5c32de89b1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:05:16.597403 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-84c6749f-25cf-492a-b954-9a5c32de89b1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:16.598219 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-84c6749f-25cf-492a-b954-9a5c32de89b1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:16.598804 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-84c6749f-25cf-492a-b954-9a5c32de89b1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:16.599698 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-84c6749f-25cf-492a-b954-9a5c32de89b1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:16.601077 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-84c6749f-25cf-492a-b954-9a5c32de89b1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:16.602573 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-84c6749f-25cf-492a-b954-9a5c32de89b1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:16.625096 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-84c6749f-25cf-492a-b954-9a5c32de89b1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Getting quotas for project 443f71d3ffde486b9072df264fea2f53. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:05:16.631148 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-84c6749f-25cf-492a-b954-9a5c32de89b1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Getting quotas for user 03335593029b48dfb19fc9cdf6b382b0 and project 443f71d3ffde486b9072df264fea2f53. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:05:16.647365 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-84c6749f-25cf-492a-b954-9a5c32de89b1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:05:16.650172 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-84c6749f-25cf-492a-b954-9a5c32de89b1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:05:16.728864 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-84c6749f-25cf-492a-b954-9a5c32de89b1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.786280 Oct 26 13:05:16.731807 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 377/808] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:05:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:05:16.741882 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-226b5080-1ba2-4717-b735-bc8bcd4b105a tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:16.743216 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-226b5080-1ba2-4717-b735-bc8bcd4b105a tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:16.759924 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-226b5080-1ba2-4717-b735-bc8bcd4b105a tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:16.760831 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-226b5080-1ba2-4717-b735-bc8bcd4b105a tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:16.761451 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-226b5080-1ba2-4717-b735-bc8bcd4b105a tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:16.762327 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-226b5080-1ba2-4717-b735-bc8bcd4b105a tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:16.762937 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-226b5080-1ba2-4717-b735-bc8bcd4b105a tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:16.763526 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-226b5080-1ba2-4717-b735-bc8bcd4b105a tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:16.934129 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:05:16.951517 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-226b5080-1ba2-4717-b735-bc8bcd4b105a tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lazy-loading 'services' on Instance uuid ee752331-9c49-4c73-ac1e-2c38175ed9f3 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:05:17.003589 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-226b5080-1ba2-4717-b735-bc8bcd4b105a tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 200 len: 1927 microversion: 2.75 time: 0.268249 Oct 26 13:05:17.010118 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 378/809] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:05:16 2022] GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 1927 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:05:17.020354 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-8e5f6568-9ad6-43ff-aacf-b65c1089126b req-bf8806cb-577f-4312-853d-f36e73897a55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "379653d7-e043-474c-9fdd-3d0f663caed1", "tag": "4cf33acb-9743-43dc-b7bb-9af2984d2817"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:17.055512 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-8e5f6568-9ad6-43ff-aacf-b65c1089126b req-bf8806cb-577f-4312-853d-f36e73897a55 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:17.055512 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-8e5f6568-9ad6-43ff-aacf-b65c1089126b req-bf8806cb-577f-4312-853d-f36e73897a55 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:17.059590 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-8e5f6568-9ad6-43ff-aacf-b65c1089126b req-bf8806cb-577f-4312-853d-f36e73897a55 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:17.087896 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-8e5f6568-9ad6-43ff-aacf-b65c1089126b req-bf8806cb-577f-4312-853d-f36e73897a55 service nova] Creating event network-changed:4cf33acb-9743-43dc-b7bb-9af2984d2817 for instance 379653d7-e043-474c-9fdd-3d0f663caed1 on n-h1-862686-1 Oct 26 13:05:17.098412 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-8e5f6568-9ad6-43ff-aacf-b65c1089126b req-bf8806cb-577f-4312-853d-f36e73897a55 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086742 Oct 26 13:05:17.103808 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 379/810] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:05:17.126394 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dc74932b-ad78-4257-b088-0481ae27f0f5 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:17.128315 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-dc74932b-ad78-4257-b088-0481ae27f0f5 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:17.138437 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc74932b-ad78-4257-b088-0481ae27f0f5 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:17.139181 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc74932b-ad78-4257-b088-0481ae27f0f5 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:17.139686 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc74932b-ad78-4257-b088-0481ae27f0f5 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:17.140601 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc74932b-ad78-4257-b088-0481ae27f0f5 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:17.141020 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc74932b-ad78-4257-b088-0481ae27f0f5 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:17.141516 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc74932b-ad78-4257-b088-0481ae27f0f5 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:18.127126 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-dc74932b-ad78-4257-b088-0481ae27f0f5 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:18.152742 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-dc74932b-ad78-4257-b088-0481ae27f0f5 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:18.154502 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-dc74932b-ad78-4257-b088-0481ae27f0f5 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:18.157130 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-dc74932b-ad78-4257-b088-0481ae27f0f5 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924" status: 200 len: 1411 microversion: 2.25 time: 1.050880 Oct 26 13:05:18.158680 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 380/811] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:05:17 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 => generated 1411 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:05:18.170642 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d19efde4-b7e6-46ea-8d90-7fa194c929fc tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:18.171507 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d19efde4-b7e6-46ea-8d90-7fa194c929fc tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:18.186469 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d19efde4-b7e6-46ea-8d90-7fa194c929fc tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:18.187258 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d19efde4-b7e6-46ea-8d90-7fa194c929fc tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:18.188150 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d19efde4-b7e6-46ea-8d90-7fa194c929fc tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:18.191159 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d19efde4-b7e6-46ea-8d90-7fa194c929fc tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:18.193417 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d19efde4-b7e6-46ea-8d90-7fa194c929fc tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:18.202184 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d19efde4-b7e6-46ea-8d90-7fa194c929fc tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:18.367070 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d19efde4-b7e6-46ea-8d90-7fa194c929fc tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:18.375297 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d19efde4-b7e6-46ea-8d90-7fa194c929fc tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 200 len: 1331 microversion: 2.1 time: 0.215200 Oct 26 13:05:18.376173 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 381/812] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:18 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 1331 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:18.383756 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-4918d37d-0b44-42f5-ab4e-187f049f3f5a req-221df44b-ca96-425c-a32a-3ab074b506f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2358d550-6ed6-4529-b268-ffdf82f228ff", "tag": "afd8b890-95e6-436a-a2d2-b757d32c6d43"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:18.404320 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-4918d37d-0b44-42f5-ab4e-187f049f3f5a req-221df44b-ca96-425c-a32a-3ab074b506f4 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:18.404976 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-4918d37d-0b44-42f5-ab4e-187f049f3f5a req-221df44b-ca96-425c-a32a-3ab074b506f4 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:18.405429 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-4918d37d-0b44-42f5-ab4e-187f049f3f5a req-221df44b-ca96-425c-a32a-3ab074b506f4 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:18.432166 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-4918d37d-0b44-42f5-ab4e-187f049f3f5a req-221df44b-ca96-425c-a32a-3ab074b506f4 service nova] Creating event network-changed:afd8b890-95e6-436a-a2d2-b757d32c6d43 for instance 2358d550-6ed6-4529-b268-ffdf82f228ff on n-h2-862686-1 Oct 26 13:05:18.439509 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-4918d37d-0b44-42f5-ab4e-187f049f3f5a req-221df44b-ca96-425c-a32a-3ab074b506f4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061946 Oct 26 13:05:18.440488 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 382/813] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:05:18.447601 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ce033e4a-f0e6-4fa6-93d8-d8cce67930e0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:18.448586 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ce033e4a-f0e6-4fa6-93d8-d8cce67930e0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 2358d550-6ed6-4529-b268-ffdf82f228ff] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:18.455055 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce033e4a-f0e6-4fa6-93d8-d8cce67930e0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:18.455843 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce033e4a-f0e6-4fa6-93d8-d8cce67930e0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:18.456499 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce033e4a-f0e6-4fa6-93d8-d8cce67930e0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:18.457427 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce033e4a-f0e6-4fa6-93d8-d8cce67930e0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:18.458114 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce033e4a-f0e6-4fa6-93d8-d8cce67930e0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:18.459570 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce033e4a-f0e6-4fa6-93d8-d8cce67930e0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:19.207353 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ce033e4a-f0e6-4fa6-93d8-d8cce67930e0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:19.248125 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ce033e4a-f0e6-4fa6-93d8-d8cce67930e0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/2358d550-6ed6-4529-b268-ffdf82f228ff" status: 200 len: 1319 microversion: 2.1 time: 0.806006 Oct 26 13:05:19.251600 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 383/814] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:18 2022] GET /compute/v2.1/servers/2358d550-6ed6-4529-b268-ffdf82f228ff => generated 1319 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:19.259172 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-beb3e354-77a6-4634-a60a-e38ab6ca3b60 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:19.268361 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-beb3e354-77a6-4634-a60a-e38ab6ca3b60 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:19.278801 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-beb3e354-77a6-4634-a60a-e38ab6ca3b60 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:19.284062 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-beb3e354-77a6-4634-a60a-e38ab6ca3b60 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:19.285807 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-beb3e354-77a6-4634-a60a-e38ab6ca3b60 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:19.290109 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-beb3e354-77a6-4634-a60a-e38ab6ca3b60 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:19.290812 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-beb3e354-77a6-4634-a60a-e38ab6ca3b60 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:19.293003 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-beb3e354-77a6-4634-a60a-e38ab6ca3b60 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:19.325013 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-9b5e2384-7d83-47d0-8068-5beb951e7569 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: 379653d7-e043-474c-9fdd-3d0f663caed1] Updating instance_info_cache with network_info: [{"id": "4cf33acb-9743-43dc-b7bb-9af2984d2817", "address": "fa:16:3e:bd:4e:32", "network": {"id": "d5dfe2c9-28ca-4cae-a6cc-e2ee7f3499d9", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-21236752-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ec66df09b6114f5dbd6678d5e848c737", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap4cf33acb-97", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120598) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 26 13:05:19.352496 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b5e2384-7d83-47d0-8068-5beb951e7569 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Releasing lock "refresh_cache-379653d7-e043-474c-9fdd-3d0f663caed1" {{(pid=120598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 26 13:05:19.353629 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9b5e2384-7d83-47d0-8068-5beb951e7569 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] 10.222.0.40 "POST /compute/v2.1/servers/379653d7-e043-474c-9fdd-3d0f663caed1/action" status: 202 len: 0 microversion: 2.1 time: 5.417093 Oct 26 13:05:19.355364 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 432/815] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:05:13 2022] POST /compute/v2.1/servers/379653d7-e043-474c-9fdd-3d0f663caed1/action => generated 0 bytes in 5420 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 26 13:05:19.360744 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f6cda67b-34e9-4699-b4aa-6610beb93167 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:19.364769 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f6cda67b-34e9-4699-b4aa-6610beb93167 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:19.378516 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6cda67b-34e9-4699-b4aa-6610beb93167 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:19.379026 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6cda67b-34e9-4699-b4aa-6610beb93167 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:19.381572 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6cda67b-34e9-4699-b4aa-6610beb93167 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:19.382419 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6cda67b-34e9-4699-b4aa-6610beb93167 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:19.385018 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6cda67b-34e9-4699-b4aa-6610beb93167 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:19.385512 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6cda67b-34e9-4699-b4aa-6610beb93167 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:19.431943 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-beb3e354-77a6-4634-a60a-e38ab6ca3b60 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lazy-loading 'services' on Instance uuid ee752331-9c49-4c73-ac1e-2c38175ed9f3 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:05:19.463890 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-beb3e354-77a6-4634-a60a-e38ab6ca3b60 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 200 len: 1927 microversion: 2.75 time: 0.208754 Oct 26 13:05:19.465369 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 384/816] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:05:19 2022] GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 1927 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:05:19.471916 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5380621f-4dc6-4603-abf1-b55d357769e9 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:19.472431 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5380621f-4dc6-4603-abf1-b55d357769e9 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: 379653d7-e043-474c-9fdd-3d0f663caed1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:19.478866 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5380621f-4dc6-4603-abf1-b55d357769e9 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:19.479355 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5380621f-4dc6-4603-abf1-b55d357769e9 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:19.479790 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5380621f-4dc6-4603-abf1-b55d357769e9 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:19.480853 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5380621f-4dc6-4603-abf1-b55d357769e9 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:19.481677 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5380621f-4dc6-4603-abf1-b55d357769e9 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:19.482246 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5380621f-4dc6-4603-abf1-b55d357769e9 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:19.520717 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5380621f-4dc6-4603-abf1-b55d357769e9 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: 379653d7-e043-474c-9fdd-3d0f663caed1] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:05:19.670916 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5380621f-4dc6-4603-abf1-b55d357769e9 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] 10.222.0.40 "DELETE /compute/v2.1/servers/379653d7-e043-474c-9fdd-3d0f663caed1" status: 204 len: 0 microversion: 2.1 time: 0.203472 Oct 26 13:05:19.671625 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 385/817] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:05:19 2022] DELETE /compute/v2.1/servers/379653d7-e043-474c-9fdd-3d0f663caed1 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:05:19.686434 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1c941eb0-0e61-48b7-91b9-d66ab7f56e19 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:19.688644 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1c941eb0-0e61-48b7-91b9-d66ab7f56e19 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:19.707869 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1c941eb0-0e61-48b7-91b9-d66ab7f56e19 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:19.709379 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1c941eb0-0e61-48b7-91b9-d66ab7f56e19 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:19.710716 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1c941eb0-0e61-48b7-91b9-d66ab7f56e19 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:19.713399 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1c941eb0-0e61-48b7-91b9-d66ab7f56e19 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:19.714899 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1c941eb0-0e61-48b7-91b9-d66ab7f56e19 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:19.716970 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1c941eb0-0e61-48b7-91b9-d66ab7f56e19 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:19.931084 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f6cda67b-34e9-4699-b4aa-6610beb93167 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:19.955770 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f6cda67b-34e9-4699-b4aa-6610beb93167 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:19.962210 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f6cda67b-34e9-4699-b4aa-6610beb93167 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:19.979250 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f6cda67b-34e9-4699-b4aa-6610beb93167 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924" status: 200 len: 1411 microversion: 2.25 time: 0.622548 Oct 26 13:05:19.980527 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 433/818] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:05:19 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 => generated 1411 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:05:19.999215 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-55a58594-a7bb-4087-a46e-d6398c3f4a1d tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.186"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:20.012258 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-55a58594-a7bb-4087-a46e-d6398c3f4a1d tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: dffc2812-b18a-4227-932f-3db590d7bc6f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:20.019063 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1c941eb0-0e61-48b7-91b9-d66ab7f56e19 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:20.032785 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1c941eb0-0e61-48b7-91b9-d66ab7f56e19 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 200 len: 1337 microversion: 2.1 time: 0.359585 Oct 26 13:05:20.034640 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 386/819] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:19 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 1337 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:20.051878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55a58594-a7bb-4087-a46e-d6398c3f4a1d tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:20.052716 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55a58594-a7bb-4087-a46e-d6398c3f4a1d tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:20.053172 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55a58594-a7bb-4087-a46e-d6398c3f4a1d tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:20.054022 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55a58594-a7bb-4087-a46e-d6398c3f4a1d tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:20.055973 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-0c4f6426-b1b4-4387-b191-8bb709f56e46 req-0324fc44-94e7-4d8c-8907-bc94dd1bc241 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f27f0232-1c7a-433d-a8ed-9ef4f631b924", "tag": "77991740-2ec4-4120-929b-065a4a4a02c8"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:20.057829 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55a58594-a7bb-4087-a46e-d6398c3f4a1d tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:20.058336 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55a58594-a7bb-4087-a46e-d6398c3f4a1d tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:20.066799 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=3,nova_cell1:RELEASE=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:05:20.091253 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-0c4f6426-b1b4-4387-b191-8bb709f56e46 req-0324fc44-94e7-4d8c-8907-bc94dd1bc241 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:20.094141 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-0c4f6426-b1b4-4387-b191-8bb709f56e46 req-0324fc44-94e7-4d8c-8907-bc94dd1bc241 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:20.094702 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-0c4f6426-b1b4-4387-b191-8bb709f56e46 req-0324fc44-94e7-4d8c-8907-bc94dd1bc241 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:20.112735 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-0c4f6426-b1b4-4387-b191-8bb709f56e46 req-0324fc44-94e7-4d8c-8907-bc94dd1bc241 service nova] Creating event network-changed:77991740-2ec4-4120-929b-065a4a4a02c8 for instance f27f0232-1c7a-433d-a8ed-9ef4f631b924 on n-h1-862686-1 Oct 26 13:05:20.121344 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-0c4f6426-b1b4-4387-b191-8bb709f56e46 req-0324fc44-94e7-4d8c-8907-bc94dd1bc241 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084688 Oct 26 13:05:20.122030 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 387/820] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:05:20.134307 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55a58594-a7bb-4087-a46e-d6398c3f4a1d tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "refresh_cache-dffc2812-b18a-4227-932f-3db590d7bc6f" {{(pid=120598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 26 13:05:20.134920 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55a58594-a7bb-4087-a46e-d6398c3f4a1d tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquired lock "refresh_cache-dffc2812-b18a-4227-932f-3db590d7bc6f" {{(pid=120598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 26 13:05:20.279085 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-759f839e-d7ed-4fa0-b382-9602773a86f8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:20.280901 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-759f839e-d7ed-4fa0-b382-9602773a86f8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 2358d550-6ed6-4529-b268-ffdf82f228ff] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:20.289995 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-759f839e-d7ed-4fa0-b382-9602773a86f8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:20.290857 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-759f839e-d7ed-4fa0-b382-9602773a86f8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:20.291371 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-759f839e-d7ed-4fa0-b382-9602773a86f8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:20.292331 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-759f839e-d7ed-4fa0-b382-9602773a86f8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:20.293016 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-759f839e-d7ed-4fa0-b382-9602773a86f8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:20.293673 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-759f839e-d7ed-4fa0-b382-9602773a86f8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:20.469349 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-759f839e-d7ed-4fa0-b382-9602773a86f8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:20.478264 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-759f839e-d7ed-4fa0-b382-9602773a86f8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/2358d550-6ed6-4529-b268-ffdf82f228ff" status: 200 len: 1319 microversion: 2.1 time: 0.205727 Oct 26 13:05:20.479057 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 388/821] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:20 2022] GET /compute/v2.1/servers/2358d550-6ed6-4529-b268-ffdf82f228ff => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:20.495543 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c1d82de1-6929-407e-ad8c-4e512ea90f1c tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:20.496155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c1d82de1-6929-407e-ad8c-4e512ea90f1c tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:20.502758 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c1d82de1-6929-407e-ad8c-4e512ea90f1c tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:20.503243 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c1d82de1-6929-407e-ad8c-4e512ea90f1c tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:20.503861 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c1d82de1-6929-407e-ad8c-4e512ea90f1c tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:20.504593 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c1d82de1-6929-407e-ad8c-4e512ea90f1c tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:20.505047 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c1d82de1-6929-407e-ad8c-4e512ea90f1c tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:20.505469 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c1d82de1-6929-407e-ad8c-4e512ea90f1c tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:20.596031 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-c1d82de1-6929-407e-ad8c-4e512ea90f1c tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lazy-loading 'services' on Instance uuid ee752331-9c49-4c73-ac1e-2c38175ed9f3 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:05:20.615722 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c1d82de1-6929-407e-ad8c-4e512ea90f1c tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 200 len: 1927 microversion: 2.75 time: 0.125295 Oct 26 13:05:20.616706 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 389/822] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:05:20 2022] GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 1927 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:05:21.060411 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9484f9e0-d3ce-4d5e-8329-601ec612dc5f tempest-SecurityGroupsTestAdminJSON-804811227 tempest-SecurityGroupsTestAdminJSON-804811227-project] Action: 'create', calling method: .version_select at 0x7f673277d5e0>, body: {"security_group": {"name": "tempest-securitygroup-1019494018", "description": "tempest-description-938929921"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:21.344539 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9484f9e0-d3ce-4d5e-8329-601ec612dc5f tempest-SecurityGroupsTestAdminJSON-804811227 tempest-SecurityGroupsTestAdminJSON-804811227-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.472252 Oct 26 13:05:21.354101 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 390/823] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 26 13:05:20 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:05:21.359513 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0dc406ec-2d60-45c2-8fd3-c5bbaf0ffe01 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:21.360303 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0dc406ec-2d60-45c2-8fd3-c5bbaf0ffe01 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:21.372769 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0dc406ec-2d60-45c2-8fd3-c5bbaf0ffe01 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:21.373256 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0dc406ec-2d60-45c2-8fd3-c5bbaf0ffe01 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:21.373960 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0dc406ec-2d60-45c2-8fd3-c5bbaf0ffe01 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:21.375281 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0dc406ec-2d60-45c2-8fd3-c5bbaf0ffe01 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:21.375944 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0dc406ec-2d60-45c2-8fd3-c5bbaf0ffe01 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:21.376579 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0dc406ec-2d60-45c2-8fd3-c5bbaf0ffe01 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:21.622843 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0dc406ec-2d60-45c2-8fd3-c5bbaf0ffe01 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:21.635456 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0dc406ec-2d60-45c2-8fd3-c5bbaf0ffe01 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:21.637361 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0dc406ec-2d60-45c2-8fd3-c5bbaf0ffe01 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:21.638999 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0dc406ec-2d60-45c2-8fd3-c5bbaf0ffe01 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924" status: 200 len: 1411 microversion: 2.25 time: 0.283598 Oct 26 13:05:21.649919 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 391/824] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:05:21 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 => generated 1411 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:05:21.662378 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7c2f8479-f9ca-4762-92da-b49e616f2290 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:21.663208 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7c2f8479-f9ca-4762-92da-b49e616f2290 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:21.671530 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7c2f8479-f9ca-4762-92da-b49e616f2290 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:21.672342 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7c2f8479-f9ca-4762-92da-b49e616f2290 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:21.673003 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7c2f8479-f9ca-4762-92da-b49e616f2290 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:21.673961 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7c2f8479-f9ca-4762-92da-b49e616f2290 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:21.674631 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7c2f8479-f9ca-4762-92da-b49e616f2290 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:21.675383 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7c2f8479-f9ca-4762-92da-b49e616f2290 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:21.828072 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7c2f8479-f9ca-4762-92da-b49e616f2290 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:21.840433 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7c2f8479-f9ca-4762-92da-b49e616f2290 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 200 len: 1337 microversion: 2.1 time: 0.189284 Oct 26 13:05:21.845907 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 392/825] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:21 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 1337 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:21.855317 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-65421a74-11e6-457d-bbfd-31fb53115195 tempest-SecurityGroupsTestAdminJSON-804811227 tempest-SecurityGroupsTestAdminJSON-804811227-project] Action: 'create', calling method: .version_select at 0x7f673278ed30>, body: {"security_group": {"name": "tempest-securitygroup-831179540", "description": "tempest-description-2132755843"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:22.391247 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-65421a74-11e6-457d-bbfd-31fb53115195 tempest-SecurityGroupsTestAdminJSON-804811227 tempest-SecurityGroupsTestAdminJSON-804811227-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.543716 Oct 26 13:05:22.391861 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 393/826] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 26 13:05:21 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:05:22.405601 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5da04536-3f4f-4cdf-b602-2d207a8a1f61 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:22.406218 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5da04536-3f4f-4cdf-b602-2d207a8a1f61 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 2358d550-6ed6-4529-b268-ffdf82f228ff] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:22.427559 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5da04536-3f4f-4cdf-b602-2d207a8a1f61 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:22.428063 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5da04536-3f4f-4cdf-b602-2d207a8a1f61 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:22.428505 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5da04536-3f4f-4cdf-b602-2d207a8a1f61 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:22.429220 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5da04536-3f4f-4cdf-b602-2d207a8a1f61 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:22.430220 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5da04536-3f4f-4cdf-b602-2d207a8a1f61 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:22.430657 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5da04536-3f4f-4cdf-b602-2d207a8a1f61 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:22.729430 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5da04536-3f4f-4cdf-b602-2d207a8a1f61 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:22.737784 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5da04536-3f4f-4cdf-b602-2d207a8a1f61 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/2358d550-6ed6-4529-b268-ffdf82f228ff" status: 200 len: 1319 microversion: 2.1 time: 0.335930 Oct 26 13:05:22.762699 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 394/827] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:22 2022] GET /compute/v2.1/servers/2358d550-6ed6-4529-b268-ffdf82f228ff => generated 1319 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:22.771255 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d3dcd8a6-2361-47dc-b37b-e531a0834c62 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:22.772107 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d3dcd8a6-2361-47dc-b37b-e531a0834c62 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:22.785255 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d3dcd8a6-2361-47dc-b37b-e531a0834c62 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:22.786073 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d3dcd8a6-2361-47dc-b37b-e531a0834c62 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:22.790062 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d3dcd8a6-2361-47dc-b37b-e531a0834c62 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:22.791051 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d3dcd8a6-2361-47dc-b37b-e531a0834c62 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:22.792325 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d3dcd8a6-2361-47dc-b37b-e531a0834c62 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:22.792956 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d3dcd8a6-2361-47dc-b37b-e531a0834c62 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:22.981810 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-d3dcd8a6-2361-47dc-b37b-e531a0834c62 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lazy-loading 'services' on Instance uuid ee752331-9c49-4c73-ac1e-2c38175ed9f3 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:05:23.016442 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:05:23.026053 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d3dcd8a6-2361-47dc-b37b-e531a0834c62 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 200 len: 1927 microversion: 2.75 time: 0.261871 Oct 26 13:05:23.027597 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 395/828] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:05:22 2022] GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 1927 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:05:23.034126 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-870d0823-fc87-45eb-a623-92e75ee37ac1 req-c29ac69e-7f30-4857-9b6b-09e61bb99158 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c9dbe46-9160-491b-9efd-074333ee4d8c", "name": "network-vif-plugged", "status": "completed", "tag": "166b9e43-0e45-4f63-b683-f951ebddd062"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:23.054102 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-870d0823-fc87-45eb-a623-92e75ee37ac1 req-c29ac69e-7f30-4857-9b6b-09e61bb99158 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:23.055063 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-870d0823-fc87-45eb-a623-92e75ee37ac1 req-c29ac69e-7f30-4857-9b6b-09e61bb99158 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:23.055884 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-870d0823-fc87-45eb-a623-92e75ee37ac1 req-c29ac69e-7f30-4857-9b6b-09e61bb99158 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:23.079200 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-870d0823-fc87-45eb-a623-92e75ee37ac1 req-c29ac69e-7f30-4857-9b6b-09e61bb99158 service nova] Creating event network-vif-plugged:166b9e43-0e45-4f63-b683-f951ebddd062 for instance 3c9dbe46-9160-491b-9efd-074333ee4d8c on n-h1-862686-1 Oct 26 13:05:23.091222 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-870d0823-fc87-45eb-a623-92e75ee37ac1 req-c29ac69e-7f30-4857-9b6b-09e61bb99158 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061180 Oct 26 13:05:23.092364 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 396/829] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:05:23.182062 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-06b7e1e5-036a-4d1c-9a56-15fb0681966c tempest-SecurityGroupsTestAdminJSON-1522255507 tempest-SecurityGroupsTestAdminJSON-1522255507-project-admin] Action: 'create', calling method: .version_select at 0x7f673277d670>, body: {"security_group": {"name": "tempest-securitygroup-503812478", "description": "tempest-description-546089961"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:23.445550 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=7 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:05:23.487822 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=22 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:05:23.608427 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-06b7e1e5-036a-4d1c-9a56-15fb0681966c tempest-SecurityGroupsTestAdminJSON-1522255507 tempest-SecurityGroupsTestAdminJSON-1522255507-project-admin] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.514470 Oct 26 13:05:23.609386 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 397/830] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 26 13:05:23 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:05:23.615531 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-383a4cb7-fa14-436b-85c9-c0979b548d65 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:23.616276 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-383a4cb7-fa14-436b-85c9-c0979b548d65 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:23.639376 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-383a4cb7-fa14-436b-85c9-c0979b548d65 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:23.639907 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-383a4cb7-fa14-436b-85c9-c0979b548d65 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:23.640943 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-383a4cb7-fa14-436b-85c9-c0979b548d65 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:23.641790 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-383a4cb7-fa14-436b-85c9-c0979b548d65 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:23.642260 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-383a4cb7-fa14-436b-85c9-c0979b548d65 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:23.642722 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-383a4cb7-fa14-436b-85c9-c0979b548d65 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:23.714356 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:05:23.750430 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-55a58594-a7bb-4087-a46e-d6398c3f4a1d tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: dffc2812-b18a-4227-932f-3db590d7bc6f] Building network info cache for instance {{(pid=120598) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 26 13:05:23.941603 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-383a4cb7-fa14-436b-85c9-c0979b548d65 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:23.953780 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-383a4cb7-fa14-436b-85c9-c0979b548d65 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:23.959414 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-383a4cb7-fa14-436b-85c9-c0979b548d65 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:23.961920 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-383a4cb7-fa14-436b-85c9-c0979b548d65 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924" status: 200 len: 1411 microversion: 2.25 time: 0.349660 Oct 26 13:05:23.977513 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 398/831] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:05:23 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 => generated 1411 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:05:23.977513 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ccf79542-9a1f-4687-8952-f6a5a5c49af7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:23.977513 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ccf79542-9a1f-4687-8952-f6a5a5c49af7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:23.980063 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ccf79542-9a1f-4687-8952-f6a5a5c49af7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:23.983874 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ccf79542-9a1f-4687-8952-f6a5a5c49af7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:23.983874 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ccf79542-9a1f-4687-8952-f6a5a5c49af7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:23.983874 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ccf79542-9a1f-4687-8952-f6a5a5c49af7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:23.983874 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ccf79542-9a1f-4687-8952-f6a5a5c49af7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:23.984232 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ccf79542-9a1f-4687-8952-f6a5a5c49af7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:24.194730 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ccf79542-9a1f-4687-8952-f6a5a5c49af7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:24.205946 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ccf79542-9a1f-4687-8952-f6a5a5c49af7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 200 len: 1379 microversion: 2.1 time: 0.240105 Oct 26 13:05:24.207367 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 399/832] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:23 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 1379 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:24.212980 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-6d5fd864-fcb2-4d77-a9e7-40b93e0f4ed1 req-a76bb475-35ab-4b04-a3c2-5993a6a41a59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "379653d7-e043-474c-9fdd-3d0f663caed1", "name": "network-vif-deleted", "tag": "4cf33acb-9743-43dc-b7bb-9af2984d2817"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:24.225087 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-6d5fd864-fcb2-4d77-a9e7-40b93e0f4ed1 req-a76bb475-35ab-4b04-a3c2-5993a6a41a59 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:24.227464 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-6d5fd864-fcb2-4d77-a9e7-40b93e0f4ed1 req-a76bb475-35ab-4b04-a3c2-5993a6a41a59 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:24.228380 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-6d5fd864-fcb2-4d77-a9e7-40b93e0f4ed1 req-a76bb475-35ab-4b04-a3c2-5993a6a41a59 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:24.255194 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-6d5fd864-fcb2-4d77-a9e7-40b93e0f4ed1 req-a76bb475-35ab-4b04-a3c2-5993a6a41a59 service nova] Creating event network-vif-deleted:4cf33acb-9743-43dc-b7bb-9af2984d2817 for instance 379653d7-e043-474c-9fdd-3d0f663caed1 on n-h1-862686-1 Oct 26 13:05:24.264394 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-6d5fd864-fcb2-4d77-a9e7-40b93e0f4ed1 req-a76bb475-35ab-4b04-a3c2-5993a6a41a59 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055085 Oct 26 13:05:24.265556 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 400/833] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:05:24.271054 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d8d9cb6d-77d1-408c-bf58-cacbc6e449c6 tempest-SecurityGroupsTestAdminJSON-1522255507 tempest-SecurityGroupsTestAdminJSON-1522255507-project-admin] Action: 'create', calling method: .version_select at 0x7f6732ae7e50>, body: {"security_group": {"name": "tempest-securitygroup-1173081067", "description": "tempest-description-1882135793"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:24.488077 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d8d9cb6d-77d1-408c-bf58-cacbc6e449c6 tempest-SecurityGroupsTestAdminJSON-1522255507 tempest-SecurityGroupsTestAdminJSON-1522255507-project-admin] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.221535 Oct 26 13:05:24.488972 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 401/834] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 26 13:05:24 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:05:24.494002 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fe5145dd-5cbf-419e-bcb9-160896207a94 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:24.495041 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fe5145dd-5cbf-419e-bcb9-160896207a94 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 2358d550-6ed6-4529-b268-ffdf82f228ff] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:24.503617 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fe5145dd-5cbf-419e-bcb9-160896207a94 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:24.504359 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fe5145dd-5cbf-419e-bcb9-160896207a94 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:24.505066 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fe5145dd-5cbf-419e-bcb9-160896207a94 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:24.505926 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fe5145dd-5cbf-419e-bcb9-160896207a94 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:24.506496 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fe5145dd-5cbf-419e-bcb9-160896207a94 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:24.507027 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fe5145dd-5cbf-419e-bcb9-160896207a94 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:24.777852 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fe5145dd-5cbf-419e-bcb9-160896207a94 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:24.787754 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fe5145dd-5cbf-419e-bcb9-160896207a94 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/2358d550-6ed6-4529-b268-ffdf82f228ff" status: 200 len: 1319 microversion: 2.1 time: 0.297482 Oct 26 13:05:24.789282 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 402/835] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:24 2022] GET /compute/v2.1/servers/2358d550-6ed6-4529-b268-ffdf82f228ff => generated 1319 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:24.794204 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-8d4db55c-9d79-4839-a015-f79ff1907677 req-83100b02-48bc-4e84-b9d3-7248994fcb8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dffc2812-b18a-4227-932f-3db590d7bc6f", "tag": "eefbc12d-6331-420c-be7b-da952bc9d1cf"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:24.804402 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-8d4db55c-9d79-4839-a015-f79ff1907677 req-83100b02-48bc-4e84-b9d3-7248994fcb8c service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:24.805163 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-8d4db55c-9d79-4839-a015-f79ff1907677 req-83100b02-48bc-4e84-b9d3-7248994fcb8c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:24.805859 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-8d4db55c-9d79-4839-a015-f79ff1907677 req-83100b02-48bc-4e84-b9d3-7248994fcb8c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:24.828335 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-8d4db55c-9d79-4839-a015-f79ff1907677 req-83100b02-48bc-4e84-b9d3-7248994fcb8c service nova] Creating event network-changed:eefbc12d-6331-420c-be7b-da952bc9d1cf for instance dffc2812-b18a-4227-932f-3db590d7bc6f on n-h2-862686-1 Oct 26 13:05:24.840168 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-8d4db55c-9d79-4839-a015-f79ff1907677 req-83100b02-48bc-4e84-b9d3-7248994fcb8c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049324 Oct 26 13:05:24.843093 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 403/836] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:05:24.858509 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8c569b13-8a26-45ab-8942-460370a72339 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:24.859530 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8c569b13-8a26-45ab-8942-460370a72339 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:24.871237 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8c569b13-8a26-45ab-8942-460370a72339 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:24.871869 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8c569b13-8a26-45ab-8942-460370a72339 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:24.872590 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8c569b13-8a26-45ab-8942-460370a72339 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:24.873659 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8c569b13-8a26-45ab-8942-460370a72339 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:24.874377 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8c569b13-8a26-45ab-8942-460370a72339 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:24.875021 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8c569b13-8a26-45ab-8942-460370a72339 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:25.029234 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-8c569b13-8a26-45ab-8942-460370a72339 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lazy-loading 'services' on Instance uuid ee752331-9c49-4c73-ac1e-2c38175ed9f3 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:05:25.071259 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8c569b13-8a26-45ab-8942-460370a72339 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 200 len: 1927 microversion: 2.75 time: 0.226529 Oct 26 13:05:25.071936 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 404/837] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:05:24 2022] GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 1927 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:05:25.083309 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f0a5c870-b3ba-4a3c-a567-8657808fab7a tempest-SecurityGroupsTestAdminJSON-1522255507 tempest-SecurityGroupsTestAdminJSON-1522255507-project-admin] Calling method '.version_select at 0x7f67327d6160>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:25.487050 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-55a58594-a7bb-4087-a46e-d6398c3f4a1d tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: dffc2812-b18a-4227-932f-3db590d7bc6f] Updating instance_info_cache with network_info: [{"id": "eefbc12d-6331-420c-be7b-da952bc9d1cf", "address": "fa:16:3e:b6:63:ec", "network": {"id": "d5dfe2c9-28ca-4cae-a6cc-e2ee7f3499d9", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-21236752-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ec66df09b6114f5dbd6678d5e848c737", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapeefbc12d-63", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120598) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 26 13:05:25.517797 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55a58594-a7bb-4087-a46e-d6398c3f4a1d tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Releasing lock "refresh_cache-dffc2812-b18a-4227-932f-3db590d7bc6f" {{(pid=120598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 26 13:05:25.519200 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-55a58594-a7bb-4087-a46e-d6398c3f4a1d tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] 10.222.0.40 "POST /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f/action" status: 202 len: 0 microversion: 2.1 time: 5.535754 Oct 26 13:05:25.524276 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 434/838] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:05:19 2022] POST /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f/action => generated 0 bytes in 5543 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 26 13:05:25.530504 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-24f6238b-3030-4bdc-9835-7fb6a8077a61 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:25.531461 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-24f6238b-3030-4bdc-9835-7fb6a8077a61 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:25.538598 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24f6238b-3030-4bdc-9835-7fb6a8077a61 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:25.540212 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24f6238b-3030-4bdc-9835-7fb6a8077a61 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:25.540871 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24f6238b-3030-4bdc-9835-7fb6a8077a61 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:25.541904 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24f6238b-3030-4bdc-9835-7fb6a8077a61 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:25.542603 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24f6238b-3030-4bdc-9835-7fb6a8077a61 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:25.543272 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24f6238b-3030-4bdc-9835-7fb6a8077a61 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:25.844061 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-24f6238b-3030-4bdc-9835-7fb6a8077a61 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:25.853465 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-24f6238b-3030-4bdc-9835-7fb6a8077a61 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:25.878982 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-24f6238b-3030-4bdc-9835-7fb6a8077a61 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:25.886462 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-24f6238b-3030-4bdc-9835-7fb6a8077a61 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924" status: 200 len: 1411 microversion: 2.25 time: 0.354371 Oct 26 13:05:25.901896 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 435/839] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:05:25 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 => generated 1411 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:05:25.915107 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-fa3fb15f-7db5-4660-b647-4f7548b1fa79 req-f4c184e1-3812-4c2b-82be-6befb87e1f37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2358d550-6ed6-4529-b268-ffdf82f228ff", "name": "network-vif-plugged", "status": "completed", "tag": "afd8b890-95e6-436a-a2d2-b757d32c6d43"}, {"server_uuid": "f27f0232-1c7a-433d-a8ed-9ef4f631b924", "name": "network-vif-plugged", "status": "completed", "tag": "77991740-2ec4-4120-929b-065a4a4a02c8"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:25.926343 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-fa3fb15f-7db5-4660-b647-4f7548b1fa79 req-f4c184e1-3812-4c2b-82be-6befb87e1f37 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:25.930766 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-fa3fb15f-7db5-4660-b647-4f7548b1fa79 req-f4c184e1-3812-4c2b-82be-6befb87e1f37 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:25.931529 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-fa3fb15f-7db5-4660-b647-4f7548b1fa79 req-f4c184e1-3812-4c2b-82be-6befb87e1f37 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:25.955682 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-fa3fb15f-7db5-4660-b647-4f7548b1fa79 req-f4c184e1-3812-4c2b-82be-6befb87e1f37 service nova] Creating event network-vif-plugged:afd8b890-95e6-436a-a2d2-b757d32c6d43 for instance 2358d550-6ed6-4529-b268-ffdf82f228ff on n-h2-862686-1 Oct 26 13:05:25.956451 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-fa3fb15f-7db5-4660-b647-4f7548b1fa79 req-f4c184e1-3812-4c2b-82be-6befb87e1f37 service nova] Creating event network-vif-plugged:77991740-2ec4-4120-929b-065a4a4a02c8 for instance f27f0232-1c7a-433d-a8ed-9ef4f631b924 on n-h1-862686-1 Oct 26 13:05:25.966861 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-fa3fb15f-7db5-4660-b647-4f7548b1fa79 req-f4c184e1-3812-4c2b-82be-6befb87e1f37 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.061236 Oct 26 13:05:25.971331 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 436/840] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:05:25.988843 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-550d4fe2-36b4-48eb-ad42-3dd322d21ddd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:25.989861 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-550d4fe2-36b4-48eb-ad42-3dd322d21ddd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:26.006292 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-550d4fe2-36b4-48eb-ad42-3dd322d21ddd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:26.010827 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-550d4fe2-36b4-48eb-ad42-3dd322d21ddd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:26.011674 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-550d4fe2-36b4-48eb-ad42-3dd322d21ddd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:26.012589 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-550d4fe2-36b4-48eb-ad42-3dd322d21ddd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:26.015225 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-550d4fe2-36b4-48eb-ad42-3dd322d21ddd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:26.016261 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-550d4fe2-36b4-48eb-ad42-3dd322d21ddd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:26.405459 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-550d4fe2-36b4-48eb-ad42-3dd322d21ddd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:26.419055 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-550d4fe2-36b4-48eb-ad42-3dd322d21ddd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 200 len: 1379 microversion: 2.1 time: 0.443109 Oct 26 13:05:26.420577 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 437/841] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:25 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 1379 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:26.433720 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c40c0281-aa1d-4119-aaf0-1ab97a57eef6 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Calling method '.version_select at 0x7f67329dd550>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:26.615133 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=12 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:05:26.644471 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=64 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:05:26.780193 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c40c0281-aa1d-4119-aaf0-1ab97a57eef6 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] 10.222.0.40 "GET /compute/v2.1/os-floating-ips/1a938a8f-d393-44c3-8278-3c73adfbe210" status: 200 len: 184 microversion: 2.1 time: 0.357919 Oct 26 13:05:26.781201 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 438/842] 10.222.0.40 () {58 vars in 1260 bytes} [Wed Oct 26 13:05:26 2022] GET /compute/v2.1/os-floating-ips/1a938a8f-d393-44c3-8278-3c73adfbe210 => generated 184 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:05:26.788423 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8c45c29b-c250-4580-9b7d-9ca807c04bd8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:26.789170 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8c45c29b-c250-4580-9b7d-9ca807c04bd8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 2358d550-6ed6-4529-b268-ffdf82f228ff] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:26.796107 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8c45c29b-c250-4580-9b7d-9ca807c04bd8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:26.796606 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8c45c29b-c250-4580-9b7d-9ca807c04bd8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:26.797045 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8c45c29b-c250-4580-9b7d-9ca807c04bd8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:26.798178 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8c45c29b-c250-4580-9b7d-9ca807c04bd8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:26.798813 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8c45c29b-c250-4580-9b7d-9ca807c04bd8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:26.799480 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8c45c29b-c250-4580-9b7d-9ca807c04bd8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:27.029250 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8c45c29b-c250-4580-9b7d-9ca807c04bd8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:27.037725 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8c45c29b-c250-4580-9b7d-9ca807c04bd8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/2358d550-6ed6-4529-b268-ffdf82f228ff" status: 200 len: 1319 microversion: 2.1 time: 0.255284 Oct 26 13:05:27.049343 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 439/843] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:26 2022] GET /compute/v2.1/servers/2358d550-6ed6-4529-b268-ffdf82f228ff => generated 1319 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:27.066227 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-02fc016d-329f-4142-a070-e15f45b4e2e4 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:27.067033 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-02fc016d-329f-4142-a070-e15f45b4e2e4 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:27.080331 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02fc016d-329f-4142-a070-e15f45b4e2e4 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:27.080998 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02fc016d-329f-4142-a070-e15f45b4e2e4 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:27.081643 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02fc016d-329f-4142-a070-e15f45b4e2e4 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:27.082437 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02fc016d-329f-4142-a070-e15f45b4e2e4 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:27.082803 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02fc016d-329f-4142-a070-e15f45b4e2e4 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:27.083222 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02fc016d-329f-4142-a070-e15f45b4e2e4 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:27.452988 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-02fc016d-329f-4142-a070-e15f45b4e2e4 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lazy-loading 'services' on Instance uuid ee752331-9c49-4c73-ac1e-2c38175ed9f3 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:05:27.484926 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-02fc016d-329f-4142-a070-e15f45b4e2e4 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 200 len: 1927 microversion: 2.75 time: 0.433939 Oct 26 13:05:27.498191 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 440/844] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:05:27 2022] GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 1927 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:05:27.498191 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-92b35a6e-c0e5-4306-b3c2-b457ee2b44de tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.186"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:27.658619 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-92b35a6e-c0e5-4306-b3c2-b457ee2b44de tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: dffc2812-b18a-4227-932f-3db590d7bc6f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:27.666302 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-92b35a6e-c0e5-4306-b3c2-b457ee2b44de tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:27.667006 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-92b35a6e-c0e5-4306-b3c2-b457ee2b44de tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:27.667634 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-92b35a6e-c0e5-4306-b3c2-b457ee2b44de tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:27.668661 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-92b35a6e-c0e5-4306-b3c2-b457ee2b44de tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:27.669998 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-92b35a6e-c0e5-4306-b3c2-b457ee2b44de tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:27.671108 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-92b35a6e-c0e5-4306-b3c2-b457ee2b44de tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:27.947494 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-92b35a6e-c0e5-4306-b3c2-b457ee2b44de tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "refresh_cache-dffc2812-b18a-4227-932f-3db590d7bc6f" {{(pid=120598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 26 13:05:27.948031 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-92b35a6e-c0e5-4306-b3c2-b457ee2b44de tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquired lock "refresh_cache-dffc2812-b18a-4227-932f-3db590d7bc6f" {{(pid=120598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 26 13:05:28.101156 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f0a5c870-b3ba-4a3c-a567-8657808fab7a tempest-SecurityGroupsTestAdminJSON-1522255507 tempest-SecurityGroupsTestAdminJSON-1522255507-project-admin] 10.222.0.40 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 12983 microversion: 2.1 time: 3.028138 Oct 26 13:05:28.102405 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 405/845] 10.222.0.40 () {58 vars in 1191 bytes} [Wed Oct 26 13:05:25 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 12983 bytes in 3030 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:05:28.126971 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-f3f28ffc-d37e-45fb-96ca-8835926326fb req-d3583ae7-9c07-45bd-a933-c2c893aadc7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7e4891a-9fbd-42b7-a12c-5a4de9c1f151", "tag": "4bacbb43-3b81-44f6-b4ad-82bf06f609ad"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:28.137244 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-f3f28ffc-d37e-45fb-96ca-8835926326fb req-d3583ae7-9c07-45bd-a933-c2c893aadc7d service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:28.137992 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-f3f28ffc-d37e-45fb-96ca-8835926326fb req-d3583ae7-9c07-45bd-a933-c2c893aadc7d service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:28.138604 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-f3f28ffc-d37e-45fb-96ca-8835926326fb req-d3583ae7-9c07-45bd-a933-c2c893aadc7d service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:28.150067 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-f3f28ffc-d37e-45fb-96ca-8835926326fb req-d3583ae7-9c07-45bd-a933-c2c893aadc7d service nova] Creating event network-changed:4bacbb43-3b81-44f6-b4ad-82bf06f609ad for instance c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 on n-h1-862686-1 Oct 26 13:05:28.155018 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-f3f28ffc-d37e-45fb-96ca-8835926326fb req-d3583ae7-9c07-45bd-a933-c2c893aadc7d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035896 Oct 26 13:05:28.155779 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 406/846] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:05:28.160631 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-137f8da9-5560-4930-964d-27ef47f8e230 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:28.161373 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-137f8da9-5560-4930-964d-27ef47f8e230 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:28.168426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-137f8da9-5560-4930-964d-27ef47f8e230 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:28.168911 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-137f8da9-5560-4930-964d-27ef47f8e230 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:28.169954 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-137f8da9-5560-4930-964d-27ef47f8e230 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:28.170082 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-137f8da9-5560-4930-964d-27ef47f8e230 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:28.170535 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-137f8da9-5560-4930-964d-27ef47f8e230 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:28.170961 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-137f8da9-5560-4930-964d-27ef47f8e230 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:28.324124 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-137f8da9-5560-4930-964d-27ef47f8e230 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:28.334361 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-137f8da9-5560-4930-964d-27ef47f8e230 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:28.336441 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-137f8da9-5560-4930-964d-27ef47f8e230 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:28.337656 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-137f8da9-5560-4930-964d-27ef47f8e230 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924" status: 200 len: 1411 microversion: 2.25 time: 0.180895 Oct 26 13:05:28.338439 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 407/847] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:05:28 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 => generated 1411 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:05:28.343162 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-18f43171-4f90-4ffc-adfa-62b47e3674c9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:28.343815 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-18f43171-4f90-4ffc-adfa-62b47e3674c9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:28.349803 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18f43171-4f90-4ffc-adfa-62b47e3674c9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:28.350367 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18f43171-4f90-4ffc-adfa-62b47e3674c9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:28.350793 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18f43171-4f90-4ffc-adfa-62b47e3674c9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:28.351616 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18f43171-4f90-4ffc-adfa-62b47e3674c9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:28.352620 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18f43171-4f90-4ffc-adfa-62b47e3674c9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:28.352620 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18f43171-4f90-4ffc-adfa-62b47e3674c9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:28.592860 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-18f43171-4f90-4ffc-adfa-62b47e3674c9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:28.600951 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-18f43171-4f90-4ffc-adfa-62b47e3674c9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 200 len: 1379 microversion: 2.1 time: 0.261618 Oct 26 13:05:28.603304 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 408/848] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:28 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 1379 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:28.728088 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0fe88089-583b-4b46-a094-3edfc9d143ad tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-607756791", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "07951130-adcc-43a3-98c8-5f0c7bf76f1a"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:28.855795 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-92b35a6e-c0e5-4306-b3c2-b457ee2b44de tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: dffc2812-b18a-4227-932f-3db590d7bc6f] Building network info cache for instance {{(pid=120598) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 26 13:05:28.859554 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-0fe88089-583b-4b46-a094-3edfc9d143ad tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] validate_networks() for [('07951130-adcc-43a3-98c8-5f0c7bf76f1a', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:05:29.963747 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-0fe88089-583b-4b46-a094-3edfc9d143ad tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:05:29.964294 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-0fe88089-583b-4b46-a094-3edfc9d143ad tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:05:29.964952 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-0fe88089-583b-4b46-a094-3edfc9d143ad tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:05:29.965400 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-0fe88089-583b-4b46-a094-3edfc9d143ad tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:05:29.965855 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-0fe88089-583b-4b46-a094-3edfc9d143ad tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:05:29.984107 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0fe88089-583b-4b46-a094-3edfc9d143ad tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:29.984606 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0fe88089-583b-4b46-a094-3edfc9d143ad tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:29.987419 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0fe88089-583b-4b46-a094-3edfc9d143ad tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:29.988214 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0fe88089-583b-4b46-a094-3edfc9d143ad tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:29.988680 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0fe88089-583b-4b46-a094-3edfc9d143ad tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:29.989109 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0fe88089-583b-4b46-a094-3edfc9d143ad tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:30.015999 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-92b35a6e-c0e5-4306-b3c2-b457ee2b44de tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: dffc2812-b18a-4227-932f-3db590d7bc6f] Updating instance_info_cache with network_info: [{"id": "eefbc12d-6331-420c-be7b-da952bc9d1cf", "address": "fa:16:3e:b6:63:ec", "network": {"id": "d5dfe2c9-28ca-4cae-a6cc-e2ee7f3499d9", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-21236752-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ec66df09b6114f5dbd6678d5e848c737", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapeefbc12d-63", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120598) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 26 13:05:30.031628 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-92b35a6e-c0e5-4306-b3c2-b457ee2b44de tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Releasing lock "refresh_cache-dffc2812-b18a-4227-932f-3db590d7bc6f" {{(pid=120598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 26 13:05:30.032960 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-92b35a6e-c0e5-4306-b3c2-b457ee2b44de tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] 10.222.0.40 "POST /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f/action" status: 202 len: 0 microversion: 2.1 time: 2.545785 Oct 26 13:05:30.033825 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 441/849] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:05:27 2022] POST /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f/action => generated 0 bytes in 2547 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 26 13:05:30.040259 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cce6d937-1c8f-4ee2-8b44-09b54f8f98aa tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:30.041180 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cce6d937-1c8f-4ee2-8b44-09b54f8f98aa tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 2358d550-6ed6-4529-b268-ffdf82f228ff] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:30.046339 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-0fe88089-583b-4b46-a094-3edfc9d143ad tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Getting quotas for project 589842c86ede4d51a98b22b996918fd3. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:05:30.052787 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-0fe88089-583b-4b46-a094-3edfc9d143ad tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Getting quotas for user dde48023bc1a4ee0a0beb2a99030a5d7 and project 589842c86ede4d51a98b22b996918fd3. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:05:30.059497 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cce6d937-1c8f-4ee2-8b44-09b54f8f98aa tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:30.060307 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cce6d937-1c8f-4ee2-8b44-09b54f8f98aa tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:30.060936 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cce6d937-1c8f-4ee2-8b44-09b54f8f98aa tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:30.061927 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cce6d937-1c8f-4ee2-8b44-09b54f8f98aa tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:30.062669 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cce6d937-1c8f-4ee2-8b44-09b54f8f98aa tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:30.063350 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cce6d937-1c8f-4ee2-8b44-09b54f8f98aa tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:30.074041 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0fe88089-583b-4b46-a094-3edfc9d143ad tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:05:30.076592 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0fe88089-583b-4b46-a094-3edfc9d143ad tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] [instance: f7878a23-cf30-42db-a872-b9cfa0c0b2c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:05:30.167518 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0fe88089-583b-4b46-a094-3edfc9d143ad tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.563019 Oct 26 13:05:30.174325 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 409/850] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:05:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:05:30.178116 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-535d3592-acb0-48bf-bea8-c14d38168e24 tempest-SecurityGroupsTestAdminJSON-804811227 tempest-SecurityGroupsTestAdminJSON-804811227-project] Calling method '.version_select at 0x7f673274db80>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:30.340522 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-cce6d937-1c8f-4ee2-8b44-09b54f8f98aa tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:30.361331 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cce6d937-1c8f-4ee2-8b44-09b54f8f98aa tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/2358d550-6ed6-4529-b268-ffdf82f228ff" status: 200 len: 1469 microversion: 2.1 time: 0.325972 Oct 26 13:05:30.361953 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 442/851] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:30 2022] GET /compute/v2.1/servers/2358d550-6ed6-4529-b268-ffdf82f228ff => generated 1469 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:30.378778 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c9d4bcfa-689f-40ac-8246-66d5d0735325 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:30.379392 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c9d4bcfa-689f-40ac-8246-66d5d0735325 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:30.405186 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9d4bcfa-689f-40ac-8246-66d5d0735325 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:30.405719 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9d4bcfa-689f-40ac-8246-66d5d0735325 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:30.407320 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9d4bcfa-689f-40ac-8246-66d5d0735325 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:30.408216 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9d4bcfa-689f-40ac-8246-66d5d0735325 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:30.408837 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9d4bcfa-689f-40ac-8246-66d5d0735325 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:30.409501 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9d4bcfa-689f-40ac-8246-66d5d0735325 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:30.524747 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-c9d4bcfa-689f-40ac-8246-66d5d0735325 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lazy-loading 'services' on Instance uuid ee752331-9c49-4c73-ac1e-2c38175ed9f3 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:05:30.546843 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-535d3592-acb0-48bf-bea8-c14d38168e24 tempest-SecurityGroupsTestAdminJSON-804811227 tempest-SecurityGroupsTestAdminJSON-804811227-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.373946 Oct 26 13:05:30.547435 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 410/852] 10.222.0.40 () {58 vars in 1191 bytes} [Wed Oct 26 13:05:30 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:30.552255 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c4b0b543-3eb7-4e88-b718-d201a5d64695 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:30.552870 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c4b0b543-3eb7-4e88-b718-d201a5d64695 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:30.575862 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4b0b543-3eb7-4e88-b718-d201a5d64695 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:30.576364 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4b0b543-3eb7-4e88-b718-d201a5d64695 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:30.576808 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4b0b543-3eb7-4e88-b718-d201a5d64695 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:30.577514 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4b0b543-3eb7-4e88-b718-d201a5d64695 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:30.577797 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c9d4bcfa-689f-40ac-8246-66d5d0735325 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 200 len: 1927 microversion: 2.75 time: 0.199437 Oct 26 13:05:30.578793 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 443/853] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:05:30 2022] GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 1927 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:05:30.583527 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-acce936c-57ba-4b48-a682-889d84cfb343 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:30.584207 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-acce936c-57ba-4b48-a682-889d84cfb343 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:30.586839 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4b0b543-3eb7-4e88-b718-d201a5d64695 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:30.587286 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4b0b543-3eb7-4e88-b718-d201a5d64695 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:30.595022 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-acce936c-57ba-4b48-a682-889d84cfb343 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:30.595513 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-acce936c-57ba-4b48-a682-889d84cfb343 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:30.596038 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-acce936c-57ba-4b48-a682-889d84cfb343 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:30.596750 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-acce936c-57ba-4b48-a682-889d84cfb343 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:30.597210 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-acce936c-57ba-4b48-a682-889d84cfb343 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:30.597666 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-acce936c-57ba-4b48-a682-889d84cfb343 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:30.893413 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c4b0b543-3eb7-4e88-b718-d201a5d64695 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:30.903804 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c4b0b543-3eb7-4e88-b718-d201a5d64695 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:30.906191 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c4b0b543-3eb7-4e88-b718-d201a5d64695 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:30.907915 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c4b0b543-3eb7-4e88-b718-d201a5d64695 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924" status: 200 len: 1606 microversion: 2.25 time: 0.359382 Oct 26 13:05:30.915316 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 411/854] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:05:30 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 => generated 1606 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:05:30.926044 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-acce936c-57ba-4b48-a682-889d84cfb343 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:30.927077 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ae5ec28a-62fe-445a-a836-d6a6836aa9ee tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:30.930278 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ae5ec28a-62fe-445a-a836-d6a6836aa9ee tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: 379653d7-e043-474c-9fdd-3d0f663caed1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:30.939088 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-acce936c-57ba-4b48-a682-889d84cfb343 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 200 len: 1379 microversion: 2.1 time: 0.355845 Oct 26 13:05:30.940779 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae5ec28a-62fe-445a-a836-d6a6836aa9ee tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:30.941216 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 444/855] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:30 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 1379 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:30.941343 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae5ec28a-62fe-445a-a836-d6a6836aa9ee tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:30.953618 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7431a9ba-5659-4c70-9ec2-c53e0f215779 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:30.954915 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae5ec28a-62fe-445a-a836-d6a6836aa9ee tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:30.955094 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7431a9ba-5659-4c70-9ec2-c53e0f215779 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] [instance: f7878a23-cf30-42db-a872-b9cfa0c0b2c1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:30.956121 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae5ec28a-62fe-445a-a836-d6a6836aa9ee tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:30.957022 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae5ec28a-62fe-445a-a836-d6a6836aa9ee tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:30.957688 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae5ec28a-62fe-445a-a836-d6a6836aa9ee tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:30.985286 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-ae5ec28a-62fe-445a-a836-d6a6836aa9ee tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] HTTP exception thrown: Instance 379653d7-e043-474c-9fdd-3d0f663caed1 could not be found. Oct 26 13:05:30.988104 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ae5ec28a-62fe-445a-a836-d6a6836aa9ee tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Request method failure captured: Oct 26 13:05:30.988104 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/servers/379653d7-e043-474c-9fdd-3d0f663caed1 HTTP/1.1 Oct 26 13:05:30.988104 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:05:30.988104 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:05:30.988104 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:05:30.988104 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:05:30.988104 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:05:30.988104 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:05:30.988104 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:05:30.988104 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:05:30.988104 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTBKlCssWTS3uIuvlb3qZMdrcWLduqRK6y7lYGMWJKaDHyabA3HHbK1QJy8wrLendLe8dvg8CEJOPjdcSkeq6wxwfMyXdDGwE64sIJ83eNlGzDxyhs0m4j6793IdF74Jx8R93iNbASvgGAA564NMv82dimk84r03I-CCjsHCyFlT9wI Oct 26 13:05:30.988104 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:05:30.988104 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:05:30.988104 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:05:30.988104 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:05:30.988104 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:05:30.988104 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:05:30.988104 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: ec66df09b6114f5dbd6678d5e848c737 Oct 26 13:05:30.988104 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1445427066 Oct 26 13:05:30.988104 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:05:30.988104 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:05:30.989446 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ec66df09b6114f5dbd6678d5e848c737"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ec66df09b6114f5dbd6678d5e848c737"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ec66df09b6114f5dbd6678d5e848c737"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ec66df09b6114f5dbd6678d5e848c737"}]}] Oct 26 13:05:30.989446 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1445427066 Oct 26 13:05:30.989446 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: ec66df09b6114f5dbd6678d5e848c737 Oct 26 13:05:30.989446 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1445427066 Oct 26 13:05:30.989446 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-FloatingIPsAssociationTestJSON-1445427066-project Oct 26 13:05:30.989446 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:05:30.989446 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:05:30.989446 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 241a2299894849c889ee7f1100a9823d Oct 26 13:05:30.989446 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1445427066-project Oct 26 13:05:30.989446 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:05:30.989446 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 379653d7-e043-474c-9fdd-3d0f663caed1 could not be found. Oct 26 13:05:30.989446 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '379653d7-e043-474c-9fdd-3d0f663caed1'} Oct 26 13:05:30.990299 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:05:30.990299 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:05:30.990299 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:05:30.990299 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:05:30.990299 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:05:30.990299 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:05:30.990299 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:05:30.990299 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:05:30.990299 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:05:30.990299 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:05:30.990299 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 379653d7-e043-474c-9fdd-3d0f663caed1 could not be found. Oct 26 13:05:30.990299 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:05:30.990299 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:05:30.990299 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:05:30.990299 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:05:30.990299 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:05:30.990299 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:05:30.990299 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:05:30.990299 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:05:30.990299 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:05:30.991800 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:05:30.991800 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:05:30.991800 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:05:30.991800 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:05:30.991800 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:05:30.991800 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:05:30.991800 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:05:30.991800 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:05:30.991800 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:05:30.991800 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 379653d7-e043-474c-9fdd-3d0f663caed1 could not be found. Oct 26 13:05:30.991800 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:05:30.991800 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:05:30.991800 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:05:30.991800 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:05:30.991800 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:05:30.991800 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:05:30.991800 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:05:30.991800 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:05:30.991800 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 379653d7-e043-474c-9fdd-3d0f663caed1 could not be found. Oct 26 13:05:30.991800 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:05:30.994281 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ae5ec28a-62fe-445a-a836-d6a6836aa9ee tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Returning 404 to user: Instance 379653d7-e043-474c-9fdd-3d0f663caed1 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:05:30.997356 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ae5ec28a-62fe-445a-a836-d6a6836aa9ee tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] 10.222.0.40 "DELETE /compute/v2.1/servers/379653d7-e043-474c-9fdd-3d0f663caed1" status: 404 len: 111 microversion: 2.1 time: 0.077990 Oct 26 13:05:30.998945 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 412/856] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:05:30 2022] DELETE /compute/v2.1/servers/379653d7-e043-474c-9fdd-3d0f663caed1 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:05:31.008462 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-57f07a0b-472b-4a76-8ac5-2f73007da56b req-2d30c052-e0a4-4260-9267-afe381cb43f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dffc2812-b18a-4227-932f-3db590d7bc6f", "tag": "eefbc12d-6331-420c-be7b-da952bc9d1cf"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:31.033409 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7431a9ba-5659-4c70-9ec2-c53e0f215779 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde48023bc1a4ee0a0beb2a99030a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589842c86ede4d51a98b22b996918fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:31.036738 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-57f07a0b-472b-4a76-8ac5-2f73007da56b req-2d30c052-e0a4-4260-9267-afe381cb43f3 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:31.037457 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-57f07a0b-472b-4a76-8ac5-2f73007da56b req-2d30c052-e0a4-4260-9267-afe381cb43f3 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:31.038149 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-57f07a0b-472b-4a76-8ac5-2f73007da56b req-2d30c052-e0a4-4260-9267-afe381cb43f3 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:31.044008 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7431a9ba-5659-4c70-9ec2-c53e0f215779 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] 10.222.0.40 "GET /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1" status: 200 len: 1215 microversion: 2.1 time: 0.101055 Oct 26 13:05:31.051543 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-57f07a0b-472b-4a76-8ac5-2f73007da56b req-2d30c052-e0a4-4260-9267-afe381cb43f3 service nova] Creating event network-changed:eefbc12d-6331-420c-be7b-da952bc9d1cf for instance dffc2812-b18a-4227-932f-3db590d7bc6f on n-h2-862686-1 Oct 26 13:05:31.058148 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 445/857] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:30 2022] GET /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1 => generated 1215 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:31.067721 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-57f07a0b-472b-4a76-8ac5-2f73007da56b req-2d30c052-e0a4-4260-9267-afe381cb43f3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059698 Oct 26 13:05:31.068987 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 413/858] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:05:31.076015 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-689cb18e-d436-40a0-b814-aa34bfa70d8a tempest-SecurityGroupsTestAdminJSON-1522255507 tempest-SecurityGroupsTestAdminJSON-1522255507-project-admin] Calling method '.version_select at 0x7f67327c4d30>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:31.084272 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a8aa2c59-fd0c-495e-9554-cfa6984f2f90 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:31.085077 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a8aa2c59-fd0c-495e-9554-cfa6984f2f90 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 3c9dbe46-9160-491b-9efd-074333ee4d8c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:31.094877 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a8aa2c59-fd0c-495e-9554-cfa6984f2f90 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:31.095409 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a8aa2c59-fd0c-495e-9554-cfa6984f2f90 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:31.095895 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a8aa2c59-fd0c-495e-9554-cfa6984f2f90 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:31.096654 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a8aa2c59-fd0c-495e-9554-cfa6984f2f90 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:31.097157 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a8aa2c59-fd0c-495e-9554-cfa6984f2f90 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:31.097738 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a8aa2c59-fd0c-495e-9554-cfa6984f2f90 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:31.320194 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a8aa2c59-fd0c-495e-9554-cfa6984f2f90 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:31.331389 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a8aa2c59-fd0c-495e-9554-cfa6984f2f90 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/3c9dbe46-9160-491b-9efd-074333ee4d8c" status: 200 len: 1468 microversion: 2.1 time: 0.272089 Oct 26 13:05:31.356183 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 446/859] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:31 2022] GET /compute/v2.1/servers/3c9dbe46-9160-491b-9efd-074333ee4d8c => generated 1468 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:31.362102 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3fb3168b-25a9-46cb-bf5d-d314d3787f65 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:31.364333 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3fb3168b-25a9-46cb-bf5d-d314d3787f65 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] [instance: 480f7c70-2963-4887-b8f8-ea3737880136] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:31.372553 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3fb3168b-25a9-46cb-bf5d-d314d3787f65 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:31.374176 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3fb3168b-25a9-46cb-bf5d-d314d3787f65 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:31.374711 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3fb3168b-25a9-46cb-bf5d-d314d3787f65 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:31.376090 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3fb3168b-25a9-46cb-bf5d-d314d3787f65 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:31.376658 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3fb3168b-25a9-46cb-bf5d-d314d3787f65 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:31.377469 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3fb3168b-25a9-46cb-bf5d-d314d3787f65 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:31.411430 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3fb3168b-25a9-46cb-bf5d-d314d3787f65 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] [instance: 480f7c70-2963-4887-b8f8-ea3737880136] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:05:31.533728 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3fb3168b-25a9-46cb-bf5d-d314d3787f65 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] 10.222.0.40 "DELETE /compute/v2.1/servers/480f7c70-2963-4887-b8f8-ea3737880136" status: 204 len: 0 microversion: 2.1 time: 0.175858 Oct 26 13:05:31.534320 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 447/860] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:05:31 2022] DELETE /compute/v2.1/servers/480f7c70-2963-4887-b8f8-ea3737880136 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:05:31.542525 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-976688f0-2d60-4276-aa2f-1c4a627a80fc tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:31.543316 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-976688f0-2d60-4276-aa2f-1c4a627a80fc tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:31.550098 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-976688f0-2d60-4276-aa2f-1c4a627a80fc tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:31.550840 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-976688f0-2d60-4276-aa2f-1c4a627a80fc tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:31.551592 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-976688f0-2d60-4276-aa2f-1c4a627a80fc tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:31.552628 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-976688f0-2d60-4276-aa2f-1c4a627a80fc tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:31.553295 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-976688f0-2d60-4276-aa2f-1c4a627a80fc tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:31.553976 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-976688f0-2d60-4276-aa2f-1c4a627a80fc tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:31.650785 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-976688f0-2d60-4276-aa2f-1c4a627a80fc tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.114860 Oct 26 13:05:31.658725 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 448/861] 10.222.0.40 () {60 vars in 1316 bytes} [Wed Oct 26 13:05:31 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924/os-interface => generated 284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:05:31.666021 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b72bffd4-0ff0-41d1-8497-f0ab0a686efb tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:31.666651 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b72bffd4-0ff0-41d1-8497-f0ab0a686efb tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: 379653d7-e043-474c-9fdd-3d0f663caed1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:31.676171 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b72bffd4-0ff0-41d1-8497-f0ab0a686efb tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:31.676673 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b72bffd4-0ff0-41d1-8497-f0ab0a686efb tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:31.677109 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b72bffd4-0ff0-41d1-8497-f0ab0a686efb tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:31.678325 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b72bffd4-0ff0-41d1-8497-f0ab0a686efb tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:31.678903 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b72bffd4-0ff0-41d1-8497-f0ab0a686efb tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:31.679422 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b72bffd4-0ff0-41d1-8497-f0ab0a686efb tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:31.697806 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-b72bffd4-0ff0-41d1-8497-f0ab0a686efb tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] HTTP exception thrown: Instance 379653d7-e043-474c-9fdd-3d0f663caed1 could not be found. Oct 26 13:05:31.699628 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b72bffd4-0ff0-41d1-8497-f0ab0a686efb tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Request method failure captured: Oct 26 13:05:31.699628 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/379653d7-e043-474c-9fdd-3d0f663caed1 HTTP/1.1 Oct 26 13:05:31.699628 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:05:31.699628 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:05:31.699628 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:05:31.699628 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:05:31.699628 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:05:31.699628 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:05:31.699628 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:05:31.699628 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:05:31.699628 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTBKlCssWTS3uIuvlb3qZMdrcWLduqRK6y7lYGMWJKaDHyabA3HHbK1QJy8wrLendLe8dvg8CEJOPjdcSkeq6wxwfMyXdDGwE64sIJ83eNlGzDxyhs0m4j6793IdF74Jx8R93iNbASvgGAA564NMv82dimk84r03I-CCjsHCyFlT9wI Oct 26 13:05:31.699628 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:05:31.699628 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:05:31.699628 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:05:31.699628 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:05:31.699628 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:05:31.699628 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:05:31.699628 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: ec66df09b6114f5dbd6678d5e848c737 Oct 26 13:05:31.699628 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1445427066 Oct 26 13:05:31.699628 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:05:31.699628 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:05:31.701195 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ec66df09b6114f5dbd6678d5e848c737"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ec66df09b6114f5dbd6678d5e848c737"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ec66df09b6114f5dbd6678d5e848c737"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ec66df09b6114f5dbd6678d5e848c737"}]}] Oct 26 13:05:31.701195 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1445427066 Oct 26 13:05:31.701195 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: ec66df09b6114f5dbd6678d5e848c737 Oct 26 13:05:31.701195 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1445427066 Oct 26 13:05:31.701195 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-FloatingIPsAssociationTestJSON-1445427066-project Oct 26 13:05:31.701195 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:05:31.701195 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:05:31.701195 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 241a2299894849c889ee7f1100a9823d Oct 26 13:05:31.701195 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1445427066-project Oct 26 13:05:31.701195 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:05:31.701195 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 379653d7-e043-474c-9fdd-3d0f663caed1 could not be found. Oct 26 13:05:31.701195 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '379653d7-e043-474c-9fdd-3d0f663caed1'} Oct 26 13:05:31.702081 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:05:31.702081 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:05:31.702081 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:05:31.702081 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:05:31.702081 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:05:31.702081 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:05:31.702081 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:05:31.702081 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:05:31.702081 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:05:31.702081 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:05:31.702081 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 379653d7-e043-474c-9fdd-3d0f663caed1 could not be found. Oct 26 13:05:31.702081 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:05:31.702081 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:05:31.702081 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:05:31.702081 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:05:31.702081 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:05:31.702081 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:05:31.702081 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:05:31.702081 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:05:31.702081 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:05:31.703441 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:05:31.703441 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:05:31.703441 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:05:31.703441 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:05:31.703441 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:05:31.703441 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:05:31.703441 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:05:31.703441 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 379653d7-e043-474c-9fdd-3d0f663caed1 could not be found. Oct 26 13:05:31.703441 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:05:31.703441 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:05:31.703441 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:05:31.703441 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:05:31.703441 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:05:31.703441 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:05:31.703441 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:05:31.703441 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:05:31.703441 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 379653d7-e043-474c-9fdd-3d0f663caed1 could not be found. Oct 26 13:05:31.703441 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:05:31.704494 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b72bffd4-0ff0-41d1-8497-f0ab0a686efb tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Returning 404 to user: Instance 379653d7-e043-474c-9fdd-3d0f663caed1 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:05:31.704494 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b72bffd4-0ff0-41d1-8497-f0ab0a686efb tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] 10.222.0.40 "GET /compute/v2.1/servers/379653d7-e043-474c-9fdd-3d0f663caed1" status: 404 len: 111 microversion: 2.1 time: 0.048133 Oct 26 13:05:31.705194 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 449/862] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:31 2022] GET /compute/v2.1/servers/379653d7-e043-474c-9fdd-3d0f663caed1 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:05:31.711065 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c557c36c-b03c-4b28-a05f-0f0da752f2b9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:31.717071 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c557c36c-b03c-4b28-a05f-0f0da752f2b9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:31.717979 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c557c36c-b03c-4b28-a05f-0f0da752f2b9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Searching by: {'reservation_id': 'r-0cbae20u', 'deleted': False, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b'} {{(pid=120598) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:05:31.725353 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c557c36c-b03c-4b28-a05f-0f0da752f2b9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:31.725886 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c557c36c-b03c-4b28-a05f-0f0da752f2b9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:31.727318 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c557c36c-b03c-4b28-a05f-0f0da752f2b9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:31.728321 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c557c36c-b03c-4b28-a05f-0f0da752f2b9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:31.729006 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c557c36c-b03c-4b28-a05f-0f0da752f2b9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:31.729702 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c557c36c-b03c-4b28-a05f-0f0da752f2b9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:31.750605 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-689cb18e-d436-40a0-b814-aa34bfa70d8a tempest-SecurityGroupsTestAdminJSON-1522255507 tempest-SecurityGroupsTestAdminJSON-1522255507-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/f657cc60-f888-4f3f-b0f9-2cbfbaedde9d" status: 202 len: 0 microversion: 2.1 time: 0.679391 Oct 26 13:05:31.751542 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 414/863] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 26 13:05:31 2022] DELETE /compute/v2.1/os-security-groups/f657cc60-f888-4f3f-b0f9-2cbfbaedde9d => generated 0 bytes in 682 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:05:31.756379 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3545f8dc-fbf2-4f85-a975-7bd45c075db4 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:31.757357 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3545f8dc-fbf2-4f85-a975-7bd45c075db4 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] [instance: 480f7c70-2963-4887-b8f8-ea3737880136] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:31.774797 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3545f8dc-fbf2-4f85-a975-7bd45c075db4 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:31.775443 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3545f8dc-fbf2-4f85-a975-7bd45c075db4 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:31.775985 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3545f8dc-fbf2-4f85-a975-7bd45c075db4 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:31.776843 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3545f8dc-fbf2-4f85-a975-7bd45c075db4 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:31.777431 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3545f8dc-fbf2-4f85-a975-7bd45c075db4 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:31.778036 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3545f8dc-fbf2-4f85-a975-7bd45c075db4 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:31.958508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.multi_cell_list [None req-c557c36c-b03c-4b28-a05f-0f0da752f2b9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120598) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 13:05:31.995668 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:05:32.010978 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3545f8dc-fbf2-4f85-a975-7bd45c075db4 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f9391046054747bbfc1c3e6d65d4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10521abb1c34417fa9369aaba9070968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:32.019497 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3545f8dc-fbf2-4f85-a975-7bd45c075db4 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] 10.222.0.40 "GET /compute/v2.1/servers/480f7c70-2963-4887-b8f8-ea3737880136" status: 200 len: 1711 microversion: 2.1 time: 0.266905 Oct 26 13:05:32.020071 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 415/864] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:31 2022] GET /compute/v2.1/servers/480f7c70-2963-4887-b8f8-ea3737880136 => generated 1711 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:32.025638 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-82693822-26e7-4084-9a2d-256513906e1c req-f326b433-f38d-4a01-b6d1-9b55568e4050 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e4891a-9fbd-42b7-a12c-5a4de9c1f151", "name": "network-vif-plugged", "status": "completed", "tag": "4bacbb43-3b81-44f6-b4ad-82bf06f609ad"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:32.040560 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-82693822-26e7-4084-9a2d-256513906e1c req-f326b433-f38d-4a01-b6d1-9b55568e4050 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:32.041325 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-82693822-26e7-4084-9a2d-256513906e1c req-f326b433-f38d-4a01-b6d1-9b55568e4050 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:32.042016 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-82693822-26e7-4084-9a2d-256513906e1c req-f326b433-f38d-4a01-b6d1-9b55568e4050 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:32.054764 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-82693822-26e7-4084-9a2d-256513906e1c req-f326b433-f38d-4a01-b6d1-9b55568e4050 service nova] Creating event network-vif-plugged:4bacbb43-3b81-44f6-b4ad-82bf06f609ad for instance c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 on n-h1-862686-1 Oct 26 13:05:32.061018 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-82693822-26e7-4084-9a2d-256513906e1c req-f326b433-f38d-4a01-b6d1-9b55568e4050 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038875 Oct 26 13:05:32.061865 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 416/865] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:05:32.073682 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-99756db3-c6ce-4d49-9575-e4335a825bce tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:32.074444 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-99756db3-c6ce-4d49-9575-e4335a825bce tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:32.082323 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-99756db3-c6ce-4d49-9575-e4335a825bce tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:32.082885 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-99756db3-c6ce-4d49-9575-e4335a825bce tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:32.083327 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-99756db3-c6ce-4d49-9575-e4335a825bce tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:32.084235 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-99756db3-c6ce-4d49-9575-e4335a825bce tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:32.084949 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-99756db3-c6ce-4d49-9575-e4335a825bce tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:32.086123 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-99756db3-c6ce-4d49-9575-e4335a825bce tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:32.088981 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c557c36c-b03c-4b28-a05f-0f0da752f2b9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:32.099812 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c557c36c-b03c-4b28-a05f-0f0da752f2b9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:32.100627 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c557c36c-b03c-4b28-a05f-0f0da752f2b9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:32.101261 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c557c36c-b03c-4b28-a05f-0f0da752f2b9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:32.192856 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-99756db3-c6ce-4d49-9575-e4335a825bce tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lazy-loading 'services' on Instance uuid ee752331-9c49-4c73-ac1e-2c38175ed9f3 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:05:32.210040 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-99756db3-c6ce-4d49-9575-e4335a825bce tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 200 len: 1927 microversion: 2.75 time: 0.145260 Oct 26 13:05:32.211940 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 417/866] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:05:32 2022] GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 1927 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:05:32.218442 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-139dc0e1-ea58-49de-9632-def80fc96254 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Calling method '.version_select at 0x7f67327c4d30>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:32.370689 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c557c36c-b03c-4b28-a05f-0f0da752f2b9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/detail?reservation_id=r-0cbae20u" status: 200 len: 2930 microversion: 2.1 time: 0.664312 Oct 26 13:05:32.375597 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 450/867] 10.222.0.40 () {58 vars in 1197 bytes} [Wed Oct 26 13:05:31 2022] GET /compute/v2.1/servers/detail?reservation_id=r-0cbae20u => generated 2930 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:32.382346 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-08d1d6ba-3718-4212-a19b-df8e3a858d64 tempest-SecurityGroupsTestAdminJSON-1522255507 tempest-SecurityGroupsTestAdminJSON-1522255507-project-admin] Calling method '.version_select at 0x7f67327bd670>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:32.913050 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-139dc0e1-ea58-49de-9632-def80fc96254 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/1a938a8f-d393-44c3-8278-3c73adfbe210" status: 202 len: 0 microversion: 2.1 time: 0.700153 Oct 26 13:05:32.916918 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 418/868] 10.222.0.40 () {58 vars in 1263 bytes} [Wed Oct 26 13:05:32 2022] DELETE /compute/v2.1/os-floating-ips/1a938a8f-d393-44c3-8278-3c73adfbe210 => generated 0 bytes in 702 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:05:32.918648 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e8df4abf-822f-4875-982b-7b68c7fdbbaa tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:32.919268 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e8df4abf-822f-4875-982b-7b68c7fdbbaa tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:32.929931 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e8df4abf-822f-4875-982b-7b68c7fdbbaa tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:32.930438 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e8df4abf-822f-4875-982b-7b68c7fdbbaa tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:32.930884 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e8df4abf-822f-4875-982b-7b68c7fdbbaa tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:32.931601 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e8df4abf-822f-4875-982b-7b68c7fdbbaa tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:32.932060 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e8df4abf-822f-4875-982b-7b68c7fdbbaa tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:32.932493 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e8df4abf-822f-4875-982b-7b68c7fdbbaa tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:33.041171 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-08d1d6ba-3718-4212-a19b-df8e3a858d64 tempest-SecurityGroupsTestAdminJSON-1522255507 tempest-SecurityGroupsTestAdminJSON-1522255507-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/293ac480-0450-476c-a53f-a87bd31229de" status: 202 len: 0 microversion: 2.1 time: 0.659794 Oct 26 13:05:33.043266 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 451/869] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 26 13:05:32 2022] DELETE /compute/v2.1/os-security-groups/293ac480-0450-476c-a53f-a87bd31229de => generated 0 bytes in 667 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:05:33.049177 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bedfa4c3-c544-49ea-8c3c-ac8c0bc46d93 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:33.050096 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bedfa4c3-c544-49ea-8c3c-ac8c0bc46d93 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] [instance: f7878a23-cf30-42db-a872-b9cfa0c0b2c1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:33.083757 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bedfa4c3-c544-49ea-8c3c-ac8c0bc46d93 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:33.084342 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bedfa4c3-c544-49ea-8c3c-ac8c0bc46d93 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:33.084685 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bedfa4c3-c544-49ea-8c3c-ac8c0bc46d93 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:33.085430 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bedfa4c3-c544-49ea-8c3c-ac8c0bc46d93 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:33.090981 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bedfa4c3-c544-49ea-8c3c-ac8c0bc46d93 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:33.091631 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bedfa4c3-c544-49ea-8c3c-ac8c0bc46d93 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:33.191892 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bedfa4c3-c544-49ea-8c3c-ac8c0bc46d93 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde48023bc1a4ee0a0beb2a99030a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589842c86ede4d51a98b22b996918fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:33.206119 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bedfa4c3-c544-49ea-8c3c-ac8c0bc46d93 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] 10.222.0.40 "GET /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1" status: 200 len: 1267 microversion: 2.1 time: 0.161134 Oct 26 13:05:33.207429 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 452/870] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:33 2022] GET /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:33.215028 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4a113ff9-0ada-485d-81cc-86297aba8e1c tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:33.252686 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.compute.server_groups [None req-4a113ff9-0ada-485d-81cc-86297aba8e1c tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Querying cell 2e5960f1-3c3d-401b-877c-fe82eb67bd3f(cell1) for 2 instances {{(pid=120598) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 26 13:05:33.254306 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a113ff9-0ada-485d-81cc-86297aba8e1c tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:33.255008 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a113ff9-0ada-485d-81cc-86297aba8e1c tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:33.255535 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a113ff9-0ada-485d-81cc-86297aba8e1c tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:33.290426 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4a113ff9-0ada-485d-81cc-86297aba8e1c tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups/a574f105-f9c7-4f29-b8cf-d00793343b3a" status: 200 len: 271 microversion: 2.1 time: 0.081356 Oct 26 13:05:33.291110 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 453/871] 10.222.0.40 () {58 vars in 1263 bytes} [Wed Oct 26 13:05:33 2022] GET /compute/v2.1/os-server-groups/a574f105-f9c7-4f29-b8cf-d00793343b3a => generated 271 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:05:33.296287 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1e4571f7-ece4-4418-8689-7761b2a7341e tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:33.297075 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1e4571f7-ece4-4418-8689-7761b2a7341e tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: dffc2812-b18a-4227-932f-3db590d7bc6f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:33.303059 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1e4571f7-ece4-4418-8689-7761b2a7341e tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:33.303548 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1e4571f7-ece4-4418-8689-7761b2a7341e tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:33.304008 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1e4571f7-ece4-4418-8689-7761b2a7341e tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:33.305377 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1e4571f7-ece4-4418-8689-7761b2a7341e tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:33.305861 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1e4571f7-ece4-4418-8689-7761b2a7341e tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:33.306279 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1e4571f7-ece4-4418-8689-7761b2a7341e tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:33.336613 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1e4571f7-ece4-4418-8689-7761b2a7341e tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: dffc2812-b18a-4227-932f-3db590d7bc6f] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:05:33.470109 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1e4571f7-ece4-4418-8689-7761b2a7341e tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] 10.222.0.40 "DELETE /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f" status: 204 len: 0 microversion: 2.1 time: 0.177131 Oct 26 13:05:33.471129 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 454/872] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:05:33 2022] DELETE /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:05:33.483727 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4823ece7-56fb-490c-ada5-04cb9f75b134 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:33.484351 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4823ece7-56fb-490c-ada5-04cb9f75b134 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] [instance: 480f7c70-2963-4887-b8f8-ea3737880136] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:33.491528 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4823ece7-56fb-490c-ada5-04cb9f75b134 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:33.492410 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4823ece7-56fb-490c-ada5-04cb9f75b134 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:33.492559 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4823ece7-56fb-490c-ada5-04cb9f75b134 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:33.493291 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4823ece7-56fb-490c-ada5-04cb9f75b134 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:33.493825 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4823ece7-56fb-490c-ada5-04cb9f75b134 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:33.494251 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4823ece7-56fb-490c-ada5-04cb9f75b134 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:33.501332 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e8df4abf-822f-4875-982b-7b68c7fdbbaa tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:33.510706 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e8df4abf-822f-4875-982b-7b68c7fdbbaa tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 200 len: 1379 microversion: 2.1 time: 0.595875 Oct 26 13:05:33.516091 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 419/873] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:32 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 1379 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:33.546348 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-11563068-f69c-4000-9265-33c5cf930e1e tempest-SecurityGroupsTestAdminJSON-804811227 tempest-SecurityGroupsTestAdminJSON-804811227-project] Calling method '.version_select at 0x7f673275cf70>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:33.769455 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-11563068-f69c-4000-9265-33c5cf930e1e tempest-SecurityGroupsTestAdminJSON-804811227 tempest-SecurityGroupsTestAdminJSON-804811227-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/19d8ace2-899b-4928-9294-77427d1030d9" status: 202 len: 0 microversion: 2.1 time: 0.237668 Oct 26 13:05:33.770331 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 420/874] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 26 13:05:33 2022] DELETE /compute/v2.1/os-security-groups/19d8ace2-899b-4928-9294-77427d1030d9 => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:05:33.775414 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-de27224c-2b82-4a7c-8a56-6cf0da738e87 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:33.776033 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-de27224c-2b82-4a7c-8a56-6cf0da738e87 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:33.782441 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-de27224c-2b82-4a7c-8a56-6cf0da738e87 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:33.783163 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-de27224c-2b82-4a7c-8a56-6cf0da738e87 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:33.783803 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-de27224c-2b82-4a7c-8a56-6cf0da738e87 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:33.784647 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-de27224c-2b82-4a7c-8a56-6cf0da738e87 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:33.785947 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-de27224c-2b82-4a7c-8a56-6cf0da738e87 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:33.786632 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-de27224c-2b82-4a7c-8a56-6cf0da738e87 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:33.788314 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4823ece7-56fb-490c-ada5-04cb9f75b134 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f9391046054747bbfc1c3e6d65d4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10521abb1c34417fa9369aaba9070968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:33.798270 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4823ece7-56fb-490c-ada5-04cb9f75b134 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] 10.222.0.40 "GET /compute/v2.1/servers/480f7c70-2963-4887-b8f8-ea3737880136" status: 200 len: 1711 microversion: 2.1 time: 0.323198 Oct 26 13:05:33.799356 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 455/875] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:33 2022] GET /compute/v2.1/servers/480f7c70-2963-4887-b8f8-ea3737880136 => generated 1711 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:33.818303 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-dcdaea70-dfdb-4604-bafa-9a5673f876a0 tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:33.819244 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-dcdaea70-dfdb-4604-bafa-9a5673f876a0 tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] [instance: 2358d550-6ed6-4529-b268-ffdf82f228ff] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:33.829159 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:05:33.831436 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dcdaea70-dfdb-4604-bafa-9a5673f876a0 tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:33.833193 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dcdaea70-dfdb-4604-bafa-9a5673f876a0 tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:33.833193 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dcdaea70-dfdb-4604-bafa-9a5673f876a0 tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:33.834098 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dcdaea70-dfdb-4604-bafa-9a5673f876a0 tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:33.834632 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dcdaea70-dfdb-4604-bafa-9a5673f876a0 tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:33.835166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dcdaea70-dfdb-4604-bafa-9a5673f876a0 tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:33.893707 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-de27224c-2b82-4a7c-8a56-6cf0da738e87 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lazy-loading 'services' on Instance uuid ee752331-9c49-4c73-ac1e-2c38175ed9f3 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:05:33.923157 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-de27224c-2b82-4a7c-8a56-6cf0da738e87 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 200 len: 1927 microversion: 2.75 time: 0.151995 Oct 26 13:05:33.923748 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 421/876] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:05:33 2022] GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 1927 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:05:33.928607 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-041cd651-0b73-4f07-99a3-d13719e63972 req-d8d8c62e-a94b-4f51-87f1-1e4dde8eec31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f27f0232-1c7a-433d-a8ed-9ef4f631b924", "tag": "77991740-2ec4-4120-929b-065a4a4a02c8"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:33.939894 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-041cd651-0b73-4f07-99a3-d13719e63972 req-d8d8c62e-a94b-4f51-87f1-1e4dde8eec31 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:33.940724 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-041cd651-0b73-4f07-99a3-d13719e63972 req-d8d8c62e-a94b-4f51-87f1-1e4dde8eec31 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:33.941336 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-041cd651-0b73-4f07-99a3-d13719e63972 req-d8d8c62e-a94b-4f51-87f1-1e4dde8eec31 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:33.953059 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-041cd651-0b73-4f07-99a3-d13719e63972 req-d8d8c62e-a94b-4f51-87f1-1e4dde8eec31 service nova] Creating event network-changed:77991740-2ec4-4120-929b-065a4a4a02c8 for instance f27f0232-1c7a-433d-a8ed-9ef4f631b924 on n-h1-862686-1 Oct 26 13:05:33.958027 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-041cd651-0b73-4f07-99a3-d13719e63972 req-d8d8c62e-a94b-4f51-87f1-1e4dde8eec31 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032853 Oct 26 13:05:33.958619 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 422/877] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:05:33.963888 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e410fff1-a4e1-429b-8cca-ebab5a0d4793 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:33.964578 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e410fff1-a4e1-429b-8cca-ebab5a0d4793 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: dffc2812-b18a-4227-932f-3db590d7bc6f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:33.970632 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e410fff1-a4e1-429b-8cca-ebab5a0d4793 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:33.971109 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e410fff1-a4e1-429b-8cca-ebab5a0d4793 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:33.971538 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e410fff1-a4e1-429b-8cca-ebab5a0d4793 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:33.972227 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e410fff1-a4e1-429b-8cca-ebab5a0d4793 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:33.972677 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e410fff1-a4e1-429b-8cca-ebab5a0d4793 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:33.973097 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e410fff1-a4e1-429b-8cca-ebab5a0d4793 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:34.113639 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-dcdaea70-dfdb-4604-bafa-9a5673f876a0 tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/2358d550-6ed6-4529-b268-ffdf82f228ff" status: 200 len: 1620 microversion: 2.1 time: 0.304342 Oct 26 13:05:34.126074 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 456/878] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:33 2022] GET /compute/v2.1/servers/2358d550-6ed6-4529-b268-ffdf82f228ff => generated 1620 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:34.126208 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e410fff1-a4e1-429b-8cca-ebab5a0d4793 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241a2299894849c889ee7f1100a9823d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec66df09b6114f5dbd6678d5e848c737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:34.135660 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e410fff1-a4e1-429b-8cca-ebab5a0d4793 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] 10.222.0.40 "GET /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f" status: 200 len: 1523 microversion: 2.1 time: 0.175650 Oct 26 13:05:34.136578 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 423/879] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:33 2022] GET /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:34.142665 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e01107cf-38d6-47f1-8211-f6309b50c91e tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:34.143529 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e01107cf-38d6-47f1-8211-f6309b50c91e tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] [instance: 3c9dbe46-9160-491b-9efd-074333ee4d8c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:34.149946 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e01107cf-38d6-47f1-8211-f6309b50c91e tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:34.150638 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e01107cf-38d6-47f1-8211-f6309b50c91e tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:34.151100 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e01107cf-38d6-47f1-8211-f6309b50c91e tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:34.152150 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e01107cf-38d6-47f1-8211-f6309b50c91e tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:34.152683 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e01107cf-38d6-47f1-8211-f6309b50c91e tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:34.153326 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e01107cf-38d6-47f1-8211-f6309b50c91e tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:34.154318 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5e65d297-c4a9-4d4b-a2c5-2b9f23557c80 tempest-SecurityGroupsTestAdminJSON-804811227 tempest-SecurityGroupsTestAdminJSON-804811227-project] Calling method '.version_select at 0x7f67325f6820>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:34.291754 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e01107cf-38d6-47f1-8211-f6309b50c91e tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/3c9dbe46-9160-491b-9efd-074333ee4d8c" status: 200 len: 1619 microversion: 2.1 time: 0.153903 Oct 26 13:05:34.292345 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 424/880] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:34 2022] GET /compute/v2.1/servers/3c9dbe46-9160-491b-9efd-074333ee4d8c => generated 1619 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:34.303556 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-590f111a-a357-47ec-bb92-ceffe5ce079d tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:34.305446 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-590f111a-a357-47ec-bb92-ceffe5ce079d tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] [instance: f7878a23-cf30-42db-a872-b9cfa0c0b2c1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:34.321469 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-590f111a-a357-47ec-bb92-ceffe5ce079d tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:34.322065 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-590f111a-a357-47ec-bb92-ceffe5ce079d tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:34.322519 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-590f111a-a357-47ec-bb92-ceffe5ce079d tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:34.324037 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-590f111a-a357-47ec-bb92-ceffe5ce079d tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:34.324865 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-590f111a-a357-47ec-bb92-ceffe5ce079d tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:34.326022 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-590f111a-a357-47ec-bb92-ceffe5ce079d tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:34.332368 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:05:34.496674 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-590f111a-a357-47ec-bb92-ceffe5ce079d tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde48023bc1a4ee0a0beb2a99030a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589842c86ede4d51a98b22b996918fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:34.509541 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-590f111a-a357-47ec-bb92-ceffe5ce079d tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] 10.222.0.40 "GET /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1" status: 200 len: 1267 microversion: 2.1 time: 0.215863 Oct 26 13:05:34.520832 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 425/881] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:34 2022] GET /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1 => generated 1267 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:34.537855 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1b812eae-b7be-4ba1-a5a4-48023b043261 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-120313569", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "4c694a16-fdba-414f-9122-1899cc715565"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:34.594152 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5e65d297-c4a9-4d4b-a2c5-2b9f23557c80 tempest-SecurityGroupsTestAdminJSON-804811227 tempest-SecurityGroupsTestAdminJSON-804811227-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/90ef0a24-160a-42a0-aa8e-2d924ecb10fd" status: 202 len: 0 microversion: 2.1 time: 0.466893 Oct 26 13:05:34.594751 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 457/882] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 26 13:05:34 2022] DELETE /compute/v2.1/os-security-groups/90ef0a24-160a-42a0-aa8e-2d924ecb10fd => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:05:34.604682 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d55fcbd7-98c2-4b7e-97b3-63e2462abcab tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:34.605535 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d55fcbd7-98c2-4b7e-97b3-63e2462abcab tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:34.618414 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d55fcbd7-98c2-4b7e-97b3-63e2462abcab tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:34.618925 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d55fcbd7-98c2-4b7e-97b3-63e2462abcab tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:34.619385 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d55fcbd7-98c2-4b7e-97b3-63e2462abcab tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:34.620095 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d55fcbd7-98c2-4b7e-97b3-63e2462abcab tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:34.620561 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d55fcbd7-98c2-4b7e-97b3-63e2462abcab tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:34.620982 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d55fcbd7-98c2-4b7e-97b3-63e2462abcab tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:34.635033 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-1b812eae-b7be-4ba1-a5a4-48023b043261 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] validate_networks() for None {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:05:35.114170 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d55fcbd7-98c2-4b7e-97b3-63e2462abcab tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:35.125823 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d55fcbd7-98c2-4b7e-97b3-63e2462abcab tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 200 len: 1379 microversion: 2.1 time: 0.525354 Oct 26 13:05:35.144958 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 458/883] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:34 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 1379 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:35.152981 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cb4287eb-dc68-42d7-8413-d41aeac81a59 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:35.153802 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cb4287eb-dc68-42d7-8413-d41aeac81a59 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] [instance: 480f7c70-2963-4887-b8f8-ea3737880136] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:35.160008 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cb4287eb-dc68-42d7-8413-d41aeac81a59 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:35.160821 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cb4287eb-dc68-42d7-8413-d41aeac81a59 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:35.161532 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cb4287eb-dc68-42d7-8413-d41aeac81a59 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:35.163035 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cb4287eb-dc68-42d7-8413-d41aeac81a59 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:35.164441 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cb4287eb-dc68-42d7-8413-d41aeac81a59 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:35.165088 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cb4287eb-dc68-42d7-8413-d41aeac81a59 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:35.316266 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-cb4287eb-dc68-42d7-8413-d41aeac81a59 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f9391046054747bbfc1c3e6d65d4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10521abb1c34417fa9369aaba9070968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:35.330434 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cb4287eb-dc68-42d7-8413-d41aeac81a59 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] 10.222.0.40 "GET /compute/v2.1/servers/480f7c70-2963-4887-b8f8-ea3737880136" status: 200 len: 1348 microversion: 2.1 time: 0.184155 Oct 26 13:05:35.334532 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 459/884] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:35 2022] GET /compute/v2.1/servers/480f7c70-2963-4887-b8f8-ea3737880136 => generated 1348 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:35.340741 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fff0efd2-fcb6-446b-ac85-b6c3b516a6ab tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:35.341536 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fff0efd2-fcb6-446b-ac85-b6c3b516a6ab tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:35.353859 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fff0efd2-fcb6-446b-ac85-b6c3b516a6ab tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:35.354535 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fff0efd2-fcb6-446b-ac85-b6c3b516a6ab tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:35.355139 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fff0efd2-fcb6-446b-ac85-b6c3b516a6ab tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:35.356759 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fff0efd2-fcb6-446b-ac85-b6c3b516a6ab tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:35.357406 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fff0efd2-fcb6-446b-ac85-b6c3b516a6ab tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:35.358410 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fff0efd2-fcb6-446b-ac85-b6c3b516a6ab tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:35.514676 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-fff0efd2-fcb6-446b-ac85-b6c3b516a6ab tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lazy-loading 'services' on Instance uuid ee752331-9c49-4c73-ac1e-2c38175ed9f3 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:05:35.546916 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fff0efd2-fcb6-446b-ac85-b6c3b516a6ab tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 200 len: 1927 microversion: 2.75 time: 0.211100 Oct 26 13:05:35.547836 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 460/885] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:05:35 2022] GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 1927 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:05:35.552815 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-07b2d285-0b65-4d85-9003-ddef2c092be0 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:35.553768 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-07b2d285-0b65-4d85-9003-ddef2c092be0 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: dffc2812-b18a-4227-932f-3db590d7bc6f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:35.560839 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07b2d285-0b65-4d85-9003-ddef2c092be0 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:35.561539 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07b2d285-0b65-4d85-9003-ddef2c092be0 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:35.562328 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07b2d285-0b65-4d85-9003-ddef2c092be0 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:35.563177 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07b2d285-0b65-4d85-9003-ddef2c092be0 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:35.563791 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07b2d285-0b65-4d85-9003-ddef2c092be0 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:35.564362 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07b2d285-0b65-4d85-9003-ddef2c092be0 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:35.671101 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-1b812eae-b7be-4ba1-a5a4-48023b043261 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:05:35.671596 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-1b812eae-b7be-4ba1-a5a4-48023b043261 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:05:35.672005 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-1b812eae-b7be-4ba1-a5a4-48023b043261 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:05:35.672407 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-1b812eae-b7be-4ba1-a5a4-48023b043261 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:05:35.672822 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-1b812eae-b7be-4ba1-a5a4-48023b043261 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:05:35.691419 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b812eae-b7be-4ba1-a5a4-48023b043261 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:35.691911 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b812eae-b7be-4ba1-a5a4-48023b043261 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:35.692346 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b812eae-b7be-4ba1-a5a4-48023b043261 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:35.693069 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b812eae-b7be-4ba1-a5a4-48023b043261 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:35.693544 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b812eae-b7be-4ba1-a5a4-48023b043261 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:35.694152 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b812eae-b7be-4ba1-a5a4-48023b043261 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:35.714763 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-1b812eae-b7be-4ba1-a5a4-48023b043261 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Getting quotas for project d6515917885c4f3cb5fb19e05f4e5e2b. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:05:35.719151 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-1b812eae-b7be-4ba1-a5a4-48023b043261 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Getting quotas for user b6cddfeca4ce49788143b2bf4b30545f and project d6515917885c4f3cb5fb19e05f4e5e2b. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:05:35.732720 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1b812eae-b7be-4ba1-a5a4-48023b043261 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:05:35.735593 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1b812eae-b7be-4ba1-a5a4-48023b043261 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 7d754336-7bde-477f-954d-d0b4290ee0fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:05:35.789712 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-07b2d285-0b65-4d85-9003-ddef2c092be0 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241a2299894849c889ee7f1100a9823d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec66df09b6114f5dbd6678d5e848c737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:35.800074 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-07b2d285-0b65-4d85-9003-ddef2c092be0 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] 10.222.0.40 "GET /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f" status: 200 len: 1523 microversion: 2.1 time: 0.250756 Oct 26 13:05:35.801428 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 461/886] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:35 2022] GET /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f => generated 1523 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:35.809047 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3fdb34a7-9cb1-4b83-bbea-24b10b3451c2 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:35.809936 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3fdb34a7-9cb1-4b83-bbea-24b10b3451c2 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] [instance: f7878a23-cf30-42db-a872-b9cfa0c0b2c1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:35.817831 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3fdb34a7-9cb1-4b83-bbea-24b10b3451c2 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:35.818539 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3fdb34a7-9cb1-4b83-bbea-24b10b3451c2 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:35.819157 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3fdb34a7-9cb1-4b83-bbea-24b10b3451c2 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:35.820596 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3fdb34a7-9cb1-4b83-bbea-24b10b3451c2 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:35.821386 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3fdb34a7-9cb1-4b83-bbea-24b10b3451c2 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:35.822124 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3fdb34a7-9cb1-4b83-bbea-24b10b3451c2 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:35.836407 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1b812eae-b7be-4ba1-a5a4-48023b043261 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.310093 Oct 26 13:05:35.837880 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 426/887] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:05:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1316 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:05:35.858330 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-19210d82-4c08-4e4a-a53b-b08fd5a52873 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:35.869922 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-19210d82-4c08-4e4a-a53b-b08fd5a52873 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 7d754336-7bde-477f-954d-d0b4290ee0fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:35.940680 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3fdb34a7-9cb1-4b83-bbea-24b10b3451c2 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde48023bc1a4ee0a0beb2a99030a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589842c86ede4d51a98b22b996918fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:35.951748 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3fdb34a7-9cb1-4b83-bbea-24b10b3451c2 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] 10.222.0.40 "GET /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1" status: 200 len: 1273 microversion: 2.1 time: 0.148751 Oct 26 13:05:35.952598 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 462/888] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:35 2022] GET /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1 => generated 1273 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:35.981406 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-2c5d7601-b44a-48d5-9c8c-ed538cb0105a req-3b705ad6-8128-4f2b-9a57-ddb8037272f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "480f7c70-2963-4887-b8f8-ea3737880136", "name": "network-vif-deleted", "tag": "f46f1d3b-c223-4e80-8cb0-2fc5b785324f"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:35.995002 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-2c5d7601-b44a-48d5-9c8c-ed538cb0105a req-3b705ad6-8128-4f2b-9a57-ddb8037272f3 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:35.995775 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-2c5d7601-b44a-48d5-9c8c-ed538cb0105a req-3b705ad6-8128-4f2b-9a57-ddb8037272f3 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:35.996420 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-2c5d7601-b44a-48d5-9c8c-ed538cb0105a req-3b705ad6-8128-4f2b-9a57-ddb8037272f3 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:36.021345 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-19210d82-4c08-4e4a-a53b-b08fd5a52873 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:36.029452 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-2c5d7601-b44a-48d5-9c8c-ed538cb0105a req-3b705ad6-8128-4f2b-9a57-ddb8037272f3 service nova] Creating event network-vif-deleted:f46f1d3b-c223-4e80-8cb0-2fc5b785324f for instance 480f7c70-2963-4887-b8f8-ea3737880136 on n-h1-862686-1 Oct 26 13:05:36.038255 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-19210d82-4c08-4e4a-a53b-b08fd5a52873 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/7d754336-7bde-477f-954d-d0b4290ee0fa" status: 200 len: 1216 microversion: 2.1 time: 0.191776 Oct 26 13:05:36.042458 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 427/889] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:35 2022] GET /compute/v2.1/servers/7d754336-7bde-477f-954d-d0b4290ee0fa => generated 1216 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:05:36.049828 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-2c5d7601-b44a-48d5-9c8c-ed538cb0105a req-3b705ad6-8128-4f2b-9a57-ddb8037272f3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075638 Oct 26 13:05:36.051556 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 463/890] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:05:36.151705 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-16270192-a603-4291-a5de-b5332e1dc2be tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:36.152330 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-16270192-a603-4291-a5de-b5332e1dc2be tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:36.163318 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-16270192-a603-4291-a5de-b5332e1dc2be tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:36.164522 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-16270192-a603-4291-a5de-b5332e1dc2be tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:36.166302 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-16270192-a603-4291-a5de-b5332e1dc2be tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:36.167059 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-16270192-a603-4291-a5de-b5332e1dc2be tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:36.167493 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-16270192-a603-4291-a5de-b5332e1dc2be tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:36.170104 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-16270192-a603-4291-a5de-b5332e1dc2be tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:36.364879 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1184c569-d03c-4260-b9f6-c31902178b55 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:36.366064 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1184c569-d03c-4260-b9f6-c31902178b55 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] [instance: 480f7c70-2963-4887-b8f8-ea3737880136] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:36.374943 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1184c569-d03c-4260-b9f6-c31902178b55 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:36.375621 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1184c569-d03c-4260-b9f6-c31902178b55 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:36.376276 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1184c569-d03c-4260-b9f6-c31902178b55 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:36.377188 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1184c569-d03c-4260-b9f6-c31902178b55 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:36.377837 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1184c569-d03c-4260-b9f6-c31902178b55 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:36.378701 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1184c569-d03c-4260-b9f6-c31902178b55 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:36.419854 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-1184c569-d03c-4260-b9f6-c31902178b55 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] HTTP exception thrown: Instance 480f7c70-2963-4887-b8f8-ea3737880136 could not be found. Oct 26 13:05:36.421628 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1184c569-d03c-4260-b9f6-c31902178b55 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Request method failure captured: Oct 26 13:05:36.421628 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/480f7c70-2963-4887-b8f8-ea3737880136 HTTP/1.1 Oct 26 13:05:36.421628 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:05:36.421628 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:05:36.421628 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:05:36.421628 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:05:36.421628 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:05:36.421628 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:05:36.421628 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:05:36.421628 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:05:36.421628 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTAFWopok3H3xE_XQuz0fZlUqCw0H_HAFgDowGdxrWxuRERqWGPwU78ltYirOwoaHygIpHlxdR3atlRYeciVf16BD84DmwoejfnU_Q9b9yAfIkhVTD1hRxiYebPBaxz2w0fG0NaOXSU4j7OhjEwuI1DC0kzFzpSVaTiJsYB-tf2CU_o Oct 26 13:05:36.421628 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:05:36.421628 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:05:36.421628 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:05:36.421628 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:05:36.421628 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:05:36.421628 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:05:36.421628 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 10521abb1c34417fa9369aaba9070968 Oct 26 13:05:36.421628 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1343304691 Oct 26 13:05:36.421628 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:05:36.421628 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:05:36.423010 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/10521abb1c34417fa9369aaba9070968"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/10521abb1c34417fa9369aaba9070968"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_10521abb1c34417fa9369aaba9070968"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/10521abb1c34417fa9369aaba9070968"}]}] Oct 26 13:05:36.423010 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1343304691 Oct 26 13:05:36.423010 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 10521abb1c34417fa9369aaba9070968 Oct 26 13:05:36.423010 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1343304691 Oct 26 13:05:36.423010 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1343304691-project Oct 26 13:05:36.423010 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:05:36.423010 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:05:36.423010 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 52f9391046054747bbfc1c3e6d65d4aa Oct 26 13:05:36.423010 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1343304691-project Oct 26 13:05:36.423010 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:05:36.423010 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 480f7c70-2963-4887-b8f8-ea3737880136 could not be found. Oct 26 13:05:36.423010 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '480f7c70-2963-4887-b8f8-ea3737880136'} Oct 26 13:05:36.423724 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:05:36.423724 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:05:36.423724 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:05:36.423724 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:05:36.423724 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:05:36.423724 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:05:36.423724 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:05:36.423724 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:05:36.423724 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:05:36.423724 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:05:36.423724 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 480f7c70-2963-4887-b8f8-ea3737880136 could not be found. Oct 26 13:05:36.423724 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:05:36.423724 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:05:36.423724 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:05:36.423724 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:05:36.423724 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:05:36.423724 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:05:36.423724 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:05:36.423724 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:05:36.423724 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:05:36.424902 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:05:36.424902 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:05:36.424902 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:05:36.424902 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:05:36.424902 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:05:36.424902 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:05:36.424902 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:05:36.424902 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 480f7c70-2963-4887-b8f8-ea3737880136 could not be found. Oct 26 13:05:36.424902 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:05:36.424902 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:05:36.424902 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:05:36.424902 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:05:36.424902 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:05:36.424902 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:05:36.424902 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:05:36.424902 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:05:36.424902 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 480f7c70-2963-4887-b8f8-ea3737880136 could not be found. Oct 26 13:05:36.424902 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:05:36.426423 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1184c569-d03c-4260-b9f6-c31902178b55 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Returning 404 to user: Instance 480f7c70-2963-4887-b8f8-ea3737880136 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:05:36.426423 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1184c569-d03c-4260-b9f6-c31902178b55 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] 10.222.0.40 "GET /compute/v2.1/servers/480f7c70-2963-4887-b8f8-ea3737880136" status: 404 len: 111 microversion: 2.1 time: 0.066022 Oct 26 13:05:36.428149 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 464/891] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:36 2022] GET /compute/v2.1/servers/480f7c70-2963-4887-b8f8-ea3737880136 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:05:36.433777 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e1912971-b5a7-4847-808d-04ab9318ee9e tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:36.434925 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e1912971-b5a7-4847-808d-04ab9318ee9e tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] [instance: 380d16a8-2b4c-460b-9b36-884e7fb24812] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:36.441316 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e1912971-b5a7-4847-808d-04ab9318ee9e tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:36.441826 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e1912971-b5a7-4847-808d-04ab9318ee9e tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:36.442428 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e1912971-b5a7-4847-808d-04ab9318ee9e tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:36.443347 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e1912971-b5a7-4847-808d-04ab9318ee9e tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:36.444259 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e1912971-b5a7-4847-808d-04ab9318ee9e tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:36.445120 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e1912971-b5a7-4847-808d-04ab9318ee9e tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:36.463352 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-e1912971-b5a7-4847-808d-04ab9318ee9e tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] HTTP exception thrown: Instance 380d16a8-2b4c-460b-9b36-884e7fb24812 could not be found. Oct 26 13:05:36.464991 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e1912971-b5a7-4847-808d-04ab9318ee9e tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Request method failure captured: Oct 26 13:05:36.464991 n-d-862686-1 devstack@n-api.service[120598]: request: DELETE /compute/v2.1/servers/380d16a8-2b4c-460b-9b36-884e7fb24812 HTTP/1.1 Oct 26 13:05:36.464991 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:05:36.464991 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:05:36.464991 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:05:36.464991 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:05:36.464991 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:05:36.464991 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:05:36.464991 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:05:36.464991 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:05:36.464991 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTAFWopok3H3xE_XQuz0fZlUqCw0H_HAFgDowGdxrWxuRERqWGPwU78ltYirOwoaHygIpHlxdR3atlRYeciVf16BD84DmwoejfnU_Q9b9yAfIkhVTD1hRxiYebPBaxz2w0fG0NaOXSU4j7OhjEwuI1DC0kzFzpSVaTiJsYB-tf2CU_o Oct 26 13:05:36.464991 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:05:36.464991 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:05:36.464991 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:05:36.464991 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:05:36.464991 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:05:36.464991 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:05:36.464991 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 10521abb1c34417fa9369aaba9070968 Oct 26 13:05:36.464991 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1343304691 Oct 26 13:05:36.464991 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:05:36.464991 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:05:36.466482 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/10521abb1c34417fa9369aaba9070968"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/10521abb1c34417fa9369aaba9070968"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_10521abb1c34417fa9369aaba9070968"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/10521abb1c34417fa9369aaba9070968"}]}] Oct 26 13:05:36.466482 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1343304691 Oct 26 13:05:36.466482 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 10521abb1c34417fa9369aaba9070968 Oct 26 13:05:36.466482 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1343304691 Oct 26 13:05:36.466482 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1343304691-project Oct 26 13:05:36.466482 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:05:36.466482 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:05:36.466482 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 52f9391046054747bbfc1c3e6d65d4aa Oct 26 13:05:36.466482 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1343304691-project Oct 26 13:05:36.466482 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:05:36.466482 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 380d16a8-2b4c-460b-9b36-884e7fb24812 could not be found. Oct 26 13:05:36.466482 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '380d16a8-2b4c-460b-9b36-884e7fb24812'} Oct 26 13:05:36.467258 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:05:36.467258 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:05:36.467258 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:05:36.467258 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:05:36.467258 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:05:36.467258 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:05:36.467258 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:05:36.467258 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:05:36.467258 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:05:36.467258 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:05:36.467258 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 380d16a8-2b4c-460b-9b36-884e7fb24812 could not be found. Oct 26 13:05:36.467258 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:05:36.467258 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:05:36.467258 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:05:36.467258 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:05:36.467258 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:05:36.467258 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:05:36.467258 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:05:36.467258 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:05:36.467258 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:05:36.468557 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:05:36.468557 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:05:36.468557 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:05:36.468557 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:05:36.468557 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:05:36.468557 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:05:36.468557 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:05:36.468557 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:05:36.468557 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:05:36.468557 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 380d16a8-2b4c-460b-9b36-884e7fb24812 could not be found. Oct 26 13:05:36.468557 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:05:36.468557 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:05:36.468557 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:05:36.468557 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:05:36.468557 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:05:36.468557 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:05:36.468557 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:05:36.468557 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:05:36.468557 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 380d16a8-2b4c-460b-9b36-884e7fb24812 could not be found. Oct 26 13:05:36.468557 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:05:36.471993 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e1912971-b5a7-4847-808d-04ab9318ee9e tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Returning 404 to user: Instance 380d16a8-2b4c-460b-9b36-884e7fb24812 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:05:36.473088 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e1912971-b5a7-4847-808d-04ab9318ee9e tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] 10.222.0.40 "DELETE /compute/v2.1/servers/380d16a8-2b4c-460b-9b36-884e7fb24812" status: 404 len: 111 microversion: 2.1 time: 0.043960 Oct 26 13:05:36.474596 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 465/892] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:05:36 2022] DELETE /compute/v2.1/servers/380d16a8-2b4c-460b-9b36-884e7fb24812 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:05:36.484587 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1eda2040-3416-4892-85dc-cdf3a516cff2 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:36.485313 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1eda2040-3416-4892-85dc-cdf3a516cff2 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] [instance: 380d16a8-2b4c-460b-9b36-884e7fb24812] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:36.493690 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1eda2040-3416-4892-85dc-cdf3a516cff2 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:36.494094 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1eda2040-3416-4892-85dc-cdf3a516cff2 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:36.494528 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1eda2040-3416-4892-85dc-cdf3a516cff2 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:36.495236 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1eda2040-3416-4892-85dc-cdf3a516cff2 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:36.495767 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1eda2040-3416-4892-85dc-cdf3a516cff2 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:36.496182 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1eda2040-3416-4892-85dc-cdf3a516cff2 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:36.512290 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-1eda2040-3416-4892-85dc-cdf3a516cff2 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] HTTP exception thrown: Instance 380d16a8-2b4c-460b-9b36-884e7fb24812 could not be found. Oct 26 13:05:36.515368 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1eda2040-3416-4892-85dc-cdf3a516cff2 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Request method failure captured: Oct 26 13:05:36.515368 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/380d16a8-2b4c-460b-9b36-884e7fb24812 HTTP/1.1 Oct 26 13:05:36.515368 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:05:36.515368 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:05:36.515368 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:05:36.515368 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:05:36.515368 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:05:36.515368 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:05:36.515368 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:05:36.515368 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:05:36.515368 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTAFWopok3H3xE_XQuz0fZlUqCw0H_HAFgDowGdxrWxuRERqWGPwU78ltYirOwoaHygIpHlxdR3atlRYeciVf16BD84DmwoejfnU_Q9b9yAfIkhVTD1hRxiYebPBaxz2w0fG0NaOXSU4j7OhjEwuI1DC0kzFzpSVaTiJsYB-tf2CU_o Oct 26 13:05:36.515368 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:05:36.515368 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:05:36.515368 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:05:36.515368 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:05:36.515368 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:05:36.515368 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:05:36.515368 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 10521abb1c34417fa9369aaba9070968 Oct 26 13:05:36.515368 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1343304691 Oct 26 13:05:36.515368 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:05:36.515368 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:05:36.516721 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/10521abb1c34417fa9369aaba9070968"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/10521abb1c34417fa9369aaba9070968"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_10521abb1c34417fa9369aaba9070968"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/10521abb1c34417fa9369aaba9070968"}]}] Oct 26 13:05:36.516721 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1343304691 Oct 26 13:05:36.516721 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 10521abb1c34417fa9369aaba9070968 Oct 26 13:05:36.516721 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1343304691 Oct 26 13:05:36.516721 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1343304691-project Oct 26 13:05:36.516721 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:05:36.516721 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:05:36.516721 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 52f9391046054747bbfc1c3e6d65d4aa Oct 26 13:05:36.516721 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1343304691-project Oct 26 13:05:36.516721 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:05:36.516721 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 380d16a8-2b4c-460b-9b36-884e7fb24812 could not be found. Oct 26 13:05:36.516721 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '380d16a8-2b4c-460b-9b36-884e7fb24812'} Oct 26 13:05:36.517443 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:05:36.517443 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:05:36.517443 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:05:36.517443 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:05:36.517443 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:05:36.517443 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:05:36.517443 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:05:36.517443 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:05:36.517443 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:05:36.517443 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:05:36.517443 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 380d16a8-2b4c-460b-9b36-884e7fb24812 could not be found. Oct 26 13:05:36.517443 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:05:36.517443 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:05:36.517443 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:05:36.517443 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:05:36.517443 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:05:36.517443 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:05:36.517443 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:05:36.517443 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:05:36.517443 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:05:36.518875 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:05:36.518875 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:05:36.518875 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:05:36.518875 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:05:36.518875 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:05:36.518875 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:05:36.518875 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:05:36.518875 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 380d16a8-2b4c-460b-9b36-884e7fb24812 could not be found. Oct 26 13:05:36.518875 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:05:36.518875 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:05:36.518875 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:05:36.518875 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:05:36.518875 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:05:36.518875 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:05:36.518875 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:05:36.518875 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:05:36.518875 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 380d16a8-2b4c-460b-9b36-884e7fb24812 could not be found. Oct 26 13:05:36.518875 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:05:36.520055 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1eda2040-3416-4892-85dc-cdf3a516cff2 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Returning 404 to user: Instance 380d16a8-2b4c-460b-9b36-884e7fb24812 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:05:36.520055 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1eda2040-3416-4892-85dc-cdf3a516cff2 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] 10.222.0.40 "GET /compute/v2.1/servers/380d16a8-2b4c-460b-9b36-884e7fb24812" status: 404 len: 111 microversion: 2.1 time: 0.039632 Oct 26 13:05:36.521802 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 466/893] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:36 2022] GET /compute/v2.1/servers/380d16a8-2b4c-460b-9b36-884e7fb24812 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:05:36.530470 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-293b9864-9c3c-474d-a850-f12ff8868738 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Calling method '.version_select at 0x7f67325c5820>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:36.554306 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-293b9864-9c3c-474d-a850-f12ff8868738 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1688437826" status: 202 len: 0 microversion: 2.1 time: 0.028123 Oct 26 13:05:36.558283 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 467/894] 10.222.0.40 () {58 vars in 1221 bytes} [Wed Oct 26 13:05:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1688437826 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 13:05:36.578533 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-26d599f2-fd42-452c-a369-a23dcef93a12 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:36.580232 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-26d599f2-fd42-452c-a369-a23dcef93a12 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:36.590023 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26d599f2-fd42-452c-a369-a23dcef93a12 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:36.590891 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26d599f2-fd42-452c-a369-a23dcef93a12 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:36.591414 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26d599f2-fd42-452c-a369-a23dcef93a12 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:36.592205 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26d599f2-fd42-452c-a369-a23dcef93a12 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:36.592720 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26d599f2-fd42-452c-a369-a23dcef93a12 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:36.593521 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26d599f2-fd42-452c-a369-a23dcef93a12 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:36.708014 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-26d599f2-fd42-452c-a369-a23dcef93a12 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lazy-loading 'services' on Instance uuid ee752331-9c49-4c73-ac1e-2c38175ed9f3 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:05:36.729773 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-16270192-a603-4291-a5de-b5332e1dc2be tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:36.738903 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-16270192-a603-4291-a5de-b5332e1dc2be tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 200 len: 1529 microversion: 2.1 time: 0.591862 Oct 26 13:05:36.740053 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 428/895] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:36 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 1529 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:36.743950 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-26d599f2-fd42-452c-a369-a23dcef93a12 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 200 len: 1927 microversion: 2.75 time: 0.170025 Oct 26 13:05:36.747454 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 468/896] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:05:36 2022] GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 1927 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:05:36.765750 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8d0fbf0c-d2c5-448b-8fd0-05345d95bcea tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:36.766453 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8d0fbf0c-d2c5-448b-8fd0-05345d95bcea tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:36.781848 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d0fbf0c-d2c5-448b-8fd0-05345d95bcea tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:36.782351 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d0fbf0c-d2c5-448b-8fd0-05345d95bcea tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:36.782793 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d0fbf0c-d2c5-448b-8fd0-05345d95bcea tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:36.783710 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d0fbf0c-d2c5-448b-8fd0-05345d95bcea tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:36.786506 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d0fbf0c-d2c5-448b-8fd0-05345d95bcea tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:36.787149 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d0fbf0c-d2c5-448b-8fd0-05345d95bcea tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:36.829120 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ff9aabbc-8acd-457f-8a74-6317f393e876 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:36.830501 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ff9aabbc-8acd-457f-8a74-6317f393e876 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: dffc2812-b18a-4227-932f-3db590d7bc6f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:36.842377 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ff9aabbc-8acd-457f-8a74-6317f393e876 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:36.843213 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ff9aabbc-8acd-457f-8a74-6317f393e876 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:36.843885 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ff9aabbc-8acd-457f-8a74-6317f393e876 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:36.847916 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ff9aabbc-8acd-457f-8a74-6317f393e876 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:36.848811 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ff9aabbc-8acd-457f-8a74-6317f393e876 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:36.849934 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ff9aabbc-8acd-457f-8a74-6317f393e876 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:37.013131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ff9aabbc-8acd-457f-8a74-6317f393e876 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241a2299894849c889ee7f1100a9823d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec66df09b6114f5dbd6678d5e848c737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:37.024359 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ff9aabbc-8acd-457f-8a74-6317f393e876 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] 10.222.0.40 "GET /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f" status: 200 len: 1481 microversion: 2.1 time: 0.199604 Oct 26 13:05:37.040290 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 469/897] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:36 2022] GET /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f => generated 1481 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:05:37.042124 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f35ceede-21de-44b0-bde4-9f35319e276b tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:37.042206 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f35ceede-21de-44b0-bde4-9f35319e276b tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] [instance: f7878a23-cf30-42db-a872-b9cfa0c0b2c1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:37.048992 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f35ceede-21de-44b0-bde4-9f35319e276b tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:37.050225 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f35ceede-21de-44b0-bde4-9f35319e276b tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:37.050997 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f35ceede-21de-44b0-bde4-9f35319e276b tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:37.051786 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f35ceede-21de-44b0-bde4-9f35319e276b tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:37.052248 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f35ceede-21de-44b0-bde4-9f35319e276b tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:37.052737 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f35ceede-21de-44b0-bde4-9f35319e276b tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:37.077779 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:05:37.257098 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f35ceede-21de-44b0-bde4-9f35319e276b tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde48023bc1a4ee0a0beb2a99030a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589842c86ede4d51a98b22b996918fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:37.270684 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f35ceede-21de-44b0-bde4-9f35319e276b tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] 10.222.0.40 "GET /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1" status: 200 len: 1315 microversion: 2.1 time: 0.235914 Oct 26 13:05:37.271863 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 470/898] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:37 2022] GET /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:37.291643 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-d324fe1d-9146-4644-b7a7-7aed026dc22c req-748308a7-3c2a-4301-9cab-eeb3ecc6b938 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dffc2812-b18a-4227-932f-3db590d7bc6f", "name": "network-vif-deleted", "tag": "eefbc12d-6331-420c-be7b-da952bc9d1cf"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:37.307010 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-d324fe1d-9146-4644-b7a7-7aed026dc22c req-748308a7-3c2a-4301-9cab-eeb3ecc6b938 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:37.307491 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-d324fe1d-9146-4644-b7a7-7aed026dc22c req-748308a7-3c2a-4301-9cab-eeb3ecc6b938 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:37.307971 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-d324fe1d-9146-4644-b7a7-7aed026dc22c req-748308a7-3c2a-4301-9cab-eeb3ecc6b938 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:37.328197 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-d324fe1d-9146-4644-b7a7-7aed026dc22c req-748308a7-3c2a-4301-9cab-eeb3ecc6b938 service nova] Creating event network-vif-deleted:eefbc12d-6331-420c-be7b-da952bc9d1cf for instance dffc2812-b18a-4227-932f-3db590d7bc6f on n-h2-862686-1 Oct 26 13:05:37.342531 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-d324fe1d-9146-4644-b7a7-7aed026dc22c req-748308a7-3c2a-4301-9cab-eeb3ecc6b938 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065253 Oct 26 13:05:37.344912 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 471/899] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:05:37.353969 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ceece1db-0d81-4e22-91dd-a10f9a21fbe0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:37.354681 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ceece1db-0d81-4e22-91dd-a10f9a21fbe0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 7d754336-7bde-477f-954d-d0b4290ee0fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:37.368024 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ceece1db-0d81-4e22-91dd-a10f9a21fbe0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:37.371892 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ceece1db-0d81-4e22-91dd-a10f9a21fbe0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:37.372550 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ceece1db-0d81-4e22-91dd-a10f9a21fbe0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:37.373282 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ceece1db-0d81-4e22-91dd-a10f9a21fbe0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:37.373796 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ceece1db-0d81-4e22-91dd-a10f9a21fbe0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:37.374570 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ceece1db-0d81-4e22-91dd-a10f9a21fbe0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:37.466511 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8d0fbf0c-d2c5-448b-8fd0-05345d95bcea tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:37.468509 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ceece1db-0d81-4e22-91dd-a10f9a21fbe0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:37.480440 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ceece1db-0d81-4e22-91dd-a10f9a21fbe0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/7d754336-7bde-477f-954d-d0b4290ee0fa" status: 200 len: 1268 microversion: 2.1 time: 0.134123 Oct 26 13:05:37.482244 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 472/900] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:37 2022] GET /compute/v2.1/servers/7d754336-7bde-477f-954d-d0b4290ee0fa => generated 1268 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:37.484198 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8d0fbf0c-d2c5-448b-8fd0-05345d95bcea tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 200 len: 1529 microversion: 2.1 time: 0.723408 Oct 26 13:05:37.484941 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 429/901] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:36 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 1529 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:37.515152 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4900586d-a983-4c9f-b849-145c693478d5 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:37.538255 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4900586d-a983-4c9f-b849-145c693478d5 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/bdaded09-0e46-4d65-bf81-f885dd5c6898" status: 202 len: 0 microversion: 2.1 time: 0.031570 Oct 26 13:05:37.539086 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 473/902] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:05:37 2022] DELETE /compute/v2.1/flavors/bdaded09-0e46-4d65-bf81-f885dd5c6898 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:05:37.548089 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b3c72091-a150-4cfe-9261-3e15ae46a0cf tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:37.575480 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b3c72091-a150-4cfe-9261-3e15ae46a0cf tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.031890 Oct 26 13:05:37.588926 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 430/903] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:05:37 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:37.596840 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1f886fc6-af7b-4c89-aa57-6545937c6df9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:37.599165 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1f886fc6-af7b-4c89-aa57-6545937c6df9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:37.608605 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f886fc6-af7b-4c89-aa57-6545937c6df9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:37.609102 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f886fc6-af7b-4c89-aa57-6545937c6df9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:37.609683 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f886fc6-af7b-4c89-aa57-6545937c6df9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:37.610401 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f886fc6-af7b-4c89-aa57-6545937c6df9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:37.610856 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f886fc6-af7b-4c89-aa57-6545937c6df9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:37.611292 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f886fc6-af7b-4c89-aa57-6545937c6df9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:37.728646 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1f886fc6-af7b-4c89-aa57-6545937c6df9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:37.736833 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1f886fc6-af7b-4c89-aa57-6545937c6df9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Old instance type tempest-test_resize_flavor_-1102669246, new instance type m1.heat {{(pid=120598) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 26 13:05:37.745510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-1f886fc6-af7b-4c89-aa57-6545937c6df9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:05:37.746246 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-1f886fc6-af7b-4c89-aa57-6545937c6df9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:05:37.746894 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-1f886fc6-af7b-4c89-aa57-6545937c6df9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:05:37.747701 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-1f886fc6-af7b-4c89-aa57-6545937c6df9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:05:37.748521 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-1f886fc6-af7b-4c89-aa57-6545937c6df9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:05:37.774296 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-09a7495a-b4b3-45fd-b9af-ac1515cd0975 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:37.775678 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-09a7495a-b4b3-45fd-b9af-ac1515cd0975 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:37.783553 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09a7495a-b4b3-45fd-b9af-ac1515cd0975 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:37.784377 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09a7495a-b4b3-45fd-b9af-ac1515cd0975 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:37.785024 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09a7495a-b4b3-45fd-b9af-ac1515cd0975 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:37.786187 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09a7495a-b4b3-45fd-b9af-ac1515cd0975 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:37.786848 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09a7495a-b4b3-45fd-b9af-ac1515cd0975 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:37.787566 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09a7495a-b4b3-45fd-b9af-ac1515cd0975 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:37.924294 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-09a7495a-b4b3-45fd-b9af-ac1515cd0975 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lazy-loading 'services' on Instance uuid ee752331-9c49-4c73-ac1e-2c38175ed9f3 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:05:37.939658 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1f886fc6-af7b-4c89-aa57-6545937c6df9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "POST /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151/action" status: 202 len: 0 microversion: 2.1 time: 0.345194 Oct 26 13:05:37.949593 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 474/904] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:05:37 2022] POST /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 13:05:37.961292 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-10d569cf-09a6-4f0b-87fb-1a5551f2aa73 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:37.962222 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-10d569cf-09a6-4f0b-87fb-1a5551f2aa73 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:37.969126 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10d569cf-09a6-4f0b-87fb-1a5551f2aa73 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:37.969707 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10d569cf-09a6-4f0b-87fb-1a5551f2aa73 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:37.970155 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10d569cf-09a6-4f0b-87fb-1a5551f2aa73 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:37.970872 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10d569cf-09a6-4f0b-87fb-1a5551f2aa73 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:37.971335 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10d569cf-09a6-4f0b-87fb-1a5551f2aa73 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:37.972035 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10d569cf-09a6-4f0b-87fb-1a5551f2aa73 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:37.999335 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-09a7495a-b4b3-45fd-b9af-ac1515cd0975 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 200 len: 1927 microversion: 2.75 time: 0.229369 Oct 26 13:05:38.013516 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 431/905] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:05:37 2022] GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 1927 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:05:38.049900 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6e1e2d69-f8e6-4014-8ef3-685535a6cb75 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:38.049900 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6e1e2d69-f8e6-4014-8ef3-685535a6cb75 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: dffc2812-b18a-4227-932f-3db590d7bc6f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:38.057873 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e1e2d69-f8e6-4014-8ef3-685535a6cb75 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:38.058375 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e1e2d69-f8e6-4014-8ef3-685535a6cb75 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:38.058813 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e1e2d69-f8e6-4014-8ef3-685535a6cb75 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:38.059524 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e1e2d69-f8e6-4014-8ef3-685535a6cb75 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:38.059976 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e1e2d69-f8e6-4014-8ef3-685535a6cb75 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:38.060400 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e1e2d69-f8e6-4014-8ef3-685535a6cb75 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:38.107248 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:05:38.116156 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e1e2d69-f8e6-4014-8ef3-685535a6cb75 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:38.121389 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e1e2d69-f8e6-4014-8ef3-685535a6cb75 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:38.122259 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e1e2d69-f8e6-4014-8ef3-685535a6cb75 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:38.122884 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-6e1e2d69-f8e6-4014-8ef3-685535a6cb75 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lazy-loading 'fault' on Instance uuid dffc2812-b18a-4227-932f-3db590d7bc6f {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:05:38.316661 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-10d569cf-09a6-4f0b-87fb-1a5551f2aa73 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:38.333388 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-10d569cf-09a6-4f0b-87fb-1a5551f2aa73 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 200 len: 1538 microversion: 2.1 time: 0.381979 Oct 26 13:05:38.335105 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 475/906] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:37 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 1538 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:38.342351 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fe05f19f-a956-46fa-ab28-8f9ee8f74589 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:38.342959 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fe05f19f-a956-46fa-ab28-8f9ee8f74589 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] [instance: f7878a23-cf30-42db-a872-b9cfa0c0b2c1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:38.350010 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe05f19f-a956-46fa-ab28-8f9ee8f74589 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:38.350511 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe05f19f-a956-46fa-ab28-8f9ee8f74589 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:38.351504 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe05f19f-a956-46fa-ab28-8f9ee8f74589 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:38.352600 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe05f19f-a956-46fa-ab28-8f9ee8f74589 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:38.353931 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe05f19f-a956-46fa-ab28-8f9ee8f74589 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:38.354558 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe05f19f-a956-46fa-ab28-8f9ee8f74589 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:38.515877 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6e1e2d69-f8e6-4014-8ef3-685535a6cb75 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241a2299894849c889ee7f1100a9823d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec66df09b6114f5dbd6678d5e848c737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:38.525024 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6e1e2d69-f8e6-4014-8ef3-685535a6cb75 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] 10.222.0.40 "GET /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f" status: 200 len: 1313 microversion: 2.1 time: 0.479693 Oct 26 13:05:38.537762 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 432/907] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:38 2022] GET /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f => generated 1313 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:05:38.537762 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-442b7f41-4fb7-4f04-9c6d-7710cf0b75ad tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:38.537762 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-442b7f41-4fb7-4f04-9c6d-7710cf0b75ad tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 7d754336-7bde-477f-954d-d0b4290ee0fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:38.554444 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-442b7f41-4fb7-4f04-9c6d-7710cf0b75ad tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:38.556064 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-442b7f41-4fb7-4f04-9c6d-7710cf0b75ad tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:38.556623 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-442b7f41-4fb7-4f04-9c6d-7710cf0b75ad tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:38.557344 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-442b7f41-4fb7-4f04-9c6d-7710cf0b75ad tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:38.558501 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-442b7f41-4fb7-4f04-9c6d-7710cf0b75ad tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:38.570827 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-442b7f41-4fb7-4f04-9c6d-7710cf0b75ad tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:38.624235 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fe05f19f-a956-46fa-ab28-8f9ee8f74589 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde48023bc1a4ee0a0beb2a99030a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589842c86ede4d51a98b22b996918fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:38.635712 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fe05f19f-a956-46fa-ab28-8f9ee8f74589 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] 10.222.0.40 "GET /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1" status: 200 len: 1315 microversion: 2.1 time: 0.298119 Oct 26 13:05:38.636796 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 476/908] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:38 2022] GET /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1 => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:38.783351 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-442b7f41-4fb7-4f04-9c6d-7710cf0b75ad tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:38.793210 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-442b7f41-4fb7-4f04-9c6d-7710cf0b75ad tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/7d754336-7bde-477f-954d-d0b4290ee0fa" status: 200 len: 1274 microversion: 2.1 time: 0.260678 Oct 26 13:05:38.798214 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 433/909] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:38 2022] GET /compute/v2.1/servers/7d754336-7bde-477f-954d-d0b4290ee0fa => generated 1274 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:38.949915 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e6e16e68-06f4-475b-b903-3ead937cd0f9 tempest-ServersWithSpecificFlavorTestJSON-25290177 tempest-ServersWithSpecificFlavorTestJSON-25290177-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:38.982772 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e6e16e68-06f4-475b-b903-3ead937cd0f9 tempest-ServersWithSpecificFlavorTestJSON-25290177 tempest-ServersWithSpecificFlavorTestJSON-25290177-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/780426335" status: 202 len: 0 microversion: 2.1 time: 0.037433 Oct 26 13:05:38.984038 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 477/910] 10.222.0.40 () {58 vars in 1158 bytes} [Wed Oct 26 13:05:38 2022] DELETE /compute/v2.1/flavors/780426335 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:05:38.993407 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-65264bf3-bcec-4a95-b620-891dbe5f844a tempest-ServersWithSpecificFlavorTestJSON-25290177 tempest-ServersWithSpecificFlavorTestJSON-25290177-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:39.023131 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-65264bf3-bcec-4a95-b620-891dbe5f844a tempest-ServersWithSpecificFlavorTestJSON-25290177 tempest-ServersWithSpecificFlavorTestJSON-25290177-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5402 microversion: 2.1 time: 0.033198 Oct 26 13:05:39.023507 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 434/911] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:05:38 2022] GET /compute/v2.1/flavors/detail => generated 5402 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:39.040589 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a64bbdba-019e-4355-bbb5-6e9ba385d9e9 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:39.041762 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a64bbdba-019e-4355-bbb5-6e9ba385d9e9 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:39.051863 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a64bbdba-019e-4355-bbb5-6e9ba385d9e9 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:39.052430 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a64bbdba-019e-4355-bbb5-6e9ba385d9e9 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:39.052874 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a64bbdba-019e-4355-bbb5-6e9ba385d9e9 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:39.053605 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a64bbdba-019e-4355-bbb5-6e9ba385d9e9 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:39.054055 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a64bbdba-019e-4355-bbb5-6e9ba385d9e9 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:39.055443 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a64bbdba-019e-4355-bbb5-6e9ba385d9e9 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:39.061245 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-81568f9a-3ddb-4845-aaa0-bac94a90e658 tempest-ServersWithSpecificFlavorTestJSON-25290177 tempest-ServersWithSpecificFlavorTestJSON-25290177-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:39.084598 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-81568f9a-3ddb-4845-aaa0-bac94a90e658 tempest-ServersWithSpecificFlavorTestJSON-25290177 tempest-ServersWithSpecificFlavorTestJSON-25290177-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/566667230" status: 202 len: 0 microversion: 2.1 time: 0.037840 Oct 26 13:05:39.086255 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 435/912] 10.222.0.40 () {58 vars in 1158 bytes} [Wed Oct 26 13:05:39 2022] DELETE /compute/v2.1/flavors/566667230 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:05:39.098336 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4aa6571e-1dd3-4244-ad8d-994acda07eab tempest-ServersWithSpecificFlavorTestJSON-25290177 tempest-ServersWithSpecificFlavorTestJSON-25290177-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:39.139707 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4aa6571e-1dd3-4244-ad8d-994acda07eab tempest-ServersWithSpecificFlavorTestJSON-25290177 tempest-ServersWithSpecificFlavorTestJSON-25290177-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048408 Oct 26 13:05:39.155462 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 436/913] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:05:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:05:39.173346 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cf9d3266-bc87-47a0-b0a3-f77ce6b2107a tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:39.175190 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cf9d3266-bc87-47a0-b0a3-f77ce6b2107a tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] [instance: 480f7c70-2963-4887-b8f8-ea3737880136] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:39.179174 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-a64bbdba-019e-4355-bbb5-6e9ba385d9e9 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lazy-loading 'services' on Instance uuid ee752331-9c49-4c73-ac1e-2c38175ed9f3 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:05:39.182481 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf9d3266-bc87-47a0-b0a3-f77ce6b2107a tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:39.183037 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf9d3266-bc87-47a0-b0a3-f77ce6b2107a tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:39.183475 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf9d3266-bc87-47a0-b0a3-f77ce6b2107a tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:39.184176 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf9d3266-bc87-47a0-b0a3-f77ce6b2107a tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:39.184632 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf9d3266-bc87-47a0-b0a3-f77ce6b2107a tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:39.185103 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf9d3266-bc87-47a0-b0a3-f77ce6b2107a tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:39.200959 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a64bbdba-019e-4355-bbb5-6e9ba385d9e9 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 200 len: 1927 microversion: 2.75 time: 0.165683 Oct 26 13:05:39.202051 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 478/914] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:05:39 2022] GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 1927 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:05:39.204711 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-cf9d3266-bc87-47a0-b0a3-f77ce6b2107a tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] HTTP exception thrown: Instance 480f7c70-2963-4887-b8f8-ea3737880136 could not be found. Oct 26 13:05:39.206477 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cf9d3266-bc87-47a0-b0a3-f77ce6b2107a tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Request method failure captured: Oct 26 13:05:39.206477 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/servers/480f7c70-2963-4887-b8f8-ea3737880136 HTTP/1.1 Oct 26 13:05:39.206477 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:05:39.206477 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:05:39.206477 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:05:39.206477 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:05:39.206477 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:05:39.206477 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:05:39.206477 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:05:39.206477 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:05:39.206477 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTAFWopok3H3xE_XQuz0fZlUqCw0H_HAFgDowGdxrWxuRERqWGPwU78ltYirOwoaHygIpHlxdR3atlRYeciVf16BD84DmwoejfnU_Q9b9yAfIkhVTD1hRxiYebPBaxz2w0fG0NaOXSU4j7OhjEwuI1DC0kzFzpSVaTiJsYB-tf2CU_o Oct 26 13:05:39.206477 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:05:39.206477 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:05:39.206477 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:05:39.206477 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:05:39.206477 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:05:39.206477 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:05:39.206477 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 10521abb1c34417fa9369aaba9070968 Oct 26 13:05:39.206477 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1343304691 Oct 26 13:05:39.206477 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:05:39.206477 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:05:39.208025 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/10521abb1c34417fa9369aaba9070968"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/10521abb1c34417fa9369aaba9070968"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_10521abb1c34417fa9369aaba9070968"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/10521abb1c34417fa9369aaba9070968"}]}] Oct 26 13:05:39.208025 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1343304691 Oct 26 13:05:39.208025 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 10521abb1c34417fa9369aaba9070968 Oct 26 13:05:39.208025 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1343304691 Oct 26 13:05:39.208025 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1343304691-project Oct 26 13:05:39.208025 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:05:39.208025 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:05:39.208025 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 52f9391046054747bbfc1c3e6d65d4aa Oct 26 13:05:39.208025 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1343304691-project Oct 26 13:05:39.208025 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:05:39.208025 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 480f7c70-2963-4887-b8f8-ea3737880136 could not be found. Oct 26 13:05:39.208025 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '480f7c70-2963-4887-b8f8-ea3737880136'} Oct 26 13:05:39.208886 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:05:39.208886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:05:39.208886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:05:39.208886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:05:39.208886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:05:39.208886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:05:39.208886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:05:39.208886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:05:39.208886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:05:39.208886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:05:39.208886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 480f7c70-2963-4887-b8f8-ea3737880136 could not be found. Oct 26 13:05:39.208886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:05:39.208886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:05:39.208886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:05:39.208886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:05:39.208886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:05:39.208886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:05:39.208886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:05:39.208886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:05:39.208886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:05:39.211166 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:05:39.211166 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:05:39.211166 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:05:39.211166 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:05:39.211166 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:05:39.211166 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:05:39.211166 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:05:39.211166 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:05:39.211166 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:05:39.211166 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 480f7c70-2963-4887-b8f8-ea3737880136 could not be found. Oct 26 13:05:39.211166 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:05:39.211166 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:05:39.211166 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:05:39.211166 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:05:39.211166 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:05:39.211166 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:05:39.211166 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:05:39.211166 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:05:39.211166 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 480f7c70-2963-4887-b8f8-ea3737880136 could not be found. Oct 26 13:05:39.211166 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:05:39.212924 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cf9d3266-bc87-47a0-b0a3-f77ce6b2107a tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Returning 404 to user: Instance 480f7c70-2963-4887-b8f8-ea3737880136 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:05:39.212924 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cf9d3266-bc87-47a0-b0a3-f77ce6b2107a tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] 10.222.0.40 "DELETE /compute/v2.1/servers/480f7c70-2963-4887-b8f8-ea3737880136" status: 404 len: 111 microversion: 2.1 time: 0.045444 Oct 26 13:05:39.212924 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 437/915] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:05:39 2022] DELETE /compute/v2.1/servers/480f7c70-2963-4887-b8f8-ea3737880136 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:05:39.226288 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ec8704c0-0988-4469-896f-2a793b638a60 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:39.227342 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ec8704c0-0988-4469-896f-2a793b638a60 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] [instance: 480f7c70-2963-4887-b8f8-ea3737880136] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:39.234148 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec8704c0-0988-4469-896f-2a793b638a60 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:39.234717 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec8704c0-0988-4469-896f-2a793b638a60 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:39.235816 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec8704c0-0988-4469-896f-2a793b638a60 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:39.236609 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec8704c0-0988-4469-896f-2a793b638a60 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:39.237145 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec8704c0-0988-4469-896f-2a793b638a60 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:39.237737 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec8704c0-0988-4469-896f-2a793b638a60 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:39.254248 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-ec8704c0-0988-4469-896f-2a793b638a60 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] HTTP exception thrown: Instance 480f7c70-2963-4887-b8f8-ea3737880136 could not be found. Oct 26 13:05:39.264799 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ec8704c0-0988-4469-896f-2a793b638a60 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Request method failure captured: Oct 26 13:05:39.264799 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/480f7c70-2963-4887-b8f8-ea3737880136 HTTP/1.1 Oct 26 13:05:39.264799 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:05:39.264799 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:05:39.264799 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:05:39.264799 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:05:39.264799 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:05:39.264799 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:05:39.264799 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:05:39.264799 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:05:39.264799 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTAFWopok3H3xE_XQuz0fZlUqCw0H_HAFgDowGdxrWxuRERqWGPwU78ltYirOwoaHygIpHlxdR3atlRYeciVf16BD84DmwoejfnU_Q9b9yAfIkhVTD1hRxiYebPBaxz2w0fG0NaOXSU4j7OhjEwuI1DC0kzFzpSVaTiJsYB-tf2CU_o Oct 26 13:05:39.264799 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:05:39.264799 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:05:39.264799 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:05:39.264799 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:05:39.264799 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:05:39.264799 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:05:39.264799 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 10521abb1c34417fa9369aaba9070968 Oct 26 13:05:39.264799 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1343304691 Oct 26 13:05:39.264799 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:05:39.264799 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:05:39.266174 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/10521abb1c34417fa9369aaba9070968"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/10521abb1c34417fa9369aaba9070968"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_10521abb1c34417fa9369aaba9070968"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/10521abb1c34417fa9369aaba9070968"}]}] Oct 26 13:05:39.266174 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1343304691 Oct 26 13:05:39.266174 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 10521abb1c34417fa9369aaba9070968 Oct 26 13:05:39.266174 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1343304691 Oct 26 13:05:39.266174 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1343304691-project Oct 26 13:05:39.266174 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:05:39.266174 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:05:39.266174 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 52f9391046054747bbfc1c3e6d65d4aa Oct 26 13:05:39.266174 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1343304691-project Oct 26 13:05:39.266174 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:05:39.266174 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 480f7c70-2963-4887-b8f8-ea3737880136 could not be found. Oct 26 13:05:39.266174 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '480f7c70-2963-4887-b8f8-ea3737880136'} Oct 26 13:05:39.266909 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:05:39.266909 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:05:39.266909 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:05:39.266909 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:05:39.266909 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:05:39.266909 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:05:39.266909 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:05:39.266909 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:05:39.266909 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:05:39.266909 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:05:39.266909 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 480f7c70-2963-4887-b8f8-ea3737880136 could not be found. Oct 26 13:05:39.266909 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:05:39.266909 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:05:39.266909 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:05:39.266909 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:05:39.266909 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:05:39.266909 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:05:39.266909 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:05:39.266909 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:05:39.266909 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:05:39.270968 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:05:39.270968 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:05:39.270968 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:05:39.270968 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:05:39.270968 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:05:39.270968 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:05:39.270968 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:05:39.270968 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 480f7c70-2963-4887-b8f8-ea3737880136 could not be found. Oct 26 13:05:39.270968 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:05:39.270968 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:05:39.270968 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:05:39.270968 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:05:39.270968 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:05:39.270968 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:05:39.270968 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:05:39.270968 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:05:39.270968 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 480f7c70-2963-4887-b8f8-ea3737880136 could not be found. Oct 26 13:05:39.270968 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:05:39.272220 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ec8704c0-0988-4469-896f-2a793b638a60 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Returning 404 to user: Instance 480f7c70-2963-4887-b8f8-ea3737880136 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:05:39.272220 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ec8704c0-0988-4469-896f-2a793b638a60 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] 10.222.0.40 "GET /compute/v2.1/servers/480f7c70-2963-4887-b8f8-ea3737880136" status: 404 len: 111 microversion: 2.1 time: 0.044994 Oct 26 13:05:39.272220 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 479/916] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:39 2022] GET /compute/v2.1/servers/480f7c70-2963-4887-b8f8-ea3737880136 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:05:39.283437 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8d29e3c3-8867-4e54-a358-04967266a8fc tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:39.283994 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8d29e3c3-8867-4e54-a358-04967266a8fc tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] [instance: 380d16a8-2b4c-460b-9b36-884e7fb24812] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:39.307645 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d29e3c3-8867-4e54-a358-04967266a8fc tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:39.308864 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d29e3c3-8867-4e54-a358-04967266a8fc tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:39.309604 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d29e3c3-8867-4e54-a358-04967266a8fc tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:39.310760 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d29e3c3-8867-4e54-a358-04967266a8fc tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:39.311217 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d29e3c3-8867-4e54-a358-04967266a8fc tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:39.312073 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d29e3c3-8867-4e54-a358-04967266a8fc tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:39.347388 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-8d29e3c3-8867-4e54-a358-04967266a8fc tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] HTTP exception thrown: Instance 380d16a8-2b4c-460b-9b36-884e7fb24812 could not be found. Oct 26 13:05:39.348999 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8d29e3c3-8867-4e54-a358-04967266a8fc tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Request method failure captured: Oct 26 13:05:39.348999 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/servers/380d16a8-2b4c-460b-9b36-884e7fb24812 HTTP/1.1 Oct 26 13:05:39.348999 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:05:39.348999 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:05:39.348999 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:05:39.348999 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:05:39.348999 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:05:39.348999 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:05:39.348999 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:05:39.348999 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:05:39.348999 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTAFWopok3H3xE_XQuz0fZlUqCw0H_HAFgDowGdxrWxuRERqWGPwU78ltYirOwoaHygIpHlxdR3atlRYeciVf16BD84DmwoejfnU_Q9b9yAfIkhVTD1hRxiYebPBaxz2w0fG0NaOXSU4j7OhjEwuI1DC0kzFzpSVaTiJsYB-tf2CU_o Oct 26 13:05:39.348999 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:05:39.348999 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:05:39.348999 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:05:39.348999 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:05:39.348999 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:05:39.348999 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:05:39.348999 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 10521abb1c34417fa9369aaba9070968 Oct 26 13:05:39.348999 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1343304691 Oct 26 13:05:39.348999 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:05:39.348999 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:05:39.351846 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/10521abb1c34417fa9369aaba9070968"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/10521abb1c34417fa9369aaba9070968"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_10521abb1c34417fa9369aaba9070968"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/10521abb1c34417fa9369aaba9070968"}]}] Oct 26 13:05:39.351846 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1343304691 Oct 26 13:05:39.351846 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 10521abb1c34417fa9369aaba9070968 Oct 26 13:05:39.351846 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1343304691 Oct 26 13:05:39.351846 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1343304691-project Oct 26 13:05:39.351846 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:05:39.351846 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:05:39.351846 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 52f9391046054747bbfc1c3e6d65d4aa Oct 26 13:05:39.351846 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1343304691-project Oct 26 13:05:39.351846 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:05:39.351846 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 380d16a8-2b4c-460b-9b36-884e7fb24812 could not be found. Oct 26 13:05:39.351846 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '380d16a8-2b4c-460b-9b36-884e7fb24812'} Oct 26 13:05:39.352871 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:05:39.352871 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:05:39.352871 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:05:39.352871 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:05:39.352871 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:05:39.352871 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:05:39.352871 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:05:39.352871 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:05:39.352871 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:05:39.352871 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:05:39.352871 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 380d16a8-2b4c-460b-9b36-884e7fb24812 could not be found. Oct 26 13:05:39.352871 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:05:39.352871 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:05:39.352871 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:05:39.352871 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:05:39.352871 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:05:39.352871 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:05:39.352871 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:05:39.352871 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:05:39.352871 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:05:39.354694 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:05:39.354694 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:05:39.354694 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:05:39.354694 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:05:39.354694 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:05:39.354694 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:05:39.354694 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:05:39.354694 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:05:39.354694 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:05:39.354694 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 380d16a8-2b4c-460b-9b36-884e7fb24812 could not be found. Oct 26 13:05:39.354694 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:05:39.354694 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:05:39.354694 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:05:39.354694 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:05:39.354694 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:05:39.354694 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:05:39.354694 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:05:39.354694 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:05:39.354694 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 380d16a8-2b4c-460b-9b36-884e7fb24812 could not be found. Oct 26 13:05:39.354694 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:05:39.356218 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8d29e3c3-8867-4e54-a358-04967266a8fc tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Returning 404 to user: Instance 380d16a8-2b4c-460b-9b36-884e7fb24812 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:05:39.356218 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8d29e3c3-8867-4e54-a358-04967266a8fc tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] 10.222.0.40 "DELETE /compute/v2.1/servers/380d16a8-2b4c-460b-9b36-884e7fb24812" status: 404 len: 111 microversion: 2.1 time: 0.079380 Oct 26 13:05:39.356218 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 438/917] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:05:39 2022] DELETE /compute/v2.1/servers/380d16a8-2b4c-460b-9b36-884e7fb24812 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:05:39.361398 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0271094b-6b0f-405d-a1a7-01fdcc089563 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:39.362039 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0271094b-6b0f-405d-a1a7-01fdcc089563 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] [instance: 380d16a8-2b4c-460b-9b36-884e7fb24812] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:39.364756 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c4ee8b86-bdf5-4ba6-949e-51d260aea140 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:39.366083 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c4ee8b86-bdf5-4ba6-949e-51d260aea140 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:39.369936 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0271094b-6b0f-405d-a1a7-01fdcc089563 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:39.370426 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0271094b-6b0f-405d-a1a7-01fdcc089563 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:39.373701 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0271094b-6b0f-405d-a1a7-01fdcc089563 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:39.374488 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4ee8b86-bdf5-4ba6-949e-51d260aea140 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:39.375177 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4ee8b86-bdf5-4ba6-949e-51d260aea140 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:39.376186 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4ee8b86-bdf5-4ba6-949e-51d260aea140 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:39.376644 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0271094b-6b0f-405d-a1a7-01fdcc089563 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:39.377124 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0271094b-6b0f-405d-a1a7-01fdcc089563 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:39.377728 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4ee8b86-bdf5-4ba6-949e-51d260aea140 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:39.378445 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4ee8b86-bdf5-4ba6-949e-51d260aea140 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:39.379769 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4ee8b86-bdf5-4ba6-949e-51d260aea140 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:39.380998 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0271094b-6b0f-405d-a1a7-01fdcc089563 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:39.424893 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-0271094b-6b0f-405d-a1a7-01fdcc089563 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] HTTP exception thrown: Instance 380d16a8-2b4c-460b-9b36-884e7fb24812 could not be found. Oct 26 13:05:39.427342 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0271094b-6b0f-405d-a1a7-01fdcc089563 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Request method failure captured: Oct 26 13:05:39.427342 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/380d16a8-2b4c-460b-9b36-884e7fb24812 HTTP/1.1 Oct 26 13:05:39.427342 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:05:39.427342 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:05:39.427342 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:05:39.427342 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:05:39.427342 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:05:39.427342 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:05:39.427342 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:05:39.427342 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:05:39.427342 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTAFWopok3H3xE_XQuz0fZlUqCw0H_HAFgDowGdxrWxuRERqWGPwU78ltYirOwoaHygIpHlxdR3atlRYeciVf16BD84DmwoejfnU_Q9b9yAfIkhVTD1hRxiYebPBaxz2w0fG0NaOXSU4j7OhjEwuI1DC0kzFzpSVaTiJsYB-tf2CU_o Oct 26 13:05:39.427342 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:05:39.427342 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:05:39.427342 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:05:39.427342 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:05:39.427342 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:05:39.427342 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:05:39.427342 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 10521abb1c34417fa9369aaba9070968 Oct 26 13:05:39.427342 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1343304691 Oct 26 13:05:39.427342 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:05:39.427342 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:05:39.428864 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/10521abb1c34417fa9369aaba9070968"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/10521abb1c34417fa9369aaba9070968"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_10521abb1c34417fa9369aaba9070968"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/10521abb1c34417fa9369aaba9070968"}]}] Oct 26 13:05:39.428864 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1343304691 Oct 26 13:05:39.428864 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 10521abb1c34417fa9369aaba9070968 Oct 26 13:05:39.428864 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1343304691 Oct 26 13:05:39.428864 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1343304691-project Oct 26 13:05:39.428864 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:05:39.428864 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:05:39.428864 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 52f9391046054747bbfc1c3e6d65d4aa Oct 26 13:05:39.428864 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1343304691-project Oct 26 13:05:39.428864 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:05:39.428864 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 380d16a8-2b4c-460b-9b36-884e7fb24812 could not be found. Oct 26 13:05:39.428864 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '380d16a8-2b4c-460b-9b36-884e7fb24812'} Oct 26 13:05:39.430318 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:05:39.430318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:05:39.430318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:05:39.430318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:05:39.430318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:05:39.430318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:05:39.430318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:05:39.430318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:05:39.430318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:05:39.430318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:05:39.430318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 380d16a8-2b4c-460b-9b36-884e7fb24812 could not be found. Oct 26 13:05:39.430318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:05:39.430318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:05:39.430318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:05:39.430318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:05:39.430318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:05:39.430318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:05:39.430318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:05:39.430318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:05:39.430318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:05:39.432028 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:05:39.432028 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:05:39.432028 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:05:39.432028 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:05:39.432028 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:05:39.432028 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:05:39.432028 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:05:39.432028 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 380d16a8-2b4c-460b-9b36-884e7fb24812 could not be found. Oct 26 13:05:39.432028 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:05:39.432028 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:05:39.432028 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:05:39.432028 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:05:39.432028 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:05:39.432028 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:05:39.432028 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:05:39.432028 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:05:39.432028 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 380d16a8-2b4c-460b-9b36-884e7fb24812 could not be found. Oct 26 13:05:39.432028 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:05:39.437812 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0271094b-6b0f-405d-a1a7-01fdcc089563 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] Returning 404 to user: Instance 380d16a8-2b4c-460b-9b36-884e7fb24812 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:05:39.440017 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0271094b-6b0f-405d-a1a7-01fdcc089563 tempest-ServersWithSpecificFlavorTestJSON-1343304691 tempest-ServersWithSpecificFlavorTestJSON-1343304691-project] 10.222.0.40 "GET /compute/v2.1/servers/380d16a8-2b4c-460b-9b36-884e7fb24812" status: 404 len: 111 microversion: 2.1 time: 0.082314 Oct 26 13:05:39.440976 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 480/918] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:39 2022] GET /compute/v2.1/servers/380d16a8-2b4c-460b-9b36-884e7fb24812 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:05:39.556299 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-687345bf-0fa0-4cd4-b617-264357a89387 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:39.557413 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-687345bf-0fa0-4cd4-b617-264357a89387 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] [instance: dffc2812-b18a-4227-932f-3db590d7bc6f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:39.568706 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-687345bf-0fa0-4cd4-b617-264357a89387 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:39.571860 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-687345bf-0fa0-4cd4-b617-264357a89387 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:39.572342 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-687345bf-0fa0-4cd4-b617-264357a89387 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:39.573078 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-687345bf-0fa0-4cd4-b617-264357a89387 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:39.573713 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-687345bf-0fa0-4cd4-b617-264357a89387 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:39.574319 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-687345bf-0fa0-4cd4-b617-264357a89387 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:39.596174 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-687345bf-0fa0-4cd4-b617-264357a89387 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] HTTP exception thrown: Instance dffc2812-b18a-4227-932f-3db590d7bc6f could not be found. Oct 26 13:05:39.598801 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-687345bf-0fa0-4cd4-b617-264357a89387 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Request method failure captured: Oct 26 13:05:39.598801 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f HTTP/1.1 Oct 26 13:05:39.598801 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:05:39.598801 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:05:39.598801 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:05:39.598801 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:05:39.598801 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:05:39.598801 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:05:39.598801 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:05:39.598801 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:05:39.598801 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTBKlCssWTS3uIuvlb3qZMdrcWLduqRK6y7lYGMWJKaDHyabA3HHbK1QJy8wrLendLe8dvg8CEJOPjdcSkeq6wxwfMyXdDGwE64sIJ83eNlGzDxyhs0m4j6793IdF74Jx8R93iNbASvgGAA564NMv82dimk84r03I-CCjsHCyFlT9wI Oct 26 13:05:39.598801 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:05:39.598801 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:05:39.598801 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:05:39.598801 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:05:39.598801 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:05:39.598801 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:05:39.598801 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: ec66df09b6114f5dbd6678d5e848c737 Oct 26 13:05:39.598801 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1445427066 Oct 26 13:05:39.598801 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:05:39.598801 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:05:39.600334 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ec66df09b6114f5dbd6678d5e848c737"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ec66df09b6114f5dbd6678d5e848c737"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ec66df09b6114f5dbd6678d5e848c737"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ec66df09b6114f5dbd6678d5e848c737"}]}] Oct 26 13:05:39.600334 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1445427066 Oct 26 13:05:39.600334 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: ec66df09b6114f5dbd6678d5e848c737 Oct 26 13:05:39.600334 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1445427066 Oct 26 13:05:39.600334 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-FloatingIPsAssociationTestJSON-1445427066-project Oct 26 13:05:39.600334 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:05:39.600334 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:05:39.600334 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 241a2299894849c889ee7f1100a9823d Oct 26 13:05:39.600334 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1445427066-project Oct 26 13:05:39.600334 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:05:39.600334 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance dffc2812-b18a-4227-932f-3db590d7bc6f could not be found. Oct 26 13:05:39.600334 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'dffc2812-b18a-4227-932f-3db590d7bc6f'} Oct 26 13:05:39.601169 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:05:39.601169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:05:39.601169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:05:39.601169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:05:39.601169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:05:39.601169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:05:39.601169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:05:39.601169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:05:39.601169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:05:39.601169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:05:39.601169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dffc2812-b18a-4227-932f-3db590d7bc6f could not be found. Oct 26 13:05:39.601169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:05:39.601169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:05:39.601169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:05:39.601169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:05:39.601169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:05:39.601169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:05:39.601169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:05:39.601169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:05:39.601169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:05:39.602428 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:05:39.602428 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:05:39.602428 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:05:39.602428 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:05:39.602428 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:05:39.602428 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:05:39.602428 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:05:39.602428 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dffc2812-b18a-4227-932f-3db590d7bc6f could not be found. Oct 26 13:05:39.602428 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:05:39.602428 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:05:39.602428 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:05:39.602428 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:05:39.602428 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:05:39.602428 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:05:39.602428 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:05:39.602428 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:05:39.602428 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dffc2812-b18a-4227-932f-3db590d7bc6f could not be found. Oct 26 13:05:39.602428 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:05:39.605134 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-687345bf-0fa0-4cd4-b617-264357a89387 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] Returning 404 to user: Instance dffc2812-b18a-4227-932f-3db590d7bc6f could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:05:39.606202 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-687345bf-0fa0-4cd4-b617-264357a89387 tempest-FloatingIPsAssociationTestJSON-1445427066 tempest-FloatingIPsAssociationTestJSON-1445427066-project] 10.222.0.40 "GET /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f" status: 404 len: 111 microversion: 2.1 time: 0.057725 Oct 26 13:05:39.607360 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 481/919] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:39 2022] GET /compute/v2.1/servers/dffc2812-b18a-4227-932f-3db590d7bc6f => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:05:39.787218 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3e47eedc-166a-4b71-ab55-dcdbe9c8ee1b tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1712588901", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:39.834482 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c4ee8b86-bdf5-4ba6-949e-51d260aea140 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:39.846025 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c4ee8b86-bdf5-4ba6-949e-51d260aea140 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 200 len: 1538 microversion: 2.1 time: 0.485739 Oct 26 13:05:39.847996 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 439/920] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:39 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 1538 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:05:39.863713 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-3e47eedc-166a-4b71-ab55-dcdbe9c8ee1b tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] validate_networks() for None {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:05:39.866381 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-83395d8d-6f2b-4757-90a3-69e57b7ecca2 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:39.867034 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-83395d8d-6f2b-4757-90a3-69e57b7ecca2 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] [instance: f7878a23-cf30-42db-a872-b9cfa0c0b2c1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:39.881584 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-83395d8d-6f2b-4757-90a3-69e57b7ecca2 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:39.882792 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-83395d8d-6f2b-4757-90a3-69e57b7ecca2 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:39.883392 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-83395d8d-6f2b-4757-90a3-69e57b7ecca2 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:39.884498 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-83395d8d-6f2b-4757-90a3-69e57b7ecca2 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:39.885310 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-83395d8d-6f2b-4757-90a3-69e57b7ecca2 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:39.886008 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-83395d8d-6f2b-4757-90a3-69e57b7ecca2 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:40.212542 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-3e47eedc-166a-4b71-ab55-dcdbe9c8ee1b tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:05:40.212971 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-3e47eedc-166a-4b71-ab55-dcdbe9c8ee1b tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:05:40.213645 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-3e47eedc-166a-4b71-ab55-dcdbe9c8ee1b tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:05:40.214064 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-3e47eedc-166a-4b71-ab55-dcdbe9c8ee1b tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:05:40.214879 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-3e47eedc-166a-4b71-ab55-dcdbe9c8ee1b tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:05:40.224064 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3e47eedc-166a-4b71-ab55-dcdbe9c8ee1b tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:40.224556 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3e47eedc-166a-4b71-ab55-dcdbe9c8ee1b tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:40.224998 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3e47eedc-166a-4b71-ab55-dcdbe9c8ee1b tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:40.226117 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3e47eedc-166a-4b71-ab55-dcdbe9c8ee1b tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:40.227117 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3e47eedc-166a-4b71-ab55-dcdbe9c8ee1b tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:40.227406 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3e47eedc-166a-4b71-ab55-dcdbe9c8ee1b tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:40.246648 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-3e47eedc-166a-4b71-ab55-dcdbe9c8ee1b tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Getting quotas for project 2f5434aa488d4d5a8bae96746cfd7494. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:05:40.250779 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-3e47eedc-166a-4b71-ab55-dcdbe9c8ee1b tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Getting quotas for user de8d47754d3f4d2c844dea032bdb0095 and project 2f5434aa488d4d5a8bae96746cfd7494. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:05:40.265418 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3e47eedc-166a-4b71-ab55-dcdbe9c8ee1b tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:05:40.267882 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3e47eedc-166a-4b71-ab55-dcdbe9c8ee1b tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:05:40.322954 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3e47eedc-166a-4b71-ab55-dcdbe9c8ee1b tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.707275 Oct 26 13:05:40.334586 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 482/921] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:05:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:05:40.345459 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-83395d8d-6f2b-4757-90a3-69e57b7ecca2 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde48023bc1a4ee0a0beb2a99030a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589842c86ede4d51a98b22b996918fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:40.353845 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-94b01c28-68e1-4676-a3bb-71249c6e4e19 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:40.354813 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-94b01c28-68e1-4676-a3bb-71249c6e4e19 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 7d754336-7bde-477f-954d-d0b4290ee0fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:40.359083 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-83395d8d-6f2b-4757-90a3-69e57b7ecca2 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] 10.222.0.40 "GET /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1" status: 200 len: 1315 microversion: 2.1 time: 0.510000 Oct 26 13:05:40.360021 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 440/922] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:39 2022] GET /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1 => generated 1315 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:40.361469 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-94b01c28-68e1-4676-a3bb-71249c6e4e19 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:40.361978 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-94b01c28-68e1-4676-a3bb-71249c6e4e19 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:40.362568 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-94b01c28-68e1-4676-a3bb-71249c6e4e19 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:40.363404 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-94b01c28-68e1-4676-a3bb-71249c6e4e19 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:40.363986 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-94b01c28-68e1-4676-a3bb-71249c6e4e19 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:40.364541 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-94b01c28-68e1-4676-a3bb-71249c6e4e19 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:40.374831 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-c7db02c1-0141-4c6c-9c7a-61a1d6017f78 req-19a1eeea-258d-4c1e-ae2c-ba06f034d848 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7878a23-cf30-42db-a872-b9cfa0c0b2c1", "tag": "59c21699-7f88-4feb-bc1a-f5627a7a31f7"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:40.395349 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-c7db02c1-0141-4c6c-9c7a-61a1d6017f78 req-19a1eeea-258d-4c1e-ae2c-ba06f034d848 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:40.396091 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-c7db02c1-0141-4c6c-9c7a-61a1d6017f78 req-19a1eeea-258d-4c1e-ae2c-ba06f034d848 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:40.396624 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-c7db02c1-0141-4c6c-9c7a-61a1d6017f78 req-19a1eeea-258d-4c1e-ae2c-ba06f034d848 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:40.418440 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-c7db02c1-0141-4c6c-9c7a-61a1d6017f78 req-19a1eeea-258d-4c1e-ae2c-ba06f034d848 service nova] Creating event network-changed:59c21699-7f88-4feb-bc1a-f5627a7a31f7 for instance f7878a23-cf30-42db-a872-b9cfa0c0b2c1 on n-h1-862686-1 Oct 26 13:05:40.424159 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-c7db02c1-0141-4c6c-9c7a-61a1d6017f78 req-19a1eeea-258d-4c1e-ae2c-ba06f034d848 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061472 Oct 26 13:05:40.425129 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 441/923] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:05:40.432436 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-050eef60-ae96-4fbd-b7b7-eb97a6d4e753 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:40.433473 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-050eef60-ae96-4fbd-b7b7-eb97a6d4e753 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:40.443149 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-050eef60-ae96-4fbd-b7b7-eb97a6d4e753 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:40.443966 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-050eef60-ae96-4fbd-b7b7-eb97a6d4e753 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:40.445431 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-050eef60-ae96-4fbd-b7b7-eb97a6d4e753 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:40.446576 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-050eef60-ae96-4fbd-b7b7-eb97a6d4e753 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:40.447251 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-050eef60-ae96-4fbd-b7b7-eb97a6d4e753 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:40.447889 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-050eef60-ae96-4fbd-b7b7-eb97a6d4e753 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:40.499340 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-94b01c28-68e1-4676-a3bb-71249c6e4e19 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:40.513094 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-94b01c28-68e1-4676-a3bb-71249c6e4e19 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/7d754336-7bde-477f-954d-d0b4290ee0fa" status: 200 len: 1274 microversion: 2.1 time: 0.173896 Oct 26 13:05:40.532011 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 483/924] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:40 2022] GET /compute/v2.1/servers/7d754336-7bde-477f-954d-d0b4290ee0fa => generated 1274 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:40.537205 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cdfeb909-ff75-4446-8f14-bedfcdc3bc2d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-365323466", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:40.569627 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-050eef60-ae96-4fbd-b7b7-eb97a6d4e753 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lazy-loading 'services' on Instance uuid ee752331-9c49-4c73-ac1e-2c38175ed9f3 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:05:40.598162 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-050eef60-ae96-4fbd-b7b7-eb97a6d4e753 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 200 len: 1933 microversion: 2.75 time: 0.171519 Oct 26 13:05:40.600054 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 442/925] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:05:40 2022] GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 1933 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:05:40.623761 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-cdfeb909-ff75-4446-8f14-bedfcdc3bc2d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] validate_networks() for None {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:05:40.873620 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b1c4f2e9-2652-4cc7-b522-da10d074227e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:40.874251 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b1c4f2e9-2652-4cc7-b522-da10d074227e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:40.890549 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b1c4f2e9-2652-4cc7-b522-da10d074227e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:40.891090 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b1c4f2e9-2652-4cc7-b522-da10d074227e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:40.892282 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b1c4f2e9-2652-4cc7-b522-da10d074227e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:40.893034 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b1c4f2e9-2652-4cc7-b522-da10d074227e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:40.893527 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b1c4f2e9-2652-4cc7-b522-da10d074227e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:40.893965 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b1c4f2e9-2652-4cc7-b522-da10d074227e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:41.611636 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-cdfeb909-ff75-4446-8f14-bedfcdc3bc2d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:05:41.613295 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-cdfeb909-ff75-4446-8f14-bedfcdc3bc2d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:05:41.614075 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-cdfeb909-ff75-4446-8f14-bedfcdc3bc2d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:05:41.615381 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-cdfeb909-ff75-4446-8f14-bedfcdc3bc2d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:05:41.617441 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-cdfeb909-ff75-4446-8f14-bedfcdc3bc2d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:05:41.644502 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cdfeb909-ff75-4446-8f14-bedfcdc3bc2d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:41.646066 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cdfeb909-ff75-4446-8f14-bedfcdc3bc2d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:41.646734 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cdfeb909-ff75-4446-8f14-bedfcdc3bc2d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:41.649147 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cdfeb909-ff75-4446-8f14-bedfcdc3bc2d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:41.649827 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cdfeb909-ff75-4446-8f14-bedfcdc3bc2d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:41.651474 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cdfeb909-ff75-4446-8f14-bedfcdc3bc2d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:41.676841 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-cdfeb909-ff75-4446-8f14-bedfcdc3bc2d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Getting quotas for project 2f5434aa488d4d5a8bae96746cfd7494. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:05:41.684385 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-cdfeb909-ff75-4446-8f14-bedfcdc3bc2d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Getting quotas for user de8d47754d3f4d2c844dea032bdb0095 and project 2f5434aa488d4d5a8bae96746cfd7494. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:05:41.724704 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=7,nova_api:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:05:41.730250 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cdfeb909-ff75-4446-8f14-bedfcdc3bc2d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:05:41.734552 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cdfeb909-ff75-4446-8f14-bedfcdc3bc2d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: be43f1c5-7509-4755-9db7-c41e7b83464f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:05:41.886549 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cdfeb909-ff75-4446-8f14-bedfcdc3bc2d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.353013 Oct 26 13:05:41.887475 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 484/926] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:05:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1355 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:05:41.897534 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bca8d893-7b1f-447a-bb8f-7db6e00be95d tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:41.905657 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bca8d893-7b1f-447a-bb8f-7db6e00be95d tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] [instance: f7878a23-cf30-42db-a872-b9cfa0c0b2c1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:41.916121 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bca8d893-7b1f-447a-bb8f-7db6e00be95d tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:41.916619 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bca8d893-7b1f-447a-bb8f-7db6e00be95d tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:41.917057 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bca8d893-7b1f-447a-bb8f-7db6e00be95d tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:41.917923 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bca8d893-7b1f-447a-bb8f-7db6e00be95d tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:41.918436 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bca8d893-7b1f-447a-bb8f-7db6e00be95d tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:41.918868 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bca8d893-7b1f-447a-bb8f-7db6e00be95d tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:42.167807 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bca8d893-7b1f-447a-bb8f-7db6e00be95d tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde48023bc1a4ee0a0beb2a99030a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589842c86ede4d51a98b22b996918fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:42.188762 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bca8d893-7b1f-447a-bb8f-7db6e00be95d tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] 10.222.0.40 "GET /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1" status: 200 len: 1315 microversion: 2.1 time: 0.288697 Oct 26 13:05:42.194718 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 485/927] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:41 2022] GET /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1 => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:42.207744 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f245cbf8-a158-427a-bb26-dcc86713becd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:42.209374 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f245cbf8-a158-427a-bb26-dcc86713becd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 7d754336-7bde-477f-954d-d0b4290ee0fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:42.227645 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f245cbf8-a158-427a-bb26-dcc86713becd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:42.228516 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f245cbf8-a158-427a-bb26-dcc86713becd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:42.228641 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f245cbf8-a158-427a-bb26-dcc86713becd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:42.229399 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f245cbf8-a158-427a-bb26-dcc86713becd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:42.229753 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f245cbf8-a158-427a-bb26-dcc86713becd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:42.230181 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f245cbf8-a158-427a-bb26-dcc86713becd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:42.259146 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b1c4f2e9-2652-4cc7-b522-da10d074227e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:42.276753 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b1c4f2e9-2652-4cc7-b522-da10d074227e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 200 len: 1538 microversion: 2.1 time: 1.409861 Oct 26 13:05:42.282385 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 443/928] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:40 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 1538 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:42.291544 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b908c5e9-f525-4775-b67d-05a41a75dec7 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:42.292893 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b908c5e9-f525-4775-b67d-05a41a75dec7 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:42.309616 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b908c5e9-f525-4775-b67d-05a41a75dec7 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:42.310215 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b908c5e9-f525-4775-b67d-05a41a75dec7 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:42.310724 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b908c5e9-f525-4775-b67d-05a41a75dec7 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:42.311690 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b908c5e9-f525-4775-b67d-05a41a75dec7 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:42.315542 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b908c5e9-f525-4775-b67d-05a41a75dec7 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:42.316197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b908c5e9-f525-4775-b67d-05a41a75dec7 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:42.756290 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f245cbf8-a158-427a-bb26-dcc86713becd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:42.774126 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f245cbf8-a158-427a-bb26-dcc86713becd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/7d754336-7bde-477f-954d-d0b4290ee0fa" status: 200 len: 1316 microversion: 2.1 time: 0.569190 Oct 26 13:05:42.776610 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 486/929] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:42 2022] GET /compute/v2.1/servers/7d754336-7bde-477f-954d-d0b4290ee0fa => generated 1316 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:42.787666 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b95e4e7a-e357-479f-a855-4a494052c41a tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:42.798769 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b95e4e7a-e357-479f-a855-4a494052c41a tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: be43f1c5-7509-4755-9db7-c41e7b83464f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:42.819707 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b95e4e7a-e357-479f-a855-4a494052c41a tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:42.821337 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b95e4e7a-e357-479f-a855-4a494052c41a tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:42.824793 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b95e4e7a-e357-479f-a855-4a494052c41a tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:42.825956 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b95e4e7a-e357-479f-a855-4a494052c41a tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:42.826650 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b95e4e7a-e357-479f-a855-4a494052c41a tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:42.827279 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b95e4e7a-e357-479f-a855-4a494052c41a tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:42.982483 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b95e4e7a-e357-479f-a855-4a494052c41a tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:42.991611 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b95e4e7a-e357-479f-a855-4a494052c41a tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/be43f1c5-7509-4755-9db7-c41e7b83464f" status: 200 len: 1217 microversion: 2.1 time: 0.213861 Oct 26 13:05:42.993906 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 487/930] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:42 2022] GET /compute/v2.1/servers/be43f1c5-7509-4755-9db7-c41e7b83464f => generated 1217 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:43.087034 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-b908c5e9-f525-4775-b67d-05a41a75dec7 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lazy-loading 'services' on Instance uuid ee752331-9c49-4c73-ac1e-2c38175ed9f3 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:05:43.123281 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b908c5e9-f525-4775-b67d-05a41a75dec7 tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 200 len: 1933 microversion: 2.75 time: 0.839444 Oct 26 13:05:43.123881 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 444/931] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:05:42 2022] GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 1933 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:05:43.213371 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-aa092dfe-6194-4b10-af0b-67334578d789 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:43.214018 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-aa092dfe-6194-4b10-af0b-67334578d789 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] [instance: f7878a23-cf30-42db-a872-b9cfa0c0b2c1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:43.221262 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa092dfe-6194-4b10-af0b-67334578d789 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:43.221784 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa092dfe-6194-4b10-af0b-67334578d789 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:43.222222 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa092dfe-6194-4b10-af0b-67334578d789 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:43.222916 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa092dfe-6194-4b10-af0b-67334578d789 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:43.223367 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa092dfe-6194-4b10-af0b-67334578d789 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:43.223789 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa092dfe-6194-4b10-af0b-67334578d789 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:43.306522 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-698aa3e7-2ffe-439f-aa7f-92fcfb001b6b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:43.307402 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-698aa3e7-2ffe-439f-aa7f-92fcfb001b6b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:43.329784 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-698aa3e7-2ffe-439f-aa7f-92fcfb001b6b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:43.330474 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-698aa3e7-2ffe-439f-aa7f-92fcfb001b6b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:43.331093 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-698aa3e7-2ffe-439f-aa7f-92fcfb001b6b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:43.332017 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-698aa3e7-2ffe-439f-aa7f-92fcfb001b6b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:43.332635 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-698aa3e7-2ffe-439f-aa7f-92fcfb001b6b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:43.333111 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-698aa3e7-2ffe-439f-aa7f-92fcfb001b6b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:43.559097 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-aa092dfe-6194-4b10-af0b-67334578d789 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde48023bc1a4ee0a0beb2a99030a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589842c86ede4d51a98b22b996918fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:43.573630 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-aa092dfe-6194-4b10-af0b-67334578d789 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] 10.222.0.40 "GET /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1" status: 200 len: 1315 microversion: 2.1 time: 0.364816 Oct 26 13:05:43.574214 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 488/932] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:43 2022] GET /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1 => generated 1315 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:43.798076 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9d2b67a5-2644-44e2-8fab-8be2603a1fd2 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:43.798804 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9d2b67a5-2644-44e2-8fab-8be2603a1fd2 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 7d754336-7bde-477f-954d-d0b4290ee0fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:43.807938 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d2b67a5-2644-44e2-8fab-8be2603a1fd2 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:43.808525 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d2b67a5-2644-44e2-8fab-8be2603a1fd2 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:43.808971 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d2b67a5-2644-44e2-8fab-8be2603a1fd2 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:43.809998 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d2b67a5-2644-44e2-8fab-8be2603a1fd2 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:43.810680 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d2b67a5-2644-44e2-8fab-8be2603a1fd2 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:43.811363 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d2b67a5-2644-44e2-8fab-8be2603a1fd2 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:43.920618 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-698aa3e7-2ffe-439f-aa7f-92fcfb001b6b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:43.930376 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-698aa3e7-2ffe-439f-aa7f-92fcfb001b6b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 200 len: 1538 microversion: 2.1 time: 0.629914 Oct 26 13:05:43.941919 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 445/933] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:43 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 1538 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:05:44.028569 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3cb051d6-450c-4538-9acb-ea05402a6453 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:44.029264 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3cb051d6-450c-4538-9acb-ea05402a6453 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: be43f1c5-7509-4755-9db7-c41e7b83464f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:44.036625 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3cb051d6-450c-4538-9acb-ea05402a6453 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:44.037354 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3cb051d6-450c-4538-9acb-ea05402a6453 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:44.038050 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3cb051d6-450c-4538-9acb-ea05402a6453 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:44.039290 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3cb051d6-450c-4538-9acb-ea05402a6453 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:44.040909 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3cb051d6-450c-4538-9acb-ea05402a6453 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:44.042361 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3cb051d6-450c-4538-9acb-ea05402a6453 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:44.223146 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9d2b67a5-2644-44e2-8fab-8be2603a1fd2 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:44.235569 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9d2b67a5-2644-44e2-8fab-8be2603a1fd2 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/7d754336-7bde-477f-954d-d0b4290ee0fa" status: 200 len: 1316 microversion: 2.1 time: 0.442514 Oct 26 13:05:44.237469 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 489/934] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:43 2022] GET /compute/v2.1/servers/7d754336-7bde-477f-954d-d0b4290ee0fa => generated 1316 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:44.243108 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-685ebda4-4845-42d9-b904-32634369fdea tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:44.244008 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-685ebda4-4845-42d9-b904-32634369fdea tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:44.254155 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-685ebda4-4845-42d9-b904-32634369fdea tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:44.254815 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-685ebda4-4845-42d9-b904-32634369fdea tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:44.255397 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-685ebda4-4845-42d9-b904-32634369fdea tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:44.256223 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-685ebda4-4845-42d9-b904-32634369fdea tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:44.256870 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-685ebda4-4845-42d9-b904-32634369fdea tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:44.258245 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-685ebda4-4845-42d9-b904-32634369fdea tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:44.412238 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3cb051d6-450c-4538-9acb-ea05402a6453 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:44.427133 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3cb051d6-450c-4538-9acb-ea05402a6453 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/be43f1c5-7509-4755-9db7-c41e7b83464f" status: 200 len: 1283 microversion: 2.1 time: 0.410493 Oct 26 13:05:44.428421 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 446/935] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:44 2022] GET /compute/v2.1/servers/be43f1c5-7509-4755-9db7-c41e7b83464f => generated 1283 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:44.598050 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9115b974-5368-41a0-888a-6fcacea8169a tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:44.601983 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9115b974-5368-41a0-888a-6fcacea8169a tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] [instance: f7878a23-cf30-42db-a872-b9cfa0c0b2c1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:44.605912 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-685ebda4-4845-42d9-b904-32634369fdea tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] Lazy-loading 'services' on Instance uuid ee752331-9c49-4c73-ac1e-2c38175ed9f3 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:05:44.624833 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:05:44.628251 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9115b974-5368-41a0-888a-6fcacea8169a tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:44.629768 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9115b974-5368-41a0-888a-6fcacea8169a tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:44.640276 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9115b974-5368-41a0-888a-6fcacea8169a tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:44.641049 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9115b974-5368-41a0-888a-6fcacea8169a tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:44.646869 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9115b974-5368-41a0-888a-6fcacea8169a tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:44.650217 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9115b974-5368-41a0-888a-6fcacea8169a tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:44.689336 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-685ebda4-4845-42d9-b904-32634369fdea tempest-ServersAdmin275Test-294945958 tempest-ServersAdmin275Test-294945958-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 200 len: 1918 microversion: 2.75 time: 0.450343 Oct 26 13:05:44.690247 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 490/936] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:05:44 2022] GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 1918 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:05:44.750323 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f22994c3-f849-4ce6-93aa-47f850767ace tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:44.751090 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f22994c3-f849-4ce6-93aa-47f850767ace tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:44.764256 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f22994c3-f849-4ce6-93aa-47f850767ace tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:44.765003 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f22994c3-f849-4ce6-93aa-47f850767ace tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:44.765436 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f22994c3-f849-4ce6-93aa-47f850767ace tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:44.766164 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f22994c3-f849-4ce6-93aa-47f850767ace tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:44.766615 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f22994c3-f849-4ce6-93aa-47f850767ace tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:44.767035 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f22994c3-f849-4ce6-93aa-47f850767ace tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:44.822134 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f22994c3-f849-4ce6-93aa-47f850767ace tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:05:45.014128 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f22994c3-f849-4ce6-93aa-47f850767ace tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 204 len: 0 microversion: 2.75 time: 0.267592 Oct 26 13:05:45.020664 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 491/937] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 26 13:05:44 2022] DELETE /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 13:05:45.031605 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1b60f8c6-5c2a-4bb9-81ae-6a862ef11811 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:45.032300 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1b60f8c6-5c2a-4bb9-81ae-6a862ef11811 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:45.049943 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b60f8c6-5c2a-4bb9-81ae-6a862ef11811 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:45.050442 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b60f8c6-5c2a-4bb9-81ae-6a862ef11811 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:45.050881 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b60f8c6-5c2a-4bb9-81ae-6a862ef11811 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:45.051585 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b60f8c6-5c2a-4bb9-81ae-6a862ef11811 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:45.056403 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b60f8c6-5c2a-4bb9-81ae-6a862ef11811 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:45.057065 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b60f8c6-5c2a-4bb9-81ae-6a862ef11811 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:45.515985 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1b60f8c6-5c2a-4bb9-81ae-6a862ef11811 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:45.532708 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1b60f8c6-5c2a-4bb9-81ae-6a862ef11811 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 200 len: 1543 microversion: 2.1 time: 0.513456 Oct 26 13:05:45.533303 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 492/938] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:45 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 1543 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:45.551469 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cdfd9ddd-f929-4a3d-bd0d-3ebe363e8ef8 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:45.552172 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cdfd9ddd-f929-4a3d-bd0d-3ebe363e8ef8 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:45.576795 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cdfd9ddd-f929-4a3d-bd0d-3ebe363e8ef8 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:45.580968 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cdfd9ddd-f929-4a3d-bd0d-3ebe363e8ef8 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:45.581533 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cdfd9ddd-f929-4a3d-bd0d-3ebe363e8ef8 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:45.587386 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cdfd9ddd-f929-4a3d-bd0d-3ebe363e8ef8 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:45.588694 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cdfd9ddd-f929-4a3d-bd0d-3ebe363e8ef8 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:45.589417 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cdfd9ddd-f929-4a3d-bd0d-3ebe363e8ef8 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:45.705395 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=4 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:05:45.803196 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-cdfd9ddd-f929-4a3d-bd0d-3ebe363e8ef8 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:45.823438 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-cdfd9ddd-f929-4a3d-bd0d-3ebe363e8ef8 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:45.826768 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-cdfd9ddd-f929-4a3d-bd0d-3ebe363e8ef8 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:45.840495 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cdfd9ddd-f929-4a3d-bd0d-3ebe363e8ef8 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] 10.222.0.40 "GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 200 len: 1443 microversion: 2.75 time: 0.303649 Oct 26 13:05:45.841804 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 493/939] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:05:45 2022] GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 1443 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:05:45.853372 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f6372869-b71e-4873-8d99-418626c75f52 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:45.868986 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f6372869-b71e-4873-8d99-418626c75f52 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 7d754336-7bde-477f-954d-d0b4290ee0fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:45.883507 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6372869-b71e-4873-8d99-418626c75f52 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:45.884839 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6372869-b71e-4873-8d99-418626c75f52 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:45.885547 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6372869-b71e-4873-8d99-418626c75f52 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:45.886768 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6372869-b71e-4873-8d99-418626c75f52 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:45.887680 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6372869-b71e-4873-8d99-418626c75f52 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:45.888543 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6372869-b71e-4873-8d99-418626c75f52 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:45.990152 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9115b974-5368-41a0-888a-6fcacea8169a tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde48023bc1a4ee0a0beb2a99030a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589842c86ede4d51a98b22b996918fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:46.003956 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9115b974-5368-41a0-888a-6fcacea8169a tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] 10.222.0.40 "GET /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1" status: 200 len: 1315 microversion: 2.1 time: 1.411300 Oct 26 13:05:46.005130 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 447/940] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:44 2022] GET /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1 => generated 1315 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:46.017427 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0de544d6-9c52-490b-b94c-ded06cf9ed67 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:46.018731 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0de544d6-9c52-490b-b94c-ded06cf9ed67 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: be43f1c5-7509-4755-9db7-c41e7b83464f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:46.031783 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=14 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:05:46.040460 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0de544d6-9c52-490b-b94c-ded06cf9ed67 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:46.041235 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0de544d6-9c52-490b-b94c-ded06cf9ed67 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:46.042112 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0de544d6-9c52-490b-b94c-ded06cf9ed67 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:46.043519 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0de544d6-9c52-490b-b94c-ded06cf9ed67 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:46.046650 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0de544d6-9c52-490b-b94c-ded06cf9ed67 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:46.047314 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0de544d6-9c52-490b-b94c-ded06cf9ed67 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:46.062840 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:05:46.350104 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f6372869-b71e-4873-8d99-418626c75f52 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:46.358379 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f6372869-b71e-4873-8d99-418626c75f52 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/7d754336-7bde-477f-954d-d0b4290ee0fa" status: 200 len: 1316 microversion: 2.1 time: 0.515271 Oct 26 13:05:46.358967 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 494/941] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:45 2022] GET /compute/v2.1/servers/7d754336-7bde-477f-954d-d0b4290ee0fa => generated 1316 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:46.467791 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-83512a40-e9b9-4680-b556-422ee262b7f1 req-e69f2f37-ac23-4326-b039-158238ef8698 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d754336-7bde-477f-954d-d0b4290ee0fa", "tag": "47e7f1c4-4783-47be-bd33-fea8170829f0"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:46.487851 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-83512a40-e9b9-4680-b556-422ee262b7f1 req-e69f2f37-ac23-4326-b039-158238ef8698 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:46.488395 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-83512a40-e9b9-4680-b556-422ee262b7f1 req-e69f2f37-ac23-4326-b039-158238ef8698 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:46.499300 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-83512a40-e9b9-4680-b556-422ee262b7f1 req-e69f2f37-ac23-4326-b039-158238ef8698 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:46.523761 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-83512a40-e9b9-4680-b556-422ee262b7f1 req-e69f2f37-ac23-4326-b039-158238ef8698 service nova] Creating event network-changed:47e7f1c4-4783-47be-bd33-fea8170829f0 for instance 7d754336-7bde-477f-954d-d0b4290ee0fa on n-h2-862686-1 Oct 26 13:05:46.543081 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-83512a40-e9b9-4680-b556-422ee262b7f1 req-e69f2f37-ac23-4326-b039-158238ef8698 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078816 Oct 26 13:05:46.544710 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 495/942] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:05:46.558257 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e17ec732-ed80-44b2-abb8-a36c3f1a118d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:46.559454 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e17ec732-ed80-44b2-abb8-a36c3f1a118d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:46.566397 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e17ec732-ed80-44b2-abb8-a36c3f1a118d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:46.567583 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e17ec732-ed80-44b2-abb8-a36c3f1a118d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:46.568248 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e17ec732-ed80-44b2-abb8-a36c3f1a118d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:46.569352 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e17ec732-ed80-44b2-abb8-a36c3f1a118d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:46.570937 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e17ec732-ed80-44b2-abb8-a36c3f1a118d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:46.571753 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e17ec732-ed80-44b2-abb8-a36c3f1a118d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:46.595781 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0de544d6-9c52-490b-b94c-ded06cf9ed67 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:46.607097 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0de544d6-9c52-490b-b94c-ded06cf9ed67 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/be43f1c5-7509-4755-9db7-c41e7b83464f" status: 200 len: 1313 microversion: 2.1 time: 0.600389 Oct 26 13:05:46.609802 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 448/943] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:46 2022] GET /compute/v2.1/servers/be43f1c5-7509-4755-9db7-c41e7b83464f => generated 1313 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:46.869665 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-18c29997-4d22-4c82-9cb9-162d0d1463c0 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:46.870346 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-18c29997-4d22-4c82-9cb9-162d0d1463c0 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:46.876686 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18c29997-4d22-4c82-9cb9-162d0d1463c0 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:46.877614 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18c29997-4d22-4c82-9cb9-162d0d1463c0 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:46.878315 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18c29997-4d22-4c82-9cb9-162d0d1463c0 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:46.879991 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18c29997-4d22-4c82-9cb9-162d0d1463c0 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:46.880529 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18c29997-4d22-4c82-9cb9-162d0d1463c0 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:46.881170 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18c29997-4d22-4c82-9cb9-162d0d1463c0 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:47.003487 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-18c29997-4d22-4c82-9cb9-162d0d1463c0 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:47.018946 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-18c29997-4d22-4c82-9cb9-162d0d1463c0 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:47.020661 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-18c29997-4d22-4c82-9cb9-162d0d1463c0 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:47.029771 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-18c29997-4d22-4c82-9cb9-162d0d1463c0 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] 10.222.0.40 "GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 200 len: 1443 microversion: 2.75 time: 0.163061 Oct 26 13:05:47.030866 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 449/944] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:05:46 2022] GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 1443 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:05:47.045388 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c271aeaa-a78f-47c4-a815-c958b082173e tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:47.046506 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c271aeaa-a78f-47c4-a815-c958b082173e tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] [instance: f7878a23-cf30-42db-a872-b9cfa0c0b2c1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:47.059317 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c271aeaa-a78f-47c4-a815-c958b082173e tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:47.059902 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c271aeaa-a78f-47c4-a815-c958b082173e tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:47.060633 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c271aeaa-a78f-47c4-a815-c958b082173e tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:47.061534 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c271aeaa-a78f-47c4-a815-c958b082173e tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:47.062143 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c271aeaa-a78f-47c4-a815-c958b082173e tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:47.062743 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c271aeaa-a78f-47c4-a815-c958b082173e tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:47.130502 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e17ec732-ed80-44b2-abb8-a36c3f1a118d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:47.143885 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e17ec732-ed80-44b2-abb8-a36c3f1a118d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 200 len: 1543 microversion: 2.1 time: 0.591095 Oct 26 13:05:47.145010 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 496/945] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:46 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 1543 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:05:47.387012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-19d92742-632c-4078-baca-0a78f9cbfeb8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:47.387872 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-19d92742-632c-4078-baca-0a78f9cbfeb8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 7d754336-7bde-477f-954d-d0b4290ee0fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:47.397019 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-19d92742-632c-4078-baca-0a78f9cbfeb8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:47.397973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-19d92742-632c-4078-baca-0a78f9cbfeb8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:47.398650 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-19d92742-632c-4078-baca-0a78f9cbfeb8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:47.400169 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-19d92742-632c-4078-baca-0a78f9cbfeb8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:47.401072 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-19d92742-632c-4078-baca-0a78f9cbfeb8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:47.401812 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-19d92742-632c-4078-baca-0a78f9cbfeb8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:47.536919 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c271aeaa-a78f-47c4-a815-c958b082173e tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde48023bc1a4ee0a0beb2a99030a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589842c86ede4d51a98b22b996918fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:47.556575 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c271aeaa-a78f-47c4-a815-c958b082173e tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] 10.222.0.40 "GET /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1" status: 200 len: 1315 microversion: 2.1 time: 0.522867 Oct 26 13:05:47.557983 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 450/946] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:47 2022] GET /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1 => generated 1315 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:47.636779 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-797832be-3508-4068-883f-e6b08eb00e4d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:47.637406 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-797832be-3508-4068-883f-e6b08eb00e4d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: be43f1c5-7509-4755-9db7-c41e7b83464f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:47.653544 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-797832be-3508-4068-883f-e6b08eb00e4d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:47.655399 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-797832be-3508-4068-883f-e6b08eb00e4d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:47.657902 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-797832be-3508-4068-883f-e6b08eb00e4d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:47.658663 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-797832be-3508-4068-883f-e6b08eb00e4d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:47.659134 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-797832be-3508-4068-883f-e6b08eb00e4d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:47.660138 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-797832be-3508-4068-883f-e6b08eb00e4d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:47.844503 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-19d92742-632c-4078-baca-0a78f9cbfeb8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:47.855188 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-19d92742-632c-4078-baca-0a78f9cbfeb8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/7d754336-7bde-477f-954d-d0b4290ee0fa" status: 200 len: 1316 microversion: 2.1 time: 0.474005 Oct 26 13:05:47.863923 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 497/947] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:47 2022] GET /compute/v2.1/servers/7d754336-7bde-477f-954d-d0b4290ee0fa => generated 1316 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:48.059845 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cfa0e925-7eaa-4101-9fd3-fa6609844fee tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:48.060477 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cfa0e925-7eaa-4101-9fd3-fa6609844fee tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:48.067043 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cfa0e925-7eaa-4101-9fd3-fa6609844fee tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:48.067816 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cfa0e925-7eaa-4101-9fd3-fa6609844fee tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:48.068484 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cfa0e925-7eaa-4101-9fd3-fa6609844fee tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:48.069443 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cfa0e925-7eaa-4101-9fd3-fa6609844fee tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:48.070176 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cfa0e925-7eaa-4101-9fd3-fa6609844fee tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:48.072367 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cfa0e925-7eaa-4101-9fd3-fa6609844fee tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:48.089126 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-797832be-3508-4068-883f-e6b08eb00e4d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:48.104289 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-797832be-3508-4068-883f-e6b08eb00e4d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/be43f1c5-7509-4755-9db7-c41e7b83464f" status: 200 len: 1313 microversion: 2.1 time: 0.472272 Oct 26 13:05:48.106132 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 451/948] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:47 2022] GET /compute/v2.1/servers/be43f1c5-7509-4755-9db7-c41e7b83464f => generated 1313 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:05:48.167660 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d1d90542-f37d-4c83-b5f3-ff7afe5ae93d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:48.168272 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d1d90542-f37d-4c83-b5f3-ff7afe5ae93d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:48.174992 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d1d90542-f37d-4c83-b5f3-ff7afe5ae93d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:48.175487 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d1d90542-f37d-4c83-b5f3-ff7afe5ae93d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:48.176115 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d1d90542-f37d-4c83-b5f3-ff7afe5ae93d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:48.176866 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d1d90542-f37d-4c83-b5f3-ff7afe5ae93d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:48.177514 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d1d90542-f37d-4c83-b5f3-ff7afe5ae93d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:48.178202 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d1d90542-f37d-4c83-b5f3-ff7afe5ae93d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:48.225302 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-cfa0e925-7eaa-4101-9fd3-fa6609844fee tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:48.233955 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-cfa0e925-7eaa-4101-9fd3-fa6609844fee tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:48.235665 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-cfa0e925-7eaa-4101-9fd3-fa6609844fee tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:48.241262 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cfa0e925-7eaa-4101-9fd3-fa6609844fee tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] 10.222.0.40 "GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 200 len: 1443 microversion: 2.75 time: 0.185389 Oct 26 13:05:48.245425 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 498/949] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:05:48 2022] GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 1443 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:05:48.581723 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f572b4c8-e660-4ca4-a85c-41be6eb7ece4 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:48.583072 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f572b4c8-e660-4ca4-a85c-41be6eb7ece4 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] [instance: f7878a23-cf30-42db-a872-b9cfa0c0b2c1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:48.592690 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f572b4c8-e660-4ca4-a85c-41be6eb7ece4 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:48.593188 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f572b4c8-e660-4ca4-a85c-41be6eb7ece4 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:48.596687 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f572b4c8-e660-4ca4-a85c-41be6eb7ece4 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:48.597820 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f572b4c8-e660-4ca4-a85c-41be6eb7ece4 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:48.598870 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f572b4c8-e660-4ca4-a85c-41be6eb7ece4 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:48.600365 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f572b4c8-e660-4ca4-a85c-41be6eb7ece4 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:48.875607 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d1d90542-f37d-4c83-b5f3-ff7afe5ae93d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:48.900039 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d1d90542-f37d-4c83-b5f3-ff7afe5ae93d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 200 len: 1543 microversion: 2.1 time: 0.734085 Oct 26 13:05:48.902371 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 452/950] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:48 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 1543 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:48.918059 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-787e44f8-6567-4bcf-9ec4-39c48a98681f req-9d46087a-bf0b-4384-a359-36aa8f385e5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be43f1c5-7509-4755-9db7-c41e7b83464f", "tag": "f433536e-b171-41cf-b186-2aea6a04c2eb"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:48.935953 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-787e44f8-6567-4bcf-9ec4-39c48a98681f req-9d46087a-bf0b-4384-a359-36aa8f385e5f service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:48.936757 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-787e44f8-6567-4bcf-9ec4-39c48a98681f req-9d46087a-bf0b-4384-a359-36aa8f385e5f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:48.937548 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-787e44f8-6567-4bcf-9ec4-39c48a98681f req-9d46087a-bf0b-4384-a359-36aa8f385e5f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:48.976374 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-787e44f8-6567-4bcf-9ec4-39c48a98681f req-9d46087a-bf0b-4384-a359-36aa8f385e5f service nova] Creating event network-changed:f433536e-b171-41cf-b186-2aea6a04c2eb for instance be43f1c5-7509-4755-9db7-c41e7b83464f on n-h1-862686-1 Oct 26 13:05:48.983260 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-787e44f8-6567-4bcf-9ec4-39c48a98681f req-9d46087a-bf0b-4384-a359-36aa8f385e5f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076185 Oct 26 13:05:48.984465 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 453/951] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:05:48.992353 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-40e3d130-bf46-4aab-9a70-fab75cd364e5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:48.993445 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-40e3d130-bf46-4aab-9a70-fab75cd364e5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 7d754336-7bde-477f-954d-d0b4290ee0fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:49.006126 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-40e3d130-bf46-4aab-9a70-fab75cd364e5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:49.006571 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-40e3d130-bf46-4aab-9a70-fab75cd364e5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:49.010044 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-40e3d130-bf46-4aab-9a70-fab75cd364e5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:49.010987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-40e3d130-bf46-4aab-9a70-fab75cd364e5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:49.013893 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-40e3d130-bf46-4aab-9a70-fab75cd364e5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:49.014357 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-40e3d130-bf46-4aab-9a70-fab75cd364e5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:49.104284 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f572b4c8-e660-4ca4-a85c-41be6eb7ece4 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde48023bc1a4ee0a0beb2a99030a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589842c86ede4d51a98b22b996918fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:49.116162 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f572b4c8-e660-4ca4-a85c-41be6eb7ece4 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] 10.222.0.40 "GET /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1" status: 200 len: 1315 microversion: 2.1 time: 0.539676 Oct 26 13:05:49.133250 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 499/952] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:48 2022] GET /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1 => generated 1315 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:05:49.140492 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bac728d7-27fd-4f88-be4f-7da908477d31 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:49.141110 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bac728d7-27fd-4f88-be4f-7da908477d31 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: be43f1c5-7509-4755-9db7-c41e7b83464f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:49.151856 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bac728d7-27fd-4f88-be4f-7da908477d31 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:49.153008 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bac728d7-27fd-4f88-be4f-7da908477d31 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:49.153666 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bac728d7-27fd-4f88-be4f-7da908477d31 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:49.155420 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bac728d7-27fd-4f88-be4f-7da908477d31 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:49.159494 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bac728d7-27fd-4f88-be4f-7da908477d31 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:49.160338 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bac728d7-27fd-4f88-be4f-7da908477d31 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:49.519024 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bac728d7-27fd-4f88-be4f-7da908477d31 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:49.541642 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bac728d7-27fd-4f88-be4f-7da908477d31 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/be43f1c5-7509-4755-9db7-c41e7b83464f" status: 200 len: 1313 microversion: 2.1 time: 0.406374 Oct 26 13:05:49.548590 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 500/953] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:49 2022] GET /compute/v2.1/servers/be43f1c5-7509-4755-9db7-c41e7b83464f => generated 1313 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:49.579529 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5a173408-a466-45d4-88ba-d4d5877d7b5c tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:49.581607 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5a173408-a466-45d4-88ba-d4d5877d7b5c tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:49.604805 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a173408-a466-45d4-88ba-d4d5877d7b5c tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:49.605589 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a173408-a466-45d4-88ba-d4d5877d7b5c tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:49.607105 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a173408-a466-45d4-88ba-d4d5877d7b5c tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:49.608064 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a173408-a466-45d4-88ba-d4d5877d7b5c tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:49.610111 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a173408-a466-45d4-88ba-d4d5877d7b5c tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:49.612490 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a173408-a466-45d4-88ba-d4d5877d7b5c tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:49.753975 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a173408-a466-45d4-88ba-d4d5877d7b5c tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:49.754727 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a173408-a466-45d4-88ba-d4d5877d7b5c tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:49.755610 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a173408-a466-45d4-88ba-d4d5877d7b5c tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:49.756287 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-5a173408-a466-45d4-88ba-d4d5877d7b5c tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lazy-loading 'fault' on Instance uuid ee752331-9c49-4c73-ac1e-2c38175ed9f3 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:05:49.826616 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-40e3d130-bf46-4aab-9a70-fab75cd364e5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:49.860131 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-40e3d130-bf46-4aab-9a70-fab75cd364e5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/7d754336-7bde-477f-954d-d0b4290ee0fa" status: 200 len: 1316 microversion: 2.1 time: 0.873815 Oct 26 13:05:49.861284 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 454/954] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:48 2022] GET /compute/v2.1/servers/7d754336-7bde-477f-954d-d0b4290ee0fa => generated 1316 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:49.926449 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cc10e7fc-ca06-4df1-8c40-4faf933bc369 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:49.927351 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cc10e7fc-ca06-4df1-8c40-4faf933bc369 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:49.949631 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5a173408-a466-45d4-88ba-d4d5877d7b5c tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:49.949926 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc10e7fc-ca06-4df1-8c40-4faf933bc369 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:49.950427 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc10e7fc-ca06-4df1-8c40-4faf933bc369 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:49.953793 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc10e7fc-ca06-4df1-8c40-4faf933bc369 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:49.954704 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc10e7fc-ca06-4df1-8c40-4faf933bc369 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:49.956759 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc10e7fc-ca06-4df1-8c40-4faf933bc369 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:49.957197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc10e7fc-ca06-4df1-8c40-4faf933bc369 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:49.963578 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5a173408-a466-45d4-88ba-d4d5877d7b5c tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:49.965533 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5a173408-a466-45d4-88ba-d4d5877d7b5c tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29fc067b89b248259a5db3d1038a0646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8588dfed474a68a5c2bb6b3b38eacb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:49.983042 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5a173408-a466-45d4-88ba-d4d5877d7b5c tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] 10.222.0.40 "GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 200 len: 1448 microversion: 2.75 time: 0.433085 Oct 26 13:05:49.984554 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 501/955] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:05:49 2022] GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 1448 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:05:50.143276 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2f3d41c5-4cba-4b92-b1bf-2b84d0cf1a22 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:50.143893 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2f3d41c5-4cba-4b92-b1bf-2b84d0cf1a22 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] [instance: f7878a23-cf30-42db-a872-b9cfa0c0b2c1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:50.156369 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f3d41c5-4cba-4b92-b1bf-2b84d0cf1a22 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:50.156853 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f3d41c5-4cba-4b92-b1bf-2b84d0cf1a22 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:50.157289 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f3d41c5-4cba-4b92-b1bf-2b84d0cf1a22 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:50.158116 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f3d41c5-4cba-4b92-b1bf-2b84d0cf1a22 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:50.158670 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f3d41c5-4cba-4b92-b1bf-2b84d0cf1a22 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:50.159096 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f3d41c5-4cba-4b92-b1bf-2b84d0cf1a22 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:50.587875 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2f3d41c5-4cba-4b92-b1bf-2b84d0cf1a22 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde48023bc1a4ee0a0beb2a99030a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589842c86ede4d51a98b22b996918fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:50.598450 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2f3d41c5-4cba-4b92-b1bf-2b84d0cf1a22 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] 10.222.0.40 "GET /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1" status: 200 len: 1315 microversion: 2.1 time: 0.461400 Oct 26 13:05:50.599863 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 502/956] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:50 2022] GET /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1 => generated 1315 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:50.616180 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-ea9fa212-03fc-40f2-9894-fab63a2f72f3 req-0ebaa300-e527-4281-99d9-e6363c3aa190 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "670021c1-045f-40b1-9358-c589d32e9904", "tag": "6e2ffd62-248d-44dd-83ca-8e87f79cc722"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:50.628137 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ea9fa212-03fc-40f2-9894-fab63a2f72f3 req-0ebaa300-e527-4281-99d9-e6363c3aa190 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:50.629207 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ea9fa212-03fc-40f2-9894-fab63a2f72f3 req-0ebaa300-e527-4281-99d9-e6363c3aa190 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:50.629940 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ea9fa212-03fc-40f2-9894-fab63a2f72f3 req-0ebaa300-e527-4281-99d9-e6363c3aa190 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:50.643857 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-ea9fa212-03fc-40f2-9894-fab63a2f72f3 req-0ebaa300-e527-4281-99d9-e6363c3aa190 service nova] Creating event network-changed:6e2ffd62-248d-44dd-83ca-8e87f79cc722 for instance 670021c1-045f-40b1-9358-c589d32e9904 on n-h2-862686-1 Oct 26 13:05:50.650133 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-ea9fa212-03fc-40f2-9894-fab63a2f72f3 req-0ebaa300-e527-4281-99d9-e6363c3aa190 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048881 Oct 26 13:05:50.651499 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 503/957] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:05:50.657319 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e07f5c86-f7fa-401b-8645-3adc6c58bc23 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:50.658305 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e07f5c86-f7fa-401b-8645-3adc6c58bc23 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: be43f1c5-7509-4755-9db7-c41e7b83464f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:50.669752 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cc10e7fc-ca06-4df1-8c40-4faf933bc369 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:50.669947 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e07f5c86-f7fa-401b-8645-3adc6c58bc23 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:50.670419 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e07f5c86-f7fa-401b-8645-3adc6c58bc23 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:50.670855 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e07f5c86-f7fa-401b-8645-3adc6c58bc23 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:50.671741 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e07f5c86-f7fa-401b-8645-3adc6c58bc23 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:50.672366 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e07f5c86-f7fa-401b-8645-3adc6c58bc23 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:50.672779 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e07f5c86-f7fa-401b-8645-3adc6c58bc23 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:50.683329 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cc10e7fc-ca06-4df1-8c40-4faf933bc369 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 200 len: 1543 microversion: 2.1 time: 0.759527 Oct 26 13:05:50.698480 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 455/958] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:49 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 1543 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:50.895965 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-22e36b0d-7aeb-42f5-a5ca-057e9fe9eb7d tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:50.899368 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-22e36b0d-7aeb-42f5-a5ca-057e9fe9eb7d tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 7d754336-7bde-477f-954d-d0b4290ee0fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:50.925709 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22e36b0d-7aeb-42f5-a5ca-057e9fe9eb7d tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:50.926585 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22e36b0d-7aeb-42f5-a5ca-057e9fe9eb7d tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:50.927201 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22e36b0d-7aeb-42f5-a5ca-057e9fe9eb7d tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:50.928113 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22e36b0d-7aeb-42f5-a5ca-057e9fe9eb7d tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:50.928760 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22e36b0d-7aeb-42f5-a5ca-057e9fe9eb7d tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:50.930231 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22e36b0d-7aeb-42f5-a5ca-057e9fe9eb7d tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:51.026382 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e07f5c86-f7fa-401b-8645-3adc6c58bc23 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:51.042119 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e07f5c86-f7fa-401b-8645-3adc6c58bc23 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/be43f1c5-7509-4755-9db7-c41e7b83464f" status: 200 len: 1313 microversion: 2.1 time: 0.388884 Oct 26 13:05:51.042963 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 504/959] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:50 2022] GET /compute/v2.1/servers/be43f1c5-7509-4755-9db7-c41e7b83464f => generated 1313 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:51.065141 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8f634ad8-6e4b-4ead-a29e-c68a77e5ae64 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:51.066076 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8f634ad8-6e4b-4ead-a29e-c68a77e5ae64 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] [instance: ee752331-9c49-4c73-ac1e-2c38175ed9f3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:51.073907 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f634ad8-6e4b-4ead-a29e-c68a77e5ae64 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:51.074643 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f634ad8-6e4b-4ead-a29e-c68a77e5ae64 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:51.075244 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f634ad8-6e4b-4ead-a29e-c68a77e5ae64 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:51.076353 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f634ad8-6e4b-4ead-a29e-c68a77e5ae64 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:51.076962 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f634ad8-6e4b-4ead-a29e-c68a77e5ae64 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:51.077575 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f634ad8-6e4b-4ead-a29e-c68a77e5ae64 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:51.111393 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-8f634ad8-6e4b-4ead-a29e-c68a77e5ae64 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] HTTP exception thrown: Instance ee752331-9c49-4c73-ac1e-2c38175ed9f3 could not be found. Oct 26 13:05:51.117310 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8f634ad8-6e4b-4ead-a29e-c68a77e5ae64 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Request method failure captured: Oct 26 13:05:51.117310 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 HTTP/1.1 Oct 26 13:05:51.117310 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:05:51.117310 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:05:51.117310 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:05:51.117310 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:05:51.117310 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:05:51.117310 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:05:51.117310 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:05:51.117310 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:05:51.117310 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTBY8IgFKDjuVFCwRA_cnhZCBsjVa3BoFv3b-7vi-jt30wDmiz0PTky4p5F4zvtKfzynChf2rM-RFFPEqqSB7c4d7_5D4lXTKMa55KKd35KWb4oNMG7Jz9ZF93TCRxXxZn7eHskZrOVCjjNBBBocToQhGNvThYvytJc-8NRI5Gw2Fd4 Oct 26 13:05:51.117310 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:05:51.117310 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:05:51.117310 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:05:51.117310 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:05:51.117310 n-d-862686-1 devstack@n-api.service[120598]: X-Openstack-Nova-Api-Version: 2.75 Oct 26 13:05:51.117310 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:05:51.117310 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:05:51.117310 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: bf8588dfed474a68a5c2bb6b3b38eacb Oct 26 13:05:51.117310 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersAdmin275Test-1656053805 Oct 26 13:05:51.117310 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:05:51.117310 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:05:51.119125 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bf8588dfed474a68a5c2bb6b3b38eacb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bf8588dfed474a68a5c2bb6b3b38eacb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bf8588dfed474a68a5c2bb6b3b38eacb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bf8588dfed474a68a5c2bb6b3b38eacb"}]}] Oct 26 13:05:51.119125 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersAdmin275Test-1656053805 Oct 26 13:05:51.119125 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: bf8588dfed474a68a5c2bb6b3b38eacb Oct 26 13:05:51.119125 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersAdmin275Test-1656053805 Oct 26 13:05:51.119125 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersAdmin275Test-1656053805-project Oct 26 13:05:51.119125 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:05:51.119125 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:05:51.119125 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 29fc067b89b248259a5db3d1038a0646 Oct 26 13:05:51.119125 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersAdmin275Test-1656053805-project Oct 26 13:05:51.119125 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:05:51.119125 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance ee752331-9c49-4c73-ac1e-2c38175ed9f3 could not be found. Oct 26 13:05:51.119125 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'ee752331-9c49-4c73-ac1e-2c38175ed9f3'} Oct 26 13:05:51.119924 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:05:51.119924 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:05:51.119924 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:05:51.119924 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:05:51.119924 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:05:51.119924 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:05:51.119924 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:05:51.119924 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:05:51.119924 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:05:51.119924 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:05:51.119924 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee752331-9c49-4c73-ac1e-2c38175ed9f3 could not be found. Oct 26 13:05:51.119924 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:05:51.119924 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:05:51.119924 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:05:51.119924 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:05:51.119924 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:05:51.119924 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:05:51.119924 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:05:51.119924 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:05:51.119924 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:05:51.121193 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:05:51.121193 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:05:51.121193 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:05:51.121193 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:05:51.121193 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:05:51.121193 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:05:51.121193 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:05:51.121193 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee752331-9c49-4c73-ac1e-2c38175ed9f3 could not be found. Oct 26 13:05:51.121193 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:05:51.121193 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:05:51.121193 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:05:51.121193 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:05:51.121193 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:05:51.121193 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:05:51.121193 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:05:51.121193 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:05:51.121193 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee752331-9c49-4c73-ac1e-2c38175ed9f3 could not be found. Oct 26 13:05:51.121193 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:05:51.127268 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8f634ad8-6e4b-4ead-a29e-c68a77e5ae64 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] Returning 404 to user: Instance ee752331-9c49-4c73-ac1e-2c38175ed9f3 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:05:51.128935 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8f634ad8-6e4b-4ead-a29e-c68a77e5ae64 tempest-ServersAdmin275Test-1656053805 tempest-ServersAdmin275Test-1656053805-project] 10.222.0.40 "GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3" status: 404 len: 111 microversion: 2.75 time: 0.069022 Oct 26 13:05:51.142085 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 505/960] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:05:51 2022] GET /compute/v2.1/servers/ee752331-9c49-4c73-ac1e-2c38175ed9f3 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:05:51.213193 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-22e36b0d-7aeb-42f5-a5ca-057e9fe9eb7d tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:51.231682 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-22e36b0d-7aeb-42f5-a5ca-057e9fe9eb7d tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/7d754336-7bde-477f-954d-d0b4290ee0fa" status: 200 len: 1316 microversion: 2.1 time: 0.347699 Oct 26 13:05:51.234651 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 456/961] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:50 2022] GET /compute/v2.1/servers/7d754336-7bde-477f-954d-d0b4290ee0fa => generated 1316 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:51.624114 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-48e9c557-93e7-438f-b2d6-0c10364cdb41 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:51.624790 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-48e9c557-93e7-438f-b2d6-0c10364cdb41 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] [instance: f7878a23-cf30-42db-a872-b9cfa0c0b2c1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:51.643330 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48e9c557-93e7-438f-b2d6-0c10364cdb41 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:51.643828 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48e9c557-93e7-438f-b2d6-0c10364cdb41 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:51.644274 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48e9c557-93e7-438f-b2d6-0c10364cdb41 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:51.644987 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48e9c557-93e7-438f-b2d6-0c10364cdb41 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:51.645447 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48e9c557-93e7-438f-b2d6-0c10364cdb41 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:51.645895 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48e9c557-93e7-438f-b2d6-0c10364cdb41 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:51.672718 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:05:51.714104 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=16 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:05:51.716807 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1a04333d-ec95-49c3-ba4f-25333259b1cb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:51.717849 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1a04333d-ec95-49c3-ba4f-25333259b1cb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:51.729872 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a04333d-ec95-49c3-ba4f-25333259b1cb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:51.730587 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a04333d-ec95-49c3-ba4f-25333259b1cb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:51.731700 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a04333d-ec95-49c3-ba4f-25333259b1cb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:51.734474 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a04333d-ec95-49c3-ba4f-25333259b1cb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:51.734959 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a04333d-ec95-49c3-ba4f-25333259b1cb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:51.735463 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a04333d-ec95-49c3-ba4f-25333259b1cb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:52.081107 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1a04333d-ec95-49c3-ba4f-25333259b1cb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:52.098358 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1a04333d-ec95-49c3-ba4f-25333259b1cb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 200 len: 1543 microversion: 2.1 time: 0.391433 Oct 26 13:05:52.100081 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 457/962] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:51 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 1543 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:52.112360 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-1b10e176-1109-44a5-967e-e846a639a71e req-6a4bc215-6019-4af1-a00a-4062989e535a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7878a23-cf30-42db-a872-b9cfa0c0b2c1", "name": "network-vif-plugged", "status": "completed", "tag": "59c21699-7f88-4feb-bc1a-f5627a7a31f7"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:52.126604 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-1b10e176-1109-44a5-967e-e846a639a71e req-6a4bc215-6019-4af1-a00a-4062989e535a service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:52.128102 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-1b10e176-1109-44a5-967e-e846a639a71e req-6a4bc215-6019-4af1-a00a-4062989e535a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:52.129690 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-1b10e176-1109-44a5-967e-e846a639a71e req-6a4bc215-6019-4af1-a00a-4062989e535a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:52.149964 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-1b10e176-1109-44a5-967e-e846a639a71e req-6a4bc215-6019-4af1-a00a-4062989e535a service nova] Creating event network-vif-plugged:59c21699-7f88-4feb-bc1a-f5627a7a31f7 for instance f7878a23-cf30-42db-a872-b9cfa0c0b2c1 on n-h1-862686-1 Oct 26 13:05:52.156839 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-1b10e176-1109-44a5-967e-e846a639a71e req-6a4bc215-6019-4af1-a00a-4062989e535a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055311 Oct 26 13:05:52.157991 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 458/963] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:05:52.163873 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-96ab0e81-896f-4cc4-b872-359ea585d91b tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:52.165637 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-96ab0e81-896f-4cc4-b872-359ea585d91b tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: be43f1c5-7509-4755-9db7-c41e7b83464f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:52.173988 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96ab0e81-896f-4cc4-b872-359ea585d91b tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:52.174937 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96ab0e81-896f-4cc4-b872-359ea585d91b tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:52.175999 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96ab0e81-896f-4cc4-b872-359ea585d91b tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:52.178909 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96ab0e81-896f-4cc4-b872-359ea585d91b tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:52.180089 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96ab0e81-896f-4cc4-b872-359ea585d91b tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:52.180710 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96ab0e81-896f-4cc4-b872-359ea585d91b tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:52.194688 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-48e9c557-93e7-438f-b2d6-0c10364cdb41 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde48023bc1a4ee0a0beb2a99030a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589842c86ede4d51a98b22b996918fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:52.230590 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-48e9c557-93e7-438f-b2d6-0c10364cdb41 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] 10.222.0.40 "GET /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1" status: 200 len: 1315 microversion: 2.1 time: 0.609624 Oct 26 13:05:52.242641 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 506/964] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:51 2022] GET /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1 => generated 1315 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:52.260220 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d90eee2d-d9d6-4d66-80df-c5a0bc071ee8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:52.260865 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d90eee2d-d9d6-4d66-80df-c5a0bc071ee8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 7d754336-7bde-477f-954d-d0b4290ee0fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:52.270226 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d90eee2d-d9d6-4d66-80df-c5a0bc071ee8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:52.270718 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d90eee2d-d9d6-4d66-80df-c5a0bc071ee8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:52.271249 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d90eee2d-d9d6-4d66-80df-c5a0bc071ee8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:52.271837 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d90eee2d-d9d6-4d66-80df-c5a0bc071ee8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:52.272292 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d90eee2d-d9d6-4d66-80df-c5a0bc071ee8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:52.273518 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d90eee2d-d9d6-4d66-80df-c5a0bc071ee8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:52.343129 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:05:52.580695 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-96ab0e81-896f-4cc4-b872-359ea585d91b tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:52.593597 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-96ab0e81-896f-4cc4-b872-359ea585d91b tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/be43f1c5-7509-4755-9db7-c41e7b83464f" status: 200 len: 1313 microversion: 2.1 time: 0.433888 Oct 26 13:05:52.598443 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 459/965] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:52 2022] GET /compute/v2.1/servers/be43f1c5-7509-4755-9db7-c41e7b83464f => generated 1313 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:52.690487 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d90eee2d-d9d6-4d66-80df-c5a0bc071ee8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:52.702754 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d90eee2d-d9d6-4d66-80df-c5a0bc071ee8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/7d754336-7bde-477f-954d-d0b4290ee0fa" status: 200 len: 1316 microversion: 2.1 time: 0.447887 Oct 26 13:05:52.704130 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 507/966] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:52 2022] GET /compute/v2.1/servers/7d754336-7bde-477f-954d-d0b4290ee0fa => generated 1316 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:05:53.124420 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-858ba697-e527-49ed-8e3a-0b8cd81e979d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:53.125590 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-858ba697-e527-49ed-8e3a-0b8cd81e979d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:53.134889 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-858ba697-e527-49ed-8e3a-0b8cd81e979d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:53.135739 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-858ba697-e527-49ed-8e3a-0b8cd81e979d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:53.136664 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-858ba697-e527-49ed-8e3a-0b8cd81e979d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:53.137888 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-858ba697-e527-49ed-8e3a-0b8cd81e979d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:53.141509 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-858ba697-e527-49ed-8e3a-0b8cd81e979d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:53.142450 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-858ba697-e527-49ed-8e3a-0b8cd81e979d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:53.263167 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d0d0a3d7-4d8e-41e7-b497-443c6ee1726e tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:53.264165 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d0d0a3d7-4d8e-41e7-b497-443c6ee1726e tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] [instance: f7878a23-cf30-42db-a872-b9cfa0c0b2c1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:53.274566 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0d0a3d7-4d8e-41e7-b497-443c6ee1726e tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:53.276161 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0d0a3d7-4d8e-41e7-b497-443c6ee1726e tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:53.277003 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0d0a3d7-4d8e-41e7-b497-443c6ee1726e tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:53.278450 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0d0a3d7-4d8e-41e7-b497-443c6ee1726e tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:53.279113 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0d0a3d7-4d8e-41e7-b497-443c6ee1726e tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:53.279802 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0d0a3d7-4d8e-41e7-b497-443c6ee1726e tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:53.585332 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d0d0a3d7-4d8e-41e7-b497-443c6ee1726e tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde48023bc1a4ee0a0beb2a99030a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589842c86ede4d51a98b22b996918fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:53.634017 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d0d0a3d7-4d8e-41e7-b497-443c6ee1726e tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] 10.222.0.40 "GET /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1" status: 200 len: 1315 microversion: 2.1 time: 0.369222 Oct 26 13:05:53.636718 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 508/967] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:53 2022] GET /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1 => generated 1315 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:53.675491 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9b77b5c4-9e17-43dd-914d-67a54281f866 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:53.678772 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9b77b5c4-9e17-43dd-914d-67a54281f866 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: be43f1c5-7509-4755-9db7-c41e7b83464f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:53.704954 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b77b5c4-9e17-43dd-914d-67a54281f866 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:53.707675 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b77b5c4-9e17-43dd-914d-67a54281f866 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:53.710095 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b77b5c4-9e17-43dd-914d-67a54281f866 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:53.715200 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b77b5c4-9e17-43dd-914d-67a54281f866 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:53.715711 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b77b5c4-9e17-43dd-914d-67a54281f866 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:53.717836 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b77b5c4-9e17-43dd-914d-67a54281f866 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:54.014173 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9b77b5c4-9e17-43dd-914d-67a54281f866 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:54.023569 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9b77b5c4-9e17-43dd-914d-67a54281f866 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/be43f1c5-7509-4755-9db7-c41e7b83464f" status: 200 len: 1313 microversion: 2.1 time: 0.379773 Oct 26 13:05:54.024156 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 509/968] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:53 2022] GET /compute/v2.1/servers/be43f1c5-7509-4755-9db7-c41e7b83464f => generated 1313 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:54.059494 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-44d8cde2-ebd9-4861-8dce-ba5ae5c0e323 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:54.061582 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-44d8cde2-ebd9-4861-8dce-ba5ae5c0e323 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 7d754336-7bde-477f-954d-d0b4290ee0fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:54.071344 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-44d8cde2-ebd9-4861-8dce-ba5ae5c0e323 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:54.071951 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-44d8cde2-ebd9-4861-8dce-ba5ae5c0e323 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:54.072479 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-44d8cde2-ebd9-4861-8dce-ba5ae5c0e323 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:54.073393 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-44d8cde2-ebd9-4861-8dce-ba5ae5c0e323 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:54.074309 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-44d8cde2-ebd9-4861-8dce-ba5ae5c0e323 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:54.074873 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-44d8cde2-ebd9-4861-8dce-ba5ae5c0e323 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:54.125320 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-858ba697-e527-49ed-8e3a-0b8cd81e979d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:54.143405 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-858ba697-e527-49ed-8e3a-0b8cd81e979d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 200 len: 1543 microversion: 2.1 time: 1.022373 Oct 26 13:05:54.144361 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 460/969] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:53 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 1543 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:54.184606 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-1a8cb657-7dcd-48b0-a509-3c6e9744e159 req-a42d2e73-a52b-4878-930d-00fd729a4034 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d754336-7bde-477f-954d-d0b4290ee0fa", "name": "network-vif-plugged", "status": "completed", "tag": "47e7f1c4-4783-47be-bd33-fea8170829f0"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:54.209467 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-1a8cb657-7dcd-48b0-a509-3c6e9744e159 req-a42d2e73-a52b-4878-930d-00fd729a4034 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:54.211137 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-1a8cb657-7dcd-48b0-a509-3c6e9744e159 req-a42d2e73-a52b-4878-930d-00fd729a4034 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:54.212680 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-1a8cb657-7dcd-48b0-a509-3c6e9744e159 req-a42d2e73-a52b-4878-930d-00fd729a4034 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:54.238519 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-1a8cb657-7dcd-48b0-a509-3c6e9744e159 req-a42d2e73-a52b-4878-930d-00fd729a4034 service nova] Creating event network-vif-plugged:47e7f1c4-4783-47be-bd33-fea8170829f0 for instance 7d754336-7bde-477f-954d-d0b4290ee0fa on n-h2-862686-1 Oct 26 13:05:54.244739 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-1a8cb657-7dcd-48b0-a509-3c6e9744e159 req-a42d2e73-a52b-4878-930d-00fd729a4034 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063496 Oct 26 13:05:54.246469 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 461/970] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:05:54.315783 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-44d8cde2-ebd9-4861-8dce-ba5ae5c0e323 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:54.329840 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-44d8cde2-ebd9-4861-8dce-ba5ae5c0e323 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/7d754336-7bde-477f-954d-d0b4290ee0fa" status: 200 len: 1316 microversion: 2.1 time: 0.281885 Oct 26 13:05:54.330957 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 510/971] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:54 2022] GET /compute/v2.1/servers/7d754336-7bde-477f-954d-d0b4290ee0fa => generated 1316 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:54.664037 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-777956ac-1081-4b60-969d-e219efe64e68 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:54.665182 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-777956ac-1081-4b60-969d-e219efe64e68 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] [instance: f7878a23-cf30-42db-a872-b9cfa0c0b2c1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:54.673345 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-777956ac-1081-4b60-969d-e219efe64e68 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:54.674044 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-777956ac-1081-4b60-969d-e219efe64e68 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:54.674635 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-777956ac-1081-4b60-969d-e219efe64e68 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:54.675348 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-777956ac-1081-4b60-969d-e219efe64e68 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:54.676062 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-777956ac-1081-4b60-969d-e219efe64e68 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:54.676641 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-777956ac-1081-4b60-969d-e219efe64e68 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:54.890261 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-777956ac-1081-4b60-969d-e219efe64e68 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde48023bc1a4ee0a0beb2a99030a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589842c86ede4d51a98b22b996918fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:54.899042 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-777956ac-1081-4b60-969d-e219efe64e68 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] 10.222.0.40 "GET /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1" status: 200 len: 1503 microversion: 2.1 time: 0.239511 Oct 26 13:05:54.899694 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 462/972] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:54 2022] GET /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1 => generated 1503 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:54.923407 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-82470893-1998-4d3d-9d0c-9a47bb86d77c tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:54.923912 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-82470893-1998-4d3d-9d0c-9a47bb86d77c tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] [instance: f7878a23-cf30-42db-a872-b9cfa0c0b2c1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:54.932628 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-82470893-1998-4d3d-9d0c-9a47bb86d77c tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:54.933118 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-82470893-1998-4d3d-9d0c-9a47bb86d77c tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:54.933721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-82470893-1998-4d3d-9d0c-9a47bb86d77c tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:54.934546 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-82470893-1998-4d3d-9d0c-9a47bb86d77c tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:54.935176 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-82470893-1998-4d3d-9d0c-9a47bb86d77c tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:54.935881 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-82470893-1998-4d3d-9d0c-9a47bb86d77c tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:54.964127 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-82470893-1998-4d3d-9d0c-9a47bb86d77c tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] [instance: f7878a23-cf30-42db-a872-b9cfa0c0b2c1] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:05:55.047873 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cc72135c-940e-4cd9-8977-e25a61bd3051 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:55.048686 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cc72135c-940e-4cd9-8977-e25a61bd3051 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: be43f1c5-7509-4755-9db7-c41e7b83464f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:55.069519 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc72135c-940e-4cd9-8977-e25a61bd3051 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:55.070885 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc72135c-940e-4cd9-8977-e25a61bd3051 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:55.071339 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc72135c-940e-4cd9-8977-e25a61bd3051 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:55.072569 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc72135c-940e-4cd9-8977-e25a61bd3051 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:55.074051 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc72135c-940e-4cd9-8977-e25a61bd3051 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:55.074496 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc72135c-940e-4cd9-8977-e25a61bd3051 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:55.099569 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-82470893-1998-4d3d-9d0c-9a47bb86d77c tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1" status: 204 len: 0 microversion: 2.1 time: 0.178482 Oct 26 13:05:55.101452 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 511/973] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:05:54 2022] DELETE /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:05:55.114647 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-30b11f81-6952-4de3-9eff-56124fbdbf96 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:55.115352 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-30b11f81-6952-4de3-9eff-56124fbdbf96 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] [instance: f7878a23-cf30-42db-a872-b9cfa0c0b2c1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:55.133815 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30b11f81-6952-4de3-9eff-56124fbdbf96 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:55.137811 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30b11f81-6952-4de3-9eff-56124fbdbf96 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:55.139236 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30b11f81-6952-4de3-9eff-56124fbdbf96 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:55.141937 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30b11f81-6952-4de3-9eff-56124fbdbf96 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:55.143753 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30b11f81-6952-4de3-9eff-56124fbdbf96 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:55.144749 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30b11f81-6952-4de3-9eff-56124fbdbf96 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:55.277963 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cc72135c-940e-4cd9-8977-e25a61bd3051 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:55.290890 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cc72135c-940e-4cd9-8977-e25a61bd3051 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/be43f1c5-7509-4755-9db7-c41e7b83464f" status: 200 len: 1313 microversion: 2.1 time: 0.246413 Oct 26 13:05:55.294476 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 463/974] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:55 2022] GET /compute/v2.1/servers/be43f1c5-7509-4755-9db7-c41e7b83464f => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:55.303465 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-72ca15ba-4f25-4742-92b8-99862da1ef2d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:55.304748 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-72ca15ba-4f25-4742-92b8-99862da1ef2d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:55.326538 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-72ca15ba-4f25-4742-92b8-99862da1ef2d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:55.328614 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-72ca15ba-4f25-4742-92b8-99862da1ef2d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:55.330235 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-72ca15ba-4f25-4742-92b8-99862da1ef2d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:55.331915 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-72ca15ba-4f25-4742-92b8-99862da1ef2d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:55.335013 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-72ca15ba-4f25-4742-92b8-99862da1ef2d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:55.336619 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-72ca15ba-4f25-4742-92b8-99862da1ef2d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:55.477508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-30b11f81-6952-4de3-9eff-56124fbdbf96 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde48023bc1a4ee0a0beb2a99030a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589842c86ede4d51a98b22b996918fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:55.489079 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-30b11f81-6952-4de3-9eff-56124fbdbf96 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] 10.222.0.40 "GET /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1" status: 200 len: 1509 microversion: 2.1 time: 0.382051 Oct 26 13:05:55.501909 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 512/975] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:55 2022] GET /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1 => generated 1509 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:55.509317 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-aceb0477-cbb9-48b1-9856-b5438622c050 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:55.515942 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-aceb0477-cbb9-48b1-9856-b5438622c050 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 7d754336-7bde-477f-954d-d0b4290ee0fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:55.525575 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aceb0477-cbb9-48b1-9856-b5438622c050 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:55.527949 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aceb0477-cbb9-48b1-9856-b5438622c050 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:55.528869 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aceb0477-cbb9-48b1-9856-b5438622c050 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:55.529764 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aceb0477-cbb9-48b1-9856-b5438622c050 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:55.530548 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aceb0477-cbb9-48b1-9856-b5438622c050 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:55.531145 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aceb0477-cbb9-48b1-9856-b5438622c050 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:55.594129 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-72ca15ba-4f25-4742-92b8-99862da1ef2d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:55.606201 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-72ca15ba-4f25-4742-92b8-99862da1ef2d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 200 len: 1543 microversion: 2.1 time: 0.310433 Oct 26 13:05:55.608826 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 464/976] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:55 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 1543 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:55.767615 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-aceb0477-cbb9-48b1-9856-b5438622c050 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:55.782651 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-aceb0477-cbb9-48b1-9856-b5438622c050 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/7d754336-7bde-477f-954d-d0b4290ee0fa" status: 200 len: 1316 microversion: 2.1 time: 0.284983 Oct 26 13:05:55.784145 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 513/977] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:55 2022] GET /compute/v2.1/servers/7d754336-7bde-477f-954d-d0b4290ee0fa => generated 1316 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:56.295399 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-41c50b48-b0cf-4c87-a214-cb9ceb976f79 req-8615b991-0090-41b9-8e7f-f782e2d20f09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be43f1c5-7509-4755-9db7-c41e7b83464f", "name": "network-vif-plugged", "status": "completed", "tag": "f433536e-b171-41cf-b186-2aea6a04c2eb"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:56.316439 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-50aa39a5-ffd1-4ebd-8ff9-ece9f64ec6f0 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:56.317944 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-50aa39a5-ffd1-4ebd-8ff9-ece9f64ec6f0 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: be43f1c5-7509-4755-9db7-c41e7b83464f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:56.324320 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-41c50b48-b0cf-4c87-a214-cb9ceb976f79 req-8615b991-0090-41b9-8e7f-f782e2d20f09 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:56.325077 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-41c50b48-b0cf-4c87-a214-cb9ceb976f79 req-8615b991-0090-41b9-8e7f-f782e2d20f09 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:56.327823 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50aa39a5-ffd1-4ebd-8ff9-ece9f64ec6f0 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:56.328304 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50aa39a5-ffd1-4ebd-8ff9-ece9f64ec6f0 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:56.329380 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-41c50b48-b0cf-4c87-a214-cb9ceb976f79 req-8615b991-0090-41b9-8e7f-f782e2d20f09 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:56.333928 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50aa39a5-ffd1-4ebd-8ff9-ece9f64ec6f0 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:56.334881 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50aa39a5-ffd1-4ebd-8ff9-ece9f64ec6f0 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:56.335681 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50aa39a5-ffd1-4ebd-8ff9-ece9f64ec6f0 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:56.336243 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50aa39a5-ffd1-4ebd-8ff9-ece9f64ec6f0 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:56.358459 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-41c50b48-b0cf-4c87-a214-cb9ceb976f79 req-8615b991-0090-41b9-8e7f-f782e2d20f09 service nova] Creating event network-vif-plugged:f433536e-b171-41cf-b186-2aea6a04c2eb for instance be43f1c5-7509-4755-9db7-c41e7b83464f on n-h1-862686-1 Oct 26 13:05:56.364006 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-41c50b48-b0cf-4c87-a214-cb9ceb976f79 req-8615b991-0090-41b9-8e7f-f782e2d20f09 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079804 Oct 26 13:05:56.364672 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 465/978] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:05:56.519113 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5b915268-9649-4506-bcb7-a748367de84b tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:56.520129 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5b915268-9649-4506-bcb7-a748367de84b tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] [instance: f7878a23-cf30-42db-a872-b9cfa0c0b2c1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:56.547088 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5b915268-9649-4506-bcb7-a748367de84b tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:56.548445 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5b915268-9649-4506-bcb7-a748367de84b tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:56.549212 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5b915268-9649-4506-bcb7-a748367de84b tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:56.551639 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5b915268-9649-4506-bcb7-a748367de84b tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:56.552320 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5b915268-9649-4506-bcb7-a748367de84b tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:56.553340 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5b915268-9649-4506-bcb7-a748367de84b tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:56.568205 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-50aa39a5-ffd1-4ebd-8ff9-ece9f64ec6f0 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:56.585632 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-50aa39a5-ffd1-4ebd-8ff9-ece9f64ec6f0 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/be43f1c5-7509-4755-9db7-c41e7b83464f" status: 200 len: 1313 microversion: 2.1 time: 0.273965 Oct 26 13:05:56.589721 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 514/979] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:56 2022] GET /compute/v2.1/servers/be43f1c5-7509-4755-9db7-c41e7b83464f => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:05:56.633683 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3a812426-e3c1-4e49-a6d1-76cace8e48e3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:56.634543 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3a812426-e3c1-4e49-a6d1-76cace8e48e3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:56.647316 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3a812426-e3c1-4e49-a6d1-76cace8e48e3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:56.650148 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3a812426-e3c1-4e49-a6d1-76cace8e48e3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:56.652010 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3a812426-e3c1-4e49-a6d1-76cace8e48e3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:56.653541 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3a812426-e3c1-4e49-a6d1-76cace8e48e3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:56.655008 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3a812426-e3c1-4e49-a6d1-76cace8e48e3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:56.658686 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3a812426-e3c1-4e49-a6d1-76cace8e48e3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:56.935078 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5b915268-9649-4506-bcb7-a748367de84b tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde48023bc1a4ee0a0beb2a99030a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589842c86ede4d51a98b22b996918fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:56.948922 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5b915268-9649-4506-bcb7-a748367de84b tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] 10.222.0.40 "GET /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1" status: 200 len: 1509 microversion: 2.1 time: 0.433980 Oct 26 13:05:56.960986 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 466/980] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:56 2022] GET /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1 => generated 1509 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:05:56.967420 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3a812426-e3c1-4e49-a6d1-76cace8e48e3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:56.971895 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3a812426-e3c1-4e49-a6d1-76cace8e48e3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 200 len: 1543 microversion: 2.1 time: 0.338150 Oct 26 13:05:56.972516 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 515/981] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:56 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 1543 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:56.998654 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-77c04322-792e-49f0-b09a-25a3528ad4f5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:56.999295 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-77c04322-792e-49f0-b09a-25a3528ad4f5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 7d754336-7bde-477f-954d-d0b4290ee0fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:57.015044 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77c04322-792e-49f0-b09a-25a3528ad4f5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:57.015529 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77c04322-792e-49f0-b09a-25a3528ad4f5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:57.016020 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77c04322-792e-49f0-b09a-25a3528ad4f5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:57.016672 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77c04322-792e-49f0-b09a-25a3528ad4f5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:57.032746 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77c04322-792e-49f0-b09a-25a3528ad4f5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:57.033307 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77c04322-792e-49f0-b09a-25a3528ad4f5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:57.266612 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3245e47b-ef9f-4798-a3e0-41c06a503579 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1710464151", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:57.352286 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-3245e47b-ef9f-4798-a3e0-41c06a503579 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] validate_networks() for None {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:05:57.684522 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-3245e47b-ef9f-4798-a3e0-41c06a503579 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:05:57.686144 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-3245e47b-ef9f-4798-a3e0-41c06a503579 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:05:57.686901 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-3245e47b-ef9f-4798-a3e0-41c06a503579 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:05:57.687462 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-3245e47b-ef9f-4798-a3e0-41c06a503579 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:05:57.691502 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-3245e47b-ef9f-4798-a3e0-41c06a503579 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:05:57.721883 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3245e47b-ef9f-4798-a3e0-41c06a503579 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:57.722373 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3245e47b-ef9f-4798-a3e0-41c06a503579 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:57.722917 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3245e47b-ef9f-4798-a3e0-41c06a503579 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:57.735485 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3245e47b-ef9f-4798-a3e0-41c06a503579 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:57.736018 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3245e47b-ef9f-4798-a3e0-41c06a503579 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:57.736464 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3245e47b-ef9f-4798-a3e0-41c06a503579 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:57.770731 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-77c04322-792e-49f0-b09a-25a3528ad4f5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:57.787357 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-77c04322-792e-49f0-b09a-25a3528ad4f5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/7d754336-7bde-477f-954d-d0b4290ee0fa" status: 200 len: 1465 microversion: 2.1 time: 0.805394 Oct 26 13:05:57.788116 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 516/982] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:56 2022] GET /compute/v2.1/servers/7d754336-7bde-477f-954d-d0b4290ee0fa => generated 1465 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:57.798575 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-a07cfb4f-d86c-482e-9313-731f628e83ff req-8643e015-33ec-4ebc-9175-248ac43b98da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7878a23-cf30-42db-a872-b9cfa0c0b2c1", "name": "network-vif-deleted", "tag": "59c21699-7f88-4feb-bc1a-f5627a7a31f7"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:57.814166 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-3245e47b-ef9f-4798-a3e0-41c06a503579 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Getting quotas for project 3a46daa2d3a043488473b65f18ebfefe. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:05:57.818355 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-a07cfb4f-d86c-482e-9313-731f628e83ff req-8643e015-33ec-4ebc-9175-248ac43b98da service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:57.820769 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-a07cfb4f-d86c-482e-9313-731f628e83ff req-8643e015-33ec-4ebc-9175-248ac43b98da service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:57.821722 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-a07cfb4f-d86c-482e-9313-731f628e83ff req-8643e015-33ec-4ebc-9175-248ac43b98da service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:57.821896 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-3245e47b-ef9f-4798-a3e0-41c06a503579 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Getting quotas for user 71de4f9fbfb94d7da473e93e42591c5a and project 3a46daa2d3a043488473b65f18ebfefe. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:05:57.862921 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3245e47b-ef9f-4798-a3e0-41c06a503579 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:05:57.864535 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-a07cfb4f-d86c-482e-9313-731f628e83ff req-8643e015-33ec-4ebc-9175-248ac43b98da service nova] Creating event network-vif-deleted:59c21699-7f88-4feb-bc1a-f5627a7a31f7 for instance f7878a23-cf30-42db-a872-b9cfa0c0b2c1 on n-h1-862686-1 Oct 26 13:05:57.871232 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3245e47b-ef9f-4798-a3e0-41c06a503579 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:05:57.873727 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-a07cfb4f-d86c-482e-9313-731f628e83ff req-8643e015-33ec-4ebc-9175-248ac43b98da service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083658 Oct 26 13:05:57.882224 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 517/983] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:05:57.893466 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4198851b-a031-4f59-b587-f190945088c6 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:57.898366 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4198851b-a031-4f59-b587-f190945088c6 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: be43f1c5-7509-4755-9db7-c41e7b83464f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:57.916095 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4198851b-a031-4f59-b587-f190945088c6 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:57.919800 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4198851b-a031-4f59-b587-f190945088c6 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:57.920594 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4198851b-a031-4f59-b587-f190945088c6 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:57.923474 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4198851b-a031-4f59-b587-f190945088c6 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:57.924089 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4198851b-a031-4f59-b587-f190945088c6 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:57.924959 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4198851b-a031-4f59-b587-f190945088c6 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:57.946681 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3245e47b-ef9f-4798-a3e0-41c06a503579 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.992886 Oct 26 13:05:57.953850 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 467/984] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:05:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1000 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:05:57.960915 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-be1b157c-8a25-49c1-abf0-a3414eea94ec tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:57.961775 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-be1b157c-8a25-49c1-abf0-a3414eea94ec tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] [instance: 7d754336-7bde-477f-954d-d0b4290ee0fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:57.984804 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-be1b157c-8a25-49c1-abf0-a3414eea94ec tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:57.987738 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-be1b157c-8a25-49c1-abf0-a3414eea94ec tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:57.988930 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-be1b157c-8a25-49c1-abf0-a3414eea94ec tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:57.990600 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-be1b157c-8a25-49c1-abf0-a3414eea94ec tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:57.994504 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-be1b157c-8a25-49c1-abf0-a3414eea94ec tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:57.995895 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-be1b157c-8a25-49c1-abf0-a3414eea94ec tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:58.001792 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:05:58.333592 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-be1b157c-8a25-49c1-abf0-a3414eea94ec tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/7d754336-7bde-477f-954d-d0b4290ee0fa" status: 200 len: 1616 microversion: 2.1 time: 0.378089 Oct 26 13:05:58.337072 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 468/985] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:57 2022] GET /compute/v2.1/servers/7d754336-7bde-477f-954d-d0b4290ee0fa => generated 1616 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:58.343361 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-36017050-b5ea-477c-8691-b4b28019ded4 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:58.344673 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-36017050-b5ea-477c-8691-b4b28019ded4 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:58.350404 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:05:58.447181 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-36017050-b5ea-477c-8691-b4b28019ded4 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:58.455806 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-36017050-b5ea-477c-8691-b4b28019ded4 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904" status: 200 len: 1222 microversion: 2.1 time: 0.117112 Oct 26 13:05:58.457913 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 469/986] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:58 2022] GET /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904 => generated 1222 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:58.465673 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b271cd4a-5456-4cf3-b445-bd80e05f9c4c tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:58.466748 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b271cd4a-5456-4cf3-b445-bd80e05f9c4c tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] [instance: f7878a23-cf30-42db-a872-b9cfa0c0b2c1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:58.480018 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b271cd4a-5456-4cf3-b445-bd80e05f9c4c tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:58.481284 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b271cd4a-5456-4cf3-b445-bd80e05f9c4c tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:58.482101 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b271cd4a-5456-4cf3-b445-bd80e05f9c4c tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:58.483155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b271cd4a-5456-4cf3-b445-bd80e05f9c4c tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:58.488823 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b271cd4a-5456-4cf3-b445-bd80e05f9c4c tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:58.489618 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b271cd4a-5456-4cf3-b445-bd80e05f9c4c tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:58.520541 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4198851b-a031-4f59-b587-f190945088c6 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:58.537502 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4198851b-a031-4f59-b587-f190945088c6 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/be43f1c5-7509-4755-9db7-c41e7b83464f" status: 200 len: 1313 microversion: 2.1 time: 0.653764 Oct 26 13:05:58.546333 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 518/987] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:57 2022] GET /compute/v2.1/servers/be43f1c5-7509-4755-9db7-c41e7b83464f => generated 1313 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:58.553364 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c4961d35-223b-49e2-82ab-72e596778ee0 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:58.554733 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c4961d35-223b-49e2-82ab-72e596778ee0 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:58.567280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4961d35-223b-49e2-82ab-72e596778ee0 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:58.567786 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4961d35-223b-49e2-82ab-72e596778ee0 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:58.568245 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4961d35-223b-49e2-82ab-72e596778ee0 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:58.576336 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4961d35-223b-49e2-82ab-72e596778ee0 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:58.577229 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4961d35-223b-49e2-82ab-72e596778ee0 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:58.577876 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4961d35-223b-49e2-82ab-72e596778ee0 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:58.586559 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b271cd4a-5456-4cf3-b445-bd80e05f9c4c tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:58.588523 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b271cd4a-5456-4cf3-b445-bd80e05f9c4c tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:58.589008 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b271cd4a-5456-4cf3-b445-bd80e05f9c4c tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:58.589603 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-b271cd4a-5456-4cf3-b445-bd80e05f9c4c tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lazy-loading 'fault' on Instance uuid f7878a23-cf30-42db-a872-b9cfa0c0b2c1 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:05:58.646122 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b271cd4a-5456-4cf3-b445-bd80e05f9c4c tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde48023bc1a4ee0a0beb2a99030a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589842c86ede4d51a98b22b996918fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:58.655147 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b271cd4a-5456-4cf3-b445-bd80e05f9c4c tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] 10.222.0.40 "GET /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1" status: 200 len: 1305 microversion: 2.1 time: 0.193363 Oct 26 13:05:58.655954 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 470/988] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:58 2022] GET /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1 => generated 1305 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:58.676929 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-56b4673d-d1db-4507-8ede-46c52f90ff7e req-19dffd30-1c50-487a-a721-764dcfa5bdf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "670021c1-045f-40b1-9358-c589d32e9904", "name": "network-vif-plugged", "status": "completed", "tag": "6e2ffd62-248d-44dd-83ca-8e87f79cc722"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:58.689047 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-56b4673d-d1db-4507-8ede-46c52f90ff7e req-19dffd30-1c50-487a-a721-764dcfa5bdf7 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:58.689726 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-56b4673d-d1db-4507-8ede-46c52f90ff7e req-19dffd30-1c50-487a-a721-764dcfa5bdf7 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:58.690371 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-56b4673d-d1db-4507-8ede-46c52f90ff7e req-19dffd30-1c50-487a-a721-764dcfa5bdf7 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:58.703209 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-56b4673d-d1db-4507-8ede-46c52f90ff7e req-19dffd30-1c50-487a-a721-764dcfa5bdf7 service nova] Creating event network-vif-plugged:6e2ffd62-248d-44dd-83ca-8e87f79cc722 for instance 670021c1-045f-40b1-9358-c589d32e9904 on n-h2-862686-1 Oct 26 13:05:58.708884 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-56b4673d-d1db-4507-8ede-46c52f90ff7e req-19dffd30-1c50-487a-a721-764dcfa5bdf7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040859 Oct 26 13:05:58.709651 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 471/989] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:05:58.729190 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-57268dfc-e1e4-4887-8266-3a33f38ccf56 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-194640201", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["4c694a16-fdba-414f-9122-1899cc715565"]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:58.822791 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-57268dfc-e1e4-4887-8266-3a33f38ccf56 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] validate_networks() for None {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:05:59.119040 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c4961d35-223b-49e2-82ab-72e596778ee0 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:59.137197 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c4961d35-223b-49e2-82ab-72e596778ee0 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 200 len: 1543 microversion: 2.1 time: 0.588410 Oct 26 13:05:59.139951 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 519/990] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:58 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 1543 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:59.266539 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-57268dfc-e1e4-4887-8266-3a33f38ccf56 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:05:59.266960 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-57268dfc-e1e4-4887-8266-3a33f38ccf56 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:05:59.267744 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-57268dfc-e1e4-4887-8266-3a33f38ccf56 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:05:59.268159 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-57268dfc-e1e4-4887-8266-3a33f38ccf56 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:05:59.268571 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-57268dfc-e1e4-4887-8266-3a33f38ccf56 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:05:59.279594 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57268dfc-e1e4-4887-8266-3a33f38ccf56 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:59.280495 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57268dfc-e1e4-4887-8266-3a33f38ccf56 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:59.282482 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57268dfc-e1e4-4887-8266-3a33f38ccf56 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:59.283747 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57268dfc-e1e4-4887-8266-3a33f38ccf56 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:59.284515 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57268dfc-e1e4-4887-8266-3a33f38ccf56 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:59.285354 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57268dfc-e1e4-4887-8266-3a33f38ccf56 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:59.335967 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-57268dfc-e1e4-4887-8266-3a33f38ccf56 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Getting quotas for project d6515917885c4f3cb5fb19e05f4e5e2b. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:05:59.341468 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-57268dfc-e1e4-4887-8266-3a33f38ccf56 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Getting quotas for user b6cddfeca4ce49788143b2bf4b30545f and project d6515917885c4f3cb5fb19e05f4e5e2b. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:05:59.358224 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-57268dfc-e1e4-4887-8266-3a33f38ccf56 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:05:59.362605 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-57268dfc-e1e4-4887-8266-3a33f38ccf56 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 82458e75-f124-45b2-85a6-ef634b510f90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:05:59.438975 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-57268dfc-e1e4-4887-8266-3a33f38ccf56 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.727528 Oct 26 13:05:59.439730 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 472/991] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:05:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:05:59.446487 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-17b6811c-e30f-4e65-b988-6f8200ad179f tempest-KeyPairsV210TestJSON-1784786849 tempest-KeyPairsV210TestJSON-1784786849-project-admin] Action: 'create', calling method: .version_select at 0x7f673248f160>, body: {"keypair": {"name": "tempest-keypair-1049041785", "type": "ssh", "user_id": "d3b1ac9553054cfd95f04a5c0e70c25d", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0I+Oke/enhUF0Rxq3vR8fTAgggTBBOJGBdZLv0ZjqggossAIbnaM5C7fqmyZqf2y67GWba4UBOfpHM4kTm94y8CjUaN5W93br9+MDZ1JfivDQ9cpTtNEV+yVNTiRJTQg=="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:59.470605 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:05:59.476737 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f1f09e1b-7c3f-4db3-86bf-8ce6fdd4ede2 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:59.477548 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f1f09e1b-7c3f-4db3-86bf-8ce6fdd4ede2 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 82458e75-f124-45b2-85a6-ef634b510f90] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:59.489852 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-17b6811c-e30f-4e65-b988-6f8200ad179f tempest-KeyPairsV210TestJSON-1784786849 tempest-KeyPairsV210TestJSON-1784786849-project-admin] Getting quotas for project 735f7849e53547a88aef2c0a9b853afe. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:05:59.496324 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-17b6811c-e30f-4e65-b988-6f8200ad179f tempest-KeyPairsV210TestJSON-1784786849 tempest-KeyPairsV210TestJSON-1784786849-project-admin] Getting quotas for user fff76d30b980427ca5f2511afc5b5d13 and project 735f7849e53547a88aef2c0a9b853afe. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:05:59.529443 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-17b6811c-e30f-4e65-b988-6f8200ad179f tempest-KeyPairsV210TestJSON-1784786849 tempest-KeyPairsV210TestJSON-1784786849-project-admin] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.260374 Oct 26 13:05:59.530422 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 520/992] 10.222.0.40 () {62 vars in 1200 bytes} [Wed Oct 26 13:05:59 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 262 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 26 13:05:59.541683 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-69f2fb30-38a6-4c71-acec-2d02710cd4a7 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:59.544112 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-69f2fb30-38a6-4c71-acec-2d02710cd4a7 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:59.556886 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-69f2fb30-38a6-4c71-acec-2d02710cd4a7 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:59.562055 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f1f09e1b-7c3f-4db3-86bf-8ce6fdd4ede2 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:59.571752 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f1f09e1b-7c3f-4db3-86bf-8ce6fdd4ede2 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/82458e75-f124-45b2-85a6-ef634b510f90" status: 200 len: 1216 microversion: 2.1 time: 0.117348 Oct 26 13:05:59.572366 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 473/993] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:59 2022] GET /compute/v2.1/servers/82458e75-f124-45b2-85a6-ef634b510f90 => generated 1216 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:59.573663 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-69f2fb30-38a6-4c71-acec-2d02710cd4a7 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:59.574191 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-69f2fb30-38a6-4c71-acec-2d02710cd4a7 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:59.574940 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-69f2fb30-38a6-4c71-acec-2d02710cd4a7 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:59.577460 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-14e60253-4ae4-406a-8174-30350118e723 tempest-KeyPairsV210TestJSON-1784786849 tempest-KeyPairsV210TestJSON-1784786849-project-admin] Action: 'create', calling method: .version_select at 0x7f67327c4ee0>, body: {"keypair": {"name": "tempest-keypair-1117453773", "type": "ssh", "user_id": "d3b1ac9553054cfd95f04a5c0e70c25d", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDaim4NvuOCp29xiBHoQKYT9zKiNpNGWOUX3j3E6KNTcp9E695qK/4FEPj/HuCXUkD5+y9hpluEDpZcituzIDvN61ZZuksG5mxtBLVxguGUiMQ/cyi3/cgsntqcNFsOojQ=="}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:59.577996 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-69f2fb30-38a6-4c71-acec-2d02710cd4a7 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:59.578437 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-69f2fb30-38a6-4c71-acec-2d02710cd4a7 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:59.620795 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-14e60253-4ae4-406a-8174-30350118e723 tempest-KeyPairsV210TestJSON-1784786849 tempest-KeyPairsV210TestJSON-1784786849-project-admin] Getting quotas for project 735f7849e53547a88aef2c0a9b853afe. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:05:59.626203 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-14e60253-4ae4-406a-8174-30350118e723 tempest-KeyPairsV210TestJSON-1784786849 tempest-KeyPairsV210TestJSON-1784786849-project-admin] Getting quotas for user fff76d30b980427ca5f2511afc5b5d13 and project 735f7849e53547a88aef2c0a9b853afe. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:05:59.665953 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-14e60253-4ae4-406a-8174-30350118e723 tempest-KeyPairsV210TestJSON-1784786849 tempest-KeyPairsV210TestJSON-1784786849-project-admin] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.092432 Oct 26 13:05:59.666724 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 474/994] 10.222.0.40 () {62 vars in 1200 bytes} [Wed Oct 26 13:05:59 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 94 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 26 13:05:59.671522 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-32d9d5b2-8bec-4170-aa04-e8de5df26ad2 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:59.672434 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-32d9d5b2-8bec-4170-aa04-e8de5df26ad2 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: be43f1c5-7509-4755-9db7-c41e7b83464f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:59.682393 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32d9d5b2-8bec-4170-aa04-e8de5df26ad2 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:59.683526 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32d9d5b2-8bec-4170-aa04-e8de5df26ad2 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:59.697810 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32d9d5b2-8bec-4170-aa04-e8de5df26ad2 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:59.698682 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32d9d5b2-8bec-4170-aa04-e8de5df26ad2 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:59.699354 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32d9d5b2-8bec-4170-aa04-e8de5df26ad2 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:59.699815 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32d9d5b2-8bec-4170-aa04-e8de5df26ad2 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:59.736723 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-69f2fb30-38a6-4c71-acec-2d02710cd4a7 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:59.749913 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-69f2fb30-38a6-4c71-acec-2d02710cd4a7 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904" status: 200 len: 1274 microversion: 2.1 time: 0.217838 Oct 26 13:05:59.767943 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 521/995] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:59 2022] GET /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904 => generated 1274 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:59.777381 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-99ae4879-8561-4c6b-9244-45d70e05998e tempest-KeyPairsV210TestJSON-1784786849 tempest-KeyPairsV210TestJSON-1784786849-project-admin] Calling method '.version_select at 0x7f67324e6280>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:59.799695 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-99ae4879-8561-4c6b-9244-45d70e05998e tempest-KeyPairsV210TestJSON-1784786849 tempest-KeyPairsV210TestJSON-1784786849-project-admin] 10.222.0.40 "GET /compute/v2.1/os-keypairs/tempest-keypair-1049041785?user_id=d3b1ac9553054cfd95f04a5c0e70c25d" status: 200 len: 512 microversion: 2.10 time: 0.026479 Oct 26 13:05:59.801120 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 522/996] 10.222.0.40 () {60 vars in 1340 bytes} [Wed Oct 26 13:05:59 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1049041785?user_id=d3b1ac9553054cfd95f04a5c0e70c25d => generated 512 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:05:59.811997 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f03361f0-5480-4ed0-9b76-afa452da8469 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:05:59.818745 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f03361f0-5480-4ed0-9b76-afa452da8469 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] [instance: f7878a23-cf30-42db-a872-b9cfa0c0b2c1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:59.828158 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f03361f0-5480-4ed0-9b76-afa452da8469 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:59.830466 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f03361f0-5480-4ed0-9b76-afa452da8469 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:59.831178 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f03361f0-5480-4ed0-9b76-afa452da8469 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:59.832388 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f03361f0-5480-4ed0-9b76-afa452da8469 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:05:59.833169 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f03361f0-5480-4ed0-9b76-afa452da8469 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:05:59.834096 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f03361f0-5480-4ed0-9b76-afa452da8469 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:05:59.859890 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-f03361f0-5480-4ed0-9b76-afa452da8469 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] HTTP exception thrown: Instance f7878a23-cf30-42db-a872-b9cfa0c0b2c1 could not be found. Oct 26 13:05:59.863824 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f03361f0-5480-4ed0-9b76-afa452da8469 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Request method failure captured: Oct 26 13:05:59.863824 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1 HTTP/1.1 Oct 26 13:05:59.863824 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:05:59.863824 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:05:59.863824 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:05:59.863824 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:05:59.863824 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:05:59.863824 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:05:59.863824 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:05:59.863824 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:05:59.863824 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTCXBQoLx7K5kSjSznofU0qdm2xirzGyCwppMGRwt0az_YdHthBxGwOVBLDXnHH1cMk5A3BV4Nrzhlhvi_6_xwUzsFCfsmnAfrtMT4wPz2C0uhc8fBOYnRxLmVmS7UCnYSqqcjZae2dEgs_mslPEnO_jzwq0GnxCMTANrf5Ql0kdN08 Oct 26 13:05:59.863824 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:05:59.863824 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:05:59.863824 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:05:59.863824 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:05:59.863824 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:05:59.863824 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:05:59.863824 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 589842c86ede4d51a98b22b996918fd3 Oct 26 13:05:59.863824 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ImagesNegativeTestJSON-1248550906 Oct 26 13:05:59.863824 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:05:59.863824 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:05:59.865195 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/589842c86ede4d51a98b22b996918fd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/589842c86ede4d51a98b22b996918fd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_589842c86ede4d51a98b22b996918fd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/589842c86ede4d51a98b22b996918fd3"}]}] Oct 26 13:05:59.865195 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ImagesNegativeTestJSON-1248550906 Oct 26 13:05:59.865195 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 589842c86ede4d51a98b22b996918fd3 Oct 26 13:05:59.865195 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1248550906 Oct 26 13:05:59.865195 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ImagesNegativeTestJSON-1248550906-project Oct 26 13:05:59.865195 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:05:59.865195 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:05:59.865195 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: dde48023bc1a4ee0a0beb2a99030a5d7 Oct 26 13:05:59.865195 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ImagesNegativeTestJSON-1248550906-project Oct 26 13:05:59.865195 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:05:59.865195 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance f7878a23-cf30-42db-a872-b9cfa0c0b2c1 could not be found. Oct 26 13:05:59.865195 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'f7878a23-cf30-42db-a872-b9cfa0c0b2c1'} Oct 26 13:05:59.866264 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:05:59.866264 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:05:59.866264 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:05:59.866264 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:05:59.866264 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:05:59.866264 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:05:59.866264 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:05:59.866264 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:05:59.866264 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:05:59.866264 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:05:59.866264 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7878a23-cf30-42db-a872-b9cfa0c0b2c1 could not be found. Oct 26 13:05:59.866264 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:05:59.866264 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:05:59.866264 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:05:59.866264 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:05:59.866264 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:05:59.866264 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:05:59.866264 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:05:59.866264 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:05:59.866264 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:05:59.868189 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:05:59.868189 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:05:59.868189 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:05:59.868189 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:05:59.868189 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:05:59.868189 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:05:59.868189 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:05:59.868189 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7878a23-cf30-42db-a872-b9cfa0c0b2c1 could not be found. Oct 26 13:05:59.868189 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:05:59.868189 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:05:59.868189 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:05:59.868189 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:05:59.868189 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:05:59.868189 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:05:59.868189 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:05:59.868189 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:05:59.868189 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7878a23-cf30-42db-a872-b9cfa0c0b2c1 could not be found. Oct 26 13:05:59.868189 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:05:59.876047 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f03361f0-5480-4ed0-9b76-afa452da8469 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Returning 404 to user: Instance f7878a23-cf30-42db-a872-b9cfa0c0b2c1 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:05:59.885764 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f03361f0-5480-4ed0-9b76-afa452da8469 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] 10.222.0.40 "GET /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1" status: 404 len: 111 microversion: 2.1 time: 0.078183 Oct 26 13:05:59.890306 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 523/997] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:59 2022] GET /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:05:59.896794 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2a670c1a-7406-443f-aaa8-a939b4a629f8 tempest-KeyPairsV210TestJSON-1784786849 tempest-KeyPairsV210TestJSON-1784786849-project-admin] Action: 'create', calling method: .version_select at 0x7f67324e65e0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-75814159", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBt5NiHNwBTGiHymVx+R4sLu4O9pTm5CenMIEg5EdZFTF7dYq0PbZW705i91Q/QygaR+KInb7rIJRLwQLysnJwMYo2VgoC82Hx1YbWRkBkHfvzkW4/hdQfWxuR0tGZ4Rjg=="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:59.915342 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-2a670c1a-7406-443f-aaa8-a939b4a629f8 tempest-KeyPairsV210TestJSON-1784786849 tempest-KeyPairsV210TestJSON-1784786849-project-admin] Getting quotas for project 735f7849e53547a88aef2c0a9b853afe. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:05:59.921560 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-2a670c1a-7406-443f-aaa8-a939b4a629f8 tempest-KeyPairsV210TestJSON-1784786849 tempest-KeyPairsV210TestJSON-1784786849-project-admin] Getting quotas for user fff76d30b980427ca5f2511afc5b5d13 and project 735f7849e53547a88aef2c0a9b853afe. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:05:59.955822 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2a670c1a-7406-443f-aaa8-a939b4a629f8 tempest-KeyPairsV210TestJSON-1784786849 tempest-KeyPairsV210TestJSON-1784786849-project-admin] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.10 time: 0.067626 Oct 26 13:05:59.956867 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 524/998] 10.222.0.40 () {62 vars in 1200 bytes} [Wed Oct 26 13:05:59 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 70 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 26 13:05:59.966066 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-32d9d5b2-8bec-4170-aa04-e8de5df26ad2 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:05:59.975011 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-46bf3481-0f1e-4080-adcf-0fa6fabcf5c1 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1108893432", "metadata": {"image_type": "test"}}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:05:59.977941 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-46bf3481-0f1e-4080-adcf-0fa6fabcf5c1 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] [instance: f7878a23-cf30-42db-a872-b9cfa0c0b2c1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:05:59.980285 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-32d9d5b2-8bec-4170-aa04-e8de5df26ad2 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/be43f1c5-7509-4755-9db7-c41e7b83464f" status: 200 len: 1463 microversion: 2.1 time: 0.312260 Oct 26 13:05:59.981773 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 475/999] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:05:59 2022] GET /compute/v2.1/servers/be43f1c5-7509-4755-9db7-c41e7b83464f => generated 1463 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:05:59.999340 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4c074197-8d19-4b63-8e2d-800f5df9e82b tempest-KeyPairsV210TestJSON-1784786849 tempest-KeyPairsV210TestJSON-1784786849-project-admin] Calling method '.version_select at 0x7f6732cb55e0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:00.013423 n-d-862686-1 devstack@n-api.service[120597]: WARNING oslo_db.sqlalchemy.utils [None req-4c074197-8d19-4b63-8e2d-800f5df9e82b tempest-KeyPairsV210TestJSON-1784786849 tempest-KeyPairsV210TestJSON-1784786849-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 26 13:06:00.014038 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46bf3481-0f1e-4080-adcf-0fa6fabcf5c1 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:00.014613 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46bf3481-0f1e-4080-adcf-0fa6fabcf5c1 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:00.015369 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46bf3481-0f1e-4080-adcf-0fa6fabcf5c1 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:00.016829 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46bf3481-0f1e-4080-adcf-0fa6fabcf5c1 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:00.017361 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46bf3481-0f1e-4080-adcf-0fa6fabcf5c1 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:00.017856 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46bf3481-0f1e-4080-adcf-0fa6fabcf5c1 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:00.036469 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4c074197-8d19-4b63-8e2d-800f5df9e82b tempest-KeyPairsV210TestJSON-1784786849 tempest-KeyPairsV210TestJSON-1784786849-project-admin] 10.222.0.40 "GET /compute/v2.1/os-keypairs?user_id=d3b1ac9553054cfd95f04a5c0e70c25d" status: 200 len: 726 microversion: 2.10 time: 0.052097 Oct 26 13:06:00.037078 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 476/1000] 10.222.0.40 () {60 vars in 1259 bytes} [Wed Oct 26 13:05:59 2022] GET /compute/v2.1/os-keypairs?user_id=d3b1ac9553054cfd95f04a5c0e70c25d => generated 726 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:06:00.044460 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-46bf3481-0f1e-4080-adcf-0fa6fabcf5c1 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] HTTP exception thrown: Instance f7878a23-cf30-42db-a872-b9cfa0c0b2c1 could not be found. Oct 26 13:06:00.047038 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-46bf3481-0f1e-4080-adcf-0fa6fabcf5c1 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Request method failure captured: Oct 26 13:06:00.047038 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1/action HTTP/1.1 Oct 26 13:06:00.047038 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:06:00.047038 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:06:00.047038 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:06:00.047038 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 112 Oct 26 13:06:00.047038 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:06:00.047038 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:06:00.047038 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:06:00.047038 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:06:00.047038 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTCXBQoLx7K5kSjSznofU0qdm2xirzGyCwppMGRwt0az_YdHthBxGwOVBLDXnHH1cMk5A3BV4Nrzhlhvi_6_xwUzsFCfsmnAfrtMT4wPz2C0uhc8fBOYnRxLmVmS7UCnYSqqcjZae2dEgs_mslPEnO_jzwq0GnxCMTANrf5Ql0kdN08 Oct 26 13:06:00.047038 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:06:00.047038 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:06:00.047038 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:06:00.047038 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:06:00.047038 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:06:00.047038 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:06:00.047038 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 589842c86ede4d51a98b22b996918fd3 Oct 26 13:06:00.047038 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ImagesNegativeTestJSON-1248550906 Oct 26 13:06:00.047038 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:06:00.047038 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:06:00.048403 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/589842c86ede4d51a98b22b996918fd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/589842c86ede4d51a98b22b996918fd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_589842c86ede4d51a98b22b996918fd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/589842c86ede4d51a98b22b996918fd3"}]}] Oct 26 13:06:00.048403 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ImagesNegativeTestJSON-1248550906 Oct 26 13:06:00.048403 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 589842c86ede4d51a98b22b996918fd3 Oct 26 13:06:00.048403 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1248550906 Oct 26 13:06:00.048403 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ImagesNegativeTestJSON-1248550906-project Oct 26 13:06:00.048403 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:06:00.048403 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:06:00.048403 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: dde48023bc1a4ee0a0beb2a99030a5d7 Oct 26 13:06:00.048403 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ImagesNegativeTestJSON-1248550906-project Oct 26 13:06:00.048403 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:06:00.048403 n-d-862686-1 devstack@n-api.service[120598]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1108893432", "metadata": {"image_type": "test"}}} Oct 26 13:06:00.048403 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:06:00.049148 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance f7878a23-cf30-42db-a872-b9cfa0c0b2c1 could not be found. Oct 26 13:06:00.049148 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'f7878a23-cf30-42db-a872-b9cfa0c0b2c1', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1108893432', 'metadata': {'image_type': 'test'}}}} Oct 26 13:06:00.049148 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:06:00.049148 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:06:00.049148 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:06:00.049148 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:06:00.049148 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:06:00.049148 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:06:00.049148 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:06:00.049148 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:06:00.049148 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:06:00.049148 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:06:00.049148 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7878a23-cf30-42db-a872-b9cfa0c0b2c1 could not be found. Oct 26 13:06:00.049148 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:06:00.049148 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:06:00.049148 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:06:00.049148 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:06:00.049148 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:06:00.049148 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:06:00.050368 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:06:00.050368 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:06:00.050368 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:06:00.050368 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:06:00.050368 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:06:00.050368 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:06:00.050368 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:06:00.050368 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:06:00.050368 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 26 13:06:00.050368 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 26 13:06:00.050368 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:06:00.050368 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:06:00.050368 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:06:00.050368 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:06:00.050368 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7878a23-cf30-42db-a872-b9cfa0c0b2c1 could not be found. Oct 26 13:06:00.050368 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:06:00.050368 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:06:00.050368 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:06:00.050368 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:06:00.050368 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:06:00.051574 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:06:00.051574 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:06:00.051574 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:06:00.051574 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7878a23-cf30-42db-a872-b9cfa0c0b2c1 could not be found. Oct 26 13:06:00.051574 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:06:00.051574 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-46bf3481-0f1e-4080-adcf-0fa6fabcf5c1 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Returning 404 to user: Instance f7878a23-cf30-42db-a872-b9cfa0c0b2c1 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:06:00.051574 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-46bf3481-0f1e-4080-adcf-0fa6fabcf5c1 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] 10.222.0.40 "POST /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1/action" status: 404 len: 111 microversion: 2.1 time: 0.090369 Oct 26 13:06:00.051574 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 525/1001] 10.222.0.40 () {60 vars in 1279 bytes} [Wed Oct 26 13:05:59 2022] POST /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1/action => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:06:00.052077 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-52123ff7-8f5e-4cc4-b87b-8d820dfb904d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:00.055324 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e30813f4-f708-40be-b395-60212a022054 tempest-KeyPairsV210TestJSON-1784786849 tempest-KeyPairsV210TestJSON-1784786849-project-admin] Calling method '.version_select at 0x7f6732907b80>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:00.057734 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-52123ff7-8f5e-4cc4-b87b-8d820dfb904d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:00.089655 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52123ff7-8f5e-4cc4-b87b-8d820dfb904d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:00.090522 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52123ff7-8f5e-4cc4-b87b-8d820dfb904d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:00.092279 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52123ff7-8f5e-4cc4-b87b-8d820dfb904d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:00.093292 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52123ff7-8f5e-4cc4-b87b-8d820dfb904d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:00.093922 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e30813f4-f708-40be-b395-60212a022054 tempest-KeyPairsV210TestJSON-1784786849 tempest-KeyPairsV210TestJSON-1784786849-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-75814159" status: 204 len: 0 microversion: 2.10 time: 0.041574 Oct 26 13:06:00.095299 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52123ff7-8f5e-4cc4-b87b-8d820dfb904d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:00.095753 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52123ff7-8f5e-4cc4-b87b-8d820dfb904d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:00.100625 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 526/1002] 10.222.0.40 () {60 vars in 1319 bytes} [Wed Oct 26 13:06:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-75814159 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 13:06:00.113171 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-67a9ef81-8547-42b4-b81c-abf9042c4156 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1877581336", "metadata": {"image_type": "test"}}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:06:00.122045 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-67a9ef81-8547-42b4-b81c-abf9042c4156 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Failed to fetch instance by id tempest-invalid-1778611154 {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 26 13:06:00.122677 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-67a9ef81-8547-42b4-b81c-abf9042c4156 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] HTTP exception thrown: Instance tempest-invalid-1778611154 could not be found. Oct 26 13:06:00.124144 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-67a9ef81-8547-42b4-b81c-abf9042c4156 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Request method failure captured: Oct 26 13:06:00.124144 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/servers/tempest-invalid-1778611154/action HTTP/1.1 Oct 26 13:06:00.124144 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:06:00.124144 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:06:00.124144 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:06:00.124144 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 112 Oct 26 13:06:00.124144 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:06:00.124144 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:06:00.124144 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:06:00.124144 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:06:00.124144 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTCXBQoLx7K5kSjSznofU0qdm2xirzGyCwppMGRwt0az_YdHthBxGwOVBLDXnHH1cMk5A3BV4Nrzhlhvi_6_xwUzsFCfsmnAfrtMT4wPz2C0uhc8fBOYnRxLmVmS7UCnYSqqcjZae2dEgs_mslPEnO_jzwq0GnxCMTANrf5Ql0kdN08 Oct 26 13:06:00.124144 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:06:00.124144 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:06:00.124144 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:06:00.124144 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:06:00.124144 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:06:00.124144 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:06:00.124144 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 589842c86ede4d51a98b22b996918fd3 Oct 26 13:06:00.124144 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ImagesNegativeTestJSON-1248550906 Oct 26 13:06:00.124144 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:06:00.124144 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:06:00.125469 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/589842c86ede4d51a98b22b996918fd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/589842c86ede4d51a98b22b996918fd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_589842c86ede4d51a98b22b996918fd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/589842c86ede4d51a98b22b996918fd3"}]}] Oct 26 13:06:00.125469 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ImagesNegativeTestJSON-1248550906 Oct 26 13:06:00.125469 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 589842c86ede4d51a98b22b996918fd3 Oct 26 13:06:00.125469 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1248550906 Oct 26 13:06:00.125469 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ImagesNegativeTestJSON-1248550906-project Oct 26 13:06:00.125469 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:06:00.125469 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:06:00.125469 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: dde48023bc1a4ee0a0beb2a99030a5d7 Oct 26 13:06:00.125469 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ImagesNegativeTestJSON-1248550906-project Oct 26 13:06:00.125469 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:06:00.125469 n-d-862686-1 devstack@n-api.service[120598]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1877581336", "metadata": {"image_type": "test"}}} Oct 26 13:06:00.125469 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:06:00.126227 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance tempest-invalid-1778611154 could not be found. Oct 26 13:06:00.126227 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'tempest-invalid-1778611154', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1877581336', 'metadata': {'image_type': 'test'}}}} Oct 26 13:06:00.126227 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:06:00.126227 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:06:00.126227 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:06:00.126227 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:06:00.126227 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 26 13:06:00.126227 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 26 13:06:00.126227 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1778611154 could not be found. Oct 26 13:06:00.126227 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:06:00.126227 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:06:00.126227 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:06:00.126227 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:06:00.126227 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:06:00.126227 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:06:00.126227 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:06:00.126227 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:06:00.126227 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:06:00.126227 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:06:00.126227 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:06:00.127442 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:06:00.127442 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:06:00.127442 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:06:00.127442 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 26 13:06:00.127442 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 26 13:06:00.127442 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:06:00.127442 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:06:00.127442 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:06:00.127442 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:06:00.127442 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1778611154 could not be found. Oct 26 13:06:00.127442 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:06:00.127442 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:06:00.127442 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:06:00.127442 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:06:00.127442 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:06:00.127442 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:06:00.127442 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:06:00.127442 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:06:00.127442 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1778611154 could not be found. Oct 26 13:06:00.127442 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:06:00.128643 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-67a9ef81-8547-42b4-b81c-abf9042c4156 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Returning 404 to user: Instance tempest-invalid-1778611154 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:06:00.128643 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-67a9ef81-8547-42b4-b81c-abf9042c4156 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] 10.222.0.40 "POST /compute/v2.1/servers/tempest-invalid-1778611154/action" status: 404 len: 101 microversion: 2.1 time: 0.023296 Oct 26 13:06:00.129908 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 527/1003] 10.222.0.40 () {60 vars in 1249 bytes} [Wed Oct 26 13:06:00 2022] POST /compute/v2.1/servers/tempest-invalid-1778611154/action => generated 101 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:06:00.140376 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9f8e653b-74d0-41ec-9dee-2a58ff212d52 tempest-KeyPairsV210TestJSON-1784786849 tempest-KeyPairsV210TestJSON-1784786849-project-admin] Calling method '.version_select at 0x7f6732442790>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:00.184207 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9f8e653b-74d0-41ec-9dee-2a58ff212d52 tempest-KeyPairsV210TestJSON-1784786849 tempest-KeyPairsV210TestJSON-1784786849-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1117453773?user_id=d3b1ac9553054cfd95f04a5c0e70c25d" status: 204 len: 0 microversion: 2.10 time: 0.053184 Oct 26 13:06:00.185200 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 528/1004] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Oct 26 13:06:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1117453773?user_id=d3b1ac9553054cfd95f04a5c0e70c25d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 13:06:00.190847 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b174dd75-d461-4f9c-9733-8464bc740f98 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-455845386"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:06:00.196384 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b174dd75-d461-4f9c-9733-8464bc740f98 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 26 13:06:00.197375 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-b174dd75-d461-4f9c-9733-8464bc740f98 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 26 13:06:00.199996 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b174dd75-d461-4f9c-9733-8464bc740f98 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Request method failure captured: Oct 26 13:06:00.199996 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 26 13:06:00.199996 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:06:00.199996 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:06:00.199996 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:06:00.199996 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 56 Oct 26 13:06:00.199996 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:06:00.199996 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:06:00.199996 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:06:00.199996 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:06:00.199996 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTCXBQoLx7K5kSjSznofU0qdm2xirzGyCwppMGRwt0az_YdHthBxGwOVBLDXnHH1cMk5A3BV4Nrzhlhvi_6_xwUzsFCfsmnAfrtMT4wPz2C0uhc8fBOYnRxLmVmS7UCnYSqqcjZae2dEgs_mslPEnO_jzwq0GnxCMTANrf5Ql0kdN08 Oct 26 13:06:00.199996 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:06:00.199996 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:06:00.199996 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:06:00.199996 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:06:00.199996 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:06:00.199996 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:06:00.199996 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 589842c86ede4d51a98b22b996918fd3 Oct 26 13:06:00.199996 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ImagesNegativeTestJSON-1248550906 Oct 26 13:06:00.199996 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:06:00.199996 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:06:00.201401 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/589842c86ede4d51a98b22b996918fd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/589842c86ede4d51a98b22b996918fd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_589842c86ede4d51a98b22b996918fd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/589842c86ede4d51a98b22b996918fd3"}]}] Oct 26 13:06:00.201401 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ImagesNegativeTestJSON-1248550906 Oct 26 13:06:00.201401 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 589842c86ede4d51a98b22b996918fd3 Oct 26 13:06:00.201401 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1248550906 Oct 26 13:06:00.201401 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ImagesNegativeTestJSON-1248550906-project Oct 26 13:06:00.201401 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:06:00.201401 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:06:00.201401 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: dde48023bc1a4ee0a0beb2a99030a5d7 Oct 26 13:06:00.201401 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ImagesNegativeTestJSON-1248550906-project Oct 26 13:06:00.201401 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:06:00.201401 n-d-862686-1 devstack@n-api.service[120598]: {"createImage": {"name": "tempest-test-snap-455845386"}} Oct 26 13:06:00.201401 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:06:00.201401 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 26 13:06:00.203786 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-455845386'}}} Oct 26 13:06:00.203786 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:06:00.203786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:06:00.203786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:06:00.203786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:06:00.203786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 26 13:06:00.203786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 26 13:06:00.203786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 26 13:06:00.203786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:06:00.203786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:06:00.203786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:06:00.203786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:06:00.203786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:06:00.203786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:06:00.203786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:06:00.203786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:06:00.203786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:06:00.203786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:06:00.203786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:06:00.203786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:06:00.205007 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:06:00.205007 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:06:00.205007 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 26 13:06:00.205007 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 26 13:06:00.205007 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:06:00.205007 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:06:00.205007 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:06:00.205007 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:06:00.205007 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 26 13:06:00.205007 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:06:00.205007 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:06:00.205007 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:06:00.205007 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:06:00.205007 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:06:00.205007 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:06:00.205007 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:06:00.205007 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:06:00.205007 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 26 13:06:00.205007 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:06:00.207275 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b174dd75-d461-4f9c-9733-8464bc740f98 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:06:00.208458 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b174dd75-d461-4f9c-9733-8464bc740f98 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] 10.222.0.40 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.022021 Oct 26 13:06:00.209428 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 529/1005] 10.222.0.40 () {60 vars in 1275 bytes} [Wed Oct 26 13:06:00 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:06:00.217522 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ec6f2ff0-e951-44e9-b006-1f65643054b1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:00.218536 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ec6f2ff0-e951-44e9-b006-1f65643054b1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:00.228376 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec6f2ff0-e951-44e9-b006-1f65643054b1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:00.229442 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec6f2ff0-e951-44e9-b006-1f65643054b1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:00.230337 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec6f2ff0-e951-44e9-b006-1f65643054b1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:00.231480 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec6f2ff0-e951-44e9-b006-1f65643054b1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:00.232226 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec6f2ff0-e951-44e9-b006-1f65643054b1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:00.233351 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec6f2ff0-e951-44e9-b006-1f65643054b1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:00.401817 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-52123ff7-8f5e-4cc4-b87b-8d820dfb904d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:00.426295 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-52123ff7-8f5e-4cc4-b87b-8d820dfb904d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1314 microversion: 2.1 time: 0.383084 Oct 26 13:06:00.427118 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 477/1006] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:00 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:00.455054 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-113673d7-8378-4537-af67-d5292d16fa53 tempest-KeyPairsV210TestJSON-1784786849 tempest-KeyPairsV210TestJSON-1784786849-project-admin] Calling method '.version_select at 0x7f673275cb80>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:00.516079 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-113673d7-8378-4537-af67-d5292d16fa53 tempest-KeyPairsV210TestJSON-1784786849 tempest-KeyPairsV210TestJSON-1784786849-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1049041785?user_id=d3b1ac9553054cfd95f04a5c0e70c25d" status: 204 len: 0 microversion: 2.10 time: 0.073495 Oct 26 13:06:00.517475 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 478/1007] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Oct 26 13:06:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1049041785?user_id=d3b1ac9553054cfd95f04a5c0e70c25d => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 13:06:00.532835 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3b59fef8-1d82-4cd1-b5ae-321d94b0de42 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1989245772"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:06:00.538926 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3b59fef8-1d82-4cd1-b5ae-321d94b0de42 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 26 13:06:00.547197 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-3b59fef8-1d82-4cd1-b5ae-321d94b0de42 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 26 13:06:00.550524 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3b59fef8-1d82-4cd1-b5ae-321d94b0de42 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Request method failure captured: Oct 26 13:06:00.550524 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 26 13:06:00.550524 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:06:00.550524 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:06:00.550524 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:06:00.550524 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 57 Oct 26 13:06:00.550524 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:06:00.550524 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:06:00.550524 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:06:00.550524 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:06:00.550524 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTCXBQoLx7K5kSjSznofU0qdm2xirzGyCwppMGRwt0az_YdHthBxGwOVBLDXnHH1cMk5A3BV4Nrzhlhvi_6_xwUzsFCfsmnAfrtMT4wPz2C0uhc8fBOYnRxLmVmS7UCnYSqqcjZae2dEgs_mslPEnO_jzwq0GnxCMTANrf5Ql0kdN08 Oct 26 13:06:00.550524 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:06:00.550524 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:06:00.550524 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:06:00.550524 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:06:00.550524 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:06:00.550524 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:06:00.550524 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 589842c86ede4d51a98b22b996918fd3 Oct 26 13:06:00.550524 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ImagesNegativeTestJSON-1248550906 Oct 26 13:06:00.550524 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:06:00.550524 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:06:00.551877 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/589842c86ede4d51a98b22b996918fd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/589842c86ede4d51a98b22b996918fd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_589842c86ede4d51a98b22b996918fd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/589842c86ede4d51a98b22b996918fd3"}]}] Oct 26 13:06:00.551877 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ImagesNegativeTestJSON-1248550906 Oct 26 13:06:00.551877 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 589842c86ede4d51a98b22b996918fd3 Oct 26 13:06:00.551877 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1248550906 Oct 26 13:06:00.551877 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ImagesNegativeTestJSON-1248550906-project Oct 26 13:06:00.551877 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:06:00.551877 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:06:00.551877 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: dde48023bc1a4ee0a0beb2a99030a5d7 Oct 26 13:06:00.551877 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ImagesNegativeTestJSON-1248550906-project Oct 26 13:06:00.551877 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:06:00.551877 n-d-862686-1 devstack@n-api.service[120597]: {"createImage": {"name": "tempest-test-snap-1989245772"}} Oct 26 13:06:00.551877 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:06:00.551877 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 26 13:06:00.552658 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1989245772'}}} Oct 26 13:06:00.552658 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:06:00.552658 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:06:00.552658 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:06:00.552658 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:06:00.552658 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 26 13:06:00.552658 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 26 13:06:00.552658 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 26 13:06:00.552658 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:06:00.552658 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:06:00.552658 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:06:00.552658 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:06:00.552658 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:06:00.552658 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:06:00.552658 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:06:00.552658 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:06:00.552658 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:06:00.552658 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:06:00.552658 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:06:00.552658 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:06:00.553964 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:06:00.553964 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:06:00.553964 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 26 13:06:00.553964 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 26 13:06:00.553964 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:06:00.553964 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:06:00.553964 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:06:00.553964 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:06:00.553964 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 26 13:06:00.553964 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:06:00.553964 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:06:00.553964 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:06:00.553964 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:06:00.553964 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:06:00.553964 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:06:00.553964 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:06:00.553964 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:06:00.553964 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 26 13:06:00.553964 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:06:00.560919 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3b59fef8-1d82-4cd1-b5ae-321d94b0de42 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:06:00.562873 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3b59fef8-1d82-4cd1-b5ae-321d94b0de42 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] 10.222.0.40 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.044168 Oct 26 13:06:00.564390 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 479/1008] 10.222.0.40 () {60 vars in 1281 bytes} [Wed Oct 26 13:06:00 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:06:00.589980 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a3efdf7b-c9bf-43b6-bc98-82549b262ef2 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:00.603613 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a3efdf7b-c9bf-43b6-bc98-82549b262ef2 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] [instance: f7878a23-cf30-42db-a872-b9cfa0c0b2c1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:00.633234 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a3efdf7b-c9bf-43b6-bc98-82549b262ef2 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:00.634785 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a3efdf7b-c9bf-43b6-bc98-82549b262ef2 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:00.635226 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a3efdf7b-c9bf-43b6-bc98-82549b262ef2 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:00.638061 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a3efdf7b-c9bf-43b6-bc98-82549b262ef2 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:00.640372 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a3efdf7b-c9bf-43b6-bc98-82549b262ef2 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:00.641171 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a3efdf7b-c9bf-43b6-bc98-82549b262ef2 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:00.690004 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-a3efdf7b-c9bf-43b6-bc98-82549b262ef2 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] HTTP exception thrown: Instance f7878a23-cf30-42db-a872-b9cfa0c0b2c1 could not be found. Oct 26 13:06:00.694282 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a3efdf7b-c9bf-43b6-bc98-82549b262ef2 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Request method failure captured: Oct 26 13:06:00.694282 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1 HTTP/1.1 Oct 26 13:06:00.694282 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:06:00.694282 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:06:00.694282 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:06:00.694282 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:06:00.694282 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:06:00.694282 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:06:00.694282 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:06:00.694282 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:06:00.694282 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTCXBQoLx7K5kSjSznofU0qdm2xirzGyCwppMGRwt0az_YdHthBxGwOVBLDXnHH1cMk5A3BV4Nrzhlhvi_6_xwUzsFCfsmnAfrtMT4wPz2C0uhc8fBOYnRxLmVmS7UCnYSqqcjZae2dEgs_mslPEnO_jzwq0GnxCMTANrf5Ql0kdN08 Oct 26 13:06:00.694282 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:06:00.694282 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:06:00.694282 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:06:00.694282 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:06:00.694282 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:06:00.694282 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:06:00.694282 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 589842c86ede4d51a98b22b996918fd3 Oct 26 13:06:00.694282 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ImagesNegativeTestJSON-1248550906 Oct 26 13:06:00.694282 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:06:00.694282 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:06:00.696227 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/589842c86ede4d51a98b22b996918fd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/589842c86ede4d51a98b22b996918fd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_589842c86ede4d51a98b22b996918fd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/589842c86ede4d51a98b22b996918fd3"}]}] Oct 26 13:06:00.696227 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ImagesNegativeTestJSON-1248550906 Oct 26 13:06:00.696227 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 589842c86ede4d51a98b22b996918fd3 Oct 26 13:06:00.696227 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1248550906 Oct 26 13:06:00.696227 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ImagesNegativeTestJSON-1248550906-project Oct 26 13:06:00.696227 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:06:00.696227 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:06:00.696227 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: dde48023bc1a4ee0a0beb2a99030a5d7 Oct 26 13:06:00.696227 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ImagesNegativeTestJSON-1248550906-project Oct 26 13:06:00.696227 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:06:00.696227 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance f7878a23-cf30-42db-a872-b9cfa0c0b2c1 could not be found. Oct 26 13:06:00.696227 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'f7878a23-cf30-42db-a872-b9cfa0c0b2c1'} Oct 26 13:06:00.697172 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:06:00.697172 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:06:00.697172 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:06:00.697172 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:06:00.697172 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:06:00.697172 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:06:00.697172 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:06:00.697172 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:06:00.697172 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:06:00.697172 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:06:00.697172 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7878a23-cf30-42db-a872-b9cfa0c0b2c1 could not be found. Oct 26 13:06:00.697172 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:06:00.697172 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:06:00.697172 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:06:00.697172 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:06:00.697172 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:06:00.697172 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:06:00.697172 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:06:00.697172 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:06:00.697172 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:06:00.698633 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:06:00.698633 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:06:00.698633 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:06:00.698633 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:06:00.698633 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:06:00.698633 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:06:00.698633 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:06:00.698633 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:06:00.698633 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:06:00.698633 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7878a23-cf30-42db-a872-b9cfa0c0b2c1 could not be found. Oct 26 13:06:00.698633 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:06:00.698633 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:06:00.698633 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:06:00.698633 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:06:00.698633 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:06:00.698633 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:06:00.698633 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:06:00.698633 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:06:00.698633 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7878a23-cf30-42db-a872-b9cfa0c0b2c1 could not be found. Oct 26 13:06:00.698633 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:06:00.700778 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a3efdf7b-c9bf-43b6-bc98-82549b262ef2 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Returning 404 to user: Instance f7878a23-cf30-42db-a872-b9cfa0c0b2c1 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:06:00.700778 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a3efdf7b-c9bf-43b6-bc98-82549b262ef2 tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1" status: 404 len: 111 microversion: 2.1 time: 0.126243 Oct 26 13:06:00.703860 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 480/1009] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:06:00 2022] DELETE /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 13:06:00.713672 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bf2ee323-cea3-4e81-a1b0-2562a073d99b tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:00.714723 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bf2ee323-cea3-4e81-a1b0-2562a073d99b tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 82458e75-f124-45b2-85a6-ef634b510f90] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:00.722443 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf2ee323-cea3-4e81-a1b0-2562a073d99b tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:00.723860 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf2ee323-cea3-4e81-a1b0-2562a073d99b tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:00.724450 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf2ee323-cea3-4e81-a1b0-2562a073d99b tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:00.725311 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf2ee323-cea3-4e81-a1b0-2562a073d99b tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:00.726809 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf2ee323-cea3-4e81-a1b0-2562a073d99b tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:00.727531 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf2ee323-cea3-4e81-a1b0-2562a073d99b tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:00.900636 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bf2ee323-cea3-4e81-a1b0-2562a073d99b tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:00.901751 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ec6f2ff0-e951-44e9-b006-1f65643054b1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:00.913770 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ec6f2ff0-e951-44e9-b006-1f65643054b1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 200 len: 1543 microversion: 2.1 time: 0.701324 Oct 26 13:06:00.914406 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 530/1010] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:00 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 1543 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:00.916711 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bf2ee323-cea3-4e81-a1b0-2562a073d99b tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/82458e75-f124-45b2-85a6-ef634b510f90" status: 200 len: 1268 microversion: 2.1 time: 0.208263 Oct 26 13:06:00.918387 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 481/1011] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:00 2022] GET /compute/v2.1/servers/82458e75-f124-45b2-85a6-ef634b510f90 => generated 1268 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:00.926506 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ae845390-cdae-464f-8ce4-49ed807918ec tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:00.926897 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ae845390-cdae-464f-8ce4-49ed807918ec tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:00.938104 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1ec7da8e-0d6a-4e72-b4ca-1732c008c3ae tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:00.938713 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1ec7da8e-0d6a-4e72-b4ca-1732c008c3ae tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] [instance: f7878a23-cf30-42db-a872-b9cfa0c0b2c1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:00.943128 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae845390-cdae-464f-8ce4-49ed807918ec tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:00.948841 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae845390-cdae-464f-8ce4-49ed807918ec tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:00.949322 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae845390-cdae-464f-8ce4-49ed807918ec tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:00.950210 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae845390-cdae-464f-8ce4-49ed807918ec tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:00.950681 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae845390-cdae-464f-8ce4-49ed807918ec tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:00.951109 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae845390-cdae-464f-8ce4-49ed807918ec tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:00.969936 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ec7da8e-0d6a-4e72-b4ca-1732c008c3ae tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:00.970441 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ec7da8e-0d6a-4e72-b4ca-1732c008c3ae tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:00.970888 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ec7da8e-0d6a-4e72-b4ca-1732c008c3ae tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:00.977400 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ec7da8e-0d6a-4e72-b4ca-1732c008c3ae tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:00.977944 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ec7da8e-0d6a-4e72-b4ca-1732c008c3ae tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:00.978393 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ec7da8e-0d6a-4e72-b4ca-1732c008c3ae tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:01.006650 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-1ec7da8e-0d6a-4e72-b4ca-1732c008c3ae tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] HTTP exception thrown: Instance f7878a23-cf30-42db-a872-b9cfa0c0b2c1 could not be found. Oct 26 13:06:01.010364 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1ec7da8e-0d6a-4e72-b4ca-1732c008c3ae tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Request method failure captured: Oct 26 13:06:01.010364 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1 HTTP/1.1 Oct 26 13:06:01.010364 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:06:01.010364 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:06:01.010364 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:06:01.010364 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:06:01.010364 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:06:01.010364 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:06:01.010364 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:06:01.010364 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:06:01.010364 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTCXBQoLx7K5kSjSznofU0qdm2xirzGyCwppMGRwt0az_YdHthBxGwOVBLDXnHH1cMk5A3BV4Nrzhlhvi_6_xwUzsFCfsmnAfrtMT4wPz2C0uhc8fBOYnRxLmVmS7UCnYSqqcjZae2dEgs_mslPEnO_jzwq0GnxCMTANrf5Ql0kdN08 Oct 26 13:06:01.010364 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:06:01.010364 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:06:01.010364 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:06:01.010364 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:06:01.010364 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:06:01.010364 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:06:01.010364 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 589842c86ede4d51a98b22b996918fd3 Oct 26 13:06:01.010364 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ImagesNegativeTestJSON-1248550906 Oct 26 13:06:01.010364 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:06:01.010364 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:06:01.011924 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/589842c86ede4d51a98b22b996918fd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/589842c86ede4d51a98b22b996918fd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_589842c86ede4d51a98b22b996918fd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/589842c86ede4d51a98b22b996918fd3"}]}] Oct 26 13:06:01.011924 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ImagesNegativeTestJSON-1248550906 Oct 26 13:06:01.011924 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 589842c86ede4d51a98b22b996918fd3 Oct 26 13:06:01.011924 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1248550906 Oct 26 13:06:01.011924 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ImagesNegativeTestJSON-1248550906-project Oct 26 13:06:01.011924 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:06:01.011924 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:06:01.011924 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: dde48023bc1a4ee0a0beb2a99030a5d7 Oct 26 13:06:01.011924 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ImagesNegativeTestJSON-1248550906-project Oct 26 13:06:01.011924 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:06:01.011924 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance f7878a23-cf30-42db-a872-b9cfa0c0b2c1 could not be found. Oct 26 13:06:01.011924 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'f7878a23-cf30-42db-a872-b9cfa0c0b2c1'} Oct 26 13:06:01.012934 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:06:01.012934 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:06:01.012934 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:06:01.012934 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:06:01.012934 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:06:01.012934 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:06:01.012934 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:06:01.012934 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:06:01.012934 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:06:01.012934 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:06:01.012934 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7878a23-cf30-42db-a872-b9cfa0c0b2c1 could not be found. Oct 26 13:06:01.012934 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:06:01.012934 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:06:01.012934 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:06:01.012934 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:06:01.012934 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:06:01.012934 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:06:01.012934 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:06:01.012934 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:06:01.012934 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:06:01.015038 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:06:01.015038 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:06:01.015038 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:06:01.015038 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:06:01.015038 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:06:01.015038 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:06:01.015038 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:06:01.015038 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7878a23-cf30-42db-a872-b9cfa0c0b2c1 could not be found. Oct 26 13:06:01.015038 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:06:01.015038 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:06:01.015038 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:06:01.015038 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:06:01.015038 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:06:01.015038 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:06:01.015038 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:06:01.015038 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:06:01.015038 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7878a23-cf30-42db-a872-b9cfa0c0b2c1 could not be found. Oct 26 13:06:01.015038 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:06:01.019303 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1ec7da8e-0d6a-4e72-b4ca-1732c008c3ae tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] Returning 404 to user: Instance f7878a23-cf30-42db-a872-b9cfa0c0b2c1 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:06:01.022202 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1ec7da8e-0d6a-4e72-b4ca-1732c008c3ae tempest-ImagesNegativeTestJSON-1248550906 tempest-ImagesNegativeTestJSON-1248550906-project] 10.222.0.40 "GET /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1" status: 404 len: 111 microversion: 2.1 time: 0.088734 Oct 26 13:06:01.025812 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 531/1012] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:00 2022] GET /compute/v2.1/servers/f7878a23-cf30-42db-a872-b9cfa0c0b2c1 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:06:01.078206 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ae845390-cdae-464f-8ce4-49ed807918ec tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:01.105851 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ae845390-cdae-464f-8ce4-49ed807918ec tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904" status: 200 len: 1282 microversion: 2.1 time: 0.186025 Oct 26 13:06:01.106810 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 482/1013] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:00 2022] GET /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904 => generated 1282 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:01.451135 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-02770545-3b4b-4581-a56d-549666122d5c tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:01.452605 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-02770545-3b4b-4581-a56d-549666122d5c tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:01.465424 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02770545-3b4b-4581-a56d-549666122d5c tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:01.468275 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02770545-3b4b-4581-a56d-549666122d5c tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:01.469019 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02770545-3b4b-4581-a56d-549666122d5c tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:01.470045 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02770545-3b4b-4581-a56d-549666122d5c tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:01.472837 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02770545-3b4b-4581-a56d-549666122d5c tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:01.473723 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02770545-3b4b-4581-a56d-549666122d5c tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:01.484046 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:06:01.941330 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7ff7219a-fa4e-4245-a557-ef0197f4fd80 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:01.942134 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7ff7219a-fa4e-4245-a557-ef0197f4fd80 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:01.955048 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ff7219a-fa4e-4245-a557-ef0197f4fd80 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:01.955633 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ff7219a-fa4e-4245-a557-ef0197f4fd80 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:01.956179 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ff7219a-fa4e-4245-a557-ef0197f4fd80 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:01.957039 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ff7219a-fa4e-4245-a557-ef0197f4fd80 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:01.957525 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ff7219a-fa4e-4245-a557-ef0197f4fd80 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:01.957961 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ff7219a-fa4e-4245-a557-ef0197f4fd80 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:01.987081 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-02770545-3b4b-4581-a56d-549666122d5c tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:02.017957 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-02770545-3b4b-4581-a56d-549666122d5c tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1464 microversion: 2.1 time: 0.564593 Oct 26 13:06:02.019150 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 532/1014] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:01 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1464 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:02.025523 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-89adaf1e-bf5b-498d-99fd-187b48a91e60 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:02.026205 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-89adaf1e-bf5b-498d-99fd-187b48a91e60 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 82458e75-f124-45b2-85a6-ef634b510f90] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:02.050623 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-89adaf1e-bf5b-498d-99fd-187b48a91e60 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:02.051269 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-89adaf1e-bf5b-498d-99fd-187b48a91e60 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:02.051621 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-89adaf1e-bf5b-498d-99fd-187b48a91e60 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:02.055514 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-89adaf1e-bf5b-498d-99fd-187b48a91e60 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:02.056217 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-89adaf1e-bf5b-498d-99fd-187b48a91e60 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:02.056600 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-89adaf1e-bf5b-498d-99fd-187b48a91e60 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:02.208037 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-89adaf1e-bf5b-498d-99fd-187b48a91e60 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:02.228755 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-89adaf1e-bf5b-498d-99fd-187b48a91e60 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/82458e75-f124-45b2-85a6-ef634b510f90" status: 200 len: 1274 microversion: 2.1 time: 0.208191 Oct 26 13:06:02.231879 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 533/1015] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:02 2022] GET /compute/v2.1/servers/82458e75-f124-45b2-85a6-ef634b510f90 => generated 1274 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:02.258513 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-21f13719-7a24-4d91-a183-4af65fa74ba3 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:02.259167 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-21f13719-7a24-4d91-a183-4af65fa74ba3 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:02.280620 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-21f13719-7a24-4d91-a183-4af65fa74ba3 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:02.281889 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-21f13719-7a24-4d91-a183-4af65fa74ba3 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:02.282431 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-21f13719-7a24-4d91-a183-4af65fa74ba3 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:02.284099 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-21f13719-7a24-4d91-a183-4af65fa74ba3 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:02.285009 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-21f13719-7a24-4d91-a183-4af65fa74ba3 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:02.285740 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-21f13719-7a24-4d91-a183-4af65fa74ba3 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:02.410088 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-21f13719-7a24-4d91-a183-4af65fa74ba3 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:02.419466 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-21f13719-7a24-4d91-a183-4af65fa74ba3 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904" status: 200 len: 1280 microversion: 2.1 time: 0.166749 Oct 26 13:06:02.420421 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 534/1016] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:02 2022] GET /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904 => generated 1280 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:02.425142 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f099b071-0587-404e-b214-ed04d0ced258 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-70373233", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "670021c1-045f-40b1-9358-c589d32e9904"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:06:02.513555 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-f099b071-0587-404e-b214-ed04d0ced258 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] validate_networks() for None {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:06:02.731580 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7ff7219a-fa4e-4245-a557-ef0197f4fd80 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:02.740619 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7ff7219a-fa4e-4245-a557-ef0197f4fd80 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 200 len: 1543 microversion: 2.1 time: 0.806385 Oct 26 13:06:02.741998 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 483/1017] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:01 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 1543 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:06:02.935849 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-f099b071-0587-404e-b214-ed04d0ced258 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:06:02.936215 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-f099b071-0587-404e-b214-ed04d0ced258 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:06:02.936686 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-f099b071-0587-404e-b214-ed04d0ced258 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:06:02.937082 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-f099b071-0587-404e-b214-ed04d0ced258 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:06:02.937809 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-f099b071-0587-404e-b214-ed04d0ced258 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:06:02.959776 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f099b071-0587-404e-b214-ed04d0ced258 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:02.961374 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f099b071-0587-404e-b214-ed04d0ced258 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:02.965797 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f099b071-0587-404e-b214-ed04d0ced258 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:02.968143 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f099b071-0587-404e-b214-ed04d0ced258 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:02.974326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f099b071-0587-404e-b214-ed04d0ced258 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:02.981475 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f099b071-0587-404e-b214-ed04d0ced258 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:03.038948 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-f099b071-0587-404e-b214-ed04d0ced258 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Getting quotas for project 2f5434aa488d4d5a8bae96746cfd7494. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:06:03.056836 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-f099b071-0587-404e-b214-ed04d0ced258 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Getting quotas for user de8d47754d3f4d2c844dea032bdb0095 and project 2f5434aa488d4d5a8bae96746cfd7494. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:06:03.098098 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f099b071-0587-404e-b214-ed04d0ced258 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:06:03.100658 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f099b071-0587-404e-b214-ed04d0ced258 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 1c5d8fc5-5c9f-4bdf-81ed-388df5d390de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:06:03.182582 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f099b071-0587-404e-b214-ed04d0ced258 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.760909 Oct 26 13:06:03.183240 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 535/1018] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:06:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:06:03.195542 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fe8973cd-dd01-412a-9d2c-05477ddd2c50 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:03.196679 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fe8973cd-dd01-412a-9d2c-05477ddd2c50 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 1c5d8fc5-5c9f-4bdf-81ed-388df5d390de] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:03.266949 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8dddeae3-c857-419c-9f2a-7fe0d5dfe917 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:03.268654 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8dddeae3-c857-419c-9f2a-7fe0d5dfe917 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 82458e75-f124-45b2-85a6-ef634b510f90] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:03.284372 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8dddeae3-c857-419c-9f2a-7fe0d5dfe917 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:03.284870 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8dddeae3-c857-419c-9f2a-7fe0d5dfe917 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:03.285313 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8dddeae3-c857-419c-9f2a-7fe0d5dfe917 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:03.286056 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8dddeae3-c857-419c-9f2a-7fe0d5dfe917 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:03.294587 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8dddeae3-c857-419c-9f2a-7fe0d5dfe917 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:03.295052 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8dddeae3-c857-419c-9f2a-7fe0d5dfe917 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:03.574749 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8dddeae3-c857-419c-9f2a-7fe0d5dfe917 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:03.582731 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8dddeae3-c857-419c-9f2a-7fe0d5dfe917 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/82458e75-f124-45b2-85a6-ef634b510f90" status: 200 len: 1274 microversion: 2.1 time: 0.327219 Oct 26 13:06:03.587409 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 536/1019] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:03 2022] GET /compute/v2.1/servers/82458e75-f124-45b2-85a6-ef634b510f90 => generated 1274 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:06:03.596966 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d1ddc2f9-0e58-4863-afdb-eee1ed46590d tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:03.602338 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d1ddc2f9-0e58-4863-afdb-eee1ed46590d tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:03.611163 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d1ddc2f9-0e58-4863-afdb-eee1ed46590d tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:03.614007 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d1ddc2f9-0e58-4863-afdb-eee1ed46590d tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:03.614628 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d1ddc2f9-0e58-4863-afdb-eee1ed46590d tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:03.622137 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d1ddc2f9-0e58-4863-afdb-eee1ed46590d tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:03.625388 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d1ddc2f9-0e58-4863-afdb-eee1ed46590d tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:03.629731 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d1ddc2f9-0e58-4863-afdb-eee1ed46590d tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:03.928523 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d1ddc2f9-0e58-4863-afdb-eee1ed46590d tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:03.937104 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d1ddc2f9-0e58-4863-afdb-eee1ed46590d tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904" status: 200 len: 1280 microversion: 2.1 time: 0.348453 Oct 26 13:06:03.953041 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 537/1020] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:03 2022] GET /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904 => generated 1280 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:03.961269 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ee81899d-bb4d-4622-8d18-6f14959f220e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:03.973838 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ee81899d-bb4d-4622-8d18-6f14959f220e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:03.987957 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee81899d-bb4d-4622-8d18-6f14959f220e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:03.994091 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee81899d-bb4d-4622-8d18-6f14959f220e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:03.995246 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee81899d-bb4d-4622-8d18-6f14959f220e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:03.996227 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee81899d-bb4d-4622-8d18-6f14959f220e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:03.996907 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee81899d-bb4d-4622-8d18-6f14959f220e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:03.997596 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee81899d-bb4d-4622-8d18-6f14959f220e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:04.376111 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fe8973cd-dd01-412a-9d2c-05477ddd2c50 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:04.385007 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fe8973cd-dd01-412a-9d2c-05477ddd2c50 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/1c5d8fc5-5c9f-4bdf-81ed-388df5d390de" status: 200 len: 1212 microversion: 2.1 time: 1.194374 Oct 26 13:06:04.385674 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 484/1021] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:03 2022] GET /compute/v2.1/servers/1c5d8fc5-5c9f-4bdf-81ed-388df5d390de => generated 1212 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:04.610947 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0ee4414b-7857-43fd-91b1-286498818cc9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:04.616062 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0ee4414b-7857-43fd-91b1-286498818cc9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 82458e75-f124-45b2-85a6-ef634b510f90] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:04.626992 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ee4414b-7857-43fd-91b1-286498818cc9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:04.631481 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ee4414b-7857-43fd-91b1-286498818cc9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:04.637088 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ee4414b-7857-43fd-91b1-286498818cc9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:04.638426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ee4414b-7857-43fd-91b1-286498818cc9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:04.642927 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ee4414b-7857-43fd-91b1-286498818cc9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:04.643644 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ee4414b-7857-43fd-91b1-286498818cc9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:04.824829 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ee81899d-bb4d-4622-8d18-6f14959f220e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:04.850054 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ee81899d-bb4d-4622-8d18-6f14959f220e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 200 len: 1542 microversion: 2.1 time: 0.896270 Oct 26 13:06:04.852353 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0ee4414b-7857-43fd-91b1-286498818cc9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:04.853838 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 538/1022] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:03 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 1542 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:04.875125 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0ee4414b-7857-43fd-91b1-286498818cc9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/82458e75-f124-45b2-85a6-ef634b510f90" status: 200 len: 1274 microversion: 2.1 time: 0.268547 Oct 26 13:06:04.875374 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 485/1023] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:04 2022] GET /compute/v2.1/servers/82458e75-f124-45b2-85a6-ef634b510f90 => generated 1274 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:06:04.963552 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7e1f2c17-c2ca-4f10-aaca-2561316a6d62 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:04.965232 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7e1f2c17-c2ca-4f10-aaca-2561316a6d62 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:04.974244 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e1f2c17-c2ca-4f10-aaca-2561316a6d62 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:04.978031 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e1f2c17-c2ca-4f10-aaca-2561316a6d62 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:04.979087 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e1f2c17-c2ca-4f10-aaca-2561316a6d62 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:04.980032 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e1f2c17-c2ca-4f10-aaca-2561316a6d62 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:04.986201 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e1f2c17-c2ca-4f10-aaca-2561316a6d62 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:04.986895 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e1f2c17-c2ca-4f10-aaca-2561316a6d62 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:05.135861 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7e1f2c17-c2ca-4f10-aaca-2561316a6d62 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:05.146291 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7e1f2c17-c2ca-4f10-aaca-2561316a6d62 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904" status: 200 len: 1280 microversion: 2.1 time: 0.189843 Oct 26 13:06:05.147633 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 539/1024] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:04 2022] GET /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904 => generated 1280 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:05.419840 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5bda6bfe-0fc6-455a-b7ce-c3d178f34025 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:05.424427 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5bda6bfe-0fc6-455a-b7ce-c3d178f34025 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 1c5d8fc5-5c9f-4bdf-81ed-388df5d390de] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:05.433766 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bda6bfe-0fc6-455a-b7ce-c3d178f34025 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:05.434662 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bda6bfe-0fc6-455a-b7ce-c3d178f34025 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:05.435269 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bda6bfe-0fc6-455a-b7ce-c3d178f34025 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:05.436235 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bda6bfe-0fc6-455a-b7ce-c3d178f34025 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:05.437213 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bda6bfe-0fc6-455a-b7ce-c3d178f34025 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:05.437783 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bda6bfe-0fc6-455a-b7ce-c3d178f34025 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:05.486672 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-52a9ac8d-41e2-4648-a50e-9e2fe7214ca8 req-e415e486-5a62-484e-8912-7e2a3341b9b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e4891a-9fbd-42b7-a12c-5a4de9c1f151", "name": "network-vif-unplugged", "status": "completed", "tag": "4bacbb43-3b81-44f6-b4ad-82bf06f609ad"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:06:05.506574 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-52a9ac8d-41e2-4648-a50e-9e2fe7214ca8 req-e415e486-5a62-484e-8912-7e2a3341b9b3 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:05.519456 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-52a9ac8d-41e2-4648-a50e-9e2fe7214ca8 req-e415e486-5a62-484e-8912-7e2a3341b9b3 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:05.520071 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-52a9ac8d-41e2-4648-a50e-9e2fe7214ca8 req-e415e486-5a62-484e-8912-7e2a3341b9b3 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:05.546336 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-52a9ac8d-41e2-4648-a50e-9e2fe7214ca8 req-e415e486-5a62-484e-8912-7e2a3341b9b3 service nova] Creating event network-vif-unplugged:4bacbb43-3b81-44f6-b4ad-82bf06f609ad for instance c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 on n-h2-862686-1 Oct 26 13:06:05.562151 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [req-52a9ac8d-41e2-4648-a50e-9e2fe7214ca8 req-e415e486-5a62-484e-8912-7e2a3341b9b3 service nova] Instance c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862686-1', 'n-h1-862686-1'} {{(pid=120598) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 13:06:05.580655 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-52a9ac8d-41e2-4648-a50e-9e2fe7214ca8 req-e415e486-5a62-484e-8912-7e2a3341b9b3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098771 Oct 26 13:06:05.587530 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 540/1025] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:06:05.672169 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5bda6bfe-0fc6-455a-b7ce-c3d178f34025 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:05.685410 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5bda6bfe-0fc6-455a-b7ce-c3d178f34025 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/1c5d8fc5-5c9f-4bdf-81ed-388df5d390de" status: 200 len: 1264 microversion: 2.1 time: 0.277303 Oct 26 13:06:05.686588 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 486/1026] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:05 2022] GET /compute/v2.1/servers/1c5d8fc5-5c9f-4bdf-81ed-388df5d390de => generated 1264 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:05.880282 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8726d6af-e35c-41cb-bf8d-62c7c5aea654 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:05.884124 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8726d6af-e35c-41cb-bf8d-62c7c5aea654 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:05.895463 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8726d6af-e35c-41cb-bf8d-62c7c5aea654 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:05.903239 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-080dec43-8d49-424d-bef6-2c9743c619cd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:05.904103 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-080dec43-8d49-424d-bef6-2c9743c619cd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 82458e75-f124-45b2-85a6-ef634b510f90] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:05.908066 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8726d6af-e35c-41cb-bf8d-62c7c5aea654 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:05.910564 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8726d6af-e35c-41cb-bf8d-62c7c5aea654 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:05.911355 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8726d6af-e35c-41cb-bf8d-62c7c5aea654 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:05.919350 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-080dec43-8d49-424d-bef6-2c9743c619cd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:05.919717 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8726d6af-e35c-41cb-bf8d-62c7c5aea654 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:05.920439 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8726d6af-e35c-41cb-bf8d-62c7c5aea654 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:05.922519 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-080dec43-8d49-424d-bef6-2c9743c619cd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:05.923122 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-080dec43-8d49-424d-bef6-2c9743c619cd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:05.924007 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-080dec43-8d49-424d-bef6-2c9743c619cd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:05.927849 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-080dec43-8d49-424d-bef6-2c9743c619cd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:05.928462 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-080dec43-8d49-424d-bef6-2c9743c619cd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:06.233329 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-080dec43-8d49-424d-bef6-2c9743c619cd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:06.250980 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-080dec43-8d49-424d-bef6-2c9743c619cd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/82458e75-f124-45b2-85a6-ef634b510f90" status: 200 len: 1274 microversion: 2.1 time: 0.351641 Oct 26 13:06:06.251817 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 487/1027] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:05 2022] GET /compute/v2.1/servers/82458e75-f124-45b2-85a6-ef634b510f90 => generated 1274 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:06:06.513833 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-09c389f8-5aec-49cc-9e6e-195031dda4e1 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1874919819", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "259bbcbd-929e-4d48-b53c-e8ded5da783d"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:06:06.630401 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-09c389f8-5aec-49cc-9e6e-195031dda4e1 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] validate_networks() for [('259bbcbd-929e-4d48-b53c-e8ded5da783d', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:06:07.060160 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8726d6af-e35c-41cb-bf8d-62c7c5aea654 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:07.097376 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8726d6af-e35c-41cb-bf8d-62c7c5aea654 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 200 len: 1542 microversion: 2.1 time: 1.217808 Oct 26 13:06:07.103330 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 541/1028] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:05 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 1542 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:07.135311 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-616bc0e5-4866-4e54-80b8-0d91a5271ec7 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:07.135934 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-616bc0e5-4866-4e54-80b8-0d91a5271ec7 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:07.156259 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-616bc0e5-4866-4e54-80b8-0d91a5271ec7 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:07.157960 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-616bc0e5-4866-4e54-80b8-0d91a5271ec7 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:07.163296 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-616bc0e5-4866-4e54-80b8-0d91a5271ec7 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:07.166394 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-616bc0e5-4866-4e54-80b8-0d91a5271ec7 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:07.167071 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-616bc0e5-4866-4e54-80b8-0d91a5271ec7 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:07.167678 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-616bc0e5-4866-4e54-80b8-0d91a5271ec7 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:07.332807 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-616bc0e5-4866-4e54-80b8-0d91a5271ec7 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:07.384616 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-616bc0e5-4866-4e54-80b8-0d91a5271ec7 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904" status: 200 len: 1280 microversion: 2.1 time: 0.245435 Oct 26 13:06:07.386158 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 542/1029] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:07 2022] GET /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904 => generated 1280 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:07.399081 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-afe5a7bd-d49c-4b7c-8539-79e5e32c35ea tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:07.400086 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-afe5a7bd-d49c-4b7c-8539-79e5e32c35ea tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 1c5d8fc5-5c9f-4bdf-81ed-388df5d390de] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:07.418588 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afe5a7bd-d49c-4b7c-8539-79e5e32c35ea tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:07.419443 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afe5a7bd-d49c-4b7c-8539-79e5e32c35ea tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:07.420087 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afe5a7bd-d49c-4b7c-8539-79e5e32c35ea tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:07.422682 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afe5a7bd-d49c-4b7c-8539-79e5e32c35ea tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:07.423373 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afe5a7bd-d49c-4b7c-8539-79e5e32c35ea tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:07.424007 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afe5a7bd-d49c-4b7c-8539-79e5e32c35ea tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:07.528495 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-afe5a7bd-d49c-4b7c-8539-79e5e32c35ea tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:07.544343 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-afe5a7bd-d49c-4b7c-8539-79e5e32c35ea tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/1c5d8fc5-5c9f-4bdf-81ed-388df5d390de" status: 200 len: 1270 microversion: 2.1 time: 0.150717 Oct 26 13:06:07.550075 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 543/1030] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:07 2022] GET /compute/v2.1/servers/1c5d8fc5-5c9f-4bdf-81ed-388df5d390de => generated 1270 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:07.580605 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-634cee50-abb9-4b58-8cae-a1b886afc49c tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:07.582298 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-634cee50-abb9-4b58-8cae-a1b886afc49c tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 82458e75-f124-45b2-85a6-ef634b510f90] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:07.591931 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-634cee50-abb9-4b58-8cae-a1b886afc49c tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:07.592779 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-634cee50-abb9-4b58-8cae-a1b886afc49c tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:07.593939 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-634cee50-abb9-4b58-8cae-a1b886afc49c tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:07.594853 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-634cee50-abb9-4b58-8cae-a1b886afc49c tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:07.595617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-634cee50-abb9-4b58-8cae-a1b886afc49c tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:07.596270 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-634cee50-abb9-4b58-8cae-a1b886afc49c tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:07.881405 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-09c389f8-5aec-49cc-9e6e-195031dda4e1 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:06:07.883073 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-09c389f8-5aec-49cc-9e6e-195031dda4e1 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:06:07.883888 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-09c389f8-5aec-49cc-9e6e-195031dda4e1 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:06:07.884774 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-09c389f8-5aec-49cc-9e6e-195031dda4e1 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:06:07.885405 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-09c389f8-5aec-49cc-9e6e-195031dda4e1 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:06:07.906050 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09c389f8-5aec-49cc-9e6e-195031dda4e1 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:07.908340 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09c389f8-5aec-49cc-9e6e-195031dda4e1 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:07.912288 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09c389f8-5aec-49cc-9e6e-195031dda4e1 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:07.916435 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09c389f8-5aec-49cc-9e6e-195031dda4e1 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:07.918448 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09c389f8-5aec-49cc-9e6e-195031dda4e1 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:07.920169 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09c389f8-5aec-49cc-9e6e-195031dda4e1 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:07.963279 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-09c389f8-5aec-49cc-9e6e-195031dda4e1 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Getting quotas for project cc4a21e57f1c4fd1ab3c60f6416f8b11. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:06:07.973343 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-09c389f8-5aec-49cc-9e6e-195031dda4e1 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Getting quotas for user e3707c34798c48d584cff9dd46d9d7c0 and project cc4a21e57f1c4fd1ab3c60f6416f8b11. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:06:07.998646 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-09c389f8-5aec-49cc-9e6e-195031dda4e1 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:06:08.008558 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-09c389f8-5aec-49cc-9e6e-195031dda4e1 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 7fc68c75-8598-4bc7-b96b-852f31f09781] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:06:08.091455 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-634cee50-abb9-4b58-8cae-a1b886afc49c tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:08.112660 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-634cee50-abb9-4b58-8cae-a1b886afc49c tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/82458e75-f124-45b2-85a6-ef634b510f90" status: 200 len: 1316 microversion: 2.1 time: 0.548998 Oct 26 13:06:08.116999 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 544/1031] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:07 2022] GET /compute/v2.1/servers/82458e75-f124-45b2-85a6-ef634b510f90 => generated 1316 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:08.134800 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-617d921b-37b6-4475-b2a4-afca976ab4d0 req-a8004cde-583d-44f6-a163-7d1b181cd552 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7e4891a-9fbd-42b7-a12c-5a4de9c1f151", "tag": "4bacbb43-3b81-44f6-b4ad-82bf06f609ad"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:06:08.152950 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-09c389f8-5aec-49cc-9e6e-195031dda4e1 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.899699 Oct 26 13:06:08.154173 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 488/1032] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:06:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1901 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:06:08.155482 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-617d921b-37b6-4475-b2a4-afca976ab4d0 req-a8004cde-583d-44f6-a163-7d1b181cd552 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:08.156192 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-617d921b-37b6-4475-b2a4-afca976ab4d0 req-a8004cde-583d-44f6-a163-7d1b181cd552 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:08.156762 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-617d921b-37b6-4475-b2a4-afca976ab4d0 req-a8004cde-583d-44f6-a163-7d1b181cd552 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:08.164655 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-66be5967-d8f9-4787-9ac6-f40be47c0542 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:08.165271 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-66be5967-d8f9-4787-9ac6-f40be47c0542 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:08.177129 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-617d921b-37b6-4475-b2a4-afca976ab4d0 req-a8004cde-583d-44f6-a163-7d1b181cd552 service nova] Creating event network-changed:4bacbb43-3b81-44f6-b4ad-82bf06f609ad for instance c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 on n-h2-862686-1 Oct 26 13:06:08.189103 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-66be5967-d8f9-4787-9ac6-f40be47c0542 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:08.189724 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-66be5967-d8f9-4787-9ac6-f40be47c0542 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:08.190101 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-66be5967-d8f9-4787-9ac6-f40be47c0542 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:08.190843 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-66be5967-d8f9-4787-9ac6-f40be47c0542 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:08.191441 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-66be5967-d8f9-4787-9ac6-f40be47c0542 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:08.191743 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-66be5967-d8f9-4787-9ac6-f40be47c0542 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:08.196317 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [req-617d921b-37b6-4475-b2a4-afca976ab4d0 req-a8004cde-583d-44f6-a163-7d1b181cd552 service nova] Instance c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862686-1', 'n-h1-862686-1'} {{(pid=120598) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 13:06:08.217075 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-617d921b-37b6-4475-b2a4-afca976ab4d0 req-a8004cde-583d-44f6-a163-7d1b181cd552 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097408 Oct 26 13:06:08.220632 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 545/1033] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:06:08.256161 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d20cc5b6-8fbc-4e3a-8583-0d159a2bd6e9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:08.257016 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d20cc5b6-8fbc-4e3a-8583-0d159a2bd6e9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 7fc68c75-8598-4bc7-b96b-852f31f09781] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:08.504147 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d20cc5b6-8fbc-4e3a-8583-0d159a2bd6e9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:08.521157 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d20cc5b6-8fbc-4e3a-8583-0d159a2bd6e9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/7fc68c75-8598-4bc7-b96b-852f31f09781" status: 200 len: 1208 microversion: 2.1 time: 0.298141 Oct 26 13:06:08.522638 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 546/1034] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:08 2022] GET /compute/v2.1/servers/7fc68c75-8598-4bc7-b96b-852f31f09781 => generated 1208 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:08.542105 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-62c7054b-3faa-4e70-8764-580e74d9ddaf tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:08.542737 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-62c7054b-3faa-4e70-8764-580e74d9ddaf tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:08.562694 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-62c7054b-3faa-4e70-8764-580e74d9ddaf tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:08.563969 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-62c7054b-3faa-4e70-8764-580e74d9ddaf tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:08.566017 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-62c7054b-3faa-4e70-8764-580e74d9ddaf tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:08.567799 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-62c7054b-3faa-4e70-8764-580e74d9ddaf tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:08.571469 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-62c7054b-3faa-4e70-8764-580e74d9ddaf tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:08.572108 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-62c7054b-3faa-4e70-8764-580e74d9ddaf tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:09.360789 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-62c7054b-3faa-4e70-8764-580e74d9ddaf tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:09.372979 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-66be5967-d8f9-4787-9ac6-f40be47c0542 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:09.386271 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-62c7054b-3faa-4e70-8764-580e74d9ddaf tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904" status: 200 len: 1322 microversion: 2.1 time: 0.859932 Oct 26 13:06:09.388837 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 547/1035] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:08 2022] GET /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904 => generated 1322 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:09.400751 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ec988856-05f6-47df-9fa5-69be22ae6248 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:09.407790 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ec988856-05f6-47df-9fa5-69be22ae6248 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 1c5d8fc5-5c9f-4bdf-81ed-388df5d390de] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:09.409844 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-66be5967-d8f9-4787-9ac6-f40be47c0542 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 200 len: 1542 microversion: 2.1 time: 1.251937 Oct 26 13:06:09.412431 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 489/1036] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:08 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 1542 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:09.417225 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec988856-05f6-47df-9fa5-69be22ae6248 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:09.418056 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec988856-05f6-47df-9fa5-69be22ae6248 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:09.418790 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec988856-05f6-47df-9fa5-69be22ae6248 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:09.419694 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec988856-05f6-47df-9fa5-69be22ae6248 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:09.420313 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec988856-05f6-47df-9fa5-69be22ae6248 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:09.420994 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec988856-05f6-47df-9fa5-69be22ae6248 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:09.438148 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d8a59fea-835e-4b13-ab8e-3ff2032dcbaa tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:09.441513 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d8a59fea-835e-4b13-ab8e-3ff2032dcbaa tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 82458e75-f124-45b2-85a6-ef634b510f90] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:09.457999 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8a59fea-835e-4b13-ab8e-3ff2032dcbaa tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:09.458949 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8a59fea-835e-4b13-ab8e-3ff2032dcbaa tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:09.459668 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8a59fea-835e-4b13-ab8e-3ff2032dcbaa tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:09.461670 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8a59fea-835e-4b13-ab8e-3ff2032dcbaa tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:09.462558 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8a59fea-835e-4b13-ab8e-3ff2032dcbaa tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:09.463222 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8a59fea-835e-4b13-ab8e-3ff2032dcbaa tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:09.952009 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ec988856-05f6-47df-9fa5-69be22ae6248 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:09.967552 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ec988856-05f6-47df-9fa5-69be22ae6248 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/1c5d8fc5-5c9f-4bdf-81ed-388df5d390de" status: 200 len: 1312 microversion: 2.1 time: 0.576737 Oct 26 13:06:09.992474 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 548/1037] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:09 2022] GET /compute/v2.1/servers/1c5d8fc5-5c9f-4bdf-81ed-388df5d390de => generated 1312 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:10.004359 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0f39e0fd-c027-48c4-9062-bbf945252cc7 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:10.005855 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0f39e0fd-c027-48c4-9062-bbf945252cc7 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 7fc68c75-8598-4bc7-b96b-852f31f09781] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:10.032617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f39e0fd-c027-48c4-9062-bbf945252cc7 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:10.033321 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f39e0fd-c027-48c4-9062-bbf945252cc7 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:10.034690 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f39e0fd-c027-48c4-9062-bbf945252cc7 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:10.035731 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f39e0fd-c027-48c4-9062-bbf945252cc7 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:10.036410 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f39e0fd-c027-48c4-9062-bbf945252cc7 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:10.043928 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f39e0fd-c027-48c4-9062-bbf945252cc7 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:10.161625 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d8a59fea-835e-4b13-ab8e-3ff2032dcbaa tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:10.172911 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d8a59fea-835e-4b13-ab8e-3ff2032dcbaa tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/82458e75-f124-45b2-85a6-ef634b510f90" status: 200 len: 1316 microversion: 2.1 time: 0.756259 Oct 26 13:06:10.174827 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 490/1038] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:09 2022] GET /compute/v2.1/servers/82458e75-f124-45b2-85a6-ef634b510f90 => generated 1316 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:10.187216 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a8fb8414-f65b-4f83-94d5-e0b2c27fbfe5 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:10.188644 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a8fb8414-f65b-4f83-94d5-e0b2c27fbfe5 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:10.200965 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8fb8414-f65b-4f83-94d5-e0b2c27fbfe5 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:10.201784 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8fb8414-f65b-4f83-94d5-e0b2c27fbfe5 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:10.202510 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8fb8414-f65b-4f83-94d5-e0b2c27fbfe5 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:10.203456 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8fb8414-f65b-4f83-94d5-e0b2c27fbfe5 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:10.204154 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8fb8414-f65b-4f83-94d5-e0b2c27fbfe5 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:10.204820 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8fb8414-f65b-4f83-94d5-e0b2c27fbfe5 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:10.247155 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0f39e0fd-c027-48c4-9062-bbf945252cc7 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:10.261396 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0f39e0fd-c027-48c4-9062-bbf945252cc7 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/7fc68c75-8598-4bc7-b96b-852f31f09781" status: 200 len: 1260 microversion: 2.1 time: 0.264416 Oct 26 13:06:10.266793 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 549/1039] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:09 2022] GET /compute/v2.1/servers/7fc68c75-8598-4bc7-b96b-852f31f09781 => generated 1260 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:10.426823 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b124bd27-4fa3-40b0-8b74-99b956b9c0f0 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:10.430720 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b124bd27-4fa3-40b0-8b74-99b956b9c0f0 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:10.440603 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b124bd27-4fa3-40b0-8b74-99b956b9c0f0 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:10.441599 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b124bd27-4fa3-40b0-8b74-99b956b9c0f0 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:10.442447 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b124bd27-4fa3-40b0-8b74-99b956b9c0f0 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:10.443947 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b124bd27-4fa3-40b0-8b74-99b956b9c0f0 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:10.445019 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b124bd27-4fa3-40b0-8b74-99b956b9c0f0 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:10.445815 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b124bd27-4fa3-40b0-8b74-99b956b9c0f0 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:10.796594 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-a8fb8414-f65b-4f83-94d5-e0b2c27fbfe5 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lazy-loading 'services' on Instance uuid f27f0232-1c7a-433d-a8ed-9ef4f631b924 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:06:10.825168 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a8fb8414-f65b-4f83-94d5-e0b2c27fbfe5 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924" status: 200 len: 2342 microversion: 2.25 time: 0.643833 Oct 26 13:06:10.832443 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 491/1040] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:06:10 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 => generated 2342 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:06:10.838512 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7ed96e81-0c82-4a0a-9dea-dcd43bed8b48 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:10.839132 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7ed96e81-0c82-4a0a-9dea-dcd43bed8b48 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:10.855734 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ed96e81-0c82-4a0a-9dea-dcd43bed8b48 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:10.856675 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ed96e81-0c82-4a0a-9dea-dcd43bed8b48 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:10.857331 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ed96e81-0c82-4a0a-9dea-dcd43bed8b48 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:10.859661 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ed96e81-0c82-4a0a-9dea-dcd43bed8b48 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:10.860368 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ed96e81-0c82-4a0a-9dea-dcd43bed8b48 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:10.861261 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ed96e81-0c82-4a0a-9dea-dcd43bed8b48 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:11.047149 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b124bd27-4fa3-40b0-8b74-99b956b9c0f0 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:11.056623 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b124bd27-4fa3-40b0-8b74-99b956b9c0f0 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904" status: 200 len: 1322 microversion: 2.1 time: 0.637852 Oct 26 13:06:11.070453 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 550/1041] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:10 2022] GET /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904 => generated 1322 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:11.079112 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-398fd2ec-af89-4d07-852c-0dcf9d12a117 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:11.083902 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-398fd2ec-af89-4d07-852c-0dcf9d12a117 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:11.084599 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-398fd2ec-af89-4d07-852c-0dcf9d12a117 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:11.085898 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-398fd2ec-af89-4d07-852c-0dcf9d12a117 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:11.087011 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-398fd2ec-af89-4d07-852c-0dcf9d12a117 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:11.087664 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-398fd2ec-af89-4d07-852c-0dcf9d12a117 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:11.088257 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-398fd2ec-af89-4d07-852c-0dcf9d12a117 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:11.093938 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:06:11.120423 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-398fd2ec-af89-4d07-852c-0dcf9d12a117 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.048439 Oct 26 13:06:11.121368 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 551/1042] 10.222.0.40 () {60 vars in 1217 bytes} [Wed Oct 26 13:06:11 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:06:11.126533 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fab0db15-6dda-427c-8947-afb7ed1a4965 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:11.127448 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fab0db15-6dda-427c-8947-afb7ed1a4965 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 1c5d8fc5-5c9f-4bdf-81ed-388df5d390de] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:11.134144 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:06:11.136221 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fab0db15-6dda-427c-8947-afb7ed1a4965 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:11.136940 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fab0db15-6dda-427c-8947-afb7ed1a4965 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:11.137902 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fab0db15-6dda-427c-8947-afb7ed1a4965 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:11.139092 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fab0db15-6dda-427c-8947-afb7ed1a4965 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:11.139757 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fab0db15-6dda-427c-8947-afb7ed1a4965 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:11.140893 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fab0db15-6dda-427c-8947-afb7ed1a4965 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:11.643076 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7ed96e81-0c82-4a0a-9dea-dcd43bed8b48 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:11.665068 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7ed96e81-0c82-4a0a-9dea-dcd43bed8b48 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 200 len: 1474 microversion: 2.1 time: 0.828918 Oct 26 13:06:11.666814 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 492/1043] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:10 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 1474 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:11.694296 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a7e83dda-0b3e-4188-ba49-c89c741f9d88 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:11.696746 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a7e83dda-0b3e-4188-ba49-c89c741f9d88 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 82458e75-f124-45b2-85a6-ef634b510f90] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:11.717022 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7e83dda-0b3e-4188-ba49-c89c741f9d88 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:11.719254 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7e83dda-0b3e-4188-ba49-c89c741f9d88 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:11.723122 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7e83dda-0b3e-4188-ba49-c89c741f9d88 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:11.723876 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7e83dda-0b3e-4188-ba49-c89c741f9d88 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:11.724344 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7e83dda-0b3e-4188-ba49-c89c741f9d88 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:11.724769 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7e83dda-0b3e-4188-ba49-c89c741f9d88 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:12.147410 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fab0db15-6dda-427c-8947-afb7ed1a4965 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:12.157420 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fab0db15-6dda-427c-8947-afb7ed1a4965 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/1c5d8fc5-5c9f-4bdf-81ed-388df5d390de" status: 200 len: 1312 microversion: 2.1 time: 1.034715 Oct 26 13:06:12.166407 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 552/1044] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:11 2022] GET /compute/v2.1/servers/1c5d8fc5-5c9f-4bdf-81ed-388df5d390de => generated 1312 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:12.176732 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7ef52d98-668b-4816-baad-b575fe95d525 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:12.180690 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7ef52d98-668b-4816-baad-b575fe95d525 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 7fc68c75-8598-4bc7-b96b-852f31f09781] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:12.192207 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ef52d98-668b-4816-baad-b575fe95d525 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:12.192706 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ef52d98-668b-4816-baad-b575fe95d525 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:12.193145 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ef52d98-668b-4816-baad-b575fe95d525 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:12.193899 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ef52d98-668b-4816-baad-b575fe95d525 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:12.194389 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ef52d98-668b-4816-baad-b575fe95d525 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:12.195020 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ef52d98-668b-4816-baad-b575fe95d525 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:12.337100 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7ef52d98-668b-4816-baad-b575fe95d525 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:12.350467 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7ef52d98-668b-4816-baad-b575fe95d525 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/7fc68c75-8598-4bc7-b96b-852f31f09781" status: 200 len: 1266 microversion: 2.1 time: 0.182605 Oct 26 13:06:12.355474 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 553/1045] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:12 2022] GET /compute/v2.1/servers/7fc68c75-8598-4bc7-b96b-852f31f09781 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:12.374315 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-b591f463-ac1a-4cf8-bee8-94293d1cb121 req-0a7cb9fc-4083-4002-b6e5-e6db4cd81f8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82458e75-f124-45b2-85a6-ef634b510f90", "tag": "126ff158-9c5b-4927-8421-7373016ebb59"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:06:12.393061 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b591f463-ac1a-4cf8-bee8-94293d1cb121 req-0a7cb9fc-4083-4002-b6e5-e6db4cd81f8c service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:12.393737 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b591f463-ac1a-4cf8-bee8-94293d1cb121 req-0a7cb9fc-4083-4002-b6e5-e6db4cd81f8c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:12.394294 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b591f463-ac1a-4cf8-bee8-94293d1cb121 req-0a7cb9fc-4083-4002-b6e5-e6db4cd81f8c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:12.411331 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-b591f463-ac1a-4cf8-bee8-94293d1cb121 req-0a7cb9fc-4083-4002-b6e5-e6db4cd81f8c service nova] Creating event network-changed:126ff158-9c5b-4927-8421-7373016ebb59 for instance 82458e75-f124-45b2-85a6-ef634b510f90 on n-h2-862686-1 Oct 26 13:06:12.417803 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-b591f463-ac1a-4cf8-bee8-94293d1cb121 req-0a7cb9fc-4083-4002-b6e5-e6db4cd81f8c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060273 Oct 26 13:06:12.418501 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 554/1046] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:06:12.429893 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-89007ada-4ba3-4ec8-8517-2bb8b112d69e tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:12.431094 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-89007ada-4ba3-4ec8-8517-2bb8b112d69e tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:12.439966 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-89007ada-4ba3-4ec8-8517-2bb8b112d69e tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:12.440825 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-89007ada-4ba3-4ec8-8517-2bb8b112d69e tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:12.441612 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-89007ada-4ba3-4ec8-8517-2bb8b112d69e tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:12.442903 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-89007ada-4ba3-4ec8-8517-2bb8b112d69e tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:12.443805 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-89007ada-4ba3-4ec8-8517-2bb8b112d69e tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:12.444431 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-89007ada-4ba3-4ec8-8517-2bb8b112d69e tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:12.713855 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a7e83dda-0b3e-4188-ba49-c89c741f9d88 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:12.718767 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:06:12.730220 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a7e83dda-0b3e-4188-ba49-c89c741f9d88 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/82458e75-f124-45b2-85a6-ef634b510f90" status: 200 len: 1316 microversion: 2.1 time: 1.035790 Oct 26 13:06:12.731365 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 493/1047] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:11 2022] GET /compute/v2.1/servers/82458e75-f124-45b2-85a6-ef634b510f90 => generated 1316 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:12.741061 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1589353b-5305-4398-886b-b9b023db1d09 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:12.750367 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1589353b-5305-4398-886b-b9b023db1d09 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:12.759432 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1589353b-5305-4398-886b-b9b023db1d09 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:12.763098 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1589353b-5305-4398-886b-b9b023db1d09 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:12.763721 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1589353b-5305-4398-886b-b9b023db1d09 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:12.764600 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1589353b-5305-4398-886b-b9b023db1d09 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:12.766036 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1589353b-5305-4398-886b-b9b023db1d09 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:12.767870 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1589353b-5305-4398-886b-b9b023db1d09 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:13.201246 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-89007ada-4ba3-4ec8-8517-2bb8b112d69e tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:13.209340 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-89007ada-4ba3-4ec8-8517-2bb8b112d69e tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904" status: 200 len: 1322 microversion: 2.1 time: 0.789231 Oct 26 13:06:13.213356 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 555/1048] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:12 2022] GET /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904 => generated 1322 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:13.230605 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0fe40626-be3d-4391-9a32-df7b19172646 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:13.231567 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0fe40626-be3d-4391-9a32-df7b19172646 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 1c5d8fc5-5c9f-4bdf-81ed-388df5d390de] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:13.247539 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0fe40626-be3d-4391-9a32-df7b19172646 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:13.248112 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0fe40626-be3d-4391-9a32-df7b19172646 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:13.249044 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0fe40626-be3d-4391-9a32-df7b19172646 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:13.250123 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0fe40626-be3d-4391-9a32-df7b19172646 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:13.252044 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0fe40626-be3d-4391-9a32-df7b19172646 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:13.253823 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0fe40626-be3d-4391-9a32-df7b19172646 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:13.961104 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0fe40626-be3d-4391-9a32-df7b19172646 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:13.971288 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0fe40626-be3d-4391-9a32-df7b19172646 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/1c5d8fc5-5c9f-4bdf-81ed-388df5d390de" status: 200 len: 1312 microversion: 2.1 time: 0.755906 Oct 26 13:06:13.971858 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 556/1049] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:13 2022] GET /compute/v2.1/servers/1c5d8fc5-5c9f-4bdf-81ed-388df5d390de => generated 1312 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:14.005173 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-09854ac7-9b1f-4870-a70c-72d94e1e6fbf tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:14.005822 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-09854ac7-9b1f-4870-a70c-72d94e1e6fbf tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 7fc68c75-8598-4bc7-b96b-852f31f09781] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:14.020564 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-09854ac7-9b1f-4870-a70c-72d94e1e6fbf tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:14.021063 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-09854ac7-9b1f-4870-a70c-72d94e1e6fbf tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:14.021521 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-09854ac7-9b1f-4870-a70c-72d94e1e6fbf tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:14.022241 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-09854ac7-9b1f-4870-a70c-72d94e1e6fbf tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:14.023294 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-09854ac7-9b1f-4870-a70c-72d94e1e6fbf tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:14.023702 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-09854ac7-9b1f-4870-a70c-72d94e1e6fbf tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:14.356446 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-09854ac7-9b1f-4870-a70c-72d94e1e6fbf tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:14.372000 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-09854ac7-9b1f-4870-a70c-72d94e1e6fbf tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/7fc68c75-8598-4bc7-b96b-852f31f09781" status: 200 len: 1308 microversion: 2.1 time: 0.383699 Oct 26 13:06:14.373476 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 557/1050] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:13 2022] GET /compute/v2.1/servers/7fc68c75-8598-4bc7-b96b-852f31f09781 => generated 1308 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:14.383165 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3d0b3781-83e3-4548-a1f9-947a2b3de1a6 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:14.385110 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3d0b3781-83e3-4548-a1f9-947a2b3de1a6 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 82458e75-f124-45b2-85a6-ef634b510f90] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:14.403134 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3d0b3781-83e3-4548-a1f9-947a2b3de1a6 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:14.404742 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3d0b3781-83e3-4548-a1f9-947a2b3de1a6 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:14.408527 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3d0b3781-83e3-4548-a1f9-947a2b3de1a6 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:14.409511 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3d0b3781-83e3-4548-a1f9-947a2b3de1a6 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:14.410139 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3d0b3781-83e3-4548-a1f9-947a2b3de1a6 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:14.411603 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3d0b3781-83e3-4548-a1f9-947a2b3de1a6 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:14.434666 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1589353b-5305-4398-886b-b9b023db1d09 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:14.445135 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1589353b-5305-4398-886b-b9b023db1d09 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 200 len: 1471 microversion: 2.1 time: 1.710858 Oct 26 13:06:14.448365 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 494/1051] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:12 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 1471 bytes in 1716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:14.466589 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f2ca68c7-5774-41b9-928b-47ab6477724f tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:14.467569 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f2ca68c7-5774-41b9-928b-47ab6477724f tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:14.480255 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2ca68c7-5774-41b9-928b-47ab6477724f tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:14.482623 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2ca68c7-5774-41b9-928b-47ab6477724f tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:14.483502 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2ca68c7-5774-41b9-928b-47ab6477724f tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:14.484504 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2ca68c7-5774-41b9-928b-47ab6477724f tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:14.487521 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2ca68c7-5774-41b9-928b-47ab6477724f tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:14.488284 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2ca68c7-5774-41b9-928b-47ab6477724f tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:14.810929 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3d0b3781-83e3-4548-a1f9-947a2b3de1a6 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:14.823216 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3d0b3781-83e3-4548-a1f9-947a2b3de1a6 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/82458e75-f124-45b2-85a6-ef634b510f90" status: 200 len: 1316 microversion: 2.1 time: 0.446896 Oct 26 13:06:14.824098 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 558/1052] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:14 2022] GET /compute/v2.1/servers/82458e75-f124-45b2-85a6-ef634b510f90 => generated 1316 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:14.833318 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-68a5817a-55a4-4763-9ce1-976963ff7e71 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:06:14.842396 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-68a5817a-55a4-4763-9ce1-976963ff7e71 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:14.848863 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68a5817a-55a4-4763-9ce1-976963ff7e71 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:14.849741 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68a5817a-55a4-4763-9ce1-976963ff7e71 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:14.850361 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68a5817a-55a4-4763-9ce1-976963ff7e71 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:14.854473 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68a5817a-55a4-4763-9ce1-976963ff7e71 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:14.855183 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68a5817a-55a4-4763-9ce1-976963ff7e71 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:14.855903 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68a5817a-55a4-4763-9ce1-976963ff7e71 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:14.926909 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68a5817a-55a4-4763-9ce1-976963ff7e71 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:14.927629 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68a5817a-55a4-4763-9ce1-976963ff7e71 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:14.928327 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68a5817a-55a4-4763-9ce1-976963ff7e71 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:14.929830 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68a5817a-55a4-4763-9ce1-976963ff7e71 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:14.931018 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68a5817a-55a4-4763-9ce1-976963ff7e71 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:14.933079 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68a5817a-55a4-4763-9ce1-976963ff7e71 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:14.994071 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-68a5817a-55a4-4763-9ce1-976963ff7e71 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Getting quotas for project 443f71d3ffde486b9072df264fea2f53. Resources: {'cores', 'ram'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:06:15.005750 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-68a5817a-55a4-4763-9ce1-976963ff7e71 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Getting quotas for user 03335593029b48dfb19fc9cdf6b382b0 and project 443f71d3ffde486b9072df264fea2f53. Resources: {'cores', 'ram'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:06:15.167100 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-68a5817a-55a4-4763-9ce1-976963ff7e71 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "POST /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151/action" status: 202 len: 0 microversion: 2.1 time: 0.340883 Oct 26 13:06:15.168452 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 559/1053] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:06:14 2022] POST /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:06:15.175097 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-c27f2d36-bd12-437f-8b4f-4c2230668397 req-786852a6-ad8f-446a-8efe-a7230fd35a7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c5d8fc5-5c9f-4bdf-81ed-388df5d390de", "tag": "0d36d4e3-ddc6-4dfc-bf9d-2290d107fddf"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:06:15.188991 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-c27f2d36-bd12-437f-8b4f-4c2230668397 req-786852a6-ad8f-446a-8efe-a7230fd35a7e service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:15.189803 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-c27f2d36-bd12-437f-8b4f-4c2230668397 req-786852a6-ad8f-446a-8efe-a7230fd35a7e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:15.190482 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-c27f2d36-bd12-437f-8b4f-4c2230668397 req-786852a6-ad8f-446a-8efe-a7230fd35a7e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:15.209030 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-c27f2d36-bd12-437f-8b4f-4c2230668397 req-786852a6-ad8f-446a-8efe-a7230fd35a7e service nova] Creating event network-changed:0d36d4e3-ddc6-4dfc-bf9d-2290d107fddf for instance 1c5d8fc5-5c9f-4bdf-81ed-388df5d390de on n-h2-862686-1 Oct 26 13:06:15.216143 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-c27f2d36-bd12-437f-8b4f-4c2230668397 req-786852a6-ad8f-446a-8efe-a7230fd35a7e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045513 Oct 26 13:06:15.218082 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 560/1054] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:06:15.226128 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-32e8d06b-c9e0-492c-abfb-096c093edc63 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:15.227389 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-32e8d06b-c9e0-492c-abfb-096c093edc63 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 1c5d8fc5-5c9f-4bdf-81ed-388df5d390de] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:15.235333 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32e8d06b-c9e0-492c-abfb-096c093edc63 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:15.236357 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32e8d06b-c9e0-492c-abfb-096c093edc63 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:15.236956 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32e8d06b-c9e0-492c-abfb-096c093edc63 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:15.237869 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32e8d06b-c9e0-492c-abfb-096c093edc63 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:15.238847 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32e8d06b-c9e0-492c-abfb-096c093edc63 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:15.239624 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32e8d06b-c9e0-492c-abfb-096c093edc63 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:15.241873 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f2ca68c7-5774-41b9-928b-47ab6477724f tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:15.250884 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f2ca68c7-5774-41b9-928b-47ab6477724f tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904" status: 200 len: 1322 microversion: 2.1 time: 0.799777 Oct 26 13:06:15.251475 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 495/1055] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:14 2022] GET /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904 => generated 1322 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:15.270340 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b594c639-f9bf-4cdc-82fd-b44711a903e8 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:15.271410 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b594c639-f9bf-4cdc-82fd-b44711a903e8 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:15.277623 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:06:15.280313 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b594c639-f9bf-4cdc-82fd-b44711a903e8 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:15.281423 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b594c639-f9bf-4cdc-82fd-b44711a903e8 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:15.282505 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b594c639-f9bf-4cdc-82fd-b44711a903e8 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:15.283424 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b594c639-f9bf-4cdc-82fd-b44711a903e8 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:15.284047 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b594c639-f9bf-4cdc-82fd-b44711a903e8 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:15.285226 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b594c639-f9bf-4cdc-82fd-b44711a903e8 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:15.443140 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-32e8d06b-c9e0-492c-abfb-096c093edc63 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:15.453700 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-32e8d06b-c9e0-492c-abfb-096c093edc63 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/1c5d8fc5-5c9f-4bdf-81ed-388df5d390de" status: 200 len: 1312 microversion: 2.1 time: 0.233725 Oct 26 13:06:15.454881 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 561/1056] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:15 2022] GET /compute/v2.1/servers/1c5d8fc5-5c9f-4bdf-81ed-388df5d390de => generated 1312 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:15.459709 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-ba8ed497-88c1-4a86-9467-b956bd9d7762 req-ccd00acd-da04-41ae-b283-547ee364053b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904", "tag": "972c68b8-19ba-4672-b7a7-ab578f54935e"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:06:15.471030 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ba8ed497-88c1-4a86-9467-b956bd9d7762 req-ccd00acd-da04-41ae-b283-547ee364053b service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:15.471655 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ba8ed497-88c1-4a86-9467-b956bd9d7762 req-ccd00acd-da04-41ae-b283-547ee364053b service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:15.472088 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ba8ed497-88c1-4a86-9467-b956bd9d7762 req-ccd00acd-da04-41ae-b283-547ee364053b service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:15.484815 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-ba8ed497-88c1-4a86-9467-b956bd9d7762 req-ccd00acd-da04-41ae-b283-547ee364053b service nova] Creating event network-changed:972c68b8-19ba-4672-b7a7-ab578f54935e for instance cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904 on n-h1-862686-1 Oct 26 13:06:15.490105 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-ba8ed497-88c1-4a86-9467-b956bd9d7762 req-ccd00acd-da04-41ae-b283-547ee364053b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034060 Oct 26 13:06:15.490817 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 562/1057] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:06:15.496312 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-16e35d3c-e169-4098-a496-6fd62c92768a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:15.497007 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-16e35d3c-e169-4098-a496-6fd62c92768a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 7fc68c75-8598-4bc7-b96b-852f31f09781] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:15.503579 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-16e35d3c-e169-4098-a496-6fd62c92768a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:15.504064 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-16e35d3c-e169-4098-a496-6fd62c92768a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:15.504506 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-16e35d3c-e169-4098-a496-6fd62c92768a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:15.505832 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-16e35d3c-e169-4098-a496-6fd62c92768a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:15.506294 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-16e35d3c-e169-4098-a496-6fd62c92768a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:15.506718 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-16e35d3c-e169-4098-a496-6fd62c92768a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:15.836332 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b594c639-f9bf-4cdc-82fd-b44711a903e8 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:15.845510 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b594c639-f9bf-4cdc-82fd-b44711a903e8 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 200 len: 1470 microversion: 2.1 time: 0.587552 Oct 26 13:06:15.846664 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 496/1058] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:15 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 1470 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:15.852890 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-006a4d76-8469-4fbb-9a9d-3e1cfd0728df tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "908e94f8-4c16-493e-820c-9c80a226a206", "device": "/dev/xvdb"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:06:15.856313 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-006a4d76-8469-4fbb-9a9d-3e1cfd0728df tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:15.865405 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-006a4d76-8469-4fbb-9a9d-3e1cfd0728df tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:15.866945 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-006a4d76-8469-4fbb-9a9d-3e1cfd0728df tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:15.867627 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-006a4d76-8469-4fbb-9a9d-3e1cfd0728df tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:15.869028 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-006a4d76-8469-4fbb-9a9d-3e1cfd0728df tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:15.869741 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-006a4d76-8469-4fbb-9a9d-3e1cfd0728df tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:15.870436 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-006a4d76-8469-4fbb-9a9d-3e1cfd0728df tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:16.109471 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-16e35d3c-e169-4098-a496-6fd62c92768a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:16.120015 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-16e35d3c-e169-4098-a496-6fd62c92768a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/7fc68c75-8598-4bc7-b96b-852f31f09781" status: 200 len: 1308 microversion: 2.1 time: 0.627878 Oct 26 13:06:16.122878 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 563/1059] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:15 2022] GET /compute/v2.1/servers/7fc68c75-8598-4bc7-b96b-852f31f09781 => generated 1308 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:16.137882 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-60ae4950-30ce-4a82-bb5c-d19efa9b8a69 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:16.138522 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-60ae4950-30ce-4a82-bb5c-d19efa9b8a69 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 82458e75-f124-45b2-85a6-ef634b510f90] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:16.147219 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-60ae4950-30ce-4a82-bb5c-d19efa9b8a69 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:16.148342 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-60ae4950-30ce-4a82-bb5c-d19efa9b8a69 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:16.154670 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-60ae4950-30ce-4a82-bb5c-d19efa9b8a69 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:16.155426 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-60ae4950-30ce-4a82-bb5c-d19efa9b8a69 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:16.159040 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-60ae4950-30ce-4a82-bb5c-d19efa9b8a69 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:16.159624 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-60ae4950-30ce-4a82-bb5c-d19efa9b8a69 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:16.563701 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-006a4d76-8469-4fbb-9a9d-3e1cfd0728df tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "POST /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.714590 Oct 26 13:06:16.564597 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 497/1060] 10.222.0.40 () {62 vars in 1364 bytes} [Wed Oct 26 13:06:15 2022] POST /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924/os-volume_attachments => generated 194 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:06:16.592999 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b4a70c17-9ca0-4386-97ba-ece1cc73ecce tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:16.597959 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b4a70c17-9ca0-4386-97ba-ece1cc73ecce tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:16.624476 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b4a70c17-9ca0-4386-97ba-ece1cc73ecce tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:16.624966 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b4a70c17-9ca0-4386-97ba-ece1cc73ecce tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:16.625411 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b4a70c17-9ca0-4386-97ba-ece1cc73ecce tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:16.630544 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b4a70c17-9ca0-4386-97ba-ece1cc73ecce tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:16.632557 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b4a70c17-9ca0-4386-97ba-ece1cc73ecce tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:16.632894 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b4a70c17-9ca0-4386-97ba-ece1cc73ecce tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:17.007647 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-60ae4950-30ce-4a82-bb5c-d19efa9b8a69 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:17.019724 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-60ae4950-30ce-4a82-bb5c-d19efa9b8a69 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/82458e75-f124-45b2-85a6-ef634b510f90" status: 200 len: 1316 microversion: 2.1 time: 0.895541 Oct 26 13:06:17.025266 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 564/1061] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:16 2022] GET /compute/v2.1/servers/82458e75-f124-45b2-85a6-ef634b510f90 => generated 1316 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:17.045907 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-79c3ea69-7921-4102-8d60-ec6e1321d776 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:17.046935 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-79c3ea69-7921-4102-8d60-ec6e1321d776 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 1c5d8fc5-5c9f-4bdf-81ed-388df5d390de] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:17.059705 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-79c3ea69-7921-4102-8d60-ec6e1321d776 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:17.060588 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-79c3ea69-7921-4102-8d60-ec6e1321d776 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:17.062166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-79c3ea69-7921-4102-8d60-ec6e1321d776 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:17.063144 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-79c3ea69-7921-4102-8d60-ec6e1321d776 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:17.066794 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-79c3ea69-7921-4102-8d60-ec6e1321d776 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:17.068896 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-79c3ea69-7921-4102-8d60-ec6e1321d776 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:17.185122 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b4a70c17-9ca0-4386-97ba-ece1cc73ecce tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:17.219473 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b4a70c17-9ca0-4386-97ba-ece1cc73ecce tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904" status: 200 len: 1322 microversion: 2.1 time: 0.646261 Oct 26 13:06:17.221178 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 498/1062] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:16 2022] GET /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904 => generated 1322 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:17.226744 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-3d723656-c15c-46ad-9c1f-6074b7a77312 req-a877f11a-14bf-4256-b171-b98235a63ea2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e4891a-9fbd-42b7-a12c-5a4de9c1f151", "name": "network-vif-plugged", "status": "completed", "tag": "4bacbb43-3b81-44f6-b4ad-82bf06f609ad"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:06:17.255719 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-3d723656-c15c-46ad-9c1f-6074b7a77312 req-a877f11a-14bf-4256-b171-b98235a63ea2 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:17.256286 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-3d723656-c15c-46ad-9c1f-6074b7a77312 req-a877f11a-14bf-4256-b171-b98235a63ea2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:17.257579 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-3d723656-c15c-46ad-9c1f-6074b7a77312 req-a877f11a-14bf-4256-b171-b98235a63ea2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:17.284839 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-3d723656-c15c-46ad-9c1f-6074b7a77312 req-a877f11a-14bf-4256-b171-b98235a63ea2 service nova] Creating event network-vif-plugged:4bacbb43-3b81-44f6-b4ad-82bf06f609ad for instance c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 on n-h2-862686-1 Oct 26 13:06:17.298744 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [req-3d723656-c15c-46ad-9c1f-6074b7a77312 req-a877f11a-14bf-4256-b171-b98235a63ea2 service nova] Instance c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862686-1', 'n-h1-862686-1'} {{(pid=120597) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 13:06:17.323898 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-3d723656-c15c-46ad-9c1f-6074b7a77312 req-a877f11a-14bf-4256-b171-b98235a63ea2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101311 Oct 26 13:06:17.324508 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 499/1063] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:06:17.331450 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8ec4ddfd-f3fa-4c52-9818-9b9de75601c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:17.332517 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8ec4ddfd-f3fa-4c52-9818-9b9de75601c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:17.339119 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8ec4ddfd-f3fa-4c52-9818-9b9de75601c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:17.340114 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8ec4ddfd-f3fa-4c52-9818-9b9de75601c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:17.340717 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8ec4ddfd-f3fa-4c52-9818-9b9de75601c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:17.341620 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8ec4ddfd-f3fa-4c52-9818-9b9de75601c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:17.342256 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8ec4ddfd-f3fa-4c52-9818-9b9de75601c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:17.342991 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8ec4ddfd-f3fa-4c52-9818-9b9de75601c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:17.462736 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-79c3ea69-7921-4102-8d60-ec6e1321d776 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:17.479398 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-79c3ea69-7921-4102-8d60-ec6e1321d776 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/1c5d8fc5-5c9f-4bdf-81ed-388df5d390de" status: 200 len: 1312 microversion: 2.1 time: 0.452625 Oct 26 13:06:17.480537 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 565/1064] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:17 2022] GET /compute/v2.1/servers/1c5d8fc5-5c9f-4bdf-81ed-388df5d390de => generated 1312 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:17.489357 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fa6d26a8-489a-4f17-9757-1e86fc9b01fd tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:17.494242 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fa6d26a8-489a-4f17-9757-1e86fc9b01fd tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 7fc68c75-8598-4bc7-b96b-852f31f09781] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:17.508838 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa6d26a8-489a-4f17-9757-1e86fc9b01fd tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:17.510354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa6d26a8-489a-4f17-9757-1e86fc9b01fd tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:17.511001 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa6d26a8-489a-4f17-9757-1e86fc9b01fd tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:17.512047 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa6d26a8-489a-4f17-9757-1e86fc9b01fd tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:17.512859 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa6d26a8-489a-4f17-9757-1e86fc9b01fd tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:17.513508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa6d26a8-489a-4f17-9757-1e86fc9b01fd tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:17.846969 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8ec4ddfd-f3fa-4c52-9818-9b9de75601c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:17.856091 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8ec4ddfd-f3fa-4c52-9818-9b9de75601c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 200 len: 1470 microversion: 2.1 time: 0.529839 Oct 26 13:06:17.877945 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 500/1065] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:17 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 1470 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:17.886792 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-77786dcd-0f21-4885-8e30-ad2b8ed4adf3 req-fc3e47c5-6da6-4c0b-9289-d67e068558f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fc68c75-8598-4bc7-b96b-852f31f09781", "tag": "641e149d-ea99-4cba-8bd0-b9368f1e4296"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:06:17.896877 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-77786dcd-0f21-4885-8e30-ad2b8ed4adf3 req-fc3e47c5-6da6-4c0b-9289-d67e068558f7 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:17.898405 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-77786dcd-0f21-4885-8e30-ad2b8ed4adf3 req-fc3e47c5-6da6-4c0b-9289-d67e068558f7 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:17.899255 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-77786dcd-0f21-4885-8e30-ad2b8ed4adf3 req-fc3e47c5-6da6-4c0b-9289-d67e068558f7 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:17.911077 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-77786dcd-0f21-4885-8e30-ad2b8ed4adf3 req-fc3e47c5-6da6-4c0b-9289-d67e068558f7 service nova] Creating event network-changed:641e149d-ea99-4cba-8bd0-b9368f1e4296 for instance 7fc68c75-8598-4bc7-b96b-852f31f09781 on n-h1-862686-1 Oct 26 13:06:17.916811 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-77786dcd-0f21-4885-8e30-ad2b8ed4adf3 req-fc3e47c5-6da6-4c0b-9289-d67e068558f7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037120 Oct 26 13:06:17.918321 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 501/1066] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:06:18.051832 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5c3f9d4f-80e2-4c38-a83a-c2b00048cbcf tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:18.056195 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5c3f9d4f-80e2-4c38-a83a-c2b00048cbcf tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 82458e75-f124-45b2-85a6-ef634b510f90] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:18.083201 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:06:18.090606 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=28 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:06:18.099683 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c3f9d4f-80e2-4c38-a83a-c2b00048cbcf tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:18.110891 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c3f9d4f-80e2-4c38-a83a-c2b00048cbcf tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:18.113124 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c3f9d4f-80e2-4c38-a83a-c2b00048cbcf tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:18.114344 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c3f9d4f-80e2-4c38-a83a-c2b00048cbcf tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:18.119310 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c3f9d4f-80e2-4c38-a83a-c2b00048cbcf tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:18.120087 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c3f9d4f-80e2-4c38-a83a-c2b00048cbcf tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:18.147288 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fa6d26a8-489a-4f17-9757-1e86fc9b01fd tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:18.169520 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fa6d26a8-489a-4f17-9757-1e86fc9b01fd tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/7fc68c75-8598-4bc7-b96b-852f31f09781" status: 200 len: 1308 microversion: 2.1 time: 0.675604 Oct 26 13:06:18.170651 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 566/1067] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:17 2022] GET /compute/v2.1/servers/7fc68c75-8598-4bc7-b96b-852f31f09781 => generated 1308 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:18.249967 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a7bedea9-ec57-47b1-be9e-5ad3dd718fa3 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:18.250578 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a7bedea9-ec57-47b1-be9e-5ad3dd718fa3 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:18.284992 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a7bedea9-ec57-47b1-be9e-5ad3dd718fa3 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:18.285424 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a7bedea9-ec57-47b1-be9e-5ad3dd718fa3 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:18.289669 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a7bedea9-ec57-47b1-be9e-5ad3dd718fa3 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:18.290435 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a7bedea9-ec57-47b1-be9e-5ad3dd718fa3 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:18.290902 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a7bedea9-ec57-47b1-be9e-5ad3dd718fa3 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:18.291332 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a7bedea9-ec57-47b1-be9e-5ad3dd718fa3 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:18.335263 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:06:18.512468 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=16 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:06:18.875387 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a7bedea9-ec57-47b1-be9e-5ad3dd718fa3 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:18.893645 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a7bedea9-ec57-47b1-be9e-5ad3dd718fa3 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904" status: 200 len: 1322 microversion: 2.1 time: 0.646704 Oct 26 13:06:18.898753 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 567/1068] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:18 2022] GET /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904 => generated 1322 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:18.907134 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f675095d-9292-4672-8ed1-1f5f01d81152 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:18.923646 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f675095d-9292-4672-8ed1-1f5f01d81152 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 1c5d8fc5-5c9f-4bdf-81ed-388df5d390de] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:18.941781 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f675095d-9292-4672-8ed1-1f5f01d81152 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:18.941781 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f675095d-9292-4672-8ed1-1f5f01d81152 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:18.941781 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f675095d-9292-4672-8ed1-1f5f01d81152 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:18.941781 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f675095d-9292-4672-8ed1-1f5f01d81152 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:18.942131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f675095d-9292-4672-8ed1-1f5f01d81152 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:18.942131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f675095d-9292-4672-8ed1-1f5f01d81152 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:19.410770 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f675095d-9292-4672-8ed1-1f5f01d81152 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:19.429279 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f675095d-9292-4672-8ed1-1f5f01d81152 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/1c5d8fc5-5c9f-4bdf-81ed-388df5d390de" status: 200 len: 1312 microversion: 2.1 time: 0.528510 Oct 26 13:06:19.430710 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 568/1069] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:18 2022] GET /compute/v2.1/servers/1c5d8fc5-5c9f-4bdf-81ed-388df5d390de => generated 1312 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:19.436420 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9e3208c4-5086-4639-86ee-49ea34ba2ed9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:19.437648 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9e3208c4-5086-4639-86ee-49ea34ba2ed9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:19.445695 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e3208c4-5086-4639-86ee-49ea34ba2ed9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:19.446731 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e3208c4-5086-4639-86ee-49ea34ba2ed9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:19.447625 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e3208c4-5086-4639-86ee-49ea34ba2ed9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:19.448514 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e3208c4-5086-4639-86ee-49ea34ba2ed9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:19.449126 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e3208c4-5086-4639-86ee-49ea34ba2ed9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:19.450036 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e3208c4-5086-4639-86ee-49ea34ba2ed9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:19.590485 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5c3f9d4f-80e2-4c38-a83a-c2b00048cbcf tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:19.598953 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5c3f9d4f-80e2-4c38-a83a-c2b00048cbcf tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/82458e75-f124-45b2-85a6-ef634b510f90" status: 200 len: 1316 microversion: 2.1 time: 1.553152 Oct 26 13:06:19.599551 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 502/1070] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:18 2022] GET /compute/v2.1/servers/82458e75-f124-45b2-85a6-ef634b510f90 => generated 1316 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:06:19.619334 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1c3b92d4-2cab-4143-8f04-854d8de037ea tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:19.619849 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1c3b92d4-2cab-4143-8f04-854d8de037ea tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 7fc68c75-8598-4bc7-b96b-852f31f09781] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:19.645772 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1c3b92d4-2cab-4143-8f04-854d8de037ea tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:19.646413 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1c3b92d4-2cab-4143-8f04-854d8de037ea tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:19.646867 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1c3b92d4-2cab-4143-8f04-854d8de037ea tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:19.647654 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1c3b92d4-2cab-4143-8f04-854d8de037ea tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:19.648105 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1c3b92d4-2cab-4143-8f04-854d8de037ea tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:19.648718 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1c3b92d4-2cab-4143-8f04-854d8de037ea tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:19.799848 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9e3208c4-5086-4639-86ee-49ea34ba2ed9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:19.813832 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9e3208c4-5086-4639-86ee-49ea34ba2ed9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 200 len: 1470 microversion: 2.1 time: 0.381733 Oct 26 13:06:19.840433 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 569/1071] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:19 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 1470 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:19.919828 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-57a1e9f7-3e91-4d83-b26c-16ec23461d65 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:19.920616 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-57a1e9f7-3e91-4d83-b26c-16ec23461d65 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:19.938752 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57a1e9f7-3e91-4d83-b26c-16ec23461d65 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:19.940329 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57a1e9f7-3e91-4d83-b26c-16ec23461d65 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:19.945272 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57a1e9f7-3e91-4d83-b26c-16ec23461d65 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:19.946276 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57a1e9f7-3e91-4d83-b26c-16ec23461d65 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:19.946900 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57a1e9f7-3e91-4d83-b26c-16ec23461d65 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:19.947507 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57a1e9f7-3e91-4d83-b26c-16ec23461d65 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:20.375084 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-57a1e9f7-3e91-4d83-b26c-16ec23461d65 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:20.387359 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-57a1e9f7-3e91-4d83-b26c-16ec23461d65 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904" status: 200 len: 1322 microversion: 2.1 time: 0.472760 Oct 26 13:06:20.401147 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 570/1072] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:19 2022] GET /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904 => generated 1322 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:06:20.459474 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-102a850b-a956-4e4c-a865-7bce2a8363d8 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:20.460394 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-102a850b-a956-4e4c-a865-7bce2a8363d8 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 1c5d8fc5-5c9f-4bdf-81ed-388df5d390de] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:20.470998 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-102a850b-a956-4e4c-a865-7bce2a8363d8 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:20.471585 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-102a850b-a956-4e4c-a865-7bce2a8363d8 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:20.472098 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-102a850b-a956-4e4c-a865-7bce2a8363d8 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:20.477265 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-102a850b-a956-4e4c-a865-7bce2a8363d8 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:20.478166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-102a850b-a956-4e4c-a865-7bce2a8363d8 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:20.478773 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-102a850b-a956-4e4c-a865-7bce2a8363d8 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:20.845926 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1c3b92d4-2cab-4143-8f04-854d8de037ea tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:20.856634 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1c3b92d4-2cab-4143-8f04-854d8de037ea tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/7fc68c75-8598-4bc7-b96b-852f31f09781" status: 200 len: 1308 microversion: 2.1 time: 1.250697 Oct 26 13:06:20.862106 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 503/1073] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:19 2022] GET /compute/v2.1/servers/7fc68c75-8598-4bc7-b96b-852f31f09781 => generated 1308 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:20.874424 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-64f5ae22-1683-426d-a3ae-e3bf150d1ab7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:20.875564 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-64f5ae22-1683-426d-a3ae-e3bf150d1ab7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 82458e75-f124-45b2-85a6-ef634b510f90] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:20.891120 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64f5ae22-1683-426d-a3ae-e3bf150d1ab7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:20.892176 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64f5ae22-1683-426d-a3ae-e3bf150d1ab7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:20.896001 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64f5ae22-1683-426d-a3ae-e3bf150d1ab7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:20.896874 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64f5ae22-1683-426d-a3ae-e3bf150d1ab7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:20.897514 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64f5ae22-1683-426d-a3ae-e3bf150d1ab7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:20.898007 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64f5ae22-1683-426d-a3ae-e3bf150d1ab7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:20.997789 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-102a850b-a956-4e4c-a865-7bce2a8363d8 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:21.008263 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-102a850b-a956-4e4c-a865-7bce2a8363d8 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/1c5d8fc5-5c9f-4bdf-81ed-388df5d390de" status: 200 len: 1312 microversion: 2.1 time: 0.553275 Oct 26 13:06:21.008856 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 571/1074] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:20 2022] GET /compute/v2.1/servers/1c5d8fc5-5c9f-4bdf-81ed-388df5d390de => generated 1312 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:06:21.029779 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9cf5239d-d2de-4fc1-9aaf-ea722a7a4058 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:21.030621 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9cf5239d-d2de-4fc1-9aaf-ea722a7a4058 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:21.047316 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9cf5239d-d2de-4fc1-9aaf-ea722a7a4058 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:21.048067 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9cf5239d-d2de-4fc1-9aaf-ea722a7a4058 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:21.048763 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9cf5239d-d2de-4fc1-9aaf-ea722a7a4058 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:21.052508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9cf5239d-d2de-4fc1-9aaf-ea722a7a4058 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:21.053239 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9cf5239d-d2de-4fc1-9aaf-ea722a7a4058 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:21.054073 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9cf5239d-d2de-4fc1-9aaf-ea722a7a4058 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:21.353503 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9cf5239d-d2de-4fc1-9aaf-ea722a7a4058 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:21.373183 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9cf5239d-d2de-4fc1-9aaf-ea722a7a4058 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 200 len: 1470 microversion: 2.1 time: 0.356424 Oct 26 13:06:21.374557 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 572/1075] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:21 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 1470 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:21.412555 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-aa46cb82-b7ee-4938-b5fc-144816980de6 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:21.413323 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-aa46cb82-b7ee-4938-b5fc-144816980de6 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:21.425865 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa46cb82-b7ee-4938-b5fc-144816980de6 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:21.426280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa46cb82-b7ee-4938-b5fc-144816980de6 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:21.426721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa46cb82-b7ee-4938-b5fc-144816980de6 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:21.427443 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa46cb82-b7ee-4938-b5fc-144816980de6 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:21.427903 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa46cb82-b7ee-4938-b5fc-144816980de6 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:21.428331 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa46cb82-b7ee-4938-b5fc-144816980de6 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:21.686583 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-aa46cb82-b7ee-4938-b5fc-144816980de6 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:21.700792 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-aa46cb82-b7ee-4938-b5fc-144816980de6 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904" status: 200 len: 1322 microversion: 2.1 time: 0.289914 Oct 26 13:06:21.703750 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 573/1076] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:21 2022] GET /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904 => generated 1322 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:06:21.716399 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-64f5ae22-1683-426d-a3ae-e3bf150d1ab7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:21.730590 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-64f5ae22-1683-426d-a3ae-e3bf150d1ab7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/82458e75-f124-45b2-85a6-ef634b510f90" status: 200 len: 1316 microversion: 2.1 time: 0.866975 Oct 26 13:06:21.734289 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 504/1077] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:20 2022] GET /compute/v2.1/servers/82458e75-f124-45b2-85a6-ef634b510f90 => generated 1316 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:21.893273 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-15e277d9-5408-497a-8a11-308a3257f35d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:21.894161 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-15e277d9-5408-497a-8a11-308a3257f35d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 7fc68c75-8598-4bc7-b96b-852f31f09781] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:21.903887 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15e277d9-5408-497a-8a11-308a3257f35d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:21.906768 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15e277d9-5408-497a-8a11-308a3257f35d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:21.907415 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15e277d9-5408-497a-8a11-308a3257f35d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:21.910300 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15e277d9-5408-497a-8a11-308a3257f35d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:21.911704 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15e277d9-5408-497a-8a11-308a3257f35d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:21.912890 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15e277d9-5408-497a-8a11-308a3257f35d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:22.034063 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fed162d2-c345-46bd-9fa6-30debde0cc27 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:22.036787 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fed162d2-c345-46bd-9fa6-30debde0cc27 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 1c5d8fc5-5c9f-4bdf-81ed-388df5d390de] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:22.062331 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fed162d2-c345-46bd-9fa6-30debde0cc27 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:22.063142 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fed162d2-c345-46bd-9fa6-30debde0cc27 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:22.065935 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fed162d2-c345-46bd-9fa6-30debde0cc27 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:22.067386 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fed162d2-c345-46bd-9fa6-30debde0cc27 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:22.070749 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fed162d2-c345-46bd-9fa6-30debde0cc27 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:22.074831 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fed162d2-c345-46bd-9fa6-30debde0cc27 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:22.282586 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-15e277d9-5408-497a-8a11-308a3257f35d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:22.304685 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-15e277d9-5408-497a-8a11-308a3257f35d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/7fc68c75-8598-4bc7-b96b-852f31f09781" status: 200 len: 1308 microversion: 2.1 time: 0.413224 Oct 26 13:06:22.305398 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 574/1078] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:21 2022] GET /compute/v2.1/servers/7fc68c75-8598-4bc7-b96b-852f31f09781 => generated 1308 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:22.401283 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fdd594e4-5301-4963-93e6-91635cc11227 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:22.402017 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fdd594e4-5301-4963-93e6-91635cc11227 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:22.411193 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fdd594e4-5301-4963-93e6-91635cc11227 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:22.411699 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fdd594e4-5301-4963-93e6-91635cc11227 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:22.412138 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fdd594e4-5301-4963-93e6-91635cc11227 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:22.412851 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fdd594e4-5301-4963-93e6-91635cc11227 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:22.414111 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fdd594e4-5301-4963-93e6-91635cc11227 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:22.414544 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fdd594e4-5301-4963-93e6-91635cc11227 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:22.802446 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fdd594e4-5301-4963-93e6-91635cc11227 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:22.816606 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fdd594e4-5301-4963-93e6-91635cc11227 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 200 len: 1470 microversion: 2.1 time: 0.423564 Oct 26 13:06:22.817219 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 575/1079] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:22 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 1470 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:22.847428 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d6f7f269-f414-4ca0-ab24-4063ed27c0f3 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:22.848050 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d6f7f269-f414-4ca0-ab24-4063ed27c0f3 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:22.854106 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fed162d2-c345-46bd-9fa6-30debde0cc27 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:22.882441 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6f7f269-f414-4ca0-ab24-4063ed27c0f3 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:22.882971 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6f7f269-f414-4ca0-ab24-4063ed27c0f3 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:22.883439 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6f7f269-f414-4ca0-ab24-4063ed27c0f3 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:22.883858 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fed162d2-c345-46bd-9fa6-30debde0cc27 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/1c5d8fc5-5c9f-4bdf-81ed-388df5d390de" status: 200 len: 1312 microversion: 2.1 time: 0.853555 Oct 26 13:06:22.884155 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6f7f269-f414-4ca0-ab24-4063ed27c0f3 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:22.886849 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 505/1080] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:22 2022] GET /compute/v2.1/servers/1c5d8fc5-5c9f-4bdf-81ed-388df5d390de => generated 1312 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:22.901818 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4e16f756-da1b-411b-95c8-455395b05c87 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:22.901818 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4e16f756-da1b-411b-95c8-455395b05c87 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 82458e75-f124-45b2-85a6-ef634b510f90] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:22.903272 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6f7f269-f414-4ca0-ab24-4063ed27c0f3 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:22.903943 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6f7f269-f414-4ca0-ab24-4063ed27c0f3 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:22.910335 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e16f756-da1b-411b-95c8-455395b05c87 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:22.910933 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e16f756-da1b-411b-95c8-455395b05c87 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:22.911474 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e16f756-da1b-411b-95c8-455395b05c87 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:22.912182 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e16f756-da1b-411b-95c8-455395b05c87 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:22.912681 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e16f756-da1b-411b-95c8-455395b05c87 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:22.913148 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e16f756-da1b-411b-95c8-455395b05c87 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:23.745470 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d6f7f269-f414-4ca0-ab24-4063ed27c0f3 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:23.762225 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d6f7f269-f414-4ca0-ab24-4063ed27c0f3 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904" status: 200 len: 1322 microversion: 2.1 time: 0.925947 Oct 26 13:06:23.763554 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 576/1081] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:22 2022] GET /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904 => generated 1322 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:23.774706 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c7c8d84f-b2c7-453b-9c7a-fbc8c9f7c363 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:23.776707 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c7c8d84f-b2c7-453b-9c7a-fbc8c9f7c363 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 7fc68c75-8598-4bc7-b96b-852f31f09781] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:23.792168 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c7c8d84f-b2c7-453b-9c7a-fbc8c9f7c363 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:23.796905 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c7c8d84f-b2c7-453b-9c7a-fbc8c9f7c363 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:23.797699 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c7c8d84f-b2c7-453b-9c7a-fbc8c9f7c363 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:23.798709 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c7c8d84f-b2c7-453b-9c7a-fbc8c9f7c363 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:23.799381 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c7c8d84f-b2c7-453b-9c7a-fbc8c9f7c363 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:23.800046 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c7c8d84f-b2c7-453b-9c7a-fbc8c9f7c363 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:23.995840 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c7c8d84f-b2c7-453b-9c7a-fbc8c9f7c363 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:24.009330 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c7c8d84f-b2c7-453b-9c7a-fbc8c9f7c363 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/7fc68c75-8598-4bc7-b96b-852f31f09781" status: 200 len: 1308 microversion: 2.1 time: 0.244298 Oct 26 13:06:24.010731 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 577/1082] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:23 2022] GET /compute/v2.1/servers/7fc68c75-8598-4bc7-b96b-852f31f09781 => generated 1308 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:24.016365 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-07446703-b90a-4d91-8224-2a90f0f3135f req-f9dbd8b9-f2e3-45ba-8db5-07b1aa4c60b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904", "name": "network-vif-plugged", "status": "completed", "tag": "972c68b8-19ba-4672-b7a7-ab578f54935e"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:06:24.027247 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-07446703-b90a-4d91-8224-2a90f0f3135f req-f9dbd8b9-f2e3-45ba-8db5-07b1aa4c60b2 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:24.028126 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-07446703-b90a-4d91-8224-2a90f0f3135f req-f9dbd8b9-f2e3-45ba-8db5-07b1aa4c60b2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:24.028778 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-07446703-b90a-4d91-8224-2a90f0f3135f req-f9dbd8b9-f2e3-45ba-8db5-07b1aa4c60b2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:24.042786 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-07446703-b90a-4d91-8224-2a90f0f3135f req-f9dbd8b9-f2e3-45ba-8db5-07b1aa4c60b2 service nova] Creating event network-vif-plugged:972c68b8-19ba-4672-b7a7-ab578f54935e for instance cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904 on n-h1-862686-1 Oct 26 13:06:24.049040 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-07446703-b90a-4d91-8224-2a90f0f3135f req-f9dbd8b9-f2e3-45ba-8db5-07b1aa4c60b2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036849 Oct 26 13:06:24.050715 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 578/1083] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:06:24.057100 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4aa98b80-20ba-40c5-9033-fa2fd376d88e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:24.058202 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4aa98b80-20ba-40c5-9033-fa2fd376d88e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:24.066769 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4aa98b80-20ba-40c5-9033-fa2fd376d88e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:24.067677 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4aa98b80-20ba-40c5-9033-fa2fd376d88e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:24.068350 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4aa98b80-20ba-40c5-9033-fa2fd376d88e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:24.069438 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4aa98b80-20ba-40c5-9033-fa2fd376d88e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:24.070410 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4aa98b80-20ba-40c5-9033-fa2fd376d88e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:24.071237 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4aa98b80-20ba-40c5-9033-fa2fd376d88e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:24.288792 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4aa98b80-20ba-40c5-9033-fa2fd376d88e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:24.300590 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4aa98b80-20ba-40c5-9033-fa2fd376d88e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 200 len: 1536 microversion: 2.1 time: 0.248286 Oct 26 13:06:24.301571 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 579/1084] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:24 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 1536 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:24.318945 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7cd2563b-ca5e-44f1-97b1-81c886b473a9 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:24.319885 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7cd2563b-ca5e-44f1-97b1-81c886b473a9 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 1c5d8fc5-5c9f-4bdf-81ed-388df5d390de] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:24.328953 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7cd2563b-ca5e-44f1-97b1-81c886b473a9 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:24.329457 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7cd2563b-ca5e-44f1-97b1-81c886b473a9 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:24.329920 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7cd2563b-ca5e-44f1-97b1-81c886b473a9 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:24.331301 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7cd2563b-ca5e-44f1-97b1-81c886b473a9 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:24.331844 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7cd2563b-ca5e-44f1-97b1-81c886b473a9 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:24.332760 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7cd2563b-ca5e-44f1-97b1-81c886b473a9 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:24.532617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7cd2563b-ca5e-44f1-97b1-81c886b473a9 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:24.544113 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7cd2563b-ca5e-44f1-97b1-81c886b473a9 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/1c5d8fc5-5c9f-4bdf-81ed-388df5d390de" status: 200 len: 1312 microversion: 2.1 time: 0.239241 Oct 26 13:06:24.546259 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 580/1085] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:24 2022] GET /compute/v2.1/servers/1c5d8fc5-5c9f-4bdf-81ed-388df5d390de => generated 1312 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:24.701641 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4e16f756-da1b-411b-95c8-455395b05c87 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:24.716615 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4e16f756-da1b-411b-95c8-455395b05c87 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/82458e75-f124-45b2-85a6-ef634b510f90" status: 200 len: 1316 microversion: 2.1 time: 1.828629 Oct 26 13:06:24.719149 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 506/1086] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:22 2022] GET /compute/v2.1/servers/82458e75-f124-45b2-85a6-ef634b510f90 => generated 1316 bytes in 1832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:24.787494 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0f3f410a-a1d1-46c0-9361-2d38e41ebdd5 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:24.788931 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0f3f410a-a1d1-46c0-9361-2d38e41ebdd5 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:24.796366 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f3f410a-a1d1-46c0-9361-2d38e41ebdd5 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:24.797166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f3f410a-a1d1-46c0-9361-2d38e41ebdd5 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:24.797892 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f3f410a-a1d1-46c0-9361-2d38e41ebdd5 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:24.798820 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f3f410a-a1d1-46c0-9361-2d38e41ebdd5 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:24.799467 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f3f410a-a1d1-46c0-9361-2d38e41ebdd5 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:24.800744 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f3f410a-a1d1-46c0-9361-2d38e41ebdd5 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:24.964274 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=7 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:06:25.011188 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0f3f410a-a1d1-46c0-9361-2d38e41ebdd5 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:25.021360 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0f3f410a-a1d1-46c0-9361-2d38e41ebdd5 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904" status: 200 len: 1322 microversion: 2.1 time: 0.237852 Oct 26 13:06:25.023801 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 581/1087] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:24 2022] GET /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904 => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:25.047596 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bf386204-fdd9-4698-93d2-4ed4f796edd7 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:25.048368 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bf386204-fdd9-4698-93d2-4ed4f796edd7 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 7fc68c75-8598-4bc7-b96b-852f31f09781] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:25.060932 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf386204-fdd9-4698-93d2-4ed4f796edd7 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:25.062564 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf386204-fdd9-4698-93d2-4ed4f796edd7 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:25.064318 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf386204-fdd9-4698-93d2-4ed4f796edd7 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:25.068442 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf386204-fdd9-4698-93d2-4ed4f796edd7 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:25.071217 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf386204-fdd9-4698-93d2-4ed4f796edd7 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:25.072581 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf386204-fdd9-4698-93d2-4ed4f796edd7 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:25.328053 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-76c88ff0-186f-431b-ab80-e90ed8893955 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:25.329226 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-76c88ff0-186f-431b-ab80-e90ed8893955 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:25.342615 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76c88ff0-186f-431b-ab80-e90ed8893955 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:25.354828 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76c88ff0-186f-431b-ab80-e90ed8893955 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:25.356177 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76c88ff0-186f-431b-ab80-e90ed8893955 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:25.356941 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76c88ff0-186f-431b-ab80-e90ed8893955 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:25.358293 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76c88ff0-186f-431b-ab80-e90ed8893955 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:25.359852 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76c88ff0-186f-431b-ab80-e90ed8893955 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:25.555214 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bf386204-fdd9-4698-93d2-4ed4f796edd7 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:25.568863 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bf386204-fdd9-4698-93d2-4ed4f796edd7 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/7fc68c75-8598-4bc7-b96b-852f31f09781" status: 200 len: 1308 microversion: 2.1 time: 0.527948 Oct 26 13:06:25.570694 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 507/1088] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:25 2022] GET /compute/v2.1/servers/7fc68c75-8598-4bc7-b96b-852f31f09781 => generated 1308 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:25.576383 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b05700f4-d219-4179-b81c-edf9ebc6d2af tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:25.576993 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b05700f4-d219-4179-b81c-edf9ebc6d2af tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 1c5d8fc5-5c9f-4bdf-81ed-388df5d390de] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:25.598969 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b05700f4-d219-4179-b81c-edf9ebc6d2af tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:25.599513 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b05700f4-d219-4179-b81c-edf9ebc6d2af tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:25.601299 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b05700f4-d219-4179-b81c-edf9ebc6d2af tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:25.602292 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b05700f4-d219-4179-b81c-edf9ebc6d2af tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:25.603632 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b05700f4-d219-4179-b81c-edf9ebc6d2af tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:25.605141 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b05700f4-d219-4179-b81c-edf9ebc6d2af tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:25.758613 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-76c88ff0-186f-431b-ab80-e90ed8893955 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:25.770759 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-76c88ff0-186f-431b-ab80-e90ed8893955 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 200 len: 1536 microversion: 2.1 time: 0.447295 Oct 26 13:06:25.770759 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 582/1089] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:25 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 1536 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:25.781301 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c6c8c1d0-ad9f-4c70-b3cb-430f8cc3c041 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:25.781301 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c6c8c1d0-ad9f-4c70-b3cb-430f8cc3c041 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 82458e75-f124-45b2-85a6-ef634b510f90] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:25.803465 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c6c8c1d0-ad9f-4c70-b3cb-430f8cc3c041 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:25.804122 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c6c8c1d0-ad9f-4c70-b3cb-430f8cc3c041 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:25.804892 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c6c8c1d0-ad9f-4c70-b3cb-430f8cc3c041 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:25.805715 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c6c8c1d0-ad9f-4c70-b3cb-430f8cc3c041 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:25.806110 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c6c8c1d0-ad9f-4c70-b3cb-430f8cc3c041 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:25.811785 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c6c8c1d0-ad9f-4c70-b3cb-430f8cc3c041 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:26.001675 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b05700f4-d219-4179-b81c-edf9ebc6d2af tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:26.012510 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b05700f4-d219-4179-b81c-edf9ebc6d2af tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/1c5d8fc5-5c9f-4bdf-81ed-388df5d390de" status: 200 len: 1312 microversion: 2.1 time: 0.440635 Oct 26 13:06:26.013135 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 508/1090] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:25 2022] GET /compute/v2.1/servers/1c5d8fc5-5c9f-4bdf-81ed-388df5d390de => generated 1312 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:26.025730 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-24ba7857-badc-4c24-9382-ceb54b8a6578 req-241054eb-d1fb-4e13-8d43-8075238ad049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e4891a-9fbd-42b7-a12c-5a4de9c1f151", "name": "network-vif-unplugged", "status": "completed", "tag": "4bacbb43-3b81-44f6-b4ad-82bf06f609ad"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:06:26.056197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-24ba7857-badc-4c24-9382-ceb54b8a6578 req-241054eb-d1fb-4e13-8d43-8075238ad049 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:26.056776 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-24ba7857-badc-4c24-9382-ceb54b8a6578 req-241054eb-d1fb-4e13-8d43-8075238ad049 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:26.057330 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-24ba7857-badc-4c24-9382-ceb54b8a6578 req-241054eb-d1fb-4e13-8d43-8075238ad049 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:26.085341 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-24ba7857-badc-4c24-9382-ceb54b8a6578 req-241054eb-d1fb-4e13-8d43-8075238ad049 service nova] Creating event network-vif-unplugged:4bacbb43-3b81-44f6-b4ad-82bf06f609ad for instance c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 on n-h1-862686-1 Oct 26 13:06:26.097080 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [req-24ba7857-badc-4c24-9382-ceb54b8a6578 req-241054eb-d1fb-4e13-8d43-8075238ad049 service nova] Instance c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862686-1', 'n-h1-862686-1'} {{(pid=120597) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 13:06:26.120956 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-24ba7857-badc-4c24-9382-ceb54b8a6578 req-241054eb-d1fb-4e13-8d43-8075238ad049 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106488 Oct 26 13:06:26.121828 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 509/1091] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:06:26.130105 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e9560321-9209-4e5b-bcea-3986fdb37e14 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:26.134539 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e9560321-9209-4e5b-bcea-3986fdb37e14 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:26.141897 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c6c8c1d0-ad9f-4c70-b3cb-430f8cc3c041 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:26.151236 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e9560321-9209-4e5b-bcea-3986fdb37e14 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:26.153061 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e9560321-9209-4e5b-bcea-3986fdb37e14 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:26.153994 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c6c8c1d0-ad9f-4c70-b3cb-430f8cc3c041 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/82458e75-f124-45b2-85a6-ef634b510f90" status: 200 len: 1316 microversion: 2.1 time: 0.382573 Oct 26 13:06:26.154371 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e9560321-9209-4e5b-bcea-3986fdb37e14 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:26.155911 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 583/1092] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:25 2022] GET /compute/v2.1/servers/82458e75-f124-45b2-85a6-ef634b510f90 => generated 1316 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:26.165114 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e9560321-9209-4e5b-bcea-3986fdb37e14 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:26.167740 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e9560321-9209-4e5b-bcea-3986fdb37e14 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:26.168414 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e9560321-9209-4e5b-bcea-3986fdb37e14 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:26.195440 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:06:26.256490 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-8e969125-0dac-48c6-ad3f-15c034f8fdbb req-5c6ed85d-671d-48ac-aabd-7cbc261dda7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82458e75-f124-45b2-85a6-ef634b510f90", "name": "network-vif-plugged", "status": "completed", "tag": "126ff158-9c5b-4927-8421-7373016ebb59"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:06:26.268603 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8e969125-0dac-48c6-ad3f-15c034f8fdbb req-5c6ed85d-671d-48ac-aabd-7cbc261dda7c service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:26.270007 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8e969125-0dac-48c6-ad3f-15c034f8fdbb req-5c6ed85d-671d-48ac-aabd-7cbc261dda7c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:26.270611 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8e969125-0dac-48c6-ad3f-15c034f8fdbb req-5c6ed85d-671d-48ac-aabd-7cbc261dda7c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:26.285937 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-8e969125-0dac-48c6-ad3f-15c034f8fdbb req-5c6ed85d-671d-48ac-aabd-7cbc261dda7c service nova] Creating event network-vif-plugged:126ff158-9c5b-4927-8421-7373016ebb59 for instance 82458e75-f124-45b2-85a6-ef634b510f90 on n-h2-862686-1 Oct 26 13:06:26.292107 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-8e969125-0dac-48c6-ad3f-15c034f8fdbb req-5c6ed85d-671d-48ac-aabd-7cbc261dda7c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039180 Oct 26 13:06:26.293294 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 584/1093] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:06:26.574963 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e9560321-9209-4e5b-bcea-3986fdb37e14 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:26.587072 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e9560321-9209-4e5b-bcea-3986fdb37e14 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904" status: 200 len: 1471 microversion: 2.1 time: 0.463476 Oct 26 13:06:26.587959 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 510/1094] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:26 2022] GET /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904 => generated 1471 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:26.594045 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2968458d-b803-48f1-ae7e-17d64e8f8d37 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:26.596264 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2968458d-b803-48f1-ae7e-17d64e8f8d37 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 7fc68c75-8598-4bc7-b96b-852f31f09781] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:26.608450 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2968458d-b803-48f1-ae7e-17d64e8f8d37 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:26.608955 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2968458d-b803-48f1-ae7e-17d64e8f8d37 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:26.609399 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2968458d-b803-48f1-ae7e-17d64e8f8d37 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:26.615357 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2968458d-b803-48f1-ae7e-17d64e8f8d37 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:26.615864 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2968458d-b803-48f1-ae7e-17d64e8f8d37 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:26.616445 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2968458d-b803-48f1-ae7e-17d64e8f8d37 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:26.685016 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:06:27.065955 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2968458d-b803-48f1-ae7e-17d64e8f8d37 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:27.078503 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2968458d-b803-48f1-ae7e-17d64e8f8d37 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/7fc68c75-8598-4bc7-b96b-852f31f09781" status: 200 len: 1308 microversion: 2.1 time: 0.490020 Oct 26 13:06:27.079118 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 585/1095] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:26 2022] GET /compute/v2.1/servers/7fc68c75-8598-4bc7-b96b-852f31f09781 => generated 1308 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:27.112849 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4ee8f06c-fadd-44d3-acc7-c5eaeb5634c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:27.112849 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4ee8f06c-fadd-44d3-acc7-c5eaeb5634c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:27.135388 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4ee8f06c-fadd-44d3-acc7-c5eaeb5634c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:27.136036 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4ee8f06c-fadd-44d3-acc7-c5eaeb5634c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:27.137701 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4ee8f06c-fadd-44d3-acc7-c5eaeb5634c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:27.139747 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4ee8f06c-fadd-44d3-acc7-c5eaeb5634c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:27.140508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4ee8f06c-fadd-44d3-acc7-c5eaeb5634c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:27.140968 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4ee8f06c-fadd-44d3-acc7-c5eaeb5634c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:27.187208 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0a2f48cc-683b-4fa1-9ef9-e1170b89401b tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:06:27.188420 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0a2f48cc-683b-4fa1-9ef9-e1170b89401b tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] [instance: 44666bec-e17c-4895-b991-70ad44f5c4f6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:27.196793 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-0a2f48cc-683b-4fa1-9ef9-e1170b89401b tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] HTTP exception thrown: Instance 44666bec-e17c-4895-b991-70ad44f5c4f6 could not be found. Oct 26 13:06:27.198730 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0a2f48cc-683b-4fa1-9ef9-e1170b89401b tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] Request method failure captured: Oct 26 13:06:27.198730 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/servers/44666bec-e17c-4895-b991-70ad44f5c4f6/action HTTP/1.1 Oct 26 13:06:27.198730 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:06:27.198730 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:06:27.198730 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:06:27.198730 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 15 Oct 26 13:06:27.198730 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:06:27.198730 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:06:27.198730 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:06:27.198730 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:06:27.198730 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTC0aqQ0l4q1158VDmiDaXwj0lvFq6vLvqlU2j9jFORkFu2g83quWd81nF7-6ctIqFLLStP9xenIjoNRtk3fol0tT6bnwiqM5ixVaBYALrT3Afd9_fX5mWB69yGpShFtkW-x-v21BlHO06I4UhuP3WJhtCWK1CZGsUEhOH1Ehxsq-NU Oct 26 13:06:27.198730 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:06:27.198730 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:06:27.198730 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:06:27.198730 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:06:27.198730 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:06:27.198730 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:06:27.198730 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: f6270fafd849458c8c880c0e2319db07 Oct 26 13:06:27.198730 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1034477245 Oct 26 13:06:27.198730 n-d-862686-1 devstack@n-api.service[120597]: X-Role: admin,member,reader Oct 26 13:06:27.198730 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: admin,member,reader Oct 26 13:06:27.200306 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f6270fafd849458c8c880c0e2319db07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f6270fafd849458c8c880c0e2319db07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f6270fafd849458c8c880c0e2319db07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f6270fafd849458c8c880c0e2319db07"}]}] Oct 26 13:06:27.200306 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1034477245 Oct 26 13:06:27.200306 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: f6270fafd849458c8c880c0e2319db07 Oct 26 13:06:27.200306 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1034477245 Oct 26 13:06:27.200306 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersAdminNegativeTestJSON-1034477245-project-admin Oct 26 13:06:27.200306 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:06:27.200306 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:06:27.200306 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 66875702d2514d62ac84efb2546e2888 Oct 26 13:06:27.200306 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1034477245-project-admin Oct 26 13:06:27.200306 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:06:27.200306 n-d-862686-1 devstack@n-api.service[120597]: {"migrate": {}} Oct 26 13:06:27.200306 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:06:27.200306 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 44666bec-e17c-4895-b991-70ad44f5c4f6 could not be found. Oct 26 13:06:27.201235 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '44666bec-e17c-4895-b991-70ad44f5c4f6', 'body': {'migrate': {}}} Oct 26 13:06:27.201235 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:06:27.201235 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:06:27.201235 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:06:27.201235 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:06:27.201235 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:06:27.201235 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:06:27.201235 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 26 13:06:27.201235 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 26 13:06:27.201235 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44666bec-e17c-4895-b991-70ad44f5c4f6 could not be found. Oct 26 13:06:27.201235 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:06:27.201235 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:06:27.201235 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:06:27.201235 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:06:27.201235 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:06:27.201235 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:06:27.201235 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:06:27.201235 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:06:27.201235 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:06:27.201235 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:06:27.202797 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:06:27.202797 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:06:27.202797 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 26 13:06:27.202797 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 26 13:06:27.202797 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:06:27.202797 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:06:27.202797 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44666bec-e17c-4895-b991-70ad44f5c4f6 could not be found. Oct 26 13:06:27.202797 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:06:27.202797 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:06:27.202797 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:06:27.202797 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:06:27.202797 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:06:27.202797 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:06:27.202797 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:06:27.202797 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:06:27.202797 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44666bec-e17c-4895-b991-70ad44f5c4f6 could not be found. Oct 26 13:06:27.202797 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:06:27.205524 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0a2f48cc-683b-4fa1-9ef9-e1170b89401b tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] Returning 404 to user: Instance 44666bec-e17c-4895-b991-70ad44f5c4f6 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:06:27.218632 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0a2f48cc-683b-4fa1-9ef9-e1170b89401b tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/44666bec-e17c-4895-b991-70ad44f5c4f6/action" status: 404 len: 111 microversion: 2.1 time: 0.603431 Oct 26 13:06:27.219476 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 511/1096] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:06:26 2022] POST /compute/v2.1/servers/44666bec-e17c-4895-b991-70ad44f5c4f6/action => generated 111 bytes in 605 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 13:06:27.224998 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-219ad471-56b1-4353-a0d3-8cc254da241b tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:27.227049 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-219ad471-56b1-4353-a0d3-8cc254da241b tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 1c5d8fc5-5c9f-4bdf-81ed-388df5d390de] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:27.239217 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-219ad471-56b1-4353-a0d3-8cc254da241b tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:27.239726 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-219ad471-56b1-4353-a0d3-8cc254da241b tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:27.240169 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-219ad471-56b1-4353-a0d3-8cc254da241b tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:27.254486 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-219ad471-56b1-4353-a0d3-8cc254da241b tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:27.255321 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-219ad471-56b1-4353-a0d3-8cc254da241b tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:27.255918 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-219ad471-56b1-4353-a0d3-8cc254da241b tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:27.514270 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4ee8f06c-fadd-44d3-acc7-c5eaeb5634c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:27.526401 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4ee8f06c-fadd-44d3-acc7-c5eaeb5634c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 200 len: 1536 microversion: 2.1 time: 0.446076 Oct 26 13:06:27.537941 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 586/1097] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:27 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 1536 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:27.543810 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d639f50a-51c1-4045-99d5-ff840bfdbc53 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:27.544648 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d639f50a-51c1-4045-99d5-ff840bfdbc53 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 82458e75-f124-45b2-85a6-ef634b510f90] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:27.563417 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d639f50a-51c1-4045-99d5-ff840bfdbc53 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:27.563919 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d639f50a-51c1-4045-99d5-ff840bfdbc53 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:27.564352 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d639f50a-51c1-4045-99d5-ff840bfdbc53 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:27.565069 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d639f50a-51c1-4045-99d5-ff840bfdbc53 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:27.567069 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d639f50a-51c1-4045-99d5-ff840bfdbc53 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:27.567483 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d639f50a-51c1-4045-99d5-ff840bfdbc53 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:28.113196 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d639f50a-51c1-4045-99d5-ff840bfdbc53 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:28.126747 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d639f50a-51c1-4045-99d5-ff840bfdbc53 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/82458e75-f124-45b2-85a6-ef634b510f90" status: 200 len: 1316 microversion: 2.1 time: 0.586571 Oct 26 13:06:28.131332 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 587/1098] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:27 2022] GET /compute/v2.1/servers/82458e75-f124-45b2-85a6-ef634b510f90 => generated 1316 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:28.141099 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d0d54aa0-b20f-474e-8383-9985e90bf5dd tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-2120366695", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:06:28.278012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-d0d54aa0-b20f-474e-8383-9985e90bf5dd tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] validate_networks() for None {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:06:28.794523 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-219ad471-56b1-4353-a0d3-8cc254da241b tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:28.807903 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-219ad471-56b1-4353-a0d3-8cc254da241b tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/1c5d8fc5-5c9f-4bdf-81ed-388df5d390de" status: 200 len: 1312 microversion: 2.1 time: 1.587154 Oct 26 13:06:28.808499 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 512/1099] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:27 2022] GET /compute/v2.1/servers/1c5d8fc5-5c9f-4bdf-81ed-388df5d390de => generated 1312 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:28.818328 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9382eb18-b3f9-4709-a791-9ff8bf548c54 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:28.818940 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9382eb18-b3f9-4709-a791-9ff8bf548c54 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 7fc68c75-8598-4bc7-b96b-852f31f09781] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:28.840315 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9382eb18-b3f9-4709-a791-9ff8bf548c54 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:28.845526 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9382eb18-b3f9-4709-a791-9ff8bf548c54 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:28.846321 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9382eb18-b3f9-4709-a791-9ff8bf548c54 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:28.847701 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9382eb18-b3f9-4709-a791-9ff8bf548c54 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:28.848371 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9382eb18-b3f9-4709-a791-9ff8bf548c54 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:28.848996 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9382eb18-b3f9-4709-a791-9ff8bf548c54 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:29.096534 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-d0d54aa0-b20f-474e-8383-9985e90bf5dd tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:06:29.097327 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-d0d54aa0-b20f-474e-8383-9985e90bf5dd tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:06:29.097836 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-d0d54aa0-b20f-474e-8383-9985e90bf5dd tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:06:29.098248 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-d0d54aa0-b20f-474e-8383-9985e90bf5dd tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:06:29.098665 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-d0d54aa0-b20f-474e-8383-9985e90bf5dd tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:06:29.126428 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0d54aa0-b20f-474e-8383-9985e90bf5dd tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:29.127210 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0d54aa0-b20f-474e-8383-9985e90bf5dd tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:29.128190 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0d54aa0-b20f-474e-8383-9985e90bf5dd tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:29.129669 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0d54aa0-b20f-474e-8383-9985e90bf5dd tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:29.130468 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0d54aa0-b20f-474e-8383-9985e90bf5dd tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:29.131080 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0d54aa0-b20f-474e-8383-9985e90bf5dd tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:29.160500 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-d0d54aa0-b20f-474e-8383-9985e90bf5dd tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Getting quotas for project 3a46daa2d3a043488473b65f18ebfefe. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:06:29.165559 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-d0d54aa0-b20f-474e-8383-9985e90bf5dd tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Getting quotas for user 71de4f9fbfb94d7da473e93e42591c5a and project 3a46daa2d3a043488473b65f18ebfefe. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:06:29.179889 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d0d54aa0-b20f-474e-8383-9985e90bf5dd tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:06:29.182781 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d0d54aa0-b20f-474e-8383-9985e90bf5dd tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: 249cce52-de17-460b-b445-e24d0d377986] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:06:29.200768 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:06:29.264043 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d0d54aa0-b20f-474e-8383-9985e90bf5dd tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.130573 Oct 26 13:06:29.265401 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 588/1100] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:06:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1133 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:06:29.270672 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-047e473a-4874-4b89-9153-fc36676d8c14 req-a0d14b66-b30a-43d9-9af8-b721bb6d498f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c5d8fc5-5c9f-4bdf-81ed-388df5d390de", "name": "network-vif-plugged", "status": "completed", "tag": "0d36d4e3-ddc6-4dfc-bf9d-2290d107fddf"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:06:29.285991 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-047e473a-4874-4b89-9153-fc36676d8c14 req-a0d14b66-b30a-43d9-9af8-b721bb6d498f service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:29.286933 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-047e473a-4874-4b89-9153-fc36676d8c14 req-a0d14b66-b30a-43d9-9af8-b721bb6d498f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:29.287688 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-047e473a-4874-4b89-9153-fc36676d8c14 req-a0d14b66-b30a-43d9-9af8-b721bb6d498f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:29.321982 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-047e473a-4874-4b89-9153-fc36676d8c14 req-a0d14b66-b30a-43d9-9af8-b721bb6d498f service nova] Creating event network-vif-plugged:0d36d4e3-ddc6-4dfc-bf9d-2290d107fddf for instance 1c5d8fc5-5c9f-4bdf-81ed-388df5d390de on n-h2-862686-1 Oct 26 13:06:29.329549 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-047e473a-4874-4b89-9153-fc36676d8c14 req-a0d14b66-b30a-43d9-9af8-b721bb6d498f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062384 Oct 26 13:06:29.330957 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 589/1101] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:06:29.344426 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1c3998c6-a762-40d2-8d2d-ba7d88ed5a0f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:29.358295 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1c3998c6-a762-40d2-8d2d-ba7d88ed5a0f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:29.381015 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c3998c6-a762-40d2-8d2d-ba7d88ed5a0f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:29.382342 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c3998c6-a762-40d2-8d2d-ba7d88ed5a0f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:29.384091 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c3998c6-a762-40d2-8d2d-ba7d88ed5a0f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:29.385023 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c3998c6-a762-40d2-8d2d-ba7d88ed5a0f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:29.386040 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c3998c6-a762-40d2-8d2d-ba7d88ed5a0f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:29.386637 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c3998c6-a762-40d2-8d2d-ba7d88ed5a0f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:29.852327 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1c3998c6-a762-40d2-8d2d-ba7d88ed5a0f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:29.867060 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1c3998c6-a762-40d2-8d2d-ba7d88ed5a0f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 200 len: 1536 microversion: 2.1 time: 0.533561 Oct 26 13:06:29.869407 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 590/1102] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:29 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 1536 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:29.880923 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-92f0ef89-0d2c-4b63-83f1-f935936514b9 req-8c47619e-ce15-4681-8a02-1755a2dbf3d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7e4891a-9fbd-42b7-a12c-5a4de9c1f151", "tag": "4bacbb43-3b81-44f6-b4ad-82bf06f609ad"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:06:29.912227 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-92f0ef89-0d2c-4b63-83f1-f935936514b9 req-8c47619e-ce15-4681-8a02-1755a2dbf3d9 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:29.914517 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-92f0ef89-0d2c-4b63-83f1-f935936514b9 req-8c47619e-ce15-4681-8a02-1755a2dbf3d9 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:29.916099 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-92f0ef89-0d2c-4b63-83f1-f935936514b9 req-8c47619e-ce15-4681-8a02-1755a2dbf3d9 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:29.952055 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-92f0ef89-0d2c-4b63-83f1-f935936514b9 req-8c47619e-ce15-4681-8a02-1755a2dbf3d9 service nova] Creating event network-changed:4bacbb43-3b81-44f6-b4ad-82bf06f609ad for instance c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 on n-h1-862686-1 Oct 26 13:06:29.966771 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [req-92f0ef89-0d2c-4b63-83f1-f935936514b9 req-8c47619e-ce15-4681-8a02-1755a2dbf3d9 service nova] Instance c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862686-1', 'n-h1-862686-1'} {{(pid=120598) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 13:06:30.015405 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-92f0ef89-0d2c-4b63-83f1-f935936514b9 req-8c47619e-ce15-4681-8a02-1755a2dbf3d9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141191 Oct 26 13:06:30.022915 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 591/1103] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:06:30.039750 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4cd6592a-e46c-42bc-bdd3-da4f1c85e3fb tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:30.042500 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4cd6592a-e46c-42bc-bdd3-da4f1c85e3fb tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 82458e75-f124-45b2-85a6-ef634b510f90] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:30.051897 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cd6592a-e46c-42bc-bdd3-da4f1c85e3fb tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:30.052540 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cd6592a-e46c-42bc-bdd3-da4f1c85e3fb tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:30.053052 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cd6592a-e46c-42bc-bdd3-da4f1c85e3fb tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:30.054661 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cd6592a-e46c-42bc-bdd3-da4f1c85e3fb tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:30.055357 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cd6592a-e46c-42bc-bdd3-da4f1c85e3fb tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:30.055949 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cd6592a-e46c-42bc-bdd3-da4f1c85e3fb tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:30.315088 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9382eb18-b3f9-4709-a791-9ff8bf548c54 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:30.331206 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9382eb18-b3f9-4709-a791-9ff8bf548c54 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/7fc68c75-8598-4bc7-b96b-852f31f09781" status: 200 len: 1308 microversion: 2.1 time: 1.515448 Oct 26 13:06:30.331824 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 513/1104] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:28 2022] GET /compute/v2.1/servers/7fc68c75-8598-4bc7-b96b-852f31f09781 => generated 1308 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:30.340182 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b83a2491-a1b2-4d0a-9ad3-7c0bc631a48e tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:30.340805 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b83a2491-a1b2-4d0a-9ad3-7c0bc631a48e tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: 249cce52-de17-460b-b445-e24d0d377986] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:30.367451 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b83a2491-a1b2-4d0a-9ad3-7c0bc631a48e tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:30.368099 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b83a2491-a1b2-4d0a-9ad3-7c0bc631a48e tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:30.368714 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b83a2491-a1b2-4d0a-9ad3-7c0bc631a48e tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:30.370189 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b83a2491-a1b2-4d0a-9ad3-7c0bc631a48e tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:30.371376 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b83a2491-a1b2-4d0a-9ad3-7c0bc631a48e tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:30.371531 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4cd6592a-e46c-42bc-bdd3-da4f1c85e3fb tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:30.372495 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b83a2491-a1b2-4d0a-9ad3-7c0bc631a48e tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:30.379436 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4cd6592a-e46c-42bc-bdd3-da4f1c85e3fb tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/82458e75-f124-45b2-85a6-ef634b510f90" status: 200 len: 1466 microversion: 2.1 time: 0.351621 Oct 26 13:06:30.383711 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 592/1105] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:30 2022] GET /compute/v2.1/servers/82458e75-f124-45b2-85a6-ef634b510f90 => generated 1466 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:30.390754 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b5c2cdd4-8a36-43ba-9ae1-1fd59c0fdf1f tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:30.391738 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b5c2cdd4-8a36-43ba-9ae1-1fd59c0fdf1f tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 1c5d8fc5-5c9f-4bdf-81ed-388df5d390de] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:30.408977 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5c2cdd4-8a36-43ba-9ae1-1fd59c0fdf1f tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:30.412302 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5c2cdd4-8a36-43ba-9ae1-1fd59c0fdf1f tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:30.413066 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5c2cdd4-8a36-43ba-9ae1-1fd59c0fdf1f tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:30.419028 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5c2cdd4-8a36-43ba-9ae1-1fd59c0fdf1f tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:30.419529 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5c2cdd4-8a36-43ba-9ae1-1fd59c0fdf1f tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:30.419971 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5c2cdd4-8a36-43ba-9ae1-1fd59c0fdf1f tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:30.504824 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b83a2491-a1b2-4d0a-9ad3-7c0bc631a48e tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:30.517977 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b83a2491-a1b2-4d0a-9ad3-7c0bc631a48e tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986" status: 200 len: 1226 microversion: 2.1 time: 0.185029 Oct 26 13:06:30.518689 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 514/1106] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:30 2022] GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986 => generated 1226 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:30.601075 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fff017c8-dfaf-436e-a667-d63f5acbb2d0 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1574691285", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "66fd6a5a-18fd-4c1d-b944-f1a3daf53a13"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:06:30.622327 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b5c2cdd4-8a36-43ba-9ae1-1fd59c0fdf1f tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:30.634152 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b5c2cdd4-8a36-43ba-9ae1-1fd59c0fdf1f tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/1c5d8fc5-5c9f-4bdf-81ed-388df5d390de" status: 200 len: 1312 microversion: 2.1 time: 0.248682 Oct 26 13:06:30.636318 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 593/1107] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:30 2022] GET /compute/v2.1/servers/1c5d8fc5-5c9f-4bdf-81ed-388df5d390de => generated 1312 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:30.642133 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-163501a9-700b-4ede-9f8e-171be1e27691 tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:30.642742 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-163501a9-700b-4ede-9f8e-171be1e27691 tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] [instance: 82458e75-f124-45b2-85a6-ef634b510f90] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:30.662871 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-163501a9-700b-4ede-9f8e-171be1e27691 tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:30.665998 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-163501a9-700b-4ede-9f8e-171be1e27691 tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:30.666448 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-163501a9-700b-4ede-9f8e-171be1e27691 tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:30.667178 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-163501a9-700b-4ede-9f8e-171be1e27691 tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:30.667642 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-163501a9-700b-4ede-9f8e-171be1e27691 tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:30.668070 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-163501a9-700b-4ede-9f8e-171be1e27691 tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:30.705928 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-fff017c8-dfaf-436e-a667-d63f5acbb2d0 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] validate_networks() for [('66fd6a5a-18fd-4c1d-b944-f1a3daf53a13', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:06:30.855627 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-163501a9-700b-4ede-9f8e-171be1e27691 tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/82458e75-f124-45b2-85a6-ef634b510f90" status: 200 len: 1617 microversion: 2.1 time: 0.217387 Oct 26 13:06:30.856779 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 594/1108] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:30 2022] GET /compute/v2.1/servers/82458e75-f124-45b2-85a6-ef634b510f90 => generated 1617 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:30.897963 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-83705b61-c8ed-4753-a48c-709703608558 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:30.899398 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-83705b61-c8ed-4753-a48c-709703608558 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:30.907690 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83705b61-c8ed-4753-a48c-709703608558 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:30.908508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83705b61-c8ed-4753-a48c-709703608558 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:30.909199 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83705b61-c8ed-4753-a48c-709703608558 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:30.912409 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83705b61-c8ed-4753-a48c-709703608558 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:30.914251 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83705b61-c8ed-4753-a48c-709703608558 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:30.914924 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83705b61-c8ed-4753-a48c-709703608558 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:31.141802 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-83705b61-c8ed-4753-a48c-709703608558 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:31.151425 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-83705b61-c8ed-4753-a48c-709703608558 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 200 len: 1536 microversion: 2.1 time: 0.262844 Oct 26 13:06:31.152390 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 595/1109] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:30 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 1536 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:06:31.157587 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-07b3a383-0f09-4b1e-90f3-f53ff3c665e7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1024050012", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "4c694a16-fdba-414f-9122-1899cc715565"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:06:31.223080 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-07b3a383-0f09-4b1e-90f3-f53ff3c665e7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] validate_networks() for None {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:06:31.732436 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-07b3a383-0f09-4b1e-90f3-f53ff3c665e7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:06:31.733131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-07b3a383-0f09-4b1e-90f3-f53ff3c665e7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:06:31.733249 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-07b3a383-0f09-4b1e-90f3-f53ff3c665e7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:06:31.733624 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-07b3a383-0f09-4b1e-90f3-f53ff3c665e7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:06:31.734220 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-07b3a383-0f09-4b1e-90f3-f53ff3c665e7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:06:31.751315 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07b3a383-0f09-4b1e-90f3-f53ff3c665e7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:31.753155 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07b3a383-0f09-4b1e-90f3-f53ff3c665e7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:31.758192 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07b3a383-0f09-4b1e-90f3-f53ff3c665e7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:31.759264 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07b3a383-0f09-4b1e-90f3-f53ff3c665e7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:31.760607 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07b3a383-0f09-4b1e-90f3-f53ff3c665e7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:31.761200 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07b3a383-0f09-4b1e-90f3-f53ff3c665e7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:31.799586 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-07b3a383-0f09-4b1e-90f3-f53ff3c665e7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Getting quotas for project d6515917885c4f3cb5fb19e05f4e5e2b. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:06:31.812095 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-07b3a383-0f09-4b1e-90f3-f53ff3c665e7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Getting quotas for user b6cddfeca4ce49788143b2bf4b30545f and project d6515917885c4f3cb5fb19e05f4e5e2b. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:06:31.826473 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-07b3a383-0f09-4b1e-90f3-f53ff3c665e7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:06:31.829416 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-07b3a383-0f09-4b1e-90f3-f53ff3c665e7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: efcb289a-74cf-4dd6-a564-27b2255a002f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:06:31.838501 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-fff017c8-dfaf-436e-a667-d63f5acbb2d0 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:06:31.838988 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-fff017c8-dfaf-436e-a667-d63f5acbb2d0 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:06:31.840114 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-fff017c8-dfaf-436e-a667-d63f5acbb2d0 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:06:31.840912 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-fff017c8-dfaf-436e-a667-d63f5acbb2d0 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:06:31.841727 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-fff017c8-dfaf-436e-a667-d63f5acbb2d0 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:06:31.870991 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fff017c8-dfaf-436e-a667-d63f5acbb2d0 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:31.872274 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fff017c8-dfaf-436e-a667-d63f5acbb2d0 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:31.875424 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fff017c8-dfaf-436e-a667-d63f5acbb2d0 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:31.877674 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fff017c8-dfaf-436e-a667-d63f5acbb2d0 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:31.878771 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fff017c8-dfaf-436e-a667-d63f5acbb2d0 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:31.879539 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fff017c8-dfaf-436e-a667-d63f5acbb2d0 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:31.908954 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-fff017c8-dfaf-436e-a667-d63f5acbb2d0 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Getting quotas for project 186ac42922a64992aa1973bd854830d7. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:06:31.917463 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-fff017c8-dfaf-436e-a667-d63f5acbb2d0 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Getting quotas for user 0b8d4ea396494628983bde1a97222f7d and project 186ac42922a64992aa1973bd854830d7. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:06:31.926679 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-07b3a383-0f09-4b1e-90f3-f53ff3c665e7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.773122 Oct 26 13:06:31.932230 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 596/1110] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:06:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:06:31.946576 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0f5af639-5748-491c-91cf-b5341304f532 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:31.947636 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0f5af639-5748-491c-91cf-b5341304f532 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 7fc68c75-8598-4bc7-b96b-852f31f09781] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:31.948476 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fff017c8-dfaf-436e-a667-d63f5acbb2d0 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:06:31.952579 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fff017c8-dfaf-436e-a667-d63f5acbb2d0 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 2803303a-ad72-4096-b524-69a583a56f03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:06:31.999015 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f5af639-5748-491c-91cf-b5341304f532 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:32.001166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f5af639-5748-491c-91cf-b5341304f532 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:32.002876 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f5af639-5748-491c-91cf-b5341304f532 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:32.005870 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f5af639-5748-491c-91cf-b5341304f532 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:32.008817 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f5af639-5748-491c-91cf-b5341304f532 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:32.010027 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f5af639-5748-491c-91cf-b5341304f532 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:32.020112 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fff017c8-dfaf-436e-a667-d63f5acbb2d0 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.499374 Oct 26 13:06:32.021367 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 515/1111] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:06:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1502 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:06:32.028136 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-18664256-7eb8-4e91-8a5c-e6c487c8eae3 req-a0e3b301-ef05-4680-8641-3191478e1f07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fc68c75-8598-4bc7-b96b-852f31f09781", "name": "network-vif-plugged", "status": "completed", "tag": "641e149d-ea99-4cba-8bd0-b9368f1e4296"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:06:32.054742 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-18664256-7eb8-4e91-8a5c-e6c487c8eae3 req-a0e3b301-ef05-4680-8641-3191478e1f07 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:32.061836 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-18664256-7eb8-4e91-8a5c-e6c487c8eae3 req-a0e3b301-ef05-4680-8641-3191478e1f07 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:32.062581 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-18664256-7eb8-4e91-8a5c-e6c487c8eae3 req-a0e3b301-ef05-4680-8641-3191478e1f07 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:32.078851 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-18664256-7eb8-4e91-8a5c-e6c487c8eae3 req-a0e3b301-ef05-4680-8641-3191478e1f07 service nova] Creating event network-vif-plugged:641e149d-ea99-4cba-8bd0-b9368f1e4296 for instance 7fc68c75-8598-4bc7-b96b-852f31f09781 on n-h1-862686-1 Oct 26 13:06:32.084526 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-18664256-7eb8-4e91-8a5c-e6c487c8eae3 req-a0e3b301-ef05-4680-8641-3191478e1f07 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061686 Oct 26 13:06:32.086151 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 516/1112] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:06:32.091340 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3093876d-bfd5-44b3-8ff9-8de5f51ebf68 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:32.092297 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3093876d-bfd5-44b3-8ff9-8de5f51ebf68 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: 249cce52-de17-460b-b445-e24d0d377986] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:32.098986 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3093876d-bfd5-44b3-8ff9-8de5f51ebf68 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:32.099186 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3093876d-bfd5-44b3-8ff9-8de5f51ebf68 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:32.099749 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3093876d-bfd5-44b3-8ff9-8de5f51ebf68 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:32.101278 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3093876d-bfd5-44b3-8ff9-8de5f51ebf68 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:32.101959 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3093876d-bfd5-44b3-8ff9-8de5f51ebf68 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:32.102417 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3093876d-bfd5-44b3-8ff9-8de5f51ebf68 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:32.448567 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0f5af639-5748-491c-91cf-b5341304f532 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:32.464523 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0f5af639-5748-491c-91cf-b5341304f532 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/7fc68c75-8598-4bc7-b96b-852f31f09781" status: 200 len: 1308 microversion: 2.1 time: 0.531094 Oct 26 13:06:32.467967 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 597/1113] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:31 2022] GET /compute/v2.1/servers/7fc68c75-8598-4bc7-b96b-852f31f09781 => generated 1308 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:32.494315 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8a3c05ef-2e3f-4571-ad26-e0ac83e12ff8 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:32.496146 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8a3c05ef-2e3f-4571-ad26-e0ac83e12ff8 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 1c5d8fc5-5c9f-4bdf-81ed-388df5d390de] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:32.506819 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8a3c05ef-2e3f-4571-ad26-e0ac83e12ff8 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:32.507837 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8a3c05ef-2e3f-4571-ad26-e0ac83e12ff8 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:32.508462 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8a3c05ef-2e3f-4571-ad26-e0ac83e12ff8 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:32.509405 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8a3c05ef-2e3f-4571-ad26-e0ac83e12ff8 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:32.510041 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8a3c05ef-2e3f-4571-ad26-e0ac83e12ff8 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:32.511039 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8a3c05ef-2e3f-4571-ad26-e0ac83e12ff8 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:32.752613 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8a3c05ef-2e3f-4571-ad26-e0ac83e12ff8 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:32.768566 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8a3c05ef-2e3f-4571-ad26-e0ac83e12ff8 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/1c5d8fc5-5c9f-4bdf-81ed-388df5d390de" status: 200 len: 1462 microversion: 2.1 time: 0.297263 Oct 26 13:06:32.770315 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 598/1114] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:32 2022] GET /compute/v2.1/servers/1c5d8fc5-5c9f-4bdf-81ed-388df5d390de => generated 1462 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:32.777918 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c884f790-0927-4581-a51b-5744e145804e tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:32.779865 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c884f790-0927-4581-a51b-5744e145804e tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: efcb289a-74cf-4dd6-a564-27b2255a002f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:32.927174 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c884f790-0927-4581-a51b-5744e145804e tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:32.939754 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c884f790-0927-4581-a51b-5744e145804e tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/efcb289a-74cf-4dd6-a564-27b2255a002f" status: 200 len: 1217 microversion: 2.1 time: 0.165645 Oct 26 13:06:32.940644 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 599/1115] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:32 2022] GET /compute/v2.1/servers/efcb289a-74cf-4dd6-a564-27b2255a002f => generated 1217 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:32.964902 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f795062d-97b0-4061-82e0-57a8e10aa223 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:32.965539 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f795062d-97b0-4061-82e0-57a8e10aa223 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 2803303a-ad72-4096-b524-69a583a56f03] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:33.083027 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3093876d-bfd5-44b3-8ff9-8de5f51ebf68 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:33.100007 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3093876d-bfd5-44b3-8ff9-8de5f51ebf68 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986" status: 200 len: 1218 microversion: 2.1 time: 1.012722 Oct 26 13:06:33.102535 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 517/1116] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:32 2022] GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986 => generated 1218 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:33.117197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-50aac7b0-532b-4d22-b8c1-c93c7350730c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:33.119846 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-50aac7b0-532b-4d22-b8c1-c93c7350730c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:33.125549 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f795062d-97b0-4061-82e0-57a8e10aa223 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:33.132308 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-50aac7b0-532b-4d22-b8c1-c93c7350730c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:33.132819 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-50aac7b0-532b-4d22-b8c1-c93c7350730c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:33.133297 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-50aac7b0-532b-4d22-b8c1-c93c7350730c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:33.134062 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-50aac7b0-532b-4d22-b8c1-c93c7350730c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:33.134456 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-50aac7b0-532b-4d22-b8c1-c93c7350730c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:33.134883 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-50aac7b0-532b-4d22-b8c1-c93c7350730c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:33.137165 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f795062d-97b0-4061-82e0-57a8e10aa223 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03" status: 200 len: 1225 microversion: 2.1 time: 0.195434 Oct 26 13:06:33.137978 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 600/1117] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:32 2022] GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03 => generated 1225 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:33.311259 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-173aa8fa-36aa-4f7f-9873-018a615d858b tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:33.317139 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-173aa8fa-36aa-4f7f-9873-018a615d858b tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Searching by: {'deleted': False, 'project_id': '17ef0478ffaf46cc94ae0130bbb4db3c'} {{(pid=120598) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:06:33.326505 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-173aa8fa-36aa-4f7f-9873-018a615d858b tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:33.327358 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-173aa8fa-36aa-4f7f-9873-018a615d858b tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:33.327999 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-173aa8fa-36aa-4f7f-9873-018a615d858b tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:33.329453 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-173aa8fa-36aa-4f7f-9873-018a615d858b tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:33.330269 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-173aa8fa-36aa-4f7f-9873-018a615d858b tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:33.330911 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-173aa8fa-36aa-4f7f-9873-018a615d858b tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:33.443429 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-173aa8fa-36aa-4f7f-9873-018a615d858b tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.303303 Oct 26 13:06:33.445002 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 601/1118] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:06:33 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:06:33.470492 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-dc03bc3d-6a0a-4e2c-9464-903d98b16988 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:33.477238 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-dc03bc3d-6a0a-4e2c-9464-903d98b16988 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Searching by: {'deleted': False} {{(pid=120598) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:06:33.482848 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc03bc3d-6a0a-4e2c-9464-903d98b16988 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:33.483570 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc03bc3d-6a0a-4e2c-9464-903d98b16988 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:33.484413 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc03bc3d-6a0a-4e2c-9464-903d98b16988 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:33.485970 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc03bc3d-6a0a-4e2c-9464-903d98b16988 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:33.486588 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc03bc3d-6a0a-4e2c-9464-903d98b16988 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:33.487167 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc03bc3d-6a0a-4e2c-9464-903d98b16988 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:33.818667 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.multi_cell_list [None req-dc03bc3d-6a0a-4e2c-9464-903d98b16988 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Listed batch of 21 results from cell out of 1000 limit. Returned 21 total so far. {{(pid=120598) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 13:06:33.835975 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-50aac7b0-532b-4d22-b8c1-c93c7350730c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:33.848432 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-50aac7b0-532b-4d22-b8c1-c93c7350730c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 200 len: 1536 microversion: 2.1 time: 0.743016 Oct 26 13:06:33.849211 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 518/1119] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:33 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 1536 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:33.876576 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-71287dfd-1d5f-43e1-b30e-6cea535d2c69 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:33.878995 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-71287dfd-1d5f-43e1-b30e-6cea535d2c69 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 7fc68c75-8598-4bc7-b96b-852f31f09781] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:33.901811 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71287dfd-1d5f-43e1-b30e-6cea535d2c69 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:33.903973 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71287dfd-1d5f-43e1-b30e-6cea535d2c69 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:33.904633 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71287dfd-1d5f-43e1-b30e-6cea535d2c69 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:33.906367 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71287dfd-1d5f-43e1-b30e-6cea535d2c69 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:33.906996 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71287dfd-1d5f-43e1-b30e-6cea535d2c69 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:33.909938 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71287dfd-1d5f-43e1-b30e-6cea535d2c69 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:34.108211 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc03bc3d-6a0a-4e2c-9464-903d98b16988 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:34.109719 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc03bc3d-6a0a-4e2c-9464-903d98b16988 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:34.110326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc03bc3d-6a0a-4e2c-9464-903d98b16988 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:34.296183 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-71287dfd-1d5f-43e1-b30e-6cea535d2c69 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:34.304538 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-71287dfd-1d5f-43e1-b30e-6cea535d2c69 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/7fc68c75-8598-4bc7-b96b-852f31f09781" status: 200 len: 1308 microversion: 2.1 time: 0.436207 Oct 26 13:06:34.305210 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 519/1120] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:33 2022] GET /compute/v2.1/servers/7fc68c75-8598-4bc7-b96b-852f31f09781 => generated 1308 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:34.326322 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7e7f0996-fb30-42f4-b372-2010c17fbf8a tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:34.329324 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7e7f0996-fb30-42f4-b372-2010c17fbf8a tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: efcb289a-74cf-4dd6-a564-27b2255a002f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:34.364227 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e7f0996-fb30-42f4-b372-2010c17fbf8a tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:34.366285 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e7f0996-fb30-42f4-b372-2010c17fbf8a tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:34.368058 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e7f0996-fb30-42f4-b372-2010c17fbf8a tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:34.370582 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e7f0996-fb30-42f4-b372-2010c17fbf8a tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:34.371733 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e7f0996-fb30-42f4-b372-2010c17fbf8a tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:34.374110 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e7f0996-fb30-42f4-b372-2010c17fbf8a tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:34.639802 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7e7f0996-fb30-42f4-b372-2010c17fbf8a tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:34.654826 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7e7f0996-fb30-42f4-b372-2010c17fbf8a tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/efcb289a-74cf-4dd6-a564-27b2255a002f" status: 200 len: 1213 microversion: 2.1 time: 0.346532 Oct 26 13:06:34.655770 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 520/1121] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:34 2022] GET /compute/v2.1/servers/efcb289a-74cf-4dd6-a564-27b2255a002f => generated 1213 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:34.666748 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2c3e191f-ad0a-4f56-b42a-aece15a54016 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:34.667387 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2c3e191f-ad0a-4f56-b42a-aece15a54016 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: 249cce52-de17-460b-b445-e24d0d377986] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:34.681691 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2c3e191f-ad0a-4f56-b42a-aece15a54016 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:34.682576 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2c3e191f-ad0a-4f56-b42a-aece15a54016 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:34.683180 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2c3e191f-ad0a-4f56-b42a-aece15a54016 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:34.684099 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2c3e191f-ad0a-4f56-b42a-aece15a54016 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:34.684879 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2c3e191f-ad0a-4f56-b42a-aece15a54016 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:34.685575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2c3e191f-ad0a-4f56-b42a-aece15a54016 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:34.753575 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-dc03bc3d-6a0a-4e2c-9464-903d98b16988 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 33229 microversion: 2.1 time: 1.286000 Oct 26 13:06:34.754621 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 602/1122] 10.222.0.40 () {58 vars in 1171 bytes} [Wed Oct 26 13:06:33 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 33229 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:06:34.761121 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9c15ac35-a0e0-4981-9be1-4b8ce4f8c7fe tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:34.762573 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9c15ac35-a0e0-4981-9be1-4b8ce4f8c7fe tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 2803303a-ad72-4096-b524-69a583a56f03] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:34.769615 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c15ac35-a0e0-4981-9be1-4b8ce4f8c7fe tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:34.770368 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c15ac35-a0e0-4981-9be1-4b8ce4f8c7fe tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:34.771002 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c15ac35-a0e0-4981-9be1-4b8ce4f8c7fe tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:34.771927 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c15ac35-a0e0-4981-9be1-4b8ce4f8c7fe tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:34.772620 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c15ac35-a0e0-4981-9be1-4b8ce4f8c7fe tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:34.773205 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c15ac35-a0e0-4981-9be1-4b8ce4f8c7fe tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:34.898360 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2c3e191f-ad0a-4f56-b42a-aece15a54016 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:34.905115 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9c15ac35-a0e0-4981-9be1-4b8ce4f8c7fe tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:34.911497 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2c3e191f-ad0a-4f56-b42a-aece15a54016 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986" status: 200 len: 1274 microversion: 2.1 time: 0.254576 Oct 26 13:06:34.912589 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 521/1123] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:34 2022] GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986 => generated 1274 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:34.918310 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2c49431d-d4be-4311-ab49-569338a237b4 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:34.920925 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2c49431d-d4be-4311-ab49-569338a237b4 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:34.925735 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2c49431d-d4be-4311-ab49-569338a237b4 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:34.926436 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2c49431d-d4be-4311-ab49-569338a237b4 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:34.927063 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2c49431d-d4be-4311-ab49-569338a237b4 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:34.927916 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2c49431d-d4be-4311-ab49-569338a237b4 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:34.928563 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2c49431d-d4be-4311-ab49-569338a237b4 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:34.929144 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2c49431d-d4be-4311-ab49-569338a237b4 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:34.936346 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9c15ac35-a0e0-4981-9be1-4b8ce4f8c7fe tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03" status: 200 len: 1221 microversion: 2.1 time: 0.180542 Oct 26 13:06:34.937574 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 603/1124] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:34 2022] GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03 => generated 1221 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:34.943302 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cf223bed-54dd-448d-b49a-942428850ab6 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:34.950559 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cf223bed-54dd-448d-b49a-942428850ab6 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Searching by: {'deleted': False, 'project_id': '17ef0478ffaf46cc94ae0130bbb4db3c'} {{(pid=120598) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:06:34.961347 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf223bed-54dd-448d-b49a-942428850ab6 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:34.962001 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf223bed-54dd-448d-b49a-942428850ab6 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:34.962547 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf223bed-54dd-448d-b49a-942428850ab6 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:34.964402 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf223bed-54dd-448d-b49a-942428850ab6 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:34.969169 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf223bed-54dd-448d-b49a-942428850ab6 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:34.969976 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf223bed-54dd-448d-b49a-942428850ab6 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:35.013259 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cf223bed-54dd-448d-b49a-942428850ab6 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/detail?tenant_id=2f5434aa488d4d5a8bae96746cfd7494" status: 200 len: 15 microversion: 2.1 time: 0.074027 Oct 26 13:06:35.013797 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 604/1125] 10.222.0.40 () {58 vars in 1231 bytes} [Wed Oct 26 13:06:34 2022] GET /compute/v2.1/servers/detail?tenant_id=2f5434aa488d4d5a8bae96746cfd7494 => generated 15 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:06:35.019643 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fd754d37-2168-447c-b112-46b93c6b679d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:35.020265 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fd754d37-2168-447c-b112-46b93c6b679d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:35.026953 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd754d37-2168-447c-b112-46b93c6b679d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:35.027652 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd754d37-2168-447c-b112-46b93c6b679d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:35.028246 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd754d37-2168-447c-b112-46b93c6b679d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:35.029109 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd754d37-2168-447c-b112-46b93c6b679d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:35.030379 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd754d37-2168-447c-b112-46b93c6b679d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:35.030970 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd754d37-2168-447c-b112-46b93c6b679d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:35.186762 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fd754d37-2168-447c-b112-46b93c6b679d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:35.195851 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fd754d37-2168-447c-b112-46b93c6b679d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 200 len: 1529 microversion: 2.1 time: 0.181006 Oct 26 13:06:35.196528 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 605/1126] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:35 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 1529 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:35.201090 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9950452a-44ab-4c39-b934-06b8e27e7d5f tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:35.207697 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9950452a-44ab-4c39-b934-06b8e27e7d5f tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Searching by: {'tenant_id': '2f5434aa488d4d5a8bae96746cfd7494', 'deleted': False} {{(pid=120598) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:06:35.213498 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9950452a-44ab-4c39-b934-06b8e27e7d5f tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:35.214115 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9950452a-44ab-4c39-b934-06b8e27e7d5f tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:35.214708 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9950452a-44ab-4c39-b934-06b8e27e7d5f tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:35.215495 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9950452a-44ab-4c39-b934-06b8e27e7d5f tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:35.216113 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9950452a-44ab-4c39-b934-06b8e27e7d5f tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:35.216682 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9950452a-44ab-4c39-b934-06b8e27e7d5f tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:35.296388 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-2c49431d-d4be-4311-ab49-569338a237b4 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lazy-loading 'services' on Instance uuid f27f0232-1c7a-433d-a8ed-9ef4f631b924 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:06:35.314656 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2c49431d-d4be-4311-ab49-569338a237b4 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924" status: 200 len: 2420 microversion: 2.25 time: 0.400075 Oct 26 13:06:35.316195 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 522/1127] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:06:34 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 => generated 2420 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:06:35.323882 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4a798a87-fcc1-413c-ac75-60c115616b5f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:35.324760 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4a798a87-fcc1-413c-ac75-60c115616b5f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:35.331927 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4a798a87-fcc1-413c-ac75-60c115616b5f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:35.333655 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4a798a87-fcc1-413c-ac75-60c115616b5f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:35.336060 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4a798a87-fcc1-413c-ac75-60c115616b5f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:35.337944 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4a798a87-fcc1-413c-ac75-60c115616b5f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:35.338657 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4a798a87-fcc1-413c-ac75-60c115616b5f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:35.339467 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4a798a87-fcc1-413c-ac75-60c115616b5f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:35.520635 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.multi_cell_list [None req-9950452a-44ab-4c39-b934-06b8e27e7d5f tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120598) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 13:06:35.597444 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:06:35.640644 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9950452a-44ab-4c39-b934-06b8e27e7d5f tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:35.641326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9950452a-44ab-4c39-b934-06b8e27e7d5f tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:35.641951 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9950452a-44ab-4c39-b934-06b8e27e7d5f tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:35.756066 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4a798a87-fcc1-413c-ac75-60c115616b5f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:35.770473 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4a798a87-fcc1-413c-ac75-60c115616b5f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 200 len: 1529 microversion: 2.1 time: 0.452660 Oct 26 13:06:35.796640 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 523/1128] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:35 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 1529 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:35.820508 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2f37e312-e4ea-4404-888f-b07cd4970d23 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:35.823557 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2f37e312-e4ea-4404-888f-b07cd4970d23 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 7fc68c75-8598-4bc7-b96b-852f31f09781] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:35.831073 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2f37e312-e4ea-4404-888f-b07cd4970d23 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:35.831829 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2f37e312-e4ea-4404-888f-b07cd4970d23 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:35.832437 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2f37e312-e4ea-4404-888f-b07cd4970d23 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:35.833444 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2f37e312-e4ea-4404-888f-b07cd4970d23 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:35.834211 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2f37e312-e4ea-4404-888f-b07cd4970d23 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:35.834863 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2f37e312-e4ea-4404-888f-b07cd4970d23 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:35.836557 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9950452a-44ab-4c39-b934-06b8e27e7d5f tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=2f5434aa488d4d5a8bae96746cfd7494" status: 200 len: 4825 microversion: 2.1 time: 0.638711 Oct 26 13:06:35.849594 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 606/1129] 10.222.0.40 () {58 vars in 1257 bytes} [Wed Oct 26 13:06:35 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=2f5434aa488d4d5a8bae96746cfd7494 => generated 4825 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:35.850430 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7d942742-50c0-4b72-aec2-5285d07ba261 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862686-1", "block_migration": "auto"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:06:35.854253 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7d942742-50c0-4b72-aec2-5285d07ba261 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:35.863969 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7d942742-50c0-4b72-aec2-5285d07ba261 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:35.866633 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7d942742-50c0-4b72-aec2-5285d07ba261 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:35.867985 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7d942742-50c0-4b72-aec2-5285d07ba261 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:35.868888 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7d942742-50c0-4b72-aec2-5285d07ba261 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:35.869724 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7d942742-50c0-4b72-aec2-5285d07ba261 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:35.870324 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7d942742-50c0-4b72-aec2-5285d07ba261 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:35.923909 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-7d942742-50c0-4b72-aec2-5285d07ba261 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lazy-loading 'flavor' on Instance uuid f27f0232-1c7a-433d-a8ed-9ef4f631b924 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:06:35.968105 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7d942742-50c0-4b72-aec2-5285d07ba261 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Going to try to live migrate instance to n-h2-862686-1 {{(pid=120598) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 26 13:06:36.331626 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2f37e312-e4ea-4404-888f-b07cd4970d23 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:36.344441 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2f37e312-e4ea-4404-888f-b07cd4970d23 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/7fc68c75-8598-4bc7-b96b-852f31f09781" status: 200 len: 1488 microversion: 2.1 time: 0.537122 Oct 26 13:06:36.369644 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 524/1130] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:35 2022] GET /compute/v2.1/servers/7fc68c75-8598-4bc7-b96b-852f31f09781 => generated 1488 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:36.376787 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cbfca9f9-4c5c-462c-99d9-be9844afa95e tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:36.377702 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cbfca9f9-4c5c-462c-99d9-be9844afa95e tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: efcb289a-74cf-4dd6-a564-27b2255a002f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:36.388507 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cbfca9f9-4c5c-462c-99d9-be9844afa95e tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:36.390017 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cbfca9f9-4c5c-462c-99d9-be9844afa95e tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:36.390904 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cbfca9f9-4c5c-462c-99d9-be9844afa95e tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:36.391907 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cbfca9f9-4c5c-462c-99d9-be9844afa95e tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:36.392517 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cbfca9f9-4c5c-462c-99d9-be9844afa95e tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:36.393115 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cbfca9f9-4c5c-462c-99d9-be9844afa95e tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:36.502531 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cbfca9f9-4c5c-462c-99d9-be9844afa95e tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:36.519997 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cbfca9f9-4c5c-462c-99d9-be9844afa95e tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/efcb289a-74cf-4dd6-a564-27b2255a002f" status: 200 len: 1213 microversion: 2.1 time: 0.148606 Oct 26 13:06:36.526432 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 525/1131] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:36 2022] GET /compute/v2.1/servers/efcb289a-74cf-4dd6-a564-27b2255a002f => generated 1213 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:36.540442 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1346e942-3fe4-48e8-a0d8-333324af5a33 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:36.575780 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-1346e942-3fe4-48e8-a0d8-333324af5a33 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] HTTP exception thrown: Flavor bdaded09-0e46-4d65-bf81-f885dd5c6898 could not be found. Oct 26 13:06:36.578118 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1346e942-3fe4-48e8-a0d8-333324af5a33 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Request method failure captured: Oct 26 13:06:36.578118 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/flavors/bdaded09-0e46-4d65-bf81-f885dd5c6898 HTTP/1.1 Oct 26 13:06:36.578118 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:06:36.578118 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:06:36.578118 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:06:36.578118 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:06:36.578118 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:06:36.578118 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:06:36.578118 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:06:36.578118 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:06:36.578118 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWS_7DGgiCOAsKG7hhQa9k-kvZgE60wa6UHye5RRzNXKhP4Ey6clfuE-nAgnZY6AipSej0Vn3NALhesKCDctY1nBRUpCc6FNqLqSTBUjMgKS0cd24S6fmtwqzQdL4a6TMI6O22gcq-gtTm5xwgLhGoBqcCu7SYTlyGtKliEw9qM5fi_Q Oct 26 13:06:36.578118 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:06:36.578118 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:06:36.578118 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:06:36.578118 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:06:36.578118 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:06:36.578118 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:06:36.578118 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: d672e8734b74406bb0fef1de5a88b7fd Oct 26 13:06:36.578118 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-MigrationsAdminTest-432218603 Oct 26 13:06:36.578118 n-d-862686-1 devstack@n-api.service[120597]: X-Role: admin,member,reader Oct 26 13:06:36.578118 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: admin,member,reader Oct 26 13:06:36.579420 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d672e8734b74406bb0fef1de5a88b7fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d672e8734b74406bb0fef1de5a88b7fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d672e8734b74406bb0fef1de5a88b7fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d672e8734b74406bb0fef1de5a88b7fd"}]}] Oct 26 13:06:36.579420 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-MigrationsAdminTest-432218603 Oct 26 13:06:36.579420 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: d672e8734b74406bb0fef1de5a88b7fd Oct 26 13:06:36.579420 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-MigrationsAdminTest-432218603 Oct 26 13:06:36.579420 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-MigrationsAdminTest-432218603-project-admin Oct 26 13:06:36.579420 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:06:36.579420 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:06:36.579420 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: e9ccaad8c3e644a7b22ace8413875396 Oct 26 13:06:36.579420 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-MigrationsAdminTest-432218603-project-admin Oct 26 13:06:36.579420 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:06:36.579420 n-d-862686-1 devstack@n-api.service[120597]: exception: Flavor bdaded09-0e46-4d65-bf81-f885dd5c6898 could not be found. Oct 26 13:06:36.579420 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'bdaded09-0e46-4d65-bf81-f885dd5c6898'} Oct 26 13:06:36.580246 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:06:36.580246 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:06:36.580246 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 26 13:06:36.580246 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 26 13:06:36.580246 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 26 13:06:36.580246 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 26 13:06:36.580246 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 26 13:06:36.580246 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 26 13:06:36.580246 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 26 13:06:36.580246 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 26 13:06:36.580246 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 13:06:36.580246 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 13:06:36.580246 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 26 13:06:36.580246 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 26 13:06:36.580246 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor bdaded09-0e46-4d65-bf81-f885dd5c6898 could not be found. Oct 26 13:06:36.580246 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:06:36.580246 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:06:36.580246 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:06:36.580246 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:06:36.580246 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:06:36.582050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:06:36.582050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:06:36.582050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:06:36.582050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:06:36.582050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:06:36.582050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 26 13:06:36.582050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:06:36.582050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor bdaded09-0e46-4d65-bf81-f885dd5c6898 could not be found. Oct 26 13:06:36.582050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:06:36.582050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:06:36.582050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:06:36.582050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:06:36.582050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:06:36.582050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:06:36.582050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:06:36.582050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:06:36.582050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor bdaded09-0e46-4d65-bf81-f885dd5c6898 could not be found. Oct 26 13:06:36.582050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:06:36.583139 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1346e942-3fe4-48e8-a0d8-333324af5a33 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Returning 404 to user: Flavor bdaded09-0e46-4d65-bf81-f885dd5c6898 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:06:36.583139 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1346e942-3fe4-48e8-a0d8-333324af5a33 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/bdaded09-0e46-4d65-bf81-f885dd5c6898" status: 404 len: 109 microversion: 2.1 time: 0.048665 Oct 26 13:06:36.589774 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 526/1132] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:06:36 2022] DELETE /compute/v2.1/flavors/bdaded09-0e46-4d65-bf81-f885dd5c6898 => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:06:36.601542 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c9269d76-c7c1-4395-9728-b4820720b825 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:36.637067 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c9269d76-c7c1-4395-9728-b4820720b825 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Searching by: {'tenant_id': '17ef0478ffaf46cc94ae0130bbb4db3c', 'deleted': False} {{(pid=120597) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:06:36.666201 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c9269d76-c7c1-4395-9728-b4820720b825 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:36.667069 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c9269d76-c7c1-4395-9728-b4820720b825 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:36.667170 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c9269d76-c7c1-4395-9728-b4820720b825 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:36.667877 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c9269d76-c7c1-4395-9728-b4820720b825 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:36.668352 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c9269d76-c7c1-4395-9728-b4820720b825 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:36.668810 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c9269d76-c7c1-4395-9728-b4820720b825 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:37.037805 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c9269d76-c7c1-4395-9728-b4820720b825 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=17ef0478ffaf46cc94ae0130bbb4db3c" status: 200 len: 15 microversion: 2.1 time: 0.445545 Oct 26 13:06:37.042417 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 527/1133] 10.222.0.40 () {58 vars in 1257 bytes} [Wed Oct 26 13:06:36 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=17ef0478ffaf46cc94ae0130bbb4db3c => generated 15 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:06:37.059305 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b9e1804a-50ca-4652-b25b-5a93437662ae tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:37.060036 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b9e1804a-50ca-4652-b25b-5a93437662ae tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: 249cce52-de17-460b-b445-e24d0d377986] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:37.071393 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b9e1804a-50ca-4652-b25b-5a93437662ae tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:37.079065 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b9e1804a-50ca-4652-b25b-5a93437662ae tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:37.079826 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b9e1804a-50ca-4652-b25b-5a93437662ae tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:37.080734 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b9e1804a-50ca-4652-b25b-5a93437662ae tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:37.081346 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b9e1804a-50ca-4652-b25b-5a93437662ae tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:37.081954 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b9e1804a-50ca-4652-b25b-5a93437662ae tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:37.249104 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b9e1804a-50ca-4652-b25b-5a93437662ae tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:37.262299 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b9e1804a-50ca-4652-b25b-5a93437662ae tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986" status: 200 len: 1280 microversion: 2.1 time: 0.217297 Oct 26 13:06:37.267111 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 528/1134] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:37 2022] GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986 => generated 1280 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:37.272005 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2e12c974-107e-4ebf-a9a3-ac384c6beefa tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:37.279524 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2e12c974-107e-4ebf-a9a3-ac384c6beefa tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 2803303a-ad72-4096-b524-69a583a56f03] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:37.292325 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e12c974-107e-4ebf-a9a3-ac384c6beefa tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:37.294949 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e12c974-107e-4ebf-a9a3-ac384c6beefa tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:37.298049 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e12c974-107e-4ebf-a9a3-ac384c6beefa tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:37.299046 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e12c974-107e-4ebf-a9a3-ac384c6beefa tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:37.299726 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e12c974-107e-4ebf-a9a3-ac384c6beefa tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:37.300348 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e12c974-107e-4ebf-a9a3-ac384c6beefa tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:37.448921 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2e12c974-107e-4ebf-a9a3-ac384c6beefa tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:37.458745 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2e12c974-107e-4ebf-a9a3-ac384c6beefa tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03" status: 200 len: 1283 microversion: 2.1 time: 0.190363 Oct 26 13:06:37.459332 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 529/1135] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:37 2022] GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03 => generated 1283 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:37.467798 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e4382224-47c8-4a35-b869-aef9fac630c3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:06:37.468325 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e4382224-47c8-4a35-b869-aef9fac630c3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 7fc68c75-8598-4bc7-b96b-852f31f09781] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:37.474299 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e4382224-47c8-4a35-b869-aef9fac630c3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:37.474832 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e4382224-47c8-4a35-b869-aef9fac630c3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:37.476389 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e4382224-47c8-4a35-b869-aef9fac630c3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:37.477793 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e4382224-47c8-4a35-b869-aef9fac630c3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:37.478423 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e4382224-47c8-4a35-b869-aef9fac630c3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:37.478996 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e4382224-47c8-4a35-b869-aef9fac630c3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:37.514775 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:06:37.564950 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e4382224-47c8-4a35-b869-aef9fac630c3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "POST /compute/v2.1/servers/7fc68c75-8598-4bc7-b96b-852f31f09781/action" status: 202 len: 0 microversion: 2.1 time: 0.100577 Oct 26 13:06:37.566391 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 530/1136] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:06:37 2022] POST /compute/v2.1/servers/7fc68c75-8598-4bc7-b96b-852f31f09781/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:06:37.573865 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-77a7c041-ecc4-4ded-9617-247238a4e939 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1069980366", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:06:37.649412 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-77a7c041-ecc4-4ded-9617-247238a4e939 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] validate_networks() for None {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:06:37.869933 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7d942742-50c0-4b72-aec2-5285d07ba261 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924/action" status: 202 len: 0 microversion: 2.25 time: 2.031167 Oct 26 13:06:37.870512 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 607/1137] 10.222.0.40 () {62 vars in 1319 bytes} [Wed Oct 26 13:06:35 2022] POST /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924/action => generated 0 bytes in 2032 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:06:37.885801 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cc8dfe73-02ad-4146-8e37-8674ecbcc6f1 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:37.891915 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cc8dfe73-02ad-4146-8e37-8674ecbcc6f1 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.018402 Oct 26 13:06:37.907646 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 608/1138] 10.222.0.40 () {58 vars in 1189 bytes} [Wed Oct 26 13:06:37 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:06:37.919577 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4b980ed5-267b-4483-8f93-79fce47a3427 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:37.924203 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4b980ed5-267b-4483-8f93-79fce47a3427 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: efcb289a-74cf-4dd6-a564-27b2255a002f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:37.945092 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4b980ed5-267b-4483-8f93-79fce47a3427 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:37.945924 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4b980ed5-267b-4483-8f93-79fce47a3427 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:37.948742 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4b980ed5-267b-4483-8f93-79fce47a3427 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:37.949669 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4b980ed5-267b-4483-8f93-79fce47a3427 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:37.950314 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4b980ed5-267b-4483-8f93-79fce47a3427 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:37.952815 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4b980ed5-267b-4483-8f93-79fce47a3427 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:38.037416 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4b980ed5-267b-4483-8f93-79fce47a3427 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:38.046338 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4b980ed5-267b-4483-8f93-79fce47a3427 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/efcb289a-74cf-4dd6-a564-27b2255a002f" status: 200 len: 1269 microversion: 2.1 time: 0.136974 Oct 26 13:06:38.046766 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 609/1139] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:37 2022] GET /compute/v2.1/servers/efcb289a-74cf-4dd6-a564-27b2255a002f => generated 1269 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:38.051314 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c4d886ad-62d3-40ed-9f74-ed798acb968b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:38.051925 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c4d886ad-62d3-40ed-9f74-ed798acb968b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 7fc68c75-8598-4bc7-b96b-852f31f09781] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:38.062765 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4d886ad-62d3-40ed-9f74-ed798acb968b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:38.063266 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4d886ad-62d3-40ed-9f74-ed798acb968b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:38.063720 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4d886ad-62d3-40ed-9f74-ed798acb968b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:38.064425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4d886ad-62d3-40ed-9f74-ed798acb968b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:38.064882 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4d886ad-62d3-40ed-9f74-ed798acb968b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:38.065308 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4d886ad-62d3-40ed-9f74-ed798acb968b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:38.247393 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c4d886ad-62d3-40ed-9f74-ed798acb968b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:38.256008 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c4d886ad-62d3-40ed-9f74-ed798acb968b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/7fc68c75-8598-4bc7-b96b-852f31f09781" status: 200 len: 1493 microversion: 2.1 time: 0.208213 Oct 26 13:06:38.257647 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 610/1140] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:38 2022] GET /compute/v2.1/servers/7fc68c75-8598-4bc7-b96b-852f31f09781 => generated 1493 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:38.278561 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-afc08e37-59c8-4907-aa59-2e2dafb679ac tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:38.279405 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-afc08e37-59c8-4907-aa59-2e2dafb679ac tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:38.286290 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afc08e37-59c8-4907-aa59-2e2dafb679ac tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:38.286940 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afc08e37-59c8-4907-aa59-2e2dafb679ac tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:38.287451 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afc08e37-59c8-4907-aa59-2e2dafb679ac tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:38.288752 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afc08e37-59c8-4907-aa59-2e2dafb679ac tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:38.289565 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afc08e37-59c8-4907-aa59-2e2dafb679ac tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:38.290269 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afc08e37-59c8-4907-aa59-2e2dafb679ac tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:38.878799 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-afc08e37-59c8-4907-aa59-2e2dafb679ac tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:38.900987 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-afc08e37-59c8-4907-aa59-2e2dafb679ac tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:38.901441 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-afc08e37-59c8-4907-aa59-2e2dafb679ac tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:38.902898 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-afc08e37-59c8-4907-aa59-2e2dafb679ac tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924" status: 200 len: 1812 microversion: 2.25 time: 0.631972 Oct 26 13:06:38.903626 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 611/1141] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:06:38 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 => generated 1812 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:06:38.912629 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e74ab2fa-d5c4-428d-8e7c-9d7bd322b5e1 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:06:38.919453 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e74ab2fa-d5c4-428d-8e7c-9d7bd322b5e1 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:38.932598 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e74ab2fa-d5c4-428d-8e7c-9d7bd322b5e1 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:38.933197 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e74ab2fa-d5c4-428d-8e7c-9d7bd322b5e1 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:38.933708 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e74ab2fa-d5c4-428d-8e7c-9d7bd322b5e1 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:38.934440 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e74ab2fa-d5c4-428d-8e7c-9d7bd322b5e1 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:38.934919 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e74ab2fa-d5c4-428d-8e7c-9d7bd322b5e1 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:38.935382 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e74ab2fa-d5c4-428d-8e7c-9d7bd322b5e1 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:38.989886 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-77a7c041-ecc4-4ded-9617-247238a4e939 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:06:38.990367 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-77a7c041-ecc4-4ded-9617-247238a4e939 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:06:38.990767 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-77a7c041-ecc4-4ded-9617-247238a4e939 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:06:38.991748 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-77a7c041-ecc4-4ded-9617-247238a4e939 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:06:38.992155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-77a7c041-ecc4-4ded-9617-247238a4e939 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:06:39.009589 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-77a7c041-ecc4-4ded-9617-247238a4e939 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:39.014774 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-77a7c041-ecc4-4ded-9617-247238a4e939 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:39.015795 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-77a7c041-ecc4-4ded-9617-247238a4e939 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:39.016634 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-77a7c041-ecc4-4ded-9617-247238a4e939 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:39.017383 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-77a7c041-ecc4-4ded-9617-247238a4e939 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:39.017877 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-77a7c041-ecc4-4ded-9617-247238a4e939 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:39.061420 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-77a7c041-ecc4-4ded-9617-247238a4e939 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Getting quotas for project 443f71d3ffde486b9072df264fea2f53. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:06:39.079994 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-77a7c041-ecc4-4ded-9617-247238a4e939 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Getting quotas for user 03335593029b48dfb19fc9cdf6b382b0 and project 443f71d3ffde486b9072df264fea2f53. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:06:39.091242 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e74ab2fa-d5c4-428d-8e7c-9d7bd322b5e1 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904/action" status: 202 len: 0 microversion: 2.1 time: 0.185683 Oct 26 13:06:39.092526 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 612/1142] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:06:38 2022] POST /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:06:39.099396 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f4c8b90c-57b6-4c69-b281-038ae2f2093e tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:39.101549 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-77a7c041-ecc4-4ded-9617-247238a4e939 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:06:39.102387 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f4c8b90c-57b6-4c69-b281-038ae2f2093e tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: 249cce52-de17-460b-b445-e24d0d377986] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:39.107159 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-77a7c041-ecc4-4ded-9617-247238a4e939 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:06:39.114196 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4c8b90c-57b6-4c69-b281-038ae2f2093e tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:39.115117 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4c8b90c-57b6-4c69-b281-038ae2f2093e tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:39.115820 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4c8b90c-57b6-4c69-b281-038ae2f2093e tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:39.116860 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4c8b90c-57b6-4c69-b281-038ae2f2093e tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:39.117575 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4c8b90c-57b6-4c69-b281-038ae2f2093e tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:39.118248 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4c8b90c-57b6-4c69-b281-038ae2f2093e tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:39.186446 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:06:39.222867 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-77a7c041-ecc4-4ded-9617-247238a4e939 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.654968 Oct 26 13:06:39.228321 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 531/1143] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:06:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:06:39.235253 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-914a916c-f315-489a-91d7-0681d38f14f9 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:39.236916 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-914a916c-f315-489a-91d7-0681d38f14f9 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 2803303a-ad72-4096-b524-69a583a56f03] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:39.247353 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-914a916c-f315-489a-91d7-0681d38f14f9 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:39.248225 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-914a916c-f315-489a-91d7-0681d38f14f9 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:39.248906 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-914a916c-f315-489a-91d7-0681d38f14f9 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:39.250929 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-914a916c-f315-489a-91d7-0681d38f14f9 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:39.251565 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-914a916c-f315-489a-91d7-0681d38f14f9 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:39.252169 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-914a916c-f315-489a-91d7-0681d38f14f9 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:39.371461 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f4c8b90c-57b6-4c69-b281-038ae2f2093e tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:39.381073 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f4c8b90c-57b6-4c69-b281-038ae2f2093e tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986" status: 200 len: 1322 microversion: 2.1 time: 0.285706 Oct 26 13:06:39.384486 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 613/1144] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:39 2022] GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986 => generated 1322 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:39.393503 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f15ff80b-211e-4c14-8338-ded2fa2a10e5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:39.403061 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f15ff80b-211e-4c14-8338-ded2fa2a10e5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: efcb289a-74cf-4dd6-a564-27b2255a002f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:39.418028 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-914a916c-f315-489a-91d7-0681d38f14f9 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:39.418703 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f15ff80b-211e-4c14-8338-ded2fa2a10e5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:39.419542 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f15ff80b-211e-4c14-8338-ded2fa2a10e5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:39.420228 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f15ff80b-211e-4c14-8338-ded2fa2a10e5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:39.421192 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f15ff80b-211e-4c14-8338-ded2fa2a10e5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:39.421756 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f15ff80b-211e-4c14-8338-ded2fa2a10e5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:39.422390 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f15ff80b-211e-4c14-8338-ded2fa2a10e5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:39.430390 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-914a916c-f315-489a-91d7-0681d38f14f9 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03" status: 200 len: 1283 microversion: 2.1 time: 0.199931 Oct 26 13:06:39.431342 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 532/1145] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:39 2022] GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03 => generated 1283 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:39.438354 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-44f99f61-7146-4341-8d26-2cdcc1a740bf tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:39.441917 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-44f99f61-7146-4341-8d26-2cdcc1a740bf tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:39.442943 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-44f99f61-7146-4341-8d26-2cdcc1a740bf tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494'} {{(pid=120597) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:06:39.463816 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-44f99f61-7146-4341-8d26-2cdcc1a740bf tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:39.463816 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-44f99f61-7146-4341-8d26-2cdcc1a740bf tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:39.464110 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-44f99f61-7146-4341-8d26-2cdcc1a740bf tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:39.464659 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-44f99f61-7146-4341-8d26-2cdcc1a740bf tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:39.465112 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-44f99f61-7146-4341-8d26-2cdcc1a740bf tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:39.466086 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-44f99f61-7146-4341-8d26-2cdcc1a740bf tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:39.579398 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f15ff80b-211e-4c14-8338-ded2fa2a10e5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:39.594786 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f15ff80b-211e-4c14-8338-ded2fa2a10e5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/efcb289a-74cf-4dd6-a564-27b2255a002f" status: 200 len: 1275 microversion: 2.1 time: 0.206357 Oct 26 13:06:39.610614 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 614/1146] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:39 2022] GET /compute/v2.1/servers/efcb289a-74cf-4dd6-a564-27b2255a002f => generated 1275 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:39.610614 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-732cece2-e10a-4b9b-bfc1-2f041744c66e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:39.610614 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-732cece2-e10a-4b9b-bfc1-2f041744c66e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:39.695503 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.multi_cell_list [None req-44f99f61-7146-4341-8d26-2cdcc1a740bf tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120597) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 13:06:39.864176 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-44f99f61-7146-4341-8d26-2cdcc1a740bf tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.431277 Oct 26 13:06:39.873042 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 533/1147] 10.222.0.40 () {58 vars in 1150 bytes} [Wed Oct 26 13:06:39 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:06:39.884558 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3a5ed28d-9969-431a-9ac5-010938e9e492 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:39.885170 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3a5ed28d-9969-431a-9ac5-010938e9e492 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 7fc68c75-8598-4bc7-b96b-852f31f09781] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:39.911009 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a5ed28d-9969-431a-9ac5-010938e9e492 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:39.911500 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a5ed28d-9969-431a-9ac5-010938e9e492 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:39.911934 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a5ed28d-9969-431a-9ac5-010938e9e492 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:39.912558 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-732cece2-e10a-4b9b-bfc1-2f041744c66e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:39.913089 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a5ed28d-9969-431a-9ac5-010938e9e492 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:39.913089 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a5ed28d-9969-431a-9ac5-010938e9e492 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:39.913550 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a5ed28d-9969-431a-9ac5-010938e9e492 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:39.925296 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-732cece2-e10a-4b9b-bfc1-2f041744c66e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1213 microversion: 2.1 time: 0.325357 Oct 26 13:06:39.925296 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 615/1148] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:39 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1213 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:39.936784 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c2a1da56-cef7-4837-8a1b-59a5762310b3 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:06:39.943527 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c2a1da56-cef7-4837-8a1b-59a5762310b3 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:39.961242 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2a1da56-cef7-4837-8a1b-59a5762310b3 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:39.962215 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2a1da56-cef7-4837-8a1b-59a5762310b3 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:39.966590 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2a1da56-cef7-4837-8a1b-59a5762310b3 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:39.967708 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2a1da56-cef7-4837-8a1b-59a5762310b3 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:39.968391 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2a1da56-cef7-4837-8a1b-59a5762310b3 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:39.968944 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2a1da56-cef7-4837-8a1b-59a5762310b3 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:40.126556 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c2a1da56-cef7-4837-8a1b-59a5762310b3 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904/action" status: 202 len: 0 microversion: 2.1 time: 0.199464 Oct 26 13:06:40.128559 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 616/1149] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:06:39 2022] POST /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:06:40.142817 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-270274b4-e0cb-44b8-bf54-f940c47a9792 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:40.144421 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-270274b4-e0cb-44b8-bf54-f940c47a9792 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:40.154309 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-270274b4-e0cb-44b8-bf54-f940c47a9792 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:40.155226 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-270274b4-e0cb-44b8-bf54-f940c47a9792 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:40.156079 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-270274b4-e0cb-44b8-bf54-f940c47a9792 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:40.157238 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-270274b4-e0cb-44b8-bf54-f940c47a9792 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:40.158473 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-270274b4-e0cb-44b8-bf54-f940c47a9792 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:40.159200 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-270274b4-e0cb-44b8-bf54-f940c47a9792 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:40.493109 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3a5ed28d-9969-431a-9ac5-010938e9e492 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:40.505016 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3a5ed28d-9969-431a-9ac5-010938e9e492 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/7fc68c75-8598-4bc7-b96b-852f31f09781" status: 200 len: 1473 microversion: 2.1 time: 0.636862 Oct 26 13:06:40.510012 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 534/1150] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:39 2022] GET /compute/v2.1/servers/7fc68c75-8598-4bc7-b96b-852f31f09781 => generated 1473 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:40.517199 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-fdc4aa4a-b7cc-4707-9ed4-0c04e59c3bb0 req-16ba8693-616d-418b-a3d5-3bfc2f0af29d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e4891a-9fbd-42b7-a12c-5a4de9c1f151", "name": "network-vif-plugged", "status": "completed", "tag": "4bacbb43-3b81-44f6-b4ad-82bf06f609ad"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:06:40.545135 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-fdc4aa4a-b7cc-4707-9ed4-0c04e59c3bb0 req-16ba8693-616d-418b-a3d5-3bfc2f0af29d service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:40.550138 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-fdc4aa4a-b7cc-4707-9ed4-0c04e59c3bb0 req-16ba8693-616d-418b-a3d5-3bfc2f0af29d service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:40.550773 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-fdc4aa4a-b7cc-4707-9ed4-0c04e59c3bb0 req-16ba8693-616d-418b-a3d5-3bfc2f0af29d service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:40.578155 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-fdc4aa4a-b7cc-4707-9ed4-0c04e59c3bb0 req-16ba8693-616d-418b-a3d5-3bfc2f0af29d service nova] Creating event network-vif-plugged:4bacbb43-3b81-44f6-b4ad-82bf06f609ad for instance c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 on n-h1-862686-1 Oct 26 13:06:40.587218 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-fdc4aa4a-b7cc-4707-9ed4-0c04e59c3bb0 req-16ba8693-616d-418b-a3d5-3bfc2f0af29d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075611 Oct 26 13:06:40.596534 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 535/1151] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:06:40.615031 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e75e4703-136b-4340-8ad6-27a9c445d2e6 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:40.615967 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e75e4703-136b-4340-8ad6-27a9c445d2e6 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:40.625769 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-270274b4-e0cb-44b8-bf54-f940c47a9792 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:40.626240 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e75e4703-136b-4340-8ad6-27a9c445d2e6 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:40.626802 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e75e4703-136b-4340-8ad6-27a9c445d2e6 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:40.627388 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e75e4703-136b-4340-8ad6-27a9c445d2e6 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:40.628105 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e75e4703-136b-4340-8ad6-27a9c445d2e6 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:40.628862 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e75e4703-136b-4340-8ad6-27a9c445d2e6 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:40.629303 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e75e4703-136b-4340-8ad6-27a9c445d2e6 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:40.656345 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-270274b4-e0cb-44b8-bf54-f940c47a9792 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:40.670367 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-270274b4-e0cb-44b8-bf54-f940c47a9792 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:40.671618 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-270274b4-e0cb-44b8-bf54-f940c47a9792 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924" status: 200 len: 1812 microversion: 2.25 time: 0.541456 Oct 26 13:06:40.672446 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 617/1152] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:06:40 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 => generated 1812 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:06:40.688865 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-069a0aae-4251-4a29-96ed-08653bb54720 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:40.689507 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-069a0aae-4251-4a29-96ed-08653bb54720 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: 249cce52-de17-460b-b445-e24d0d377986] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:40.710987 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-069a0aae-4251-4a29-96ed-08653bb54720 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:40.711393 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-069a0aae-4251-4a29-96ed-08653bb54720 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:40.711834 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-069a0aae-4251-4a29-96ed-08653bb54720 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:40.712549 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-069a0aae-4251-4a29-96ed-08653bb54720 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:40.713005 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-069a0aae-4251-4a29-96ed-08653bb54720 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:40.714096 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-069a0aae-4251-4a29-96ed-08653bb54720 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:41.037244 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e75e4703-136b-4340-8ad6-27a9c445d2e6 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1615 microversion: 2.1 time: 0.432778 Oct 26 13:06:41.037903 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 536/1153] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:40 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1615 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:41.042855 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b8f8aa43-4afe-4115-876e-7c9a138ff621 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:41.043471 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b8f8aa43-4afe-4115-876e-7c9a138ff621 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 2803303a-ad72-4096-b524-69a583a56f03] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:41.065112 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8f8aa43-4afe-4115-876e-7c9a138ff621 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:41.067604 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8f8aa43-4afe-4115-876e-7c9a138ff621 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:41.068085 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8f8aa43-4afe-4115-876e-7c9a138ff621 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:41.069968 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8f8aa43-4afe-4115-876e-7c9a138ff621 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:41.070245 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8f8aa43-4afe-4115-876e-7c9a138ff621 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:41.073129 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8f8aa43-4afe-4115-876e-7c9a138ff621 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:41.161382 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-069a0aae-4251-4a29-96ed-08653bb54720 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:41.172971 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-069a0aae-4251-4a29-96ed-08653bb54720 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986" status: 200 len: 1322 microversion: 2.1 time: 0.499632 Oct 26 13:06:41.174596 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 618/1154] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:40 2022] GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986 => generated 1322 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:41.181418 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-17bee8e9-b2a8-4746-8db6-f68bb6f66ad9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1245484284"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:06:41.184246 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-17bee8e9-b2a8-4746-8db6-f68bb6f66ad9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 7fc68c75-8598-4bc7-b96b-852f31f09781] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:41.194579 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17bee8e9-b2a8-4746-8db6-f68bb6f66ad9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:41.195557 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17bee8e9-b2a8-4746-8db6-f68bb6f66ad9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:41.197727 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17bee8e9-b2a8-4746-8db6-f68bb6f66ad9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:41.200600 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17bee8e9-b2a8-4746-8db6-f68bb6f66ad9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:41.202846 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17bee8e9-b2a8-4746-8db6-f68bb6f66ad9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:41.203484 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17bee8e9-b2a8-4746-8db6-f68bb6f66ad9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:41.615314 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:06:41.726885 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-17bee8e9-b2a8-4746-8db6-f68bb6f66ad9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "POST /compute/v2.1/servers/7fc68c75-8598-4bc7-b96b-852f31f09781/action" status: 202 len: 0 microversion: 2.1 time: 0.550510 Oct 26 13:06:41.730163 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b8f8aa43-4afe-4115-876e-7c9a138ff621 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:41.735409 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 619/1155] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:06:41 2022] POST /compute/v2.1/servers/7fc68c75-8598-4bc7-b96b-852f31f09781/action => generated 0 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 26 13:06:41.743740 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-aa1f3c77-b6c3-4b75-8519-4700da35b365 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:41.744524 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-aa1f3c77-b6c3-4b75-8519-4700da35b365 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: efcb289a-74cf-4dd6-a564-27b2255a002f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:41.745698 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b8f8aa43-4afe-4115-876e-7c9a138ff621 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03" status: 200 len: 1325 microversion: 2.1 time: 0.705585 Oct 26 13:06:41.746546 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 537/1156] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:41 2022] GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03 => generated 1325 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:41.768366 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-27b5b863-0e0a-4e28-b663-5ba68f0363ed tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:41.773167 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-27b5b863-0e0a-4e28-b663-5ba68f0363ed tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:41.773549 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa1f3c77-b6c3-4b75-8519-4700da35b365 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:41.774059 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa1f3c77-b6c3-4b75-8519-4700da35b365 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:41.774566 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa1f3c77-b6c3-4b75-8519-4700da35b365 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:41.776011 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa1f3c77-b6c3-4b75-8519-4700da35b365 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:41.776462 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa1f3c77-b6c3-4b75-8519-4700da35b365 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:41.777033 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa1f3c77-b6c3-4b75-8519-4700da35b365 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:41.797680 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-27b5b863-0e0a-4e28-b663-5ba68f0363ed tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:41.799656 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-27b5b863-0e0a-4e28-b663-5ba68f0363ed tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:41.801820 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-27b5b863-0e0a-4e28-b663-5ba68f0363ed tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:41.808456 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-27b5b863-0e0a-4e28-b663-5ba68f0363ed tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:41.817469 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-27b5b863-0e0a-4e28-b663-5ba68f0363ed tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:41.817469 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-27b5b863-0e0a-4e28-b663-5ba68f0363ed tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:42.114321 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-aa1f3c77-b6c3-4b75-8519-4700da35b365 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:42.132228 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-aa1f3c77-b6c3-4b75-8519-4700da35b365 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/efcb289a-74cf-4dd6-a564-27b2255a002f" status: 200 len: 1317 microversion: 2.1 time: 0.395103 Oct 26 13:06:42.132994 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 620/1157] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:41 2022] GET /compute/v2.1/servers/efcb289a-74cf-4dd6-a564-27b2255a002f => generated 1317 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:42.152894 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cb775ca6-89bc-4b27-a08b-d891889f41ff tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:42.153555 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cb775ca6-89bc-4b27-a08b-d891889f41ff tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:42.169091 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cb775ca6-89bc-4b27-a08b-d891889f41ff tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:42.172571 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cb775ca6-89bc-4b27-a08b-d891889f41ff tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:42.173089 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cb775ca6-89bc-4b27-a08b-d891889f41ff tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:42.173883 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cb775ca6-89bc-4b27-a08b-d891889f41ff tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:42.174359 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cb775ca6-89bc-4b27-a08b-d891889f41ff tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:42.174796 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cb775ca6-89bc-4b27-a08b-d891889f41ff tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:42.203359 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-27b5b863-0e0a-4e28-b663-5ba68f0363ed tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:42.213640 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-27b5b863-0e0a-4e28-b663-5ba68f0363ed tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1265 microversion: 2.1 time: 0.462439 Oct 26 13:06:42.232291 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 538/1158] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:41 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1265 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:42.248018 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dadd3d0b-4447-4be4-b1d0-666cfab7db38 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:42.248906 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-dadd3d0b-4447-4be4-b1d0-666cfab7db38 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:42.263633 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dadd3d0b-4447-4be4-b1d0-666cfab7db38 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:42.265900 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dadd3d0b-4447-4be4-b1d0-666cfab7db38 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:42.266631 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dadd3d0b-4447-4be4-b1d0-666cfab7db38 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:42.268013 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dadd3d0b-4447-4be4-b1d0-666cfab7db38 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:42.271272 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dadd3d0b-4447-4be4-b1d0-666cfab7db38 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:42.274327 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dadd3d0b-4447-4be4-b1d0-666cfab7db38 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:42.517393 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-dadd3d0b-4447-4be4-b1d0-666cfab7db38 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:42.534717 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-dadd3d0b-4447-4be4-b1d0-666cfab7db38 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:42.540572 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-dadd3d0b-4447-4be4-b1d0-666cfab7db38 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:42.545889 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-dadd3d0b-4447-4be4-b1d0-666cfab7db38 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924" status: 200 len: 1812 microversion: 2.25 time: 0.310146 Oct 26 13:06:42.563390 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 539/1159] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:06:42 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 => generated 1812 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:06:42.572819 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8446b5b0-3b0d-4ac4-a5ca-711596161410 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f673251a3a0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:42.656157 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8446b5b0-3b0d-4ac4-a5ca-711596161410 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/ac122a22-843b-441e-bc8c-3e65b4dbcf63" status: 200 len: 1414 microversion: 2.1 time: 0.090522 Oct 26 13:06:42.657412 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 540/1160] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:06:42 2022] GET /compute/v2.1/images/ac122a22-843b-441e-bc8c-3e65b4dbcf63 => generated 1414 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:42.672890 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-618e8a8d-735c-4f6a-83e3-8348fc397280 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:42.674048 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-618e8a8d-735c-4f6a-83e3-8348fc397280 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: 249cce52-de17-460b-b445-e24d0d377986] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:42.690811 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-618e8a8d-735c-4f6a-83e3-8348fc397280 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:42.700579 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-618e8a8d-735c-4f6a-83e3-8348fc397280 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:42.701946 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-618e8a8d-735c-4f6a-83e3-8348fc397280 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:42.705888 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-618e8a8d-735c-4f6a-83e3-8348fc397280 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:42.706461 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-618e8a8d-735c-4f6a-83e3-8348fc397280 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:42.706987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-618e8a8d-735c-4f6a-83e3-8348fc397280 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:42.839727 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cb775ca6-89bc-4b27-a08b-d891889f41ff tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1615 microversion: 2.1 time: 0.704794 Oct 26 13:06:42.842199 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 621/1161] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:42 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1615 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:42.855179 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-637d178b-d2ab-4e51-8506-ea119b7467e5 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:42.856120 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-637d178b-d2ab-4e51-8506-ea119b7467e5 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 2803303a-ad72-4096-b524-69a583a56f03] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:42.876673 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-637d178b-d2ab-4e51-8506-ea119b7467e5 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:42.879210 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-637d178b-d2ab-4e51-8506-ea119b7467e5 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:42.892004 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-637d178b-d2ab-4e51-8506-ea119b7467e5 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:42.895746 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-637d178b-d2ab-4e51-8506-ea119b7467e5 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:42.898628 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-637d178b-d2ab-4e51-8506-ea119b7467e5 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:42.899025 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-637d178b-d2ab-4e51-8506-ea119b7467e5 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:43.354499 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-637d178b-d2ab-4e51-8506-ea119b7467e5 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:43.372314 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-637d178b-d2ab-4e51-8506-ea119b7467e5 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03" status: 200 len: 1325 microversion: 2.1 time: 0.528806 Oct 26 13:06:43.373531 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 622/1162] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:42 2022] GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03 => generated 1325 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:43.379884 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7d5282a7-0b2b-49cd-9d94-b7558d136984 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:43.389457 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7d5282a7-0b2b-49cd-9d94-b7558d136984 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Searching by: {'host': 'n-h2-862686-1', 'deleted': False} {{(pid=120598) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:06:43.394627 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=95 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:06:43.402473 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7d5282a7-0b2b-49cd-9d94-b7558d136984 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:43.404150 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7d5282a7-0b2b-49cd-9d94-b7558d136984 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:43.405096 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7d5282a7-0b2b-49cd-9d94-b7558d136984 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:43.406774 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7d5282a7-0b2b-49cd-9d94-b7558d136984 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:43.407578 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7d5282a7-0b2b-49cd-9d94-b7558d136984 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:43.408292 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7d5282a7-0b2b-49cd-9d94-b7558d136984 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:43.544487 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.multi_cell_list [None req-7d5282a7-0b2b-49cd-9d94-b7558d136984 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Listed batch of 12 results from cell out of 1000 limit. Returned 12 total so far. {{(pid=120598) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 13:06:43.614286 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7d5282a7-0b2b-49cd-9d94-b7558d136984 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] 10.222.0.40 "GET /compute/v2.1/servers?host=n-h2-862686-1&all_tenants=1" status: 200 len: 3957 microversion: 2.1 time: 0.239505 Oct 26 13:06:43.615397 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 623/1163] 10.222.0.40 () {58 vars in 1190 bytes} [Wed Oct 26 13:06:43 2022] GET /compute/v2.1/servers?host=n-h2-862686-1&all_tenants=1 => generated 3957 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:43.621645 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-29167540-b153-464c-a601-e4e31e8b4337 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:43.622438 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-29167540-b153-464c-a601-e4e31e8b4337 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: efcb289a-74cf-4dd6-a564-27b2255a002f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:43.628827 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29167540-b153-464c-a601-e4e31e8b4337 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:43.629569 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29167540-b153-464c-a601-e4e31e8b4337 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:43.630149 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29167540-b153-464c-a601-e4e31e8b4337 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:43.631024 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29167540-b153-464c-a601-e4e31e8b4337 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:43.631715 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29167540-b153-464c-a601-e4e31e8b4337 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:43.633143 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29167540-b153-464c-a601-e4e31e8b4337 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:44.027977 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-29167540-b153-464c-a601-e4e31e8b4337 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:44.039465 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-29167540-b153-464c-a601-e4e31e8b4337 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/efcb289a-74cf-4dd6-a564-27b2255a002f" status: 200 len: 1317 microversion: 2.1 time: 0.418344 Oct 26 13:06:44.040235 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 624/1164] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:43 2022] GET /compute/v2.1/servers/efcb289a-74cf-4dd6-a564-27b2255a002f => generated 1317 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:44.052976 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6c883244-109b-4d87-b024-3a7d6f592fe3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:44.054247 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6c883244-109b-4d87-b024-3a7d6f592fe3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:44.056982 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-618e8a8d-735c-4f6a-83e3-8348fc397280 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:44.065752 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c883244-109b-4d87-b024-3a7d6f592fe3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:44.072665 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c883244-109b-4d87-b024-3a7d6f592fe3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:44.073227 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c883244-109b-4d87-b024-3a7d6f592fe3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:44.074106 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c883244-109b-4d87-b024-3a7d6f592fe3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:44.074670 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c883244-109b-4d87-b024-3a7d6f592fe3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:44.075233 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c883244-109b-4d87-b024-3a7d6f592fe3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:44.079702 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-618e8a8d-735c-4f6a-83e3-8348fc397280 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986" status: 200 len: 1322 microversion: 2.1 time: 1.407706 Oct 26 13:06:44.094283 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 541/1165] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:42 2022] GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986 => generated 1322 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:44.097474 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-18b44d50-021a-4254-8bfe-76614173bb5b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:44.104833 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-18b44d50-021a-4254-8bfe-76614173bb5b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:44.111759 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18b44d50-021a-4254-8bfe-76614173bb5b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:44.112442 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18b44d50-021a-4254-8bfe-76614173bb5b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:44.113146 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18b44d50-021a-4254-8bfe-76614173bb5b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:44.114089 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18b44d50-021a-4254-8bfe-76614173bb5b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:44.114702 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18b44d50-021a-4254-8bfe-76614173bb5b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:44.119497 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18b44d50-021a-4254-8bfe-76614173bb5b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:44.484711 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-18b44d50-021a-4254-8bfe-76614173bb5b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:44.496233 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-18b44d50-021a-4254-8bfe-76614173bb5b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:44.502635 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-18b44d50-021a-4254-8bfe-76614173bb5b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:44.504050 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-18b44d50-021a-4254-8bfe-76614173bb5b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924" status: 200 len: 1812 microversion: 2.25 time: 0.413108 Oct 26 13:06:44.506077 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 542/1166] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:06:44 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 => generated 1812 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:06:44.516378 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6c883244-109b-4d87-b024-3a7d6f592fe3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:44.521403 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-21313b74-4120-4441-91e4-c0cba60c7cbf tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:44.526992 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6c883244-109b-4d87-b024-3a7d6f592fe3 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1313 microversion: 2.1 time: 0.477932 Oct 26 13:06:44.527584 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 625/1167] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:44 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1313 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:44.537067 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-21313b74-4120-4441-91e4-c0cba60c7cbf tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=120597) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:06:44.542983 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-91a173c8-fd36-4d42-b904-fdc2125b681c tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f6732442e50>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:44.545059 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-21313b74-4120-4441-91e4-c0cba60c7cbf tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:44.545609 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-21313b74-4120-4441-91e4-c0cba60c7cbf tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:44.546015 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-21313b74-4120-4441-91e4-c0cba60c7cbf tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:44.546738 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-21313b74-4120-4441-91e4-c0cba60c7cbf tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:44.547192 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-21313b74-4120-4441-91e4-c0cba60c7cbf tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:44.554723 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-21313b74-4120-4441-91e4-c0cba60c7cbf tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:44.625191 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-91a173c8-fd36-4d42-b904-fdc2125b681c tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/ac122a22-843b-441e-bc8c-3e65b4dbcf63" status: 200 len: 1414 microversion: 2.1 time: 0.086151 Oct 26 13:06:44.625809 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 626/1168] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:06:44 2022] GET /compute/v2.1/images/ac122a22-843b-441e-bc8c-3e65b4dbcf63 => generated 1414 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:44.630577 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-0badf9c7-b05e-4890-90cb-e781b5d534e9 req-d5abc332-71c2-45db-8bd1-55dd06a89ca0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efcb289a-74cf-4dd6-a564-27b2255a002f", "tag": "1e95e7b9-0c5b-4a27-a6cd-c1528bee78ad"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:06:44.656499 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-0badf9c7-b05e-4890-90cb-e781b5d534e9 req-d5abc332-71c2-45db-8bd1-55dd06a89ca0 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:44.657242 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-0badf9c7-b05e-4890-90cb-e781b5d534e9 req-d5abc332-71c2-45db-8bd1-55dd06a89ca0 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:44.657856 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-0badf9c7-b05e-4890-90cb-e781b5d534e9 req-d5abc332-71c2-45db-8bd1-55dd06a89ca0 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:44.679640 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-0badf9c7-b05e-4890-90cb-e781b5d534e9 req-d5abc332-71c2-45db-8bd1-55dd06a89ca0 service nova] Creating event network-changed:1e95e7b9-0c5b-4a27-a6cd-c1528bee78ad for instance efcb289a-74cf-4dd6-a564-27b2255a002f on n-h1-862686-1 Oct 26 13:06:44.694678 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-0badf9c7-b05e-4890-90cb-e781b5d534e9 req-d5abc332-71c2-45db-8bd1-55dd06a89ca0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066291 Oct 26 13:06:44.698300 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 627/1169] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:06:44.709410 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2f111395-223c-4db5-a855-7b82c3a657a4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:44.712561 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2f111395-223c-4db5-a855-7b82c3a657a4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 2803303a-ad72-4096-b524-69a583a56f03] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:44.730117 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f111395-223c-4db5-a855-7b82c3a657a4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:44.730949 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f111395-223c-4db5-a855-7b82c3a657a4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:44.731533 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f111395-223c-4db5-a855-7b82c3a657a4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:44.732823 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f111395-223c-4db5-a855-7b82c3a657a4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:44.733668 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-21313b74-4120-4441-91e4-c0cba60c7cbf tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] 10.222.0.40 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.224516 Oct 26 13:06:44.743500 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f111395-223c-4db5-a855-7b82c3a657a4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:44.743712 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 543/1170] 10.222.0.40 () {58 vars in 1196 bytes} [Wed Oct 26 13:06:44 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:06:44.745017 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f111395-223c-4db5-a855-7b82c3a657a4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:44.748652 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f81522fe-74a3-47e0-ad6d-c702d0dcbeca tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:06:44.754272 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f81522fe-74a3-47e0-ad6d-c702d0dcbeca tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:44.783315 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f81522fe-74a3-47e0-ad6d-c702d0dcbeca tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:44.783818 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f81522fe-74a3-47e0-ad6d-c702d0dcbeca tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:44.784268 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f81522fe-74a3-47e0-ad6d-c702d0dcbeca tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:44.784980 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f81522fe-74a3-47e0-ad6d-c702d0dcbeca tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:44.785438 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f81522fe-74a3-47e0-ad6d-c702d0dcbeca tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:44.785897 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f81522fe-74a3-47e0-ad6d-c702d0dcbeca tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:44.997553 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f81522fe-74a3-47e0-ad6d-c702d0dcbeca tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904/action" status: 202 len: 0 microversion: 2.1 time: 0.252477 Oct 26 13:06:44.998346 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 544/1171] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:06:44 2022] POST /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:06:45.010115 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-a91ac525-170a-46bb-b0d6-f603eef03880 req-e93ccdcf-a4e0-4d59-9d44-a1426222db96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "249cce52-de17-460b-b445-e24d0d377986", "tag": "63756a62-388c-4b3a-971b-3d8f25684ca1"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:06:45.039437 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a91ac525-170a-46bb-b0d6-f603eef03880 req-e93ccdcf-a4e0-4d59-9d44-a1426222db96 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:45.041951 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a91ac525-170a-46bb-b0d6-f603eef03880 req-e93ccdcf-a4e0-4d59-9d44-a1426222db96 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:45.042640 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a91ac525-170a-46bb-b0d6-f603eef03880 req-e93ccdcf-a4e0-4d59-9d44-a1426222db96 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:45.070612 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-a91ac525-170a-46bb-b0d6-f603eef03880 req-e93ccdcf-a4e0-4d59-9d44-a1426222db96 service nova] Creating event network-changed:63756a62-388c-4b3a-971b-3d8f25684ca1 for instance 249cce52-de17-460b-b445-e24d0d377986 on n-h1-862686-1 Oct 26 13:06:45.092776 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-a91ac525-170a-46bb-b0d6-f603eef03880 req-e93ccdcf-a4e0-4d59-9d44-a1426222db96 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090555 Oct 26 13:06:45.095299 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 545/1172] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:06:45.107666 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4ce7a8cc-e3d4-4d6a-8a0e-1b3c4b6994d1 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:06:45.119006 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4ce7a8cc-e3d4-4d6a-8a0e-1b3c4b6994d1 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:45.135990 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4ce7a8cc-e3d4-4d6a-8a0e-1b3c4b6994d1 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:45.136775 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4ce7a8cc-e3d4-4d6a-8a0e-1b3c4b6994d1 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:45.137950 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4ce7a8cc-e3d4-4d6a-8a0e-1b3c4b6994d1 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:45.138997 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4ce7a8cc-e3d4-4d6a-8a0e-1b3c4b6994d1 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:45.139615 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4ce7a8cc-e3d4-4d6a-8a0e-1b3c4b6994d1 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:45.140197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4ce7a8cc-e3d4-4d6a-8a0e-1b3c4b6994d1 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:45.341399 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-4ce7a8cc-e3d4-4d6a-8a0e-1b3c4b6994d1 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:06:45.342445 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-4ce7a8cc-e3d4-4d6a-8a0e-1b3c4b6994d1 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:06:45.343538 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-4ce7a8cc-e3d4-4d6a-8a0e-1b3c4b6994d1 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:06:45.344279 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-4ce7a8cc-e3d4-4d6a-8a0e-1b3c4b6994d1 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:06:45.344933 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-4ce7a8cc-e3d4-4d6a-8a0e-1b3c4b6994d1 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:06:45.815933 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2f111395-223c-4db5-a855-7b82c3a657a4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:45.830214 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2f111395-223c-4db5-a855-7b82c3a657a4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03" status: 200 len: 1325 microversion: 2.1 time: 1.130419 Oct 26 13:06:45.831538 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 628/1173] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:44 2022] GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03 => generated 1325 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:45.844306 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c25e6cbc-4176-46c2-9c80-20a0784b8e43 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:45.845304 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c25e6cbc-4176-46c2-9c80-20a0784b8e43 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: efcb289a-74cf-4dd6-a564-27b2255a002f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:45.863224 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c25e6cbc-4176-46c2-9c80-20a0784b8e43 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:45.870830 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c25e6cbc-4176-46c2-9c80-20a0784b8e43 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:45.872192 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c25e6cbc-4176-46c2-9c80-20a0784b8e43 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:45.876382 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c25e6cbc-4176-46c2-9c80-20a0784b8e43 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:45.876997 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c25e6cbc-4176-46c2-9c80-20a0784b8e43 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:45.879797 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c25e6cbc-4176-46c2-9c80-20a0784b8e43 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:46.010387 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4ce7a8cc-e3d4-4d6a-8a0e-1b3c4b6994d1 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:46.027889 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4ce7a8cc-e3d4-4d6a-8a0e-1b3c4b6994d1 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:46.027889 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4ce7a8cc-e3d4-4d6a-8a0e-1b3c4b6994d1 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:46.028271 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4ce7a8cc-e3d4-4d6a-8a0e-1b3c4b6994d1 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:46.028957 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4ce7a8cc-e3d4-4d6a-8a0e-1b3c4b6994d1 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:46.029417 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4ce7a8cc-e3d4-4d6a-8a0e-1b3c4b6994d1 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:46.055605 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4ce7a8cc-e3d4-4d6a-8a0e-1b3c4b6994d1 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:46.072526 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:06:46.184672 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4ce7a8cc-e3d4-4d6a-8a0e-1b3c4b6994d1 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "POST /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904/action" status: 202 len: 1068 microversion: 2.1 time: 1.087903 Oct 26 13:06:46.185328 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 546/1174] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:06:45 2022] POST /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904/action => generated 1068 bytes in 1089 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 26 13:06:46.210870 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9861ac1c-ec97-46cc-b399-4d9851eda091 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:46.211499 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9861ac1c-ec97-46cc-b399-4d9851eda091 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: 249cce52-de17-460b-b445-e24d0d377986] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:46.236427 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9861ac1c-ec97-46cc-b399-4d9851eda091 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:46.236910 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9861ac1c-ec97-46cc-b399-4d9851eda091 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:46.247764 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9861ac1c-ec97-46cc-b399-4d9851eda091 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:46.248686 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9861ac1c-ec97-46cc-b399-4d9851eda091 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:46.249180 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9861ac1c-ec97-46cc-b399-4d9851eda091 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:46.249655 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9861ac1c-ec97-46cc-b399-4d9851eda091 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:47.125701 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c25e6cbc-4176-46c2-9c80-20a0784b8e43 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:47.127132 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9861ac1c-ec97-46cc-b399-4d9851eda091 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:47.139489 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c25e6cbc-4176-46c2-9c80-20a0784b8e43 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/efcb289a-74cf-4dd6-a564-27b2255a002f" status: 200 len: 1317 microversion: 2.1 time: 1.306533 Oct 26 13:06:47.142943 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9861ac1c-ec97-46cc-b399-4d9851eda091 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986" status: 200 len: 1322 microversion: 2.1 time: 0.954813 Oct 26 13:06:47.146512 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 547/1175] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:46 2022] GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986 => generated 1322 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:47.159117 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 629/1176] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:45 2022] GET /compute/v2.1/servers/efcb289a-74cf-4dd6-a564-27b2255a002f => generated 1317 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:47.165000 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b77e3a89-db6f-4cf3-b7c7-e178c8aab00a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:47.169573 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b77e3a89-db6f-4cf3-b7c7-e178c8aab00a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:47.171879 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-84f9cc70-73ac-4409-a538-e81b18337f82 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:47.176084 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-84f9cc70-73ac-4409-a538-e81b18337f82 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:47.192121 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84f9cc70-73ac-4409-a538-e81b18337f82 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:47.193864 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84f9cc70-73ac-4409-a538-e81b18337f82 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:47.196467 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84f9cc70-73ac-4409-a538-e81b18337f82 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:47.198208 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84f9cc70-73ac-4409-a538-e81b18337f82 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:47.198959 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b77e3a89-db6f-4cf3-b7c7-e178c8aab00a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:47.199816 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84f9cc70-73ac-4409-a538-e81b18337f82 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:47.200460 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b77e3a89-db6f-4cf3-b7c7-e178c8aab00a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:47.204082 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84f9cc70-73ac-4409-a538-e81b18337f82 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:47.204249 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b77e3a89-db6f-4cf3-b7c7-e178c8aab00a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:47.208027 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b77e3a89-db6f-4cf3-b7c7-e178c8aab00a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:47.210376 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b77e3a89-db6f-4cf3-b7c7-e178c8aab00a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:47.213231 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b77e3a89-db6f-4cf3-b7c7-e178c8aab00a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:47.930736 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b77e3a89-db6f-4cf3-b7c7-e178c8aab00a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:47.945716 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b77e3a89-db6f-4cf3-b7c7-e178c8aab00a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:47.947285 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b77e3a89-db6f-4cf3-b7c7-e178c8aab00a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:47.951517 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b77e3a89-db6f-4cf3-b7c7-e178c8aab00a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924" status: 200 len: 1812 microversion: 2.25 time: 0.803678 Oct 26 13:06:47.952486 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 548/1177] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:06:47 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 => generated 1812 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:06:47.957402 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f28774be-bcfd-4fa0-95a9-56ee5355fba9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67326561f0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:48.042859 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f28774be-bcfd-4fa0-95a9-56ee5355fba9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/ac122a22-843b-441e-bc8c-3e65b4dbcf63" status: 200 len: 1414 microversion: 2.1 time: 0.088957 Oct 26 13:06:48.043861 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 549/1178] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:06:47 2022] GET /compute/v2.1/images/ac122a22-843b-441e-bc8c-3e65b4dbcf63 => generated 1414 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:48.051585 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-95eeaccf-16de-40b4-8b3a-98c1c58eebea tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:48.052719 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-95eeaccf-16de-40b4-8b3a-98c1c58eebea tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:48.078029 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-95eeaccf-16de-40b4-8b3a-98c1c58eebea tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:48.078688 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-95eeaccf-16de-40b4-8b3a-98c1c58eebea tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:48.079240 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-95eeaccf-16de-40b4-8b3a-98c1c58eebea tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:48.080073 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-95eeaccf-16de-40b4-8b3a-98c1c58eebea tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:48.080652 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-95eeaccf-16de-40b4-8b3a-98c1c58eebea tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:48.081321 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-95eeaccf-16de-40b4-8b3a-98c1c58eebea tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:48.395832 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-84f9cc70-73ac-4409-a538-e81b18337f82 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:48.406623 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-84f9cc70-73ac-4409-a538-e81b18337f82 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1313 microversion: 2.1 time: 1.245259 Oct 26 13:06:48.419964 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 630/1179] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:47 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1313 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:48.425033 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-00cd3ea0-468c-4b8b-b92d-57ca9ec6115e tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:48.426190 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-00cd3ea0-468c-4b8b-b92d-57ca9ec6115e tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 2803303a-ad72-4096-b524-69a583a56f03] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:48.438168 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-00cd3ea0-468c-4b8b-b92d-57ca9ec6115e tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:48.438854 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-00cd3ea0-468c-4b8b-b92d-57ca9ec6115e tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:48.442194 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-00cd3ea0-468c-4b8b-b92d-57ca9ec6115e tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:48.446634 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-00cd3ea0-468c-4b8b-b92d-57ca9ec6115e tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:48.448335 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-00cd3ea0-468c-4b8b-b92d-57ca9ec6115e tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:48.455212 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-00cd3ea0-468c-4b8b-b92d-57ca9ec6115e tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:48.568880 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-95eeaccf-16de-40b4-8b3a-98c1c58eebea tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:48.581597 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-95eeaccf-16de-40b4-8b3a-98c1c58eebea tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1472 microversion: 2.1 time: 0.529907 Oct 26 13:06:48.582560 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 550/1180] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:48 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1472 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:48.587813 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-8ee05198-a770-40de-a6b4-52d149d68edb req-eeb3cadd-527f-4b02-a2ca-83fc4e97d447 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2803303a-ad72-4096-b524-69a583a56f03", "tag": "1d2c7a75-3140-4fe8-a8c6-96801d8b0941"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:06:48.599969 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-8ee05198-a770-40de-a6b4-52d149d68edb req-eeb3cadd-527f-4b02-a2ca-83fc4e97d447 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:48.601884 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-8ee05198-a770-40de-a6b4-52d149d68edb req-eeb3cadd-527f-4b02-a2ca-83fc4e97d447 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:48.602392 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-8ee05198-a770-40de-a6b4-52d149d68edb req-eeb3cadd-527f-4b02-a2ca-83fc4e97d447 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:48.620413 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-8ee05198-a770-40de-a6b4-52d149d68edb req-eeb3cadd-527f-4b02-a2ca-83fc4e97d447 service nova] Creating event network-changed:1d2c7a75-3140-4fe8-a8c6-96801d8b0941 for instance 2803303a-ad72-4096-b524-69a583a56f03 on n-h1-862686-1 Oct 26 13:06:48.626404 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-8ee05198-a770-40de-a6b4-52d149d68edb req-eeb3cadd-527f-4b02-a2ca-83fc4e97d447 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042474 Oct 26 13:06:48.627291 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 551/1181] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:06:48.635863 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e008513c-83d8-4550-b2e8-cbdfcaabba54 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:48.637084 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e008513c-83d8-4550-b2e8-cbdfcaabba54 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: efcb289a-74cf-4dd6-a564-27b2255a002f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:48.644997 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e008513c-83d8-4550-b2e8-cbdfcaabba54 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:48.645932 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e008513c-83d8-4550-b2e8-cbdfcaabba54 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:48.646815 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e008513c-83d8-4550-b2e8-cbdfcaabba54 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:48.649126 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e008513c-83d8-4550-b2e8-cbdfcaabba54 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:48.649893 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e008513c-83d8-4550-b2e8-cbdfcaabba54 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:48.650550 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e008513c-83d8-4550-b2e8-cbdfcaabba54 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:48.958293 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-00cd3ea0-468c-4b8b-b92d-57ca9ec6115e tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:48.969613 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-00cd3ea0-468c-4b8b-b92d-57ca9ec6115e tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03" status: 200 len: 1325 microversion: 2.1 time: 0.548247 Oct 26 13:06:48.975663 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 631/1182] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:48 2022] GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03 => generated 1325 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:48.987701 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-496699f3-c67a-4f63-9fee-2ffb31aadf72 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:48.989717 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-496699f3-c67a-4f63-9fee-2ffb31aadf72 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: 249cce52-de17-460b-b445-e24d0d377986] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:49.010191 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-496699f3-c67a-4f63-9fee-2ffb31aadf72 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:49.011053 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-496699f3-c67a-4f63-9fee-2ffb31aadf72 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:49.012175 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-496699f3-c67a-4f63-9fee-2ffb31aadf72 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:49.014094 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-496699f3-c67a-4f63-9fee-2ffb31aadf72 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:49.018505 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-496699f3-c67a-4f63-9fee-2ffb31aadf72 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:49.019446 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-496699f3-c67a-4f63-9fee-2ffb31aadf72 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:49.061250 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e008513c-83d8-4550-b2e8-cbdfcaabba54 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:49.075525 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e008513c-83d8-4550-b2e8-cbdfcaabba54 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/efcb289a-74cf-4dd6-a564-27b2255a002f" status: 200 len: 1317 microversion: 2.1 time: 0.445283 Oct 26 13:06:49.094497 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 552/1183] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:48 2022] GET /compute/v2.1/servers/efcb289a-74cf-4dd6-a564-27b2255a002f => generated 1317 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:49.099082 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=12 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:06:49.111571 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-9b4123f4-b836-4c13-992e-ea445f31bade req-1c8ee333-c06d-42ef-bf42-4479c973f1d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70961c4d-e68b-4b33-a2ad-1fd612e14a73", "tag": "6310dd0d-823a-4f3c-b6f0-fde873d3af7c"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:06:49.144684 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9b4123f4-b836-4c13-992e-ea445f31bade req-1c8ee333-c06d-42ef-bf42-4479c973f1d7 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:49.145646 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9b4123f4-b836-4c13-992e-ea445f31bade req-1c8ee333-c06d-42ef-bf42-4479c973f1d7 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:49.146316 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9b4123f4-b836-4c13-992e-ea445f31bade req-1c8ee333-c06d-42ef-bf42-4479c973f1d7 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:49.173601 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-9b4123f4-b836-4c13-992e-ea445f31bade req-1c8ee333-c06d-42ef-bf42-4479c973f1d7 service nova] Creating event network-changed:6310dd0d-823a-4f3c-b6f0-fde873d3af7c for instance 70961c4d-e68b-4b33-a2ad-1fd612e14a73 on n-h2-862686-1 Oct 26 13:06:49.183696 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-9b4123f4-b836-4c13-992e-ea445f31bade req-1c8ee333-c06d-42ef-bf42-4479c973f1d7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087813 Oct 26 13:06:49.186435 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 553/1184] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:06:49.193735 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-aad88984-53bc-439a-a1bb-d24af0d303d3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:49.196192 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-aad88984-53bc-439a-a1bb-d24af0d303d3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:49.234161 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aad88984-53bc-439a-a1bb-d24af0d303d3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:49.234954 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aad88984-53bc-439a-a1bb-d24af0d303d3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:49.235176 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aad88984-53bc-439a-a1bb-d24af0d303d3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:49.240485 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aad88984-53bc-439a-a1bb-d24af0d303d3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:49.241818 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aad88984-53bc-439a-a1bb-d24af0d303d3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:49.245083 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aad88984-53bc-439a-a1bb-d24af0d303d3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:49.275229 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-496699f3-c67a-4f63-9fee-2ffb31aadf72 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:49.289498 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-496699f3-c67a-4f63-9fee-2ffb31aadf72 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986" status: 200 len: 1322 microversion: 2.1 time: 0.312174 Oct 26 13:06:49.294837 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 632/1185] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:48 2022] GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986 => generated 1322 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:49.317106 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0b6f82fa-51fc-4a42-9d76-e5018ba57f56 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67325b6940>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:49.448189 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0b6f82fa-51fc-4a42-9d76-e5018ba57f56 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/ac122a22-843b-441e-bc8c-3e65b4dbcf63" status: 200 len: 1414 microversion: 2.1 time: 0.149356 Oct 26 13:06:49.450996 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 633/1186] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:06:49 2022] GET /compute/v2.1/images/ac122a22-843b-441e-bc8c-3e65b4dbcf63 => generated 1414 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:49.469905 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-afbb37c4-6ab9-4ab0-b414-bdfdfd0a8023 req-820c94de-0f08-45f8-9ce1-597b7e8bb94f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fc68c75-8598-4bc7-b96b-852f31f09781", "name": "network-vif-plugged", "status": "completed", "tag": "641e149d-ea99-4cba-8bd0-b9368f1e4296"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:06:49.503581 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-afbb37c4-6ab9-4ab0-b414-bdfdfd0a8023 req-820c94de-0f08-45f8-9ce1-597b7e8bb94f service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:49.519179 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-afbb37c4-6ab9-4ab0-b414-bdfdfd0a8023 req-820c94de-0f08-45f8-9ce1-597b7e8bb94f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:49.519819 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-afbb37c4-6ab9-4ab0-b414-bdfdfd0a8023 req-820c94de-0f08-45f8-9ce1-597b7e8bb94f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:49.549229 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-afbb37c4-6ab9-4ab0-b414-bdfdfd0a8023 req-820c94de-0f08-45f8-9ce1-597b7e8bb94f service nova] Creating event network-vif-plugged:641e149d-ea99-4cba-8bd0-b9368f1e4296 for instance 7fc68c75-8598-4bc7-b96b-852f31f09781 on n-h1-862686-1 Oct 26 13:06:49.562572 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-afbb37c4-6ab9-4ab0-b414-bdfdfd0a8023 req-820c94de-0f08-45f8-9ce1-597b7e8bb94f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107509 Oct 26 13:06:49.563923 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 634/1187] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:06:49.572226 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c7b1d80b-28e3-4ebe-aef1-a1072522a501 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:49.573197 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c7b1d80b-28e3-4ebe-aef1-a1072522a501 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:49.582177 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c7b1d80b-28e3-4ebe-aef1-a1072522a501 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:49.582854 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c7b1d80b-28e3-4ebe-aef1-a1072522a501 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:49.583521 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c7b1d80b-28e3-4ebe-aef1-a1072522a501 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:49.584393 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c7b1d80b-28e3-4ebe-aef1-a1072522a501 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:49.585049 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c7b1d80b-28e3-4ebe-aef1-a1072522a501 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:49.585966 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c7b1d80b-28e3-4ebe-aef1-a1072522a501 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:49.920982 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=22 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:06:49.954997 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-aad88984-53bc-439a-a1bb-d24af0d303d3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:49.975269 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-aad88984-53bc-439a-a1bb-d24af0d303d3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:49.989186 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-aad88984-53bc-439a-a1bb-d24af0d303d3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:49.997730 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-aad88984-53bc-439a-a1bb-d24af0d303d3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924" status: 200 len: 1812 microversion: 2.25 time: 0.805456 Oct 26 13:06:49.999816 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 554/1188] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:06:49 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 => generated 1812 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:06:50.004368 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bb6e0237-caa1-4a03-94d4-43e4cd659cf5 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:50.004993 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bb6e0237-caa1-4a03-94d4-43e4cd659cf5 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:50.029499 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb6e0237-caa1-4a03-94d4-43e4cd659cf5 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:50.030311 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb6e0237-caa1-4a03-94d4-43e4cd659cf5 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:50.030941 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb6e0237-caa1-4a03-94d4-43e4cd659cf5 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:50.036409 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb6e0237-caa1-4a03-94d4-43e4cd659cf5 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:50.037343 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb6e0237-caa1-4a03-94d4-43e4cd659cf5 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:50.038238 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb6e0237-caa1-4a03-94d4-43e4cd659cf5 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:50.047017 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c7b1d80b-28e3-4ebe-aef1-a1072522a501 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:50.068022 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c7b1d80b-28e3-4ebe-aef1-a1072522a501 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1313 microversion: 2.1 time: 0.492250 Oct 26 13:06:50.070156 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 635/1189] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:49 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1313 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:50.074989 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e7bcfeae-4473-4bbd-a10e-fb4a83cd92f9 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:50.075597 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e7bcfeae-4473-4bbd-a10e-fb4a83cd92f9 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 2803303a-ad72-4096-b524-69a583a56f03] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:50.110452 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e7bcfeae-4473-4bbd-a10e-fb4a83cd92f9 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:50.112166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e7bcfeae-4473-4bbd-a10e-fb4a83cd92f9 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:50.112628 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e7bcfeae-4473-4bbd-a10e-fb4a83cd92f9 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:50.114583 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e7bcfeae-4473-4bbd-a10e-fb4a83cd92f9 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:50.117243 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e7bcfeae-4473-4bbd-a10e-fb4a83cd92f9 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:50.117911 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e7bcfeae-4473-4bbd-a10e-fb4a83cd92f9 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:50.309984 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bb6e0237-caa1-4a03-94d4-43e4cd659cf5 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:50.319294 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bb6e0237-caa1-4a03-94d4-43e4cd659cf5 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1472 microversion: 2.1 time: 0.318577 Oct 26 13:06:50.319743 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 555/1190] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:49 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1472 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:50.343411 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b0f53679-4d81-4235-93b9-69e3743ea84f tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:50.344325 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b0f53679-4d81-4235-93b9-69e3743ea84f tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: efcb289a-74cf-4dd6-a564-27b2255a002f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:50.351252 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b0f53679-4d81-4235-93b9-69e3743ea84f tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:50.352015 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b0f53679-4d81-4235-93b9-69e3743ea84f tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:50.352618 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b0f53679-4d81-4235-93b9-69e3743ea84f tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:50.353621 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b0f53679-4d81-4235-93b9-69e3743ea84f tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:50.354422 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b0f53679-4d81-4235-93b9-69e3743ea84f tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:50.355024 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b0f53679-4d81-4235-93b9-69e3743ea84f tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:50.375723 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e7bcfeae-4473-4bbd-a10e-fb4a83cd92f9 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:50.383742 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e7bcfeae-4473-4bbd-a10e-fb4a83cd92f9 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03" status: 200 len: 1325 microversion: 2.1 time: 0.312493 Oct 26 13:06:50.398938 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 636/1191] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:50 2022] GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03 => generated 1325 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:50.406072 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-207c0fbf-acdc-442c-b525-77ab57f0d7ed tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:50.406686 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-207c0fbf-acdc-442c-b525-77ab57f0d7ed tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: 249cce52-de17-460b-b445-e24d0d377986] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:50.414537 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-207c0fbf-acdc-442c-b525-77ab57f0d7ed tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:50.415275 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-207c0fbf-acdc-442c-b525-77ab57f0d7ed tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:50.415891 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-207c0fbf-acdc-442c-b525-77ab57f0d7ed tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:50.416784 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-207c0fbf-acdc-442c-b525-77ab57f0d7ed tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:50.417384 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-207c0fbf-acdc-442c-b525-77ab57f0d7ed tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:50.418287 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-207c0fbf-acdc-442c-b525-77ab57f0d7ed tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:50.839955 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-207c0fbf-acdc-442c-b525-77ab57f0d7ed tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:50.883457 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-207c0fbf-acdc-442c-b525-77ab57f0d7ed tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986" status: 200 len: 1322 microversion: 2.1 time: 0.482965 Oct 26 13:06:50.884160 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 637/1192] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:50 2022] GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986 => generated 1322 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:50.894456 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-07c20446-1d7a-4327-8cb9-cbcd4bf3977d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67328074c0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:50.978837 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-07c20446-1d7a-4327-8cb9-cbcd4bf3977d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/ac122a22-843b-441e-bc8c-3e65b4dbcf63" status: 200 len: 1414 microversion: 2.1 time: 0.093602 Oct 26 13:06:50.979945 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 638/1193] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:06:50 2022] GET /compute/v2.1/images/ac122a22-843b-441e-bc8c-3e65b4dbcf63 => generated 1414 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:51.027532 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-174b5c15-1ed3-429a-8c3c-3e6c0f1ccd4b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:51.028409 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-174b5c15-1ed3-429a-8c3c-3e6c0f1ccd4b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:51.041025 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-174b5c15-1ed3-429a-8c3c-3e6c0f1ccd4b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:51.041815 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-174b5c15-1ed3-429a-8c3c-3e6c0f1ccd4b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:51.042440 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-174b5c15-1ed3-429a-8c3c-3e6c0f1ccd4b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:51.043337 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-174b5c15-1ed3-429a-8c3c-3e6c0f1ccd4b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:51.043958 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-174b5c15-1ed3-429a-8c3c-3e6c0f1ccd4b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:51.044569 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-174b5c15-1ed3-429a-8c3c-3e6c0f1ccd4b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:51.082201 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:06:51.540678 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-174b5c15-1ed3-429a-8c3c-3e6c0f1ccd4b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:51.555850 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-174b5c15-1ed3-429a-8c3c-3e6c0f1ccd4b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:51.561714 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-174b5c15-1ed3-429a-8c3c-3e6c0f1ccd4b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:51.567355 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-174b5c15-1ed3-429a-8c3c-3e6c0f1ccd4b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924" status: 200 len: 1812 microversion: 2.25 time: 0.542174 Oct 26 13:06:51.569726 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 639/1194] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:06:51 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 => generated 1812 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:06:51.583069 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f13da772-135c-4701-8aad-2bdd09b22967 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:51.588109 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f13da772-135c-4701-8aad-2bdd09b22967 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:51.602105 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f13da772-135c-4701-8aad-2bdd09b22967 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:51.602340 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f13da772-135c-4701-8aad-2bdd09b22967 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:51.602718 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f13da772-135c-4701-8aad-2bdd09b22967 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:51.603453 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f13da772-135c-4701-8aad-2bdd09b22967 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:51.604153 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f13da772-135c-4701-8aad-2bdd09b22967 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:51.609228 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f13da772-135c-4701-8aad-2bdd09b22967 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:51.961327 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b0f53679-4d81-4235-93b9-69e3743ea84f tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:51.970207 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b0f53679-4d81-4235-93b9-69e3743ea84f tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/efcb289a-74cf-4dd6-a564-27b2255a002f" status: 200 len: 1317 microversion: 2.1 time: 1.634932 Oct 26 13:06:51.989197 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 556/1195] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:50 2022] GET /compute/v2.1/servers/efcb289a-74cf-4dd6-a564-27b2255a002f => generated 1317 bytes in 1655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:52.001471 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-11275840-7004-4086-8ec9-052e514466f5 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:52.005118 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f13da772-135c-4701-8aad-2bdd09b22967 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:52.006062 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-11275840-7004-4086-8ec9-052e514466f5 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:52.024304 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-11275840-7004-4086-8ec9-052e514466f5 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:52.024821 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f13da772-135c-4701-8aad-2bdd09b22967 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1313 microversion: 2.1 time: 0.451096 Oct 26 13:06:52.025449 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-11275840-7004-4086-8ec9-052e514466f5 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:52.037088 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 640/1196] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:51 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1313 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:52.037088 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c2341dd9-0784-4db9-b0ae-5c4d76e4d011 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:52.037088 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c2341dd9-0784-4db9-b0ae-5c4d76e4d011 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 2803303a-ad72-4096-b524-69a583a56f03] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:52.038731 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-11275840-7004-4086-8ec9-052e514466f5 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:52.039739 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-11275840-7004-4086-8ec9-052e514466f5 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:52.043082 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2341dd9-0784-4db9-b0ae-5c4d76e4d011 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:52.043082 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2341dd9-0784-4db9-b0ae-5c4d76e4d011 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:52.043082 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2341dd9-0784-4db9-b0ae-5c4d76e4d011 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:52.043518 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-11275840-7004-4086-8ec9-052e514466f5 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:52.043610 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2341dd9-0784-4db9-b0ae-5c4d76e4d011 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:52.043691 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-11275840-7004-4086-8ec9-052e514466f5 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:52.043781 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2341dd9-0784-4db9-b0ae-5c4d76e4d011 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:52.044247 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2341dd9-0784-4db9-b0ae-5c4d76e4d011 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:52.259029 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c2341dd9-0784-4db9-b0ae-5c4d76e4d011 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:52.292258 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c2341dd9-0784-4db9-b0ae-5c4d76e4d011 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03" status: 200 len: 1325 microversion: 2.1 time: 0.265241 Oct 26 13:06:52.292869 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 641/1197] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:52 2022] GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03 => generated 1325 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:52.316319 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-8c8b9352-ebe6-4459-938b-c53d826eb137 req-c7cac0e8-a9c8-4d78-a6c4-62292008ed47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efcb289a-74cf-4dd6-a564-27b2255a002f", "name": "network-vif-plugged", "status": "completed", "tag": "1e95e7b9-0c5b-4a27-a6cd-c1528bee78ad"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:06:52.341761 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8c8b9352-ebe6-4459-938b-c53d826eb137 req-c7cac0e8-a9c8-4d78-a6c4-62292008ed47 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:52.342247 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8c8b9352-ebe6-4459-938b-c53d826eb137 req-c7cac0e8-a9c8-4d78-a6c4-62292008ed47 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:52.343048 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8c8b9352-ebe6-4459-938b-c53d826eb137 req-c7cac0e8-a9c8-4d78-a6c4-62292008ed47 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:52.368968 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-8c8b9352-ebe6-4459-938b-c53d826eb137 req-c7cac0e8-a9c8-4d78-a6c4-62292008ed47 service nova] Creating event network-vif-plugged:1e95e7b9-0c5b-4a27-a6cd-c1528bee78ad for instance efcb289a-74cf-4dd6-a564-27b2255a002f on n-h1-862686-1 Oct 26 13:06:52.387289 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-8c8b9352-ebe6-4459-938b-c53d826eb137 req-c7cac0e8-a9c8-4d78-a6c4-62292008ed47 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080032 Oct 26 13:06:52.388190 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 642/1198] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:06:52.400057 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f28dc485-080c-49b7-bd12-2943cdf48aa6 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:52.401045 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f28dc485-080c-49b7-bd12-2943cdf48aa6 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: 249cce52-de17-460b-b445-e24d0d377986] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:52.417507 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f28dc485-080c-49b7-bd12-2943cdf48aa6 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:52.418212 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f28dc485-080c-49b7-bd12-2943cdf48aa6 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:52.418823 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f28dc485-080c-49b7-bd12-2943cdf48aa6 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:52.419704 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f28dc485-080c-49b7-bd12-2943cdf48aa6 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:52.420322 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f28dc485-080c-49b7-bd12-2943cdf48aa6 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:52.421993 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f28dc485-080c-49b7-bd12-2943cdf48aa6 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:52.430615 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-11275840-7004-4086-8ec9-052e514466f5 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:52.439213 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-11275840-7004-4086-8ec9-052e514466f5 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1472 microversion: 2.1 time: 0.448616 Oct 26 13:06:52.443620 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 557/1199] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:51 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1472 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:52.449832 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bb869d3f-d44b-45a7-b403-c2e9cae80420 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67326e25e0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:52.499259 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bb869d3f-d44b-45a7-b403-c2e9cae80420 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/ac122a22-843b-441e-bc8c-3e65b4dbcf63" status: 200 len: 1414 microversion: 2.1 time: 0.053332 Oct 26 13:06:52.501038 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 558/1200] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:06:52 2022] GET /compute/v2.1/images/ac122a22-843b-441e-bc8c-3e65b4dbcf63 => generated 1414 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:52.597113 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c60fdb05-9ae3-462b-a253-e3dac1cbbdc2 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:52.598264 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c60fdb05-9ae3-462b-a253-e3dac1cbbdc2 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:52.606067 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c60fdb05-9ae3-462b-a253-e3dac1cbbdc2 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:52.606818 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c60fdb05-9ae3-462b-a253-e3dac1cbbdc2 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:52.607484 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c60fdb05-9ae3-462b-a253-e3dac1cbbdc2 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:52.608513 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c60fdb05-9ae3-462b-a253-e3dac1cbbdc2 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:52.609137 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c60fdb05-9ae3-462b-a253-e3dac1cbbdc2 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:52.609786 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c60fdb05-9ae3-462b-a253-e3dac1cbbdc2 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:52.744487 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f28dc485-080c-49b7-bd12-2943cdf48aa6 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:52.760189 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f28dc485-080c-49b7-bd12-2943cdf48aa6 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986" status: 200 len: 1322 microversion: 2.1 time: 0.370597 Oct 26 13:06:52.761658 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 643/1201] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:52 2022] GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986 => generated 1322 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:52.783092 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c60fdb05-9ae3-462b-a253-e3dac1cbbdc2 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:52.794861 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c60fdb05-9ae3-462b-a253-e3dac1cbbdc2 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:52.796603 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c60fdb05-9ae3-462b-a253-e3dac1cbbdc2 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:52.798163 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c60fdb05-9ae3-462b-a253-e3dac1cbbdc2 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924" status: 200 len: 1812 microversion: 2.25 time: 0.205839 Oct 26 13:06:52.811947 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 559/1202] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:06:52 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 => generated 1812 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:06:53.000098 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7e2275fe-8aef-4912-833f-3b762171d099 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:53.001314 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7e2275fe-8aef-4912-833f-3b762171d099 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: efcb289a-74cf-4dd6-a564-27b2255a002f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:53.020618 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e2275fe-8aef-4912-833f-3b762171d099 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:53.021430 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e2275fe-8aef-4912-833f-3b762171d099 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:53.022020 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e2275fe-8aef-4912-833f-3b762171d099 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:53.023431 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e2275fe-8aef-4912-833f-3b762171d099 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:53.023993 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e2275fe-8aef-4912-833f-3b762171d099 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:53.025437 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e2275fe-8aef-4912-833f-3b762171d099 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:53.052527 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-551be807-c18b-4ef5-8dcb-a5cf4889e912 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:53.054350 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-551be807-c18b-4ef5-8dcb-a5cf4889e912 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:53.062827 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-551be807-c18b-4ef5-8dcb-a5cf4889e912 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:53.064366 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-551be807-c18b-4ef5-8dcb-a5cf4889e912 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:53.070544 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-551be807-c18b-4ef5-8dcb-a5cf4889e912 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:53.071812 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-551be807-c18b-4ef5-8dcb-a5cf4889e912 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:53.072453 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-551be807-c18b-4ef5-8dcb-a5cf4889e912 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:53.073834 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-551be807-c18b-4ef5-8dcb-a5cf4889e912 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:53.285274 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-551be807-c18b-4ef5-8dcb-a5cf4889e912 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:53.295103 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-551be807-c18b-4ef5-8dcb-a5cf4889e912 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1313 microversion: 2.1 time: 0.247880 Oct 26 13:06:53.296968 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 560/1203] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:53 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:53.318752 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4f06c671-d322-4ad6-aed2-ba4ba74d7df4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:53.319849 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4f06c671-d322-4ad6-aed2-ba4ba74d7df4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 2803303a-ad72-4096-b524-69a583a56f03] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:53.331286 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f06c671-d322-4ad6-aed2-ba4ba74d7df4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:53.332037 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f06c671-d322-4ad6-aed2-ba4ba74d7df4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:53.332687 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f06c671-d322-4ad6-aed2-ba4ba74d7df4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:53.333640 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f06c671-d322-4ad6-aed2-ba4ba74d7df4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:53.334254 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f06c671-d322-4ad6-aed2-ba4ba74d7df4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:53.334882 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f06c671-d322-4ad6-aed2-ba4ba74d7df4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:53.420843 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7e2275fe-8aef-4912-833f-3b762171d099 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:53.429263 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7e2275fe-8aef-4912-833f-3b762171d099 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/efcb289a-74cf-4dd6-a564-27b2255a002f" status: 200 len: 1317 microversion: 2.1 time: 0.434103 Oct 26 13:06:53.439118 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 644/1204] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:52 2022] GET /compute/v2.1/servers/efcb289a-74cf-4dd6-a564-27b2255a002f => generated 1317 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:53.463742 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-216f749e-8fcf-4132-a1b4-2720ebcfa6eb tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:53.464419 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-216f749e-8fcf-4132-a1b4-2720ebcfa6eb tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:53.466406 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=14 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:06:53.475724 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-216f749e-8fcf-4132-a1b4-2720ebcfa6eb tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:53.476229 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-216f749e-8fcf-4132-a1b4-2720ebcfa6eb tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:53.476676 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-216f749e-8fcf-4132-a1b4-2720ebcfa6eb tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:53.477396 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-216f749e-8fcf-4132-a1b4-2720ebcfa6eb tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:53.489097 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-216f749e-8fcf-4132-a1b4-2720ebcfa6eb tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:53.489590 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-216f749e-8fcf-4132-a1b4-2720ebcfa6eb tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:53.573145 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4f06c671-d322-4ad6-aed2-ba4ba74d7df4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:53.582994 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4f06c671-d322-4ad6-aed2-ba4ba74d7df4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03" status: 200 len: 1325 microversion: 2.1 time: 0.268182 Oct 26 13:06:53.583589 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 561/1205] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:53 2022] GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03 => generated 1325 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:53.589454 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1f6090a2-d459-40ff-afb1-078cce151ec6 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f6732715ee0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:53.648627 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1f6090a2-d459-40ff-afb1-078cce151ec6 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/ac122a22-843b-441e-bc8c-3e65b4dbcf63" status: 200 len: 1414 microversion: 2.1 time: 0.062260 Oct 26 13:06:53.649457 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 562/1206] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:06:53 2022] GET /compute/v2.1/images/ac122a22-843b-441e-bc8c-3e65b4dbcf63 => generated 1414 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:53.789056 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-59b176ac-8692-4582-a5de-ce1a0ff3ad6c tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:53.789970 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-59b176ac-8692-4582-a5de-ce1a0ff3ad6c tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: 249cce52-de17-460b-b445-e24d0d377986] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:53.808253 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59b176ac-8692-4582-a5de-ce1a0ff3ad6c tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:53.808768 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59b176ac-8692-4582-a5de-ce1a0ff3ad6c tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:53.809212 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59b176ac-8692-4582-a5de-ce1a0ff3ad6c tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:53.809987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59b176ac-8692-4582-a5de-ce1a0ff3ad6c tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:53.810448 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59b176ac-8692-4582-a5de-ce1a0ff3ad6c tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:53.810878 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59b176ac-8692-4582-a5de-ce1a0ff3ad6c tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:53.973717 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-216f749e-8fcf-4132-a1b4-2720ebcfa6eb tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:53.983797 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-216f749e-8fcf-4132-a1b4-2720ebcfa6eb tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1472 microversion: 2.1 time: 0.523427 Oct 26 13:06:53.988894 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 645/1207] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:53 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1472 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:06:53.997325 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-934646af-f346-4b1a-9dfa-0a58dc3e9dc6 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:54.014806 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-934646af-f346-4b1a-9dfa-0a58dc3e9dc6 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:54.036833 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-934646af-f346-4b1a-9dfa-0a58dc3e9dc6 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:54.037605 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-934646af-f346-4b1a-9dfa-0a58dc3e9dc6 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:54.038936 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-934646af-f346-4b1a-9dfa-0a58dc3e9dc6 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:54.047275 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-934646af-f346-4b1a-9dfa-0a58dc3e9dc6 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:54.047883 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-934646af-f346-4b1a-9dfa-0a58dc3e9dc6 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:54.048410 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-934646af-f346-4b1a-9dfa-0a58dc3e9dc6 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:54.123408 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-59b176ac-8692-4582-a5de-ce1a0ff3ad6c tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:54.135528 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-59b176ac-8692-4582-a5de-ce1a0ff3ad6c tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986" status: 200 len: 1322 microversion: 2.1 time: 0.354907 Oct 26 13:06:54.150656 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 563/1208] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:53 2022] GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986 => generated 1322 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:06:54.322347 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2b59f164-d44f-4444-915a-3f33ccba6322 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:54.322969 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2b59f164-d44f-4444-915a-3f33ccba6322 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:54.342469 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b59f164-d44f-4444-915a-3f33ccba6322 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:54.342988 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b59f164-d44f-4444-915a-3f33ccba6322 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:54.344882 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b59f164-d44f-4444-915a-3f33ccba6322 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:54.347481 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b59f164-d44f-4444-915a-3f33ccba6322 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:54.347980 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b59f164-d44f-4444-915a-3f33ccba6322 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:54.348426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b59f164-d44f-4444-915a-3f33ccba6322 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:54.361173 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-934646af-f346-4b1a-9dfa-0a58dc3e9dc6 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:54.379511 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-934646af-f346-4b1a-9dfa-0a58dc3e9dc6 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:54.390191 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-934646af-f346-4b1a-9dfa-0a58dc3e9dc6 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:54.395194 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-934646af-f346-4b1a-9dfa-0a58dc3e9dc6 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924" status: 200 len: 1812 microversion: 2.25 time: 0.404829 Oct 26 13:06:54.399158 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 646/1209] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:06:53 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 => generated 1812 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:06:54.466856 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d51a1494-923e-4d31-bbb4-1d56f8231326 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:54.472914 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d51a1494-923e-4d31-bbb4-1d56f8231326 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: efcb289a-74cf-4dd6-a564-27b2255a002f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:54.487372 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d51a1494-923e-4d31-bbb4-1d56f8231326 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:54.489690 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d51a1494-923e-4d31-bbb4-1d56f8231326 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:54.490758 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d51a1494-923e-4d31-bbb4-1d56f8231326 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:54.493001 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d51a1494-923e-4d31-bbb4-1d56f8231326 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:54.495776 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d51a1494-923e-4d31-bbb4-1d56f8231326 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:54.496729 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d51a1494-923e-4d31-bbb4-1d56f8231326 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:54.611592 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2b59f164-d44f-4444-915a-3f33ccba6322 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:54.618762 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=10 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:06:54.623548 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2b59f164-d44f-4444-915a-3f33ccba6322 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1313 microversion: 2.1 time: 0.306749 Oct 26 13:06:54.638370 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 564/1210] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:54 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1313 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:54.645967 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2e585518-646d-4bd6-9e2b-1c30a58ff385 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:54.646793 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2e585518-646d-4bd6-9e2b-1c30a58ff385 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 2803303a-ad72-4096-b524-69a583a56f03] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:54.657027 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e585518-646d-4bd6-9e2b-1c30a58ff385 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:54.657812 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e585518-646d-4bd6-9e2b-1c30a58ff385 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:54.658472 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e585518-646d-4bd6-9e2b-1c30a58ff385 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:54.659489 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e585518-646d-4bd6-9e2b-1c30a58ff385 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:54.660283 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e585518-646d-4bd6-9e2b-1c30a58ff385 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:54.661184 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e585518-646d-4bd6-9e2b-1c30a58ff385 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:54.844309 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2e585518-646d-4bd6-9e2b-1c30a58ff385 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:54.858858 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2e585518-646d-4bd6-9e2b-1c30a58ff385 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03" status: 200 len: 1325 microversion: 2.1 time: 0.219052 Oct 26 13:06:54.860673 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 565/1211] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:54 2022] GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03 => generated 1325 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:54.870339 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9031e355-3a4b-499a-97bc-d5b7a4edd12a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f6732693160>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:54.934593 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9031e355-3a4b-499a-97bc-d5b7a4edd12a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/ac122a22-843b-441e-bc8c-3e65b4dbcf63" status: 200 len: 1414 microversion: 2.1 time: 0.072365 Oct 26 13:06:54.936251 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 566/1212] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:06:54 2022] GET /compute/v2.1/images/ac122a22-843b-441e-bc8c-3e65b4dbcf63 => generated 1414 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:55.012962 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9b22e88b-e7ae-4ce7-b006-634199daa23a tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:55.013733 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9b22e88b-e7ae-4ce7-b006-634199daa23a tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:55.024077 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9b22e88b-e7ae-4ce7-b006-634199daa23a tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:55.024234 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9b22e88b-e7ae-4ce7-b006-634199daa23a tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:55.026846 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d51a1494-923e-4d31-bbb4-1d56f8231326 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:55.031896 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9b22e88b-e7ae-4ce7-b006-634199daa23a tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:55.032643 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9b22e88b-e7ae-4ce7-b006-634199daa23a tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:55.033207 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9b22e88b-e7ae-4ce7-b006-634199daa23a tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:55.033757 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9b22e88b-e7ae-4ce7-b006-634199daa23a tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:55.037041 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d51a1494-923e-4d31-bbb4-1d56f8231326 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/efcb289a-74cf-4dd6-a564-27b2255a002f" status: 200 len: 1467 microversion: 2.1 time: 0.584529 Oct 26 13:06:55.050420 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 647/1213] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:54 2022] GET /compute/v2.1/servers/efcb289a-74cf-4dd6-a564-27b2255a002f => generated 1467 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:55.062718 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-45fe3ef7-312e-47f5-903c-5e1a3b0d4789 tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:55.063330 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-45fe3ef7-312e-47f5-903c-5e1a3b0d4789 tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] [instance: efcb289a-74cf-4dd6-a564-27b2255a002f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:55.073724 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45fe3ef7-312e-47f5-903c-5e1a3b0d4789 tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:55.074797 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45fe3ef7-312e-47f5-903c-5e1a3b0d4789 tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:55.075255 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45fe3ef7-312e-47f5-903c-5e1a3b0d4789 tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:55.075964 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45fe3ef7-312e-47f5-903c-5e1a3b0d4789 tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:55.077110 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45fe3ef7-312e-47f5-903c-5e1a3b0d4789 tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:55.077732 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45fe3ef7-312e-47f5-903c-5e1a3b0d4789 tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:55.253076 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9b22e88b-e7ae-4ce7-b006-634199daa23a tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:55.264107 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9b22e88b-e7ae-4ce7-b006-634199daa23a tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1472 microversion: 2.1 time: 0.255003 Oct 26 13:06:55.264882 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 567/1214] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:55 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1472 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:06:55.276045 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0d47bafb-9819-464a-a2b2-9a6a90db5d10 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:55.276653 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0d47bafb-9819-464a-a2b2-9a6a90db5d10 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: 249cce52-de17-460b-b445-e24d0d377986] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:55.293854 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0d47bafb-9819-464a-a2b2-9a6a90db5d10 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:55.294348 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0d47bafb-9819-464a-a2b2-9a6a90db5d10 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:55.294792 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0d47bafb-9819-464a-a2b2-9a6a90db5d10 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:55.300721 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0d47bafb-9819-464a-a2b2-9a6a90db5d10 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:55.301234 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0d47bafb-9819-464a-a2b2-9a6a90db5d10 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:55.301713 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0d47bafb-9819-464a-a2b2-9a6a90db5d10 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:55.338585 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:06:55.528816 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0d47bafb-9819-464a-a2b2-9a6a90db5d10 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:55.541114 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0d47bafb-9819-464a-a2b2-9a6a90db5d10 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986" status: 200 len: 1322 microversion: 2.1 time: 0.269061 Oct 26 13:06:55.541919 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 568/1215] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:55 2022] GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986 => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:55.547065 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-94b5a0bf-25d4-4e59-9722-18abadf7495a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:55.547878 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-94b5a0bf-25d4-4e59-9722-18abadf7495a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:55.554802 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-94b5a0bf-25d4-4e59-9722-18abadf7495a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:55.555521 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-94b5a0bf-25d4-4e59-9722-18abadf7495a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:55.556116 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-94b5a0bf-25d4-4e59-9722-18abadf7495a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:55.557000 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-94b5a0bf-25d4-4e59-9722-18abadf7495a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:55.558099 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-94b5a0bf-25d4-4e59-9722-18abadf7495a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:55.558538 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-94b5a0bf-25d4-4e59-9722-18abadf7495a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:55.746308 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-45fe3ef7-312e-47f5-903c-5e1a3b0d4789 tempest-ServersOnMultiNodesTest-1051446259 tempest-ServersOnMultiNodesTest-1051446259-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/efcb289a-74cf-4dd6-a564-27b2255a002f" status: 200 len: 1618 microversion: 2.1 time: 0.687425 Oct 26 13:06:55.749200 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 648/1216] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:55 2022] GET /compute/v2.1/servers/efcb289a-74cf-4dd6-a564-27b2255a002f => generated 1618 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:55.768290 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d9fb5498-afd0-402b-93b0-802b6ce7a0ea tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:55.773013 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d9fb5498-afd0-402b-93b0-802b6ce7a0ea tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:55.792507 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9fb5498-afd0-402b-93b0-802b6ce7a0ea tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:55.798218 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9fb5498-afd0-402b-93b0-802b6ce7a0ea tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:55.801514 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9fb5498-afd0-402b-93b0-802b6ce7a0ea tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:55.808189 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9fb5498-afd0-402b-93b0-802b6ce7a0ea tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:55.808767 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9fb5498-afd0-402b-93b0-802b6ce7a0ea tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:55.809232 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9fb5498-afd0-402b-93b0-802b6ce7a0ea tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:56.019249 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d9fb5498-afd0-402b-93b0-802b6ce7a0ea tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:56.033241 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d9fb5498-afd0-402b-93b0-802b6ce7a0ea tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1313 microversion: 2.1 time: 0.281503 Oct 26 13:06:56.053764 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 649/1217] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:55 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1313 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:56.059878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fb80389c-647b-48db-a6b7-267b92e06313 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:56.060388 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fb80389c-647b-48db-a6b7-267b92e06313 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: efcb289a-74cf-4dd6-a564-27b2255a002f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:56.067991 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fb80389c-647b-48db-a6b7-267b92e06313 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:56.068789 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fb80389c-647b-48db-a6b7-267b92e06313 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:56.069065 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fb80389c-647b-48db-a6b7-267b92e06313 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:56.069851 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fb80389c-647b-48db-a6b7-267b92e06313 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:56.070354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fb80389c-647b-48db-a6b7-267b92e06313 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:56.070786 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fb80389c-647b-48db-a6b7-267b92e06313 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:56.120613 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fb80389c-647b-48db-a6b7-267b92e06313 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: efcb289a-74cf-4dd6-a564-27b2255a002f] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:06:56.184388 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-94b5a0bf-25d4-4e59-9722-18abadf7495a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:56.200269 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-94b5a0bf-25d4-4e59-9722-18abadf7495a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:56.205026 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-94b5a0bf-25d4-4e59-9722-18abadf7495a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:56.214345 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-94b5a0bf-25d4-4e59-9722-18abadf7495a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924" status: 200 len: 1812 microversion: 2.25 time: 0.665532 Oct 26 13:06:56.236911 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 569/1218] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:06:55 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 => generated 1812 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:06:56.250667 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-79b61e92-1bf0-40c5-963f-4e2527bb2cb4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:56.253911 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-79b61e92-1bf0-40c5-963f-4e2527bb2cb4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 2803303a-ad72-4096-b524-69a583a56f03] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:56.275196 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-79b61e92-1bf0-40c5-963f-4e2527bb2cb4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:56.276108 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-79b61e92-1bf0-40c5-963f-4e2527bb2cb4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:56.277407 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-79b61e92-1bf0-40c5-963f-4e2527bb2cb4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:56.279024 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-79b61e92-1bf0-40c5-963f-4e2527bb2cb4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:56.280373 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-79b61e92-1bf0-40c5-963f-4e2527bb2cb4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:56.281027 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-79b61e92-1bf0-40c5-963f-4e2527bb2cb4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:56.316479 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fb80389c-647b-48db-a6b7-267b92e06313 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "DELETE /compute/v2.1/servers/efcb289a-74cf-4dd6-a564-27b2255a002f" status: 204 len: 0 microversion: 2.1 time: 0.261258 Oct 26 13:06:56.320680 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 650/1219] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:06:56 2022] DELETE /compute/v2.1/servers/efcb289a-74cf-4dd6-a564-27b2255a002f => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:06:56.328628 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3f324f94-9f81-49a2-b3b0-41c13ed7c17a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f673306ef70>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:56.409366 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3f324f94-9f81-49a2-b3b0-41c13ed7c17a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/ac122a22-843b-441e-bc8c-3e65b4dbcf63" status: 200 len: 1414 microversion: 2.1 time: 0.087367 Oct 26 13:06:56.420622 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 651/1220] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:06:56 2022] GET /compute/v2.1/images/ac122a22-843b-441e-bc8c-3e65b4dbcf63 => generated 1414 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:56.430912 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-663e2ca1-427e-4198-afa7-a5b07a102674 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:56.431734 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-663e2ca1-427e-4198-afa7-a5b07a102674 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:56.447152 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-663e2ca1-427e-4198-afa7-a5b07a102674 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:56.447682 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-663e2ca1-427e-4198-afa7-a5b07a102674 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:56.448132 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-663e2ca1-427e-4198-afa7-a5b07a102674 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:56.448925 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-663e2ca1-427e-4198-afa7-a5b07a102674 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:56.449381 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-663e2ca1-427e-4198-afa7-a5b07a102674 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:56.451266 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-663e2ca1-427e-4198-afa7-a5b07a102674 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:56.558061 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-79b61e92-1bf0-40c5-963f-4e2527bb2cb4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:56.567974 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-79b61e92-1bf0-40c5-963f-4e2527bb2cb4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03" status: 200 len: 1325 microversion: 2.1 time: 0.329706 Oct 26 13:06:56.574384 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 570/1221] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:56 2022] GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03 => generated 1325 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:56.584246 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-05467705-b454-49b6-846e-84921681aeb9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:56.589542 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-05467705-b454-49b6-846e-84921681aeb9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: efcb289a-74cf-4dd6-a564-27b2255a002f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:56.627020 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05467705-b454-49b6-846e-84921681aeb9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:56.627999 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05467705-b454-49b6-846e-84921681aeb9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:56.628608 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05467705-b454-49b6-846e-84921681aeb9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:56.631903 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05467705-b454-49b6-846e-84921681aeb9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:56.632437 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05467705-b454-49b6-846e-84921681aeb9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:56.632918 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05467705-b454-49b6-846e-84921681aeb9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:56.704209 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-663e2ca1-427e-4198-afa7-a5b07a102674 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:56.714131 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-663e2ca1-427e-4198-afa7-a5b07a102674 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1472 microversion: 2.1 time: 0.299258 Oct 26 13:06:56.734593 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 652/1222] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:56 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1472 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:56.739932 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-c03fae31-7cf1-456b-aa97-6dde7f2ab048 req-3dfb55ee-362c-42ad-8a38-d76f5cef6fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70961c4d-e68b-4b33-a2ad-1fd612e14a73", "name": "network-vif-plugged", "status": "completed", "tag": "6310dd0d-823a-4f3c-b6f0-fde873d3af7c"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:06:56.751405 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-c03fae31-7cf1-456b-aa97-6dde7f2ab048 req-3dfb55ee-362c-42ad-8a38-d76f5cef6fb1 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:56.752150 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-c03fae31-7cf1-456b-aa97-6dde7f2ab048 req-3dfb55ee-362c-42ad-8a38-d76f5cef6fb1 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:56.752860 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-c03fae31-7cf1-456b-aa97-6dde7f2ab048 req-3dfb55ee-362c-42ad-8a38-d76f5cef6fb1 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:56.770353 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-c03fae31-7cf1-456b-aa97-6dde7f2ab048 req-3dfb55ee-362c-42ad-8a38-d76f5cef6fb1 service nova] Creating event network-vif-plugged:6310dd0d-823a-4f3c-b6f0-fde873d3af7c for instance 70961c4d-e68b-4b33-a2ad-1fd612e14a73 on n-h2-862686-1 Oct 26 13:06:56.781114 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-c03fae31-7cf1-456b-aa97-6dde7f2ab048 req-3dfb55ee-362c-42ad-8a38-d76f5cef6fb1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043799 Oct 26 13:06:56.782030 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 653/1223] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:06:56.789671 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b7c22c49-3035-437c-b3f1-0a2782ed54a5 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:56.790941 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b7c22c49-3035-437c-b3f1-0a2782ed54a5 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: 249cce52-de17-460b-b445-e24d0d377986] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:56.798312 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b7c22c49-3035-437c-b3f1-0a2782ed54a5 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:56.799210 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b7c22c49-3035-437c-b3f1-0a2782ed54a5 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:56.799906 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b7c22c49-3035-437c-b3f1-0a2782ed54a5 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:56.800801 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b7c22c49-3035-437c-b3f1-0a2782ed54a5 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:56.801605 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b7c22c49-3035-437c-b3f1-0a2782ed54a5 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:56.802200 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b7c22c49-3035-437c-b3f1-0a2782ed54a5 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:56.908296 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-05467705-b454-49b6-846e-84921681aeb9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:56.917625 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-05467705-b454-49b6-846e-84921681aeb9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/efcb289a-74cf-4dd6-a564-27b2255a002f" status: 200 len: 1473 microversion: 2.1 time: 0.341855 Oct 26 13:06:56.918230 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 571/1224] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:56 2022] GET /compute/v2.1/servers/efcb289a-74cf-4dd6-a564-27b2255a002f => generated 1473 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:57.057275 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-75e4ee4b-29cc-4635-a9cf-8377f852f06d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:57.058070 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-75e4ee4b-29cc-4635-a9cf-8377f852f06d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:57.069999 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-75e4ee4b-29cc-4635-a9cf-8377f852f06d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:57.071419 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-75e4ee4b-29cc-4635-a9cf-8377f852f06d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:57.071941 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-75e4ee4b-29cc-4635-a9cf-8377f852f06d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:57.072734 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-75e4ee4b-29cc-4635-a9cf-8377f852f06d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:57.073267 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-75e4ee4b-29cc-4635-a9cf-8377f852f06d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:57.075850 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-75e4ee4b-29cc-4635-a9cf-8377f852f06d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:57.118043 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b7c22c49-3035-437c-b3f1-0a2782ed54a5 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:57.137323 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b7c22c49-3035-437c-b3f1-0a2782ed54a5 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986" status: 200 len: 1322 microversion: 2.1 time: 0.350237 Oct 26 13:06:57.138271 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 654/1225] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:56 2022] GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986 => generated 1322 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:57.243753 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-951cf691-57dd-43bb-811d-57ad737c5915 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:57.244488 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-951cf691-57dd-43bb-811d-57ad737c5915 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:57.253217 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-951cf691-57dd-43bb-811d-57ad737c5915 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:57.253987 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-951cf691-57dd-43bb-811d-57ad737c5915 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:57.254706 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-951cf691-57dd-43bb-811d-57ad737c5915 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:57.255593 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-951cf691-57dd-43bb-811d-57ad737c5915 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:57.256201 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-951cf691-57dd-43bb-811d-57ad737c5915 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:57.259377 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-951cf691-57dd-43bb-811d-57ad737c5915 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:57.425266 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-75e4ee4b-29cc-4635-a9cf-8377f852f06d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:57.441013 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-75e4ee4b-29cc-4635-a9cf-8377f852f06d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1313 microversion: 2.1 time: 0.388576 Oct 26 13:06:57.441996 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 572/1226] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:57 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1313 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:57.456227 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e2cec7ff-4e4d-4895-a83d-2380f11b5be7 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f6732656700>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:57.456431 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-951cf691-57dd-43bb-811d-57ad737c5915 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:57.469030 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-951cf691-57dd-43bb-811d-57ad737c5915 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:57.471276 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-951cf691-57dd-43bb-811d-57ad737c5915 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:57.472632 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-951cf691-57dd-43bb-811d-57ad737c5915 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924" status: 200 len: 1812 microversion: 2.25 time: 0.233116 Oct 26 13:06:57.482986 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 655/1227] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:06:57 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 => generated 1812 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:06:57.555277 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e2cec7ff-4e4d-4895-a83d-2380f11b5be7 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/ac122a22-843b-441e-bc8c-3e65b4dbcf63" status: 200 len: 1414 microversion: 2.1 time: 0.104895 Oct 26 13:06:57.556130 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 573/1228] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:06:57 2022] GET /compute/v2.1/images/ac122a22-843b-441e-bc8c-3e65b4dbcf63 => generated 1414 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:57.598721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fe8b48b8-f89a-465f-bebf-486b92b417ed tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:57.599418 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fe8b48b8-f89a-465f-bebf-486b92b417ed tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 2803303a-ad72-4096-b524-69a583a56f03] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:57.609403 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe8b48b8-f89a-465f-bebf-486b92b417ed tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:57.609935 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe8b48b8-f89a-465f-bebf-486b92b417ed tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:57.616515 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe8b48b8-f89a-465f-bebf-486b92b417ed tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:57.617449 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe8b48b8-f89a-465f-bebf-486b92b417ed tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:57.617996 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe8b48b8-f89a-465f-bebf-486b92b417ed tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:57.618465 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe8b48b8-f89a-465f-bebf-486b92b417ed tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:57.742449 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ace298a9-3f30-4d6a-b64c-86c9215853d1 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:57.743327 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ace298a9-3f30-4d6a-b64c-86c9215853d1 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:57.750643 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ace298a9-3f30-4d6a-b64c-86c9215853d1 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:57.751140 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ace298a9-3f30-4d6a-b64c-86c9215853d1 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:57.751580 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ace298a9-3f30-4d6a-b64c-86c9215853d1 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:57.752303 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ace298a9-3f30-4d6a-b64c-86c9215853d1 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:57.752761 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ace298a9-3f30-4d6a-b64c-86c9215853d1 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:57.753184 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ace298a9-3f30-4d6a-b64c-86c9215853d1 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:57.914561 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fe8b48b8-f89a-465f-bebf-486b92b417ed tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:57.922229 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:06:57.943304 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fe8b48b8-f89a-465f-bebf-486b92b417ed tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03" status: 200 len: 1325 microversion: 2.1 time: 0.345691 Oct 26 13:06:57.946027 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 656/1229] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:57 2022] GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03 => generated 1325 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:57.959256 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-78edadc3-6750-4d34-b3ee-132d47b6e33c tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:57.970778 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-78edadc3-6750-4d34-b3ee-132d47b6e33c tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: efcb289a-74cf-4dd6-a564-27b2255a002f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:57.983246 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78edadc3-6750-4d34-b3ee-132d47b6e33c tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:57.989142 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78edadc3-6750-4d34-b3ee-132d47b6e33c tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:57.989451 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78edadc3-6750-4d34-b3ee-132d47b6e33c tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:57.995636 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78edadc3-6750-4d34-b3ee-132d47b6e33c tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:57.996049 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78edadc3-6750-4d34-b3ee-132d47b6e33c tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:58.005291 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78edadc3-6750-4d34-b3ee-132d47b6e33c tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:58.114473 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ace298a9-3f30-4d6a-b64c-86c9215853d1 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:58.126082 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ace298a9-3f30-4d6a-b64c-86c9215853d1 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1472 microversion: 2.1 time: 0.388252 Oct 26 13:06:58.126984 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 574/1230] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:57 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1472 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:58.160209 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7f507b5b-1d15-46b4-94d8-e5975d9c9f24 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:58.161345 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7f507b5b-1d15-46b4-94d8-e5975d9c9f24 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: 249cce52-de17-460b-b445-e24d0d377986] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:58.171633 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f507b5b-1d15-46b4-94d8-e5975d9c9f24 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:58.172137 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f507b5b-1d15-46b4-94d8-e5975d9c9f24 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:58.172583 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f507b5b-1d15-46b4-94d8-e5975d9c9f24 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:58.173296 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f507b5b-1d15-46b4-94d8-e5975d9c9f24 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:58.173788 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f507b5b-1d15-46b4-94d8-e5975d9c9f24 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:58.174222 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f507b5b-1d15-46b4-94d8-e5975d9c9f24 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:58.393424 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-78edadc3-6750-4d34-b3ee-132d47b6e33c tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:58.425036 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-78edadc3-6750-4d34-b3ee-132d47b6e33c tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/efcb289a-74cf-4dd6-a564-27b2255a002f" status: 200 len: 1473 microversion: 2.1 time: 0.475009 Oct 26 13:06:58.440527 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 657/1231] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:57 2022] GET /compute/v2.1/servers/efcb289a-74cf-4dd6-a564-27b2255a002f => generated 1473 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:58.468598 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7120d566-01f6-42bc-9ce6-5f641b492019 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:58.469623 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7120d566-01f6-42bc-9ce6-5f641b492019 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:58.477751 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7120d566-01f6-42bc-9ce6-5f641b492019 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:58.478866 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7120d566-01f6-42bc-9ce6-5f641b492019 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:58.479582 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7120d566-01f6-42bc-9ce6-5f641b492019 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:58.480503 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7120d566-01f6-42bc-9ce6-5f641b492019 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:58.481276 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7120d566-01f6-42bc-9ce6-5f641b492019 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:58.481923 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7120d566-01f6-42bc-9ce6-5f641b492019 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:58.556805 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7f507b5b-1d15-46b4-94d8-e5975d9c9f24 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:58.569737 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7f507b5b-1d15-46b4-94d8-e5975d9c9f24 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986" status: 200 len: 1322 microversion: 2.1 time: 0.413180 Oct 26 13:06:58.574054 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 575/1232] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:58 2022] GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986 => generated 1322 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:06:58.583209 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c4d43df2-7d97-431e-b4dd-de25303d6dff tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:58.585990 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c4d43df2-7d97-431e-b4dd-de25303d6dff tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:58.594372 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4d43df2-7d97-431e-b4dd-de25303d6dff tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:58.595238 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4d43df2-7d97-431e-b4dd-de25303d6dff tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:58.595856 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4d43df2-7d97-431e-b4dd-de25303d6dff tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:58.596704 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4d43df2-7d97-431e-b4dd-de25303d6dff tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:58.597052 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4d43df2-7d97-431e-b4dd-de25303d6dff tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:58.597525 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4d43df2-7d97-431e-b4dd-de25303d6dff tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:58.853159 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7120d566-01f6-42bc-9ce6-5f641b492019 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:58.866012 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c4d43df2-7d97-431e-b4dd-de25303d6dff tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:58.866321 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7120d566-01f6-42bc-9ce6-5f641b492019 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1313 microversion: 2.1 time: 0.404098 Oct 26 13:06:58.867562 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 658/1233] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:58 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1313 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:06:58.880735 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a8efb3a9-e214-4c15-ba95-8309d9958792 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f6732f77af0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:58.893633 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c4d43df2-7d97-431e-b4dd-de25303d6dff tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:58.895352 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c4d43df2-7d97-431e-b4dd-de25303d6dff tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:58.896559 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c4d43df2-7d97-431e-b4dd-de25303d6dff tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924" status: 200 len: 1812 microversion: 2.25 time: 0.321209 Oct 26 13:06:58.897901 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 576/1234] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:06:58 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 => generated 1812 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:06:58.945925 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a8efb3a9-e214-4c15-ba95-8309d9958792 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/ac122a22-843b-441e-bc8c-3e65b4dbcf63" status: 200 len: 1414 microversion: 2.1 time: 0.076989 Oct 26 13:06:58.947058 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 659/1235] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:06:58 2022] GET /compute/v2.1/images/ac122a22-843b-441e-bc8c-3e65b4dbcf63 => generated 1414 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:58.960361 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-57c4eb2d-c68f-47cc-8561-bf96910b2edf req-d198d2ce-efe0-487f-9391-f93c69a6735c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2803303a-ad72-4096-b524-69a583a56f03", "name": "network-vif-plugged", "status": "completed", "tag": "1d2c7a75-3140-4fe8-a8c6-96801d8b0941"}, {"server_uuid": "249cce52-de17-460b-b445-e24d0d377986", "name": "network-vif-plugged", "status": "completed", "tag": "63756a62-388c-4b3a-971b-3d8f25684ca1"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:06:58.972193 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e646477c-3385-499e-bde5-24a25252e3e3 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:58.978535 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e646477c-3385-499e-bde5-24a25252e3e3 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 2803303a-ad72-4096-b524-69a583a56f03] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:58.982638 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-57c4eb2d-c68f-47cc-8561-bf96910b2edf req-d198d2ce-efe0-487f-9391-f93c69a6735c service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:58.983324 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-57c4eb2d-c68f-47cc-8561-bf96910b2edf req-d198d2ce-efe0-487f-9391-f93c69a6735c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:58.983780 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-57c4eb2d-c68f-47cc-8561-bf96910b2edf req-d198d2ce-efe0-487f-9391-f93c69a6735c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:59.000662 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e646477c-3385-499e-bde5-24a25252e3e3 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:59.001172 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e646477c-3385-499e-bde5-24a25252e3e3 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:59.001637 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e646477c-3385-499e-bde5-24a25252e3e3 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:59.003000 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e646477c-3385-499e-bde5-24a25252e3e3 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:59.003461 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e646477c-3385-499e-bde5-24a25252e3e3 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:59.004560 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e646477c-3385-499e-bde5-24a25252e3e3 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:59.018986 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-57c4eb2d-c68f-47cc-8561-bf96910b2edf req-d198d2ce-efe0-487f-9391-f93c69a6735c service nova] Creating event network-vif-plugged:1d2c7a75-3140-4fe8-a8c6-96801d8b0941 for instance 2803303a-ad72-4096-b524-69a583a56f03 on n-h1-862686-1 Oct 26 13:06:59.019818 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-57c4eb2d-c68f-47cc-8561-bf96910b2edf req-d198d2ce-efe0-487f-9391-f93c69a6735c service nova] Creating event network-vif-plugged:63756a62-388c-4b3a-971b-3d8f25684ca1 for instance 249cce52-de17-460b-b445-e24d0d377986 on n-h1-862686-1 Oct 26 13:06:59.038752 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-57c4eb2d-c68f-47cc-8561-bf96910b2edf req-d198d2ce-efe0-487f-9391-f93c69a6735c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.074585 Oct 26 13:06:59.040910 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 577/1236] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:06:59.153125 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d40f6c4c-003e-4c8d-a4aa-92b1fd16aa76 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:59.153768 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d40f6c4c-003e-4c8d-a4aa-92b1fd16aa76 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:59.160553 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d40f6c4c-003e-4c8d-a4aa-92b1fd16aa76 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:59.161317 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d40f6c4c-003e-4c8d-a4aa-92b1fd16aa76 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:59.161899 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d40f6c4c-003e-4c8d-a4aa-92b1fd16aa76 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:59.163572 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d40f6c4c-003e-4c8d-a4aa-92b1fd16aa76 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:59.164237 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d40f6c4c-003e-4c8d-a4aa-92b1fd16aa76 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:59.164827 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d40f6c4c-003e-4c8d-a4aa-92b1fd16aa76 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:59.507215 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e646477c-3385-499e-bde5-24a25252e3e3 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:59.544073 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e646477c-3385-499e-bde5-24a25252e3e3 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03" status: 200 len: 1325 microversion: 2.1 time: 0.578896 Oct 26 13:06:59.549090 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 660/1237] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:58 2022] GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03 => generated 1325 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:06:59.563981 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-40b817cc-d09d-4237-abb1-dbf311bb8d46 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:59.565738 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-40b817cc-d09d-4237-abb1-dbf311bb8d46 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: efcb289a-74cf-4dd6-a564-27b2255a002f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:59.602751 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-40b817cc-d09d-4237-abb1-dbf311bb8d46 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:59.603260 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-40b817cc-d09d-4237-abb1-dbf311bb8d46 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:59.603782 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-40b817cc-d09d-4237-abb1-dbf311bb8d46 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:59.604718 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-40b817cc-d09d-4237-abb1-dbf311bb8d46 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:59.607570 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-40b817cc-d09d-4237-abb1-dbf311bb8d46 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:59.608621 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-40b817cc-d09d-4237-abb1-dbf311bb8d46 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:59.830847 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d40f6c4c-003e-4c8d-a4aa-92b1fd16aa76 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:59.854019 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d40f6c4c-003e-4c8d-a4aa-92b1fd16aa76 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1472 microversion: 2.1 time: 0.705277 Oct 26 13:06:59.854620 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 578/1238] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:59 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1472 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:06:59.877662 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-b1c4251c-0b84-43ad-9d2d-e2eff64026bd req-f66f9e0c-ee31-429a-b4f1-1f70d1e9944d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efcb289a-74cf-4dd6-a564-27b2255a002f", "name": "network-vif-deleted", "tag": "1e95e7b9-0c5b-4a27-a6cd-c1528bee78ad"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:06:59.921303 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-b1c4251c-0b84-43ad-9d2d-e2eff64026bd req-f66f9e0c-ee31-429a-b4f1-1f70d1e9944d service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:59.921830 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-b1c4251c-0b84-43ad-9d2d-e2eff64026bd req-f66f9e0c-ee31-429a-b4f1-1f70d1e9944d service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:59.922269 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-b1c4251c-0b84-43ad-9d2d-e2eff64026bd req-f66f9e0c-ee31-429a-b4f1-1f70d1e9944d service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:59.949211 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-b1c4251c-0b84-43ad-9d2d-e2eff64026bd req-f66f9e0c-ee31-429a-b4f1-1f70d1e9944d service nova] Creating event network-vif-deleted:1e95e7b9-0c5b-4a27-a6cd-c1528bee78ad for instance efcb289a-74cf-4dd6-a564-27b2255a002f on n-h1-862686-1 Oct 26 13:06:59.952016 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-40b817cc-d09d-4237-abb1-dbf311bb8d46 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:06:59.956987 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-b1c4251c-0b84-43ad-9d2d-e2eff64026bd req-f66f9e0c-ee31-429a-b4f1-1f70d1e9944d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092410 Oct 26 13:06:59.959124 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 579/1239] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:06:59.968255 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-40b817cc-d09d-4237-abb1-dbf311bb8d46 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/efcb289a-74cf-4dd6-a564-27b2255a002f" status: 200 len: 1302 microversion: 2.1 time: 0.417176 Oct 26 13:06:59.968879 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-745a17e8-f7dd-4901-b090-df264cc1cad8 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:59.969911 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 661/1240] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:59 2022] GET /compute/v2.1/servers/efcb289a-74cf-4dd6-a564-27b2255a002f => generated 1302 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:06:59.973440 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-745a17e8-f7dd-4901-b090-df264cc1cad8 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: 249cce52-de17-460b-b445-e24d0d377986] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:59.977583 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6c64d6c0-2ec6-4159-aa13-9a4e46c6aa1d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:06:59.980235 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6c64d6c0-2ec6-4159-aa13-9a4e46c6aa1d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:06:59.989829 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-745a17e8-f7dd-4901-b090-df264cc1cad8 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:59.991373 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-745a17e8-f7dd-4901-b090-df264cc1cad8 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:59.992307 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-745a17e8-f7dd-4901-b090-df264cc1cad8 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:59.993206 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-745a17e8-f7dd-4901-b090-df264cc1cad8 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:59.993908 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-745a17e8-f7dd-4901-b090-df264cc1cad8 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:59.994504 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-745a17e8-f7dd-4901-b090-df264cc1cad8 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:06:59.997974 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c64d6c0-2ec6-4159-aa13-9a4e46c6aa1d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:06:59.998512 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c64d6c0-2ec6-4159-aa13-9a4e46c6aa1d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:06:59.998955 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c64d6c0-2ec6-4159-aa13-9a4e46c6aa1d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:00.029550 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c64d6c0-2ec6-4159-aa13-9a4e46c6aa1d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:00.031695 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c64d6c0-2ec6-4159-aa13-9a4e46c6aa1d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:00.035381 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c64d6c0-2ec6-4159-aa13-9a4e46c6aa1d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:00.190811 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-745a17e8-f7dd-4901-b090-df264cc1cad8 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:00.204412 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-745a17e8-f7dd-4901-b090-df264cc1cad8 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986" status: 200 len: 1322 microversion: 2.1 time: 0.240370 Oct 26 13:07:00.205743 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 580/1241] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:59 2022] GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986 => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:00.212891 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ecd7b008-7b39-4897-b769-6bc4b7272630 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:00.214376 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ecd7b008-7b39-4897-b769-6bc4b7272630 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:00.221252 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ecd7b008-7b39-4897-b769-6bc4b7272630 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:00.222703 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ecd7b008-7b39-4897-b769-6bc4b7272630 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:00.223561 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ecd7b008-7b39-4897-b769-6bc4b7272630 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:00.224845 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ecd7b008-7b39-4897-b769-6bc4b7272630 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:00.226135 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ecd7b008-7b39-4897-b769-6bc4b7272630 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:00.226789 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ecd7b008-7b39-4897-b769-6bc4b7272630 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:00.400904 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6c64d6c0-2ec6-4159-aa13-9a4e46c6aa1d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:00.421416 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6c64d6c0-2ec6-4159-aa13-9a4e46c6aa1d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1462 microversion: 2.1 time: 0.445111 Oct 26 13:07:00.422521 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 662/1242] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:06:59 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1462 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:00.433804 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-02e3bc65-7358-4c21-b645-4703d9fad7dc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f6732f77d30>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:00.510113 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-02e3bc65-7358-4c21-b645-4703d9fad7dc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/ac122a22-843b-441e-bc8c-3e65b4dbcf63" status: 200 len: 1414 microversion: 2.1 time: 0.086149 Oct 26 13:07:00.512356 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 663/1243] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:07:00 2022] GET /compute/v2.1/images/ac122a22-843b-441e-bc8c-3e65b4dbcf63 => generated 1414 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:00.518743 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8169054c-5bc8-4732-9282-5ba18edc9cd1 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:00.519566 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8169054c-5bc8-4732-9282-5ba18edc9cd1 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:00.529154 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8169054c-5bc8-4732-9282-5ba18edc9cd1 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:00.530438 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8169054c-5bc8-4732-9282-5ba18edc9cd1 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:00.531039 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8169054c-5bc8-4732-9282-5ba18edc9cd1 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:00.531947 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8169054c-5bc8-4732-9282-5ba18edc9cd1 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:00.532816 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8169054c-5bc8-4732-9282-5ba18edc9cd1 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:00.533404 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8169054c-5bc8-4732-9282-5ba18edc9cd1 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:00.539250 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ecd7b008-7b39-4897-b769-6bc4b7272630 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:00.552545 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ecd7b008-7b39-4897-b769-6bc4b7272630 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:00.558765 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ecd7b008-7b39-4897-b769-6bc4b7272630 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:00.562221 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ecd7b008-7b39-4897-b769-6bc4b7272630 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924" status: 200 len: 1812 microversion: 2.25 time: 0.355143 Oct 26 13:07:00.565248 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 581/1244] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:07:00 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 => generated 1812 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:07:00.583394 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fe08dcef-1db4-4f58-b386-42086eea489c tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:00.584992 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fe08dcef-1db4-4f58-b386-42086eea489c tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 2803303a-ad72-4096-b524-69a583a56f03] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:00.595937 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fe08dcef-1db4-4f58-b386-42086eea489c tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:00.596702 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fe08dcef-1db4-4f58-b386-42086eea489c tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:00.598409 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fe08dcef-1db4-4f58-b386-42086eea489c tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:00.599756 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fe08dcef-1db4-4f58-b386-42086eea489c tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:00.600959 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fe08dcef-1db4-4f58-b386-42086eea489c tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:00.601646 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fe08dcef-1db4-4f58-b386-42086eea489c tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:00.754693 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8169054c-5bc8-4732-9282-5ba18edc9cd1 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1613 microversion: 2.1 time: 0.241014 Oct 26 13:07:00.766089 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 664/1245] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:00 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1613 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:00.778194 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-51cf8449-2475-4356-ad9b-0821cabe0840 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:00.779026 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-51cf8449-2475-4356-ad9b-0821cabe0840 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:00.795424 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-51cf8449-2475-4356-ad9b-0821cabe0840 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:00.796231 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-51cf8449-2475-4356-ad9b-0821cabe0840 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:00.796851 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-51cf8449-2475-4356-ad9b-0821cabe0840 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:00.797910 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-51cf8449-2475-4356-ad9b-0821cabe0840 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:00.798538 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-51cf8449-2475-4356-ad9b-0821cabe0840 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:00.801441 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-51cf8449-2475-4356-ad9b-0821cabe0840 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:00.846422 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-51cf8449-2475-4356-ad9b-0821cabe0840 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'e9ccaad8c3e644a7b22ace8413875396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd672e8734b74406bb0fef1de5a88b7fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:00.847639 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-51cf8449-2475-4356-ad9b-0821cabe0840 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] flavor_id is None. Assuming migration. {{(pid=120598) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 26 13:07:00.848307 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-51cf8449-2475-4356-ad9b-0821cabe0840 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120598) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 26 13:07:00.868989 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fe08dcef-1db4-4f58-b386-42086eea489c tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:00.902720 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fe08dcef-1db4-4f58-b386-42086eea489c tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03" status: 200 len: 1325 microversion: 2.1 time: 0.309030 Oct 26 13:07:00.907851 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 582/1246] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:00 2022] GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03 => generated 1325 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:07:00.912750 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bfb74c09-ccd4-45a5-84c7-dffe22aba61a tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:00.913367 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bfb74c09-ccd4-45a5-84c7-dffe22aba61a tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:00.919974 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bfb74c09-ccd4-45a5-84c7-dffe22aba61a tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:00.920696 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bfb74c09-ccd4-45a5-84c7-dffe22aba61a tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:00.921293 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bfb74c09-ccd4-45a5-84c7-dffe22aba61a tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:00.922187 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bfb74c09-ccd4-45a5-84c7-dffe22aba61a tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:00.922789 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bfb74c09-ccd4-45a5-84c7-dffe22aba61a tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:00.923378 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bfb74c09-ccd4-45a5-84c7-dffe22aba61a tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:01.082996 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-51cf8449-2475-4356-ad9b-0821cabe0840 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73/action" status: 202 len: 0 microversion: 2.1 time: 0.308545 Oct 26 13:07:01.083980 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 665/1247] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:07:00 2022] POST /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 13:07:01.090440 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-173e9ee5-d008-4073-b50a-878a388b2bf4 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:01.091401 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-173e9ee5-d008-4073-b50a-878a388b2bf4 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: efcb289a-74cf-4dd6-a564-27b2255a002f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:01.109393 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-173e9ee5-d008-4073-b50a-878a388b2bf4 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:01.110070 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-173e9ee5-d008-4073-b50a-878a388b2bf4 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:01.116060 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-173e9ee5-d008-4073-b50a-878a388b2bf4 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:01.116969 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-173e9ee5-d008-4073-b50a-878a388b2bf4 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:01.117553 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-173e9ee5-d008-4073-b50a-878a388b2bf4 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:01.118101 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-173e9ee5-d008-4073-b50a-878a388b2bf4 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:01.195518 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-173e9ee5-d008-4073-b50a-878a388b2bf4 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:01.196014 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-173e9ee5-d008-4073-b50a-878a388b2bf4 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:01.196454 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-173e9ee5-d008-4073-b50a-878a388b2bf4 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:01.196912 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-173e9ee5-d008-4073-b50a-878a388b2bf4 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lazy-loading 'fault' on Instance uuid efcb289a-74cf-4dd6-a564-27b2255a002f {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:07:01.205152 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bfb74c09-ccd4-45a5-84c7-dffe22aba61a tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:01.214806 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bfb74c09-ccd4-45a5-84c7-dffe22aba61a tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1472 microversion: 2.1 time: 0.305888 Oct 26 13:07:01.230770 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 583/1248] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:00 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1472 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:01.243015 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9bd68972-c40f-4825-8dd2-087dc0c1575a tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:01.243851 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9bd68972-c40f-4825-8dd2-087dc0c1575a tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:01.250229 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9bd68972-c40f-4825-8dd2-087dc0c1575a tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:01.251004 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9bd68972-c40f-4825-8dd2-087dc0c1575a tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:01.251774 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9bd68972-c40f-4825-8dd2-087dc0c1575a tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:01.252652 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9bd68972-c40f-4825-8dd2-087dc0c1575a tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:01.253273 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9bd68972-c40f-4825-8dd2-087dc0c1575a tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:01.253899 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9bd68972-c40f-4825-8dd2-087dc0c1575a tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:01.277023 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-173e9ee5-d008-4073-b50a-878a388b2bf4 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:01.286909 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-173e9ee5-d008-4073-b50a-878a388b2bf4 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/efcb289a-74cf-4dd6-a564-27b2255a002f" status: 200 len: 1307 microversion: 2.1 time: 0.200988 Oct 26 13:07:01.301516 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 666/1249] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:01 2022] GET /compute/v2.1/servers/efcb289a-74cf-4dd6-a564-27b2255a002f => generated 1307 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:01.301516 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-02663ddd-01e6-48a9-8dc1-f70bb00c3844 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:01.301516 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-02663ddd-01e6-48a9-8dc1-f70bb00c3844 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: 249cce52-de17-460b-b445-e24d0d377986] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:01.331413 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02663ddd-01e6-48a9-8dc1-f70bb00c3844 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:01.336759 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02663ddd-01e6-48a9-8dc1-f70bb00c3844 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:01.337308 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02663ddd-01e6-48a9-8dc1-f70bb00c3844 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:01.339461 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02663ddd-01e6-48a9-8dc1-f70bb00c3844 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:01.357179 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02663ddd-01e6-48a9-8dc1-f70bb00c3844 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:01.369460 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02663ddd-01e6-48a9-8dc1-f70bb00c3844 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:01.502729 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9bd68972-c40f-4825-8dd2-087dc0c1575a tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:01.513347 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9bd68972-c40f-4825-8dd2-087dc0c1575a tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1471 microversion: 2.1 time: 0.280450 Oct 26 13:07:01.514866 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 584/1250] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:01 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1471 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:01.538000 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e453f697-8ab6-4625-8ae3-d604a717af91 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67324b1e50>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:01.610417 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e453f697-8ab6-4625-8ae3-d604a717af91 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/ac122a22-843b-441e-bc8c-3e65b4dbcf63" status: 200 len: 1414 microversion: 2.1 time: 0.079511 Oct 26 13:07:01.611500 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 585/1251] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:07:01 2022] GET /compute/v2.1/images/ac122a22-843b-441e-bc8c-3e65b4dbcf63 => generated 1414 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:07:01.624557 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-69a6e04a-995a-4820-a051-b53e4284c99d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:01.625379 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-69a6e04a-995a-4820-a051-b53e4284c99d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:01.628526 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:07:01.637044 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69a6e04a-995a-4820-a051-b53e4284c99d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:01.641947 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69a6e04a-995a-4820-a051-b53e4284c99d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:01.642760 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69a6e04a-995a-4820-a051-b53e4284c99d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:01.647830 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69a6e04a-995a-4820-a051-b53e4284c99d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:01.648687 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69a6e04a-995a-4820-a051-b53e4284c99d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:01.649197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69a6e04a-995a-4820-a051-b53e4284c99d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:01.777687 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-02663ddd-01e6-48a9-8dc1-f70bb00c3844 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:01.796171 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-02663ddd-01e6-48a9-8dc1-f70bb00c3844 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986" status: 200 len: 1322 microversion: 2.1 time: 0.505557 Oct 26 13:07:01.798240 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 667/1252] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:01 2022] GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986 => generated 1322 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:01.931053 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-05cd0801-15ae-401a-99a2-02790041d1ec tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:01.931665 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-05cd0801-15ae-401a-99a2-02790041d1ec tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 2803303a-ad72-4096-b524-69a583a56f03] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:01.947403 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05cd0801-15ae-401a-99a2-02790041d1ec tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:01.948136 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05cd0801-15ae-401a-99a2-02790041d1ec tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:01.948778 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05cd0801-15ae-401a-99a2-02790041d1ec tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:01.949691 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05cd0801-15ae-401a-99a2-02790041d1ec tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:01.950304 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05cd0801-15ae-401a-99a2-02790041d1ec tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:01.950878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05cd0801-15ae-401a-99a2-02790041d1ec tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:01.985558 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-69a6e04a-995a-4820-a051-b53e4284c99d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:02.011038 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-69a6e04a-995a-4820-a051-b53e4284c99d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:02.016420 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-69a6e04a-995a-4820-a051-b53e4284c99d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:02.018243 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-69a6e04a-995a-4820-a051-b53e4284c99d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924" status: 200 len: 1812 microversion: 2.25 time: 0.405628 Oct 26 13:07:02.020485 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 586/1253] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:07:01 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 => generated 1812 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:07:02.027400 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-695e533f-4cdf-4423-a174-62bf6a395ae9 req-1f74f6e6-2496-4420-b6c3-899157b64980 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f27f0232-1c7a-433d-a8ed-9ef4f631b924", "name": "network-vif-unplugged", "status": "completed", "tag": "77991740-2ec4-4120-929b-065a4a4a02c8"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:02.056524 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-695e533f-4cdf-4423-a174-62bf6a395ae9 req-1f74f6e6-2496-4420-b6c3-899157b64980 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:02.059039 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-695e533f-4cdf-4423-a174-62bf6a395ae9 req-1f74f6e6-2496-4420-b6c3-899157b64980 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:02.061163 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-695e533f-4cdf-4423-a174-62bf6a395ae9 req-1f74f6e6-2496-4420-b6c3-899157b64980 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:02.094685 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-695e533f-4cdf-4423-a174-62bf6a395ae9 req-1f74f6e6-2496-4420-b6c3-899157b64980 service nova] Creating event network-vif-unplugged:77991740-2ec4-4120-929b-065a4a4a02c8 for instance f27f0232-1c7a-433d-a8ed-9ef4f631b924 on n-h1-862686-1 Oct 26 13:07:02.102804 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-695e533f-4cdf-4423-a174-62bf6a395ae9 req-1f74f6e6-2496-4420-b6c3-899157b64980 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080737 Oct 26 13:07:02.104056 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 587/1254] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:07:02.247775 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e840f29e-2a94-4f66-8234-6d684ca9ea79 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:02.248849 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e840f29e-2a94-4f66-8234-6d684ca9ea79 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:02.274930 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e840f29e-2a94-4f66-8234-6d684ca9ea79 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:02.279542 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e840f29e-2a94-4f66-8234-6d684ca9ea79 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:02.281134 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e840f29e-2a94-4f66-8234-6d684ca9ea79 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:02.282152 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e840f29e-2a94-4f66-8234-6d684ca9ea79 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:02.284616 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e840f29e-2a94-4f66-8234-6d684ca9ea79 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:02.286973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-05cd0801-15ae-401a-99a2-02790041d1ec tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:02.289079 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e840f29e-2a94-4f66-8234-6d684ca9ea79 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:02.297961 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-05cd0801-15ae-401a-99a2-02790041d1ec tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03" status: 200 len: 1521 microversion: 2.1 time: 0.371679 Oct 26 13:07:02.298562 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 668/1255] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:01 2022] GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03 => generated 1521 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:02.326385 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-834a142b-99e0-4cb3-a9a5-7c5086ca0412 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:02.327007 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-834a142b-99e0-4cb3-a9a5-7c5086ca0412 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: efcb289a-74cf-4dd6-a564-27b2255a002f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:02.344406 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-834a142b-99e0-4cb3-a9a5-7c5086ca0412 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:02.345205 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-834a142b-99e0-4cb3-a9a5-7c5086ca0412 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:02.347253 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-834a142b-99e0-4cb3-a9a5-7c5086ca0412 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:02.348208 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-834a142b-99e0-4cb3-a9a5-7c5086ca0412 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:02.349346 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-834a142b-99e0-4cb3-a9a5-7c5086ca0412 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:02.351408 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-834a142b-99e0-4cb3-a9a5-7c5086ca0412 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:02.427164 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-834a142b-99e0-4cb3-a9a5-7c5086ca0412 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:02.427872 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-834a142b-99e0-4cb3-a9a5-7c5086ca0412 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:02.429550 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-834a142b-99e0-4cb3-a9a5-7c5086ca0412 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:02.431661 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-834a142b-99e0-4cb3-a9a5-7c5086ca0412 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lazy-loading 'fault' on Instance uuid efcb289a-74cf-4dd6-a564-27b2255a002f {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:07:02.535965 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-834a142b-99e0-4cb3-a9a5-7c5086ca0412 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:02.551737 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-834a142b-99e0-4cb3-a9a5-7c5086ca0412 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/efcb289a-74cf-4dd6-a564-27b2255a002f" status: 200 len: 1307 microversion: 2.1 time: 0.227561 Oct 26 13:07:02.552657 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 669/1256] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:02 2022] GET /compute/v2.1/servers/efcb289a-74cf-4dd6-a564-27b2255a002f => generated 1307 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:02.573347 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-101b8f5c-a9aa-4633-80b3-ee036314cbe4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:02.577892 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-101b8f5c-a9aa-4633-80b3-ee036314cbe4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 2803303a-ad72-4096-b524-69a583a56f03] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:02.610461 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-101b8f5c-a9aa-4633-80b3-ee036314cbe4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:02.610461 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-101b8f5c-a9aa-4633-80b3-ee036314cbe4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:02.611131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-101b8f5c-a9aa-4633-80b3-ee036314cbe4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:02.612009 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-101b8f5c-a9aa-4633-80b3-ee036314cbe4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:02.612684 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-101b8f5c-a9aa-4633-80b3-ee036314cbe4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:02.615313 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-101b8f5c-a9aa-4633-80b3-ee036314cbe4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:02.643595 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e840f29e-2a94-4f66-8234-6d684ca9ea79 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:02.652258 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e840f29e-2a94-4f66-8234-6d684ca9ea79 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1472 microversion: 2.1 time: 0.409282 Oct 26 13:07:02.654511 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 588/1257] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:02 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1472 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:02.681529 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9b70b2ab-b5eb-454c-9a62-c6a4507f71c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:02.682620 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9b70b2ab-b5eb-454c-9a62-c6a4507f71c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:02.709930 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9b70b2ab-b5eb-454c-9a62-c6a4507f71c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:02.711981 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9b70b2ab-b5eb-454c-9a62-c6a4507f71c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:02.718848 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9b70b2ab-b5eb-454c-9a62-c6a4507f71c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:02.719820 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9b70b2ab-b5eb-454c-9a62-c6a4507f71c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:02.722192 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9b70b2ab-b5eb-454c-9a62-c6a4507f71c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:02.723365 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9b70b2ab-b5eb-454c-9a62-c6a4507f71c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:02.728593 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:07:02.975846 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-101b8f5c-a9aa-4633-80b3-ee036314cbe4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:02.985227 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-101b8f5c-a9aa-4633-80b3-ee036314cbe4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03" status: 200 len: 1521 microversion: 2.1 time: 0.429340 Oct 26 13:07:02.989957 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 670/1258] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:02 2022] GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03 => generated 1521 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:03.002661 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0cea66fa-9c6c-4b60-8042-4857ea596e0c tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f6732289700>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:03.075482 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9b70b2ab-b5eb-454c-9a62-c6a4507f71c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:03.089416 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9b70b2ab-b5eb-454c-9a62-c6a4507f71c1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1471 microversion: 2.1 time: 0.432921 Oct 26 13:07:03.090358 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 589/1259] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:02 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1471 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:03.114659 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cce8a2fe-e1c9-49b7-b2b1-82b1de693b23 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:03.127575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cce8a2fe-e1c9-49b7-b2b1-82b1de693b23 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: 249cce52-de17-460b-b445-e24d0d377986] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:03.136985 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0cea66fa-9c6c-4b60-8042-4857ea596e0c tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/ac122a22-843b-441e-bc8c-3e65b4dbcf63" status: 200 len: 1414 microversion: 2.1 time: 0.144034 Oct 26 13:07:03.139038 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 671/1260] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:07:02 2022] GET /compute/v2.1/images/ac122a22-843b-441e-bc8c-3e65b4dbcf63 => generated 1414 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:03.150858 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4b56feda-49bb-4baa-b296-266a613c8884 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1212312653", "metadata": {"": ""}}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:03.156182 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cce8a2fe-e1c9-49b7-b2b1-82b1de693b23 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:03.156836 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cce8a2fe-e1c9-49b7-b2b1-82b1de693b23 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:03.157305 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cce8a2fe-e1c9-49b7-b2b1-82b1de693b23 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:03.158076 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cce8a2fe-e1c9-49b7-b2b1-82b1de693b23 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:03.158536 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cce8a2fe-e1c9-49b7-b2b1-82b1de693b23 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:03.158970 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cce8a2fe-e1c9-49b7-b2b1-82b1de693b23 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:03.160819 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4b56feda-49bb-4baa-b296-266a613c8884 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Request method failure captured: Oct 26 13:07:03.160819 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03/action HTTP/1.1 Oct 26 13:07:03.160819 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:07:03.160819 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:07:03.160819 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:07:03.160819 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 107 Oct 26 13:07:03.160819 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:07:03.160819 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:07:03.160819 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:07:03.160819 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:07:03.160819 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTDWcY4mtHepJlQ55KVJtNHC-FXqIi903yr1J5OC-zbXOMs1LBU3zczKCFgnqIJBIqkvCLTFhaHFSdgfodLtkoXiluiPVf_SkgLznk0TL97DMnsRT29TeJsNzQAsUym5LCo50Ifxk2xlPnZ_QiGEmh7kAsukHuXMaWRZIS-UkeLc5o8 Oct 26 13:07:03.160819 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:07:03.160819 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:07:03.160819 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:07:03.160819 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:07:03.160819 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:07:03.160819 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:07:03.160819 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 186ac42922a64992aa1973bd854830d7 Oct 26 13:07:03.160819 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-778472214 Oct 26 13:07:03.160819 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:07:03.160819 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:07:03.163041 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/186ac42922a64992aa1973bd854830d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/186ac42922a64992aa1973bd854830d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_186ac42922a64992aa1973bd854830d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/186ac42922a64992aa1973bd854830d7"}]}] Oct 26 13:07:03.163041 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-778472214 Oct 26 13:07:03.163041 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 186ac42922a64992aa1973bd854830d7 Oct 26 13:07:03.163041 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-778472214 Oct 26 13:07:03.163041 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ImagesOneServerNegativeTestJSON-778472214-project Oct 26 13:07:03.163041 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:07:03.163041 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:07:03.163041 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 0b8d4ea396494628983bde1a97222f7d Oct 26 13:07:03.163041 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-778472214-project Oct 26 13:07:03.163041 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:07:03.163041 n-d-862686-1 devstack@n-api.service[120598]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1212312653", "metadata": {"": ""}}} Oct 26 13:07:03.163041 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:07:03.163950 n-d-862686-1 devstack@n-api.service[120598]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 13:07:03.163950 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '2803303a-ad72-4096-b524-69a583a56f03', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1212312653', 'metadata': {'': ''}}}} Oct 26 13:07:03.163950 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:07:03.163950 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:03.163950 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 13:07:03.163950 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 13:07:03.163950 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 13:07:03.163950 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise error Oct 26 13:07:03.163950 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 13:07:03.163950 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:03.163950 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 26 13:07:03.163950 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 26 13:07:03.163950 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 26 13:07:03.163950 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 26 13:07:03.163950 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 26 13:07:03.163950 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:03.163950 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 26 13:07:03.163950 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi {'': ''} Oct 26 13:07:03.163950 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:03.163950 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:03.163950 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:03.165499 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:03.165499 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:03.165499 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:03.165499 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:07:03.165499 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:07:03.165499 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:07:03.165499 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:07:03.165499 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:07:03.165499 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:07:03.165499 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 13:07:03.165499 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 13:07:03.165499 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 13:07:03.165499 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 13:07:03.165499 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 13:07:03.165499 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 13:07:03.165499 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 13:07:03.165499 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:03.165499 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:03.165499 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:03.165499 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:03.167005 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:03.167005 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:03.167005 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 13:07:03.167005 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 13:07:03.167005 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 13:07:03.167005 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:03.194605 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4b56feda-49bb-4baa-b296-266a613c8884 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:07:03.195768 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4b56feda-49bb-4baa-b296-266a613c8884 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "POST /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03/action" status: 400 len: 170 microversion: 2.1 time: 0.055560 Oct 26 13:07:03.196911 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 672/1261] 10.222.0.40 () {60 vars in 1279 bytes} [Wed Oct 26 13:07:03 2022] POST /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03/action => generated 170 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:07:03.214113 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-48105e9c-6209-43fe-9b36-31cb487abf40 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:03.214996 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-48105e9c-6209-43fe-9b36-31cb487abf40 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:03.236319 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48105e9c-6209-43fe-9b36-31cb487abf40 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:03.243670 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48105e9c-6209-43fe-9b36-31cb487abf40 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:03.244365 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48105e9c-6209-43fe-9b36-31cb487abf40 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:03.245796 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48105e9c-6209-43fe-9b36-31cb487abf40 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:03.246423 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48105e9c-6209-43fe-9b36-31cb487abf40 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:03.247332 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48105e9c-6209-43fe-9b36-31cb487abf40 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:03.434622 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cce8a2fe-e1c9-49b7-b2b1-82b1de693b23 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:03.446374 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cce8a2fe-e1c9-49b7-b2b1-82b1de693b23 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986" status: 200 len: 1471 microversion: 2.1 time: 0.352584 Oct 26 13:07:03.463903 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 590/1262] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:03 2022] GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986 => generated 1471 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:03.478825 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-754e4e79-7b64-4584-91ca-4ecb20b5aba0 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:03.479711 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-754e4e79-7b64-4584-91ca-4ecb20b5aba0 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 2803303a-ad72-4096-b524-69a583a56f03] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:03.488738 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-754e4e79-7b64-4584-91ca-4ecb20b5aba0 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:03.489976 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-754e4e79-7b64-4584-91ca-4ecb20b5aba0 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:03.490783 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-754e4e79-7b64-4584-91ca-4ecb20b5aba0 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:03.493471 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-754e4e79-7b64-4584-91ca-4ecb20b5aba0 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:03.493949 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-754e4e79-7b64-4584-91ca-4ecb20b5aba0 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:03.494753 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-754e4e79-7b64-4584-91ca-4ecb20b5aba0 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:03.626800 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-48105e9c-6209-43fe-9b36-31cb487abf40 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:03.643217 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-48105e9c-6209-43fe-9b36-31cb487abf40 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:03.653977 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-48105e9c-6209-43fe-9b36-31cb487abf40 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:03.656463 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-48105e9c-6209-43fe-9b36-31cb487abf40 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924" status: 200 len: 1812 microversion: 2.25 time: 0.457787 Oct 26 13:07:03.660168 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 673/1263] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:07:03 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 => generated 1812 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:07:03.674562 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4889856d-46bf-4573-b88f-5ac83ab6cd3b tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:03.675340 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4889856d-46bf-4573-b88f-5ac83ab6cd3b tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] [instance: 249cce52-de17-460b-b445-e24d0d377986] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:03.690829 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4889856d-46bf-4573-b88f-5ac83ab6cd3b tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:03.691590 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4889856d-46bf-4573-b88f-5ac83ab6cd3b tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:03.692253 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4889856d-46bf-4573-b88f-5ac83ab6cd3b tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:03.693913 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4889856d-46bf-4573-b88f-5ac83ab6cd3b tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:03.695216 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4889856d-46bf-4573-b88f-5ac83ab6cd3b tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:03.695854 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4889856d-46bf-4573-b88f-5ac83ab6cd3b tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:03.754004 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-4889856d-46bf-4573-b88f-5ac83ab6cd3b tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] Lazy-loading 'flavor' on Instance uuid 249cce52-de17-460b-b445-e24d0d377986 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:07:03.807534 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:07:03.815134 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-754e4e79-7b64-4584-91ca-4ecb20b5aba0 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:03.826703 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-754e4e79-7b64-4584-91ca-4ecb20b5aba0 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03" status: 200 len: 1521 microversion: 2.1 time: 0.361307 Oct 26 13:07:03.842994 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 591/1264] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:03 2022] GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03 => generated 1521 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:03.865352 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c2b1ca35-67dd-4316-ac59-5cd228fa98d8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:03.866420 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c2b1ca35-67dd-4316-ac59-5cd228fa98d8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: efcb289a-74cf-4dd6-a564-27b2255a002f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:03.873983 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c2b1ca35-67dd-4316-ac59-5cd228fa98d8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:03.874968 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c2b1ca35-67dd-4316-ac59-5cd228fa98d8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:03.876117 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c2b1ca35-67dd-4316-ac59-5cd228fa98d8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:03.877070 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c2b1ca35-67dd-4316-ac59-5cd228fa98d8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:03.877721 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c2b1ca35-67dd-4316-ac59-5cd228fa98d8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:03.878361 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c2b1ca35-67dd-4316-ac59-5cd228fa98d8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:03.915112 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4889856d-46bf-4573-b88f-5ac83ab6cd3b tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986/action" status: 202 len: 0 microversion: 2.1 time: 0.252666 Oct 26 13:07:03.920556 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 674/1265] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:07:03 2022] POST /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:07:03.920826 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-c2b1ca35-67dd-4316-ac59-5cd228fa98d8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] HTTP exception thrown: Instance efcb289a-74cf-4dd6-a564-27b2255a002f could not be found. Oct 26 13:07:03.923097 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c2b1ca35-67dd-4316-ac59-5cd228fa98d8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Request method failure captured: Oct 26 13:07:03.923097 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/efcb289a-74cf-4dd6-a564-27b2255a002f HTTP/1.1 Oct 26 13:07:03.923097 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:07:03.923097 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:07:03.923097 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:07:03.923097 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:07:03.923097 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:07:03.923097 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:07:03.923097 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:07:03.923097 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:07:03.923097 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTBPRVt_8YZnaMSFiptNqbU9QNU93-_uVsnIl5oPaIxTkieW3pGz0zJKB63vkS1UTm30oE-_Ib6tVEIUcfod49uJs_R6L4h_NtP5w4W8pi8x5J4f1QqVVXViMhIM2rv6Z6M-Vnp8kRHMISIYhq0EFTwFrWnXPDyjXTUbEUwh3-ynQvQ Oct 26 13:07:03.923097 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:07:03.923097 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:07:03.923097 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:07:03.923097 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:07:03.923097 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:07:03.923097 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:07:03.923097 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: d6515917885c4f3cb5fb19e05f4e5e2b Oct 26 13:07:03.923097 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersOnMultiNodesTest-1287428008 Oct 26 13:07:03.923097 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:07:03.923097 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:07:03.924704 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d6515917885c4f3cb5fb19e05f4e5e2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d6515917885c4f3cb5fb19e05f4e5e2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d6515917885c4f3cb5fb19e05f4e5e2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d6515917885c4f3cb5fb19e05f4e5e2b"}]}] Oct 26 13:07:03.924704 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersOnMultiNodesTest-1287428008 Oct 26 13:07:03.924704 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: d6515917885c4f3cb5fb19e05f4e5e2b Oct 26 13:07:03.924704 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1287428008 Oct 26 13:07:03.924704 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersOnMultiNodesTest-1287428008-project Oct 26 13:07:03.924704 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:07:03.924704 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:07:03.924704 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: b6cddfeca4ce49788143b2bf4b30545f Oct 26 13:07:03.924704 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersOnMultiNodesTest-1287428008-project Oct 26 13:07:03.924704 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:07:03.924704 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance efcb289a-74cf-4dd6-a564-27b2255a002f could not be found. Oct 26 13:07:03.924704 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'efcb289a-74cf-4dd6-a564-27b2255a002f'} Oct 26 13:07:03.925903 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:07:03.925903 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:03.925903 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:07:03.925903 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:07:03.925903 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:07:03.925903 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:07:03.925903 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:07:03.925903 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:07:03.925903 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:07:03.925903 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:07:03.925903 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efcb289a-74cf-4dd6-a564-27b2255a002f could not be found. Oct 26 13:07:03.925903 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:03.925903 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:03.925903 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:03.925903 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:03.925903 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:03.925903 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:03.925903 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:07:03.925903 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:07:03.925903 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:07:03.927851 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:07:03.927851 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:07:03.927851 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:07:03.927851 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:07:03.927851 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:07:03.927851 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:07:03.927851 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:07:03.927851 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efcb289a-74cf-4dd6-a564-27b2255a002f could not be found. Oct 26 13:07:03.927851 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:03.927851 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:03.927851 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:03.927851 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:03.927851 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:03.927851 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:03.927851 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:07:03.927851 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:07:03.927851 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efcb289a-74cf-4dd6-a564-27b2255a002f could not be found. Oct 26 13:07:03.927851 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:03.931062 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c2b1ca35-67dd-4316-ac59-5cd228fa98d8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Returning 404 to user: Instance efcb289a-74cf-4dd6-a564-27b2255a002f could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:07:03.932420 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c2b1ca35-67dd-4316-ac59-5cd228fa98d8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/efcb289a-74cf-4dd6-a564-27b2255a002f" status: 404 len: 111 microversion: 2.1 time: 0.087932 Oct 26 13:07:03.933173 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9db035ac-3e64-40f7-bb33-d032938150ef tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:03.933755 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 592/1266] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:03 2022] GET /compute/v2.1/servers/efcb289a-74cf-4dd6-a564-27b2255a002f => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:07:03.935727 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9db035ac-3e64-40f7-bb33-d032938150ef tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:03.939410 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bc3cadbf-cd48-4a22-9c28-8f5b5643a734 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:03.940225 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bc3cadbf-cd48-4a22-9c28-8f5b5643a734 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 2803303a-ad72-4096-b524-69a583a56f03] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:03.946425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:07:03.947677 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc3cadbf-cd48-4a22-9c28-8f5b5643a734 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:03.948370 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc3cadbf-cd48-4a22-9c28-8f5b5643a734 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:03.949010 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc3cadbf-cd48-4a22-9c28-8f5b5643a734 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:03.949971 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc3cadbf-cd48-4a22-9c28-8f5b5643a734 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:03.950134 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9db035ac-3e64-40f7-bb33-d032938150ef tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:03.951001 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc3cadbf-cd48-4a22-9c28-8f5b5643a734 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:03.951211 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9db035ac-3e64-40f7-bb33-d032938150ef tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:03.951435 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc3cadbf-cd48-4a22-9c28-8f5b5643a734 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:03.951827 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9db035ac-3e64-40f7-bb33-d032938150ef tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:03.953333 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9db035ac-3e64-40f7-bb33-d032938150ef tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:03.953843 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9db035ac-3e64-40f7-bb33-d032938150ef tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:03.954693 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9db035ac-3e64-40f7-bb33-d032938150ef tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:04.181661 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bc3cadbf-cd48-4a22-9c28-8f5b5643a734 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:04.204027 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bc3cadbf-cd48-4a22-9c28-8f5b5643a734 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03" status: 200 len: 1521 microversion: 2.1 time: 0.261413 Oct 26 13:07:04.214473 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 593/1267] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:03 2022] GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03 => generated 1521 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:04.237520 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-857e86cf-838e-4b7f-81f7-a7d070309899 tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:04.241174 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-857e86cf-838e-4b7f-81f7-a7d070309899 tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] [instance: 249cce52-de17-460b-b445-e24d0d377986] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:04.255023 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9db035ac-3e64-40f7-bb33-d032938150ef tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:04.263724 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-857e86cf-838e-4b7f-81f7-a7d070309899 tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:04.264227 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-857e86cf-838e-4b7f-81f7-a7d070309899 tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:04.268489 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9db035ac-3e64-40f7-bb33-d032938150ef tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1478 microversion: 2.1 time: 0.345377 Oct 26 13:07:04.269701 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-857e86cf-838e-4b7f-81f7-a7d070309899 tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:04.271117 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-857e86cf-838e-4b7f-81f7-a7d070309899 tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:04.271872 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 675/1268] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:03 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1478 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:04.272757 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-857e86cf-838e-4b7f-81f7-a7d070309899 tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:04.273608 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-857e86cf-838e-4b7f-81f7-a7d070309899 tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:04.289283 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3dcdd1e4-a590-4650-92f7-43bd6cb426a8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:04.299396 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3dcdd1e4-a590-4650-92f7-43bd6cb426a8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 82458e75-f124-45b2-85a6-ef634b510f90] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:04.325910 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3dcdd1e4-a590-4650-92f7-43bd6cb426a8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:04.326414 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3dcdd1e4-a590-4650-92f7-43bd6cb426a8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:04.326842 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3dcdd1e4-a590-4650-92f7-43bd6cb426a8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:04.327549 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3dcdd1e4-a590-4650-92f7-43bd6cb426a8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:04.334534 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3dcdd1e4-a590-4650-92f7-43bd6cb426a8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:04.335133 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3dcdd1e4-a590-4650-92f7-43bd6cb426a8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:04.391792 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3dcdd1e4-a590-4650-92f7-43bd6cb426a8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 82458e75-f124-45b2-85a6-ef634b510f90] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:07:04.581541 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3dcdd1e4-a590-4650-92f7-43bd6cb426a8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "DELETE /compute/v2.1/servers/82458e75-f124-45b2-85a6-ef634b510f90" status: 204 len: 0 microversion: 2.1 time: 0.306286 Oct 26 13:07:04.582925 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 676/1269] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:07:04 2022] DELETE /compute/v2.1/servers/82458e75-f124-45b2-85a6-ef634b510f90 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:07:04.595219 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-457ade75-efde-4ef7-9140-876df03ea8c4 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:04.610763 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-457ade75-efde-4ef7-9140-876df03ea8c4 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:04.627884 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-457ade75-efde-4ef7-9140-876df03ea8c4 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:04.633073 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-457ade75-efde-4ef7-9140-876df03ea8c4 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:04.633806 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-457ade75-efde-4ef7-9140-876df03ea8c4 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:04.634973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-457ade75-efde-4ef7-9140-876df03ea8c4 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:04.635539 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-457ade75-efde-4ef7-9140-876df03ea8c4 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:04.636716 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-457ade75-efde-4ef7-9140-876df03ea8c4 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:04.769389 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-857e86cf-838e-4b7f-81f7-a7d070309899 tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986" status: 200 len: 1630 microversion: 2.1 time: 0.553180 Oct 26 13:07:04.799090 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 594/1270] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:04 2022] GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986 => generated 1630 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:04.811774 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9bdbaa47-2111-4eaf-8c55-61ca1435a3e5 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67326e2c10>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:04.865758 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-457ade75-efde-4ef7-9140-876df03ea8c4 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:04.879587 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-457ade75-efde-4ef7-9140-876df03ea8c4 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1471 microversion: 2.1 time: 0.291742 Oct 26 13:07:04.888584 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9bdbaa47-2111-4eaf-8c55-61ca1435a3e5 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/ac122a22-843b-441e-bc8c-3e65b4dbcf63" status: 200 len: 1414 microversion: 2.1 time: 0.088021 Oct 26 13:07:04.897798 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 595/1271] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:07:04 2022] GET /compute/v2.1/images/ac122a22-843b-441e-bc8c-3e65b4dbcf63 => generated 1414 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:04.899670 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 677/1272] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:04 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1471 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:04.905623 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-d67c8e3e-aa57-4234-a7bd-87b0f78bbbf2 req-0ced33f5-610f-46a9-8c33-7c3a5ca275aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f27f0232-1c7a-433d-a8ed-9ef4f631b924", "tag": "77991740-2ec4-4120-929b-065a4a4a02c8"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:04.918305 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-938bd5d4-1bdf-445e-93c2-697d894f54b9 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1805123105", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:04.921091 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d67c8e3e-aa57-4234-a7bd-87b0f78bbbf2 req-0ced33f5-610f-46a9-8c33-7c3a5ca275aa service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:04.921387 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d67c8e3e-aa57-4234-a7bd-87b0f78bbbf2 req-0ced33f5-610f-46a9-8c33-7c3a5ca275aa service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:04.921820 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d67c8e3e-aa57-4234-a7bd-87b0f78bbbf2 req-0ced33f5-610f-46a9-8c33-7c3a5ca275aa service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:04.925211 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-938bd5d4-1bdf-445e-93c2-697d894f54b9 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Request method failure captured: Oct 26 13:07:04.925211 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03/action HTTP/1.1 Oct 26 13:07:04.925211 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:07:04.925211 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:07:04.925211 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:07:04.925211 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 619 Oct 26 13:07:04.925211 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:07:04.925211 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:07:04.925211 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:07:04.925211 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:07:04.925211 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTDWcY4mtHepJlQ55KVJtNHC-FXqIi903yr1J5OC-zbXOMs1LBU3zczKCFgnqIJBIqkvCLTFhaHFSdgfodLtkoXiluiPVf_SkgLznk0TL97DMnsRT29TeJsNzQAsUym5LCo50Ifxk2xlPnZ_QiGEmh7kAsukHuXMaWRZIS-UkeLc5o8 Oct 26 13:07:04.925211 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:07:04.925211 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:07:04.925211 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:07:04.925211 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:07:04.925211 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:07:04.925211 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:07:04.925211 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 186ac42922a64992aa1973bd854830d7 Oct 26 13:07:04.925211 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-778472214 Oct 26 13:07:04.925211 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:07:04.925211 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:07:04.926822 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/186ac42922a64992aa1973bd854830d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/186ac42922a64992aa1973bd854830d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_186ac42922a64992aa1973bd854830d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/186ac42922a64992aa1973bd854830d7"}]}] Oct 26 13:07:04.926822 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-778472214 Oct 26 13:07:04.926822 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 186ac42922a64992aa1973bd854830d7 Oct 26 13:07:04.926822 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-778472214 Oct 26 13:07:04.926822 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ImagesOneServerNegativeTestJSON-778472214-project Oct 26 13:07:04.926822 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:07:04.926822 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:07:04.926822 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 0b8d4ea396494628983bde1a97222f7d Oct 26 13:07:04.926822 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-778472214-project Oct 26 13:07:04.926822 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:07:04.927557 n-d-862686-1 devstack@n-api.service[120598]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1805123105", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 26 13:07:04.927557 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:07:04.927557 n-d-862686-1 devstack@n-api.service[120598]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 13:07:04.927820 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '2803303a-ad72-4096-b524-69a583a56f03', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1805123105', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 26 13:07:04.927820 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:07:04.927820 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:04.927820 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 13:07:04.927820 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 13:07:04.927820 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 13:07:04.927820 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise error Oct 26 13:07:04.927820 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 13:07:04.927820 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:04.927820 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 26 13:07:04.927820 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 26 13:07:04.929259 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 26 13:07:04.929259 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 26 13:07:04.929259 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 26 13:07:04.929259 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:04.929259 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 26 13:07:04.929259 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 26 13:07:04.929259 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:04.929259 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:04.929259 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:04.929259 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:04.929259 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:04.929259 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:04.929259 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:07:04.929259 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:07:04.929259 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:07:04.929259 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:07:04.929259 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:07:04.930631 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:07:04.930631 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 13:07:04.930631 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 13:07:04.930631 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 13:07:04.930631 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 13:07:04.930631 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 13:07:04.930631 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 13:07:04.930631 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 13:07:04.930631 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:04.930631 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:04.930631 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:04.930631 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:04.931494 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:04.931494 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:04.931494 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 13:07:04.931494 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 13:07:04.931494 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 13:07:04.931494 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:04.932638 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-938bd5d4-1bdf-445e-93c2-697d894f54b9 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:07:04.933711 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-938bd5d4-1bdf-445e-93c2-697d894f54b9 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "POST /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03/action" status: 400 len: 938 microversion: 2.1 time: 0.032873 Oct 26 13:07:04.934741 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 678/1273] 10.222.0.40 () {60 vars in 1279 bytes} [Wed Oct 26 13:07:04 2022] POST /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03/action => generated 938 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:07:04.941586 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9da63a67-acff-43fb-8926-33f1e2e62286 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:04.942047 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9da63a67-acff-43fb-8926-33f1e2e62286 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 82458e75-f124-45b2-85a6-ef634b510f90] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:04.952830 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-d67c8e3e-aa57-4234-a7bd-87b0f78bbbf2 req-0ced33f5-610f-46a9-8c33-7c3a5ca275aa service nova] Creating event network-changed:77991740-2ec4-4120-929b-065a4a4a02c8 for instance f27f0232-1c7a-433d-a8ed-9ef4f631b924 on n-h1-862686-1 Oct 26 13:07:04.963034 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9da63a67-acff-43fb-8926-33f1e2e62286 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:04.963619 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9da63a67-acff-43fb-8926-33f1e2e62286 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:04.964066 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9da63a67-acff-43fb-8926-33f1e2e62286 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:04.965346 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-d67c8e3e-aa57-4234-a7bd-87b0f78bbbf2 req-0ced33f5-610f-46a9-8c33-7c3a5ca275aa service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066240 Oct 26 13:07:04.966161 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 596/1274] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:07:04.968800 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9da63a67-acff-43fb-8926-33f1e2e62286 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:04.969285 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9da63a67-acff-43fb-8926-33f1e2e62286 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:04.969750 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9da63a67-acff-43fb-8926-33f1e2e62286 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:04.978614 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b73717c6-6e7a-46c9-bf2b-1d1f63197524 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:04.983551 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b73717c6-6e7a-46c9-bf2b-1d1f63197524 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:04.999788 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b73717c6-6e7a-46c9-bf2b-1d1f63197524 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:05.000543 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b73717c6-6e7a-46c9-bf2b-1d1f63197524 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:05.001608 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b73717c6-6e7a-46c9-bf2b-1d1f63197524 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:05.002620 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b73717c6-6e7a-46c9-bf2b-1d1f63197524 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:05.003251 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b73717c6-6e7a-46c9-bf2b-1d1f63197524 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:05.003849 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b73717c6-6e7a-46c9-bf2b-1d1f63197524 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:05.186296 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9da63a67-acff-43fb-8926-33f1e2e62286 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:05.195806 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9da63a67-acff-43fb-8926-33f1e2e62286 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/82458e75-f124-45b2-85a6-ef634b510f90" status: 200 len: 1472 microversion: 2.1 time: 0.259866 Oct 26 13:07:05.196808 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 679/1275] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:04 2022] GET /compute/v2.1/servers/82458e75-f124-45b2-85a6-ef634b510f90 => generated 1472 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:05.211328 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c3467e4a-c18c-4ed3-b6ea-73b7c657347d tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:05.211963 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c3467e4a-c18c-4ed3-b6ea-73b7c657347d tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 2803303a-ad72-4096-b524-69a583a56f03] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:05.218800 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c3467e4a-c18c-4ed3-b6ea-73b7c657347d tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:05.219290 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c3467e4a-c18c-4ed3-b6ea-73b7c657347d tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:05.219726 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c3467e4a-c18c-4ed3-b6ea-73b7c657347d tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:05.220434 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c3467e4a-c18c-4ed3-b6ea-73b7c657347d tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:05.220898 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c3467e4a-c18c-4ed3-b6ea-73b7c657347d tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:05.221321 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c3467e4a-c18c-4ed3-b6ea-73b7c657347d tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:05.278810 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b73717c6-6e7a-46c9-bf2b-1d1f63197524 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:05.295032 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b73717c6-6e7a-46c9-bf2b-1d1f63197524 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:05.297123 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b73717c6-6e7a-46c9-bf2b-1d1f63197524 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:05.298871 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b73717c6-6e7a-46c9-bf2b-1d1f63197524 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924" status: 200 len: 1812 microversion: 2.25 time: 0.331768 Oct 26 13:07:05.300047 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 597/1276] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:07:04 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 => generated 1812 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:07:05.422694 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c3467e4a-c18c-4ed3-b6ea-73b7c657347d tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:05.442398 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c3467e4a-c18c-4ed3-b6ea-73b7c657347d tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03" status: 200 len: 1521 microversion: 2.1 time: 0.243851 Oct 26 13:07:05.443553 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 680/1277] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:05 2022] GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:05.469248 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4b438715-6c73-424a-a6bb-51b3deb506f2 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:05.470666 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4b438715-6c73-424a-a6bb-51b3deb506f2 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:05.478303 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4b438715-6c73-424a-a6bb-51b3deb506f2 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:05.478792 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4b438715-6c73-424a-a6bb-51b3deb506f2 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:05.479226 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4b438715-6c73-424a-a6bb-51b3deb506f2 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:05.479928 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4b438715-6c73-424a-a6bb-51b3deb506f2 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:05.480377 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4b438715-6c73-424a-a6bb-51b3deb506f2 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:05.483281 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4b438715-6c73-424a-a6bb-51b3deb506f2 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:05.523271 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d648d9c7-e6bd-4074-8346-4a2cc1679e49 tempest-QuotaClassesAdminTestJSON-871536779 tempest-QuotaClassesAdminTestJSON-871536779-project-admin] Calling method '.version_select at 0x7f67326f65e0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:05.548534 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d648d9c7-e6bd-4074-8346-4a2cc1679e49 tempest-QuotaClassesAdminTestJSON-871536779 tempest-QuotaClassesAdminTestJSON-871536779-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.246915 Oct 26 13:07:05.549789 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 598/1278] 10.222.0.40 () {58 vars in 1185 bytes} [Wed Oct 26 13:07:05 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:07:05.563424 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3c1a6634-7393-416c-836f-de2beb60b496 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:05.564052 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3c1a6634-7393-416c-836f-de2beb60b496 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 2803303a-ad72-4096-b524-69a583a56f03] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:05.573216 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3c1a6634-7393-416c-836f-de2beb60b496 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:05.573825 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3c1a6634-7393-416c-836f-de2beb60b496 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:05.574271 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3c1a6634-7393-416c-836f-de2beb60b496 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:05.574990 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3c1a6634-7393-416c-836f-de2beb60b496 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:05.575444 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3c1a6634-7393-416c-836f-de2beb60b496 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:05.575901 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3c1a6634-7393-416c-836f-de2beb60b496 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:05.663058 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4b438715-6c73-424a-a6bb-51b3deb506f2 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:05.672839 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4b438715-6c73-424a-a6bb-51b3deb506f2 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1478 microversion: 2.1 time: 0.226900 Oct 26 13:07:05.690163 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 681/1279] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:05 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1478 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:05.695794 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8c5ac02e-c7bb-41b2-af18-d4be0c309cd0 tempest-QuotaClassesAdminTestJSON-871536779 tempest-QuotaClassesAdminTestJSON-871536779-project-admin] Action: 'update', calling method: .version_select at 0x7f67325b6310>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:05.873748 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3c1a6634-7393-416c-836f-de2beb60b496 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:05.887434 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3c1a6634-7393-416c-836f-de2beb60b496 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03" status: 200 len: 1521 microversion: 2.1 time: 0.336250 Oct 26 13:07:05.888231 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 599/1280] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:05 2022] GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03 => generated 1521 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:05.893613 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3932da9f-7a2e-4e27-a92b-380e62c8e53e tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:05.894735 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3932da9f-7a2e-4e27-a92b-380e62c8e53e tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] [instance: 249cce52-de17-460b-b445-e24d0d377986] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:05.919219 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3932da9f-7a2e-4e27-a92b-380e62c8e53e tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:05.920169 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3932da9f-7a2e-4e27-a92b-380e62c8e53e tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:05.920616 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3932da9f-7a2e-4e27-a92b-380e62c8e53e tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:05.921339 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3932da9f-7a2e-4e27-a92b-380e62c8e53e tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:05.921946 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3932da9f-7a2e-4e27-a92b-380e62c8e53e tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:05.922609 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3932da9f-7a2e-4e27-a92b-380e62c8e53e tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:06.106904 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3932da9f-7a2e-4e27-a92b-380e62c8e53e tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986" status: 200 len: 1613 microversion: 2.1 time: 0.216771 Oct 26 13:07:06.107789 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 600/1281] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:05 2022] GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986 => generated 1613 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:06.113370 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c058484d-7667-4350-8ad7-868f90d34c46 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f6732e47820>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:06.164480 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c058484d-7667-4350-8ad7-868f90d34c46 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/ac122a22-843b-441e-bc8c-3e65b4dbcf63" status: 200 len: 1414 microversion: 2.1 time: 0.054961 Oct 26 13:07:06.165671 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 601/1282] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:07:06 2022] GET /compute/v2.1/images/ac122a22-843b-441e-bc8c-3e65b4dbcf63 => generated 1414 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:06.170665 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7ec7ef40-9d9c-44b2-a602-a70844c80208 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:06.175233 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7ec7ef40-9d9c-44b2-a602-a70844c80208 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Request method failure captured: Oct 26 13:07:06.175233 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03/action HTTP/1.1 Oct 26 13:07:06.175233 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:07:06.175233 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:07:06.175233 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:07:06.175233 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 285 Oct 26 13:07:06.175233 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:07:06.175233 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:07:06.175233 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:07:06.175233 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:07:06.175233 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTDWcY4mtHepJlQ55KVJtNHC-FXqIi903yr1J5OC-zbXOMs1LBU3zczKCFgnqIJBIqkvCLTFhaHFSdgfodLtkoXiluiPVf_SkgLznk0TL97DMnsRT29TeJsNzQAsUym5LCo50Ifxk2xlPnZ_QiGEmh7kAsukHuXMaWRZIS-UkeLc5o8 Oct 26 13:07:06.175233 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:07:06.175233 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:07:06.175233 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:07:06.175233 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:07:06.175233 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:07:06.175233 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:07:06.175233 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 186ac42922a64992aa1973bd854830d7 Oct 26 13:07:06.175233 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-778472214 Oct 26 13:07:06.175233 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:07:06.175233 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:07:06.176974 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/186ac42922a64992aa1973bd854830d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/186ac42922a64992aa1973bd854830d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_186ac42922a64992aa1973bd854830d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/186ac42922a64992aa1973bd854830d7"}]}] Oct 26 13:07:06.176974 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-778472214 Oct 26 13:07:06.176974 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 186ac42922a64992aa1973bd854830d7 Oct 26 13:07:06.176974 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-778472214 Oct 26 13:07:06.176974 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ImagesOneServerNegativeTestJSON-778472214-project Oct 26 13:07:06.176974 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:07:06.176974 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:07:06.176974 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 0b8d4ea396494628983bde1a97222f7d Oct 26 13:07:06.176974 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-778472214-project Oct 26 13:07:06.176974 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:07:06.176974 n-d-862686-1 devstack@n-api.service[120597]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 26 13:07:06.177861 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:07:06.177861 n-d-862686-1 devstack@n-api.service[120597]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 26 13:07:06.177861 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '2803303a-ad72-4096-b524-69a583a56f03', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 26 13:07:06.177861 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:07:06.177861 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:06.177861 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 13:07:06.177861 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 13:07:06.177861 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 13:07:06.177861 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise error Oct 26 13:07:06.177861 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 26 13:07:06.178829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:06.178829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 26 13:07:06.178829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 26 13:07:06.178829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:06.178829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 26 13:07:06.178829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 26 13:07:06.178829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:06.178829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:06.178829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:06.178829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:06.178829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:06.178829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:06.178829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:07:06.178829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:07:06.178829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:07:06.178829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:07:06.178829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:07:06.178829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:07:06.178829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 13:07:06.178829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 13:07:06.180339 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 13:07:06.180339 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 13:07:06.180339 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 13:07:06.180339 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 13:07:06.180339 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 26 13:07:06.180339 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:06.180339 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:06.180339 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:06.180339 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:06.180339 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:06.180339 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:06.180339 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 13:07:06.180339 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 13:07:06.181300 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 26 13:07:06.181300 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:06.182220 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7ec7ef40-9d9c-44b2-a602-a70844c80208 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:07:06.183922 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7ec7ef40-9d9c-44b2-a602-a70844c80208 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "POST /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03/action" status: 400 len: 619 microversion: 2.1 time: 0.017154 Oct 26 13:07:06.184979 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 602/1283] 10.222.0.40 () {60 vars in 1279 bytes} [Wed Oct 26 13:07:06 2022] POST /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03/action => generated 619 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:07:06.190943 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-022c5ce1-64d8-480e-9cf9-49463af9732e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:06.191782 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-022c5ce1-64d8-480e-9cf9-49463af9732e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:06.198757 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-022c5ce1-64d8-480e-9cf9-49463af9732e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:06.199246 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-022c5ce1-64d8-480e-9cf9-49463af9732e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:06.199667 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-022c5ce1-64d8-480e-9cf9-49463af9732e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:06.200375 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-022c5ce1-64d8-480e-9cf9-49463af9732e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:06.200937 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-022c5ce1-64d8-480e-9cf9-49463af9732e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:06.201259 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-022c5ce1-64d8-480e-9cf9-49463af9732e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:06.211871 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8c5ac02e-c7bb-41b2-af18-d4be0c309cd0 tempest-QuotaClassesAdminTestJSON-871536779 tempest-QuotaClassesAdminTestJSON-871536779-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.520338 Oct 26 13:07:06.220953 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 682/1284] 10.222.0.40 () {60 vars in 1206 bytes} [Wed Oct 26 13:07:05 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:07:06.220953 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b5ba87e2-a282-4980-b566-10d29d20b846 tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:06.220953 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b5ba87e2-a282-4980-b566-10d29d20b846 tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] [instance: 249cce52-de17-460b-b445-e24d0d377986] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:06.226277 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5ba87e2-a282-4980-b566-10d29d20b846 tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:06.226277 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5ba87e2-a282-4980-b566-10d29d20b846 tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:06.226277 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5ba87e2-a282-4980-b566-10d29d20b846 tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:06.227457 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5ba87e2-a282-4980-b566-10d29d20b846 tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:06.227907 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5ba87e2-a282-4980-b566-10d29d20b846 tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:06.228199 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5ba87e2-a282-4980-b566-10d29d20b846 tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:06.260218 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-b5ba87e2-a282-4980-b566-10d29d20b846 tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] HTTP exception thrown: Cannot 'migrate' instance 249cce52-de17-460b-b445-e24d0d377986 while it is in vm_state suspended Oct 26 13:07:06.262020 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b5ba87e2-a282-4980-b566-10d29d20b846 tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] Request method failure captured: Oct 26 13:07:06.262020 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986/action HTTP/1.1 Oct 26 13:07:06.262020 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:07:06.262020 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:07:06.262020 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:07:06.262020 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 15 Oct 26 13:07:06.262020 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:07:06.262020 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:07:06.262020 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:07:06.262020 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:07:06.262020 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTC0aqQ0l4q1158VDmiDaXwj0lvFq6vLvqlU2j9jFORkFu2g83quWd81nF7-6ctIqFLLStP9xenIjoNRtk3fol0tT6bnwiqM5ixVaBYALrT3Afd9_fX5mWB69yGpShFtkW-x-v21BlHO06I4UhuP3WJhtCWK1CZGsUEhOH1Ehxsq-NU Oct 26 13:07:06.262020 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:07:06.262020 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:07:06.262020 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:07:06.262020 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:07:06.262020 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:07:06.262020 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:07:06.262020 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: f6270fafd849458c8c880c0e2319db07 Oct 26 13:07:06.262020 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1034477245 Oct 26 13:07:06.262020 n-d-862686-1 devstack@n-api.service[120598]: X-Role: admin,member,reader Oct 26 13:07:06.262020 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: admin,member,reader Oct 26 13:07:06.263597 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f6270fafd849458c8c880c0e2319db07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f6270fafd849458c8c880c0e2319db07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f6270fafd849458c8c880c0e2319db07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f6270fafd849458c8c880c0e2319db07"}]}] Oct 26 13:07:06.263597 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1034477245 Oct 26 13:07:06.263597 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: f6270fafd849458c8c880c0e2319db07 Oct 26 13:07:06.263597 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1034477245 Oct 26 13:07:06.263597 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersAdminNegativeTestJSON-1034477245-project-admin Oct 26 13:07:06.263597 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:07:06.263597 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:07:06.263597 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 66875702d2514d62ac84efb2546e2888 Oct 26 13:07:06.263597 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1034477245-project-admin Oct 26 13:07:06.263597 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:07:06.263597 n-d-862686-1 devstack@n-api.service[120598]: {"migrate": {}} Oct 26 13:07:06.263597 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:07:06.263597 n-d-862686-1 devstack@n-api.service[120598]: exception: Cannot 'migrate' instance 249cce52-de17-460b-b445-e24d0d377986 while it is in vm_state suspended Oct 26 13:07:06.264563 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '249cce52-de17-460b-b445-e24d0d377986', 'body': {'migrate': {}}} Oct 26 13:07:06.264563 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:07:06.264563 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:06.264563 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 26 13:07:06.264563 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 26 13:07:06.264563 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 26 13:07:06.264563 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 13:07:06.264563 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 26 13:07:06.264563 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 26 13:07:06.264563 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 26 13:07:06.264563 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 26 13:07:06.264563 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 26 13:07:06.264563 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 13:07:06.264563 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 26 13:07:06.264563 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 26 13:07:06.264563 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 249cce52-de17-460b-b445-e24d0d377986 in vm_state suspended. Cannot resize while the instance is in this state. Oct 26 13:07:06.264563 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:06.264563 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:06.264563 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:06.264563 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:06.266306 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:06.266306 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:06.266306 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:07:06.266306 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:07:06.266306 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:07:06.266306 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:07:06.266306 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:07:06.266306 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:07:06.266306 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 26 13:07:06.266306 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 26 13:07:06.266306 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 26 13:07:06.266306 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 26 13:07:06.266306 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 249cce52-de17-460b-b445-e24d0d377986 while it is in vm_state suspended Oct 26 13:07:06.266306 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:06.266306 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:06.266306 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:06.266306 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:06.266306 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:06.266306 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:06.273336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:07:06.273336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:07:06.273336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 249cce52-de17-460b-b445-e24d0d377986 while it is in vm_state suspended Oct 26 13:07:06.273336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:06.273336 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b5ba87e2-a282-4980-b566-10d29d20b846 tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] Returning 409 to user: Cannot 'migrate' instance 249cce52-de17-460b-b445-e24d0d377986 while it is in vm_state suspended {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:07:06.273336 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b5ba87e2-a282-4980-b566-10d29d20b846 tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986/action" status: 409 len: 148 microversion: 2.1 time: 0.050373 Oct 26 13:07:06.273336 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 683/1285] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:07:06 2022] POST /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986/action => generated 148 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:07:06.273336 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f8d65282-96c4-40df-b9cc-9cefc18df987 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:06.274037 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f8d65282-96c4-40df-b9cc-9cefc18df987 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 2803303a-ad72-4096-b524-69a583a56f03] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:06.281899 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8d65282-96c4-40df-b9cc-9cefc18df987 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:06.281899 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8d65282-96c4-40df-b9cc-9cefc18df987 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:06.281899 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8d65282-96c4-40df-b9cc-9cefc18df987 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:06.281899 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8d65282-96c4-40df-b9cc-9cefc18df987 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:06.282391 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8d65282-96c4-40df-b9cc-9cefc18df987 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:06.282826 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8d65282-96c4-40df-b9cc-9cefc18df987 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:06.375391 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-022c5ce1-64d8-480e-9cf9-49463af9732e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:06.384856 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-022c5ce1-64d8-480e-9cf9-49463af9732e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1471 microversion: 2.1 time: 0.198559 Oct 26 13:07:06.385824 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 603/1286] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:06 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1471 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:06.390616 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cbf09ebd-db0d-40e1-b1c3-a3bf082c1e24 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:06.391632 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cbf09ebd-db0d-40e1-b1c3-a3bf082c1e24 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 82458e75-f124-45b2-85a6-ef634b510f90] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:06.399391 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cbf09ebd-db0d-40e1-b1c3-a3bf082c1e24 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:06.400385 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cbf09ebd-db0d-40e1-b1c3-a3bf082c1e24 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:06.400811 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cbf09ebd-db0d-40e1-b1c3-a3bf082c1e24 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:06.401874 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cbf09ebd-db0d-40e1-b1c3-a3bf082c1e24 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:06.402410 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cbf09ebd-db0d-40e1-b1c3-a3bf082c1e24 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:06.402850 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cbf09ebd-db0d-40e1-b1c3-a3bf082c1e24 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:06.439499 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f8d65282-96c4-40df-b9cc-9cefc18df987 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:06.448264 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f8d65282-96c4-40df-b9cc-9cefc18df987 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03" status: 200 len: 1521 microversion: 2.1 time: 0.179817 Oct 26 13:07:06.448843 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 684/1287] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:06 2022] GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:06.473919 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a50be438-82b6-468e-b8cc-1eafc3fb1c9f tempest-QuotaClassesAdminTestJSON-871536779 tempest-QuotaClassesAdminTestJSON-871536779-project-admin] Calling method '.version_select at 0x7f6732e3bc10>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:06.485800 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a50be438-82b6-468e-b8cc-1eafc3fb1c9f tempest-QuotaClassesAdminTestJSON-871536779 tempest-QuotaClassesAdminTestJSON-871536779-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.021771 Oct 26 13:07:06.493389 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 685/1288] 10.222.0.40 () {58 vars in 1185 bytes} [Wed Oct 26 13:07:06 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:07:06.493389 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ed7f5938-fd2f-449c-8fff-afc598b408b2 tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:06.495489 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ed7f5938-fd2f-449c-8fff-afc598b408b2 tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] Request method failure captured: Oct 26 13:07:06.495489 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904/action HTTP/1.1 Oct 26 13:07:06.495489 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:07:06.495489 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:07:06.495489 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:07:06.495489 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 39 Oct 26 13:07:06.495489 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:07:06.495489 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:07:06.495489 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:07:06.495489 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:07:06.495489 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTC0aqQ0l4q1158VDmiDaXwj0lvFq6vLvqlU2j9jFORkFu2g83quWd81nF7-6ctIqFLLStP9xenIjoNRtk3fol0tT6bnwiqM5ixVaBYALrT3Afd9_fX5mWB69yGpShFtkW-x-v21BlHO06I4UhuP3WJhtCWK1CZGsUEhOH1Ehxsq-NU Oct 26 13:07:06.495489 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:07:06.495489 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:07:06.495489 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:07:06.495489 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:07:06.495489 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:07:06.495489 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:07:06.495489 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: f6270fafd849458c8c880c0e2319db07 Oct 26 13:07:06.495489 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1034477245 Oct 26 13:07:06.495489 n-d-862686-1 devstack@n-api.service[120598]: X-Role: admin,member,reader Oct 26 13:07:06.495489 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: admin,member,reader Oct 26 13:07:06.496825 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f6270fafd849458c8c880c0e2319db07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f6270fafd849458c8c880c0e2319db07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f6270fafd849458c8c880c0e2319db07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f6270fafd849458c8c880c0e2319db07"}]}] Oct 26 13:07:06.496825 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1034477245 Oct 26 13:07:06.496825 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: f6270fafd849458c8c880c0e2319db07 Oct 26 13:07:06.496825 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1034477245 Oct 26 13:07:06.496825 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersAdminNegativeTestJSON-1034477245-project-admin Oct 26 13:07:06.496825 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:07:06.496825 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:07:06.496825 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 66875702d2514d62ac84efb2546e2888 Oct 26 13:07:06.496825 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1034477245-project-admin Oct 26 13:07:06.496825 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:07:06.496825 n-d-862686-1 devstack@n-api.service[120598]: {"os-resetState": {"state": "invalid"}} Oct 26 13:07:06.496825 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:07:06.501834 n-d-862686-1 devstack@n-api.service[120598]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 26 13:07:06.501834 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 26 13:07:06.501834 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:07:06.501834 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:06.501834 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 13:07:06.501834 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 13:07:06.501834 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 13:07:06.501834 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise error Oct 26 13:07:06.501834 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 26 13:07:06.501834 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:06.501834 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 26 13:07:06.501834 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 26 13:07:06.501834 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:06.501834 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 26 13:07:06.501834 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi 'invalid' Oct 26 13:07:06.501834 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:06.501834 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:06.501834 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:06.501834 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:06.501834 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:06.501834 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:06.501834 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:07:06.503288 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:07:06.503288 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:07:06.503288 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:07:06.503288 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 13:07:06.503288 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 13:07:06.503288 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 13:07:06.503288 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 13:07:06.503288 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 13:07:06.503288 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 13:07:06.503288 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 26 13:07:06.503288 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:06.503288 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:06.503288 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:06.503288 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:06.503288 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:06.503288 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:06.503288 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 13:07:06.503288 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 13:07:06.503288 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 26 13:07:06.505607 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:06.505607 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ed7f5938-fd2f-449c-8fff-afc598b408b2 tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:07:06.505607 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ed7f5938-fd2f-449c-8fff-afc598b408b2 tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904/action" status: 400 len: 144 microversion: 2.1 time: 0.009117 Oct 26 13:07:06.505607 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 686/1289] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:07:06 2022] POST /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904/action => generated 144 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:07:06.505607 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-db31742a-e29d-409e-b388-7ed88b9c4775 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:06.505607 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-db31742a-e29d-409e-b388-7ed88b9c4775 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:06.510301 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db31742a-e29d-409e-b388-7ed88b9c4775 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:06.510902 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db31742a-e29d-409e-b388-7ed88b9c4775 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:06.511448 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db31742a-e29d-409e-b388-7ed88b9c4775 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:06.512255 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db31742a-e29d-409e-b388-7ed88b9c4775 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:06.512939 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db31742a-e29d-409e-b388-7ed88b9c4775 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:06.513469 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db31742a-e29d-409e-b388-7ed88b9c4775 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:06.565663 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cbf09ebd-db0d-40e1-b1c3-a3bf082c1e24 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:06.575572 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cbf09ebd-db0d-40e1-b1c3-a3bf082c1e24 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/82458e75-f124-45b2-85a6-ef634b510f90" status: 200 len: 1472 microversion: 2.1 time: 0.188532 Oct 26 13:07:06.576393 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 604/1290] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:06 2022] GET /compute/v2.1/servers/82458e75-f124-45b2-85a6-ef634b510f90 => generated 1472 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:06.581504 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c45c1f84-444a-496a-8743-93458bcb9a83 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:06.582153 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c45c1f84-444a-496a-8743-93458bcb9a83 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 2803303a-ad72-4096-b524-69a583a56f03] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:06.589118 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c45c1f84-444a-496a-8743-93458bcb9a83 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:06.589643 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c45c1f84-444a-496a-8743-93458bcb9a83 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:06.590162 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c45c1f84-444a-496a-8743-93458bcb9a83 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:06.590860 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c45c1f84-444a-496a-8743-93458bcb9a83 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:06.591367 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c45c1f84-444a-496a-8743-93458bcb9a83 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:06.591833 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c45c1f84-444a-496a-8743-93458bcb9a83 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:06.720876 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-db31742a-e29d-409e-b388-7ed88b9c4775 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:06.730162 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-db31742a-e29d-409e-b388-7ed88b9c4775 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:06.731619 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-db31742a-e29d-409e-b388-7ed88b9c4775 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:06.732787 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-db31742a-e29d-409e-b388-7ed88b9c4775 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924" status: 200 len: 1812 microversion: 2.25 time: 0.234080 Oct 26 13:07:06.733537 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 687/1291] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:07:06 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 => generated 1812 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:07:06.737875 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c1f9e204-b116-4bd7-b2e1-41463af63d90 tempest-QuotaClassesAdminTestJSON-871536779 tempest-QuotaClassesAdminTestJSON-871536779-project-admin] Action: 'update', calling method: .version_select at 0x7f6732fe7160>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:06.744396 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c45c1f84-444a-496a-8743-93458bcb9a83 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:06.753458 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c45c1f84-444a-496a-8743-93458bcb9a83 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03" status: 200 len: 1521 microversion: 2.1 time: 0.176076 Oct 26 13:07:06.754490 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 605/1292] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:06 2022] GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:06.760183 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-15399a1c-da30-4c07-8ce7-da56b7aa5242 tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:06.763818 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-15399a1c-da30-4c07-8ce7-da56b7aa5242 tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] Request method failure captured: Oct 26 13:07:06.763818 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904/action HTTP/1.1 Oct 26 13:07:06.763818 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:07:06.763818 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:07:06.763818 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:07:06.763818 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 31 Oct 26 13:07:06.763818 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:07:06.763818 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:07:06.763818 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:07:06.763818 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:07:06.763818 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTC0aqQ0l4q1158VDmiDaXwj0lvFq6vLvqlU2j9jFORkFu2g83quWd81nF7-6ctIqFLLStP9xenIjoNRtk3fol0tT6bnwiqM5ixVaBYALrT3Afd9_fX5mWB69yGpShFtkW-x-v21BlHO06I4UhuP3WJhtCWK1CZGsUEhOH1Ehxsq-NU Oct 26 13:07:06.763818 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:07:06.763818 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:07:06.763818 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:07:06.763818 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:07:06.763818 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:07:06.763818 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:07:06.763818 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: f6270fafd849458c8c880c0e2319db07 Oct 26 13:07:06.763818 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1034477245 Oct 26 13:07:06.763818 n-d-862686-1 devstack@n-api.service[120597]: X-Role: admin,member,reader Oct 26 13:07:06.763818 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: admin,member,reader Oct 26 13:07:06.765165 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f6270fafd849458c8c880c0e2319db07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f6270fafd849458c8c880c0e2319db07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f6270fafd849458c8c880c0e2319db07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f6270fafd849458c8c880c0e2319db07"}]}] Oct 26 13:07:06.765165 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1034477245 Oct 26 13:07:06.765165 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: f6270fafd849458c8c880c0e2319db07 Oct 26 13:07:06.765165 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1034477245 Oct 26 13:07:06.765165 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersAdminNegativeTestJSON-1034477245-project-admin Oct 26 13:07:06.765165 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:07:06.765165 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:07:06.765165 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 66875702d2514d62ac84efb2546e2888 Oct 26 13:07:06.765165 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1034477245-project-admin Oct 26 13:07:06.765165 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:07:06.765165 n-d-862686-1 devstack@n-api.service[120597]: {"os-resetState": {"state": 1}} Oct 26 13:07:06.765165 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:07:06.765165 n-d-862686-1 devstack@n-api.service[120597]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 26 13:07:06.770143 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904', 'body': {'os-resetState': {'state': 1}}} Oct 26 13:07:06.770143 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:07:06.770143 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:06.770143 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 13:07:06.770143 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 13:07:06.770143 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 13:07:06.770143 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise error Oct 26 13:07:06.770143 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 26 13:07:06.770143 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:06.770143 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 26 13:07:06.770143 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 26 13:07:06.770143 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:06.770143 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 26 13:07:06.770143 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi 1 Oct 26 13:07:06.770143 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:06.770143 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:06.770143 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:06.770143 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:06.770143 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:06.770143 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:06.770143 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:07:06.770143 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:07:06.771552 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:07:06.771552 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:07:06.771552 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 13:07:06.771552 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 13:07:06.771552 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 13:07:06.771552 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 13:07:06.771552 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 13:07:06.771552 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 13:07:06.771552 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 26 13:07:06.771552 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:06.771552 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:06.771552 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:06.771552 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:06.771552 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:06.771552 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:06.771552 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 13:07:06.771552 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 13:07:06.771552 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 26 13:07:06.771552 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:06.772925 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-15399a1c-da30-4c07-8ce7-da56b7aa5242 tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:07:06.772925 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-15399a1c-da30-4c07-8ce7-da56b7aa5242 tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904/action" status: 400 len: 120 microversion: 2.1 time: 0.009289 Oct 26 13:07:06.772925 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 606/1293] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:07:06 2022] POST /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904/action => generated 120 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:07:06.783236 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e1880b7b-9796-42ef-94b4-838594118d62 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:06.783857 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e1880b7b-9796-42ef-94b4-838594118d62 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:06.792155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1880b7b-9796-42ef-94b4-838594118d62 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:06.792646 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1880b7b-9796-42ef-94b4-838594118d62 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:06.793088 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1880b7b-9796-42ef-94b4-838594118d62 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:06.793825 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1880b7b-9796-42ef-94b4-838594118d62 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:06.794981 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1880b7b-9796-42ef-94b4-838594118d62 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:06.794981 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1880b7b-9796-42ef-94b4-838594118d62 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:06.809574 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=20,nova_api:INSERT=12 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:07:06.865208 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c1f9e204-b116-4bd7-b2e1-41463af63d90 tempest-QuotaClassesAdminTestJSON-871536779 tempest-QuotaClassesAdminTestJSON-871536779-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.130655 Oct 26 13:07:06.866579 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 688/1294] 10.222.0.40 () {60 vars in 1206 bytes} [Wed Oct 26 13:07:06 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:07:06.878572 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ea555941-39be-4802-9396-e7d76cddae25 tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:06.882879 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ea555941-39be-4802-9396-e7d76cddae25 tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] Failed to fetch instance by id 999 {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 26 13:07:06.885924 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-ea555941-39be-4802-9396-e7d76cddae25 tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 26 13:07:06.885924 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ea555941-39be-4802-9396-e7d76cddae25 tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] Request method failure captured: Oct 26 13:07:06.885924 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 26 13:07:06.885924 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:07:06.885924 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:07:06.885924 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:07:06.885924 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 37 Oct 26 13:07:06.885924 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:07:06.885924 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:07:06.885924 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:07:06.885924 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:07:06.885924 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTC0aqQ0l4q1158VDmiDaXwj0lvFq6vLvqlU2j9jFORkFu2g83quWd81nF7-6ctIqFLLStP9xenIjoNRtk3fol0tT6bnwiqM5ixVaBYALrT3Afd9_fX5mWB69yGpShFtkW-x-v21BlHO06I4UhuP3WJhtCWK1CZGsUEhOH1Ehxsq-NU Oct 26 13:07:06.885924 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:07:06.885924 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:07:06.885924 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:07:06.885924 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:07:06.885924 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:07:06.885924 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:07:06.885924 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: f6270fafd849458c8c880c0e2319db07 Oct 26 13:07:06.885924 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1034477245 Oct 26 13:07:06.885924 n-d-862686-1 devstack@n-api.service[120598]: X-Role: admin,member,reader Oct 26 13:07:06.885924 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: admin,member,reader Oct 26 13:07:06.887641 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f6270fafd849458c8c880c0e2319db07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f6270fafd849458c8c880c0e2319db07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f6270fafd849458c8c880c0e2319db07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f6270fafd849458c8c880c0e2319db07"}]}] Oct 26 13:07:06.887641 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1034477245 Oct 26 13:07:06.887641 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: f6270fafd849458c8c880c0e2319db07 Oct 26 13:07:06.887641 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1034477245 Oct 26 13:07:06.887641 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersAdminNegativeTestJSON-1034477245-project-admin Oct 26 13:07:06.887641 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:07:06.887641 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:07:06.887641 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 66875702d2514d62ac84efb2546e2888 Oct 26 13:07:06.887641 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1034477245-project-admin Oct 26 13:07:06.887641 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:07:06.887641 n-d-862686-1 devstack@n-api.service[120598]: {"os-resetState": {"state": "error"}} Oct 26 13:07:06.887641 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:07:06.887641 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 999 could not be found. Oct 26 13:07:06.888582 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 26 13:07:06.888582 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:07:06.888582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:06.888582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:07:06.888582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:07:06.888582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 26 13:07:06.888582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 26 13:07:06.888582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 26 13:07:06.888582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:06.888582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:06.888582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:06.888582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:06.888582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:06.888582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:06.888582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:07:06.888582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:07:06.888582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:07:06.888582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:07:06.888582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:07:06.888582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:07:06.888582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 26 13:07:06.890144 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 26 13:07:06.890144 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:07:06.890144 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:07:06.890144 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 26 13:07:06.890144 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:06.890144 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:06.890144 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:06.890144 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:06.890144 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:06.890144 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:06.890144 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:07:06.890144 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:07:06.890144 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 26 13:07:06.890144 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:06.896634 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ea555941-39be-4802-9396-e7d76cddae25 tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:07:06.899592 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ea555941-39be-4802-9396-e7d76cddae25 tempest-ServersAdminNegativeTestJSON-1034477245 tempest-ServersAdminNegativeTestJSON-1034477245-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.031334 Oct 26 13:07:06.910925 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 689/1295] 10.222.0.40 () {60 vars in 1179 bytes} [Wed Oct 26 13:07:06 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:07:06.924135 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a02f03ea-2dbd-492f-bac6-22b4d72b299c tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1064348790"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:06.929283 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a02f03ea-2dbd-492f-bac6-22b4d72b299c tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 2803303a-ad72-4096-b524-69a583a56f03] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:06.947104 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a02f03ea-2dbd-492f-bac6-22b4d72b299c tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:06.948100 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a02f03ea-2dbd-492f-bac6-22b4d72b299c tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:06.949975 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a02f03ea-2dbd-492f-bac6-22b4d72b299c tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:06.952901 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a02f03ea-2dbd-492f-bac6-22b4d72b299c tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:06.955100 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a02f03ea-2dbd-492f-bac6-22b4d72b299c tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:06.957298 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a02f03ea-2dbd-492f-bac6-22b4d72b299c tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:07.026078 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e1880b7b-9796-42ef-94b4-838594118d62 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:07.036963 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e1880b7b-9796-42ef-94b4-838594118d62 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1478 microversion: 2.1 time: 0.269515 Oct 26 13:07:07.038215 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 607/1296] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:06 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1478 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:07.047078 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e62fbf5c-ae47-4ab8-9900-887aaf975f70 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:07.047592 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e62fbf5c-ae47-4ab8-9900-887aaf975f70 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: 249cce52-de17-460b-b445-e24d0d377986] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:07.069821 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e62fbf5c-ae47-4ab8-9900-887aaf975f70 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:07.070700 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e62fbf5c-ae47-4ab8-9900-887aaf975f70 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:07.070850 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e62fbf5c-ae47-4ab8-9900-887aaf975f70 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:07.071554 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e62fbf5c-ae47-4ab8-9900-887aaf975f70 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:07.072044 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e62fbf5c-ae47-4ab8-9900-887aaf975f70 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:07.072510 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e62fbf5c-ae47-4ab8-9900-887aaf975f70 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:07.141190 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e62fbf5c-ae47-4ab8-9900-887aaf975f70 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: 249cce52-de17-460b-b445-e24d0d377986] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:07:07.327829 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e62fbf5c-ae47-4ab8-9900-887aaf975f70 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "DELETE /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986" status: 204 len: 0 microversion: 2.1 time: 0.287196 Oct 26 13:07:07.331590 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 608/1297] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:07:07 2022] DELETE /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:07:07.348460 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-6af28220-0814-4873-9012-6c157e4491d6 req-52216db6-d675-479e-a217-dda4f10d855c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "670021c1-045f-40b1-9358-c589d32e9904", "name": "network-vif-unplugged", "status": "completed", "tag": "6e2ffd62-248d-44dd-83ca-8e87f79cc722"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:07.382366 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-6af28220-0814-4873-9012-6c157e4491d6 req-52216db6-d675-479e-a217-dda4f10d855c service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:07.383184 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-6af28220-0814-4873-9012-6c157e4491d6 req-52216db6-d675-479e-a217-dda4f10d855c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:07.383296 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-6af28220-0814-4873-9012-6c157e4491d6 req-52216db6-d675-479e-a217-dda4f10d855c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:07.399345 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-6af28220-0814-4873-9012-6c157e4491d6 req-52216db6-d675-479e-a217-dda4f10d855c service nova] Creating event network-vif-unplugged:6e2ffd62-248d-44dd-83ca-8e87f79cc722 for instance 670021c1-045f-40b1-9358-c589d32e9904 on n-h2-862686-1 Oct 26 13:07:07.405524 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-6af28220-0814-4873-9012-6c157e4491d6 req-52216db6-d675-479e-a217-dda4f10d855c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072439 Oct 26 13:07:07.406834 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 609/1298] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:07:07.413381 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d627c689-1686-49f0-b9e3-10f59c0a0bfe tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67327a70d0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:07.418406 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a02f03ea-2dbd-492f-bac6-22b4d72b299c tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "POST /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03/action" status: 202 len: 0 microversion: 2.1 time: 0.505938 Oct 26 13:07:07.425135 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 690/1299] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:07:06 2022] POST /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03/action => generated 0 bytes in 508 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 26 13:07:07.425976 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fb4318ad-8a30-4275-8871-f92671c0571a tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:07.426841 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fb4318ad-8a30-4275-8871-f92671c0571a tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: 249cce52-de17-460b-b445-e24d0d377986] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:07.435388 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fb4318ad-8a30-4275-8871-f92671c0571a tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:07.436706 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fb4318ad-8a30-4275-8871-f92671c0571a tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:07.436706 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fb4318ad-8a30-4275-8871-f92671c0571a tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:07.437401 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fb4318ad-8a30-4275-8871-f92671c0571a tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:07.437948 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fb4318ad-8a30-4275-8871-f92671c0571a tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:07.438449 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fb4318ad-8a30-4275-8871-f92671c0571a tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:07.471025 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d627c689-1686-49f0-b9e3-10f59c0a0bfe tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/ac122a22-843b-441e-bc8c-3e65b4dbcf63" status: 200 len: 1423 microversion: 2.1 time: 0.062746 Oct 26 13:07:07.473780 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 610/1300] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:07:07 2022] GET /compute/v2.1/images/ac122a22-843b-441e-bc8c-3e65b4dbcf63 => generated 1423 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:07.485070 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dc1bd0c4-f25a-4129-b13b-4103e3efc47f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:07.485847 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-dc1bd0c4-f25a-4129-b13b-4103e3efc47f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:07.492486 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc1bd0c4-f25a-4129-b13b-4103e3efc47f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:07.493001 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc1bd0c4-f25a-4129-b13b-4103e3efc47f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:07.493464 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc1bd0c4-f25a-4129-b13b-4103e3efc47f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:07.494202 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc1bd0c4-f25a-4129-b13b-4103e3efc47f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:07.494665 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc1bd0c4-f25a-4129-b13b-4103e3efc47f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:07.495101 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc1bd0c4-f25a-4129-b13b-4103e3efc47f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:07.682847 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fb4318ad-8a30-4275-8871-f92671c0571a tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:07.701193 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fb4318ad-8a30-4275-8871-f92671c0571a tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986" status: 200 len: 1468 microversion: 2.1 time: 0.280345 Oct 26 13:07:07.705733 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 691/1301] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:07 2022] GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986 => generated 1468 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:07.714186 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9c0678e9-5ebf-4938-a05c-68e2772b827b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1173559898"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:07.716764 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9c0678e9-5ebf-4938-a05c-68e2772b827b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 2803303a-ad72-4096-b524-69a583a56f03] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:07.730486 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c0678e9-5ebf-4938-a05c-68e2772b827b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:07.731289 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c0678e9-5ebf-4938-a05c-68e2772b827b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:07.732742 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c0678e9-5ebf-4938-a05c-68e2772b827b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:07.733798 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c0678e9-5ebf-4938-a05c-68e2772b827b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:07.734317 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c0678e9-5ebf-4938-a05c-68e2772b827b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:07.734745 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c0678e9-5ebf-4938-a05c-68e2772b827b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:07.782036 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-9c0678e9-5ebf-4938-a05c-68e2772b827b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] HTTP exception thrown: Cannot 'createImage' instance 2803303a-ad72-4096-b524-69a583a56f03 while it is in task_state image_snapshot_pending Oct 26 13:07:07.783395 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9c0678e9-5ebf-4938-a05c-68e2772b827b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Request method failure captured: Oct 26 13:07:07.783395 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03/action HTTP/1.1 Oct 26 13:07:07.783395 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:07:07.783395 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:07:07.783395 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:07:07.783395 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 85 Oct 26 13:07:07.783395 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:07:07.783395 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:07:07.783395 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:07:07.783395 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:07:07.783395 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTDWcY4mtHepJlQ55KVJtNHC-FXqIi903yr1J5OC-zbXOMs1LBU3zczKCFgnqIJBIqkvCLTFhaHFSdgfodLtkoXiluiPVf_SkgLznk0TL97DMnsRT29TeJsNzQAsUym5LCo50Ifxk2xlPnZ_QiGEmh7kAsukHuXMaWRZIS-UkeLc5o8 Oct 26 13:07:07.783395 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:07:07.783395 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:07:07.783395 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:07:07.783395 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:07:07.783395 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:07:07.783395 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:07:07.783395 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 186ac42922a64992aa1973bd854830d7 Oct 26 13:07:07.783395 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-778472214 Oct 26 13:07:07.783395 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:07:07.783395 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:07:07.784952 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/186ac42922a64992aa1973bd854830d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/186ac42922a64992aa1973bd854830d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_186ac42922a64992aa1973bd854830d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/186ac42922a64992aa1973bd854830d7"}]}] Oct 26 13:07:07.784952 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-778472214 Oct 26 13:07:07.784952 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 186ac42922a64992aa1973bd854830d7 Oct 26 13:07:07.784952 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-778472214 Oct 26 13:07:07.784952 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ImagesOneServerNegativeTestJSON-778472214-project Oct 26 13:07:07.784952 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:07:07.784952 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:07:07.784952 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 0b8d4ea396494628983bde1a97222f7d Oct 26 13:07:07.784952 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-778472214-project Oct 26 13:07:07.784952 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:07:07.784952 n-d-862686-1 devstack@n-api.service[120598]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1173559898"}} Oct 26 13:07:07.784952 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:07:07.785995 n-d-862686-1 devstack@n-api.service[120598]: exception: Cannot 'createImage' instance 2803303a-ad72-4096-b524-69a583a56f03 while it is in task_state image_snapshot_pending Oct 26 13:07:07.785995 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '2803303a-ad72-4096-b524-69a583a56f03', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1173559898'}}} Oct 26 13:07:07.785995 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:07:07.785995 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:07.785995 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 26 13:07:07.785995 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 26 13:07:07.785995 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 26 13:07:07.785995 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 26 13:07:07.785995 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2803303a-ad72-4096-b524-69a583a56f03 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Oct 26 13:07:07.785995 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:07.785995 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:07.785995 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:07.785995 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:07.785995 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:07.785995 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:07.785995 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:07:07.785995 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:07:07.785995 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:07:07.785995 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:07:07.788182 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:07:07.788182 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:07:07.788182 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:07:07.788182 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:07:07.788182 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 26 13:07:07.788182 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 26 13:07:07.788182 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 26 13:07:07.788182 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 26 13:07:07.788182 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 2803303a-ad72-4096-b524-69a583a56f03 while it is in task_state image_snapshot_pending Oct 26 13:07:07.788182 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:07.788182 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:07.788182 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:07.788182 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:07.788182 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:07.788182 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:07.788182 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:07:07.788182 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:07:07.788182 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 2803303a-ad72-4096-b524-69a583a56f03 while it is in task_state image_snapshot_pending Oct 26 13:07:07.788182 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:07.789756 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9c0678e9-5ebf-4938-a05c-68e2772b827b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Returning 409 to user: Cannot 'createImage' instance 2803303a-ad72-4096-b524-69a583a56f03 while it is in task_state image_snapshot_pending {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:07:07.789756 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9c0678e9-5ebf-4938-a05c-68e2772b827b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "POST /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03/action" status: 409 len: 167 microversion: 2.1 time: 0.077019 Oct 26 13:07:07.789756 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 692/1302] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:07:07 2022] POST /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03/action => generated 167 bytes in 78 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:07:07.791990 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b069c6ef-235c-41bb-b913-db073226fda6 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f6732a101f0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:07.834101 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-dc1bd0c4-f25a-4129-b13b-4103e3efc47f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:07.846289 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-dc1bd0c4-f25a-4129-b13b-4103e3efc47f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1471 microversion: 2.1 time: 0.371226 Oct 26 13:07:07.847516 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 611/1303] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:07 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1471 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:07.855282 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c5ccb07d-5b0c-4d0c-8ec1-0124b02d00a7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:07.855637 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b069c6ef-235c-41bb-b913-db073226fda6 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/ac122a22-843b-441e-bc8c-3e65b4dbcf63" status: 200 len: 1423 microversion: 2.1 time: 0.067366 Oct 26 13:07:07.856344 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c5ccb07d-5b0c-4d0c-8ec1-0124b02d00a7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 82458e75-f124-45b2-85a6-ef634b510f90] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:07.868334 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 693/1304] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:07:07 2022] GET /compute/v2.1/images/ac122a22-843b-441e-bc8c-3e65b4dbcf63 => generated 1423 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:07.869470 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c5ccb07d-5b0c-4d0c-8ec1-0124b02d00a7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:07.870172 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c5ccb07d-5b0c-4d0c-8ec1-0124b02d00a7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:07.870770 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c5ccb07d-5b0c-4d0c-8ec1-0124b02d00a7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:07.871657 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c5ccb07d-5b0c-4d0c-8ec1-0124b02d00a7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:07.872398 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c5ccb07d-5b0c-4d0c-8ec1-0124b02d00a7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:07.873000 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c5ccb07d-5b0c-4d0c-8ec1-0124b02d00a7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:07.879544 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-5ba1c46b-ed22-40f0-a51f-fb91e185ad8a req-2b09b84a-68e1-4732-ae03-ac78583a8a06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82458e75-f124-45b2-85a6-ef634b510f90", "name": "network-vif-deleted", "tag": "126ff158-9c5b-4927-8421-7373016ebb59"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:07.881075 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:07:07.922606 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-5ba1c46b-ed22-40f0-a51f-fb91e185ad8a req-2b09b84a-68e1-4732-ae03-ac78583a8a06 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:07.929886 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-5ba1c46b-ed22-40f0-a51f-fb91e185ad8a req-2b09b84a-68e1-4732-ae03-ac78583a8a06 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:07.930552 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-5ba1c46b-ed22-40f0-a51f-fb91e185ad8a req-2b09b84a-68e1-4732-ae03-ac78583a8a06 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:07.956085 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-5ba1c46b-ed22-40f0-a51f-fb91e185ad8a req-2b09b84a-68e1-4732-ae03-ac78583a8a06 service nova] Creating event network-vif-deleted:126ff158-9c5b-4927-8421-7373016ebb59 for instance 82458e75-f124-45b2-85a6-ef634b510f90 on n-h2-862686-1 Oct 26 13:07:07.963603 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-5ba1c46b-ed22-40f0-a51f-fb91e185ad8a req-2b09b84a-68e1-4732-ae03-ac78583a8a06 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093949 Oct 26 13:07:07.964613 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 694/1305] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:07:07.973223 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-696c6c2d-61e0-44b2-b833-084ce7792ac6 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:07.974222 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-696c6c2d-61e0-44b2-b833-084ce7792ac6 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:07.984306 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-696c6c2d-61e0-44b2-b833-084ce7792ac6 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:07.987885 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-696c6c2d-61e0-44b2-b833-084ce7792ac6 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:07.988673 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-696c6c2d-61e0-44b2-b833-084ce7792ac6 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:07.989841 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-696c6c2d-61e0-44b2-b833-084ce7792ac6 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:07.991208 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-696c6c2d-61e0-44b2-b833-084ce7792ac6 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:07.991910 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-696c6c2d-61e0-44b2-b833-084ce7792ac6 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:07.996216 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c5ccb07d-5b0c-4d0c-8ec1-0124b02d00a7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:08.010179 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c5ccb07d-5b0c-4d0c-8ec1-0124b02d00a7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/82458e75-f124-45b2-85a6-ef634b510f90" status: 200 len: 1301 microversion: 2.1 time: 0.161268 Oct 26 13:07:08.011383 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 612/1306] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:07 2022] GET /compute/v2.1/servers/82458e75-f124-45b2-85a6-ef634b510f90 => generated 1301 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:08.026874 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7a0aca8b-dd99-4031-8d56-58a78fb538de tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '.version_select at 0x7f6732d92f70>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:08.028839 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:07:08.300144 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7a0aca8b-dd99-4031-8d56-58a78fb538de tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "DELETE /compute/v2.1/images/ab3ed147-a4ca-4c48-b16f-1071f9c6bea0" status: 204 len: 0 microversion: 2.1 time: 0.287438 Oct 26 13:07:08.300949 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 613/1307] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:08 2022] DELETE /compute/v2.1/images/ab3ed147-a4ca-4c48-b16f-1071f9c6bea0 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:07:08.313961 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-994d62bc-e10c-4818-809c-3573bb2ebd9a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67324b1c10>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:08.325529 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-696c6c2d-61e0-44b2-b833-084ce7792ac6 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:08.336345 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-696c6c2d-61e0-44b2-b833-084ce7792ac6 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:08.338782 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-696c6c2d-61e0-44b2-b833-084ce7792ac6 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:08.339980 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-696c6c2d-61e0-44b2-b833-084ce7792ac6 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924" status: 200 len: 1812 microversion: 2.25 time: 0.374054 Oct 26 13:07:08.345863 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 695/1308] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:07:07 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 => generated 1812 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:07:08.350766 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-41b8e16b-be7e-45bc-a794-8d56da5045a7 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:08.351546 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-41b8e16b-be7e-45bc-a794-8d56da5045a7 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:08.358864 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-41b8e16b-be7e-45bc-a794-8d56da5045a7 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:08.359590 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-41b8e16b-be7e-45bc-a794-8d56da5045a7 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:08.360190 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-41b8e16b-be7e-45bc-a794-8d56da5045a7 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:08.361145 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-41b8e16b-be7e-45bc-a794-8d56da5045a7 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:08.361857 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-41b8e16b-be7e-45bc-a794-8d56da5045a7 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:08.362672 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-41b8e16b-be7e-45bc-a794-8d56da5045a7 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:08.540387 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-41b8e16b-be7e-45bc-a794-8d56da5045a7 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:08.552661 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-41b8e16b-be7e-45bc-a794-8d56da5045a7 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1478 microversion: 2.1 time: 0.210518 Oct 26 13:07:08.567292 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 696/1309] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:08 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1478 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:08.578641 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-eb46c0a7-1f12-48f4-ab95-3ae429064176 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:08.580178 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-eb46c0a7-1f12-48f4-ab95-3ae429064176 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 2803303a-ad72-4096-b524-69a583a56f03] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:08.587863 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb46c0a7-1f12-48f4-ab95-3ae429064176 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:08.588582 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb46c0a7-1f12-48f4-ab95-3ae429064176 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:08.589036 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb46c0a7-1f12-48f4-ab95-3ae429064176 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:08.589942 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb46c0a7-1f12-48f4-ab95-3ae429064176 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:08.591004 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb46c0a7-1f12-48f4-ab95-3ae429064176 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:08.591439 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb46c0a7-1f12-48f4-ab95-3ae429064176 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:08.797528 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-eb46c0a7-1f12-48f4-ab95-3ae429064176 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:08.806990 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-eb46c0a7-1f12-48f4-ab95-3ae429064176 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03" status: 200 len: 1541 microversion: 2.1 time: 0.238610 Oct 26 13:07:08.807961 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 697/1310] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:08 2022] GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03 => generated 1541 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:08.813964 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-71a45a35-e67c-4ba8-8d9c-d12549e44953 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:08.814579 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-71a45a35-e67c-4ba8-8d9c-d12549e44953 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: 249cce52-de17-460b-b445-e24d0d377986] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:08.822475 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-71a45a35-e67c-4ba8-8d9c-d12549e44953 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:08.823161 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-71a45a35-e67c-4ba8-8d9c-d12549e44953 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:08.823701 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-71a45a35-e67c-4ba8-8d9c-d12549e44953 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:08.824524 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-71a45a35-e67c-4ba8-8d9c-d12549e44953 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:08.825051 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-71a45a35-e67c-4ba8-8d9c-d12549e44953 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:08.825508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-71a45a35-e67c-4ba8-8d9c-d12549e44953 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:08.996634 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-71a45a35-e67c-4ba8-8d9c-d12549e44953 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:09.009276 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-71a45a35-e67c-4ba8-8d9c-d12549e44953 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986" status: 200 len: 1468 microversion: 2.1 time: 0.200067 Oct 26 13:07:09.021560 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 698/1311] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:08 2022] GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986 => generated 1468 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:09.038833 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-64ab36d7-2e82-4d10-836e-059dfcfabeed tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:09.039565 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-64ab36d7-2e82-4d10-836e-059dfcfabeed tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:09.046227 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64ab36d7-2e82-4d10-836e-059dfcfabeed tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:09.046905 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64ab36d7-2e82-4d10-836e-059dfcfabeed tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:09.047502 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64ab36d7-2e82-4d10-836e-059dfcfabeed tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:09.048522 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64ab36d7-2e82-4d10-836e-059dfcfabeed tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:09.049189 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64ab36d7-2e82-4d10-836e-059dfcfabeed tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:09.049821 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64ab36d7-2e82-4d10-836e-059dfcfabeed tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:09.152775 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-994d62bc-e10c-4818-809c-3573bb2ebd9a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "DELETE /compute/v2.1/images/ac122a22-843b-441e-bc8c-3e65b4dbcf63" status: 204 len: 0 microversion: 2.1 time: 0.850450 Oct 26 13:07:09.153362 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 614/1312] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:08 2022] DELETE /compute/v2.1/images/ac122a22-843b-441e-bc8c-3e65b4dbcf63 => generated 0 bytes in 852 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:07:09.158103 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-22b756a1-288c-4128-a709-32ee835bcb39 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:09.159062 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-22b756a1-288c-4128-a709-32ee835bcb39 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 82458e75-f124-45b2-85a6-ef634b510f90] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:09.166238 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22b756a1-288c-4128-a709-32ee835bcb39 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:09.166966 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22b756a1-288c-4128-a709-32ee835bcb39 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:09.167600 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22b756a1-288c-4128-a709-32ee835bcb39 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:09.168748 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22b756a1-288c-4128-a709-32ee835bcb39 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:09.169396 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22b756a1-288c-4128-a709-32ee835bcb39 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:09.169989 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22b756a1-288c-4128-a709-32ee835bcb39 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:09.190939 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-22b756a1-288c-4128-a709-32ee835bcb39 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] HTTP exception thrown: Instance 82458e75-f124-45b2-85a6-ef634b510f90 could not be found. Oct 26 13:07:09.192877 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-22b756a1-288c-4128-a709-32ee835bcb39 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Request method failure captured: Oct 26 13:07:09.192877 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/82458e75-f124-45b2-85a6-ef634b510f90 HTTP/1.1 Oct 26 13:07:09.192877 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:07:09.192877 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:07:09.192877 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:07:09.192877 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:07:09.192877 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:07:09.192877 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:07:09.192877 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:07:09.192877 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:07:09.192877 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTBPRVt_8YZnaMSFiptNqbU9QNU93-_uVsnIl5oPaIxTkieW3pGz0zJKB63vkS1UTm30oE-_Ib6tVEIUcfod49uJs_R6L4h_NtP5w4W8pi8x5J4f1QqVVXViMhIM2rv6Z6M-Vnp8kRHMISIYhq0EFTwFrWnXPDyjXTUbEUwh3-ynQvQ Oct 26 13:07:09.192877 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:07:09.192877 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:07:09.192877 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:07:09.192877 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:07:09.192877 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:07:09.192877 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:07:09.192877 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: d6515917885c4f3cb5fb19e05f4e5e2b Oct 26 13:07:09.192877 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersOnMultiNodesTest-1287428008 Oct 26 13:07:09.192877 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:07:09.192877 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:07:09.195092 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d6515917885c4f3cb5fb19e05f4e5e2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d6515917885c4f3cb5fb19e05f4e5e2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d6515917885c4f3cb5fb19e05f4e5e2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d6515917885c4f3cb5fb19e05f4e5e2b"}]}] Oct 26 13:07:09.195092 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersOnMultiNodesTest-1287428008 Oct 26 13:07:09.195092 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: d6515917885c4f3cb5fb19e05f4e5e2b Oct 26 13:07:09.195092 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1287428008 Oct 26 13:07:09.195092 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersOnMultiNodesTest-1287428008-project Oct 26 13:07:09.195092 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:07:09.195092 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:07:09.195092 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: b6cddfeca4ce49788143b2bf4b30545f Oct 26 13:07:09.195092 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersOnMultiNodesTest-1287428008-project Oct 26 13:07:09.195092 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:07:09.195092 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 82458e75-f124-45b2-85a6-ef634b510f90 could not be found. Oct 26 13:07:09.195092 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '82458e75-f124-45b2-85a6-ef634b510f90'} Oct 26 13:07:09.195990 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:07:09.195990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:09.195990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:07:09.195990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:07:09.195990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:07:09.195990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:07:09.195990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:07:09.195990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:07:09.195990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:07:09.195990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:07:09.195990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82458e75-f124-45b2-85a6-ef634b510f90 could not be found. Oct 26 13:07:09.195990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:09.195990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:09.195990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:09.195990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:09.195990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:09.195990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:09.195990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:07:09.195990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:07:09.195990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:07:09.197472 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:07:09.197472 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:07:09.197472 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:07:09.197472 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:07:09.197472 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:07:09.197472 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:07:09.197472 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:07:09.197472 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82458e75-f124-45b2-85a6-ef634b510f90 could not be found. Oct 26 13:07:09.197472 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:09.197472 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:09.197472 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:09.197472 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:09.197472 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:09.197472 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:09.197472 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:07:09.197472 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:07:09.197472 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82458e75-f124-45b2-85a6-ef634b510f90 could not be found. Oct 26 13:07:09.197472 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:09.198960 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-22b756a1-288c-4128-a709-32ee835bcb39 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Returning 404 to user: Instance 82458e75-f124-45b2-85a6-ef634b510f90 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:07:09.198960 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-22b756a1-288c-4128-a709-32ee835bcb39 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/82458e75-f124-45b2-85a6-ef634b510f90" status: 404 len: 111 microversion: 2.1 time: 0.040717 Oct 26 13:07:09.198960 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 615/1313] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:09 2022] GET /compute/v2.1/servers/82458e75-f124-45b2-85a6-ef634b510f90 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:07:09.203708 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a4f57015-d35a-4d1e-a055-2ec175cfd81b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:09.204203 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a4f57015-d35a-4d1e-a055-2ec175cfd81b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 7fc68c75-8598-4bc7-b96b-852f31f09781] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:09.210388 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4f57015-d35a-4d1e-a055-2ec175cfd81b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:09.210878 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4f57015-d35a-4d1e-a055-2ec175cfd81b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:09.211323 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4f57015-d35a-4d1e-a055-2ec175cfd81b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:09.212031 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4f57015-d35a-4d1e-a055-2ec175cfd81b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:09.212486 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4f57015-d35a-4d1e-a055-2ec175cfd81b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:09.212915 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4f57015-d35a-4d1e-a055-2ec175cfd81b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:09.234270 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-64ab36d7-2e82-4d10-836e-059dfcfabeed tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:09.242407 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a4f57015-d35a-4d1e-a055-2ec175cfd81b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 7fc68c75-8598-4bc7-b96b-852f31f09781] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:07:09.243268 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-64ab36d7-2e82-4d10-836e-059dfcfabeed tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1476 microversion: 2.1 time: 0.219559 Oct 26 13:07:09.247539 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 699/1314] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:09 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1476 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:09.254228 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-752a6ee4-be0e-42e0-9a03-25c2ea02e586 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:09.254930 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-752a6ee4-be0e-42e0-9a03-25c2ea02e586 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 7d754336-7bde-477f-954d-d0b4290ee0fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:09.262122 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-752a6ee4-be0e-42e0-9a03-25c2ea02e586 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:09.262617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-752a6ee4-be0e-42e0-9a03-25c2ea02e586 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:09.263056 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-752a6ee4-be0e-42e0-9a03-25c2ea02e586 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:09.263764 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-752a6ee4-be0e-42e0-9a03-25c2ea02e586 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:09.264222 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-752a6ee4-be0e-42e0-9a03-25c2ea02e586 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:09.264651 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-752a6ee4-be0e-42e0-9a03-25c2ea02e586 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:09.295248 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-752a6ee4-be0e-42e0-9a03-25c2ea02e586 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 7d754336-7bde-477f-954d-d0b4290ee0fa] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:07:09.325440 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a4f57015-d35a-4d1e-a055-2ec175cfd81b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7fc68c75-8598-4bc7-b96b-852f31f09781" status: 204 len: 0 microversion: 2.1 time: 0.125230 Oct 26 13:07:09.337505 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 616/1315] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:07:09 2022] DELETE /compute/v2.1/servers/7fc68c75-8598-4bc7-b96b-852f31f09781 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:07:09.367662 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-256aaed7-2308-4e50-b33f-809b6d801744 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:09.368370 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-256aaed7-2308-4e50-b33f-809b6d801744 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:09.375095 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-256aaed7-2308-4e50-b33f-809b6d801744 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:09.375598 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-256aaed7-2308-4e50-b33f-809b6d801744 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:09.376041 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-256aaed7-2308-4e50-b33f-809b6d801744 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:09.376749 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-256aaed7-2308-4e50-b33f-809b6d801744 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:09.378218 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-256aaed7-2308-4e50-b33f-809b6d801744 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:09.378662 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-256aaed7-2308-4e50-b33f-809b6d801744 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:09.408142 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-752a6ee4-be0e-42e0-9a03-25c2ea02e586 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7d754336-7bde-477f-954d-d0b4290ee0fa" status: 204 len: 0 microversion: 2.1 time: 0.159134 Oct 26 13:07:09.411801 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 700/1316] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:07:09 2022] DELETE /compute/v2.1/servers/7d754336-7bde-477f-954d-d0b4290ee0fa => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:07:09.419475 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cfb3b9fa-b769-40dd-af61-632c681ae0c1 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:09.420191 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cfb3b9fa-b769-40dd-af61-632c681ae0c1 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 7d754336-7bde-477f-954d-d0b4290ee0fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:09.434306 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cfb3b9fa-b769-40dd-af61-632c681ae0c1 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:09.435165 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cfb3b9fa-b769-40dd-af61-632c681ae0c1 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:09.435820 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cfb3b9fa-b769-40dd-af61-632c681ae0c1 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:09.436604 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cfb3b9fa-b769-40dd-af61-632c681ae0c1 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:09.437134 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cfb3b9fa-b769-40dd-af61-632c681ae0c1 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:09.437663 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cfb3b9fa-b769-40dd-af61-632c681ae0c1 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:09.594754 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-cfb3b9fa-b769-40dd-af61-632c681ae0c1 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:09.604989 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cfb3b9fa-b769-40dd-af61-632c681ae0c1 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/7d754336-7bde-477f-954d-d0b4290ee0fa" status: 200 len: 1471 microversion: 2.1 time: 0.191351 Oct 26 13:07:09.613541 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 701/1317] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:09 2022] GET /compute/v2.1/servers/7d754336-7bde-477f-954d-d0b4290ee0fa => generated 1471 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:09.622951 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c3c15574-61fa-4b70-a8dd-0f74e1d35be9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1895555110", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "259bbcbd-929e-4d48-b53c-e8ded5da783d"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:09.684458 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-c3c15574-61fa-4b70-a8dd-0f74e1d35be9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] validate_networks() for [('259bbcbd-929e-4d48-b53c-e8ded5da783d', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:07:09.857064 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-256aaed7-2308-4e50-b33f-809b6d801744 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:09.866579 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-256aaed7-2308-4e50-b33f-809b6d801744 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:09.868492 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-256aaed7-2308-4e50-b33f-809b6d801744 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:09.869982 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-256aaed7-2308-4e50-b33f-809b6d801744 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924" status: 200 len: 1812 microversion: 2.25 time: 0.507712 Oct 26 13:07:09.895756 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 617/1318] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:07:09 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 => generated 1812 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:07:09.900942 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dc921f9d-f1d5-4f75-9765-410fc0c90ee9 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:09.901678 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-dc921f9d-f1d5-4f75-9765-410fc0c90ee9 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:09.908605 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc921f9d-f1d5-4f75-9765-410fc0c90ee9 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:09.909461 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc921f9d-f1d5-4f75-9765-410fc0c90ee9 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:09.910178 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc921f9d-f1d5-4f75-9765-410fc0c90ee9 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:09.910980 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc921f9d-f1d5-4f75-9765-410fc0c90ee9 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:09.911655 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc921f9d-f1d5-4f75-9765-410fc0c90ee9 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:09.912094 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc921f9d-f1d5-4f75-9765-410fc0c90ee9 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:10.067244 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-dc921f9d-f1d5-4f75-9765-410fc0c90ee9 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:10.076375 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-dc921f9d-f1d5-4f75-9765-410fc0c90ee9 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1478 microversion: 2.1 time: 0.179847 Oct 26 13:07:10.076979 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 618/1319] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:09 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1478 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:10.082138 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e3f2e385-96de-4405-ad2a-661b8eef5fe2 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:10.082922 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e3f2e385-96de-4405-ad2a-661b8eef5fe2 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 2803303a-ad72-4096-b524-69a583a56f03] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:10.089097 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3f2e385-96de-4405-ad2a-661b8eef5fe2 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:10.089948 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3f2e385-96de-4405-ad2a-661b8eef5fe2 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:10.090785 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3f2e385-96de-4405-ad2a-661b8eef5fe2 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:10.091653 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3f2e385-96de-4405-ad2a-661b8eef5fe2 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:10.092260 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3f2e385-96de-4405-ad2a-661b8eef5fe2 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:10.092840 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3f2e385-96de-4405-ad2a-661b8eef5fe2 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:10.246618 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e3f2e385-96de-4405-ad2a-661b8eef5fe2 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:10.257387 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e3f2e385-96de-4405-ad2a-661b8eef5fe2 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03" status: 200 len: 1541 microversion: 2.1 time: 0.178291 Oct 26 13:07:10.258417 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 619/1320] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:10 2022] GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03 => generated 1541 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:10.282866 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ea479006-fc77-4e52-b30c-a9901bf15906 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:10.284316 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ea479006-fc77-4e52-b30c-a9901bf15906 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: 249cce52-de17-460b-b445-e24d0d377986] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:10.290515 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ea479006-fc77-4e52-b30c-a9901bf15906 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:10.291355 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ea479006-fc77-4e52-b30c-a9901bf15906 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:10.292383 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ea479006-fc77-4e52-b30c-a9901bf15906 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:10.293873 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ea479006-fc77-4e52-b30c-a9901bf15906 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:10.294702 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ea479006-fc77-4e52-b30c-a9901bf15906 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:10.295695 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ea479006-fc77-4e52-b30c-a9901bf15906 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:10.386683 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-c3c15574-61fa-4b70-a8dd-0f74e1d35be9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:07:10.387161 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-c3c15574-61fa-4b70-a8dd-0f74e1d35be9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:07:10.387573 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-c3c15574-61fa-4b70-a8dd-0f74e1d35be9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:07:10.387983 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-c3c15574-61fa-4b70-a8dd-0f74e1d35be9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:07:10.388498 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-c3c15574-61fa-4b70-a8dd-0f74e1d35be9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:07:10.399315 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c3c15574-61fa-4b70-a8dd-0f74e1d35be9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:10.399796 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c3c15574-61fa-4b70-a8dd-0f74e1d35be9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:10.400361 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c3c15574-61fa-4b70-a8dd-0f74e1d35be9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:10.401272 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c3c15574-61fa-4b70-a8dd-0f74e1d35be9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:10.401745 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c3c15574-61fa-4b70-a8dd-0f74e1d35be9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:10.402354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c3c15574-61fa-4b70-a8dd-0f74e1d35be9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:10.423291 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-c3c15574-61fa-4b70-a8dd-0f74e1d35be9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Getting quotas for project cc4a21e57f1c4fd1ab3c60f6416f8b11. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:07:10.429084 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-c3c15574-61fa-4b70-a8dd-0f74e1d35be9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Getting quotas for user e3707c34798c48d584cff9dd46d9d7c0 and project cc4a21e57f1c4fd1ab3c60f6416f8b11. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:07:10.441444 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c3c15574-61fa-4b70-a8dd-0f74e1d35be9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:07:10.443849 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c3c15574-61fa-4b70-a8dd-0f74e1d35be9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: d426a4f6-fa08-47d2-a583-735600b77f27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:07:10.459048 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ea479006-fc77-4e52-b30c-a9901bf15906 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:10.470862 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ea479006-fc77-4e52-b30c-a9901bf15906 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986" status: 200 len: 1468 microversion: 2.1 time: 0.211122 Oct 26 13:07:10.471929 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 620/1321] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:10 2022] GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986 => generated 1468 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:10.485156 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8d915194-43ff-4622-ae35-8c47532f70a6 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:10.486052 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8d915194-43ff-4622-ae35-8c47532f70a6 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:10.492987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d915194-43ff-4622-ae35-8c47532f70a6 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:10.493417 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d915194-43ff-4622-ae35-8c47532f70a6 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:10.493929 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d915194-43ff-4622-ae35-8c47532f70a6 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:10.494632 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d915194-43ff-4622-ae35-8c47532f70a6 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:10.495265 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d915194-43ff-4622-ae35-8c47532f70a6 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:10.495709 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d915194-43ff-4622-ae35-8c47532f70a6 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:10.515523 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c3c15574-61fa-4b70-a8dd-0f74e1d35be9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.908394 Oct 26 13:07:10.519883 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 702/1322] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:07:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 913 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:07:10.542270 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-66775d50-30ed-4e3c-9a71-0057f0b2fe76 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:10.543587 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-66775d50-30ed-4e3c-9a71-0057f0b2fe76 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: d426a4f6-fa08-47d2-a583-735600b77f27] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:10.605707 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-66775d50-30ed-4e3c-9a71-0057f0b2fe76 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:10.614826 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-66775d50-30ed-4e3c-9a71-0057f0b2fe76 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27" status: 200 len: 1208 microversion: 2.1 time: 0.086097 Oct 26 13:07:10.616175 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 703/1323] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:10 2022] GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27 => generated 1208 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:10.636123 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-65ea070c-992d-40f7-8e76-2c056258251f tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:10.637073 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-65ea070c-992d-40f7-8e76-2c056258251f tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 7d754336-7bde-477f-954d-d0b4290ee0fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:10.644773 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65ea070c-992d-40f7-8e76-2c056258251f tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:10.645426 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65ea070c-992d-40f7-8e76-2c056258251f tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:10.646161 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65ea070c-992d-40f7-8e76-2c056258251f tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:10.647730 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65ea070c-992d-40f7-8e76-2c056258251f tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:10.648234 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8d915194-43ff-4622-ae35-8c47532f70a6 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:10.648717 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65ea070c-992d-40f7-8e76-2c056258251f tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:10.649362 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65ea070c-992d-40f7-8e76-2c056258251f tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:10.658531 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8d915194-43ff-4622-ae35-8c47532f70a6 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1476 microversion: 2.1 time: 0.185171 Oct 26 13:07:10.665901 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 621/1324] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:10 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1476 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:10.810525 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-65ea070c-992d-40f7-8e76-2c056258251f tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:10.815694 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5e3a44f3-ff8c-4cee-bf41-b03a58141421 tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Action: 'update', calling method: .version_select at 0x7f6732648b80>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:10.818341 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-65ea070c-992d-40f7-8e76-2c056258251f tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/7d754336-7bde-477f-954d-d0b4290ee0fa" status: 200 len: 1471 microversion: 2.1 time: 0.193262 Oct 26 13:07:10.819440 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 704/1325] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:10 2022] GET /compute/v2.1/servers/7d754336-7bde-477f-954d-d0b4290ee0fa => generated 1471 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:10.819865 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5e3a44f3-ff8c-4cee-bf41-b03a58141421 tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:10.821320 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5e3a44f3-ff8c-4cee-bf41-b03a58141421 tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:10.822009 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5e3a44f3-ff8c-4cee-bf41-b03a58141421 tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:10.829380 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5e3a44f3-ff8c-4cee-bf41-b03a58141421 tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:10.829893 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5e3a44f3-ff8c-4cee-bf41-b03a58141421 tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:10.830332 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5e3a44f3-ff8c-4cee-bf41-b03a58141421 tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:10.841461 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-5e3a44f3-ff8c-4cee-bf41-b03a58141421 tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] HTTP exception thrown: Service f9eb436f-cacf-4c9a-bd38-0fb5d9bac27b could not be found. Oct 26 13:07:10.843608 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5e3a44f3-ff8c-4cee-bf41-b03a58141421 tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Request method failure captured: Oct 26 13:07:10.843608 n-d-862686-1 devstack@n-api.service[120597]: request: PUT /compute/v2.1/os-services/f9eb436f-cacf-4c9a-bd38-0fb5d9bac27b HTTP/1.1 Oct 26 13:07:10.843608 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:07:10.843608 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:07:10.843608 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:07:10.843608 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 56 Oct 26 13:07:10.843608 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:07:10.843608 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:07:10.843608 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:07:10.843608 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:07:10.843608 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTD-2tVLqnjyvrM7yA8V7WALM_AaBPOIlnaCK438bJbfSJMSNykbE3dX2YIexBM4Ca7lrdzY7F0-vJFYuKqa6XJsVe2xucq4CQ5_NXZktD7kI4k8x7axtd9vMlZWzGUsTz93iLP_LVNLv0t7xFP3Uav6Asz71C6NYWUU57oCv_ELOCs Oct 26 13:07:10.843608 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:07:10.843608 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:07:10.843608 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:07:10.843608 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:07:10.843608 n-d-862686-1 devstack@n-api.service[120597]: X-Openstack-Nova-Api-Version: 2.53 Oct 26 13:07:10.843608 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:07:10.843608 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:07:10.843608 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 8aefabe3d53144a0bd02b5e91076e309 Oct 26 13:07:10.843608 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1410706316 Oct 26 13:07:10.843608 n-d-862686-1 devstack@n-api.service[120597]: X-Role: admin,member,reader Oct 26 13:07:10.843608 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: admin,member,reader Oct 26 13:07:10.845287 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8aefabe3d53144a0bd02b5e91076e309"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8aefabe3d53144a0bd02b5e91076e309"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8aefabe3d53144a0bd02b5e91076e309"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8aefabe3d53144a0bd02b5e91076e309"}]}] Oct 26 13:07:10.845287 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1410706316 Oct 26 13:07:10.845287 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 8aefabe3d53144a0bd02b5e91076e309 Oct 26 13:07:10.845287 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1410706316 Oct 26 13:07:10.845287 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin Oct 26 13:07:10.845287 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:07:10.845287 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:07:10.845287 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: e2e5f230da0a4e568f3c5d9cc6502669 Oct 26 13:07:10.845287 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin Oct 26 13:07:10.845287 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:07:10.845287 n-d-862686-1 devstack@n-api.service[120597]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 26 13:07:10.845287 n-d-862686-1 devstack@n-api.service[120597]: method: Oct 26 13:07:10.845287 n-d-862686-1 devstack@n-api.service[120597]: exception: Service f9eb436f-cacf-4c9a-bd38-0fb5d9bac27b could not be found. Oct 26 13:07:10.851324 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'f9eb436f-cacf-4c9a-bd38-0fb5d9bac27b', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 26 13:07:10.851324 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:07:10.851324 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:10.851324 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 26 13:07:10.851324 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 26 13:07:10.851324 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 26 13:07:10.851324 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 26 13:07:10.851324 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 26 13:07:10.851324 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:10.851324 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:10.851324 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:10.851324 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:10.851324 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 26 13:07:10.851324 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 26 13:07:10.851324 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 26 13:07:10.851324 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 26 13:07:10.851324 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service f9eb436f-cacf-4c9a-bd38-0fb5d9bac27b could not be found. Oct 26 13:07:10.851324 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:10.851324 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:10.851324 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:10.851324 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:10.852846 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:10.852846 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:10.852846 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:07:10.852846 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:07:10.852846 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:07:10.852846 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:07:10.852846 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:07:10.852846 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:07:10.852846 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:07:10.852846 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:07:10.852846 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 26 13:07:10.852846 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:07:10.852846 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service f9eb436f-cacf-4c9a-bd38-0fb5d9bac27b could not be found. Oct 26 13:07:10.852846 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:10.852846 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:10.852846 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:10.852846 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:10.852846 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:10.852846 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:10.852846 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:07:10.854312 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:07:10.854312 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service f9eb436f-cacf-4c9a-bd38-0fb5d9bac27b could not be found. Oct 26 13:07:10.854312 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:10.854312 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5e3a44f3-ff8c-4cee-bf41-b03a58141421 tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Returning 404 to user: Service f9eb436f-cacf-4c9a-bd38-0fb5d9bac27b could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:07:10.854312 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5e3a44f3-ff8c-4cee-bf41-b03a58141421 tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-services/f9eb436f-cacf-4c9a-bd38-0fb5d9bac27b" status: 404 len: 110 microversion: 2.53 time: 0.165538 Oct 26 13:07:10.854312 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 622/1326] 10.222.0.40 () {62 vars in 1309 bytes} [Wed Oct 26 13:07:10 2022] PUT /compute/v2.1/os-services/f9eb436f-cacf-4c9a-bd38-0fb5d9bac27b => generated 110 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 26 13:07:10.854964 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6268beeb-f140-4916-876b-157822602ffc tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Action: 'update', calling method: .version_select at 0x7f6732a130d0>, body: {"status": "disabled"} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:10.861151 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6268beeb-f140-4916-876b-157822602ffc tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:10.861677 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6268beeb-f140-4916-876b-157822602ffc tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:10.862102 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6268beeb-f140-4916-876b-157822602ffc tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:10.871390 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6268beeb-f140-4916-876b-157822602ffc tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:10.871878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6268beeb-f140-4916-876b-157822602ffc tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:10.872372 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6268beeb-f140-4916-876b-157822602ffc tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:10.879308 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-6268beeb-f140-4916-876b-157822602ffc tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] HTTP exception thrown: Service f9eb436f-cacf-4c9a-bd38-0fb5d9bac27b could not be found. Oct 26 13:07:10.881635 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6268beeb-f140-4916-876b-157822602ffc tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Request method failure captured: Oct 26 13:07:10.881635 n-d-862686-1 devstack@n-api.service[120598]: request: PUT /compute/v2.1/os-services/f9eb436f-cacf-4c9a-bd38-0fb5d9bac27b HTTP/1.1 Oct 26 13:07:10.881635 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:07:10.881635 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:07:10.881635 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:07:10.881635 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 22 Oct 26 13:07:10.881635 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:07:10.881635 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:07:10.881635 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:07:10.881635 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:07:10.881635 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTD-2tVLqnjyvrM7yA8V7WALM_AaBPOIlnaCK438bJbfSJMSNykbE3dX2YIexBM4Ca7lrdzY7F0-vJFYuKqa6XJsVe2xucq4CQ5_NXZktD7kI4k8x7axtd9vMlZWzGUsTz93iLP_LVNLv0t7xFP3Uav6Asz71C6NYWUU57oCv_ELOCs Oct 26 13:07:10.881635 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:07:10.881635 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:07:10.881635 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:07:10.881635 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:07:10.881635 n-d-862686-1 devstack@n-api.service[120598]: X-Openstack-Nova-Api-Version: 2.53 Oct 26 13:07:10.881635 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:07:10.881635 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:07:10.881635 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 8aefabe3d53144a0bd02b5e91076e309 Oct 26 13:07:10.881635 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1410706316 Oct 26 13:07:10.881635 n-d-862686-1 devstack@n-api.service[120598]: X-Role: admin,member,reader Oct 26 13:07:10.881635 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: admin,member,reader Oct 26 13:07:10.883053 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8aefabe3d53144a0bd02b5e91076e309"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8aefabe3d53144a0bd02b5e91076e309"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8aefabe3d53144a0bd02b5e91076e309"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8aefabe3d53144a0bd02b5e91076e309"}]}] Oct 26 13:07:10.883053 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1410706316 Oct 26 13:07:10.883053 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 8aefabe3d53144a0bd02b5e91076e309 Oct 26 13:07:10.883053 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1410706316 Oct 26 13:07:10.883053 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin Oct 26 13:07:10.883053 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:07:10.883053 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:07:10.883053 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: e2e5f230da0a4e568f3c5d9cc6502669 Oct 26 13:07:10.883053 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin Oct 26 13:07:10.883053 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:07:10.883053 n-d-862686-1 devstack@n-api.service[120598]: {"status": "disabled"} Oct 26 13:07:10.883053 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:07:10.883053 n-d-862686-1 devstack@n-api.service[120598]: exception: Service f9eb436f-cacf-4c9a-bd38-0fb5d9bac27b could not be found. Oct 26 13:07:10.883053 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'f9eb436f-cacf-4c9a-bd38-0fb5d9bac27b', 'body': {'status': 'disabled'}} Oct 26 13:07:10.884245 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:07:10.884245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:10.884245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 26 13:07:10.884245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 26 13:07:10.884245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 26 13:07:10.884245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 26 13:07:10.884245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 26 13:07:10.884245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:10.884245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:10.884245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:10.884245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:10.884245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 26 13:07:10.884245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 26 13:07:10.884245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 26 13:07:10.884245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 26 13:07:10.884245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service f9eb436f-cacf-4c9a-bd38-0fb5d9bac27b could not be found. Oct 26 13:07:10.884245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:10.884245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:10.884245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:10.884245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:10.884245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:10.886320 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:10.886320 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:07:10.886320 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:07:10.886320 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:07:10.886320 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:07:10.886320 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:07:10.886320 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:07:10.886320 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:07:10.886320 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:07:10.886320 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 26 13:07:10.886320 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:07:10.886320 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service f9eb436f-cacf-4c9a-bd38-0fb5d9bac27b could not be found. Oct 26 13:07:10.886320 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:10.886320 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:10.886320 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:10.886320 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:10.886320 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:10.886320 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:10.886320 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:07:10.886320 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:07:10.888541 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service f9eb436f-cacf-4c9a-bd38-0fb5d9bac27b could not be found. Oct 26 13:07:10.888541 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:10.888541 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6268beeb-f140-4916-876b-157822602ffc tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Returning 404 to user: Service f9eb436f-cacf-4c9a-bd38-0fb5d9bac27b could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:07:10.888541 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6268beeb-f140-4916-876b-157822602ffc tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-services/f9eb436f-cacf-4c9a-bd38-0fb5d9bac27b" status: 404 len: 110 microversion: 2.53 time: 0.032230 Oct 26 13:07:10.888541 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 705/1327] 10.222.0.40 () {62 vars in 1309 bytes} [Wed Oct 26 13:07:10 2022] PUT /compute/v2.1/os-services/f9eb436f-cacf-4c9a-bd38-0fb5d9bac27b => generated 110 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:07:10.893266 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9c3b7b57-97e7-46a1-9cfd-dcc976b56084 tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Action: 'update', calling method: .version_select at 0x7f67327a7160>, body: {"status": "enabled"} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:10.897812 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c3b7b57-97e7-46a1-9cfd-dcc976b56084 tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:10.898458 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c3b7b57-97e7-46a1-9cfd-dcc976b56084 tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:10.898904 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c3b7b57-97e7-46a1-9cfd-dcc976b56084 tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:10.905410 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c3b7b57-97e7-46a1-9cfd-dcc976b56084 tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:10.905943 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c3b7b57-97e7-46a1-9cfd-dcc976b56084 tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:10.906375 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c3b7b57-97e7-46a1-9cfd-dcc976b56084 tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:10.906931 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-39a4659b-6dc9-44c5-b78c-5e2061d7f284 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:10.907553 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-39a4659b-6dc9-44c5-b78c-5e2061d7f284 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:10.913686 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-9c3b7b57-97e7-46a1-9cfd-dcc976b56084 tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] HTTP exception thrown: Service f9eb436f-cacf-4c9a-bd38-0fb5d9bac27b could not be found. Oct 26 13:07:10.915174 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39a4659b-6dc9-44c5-b78c-5e2061d7f284 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:10.915670 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39a4659b-6dc9-44c5-b78c-5e2061d7f284 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:10.915987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9c3b7b57-97e7-46a1-9cfd-dcc976b56084 tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Request method failure captured: Oct 26 13:07:10.915987 n-d-862686-1 devstack@n-api.service[120597]: request: PUT /compute/v2.1/os-services/f9eb436f-cacf-4c9a-bd38-0fb5d9bac27b HTTP/1.1 Oct 26 13:07:10.915987 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:07:10.915987 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:07:10.915987 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:07:10.915987 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 21 Oct 26 13:07:10.915987 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:07:10.915987 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:07:10.915987 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:07:10.915987 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:07:10.915987 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTD-2tVLqnjyvrM7yA8V7WALM_AaBPOIlnaCK438bJbfSJMSNykbE3dX2YIexBM4Ca7lrdzY7F0-vJFYuKqa6XJsVe2xucq4CQ5_NXZktD7kI4k8x7axtd9vMlZWzGUsTz93iLP_LVNLv0t7xFP3Uav6Asz71C6NYWUU57oCv_ELOCs Oct 26 13:07:10.915987 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:07:10.915987 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:07:10.915987 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:07:10.915987 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:07:10.915987 n-d-862686-1 devstack@n-api.service[120597]: X-Openstack-Nova-Api-Version: 2.53 Oct 26 13:07:10.915987 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:07:10.915987 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:07:10.915987 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 8aefabe3d53144a0bd02b5e91076e309 Oct 26 13:07:10.915987 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1410706316 Oct 26 13:07:10.915987 n-d-862686-1 devstack@n-api.service[120597]: X-Role: admin,member,reader Oct 26 13:07:10.915987 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: admin,member,reader Oct 26 13:07:10.917595 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8aefabe3d53144a0bd02b5e91076e309"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8aefabe3d53144a0bd02b5e91076e309"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8aefabe3d53144a0bd02b5e91076e309"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8aefabe3d53144a0bd02b5e91076e309"}]}] Oct 26 13:07:10.917595 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1410706316 Oct 26 13:07:10.917595 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 8aefabe3d53144a0bd02b5e91076e309 Oct 26 13:07:10.917595 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1410706316 Oct 26 13:07:10.917595 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin Oct 26 13:07:10.917595 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:07:10.917595 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:07:10.917595 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: e2e5f230da0a4e568f3c5d9cc6502669 Oct 26 13:07:10.917595 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin Oct 26 13:07:10.917595 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:07:10.917595 n-d-862686-1 devstack@n-api.service[120597]: {"status": "enabled"} Oct 26 13:07:10.917595 n-d-862686-1 devstack@n-api.service[120597]: method: Oct 26 13:07:10.917595 n-d-862686-1 devstack@n-api.service[120597]: exception: Service f9eb436f-cacf-4c9a-bd38-0fb5d9bac27b could not be found. Oct 26 13:07:10.917595 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'f9eb436f-cacf-4c9a-bd38-0fb5d9bac27b', 'body': {'status': 'enabled'}} Oct 26 13:07:10.918657 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:07:10.918657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:10.918657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 26 13:07:10.918657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 26 13:07:10.918657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 26 13:07:10.918657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 26 13:07:10.918657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 26 13:07:10.918657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:10.918657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:10.918657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:10.918657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:10.918657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 26 13:07:10.918657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 26 13:07:10.918657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 26 13:07:10.918657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 26 13:07:10.918657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service f9eb436f-cacf-4c9a-bd38-0fb5d9bac27b could not be found. Oct 26 13:07:10.918657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:10.918657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:10.918657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:10.918657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:10.918657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:10.920097 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:10.920097 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:07:10.920097 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:07:10.920097 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:07:10.920097 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:07:10.920097 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:07:10.920097 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:07:10.920097 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:07:10.920097 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:07:10.920097 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 26 13:07:10.920097 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:07:10.920097 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service f9eb436f-cacf-4c9a-bd38-0fb5d9bac27b could not be found. Oct 26 13:07:10.920097 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:10.920097 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:10.920097 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:10.920097 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:10.920097 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:10.920097 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:10.920097 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:07:10.920097 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:07:10.921546 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service f9eb436f-cacf-4c9a-bd38-0fb5d9bac27b could not be found. Oct 26 13:07:10.921546 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:10.921717 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39a4659b-6dc9-44c5-b78c-5e2061d7f284 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:10.921717 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39a4659b-6dc9-44c5-b78c-5e2061d7f284 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:10.921717 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39a4659b-6dc9-44c5-b78c-5e2061d7f284 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:10.921717 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39a4659b-6dc9-44c5-b78c-5e2061d7f284 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:10.923135 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9c3b7b57-97e7-46a1-9cfd-dcc976b56084 tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Returning 404 to user: Service f9eb436f-cacf-4c9a-bd38-0fb5d9bac27b could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:07:10.924159 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9c3b7b57-97e7-46a1-9cfd-dcc976b56084 tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-services/f9eb436f-cacf-4c9a-bd38-0fb5d9bac27b" status: 404 len: 110 microversion: 2.53 time: 0.035054 Oct 26 13:07:10.924747 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 623/1328] 10.222.0.40 () {62 vars in 1309 bytes} [Wed Oct 26 13:07:10 2022] PUT /compute/v2.1/os-services/f9eb436f-cacf-4c9a-bd38-0fb5d9bac27b => generated 110 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:07:10.935716 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-43991c9d-ce84-4c40-b122-26978b8092ac tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:10.940191 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-43991c9d-ce84-4c40-b122-26978b8092ac tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:10.940685 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-43991c9d-ce84-4c40-b122-26978b8092ac tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:10.941742 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-43991c9d-ce84-4c40-b122-26978b8092ac tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:10.943037 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-43991c9d-ce84-4c40-b122-26978b8092ac tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:10.945839 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-43991c9d-ce84-4c40-b122-26978b8092ac tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:10.946433 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-43991c9d-ce84-4c40-b122-26978b8092ac tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:10.981362 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-43991c9d-ce84-4c40-b122-26978b8092ac tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.050334 Oct 26 13:07:10.990320 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 624/1329] 10.222.0.40 () {60 vars in 1178 bytes} [Wed Oct 26 13:07:10 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:07:10.997041 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-733b5dc3-0501-43fd-a780-2d1f13c8da1b tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:11.001104 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-733b5dc3-0501-43fd-a780-2d1f13c8da1b tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:11.001848 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-733b5dc3-0501-43fd-a780-2d1f13c8da1b tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:11.002506 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-733b5dc3-0501-43fd-a780-2d1f13c8da1b tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:11.003523 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-733b5dc3-0501-43fd-a780-2d1f13c8da1b tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:11.003986 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-733b5dc3-0501-43fd-a780-2d1f13c8da1b tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:11.004602 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-733b5dc3-0501-43fd-a780-2d1f13c8da1b tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:11.035145 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-733b5dc3-0501-43fd-a780-2d1f13c8da1b tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.042161 Oct 26 13:07:11.039095 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 625/1330] 10.222.0.40 () {60 vars in 1211 bytes} [Wed Oct 26 13:07:10 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:07:11.050073 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fd932acf-2c1f-48fb-8b39-a4ba9467310a tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:11.057156 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd932acf-2c1f-48fb-8b39-a4ba9467310a tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:11.058283 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd932acf-2c1f-48fb-8b39-a4ba9467310a tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:11.058867 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd932acf-2c1f-48fb-8b39-a4ba9467310a tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:11.059981 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd932acf-2c1f-48fb-8b39-a4ba9467310a tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:11.060682 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd932acf-2c1f-48fb-8b39-a4ba9467310a tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:11.061284 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd932acf-2c1f-48fb-8b39-a4ba9467310a tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:11.089286 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-39a4659b-6dc9-44c5-b78c-5e2061d7f284 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:11.096258 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fd932acf-2c1f-48fb-8b39-a4ba9467310a tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.050625 Oct 26 13:07:11.096992 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 626/1331] 10.222.0.40 () {60 vars in 1178 bytes} [Wed Oct 26 13:07:11 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:07:11.101392 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-39a4659b-6dc9-44c5-b78c-5e2061d7f284 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:11.102877 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-39a4659b-6dc9-44c5-b78c-5e2061d7f284 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:11.106363 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-39a4659b-6dc9-44c5-b78c-5e2061d7f284 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924" status: 200 len: 1812 microversion: 2.25 time: 0.206584 Oct 26 13:07:11.106937 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 706/1332] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:07:10 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 => generated 1812 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:07:11.110045 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bae7b872-af6b-4269-bb80-f9029fb5e612 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:11.110914 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bae7b872-af6b-4269-bb80-f9029fb5e612 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:11.111257 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-30057f32-98b5-4c30-9729-14727e3cdaa7 tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:11.117012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30057f32-98b5-4c30-9729-14727e3cdaa7 tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:11.117961 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30057f32-98b5-4c30-9729-14727e3cdaa7 tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:11.118464 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30057f32-98b5-4c30-9729-14727e3cdaa7 tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:11.119426 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30057f32-98b5-4c30-9729-14727e3cdaa7 tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:11.119845 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30057f32-98b5-4c30-9729-14727e3cdaa7 tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:11.120560 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30057f32-98b5-4c30-9729-14727e3cdaa7 tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:11.132241 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bae7b872-af6b-4269-bb80-f9029fb5e612 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:11.132709 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bae7b872-af6b-4269-bb80-f9029fb5e612 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:11.133207 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bae7b872-af6b-4269-bb80-f9029fb5e612 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:11.134163 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bae7b872-af6b-4269-bb80-f9029fb5e612 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:11.134956 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bae7b872-af6b-4269-bb80-f9029fb5e612 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:11.135539 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bae7b872-af6b-4269-bb80-f9029fb5e612 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:11.148296 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-30057f32-98b5-4c30-9729-14727e3cdaa7 tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?host=n-d-862686-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.040239 Oct 26 13:07:11.149288 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 707/1333] 10.222.0.40 () {60 vars in 1235 bytes} [Wed Oct 26 13:07:11 2022] GET /compute/v2.1/os-services?host=n-d-862686-1&binary=xxx => generated 16 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:11.164822 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-afb95dbd-4614-48ce-8ac5-baccde5927ea tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:11.169759 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afb95dbd-4614-48ce-8ac5-baccde5927ea tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:11.170527 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afb95dbd-4614-48ce-8ac5-baccde5927ea tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:11.171449 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afb95dbd-4614-48ce-8ac5-baccde5927ea tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:11.172453 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afb95dbd-4614-48ce-8ac5-baccde5927ea tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:11.172918 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afb95dbd-4614-48ce-8ac5-baccde5927ea tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:11.173425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afb95dbd-4614-48ce-8ac5-baccde5927ea tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:11.204825 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-afb95dbd-4614-48ce-8ac5-baccde5927ea tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.046859 Oct 26 13:07:11.214745 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 708/1334] 10.222.0.40 () {60 vars in 1178 bytes} [Wed Oct 26 13:07:11 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:07:11.222173 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6f9434f0-87b2-445f-9dbd-875e68885ed7 tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:11.227384 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6f9434f0-87b2-445f-9dbd-875e68885ed7 tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:11.227879 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6f9434f0-87b2-445f-9dbd-875e68885ed7 tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:11.228322 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6f9434f0-87b2-445f-9dbd-875e68885ed7 tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:11.229055 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6f9434f0-87b2-445f-9dbd-875e68885ed7 tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:11.229528 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6f9434f0-87b2-445f-9dbd-875e68885ed7 tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:11.230636 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6f9434f0-87b2-445f-9dbd-875e68885ed7 tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:11.255766 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6f9434f0-87b2-445f-9dbd-875e68885ed7 tempest-ServicesAdminNegativeV253TestJSON-1410706316 tempest-ServicesAdminNegativeV253TestJSON-1410706316-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.039823 Oct 26 13:07:11.264997 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 709/1335] 10.222.0.40 () {60 vars in 1239 bytes} [Wed Oct 26 13:07:11 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:11.412389 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f8e55f9f-cf74-44b8-8e0f-d337397f878f tempest-ServicesAdminNegativeV253TestJSON-373116705 tempest-ServicesAdminNegativeV253TestJSON-373116705-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:11.416363 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f8e55f9f-cf74-44b8-8e0f-d337397f878f tempest-ServicesAdminNegativeV253TestJSON-373116705 tempest-ServicesAdminNegativeV253TestJSON-373116705-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '7a27290692bc4e79bb1145ee28aa9cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb1a93dca6843ceabe1023895bc18c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:11.418420 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f8e55f9f-cf74-44b8-8e0f-d337397f878f tempest-ServicesAdminNegativeV253TestJSON-373116705 tempest-ServicesAdminNegativeV253TestJSON-373116705-project] Request method failure captured: Oct 26 13:07:11.418420 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 26 13:07:11.418420 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:07:11.418420 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:07:11.418420 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:07:11.418420 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:07:11.418420 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:07:11.418420 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:07:11.418420 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:07:11.418420 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:07:11.418420 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTD9rGtjMEhNqg8YOos_j1-jSCOOapVy1Df0teOQ_n7I3KOrTsmUvXl0CfhHUzgo_A04_22bMnCD-jvIJgCLpE18jbnxlLicDK7KTSVVB1n3yDCcBVjQWSlusHFsbY21URSvQMIZi1GeZoINg7YUdcLJ1swtQFDxBH6HZul5Ajr-60k Oct 26 13:07:11.418420 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:07:11.418420 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:07:11.418420 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:07:11.418420 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:07:11.418420 n-d-862686-1 devstack@n-api.service[120598]: X-Openstack-Nova-Api-Version: 2.53 Oct 26 13:07:11.418420 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:07:11.418420 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:07:11.418420 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 2eb1a93dca6843ceabe1023895bc18c0 Oct 26 13:07:11.418420 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-373116705 Oct 26 13:07:11.418420 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:07:11.418420 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:07:11.420052 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2eb1a93dca6843ceabe1023895bc18c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2eb1a93dca6843ceabe1023895bc18c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2eb1a93dca6843ceabe1023895bc18c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2eb1a93dca6843ceabe1023895bc18c0"}]}] Oct 26 13:07:11.420052 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-373116705 Oct 26 13:07:11.420052 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 2eb1a93dca6843ceabe1023895bc18c0 Oct 26 13:07:11.420052 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-373116705 Oct 26 13:07:11.420052 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServicesAdminNegativeV253TestJSON-373116705-project Oct 26 13:07:11.420052 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:07:11.420052 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:07:11.420052 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 7a27290692bc4e79bb1145ee28aa9cb3 Oct 26 13:07:11.420052 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-373116705-project Oct 26 13:07:11.420052 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:07:11.420052 n-d-862686-1 devstack@n-api.service[120598]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 26 13:07:11.420052 n-d-862686-1 devstack@n-api.service[120598]: action_args: {} Oct 26 13:07:11.420973 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:07:11.420973 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:11.420973 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:11.420973 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:11.420973 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:07:11.420973 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:07:11.420973 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 26 13:07:11.420973 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:07:11.420973 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 26 13:07:11.420973 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:07:11.420973 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:07:11.420973 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:07:11.420973 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 26 13:07:11.420973 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 26 13:07:11.420973 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 13:07:11.420973 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 13:07:11.420973 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 13:07:11.420973 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 13:07:11.420973 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 13:07:11.422334 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 13:07:11.422334 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 13:07:11.422334 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 13:07:11.422334 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 13:07:11.422334 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 13:07:11.422334 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 13:07:11.422334 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 13:07:11.422334 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 13:07:11.422334 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 13:07:11.422334 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 26 13:07:11.422334 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:11.422334 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:11.422334 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:11.422334 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:11.422334 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:11.422334 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:11.422334 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 13:07:11.422334 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 13:07:11.422334 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 26 13:07:11.422334 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:11.424573 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f8e55f9f-cf74-44b8-8e0f-d337397f878f tempest-ServicesAdminNegativeV253TestJSON-373116705 tempest-ServicesAdminNegativeV253TestJSON-373116705-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:07:11.425618 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f8e55f9f-cf74-44b8-8e0f-d337397f878f tempest-ServicesAdminNegativeV253TestJSON-373116705 tempest-ServicesAdminNegativeV253TestJSON-373116705-project] 10.222.0.40 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.158815 Oct 26 13:07:11.431219 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 710/1336] 10.222.0.40 () {60 vars in 1178 bytes} [Wed Oct 26 13:07:11 2022] GET /compute/v2.1/os-services => generated 112 bytes in 165 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:07:11.437319 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7f0f1f3e-6b64-4b98-bafd-8be34b58bb82 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:11.438191 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7f0f1f3e-6b64-4b98-bafd-8be34b58bb82 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 2803303a-ad72-4096-b524-69a583a56f03] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:11.447593 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f0f1f3e-6b64-4b98-bafd-8be34b58bb82 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:11.448328 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f0f1f3e-6b64-4b98-bafd-8be34b58bb82 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:11.449029 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f0f1f3e-6b64-4b98-bafd-8be34b58bb82 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:11.450093 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f0f1f3e-6b64-4b98-bafd-8be34b58bb82 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:11.450821 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f0f1f3e-6b64-4b98-bafd-8be34b58bb82 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:11.452108 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f0f1f3e-6b64-4b98-bafd-8be34b58bb82 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:11.477161 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bae7b872-af6b-4269-bb80-f9029fb5e612 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:11.490161 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bae7b872-af6b-4269-bb80-f9029fb5e612 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1478 microversion: 2.1 time: 0.388365 Oct 26 13:07:11.492784 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 627/1337] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:11 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1478 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:11.501062 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-bfa7f5fb-3eb3-4597-a424-89673980bce9 req-5cc21b71-e05d-41e8-a835-4839d9f02d69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "670021c1-045f-40b1-9358-c589d32e9904", "name": "network-vif-plugged", "status": "completed", "tag": "6e2ffd62-248d-44dd-83ca-8e87f79cc722"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:11.520120 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-bfa7f5fb-3eb3-4597-a424-89673980bce9 req-5cc21b71-e05d-41e8-a835-4839d9f02d69 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:11.520625 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-bfa7f5fb-3eb3-4597-a424-89673980bce9 req-5cc21b71-e05d-41e8-a835-4839d9f02d69 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:11.521120 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-bfa7f5fb-3eb3-4597-a424-89673980bce9 req-5cc21b71-e05d-41e8-a835-4839d9f02d69 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:11.552853 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-bfa7f5fb-3eb3-4597-a424-89673980bce9 req-5cc21b71-e05d-41e8-a835-4839d9f02d69 service nova] Creating event network-vif-plugged:6e2ffd62-248d-44dd-83ca-8e87f79cc722 for instance 670021c1-045f-40b1-9358-c589d32e9904 on n-h2-862686-1 Oct 26 13:07:11.561589 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-bfa7f5fb-3eb3-4597-a424-89673980bce9 req-5cc21b71-e05d-41e8-a835-4839d9f02d69 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067329 Oct 26 13:07:11.562440 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 628/1338] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:07:11.570585 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-77cb2f0f-db75-4af9-86e1-d76a0caf26f0 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:11.571523 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-77cb2f0f-db75-4af9-86e1-d76a0caf26f0 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: 249cce52-de17-460b-b445-e24d0d377986] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:11.579750 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-77cb2f0f-db75-4af9-86e1-d76a0caf26f0 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:11.580682 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-77cb2f0f-db75-4af9-86e1-d76a0caf26f0 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:11.581348 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-77cb2f0f-db75-4af9-86e1-d76a0caf26f0 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:11.582302 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-77cb2f0f-db75-4af9-86e1-d76a0caf26f0 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:11.583039 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-77cb2f0f-db75-4af9-86e1-d76a0caf26f0 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:11.583986 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-77cb2f0f-db75-4af9-86e1-d76a0caf26f0 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:11.682198 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7f0f1f3e-6b64-4b98-bafd-8be34b58bb82 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:11.691290 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7f0f1f3e-6b64-4b98-bafd-8be34b58bb82 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03" status: 200 len: 1541 microversion: 2.1 time: 0.258773 Oct 26 13:07:11.692734 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 711/1339] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:11 2022] GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03 => generated 1541 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:11.698224 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a1dfa66a-a927-46c6-b52d-d28a94245a4f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:11.698829 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a1dfa66a-a927-46c6-b52d-d28a94245a4f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: d426a4f6-fa08-47d2-a583-735600b77f27] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:11.715252 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a1dfa66a-a927-46c6-b52d-d28a94245a4f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:11.715740 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a1dfa66a-a927-46c6-b52d-d28a94245a4f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:11.716472 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a1dfa66a-a927-46c6-b52d-d28a94245a4f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:11.717178 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a1dfa66a-a927-46c6-b52d-d28a94245a4f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:11.717700 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a1dfa66a-a927-46c6-b52d-d28a94245a4f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:11.721103 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a1dfa66a-a927-46c6-b52d-d28a94245a4f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:11.816127 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a1dfa66a-a927-46c6-b52d-d28a94245a4f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:11.829022 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a1dfa66a-a927-46c6-b52d-d28a94245a4f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27" status: 200 len: 1260 microversion: 2.1 time: 0.134988 Oct 26 13:07:11.833691 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 712/1340] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:11 2022] GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27 => generated 1260 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:11.846775 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7ebd7a1d-b9f7-4df4-9628-949ed4ba93cc tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:11.855041 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7ebd7a1d-b9f7-4df4-9628-949ed4ba93cc tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:11.870277 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ebd7a1d-b9f7-4df4-9628-949ed4ba93cc tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:11.870879 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ebd7a1d-b9f7-4df4-9628-949ed4ba93cc tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:11.871681 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ebd7a1d-b9f7-4df4-9628-949ed4ba93cc tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:11.873214 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ebd7a1d-b9f7-4df4-9628-949ed4ba93cc tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:11.874306 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ebd7a1d-b9f7-4df4-9628-949ed4ba93cc tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:11.874966 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ebd7a1d-b9f7-4df4-9628-949ed4ba93cc tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:11.938370 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-77cb2f0f-db75-4af9-86e1-d76a0caf26f0 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:11.951368 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-77cb2f0f-db75-4af9-86e1-d76a0caf26f0 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986" status: 200 len: 1468 microversion: 2.1 time: 0.387526 Oct 26 13:07:11.968900 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 629/1341] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:11 2022] GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986 => generated 1468 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:11.976932 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-0b9adf1b-0138-491f-8c86-eadb81ceb7c2 req-a63ab37e-1399-4c6e-8cb7-77db982ba670 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d754336-7bde-477f-954d-d0b4290ee0fa", "name": "network-vif-deleted", "tag": "47e7f1c4-4783-47be-bd33-fea8170829f0"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:11.989234 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-0b9adf1b-0138-491f-8c86-eadb81ceb7c2 req-a63ab37e-1399-4c6e-8cb7-77db982ba670 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:11.989989 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-0b9adf1b-0138-491f-8c86-eadb81ceb7c2 req-a63ab37e-1399-4c6e-8cb7-77db982ba670 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:11.991134 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-0b9adf1b-0138-491f-8c86-eadb81ceb7c2 req-a63ab37e-1399-4c6e-8cb7-77db982ba670 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:12.017389 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-0b9adf1b-0138-491f-8c86-eadb81ceb7c2 req-a63ab37e-1399-4c6e-8cb7-77db982ba670 service nova] Creating event network-vif-deleted:47e7f1c4-4783-47be-bd33-fea8170829f0 for instance 7d754336-7bde-477f-954d-d0b4290ee0fa on n-h2-862686-1 Oct 26 13:07:12.026781 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-0b9adf1b-0138-491f-8c86-eadb81ceb7c2 req-a63ab37e-1399-4c6e-8cb7-77db982ba670 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056283 Oct 26 13:07:12.027673 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 630/1342] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:07:12.033022 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-31931716-fe5a-4fa4-8fc0-a32e2177da22 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:12.035112 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-31931716-fe5a-4fa4-8fc0-a32e2177da22 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 7d754336-7bde-477f-954d-d0b4290ee0fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:12.046337 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31931716-fe5a-4fa4-8fc0-a32e2177da22 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:12.047231 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31931716-fe5a-4fa4-8fc0-a32e2177da22 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:12.049302 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31931716-fe5a-4fa4-8fc0-a32e2177da22 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:12.050395 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31931716-fe5a-4fa4-8fc0-a32e2177da22 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:12.051084 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31931716-fe5a-4fa4-8fc0-a32e2177da22 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:12.051564 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31931716-fe5a-4fa4-8fc0-a32e2177da22 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:12.078467 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7ebd7a1d-b9f7-4df4-9628-949ed4ba93cc tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:12.088388 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7ebd7a1d-b9f7-4df4-9628-949ed4ba93cc tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1476 microversion: 2.1 time: 0.251658 Oct 26 13:07:12.089601 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 713/1343] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:11 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1476 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:12.093193 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31931716-fe5a-4fa4-8fc0-a32e2177da22 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:12.093791 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31931716-fe5a-4fa4-8fc0-a32e2177da22 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:12.097649 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31931716-fe5a-4fa4-8fc0-a32e2177da22 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:12.098295 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-31931716-fe5a-4fa4-8fc0-a32e2177da22 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lazy-loading 'fault' on Instance uuid 7d754336-7bde-477f-954d-d0b4290ee0fa {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:07:12.135654 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f3c3b209-108e-4b51-9bcc-1fab14baf17b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:12.136720 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f3c3b209-108e-4b51-9bcc-1fab14baf17b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:12.148335 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f3c3b209-108e-4b51-9bcc-1fab14baf17b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:12.150700 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f3c3b209-108e-4b51-9bcc-1fab14baf17b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:12.151164 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f3c3b209-108e-4b51-9bcc-1fab14baf17b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:12.151901 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f3c3b209-108e-4b51-9bcc-1fab14baf17b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:12.155626 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f3c3b209-108e-4b51-9bcc-1fab14baf17b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:12.156376 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f3c3b209-108e-4b51-9bcc-1fab14baf17b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:12.160242 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-31931716-fe5a-4fa4-8fc0-a32e2177da22 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:12.173621 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-31931716-fe5a-4fa4-8fc0-a32e2177da22 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/7d754336-7bde-477f-954d-d0b4290ee0fa" status: 200 len: 1306 microversion: 2.1 time: 0.144481 Oct 26 13:07:12.174461 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 631/1344] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:12 2022] GET /compute/v2.1/servers/7d754336-7bde-477f-954d-d0b4290ee0fa => generated 1306 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:12.441881 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f3c3b209-108e-4b51-9bcc-1fab14baf17b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:12.451306 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f3c3b209-108e-4b51-9bcc-1fab14baf17b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:12.453070 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f3c3b209-108e-4b51-9bcc-1fab14baf17b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:12.454419 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f3c3b209-108e-4b51-9bcc-1fab14baf17b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924" status: 200 len: 1812 microversion: 2.25 time: 0.323471 Oct 26 13:07:12.455021 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 714/1345] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:07:12 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 => generated 1812 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:07:12.519922 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6729b068-9354-44ef-984a-1d1a3e470f99 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:12.520543 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6729b068-9354-44ef-984a-1d1a3e470f99 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:12.527218 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6729b068-9354-44ef-984a-1d1a3e470f99 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:12.527708 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6729b068-9354-44ef-984a-1d1a3e470f99 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:12.528175 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6729b068-9354-44ef-984a-1d1a3e470f99 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:12.528878 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6729b068-9354-44ef-984a-1d1a3e470f99 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:12.529337 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6729b068-9354-44ef-984a-1d1a3e470f99 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:12.529986 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6729b068-9354-44ef-984a-1d1a3e470f99 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:12.721589 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-671b29e1-b70d-44ff-b7d3-e4f69303d672 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:12.735181 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-671b29e1-b70d-44ff-b7d3-e4f69303d672 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 2803303a-ad72-4096-b524-69a583a56f03] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:12.754977 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-671b29e1-b70d-44ff-b7d3-e4f69303d672 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:12.755471 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-671b29e1-b70d-44ff-b7d3-e4f69303d672 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:12.755906 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-671b29e1-b70d-44ff-b7d3-e4f69303d672 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:12.757127 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-671b29e1-b70d-44ff-b7d3-e4f69303d672 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:12.757860 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-671b29e1-b70d-44ff-b7d3-e4f69303d672 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:12.758014 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-671b29e1-b70d-44ff-b7d3-e4f69303d672 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:12.788566 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6729b068-9354-44ef-984a-1d1a3e470f99 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:12.799245 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6729b068-9354-44ef-984a-1d1a3e470f99 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1478 microversion: 2.1 time: 0.283482 Oct 26 13:07:12.799480 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:07:12.803002 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 632/1346] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:12 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1478 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:12.865220 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-18d6d45b-ec73-4e1d-86f7-1524e87a44e3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:12.866126 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-18d6d45b-ec73-4e1d-86f7-1524e87a44e3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: d426a4f6-fa08-47d2-a583-735600b77f27] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:12.872565 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18d6d45b-ec73-4e1d-86f7-1524e87a44e3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:12.873066 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18d6d45b-ec73-4e1d-86f7-1524e87a44e3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:12.873711 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18d6d45b-ec73-4e1d-86f7-1524e87a44e3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:12.874583 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18d6d45b-ec73-4e1d-86f7-1524e87a44e3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:12.875204 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18d6d45b-ec73-4e1d-86f7-1524e87a44e3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:12.875929 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18d6d45b-ec73-4e1d-86f7-1524e87a44e3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:12.934675 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-671b29e1-b70d-44ff-b7d3-e4f69303d672 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:12.944002 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-671b29e1-b70d-44ff-b7d3-e4f69303d672 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03" status: 200 len: 1541 microversion: 2.1 time: 0.227328 Oct 26 13:07:12.953388 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 715/1347] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:12 2022] GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03 => generated 1541 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:12.954012 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-18d6d45b-ec73-4e1d-86f7-1524e87a44e3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:12.959973 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-18d6d45b-ec73-4e1d-86f7-1524e87a44e3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27" status: 200 len: 1266 microversion: 2.1 time: 0.098614 Oct 26 13:07:12.960710 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 633/1348] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:12 2022] GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27 => generated 1266 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:07:12.978132 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-51097d44-77d7-41ca-bb99-64cce6435ca8 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:12.978823 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-51097d44-77d7-41ca-bb99-64cce6435ca8 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: 249cce52-de17-460b-b445-e24d0d377986] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:12.985922 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-51097d44-77d7-41ca-bb99-64cce6435ca8 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:12.986412 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-51097d44-77d7-41ca-bb99-64cce6435ca8 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:12.986862 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-51097d44-77d7-41ca-bb99-64cce6435ca8 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:12.987550 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-51097d44-77d7-41ca-bb99-64cce6435ca8 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:12.988005 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-51097d44-77d7-41ca-bb99-64cce6435ca8 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:12.988435 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-51097d44-77d7-41ca-bb99-64cce6435ca8 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:13.120678 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-64155a59-3f65-452d-930e-939b022f2d11 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:13.122505 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-64155a59-3f65-452d-930e-939b022f2d11 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:13.127626 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-51097d44-77d7-41ca-bb99-64cce6435ca8 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:13.129290 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64155a59-3f65-452d-930e-939b022f2d11 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:13.130227 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64155a59-3f65-452d-930e-939b022f2d11 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:13.130829 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64155a59-3f65-452d-930e-939b022f2d11 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:13.132211 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64155a59-3f65-452d-930e-939b022f2d11 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:13.132850 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64155a59-3f65-452d-930e-939b022f2d11 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:13.133281 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64155a59-3f65-452d-930e-939b022f2d11 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:13.136794 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-51097d44-77d7-41ca-bb99-64cce6435ca8 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986" status: 200 len: 1468 microversion: 2.1 time: 0.164254 Oct 26 13:07:13.137987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:07:13.153551 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 716/1349] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:12 2022] GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986 => generated 1468 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:13.196648 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4762c65d-60a9-439c-8583-0d0a780139a0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:13.197365 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4762c65d-60a9-439c-8583-0d0a780139a0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 7d754336-7bde-477f-954d-d0b4290ee0fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:13.203684 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4762c65d-60a9-439c-8583-0d0a780139a0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:13.204276 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4762c65d-60a9-439c-8583-0d0a780139a0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:13.204799 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4762c65d-60a9-439c-8583-0d0a780139a0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:13.205587 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4762c65d-60a9-439c-8583-0d0a780139a0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:13.206246 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4762c65d-60a9-439c-8583-0d0a780139a0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:13.206876 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4762c65d-60a9-439c-8583-0d0a780139a0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:13.242033 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4762c65d-60a9-439c-8583-0d0a780139a0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:13.242737 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4762c65d-60a9-439c-8583-0d0a780139a0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:13.243336 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4762c65d-60a9-439c-8583-0d0a780139a0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:13.243945 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-4762c65d-60a9-439c-8583-0d0a780139a0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lazy-loading 'fault' on Instance uuid 7d754336-7bde-477f-954d-d0b4290ee0fa {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:07:13.283153 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-64155a59-3f65-452d-930e-939b022f2d11 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:13.291923 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-64155a59-3f65-452d-930e-939b022f2d11 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1476 microversion: 2.1 time: 0.177852 Oct 26 13:07:13.292931 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 634/1350] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:13 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1476 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:13.297972 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4762c65d-60a9-439c-8583-0d0a780139a0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:13.307717 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4762c65d-60a9-439c-8583-0d0a780139a0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/7d754336-7bde-477f-954d-d0b4290ee0fa" status: 200 len: 1306 microversion: 2.1 time: 0.115051 Oct 26 13:07:13.308316 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 717/1351] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:13 2022] GET /compute/v2.1/servers/7d754336-7bde-477f-954d-d0b4290ee0fa => generated 1306 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:07:13.488991 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2d575c82-41a3-44da-89a7-b13db411cdb3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:13.493044 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2d575c82-41a3-44da-89a7-b13db411cdb3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:13.497832 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:07:13.502154 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2d575c82-41a3-44da-89a7-b13db411cdb3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:13.502812 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2d575c82-41a3-44da-89a7-b13db411cdb3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:13.503470 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2d575c82-41a3-44da-89a7-b13db411cdb3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:13.504443 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2d575c82-41a3-44da-89a7-b13db411cdb3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:13.508402 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2d575c82-41a3-44da-89a7-b13db411cdb3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:13.508402 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2d575c82-41a3-44da-89a7-b13db411cdb3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:13.766645 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2d575c82-41a3-44da-89a7-b13db411cdb3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:13.776548 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2d575c82-41a3-44da-89a7-b13db411cdb3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:13.778058 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2d575c82-41a3-44da-89a7-b13db411cdb3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:13.779245 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2d575c82-41a3-44da-89a7-b13db411cdb3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924" status: 200 len: 1812 microversion: 2.25 time: 0.299299 Oct 26 13:07:13.779798 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 635/1352] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:07:13 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 => generated 1812 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:07:13.827800 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2c6723d0-9831-4bf8-af1c-f7303b29ff97 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:13.828454 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2c6723d0-9831-4bf8-af1c-f7303b29ff97 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:13.839908 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2c6723d0-9831-4bf8-af1c-f7303b29ff97 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:13.843572 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2c6723d0-9831-4bf8-af1c-f7303b29ff97 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:13.844055 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2c6723d0-9831-4bf8-af1c-f7303b29ff97 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:13.847119 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2c6723d0-9831-4bf8-af1c-f7303b29ff97 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:13.847599 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2c6723d0-9831-4bf8-af1c-f7303b29ff97 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:13.848041 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2c6723d0-9831-4bf8-af1c-f7303b29ff97 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:13.972977 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e83bb72b-9176-4d83-b80a-f227c10f66ff tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:13.974342 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e83bb72b-9176-4d83-b80a-f227c10f66ff tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 2803303a-ad72-4096-b524-69a583a56f03] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:13.990372 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e83bb72b-9176-4d83-b80a-f227c10f66ff tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:13.991354 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e83bb72b-9176-4d83-b80a-f227c10f66ff tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:13.991804 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e83bb72b-9176-4d83-b80a-f227c10f66ff tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:13.998463 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e83bb72b-9176-4d83-b80a-f227c10f66ff tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:13.998463 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e83bb72b-9176-4d83-b80a-f227c10f66ff tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:13.999323 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e83bb72b-9176-4d83-b80a-f227c10f66ff tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:14.052396 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2c6723d0-9831-4bf8-af1c-f7303b29ff97 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:14.067305 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2c6723d0-9831-4bf8-af1c-f7303b29ff97 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1478 microversion: 2.1 time: 0.244121 Oct 26 13:07:14.068271 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 718/1353] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:13 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1478 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:07:14.086339 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-542f005c-5fc5-4a6d-a786-40586fc75f53 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:14.087059 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-542f005c-5fc5-4a6d-a786-40586fc75f53 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: d426a4f6-fa08-47d2-a583-735600b77f27] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:14.093571 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-542f005c-5fc5-4a6d-a786-40586fc75f53 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:14.094457 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-542f005c-5fc5-4a6d-a786-40586fc75f53 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:14.095127 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-542f005c-5fc5-4a6d-a786-40586fc75f53 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:14.096074 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-542f005c-5fc5-4a6d-a786-40586fc75f53 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:14.096763 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-542f005c-5fc5-4a6d-a786-40586fc75f53 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:14.097432 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-542f005c-5fc5-4a6d-a786-40586fc75f53 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:14.304193 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e83bb72b-9176-4d83-b80a-f227c10f66ff tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:14.316571 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e83bb72b-9176-4d83-b80a-f227c10f66ff tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03" status: 200 len: 1541 microversion: 2.1 time: 0.352272 Oct 26 13:07:14.338876 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-542f005c-5fc5-4a6d-a786-40586fc75f53 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:14.342463 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 636/1354] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:13 2022] GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03 => generated 1541 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:14.348442 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c5cf0b5c-7d6e-4c9a-9350-0f1a211e8a90 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:14.349089 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c5cf0b5c-7d6e-4c9a-9350-0f1a211e8a90 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: 249cce52-de17-460b-b445-e24d0d377986] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:14.371294 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-542f005c-5fc5-4a6d-a786-40586fc75f53 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27" status: 200 len: 1308 microversion: 2.1 time: 0.301295 Oct 26 13:07:14.371551 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c5cf0b5c-7d6e-4c9a-9350-0f1a211e8a90 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:14.371904 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c5cf0b5c-7d6e-4c9a-9350-0f1a211e8a90 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:14.372834 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c5cf0b5c-7d6e-4c9a-9350-0f1a211e8a90 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:14.374175 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c5cf0b5c-7d6e-4c9a-9350-0f1a211e8a90 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:14.375340 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 719/1355] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:14 2022] GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27 => generated 1308 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:14.378542 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c5cf0b5c-7d6e-4c9a-9350-0f1a211e8a90 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:14.379217 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c5cf0b5c-7d6e-4c9a-9350-0f1a211e8a90 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:14.392351 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bb5f2070-6aa7-4448-a9f9-3f7bbc1a9217 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:14.394905 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bb5f2070-6aa7-4448-a9f9-3f7bbc1a9217 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:14.411990 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb5f2070-6aa7-4448-a9f9-3f7bbc1a9217 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:14.417348 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb5f2070-6aa7-4448-a9f9-3f7bbc1a9217 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:14.419260 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb5f2070-6aa7-4448-a9f9-3f7bbc1a9217 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:14.422053 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb5f2070-6aa7-4448-a9f9-3f7bbc1a9217 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:14.424168 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb5f2070-6aa7-4448-a9f9-3f7bbc1a9217 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:14.426365 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb5f2070-6aa7-4448-a9f9-3f7bbc1a9217 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:14.660479 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bb5f2070-6aa7-4448-a9f9-3f7bbc1a9217 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:14.669908 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bb5f2070-6aa7-4448-a9f9-3f7bbc1a9217 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1476 microversion: 2.1 time: 0.292565 Oct 26 13:07:14.670824 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 720/1356] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:14 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1476 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:14.686948 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d106a9e9-b203-4203-9dec-8b0514431ace tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:14.687890 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d106a9e9-b203-4203-9dec-8b0514431ace tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 7d754336-7bde-477f-954d-d0b4290ee0fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:14.690867 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=6,nova_api:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:07:14.694849 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d106a9e9-b203-4203-9dec-8b0514431ace tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:14.695532 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d106a9e9-b203-4203-9dec-8b0514431ace tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:14.696144 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d106a9e9-b203-4203-9dec-8b0514431ace tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:14.697130 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d106a9e9-b203-4203-9dec-8b0514431ace tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:14.697811 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d106a9e9-b203-4203-9dec-8b0514431ace tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:14.698207 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d106a9e9-b203-4203-9dec-8b0514431ace tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:14.701263 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c5cf0b5c-7d6e-4c9a-9350-0f1a211e8a90 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:14.714004 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c5cf0b5c-7d6e-4c9a-9350-0f1a211e8a90 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986" status: 200 len: 1468 microversion: 2.1 time: 0.370129 Oct 26 13:07:14.714527 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-d106a9e9-b203-4203-9dec-8b0514431ace tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] HTTP exception thrown: Instance 7d754336-7bde-477f-954d-d0b4290ee0fa could not be found. Oct 26 13:07:14.716184 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d106a9e9-b203-4203-9dec-8b0514431ace tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Request method failure captured: Oct 26 13:07:14.716184 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/7d754336-7bde-477f-954d-d0b4290ee0fa HTTP/1.1 Oct 26 13:07:14.716184 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:07:14.716184 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:07:14.716184 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:07:14.716184 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:07:14.716184 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:07:14.716184 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:07:14.716184 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:07:14.716184 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:07:14.716184 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTBPRVt_8YZnaMSFiptNqbU9QNU93-_uVsnIl5oPaIxTkieW3pGz0zJKB63vkS1UTm30oE-_Ib6tVEIUcfod49uJs_R6L4h_NtP5w4W8pi8x5J4f1QqVVXViMhIM2rv6Z6M-Vnp8kRHMISIYhq0EFTwFrWnXPDyjXTUbEUwh3-ynQvQ Oct 26 13:07:14.716184 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:07:14.716184 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:07:14.716184 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:07:14.716184 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:07:14.716184 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:07:14.716184 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:07:14.716184 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: d6515917885c4f3cb5fb19e05f4e5e2b Oct 26 13:07:14.716184 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersOnMultiNodesTest-1287428008 Oct 26 13:07:14.716184 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:07:14.716184 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:07:14.717896 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d6515917885c4f3cb5fb19e05f4e5e2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d6515917885c4f3cb5fb19e05f4e5e2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d6515917885c4f3cb5fb19e05f4e5e2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d6515917885c4f3cb5fb19e05f4e5e2b"}]}] Oct 26 13:07:14.717896 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersOnMultiNodesTest-1287428008 Oct 26 13:07:14.717896 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: d6515917885c4f3cb5fb19e05f4e5e2b Oct 26 13:07:14.717896 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1287428008 Oct 26 13:07:14.717896 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersOnMultiNodesTest-1287428008-project Oct 26 13:07:14.717896 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:07:14.717896 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:07:14.717896 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: b6cddfeca4ce49788143b2bf4b30545f Oct 26 13:07:14.717896 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersOnMultiNodesTest-1287428008-project Oct 26 13:07:14.717896 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:07:14.717896 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 7d754336-7bde-477f-954d-d0b4290ee0fa could not be found. Oct 26 13:07:14.717896 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '7d754336-7bde-477f-954d-d0b4290ee0fa'} Oct 26 13:07:14.721734 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:07:14.721734 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:14.721734 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:07:14.721734 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:07:14.721734 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:07:14.721734 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:07:14.721734 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:07:14.721734 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:07:14.721734 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:07:14.721734 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:07:14.721734 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d754336-7bde-477f-954d-d0b4290ee0fa could not be found. Oct 26 13:07:14.721734 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:14.721734 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:14.721734 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:14.721734 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:14.721734 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:14.721734 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:14.721734 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:07:14.721734 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:07:14.721734 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:07:14.722951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:07:14.722951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:07:14.722951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:07:14.722951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:07:14.722951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:07:14.722951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:07:14.722951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:07:14.722951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d754336-7bde-477f-954d-d0b4290ee0fa could not be found. Oct 26 13:07:14.722951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:14.722951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:14.722951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:14.722951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:14.722951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:14.722951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:14.722951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:07:14.722951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:07:14.722951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d754336-7bde-477f-954d-d0b4290ee0fa could not be found. Oct 26 13:07:14.722951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:14.724183 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d106a9e9-b203-4203-9dec-8b0514431ace tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Returning 404 to user: Instance 7d754336-7bde-477f-954d-d0b4290ee0fa could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:07:14.724183 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d106a9e9-b203-4203-9dec-8b0514431ace tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/7d754336-7bde-477f-954d-d0b4290ee0fa" status: 404 len: 111 microversion: 2.1 time: 0.045448 Oct 26 13:07:14.724183 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 721/1357] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:14 2022] GET /compute/v2.1/servers/7d754336-7bde-477f-954d-d0b4290ee0fa => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:07:14.726425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6283a41d-172d-478c-89f8-403ffd794205 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:14.726922 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6283a41d-172d-478c-89f8-403ffd794205 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 3c9dbe46-9160-491b-9efd-074333ee4d8c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:14.732815 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6283a41d-172d-478c-89f8-403ffd794205 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:14.733472 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6283a41d-172d-478c-89f8-403ffd794205 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:14.734148 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6283a41d-172d-478c-89f8-403ffd794205 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:14.734298 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 637/1358] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:14 2022] GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986 => generated 1468 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:14.735165 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6283a41d-172d-478c-89f8-403ffd794205 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:14.735619 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6283a41d-172d-478c-89f8-403ffd794205 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:14.736203 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6283a41d-172d-478c-89f8-403ffd794205 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:14.765218 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6283a41d-172d-478c-89f8-403ffd794205 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 3c9dbe46-9160-491b-9efd-074333ee4d8c] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:07:14.807255 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-50f8c96c-245d-44a6-96e0-de3eb8af8e1c tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:14.808164 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-50f8c96c-245d-44a6-96e0-de3eb8af8e1c tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:14.816209 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-50f8c96c-245d-44a6-96e0-de3eb8af8e1c tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:14.818143 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-50f8c96c-245d-44a6-96e0-de3eb8af8e1c tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:14.819350 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-50f8c96c-245d-44a6-96e0-de3eb8af8e1c tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:14.820803 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-50f8c96c-245d-44a6-96e0-de3eb8af8e1c tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:14.821336 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-50f8c96c-245d-44a6-96e0-de3eb8af8e1c tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:14.821850 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-50f8c96c-245d-44a6-96e0-de3eb8af8e1c tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:14.872097 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6283a41d-172d-478c-89f8-403ffd794205 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3c9dbe46-9160-491b-9efd-074333ee4d8c" status: 204 len: 0 microversion: 2.1 time: 0.148912 Oct 26 13:07:14.876575 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 722/1359] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:07:14 2022] DELETE /compute/v2.1/servers/3c9dbe46-9160-491b-9efd-074333ee4d8c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 26 13:07:14.883656 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1362e353-ff1f-444e-b18d-ad2ba861b230 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:14.884434 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1362e353-ff1f-444e-b18d-ad2ba861b230 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 2358d550-6ed6-4529-b268-ffdf82f228ff] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:14.891479 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1362e353-ff1f-444e-b18d-ad2ba861b230 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:14.892170 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1362e353-ff1f-444e-b18d-ad2ba861b230 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:14.892790 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1362e353-ff1f-444e-b18d-ad2ba861b230 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:14.893701 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1362e353-ff1f-444e-b18d-ad2ba861b230 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:14.894310 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1362e353-ff1f-444e-b18d-ad2ba861b230 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:14.894895 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1362e353-ff1f-444e-b18d-ad2ba861b230 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:14.927575 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1362e353-ff1f-444e-b18d-ad2ba861b230 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 2358d550-6ed6-4529-b268-ffdf82f228ff] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:07:15.043374 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1362e353-ff1f-444e-b18d-ad2ba861b230 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2358d550-6ed6-4529-b268-ffdf82f228ff" status: 204 len: 0 microversion: 2.1 time: 0.162917 Oct 26 13:07:15.047840 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 723/1360] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:07:14 2022] DELETE /compute/v2.1/servers/2358d550-6ed6-4529-b268-ffdf82f228ff => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:07:15.058353 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b92ed03c-7588-417b-aeed-e1f2bcfdfeee tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:15.059370 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b92ed03c-7588-417b-aeed-e1f2bcfdfeee tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 3c9dbe46-9160-491b-9efd-074333ee4d8c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:15.069473 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b92ed03c-7588-417b-aeed-e1f2bcfdfeee tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:15.070026 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b92ed03c-7588-417b-aeed-e1f2bcfdfeee tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:15.070569 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b92ed03c-7588-417b-aeed-e1f2bcfdfeee tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:15.071445 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b92ed03c-7588-417b-aeed-e1f2bcfdfeee tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:15.072223 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b92ed03c-7588-417b-aeed-e1f2bcfdfeee tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:15.073345 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b92ed03c-7588-417b-aeed-e1f2bcfdfeee tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:15.088776 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-50f8c96c-245d-44a6-96e0-de3eb8af8e1c tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:15.103085 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-50f8c96c-245d-44a6-96e0-de3eb8af8e1c tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:15.106301 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-50f8c96c-245d-44a6-96e0-de3eb8af8e1c tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:15.110959 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-50f8c96c-245d-44a6-96e0-de3eb8af8e1c tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924" status: 200 len: 1812 microversion: 2.25 time: 0.308264 Oct 26 13:07:15.111818 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 638/1361] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:07:14 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 => generated 1812 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:07:15.147672 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b28be79e-ded9-4f65-88a6-98e4013885aa tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:15.148407 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b28be79e-ded9-4f65-88a6-98e4013885aa tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:15.156627 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b28be79e-ded9-4f65-88a6-98e4013885aa tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:15.157140 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b28be79e-ded9-4f65-88a6-98e4013885aa tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:15.157615 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b28be79e-ded9-4f65-88a6-98e4013885aa tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:15.158553 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b28be79e-ded9-4f65-88a6-98e4013885aa tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:15.159785 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b28be79e-ded9-4f65-88a6-98e4013885aa tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:15.160233 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b28be79e-ded9-4f65-88a6-98e4013885aa tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:15.339873 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b92ed03c-7588-417b-aeed-e1f2bcfdfeee tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:15.363062 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b92ed03c-7588-417b-aeed-e1f2bcfdfeee tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/3c9dbe46-9160-491b-9efd-074333ee4d8c" status: 200 len: 1474 microversion: 2.1 time: 0.312343 Oct 26 13:07:15.371001 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 724/1362] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:15 2022] GET /compute/v2.1/servers/3c9dbe46-9160-491b-9efd-074333ee4d8c => generated 1474 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:15.381360 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-695f708e-c63b-4cd4-ae97-f0329f2605f4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:15.382331 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-695f708e-c63b-4cd4-ae97-f0329f2605f4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 2803303a-ad72-4096-b524-69a583a56f03] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:15.391306 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-695f708e-c63b-4cd4-ae97-f0329f2605f4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:15.394011 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-695f708e-c63b-4cd4-ae97-f0329f2605f4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:15.394585 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-695f708e-c63b-4cd4-ae97-f0329f2605f4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:15.394877 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b28be79e-ded9-4f65-88a6-98e4013885aa tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:15.397342 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-695f708e-c63b-4cd4-ae97-f0329f2605f4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:15.397855 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-695f708e-c63b-4cd4-ae97-f0329f2605f4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:15.398292 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-695f708e-c63b-4cd4-ae97-f0329f2605f4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:15.416593 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b28be79e-ded9-4f65-88a6-98e4013885aa tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1464 microversion: 2.1 time: 0.287516 Oct 26 13:07:15.417382 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 639/1363] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:15 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1464 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:15.421903 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8cc88a26-ea9f-4684-bad0-4158232d54e9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:15.422520 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8cc88a26-ea9f-4684-bad0-4158232d54e9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: d426a4f6-fa08-47d2-a583-735600b77f27] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:15.434601 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8cc88a26-ea9f-4684-bad0-4158232d54e9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:15.435021 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8cc88a26-ea9f-4684-bad0-4158232d54e9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:15.437664 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8cc88a26-ea9f-4684-bad0-4158232d54e9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:15.438594 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8cc88a26-ea9f-4684-bad0-4158232d54e9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:15.439601 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8cc88a26-ea9f-4684-bad0-4158232d54e9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:15.440171 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8cc88a26-ea9f-4684-bad0-4158232d54e9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:15.541841 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:07:15.604974 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-695f708e-c63b-4cd4-ae97-f0329f2605f4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:15.613503 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-695f708e-c63b-4cd4-ae97-f0329f2605f4 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03" status: 200 len: 1541 microversion: 2.1 time: 0.242067 Oct 26 13:07:15.614316 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 725/1364] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:15 2022] GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03 => generated 1541 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:15.619328 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-c3007352-2892-45eb-b852-82f57d0063dd req-21591fa1-27ca-4526-a798-98cdf96d1ba8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d426a4f6-fa08-47d2-a583-735600b77f27", "tag": "8734e662-a14c-45ba-b2b3-6b2193b943a0"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:15.635525 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-c3007352-2892-45eb-b852-82f57d0063dd req-21591fa1-27ca-4526-a798-98cdf96d1ba8 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:15.636083 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-c3007352-2892-45eb-b852-82f57d0063dd req-21591fa1-27ca-4526-a798-98cdf96d1ba8 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:15.636927 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-c3007352-2892-45eb-b852-82f57d0063dd req-21591fa1-27ca-4526-a798-98cdf96d1ba8 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:15.638061 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8cc88a26-ea9f-4684-bad0-4158232d54e9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:15.647956 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8cc88a26-ea9f-4684-bad0-4158232d54e9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27" status: 200 len: 1308 microversion: 2.1 time: 0.228927 Oct 26 13:07:15.648547 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 640/1365] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:15 2022] GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27 => generated 1308 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:15.655291 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-74a1705d-3487-4d16-827e-dfa4d09aa6ce tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:15.656109 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-74a1705d-3487-4d16-827e-dfa4d09aa6ce tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:15.663880 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-c3007352-2892-45eb-b852-82f57d0063dd req-21591fa1-27ca-4526-a798-98cdf96d1ba8 service nova] Creating event network-changed:8734e662-a14c-45ba-b2b3-6b2193b943a0 for instance d426a4f6-fa08-47d2-a583-735600b77f27 on n-h2-862686-1 Oct 26 13:07:15.664611 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-74a1705d-3487-4d16-827e-dfa4d09aa6ce tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:15.665227 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-74a1705d-3487-4d16-827e-dfa4d09aa6ce tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:15.665650 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-74a1705d-3487-4d16-827e-dfa4d09aa6ce tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:15.666426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-74a1705d-3487-4d16-827e-dfa4d09aa6ce tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:15.667036 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-74a1705d-3487-4d16-827e-dfa4d09aa6ce tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:15.667454 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-74a1705d-3487-4d16-827e-dfa4d09aa6ce tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:15.674434 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-c3007352-2892-45eb-b852-82f57d0063dd req-21591fa1-27ca-4526-a798-98cdf96d1ba8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059056 Oct 26 13:07:15.675130 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 726/1366] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:07:15.696282 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b3fda2c5-a71c-47d4-8a2a-30ba6885eb0d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:15.697264 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b3fda2c5-a71c-47d4-8a2a-30ba6885eb0d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:15.704997 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3fda2c5-a71c-47d4-8a2a-30ba6885eb0d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:15.705474 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3fda2c5-a71c-47d4-8a2a-30ba6885eb0d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:15.705940 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3fda2c5-a71c-47d4-8a2a-30ba6885eb0d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:15.706626 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3fda2c5-a71c-47d4-8a2a-30ba6885eb0d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:15.707073 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3fda2c5-a71c-47d4-8a2a-30ba6885eb0d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:15.707490 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3fda2c5-a71c-47d4-8a2a-30ba6885eb0d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:15.871010 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b3fda2c5-a71c-47d4-8a2a-30ba6885eb0d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:15.886057 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b3fda2c5-a71c-47d4-8a2a-30ba6885eb0d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1476 microversion: 2.1 time: 0.194944 Oct 26 13:07:15.887732 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 727/1367] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:15 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1476 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:15.893244 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-252890f0-1839-4196-94f6-cc3acd6e9efd tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:15.893898 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-252890f0-1839-4196-94f6-cc3acd6e9efd tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: 249cce52-de17-460b-b445-e24d0d377986] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:15.899869 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-252890f0-1839-4196-94f6-cc3acd6e9efd tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:15.900356 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-252890f0-1839-4196-94f6-cc3acd6e9efd tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:15.900844 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-252890f0-1839-4196-94f6-cc3acd6e9efd tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:15.901562 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-252890f0-1839-4196-94f6-cc3acd6e9efd tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:15.902183 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-252890f0-1839-4196-94f6-cc3acd6e9efd tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:15.903958 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-252890f0-1839-4196-94f6-cc3acd6e9efd tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:15.954934 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-74a1705d-3487-4d16-827e-dfa4d09aa6ce tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:15.967363 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-74a1705d-3487-4d16-827e-dfa4d09aa6ce tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1464 microversion: 2.1 time: 0.317429 Oct 26 13:07:15.968142 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 641/1368] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:15 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1464 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:15.994984 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c4b3dc4d-aa8d-4fb8-a804-9501a8bd2c2d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:16.001094 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c4b3dc4d-aa8d-4fb8-a804-9501a8bd2c2d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:16.009128 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4b3dc4d-aa8d-4fb8-a804-9501a8bd2c2d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:16.009902 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4b3dc4d-aa8d-4fb8-a804-9501a8bd2c2d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:16.011089 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4b3dc4d-aa8d-4fb8-a804-9501a8bd2c2d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:16.012297 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4b3dc4d-aa8d-4fb8-a804-9501a8bd2c2d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:16.013532 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4b3dc4d-aa8d-4fb8-a804-9501a8bd2c2d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:16.014302 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4b3dc4d-aa8d-4fb8-a804-9501a8bd2c2d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:16.075519 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-252890f0-1839-4196-94f6-cc3acd6e9efd tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:16.085235 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-252890f0-1839-4196-94f6-cc3acd6e9efd tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986" status: 200 len: 1468 microversion: 2.1 time: 0.196028 Oct 26 13:07:16.086104 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 728/1369] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:15 2022] GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986 => generated 1468 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:16.139678 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-c4b3dc4d-aa8d-4fb8-a804-9501a8bd2c2d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:07:16.140104 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-c4b3dc4d-aa8d-4fb8-a804-9501a8bd2c2d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:07:16.140583 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-c4b3dc4d-aa8d-4fb8-a804-9501a8bd2c2d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:07:16.141228 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9c96a2bc-e87e-4746-9179-fd37b9083703 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:16.141397 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-c4b3dc4d-aa8d-4fb8-a804-9501a8bd2c2d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:07:16.141859 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9c96a2bc-e87e-4746-9179-fd37b9083703 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:16.141973 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-c4b3dc4d-aa8d-4fb8-a804-9501a8bd2c2d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:07:16.151136 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c96a2bc-e87e-4746-9179-fd37b9083703 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:16.151625 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c96a2bc-e87e-4746-9179-fd37b9083703 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:16.153151 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c96a2bc-e87e-4746-9179-fd37b9083703 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:16.153151 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c96a2bc-e87e-4746-9179-fd37b9083703 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:16.153363 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c96a2bc-e87e-4746-9179-fd37b9083703 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:16.153702 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c96a2bc-e87e-4746-9179-fd37b9083703 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:16.230218 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c4b3dc4d-aa8d-4fb8-a804-9501a8bd2c2d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:16.239005 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4b3dc4d-aa8d-4fb8-a804-9501a8bd2c2d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:16.239512 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4b3dc4d-aa8d-4fb8-a804-9501a8bd2c2d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:16.239950 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4b3dc4d-aa8d-4fb8-a804-9501a8bd2c2d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:16.243748 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4b3dc4d-aa8d-4fb8-a804-9501a8bd2c2d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:16.246693 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4b3dc4d-aa8d-4fb8-a804-9501a8bd2c2d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:16.247153 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4b3dc4d-aa8d-4fb8-a804-9501a8bd2c2d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:16.293229 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c4b3dc4d-aa8d-4fb8-a804-9501a8bd2c2d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "POST /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904/action" status: 202 len: 1068 microversion: 2.1 time: 0.304344 Oct 26 13:07:16.295133 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 642/1370] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:07:15 2022] POST /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904/action => generated 1068 bytes in 308 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 26 13:07:16.314401 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-21aa9382-3ad4-4199-b81c-8b5ec0147897 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:16.315174 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-21aa9382-3ad4-4199-b81c-8b5ec0147897 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:16.323245 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-21aa9382-3ad4-4199-b81c-8b5ec0147897 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:16.324082 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-21aa9382-3ad4-4199-b81c-8b5ec0147897 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:16.325365 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-21aa9382-3ad4-4199-b81c-8b5ec0147897 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:16.326378 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-21aa9382-3ad4-4199-b81c-8b5ec0147897 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:16.327066 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-21aa9382-3ad4-4199-b81c-8b5ec0147897 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:16.327770 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-21aa9382-3ad4-4199-b81c-8b5ec0147897 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:16.348942 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9c96a2bc-e87e-4746-9179-fd37b9083703 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:16.353737 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:07:16.359880 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9c96a2bc-e87e-4746-9179-fd37b9083703 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:16.361619 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9c96a2bc-e87e-4746-9179-fd37b9083703 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:16.363349 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9c96a2bc-e87e-4746-9179-fd37b9083703 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924" status: 200 len: 1812 microversion: 2.25 time: 0.227328 Oct 26 13:07:16.364534 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 729/1371] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:07:16 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 => generated 1812 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:07:16.397721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fc888da9-ca27-4fd6-86a0-b5cd3feafbad tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:16.398365 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fc888da9-ca27-4fd6-86a0-b5cd3feafbad tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 3c9dbe46-9160-491b-9efd-074333ee4d8c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:16.411883 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fc888da9-ca27-4fd6-86a0-b5cd3feafbad tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:16.413116 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fc888da9-ca27-4fd6-86a0-b5cd3feafbad tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:16.414019 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fc888da9-ca27-4fd6-86a0-b5cd3feafbad tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:16.416172 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fc888da9-ca27-4fd6-86a0-b5cd3feafbad tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:16.416648 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fc888da9-ca27-4fd6-86a0-b5cd3feafbad tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:16.417075 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fc888da9-ca27-4fd6-86a0-b5cd3feafbad tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:16.608281 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fc888da9-ca27-4fd6-86a0-b5cd3feafbad tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:16.619985 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fc888da9-ca27-4fd6-86a0-b5cd3feafbad tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/3c9dbe46-9160-491b-9efd-074333ee4d8c" status: 200 len: 1474 microversion: 2.1 time: 0.236544 Oct 26 13:07:16.626313 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 730/1372] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:16 2022] GET /compute/v2.1/servers/3c9dbe46-9160-491b-9efd-074333ee4d8c => generated 1474 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:07:16.642528 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a5c36ea5-f31f-404a-8a1f-2fff58fa1d41 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:16.643102 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a5c36ea5-f31f-404a-8a1f-2fff58fa1d41 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 2803303a-ad72-4096-b524-69a583a56f03] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:16.651893 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5c36ea5-f31f-404a-8a1f-2fff58fa1d41 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:16.652347 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5c36ea5-f31f-404a-8a1f-2fff58fa1d41 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:16.652959 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5c36ea5-f31f-404a-8a1f-2fff58fa1d41 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:16.654241 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5c36ea5-f31f-404a-8a1f-2fff58fa1d41 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:16.654885 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5c36ea5-f31f-404a-8a1f-2fff58fa1d41 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:16.655953 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5c36ea5-f31f-404a-8a1f-2fff58fa1d41 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:16.656790 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-21aa9382-3ad4-4199-b81c-8b5ec0147897 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:16.671004 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-21aa9382-3ad4-4199-b81c-8b5ec0147897 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1473 microversion: 2.1 time: 0.361468 Oct 26 13:07:16.671761 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 643/1373] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:16 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1473 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:07:16.676897 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6995f91e-afd1-4f3c-9a78-c53932e7b00e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:16.677866 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6995f91e-afd1-4f3c-9a78-c53932e7b00e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: d426a4f6-fa08-47d2-a583-735600b77f27] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:16.720683 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6995f91e-afd1-4f3c-9a78-c53932e7b00e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:16.721834 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6995f91e-afd1-4f3c-9a78-c53932e7b00e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:16.722518 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6995f91e-afd1-4f3c-9a78-c53932e7b00e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:16.723645 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6995f91e-afd1-4f3c-9a78-c53932e7b00e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:16.725826 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6995f91e-afd1-4f3c-9a78-c53932e7b00e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:16.726664 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6995f91e-afd1-4f3c-9a78-c53932e7b00e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:16.941139 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a5c36ea5-f31f-404a-8a1f-2fff58fa1d41 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:16.954834 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a5c36ea5-f31f-404a-8a1f-2fff58fa1d41 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03" status: 200 len: 1533 microversion: 2.1 time: 0.318082 Oct 26 13:07:16.971501 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 731/1374] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:16 2022] GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03 => generated 1533 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:16.971501 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9e7f36c9-43ef-481f-b952-c87ec5b01159 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:16.971501 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9e7f36c9-43ef-481f-b952-c87ec5b01159 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:16.973458 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e7f36c9-43ef-481f-b952-c87ec5b01159 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:16.974000 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e7f36c9-43ef-481f-b952-c87ec5b01159 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:16.974867 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e7f36c9-43ef-481f-b952-c87ec5b01159 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:16.975723 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e7f36c9-43ef-481f-b952-c87ec5b01159 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:16.976910 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e7f36c9-43ef-481f-b952-c87ec5b01159 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:16.977567 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e7f36c9-43ef-481f-b952-c87ec5b01159 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:17.245898 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6995f91e-afd1-4f3c-9a78-c53932e7b00e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:17.262056 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6995f91e-afd1-4f3c-9a78-c53932e7b00e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27" status: 200 len: 1308 microversion: 2.1 time: 0.588734 Oct 26 13:07:17.263978 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 644/1375] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:16 2022] GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27 => generated 1308 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:17.266677 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9e7f36c9-43ef-481f-b952-c87ec5b01159 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:17.278132 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9e7f36c9-43ef-481f-b952-c87ec5b01159 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1476 microversion: 2.1 time: 0.319160 Oct 26 13:07:17.278682 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3c292cb7-591d-496e-9f08-4f819116022d tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:17.281256 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 732/1376] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:16 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1476 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:17.282212 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3c292cb7-591d-496e-9f08-4f819116022d tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: 249cce52-de17-460b-b445-e24d0d377986] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:17.290433 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3c292cb7-591d-496e-9f08-4f819116022d tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:17.290934 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3c292cb7-591d-496e-9f08-4f819116022d tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:17.291381 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3c292cb7-591d-496e-9f08-4f819116022d tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:17.292253 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3c292cb7-591d-496e-9f08-4f819116022d tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:17.292914 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3c292cb7-591d-496e-9f08-4f819116022d tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:17.293607 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3c292cb7-591d-496e-9f08-4f819116022d tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:17.396637 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0ba52d6c-c49e-4c63-87bf-6ec35971e5e8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:17.397696 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0ba52d6c-c49e-4c63-87bf-6ec35971e5e8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:17.406077 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ba52d6c-c49e-4c63-87bf-6ec35971e5e8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:17.406867 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ba52d6c-c49e-4c63-87bf-6ec35971e5e8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:17.407576 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ba52d6c-c49e-4c63-87bf-6ec35971e5e8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:17.409361 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ba52d6c-c49e-4c63-87bf-6ec35971e5e8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:17.410120 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ba52d6c-c49e-4c63-87bf-6ec35971e5e8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:17.410794 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ba52d6c-c49e-4c63-87bf-6ec35971e5e8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:17.681514 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0ba52d6c-c49e-4c63-87bf-6ec35971e5e8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:17.697248 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0ba52d6c-c49e-4c63-87bf-6ec35971e5e8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:17.698943 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0ba52d6c-c49e-4c63-87bf-6ec35971e5e8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:17.700641 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0ba52d6c-c49e-4c63-87bf-6ec35971e5e8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924" status: 200 len: 1812 microversion: 2.25 time: 0.313991 Oct 26 13:07:17.714287 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 733/1377] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:07:17 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 => generated 1812 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:07:17.714287 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-554cf9c4-04e6-478c-835a-d70097216424 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:17.714287 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-554cf9c4-04e6-478c-835a-d70097216424 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 3c9dbe46-9160-491b-9efd-074333ee4d8c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:17.719070 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-554cf9c4-04e6-478c-835a-d70097216424 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:17.719695 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-554cf9c4-04e6-478c-835a-d70097216424 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:17.720148 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-554cf9c4-04e6-478c-835a-d70097216424 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:17.721920 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-554cf9c4-04e6-478c-835a-d70097216424 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:17.722606 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-554cf9c4-04e6-478c-835a-d70097216424 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:17.723152 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-554cf9c4-04e6-478c-835a-d70097216424 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:17.966304 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-554cf9c4-04e6-478c-835a-d70097216424 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:17.976227 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-554cf9c4-04e6-478c-835a-d70097216424 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/3c9dbe46-9160-491b-9efd-074333ee4d8c" status: 200 len: 1474 microversion: 2.1 time: 0.273334 Oct 26 13:07:17.976992 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 734/1378] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:17 2022] GET /compute/v2.1/servers/3c9dbe46-9160-491b-9efd-074333ee4d8c => generated 1474 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:17.996576 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-52fa396c-95ca-4e58-89ff-4d336053d5e1 req-a8795b11-19bf-48e2-b4f2-541676e03e22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2358d550-6ed6-4529-b268-ffdf82f228ff", "name": "network-vif-deleted", "tag": "afd8b890-95e6-436a-a2d2-b757d32c6d43"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:18.007340 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-52fa396c-95ca-4e58-89ff-4d336053d5e1 req-a8795b11-19bf-48e2-b4f2-541676e03e22 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:18.008433 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-52fa396c-95ca-4e58-89ff-4d336053d5e1 req-a8795b11-19bf-48e2-b4f2-541676e03e22 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:18.008433 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-52fa396c-95ca-4e58-89ff-4d336053d5e1 req-a8795b11-19bf-48e2-b4f2-541676e03e22 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:18.028725 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-52fa396c-95ca-4e58-89ff-4d336053d5e1 req-a8795b11-19bf-48e2-b4f2-541676e03e22 service nova] Creating event network-vif-deleted:afd8b890-95e6-436a-a2d2-b757d32c6d43 for instance 2358d550-6ed6-4529-b268-ffdf82f228ff on n-h2-862686-1 Oct 26 13:07:18.033716 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-52fa396c-95ca-4e58-89ff-4d336053d5e1 req-a8795b11-19bf-48e2-b4f2-541676e03e22 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041754 Oct 26 13:07:18.034331 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 735/1379] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:07:18.040231 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-674ea53c-c297-4bfa-98e9-bd375ce20556 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:18.040932 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-674ea53c-c297-4bfa-98e9-bd375ce20556 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:18.047335 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-674ea53c-c297-4bfa-98e9-bd375ce20556 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:18.047835 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-674ea53c-c297-4bfa-98e9-bd375ce20556 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:18.048285 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-674ea53c-c297-4bfa-98e9-bd375ce20556 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:18.049063 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-674ea53c-c297-4bfa-98e9-bd375ce20556 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:18.050361 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-674ea53c-c297-4bfa-98e9-bd375ce20556 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:18.050836 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-674ea53c-c297-4bfa-98e9-bd375ce20556 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:18.088808 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3c292cb7-591d-496e-9f08-4f819116022d tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:18.110735 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3c292cb7-591d-496e-9f08-4f819116022d tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986" status: 200 len: 1468 microversion: 2.1 time: 0.844821 Oct 26 13:07:18.113125 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 645/1380] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:17 2022] GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986 => generated 1468 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:18.126494 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9fc0f553-2eb5-4451-a7d6-7796012f17d5 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:18.127376 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9fc0f553-2eb5-4451-a7d6-7796012f17d5 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 2803303a-ad72-4096-b524-69a583a56f03] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:18.134487 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9fc0f553-2eb5-4451-a7d6-7796012f17d5 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:18.135286 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9fc0f553-2eb5-4451-a7d6-7796012f17d5 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:18.135972 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9fc0f553-2eb5-4451-a7d6-7796012f17d5 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:18.138770 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9fc0f553-2eb5-4451-a7d6-7796012f17d5 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:18.146678 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9fc0f553-2eb5-4451-a7d6-7796012f17d5 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:18.148579 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9fc0f553-2eb5-4451-a7d6-7796012f17d5 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:18.303543 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-674ea53c-c297-4bfa-98e9-bd375ce20556 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:18.322431 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-674ea53c-c297-4bfa-98e9-bd375ce20556 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1473 microversion: 2.1 time: 0.286816 Oct 26 13:07:18.323458 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 736/1381] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:18 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1473 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:18.328764 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0052091c-ef67-4ce9-9991-40cdb1d81c75 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:18.329467 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0052091c-ef67-4ce9-9991-40cdb1d81c75 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: d426a4f6-fa08-47d2-a583-735600b77f27] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:18.336995 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0052091c-ef67-4ce9-9991-40cdb1d81c75 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:18.337750 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0052091c-ef67-4ce9-9991-40cdb1d81c75 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:18.338279 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0052091c-ef67-4ce9-9991-40cdb1d81c75 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:18.339073 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0052091c-ef67-4ce9-9991-40cdb1d81c75 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:18.339595 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0052091c-ef67-4ce9-9991-40cdb1d81c75 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:18.340091 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0052091c-ef67-4ce9-9991-40cdb1d81c75 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:18.558349 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0052091c-ef67-4ce9-9991-40cdb1d81c75 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:18.572557 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0052091c-ef67-4ce9-9991-40cdb1d81c75 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27" status: 200 len: 1308 microversion: 2.1 time: 0.245719 Oct 26 13:07:18.573388 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9fc0f553-2eb5-4451-a7d6-7796012f17d5 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:18.573924 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 737/1382] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:18 2022] GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27 => generated 1308 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:18.583892 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9fc0f553-2eb5-4451-a7d6-7796012f17d5 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03" status: 200 len: 1533 microversion: 2.1 time: 0.468240 Oct 26 13:07:18.588804 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d397fb72-fd31-43a6-aee8-e153d6ad5f9c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:18.589997 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 646/1383] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:18 2022] GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03 => generated 1533 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:18.591806 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d397fb72-fd31-43a6-aee8-e153d6ad5f9c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:18.595206 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-af0dcdb6-ea90-45d7-9cab-109e7dd4e7ff req-c36113bc-47c8-4edf-8d1f-e34a42c1a6fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "249cce52-de17-460b-b445-e24d0d377986", "name": "network-vif-unplugged", "status": "completed", "tag": "63756a62-388c-4b3a-971b-3d8f25684ca1"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:18.614626 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d397fb72-fd31-43a6-aee8-e153d6ad5f9c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:18.615138 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d397fb72-fd31-43a6-aee8-e153d6ad5f9c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:18.615673 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d397fb72-fd31-43a6-aee8-e153d6ad5f9c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:18.616448 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d397fb72-fd31-43a6-aee8-e153d6ad5f9c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:18.616946 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d397fb72-fd31-43a6-aee8-e153d6ad5f9c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:18.617809 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d397fb72-fd31-43a6-aee8-e153d6ad5f9c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:18.621728 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-af0dcdb6-ea90-45d7-9cab-109e7dd4e7ff req-c36113bc-47c8-4edf-8d1f-e34a42c1a6fe service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:18.622430 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-af0dcdb6-ea90-45d7-9cab-109e7dd4e7ff req-c36113bc-47c8-4edf-8d1f-e34a42c1a6fe service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:18.623027 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-af0dcdb6-ea90-45d7-9cab-109e7dd4e7ff req-c36113bc-47c8-4edf-8d1f-e34a42c1a6fe service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:18.655444 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-af0dcdb6-ea90-45d7-9cab-109e7dd4e7ff req-c36113bc-47c8-4edf-8d1f-e34a42c1a6fe service nova] Creating event network-vif-unplugged:63756a62-388c-4b3a-971b-3d8f25684ca1 for instance 249cce52-de17-460b-b445-e24d0d377986 on n-h1-862686-1 Oct 26 13:07:18.667132 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-af0dcdb6-ea90-45d7-9cab-109e7dd4e7ff req-c36113bc-47c8-4edf-8d1f-e34a42c1a6fe service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075591 Oct 26 13:07:18.668022 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 647/1384] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:07:18.738210 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bfa0bf50-f5a8-4060-a5dd-6dc72b586903 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:18.739303 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bfa0bf50-f5a8-4060-a5dd-6dc72b586903 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:18.748584 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bfa0bf50-f5a8-4060-a5dd-6dc72b586903 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:18.749149 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bfa0bf50-f5a8-4060-a5dd-6dc72b586903 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:18.749747 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bfa0bf50-f5a8-4060-a5dd-6dc72b586903 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:18.750580 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bfa0bf50-f5a8-4060-a5dd-6dc72b586903 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:18.751134 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bfa0bf50-f5a8-4060-a5dd-6dc72b586903 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:18.751723 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bfa0bf50-f5a8-4060-a5dd-6dc72b586903 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:18.870079 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d397fb72-fd31-43a6-aee8-e153d6ad5f9c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:18.882508 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d397fb72-fd31-43a6-aee8-e153d6ad5f9c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1476 microversion: 2.1 time: 0.307374 Oct 26 13:07:18.884963 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 738/1385] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:18 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1476 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:19.010703 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f4837b3d-b30c-4c07-ba85-15d85b130673 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:19.031502 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f4837b3d-b30c-4c07-ba85-15d85b130673 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 3c9dbe46-9160-491b-9efd-074333ee4d8c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:19.055312 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4837b3d-b30c-4c07-ba85-15d85b130673 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:19.055875 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4837b3d-b30c-4c07-ba85-15d85b130673 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:19.056332 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4837b3d-b30c-4c07-ba85-15d85b130673 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:19.057513 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4837b3d-b30c-4c07-ba85-15d85b130673 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:19.057991 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4837b3d-b30c-4c07-ba85-15d85b130673 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:19.058425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4837b3d-b30c-4c07-ba85-15d85b130673 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:19.455423 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f4837b3d-b30c-4c07-ba85-15d85b130673 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:19.467869 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f4837b3d-b30c-4c07-ba85-15d85b130673 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/3c9dbe46-9160-491b-9efd-074333ee4d8c" status: 200 len: 1474 microversion: 2.1 time: 0.471314 Oct 26 13:07:19.470480 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 739/1386] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:18 2022] GET /compute/v2.1/servers/3c9dbe46-9160-491b-9efd-074333ee4d8c => generated 1474 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:19.479672 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c8c0b6a2-deed-4b76-b8ea-a7f430035279 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:19.480292 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c8c0b6a2-deed-4b76-b8ea-a7f430035279 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: 249cce52-de17-460b-b445-e24d0d377986] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:19.497778 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c8c0b6a2-deed-4b76-b8ea-a7f430035279 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:19.498778 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c8c0b6a2-deed-4b76-b8ea-a7f430035279 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:19.500851 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c8c0b6a2-deed-4b76-b8ea-a7f430035279 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:19.502240 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c8c0b6a2-deed-4b76-b8ea-a7f430035279 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:19.504122 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c8c0b6a2-deed-4b76-b8ea-a7f430035279 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:19.505807 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c8c0b6a2-deed-4b76-b8ea-a7f430035279 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:19.605535 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bfa0bf50-f5a8-4060-a5dd-6dc72b586903 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:19.623533 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bfa0bf50-f5a8-4060-a5dd-6dc72b586903 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:19.627265 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bfa0bf50-f5a8-4060-a5dd-6dc72b586903 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:19.631020 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bfa0bf50-f5a8-4060-a5dd-6dc72b586903 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924" status: 200 len: 1812 microversion: 2.25 time: 0.902132 Oct 26 13:07:19.631610 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 648/1387] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:07:18 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 => generated 1812 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:07:19.640038 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f783ccb5-6e6e-4401-bd07-eee83e253a7d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:19.646185 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f783ccb5-6e6e-4401-bd07-eee83e253a7d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:19.659634 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f783ccb5-6e6e-4401-bd07-eee83e253a7d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:19.661158 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f783ccb5-6e6e-4401-bd07-eee83e253a7d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:19.664477 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f783ccb5-6e6e-4401-bd07-eee83e253a7d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:19.665603 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f783ccb5-6e6e-4401-bd07-eee83e253a7d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:19.666262 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f783ccb5-6e6e-4401-bd07-eee83e253a7d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:19.668250 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f783ccb5-6e6e-4401-bd07-eee83e253a7d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:19.697346 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:07:19.735564 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c8c0b6a2-deed-4b76-b8ea-a7f430035279 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:19.753631 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c8c0b6a2-deed-4b76-b8ea-a7f430035279 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986" status: 200 len: 1426 microversion: 2.1 time: 0.280849 Oct 26 13:07:19.765519 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 740/1388] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:19 2022] GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986 => generated 1426 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:19.775112 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4e4ad6a2-e01e-473d-91c5-ff06ba30ae06 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:19.775112 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4e4ad6a2-e01e-473d-91c5-ff06ba30ae06 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: d426a4f6-fa08-47d2-a583-735600b77f27] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:19.784892 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e4ad6a2-e01e-473d-91c5-ff06ba30ae06 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:19.785537 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e4ad6a2-e01e-473d-91c5-ff06ba30ae06 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:19.786135 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e4ad6a2-e01e-473d-91c5-ff06ba30ae06 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:19.787003 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e4ad6a2-e01e-473d-91c5-ff06ba30ae06 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:19.787614 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e4ad6a2-e01e-473d-91c5-ff06ba30ae06 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:19.788152 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e4ad6a2-e01e-473d-91c5-ff06ba30ae06 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:20.109187 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4e4ad6a2-e01e-473d-91c5-ff06ba30ae06 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:20.126142 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4e4ad6a2-e01e-473d-91c5-ff06ba30ae06 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27" status: 200 len: 1308 microversion: 2.1 time: 0.362848 Oct 26 13:07:20.127181 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 741/1389] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:19 2022] GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27 => generated 1308 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:20.156837 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-616913b8-51dd-49e7-b5bf-ff5050c9ce15 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:20.157537 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-616913b8-51dd-49e7-b5bf-ff5050c9ce15 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 2803303a-ad72-4096-b524-69a583a56f03] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:20.177602 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-616913b8-51dd-49e7-b5bf-ff5050c9ce15 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:20.178625 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-616913b8-51dd-49e7-b5bf-ff5050c9ce15 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:20.179071 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-616913b8-51dd-49e7-b5bf-ff5050c9ce15 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:20.179903 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-616913b8-51dd-49e7-b5bf-ff5050c9ce15 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:20.180541 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-616913b8-51dd-49e7-b5bf-ff5050c9ce15 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:20.181012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-616913b8-51dd-49e7-b5bf-ff5050c9ce15 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:20.233042 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f783ccb5-6e6e-4401-bd07-eee83e253a7d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:20.253042 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f783ccb5-6e6e-4401-bd07-eee83e253a7d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1473 microversion: 2.1 time: 0.617459 Oct 26 13:07:20.253994 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 649/1390] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:19 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1473 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:20.266470 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0c969af5-5853-44da-a7b0-590c20c0b90e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:20.279308 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0c969af5-5853-44da-a7b0-590c20c0b90e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:20.289383 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c969af5-5853-44da-a7b0-590c20c0b90e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:20.290868 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c969af5-5853-44da-a7b0-590c20c0b90e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:20.291502 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c969af5-5853-44da-a7b0-590c20c0b90e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:20.292550 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c969af5-5853-44da-a7b0-590c20c0b90e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:20.293180 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c969af5-5853-44da-a7b0-590c20c0b90e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:20.293885 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c969af5-5853-44da-a7b0-590c20c0b90e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:20.477198 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-616913b8-51dd-49e7-b5bf-ff5050c9ce15 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:20.487528 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-616913b8-51dd-49e7-b5bf-ff5050c9ce15 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03" status: 200 len: 1539 microversion: 2.1 time: 0.359105 Oct 26 13:07:20.506891 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 742/1391] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:20 2022] GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03 => generated 1539 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:20.513021 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-a086c097-7674-4259-9010-1f0e1979a933 req-dba39808-c805-4938-bbb9-1f7f009330f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c9dbe46-9160-491b-9efd-074333ee4d8c", "name": "network-vif-deleted", "tag": "166b9e43-0e45-4f63-b683-f951ebddd062"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:20.525203 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-a086c097-7674-4259-9010-1f0e1979a933 req-dba39808-c805-4938-bbb9-1f7f009330f3 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:20.526068 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-a086c097-7674-4259-9010-1f0e1979a933 req-dba39808-c805-4938-bbb9-1f7f009330f3 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:20.526723 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-a086c097-7674-4259-9010-1f0e1979a933 req-dba39808-c805-4938-bbb9-1f7f009330f3 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:20.545833 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-a086c097-7674-4259-9010-1f0e1979a933 req-dba39808-c805-4938-bbb9-1f7f009330f3 service nova] Creating event network-vif-deleted:166b9e43-0e45-4f63-b683-f951ebddd062 for instance 3c9dbe46-9160-491b-9efd-074333ee4d8c on n-h1-862686-1 Oct 26 13:07:20.555769 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-a086c097-7674-4259-9010-1f0e1979a933 req-dba39808-c805-4938-bbb9-1f7f009330f3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046955 Oct 26 13:07:20.561612 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 743/1392] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:07:20.572433 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-f3e154b2-9e5f-429a-82fb-55c2adf7ef3c req-9df2eb8e-e6cf-486f-88e0-b66b3ed8da04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "249cce52-de17-460b-b445-e24d0d377986", "name": "network-vif-deleted", "tag": "63756a62-388c-4b3a-971b-3d8f25684ca1"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:20.587759 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f3e154b2-9e5f-429a-82fb-55c2adf7ef3c req-9df2eb8e-e6cf-486f-88e0-b66b3ed8da04 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:20.588599 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f3e154b2-9e5f-429a-82fb-55c2adf7ef3c req-9df2eb8e-e6cf-486f-88e0-b66b3ed8da04 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:20.589252 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f3e154b2-9e5f-429a-82fb-55c2adf7ef3c req-9df2eb8e-e6cf-486f-88e0-b66b3ed8da04 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:20.607287 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-f3e154b2-9e5f-429a-82fb-55c2adf7ef3c req-9df2eb8e-e6cf-486f-88e0-b66b3ed8da04 service nova] Creating event network-vif-deleted:63756a62-388c-4b3a-971b-3d8f25684ca1 for instance 249cce52-de17-460b-b445-e24d0d377986 on n-h1-862686-1 Oct 26 13:07:20.614786 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-f3e154b2-9e5f-429a-82fb-55c2adf7ef3c req-9df2eb8e-e6cf-486f-88e0-b66b3ed8da04 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050804 Oct 26 13:07:20.617711 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 744/1393] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:07:20.625401 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4d0272b9-916f-42fc-bec9-c3cd3d2a07d9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:20.626360 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4d0272b9-916f-42fc-bec9-c3cd3d2a07d9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 3c9dbe46-9160-491b-9efd-074333ee4d8c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:20.652536 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=50,nova_cell0:UPDATE=12 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:07:20.660287 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d0272b9-916f-42fc-bec9-c3cd3d2a07d9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:20.665461 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d0272b9-916f-42fc-bec9-c3cd3d2a07d9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:20.666387 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d0272b9-916f-42fc-bec9-c3cd3d2a07d9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:20.667577 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d0272b9-916f-42fc-bec9-c3cd3d2a07d9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:20.670948 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d0272b9-916f-42fc-bec9-c3cd3d2a07d9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:20.673986 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d0272b9-916f-42fc-bec9-c3cd3d2a07d9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:20.754560 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0c969af5-5853-44da-a7b0-590c20c0b90e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:20.770419 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d0272b9-916f-42fc-bec9-c3cd3d2a07d9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:20.770993 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0c969af5-5853-44da-a7b0-590c20c0b90e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1476 microversion: 2.1 time: 0.513387 Oct 26 13:07:20.773929 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 650/1394] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:20 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1476 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:20.783944 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-06dfa47f-386e-4164-8b9d-8ea6480cc3b8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:20.786766 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-06dfa47f-386e-4164-8b9d-8ea6480cc3b8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:20.793552 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d0272b9-916f-42fc-bec9-c3cd3d2a07d9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:20.794160 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d0272b9-916f-42fc-bec9-c3cd3d2a07d9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:20.795027 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-4d0272b9-916f-42fc-bec9-c3cd3d2a07d9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lazy-loading 'fault' on Instance uuid 3c9dbe46-9160-491b-9efd-074333ee4d8c {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:07:20.801893 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-06dfa47f-386e-4164-8b9d-8ea6480cc3b8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:20.803754 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-06dfa47f-386e-4164-8b9d-8ea6480cc3b8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:20.805362 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-06dfa47f-386e-4164-8b9d-8ea6480cc3b8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:20.806358 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-06dfa47f-386e-4164-8b9d-8ea6480cc3b8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:20.806989 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-06dfa47f-386e-4164-8b9d-8ea6480cc3b8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:20.807607 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-06dfa47f-386e-4164-8b9d-8ea6480cc3b8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:21.025839 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4d0272b9-916f-42fc-bec9-c3cd3d2a07d9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:21.043314 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4d0272b9-916f-42fc-bec9-c3cd3d2a07d9 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/3c9dbe46-9160-491b-9efd-074333ee4d8c" status: 200 len: 1309 microversion: 2.1 time: 0.423293 Oct 26 13:07:21.049530 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 745/1395] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:20 2022] GET /compute/v2.1/servers/3c9dbe46-9160-491b-9efd-074333ee4d8c => generated 1309 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:21.068973 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=10 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:07:21.085236 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-b3d1102d-21a4-448f-8e87-e0df2bc7b081 req-49d9c91c-307d-43d8-a534-37e195f38ad2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fc68c75-8598-4bc7-b96b-852f31f09781", "name": "network-vif-unplugged", "status": "completed", "tag": "641e149d-ea99-4cba-8bd0-b9368f1e4296"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:21.122280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b3d1102d-21a4-448f-8e87-e0df2bc7b081 req-49d9c91c-307d-43d8-a534-37e195f38ad2 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:21.125456 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b3d1102d-21a4-448f-8e87-e0df2bc7b081 req-49d9c91c-307d-43d8-a534-37e195f38ad2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:21.126659 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b3d1102d-21a4-448f-8e87-e0df2bc7b081 req-49d9c91c-307d-43d8-a534-37e195f38ad2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:21.180100 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-b3d1102d-21a4-448f-8e87-e0df2bc7b081 req-49d9c91c-307d-43d8-a534-37e195f38ad2 service nova] Creating event network-vif-unplugged:641e149d-ea99-4cba-8bd0-b9368f1e4296 for instance 7fc68c75-8598-4bc7-b96b-852f31f09781 on n-h1-862686-1 Oct 26 13:07:21.189751 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-b3d1102d-21a4-448f-8e87-e0df2bc7b081 req-49d9c91c-307d-43d8-a534-37e195f38ad2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.136360 Oct 26 13:07:21.201120 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 746/1396] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:07:21.216930 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4fc06646-e9d7-4d17-b2c0-5417081173f3 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:21.219518 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4fc06646-e9d7-4d17-b2c0-5417081173f3 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: 249cce52-de17-460b-b445-e24d0d377986] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:21.243983 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=10 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:07:21.248849 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4fc06646-e9d7-4d17-b2c0-5417081173f3 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:21.250624 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4fc06646-e9d7-4d17-b2c0-5417081173f3 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:21.252188 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4fc06646-e9d7-4d17-b2c0-5417081173f3 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:21.254136 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4fc06646-e9d7-4d17-b2c0-5417081173f3 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:21.255532 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4fc06646-e9d7-4d17-b2c0-5417081173f3 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:21.256648 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4fc06646-e9d7-4d17-b2c0-5417081173f3 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:21.324759 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-06dfa47f-386e-4164-8b9d-8ea6480cc3b8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:21.346003 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4fc06646-e9d7-4d17-b2c0-5417081173f3 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:21.346672 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-06dfa47f-386e-4164-8b9d-8ea6480cc3b8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:21.346855 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4fc06646-e9d7-4d17-b2c0-5417081173f3 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:21.347408 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4fc06646-e9d7-4d17-b2c0-5417081173f3 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:21.349331 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-4fc06646-e9d7-4d17-b2c0-5417081173f3 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lazy-loading 'fault' on Instance uuid 249cce52-de17-460b-b445-e24d0d377986 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:07:21.349462 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-06dfa47f-386e-4164-8b9d-8ea6480cc3b8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:21.357964 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-06dfa47f-386e-4164-8b9d-8ea6480cc3b8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924" status: 200 len: 1812 microversion: 2.25 time: 0.582489 Oct 26 13:07:21.358936 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 651/1397] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:07:20 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 => generated 1812 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:07:21.363854 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a7fe9721-ff35-445d-9f05-89276013cb1f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:21.364463 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a7fe9721-ff35-445d-9f05-89276013cb1f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: d426a4f6-fa08-47d2-a583-735600b77f27] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:21.403207 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7fe9721-ff35-445d-9f05-89276013cb1f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:21.405742 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7fe9721-ff35-445d-9f05-89276013cb1f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:21.406465 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7fe9721-ff35-445d-9f05-89276013cb1f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:21.407433 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7fe9721-ff35-445d-9f05-89276013cb1f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:21.408188 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7fe9721-ff35-445d-9f05-89276013cb1f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:21.409514 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7fe9721-ff35-445d-9f05-89276013cb1f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:21.518084 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4fc06646-e9d7-4d17-b2c0-5417081173f3 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:21.531660 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4fc06646-e9d7-4d17-b2c0-5417081173f3 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986" status: 200 len: 1312 microversion: 2.1 time: 0.326308 Oct 26 13:07:21.532886 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 747/1398] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:21 2022] GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986 => generated 1312 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:21.551969 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-27c0ff5b-4722-49a2-856d-fcd7c0274434 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:21.555454 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-27c0ff5b-4722-49a2-856d-fcd7c0274434 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:21.569598 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-27c0ff5b-4722-49a2-856d-fcd7c0274434 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:21.570974 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-27c0ff5b-4722-49a2-856d-fcd7c0274434 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:21.571592 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-27c0ff5b-4722-49a2-856d-fcd7c0274434 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:21.572505 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-27c0ff5b-4722-49a2-856d-fcd7c0274434 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:21.573872 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-27c0ff5b-4722-49a2-856d-fcd7c0274434 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:21.574535 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-27c0ff5b-4722-49a2-856d-fcd7c0274434 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:21.618816 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:07:21.679294 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a7fe9721-ff35-445d-9f05-89276013cb1f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:21.688044 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a7fe9721-ff35-445d-9f05-89276013cb1f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27" status: 200 len: 1308 microversion: 2.1 time: 0.327899 Oct 26 13:07:21.702085 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 652/1399] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:21 2022] GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27 => generated 1308 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:21.709844 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-22d80157-d2e6-4049-8b77-bd03ffd3dd91 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:21.710568 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-22d80157-d2e6-4049-8b77-bd03ffd3dd91 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 2803303a-ad72-4096-b524-69a583a56f03] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:21.716841 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22d80157-d2e6-4049-8b77-bd03ffd3dd91 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:21.717623 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22d80157-d2e6-4049-8b77-bd03ffd3dd91 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:21.718258 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22d80157-d2e6-4049-8b77-bd03ffd3dd91 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:21.719127 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22d80157-d2e6-4049-8b77-bd03ffd3dd91 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:21.719744 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22d80157-d2e6-4049-8b77-bd03ffd3dd91 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:21.720334 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22d80157-d2e6-4049-8b77-bd03ffd3dd91 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:21.818204 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-27c0ff5b-4722-49a2-856d-fcd7c0274434 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:21.826547 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-27c0ff5b-4722-49a2-856d-fcd7c0274434 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1473 microversion: 2.1 time: 0.292490 Oct 26 13:07:21.830459 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 748/1400] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:21 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1473 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:21.839977 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7a584b11-843d-44d4-a958-644e89e13c74 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:21.840613 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7a584b11-843d-44d4-a958-644e89e13c74 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:21.865274 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a584b11-843d-44d4-a958-644e89e13c74 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:21.866522 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a584b11-843d-44d4-a958-644e89e13c74 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:21.867988 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a584b11-843d-44d4-a958-644e89e13c74 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:21.867988 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a584b11-843d-44d4-a958-644e89e13c74 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:21.887795 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a584b11-843d-44d4-a958-644e89e13c74 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:21.888317 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a584b11-843d-44d4-a958-644e89e13c74 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:21.915494 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-22d80157-d2e6-4049-8b77-bd03ffd3dd91 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:21.924298 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-22d80157-d2e6-4049-8b77-bd03ffd3dd91 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03" status: 200 len: 1521 microversion: 2.1 time: 0.221022 Oct 26 13:07:21.926782 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 653/1401] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:21 2022] GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:21.955549 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6b5ff70e-13a7-4aca-8407-ada09dab5c67 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:21.956060 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6b5ff70e-13a7-4aca-8407-ada09dab5c67 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 2803303a-ad72-4096-b524-69a583a56f03] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:21.970933 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b5ff70e-13a7-4aca-8407-ada09dab5c67 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:21.971497 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b5ff70e-13a7-4aca-8407-ada09dab5c67 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:21.971944 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b5ff70e-13a7-4aca-8407-ada09dab5c67 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:21.972851 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b5ff70e-13a7-4aca-8407-ada09dab5c67 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:21.973375 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b5ff70e-13a7-4aca-8407-ada09dab5c67 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:21.974439 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b5ff70e-13a7-4aca-8407-ada09dab5c67 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:22.072156 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6b5ff70e-13a7-4aca-8407-ada09dab5c67 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 2803303a-ad72-4096-b524-69a583a56f03] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:07:22.248954 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6b5ff70e-13a7-4aca-8407-ada09dab5c67 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03" status: 204 len: 0 microversion: 2.1 time: 0.300169 Oct 26 13:07:22.255266 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 654/1402] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:07:21 2022] DELETE /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:07:22.264688 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-55dc66bd-86d5-42e0-92f8-465c0995b356 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:22.265523 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-55dc66bd-86d5-42e0-92f8-465c0995b356 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 3c9dbe46-9160-491b-9efd-074333ee4d8c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:22.275716 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-55dc66bd-86d5-42e0-92f8-465c0995b356 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:22.276253 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-55dc66bd-86d5-42e0-92f8-465c0995b356 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:22.276695 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-55dc66bd-86d5-42e0-92f8-465c0995b356 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:22.277412 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-55dc66bd-86d5-42e0-92f8-465c0995b356 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:22.277898 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-55dc66bd-86d5-42e0-92f8-465c0995b356 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:22.278328 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-55dc66bd-86d5-42e0-92f8-465c0995b356 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:22.294054 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-55dc66bd-86d5-42e0-92f8-465c0995b356 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] HTTP exception thrown: Instance 3c9dbe46-9160-491b-9efd-074333ee4d8c could not be found. Oct 26 13:07:22.296359 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-55dc66bd-86d5-42e0-92f8-465c0995b356 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Request method failure captured: Oct 26 13:07:22.296359 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/3c9dbe46-9160-491b-9efd-074333ee4d8c HTTP/1.1 Oct 26 13:07:22.296359 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:07:22.296359 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:07:22.296359 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:07:22.296359 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:07:22.296359 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:07:22.296359 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:07:22.296359 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:07:22.296359 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:07:22.296359 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTBPRVt_8YZnaMSFiptNqbU9QNU93-_uVsnIl5oPaIxTkieW3pGz0zJKB63vkS1UTm30oE-_Ib6tVEIUcfod49uJs_R6L4h_NtP5w4W8pi8x5J4f1QqVVXViMhIM2rv6Z6M-Vnp8kRHMISIYhq0EFTwFrWnXPDyjXTUbEUwh3-ynQvQ Oct 26 13:07:22.296359 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:07:22.296359 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:07:22.296359 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:07:22.296359 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:07:22.296359 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:07:22.296359 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:07:22.296359 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: d6515917885c4f3cb5fb19e05f4e5e2b Oct 26 13:07:22.296359 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersOnMultiNodesTest-1287428008 Oct 26 13:07:22.296359 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:07:22.296359 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:07:22.298173 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d6515917885c4f3cb5fb19e05f4e5e2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d6515917885c4f3cb5fb19e05f4e5e2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d6515917885c4f3cb5fb19e05f4e5e2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d6515917885c4f3cb5fb19e05f4e5e2b"}]}] Oct 26 13:07:22.298173 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersOnMultiNodesTest-1287428008 Oct 26 13:07:22.298173 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: d6515917885c4f3cb5fb19e05f4e5e2b Oct 26 13:07:22.298173 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1287428008 Oct 26 13:07:22.298173 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersOnMultiNodesTest-1287428008-project Oct 26 13:07:22.298173 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:07:22.298173 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:07:22.298173 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: b6cddfeca4ce49788143b2bf4b30545f Oct 26 13:07:22.298173 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersOnMultiNodesTest-1287428008-project Oct 26 13:07:22.298173 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:07:22.298173 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 3c9dbe46-9160-491b-9efd-074333ee4d8c could not be found. Oct 26 13:07:22.298173 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '3c9dbe46-9160-491b-9efd-074333ee4d8c'} Oct 26 13:07:22.299021 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:07:22.299021 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:22.299021 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:07:22.299021 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:07:22.299021 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:07:22.299021 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:07:22.299021 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:07:22.299021 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:07:22.299021 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:07:22.299021 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:07:22.299021 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c9dbe46-9160-491b-9efd-074333ee4d8c could not be found. Oct 26 13:07:22.299021 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:22.299021 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:22.299021 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:22.299021 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:22.299021 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:22.299021 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:22.299021 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:07:22.299021 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:07:22.299021 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:07:22.300248 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:07:22.300248 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:07:22.300248 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:07:22.300248 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:07:22.300248 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:07:22.300248 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:07:22.300248 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:07:22.300248 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c9dbe46-9160-491b-9efd-074333ee4d8c could not be found. Oct 26 13:07:22.300248 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:22.300248 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:22.300248 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:22.300248 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:22.300248 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:22.300248 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:22.300248 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:07:22.300248 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:07:22.300248 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c9dbe46-9160-491b-9efd-074333ee4d8c could not be found. Oct 26 13:07:22.300248 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:22.301410 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-55dc66bd-86d5-42e0-92f8-465c0995b356 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Returning 404 to user: Instance 3c9dbe46-9160-491b-9efd-074333ee4d8c could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:07:22.301410 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-55dc66bd-86d5-42e0-92f8-465c0995b356 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/3c9dbe46-9160-491b-9efd-074333ee4d8c" status: 404 len: 111 microversion: 2.1 time: 0.040756 Oct 26 13:07:22.301410 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 655/1403] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:22 2022] GET /compute/v2.1/servers/3c9dbe46-9160-491b-9efd-074333ee4d8c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:07:22.304087 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-becc39f5-5e21-4b74-96ad-72d7a0adcc10 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:22.304790 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-becc39f5-5e21-4b74-96ad-72d7a0adcc10 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 2803303a-ad72-4096-b524-69a583a56f03] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:22.311247 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-becc39f5-5e21-4b74-96ad-72d7a0adcc10 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:22.311784 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-becc39f5-5e21-4b74-96ad-72d7a0adcc10 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:22.312302 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-becc39f5-5e21-4b74-96ad-72d7a0adcc10 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:22.313019 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-becc39f5-5e21-4b74-96ad-72d7a0adcc10 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:22.313580 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-becc39f5-5e21-4b74-96ad-72d7a0adcc10 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:22.314018 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-becc39f5-5e21-4b74-96ad-72d7a0adcc10 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:22.374290 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7a584b11-843d-44d4-a958-644e89e13c74 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:22.382793 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7a584b11-843d-44d4-a958-644e89e13c74 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1476 microversion: 2.1 time: 0.551188 Oct 26 13:07:22.383888 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 749/1404] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:21 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1476 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:22.388635 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d6b06524-55e2-4dc5-b001-4c9528c927df tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:22.389538 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d6b06524-55e2-4dc5-b001-4c9528c927df tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 2358d550-6ed6-4529-b268-ffdf82f228ff] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:22.396395 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6b06524-55e2-4dc5-b001-4c9528c927df tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:22.397913 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6b06524-55e2-4dc5-b001-4c9528c927df tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:22.398637 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6b06524-55e2-4dc5-b001-4c9528c927df tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:22.399575 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6b06524-55e2-4dc5-b001-4c9528c927df tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:22.400221 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6b06524-55e2-4dc5-b001-4c9528c927df tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:22.400832 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6b06524-55e2-4dc5-b001-4c9528c927df tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:22.418412 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-d6b06524-55e2-4dc5-b001-4c9528c927df tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] HTTP exception thrown: Instance 2358d550-6ed6-4529-b268-ffdf82f228ff could not be found. Oct 26 13:07:22.421047 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d6b06524-55e2-4dc5-b001-4c9528c927df tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Request method failure captured: Oct 26 13:07:22.421047 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/2358d550-6ed6-4529-b268-ffdf82f228ff HTTP/1.1 Oct 26 13:07:22.421047 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:07:22.421047 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:07:22.421047 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:07:22.421047 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:07:22.421047 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:07:22.421047 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:07:22.421047 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:07:22.421047 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:07:22.421047 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTBPRVt_8YZnaMSFiptNqbU9QNU93-_uVsnIl5oPaIxTkieW3pGz0zJKB63vkS1UTm30oE-_Ib6tVEIUcfod49uJs_R6L4h_NtP5w4W8pi8x5J4f1QqVVXViMhIM2rv6Z6M-Vnp8kRHMISIYhq0EFTwFrWnXPDyjXTUbEUwh3-ynQvQ Oct 26 13:07:22.421047 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:07:22.421047 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:07:22.421047 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:07:22.421047 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:07:22.421047 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:07:22.421047 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:07:22.421047 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: d6515917885c4f3cb5fb19e05f4e5e2b Oct 26 13:07:22.421047 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersOnMultiNodesTest-1287428008 Oct 26 13:07:22.421047 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:07:22.421047 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:07:22.422454 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d6515917885c4f3cb5fb19e05f4e5e2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d6515917885c4f3cb5fb19e05f4e5e2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d6515917885c4f3cb5fb19e05f4e5e2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d6515917885c4f3cb5fb19e05f4e5e2b"}]}] Oct 26 13:07:22.422454 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersOnMultiNodesTest-1287428008 Oct 26 13:07:22.422454 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: d6515917885c4f3cb5fb19e05f4e5e2b Oct 26 13:07:22.422454 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1287428008 Oct 26 13:07:22.422454 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersOnMultiNodesTest-1287428008-project Oct 26 13:07:22.422454 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:07:22.422454 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:07:22.422454 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: b6cddfeca4ce49788143b2bf4b30545f Oct 26 13:07:22.422454 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersOnMultiNodesTest-1287428008-project Oct 26 13:07:22.422454 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:07:22.422454 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 2358d550-6ed6-4529-b268-ffdf82f228ff could not be found. Oct 26 13:07:22.422454 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '2358d550-6ed6-4529-b268-ffdf82f228ff'} Oct 26 13:07:22.423193 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:07:22.423193 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:22.423193 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:07:22.423193 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:07:22.423193 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:07:22.423193 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:07:22.423193 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:07:22.423193 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:07:22.423193 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:07:22.423193 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:07:22.423193 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2358d550-6ed6-4529-b268-ffdf82f228ff could not be found. Oct 26 13:07:22.423193 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:22.423193 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:22.423193 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:22.423193 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:22.423193 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:22.423193 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:22.423193 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:07:22.423193 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:07:22.423193 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:07:22.424417 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:07:22.424417 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:07:22.424417 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:07:22.424417 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:07:22.424417 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:07:22.424417 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:07:22.424417 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:07:22.424417 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2358d550-6ed6-4529-b268-ffdf82f228ff could not be found. Oct 26 13:07:22.424417 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:22.424417 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:22.424417 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:22.424417 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:22.424417 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:22.424417 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:22.424417 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:07:22.424417 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:07:22.424417 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2358d550-6ed6-4529-b268-ffdf82f228ff could not be found. Oct 26 13:07:22.424417 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:22.427683 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d6b06524-55e2-4dc5-b001-4c9528c927df tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Returning 404 to user: Instance 2358d550-6ed6-4529-b268-ffdf82f228ff could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:07:22.428840 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d6b06524-55e2-4dc5-b001-4c9528c927df tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/2358d550-6ed6-4529-b268-ffdf82f228ff" status: 404 len: 111 microversion: 2.1 time: 0.043801 Oct 26 13:07:22.429927 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 750/1405] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:22 2022] GET /compute/v2.1/servers/2358d550-6ed6-4529-b268-ffdf82f228ff => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:07:22.436707 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-054de4f2-91b2-4051-9057-9298688a2268 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:22.437321 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-054de4f2-91b2-4051-9057-9298688a2268 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:22.443185 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-054de4f2-91b2-4051-9057-9298688a2268 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:22.443700 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-054de4f2-91b2-4051-9057-9298688a2268 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:22.444131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-054de4f2-91b2-4051-9057-9298688a2268 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:22.444827 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-054de4f2-91b2-4051-9057-9298688a2268 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:22.445275 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-054de4f2-91b2-4051-9057-9298688a2268 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:22.445780 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-054de4f2-91b2-4051-9057-9298688a2268 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:22.508314 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-becc39f5-5e21-4b74-96ad-72d7a0adcc10 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:22.516555 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-becc39f5-5e21-4b74-96ad-72d7a0adcc10 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03" status: 200 len: 1527 microversion: 2.1 time: 0.216051 Oct 26 13:07:22.521551 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 656/1406] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:22 2022] GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03 => generated 1527 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:22.521991 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8ad72442-6e0e-4516-b217-8d46bafe959c tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:22.559470 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8ad72442-6e0e-4516-b217-8d46bafe959c tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/a574f105-f9c7-4f29-b8cf-d00793343b3a" status: 204 len: 0 microversion: 2.1 time: 0.040802 Oct 26 13:07:22.560572 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 657/1407] 10.222.0.40 () {58 vars in 1266 bytes} [Wed Oct 26 13:07:22 2022] DELETE /compute/v2.1/os-server-groups/a574f105-f9c7-4f29-b8cf-d00793343b3a => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:07:22.567749 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-900b0904-16d0-43e3-a6c0-a9c03c3b8701 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:22.569508 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-900b0904-16d0-43e3-a6c0-a9c03c3b8701 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: 249cce52-de17-460b-b445-e24d0d377986] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:22.576394 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-900b0904-16d0-43e3-a6c0-a9c03c3b8701 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:22.577267 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-900b0904-16d0-43e3-a6c0-a9c03c3b8701 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:22.577989 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-900b0904-16d0-43e3-a6c0-a9c03c3b8701 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:22.579152 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-900b0904-16d0-43e3-a6c0-a9c03c3b8701 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:22.579984 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-900b0904-16d0-43e3-a6c0-a9c03c3b8701 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:22.580655 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-900b0904-16d0-43e3-a6c0-a9c03c3b8701 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:22.599238 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-900b0904-16d0-43e3-a6c0-a9c03c3b8701 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] HTTP exception thrown: Instance 249cce52-de17-460b-b445-e24d0d377986 could not be found. Oct 26 13:07:22.601635 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-900b0904-16d0-43e3-a6c0-a9c03c3b8701 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Request method failure captured: Oct 26 13:07:22.601635 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986 HTTP/1.1 Oct 26 13:07:22.601635 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:07:22.601635 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:07:22.601635 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:07:22.601635 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:07:22.601635 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:07:22.601635 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:07:22.601635 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:07:22.601635 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:07:22.601635 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTCzjU02WwlPIn0go9tFuSgvGoJ4tyXs08GsUfBt3wSbVdEw-a3jjvA47LU7fEM54SECBUXriSwAA_YRmorzEZ5qxZdXj1_GcRadDBJylUQ6zNRBEzaU7c7J_rfvYbtLW_-foYvLQKzbq2qLZrnkVwP47m44RWkpP7FcaMZXP7gLNNo Oct 26 13:07:22.601635 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:07:22.601635 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:07:22.601635 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:07:22.601635 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:07:22.601635 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:07:22.601635 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:07:22.601635 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 3a46daa2d3a043488473b65f18ebfefe Oct 26 13:07:22.601635 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-394142580 Oct 26 13:07:22.601635 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:07:22.601635 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:07:22.603001 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3a46daa2d3a043488473b65f18ebfefe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3a46daa2d3a043488473b65f18ebfefe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3a46daa2d3a043488473b65f18ebfefe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3a46daa2d3a043488473b65f18ebfefe"}]}] Oct 26 13:07:22.603001 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersAdminNegativeTestJSON-394142580 Oct 26 13:07:22.603001 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 3a46daa2d3a043488473b65f18ebfefe Oct 26 13:07:22.603001 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-394142580 Oct 26 13:07:22.603001 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersAdminNegativeTestJSON-394142580-project Oct 26 13:07:22.603001 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:07:22.603001 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:07:22.603001 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 71de4f9fbfb94d7da473e93e42591c5a Oct 26 13:07:22.603001 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersAdminNegativeTestJSON-394142580-project Oct 26 13:07:22.603001 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:07:22.603001 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 249cce52-de17-460b-b445-e24d0d377986 could not be found. Oct 26 13:07:22.603001 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '249cce52-de17-460b-b445-e24d0d377986'} Oct 26 13:07:22.603804 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:07:22.603804 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:22.603804 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:07:22.603804 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:07:22.603804 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:07:22.603804 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:07:22.603804 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:07:22.603804 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:07:22.603804 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:07:22.603804 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:07:22.603804 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 249cce52-de17-460b-b445-e24d0d377986 could not be found. Oct 26 13:07:22.603804 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:22.603804 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:22.603804 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:22.603804 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:22.603804 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:22.603804 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:22.603804 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:07:22.603804 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:07:22.603804 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:07:22.605089 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:07:22.605089 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:07:22.605089 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:07:22.605089 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:07:22.605089 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:07:22.605089 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:07:22.605089 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:07:22.605089 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 249cce52-de17-460b-b445-e24d0d377986 could not be found. Oct 26 13:07:22.605089 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:22.605089 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:22.605089 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:22.605089 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:22.605089 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:22.605089 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:22.605089 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:07:22.605089 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:07:22.605089 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 249cce52-de17-460b-b445-e24d0d377986 could not be found. Oct 26 13:07:22.605089 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:22.606282 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-900b0904-16d0-43e3-a6c0-a9c03c3b8701 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Returning 404 to user: Instance 249cce52-de17-460b-b445-e24d0d377986 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:07:22.606282 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-900b0904-16d0-43e3-a6c0-a9c03c3b8701 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986" status: 404 len: 111 microversion: 2.1 time: 0.041435 Oct 26 13:07:22.606282 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 658/1408] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:22 2022] GET /compute/v2.1/servers/249cce52-de17-460b-b445-e24d0d377986 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:07:22.610216 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8420a3da-6e3f-447c-8474-48cce0821d67 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:22.610870 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8420a3da-6e3f-447c-8474-48cce0821d67 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 60c4cea5-3b00-4614-a70d-e3fd589cc408] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:22.618836 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8420a3da-6e3f-447c-8474-48cce0821d67 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:22.619332 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8420a3da-6e3f-447c-8474-48cce0821d67 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:22.619771 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8420a3da-6e3f-447c-8474-48cce0821d67 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:22.620981 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8420a3da-6e3f-447c-8474-48cce0821d67 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:22.621444 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8420a3da-6e3f-447c-8474-48cce0821d67 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:22.621908 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8420a3da-6e3f-447c-8474-48cce0821d67 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:22.637314 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-054de4f2-91b2-4051-9057-9298688a2268 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:22.647198 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-054de4f2-91b2-4051-9057-9298688a2268 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:22.648800 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-054de4f2-91b2-4051-9057-9298688a2268 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:22.650174 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-054de4f2-91b2-4051-9057-9298688a2268 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924" status: 200 len: 1812 microversion: 2.25 time: 0.218389 Oct 26 13:07:22.651177 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 751/1409] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:07:22 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 => generated 1812 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:07:22.656816 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-65b698b4-6090-4c94-b903-af9afed93f64 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:22.657660 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-65b698b4-6090-4c94-b903-af9afed93f64 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:22.671886 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65b698b4-6090-4c94-b903-af9afed93f64 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:22.672931 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65b698b4-6090-4c94-b903-af9afed93f64 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:22.675866 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65b698b4-6090-4c94-b903-af9afed93f64 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:22.676500 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8420a3da-6e3f-447c-8474-48cce0821d67 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 60c4cea5-3b00-4614-a70d-e3fd589cc408] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:07:22.676648 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65b698b4-6090-4c94-b903-af9afed93f64 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:22.677105 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65b698b4-6090-4c94-b903-af9afed93f64 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:22.677600 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65b698b4-6090-4c94-b903-af9afed93f64 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:22.719527 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-65b698b4-6090-4c94-b903-af9afed93f64 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:07:22.793057 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8420a3da-6e3f-447c-8474-48cce0821d67 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "DELETE /compute/v2.1/servers/60c4cea5-3b00-4614-a70d-e3fd589cc408" status: 204 len: 0 microversion: 2.1 time: 0.187217 Oct 26 13:07:22.793748 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 659/1410] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:07:22 2022] DELETE /compute/v2.1/servers/60c4cea5-3b00-4614-a70d-e3fd589cc408 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:07:22.800576 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-e143449c-bb77-44de-b1c0-b59008775c72 req-06952fe5-ac0a-4e19-a536-18b4f5fc12d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fc68c75-8598-4bc7-b96b-852f31f09781", "name": "network-vif-deleted", "tag": "641e149d-ea99-4cba-8bd0-b9368f1e4296"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:22.815272 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-e143449c-bb77-44de-b1c0-b59008775c72 req-06952fe5-ac0a-4e19-a536-18b4f5fc12d1 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:22.817257 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-e143449c-bb77-44de-b1c0-b59008775c72 req-06952fe5-ac0a-4e19-a536-18b4f5fc12d1 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:22.817772 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-e143449c-bb77-44de-b1c0-b59008775c72 req-06952fe5-ac0a-4e19-a536-18b4f5fc12d1 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:22.834190 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-e143449c-bb77-44de-b1c0-b59008775c72 req-06952fe5-ac0a-4e19-a536-18b4f5fc12d1 service nova] Creating event network-vif-deleted:641e149d-ea99-4cba-8bd0-b9368f1e4296 for instance 7fc68c75-8598-4bc7-b96b-852f31f09781 on n-h1-862686-1 Oct 26 13:07:22.839337 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-e143449c-bb77-44de-b1c0-b59008775c72 req-06952fe5-ac0a-4e19-a536-18b4f5fc12d1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044133 Oct 26 13:07:22.840282 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 660/1411] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:07:22.845772 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bbddffd5-930d-4ddb-b717-3dda76fbba6f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:22.846486 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bbddffd5-930d-4ddb-b717-3dda76fbba6f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: d426a4f6-fa08-47d2-a583-735600b77f27] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:22.855013 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bbddffd5-930d-4ddb-b717-3dda76fbba6f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:22.855520 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bbddffd5-930d-4ddb-b717-3dda76fbba6f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:22.856104 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bbddffd5-930d-4ddb-b717-3dda76fbba6f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:22.856830 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bbddffd5-930d-4ddb-b717-3dda76fbba6f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:22.857293 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bbddffd5-930d-4ddb-b717-3dda76fbba6f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:22.857908 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bbddffd5-930d-4ddb-b717-3dda76fbba6f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:22.880406 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-65b698b4-6090-4c94-b903-af9afed93f64 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "DELETE /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904" status: 204 len: 0 microversion: 2.1 time: 0.226003 Oct 26 13:07:22.880524 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 752/1412] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:07:22 2022] DELETE /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:07:22.885946 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ddc00902-c1a7-48cc-95ec-8c5fab25c75e tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:22.886852 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ddc00902-c1a7-48cc-95ec-8c5fab25c75e tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 025e46ee-bd4b-4c43-96ce-ee086ecafe24] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:22.894555 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ddc00902-c1a7-48cc-95ec-8c5fab25c75e tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:22.895566 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ddc00902-c1a7-48cc-95ec-8c5fab25c75e tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:22.896351 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ddc00902-c1a7-48cc-95ec-8c5fab25c75e tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:22.898132 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ddc00902-c1a7-48cc-95ec-8c5fab25c75e tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:22.898802 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ddc00902-c1a7-48cc-95ec-8c5fab25c75e tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:22.899421 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ddc00902-c1a7-48cc-95ec-8c5fab25c75e tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:22.942810 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ddc00902-c1a7-48cc-95ec-8c5fab25c75e tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 025e46ee-bd4b-4c43-96ce-ee086ecafe24] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:07:23.085187 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bbddffd5-930d-4ddb-b717-3dda76fbba6f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:23.094907 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bbddffd5-930d-4ddb-b717-3dda76fbba6f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27" status: 200 len: 1308 microversion: 2.1 time: 0.253291 Oct 26 13:07:23.101541 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 661/1413] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:22 2022] GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27 => generated 1308 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:23.107470 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1aa95d16-dd39-46d8-9001-8abccd5908ff tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:23.109013 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1aa95d16-dd39-46d8-9001-8abccd5908ff tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:23.123339 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ddc00902-c1a7-48cc-95ec-8c5fab25c75e tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "DELETE /compute/v2.1/servers/025e46ee-bd4b-4c43-96ce-ee086ecafe24" status: 204 len: 0 microversion: 2.1 time: 0.238915 Oct 26 13:07:23.123974 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 753/1414] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:07:22 2022] DELETE /compute/v2.1/servers/025e46ee-bd4b-4c43-96ce-ee086ecafe24 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:07:23.130688 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1aa95d16-dd39-46d8-9001-8abccd5908ff tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:23.132081 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1aa95d16-dd39-46d8-9001-8abccd5908ff tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:23.132525 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1aa95d16-dd39-46d8-9001-8abccd5908ff tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:23.146066 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1aa95d16-dd39-46d8-9001-8abccd5908ff tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:23.146601 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1aa95d16-dd39-46d8-9001-8abccd5908ff tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:23.147199 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1aa95d16-dd39-46d8-9001-8abccd5908ff tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:23.147794 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b8f5c593-5a6a-48d2-bf44-ca43b3f405b1 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:23.151788 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b8f5c593-5a6a-48d2-bf44-ca43b3f405b1 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:23.162715 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b8f5c593-5a6a-48d2-bf44-ca43b3f405b1 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:23.166540 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b8f5c593-5a6a-48d2-bf44-ca43b3f405b1 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:23.167284 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b8f5c593-5a6a-48d2-bf44-ca43b3f405b1 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:23.171717 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b8f5c593-5a6a-48d2-bf44-ca43b3f405b1 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:23.175058 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b8f5c593-5a6a-48d2-bf44-ca43b3f405b1 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:23.175623 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b8f5c593-5a6a-48d2-bf44-ca43b3f405b1 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:23.308985 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1aa95d16-dd39-46d8-9001-8abccd5908ff tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:23.320500 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1aa95d16-dd39-46d8-9001-8abccd5908ff tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1473 microversion: 2.1 time: 0.217295 Oct 26 13:07:23.321722 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 662/1415] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:23 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1473 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:23.327343 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c74f2a73-0402-455e-a219-cce006725649 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:23.328077 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c74f2a73-0402-455e-a219-cce006725649 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 60c4cea5-3b00-4614-a70d-e3fd589cc408] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:23.338450 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c74f2a73-0402-455e-a219-cce006725649 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:23.339269 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c74f2a73-0402-455e-a219-cce006725649 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:23.339958 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c74f2a73-0402-455e-a219-cce006725649 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:23.341037 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c74f2a73-0402-455e-a219-cce006725649 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:23.341737 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c74f2a73-0402-455e-a219-cce006725649 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:23.342382 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c74f2a73-0402-455e-a219-cce006725649 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:23.441040 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b8f5c593-5a6a-48d2-bf44-ca43b3f405b1 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:23.451724 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b8f5c593-5a6a-48d2-bf44-ca43b3f405b1 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904" status: 200 len: 1477 microversion: 2.1 time: 0.325112 Oct 26 13:07:23.452471 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 754/1416] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:23 2022] GET /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904 => generated 1477 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:23.459079 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-9cf5be4a-21ae-4d38-b02f-e5afc5de438f req-d3480749-aa51-44b4-9bed-31197e4da62b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2803303a-ad72-4096-b524-69a583a56f03", "name": "network-vif-plugged", "status": "completed", "tag": "1d2c7a75-3140-4fe8-a8c6-96801d8b0941"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:23.471349 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9cf5be4a-21ae-4d38-b02f-e5afc5de438f req-d3480749-aa51-44b4-9bed-31197e4da62b service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:23.471983 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9cf5be4a-21ae-4d38-b02f-e5afc5de438f req-d3480749-aa51-44b4-9bed-31197e4da62b service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:23.472518 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9cf5be4a-21ae-4d38-b02f-e5afc5de438f req-d3480749-aa51-44b4-9bed-31197e4da62b service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:23.491595 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-9cf5be4a-21ae-4d38-b02f-e5afc5de438f req-d3480749-aa51-44b4-9bed-31197e4da62b service nova] Creating event network-vif-plugged:1d2c7a75-3140-4fe8-a8c6-96801d8b0941 for instance 2803303a-ad72-4096-b524-69a583a56f03 on n-h1-862686-1 Oct 26 13:07:23.499063 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-9cf5be4a-21ae-4d38-b02f-e5afc5de438f req-d3480749-aa51-44b4-9bed-31197e4da62b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044845 Oct 26 13:07:23.500737 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 755/1417] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:07:23.507709 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d6aec0f6-3853-4483-9274-418166a472b1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:23.508641 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d6aec0f6-3853-4483-9274-418166a472b1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:23.515460 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6aec0f6-3853-4483-9274-418166a472b1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:23.516312 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6aec0f6-3853-4483-9274-418166a472b1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:23.516436 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c74f2a73-0402-455e-a219-cce006725649 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:23.516889 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6aec0f6-3853-4483-9274-418166a472b1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:23.517711 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6aec0f6-3853-4483-9274-418166a472b1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:23.518244 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6aec0f6-3853-4483-9274-418166a472b1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:23.519602 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6aec0f6-3853-4483-9274-418166a472b1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:23.528303 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c74f2a73-0402-455e-a219-cce006725649 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/60c4cea5-3b00-4614-a70d-e3fd589cc408" status: 200 len: 1475 microversion: 2.1 time: 0.205411 Oct 26 13:07:23.544023 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 663/1418] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:23 2022] GET /compute/v2.1/servers/60c4cea5-3b00-4614-a70d-e3fd589cc408 => generated 1475 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:23.544023 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a0c52238-6d7a-4568-a44e-50a195850987 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:23.549472 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a0c52238-6d7a-4568-a44e-50a195850987 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 2803303a-ad72-4096-b524-69a583a56f03] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:23.550601 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0c52238-6d7a-4568-a44e-50a195850987 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:23.551119 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0c52238-6d7a-4568-a44e-50a195850987 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:23.551636 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0c52238-6d7a-4568-a44e-50a195850987 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:23.552410 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0c52238-6d7a-4568-a44e-50a195850987 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:23.553215 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0c52238-6d7a-4568-a44e-50a195850987 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:23.554065 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0c52238-6d7a-4568-a44e-50a195850987 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:23.759395 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a0c52238-6d7a-4568-a44e-50a195850987 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:23.769511 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a0c52238-6d7a-4568-a44e-50a195850987 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03" status: 200 len: 1527 microversion: 2.1 time: 0.232701 Oct 26 13:07:23.771445 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 664/1419] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:23 2022] GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03 => generated 1527 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:07:23.777760 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-00287c62-18b3-48a3-a503-59f2515a718f tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:23.778426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-00287c62-18b3-48a3-a503-59f2515a718f tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:23.798410 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-00287c62-18b3-48a3-a503-59f2515a718f tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:23.799307 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-00287c62-18b3-48a3-a503-59f2515a718f tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:23.799764 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-00287c62-18b3-48a3-a503-59f2515a718f tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:23.800501 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-00287c62-18b3-48a3-a503-59f2515a718f tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:23.802338 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-00287c62-18b3-48a3-a503-59f2515a718f tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:23.802884 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-00287c62-18b3-48a3-a503-59f2515a718f tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:23.974575 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d6aec0f6-3853-4483-9274-418166a472b1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:23.995367 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d6aec0f6-3853-4483-9274-418166a472b1 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1476 microversion: 2.1 time: 0.491995 Oct 26 13:07:24.001565 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 756/1420] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:23 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1476 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:24.096006 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-00287c62-18b3-48a3-a503-59f2515a718f tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:24.098332 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:07:24.109533 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-00287c62-18b3-48a3-a503-59f2515a718f tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:24.111103 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-00287c62-18b3-48a3-a503-59f2515a718f tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:24.113038 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-00287c62-18b3-48a3-a503-59f2515a718f tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924" status: 200 len: 1812 microversion: 2.25 time: 0.339903 Oct 26 13:07:24.121580 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 665/1421] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:07:23 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 => generated 1812 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:07:24.122611 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4f25e404-bae7-44dc-bbd3-e5f29aa5879a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:24.123574 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4f25e404-bae7-44dc-bbd3-e5f29aa5879a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: d426a4f6-fa08-47d2-a583-735600b77f27] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:24.126824 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:07:24.132858 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f25e404-bae7-44dc-bbd3-e5f29aa5879a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:24.133746 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f25e404-bae7-44dc-bbd3-e5f29aa5879a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:24.134183 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f25e404-bae7-44dc-bbd3-e5f29aa5879a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:24.134888 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f25e404-bae7-44dc-bbd3-e5f29aa5879a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:24.135337 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f25e404-bae7-44dc-bbd3-e5f29aa5879a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:24.135760 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f25e404-bae7-44dc-bbd3-e5f29aa5879a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:24.290240 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4f25e404-bae7-44dc-bbd3-e5f29aa5879a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:24.308229 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4f25e404-bae7-44dc-bbd3-e5f29aa5879a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27" status: 200 len: 1308 microversion: 2.1 time: 0.189306 Oct 26 13:07:24.314058 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 757/1422] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:24 2022] GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27 => generated 1308 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:24.344967 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c59fec3c-887a-46e9-a0be-aa8c34d72299 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:24.346226 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c59fec3c-887a-46e9-a0be-aa8c34d72299 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:24.354290 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c59fec3c-887a-46e9-a0be-aa8c34d72299 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:24.354915 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c59fec3c-887a-46e9-a0be-aa8c34d72299 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:24.355471 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c59fec3c-887a-46e9-a0be-aa8c34d72299 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:24.356337 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c59fec3c-887a-46e9-a0be-aa8c34d72299 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:24.356795 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c59fec3c-887a-46e9-a0be-aa8c34d72299 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:24.357215 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c59fec3c-887a-46e9-a0be-aa8c34d72299 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:24.438818 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2d54f957-4672-4733-97e8-b7880f584e44 tempest-FloatingIPsNegativeTestJSON-1393605046 tempest-FloatingIPsNegativeTestJSON-1393605046-project] Calling method '.version_select at 0x7f67327a7430>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:24.523028 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2d54f957-4672-4733-97e8-b7880f584e44 tempest-FloatingIPsNegativeTestJSON-1393605046 tempest-FloatingIPsNegativeTestJSON-1393605046-project] 10.222.0.40 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.227295 Oct 26 13:07:24.523614 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 666/1423] 10.222.0.40 () {58 vars in 1149 bytes} [Wed Oct 26 13:07:24 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 26 13:07:24.526408 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c59fec3c-887a-46e9-a0be-aa8c34d72299 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:24.528313 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f4665f49-fe3f-4a32-92ac-2a5b03f6a199 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:24.528922 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f4665f49-fe3f-4a32-92ac-2a5b03f6a199 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:24.536759 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f4665f49-fe3f-4a32-92ac-2a5b03f6a199 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:24.537226 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f4665f49-fe3f-4a32-92ac-2a5b03f6a199 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:24.537842 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f4665f49-fe3f-4a32-92ac-2a5b03f6a199 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:24.538442 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c59fec3c-887a-46e9-a0be-aa8c34d72299 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1473 microversion: 2.1 time: 0.196905 Oct 26 13:07:24.538567 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f4665f49-fe3f-4a32-92ac-2a5b03f6a199 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:24.539016 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f4665f49-fe3f-4a32-92ac-2a5b03f6a199 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:24.539440 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f4665f49-fe3f-4a32-92ac-2a5b03f6a199 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:24.539713 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 758/1424] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:24 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1473 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:07:24.544650 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a975ae00-9da8-4920-adf3-adac51800263 tempest-FloatingIPsNegativeTestJSON-1393605046 tempest-FloatingIPsNegativeTestJSON-1393605046-project] Action: 'create', calling method: .version_select at 0x7f67329810d0>, body: {"pool": "non_exist_pool"} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:24.578132 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-a975ae00-9da8-4920-adf3-adac51800263 tempest-FloatingIPsNegativeTestJSON-1393605046 tempest-FloatingIPsNegativeTestJSON-1393605046-project] HTTP exception thrown: Floating IP pool not found. Oct 26 13:07:24.581381 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a975ae00-9da8-4920-adf3-adac51800263 tempest-FloatingIPsNegativeTestJSON-1393605046 tempest-FloatingIPsNegativeTestJSON-1393605046-project] Request method failure captured: Oct 26 13:07:24.581381 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 26 13:07:24.581381 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:07:24.581381 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:07:24.581381 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:07:24.581381 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 26 Oct 26 13:07:24.581381 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:07:24.581381 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:07:24.581381 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:07:24.581381 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:07:24.581381 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTEM3LLyZo0sZjQF3tfqBHRpl4IZrkUx8DPEf2HFIejZlTj0uc2Lg1j6yT8CFYux4wWXHsq6kZ6MyVZOFLZ9zvJqRM_6LYbYK8kv52Cy1xfx6mbCjSNna-j3gkH6IGaPNntKCvXfU-A9OMyd8RTDNZITU4fnrHF9OQJwYD_StcfOptU Oct 26 13:07:24.581381 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:07:24.581381 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:07:24.581381 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:07:24.581381 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:07:24.581381 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:07:24.581381 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:07:24.581381 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: bb8953cc47774df9841f85b6baf3b4af Oct 26 13:07:24.581381 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1393605046 Oct 26 13:07:24.581381 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:07:24.581381 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:07:24.582991 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bb8953cc47774df9841f85b6baf3b4af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bb8953cc47774df9841f85b6baf3b4af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bb8953cc47774df9841f85b6baf3b4af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bb8953cc47774df9841f85b6baf3b4af"}]}] Oct 26 13:07:24.582991 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1393605046 Oct 26 13:07:24.582991 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: bb8953cc47774df9841f85b6baf3b4af Oct 26 13:07:24.582991 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1393605046 Oct 26 13:07:24.582991 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-FloatingIPsNegativeTestJSON-1393605046-project Oct 26 13:07:24.582991 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:07:24.582991 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:07:24.582991 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: ee54b5fa62134ad4be607f73ad0a22ee Oct 26 13:07:24.582991 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1393605046-project Oct 26 13:07:24.582991 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:07:24.582991 n-d-862686-1 devstack@n-api.service[120598]: {"pool": "non_exist_pool"} Oct 26 13:07:24.582991 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:07:24.582991 n-d-862686-1 devstack@n-api.service[120598]: exception: Floating IP pool not found. Oct 26 13:07:24.582991 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 26 13:07:24.582991 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:07:24.584786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:24.584786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 26 13:07:24.584786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 26 13:07:24.584786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 26 13:07:24.584786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 26 13:07:24.584786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 26 13:07:24.584786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 26 13:07:24.584786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 26 13:07:24.584786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:24.584786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:24.584786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:24.584786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:24.584786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:24.584786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:24.584786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:07:24.584786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:07:24.584786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:07:24.584786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:07:24.584786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:07:24.584786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:07:24.586189 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 26 13:07:24.586189 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:07:24.586189 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 26 13:07:24.586189 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:24.586189 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:24.586189 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:24.586189 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:24.586189 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:24.586189 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:24.586189 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:07:24.586189 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:07:24.586189 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 26 13:07:24.586189 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:24.586189 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a975ae00-9da8-4920-adf3-adac51800263 tempest-FloatingIPsNegativeTestJSON-1393605046 tempest-FloatingIPsNegativeTestJSON-1393605046-project] Returning 404 to user: Floating IP pool not found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:07:24.586189 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a975ae00-9da8-4920-adf3-adac51800263 tempest-FloatingIPsNegativeTestJSON-1393605046 tempest-FloatingIPsNegativeTestJSON-1393605046-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.041977 Oct 26 13:07:24.587283 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 759/1425] 10.222.0.40 () {60 vars in 1170 bytes} [Wed Oct 26 13:07:24 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:07:24.589261 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c724667c-5a65-44ad-8f07-e6fbf04d2ed0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:24.589701 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c724667c-5a65-44ad-8f07-e6fbf04d2ed0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 60c4cea5-3b00-4614-a70d-e3fd589cc408] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:24.597158 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c724667c-5a65-44ad-8f07-e6fbf04d2ed0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:24.597685 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c724667c-5a65-44ad-8f07-e6fbf04d2ed0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:24.598128 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c724667c-5a65-44ad-8f07-e6fbf04d2ed0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:24.598838 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c724667c-5a65-44ad-8f07-e6fbf04d2ed0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:24.599296 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c724667c-5a65-44ad-8f07-e6fbf04d2ed0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:24.599814 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c724667c-5a65-44ad-8f07-e6fbf04d2ed0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:24.718938 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f4665f49-fe3f-4a32-92ac-2a5b03f6a199 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:24.728198 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f4665f49-fe3f-4a32-92ac-2a5b03f6a199 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904" status: 200 len: 1477 microversion: 2.1 time: 0.203553 Oct 26 13:07:24.728777 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 667/1426] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:24 2022] GET /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904 => generated 1477 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:24.742092 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c8b68299-54e5-44dd-a770-783d139d5aad tempest-FloatingIPsNegativeTestJSON-1393605046 tempest-FloatingIPsNegativeTestJSON-1393605046-project] Calling method '.version_select at 0x7f6732c65e50>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:24.742425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c724667c-5a65-44ad-8f07-e6fbf04d2ed0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:24.750632 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c724667c-5a65-44ad-8f07-e6fbf04d2ed0 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/60c4cea5-3b00-4614-a70d-e3fd589cc408" status: 200 len: 1475 microversion: 2.1 time: 0.165381 Oct 26 13:07:24.751204 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 760/1427] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:24 2022] GET /compute/v2.1/servers/60c4cea5-3b00-4614-a70d-e3fd589cc408 => generated 1475 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:24.781679 n-d-862686-1 devstack@n-api.service[120597]: DEBUG neutronclient.v2_0.client [None req-c8b68299-54e5-44dd-a770-783d139d5aad tempest-FloatingIPsNegativeTestJSON-1393605046 tempest-FloatingIPsNegativeTestJSON-1393605046-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP d05aa0f8-bdff-4d92-bc53-8a9e4f28e306 could not be found", "detail": ""}} {{(pid=120597) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 26 13:07:24.782376 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-c8b68299-54e5-44dd-a770-783d139d5aad tempest-FloatingIPsNegativeTestJSON-1393605046 tempest-FloatingIPsNegativeTestJSON-1393605046-project] HTTP exception thrown: Floating IP not found for ID d05aa0f8-bdff-4d92-bc53-8a9e4f28e306 Oct 26 13:07:24.796143 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-45c3e206-a8ea-491a-93ab-f67f03a1ee29 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:24.796607 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c8b68299-54e5-44dd-a770-783d139d5aad tempest-FloatingIPsNegativeTestJSON-1393605046 tempest-FloatingIPsNegativeTestJSON-1393605046-project] Request method failure captured: Oct 26 13:07:24.796607 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/os-floating-ips/d05aa0f8-bdff-4d92-bc53-8a9e4f28e306 HTTP/1.1 Oct 26 13:07:24.796607 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:07:24.796607 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:07:24.796607 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:07:24.796607 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:07:24.796607 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:07:24.796607 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:07:24.796607 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:07:24.796607 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:07:24.796607 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTEM3LLyZo0sZjQF3tfqBHRpl4IZrkUx8DPEf2HFIejZlTj0uc2Lg1j6yT8CFYux4wWXHsq6kZ6MyVZOFLZ9zvJqRM_6LYbYK8kv52Cy1xfx6mbCjSNna-j3gkH6IGaPNntKCvXfU-A9OMyd8RTDNZITU4fnrHF9OQJwYD_StcfOptU Oct 26 13:07:24.796607 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:07:24.796607 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:07:24.796607 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:07:24.796607 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:07:24.796607 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:07:24.796607 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:07:24.796607 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: bb8953cc47774df9841f85b6baf3b4af Oct 26 13:07:24.796607 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1393605046 Oct 26 13:07:24.796607 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:07:24.796607 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:07:24.798184 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bb8953cc47774df9841f85b6baf3b4af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bb8953cc47774df9841f85b6baf3b4af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bb8953cc47774df9841f85b6baf3b4af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bb8953cc47774df9841f85b6baf3b4af"}]}] Oct 26 13:07:24.798184 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1393605046 Oct 26 13:07:24.798184 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: bb8953cc47774df9841f85b6baf3b4af Oct 26 13:07:24.798184 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1393605046 Oct 26 13:07:24.798184 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-FloatingIPsNegativeTestJSON-1393605046-project Oct 26 13:07:24.798184 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:07:24.798184 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:07:24.798184 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: ee54b5fa62134ad4be607f73ad0a22ee Oct 26 13:07:24.798184 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1393605046-project Oct 26 13:07:24.798184 n-d-862686-1 devstack@n-api.service[120597]: method: Oct 26 13:07:24.798184 n-d-862686-1 devstack@n-api.service[120597]: exception: Floating IP not found for ID d05aa0f8-bdff-4d92-bc53-8a9e4f28e306 Oct 26 13:07:24.798184 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'd05aa0f8-bdff-4d92-bc53-8a9e4f28e306'} Oct 26 13:07:24.798184 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:07:24.801715 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:24.801715 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 26 13:07:24.801715 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 26 13:07:24.801715 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:07:24.801715 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:07:24.801715 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 26 13:07:24.801715 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 26 13:07:24.801715 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:07:24.801715 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:07:24.801715 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 26 13:07:24.801715 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 26 13:07:24.801715 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:07:24.801715 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:07:24.801715 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 26 13:07:24.801715 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 26 13:07:24.801715 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:07:24.801715 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:07:24.801715 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 26 13:07:24.801715 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 26 13:07:24.803869 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:07:24.803869 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:07:24.803869 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 26 13:07:24.803869 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 26 13:07:24.803869 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 26 13:07:24.803869 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 26 13:07:24.803869 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP d05aa0f8-bdff-4d92-bc53-8a9e4f28e306 could not be found Oct 26 13:07:24.803869 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-85d4fbea-2c04-4325-8af5-fecc961f3801'] Oct 26 13:07:24.803869 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:24.803869 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:24.803869 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:24.803869 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:24.803869 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 26 13:07:24.803869 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 26 13:07:24.803869 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 26 13:07:24.803869 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 26 13:07:24.803869 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID d05aa0f8-bdff-4d92-bc53-8a9e4f28e306. Oct 26 13:07:24.803869 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:24.803869 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:24.803869 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:24.805369 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:24.805369 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:24.805369 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:24.805369 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:07:24.805369 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:07:24.805369 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:07:24.805369 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:07:24.805369 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:07:24.805369 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:07:24.805369 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 26 13:07:24.805369 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 26 13:07:24.805369 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID d05aa0f8-bdff-4d92-bc53-8a9e4f28e306 Oct 26 13:07:24.805369 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:24.805369 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:24.805369 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:24.805369 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:24.805369 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:24.805369 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:24.805369 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:07:24.805369 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:07:24.806925 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID d05aa0f8-bdff-4d92-bc53-8a9e4f28e306 Oct 26 13:07:24.806925 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:24.807086 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-45c3e206-a8ea-491a-93ab-f67f03a1ee29 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 2803303a-ad72-4096-b524-69a583a56f03] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:24.807262 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c8b68299-54e5-44dd-a770-783d139d5aad tempest-FloatingIPsNegativeTestJSON-1393605046 tempest-FloatingIPsNegativeTestJSON-1393605046-project] Returning 404 to user: Floating IP not found for ID d05aa0f8-bdff-4d92-bc53-8a9e4f28e306 {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:07:24.807262 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c8b68299-54e5-44dd-a770-783d139d5aad tempest-FloatingIPsNegativeTestJSON-1393605046 tempest-FloatingIPsNegativeTestJSON-1393605046-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/d05aa0f8-bdff-4d92-bc53-8a9e4f28e306" status: 404 len: 111 microversion: 2.1 time: 0.068420 Oct 26 13:07:24.807262 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 668/1428] 10.222.0.40 () {58 vars in 1263 bytes} [Wed Oct 26 13:07:24 2022] DELETE /compute/v2.1/os-floating-ips/d05aa0f8-bdff-4d92-bc53-8a9e4f28e306 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:07:24.807496 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45c3e206-a8ea-491a-93ab-f67f03a1ee29 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:24.807496 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45c3e206-a8ea-491a-93ab-f67f03a1ee29 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:24.807496 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45c3e206-a8ea-491a-93ab-f67f03a1ee29 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:24.807810 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45c3e206-a8ea-491a-93ab-f67f03a1ee29 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:24.808268 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45c3e206-a8ea-491a-93ab-f67f03a1ee29 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:24.808722 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45c3e206-a8ea-491a-93ab-f67f03a1ee29 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:25.021908 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-aca1762f-0da4-4fc9-b5f3-2430032a7217 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:25.022717 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-aca1762f-0da4-4fc9-b5f3-2430032a7217 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:25.030498 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aca1762f-0da4-4fc9-b5f3-2430032a7217 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:25.031094 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aca1762f-0da4-4fc9-b5f3-2430032a7217 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:25.031607 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aca1762f-0da4-4fc9-b5f3-2430032a7217 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:25.032395 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aca1762f-0da4-4fc9-b5f3-2430032a7217 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:25.033366 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aca1762f-0da4-4fc9-b5f3-2430032a7217 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:25.033983 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aca1762f-0da4-4fc9-b5f3-2430032a7217 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:25.199880 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-aca1762f-0da4-4fc9-b5f3-2430032a7217 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:25.209996 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-aca1762f-0da4-4fc9-b5f3-2430032a7217 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1476 microversion: 2.1 time: 0.191456 Oct 26 13:07:25.210816 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 669/1429] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:25 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1476 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:07:25.215774 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4436430e-1e3b-40d5-abab-8f6948e616f1 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:25.216478 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4436430e-1e3b-40d5-abab-8f6948e616f1 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:25.228647 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4436430e-1e3b-40d5-abab-8f6948e616f1 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:25.229194 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4436430e-1e3b-40d5-abab-8f6948e616f1 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:25.229709 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4436430e-1e3b-40d5-abab-8f6948e616f1 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:25.230463 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4436430e-1e3b-40d5-abab-8f6948e616f1 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:25.230925 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4436430e-1e3b-40d5-abab-8f6948e616f1 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:25.231355 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4436430e-1e3b-40d5-abab-8f6948e616f1 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:25.357111 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-45c3e206-a8ea-491a-93ab-f67f03a1ee29 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:25.370685 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-45c3e206-a8ea-491a-93ab-f67f03a1ee29 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03" status: 200 len: 1527 microversion: 2.1 time: 0.577397 Oct 26 13:07:25.372784 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 761/1430] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:24 2022] GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03 => generated 1527 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:07:25.379409 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2bfa09ed-08e9-4031-b830-aa50781b65f0 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:25.380116 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2bfa09ed-08e9-4031-b830-aa50781b65f0 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: d426a4f6-fa08-47d2-a583-735600b77f27] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:25.392884 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2bfa09ed-08e9-4031-b830-aa50781b65f0 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:25.393581 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2bfa09ed-08e9-4031-b830-aa50781b65f0 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:25.394099 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2bfa09ed-08e9-4031-b830-aa50781b65f0 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:25.394896 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2bfa09ed-08e9-4031-b830-aa50781b65f0 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:25.395425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2bfa09ed-08e9-4031-b830-aa50781b65f0 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:25.395920 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2bfa09ed-08e9-4031-b830-aa50781b65f0 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:25.759804 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2bfa09ed-08e9-4031-b830-aa50781b65f0 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:25.768695 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2bfa09ed-08e9-4031-b830-aa50781b65f0 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27" status: 200 len: 1308 microversion: 2.1 time: 0.394320 Oct 26 13:07:25.769569 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 762/1431] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:25 2022] GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27 => generated 1308 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:25.792079 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-f56375dc-13f8-49bd-ae5d-e1a3374b102e req-acc707a2-a7cb-46c0-a21c-3eba392a1add service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2803303a-ad72-4096-b524-69a583a56f03", "name": "network-vif-unplugged", "status": "completed", "tag": "1d2c7a75-3140-4fe8-a8c6-96801d8b0941"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:25.802326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f56375dc-13f8-49bd-ae5d-e1a3374b102e req-acc707a2-a7cb-46c0-a21c-3eba392a1add service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:25.803722 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f56375dc-13f8-49bd-ae5d-e1a3374b102e req-acc707a2-a7cb-46c0-a21c-3eba392a1add service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:25.804319 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f56375dc-13f8-49bd-ae5d-e1a3374b102e req-acc707a2-a7cb-46c0-a21c-3eba392a1add service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:25.818626 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-f56375dc-13f8-49bd-ae5d-e1a3374b102e req-acc707a2-a7cb-46c0-a21c-3eba392a1add service nova] Creating event network-vif-unplugged:1d2c7a75-3140-4fe8-a8c6-96801d8b0941 for instance 2803303a-ad72-4096-b524-69a583a56f03 on n-h1-862686-1 Oct 26 13:07:25.826077 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-f56375dc-13f8-49bd-ae5d-e1a3374b102e req-acc707a2-a7cb-46c0-a21c-3eba392a1add service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041507 Oct 26 13:07:25.826881 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 763/1432] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:07:25.833532 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d89b63d1-3063-4c5d-92d6-d4730e408225 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:25.834727 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d89b63d1-3063-4c5d-92d6-d4730e408225 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:25.842304 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d89b63d1-3063-4c5d-92d6-d4730e408225 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:25.842966 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d89b63d1-3063-4c5d-92d6-d4730e408225 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:25.843899 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d89b63d1-3063-4c5d-92d6-d4730e408225 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:25.845088 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d89b63d1-3063-4c5d-92d6-d4730e408225 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:25.845889 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d89b63d1-3063-4c5d-92d6-d4730e408225 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:25.846606 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d89b63d1-3063-4c5d-92d6-d4730e408225 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:26.147365 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4436430e-1e3b-40d5-abab-8f6948e616f1 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:26.194658 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d89b63d1-3063-4c5d-92d6-d4730e408225 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:26.196223 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4436430e-1e3b-40d5-abab-8f6948e616f1 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:26.197928 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4436430e-1e3b-40d5-abab-8f6948e616f1 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:26.198881 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:07:26.199562 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4436430e-1e3b-40d5-abab-8f6948e616f1 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924" status: 200 len: 1802 microversion: 2.25 time: 0.987696 Oct 26 13:07:26.200422 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 670/1433] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:07:25 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 => generated 1802 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:07:26.211156 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d86aefbd-ed78-495a-8027-0fca9addfd5f tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:26.212069 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d86aefbd-ed78-495a-8027-0fca9addfd5f tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:26.215113 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d89b63d1-3063-4c5d-92d6-d4730e408225 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1473 microversion: 2.1 time: 0.386664 Oct 26 13:07:26.229508 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 764/1434] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:25 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1473 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:26.229508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c38d8037-7939-411d-ba3a-24239b176886 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:26.229508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c38d8037-7939-411d-ba3a-24239b176886 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 60c4cea5-3b00-4614-a70d-e3fd589cc408] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:26.236102 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d86aefbd-ed78-495a-8027-0fca9addfd5f tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:26.236837 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d86aefbd-ed78-495a-8027-0fca9addfd5f tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:26.237445 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d86aefbd-ed78-495a-8027-0fca9addfd5f tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:26.238374 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d86aefbd-ed78-495a-8027-0fca9addfd5f tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:26.239206 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d86aefbd-ed78-495a-8027-0fca9addfd5f tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:26.239879 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d86aefbd-ed78-495a-8027-0fca9addfd5f tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:26.242447 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c38d8037-7939-411d-ba3a-24239b176886 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:26.243066 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c38d8037-7939-411d-ba3a-24239b176886 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:26.243501 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c38d8037-7939-411d-ba3a-24239b176886 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:26.244388 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c38d8037-7939-411d-ba3a-24239b176886 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:26.244763 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c38d8037-7939-411d-ba3a-24239b176886 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:26.245180 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c38d8037-7939-411d-ba3a-24239b176886 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:26.378420 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c38d8037-7939-411d-ba3a-24239b176886 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:26.393364 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c38d8037-7939-411d-ba3a-24239b176886 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/60c4cea5-3b00-4614-a70d-e3fd589cc408" status: 200 len: 1433 microversion: 2.1 time: 0.175405 Oct 26 13:07:26.403184 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 765/1435] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:26 2022] GET /compute/v2.1/servers/60c4cea5-3b00-4614-a70d-e3fd589cc408 => generated 1433 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:26.416411 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-de311fcf-c119-4cb1-a26f-bf0a6a293c5e tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Calling method '.version_select at 0x7f6732117820>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:26.420093 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de311fcf-c119-4cb1-a26f-bf0a6a293c5e tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:26.420738 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de311fcf-c119-4cb1-a26f-bf0a6a293c5e tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:26.421280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de311fcf-c119-4cb1-a26f-bf0a6a293c5e tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:26.452401 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-de311fcf-c119-4cb1-a26f-bf0a6a293c5e tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 2962 microversion: 2.25 time: 0.047074 Oct 26 13:07:26.466455 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 766/1436] 10.222.0.40 () {60 vars in 1184 bytes} [Wed Oct 26 13:07:26 2022] GET /compute/v2.1/os-migrations => generated 2962 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:07:26.478159 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8e7b576c-40b5-44d0-8547-62a391c9d63d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:26.479158 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8e7b576c-40b5-44d0-8547-62a391c9d63d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:26.498597 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e7b576c-40b5-44d0-8547-62a391c9d63d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:26.499425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e7b576c-40b5-44d0-8547-62a391c9d63d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:26.500042 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e7b576c-40b5-44d0-8547-62a391c9d63d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:26.500975 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e7b576c-40b5-44d0-8547-62a391c9d63d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:26.501695 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e7b576c-40b5-44d0-8547-62a391c9d63d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:26.502419 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e7b576c-40b5-44d0-8547-62a391c9d63d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:26.777624 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8e7b576c-40b5-44d0-8547-62a391c9d63d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:26.785444 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8e7b576c-40b5-44d0-8547-62a391c9d63d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1476 microversion: 2.1 time: 0.317683 Oct 26 13:07:26.788288 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 767/1437] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:26 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1476 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:26.798063 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3153051d-95a0-4dc6-b490-4b8089f9fcbb tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:26.800638 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3153051d-95a0-4dc6-b490-4b8089f9fcbb tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 2803303a-ad72-4096-b524-69a583a56f03] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:26.815120 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d86aefbd-ed78-495a-8027-0fca9addfd5f tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:26.819849 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3153051d-95a0-4dc6-b490-4b8089f9fcbb tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:26.820676 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3153051d-95a0-4dc6-b490-4b8089f9fcbb tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:26.821930 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3153051d-95a0-4dc6-b490-4b8089f9fcbb tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:26.822994 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3153051d-95a0-4dc6-b490-4b8089f9fcbb tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:26.823821 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3153051d-95a0-4dc6-b490-4b8089f9fcbb tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:26.825141 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3153051d-95a0-4dc6-b490-4b8089f9fcbb tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:26.832184 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d86aefbd-ed78-495a-8027-0fca9addfd5f tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904" status: 200 len: 1477 microversion: 2.1 time: 0.628815 Oct 26 13:07:26.835199 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 671/1438] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:26 2022] GET /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904 => generated 1477 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:26.849136 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-82089e4c-4e93-4da4-aa7e-a47e803dbd2f tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:26.850234 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-82089e4c-4e93-4da4-aa7e-a47e803dbd2f tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:26.868177 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-82089e4c-4e93-4da4-aa7e-a47e803dbd2f tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:26.868903 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-82089e4c-4e93-4da4-aa7e-a47e803dbd2f tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:26.870003 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-82089e4c-4e93-4da4-aa7e-a47e803dbd2f tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:26.872410 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-82089e4c-4e93-4da4-aa7e-a47e803dbd2f tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:26.873499 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-82089e4c-4e93-4da4-aa7e-a47e803dbd2f tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:26.877952 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-82089e4c-4e93-4da4-aa7e-a47e803dbd2f tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:27.156987 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3153051d-95a0-4dc6-b490-4b8089f9fcbb tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:27.170151 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3153051d-95a0-4dc6-b490-4b8089f9fcbb tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03" status: 200 len: 1527 microversion: 2.1 time: 0.378891 Oct 26 13:07:27.170606 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 768/1439] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:26 2022] GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03 => generated 1527 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:27.196464 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-88d54219-2dd5-4069-91a6-ea7c3aa6e1b4 req-dc1d6400-520f-4982-baa2-c8f54135336a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60c4cea5-3b00-4614-a70d-e3fd589cc408", "name": "network-vif-deleted", "tag": "79a7de1e-4128-41b8-bbb9-aea414b689c4"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:27.207546 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-88d54219-2dd5-4069-91a6-ea7c3aa6e1b4 req-dc1d6400-520f-4982-baa2-c8f54135336a service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:27.207956 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-88d54219-2dd5-4069-91a6-ea7c3aa6e1b4 req-dc1d6400-520f-4982-baa2-c8f54135336a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:27.209165 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-88d54219-2dd5-4069-91a6-ea7c3aa6e1b4 req-dc1d6400-520f-4982-baa2-c8f54135336a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:27.228064 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-88d54219-2dd5-4069-91a6-ea7c3aa6e1b4 req-dc1d6400-520f-4982-baa2-c8f54135336a service nova] Creating event network-vif-deleted:79a7de1e-4128-41b8-bbb9-aea414b689c4 for instance 60c4cea5-3b00-4614-a70d-e3fd589cc408 on n-h2-862686-1 Oct 26 13:07:27.241931 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-88d54219-2dd5-4069-91a6-ea7c3aa6e1b4 req-dc1d6400-520f-4982-baa2-c8f54135336a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047767 Oct 26 13:07:27.243136 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 769/1440] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:07:27.267406 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f5b9adac-a2ea-4fed-b6d4-4174766952cc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:27.268464 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f5b9adac-a2ea-4fed-b6d4-4174766952cc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: d426a4f6-fa08-47d2-a583-735600b77f27] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:27.282388 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5b9adac-a2ea-4fed-b6d4-4174766952cc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:27.283284 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5b9adac-a2ea-4fed-b6d4-4174766952cc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:27.283894 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5b9adac-a2ea-4fed-b6d4-4174766952cc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:27.284926 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5b9adac-a2ea-4fed-b6d4-4174766952cc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:27.285520 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5b9adac-a2ea-4fed-b6d4-4174766952cc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:27.286045 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5b9adac-a2ea-4fed-b6d4-4174766952cc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:27.368933 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-82089e4c-4e93-4da4-aa7e-a47e803dbd2f tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lazy-loading 'services' on Instance uuid f27f0232-1c7a-433d-a8ed-9ef4f631b924 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:07:27.397149 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-82089e4c-4e93-4da4-aa7e-a47e803dbd2f tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924" status: 200 len: 2420 microversion: 2.25 time: 0.559886 Oct 26 13:07:27.403591 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 672/1441] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:07:26 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 => generated 2420 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:07:27.408362 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-64bb6b90-5ff4-4e49-81cf-156223f099c6 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:27.413610 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-64bb6b90-5ff4-4e49-81cf-156223f099c6 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:27.426104 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64bb6b90-5ff4-4e49-81cf-156223f099c6 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:27.427409 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64bb6b90-5ff4-4e49-81cf-156223f099c6 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:27.430228 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64bb6b90-5ff4-4e49-81cf-156223f099c6 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:27.431194 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64bb6b90-5ff4-4e49-81cf-156223f099c6 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:27.431852 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64bb6b90-5ff4-4e49-81cf-156223f099c6 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:27.432607 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64bb6b90-5ff4-4e49-81cf-156223f099c6 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:27.637708 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f5b9adac-a2ea-4fed-b6d4-4174766952cc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:27.652674 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f5b9adac-a2ea-4fed-b6d4-4174766952cc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27" status: 200 len: 1308 microversion: 2.1 time: 0.404783 Oct 26 13:07:27.653553 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 770/1442] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:27 2022] GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27 => generated 1308 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:27.681091 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-38967b3d-7de1-4460-9dcc-c239d5006a72 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:27.682159 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-38967b3d-7de1-4460-9dcc-c239d5006a72 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 60c4cea5-3b00-4614-a70d-e3fd589cc408] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:27.705897 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38967b3d-7de1-4460-9dcc-c239d5006a72 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:27.708886 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38967b3d-7de1-4460-9dcc-c239d5006a72 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:27.712630 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38967b3d-7de1-4460-9dcc-c239d5006a72 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:27.716886 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38967b3d-7de1-4460-9dcc-c239d5006a72 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:27.719821 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38967b3d-7de1-4460-9dcc-c239d5006a72 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:27.721203 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38967b3d-7de1-4460-9dcc-c239d5006a72 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:27.798669 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38967b3d-7de1-4460-9dcc-c239d5006a72 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:27.832982 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38967b3d-7de1-4460-9dcc-c239d5006a72 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:27.841675 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38967b3d-7de1-4460-9dcc-c239d5006a72 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.041s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:27.843433 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-38967b3d-7de1-4460-9dcc-c239d5006a72 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lazy-loading 'fault' on Instance uuid 60c4cea5-3b00-4614-a70d-e3fd589cc408 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:07:28.001599 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-38967b3d-7de1-4460-9dcc-c239d5006a72 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:28.009871 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-38967b3d-7de1-4460-9dcc-c239d5006a72 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/60c4cea5-3b00-4614-a70d-e3fd589cc408" status: 200 len: 1309 microversion: 2.1 time: 0.342138 Oct 26 13:07:28.013791 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 771/1443] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:27 2022] GET /compute/v2.1/servers/60c4cea5-3b00-4614-a70d-e3fd589cc408 => generated 1309 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:28.020440 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6f9270aa-3116-4317-8482-2ecd1e71ed9e tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:28.021147 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6f9270aa-3116-4317-8482-2ecd1e71ed9e tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:28.045177 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6f9270aa-3116-4317-8482-2ecd1e71ed9e tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:28.058417 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6f9270aa-3116-4317-8482-2ecd1e71ed9e tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:28.059277 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6f9270aa-3116-4317-8482-2ecd1e71ed9e tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:28.060538 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6f9270aa-3116-4317-8482-2ecd1e71ed9e tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:28.062640 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6f9270aa-3116-4317-8482-2ecd1e71ed9e tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:28.063256 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6f9270aa-3116-4317-8482-2ecd1e71ed9e tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:28.265044 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-64bb6b90-5ff4-4e49-81cf-156223f099c6 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:28.294470 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-64bb6b90-5ff4-4e49-81cf-156223f099c6 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1473 microversion: 2.1 time: 0.889770 Oct 26 13:07:28.299339 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 673/1444] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:27 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1473 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:28.311782 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f33bd75b-31b7-4cc4-b156-440ee4b834e4 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:28.312397 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f33bd75b-31b7-4cc4-b156-440ee4b834e4 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:28.377947 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f33bd75b-31b7-4cc4-b156-440ee4b834e4 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:28.380986 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f33bd75b-31b7-4cc4-b156-440ee4b834e4 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:28.383139 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f33bd75b-31b7-4cc4-b156-440ee4b834e4 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:28.384393 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f33bd75b-31b7-4cc4-b156-440ee4b834e4 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:28.385690 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f33bd75b-31b7-4cc4-b156-440ee4b834e4 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:28.386746 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f33bd75b-31b7-4cc4-b156-440ee4b834e4 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:28.453189 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-6f9270aa-3116-4317-8482-2ecd1e71ed9e tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lazy-loading 'services' on Instance uuid f27f0232-1c7a-433d-a8ed-9ef4f631b924 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:07:28.760851 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6f9270aa-3116-4317-8482-2ecd1e71ed9e tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924/os-volume_attachments/908e94f8-4c16-493e-820c-9c80a226a206" status: 202 len: 0 microversion: 2.25 time: 0.745344 Oct 26 13:07:28.761578 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 772/1445] 10.222.0.40 () {60 vars in 1457 bytes} [Wed Oct 26 13:07:28 2022] DELETE /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924/os-volume_attachments/908e94f8-4c16-493e-820c-9c80a226a206 => generated 0 bytes in 747 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:07:28.776857 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-da79aea9-0357-4568-a48f-d22e8aa5ae8d tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:28.777622 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-da79aea9-0357-4568-a48f-d22e8aa5ae8d tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:28.803589 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da79aea9-0357-4568-a48f-d22e8aa5ae8d tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:28.804236 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da79aea9-0357-4568-a48f-d22e8aa5ae8d tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:28.810168 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da79aea9-0357-4568-a48f-d22e8aa5ae8d tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:28.811188 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da79aea9-0357-4568-a48f-d22e8aa5ae8d tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:28.811779 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da79aea9-0357-4568-a48f-d22e8aa5ae8d tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:28.812582 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da79aea9-0357-4568-a48f-d22e8aa5ae8d tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:28.885568 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da79aea9-0357-4568-a48f-d22e8aa5ae8d tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:28.886669 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da79aea9-0357-4568-a48f-d22e8aa5ae8d tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:28.887134 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da79aea9-0357-4568-a48f-d22e8aa5ae8d tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:28.887687 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-da79aea9-0357-4568-a48f-d22e8aa5ae8d tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lazy-loading 'fault' on Instance uuid cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:07:29.051172 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f33bd75b-31b7-4cc4-b156-440ee4b834e4 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:29.061030 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f33bd75b-31b7-4cc4-b156-440ee4b834e4 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1476 microversion: 2.1 time: 0.760564 Oct 26 13:07:29.065440 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 674/1446] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:28 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1476 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:29.096241 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-85af3e45-028d-4a59-b7e2-329abc3823f5 req-b04fe873-cd1a-4b21-94a5-e5221be1451f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d426a4f6-fa08-47d2-a583-735600b77f27", "name": "network-vif-plugged", "status": "completed", "tag": "8734e662-a14c-45ba-b2b3-6b2193b943a0"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:29.158606 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-85af3e45-028d-4a59-b7e2-329abc3823f5 req-b04fe873-cd1a-4b21-94a5-e5221be1451f service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:29.163599 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-85af3e45-028d-4a59-b7e2-329abc3823f5 req-b04fe873-cd1a-4b21-94a5-e5221be1451f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:29.165943 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-85af3e45-028d-4a59-b7e2-329abc3823f5 req-b04fe873-cd1a-4b21-94a5-e5221be1451f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:29.201657 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-85af3e45-028d-4a59-b7e2-329abc3823f5 req-b04fe873-cd1a-4b21-94a5-e5221be1451f service nova] Creating event network-vif-plugged:8734e662-a14c-45ba-b2b3-6b2193b943a0 for instance d426a4f6-fa08-47d2-a583-735600b77f27 on n-h2-862686-1 Oct 26 13:07:29.227319 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-85af3e45-028d-4a59-b7e2-329abc3823f5 req-b04fe873-cd1a-4b21-94a5-e5221be1451f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159899 Oct 26 13:07:29.234923 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 675/1447] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:07:29.254665 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-2c1ecadc-4bfa-408f-acf3-fa2c5de4d93c req-18b0aad9-f6a2-45ce-85d8-665f6ff642d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904", "name": "network-vif-deleted", "tag": "972c68b8-19ba-4672-b7a7-ab578f54935e"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:29.280299 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-da79aea9-0357-4568-a48f-d22e8aa5ae8d tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71de4f9fbfb94d7da473e93e42591c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a46daa2d3a043488473b65f18ebfefe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:29.281548 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:07:29.290441 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2c1ecadc-4bfa-408f-acf3-fa2c5de4d93c req-18b0aad9-f6a2-45ce-85d8-665f6ff642d2 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:29.291028 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2c1ecadc-4bfa-408f-acf3-fa2c5de4d93c req-18b0aad9-f6a2-45ce-85d8-665f6ff642d2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:29.291476 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2c1ecadc-4bfa-408f-acf3-fa2c5de4d93c req-18b0aad9-f6a2-45ce-85d8-665f6ff642d2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:29.292309 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-da79aea9-0357-4568-a48f-d22e8aa5ae8d tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904" status: 200 len: 1312 microversion: 2.1 time: 0.528040 Oct 26 13:07:29.306178 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 773/1448] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:28 2022] GET /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904 => generated 1312 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:29.327870 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-59e34e09-bb33-42b1-b1da-9c0a6c5dce6c tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:29.328740 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-59e34e09-bb33-42b1-b1da-9c0a6c5dce6c tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 2803303a-ad72-4096-b524-69a583a56f03] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:29.333198 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-2c1ecadc-4bfa-408f-acf3-fa2c5de4d93c req-18b0aad9-f6a2-45ce-85d8-665f6ff642d2 service nova] Creating event network-vif-deleted:972c68b8-19ba-4672-b7a7-ab578f54935e for instance cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904 on n-h1-862686-1 Oct 26 13:07:29.345559 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-2c1ecadc-4bfa-408f-acf3-fa2c5de4d93c req-18b0aad9-f6a2-45ce-85d8-665f6ff642d2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106842 Oct 26 13:07:29.346532 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-59e34e09-bb33-42b1-b1da-9c0a6c5dce6c tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:29.347217 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 676/1449] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:07:29.348036 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-59e34e09-bb33-42b1-b1da-9c0a6c5dce6c tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:29.354107 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-59e34e09-bb33-42b1-b1da-9c0a6c5dce6c tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:29.355418 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-59e34e09-bb33-42b1-b1da-9c0a6c5dce6c tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:29.356157 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-59e34e09-bb33-42b1-b1da-9c0a6c5dce6c tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:29.356790 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-59e34e09-bb33-42b1-b1da-9c0a6c5dce6c tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:29.365174 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c4a1451c-dadd-4bb5-baa8-37a1ff754e33 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:29.366972 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c4a1451c-dadd-4bb5-baa8-37a1ff754e33 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: d426a4f6-fa08-47d2-a583-735600b77f27] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:29.382486 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4a1451c-dadd-4bb5-baa8-37a1ff754e33 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:29.383034 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4a1451c-dadd-4bb5-baa8-37a1ff754e33 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:29.386507 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4a1451c-dadd-4bb5-baa8-37a1ff754e33 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:29.387449 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4a1451c-dadd-4bb5-baa8-37a1ff754e33 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:29.388030 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4a1451c-dadd-4bb5-baa8-37a1ff754e33 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:29.388566 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4a1451c-dadd-4bb5-baa8-37a1ff754e33 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:29.531799 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-59e34e09-bb33-42b1-b1da-9c0a6c5dce6c tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:29.544628 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-59e34e09-bb33-42b1-b1da-9c0a6c5dce6c tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03" status: 200 len: 1310 microversion: 2.1 time: 0.228901 Oct 26 13:07:29.548625 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 774/1450] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:29 2022] GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03 => generated 1310 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:29.561902 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7f0325a0-3700-4480-af97-92354d8d99b3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:29.564010 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7f0325a0-3700-4480-af97-92354d8d99b3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:29.582112 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f0325a0-3700-4480-af97-92354d8d99b3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:29.586086 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f0325a0-3700-4480-af97-92354d8d99b3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:29.586919 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f0325a0-3700-4480-af97-92354d8d99b3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:29.591554 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f0325a0-3700-4480-af97-92354d8d99b3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:29.592222 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f0325a0-3700-4480-af97-92354d8d99b3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:29.592934 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f0325a0-3700-4480-af97-92354d8d99b3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:29.656864 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7f0325a0-3700-4480-af97-92354d8d99b3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.106896 Oct 26 13:07:29.661813 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 775/1451] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Oct 26 13:07:29 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:07:29.676844 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cd2cd3c7-e6ba-4687-ba34-114c4bc371e8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:29.679990 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cd2cd3c7-e6ba-4687-ba34-114c4bc371e8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 60c4cea5-3b00-4614-a70d-e3fd589cc408] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:29.689285 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cd2cd3c7-e6ba-4687-ba34-114c4bc371e8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:29.690001 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cd2cd3c7-e6ba-4687-ba34-114c4bc371e8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:29.690672 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cd2cd3c7-e6ba-4687-ba34-114c4bc371e8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:29.691564 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cd2cd3c7-e6ba-4687-ba34-114c4bc371e8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:29.695245 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cd2cd3c7-e6ba-4687-ba34-114c4bc371e8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:29.695919 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cd2cd3c7-e6ba-4687-ba34-114c4bc371e8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:29.722472 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-cd2cd3c7-e6ba-4687-ba34-114c4bc371e8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] HTTP exception thrown: Instance 60c4cea5-3b00-4614-a70d-e3fd589cc408 could not be found. Oct 26 13:07:29.730121 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cd2cd3c7-e6ba-4687-ba34-114c4bc371e8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Request method failure captured: Oct 26 13:07:29.730121 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/60c4cea5-3b00-4614-a70d-e3fd589cc408 HTTP/1.1 Oct 26 13:07:29.730121 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:07:29.730121 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:07:29.730121 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:07:29.730121 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:07:29.730121 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:07:29.730121 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:07:29.730121 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:07:29.730121 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:07:29.730121 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTBPRVt_8YZnaMSFiptNqbU9QNU93-_uVsnIl5oPaIxTkieW3pGz0zJKB63vkS1UTm30oE-_Ib6tVEIUcfod49uJs_R6L4h_NtP5w4W8pi8x5J4f1QqVVXViMhIM2rv6Z6M-Vnp8kRHMISIYhq0EFTwFrWnXPDyjXTUbEUwh3-ynQvQ Oct 26 13:07:29.730121 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:07:29.730121 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:07:29.730121 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:07:29.730121 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:07:29.730121 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:07:29.730121 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:07:29.730121 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: d6515917885c4f3cb5fb19e05f4e5e2b Oct 26 13:07:29.730121 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersOnMultiNodesTest-1287428008 Oct 26 13:07:29.730121 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:07:29.730121 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:07:29.731712 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d6515917885c4f3cb5fb19e05f4e5e2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d6515917885c4f3cb5fb19e05f4e5e2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d6515917885c4f3cb5fb19e05f4e5e2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d6515917885c4f3cb5fb19e05f4e5e2b"}]}] Oct 26 13:07:29.731712 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersOnMultiNodesTest-1287428008 Oct 26 13:07:29.731712 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: d6515917885c4f3cb5fb19e05f4e5e2b Oct 26 13:07:29.731712 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1287428008 Oct 26 13:07:29.731712 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersOnMultiNodesTest-1287428008-project Oct 26 13:07:29.731712 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:07:29.731712 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:07:29.731712 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: b6cddfeca4ce49788143b2bf4b30545f Oct 26 13:07:29.731712 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersOnMultiNodesTest-1287428008-project Oct 26 13:07:29.731712 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:07:29.731712 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 60c4cea5-3b00-4614-a70d-e3fd589cc408 could not be found. Oct 26 13:07:29.731712 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '60c4cea5-3b00-4614-a70d-e3fd589cc408'} Oct 26 13:07:29.732601 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:07:29.732601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:29.732601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:07:29.732601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:07:29.732601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:07:29.732601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:07:29.732601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:07:29.732601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:07:29.732601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:07:29.732601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:07:29.732601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60c4cea5-3b00-4614-a70d-e3fd589cc408 could not be found. Oct 26 13:07:29.732601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:29.732601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:29.732601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:29.732601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:29.732601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:29.732601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:29.732601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:07:29.732601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:07:29.732601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:07:29.734174 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:07:29.734174 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:07:29.734174 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:07:29.734174 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:07:29.734174 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:07:29.734174 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:07:29.734174 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:07:29.734174 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60c4cea5-3b00-4614-a70d-e3fd589cc408 could not be found. Oct 26 13:07:29.734174 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:29.734174 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:29.734174 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:29.734174 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:29.734174 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:29.734174 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:29.734174 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:07:29.734174 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:07:29.734174 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60c4cea5-3b00-4614-a70d-e3fd589cc408 could not be found. Oct 26 13:07:29.734174 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:29.748439 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cd2cd3c7-e6ba-4687-ba34-114c4bc371e8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Returning 404 to user: Instance 60c4cea5-3b00-4614-a70d-e3fd589cc408 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:07:29.755027 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cd2cd3c7-e6ba-4687-ba34-114c4bc371e8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/60c4cea5-3b00-4614-a70d-e3fd589cc408" status: 404 len: 111 microversion: 2.1 time: 0.090719 Oct 26 13:07:29.759282 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 776/1452] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:29 2022] GET /compute/v2.1/servers/60c4cea5-3b00-4614-a70d-e3fd589cc408 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:07:29.773143 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8c3b2bc2-472d-44a5-a99a-16fe5a6c1e46 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:29.776882 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8c3b2bc2-472d-44a5-a99a-16fe5a6c1e46 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:29.790964 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8c3b2bc2-472d-44a5-a99a-16fe5a6c1e46 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:29.792406 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8c3b2bc2-472d-44a5-a99a-16fe5a6c1e46 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:29.793381 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8c3b2bc2-472d-44a5-a99a-16fe5a6c1e46 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:29.794421 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8c3b2bc2-472d-44a5-a99a-16fe5a6c1e46 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:29.795039 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8c3b2bc2-472d-44a5-a99a-16fe5a6c1e46 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:29.795617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8c3b2bc2-472d-44a5-a99a-16fe5a6c1e46 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:29.970507 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c4a1451c-dadd-4bb5-baa8-37a1ff754e33 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:29.987109 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c4a1451c-dadd-4bb5-baa8-37a1ff754e33 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27" status: 200 len: 1308 microversion: 2.1 time: 0.635298 Oct 26 13:07:29.999791 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 677/1453] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:29 2022] GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27 => generated 1308 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:30.018087 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-88fa2bf1-b065-4e29-b7ff-4f07bd4a07a5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:30.018715 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-88fa2bf1-b065-4e29-b7ff-4f07bd4a07a5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 025e46ee-bd4b-4c43-96ce-ee086ecafe24] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:30.036828 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88fa2bf1-b065-4e29-b7ff-4f07bd4a07a5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:30.048365 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88fa2bf1-b065-4e29-b7ff-4f07bd4a07a5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:30.048909 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88fa2bf1-b065-4e29-b7ff-4f07bd4a07a5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:30.052671 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88fa2bf1-b065-4e29-b7ff-4f07bd4a07a5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:30.053825 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88fa2bf1-b065-4e29-b7ff-4f07bd4a07a5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:30.054277 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88fa2bf1-b065-4e29-b7ff-4f07bd4a07a5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:30.165983 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88fa2bf1-b065-4e29-b7ff-4f07bd4a07a5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:30.166743 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88fa2bf1-b065-4e29-b7ff-4f07bd4a07a5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:30.167341 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88fa2bf1-b065-4e29-b7ff-4f07bd4a07a5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:30.167954 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-88fa2bf1-b065-4e29-b7ff-4f07bd4a07a5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lazy-loading 'fault' on Instance uuid 025e46ee-bd4b-4c43-96ce-ee086ecafe24 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:07:30.320715 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-88fa2bf1-b065-4e29-b7ff-4f07bd4a07a5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:30.331552 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-88fa2bf1-b065-4e29-b7ff-4f07bd4a07a5 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/025e46ee-bd4b-4c43-96ce-ee086ecafe24" status: 200 len: 1309 microversion: 2.1 time: 0.326096 Oct 26 13:07:30.335505 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 678/1454] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:30 2022] GET /compute/v2.1/servers/025e46ee-bd4b-4c43-96ce-ee086ecafe24 => generated 1309 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:30.347161 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0ab0912a-4a7c-4e03-b573-1d7f98ea289c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:30.354641 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0ab0912a-4a7c-4e03-b573-1d7f98ea289c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:30.376153 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ab0912a-4a7c-4e03-b573-1d7f98ea289c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:30.382673 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ab0912a-4a7c-4e03-b573-1d7f98ea289c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:30.383915 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ab0912a-4a7c-4e03-b573-1d7f98ea289c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:30.384952 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ab0912a-4a7c-4e03-b573-1d7f98ea289c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:30.385721 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ab0912a-4a7c-4e03-b573-1d7f98ea289c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:30.386409 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ab0912a-4a7c-4e03-b573-1d7f98ea289c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:30.919367 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8c3b2bc2-472d-44a5-a99a-16fe5a6c1e46 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:30.933632 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8c3b2bc2-472d-44a5-a99a-16fe5a6c1e46 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1473 microversion: 2.1 time: 1.170642 Oct 26 13:07:30.954485 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 777/1455] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:29 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1473 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:30.992578 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-670bdb94-d154-4e63-b55e-4c10af5fbb24 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:31.000409 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0ab0912a-4a7c-4e03-b573-1d7f98ea289c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:31.004556 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-670bdb94-d154-4e63-b55e-4c10af5fbb24 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] [instance: cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:31.013398 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0ab0912a-4a7c-4e03-b573-1d7f98ea289c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1476 microversion: 2.1 time: 0.676727 Oct 26 13:07:31.016658 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 679/1456] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:30 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1476 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:31.019758 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-670bdb94-d154-4e63-b55e-4c10af5fbb24 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:31.020537 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-670bdb94-d154-4e63-b55e-4c10af5fbb24 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:31.021455 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-670bdb94-d154-4e63-b55e-4c10af5fbb24 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:31.023151 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-670bdb94-d154-4e63-b55e-4c10af5fbb24 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:31.023862 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-670bdb94-d154-4e63-b55e-4c10af5fbb24 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:31.024013 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-258c6bf9-e6ba-490e-914a-0c577d5f9158 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:31.024501 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-258c6bf9-e6ba-490e-914a-0c577d5f9158 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 2803303a-ad72-4096-b524-69a583a56f03] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:31.025702 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-670bdb94-d154-4e63-b55e-4c10af5fbb24 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:31.032858 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-258c6bf9-e6ba-490e-914a-0c577d5f9158 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:31.033381 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-258c6bf9-e6ba-490e-914a-0c577d5f9158 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:31.033949 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-258c6bf9-e6ba-490e-914a-0c577d5f9158 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:31.034700 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-258c6bf9-e6ba-490e-914a-0c577d5f9158 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:31.041790 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-258c6bf9-e6ba-490e-914a-0c577d5f9158 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:31.042698 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-258c6bf9-e6ba-490e-914a-0c577d5f9158 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:31.049149 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-670bdb94-d154-4e63-b55e-4c10af5fbb24 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] HTTP exception thrown: Instance cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904 could not be found. Oct 26 13:07:31.050962 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-670bdb94-d154-4e63-b55e-4c10af5fbb24 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Request method failure captured: Oct 26 13:07:31.050962 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904 HTTP/1.1 Oct 26 13:07:31.050962 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:07:31.050962 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:07:31.050962 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:07:31.050962 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:07:31.050962 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:07:31.050962 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:07:31.050962 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:07:31.050962 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:07:31.050962 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTCzjU02WwlPIn0go9tFuSgvGoJ4tyXs08GsUfBt3wSbVdEw-a3jjvA47LU7fEM54SECBUXriSwAA_YRmorzEZ5qxZdXj1_GcRadDBJylUQ6zNRBEzaU7c7J_rfvYbtLW_-foYvLQKzbq2qLZrnkVwP47m44RWkpP7FcaMZXP7gLNNo Oct 26 13:07:31.050962 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:07:31.050962 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:07:31.050962 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:07:31.050962 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:07:31.050962 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:07:31.050962 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:07:31.050962 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 3a46daa2d3a043488473b65f18ebfefe Oct 26 13:07:31.050962 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-394142580 Oct 26 13:07:31.050962 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:07:31.050962 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:07:31.052525 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3a46daa2d3a043488473b65f18ebfefe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3a46daa2d3a043488473b65f18ebfefe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3a46daa2d3a043488473b65f18ebfefe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3a46daa2d3a043488473b65f18ebfefe"}]}] Oct 26 13:07:31.052525 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersAdminNegativeTestJSON-394142580 Oct 26 13:07:31.052525 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 3a46daa2d3a043488473b65f18ebfefe Oct 26 13:07:31.052525 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-394142580 Oct 26 13:07:31.052525 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersAdminNegativeTestJSON-394142580-project Oct 26 13:07:31.052525 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:07:31.052525 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:07:31.052525 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 71de4f9fbfb94d7da473e93e42591c5a Oct 26 13:07:31.052525 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersAdminNegativeTestJSON-394142580-project Oct 26 13:07:31.052525 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:07:31.052525 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904 could not be found. Oct 26 13:07:31.052525 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904'} Oct 26 13:07:31.053399 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:07:31.053399 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:31.053399 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:07:31.053399 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:07:31.053399 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:07:31.053399 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:07:31.053399 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:07:31.053399 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:07:31.053399 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:07:31.053399 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:07:31.053399 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904 could not be found. Oct 26 13:07:31.053399 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:31.053399 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:31.053399 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:31.053399 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:31.053399 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:31.053399 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:31.053399 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:07:31.053399 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:07:31.053399 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:07:31.054980 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:07:31.054980 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:07:31.054980 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:07:31.054980 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:07:31.054980 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:07:31.054980 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:07:31.054980 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:07:31.054980 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904 could not be found. Oct 26 13:07:31.054980 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:31.054980 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:31.054980 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:31.054980 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:31.054980 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:31.054980 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:31.054980 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:07:31.054980 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:07:31.054980 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904 could not be found. Oct 26 13:07:31.054980 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:31.071969 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-670bdb94-d154-4e63-b55e-4c10af5fbb24 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] Returning 404 to user: Instance cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:07:31.073171 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-670bdb94-d154-4e63-b55e-4c10af5fbb24 tempest-ServersAdminNegativeTestJSON-394142580 tempest-ServersAdminNegativeTestJSON-394142580-project] 10.222.0.40 "GET /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904" status: 404 len: 111 microversion: 2.1 time: 0.084808 Oct 26 13:07:31.076451 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-258c6bf9-e6ba-490e-914a-0c577d5f9158 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] HTTP exception thrown: Instance 2803303a-ad72-4096-b524-69a583a56f03 could not be found. Oct 26 13:07:31.078400 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-258c6bf9-e6ba-490e-914a-0c577d5f9158 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Request method failure captured: Oct 26 13:07:31.078400 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03 HTTP/1.1 Oct 26 13:07:31.078400 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:07:31.078400 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:07:31.078400 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:07:31.078400 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:07:31.078400 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:07:31.078400 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:07:31.078400 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:07:31.078400 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:07:31.078400 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTDWcY4mtHepJlQ55KVJtNHC-FXqIi903yr1J5OC-zbXOMs1LBU3zczKCFgnqIJBIqkvCLTFhaHFSdgfodLtkoXiluiPVf_SkgLznk0TL97DMnsRT29TeJsNzQAsUym5LCo50Ifxk2xlPnZ_QiGEmh7kAsukHuXMaWRZIS-UkeLc5o8 Oct 26 13:07:31.078400 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:07:31.078400 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:07:31.078400 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:07:31.078400 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:07:31.078400 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:07:31.078400 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:07:31.078400 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 186ac42922a64992aa1973bd854830d7 Oct 26 13:07:31.078400 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-778472214 Oct 26 13:07:31.078400 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:07:31.078400 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:07:31.080067 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/186ac42922a64992aa1973bd854830d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/186ac42922a64992aa1973bd854830d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_186ac42922a64992aa1973bd854830d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/186ac42922a64992aa1973bd854830d7"}]}] Oct 26 13:07:31.080067 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-778472214 Oct 26 13:07:31.080067 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 186ac42922a64992aa1973bd854830d7 Oct 26 13:07:31.080067 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-778472214 Oct 26 13:07:31.080067 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ImagesOneServerNegativeTestJSON-778472214-project Oct 26 13:07:31.080067 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:07:31.080067 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:07:31.080067 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 0b8d4ea396494628983bde1a97222f7d Oct 26 13:07:31.080067 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-778472214-project Oct 26 13:07:31.080067 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:07:31.080067 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 2803303a-ad72-4096-b524-69a583a56f03 could not be found. Oct 26 13:07:31.080067 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '2803303a-ad72-4096-b524-69a583a56f03'} Oct 26 13:07:31.081545 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:07:31.081545 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:31.081545 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:07:31.081545 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:07:31.081545 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:07:31.081545 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:07:31.081545 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:07:31.081545 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:07:31.081545 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:07:31.081545 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:07:31.081545 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2803303a-ad72-4096-b524-69a583a56f03 could not be found. Oct 26 13:07:31.081545 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:31.081545 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:31.081545 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:31.081545 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:31.081545 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:31.081545 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:31.081545 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:07:31.081545 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:07:31.081545 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:07:31.083014 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:07:31.083014 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:07:31.083014 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:07:31.083014 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:07:31.083014 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:07:31.083014 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:07:31.083014 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:07:31.083014 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2803303a-ad72-4096-b524-69a583a56f03 could not be found. Oct 26 13:07:31.083014 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:31.083014 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:31.083014 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:31.083014 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:31.083014 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:31.083014 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:31.083014 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:07:31.083014 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:07:31.083014 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2803303a-ad72-4096-b524-69a583a56f03 could not be found. Oct 26 13:07:31.083014 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:31.085550 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-258c6bf9-e6ba-490e-914a-0c577d5f9158 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Returning 404 to user: Instance 2803303a-ad72-4096-b524-69a583a56f03 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:07:31.086580 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-258c6bf9-e6ba-490e-914a-0c577d5f9158 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03" status: 404 len: 111 microversion: 2.1 time: 0.068781 Oct 26 13:07:31.087627 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 680/1457] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:31 2022] GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:07:31.090304 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 778/1458] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:30 2022] GET /compute/v2.1/servers/cc1a4aa6-28ab-4c73-9b73-0b0cea3b5904 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:07:31.092688 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8aacda84-69a7-4d36-b9f7-1cac729413ee tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:31.095536 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8aacda84-69a7-4d36-b9f7-1cac729413ee tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:31.102233 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8aacda84-69a7-4d36-b9f7-1cac729413ee tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:31.103226 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2814347e-23f8-4015-98d6-0ad04d441be7 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:31.103898 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2814347e-23f8-4015-98d6-0ad04d441be7 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: d426a4f6-fa08-47d2-a583-735600b77f27] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:31.104101 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8aacda84-69a7-4d36-b9f7-1cac729413ee tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:31.104715 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8aacda84-69a7-4d36-b9f7-1cac729413ee tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:31.105679 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8aacda84-69a7-4d36-b9f7-1cac729413ee tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:31.106304 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8aacda84-69a7-4d36-b9f7-1cac729413ee tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:31.107416 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8aacda84-69a7-4d36-b9f7-1cac729413ee tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:31.116489 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2814347e-23f8-4015-98d6-0ad04d441be7 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:31.116905 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2814347e-23f8-4015-98d6-0ad04d441be7 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:31.119304 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2814347e-23f8-4015-98d6-0ad04d441be7 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:31.123525 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2814347e-23f8-4015-98d6-0ad04d441be7 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:31.125729 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2814347e-23f8-4015-98d6-0ad04d441be7 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:31.127166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2814347e-23f8-4015-98d6-0ad04d441be7 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:31.156106 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8aacda84-69a7-4d36-b9f7-1cac729413ee tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.067248 Oct 26 13:07:31.157147 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 681/1459] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Oct 26 13:07:31 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:07:31.174542 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e2bdf45c-0558-48c4-b90c-de69ae6fdb04 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Action: 'create', calling method: .version_select at 0x7f673274db80>, body: {"keypair": {"name": "tempest-keypair-1220212086", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhyDTKyrROF7zbCIeBNSJ0WnB6v0iQD2jZbELYMgDnBsiOYTplJadD0RyOqv0/EvM75MdDrgpEiPML94JCM5tVIOw9aKCx9kyfMQiKVxjXgMF9NPO1zXz1dnVHcFEdhZA=="}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:31.196048 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-e2bdf45c-0558-48c4-b90c-de69ae6fdb04 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Getting quotas for project 186ac42922a64992aa1973bd854830d7. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:07:31.201440 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-e2bdf45c-0558-48c4-b90c-de69ae6fdb04 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Getting quotas for user 0b8d4ea396494628983bde1a97222f7d and project 186ac42922a64992aa1973bd854830d7. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:07:31.237210 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e2bdf45c-0558-48c4-b90c-de69ae6fdb04 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.078288 Oct 26 13:07:31.238356 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 682/1460] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 13:07:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:07:31.355693 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d7f04e06-7629-433a-8bec-74d6c848bdd7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:31.358822 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d7f04e06-7629-433a-8bec-74d6c848bdd7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 025e46ee-bd4b-4c43-96ce-ee086ecafe24] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:31.377614 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7f04e06-7629-433a-8bec-74d6c848bdd7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:31.384477 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7f04e06-7629-433a-8bec-74d6c848bdd7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:31.388857 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7f04e06-7629-433a-8bec-74d6c848bdd7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:31.391566 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7f04e06-7629-433a-8bec-74d6c848bdd7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:31.395765 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7f04e06-7629-433a-8bec-74d6c848bdd7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:31.398933 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7f04e06-7629-433a-8bec-74d6c848bdd7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:31.462086 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-d7f04e06-7629-433a-8bec-74d6c848bdd7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] HTTP exception thrown: Instance 025e46ee-bd4b-4c43-96ce-ee086ecafe24 could not be found. Oct 26 13:07:31.469229 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d7f04e06-7629-433a-8bec-74d6c848bdd7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Request method failure captured: Oct 26 13:07:31.469229 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/025e46ee-bd4b-4c43-96ce-ee086ecafe24 HTTP/1.1 Oct 26 13:07:31.469229 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:07:31.469229 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:07:31.469229 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:07:31.469229 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:07:31.469229 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:07:31.469229 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:07:31.469229 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:07:31.469229 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:07:31.469229 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTBPRVt_8YZnaMSFiptNqbU9QNU93-_uVsnIl5oPaIxTkieW3pGz0zJKB63vkS1UTm30oE-_Ib6tVEIUcfod49uJs_R6L4h_NtP5w4W8pi8x5J4f1QqVVXViMhIM2rv6Z6M-Vnp8kRHMISIYhq0EFTwFrWnXPDyjXTUbEUwh3-ynQvQ Oct 26 13:07:31.469229 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:07:31.469229 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:07:31.469229 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:07:31.469229 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:07:31.469229 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:07:31.469229 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:07:31.469229 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: d6515917885c4f3cb5fb19e05f4e5e2b Oct 26 13:07:31.469229 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersOnMultiNodesTest-1287428008 Oct 26 13:07:31.469229 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:07:31.469229 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:07:31.470899 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d6515917885c4f3cb5fb19e05f4e5e2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d6515917885c4f3cb5fb19e05f4e5e2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d6515917885c4f3cb5fb19e05f4e5e2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d6515917885c4f3cb5fb19e05f4e5e2b"}]}] Oct 26 13:07:31.470899 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersOnMultiNodesTest-1287428008 Oct 26 13:07:31.470899 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: d6515917885c4f3cb5fb19e05f4e5e2b Oct 26 13:07:31.470899 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1287428008 Oct 26 13:07:31.470899 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersOnMultiNodesTest-1287428008-project Oct 26 13:07:31.470899 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:07:31.470899 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:07:31.470899 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: b6cddfeca4ce49788143b2bf4b30545f Oct 26 13:07:31.470899 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersOnMultiNodesTest-1287428008-project Oct 26 13:07:31.470899 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:07:31.470899 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 025e46ee-bd4b-4c43-96ce-ee086ecafe24 could not be found. Oct 26 13:07:31.470899 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '025e46ee-bd4b-4c43-96ce-ee086ecafe24'} Oct 26 13:07:31.471792 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:07:31.471792 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:31.471792 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:07:31.471792 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:07:31.471792 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:07:31.471792 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:07:31.471792 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:07:31.471792 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:07:31.471792 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:07:31.471792 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:07:31.471792 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 025e46ee-bd4b-4c43-96ce-ee086ecafe24 could not be found. Oct 26 13:07:31.471792 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:31.471792 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:31.471792 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:31.471792 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:31.471792 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:31.471792 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:31.471792 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:07:31.471792 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:07:31.471792 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:07:31.473245 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:07:31.473245 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:07:31.473245 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:07:31.473245 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:07:31.473245 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:07:31.473245 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:07:31.473245 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:07:31.473245 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 025e46ee-bd4b-4c43-96ce-ee086ecafe24 could not be found. Oct 26 13:07:31.473245 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:31.473245 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:31.473245 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:31.473245 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:31.473245 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:31.473245 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:31.473245 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:07:31.473245 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:07:31.473245 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 025e46ee-bd4b-4c43-96ce-ee086ecafe24 could not be found. Oct 26 13:07:31.473245 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:31.478494 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d7f04e06-7629-433a-8bec-74d6c848bdd7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Returning 404 to user: Instance 025e46ee-bd4b-4c43-96ce-ee086ecafe24 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:07:31.480260 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d7f04e06-7629-433a-8bec-74d6c848bdd7 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/025e46ee-bd4b-4c43-96ce-ee086ecafe24" status: 404 len: 111 microversion: 2.1 time: 0.129271 Oct 26 13:07:31.488377 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 683/1461] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:31 2022] GET /compute/v2.1/servers/025e46ee-bd4b-4c43-96ce-ee086ecafe24 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 13:07:31.508703 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d257d93f-8810-403a-86bc-695af64fe6b8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:31.565994 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2814347e-23f8-4015-98d6-0ad04d441be7 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:31.582296 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2814347e-23f8-4015-98d6-0ad04d441be7 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27" status: 200 len: 1308 microversion: 2.1 time: 0.490803 Oct 26 13:07:31.582948 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 779/1462] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:31 2022] GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27 => generated 1308 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:31.607173 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d257d93f-8810-403a-86bc-695af64fe6b8 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/c60de25a-4a7c-479c-a06e-5f66faf76b57" status: 204 len: 0 microversion: 2.1 time: 0.116099 Oct 26 13:07:31.613244 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 684/1463] 10.222.0.40 () {58 vars in 1266 bytes} [Wed Oct 26 13:07:31 2022] DELETE /compute/v2.1/os-server-groups/c60de25a-4a7c-479c-a06e-5f66faf76b57 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:07:31.628255 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3cdeadf5-a276-4311-9e7f-df696232156a tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:31.629047 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3cdeadf5-a276-4311-9e7f-df696232156a tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 4c694a16-fdba-414f-9122-1899cc715565] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:31.637564 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cdeadf5-a276-4311-9e7f-df696232156a tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:31.638463 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cdeadf5-a276-4311-9e7f-df696232156a tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:31.638909 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cdeadf5-a276-4311-9e7f-df696232156a tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:31.639626 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cdeadf5-a276-4311-9e7f-df696232156a tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:31.640080 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cdeadf5-a276-4311-9e7f-df696232156a tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:31.640505 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cdeadf5-a276-4311-9e7f-df696232156a tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:31.713713 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3cdeadf5-a276-4311-9e7f-df696232156a tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 4c694a16-fdba-414f-9122-1899cc715565] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:07:31.802192 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-c48666bc-46db-4d78-93e3-45ff1e716ab4 req-6d2a640f-6a13-4513-a417-6ec5eaf2113a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "025e46ee-bd4b-4c43-96ce-ee086ecafe24", "name": "network-vif-deleted", "tag": "c77ced81-786f-403c-bb03-35100bde9f26"}, {"server_uuid": "2803303a-ad72-4096-b524-69a583a56f03", "name": "network-vif-deleted", "tag": "1d2c7a75-3140-4fe8-a8c6-96801d8b0941"}, {"name": "network-changed", "server_uuid": "f27f0232-1c7a-433d-a8ed-9ef4f631b924", "tag": "77991740-2ec4-4120-929b-065a4a4a02c8"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:31.840391 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-c48666bc-46db-4d78-93e3-45ff1e716ab4 req-6d2a640f-6a13-4513-a417-6ec5eaf2113a service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:31.841141 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-c48666bc-46db-4d78-93e3-45ff1e716ab4 req-6d2a640f-6a13-4513-a417-6ec5eaf2113a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:31.842273 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-c48666bc-46db-4d78-93e3-45ff1e716ab4 req-6d2a640f-6a13-4513-a417-6ec5eaf2113a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:31.876659 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-c48666bc-46db-4d78-93e3-45ff1e716ab4 req-6d2a640f-6a13-4513-a417-6ec5eaf2113a service nova] Creating event network-vif-deleted:c77ced81-786f-403c-bb03-35100bde9f26 for instance 025e46ee-bd4b-4c43-96ce-ee086ecafe24 on n-h2-862686-1 Oct 26 13:07:31.877578 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-c48666bc-46db-4d78-93e3-45ff1e716ab4 req-6d2a640f-6a13-4513-a417-6ec5eaf2113a service nova] Creating event network-vif-deleted:1d2c7a75-3140-4fe8-a8c6-96801d8b0941 for instance 2803303a-ad72-4096-b524-69a583a56f03 on n-h1-862686-1 Oct 26 13:07:31.881344 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-c48666bc-46db-4d78-93e3-45ff1e716ab4 req-6d2a640f-6a13-4513-a417-6ec5eaf2113a service nova] Creating event network-changed:77991740-2ec4-4120-929b-065a4a4a02c8 for instance f27f0232-1c7a-433d-a8ed-9ef4f631b924 on n-h1-862686-1 Oct 26 13:07:31.894825 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3cdeadf5-a276-4311-9e7f-df696232156a tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4c694a16-fdba-414f-9122-1899cc715565" status: 204 len: 0 microversion: 2.1 time: 0.275703 Oct 26 13:07:31.896258 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 780/1464] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:07:31 2022] DELETE /compute/v2.1/servers/4c694a16-fdba-414f-9122-1899cc715565 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 26 13:07:31.909075 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2c2865b1-a344-4fec-88f1-5d2c0794f8fd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:31.909621 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-c48666bc-46db-4d78-93e3-45ff1e716ab4 req-6d2a640f-6a13-4513-a417-6ec5eaf2113a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.112534 Oct 26 13:07:31.909842 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2c2865b1-a344-4fec-88f1-5d2c0794f8fd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 4c694a16-fdba-414f-9122-1899cc715565] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:31.912532 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 685/1465] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:07:31.927587 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2c2865b1-a344-4fec-88f1-5d2c0794f8fd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:31.929640 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2c2865b1-a344-4fec-88f1-5d2c0794f8fd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:31.930275 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2c2865b1-a344-4fec-88f1-5d2c0794f8fd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:31.931863 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2c2865b1-a344-4fec-88f1-5d2c0794f8fd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:31.932491 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2c2865b1-a344-4fec-88f1-5d2c0794f8fd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:31.933842 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2c2865b1-a344-4fec-88f1-5d2c0794f8fd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:31.940611 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:07:31.967341 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-97b6fefe-f7f8-4c1f-905d-e25d63bde095 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:31.968050 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-97b6fefe-f7f8-4c1f-905d-e25d63bde095 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:31.995998 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-97b6fefe-f7f8-4c1f-905d-e25d63bde095 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:31.996663 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-97b6fefe-f7f8-4c1f-905d-e25d63bde095 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:31.997188 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-97b6fefe-f7f8-4c1f-905d-e25d63bde095 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:32.000483 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-97b6fefe-f7f8-4c1f-905d-e25d63bde095 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:32.001228 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-97b6fefe-f7f8-4c1f-905d-e25d63bde095 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:32.004683 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-97b6fefe-f7f8-4c1f-905d-e25d63bde095 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:32.329287 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-97b6fefe-f7f8-4c1f-905d-e25d63bde095 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:32.377896 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-97b6fefe-f7f8-4c1f-905d-e25d63bde095 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1473 microversion: 2.1 time: 0.416489 Oct 26 13:07:32.379329 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 686/1466] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:31 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1473 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:32.401845 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6de63f3e-4359-4514-b469-592d11701ba9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:32.402513 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6de63f3e-4359-4514-b469-592d11701ba9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:32.413269 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6de63f3e-4359-4514-b469-592d11701ba9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:32.415615 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6de63f3e-4359-4514-b469-592d11701ba9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:32.420456 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6de63f3e-4359-4514-b469-592d11701ba9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:32.421783 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6de63f3e-4359-4514-b469-592d11701ba9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:32.421942 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6de63f3e-4359-4514-b469-592d11701ba9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:32.422382 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6de63f3e-4359-4514-b469-592d11701ba9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:32.548748 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2c2865b1-a344-4fec-88f1-5d2c0794f8fd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:32.558894 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2c2865b1-a344-4fec-88f1-5d2c0794f8fd tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/4c694a16-fdba-414f-9122-1899cc715565" status: 200 len: 1472 microversion: 2.1 time: 0.657227 Oct 26 13:07:32.576214 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 781/1467] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:31 2022] GET /compute/v2.1/servers/4c694a16-fdba-414f-9122-1899cc715565 => generated 1472 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:32.581932 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b061bd9e-0c9a-4d2b-8cc0-db722bd40f59 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:32.602324 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b061bd9e-0c9a-4d2b-8cc0-db722bd40f59 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:32.625323 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b061bd9e-0c9a-4d2b-8cc0-db722bd40f59 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:32.626415 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b061bd9e-0c9a-4d2b-8cc0-db722bd40f59 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:32.627982 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b061bd9e-0c9a-4d2b-8cc0-db722bd40f59 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:32.629086 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b061bd9e-0c9a-4d2b-8cc0-db722bd40f59 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:32.632341 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b061bd9e-0c9a-4d2b-8cc0-db722bd40f59 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:32.634127 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b061bd9e-0c9a-4d2b-8cc0-db722bd40f59 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:32.729641 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b061bd9e-0c9a-4d2b-8cc0-db722bd40f59 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.151710 Oct 26 13:07:32.737586 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 782/1468] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Oct 26 13:07:32 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:07:32.747663 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a140d072-bf04-4aac-9b5d-81271dac8e78 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:32.748622 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a140d072-bf04-4aac-9b5d-81271dac8e78 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: d426a4f6-fa08-47d2-a583-735600b77f27] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:32.755524 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a140d072-bf04-4aac-9b5d-81271dac8e78 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:32.757455 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a140d072-bf04-4aac-9b5d-81271dac8e78 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:32.758378 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a140d072-bf04-4aac-9b5d-81271dac8e78 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:32.759315 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a140d072-bf04-4aac-9b5d-81271dac8e78 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:32.759991 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a140d072-bf04-4aac-9b5d-81271dac8e78 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:32.760741 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a140d072-bf04-4aac-9b5d-81271dac8e78 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:32.778056 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6de63f3e-4359-4514-b469-592d11701ba9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:32.786597 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6de63f3e-4359-4514-b469-592d11701ba9 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1476 microversion: 2.1 time: 0.404678 Oct 26 13:07:32.798608 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 687/1469] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:32 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1476 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:33.129847 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a140d072-bf04-4aac-9b5d-81271dac8e78 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:33.139887 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a140d072-bf04-4aac-9b5d-81271dac8e78 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27" status: 200 len: 1488 microversion: 2.1 time: 0.400920 Oct 26 13:07:33.157422 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 783/1470] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:32 2022] GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27 => generated 1488 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:33.169301 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e641a267-edb9-443e-99fb-3835a6a8cdd4 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:33.187672 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e641a267-edb9-443e-99fb-3835a6a8cdd4 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:33.188792 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e641a267-edb9-443e-99fb-3835a6a8cdd4 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:33.189243 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e641a267-edb9-443e-99fb-3835a6a8cdd4 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:33.285969 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e641a267-edb9-443e-99fb-3835a6a8cdd4 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: d426a4f6-fa08-47d2-a583-735600b77f27] Going to try to stop instance {{(pid=120597) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 26 13:07:33.306013 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:07:33.344374 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e641a267-edb9-443e-99fb-3835a6a8cdd4 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "POST /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27/action" status: 202 len: 0 microversion: 2.1 time: 0.179257 Oct 26 13:07:33.345867 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 688/1471] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:07:33 2022] POST /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:07:33.367250 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-810e2a3f-6c5a-42aa-8344-c43ec4355892 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:33.367941 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-810e2a3f-6c5a-42aa-8344-c43ec4355892 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: d426a4f6-fa08-47d2-a583-735600b77f27] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:33.388171 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-810e2a3f-6c5a-42aa-8344-c43ec4355892 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:33.405326 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0ba60daa-e257-4c84-9e7b-12d64918f061 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:33.407032 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0ba60daa-e257-4c84-9e7b-12d64918f061 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:33.407533 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-810e2a3f-6c5a-42aa-8344-c43ec4355892 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:33.408003 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-810e2a3f-6c5a-42aa-8344-c43ec4355892 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:33.410809 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-810e2a3f-6c5a-42aa-8344-c43ec4355892 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:33.423528 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-810e2a3f-6c5a-42aa-8344-c43ec4355892 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:33.425289 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-810e2a3f-6c5a-42aa-8344-c43ec4355892 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:33.441796 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ba60daa-e257-4c84-9e7b-12d64918f061 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:33.446730 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ba60daa-e257-4c84-9e7b-12d64918f061 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:33.450011 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ba60daa-e257-4c84-9e7b-12d64918f061 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:33.451822 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ba60daa-e257-4c84-9e7b-12d64918f061 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:33.452298 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ba60daa-e257-4c84-9e7b-12d64918f061 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:33.452727 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ba60daa-e257-4c84-9e7b-12d64918f061 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:33.666743 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-810e2a3f-6c5a-42aa-8344-c43ec4355892 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:33.682465 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-810e2a3f-6c5a-42aa-8344-c43ec4355892 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27" status: 200 len: 1498 microversion: 2.1 time: 0.326100 Oct 26 13:07:33.688856 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 784/1472] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:33 2022] GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27 => generated 1498 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:33.694554 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e336d758-958f-4240-a846-4aa9327a34e1 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:33.698895 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e336d758-958f-4240-a846-4aa9327a34e1 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 4c694a16-fdba-414f-9122-1899cc715565] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:33.719002 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e336d758-958f-4240-a846-4aa9327a34e1 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:33.722768 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e336d758-958f-4240-a846-4aa9327a34e1 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:33.723564 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e336d758-958f-4240-a846-4aa9327a34e1 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:33.729166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e336d758-958f-4240-a846-4aa9327a34e1 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:33.730550 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e336d758-958f-4240-a846-4aa9327a34e1 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:33.730877 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e336d758-958f-4240-a846-4aa9327a34e1 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:34.030080 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e336d758-958f-4240-a846-4aa9327a34e1 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:34.040027 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0ba60daa-e257-4c84-9e7b-12d64918f061 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:34.040417 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e336d758-958f-4240-a846-4aa9327a34e1 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/4c694a16-fdba-414f-9122-1899cc715565" status: 200 len: 1472 microversion: 2.1 time: 0.350388 Oct 26 13:07:34.040963 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 785/1473] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:33 2022] GET /compute/v2.1/servers/4c694a16-fdba-414f-9122-1899cc715565 => generated 1472 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:34.051258 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0ba60daa-e257-4c84-9e7b-12d64918f061 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1473 microversion: 2.1 time: 0.650487 Oct 26 13:07:34.052356 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 689/1474] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:33 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1473 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:34.058103 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-be9399b8-0111-4f03-a386-c703972dc3f0 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:34.066340 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-be9399b8-0111-4f03-a386-c703972dc3f0 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:34.075498 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-be9399b8-0111-4f03-a386-c703972dc3f0 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:34.077452 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-08a57e85-e0fd-4d4c-9d69-b50865296d37 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:34.078190 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-be9399b8-0111-4f03-a386-c703972dc3f0 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:34.080222 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-08a57e85-e0fd-4d4c-9d69-b50865296d37 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:34.080789 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-be9399b8-0111-4f03-a386-c703972dc3f0 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:34.081732 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-be9399b8-0111-4f03-a386-c703972dc3f0 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:34.082403 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-be9399b8-0111-4f03-a386-c703972dc3f0 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:34.083045 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-be9399b8-0111-4f03-a386-c703972dc3f0 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:34.087006 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-08a57e85-e0fd-4d4c-9d69-b50865296d37 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:34.087696 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-08a57e85-e0fd-4d4c-9d69-b50865296d37 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:34.088302 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-08a57e85-e0fd-4d4c-9d69-b50865296d37 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:34.089176 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-08a57e85-e0fd-4d4c-9d69-b50865296d37 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:34.089817 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-08a57e85-e0fd-4d4c-9d69-b50865296d37 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:34.090404 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-08a57e85-e0fd-4d4c-9d69-b50865296d37 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:34.126318 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-08a57e85-e0fd-4d4c-9d69-b50865296d37 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.071443 Oct 26 13:07:34.132297 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 786/1475] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Oct 26 13:07:34 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:07:34.474540 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-be9399b8-0111-4f03-a386-c703972dc3f0 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:34.485384 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-be9399b8-0111-4f03-a386-c703972dc3f0 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1476 microversion: 2.1 time: 0.430806 Oct 26 13:07:34.485991 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 690/1476] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:34 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1476 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:34.711973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7233dbf9-361c-4f43-8ae5-e0f3e3d8c8ef tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:34.712713 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7233dbf9-361c-4f43-8ae5-e0f3e3d8c8ef tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: d426a4f6-fa08-47d2-a583-735600b77f27] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:34.727569 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7233dbf9-361c-4f43-8ae5-e0f3e3d8c8ef tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:34.757437 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7233dbf9-361c-4f43-8ae5-e0f3e3d8c8ef tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:34.758236 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7233dbf9-361c-4f43-8ae5-e0f3e3d8c8ef tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:34.760076 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7233dbf9-361c-4f43-8ae5-e0f3e3d8c8ef tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:34.770759 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7233dbf9-361c-4f43-8ae5-e0f3e3d8c8ef tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:34.771473 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7233dbf9-361c-4f43-8ae5-e0f3e3d8c8ef tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:34.945883 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-250c3201-bb91-4691-976d-e2cafbe558d5 req-85766f58-0a6d-4f91-8987-d0e5eb6f061d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c694a16-fdba-414f-9122-1899cc715565", "name": "network-vif-deleted", "tag": "ada02b45-c859-4cf1-a9a4-d28591f7a07b"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:34.971000 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-250c3201-bb91-4691-976d-e2cafbe558d5 req-85766f58-0a6d-4f91-8987-d0e5eb6f061d service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:34.971495 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-250c3201-bb91-4691-976d-e2cafbe558d5 req-85766f58-0a6d-4f91-8987-d0e5eb6f061d service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:34.977158 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-250c3201-bb91-4691-976d-e2cafbe558d5 req-85766f58-0a6d-4f91-8987-d0e5eb6f061d service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:35.020385 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-250c3201-bb91-4691-976d-e2cafbe558d5 req-85766f58-0a6d-4f91-8987-d0e5eb6f061d service nova] Creating event network-vif-deleted:ada02b45-c859-4cf1-a9a4-d28591f7a07b for instance 4c694a16-fdba-414f-9122-1899cc715565 on n-h1-862686-1 Oct 26 13:07:35.036357 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-250c3201-bb91-4691-976d-e2cafbe558d5 req-85766f58-0a6d-4f91-8987-d0e5eb6f061d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096138 Oct 26 13:07:35.036964 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 691/1477] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:07:35.061788 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7233dbf9-361c-4f43-8ae5-e0f3e3d8c8ef tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:35.070340 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7233dbf9-361c-4f43-8ae5-e0f3e3d8c8ef tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27" status: 200 len: 1498 microversion: 2.1 time: 0.363523 Oct 26 13:07:35.070934 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 787/1478] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:34 2022] GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27 => generated 1498 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:35.087264 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-98e857ee-789b-45a6-a066-cdc9144214ea tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:35.093901 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-98e857ee-789b-45a6-a066-cdc9144214ea tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:35.094824 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f08ccb87-be37-4349-804a-2b8850334830 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:35.095908 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f08ccb87-be37-4349-804a-2b8850334830 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 4c694a16-fdba-414f-9122-1899cc715565] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:35.103284 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-98e857ee-789b-45a6-a066-cdc9144214ea tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:35.104670 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f08ccb87-be37-4349-804a-2b8850334830 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:35.105333 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f08ccb87-be37-4349-804a-2b8850334830 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:35.106156 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f08ccb87-be37-4349-804a-2b8850334830 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:35.107029 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f08ccb87-be37-4349-804a-2b8850334830 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:35.107239 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-98e857ee-789b-45a6-a066-cdc9144214ea tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:35.107849 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f08ccb87-be37-4349-804a-2b8850334830 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:35.107993 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-98e857ee-789b-45a6-a066-cdc9144214ea tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:35.108282 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f08ccb87-be37-4349-804a-2b8850334830 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:35.109263 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-98e857ee-789b-45a6-a066-cdc9144214ea tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:35.111295 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-98e857ee-789b-45a6-a066-cdc9144214ea tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:35.111753 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-98e857ee-789b-45a6-a066-cdc9144214ea tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:35.243427 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f08ccb87-be37-4349-804a-2b8850334830 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:35.244771 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f08ccb87-be37-4349-804a-2b8850334830 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:35.247316 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f08ccb87-be37-4349-804a-2b8850334830 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:35.248203 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-f08ccb87-be37-4349-804a-2b8850334830 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lazy-loading 'fault' on Instance uuid 4c694a16-fdba-414f-9122-1899cc715565 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:07:35.341209 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f08ccb87-be37-4349-804a-2b8850334830 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:35.350654 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f08ccb87-be37-4349-804a-2b8850334830 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/4c694a16-fdba-414f-9122-1899cc715565" status: 200 len: 1307 microversion: 2.1 time: 0.270196 Oct 26 13:07:35.362001 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 692/1479] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:35 2022] GET /compute/v2.1/servers/4c694a16-fdba-414f-9122-1899cc715565 => generated 1307 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:35.390852 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6a049288-f7a1-44c0-9b3e-771647c49908 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:35.393537 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6a049288-f7a1-44c0-9b3e-771647c49908 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:35.419901 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6a049288-f7a1-44c0-9b3e-771647c49908 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:35.420410 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6a049288-f7a1-44c0-9b3e-771647c49908 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:35.420855 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6a049288-f7a1-44c0-9b3e-771647c49908 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:35.421605 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6a049288-f7a1-44c0-9b3e-771647c49908 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:35.422063 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6a049288-f7a1-44c0-9b3e-771647c49908 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:35.422489 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6a049288-f7a1-44c0-9b3e-771647c49908 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:35.440640 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-98e857ee-789b-45a6-a066-cdc9144214ea tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:35.450514 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-98e857ee-789b-45a6-a066-cdc9144214ea tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1473 microversion: 2.1 time: 0.368218 Oct 26 13:07:35.456579 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 788/1480] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:35 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1473 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:35.504976 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6a049288-f7a1-44c0-9b3e-771647c49908 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.138603 Oct 26 13:07:35.507533 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 693/1481] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Oct 26 13:07:35 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:07:35.510602 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-866c287a-4f6e-48ab-ac5d-1fe07c2e5428 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:35.511418 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-866c287a-4f6e-48ab-ac5d-1fe07c2e5428 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:35.519799 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-866c287a-4f6e-48ab-ac5d-1fe07c2e5428 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:35.520295 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-866c287a-4f6e-48ab-ac5d-1fe07c2e5428 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:35.520731 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-866c287a-4f6e-48ab-ac5d-1fe07c2e5428 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:35.522085 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-866c287a-4f6e-48ab-ac5d-1fe07c2e5428 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:35.522547 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-866c287a-4f6e-48ab-ac5d-1fe07c2e5428 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:35.522980 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-866c287a-4f6e-48ab-ac5d-1fe07c2e5428 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:35.723540 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-866c287a-4f6e-48ab-ac5d-1fe07c2e5428 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:35.735351 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-866c287a-4f6e-48ab-ac5d-1fe07c2e5428 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1476 microversion: 2.1 time: 0.230230 Oct 26 13:07:35.735942 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 789/1482] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:35 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1476 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:07:36.096192 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a46bd198-9c8e-4a24-a42d-9ab6cd877daa tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:36.096722 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a46bd198-9c8e-4a24-a42d-9ab6cd877daa tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: d426a4f6-fa08-47d2-a583-735600b77f27] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:36.103238 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a46bd198-9c8e-4a24-a42d-9ab6cd877daa tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:36.103721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a46bd198-9c8e-4a24-a42d-9ab6cd877daa tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:36.104330 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a46bd198-9c8e-4a24-a42d-9ab6cd877daa tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:36.105194 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a46bd198-9c8e-4a24-a42d-9ab6cd877daa tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:36.105674 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a46bd198-9c8e-4a24-a42d-9ab6cd877daa tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:36.106359 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a46bd198-9c8e-4a24-a42d-9ab6cd877daa tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:36.192142 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4a3b04b3-ebf1-43ca-9ffa-73f638439e7c tempest-ImagesMetadataNegativeTestJSON-391193339 tempest-ImagesMetadataNegativeTestJSON-391193339-project] Calling method '.version_select at 0x7f67323a5a60>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:36.218680 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-4a3b04b3-ebf1-43ca-9ffa-73f638439e7c tempest-ImagesMetadataNegativeTestJSON-391193339 tempest-ImagesMetadataNegativeTestJSON-391193339-project] HTTP exception thrown: Image not found. Oct 26 13:07:36.229299 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4a3b04b3-ebf1-43ca-9ffa-73f638439e7c tempest-ImagesMetadataNegativeTestJSON-391193339 tempest-ImagesMetadataNegativeTestJSON-391193339-project] Request method failure captured: Oct 26 13:07:36.229299 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/images/b6447f37-224e-446f-a834-769cbbb32f06/metadata/os_distro HTTP/1.1 Oct 26 13:07:36.229299 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:07:36.229299 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:07:36.229299 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:07:36.229299 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:07:36.229299 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:07:36.229299 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:07:36.229299 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:07:36.229299 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:07:36.229299 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTEXmFcZoYsUwR0MK-kbtPNbM1XlSPVOsfADpMnW7gnlB9i6z0_IZg4sK5-3H2xAALc0AtEvr3UIqDczPzmFR0xD8rdyhw8EBI1OB1adV6XrwUOTILBNsiEyxWaehoObcAwAg-y5AeYJ-DuCVlsTfBMXCg_bn8qhe1Hjgv0ju0wEI7I Oct 26 13:07:36.229299 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:07:36.229299 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:07:36.229299 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:07:36.229299 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:07:36.229299 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:07:36.229299 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:07:36.229299 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 9b4e3e0bcd804f018163edf6c9198931 Oct 26 13:07:36.229299 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-391193339 Oct 26 13:07:36.229299 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:07:36.229299 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:07:36.230819 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9b4e3e0bcd804f018163edf6c9198931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9b4e3e0bcd804f018163edf6c9198931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9b4e3e0bcd804f018163edf6c9198931"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9b4e3e0bcd804f018163edf6c9198931"}]}] Oct 26 13:07:36.230819 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-391193339 Oct 26 13:07:36.230819 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 9b4e3e0bcd804f018163edf6c9198931 Oct 26 13:07:36.230819 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-391193339 Oct 26 13:07:36.230819 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ImagesMetadataNegativeTestJSON-391193339-project Oct 26 13:07:36.230819 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:07:36.230819 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:07:36.230819 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 5069f98b4bfc426b8ad281c72b04edce Oct 26 13:07:36.230819 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-391193339-project Oct 26 13:07:36.230819 n-d-862686-1 devstack@n-api.service[120597]: method: Oct 26 13:07:36.230819 n-d-862686-1 devstack@n-api.service[120597]: exception: Image not found. Oct 26 13:07:36.230819 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'image_id': 'b6447f37-224e-446f-a834-769cbbb32f06', 'id': 'os_distro'} Oct 26 13:07:36.230819 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:07:36.231759 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:36.231759 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 26 13:07:36.231759 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 26 13:07:36.231759 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 13:07:36.231759 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 13:07:36.231759 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 26 13:07:36.231759 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 26 13:07:36.231759 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 13:07:36.231759 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 13:07:36.231759 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 26 13:07:36.231759 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 26 13:07:36.231759 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 26 13:07:36.231759 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 26 13:07:36.231759 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 13:07:36.231759 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 13:07:36.231759 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 13:07:36.231759 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 13:07:36.231759 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b6447f37-224e-446f-a834-769cbbb32f06 Oct 26 13:07:36.232906 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:36.232906 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:36.232906 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:36.232906 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:36.232906 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 26 13:07:36.232906 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 26 13:07:36.232906 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 26 13:07:36.232906 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 26 13:07:36.232906 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 26 13:07:36.232906 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 26 13:07:36.232906 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 26 13:07:36.232906 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 26 13:07:36.232906 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 26 13:07:36.232906 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 26 13:07:36.232906 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 13:07:36.232906 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 13:07:36.232906 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 26 13:07:36.232906 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 26 13:07:36.232906 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 13:07:36.232906 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 13:07:36.234173 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 26 13:07:36.234173 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 26 13:07:36.234173 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 26 13:07:36.234173 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 26 13:07:36.234173 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 13:07:36.234173 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 13:07:36.234173 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 13:07:36.234173 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 13:07:36.234173 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b6447f37-224e-446f-a834-769cbbb32f06 could not be found. Oct 26 13:07:36.234173 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:36.234173 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:36.234173 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:36.234173 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:36.234173 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:36.234173 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:36.234173 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:07:36.234173 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:07:36.234173 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:07:36.234173 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:07:36.235395 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:07:36.235395 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:07:36.235395 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 26 13:07:36.235395 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 26 13:07:36.235395 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 26 13:07:36.235395 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 26 13:07:36.235395 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 26 13:07:36.235395 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:36.235395 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:36.235395 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:36.235395 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:36.235395 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:36.235395 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:36.235395 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:07:36.235395 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:07:36.235395 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 26 13:07:36.235395 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:36.239021 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4a3b04b3-ebf1-43ca-9ffa-73f638439e7c tempest-ImagesMetadataNegativeTestJSON-391193339 tempest-ImagesMetadataNegativeTestJSON-391193339-project] Returning 404 to user: Image not found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:07:36.240139 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4a3b04b3-ebf1-43ca-9ffa-73f638439e7c tempest-ImagesMetadataNegativeTestJSON-391193339 tempest-ImagesMetadataNegativeTestJSON-391193339-project] 10.222.0.40 "DELETE /compute/v2.1/images/b6447f37-224e-446f-a834-769cbbb32f06/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.219122 Oct 26 13:07:36.241402 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 694/1483] 10.222.0.40 () {58 vars in 1293 bytes} [Wed Oct 26 13:07:36 2022] DELETE /compute/v2.1/images/b6447f37-224e-446f-a834-769cbbb32f06/metadata/os_distro => generated 62 bytes in 221 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:07:36.250210 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-833fef4c-595f-4642-abe8-81aa542eedb1 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-510101228", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:36.285057 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a46bd198-9c8e-4a24-a42d-9ab6cd877daa tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:36.298450 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a46bd198-9c8e-4a24-a42d-9ab6cd877daa tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27" status: 200 len: 1498 microversion: 2.1 time: 0.206106 Oct 26 13:07:36.299379 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 790/1484] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:36 2022] GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27 => generated 1498 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:36.317468 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-db050b94-ae09-403b-88a3-afcb7a393b89 tempest-ImagesMetadataNegativeTestJSON-391193339 tempest-ImagesMetadataNegativeTestJSON-391193339-project] Calling method '.version_select at 0x7f6731fb5280>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:36.354988 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-833fef4c-595f-4642-abe8-81aa542eedb1 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] validate_networks() for [('66fd6a5a-18fd-4c1d-b944-f1a3daf53a13', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:07:36.382750 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-db050b94-ae09-403b-88a3-afcb7a393b89 tempest-ImagesMetadataNegativeTestJSON-391193339 tempest-ImagesMetadataNegativeTestJSON-391193339-project] HTTP exception thrown: Image not found. Oct 26 13:07:36.387022 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-db050b94-ae09-403b-88a3-afcb7a393b89 tempest-ImagesMetadataNegativeTestJSON-391193339 tempest-ImagesMetadataNegativeTestJSON-391193339-project] Request method failure captured: Oct 26 13:07:36.387022 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/images/08317eaf-61cd-4290-80e9-1dcddd33b9ec/metadata/os_version HTTP/1.1 Oct 26 13:07:36.387022 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:07:36.387022 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:07:36.387022 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:07:36.387022 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:07:36.387022 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:07:36.387022 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:07:36.387022 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:07:36.387022 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:07:36.387022 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTEXmFcZoYsUwR0MK-kbtPNbM1XlSPVOsfADpMnW7gnlB9i6z0_IZg4sK5-3H2xAALc0AtEvr3UIqDczPzmFR0xD8rdyhw8EBI1OB1adV6XrwUOTILBNsiEyxWaehoObcAwAg-y5AeYJ-DuCVlsTfBMXCg_bn8qhe1Hjgv0ju0wEI7I Oct 26 13:07:36.387022 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:07:36.387022 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:07:36.387022 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:07:36.387022 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:07:36.387022 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:07:36.387022 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:07:36.387022 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 9b4e3e0bcd804f018163edf6c9198931 Oct 26 13:07:36.387022 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-391193339 Oct 26 13:07:36.387022 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:07:36.387022 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:07:36.388406 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9b4e3e0bcd804f018163edf6c9198931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9b4e3e0bcd804f018163edf6c9198931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9b4e3e0bcd804f018163edf6c9198931"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9b4e3e0bcd804f018163edf6c9198931"}]}] Oct 26 13:07:36.388406 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-391193339 Oct 26 13:07:36.388406 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 9b4e3e0bcd804f018163edf6c9198931 Oct 26 13:07:36.388406 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-391193339 Oct 26 13:07:36.388406 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ImagesMetadataNegativeTestJSON-391193339-project Oct 26 13:07:36.388406 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:07:36.388406 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:07:36.388406 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 5069f98b4bfc426b8ad281c72b04edce Oct 26 13:07:36.388406 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-391193339-project Oct 26 13:07:36.388406 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:07:36.388406 n-d-862686-1 devstack@n-api.service[120598]: exception: Image not found. Oct 26 13:07:36.388406 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'image_id': '08317eaf-61cd-4290-80e9-1dcddd33b9ec', 'id': 'os_version'} Oct 26 13:07:36.388406 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:07:36.389256 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:36.389256 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 26 13:07:36.389256 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 26 13:07:36.389256 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 13:07:36.389256 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 13:07:36.389256 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 26 13:07:36.389256 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 26 13:07:36.389256 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 13:07:36.389256 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 13:07:36.389256 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 26 13:07:36.389256 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 26 13:07:36.389256 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 26 13:07:36.389256 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 26 13:07:36.389256 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 13:07:36.389256 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 13:07:36.389256 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 13:07:36.389256 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 13:07:36.389256 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 08317eaf-61cd-4290-80e9-1dcddd33b9ec Oct 26 13:07:36.390848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:36.390848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:36.390848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:36.390848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:36.390848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 26 13:07:36.390848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 26 13:07:36.390848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 26 13:07:36.390848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 26 13:07:36.390848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 26 13:07:36.390848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 26 13:07:36.390848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 26 13:07:36.390848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 26 13:07:36.390848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 26 13:07:36.390848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 26 13:07:36.390848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 13:07:36.390848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 13:07:36.390848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 26 13:07:36.390848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 26 13:07:36.390848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 13:07:36.390848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 13:07:36.393234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 26 13:07:36.393234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 26 13:07:36.393234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 26 13:07:36.393234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 26 13:07:36.393234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 13:07:36.393234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 13:07:36.393234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 13:07:36.393234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 13:07:36.393234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 08317eaf-61cd-4290-80e9-1dcddd33b9ec could not be found. Oct 26 13:07:36.393234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:36.393234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:36.393234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:36.393234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:36.393234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:36.393234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:36.393234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:07:36.393234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:07:36.393234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:07:36.393234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:07:36.395528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:07:36.395528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:07:36.395528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 26 13:07:36.395528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 26 13:07:36.395528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 26 13:07:36.395528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 26 13:07:36.395528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 26 13:07:36.395528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:36.395528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:36.395528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:36.395528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:36.395528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:36.395528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:36.395528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:07:36.395528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:07:36.395528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 26 13:07:36.395528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:36.395528 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-db050b94-ae09-403b-88a3-afcb7a393b89 tempest-ImagesMetadataNegativeTestJSON-391193339 tempest-ImagesMetadataNegativeTestJSON-391193339-project] Returning 404 to user: Image not found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:07:36.399576 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-db050b94-ae09-403b-88a3-afcb7a393b89 tempest-ImagesMetadataNegativeTestJSON-391193339 tempest-ImagesMetadataNegativeTestJSON-391193339-project] 10.222.0.40 "GET /compute/v2.1/images/08317eaf-61cd-4290-80e9-1dcddd33b9ec/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.087963 Oct 26 13:07:36.399576 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 791/1485] 10.222.0.40 () {58 vars in 1293 bytes} [Wed Oct 26 13:07:36 2022] GET /compute/v2.1/images/08317eaf-61cd-4290-80e9-1dcddd33b9ec/metadata/os_version => generated 62 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:07:36.402171 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ab3eadf4-89ed-42ab-8457-e71b372aa9f4 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:36.403161 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ab3eadf4-89ed-42ab-8457-e71b372aa9f4 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 4c694a16-fdba-414f-9122-1899cc715565] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:36.410832 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab3eadf4-89ed-42ab-8457-e71b372aa9f4 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:36.411757 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab3eadf4-89ed-42ab-8457-e71b372aa9f4 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:36.413331 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab3eadf4-89ed-42ab-8457-e71b372aa9f4 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:36.414662 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab3eadf4-89ed-42ab-8457-e71b372aa9f4 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:36.415350 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab3eadf4-89ed-42ab-8457-e71b372aa9f4 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:36.415999 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab3eadf4-89ed-42ab-8457-e71b372aa9f4 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:36.466560 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab3eadf4-89ed-42ab-8457-e71b372aa9f4 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:36.467797 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab3eadf4-89ed-42ab-8457-e71b372aa9f4 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:36.468488 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab3eadf4-89ed-42ab-8457-e71b372aa9f4 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:36.469166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-ab3eadf4-89ed-42ab-8457-e71b372aa9f4 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lazy-loading 'fault' on Instance uuid 4c694a16-fdba-414f-9122-1899cc715565 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:07:36.527167 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ab3eadf4-89ed-42ab-8457-e71b372aa9f4 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cddfeca4ce49788143b2bf4b30545f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6515917885c4f3cb5fb19e05f4e5e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:36.538091 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ab3eadf4-89ed-42ab-8457-e71b372aa9f4 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/4c694a16-fdba-414f-9122-1899cc715565" status: 200 len: 1307 microversion: 2.1 time: 0.146409 Oct 26 13:07:36.553519 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 792/1486] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:36 2022] GET /compute/v2.1/servers/4c694a16-fdba-414f-9122-1899cc715565 => generated 1307 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:36.553519 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fa94d6d7-fc1c-4387-88f6-a87861875d5a tempest-ImagesMetadataNegativeTestJSON-391193339 tempest-ImagesMetadataNegativeTestJSON-391193339-project] Calling method '.version_select at 0x7f6732145820>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:36.584643 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-fa94d6d7-fc1c-4387-88f6-a87861875d5a tempest-ImagesMetadataNegativeTestJSON-391193339 tempest-ImagesMetadataNegativeTestJSON-391193339-project] HTTP exception thrown: Image not found. Oct 26 13:07:36.587246 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fa94d6d7-fc1c-4387-88f6-a87861875d5a tempest-ImagesMetadataNegativeTestJSON-391193339 tempest-ImagesMetadataNegativeTestJSON-391193339-project] Request method failure captured: Oct 26 13:07:36.587246 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/images/f3e7515c-f9f2-4fc9-8013-6d456426c31c/metadata HTTP/1.1 Oct 26 13:07:36.587246 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:07:36.587246 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:07:36.587246 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:07:36.587246 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:07:36.587246 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:07:36.587246 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:07:36.587246 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:07:36.587246 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:07:36.587246 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTEXmFcZoYsUwR0MK-kbtPNbM1XlSPVOsfADpMnW7gnlB9i6z0_IZg4sK5-3H2xAALc0AtEvr3UIqDczPzmFR0xD8rdyhw8EBI1OB1adV6XrwUOTILBNsiEyxWaehoObcAwAg-y5AeYJ-DuCVlsTfBMXCg_bn8qhe1Hjgv0ju0wEI7I Oct 26 13:07:36.587246 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:07:36.587246 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:07:36.587246 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:07:36.587246 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:07:36.587246 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:07:36.587246 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:07:36.587246 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 9b4e3e0bcd804f018163edf6c9198931 Oct 26 13:07:36.587246 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-391193339 Oct 26 13:07:36.587246 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:07:36.587246 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:07:36.588801 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9b4e3e0bcd804f018163edf6c9198931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9b4e3e0bcd804f018163edf6c9198931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9b4e3e0bcd804f018163edf6c9198931"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9b4e3e0bcd804f018163edf6c9198931"}]}] Oct 26 13:07:36.588801 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-391193339 Oct 26 13:07:36.588801 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 9b4e3e0bcd804f018163edf6c9198931 Oct 26 13:07:36.588801 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-391193339 Oct 26 13:07:36.588801 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ImagesMetadataNegativeTestJSON-391193339-project Oct 26 13:07:36.588801 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:07:36.588801 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:07:36.588801 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 5069f98b4bfc426b8ad281c72b04edce Oct 26 13:07:36.588801 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-391193339-project Oct 26 13:07:36.588801 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:07:36.588801 n-d-862686-1 devstack@n-api.service[120598]: exception: Image not found. Oct 26 13:07:36.588801 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'image_id': 'f3e7515c-f9f2-4fc9-8013-6d456426c31c'} Oct 26 13:07:36.588801 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:07:36.589688 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:36.589688 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 26 13:07:36.589688 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 26 13:07:36.589688 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 13:07:36.589688 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 13:07:36.589688 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 26 13:07:36.589688 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 26 13:07:36.589688 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 13:07:36.589688 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 13:07:36.589688 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 26 13:07:36.589688 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 26 13:07:36.589688 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 26 13:07:36.589688 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 26 13:07:36.589688 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 13:07:36.589688 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 13:07:36.589688 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 13:07:36.589688 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 13:07:36.589688 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f3e7515c-f9f2-4fc9-8013-6d456426c31c Oct 26 13:07:36.590855 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:36.590855 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:36.590855 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:36.590855 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:36.590855 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 26 13:07:36.590855 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 26 13:07:36.590855 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 26 13:07:36.590855 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 26 13:07:36.590855 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 26 13:07:36.590855 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 26 13:07:36.590855 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 26 13:07:36.590855 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 26 13:07:36.590855 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 26 13:07:36.590855 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 26 13:07:36.590855 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 13:07:36.590855 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 13:07:36.590855 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 26 13:07:36.590855 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 26 13:07:36.590855 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 13:07:36.590855 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 13:07:36.592127 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 26 13:07:36.592127 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 26 13:07:36.592127 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 26 13:07:36.592127 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 26 13:07:36.592127 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 13:07:36.592127 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 13:07:36.592127 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 13:07:36.592127 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 13:07:36.592127 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f3e7515c-f9f2-4fc9-8013-6d456426c31c could not be found. Oct 26 13:07:36.592127 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:36.592127 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:36.592127 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:36.592127 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:36.592127 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:36.592127 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:36.592127 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:07:36.592127 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:07:36.592127 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:07:36.592127 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:07:36.593334 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:07:36.593334 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:07:36.593334 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 26 13:07:36.593334 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 26 13:07:36.593334 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 26 13:07:36.593334 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 26 13:07:36.593334 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 26 13:07:36.593334 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:36.593334 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:36.593334 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:36.593334 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:36.593334 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:36.593334 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:36.593334 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:07:36.593334 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:07:36.593334 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 26 13:07:36.593334 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:36.593334 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fa94d6d7-fc1c-4387-88f6-a87861875d5a tempest-ImagesMetadataNegativeTestJSON-391193339 tempest-ImagesMetadataNegativeTestJSON-391193339-project] Returning 404 to user: Image not found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:07:36.597644 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fa94d6d7-fc1c-4387-88f6-a87861875d5a tempest-ImagesMetadataNegativeTestJSON-391193339 tempest-ImagesMetadataNegativeTestJSON-391193339-project] 10.222.0.40 "GET /compute/v2.1/images/f3e7515c-f9f2-4fc9-8013-6d456426c31c/metadata" status: 404 len: 62 microversion: 2.1 time: 0.048768 Oct 26 13:07:36.597644 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 793/1487] 10.222.0.40 () {58 vars in 1260 bytes} [Wed Oct 26 13:07:36 2022] GET /compute/v2.1/images/f3e7515c-f9f2-4fc9-8013-6d456426c31c/metadata => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:07:36.601319 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-48db002c-6553-41c3-9ca8-30acff7c7029 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:36.601975 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-48db002c-6553-41c3-9ca8-30acff7c7029 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:36.609243 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48db002c-6553-41c3-9ca8-30acff7c7029 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:36.610168 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48db002c-6553-41c3-9ca8-30acff7c7029 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:36.610818 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48db002c-6553-41c3-9ca8-30acff7c7029 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:36.611726 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48db002c-6553-41c3-9ca8-30acff7c7029 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:36.612372 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48db002c-6553-41c3-9ca8-30acff7c7029 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:36.613091 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48db002c-6553-41c3-9ca8-30acff7c7029 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:36.792723 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-48db002c-6553-41c3-9ca8-30acff7c7029 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:36.803142 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-48db002c-6553-41c3-9ca8-30acff7c7029 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1473 microversion: 2.1 time: 0.206105 Oct 26 13:07:36.803952 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 794/1488] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:36 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1473 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:36.824909 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-eeb2bcee-67a0-4728-a1e1-a47b85345a83 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:36.827261 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-eeb2bcee-67a0-4728-a1e1-a47b85345a83 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:36.833341 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eeb2bcee-67a0-4728-a1e1-a47b85345a83 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:36.834820 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eeb2bcee-67a0-4728-a1e1-a47b85345a83 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:36.835280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eeb2bcee-67a0-4728-a1e1-a47b85345a83 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:36.835980 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eeb2bcee-67a0-4728-a1e1-a47b85345a83 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:36.836437 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eeb2bcee-67a0-4728-a1e1-a47b85345a83 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:36.836862 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eeb2bcee-67a0-4728-a1e1-a47b85345a83 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:36.870375 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-eeb2bcee-67a0-4728-a1e1-a47b85345a83 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.051397 Oct 26 13:07:36.875878 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 795/1489] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Oct 26 13:07:36 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:07:36.882489 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e322ba79-428f-427b-9863-36d1e3e08344 tempest-ImagesMetadataNegativeTestJSON-391193339 tempest-ImagesMetadataNegativeTestJSON-391193339-project] Action: 'update_all', calling method: .version_select at 0x7f67329f1a60>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:36.909949 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-e322ba79-428f-427b-9863-36d1e3e08344 tempest-ImagesMetadataNegativeTestJSON-391193339 tempest-ImagesMetadataNegativeTestJSON-391193339-project] HTTP exception thrown: Image not found. Oct 26 13:07:36.912864 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e322ba79-428f-427b-9863-36d1e3e08344 tempest-ImagesMetadataNegativeTestJSON-391193339 tempest-ImagesMetadataNegativeTestJSON-391193339-project] Request method failure captured: Oct 26 13:07:36.912864 n-d-862686-1 devstack@n-api.service[120598]: request: PUT /compute/v2.1/images/f7c50145-7e86-4ea8-a660-bf8be2069766/metadata HTTP/1.1 Oct 26 13:07:36.912864 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:07:36.912864 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:07:36.912864 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:07:36.912864 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 57 Oct 26 13:07:36.912864 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:07:36.912864 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:07:36.912864 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:07:36.912864 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:07:36.912864 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTEXmFcZoYsUwR0MK-kbtPNbM1XlSPVOsfADpMnW7gnlB9i6z0_IZg4sK5-3H2xAALc0AtEvr3UIqDczPzmFR0xD8rdyhw8EBI1OB1adV6XrwUOTILBNsiEyxWaehoObcAwAg-y5AeYJ-DuCVlsTfBMXCg_bn8qhe1Hjgv0ju0wEI7I Oct 26 13:07:36.912864 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:07:36.912864 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:07:36.912864 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:07:36.912864 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:07:36.912864 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:07:36.912864 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:07:36.912864 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 9b4e3e0bcd804f018163edf6c9198931 Oct 26 13:07:36.912864 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-391193339 Oct 26 13:07:36.912864 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:07:36.912864 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:07:36.914449 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9b4e3e0bcd804f018163edf6c9198931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9b4e3e0bcd804f018163edf6c9198931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9b4e3e0bcd804f018163edf6c9198931"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9b4e3e0bcd804f018163edf6c9198931"}]}] Oct 26 13:07:36.914449 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-391193339 Oct 26 13:07:36.914449 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 9b4e3e0bcd804f018163edf6c9198931 Oct 26 13:07:36.914449 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-391193339 Oct 26 13:07:36.914449 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ImagesMetadataNegativeTestJSON-391193339-project Oct 26 13:07:36.914449 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:07:36.914449 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:07:36.914449 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 5069f98b4bfc426b8ad281c72b04edce Oct 26 13:07:36.914449 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-391193339-project Oct 26 13:07:36.914449 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:07:36.914449 n-d-862686-1 devstack@n-api.service[120598]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 26 13:07:36.914449 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:07:36.914449 n-d-862686-1 devstack@n-api.service[120598]: exception: Image not found. Oct 26 13:07:36.914449 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'image_id': 'f7c50145-7e86-4ea8-a660-bf8be2069766', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 26 13:07:36.915348 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:07:36.915348 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:36.915348 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 26 13:07:36.915348 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 26 13:07:36.915348 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 13:07:36.915348 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 13:07:36.915348 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 26 13:07:36.915348 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 26 13:07:36.915348 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 13:07:36.915348 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 13:07:36.915348 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 26 13:07:36.915348 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 26 13:07:36.915348 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 26 13:07:36.915348 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 26 13:07:36.915348 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 13:07:36.915348 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 13:07:36.915348 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 13:07:36.915348 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 13:07:36.916461 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f7c50145-7e86-4ea8-a660-bf8be2069766 Oct 26 13:07:36.916461 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:36.916461 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:36.916461 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:36.916461 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:36.916461 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 26 13:07:36.916461 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 26 13:07:36.916461 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 26 13:07:36.916461 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 26 13:07:36.916461 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 26 13:07:36.916461 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 26 13:07:36.916461 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 26 13:07:36.916461 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 26 13:07:36.916461 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 26 13:07:36.916461 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 26 13:07:36.916461 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 13:07:36.916461 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 13:07:36.916461 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 26 13:07:36.916461 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 26 13:07:36.918324 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 13:07:36.918324 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 13:07:36.918324 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 26 13:07:36.918324 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 26 13:07:36.918324 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 26 13:07:36.918324 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 26 13:07:36.918324 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 13:07:36.918324 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 13:07:36.918324 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 13:07:36.918324 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 13:07:36.918324 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f7c50145-7e86-4ea8-a660-bf8be2069766 could not be found. Oct 26 13:07:36.918324 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:36.918324 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:36.918324 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:36.918324 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:36.918324 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:36.918324 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:36.918324 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:07:36.918324 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:07:36.919989 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:07:36.919989 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:07:36.919989 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:07:36.919989 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:07:36.919989 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:07:36.919989 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:07:36.919989 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 26 13:07:36.919989 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 26 13:07:36.919989 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 26 13:07:36.919989 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 26 13:07:36.919989 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 26 13:07:36.919989 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:36.919989 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:36.919989 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:36.919989 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:36.919989 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:36.919989 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:36.919989 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:07:36.919989 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:07:36.919989 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 26 13:07:36.919989 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:36.922358 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e322ba79-428f-427b-9863-36d1e3e08344 tempest-ImagesMetadataNegativeTestJSON-391193339 tempest-ImagesMetadataNegativeTestJSON-391193339-project] Returning 404 to user: Image not found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:07:36.922358 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e322ba79-428f-427b-9863-36d1e3e08344 tempest-ImagesMetadataNegativeTestJSON-391193339 tempest-ImagesMetadataNegativeTestJSON-391193339-project] 10.222.0.40 "PUT /compute/v2.1/images/f7c50145-7e86-4ea8-a660-bf8be2069766/metadata" status: 404 len: 62 microversion: 2.1 time: 0.037613 Oct 26 13:07:36.922358 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 796/1490] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 26 13:07:36 2022] PUT /compute/v2.1/images/f7c50145-7e86-4ea8-a660-bf8be2069766/metadata => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:07:36.926389 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ba038f98-8775-4c25-8d3c-821c42a38f58 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:36.927028 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ba038f98-8775-4c25-8d3c-821c42a38f58 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:36.935273 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ba038f98-8775-4c25-8d3c-821c42a38f58 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:36.935743 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ba038f98-8775-4c25-8d3c-821c42a38f58 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:36.936231 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ba038f98-8775-4c25-8d3c-821c42a38f58 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:36.937111 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ba038f98-8775-4c25-8d3c-821c42a38f58 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:36.937740 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ba038f98-8775-4c25-8d3c-821c42a38f58 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:36.938090 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ba038f98-8775-4c25-8d3c-821c42a38f58 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:37.040721 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-833fef4c-595f-4642-abe8-81aa542eedb1 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:07:37.041240 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-833fef4c-595f-4642-abe8-81aa542eedb1 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:07:37.041630 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-833fef4c-595f-4642-abe8-81aa542eedb1 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:07:37.042019 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-833fef4c-595f-4642-abe8-81aa542eedb1 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:07:37.042423 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-833fef4c-595f-4642-abe8-81aa542eedb1 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:07:37.053428 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-833fef4c-595f-4642-abe8-81aa542eedb1 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:37.054381 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-833fef4c-595f-4642-abe8-81aa542eedb1 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:37.055184 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-833fef4c-595f-4642-abe8-81aa542eedb1 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:37.056437 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-833fef4c-595f-4642-abe8-81aa542eedb1 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:37.057150 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-833fef4c-595f-4642-abe8-81aa542eedb1 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:37.057867 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-833fef4c-595f-4642-abe8-81aa542eedb1 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:37.078622 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-833fef4c-595f-4642-abe8-81aa542eedb1 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Getting quotas for project 186ac42922a64992aa1973bd854830d7. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:07:37.086464 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-833fef4c-595f-4642-abe8-81aa542eedb1 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Getting quotas for user 0b8d4ea396494628983bde1a97222f7d and project 186ac42922a64992aa1973bd854830d7. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:07:37.089699 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ba038f98-8775-4c25-8d3c-821c42a38f58 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:37.097383 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ba038f98-8775-4c25-8d3c-821c42a38f58 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1476 microversion: 2.1 time: 0.174774 Oct 26 13:07:37.099340 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 797/1491] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:36 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1476 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:37.112461 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-22cb307f-59a2-4a65-badc-d209023826f6 tempest-ImagesMetadataNegativeTestJSON-391193339 tempest-ImagesMetadataNegativeTestJSON-391193339-project] Action: 'update', calling method: .version_select at 0x7f67320a1f70>, body: {"meta": {"os_distro": "alt"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:37.118152 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-833fef4c-595f-4642-abe8-81aa542eedb1 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:07:37.120713 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-833fef4c-595f-4642-abe8-81aa542eedb1 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: f274cbdb-53e5-4634-b1c8-1913500fef38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:07:37.141703 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-22cb307f-59a2-4a65-badc-d209023826f6 tempest-ImagesMetadataNegativeTestJSON-391193339 tempest-ImagesMetadataNegativeTestJSON-391193339-project] HTTP exception thrown: Image not found. Oct 26 13:07:37.144040 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-22cb307f-59a2-4a65-badc-d209023826f6 tempest-ImagesMetadataNegativeTestJSON-391193339 tempest-ImagesMetadataNegativeTestJSON-391193339-project] Request method failure captured: Oct 26 13:07:37.144040 n-d-862686-1 devstack@n-api.service[120598]: request: PUT /compute/v2.1/images/45e79365-d0ca-4f76-9fcc-8535d5995d2c/metadata/os_distro HTTP/1.1 Oct 26 13:07:37.144040 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:07:37.144040 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:07:37.144040 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:07:37.144040 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 30 Oct 26 13:07:37.144040 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:07:37.144040 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:07:37.144040 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:07:37.144040 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:07:37.144040 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTEXmFcZoYsUwR0MK-kbtPNbM1XlSPVOsfADpMnW7gnlB9i6z0_IZg4sK5-3H2xAALc0AtEvr3UIqDczPzmFR0xD8rdyhw8EBI1OB1adV6XrwUOTILBNsiEyxWaehoObcAwAg-y5AeYJ-DuCVlsTfBMXCg_bn8qhe1Hjgv0ju0wEI7I Oct 26 13:07:37.144040 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:07:37.144040 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:07:37.144040 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:07:37.144040 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:07:37.144040 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:07:37.144040 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:07:37.144040 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 9b4e3e0bcd804f018163edf6c9198931 Oct 26 13:07:37.144040 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-391193339 Oct 26 13:07:37.144040 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:07:37.144040 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:07:37.145673 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9b4e3e0bcd804f018163edf6c9198931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9b4e3e0bcd804f018163edf6c9198931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9b4e3e0bcd804f018163edf6c9198931"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9b4e3e0bcd804f018163edf6c9198931"}]}] Oct 26 13:07:37.145673 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-391193339 Oct 26 13:07:37.145673 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 9b4e3e0bcd804f018163edf6c9198931 Oct 26 13:07:37.145673 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-391193339 Oct 26 13:07:37.145673 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ImagesMetadataNegativeTestJSON-391193339-project Oct 26 13:07:37.145673 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:07:37.145673 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:07:37.145673 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 5069f98b4bfc426b8ad281c72b04edce Oct 26 13:07:37.145673 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-391193339-project Oct 26 13:07:37.145673 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:07:37.145673 n-d-862686-1 devstack@n-api.service[120598]: {"meta": {"os_distro": "alt"}} Oct 26 13:07:37.145673 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:07:37.145673 n-d-862686-1 devstack@n-api.service[120598]: exception: Image not found. Oct 26 13:07:37.145673 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'image_id': '45e79365-d0ca-4f76-9fcc-8535d5995d2c', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 26 13:07:37.147325 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:07:37.147325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:37.147325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 26 13:07:37.147325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 26 13:07:37.147325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 13:07:37.147325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 13:07:37.147325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 26 13:07:37.147325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 26 13:07:37.147325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 13:07:37.147325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 13:07:37.147325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 26 13:07:37.147325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 26 13:07:37.147325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 26 13:07:37.147325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 26 13:07:37.147325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 13:07:37.147325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 13:07:37.147325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 13:07:37.147325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 13:07:37.148608 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 45e79365-d0ca-4f76-9fcc-8535d5995d2c Oct 26 13:07:37.148608 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:37.148608 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:37.148608 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:37.148608 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:37.148608 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 26 13:07:37.148608 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 26 13:07:37.148608 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 26 13:07:37.148608 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 26 13:07:37.148608 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 26 13:07:37.148608 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 26 13:07:37.148608 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 26 13:07:37.148608 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 26 13:07:37.148608 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 26 13:07:37.148608 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 26 13:07:37.148608 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 13:07:37.148608 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 13:07:37.148608 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 26 13:07:37.148608 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 26 13:07:37.151781 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 13:07:37.151781 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 13:07:37.151781 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 26 13:07:37.151781 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 26 13:07:37.151781 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 26 13:07:37.151781 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 26 13:07:37.151781 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 13:07:37.151781 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 13:07:37.151781 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 13:07:37.151781 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 13:07:37.151781 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 45e79365-d0ca-4f76-9fcc-8535d5995d2c could not be found. Oct 26 13:07:37.151781 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:37.151781 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:37.151781 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:37.151781 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:37.151781 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:37.151781 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:37.151781 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:07:37.151781 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:07:37.155059 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:07:37.155059 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:07:37.155059 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:07:37.155059 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:07:37.155059 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:07:37.155059 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:07:37.155059 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 26 13:07:37.155059 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 26 13:07:37.155059 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 26 13:07:37.155059 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 26 13:07:37.155059 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 26 13:07:37.155059 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:37.155059 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:37.155059 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:37.155059 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:37.155059 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:37.155059 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:37.155059 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:07:37.155059 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:07:37.155059 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 26 13:07:37.155059 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:37.158065 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-22cb307f-59a2-4a65-badc-d209023826f6 tempest-ImagesMetadataNegativeTestJSON-391193339 tempest-ImagesMetadataNegativeTestJSON-391193339-project] Returning 404 to user: Image not found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:07:37.158065 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-22cb307f-59a2-4a65-badc-d209023826f6 tempest-ImagesMetadataNegativeTestJSON-391193339 tempest-ImagesMetadataNegativeTestJSON-391193339-project] 10.222.0.40 "PUT /compute/v2.1/images/45e79365-d0ca-4f76-9fcc-8535d5995d2c/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.043269 Oct 26 13:07:37.158065 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 798/1492] 10.222.0.40 () {60 vars in 1310 bytes} [Wed Oct 26 13:07:37 2022] PUT /compute/v2.1/images/45e79365-d0ca-4f76-9fcc-8535d5995d2c/metadata/os_distro => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:07:37.158065 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-19f2c17d-003d-479b-ab30-6978c5bfd1c3 tempest-ImagesMetadataNegativeTestJSON-391193339 tempest-ImagesMetadataNegativeTestJSON-391193339-project] Action: 'create', calling method: .version_select at 0x7f6731ff3c10>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:37.176419 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-833fef4c-595f-4642-abe8-81aa542eedb1 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.933386 Oct 26 13:07:37.181742 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 695/1493] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:07:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:07:37.189326 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-19f2c17d-003d-479b-ab30-6978c5bfd1c3 tempest-ImagesMetadataNegativeTestJSON-391193339 tempest-ImagesMetadataNegativeTestJSON-391193339-project] HTTP exception thrown: Image not found. Oct 26 13:07:37.196169 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-19f2c17d-003d-479b-ab30-6978c5bfd1c3 tempest-ImagesMetadataNegativeTestJSON-391193339 tempest-ImagesMetadataNegativeTestJSON-391193339-project] Request method failure captured: Oct 26 13:07:37.196169 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/images/6ec37728-ea84-4ef7-b147-c2ee40d8a416/metadata HTTP/1.1 Oct 26 13:07:37.196169 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:07:37.196169 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:07:37.196169 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:07:37.196169 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 57 Oct 26 13:07:37.196169 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:07:37.196169 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:07:37.196169 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:07:37.196169 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:07:37.196169 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTEXmFcZoYsUwR0MK-kbtPNbM1XlSPVOsfADpMnW7gnlB9i6z0_IZg4sK5-3H2xAALc0AtEvr3UIqDczPzmFR0xD8rdyhw8EBI1OB1adV6XrwUOTILBNsiEyxWaehoObcAwAg-y5AeYJ-DuCVlsTfBMXCg_bn8qhe1Hjgv0ju0wEI7I Oct 26 13:07:37.196169 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:07:37.196169 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:07:37.196169 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:07:37.196169 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:07:37.196169 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:07:37.196169 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:07:37.196169 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 9b4e3e0bcd804f018163edf6c9198931 Oct 26 13:07:37.196169 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-391193339 Oct 26 13:07:37.196169 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:07:37.196169 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:07:37.197679 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9b4e3e0bcd804f018163edf6c9198931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9b4e3e0bcd804f018163edf6c9198931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9b4e3e0bcd804f018163edf6c9198931"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9b4e3e0bcd804f018163edf6c9198931"}]}] Oct 26 13:07:37.197679 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-391193339 Oct 26 13:07:37.197679 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 9b4e3e0bcd804f018163edf6c9198931 Oct 26 13:07:37.197679 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-391193339 Oct 26 13:07:37.197679 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ImagesMetadataNegativeTestJSON-391193339-project Oct 26 13:07:37.197679 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:07:37.197679 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:07:37.197679 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 5069f98b4bfc426b8ad281c72b04edce Oct 26 13:07:37.197679 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-391193339-project Oct 26 13:07:37.197679 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:07:37.197679 n-d-862686-1 devstack@n-api.service[120598]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 26 13:07:37.197679 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:07:37.197679 n-d-862686-1 devstack@n-api.service[120598]: exception: Image not found. Oct 26 13:07:37.197679 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'image_id': '6ec37728-ea84-4ef7-b147-c2ee40d8a416', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 26 13:07:37.198582 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:07:37.198582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:37.198582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 26 13:07:37.198582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 26 13:07:37.198582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 13:07:37.198582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 13:07:37.198582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 26 13:07:37.198582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 26 13:07:37.198582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 13:07:37.198582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 13:07:37.198582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 26 13:07:37.198582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 26 13:07:37.198582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 26 13:07:37.198582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 26 13:07:37.198582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 13:07:37.198582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 13:07:37.198582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 13:07:37.198582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 13:07:37.199690 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6ec37728-ea84-4ef7-b147-c2ee40d8a416 Oct 26 13:07:37.199690 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:37.199690 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:37.199690 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:37.199690 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:37.199690 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 26 13:07:37.199690 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 26 13:07:37.199690 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 26 13:07:37.199690 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 26 13:07:37.199690 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 26 13:07:37.199690 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 26 13:07:37.199690 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 26 13:07:37.199690 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 26 13:07:37.199690 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 26 13:07:37.199690 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 26 13:07:37.199690 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 13:07:37.199690 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 13:07:37.199690 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 26 13:07:37.199690 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 26 13:07:37.200848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 13:07:37.200848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 13:07:37.200848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 26 13:07:37.200848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 26 13:07:37.200848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 26 13:07:37.200848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 26 13:07:37.200848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 13:07:37.200848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 13:07:37.200848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 13:07:37.200848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 13:07:37.200848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6ec37728-ea84-4ef7-b147-c2ee40d8a416 could not be found. Oct 26 13:07:37.200848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:37.200848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:37.200848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:37.200848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:37.200848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:37.200848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:37.200848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:07:37.200848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:07:37.202077 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:07:37.202077 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:07:37.202077 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:07:37.202077 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:07:37.202077 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:07:37.202077 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:07:37.202077 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 26 13:07:37.202077 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 26 13:07:37.202077 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 26 13:07:37.202077 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 26 13:07:37.202077 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 26 13:07:37.202077 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:37.202077 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:37.202077 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:37.202077 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:37.202077 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:37.202077 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:37.202077 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:07:37.202077 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:07:37.202077 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 26 13:07:37.202077 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:07:37.204720 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-19f2c17d-003d-479b-ab30-6978c5bfd1c3 tempest-ImagesMetadataNegativeTestJSON-391193339 tempest-ImagesMetadataNegativeTestJSON-391193339-project] Returning 404 to user: Image not found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:07:37.204827 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bc650067-e67e-4c22-9f5e-a91082680fd1 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:37.204827 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bc650067-e67e-4c22-9f5e-a91082680fd1 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: f274cbdb-53e5-4634-b1c8-1913500fef38] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:37.205013 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-19f2c17d-003d-479b-ab30-6978c5bfd1c3 tempest-ImagesMetadataNegativeTestJSON-391193339 tempest-ImagesMetadataNegativeTestJSON-391193339-project] 10.222.0.40 "POST /compute/v2.1/images/6ec37728-ea84-4ef7-b147-c2ee40d8a416/metadata" status: 404 len: 62 microversion: 2.1 time: 0.047054 Oct 26 13:07:37.205013 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 799/1494] 10.222.0.40 () {60 vars in 1281 bytes} [Wed Oct 26 13:07:37 2022] POST /compute/v2.1/images/6ec37728-ea84-4ef7-b147-c2ee40d8a416/metadata => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:07:37.301175 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bc650067-e67e-4c22-9f5e-a91082680fd1 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:37.326781 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3c34674d-8cee-4407-a4a7-0a1a9d5aa1be tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:37.328135 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3c34674d-8cee-4407-a4a7-0a1a9d5aa1be tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: d426a4f6-fa08-47d2-a583-735600b77f27] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:37.331332 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bc650067-e67e-4c22-9f5e-a91082680fd1 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38" status: 200 len: 1224 microversion: 2.1 time: 0.137896 Oct 26 13:07:37.338285 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c34674d-8cee-4407-a4a7-0a1a9d5aa1be tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:37.339100 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c34674d-8cee-4407-a4a7-0a1a9d5aa1be tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:37.340313 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c34674d-8cee-4407-a4a7-0a1a9d5aa1be tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:37.341649 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c34674d-8cee-4407-a4a7-0a1a9d5aa1be tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:37.342396 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c34674d-8cee-4407-a4a7-0a1a9d5aa1be tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:37.343013 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c34674d-8cee-4407-a4a7-0a1a9d5aa1be tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:37.344356 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 696/1495] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:37 2022] GET /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38 => generated 1224 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:37.562038 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3c34674d-8cee-4407-a4a7-0a1a9d5aa1be tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:37.564776 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a2f88e5d-dd15-4e91-9540-29bd3f467163 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:37.566092 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a2f88e5d-dd15-4e91-9540-29bd3f467163 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] [instance: 4c694a16-fdba-414f-9122-1899cc715565] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:37.571491 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3c34674d-8cee-4407-a4a7-0a1a9d5aa1be tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27" status: 200 len: 1498 microversion: 2.1 time: 0.250948 Oct 26 13:07:37.580662 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2f88e5d-dd15-4e91-9540-29bd3f467163 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:37.581166 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2f88e5d-dd15-4e91-9540-29bd3f467163 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:37.585910 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 800/1496] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:37 2022] GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27 => generated 1498 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:07:37.586681 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2f88e5d-dd15-4e91-9540-29bd3f467163 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:37.587628 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2f88e5d-dd15-4e91-9540-29bd3f467163 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:37.588074 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2f88e5d-dd15-4e91-9540-29bd3f467163 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:37.588590 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2f88e5d-dd15-4e91-9540-29bd3f467163 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:37.639609 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-a2f88e5d-dd15-4e91-9540-29bd3f467163 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] HTTP exception thrown: Instance 4c694a16-fdba-414f-9122-1899cc715565 could not be found. Oct 26 13:07:37.641545 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a2f88e5d-dd15-4e91-9540-29bd3f467163 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Request method failure captured: Oct 26 13:07:37.641545 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/4c694a16-fdba-414f-9122-1899cc715565 HTTP/1.1 Oct 26 13:07:37.641545 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:07:37.641545 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:07:37.641545 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:07:37.641545 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:07:37.641545 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:07:37.641545 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:07:37.641545 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:07:37.641545 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:07:37.641545 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTBPRVt_8YZnaMSFiptNqbU9QNU93-_uVsnIl5oPaIxTkieW3pGz0zJKB63vkS1UTm30oE-_Ib6tVEIUcfod49uJs_R6L4h_NtP5w4W8pi8x5J4f1QqVVXViMhIM2rv6Z6M-Vnp8kRHMISIYhq0EFTwFrWnXPDyjXTUbEUwh3-ynQvQ Oct 26 13:07:37.641545 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:07:37.641545 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:07:37.641545 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:07:37.641545 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:07:37.641545 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:07:37.641545 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:07:37.641545 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: d6515917885c4f3cb5fb19e05f4e5e2b Oct 26 13:07:37.641545 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersOnMultiNodesTest-1287428008 Oct 26 13:07:37.641545 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:07:37.641545 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:07:37.642960 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d6515917885c4f3cb5fb19e05f4e5e2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d6515917885c4f3cb5fb19e05f4e5e2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d6515917885c4f3cb5fb19e05f4e5e2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d6515917885c4f3cb5fb19e05f4e5e2b"}]}] Oct 26 13:07:37.642960 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersOnMultiNodesTest-1287428008 Oct 26 13:07:37.642960 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: d6515917885c4f3cb5fb19e05f4e5e2b Oct 26 13:07:37.642960 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1287428008 Oct 26 13:07:37.642960 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersOnMultiNodesTest-1287428008-project Oct 26 13:07:37.642960 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:07:37.642960 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:07:37.642960 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: b6cddfeca4ce49788143b2bf4b30545f Oct 26 13:07:37.642960 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersOnMultiNodesTest-1287428008-project Oct 26 13:07:37.642960 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:07:37.642960 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 4c694a16-fdba-414f-9122-1899cc715565 could not be found. Oct 26 13:07:37.642960 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '4c694a16-fdba-414f-9122-1899cc715565'} Oct 26 13:07:37.643756 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:07:37.643756 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:37.643756 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:07:37.643756 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:07:37.643756 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:07:37.643756 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:07:37.643756 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:07:37.643756 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:07:37.643756 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:07:37.643756 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:07:37.643756 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c694a16-fdba-414f-9122-1899cc715565 could not be found. Oct 26 13:07:37.643756 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:37.643756 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:37.643756 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:37.643756 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:37.643756 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:37.643756 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:37.643756 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:07:37.643756 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:07:37.643756 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:07:37.645096 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:07:37.645096 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:07:37.645096 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:07:37.645096 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:07:37.645096 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:07:37.645096 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:07:37.645096 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:07:37.645096 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c694a16-fdba-414f-9122-1899cc715565 could not be found. Oct 26 13:07:37.645096 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:37.645096 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:07:37.645096 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:37.645096 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:07:37.645096 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:07:37.645096 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:07:37.645096 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:07:37.645096 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:07:37.645096 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c694a16-fdba-414f-9122-1899cc715565 could not be found. Oct 26 13:07:37.645096 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:07:37.646432 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a2f88e5d-dd15-4e91-9540-29bd3f467163 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] Returning 404 to user: Instance 4c694a16-fdba-414f-9122-1899cc715565 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:07:37.646432 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a2f88e5d-dd15-4e91-9540-29bd3f467163 tempest-ServersOnMultiNodesTest-1287428008 tempest-ServersOnMultiNodesTest-1287428008-project] 10.222.0.40 "GET /compute/v2.1/servers/4c694a16-fdba-414f-9122-1899cc715565" status: 404 len: 111 microversion: 2.1 time: 0.082777 Oct 26 13:07:37.650896 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 697/1497] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:37 2022] GET /compute/v2.1/servers/4c694a16-fdba-414f-9122-1899cc715565 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 13:07:37.829220 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c2591220-4cb9-43d3-b83c-db6a6b3d4c3d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:37.830204 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c2591220-4cb9-43d3-b83c-db6a6b3d4c3d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:37.847051 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2591220-4cb9-43d3-b83c-db6a6b3d4c3d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:37.847654 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2591220-4cb9-43d3-b83c-db6a6b3d4c3d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:37.848850 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2591220-4cb9-43d3-b83c-db6a6b3d4c3d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:37.849933 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2591220-4cb9-43d3-b83c-db6a6b3d4c3d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:37.852008 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2591220-4cb9-43d3-b83c-db6a6b3d4c3d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:37.852611 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2591220-4cb9-43d3-b83c-db6a6b3d4c3d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:37.887008 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-350ea71e-c2dd-44da-9542-4fe4bc44f38b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:37.890827 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-350ea71e-c2dd-44da-9542-4fe4bc44f38b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:37.914391 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-350ea71e-c2dd-44da-9542-4fe4bc44f38b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:37.914882 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-350ea71e-c2dd-44da-9542-4fe4bc44f38b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:37.915319 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-350ea71e-c2dd-44da-9542-4fe4bc44f38b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:37.916042 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-350ea71e-c2dd-44da-9542-4fe4bc44f38b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:37.916497 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-350ea71e-c2dd-44da-9542-4fe4bc44f38b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:37.916924 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-350ea71e-c2dd-44da-9542-4fe4bc44f38b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:38.015605 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-350ea71e-c2dd-44da-9542-4fe4bc44f38b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.135691 Oct 26 13:07:38.022325 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 698/1498] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Oct 26 13:07:37 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924/os-volume_attachments => generated 25 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:38.123198 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0a5e7cce-6ab9-431e-ab5b-a37e7d812798 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:38.123813 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0a5e7cce-6ab9-431e-ab5b-a37e7d812798 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:38.132037 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0a5e7cce-6ab9-431e-ab5b-a37e7d812798 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:38.137748 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0a5e7cce-6ab9-431e-ab5b-a37e7d812798 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:38.138536 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0a5e7cce-6ab9-431e-ab5b-a37e7d812798 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:38.140526 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0a5e7cce-6ab9-431e-ab5b-a37e7d812798 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:38.142391 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0a5e7cce-6ab9-431e-ab5b-a37e7d812798 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:38.143749 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0a5e7cce-6ab9-431e-ab5b-a37e7d812798 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:38.229688 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c2591220-4cb9-43d3-b83c-db6a6b3d4c3d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:38.242245 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c2591220-4cb9-43d3-b83c-db6a6b3d4c3d tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1473 microversion: 2.1 time: 0.415095 Oct 26 13:07:38.245930 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 801/1499] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:37 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1473 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:38.361817 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f7539345-ba34-4908-b535-ce0d56e008da tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:38.362524 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f7539345-ba34-4908-b535-ce0d56e008da tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: f274cbdb-53e5-4634-b1c8-1913500fef38] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:38.375996 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7539345-ba34-4908-b535-ce0d56e008da tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:38.376748 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7539345-ba34-4908-b535-ce0d56e008da tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:38.377596 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7539345-ba34-4908-b535-ce0d56e008da tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:38.378325 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7539345-ba34-4908-b535-ce0d56e008da tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:38.378785 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7539345-ba34-4908-b535-ce0d56e008da tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:38.379215 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7539345-ba34-4908-b535-ce0d56e008da tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:38.443890 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:07:38.549105 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f7539345-ba34-4908-b535-ce0d56e008da tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:38.563473 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f7539345-ba34-4908-b535-ce0d56e008da tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38" status: 200 len: 1276 microversion: 2.1 time: 0.206642 Oct 26 13:07:38.565270 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 802/1500] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:38 2022] GET /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38 => generated 1276 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:38.599155 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5e316e26-48e9-4bf6-93a6-44ae64f574e1 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:38.600562 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5e316e26-48e9-4bf6-93a6-44ae64f574e1 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: d426a4f6-fa08-47d2-a583-735600b77f27] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:38.624249 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5e316e26-48e9-4bf6-93a6-44ae64f574e1 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:38.626026 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5e316e26-48e9-4bf6-93a6-44ae64f574e1 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:38.628464 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5e316e26-48e9-4bf6-93a6-44ae64f574e1 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:38.630407 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5e316e26-48e9-4bf6-93a6-44ae64f574e1 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:38.632151 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5e316e26-48e9-4bf6-93a6-44ae64f574e1 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:38.633351 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5e316e26-48e9-4bf6-93a6-44ae64f574e1 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:38.889056 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5e316e26-48e9-4bf6-93a6-44ae64f574e1 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:38.933304 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5e316e26-48e9-4bf6-93a6-44ae64f574e1 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27" status: 200 len: 1498 microversion: 2.1 time: 0.340777 Oct 26 13:07:38.934237 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 803/1501] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:38 2022] GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27 => generated 1498 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:39.276598 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f6ae641e-8312-46fb-ac18-e4d4040d0079 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:39.277903 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f6ae641e-8312-46fb-ac18-e4d4040d0079 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:39.288072 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6ae641e-8312-46fb-ac18-e4d4040d0079 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:39.289379 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6ae641e-8312-46fb-ac18-e4d4040d0079 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:39.290076 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6ae641e-8312-46fb-ac18-e4d4040d0079 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:39.291236 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6ae641e-8312-46fb-ac18-e4d4040d0079 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:39.292082 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6ae641e-8312-46fb-ac18-e4d4040d0079 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:39.292795 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6ae641e-8312-46fb-ac18-e4d4040d0079 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:39.475139 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0a5e7cce-6ab9-431e-ab5b-a37e7d812798 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:39.491832 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0a5e7cce-6ab9-431e-ab5b-a37e7d812798 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1476 microversion: 2.1 time: 1.372929 Oct 26 13:07:39.492816 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 699/1502] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:38 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1476 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:39.592527 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d7a5b0d9-461f-40c4-8d38-53d218abe27f tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:39.593212 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d7a5b0d9-461f-40c4-8d38-53d218abe27f tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: f274cbdb-53e5-4634-b1c8-1913500fef38] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:39.601579 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7a5b0d9-461f-40c4-8d38-53d218abe27f tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:39.602366 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7a5b0d9-461f-40c4-8d38-53d218abe27f tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:39.603037 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7a5b0d9-461f-40c4-8d38-53d218abe27f tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:39.603987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7a5b0d9-461f-40c4-8d38-53d218abe27f tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:39.605350 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7a5b0d9-461f-40c4-8d38-53d218abe27f tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:39.606178 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7a5b0d9-461f-40c4-8d38-53d218abe27f tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:39.661210 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f6ae641e-8312-46fb-ac18-e4d4040d0079 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:39.700388 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f6ae641e-8312-46fb-ac18-e4d4040d0079 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1473 microversion: 2.1 time: 0.428586 Oct 26 13:07:39.718090 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 804/1503] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:39 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1473 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:07:39.964930 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-407b1139-2e75-4769-b791-1d9aa79d90d5 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:39.965866 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-407b1139-2e75-4769-b791-1d9aa79d90d5 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: d426a4f6-fa08-47d2-a583-735600b77f27] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:39.977243 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-407b1139-2e75-4769-b791-1d9aa79d90d5 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:39.982352 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-407b1139-2e75-4769-b791-1d9aa79d90d5 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:39.985718 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-407b1139-2e75-4769-b791-1d9aa79d90d5 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:39.988292 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-407b1139-2e75-4769-b791-1d9aa79d90d5 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:39.993208 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-407b1139-2e75-4769-b791-1d9aa79d90d5 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:40.000194 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-407b1139-2e75-4769-b791-1d9aa79d90d5 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:40.010661 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d7a5b0d9-461f-40c4-8d38-53d218abe27f tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:40.027622 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d7a5b0d9-461f-40c4-8d38-53d218abe27f tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38" status: 200 len: 1282 microversion: 2.1 time: 0.438451 Oct 26 13:07:40.030688 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 700/1504] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:39 2022] GET /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38 => generated 1282 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:07:40.516140 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b1f7793e-85d8-4a09-a51c-57e5f2aa1344 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:40.517275 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b1f7793e-85d8-4a09-a51c-57e5f2aa1344 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:40.530145 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b1f7793e-85d8-4a09-a51c-57e5f2aa1344 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:40.531105 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b1f7793e-85d8-4a09-a51c-57e5f2aa1344 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:40.531957 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b1f7793e-85d8-4a09-a51c-57e5f2aa1344 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:40.532885 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b1f7793e-85d8-4a09-a51c-57e5f2aa1344 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:40.534009 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b1f7793e-85d8-4a09-a51c-57e5f2aa1344 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:40.534662 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b1f7793e-85d8-4a09-a51c-57e5f2aa1344 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:40.610422 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-407b1139-2e75-4769-b791-1d9aa79d90d5 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:40.622328 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-407b1139-2e75-4769-b791-1d9aa79d90d5 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27" status: 200 len: 1498 microversion: 2.1 time: 0.660032 Oct 26 13:07:40.625527 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 805/1505] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:39 2022] GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27 => generated 1498 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:07:40.737652 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4dbbcbc6-1d35-4bc7-b6d2-ac595c3c9933 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:40.738281 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4dbbcbc6-1d35-4bc7-b6d2-ac595c3c9933 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:40.760909 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4dbbcbc6-1d35-4bc7-b6d2-ac595c3c9933 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:40.761442 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4dbbcbc6-1d35-4bc7-b6d2-ac595c3c9933 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:40.765052 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4dbbcbc6-1d35-4bc7-b6d2-ac595c3c9933 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:40.769006 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4dbbcbc6-1d35-4bc7-b6d2-ac595c3c9933 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:40.770046 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4dbbcbc6-1d35-4bc7-b6d2-ac595c3c9933 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:40.773312 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4dbbcbc6-1d35-4bc7-b6d2-ac595c3c9933 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:41.260492 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4dbbcbc6-1d35-4bc7-b6d2-ac595c3c9933 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:41.274123 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4dbbcbc6-1d35-4bc7-b6d2-ac595c3c9933 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1473 microversion: 2.1 time: 0.545955 Oct 26 13:07:41.279361 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 806/1506] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:40 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1473 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:41.298721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b0422068-f15c-4a36-ab59-10d834fd2b4b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:41.301281 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b0422068-f15c-4a36-ab59-10d834fd2b4b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: f274cbdb-53e5-4634-b1c8-1913500fef38] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:41.327844 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b0422068-f15c-4a36-ab59-10d834fd2b4b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:41.328942 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b0422068-f15c-4a36-ab59-10d834fd2b4b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:41.331506 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b0422068-f15c-4a36-ab59-10d834fd2b4b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:41.332831 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b0422068-f15c-4a36-ab59-10d834fd2b4b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:41.335629 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b0422068-f15c-4a36-ab59-10d834fd2b4b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:41.336755 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b0422068-f15c-4a36-ab59-10d834fd2b4b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:41.467516 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b1f7793e-85d8-4a09-a51c-57e5f2aa1344 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:41.489754 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b1f7793e-85d8-4a09-a51c-57e5f2aa1344 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1475 microversion: 2.1 time: 0.974546 Oct 26 13:07:41.498035 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 701/1507] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:40 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1475 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:07:41.505364 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-02cbb820-9614-4af6-af7f-c78bf0b20a77 req-1864dccd-8cc3-4c0d-ba83-a6064f128fe0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70961c4d-e68b-4b33-a2ad-1fd612e14a73", "name": "network-vif-unplugged", "status": "completed", "tag": "6310dd0d-823a-4f3c-b6f0-fde873d3af7c"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:41.565565 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-02cbb820-9614-4af6-af7f-c78bf0b20a77 req-1864dccd-8cc3-4c0d-ba83-a6064f128fe0 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:41.566144 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-02cbb820-9614-4af6-af7f-c78bf0b20a77 req-1864dccd-8cc3-4c0d-ba83-a6064f128fe0 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:41.566488 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-02cbb820-9614-4af6-af7f-c78bf0b20a77 req-1864dccd-8cc3-4c0d-ba83-a6064f128fe0 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:41.580475 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b0422068-f15c-4a36-ab59-10d834fd2b4b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:41.602100 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b0422068-f15c-4a36-ab59-10d834fd2b4b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38" status: 200 len: 1282 microversion: 2.1 time: 0.321052 Oct 26 13:07:41.621663 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 807/1508] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:41 2022] GET /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38 => generated 1282 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:41.621984 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-02cbb820-9614-4af6-af7f-c78bf0b20a77 req-1864dccd-8cc3-4c0d-ba83-a6064f128fe0 service nova] Creating event network-vif-unplugged:6310dd0d-823a-4f3c-b6f0-fde873d3af7c for instance 70961c4d-e68b-4b33-a2ad-1fd612e14a73 on n-h1-862686-1 Oct 26 13:07:41.633525 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [req-02cbb820-9614-4af6-af7f-c78bf0b20a77 req-1864dccd-8cc3-4c0d-ba83-a6064f128fe0 service nova] Instance 70961c4d-e68b-4b33-a2ad-1fd612e14a73 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862686-1', 'n-h1-862686-1'} {{(pid=120597) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 13:07:41.669145 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-02cbb820-9614-4af6-af7f-c78bf0b20a77 req-1864dccd-8cc3-4c0d-ba83-a6064f128fe0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.168221 Oct 26 13:07:41.670507 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 702/1509] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:07:41.676704 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5216e7a0-9b46-4016-bc7f-ec64e7345e40 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:41.677944 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5216e7a0-9b46-4016-bc7f-ec64e7345e40 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: d426a4f6-fa08-47d2-a583-735600b77f27] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:41.689615 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5216e7a0-9b46-4016-bc7f-ec64e7345e40 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:41.690135 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5216e7a0-9b46-4016-bc7f-ec64e7345e40 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:41.691406 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5216e7a0-9b46-4016-bc7f-ec64e7345e40 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:41.692129 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5216e7a0-9b46-4016-bc7f-ec64e7345e40 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:41.692574 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5216e7a0-9b46-4016-bc7f-ec64e7345e40 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:41.693001 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5216e7a0-9b46-4016-bc7f-ec64e7345e40 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:41.893295 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-47f8555b-e439-481a-a6e9-fc6a98ad044d tempest-AbsoluteLimitsTestJSON-1107277023 tempest-AbsoluteLimitsTestJSON-1107277023-project] Calling method '.version_select at 0x7f6731fbea60>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:41.904250 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:07:41.919093 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47f8555b-e439-481a-a6e9-fc6a98ad044d tempest-AbsoluteLimitsTestJSON-1107277023 tempest-AbsoluteLimitsTestJSON-1107277023-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:41.919593 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47f8555b-e439-481a-a6e9-fc6a98ad044d tempest-AbsoluteLimitsTestJSON-1107277023 tempest-AbsoluteLimitsTestJSON-1107277023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:41.920054 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47f8555b-e439-481a-a6e9-fc6a98ad044d tempest-AbsoluteLimitsTestJSON-1107277023 tempest-AbsoluteLimitsTestJSON-1107277023-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:41.920754 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47f8555b-e439-481a-a6e9-fc6a98ad044d tempest-AbsoluteLimitsTestJSON-1107277023 tempest-AbsoluteLimitsTestJSON-1107277023-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:41.921212 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47f8555b-e439-481a-a6e9-fc6a98ad044d tempest-AbsoluteLimitsTestJSON-1107277023 tempest-AbsoluteLimitsTestJSON-1107277023-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:41.928567 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47f8555b-e439-481a-a6e9-fc6a98ad044d tempest-AbsoluteLimitsTestJSON-1107277023 tempest-AbsoluteLimitsTestJSON-1107277023-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:41.958334 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-47f8555b-e439-481a-a6e9-fc6a98ad044d tempest-AbsoluteLimitsTestJSON-1107277023 tempest-AbsoluteLimitsTestJSON-1107277023-project] 10.222.0.40 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.335018 Oct 26 13:07:41.973072 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 808/1510] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Oct 26 13:07:41 2022] GET /compute/v2.1/limits => generated 511 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:07:42.307260 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cac67b43-586f-4179-8d1d-03c87cbaca18 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:42.310896 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cac67b43-586f-4179-8d1d-03c87cbaca18 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:42.329936 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cac67b43-586f-4179-8d1d-03c87cbaca18 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:42.330632 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cac67b43-586f-4179-8d1d-03c87cbaca18 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:42.331263 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cac67b43-586f-4179-8d1d-03c87cbaca18 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:42.332146 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cac67b43-586f-4179-8d1d-03c87cbaca18 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:42.333030 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cac67b43-586f-4179-8d1d-03c87cbaca18 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:42.340094 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cac67b43-586f-4179-8d1d-03c87cbaca18 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:42.409651 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5216e7a0-9b46-4016-bc7f-ec64e7345e40 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:42.423764 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5216e7a0-9b46-4016-bc7f-ec64e7345e40 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27" status: 200 len: 1498 microversion: 2.1 time: 0.751490 Oct 26 13:07:42.444479 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 703/1511] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:41 2022] GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27 => generated 1498 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:42.524653 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b4ed9f42-88a7-432a-a5ce-78deda18556e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:42.525583 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b4ed9f42-88a7-432a-a5ce-78deda18556e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:42.542889 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b4ed9f42-88a7-432a-a5ce-78deda18556e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:42.545390 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b4ed9f42-88a7-432a-a5ce-78deda18556e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:42.547000 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b4ed9f42-88a7-432a-a5ce-78deda18556e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:42.548967 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b4ed9f42-88a7-432a-a5ce-78deda18556e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:42.550568 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b4ed9f42-88a7-432a-a5ce-78deda18556e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:42.551397 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b4ed9f42-88a7-432a-a5ce-78deda18556e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:42.556973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-cac67b43-586f-4179-8d1d-03c87cbaca18 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:42.569879 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cac67b43-586f-4179-8d1d-03c87cbaca18 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1473 microversion: 2.1 time: 0.265164 Oct 26 13:07:42.572914 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 809/1512] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:42 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1473 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:07:42.632460 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c9d87ae2-0154-440a-b899-a0e9bb5aa735 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:42.633366 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c9d87ae2-0154-440a-b899-a0e9bb5aa735 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: f274cbdb-53e5-4634-b1c8-1913500fef38] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:42.643112 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9d87ae2-0154-440a-b899-a0e9bb5aa735 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:42.643605 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9d87ae2-0154-440a-b899-a0e9bb5aa735 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:42.644320 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9d87ae2-0154-440a-b899-a0e9bb5aa735 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:42.645211 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9d87ae2-0154-440a-b899-a0e9bb5aa735 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:42.645859 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9d87ae2-0154-440a-b899-a0e9bb5aa735 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:42.647034 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9d87ae2-0154-440a-b899-a0e9bb5aa735 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:42.975597 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c9d87ae2-0154-440a-b899-a0e9bb5aa735 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:42.985248 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c9d87ae2-0154-440a-b899-a0e9bb5aa735 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38" status: 200 len: 1324 microversion: 2.1 time: 0.358500 Oct 26 13:07:42.988311 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 810/1513] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:42 2022] GET /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38 => generated 1324 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:07:43.086472 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b4ed9f42-88a7-432a-a5ce-78deda18556e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:43.099582 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b4ed9f42-88a7-432a-a5ce-78deda18556e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1475 microversion: 2.1 time: 0.580614 Oct 26 13:07:43.104791 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 704/1514] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:42 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1475 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:07:43.450610 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6c9864f8-d665-4fa2-b17a-f2cb3db7afbf tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:43.451147 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6c9864f8-d665-4fa2-b17a-f2cb3db7afbf tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: d426a4f6-fa08-47d2-a583-735600b77f27] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:43.461072 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c9864f8-d665-4fa2-b17a-f2cb3db7afbf tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:43.462794 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c9864f8-d665-4fa2-b17a-f2cb3db7afbf tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:43.463440 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c9864f8-d665-4fa2-b17a-f2cb3db7afbf tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:43.465410 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c9864f8-d665-4fa2-b17a-f2cb3db7afbf tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:43.466713 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c9864f8-d665-4fa2-b17a-f2cb3db7afbf tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:43.467157 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c9864f8-d665-4fa2-b17a-f2cb3db7afbf tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:43.599114 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2cb02a3d-2b6e-43c7-9c2f-da7668be23b9 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:43.600110 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2cb02a3d-2b6e-43c7-9c2f-da7668be23b9 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:43.614311 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2cb02a3d-2b6e-43c7-9c2f-da7668be23b9 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:43.615903 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2cb02a3d-2b6e-43c7-9c2f-da7668be23b9 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:43.616510 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2cb02a3d-2b6e-43c7-9c2f-da7668be23b9 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:43.618164 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2cb02a3d-2b6e-43c7-9c2f-da7668be23b9 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:43.618806 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2cb02a3d-2b6e-43c7-9c2f-da7668be23b9 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:43.619409 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2cb02a3d-2b6e-43c7-9c2f-da7668be23b9 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:43.780676 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6c9864f8-d665-4fa2-b17a-f2cb3db7afbf tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:43.792878 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6c9864f8-d665-4fa2-b17a-f2cb3db7afbf tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27" status: 200 len: 1498 microversion: 2.1 time: 0.346331 Oct 26 13:07:43.794483 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 811/1515] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:43 2022] GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27 => generated 1498 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:07:43.800010 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-c8bdbf70-bf69-4392-82d4-33663a16cdaf req-e44a4813-d0e7-4e5b-9316-6cdbeeec1c64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70961c4d-e68b-4b33-a2ad-1fd612e14a73", "tag": "6310dd0d-823a-4f3c-b6f0-fde873d3af7c"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:43.810727 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-c8bdbf70-bf69-4392-82d4-33663a16cdaf req-e44a4813-d0e7-4e5b-9316-6cdbeeec1c64 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:43.811205 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-c8bdbf70-bf69-4392-82d4-33663a16cdaf req-e44a4813-d0e7-4e5b-9316-6cdbeeec1c64 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:43.811631 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-c8bdbf70-bf69-4392-82d4-33663a16cdaf req-e44a4813-d0e7-4e5b-9316-6cdbeeec1c64 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:43.827321 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-c8bdbf70-bf69-4392-82d4-33663a16cdaf req-e44a4813-d0e7-4e5b-9316-6cdbeeec1c64 service nova] Creating event network-changed:6310dd0d-823a-4f3c-b6f0-fde873d3af7c for instance 70961c4d-e68b-4b33-a2ad-1fd612e14a73 on n-h1-862686-1 Oct 26 13:07:43.836150 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [req-c8bdbf70-bf69-4392-82d4-33663a16cdaf req-e44a4813-d0e7-4e5b-9316-6cdbeeec1c64 service nova] Instance 70961c4d-e68b-4b33-a2ad-1fd612e14a73 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862686-1', 'n-h1-862686-1'} {{(pid=120598) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 13:07:43.853910 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-c8bdbf70-bf69-4392-82d4-33663a16cdaf req-e44a4813-d0e7-4e5b-9316-6cdbeeec1c64 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057927 Oct 26 13:07:43.854799 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 812/1516] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:07:44.011282 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e46df932-a8d5-4b3f-96a3-33801e97c55d tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:44.011863 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e46df932-a8d5-4b3f-96a3-33801e97c55d tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: f274cbdb-53e5-4634-b1c8-1913500fef38] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:44.025898 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e46df932-a8d5-4b3f-96a3-33801e97c55d tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:44.027133 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e46df932-a8d5-4b3f-96a3-33801e97c55d tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:44.027582 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e46df932-a8d5-4b3f-96a3-33801e97c55d tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:44.028299 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e46df932-a8d5-4b3f-96a3-33801e97c55d tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:44.028757 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e46df932-a8d5-4b3f-96a3-33801e97c55d tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:44.033312 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e46df932-a8d5-4b3f-96a3-33801e97c55d tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:44.593385 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2cb02a3d-2b6e-43c7-9c2f-da7668be23b9 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:44.607462 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2cb02a3d-2b6e-43c7-9c2f-da7668be23b9 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1473 microversion: 2.1 time: 1.012311 Oct 26 13:07:44.608681 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 705/1517] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:43 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1473 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:44.613630 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b2211c8a-913f-4ca8-8dba-aca26696e92e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:44.622220 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b2211c8a-913f-4ca8-8dba-aca26696e92e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:44.639433 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b2211c8a-913f-4ca8-8dba-aca26696e92e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:44.640201 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b2211c8a-913f-4ca8-8dba-aca26696e92e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:44.640836 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b2211c8a-913f-4ca8-8dba-aca26696e92e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:44.642103 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b2211c8a-913f-4ca8-8dba-aca26696e92e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:44.642829 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b2211c8a-913f-4ca8-8dba-aca26696e92e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:44.643418 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b2211c8a-913f-4ca8-8dba-aca26696e92e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:44.904750 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e46df932-a8d5-4b3f-96a3-33801e97c55d tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:44.916901 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e46df932-a8d5-4b3f-96a3-33801e97c55d tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38" status: 200 len: 1324 microversion: 2.1 time: 0.907150 Oct 26 13:07:44.917859 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 813/1518] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:44 2022] GET /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38 => generated 1324 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:44.937036 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c3e8c17b-1dbb-438b-9bd2-f1d4e463a0da tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:44.937883 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c3e8c17b-1dbb-438b-9bd2-f1d4e463a0da tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: d426a4f6-fa08-47d2-a583-735600b77f27] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:44.963781 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c3e8c17b-1dbb-438b-9bd2-f1d4e463a0da tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:44.984778 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c3e8c17b-1dbb-438b-9bd2-f1d4e463a0da tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:44.988572 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c3e8c17b-1dbb-438b-9bd2-f1d4e463a0da tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:44.989347 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c3e8c17b-1dbb-438b-9bd2-f1d4e463a0da tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:44.992227 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c3e8c17b-1dbb-438b-9bd2-f1d4e463a0da tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:44.992664 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c3e8c17b-1dbb-438b-9bd2-f1d4e463a0da tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:45.231855 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b2211c8a-913f-4ca8-8dba-aca26696e92e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:45.244660 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b2211c8a-913f-4ca8-8dba-aca26696e92e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1473 microversion: 2.1 time: 0.634043 Oct 26 13:07:45.245270 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 706/1519] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:44 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1473 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:45.296477 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c3e8c17b-1dbb-438b-9bd2-f1d4e463a0da tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:45.315408 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c3e8c17b-1dbb-438b-9bd2-f1d4e463a0da tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27" status: 200 len: 1498 microversion: 2.1 time: 0.395599 Oct 26 13:07:45.316114 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 814/1520] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:44 2022] GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27 => generated 1498 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:45.404187 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-5fd3968b-4cb8-4fe9-89c2-573674264e01 req-5aa773fa-9e96-49ba-9b9c-d3aa8c71e6d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f274cbdb-53e5-4634-b1c8-1913500fef38", "tag": "52161141-fa34-4693-8439-7b898106f928"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:45.448603 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-5fd3968b-4cb8-4fe9-89c2-573674264e01 req-5aa773fa-9e96-49ba-9b9c-d3aa8c71e6d8 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:45.449123 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-5fd3968b-4cb8-4fe9-89c2-573674264e01 req-5aa773fa-9e96-49ba-9b9c-d3aa8c71e6d8 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:45.450708 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-5fd3968b-4cb8-4fe9-89c2-573674264e01 req-5aa773fa-9e96-49ba-9b9c-d3aa8c71e6d8 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:45.492352 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-5fd3968b-4cb8-4fe9-89c2-573674264e01 req-5aa773fa-9e96-49ba-9b9c-d3aa8c71e6d8 service nova] Creating event network-changed:52161141-fa34-4693-8439-7b898106f928 for instance f274cbdb-53e5-4634-b1c8-1913500fef38 on n-h1-862686-1 Oct 26 13:07:45.505908 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-5fd3968b-4cb8-4fe9-89c2-573674264e01 req-5aa773fa-9e96-49ba-9b9c-d3aa8c71e6d8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110447 Oct 26 13:07:45.506581 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 707/1521] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:07:45.638435 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f4c17d47-b0b0-4720-938d-233fe37ca194 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:45.639184 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f4c17d47-b0b0-4720-938d-233fe37ca194 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:45.671945 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4c17d47-b0b0-4720-938d-233fe37ca194 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:45.673414 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4c17d47-b0b0-4720-938d-233fe37ca194 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:45.674159 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4c17d47-b0b0-4720-938d-233fe37ca194 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:45.675399 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4c17d47-b0b0-4720-938d-233fe37ca194 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:45.681135 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4c17d47-b0b0-4720-938d-233fe37ca194 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:45.681953 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4c17d47-b0b0-4720-938d-233fe37ca194 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:45.945631 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0b7a5caa-fcd5-4db0-83de-10bf4cfd383f tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:45.946061 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0b7a5caa-fcd5-4db0-83de-10bf4cfd383f tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: f274cbdb-53e5-4634-b1c8-1913500fef38] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:45.954722 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b7a5caa-fcd5-4db0-83de-10bf4cfd383f tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:45.955489 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b7a5caa-fcd5-4db0-83de-10bf4cfd383f tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:45.956729 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b7a5caa-fcd5-4db0-83de-10bf4cfd383f tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:45.958112 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b7a5caa-fcd5-4db0-83de-10bf4cfd383f tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:45.960754 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b7a5caa-fcd5-4db0-83de-10bf4cfd383f tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:45.961498 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b7a5caa-fcd5-4db0-83de-10bf4cfd383f tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:46.412686 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0b7a5caa-fcd5-4db0-83de-10bf4cfd383f tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:46.424037 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0b7a5caa-fcd5-4db0-83de-10bf4cfd383f tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38" status: 200 len: 1324 microversion: 2.1 time: 0.483646 Oct 26 13:07:46.432786 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 708/1522] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:45 2022] GET /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38 => generated 1324 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:46.445828 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f357204e-8c9f-45c0-9c71-8c8da343c9a6 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:46.447122 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f357204e-8c9f-45c0-9c71-8c8da343c9a6 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:46.460508 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:07:46.468077 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f357204e-8c9f-45c0-9c71-8c8da343c9a6 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:46.472865 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f357204e-8c9f-45c0-9c71-8c8da343c9a6 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:46.473617 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f357204e-8c9f-45c0-9c71-8c8da343c9a6 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:46.477266 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f357204e-8c9f-45c0-9c71-8c8da343c9a6 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:46.480426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f357204e-8c9f-45c0-9c71-8c8da343c9a6 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:46.481126 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f357204e-8c9f-45c0-9c71-8c8da343c9a6 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:46.543118 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f4c17d47-b0b0-4720-938d-233fe37ca194 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:46.555198 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f4c17d47-b0b0-4720-938d-233fe37ca194 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1473 microversion: 2.1 time: 0.919748 Oct 26 13:07:46.557875 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 815/1523] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:45 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1473 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:46.567648 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8e1aaf8f-513c-49e1-9956-099e45b4b774 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:46.570322 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8e1aaf8f-513c-49e1-9956-099e45b4b774 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: d426a4f6-fa08-47d2-a583-735600b77f27] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:46.573626 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:07:46.585427 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e1aaf8f-513c-49e1-9956-099e45b4b774 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:46.590030 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e1aaf8f-513c-49e1-9956-099e45b4b774 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:46.590696 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e1aaf8f-513c-49e1-9956-099e45b4b774 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:46.591943 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e1aaf8f-513c-49e1-9956-099e45b4b774 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:46.592587 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e1aaf8f-513c-49e1-9956-099e45b4b774 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:46.593254 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e1aaf8f-513c-49e1-9956-099e45b4b774 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:47.067909 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:07:47.204250 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f357204e-8c9f-45c0-9c71-8c8da343c9a6 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:47.223312 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f357204e-8c9f-45c0-9c71-8c8da343c9a6 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1470 microversion: 2.1 time: 0.787855 Oct 26 13:07:47.226384 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 709/1524] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:46 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1470 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:47.257284 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5300ce70-5ada-4df8-ab7b-79c2aa61896f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:47.258998 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5300ce70-5ada-4df8-ab7b-79c2aa61896f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:47.294594 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5300ce70-5ada-4df8-ab7b-79c2aa61896f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:47.297656 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5300ce70-5ada-4df8-ab7b-79c2aa61896f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:47.298239 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5300ce70-5ada-4df8-ab7b-79c2aa61896f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:47.301023 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5300ce70-5ada-4df8-ab7b-79c2aa61896f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:47.302146 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5300ce70-5ada-4df8-ab7b-79c2aa61896f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:47.305731 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5300ce70-5ada-4df8-ab7b-79c2aa61896f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:47.339399 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=12 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:07:47.578565 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5300ce70-5ada-4df8-ab7b-79c2aa61896f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "POST /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73/action" status: 202 len: 0 microversion: 2.1 time: 0.330750 Oct 26 13:07:47.591121 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 710/1525] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:07:47 2022] POST /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:07:47.612970 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-745ab5cb-d293-4426-9a6e-7c19a2b5ad23 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:47.614479 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-745ab5cb-d293-4426-9a6e-7c19a2b5ad23 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: f274cbdb-53e5-4634-b1c8-1913500fef38] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:47.634458 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-745ab5cb-d293-4426-9a6e-7c19a2b5ad23 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:47.636660 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-745ab5cb-d293-4426-9a6e-7c19a2b5ad23 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:47.637219 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-745ab5cb-d293-4426-9a6e-7c19a2b5ad23 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:47.639446 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-745ab5cb-d293-4426-9a6e-7c19a2b5ad23 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:47.640852 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-745ab5cb-d293-4426-9a6e-7c19a2b5ad23 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:47.642164 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-745ab5cb-d293-4426-9a6e-7c19a2b5ad23 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:47.773903 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8e1aaf8f-513c-49e1-9956-099e45b4b774 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:47.787011 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8e1aaf8f-513c-49e1-9956-099e45b4b774 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27" status: 200 len: 1498 microversion: 2.1 time: 1.227734 Oct 26 13:07:47.791119 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 816/1526] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:46 2022] GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27 => generated 1498 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:47.806930 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b8e68b3f-3b9d-4009-8982-cb5c160cbac5 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:47.809296 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b8e68b3f-3b9d-4009-8982-cb5c160cbac5 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:47.823904 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b8e68b3f-3b9d-4009-8982-cb5c160cbac5 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:47.825176 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b8e68b3f-3b9d-4009-8982-cb5c160cbac5 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:47.826417 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b8e68b3f-3b9d-4009-8982-cb5c160cbac5 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:47.829740 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b8e68b3f-3b9d-4009-8982-cb5c160cbac5 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:47.831537 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b8e68b3f-3b9d-4009-8982-cb5c160cbac5 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:47.832193 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b8e68b3f-3b9d-4009-8982-cb5c160cbac5 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:48.250171 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-745ab5cb-d293-4426-9a6e-7c19a2b5ad23 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:48.259548 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-745ab5cb-d293-4426-9a6e-7c19a2b5ad23 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38" status: 200 len: 1324 microversion: 2.1 time: 0.665709 Oct 26 13:07:48.259837 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 711/1527] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:47 2022] GET /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38 => generated 1324 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:48.265896 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bc9ebd2f-8671-4bb1-ae3a-a908475160fa tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:48.267081 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bc9ebd2f-8671-4bb1-ae3a-a908475160fa tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:48.280512 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc9ebd2f-8671-4bb1-ae3a-a908475160fa tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:48.281223 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc9ebd2f-8671-4bb1-ae3a-a908475160fa tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:48.281944 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc9ebd2f-8671-4bb1-ae3a-a908475160fa tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:48.282593 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc9ebd2f-8671-4bb1-ae3a-a908475160fa tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:48.283220 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc9ebd2f-8671-4bb1-ae3a-a908475160fa tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:48.283655 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc9ebd2f-8671-4bb1-ae3a-a908475160fa tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:48.310271 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b8e68b3f-3b9d-4009-8982-cb5c160cbac5 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:48.323873 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b8e68b3f-3b9d-4009-8982-cb5c160cbac5 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1473 microversion: 2.1 time: 0.531374 Oct 26 13:07:48.329568 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 817/1528] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:47 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1473 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:48.781827 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bc9ebd2f-8671-4bb1-ae3a-a908475160fa tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:48.790724 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bc9ebd2f-8671-4bb1-ae3a-a908475160fa tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1469 microversion: 2.1 time: 0.529328 Oct 26 13:07:48.796058 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 712/1529] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:48 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1469 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:48.824625 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ce944834-ad84-416c-a9cb-34098a25eb8e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:48.826266 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ce944834-ad84-416c-a9cb-34098a25eb8e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: d426a4f6-fa08-47d2-a583-735600b77f27] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:48.842958 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ce944834-ad84-416c-a9cb-34098a25eb8e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:48.843455 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ce944834-ad84-416c-a9cb-34098a25eb8e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:48.843898 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ce944834-ad84-416c-a9cb-34098a25eb8e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:48.844624 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ce944834-ad84-416c-a9cb-34098a25eb8e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:48.845107 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ce944834-ad84-416c-a9cb-34098a25eb8e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:48.845521 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ce944834-ad84-416c-a9cb-34098a25eb8e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:49.288430 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b17c3159-d215-431d-b7bb-d01e27bc4903 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:49.289093 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b17c3159-d215-431d-b7bb-d01e27bc4903 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: f274cbdb-53e5-4634-b1c8-1913500fef38] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:49.299053 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b17c3159-d215-431d-b7bb-d01e27bc4903 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:49.299545 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b17c3159-d215-431d-b7bb-d01e27bc4903 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:49.311969 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b17c3159-d215-431d-b7bb-d01e27bc4903 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:49.313925 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b17c3159-d215-431d-b7bb-d01e27bc4903 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:49.314653 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b17c3159-d215-431d-b7bb-d01e27bc4903 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:49.315987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b17c3159-d215-431d-b7bb-d01e27bc4903 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:49.758957 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ce944834-ad84-416c-a9cb-34098a25eb8e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:49.774562 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ce944834-ad84-416c-a9cb-34098a25eb8e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27" status: 200 len: 1498 microversion: 2.1 time: 0.962756 Oct 26 13:07:49.780058 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 818/1530] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:48 2022] GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27 => generated 1498 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:49.798455 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d81db4ab-092d-4a12-9c8e-abb2717f32d5 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:49.800034 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d81db4ab-092d-4a12-9c8e-abb2717f32d5 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:49.819861 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d81db4ab-092d-4a12-9c8e-abb2717f32d5 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:49.821740 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d81db4ab-092d-4a12-9c8e-abb2717f32d5 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:49.822424 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d81db4ab-092d-4a12-9c8e-abb2717f32d5 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:49.825345 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d81db4ab-092d-4a12-9c8e-abb2717f32d5 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:49.827347 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d81db4ab-092d-4a12-9c8e-abb2717f32d5 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:49.827992 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d81db4ab-092d-4a12-9c8e-abb2717f32d5 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:50.126854 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b17c3159-d215-431d-b7bb-d01e27bc4903 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:50.142091 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b17c3159-d215-431d-b7bb-d01e27bc4903 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38" status: 200 len: 1324 microversion: 2.1 time: 0.857856 Oct 26 13:07:50.143921 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 713/1531] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:49 2022] GET /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38 => generated 1324 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:50.153521 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-aa36addf-7b5e-4997-8d90-3058393e8127 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:50.157996 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-aa36addf-7b5e-4997-8d90-3058393e8127 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:50.171414 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aa36addf-7b5e-4997-8d90-3058393e8127 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:50.171919 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aa36addf-7b5e-4997-8d90-3058393e8127 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:50.172359 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aa36addf-7b5e-4997-8d90-3058393e8127 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:50.173071 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aa36addf-7b5e-4997-8d90-3058393e8127 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:50.173560 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aa36addf-7b5e-4997-8d90-3058393e8127 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:50.177358 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aa36addf-7b5e-4997-8d90-3058393e8127 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:50.601540 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-aa36addf-7b5e-4997-8d90-3058393e8127 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:50.610232 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-aa36addf-7b5e-4997-8d90-3058393e8127 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1469 microversion: 2.1 time: 0.461728 Oct 26 13:07:50.625611 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 714/1532] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:50 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1469 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:50.634321 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-cac962e7-a71f-4e0b-baad-ba6ba037dac7 req-468ebca2-d7b2-412e-8161-a0c57d482b8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70961c4d-e68b-4b33-a2ad-1fd612e14a73", "name": "network-vif-plugged", "status": "completed", "tag": "6310dd0d-823a-4f3c-b6f0-fde873d3af7c"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:50.668523 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-cac962e7-a71f-4e0b-baad-ba6ba037dac7 req-468ebca2-d7b2-412e-8161-a0c57d482b8c service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:50.669154 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-cac962e7-a71f-4e0b-baad-ba6ba037dac7 req-468ebca2-d7b2-412e-8161-a0c57d482b8c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:50.669716 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-cac962e7-a71f-4e0b-baad-ba6ba037dac7 req-468ebca2-d7b2-412e-8161-a0c57d482b8c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:50.691203 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-cac962e7-a71f-4e0b-baad-ba6ba037dac7 req-468ebca2-d7b2-412e-8161-a0c57d482b8c service nova] Creating event network-vif-plugged:6310dd0d-823a-4f3c-b6f0-fde873d3af7c for instance 70961c4d-e68b-4b33-a2ad-1fd612e14a73 on n-h1-862686-1 Oct 26 13:07:50.706637 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [req-cac962e7-a71f-4e0b-baad-ba6ba037dac7 req-468ebca2-d7b2-412e-8161-a0c57d482b8c service nova] Instance 70961c4d-e68b-4b33-a2ad-1fd612e14a73 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862686-1', 'n-h1-862686-1'} {{(pid=120597) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 13:07:50.751131 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-cac962e7-a71f-4e0b-baad-ba6ba037dac7 req-468ebca2-d7b2-412e-8161-a0c57d482b8c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120909 Oct 26 13:07:50.762045 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 715/1533] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:07:50.884008 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-81025ff8-3171-4b76-9a1a-3c4564978664 tempest-FloatingIPsTestJSON-1758665743 tempest-FloatingIPsTestJSON-1758665743-project] Action: 'create', calling method: .version_select at 0x7f673277d0d0>, body: {"pool": null} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:51.006743 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d81db4ab-092d-4a12-9c8e-abb2717f32d5 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:51.016120 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d81db4ab-092d-4a12-9c8e-abb2717f32d5 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1479 microversion: 2.1 time: 1.234554 Oct 26 13:07:51.020861 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 819/1534] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:49 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1479 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:51.028916 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2827626d-fa5f-4be5-a89a-b75959adf959 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:51.029850 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2827626d-fa5f-4be5-a89a-b75959adf959 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: d426a4f6-fa08-47d2-a583-735600b77f27] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:51.062097 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2827626d-fa5f-4be5-a89a-b75959adf959 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:51.063013 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2827626d-fa5f-4be5-a89a-b75959adf959 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:51.063625 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2827626d-fa5f-4be5-a89a-b75959adf959 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:51.064492 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2827626d-fa5f-4be5-a89a-b75959adf959 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:51.070394 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2827626d-fa5f-4be5-a89a-b75959adf959 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:51.071093 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2827626d-fa5f-4be5-a89a-b75959adf959 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:51.086637 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:07:51.572793 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2827626d-fa5f-4be5-a89a-b75959adf959 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:51.593244 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2827626d-fa5f-4be5-a89a-b75959adf959 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27" status: 200 len: 1498 microversion: 2.1 time: 0.569977 Oct 26 13:07:51.596248 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 820/1535] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:51 2022] GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27 => generated 1498 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:51.603934 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f6718dfc-c680-4b81-b044-2f652a1ece60 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:51.605057 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f6718dfc-c680-4b81-b044-2f652a1ece60 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: f274cbdb-53e5-4634-b1c8-1913500fef38] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:51.613043 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6718dfc-c680-4b81-b044-2f652a1ece60 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:51.614088 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6718dfc-c680-4b81-b044-2f652a1ece60 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:51.614779 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6718dfc-c680-4b81-b044-2f652a1ece60 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:51.616260 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6718dfc-c680-4b81-b044-2f652a1ece60 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:51.616943 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6718dfc-c680-4b81-b044-2f652a1ece60 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:51.617619 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6718dfc-c680-4b81-b044-2f652a1ece60 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:51.910758 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:07:51.946854 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:07:52.287501 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f6718dfc-c680-4b81-b044-2f652a1ece60 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:52.298412 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f6718dfc-c680-4b81-b044-2f652a1ece60 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38" status: 200 len: 1324 microversion: 2.1 time: 0.699117 Oct 26 13:07:52.299519 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 821/1536] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:51 2022] GET /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38 => generated 1324 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:52.574783 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-17edc1a8-1e3e-48e8-a893-3bf71702701b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:52.575408 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-17edc1a8-1e3e-48e8-a893-3bf71702701b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:52.593083 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17edc1a8-1e3e-48e8-a893-3bf71702701b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:52.594814 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17edc1a8-1e3e-48e8-a893-3bf71702701b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:52.595279 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17edc1a8-1e3e-48e8-a893-3bf71702701b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:52.599828 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17edc1a8-1e3e-48e8-a893-3bf71702701b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:52.600673 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17edc1a8-1e3e-48e8-a893-3bf71702701b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:52.601165 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17edc1a8-1e3e-48e8-a893-3bf71702701b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:53.258521 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-17edc1a8-1e3e-48e8-a893-3bf71702701b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:53.277587 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-17edc1a8-1e3e-48e8-a893-3bf71702701b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1469 microversion: 2.1 time: 0.976782 Oct 26 13:07:53.278184 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 822/1537] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:52 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1469 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:53.307111 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-982b0ec8-0119-43ec-aa99-00128f2315b9 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:53.307751 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-982b0ec8-0119-43ec-aa99-00128f2315b9 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:53.344530 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-982b0ec8-0119-43ec-aa99-00128f2315b9 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:53.345135 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-982b0ec8-0119-43ec-aa99-00128f2315b9 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:53.348617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-982b0ec8-0119-43ec-aa99-00128f2315b9 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:53.349415 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-982b0ec8-0119-43ec-aa99-00128f2315b9 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:53.349914 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-982b0ec8-0119-43ec-aa99-00128f2315b9 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:53.350448 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-982b0ec8-0119-43ec-aa99-00128f2315b9 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:54.701933 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-81025ff8-3171-4b76-9a1a-3c4564978664 tempest-FloatingIPsTestJSON-1758665743 tempest-FloatingIPsTestJSON-1758665743-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.937314 Oct 26 13:07:54.703089 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 716/1538] 10.222.0.40 () {60 vars in 1170 bytes} [Wed Oct 26 13:07:50 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3939 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:07:54.712415 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5b223a8e-dbf7-482c-9e6c-078c91cf519a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:54.712998 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5b223a8e-dbf7-482c-9e6c-078c91cf519a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: d426a4f6-fa08-47d2-a583-735600b77f27] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:54.729729 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5b223a8e-dbf7-482c-9e6c-078c91cf519a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:54.731218 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5b223a8e-dbf7-482c-9e6c-078c91cf519a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:54.732018 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5b223a8e-dbf7-482c-9e6c-078c91cf519a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:54.733151 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5b223a8e-dbf7-482c-9e6c-078c91cf519a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:54.733916 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5b223a8e-dbf7-482c-9e6c-078c91cf519a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:54.734506 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5b223a8e-dbf7-482c-9e6c-078c91cf519a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:54.935539 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-982b0ec8-0119-43ec-aa99-00128f2315b9 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:54.945898 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-982b0ec8-0119-43ec-aa99-00128f2315b9 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1479 microversion: 2.1 time: 1.666608 Oct 26 13:07:54.957082 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 823/1539] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:53 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1479 bytes in 1678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:54.967153 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3985de3c-36ba-4bb2-aa36-ace96a77826c tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:54.970439 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3985de3c-36ba-4bb2-aa36-ace96a77826c tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: f274cbdb-53e5-4634-b1c8-1913500fef38] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:54.993009 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3985de3c-36ba-4bb2-aa36-ace96a77826c tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:54.993552 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3985de3c-36ba-4bb2-aa36-ace96a77826c tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:54.995256 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3985de3c-36ba-4bb2-aa36-ace96a77826c tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:54.996023 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3985de3c-36ba-4bb2-aa36-ace96a77826c tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:54.996481 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3985de3c-36ba-4bb2-aa36-ace96a77826c tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:54.996905 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3985de3c-36ba-4bb2-aa36-ace96a77826c tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:55.097048 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5b223a8e-dbf7-482c-9e6c-078c91cf519a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:55.109680 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5b223a8e-dbf7-482c-9e6c-078c91cf519a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27" status: 200 len: 1498 microversion: 2.1 time: 0.405469 Oct 26 13:07:55.114498 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 717/1540] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:54 2022] GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27 => generated 1498 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:55.134225 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-57f5f3d9-d0d1-4fb4-b9fb-04cfdc09c96c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:55.135948 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-57f5f3d9-d0d1-4fb4-b9fb-04cfdc09c96c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:55.145157 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57f5f3d9-d0d1-4fb4-b9fb-04cfdc09c96c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:55.146025 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57f5f3d9-d0d1-4fb4-b9fb-04cfdc09c96c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:55.147463 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57f5f3d9-d0d1-4fb4-b9fb-04cfdc09c96c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:55.149020 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57f5f3d9-d0d1-4fb4-b9fb-04cfdc09c96c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:55.149740 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57f5f3d9-d0d1-4fb4-b9fb-04cfdc09c96c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:55.150383 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57f5f3d9-d0d1-4fb4-b9fb-04cfdc09c96c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:55.417277 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-57f5f3d9-d0d1-4fb4-b9fb-04cfdc09c96c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:55.428812 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-57f5f3d9-d0d1-4fb4-b9fb-04cfdc09c96c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1469 microversion: 2.1 time: 0.312329 Oct 26 13:07:55.432795 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 718/1541] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:55 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1469 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:55.444711 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cab7d2bc-9bf3-44cb-bde1-547dff9916ae tempest-FloatingIPsTestJSON-1758665743 tempest-FloatingIPsTestJSON-1758665743-project] Calling method '.version_select at 0x7f67322c9940>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:55.743151 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3985de3c-36ba-4bb2-aa36-ace96a77826c tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:55.761962 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cab7d2bc-9bf3-44cb-bde1-547dff9916ae tempest-FloatingIPsTestJSON-1758665743 tempest-FloatingIPsTestJSON-1758665743-project] 10.222.0.40 "GET /compute/v2.1/os-floating-ips/a7545b95-d17c-4289-b4d0-8cf5529ecacc" status: 200 len: 142 microversion: 2.1 time: 0.325886 Oct 26 13:07:55.763193 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 719/1542] 10.222.0.40 () {58 vars in 1260 bytes} [Wed Oct 26 13:07:55 2022] GET /compute/v2.1/os-floating-ips/a7545b95-d17c-4289-b4d0-8cf5529ecacc => generated 142 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:07:55.765025 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3985de3c-36ba-4bb2-aa36-ace96a77826c tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38" status: 200 len: 1324 microversion: 2.1 time: 0.806418 Oct 26 13:07:55.768719 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-7ef8e238-56f4-49eb-9c40-1a38f521233c req-92409c7d-7d59-469a-9853-877f03c2e0f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f274cbdb-53e5-4634-b1c8-1913500fef38", "name": "network-vif-plugged", "status": "completed", "tag": "52161141-fa34-4693-8439-7b898106f928"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:55.780195 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 824/1543] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:54 2022] GET /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38 => generated 1324 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:55.784485 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-7ef8e238-56f4-49eb-9c40-1a38f521233c req-92409c7d-7d59-469a-9853-877f03c2e0f0 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:55.785002 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e4eb6f26-2751-470f-8e71-54d5f357fd36 tempest-FloatingIPsTestJSON-1758665743 tempest-FloatingIPsTestJSON-1758665743-project] Calling method '.version_select at 0x7f6731f573a0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:55.785560 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-7ef8e238-56f4-49eb-9c40-1a38f521233c req-92409c7d-7d59-469a-9853-877f03c2e0f0 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:55.786217 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-7ef8e238-56f4-49eb-9c40-1a38f521233c req-92409c7d-7d59-469a-9853-877f03c2e0f0 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:55.801398 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-7ef8e238-56f4-49eb-9c40-1a38f521233c req-92409c7d-7d59-469a-9853-877f03c2e0f0 service nova] Creating event network-vif-plugged:52161141-fa34-4693-8439-7b898106f928 for instance f274cbdb-53e5-4634-b1c8-1913500fef38 on n-h1-862686-1 Oct 26 13:07:55.808124 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-7ef8e238-56f4-49eb-9c40-1a38f521233c req-92409c7d-7d59-469a-9853-877f03c2e0f0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043481 Oct 26 13:07:55.809040 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 720/1544] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:07:55.972441 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7e098e8b-1134-45fc-b7ac-201d204d9cbf tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:55.973309 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7e098e8b-1134-45fc-b7ac-201d204d9cbf tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:55.987130 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e098e8b-1134-45fc-b7ac-201d204d9cbf tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:55.987819 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e098e8b-1134-45fc-b7ac-201d204d9cbf tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:55.988437 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e098e8b-1134-45fc-b7ac-201d204d9cbf tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:55.990880 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e098e8b-1134-45fc-b7ac-201d204d9cbf tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:55.993079 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e098e8b-1134-45fc-b7ac-201d204d9cbf tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:55.993752 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e098e8b-1134-45fc-b7ac-201d204d9cbf tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:56.210958 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7e098e8b-1134-45fc-b7ac-201d204d9cbf tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:56.218807 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7e098e8b-1134-45fc-b7ac-201d204d9cbf tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1479 microversion: 2.1 time: 0.251650 Oct 26 13:07:56.220119 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 721/1545] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:55 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1479 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:56.225914 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-2a344472-64dd-46f2-9cf9-3eebad0f3815 req-543bef9b-6791-4a88-b8cb-23d97faa9401 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70961c4d-e68b-4b33-a2ad-1fd612e14a73", "name": "network-vif-unplugged", "status": "completed", "tag": "6310dd0d-823a-4f3c-b6f0-fde873d3af7c"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:56.236565 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2a344472-64dd-46f2-9cf9-3eebad0f3815 req-543bef9b-6791-4a88-b8cb-23d97faa9401 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:56.237409 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2a344472-64dd-46f2-9cf9-3eebad0f3815 req-543bef9b-6791-4a88-b8cb-23d97faa9401 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:56.238100 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2a344472-64dd-46f2-9cf9-3eebad0f3815 req-543bef9b-6791-4a88-b8cb-23d97faa9401 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:56.252161 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-2a344472-64dd-46f2-9cf9-3eebad0f3815 req-543bef9b-6791-4a88-b8cb-23d97faa9401 service nova] Creating event network-vif-unplugged:6310dd0d-823a-4f3c-b6f0-fde873d3af7c for instance 70961c4d-e68b-4b33-a2ad-1fd612e14a73 on n-h2-862686-1 Oct 26 13:07:56.259162 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [req-2a344472-64dd-46f2-9cf9-3eebad0f3815 req-543bef9b-6791-4a88-b8cb-23d97faa9401 service nova] Instance 70961c4d-e68b-4b33-a2ad-1fd612e14a73 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862686-1', 'n-h1-862686-1'} {{(pid=120597) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 13:07:56.271010 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-2a344472-64dd-46f2-9cf9-3eebad0f3815 req-543bef9b-6791-4a88-b8cb-23d97faa9401 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049377 Oct 26 13:07:56.272448 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 722/1546] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:07:56.278348 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-171de2f8-78b9-4d6e-a2a5-23537d205633 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:56.280348 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-171de2f8-78b9-4d6e-a2a5-23537d205633 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: d426a4f6-fa08-47d2-a583-735600b77f27] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:56.288558 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-171de2f8-78b9-4d6e-a2a5-23537d205633 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:56.289388 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-171de2f8-78b9-4d6e-a2a5-23537d205633 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:56.290070 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-171de2f8-78b9-4d6e-a2a5-23537d205633 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:56.291051 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-171de2f8-78b9-4d6e-a2a5-23537d205633 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:56.291729 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-171de2f8-78b9-4d6e-a2a5-23537d205633 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:56.292368 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-171de2f8-78b9-4d6e-a2a5-23537d205633 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:56.456669 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-171de2f8-78b9-4d6e-a2a5-23537d205633 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:56.469912 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-171de2f8-78b9-4d6e-a2a5-23537d205633 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27" status: 200 len: 1498 microversion: 2.1 time: 0.195104 Oct 26 13:07:56.473717 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 723/1547] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:56 2022] GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27 => generated 1498 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:56.492600 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f1996b32-db79-4ce8-acce-5022b8c3d5f7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:56.494551 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f1996b32-db79-4ce8-acce-5022b8c3d5f7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:56.506445 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f1996b32-db79-4ce8-acce-5022b8c3d5f7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:56.507180 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f1996b32-db79-4ce8-acce-5022b8c3d5f7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:56.508269 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f1996b32-db79-4ce8-acce-5022b8c3d5f7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:56.509668 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f1996b32-db79-4ce8-acce-5022b8c3d5f7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:56.510727 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e4eb6f26-2751-470f-8e71-54d5f357fd36 tempest-FloatingIPsTestJSON-1758665743 tempest-FloatingIPsTestJSON-1758665743-project] 10.222.0.40 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.729475 Oct 26 13:07:56.511635 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 825/1548] 10.222.0.40 () {58 vars in 1149 bytes} [Wed Oct 26 13:07:55 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:07:56.512207 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f1996b32-db79-4ce8-acce-5022b8c3d5f7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:56.514387 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f1996b32-db79-4ce8-acce-5022b8c3d5f7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:56.533094 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-163f5834-67d4-4b72-ac48-791d699010a4 tempest-FloatingIPsTestJSON-1758665743 tempest-FloatingIPsTestJSON-1758665743-project] Calling method '.version_select at 0x7f6731f570d0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:56.707833 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f1996b32-db79-4ce8-acce-5022b8c3d5f7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:56.716846 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f1996b32-db79-4ce8-acce-5022b8c3d5f7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1469 microversion: 2.1 time: 0.240580 Oct 26 13:07:56.717675 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 724/1549] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:56 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1469 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:56.795307 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c9186c54-ddbd-40ce-8a7f-5202b643047b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:56.795990 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c9186c54-ddbd-40ce-8a7f-5202b643047b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: f274cbdb-53e5-4634-b1c8-1913500fef38] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:56.811949 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c9186c54-ddbd-40ce-8a7f-5202b643047b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:56.812880 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c9186c54-ddbd-40ce-8a7f-5202b643047b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:56.813605 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c9186c54-ddbd-40ce-8a7f-5202b643047b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:56.814595 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c9186c54-ddbd-40ce-8a7f-5202b643047b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:56.815272 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c9186c54-ddbd-40ce-8a7f-5202b643047b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:56.815937 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c9186c54-ddbd-40ce-8a7f-5202b643047b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:57.572288 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c9186c54-ddbd-40ce-8a7f-5202b643047b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:57.584594 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c9186c54-ddbd-40ce-8a7f-5202b643047b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38" status: 200 len: 1324 microversion: 2.1 time: 0.792950 Oct 26 13:07:57.588136 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 725/1550] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:56 2022] GET /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38 => generated 1324 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:57.594602 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-189fc78c-5fe0-4bc4-8fd4-6838525fbadc tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:57.595414 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-189fc78c-5fe0-4bc4-8fd4-6838525fbadc tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:57.611807 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-189fc78c-5fe0-4bc4-8fd4-6838525fbadc tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:57.617452 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-189fc78c-5fe0-4bc4-8fd4-6838525fbadc tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:57.618362 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-189fc78c-5fe0-4bc4-8fd4-6838525fbadc tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:57.619306 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-189fc78c-5fe0-4bc4-8fd4-6838525fbadc tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:57.621087 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-189fc78c-5fe0-4bc4-8fd4-6838525fbadc tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:57.621760 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-189fc78c-5fe0-4bc4-8fd4-6838525fbadc tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:57.994898 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-189fc78c-5fe0-4bc4-8fd4-6838525fbadc tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:58.007350 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-189fc78c-5fe0-4bc4-8fd4-6838525fbadc tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1479 microversion: 2.1 time: 0.417337 Oct 26 13:07:58.008179 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 726/1551] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:57 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1479 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:58.020546 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1b839b19-f692-4821-b0d8-5cea37f96c78 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:58.022714 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1b839b19-f692-4821-b0d8-5cea37f96c78 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: d426a4f6-fa08-47d2-a583-735600b77f27] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:58.040486 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b839b19-f692-4821-b0d8-5cea37f96c78 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:58.042702 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b839b19-f692-4821-b0d8-5cea37f96c78 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:58.045429 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b839b19-f692-4821-b0d8-5cea37f96c78 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:58.048352 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b839b19-f692-4821-b0d8-5cea37f96c78 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:58.049027 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b839b19-f692-4821-b0d8-5cea37f96c78 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:58.049894 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b839b19-f692-4821-b0d8-5cea37f96c78 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:58.117691 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:07:58.430087 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1b839b19-f692-4821-b0d8-5cea37f96c78 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:58.441284 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1b839b19-f692-4821-b0d8-5cea37f96c78 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27" status: 200 len: 1498 microversion: 2.1 time: 0.431102 Oct 26 13:07:58.442127 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 727/1552] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:58 2022] GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27 => generated 1498 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:58.455618 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bfcb87bd-dd9c-435b-b428-622d4c2a91a6 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:58.456236 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bfcb87bd-dd9c-435b-b428-622d4c2a91a6 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:58.477441 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bfcb87bd-dd9c-435b-b428-622d4c2a91a6 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:58.478251 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bfcb87bd-dd9c-435b-b428-622d4c2a91a6 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:58.478868 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bfcb87bd-dd9c-435b-b428-622d4c2a91a6 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:58.482388 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bfcb87bd-dd9c-435b-b428-622d4c2a91a6 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:58.483054 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bfcb87bd-dd9c-435b-b428-622d4c2a91a6 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:58.483651 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bfcb87bd-dd9c-435b-b428-622d4c2a91a6 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:58.763127 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bfcb87bd-dd9c-435b-b428-622d4c2a91a6 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:58.780311 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bfcb87bd-dd9c-435b-b428-622d4c2a91a6 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1469 microversion: 2.1 time: 0.337276 Oct 26 13:07:58.781524 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 728/1553] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:58 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1469 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:58.791490 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-473a1368-9ea2-4bc7-8efc-193159dba22a req-2b42cd94-92e9-4eac-b69d-bf1b645decd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "670021c1-045f-40b1-9358-c589d32e9904", "name": "network-vif-plugged", "status": "completed", "tag": "6e2ffd62-248d-44dd-83ca-8e87f79cc722"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:58.815488 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-473a1368-9ea2-4bc7-8efc-193159dba22a req-2b42cd94-92e9-4eac-b69d-bf1b645decd8 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:58.816819 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-473a1368-9ea2-4bc7-8efc-193159dba22a req-2b42cd94-92e9-4eac-b69d-bf1b645decd8 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:58.818541 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-473a1368-9ea2-4bc7-8efc-193159dba22a req-2b42cd94-92e9-4eac-b69d-bf1b645decd8 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:58.851834 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-473a1368-9ea2-4bc7-8efc-193159dba22a req-2b42cd94-92e9-4eac-b69d-bf1b645decd8 service nova] Creating event network-vif-plugged:6e2ffd62-248d-44dd-83ca-8e87f79cc722 for instance 670021c1-045f-40b1-9358-c589d32e9904 on n-h2-862686-1 Oct 26 13:07:58.867303 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-473a1368-9ea2-4bc7-8efc-193159dba22a req-2b42cd94-92e9-4eac-b69d-bf1b645decd8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084302 Oct 26 13:07:58.867930 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 729/1554] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:07:58.888068 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-1c4ef197-58e6-4f28-8b6a-a883a1ed3f21 req-8651d6a3-0f9f-43e8-af1a-7b1d27453731 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70961c4d-e68b-4b33-a2ad-1fd612e14a73", "tag": "6310dd0d-823a-4f3c-b6f0-fde873d3af7c"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:07:58.906732 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-1c4ef197-58e6-4f28-8b6a-a883a1ed3f21 req-8651d6a3-0f9f-43e8-af1a-7b1d27453731 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:58.910377 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-1c4ef197-58e6-4f28-8b6a-a883a1ed3f21 req-8651d6a3-0f9f-43e8-af1a-7b1d27453731 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:58.911042 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-1c4ef197-58e6-4f28-8b6a-a883a1ed3f21 req-8651d6a3-0f9f-43e8-af1a-7b1d27453731 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:58.926503 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-1c4ef197-58e6-4f28-8b6a-a883a1ed3f21 req-8651d6a3-0f9f-43e8-af1a-7b1d27453731 service nova] Creating event network-changed:6310dd0d-823a-4f3c-b6f0-fde873d3af7c for instance 70961c4d-e68b-4b33-a2ad-1fd612e14a73 on n-h2-862686-1 Oct 26 13:07:58.939945 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [req-1c4ef197-58e6-4f28-8b6a-a883a1ed3f21 req-8651d6a3-0f9f-43e8-af1a-7b1d27453731 service nova] Instance 70961c4d-e68b-4b33-a2ad-1fd612e14a73 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862686-1', 'n-h1-862686-1'} {{(pid=120597) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 13:07:58.960125 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-1c4ef197-58e6-4f28-8b6a-a883a1ed3f21 req-8651d6a3-0f9f-43e8-af1a-7b1d27453731 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090773 Oct 26 13:07:58.961052 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 730/1555] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:07:58.970172 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3a081728-265e-4674-abf7-976758d5833e tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:58.975060 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3a081728-265e-4674-abf7-976758d5833e tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: f274cbdb-53e5-4634-b1c8-1913500fef38] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:58.983231 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a081728-265e-4674-abf7-976758d5833e tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:58.984287 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a081728-265e-4674-abf7-976758d5833e tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:58.984907 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a081728-265e-4674-abf7-976758d5833e tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:58.986680 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a081728-265e-4674-abf7-976758d5833e tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:58.987315 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a081728-265e-4674-abf7-976758d5833e tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:58.988142 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a081728-265e-4674-abf7-976758d5833e tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:59.438210 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3a081728-265e-4674-abf7-976758d5833e tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:59.450137 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3a081728-265e-4674-abf7-976758d5833e tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38" status: 200 len: 1521 microversion: 2.1 time: 0.484206 Oct 26 13:07:59.451058 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 731/1556] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:58 2022] GET /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38 => generated 1521 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:59.461691 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-67b927f0-3552-448e-9650-f4ec31e3e932 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:59.462556 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-67b927f0-3552-448e-9650-f4ec31e3e932 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:59.476899 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-67b927f0-3552-448e-9650-f4ec31e3e932 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:59.477853 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-67b927f0-3552-448e-9650-f4ec31e3e932 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:59.478460 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-67b927f0-3552-448e-9650-f4ec31e3e932 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:59.479817 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-67b927f0-3552-448e-9650-f4ec31e3e932 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:59.480590 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-67b927f0-3552-448e-9650-f4ec31e3e932 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:59.481262 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-67b927f0-3552-448e-9650-f4ec31e3e932 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:59.947259 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-67b927f0-3552-448e-9650-f4ec31e3e932 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:07:59.956002 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-67b927f0-3552-448e-9650-f4ec31e3e932 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1479 microversion: 2.1 time: 0.503681 Oct 26 13:07:59.960420 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 732/1557] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:59 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1479 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:07:59.977365 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7e6f9360-ea70-4d9c-90c7-5786fc19cbfb tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:07:59.978037 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7e6f9360-ea70-4d9c-90c7-5786fc19cbfb tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: d426a4f6-fa08-47d2-a583-735600b77f27] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:07:59.994281 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e6f9360-ea70-4d9c-90c7-5786fc19cbfb tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:59.995331 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e6f9360-ea70-4d9c-90c7-5786fc19cbfb tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:59.995859 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e6f9360-ea70-4d9c-90c7-5786fc19cbfb tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:07:59.998485 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e6f9360-ea70-4d9c-90c7-5786fc19cbfb tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:07:59.999132 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e6f9360-ea70-4d9c-90c7-5786fc19cbfb tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:07:59.999763 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e6f9360-ea70-4d9c-90c7-5786fc19cbfb tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:00.245253 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-163f5834-67d4-4b72-ac48-791d699010a4 tempest-FloatingIPsTestJSON-1758665743 tempest-FloatingIPsTestJSON-1758665743-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/a7545b95-d17c-4289-b4d0-8cf5529ecacc" status: 202 len: 0 microversion: 2.1 time: 3.721843 Oct 26 13:08:00.246818 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 826/1558] 10.222.0.40 () {58 vars in 1263 bytes} [Wed Oct 26 13:07:56 2022] DELETE /compute/v2.1/os-floating-ips/a7545b95-d17c-4289-b4d0-8cf5529ecacc => generated 0 bytes in 3727 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:08:00.262311 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d2d4ef69-ffc8-43b9-b57d-8770c0218443 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:00.268019 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d2d4ef69-ffc8-43b9-b57d-8770c0218443 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: f274cbdb-53e5-4634-b1c8-1913500fef38] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:00.280795 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d2d4ef69-ffc8-43b9-b57d-8770c0218443 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:00.281764 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d2d4ef69-ffc8-43b9-b57d-8770c0218443 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:00.282394 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d2d4ef69-ffc8-43b9-b57d-8770c0218443 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:00.284145 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d2d4ef69-ffc8-43b9-b57d-8770c0218443 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:00.285216 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d2d4ef69-ffc8-43b9-b57d-8770c0218443 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:00.285889 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d2d4ef69-ffc8-43b9-b57d-8770c0218443 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:00.622051 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7e6f9360-ea70-4d9c-90c7-5786fc19cbfb tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:00.664671 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7e6f9360-ea70-4d9c-90c7-5786fc19cbfb tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27" status: 200 len: 1498 microversion: 2.1 time: 0.693161 Oct 26 13:08:00.682354 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 733/1559] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:07:59 2022] GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27 => generated 1498 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:00.691247 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e624be68-1a80-466d-a6c9-8217a1b70ff2 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:00.692051 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e624be68-1a80-466d-a6c9-8217a1b70ff2 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:00.698756 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e624be68-1a80-466d-a6c9-8217a1b70ff2 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:00.699581 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e624be68-1a80-466d-a6c9-8217a1b70ff2 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:00.700200 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e624be68-1a80-466d-a6c9-8217a1b70ff2 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:00.701085 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e624be68-1a80-466d-a6c9-8217a1b70ff2 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:00.701734 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e624be68-1a80-466d-a6c9-8217a1b70ff2 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:00.702326 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e624be68-1a80-466d-a6c9-8217a1b70ff2 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:00.929516 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d2d4ef69-ffc8-43b9-b57d-8770c0218443 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:00.945858 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d2d4ef69-ffc8-43b9-b57d-8770c0218443 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38" status: 200 len: 1521 microversion: 2.1 time: 0.696707 Oct 26 13:08:00.946910 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 827/1560] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:00 2022] GET /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38 => generated 1521 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:00.968987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e624be68-1a80-466d-a6c9-8217a1b70ff2 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:00.969580 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-311e0a2c-844e-4294-81c6-ad90f6ea280d tempest-FloatingIPsTestJSON-1758665743 tempest-FloatingIPsTestJSON-1758665743-project] Action: 'create', calling method: .version_select at 0x7f6731f30160>, body: {"pool": null} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:08:00.977831 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e624be68-1a80-466d-a6c9-8217a1b70ff2 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1469 microversion: 2.1 time: 0.294223 Oct 26 13:08:00.979175 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 734/1561] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:00 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1469 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:00.991804 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-940525f4-2559-4a9a-8ab4-841c450c678f tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1000083759"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:08:00.995665 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-940525f4-2559-4a9a-8ab4-841c450c678f tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: f274cbdb-53e5-4634-b1c8-1913500fef38] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:01.006575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-940525f4-2559-4a9a-8ab4-841c450c678f tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:01.007324 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-940525f4-2559-4a9a-8ab4-841c450c678f tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:01.007964 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-940525f4-2559-4a9a-8ab4-841c450c678f tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:01.009542 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-940525f4-2559-4a9a-8ab4-841c450c678f tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:01.010178 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-940525f4-2559-4a9a-8ab4-841c450c678f tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:01.010803 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-940525f4-2559-4a9a-8ab4-841c450c678f tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:01.468270 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-940525f4-2559-4a9a-8ab4-841c450c678f tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "POST /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38/action" status: 202 len: 0 microversion: 2.1 time: 0.487449 Oct 26 13:08:01.469067 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 735/1562] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:08:00 2022] POST /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38/action => generated 0 bytes in 489 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 26 13:08:01.486312 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-999c788e-d8cc-4254-ade1-3d1635a005d4 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:01.487320 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-999c788e-d8cc-4254-ade1-3d1635a005d4 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:01.503812 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-999c788e-d8cc-4254-ade1-3d1635a005d4 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:01.504308 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-999c788e-d8cc-4254-ade1-3d1635a005d4 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:01.504745 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-999c788e-d8cc-4254-ade1-3d1635a005d4 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:01.505537 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-999c788e-d8cc-4254-ade1-3d1635a005d4 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:01.513726 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-999c788e-d8cc-4254-ade1-3d1635a005d4 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:01.517169 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-999c788e-d8cc-4254-ade1-3d1635a005d4 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:01.784198 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-999c788e-d8cc-4254-ade1-3d1635a005d4 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:01.794461 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-999c788e-d8cc-4254-ade1-3d1635a005d4 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1464 microversion: 2.1 time: 0.322512 Oct 26 13:08:01.796957 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 736/1563] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:01 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1464 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:01.803319 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f965b2f3-9e33-402a-8604-92983d907f9b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '.version_select at 0x7f6732518ee0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:01.989523 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f965b2f3-9e33-402a-8604-92983d907f9b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "DELETE /compute/v2.1/images/eacaed20-a0d3-41a3-bf4a-9efc8868bd0e" status: 204 len: 0 microversion: 2.1 time: 0.190784 Oct 26 13:08:01.990311 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 737/1564] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:01 2022] DELETE /compute/v2.1/images/eacaed20-a0d3-41a3-bf4a-9efc8868bd0e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:08:01.999930 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f2e27c1e-53a7-4b93-b4d5-31e57c0983df tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:02.001702 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f2e27c1e-53a7-4b93-b4d5-31e57c0983df tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: d426a4f6-fa08-47d2-a583-735600b77f27] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:02.012736 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2e27c1e-53a7-4b93-b4d5-31e57c0983df tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:02.017955 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2e27c1e-53a7-4b93-b4d5-31e57c0983df tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:02.018529 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2e27c1e-53a7-4b93-b4d5-31e57c0983df tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:02.019378 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2e27c1e-53a7-4b93-b4d5-31e57c0983df tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:02.023599 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2e27c1e-53a7-4b93-b4d5-31e57c0983df tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:02.024322 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2e27c1e-53a7-4b93-b4d5-31e57c0983df tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:02.248906 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f2e27c1e-53a7-4b93-b4d5-31e57c0983df tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:02.259455 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f2e27c1e-53a7-4b93-b4d5-31e57c0983df tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27" status: 200 len: 1498 microversion: 2.1 time: 0.264698 Oct 26 13:08:02.260029 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 738/1565] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:01 2022] GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27 => generated 1498 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:02.335159 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4d32037f-a5c0-423b-bc9f-9ffd0efe919b tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Action: 'create', calling method: .version_select at 0x7f67322c95e0>, body: {"keypair": {"name": "tempest-keypair-951577738", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHD67PYVDDBMWcz/IYJnZuPvJPLiJgchgnMUtkDSrdHqgQaYQ3/AFcNB/npuu/wdp86kUcTIAUHjqJTXtmy/d1QU3Z3/3669A7hWlNUjKUgDGSEvLni/vWl66XysT7sF6Q=="}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:08:02.371597 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-4d32037f-a5c0-423b-bc9f-9ffd0efe919b tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Getting quotas for project 075b65181daf492da145b2e815809d91. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:08:02.377953 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-4d32037f-a5c0-423b-bc9f-9ffd0efe919b tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Getting quotas for user c7849545fe2042618da2cd47f4a2b47d and project 075b65181daf492da145b2e815809d91. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:08:02.414376 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4d32037f-a5c0-423b-bc9f-9ffd0efe919b tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.152899 Oct 26 13:08:02.421388 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 739/1566] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 13:08:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:08:02.428922 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5d3b2afc-b89a-4f5a-ac57-195556e21d74 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:08:02.434029 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5d3b2afc-b89a-4f5a-ac57-195556e21d74 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:02.444641 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d3b2afc-b89a-4f5a-ac57-195556e21d74 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:02.445536 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d3b2afc-b89a-4f5a-ac57-195556e21d74 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:02.446246 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d3b2afc-b89a-4f5a-ac57-195556e21d74 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:02.447958 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d3b2afc-b89a-4f5a-ac57-195556e21d74 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:02.448661 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d3b2afc-b89a-4f5a-ac57-195556e21d74 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:02.449345 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d3b2afc-b89a-4f5a-ac57-195556e21d74 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:02.584731 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5d3b2afc-b89a-4f5a-ac57-195556e21d74 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904/action" status: 202 len: 0 microversion: 2.1 time: 0.159966 Oct 26 13:08:02.587068 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 740/1567] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:08:02 2022] POST /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:08:02.601365 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-07cbe448-771f-46a1-8934-9b354a4288c6 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '.version_select at 0x7f67323c4040>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:02.649389 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-07cbe448-771f-46a1-8934-9b354a4288c6 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] HTTP exception thrown: Image not found. Oct 26 13:08:02.651776 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-07cbe448-771f-46a1-8934-9b354a4288c6 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Request method failure captured: Oct 26 13:08:02.651776 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/images/eacaed20-a0d3-41a3-bf4a-9efc8868bd0e HTTP/1.1 Oct 26 13:08:02.651776 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:08:02.651776 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:08:02.651776 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:08:02.651776 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:08:02.651776 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:08:02.651776 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:08:02.651776 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:08:02.651776 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:08:02.651776 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTDWcY4mtHepJlQ55KVJtNHC-FXqIi903yr1J5OC-zbXOMs1LBU3zczKCFgnqIJBIqkvCLTFhaHFSdgfodLtkoXiluiPVf_SkgLznk0TL97DMnsRT29TeJsNzQAsUym5LCo50Ifxk2xlPnZ_QiGEmh7kAsukHuXMaWRZIS-UkeLc5o8 Oct 26 13:08:02.651776 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:08:02.651776 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:08:02.651776 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:08:02.651776 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:08:02.651776 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:08:02.651776 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:08:02.651776 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 186ac42922a64992aa1973bd854830d7 Oct 26 13:08:02.651776 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-778472214 Oct 26 13:08:02.651776 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:08:02.651776 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:08:02.653305 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/186ac42922a64992aa1973bd854830d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/186ac42922a64992aa1973bd854830d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_186ac42922a64992aa1973bd854830d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/186ac42922a64992aa1973bd854830d7"}]}] Oct 26 13:08:02.653305 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-778472214 Oct 26 13:08:02.653305 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 186ac42922a64992aa1973bd854830d7 Oct 26 13:08:02.653305 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-778472214 Oct 26 13:08:02.653305 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ImagesOneServerNegativeTestJSON-778472214-project Oct 26 13:08:02.653305 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:08:02.653305 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:08:02.653305 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 0b8d4ea396494628983bde1a97222f7d Oct 26 13:08:02.653305 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-778472214-project Oct 26 13:08:02.653305 n-d-862686-1 devstack@n-api.service[120597]: method: Oct 26 13:08:02.653305 n-d-862686-1 devstack@n-api.service[120597]: exception: Image not found. Oct 26 13:08:02.653305 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'eacaed20-a0d3-41a3-bf4a-9efc8868bd0e'} Oct 26 13:08:02.653305 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:08:02.655555 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:02.655555 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 26 13:08:02.655555 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 26 13:08:02.655555 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 13:08:02.655555 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 13:08:02.655555 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 26 13:08:02.655555 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 26 13:08:02.655555 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 13:08:02.655555 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 13:08:02.655555 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 26 13:08:02.655555 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 26 13:08:02.655555 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 26 13:08:02.655555 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 26 13:08:02.655555 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 13:08:02.655555 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 13:08:02.655555 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 13:08:02.655555 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 13:08:02.655555 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID eacaed20-a0d3-41a3-bf4a-9efc8868bd0e Oct 26 13:08:02.659134 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:02.659134 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:02.659134 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:02.659134 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:02.659134 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 26 13:08:02.659134 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 26 13:08:02.659134 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 26 13:08:02.659134 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 26 13:08:02.659134 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 26 13:08:02.659134 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 26 13:08:02.659134 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 26 13:08:02.659134 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 26 13:08:02.659134 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 26 13:08:02.659134 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 26 13:08:02.659134 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 13:08:02.659134 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 13:08:02.659134 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 26 13:08:02.659134 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 26 13:08:02.659134 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 13:08:02.659134 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 13:08:02.660923 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 26 13:08:02.660923 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 26 13:08:02.660923 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 26 13:08:02.660923 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 26 13:08:02.660923 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 13:08:02.660923 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 13:08:02.660923 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 13:08:02.660923 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 13:08:02.660923 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image eacaed20-a0d3-41a3-bf4a-9efc8868bd0e could not be found. Oct 26 13:08:02.660923 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:02.660923 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:02.660923 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:02.660923 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:02.660923 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:08:02.660923 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:08:02.660923 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:08:02.660923 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:08:02.660923 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:08:02.660923 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:08:02.663851 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:08:02.663851 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:08:02.663851 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 26 13:08:02.663851 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 26 13:08:02.663851 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 26 13:08:02.663851 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:02.663851 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:02.663851 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:02.663851 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:02.663851 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:08:02.663851 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:08:02.663851 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:08:02.663851 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:08:02.663851 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 26 13:08:02.663851 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:02.663851 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-07cbe448-771f-46a1-8934-9b354a4288c6 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Returning 404 to user: Image not found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:08:02.665365 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-07cbe448-771f-46a1-8934-9b354a4288c6 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/images/eacaed20-a0d3-41a3-bf4a-9efc8868bd0e" status: 404 len: 62 microversion: 2.1 time: 0.064716 Oct 26 13:08:02.665365 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 741/1568] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:08:02 2022] GET /compute/v2.1/images/eacaed20-a0d3-41a3-bf4a-9efc8868bd0e => generated 62 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:08:02.671494 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f33db62f-2b49-4d3c-9e55-96277dc3399b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:02.672113 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f33db62f-2b49-4d3c-9e55-96277dc3399b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:02.700509 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f33db62f-2b49-4d3c-9e55-96277dc3399b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:02.701047 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f33db62f-2b49-4d3c-9e55-96277dc3399b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:02.704796 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f33db62f-2b49-4d3c-9e55-96277dc3399b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:02.705627 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f33db62f-2b49-4d3c-9e55-96277dc3399b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:02.707224 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f33db62f-2b49-4d3c-9e55-96277dc3399b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:02.708088 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f33db62f-2b49-4d3c-9e55-96277dc3399b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:03.024708 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f33db62f-2b49-4d3c-9e55-96277dc3399b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:03.034075 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f33db62f-2b49-4d3c-9e55-96277dc3399b tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1469 microversion: 2.1 time: 0.375446 Oct 26 13:08:03.035241 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 742/1569] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:02 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1469 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:03.040782 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-200f486c-614d-466c-a750-c07cd1f7743e tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:03.044149 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-200f486c-614d-466c-a750-c07cd1f7743e tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:03.057236 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-200f486c-614d-466c-a750-c07cd1f7743e tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:03.057956 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-200f486c-614d-466c-a750-c07cd1f7743e tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:03.058795 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-200f486c-614d-466c-a750-c07cd1f7743e tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:03.076248 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-200f486c-614d-466c-a750-c07cd1f7743e tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:03.082366 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-200f486c-614d-466c-a750-c07cd1f7743e tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:03.084435 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-200f486c-614d-466c-a750-c07cd1f7743e tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:03.197782 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-200f486c-614d-466c-a750-c07cd1f7743e tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:03.198617 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-200f486c-614d-466c-a750-c07cd1f7743e tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:03.199851 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-200f486c-614d-466c-a750-c07cd1f7743e tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:03.200899 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-200f486c-614d-466c-a750-c07cd1f7743e tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lazy-loading 'fault' on Instance uuid 670021c1-045f-40b1-9358-c589d32e9904 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:08:03.463231 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-200f486c-614d-466c-a750-c07cd1f7743e tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1598 microversion: 2.1 time: 0.426455 Oct 26 13:08:03.463909 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 743/1570] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:03 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1598 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:03.493232 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-05437f5c-d52b-47d3-9a6d-8774f80ec91b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:03.496466 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-05437f5c-d52b-47d3-9a6d-8774f80ec91b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: f274cbdb-53e5-4634-b1c8-1913500fef38] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:03.512204 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05437f5c-d52b-47d3-9a6d-8774f80ec91b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:03.513221 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05437f5c-d52b-47d3-9a6d-8774f80ec91b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:03.513955 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05437f5c-d52b-47d3-9a6d-8774f80ec91b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:03.515046 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05437f5c-d52b-47d3-9a6d-8774f80ec91b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:03.516183 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05437f5c-d52b-47d3-9a6d-8774f80ec91b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:03.517095 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05437f5c-d52b-47d3-9a6d-8774f80ec91b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:03.830172 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-05437f5c-d52b-47d3-9a6d-8774f80ec91b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:03.844634 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-05437f5c-d52b-47d3-9a6d-8774f80ec91b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38" status: 200 len: 1539 microversion: 2.1 time: 0.379270 Oct 26 13:08:03.853630 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 744/1571] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:03 2022] GET /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38 => generated 1539 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:04.013276 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3f4d30a7-24bc-424c-914a-e012a0ac1da5 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-523278770", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "f3e49ff8-9efe-4bcf-b4e9-6739476549bb"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:08:04.126591 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-3f4d30a7-24bc-424c-914a-e012a0ac1da5 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] validate_networks() for [('f3e49ff8-9efe-4bcf-b4e9-6739476549bb', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:08:04.981077 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-3f4d30a7-24bc-424c-914a-e012a0ac1da5 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:08:04.981513 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-3f4d30a7-24bc-424c-914a-e012a0ac1da5 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:08:04.982005 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-3f4d30a7-24bc-424c-914a-e012a0ac1da5 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:08:04.982419 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-3f4d30a7-24bc-424c-914a-e012a0ac1da5 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:08:04.982834 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-3f4d30a7-24bc-424c-914a-e012a0ac1da5 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:08:05.000188 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3f4d30a7-24bc-424c-914a-e012a0ac1da5 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:05.002847 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3f4d30a7-24bc-424c-914a-e012a0ac1da5 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:05.003319 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3f4d30a7-24bc-424c-914a-e012a0ac1da5 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:05.005279 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3f4d30a7-24bc-424c-914a-e012a0ac1da5 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:05.006901 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3f4d30a7-24bc-424c-914a-e012a0ac1da5 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:05.007894 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3f4d30a7-24bc-424c-914a-e012a0ac1da5 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:05.025207 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-311e0a2c-844e-4294-81c6-ad90f6ea280d tempest-FloatingIPsTestJSON-1758665743 tempest-FloatingIPsTestJSON-1758665743-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.076470 Oct 26 13:08:05.026293 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 828/1572] 10.222.0.40 () {60 vars in 1170 bytes} [Wed Oct 26 13:08:00 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4078 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:08:05.031434 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8ea1d37b-ede0-44eb-ac44-8c97b0e8c9dd tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:05.032621 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8ea1d37b-ede0-44eb-ac44-8c97b0e8c9dd tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: d426a4f6-fa08-47d2-a583-735600b77f27] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:05.035257 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:08:05.050799 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8ea1d37b-ede0-44eb-ac44-8c97b0e8c9dd tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:05.051741 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8ea1d37b-ede0-44eb-ac44-8c97b0e8c9dd tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:05.054511 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8ea1d37b-ede0-44eb-ac44-8c97b0e8c9dd tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:05.058485 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8ea1d37b-ede0-44eb-ac44-8c97b0e8c9dd tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:05.059311 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8ea1d37b-ede0-44eb-ac44-8c97b0e8c9dd tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:05.060003 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8ea1d37b-ede0-44eb-ac44-8c97b0e8c9dd tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:05.068400 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-3f4d30a7-24bc-424c-914a-e012a0ac1da5 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Getting quotas for project b86e36a2f7fc44daac11d122c492ba68. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:08:05.082907 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-3f4d30a7-24bc-424c-914a-e012a0ac1da5 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Getting quotas for user ec3945207e6a490fb1baa5eaefcfeaf5 and project b86e36a2f7fc44daac11d122c492ba68. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:08:05.120091 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3f4d30a7-24bc-424c-914a-e012a0ac1da5 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:08:05.122760 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3f4d30a7-24bc-424c-914a-e012a0ac1da5 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] [instance: cdca1d32-5d8f-44da-9c3b-c8d11433df06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:08:05.236923 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3f4d30a7-24bc-424c-914a-e012a0ac1da5 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.388050 Oct 26 13:08:05.238174 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 745/1573] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:08:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1390 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:08:05.254427 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bcf7bdd1-025d-4032-9fec-d69c51a69cc4 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:08:05.274442 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bcf7bdd1-025d-4032-9fec-d69c51a69cc4 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:05.313030 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bcf7bdd1-025d-4032-9fec-d69c51a69cc4 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:05.314197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bcf7bdd1-025d-4032-9fec-d69c51a69cc4 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:05.315232 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bcf7bdd1-025d-4032-9fec-d69c51a69cc4 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:05.315969 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bcf7bdd1-025d-4032-9fec-d69c51a69cc4 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:05.316437 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bcf7bdd1-025d-4032-9fec-d69c51a69cc4 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:05.316876 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bcf7bdd1-025d-4032-9fec-d69c51a69cc4 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:05.381692 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8ea1d37b-ede0-44eb-ac44-8c97b0e8c9dd tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:05.394062 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8ea1d37b-ede0-44eb-ac44-8c97b0e8c9dd tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27" status: 200 len: 1475 microversion: 2.1 time: 0.363736 Oct 26 13:08:05.396524 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 829/1574] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:05 2022] GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27 => generated 1475 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:05.407471 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0284f4ae-6b2f-4fdd-a0dd-ead0a01f79bd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:05.409400 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0284f4ae-6b2f-4fdd-a0dd-ead0a01f79bd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:05.444571 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0284f4ae-6b2f-4fdd-a0dd-ead0a01f79bd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:05.445662 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0284f4ae-6b2f-4fdd-a0dd-ead0a01f79bd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:05.446344 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0284f4ae-6b2f-4fdd-a0dd-ead0a01f79bd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:05.447336 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0284f4ae-6b2f-4fdd-a0dd-ead0a01f79bd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:05.448017 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0284f4ae-6b2f-4fdd-a0dd-ead0a01f79bd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:05.448666 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0284f4ae-6b2f-4fdd-a0dd-ead0a01f79bd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:05.521640 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bcf7bdd1-025d-4032-9fec-d69c51a69cc4 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904/action" status: 202 len: 0 microversion: 2.1 time: 0.281817 Oct 26 13:08:05.525353 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 746/1575] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:08:05 2022] POST /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:08:05.534019 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0bb2439d-6d17-4b04-8ac7-6041ad465fe8 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:05.535475 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0bb2439d-6d17-4b04-8ac7-6041ad465fe8 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: f274cbdb-53e5-4634-b1c8-1913500fef38] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:05.548062 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0bb2439d-6d17-4b04-8ac7-6041ad465fe8 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:05.548707 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0bb2439d-6d17-4b04-8ac7-6041ad465fe8 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:05.553462 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0bb2439d-6d17-4b04-8ac7-6041ad465fe8 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:05.554534 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0bb2439d-6d17-4b04-8ac7-6041ad465fe8 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:05.555115 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0bb2439d-6d17-4b04-8ac7-6041ad465fe8 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:05.555764 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0bb2439d-6d17-4b04-8ac7-6041ad465fe8 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:05.834083 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0bb2439d-6d17-4b04-8ac7-6041ad465fe8 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:05.845091 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0bb2439d-6d17-4b04-8ac7-6041ad465fe8 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38" status: 200 len: 1521 microversion: 2.1 time: 0.320583 Oct 26 13:08:05.875388 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0284f4ae-6b2f-4fdd-a0dd-ead0a01f79bd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:05.883996 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 747/1576] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:05 2022] GET /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38 => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:05.891332 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0284f4ae-6b2f-4fdd-a0dd-ead0a01f79bd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1462 microversion: 2.1 time: 0.489170 Oct 26 13:08:05.894664 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 830/1577] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:05 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1462 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:05.909691 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9a94fce3-8353-4ce8-80fd-9b1349e9248a tempest-FloatingIPsTestJSON-1758665743 tempest-FloatingIPsTestJSON-1758665743-project] Calling method '.version_select at 0x7f67322e7a60>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:05.920247 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-98725efa-e569-44c5-ba1b-aea8c3217f97 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:05.921338 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-98725efa-e569-44c5-ba1b-aea8c3217f97 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] [instance: cdca1d32-5d8f-44da-9c3b-c8d11433df06] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:06.088402 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-98725efa-e569-44c5-ba1b-aea8c3217f97 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec3945207e6a490fb1baa5eaefcfeaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86e36a2f7fc44daac11d122c492ba68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:06.096249 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-98725efa-e569-44c5-ba1b-aea8c3217f97 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] 10.222.0.40 "GET /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06" status: 200 len: 1231 microversion: 2.1 time: 0.184269 Oct 26 13:08:06.096837 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 831/1578] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:05 2022] GET /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06 => generated 1231 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:06.106535 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-93796ad5-62e6-4ddc-b4d3-bc0287bece9f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-56744271"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:08:06.119244 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-93796ad5-62e6-4ddc-b4d3-bc0287bece9f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: d426a4f6-fa08-47d2-a583-735600b77f27] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:06.136819 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-93796ad5-62e6-4ddc-b4d3-bc0287bece9f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:06.138419 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-93796ad5-62e6-4ddc-b4d3-bc0287bece9f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:06.139051 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-93796ad5-62e6-4ddc-b4d3-bc0287bece9f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:06.140273 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-93796ad5-62e6-4ddc-b4d3-bc0287bece9f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:06.141037 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-93796ad5-62e6-4ddc-b4d3-bc0287bece9f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:06.145965 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-93796ad5-62e6-4ddc-b4d3-bc0287bece9f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:06.620031 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-93796ad5-62e6-4ddc-b4d3-bc0287bece9f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "POST /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27/action" status: 202 len: 0 microversion: 2.1 time: 0.517237 Oct 26 13:08:06.636242 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 832/1579] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:08:06 2022] POST /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27/action => generated 0 bytes in 534 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 26 13:08:06.659767 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e0898622-637f-4be6-b574-7a3bbe716b66 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:06.660544 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e0898622-637f-4be6-b574-7a3bbe716b66 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:06.677048 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0898622-637f-4be6-b574-7a3bbe716b66 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:06.678164 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0898622-637f-4be6-b574-7a3bbe716b66 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:06.678710 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0898622-637f-4be6-b574-7a3bbe716b66 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:06.679434 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0898622-637f-4be6-b574-7a3bbe716b66 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:06.679891 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0898622-637f-4be6-b574-7a3bbe716b66 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:06.687054 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0898622-637f-4be6-b574-7a3bbe716b66 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:06.933154 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e0898622-637f-4be6-b574-7a3bbe716b66 tempest-ServersAdminTestJSON-1468171734 tempest-ServersAdminTestJSON-1468171734-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1615 microversion: 2.1 time: 0.289543 Oct 26 13:08:06.933821 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 833/1580] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:06 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1615 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:06.957032 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a8cd5685-18e2-43a2-b7ba-97a611b6c0d2 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:06.958003 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a8cd5685-18e2-43a2-b7ba-97a611b6c0d2 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: f274cbdb-53e5-4634-b1c8-1913500fef38] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:06.978174 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a8cd5685-18e2-43a2-b7ba-97a611b6c0d2 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:06.978649 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a8cd5685-18e2-43a2-b7ba-97a611b6c0d2 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:06.979104 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a8cd5685-18e2-43a2-b7ba-97a611b6c0d2 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:06.979857 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a8cd5685-18e2-43a2-b7ba-97a611b6c0d2 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:06.980319 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a8cd5685-18e2-43a2-b7ba-97a611b6c0d2 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:06.980748 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a8cd5685-18e2-43a2-b7ba-97a611b6c0d2 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:07.033641 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a8cd5685-18e2-43a2-b7ba-97a611b6c0d2 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: f274cbdb-53e5-4634-b1c8-1913500fef38] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:08:07.171574 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a8cd5685-18e2-43a2-b7ba-97a611b6c0d2 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38" status: 204 len: 0 microversion: 2.1 time: 0.229991 Oct 26 13:08:07.175451 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 834/1581] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:08:06 2022] DELETE /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:08:07.178839 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d9e2a0ae-d89e-476e-ac63-49406f477f35 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:07.179655 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d9e2a0ae-d89e-476e-ac63-49406f477f35 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:07.188308 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9e2a0ae-d89e-476e-ac63-49406f477f35 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:07.189052 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9e2a0ae-d89e-476e-ac63-49406f477f35 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:07.189790 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9e2a0ae-d89e-476e-ac63-49406f477f35 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:07.191282 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9e2a0ae-d89e-476e-ac63-49406f477f35 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:07.191836 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9e2a0ae-d89e-476e-ac63-49406f477f35 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:07.193913 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9e2a0ae-d89e-476e-ac63-49406f477f35 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:07.363153 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d9e2a0ae-d89e-476e-ac63-49406f477f35 tempest-MigrationsAdminTest-432218603 tempest-MigrationsAdminTest-432218603-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1613 microversion: 2.1 time: 0.189163 Oct 26 13:08:07.381819 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 835/1582] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:07 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1613 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:07.399488 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cd716639-cc7a-40f3-ac3c-98936544f76a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67320a1550>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:07.460056 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cd716639-cc7a-40f3-ac3c-98936544f76a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/7d91cde1-e33e-4251-b5c9-7baac06f15a0" status: 200 len: 1412 microversion: 2.1 time: 0.076748 Oct 26 13:08:07.469042 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 836/1583] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:08:07 2022] GET /compute/v2.1/images/7d91cde1-e33e-4251-b5c9-7baac06f15a0 => generated 1412 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:07.469042 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5139a63c-1e38-47c4-b34d-3d339275c082 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-730788022", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "2bcb389e-488d-4685-a8d5-ca1ea0b41582"}], "security_groups": [{"name": "tempest-securitygroup--1162656030"}], "key_name": "tempest-keypair-951577738", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:08:07.541433 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9a94fce3-8353-4ce8-80fd-9b1349e9248a tempest-FloatingIPsTestJSON-1758665743 tempest-FloatingIPsTestJSON-1758665743-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/a542e4e7-bdf7-4cdf-b6a4-01f86bf8e3e6" status: 202 len: 0 microversion: 2.1 time: 1.655451 Oct 26 13:08:07.542078 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 748/1584] 10.222.0.40 () {58 vars in 1263 bytes} [Wed Oct 26 13:08:05 2022] DELETE /compute/v2.1/os-floating-ips/a542e4e7-bdf7-4cdf-b6a4-01f86bf8e3e6 => generated 0 bytes in 1658 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:08:07.551921 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0a9bba8d-d973-4895-ad03-c102cf423501 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:07.553059 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0a9bba8d-d973-4895-ad03-c102cf423501 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 1c5d8fc5-5c9f-4bdf-81ed-388df5d390de] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:07.561459 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:08:07.564476 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0a9bba8d-d973-4895-ad03-c102cf423501 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:07.565886 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0a9bba8d-d973-4895-ad03-c102cf423501 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:07.566964 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0a9bba8d-d973-4895-ad03-c102cf423501 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:07.571435 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0a9bba8d-d973-4895-ad03-c102cf423501 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:07.580260 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0a9bba8d-d973-4895-ad03-c102cf423501 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:07.581205 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0a9bba8d-d973-4895-ad03-c102cf423501 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:07.627592 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0a9bba8d-d973-4895-ad03-c102cf423501 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 1c5d8fc5-5c9f-4bdf-81ed-388df5d390de] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:08:07.647381 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-5139a63c-1e38-47c4-b34d-3d339275c082 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] validate_networks() for [('2bcb389e-488d-4685-a8d5-ca1ea0b41582', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:08:07.805796 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0a9bba8d-d973-4895-ad03-c102cf423501 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1c5d8fc5-5c9f-4bdf-81ed-388df5d390de" status: 204 len: 0 microversion: 2.1 time: 0.262101 Oct 26 13:08:07.806983 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 749/1585] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:08:07 2022] DELETE /compute/v2.1/servers/1c5d8fc5-5c9f-4bdf-81ed-388df5d390de => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:08:07.818508 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-08741587-d11f-4aca-b127-11530bcf8902 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:07.820040 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-08741587-d11f-4aca-b127-11530bcf8902 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] [instance: cdca1d32-5d8f-44da-9c3b-c8d11433df06] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:07.829009 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-08741587-d11f-4aca-b127-11530bcf8902 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:07.830130 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-08741587-d11f-4aca-b127-11530bcf8902 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:07.830875 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-08741587-d11f-4aca-b127-11530bcf8902 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:07.832907 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-08741587-d11f-4aca-b127-11530bcf8902 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:07.833677 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-08741587-d11f-4aca-b127-11530bcf8902 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:07.834440 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-08741587-d11f-4aca-b127-11530bcf8902 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:07.953509 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-08741587-d11f-4aca-b127-11530bcf8902 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec3945207e6a490fb1baa5eaefcfeaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86e36a2f7fc44daac11d122c492ba68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:07.985168 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-08741587-d11f-4aca-b127-11530bcf8902 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] 10.222.0.40 "GET /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06" status: 200 len: 1283 microversion: 2.1 time: 0.176705 Oct 26 13:08:07.987985 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 750/1586] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:07 2022] GET /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06 => generated 1283 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:08.006324 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4e526c61-113c-4f1a-9aa2-4adc272308e9 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:08.007505 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4e526c61-113c-4f1a-9aa2-4adc272308e9 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: f274cbdb-53e5-4634-b1c8-1913500fef38] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:08.018049 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e526c61-113c-4f1a-9aa2-4adc272308e9 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:08.019049 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e526c61-113c-4f1a-9aa2-4adc272308e9 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:08.020096 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e526c61-113c-4f1a-9aa2-4adc272308e9 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:08.021930 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e526c61-113c-4f1a-9aa2-4adc272308e9 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:08.022770 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e526c61-113c-4f1a-9aa2-4adc272308e9 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:08.023595 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e526c61-113c-4f1a-9aa2-4adc272308e9 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:08.322917 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4e526c61-113c-4f1a-9aa2-4adc272308e9 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:08.335476 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4e526c61-113c-4f1a-9aa2-4adc272308e9 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38" status: 200 len: 1527 microversion: 2.1 time: 0.346975 Oct 26 13:08:08.337252 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 751/1587] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:07 2022] GET /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38 => generated 1527 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:08.345196 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b92b20cd-431b-4c6f-b4ab-7e7636859124 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:08.346474 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b92b20cd-431b-4c6f-b4ab-7e7636859124 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:08.357473 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b92b20cd-431b-4c6f-b4ab-7e7636859124 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:08.358238 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b92b20cd-431b-4c6f-b4ab-7e7636859124 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:08.358685 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b92b20cd-431b-4c6f-b4ab-7e7636859124 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:08.359627 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b92b20cd-431b-4c6f-b4ab-7e7636859124 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:08.360098 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b92b20cd-431b-4c6f-b4ab-7e7636859124 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:08.360728 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b92b20cd-431b-4c6f-b4ab-7e7636859124 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:08.404046 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b92b20cd-431b-4c6f-b4ab-7e7636859124 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:08:08.491613 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-5139a63c-1e38-47c4-b34d-3d339275c082 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Getting quotas for project 075b65181daf492da145b2e815809d91. Resources: dict_keys(['metadata_items']) {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:08:08.499100 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-5139a63c-1e38-47c4-b34d-3d339275c082 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Getting quotas for user c7849545fe2042618da2cd47f4a2b47d and project 075b65181daf492da145b2e815809d91. Resources: dict_keys(['metadata_items']) {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:08:08.517036 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-5139a63c-1e38-47c4-b34d-3d339275c082 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:08:08.517885 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-5139a63c-1e38-47c4-b34d-3d339275c082 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:08:08.518848 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-5139a63c-1e38-47c4-b34d-3d339275c082 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:08:08.519522 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-5139a63c-1e38-47c4-b34d-3d339275c082 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:08:08.520229 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-5139a63c-1e38-47c4-b34d-3d339275c082 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:08:08.535418 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b92b20cd-431b-4c6f-b4ab-7e7636859124 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "DELETE /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 204 len: 0 microversion: 2.1 time: 0.196099 Oct 26 13:08:08.541336 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 752/1588] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:08:08 2022] DELETE /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:08:08.546104 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5139a63c-1e38-47c4-b34d-3d339275c082 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:08.547462 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5139a63c-1e38-47c4-b34d-3d339275c082 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:08.548188 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5139a63c-1e38-47c4-b34d-3d339275c082 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:08.549403 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5139a63c-1e38-47c4-b34d-3d339275c082 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:08.549948 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e4fe9405-70bb-4dd7-9f53-9b8a3cc808c5 tempest-FloatingIPsTestJSON-1758665743 tempest-FloatingIPsTestJSON-1758665743-project] Calling method '.version_select at 0x7f67323181f0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:08.551924 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5139a63c-1e38-47c4-b34d-3d339275c082 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:08.553439 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5139a63c-1e38-47c4-b34d-3d339275c082 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:08.574939 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-5139a63c-1e38-47c4-b34d-3d339275c082 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Getting quotas for project 075b65181daf492da145b2e815809d91. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:08:08.582589 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-5139a63c-1e38-47c4-b34d-3d339275c082 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Getting quotas for user c7849545fe2042618da2cd47f4a2b47d and project 075b65181daf492da145b2e815809d91. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:08:08.617166 n-d-862686-1 devstack@n-api.service[120597]: DEBUG neutronclient.v2_0.client [None req-e4fe9405-70bb-4dd7-9f53-9b8a3cc808c5 tempest-FloatingIPsTestJSON-1758665743 tempest-FloatingIPsTestJSON-1758665743-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a542e4e7-bdf7-4cdf-b6a4-01f86bf8e3e6 could not be found", "detail": ""}} {{(pid=120597) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 26 13:08:08.618874 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-e4fe9405-70bb-4dd7-9f53-9b8a3cc808c5 tempest-FloatingIPsTestJSON-1758665743 tempest-FloatingIPsTestJSON-1758665743-project] HTTP exception thrown: Floating IP not found for ID a542e4e7-bdf7-4cdf-b6a4-01f86bf8e3e6 Oct 26 13:08:08.623485 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e4fe9405-70bb-4dd7-9f53-9b8a3cc808c5 tempest-FloatingIPsTestJSON-1758665743 tempest-FloatingIPsTestJSON-1758665743-project] Request method failure captured: Oct 26 13:08:08.623485 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/os-floating-ips/a542e4e7-bdf7-4cdf-b6a4-01f86bf8e3e6 HTTP/1.1 Oct 26 13:08:08.623485 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:08:08.623485 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:08:08.623485 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:08:08.623485 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:08:08.623485 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:08:08.623485 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:08:08.623485 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:08:08.623485 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:08:08.623485 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTEmb8e7fb0j7PBlZMRS6CtMEpxMir8unCOTc_U5Too1q76tr7kBacJJZUtW6gOoI9F52_fNdhInFVAOy0_8dMm47FrC6VGW4n1RzcYLJ-YVJnquNqUu9z-H-bX49hMfGW-jW9a_s25M4bv0peLV574K9aFKXzOash4vXWGyqB_L_qE Oct 26 13:08:08.623485 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:08:08.623485 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:08:08.623485 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:08:08.623485 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:08:08.623485 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:08:08.623485 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:08:08.623485 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 3b8082dc53d04cda9f728ef5926ab662 Oct 26 13:08:08.623485 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-FloatingIPsTestJSON-1758665743 Oct 26 13:08:08.623485 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:08:08.623485 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:08:08.625543 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3b8082dc53d04cda9f728ef5926ab662"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3b8082dc53d04cda9f728ef5926ab662"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3b8082dc53d04cda9f728ef5926ab662"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3b8082dc53d04cda9f728ef5926ab662"}]}] Oct 26 13:08:08.625543 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-FloatingIPsTestJSON-1758665743 Oct 26 13:08:08.625543 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 3b8082dc53d04cda9f728ef5926ab662 Oct 26 13:08:08.625543 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1758665743 Oct 26 13:08:08.625543 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-FloatingIPsTestJSON-1758665743-project Oct 26 13:08:08.625543 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:08:08.625543 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:08:08.625543 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: d3af6688b90846eb9829efa816443eb2 Oct 26 13:08:08.625543 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-FloatingIPsTestJSON-1758665743-project Oct 26 13:08:08.625543 n-d-862686-1 devstack@n-api.service[120597]: method: Oct 26 13:08:08.625543 n-d-862686-1 devstack@n-api.service[120597]: exception: Floating IP not found for ID a542e4e7-bdf7-4cdf-b6a4-01f86bf8e3e6 Oct 26 13:08:08.625543 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'a542e4e7-bdf7-4cdf-b6a4-01f86bf8e3e6'} Oct 26 13:08:08.625543 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:08:08.626840 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:08.626840 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 26 13:08:08.626840 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 26 13:08:08.626840 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:08:08.626840 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:08:08.626840 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 26 13:08:08.626840 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 26 13:08:08.626840 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:08:08.626840 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:08:08.626840 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 26 13:08:08.626840 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 26 13:08:08.626840 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:08:08.626840 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:08:08.626840 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 26 13:08:08.626840 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 26 13:08:08.626840 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:08:08.626840 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:08:08.626840 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 26 13:08:08.626840 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 26 13:08:08.628916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:08:08.628916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:08:08.628916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 26 13:08:08.628916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 26 13:08:08.628916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 26 13:08:08.628916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 26 13:08:08.628916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP a542e4e7-bdf7-4cdf-b6a4-01f86bf8e3e6 could not be found Oct 26 13:08:08.628916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0e5192fb-f192-4721-8d58-6d6b9e485131'] Oct 26 13:08:08.628916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:08.628916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:08.628916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:08.628916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:08.628916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 26 13:08:08.628916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 26 13:08:08.628916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 26 13:08:08.628916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 26 13:08:08.628916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID a542e4e7-bdf7-4cdf-b6a4-01f86bf8e3e6. Oct 26 13:08:08.628916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:08.628916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:08.628916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:08.631345 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:08.631345 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:08:08.631345 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:08:08.631345 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:08:08.631345 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:08:08.631345 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:08:08.631345 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:08:08.631345 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:08:08.631345 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:08:08.631345 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 26 13:08:08.631345 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 26 13:08:08.631345 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID a542e4e7-bdf7-4cdf-b6a4-01f86bf8e3e6 Oct 26 13:08:08.631345 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:08.631345 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:08.631345 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:08.631345 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:08.631345 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:08:08.631345 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:08:08.631345 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:08:08.631345 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:08:08.633668 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID a542e4e7-bdf7-4cdf-b6a4-01f86bf8e3e6 Oct 26 13:08:08.633668 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:08.633668 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e4fe9405-70bb-4dd7-9f53-9b8a3cc808c5 tempest-FloatingIPsTestJSON-1758665743 tempest-FloatingIPsTestJSON-1758665743-project] Returning 404 to user: Floating IP not found for ID a542e4e7-bdf7-4cdf-b6a4-01f86bf8e3e6 {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:08:08.633668 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e4fe9405-70bb-4dd7-9f53-9b8a3cc808c5 tempest-FloatingIPsTestJSON-1758665743 tempest-FloatingIPsTestJSON-1758665743-project] 10.222.0.40 "GET /compute/v2.1/os-floating-ips/a542e4e7-bdf7-4cdf-b6a4-01f86bf8e3e6" status: 404 len: 111 microversion: 2.1 time: 0.083557 Oct 26 13:08:08.633668 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 753/1589] 10.222.0.40 () {58 vars in 1260 bytes} [Wed Oct 26 13:08:08 2022] GET /compute/v2.1/os-floating-ips/a542e4e7-bdf7-4cdf-b6a4-01f86bf8e3e6 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:08:08.643026 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5139a63c-1e38-47c4-b34d-3d339275c082 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:08:08.648751 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3426a084-9715-492d-939a-d04d052bfff6 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:08.650279 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3426a084-9715-492d-939a-d04d052bfff6 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 1c5d8fc5-5c9f-4bdf-81ed-388df5d390de] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:08.653177 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5139a63c-1e38-47c4-b34d-3d339275c082 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] [instance: 523459ad-2398-43e2-b03b-3dc16c7214cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:08:08.670938 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3426a084-9715-492d-939a-d04d052bfff6 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:08.671468 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3426a084-9715-492d-939a-d04d052bfff6 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:08.672152 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3426a084-9715-492d-939a-d04d052bfff6 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:08.673092 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3426a084-9715-492d-939a-d04d052bfff6 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:08.674294 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3426a084-9715-492d-939a-d04d052bfff6 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:08.675044 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3426a084-9715-492d-939a-d04d052bfff6 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:08.754140 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5139a63c-1e38-47c4-b34d-3d339275c082 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.291238 Oct 26 13:08:08.756038 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 837/1590] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:08:07 2022] POST /compute/v2.1/servers => generated 409 bytes in 1293 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:08:08.762762 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2d0f57c6-89cf-4b44-a712-3aebc0375214 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f6731f30f70>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:08.901182 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2d0f57c6-89cf-4b44-a712-3aebc0375214 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/7d91cde1-e33e-4251-b5c9-7baac06f15a0" status: 200 len: 1412 microversion: 2.1 time: 0.143619 Oct 26 13:08:08.904094 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 838/1591] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:08:08 2022] GET /compute/v2.1/images/7d91cde1-e33e-4251-b5c9-7baac06f15a0 => generated 1412 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:08.913842 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cbb3ca25-8e3a-4382-a09e-34728868e7bc tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:08.916097 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cbb3ca25-8e3a-4382-a09e-34728868e7bc tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:08.964850 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cbb3ca25-8e3a-4382-a09e-34728868e7bc tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:08.965508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cbb3ca25-8e3a-4382-a09e-34728868e7bc tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:08.965972 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cbb3ca25-8e3a-4382-a09e-34728868e7bc tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:08.968822 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cbb3ca25-8e3a-4382-a09e-34728868e7bc tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:08.969307 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cbb3ca25-8e3a-4382-a09e-34728868e7bc tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:08.969947 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cbb3ca25-8e3a-4382-a09e-34728868e7bc tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:09.096762 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3426a084-9715-492d-939a-d04d052bfff6 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:09.110153 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3426a084-9715-492d-939a-d04d052bfff6 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/1c5d8fc5-5c9f-4bdf-81ed-388df5d390de" status: 200 len: 1468 microversion: 2.1 time: 0.479795 Oct 26 13:08:09.121608 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 754/1592] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:08 2022] GET /compute/v2.1/servers/1c5d8fc5-5c9f-4bdf-81ed-388df5d390de => generated 1468 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:09.121608 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-eaa622be-be12-48e3-be9d-d413ca0dcea6 tempest-FloatingIPsTestJSON-1758665743 tempest-FloatingIPsTestJSON-1758665743-project] Calling method '.version_select at 0x7f67322703a0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:09.215328 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-cbb3ca25-8e3a-4382-a09e-34728868e7bc tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:09.218505 n-d-862686-1 devstack@n-api.service[120597]: DEBUG neutronclient.v2_0.client [None req-eaa622be-be12-48e3-be9d-d413ca0dcea6 tempest-FloatingIPsTestJSON-1758665743 tempest-FloatingIPsTestJSON-1758665743-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a542e4e7-bdf7-4cdf-b6a4-01f86bf8e3e6 could not be found", "detail": ""}} {{(pid=120597) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 26 13:08:09.219181 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-eaa622be-be12-48e3-be9d-d413ca0dcea6 tempest-FloatingIPsTestJSON-1758665743 tempest-FloatingIPsTestJSON-1758665743-project] HTTP exception thrown: Floating IP not found for ID a542e4e7-bdf7-4cdf-b6a4-01f86bf8e3e6 Oct 26 13:08:09.220973 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-eaa622be-be12-48e3-be9d-d413ca0dcea6 tempest-FloatingIPsTestJSON-1758665743 tempest-FloatingIPsTestJSON-1758665743-project] Request method failure captured: Oct 26 13:08:09.220973 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/os-floating-ips/a542e4e7-bdf7-4cdf-b6a4-01f86bf8e3e6 HTTP/1.1 Oct 26 13:08:09.220973 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:08:09.220973 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:08:09.220973 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:08:09.220973 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:08:09.220973 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:08:09.220973 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:08:09.220973 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:08:09.220973 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:08:09.220973 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTEmb8e7fb0j7PBlZMRS6CtMEpxMir8unCOTc_U5Too1q76tr7kBacJJZUtW6gOoI9F52_fNdhInFVAOy0_8dMm47FrC6VGW4n1RzcYLJ-YVJnquNqUu9z-H-bX49hMfGW-jW9a_s25M4bv0peLV574K9aFKXzOash4vXWGyqB_L_qE Oct 26 13:08:09.220973 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:08:09.220973 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:08:09.220973 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:08:09.220973 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:08:09.220973 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:08:09.220973 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:08:09.220973 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 3b8082dc53d04cda9f728ef5926ab662 Oct 26 13:08:09.220973 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-FloatingIPsTestJSON-1758665743 Oct 26 13:08:09.220973 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:08:09.220973 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:08:09.222457 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3b8082dc53d04cda9f728ef5926ab662"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3b8082dc53d04cda9f728ef5926ab662"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3b8082dc53d04cda9f728ef5926ab662"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3b8082dc53d04cda9f728ef5926ab662"}]}] Oct 26 13:08:09.222457 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-FloatingIPsTestJSON-1758665743 Oct 26 13:08:09.222457 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 3b8082dc53d04cda9f728ef5926ab662 Oct 26 13:08:09.222457 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1758665743 Oct 26 13:08:09.222457 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-FloatingIPsTestJSON-1758665743-project Oct 26 13:08:09.222457 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:08:09.222457 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:08:09.222457 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: d3af6688b90846eb9829efa816443eb2 Oct 26 13:08:09.222457 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-FloatingIPsTestJSON-1758665743-project Oct 26 13:08:09.222457 n-d-862686-1 devstack@n-api.service[120597]: method: Oct 26 13:08:09.222457 n-d-862686-1 devstack@n-api.service[120597]: exception: Floating IP not found for ID a542e4e7-bdf7-4cdf-b6a4-01f86bf8e3e6 Oct 26 13:08:09.222457 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'a542e4e7-bdf7-4cdf-b6a4-01f86bf8e3e6'} Oct 26 13:08:09.222457 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:08:09.223448 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:09.223448 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 26 13:08:09.223448 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 26 13:08:09.223448 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:08:09.223448 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:08:09.223448 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 26 13:08:09.223448 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 26 13:08:09.223448 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:08:09.223448 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:08:09.223448 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 26 13:08:09.223448 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 26 13:08:09.223448 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:08:09.223448 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:08:09.223448 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 26 13:08:09.223448 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 26 13:08:09.223448 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:08:09.223448 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:08:09.223448 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 26 13:08:09.223448 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 26 13:08:09.224768 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:08:09.224768 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:08:09.224768 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 26 13:08:09.224768 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 26 13:08:09.224768 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 26 13:08:09.224768 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 26 13:08:09.224768 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP a542e4e7-bdf7-4cdf-b6a4-01f86bf8e3e6 could not be found Oct 26 13:08:09.224768 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cac68b2a-82aa-4668-9057-db19384c7b01'] Oct 26 13:08:09.224768 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:09.224768 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:09.224768 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:09.224768 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:09.224768 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 26 13:08:09.224768 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 26 13:08:09.224768 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 26 13:08:09.224768 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 26 13:08:09.224768 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID a542e4e7-bdf7-4cdf-b6a4-01f86bf8e3e6. Oct 26 13:08:09.224768 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:09.224768 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:09.224768 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:09.226291 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:09.226291 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:08:09.226291 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:08:09.226291 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:08:09.226291 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:08:09.226291 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:08:09.226291 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:08:09.226291 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:08:09.226291 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:08:09.226291 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 26 13:08:09.226291 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 26 13:08:09.226291 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID a542e4e7-bdf7-4cdf-b6a4-01f86bf8e3e6 Oct 26 13:08:09.226291 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:09.226291 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:09.226291 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:09.226291 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:09.226291 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:08:09.226291 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:08:09.226291 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:08:09.226291 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:08:09.227732 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID a542e4e7-bdf7-4cdf-b6a4-01f86bf8e3e6 Oct 26 13:08:09.227732 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:09.227732 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-eaa622be-be12-48e3-be9d-d413ca0dcea6 tempest-FloatingIPsTestJSON-1758665743 tempest-FloatingIPsTestJSON-1758665743-project] Returning 404 to user: Floating IP not found for ID a542e4e7-bdf7-4cdf-b6a4-01f86bf8e3e6 {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:08:09.227732 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-eaa622be-be12-48e3-be9d-d413ca0dcea6 tempest-FloatingIPsTestJSON-1758665743 tempest-FloatingIPsTestJSON-1758665743-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/a542e4e7-bdf7-4cdf-b6a4-01f86bf8e3e6" status: 404 len: 111 microversion: 2.1 time: 0.106783 Oct 26 13:08:09.228877 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 755/1593] 10.222.0.40 () {58 vars in 1263 bytes} [Wed Oct 26 13:08:09 2022] DELETE /compute/v2.1/os-floating-ips/a542e4e7-bdf7-4cdf-b6a4-01f86bf8e3e6 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:08:09.233288 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5e1aa65a-4f74-4140-8a34-78eba7e86686 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:09.234679 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5e1aa65a-4f74-4140-8a34-78eba7e86686 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] [instance: 523459ad-2398-43e2-b03b-3dc16c7214cb] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:09.239759 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cbb3ca25-8e3a-4382-a09e-34728868e7bc tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1468 microversion: 2.1 time: 0.333107 Oct 26 13:08:09.242779 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 839/1594] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:08 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1468 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:09.274649 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-575ff02e-7733-4af0-a7c9-8b7414a341a0 req-9605bbdb-a22c-4b62-9cc1-7465fc929025 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70961c4d-e68b-4b33-a2ad-1fd612e14a73", "name": "network-vif-plugged", "status": "completed", "tag": "6310dd0d-823a-4f3c-b6f0-fde873d3af7c"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:08:09.289941 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-575ff02e-7733-4af0-a7c9-8b7414a341a0 req-9605bbdb-a22c-4b62-9cc1-7465fc929025 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:09.290737 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-575ff02e-7733-4af0-a7c9-8b7414a341a0 req-9605bbdb-a22c-4b62-9cc1-7465fc929025 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:09.291422 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-575ff02e-7733-4af0-a7c9-8b7414a341a0 req-9605bbdb-a22c-4b62-9cc1-7465fc929025 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:09.292333 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5e1aa65a-4f74-4140-8a34-78eba7e86686 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7849545fe2042618da2cd47f4a2b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075b65181daf492da145b2e815809d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:09.299841 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5e1aa65a-4f74-4140-8a34-78eba7e86686 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] 10.222.0.40 "GET /compute/v2.1/servers/523459ad-2398-43e2-b03b-3dc16c7214cb" status: 200 len: 1276 microversion: 2.1 time: 0.070237 Oct 26 13:08:09.301930 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 756/1595] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:09 2022] GET /compute/v2.1/servers/523459ad-2398-43e2-b03b-3dc16c7214cb => generated 1276 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:09.319530 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-995a6420-2ee8-4eec-adce-1d9a2d4cccec tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:09.320415 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-995a6420-2ee8-4eec-adce-1d9a2d4cccec tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] [instance: cdca1d32-5d8f-44da-9c3b-c8d11433df06] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:09.324840 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-575ff02e-7733-4af0-a7c9-8b7414a341a0 req-9605bbdb-a22c-4b62-9cc1-7465fc929025 service nova] Creating event network-vif-plugged:6310dd0d-823a-4f3c-b6f0-fde873d3af7c for instance 70961c4d-e68b-4b33-a2ad-1fd612e14a73 on n-h2-862686-1 Oct 26 13:08:09.328991 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-995a6420-2ee8-4eec-adce-1d9a2d4cccec tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:09.329531 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-995a6420-2ee8-4eec-adce-1d9a2d4cccec tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:09.329968 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-995a6420-2ee8-4eec-adce-1d9a2d4cccec tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:09.330681 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-995a6420-2ee8-4eec-adce-1d9a2d4cccec tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:09.331134 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-995a6420-2ee8-4eec-adce-1d9a2d4cccec tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:09.331543 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-995a6420-2ee8-4eec-adce-1d9a2d4cccec tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:09.345065 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-575ff02e-7733-4af0-a7c9-8b7414a341a0 req-9605bbdb-a22c-4b62-9cc1-7465fc929025 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097240 Oct 26 13:08:09.349761 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 840/1596] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:08:09.364455 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-230536b4-b655-471f-a2c5-a59d4814830b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:09.371833 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-230536b4-b655-471f-a2c5-a59d4814830b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: f274cbdb-53e5-4634-b1c8-1913500fef38] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:09.385503 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-230536b4-b655-471f-a2c5-a59d4814830b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:09.387960 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-230536b4-b655-471f-a2c5-a59d4814830b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:09.388895 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-230536b4-b655-471f-a2c5-a59d4814830b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:09.392906 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-230536b4-b655-471f-a2c5-a59d4814830b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:09.394263 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-230536b4-b655-471f-a2c5-a59d4814830b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:09.395786 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-230536b4-b655-471f-a2c5-a59d4814830b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:09.430910 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:08:09.547462 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-995a6420-2ee8-4eec-adce-1d9a2d4cccec tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec3945207e6a490fb1baa5eaefcfeaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86e36a2f7fc44daac11d122c492ba68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:09.556688 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-995a6420-2ee8-4eec-adce-1d9a2d4cccec tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] 10.222.0.40 "GET /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06" status: 200 len: 1283 microversion: 2.1 time: 0.252977 Oct 26 13:08:09.557349 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 757/1597] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:09 2022] GET /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06 => generated 1283 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:09.923896 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8002f317-2350-4a9b-8835-296fb2da3711 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67322c9700>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:10.019375 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8002f317-2350-4a9b-8835-296fb2da3711 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/7d91cde1-e33e-4251-b5c9-7baac06f15a0" status: 200 len: 1412 microversion: 2.1 time: 0.101681 Oct 26 13:08:10.023799 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 758/1598] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:08:09 2022] GET /compute/v2.1/images/7d91cde1-e33e-4251-b5c9-7baac06f15a0 => generated 1412 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:10.044591 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-230536b4-b655-471f-a2c5-a59d4814830b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:10.063601 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-230536b4-b655-471f-a2c5-a59d4814830b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38" status: 200 len: 1527 microversion: 2.1 time: 0.706094 Oct 26 13:08:10.064200 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 841/1599] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:09 2022] GET /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38 => generated 1527 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:10.139471 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-55243b3a-4aad-41a2-8a7f-d64387a357c8 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:10.140103 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-55243b3a-4aad-41a2-8a7f-d64387a357c8 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 1c5d8fc5-5c9f-4bdf-81ed-388df5d390de] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:10.153660 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-55243b3a-4aad-41a2-8a7f-d64387a357c8 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:10.154182 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-55243b3a-4aad-41a2-8a7f-d64387a357c8 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:10.154629 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-55243b3a-4aad-41a2-8a7f-d64387a357c8 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:10.157728 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-55243b3a-4aad-41a2-8a7f-d64387a357c8 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:10.158215 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-55243b3a-4aad-41a2-8a7f-d64387a357c8 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:10.158662 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-55243b3a-4aad-41a2-8a7f-d64387a357c8 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:10.268224 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-dd20d963-5684-4804-bbe0-500e1dde7f17 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:10.268829 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-dd20d963-5684-4804-bbe0-500e1dde7f17 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:10.281375 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dd20d963-5684-4804-bbe0-500e1dde7f17 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:10.281882 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dd20d963-5684-4804-bbe0-500e1dde7f17 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:10.283617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dd20d963-5684-4804-bbe0-500e1dde7f17 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:10.283977 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dd20d963-5684-4804-bbe0-500e1dde7f17 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:10.284622 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dd20d963-5684-4804-bbe0-500e1dde7f17 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:10.285039 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dd20d963-5684-4804-bbe0-500e1dde7f17 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:10.532582 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-dd20d963-5684-4804-bbe0-500e1dde7f17 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:10.544755 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-dd20d963-5684-4804-bbe0-500e1dde7f17 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1468 microversion: 2.1 time: 0.280724 Oct 26 13:08:10.545345 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 842/1600] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:10 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1468 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:10.581182 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e06701be-38e2-416c-aaaf-e1964f6bf0fa tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:10.582138 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e06701be-38e2-416c-aaaf-e1964f6bf0fa tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] [instance: 523459ad-2398-43e2-b03b-3dc16c7214cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:10.595134 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e06701be-38e2-416c-aaaf-e1964f6bf0fa tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:10.596286 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e06701be-38e2-416c-aaaf-e1964f6bf0fa tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:10.596897 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e06701be-38e2-416c-aaaf-e1964f6bf0fa tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:10.597859 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e06701be-38e2-416c-aaaf-e1964f6bf0fa tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:10.598484 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e06701be-38e2-416c-aaaf-e1964f6bf0fa tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:10.599651 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e06701be-38e2-416c-aaaf-e1964f6bf0fa tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:10.733346 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e06701be-38e2-416c-aaaf-e1964f6bf0fa tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7849545fe2042618da2cd47f4a2b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075b65181daf492da145b2e815809d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:10.747170 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e06701be-38e2-416c-aaaf-e1964f6bf0fa tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] 10.222.0.40 "GET /compute/v2.1/servers/523459ad-2398-43e2-b03b-3dc16c7214cb" status: 200 len: 1328 microversion: 2.1 time: 0.187855 Oct 26 13:08:10.763839 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 843/1601] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:10 2022] GET /compute/v2.1/servers/523459ad-2398-43e2-b03b-3dc16c7214cb => generated 1328 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:10.779833 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-970c3533-633b-4d9e-9c45-fe53c4718e23 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1501590159", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "126fa8f9-6bcd-4196-bf93-7bb18cb15112"}], "block_device_mapping_v2": [{"uuid": "810ee9d5-e329-42de-8250-c7bd64f7e552", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:08:10.790155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-55243b3a-4aad-41a2-8a7f-d64387a357c8 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:10.807941 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-55243b3a-4aad-41a2-8a7f-d64387a357c8 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/1c5d8fc5-5c9f-4bdf-81ed-388df5d390de" status: 200 len: 1468 microversion: 2.1 time: 0.673572 Oct 26 13:08:10.812615 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 759/1602] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:10 2022] GET /compute/v2.1/servers/1c5d8fc5-5c9f-4bdf-81ed-388df5d390de => generated 1468 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:10.821764 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7bfe6351-7df8-4cf1-b58f-94c0a0f6fd0c tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:10.822385 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7bfe6351-7df8-4cf1-b58f-94c0a0f6fd0c tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] [instance: cdca1d32-5d8f-44da-9c3b-c8d11433df06] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:10.834016 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7bfe6351-7df8-4cf1-b58f-94c0a0f6fd0c tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:10.834861 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7bfe6351-7df8-4cf1-b58f-94c0a0f6fd0c tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:10.835513 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7bfe6351-7df8-4cf1-b58f-94c0a0f6fd0c tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:10.836999 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7bfe6351-7df8-4cf1-b58f-94c0a0f6fd0c tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:10.837704 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7bfe6351-7df8-4cf1-b58f-94c0a0f6fd0c tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:10.838385 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7bfe6351-7df8-4cf1-b58f-94c0a0f6fd0c tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:11.012531 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-970c3533-633b-4d9e-9c45-fe53c4718e23 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] validate_networks() for [('126fa8f9-6bcd-4196-bf93-7bb18cb15112', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:08:12.357939 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7bfe6351-7df8-4cf1-b58f-94c0a0f6fd0c tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec3945207e6a490fb1baa5eaefcfeaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86e36a2f7fc44daac11d122c492ba68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:12.366322 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7bfe6351-7df8-4cf1-b58f-94c0a0f6fd0c tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] 10.222.0.40 "GET /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06" status: 200 len: 1331 microversion: 2.1 time: 1.552619 Oct 26 13:08:12.366904 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 760/1603] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:10 2022] GET /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06 => generated 1331 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:12.388885 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-970c3533-633b-4d9e-9c45-fe53c4718e23 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:08:12.389977 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-970c3533-633b-4d9e-9c45-fe53c4718e23 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:08:12.390673 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-970c3533-633b-4d9e-9c45-fe53c4718e23 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:08:12.391250 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-970c3533-633b-4d9e-9c45-fe53c4718e23 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:08:12.392080 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-970c3533-633b-4d9e-9c45-fe53c4718e23 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:08:12.392306 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-17537706-32af-461e-bf7f-87253611cbaf tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f673278eb80>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:12.397465 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:08:12.408738 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-970c3533-633b-4d9e-9c45-fe53c4718e23 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:12.420924 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-970c3533-633b-4d9e-9c45-fe53c4718e23 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:12.421555 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-970c3533-633b-4d9e-9c45-fe53c4718e23 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:12.422992 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-970c3533-633b-4d9e-9c45-fe53c4718e23 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:12.424912 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-970c3533-633b-4d9e-9c45-fe53c4718e23 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:12.425433 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-970c3533-633b-4d9e-9c45-fe53c4718e23 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:12.490672 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-17537706-32af-461e-bf7f-87253611cbaf tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/7d91cde1-e33e-4251-b5c9-7baac06f15a0" status: 200 len: 1412 microversion: 2.1 time: 0.116204 Oct 26 13:08:12.491505 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 761/1604] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:08:12 2022] GET /compute/v2.1/images/7d91cde1-e33e-4251-b5c9-7baac06f15a0 => generated 1412 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:12.503363 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-970c3533-633b-4d9e-9c45-fe53c4718e23 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Getting quotas for project 2f7b9165f0ff4c06a5d154ea24b17bac. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:08:12.507649 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4d8c6dbe-c947-4735-b979-c4687aa8a1c3 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:12.512776 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4d8c6dbe-c947-4735-b979-c4687aa8a1c3 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: f274cbdb-53e5-4634-b1c8-1913500fef38] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:12.526019 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-970c3533-633b-4d9e-9c45-fe53c4718e23 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Getting quotas for user 27f4a513ca654b0abf9f972e07270c10 and project 2f7b9165f0ff4c06a5d154ea24b17bac. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:08:12.539895 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4d8c6dbe-c947-4735-b979-c4687aa8a1c3 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:12.540404 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4d8c6dbe-c947-4735-b979-c4687aa8a1c3 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:12.541034 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4d8c6dbe-c947-4735-b979-c4687aa8a1c3 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:12.543047 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4d8c6dbe-c947-4735-b979-c4687aa8a1c3 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:12.543740 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4d8c6dbe-c947-4735-b979-c4687aa8a1c3 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:12.546790 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4d8c6dbe-c947-4735-b979-c4687aa8a1c3 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:12.592757 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-4d8c6dbe-c947-4735-b979-c4687aa8a1c3 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] HTTP exception thrown: Instance f274cbdb-53e5-4634-b1c8-1913500fef38 could not be found. Oct 26 13:08:12.596609 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4d8c6dbe-c947-4735-b979-c4687aa8a1c3 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Request method failure captured: Oct 26 13:08:12.596609 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38 HTTP/1.1 Oct 26 13:08:12.596609 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:08:12.596609 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:08:12.596609 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:08:12.596609 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:08:12.596609 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:08:12.596609 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:08:12.596609 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:08:12.596609 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:08:12.596609 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTDWcY4mtHepJlQ55KVJtNHC-FXqIi903yr1J5OC-zbXOMs1LBU3zczKCFgnqIJBIqkvCLTFhaHFSdgfodLtkoXiluiPVf_SkgLznk0TL97DMnsRT29TeJsNzQAsUym5LCo50Ifxk2xlPnZ_QiGEmh7kAsukHuXMaWRZIS-UkeLc5o8 Oct 26 13:08:12.596609 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:08:12.596609 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:08:12.596609 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:08:12.596609 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:08:12.596609 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:08:12.596609 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:08:12.596609 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 186ac42922a64992aa1973bd854830d7 Oct 26 13:08:12.596609 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-778472214 Oct 26 13:08:12.596609 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:08:12.596609 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:08:12.598289 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/186ac42922a64992aa1973bd854830d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/186ac42922a64992aa1973bd854830d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_186ac42922a64992aa1973bd854830d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/186ac42922a64992aa1973bd854830d7"}]}] Oct 26 13:08:12.598289 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-778472214 Oct 26 13:08:12.598289 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 186ac42922a64992aa1973bd854830d7 Oct 26 13:08:12.598289 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-778472214 Oct 26 13:08:12.598289 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ImagesOneServerNegativeTestJSON-778472214-project Oct 26 13:08:12.598289 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:08:12.598289 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:08:12.598289 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 0b8d4ea396494628983bde1a97222f7d Oct 26 13:08:12.598289 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-778472214-project Oct 26 13:08:12.598289 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:08:12.598289 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance f274cbdb-53e5-4634-b1c8-1913500fef38 could not be found. Oct 26 13:08:12.598289 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'f274cbdb-53e5-4634-b1c8-1913500fef38'} Oct 26 13:08:12.599810 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:08:12.599810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:12.599810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:08:12.599810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:08:12.599810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:08:12.599810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:08:12.599810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:08:12.599810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:08:12.599810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:08:12.599810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:08:12.599810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f274cbdb-53e5-4634-b1c8-1913500fef38 could not be found. Oct 26 13:08:12.599810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:12.599810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:12.599810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:12.599810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:12.599810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:08:12.599810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:08:12.599810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:08:12.599810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:08:12.599810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:08:12.601260 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:08:12.601260 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:08:12.601260 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:08:12.601260 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:08:12.601260 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:08:12.601260 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:08:12.601260 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:08:12.601260 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f274cbdb-53e5-4634-b1c8-1913500fef38 could not be found. Oct 26 13:08:12.601260 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:12.601260 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:12.601260 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:12.601260 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:12.601260 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:08:12.601260 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:08:12.601260 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:08:12.601260 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:08:12.601260 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f274cbdb-53e5-4634-b1c8-1913500fef38 could not be found. Oct 26 13:08:12.601260 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:12.606295 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4d8c6dbe-c947-4735-b979-c4687aa8a1c3 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Returning 404 to user: Instance f274cbdb-53e5-4634-b1c8-1913500fef38 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:08:12.608669 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4d8c6dbe-c947-4735-b979-c4687aa8a1c3 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38" status: 404 len: 111 microversion: 2.1 time: 0.115674 Oct 26 13:08:12.615223 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 762/1605] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:12 2022] GET /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:08:12.636854 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-a6e3adc5-5a09-4c24-ad1c-064e49e9af1c req-ef9f170c-0804-4fdc-941c-3d8d0c6d0fd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f274cbdb-53e5-4634-b1c8-1913500fef38", "name": "network-vif-deleted", "tag": "52161141-fa34-4693-8439-7b898106f928"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:08:12.678845 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a6e3adc5-5a09-4c24-ad1c-064e49e9af1c req-ef9f170c-0804-4fdc-941c-3d8d0c6d0fd3 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:12.680946 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a6e3adc5-5a09-4c24-ad1c-064e49e9af1c req-ef9f170c-0804-4fdc-941c-3d8d0c6d0fd3 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:12.686262 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a6e3adc5-5a09-4c24-ad1c-064e49e9af1c req-ef9f170c-0804-4fdc-941c-3d8d0c6d0fd3 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:12.704944 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-970c3533-633b-4d9e-9c45-fe53c4718e23 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:08:12.707092 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-970c3533-633b-4d9e-9c45-fe53c4718e23 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='810ee9d5-e329-42de-8250-c7bd64f7e552',volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:08:12.739298 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-a6e3adc5-5a09-4c24-ad1c-064e49e9af1c req-ef9f170c-0804-4fdc-941c-3d8d0c6d0fd3 service nova] Creating event network-vif-deleted:52161141-fa34-4693-8439-7b898106f928 for instance f274cbdb-53e5-4634-b1c8-1913500fef38 on n-h1-862686-1 Oct 26 13:08:12.760603 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-a6e3adc5-5a09-4c24-ad1c-064e49e9af1c req-ef9f170c-0804-4fdc-941c-3d8d0c6d0fd3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143476 Oct 26 13:08:12.775006 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 763/1606] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:08:12.784425 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-58a63a25-fa5f-41e7-b499-ee3c8a1ad214 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:12.794924 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-58a63a25-fa5f-41e7-b499-ee3c8a1ad214 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:12.826416 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-58a63a25-fa5f-41e7-b499-ee3c8a1ad214 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:12.827200 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-58a63a25-fa5f-41e7-b499-ee3c8a1ad214 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:12.829678 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-58a63a25-fa5f-41e7-b499-ee3c8a1ad214 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:12.831213 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-58a63a25-fa5f-41e7-b499-ee3c8a1ad214 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:12.831789 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-58a63a25-fa5f-41e7-b499-ee3c8a1ad214 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:12.832457 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-58a63a25-fa5f-41e7-b499-ee3c8a1ad214 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:13.035306 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-970c3533-633b-4d9e-9c45-fe53c4718e23 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.270161 Oct 26 13:08:13.037430 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 844/1607] 10.222.0.40 () {62 vars in 1188 bytes} [Wed Oct 26 13:08:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2273 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 26 13:08:13.044663 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-58a63a25-fa5f-41e7-b499-ee3c8a1ad214 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:13.049693 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-eb8ff020-064f-4f5c-9124-db768eca2998 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:13.052748 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-eb8ff020-064f-4f5c-9124-db768eca2998 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] [instance: 523459ad-2398-43e2-b03b-3dc16c7214cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:13.054621 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:08:13.059115 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-58a63a25-fa5f-41e7-b499-ee3c8a1ad214 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 200 len: 1426 microversion: 2.1 time: 0.282372 Oct 26 13:08:13.075612 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 764/1608] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:12 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 1426 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:13.078417 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb8ff020-064f-4f5c-9124-db768eca2998 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:13.087624 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8296e0fe-7ecf-4c49-940a-c29f56bff94b tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:13.088541 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8296e0fe-7ecf-4c49-940a-c29f56bff94b tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 1c5d8fc5-5c9f-4bdf-81ed-388df5d390de] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:13.098736 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8296e0fe-7ecf-4c49-940a-c29f56bff94b tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:13.099881 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb8ff020-064f-4f5c-9124-db768eca2998 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:13.100294 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8296e0fe-7ecf-4c49-940a-c29f56bff94b tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:13.100904 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8296e0fe-7ecf-4c49-940a-c29f56bff94b tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:13.102162 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8296e0fe-7ecf-4c49-940a-c29f56bff94b tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:13.102884 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb8ff020-064f-4f5c-9124-db768eca2998 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:13.103499 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8296e0fe-7ecf-4c49-940a-c29f56bff94b tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:13.104288 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8296e0fe-7ecf-4c49-940a-c29f56bff94b tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:13.106967 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb8ff020-064f-4f5c-9124-db768eca2998 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:13.107716 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb8ff020-064f-4f5c-9124-db768eca2998 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:13.109651 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb8ff020-064f-4f5c-9124-db768eca2998 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:13.417887 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-eb8ff020-064f-4f5c-9124-db768eca2998 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7849545fe2042618da2cd47f4a2b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075b65181daf492da145b2e815809d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:13.442414 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-eb8ff020-064f-4f5c-9124-db768eca2998 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] 10.222.0.40 "GET /compute/v2.1/servers/523459ad-2398-43e2-b03b-3dc16c7214cb" status: 200 len: 1334 microversion: 2.1 time: 0.393478 Oct 26 13:08:13.465389 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 845/1609] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:13 2022] GET /compute/v2.1/servers/523459ad-2398-43e2-b03b-3dc16c7214cb => generated 1334 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:13.478412 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4e438fa3-1bd3-4610-b620-6d8601be829f tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-2046455883", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:08:13.666532 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-4e438fa3-1bd3-4610-b620-6d8601be829f tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] validate_networks() for [('66fd6a5a-18fd-4c1d-b944-f1a3daf53a13', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:08:13.793153 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8296e0fe-7ecf-4c49-940a-c29f56bff94b tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:13.810242 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8296e0fe-7ecf-4c49-940a-c29f56bff94b tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/1c5d8fc5-5c9f-4bdf-81ed-388df5d390de" status: 200 len: 1426 microversion: 2.1 time: 0.733144 Oct 26 13:08:13.813625 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 765/1610] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:13 2022] GET /compute/v2.1/servers/1c5d8fc5-5c9f-4bdf-81ed-388df5d390de => generated 1426 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:13.833837 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-396fd6ae-4120-44a6-970b-290a845d1170 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:13.834988 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-396fd6ae-4120-44a6-970b-290a845d1170 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:14.030155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-396fd6ae-4120-44a6-970b-290a845d1170 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:14.042782 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-396fd6ae-4120-44a6-970b-290a845d1170 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:14.046552 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-396fd6ae-4120-44a6-970b-290a845d1170 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:14.048531 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-396fd6ae-4120-44a6-970b-290a845d1170 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 200 len: 1104 microversion: 2.25 time: 0.233623 Oct 26 13:08:14.051747 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 766/1611] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:08:13 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 1104 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:08:14.062054 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e132045b-48cf-4a05-b670-93391c72fbe0 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:14.064393 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e132045b-48cf-4a05-b670-93391c72fbe0 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] [instance: cdca1d32-5d8f-44da-9c3b-c8d11433df06] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:14.081171 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e132045b-48cf-4a05-b670-93391c72fbe0 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:14.085153 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e132045b-48cf-4a05-b670-93391c72fbe0 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:14.086061 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e132045b-48cf-4a05-b670-93391c72fbe0 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:14.088872 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e132045b-48cf-4a05-b670-93391c72fbe0 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:14.089628 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e132045b-48cf-4a05-b670-93391c72fbe0 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:14.092365 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e132045b-48cf-4a05-b670-93391c72fbe0 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:14.843513 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e132045b-48cf-4a05-b670-93391c72fbe0 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec3945207e6a490fb1baa5eaefcfeaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86e36a2f7fc44daac11d122c492ba68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:14.872976 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e132045b-48cf-4a05-b670-93391c72fbe0 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] 10.222.0.40 "GET /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06" status: 200 len: 1331 microversion: 2.1 time: 0.818349 Oct 26 13:08:14.876498 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 767/1612] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:14 2022] GET /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06 => generated 1331 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:14.889464 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3384dc8c-13ab-408c-966b-75a041ed71ac tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67322ada60>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:14.977388 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3384dc8c-13ab-408c-966b-75a041ed71ac tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/7d91cde1-e33e-4251-b5c9-7baac06f15a0" status: 200 len: 1412 microversion: 2.1 time: 0.098605 Oct 26 13:08:14.977997 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 768/1613] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:08:14 2022] GET /compute/v2.1/images/7d91cde1-e33e-4251-b5c9-7baac06f15a0 => generated 1412 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:15.035478 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:08:15.104421 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-d4775bc6-c801-464c-a5e4-8773612c5e1d req-ed11659d-470a-4447-a2da-f9e575d68f76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d426a4f6-fa08-47d2-a583-735600b77f27", "name": "network-vif-plugged", "status": "completed", "tag": "8734e662-a14c-45ba-b2b3-6b2193b943a0"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:08:15.109877 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-4e438fa3-1bd3-4610-b620-6d8601be829f tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:08:15.111053 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-4e438fa3-1bd3-4610-b620-6d8601be829f tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:08:15.111740 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-4e438fa3-1bd3-4610-b620-6d8601be829f tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:08:15.112650 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-4e438fa3-1bd3-4610-b620-6d8601be829f tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:08:15.113441 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-4e438fa3-1bd3-4610-b620-6d8601be829f tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:08:15.126801 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e438fa3-1bd3-4610-b620-6d8601be829f tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:15.129816 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e438fa3-1bd3-4610-b620-6d8601be829f tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:15.130548 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e438fa3-1bd3-4610-b620-6d8601be829f tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:15.134328 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e438fa3-1bd3-4610-b620-6d8601be829f tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:15.135106 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e438fa3-1bd3-4610-b620-6d8601be829f tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:15.137295 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e438fa3-1bd3-4610-b620-6d8601be829f tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:15.138685 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d4775bc6-c801-464c-a5e4-8773612c5e1d req-ed11659d-470a-4447-a2da-f9e575d68f76 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:15.139872 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d4775bc6-c801-464c-a5e4-8773612c5e1d req-ed11659d-470a-4447-a2da-f9e575d68f76 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:15.143304 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d4775bc6-c801-464c-a5e4-8773612c5e1d req-ed11659d-470a-4447-a2da-f9e575d68f76 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:15.175892 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-d4775bc6-c801-464c-a5e4-8773612c5e1d req-ed11659d-470a-4447-a2da-f9e575d68f76 service nova] Creating event network-vif-plugged:8734e662-a14c-45ba-b2b3-6b2193b943a0 for instance d426a4f6-fa08-47d2-a583-735600b77f27 on n-h2-862686-1 Oct 26 13:08:15.208739 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-d4775bc6-c801-464c-a5e4-8773612c5e1d req-ed11659d-470a-4447-a2da-f9e575d68f76 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.229214 Oct 26 13:08:15.218125 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 769/1614] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:08:15.222021 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-4e438fa3-1bd3-4610-b620-6d8601be829f tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Getting quotas for project 186ac42922a64992aa1973bd854830d7. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:08:15.241001 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-4e438fa3-1bd3-4610-b620-6d8601be829f tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Getting quotas for user 0b8d4ea396494628983bde1a97222f7d and project 186ac42922a64992aa1973bd854830d7. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:08:15.283796 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4e438fa3-1bd3-4610-b620-6d8601be829f tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:08:15.297823 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4e438fa3-1bd3-4610-b620-6d8601be829f tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 8d92c502-ca44-4fb9-b1ac-6dd4dff929ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:08:15.350554 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-54edc044-a3df-47bc-be6d-5fc57cfcbb9d req-80f87796-d1a8-41c6-b1b6-f715663cb0c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70961c4d-e68b-4b33-a2ad-1fd612e14a73", "name": "network-vif-deleted", "tag": "6310dd0d-823a-4f3c-b6f0-fde873d3af7c"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:08:15.398929 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-54edc044-a3df-47bc-be6d-5fc57cfcbb9d req-80f87796-d1a8-41c6-b1b6-f715663cb0c5 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:15.399574 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-54edc044-a3df-47bc-be6d-5fc57cfcbb9d req-80f87796-d1a8-41c6-b1b6-f715663cb0c5 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:15.400011 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-54edc044-a3df-47bc-be6d-5fc57cfcbb9d req-80f87796-d1a8-41c6-b1b6-f715663cb0c5 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:15.448341 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-54edc044-a3df-47bc-be6d-5fc57cfcbb9d req-80f87796-d1a8-41c6-b1b6-f715663cb0c5 service nova] Creating event network-vif-deleted:6310dd0d-823a-4f3c-b6f0-fde873d3af7c for instance 70961c4d-e68b-4b33-a2ad-1fd612e14a73 on n-h2-862686-1 Oct 26 13:08:15.456216 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-54edc044-a3df-47bc-be6d-5fc57cfcbb9d req-80f87796-d1a8-41c6-b1b6-f715663cb0c5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.234800 Oct 26 13:08:15.457160 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 770/1615] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:08:15.480738 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-88a222b3-ec73-4f88-b38b-070dc0888184 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:15.481443 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-88a222b3-ec73-4f88-b38b-070dc0888184 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 70961c4d-e68b-4b33-a2ad-1fd612e14a73] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:15.526723 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4e438fa3-1bd3-4610-b620-6d8601be829f tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.060013 Oct 26 13:08:15.535927 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 846/1616] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:08:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 2070 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:08:15.539650 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88a222b3-ec73-4f88-b38b-070dc0888184 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:15.540260 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88a222b3-ec73-4f88-b38b-070dc0888184 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:15.543720 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88a222b3-ec73-4f88-b38b-070dc0888184 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:15.547905 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88a222b3-ec73-4f88-b38b-070dc0888184 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:15.548635 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88a222b3-ec73-4f88-b38b-070dc0888184 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:15.549086 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88a222b3-ec73-4f88-b38b-070dc0888184 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:15.570596 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3ab82c9a-0f10-449d-952c-ceb8e872fd05 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:15.588190 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3ab82c9a-0f10-449d-952c-ceb8e872fd05 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] [instance: 523459ad-2398-43e2-b03b-3dc16c7214cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:15.597473 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-88a222b3-ec73-4f88-b38b-070dc0888184 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] HTTP exception thrown: Instance 70961c4d-e68b-4b33-a2ad-1fd612e14a73 could not be found. Oct 26 13:08:15.600230 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-88a222b3-ec73-4f88-b38b-070dc0888184 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Request method failure captured: Oct 26 13:08:15.600230 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 HTTP/1.1 Oct 26 13:08:15.600230 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:08:15.600230 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:08:15.600230 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:08:15.600230 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:08:15.600230 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:08:15.600230 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:08:15.600230 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:08:15.600230 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:08:15.600230 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWS_3Fw97GVdJXzrizCJxBUgu9J8RJco_kVLmGoVom2EfSBf64V5ikwkoboRMlNwzTzrwppwQPetCMyQDytCjux0xldDodqy3aeyjdjftC1XoGeXvxoPPAFfp6LAn20VCMFMSmFkTZbBojQkiY4AnTk9HKUW_4_BuHyJOhDfsBXlX388 Oct 26 13:08:15.600230 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:08:15.600230 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:08:15.600230 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:08:15.600230 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:08:15.600230 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:08:15.600230 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:08:15.600230 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 443f71d3ffde486b9072df264fea2f53 Oct 26 13:08:15.600230 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-MigrationsAdminTest-2041762941 Oct 26 13:08:15.600230 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:08:15.600230 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:08:15.601640 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/443f71d3ffde486b9072df264fea2f53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/443f71d3ffde486b9072df264fea2f53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_443f71d3ffde486b9072df264fea2f53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/443f71d3ffde486b9072df264fea2f53"}]}] Oct 26 13:08:15.601640 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-MigrationsAdminTest-2041762941 Oct 26 13:08:15.601640 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 443f71d3ffde486b9072df264fea2f53 Oct 26 13:08:15.601640 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-MigrationsAdminTest-2041762941 Oct 26 13:08:15.601640 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-MigrationsAdminTest-2041762941-project Oct 26 13:08:15.601640 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:08:15.601640 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:08:15.601640 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 03335593029b48dfb19fc9cdf6b382b0 Oct 26 13:08:15.601640 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-MigrationsAdminTest-2041762941-project Oct 26 13:08:15.601640 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:08:15.601640 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 70961c4d-e68b-4b33-a2ad-1fd612e14a73 could not be found. Oct 26 13:08:15.601640 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '70961c4d-e68b-4b33-a2ad-1fd612e14a73'} Oct 26 13:08:15.602430 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:08:15.602430 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:15.602430 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:08:15.602430 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:08:15.602430 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:08:15.602430 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:08:15.602430 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:08:15.602430 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:08:15.602430 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:08:15.602430 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:08:15.602430 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70961c4d-e68b-4b33-a2ad-1fd612e14a73 could not be found. Oct 26 13:08:15.602430 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:15.602430 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:15.602430 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:15.602430 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:15.602430 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:08:15.602430 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:08:15.602430 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:08:15.602430 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:08:15.602430 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:08:15.603685 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:08:15.603685 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:08:15.603685 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:08:15.603685 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:08:15.603685 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:08:15.603685 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:08:15.603685 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:08:15.603685 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70961c4d-e68b-4b33-a2ad-1fd612e14a73 could not be found. Oct 26 13:08:15.603685 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:15.603685 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:15.603685 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:15.603685 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:15.603685 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:08:15.603685 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:08:15.603685 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:08:15.603685 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:08:15.603685 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70961c4d-e68b-4b33-a2ad-1fd612e14a73 could not be found. Oct 26 13:08:15.603685 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:15.609356 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-88a222b3-ec73-4f88-b38b-070dc0888184 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Returning 404 to user: Instance 70961c4d-e68b-4b33-a2ad-1fd612e14a73 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:08:15.610951 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-88a222b3-ec73-4f88-b38b-070dc0888184 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73" status: 404 len: 111 microversion: 2.1 time: 0.152496 Oct 26 13:08:15.615572 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 771/1617] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:15 2022] GET /compute/v2.1/servers/70961c4d-e68b-4b33-a2ad-1fd612e14a73 => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:08:15.621918 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-440cb390-008a-40dc-adc0-f87c3c507ac7 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:15.622879 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-440cb390-008a-40dc-adc0-f87c3c507ac7 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 1c5d8fc5-5c9f-4bdf-81ed-388df5d390de] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:15.623259 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3ab82c9a-0f10-449d-952c-ceb8e872fd05 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:15.623785 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3ab82c9a-0f10-449d-952c-ceb8e872fd05 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:15.624241 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3ab82c9a-0f10-449d-952c-ceb8e872fd05 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:15.629195 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3ab82c9a-0f10-449d-952c-ceb8e872fd05 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:15.631540 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3ab82c9a-0f10-449d-952c-ceb8e872fd05 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:15.633234 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3ab82c9a-0f10-449d-952c-ceb8e872fd05 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:15.634350 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-440cb390-008a-40dc-adc0-f87c3c507ac7 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:15.635299 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-440cb390-008a-40dc-adc0-f87c3c507ac7 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:15.636339 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-440cb390-008a-40dc-adc0-f87c3c507ac7 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:15.638028 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-440cb390-008a-40dc-adc0-f87c3c507ac7 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:15.639567 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-440cb390-008a-40dc-adc0-f87c3c507ac7 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:15.642481 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-440cb390-008a-40dc-adc0-f87c3c507ac7 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:15.664574 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-440cb390-008a-40dc-adc0-f87c3c507ac7 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] HTTP exception thrown: Instance 1c5d8fc5-5c9f-4bdf-81ed-388df5d390de could not be found. Oct 26 13:08:15.672510 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-440cb390-008a-40dc-adc0-f87c3c507ac7 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Request method failure captured: Oct 26 13:08:15.672510 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/1c5d8fc5-5c9f-4bdf-81ed-388df5d390de HTTP/1.1 Oct 26 13:08:15.672510 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:08:15.672510 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:08:15.672510 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:08:15.672510 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:08:15.672510 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:08:15.672510 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:08:15.672510 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:08:15.672510 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:08:15.672510 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTCi7-4ZJs-l3nyp7w3yWqj5xyBsFDp7ThFrSK2u004qA51FnO6UwBoBJnzDHnk4FNtYFd25TcBD3Pcko3EMO8wceOHAC6_Qkb2QLB9Fq_CC6QhjLHIiNtJmw_5kv4z1i-RC7jIpndCE0i2m-M3AXbb2FJh8hxcDElyLHaM3j-vW_Es Oct 26 13:08:15.672510 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:08:15.672510 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:08:15.672510 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:08:15.672510 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:08:15.672510 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:08:15.672510 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:08:15.672510 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 2f5434aa488d4d5a8bae96746cfd7494 Oct 26 13:08:15.672510 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersAdminTestJSON-295038141 Oct 26 13:08:15.672510 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:08:15.672510 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:08:15.674936 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2f5434aa488d4d5a8bae96746cfd7494"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2f5434aa488d4d5a8bae96746cfd7494"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2f5434aa488d4d5a8bae96746cfd7494"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2f5434aa488d4d5a8bae96746cfd7494"}]}] Oct 26 13:08:15.674936 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersAdminTestJSON-295038141 Oct 26 13:08:15.674936 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 2f5434aa488d4d5a8bae96746cfd7494 Oct 26 13:08:15.674936 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersAdminTestJSON-295038141 Oct 26 13:08:15.674936 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersAdminTestJSON-295038141-project Oct 26 13:08:15.674936 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:08:15.674936 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:08:15.674936 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: de8d47754d3f4d2c844dea032bdb0095 Oct 26 13:08:15.674936 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersAdminTestJSON-295038141-project Oct 26 13:08:15.674936 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:08:15.674936 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 1c5d8fc5-5c9f-4bdf-81ed-388df5d390de could not be found. Oct 26 13:08:15.674936 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '1c5d8fc5-5c9f-4bdf-81ed-388df5d390de'} Oct 26 13:08:15.676041 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:08:15.676041 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:15.676041 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:08:15.676041 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:08:15.676041 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:08:15.676041 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:08:15.676041 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:08:15.676041 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:08:15.676041 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:08:15.676041 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:08:15.676041 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c5d8fc5-5c9f-4bdf-81ed-388df5d390de could not be found. Oct 26 13:08:15.676041 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:15.676041 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:15.676041 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:15.676041 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:15.676041 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:08:15.676041 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:08:15.676041 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:08:15.676041 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:08:15.676041 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:08:15.679947 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:08:15.679947 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:08:15.679947 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:08:15.679947 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:08:15.679947 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:08:15.679947 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:08:15.679947 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:08:15.679947 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c5d8fc5-5c9f-4bdf-81ed-388df5d390de could not be found. Oct 26 13:08:15.679947 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:15.679947 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:15.679947 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:15.679947 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:15.679947 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:08:15.679947 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:08:15.679947 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:08:15.679947 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:08:15.679947 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c5d8fc5-5c9f-4bdf-81ed-388df5d390de could not be found. Oct 26 13:08:15.679947 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:15.682382 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-440cb390-008a-40dc-adc0-f87c3c507ac7 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Returning 404 to user: Instance 1c5d8fc5-5c9f-4bdf-81ed-388df5d390de could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:08:15.683789 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-440cb390-008a-40dc-adc0-f87c3c507ac7 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/1c5d8fc5-5c9f-4bdf-81ed-388df5d390de" status: 404 len: 111 microversion: 2.1 time: 0.066684 Oct 26 13:08:15.684513 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 772/1618] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:15 2022] GET /compute/v2.1/servers/1c5d8fc5-5c9f-4bdf-81ed-388df5d390de => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:08:15.690154 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-b9b74c4c-d1c3-4d47-80b4-24cb2fd5616a req-46eb6950-732f-474d-8846-7b0b7bda98d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c5d8fc5-5c9f-4bdf-81ed-388df5d390de", "name": "network-vif-deleted", "tag": "0d36d4e3-ddc6-4dfc-bf9d-2290d107fddf"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:08:15.701915 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-b9b74c4c-d1c3-4d47-80b4-24cb2fd5616a req-46eb6950-732f-474d-8846-7b0b7bda98d7 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:15.702863 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-b9b74c4c-d1c3-4d47-80b4-24cb2fd5616a req-46eb6950-732f-474d-8846-7b0b7bda98d7 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:15.703535 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-b9b74c4c-d1c3-4d47-80b4-24cb2fd5616a req-46eb6950-732f-474d-8846-7b0b7bda98d7 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:15.723280 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-b9b74c4c-d1c3-4d47-80b4-24cb2fd5616a req-46eb6950-732f-474d-8846-7b0b7bda98d7 service nova] Creating event network-vif-deleted:0d36d4e3-ddc6-4dfc-bf9d-2290d107fddf for instance 1c5d8fc5-5c9f-4bdf-81ed-388df5d390de on n-h2-862686-1 Oct 26 13:08:15.730217 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-b9b74c4c-d1c3-4d47-80b4-24cb2fd5616a req-46eb6950-732f-474d-8846-7b0b7bda98d7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044188 Oct 26 13:08:15.731630 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 773/1619] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:08:15.737785 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-166df8ce-f568-4a5c-a806-21efc950f682 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:15.740822 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-166df8ce-f568-4a5c-a806-21efc950f682 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:15.764099 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-166df8ce-f568-4a5c-a806-21efc950f682 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:15.767604 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-166df8ce-f568-4a5c-a806-21efc950f682 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:15.769838 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-166df8ce-f568-4a5c-a806-21efc950f682 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:15.772773 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-166df8ce-f568-4a5c-a806-21efc950f682 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:15.774517 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-166df8ce-f568-4a5c-a806-21efc950f682 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:15.775280 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-166df8ce-f568-4a5c-a806-21efc950f682 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:16.091647 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-166df8ce-f568-4a5c-a806-21efc950f682 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:16.119766 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-166df8ce-f568-4a5c-a806-21efc950f682 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:16.125254 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-166df8ce-f568-4a5c-a806-21efc950f682 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:16.136848 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-166df8ce-f568-4a5c-a806-21efc950f682 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 200 len: 1241 microversion: 2.25 time: 0.393586 Oct 26 13:08:16.137545 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 774/1620] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:08:15 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 1241 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:08:16.155867 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-99c03efe-1052-4803-8d68-53c3bc8245a8 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:16.156537 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-99c03efe-1052-4803-8d68-53c3bc8245a8 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 8d92c502-ca44-4fb9-b1ac-6dd4dff929ab] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:16.451177 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-99c03efe-1052-4803-8d68-53c3bc8245a8 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:16.466097 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-99c03efe-1052-4803-8d68-53c3bc8245a8 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/8d92c502-ca44-4fb9-b1ac-6dd4dff929ab" status: 200 len: 1225 microversion: 2.1 time: 0.319380 Oct 26 13:08:16.481751 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 775/1621] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:16 2022] GET /compute/v2.1/servers/8d92c502-ca44-4fb9-b1ac-6dd4dff929ab => generated 1225 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:16.488586 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-feabf1e8-1c2b-4669-bc1b-19aaf396c3b0 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:16.488586 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-feabf1e8-1c2b-4669-bc1b-19aaf396c3b0 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:16.523954 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-feabf1e8-1c2b-4669-bc1b-19aaf396c3b0 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:16.526205 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-feabf1e8-1c2b-4669-bc1b-19aaf396c3b0 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:16.540406 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-feabf1e8-1c2b-4669-bc1b-19aaf396c3b0 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:16.541747 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-feabf1e8-1c2b-4669-bc1b-19aaf396c3b0 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:16.544748 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-feabf1e8-1c2b-4669-bc1b-19aaf396c3b0 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:16.546060 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-feabf1e8-1c2b-4669-bc1b-19aaf396c3b0 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:16.548853 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3ab82c9a-0f10-449d-952c-ceb8e872fd05 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7849545fe2042618da2cd47f4a2b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075b65181daf492da145b2e815809d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:16.563550 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3ab82c9a-0f10-449d-952c-ceb8e872fd05 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] 10.222.0.40 "GET /compute/v2.1/servers/523459ad-2398-43e2-b03b-3dc16c7214cb" status: 200 len: 1402 microversion: 2.1 time: 1.022357 Oct 26 13:08:16.564683 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 847/1622] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:15 2022] GET /compute/v2.1/servers/523459ad-2398-43e2-b03b-3dc16c7214cb => generated 1402 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:16.585419 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d9091b77-1c10-49c3-8449-022a77aeeab7 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:16.586745 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d9091b77-1c10-49c3-8449-022a77aeeab7 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: be43f1c5-7509-4755-9db7-c41e7b83464f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:16.618815 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9091b77-1c10-49c3-8449-022a77aeeab7 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:16.619607 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9091b77-1c10-49c3-8449-022a77aeeab7 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:16.620208 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9091b77-1c10-49c3-8449-022a77aeeab7 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:16.621112 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9091b77-1c10-49c3-8449-022a77aeeab7 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:16.622642 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9091b77-1c10-49c3-8449-022a77aeeab7 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:16.623308 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9091b77-1c10-49c3-8449-022a77aeeab7 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:16.672206 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-feabf1e8-1c2b-4669-bc1b-19aaf396c3b0 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:08:16.728284 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d9091b77-1c10-49c3-8449-022a77aeeab7 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: be43f1c5-7509-4755-9db7-c41e7b83464f] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:08:16.957186 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-feabf1e8-1c2b-4669-bc1b-19aaf396c3b0 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 204 len: 0 microversion: 2.1 time: 0.487960 Oct 26 13:08:16.963683 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 776/1623] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:08:16 2022] DELETE /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:08:16.976504 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d9091b77-1c10-49c3-8449-022a77aeeab7 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "DELETE /compute/v2.1/servers/be43f1c5-7509-4755-9db7-c41e7b83464f" status: 204 len: 0 microversion: 2.1 time: 0.408509 Oct 26 13:08:16.986080 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 848/1624] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:08:16 2022] DELETE /compute/v2.1/servers/be43f1c5-7509-4755-9db7-c41e7b83464f => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:08:16.990068 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f872a4c1-c140-4d92-9a61-ac784880e43d tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:16.997285 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f872a4c1-c140-4d92-9a61-ac784880e43d tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] [instance: cdca1d32-5d8f-44da-9c3b-c8d11433df06] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:17.020347 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ef2ec409-89af-44fb-9809-58a715726fc5 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f6731f65b80>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:17.027658 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f872a4c1-c140-4d92-9a61-ac784880e43d tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:17.031371 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f872a4c1-c140-4d92-9a61-ac784880e43d tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:17.036903 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f872a4c1-c140-4d92-9a61-ac784880e43d tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:17.037763 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f872a4c1-c140-4d92-9a61-ac784880e43d tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:17.041122 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f872a4c1-c140-4d92-9a61-ac784880e43d tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:17.042932 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f872a4c1-c140-4d92-9a61-ac784880e43d tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:17.138224 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ef2ec409-89af-44fb-9809-58a715726fc5 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/7d91cde1-e33e-4251-b5c9-7baac06f15a0" status: 200 len: 1412 microversion: 2.1 time: 0.140346 Oct 26 13:08:17.140631 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 849/1625] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:08:16 2022] GET /compute/v2.1/images/7d91cde1-e33e-4251-b5c9-7baac06f15a0 => generated 1412 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:17.153430 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c95e173e-d259-48d2-9f0d-0ffd90cb7b2f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:17.154241 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c95e173e-d259-48d2-9f0d-0ffd90cb7b2f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:17.173215 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c95e173e-d259-48d2-9f0d-0ffd90cb7b2f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:17.175688 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c95e173e-d259-48d2-9f0d-0ffd90cb7b2f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:17.177345 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c95e173e-d259-48d2-9f0d-0ffd90cb7b2f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:17.181033 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c95e173e-d259-48d2-9f0d-0ffd90cb7b2f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:17.182625 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c95e173e-d259-48d2-9f0d-0ffd90cb7b2f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:17.183954 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c95e173e-d259-48d2-9f0d-0ffd90cb7b2f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:17.822267 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c95e173e-d259-48d2-9f0d-0ffd90cb7b2f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:17.832470 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c95e173e-d259-48d2-9f0d-0ffd90cb7b2f tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 200 len: 1535 microversion: 2.1 time: 0.690688 Oct 26 13:08:17.842510 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 850/1626] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:17 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 1535 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:17.857510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fa90ed91-ad85-41de-a170-b0842804de1f tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:17.858325 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fa90ed91-ad85-41de-a170-b0842804de1f tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: be43f1c5-7509-4755-9db7-c41e7b83464f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:17.869064 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f872a4c1-c140-4d92-9a61-ac784880e43d tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec3945207e6a490fb1baa5eaefcfeaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86e36a2f7fc44daac11d122c492ba68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:17.873205 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa90ed91-ad85-41de-a170-b0842804de1f tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:17.874187 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa90ed91-ad85-41de-a170-b0842804de1f tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:17.874732 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa90ed91-ad85-41de-a170-b0842804de1f tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:17.875554 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa90ed91-ad85-41de-a170-b0842804de1f tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:17.876125 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa90ed91-ad85-41de-a170-b0842804de1f tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:17.879087 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa90ed91-ad85-41de-a170-b0842804de1f tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:17.904925 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f872a4c1-c140-4d92-9a61-ac784880e43d tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] 10.222.0.40 "GET /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06" status: 200 len: 1331 microversion: 2.1 time: 0.941134 Oct 26 13:08:17.906414 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 777/1627] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:16 2022] GET /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06 => generated 1331 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:17.913596 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3e3a7393-fd6f-4669-b736-a8da55886bbc tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:17.914456 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3e3a7393-fd6f-4669-b736-a8da55886bbc tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:17.922175 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3e3a7393-fd6f-4669-b736-a8da55886bbc tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:17.923734 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3e3a7393-fd6f-4669-b736-a8da55886bbc tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:17.924409 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3e3a7393-fd6f-4669-b736-a8da55886bbc tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:17.925619 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3e3a7393-fd6f-4669-b736-a8da55886bbc tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:17.926254 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3e3a7393-fd6f-4669-b736-a8da55886bbc tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:17.926848 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3e3a7393-fd6f-4669-b736-a8da55886bbc tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:18.111979 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3e3a7393-fd6f-4669-b736-a8da55886bbc tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:18.127314 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3e3a7393-fd6f-4669-b736-a8da55886bbc tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:18.128960 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3e3a7393-fd6f-4669-b736-a8da55886bbc tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:18.133191 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3e3a7393-fd6f-4669-b736-a8da55886bbc tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 200 len: 1251 microversion: 2.25 time: 0.224085 Oct 26 13:08:18.134380 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 778/1628] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:08:17 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 1251 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:08:18.153524 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b9348fc0-92ec-4a16-817d-b72120c4eed9 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:18.154491 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b9348fc0-92ec-4a16-817d-b72120c4eed9 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 8d92c502-ca44-4fb9-b1ac-6dd4dff929ab] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:18.163249 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b9348fc0-92ec-4a16-817d-b72120c4eed9 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:18.166806 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b9348fc0-92ec-4a16-817d-b72120c4eed9 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:18.167440 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b9348fc0-92ec-4a16-817d-b72120c4eed9 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:18.168367 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b9348fc0-92ec-4a16-817d-b72120c4eed9 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:18.175269 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b9348fc0-92ec-4a16-817d-b72120c4eed9 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:18.175935 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b9348fc0-92ec-4a16-817d-b72120c4eed9 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:18.234734 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fa90ed91-ad85-41de-a170-b0842804de1f tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:18.244573 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fa90ed91-ad85-41de-a170-b0842804de1f tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/be43f1c5-7509-4755-9db7-c41e7b83464f" status: 200 len: 1469 microversion: 2.1 time: 0.400824 Oct 26 13:08:18.245156 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 851/1629] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:17 2022] GET /compute/v2.1/servers/be43f1c5-7509-4755-9db7-c41e7b83464f => generated 1469 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:18.283505 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e87b97af-c47d-4cad-805b-74a2cb86c347 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:18.284142 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e87b97af-c47d-4cad-805b-74a2cb86c347 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] [instance: 523459ad-2398-43e2-b03b-3dc16c7214cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:18.307569 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e87b97af-c47d-4cad-805b-74a2cb86c347 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:18.309066 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e87b97af-c47d-4cad-805b-74a2cb86c347 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:18.310425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e87b97af-c47d-4cad-805b-74a2cb86c347 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:18.311748 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e87b97af-c47d-4cad-805b-74a2cb86c347 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:18.312363 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e87b97af-c47d-4cad-805b-74a2cb86c347 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:18.312963 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e87b97af-c47d-4cad-805b-74a2cb86c347 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:18.497629 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b9348fc0-92ec-4a16-817d-b72120c4eed9 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:18.510264 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b9348fc0-92ec-4a16-817d-b72120c4eed9 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/8d92c502-ca44-4fb9-b1ac-6dd4dff929ab" status: 200 len: 1277 microversion: 2.1 time: 0.374336 Oct 26 13:08:18.529829 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 779/1630] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:18 2022] GET /compute/v2.1/servers/8d92c502-ca44-4fb9-b1ac-6dd4dff929ab => generated 1277 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:18.544956 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-e5436b23-bfbe-4862-8cae-c80e54cfcd70 req-58d9f352-7016-440f-a0e4-fcf759f31d78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdca1d32-5d8f-44da-9c3b-c8d11433df06", "tag": "7cca99b7-782b-4cb4-bf7d-e207183f2165"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:08:18.558609 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-e5436b23-bfbe-4862-8cae-c80e54cfcd70 req-58d9f352-7016-440f-a0e4-fcf759f31d78 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:18.559736 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-e5436b23-bfbe-4862-8cae-c80e54cfcd70 req-58d9f352-7016-440f-a0e4-fcf759f31d78 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:18.560335 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-e5436b23-bfbe-4862-8cae-c80e54cfcd70 req-58d9f352-7016-440f-a0e4-fcf759f31d78 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:18.575472 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-e5436b23-bfbe-4862-8cae-c80e54cfcd70 req-58d9f352-7016-440f-a0e4-fcf759f31d78 service nova] Creating event network-changed:7cca99b7-782b-4cb4-bf7d-e207183f2165 for instance cdca1d32-5d8f-44da-9c3b-c8d11433df06 on n-h1-862686-1 Oct 26 13:08:18.581990 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-e5436b23-bfbe-4862-8cae-c80e54cfcd70 req-58d9f352-7016-440f-a0e4-fcf759f31d78 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049415 Oct 26 13:08:18.583214 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 780/1631] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:08:18.592517 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fb140a6b-a80e-4bb9-906d-1de5860a7018 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f673229a5e0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:18.679211 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fb140a6b-a80e-4bb9-906d-1de5860a7018 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/7d91cde1-e33e-4251-b5c9-7baac06f15a0" status: 200 len: 1412 microversion: 2.1 time: 0.093791 Oct 26 13:08:18.679841 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 781/1632] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:08:18 2022] GET /compute/v2.1/images/7d91cde1-e33e-4251-b5c9-7baac06f15a0 => generated 1412 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:18.868027 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-479e25f4-a300-44f3-ad9b-760c7da1c5eb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:18.868869 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-479e25f4-a300-44f3-ad9b-760c7da1c5eb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:18.886013 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-479e25f4-a300-44f3-ad9b-760c7da1c5eb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:18.886865 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-479e25f4-a300-44f3-ad9b-760c7da1c5eb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:18.887096 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-479e25f4-a300-44f3-ad9b-760c7da1c5eb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:18.887940 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-479e25f4-a300-44f3-ad9b-760c7da1c5eb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:18.888396 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-479e25f4-a300-44f3-ad9b-760c7da1c5eb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:18.889452 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-479e25f4-a300-44f3-ad9b-760c7da1c5eb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:19.338470 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-479e25f4-a300-44f3-ad9b-760c7da1c5eb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:19.350028 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-479e25f4-a300-44f3-ad9b-760c7da1c5eb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 200 len: 1535 microversion: 2.1 time: 0.483554 Oct 26 13:08:19.350687 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 782/1633] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:18 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 1535 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:19.356790 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8fb53ba8-e3d6-42a9-bef8-6e32dba06afa tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:19.357408 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8fb53ba8-e3d6-42a9-bef8-6e32dba06afa tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] [instance: cdca1d32-5d8f-44da-9c3b-c8d11433df06] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:19.380052 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8fb53ba8-e3d6-42a9-bef8-6e32dba06afa tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:19.383239 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8fb53ba8-e3d6-42a9-bef8-6e32dba06afa tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:19.384525 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8fb53ba8-e3d6-42a9-bef8-6e32dba06afa tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:19.386945 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8fb53ba8-e3d6-42a9-bef8-6e32dba06afa tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:19.387960 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8fb53ba8-e3d6-42a9-bef8-6e32dba06afa tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:19.389738 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8fb53ba8-e3d6-42a9-bef8-6e32dba06afa tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:19.678152 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e87b97af-c47d-4cad-805b-74a2cb86c347 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7849545fe2042618da2cd47f4a2b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075b65181daf492da145b2e815809d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:19.712095 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e87b97af-c47d-4cad-805b-74a2cb86c347 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] 10.222.0.40 "GET /compute/v2.1/servers/523459ad-2398-43e2-b03b-3dc16c7214cb" status: 200 len: 1402 microversion: 2.1 time: 1.442878 Oct 26 13:08:19.717625 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 852/1634] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:18 2022] GET /compute/v2.1/servers/523459ad-2398-43e2-b03b-3dc16c7214cb => generated 1402 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:19.723237 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3febacab-42e2-43dc-8f7a-d51767a323af tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:19.723845 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3febacab-42e2-43dc-8f7a-d51767a323af tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:19.743281 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3febacab-42e2-43dc-8f7a-d51767a323af tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:19.743771 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3febacab-42e2-43dc-8f7a-d51767a323af tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:19.744203 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3febacab-42e2-43dc-8f7a-d51767a323af tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:19.744904 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3febacab-42e2-43dc-8f7a-d51767a323af tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:19.745356 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3febacab-42e2-43dc-8f7a-d51767a323af tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:19.745815 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3febacab-42e2-43dc-8f7a-d51767a323af tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:20.062883 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8fb53ba8-e3d6-42a9-bef8-6e32dba06afa tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec3945207e6a490fb1baa5eaefcfeaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86e36a2f7fc44daac11d122c492ba68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:20.063465 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3febacab-42e2-43dc-8f7a-d51767a323af tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:20.083124 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8fb53ba8-e3d6-42a9-bef8-6e32dba06afa tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] 10.222.0.40 "GET /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06" status: 200 len: 1331 microversion: 2.1 time: 0.729088 Oct 26 13:08:20.085250 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 783/1635] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:19 2022] GET /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06 => generated 1331 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:20.095008 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-69c44831-e6ec-4fe5-9345-66e1de7cb382 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:20.098271 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-69c44831-e6ec-4fe5-9345-66e1de7cb382 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: be43f1c5-7509-4755-9db7-c41e7b83464f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:20.098910 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3febacab-42e2-43dc-8f7a-d51767a323af tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:20.100680 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3febacab-42e2-43dc-8f7a-d51767a323af tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:20.102554 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3febacab-42e2-43dc-8f7a-d51767a323af tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 200 len: 1251 microversion: 2.25 time: 0.383167 Oct 26 13:08:20.103132 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 853/1636] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:08:19 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 1251 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:08:20.126304 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-616630fe-e35d-46ee-ab1d-e2a4b3af2aaf tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:20.127554 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69c44831-e6ec-4fe5-9345-66e1de7cb382 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:20.127870 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-616630fe-e35d-46ee-ab1d-e2a4b3af2aaf tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 8d92c502-ca44-4fb9-b1ac-6dd4dff929ab] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:20.128351 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69c44831-e6ec-4fe5-9345-66e1de7cb382 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:20.128810 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69c44831-e6ec-4fe5-9345-66e1de7cb382 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:20.130128 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69c44831-e6ec-4fe5-9345-66e1de7cb382 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:20.131162 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69c44831-e6ec-4fe5-9345-66e1de7cb382 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:20.131713 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69c44831-e6ec-4fe5-9345-66e1de7cb382 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:20.137222 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-616630fe-e35d-46ee-ab1d-e2a4b3af2aaf tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:20.140393 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-616630fe-e35d-46ee-ab1d-e2a4b3af2aaf tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:20.149979 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-616630fe-e35d-46ee-ab1d-e2a4b3af2aaf tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:20.151051 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-616630fe-e35d-46ee-ab1d-e2a4b3af2aaf tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:20.152500 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-616630fe-e35d-46ee-ab1d-e2a4b3af2aaf tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:20.153125 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-616630fe-e35d-46ee-ab1d-e2a4b3af2aaf tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:20.270302 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-616630fe-e35d-46ee-ab1d-e2a4b3af2aaf tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:20.289750 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-616630fe-e35d-46ee-ab1d-e2a4b3af2aaf tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/8d92c502-ca44-4fb9-b1ac-6dd4dff929ab" status: 200 len: 1283 microversion: 2.1 time: 0.185189 Oct 26 13:08:20.293781 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 854/1637] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:20 2022] GET /compute/v2.1/servers/8d92c502-ca44-4fb9-b1ac-6dd4dff929ab => generated 1283 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:20.298898 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ef4e9fe4-17da-431a-9399-9b2142186a82 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f6731f30ee0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:20.353160 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ef4e9fe4-17da-431a-9399-9b2142186a82 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/7d91cde1-e33e-4251-b5c9-7baac06f15a0" status: 200 len: 1412 microversion: 2.1 time: 0.057975 Oct 26 13:08:20.354046 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 855/1638] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:08:20 2022] GET /compute/v2.1/images/7d91cde1-e33e-4251-b5c9-7baac06f15a0 => generated 1412 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:20.376040 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e7e53ff7-c4af-41f1-aebe-1b12ab2b85d7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:20.376964 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e7e53ff7-c4af-41f1-aebe-1b12ab2b85d7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:20.387766 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e7e53ff7-c4af-41f1-aebe-1b12ab2b85d7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:20.387766 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e7e53ff7-c4af-41f1-aebe-1b12ab2b85d7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:20.389748 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e7e53ff7-c4af-41f1-aebe-1b12ab2b85d7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:20.391535 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e7e53ff7-c4af-41f1-aebe-1b12ab2b85d7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:20.392660 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e7e53ff7-c4af-41f1-aebe-1b12ab2b85d7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:20.393316 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e7e53ff7-c4af-41f1-aebe-1b12ab2b85d7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:21.046992 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-69c44831-e6ec-4fe5-9345-66e1de7cb382 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:21.059283 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-69c44831-e6ec-4fe5-9345-66e1de7cb382 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/be43f1c5-7509-4755-9db7-c41e7b83464f" status: 200 len: 1469 microversion: 2.1 time: 0.972579 Oct 26 13:08:21.062038 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 784/1639] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:20 2022] GET /compute/v2.1/servers/be43f1c5-7509-4755-9db7-c41e7b83464f => generated 1469 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:21.073210 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9f99bd1a-7156-44b4-b059-93ce7d0f64e0 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:21.081354 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9f99bd1a-7156-44b4-b059-93ce7d0f64e0 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] [instance: 523459ad-2398-43e2-b03b-3dc16c7214cb] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:21.095269 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f99bd1a-7156-44b4-b059-93ce7d0f64e0 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:21.102234 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f99bd1a-7156-44b4-b059-93ce7d0f64e0 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:21.102782 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f99bd1a-7156-44b4-b059-93ce7d0f64e0 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:21.104627 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f99bd1a-7156-44b4-b059-93ce7d0f64e0 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:21.104627 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f99bd1a-7156-44b4-b059-93ce7d0f64e0 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:21.106994 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f99bd1a-7156-44b4-b059-93ce7d0f64e0 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:21.943659 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e7e53ff7-c4af-41f1-aebe-1b12ab2b85d7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:21.957881 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e7e53ff7-c4af-41f1-aebe-1b12ab2b85d7 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 200 len: 1535 microversion: 2.1 time: 1.583802 Oct 26 13:08:21.959957 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 856/1640] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:20 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 1535 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:08:21.973524 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-246e90fc-bd8b-483a-ab57-11d904d28fce tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:21.976559 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-246e90fc-bd8b-483a-ab57-11d904d28fce tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] [instance: cdca1d32-5d8f-44da-9c3b-c8d11433df06] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:21.992343 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-246e90fc-bd8b-483a-ab57-11d904d28fce tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:21.994844 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-246e90fc-bd8b-483a-ab57-11d904d28fce tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:21.996791 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-246e90fc-bd8b-483a-ab57-11d904d28fce tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:22.000080 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-246e90fc-bd8b-483a-ab57-11d904d28fce tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:22.004017 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-246e90fc-bd8b-483a-ab57-11d904d28fce tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:22.004961 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-246e90fc-bd8b-483a-ab57-11d904d28fce tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:22.626482 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-246e90fc-bd8b-483a-ab57-11d904d28fce tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec3945207e6a490fb1baa5eaefcfeaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86e36a2f7fc44daac11d122c492ba68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:22.638155 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-246e90fc-bd8b-483a-ab57-11d904d28fce tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] 10.222.0.40 "GET /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06" status: 200 len: 1331 microversion: 2.1 time: 0.675975 Oct 26 13:08:22.647791 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 857/1641] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:21 2022] GET /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06 => generated 1331 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:22.660404 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2e368e78-2bbe-484d-8a83-559f4171c3f0 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:22.667076 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2e368e78-2bbe-484d-8a83-559f4171c3f0 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:22.674257 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9f99bd1a-7156-44b4-b059-93ce7d0f64e0 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7849545fe2042618da2cd47f4a2b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075b65181daf492da145b2e815809d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:22.687772 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9f99bd1a-7156-44b4-b059-93ce7d0f64e0 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] 10.222.0.40 "GET /compute/v2.1/servers/523459ad-2398-43e2-b03b-3dc16c7214cb" status: 200 len: 1402 microversion: 2.1 time: 1.623285 Oct 26 13:08:22.688685 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 785/1642] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:21 2022] GET /compute/v2.1/servers/523459ad-2398-43e2-b03b-3dc16c7214cb => generated 1402 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:22.697639 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e368e78-2bbe-484d-8a83-559f4171c3f0 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:22.697639 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e368e78-2bbe-484d-8a83-559f4171c3f0 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:22.697639 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e368e78-2bbe-484d-8a83-559f4171c3f0 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:22.697639 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e368e78-2bbe-484d-8a83-559f4171c3f0 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:22.698090 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e368e78-2bbe-484d-8a83-559f4171c3f0 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:22.698090 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e368e78-2bbe-484d-8a83-559f4171c3f0 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:22.718845 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-a3a70dea-17b3-43ec-9bd3-c7733593a389 req-a8ad24ab-df9a-4a5f-acaf-0c76a7f44f68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "523459ad-2398-43e2-b03b-3dc16c7214cb", "tag": "ad3bf7f7-f2d9-4b92-a4fd-ba2b441e5413"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:08:22.752586 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a3a70dea-17b3-43ec-9bd3-c7733593a389 req-a8ad24ab-df9a-4a5f-acaf-0c76a7f44f68 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:22.754030 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a3a70dea-17b3-43ec-9bd3-c7733593a389 req-a8ad24ab-df9a-4a5f-acaf-0c76a7f44f68 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:22.756704 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a3a70dea-17b3-43ec-9bd3-c7733593a389 req-a8ad24ab-df9a-4a5f-acaf-0c76a7f44f68 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:22.795075 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-a3a70dea-17b3-43ec-9bd3-c7733593a389 req-a8ad24ab-df9a-4a5f-acaf-0c76a7f44f68 service nova] Creating event network-changed:ad3bf7f7-f2d9-4b92-a4fd-ba2b441e5413 for instance 523459ad-2398-43e2-b03b-3dc16c7214cb on n-h1-862686-1 Oct 26 13:08:22.813789 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-a3a70dea-17b3-43ec-9bd3-c7733593a389 req-a8ad24ab-df9a-4a5f-acaf-0c76a7f44f68 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113796 Oct 26 13:08:22.826185 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 786/1643] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:08:22.838488 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f6cfefa9-029c-4c1d-b9fe-795af45be7fd tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:22.839547 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f6cfefa9-029c-4c1d-b9fe-795af45be7fd tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 8d92c502-ca44-4fb9-b1ac-6dd4dff929ab] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:22.893766 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f6cfefa9-029c-4c1d-b9fe-795af45be7fd tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:22.894273 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f6cfefa9-029c-4c1d-b9fe-795af45be7fd tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:22.894703 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f6cfefa9-029c-4c1d-b9fe-795af45be7fd tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:22.895414 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f6cfefa9-029c-4c1d-b9fe-795af45be7fd tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:22.896423 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f6cfefa9-029c-4c1d-b9fe-795af45be7fd tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:22.896853 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f6cfefa9-029c-4c1d-b9fe-795af45be7fd tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:23.390943 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f6cfefa9-029c-4c1d-b9fe-795af45be7fd tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:23.412580 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f6cfefa9-029c-4c1d-b9fe-795af45be7fd tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/8d92c502-ca44-4fb9-b1ac-6dd4dff929ab" status: 200 len: 1325 microversion: 2.1 time: 0.581222 Oct 26 13:08:23.413324 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 787/1644] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:22 2022] GET /compute/v2.1/servers/8d92c502-ca44-4fb9-b1ac-6dd4dff929ab => generated 1325 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:23.435917 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-722ec6ad-9da2-4cd2-83ab-a7f1ff12a288 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67322e7dc0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:23.545757 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-722ec6ad-9da2-4cd2-83ab-a7f1ff12a288 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/7d91cde1-e33e-4251-b5c9-7baac06f15a0" status: 200 len: 1412 microversion: 2.1 time: 0.130407 Oct 26 13:08:23.547724 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 788/1645] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:08:23 2022] GET /compute/v2.1/images/7d91cde1-e33e-4251-b5c9-7baac06f15a0 => generated 1412 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:23.634561 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-580eed0d-cca0-4fa8-b51a-626aa8290b91 req-734f33a2-89aa-427a-b783-b2fe7af69548 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be43f1c5-7509-4755-9db7-c41e7b83464f", "name": "network-vif-deleted", "tag": "f433536e-b171-41cf-b186-2aea6a04c2eb"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:08:23.650543 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-580eed0d-cca0-4fa8-b51a-626aa8290b91 req-734f33a2-89aa-427a-b783-b2fe7af69548 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:23.651429 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-580eed0d-cca0-4fa8-b51a-626aa8290b91 req-734f33a2-89aa-427a-b783-b2fe7af69548 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:23.652339 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-580eed0d-cca0-4fa8-b51a-626aa8290b91 req-734f33a2-89aa-427a-b783-b2fe7af69548 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:23.666719 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2e368e78-2bbe-484d-8a83-559f4171c3f0 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:23.683349 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2e368e78-2bbe-484d-8a83-559f4171c3f0 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:23.687571 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-580eed0d-cca0-4fa8-b51a-626aa8290b91 req-734f33a2-89aa-427a-b783-b2fe7af69548 service nova] Creating event network-vif-deleted:f433536e-b171-41cf-b186-2aea6a04c2eb for instance be43f1c5-7509-4755-9db7-c41e7b83464f on n-h1-862686-1 Oct 26 13:08:23.689156 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2e368e78-2bbe-484d-8a83-559f4171c3f0 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:23.692026 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2e368e78-2bbe-484d-8a83-559f4171c3f0 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 200 len: 1293 microversion: 2.25 time: 1.042736 Oct 26 13:08:23.695054 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 858/1646] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:08:22 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 1293 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:08:23.699986 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-580eed0d-cca0-4fa8-b51a-626aa8290b91 req-734f33a2-89aa-427a-b783-b2fe7af69548 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150655 Oct 26 13:08:23.703807 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 789/1647] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:08:23.706209 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0ae3f313-1476-49f6-a1d1-b12233e40f08 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:23.711350 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0ae3f313-1476-49f6-a1d1-b12233e40f08 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: be43f1c5-7509-4755-9db7-c41e7b83464f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:23.717211 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d0db0832-a329-4223-a9bc-696ba219a8da tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:23.719420 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d0db0832-a329-4223-a9bc-696ba219a8da tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:23.729766 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ae3f313-1476-49f6-a1d1-b12233e40f08 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:23.730494 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ae3f313-1476-49f6-a1d1-b12233e40f08 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:23.731722 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ae3f313-1476-49f6-a1d1-b12233e40f08 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:23.734723 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ae3f313-1476-49f6-a1d1-b12233e40f08 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:23.735535 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ae3f313-1476-49f6-a1d1-b12233e40f08 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:23.736653 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ae3f313-1476-49f6-a1d1-b12233e40f08 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:23.736835 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d0db0832-a329-4223-a9bc-696ba219a8da tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:23.738712 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d0db0832-a329-4223-a9bc-696ba219a8da tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:23.739433 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d0db0832-a329-4223-a9bc-696ba219a8da tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:23.742202 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d0db0832-a329-4223-a9bc-696ba219a8da tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:23.742872 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d0db0832-a329-4223-a9bc-696ba219a8da tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:23.744763 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d0db0832-a329-4223-a9bc-696ba219a8da tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:23.760361 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:08:23.795577 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:08:23.826329 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ae3f313-1476-49f6-a1d1-b12233e40f08 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:23.828655 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ae3f313-1476-49f6-a1d1-b12233e40f08 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:23.829975 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ae3f313-1476-49f6-a1d1-b12233e40f08 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:23.831746 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-0ae3f313-1476-49f6-a1d1-b12233e40f08 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lazy-loading 'fault' on Instance uuid be43f1c5-7509-4755-9db7-c41e7b83464f {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:08:23.839790 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d0db0832-a329-4223-a9bc-696ba219a8da tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:23.840775 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d0db0832-a329-4223-a9bc-696ba219a8da tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:23.843353 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d0db0832-a329-4223-a9bc-696ba219a8da tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:23.845588 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-d0db0832-a329-4223-a9bc-696ba219a8da tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lazy-loading 'fault' on Instance uuid c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:08:24.017614 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d0db0832-a329-4223-a9bc-696ba219a8da tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:24.032838 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d0db0832-a329-4223-a9bc-696ba219a8da tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 200 len: 1369 microversion: 2.1 time: 0.327498 Oct 26 13:08:24.035056 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 790/1648] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:23 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 1369 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:24.048607 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-85fe4530-adff-47b1-b204-739da9897960 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:24.050177 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-85fe4530-adff-47b1-b204-739da9897960 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] [instance: cdca1d32-5d8f-44da-9c3b-c8d11433df06] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:24.067131 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-85fe4530-adff-47b1-b204-739da9897960 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:24.069821 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-85fe4530-adff-47b1-b204-739da9897960 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:24.071343 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-85fe4530-adff-47b1-b204-739da9897960 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:24.073855 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-85fe4530-adff-47b1-b204-739da9897960 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:24.074741 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-85fe4530-adff-47b1-b204-739da9897960 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:24.076686 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-85fe4530-adff-47b1-b204-739da9897960 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:24.167797 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0ae3f313-1476-49f6-a1d1-b12233e40f08 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:24.176777 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0ae3f313-1476-49f6-a1d1-b12233e40f08 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/be43f1c5-7509-4755-9db7-c41e7b83464f" status: 200 len: 1303 microversion: 2.1 time: 0.479793 Oct 26 13:08:24.188314 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 859/1649] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:23 2022] GET /compute/v2.1/servers/be43f1c5-7509-4755-9db7-c41e7b83464f => generated 1303 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:24.194114 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-876514dd-bff3-4db0-8fe4-60dcf1baf0db tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:24.198063 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-876514dd-bff3-4db0-8fe4-60dcf1baf0db tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] [instance: 523459ad-2398-43e2-b03b-3dc16c7214cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:24.221617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-876514dd-bff3-4db0-8fe4-60dcf1baf0db tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:24.226081 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-876514dd-bff3-4db0-8fe4-60dcf1baf0db tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:24.226726 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-876514dd-bff3-4db0-8fe4-60dcf1baf0db tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:24.233878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-876514dd-bff3-4db0-8fe4-60dcf1baf0db tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:24.235326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-876514dd-bff3-4db0-8fe4-60dcf1baf0db tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:24.237865 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-876514dd-bff3-4db0-8fe4-60dcf1baf0db tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:24.652701 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-876514dd-bff3-4db0-8fe4-60dcf1baf0db tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7849545fe2042618da2cd47f4a2b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075b65181daf492da145b2e815809d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:24.668055 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-876514dd-bff3-4db0-8fe4-60dcf1baf0db tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] 10.222.0.40 "GET /compute/v2.1/servers/523459ad-2398-43e2-b03b-3dc16c7214cb" status: 200 len: 1402 microversion: 2.1 time: 0.478225 Oct 26 13:08:24.686491 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 860/1650] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:24 2022] GET /compute/v2.1/servers/523459ad-2398-43e2-b03b-3dc16c7214cb => generated 1402 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:24.692126 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3f819385-e8a4-4dc5-a8c6-e3da90d9eaaa tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:24.693954 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3f819385-e8a4-4dc5-a8c6-e3da90d9eaaa tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 8d92c502-ca44-4fb9-b1ac-6dd4dff929ab] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:24.699949 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-85fe4530-adff-47b1-b204-739da9897960 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec3945207e6a490fb1baa5eaefcfeaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86e36a2f7fc44daac11d122c492ba68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:24.701825 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3f819385-e8a4-4dc5-a8c6-e3da90d9eaaa tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:24.702838 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3f819385-e8a4-4dc5-a8c6-e3da90d9eaaa tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:24.703524 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3f819385-e8a4-4dc5-a8c6-e3da90d9eaaa tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:24.705693 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3f819385-e8a4-4dc5-a8c6-e3da90d9eaaa tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:24.706954 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3f819385-e8a4-4dc5-a8c6-e3da90d9eaaa tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:24.707977 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3f819385-e8a4-4dc5-a8c6-e3da90d9eaaa tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:24.726379 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-85fe4530-adff-47b1-b204-739da9897960 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] 10.222.0.40 "GET /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06" status: 200 len: 1331 microversion: 2.1 time: 0.687637 Oct 26 13:08:24.727383 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 791/1651] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:24 2022] GET /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06 => generated 1331 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:24.745117 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-96828b8a-864d-4a45-a8f2-57bb86d6e20f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f6732237af0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:24.842898 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-96828b8a-864d-4a45-a8f2-57bb86d6e20f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/7d91cde1-e33e-4251-b5c9-7baac06f15a0" status: 200 len: 1412 microversion: 2.1 time: 0.109551 Oct 26 13:08:24.846334 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 792/1652] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:08:24 2022] GET /compute/v2.1/images/7d91cde1-e33e-4251-b5c9-7baac06f15a0 => generated 1412 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:24.866297 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c749c211-1980-41fa-82ac-8e5dcebf4019 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:24.871453 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c749c211-1980-41fa-82ac-8e5dcebf4019 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:24.901225 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c749c211-1980-41fa-82ac-8e5dcebf4019 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:24.903667 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c749c211-1980-41fa-82ac-8e5dcebf4019 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:24.910417 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c749c211-1980-41fa-82ac-8e5dcebf4019 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:24.915830 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c749c211-1980-41fa-82ac-8e5dcebf4019 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:24.918122 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c749c211-1980-41fa-82ac-8e5dcebf4019 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:24.918844 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c749c211-1980-41fa-82ac-8e5dcebf4019 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:25.169025 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:08:25.186340 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3f819385-e8a4-4dc5-a8c6-e3da90d9eaaa tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:25.195971 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3f819385-e8a4-4dc5-a8c6-e3da90d9eaaa tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/8d92c502-ca44-4fb9-b1ac-6dd4dff929ab" status: 200 len: 1325 microversion: 2.1 time: 0.507929 Oct 26 13:08:25.202773 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 861/1653] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:24 2022] GET /compute/v2.1/servers/8d92c502-ca44-4fb9-b1ac-6dd4dff929ab => generated 1325 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:25.207785 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-a7f51a4b-f884-4676-83d9-087d1776ea0a req-dad73ee3-54d7-4f2a-b854-4e21a0a16d92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e4891a-9fbd-42b7-a12c-5a4de9c1f151", "name": "network-vif-deleted", "tag": "4bacbb43-3b81-44f6-b4ad-82bf06f609ad"}, {"name": "network-changed", "server_uuid": "8d92c502-ca44-4fb9-b1ac-6dd4dff929ab", "tag": "cb20d675-ee5b-4fc8-8681-99b8c7998830"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:08:25.236864 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-a7f51a4b-f884-4676-83d9-087d1776ea0a req-dad73ee3-54d7-4f2a-b854-4e21a0a16d92 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:25.237605 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-a7f51a4b-f884-4676-83d9-087d1776ea0a req-dad73ee3-54d7-4f2a-b854-4e21a0a16d92 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:25.238269 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-a7f51a4b-f884-4676-83d9-087d1776ea0a req-dad73ee3-54d7-4f2a-b854-4e21a0a16d92 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:25.265424 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=24 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:08:25.269944 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-a7f51a4b-f884-4676-83d9-087d1776ea0a req-dad73ee3-54d7-4f2a-b854-4e21a0a16d92 service nova] Creating event network-vif-deleted:4bacbb43-3b81-44f6-b4ad-82bf06f609ad for instance c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 on n-h1-862686-1 Oct 26 13:08:25.272546 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-a7f51a4b-f884-4676-83d9-087d1776ea0a req-dad73ee3-54d7-4f2a-b854-4e21a0a16d92 service nova] Creating event network-changed:cb20d675-ee5b-4fc8-8681-99b8c7998830 for instance 8d92c502-ca44-4fb9-b1ac-6dd4dff929ab on n-h2-862686-1 Oct 26 13:08:25.294926 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-a7f51a4b-f884-4676-83d9-087d1776ea0a req-dad73ee3-54d7-4f2a-b854-4e21a0a16d92 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.088412 Oct 26 13:08:25.295946 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 862/1654] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:08:25.308370 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ffdf8e63-8ded-4f45-9c66-3aeb8e92f890 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:25.309142 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ffdf8e63-8ded-4f45-9c66-3aeb8e92f890 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: c7e4891a-9fbd-42b7-a12c-5a4de9c1f151] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:25.323078 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ffdf8e63-8ded-4f45-9c66-3aeb8e92f890 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:25.326173 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ffdf8e63-8ded-4f45-9c66-3aeb8e92f890 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:25.326911 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ffdf8e63-8ded-4f45-9c66-3aeb8e92f890 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:25.329102 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ffdf8e63-8ded-4f45-9c66-3aeb8e92f890 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:25.329866 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ffdf8e63-8ded-4f45-9c66-3aeb8e92f890 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:25.331318 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ffdf8e63-8ded-4f45-9c66-3aeb8e92f890 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:25.375193 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-ffdf8e63-8ded-4f45-9c66-3aeb8e92f890 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] HTTP exception thrown: Instance c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 could not be found. Oct 26 13:08:25.381796 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ffdf8e63-8ded-4f45-9c66-3aeb8e92f890 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Request method failure captured: Oct 26 13:08:25.381796 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 HTTP/1.1 Oct 26 13:08:25.381796 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:08:25.381796 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:08:25.381796 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:08:25.381796 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:08:25.381796 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:08:25.381796 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:08:25.381796 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:08:25.381796 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:08:25.381796 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWS_3Fw97GVdJXzrizCJxBUgu9J8RJco_kVLmGoVom2EfSBf64V5ikwkoboRMlNwzTzrwppwQPetCMyQDytCjux0xldDodqy3aeyjdjftC1XoGeXvxoPPAFfp6LAn20VCMFMSmFkTZbBojQkiY4AnTk9HKUW_4_BuHyJOhDfsBXlX388 Oct 26 13:08:25.381796 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:08:25.381796 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:08:25.381796 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:08:25.381796 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:08:25.381796 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:08:25.381796 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:08:25.381796 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 443f71d3ffde486b9072df264fea2f53 Oct 26 13:08:25.381796 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-MigrationsAdminTest-2041762941 Oct 26 13:08:25.381796 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:08:25.381796 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:08:25.383236 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/443f71d3ffde486b9072df264fea2f53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/443f71d3ffde486b9072df264fea2f53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_443f71d3ffde486b9072df264fea2f53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/443f71d3ffde486b9072df264fea2f53"}]}] Oct 26 13:08:25.383236 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-MigrationsAdminTest-2041762941 Oct 26 13:08:25.383236 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 443f71d3ffde486b9072df264fea2f53 Oct 26 13:08:25.383236 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-MigrationsAdminTest-2041762941 Oct 26 13:08:25.383236 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-MigrationsAdminTest-2041762941-project Oct 26 13:08:25.383236 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:08:25.383236 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:08:25.383236 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 03335593029b48dfb19fc9cdf6b382b0 Oct 26 13:08:25.383236 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-MigrationsAdminTest-2041762941-project Oct 26 13:08:25.383236 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:08:25.383236 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 could not be found. Oct 26 13:08:25.383236 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'c7e4891a-9fbd-42b7-a12c-5a4de9c1f151'} Oct 26 13:08:25.384005 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:08:25.384005 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:25.384005 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:08:25.384005 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:08:25.384005 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:08:25.384005 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:08:25.384005 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:08:25.384005 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:08:25.384005 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:08:25.384005 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:08:25.384005 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 could not be found. Oct 26 13:08:25.384005 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:08:25.384005 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:25.384005 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:08:25.384005 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:25.384005 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:08:25.384005 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:08:25.384005 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:08:25.384005 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:08:25.384005 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:08:25.385309 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:08:25.385309 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:08:25.385309 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:08:25.385309 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:08:25.385309 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:08:25.385309 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:08:25.385309 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:08:25.385309 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 could not be found. Oct 26 13:08:25.385309 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:08:25.385309 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:25.385309 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:08:25.385309 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:25.385309 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:08:25.385309 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:08:25.385309 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:08:25.385309 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:08:25.385309 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 could not be found. Oct 26 13:08:25.385309 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:08:25.388747 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ffdf8e63-8ded-4f45-9c66-3aeb8e92f890 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Returning 404 to user: Instance c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:08:25.389891 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ffdf8e63-8ded-4f45-9c66-3aeb8e92f890 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151" status: 404 len: 111 microversion: 2.1 time: 0.092773 Oct 26 13:08:25.391057 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 863/1655] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:25 2022] GET /compute/v2.1/servers/c7e4891a-9fbd-42b7-a12c-5a4de9c1f151 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:08:25.399679 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a053756c-b13d-4bd2-a296-eb4f64e7fa19 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:25.400536 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a053756c-b13d-4bd2-a296-eb4f64e7fa19 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: be43f1c5-7509-4755-9db7-c41e7b83464f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:25.407676 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a053756c-b13d-4bd2-a296-eb4f64e7fa19 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:25.408506 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a053756c-b13d-4bd2-a296-eb4f64e7fa19 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:25.409198 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a053756c-b13d-4bd2-a296-eb4f64e7fa19 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:25.410414 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a053756c-b13d-4bd2-a296-eb4f64e7fa19 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:25.411126 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a053756c-b13d-4bd2-a296-eb4f64e7fa19 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:25.413120 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a053756c-b13d-4bd2-a296-eb4f64e7fa19 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:25.430363 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-a053756c-b13d-4bd2-a296-eb4f64e7fa19 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] HTTP exception thrown: Instance be43f1c5-7509-4755-9db7-c41e7b83464f could not be found. Oct 26 13:08:25.432333 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a053756c-b13d-4bd2-a296-eb4f64e7fa19 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Request method failure captured: Oct 26 13:08:25.432333 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/be43f1c5-7509-4755-9db7-c41e7b83464f HTTP/1.1 Oct 26 13:08:25.432333 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:08:25.432333 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:08:25.432333 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:08:25.432333 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:08:25.432333 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:08:25.432333 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:08:25.432333 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:08:25.432333 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:08:25.432333 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTCi7-4ZJs-l3nyp7w3yWqj5xyBsFDp7ThFrSK2u004qA51FnO6UwBoBJnzDHnk4FNtYFd25TcBD3Pcko3EMO8wceOHAC6_Qkb2QLB9Fq_CC6QhjLHIiNtJmw_5kv4z1i-RC7jIpndCE0i2m-M3AXbb2FJh8hxcDElyLHaM3j-vW_Es Oct 26 13:08:25.432333 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:08:25.432333 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:08:25.432333 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:08:25.432333 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:08:25.432333 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:08:25.432333 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:08:25.432333 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 2f5434aa488d4d5a8bae96746cfd7494 Oct 26 13:08:25.432333 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersAdminTestJSON-295038141 Oct 26 13:08:25.432333 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:08:25.432333 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:08:25.433867 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2f5434aa488d4d5a8bae96746cfd7494"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2f5434aa488d4d5a8bae96746cfd7494"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2f5434aa488d4d5a8bae96746cfd7494"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2f5434aa488d4d5a8bae96746cfd7494"}]}] Oct 26 13:08:25.433867 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersAdminTestJSON-295038141 Oct 26 13:08:25.433867 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 2f5434aa488d4d5a8bae96746cfd7494 Oct 26 13:08:25.433867 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersAdminTestJSON-295038141 Oct 26 13:08:25.433867 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersAdminTestJSON-295038141-project Oct 26 13:08:25.433867 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:08:25.433867 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:08:25.433867 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: de8d47754d3f4d2c844dea032bdb0095 Oct 26 13:08:25.433867 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersAdminTestJSON-295038141-project Oct 26 13:08:25.433867 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:08:25.433867 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance be43f1c5-7509-4755-9db7-c41e7b83464f could not be found. Oct 26 13:08:25.433867 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'be43f1c5-7509-4755-9db7-c41e7b83464f'} Oct 26 13:08:25.442271 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:08:25.442271 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:25.442271 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:08:25.442271 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:08:25.442271 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:08:25.442271 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:08:25.442271 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:08:25.442271 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:08:25.442271 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:08:25.442271 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:08:25.442271 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be43f1c5-7509-4755-9db7-c41e7b83464f could not be found. Oct 26 13:08:25.442271 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:08:25.442271 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:25.442271 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:08:25.442271 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:25.442271 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:08:25.442271 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:08:25.442271 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:08:25.442271 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:08:25.442271 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:08:25.447710 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:08:25.447710 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:08:25.447710 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:08:25.447710 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:08:25.447710 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:08:25.447710 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:08:25.447710 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:08:25.447710 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be43f1c5-7509-4755-9db7-c41e7b83464f could not be found. Oct 26 13:08:25.447710 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:08:25.447710 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:25.447710 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:08:25.447710 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:25.447710 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:08:25.447710 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:08:25.447710 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:08:25.447710 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:08:25.447710 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be43f1c5-7509-4755-9db7-c41e7b83464f could not be found. Oct 26 13:08:25.447710 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:08:25.458804 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a053756c-b13d-4bd2-a296-eb4f64e7fa19 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Returning 404 to user: Instance be43f1c5-7509-4755-9db7-c41e7b83464f could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:08:25.461367 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a053756c-b13d-4bd2-a296-eb4f64e7fa19 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/be43f1c5-7509-4755-9db7-c41e7b83464f" status: 404 len: 111 microversion: 2.1 time: 0.068990 Oct 26 13:08:25.469001 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 864/1656] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:25 2022] GET /compute/v2.1/servers/be43f1c5-7509-4755-9db7-c41e7b83464f => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:08:25.482086 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d610deee-b68b-4fa9-b587-9016c9ccdd9c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '.version_select at 0x7f67369e7ca0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:25.531120 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d610deee-b68b-4fa9-b587-9016c9ccdd9c tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1672155377" status: 202 len: 0 microversion: 2.1 time: 0.059218 Oct 26 13:08:25.532876 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 865/1657] 10.222.0.40 () {58 vars in 1221 bytes} [Wed Oct 26 13:08:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1672155377 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:08:25.539539 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-52b03595-9275-4b4d-814a-f4279930d178 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:25.540690 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-52b03595-9275-4b4d-814a-f4279930d178 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:25.547632 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-52b03595-9275-4b4d-814a-f4279930d178 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:25.548515 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-52b03595-9275-4b4d-814a-f4279930d178 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:25.549468 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-52b03595-9275-4b4d-814a-f4279930d178 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:25.550808 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-52b03595-9275-4b4d-814a-f4279930d178 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:25.551490 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-52b03595-9275-4b4d-814a-f4279930d178 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:25.552921 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-52b03595-9275-4b4d-814a-f4279930d178 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:25.584230 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c749c211-1980-41fa-82ac-8e5dcebf4019 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:25.585910 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-52b03595-9275-4b4d-814a-f4279930d178 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:08:25.595178 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c749c211-1980-41fa-82ac-8e5dcebf4019 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:25.596633 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c749c211-1980-41fa-82ac-8e5dcebf4019 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:25.609979 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c749c211-1980-41fa-82ac-8e5dcebf4019 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 200 len: 1293 microversion: 2.25 time: 0.749461 Oct 26 13:08:25.628004 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 793/1658] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:08:24 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 1293 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:08:25.694219 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-80faad87-faef-49b1-b2fc-cd8f3692121c tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:25.695235 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-80faad87-faef-49b1-b2fc-cd8f3692121c tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] [instance: 523459ad-2398-43e2-b03b-3dc16c7214cb] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:25.711907 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:08:25.714384 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-80faad87-faef-49b1-b2fc-cd8f3692121c tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:25.719835 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-80faad87-faef-49b1-b2fc-cd8f3692121c tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:25.720858 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-80faad87-faef-49b1-b2fc-cd8f3692121c tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:25.723098 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-80faad87-faef-49b1-b2fc-cd8f3692121c tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:25.724723 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-80faad87-faef-49b1-b2fc-cd8f3692121c tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:25.725516 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-80faad87-faef-49b1-b2fc-cd8f3692121c tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:25.770656 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-52b03595-9275-4b4d-814a-f4279930d178 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "DELETE /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 204 len: 0 microversion: 2.1 time: 0.236166 Oct 26 13:08:25.771942 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 866/1659] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:08:25 2022] DELETE /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:08:25.781996 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-46fc8c25-405b-4bb4-b393-80001f3a377b tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:25.782827 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-46fc8c25-405b-4bb4-b393-80001f3a377b tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] [instance: cdca1d32-5d8f-44da-9c3b-c8d11433df06] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:25.793753 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46fc8c25-405b-4bb4-b393-80001f3a377b tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:25.794236 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46fc8c25-405b-4bb4-b393-80001f3a377b tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:25.795361 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46fc8c25-405b-4bb4-b393-80001f3a377b tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:25.797002 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46fc8c25-405b-4bb4-b393-80001f3a377b tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:25.799228 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46fc8c25-405b-4bb4-b393-80001f3a377b tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:25.799858 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46fc8c25-405b-4bb4-b393-80001f3a377b tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:26.127392 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-80faad87-faef-49b1-b2fc-cd8f3692121c tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7849545fe2042618da2cd47f4a2b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075b65181daf492da145b2e815809d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:26.138838 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-80faad87-faef-49b1-b2fc-cd8f3692121c tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] 10.222.0.40 "GET /compute/v2.1/servers/523459ad-2398-43e2-b03b-3dc16c7214cb" status: 200 len: 1402 microversion: 2.1 time: 0.447830 Oct 26 13:08:26.140181 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 794/1660] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:25 2022] GET /compute/v2.1/servers/523459ad-2398-43e2-b03b-3dc16c7214cb => generated 1402 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:08:26.145648 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-64b2af1e-a04a-4a33-b9ee-a44fd586c725 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:26.147291 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-64b2af1e-a04a-4a33-b9ee-a44fd586c725 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:26.155061 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64b2af1e-a04a-4a33-b9ee-a44fd586c725 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:26.155893 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64b2af1e-a04a-4a33-b9ee-a44fd586c725 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:26.156562 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64b2af1e-a04a-4a33-b9ee-a44fd586c725 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:26.157497 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64b2af1e-a04a-4a33-b9ee-a44fd586c725 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:26.158169 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64b2af1e-a04a-4a33-b9ee-a44fd586c725 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:26.158807 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64b2af1e-a04a-4a33-b9ee-a44fd586c725 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:26.448471 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-46fc8c25-405b-4bb4-b393-80001f3a377b tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec3945207e6a490fb1baa5eaefcfeaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86e36a2f7fc44daac11d122c492ba68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:26.456559 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=16 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:08:26.461176 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-46fc8c25-405b-4bb4-b393-80001f3a377b tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] 10.222.0.40 "GET /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06" status: 200 len: 1331 microversion: 2.1 time: 0.687699 Oct 26 13:08:26.481509 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 867/1661] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:25 2022] GET /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06 => generated 1331 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:26.481509 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-b9121190-2b57-499a-87ac-d1dab14fb44c req-015be7b1-bd1b-4525-bea9-c901a9d7bb5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ce726c3-809c-4662-b794-dcec3f82047c", "tag": "2ed4f127-e35d-49ce-a3f0-81fac3604625"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:08:26.524138 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b9121190-2b57-499a-87ac-d1dab14fb44c req-015be7b1-bd1b-4525-bea9-c901a9d7bb5b service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:26.524653 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b9121190-2b57-499a-87ac-d1dab14fb44c req-015be7b1-bd1b-4525-bea9-c901a9d7bb5b service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:26.526253 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b9121190-2b57-499a-87ac-d1dab14fb44c req-015be7b1-bd1b-4525-bea9-c901a9d7bb5b service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:26.559421 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-64b2af1e-a04a-4a33-b9ee-a44fd586c725 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:26.572266 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-b9121190-2b57-499a-87ac-d1dab14fb44c req-015be7b1-bd1b-4525-bea9-c901a9d7bb5b service nova] Creating event network-changed:2ed4f127-e35d-49ce-a3f0-81fac3604625 for instance 3ce726c3-809c-4662-b794-dcec3f82047c on n-h1-862686-1 Oct 26 13:08:26.573454 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-64b2af1e-a04a-4a33-b9ee-a44fd586c725 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1470 microversion: 2.1 time: 0.430423 Oct 26 13:08:26.592613 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 795/1662] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:26 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1470 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:26.593711 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-b9121190-2b57-499a-87ac-d1dab14fb44c req-015be7b1-bd1b-4525-bea9-c901a9d7bb5b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122716 Oct 26 13:08:26.601965 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 868/1663] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:08:26.610472 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b7afa894-cdc9-440c-8e92-4ae924e07b79 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67323c4820>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:26.626225 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ef1fb05b-ba07-48ea-a9b6-506d02d2d012 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:26.629792 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ef1fb05b-ba07-48ea-a9b6-506d02d2d012 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 8d92c502-ca44-4fb9-b1ac-6dd4dff929ab] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:26.656277 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef1fb05b-ba07-48ea-a9b6-506d02d2d012 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:26.657069 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef1fb05b-ba07-48ea-a9b6-506d02d2d012 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:26.660297 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef1fb05b-ba07-48ea-a9b6-506d02d2d012 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:26.665555 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef1fb05b-ba07-48ea-a9b6-506d02d2d012 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:26.666790 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef1fb05b-ba07-48ea-a9b6-506d02d2d012 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:26.667391 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef1fb05b-ba07-48ea-a9b6-506d02d2d012 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:26.728740 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b7afa894-cdc9-440c-8e92-4ae924e07b79 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/7d91cde1-e33e-4251-b5c9-7baac06f15a0" status: 200 len: 1412 microversion: 2.1 time: 0.129832 Oct 26 13:08:26.731933 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 796/1664] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:08:26 2022] GET /compute/v2.1/images/7d91cde1-e33e-4251-b5c9-7baac06f15a0 => generated 1412 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:26.747694 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3749f6e8-0970-462a-bfa8-bf29e93139cc tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:26.749298 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3749f6e8-0970-462a-bfa8-bf29e93139cc tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:26.764612 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3749f6e8-0970-462a-bfa8-bf29e93139cc tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:26.770296 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3749f6e8-0970-462a-bfa8-bf29e93139cc tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:26.771480 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3749f6e8-0970-462a-bfa8-bf29e93139cc tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:26.772590 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3749f6e8-0970-462a-bfa8-bf29e93139cc tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:26.773771 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3749f6e8-0970-462a-bfa8-bf29e93139cc tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:26.774903 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3749f6e8-0970-462a-bfa8-bf29e93139cc tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:27.144181 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3749f6e8-0970-462a-bfa8-bf29e93139cc tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:27.156667 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3749f6e8-0970-462a-bfa8-bf29e93139cc tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:27.161244 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3749f6e8-0970-462a-bfa8-bf29e93139cc tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:27.164227 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3749f6e8-0970-462a-bfa8-bf29e93139cc tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 200 len: 1281 microversion: 2.25 time: 0.430847 Oct 26 13:08:27.167539 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 797/1665] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:08:26 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 1281 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:08:27.175627 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-a19060d2-faf2-44fb-bc08-54e7b3fc0566 req-15009c84-6e00-4c19-8d33-6b010a16bb1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdca1d32-5d8f-44da-9c3b-c8d11433df06", "name": "network-vif-plugged", "status": "completed", "tag": "7cca99b7-782b-4cb4-bf7d-e207183f2165"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:08:27.236388 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a19060d2-faf2-44fb-bc08-54e7b3fc0566 req-15009c84-6e00-4c19-8d33-6b010a16bb1b service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:27.238522 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a19060d2-faf2-44fb-bc08-54e7b3fc0566 req-15009c84-6e00-4c19-8d33-6b010a16bb1b service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:27.240345 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a19060d2-faf2-44fb-bc08-54e7b3fc0566 req-15009c84-6e00-4c19-8d33-6b010a16bb1b service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:27.265512 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-a19060d2-faf2-44fb-bc08-54e7b3fc0566 req-15009c84-6e00-4c19-8d33-6b010a16bb1b service nova] Creating event network-vif-plugged:7cca99b7-782b-4cb4-bf7d-e207183f2165 for instance cdca1d32-5d8f-44da-9c3b-c8d11433df06 on n-h1-862686-1 Oct 26 13:08:27.282021 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-a19060d2-faf2-44fb-bc08-54e7b3fc0566 req-15009c84-6e00-4c19-8d33-6b010a16bb1b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105945 Oct 26 13:08:27.286069 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 798/1666] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:08:27.309122 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9f64459e-75b5-41d1-a8c6-b7c992b6e337 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:27.311549 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9f64459e-75b5-41d1-a8c6-b7c992b6e337 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] [instance: 523459ad-2398-43e2-b03b-3dc16c7214cb] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:27.335957 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ef1fb05b-ba07-48ea-a9b6-506d02d2d012 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:27.340237 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f64459e-75b5-41d1-a8c6-b7c992b6e337 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:27.340730 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f64459e-75b5-41d1-a8c6-b7c992b6e337 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:27.341164 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f64459e-75b5-41d1-a8c6-b7c992b6e337 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:27.341894 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f64459e-75b5-41d1-a8c6-b7c992b6e337 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:27.342347 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f64459e-75b5-41d1-a8c6-b7c992b6e337 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:27.345524 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ef1fb05b-ba07-48ea-a9b6-506d02d2d012 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/8d92c502-ca44-4fb9-b1ac-6dd4dff929ab" status: 200 len: 1325 microversion: 2.1 time: 0.739608 Oct 26 13:08:27.361437 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f64459e-75b5-41d1-a8c6-b7c992b6e337 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:27.362594 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 869/1667] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:26 2022] GET /compute/v2.1/servers/8d92c502-ca44-4fb9-b1ac-6dd4dff929ab => generated 1325 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:27.496782 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bc5dd3dc-7d2e-48da-8e70-4097d26edee4 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:27.497940 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bc5dd3dc-7d2e-48da-8e70-4097d26edee4 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] [instance: cdca1d32-5d8f-44da-9c3b-c8d11433df06] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:27.509207 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc5dd3dc-7d2e-48da-8e70-4097d26edee4 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:27.509735 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc5dd3dc-7d2e-48da-8e70-4097d26edee4 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:27.510176 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc5dd3dc-7d2e-48da-8e70-4097d26edee4 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:27.510896 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc5dd3dc-7d2e-48da-8e70-4097d26edee4 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:27.511357 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc5dd3dc-7d2e-48da-8e70-4097d26edee4 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:27.511785 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc5dd3dc-7d2e-48da-8e70-4097d26edee4 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:27.765163 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bc5dd3dc-7d2e-48da-8e70-4097d26edee4 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec3945207e6a490fb1baa5eaefcfeaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86e36a2f7fc44daac11d122c492ba68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:27.779680 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bc5dd3dc-7d2e-48da-8e70-4097d26edee4 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] 10.222.0.40 "GET /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06" status: 200 len: 1331 microversion: 2.1 time: 0.287879 Oct 26 13:08:27.796164 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 870/1668] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:27 2022] GET /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06 => generated 1331 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:08:27.806623 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9f64459e-75b5-41d1-a8c6-b7c992b6e337 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7849545fe2042618da2cd47f4a2b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075b65181daf492da145b2e815809d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:27.818650 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9f64459e-75b5-41d1-a8c6-b7c992b6e337 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] 10.222.0.40 "GET /compute/v2.1/servers/523459ad-2398-43e2-b03b-3dc16c7214cb" status: 200 len: 1402 microversion: 2.1 time: 0.530451 Oct 26 13:08:27.819249 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 799/1669] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:27 2022] GET /compute/v2.1/servers/523459ad-2398-43e2-b03b-3dc16c7214cb => generated 1402 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:27.825004 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a7c0baaa-a1e2-4eba-a066-357df0819d55 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:27.827375 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a7c0baaa-a1e2-4eba-a066-357df0819d55 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:27.832826 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-533746bf-ee1c-4aa5-ae23-b9be1c7430f6 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f673229ad30>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:27.837351 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a7c0baaa-a1e2-4eba-a066-357df0819d55 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:27.838248 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a7c0baaa-a1e2-4eba-a066-357df0819d55 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:27.838938 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a7c0baaa-a1e2-4eba-a066-357df0819d55 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:27.840028 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a7c0baaa-a1e2-4eba-a066-357df0819d55 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:27.840729 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a7c0baaa-a1e2-4eba-a066-357df0819d55 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:27.842177 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a7c0baaa-a1e2-4eba-a066-357df0819d55 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:27.913269 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-533746bf-ee1c-4aa5-ae23-b9be1c7430f6 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/7d91cde1-e33e-4251-b5c9-7baac06f15a0" status: 200 len: 1412 microversion: 2.1 time: 0.092740 Oct 26 13:08:27.914997 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 800/1670] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:08:27 2022] GET /compute/v2.1/images/7d91cde1-e33e-4251-b5c9-7baac06f15a0 => generated 1412 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:28.178564 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-55551110-a42e-456c-99ee-4191b63bb2cf tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:28.179243 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-55551110-a42e-456c-99ee-4191b63bb2cf tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 7da4bb85-b577-4608-a7c0-3320721cb997] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:28.195257 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-55551110-a42e-456c-99ee-4191b63bb2cf tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:28.195890 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-55551110-a42e-456c-99ee-4191b63bb2cf tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:28.197603 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-55551110-a42e-456c-99ee-4191b63bb2cf tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:28.200302 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-55551110-a42e-456c-99ee-4191b63bb2cf tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:28.201983 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-55551110-a42e-456c-99ee-4191b63bb2cf tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:28.203219 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-55551110-a42e-456c-99ee-4191b63bb2cf tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:28.296031 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-55551110-a42e-456c-99ee-4191b63bb2cf tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 7da4bb85-b577-4608-a7c0-3320721cb997] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:08:28.305393 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a7c0baaa-a1e2-4eba-a066-357df0819d55 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:28.324969 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a7c0baaa-a1e2-4eba-a066-357df0819d55 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1470 microversion: 2.1 time: 0.527358 Oct 26 13:08:28.347320 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 871/1671] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:27 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1470 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:28.354025 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ff688a96-dee1-467e-9676-645b172042f8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:28.354650 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ff688a96-dee1-467e-9676-645b172042f8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:28.374645 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ff688a96-dee1-467e-9676-645b172042f8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:28.375736 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ff688a96-dee1-467e-9676-645b172042f8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:28.377008 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ff688a96-dee1-467e-9676-645b172042f8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:28.378417 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ff688a96-dee1-467e-9676-645b172042f8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:28.380122 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ff688a96-dee1-467e-9676-645b172042f8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:28.381415 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ff688a96-dee1-467e-9676-645b172042f8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:28.519185 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-55551110-a42e-456c-99ee-4191b63bb2cf tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997" status: 204 len: 0 microversion: 2.1 time: 0.347074 Oct 26 13:08:28.523645 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 801/1672] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:08:28 2022] DELETE /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:08:28.527882 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-899702a8-6c4e-4ead-aa6f-9c382a71e886 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:28.528736 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-899702a8-6c4e-4ead-aa6f-9c382a71e886 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 8d92c502-ca44-4fb9-b1ac-6dd4dff929ab] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:28.537787 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-899702a8-6c4e-4ead-aa6f-9c382a71e886 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:28.538286 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-899702a8-6c4e-4ead-aa6f-9c382a71e886 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:28.539207 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-899702a8-6c4e-4ead-aa6f-9c382a71e886 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:28.539943 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-899702a8-6c4e-4ead-aa6f-9c382a71e886 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:28.540467 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-899702a8-6c4e-4ead-aa6f-9c382a71e886 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:28.541040 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-899702a8-6c4e-4ead-aa6f-9c382a71e886 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:28.710035 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ff688a96-dee1-467e-9676-645b172042f8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:28.728014 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ff688a96-dee1-467e-9676-645b172042f8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:28.733778 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ff688a96-dee1-467e-9676-645b172042f8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:28.735240 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ff688a96-dee1-467e-9676-645b172042f8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 200 len: 1281 microversion: 2.25 time: 0.385978 Oct 26 13:08:28.751856 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 872/1673] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:08:28 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 1281 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:08:28.762911 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f51b850b-81d6-46a8-92d2-2f83abc0a189 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:28.763757 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f51b850b-81d6-46a8-92d2-2f83abc0a189 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 7da4bb85-b577-4608-a7c0-3320721cb997] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:28.771444 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f51b850b-81d6-46a8-92d2-2f83abc0a189 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:28.772851 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f51b850b-81d6-46a8-92d2-2f83abc0a189 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:28.773527 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f51b850b-81d6-46a8-92d2-2f83abc0a189 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:28.774467 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f51b850b-81d6-46a8-92d2-2f83abc0a189 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:28.775103 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f51b850b-81d6-46a8-92d2-2f83abc0a189 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:28.776198 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f51b850b-81d6-46a8-92d2-2f83abc0a189 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:29.121157 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f51b850b-81d6-46a8-92d2-2f83abc0a189 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:29.129926 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f51b850b-81d6-46a8-92d2-2f83abc0a189 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997" status: 200 len: 1468 microversion: 2.1 time: 0.376480 Oct 26 13:08:29.135912 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 873/1674] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:28 2022] GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997 => generated 1468 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:29.140930 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b777d7ef-4f43-4952-b937-2dca1b43828d tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:29.148452 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b777d7ef-4f43-4952-b937-2dca1b43828d tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] [instance: cdca1d32-5d8f-44da-9c3b-c8d11433df06] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:29.163192 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b777d7ef-4f43-4952-b937-2dca1b43828d tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:29.164982 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b777d7ef-4f43-4952-b937-2dca1b43828d tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:29.165826 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b777d7ef-4f43-4952-b937-2dca1b43828d tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:29.166753 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b777d7ef-4f43-4952-b937-2dca1b43828d tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:29.167473 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b777d7ef-4f43-4952-b937-2dca1b43828d tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:29.168209 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b777d7ef-4f43-4952-b937-2dca1b43828d tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:29.409133 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b777d7ef-4f43-4952-b937-2dca1b43828d tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec3945207e6a490fb1baa5eaefcfeaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86e36a2f7fc44daac11d122c492ba68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:29.424660 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b777d7ef-4f43-4952-b937-2dca1b43828d tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] 10.222.0.40 "GET /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06" status: 200 len: 1331 microversion: 2.1 time: 0.286219 Oct 26 13:08:29.438646 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 874/1675] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:29 2022] GET /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06 => generated 1331 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:29.446371 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-899702a8-6c4e-4ead-aa6f-9c382a71e886 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:29.452693 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5972c9b9-d0f8-4719-be73-64822cd9201b tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:29.453326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5972c9b9-d0f8-4719-be73-64822cd9201b tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] [instance: 523459ad-2398-43e2-b03b-3dc16c7214cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:29.456815 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-899702a8-6c4e-4ead-aa6f-9c382a71e886 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/8d92c502-ca44-4fb9-b1ac-6dd4dff929ab" status: 200 len: 1325 microversion: 2.1 time: 0.934703 Oct 26 13:08:29.457570 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:08:29.460177 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 802/1676] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:28 2022] GET /compute/v2.1/servers/8d92c502-ca44-4fb9-b1ac-6dd4dff929ab => generated 1325 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:29.467834 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4f39eda1-62f9-42a5-a501-d122109903f9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67322e7f70>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:29.473403 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5972c9b9-d0f8-4719-be73-64822cd9201b tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:29.475446 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5972c9b9-d0f8-4719-be73-64822cd9201b tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:29.476218 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5972c9b9-d0f8-4719-be73-64822cd9201b tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:29.477607 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5972c9b9-d0f8-4719-be73-64822cd9201b tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:29.478687 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5972c9b9-d0f8-4719-be73-64822cd9201b tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:29.480524 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5972c9b9-d0f8-4719-be73-64822cd9201b tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:29.555095 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4f39eda1-62f9-42a5-a501-d122109903f9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/7d91cde1-e33e-4251-b5c9-7baac06f15a0" status: 200 len: 1412 microversion: 2.1 time: 0.093564 Oct 26 13:08:29.555942 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 803/1677] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:08:29 2022] GET /compute/v2.1/images/7d91cde1-e33e-4251-b5c9-7baac06f15a0 => generated 1412 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:29.561201 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-5319c565-a1f4-4ee9-b1e6-8edc1bb3b279 req-7c540237-0f6e-46dd-a173-840bb646dfaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "670021c1-045f-40b1-9358-c589d32e9904", "name": "network-vif-deleted", "tag": "6e2ffd62-248d-44dd-83ca-8e87f79cc722"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:08:29.589312 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-5319c565-a1f4-4ee9-b1e6-8edc1bb3b279 req-7c540237-0f6e-46dd-a173-840bb646dfaf service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:29.592216 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-5319c565-a1f4-4ee9-b1e6-8edc1bb3b279 req-7c540237-0f6e-46dd-a173-840bb646dfaf service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:29.594740 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-5319c565-a1f4-4ee9-b1e6-8edc1bb3b279 req-7c540237-0f6e-46dd-a173-840bb646dfaf service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:29.611670 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-5319c565-a1f4-4ee9-b1e6-8edc1bb3b279 req-7c540237-0f6e-46dd-a173-840bb646dfaf service nova] Creating event network-vif-deleted:6e2ffd62-248d-44dd-83ca-8e87f79cc722 for instance 670021c1-045f-40b1-9358-c589d32e9904 on n-h2-862686-1 Oct 26 13:08:29.617931 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-5319c565-a1f4-4ee9-b1e6-8edc1bb3b279 req-7c540237-0f6e-46dd-a173-840bb646dfaf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060184 Oct 26 13:08:29.619227 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 804/1678] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:08:29.624426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-def8426f-f3a4-4f1f-9c8e-7c9ab4d64541 req-f0a58d3c-c7e0-4008-befd-ebc97c676747 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "523459ad-2398-43e2-b03b-3dc16c7214cb", "name": "network-vif-plugged", "status": "completed", "tag": "ad3bf7f7-f2d9-4b92-a4fd-ba2b441e5413"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:08:29.638153 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-def8426f-f3a4-4f1f-9c8e-7c9ab4d64541 req-f0a58d3c-c7e0-4008-befd-ebc97c676747 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:29.638919 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-def8426f-f3a4-4f1f-9c8e-7c9ab4d64541 req-f0a58d3c-c7e0-4008-befd-ebc97c676747 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:29.639614 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-def8426f-f3a4-4f1f-9c8e-7c9ab4d64541 req-f0a58d3c-c7e0-4008-befd-ebc97c676747 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:29.654625 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-def8426f-f3a4-4f1f-9c8e-7c9ab4d64541 req-f0a58d3c-c7e0-4008-befd-ebc97c676747 service nova] Creating event network-vif-plugged:ad3bf7f7-f2d9-4b92-a4fd-ba2b441e5413 for instance 523459ad-2398-43e2-b03b-3dc16c7214cb on n-h1-862686-1 Oct 26 13:08:29.662112 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-def8426f-f3a4-4f1f-9c8e-7c9ab4d64541 req-f0a58d3c-c7e0-4008-befd-ebc97c676747 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040675 Oct 26 13:08:29.663650 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 805/1679] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:08:29.669963 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d2d05ea0-d7db-4d13-812b-dbb5e1139b82 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:29.670889 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d2d05ea0-d7db-4d13-812b-dbb5e1139b82 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:29.677662 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d2d05ea0-d7db-4d13-812b-dbb5e1139b82 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:29.678540 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d2d05ea0-d7db-4d13-812b-dbb5e1139b82 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:29.679198 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d2d05ea0-d7db-4d13-812b-dbb5e1139b82 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:29.680111 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d2d05ea0-d7db-4d13-812b-dbb5e1139b82 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:29.680756 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d2d05ea0-d7db-4d13-812b-dbb5e1139b82 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:29.681367 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d2d05ea0-d7db-4d13-812b-dbb5e1139b82 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:29.763443 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5972c9b9-d0f8-4719-be73-64822cd9201b tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7849545fe2042618da2cd47f4a2b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075b65181daf492da145b2e815809d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:29.773250 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5972c9b9-d0f8-4719-be73-64822cd9201b tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] 10.222.0.40 "GET /compute/v2.1/servers/523459ad-2398-43e2-b03b-3dc16c7214cb" status: 200 len: 1402 microversion: 2.1 time: 0.328285 Oct 26 13:08:29.774738 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 875/1680] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:29 2022] GET /compute/v2.1/servers/523459ad-2398-43e2-b03b-3dc16c7214cb => generated 1402 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:29.781818 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0fa06983-8755-4024-8891-6548257c9553 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:29.782960 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0fa06983-8755-4024-8891-6548257c9553 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:29.793472 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0fa06983-8755-4024-8891-6548257c9553 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:29.795235 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0fa06983-8755-4024-8891-6548257c9553 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:29.795936 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0fa06983-8755-4024-8891-6548257c9553 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:29.796965 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0fa06983-8755-4024-8891-6548257c9553 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:29.798326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0fa06983-8755-4024-8891-6548257c9553 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:29.799013 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0fa06983-8755-4024-8891-6548257c9553 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:30.051423 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d2d05ea0-d7db-4d13-812b-dbb5e1139b82 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8d47754d3f4d2c844dea032bdb0095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5434aa488d4d5a8bae96746cfd7494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:30.069951 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d2d05ea0-d7db-4d13-812b-dbb5e1139b82 tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 200 len: 1428 microversion: 2.1 time: 0.403666 Oct 26 13:08:30.070569 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 806/1681] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:29 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 1428 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:30.125423 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0fa06983-8755-4024-8891-6548257c9553 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:30.135166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0fa06983-8755-4024-8891-6548257c9553 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:30.140954 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0fa06983-8755-4024-8891-6548257c9553 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:30.148868 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0fa06983-8755-4024-8891-6548257c9553 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 200 len: 1281 microversion: 2.25 time: 0.371527 Oct 26 13:08:30.152363 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 876/1682] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:08:29 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 1281 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:08:30.169794 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f37dd93f-91af-484f-93d8-ca1d389ecb4d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:30.170726 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f37dd93f-91af-484f-93d8-ca1d389ecb4d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 7da4bb85-b577-4608-a7c0-3320721cb997] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:30.187844 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f37dd93f-91af-484f-93d8-ca1d389ecb4d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:30.188575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f37dd93f-91af-484f-93d8-ca1d389ecb4d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:30.190378 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f37dd93f-91af-484f-93d8-ca1d389ecb4d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:30.191122 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f37dd93f-91af-484f-93d8-ca1d389ecb4d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:30.191594 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f37dd93f-91af-484f-93d8-ca1d389ecb4d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:30.192028 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f37dd93f-91af-484f-93d8-ca1d389ecb4d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:30.458176 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f0cf9e1b-cd42-4e02-bd24-9c3541b2087d tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:30.460033 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f0cf9e1b-cd42-4e02-bd24-9c3541b2087d tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] [instance: cdca1d32-5d8f-44da-9c3b-c8d11433df06] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:30.475016 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0cf9e1b-cd42-4e02-bd24-9c3541b2087d tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:30.475541 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0cf9e1b-cd42-4e02-bd24-9c3541b2087d tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:30.475942 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0cf9e1b-cd42-4e02-bd24-9c3541b2087d tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:30.490705 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0cf9e1b-cd42-4e02-bd24-9c3541b2087d tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:30.494653 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0cf9e1b-cd42-4e02-bd24-9c3541b2087d tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:30.498202 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0cf9e1b-cd42-4e02-bd24-9c3541b2087d tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:30.586127 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f37dd93f-91af-484f-93d8-ca1d389ecb4d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:30.598025 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f37dd93f-91af-484f-93d8-ca1d389ecb4d tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997" status: 200 len: 1468 microversion: 2.1 time: 0.438263 Oct 26 13:08:30.603706 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 807/1683] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:30 2022] GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997 => generated 1468 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:30.611413 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6bf561c2-9cca-414e-9234-623c50bcaeda tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:30.612018 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6bf561c2-9cca-414e-9234-623c50bcaeda tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 8d92c502-ca44-4fb9-b1ac-6dd4dff929ab] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:30.620677 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6bf561c2-9cca-414e-9234-623c50bcaeda tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:30.621378 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6bf561c2-9cca-414e-9234-623c50bcaeda tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:30.622029 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6bf561c2-9cca-414e-9234-623c50bcaeda tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:30.622937 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6bf561c2-9cca-414e-9234-623c50bcaeda tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:30.623602 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6bf561c2-9cca-414e-9234-623c50bcaeda tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:30.624335 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6bf561c2-9cca-414e-9234-623c50bcaeda tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:30.905233 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f0cf9e1b-cd42-4e02-bd24-9c3541b2087d tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec3945207e6a490fb1baa5eaefcfeaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86e36a2f7fc44daac11d122c492ba68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:30.917982 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:08:30.923593 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f0cf9e1b-cd42-4e02-bd24-9c3541b2087d tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] 10.222.0.40 "GET /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06" status: 200 len: 1535 microversion: 2.1 time: 0.475018 Oct 26 13:08:30.949873 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 877/1684] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:30 2022] GET /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06 => generated 1535 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:30.967878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c58c1f1b-101a-4ad3-9dc2-dd25f3ee524e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f6731fa8670>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:31.089305 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c58c1f1b-101a-4ad3-9dc2-dd25f3ee524e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/7d91cde1-e33e-4251-b5c9-7baac06f15a0" status: 200 len: 1412 microversion: 2.1 time: 0.138202 Oct 26 13:08:31.090114 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 878/1685] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:08:30 2022] GET /compute/v2.1/images/7d91cde1-e33e-4251-b5c9-7baac06f15a0 => generated 1412 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:31.102960 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-50545f1e-51d1-4adc-b624-c6e68b8b9a7f tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:31.103956 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-50545f1e-51d1-4adc-b624-c6e68b8b9a7f tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] [instance: 523459ad-2398-43e2-b03b-3dc16c7214cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:31.112728 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6bf561c2-9cca-414e-9234-623c50bcaeda tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:31.121618 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50545f1e-51d1-4adc-b624-c6e68b8b9a7f tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:31.122118 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50545f1e-51d1-4adc-b624-c6e68b8b9a7f tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:31.122713 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50545f1e-51d1-4adc-b624-c6e68b8b9a7f tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:31.123248 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50545f1e-51d1-4adc-b624-c6e68b8b9a7f tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:31.125269 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50545f1e-51d1-4adc-b624-c6e68b8b9a7f tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:31.125900 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50545f1e-51d1-4adc-b624-c6e68b8b9a7f tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:31.128420 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6bf561c2-9cca-414e-9234-623c50bcaeda tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/8d92c502-ca44-4fb9-b1ac-6dd4dff929ab" status: 200 len: 1325 microversion: 2.1 time: 0.523261 Oct 26 13:08:31.134037 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 808/1686] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:30 2022] GET /compute/v2.1/servers/8d92c502-ca44-4fb9-b1ac-6dd4dff929ab => generated 1325 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:31.140150 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cc868803-b2d2-4087-b933-711650a3b964 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Action: 'create', calling method: .version_select at 0x7f6732237f70>, body: {"pool": "41c3ece9-8653-47df-8de8-fa897ccc9072"} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:08:31.473807 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-50545f1e-51d1-4adc-b624-c6e68b8b9a7f tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7849545fe2042618da2cd47f4a2b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075b65181daf492da145b2e815809d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:31.486887 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-50545f1e-51d1-4adc-b624-c6e68b8b9a7f tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] 10.222.0.40 "GET /compute/v2.1/servers/523459ad-2398-43e2-b03b-3dc16c7214cb" status: 200 len: 1402 microversion: 2.1 time: 0.395017 Oct 26 13:08:31.487486 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 879/1687] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:31 2022] GET /compute/v2.1/servers/523459ad-2398-43e2-b03b-3dc16c7214cb => generated 1402 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:31.496763 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-62c95ca9-904c-45ed-9e2b-334ec7c6478a tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:31.497380 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-62c95ca9-904c-45ed-9e2b-334ec7c6478a tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] [instance: 670021c1-045f-40b1-9358-c589d32e9904] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:31.507133 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-62c95ca9-904c-45ed-9e2b-334ec7c6478a tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:31.508149 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-62c95ca9-904c-45ed-9e2b-334ec7c6478a tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:31.508915 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-62c95ca9-904c-45ed-9e2b-334ec7c6478a tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:31.512346 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-62c95ca9-904c-45ed-9e2b-334ec7c6478a tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:31.513138 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-62c95ca9-904c-45ed-9e2b-334ec7c6478a tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:31.514068 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-62c95ca9-904c-45ed-9e2b-334ec7c6478a tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:31.532686 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-62c95ca9-904c-45ed-9e2b-334ec7c6478a tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] HTTP exception thrown: Instance 670021c1-045f-40b1-9358-c589d32e9904 could not be found. Oct 26 13:08:31.534824 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-62c95ca9-904c-45ed-9e2b-334ec7c6478a tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Request method failure captured: Oct 26 13:08:31.534824 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 HTTP/1.1 Oct 26 13:08:31.534824 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:08:31.534824 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:08:31.534824 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:08:31.534824 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:08:31.534824 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:08:31.534824 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:08:31.534824 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:08:31.534824 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:08:31.534824 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTCi7-4ZJs-l3nyp7w3yWqj5xyBsFDp7ThFrSK2u004qA51FnO6UwBoBJnzDHnk4FNtYFd25TcBD3Pcko3EMO8wceOHAC6_Qkb2QLB9Fq_CC6QhjLHIiNtJmw_5kv4z1i-RC7jIpndCE0i2m-M3AXbb2FJh8hxcDElyLHaM3j-vW_Es Oct 26 13:08:31.534824 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:08:31.534824 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:08:31.534824 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:08:31.534824 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:08:31.534824 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:08:31.534824 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:08:31.534824 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 2f5434aa488d4d5a8bae96746cfd7494 Oct 26 13:08:31.534824 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersAdminTestJSON-295038141 Oct 26 13:08:31.534824 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:08:31.534824 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:08:31.537135 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2f5434aa488d4d5a8bae96746cfd7494"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2f5434aa488d4d5a8bae96746cfd7494"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2f5434aa488d4d5a8bae96746cfd7494"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2f5434aa488d4d5a8bae96746cfd7494"}]}] Oct 26 13:08:31.537135 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersAdminTestJSON-295038141 Oct 26 13:08:31.537135 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 2f5434aa488d4d5a8bae96746cfd7494 Oct 26 13:08:31.537135 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersAdminTestJSON-295038141 Oct 26 13:08:31.537135 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersAdminTestJSON-295038141-project Oct 26 13:08:31.537135 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:08:31.537135 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:08:31.537135 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: de8d47754d3f4d2c844dea032bdb0095 Oct 26 13:08:31.537135 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersAdminTestJSON-295038141-project Oct 26 13:08:31.537135 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:08:31.537135 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 670021c1-045f-40b1-9358-c589d32e9904 could not be found. Oct 26 13:08:31.537135 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '670021c1-045f-40b1-9358-c589d32e9904'} Oct 26 13:08:31.539501 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:08:31.539501 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:31.539501 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:08:31.539501 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:08:31.539501 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:08:31.539501 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:08:31.539501 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:08:31.539501 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:08:31.539501 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:08:31.539501 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:08:31.539501 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 670021c1-045f-40b1-9358-c589d32e9904 could not be found. Oct 26 13:08:31.539501 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:08:31.539501 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:31.539501 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:08:31.539501 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:31.539501 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:08:31.539501 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:08:31.539501 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:08:31.539501 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:08:31.539501 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:08:31.543767 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:08:31.543767 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:08:31.543767 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:08:31.543767 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:08:31.543767 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:08:31.543767 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:08:31.543767 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:08:31.543767 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 670021c1-045f-40b1-9358-c589d32e9904 could not be found. Oct 26 13:08:31.543767 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:08:31.543767 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:31.543767 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:08:31.543767 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:31.543767 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:08:31.543767 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:08:31.543767 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:08:31.543767 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:08:31.543767 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 670021c1-045f-40b1-9358-c589d32e9904 could not be found. Oct 26 13:08:31.543767 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:08:31.546104 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-62c95ca9-904c-45ed-9e2b-334ec7c6478a tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] Returning 404 to user: Instance 670021c1-045f-40b1-9358-c589d32e9904 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:08:31.546104 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-62c95ca9-904c-45ed-9e2b-334ec7c6478a tempest-ServersAdminTestJSON-295038141 tempest-ServersAdminTestJSON-295038141-project] 10.222.0.40 "GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904" status: 404 len: 111 microversion: 2.1 time: 0.045737 Oct 26 13:08:31.546104 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 880/1688] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:31 2022] GET /compute/v2.1/servers/670021c1-045f-40b1-9358-c589d32e9904 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:08:31.960872 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-eb54f39b-4f9a-4e83-b33d-0530abbca6be tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:31.962224 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-eb54f39b-4f9a-4e83-b33d-0530abbca6be tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:31.971357 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb54f39b-4f9a-4e83-b33d-0530abbca6be tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:31.972475 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb54f39b-4f9a-4e83-b33d-0530abbca6be tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:31.973153 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb54f39b-4f9a-4e83-b33d-0530abbca6be tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:31.975196 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb54f39b-4f9a-4e83-b33d-0530abbca6be tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:31.988879 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb54f39b-4f9a-4e83-b33d-0530abbca6be tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:31.991919 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb54f39b-4f9a-4e83-b33d-0530abbca6be tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:32.299301 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-eb54f39b-4f9a-4e83-b33d-0530abbca6be tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:32.311255 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-eb54f39b-4f9a-4e83-b33d-0530abbca6be tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:32.313927 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-eb54f39b-4f9a-4e83-b33d-0530abbca6be tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:32.315579 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-eb54f39b-4f9a-4e83-b33d-0530abbca6be tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 200 len: 1281 microversion: 2.25 time: 0.776633 Oct 26 13:08:32.338510 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 881/1689] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:08:31 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 1281 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:08:32.350540 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1dbe0c2b-3686-4cd4-9d88-d4ed3f23b3dd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:32.351481 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1dbe0c2b-3686-4cd4-9d88-d4ed3f23b3dd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 7da4bb85-b577-4608-a7c0-3320721cb997] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:32.357788 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1dbe0c2b-3686-4cd4-9d88-d4ed3f23b3dd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:32.359039 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1dbe0c2b-3686-4cd4-9d88-d4ed3f23b3dd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:32.359699 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1dbe0c2b-3686-4cd4-9d88-d4ed3f23b3dd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:32.360586 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1dbe0c2b-3686-4cd4-9d88-d4ed3f23b3dd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:32.361214 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1dbe0c2b-3686-4cd4-9d88-d4ed3f23b3dd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:32.361888 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1dbe0c2b-3686-4cd4-9d88-d4ed3f23b3dd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:32.381330 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-1dbe0c2b-3686-4cd4-9d88-d4ed3f23b3dd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] HTTP exception thrown: Instance 7da4bb85-b577-4608-a7c0-3320721cb997 could not be found. Oct 26 13:08:32.384213 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1dbe0c2b-3686-4cd4-9d88-d4ed3f23b3dd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Request method failure captured: Oct 26 13:08:32.384213 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997 HTTP/1.1 Oct 26 13:08:32.384213 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:08:32.384213 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:08:32.384213 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:08:32.384213 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:08:32.384213 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:08:32.384213 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:08:32.384213 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:08:32.384213 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:08:32.384213 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWS_3Fw97GVdJXzrizCJxBUgu9J8RJco_kVLmGoVom2EfSBf64V5ikwkoboRMlNwzTzrwppwQPetCMyQDytCjux0xldDodqy3aeyjdjftC1XoGeXvxoPPAFfp6LAn20VCMFMSmFkTZbBojQkiY4AnTk9HKUW_4_BuHyJOhDfsBXlX388 Oct 26 13:08:32.384213 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:08:32.384213 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:08:32.384213 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:08:32.384213 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:08:32.384213 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:08:32.384213 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:08:32.384213 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 443f71d3ffde486b9072df264fea2f53 Oct 26 13:08:32.384213 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-MigrationsAdminTest-2041762941 Oct 26 13:08:32.384213 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:08:32.384213 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:08:32.386001 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/443f71d3ffde486b9072df264fea2f53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/443f71d3ffde486b9072df264fea2f53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_443f71d3ffde486b9072df264fea2f53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/443f71d3ffde486b9072df264fea2f53"}]}] Oct 26 13:08:32.386001 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-MigrationsAdminTest-2041762941 Oct 26 13:08:32.386001 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 443f71d3ffde486b9072df264fea2f53 Oct 26 13:08:32.386001 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-MigrationsAdminTest-2041762941 Oct 26 13:08:32.386001 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-MigrationsAdminTest-2041762941-project Oct 26 13:08:32.386001 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:08:32.386001 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:08:32.386001 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 03335593029b48dfb19fc9cdf6b382b0 Oct 26 13:08:32.386001 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-MigrationsAdminTest-2041762941-project Oct 26 13:08:32.386001 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:08:32.386001 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 7da4bb85-b577-4608-a7c0-3320721cb997 could not be found. Oct 26 13:08:32.386001 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '7da4bb85-b577-4608-a7c0-3320721cb997'} Oct 26 13:08:32.386971 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:08:32.386971 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:32.386971 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:08:32.386971 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:08:32.386971 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:08:32.386971 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:08:32.386971 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:08:32.386971 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:08:32.386971 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:08:32.386971 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:08:32.386971 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7da4bb85-b577-4608-a7c0-3320721cb997 could not be found. Oct 26 13:08:32.386971 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:08:32.386971 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:32.386971 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:08:32.386971 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:32.386971 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:08:32.386971 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:08:32.386971 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:08:32.386971 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:08:32.386971 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:08:32.388648 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:08:32.388648 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:08:32.388648 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:08:32.388648 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:08:32.388648 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:08:32.388648 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:08:32.388648 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:08:32.388648 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7da4bb85-b577-4608-a7c0-3320721cb997 could not be found. Oct 26 13:08:32.388648 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:08:32.388648 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:32.388648 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:08:32.388648 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:32.388648 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:08:32.388648 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:08:32.388648 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:08:32.388648 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:08:32.388648 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7da4bb85-b577-4608-a7c0-3320721cb997 could not be found. Oct 26 13:08:32.388648 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:08:32.391302 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1dbe0c2b-3686-4cd4-9d88-d4ed3f23b3dd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Returning 404 to user: Instance 7da4bb85-b577-4608-a7c0-3320721cb997 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:08:32.392587 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1dbe0c2b-3686-4cd4-9d88-d4ed3f23b3dd tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997" status: 404 len: 111 microversion: 2.1 time: 0.052490 Oct 26 13:08:32.394542 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 882/1690] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:32 2022] GET /compute/v2.1/servers/7da4bb85-b577-4608-a7c0-3320721cb997 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:08:32.400135 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-045746f3-1beb-4a75-bb8a-66ef902d0c32 req-9a1685b1-043a-4769-938f-12062b585496 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7da4bb85-b577-4608-a7c0-3320721cb997", "name": "network-vif-deleted", "tag": "612e62d8-c0dd-48c8-889d-f05c9055db41"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:08:32.412490 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-045746f3-1beb-4a75-bb8a-66ef902d0c32 req-9a1685b1-043a-4769-938f-12062b585496 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:32.413442 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-045746f3-1beb-4a75-bb8a-66ef902d0c32 req-9a1685b1-043a-4769-938f-12062b585496 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:32.415465 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-045746f3-1beb-4a75-bb8a-66ef902d0c32 req-9a1685b1-043a-4769-938f-12062b585496 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:32.430557 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-045746f3-1beb-4a75-bb8a-66ef902d0c32 req-9a1685b1-043a-4769-938f-12062b585496 service nova] Creating event network-vif-deleted:612e62d8-c0dd-48c8-889d-f05c9055db41 for instance 7da4bb85-b577-4608-a7c0-3320721cb997 on n-h2-862686-1 Oct 26 13:08:32.437732 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-045746f3-1beb-4a75-bb8a-66ef902d0c32 req-9a1685b1-043a-4769-938f-12062b585496 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041697 Oct 26 13:08:32.439337 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 883/1691] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:08:32.447813 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-461c5cab-165a-4a4e-891d-9e2a8e3e143b req-e597f98f-9156-486c-8458-e4a8b83193b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d92c502-ca44-4fb9-b1ac-6dd4dff929ab", "name": "network-vif-plugged", "status": "completed", "tag": "cb20d675-ee5b-4fc8-8681-99b8c7998830"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:08:32.459034 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-461c5cab-165a-4a4e-891d-9e2a8e3e143b req-e597f98f-9156-486c-8458-e4a8b83193b6 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:32.459915 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-461c5cab-165a-4a4e-891d-9e2a8e3e143b req-e597f98f-9156-486c-8458-e4a8b83193b6 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:32.460598 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-461c5cab-165a-4a4e-891d-9e2a8e3e143b req-e597f98f-9156-486c-8458-e4a8b83193b6 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:32.492765 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-461c5cab-165a-4a4e-891d-9e2a8e3e143b req-e597f98f-9156-486c-8458-e4a8b83193b6 service nova] Creating event network-vif-plugged:cb20d675-ee5b-4fc8-8681-99b8c7998830 for instance 8d92c502-ca44-4fb9-b1ac-6dd4dff929ab on n-h2-862686-1 Oct 26 13:08:32.500938 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-461c5cab-165a-4a4e-891d-9e2a8e3e143b req-e597f98f-9156-486c-8458-e4a8b83193b6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059424 Oct 26 13:08:32.502529 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 884/1692] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:08:32.510882 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3a0918cc-b709-4f7e-88c3-d22fa9a86794 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f6731f544c0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:32.584729 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3a0918cc-b709-4f7e-88c3-d22fa9a86794 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/7d91cde1-e33e-4251-b5c9-7baac06f15a0" status: 200 len: 1412 microversion: 2.1 time: 0.078926 Oct 26 13:08:32.587262 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 885/1693] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:08:32 2022] GET /compute/v2.1/images/7d91cde1-e33e-4251-b5c9-7baac06f15a0 => generated 1412 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:32.600277 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-67f41a2a-8c2e-4325-9f79-a32ce0e05940 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:32.602757 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-67f41a2a-8c2e-4325-9f79-a32ce0e05940 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 8d92c502-ca44-4fb9-b1ac-6dd4dff929ab] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:32.612410 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-67f41a2a-8c2e-4325-9f79-a32ce0e05940 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:32.613938 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-67f41a2a-8c2e-4325-9f79-a32ce0e05940 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:32.614828 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-67f41a2a-8c2e-4325-9f79-a32ce0e05940 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:32.616069 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-67f41a2a-8c2e-4325-9f79-a32ce0e05940 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:32.616943 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-67f41a2a-8c2e-4325-9f79-a32ce0e05940 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:32.617898 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-67f41a2a-8c2e-4325-9f79-a32ce0e05940 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:32.934857 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-67f41a2a-8c2e-4325-9f79-a32ce0e05940 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:32.948928 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-67f41a2a-8c2e-4325-9f79-a32ce0e05940 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/8d92c502-ca44-4fb9-b1ac-6dd4dff929ab" status: 200 len: 1325 microversion: 2.1 time: 0.360200 Oct 26 13:08:32.949894 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 886/1694] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:32 2022] GET /compute/v2.1/servers/8d92c502-ca44-4fb9-b1ac-6dd4dff929ab => generated 1325 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:32.954896 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2ad1eec8-7fa4-4725-943a-685876d67b6e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:32.960888 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2ad1eec8-7fa4-4725-943a-685876d67b6e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:32.975603 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ad1eec8-7fa4-4725-943a-685876d67b6e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:32.976137 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ad1eec8-7fa4-4725-943a-685876d67b6e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:32.976597 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ad1eec8-7fa4-4725-943a-685876d67b6e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:33.026679 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ad1eec8-7fa4-4725-943a-685876d67b6e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:33.027698 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ad1eec8-7fa4-4725-943a-685876d67b6e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.049s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:33.032822 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ad1eec8-7fa4-4725-943a-685876d67b6e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:33.144971 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2ad1eec8-7fa4-4725-943a-685876d67b6e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:08:33.277386 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2ad1eec8-7fa4-4725-943a-685876d67b6e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 204 len: 0 microversion: 2.1 time: 0.325865 Oct 26 13:08:33.278027 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 887/1695] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:08:32 2022] DELETE /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:08:33.285225 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f0053806-f1a6-44c4-a77b-acf480b53ffa tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:33.285225 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f0053806-f1a6-44c4-a77b-acf480b53ffa tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] [instance: 523459ad-2398-43e2-b03b-3dc16c7214cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:33.291623 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0053806-f1a6-44c4-a77b-acf480b53ffa tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:33.292122 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0053806-f1a6-44c4-a77b-acf480b53ffa tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:33.292555 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0053806-f1a6-44c4-a77b-acf480b53ffa tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:33.293260 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0053806-f1a6-44c4-a77b-acf480b53ffa tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:33.293754 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0053806-f1a6-44c4-a77b-acf480b53ffa tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:33.294173 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0053806-f1a6-44c4-a77b-acf480b53ffa tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:33.566765 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f0053806-f1a6-44c4-a77b-acf480b53ffa tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7849545fe2042618da2cd47f4a2b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075b65181daf492da145b2e815809d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:33.576175 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f0053806-f1a6-44c4-a77b-acf480b53ffa tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] 10.222.0.40 "GET /compute/v2.1/servers/523459ad-2398-43e2-b03b-3dc16c7214cb" status: 200 len: 1589 microversion: 2.1 time: 0.296582 Oct 26 13:08:33.590280 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 888/1696] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:33 2022] GET /compute/v2.1/servers/523459ad-2398-43e2-b03b-3dc16c7214cb => generated 1589 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:33.601310 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8a955fcc-99d6-43d5-8adb-c3d1e98a0ffb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:33.602065 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8a955fcc-99d6-43d5-8adb-c3d1e98a0ffb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:33.608530 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8a955fcc-99d6-43d5-8adb-c3d1e98a0ffb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:33.609374 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8a955fcc-99d6-43d5-8adb-c3d1e98a0ffb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:33.609374 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8a955fcc-99d6-43d5-8adb-c3d1e98a0ffb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:33.610625 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8a955fcc-99d6-43d5-8adb-c3d1e98a0ffb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:33.611093 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8a955fcc-99d6-43d5-8adb-c3d1e98a0ffb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:33.611525 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8a955fcc-99d6-43d5-8adb-c3d1e98a0ffb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:33.850736 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8a955fcc-99d6-43d5-8adb-c3d1e98a0ffb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:33.867036 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8a955fcc-99d6-43d5-8adb-c3d1e98a0ffb tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1467 microversion: 2.1 time: 0.275579 Oct 26 13:08:33.887887 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 889/1697] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:33 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1467 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:33.887887 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-db64b1d2-7041-44ca-824b-eb79b62f61e0 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:33.887887 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-db64b1d2-7041-44ca-824b-eb79b62f61e0 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:33.888809 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db64b1d2-7041-44ca-824b-eb79b62f61e0 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:33.900881 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db64b1d2-7041-44ca-824b-eb79b62f61e0 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:33.905795 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db64b1d2-7041-44ca-824b-eb79b62f61e0 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:33.906926 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db64b1d2-7041-44ca-824b-eb79b62f61e0 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:33.924903 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db64b1d2-7041-44ca-824b-eb79b62f61e0 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:33.925473 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db64b1d2-7041-44ca-824b-eb79b62f61e0 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:34.257072 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-db64b1d2-7041-44ca-824b-eb79b62f61e0 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:34.277594 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-db64b1d2-7041-44ca-824b-eb79b62f61e0 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:34.280486 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-db64b1d2-7041-44ca-824b-eb79b62f61e0 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:34.286902 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-db64b1d2-7041-44ca-824b-eb79b62f61e0 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 200 len: 1281 microversion: 2.25 time: 0.417169 Oct 26 13:08:34.287982 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 890/1698] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:08:33 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 1281 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:08:34.310490 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-beb6d3e9-6adf-48a9-93b5-95cc108a258c tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f6731f54c10>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:34.420921 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-beb6d3e9-6adf-48a9-93b5-95cc108a258c tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/7d91cde1-e33e-4251-b5c9-7baac06f15a0" status: 200 len: 1412 microversion: 2.1 time: 0.131409 Oct 26 13:08:34.422184 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 891/1699] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:08:34 2022] GET /compute/v2.1/images/7d91cde1-e33e-4251-b5c9-7baac06f15a0 => generated 1412 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:34.430189 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a3648712-4c9d-486c-80d2-5f6a843c61b5 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:34.434544 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a3648712-4c9d-486c-80d2-5f6a843c61b5 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] [instance: 523459ad-2398-43e2-b03b-3dc16c7214cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:34.469518 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a3648712-4c9d-486c-80d2-5f6a843c61b5 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:34.471652 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a3648712-4c9d-486c-80d2-5f6a843c61b5 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:34.473871 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a3648712-4c9d-486c-80d2-5f6a843c61b5 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:34.476819 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a3648712-4c9d-486c-80d2-5f6a843c61b5 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:34.477719 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a3648712-4c9d-486c-80d2-5f6a843c61b5 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:34.481157 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a3648712-4c9d-486c-80d2-5f6a843c61b5 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:34.612688 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a3648712-4c9d-486c-80d2-5f6a843c61b5 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] 10.222.0.40 "GET /compute/v2.1/servers/523459ad-2398-43e2-b03b-3dc16c7214cb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.189214 Oct 26 13:08:34.613474 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 892/1700] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 26 13:08:34 2022] GET /compute/v2.1/servers/523459ad-2398-43e2-b03b-3dc16c7214cb/os-interface => generated 284 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:08:34.621042 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8e31c1b2-dedc-4912-9a84-1a4cbd32720b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:34.622583 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8e31c1b2-dedc-4912-9a84-1a4cbd32720b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 8d92c502-ca44-4fb9-b1ac-6dd4dff929ab] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:34.647901 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e31c1b2-dedc-4912-9a84-1a4cbd32720b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:34.651200 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e31c1b2-dedc-4912-9a84-1a4cbd32720b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:34.656605 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e31c1b2-dedc-4912-9a84-1a4cbd32720b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:34.657994 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e31c1b2-dedc-4912-9a84-1a4cbd32720b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:34.662675 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e31c1b2-dedc-4912-9a84-1a4cbd32720b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:34.663399 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e31c1b2-dedc-4912-9a84-1a4cbd32720b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:35.158597 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8e31c1b2-dedc-4912-9a84-1a4cbd32720b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:35.168359 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8e31c1b2-dedc-4912-9a84-1a4cbd32720b tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/8d92c502-ca44-4fb9-b1ac-6dd4dff929ab" status: 200 len: 1325 microversion: 2.1 time: 0.553652 Oct 26 13:08:35.174045 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 893/1701] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:34 2022] GET /compute/v2.1/servers/8d92c502-ca44-4fb9-b1ac-6dd4dff929ab => generated 1325 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:35.180406 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9fb38e2c-81c8-49de-84de-a5b67711b34e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:35.183183 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9fb38e2c-81c8-49de-84de-a5b67711b34e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:35.198824 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9fb38e2c-81c8-49de-84de-a5b67711b34e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:35.199359 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9fb38e2c-81c8-49de-84de-a5b67711b34e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:35.199806 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9fb38e2c-81c8-49de-84de-a5b67711b34e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:35.203029 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9fb38e2c-81c8-49de-84de-a5b67711b34e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:35.205229 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9fb38e2c-81c8-49de-84de-a5b67711b34e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:35.205904 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9fb38e2c-81c8-49de-84de-a5b67711b34e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:35.862878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9fb38e2c-81c8-49de-84de-a5b67711b34e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:35.872180 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9fb38e2c-81c8-49de-84de-a5b67711b34e tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1467 microversion: 2.1 time: 0.696814 Oct 26 13:08:35.874384 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 894/1702] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:35 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1467 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:35.892413 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c39ba72d-971b-413c-9603-0b708e639fdb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:35.897279 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c39ba72d-971b-413c-9603-0b708e639fdb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:35.923893 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c39ba72d-971b-413c-9603-0b708e639fdb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:35.924412 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c39ba72d-971b-413c-9603-0b708e639fdb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:35.924855 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c39ba72d-971b-413c-9603-0b708e639fdb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:35.925617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c39ba72d-971b-413c-9603-0b708e639fdb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:35.926069 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c39ba72d-971b-413c-9603-0b708e639fdb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:35.928061 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c39ba72d-971b-413c-9603-0b708e639fdb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:36.319708 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c39ba72d-971b-413c-9603-0b708e639fdb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:36.331242 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c39ba72d-971b-413c-9603-0b708e639fdb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:36.333300 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c39ba72d-971b-413c-9603-0b708e639fdb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:36.334829 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c39ba72d-971b-413c-9603-0b708e639fdb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 200 len: 1281 microversion: 2.25 time: 0.456387 Oct 26 13:08:36.335756 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 895/1703] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:08:35 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 1281 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:08:36.341123 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c93bff8f-dd6a-4a32-bfdd-14b51e42d3e5 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f6736980b80>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:36.394252 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cc868803-b2d2-4087-b933-711650a3b964 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.258090 Oct 26 13:08:36.403933 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 809/1704] 10.222.0.40 () {60 vars in 1170 bytes} [Wed Oct 26 13:08:31 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:08:36.403933 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0c793a68-8577-4345-8620-0b35c060d2d3 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:36.405439 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0c793a68-8577-4345-8620-0b35c060d2d3 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 8d92c502-ca44-4fb9-b1ac-6dd4dff929ab] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:36.417900 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c93bff8f-dd6a-4a32-bfdd-14b51e42d3e5 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/7d91cde1-e33e-4251-b5c9-7baac06f15a0" status: 200 len: 1412 microversion: 2.1 time: 0.080605 Oct 26 13:08:36.419376 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 896/1705] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:08:36 2022] GET /compute/v2.1/images/7d91cde1-e33e-4251-b5c9-7baac06f15a0 => generated 1412 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:36.424830 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-86cb069d-4f60-4854-9aeb-cfe5ae5f904a tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.208"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:08:36.428584 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-86cb069d-4f60-4854-9aeb-cfe5ae5f904a tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] [instance: cdca1d32-5d8f-44da-9c3b-c8d11433df06] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:36.439936 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c793a68-8577-4345-8620-0b35c060d2d3 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:36.442162 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c793a68-8577-4345-8620-0b35c060d2d3 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:36.444344 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c793a68-8577-4345-8620-0b35c060d2d3 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:36.447480 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c793a68-8577-4345-8620-0b35c060d2d3 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:36.450540 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c793a68-8577-4345-8620-0b35c060d2d3 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:36.451784 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-86cb069d-4f60-4854-9aeb-cfe5ae5f904a tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:36.453560 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c793a68-8577-4345-8620-0b35c060d2d3 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:36.455353 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-86cb069d-4f60-4854-9aeb-cfe5ae5f904a tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:36.457433 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-86cb069d-4f60-4854-9aeb-cfe5ae5f904a tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:36.461250 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-86cb069d-4f60-4854-9aeb-cfe5ae5f904a tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:36.462390 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-86cb069d-4f60-4854-9aeb-cfe5ae5f904a tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:36.465144 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-86cb069d-4f60-4854-9aeb-cfe5ae5f904a tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:36.538467 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-86cb069d-4f60-4854-9aeb-cfe5ae5f904a tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "refresh_cache-cdca1d32-5d8f-44da-9c3b-c8d11433df06" {{(pid=120598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 26 13:08:36.539465 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-86cb069d-4f60-4854-9aeb-cfe5ae5f904a tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquired lock "refresh_cache-cdca1d32-5d8f-44da-9c3b-c8d11433df06" {{(pid=120598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 26 13:08:36.813585 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0c793a68-8577-4345-8620-0b35c060d2d3 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:36.822921 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0c793a68-8577-4345-8620-0b35c060d2d3 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/8d92c502-ca44-4fb9-b1ac-6dd4dff929ab" status: 200 len: 1521 microversion: 2.1 time: 0.425132 Oct 26 13:08:36.830585 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 810/1706] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:36 2022] GET /compute/v2.1/servers/8d92c502-ca44-4fb9-b1ac-6dd4dff929ab => generated 1521 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:36.867896 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d12bf6c6-ebea-4040-801b-6840d7348b99 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:36.868714 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d12bf6c6-ebea-4040-801b-6840d7348b99 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 8d92c502-ca44-4fb9-b1ac-6dd4dff929ab] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:36.884210 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d12bf6c6-ebea-4040-801b-6840d7348b99 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:36.885081 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d12bf6c6-ebea-4040-801b-6840d7348b99 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:36.885804 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d12bf6c6-ebea-4040-801b-6840d7348b99 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:36.886746 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d12bf6c6-ebea-4040-801b-6840d7348b99 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:36.887710 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d12bf6c6-ebea-4040-801b-6840d7348b99 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:36.888474 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d12bf6c6-ebea-4040-801b-6840d7348b99 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:36.921247 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d12bf6c6-ebea-4040-801b-6840d7348b99 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 8d92c502-ca44-4fb9-b1ac-6dd4dff929ab] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:08:36.925034 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:08:37.082378 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d12bf6c6-ebea-4040-801b-6840d7348b99 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8d92c502-ca44-4fb9-b1ac-6dd4dff929ab" status: 204 len: 0 microversion: 2.1 time: 0.224411 Oct 26 13:08:37.086926 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 811/1707] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:08:36 2022] DELETE /compute/v2.1/servers/8d92c502-ca44-4fb9-b1ac-6dd4dff929ab => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:08:37.105146 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3a535161-59af-404b-8ffe-55bcb55786aa tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:37.106459 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3a535161-59af-404b-8ffe-55bcb55786aa tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:37.121892 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a535161-59af-404b-8ffe-55bcb55786aa tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:37.124679 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a535161-59af-404b-8ffe-55bcb55786aa tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:37.125925 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a535161-59af-404b-8ffe-55bcb55786aa tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:37.130278 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a535161-59af-404b-8ffe-55bcb55786aa tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:37.130950 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a535161-59af-404b-8ffe-55bcb55786aa tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:37.131622 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a535161-59af-404b-8ffe-55bcb55786aa tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:37.251766 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3a535161-59af-404b-8ffe-55bcb55786aa tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:37.262950 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3a535161-59af-404b-8ffe-55bcb55786aa tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1425 microversion: 2.1 time: 0.173997 Oct 26 13:08:37.264105 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 812/1708] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:37 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1425 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:37.269822 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7b018de2-95da-47e1-95ba-566289cb40a2 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:37.271385 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7b018de2-95da-47e1-95ba-566289cb40a2 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 8d92c502-ca44-4fb9-b1ac-6dd4dff929ab] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:37.284409 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b018de2-95da-47e1-95ba-566289cb40a2 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:37.284916 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b018de2-95da-47e1-95ba-566289cb40a2 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:37.285682 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b018de2-95da-47e1-95ba-566289cb40a2 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:37.287287 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b018de2-95da-47e1-95ba-566289cb40a2 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:37.287915 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b018de2-95da-47e1-95ba-566289cb40a2 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:37.288350 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b018de2-95da-47e1-95ba-566289cb40a2 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:37.763491 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7b018de2-95da-47e1-95ba-566289cb40a2 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:37.775727 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7b018de2-95da-47e1-95ba-566289cb40a2 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/8d92c502-ca44-4fb9-b1ac-6dd4dff929ab" status: 200 len: 1527 microversion: 2.1 time: 0.510000 Oct 26 13:08:37.780643 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 813/1709] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:37 2022] GET /compute/v2.1/servers/8d92c502-ca44-4fb9-b1ac-6dd4dff929ab => generated 1527 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:37.792564 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-4521fea4-8182-4bcc-9236-794bad939804 req-6f61357d-afd5-40d1-b074-7e5342de3b7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c858b29-db9e-4d65-af6d-86b6e1d36c45", "name": "network-vif-deleted", "tag": "fbefc9ba-9ae6-4d00-93d2-059d7c60c35f"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:08:37.820360 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-4521fea4-8182-4bcc-9236-794bad939804 req-6f61357d-afd5-40d1-b074-7e5342de3b7d service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:37.821769 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-4521fea4-8182-4bcc-9236-794bad939804 req-6f61357d-afd5-40d1-b074-7e5342de3b7d service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:37.822419 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-4521fea4-8182-4bcc-9236-794bad939804 req-6f61357d-afd5-40d1-b074-7e5342de3b7d service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:37.841320 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-4521fea4-8182-4bcc-9236-794bad939804 req-6f61357d-afd5-40d1-b074-7e5342de3b7d service nova] Creating event network-vif-deleted:fbefc9ba-9ae6-4d00-93d2-059d7c60c35f for instance 3c858b29-db9e-4d65-af6d-86b6e1d36c45 on n-h2-862686-1 Oct 26 13:08:37.847059 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-4521fea4-8182-4bcc-9236-794bad939804 req-6f61357d-afd5-40d1-b074-7e5342de3b7d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063280 Oct 26 13:08:37.848307 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 814/1710] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:08:37.855774 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bce95dda-edd2-4ef6-9605-c5f244a09fbf tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:37.856759 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bce95dda-edd2-4ef6-9605-c5f244a09fbf tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:37.863896 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bce95dda-edd2-4ef6-9605-c5f244a09fbf tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:37.864704 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bce95dda-edd2-4ef6-9605-c5f244a09fbf tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:37.865555 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bce95dda-edd2-4ef6-9605-c5f244a09fbf tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:37.866456 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bce95dda-edd2-4ef6-9605-c5f244a09fbf tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:37.867079 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bce95dda-edd2-4ef6-9605-c5f244a09fbf tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:37.867677 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bce95dda-edd2-4ef6-9605-c5f244a09fbf tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:38.230226 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bce95dda-edd2-4ef6-9605-c5f244a09fbf tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:38.246787 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bce95dda-edd2-4ef6-9605-c5f244a09fbf tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:38.250976 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bce95dda-edd2-4ef6-9605-c5f244a09fbf tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:38.257464 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bce95dda-edd2-4ef6-9605-c5f244a09fbf tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 200 len: 1281 microversion: 2.25 time: 0.403894 Oct 26 13:08:38.262234 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 815/1711] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:08:37 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 1281 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:08:38.278531 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7408c841-38c4-4819-8eb7-0833d9c32918 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f6732246af0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:38.368459 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7408c841-38c4-4819-8eb7-0833d9c32918 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/7d91cde1-e33e-4251-b5c9-7baac06f15a0" status: 200 len: 1421 microversion: 2.1 time: 0.104762 Oct 26 13:08:38.379386 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 816/1712] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:08:38 2022] GET /compute/v2.1/images/7d91cde1-e33e-4251-b5c9-7baac06f15a0 => generated 1421 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:38.396668 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ff1d4257-e2a7-44cf-89f4-39b5393d04e9 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:38.397770 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ff1d4257-e2a7-44cf-89f4-39b5393d04e9 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] [instance: 523459ad-2398-43e2-b03b-3dc16c7214cb] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:38.417119 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff1d4257-e2a7-44cf-89f4-39b5393d04e9 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:38.417346 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff1d4257-e2a7-44cf-89f4-39b5393d04e9 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:38.417834 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff1d4257-e2a7-44cf-89f4-39b5393d04e9 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:38.423876 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff1d4257-e2a7-44cf-89f4-39b5393d04e9 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:38.424648 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff1d4257-e2a7-44cf-89f4-39b5393d04e9 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:38.424799 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff1d4257-e2a7-44cf-89f4-39b5393d04e9 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:39.163635 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ff1d4257-e2a7-44cf-89f4-39b5393d04e9 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7849545fe2042618da2cd47f4a2b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075b65181daf492da145b2e815809d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:39.175921 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ff1d4257-e2a7-44cf-89f4-39b5393d04e9 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] 10.222.0.40 "GET /compute/v2.1/servers/523459ad-2398-43e2-b03b-3dc16c7214cb" status: 200 len: 1589 microversion: 2.1 time: 0.793463 Oct 26 13:08:39.179612 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 817/1713] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:38 2022] GET /compute/v2.1/servers/523459ad-2398-43e2-b03b-3dc16c7214cb => generated 1589 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:39.195936 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-0f28ed94-7545-44a3-9750-e11d26030837 req-01d1ed72-88a8-4a49-b296-054007066740 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "523459ad-2398-43e2-b03b-3dc16c7214cb", "tag": "ad3bf7f7-f2d9-4b92-a4fd-ba2b441e5413"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:08:39.245369 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-0f28ed94-7545-44a3-9750-e11d26030837 req-01d1ed72-88a8-4a49-b296-054007066740 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:39.246093 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-0f28ed94-7545-44a3-9750-e11d26030837 req-01d1ed72-88a8-4a49-b296-054007066740 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:39.247682 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-0f28ed94-7545-44a3-9750-e11d26030837 req-01d1ed72-88a8-4a49-b296-054007066740 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:39.263535 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-0f28ed94-7545-44a3-9750-e11d26030837 req-01d1ed72-88a8-4a49-b296-054007066740 service nova] Creating event network-changed:ad3bf7f7-f2d9-4b92-a4fd-ba2b441e5413 for instance 523459ad-2398-43e2-b03b-3dc16c7214cb on n-h1-862686-1 Oct 26 13:08:39.287196 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-0f28ed94-7545-44a3-9750-e11d26030837 req-01d1ed72-88a8-4a49-b296-054007066740 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103327 Oct 26 13:08:39.288408 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 818/1714] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:08:39.294209 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-41ed62e4-1232-4440-bfd9-72ac0b53c3d0 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:39.296704 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-41ed62e4-1232-4440-bfd9-72ac0b53c3d0 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:39.313173 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41ed62e4-1232-4440-bfd9-72ac0b53c3d0 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:39.314492 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41ed62e4-1232-4440-bfd9-72ac0b53c3d0 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:39.316564 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41ed62e4-1232-4440-bfd9-72ac0b53c3d0 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:39.318063 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41ed62e4-1232-4440-bfd9-72ac0b53c3d0 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:39.322878 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41ed62e4-1232-4440-bfd9-72ac0b53c3d0 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:39.323774 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41ed62e4-1232-4440-bfd9-72ac0b53c3d0 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:39.456476 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41ed62e4-1232-4440-bfd9-72ac0b53c3d0 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:39.456991 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41ed62e4-1232-4440-bfd9-72ac0b53c3d0 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:39.457444 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41ed62e4-1232-4440-bfd9-72ac0b53c3d0 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:39.457933 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-41ed62e4-1232-4440-bfd9-72ac0b53c3d0 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lazy-loading 'fault' on Instance uuid 3c858b29-db9e-4d65-af6d-86b6e1d36c45 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:08:39.620540 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-86cb069d-4f60-4854-9aeb-cfe5ae5f904a tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] [instance: cdca1d32-5d8f-44da-9c3b-c8d11433df06] Building network info cache for instance {{(pid=120598) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 26 13:08:39.639039 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-41ed62e4-1232-4440-bfd9-72ac0b53c3d0 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03335593029b48dfb19fc9cdf6b382b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f71d3ffde486b9072df264fea2f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:39.662604 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-41ed62e4-1232-4440-bfd9-72ac0b53c3d0 tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 200 len: 1302 microversion: 2.1 time: 0.370195 Oct 26 13:08:39.681146 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 819/1715] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:39 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 1302 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:39.691740 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-304dd2ee-f7cf-4742-b07b-2de08d6e5e9e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67322c9700>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:39.778148 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-304dd2ee-f7cf-4742-b07b-2de08d6e5e9e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/7d91cde1-e33e-4251-b5c9-7baac06f15a0" status: 200 len: 1421 microversion: 2.1 time: 0.104716 Oct 26 13:08:39.785435 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 820/1716] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:08:39 2022] GET /compute/v2.1/images/7d91cde1-e33e-4251-b5c9-7baac06f15a0 => generated 1421 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:39.807629 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fac71d8c-787b-4fa4-a1fa-236858ddf1b1 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:39.810391 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fac71d8c-787b-4fa4-a1fa-236858ddf1b1 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 8d92c502-ca44-4fb9-b1ac-6dd4dff929ab] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:39.830906 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fac71d8c-787b-4fa4-a1fa-236858ddf1b1 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:39.832197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fac71d8c-787b-4fa4-a1fa-236858ddf1b1 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:39.835985 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fac71d8c-787b-4fa4-a1fa-236858ddf1b1 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:39.837184 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fac71d8c-787b-4fa4-a1fa-236858ddf1b1 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:39.837859 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fac71d8c-787b-4fa4-a1fa-236858ddf1b1 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:39.840429 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fac71d8c-787b-4fa4-a1fa-236858ddf1b1 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:40.269065 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fac71d8c-787b-4fa4-a1fa-236858ddf1b1 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:40.289808 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fac71d8c-787b-4fa4-a1fa-236858ddf1b1 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/8d92c502-ca44-4fb9-b1ac-6dd4dff929ab" status: 200 len: 1527 microversion: 2.1 time: 0.491109 Oct 26 13:08:40.290860 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 821/1717] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:39 2022] GET /compute/v2.1/servers/8d92c502-ca44-4fb9-b1ac-6dd4dff929ab => generated 1527 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:40.296069 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-2239be36-9358-4f19-b216-c9e30fadb8fc req-ed1d36c5-260b-4b0a-93fe-6198a98cd981 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ce726c3-809c-4662-b794-dcec3f82047c", "name": "network-vif-plugged", "status": "completed", "tag": "2ed4f127-e35d-49ce-a3f0-81fac3604625"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:08:40.314719 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2239be36-9358-4f19-b216-c9e30fadb8fc req-ed1d36c5-260b-4b0a-93fe-6198a98cd981 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:40.315477 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2239be36-9358-4f19-b216-c9e30fadb8fc req-ed1d36c5-260b-4b0a-93fe-6198a98cd981 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:40.321662 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2239be36-9358-4f19-b216-c9e30fadb8fc req-ed1d36c5-260b-4b0a-93fe-6198a98cd981 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:40.343596 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-2239be36-9358-4f19-b216-c9e30fadb8fc req-ed1d36c5-260b-4b0a-93fe-6198a98cd981 service nova] Creating event network-vif-plugged:2ed4f127-e35d-49ce-a3f0-81fac3604625 for instance 3ce726c3-809c-4662-b794-dcec3f82047c on n-h1-862686-1 Oct 26 13:08:40.353007 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-2239be36-9358-4f19-b216-c9e30fadb8fc req-ed1d36c5-260b-4b0a-93fe-6198a98cd981 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060707 Oct 26 13:08:40.353983 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 822/1718] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:08:40.366039 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9514d5b3-271c-4644-8a6a-c6f705487d42 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:40.372422 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9514d5b3-271c-4644-8a6a-c6f705487d42 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:40.379180 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9514d5b3-271c-4644-8a6a-c6f705487d42 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:40.382111 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9514d5b3-271c-4644-8a6a-c6f705487d42 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:40.382769 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9514d5b3-271c-4644-8a6a-c6f705487d42 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:40.393691 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9514d5b3-271c-4644-8a6a-c6f705487d42 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:40.394426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9514d5b3-271c-4644-8a6a-c6f705487d42 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:40.395065 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9514d5b3-271c-4644-8a6a-c6f705487d42 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:41.646802 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-86cb069d-4f60-4854-9aeb-cfe5ae5f904a tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] [instance: cdca1d32-5d8f-44da-9c3b-c8d11433df06] Updating instance_info_cache with network_info: [{"id": "7cca99b7-782b-4cb4-bf7d-e207183f2165", "address": "fa:16:3e:b3:ae:68", "network": {"id": "f3e49ff8-9efe-4bcf-b4e9-6739476549bb", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-727200659-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b86e36a2f7fc44daac11d122c492ba68", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap7cca99b7-78", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120598) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 26 13:08:41.674179 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-86cb069d-4f60-4854-9aeb-cfe5ae5f904a tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Releasing lock "refresh_cache-cdca1d32-5d8f-44da-9c3b-c8d11433df06" {{(pid=120598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 26 13:08:41.676319 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-86cb069d-4f60-4854-9aeb-cfe5ae5f904a tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] 10.222.0.40 "POST /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06/action" status: 202 len: 0 microversion: 2.1 time: 5.255727 Oct 26 13:08:41.679342 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 897/1719] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:08:36 2022] POST /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06/action => generated 0 bytes in 5259 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 26 13:08:41.699979 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8401bf68-8fc7-4420-9d63-a72418dfa0f6 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f6731f54940>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:41.764901 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9514d5b3-271c-4644-8a6a-c6f705487d42 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:41.797856 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9514d5b3-271c-4644-8a6a-c6f705487d42 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:41.812398 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9514d5b3-271c-4644-8a6a-c6f705487d42 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:41.813660 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9514d5b3-271c-4644-8a6a-c6f705487d42 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 200 len: 1281 microversion: 2.25 time: 1.458311 Oct 26 13:08:41.818160 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 823/1720] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:08:40 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 1281 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:08:41.832945 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3560c0a3-e7cb-4348-97f6-9ec6aa116adf tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:41.836524 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3560c0a3-e7cb-4348-97f6-9ec6aa116adf tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] [instance: 3c858b29-db9e-4d65-af6d-86b6e1d36c45] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:41.856451 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3560c0a3-e7cb-4348-97f6-9ec6aa116adf tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:41.857705 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3560c0a3-e7cb-4348-97f6-9ec6aa116adf tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:41.858425 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3560c0a3-e7cb-4348-97f6-9ec6aa116adf tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:41.859383 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3560c0a3-e7cb-4348-97f6-9ec6aa116adf tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:41.860142 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3560c0a3-e7cb-4348-97f6-9ec6aa116adf tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:41.860731 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3560c0a3-e7cb-4348-97f6-9ec6aa116adf tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:41.949129 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-3560c0a3-e7cb-4348-97f6-9ec6aa116adf tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] HTTP exception thrown: Instance 3c858b29-db9e-4d65-af6d-86b6e1d36c45 could not be found. Oct 26 13:08:41.969761 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3560c0a3-e7cb-4348-97f6-9ec6aa116adf tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Request method failure captured: Oct 26 13:08:41.969761 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 HTTP/1.1 Oct 26 13:08:41.969761 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:08:41.969761 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:08:41.969761 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:08:41.969761 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:08:41.969761 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:08:41.969761 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:08:41.969761 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:08:41.969761 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:08:41.969761 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWS_3Fw97GVdJXzrizCJxBUgu9J8RJco_kVLmGoVom2EfSBf64V5ikwkoboRMlNwzTzrwppwQPetCMyQDytCjux0xldDodqy3aeyjdjftC1XoGeXvxoPPAFfp6LAn20VCMFMSmFkTZbBojQkiY4AnTk9HKUW_4_BuHyJOhDfsBXlX388 Oct 26 13:08:41.969761 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:08:41.969761 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:08:41.969761 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:08:41.969761 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:08:41.969761 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:08:41.969761 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:08:41.969761 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 443f71d3ffde486b9072df264fea2f53 Oct 26 13:08:41.969761 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-MigrationsAdminTest-2041762941 Oct 26 13:08:41.969761 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:08:41.969761 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:08:41.971735 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/443f71d3ffde486b9072df264fea2f53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/443f71d3ffde486b9072df264fea2f53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_443f71d3ffde486b9072df264fea2f53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/443f71d3ffde486b9072df264fea2f53"}]}] Oct 26 13:08:41.971735 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-MigrationsAdminTest-2041762941 Oct 26 13:08:41.971735 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 443f71d3ffde486b9072df264fea2f53 Oct 26 13:08:41.971735 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-MigrationsAdminTest-2041762941 Oct 26 13:08:41.971735 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-MigrationsAdminTest-2041762941-project Oct 26 13:08:41.971735 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:08:41.971735 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:08:41.971735 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 03335593029b48dfb19fc9cdf6b382b0 Oct 26 13:08:41.971735 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-MigrationsAdminTest-2041762941-project Oct 26 13:08:41.971735 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:08:41.971735 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 3c858b29-db9e-4d65-af6d-86b6e1d36c45 could not be found. Oct 26 13:08:41.971735 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '3c858b29-db9e-4d65-af6d-86b6e1d36c45'} Oct 26 13:08:41.972856 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:08:41.972856 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:41.972856 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:08:41.972856 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:08:41.972856 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:08:41.972856 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:08:41.972856 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:08:41.972856 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:08:41.972856 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:08:41.972856 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:08:41.972856 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c858b29-db9e-4d65-af6d-86b6e1d36c45 could not be found. Oct 26 13:08:41.972856 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:41.972856 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:41.972856 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:41.972856 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:41.972856 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:08:41.972856 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:08:41.972856 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:08:41.972856 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:08:41.972856 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:08:41.974415 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:08:41.974415 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:08:41.974415 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:08:41.974415 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:08:41.974415 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:08:41.974415 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:08:41.974415 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:08:41.974415 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c858b29-db9e-4d65-af6d-86b6e1d36c45 could not be found. Oct 26 13:08:41.974415 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:41.974415 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:41.974415 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:41.974415 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:41.974415 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:08:41.974415 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:08:41.974415 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:08:41.974415 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:08:41.974415 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c858b29-db9e-4d65-af6d-86b6e1d36c45 could not be found. Oct 26 13:08:41.974415 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:41.975785 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3560c0a3-e7cb-4348-97f6-9ec6aa116adf tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] Returning 404 to user: Instance 3c858b29-db9e-4d65-af6d-86b6e1d36c45 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:08:41.977610 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3560c0a3-e7cb-4348-97f6-9ec6aa116adf tempest-MigrationsAdminTest-2041762941 tempest-MigrationsAdminTest-2041762941-project] 10.222.0.40 "GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45" status: 404 len: 111 microversion: 2.1 time: 0.156170 Oct 26 13:08:41.982818 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 824/1721] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:41 2022] GET /compute/v2.1/servers/3c858b29-db9e-4d65-af6d-86b6e1d36c45 => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:08:41.996059 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-39639ba4-0024-4f5f-ba2d-7f5d84cd3bd5 req-412a4cee-6cc0-414a-8ce6-e96ad1dc7694 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d92c502-ca44-4fb9-b1ac-6dd4dff929ab", "name": "network-vif-deleted", "tag": "cb20d675-ee5b-4fc8-8681-99b8c7998830"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:08:42.019127 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-39639ba4-0024-4f5f-ba2d-7f5d84cd3bd5 req-412a4cee-6cc0-414a-8ce6-e96ad1dc7694 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:42.019956 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-39639ba4-0024-4f5f-ba2d-7f5d84cd3bd5 req-412a4cee-6cc0-414a-8ce6-e96ad1dc7694 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:42.020710 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-39639ba4-0024-4f5f-ba2d-7f5d84cd3bd5 req-412a4cee-6cc0-414a-8ce6-e96ad1dc7694 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:42.066322 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-39639ba4-0024-4f5f-ba2d-7f5d84cd3bd5 req-412a4cee-6cc0-414a-8ce6-e96ad1dc7694 service nova] Creating event network-vif-deleted:cb20d675-ee5b-4fc8-8681-99b8c7998830 for instance 8d92c502-ca44-4fb9-b1ac-6dd4dff929ab on n-h2-862686-1 Oct 26 13:08:42.076941 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-39639ba4-0024-4f5f-ba2d-7f5d84cd3bd5 req-412a4cee-6cc0-414a-8ce6-e96ad1dc7694 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092612 Oct 26 13:08:42.078618 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 825/1722] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:08:42.098133 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-542a17e6-e0c2-410d-8307-cf4e449ceb7e tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:42.100405 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-542a17e6-e0c2-410d-8307-cf4e449ceb7e tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 8d92c502-ca44-4fb9-b1ac-6dd4dff929ab] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:42.107687 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-542a17e6-e0c2-410d-8307-cf4e449ceb7e tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:42.108445 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-542a17e6-e0c2-410d-8307-cf4e449ceb7e tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:42.110156 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-542a17e6-e0c2-410d-8307-cf4e449ceb7e tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:42.115492 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-542a17e6-e0c2-410d-8307-cf4e449ceb7e tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:42.116270 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-542a17e6-e0c2-410d-8307-cf4e449ceb7e tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:42.121405 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-542a17e6-e0c2-410d-8307-cf4e449ceb7e tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:42.338543 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-542a17e6-e0c2-410d-8307-cf4e449ceb7e tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:42.341441 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-542a17e6-e0c2-410d-8307-cf4e449ceb7e tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:42.342295 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-542a17e6-e0c2-410d-8307-cf4e449ceb7e tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:42.344565 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-542a17e6-e0c2-410d-8307-cf4e449ceb7e tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lazy-loading 'fault' on Instance uuid 8d92c502-ca44-4fb9-b1ac-6dd4dff929ab {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:08:42.435049 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-542a17e6-e0c2-410d-8307-cf4e449ceb7e tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d4ea396494628983bde1a97222f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186ac42922a64992aa1973bd854830d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:42.454470 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-542a17e6-e0c2-410d-8307-cf4e449ceb7e tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/8d92c502-ca44-4fb9-b1ac-6dd4dff929ab" status: 200 len: 1315 microversion: 2.1 time: 0.370713 Oct 26 13:08:42.475733 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 826/1723] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:42 2022] GET /compute/v2.1/servers/8d92c502-ca44-4fb9-b1ac-6dd4dff929ab => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:42.488021 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-684cec89-bd07-4e2b-a8bb-4d7de8e7656c req-230e82b6-51f5-4f0a-b395-85cb9721c297 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdca1d32-5d8f-44da-9c3b-c8d11433df06", "tag": "7cca99b7-782b-4cb4-bf7d-e207183f2165"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:08:42.518194 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-684cec89-bd07-4e2b-a8bb-4d7de8e7656c req-230e82b6-51f5-4f0a-b395-85cb9721c297 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:42.523341 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-684cec89-bd07-4e2b-a8bb-4d7de8e7656c req-230e82b6-51f5-4f0a-b395-85cb9721c297 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:42.524037 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-684cec89-bd07-4e2b-a8bb-4d7de8e7656c req-230e82b6-51f5-4f0a-b395-85cb9721c297 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:42.550006 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-684cec89-bd07-4e2b-a8bb-4d7de8e7656c req-230e82b6-51f5-4f0a-b395-85cb9721c297 service nova] Creating event network-changed:7cca99b7-782b-4cb4-bf7d-e207183f2165 for instance cdca1d32-5d8f-44da-9c3b-c8d11433df06 on n-h1-862686-1 Oct 26 13:08:42.565306 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-684cec89-bd07-4e2b-a8bb-4d7de8e7656c req-230e82b6-51f5-4f0a-b395-85cb9721c297 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086341 Oct 26 13:08:42.566509 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 827/1724] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:08:42.584011 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-86e001d0-9ffc-4b1f-a4a0-bbd4f930aca6 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Action: 'create', calling method: .version_select at 0x7f6732262820>, body: {"pool": "41c3ece9-8653-47df-8de8-fa897ccc9072"} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:08:43.311960 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8401bf68-8fc7-4420-9d63-a72418dfa0f6 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "DELETE /compute/v2.1/images/7d91cde1-e33e-4251-b5c9-7baac06f15a0" status: 204 len: 0 microversion: 2.1 time: 1.624927 Oct 26 13:08:43.312658 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 898/1725] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:41 2022] DELETE /compute/v2.1/images/7d91cde1-e33e-4251-b5c9-7baac06f15a0 => generated 0 bytes in 1633 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:08:43.317339 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-285e3a29-1797-4036-987e-3ada9f537297 req-ec777140-e6c1-4533-a2c5-72e2fbae9917 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d426a4f6-fa08-47d2-a583-735600b77f27", "name": "network-vif-unplugged", "status": "completed", "tag": "8734e662-a14c-45ba-b2b3-6b2193b943a0"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:08:43.330354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-285e3a29-1797-4036-987e-3ada9f537297 req-ec777140-e6c1-4533-a2c5-72e2fbae9917 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:43.330833 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-285e3a29-1797-4036-987e-3ada9f537297 req-ec777140-e6c1-4533-a2c5-72e2fbae9917 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:43.331269 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-285e3a29-1797-4036-987e-3ada9f537297 req-ec777140-e6c1-4533-a2c5-72e2fbae9917 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:43.346527 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-285e3a29-1797-4036-987e-3ada9f537297 req-ec777140-e6c1-4533-a2c5-72e2fbae9917 service nova] Creating event network-vif-unplugged:8734e662-a14c-45ba-b2b3-6b2193b943a0 for instance d426a4f6-fa08-47d2-a583-735600b77f27 on n-h2-862686-1 Oct 26 13:08:43.353152 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-285e3a29-1797-4036-987e-3ada9f537297 req-ec777140-e6c1-4533-a2c5-72e2fbae9917 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039401 Oct 26 13:08:43.354223 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 899/1726] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:08:43.361629 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2555005a-24e4-454e-b70f-7039c844b00a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:43.362346 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2555005a-24e4-454e-b70f-7039c844b00a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:43.372571 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2555005a-24e4-454e-b70f-7039c844b00a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:43.373065 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2555005a-24e4-454e-b70f-7039c844b00a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:43.373517 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2555005a-24e4-454e-b70f-7039c844b00a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:43.374245 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2555005a-24e4-454e-b70f-7039c844b00a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:43.375120 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2555005a-24e4-454e-b70f-7039c844b00a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:43.376104 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2555005a-24e4-454e-b70f-7039c844b00a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:43.838398 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2555005a-24e4-454e-b70f-7039c844b00a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:43.844413 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:08:43.877065 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2555005a-24e4-454e-b70f-7039c844b00a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:43.880585 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2555005a-24e4-454e-b70f-7039c844b00a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:43.883413 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2555005a-24e4-454e-b70f-7039c844b00a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 200 len: 1476 microversion: 2.25 time: 0.526907 Oct 26 13:08:43.886874 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 900/1727] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:08:43 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 1476 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:08:43.898779 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-33526e5e-459a-4811-ac3d-1893ca222b97 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:43.899469 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-33526e5e-459a-4811-ac3d-1893ca222b97 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: d426a4f6-fa08-47d2-a583-735600b77f27] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:43.906563 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33526e5e-459a-4811-ac3d-1893ca222b97 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:43.907670 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33526e5e-459a-4811-ac3d-1893ca222b97 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:43.909093 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33526e5e-459a-4811-ac3d-1893ca222b97 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:43.911128 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33526e5e-459a-4811-ac3d-1893ca222b97 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:43.912004 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33526e5e-459a-4811-ac3d-1893ca222b97 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:43.912631 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33526e5e-459a-4811-ac3d-1893ca222b97 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:43.964245 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-33526e5e-459a-4811-ac3d-1893ca222b97 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: d426a4f6-fa08-47d2-a583-735600b77f27] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:08:44.101644 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-33526e5e-459a-4811-ac3d-1893ca222b97 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27" status: 204 len: 0 microversion: 2.1 time: 0.211807 Oct 26 13:08:44.107734 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 901/1728] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:08:43 2022] DELETE /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:08:44.128722 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f40117f9-1c1a-4033-9cee-c694468fdddc tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:44.132838 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f40117f9-1c1a-4033-9cee-c694468fdddc tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 8d92c502-ca44-4fb9-b1ac-6dd4dff929ab] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:44.148449 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f40117f9-1c1a-4033-9cee-c694468fdddc tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:44.152205 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f40117f9-1c1a-4033-9cee-c694468fdddc tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:44.152838 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f40117f9-1c1a-4033-9cee-c694468fdddc tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:44.154396 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f40117f9-1c1a-4033-9cee-c694468fdddc tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:44.157276 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f40117f9-1c1a-4033-9cee-c694468fdddc tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:44.157923 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f40117f9-1c1a-4033-9cee-c694468fdddc tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:44.190704 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-f40117f9-1c1a-4033-9cee-c694468fdddc tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] HTTP exception thrown: Instance 8d92c502-ca44-4fb9-b1ac-6dd4dff929ab could not be found. Oct 26 13:08:44.194942 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f40117f9-1c1a-4033-9cee-c694468fdddc tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Request method failure captured: Oct 26 13:08:44.194942 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/8d92c502-ca44-4fb9-b1ac-6dd4dff929ab HTTP/1.1 Oct 26 13:08:44.194942 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:08:44.194942 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:08:44.194942 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:08:44.194942 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:08:44.194942 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:08:44.194942 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:08:44.194942 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:08:44.194942 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:08:44.194942 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTDWcY4mtHepJlQ55KVJtNHC-FXqIi903yr1J5OC-zbXOMs1LBU3zczKCFgnqIJBIqkvCLTFhaHFSdgfodLtkoXiluiPVf_SkgLznk0TL97DMnsRT29TeJsNzQAsUym5LCo50Ifxk2xlPnZ_QiGEmh7kAsukHuXMaWRZIS-UkeLc5o8 Oct 26 13:08:44.194942 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:08:44.194942 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:08:44.194942 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:08:44.194942 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:08:44.194942 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:08:44.194942 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:08:44.194942 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 186ac42922a64992aa1973bd854830d7 Oct 26 13:08:44.194942 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-778472214 Oct 26 13:08:44.194942 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:08:44.194942 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:08:44.196708 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/186ac42922a64992aa1973bd854830d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/186ac42922a64992aa1973bd854830d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_186ac42922a64992aa1973bd854830d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/186ac42922a64992aa1973bd854830d7"}]}] Oct 26 13:08:44.196708 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-778472214 Oct 26 13:08:44.196708 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 186ac42922a64992aa1973bd854830d7 Oct 26 13:08:44.196708 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-778472214 Oct 26 13:08:44.196708 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ImagesOneServerNegativeTestJSON-778472214-project Oct 26 13:08:44.196708 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:08:44.196708 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:08:44.196708 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 0b8d4ea396494628983bde1a97222f7d Oct 26 13:08:44.196708 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-778472214-project Oct 26 13:08:44.196708 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:08:44.196708 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 8d92c502-ca44-4fb9-b1ac-6dd4dff929ab could not be found. Oct 26 13:08:44.196708 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '8d92c502-ca44-4fb9-b1ac-6dd4dff929ab'} Oct 26 13:08:44.198059 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:08:44.198059 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:44.198059 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:08:44.198059 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:08:44.198059 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:08:44.198059 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:08:44.198059 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:08:44.198059 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:08:44.198059 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:08:44.198059 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:08:44.198059 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d92c502-ca44-4fb9-b1ac-6dd4dff929ab could not be found. Oct 26 13:08:44.198059 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:08:44.198059 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:44.198059 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:08:44.198059 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:44.198059 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:08:44.198059 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:08:44.198059 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:08:44.198059 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:08:44.198059 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:08:44.200222 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:08:44.200222 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:08:44.200222 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:08:44.200222 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:08:44.200222 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:08:44.200222 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:08:44.200222 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:08:44.200222 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d92c502-ca44-4fb9-b1ac-6dd4dff929ab could not be found. Oct 26 13:08:44.200222 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:08:44.200222 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:44.200222 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:08:44.200222 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:44.200222 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:08:44.200222 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:08:44.200222 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:08:44.200222 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:08:44.200222 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d92c502-ca44-4fb9-b1ac-6dd4dff929ab could not be found. Oct 26 13:08:44.200222 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:08:44.203040 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f40117f9-1c1a-4033-9cee-c694468fdddc tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Returning 404 to user: Instance 8d92c502-ca44-4fb9-b1ac-6dd4dff929ab could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:08:44.206300 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f40117f9-1c1a-4033-9cee-c694468fdddc tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/8d92c502-ca44-4fb9-b1ac-6dd4dff929ab" status: 404 len: 111 microversion: 2.1 time: 0.095958 Oct 26 13:08:44.207385 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 902/1729] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:44 2022] GET /compute/v2.1/servers/8d92c502-ca44-4fb9-b1ac-6dd4dff929ab => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:08:44.215543 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ee4c04b8-c8bc-4a4d-858e-b382a9b6f0c9 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:44.216562 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ee4c04b8-c8bc-4a4d-858e-b382a9b6f0c9 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:44.238355 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee4c04b8-c8bc-4a4d-858e-b382a9b6f0c9 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:44.240228 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee4c04b8-c8bc-4a4d-858e-b382a9b6f0c9 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:44.241010 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee4c04b8-c8bc-4a4d-858e-b382a9b6f0c9 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:44.242585 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee4c04b8-c8bc-4a4d-858e-b382a9b6f0c9 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:44.243817 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee4c04b8-c8bc-4a4d-858e-b382a9b6f0c9 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:44.244675 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee4c04b8-c8bc-4a4d-858e-b382a9b6f0c9 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:44.569291 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-ee4c04b8-c8bc-4a4d-858e-b382a9b6f0c9 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lazy-loading 'services' on Instance uuid 3ce726c3-809c-4662-b794-dcec3f82047c {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:08:44.604482 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ee4c04b8-c8bc-4a4d-858e-b382a9b6f0c9 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 200 len: 1969 microversion: 2.25 time: 0.394966 Oct 26 13:08:44.609375 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 903/1730] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:08:44 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 1969 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:08:44.620099 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-25c01cf2-8e3a-4abd-9cf6-470d02a90096 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '.version_select at 0x7f6731f928b0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:44.719297 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-25c01cf2-8e3a-4abd-9cf6-470d02a90096 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] HTTP exception thrown: Image not found. Oct 26 13:08:44.723637 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-25c01cf2-8e3a-4abd-9cf6-470d02a90096 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Request method failure captured: Oct 26 13:08:44.723637 n-d-862686-1 devstack@n-api.service[120598]: request: DELETE /compute/v2.1/images/eacaed20-a0d3-41a3-bf4a-9efc8868bd0e HTTP/1.1 Oct 26 13:08:44.723637 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:08:44.723637 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:08:44.723637 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:08:44.723637 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:08:44.723637 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:08:44.723637 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:08:44.723637 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:08:44.723637 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:08:44.723637 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTDWcY4mtHepJlQ55KVJtNHC-FXqIi903yr1J5OC-zbXOMs1LBU3zczKCFgnqIJBIqkvCLTFhaHFSdgfodLtkoXiluiPVf_SkgLznk0TL97DMnsRT29TeJsNzQAsUym5LCo50Ifxk2xlPnZ_QiGEmh7kAsukHuXMaWRZIS-UkeLc5o8 Oct 26 13:08:44.723637 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:08:44.723637 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:08:44.723637 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:08:44.723637 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:08:44.723637 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:08:44.723637 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:08:44.723637 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 186ac42922a64992aa1973bd854830d7 Oct 26 13:08:44.723637 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-778472214 Oct 26 13:08:44.723637 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:08:44.723637 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:08:44.725884 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/186ac42922a64992aa1973bd854830d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/186ac42922a64992aa1973bd854830d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_186ac42922a64992aa1973bd854830d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/186ac42922a64992aa1973bd854830d7"}]}] Oct 26 13:08:44.725884 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-778472214 Oct 26 13:08:44.725884 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 186ac42922a64992aa1973bd854830d7 Oct 26 13:08:44.725884 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-778472214 Oct 26 13:08:44.725884 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ImagesOneServerNegativeTestJSON-778472214-project Oct 26 13:08:44.725884 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:08:44.725884 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:08:44.725884 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 0b8d4ea396494628983bde1a97222f7d Oct 26 13:08:44.725884 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-778472214-project Oct 26 13:08:44.725884 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:08:44.725884 n-d-862686-1 devstack@n-api.service[120598]: exception: Image not found. Oct 26 13:08:44.725884 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'eacaed20-a0d3-41a3-bf4a-9efc8868bd0e'} Oct 26 13:08:44.725884 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:08:44.726931 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:44.726931 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 26 13:08:44.726931 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 26 13:08:44.726931 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 13:08:44.726931 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 13:08:44.726931 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 13:08:44.726931 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 13:08:44.726931 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 26 13:08:44.726931 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 26 13:08:44.726931 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 26 13:08:44.726931 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 26 13:08:44.726931 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 13:08:44.726931 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 13:08:44.726931 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 13:08:44.726931 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 13:08:44.726931 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image eacaed20-a0d3-41a3-bf4a-9efc8868bd0e to delete Oct 26 13:08:44.726931 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:08:44.726931 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:44.726931 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:08:44.728601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:44.728601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 26 13:08:44.728601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 26 13:08:44.728601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 26 13:08:44.728601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 26 13:08:44.728601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 26 13:08:44.728601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 26 13:08:44.728601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image eacaed20-a0d3-41a3-bf4a-9efc8868bd0e could not be found. Oct 26 13:08:44.728601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:08:44.728601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:44.728601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:08:44.728601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:44.728601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:08:44.728601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:08:44.728601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:08:44.728601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:08:44.728601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:08:44.728601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:08:44.728601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:08:44.728601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:08:44.733259 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 26 13:08:44.733259 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 26 13:08:44.733259 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 26 13:08:44.733259 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:08:44.733259 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:44.733259 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:08:44.733259 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:44.733259 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:08:44.733259 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:08:44.733259 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:08:44.733259 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:08:44.733259 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 26 13:08:44.733259 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:08:44.733259 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-25c01cf2-8e3a-4abd-9cf6-470d02a90096 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Returning 404 to user: Image not found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:08:44.733259 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-25c01cf2-8e3a-4abd-9cf6-470d02a90096 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "DELETE /compute/v2.1/images/eacaed20-a0d3-41a3-bf4a-9efc8868bd0e" status: 404 len: 62 microversion: 2.1 time: 0.118830 Oct 26 13:08:44.734703 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 904/1731] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:44 2022] DELETE /compute/v2.1/images/eacaed20-a0d3-41a3-bf4a-9efc8868bd0e => generated 62 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:08:44.738883 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ebdeba61-abff-48dd-adc5-9122bfc18f52 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1695303372", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "259bbcbd-929e-4d48-b53c-e8ded5da783d"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:08:44.850685 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-ebdeba61-abff-48dd-adc5-9122bfc18f52 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] validate_networks() for [('259bbcbd-929e-4d48-b53c-e8ded5da783d', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:08:46.570900 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-ebdeba61-abff-48dd-adc5-9122bfc18f52 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:08:46.570900 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-ebdeba61-abff-48dd-adc5-9122bfc18f52 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:08:46.570900 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-ebdeba61-abff-48dd-adc5-9122bfc18f52 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:08:46.570900 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-ebdeba61-abff-48dd-adc5-9122bfc18f52 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:08:46.570900 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-ebdeba61-abff-48dd-adc5-9122bfc18f52 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:08:46.588593 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ebdeba61-abff-48dd-adc5-9122bfc18f52 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:46.589967 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ebdeba61-abff-48dd-adc5-9122bfc18f52 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:46.591561 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ebdeba61-abff-48dd-adc5-9122bfc18f52 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:46.592747 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ebdeba61-abff-48dd-adc5-9122bfc18f52 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:46.593219 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ebdeba61-abff-48dd-adc5-9122bfc18f52 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:46.597655 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ebdeba61-abff-48dd-adc5-9122bfc18f52 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:46.653467 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-ebdeba61-abff-48dd-adc5-9122bfc18f52 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Getting quotas for project cc4a21e57f1c4fd1ab3c60f6416f8b11. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:08:46.670506 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-ebdeba61-abff-48dd-adc5-9122bfc18f52 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Getting quotas for user e3707c34798c48d584cff9dd46d9d7c0 and project cc4a21e57f1c4fd1ab3c60f6416f8b11. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:08:46.705403 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ebdeba61-abff-48dd-adc5-9122bfc18f52 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:08:46.715875 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ebdeba61-abff-48dd-adc5-9122bfc18f52 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: cb087101-2eda-4145-bdcc-41673edfcbb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:08:46.800047 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ebdeba61-abff-48dd-adc5-9122bfc18f52 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.068032 Oct 26 13:08:46.809412 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 905/1732] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:08:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2078 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:08:46.815086 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-dc30db63-351b-47ca-9a01-6d8a3695fea7 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:46.815701 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-dc30db63-351b-47ca-9a01-6d8a3695fea7 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:46.823392 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc30db63-351b-47ca-9a01-6d8a3695fea7 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:46.823806 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc30db63-351b-47ca-9a01-6d8a3695fea7 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:46.824391 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc30db63-351b-47ca-9a01-6d8a3695fea7 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:46.824981 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc30db63-351b-47ca-9a01-6d8a3695fea7 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:46.825848 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc30db63-351b-47ca-9a01-6d8a3695fea7 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:46.826001 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc30db63-351b-47ca-9a01-6d8a3695fea7 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:47.094557 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-86e001d0-9ffc-4b1f-a4a0-bbd4f930aca6 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.526821 Oct 26 13:08:47.095494 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 828/1733] 10.222.0.40 () {60 vars in 1170 bytes} [Wed Oct 26 13:08:42 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:08:47.100289 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9daffca6-8093-412c-a686-d679726b63e0 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:47.100913 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9daffca6-8093-412c-a686-d679726b63e0 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: f274cbdb-53e5-4634-b1c8-1913500fef38] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:47.122387 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9daffca6-8093-412c-a686-d679726b63e0 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:47.123348 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9daffca6-8093-412c-a686-d679726b63e0 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:47.124019 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9daffca6-8093-412c-a686-d679726b63e0 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:47.127325 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9daffca6-8093-412c-a686-d679726b63e0 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:47.134079 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9daffca6-8093-412c-a686-d679726b63e0 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:47.135091 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9daffca6-8093-412c-a686-d679726b63e0 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:47.175120 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-9daffca6-8093-412c-a686-d679726b63e0 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] HTTP exception thrown: Instance f274cbdb-53e5-4634-b1c8-1913500fef38 could not be found. Oct 26 13:08:47.179192 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9daffca6-8093-412c-a686-d679726b63e0 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Request method failure captured: Oct 26 13:08:47.179192 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38 HTTP/1.1 Oct 26 13:08:47.179192 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:08:47.179192 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:08:47.179192 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:08:47.179192 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:08:47.179192 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:08:47.179192 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:08:47.179192 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:08:47.179192 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:08:47.179192 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTDWcY4mtHepJlQ55KVJtNHC-FXqIi903yr1J5OC-zbXOMs1LBU3zczKCFgnqIJBIqkvCLTFhaHFSdgfodLtkoXiluiPVf_SkgLznk0TL97DMnsRT29TeJsNzQAsUym5LCo50Ifxk2xlPnZ_QiGEmh7kAsukHuXMaWRZIS-UkeLc5o8 Oct 26 13:08:47.179192 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:08:47.179192 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:08:47.179192 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:08:47.179192 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:08:47.179192 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:08:47.179192 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:08:47.179192 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 186ac42922a64992aa1973bd854830d7 Oct 26 13:08:47.179192 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-778472214 Oct 26 13:08:47.179192 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:08:47.179192 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:08:47.180872 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/186ac42922a64992aa1973bd854830d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/186ac42922a64992aa1973bd854830d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_186ac42922a64992aa1973bd854830d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/186ac42922a64992aa1973bd854830d7"}]}] Oct 26 13:08:47.180872 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-778472214 Oct 26 13:08:47.180872 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 186ac42922a64992aa1973bd854830d7 Oct 26 13:08:47.180872 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-778472214 Oct 26 13:08:47.180872 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ImagesOneServerNegativeTestJSON-778472214-project Oct 26 13:08:47.180872 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:08:47.180872 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:08:47.180872 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 0b8d4ea396494628983bde1a97222f7d Oct 26 13:08:47.180872 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-778472214-project Oct 26 13:08:47.180872 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:08:47.180872 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance f274cbdb-53e5-4634-b1c8-1913500fef38 could not be found. Oct 26 13:08:47.180872 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'f274cbdb-53e5-4634-b1c8-1913500fef38'} Oct 26 13:08:47.181852 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:08:47.181852 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:47.181852 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:08:47.181852 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:08:47.181852 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:08:47.181852 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:08:47.181852 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:08:47.181852 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:08:47.181852 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:08:47.181852 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:08:47.181852 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f274cbdb-53e5-4634-b1c8-1913500fef38 could not be found. Oct 26 13:08:47.181852 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:47.181852 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:47.181852 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:47.181852 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:47.181852 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:08:47.181852 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:08:47.181852 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:08:47.181852 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:08:47.181852 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:08:47.183383 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:08:47.183383 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:08:47.183383 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:08:47.183383 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:08:47.183383 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:08:47.183383 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:08:47.183383 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:08:47.183383 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:08:47.183383 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:08:47.183383 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f274cbdb-53e5-4634-b1c8-1913500fef38 could not be found. Oct 26 13:08:47.183383 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:47.183383 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:47.183383 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:47.183383 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:47.183383 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:08:47.183383 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:08:47.183383 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:08:47.183383 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:08:47.183383 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f274cbdb-53e5-4634-b1c8-1913500fef38 could not be found. Oct 26 13:08:47.183383 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:47.187493 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9daffca6-8093-412c-a686-d679726b63e0 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Returning 404 to user: Instance f274cbdb-53e5-4634-b1c8-1913500fef38 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:08:47.191828 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9daffca6-8093-412c-a686-d679726b63e0 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38" status: 404 len: 111 microversion: 2.1 time: 0.093777 Oct 26 13:08:47.195673 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 829/1734] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:08:47 2022] DELETE /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:08:47.407261 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-dc30db63-351b-47ca-9a01-6d8a3695fea7 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lazy-loading 'services' on Instance uuid 3ce726c3-809c-4662-b794-dcec3f82047c {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:08:47.461337 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-dc30db63-351b-47ca-9a01-6d8a3695fea7 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 200 len: 1969 microversion: 2.25 time: 0.650201 Oct 26 13:08:47.490037 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 906/1735] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:08:46 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 1969 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:08:47.513643 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5d813724-6f93-4c92-b40d-4b72eede9ada tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:47.514745 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5d813724-6f93-4c92-b40d-4b72eede9ada tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: cb087101-2eda-4145-bdcc-41673edfcbb7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:47.772822 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-77a2fe2e-41e6-458c-8c5e-676448d99dbe tempest-SecurityGroupsNegativeTestJSON-1848595126 tempest-SecurityGroupsNegativeTestJSON-1848595126-project] Calling method '.version_select at 0x7f6732264790>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:47.842674 n-d-862686-1 devstack@n-api.service[120597]: DEBUG neutronclient.v2_0.client [None req-77a2fe2e-41e6-458c-8c5e-676448d99dbe tempest-SecurityGroupsNegativeTestJSON-1848595126 tempest-SecurityGroupsNegativeTestJSON-1848595126-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d272bff9-d086-4a97-808b-dd9f4a02e054 does not exist", "detail": ""}} {{(pid=120597) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 26 13:08:47.843293 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.security_group_api [None req-77a2fe2e-41e6-458c-8c5e-676448d99dbe tempest-SecurityGroupsNegativeTestJSON-1848595126 tempest-SecurityGroupsNegativeTestJSON-1848595126-project] Neutron security group d272bff9-d086-4a97-808b-dd9f4a02e054 not found {{(pid=120597) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 26 13:08:47.843816 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-77a2fe2e-41e6-458c-8c5e-676448d99dbe tempest-SecurityGroupsNegativeTestJSON-1848595126 tempest-SecurityGroupsNegativeTestJSON-1848595126-project] HTTP exception thrown: Security group d272bff9-d086-4a97-808b-dd9f4a02e054 does not exist Oct 26 13:08:47.843816 n-d-862686-1 devstack@n-api.service[120597]: Neutron server returns request_ids: ['req-0306c53d-d71d-496f-8c4a-629e1bf055a0'] Oct 26 13:08:47.847640 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-77a2fe2e-41e6-458c-8c5e-676448d99dbe tempest-SecurityGroupsNegativeTestJSON-1848595126 tempest-SecurityGroupsNegativeTestJSON-1848595126-project] Request method failure captured: Oct 26 13:08:47.847640 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/os-security-groups/d272bff9-d086-4a97-808b-dd9f4a02e054 HTTP/1.1 Oct 26 13:08:47.847640 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:08:47.847640 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:08:47.847640 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:08:47.847640 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:08:47.847640 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:08:47.847640 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:08:47.847640 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:08:47.847640 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:08:47.847640 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTFdaE40pB6kSh_NoLhOy9_BU1vUpivaf__BXDd63BmnWKihwXvkaa-NtM00PELoP87cD6B9-rrx8qWILPuMAFpv8PVELihazw9jjchVgvhq5XS4ZKPh1Jd-VmpUoMLy0QWWD0EsN-EVNU3jiZMzbCBcLggWGBZxtvaegkkd7ECW0JY Oct 26 13:08:47.847640 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:08:47.847640 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:08:47.847640 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:08:47.847640 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:08:47.847640 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:08:47.847640 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:08:47.847640 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: b6acfe71fe2345189524769e5dddeef2 Oct 26 13:08:47.847640 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1848595126 Oct 26 13:08:47.847640 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:08:47.847640 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:08:47.849588 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b6acfe71fe2345189524769e5dddeef2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b6acfe71fe2345189524769e5dddeef2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b6acfe71fe2345189524769e5dddeef2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b6acfe71fe2345189524769e5dddeef2"}]}] Oct 26 13:08:47.849588 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1848595126 Oct 26 13:08:47.849588 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: b6acfe71fe2345189524769e5dddeef2 Oct 26 13:08:47.849588 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1848595126 Oct 26 13:08:47.849588 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-SecurityGroupsNegativeTestJSON-1848595126-project Oct 26 13:08:47.849588 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:08:47.849588 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:08:47.849588 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 9f9e180693c643858afaca6be32e27f6 Oct 26 13:08:47.849588 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1848595126-project Oct 26 13:08:47.849588 n-d-862686-1 devstack@n-api.service[120597]: method: Oct 26 13:08:47.849588 n-d-862686-1 devstack@n-api.service[120597]: exception: Security group d272bff9-d086-4a97-808b-dd9f4a02e054 does not exist Oct 26 13:08:47.849588 n-d-862686-1 devstack@n-api.service[120597]: Neutron server returns request_ids: ['req-0306c53d-d71d-496f-8c4a-629e1bf055a0'] Oct 26 13:08:47.849588 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'd272bff9-d086-4a97-808b-dd9f4a02e054'} Oct 26 13:08:47.851025 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:08:47.851025 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:47.851025 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 26 13:08:47.851025 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 26 13:08:47.851025 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:08:47.851025 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:08:47.851025 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 26 13:08:47.851025 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 26 13:08:47.851025 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:08:47.851025 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:08:47.851025 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 26 13:08:47.851025 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 26 13:08:47.851025 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:08:47.851025 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:08:47.851025 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 26 13:08:47.851025 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 26 13:08:47.851025 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:08:47.851025 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:08:47.851025 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 26 13:08:47.852717 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 26 13:08:47.852717 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:08:47.852717 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:08:47.852717 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 26 13:08:47.852717 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 26 13:08:47.852717 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 26 13:08:47.852717 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 26 13:08:47.852717 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d272bff9-d086-4a97-808b-dd9f4a02e054 does not exist Oct 26 13:08:47.852717 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0306c53d-d71d-496f-8c4a-629e1bf055a0'] Oct 26 13:08:47.852717 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:47.852717 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:47.852717 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:47.852717 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:47.852717 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 26 13:08:47.852717 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 26 13:08:47.852717 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 26 13:08:47.852717 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 26 13:08:47.852717 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d272bff9-d086-4a97-808b-dd9f4a02e054 does not exist Oct 26 13:08:47.855439 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0306c53d-d71d-496f-8c4a-629e1bf055a0'] Oct 26 13:08:47.855439 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:47.855439 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:47.855439 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:47.855439 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:47.855439 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:08:47.855439 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:08:47.855439 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:08:47.855439 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:08:47.855439 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:08:47.855439 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:08:47.855439 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:08:47.855439 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:08:47.855439 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 26 13:08:47.855439 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 26 13:08:47.855439 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d272bff9-d086-4a97-808b-dd9f4a02e054 does not exist Oct 26 13:08:47.855439 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0306c53d-d71d-496f-8c4a-629e1bf055a0'] Oct 26 13:08:47.855439 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:47.855439 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:47.855439 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:47.855439 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:47.858451 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:08:47.858451 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:08:47.858451 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:08:47.858451 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:08:47.858451 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d272bff9-d086-4a97-808b-dd9f4a02e054 does not exist Oct 26 13:08:47.858451 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0306c53d-d71d-496f-8c4a-629e1bf055a0'] Oct 26 13:08:47.858451 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:47.858451 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-77a2fe2e-41e6-458c-8c5e-676448d99dbe tempest-SecurityGroupsNegativeTestJSON-1848595126 tempest-SecurityGroupsNegativeTestJSON-1848595126-project] Returning 404 to user: Security group d272bff9-d086-4a97-808b-dd9f4a02e054 does not exist Oct 26 13:08:47.858451 n-d-862686-1 devstack@n-api.service[120597]: Neutron server returns request_ids: ['req-0306c53d-d71d-496f-8c4a-629e1bf055a0'] {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:08:47.858451 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-77a2fe2e-41e6-458c-8c5e-676448d99dbe tempest-SecurityGroupsNegativeTestJSON-1848595126 tempest-SecurityGroupsNegativeTestJSON-1848595126-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/d272bff9-d086-4a97-808b-dd9f4a02e054" status: 404 len: 194 microversion: 2.1 time: 0.652448 Oct 26 13:08:47.858451 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 830/1736] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 26 13:08:47 2022] DELETE /compute/v2.1/os-security-groups/d272bff9-d086-4a97-808b-dd9f4a02e054 => generated 194 bytes in 654 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:08:47.861399 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-be5e17af-2d41-4638-aa19-2cd117b8056b tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.132"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:08:47.868610 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5d813724-6f93-4c92-b40d-4b72eede9ada tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:47.875548 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-be5e17af-2d41-4638-aa19-2cd117b8056b tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] [instance: cdca1d32-5d8f-44da-9c3b-c8d11433df06] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:47.879538 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5d813724-6f93-4c92-b40d-4b72eede9ada tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/cb087101-2eda-4145-bdcc-41673edfcbb7" status: 200 len: 1208 microversion: 2.1 time: 0.387986 Oct 26 13:08:47.884582 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 907/1737] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:47 2022] GET /compute/v2.1/servers/cb087101-2eda-4145-bdcc-41673edfcbb7 => generated 1208 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:47.894357 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-be5e17af-2d41-4638-aa19-2cd117b8056b tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:47.895238 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-be5e17af-2d41-4638-aa19-2cd117b8056b tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:47.895974 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-be5e17af-2d41-4638-aa19-2cd117b8056b tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:47.897064 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-be5e17af-2d41-4638-aa19-2cd117b8056b tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:47.897730 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-be5e17af-2d41-4638-aa19-2cd117b8056b tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:47.898323 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-be5e17af-2d41-4638-aa19-2cd117b8056b tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:47.910328 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c52ec1aa-f511-46fe-8479-9d1cd7f93116 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:47.911003 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c52ec1aa-f511-46fe-8479-9d1cd7f93116 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: f274cbdb-53e5-4634-b1c8-1913500fef38] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:47.946122 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c52ec1aa-f511-46fe-8479-9d1cd7f93116 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:47.946942 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c52ec1aa-f511-46fe-8479-9d1cd7f93116 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:47.947869 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c52ec1aa-f511-46fe-8479-9d1cd7f93116 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:47.950217 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c52ec1aa-f511-46fe-8479-9d1cd7f93116 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:47.952865 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c52ec1aa-f511-46fe-8479-9d1cd7f93116 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:47.968668 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c52ec1aa-f511-46fe-8479-9d1cd7f93116 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:47.992994 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-be5e17af-2d41-4638-aa19-2cd117b8056b tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "refresh_cache-cdca1d32-5d8f-44da-9c3b-c8d11433df06" {{(pid=120597) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 26 13:08:47.993676 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-be5e17af-2d41-4638-aa19-2cd117b8056b tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquired lock "refresh_cache-cdca1d32-5d8f-44da-9c3b-c8d11433df06" {{(pid=120597) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 26 13:08:48.040316 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-c52ec1aa-f511-46fe-8479-9d1cd7f93116 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] HTTP exception thrown: Instance f274cbdb-53e5-4634-b1c8-1913500fef38 could not be found. Oct 26 13:08:48.044488 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c52ec1aa-f511-46fe-8479-9d1cd7f93116 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Request method failure captured: Oct 26 13:08:48.044488 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38 HTTP/1.1 Oct 26 13:08:48.044488 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:08:48.044488 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:08:48.044488 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:08:48.044488 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:08:48.044488 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:08:48.044488 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:08:48.044488 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:08:48.044488 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:08:48.044488 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTDWcY4mtHepJlQ55KVJtNHC-FXqIi903yr1J5OC-zbXOMs1LBU3zczKCFgnqIJBIqkvCLTFhaHFSdgfodLtkoXiluiPVf_SkgLznk0TL97DMnsRT29TeJsNzQAsUym5LCo50Ifxk2xlPnZ_QiGEmh7kAsukHuXMaWRZIS-UkeLc5o8 Oct 26 13:08:48.044488 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:08:48.044488 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:08:48.044488 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:08:48.044488 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:08:48.044488 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:08:48.044488 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:08:48.044488 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 186ac42922a64992aa1973bd854830d7 Oct 26 13:08:48.044488 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-778472214 Oct 26 13:08:48.044488 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:08:48.044488 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:08:48.046308 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/186ac42922a64992aa1973bd854830d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/186ac42922a64992aa1973bd854830d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_186ac42922a64992aa1973bd854830d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/186ac42922a64992aa1973bd854830d7"}]}] Oct 26 13:08:48.046308 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-778472214 Oct 26 13:08:48.046308 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 186ac42922a64992aa1973bd854830d7 Oct 26 13:08:48.046308 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-778472214 Oct 26 13:08:48.046308 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ImagesOneServerNegativeTestJSON-778472214-project Oct 26 13:08:48.046308 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:08:48.046308 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:08:48.046308 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 0b8d4ea396494628983bde1a97222f7d Oct 26 13:08:48.046308 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-778472214-project Oct 26 13:08:48.046308 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:08:48.046308 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance f274cbdb-53e5-4634-b1c8-1913500fef38 could not be found. Oct 26 13:08:48.046308 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'f274cbdb-53e5-4634-b1c8-1913500fef38'} Oct 26 13:08:48.047443 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:08:48.047443 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:48.047443 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:08:48.047443 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:08:48.047443 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:08:48.047443 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:08:48.047443 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:08:48.047443 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:08:48.047443 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:08:48.047443 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:08:48.047443 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f274cbdb-53e5-4634-b1c8-1913500fef38 could not be found. Oct 26 13:08:48.047443 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:08:48.047443 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:48.047443 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:08:48.047443 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:48.047443 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:08:48.047443 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:08:48.047443 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:08:48.047443 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:08:48.047443 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:08:48.048973 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:08:48.048973 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:08:48.048973 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:08:48.048973 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:08:48.048973 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:08:48.048973 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:08:48.048973 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:08:48.048973 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f274cbdb-53e5-4634-b1c8-1913500fef38 could not be found. Oct 26 13:08:48.048973 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:08:48.048973 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:48.048973 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:08:48.048973 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:48.048973 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:08:48.048973 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:08:48.048973 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:08:48.048973 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:08:48.048973 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f274cbdb-53e5-4634-b1c8-1913500fef38 could not be found. Oct 26 13:08:48.048973 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:08:48.055189 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c52ec1aa-f511-46fe-8479-9d1cd7f93116 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Returning 404 to user: Instance f274cbdb-53e5-4634-b1c8-1913500fef38 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:08:48.058906 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c52ec1aa-f511-46fe-8479-9d1cd7f93116 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38" status: 404 len: 111 microversion: 2.1 time: 0.171485 Oct 26 13:08:48.061587 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 908/1738] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:47 2022] GET /compute/v2.1/servers/f274cbdb-53e5-4634-b1c8-1913500fef38 => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:08:48.074578 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-024ace4d-0934-4c46-a263-409d5d2408a2 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:48.102821 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-024ace4d-0934-4c46-a263-409d5d2408a2 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:48.104362 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-024ace4d-0934-4c46-a263-409d5d2408a2 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:48.108991 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-024ace4d-0934-4c46-a263-409d5d2408a2 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:48.119135 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-024ace4d-0934-4c46-a263-409d5d2408a2 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:48.122116 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-024ace4d-0934-4c46-a263-409d5d2408a2 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:48.124677 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-024ace4d-0934-4c46-a263-409d5d2408a2 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:48.214232 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-024ace4d-0934-4c46-a263-409d5d2408a2 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.151406 Oct 26 13:08:48.215206 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 909/1739] 10.222.0.40 () {60 vars in 1217 bytes} [Wed Oct 26 13:08:48 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:08:48.224932 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-b3171181-f826-44dd-a663-61bb10c32267 req-ed70dd2e-0737-46b0-abc9-35e3c11f937f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d426a4f6-fa08-47d2-a583-735600b77f27", "name": "network-vif-deleted", "tag": "8734e662-a14c-45ba-b2b3-6b2193b943a0"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:08:48.249543 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b3171181-f826-44dd-a663-61bb10c32267 req-ed70dd2e-0737-46b0-abc9-35e3c11f937f service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:48.250357 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b3171181-f826-44dd-a663-61bb10c32267 req-ed70dd2e-0737-46b0-abc9-35e3c11f937f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:48.250890 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b3171181-f826-44dd-a663-61bb10c32267 req-ed70dd2e-0737-46b0-abc9-35e3c11f937f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:48.279141 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-b3171181-f826-44dd-a663-61bb10c32267 req-ed70dd2e-0737-46b0-abc9-35e3c11f937f service nova] Creating event network-vif-deleted:8734e662-a14c-45ba-b2b3-6b2193b943a0 for instance d426a4f6-fa08-47d2-a583-735600b77f27 on n-h2-862686-1 Oct 26 13:08:48.288212 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-b3171181-f826-44dd-a663-61bb10c32267 req-ed70dd2e-0737-46b0-abc9-35e3c11f937f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071445 Oct 26 13:08:48.291675 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 910/1740] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:08:48.309230 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b9a5ecfe-e0f4-4a89-9726-9db55f8016a7 tempest-SecurityGroupsNegativeTestJSON-1848595126 tempest-SecurityGroupsNegativeTestJSON-1848595126-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.010293 Oct 26 13:08:48.309230 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 911/1741] 10.222.0.40 () {58 vars in 1164 bytes} [Wed Oct 26 13:08:48 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 26 13:08:48.324433 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b8310f86-2ba7-4489-8260-3c02e74924ad tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '.version_select at 0x7f673698ff70>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:48.378931 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b8310f86-2ba7-4489-8260-3c02e74924ad tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1220212086" status: 202 len: 0 microversion: 2.1 time: 0.070232 Oct 26 13:08:48.381044 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 912/1742] 10.222.0.40 () {58 vars in 1221 bytes} [Wed Oct 26 13:08:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1220212086 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:08:48.790841 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-be76298c-d0b7-4a71-82c8-f0e9a9a2d64a tempest-QuotaClassesAdmin257Test-658640842 tempest-QuotaClassesAdmin257Test-658640842-project-admin] Calling method '.version_select at 0x7f6736993790>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:48.819143 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-be76298c-d0b7-4a71-82c8-f0e9a9a2d64a tempest-QuotaClassesAdmin257Test-658640842 tempest-QuotaClassesAdmin257Test-658640842-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.435558 Oct 26 13:08:48.822178 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 913/1743] 10.222.0.40 () {60 vars in 1226 bytes} [Wed Oct 26 13:08:48 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:08:48.837817 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bac2c03e-5767-492a-aa90-33a693364a10 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862686-1", "block_migration": "auto"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:08:48.844371 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bac2c03e-5767-492a-aa90-33a693364a10 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:48.864136 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bac2c03e-5767-492a-aa90-33a693364a10 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:48.864664 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bac2c03e-5767-492a-aa90-33a693364a10 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:48.865097 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bac2c03e-5767-492a-aa90-33a693364a10 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:48.870495 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bac2c03e-5767-492a-aa90-33a693364a10 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:48.874909 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bac2c03e-5767-492a-aa90-33a693364a10 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:48.875355 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bac2c03e-5767-492a-aa90-33a693364a10 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:48.955393 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-bac2c03e-5767-492a-aa90-33a693364a10 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lazy-loading 'flavor' on Instance uuid 3ce726c3-809c-4662-b794-dcec3f82047c {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:08:48.982915 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bac2c03e-5767-492a-aa90-33a693364a10 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Going to try to live migrate instance to n-h2-862686-1 {{(pid=120598) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 26 13:08:49.143130 n-d-862686-1 devstack@n-api.service[120597]: DEBUG neutronclient.v2_0.client [None req-be5e17af-2d41-4638-aa19-2cd117b8056b tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.6.132 (89d2c2fc-82ed-410e-9572-fd9523b7912a) with port 7cca99b7-782b-4cb4-bf7d-e207183f2165 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 41c3ece9-8653-47df-8de8-fa897ccc9072.", "detail": ""}} {{(pid=120597) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 26 13:08:49.143755 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-be5e17af-2d41-4638-aa19-2cd117b8056b tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Releasing lock "refresh_cache-cdca1d32-5d8f-44da-9c3b-c8d11433df06" {{(pid=120597) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 26 13:08:49.144311 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-be5e17af-2d41-4638-aa19-2cd117b8056b tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] HTTP exception thrown: Cannot associate floating IP 172.25.6.132 (89d2c2fc-82ed-410e-9572-fd9523b7912a) with port 7cca99b7-782b-4cb4-bf7d-e207183f2165 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 41c3ece9-8653-47df-8de8-fa897ccc9072. Oct 26 13:08:49.144311 n-d-862686-1 devstack@n-api.service[120597]: Neutron server returns request_ids: ['req-7fbedfbe-0b18-498e-b1c0-9de724361580'] Oct 26 13:08:49.148300 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-be5e17af-2d41-4638-aa19-2cd117b8056b tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Request method failure captured: Oct 26 13:08:49.148300 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06/action HTTP/1.1 Oct 26 13:08:49.148300 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:08:49.148300 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:08:49.148300 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:08:49.148300 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 46 Oct 26 13:08:49.148300 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:08:49.148300 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:08:49.148300 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:08:49.148300 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:08:49.148300 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTEyN7KOWBDZ6tavoWYwvFvv3R2kkimdK9s2yUsufV6fgY7GMpFZmN5v6IpKkskubRIZ0sYcCsVc1H3e7reKAMuC1hpK0WDLZiuSPbwYOtrULpaL4vWsedQVrSuTHE0J2u6T2i1J9ErKEFkr8pVpiZAcT6erIdcDGIEmd54UV-ozGe0 Oct 26 13:08:49.148300 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:08:49.148300 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:08:49.148300 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:08:49.148300 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:08:49.148300 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:08:49.148300 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:08:49.148300 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: b86e36a2f7fc44daac11d122c492ba68 Oct 26 13:08:49.148300 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 Oct 26 13:08:49.148300 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:08:49.148300 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:08:49.150243 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b86e36a2f7fc44daac11d122c492ba68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b86e36a2f7fc44daac11d122c492ba68"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b86e36a2f7fc44daac11d122c492ba68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b86e36a2f7fc44daac11d122c492ba68"}]}] Oct 26 13:08:49.150243 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 Oct 26 13:08:49.150243 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: b86e36a2f7fc44daac11d122c492ba68 Oct 26 13:08:49.150243 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 Oct 26 13:08:49.150243 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project Oct 26 13:08:49.150243 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:08:49.150243 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:08:49.150243 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: ec3945207e6a490fb1baa5eaefcfeaf5 Oct 26 13:08:49.150243 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project Oct 26 13:08:49.150243 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:08:49.150243 n-d-862686-1 devstack@n-api.service[120597]: {"addFloatingIp": {"address": "172.25.6.132"}} Oct 26 13:08:49.150243 n-d-862686-1 devstack@n-api.service[120597]: method: Oct 26 13:08:49.151152 n-d-862686-1 devstack@n-api.service[120597]: exception: Cannot associate floating IP 172.25.6.132 (89d2c2fc-82ed-410e-9572-fd9523b7912a) with port 7cca99b7-782b-4cb4-bf7d-e207183f2165 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 41c3ece9-8653-47df-8de8-fa897ccc9072. Oct 26 13:08:49.151152 n-d-862686-1 devstack@n-api.service[120597]: Neutron server returns request_ids: ['req-7fbedfbe-0b18-498e-b1c0-9de724361580'] Oct 26 13:08:49.151152 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'cdca1d32-5d8f-44da-9c3b-c8d11433df06', 'body': {'addFloatingIp': {'address': '172.25.6.132'}}} Oct 26 13:08:49.151152 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:08:49.151152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:49.151152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 26 13:08:49.151152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 26 13:08:49.151152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:08:49.151152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:08:49.151152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 26 13:08:49.151152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 26 13:08:49.151152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:08:49.151152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:08:49.151152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 26 13:08:49.151152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 26 13:08:49.151152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:08:49.151152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:08:49.154571 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 26 13:08:49.154571 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 26 13:08:49.154571 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:08:49.154571 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:08:49.154571 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 26 13:08:49.154571 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 26 13:08:49.154571 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:08:49.154571 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:08:49.154571 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 26 13:08:49.154571 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 26 13:08:49.154571 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:08:49.154571 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:08:49.154571 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 26 13:08:49.154571 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 26 13:08:49.154571 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 26 13:08:49.154571 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 26 13:08:49.156998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.6.132 (89d2c2fc-82ed-410e-9572-fd9523b7912a) with port 7cca99b7-782b-4cb4-bf7d-e207183f2165 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 41c3ece9-8653-47df-8de8-fa897ccc9072. Oct 26 13:08:49.156998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7fbedfbe-0b18-498e-b1c0-9de724361580'] Oct 26 13:08:49.156998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:49.156998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:49.156998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:49.156998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:49.156998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 26 13:08:49.156998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 26 13:08:49.156998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 26 13:08:49.156998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 26 13:08:49.156998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 26 13:08:49.156998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 26 13:08:49.156998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.6.132 (89d2c2fc-82ed-410e-9572-fd9523b7912a) with port 7cca99b7-782b-4cb4-bf7d-e207183f2165 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 41c3ece9-8653-47df-8de8-fa897ccc9072. Oct 26 13:08:49.156998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7fbedfbe-0b18-498e-b1c0-9de724361580'] Oct 26 13:08:49.156998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:49.156998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:49.159724 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:49.159724 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:49.159724 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:08:49.159724 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:08:49.159724 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:08:49.159724 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:08:49.159724 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:08:49.159724 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:08:49.159724 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:08:49.159724 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:08:49.159724 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:08:49.159724 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:08:49.159724 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 26 13:08:49.159724 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 26 13:08:49.159724 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.6.132 (89d2c2fc-82ed-410e-9572-fd9523b7912a) with port 7cca99b7-782b-4cb4-bf7d-e207183f2165 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 41c3ece9-8653-47df-8de8-fa897ccc9072. Oct 26 13:08:49.159724 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7fbedfbe-0b18-498e-b1c0-9de724361580'] Oct 26 13:08:49.159724 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:49.159724 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:49.163151 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:49.163151 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:49.163151 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:08:49.163151 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:08:49.163151 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:08:49.163151 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:08:49.163151 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.6.132 (89d2c2fc-82ed-410e-9572-fd9523b7912a) with port 7cca99b7-782b-4cb4-bf7d-e207183f2165 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 41c3ece9-8653-47df-8de8-fa897ccc9072. Oct 26 13:08:49.163151 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7fbedfbe-0b18-498e-b1c0-9de724361580'] Oct 26 13:08:49.163151 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:49.163151 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-be5e17af-2d41-4638-aa19-2cd117b8056b tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Returning 400 to user: Cannot associate floating IP 172.25.6.132 (89d2c2fc-82ed-410e-9572-fd9523b7912a) with port 7cca99b7-782b-4cb4-bf7d-e207183f2165 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 41c3ece9-8653-47df-8de8-fa897ccc9072. Oct 26 13:08:49.163151 n-d-862686-1 devstack@n-api.service[120597]: Neutron server returns request_ids: ['req-7fbedfbe-0b18-498e-b1c0-9de724361580'] {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:08:49.165616 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-be5e17af-2d41-4638-aa19-2cd117b8056b tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] 10.222.0.40 "POST /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06/action" status: 400 len: 382 microversion: 2.1 time: 1.298814 Oct 26 13:08:49.165616 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 831/1744] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:08:47 2022] POST /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06/action => generated 382 bytes in 1300 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:08:49.165616 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-efa6d1c6-4a1e-4d1a-8da7-300c25661cdf tempest-SecurityGroupsNegativeTestJSON-1848595126 tempest-SecurityGroupsNegativeTestJSON-1848595126-project] Calling method '.version_select at 0x7f673229a670>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:49.799281 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-efa6d1c6-4a1e-4d1a-8da7-300c25661cdf tempest-SecurityGroupsNegativeTestJSON-1848595126 tempest-SecurityGroupsNegativeTestJSON-1848595126-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.647093 Oct 26 13:08:49.803021 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 832/1745] 10.222.0.40 () {58 vars in 1158 bytes} [Wed Oct 26 13:08:49 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:08:49.809169 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fcb05092-be1d-45cd-b0e1-e74974eacc54 tempest-QuotaClassesAdmin257Test-658640842 tempest-QuotaClassesAdmin257Test-658640842-project-admin] Action: 'update', calling method: .version_select at 0x7f673232ed30>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:08:49.987305 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fcb05092-be1d-45cd-b0e1-e74974eacc54 tempest-QuotaClassesAdmin257Test-658640842 tempest-QuotaClassesAdmin257Test-658640842-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.181866 Oct 26 13:08:49.988453 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 833/1746] 10.222.0.40 () {62 vars in 1247 bytes} [Wed Oct 26 13:08:49 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:08:49.995554 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e1344f9c-d809-44ee-a2e2-07dc1476bc32 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:49.996174 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e1344f9c-d809-44ee-a2e2-07dc1476bc32 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: cb087101-2eda-4145-bdcc-41673edfcbb7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:50.007659 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1344f9c-d809-44ee-a2e2-07dc1476bc32 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:50.008505 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1344f9c-d809-44ee-a2e2-07dc1476bc32 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:50.009140 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1344f9c-d809-44ee-a2e2-07dc1476bc32 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:50.010256 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1344f9c-d809-44ee-a2e2-07dc1476bc32 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:50.011716 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1344f9c-d809-44ee-a2e2-07dc1476bc32 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:50.012406 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1344f9c-d809-44ee-a2e2-07dc1476bc32 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:50.217906 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e1344f9c-d809-44ee-a2e2-07dc1476bc32 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:50.228790 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e1344f9c-d809-44ee-a2e2-07dc1476bc32 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/cb087101-2eda-4145-bdcc-41673edfcbb7" status: 200 len: 1266 microversion: 2.1 time: 0.238209 Oct 26 13:08:50.229421 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 834/1747] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:49 2022] GET /compute/v2.1/servers/cb087101-2eda-4145-bdcc-41673edfcbb7 => generated 1266 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:50.243734 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c0051d7d-b4fc-4900-b204-93dcf5e3508c tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Calling method '.version_select at 0x7f6732264670>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:51.866646 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bac2c03e-5767-492a-aa90-33a693364a10 tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c/action" status: 202 len: 0 microversion: 2.25 time: 3.030168 Oct 26 13:08:51.871473 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 914/1748] 10.222.0.40 () {62 vars in 1319 bytes} [Wed Oct 26 13:08:48 2022] POST /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c/action => generated 0 bytes in 3046 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:08:51.888358 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c0051d7d-b4fc-4900-b204-93dcf5e3508c tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/89d2c2fc-82ed-410e-9572-fd9523b7912a" status: 202 len: 0 microversion: 2.1 time: 1.657842 Oct 26 13:08:51.890273 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 835/1749] 10.222.0.40 () {58 vars in 1263 bytes} [Wed Oct 26 13:08:50 2022] DELETE /compute/v2.1/os-floating-ips/89d2c2fc-82ed-410e-9572-fd9523b7912a => generated 0 bytes in 1660 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:08:51.897162 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b5282e45-7f5a-4518-921e-6cccda633636 tempest-QuotaClassesAdmin257Test-658640842 tempest-QuotaClassesAdmin257Test-658640842-project-admin] Calling method '.version_select at 0x7f6732262ee0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:51.905080 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-768b23f9-3bca-4ff7-bdd9-003d3d767dde tempest-SecurityGroupsNegativeTestJSON-1848595126 tempest-SecurityGroupsNegativeTestJSON-1848595126-project] Calling method '.version_select at 0x7f6731f544c0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:51.940014 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=9,nova_api:INSERT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:08:51.959006 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b5282e45-7f5a-4518-921e-6cccda633636 tempest-QuotaClassesAdmin257Test-658640842 tempest-QuotaClassesAdmin257Test-658640842-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.067121 Oct 26 13:08:51.959936 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 836/1750] 10.222.0.40 () {60 vars in 1226 bytes} [Wed Oct 26 13:08:51 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:08:51.976825 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d86ee1eb-4ade-4803-91bd-3a3e47c999e7 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '.version_select at 0x7f67322e7940>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:52.075771 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-d86ee1eb-4ade-4803-91bd-3a3e47c999e7 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] HTTP exception thrown: Image not found. Oct 26 13:08:52.087528 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d86ee1eb-4ade-4803-91bd-3a3e47c999e7 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Request method failure captured: Oct 26 13:08:52.087528 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/images/ab3ed147-a4ca-4c48-b16f-1071f9c6bea0 HTTP/1.1 Oct 26 13:08:52.087528 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:08:52.087528 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:08:52.087528 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:08:52.087528 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:08:52.087528 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:08:52.087528 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:08:52.087528 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:08:52.087528 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:08:52.087528 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTDWcY4mtHepJlQ55KVJtNHC-FXqIi903yr1J5OC-zbXOMs1LBU3zczKCFgnqIJBIqkvCLTFhaHFSdgfodLtkoXiluiPVf_SkgLznk0TL97DMnsRT29TeJsNzQAsUym5LCo50Ifxk2xlPnZ_QiGEmh7kAsukHuXMaWRZIS-UkeLc5o8 Oct 26 13:08:52.087528 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:08:52.087528 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:08:52.087528 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:08:52.087528 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:08:52.087528 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:08:52.087528 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:08:52.087528 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 186ac42922a64992aa1973bd854830d7 Oct 26 13:08:52.087528 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-778472214 Oct 26 13:08:52.087528 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:08:52.087528 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:08:52.089291 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/186ac42922a64992aa1973bd854830d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/186ac42922a64992aa1973bd854830d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_186ac42922a64992aa1973bd854830d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/186ac42922a64992aa1973bd854830d7"}]}] Oct 26 13:08:52.089291 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-778472214 Oct 26 13:08:52.089291 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 186ac42922a64992aa1973bd854830d7 Oct 26 13:08:52.089291 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-778472214 Oct 26 13:08:52.089291 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ImagesOneServerNegativeTestJSON-778472214-project Oct 26 13:08:52.089291 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:08:52.089291 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:08:52.089291 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 0b8d4ea396494628983bde1a97222f7d Oct 26 13:08:52.089291 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-778472214-project Oct 26 13:08:52.089291 n-d-862686-1 devstack@n-api.service[120597]: method: Oct 26 13:08:52.089291 n-d-862686-1 devstack@n-api.service[120597]: exception: Image not found. Oct 26 13:08:52.089291 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'ab3ed147-a4ca-4c48-b16f-1071f9c6bea0'} Oct 26 13:08:52.089291 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:08:52.091116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:52.091116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 26 13:08:52.091116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 26 13:08:52.091116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 13:08:52.091116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 13:08:52.091116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 13:08:52.091116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 13:08:52.091116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 26 13:08:52.091116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 26 13:08:52.091116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 26 13:08:52.091116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 26 13:08:52.091116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 13:08:52.091116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 13:08:52.091116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 13:08:52.091116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 13:08:52.091116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ab3ed147-a4ca-4c48-b16f-1071f9c6bea0 to delete Oct 26 13:08:52.091116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:52.091116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:52.091116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:52.092691 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:52.092691 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 26 13:08:52.092691 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 26 13:08:52.092691 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 26 13:08:52.092691 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 26 13:08:52.092691 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 26 13:08:52.092691 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 26 13:08:52.092691 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ab3ed147-a4ca-4c48-b16f-1071f9c6bea0 could not be found. Oct 26 13:08:52.092691 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:52.092691 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:52.092691 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:52.092691 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:52.092691 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:08:52.092691 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:08:52.092691 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:08:52.092691 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:08:52.092691 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:08:52.092691 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:08:52.092691 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:08:52.092691 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:08:52.094308 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 26 13:08:52.094308 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 26 13:08:52.094308 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 26 13:08:52.094308 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:52.094308 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:52.094308 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:52.094308 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:52.094308 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:08:52.094308 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:08:52.094308 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:08:52.094308 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:08:52.094308 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 26 13:08:52.094308 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:52.094308 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d86ee1eb-4ade-4803-91bd-3a3e47c999e7 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Returning 404 to user: Image not found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:08:52.097740 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d86ee1eb-4ade-4803-91bd-3a3e47c999e7 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "DELETE /compute/v2.1/images/ab3ed147-a4ca-4c48-b16f-1071f9c6bea0" status: 404 len: 62 microversion: 2.1 time: 0.132968 Oct 26 13:08:52.097740 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 837/1751] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:51 2022] DELETE /compute/v2.1/images/ab3ed147-a4ca-4c48-b16f-1071f9c6bea0 => generated 62 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:08:52.108174 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a77836ef-da08-4a45-9ee5-8883255d8d74 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:52.122639 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a77836ef-da08-4a45-9ee5-8883255d8d74 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: cb087101-2eda-4145-bdcc-41673edfcbb7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:52.164229 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a77836ef-da08-4a45-9ee5-8883255d8d74 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:52.167788 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a77836ef-da08-4a45-9ee5-8883255d8d74 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:52.168558 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a77836ef-da08-4a45-9ee5-8883255d8d74 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:52.169612 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a77836ef-da08-4a45-9ee5-8883255d8d74 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:52.170049 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a77836ef-da08-4a45-9ee5-8883255d8d74 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:52.170487 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a77836ef-da08-4a45-9ee5-8883255d8d74 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:52.507418 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a77836ef-da08-4a45-9ee5-8883255d8d74 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:52.518313 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a77836ef-da08-4a45-9ee5-8883255d8d74 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/cb087101-2eda-4145-bdcc-41673edfcbb7" status: 200 len: 1308 microversion: 2.1 time: 0.420549 Oct 26 13:08:52.519147 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 838/1752] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:52 2022] GET /compute/v2.1/servers/cb087101-2eda-4145-bdcc-41673edfcbb7 => generated 1308 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:52.524197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-456331b9-f7a6-40d8-b7c9-8272f4b4a76e tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:52.525005 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-456331b9-f7a6-40d8-b7c9-8272f4b4a76e tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:52.539684 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-456331b9-f7a6-40d8-b7c9-8272f4b4a76e tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:52.540186 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-456331b9-f7a6-40d8-b7c9-8272f4b4a76e tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:52.540629 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-456331b9-f7a6-40d8-b7c9-8272f4b4a76e tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:52.541404 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-456331b9-f7a6-40d8-b7c9-8272f4b4a76e tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:52.545469 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-456331b9-f7a6-40d8-b7c9-8272f4b4a76e tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:52.545971 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-456331b9-f7a6-40d8-b7c9-8272f4b4a76e tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:52.587657 n-d-862686-1 devstack@n-api.service[120598]: DEBUG neutronclient.v2_0.client [None req-768b23f9-3bca-4ff7-bdd9-003d3d767dde tempest-SecurityGroupsNegativeTestJSON-1848595126 tempest-SecurityGroupsNegativeTestJSON-1848595126-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=120598) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 26 13:08:52.588549 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-768b23f9-3bca-4ff7-bdd9-003d3d767dde tempest-SecurityGroupsNegativeTestJSON-1848595126 tempest-SecurityGroupsNegativeTestJSON-1848595126-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 26 13:08:52.588549 n-d-862686-1 devstack@n-api.service[120598]: Neutron server returns request_ids: ['req-dd65beee-a66e-4ed0-9a42-9bd197c3f7e4'] Oct 26 13:08:52.592487 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-768b23f9-3bca-4ff7-bdd9-003d3d767dde tempest-SecurityGroupsNegativeTestJSON-1848595126 tempest-SecurityGroupsNegativeTestJSON-1848595126-project] Request method failure captured: Oct 26 13:08:52.592487 n-d-862686-1 devstack@n-api.service[120598]: request: DELETE /compute/v2.1/os-security-groups/f51dc6cb-7077-4823-8425-e8710dfd683e HTTP/1.1 Oct 26 13:08:52.592487 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:08:52.592487 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:08:52.592487 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:08:52.592487 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:08:52.592487 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:08:52.592487 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:08:52.592487 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:08:52.592487 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:08:52.592487 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTFdaE40pB6kSh_NoLhOy9_BU1vUpivaf__BXDd63BmnWKihwXvkaa-NtM00PELoP87cD6B9-rrx8qWILPuMAFpv8PVELihazw9jjchVgvhq5XS4ZKPh1Jd-VmpUoMLy0QWWD0EsN-EVNU3jiZMzbCBcLggWGBZxtvaegkkd7ECW0JY Oct 26 13:08:52.592487 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:08:52.592487 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:08:52.592487 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:08:52.592487 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:08:52.592487 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:08:52.592487 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:08:52.592487 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: b6acfe71fe2345189524769e5dddeef2 Oct 26 13:08:52.592487 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1848595126 Oct 26 13:08:52.592487 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:08:52.592487 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:08:52.594259 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b6acfe71fe2345189524769e5dddeef2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b6acfe71fe2345189524769e5dddeef2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b6acfe71fe2345189524769e5dddeef2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b6acfe71fe2345189524769e5dddeef2"}]}] Oct 26 13:08:52.594259 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1848595126 Oct 26 13:08:52.594259 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: b6acfe71fe2345189524769e5dddeef2 Oct 26 13:08:52.594259 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1848595126 Oct 26 13:08:52.594259 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-SecurityGroupsNegativeTestJSON-1848595126-project Oct 26 13:08:52.594259 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:08:52.594259 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:08:52.594259 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 9f9e180693c643858afaca6be32e27f6 Oct 26 13:08:52.594259 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1848595126-project Oct 26 13:08:52.594259 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:08:52.594259 n-d-862686-1 devstack@n-api.service[120598]: exception: Insufficient rights for removing default security group. Oct 26 13:08:52.594259 n-d-862686-1 devstack@n-api.service[120598]: Neutron server returns request_ids: ['req-dd65beee-a66e-4ed0-9a42-9bd197c3f7e4'] Oct 26 13:08:52.594259 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'f51dc6cb-7077-4823-8425-e8710dfd683e'} Oct 26 13:08:52.595411 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:08:52.595411 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:52.595411 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 26 13:08:52.595411 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 26 13:08:52.595411 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:08:52.595411 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:08:52.595411 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 26 13:08:52.595411 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 26 13:08:52.595411 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:08:52.595411 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:08:52.595411 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 26 13:08:52.595411 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 26 13:08:52.595411 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:08:52.595411 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:08:52.595411 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 26 13:08:52.595411 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 26 13:08:52.595411 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:08:52.595411 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:08:52.595411 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 26 13:08:52.596889 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 26 13:08:52.596889 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:08:52.596889 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:08:52.596889 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 26 13:08:52.596889 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 26 13:08:52.596889 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 26 13:08:52.596889 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 26 13:08:52.596889 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 26 13:08:52.596889 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dd65beee-a66e-4ed0-9a42-9bd197c3f7e4'] Oct 26 13:08:52.596889 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:08:52.596889 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:52.596889 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:08:52.596889 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:52.596889 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 26 13:08:52.596889 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 26 13:08:52.596889 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 26 13:08:52.596889 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 26 13:08:52.596889 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 26 13:08:52.596889 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dd65beee-a66e-4ed0-9a42-9bd197c3f7e4'] Oct 26 13:08:52.598385 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:08:52.598385 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:52.598385 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:08:52.598385 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:52.598385 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:08:52.598385 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:08:52.598385 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:08:52.598385 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:08:52.598385 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:08:52.598385 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:08:52.598385 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:08:52.598385 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:08:52.598385 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 26 13:08:52.598385 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 26 13:08:52.598385 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 26 13:08:52.598385 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dd65beee-a66e-4ed0-9a42-9bd197c3f7e4'] Oct 26 13:08:52.598385 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:08:52.598385 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:52.598385 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:08:52.598385 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:52.598385 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:08:52.600624 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:08:52.600624 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:08:52.600624 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:08:52.600624 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 26 13:08:52.600624 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dd65beee-a66e-4ed0-9a42-9bd197c3f7e4'] Oct 26 13:08:52.600624 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:08:52.602067 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-768b23f9-3bca-4ff7-bdd9-003d3d767dde tempest-SecurityGroupsNegativeTestJSON-1848595126 tempest-SecurityGroupsNegativeTestJSON-1848595126-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 26 13:08:52.602067 n-d-862686-1 devstack@n-api.service[120598]: Neutron server returns request_ids: ['req-dd65beee-a66e-4ed0-9a42-9bd197c3f7e4'] {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:08:52.603213 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-768b23f9-3bca-4ff7-bdd9-003d3d767dde tempest-SecurityGroupsNegativeTestJSON-1848595126 tempest-SecurityGroupsNegativeTestJSON-1848595126-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/f51dc6cb-7077-4823-8425-e8710dfd683e" status: 400 len: 182 microversion: 2.1 time: 0.733691 Oct 26 13:08:52.611797 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 915/1753] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 26 13:08:51 2022] DELETE /compute/v2.1/os-security-groups/f51dc6cb-7077-4823-8425-e8710dfd683e => generated 182 bytes in 743 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:08:52.618268 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-132346dd-8efd-4b46-bc3d-8a2a31aefcbc tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.208"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:08:52.824362 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-456331b9-f7a6-40d8-b7c9-8272f4b4a76e tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:52.837496 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-456331b9-f7a6-40d8-b7c9-8272f4b4a76e tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:52.841718 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-456331b9-f7a6-40d8-b7c9-8272f4b4a76e tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:52.843469 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-456331b9-f7a6-40d8-b7c9-8272f4b4a76e tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 200 len: 1486 microversion: 2.25 time: 0.323202 Oct 26 13:08:52.848273 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 839/1754] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:08:52 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 1486 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:08:52.853641 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6494cf7b-e44c-4587-b018-5f9b1f50235f tempest-QuotaClassesAdmin257Test-658640842 tempest-QuotaClassesAdmin257Test-658640842-project-admin] Action: 'update', calling method: .version_select at 0x7f67322108b0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:08:52.999121 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6494cf7b-e44c-4587-b018-5f9b1f50235f tempest-QuotaClassesAdmin257Test-658640842 tempest-QuotaClassesAdmin257Test-658640842-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.149069 Oct 26 13:08:53.000820 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 840/1755] 10.222.0.40 () {62 vars in 1247 bytes} [Wed Oct 26 13:08:52 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:08:53.012286 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-42735e70-074e-4f39-8ad1-e704bacfd805 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:53.012969 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-42735e70-074e-4f39-8ad1-e704bacfd805 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 2803303a-ad72-4096-b524-69a583a56f03] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:53.027911 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-42735e70-074e-4f39-8ad1-e704bacfd805 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:53.030783 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-42735e70-074e-4f39-8ad1-e704bacfd805 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:53.032263 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-42735e70-074e-4f39-8ad1-e704bacfd805 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:53.035597 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-42735e70-074e-4f39-8ad1-e704bacfd805 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:53.036835 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-42735e70-074e-4f39-8ad1-e704bacfd805 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:53.037469 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-42735e70-074e-4f39-8ad1-e704bacfd805 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:53.049574 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:08:53.073201 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-42735e70-074e-4f39-8ad1-e704bacfd805 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] HTTP exception thrown: Instance 2803303a-ad72-4096-b524-69a583a56f03 could not be found. Oct 26 13:08:53.076982 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-42735e70-074e-4f39-8ad1-e704bacfd805 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Request method failure captured: Oct 26 13:08:53.076982 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03 HTTP/1.1 Oct 26 13:08:53.076982 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:08:53.076982 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:08:53.076982 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:08:53.076982 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:08:53.076982 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:08:53.076982 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:08:53.076982 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:08:53.076982 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:08:53.076982 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTDWcY4mtHepJlQ55KVJtNHC-FXqIi903yr1J5OC-zbXOMs1LBU3zczKCFgnqIJBIqkvCLTFhaHFSdgfodLtkoXiluiPVf_SkgLznk0TL97DMnsRT29TeJsNzQAsUym5LCo50Ifxk2xlPnZ_QiGEmh7kAsukHuXMaWRZIS-UkeLc5o8 Oct 26 13:08:53.076982 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:08:53.076982 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:08:53.076982 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:08:53.076982 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:08:53.076982 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:08:53.076982 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:08:53.076982 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 186ac42922a64992aa1973bd854830d7 Oct 26 13:08:53.076982 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-778472214 Oct 26 13:08:53.076982 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:08:53.076982 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:08:53.078672 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/186ac42922a64992aa1973bd854830d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/186ac42922a64992aa1973bd854830d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_186ac42922a64992aa1973bd854830d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/186ac42922a64992aa1973bd854830d7"}]}] Oct 26 13:08:53.078672 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-778472214 Oct 26 13:08:53.078672 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 186ac42922a64992aa1973bd854830d7 Oct 26 13:08:53.078672 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-778472214 Oct 26 13:08:53.078672 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ImagesOneServerNegativeTestJSON-778472214-project Oct 26 13:08:53.078672 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:08:53.078672 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:08:53.078672 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 0b8d4ea396494628983bde1a97222f7d Oct 26 13:08:53.078672 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-778472214-project Oct 26 13:08:53.078672 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:08:53.078672 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 2803303a-ad72-4096-b524-69a583a56f03 could not be found. Oct 26 13:08:53.078672 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '2803303a-ad72-4096-b524-69a583a56f03'} Oct 26 13:08:53.079624 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:08:53.079624 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:53.079624 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:08:53.079624 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:08:53.079624 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:08:53.079624 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:08:53.079624 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:08:53.079624 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:08:53.079624 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:08:53.079624 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:08:53.079624 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2803303a-ad72-4096-b524-69a583a56f03 could not be found. Oct 26 13:08:53.079624 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:53.079624 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:53.079624 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:53.079624 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:53.079624 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:08:53.079624 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:08:53.079624 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:08:53.079624 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:08:53.079624 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:08:53.081589 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:08:53.081589 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:08:53.081589 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:08:53.081589 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:08:53.081589 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:08:53.081589 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:08:53.081589 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:08:53.081589 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:08:53.081589 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:08:53.081589 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2803303a-ad72-4096-b524-69a583a56f03 could not be found. Oct 26 13:08:53.081589 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:53.081589 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:53.081589 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:53.081589 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:53.081589 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:08:53.081589 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:08:53.081589 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:08:53.081589 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:08:53.081589 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2803303a-ad72-4096-b524-69a583a56f03 could not be found. Oct 26 13:08:53.081589 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:53.085854 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-42735e70-074e-4f39-8ad1-e704bacfd805 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Returning 404 to user: Instance 2803303a-ad72-4096-b524-69a583a56f03 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:08:53.089721 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-42735e70-074e-4f39-8ad1-e704bacfd805 tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03" status: 404 len: 111 microversion: 2.1 time: 0.087360 Oct 26 13:08:53.091793 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 841/1756] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:08:53 2022] DELETE /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:08:53.099943 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-99473e3d-7f39-46c4-9d26-8813a15ea76a tempest-SecurityGroupsNegativeTestJSON-1848595126 tempest-SecurityGroupsNegativeTestJSON-1848595126-project] Calling method '.version_select at 0x7f6732210af0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:53.168689 n-d-862686-1 devstack@n-api.service[120597]: DEBUG neutronclient.v2_0.client [None req-99473e3d-7f39-46c4-9d26-8813a15ea76a tempest-SecurityGroupsNegativeTestJSON-1848595126 tempest-SecurityGroupsNegativeTestJSON-1848595126-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 23c4de94-2dac-45bd-b4e3-512530ec2f42 does not exist", "detail": ""}} {{(pid=120597) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 26 13:08:53.170024 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.security_group_api [None req-99473e3d-7f39-46c4-9d26-8813a15ea76a tempest-SecurityGroupsNegativeTestJSON-1848595126 tempest-SecurityGroupsNegativeTestJSON-1848595126-project] Neutron security group 23c4de94-2dac-45bd-b4e3-512530ec2f42 not found {{(pid=120597) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 26 13:08:53.170863 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-99473e3d-7f39-46c4-9d26-8813a15ea76a tempest-SecurityGroupsNegativeTestJSON-1848595126 tempest-SecurityGroupsNegativeTestJSON-1848595126-project] HTTP exception thrown: Security group 23c4de94-2dac-45bd-b4e3-512530ec2f42 does not exist Oct 26 13:08:53.170863 n-d-862686-1 devstack@n-api.service[120597]: Neutron server returns request_ids: ['req-c5d04bc5-1e77-4523-b634-d1463a00150c'] Oct 26 13:08:53.173240 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-99473e3d-7f39-46c4-9d26-8813a15ea76a tempest-SecurityGroupsNegativeTestJSON-1848595126 tempest-SecurityGroupsNegativeTestJSON-1848595126-project] Request method failure captured: Oct 26 13:08:53.173240 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/os-security-groups/23c4de94-2dac-45bd-b4e3-512530ec2f42 HTTP/1.1 Oct 26 13:08:53.173240 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:08:53.173240 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:08:53.173240 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:08:53.173240 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:08:53.173240 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:08:53.173240 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:08:53.173240 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:08:53.173240 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:08:53.173240 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTFdaE40pB6kSh_NoLhOy9_BU1vUpivaf__BXDd63BmnWKihwXvkaa-NtM00PELoP87cD6B9-rrx8qWILPuMAFpv8PVELihazw9jjchVgvhq5XS4ZKPh1Jd-VmpUoMLy0QWWD0EsN-EVNU3jiZMzbCBcLggWGBZxtvaegkkd7ECW0JY Oct 26 13:08:53.173240 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:08:53.173240 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:08:53.173240 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:08:53.173240 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:08:53.173240 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:08:53.173240 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:08:53.173240 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: b6acfe71fe2345189524769e5dddeef2 Oct 26 13:08:53.173240 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1848595126 Oct 26 13:08:53.173240 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:08:53.173240 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:08:53.174721 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b6acfe71fe2345189524769e5dddeef2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b6acfe71fe2345189524769e5dddeef2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b6acfe71fe2345189524769e5dddeef2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b6acfe71fe2345189524769e5dddeef2"}]}] Oct 26 13:08:53.174721 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1848595126 Oct 26 13:08:53.174721 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: b6acfe71fe2345189524769e5dddeef2 Oct 26 13:08:53.174721 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1848595126 Oct 26 13:08:53.174721 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-SecurityGroupsNegativeTestJSON-1848595126-project Oct 26 13:08:53.174721 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:08:53.174721 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:08:53.174721 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 9f9e180693c643858afaca6be32e27f6 Oct 26 13:08:53.174721 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1848595126-project Oct 26 13:08:53.174721 n-d-862686-1 devstack@n-api.service[120597]: method: Oct 26 13:08:53.174721 n-d-862686-1 devstack@n-api.service[120597]: exception: Security group 23c4de94-2dac-45bd-b4e3-512530ec2f42 does not exist Oct 26 13:08:53.174721 n-d-862686-1 devstack@n-api.service[120597]: Neutron server returns request_ids: ['req-c5d04bc5-1e77-4523-b634-d1463a00150c'] Oct 26 13:08:53.174721 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '23c4de94-2dac-45bd-b4e3-512530ec2f42'} Oct 26 13:08:53.175683 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:08:53.175683 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:53.175683 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 26 13:08:53.175683 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 26 13:08:53.175683 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:08:53.175683 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:08:53.175683 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 26 13:08:53.175683 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 26 13:08:53.175683 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:08:53.175683 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:08:53.175683 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 26 13:08:53.175683 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 26 13:08:53.175683 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:08:53.175683 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:08:53.175683 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 26 13:08:53.175683 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 26 13:08:53.175683 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:08:53.175683 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:08:53.175683 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 26 13:08:53.178371 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 26 13:08:53.178371 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:08:53.178371 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:08:53.178371 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 26 13:08:53.178371 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 26 13:08:53.178371 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 26 13:08:53.178371 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 26 13:08:53.178371 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 23c4de94-2dac-45bd-b4e3-512530ec2f42 does not exist Oct 26 13:08:53.178371 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c5d04bc5-1e77-4523-b634-d1463a00150c'] Oct 26 13:08:53.178371 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:53.178371 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:53.178371 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:53.178371 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:53.178371 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 26 13:08:53.178371 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 26 13:08:53.178371 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 26 13:08:53.178371 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 26 13:08:53.178371 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 23c4de94-2dac-45bd-b4e3-512530ec2f42 does not exist Oct 26 13:08:53.179906 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c5d04bc5-1e77-4523-b634-d1463a00150c'] Oct 26 13:08:53.179906 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:53.179906 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:53.179906 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:53.179906 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:53.179906 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:08:53.179906 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:08:53.179906 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:08:53.179906 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:08:53.179906 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:08:53.179906 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:08:53.179906 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:08:53.179906 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:08:53.179906 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 26 13:08:53.179906 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 26 13:08:53.179906 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 23c4de94-2dac-45bd-b4e3-512530ec2f42 does not exist Oct 26 13:08:53.179906 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c5d04bc5-1e77-4523-b634-d1463a00150c'] Oct 26 13:08:53.179906 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:53.179906 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:53.179906 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:53.179906 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:53.181528 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:08:53.181528 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:08:53.181528 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:08:53.181528 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:08:53.181528 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 23c4de94-2dac-45bd-b4e3-512530ec2f42 does not exist Oct 26 13:08:53.181528 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c5d04bc5-1e77-4523-b634-d1463a00150c'] Oct 26 13:08:53.181528 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:53.183307 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-99473e3d-7f39-46c4-9d26-8813a15ea76a tempest-SecurityGroupsNegativeTestJSON-1848595126 tempest-SecurityGroupsNegativeTestJSON-1848595126-project] Returning 404 to user: Security group 23c4de94-2dac-45bd-b4e3-512530ec2f42 does not exist Oct 26 13:08:53.183307 n-d-862686-1 devstack@n-api.service[120597]: Neutron server returns request_ids: ['req-c5d04bc5-1e77-4523-b634-d1463a00150c'] {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:08:53.184400 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-99473e3d-7f39-46c4-9d26-8813a15ea76a tempest-SecurityGroupsNegativeTestJSON-1848595126 tempest-SecurityGroupsNegativeTestJSON-1848595126-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups/23c4de94-2dac-45bd-b4e3-512530ec2f42" status: 404 len: 194 microversion: 2.1 time: 0.091437 Oct 26 13:08:53.185967 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 842/1757] 10.222.0.40 () {58 vars in 1269 bytes} [Wed Oct 26 13:08:53 2022] GET /compute/v2.1/os-security-groups/23c4de94-2dac-45bd-b4e3-512530ec2f42 => generated 194 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:08:53.190282 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-132346dd-8efd-4b46-bc3d-8a2a31aefcbc tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] [instance: cdca1d32-5d8f-44da-9c3b-c8d11433df06] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:53.194222 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:08:53.194504 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f09b4aee-f252-4b0d-8962-33d181c2e87d tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:53.196039 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f09b4aee-f252-4b0d-8962-33d181c2e87d tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] [instance: 2803303a-ad72-4096-b524-69a583a56f03] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:53.198534 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-132346dd-8efd-4b46-bc3d-8a2a31aefcbc tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:53.199186 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-132346dd-8efd-4b46-bc3d-8a2a31aefcbc tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:53.203386 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-132346dd-8efd-4b46-bc3d-8a2a31aefcbc tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:53.205592 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-132346dd-8efd-4b46-bc3d-8a2a31aefcbc tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:53.206210 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-132346dd-8efd-4b46-bc3d-8a2a31aefcbc tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:53.206769 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-132346dd-8efd-4b46-bc3d-8a2a31aefcbc tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:53.208424 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f09b4aee-f252-4b0d-8962-33d181c2e87d tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:53.209564 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f09b4aee-f252-4b0d-8962-33d181c2e87d tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:53.210194 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f09b4aee-f252-4b0d-8962-33d181c2e87d tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:53.211074 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f09b4aee-f252-4b0d-8962-33d181c2e87d tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:53.211702 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f09b4aee-f252-4b0d-8962-33d181c2e87d tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:53.212285 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f09b4aee-f252-4b0d-8962-33d181c2e87d tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:53.249034 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-f09b4aee-f252-4b0d-8962-33d181c2e87d tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] HTTP exception thrown: Instance 2803303a-ad72-4096-b524-69a583a56f03 could not be found. Oct 26 13:08:53.253868 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f09b4aee-f252-4b0d-8962-33d181c2e87d tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Request method failure captured: Oct 26 13:08:53.253868 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03 HTTP/1.1 Oct 26 13:08:53.253868 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:08:53.253868 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:08:53.253868 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:08:53.253868 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:08:53.253868 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:08:53.253868 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:08:53.253868 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:08:53.253868 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:08:53.253868 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTDWcY4mtHepJlQ55KVJtNHC-FXqIi903yr1J5OC-zbXOMs1LBU3zczKCFgnqIJBIqkvCLTFhaHFSdgfodLtkoXiluiPVf_SkgLznk0TL97DMnsRT29TeJsNzQAsUym5LCo50Ifxk2xlPnZ_QiGEmh7kAsukHuXMaWRZIS-UkeLc5o8 Oct 26 13:08:53.253868 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:08:53.253868 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:08:53.253868 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:08:53.253868 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:08:53.253868 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:08:53.253868 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:08:53.253868 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 186ac42922a64992aa1973bd854830d7 Oct 26 13:08:53.253868 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-778472214 Oct 26 13:08:53.253868 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:08:53.253868 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:08:53.255945 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/186ac42922a64992aa1973bd854830d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/186ac42922a64992aa1973bd854830d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_186ac42922a64992aa1973bd854830d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/186ac42922a64992aa1973bd854830d7"}]}] Oct 26 13:08:53.255945 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-778472214 Oct 26 13:08:53.255945 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 186ac42922a64992aa1973bd854830d7 Oct 26 13:08:53.255945 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-778472214 Oct 26 13:08:53.255945 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ImagesOneServerNegativeTestJSON-778472214-project Oct 26 13:08:53.255945 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:08:53.255945 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:08:53.255945 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 0b8d4ea396494628983bde1a97222f7d Oct 26 13:08:53.255945 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-778472214-project Oct 26 13:08:53.255945 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:08:53.255945 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 2803303a-ad72-4096-b524-69a583a56f03 could not be found. Oct 26 13:08:53.255945 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '2803303a-ad72-4096-b524-69a583a56f03'} Oct 26 13:08:53.256850 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:08:53.256850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:53.256850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:08:53.256850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:08:53.256850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:08:53.256850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:08:53.256850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:08:53.256850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:08:53.256850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:08:53.256850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:08:53.256850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2803303a-ad72-4096-b524-69a583a56f03 could not be found. Oct 26 13:08:53.256850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:53.256850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:53.256850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:53.256850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:53.256850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:08:53.256850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:08:53.256850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:08:53.256850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:08:53.256850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:08:53.258684 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:08:53.258684 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:08:53.258684 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:08:53.258684 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:08:53.258684 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:08:53.258684 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:08:53.258684 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:08:53.258684 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2803303a-ad72-4096-b524-69a583a56f03 could not be found. Oct 26 13:08:53.258684 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:53.258684 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:53.258684 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:53.258684 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:53.258684 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:08:53.258684 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:08:53.258684 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:08:53.258684 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:08:53.258684 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2803303a-ad72-4096-b524-69a583a56f03 could not be found. Oct 26 13:08:53.258684 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:53.260124 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f09b4aee-f252-4b0d-8962-33d181c2e87d tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] Returning 404 to user: Instance 2803303a-ad72-4096-b524-69a583a56f03 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:08:53.260124 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f09b4aee-f252-4b0d-8962-33d181c2e87d tempest-ImagesOneServerNegativeTestJSON-778472214 tempest-ImagesOneServerNegativeTestJSON-778472214-project] 10.222.0.40 "GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03" status: 404 len: 111 microversion: 2.1 time: 0.068274 Oct 26 13:08:53.260124 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 843/1758] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:53 2022] GET /compute/v2.1/servers/2803303a-ad72-4096-b524-69a583a56f03 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:08:53.271746 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-45c18a45-4c37-444f-9eed-e14ff22c05fa tempest-SecurityGroupsNegativeTestJSON-1848595126 tempest-SecurityGroupsNegativeTestJSON-1848595126-project] Action: 'update', calling method: .version_select at 0x7f6732254dc0>, body: {"security_group": {"name": "tempest-sg-364835789", "description": "tempest-description-1755338935"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:08:53.383679 n-d-862686-1 devstack@n-api.service[120597]: DEBUG neutronclient.v2_0.client [None req-45c18a45-4c37-444f-9eed-e14ff22c05fa tempest-SecurityGroupsNegativeTestJSON-1848595126 tempest-SecurityGroupsNegativeTestJSON-1848595126-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 48ba2cab-59fc-460c-86fc-c5fa21e9cc04 does not exist", "detail": ""}} {{(pid=120597) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 26 13:08:53.384292 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.security_group_api [None req-45c18a45-4c37-444f-9eed-e14ff22c05fa tempest-SecurityGroupsNegativeTestJSON-1848595126 tempest-SecurityGroupsNegativeTestJSON-1848595126-project] Neutron security group 48ba2cab-59fc-460c-86fc-c5fa21e9cc04 not found {{(pid=120597) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 26 13:08:53.384802 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-45c18a45-4c37-444f-9eed-e14ff22c05fa tempest-SecurityGroupsNegativeTestJSON-1848595126 tempest-SecurityGroupsNegativeTestJSON-1848595126-project] HTTP exception thrown: Security group 48ba2cab-59fc-460c-86fc-c5fa21e9cc04 does not exist Oct 26 13:08:53.384802 n-d-862686-1 devstack@n-api.service[120597]: Neutron server returns request_ids: ['req-075b33af-694e-44dd-9dd6-f6cb0bf58710'] Oct 26 13:08:53.388738 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-45c18a45-4c37-444f-9eed-e14ff22c05fa tempest-SecurityGroupsNegativeTestJSON-1848595126 tempest-SecurityGroupsNegativeTestJSON-1848595126-project] Request method failure captured: Oct 26 13:08:53.388738 n-d-862686-1 devstack@n-api.service[120597]: request: PUT /compute/v2.1/os-security-groups/48ba2cab-59fc-460c-86fc-c5fa21e9cc04 HTTP/1.1 Oct 26 13:08:53.388738 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:08:53.388738 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:08:53.388738 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:08:53.388738 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 101 Oct 26 13:08:53.388738 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:08:53.388738 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:08:53.388738 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:08:53.388738 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:08:53.388738 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTFdaE40pB6kSh_NoLhOy9_BU1vUpivaf__BXDd63BmnWKihwXvkaa-NtM00PELoP87cD6B9-rrx8qWILPuMAFpv8PVELihazw9jjchVgvhq5XS4ZKPh1Jd-VmpUoMLy0QWWD0EsN-EVNU3jiZMzbCBcLggWGBZxtvaegkkd7ECW0JY Oct 26 13:08:53.388738 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:08:53.388738 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:08:53.388738 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:08:53.388738 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:08:53.388738 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:08:53.388738 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:08:53.388738 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: b6acfe71fe2345189524769e5dddeef2 Oct 26 13:08:53.388738 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1848595126 Oct 26 13:08:53.388738 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:08:53.388738 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:08:53.390389 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b6acfe71fe2345189524769e5dddeef2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b6acfe71fe2345189524769e5dddeef2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b6acfe71fe2345189524769e5dddeef2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b6acfe71fe2345189524769e5dddeef2"}]}] Oct 26 13:08:53.390389 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1848595126 Oct 26 13:08:53.390389 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: b6acfe71fe2345189524769e5dddeef2 Oct 26 13:08:53.390389 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1848595126 Oct 26 13:08:53.390389 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-SecurityGroupsNegativeTestJSON-1848595126-project Oct 26 13:08:53.390389 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:08:53.390389 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:08:53.390389 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 9f9e180693c643858afaca6be32e27f6 Oct 26 13:08:53.390389 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1848595126-project Oct 26 13:08:53.390389 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:08:53.390389 n-d-862686-1 devstack@n-api.service[120597]: {"security_group": {"name": "tempest-sg-364835789", "description": "tempest-description-1755338935"}} Oct 26 13:08:53.390389 n-d-862686-1 devstack@n-api.service[120597]: method: Oct 26 13:08:53.390389 n-d-862686-1 devstack@n-api.service[120597]: exception: Security group 48ba2cab-59fc-460c-86fc-c5fa21e9cc04 does not exist Oct 26 13:08:53.391440 n-d-862686-1 devstack@n-api.service[120597]: Neutron server returns request_ids: ['req-075b33af-694e-44dd-9dd6-f6cb0bf58710'] Oct 26 13:08:53.391440 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '48ba2cab-59fc-460c-86fc-c5fa21e9cc04', 'body': {'security_group': {'name': 'tempest-sg-364835789', 'description': 'tempest-description-1755338935'}}} Oct 26 13:08:53.391440 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:08:53.391440 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:53.391440 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 26 13:08:53.391440 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 26 13:08:53.391440 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:08:53.391440 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:08:53.391440 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 26 13:08:53.391440 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 26 13:08:53.391440 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:08:53.391440 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:08:53.391440 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 26 13:08:53.391440 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 26 13:08:53.391440 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:08:53.391440 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:08:53.391440 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 26 13:08:53.391440 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 26 13:08:53.393116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:08:53.393116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:08:53.393116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 26 13:08:53.393116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 26 13:08:53.393116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:08:53.393116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:08:53.393116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 26 13:08:53.393116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 26 13:08:53.393116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 26 13:08:53.393116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 26 13:08:53.393116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 48ba2cab-59fc-460c-86fc-c5fa21e9cc04 does not exist Oct 26 13:08:53.393116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-075b33af-694e-44dd-9dd6-f6cb0bf58710'] Oct 26 13:08:53.393116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:53.393116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:53.393116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:53.393116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:53.393116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 26 13:08:53.393116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 26 13:08:53.393116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 26 13:08:53.395015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 26 13:08:53.395015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 48ba2cab-59fc-460c-86fc-c5fa21e9cc04 does not exist Oct 26 13:08:53.395015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-075b33af-694e-44dd-9dd6-f6cb0bf58710'] Oct 26 13:08:53.395015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:53.395015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:53.395015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:53.395015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:53.395015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:08:53.395015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:08:53.395015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:08:53.395015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:08:53.395015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:08:53.395015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:08:53.395015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:08:53.395015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:08:53.395015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 26 13:08:53.395015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 26 13:08:53.395015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 48ba2cab-59fc-460c-86fc-c5fa21e9cc04 does not exist Oct 26 13:08:53.395015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-075b33af-694e-44dd-9dd6-f6cb0bf58710'] Oct 26 13:08:53.395015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:53.396859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:08:53.396859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:53.396859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:08:53.396859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:08:53.396859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:08:53.396859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:08:53.396859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:08:53.396859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 48ba2cab-59fc-460c-86fc-c5fa21e9cc04 does not exist Oct 26 13:08:53.396859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-075b33af-694e-44dd-9dd6-f6cb0bf58710'] Oct 26 13:08:53.396859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:08:53.396859 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-45c18a45-4c37-444f-9eed-e14ff22c05fa tempest-SecurityGroupsNegativeTestJSON-1848595126 tempest-SecurityGroupsNegativeTestJSON-1848595126-project] Returning 404 to user: Security group 48ba2cab-59fc-460c-86fc-c5fa21e9cc04 does not exist Oct 26 13:08:53.396859 n-d-862686-1 devstack@n-api.service[120597]: Neutron server returns request_ids: ['req-075b33af-694e-44dd-9dd6-f6cb0bf58710'] {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:08:53.396859 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-45c18a45-4c37-444f-9eed-e14ff22c05fa tempest-SecurityGroupsNegativeTestJSON-1848595126 tempest-SecurityGroupsNegativeTestJSON-1848595126-project] 10.222.0.40 "PUT /compute/v2.1/os-security-groups/48ba2cab-59fc-460c-86fc-c5fa21e9cc04" status: 404 len: 194 microversion: 2.1 time: 0.127745 Oct 26 13:08:53.397925 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 844/1759] 10.222.0.40 () {60 vars in 1290 bytes} [Wed Oct 26 13:08:53 2022] PUT /compute/v2.1/os-security-groups/48ba2cab-59fc-460c-86fc-c5fa21e9cc04 => generated 194 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:08:53.543061 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1d0553e6-d610-48b3-ae61-b0abc0fde8ef tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:53.543660 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1d0553e6-d610-48b3-ae61-b0abc0fde8ef tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: cb087101-2eda-4145-bdcc-41673edfcbb7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:53.554451 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d0553e6-d610-48b3-ae61-b0abc0fde8ef tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:53.555986 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d0553e6-d610-48b3-ae61-b0abc0fde8ef tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:53.556809 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d0553e6-d610-48b3-ae61-b0abc0fde8ef tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:53.561705 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d0553e6-d610-48b3-ae61-b0abc0fde8ef tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:53.563388 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d0553e6-d610-48b3-ae61-b0abc0fde8ef tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:53.564419 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d0553e6-d610-48b3-ae61-b0abc0fde8ef tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:54.245514 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-132346dd-8efd-4b46-bc3d-8a2a31aefcbc tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "refresh_cache-cdca1d32-5d8f-44da-9c3b-c8d11433df06" {{(pid=120598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 26 13:08:54.247750 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-132346dd-8efd-4b46-bc3d-8a2a31aefcbc tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquired lock "refresh_cache-cdca1d32-5d8f-44da-9c3b-c8d11433df06" {{(pid=120598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 26 13:08:54.709026 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1d0553e6-d610-48b3-ae61-b0abc0fde8ef tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:54.723234 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1d0553e6-d610-48b3-ae61-b0abc0fde8ef tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/cb087101-2eda-4145-bdcc-41673edfcbb7" status: 200 len: 1308 microversion: 2.1 time: 1.184502 Oct 26 13:08:54.724250 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 845/1760] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:53 2022] GET /compute/v2.1/servers/cb087101-2eda-4145-bdcc-41673edfcbb7 => generated 1308 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:08:54.761331 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-06efcb43-4e80-42db-ade8-078aa8536c82 req-f4f755be-68e9-4c48-b035-173eebfbde7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb087101-2eda-4145-bdcc-41673edfcbb7", "tag": "9caa8004-d404-4f87-9693-e2931b83f65c"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:08:54.785382 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-06efcb43-4e80-42db-ade8-078aa8536c82 req-f4f755be-68e9-4c48-b035-173eebfbde7f service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:54.799231 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-06efcb43-4e80-42db-ade8-078aa8536c82 req-f4f755be-68e9-4c48-b035-173eebfbde7f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:54.801118 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-06efcb43-4e80-42db-ade8-078aa8536c82 req-f4f755be-68e9-4c48-b035-173eebfbde7f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:54.832086 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-06efcb43-4e80-42db-ade8-078aa8536c82 req-f4f755be-68e9-4c48-b035-173eebfbde7f service nova] Creating event network-changed:9caa8004-d404-4f87-9693-e2931b83f65c for instance cb087101-2eda-4145-bdcc-41673edfcbb7 on n-h2-862686-1 Oct 26 13:08:54.843979 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-06efcb43-4e80-42db-ade8-078aa8536c82 req-f4f755be-68e9-4c48-b035-173eebfbde7f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117893 Oct 26 13:08:54.845862 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 846/1761] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:08:54.852913 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-18da337a-0531-4200-b323-5a91f351e98c tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:54.853969 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-18da337a-0531-4200-b323-5a91f351e98c tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:54.894779 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18da337a-0531-4200-b323-5a91f351e98c tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:54.895678 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18da337a-0531-4200-b323-5a91f351e98c tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:54.896671 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18da337a-0531-4200-b323-5a91f351e98c tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:54.902307 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18da337a-0531-4200-b323-5a91f351e98c tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:54.903057 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18da337a-0531-4200-b323-5a91f351e98c tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:54.903727 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18da337a-0531-4200-b323-5a91f351e98c tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:55.429394 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-18da337a-0531-4200-b323-5a91f351e98c tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:55.442337 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-18da337a-0531-4200-b323-5a91f351e98c tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:55.444411 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-18da337a-0531-4200-b323-5a91f351e98c tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:55.445832 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-18da337a-0531-4200-b323-5a91f351e98c tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 200 len: 1486 microversion: 2.25 time: 0.598397 Oct 26 13:08:55.446507 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 847/1762] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:08:54 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 1486 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:08:55.616474 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-132346dd-8efd-4b46-bc3d-8a2a31aefcbc tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] [instance: cdca1d32-5d8f-44da-9c3b-c8d11433df06] Building network info cache for instance {{(pid=120598) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 26 13:08:55.633277 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-d57d7a3a-726e-4707-8851-0c33c2e8ce5e req-9cb20417-3922-4b0c-9494-1a017dd07849 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdca1d32-5d8f-44da-9c3b-c8d11433df06", "tag": "7cca99b7-782b-4cb4-bf7d-e207183f2165"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:08:55.665676 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d57d7a3a-726e-4707-8851-0c33c2e8ce5e req-9cb20417-3922-4b0c-9494-1a017dd07849 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:55.669410 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d57d7a3a-726e-4707-8851-0c33c2e8ce5e req-9cb20417-3922-4b0c-9494-1a017dd07849 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:55.670135 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d57d7a3a-726e-4707-8851-0c33c2e8ce5e req-9cb20417-3922-4b0c-9494-1a017dd07849 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:55.691550 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-d57d7a3a-726e-4707-8851-0c33c2e8ce5e req-9cb20417-3922-4b0c-9494-1a017dd07849 service nova] Creating event network-changed:7cca99b7-782b-4cb4-bf7d-e207183f2165 for instance cdca1d32-5d8f-44da-9c3b-c8d11433df06 on n-h1-862686-1 Oct 26 13:08:55.703636 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-d57d7a3a-726e-4707-8851-0c33c2e8ce5e req-9cb20417-3922-4b0c-9494-1a017dd07849 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075339 Oct 26 13:08:55.705013 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 848/1763] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:08:55.752742 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d1b21539-1d51-4e1e-9df1-ec1393472558 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:55.754579 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d1b21539-1d51-4e1e-9df1-ec1393472558 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: cb087101-2eda-4145-bdcc-41673edfcbb7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:55.769211 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d1b21539-1d51-4e1e-9df1-ec1393472558 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:55.795437 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d1b21539-1d51-4e1e-9df1-ec1393472558 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:55.796401 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d1b21539-1d51-4e1e-9df1-ec1393472558 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:55.798382 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d1b21539-1d51-4e1e-9df1-ec1393472558 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:55.801424 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d1b21539-1d51-4e1e-9df1-ec1393472558 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:55.803187 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d1b21539-1d51-4e1e-9df1-ec1393472558 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:56.699824 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d1b21539-1d51-4e1e-9df1-ec1393472558 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:56.710361 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d1b21539-1d51-4e1e-9df1-ec1393472558 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/cb087101-2eda-4145-bdcc-41673edfcbb7" status: 200 len: 1308 microversion: 2.1 time: 0.962856 Oct 26 13:08:56.715476 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 849/1764] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:55 2022] GET /compute/v2.1/servers/cb087101-2eda-4145-bdcc-41673edfcbb7 => generated 1308 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:08:56.729382 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4edb7b54-00d9-4f30-8312-c95f849fd245 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:56.730302 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4edb7b54-00d9-4f30-8312-c95f849fd245 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:56.751364 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4edb7b54-00d9-4f30-8312-c95f849fd245 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:56.752780 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4edb7b54-00d9-4f30-8312-c95f849fd245 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:56.754650 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4edb7b54-00d9-4f30-8312-c95f849fd245 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:56.756009 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4edb7b54-00d9-4f30-8312-c95f849fd245 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:56.760303 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4edb7b54-00d9-4f30-8312-c95f849fd245 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:56.760985 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4edb7b54-00d9-4f30-8312-c95f849fd245 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:57.396639 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-132346dd-8efd-4b46-bc3d-8a2a31aefcbc tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] [instance: cdca1d32-5d8f-44da-9c3b-c8d11433df06] Updating instance_info_cache with network_info: [{"id": "7cca99b7-782b-4cb4-bf7d-e207183f2165", "address": "fa:16:3e:b3:ae:68", "network": {"id": "f3e49ff8-9efe-4bcf-b4e9-6739476549bb", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-727200659-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b86e36a2f7fc44daac11d122c492ba68", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap7cca99b7-78", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120598) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 26 13:08:57.420165 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-132346dd-8efd-4b46-bc3d-8a2a31aefcbc tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Releasing lock "refresh_cache-cdca1d32-5d8f-44da-9c3b-c8d11433df06" {{(pid=120598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 26 13:08:57.421514 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-132346dd-8efd-4b46-bc3d-8a2a31aefcbc tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] 10.222.0.40 "POST /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06/action" status: 202 len: 0 microversion: 2.1 time: 4.808239 Oct 26 13:08:57.425955 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 916/1765] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:08:52 2022] POST /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06/action => generated 0 bytes in 4813 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 26 13:08:57.439553 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2cc63816-9879-4167-aa0d-293c42a23a18 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Calling method '.version_select at 0x7f67369975e0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:58.169007 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=4 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:08:58.461067 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4edb7b54-00d9-4f30-8312-c95f849fd245 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:58.491502 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4edb7b54-00d9-4f30-8312-c95f849fd245 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:58.494474 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4edb7b54-00d9-4f30-8312-c95f849fd245 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:58.505522 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4edb7b54-00d9-4f30-8312-c95f849fd245 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 200 len: 1486 microversion: 2.25 time: 1.785464 Oct 26 13:08:58.506449 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 850/1766] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:08:56 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 1486 bytes in 1790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:08:58.515372 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d69ca84d-7a95-41bf-b2b3-81ca5ecad6f6 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:58.519749 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d69ca84d-7a95-41bf-b2b3-81ca5ecad6f6 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: cb087101-2eda-4145-bdcc-41673edfcbb7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:58.537185 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d69ca84d-7a95-41bf-b2b3-81ca5ecad6f6 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:58.545635 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d69ca84d-7a95-41bf-b2b3-81ca5ecad6f6 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:58.546099 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d69ca84d-7a95-41bf-b2b3-81ca5ecad6f6 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:58.546860 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d69ca84d-7a95-41bf-b2b3-81ca5ecad6f6 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:58.547326 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d69ca84d-7a95-41bf-b2b3-81ca5ecad6f6 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:58.547757 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d69ca84d-7a95-41bf-b2b3-81ca5ecad6f6 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:58.816102 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=10 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:08:59.321350 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d69ca84d-7a95-41bf-b2b3-81ca5ecad6f6 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:08:59.330031 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d69ca84d-7a95-41bf-b2b3-81ca5ecad6f6 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/cb087101-2eda-4145-bdcc-41673edfcbb7" status: 200 len: 1308 microversion: 2.1 time: 0.820605 Oct 26 13:08:59.353525 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 851/1767] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:08:58 2022] GET /compute/v2.1/servers/cb087101-2eda-4145-bdcc-41673edfcbb7 => generated 1308 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:08:59.548438 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a82ad606-6d7a-4a4a-9ded-fcb65cf2285b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:08:59.549228 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a82ad606-6d7a-4a4a-9ded-fcb65cf2285b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:08:59.569349 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a82ad606-6d7a-4a4a-9ded-fcb65cf2285b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:59.571194 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a82ad606-6d7a-4a4a-9ded-fcb65cf2285b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:59.577910 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a82ad606-6d7a-4a4a-9ded-fcb65cf2285b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:08:59.579665 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a82ad606-6d7a-4a4a-9ded-fcb65cf2285b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:08:59.580342 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a82ad606-6d7a-4a4a-9ded-fcb65cf2285b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:08:59.580992 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a82ad606-6d7a-4a4a-9ded-fcb65cf2285b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:00.224587 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a82ad606-6d7a-4a4a-9ded-fcb65cf2285b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:00.254935 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a82ad606-6d7a-4a4a-9ded-fcb65cf2285b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:00.259362 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a82ad606-6d7a-4a4a-9ded-fcb65cf2285b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:00.264771 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a82ad606-6d7a-4a4a-9ded-fcb65cf2285b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 200 len: 1486 microversion: 2.25 time: 0.720019 Oct 26 13:09:00.267495 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 852/1768] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:08:59 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 1486 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:09:00.365700 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a44ba633-b459-4e24-af40-b40114ad8584 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:00.366322 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a44ba633-b459-4e24-af40-b40114ad8584 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: cb087101-2eda-4145-bdcc-41673edfcbb7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:00.387302 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a44ba633-b459-4e24-af40-b40114ad8584 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:00.387909 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a44ba633-b459-4e24-af40-b40114ad8584 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:00.388372 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a44ba633-b459-4e24-af40-b40114ad8584 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:00.389112 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a44ba633-b459-4e24-af40-b40114ad8584 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:00.394197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a44ba633-b459-4e24-af40-b40114ad8584 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:00.395767 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a44ba633-b459-4e24-af40-b40114ad8584 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:00.422916 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2cc63816-9879-4167-aa0d-293c42a23a18 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/c2272e2b-2ded-4969-b193-f76b800a4670" status: 202 len: 0 microversion: 2.1 time: 2.994832 Oct 26 13:09:00.428679 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 917/1769] 10.222.0.40 () {58 vars in 1263 bytes} [Wed Oct 26 13:08:57 2022] DELETE /compute/v2.1/os-floating-ips/c2272e2b-2ded-4969-b193-f76b800a4670 => generated 0 bytes in 3002 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:09:00.440207 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c087d964-20e6-4041-8f27-a6531f37f125 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:00.455990 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c087d964-20e6-4041-8f27-a6531f37f125 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Request method failure captured: Oct 26 13:09:00.455990 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06/action HTTP/1.1 Oct 26 13:09:00.455990 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:09:00.455990 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:09:00.455990 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:09:00.455990 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 34 Oct 26 13:09:00.455990 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:09:00.455990 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:09:00.455990 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:09:00.455990 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:09:00.455990 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTEyN7KOWBDZ6tavoWYwvFvv3R2kkimdK9s2yUsufV6fgY7GMpFZmN5v6IpKkskubRIZ0sYcCsVc1H3e7reKAMuC1hpK0WDLZiuSPbwYOtrULpaL4vWsedQVrSuTHE0J2u6T2i1J9ErKEFkr8pVpiZAcT6erIdcDGIEmd54UV-ozGe0 Oct 26 13:09:00.455990 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:09:00.455990 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:09:00.455990 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:09:00.455990 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:09:00.455990 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:09:00.455990 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:09:00.455990 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: b86e36a2f7fc44daac11d122c492ba68 Oct 26 13:09:00.455990 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 Oct 26 13:09:00.455990 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:09:00.455990 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:09:00.458366 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b86e36a2f7fc44daac11d122c492ba68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b86e36a2f7fc44daac11d122c492ba68"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b86e36a2f7fc44daac11d122c492ba68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b86e36a2f7fc44daac11d122c492ba68"}]}] Oct 26 13:09:00.458366 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 Oct 26 13:09:00.458366 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: b86e36a2f7fc44daac11d122c492ba68 Oct 26 13:09:00.458366 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 Oct 26 13:09:00.458366 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project Oct 26 13:09:00.458366 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:09:00.458366 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:09:00.458366 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: ec3945207e6a490fb1baa5eaefcfeaf5 Oct 26 13:09:00.458366 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project Oct 26 13:09:00.458366 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:09:00.458366 n-d-862686-1 devstack@n-api.service[120598]: {"addFloatingIp": {"address": ""}} Oct 26 13:09:00.458366 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:09:00.458366 n-d-862686-1 devstack@n-api.service[120598]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 26 13:09:00.459512 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'cdca1d32-5d8f-44da-9c3b-c8d11433df06', 'body': {'addFloatingIp': {'address': ''}}} Oct 26 13:09:00.459512 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:09:00.459512 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:00.459512 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 13:09:00.459512 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 13:09:00.459512 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 13:09:00.459512 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise error Oct 26 13:09:00.459512 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 26 13:09:00.459512 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:00.459512 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 26 13:09:00.459512 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 26 13:09:00.459512 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:00.459512 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 26 13:09:00.459512 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi '' Oct 26 13:09:00.459512 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:00.459512 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:09:00.459512 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:00.459512 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:00.459512 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:09:00.459512 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:09:00.459512 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:09:00.459512 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:09:00.461380 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:09:00.461380 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:09:00.461380 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:09:00.461380 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:09:00.461380 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 13:09:00.461380 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 13:09:00.461380 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 13:09:00.461380 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 13:09:00.461380 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 13:09:00.461380 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 13:09:00.461380 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 26 13:09:00.461380 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:00.461380 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:09:00.461380 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:00.461380 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:00.461380 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:09:00.461380 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:09:00.461380 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 13:09:00.461380 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 13:09:00.462893 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 26 13:09:00.462893 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:00.462893 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c087d964-20e6-4041-8f27-a6531f37f125 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:09:00.469271 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c087d964-20e6-4041-8f27-a6531f37f125 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] 10.222.0.40 "POST /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06/action" status: 400 len: 142 microversion: 2.1 time: 0.029403 Oct 26 13:09:00.470222 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 918/1770] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:09:00 2022] POST /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06/action => generated 142 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 26 13:09:00.482767 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-75c918c2-fdb5-4620-ba0f-b94c2bf9b56c tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:00.497047 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-75c918c2-fdb5-4620-ba0f-b94c2bf9b56c tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] [instance: cdca1d32-5d8f-44da-9c3b-c8d11433df06] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:00.514695 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-75c918c2-fdb5-4620-ba0f-b94c2bf9b56c tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:00.515509 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-75c918c2-fdb5-4620-ba0f-b94c2bf9b56c tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:00.516291 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-75c918c2-fdb5-4620-ba0f-b94c2bf9b56c tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:00.517190 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-75c918c2-fdb5-4620-ba0f-b94c2bf9b56c tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:00.518156 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-75c918c2-fdb5-4620-ba0f-b94c2bf9b56c tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:00.518760 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-75c918c2-fdb5-4620-ba0f-b94c2bf9b56c tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:00.581884 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-75c918c2-fdb5-4620-ba0f-b94c2bf9b56c tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "refresh_cache-cdca1d32-5d8f-44da-9c3b-c8d11433df06" {{(pid=120598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 26 13:09:00.582578 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-75c918c2-fdb5-4620-ba0f-b94c2bf9b56c tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquired lock "refresh_cache-cdca1d32-5d8f-44da-9c3b-c8d11433df06" {{(pid=120598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 26 13:09:01.012654 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-75c918c2-fdb5-4620-ba0f-b94c2bf9b56c tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Releasing lock "refresh_cache-cdca1d32-5d8f-44da-9c3b-c8d11433df06" {{(pid=120598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 26 13:09:01.013245 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-75c918c2-fdb5-4620-ba0f-b94c2bf9b56c tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] HTTP exception thrown: floating IP not found Oct 26 13:09:01.015051 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-75c918c2-fdb5-4620-ba0f-b94c2bf9b56c tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Request method failure captured: Oct 26 13:09:01.015051 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06/action HTTP/1.1 Oct 26 13:09:01.015051 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:09:01.015051 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:09:01.015051 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:09:01.015051 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 41 Oct 26 13:09:01.015051 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:09:01.015051 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:09:01.015051 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:09:01.015051 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:09:01.015051 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTEyN7KOWBDZ6tavoWYwvFvv3R2kkimdK9s2yUsufV6fgY7GMpFZmN5v6IpKkskubRIZ0sYcCsVc1H3e7reKAMuC1hpK0WDLZiuSPbwYOtrULpaL4vWsedQVrSuTHE0J2u6T2i1J9ErKEFkr8pVpiZAcT6erIdcDGIEmd54UV-ozGe0 Oct 26 13:09:01.015051 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:09:01.015051 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:09:01.015051 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:09:01.015051 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:09:01.015051 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:09:01.015051 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:09:01.015051 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: b86e36a2f7fc44daac11d122c492ba68 Oct 26 13:09:01.015051 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 Oct 26 13:09:01.015051 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:09:01.015051 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:09:01.016848 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b86e36a2f7fc44daac11d122c492ba68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b86e36a2f7fc44daac11d122c492ba68"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b86e36a2f7fc44daac11d122c492ba68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b86e36a2f7fc44daac11d122c492ba68"}]}] Oct 26 13:09:01.016848 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 Oct 26 13:09:01.016848 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: b86e36a2f7fc44daac11d122c492ba68 Oct 26 13:09:01.016848 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 Oct 26 13:09:01.016848 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project Oct 26 13:09:01.016848 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:09:01.016848 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:09:01.016848 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: ec3945207e6a490fb1baa5eaefcfeaf5 Oct 26 13:09:01.016848 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project Oct 26 13:09:01.016848 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:09:01.016848 n-d-862686-1 devstack@n-api.service[120598]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 26 13:09:01.016848 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:09:01.016848 n-d-862686-1 devstack@n-api.service[120598]: exception: floating IP not found Oct 26 13:09:01.018796 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'cdca1d32-5d8f-44da-9c3b-c8d11433df06', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 26 13:09:01.018796 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:09:01.018796 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:01.018796 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 26 13:09:01.018796 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 26 13:09:01.018796 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 26 13:09:01.018796 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 26 13:09:01.018796 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 26 13:09:01.018796 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 26 13:09:01.018796 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 26 13:09:01.018796 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 26 13:09:01.018796 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 26 13:09:01.018796 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:01.018796 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:09:01.018796 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:01.018796 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:01.018796 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:09:01.018796 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:09:01.018796 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:09:01.020219 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:09:01.020219 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:09:01.020219 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:09:01.020219 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:09:01.020219 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:09:01.020219 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:09:01.020219 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:09:01.020219 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 26 13:09:01.020219 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 26 13:09:01.020219 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 26 13:09:01.020219 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:01.020219 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:09:01.020219 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:01.020219 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:01.020219 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:09:01.020219 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:09:01.020219 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:09:01.020219 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:09:01.020219 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 26 13:09:01.020219 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:01.022070 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-75c918c2-fdb5-4620-ba0f-b94c2bf9b56c tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Returning 404 to user: floating IP not found {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:09:01.022070 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-75c918c2-fdb5-4620-ba0f-b94c2bf9b56c tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] 10.222.0.40 "POST /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06/action" status: 404 len: 67 microversion: 2.1 time: 0.540742 Oct 26 13:09:01.022070 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 919/1771] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:09:00 2022] POST /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06/action => generated 67 bytes in 542 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:09:01.028216 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a518d3df-54e2-4f20-b1b2-c909db7e51d4 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:01.206940 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-a518d3df-54e2-4f20-b1b2-c909db7e51d4 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 26 13:09:01.208941 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a518d3df-54e2-4f20-b1b2-c909db7e51d4 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Request method failure captured: Oct 26 13:09:01.208941 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06/action HTTP/1.1 Oct 26 13:09:01.208941 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:09:01.208941 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:09:01.208941 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:09:01.208941 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 44 Oct 26 13:09:01.208941 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:09:01.208941 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:09:01.208941 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:09:01.208941 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:09:01.208941 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTEyN7KOWBDZ6tavoWYwvFvv3R2kkimdK9s2yUsufV6fgY7GMpFZmN5v6IpKkskubRIZ0sYcCsVc1H3e7reKAMuC1hpK0WDLZiuSPbwYOtrULpaL4vWsedQVrSuTHE0J2u6T2i1J9ErKEFkr8pVpiZAcT6erIdcDGIEmd54UV-ozGe0 Oct 26 13:09:01.208941 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:09:01.208941 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:09:01.208941 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:09:01.208941 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:09:01.208941 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:09:01.208941 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:09:01.208941 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: b86e36a2f7fc44daac11d122c492ba68 Oct 26 13:09:01.208941 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 Oct 26 13:09:01.208941 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:09:01.208941 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:09:01.210737 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b86e36a2f7fc44daac11d122c492ba68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b86e36a2f7fc44daac11d122c492ba68"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b86e36a2f7fc44daac11d122c492ba68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b86e36a2f7fc44daac11d122c492ba68"}]}] Oct 26 13:09:01.210737 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 Oct 26 13:09:01.210737 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: b86e36a2f7fc44daac11d122c492ba68 Oct 26 13:09:01.210737 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 Oct 26 13:09:01.210737 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project Oct 26 13:09:01.210737 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:09:01.210737 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:09:01.210737 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: ec3945207e6a490fb1baa5eaefcfeaf5 Oct 26 13:09:01.210737 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project Oct 26 13:09:01.210737 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:09:01.210737 n-d-862686-1 devstack@n-api.service[120598]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 26 13:09:01.210737 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:09:01.210737 n-d-862686-1 devstack@n-api.service[120598]: exception: Floating IP not found for address 0.0.0.0. Oct 26 13:09:01.211966 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'cdca1d32-5d8f-44da-9c3b-c8d11433df06', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 26 13:09:01.211966 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:09:01.211966 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:01.211966 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 26 13:09:01.211966 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 26 13:09:01.211966 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 26 13:09:01.211966 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 26 13:09:01.211966 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 26 13:09:01.211966 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 26 13:09:01.211966 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 26 13:09:01.211966 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:01.211966 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:09:01.211966 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:01.211966 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:01.211966 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:09:01.211966 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:09:01.211966 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:09:01.211966 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:09:01.211966 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:09:01.213318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:09:01.213318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:09:01.213318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:09:01.213318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:09:01.213318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:09:01.213318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 26 13:09:01.213318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 26 13:09:01.213318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 26 13:09:01.213318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 26 13:09:01.213318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 26 13:09:01.213318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:01.213318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:09:01.213318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:01.213318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:01.213318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:09:01.213318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:09:01.213318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:09:01.213318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:09:01.213318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 26 13:09:01.213318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:01.216674 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a518d3df-54e2-4f20-b1b2-c909db7e51d4 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:09:01.216674 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a518d3df-54e2-4f20-b1b2-c909db7e51d4 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] 10.222.0.40 "POST /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06/action" status: 404 len: 88 microversion: 2.1 time: 0.186894 Oct 26 13:09:01.216674 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 920/1772] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:09:01 2022] POST /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06/action => generated 88 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:09:01.224031 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e650060a-fccf-4949-8678-7b5f6f28f513 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:01.225869 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e650060a-fccf-4949-8678-7b5f6f28f513 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] [instance: cdca1d32-5d8f-44da-9c3b-c8d11433df06] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:01.251338 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e650060a-fccf-4949-8678-7b5f6f28f513 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:01.251338 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e650060a-fccf-4949-8678-7b5f6f28f513 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:01.251338 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e650060a-fccf-4949-8678-7b5f6f28f513 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:01.251802 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e650060a-fccf-4949-8678-7b5f6f28f513 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:01.251897 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e650060a-fccf-4949-8678-7b5f6f28f513 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:01.252272 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e650060a-fccf-4949-8678-7b5f6f28f513 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:01.341967 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e650060a-fccf-4949-8678-7b5f6f28f513 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] [instance: cdca1d32-5d8f-44da-9c3b-c8d11433df06] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:09:01.554860 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e650060a-fccf-4949-8678-7b5f6f28f513 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] 10.222.0.40 "DELETE /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06" status: 204 len: 0 microversion: 2.1 time: 0.334936 Oct 26 13:09:01.560141 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 921/1773] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:09:01 2022] DELETE /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:09:01.567849 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-83ab3f32-0bbb-4351-a9a5-c94f3c6007a6 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:01.568863 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-83ab3f32-0bbb-4351-a9a5-c94f3c6007a6 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:01.577386 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83ab3f32-0bbb-4351-a9a5-c94f3c6007a6 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:01.578679 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83ab3f32-0bbb-4351-a9a5-c94f3c6007a6 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:01.579673 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83ab3f32-0bbb-4351-a9a5-c94f3c6007a6 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:01.580793 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83ab3f32-0bbb-4351-a9a5-c94f3c6007a6 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:01.581425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83ab3f32-0bbb-4351-a9a5-c94f3c6007a6 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:01.582040 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83ab3f32-0bbb-4351-a9a5-c94f3c6007a6 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:02.015128 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-83ab3f32-0bbb-4351-a9a5-c94f3c6007a6 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:02.030467 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-83ab3f32-0bbb-4351-a9a5-c94f3c6007a6 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:02.038065 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-83ab3f32-0bbb-4351-a9a5-c94f3c6007a6 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:02.054318 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-83ab3f32-0bbb-4351-a9a5-c94f3c6007a6 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 200 len: 1486 microversion: 2.25 time: 0.491928 Oct 26 13:09:02.056920 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 922/1774] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:09:01 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 1486 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:09:02.084472 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9b49da92-0c48-497e-87f4-b79622e621c6 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:02.092323 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9b49da92-0c48-497e-87f4-b79622e621c6 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] [instance: cdca1d32-5d8f-44da-9c3b-c8d11433df06] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:02.108260 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b49da92-0c48-497e-87f4-b79622e621c6 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:02.110297 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b49da92-0c48-497e-87f4-b79622e621c6 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:02.110968 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b49da92-0c48-497e-87f4-b79622e621c6 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:02.112248 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b49da92-0c48-497e-87f4-b79622e621c6 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:02.112852 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b49da92-0c48-497e-87f4-b79622e621c6 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:02.113590 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b49da92-0c48-497e-87f4-b79622e621c6 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:02.123759 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=5,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:09:02.479532 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a44ba633-b459-4e24-af40-b40114ad8584 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:02.491321 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a44ba633-b459-4e24-af40-b40114ad8584 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/cb087101-2eda-4145-bdcc-41673edfcbb7" status: 200 len: 1308 microversion: 2.1 time: 2.130775 Oct 26 13:09:02.492973 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 853/1775] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:00 2022] GET /compute/v2.1/servers/cb087101-2eda-4145-bdcc-41673edfcbb7 => generated 1308 bytes in 2132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:09:02.499586 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-3344b2d7-8b3a-4789-aa6a-e220941bd1e5 req-c2bbeb63-a7c9-4632-bafe-cc9d53bb9d85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb087101-2eda-4145-bdcc-41673edfcbb7", "name": "network-vif-plugged", "status": "completed", "tag": "9caa8004-d404-4f87-9693-e2931b83f65c"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:02.504834 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9b49da92-0c48-497e-87f4-b79622e621c6 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec3945207e6a490fb1baa5eaefcfeaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86e36a2f7fc44daac11d122c492ba68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:02.520417 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9b49da92-0c48-497e-87f4-b79622e621c6 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] 10.222.0.40 "GET /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06" status: 200 len: 1541 microversion: 2.1 time: 0.459979 Oct 26 13:09:02.521292 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 923/1776] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:02 2022] GET /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06 => generated 1541 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:02.535611 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-3344b2d7-8b3a-4789-aa6a-e220941bd1e5 req-c2bbeb63-a7c9-4632-bafe-cc9d53bb9d85 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:02.542072 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-3344b2d7-8b3a-4789-aa6a-e220941bd1e5 req-c2bbeb63-a7c9-4632-bafe-cc9d53bb9d85 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:02.542713 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-3344b2d7-8b3a-4789-aa6a-e220941bd1e5 req-c2bbeb63-a7c9-4632-bafe-cc9d53bb9d85 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:02.572379 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-3344b2d7-8b3a-4789-aa6a-e220941bd1e5 req-c2bbeb63-a7c9-4632-bafe-cc9d53bb9d85 service nova] Creating event network-vif-plugged:9caa8004-d404-4f87-9693-e2931b83f65c for instance cb087101-2eda-4145-bdcc-41673edfcbb7 on n-h2-862686-1 Oct 26 13:09:02.591781 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-3344b2d7-8b3a-4789-aa6a-e220941bd1e5 req-c2bbeb63-a7c9-4632-bafe-cc9d53bb9d85 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097371 Oct 26 13:09:02.592832 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 854/1777] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:03.087802 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1ce4aecd-8f2f-4b35-a8ee-d491f226c96f tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:03.089941 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1ce4aecd-8f2f-4b35-a8ee-d491f226c96f tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:03.108850 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ce4aecd-8f2f-4b35-a8ee-d491f226c96f tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:03.112375 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ce4aecd-8f2f-4b35-a8ee-d491f226c96f tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:03.117913 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ce4aecd-8f2f-4b35-a8ee-d491f226c96f tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:03.119099 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ce4aecd-8f2f-4b35-a8ee-d491f226c96f tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:03.121000 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ce4aecd-8f2f-4b35-a8ee-d491f226c96f tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:03.126146 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ce4aecd-8f2f-4b35-a8ee-d491f226c96f tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:03.154732 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=12,nova_cell0:UPDATE=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:09:03.469514 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-556ef1f3-99af-4515-8d81-08f969d4a591 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1043010776", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:03.544008 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1ce4aecd-8f2f-4b35-a8ee-d491f226c96f tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:03.555731 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1ce4aecd-8f2f-4b35-a8ee-d491f226c96f tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:03.560232 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1ce4aecd-8f2f-4b35-a8ee-d491f226c96f tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:03.565658 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1ce4aecd-8f2f-4b35-a8ee-d491f226c96f tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 200 len: 1486 microversion: 2.25 time: 0.480863 Oct 26 13:09:03.582568 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-556ef1f3-99af-4515-8d81-08f969d4a591 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] validate_networks() for None {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:09:03.588214 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 924/1778] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:09:03 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 1486 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:09:03.908734 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7d25cf01-b9f3-4077-9642-1a253e346ead tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Action: 'create', calling method: .version_select at 0x7f673690ab80>, body: {"keypair": {"name": "tempest-keypair-587871191", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFm8O8SAM3fBTdNEnRcmUUllCjK6yrjx2/MET9gO517JBnnJUonobqCtiaDhKTLFx1D8hMIJdCeJmob3/e1I+h7rX/QFNg4xHs2lMm+PEJSIuUVGJ/X16QKC/qwqtShn5g=="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:03.930181 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-7d25cf01-b9f3-4077-9642-1a253e346ead tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Getting quotas for project 2336994846d345aa86b5fd940d1b004f. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:09:03.941312 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-7d25cf01-b9f3-4077-9642-1a253e346ead tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Getting quotas for user cb4c9b05864d4d448b1c722659a3bc21 and project 2336994846d345aa86b5fd940d1b004f. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:09:03.978514 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7d25cf01-b9f3-4077-9642-1a253e346ead tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.388794 Oct 26 13:09:03.979685 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 925/1779] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 13:09:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:03.984389 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-95f7941c-b32f-45cf-822b-8d6bc05c147b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:03.986864 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-95f7941c-b32f-45cf-822b-8d6bc05c147b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: cb087101-2eda-4145-bdcc-41673edfcbb7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:04.000164 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-95f7941c-b32f-45cf-822b-8d6bc05c147b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:04.001238 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-95f7941c-b32f-45cf-822b-8d6bc05c147b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:04.001921 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-95f7941c-b32f-45cf-822b-8d6bc05c147b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:04.002817 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-95f7941c-b32f-45cf-822b-8d6bc05c147b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:04.003478 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-95f7941c-b32f-45cf-822b-8d6bc05c147b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:04.004088 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-95f7941c-b32f-45cf-822b-8d6bc05c147b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:04.422836 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-95f7941c-b32f-45cf-822b-8d6bc05c147b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:04.437676 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-95f7941c-b32f-45cf-822b-8d6bc05c147b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/cb087101-2eda-4145-bdcc-41673edfcbb7" status: 200 len: 1308 microversion: 2.1 time: 0.452753 Oct 26 13:09:04.450113 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 926/1780] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:03 2022] GET /compute/v2.1/servers/cb087101-2eda-4145-bdcc-41673edfcbb7 => generated 1308 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:04.475206 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7e09c713-b04d-4f15-bae7-8d8777e14973 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:04.478274 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7e09c713-b04d-4f15-bae7-8d8777e14973 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] [instance: cdca1d32-5d8f-44da-9c3b-c8d11433df06] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:04.501911 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e09c713-b04d-4f15-bae7-8d8777e14973 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:04.505730 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e09c713-b04d-4f15-bae7-8d8777e14973 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:04.506438 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e09c713-b04d-4f15-bae7-8d8777e14973 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:04.509830 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e09c713-b04d-4f15-bae7-8d8777e14973 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:04.510782 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e09c713-b04d-4f15-bae7-8d8777e14973 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:04.511483 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e09c713-b04d-4f15-bae7-8d8777e14973 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:04.864848 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7e09c713-b04d-4f15-bae7-8d8777e14973 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec3945207e6a490fb1baa5eaefcfeaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86e36a2f7fc44daac11d122c492ba68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:04.884047 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7e09c713-b04d-4f15-bae7-8d8777e14973 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] 10.222.0.40 "GET /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06" status: 200 len: 1541 microversion: 2.1 time: 0.432000 Oct 26 13:09:04.884819 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 927/1781] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:04 2022] GET /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06 => generated 1541 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:04.889708 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0664d9cc-c1d2-4015-bf71-21d24339f11a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:04.890670 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0664d9cc-c1d2-4015-bf71-21d24339f11a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:04.903975 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0664d9cc-c1d2-4015-bf71-21d24339f11a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:04.904466 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0664d9cc-c1d2-4015-bf71-21d24339f11a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:04.907882 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0664d9cc-c1d2-4015-bf71-21d24339f11a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:04.908707 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0664d9cc-c1d2-4015-bf71-21d24339f11a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:04.909177 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0664d9cc-c1d2-4015-bf71-21d24339f11a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:04.909832 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0664d9cc-c1d2-4015-bf71-21d24339f11a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:04.951689 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-556ef1f3-99af-4515-8d81-08f969d4a591 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:09:04.952169 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-556ef1f3-99af-4515-8d81-08f969d4a591 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:09:04.952615 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-556ef1f3-99af-4515-8d81-08f969d4a591 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:09:04.953090 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-556ef1f3-99af-4515-8d81-08f969d4a591 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:09:04.953452 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-556ef1f3-99af-4515-8d81-08f969d4a591 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:09:04.967912 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-556ef1f3-99af-4515-8d81-08f969d4a591 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:04.968405 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-556ef1f3-99af-4515-8d81-08f969d4a591 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:04.968840 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-556ef1f3-99af-4515-8d81-08f969d4a591 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:04.969597 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-556ef1f3-99af-4515-8d81-08f969d4a591 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:04.970060 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-556ef1f3-99af-4515-8d81-08f969d4a591 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:04.970481 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-556ef1f3-99af-4515-8d81-08f969d4a591 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:05.041266 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-556ef1f3-99af-4515-8d81-08f969d4a591 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Getting quotas for project 6f3d3f7efed04d7fb58147bc2ed55349. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:09:05.049755 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-556ef1f3-99af-4515-8d81-08f969d4a591 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Getting quotas for user 1bb3f2b0e3cc4326a1846f6755882dda and project 6f3d3f7efed04d7fb58147bc2ed55349. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:09:05.108876 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-556ef1f3-99af-4515-8d81-08f969d4a591 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:09:05.116523 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-556ef1f3-99af-4515-8d81-08f969d4a591 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] [instance: bbb44881-d590-4635-8c38-f107f70eaaa3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:09:05.226187 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-556ef1f3-99af-4515-8d81-08f969d4a591 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.078042 Oct 26 13:09:05.226857 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 855/1782] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:09:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:09:05.243971 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9c99253a-958a-46fd-9dd7-f3509816e68a tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:05.244986 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9c99253a-958a-46fd-9dd7-f3509816e68a tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] [instance: bbb44881-d590-4635-8c38-f107f70eaaa3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:05.630071 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9c99253a-958a-46fd-9dd7-f3509816e68a tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb3f2b0e3cc4326a1846f6755882dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f3d3f7efed04d7fb58147bc2ed55349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:05.642985 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9c99253a-958a-46fd-9dd7-f3509816e68a tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb44881-d590-4635-8c38-f107f70eaaa3" status: 200 len: 1214 microversion: 2.1 time: 0.405515 Oct 26 13:09:05.670323 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 856/1783] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:05 2022] GET /compute/v2.1/servers/bbb44881-d590-4635-8c38-f107f70eaaa3 => generated 1214 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:05.687910 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2ae9f5a2-35e9-4f46-b770-56b1069ed52a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:05.688993 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2ae9f5a2-35e9-4f46-b770-56b1069ed52a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: cb087101-2eda-4145-bdcc-41673edfcbb7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:05.715517 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ae9f5a2-35e9-4f46-b770-56b1069ed52a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:05.716462 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ae9f5a2-35e9-4f46-b770-56b1069ed52a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:05.717169 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ae9f5a2-35e9-4f46-b770-56b1069ed52a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:05.718491 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ae9f5a2-35e9-4f46-b770-56b1069ed52a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:05.719076 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ae9f5a2-35e9-4f46-b770-56b1069ed52a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:05.719690 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ae9f5a2-35e9-4f46-b770-56b1069ed52a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:05.945682 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0664d9cc-c1d2-4015-bf71-21d24339f11a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:05.962926 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0664d9cc-c1d2-4015-bf71-21d24339f11a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:05.969172 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0664d9cc-c1d2-4015-bf71-21d24339f11a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:05.983442 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0664d9cc-c1d2-4015-bf71-21d24339f11a tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 200 len: 1486 microversion: 2.25 time: 1.087679 Oct 26 13:09:05.984334 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 928/1784] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:09:04 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 1486 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:09:05.990524 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-34f7266c-9975-47d0-8048-80c4e4c32eaa tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:05.991349 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-34f7266c-9975-47d0-8048-80c4e4c32eaa tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] [instance: cdca1d32-5d8f-44da-9c3b-c8d11433df06] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:06.013407 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-34f7266c-9975-47d0-8048-80c4e4c32eaa tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:06.014236 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-34f7266c-9975-47d0-8048-80c4e4c32eaa tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:06.014997 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-34f7266c-9975-47d0-8048-80c4e4c32eaa tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:06.015962 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-34f7266c-9975-47d0-8048-80c4e4c32eaa tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:06.016862 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-34f7266c-9975-47d0-8048-80c4e4c32eaa tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:06.018356 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-34f7266c-9975-47d0-8048-80c4e4c32eaa tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:06.215588 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-34f7266c-9975-47d0-8048-80c4e4c32eaa tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec3945207e6a490fb1baa5eaefcfeaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86e36a2f7fc44daac11d122c492ba68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:06.224804 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-34f7266c-9975-47d0-8048-80c4e4c32eaa tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] 10.222.0.40 "GET /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06" status: 200 len: 1499 microversion: 2.1 time: 0.239197 Oct 26 13:09:06.229914 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 929/1785] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:05 2022] GET /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06 => generated 1499 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:06.590755 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-7f316efe-5d00-4327-a3c2-946c91b35871 req-ee31bf14-3df5-4330-84ff-8275c18fa852 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdca1d32-5d8f-44da-9c3b-c8d11433df06", "name": "network-vif-deleted", "tag": "7cca99b7-782b-4cb4-bf7d-e207183f2165"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:06.611334 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-7f316efe-5d00-4327-a3c2-946c91b35871 req-ee31bf14-3df5-4330-84ff-8275c18fa852 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:06.612948 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-7f316efe-5d00-4327-a3c2-946c91b35871 req-ee31bf14-3df5-4330-84ff-8275c18fa852 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:06.614565 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-7f316efe-5d00-4327-a3c2-946c91b35871 req-ee31bf14-3df5-4330-84ff-8275c18fa852 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:06.671646 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-7f316efe-5d00-4327-a3c2-946c91b35871 req-ee31bf14-3df5-4330-84ff-8275c18fa852 service nova] Creating event network-vif-deleted:7cca99b7-782b-4cb4-bf7d-e207183f2165 for instance cdca1d32-5d8f-44da-9c3b-c8d11433df06 on n-h1-862686-1 Oct 26 13:09:06.693510 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-7f316efe-5d00-4327-a3c2-946c91b35871 req-ee31bf14-3df5-4330-84ff-8275c18fa852 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106165 Oct 26 13:09:06.695161 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 930/1786] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:06.715030 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-19fc780e-0a25-4dc1-922e-35d1bd286be9 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:06.715685 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2ae9f5a2-35e9-4f46-b770-56b1069ed52a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:06.719091 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-19fc780e-0a25-4dc1-922e-35d1bd286be9 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] [instance: bbb44881-d590-4635-8c38-f107f70eaaa3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:06.734933 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-19fc780e-0a25-4dc1-922e-35d1bd286be9 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:06.737248 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2ae9f5a2-35e9-4f46-b770-56b1069ed52a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/cb087101-2eda-4145-bdcc-41673edfcbb7" status: 200 len: 1488 microversion: 2.1 time: 1.065219 Oct 26 13:09:06.742075 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-19fc780e-0a25-4dc1-922e-35d1bd286be9 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:06.746870 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 857/1787] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:05 2022] GET /compute/v2.1/servers/cb087101-2eda-4145-bdcc-41673edfcbb7 => generated 1488 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:06.747296 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-19fc780e-0a25-4dc1-922e-35d1bd286be9 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:06.750129 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-19fc780e-0a25-4dc1-922e-35d1bd286be9 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:06.751271 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-19fc780e-0a25-4dc1-922e-35d1bd286be9 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:06.752018 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-19fc780e-0a25-4dc1-922e-35d1bd286be9 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:06.777716 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-931f38d6-60a9-4179-a276-05bde8805e29 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:06.778478 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-931f38d6-60a9-4179-a276-05bde8805e29 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: cb087101-2eda-4145-bdcc-41673edfcbb7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:06.797308 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-931f38d6-60a9-4179-a276-05bde8805e29 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:06.798198 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-931f38d6-60a9-4179-a276-05bde8805e29 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:06.798919 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-931f38d6-60a9-4179-a276-05bde8805e29 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:06.802536 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-931f38d6-60a9-4179-a276-05bde8805e29 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:06.805329 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-931f38d6-60a9-4179-a276-05bde8805e29 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:06.807149 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-931f38d6-60a9-4179-a276-05bde8805e29 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:06.886738 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-931f38d6-60a9-4179-a276-05bde8805e29 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lazy-loading 'flavor' on Instance uuid cb087101-2eda-4145-bdcc-41673edfcbb7 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:09:07.046999 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-931f38d6-60a9-4179-a276-05bde8805e29 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "POST /compute/v2.1/servers/cb087101-2eda-4145-bdcc-41673edfcbb7/action" status: 202 len: 0 microversion: 2.1 time: 0.276621 Oct 26 13:09:07.048696 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 858/1788] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:09:06 2022] POST /compute/v2.1/servers/cb087101-2eda-4145-bdcc-41673edfcbb7/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:09:07.056576 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d9c4e0cf-14f9-48c2-a118-84a665ac17c6 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:07.057561 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d9c4e0cf-14f9-48c2-a118-84a665ac17c6 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:07.068386 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d9c4e0cf-14f9-48c2-a118-84a665ac17c6 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:07.070062 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d9c4e0cf-14f9-48c2-a118-84a665ac17c6 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:07.071489 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d9c4e0cf-14f9-48c2-a118-84a665ac17c6 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:07.073087 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d9c4e0cf-14f9-48c2-a118-84a665ac17c6 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:07.073786 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d9c4e0cf-14f9-48c2-a118-84a665ac17c6 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:07.073927 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-19fc780e-0a25-4dc1-922e-35d1bd286be9 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb3f2b0e3cc4326a1846f6755882dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f3d3f7efed04d7fb58147bc2ed55349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:07.076351 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d9c4e0cf-14f9-48c2-a118-84a665ac17c6 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:07.082008 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-19fc780e-0a25-4dc1-922e-35d1bd286be9 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb44881-d590-4635-8c38-f107f70eaaa3" status: 200 len: 1266 microversion: 2.1 time: 0.385050 Oct 26 13:09:07.082588 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 931/1789] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:06 2022] GET /compute/v2.1/servers/bbb44881-d590-4635-8c38-f107f70eaaa3 => generated 1266 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:07.102530 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1cf2e028-a093-4b49-87c9-e4c1e054fe6f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:07.103145 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1cf2e028-a093-4b49-87c9-e4c1e054fe6f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: cb087101-2eda-4145-bdcc-41673edfcbb7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:07.129442 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1cf2e028-a093-4b49-87c9-e4c1e054fe6f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:07.133660 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1cf2e028-a093-4b49-87c9-e4c1e054fe6f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:07.134299 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1cf2e028-a093-4b49-87c9-e4c1e054fe6f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:07.135199 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1cf2e028-a093-4b49-87c9-e4c1e054fe6f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:07.135855 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1cf2e028-a093-4b49-87c9-e4c1e054fe6f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:07.136289 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1cf2e028-a093-4b49-87c9-e4c1e054fe6f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:07.402523 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d9c4e0cf-14f9-48c2-a118-84a665ac17c6 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:07.450163 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d9c4e0cf-14f9-48c2-a118-84a665ac17c6 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:07.452108 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d9c4e0cf-14f9-48c2-a118-84a665ac17c6 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:07.455161 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d9c4e0cf-14f9-48c2-a118-84a665ac17c6 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 200 len: 1486 microversion: 2.25 time: 0.404972 Oct 26 13:09:07.479013 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 859/1790] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:09:07 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 1486 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:09:07.490143 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-78695b4c-d9c6-47f2-a44f-a671c7e62bf9 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:07.491515 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-78695b4c-d9c6-47f2-a44f-a671c7e62bf9 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] [instance: cdca1d32-5d8f-44da-9c3b-c8d11433df06] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:07.511770 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78695b4c-d9c6-47f2-a44f-a671c7e62bf9 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:07.512554 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78695b4c-d9c6-47f2-a44f-a671c7e62bf9 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:07.513280 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78695b4c-d9c6-47f2-a44f-a671c7e62bf9 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:07.514449 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78695b4c-d9c6-47f2-a44f-a671c7e62bf9 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:07.517433 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78695b4c-d9c6-47f2-a44f-a671c7e62bf9 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:07.518423 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78695b4c-d9c6-47f2-a44f-a671c7e62bf9 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:07.552655 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1cf2e028-a093-4b49-87c9-e4c1e054fe6f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:07.561521 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1cf2e028-a093-4b49-87c9-e4c1e054fe6f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/cb087101-2eda-4145-bdcc-41673edfcbb7" status: 200 len: 1496 microversion: 2.1 time: 0.477239 Oct 26 13:09:07.568627 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 932/1791] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:07 2022] GET /compute/v2.1/servers/cb087101-2eda-4145-bdcc-41673edfcbb7 => generated 1496 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:07.574835 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78695b4c-d9c6-47f2-a44f-a671c7e62bf9 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:07.575450 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78695b4c-d9c6-47f2-a44f-a671c7e62bf9 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:07.576011 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78695b4c-d9c6-47f2-a44f-a671c7e62bf9 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:07.576553 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-78695b4c-d9c6-47f2-a44f-a671c7e62bf9 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lazy-loading 'fault' on Instance uuid cdca1d32-5d8f-44da-9c3b-c8d11433df06 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:09:07.832530 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-78695b4c-d9c6-47f2-a44f-a671c7e62bf9 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec3945207e6a490fb1baa5eaefcfeaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86e36a2f7fc44daac11d122c492ba68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:07.846344 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-78695b4c-d9c6-47f2-a44f-a671c7e62bf9 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] 10.222.0.40 "GET /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06" status: 200 len: 1321 microversion: 2.1 time: 0.365852 Oct 26 13:09:07.884521 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 860/1792] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:07 2022] GET /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06 => generated 1321 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:08.112160 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-91fecca2-cd0d-4af3-aabb-66c737bc4fc5 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:08.113452 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-91fecca2-cd0d-4af3-aabb-66c737bc4fc5 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] [instance: bbb44881-d590-4635-8c38-f107f70eaaa3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:08.126016 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91fecca2-cd0d-4af3-aabb-66c737bc4fc5 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:08.127837 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91fecca2-cd0d-4af3-aabb-66c737bc4fc5 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:08.129983 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91fecca2-cd0d-4af3-aabb-66c737bc4fc5 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:08.130949 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91fecca2-cd0d-4af3-aabb-66c737bc4fc5 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:08.133619 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91fecca2-cd0d-4af3-aabb-66c737bc4fc5 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:08.134225 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91fecca2-cd0d-4af3-aabb-66c737bc4fc5 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:08.182085 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d5a96803-8822-4737-9d9f-f37ffa8db80f tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:08.187591 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d5a96803-8822-4737-9d9f-f37ffa8db80f tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c7849545fe2042618da2cd47f4a2b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075b65181daf492da145b2e815809d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:08.200944 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d5a96803-8822-4737-9d9f-f37ffa8db80f tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Searching by: {'deleted': False, 'project_id': '075b65181daf492da145b2e815809d91'} {{(pid=120597) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:09:08.231648 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d5a96803-8822-4737-9d9f-f37ffa8db80f tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:08.233096 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d5a96803-8822-4737-9d9f-f37ffa8db80f tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:08.233601 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d5a96803-8822-4737-9d9f-f37ffa8db80f tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:08.235777 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d5a96803-8822-4737-9d9f-f37ffa8db80f tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:08.241437 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d5a96803-8822-4737-9d9f-f37ffa8db80f tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:08.241437 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d5a96803-8822-4737-9d9f-f37ffa8db80f tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:08.263275 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-91fecca2-cd0d-4af3-aabb-66c737bc4fc5 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb3f2b0e3cc4326a1846f6755882dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f3d3f7efed04d7fb58147bc2ed55349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:08.288582 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-91fecca2-cd0d-4af3-aabb-66c737bc4fc5 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb44881-d590-4635-8c38-f107f70eaaa3" status: 200 len: 1272 microversion: 2.1 time: 0.174668 Oct 26 13:09:08.292742 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 933/1793] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:08 2022] GET /compute/v2.1/servers/bbb44881-d590-4635-8c38-f107f70eaaa3 => generated 1272 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:08.331863 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.multi_cell_list [None req-d5a96803-8822-4737-9d9f-f37ffa8db80f tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120597) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 13:09:08.420093 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d5a96803-8822-4737-9d9f-f37ffa8db80f tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.243185 Oct 26 13:09:08.432045 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 861/1794] 10.222.0.40 () {58 vars in 1125 bytes} [Wed Oct 26 13:09:08 2022] GET /compute/v2.1/servers => generated 339 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:08.434625 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-790073bb-dde2-4f93-a6a1-34f99d6ea731 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:08.443777 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-790073bb-dde2-4f93-a6a1-34f99d6ea731 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c7849545fe2042618da2cd47f4a2b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075b65181daf492da145b2e815809d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:08.459036 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-790073bb-dde2-4f93-a6a1-34f99d6ea731 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Searching by: {'deleted': False, 'project_id': '075b65181daf492da145b2e815809d91'} {{(pid=120598) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:09:08.468695 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-790073bb-dde2-4f93-a6a1-34f99d6ea731 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:08.469449 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-790073bb-dde2-4f93-a6a1-34f99d6ea731 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:08.470002 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-790073bb-dde2-4f93-a6a1-34f99d6ea731 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:08.470940 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-790073bb-dde2-4f93-a6a1-34f99d6ea731 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:08.471406 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-790073bb-dde2-4f93-a6a1-34f99d6ea731 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:08.471884 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-790073bb-dde2-4f93-a6a1-34f99d6ea731 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:08.485443 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-18bbc1fa-7cca-4d0e-be2c-9c668cb281e0 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:08.486301 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-18bbc1fa-7cca-4d0e-be2c-9c668cb281e0 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:08.496627 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18bbc1fa-7cca-4d0e-be2c-9c668cb281e0 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:08.506110 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18bbc1fa-7cca-4d0e-be2c-9c668cb281e0 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:08.506253 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18bbc1fa-7cca-4d0e-be2c-9c668cb281e0 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:08.507001 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18bbc1fa-7cca-4d0e-be2c-9c668cb281e0 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:08.507465 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18bbc1fa-7cca-4d0e-be2c-9c668cb281e0 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:08.507908 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18bbc1fa-7cca-4d0e-be2c-9c668cb281e0 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:08.564739 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.multi_cell_list [None req-790073bb-dde2-4f93-a6a1-34f99d6ea731 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120598) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 13:09:08.568813 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:09:08.665791 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-790073bb-dde2-4f93-a6a1-34f99d6ea731 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7849545fe2042618da2cd47f4a2b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075b65181daf492da145b2e815809d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:08.682660 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-790073bb-dde2-4f93-a6a1-34f99d6ea731 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:08.685098 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-790073bb-dde2-4f93-a6a1-34f99d6ea731 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:08.686798 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-790073bb-dde2-4f93-a6a1-34f99d6ea731 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:08.874393 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-18bbc1fa-7cca-4d0e-be2c-9c668cb281e0 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:08.888876 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-18bbc1fa-7cca-4d0e-be2c-9c668cb281e0 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:08.893105 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-18bbc1fa-7cca-4d0e-be2c-9c668cb281e0 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:08.899521 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-18bbc1fa-7cca-4d0e-be2c-9c668cb281e0 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 200 len: 1486 microversion: 2.25 time: 0.418041 Oct 26 13:09:08.900954 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 862/1795] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:09:08 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 1486 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:09:08.920155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e3ecdb41-6bec-4310-b3d5-d8e2877f5303 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:08.920757 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e3ecdb41-6bec-4310-b3d5-d8e2877f5303 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: cb087101-2eda-4145-bdcc-41673edfcbb7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:08.936242 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3ecdb41-6bec-4310-b3d5-d8e2877f5303 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:08.936732 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3ecdb41-6bec-4310-b3d5-d8e2877f5303 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:08.937167 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3ecdb41-6bec-4310-b3d5-d8e2877f5303 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:08.937899 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3ecdb41-6bec-4310-b3d5-d8e2877f5303 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:08.949825 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3ecdb41-6bec-4310-b3d5-d8e2877f5303 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:08.950379 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3ecdb41-6bec-4310-b3d5-d8e2877f5303 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:08.977635 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-790073bb-dde2-4f93-a6a1-34f99d6ea731 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] 10.222.0.40 "GET /compute/v2.1/servers/detail" status: 200 len: 1711 microversion: 2.1 time: 0.547467 Oct 26 13:09:08.978907 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 934/1796] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:09:08 2022] GET /compute/v2.1/servers/detail => generated 1711 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:09.000186 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e3ca74b2-cf22-47f9-86cf-1d547dd3a588 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:09.001269 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e3ca74b2-cf22-47f9-86cf-1d547dd3a588 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] [instance: cdca1d32-5d8f-44da-9c3b-c8d11433df06] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:09.010860 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e3ca74b2-cf22-47f9-86cf-1d547dd3a588 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:09.011975 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e3ca74b2-cf22-47f9-86cf-1d547dd3a588 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:09.012643 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e3ca74b2-cf22-47f9-86cf-1d547dd3a588 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:09.013749 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e3ca74b2-cf22-47f9-86cf-1d547dd3a588 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:09.014446 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e3ca74b2-cf22-47f9-86cf-1d547dd3a588 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:09.015932 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e3ca74b2-cf22-47f9-86cf-1d547dd3a588 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:09.034697 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-e3ca74b2-cf22-47f9-86cf-1d547dd3a588 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] HTTP exception thrown: Instance cdca1d32-5d8f-44da-9c3b-c8d11433df06 could not be found. Oct 26 13:09:09.037738 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e3ca74b2-cf22-47f9-86cf-1d547dd3a588 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Request method failure captured: Oct 26 13:09:09.037738 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06 HTTP/1.1 Oct 26 13:09:09.037738 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:09:09.037738 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:09:09.037738 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:09:09.037738 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:09:09.037738 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:09:09.037738 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:09:09.037738 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:09:09.037738 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:09:09.037738 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTEyN7KOWBDZ6tavoWYwvFvv3R2kkimdK9s2yUsufV6fgY7GMpFZmN5v6IpKkskubRIZ0sYcCsVc1H3e7reKAMuC1hpK0WDLZiuSPbwYOtrULpaL4vWsedQVrSuTHE0J2u6T2i1J9ErKEFkr8pVpiZAcT6erIdcDGIEmd54UV-ozGe0 Oct 26 13:09:09.037738 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:09:09.037738 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:09:09.037738 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:09:09.037738 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:09:09.037738 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:09:09.037738 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:09:09.037738 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: b86e36a2f7fc44daac11d122c492ba68 Oct 26 13:09:09.037738 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 Oct 26 13:09:09.037738 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:09:09.037738 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:09:09.039657 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b86e36a2f7fc44daac11d122c492ba68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b86e36a2f7fc44daac11d122c492ba68"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b86e36a2f7fc44daac11d122c492ba68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b86e36a2f7fc44daac11d122c492ba68"}]}] Oct 26 13:09:09.039657 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 Oct 26 13:09:09.039657 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: b86e36a2f7fc44daac11d122c492ba68 Oct 26 13:09:09.039657 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 Oct 26 13:09:09.039657 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project Oct 26 13:09:09.039657 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:09:09.039657 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:09:09.039657 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: ec3945207e6a490fb1baa5eaefcfeaf5 Oct 26 13:09:09.039657 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project Oct 26 13:09:09.039657 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:09:09.039657 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance cdca1d32-5d8f-44da-9c3b-c8d11433df06 could not be found. Oct 26 13:09:09.040457 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'cdca1d32-5d8f-44da-9c3b-c8d11433df06'} Oct 26 13:09:09.040457 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:09:09.040457 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:09.040457 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:09:09.040457 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:09:09.040457 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:09:09.040457 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:09:09.040457 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:09:09.040457 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:09:09.040457 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:09:09.040457 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:09:09.040457 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdca1d32-5d8f-44da-9c3b-c8d11433df06 could not be found. Oct 26 13:09:09.040457 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:09.040457 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:09:09.040457 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:09.040457 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:09.040457 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:09:09.040457 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:09:09.040457 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:09:09.040457 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:09:09.042488 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:09:09.042488 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:09:09.042488 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:09:09.042488 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:09:09.042488 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:09:09.042488 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:09:09.042488 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:09:09.042488 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:09:09.042488 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdca1d32-5d8f-44da-9c3b-c8d11433df06 could not be found. Oct 26 13:09:09.042488 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:09.042488 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:09:09.042488 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:09.042488 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:09.042488 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:09:09.042488 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:09:09.042488 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:09:09.042488 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:09:09.042488 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdca1d32-5d8f-44da-9c3b-c8d11433df06 could not be found. Oct 26 13:09:09.042488 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:09.046853 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e3ca74b2-cf22-47f9-86cf-1d547dd3a588 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] Returning 404 to user: Instance cdca1d32-5d8f-44da-9c3b-c8d11433df06 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:09:09.047995 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e3ca74b2-cf22-47f9-86cf-1d547dd3a588 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851 tempest-FloatingIPsAssociationNegativeTestJSON-1279611851-project] 10.222.0.40 "GET /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06" status: 404 len: 111 microversion: 2.1 time: 0.067782 Oct 26 13:09:09.049386 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 935/1797] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:08 2022] GET /compute/v2.1/servers/cdca1d32-5d8f-44da-9c3b-c8d11433df06 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:09:09.059888 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4a3b0a16-a598-470d-82db-44b04e077395 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:09.081008 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4a3b0a16-a598-470d-82db-44b04e077395 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029807 Oct 26 13:09:09.084661 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 936/1798] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 26 13:09:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:09.304844 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e3ecdb41-6bec-4310-b3d5-d8e2877f5303 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:09.316229 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e3ecdb41-6bec-4310-b3d5-d8e2877f5303 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/cb087101-2eda-4145-bdcc-41673edfcbb7" status: 200 len: 1479 microversion: 2.1 time: 0.413785 Oct 26 13:09:09.319854 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e773f251-f1fa-464c-a686-465ef3cc0d7c tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:09.320465 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e773f251-f1fa-464c-a686-465ef3cc0d7c tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] [instance: bbb44881-d590-4635-8c38-f107f70eaaa3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:09.320598 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 863/1799] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:08 2022] GET /compute/v2.1/servers/cb087101-2eda-4145-bdcc-41673edfcbb7 => generated 1479 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:09.342770 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e773f251-f1fa-464c-a686-465ef3cc0d7c tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:09.345858 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e773f251-f1fa-464c-a686-465ef3cc0d7c tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:09.346334 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c1a04432-4c98-473f-af94-f3c3548b536b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-569750903"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:09.347471 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e773f251-f1fa-464c-a686-465ef3cc0d7c tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:09.348762 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c1a04432-4c98-473f-af94-f3c3548b536b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: cb087101-2eda-4145-bdcc-41673edfcbb7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:09.349426 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e773f251-f1fa-464c-a686-465ef3cc0d7c tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:09.351524 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e773f251-f1fa-464c-a686-465ef3cc0d7c tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:09.352159 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e773f251-f1fa-464c-a686-465ef3cc0d7c tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:09.369932 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c1a04432-4c98-473f-af94-f3c3548b536b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:09.370539 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c1a04432-4c98-473f-af94-f3c3548b536b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:09.370988 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c1a04432-4c98-473f-af94-f3c3548b536b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:09.372195 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c1a04432-4c98-473f-af94-f3c3548b536b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:09.372654 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c1a04432-4c98-473f-af94-f3c3548b536b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:09.373084 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c1a04432-4c98-473f-af94-f3c3548b536b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:09.483196 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e773f251-f1fa-464c-a686-465ef3cc0d7c tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb3f2b0e3cc4326a1846f6755882dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f3d3f7efed04d7fb58147bc2ed55349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:09.503521 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e773f251-f1fa-464c-a686-465ef3cc0d7c tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb44881-d590-4635-8c38-f107f70eaaa3" status: 200 len: 1272 microversion: 2.1 time: 0.189418 Oct 26 13:09:09.506258 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 937/1800] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:09 2022] GET /compute/v2.1/servers/bbb44881-d590-4635-8c38-f107f70eaaa3 => generated 1272 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:09.512688 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-74469e93-cfae-4ce2-9ca2-1e272221fbb6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-163793803", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "ea467900-166a-4bae-8dfc-1d9c29684906"}], "security_groups": [{"name": "tempest-securitygroup--1691930579"}], "key_name": "tempest-keypair-587871191", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:09.765165 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c1a04432-4c98-473f-af94-f3c3548b536b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "POST /compute/v2.1/servers/cb087101-2eda-4145-bdcc-41673edfcbb7/action" status: 202 len: 0 microversion: 2.1 time: 0.422333 Oct 26 13:09:09.766218 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 864/1801] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:09:09 2022] POST /compute/v2.1/servers/cb087101-2eda-4145-bdcc-41673edfcbb7/action => generated 0 bytes in 425 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 26 13:09:09.781550 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-74469e93-cfae-4ce2-9ca2-1e272221fbb6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] validate_networks() for [('ea467900-166a-4bae-8dfc-1d9c29684906', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:09:09.953306 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3f3d20d2-8525-4620-bd81-9a8eb2198630 tempest-KeyPairsV2TestJSON-1839139725 tempest-KeyPairsV2TestJSON-1839139725-project] Action: 'create', calling method: .version_select at 0x7f67321f8700>, body: {"keypair": {"name": "tempest-keypair-963633710", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJoWudpRQ+7P70lS6RAGJAekZPZXui2Cte+oREMpgg5d7KxPquEffDu+QciisMbcqwW3p60diKRwJud+vAA4kh6q8IUnxiquyTRIwtjYHD3NEXsY+1EhxHzsm/HWaorBw=="}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:09.972994 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-3f3d20d2-8525-4620-bd81-9a8eb2198630 tempest-KeyPairsV2TestJSON-1839139725 tempest-KeyPairsV2TestJSON-1839139725-project] Getting quotas for project ef046d6a5f55459db4163a051d0581cf. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:09:09.980397 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-3f3d20d2-8525-4620-bd81-9a8eb2198630 tempest-KeyPairsV2TestJSON-1839139725 tempest-KeyPairsV2TestJSON-1839139725-project] Getting quotas for user 3e53d0c52dbd4ad08d72f4db1ba55f70 and project ef046d6a5f55459db4163a051d0581cf. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:09:10.009939 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3f3d20d2-8525-4620-bd81-9a8eb2198630 tempest-KeyPairsV2TestJSON-1839139725 tempest-KeyPairsV2TestJSON-1839139725-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.238288 Oct 26 13:09:10.017019 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 865/1802] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 13:09:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:10.017019 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f53ac964-59fc-4049-94c4-3cff4f33075d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f6732210670>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:10.073589 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f53ac964-59fc-4049-94c4-3cff4f33075d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc" status: 200 len: 1439 microversion: 2.1 time: 0.061478 Oct 26 13:09:10.074458 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 866/1803] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:09:10 2022] GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc => generated 1439 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:10.081253 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-026e1bb2-d2e3-4c5e-9abe-f161a9f3e74c tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:10.082124 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-026e1bb2-d2e3-4c5e-9abe-f161a9f3e74c tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] [instance: 523459ad-2398-43e2-b03b-3dc16c7214cb] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:10.093008 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-026e1bb2-d2e3-4c5e-9abe-f161a9f3e74c tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:10.093772 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-026e1bb2-d2e3-4c5e-9abe-f161a9f3e74c tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:10.094562 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-026e1bb2-d2e3-4c5e-9abe-f161a9f3e74c tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:10.095726 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-026e1bb2-d2e3-4c5e-9abe-f161a9f3e74c tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:10.096417 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-026e1bb2-d2e3-4c5e-9abe-f161a9f3e74c tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:10.097052 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-026e1bb2-d2e3-4c5e-9abe-f161a9f3e74c tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:10.129020 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-026e1bb2-d2e3-4c5e-9abe-f161a9f3e74c tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] [instance: 523459ad-2398-43e2-b03b-3dc16c7214cb] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:09:10.266883 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=7,nova_api:INSERT=4 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:09:10.290055 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-026e1bb2-d2e3-4c5e-9abe-f161a9f3e74c tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] 10.222.0.40 "DELETE /compute/v2.1/servers/523459ad-2398-43e2-b03b-3dc16c7214cb" status: 204 len: 0 microversion: 2.1 time: 0.213322 Oct 26 13:09:10.290901 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 867/1804] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:09:10 2022] DELETE /compute/v2.1/servers/523459ad-2398-43e2-b03b-3dc16c7214cb => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:09:10.300848 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f97b005a-e13f-486c-beb4-368f1839f877 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:10.307133 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f97b005a-e13f-486c-beb4-368f1839f877 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:10.320934 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f97b005a-e13f-486c-beb4-368f1839f877 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:10.323056 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f97b005a-e13f-486c-beb4-368f1839f877 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:10.323651 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f97b005a-e13f-486c-beb4-368f1839f877 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:10.324699 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f97b005a-e13f-486c-beb4-368f1839f877 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:10.327438 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f97b005a-e13f-486c-beb4-368f1839f877 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:10.328088 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f97b005a-e13f-486c-beb4-368f1839f877 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:10.663179 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f97b005a-e13f-486c-beb4-368f1839f877 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:10.676068 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f97b005a-e13f-486c-beb4-368f1839f877 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:10.678123 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f97b005a-e13f-486c-beb4-368f1839f877 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:10.679784 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f97b005a-e13f-486c-beb4-368f1839f877 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 200 len: 1486 microversion: 2.25 time: 0.386600 Oct 26 13:09:10.691191 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 868/1805] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:09:10 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 1486 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:09:10.693654 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-74469e93-cfae-4ce2-9ca2-1e272221fbb6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:09:10.694852 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-74469e93-cfae-4ce2-9ca2-1e272221fbb6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:09:10.695503 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-74469e93-cfae-4ce2-9ca2-1e272221fbb6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:09:10.697150 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-74469e93-cfae-4ce2-9ca2-1e272221fbb6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:09:10.697961 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-74469e93-cfae-4ce2-9ca2-1e272221fbb6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:09:10.705573 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bf47e5d3-5bf2-4b1b-9d79-59a61d5f6815 tempest-KeyPairsV2TestJSON-1839139725 tempest-KeyPairsV2TestJSON-1839139725-project] Calling method '.version_select at 0x7f67322104c0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:10.715999 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bf47e5d3-5bf2-4b1b-9d79-59a61d5f6815 tempest-KeyPairsV2TestJSON-1839139725 tempest-KeyPairsV2TestJSON-1839139725-project] 10.222.0.40 "GET /compute/v2.1/os-keypairs/tempest-keypair-963633710" status: 200 len: 497 microversion: 2.1 time: 0.020436 Oct 26 13:09:10.716300 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74469e93-cfae-4ce2-9ca2-1e272221fbb6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:10.716820 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74469e93-cfae-4ce2-9ca2-1e272221fbb6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:10.716981 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 869/1806] 10.222.0.40 () {58 vars in 1215 bytes} [Wed Oct 26 13:09:10 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-963633710 => generated 497 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:10.717863 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74469e93-cfae-4ce2-9ca2-1e272221fbb6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:10.721432 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74469e93-cfae-4ce2-9ca2-1e272221fbb6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:10.722040 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74469e93-cfae-4ce2-9ca2-1e272221fbb6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:10.722486 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74469e93-cfae-4ce2-9ca2-1e272221fbb6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:10.723988 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b453fdc6-dff1-47a0-b414-19cea8298575 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:10.724867 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b453fdc6-dff1-47a0-b414-19cea8298575 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] [instance: 523459ad-2398-43e2-b03b-3dc16c7214cb] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:10.736367 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b453fdc6-dff1-47a0-b414-19cea8298575 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:10.737171 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b453fdc6-dff1-47a0-b414-19cea8298575 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:10.738048 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b453fdc6-dff1-47a0-b414-19cea8298575 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:10.740987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b453fdc6-dff1-47a0-b414-19cea8298575 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:10.741678 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b453fdc6-dff1-47a0-b414-19cea8298575 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:10.742275 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b453fdc6-dff1-47a0-b414-19cea8298575 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:10.747537 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-74469e93-cfae-4ce2-9ca2-1e272221fbb6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Getting quotas for project 2336994846d345aa86b5fd940d1b004f. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:09:10.757581 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-74469e93-cfae-4ce2-9ca2-1e272221fbb6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Getting quotas for user cb4c9b05864d4d448b1c722659a3bc21 and project 2336994846d345aa86b5fd940d1b004f. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:09:10.774154 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-74469e93-cfae-4ce2-9ca2-1e272221fbb6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:09:10.776482 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-74469e93-cfae-4ce2-9ca2-1e272221fbb6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: 14fcf77a-99ed-4d7b-889a-19da49d9e4b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:09:10.837600 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-74469e93-cfae-4ce2-9ca2-1e272221fbb6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.329565 Oct 26 13:09:10.838925 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 938/1807] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:09:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 1332 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:09:10.845930 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e773bc51-7aa8-40ba-a26b-9c1d6f824790 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:10.846976 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e773bc51-7aa8-40ba-a26b-9c1d6f824790 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] [instance: bbb44881-d590-4635-8c38-f107f70eaaa3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:10.857239 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e773bc51-7aa8-40ba-a26b-9c1d6f824790 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:10.858009 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e773bc51-7aa8-40ba-a26b-9c1d6f824790 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:10.858654 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e773bc51-7aa8-40ba-a26b-9c1d6f824790 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:10.861984 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e773bc51-7aa8-40ba-a26b-9c1d6f824790 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:10.862725 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e773bc51-7aa8-40ba-a26b-9c1d6f824790 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:10.863366 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e773bc51-7aa8-40ba-a26b-9c1d6f824790 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:11.134623 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b453fdc6-dff1-47a0-b414-19cea8298575 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7849545fe2042618da2cd47f4a2b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075b65181daf492da145b2e815809d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:11.150972 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b453fdc6-dff1-47a0-b414-19cea8298575 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] 10.222.0.40 "GET /compute/v2.1/servers/523459ad-2398-43e2-b03b-3dc16c7214cb" status: 200 len: 1714 microversion: 2.1 time: 0.432050 Oct 26 13:09:11.152786 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 870/1808] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:10 2022] GET /compute/v2.1/servers/523459ad-2398-43e2-b03b-3dc16c7214cb => generated 1714 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:11.159488 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b15ee9e2-a026-4241-9664-dbf5092656dd tempest-KeyPairsV2TestJSON-1839139725 tempest-KeyPairsV2TestJSON-1839139725-project] Calling method '.version_select at 0x7f6732262d30>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:11.198617 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b15ee9e2-a026-4241-9664-dbf5092656dd tempest-KeyPairsV2TestJSON-1839139725 tempest-KeyPairsV2TestJSON-1839139725-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-963633710" status: 202 len: 0 microversion: 2.1 time: 0.043318 Oct 26 13:09:11.200343 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 871/1809] 10.222.0.40 () {58 vars in 1218 bytes} [Wed Oct 26 13:09:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-963633710 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:09:11.207540 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-19479b7b-e9ef-4aed-93c5-6dbaee463e8b tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:11.211253 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-19479b7b-e9ef-4aed-93c5-6dbaee463e8b tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: 14fcf77a-99ed-4d7b-889a-19da49d9e4b4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:11.294218 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-19479b7b-e9ef-4aed-93c5-6dbaee463e8b tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4c9b05864d4d448b1c722659a3bc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2336994846d345aa86b5fd940d1b004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:11.303464 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-19479b7b-e9ef-4aed-93c5-6dbaee463e8b tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4" status: 200 len: 1240 microversion: 2.1 time: 0.100966 Oct 26 13:09:11.305070 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 872/1810] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:11 2022] GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4 => generated 1240 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:11.310965 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cfca442a-ecb5-4bd8-bf5e-8dbb64a95249 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f673222c790>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:11.341408 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e773bc51-7aa8-40ba-a26b-9c1d6f824790 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb3f2b0e3cc4326a1846f6755882dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f3d3f7efed04d7fb58147bc2ed55349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:11.352584 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e773bc51-7aa8-40ba-a26b-9c1d6f824790 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb44881-d590-4635-8c38-f107f70eaaa3" status: 200 len: 1314 microversion: 2.1 time: 0.512181 Oct 26 13:09:11.354880 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 939/1811] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:10 2022] GET /compute/v2.1/servers/bbb44881-d590-4635-8c38-f107f70eaaa3 => generated 1314 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:11.362777 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f74b3990-d5c3-47f6-82e9-436b2b1ecfa7 tempest-KeyPairsV2TestJSON-1839139725 tempest-KeyPairsV2TestJSON-1839139725-project] Action: 'create', calling method: .version_select at 0x7f6736980f70>, body: {"keypair": {"name": "tempest-keypair-226968291", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB70ZfLuGRqK3KyE2sQO0fUhaQM7VTsc/XWr4/ely9hZPHbMop7NMWekckCU4Wf30bqGkz8mapAGbTNUuqOBsmsUPzYGwq34DiCgaph4gOYj78KJIGYBCjMq30OV0CJrsg=="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:11.398076 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cfca442a-ecb5-4bd8-bf5e-8dbb64a95249 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc" status: 200 len: 1439 microversion: 2.1 time: 0.091097 Oct 26 13:09:11.398689 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 873/1812] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:09:11 2022] GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc => generated 1439 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:11.415448 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-f74b3990-d5c3-47f6-82e9-436b2b1ecfa7 tempest-KeyPairsV2TestJSON-1839139725 tempest-KeyPairsV2TestJSON-1839139725-project] Getting quotas for project ef046d6a5f55459db4163a051d0581cf. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:09:11.428093 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-f74b3990-d5c3-47f6-82e9-436b2b1ecfa7 tempest-KeyPairsV2TestJSON-1839139725 tempest-KeyPairsV2TestJSON-1839139725-project] Getting quotas for user 3e53d0c52dbd4ad08d72f4db1ba55f70 and project ef046d6a5f55459db4163a051d0581cf. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:09:11.476691 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f74b3990-d5c3-47f6-82e9-436b2b1ecfa7 tempest-KeyPairsV2TestJSON-1839139725 tempest-KeyPairsV2TestJSON-1839139725-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.119830 Oct 26 13:09:11.479284 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 940/1813] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 13:09:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:11.490124 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-64663d05-f28f-478b-a37b-a6046caf57b5 tempest-KeyPairsV2TestJSON-1839139725 tempest-KeyPairsV2TestJSON-1839139725-project] Calling method '.version_select at 0x7f6732210dc0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:11.541968 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-64663d05-f28f-478b-a37b-a6046caf57b5 tempest-KeyPairsV2TestJSON-1839139725 tempest-KeyPairsV2TestJSON-1839139725-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-226968291" status: 202 len: 0 microversion: 2.1 time: 0.056270 Oct 26 13:09:11.546728 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 874/1814] 10.222.0.40 () {58 vars in 1218 bytes} [Wed Oct 26 13:09:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-226968291 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:09:11.554008 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-dff8a54b-3ff4-47fc-926a-d7f3c49bed48 tempest-KeyPairsV2TestJSON-1839139725 tempest-KeyPairsV2TestJSON-1839139725-project] Action: 'create', calling method: .version_select at 0x7f673698f820>, body: {"keypair": {"name": "tempest-keypair-1674645049", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:11.616249 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-dff8a54b-3ff4-47fc-926a-d7f3c49bed48 tempest-KeyPairsV2TestJSON-1839139725 tempest-KeyPairsV2TestJSON-1839139725-project] Getting quotas for project ef046d6a5f55459db4163a051d0581cf. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:09:11.623109 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-2d05029c-557d-43b6-a85b-6b209936183b req-18f83891-a17a-43af-8a7c-a5aaa6654774 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbb44881-d590-4635-8c38-f107f70eaaa3", "tag": "96678790-23ae-4f84-9bcd-70cbbff81b16"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:11.657603 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2d05029c-557d-43b6-a85b-6b209936183b req-18f83891-a17a-43af-8a7c-a5aaa6654774 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:11.658355 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2d05029c-557d-43b6-a85b-6b209936183b req-18f83891-a17a-43af-8a7c-a5aaa6654774 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:11.659491 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2d05029c-557d-43b6-a85b-6b209936183b req-18f83891-a17a-43af-8a7c-a5aaa6654774 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:11.660214 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-dff8a54b-3ff4-47fc-926a-d7f3c49bed48 tempest-KeyPairsV2TestJSON-1839139725 tempest-KeyPairsV2TestJSON-1839139725-project] Getting quotas for user 3e53d0c52dbd4ad08d72f4db1ba55f70 and project ef046d6a5f55459db4163a051d0581cf. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:09:11.684552 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-2d05029c-557d-43b6-a85b-6b209936183b req-18f83891-a17a-43af-8a7c-a5aaa6654774 service nova] Creating event network-changed:96678790-23ae-4f84-9bcd-70cbbff81b16 for instance bbb44881-d590-4635-8c38-f107f70eaaa3 on n-h2-862686-1 Oct 26 13:09:11.698092 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-2d05029c-557d-43b6-a85b-6b209936183b req-18f83891-a17a-43af-8a7c-a5aaa6654774 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076467 Oct 26 13:09:11.700239 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 875/1815] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:09:11.717418 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-dff8a54b-3ff4-47fc-926a-d7f3c49bed48 tempest-KeyPairsV2TestJSON-1839139725 tempest-KeyPairsV2TestJSON-1839139725-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.167739 Oct 26 13:09:11.718528 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 941/1816] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 13:09:11 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:11.724634 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3bbf371e-4ddd-4990-baa6-e744ecf0bdc2 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:11.724634 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3bbf371e-4ddd-4990-baa6-e744ecf0bdc2 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:11.730965 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3bbf371e-4ddd-4990-baa6-e744ecf0bdc2 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:11.731544 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3bbf371e-4ddd-4990-baa6-e744ecf0bdc2 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:11.732245 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3bbf371e-4ddd-4990-baa6-e744ecf0bdc2 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:11.733628 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3bbf371e-4ddd-4990-baa6-e744ecf0bdc2 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:11.735269 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3bbf371e-4ddd-4990-baa6-e744ecf0bdc2 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:11.736034 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3bbf371e-4ddd-4990-baa6-e744ecf0bdc2 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:11.736743 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a446bff6-dd98-413a-8a13-a29cbbf40839 tempest-KeyPairsV2TestJSON-1839139725 tempest-KeyPairsV2TestJSON-1839139725-project] Calling method '.version_select at 0x7f673698fc10>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:11.776852 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:09:11.797803 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a446bff6-dd98-413a-8a13-a29cbbf40839 tempest-KeyPairsV2TestJSON-1839139725 tempest-KeyPairsV2TestJSON-1839139725-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1674645049" status: 202 len: 0 microversion: 2.1 time: 0.071690 Oct 26 13:09:11.800265 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 942/1817] 10.222.0.40 () {58 vars in 1221 bytes} [Wed Oct 26 13:09:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1674645049 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:09:11.825271 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-553d6c7c-8b71-4d32-8c3d-b38764a0ff36 tempest-KeyPairsV2TestJSON-1839139725 tempest-KeyPairsV2TestJSON-1839139725-project] Action: 'create', calling method: .version_select at 0x7f67369974c0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-390168129", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnsIVIznDcQgKc3SLkrwm5CwWALJoMtP5/lgmOZP9l7Qix1A541QSkP/052/cDdzQIDUCUHdPLqTRSblZseFW2sWQyy3Shufe7fN30Cjpj8HHqrflYhcq3cYNFuKeMuwg=="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:11.854930 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-553d6c7c-8b71-4d32-8c3d-b38764a0ff36 tempest-KeyPairsV2TestJSON-1839139725 tempest-KeyPairsV2TestJSON-1839139725-project] Getting quotas for project ef046d6a5f55459db4163a051d0581cf. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:09:11.871017 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-553d6c7c-8b71-4d32-8c3d-b38764a0ff36 tempest-KeyPairsV2TestJSON-1839139725 tempest-KeyPairsV2TestJSON-1839139725-project] Getting quotas for user 3e53d0c52dbd4ad08d72f4db1ba55f70 and project ef046d6a5f55459db4163a051d0581cf. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:09:11.908230 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-553d6c7c-8b71-4d32-8c3d-b38764a0ff36 tempest-KeyPairsV2TestJSON-1839139725 tempest-KeyPairsV2TestJSON-1839139725-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.097195 Oct 26 13:09:11.909307 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 943/1818] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 13:09:11 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:11.923705 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3f99fc59-e8c3-4a0e-b075-e43b765dc95a tempest-KeyPairsV2TestJSON-1839139725 tempest-KeyPairsV2TestJSON-1839139725-project] Action: 'create', calling method: .version_select at 0x7f673690a670>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1193631151", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBa5ZIlwvmhjBJw++a+koczTveWSHvWrc4Sj0WIkNR1dwaTImfM8DbsZv7a58LrsHQx/nGSHZ8ZQolk+ncy3rbuXfRUBwDhI/nZMnDYdLccBUyLgY6zV14GHwxykg/hYCA=="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:11.941390 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-3f99fc59-e8c3-4a0e-b075-e43b765dc95a tempest-KeyPairsV2TestJSON-1839139725 tempest-KeyPairsV2TestJSON-1839139725-project] Getting quotas for project ef046d6a5f55459db4163a051d0581cf. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:09:11.948593 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-3f99fc59-e8c3-4a0e-b075-e43b765dc95a tempest-KeyPairsV2TestJSON-1839139725 tempest-KeyPairsV2TestJSON-1839139725-project] Getting quotas for user 3e53d0c52dbd4ad08d72f4db1ba55f70 and project ef046d6a5f55459db4163a051d0581cf. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:09:11.979139 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3f99fc59-e8c3-4a0e-b075-e43b765dc95a tempest-KeyPairsV2TestJSON-1839139725 tempest-KeyPairsV2TestJSON-1839139725-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.059493 Oct 26 13:09:11.980446 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 944/1819] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 13:09:11 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:11.997966 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ee2f7af9-4bdd-46b5-92bf-4e6b28ea08d1 tempest-KeyPairsV2TestJSON-1839139725 tempest-KeyPairsV2TestJSON-1839139725-project] Action: 'create', calling method: .version_select at 0x7f67369975e0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-941537805", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPWqI+j/h/ULpqMiJbLPM51rKsskKQWx+hgP1yTmgowfpSMbgyoF3of487Iy8UbM72K76nHWYABg8GhASzXrvdxgIV/eshyntNiWn5KbfLZr48LmOLGhW76srBuQ31bW5g=="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:12.026720 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-ee2f7af9-4bdd-46b5-92bf-4e6b28ea08d1 tempest-KeyPairsV2TestJSON-1839139725 tempest-KeyPairsV2TestJSON-1839139725-project] Getting quotas for project ef046d6a5f55459db4163a051d0581cf. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:09:12.039024 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-ee2f7af9-4bdd-46b5-92bf-4e6b28ea08d1 tempest-KeyPairsV2TestJSON-1839139725 tempest-KeyPairsV2TestJSON-1839139725-project] Getting quotas for user 3e53d0c52dbd4ad08d72f4db1ba55f70 and project ef046d6a5f55459db4163a051d0581cf. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:09:12.111156 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ee2f7af9-4bdd-46b5-92bf-4e6b28ea08d1 tempest-KeyPairsV2TestJSON-1839139725 tempest-KeyPairsV2TestJSON-1839139725-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.119439 Oct 26 13:09:12.119793 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 945/1820] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 13:09:11 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:12.124928 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-a9af7461-2d9a-4f78-865f-4541f992ece5 req-b8f3f781-ef40-4953-bd61-e3540ded9474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ce726c3-809c-4662-b794-dcec3f82047c", "name": "network-vif-unplugged", "status": "completed", "tag": "2ed4f127-e35d-49ce-a3f0-81fac3604625"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:12.140149 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-a9af7461-2d9a-4f78-865f-4541f992ece5 req-b8f3f781-ef40-4953-bd61-e3540ded9474 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:12.140929 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-a9af7461-2d9a-4f78-865f-4541f992ece5 req-b8f3f781-ef40-4953-bd61-e3540ded9474 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:12.143327 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-a9af7461-2d9a-4f78-865f-4541f992ece5 req-b8f3f781-ef40-4953-bd61-e3540ded9474 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:12.157396 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-a9af7461-2d9a-4f78-865f-4541f992ece5 req-b8f3f781-ef40-4953-bd61-e3540ded9474 service nova] Creating event network-vif-unplugged:2ed4f127-e35d-49ce-a3f0-81fac3604625 for instance 3ce726c3-809c-4662-b794-dcec3f82047c on n-h1-862686-1 Oct 26 13:09:12.165718 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-a9af7461-2d9a-4f78-865f-4541f992ece5 req-b8f3f781-ef40-4953-bd61-e3540ded9474 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044494 Oct 26 13:09:12.167302 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 946/1821] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:12.175233 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4f56f3a2-56b7-475d-aafe-d8816a4fb17f tempest-KeyPairsV2TestJSON-1839139725 tempest-KeyPairsV2TestJSON-1839139725-project] Calling method '.version_select at 0x7f6731fb5040>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:12.191058 n-d-862686-1 devstack@n-api.service[120598]: WARNING oslo_db.sqlalchemy.utils [None req-4f56f3a2-56b7-475d-aafe-d8816a4fb17f tempest-KeyPairsV2TestJSON-1839139725 tempest-KeyPairsV2TestJSON-1839139725-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 26 13:09:12.199722 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4f56f3a2-56b7-475d-aafe-d8816a4fb17f tempest-KeyPairsV2TestJSON-1839139725 tempest-KeyPairsV2TestJSON-1839139725-project] 10.222.0.40 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.030752 Oct 26 13:09:12.205631 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 947/1822] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 26 13:09:12 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:12.212461 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f067e4b7-d356-4180-be9d-6d2bb59ace37 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:12.213200 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f067e4b7-d356-4180-be9d-6d2bb59ace37 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] [instance: 523459ad-2398-43e2-b03b-3dc16c7214cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:12.232748 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f067e4b7-d356-4180-be9d-6d2bb59ace37 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:12.233106 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f067e4b7-d356-4180-be9d-6d2bb59ace37 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:12.233575 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f067e4b7-d356-4180-be9d-6d2bb59ace37 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:12.234337 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f067e4b7-d356-4180-be9d-6d2bb59ace37 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:12.234760 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f067e4b7-d356-4180-be9d-6d2bb59ace37 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:12.237365 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f067e4b7-d356-4180-be9d-6d2bb59ace37 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:12.318043 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3bbf371e-4ddd-4990-baa6-e744ecf0bdc2 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:12.347908 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3bbf371e-4ddd-4990-baa6-e744ecf0bdc2 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:12.356815 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3bbf371e-4ddd-4990-baa6-e744ecf0bdc2 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:12.367369 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3bbf371e-4ddd-4990-baa6-e744ecf0bdc2 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 200 len: 1486 microversion: 2.25 time: 0.659645 Oct 26 13:09:12.369673 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 876/1823] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:09:11 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 1486 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:09:12.377341 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a9e8baf8-0614-4b02-bdd1-8fc4d85e1865 tempest-KeyPairsV2TestJSON-1839139725 tempest-KeyPairsV2TestJSON-1839139725-project] Calling method '.version_select at 0x7f67321bfdc0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:12.435108 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a9e8baf8-0614-4b02-bdd1-8fc4d85e1865 tempest-KeyPairsV2TestJSON-1839139725 tempest-KeyPairsV2TestJSON-1839139725-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-941537805" status: 202 len: 0 microversion: 2.1 time: 0.061725 Oct 26 13:09:12.436807 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 877/1824] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 26 13:09:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-941537805 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:09:12.459271 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b216b1a4-5d33-4926-8983-bbff1274a6b8 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:12.460273 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b216b1a4-5d33-4926-8983-bbff1274a6b8 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: 14fcf77a-99ed-4d7b-889a-19da49d9e4b4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:12.468423 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b216b1a4-5d33-4926-8983-bbff1274a6b8 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:12.469261 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b216b1a4-5d33-4926-8983-bbff1274a6b8 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:12.469949 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b216b1a4-5d33-4926-8983-bbff1274a6b8 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:12.470816 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b216b1a4-5d33-4926-8983-bbff1274a6b8 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:12.472137 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b216b1a4-5d33-4926-8983-bbff1274a6b8 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:12.472839 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b216b1a4-5d33-4926-8983-bbff1274a6b8 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:12.590972 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b216b1a4-5d33-4926-8983-bbff1274a6b8 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4c9b05864d4d448b1c722659a3bc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2336994846d345aa86b5fd940d1b004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:12.626400 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b216b1a4-5d33-4926-8983-bbff1274a6b8 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4" status: 200 len: 1292 microversion: 2.1 time: 0.160355 Oct 26 13:09:12.629121 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 878/1825] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:12 2022] GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4 => generated 1292 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:12.634938 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b973b27a-a998-4394-a585-3535f85a5ecd tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:12.637159 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b973b27a-a998-4394-a585-3535f85a5ecd tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] [instance: bbb44881-d590-4635-8c38-f107f70eaaa3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:12.652384 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b973b27a-a998-4394-a585-3535f85a5ecd tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:12.654458 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b973b27a-a998-4394-a585-3535f85a5ecd tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:12.655307 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b973b27a-a998-4394-a585-3535f85a5ecd tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:12.656441 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b973b27a-a998-4394-a585-3535f85a5ecd tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:12.657546 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b973b27a-a998-4394-a585-3535f85a5ecd tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:12.658305 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b973b27a-a998-4394-a585-3535f85a5ecd tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:12.765086 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f067e4b7-d356-4180-be9d-6d2bb59ace37 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7849545fe2042618da2cd47f4a2b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075b65181daf492da145b2e815809d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:12.784180 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f067e4b7-d356-4180-be9d-6d2bb59ace37 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] 10.222.0.40 "GET /compute/v2.1/servers/523459ad-2398-43e2-b03b-3dc16c7214cb" status: 200 len: 1714 microversion: 2.1 time: 0.574319 Oct 26 13:09:12.785261 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 948/1826] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:12 2022] GET /compute/v2.1/servers/523459ad-2398-43e2-b03b-3dc16c7214cb => generated 1714 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:12.818986 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1babbf05-c049-43a6-bd25-9611e08f744d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f6736980940>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:12.890680 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1babbf05-c049-43a6-bd25-9611e08f744d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc" status: 200 len: 1439 microversion: 2.1 time: 0.089180 Oct 26 13:09:12.891725 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 949/1827] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:09:12 2022] GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc => generated 1439 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:12.897962 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5fdd742a-68ef-402e-888b-445b6d545c53 tempest-KeyPairsV2TestJSON-1839139725 tempest-KeyPairsV2TestJSON-1839139725-project] Calling method '.version_select at 0x7f6731ffa1f0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:12.931603 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5fdd742a-68ef-402e-888b-445b6d545c53 tempest-KeyPairsV2TestJSON-1839139725 tempest-KeyPairsV2TestJSON-1839139725-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1193631151" status: 202 len: 0 microversion: 2.1 time: 0.037703 Oct 26 13:09:12.932547 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 950/1828] 10.222.0.40 () {58 vars in 1278 bytes} [Wed Oct 26 13:09:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1193631151 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:09:12.942243 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-80654491-5b64-4c21-9ad1-734ff3593f3d tempest-KeyPairsV2TestJSON-1839139725 tempest-KeyPairsV2TestJSON-1839139725-project] Calling method '.version_select at 0x7f6731ffa310>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:12.984320 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-80654491-5b64-4c21-9ad1-734ff3593f3d tempest-KeyPairsV2TestJSON-1839139725 tempest-KeyPairsV2TestJSON-1839139725-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-390168129" status: 202 len: 0 microversion: 2.1 time: 0.046750 Oct 26 13:09:12.984990 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 951/1829] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 26 13:09:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-390168129 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:09:13.405870 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-928e5fbe-2d17-4277-bfe1-ef13d29fe1c8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:13.406481 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-928e5fbe-2d17-4277-bfe1-ef13d29fe1c8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:13.431812 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-928e5fbe-2d17-4277-bfe1-ef13d29fe1c8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:13.432318 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-928e5fbe-2d17-4277-bfe1-ef13d29fe1c8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:13.445923 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-928e5fbe-2d17-4277-bfe1-ef13d29fe1c8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:13.446779 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-928e5fbe-2d17-4277-bfe1-ef13d29fe1c8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:13.447265 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-928e5fbe-2d17-4277-bfe1-ef13d29fe1c8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:13.447703 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-928e5fbe-2d17-4277-bfe1-ef13d29fe1c8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:14.251974 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-928e5fbe-2d17-4277-bfe1-ef13d29fe1c8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:14.266127 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b973b27a-a998-4394-a585-3535f85a5ecd tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb3f2b0e3cc4326a1846f6755882dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f3d3f7efed04d7fb58147bc2ed55349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:14.272770 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-928e5fbe-2d17-4277-bfe1-ef13d29fe1c8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:14.274418 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-928e5fbe-2d17-4277-bfe1-ef13d29fe1c8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:14.275626 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-928e5fbe-2d17-4277-bfe1-ef13d29fe1c8 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 200 len: 1486 microversion: 2.25 time: 0.875682 Oct 26 13:09:14.284263 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b973b27a-a998-4394-a585-3535f85a5ecd tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb44881-d590-4635-8c38-f107f70eaaa3" status: 200 len: 1314 microversion: 2.1 time: 1.652172 Oct 26 13:09:14.294504 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 952/1830] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:09:13 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 1486 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:09:14.307223 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 879/1831] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:12 2022] GET /compute/v2.1/servers/bbb44881-d590-4635-8c38-f107f70eaaa3 => generated 1314 bytes in 1677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:14.310303 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-51a6ba3b-0b9b-4f17-96d4-35ca33dede58 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:14.310966 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-51a6ba3b-0b9b-4f17-96d4-35ca33dede58 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: 14fcf77a-99ed-4d7b-889a-19da49d9e4b4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:14.320539 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-51a6ba3b-0b9b-4f17-96d4-35ca33dede58 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:14.321257 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-51a6ba3b-0b9b-4f17-96d4-35ca33dede58 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:14.323384 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-51a6ba3b-0b9b-4f17-96d4-35ca33dede58 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:14.324578 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-51a6ba3b-0b9b-4f17-96d4-35ca33dede58 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:14.324893 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9a8313fd-bf58-4ae5-9672-b66d755e1f5e tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:14.325780 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-51a6ba3b-0b9b-4f17-96d4-35ca33dede58 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:14.326671 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-51a6ba3b-0b9b-4f17-96d4-35ca33dede58 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:14.331025 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9a8313fd-bf58-4ae5-9672-b66d755e1f5e tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] [instance: 523459ad-2398-43e2-b03b-3dc16c7214cb] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:14.344641 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9a8313fd-bf58-4ae5-9672-b66d755e1f5e tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:14.345719 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9a8313fd-bf58-4ae5-9672-b66d755e1f5e tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:14.347995 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9a8313fd-bf58-4ae5-9672-b66d755e1f5e tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:14.349586 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9a8313fd-bf58-4ae5-9672-b66d755e1f5e tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:14.350230 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9a8313fd-bf58-4ae5-9672-b66d755e1f5e tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:14.350828 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9a8313fd-bf58-4ae5-9672-b66d755e1f5e tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:14.618346 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-51a6ba3b-0b9b-4f17-96d4-35ca33dede58 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4c9b05864d4d448b1c722659a3bc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2336994846d345aa86b5fd940d1b004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:14.622499 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:09:14.640395 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-51a6ba3b-0b9b-4f17-96d4-35ca33dede58 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4" status: 200 len: 1298 microversion: 2.1 time: 0.343489 Oct 26 13:09:14.642540 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 953/1832] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:14 2022] GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4 => generated 1298 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:14.667510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fd973b1a-4359-4731-94c0-4b571fed709f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f6736922c10>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:14.753475 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fd973b1a-4359-4731-94c0-4b571fed709f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc" status: 200 len: 1439 microversion: 2.1 time: 0.104335 Oct 26 13:09:14.766234 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 954/1833] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:09:14 2022] GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc => generated 1439 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:14.783382 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-bb74e000-f35e-4465-8dea-55ecb4c30e33 req-3ffed14d-6a03-4481-bb3e-386503100859 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ce726c3-809c-4662-b794-dcec3f82047c", "tag": "2ed4f127-e35d-49ce-a3f0-81fac3604625"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:14.803342 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-bb74e000-f35e-4465-8dea-55ecb4c30e33 req-3ffed14d-6a03-4481-bb3e-386503100859 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:14.804227 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-bb74e000-f35e-4465-8dea-55ecb4c30e33 req-3ffed14d-6a03-4481-bb3e-386503100859 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:14.805018 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-bb74e000-f35e-4465-8dea-55ecb4c30e33 req-3ffed14d-6a03-4481-bb3e-386503100859 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:14.826450 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-bb74e000-f35e-4465-8dea-55ecb4c30e33 req-3ffed14d-6a03-4481-bb3e-386503100859 service nova] Creating event network-changed:2ed4f127-e35d-49ce-a3f0-81fac3604625 for instance 3ce726c3-809c-4662-b794-dcec3f82047c on n-h1-862686-1 Oct 26 13:09:14.826701 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9a8313fd-bf58-4ae5-9672-b66d755e1f5e tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7849545fe2042618da2cd47f4a2b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075b65181daf492da145b2e815809d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:14.834266 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-bb74e000-f35e-4465-8dea-55ecb4c30e33 req-3ffed14d-6a03-4481-bb3e-386503100859 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065972 Oct 26 13:09:14.835314 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 955/1834] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:14.838046 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9a8313fd-bf58-4ae5-9672-b66d755e1f5e tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] 10.222.0.40 "GET /compute/v2.1/servers/523459ad-2398-43e2-b03b-3dc16c7214cb" status: 200 len: 1714 microversion: 2.1 time: 0.529634 Oct 26 13:09:14.841118 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 880/1835] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:14 2022] GET /compute/v2.1/servers/523459ad-2398-43e2-b03b-3dc16c7214cb => generated 1714 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:15.305092 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ac1f0e42-2704-4c41-be49-8edcb2df9edb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:15.307479 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ac1f0e42-2704-4c41-be49-8edcb2df9edb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:15.311760 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cf5d1f34-0334-4942-a0db-987ab5fea5f6 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:15.312399 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cf5d1f34-0334-4942-a0db-987ab5fea5f6 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] [instance: bbb44881-d590-4635-8c38-f107f70eaaa3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:15.324844 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf5d1f34-0334-4942-a0db-987ab5fea5f6 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:15.325640 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf5d1f34-0334-4942-a0db-987ab5fea5f6 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:15.328223 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf5d1f34-0334-4942-a0db-987ab5fea5f6 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:15.329206 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf5d1f34-0334-4942-a0db-987ab5fea5f6 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:15.334662 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf5d1f34-0334-4942-a0db-987ab5fea5f6 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:15.335354 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf5d1f34-0334-4942-a0db-987ab5fea5f6 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:15.338091 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac1f0e42-2704-4c41-be49-8edcb2df9edb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:15.338789 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac1f0e42-2704-4c41-be49-8edcb2df9edb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:15.339917 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac1f0e42-2704-4c41-be49-8edcb2df9edb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:15.340869 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac1f0e42-2704-4c41-be49-8edcb2df9edb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:15.341429 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac1f0e42-2704-4c41-be49-8edcb2df9edb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:15.343855 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac1f0e42-2704-4c41-be49-8edcb2df9edb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:15.779688 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ac1f0e42-2704-4c41-be49-8edcb2df9edb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:15.796511 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ac1f0e42-2704-4c41-be49-8edcb2df9edb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:15.798013 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ac1f0e42-2704-4c41-be49-8edcb2df9edb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:15.799198 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ac1f0e42-2704-4c41-be49-8edcb2df9edb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 200 len: 1486 microversion: 2.25 time: 0.501786 Oct 26 13:09:15.799765 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 956/1836] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:09:15 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 1486 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:09:15.822666 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-26710b01-9086-428a-a111-7e72fe481df2 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:15.823306 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-26710b01-9086-428a-a111-7e72fe481df2 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: 14fcf77a-99ed-4d7b-889a-19da49d9e4b4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:15.846855 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26710b01-9086-428a-a111-7e72fe481df2 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:15.847353 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26710b01-9086-428a-a111-7e72fe481df2 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:15.847799 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26710b01-9086-428a-a111-7e72fe481df2 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:15.849289 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26710b01-9086-428a-a111-7e72fe481df2 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:15.849787 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26710b01-9086-428a-a111-7e72fe481df2 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:15.850220 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26710b01-9086-428a-a111-7e72fe481df2 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:16.000849 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-26710b01-9086-428a-a111-7e72fe481df2 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4c9b05864d4d448b1c722659a3bc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2336994846d345aa86b5fd940d1b004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:16.015228 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-26710b01-9086-428a-a111-7e72fe481df2 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4" status: 200 len: 1298 microversion: 2.1 time: 0.211706 Oct 26 13:09:16.018727 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 957/1837] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:15 2022] GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4 => generated 1298 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:16.038525 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2282d532-c798-4718-b64f-33bd448f46fc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f6731f561f0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:16.156636 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2282d532-c798-4718-b64f-33bd448f46fc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc" status: 200 len: 1439 microversion: 2.1 time: 0.136484 Oct 26 13:09:16.157230 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 958/1838] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:09:16 2022] GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc => generated 1439 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:16.180492 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5ceff17f-c8b2-42f6-aeab-61984aa6b699 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:16.181130 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5ceff17f-c8b2-42f6-aeab-61984aa6b699 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] [instance: 523459ad-2398-43e2-b03b-3dc16c7214cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:16.226974 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5ceff17f-c8b2-42f6-aeab-61984aa6b699 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:16.227813 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5ceff17f-c8b2-42f6-aeab-61984aa6b699 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:16.228441 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5ceff17f-c8b2-42f6-aeab-61984aa6b699 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:16.229365 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5ceff17f-c8b2-42f6-aeab-61984aa6b699 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:16.232100 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5ceff17f-c8b2-42f6-aeab-61984aa6b699 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:16.232727 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5ceff17f-c8b2-42f6-aeab-61984aa6b699 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:16.516524 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5ceff17f-c8b2-42f6-aeab-61984aa6b699 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7849545fe2042618da2cd47f4a2b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075b65181daf492da145b2e815809d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:16.526498 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5ceff17f-c8b2-42f6-aeab-61984aa6b699 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] 10.222.0.40 "GET /compute/v2.1/servers/523459ad-2398-43e2-b03b-3dc16c7214cb" status: 200 len: 1646 microversion: 2.1 time: 0.368111 Oct 26 13:09:16.541167 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 959/1839] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:16 2022] GET /compute/v2.1/servers/523459ad-2398-43e2-b03b-3dc16c7214cb => generated 1646 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:16.595530 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cf5d1f34-0334-4942-a0db-987ab5fea5f6 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb3f2b0e3cc4326a1846f6755882dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f3d3f7efed04d7fb58147bc2ed55349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:16.615084 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cf5d1f34-0334-4942-a0db-987ab5fea5f6 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb44881-d590-4635-8c38-f107f70eaaa3" status: 200 len: 1314 microversion: 2.1 time: 1.303024 Oct 26 13:09:16.638809 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 881/1840] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:15 2022] GET /compute/v2.1/servers/bbb44881-d590-4635-8c38-f107f70eaaa3 => generated 1314 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:09:16.831198 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b23bd0c1-a0d8-42f4-a180-699688ad44e4 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:16.831815 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b23bd0c1-a0d8-42f4-a180-699688ad44e4 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:16.860620 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b23bd0c1-a0d8-42f4-a180-699688ad44e4 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:16.861133 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b23bd0c1-a0d8-42f4-a180-699688ad44e4 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:16.861619 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b23bd0c1-a0d8-42f4-a180-699688ad44e4 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:16.862425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b23bd0c1-a0d8-42f4-a180-699688ad44e4 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:16.862892 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b23bd0c1-a0d8-42f4-a180-699688ad44e4 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:16.863325 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b23bd0c1-a0d8-42f4-a180-699688ad44e4 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:17.039500 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8ee95f57-a429-4487-a1b4-7dc5a8da1939 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:17.040135 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8ee95f57-a429-4487-a1b4-7dc5a8da1939 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: 14fcf77a-99ed-4d7b-889a-19da49d9e4b4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:17.055216 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8ee95f57-a429-4487-a1b4-7dc5a8da1939 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:17.055729 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8ee95f57-a429-4487-a1b4-7dc5a8da1939 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:17.056174 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8ee95f57-a429-4487-a1b4-7dc5a8da1939 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:17.056912 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8ee95f57-a429-4487-a1b4-7dc5a8da1939 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:17.057375 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8ee95f57-a429-4487-a1b4-7dc5a8da1939 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:17.070189 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8ee95f57-a429-4487-a1b4-7dc5a8da1939 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:17.805155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8ee95f57-a429-4487-a1b4-7dc5a8da1939 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4c9b05864d4d448b1c722659a3bc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2336994846d345aa86b5fd940d1b004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:17.821774 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8ee95f57-a429-4487-a1b4-7dc5a8da1939 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4" status: 200 len: 1366 microversion: 2.1 time: 0.783006 Oct 26 13:09:17.823063 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 882/1841] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:17 2022] GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4 => generated 1366 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:17.830311 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1bf6a589-68ff-4be8-aa81-40d0a56778bb tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f6732210ca0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:17.956495 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1bf6a589-68ff-4be8-aa81-40d0a56778bb tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc" status: 200 len: 1439 microversion: 2.1 time: 0.129009 Oct 26 13:09:17.959554 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 883/1842] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:09:17 2022] GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc => generated 1439 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:17.990431 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-77b3fe38-2325-410f-8b71-a8f345c8885a req-a87f2224-8a5c-407a-a835-6427882295b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "523459ad-2398-43e2-b03b-3dc16c7214cb", "name": "network-vif-deleted", "tag": "ad3bf7f7-f2d9-4b92-a4fd-ba2b441e5413"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:18.053290 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-77b3fe38-2325-410f-8b71-a8f345c8885a req-a87f2224-8a5c-407a-a835-6427882295b4 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:18.055227 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-77b3fe38-2325-410f-8b71-a8f345c8885a req-a87f2224-8a5c-407a-a835-6427882295b4 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:18.057660 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-77b3fe38-2325-410f-8b71-a8f345c8885a req-a87f2224-8a5c-407a-a835-6427882295b4 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:18.095724 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-77b3fe38-2325-410f-8b71-a8f345c8885a req-a87f2224-8a5c-407a-a835-6427882295b4 service nova] Creating event network-vif-deleted:ad3bf7f7-f2d9-4b92-a4fd-ba2b441e5413 for instance 523459ad-2398-43e2-b03b-3dc16c7214cb on n-h1-862686-1 Oct 26 13:09:18.108775 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-77b3fe38-2325-410f-8b71-a8f345c8885a req-a87f2224-8a5c-407a-a835-6427882295b4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141394 Oct 26 13:09:18.119209 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 884/1843] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:18.131742 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d13be395-9933-4068-a728-9099e0d6c21c tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:18.132628 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d13be395-9933-4068-a728-9099e0d6c21c tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] [instance: 523459ad-2398-43e2-b03b-3dc16c7214cb] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:18.147946 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d13be395-9933-4068-a728-9099e0d6c21c tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:18.151093 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d13be395-9933-4068-a728-9099e0d6c21c tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:18.151977 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d13be395-9933-4068-a728-9099e0d6c21c tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:18.152953 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d13be395-9933-4068-a728-9099e0d6c21c tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:18.154682 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d13be395-9933-4068-a728-9099e0d6c21c tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:18.156629 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d13be395-9933-4068-a728-9099e0d6c21c tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:18.266035 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d13be395-9933-4068-a728-9099e0d6c21c tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:18.268901 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d13be395-9933-4068-a728-9099e0d6c21c tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:18.269687 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d13be395-9933-4068-a728-9099e0d6c21c tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:18.270994 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-d13be395-9933-4068-a728-9099e0d6c21c tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lazy-loading 'fault' on Instance uuid 523459ad-2398-43e2-b03b-3dc16c7214cb {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:09:18.290105 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=4 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:09:18.385462 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b23bd0c1-a0d8-42f4-a180-699688ad44e4 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:18.422087 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b23bd0c1-a0d8-42f4-a180-699688ad44e4 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:18.427279 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b23bd0c1-a0d8-42f4-a180-699688ad44e4 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:18.432019 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b23bd0c1-a0d8-42f4-a180-699688ad44e4 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 200 len: 1486 microversion: 2.25 time: 1.601616 Oct 26 13:09:18.434480 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 960/1844] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:09:16 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 1486 bytes in 1608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:09:18.451609 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8112c638-a930-4838-96aa-e90b786c3bce tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:18.464324 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8112c638-a930-4838-96aa-e90b786c3bce tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] [instance: bbb44881-d590-4635-8c38-f107f70eaaa3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:18.483226 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d13be395-9933-4068-a728-9099e0d6c21c tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7849545fe2042618da2cd47f4a2b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075b65181daf492da145b2e815809d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:18.495865 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d13be395-9933-4068-a728-9099e0d6c21c tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] 10.222.0.40 "GET /compute/v2.1/servers/523459ad-2398-43e2-b03b-3dc16c7214cb" status: 200 len: 1366 microversion: 2.1 time: 0.374850 Oct 26 13:09:18.518873 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 885/1845] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:18 2022] GET /compute/v2.1/servers/523459ad-2398-43e2-b03b-3dc16c7214cb => generated 1366 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:18.523232 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8112c638-a930-4838-96aa-e90b786c3bce tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:18.529191 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8112c638-a930-4838-96aa-e90b786c3bce tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:18.535350 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8112c638-a930-4838-96aa-e90b786c3bce tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:18.536513 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8112c638-a930-4838-96aa-e90b786c3bce tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:18.537671 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8112c638-a930-4838-96aa-e90b786c3bce tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:18.541131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8112c638-a930-4838-96aa-e90b786c3bce tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:18.864376 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e667cbb6-f91f-4d0b-b673-bf58748f8801 tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] Action: 'create', calling method: .version_select at 0x7f6732237ee0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxGCIPE4xrfkg2TArPxOTO1iIVJ3QKAAKCQHDAfgXnUJWod4bZgQK9j+NnG/T9nNWrQlu9Oy92MNxZ1imys173tx0b+r1rELSGuoj2HubPBGy8nez3WNAD1ZZqgborBFw=="}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:18.870539 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e667cbb6-f91f-4d0b-b673-bf58748f8801 tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] Request method failure captured: Oct 26 13:09:18.870539 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 26 13:09:18.870539 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:09:18.870539 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:09:18.870539 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:09:18.870539 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 257 Oct 26 13:09:18.870539 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:09:18.870539 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:09:18.870539 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:09:18.870539 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:09:18.870539 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTF9X5ushdX1JUPgITSPZBjR5Dnsb02rM2oijJrOUOtkmL_VymjhrKyFKyfbNy3Bw5etaRX6G1ayRuTJDNS-DjqHY43hvLjeg7lBfaNgGmBoO6eWbkkq-oylkzPqBiCWEY7__ZAYTz3XKExq6U-x-eGwlclCaJViW1vcWvvIphljREQ Oct 26 13:09:18.870539 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:09:18.870539 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:09:18.870539 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:09:18.870539 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:09:18.870539 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:09:18.870539 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:09:18.870539 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: bdfc2ab0d8ab4fe8b41587a87d620c1c Oct 26 13:09:18.870539 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1236876776 Oct 26 13:09:18.870539 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:09:18.870539 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:09:18.872217 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bdfc2ab0d8ab4fe8b41587a87d620c1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bdfc2ab0d8ab4fe8b41587a87d620c1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bdfc2ab0d8ab4fe8b41587a87d620c1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bdfc2ab0d8ab4fe8b41587a87d620c1c"}]}] Oct 26 13:09:18.872217 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1236876776 Oct 26 13:09:18.872217 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: bdfc2ab0d8ab4fe8b41587a87d620c1c Oct 26 13:09:18.872217 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1236876776 Oct 26 13:09:18.872217 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-KeyPairsNegativeTestJSON-1236876776-project Oct 26 13:09:18.872217 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:09:18.872217 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:09:18.872217 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 28711a1a9e5a489e915a2bb89caa6de0 Oct 26 13:09:18.872217 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1236876776-project Oct 26 13:09:18.872217 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:09:18.872217 n-d-862686-1 devstack@n-api.service[120597]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxGCIPE4xrfkg2TArPxOTO1iIVJ3QKAAKCQHDAfgXnUJWod4bZgQK9j+NnG/T9nNWrQlu9Oy92MNxZ1imys173tx0b+r1rELSGuoj2HubPBGy8nez3WNAD1ZZqgborBFw=="}} Oct 26 13:09:18.873087 n-d-862686-1 devstack@n-api.service[120597]: method: Oct 26 13:09:18.873087 n-d-862686-1 devstack@n-api.service[120597]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 26 13:09:18.873087 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxGCIPE4xrfkg2TArPxOTO1iIVJ3QKAAKCQHDAfgXnUJWod4bZgQK9j+NnG/T9nNWrQlu9Oy92MNxZ1imys173tx0b+r1rELSGuoj2HubPBGy8nez3WNAD1ZZqgborBFw=='}}} Oct 26 13:09:18.873087 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:09:18.873087 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:18.873087 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 26 13:09:18.873087 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 26 13:09:18.873087 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 26 13:09:18.873087 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 26 13:09:18.873087 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 26 13:09:18.873087 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 26 13:09:18.873087 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 26 13:09:18.873087 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:09:18.873087 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 26 13:09:18.873087 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:09:18.873087 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:18.873087 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 13:09:18.874321 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 13:09:18.874321 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 13:09:18.874321 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise error Oct 26 13:09:18.874321 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 26 13:09:18.874321 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:09:18.874321 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 26 13:09:18.874321 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 26 13:09:18.874321 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 26 13:09:18.874321 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 26 13:09:18.874321 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 26 13:09:18.874321 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:09:18.874321 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 26 13:09:18.874321 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 26 13:09:18.874321 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:09:18.874321 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:09:18.874321 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:09:18.874321 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:18.874321 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:09:18.874321 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:09:18.874321 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:09:18.874321 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:09:18.874321 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:09:18.874321 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:09:18.875853 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:09:18.875853 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:09:18.875853 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:09:18.875853 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:09:18.875853 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 13:09:18.875853 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 13:09:18.875853 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 13:09:18.875853 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 13:09:18.875853 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 13:09:18.875853 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 13:09:18.875853 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 26 13:09:18.875853 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:09:18.875853 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:09:18.875853 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:09:18.875853 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:18.875853 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:09:18.875853 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:09:18.875853 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 13:09:18.875853 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 13:09:18.877260 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 26 13:09:18.877260 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:09:18.877260 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e667cbb6-f91f-4d0b-b673-bf58748f8801 tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:09:18.877260 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e667cbb6-f91f-4d0b-b673-bf58748f8801 tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.353181 Oct 26 13:09:18.877260 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 886/1846] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 13:09:18 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 354 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:09:18.886547 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-d73b78a9-b6ff-439c-9072-dc7486ea630e req-1cd930dc-2f55-479f-a3cc-e821a4008457 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb087101-2eda-4145-bdcc-41673edfcbb7", "name": "network-vif-plugged", "status": "completed", "tag": "9caa8004-d404-4f87-9693-e2931b83f65c"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:18.913144 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d73b78a9-b6ff-439c-9072-dc7486ea630e req-1cd930dc-2f55-479f-a3cc-e821a4008457 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:18.913679 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d73b78a9-b6ff-439c-9072-dc7486ea630e req-1cd930dc-2f55-479f-a3cc-e821a4008457 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:18.914118 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d73b78a9-b6ff-439c-9072-dc7486ea630e req-1cd930dc-2f55-479f-a3cc-e821a4008457 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:18.918578 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:09:18.928543 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-d73b78a9-b6ff-439c-9072-dc7486ea630e req-1cd930dc-2f55-479f-a3cc-e821a4008457 service nova] Creating event network-vif-plugged:9caa8004-d404-4f87-9693-e2931b83f65c for instance cb087101-2eda-4145-bdcc-41673edfcbb7 on n-h2-862686-1 Oct 26 13:09:18.948837 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-d73b78a9-b6ff-439c-9072-dc7486ea630e req-1cd930dc-2f55-479f-a3cc-e821a4008457 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062939 Oct 26 13:09:18.949858 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 887/1847] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:18.955191 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7d4ab95e-91c7-49fd-9aab-f24dab1b76ac tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:18.955923 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7d4ab95e-91c7-49fd-9aab-f24dab1b76ac tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: 14fcf77a-99ed-4d7b-889a-19da49d9e4b4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:18.965887 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d4ab95e-91c7-49fd-9aab-f24dab1b76ac tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:18.966378 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d4ab95e-91c7-49fd-9aab-f24dab1b76ac tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:18.966850 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d4ab95e-91c7-49fd-9aab-f24dab1b76ac tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:18.968756 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d4ab95e-91c7-49fd-9aab-f24dab1b76ac tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:18.968756 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d4ab95e-91c7-49fd-9aab-f24dab1b76ac tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:18.977885 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d4ab95e-91c7-49fd-9aab-f24dab1b76ac tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:19.229021 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8112c638-a930-4838-96aa-e90b786c3bce tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb3f2b0e3cc4326a1846f6755882dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f3d3f7efed04d7fb58147bc2ed55349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:19.246183 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8112c638-a930-4838-96aa-e90b786c3bce tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb44881-d590-4635-8c38-f107f70eaaa3" status: 200 len: 1314 microversion: 2.1 time: 0.809212 Oct 26 13:09:19.247056 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 961/1848] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:18 2022] GET /compute/v2.1/servers/bbb44881-d590-4635-8c38-f107f70eaaa3 => generated 1314 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:19.262095 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bd27f951-306d-43f9-b8a9-afedb1242af7 tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] Action: 'create', calling method: .version_select at 0x7f6731fa8e50>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1670060869", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:19.313643 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-bd27f951-306d-43f9-b8a9-afedb1242af7 tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] Getting quotas for project bdfc2ab0d8ab4fe8b41587a87d620c1c. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:09:19.328007 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-bd27f951-306d-43f9-b8a9-afedb1242af7 tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] Getting quotas for user 28711a1a9e5a489e915a2bb89caa6de0 and project bdfc2ab0d8ab4fe8b41587a87d620c1c. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:09:19.373764 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-bd27f951-306d-43f9-b8a9-afedb1242af7 tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 26 13:09:19.390123 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bd27f951-306d-43f9-b8a9-afedb1242af7 tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] Request method failure captured: Oct 26 13:09:19.390123 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 26 13:09:19.390123 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:09:19.390123 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:09:19.390123 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:09:19.390123 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 2167 Oct 26 13:09:19.390123 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:09:19.390123 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:09:19.390123 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:09:19.390123 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:09:19.390123 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTF9X5ushdX1JUPgITSPZBjR5Dnsb02rM2oijJrOUOtkmL_VymjhrKyFKyfbNy3Bw5etaRX6G1ayRuTJDNS-DjqHY43hvLjeg7lBfaNgGmBoO6eWbkkq-oylkzPqBiCWEY7__ZAYTz3XKExq6U-x-eGwlclCaJViW1vcWvvIphljREQ Oct 26 13:09:19.390123 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:09:19.390123 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:09:19.390123 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:09:19.390123 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:09:19.390123 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:09:19.390123 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:09:19.390123 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: bdfc2ab0d8ab4fe8b41587a87d620c1c Oct 26 13:09:19.390123 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1236876776 Oct 26 13:09:19.390123 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:09:19.390123 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:09:19.390123 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bdfc2ab0d8ab4fe8b41587a87d620c1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bdfc2ab0d8ab4fe8b41587a87d620c1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bdfc2ab0d8ab4fe8b41587a87d620c1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bdfc2ab0d8ab4fe8b41587a87d620c1c"}]}] Oct 26 13:09:19.390123 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1236876776 Oct 26 13:09:19.390123 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: bdfc2ab0d8ab4fe8b41587a87d620c1c Oct 26 13:09:19.390123 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1236876776 Oct 26 13:09:19.390123 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-KeyPairsNegativeTestJSON-1236876776-project Oct 26 13:09:19.390123 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:09:19.390123 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:09:19.390123 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 28711a1a9e5a489e915a2bb89caa6de0 Oct 26 13:09:19.390123 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1236876776-project Oct 26 13:09:19.390123 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:09:19.390123 n-d-862686-1 devstack@n-api.service[120598]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1670060869", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 26 13:09:19.390123 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:09:19.390123 n-d-862686-1 devstack@n-api.service[120598]: exception: Keypair data is invalid: failed to generate fingerprint Oct 26 13:09:19.393850 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1670060869', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 26 13:09:19.393850 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:09:19.393850 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:19.393850 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 26 13:09:19.393850 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 26 13:09:19.393850 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 26 13:09:19.393850 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 26 13:09:19.393850 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 26 13:09:19.393850 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:19.393850 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:09:19.393850 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:19.393850 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:19.393850 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 26 13:09:19.393850 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 26 13:09:19.393850 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 26 13:09:19.393850 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 26 13:09:19.393850 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 13:09:19.393850 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 13:09:19.393850 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 13:09:19.393850 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 13:09:19.393850 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 26 13:09:19.393850 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 26 13:09:19.393850 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 26 13:09:19.393850 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 26 13:09:19.393850 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 26 13:09:19.393850 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 26 13:09:19.393850 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 26 13:09:19.393850 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 26 13:09:19.393850 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 26 13:09:19.393850 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:19.393850 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:09:19.393850 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:19.393850 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:19.393850 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:09:19.393850 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:09:19.393850 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:09:19.393850 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:09:19.393850 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:09:19.393850 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:09:19.393850 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:09:19.393850 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:09:19.397302 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:09:19.397302 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:09:19.397302 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:09:19.397302 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:09:19.397302 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 26 13:09:19.397302 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 26 13:09:19.397302 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 26 13:09:19.397302 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 26 13:09:19.397302 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 26 13:09:19.397302 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:19.397302 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:09:19.397302 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:19.397302 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:19.397302 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:09:19.397302 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:09:19.397302 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:09:19.397302 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:09:19.397302 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 26 13:09:19.397302 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:19.397302 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bd27f951-306d-43f9-b8a9-afedb1242af7 tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:09:19.397302 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bd27f951-306d-43f9-b8a9-afedb1242af7 tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.143973 Oct 26 13:09:19.417967 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 962/1849] 10.222.0.40 () {60 vars in 1160 bytes} [Wed Oct 26 13:09:19 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 170 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 26 13:09:19.457033 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-97e8b705-7fca-41c5-8c28-7894d15cf13b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67368c6dc0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:19.585465 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-97e8b705-7fca-41c5-8c28-7894d15cf13b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc" status: 200 len: 1439 microversion: 2.1 time: 0.166288 Oct 26 13:09:19.586510 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 963/1850] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:09:19 2022] GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc => generated 1439 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:19.600030 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7c7f8250-e19c-4aa0-8158-a0f94ca26068 tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] Action: 'create', calling method: .version_select at 0x7f67369970d0>, body: {"keypair": {"name": "tempest-keypair-1759943038", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQTtYjaohUpvTOuABYjKBq9Q+hGqnQ4eWTWWO8bUg55WcG2A8es5bwtljIAtqo2kkDnu0gA6oiO/PXmS51UGsMbgLIb1JNboIaWuxQI7av3rEO+BTYNs+vCppXvgAJltg=="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:19.660105 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7d4ab95e-91c7-49fd-9aab-f24dab1b76ac tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4c9b05864d4d448b1c722659a3bc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2336994846d345aa86b5fd940d1b004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:19.661556 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-7c7f8250-e19c-4aa0-8158-a0f94ca26068 tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] Getting quotas for project bdfc2ab0d8ab4fe8b41587a87d620c1c. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:09:19.673071 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7d4ab95e-91c7-49fd-9aab-f24dab1b76ac tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4" status: 200 len: 1366 microversion: 2.1 time: 0.721941 Oct 26 13:09:19.677334 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 888/1851] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:18 2022] GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4 => generated 1366 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:19.681289 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-7c7f8250-e19c-4aa0-8158-a0f94ca26068 tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] Getting quotas for user 28711a1a9e5a489e915a2bb89caa6de0 and project bdfc2ab0d8ab4fe8b41587a87d620c1c. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:09:19.688277 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-307348f9-ac8b-4f83-bc6e-5b81f88cd202 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:19.690867 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-307348f9-ac8b-4f83-bc6e-5b81f88cd202 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:19.713543 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-307348f9-ac8b-4f83-bc6e-5b81f88cd202 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:19.717433 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-307348f9-ac8b-4f83-bc6e-5b81f88cd202 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:19.720814 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-307348f9-ac8b-4f83-bc6e-5b81f88cd202 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:19.723983 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-307348f9-ac8b-4f83-bc6e-5b81f88cd202 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:19.730044 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-307348f9-ac8b-4f83-bc6e-5b81f88cd202 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:19.734294 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-307348f9-ac8b-4f83-bc6e-5b81f88cd202 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:19.742172 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7c7f8250-e19c-4aa0-8158-a0f94ca26068 tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.154258 Oct 26 13:09:19.745440 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 964/1852] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 13:09:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:19.762401 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8b825ac2-3af7-446f-9233-c49e28ae7a54 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:19.765613 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8b825ac2-3af7-446f-9233-c49e28ae7a54 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] [instance: 523459ad-2398-43e2-b03b-3dc16c7214cb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:19.786344 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b825ac2-3af7-446f-9233-c49e28ae7a54 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:19.787350 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b825ac2-3af7-446f-9233-c49e28ae7a54 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:19.788640 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b825ac2-3af7-446f-9233-c49e28ae7a54 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:19.789399 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b825ac2-3af7-446f-9233-c49e28ae7a54 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:19.789910 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b825ac2-3af7-446f-9233-c49e28ae7a54 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:19.790338 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b825ac2-3af7-446f-9233-c49e28ae7a54 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:19.851192 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-8b825ac2-3af7-446f-9233-c49e28ae7a54 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] HTTP exception thrown: Instance 523459ad-2398-43e2-b03b-3dc16c7214cb could not be found. Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8b825ac2-3af7-446f-9233-c49e28ae7a54 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Request method failure captured: Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/523459ad-2398-43e2-b03b-3dc16c7214cb HTTP/1.1 Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTExGpzO_b3kY1LPV8U6EXQGowy1gpv5puo8QT8T7q8hvuJnRvj_jy8xpHmRT6nDIMDyLHgRJ1Wx19_qgM58kqiJMqG4DagXMLGd8Xb8-sk0Hy9LcvFNUyOKmCpcUxp443yTY5Etgz7hE4nvKAM-WU1UcL374lYKrryDFuH5mzxATnM Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 075b65181daf492da145b2e815809d91 Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersTestManualDisk-995970990 Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/075b65181daf492da145b2e815809d91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/075b65181daf492da145b2e815809d91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_075b65181daf492da145b2e815809d91"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/075b65181daf492da145b2e815809d91"}]}] Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersTestManualDisk-995970990 Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 075b65181daf492da145b2e815809d91 Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersTestManualDisk-995970990 Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersTestManualDisk-995970990-project Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: c7849545fe2042618da2cd47f4a2b47d Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersTestManualDisk-995970990-project Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 523459ad-2398-43e2-b03b-3dc16c7214cb could not be found. Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '523459ad-2398-43e2-b03b-3dc16c7214cb'} Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 523459ad-2398-43e2-b03b-3dc16c7214cb could not be found. Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 523459ad-2398-43e2-b03b-3dc16c7214cb could not be found. Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:09:19.852852 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:19.857867 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:19.857867 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:09:19.857867 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:09:19.857867 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:09:19.857867 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:09:19.857867 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 523459ad-2398-43e2-b03b-3dc16c7214cb could not be found. Oct 26 13:09:19.857867 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:19.857867 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8b825ac2-3af7-446f-9233-c49e28ae7a54 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Returning 404 to user: Instance 523459ad-2398-43e2-b03b-3dc16c7214cb could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:09:19.857867 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8b825ac2-3af7-446f-9233-c49e28ae7a54 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] 10.222.0.40 "GET /compute/v2.1/servers/523459ad-2398-43e2-b03b-3dc16c7214cb" status: 404 len: 111 microversion: 2.1 time: 0.104719 Oct 26 13:09:19.865228 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 965/1853] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:19 2022] GET /compute/v2.1/servers/523459ad-2398-43e2-b03b-3dc16c7214cb => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:09:19.881321 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f6413cde-fe8f-419c-b712-46f2eac7de1b tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] Action: 'create', calling method: .version_select at 0x7f67368e1430>, body: {"keypair": {"name": "tempest-keypair-1759943038", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMpzfge2xV8MCGMpErwyiRDTtpmYTBwOm63ShYbVL8qYjTRGtpv7xDcCL3sl0Mvm/um6CuAkalNH0/aLk3yJmmo/In5ajzhNCuW1kjxt3XVHO97hOoK4jG2cElovySENlQ=="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:19.959489 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-f6413cde-fe8f-419c-b712-46f2eac7de1b tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] Getting quotas for project bdfc2ab0d8ab4fe8b41587a87d620c1c. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:09:19.966249 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-f6413cde-fe8f-419c-b712-46f2eac7de1b tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] Getting quotas for user 28711a1a9e5a489e915a2bb89caa6de0 and project bdfc2ab0d8ab4fe8b41587a87d620c1c. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:09:19.973709 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=4 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:09:20.026479 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-f6413cde-fe8f-419c-b712-46f2eac7de1b tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] HTTP exception thrown: Key pair 'tempest-keypair-1759943038' already exists. Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f6413cde-fe8f-419c-b712-46f2eac7de1b tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] Request method failure captured: Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 273 Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTF9X5ushdX1JUPgITSPZBjR5Dnsb02rM2oijJrOUOtkmL_VymjhrKyFKyfbNy3Bw5etaRX6G1ayRuTJDNS-DjqHY43hvLjeg7lBfaNgGmBoO6eWbkkq-oylkzPqBiCWEY7__ZAYTz3XKExq6U-x-eGwlclCaJViW1vcWvvIphljREQ Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: bdfc2ab0d8ab4fe8b41587a87d620c1c Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1236876776 Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bdfc2ab0d8ab4fe8b41587a87d620c1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bdfc2ab0d8ab4fe8b41587a87d620c1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bdfc2ab0d8ab4fe8b41587a87d620c1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bdfc2ab0d8ab4fe8b41587a87d620c1c"}]}] Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1236876776 Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: bdfc2ab0d8ab4fe8b41587a87d620c1c Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1236876776 Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-KeyPairsNegativeTestJSON-1236876776-project Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 28711a1a9e5a489e915a2bb89caa6de0 Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1236876776-project Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: {"keypair": {"name": "tempest-keypair-1759943038", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMpzfge2xV8MCGMpErwyiRDTtpmYTBwOm63ShYbVL8qYjTRGtpv7xDcCL3sl0Mvm/um6CuAkalNH0/aLk3yJmmo/In5ajzhNCuW1kjxt3XVHO97hOoK4jG2cElovySENlQ=="}} Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: exception: Key pair 'tempest-keypair-1759943038' already exists. Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1759943038', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMpzfge2xV8MCGMpErwyiRDTtpmYTBwOm63ShYbVL8qYjTRGtpv7xDcCL3sl0Mvm/um6CuAkalNH0/aLk3yJmmo/In5ajzhNCuW1kjxt3XVHO97hOoK4jG2cElovySENlQ=='}}} Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result.read() Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '28711a1a9e5a489e915a2bb89caa6de0-tempest-keypair-1759943038' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 26 13:09:20.030519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi session.flush() Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result.read() Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 26 13:09:20.035597 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '28711a1a9e5a489e915a2bb89caa6de0-tempest-keypair-1759943038' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 26, 13, 9, 20, 9799), 'updated_at': None, 'name': 'tempest-keypair-1759943038', 'user_id': '28711a1a9e5a489e915a2bb89caa6de0', 'fingerprint': '3a:49:af:e2:ea:d8:d3:d0:0a:66:90:de:21:3c:34:d9', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMpzfge2xV8MCGMpErwyiRDTtpmYTBwOm63ShYbVL8qYjTRGtpv7xDcCL3sl0Mvm/um6CuAkalNH0/aLk3yJmmo/In5ajzhNCuW1kjxt3XVHO97hOoK4jG2cElovySENlQ==', 'type': 'ssh'}] Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi keypair.create() Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._create() Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1759943038' already exists. Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 26 13:09:20.045165 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1759943038' already exists. Oct 26 13:09:20.054649 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:20.054649 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:09:20.054649 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:20.054649 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:20.054649 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:09:20.054649 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:09:20.054649 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:09:20.054649 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:09:20.054649 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1759943038' already exists. Oct 26 13:09:20.054649 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:20.054649 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f6413cde-fe8f-419c-b712-46f2eac7de1b tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] Returning 409 to user: Key pair 'tempest-keypair-1759943038' already exists. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:09:20.054649 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f6413cde-fe8f-419c-b712-46f2eac7de1b tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.165854 Oct 26 13:09:20.054649 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 966/1854] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 13:09:19 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 170 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:09:20.054649 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-91b7d4d6-2a74-4733-8479-3ef9525ccb56 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] Calling method '.version_select at 0x7f673698f820>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:20.106319 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-91b7d4d6-2a74-4733-8479-3ef9525ccb56 tempest-ServersTestManualDisk-995970990 tempest-ServersTestManualDisk-995970990-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-951577738" status: 202 len: 0 microversion: 2.1 time: 0.069103 Oct 26 13:09:20.109579 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 967/1855] 10.222.0.40 () {58 vars in 1218 bytes} [Wed Oct 26 13:09:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-951577738 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:09:20.128510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9240d5c9-f54b-426c-8e26-6cb3f55f7b23 tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] Calling method '.version_select at 0x7f67368e1790>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:20.182094 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9240d5c9-f54b-426c-8e26-6cb3f55f7b23 tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1759943038" status: 202 len: 0 microversion: 2.1 time: 0.072619 Oct 26 13:09:20.182689 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 968/1856] 10.222.0.40 () {58 vars in 1221 bytes} [Wed Oct 26 13:09:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1759943038 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:09:20.196310 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-63017f0e-ed2e-4d1d-9d9e-6092a77ab30a tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] Action: 'create', calling method: .version_select at 0x7f6736922310>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcx//+BpkS95L9TxORkJkq9JkSPAJs8WFXChFDm811a6ramfLbXlrTIoD922J0xfEnCWYjVu5FG+qL/qZMhiXCCXgM8cZXdOw8lChuez5sd+WzRLK4a+v3PEpXNDTc+eA=="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-63017f0e-ed2e-4d1d-9d9e-6092a77ab30a tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] Request method failure captured: Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 247 Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTF9X5ushdX1JUPgITSPZBjR5Dnsb02rM2oijJrOUOtkmL_VymjhrKyFKyfbNy3Bw5etaRX6G1ayRuTJDNS-DjqHY43hvLjeg7lBfaNgGmBoO6eWbkkq-oylkzPqBiCWEY7__ZAYTz3XKExq6U-x-eGwlclCaJViW1vcWvvIphljREQ Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: bdfc2ab0d8ab4fe8b41587a87d620c1c Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1236876776 Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bdfc2ab0d8ab4fe8b41587a87d620c1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bdfc2ab0d8ab4fe8b41587a87d620c1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bdfc2ab0d8ab4fe8b41587a87d620c1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bdfc2ab0d8ab4fe8b41587a87d620c1c"}]}] Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1236876776 Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: bdfc2ab0d8ab4fe8b41587a87d620c1c Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1236876776 Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-KeyPairsNegativeTestJSON-1236876776-project Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 28711a1a9e5a489e915a2bb89caa6de0 Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1236876776-project Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcx//+BpkS95L9TxORkJkq9JkSPAJs8WFXChFDm811a6ramfLbXlrTIoD922J0xfEnCWYjVu5FG+qL/qZMhiXCCXgM8cZXdOw8lChuez5sd+WzRLK4a+v3PEpXNDTc+eA=="}} Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcx//+BpkS95L9TxORkJkq9JkSPAJs8WFXChFDm811a6ramfLbXlrTIoD922J0xfEnCWYjVu5FG+qL/qZMhiXCCXgM8cZXdOw8lChuez5sd+WzRLK4a+v3PEpXNDTc+eA=='}}} Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise error Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi '' Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 13:09:20.203169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 13:09:20.207861 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 13:09:20.207861 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 13:09:20.207861 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 13:09:20.207861 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 13:09:20.207861 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 26 13:09:20.207861 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:20.207861 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:09:20.207861 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:20.207861 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:20.207861 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:09:20.207861 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:09:20.207861 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 13:09:20.207861 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 13:09:20.207861 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 26 13:09:20.207861 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:20.211421 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-63017f0e-ed2e-4d1d-9d9e-6092a77ab30a tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:09:20.212528 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-63017f0e-ed2e-4d1d-9d9e-6092a77ab30a tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.021184 Oct 26 13:09:20.213339 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 969/1857] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 13:09:20 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 26 13:09:20.230501 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-746a3006-25d1-45eb-b326-028ed6506523 tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] Action: 'create', calling method: .version_select at 0x7f67368c8f70>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-722584428", "public_key": " "}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:20.317810 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-746a3006-25d1-45eb-b326-028ed6506523 tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] Getting quotas for project bdfc2ab0d8ab4fe8b41587a87d620c1c. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:09:20.334076 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-746a3006-25d1-45eb-b326-028ed6506523 tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] Getting quotas for user 28711a1a9e5a489e915a2bb89caa6de0 and project bdfc2ab0d8ab4fe8b41587a87d620c1c. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:09:20.408168 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-746a3006-25d1-45eb-b326-028ed6506523 tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-746a3006-25d1-45eb-b326-028ed6506523 tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] Request method failure captured: Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 94 Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTF9X5ushdX1JUPgITSPZBjR5Dnsb02rM2oijJrOUOtkmL_VymjhrKyFKyfbNy3Bw5etaRX6G1ayRuTJDNS-DjqHY43hvLjeg7lBfaNgGmBoO6eWbkkq-oylkzPqBiCWEY7__ZAYTz3XKExq6U-x-eGwlclCaJViW1vcWvvIphljREQ Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: bdfc2ab0d8ab4fe8b41587a87d620c1c Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1236876776 Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bdfc2ab0d8ab4fe8b41587a87d620c1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bdfc2ab0d8ab4fe8b41587a87d620c1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bdfc2ab0d8ab4fe8b41587a87d620c1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bdfc2ab0d8ab4fe8b41587a87d620c1c"}]}] Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1236876776 Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: bdfc2ab0d8ab4fe8b41587a87d620c1c Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1236876776 Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-KeyPairsNegativeTestJSON-1236876776-project Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 28711a1a9e5a489e915a2bb89caa6de0 Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1236876776-project Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-722584428", "public_key": " "}} Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: exception: Keypair data is invalid: failed to generate fingerprint Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-722584428', 'public_key': ' '}}} Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:09:20.410119 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:20.415509 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:20.415509 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:09:20.415509 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:09:20.415509 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:09:20.415509 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:09:20.415509 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:09:20.415509 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:09:20.415509 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:09:20.415509 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:09:20.415509 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:09:20.415509 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:09:20.415509 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:09:20.415509 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:09:20.415509 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 26 13:09:20.415509 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 26 13:09:20.415509 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 26 13:09:20.415509 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 26 13:09:20.415509 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 26 13:09:20.415509 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:20.415509 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:09:20.415509 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:20.415509 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:20.415509 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:09:20.415509 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:09:20.415509 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:09:20.415509 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:09:20.415509 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 26 13:09:20.415509 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:20.430404 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-746a3006-25d1-45eb-b326-028ed6506523 tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:09:20.431648 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-746a3006-25d1-45eb-b326-028ed6506523 tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.211029 Oct 26 13:09:20.432452 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 970/1858] 10.222.0.40 () {60 vars in 1158 bytes} [Wed Oct 26 13:09:20 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 214 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 26 13:09:20.450201 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b118a366-e203-425c-971a-f5c42b2d1ba8 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:20.454732 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b118a366-e203-425c-971a-f5c42b2d1ba8 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] [instance: bbb44881-d590-4635-8c38-f107f70eaaa3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:20.489585 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b118a366-e203-425c-971a-f5c42b2d1ba8 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:20.498206 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b118a366-e203-425c-971a-f5c42b2d1ba8 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:20.498206 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b118a366-e203-425c-971a-f5c42b2d1ba8 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:20.498206 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b118a366-e203-425c-971a-f5c42b2d1ba8 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:20.505626 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b118a366-e203-425c-971a-f5c42b2d1ba8 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:20.508179 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b118a366-e203-425c-971a-f5c42b2d1ba8 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:20.737853 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=4 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:09:21.041073 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b118a366-e203-425c-971a-f5c42b2d1ba8 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb3f2b0e3cc4326a1846f6755882dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f3d3f7efed04d7fb58147bc2ed55349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:21.057355 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b118a366-e203-425c-971a-f5c42b2d1ba8 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb44881-d590-4635-8c38-f107f70eaaa3" status: 200 len: 1314 microversion: 2.1 time: 0.620556 Oct 26 13:09:21.073521 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 971/1859] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:20 2022] GET /compute/v2.1/servers/bbb44881-d590-4635-8c38-f107f70eaaa3 => generated 1314 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:21.073521 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ce684e86-0ba0-4aad-bbdc-81fcbf26aa8f tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] Action: 'create', calling method: .version_select at 0x7f6736922c10>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBls3EuDR7RepnvxXY4vE4UIArwwMNnVTBd2CilwX4SA7hYLyriIk5bY6SO2u21n4eaoIL4pZNFvzI0fKzv0UOfFKNfWg5IN06QKIpcc8V8VMJm+d5CpehCTt2qVZFDUg=="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:21.081332 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ce684e86-0ba0-4aad-bbdc-81fcbf26aa8f tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] Request method failure captured: Oct 26 13:09:21.081332 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 26 13:09:21.081332 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:09:21.081332 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:09:21.081332 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:09:21.081332 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 507 Oct 26 13:09:21.081332 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:09:21.081332 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:09:21.081332 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:09:21.081332 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:09:21.081332 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTF9X5ushdX1JUPgITSPZBjR5Dnsb02rM2oijJrOUOtkmL_VymjhrKyFKyfbNy3Bw5etaRX6G1ayRuTJDNS-DjqHY43hvLjeg7lBfaNgGmBoO6eWbkkq-oylkzPqBiCWEY7__ZAYTz3XKExq6U-x-eGwlclCaJViW1vcWvvIphljREQ Oct 26 13:09:21.081332 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:09:21.081332 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:09:21.081332 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:09:21.081332 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:09:21.081332 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:09:21.081332 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:09:21.081332 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: bdfc2ab0d8ab4fe8b41587a87d620c1c Oct 26 13:09:21.081332 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1236876776 Oct 26 13:09:21.081332 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:09:21.081332 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:09:21.081332 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bdfc2ab0d8ab4fe8b41587a87d620c1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bdfc2ab0d8ab4fe8b41587a87d620c1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bdfc2ab0d8ab4fe8b41587a87d620c1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bdfc2ab0d8ab4fe8b41587a87d620c1c"}]}] Oct 26 13:09:21.081332 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1236876776 Oct 26 13:09:21.081332 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: bdfc2ab0d8ab4fe8b41587a87d620c1c Oct 26 13:09:21.081332 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1236876776 Oct 26 13:09:21.081332 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-KeyPairsNegativeTestJSON-1236876776-project Oct 26 13:09:21.081332 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:09:21.081332 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:09:21.081332 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 28711a1a9e5a489e915a2bb89caa6de0 Oct 26 13:09:21.081332 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1236876776-project Oct 26 13:09:21.081332 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:09:21.081332 n-d-862686-1 devstack@n-api.service[120598]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBls3EuDR7RepnvxXY4vE4UIArwwMNnVTBd2CilwX4SA7hYLyriIk5bY6SO2u21n4eaoIL4pZNFvzI0fKzv0UOfFKNfWg5IN06QKIpcc8V8VMJm+d5CpehCTt2qVZFDUg=="}} Oct 26 13:09:21.081332 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:09:21.081332 n-d-862686-1 devstack@n-api.service[120598]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 26 13:09:21.081332 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBls3EuDR7RepnvxXY4vE4UIArwwMNnVTBd2CilwX4SA7hYLyriIk5bY6SO2u21n4eaoIL4pZNFvzI0fKzv0UOfFKNfWg5IN06QKIpcc8V8VMJm+d5CpehCTt2qVZFDUg=='}}} Oct 26 13:09:21.081332 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:09:21.081332 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:21.081332 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 13:09:21.081332 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 13:09:21.081332 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 13:09:21.081332 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise error Oct 26 13:09:21.081332 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 26 13:09:21.081332 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:21.081332 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 26 13:09:21.081332 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 26 13:09:21.081332 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:21.081332 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 26 13:09:21.081332 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 26 13:09:21.085601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:21.085601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:09:21.085601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:21.085601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:21.085601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:09:21.085601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:09:21.085601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:09:21.085601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:09:21.085601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:09:21.085601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:09:21.085601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:09:21.085601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:09:21.085601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:09:21.085601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:09:21.085601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 13:09:21.085601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 13:09:21.085601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 13:09:21.085601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 13:09:21.085601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 13:09:21.085601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 13:09:21.085601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 26 13:09:21.085601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:21.085601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:09:21.085601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:21.085601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:21.085601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:09:21.085601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:09:21.085601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 13:09:21.085601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 13:09:21.085601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 26 13:09:21.085601 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:21.085601 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ce684e86-0ba0-4aad-bbdc-81fcbf26aa8f tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:09:21.087810 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ce684e86-0ba0-4aad-bbdc-81fcbf26aa8f tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.023103 Oct 26 13:09:21.092008 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 972/1860] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 13:09:21 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:09:21.106762 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f551d1b2-2c73-4fd8-b766-79f36300e46e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67368e1e50>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:21.168363 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-307348f9-ac8b-4f83-bc6e-5b81f88cd202 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:21.197632 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-307348f9-ac8b-4f83-bc6e-5b81f88cd202 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:21.201570 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-307348f9-ac8b-4f83-bc6e-5b81f88cd202 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:21.203608 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-307348f9-ac8b-4f83-bc6e-5b81f88cd202 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 200 len: 1486 microversion: 2.25 time: 1.523680 Oct 26 13:09:21.205391 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f551d1b2-2c73-4fd8-b766-79f36300e46e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc" status: 200 len: 1439 microversion: 2.1 time: 0.112235 Oct 26 13:09:21.206261 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 889/1861] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:09:19 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 1486 bytes in 1528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:09:21.217270 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fe5a10d8-7225-4b96-91d1-b2899171f531 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:21.219841 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fe5a10d8-7225-4b96-91d1-b2899171f531 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: 14fcf77a-99ed-4d7b-889a-19da49d9e4b4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:21.228725 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 973/1862] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:09:21 2022] GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc => generated 1439 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:21.234158 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-684135b6-e2ba-4c82-8eed-e0a804ac67b2 tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] Action: 'create', calling method: .version_select at 0x7f67320a11f0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-696490870", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:21.237114 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fe5a10d8-7225-4b96-91d1-b2899171f531 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:21.238549 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fe5a10d8-7225-4b96-91d1-b2899171f531 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:21.242190 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fe5a10d8-7225-4b96-91d1-b2899171f531 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:21.243540 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fe5a10d8-7225-4b96-91d1-b2899171f531 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:21.246624 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fe5a10d8-7225-4b96-91d1-b2899171f531 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:21.247365 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fe5a10d8-7225-4b96-91d1-b2899171f531 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:21.277946 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-684135b6-e2ba-4c82-8eed-e0a804ac67b2 tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] Getting quotas for project bdfc2ab0d8ab4fe8b41587a87d620c1c. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:09:21.290552 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-684135b6-e2ba-4c82-8eed-e0a804ac67b2 tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] Getting quotas for user 28711a1a9e5a489e915a2bb89caa6de0 and project bdfc2ab0d8ab4fe8b41587a87d620c1c. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:09:21.318322 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=14 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:09:21.347954 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-684135b6-e2ba-4c82-8eed-e0a804ac67b2 tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-684135b6-e2ba-4c82-8eed-e0a804ac67b2 tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] Request method failure captured: Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 117 Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTF9X5ushdX1JUPgITSPZBjR5Dnsb02rM2oijJrOUOtkmL_VymjhrKyFKyfbNy3Bw5etaRX6G1ayRuTJDNS-DjqHY43hvLjeg7lBfaNgGmBoO6eWbkkq-oylkzPqBiCWEY7__ZAYTz3XKExq6U-x-eGwlclCaJViW1vcWvvIphljREQ Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: bdfc2ab0d8ab4fe8b41587a87d620c1c Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1236876776 Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bdfc2ab0d8ab4fe8b41587a87d620c1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bdfc2ab0d8ab4fe8b41587a87d620c1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bdfc2ab0d8ab4fe8b41587a87d620c1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bdfc2ab0d8ab4fe8b41587a87d620c1c"}]}] Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1236876776 Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: bdfc2ab0d8ab4fe8b41587a87d620c1c Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1236876776 Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-KeyPairsNegativeTestJSON-1236876776-project Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 28711a1a9e5a489e915a2bb89caa6de0 Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1236876776-project Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-696490870", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: exception: Keypair data is invalid: failed to generate fingerprint Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-696490870', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 26 13:09:21.360621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 26 13:09:21.370389 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 26 13:09:21.370389 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 26 13:09:21.370389 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 26 13:09:21.370389 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:21.370389 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:09:21.370389 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:21.370389 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:21.370389 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:09:21.370389 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:09:21.370389 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:09:21.370389 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:09:21.370389 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:09:21.370389 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:09:21.370389 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:09:21.370389 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:09:21.370389 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:09:21.370389 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:09:21.370389 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:09:21.370389 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:09:21.370389 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 26 13:09:21.370389 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 26 13:09:21.370389 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 26 13:09:21.370389 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 26 13:09:21.370389 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 26 13:09:21.370389 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:21.370389 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:09:21.370389 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:21.370389 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:21.370389 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:09:21.370389 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:09:21.370389 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:09:21.370389 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:09:21.370389 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 26 13:09:21.370389 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:21.370389 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-684135b6-e2ba-4c82-8eed-e0a804ac67b2 tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:09:21.370389 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-684135b6-e2ba-4c82-8eed-e0a804ac67b2 tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.136884 Oct 26 13:09:21.378243 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 974/1863] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 13:09:21 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 145 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 26 13:09:21.391419 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-76ac1c9f-1da1-46b3-974f-ce9fa98c6364 tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] Calling method '.version_select at 0x7f67368c6550>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:21.427148 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-76ac1c9f-1da1-46b3-974f-ce9fa98c6364 tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1186854667 not found for user 28711a1a9e5a489e915a2bb89caa6de0 Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-76ac1c9f-1da1-46b3-974f-ce9fa98c6364 tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] Request method failure captured: Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1186854667 HTTP/1.1 Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTF9X5ushdX1JUPgITSPZBjR5Dnsb02rM2oijJrOUOtkmL_VymjhrKyFKyfbNy3Bw5etaRX6G1ayRuTJDNS-DjqHY43hvLjeg7lBfaNgGmBoO6eWbkkq-oylkzPqBiCWEY7__ZAYTz3XKExq6U-x-eGwlclCaJViW1vcWvvIphljREQ Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: bdfc2ab0d8ab4fe8b41587a87d620c1c Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1236876776 Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bdfc2ab0d8ab4fe8b41587a87d620c1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bdfc2ab0d8ab4fe8b41587a87d620c1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bdfc2ab0d8ab4fe8b41587a87d620c1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bdfc2ab0d8ab4fe8b41587a87d620c1c"}]}] Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1236876776 Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: bdfc2ab0d8ab4fe8b41587a87d620c1c Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1236876776 Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-KeyPairsNegativeTestJSON-1236876776-project Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 28711a1a9e5a489e915a2bb89caa6de0 Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1236876776-project Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: exception: Keypair tempest-keypair-non-existent-1186854667 not found for user 28711a1a9e5a489e915a2bb89caa6de0 Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'tempest-keypair-non-existent-1186854667'} Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1186854667 not found for user 28711a1a9e5a489e915a2bb89caa6de0 Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:21.431809 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:09:21.436687 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:21.436687 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:21.436687 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:09:21.436687 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:09:21.436687 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:09:21.436687 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:09:21.436687 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:09:21.436687 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:09:21.436687 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 26 13:09:21.436687 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:09:21.436687 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:09:21.436687 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:09:21.436687 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 26 13:09:21.436687 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 26 13:09:21.436687 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 26 13:09:21.436687 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 26 13:09:21.436687 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1186854667 not found for user 28711a1a9e5a489e915a2bb89caa6de0 Oct 26 13:09:21.436687 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:21.436687 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:09:21.436687 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:21.436687 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:21.436687 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:09:21.436687 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:09:21.436687 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:09:21.436687 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:09:21.436687 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1186854667 not found for user 28711a1a9e5a489e915a2bb89caa6de0 Oct 26 13:09:21.436687 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:21.436687 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-76ac1c9f-1da1-46b3-974f-ce9fa98c6364 tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1186854667 not found for user 28711a1a9e5a489e915a2bb89caa6de0 {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:09:21.436687 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-76ac1c9f-1da1-46b3-974f-ce9fa98c6364 tempest-KeyPairsNegativeTestJSON-1236876776 tempest-KeyPairsNegativeTestJSON-1236876776-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1186854667" status: 404 len: 145 microversion: 2.1 time: 0.057357 Oct 26 13:09:21.442519 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 975/1864] 10.222.0.40 () {58 vars in 1260 bytes} [Wed Oct 26 13:09:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1186854667 => generated 145 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:09:21.890594 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fe5a10d8-7225-4b96-91d1-b2899171f531 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4c9b05864d4d448b1c722659a3bc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2336994846d345aa86b5fd940d1b004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:21.907970 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fe5a10d8-7225-4b96-91d1-b2899171f531 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4" status: 200 len: 1366 microversion: 2.1 time: 0.696766 Oct 26 13:09:21.925244 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 890/1865] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:21 2022] GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4 => generated 1366 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:22.095744 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-176dffc1-07d5-4946-b817-f4bfb96c7b3a tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:22.099426 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-176dffc1-07d5-4946-b817-f4bfb96c7b3a tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] [instance: bbb44881-d590-4635-8c38-f107f70eaaa3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:22.139892 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-176dffc1-07d5-4946-b817-f4bfb96c7b3a tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:22.140915 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-176dffc1-07d5-4946-b817-f4bfb96c7b3a tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:22.141957 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-176dffc1-07d5-4946-b817-f4bfb96c7b3a tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:22.147697 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-176dffc1-07d5-4946-b817-f4bfb96c7b3a tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:22.148468 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-176dffc1-07d5-4946-b817-f4bfb96c7b3a tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:22.150116 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-176dffc1-07d5-4946-b817-f4bfb96c7b3a tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:22.193255 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-364129a8-39fe-44c3-9c7d-b09733b4bc03 req-a0b272ed-d49f-4a12-b545-30198c5e039c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14fcf77a-99ed-4d7b-889a-19da49d9e4b4", "tag": "daf7da51-0b0e-451f-8b3d-8f82f9a71263"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:22.228002 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-364129a8-39fe-44c3-9c7d-b09733b4bc03 req-a0b272ed-d49f-4a12-b545-30198c5e039c service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:22.233954 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-364129a8-39fe-44c3-9c7d-b09733b4bc03 req-a0b272ed-d49f-4a12-b545-30198c5e039c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:22.234596 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-364129a8-39fe-44c3-9c7d-b09733b4bc03 req-a0b272ed-d49f-4a12-b545-30198c5e039c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:22.269626 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-364129a8-39fe-44c3-9c7d-b09733b4bc03 req-a0b272ed-d49f-4a12-b545-30198c5e039c service nova] Creating event network-changed:daf7da51-0b0e-451f-8b3d-8f82f9a71263 for instance 14fcf77a-99ed-4d7b-889a-19da49d9e4b4 on n-h1-862686-1 Oct 26 13:09:22.293209 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-364129a8-39fe-44c3-9c7d-b09733b4bc03 req-a0b272ed-d49f-4a12-b545-30198c5e039c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107051 Oct 26 13:09:22.297112 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 891/1866] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:22.308039 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f66f9254-1aec-43af-ab53-8fcc8018dd10 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:22.314375 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f66f9254-1aec-43af-ab53-8fcc8018dd10 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:22.338360 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f66f9254-1aec-43af-ab53-8fcc8018dd10 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:22.339117 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f66f9254-1aec-43af-ab53-8fcc8018dd10 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:22.339742 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f66f9254-1aec-43af-ab53-8fcc8018dd10 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:22.340862 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f66f9254-1aec-43af-ab53-8fcc8018dd10 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:22.341670 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f66f9254-1aec-43af-ab53-8fcc8018dd10 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:22.342262 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f66f9254-1aec-43af-ab53-8fcc8018dd10 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:22.891916 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-176dffc1-07d5-4946-b817-f4bfb96c7b3a tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb3f2b0e3cc4326a1846f6755882dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f3d3f7efed04d7fb58147bc2ed55349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:22.907456 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-176dffc1-07d5-4946-b817-f4bfb96c7b3a tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb44881-d590-4635-8c38-f107f70eaaa3" status: 200 len: 1314 microversion: 2.1 time: 0.819659 Oct 26 13:09:22.908616 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 976/1867] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:22 2022] GET /compute/v2.1/servers/bbb44881-d590-4635-8c38-f107f70eaaa3 => generated 1314 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:22.921349 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6623b7ef-692d-47b5-a198-d61caee0dddf tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67369974c0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:22.997727 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6623b7ef-692d-47b5-a198-d61caee0dddf tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc" status: 200 len: 1439 microversion: 2.1 time: 0.087792 Oct 26 13:09:22.998624 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 977/1868] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:09:22 2022] GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc => generated 1439 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:23.003488 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-52dd1f86-dc29-4062-b998-769349e1ee89 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:23.009788 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-52dd1f86-dc29-4062-b998-769349e1ee89 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: 14fcf77a-99ed-4d7b-889a-19da49d9e4b4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:23.023323 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-52dd1f86-dc29-4062-b998-769349e1ee89 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:23.034292 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-52dd1f86-dc29-4062-b998-769349e1ee89 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:23.035061 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-52dd1f86-dc29-4062-b998-769349e1ee89 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:23.036025 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-52dd1f86-dc29-4062-b998-769349e1ee89 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:23.036859 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-52dd1f86-dc29-4062-b998-769349e1ee89 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:23.037502 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-52dd1f86-dc29-4062-b998-769349e1ee89 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:23.212501 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f66f9254-1aec-43af-ab53-8fcc8018dd10 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:23.227030 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f66f9254-1aec-43af-ab53-8fcc8018dd10 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:23.235229 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f66f9254-1aec-43af-ab53-8fcc8018dd10 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:23.236714 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f66f9254-1aec-43af-ab53-8fcc8018dd10 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 200 len: 1486 microversion: 2.25 time: 0.938040 Oct 26 13:09:23.237328 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 892/1869] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:09:22 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 1486 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:09:23.628369 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-52dd1f86-dc29-4062-b998-769349e1ee89 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4c9b05864d4d448b1c722659a3bc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2336994846d345aa86b5fd940d1b004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:23.640634 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-52dd1f86-dc29-4062-b998-769349e1ee89 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4" status: 200 len: 1366 microversion: 2.1 time: 0.640789 Oct 26 13:09:23.645758 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 978/1870] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:22 2022] GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4 => generated 1366 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:23.932245 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-05243c5c-4eea-47c5-b5c0-33c55c2a563c tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:23.932950 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-05243c5c-4eea-47c5-b5c0-33c55c2a563c tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] [instance: bbb44881-d590-4635-8c38-f107f70eaaa3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:23.942878 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05243c5c-4eea-47c5-b5c0-33c55c2a563c tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:23.952853 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05243c5c-4eea-47c5-b5c0-33c55c2a563c tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:23.955010 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05243c5c-4eea-47c5-b5c0-33c55c2a563c tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:23.957088 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05243c5c-4eea-47c5-b5c0-33c55c2a563c tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:23.959270 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05243c5c-4eea-47c5-b5c0-33c55c2a563c tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:23.961545 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05243c5c-4eea-47c5-b5c0-33c55c2a563c tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:24.016978 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-42443f85-c931-41bf-97a9-adbfc520dc9c tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67369e7700>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:24.100249 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-42443f85-c931-41bf-97a9-adbfc520dc9c tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc" status: 200 len: 1439 microversion: 2.1 time: 0.086954 Oct 26 13:09:24.112008 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 979/1871] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:09:24 2022] GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc => generated 1439 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:24.278086 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-35ba9ad0-4896-4319-b375-e292ae7702eb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:24.278816 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-35ba9ad0-4896-4319-b375-e292ae7702eb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:24.301726 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-35ba9ad0-4896-4319-b375-e292ae7702eb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:24.311954 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-35ba9ad0-4896-4319-b375-e292ae7702eb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:24.312648 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-35ba9ad0-4896-4319-b375-e292ae7702eb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:24.313714 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-35ba9ad0-4896-4319-b375-e292ae7702eb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:24.314441 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-35ba9ad0-4896-4319-b375-e292ae7702eb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:24.315046 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-35ba9ad0-4896-4319-b375-e292ae7702eb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:24.700105 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-05243c5c-4eea-47c5-b5c0-33c55c2a563c tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb3f2b0e3cc4326a1846f6755882dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f3d3f7efed04d7fb58147bc2ed55349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:24.714980 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-05243c5c-4eea-47c5-b5c0-33c55c2a563c tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb44881-d590-4635-8c38-f107f70eaaa3" status: 200 len: 1314 microversion: 2.1 time: 0.787383 Oct 26 13:09:24.715572 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 893/1872] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:23 2022] GET /compute/v2.1/servers/bbb44881-d590-4635-8c38-f107f70eaaa3 => generated 1314 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:24.728605 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d8d68f17-d032-4a74-a406-8666c2252f5a tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:24.729638 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d8d68f17-d032-4a74-a406-8666c2252f5a tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: 14fcf77a-99ed-4d7b-889a-19da49d9e4b4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:24.736176 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8d68f17-d032-4a74-a406-8666c2252f5a tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:24.737933 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8d68f17-d032-4a74-a406-8666c2252f5a tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:24.738555 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8d68f17-d032-4a74-a406-8666c2252f5a tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:24.741450 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8d68f17-d032-4a74-a406-8666c2252f5a tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:24.742145 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8d68f17-d032-4a74-a406-8666c2252f5a tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:24.745006 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8d68f17-d032-4a74-a406-8666c2252f5a tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:25.468557 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-35ba9ad0-4896-4319-b375-e292ae7702eb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:25.485301 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-35ba9ad0-4896-4319-b375-e292ae7702eb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:25.498916 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-35ba9ad0-4896-4319-b375-e292ae7702eb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:25.507623 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-35ba9ad0-4896-4319-b375-e292ae7702eb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 200 len: 1486 microversion: 2.25 time: 1.228218 Oct 26 13:09:25.512997 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 980/1873] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:09:24 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 1486 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:09:25.535173 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3fb8bb2c-d936-4ea4-ac6e-4f05f8d4c977 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67368c6ca0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:25.634377 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d8d68f17-d032-4a74-a406-8666c2252f5a tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4c9b05864d4d448b1c722659a3bc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2336994846d345aa86b5fd940d1b004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:25.651544 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d8d68f17-d032-4a74-a406-8666c2252f5a tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4" status: 200 len: 1366 microversion: 2.1 time: 0.934637 Oct 26 13:09:25.652143 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 894/1874] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:24 2022] GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4 => generated 1366 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:25.675595 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3fb8bb2c-d936-4ea4-ac6e-4f05f8d4c977 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc" status: 200 len: 1439 microversion: 2.1 time: 0.158280 Oct 26 13:09:25.676223 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 981/1875] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:09:25 2022] GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc => generated 1439 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:25.692393 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-c9dd9073-159f-4978-bcb2-9ab358a6d43e req-293fbfec-eac7-4eaf-97dd-3028bce911ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb44881-d590-4635-8c38-f107f70eaaa3", "name": "network-vif-plugged", "status": "completed", "tag": "96678790-23ae-4f84-9bcd-70cbbff81b16"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:25.725406 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-c9dd9073-159f-4978-bcb2-9ab358a6d43e req-293fbfec-eac7-4eaf-97dd-3028bce911ce service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:25.726088 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-c9dd9073-159f-4978-bcb2-9ab358a6d43e req-293fbfec-eac7-4eaf-97dd-3028bce911ce service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:25.726327 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-c9dd9073-159f-4978-bcb2-9ab358a6d43e req-293fbfec-eac7-4eaf-97dd-3028bce911ce service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:25.741433 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2ee04eb4-9858-45a0-a18c-8b0612886d3f tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:25.742280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2ee04eb4-9858-45a0-a18c-8b0612886d3f tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] [instance: bbb44881-d590-4635-8c38-f107f70eaaa3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:25.756562 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ee04eb4-9858-45a0-a18c-8b0612886d3f tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:25.756939 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ee04eb4-9858-45a0-a18c-8b0612886d3f tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:25.757390 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ee04eb4-9858-45a0-a18c-8b0612886d3f tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:25.758137 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ee04eb4-9858-45a0-a18c-8b0612886d3f tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:25.758593 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ee04eb4-9858-45a0-a18c-8b0612886d3f tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:25.771759 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ee04eb4-9858-45a0-a18c-8b0612886d3f tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:25.813691 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-c9dd9073-159f-4978-bcb2-9ab358a6d43e req-293fbfec-eac7-4eaf-97dd-3028bce911ce service nova] Creating event network-vif-plugged:96678790-23ae-4f84-9bcd-70cbbff81b16 for instance bbb44881-d590-4635-8c38-f107f70eaaa3 on n-h2-862686-1 Oct 26 13:09:25.829920 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-c9dd9073-159f-4978-bcb2-9ab358a6d43e req-293fbfec-eac7-4eaf-97dd-3028bce911ce service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176518 Oct 26 13:09:25.855697 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 895/1876] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:26.442247 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3cf536ba-5e5f-48e9-a240-d3422d409484 tempest-AbsoluteLimitsNegativeTestJSON-646810423 tempest-AbsoluteLimitsNegativeTestJSON-646810423-project] Calling method '.version_select at 0x7f673213a550>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:26.457586 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3cf536ba-5e5f-48e9-a240-d3422d409484 tempest-AbsoluteLimitsNegativeTestJSON-646810423 tempest-AbsoluteLimitsNegativeTestJSON-646810423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:26.458404 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3cf536ba-5e5f-48e9-a240-d3422d409484 tempest-AbsoluteLimitsNegativeTestJSON-646810423 tempest-AbsoluteLimitsNegativeTestJSON-646810423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:26.459190 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3cf536ba-5e5f-48e9-a240-d3422d409484 tempest-AbsoluteLimitsNegativeTestJSON-646810423 tempest-AbsoluteLimitsNegativeTestJSON-646810423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:26.461246 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3cf536ba-5e5f-48e9-a240-d3422d409484 tempest-AbsoluteLimitsNegativeTestJSON-646810423 tempest-AbsoluteLimitsNegativeTestJSON-646810423-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:26.462013 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3cf536ba-5e5f-48e9-a240-d3422d409484 tempest-AbsoluteLimitsNegativeTestJSON-646810423 tempest-AbsoluteLimitsNegativeTestJSON-646810423-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:26.462529 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3cf536ba-5e5f-48e9-a240-d3422d409484 tempest-AbsoluteLimitsNegativeTestJSON-646810423 tempest-AbsoluteLimitsNegativeTestJSON-646810423-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:26.494032 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3cf536ba-5e5f-48e9-a240-d3422d409484 tempest-AbsoluteLimitsNegativeTestJSON-646810423 tempest-AbsoluteLimitsNegativeTestJSON-646810423-project] 10.222.0.40 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.259676 Oct 26 13:09:26.495456 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 896/1877] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Oct 26 13:09:26 2022] GET /compute/v2.1/limits => generated 511 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:09:26.534870 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1a6e569f-5ede-467c-9d15-75e0604f9766 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:26.536676 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1a6e569f-5ede-467c-9d15-75e0604f9766 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:26.547469 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a6e569f-5ede-467c-9d15-75e0604f9766 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:26.548336 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a6e569f-5ede-467c-9d15-75e0604f9766 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:26.550265 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a6e569f-5ede-467c-9d15-75e0604f9766 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:26.555844 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a6e569f-5ede-467c-9d15-75e0604f9766 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:26.556803 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a6e569f-5ede-467c-9d15-75e0604f9766 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:26.557513 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a6e569f-5ede-467c-9d15-75e0604f9766 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:26.684390 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2ee04eb4-9858-45a0-a18c-8b0612886d3f tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb3f2b0e3cc4326a1846f6755882dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f3d3f7efed04d7fb58147bc2ed55349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:26.698779 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2ee04eb4-9858-45a0-a18c-8b0612886d3f tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb44881-d590-4635-8c38-f107f70eaaa3" status: 200 len: 1314 microversion: 2.1 time: 0.962404 Oct 26 13:09:26.702247 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 982/1878] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:25 2022] GET /compute/v2.1/servers/bbb44881-d590-4635-8c38-f107f70eaaa3 => generated 1314 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:09:26.712949 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-567b9068-24f1-4f77-bd34-10d330ee1876 tempest-AbsoluteLimitsNegativeTestJSON-646810423 tempest-AbsoluteLimitsNegativeTestJSON-646810423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-900249286", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:26.847356 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-567b9068-24f1-4f77-bd34-10d330ee1876 tempest-AbsoluteLimitsNegativeTestJSON-646810423 tempest-AbsoluteLimitsNegativeTestJSON-646810423-project] validate_networks() for None {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:09:27.828545 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1a6e569f-5ede-467c-9d15-75e0604f9766 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:27.847901 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1a6e569f-5ede-467c-9d15-75e0604f9766 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:27.855538 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1a6e569f-5ede-467c-9d15-75e0604f9766 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:27.856812 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1a6e569f-5ede-467c-9d15-75e0604f9766 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 200 len: 1486 microversion: 2.25 time: 1.326083 Oct 26 13:09:27.870852 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 897/1879] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:09:26 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 1486 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:09:27.876401 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-627cb25e-a039-4b38-a692-5a40bf465843 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:27.890984 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-627cb25e-a039-4b38-a692-5a40bf465843 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: 14fcf77a-99ed-4d7b-889a-19da49d9e4b4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:27.914744 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-627cb25e-a039-4b38-a692-5a40bf465843 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:27.915280 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-627cb25e-a039-4b38-a692-5a40bf465843 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:27.915920 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-627cb25e-a039-4b38-a692-5a40bf465843 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:27.917331 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-627cb25e-a039-4b38-a692-5a40bf465843 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:27.919163 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-627cb25e-a039-4b38-a692-5a40bf465843 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:27.921641 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-627cb25e-a039-4b38-a692-5a40bf465843 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:28.035055 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-567b9068-24f1-4f77-bd34-10d330ee1876 tempest-AbsoluteLimitsNegativeTestJSON-646810423 tempest-AbsoluteLimitsNegativeTestJSON-646810423-project] Getting quotas for project f52d7c2b7df34ad4b65b3346cfd4536e. Resources: dict_keys(['metadata_items']) {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:09:28.080000 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-567b9068-24f1-4f77-bd34-10d330ee1876 tempest-AbsoluteLimitsNegativeTestJSON-646810423 tempest-AbsoluteLimitsNegativeTestJSON-646810423-project] Getting quotas for user ed8c9508398747e794859854c45ba58c and project f52d7c2b7df34ad4b65b3346cfd4536e. Resources: dict_keys(['metadata_items']) {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:09:28.118189 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-567b9068-24f1-4f77-bd34-10d330ee1876 tempest-AbsoluteLimitsNegativeTestJSON-646810423 tempest-AbsoluteLimitsNegativeTestJSON-646810423-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 26 13:09:28.122769 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-567b9068-24f1-4f77-bd34-10d330ee1876 tempest-AbsoluteLimitsNegativeTestJSON-646810423 tempest-AbsoluteLimitsNegativeTestJSON-646810423-project] Request method failure captured: Oct 26 13:09:28.122769 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 13:09:28.122769 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:09:28.122769 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:09:28.122769 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:09:28.122769 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 1751 Oct 26 13:09:28.122769 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:09:28.122769 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:09:28.122769 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:09:28.122769 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:09:28.122769 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTGG-jRRmUHG39wbFKhGkoczRMYkqwIswHBsbCWcThCurkVc4_RNPxBIMZTpnqiqq5tXqArlvCIcrsQxfpHlcTNvhDUF7YaEXCa835yQ8rhEUcCBGVGTH3o__nA2RQvu0O2wLkPcL5Xp9RT_JIGprQ0hClK72qVcTbdpKuy5JwfuyIQ Oct 26 13:09:28.122769 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:09:28.122769 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:09:28.122769 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:09:28.122769 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:09:28.122769 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:09:28.122769 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:09:28.122769 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: f52d7c2b7df34ad4b65b3346cfd4536e Oct 26 13:09:28.122769 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-646810423 Oct 26 13:09:28.122769 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:09:28.122769 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:09:28.122769 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f52d7c2b7df34ad4b65b3346cfd4536e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f52d7c2b7df34ad4b65b3346cfd4536e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f52d7c2b7df34ad4b65b3346cfd4536e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f52d7c2b7df34ad4b65b3346cfd4536e"}]}] Oct 26 13:09:28.122769 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-646810423 Oct 26 13:09:28.122769 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: f52d7c2b7df34ad4b65b3346cfd4536e Oct 26 13:09:28.122769 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-646810423 Oct 26 13:09:28.122769 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-646810423-project Oct 26 13:09:28.122769 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:09:28.122769 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:09:28.122769 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: ed8c9508398747e794859854c45ba58c Oct 26 13:09:28.122769 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-646810423-project Oct 26 13:09:28.122769 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:09:28.122769 n-d-862686-1 devstack@n-api.service[120598]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-900249286", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 26 13:09:28.122769 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:09:28.122769 n-d-862686-1 devstack@n-api.service[120598]: exception: Maximum number of metadata items exceeds 128 Oct 26 13:09:28.125951 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-900249286', 'imageRef': '762c20f4-0f9b-45cb-bd95-cf21a747b33b', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 26 13:09:28.125951 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:09:28.125951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:28.125951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 26 13:09:28.125951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 26 13:09:28.125951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 13:09:28.125951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 13:09:28.125951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 26 13:09:28.125951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 26 13:09:28.125951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 26 13:09:28.125951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 26 13:09:28.125951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 26 13:09:28.125951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 26 13:09:28.125951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 26 13:09:28.125951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:28.125951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:09:28.125951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:28.125951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:28.125951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 26 13:09:28.125951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 26 13:09:28.125951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 26 13:09:28.125951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 26 13:09:28.125951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 26 13:09:28.125951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 26 13:09:28.125951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 26 13:09:28.125951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 26 13:09:28.125951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 26 13:09:28.125951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 26 13:09:28.125951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 26 13:09:28.125951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:28.125951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:09:28.125951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:28.125951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:28.125951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:09:28.125951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:09:28.125951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:09:28.125951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:09:28.125951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:09:28.125951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:09:28.125951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:09:28.125951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:09:28.125951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:09:28.125951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:09:28.125951 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:09:28.129454 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:09:28.129454 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 26 13:09:28.129454 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 26 13:09:28.129454 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 26 13:09:28.129454 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 26 13:09:28.129454 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:28.129454 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:09:28.129454 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:28.129454 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:28.129454 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:09:28.129454 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:09:28.129454 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:09:28.129454 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:09:28.129454 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 26 13:09:28.129454 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:28.129454 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-567b9068-24f1-4f77-bd34-10d330ee1876 tempest-AbsoluteLimitsNegativeTestJSON-646810423 tempest-AbsoluteLimitsNegativeTestJSON-646810423-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:09:28.129454 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-567b9068-24f1-4f77-bd34-10d330ee1876 tempest-AbsoluteLimitsNegativeTestJSON-646810423 tempest-AbsoluteLimitsNegativeTestJSON-646810423-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.424276 Oct 26 13:09:28.133405 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 983/1880] 10.222.0.40 () {60 vars in 1148 bytes} [Wed Oct 26 13:09:26 2022] POST /compute/v2.1/servers => generated 87 bytes in 1428 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:09:28.144488 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e44e780e-b77c-474c-b822-1518d890fa7f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67368e19d0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:28.271595 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e44e780e-b77c-474c-b822-1518d890fa7f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc" status: 200 len: 1439 microversion: 2.1 time: 0.135678 Oct 26 13:09:28.278436 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 984/1881] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:09:28 2022] GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc => generated 1439 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:28.289021 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-589c8092-bf58-4014-9ca7-44cea0e9a0ad tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:28.290960 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-589c8092-bf58-4014-9ca7-44cea0e9a0ad tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] [instance: bbb44881-d590-4635-8c38-f107f70eaaa3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:28.306098 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-589c8092-bf58-4014-9ca7-44cea0e9a0ad tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:28.307661 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-589c8092-bf58-4014-9ca7-44cea0e9a0ad tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:28.308458 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-589c8092-bf58-4014-9ca7-44cea0e9a0ad tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:28.311522 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-589c8092-bf58-4014-9ca7-44cea0e9a0ad tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:28.312904 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-589c8092-bf58-4014-9ca7-44cea0e9a0ad tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:28.315123 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-589c8092-bf58-4014-9ca7-44cea0e9a0ad tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:28.798117 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-627cb25e-a039-4b38-a692-5a40bf465843 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4c9b05864d4d448b1c722659a3bc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2336994846d345aa86b5fd940d1b004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:28.813457 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-627cb25e-a039-4b38-a692-5a40bf465843 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4" status: 200 len: 1366 microversion: 2.1 time: 0.938941 Oct 26 13:09:28.815041 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 898/1882] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:27 2022] GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4 => generated 1366 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:28.886686 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0020ce3f-33ba-4c06-bb62-bdeb143089af tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:28.887988 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0020ce3f-33ba-4c06-bb62-bdeb143089af tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:28.897328 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0020ce3f-33ba-4c06-bb62-bdeb143089af tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:28.902531 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-589c8092-bf58-4014-9ca7-44cea0e9a0ad tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb3f2b0e3cc4326a1846f6755882dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f3d3f7efed04d7fb58147bc2ed55349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:28.913101 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0020ce3f-33ba-4c06-bb62-bdeb143089af tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:28.922207 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0020ce3f-33ba-4c06-bb62-bdeb143089af tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:28.923270 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0020ce3f-33ba-4c06-bb62-bdeb143089af tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:28.923958 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0020ce3f-33ba-4c06-bb62-bdeb143089af tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:28.925549 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-589c8092-bf58-4014-9ca7-44cea0e9a0ad tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb44881-d590-4635-8c38-f107f70eaaa3" status: 200 len: 1463 microversion: 2.1 time: 0.632913 Oct 26 13:09:28.927010 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0020ce3f-33ba-4c06-bb62-bdeb143089af tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:28.928341 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 985/1883] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:28 2022] GET /compute/v2.1/servers/bbb44881-d590-4635-8c38-f107f70eaaa3 => generated 1463 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:29.377841 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7fd2ab8d-51f1-4c71-a8a1-39e0c9506135 tempest-TenantUsagesTestJSON-1971608858 tempest-TenantUsagesTestJSON-1971608858-project-admin] Calling method '.version_select at 0x7f67368ed5e0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:29.399838 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7fd2ab8d-51f1-4c71-a8a1-39e0c9506135 tempest-TenantUsagesTestJSON-1971608858 tempest-TenantUsagesTestJSON-1971608858-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:29.400995 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7fd2ab8d-51f1-4c71-a8a1-39e0c9506135 tempest-TenantUsagesTestJSON-1971608858 tempest-TenantUsagesTestJSON-1971608858-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:29.402742 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7fd2ab8d-51f1-4c71-a8a1-39e0c9506135 tempest-TenantUsagesTestJSON-1971608858 tempest-TenantUsagesTestJSON-1971608858-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:29.456815 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7fd2ab8d-51f1-4c71-a8a1-39e0c9506135 tempest-TenantUsagesTestJSON-1971608858 tempest-TenantUsagesTestJSON-1971608858-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:29.457060 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7fd2ab8d-51f1-4c71-a8a1-39e0c9506135 tempest-TenantUsagesTestJSON-1971608858 tempest-TenantUsagesTestJSON-1971608858-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:29.458138 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7fd2ab8d-51f1-4c71-a8a1-39e0c9506135 tempest-TenantUsagesTestJSON-1971608858 tempest-TenantUsagesTestJSON-1971608858-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:29.504214 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7fd2ab8d-51f1-4c71-a8a1-39e0c9506135 tempest-TenantUsagesTestJSON-1971608858 tempest-TenantUsagesTestJSON-1971608858-project-admin] 10.222.0.40 "GET /compute/v2.1/os-simple-tenant-usage/6f3d3f7efed04d7fb58147bc2ed55349?start=2022-10-25T13%3A09%3A28.943749&end=2022-10-27T13%3A09%3A28.943749" status: 200 len: 695 microversion: 2.1 time: 0.549228 Oct 26 13:09:29.510574 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 986/1884] 10.222.0.40 () {58 vars in 1412 bytes} [Wed Oct 26 13:09:28 2022] GET /compute/v2.1/os-simple-tenant-usage/6f3d3f7efed04d7fb58147bc2ed55349?start=2022-10-25T13%3A09%3A28.943749&end=2022-10-27T13%3A09%3A28.943749 => generated 695 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:09:29.525898 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c045aea6-7ea8-4846-9f64-e53f9d083f88 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67368eda60>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:29.635425 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c045aea6-7ea8-4846-9f64-e53f9d083f88 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc" status: 200 len: 1439 microversion: 2.1 time: 0.117608 Oct 26 13:09:29.636246 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 987/1885] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:09:29 2022] GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc => generated 1439 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:29.659829 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-de63baab-c74d-43eb-8b65-e0511330e85f tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Calling method '.version_select at 0x7f67368c8790>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:29.704010 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de63baab-c74d-43eb-8b65-e0511330e85f tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:29.708041 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de63baab-c74d-43eb-8b65-e0511330e85f tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:29.714257 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de63baab-c74d-43eb-8b65-e0511330e85f tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:29.736415 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de63baab-c74d-43eb-8b65-e0511330e85f tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:29.737167 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de63baab-c74d-43eb-8b65-e0511330e85f tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:29.738089 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de63baab-c74d-43eb-8b65-e0511330e85f tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:29.756857 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-de63baab-c74d-43eb-8b65-e0511330e85f tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] 10.222.0.40 "GET /compute/v2.1/os-simple-tenant-usage/6f3d3f7efed04d7fb58147bc2ed55349?start=2022-10-25T13%3A09%3A28.943749&end=2022-10-27T13%3A09%3A28.943749" status: 200 len: 695 microversion: 2.1 time: 0.117931 Oct 26 13:09:29.758204 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 988/1886] 10.222.0.40 () {58 vars in 1412 bytes} [Wed Oct 26 13:09:29 2022] GET /compute/v2.1/os-simple-tenant-usage/6f3d3f7efed04d7fb58147bc2ed55349?start=2022-10-25T13%3A09%3A28.943749&end=2022-10-27T13%3A09%3A28.943749 => generated 695 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:29.775472 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-10821a44-fd74-4468-87cc-b3db849d12cf tempest-TenantUsagesTestJSON-1971608858 tempest-TenantUsagesTestJSON-1971608858-project-admin] Calling method '.version_select at 0x7f67368f0280>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:29.785560 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10821a44-fd74-4468-87cc-b3db849d12cf tempest-TenantUsagesTestJSON-1971608858 tempest-TenantUsagesTestJSON-1971608858-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:29.787027 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10821a44-fd74-4468-87cc-b3db849d12cf tempest-TenantUsagesTestJSON-1971608858 tempest-TenantUsagesTestJSON-1971608858-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:29.787640 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10821a44-fd74-4468-87cc-b3db849d12cf tempest-TenantUsagesTestJSON-1971608858 tempest-TenantUsagesTestJSON-1971608858-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:29.805675 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0020ce3f-33ba-4c06-bb62-bdeb143089af tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:29.821772 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10821a44-fd74-4468-87cc-b3db849d12cf tempest-TenantUsagesTestJSON-1971608858 tempest-TenantUsagesTestJSON-1971608858-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:29.822552 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10821a44-fd74-4468-87cc-b3db849d12cf tempest-TenantUsagesTestJSON-1971608858 tempest-TenantUsagesTestJSON-1971608858-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:29.823466 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10821a44-fd74-4468-87cc-b3db849d12cf tempest-TenantUsagesTestJSON-1971608858 tempest-TenantUsagesTestJSON-1971608858-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:29.834444 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0020ce3f-33ba-4c06-bb62-bdeb143089af tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:29.839668 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0020ce3f-33ba-4c06-bb62-bdeb143089af tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:29.840893 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0020ce3f-33ba-4c06-bb62-bdeb143089af tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 200 len: 1486 microversion: 2.25 time: 0.960422 Oct 26 13:09:29.846172 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 899/1887] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:09:28 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 1486 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:09:29.852919 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-31f0fbad-c653-4904-875c-e84bd6a99c77 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:29.854011 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-31f0fbad-c653-4904-875c-e84bd6a99c77 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: 14fcf77a-99ed-4d7b-889a-19da49d9e4b4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:29.877106 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31f0fbad-c653-4904-875c-e84bd6a99c77 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:29.879601 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31f0fbad-c653-4904-875c-e84bd6a99c77 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:29.880786 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31f0fbad-c653-4904-875c-e84bd6a99c77 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:29.882596 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31f0fbad-c653-4904-875c-e84bd6a99c77 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:29.885209 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31f0fbad-c653-4904-875c-e84bd6a99c77 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:29.885968 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31f0fbad-c653-4904-875c-e84bd6a99c77 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:29.955735 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-10821a44-fd74-4468-87cc-b3db849d12cf tempest-TenantUsagesTestJSON-1971608858 tempest-TenantUsagesTestJSON-1971608858-project-admin] 10.222.0.40 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-25T13%3A09%3A28.943749&end=2022-10-27T13%3A09%3A28.943749&detailed=1" status: 200 len: 21953 microversion: 2.1 time: 0.183784 Oct 26 13:09:29.956978 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 989/1888] 10.222.0.40 () {58 vars in 1335 bytes} [Wed Oct 26 13:09:29 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-25T13%3A09%3A28.943749&end=2022-10-27T13%3A09%3A28.943749&detailed=1 => generated 21953 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:09:29.995715 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-927ff31b-432b-4740-a108-ee17f4bd0a1d tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:29.996337 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-927ff31b-432b-4740-a108-ee17f4bd0a1d tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] [instance: bbb44881-d590-4635-8c38-f107f70eaaa3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:30.013283 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-927ff31b-432b-4740-a108-ee17f4bd0a1d tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:30.013826 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-927ff31b-432b-4740-a108-ee17f4bd0a1d tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:30.014270 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-927ff31b-432b-4740-a108-ee17f4bd0a1d tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:30.014989 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-927ff31b-432b-4740-a108-ee17f4bd0a1d tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:30.015441 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-927ff31b-432b-4740-a108-ee17f4bd0a1d tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:30.015864 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-927ff31b-432b-4740-a108-ee17f4bd0a1d tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:30.086394 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-927ff31b-432b-4740-a108-ee17f4bd0a1d tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] [instance: bbb44881-d590-4635-8c38-f107f70eaaa3] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:09:30.231689 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-927ff31b-432b-4740-a108-ee17f4bd0a1d tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] 10.222.0.40 "DELETE /compute/v2.1/servers/bbb44881-d590-4635-8c38-f107f70eaaa3" status: 204 len: 0 microversion: 2.1 time: 0.239854 Oct 26 13:09:30.236000 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 990/1889] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:09:29 2022] DELETE /compute/v2.1/servers/bbb44881-d590-4635-8c38-f107f70eaaa3 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:09:30.243847 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-03aba4e8-b8c3-4aa1-a818-d76383760db0 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:30.245249 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-03aba4e8-b8c3-4aa1-a818-d76383760db0 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] [instance: bbb44881-d590-4635-8c38-f107f70eaaa3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:30.252776 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03aba4e8-b8c3-4aa1-a818-d76383760db0 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:30.253322 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03aba4e8-b8c3-4aa1-a818-d76383760db0 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:30.253805 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03aba4e8-b8c3-4aa1-a818-d76383760db0 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:30.255162 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03aba4e8-b8c3-4aa1-a818-d76383760db0 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:30.255879 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03aba4e8-b8c3-4aa1-a818-d76383760db0 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:30.256058 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03aba4e8-b8c3-4aa1-a818-d76383760db0 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:30.757538 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-03aba4e8-b8c3-4aa1-a818-d76383760db0 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb3f2b0e3cc4326a1846f6755882dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f3d3f7efed04d7fb58147bc2ed55349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:30.770445 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-03aba4e8-b8c3-4aa1-a818-d76383760db0 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb44881-d590-4635-8c38-f107f70eaaa3" status: 200 len: 1469 microversion: 2.1 time: 0.532741 Oct 26 13:09:30.771182 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 991/1890] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:30 2022] GET /compute/v2.1/servers/bbb44881-d590-4635-8c38-f107f70eaaa3 => generated 1469 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:30.784428 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9f28f0cd-d249-4924-9ea1-5843b4dbdb79 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f6736997160>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:30.787877 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-31f0fbad-c653-4904-875c-e84bd6a99c77 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4c9b05864d4d448b1c722659a3bc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2336994846d345aa86b5fd940d1b004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:30.805308 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-31f0fbad-c653-4904-875c-e84bd6a99c77 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4" status: 200 len: 1366 microversion: 2.1 time: 0.956714 Oct 26 13:09:30.806163 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 900/1891] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:29 2022] GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4 => generated 1366 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:30.872992 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-71ab1932-743f-4752-a655-c01f19b2ae8d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:30.873655 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-71ab1932-743f-4752-a655-c01f19b2ae8d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:30.887688 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9f28f0cd-d249-4924-9ea1-5843b4dbdb79 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc" status: 200 len: 1439 microversion: 2.1 time: 0.115544 Oct 26 13:09:30.888485 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 992/1892] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:09:30 2022] GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc => generated 1439 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:30.892186 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71ab1932-743f-4752-a655-c01f19b2ae8d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:30.892708 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71ab1932-743f-4752-a655-c01f19b2ae8d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:30.893411 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71ab1932-743f-4752-a655-c01f19b2ae8d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:30.894180 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71ab1932-743f-4752-a655-c01f19b2ae8d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:30.894641 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71ab1932-743f-4752-a655-c01f19b2ae8d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:30.895939 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71ab1932-743f-4752-a655-c01f19b2ae8d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:31.289254 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-71ab1932-743f-4752-a655-c01f19b2ae8d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:31.310108 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-71ab1932-743f-4752-a655-c01f19b2ae8d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:31.315842 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-71ab1932-743f-4752-a655-c01f19b2ae8d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:31.319640 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-71ab1932-743f-4752-a655-c01f19b2ae8d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 200 len: 1476 microversion: 2.25 time: 0.451246 Oct 26 13:09:31.320235 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 901/1893] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:09:30 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 1476 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:09:31.353658 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e1fcb483-53d1-4279-a82a-8045419640fe tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Calling method '.version_select at 0x7f673213a8b0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:31.369844 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1fcb483-53d1-4279-a82a-8045419640fe tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:31.373861 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1fcb483-53d1-4279-a82a-8045419640fe tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:31.374326 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1fcb483-53d1-4279-a82a-8045419640fe tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:31.403881 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b35c148c-7bb9-495f-bc6e-369846971aa1 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Action: 'create', calling method: .version_select at 0x7f6736922310>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1950158494", "policies": ["affinity"]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:31.405673 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e1fcb483-53d1-4279-a82a-8045419640fe tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 1937 microversion: 2.25 time: 0.056354 Oct 26 13:09:31.406569 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 902/1894] 10.222.0.40 () {60 vars in 1184 bytes} [Wed Oct 26 13:09:31 2022] GET /compute/v2.1/os-migrations => generated 1937 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:09:31.427143 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4bce55f1-1021-4273-b5e2-631c170a41ca tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:31.427763 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4bce55f1-1021-4273-b5e2-631c170a41ca tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:31.437565 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=57 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:09:31.441307 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-b35c148c-7bb9-495f-bc6e-369846971aa1 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Getting quotas for project 7a8dfdc9c02b4cac85a12b25ccf35afd. Resources: {'server_groups'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:09:31.449344 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-b35c148c-7bb9-495f-bc6e-369846971aa1 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Getting quotas for user d933dcf6e541498daeb97cffb8bb3714 and project 7a8dfdc9c02b4cac85a12b25ccf35afd. Resources: {'server_groups'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:09:31.453024 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4bce55f1-1021-4273-b5e2-631c170a41ca tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:31.453553 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4bce55f1-1021-4273-b5e2-631c170a41ca tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:31.462569 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4bce55f1-1021-4273-b5e2-631c170a41ca tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:31.465777 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4bce55f1-1021-4273-b5e2-631c170a41ca tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:31.468806 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4bce55f1-1021-4273-b5e2-631c170a41ca tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:31.473155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4bce55f1-1021-4273-b5e2-631c170a41ca tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:31.532460 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-b35c148c-7bb9-495f-bc6e-369846971aa1 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Getting quotas for project 7a8dfdc9c02b4cac85a12b25ccf35afd. Resources: {'server_groups'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:09:31.540611 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-b35c148c-7bb9-495f-bc6e-369846971aa1 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Getting quotas for user d933dcf6e541498daeb97cffb8bb3714 and project 7a8dfdc9c02b4cac85a12b25ccf35afd. Resources: {'server_groups'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:09:31.556284 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:09:31.558832 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b35c148c-7bb9-495f-bc6e-369846971aa1 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] 10.222.0.40 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.261701 Oct 26 13:09:31.560429 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 993/1895] 10.222.0.40 () {60 vars in 1174 bytes} [Wed Oct 26 13:09:31 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:31.573003 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4abb12c4-e73d-4f23-a1c7-b3149ecee0ca tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Action: 'create', calling method: .version_select at 0x7f67368c65e0>, body: {"server_group": {"name": "tempest-server-group-1758926633", "policies": ["affinity"]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:31.629161 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-4abb12c4-e73d-4f23-a1c7-b3149ecee0ca tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Getting quotas for project 7a8dfdc9c02b4cac85a12b25ccf35afd. Resources: {'server_groups'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:09:31.661520 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-4abb12c4-e73d-4f23-a1c7-b3149ecee0ca tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Getting quotas for user d933dcf6e541498daeb97cffb8bb3714 and project 7a8dfdc9c02b4cac85a12b25ccf35afd. Resources: {'server_groups'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:09:31.826914 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-4abb12c4-e73d-4f23-a1c7-b3149ecee0ca tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Getting quotas for project 7a8dfdc9c02b4cac85a12b25ccf35afd. Resources: {'server_groups'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:09:31.854051 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-4abb12c4-e73d-4f23-a1c7-b3149ecee0ca tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Getting quotas for user d933dcf6e541498daeb97cffb8bb3714 and project 7a8dfdc9c02b4cac85a12b25ccf35afd. Resources: {'server_groups'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:09:31.932402 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4abb12c4-e73d-4f23-a1c7-b3149ecee0ca tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] 10.222.0.40 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.364729 Oct 26 13:09:31.936474 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 994/1896] 10.222.0.40 () {60 vars in 1173 bytes} [Wed Oct 26 13:09:31 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:31.950696 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8ea136f5-6ac0-4905-bd80-24a372319782 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:31.951433 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8ea136f5-6ac0-4905-bd80-24a372319782 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] [instance: bbb44881-d590-4635-8c38-f107f70eaaa3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:31.958729 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8ea136f5-6ac0-4905-bd80-24a372319782 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:31.959388 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8ea136f5-6ac0-4905-bd80-24a372319782 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:31.960077 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8ea136f5-6ac0-4905-bd80-24a372319782 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:31.960902 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8ea136f5-6ac0-4905-bd80-24a372319782 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:31.962135 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8ea136f5-6ac0-4905-bd80-24a372319782 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:31.962676 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8ea136f5-6ac0-4905-bd80-24a372319782 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:32.017312 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:09:32.572930 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8ea136f5-6ac0-4905-bd80-24a372319782 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb3f2b0e3cc4326a1846f6755882dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f3d3f7efed04d7fb58147bc2ed55349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:32.611398 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8ea136f5-6ac0-4905-bd80-24a372319782 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb44881-d590-4635-8c38-f107f70eaaa3" status: 200 len: 1469 microversion: 2.1 time: 0.669498 Oct 26 13:09:32.614555 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 995/1897] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:31 2022] GET /compute/v2.1/servers/bbb44881-d590-4635-8c38-f107f70eaaa3 => generated 1469 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:32.653547 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8d79c710-00ac-4632-a0da-5c91586b5541 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:32.663186 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8d79c710-00ac-4632-a0da-5c91586b5541 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: 14fcf77a-99ed-4d7b-889a-19da49d9e4b4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:32.702510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d79c710-00ac-4632-a0da-5c91586b5541 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:32.709180 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d79c710-00ac-4632-a0da-5c91586b5541 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:32.714051 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d79c710-00ac-4632-a0da-5c91586b5541 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:32.720047 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d79c710-00ac-4632-a0da-5c91586b5541 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:32.721821 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d79c710-00ac-4632-a0da-5c91586b5541 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:32.722266 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d79c710-00ac-4632-a0da-5c91586b5541 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:33.188020 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-4bce55f1-1021-4273-b5e2-631c170a41ca tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] Lazy-loading 'services' on Instance uuid 3ce726c3-809c-4662-b794-dcec3f82047c {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:09:33.243216 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4bce55f1-1021-4273-b5e2-631c170a41ca tempest-LiveAutoBlockMigrationV225Test-689652143 tempest-LiveAutoBlockMigrationV225Test-689652143-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 200 len: 1969 microversion: 2.25 time: 1.819840 Oct 26 13:09:33.247452 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 903/1898] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:09:31 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 1969 bytes in 1825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:09:33.280967 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9c8144b1-d7a3-427a-b728-d6ed57267470 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f673213b820>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:33.386725 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9c8144b1-d7a3-427a-b728-d6ed57267470 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc" status: 200 len: 1439 microversion: 2.1 time: 0.123631 Oct 26 13:09:33.387464 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 904/1899] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:09:33 2022] GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc => generated 1439 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:33.398424 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d293cf90-723c-4f37-8aa6-8930741b88ea tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Action: 'create', calling method: .version_select at 0x7f67322104c0>, body: {"server_group": {"name": "tempest-server-group-1758926633", "policies": ["affinity"]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:33.477542 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-d293cf90-723c-4f37-8aa6-8930741b88ea tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Getting quotas for project 7a8dfdc9c02b4cac85a12b25ccf35afd. Resources: {'server_groups'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:09:33.519218 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-d293cf90-723c-4f37-8aa6-8930741b88ea tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Getting quotas for user d933dcf6e541498daeb97cffb8bb3714 and project 7a8dfdc9c02b4cac85a12b25ccf35afd. Resources: {'server_groups'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:09:33.634939 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=94,nova_api:DELETE=3,nova_api:INSERT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:09:33.651173 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-d293cf90-723c-4f37-8aa6-8930741b88ea tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Getting quotas for project 7a8dfdc9c02b4cac85a12b25ccf35afd. Resources: {'server_groups'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:09:33.657658 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-d293cf90-723c-4f37-8aa6-8930741b88ea tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Getting quotas for user d933dcf6e541498daeb97cffb8bb3714 and project 7a8dfdc9c02b4cac85a12b25ccf35afd. Resources: {'server_groups'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:09:33.686966 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d293cf90-723c-4f37-8aa6-8930741b88ea tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] 10.222.0.40 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.295882 Oct 26 13:09:33.696567 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 905/1900] 10.222.0.40 () {60 vars in 1173 bytes} [Wed Oct 26 13:09:33 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:33.717397 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8d79c710-00ac-4632-a0da-5c91586b5541 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4c9b05864d4d448b1c722659a3bc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2336994846d345aa86b5fd940d1b004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:33.718025 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-36e728a6-9fdc-4913-ae95-cfad0e70bd27 req-8dcecdcd-6495-4721-aac2-6f5fe284fa39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14fcf77a-99ed-4d7b-889a-19da49d9e4b4", "name": "network-vif-plugged", "status": "completed", "tag": "daf7da51-0b0e-451f-8b3d-8f82f9a71263"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:33.729225 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8d79c710-00ac-4632-a0da-5c91586b5541 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4" status: 200 len: 1366 microversion: 2.1 time: 1.109781 Oct 26 13:09:33.730594 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 996/1901] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:32 2022] GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4 => generated 1366 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:33.743510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9e7f948a-9d67-48f9-9115-0cf86fce2902 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:33.744488 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9e7f948a-9d67-48f9-9115-0cf86fce2902 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:33.751323 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-36e728a6-9fdc-4913-ae95-cfad0e70bd27 req-8dcecdcd-6495-4721-aac2-6f5fe284fa39 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:33.751808 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-36e728a6-9fdc-4913-ae95-cfad0e70bd27 req-8dcecdcd-6495-4721-aac2-6f5fe284fa39 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:33.752242 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-36e728a6-9fdc-4913-ae95-cfad0e70bd27 req-8dcecdcd-6495-4721-aac2-6f5fe284fa39 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:33.753988 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e7f948a-9d67-48f9-9115-0cf86fce2902 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:33.756301 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e7f948a-9d67-48f9-9115-0cf86fce2902 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:33.757134 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e7f948a-9d67-48f9-9115-0cf86fce2902 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:33.758212 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e7f948a-9d67-48f9-9115-0cf86fce2902 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:33.758903 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e7f948a-9d67-48f9-9115-0cf86fce2902 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:33.759579 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e7f948a-9d67-48f9-9115-0cf86fce2902 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:33.838727 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-36e728a6-9fdc-4913-ae95-cfad0e70bd27 req-8dcecdcd-6495-4721-aac2-6f5fe284fa39 service nova] Creating event network-vif-plugged:daf7da51-0b0e-451f-8b3d-8f82f9a71263 for instance 14fcf77a-99ed-4d7b-889a-19da49d9e4b4 on n-h1-862686-1 Oct 26 13:09:33.875414 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-36e728a6-9fdc-4913-ae95-cfad0e70bd27 req-8dcecdcd-6495-4721-aac2-6f5fe284fa39 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177351 Oct 26 13:09:33.881239 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 906/1902] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:33.895978 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-0f69a8dc-4a1e-4fb8-bf83-aa70a155a7fb req-7c18d7b0-67c0-4382-bc11-9bd9660325d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb44881-d590-4635-8c38-f107f70eaaa3", "name": "network-vif-deleted", "tag": "96678790-23ae-4f84-9bcd-70cbbff81b16"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:33.929738 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9e7f948a-9d67-48f9-9115-0cf86fce2902 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:09:33.932970 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-0f69a8dc-4a1e-4fb8-bf83-aa70a155a7fb req-7c18d7b0-67c0-4382-bc11-9bd9660325d1 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:33.933449 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-0f69a8dc-4a1e-4fb8-bf83-aa70a155a7fb req-7c18d7b0-67c0-4382-bc11-9bd9660325d1 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:33.933922 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-0f69a8dc-4a1e-4fb8-bf83-aa70a155a7fb req-7c18d7b0-67c0-4382-bc11-9bd9660325d1 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:33.965490 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-0f69a8dc-4a1e-4fb8-bf83-aa70a155a7fb req-7c18d7b0-67c0-4382-bc11-9bd9660325d1 service nova] Creating event network-vif-deleted:96678790-23ae-4f84-9bcd-70cbbff81b16 for instance bbb44881-d590-4635-8c38-f107f70eaaa3 on n-h2-862686-1 Oct 26 13:09:33.992565 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-0f69a8dc-4a1e-4fb8-bf83-aa70a155a7fb req-7c18d7b0-67c0-4382-bc11-9bd9660325d1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106272 Oct 26 13:09:33.999963 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 907/1903] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:34.005790 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2e2770d9-fc91-4914-9f6d-ecf6ffd5f344 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:34.016000 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2e2770d9-fc91-4914-9f6d-ecf6ffd5f344 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] [instance: bbb44881-d590-4635-8c38-f107f70eaaa3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:34.033022 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e2770d9-fc91-4914-9f6d-ecf6ffd5f344 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:34.033869 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e2770d9-fc91-4914-9f6d-ecf6ffd5f344 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:34.038307 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e2770d9-fc91-4914-9f6d-ecf6ffd5f344 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:34.039289 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e2770d9-fc91-4914-9f6d-ecf6ffd5f344 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:34.039760 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e2770d9-fc91-4914-9f6d-ecf6ffd5f344 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:34.040191 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e2770d9-fc91-4914-9f6d-ecf6ffd5f344 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:34.157354 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e2770d9-fc91-4914-9f6d-ecf6ffd5f344 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:34.173425 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e2770d9-fc91-4914-9f6d-ecf6ffd5f344 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:34.181244 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e2770d9-fc91-4914-9f6d-ecf6ffd5f344 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:34.188677 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-2e2770d9-fc91-4914-9f6d-ecf6ffd5f344 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lazy-loading 'fault' on Instance uuid bbb44881-d590-4635-8c38-f107f70eaaa3 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:09:34.224795 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9e7f948a-9d67-48f9-9115-0cf86fce2902 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 204 len: 0 microversion: 2.25 time: 0.487470 Oct 26 13:09:34.227682 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 997/1904] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 26 13:09:33 2022] DELETE /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 0 bytes in 496 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 13:09:34.252165 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7a0dd1d0-2725-45ca-8d8c-157aa4c8a18f tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:34.360469 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7a0dd1d0-2725-45ca-8d8c-157aa4c8a18f tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/7167619a-8b0c-4312-9157-4c0fb5812485" status: 204 len: 0 microversion: 2.1 time: 0.125824 Oct 26 13:09:34.361763 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 998/1905] 10.222.0.40 () {58 vars in 1266 bytes} [Wed Oct 26 13:09:34 2022] DELETE /compute/v2.1/os-server-groups/7167619a-8b0c-4312-9157-4c0fb5812485 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:09:34.369816 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-801e9b8b-99a5-43e8-a6a1-faf0b3e91257 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:34.370867 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-801e9b8b-99a5-43e8-a6a1-faf0b3e91257 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:34.381207 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-801e9b8b-99a5-43e8-a6a1-faf0b3e91257 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:34.382016 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-801e9b8b-99a5-43e8-a6a1-faf0b3e91257 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:34.383327 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-801e9b8b-99a5-43e8-a6a1-faf0b3e91257 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:34.385033 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-801e9b8b-99a5-43e8-a6a1-faf0b3e91257 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:34.386213 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-801e9b8b-99a5-43e8-a6a1-faf0b3e91257 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:34.386929 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-801e9b8b-99a5-43e8-a6a1-faf0b3e91257 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:34.726258 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-801e9b8b-99a5-43e8-a6a1-faf0b3e91257 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:34.729176 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2e2770d9-fc91-4914-9f6d-ecf6ffd5f344 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb3f2b0e3cc4326a1846f6755882dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f3d3f7efed04d7fb58147bc2ed55349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:34.737616 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-801e9b8b-99a5-43e8-a6a1-faf0b3e91257 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:34.740020 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-801e9b8b-99a5-43e8-a6a1-faf0b3e91257 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:34.744691 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-801e9b8b-99a5-43e8-a6a1-faf0b3e91257 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 200 len: 1482 microversion: 2.25 time: 0.380966 Oct 26 13:09:34.747859 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2e2770d9-fc91-4914-9f6d-ecf6ffd5f344 tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb44881-d590-4635-8c38-f107f70eaaa3" status: 200 len: 1304 microversion: 2.1 time: 0.735997 Oct 26 13:09:34.748598 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 999/1906] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:09:34 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 1482 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:09:34.759965 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-35807ddc-ff0e-4c4b-bf5a-0d44d70d5691 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:34.764302 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 908/1907] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:33 2022] GET /compute/v2.1/servers/bbb44881-d590-4635-8c38-f107f70eaaa3 => generated 1304 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:34.778076 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7c560a51-163a-4085-a5c2-9ad49c4efc15 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f6732210310>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:34.833636 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-35807ddc-ff0e-4c4b-bf5a-0d44d70d5691 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.080927 Oct 26 13:09:34.837555 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1000/1908] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 26 13:09:34 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:34.865099 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7c560a51-163a-4085-a5c2-9ad49c4efc15 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc" status: 200 len: 1439 microversion: 2.1 time: 0.099662 Oct 26 13:09:34.865326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bb6b1cc2-fbb8-48cf-a672-d4432c0af40f tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:34.866111 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 909/1909] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:09:34 2022] GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc => generated 1439 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:34.876394 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bb6b1cc2-fbb8-48cf-a672-d4432c0af40f tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: 14fcf77a-99ed-4d7b-889a-19da49d9e4b4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:34.892687 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8af29787-ec11-41db-ad7c-811472f22da5 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:34.898848 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb6b1cc2-fbb8-48cf-a672-d4432c0af40f tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:34.899356 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb6b1cc2-fbb8-48cf-a672-d4432c0af40f tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:34.899799 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb6b1cc2-fbb8-48cf-a672-d4432c0af40f tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:34.900526 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb6b1cc2-fbb8-48cf-a672-d4432c0af40f tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:34.900979 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb6b1cc2-fbb8-48cf-a672-d4432c0af40f tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:34.901407 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb6b1cc2-fbb8-48cf-a672-d4432c0af40f tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:34.951563 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8af29787-ec11-41db-ad7c-811472f22da5 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/6c8d91c6-f8e6-4d0c-8217-b5b43aac1700" status: 204 len: 0 microversion: 2.1 time: 0.082911 Oct 26 13:09:34.952885 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 910/1910] 10.222.0.40 () {58 vars in 1266 bytes} [Wed Oct 26 13:09:34 2022] DELETE /compute/v2.1/os-server-groups/6c8d91c6-f8e6-4d0c-8217-b5b43aac1700 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:09:34.966482 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-610a9a42-3b97-48d4-9aee-b02691caeaa4 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:35.001863 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-610a9a42-3b97-48d4-9aee-b02691caeaa4 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.041429 Oct 26 13:09:35.005772 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 911/1911] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 26 13:09:34 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:35.018148 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b7dc93a8-91b7-4cf6-9cf7-243dbd65d2b2 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Action: 'create', calling method: .version_select at 0x7f673213bd30>, body: {"server_group": {"name": "tempest-server-group-2056347664", "policies": ["affinity"]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:35.091509 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-b7dc93a8-91b7-4cf6-9cf7-243dbd65d2b2 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Getting quotas for project 7a8dfdc9c02b4cac85a12b25ccf35afd. Resources: {'server_groups'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:09:35.108270 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-b7dc93a8-91b7-4cf6-9cf7-243dbd65d2b2 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Getting quotas for user d933dcf6e541498daeb97cffb8bb3714 and project 7a8dfdc9c02b4cac85a12b25ccf35afd. Resources: {'server_groups'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:09:35.255781 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-b7dc93a8-91b7-4cf6-9cf7-243dbd65d2b2 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Getting quotas for project 7a8dfdc9c02b4cac85a12b25ccf35afd. Resources: {'server_groups'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:09:35.264819 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-b7dc93a8-91b7-4cf6-9cf7-243dbd65d2b2 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Getting quotas for user d933dcf6e541498daeb97cffb8bb3714 and project 7a8dfdc9c02b4cac85a12b25ccf35afd. Resources: {'server_groups'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:09:35.296682 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b7dc93a8-91b7-4cf6-9cf7-243dbd65d2b2 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] 10.222.0.40 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.282781 Oct 26 13:09:35.299188 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 912/1912] 10.222.0.40 () {60 vars in 1173 bytes} [Wed Oct 26 13:09:35 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:35.314404 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1cadb73e-b226-4310-9efd-376c0a29691b tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:35.382782 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1cadb73e-b226-4310-9efd-376c0a29691b tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/db318960-6b03-4f04-9002-0e4eb1d40426" status: 204 len: 0 microversion: 2.1 time: 0.076150 Oct 26 13:09:35.386732 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 913/1913] 10.222.0.40 () {58 vars in 1266 bytes} [Wed Oct 26 13:09:35 2022] DELETE /compute/v2.1/os-server-groups/db318960-6b03-4f04-9002-0e4eb1d40426 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:09:35.395579 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-01ff8b21-5f98-4309-8dc6-a1ba2a3e9fcd tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:35.417836 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-01ff8b21-5f98-4309-8dc6-a1ba2a3e9fcd tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.029638 Oct 26 13:09:35.426848 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 914/1914] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 26 13:09:35 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:35.437093 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3a07bfc9-0b0e-4535-ace9-a37f2cb0faf5 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Action: 'create', calling method: .version_select at 0x7f6732262820>, body: {"server_group": {"name": "tempest-server-group-1623471795", "policies": ["anti-affinity"]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:35.463350 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-3a07bfc9-0b0e-4535-ace9-a37f2cb0faf5 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Getting quotas for project 7a8dfdc9c02b4cac85a12b25ccf35afd. Resources: {'server_groups'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:09:35.477965 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-3a07bfc9-0b0e-4535-ace9-a37f2cb0faf5 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Getting quotas for user d933dcf6e541498daeb97cffb8bb3714 and project 7a8dfdc9c02b4cac85a12b25ccf35afd. Resources: {'server_groups'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:09:35.585191 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-3a07bfc9-0b0e-4535-ace9-a37f2cb0faf5 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Getting quotas for project 7a8dfdc9c02b4cac85a12b25ccf35afd. Resources: {'server_groups'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:09:35.592940 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-3a07bfc9-0b0e-4535-ace9-a37f2cb0faf5 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Getting quotas for user d933dcf6e541498daeb97cffb8bb3714 and project 7a8dfdc9c02b4cac85a12b25ccf35afd. Resources: {'server_groups'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:09:35.655999 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3a07bfc9-0b0e-4535-ace9-a37f2cb0faf5 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] 10.222.0.40 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.227457 Oct 26 13:09:35.666729 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 915/1915] 10.222.0.40 () {60 vars in 1173 bytes} [Wed Oct 26 13:09:35 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:35.678206 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b694be77-b5a5-4423-8f4b-3b7fd341ee0c tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:35.747583 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b694be77-b5a5-4423-8f4b-3b7fd341ee0c tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/929b99f5-601a-46dc-ad28-2cea5bd675d5" status: 204 len: 0 microversion: 2.1 time: 0.077319 Oct 26 13:09:35.748325 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 916/1916] 10.222.0.40 () {58 vars in 1266 bytes} [Wed Oct 26 13:09:35 2022] DELETE /compute/v2.1/os-server-groups/929b99f5-601a-46dc-ad28-2cea5bd675d5 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:09:35.758271 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1866051f-1bbd-49b7-9165-c72c31ccab18 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:35.783457 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1866051f-1bbd-49b7-9165-c72c31ccab18 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.030538 Oct 26 13:09:35.806203 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 917/1917] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 26 13:09:35 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:35.806203 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-460ce35e-b1df-4b10-a715-f84b222cbcca tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:35.806203 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-460ce35e-b1df-4b10-a715-f84b222cbcca tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:35.806203 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=9,nova_api:INSERT=4 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:09:35.820374 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-460ce35e-b1df-4b10-a715-f84b222cbcca tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:35.826190 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-460ce35e-b1df-4b10-a715-f84b222cbcca tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:35.826839 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-460ce35e-b1df-4b10-a715-f84b222cbcca tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:35.827797 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-460ce35e-b1df-4b10-a715-f84b222cbcca tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:35.828363 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-460ce35e-b1df-4b10-a715-f84b222cbcca tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:35.828895 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-460ce35e-b1df-4b10-a715-f84b222cbcca tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:36.419973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bb6b1cc2-fbb8-48cf-a672-d4432c0af40f tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4c9b05864d4d448b1c722659a3bc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2336994846d345aa86b5fd940d1b004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:36.436782 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bb6b1cc2-fbb8-48cf-a672-d4432c0af40f tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4" status: 200 len: 1366 microversion: 2.1 time: 1.594032 Oct 26 13:09:36.438828 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1001/1918] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:34 2022] GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4 => generated 1366 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:36.456569 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ef4f356b-551c-472d-b57c-5d2787fe696e tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:36.457475 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ef4f356b-551c-472d-b57c-5d2787fe696e tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] [instance: bbb44881-d590-4635-8c38-f107f70eaaa3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:36.466787 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef4f356b-551c-472d-b57c-5d2787fe696e tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:36.467306 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef4f356b-551c-472d-b57c-5d2787fe696e tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:36.467743 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef4f356b-551c-472d-b57c-5d2787fe696e tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:36.468456 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef4f356b-551c-472d-b57c-5d2787fe696e tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:36.477874 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef4f356b-551c-472d-b57c-5d2787fe696e tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:36.479037 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef4f356b-551c-472d-b57c-5d2787fe696e tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:36.479802 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:09:36.513300 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-ef4f356b-551c-472d-b57c-5d2787fe696e tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] HTTP exception thrown: Instance bbb44881-d590-4635-8c38-f107f70eaaa3 could not be found. Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ef4f356b-551c-472d-b57c-5d2787fe696e tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Request method failure captured: Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/bbb44881-d590-4635-8c38-f107f70eaaa3 HTTP/1.1 Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTFtzgN-MAhq37GgiWMc4yLbwWn5flzJA-GQD1sXMKeyZTPJp8SlK0Gri4nQSAXqeUcmo7Ai2BtT3YjTVqkYypvy2fvH_j2_tjeKkwE8Teqy4Dd0sUvqiAwLkTrT74iRlcQtVyRjAdKkaiK72i8LalbAXHJjLSrMVcY44IZasoSg2lM Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 6f3d3f7efed04d7fb58147bc2ed55349 Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-TenantUsagesTestJSON-520065391 Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6f3d3f7efed04d7fb58147bc2ed55349"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6f3d3f7efed04d7fb58147bc2ed55349"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6f3d3f7efed04d7fb58147bc2ed55349"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6f3d3f7efed04d7fb58147bc2ed55349"}]}] Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-TenantUsagesTestJSON-520065391 Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 6f3d3f7efed04d7fb58147bc2ed55349 Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-TenantUsagesTestJSON-520065391 Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-TenantUsagesTestJSON-520065391-project Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 1bb3f2b0e3cc4326a1846f6755882dda Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-TenantUsagesTestJSON-520065391-project Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance bbb44881-d590-4635-8c38-f107f70eaaa3 could not be found. Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'bbb44881-d590-4635-8c38-f107f70eaaa3'} Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbb44881-d590-4635-8c38-f107f70eaaa3 could not be found. Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbb44881-d590-4635-8c38-f107f70eaaa3 could not be found. Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:09:36.515155 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:36.521352 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:36.521352 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:09:36.521352 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:09:36.521352 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:09:36.521352 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:09:36.521352 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbb44881-d590-4635-8c38-f107f70eaaa3 could not be found. Oct 26 13:09:36.521352 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:36.535283 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ef4f356b-551c-472d-b57c-5d2787fe696e tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] Returning 404 to user: Instance bbb44881-d590-4635-8c38-f107f70eaaa3 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:09:36.536754 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ef4f356b-551c-472d-b57c-5d2787fe696e tempest-TenantUsagesTestJSON-520065391 tempest-TenantUsagesTestJSON-520065391-project] 10.222.0.40 "GET /compute/v2.1/servers/bbb44881-d590-4635-8c38-f107f70eaaa3" status: 404 len: 111 microversion: 2.1 time: 0.096680 Oct 26 13:09:36.540588 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1002/1919] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:36 2022] GET /compute/v2.1/servers/bbb44881-d590-4635-8c38-f107f70eaaa3 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:09:36.549930 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-77993b8e-9c05-4d91-992c-e17d67c604c3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67368f0550>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:36.648270 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-77993b8e-9c05-4d91-992c-e17d67c604c3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc" status: 200 len: 1439 microversion: 2.1 time: 0.104033 Oct 26 13:09:36.658596 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1003/1920] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:09:36 2022] GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc => generated 1439 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:36.674817 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f28e1693-2c9e-47cb-a434-1c3d81e47db6 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-865360798", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "bf06a9b7-7912-4452-8755-e97d45a1ca77"}]}, "os:scheduler_hints": {"group": "6a7a6fc4-6f4d-4478-978e-63a345ff4b35"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:36.822050 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-f28e1693-2c9e-47cb-a434-1c3d81e47db6 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] validate_networks() for [('bf06a9b7-7912-4452-8755-e97d45a1ca77', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:09:37.042153 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-460ce35e-b1df-4b10-a715-f84b222cbcca tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:37.045575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:09:37.063765 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-460ce35e-b1df-4b10-a715-f84b222cbcca tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:37.073161 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-460ce35e-b1df-4b10-a715-f84b222cbcca tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:37.074469 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-460ce35e-b1df-4b10-a715-f84b222cbcca tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 200 len: 1482 microversion: 2.25 time: 1.281537 Oct 26 13:09:37.083726 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 918/1921] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:09:35 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 1482 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:09:37.465815 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-39d80f23-c429-4527-bc41-1500ac275c94 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:37.466537 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-39d80f23-c429-4527-bc41-1500ac275c94 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: 14fcf77a-99ed-4d7b-889a-19da49d9e4b4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:37.494316 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39d80f23-c429-4527-bc41-1500ac275c94 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:37.502212 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39d80f23-c429-4527-bc41-1500ac275c94 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:37.504682 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39d80f23-c429-4527-bc41-1500ac275c94 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:37.511449 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39d80f23-c429-4527-bc41-1500ac275c94 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:37.514409 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39d80f23-c429-4527-bc41-1500ac275c94 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:37.517720 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39d80f23-c429-4527-bc41-1500ac275c94 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:38.240669 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-f28e1693-2c9e-47cb-a434-1c3d81e47db6 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:09:38.241800 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-f28e1693-2c9e-47cb-a434-1c3d81e47db6 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:09:38.243381 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-f28e1693-2c9e-47cb-a434-1c3d81e47db6 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:09:38.244165 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-f28e1693-2c9e-47cb-a434-1c3d81e47db6 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:09:38.244777 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-f28e1693-2c9e-47cb-a434-1c3d81e47db6 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:09:38.275296 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f28e1693-2c9e-47cb-a434-1c3d81e47db6 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:38.279357 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f28e1693-2c9e-47cb-a434-1c3d81e47db6 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:38.280026 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f28e1693-2c9e-47cb-a434-1c3d81e47db6 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:38.283559 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f28e1693-2c9e-47cb-a434-1c3d81e47db6 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:38.284270 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f28e1693-2c9e-47cb-a434-1c3d81e47db6 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:38.287934 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f28e1693-2c9e-47cb-a434-1c3d81e47db6 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:38.362905 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-f28e1693-2c9e-47cb-a434-1c3d81e47db6 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Getting quotas for project 7a8dfdc9c02b4cac85a12b25ccf35afd. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:09:38.382511 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-f28e1693-2c9e-47cb-a434-1c3d81e47db6 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Getting quotas for user d933dcf6e541498daeb97cffb8bb3714 and project 7a8dfdc9c02b4cac85a12b25ccf35afd. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:09:38.432756 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f28e1693-2c9e-47cb-a434-1c3d81e47db6 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:09:38.443774 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f28e1693-2c9e-47cb-a434-1c3d81e47db6 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] [instance: baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:09:38.517331 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-f28e1693-2c9e-47cb-a434-1c3d81e47db6 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120598) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 26 13:09:38.580255 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-f28e1693-2c9e-47cb-a434-1c3d81e47db6 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Getting quotas for project 7a8dfdc9c02b4cac85a12b25ccf35afd. Resources: {'server_group_members'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:09:38.591587 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-f28e1693-2c9e-47cb-a434-1c3d81e47db6 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Getting quotas for user d933dcf6e541498daeb97cffb8bb3714 and project 7a8dfdc9c02b4cac85a12b25ccf35afd. Resources: {'server_group_members'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:09:38.721228 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-f28e1693-2c9e-47cb-a434-1c3d81e47db6 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Getting quotas for project 7a8dfdc9c02b4cac85a12b25ccf35afd. Resources: {'server_group_members'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:09:38.731897 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-f28e1693-2c9e-47cb-a434-1c3d81e47db6 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Getting quotas for user d933dcf6e541498daeb97cffb8bb3714 and project 7a8dfdc9c02b4cac85a12b25ccf35afd. Resources: {'server_group_members'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:09:38.793376 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f28e1693-2c9e-47cb-a434-1c3d81e47db6 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.131094 Oct 26 13:09:38.795633 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1004/1922] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:09:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2136 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:09:38.807102 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-b40b6a96-94c4-47f5-b43e-77c471b19b08 req-d5d5aef1-cb47-47bb-9b4b-665b1bf382c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ce726c3-809c-4662-b794-dcec3f82047c", "name": "network-vif-deleted", "tag": "2ed4f127-e35d-49ce-a3f0-81fac3604625"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:38.836034 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:09:38.845934 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b40b6a96-94c4-47f5-b43e-77c471b19b08 req-d5d5aef1-cb47-47bb-9b4b-665b1bf382c4 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:38.847615 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b40b6a96-94c4-47f5-b43e-77c471b19b08 req-d5d5aef1-cb47-47bb-9b4b-665b1bf382c4 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:38.849370 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b40b6a96-94c4-47f5-b43e-77c471b19b08 req-d5d5aef1-cb47-47bb-9b4b-665b1bf382c4 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:38.883617 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-39d80f23-c429-4527-bc41-1500ac275c94 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4c9b05864d4d448b1c722659a3bc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2336994846d345aa86b5fd940d1b004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:38.896938 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-39d80f23-c429-4527-bc41-1500ac275c94 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4" status: 200 len: 1556 microversion: 2.1 time: 1.435761 Oct 26 13:09:38.903838 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 919/1923] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:37 2022] GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4 => generated 1556 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:38.923348 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ec456124-d4de-4ebd-ac6d-acda87476c8e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67321f8040>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:39.032388 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ec456124-d4de-4ebd-ac6d-acda87476c8e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc" status: 200 len: 1439 microversion: 2.1 time: 0.120757 Oct 26 13:09:39.045050 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 920/1924] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:09:38 2022] GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc => generated 1439 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:39.053516 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-259121ea-c5f1-4173-b574-d2e32535960b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:39.054584 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-259121ea-c5f1-4173-b574-d2e32535960b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:39.064981 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-259121ea-c5f1-4173-b574-d2e32535960b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:39.065819 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-259121ea-c5f1-4173-b574-d2e32535960b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:39.066498 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-259121ea-c5f1-4173-b574-d2e32535960b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:39.067927 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-259121ea-c5f1-4173-b574-d2e32535960b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:39.069197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-259121ea-c5f1-4173-b574-d2e32535960b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:39.069854 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-259121ea-c5f1-4173-b574-d2e32535960b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:39.198347 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-259121ea-c5f1-4173-b574-d2e32535960b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:39.231122 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-259121ea-c5f1-4173-b574-d2e32535960b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:39.241096 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-259121ea-c5f1-4173-b574-d2e32535960b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:39.245696 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-259121ea-c5f1-4173-b574-d2e32535960b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 200 len: 1266 microversion: 2.25 time: 0.196927 Oct 26 13:09:39.248961 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 921/1925] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:09:39 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:09:39.266988 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-88a78f77-4e69-44e5-9cf1-2aafae35ae05 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:39.277453 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-88a78f77-4e69-44e5-9cf1-2aafae35ae05 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] [instance: baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:39.848317 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-88a78f77-4e69-44e5-9cf1-2aafae35ae05 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd933dcf6e541498daeb97cffb8bb3714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8dfdc9c02b4cac85a12b25ccf35afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:39.861522 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-88a78f77-4e69-44e5-9cf1-2aafae35ae05 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] 10.222.0.40 "GET /compute/v2.1/servers/baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94" status: 200 len: 1212 microversion: 2.1 time: 0.610239 Oct 26 13:09:39.862611 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 922/1926] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:39 2022] GET /compute/v2.1/servers/baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94 => generated 1212 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:39.892857 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-692982e6-44e4-42f7-ad69-ea29f703544a tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:39.904515 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-692982e6-44e4-42f7-ad69-ea29f703544a tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: 14fcf77a-99ed-4d7b-889a-19da49d9e4b4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:39.943931 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-692982e6-44e4-42f7-ad69-ea29f703544a tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:39.944628 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-692982e6-44e4-42f7-ad69-ea29f703544a tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:39.946382 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-692982e6-44e4-42f7-ad69-ea29f703544a tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:39.947426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-692982e6-44e4-42f7-ad69-ea29f703544a tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:39.952317 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-692982e6-44e4-42f7-ad69-ea29f703544a tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:39.954964 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-692982e6-44e4-42f7-ad69-ea29f703544a tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:40.209393 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-b40b6a96-94c4-47f5-b43e-77c471b19b08 req-d5d5aef1-cb47-47bb-9b4b-665b1bf382c4 service nova] Creating event network-vif-deleted:2ed4f127-e35d-49ce-a3f0-81fac3604625 for instance 3ce726c3-809c-4662-b794-dcec3f82047c on n-h2-862686-1 Oct 26 13:09:40.230588 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-b40b6a96-94c4-47f5-b43e-77c471b19b08 req-d5d5aef1-cb47-47bb-9b4b-665b1bf382c4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.431778 Oct 26 13:09:40.235104 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1005/1927] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:40.253383 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9f3b06f9-8671-4e86-a9fd-ef36bb8b6a05 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67368f0af0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:40.393142 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9f3b06f9-8671-4e86-a9fd-ef36bb8b6a05 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc" status: 200 len: 1439 microversion: 2.1 time: 0.156661 Oct 26 13:09:40.399073 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1006/1928] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:09:40 2022] GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc => generated 1439 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:40.418806 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f123a2d6-8257-4b7e-832f-dd1f675f6101 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:40.422382 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f123a2d6-8257-4b7e-832f-dd1f675f6101 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:40.445408 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f123a2d6-8257-4b7e-832f-dd1f675f6101 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:40.445965 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f123a2d6-8257-4b7e-832f-dd1f675f6101 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:40.446422 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f123a2d6-8257-4b7e-832f-dd1f675f6101 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:40.458157 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f123a2d6-8257-4b7e-832f-dd1f675f6101 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:40.458823 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f123a2d6-8257-4b7e-832f-dd1f675f6101 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:40.459291 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f123a2d6-8257-4b7e-832f-dd1f675f6101 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:40.587316 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-692982e6-44e4-42f7-ad69-ea29f703544a tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.723449 Oct 26 13:09:40.597574 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 923/1929] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 26 13:09:39 2022] GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4/os-interface => generated 284 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:40.885818 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-254210b0-061f-42af-94b1-c2fa568d9664 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:40.886702 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-254210b0-061f-42af-94b1-c2fa568d9664 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] [instance: baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:41.372115 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f123a2d6-8257-4b7e-832f-dd1f675f6101 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:41.387536 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f123a2d6-8257-4b7e-832f-dd1f675f6101 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:41.393703 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f123a2d6-8257-4b7e-832f-dd1f675f6101 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:41.397722 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f123a2d6-8257-4b7e-832f-dd1f675f6101 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 200 len: 1266 microversion: 2.25 time: 0.995013 Oct 26 13:09:41.400260 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1007/1930] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:09:40 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 1266 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:09:41.422319 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-61e8ebaa-2547-4f9e-939d-0979b09253ee tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67368c85e0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:41.547882 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-61e8ebaa-2547-4f9e-939d-0979b09253ee tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc" status: 200 len: 1439 microversion: 2.1 time: 0.139470 Oct 26 13:09:41.548697 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1008/1931] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:09:41 2022] GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc => generated 1439 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:09:41.734701 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-254210b0-061f-42af-94b1-c2fa568d9664 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd933dcf6e541498daeb97cffb8bb3714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8dfdc9c02b4cac85a12b25ccf35afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:41.748112 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-254210b0-061f-42af-94b1-c2fa568d9664 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] 10.222.0.40 "GET /compute/v2.1/servers/baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94" status: 200 len: 1212 microversion: 2.1 time: 0.866152 Oct 26 13:09:41.754792 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 924/1932] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:40 2022] GET /compute/v2.1/servers/baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94 => generated 1212 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:42.426558 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a9f5da75-933a-4a89-bf35-1e3d0f576014 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:42.427240 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a9f5da75-933a-4a89-bf35-1e3d0f576014 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:42.449522 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a9f5da75-933a-4a89-bf35-1e3d0f576014 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:42.452853 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a9f5da75-933a-4a89-bf35-1e3d0f576014 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:42.459184 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a9f5da75-933a-4a89-bf35-1e3d0f576014 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:42.464985 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a9f5da75-933a-4a89-bf35-1e3d0f576014 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:42.465768 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a9f5da75-933a-4a89-bf35-1e3d0f576014 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:42.468242 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a9f5da75-933a-4a89-bf35-1e3d0f576014 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:42.571512 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3ccfde3d-7ad5-4413-996f-ea7a8d66d4e5 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67321e8820>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:42.656451 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3ccfde3d-7ad5-4413-996f-ea7a8d66d4e5 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc" status: 200 len: 1439 microversion: 2.1 time: 0.092599 Oct 26 13:09:42.659101 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 925/1933] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:09:42 2022] GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc => generated 1439 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:42.775020 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-98241a56-16a0-41b9-9a20-6825d31d84d8 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:42.775689 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-98241a56-16a0-41b9-9a20-6825d31d84d8 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] [instance: baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:42.807854 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-98241a56-16a0-41b9-9a20-6825d31d84d8 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:42.808497 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-98241a56-16a0-41b9-9a20-6825d31d84d8 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:42.808921 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-98241a56-16a0-41b9-9a20-6825d31d84d8 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:42.809807 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-98241a56-16a0-41b9-9a20-6825d31d84d8 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:42.810182 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-98241a56-16a0-41b9-9a20-6825d31d84d8 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:42.810573 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-98241a56-16a0-41b9-9a20-6825d31d84d8 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:43.058758 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a9f5da75-933a-4a89-bf35-1e3d0f576014 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:43.077311 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a9f5da75-933a-4a89-bf35-1e3d0f576014 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:43.081302 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a9f5da75-933a-4a89-bf35-1e3d0f576014 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:43.092366 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a9f5da75-933a-4a89-bf35-1e3d0f576014 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 200 len: 1266 microversion: 2.25 time: 0.663368 Oct 26 13:09:43.093674 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1009/1934] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:09:42 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 1266 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:09:43.234244 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-98241a56-16a0-41b9-9a20-6825d31d84d8 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd933dcf6e541498daeb97cffb8bb3714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8dfdc9c02b4cac85a12b25ccf35afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:43.252828 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-98241a56-16a0-41b9-9a20-6825d31d84d8 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] 10.222.0.40 "GET /compute/v2.1/servers/baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94" status: 200 len: 1282 microversion: 2.1 time: 0.475324 Oct 26 13:09:43.262457 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 926/1935] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:42 2022] GET /compute/v2.1/servers/baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94 => generated 1282 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:43.683197 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2090bd10-0a6b-4de4-be0f-a5c357c709b0 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f6736922b80>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:43.806916 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2090bd10-0a6b-4de4-be0f-a5c357c709b0 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc" status: 200 len: 1439 microversion: 2.1 time: 0.135623 Oct 26 13:09:43.814211 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1010/1936] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:09:43 2022] GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc => generated 1439 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:44.123339 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fd83da92-d8ec-4884-9e16-6b4bef0940b9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:44.123941 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fd83da92-d8ec-4884-9e16-6b4bef0940b9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:44.145107 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd83da92-d8ec-4884-9e16-6b4bef0940b9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:44.152363 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd83da92-d8ec-4884-9e16-6b4bef0940b9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:44.152961 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd83da92-d8ec-4884-9e16-6b4bef0940b9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:44.153754 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd83da92-d8ec-4884-9e16-6b4bef0940b9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:44.154226 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd83da92-d8ec-4884-9e16-6b4bef0940b9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:44.154652 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd83da92-d8ec-4884-9e16-6b4bef0940b9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:44.287533 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e87ec32d-0c4f-4115-adf9-44f57bb853d6 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:44.288143 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e87ec32d-0c4f-4115-adf9-44f57bb853d6 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] [instance: baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:44.323709 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e87ec32d-0c4f-4115-adf9-44f57bb853d6 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:44.324378 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e87ec32d-0c4f-4115-adf9-44f57bb853d6 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:44.324834 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e87ec32d-0c4f-4115-adf9-44f57bb853d6 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:44.332042 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e87ec32d-0c4f-4115-adf9-44f57bb853d6 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:44.333273 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e87ec32d-0c4f-4115-adf9-44f57bb853d6 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:44.335511 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e87ec32d-0c4f-4115-adf9-44f57bb853d6 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:44.404978 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fd83da92-d8ec-4884-9e16-6b4bef0940b9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:44.414859 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fd83da92-d8ec-4884-9e16-6b4bef0940b9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:44.428127 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fd83da92-d8ec-4884-9e16-6b4bef0940b9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:44.432068 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fd83da92-d8ec-4884-9e16-6b4bef0940b9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 200 len: 1266 microversion: 2.25 time: 0.312706 Oct 26 13:09:44.435167 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 927/1937] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:09:44 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 1266 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:09:44.828875 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f03184a8-020a-4af5-bb91-28fb02f4c65b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f673215c670>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:44.962169 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f03184a8-020a-4af5-bb91-28fb02f4c65b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc" status: 200 len: 1439 microversion: 2.1 time: 0.136896 Oct 26 13:09:44.962949 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 928/1938] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:09:44 2022] GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc => generated 1439 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:09:45.473208 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-08efdfde-67c4-4941-b0a9-0980a9a21374 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:45.477684 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-08efdfde-67c4-4941-b0a9-0980a9a21374 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:45.538635 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-08efdfde-67c4-4941-b0a9-0980a9a21374 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:45.544409 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-08efdfde-67c4-4941-b0a9-0980a9a21374 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:45.544944 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-08efdfde-67c4-4941-b0a9-0980a9a21374 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:45.548226 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-08efdfde-67c4-4941-b0a9-0980a9a21374 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:45.548718 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-08efdfde-67c4-4941-b0a9-0980a9a21374 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:45.549163 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-08efdfde-67c4-4941-b0a9-0980a9a21374 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:45.945681 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-08efdfde-67c4-4941-b0a9-0980a9a21374 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:45.966922 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-08efdfde-67c4-4941-b0a9-0980a9a21374 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:45.970936 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-08efdfde-67c4-4941-b0a9-0980a9a21374 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:45.980755 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-08efdfde-67c4-4941-b0a9-0980a9a21374 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 200 len: 1266 microversion: 2.25 time: 0.519552 Oct 26 13:09:45.985598 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 929/1939] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:09:45 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 1266 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:09:46.009171 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-47c62655-af40-4be2-860c-a4171c5d11b1 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67320f0af0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:46.144590 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-47c62655-af40-4be2-860c-a4171c5d11b1 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc" status: 200 len: 1439 microversion: 2.1 time: 0.150002 Oct 26 13:09:46.165774 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 930/1940] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:09:45 2022] GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc => generated 1439 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:46.561204 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-23f43cde-fe86-4063-ba95-ab5fd1d6105b tempest-FlavorsV2TestJSON-156696413 tempest-FlavorsV2TestJSON-156696413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:46.583000 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-23f43cde-fe86-4063-ba95-ab5fd1d6105b tempest-FlavorsV2TestJSON-156696413 tempest-FlavorsV2TestJSON-156696413-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.355205 Oct 26 13:09:46.592812 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 931/1941] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 26 13:09:46 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:09:46.609091 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0285a644-545c-4647-9859-96a84fc269dc tempest-FlavorsV2TestJSON-156696413 tempest-FlavorsV2TestJSON-156696413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:46.702745 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0285a644-545c-4647-9859-96a84fc269dc tempest-FlavorsV2TestJSON-156696413 tempest-FlavorsV2TestJSON-156696413-project] 10.222.0.40 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.097351 Oct 26 13:09:46.706645 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 932/1942] 10.222.0.40 () {58 vars in 1125 bytes} [Wed Oct 26 13:09:46 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:46.746019 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ee7fc120-38e4-4057-bfcb-5ab7ce52a22c tempest-FlavorsV2TestJSON-156696413 tempest-FlavorsV2TestJSON-156696413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:46.760166 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ee7fc120-38e4-4057-bfcb-5ab7ce52a22c tempest-FlavorsV2TestJSON-156696413 tempest-FlavorsV2TestJSON-156696413-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.045999 Oct 26 13:09:46.768652 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 933/1943] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 26 13:09:46 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:09:46.776443 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-46f19908-914a-4c39-9e95-88baf7f738c9 tempest-FlavorsV2TestJSON-156696413 tempest-FlavorsV2TestJSON-156696413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:46.807967 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-46f19908-914a-4c39-9e95-88baf7f738c9 tempest-FlavorsV2TestJSON-156696413 tempest-FlavorsV2TestJSON-156696413-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.035472 Oct 26 13:09:46.817120 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 934/1944] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 26 13:09:46 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:09:46.835971 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4d6edcdf-fa25-4f7b-b27a-af85f9a36d2c tempest-FlavorsV2TestJSON-156696413 tempest-FlavorsV2TestJSON-156696413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:46.905140 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4d6edcdf-fa25-4f7b-b27a-af85f9a36d2c tempest-FlavorsV2TestJSON-156696413 tempest-FlavorsV2TestJSON-156696413-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.075357 Oct 26 13:09:46.908370 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 935/1945] 10.222.0.40 () {58 vars in 1165 bytes} [Wed Oct 26 13:09:46 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:46.925884 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d849128a-136d-4a5f-bd85-cb946f134279 tempest-FlavorsV2TestJSON-156696413 tempest-FlavorsV2TestJSON-156696413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:46.940497 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d849128a-136d-4a5f-bd85-cb946f134279 tempest-FlavorsV2TestJSON-156696413 tempest-FlavorsV2TestJSON-156696413-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018551 Oct 26 13:09:46.941389 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 936/1946] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 26 13:09:46 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:46.953210 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0090e07f-b3b1-410b-bb47-6a736e73a780 tempest-FlavorsV2TestJSON-156696413 tempest-FlavorsV2TestJSON-156696413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:47.021954 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0090e07f-b3b1-410b-bb47-6a736e73a780 tempest-FlavorsV2TestJSON-156696413 tempest-FlavorsV2TestJSON-156696413-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.070201 Oct 26 13:09:47.023209 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 937/1947] 10.222.0.40 () {58 vars in 1169 bytes} [Wed Oct 26 13:09:46 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:47.038470 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a8028b8b-745d-440f-a7f2-9da12f9ab03d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:47.039446 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a8028b8b-745d-440f-a7f2-9da12f9ab03d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:47.056139 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8028b8b-745d-440f-a7f2-9da12f9ab03d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:47.056924 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8028b8b-745d-440f-a7f2-9da12f9ab03d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:47.058043 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8028b8b-745d-440f-a7f2-9da12f9ab03d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:47.058995 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8028b8b-745d-440f-a7f2-9da12f9ab03d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:47.060854 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8028b8b-745d-440f-a7f2-9da12f9ab03d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:47.061523 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8028b8b-745d-440f-a7f2-9da12f9ab03d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:47.284052 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e87ec32d-0c4f-4115-adf9-44f57bb853d6 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd933dcf6e541498daeb97cffb8bb3714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8dfdc9c02b4cac85a12b25ccf35afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:47.312893 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e87ec32d-0c4f-4115-adf9-44f57bb853d6 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] 10.222.0.40 "GET /compute/v2.1/servers/baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94" status: 200 len: 1312 microversion: 2.1 time: 3.032506 Oct 26 13:09:47.313912 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1011/1948] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:44 2022] GET /compute/v2.1/servers/baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94 => generated 1312 bytes in 3034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:09:47.324189 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0cc2243a-870c-400d-a055-af16d0a8bfb2 tempest-FlavorsV2TestJSON-156696413 tempest-FlavorsV2TestJSON-156696413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:47.358060 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0cc2243a-870c-400d-a055-af16d0a8bfb2 tempest-FlavorsV2TestJSON-156696413 tempest-FlavorsV2TestJSON-156696413-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.043419 Oct 26 13:09:47.358654 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1012/1949] 10.222.0.40 () {58 vars in 1161 bytes} [Wed Oct 26 13:09:47 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:47.372226 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b9015c16-d47e-4ece-8cfe-c4735e2ba7a3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f6731f304c0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:47.457023 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b9015c16-d47e-4ece-8cfe-c4735e2ba7a3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc" status: 200 len: 1439 microversion: 2.1 time: 0.094515 Oct 26 13:09:47.458437 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1013/1950] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:09:47 2022] GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc => generated 1439 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:47.470900 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a8028b8b-745d-440f-a7f2-9da12f9ab03d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:47.487743 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1c4290ea-5de7-4286-988c-a28a28f90fde tempest-FlavorsV2TestJSON-156696413 tempest-FlavorsV2TestJSON-156696413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:47.490089 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a8028b8b-745d-440f-a7f2-9da12f9ab03d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:47.500261 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a8028b8b-745d-440f-a7f2-9da12f9ab03d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:47.501975 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a8028b8b-745d-440f-a7f2-9da12f9ab03d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 200 len: 1266 microversion: 2.25 time: 0.477375 Oct 26 13:09:47.510014 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1c4290ea-5de7-4286-988c-a28a28f90fde tempest-FlavorsV2TestJSON-156696413 tempest-FlavorsV2TestJSON-156696413-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.050265 Oct 26 13:09:47.511853 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1014/1951] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 26 13:09:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:47.517847 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 938/1952] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:09:47 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 1266 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:09:47.526142 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6201953f-1a61-4c50-9847-82283dd34ba8 tempest-FlavorsV2TestJSON-156696413 tempest-FlavorsV2TestJSON-156696413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:47.657043 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6201953f-1a61-4c50-9847-82283dd34ba8 tempest-FlavorsV2TestJSON-156696413 tempest-FlavorsV2TestJSON-156696413-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.135035 Oct 26 13:09:47.668754 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1015/1953] 10.222.0.40 () {58 vars in 1167 bytes} [Wed Oct 26 13:09:47 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:47.678451 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1f958273-2c57-4fd0-ad5b-9aec374154dc tempest-FlavorsV2TestJSON-156696413 tempest-FlavorsV2TestJSON-156696413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:47.705674 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1f958273-2c57-4fd0-ad5b-9aec374154dc tempest-FlavorsV2TestJSON-156696413 tempest-FlavorsV2TestJSON-156696413-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027519 Oct 26 13:09:47.715778 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 939/1954] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 26 13:09:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:47.728961 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4c1f804f-968c-4e2e-9794-a515775f801c tempest-FlavorsV2TestJSON-156696413 tempest-FlavorsV2TestJSON-156696413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:47.794708 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4c1f804f-968c-4e2e-9794-a515775f801c tempest-FlavorsV2TestJSON-156696413 tempest-FlavorsV2TestJSON-156696413-project] 10.222.0.40 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.069812 Oct 26 13:09:47.795304 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1016/1955] 10.222.0.40 () {58 vars in 1144 bytes} [Wed Oct 26 13:09:47 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:47.810673 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-95904a05-99da-4988-84d9-7436b5713c81 tempest-FlavorsV2TestJSON-156696413 tempest-FlavorsV2TestJSON-156696413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:47.819787 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-95904a05-99da-4988-84d9-7436b5713c81 tempest-FlavorsV2TestJSON-156696413 tempest-FlavorsV2TestJSON-156696413-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013115 Oct 26 13:09:47.826547 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 940/1956] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 26 13:09:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:47.839062 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-adbfad3c-ba74-4ff5-846a-727f45d90d41 tempest-FlavorsV2TestJSON-156696413 tempest-FlavorsV2TestJSON-156696413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:47.885718 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-adbfad3c-ba74-4ff5-846a-727f45d90d41 tempest-FlavorsV2TestJSON-156696413 tempest-FlavorsV2TestJSON-156696413-project] 10.222.0.40 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.050337 Oct 26 13:09:47.886347 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1017/1957] 10.222.0.40 () {58 vars in 1148 bytes} [Wed Oct 26 13:09:47 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:09:47.903507 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-00f6dc7b-10b8-4e84-80a3-cf271a7ca813 tempest-FlavorsV2TestJSON-156696413 tempest-FlavorsV2TestJSON-156696413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:47.928985 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-00f6dc7b-10b8-4e84-80a3-cf271a7ca813 tempest-FlavorsV2TestJSON-156696413 tempest-FlavorsV2TestJSON-156696413-project] 10.222.0.40 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.029378 Oct 26 13:09:47.929922 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 941/1958] 10.222.0.40 () {58 vars in 1140 bytes} [Wed Oct 26 13:09:47 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:47.943551 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0bf308a0-247d-49a2-adb0-adc61bb236e3 tempest-FlavorsV2TestJSON-156696413 tempest-FlavorsV2TestJSON-156696413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:47.952394 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0bf308a0-247d-49a2-adb0-adc61bb236e3 tempest-FlavorsV2TestJSON-156696413 tempest-FlavorsV2TestJSON-156696413-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012754 Oct 26 13:09:47.961443 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1018/1959] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 26 13:09:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:47.974588 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e151feae-60af-49e2-94e9-e7f0fe3e30de tempest-FlavorsV2TestJSON-156696413 tempest-FlavorsV2TestJSON-156696413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:48.076585 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e151feae-60af-49e2-94e9-e7f0fe3e30de tempest-FlavorsV2TestJSON-156696413 tempest-FlavorsV2TestJSON-156696413-project] 10.222.0.40 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.106605 Oct 26 13:09:48.081819 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 942/1960] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:09:47 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:48.095496 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5cd6abd5-c54c-4861-a6eb-4978c5c5009b tempest-FlavorsV2TestJSON-156696413 tempest-FlavorsV2TestJSON-156696413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:48.146627 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5cd6abd5-c54c-4861-a6eb-4978c5c5009b tempest-FlavorsV2TestJSON-156696413 tempest-FlavorsV2TestJSON-156696413-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054662 Oct 26 13:09:48.148174 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1019/1961] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:09:48 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:48.167602 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8388bed0-77ea-49d7-8b14-9f8c60f2d01a tempest-FlavorsV2TestJSON-156696413 tempest-FlavorsV2TestJSON-156696413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:48.180560 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8388bed0-77ea-49d7-8b14-9f8c60f2d01a tempest-FlavorsV2TestJSON-156696413 tempest-FlavorsV2TestJSON-156696413-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017747 Oct 26 13:09:48.185408 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 943/1962] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 26 13:09:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:48.341717 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-28f54c0a-6ae3-4511-827d-7daa9efbdbf2 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:48.342352 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-28f54c0a-6ae3-4511-827d-7daa9efbdbf2 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] [instance: baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:48.344803 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=8 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:09:48.353092 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28f54c0a-6ae3-4511-827d-7daa9efbdbf2 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:48.353618 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28f54c0a-6ae3-4511-827d-7daa9efbdbf2 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:48.354068 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28f54c0a-6ae3-4511-827d-7daa9efbdbf2 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:48.354786 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28f54c0a-6ae3-4511-827d-7daa9efbdbf2 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:48.355249 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28f54c0a-6ae3-4511-827d-7daa9efbdbf2 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:48.355679 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28f54c0a-6ae3-4511-827d-7daa9efbdbf2 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:48.474591 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-65b982ab-550f-44da-ae06-ba9ed795ea03 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f673213ae50>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:48.584364 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-65b982ab-550f-44da-ae06-ba9ed795ea03 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc" status: 200 len: 1448 microversion: 2.1 time: 0.114395 Oct 26 13:09:48.595436 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 944/1963] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:09:48 2022] GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc => generated 1448 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:09:48.601789 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d6b9e65d-4a7f-4810-800b-083be3ca11f2 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:48.602902 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d6b9e65d-4a7f-4810-800b-083be3ca11f2 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:48.610525 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6b9e65d-4a7f-4810-800b-083be3ca11f2 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:48.611195 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6b9e65d-4a7f-4810-800b-083be3ca11f2 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:48.611906 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6b9e65d-4a7f-4810-800b-083be3ca11f2 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:48.612783 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6b9e65d-4a7f-4810-800b-083be3ca11f2 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:48.613492 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6b9e65d-4a7f-4810-800b-083be3ca11f2 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:48.614092 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6b9e65d-4a7f-4810-800b-083be3ca11f2 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:48.745788 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=29 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:09:48.963834 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d6b9e65d-4a7f-4810-800b-083be3ca11f2 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:48.975781 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d6b9e65d-4a7f-4810-800b-083be3ca11f2 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:48.977611 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d6b9e65d-4a7f-4810-800b-083be3ca11f2 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:48.979719 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d6b9e65d-4a7f-4810-800b-083be3ca11f2 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 200 len: 1266 microversion: 2.25 time: 0.382598 Oct 26 13:09:48.980872 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 945/1964] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:09:48 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 1266 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:09:48.987543 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9a204c6a-837a-4962-936a-b3db9258fdd5 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f6732169c10>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:49.040802 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-28f54c0a-6ae3-4511-827d-7daa9efbdbf2 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd933dcf6e541498daeb97cffb8bb3714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8dfdc9c02b4cac85a12b25ccf35afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:49.049131 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-28f54c0a-6ae3-4511-827d-7daa9efbdbf2 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] 10.222.0.40 "GET /compute/v2.1/servers/baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94" status: 200 len: 1312 microversion: 2.1 time: 0.711303 Oct 26 13:09:49.051941 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1020/1965] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:48 2022] GET /compute/v2.1/servers/baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94 => generated 1312 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:49.085237 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-003f37ca-baae-4b5b-b737-e3eb58db5041 req-255eee0d-b400-4654-b83d-719772eb8ea8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14fcf77a-99ed-4d7b-889a-19da49d9e4b4", "tag": "daf7da51-0b0e-451f-8b3d-8f82f9a71263"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:49.092037 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9a204c6a-837a-4962-936a-b3db9258fdd5 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc" status: 200 len: 1448 microversion: 2.1 time: 0.109457 Oct 26 13:09:49.102936 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 946/1966] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:09:48 2022] GET /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc => generated 1448 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:49.106568 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-003f37ca-baae-4b5b-b737-e3eb58db5041 req-255eee0d-b400-4654-b83d-719772eb8ea8 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:49.107065 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-003f37ca-baae-4b5b-b737-e3eb58db5041 req-255eee0d-b400-4654-b83d-719772eb8ea8 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:49.107507 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-003f37ca-baae-4b5b-b737-e3eb58db5041 req-255eee0d-b400-4654-b83d-719772eb8ea8 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:49.111214 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cbecbaa0-f1fa-4d0f-a6fd-d7aaeea3da6a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f673215c3a0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:49.132303 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-003f37ca-baae-4b5b-b737-e3eb58db5041 req-255eee0d-b400-4654-b83d-719772eb8ea8 service nova] Creating event network-changed:daf7da51-0b0e-451f-8b3d-8f82f9a71263 for instance 14fcf77a-99ed-4d7b-889a-19da49d9e4b4 on n-h1-862686-1 Oct 26 13:09:49.147283 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-003f37ca-baae-4b5b-b737-e3eb58db5041 req-255eee0d-b400-4654-b83d-719772eb8ea8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081369 Oct 26 13:09:49.147965 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1021/1967] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:50.200631 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fd56dad3-d701-43d4-add2-65dee06cdf97 tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] Action: 'create', calling method: .version_select at 0x7f67368c61f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-677568275", "description": "tempest-description-600936415"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:50.458392 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cbecbaa0-f1fa-4d0f-a6fd-d7aaeea3da6a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "DELETE /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc" status: 204 len: 0 microversion: 2.1 time: 1.351821 Oct 26 13:09:50.459018 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 947/1968] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:49 2022] DELETE /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc => generated 0 bytes in 1355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 26 13:09:50.465866 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cfc60f74-d22f-4008-90d3-804c04e33b52 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:50.467379 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cfc60f74-d22f-4008-90d3-804c04e33b52 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:50.501008 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cfc60f74-d22f-4008-90d3-804c04e33b52 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:50.506027 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cfc60f74-d22f-4008-90d3-804c04e33b52 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:50.508558 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cfc60f74-d22f-4008-90d3-804c04e33b52 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:50.511057 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cfc60f74-d22f-4008-90d3-804c04e33b52 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:50.511565 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cfc60f74-d22f-4008-90d3-804c04e33b52 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:50.512012 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cfc60f74-d22f-4008-90d3-804c04e33b52 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:50.592157 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cfc60f74-d22f-4008-90d3-804c04e33b52 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:50.592648 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cfc60f74-d22f-4008-90d3-804c04e33b52 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:50.593081 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cfc60f74-d22f-4008-90d3-804c04e33b52 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:50.593565 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-cfc60f74-d22f-4008-90d3-804c04e33b52 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lazy-loading 'fault' on Instance uuid 3ce726c3-809c-4662-b794-dcec3f82047c {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:09:50.688897 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cfc60f74-d22f-4008-90d3-804c04e33b52 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:50.702646 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cfc60f74-d22f-4008-90d3-804c04e33b52 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:50.706228 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cfc60f74-d22f-4008-90d3-804c04e33b52 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:50.719185 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cfc60f74-d22f-4008-90d3-804c04e33b52 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 200 len: 1271 microversion: 2.25 time: 0.250071 Oct 26 13:09:50.720942 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 948/1969] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:09:50 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 1271 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:09:50.742259 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5ea9fd82-5992-49fe-8407-a5e69c4bf6ec tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:50.743339 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5ea9fd82-5992-49fe-8407-a5e69c4bf6ec tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] [instance: baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:50.753443 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ea9fd82-5992-49fe-8407-a5e69c4bf6ec tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:50.754460 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ea9fd82-5992-49fe-8407-a5e69c4bf6ec tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:50.757465 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ea9fd82-5992-49fe-8407-a5e69c4bf6ec tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:50.758574 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ea9fd82-5992-49fe-8407-a5e69c4bf6ec tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:50.760595 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ea9fd82-5992-49fe-8407-a5e69c4bf6ec tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:50.761294 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ea9fd82-5992-49fe-8407-a5e69c4bf6ec tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:51.178230 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fd56dad3-d701-43d4-add2-65dee06cdf97 tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.373788 Oct 26 13:09:51.179107 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1022/1970] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 26 13:09:49 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:51.184445 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-dcc21e4f-ed6d-4952-96f9-b41437e8c309 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:51.185068 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-dcc21e4f-ed6d-4952-96f9-b41437e8c309 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: cb087101-2eda-4145-bdcc-41673edfcbb7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:51.216733 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dcc21e4f-ed6d-4952-96f9-b41437e8c309 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:51.217451 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dcc21e4f-ed6d-4952-96f9-b41437e8c309 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:51.226497 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dcc21e4f-ed6d-4952-96f9-b41437e8c309 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:51.230387 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dcc21e4f-ed6d-4952-96f9-b41437e8c309 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:51.246597 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dcc21e4f-ed6d-4952-96f9-b41437e8c309 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:51.248765 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dcc21e4f-ed6d-4952-96f9-b41437e8c309 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:51.346806 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-dcc21e4f-ed6d-4952-96f9-b41437e8c309 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: cb087101-2eda-4145-bdcc-41673edfcbb7] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:09:51.553856 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-dcc21e4f-ed6d-4952-96f9-b41437e8c309 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "DELETE /compute/v2.1/servers/cb087101-2eda-4145-bdcc-41673edfcbb7" status: 204 len: 0 microversion: 2.1 time: 0.373251 Oct 26 13:09:51.554759 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1023/1971] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:09:51 2022] DELETE /compute/v2.1/servers/cb087101-2eda-4145-bdcc-41673edfcbb7 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:09:51.586763 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f0a5479e-107c-4bbd-aa4c-e11be154e092 tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] Action: 'create', calling method: .version_select at 0x7f67368edc10>, body: {"security_group_rule": {"parent_group_id": "677f7826-136d-4049-941d-8cfbfaac3de6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:51.739968 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=30 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:09:52.128433 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5ea9fd82-5992-49fe-8407-a5e69c4bf6ec tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd933dcf6e541498daeb97cffb8bb3714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8dfdc9c02b4cac85a12b25ccf35afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:52.142950 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5ea9fd82-5992-49fe-8407-a5e69c4bf6ec tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] 10.222.0.40 "GET /compute/v2.1/servers/baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94" status: 200 len: 1312 microversion: 2.1 time: 1.420234 Oct 26 13:09:52.146799 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 949/1972] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:50 2022] GET /compute/v2.1/servers/baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94 => generated 1312 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:52.163139 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5a97d63d-dd5c-4664-9aec-74ea05de6d95 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:52.164124 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5a97d63d-dd5c-4664-9aec-74ea05de6d95 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3ce726c3-809c-4662-b794-dcec3f82047c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:52.202645 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5a97d63d-dd5c-4664-9aec-74ea05de6d95 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:52.204239 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5a97d63d-dd5c-4664-9aec-74ea05de6d95 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:52.211052 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5a97d63d-dd5c-4664-9aec-74ea05de6d95 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:52.217848 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5a97d63d-dd5c-4664-9aec-74ea05de6d95 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:52.223732 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5a97d63d-dd5c-4664-9aec-74ea05de6d95 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:52.225726 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5a97d63d-dd5c-4664-9aec-74ea05de6d95 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:52.254612 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-5a97d63d-dd5c-4664-9aec-74ea05de6d95 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] HTTP exception thrown: Instance 3ce726c3-809c-4662-b794-dcec3f82047c could not be found. Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5a97d63d-dd5c-4664-9aec-74ea05de6d95 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Request method failure captured: Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c HTTP/1.1 Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTAVYR0OVZ4Dphw165KOe64tVOSe2bRwO7lZpFQNjQsUumeonFRg55gQeR9IdnQvsDzhcBe3pVL-kelGNhzAXdpAoseAYNY9_pDGpAcVec-gDgRy0K7LaBXNjLW0ljiFS-rO59d5NadiTJVmzCzjaWlC4EdPCUsaZaUutubLIFWnPUc Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: X-Openstack-Nova-Api-Version: 2.25 Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 2f7b9165f0ff4c06a5d154ea24b17bac Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1206006244 Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2f7b9165f0ff4c06a5d154ea24b17bac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2f7b9165f0ff4c06a5d154ea24b17bac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2f7b9165f0ff4c06a5d154ea24b17bac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2f7b9165f0ff4c06a5d154ea24b17bac"}]}] Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1206006244 Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 2f7b9165f0ff4c06a5d154ea24b17bac Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1206006244 Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-LiveAutoBlockMigrationV225Test-1206006244-project Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 27f4a513ca654b0abf9f972e07270c10 Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1206006244-project Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 3ce726c3-809c-4662-b794-dcec3f82047c could not be found. Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '3ce726c3-809c-4662-b794-dcec3f82047c'} Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ce726c3-809c-4662-b794-dcec3f82047c could not be found. Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ce726c3-809c-4662-b794-dcec3f82047c could not be found. Oct 26 13:09:52.259927 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:09:52.267100 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:09:52.267100 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:09:52.267100 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:52.267100 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:09:52.267100 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:09:52.267100 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:09:52.267100 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:09:52.267100 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ce726c3-809c-4662-b794-dcec3f82047c could not be found. Oct 26 13:09:52.267100 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:09:52.273648 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5a97d63d-dd5c-4664-9aec-74ea05de6d95 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Returning 404 to user: Instance 3ce726c3-809c-4662-b794-dcec3f82047c could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:09:52.277732 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5a97d63d-dd5c-4664-9aec-74ea05de6d95 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c" status: 404 len: 111 microversion: 2.25 time: 0.129024 Oct 26 13:09:52.280056 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 950/1973] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:09:52 2022] GET /compute/v2.1/servers/3ce726c3-809c-4662-b794-dcec3f82047c => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:09:52.296012 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0b75939d-1e2a-41a0-86dc-9e8c78adde20 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1786069051", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "259bbcbd-929e-4d48-b53c-e8ded5da783d"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:52.400371 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-0b75939d-1e2a-41a0-86dc-9e8c78adde20 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] validate_networks() for [('259bbcbd-929e-4d48-b53c-e8ded5da783d', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:09:52.753071 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f0a5479e-107c-4bbd-aa4c-e11be154e092 tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.196654 Oct 26 13:09:52.754704 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1024/1974] 10.222.0.40 () {60 vars in 1195 bytes} [Wed Oct 26 13:09:51 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:52.760807 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-60d58b49-93e6-4e6a-97f1-6887048fde12 req-0cd0b09e-6945-44ad-860d-0e2fe404f4c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94", "tag": "d8096ac7-69b7-4caa-b06e-b66b36ad522d"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:52.798920 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-60d58b49-93e6-4e6a-97f1-6887048fde12 req-0cd0b09e-6945-44ad-860d-0e2fe404f4c7 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:52.802185 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-60d58b49-93e6-4e6a-97f1-6887048fde12 req-0cd0b09e-6945-44ad-860d-0e2fe404f4c7 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:52.802766 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-60d58b49-93e6-4e6a-97f1-6887048fde12 req-0cd0b09e-6945-44ad-860d-0e2fe404f4c7 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:52.842391 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-60d58b49-93e6-4e6a-97f1-6887048fde12 req-0cd0b09e-6945-44ad-860d-0e2fe404f4c7 service nova] Creating event network-changed:d8096ac7-69b7-4caa-b06e-b66b36ad522d for instance baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94 on n-h2-862686-1 Oct 26 13:09:52.867160 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-60d58b49-93e6-4e6a-97f1-6887048fde12 req-0cd0b09e-6945-44ad-860d-0e2fe404f4c7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110542 Oct 26 13:09:52.871480 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1025/1975] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:52.883689 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b1df42f7-a810-4f3c-990c-d905bea06bee tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] Action: 'create', calling method: .version_select at 0x7f673690a700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1035370751", "description": "tempest-description-659109399"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:53.974032 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b1df42f7-a810-4f3c-990c-d905bea06bee tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.098813 Oct 26 13:09:53.980620 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1026/1976] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 26 13:09:52 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:53.986255 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8b3222ae-4826-4fca-9b55-b06ad023903a tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:53.987223 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8b3222ae-4826-4fca-9b55-b06ad023903a tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] [instance: baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:54.018888 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b3222ae-4826-4fca-9b55-b06ad023903a tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:54.019406 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b3222ae-4826-4fca-9b55-b06ad023903a tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:54.027438 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b3222ae-4826-4fca-9b55-b06ad023903a tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:54.028299 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b3222ae-4826-4fca-9b55-b06ad023903a tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:54.028796 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b3222ae-4826-4fca-9b55-b06ad023903a tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:54.029245 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b3222ae-4826-4fca-9b55-b06ad023903a tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:54.349150 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-0b75939d-1e2a-41a0-86dc-9e8c78adde20 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:09:54.349822 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-0b75939d-1e2a-41a0-86dc-9e8c78adde20 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:09:54.349977 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-0b75939d-1e2a-41a0-86dc-9e8c78adde20 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:09:54.350840 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-0b75939d-1e2a-41a0-86dc-9e8c78adde20 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:09:54.351438 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-0b75939d-1e2a-41a0-86dc-9e8c78adde20 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:09:54.377751 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b75939d-1e2a-41a0-86dc-9e8c78adde20 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:54.379349 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b75939d-1e2a-41a0-86dc-9e8c78adde20 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:54.382767 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b75939d-1e2a-41a0-86dc-9e8c78adde20 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:54.383782 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b75939d-1e2a-41a0-86dc-9e8c78adde20 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:54.387020 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b75939d-1e2a-41a0-86dc-9e8c78adde20 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:54.387626 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b75939d-1e2a-41a0-86dc-9e8c78adde20 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:54.425215 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8b3222ae-4826-4fca-9b55-b06ad023903a tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd933dcf6e541498daeb97cffb8bb3714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8dfdc9c02b4cac85a12b25ccf35afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:54.434821 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8b3222ae-4826-4fca-9b55-b06ad023903a tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] 10.222.0.40 "GET /compute/v2.1/servers/baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94" status: 200 len: 1312 microversion: 2.1 time: 0.452538 Oct 26 13:09:54.435401 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1027/1977] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:53 2022] GET /compute/v2.1/servers/baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94 => generated 1312 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:54.437459 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-0b75939d-1e2a-41a0-86dc-9e8c78adde20 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Getting quotas for project cc4a21e57f1c4fd1ab3c60f6416f8b11. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:09:54.449297 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-0b75939d-1e2a-41a0-86dc-9e8c78adde20 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Getting quotas for user e3707c34798c48d584cff9dd46d9d7c0 and project cc4a21e57f1c4fd1ab3c60f6416f8b11. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:09:54.502254 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0b75939d-1e2a-41a0-86dc-9e8c78adde20 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:09:54.512570 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0b75939d-1e2a-41a0-86dc-9e8c78adde20 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 31d4915d-93b9-445d-aad6-4fbc96fd5326] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:09:54.647564 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0b75939d-1e2a-41a0-86dc-9e8c78adde20 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.365524 Oct 26 13:09:54.651904 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 951/1978] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:09:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2371 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:09:54.666244 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-b40456be-e53e-4e6f-aea0-059e69b215d6 req-db984f3d-2d1c-4333-814b-76f8962cd0e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb087101-2eda-4145-bdcc-41673edfcbb7", "name": "network-vif-unplugged", "status": "completed", "tag": "9caa8004-d404-4f87-9693-e2931b83f65c"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:54.695992 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-b40456be-e53e-4e6f-aea0-059e69b215d6 req-db984f3d-2d1c-4333-814b-76f8962cd0e2 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:54.696752 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-b40456be-e53e-4e6f-aea0-059e69b215d6 req-db984f3d-2d1c-4333-814b-76f8962cd0e2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:54.697630 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-b40456be-e53e-4e6f-aea0-059e69b215d6 req-db984f3d-2d1c-4333-814b-76f8962cd0e2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:54.719660 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-b40456be-e53e-4e6f-aea0-059e69b215d6 req-db984f3d-2d1c-4333-814b-76f8962cd0e2 service nova] Creating event network-vif-unplugged:9caa8004-d404-4f87-9693-e2931b83f65c for instance cb087101-2eda-4145-bdcc-41673edfcbb7 on n-h2-862686-1 Oct 26 13:09:54.741852 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-91d1e27f-33bc-4faf-977a-e3b5d94a8d1f tempest-FlavorsV2NegativeTest-1211572628 tempest-FlavorsV2NegativeTest-1211572628-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:54.746088 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-b40456be-e53e-4e6f-aea0-059e69b215d6 req-db984f3d-2d1c-4333-814b-76f8962cd0e2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078140 Oct 26 13:09:54.752784 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 952/1979] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:54.759434 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-91d1e27f-33bc-4faf-977a-e3b5d94a8d1f tempest-FlavorsV2NegativeTest-1211572628 tempest-FlavorsV2NegativeTest-1211572628-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.322968 Oct 26 13:09:54.761627 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1028/1980] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 26 13:09:54 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:54.765532 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-638a91c3-19a9-43ef-b9ac-ccb73cd0abb5 tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] Action: 'create', calling method: .version_select at 0x7f6732210280>, body: {"security_group_rule": {"parent_group_id": "27f99c73-ad94-4f22-8d6a-ed80c20663dd", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:54.841755 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1de7a28b-1064-431f-b63b-98e9916669b3 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-211747782", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "c1cd2b04-493d-4d2d-8e9c-d8e3a0e4f8bb"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:54.981339 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-1de7a28b-1064-431f-b63b-98e9916669b3 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] validate_networks() for [('c1cd2b04-493d-4d2d-8e9c-d8e3a0e4f8bb', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:09:56.107739 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-1de7a28b-1064-431f-b63b-98e9916669b3 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:09:56.109821 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-1de7a28b-1064-431f-b63b-98e9916669b3 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:09:56.110562 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-1de7a28b-1064-431f-b63b-98e9916669b3 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:09:56.111448 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-1de7a28b-1064-431f-b63b-98e9916669b3 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:09:56.112992 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-1de7a28b-1064-431f-b63b-98e9916669b3 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:09:56.150091 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1de7a28b-1064-431f-b63b-98e9916669b3 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:56.152800 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1de7a28b-1064-431f-b63b-98e9916669b3 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:56.153420 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1de7a28b-1064-431f-b63b-98e9916669b3 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:56.154208 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1de7a28b-1064-431f-b63b-98e9916669b3 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:56.155266 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1de7a28b-1064-431f-b63b-98e9916669b3 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:56.155703 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1de7a28b-1064-431f-b63b-98e9916669b3 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:56.201774 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-1de7a28b-1064-431f-b63b-98e9916669b3 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Getting quotas for project e689293a8bf44cff9b5ee773557c3e09. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:09:56.213194 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-1de7a28b-1064-431f-b63b-98e9916669b3 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Getting quotas for user f37d1f2f0dfa49bd9b3b6bc7c86e7b7f and project e689293a8bf44cff9b5ee773557c3e09. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:09:56.250096 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1de7a28b-1064-431f-b63b-98e9916669b3 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:09:56.262139 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1de7a28b-1064-431f-b63b-98e9916669b3 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] [instance: db4409fe-6b22-41d1-8c54-c8a5222a65b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:09:56.390407 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1de7a28b-1064-431f-b63b-98e9916669b3 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.627393 Oct 26 13:09:56.392669 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1029/1981] 10.222.0.40 () {62 vars in 1188 bytes} [Wed Oct 26 13:09:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1630 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 26 13:09:56.405438 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6a3007a2-365d-493d-871b-604858427209 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:56.406841 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6a3007a2-365d-493d-871b-604858427209 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 31d4915d-93b9-445d-aad6-4fbc96fd5326] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:56.453354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a3007a2-365d-493d-871b-604858427209 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:56.453967 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a3007a2-365d-493d-871b-604858427209 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:56.454410 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a3007a2-365d-493d-871b-604858427209 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:56.455440 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a3007a2-365d-493d-871b-604858427209 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:56.455794 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a3007a2-365d-493d-871b-604858427209 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:56.456221 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a3007a2-365d-493d-871b-604858427209 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:56.544647 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:09:56.576789 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-638a91c3-19a9-43ef-b9ac-ccb73cd0abb5 tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.822294 Oct 26 13:09:56.577436 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 953/1982] 10.222.0.40 () {60 vars in 1195 bytes} [Wed Oct 26 13:09:54 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1824 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:56.583992 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b88a395c-15d6-496b-92f9-992180e790ce tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:56.585823 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b88a395c-15d6-496b-92f9-992180e790ce tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] [instance: baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:56.612929 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b88a395c-15d6-496b-92f9-992180e790ce tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:56.620498 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b88a395c-15d6-496b-92f9-992180e790ce tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:56.622185 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b88a395c-15d6-496b-92f9-992180e790ce tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:56.627238 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b88a395c-15d6-496b-92f9-992180e790ce tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:56.627974 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b88a395c-15d6-496b-92f9-992180e790ce tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:56.628613 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b88a395c-15d6-496b-92f9-992180e790ce tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:56.703407 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6a3007a2-365d-493d-871b-604858427209 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:56.720350 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6a3007a2-365d-493d-871b-604858427209 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/31d4915d-93b9-445d-aad6-4fbc96fd5326" status: 200 len: 1260 microversion: 2.1 time: 0.326396 Oct 26 13:09:56.736151 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1030/1983] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:56 2022] GET /compute/v2.1/servers/31d4915d-93b9-445d-aad6-4fbc96fd5326 => generated 1260 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:56.753343 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-ee4cd533-d4dd-4d67-9361-0a4d927a78e6 req-9fadef38-1098-4f78-93ab-34bfdf32093a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb087101-2eda-4145-bdcc-41673edfcbb7", "name": "network-vif-deleted", "tag": "9caa8004-d404-4f87-9693-e2931b83f65c"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:56.821802 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ee4cd533-d4dd-4d67-9361-0a4d927a78e6 req-9fadef38-1098-4f78-93ab-34bfdf32093a service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:56.824036 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ee4cd533-d4dd-4d67-9361-0a4d927a78e6 req-9fadef38-1098-4f78-93ab-34bfdf32093a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:56.824627 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ee4cd533-d4dd-4d67-9361-0a4d927a78e6 req-9fadef38-1098-4f78-93ab-34bfdf32093a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:56.869112 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-ee4cd533-d4dd-4d67-9361-0a4d927a78e6 req-9fadef38-1098-4f78-93ab-34bfdf32093a service nova] Creating event network-vif-deleted:9caa8004-d404-4f87-9693-e2931b83f65c for instance cb087101-2eda-4145-bdcc-41673edfcbb7 on n-h2-862686-1 Oct 26 13:09:56.889616 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-ee4cd533-d4dd-4d67-9361-0a4d927a78e6 req-9fadef38-1098-4f78-93ab-34bfdf32093a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145514 Oct 26 13:09:56.891413 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1031/1984] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:56.908094 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-58cff913-b810-4ffa-8c9a-30dc308ef2fc tempest-FlavorsV2NegativeTest-1211572628 tempest-FlavorsV2NegativeTest-1211572628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1586173770", "imageRef": "7a543eda-303b-4755-9147-e810d785a04d", "flavorRef": "452"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:57.087464 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-58cff913-b810-4ffa-8c9a-30dc308ef2fc tempest-FlavorsV2NegativeTest-1211572628 tempest-FlavorsV2NegativeTest-1211572628-project] validate_networks() for None {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:09:57.271259 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b88a395c-15d6-496b-92f9-992180e790ce tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd933dcf6e541498daeb97cffb8bb3714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8dfdc9c02b4cac85a12b25ccf35afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:57.302178 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b88a395c-15d6-496b-92f9-992180e790ce tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] 10.222.0.40 "GET /compute/v2.1/servers/baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94" status: 200 len: 1312 microversion: 2.1 time: 0.707058 Oct 26 13:09:57.305214 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 954/1985] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:56 2022] GET /compute/v2.1/servers/baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94 => generated 1312 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:57.327067 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e0873ede-a4b8-46c8-941b-2e95d6a098ea tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:57.329124 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e0873ede-a4b8-46c8-941b-2e95d6a098ea tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] [instance: db4409fe-6b22-41d1-8c54-c8a5222a65b4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:57.552160 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-58cff913-b810-4ffa-8c9a-30dc308ef2fc tempest-FlavorsV2NegativeTest-1211572628 tempest-FlavorsV2NegativeTest-1211572628-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-58cff913-b810-4ffa-8c9a-30dc308ef2fc tempest-FlavorsV2NegativeTest-1211572628 tempest-FlavorsV2NegativeTest-1211572628-project] Request method failure captured: Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 143 Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTGh13-ZGBuEoM2P68jk_9K_f6lyAwRJSL__Vo8SVIyO5YBBm6yLkKrH8PZbhabXZecm1FSC3iee9Q2hIDkpNdD9m3TgulOMS0kkSL41gOeaM4dPqsWbWEmbtTDWhfd-OD40CdbUpCeZoM1-vJL1R2ZrNQUMNmSxWVfdJV7ueyl9lsE Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: bf54676b36ef41a8bf3721f999ce3aca Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-FlavorsV2NegativeTest-1211572628 Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bf54676b36ef41a8bf3721f999ce3aca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bf54676b36ef41a8bf3721f999ce3aca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bf54676b36ef41a8bf3721f999ce3aca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bf54676b36ef41a8bf3721f999ce3aca"}]}] Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-FlavorsV2NegativeTest-1211572628 Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: bf54676b36ef41a8bf3721f999ce3aca Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1211572628 Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-FlavorsV2NegativeTest-1211572628-project Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: fe0e263f5b1f4f8d914c2368d1418ea2 Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-FlavorsV2NegativeTest-1211572628-project Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1586173770", "imageRef": "7a543eda-303b-4755-9147-e810d785a04d", "flavorRef": "452"}} Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: exception: Flavor's memory is too small for requested image. Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1586173770', 'imageRef': '7a543eda-303b-4755-9147-e810d785a04d', 'flavorRef': '452'}}} Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:09:57.554118 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:09:57.559270 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:09:57.559270 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:09:57.559270 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 26 13:09:57.559270 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 26 13:09:57.559270 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 26 13:09:57.559270 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 26 13:09:57.559270 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:57.559270 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:09:57.559270 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:57.559270 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:09:57.559270 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:09:57.559270 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:09:57.559270 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:09:57.559270 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:09:57.559270 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 26 13:09:57.559270 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:09:57.559270 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-58cff913-b810-4ffa-8c9a-30dc308ef2fc tempest-FlavorsV2NegativeTest-1211572628 tempest-FlavorsV2NegativeTest-1211572628-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:09:57.559270 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-58cff913-b810-4ffa-8c9a-30dc308ef2fc tempest-FlavorsV2NegativeTest-1211572628 tempest-FlavorsV2NegativeTest-1211572628-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.661087 Oct 26 13:09:57.559270 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1032/1986] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:09:56 2022] POST /compute/v2.1/servers => generated 93 bytes in 664 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 26 13:09:57.575781 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-82b41350-9362-4a27-bcf4-30daa87a114c tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] Action: 'create', calling method: .version_select at 0x7f67368c8280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-327814530", "description": "tempest-description-326308314"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:58.150406 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-82b41350-9362-4a27-bcf4-30daa87a114c tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.593234 Oct 26 13:09:58.151576 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1033/1987] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 26 13:09:57 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:58.156845 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7f588095-b2c2-453d-a415-21befeb7cbce tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:58.157845 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7f588095-b2c2-453d-a415-21befeb7cbce tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 31d4915d-93b9-445d-aad6-4fbc96fd5326] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:58.197419 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f588095-b2c2-453d-a415-21befeb7cbce tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:58.198073 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f588095-b2c2-453d-a415-21befeb7cbce tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:58.198526 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f588095-b2c2-453d-a415-21befeb7cbce tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:58.199265 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f588095-b2c2-453d-a415-21befeb7cbce tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:58.210279 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f588095-b2c2-453d-a415-21befeb7cbce tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:58.211036 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f588095-b2c2-453d-a415-21befeb7cbce tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:58.235120 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e0873ede-a4b8-46c8-941b-2e95d6a098ea tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f37d1f2f0dfa49bd9b3b6bc7c86e7b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e689293a8bf44cff9b5ee773557c3e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:58.253829 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e0873ede-a4b8-46c8-941b-2e95d6a098ea tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f37d1f2f0dfa49bd9b3b6bc7c86e7b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e689293a8bf44cff9b5ee773557c3e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:58.263455 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e0873ede-a4b8-46c8-941b-2e95d6a098ea tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f37d1f2f0dfa49bd9b3b6bc7c86e7b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e689293a8bf44cff9b5ee773557c3e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:58.272772 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e0873ede-a4b8-46c8-941b-2e95d6a098ea tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] 10.222.0.40 "GET /compute/v2.1/servers/db4409fe-6b22-41d1-8c54-c8a5222a65b4" status: 200 len: 1258 microversion: 2.21 time: 0.958974 Oct 26 13:09:58.292577 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 955/1988] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:09:57 2022] GET /compute/v2.1/servers/db4409fe-6b22-41d1-8c54-c8a5222a65b4 => generated 1258 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:09:58.314208 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3402b376-f847-46ba-87cc-b7ad56190912 tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] Action: 'create', calling method: .version_select at 0x7f67320be700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1012477069", "description": "tempest-description-1977812881"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:09:58.451767 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7f588095-b2c2-453d-a415-21befeb7cbce tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:58.461410 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7f588095-b2c2-453d-a415-21befeb7cbce tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/31d4915d-93b9-445d-aad6-4fbc96fd5326" status: 200 len: 1266 microversion: 2.1 time: 0.308506 Oct 26 13:09:58.479424 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1034/1989] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:58 2022] GET /compute/v2.1/servers/31d4915d-93b9-445d-aad6-4fbc96fd5326 => generated 1266 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:58.484379 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b3a28ce1-def1-40c3-8313-75376b53d4eb tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:58.498517 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b3a28ce1-def1-40c3-8313-75376b53d4eb tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] [instance: baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:58.511282 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3a28ce1-def1-40c3-8313-75376b53d4eb tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:58.511967 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3a28ce1-def1-40c3-8313-75376b53d4eb tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:58.514359 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3a28ce1-def1-40c3-8313-75376b53d4eb tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:58.515458 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3a28ce1-def1-40c3-8313-75376b53d4eb tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:58.532761 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3a28ce1-def1-40c3-8313-75376b53d4eb tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:58.533611 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3a28ce1-def1-40c3-8313-75376b53d4eb tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:58.878508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b3a28ce1-def1-40c3-8313-75376b53d4eb tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd933dcf6e541498daeb97cffb8bb3714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8dfdc9c02b4cac85a12b25ccf35afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:09:58.897622 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b3a28ce1-def1-40c3-8313-75376b53d4eb tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] 10.222.0.40 "GET /compute/v2.1/servers/baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94" status: 200 len: 1312 microversion: 2.1 time: 0.413327 Oct 26 13:09:58.899657 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1035/1990] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:09:58 2022] GET /compute/v2.1/servers/baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94 => generated 1312 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:09:59.306502 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-eb8d508e-0f8c-497c-845a-0b6cad18f2dd tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:59.307590 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-eb8d508e-0f8c-497c-845a-0b6cad18f2dd tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] [instance: db4409fe-6b22-41d1-8c54-c8a5222a65b4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:59.324198 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb8d508e-0f8c-497c-845a-0b6cad18f2dd tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:59.334118 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb8d508e-0f8c-497c-845a-0b6cad18f2dd tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:59.334696 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb8d508e-0f8c-497c-845a-0b6cad18f2dd tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:59.335522 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb8d508e-0f8c-497c-845a-0b6cad18f2dd tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:59.336009 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb8d508e-0f8c-497c-845a-0b6cad18f2dd tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:59.336440 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb8d508e-0f8c-497c-845a-0b6cad18f2dd tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:59.717803 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3402b376-f847-46ba-87cc-b7ad56190912 tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.416882 Oct 26 13:09:59.718429 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 956/1991] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 26 13:09:58 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:09:59.725315 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-24e37347-0b56-4f2d-9b80-e39ef43ed94b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:09:59.725843 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-24e37347-0b56-4f2d-9b80-e39ef43ed94b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:09:59.761153 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-24e37347-0b56-4f2d-9b80-e39ef43ed94b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:59.761728 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-24e37347-0b56-4f2d-9b80-e39ef43ed94b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:59.764626 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-24e37347-0b56-4f2d-9b80-e39ef43ed94b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:59.765716 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-24e37347-0b56-4f2d-9b80-e39ef43ed94b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:09:59.767969 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-24e37347-0b56-4f2d-9b80-e39ef43ed94b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:09:59.768830 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-24e37347-0b56-4f2d-9b80-e39ef43ed94b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:09:59.903847 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-24e37347-0b56-4f2d-9b80-e39ef43ed94b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:10:00.148636 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-24e37347-0b56-4f2d-9b80-e39ef43ed94b tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924" status: 204 len: 0 microversion: 2.25 time: 0.428374 Oct 26 13:10:00.152312 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 957/1992] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 26 13:09:59 2022] DELETE /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 13:10:00.158632 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-eb8d508e-0f8c-497c-845a-0b6cad18f2dd tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f37d1f2f0dfa49bd9b3b6bc7c86e7b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e689293a8bf44cff9b5ee773557c3e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:00.167332 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e555f974-88a9-436f-8e29-b294dfbd1913 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:00.168179 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e555f974-88a9-436f-8e29-b294dfbd1913 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 31d4915d-93b9-445d-aad6-4fbc96fd5326] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:00.175141 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-eb8d508e-0f8c-497c-845a-0b6cad18f2dd tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f37d1f2f0dfa49bd9b3b6bc7c86e7b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e689293a8bf44cff9b5ee773557c3e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:00.178282 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-eb8d508e-0f8c-497c-845a-0b6cad18f2dd tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f37d1f2f0dfa49bd9b3b6bc7c86e7b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e689293a8bf44cff9b5ee773557c3e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:00.183587 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-eb8d508e-0f8c-497c-845a-0b6cad18f2dd tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] 10.222.0.40 "GET /compute/v2.1/servers/db4409fe-6b22-41d1-8c54-c8a5222a65b4" status: 200 len: 1316 microversion: 2.21 time: 0.881061 Oct 26 13:10:00.188342 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1036/1993] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:09:59 2022] GET /compute/v2.1/servers/db4409fe-6b22-41d1-8c54-c8a5222a65b4 => generated 1316 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:10:00.203400 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e555f974-88a9-436f-8e29-b294dfbd1913 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:00.204302 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e555f974-88a9-436f-8e29-b294dfbd1913 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:00.204925 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e555f974-88a9-436f-8e29-b294dfbd1913 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:00.206189 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e555f974-88a9-436f-8e29-b294dfbd1913 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:00.207624 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e7b33bdd-8f86-40a4-b71d-2239b79a65e3 tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] Action: 'create', calling method: .version_select at 0x7f6736912b80>, body: {"security_group_rule": {"parent_group_id": "e4740dcd-c598-417a-ae36-e07a4a71537b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "7eb5a36f-6100-4644-955f-4bc0fe93f9fc"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:10:00.208343 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e555f974-88a9-436f-8e29-b294dfbd1913 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:00.211346 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e555f974-88a9-436f-8e29-b294dfbd1913 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:00.439677 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e555f974-88a9-436f-8e29-b294dfbd1913 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:00.451062 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e555f974-88a9-436f-8e29-b294dfbd1913 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/31d4915d-93b9-445d-aad6-4fbc96fd5326" status: 200 len: 1266 microversion: 2.1 time: 0.299992 Oct 26 13:10:00.474256 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 958/1994] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:10:00 2022] GET /compute/v2.1/servers/31d4915d-93b9-445d-aad6-4fbc96fd5326 => generated 1266 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:00.481180 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b5ccaf53-2591-42f0-8aa4-c7f249d517b5 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:00.487247 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b5ccaf53-2591-42f0-8aa4-c7f249d517b5 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] [instance: baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:00.501455 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b5ccaf53-2591-42f0-8aa4-c7f249d517b5 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:00.508955 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b5ccaf53-2591-42f0-8aa4-c7f249d517b5 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:00.513375 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b5ccaf53-2591-42f0-8aa4-c7f249d517b5 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:00.514494 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b5ccaf53-2591-42f0-8aa4-c7f249d517b5 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:00.515148 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b5ccaf53-2591-42f0-8aa4-c7f249d517b5 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:00.515829 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b5ccaf53-2591-42f0-8aa4-c7f249d517b5 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:01.129775 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b5ccaf53-2591-42f0-8aa4-c7f249d517b5 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd933dcf6e541498daeb97cffb8bb3714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8dfdc9c02b4cac85a12b25ccf35afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:01.134843 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:10:01.145336 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b5ccaf53-2591-42f0-8aa4-c7f249d517b5 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] 10.222.0.40 "GET /compute/v2.1/servers/baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94" status: 200 len: 1312 microversion: 2.1 time: 0.667025 Oct 26 13:10:01.146414 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 959/1995] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:10:00 2022] GET /compute/v2.1/servers/baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94 => generated 1312 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:01.158320 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-462b0638-44a8-453a-859d-4b4e5bced939 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:01.161715 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-462b0638-44a8-453a-859d-4b4e5bced939 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:01.178763 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-462b0638-44a8-453a-859d-4b4e5bced939 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:01.181217 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-462b0638-44a8-453a-859d-4b4e5bced939 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:01.183585 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-462b0638-44a8-453a-859d-4b4e5bced939 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:01.186769 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-462b0638-44a8-453a-859d-4b4e5bced939 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:01.188221 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-462b0638-44a8-453a-859d-4b4e5bced939 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:01.189291 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-462b0638-44a8-453a-859d-4b4e5bced939 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:01.319025 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e7b33bdd-8f86-40a4-b71d-2239b79a65e3 tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.129072 Oct 26 13:10:01.320186 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1037/1996] 10.222.0.40 () {60 vars in 1195 bytes} [Wed Oct 26 13:10:00 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:10:01.326691 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bb8adb59-9e75-4e99-a76b-ae6732bee0b6 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:01.327549 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bb8adb59-9e75-4e99-a76b-ae6732bee0b6 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] [instance: db4409fe-6b22-41d1-8c54-c8a5222a65b4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:01.360417 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb8adb59-9e75-4e99-a76b-ae6732bee0b6 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:01.361179 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb8adb59-9e75-4e99-a76b-ae6732bee0b6 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:01.361912 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb8adb59-9e75-4e99-a76b-ae6732bee0b6 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:01.362993 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb8adb59-9e75-4e99-a76b-ae6732bee0b6 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:01.363672 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb8adb59-9e75-4e99-a76b-ae6732bee0b6 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:01.367959 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb8adb59-9e75-4e99-a76b-ae6732bee0b6 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:01.615988 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bb8adb59-9e75-4e99-a76b-ae6732bee0b6 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f37d1f2f0dfa49bd9b3b6bc7c86e7b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e689293a8bf44cff9b5ee773557c3e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:01.633421 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bb8adb59-9e75-4e99-a76b-ae6732bee0b6 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f37d1f2f0dfa49bd9b3b6bc7c86e7b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e689293a8bf44cff9b5ee773557c3e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:01.639395 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bb8adb59-9e75-4e99-a76b-ae6732bee0b6 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f37d1f2f0dfa49bd9b3b6bc7c86e7b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e689293a8bf44cff9b5ee773557c3e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:01.650478 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bb8adb59-9e75-4e99-a76b-ae6732bee0b6 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] 10.222.0.40 "GET /compute/v2.1/servers/db4409fe-6b22-41d1-8c54-c8a5222a65b4" status: 200 len: 1316 microversion: 2.21 time: 0.318806 Oct 26 13:10:01.670577 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1038/1997] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:10:01 2022] GET /compute/v2.1/servers/db4409fe-6b22-41d1-8c54-c8a5222a65b4 => generated 1316 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:10:01.702014 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0729cfec-6a86-4451-af35-5427b93f7fe8 tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] Action: 'create', calling method: .version_select at 0x7f6731ffaa60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1589666512", "description": "tempest-description-345309280"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:10:02.597568 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-462b0638-44a8-453a-859d-4b4e5bced939 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:02.601123 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0729cfec-6a86-4451-af35-5427b93f7fe8 tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.929318 Oct 26 13:10:02.603008 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1039/1998] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 26 13:10:01 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:10:02.608416 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-394c12a7-34b0-48a3-a387-03c891f470cc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:02.617930 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-394c12a7-34b0-48a3-a387-03c891f470cc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 31d4915d-93b9-445d-aad6-4fbc96fd5326] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:02.635038 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-462b0638-44a8-453a-859d-4b4e5bced939 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:02.638109 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-462b0638-44a8-453a-859d-4b4e5bced939 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:02.639211 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-394c12a7-34b0-48a3-a387-03c891f470cc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:02.646773 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-394c12a7-34b0-48a3-a387-03c891f470cc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:02.647355 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-394c12a7-34b0-48a3-a387-03c891f470cc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:02.647633 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-462b0638-44a8-453a-859d-4b4e5bced939 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924" status: 200 len: 1730 microversion: 2.25 time: 1.493063 Oct 26 13:10:02.648973 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 960/1999] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:10:01 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 => generated 1730 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:10:02.652179 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-394c12a7-34b0-48a3-a387-03c891f470cc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:02.660645 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-394c12a7-34b0-48a3-a387-03c891f470cc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:02.666242 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-10f62f07-fb5a-4ac3-b70b-f1e48424f1e8 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:02.667354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-394c12a7-34b0-48a3-a387-03c891f470cc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:02.694607 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-10f62f07-fb5a-4ac3-b70b-f1e48424f1e8 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] [instance: baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:02.723655 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-10f62f07-fb5a-4ac3-b70b-f1e48424f1e8 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:02.724167 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-10f62f07-fb5a-4ac3-b70b-f1e48424f1e8 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:02.725429 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-10f62f07-fb5a-4ac3-b70b-f1e48424f1e8 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:02.736793 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-10f62f07-fb5a-4ac3-b70b-f1e48424f1e8 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:02.737293 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-10f62f07-fb5a-4ac3-b70b-f1e48424f1e8 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:02.737769 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-10f62f07-fb5a-4ac3-b70b-f1e48424f1e8 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:03.307821 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-394c12a7-34b0-48a3-a387-03c891f470cc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:03.320981 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-394c12a7-34b0-48a3-a387-03c891f470cc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/31d4915d-93b9-445d-aad6-4fbc96fd5326" status: 200 len: 1308 microversion: 2.1 time: 0.716501 Oct 26 13:10:03.349466 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1040/2000] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:10:02 2022] GET /compute/v2.1/servers/31d4915d-93b9-445d-aad6-4fbc96fd5326 => generated 1308 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:03.361035 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e771d4cc-83a1-4495-a174-867f06299de9 tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] Action: 'create', calling method: .version_select at 0x7f6731ffaaf0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-664026617", "description": "tempest-description-414878096"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:10:03.985495 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-10f62f07-fb5a-4ac3-b70b-f1e48424f1e8 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd933dcf6e541498daeb97cffb8bb3714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8dfdc9c02b4cac85a12b25ccf35afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:03.998916 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-10f62f07-fb5a-4ac3-b70b-f1e48424f1e8 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] 10.222.0.40 "GET /compute/v2.1/servers/baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94" status: 200 len: 1312 microversion: 2.1 time: 1.343257 Oct 26 13:10:03.999741 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 961/2001] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:10:02 2022] GET /compute/v2.1/servers/baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94 => generated 1312 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:04.010755 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c790665d-2595-4136-adee-783485b1e3bc tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:04.017547 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c790665d-2595-4136-adee-783485b1e3bc tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] [instance: db4409fe-6b22-41d1-8c54-c8a5222a65b4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:04.022843 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:10:04.028718 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c790665d-2595-4136-adee-783485b1e3bc tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:04.034992 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c790665d-2595-4136-adee-783485b1e3bc tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:04.038120 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c790665d-2595-4136-adee-783485b1e3bc tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:04.039125 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c790665d-2595-4136-adee-783485b1e3bc tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:04.039903 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c790665d-2595-4136-adee-783485b1e3bc tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:04.044973 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c790665d-2595-4136-adee-783485b1e3bc tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:04.411495 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:10:04.490098 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e771d4cc-83a1-4495-a174-867f06299de9 tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.139334 Oct 26 13:10:04.491834 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1041/2002] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 26 13:10:03 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:10:04.497340 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-58df06af-9344-41d4-8229-8a3f652de69d req-a1f80652-74f5-4d43-884c-9751ba3b7805 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94", "name": "network-vif-plugged", "status": "completed", "tag": "d8096ac7-69b7-4caa-b06e-b66b36ad522d"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:10:04.526547 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-58df06af-9344-41d4-8229-8a3f652de69d req-a1f80652-74f5-4d43-884c-9751ba3b7805 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:04.527201 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-58df06af-9344-41d4-8229-8a3f652de69d req-a1f80652-74f5-4d43-884c-9751ba3b7805 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:04.529680 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-58df06af-9344-41d4-8229-8a3f652de69d req-a1f80652-74f5-4d43-884c-9751ba3b7805 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:04.554631 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-58df06af-9344-41d4-8229-8a3f652de69d req-a1f80652-74f5-4d43-884c-9751ba3b7805 service nova] Creating event network-vif-plugged:d8096ac7-69b7-4caa-b06e-b66b36ad522d for instance baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94 on n-h2-862686-1 Oct 26 13:10:04.560989 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-58df06af-9344-41d4-8229-8a3f652de69d req-a1f80652-74f5-4d43-884c-9751ba3b7805 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067548 Oct 26 13:10:04.562103 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1042/2003] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:10:04.585521 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f12d0309-b840-4440-9673-957d5dd62e03 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:04.587786 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f12d0309-b840-4440-9673-957d5dd62e03 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:04.626120 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f12d0309-b840-4440-9673-957d5dd62e03 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:04.626619 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f12d0309-b840-4440-9673-957d5dd62e03 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:04.629023 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f12d0309-b840-4440-9673-957d5dd62e03 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:04.630332 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f12d0309-b840-4440-9673-957d5dd62e03 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:04.631047 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f12d0309-b840-4440-9673-957d5dd62e03 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:04.631649 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f12d0309-b840-4440-9673-957d5dd62e03 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:04.742640 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c790665d-2595-4136-adee-783485b1e3bc tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f37d1f2f0dfa49bd9b3b6bc7c86e7b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e689293a8bf44cff9b5ee773557c3e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:04.756108 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c790665d-2595-4136-adee-783485b1e3bc tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f37d1f2f0dfa49bd9b3b6bc7c86e7b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e689293a8bf44cff9b5ee773557c3e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:04.759948 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c790665d-2595-4136-adee-783485b1e3bc tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f37d1f2f0dfa49bd9b3b6bc7c86e7b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e689293a8bf44cff9b5ee773557c3e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:04.761774 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c790665d-2595-4136-adee-783485b1e3bc tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] 10.222.0.40 "GET /compute/v2.1/servers/db4409fe-6b22-41d1-8c54-c8a5222a65b4" status: 200 len: 1358 microversion: 2.21 time: 0.756240 Oct 26 13:10:04.780810 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 962/2004] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:10:04 2022] GET /compute/v2.1/servers/db4409fe-6b22-41d1-8c54-c8a5222a65b4 => generated 1358 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:10:04.789670 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3a7bc92c-3d62-4981-9c65-8d9fd788906c tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:04.790955 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3a7bc92c-3d62-4981-9c65-8d9fd788906c tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 31d4915d-93b9-445d-aad6-4fbc96fd5326] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:04.821242 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f12d0309-b840-4440-9673-957d5dd62e03 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:04.826424 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a7bc92c-3d62-4981-9c65-8d9fd788906c tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:04.828329 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a7bc92c-3d62-4981-9c65-8d9fd788906c tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:04.828790 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a7bc92c-3d62-4981-9c65-8d9fd788906c tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:04.832783 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a7bc92c-3d62-4981-9c65-8d9fd788906c tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:04.833620 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a7bc92c-3d62-4981-9c65-8d9fd788906c tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:04.833757 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f12d0309-b840-4440-9673-957d5dd62e03 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:04.834013 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a7bc92c-3d62-4981-9c65-8d9fd788906c tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:04.836088 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f12d0309-b840-4440-9673-957d5dd62e03 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:04.837621 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f12d0309-b840-4440-9673-957d5dd62e03 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924" status: 200 len: 1662 microversion: 2.25 time: 0.259327 Oct 26 13:10:04.838670 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1043/2005] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:10:04 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 => generated 1662 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:10:04.843872 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c5d9023d-0d64-4b79-baf7-4b9fe847450c tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] Action: 'create', calling method: .version_select at 0x7f673690a550>, body: {"security_group_rule": {"parent_group_id": "0b187e79-9585-45ac-a37a-66d5ee54fedb", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "85509d9f-0599-4175-9dde-2063de703780"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:10:05.127861 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3a7bc92c-3d62-4981-9c65-8d9fd788906c tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:05.142121 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3a7bc92c-3d62-4981-9c65-8d9fd788906c tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/31d4915d-93b9-445d-aad6-4fbc96fd5326" status: 200 len: 1308 microversion: 2.1 time: 0.358894 Oct 26 13:10:05.144029 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 963/2006] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:10:04 2022] GET /compute/v2.1/servers/31d4915d-93b9-445d-aad6-4fbc96fd5326 => generated 1308 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:05.166924 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-76b35743-3f8f-4336-8351-2b60e929f88e tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] Calling method '.version_select at 0x7f67320f0160>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:05.229265 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-76b35743-3f8f-4336-8351-2b60e929f88e tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] 10.222.0.40 "GET /compute/v2.1/images/68273e9a-d6c8-4555-a9a3-af5f0508d770" status: 200 len: 636 microversion: 2.1 time: 0.073676 Oct 26 13:10:05.231125 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 964/2007] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:10:05 2022] GET /compute/v2.1/images/68273e9a-d6c8-4555-a9a3-af5f0508d770 => generated 636 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:10:05.236255 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3179207e-48f6-4896-9252-28ea50c33236 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:05.237039 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3179207e-48f6-4896-9252-28ea50c33236 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] [instance: baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:05.244501 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3179207e-48f6-4896-9252-28ea50c33236 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:05.245290 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3179207e-48f6-4896-9252-28ea50c33236 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:05.249397 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3179207e-48f6-4896-9252-28ea50c33236 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:05.250399 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3179207e-48f6-4896-9252-28ea50c33236 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:05.251595 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3179207e-48f6-4896-9252-28ea50c33236 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:05.252348 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3179207e-48f6-4896-9252-28ea50c33236 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:06.168710 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:10:06.176342 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3179207e-48f6-4896-9252-28ea50c33236 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd933dcf6e541498daeb97cffb8bb3714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8dfdc9c02b4cac85a12b25ccf35afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:06.195187 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3179207e-48f6-4896-9252-28ea50c33236 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] 10.222.0.40 "GET /compute/v2.1/servers/baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94" status: 200 len: 1312 microversion: 2.1 time: 0.962797 Oct 26 13:10:06.202593 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 965/2008] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:10:05 2022] GET /compute/v2.1/servers/baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94 => generated 1312 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:06.208089 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-d6d348be-d6f8-44a4-b40d-caa670607870 req-36f06177-7a1c-4b7e-93b4-9d5e38128d08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db4409fe-6b22-41d1-8c54-c8a5222a65b4", "tag": "5c0f9fbe-abc9-46a1-82c7-fb7999c227df"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:10:06.229605 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d6d348be-d6f8-44a4-b40d-caa670607870 req-36f06177-7a1c-4b7e-93b4-9d5e38128d08 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:06.229963 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:10:06.234333 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d6d348be-d6f8-44a4-b40d-caa670607870 req-36f06177-7a1c-4b7e-93b4-9d5e38128d08 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:06.238868 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d6d348be-d6f8-44a4-b40d-caa670607870 req-36f06177-7a1c-4b7e-93b4-9d5e38128d08 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:06.341182 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-d6d348be-d6f8-44a4-b40d-caa670607870 req-36f06177-7a1c-4b7e-93b4-9d5e38128d08 service nova] Creating event network-changed:5c0f9fbe-abc9-46a1-82c7-fb7999c227df for instance db4409fe-6b22-41d1-8c54-c8a5222a65b4 on n-h2-862686-1 Oct 26 13:10:06.365574 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-d6d348be-d6f8-44a4-b40d-caa670607870 req-36f06177-7a1c-4b7e-93b4-9d5e38128d08 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149857 Oct 26 13:10:06.366755 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 966/2009] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:10:06.382989 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d558a5be-f858-418c-bcf0-e7e3954c9197 tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] Action: 'update_all', calling method: .version_select at 0x7f673309c5e0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:10:06.445475 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c5d9023d-0d64-4b79-baf7-4b9fe847450c tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.605565 Oct 26 13:10:06.452889 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1044/2010] 10.222.0.40 () {60 vars in 1195 bytes} [Wed Oct 26 13:10:04 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:10:06.459147 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-1c593a85-5e27-4aa5-a4a2-5464eea3df71 req-084151f5-aa4b-4792-ab6f-996597d8ff31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f27f0232-1c7a-433d-a8ed-9ef4f631b924", "name": "network-vif-deleted", "tag": "77991740-2ec4-4120-929b-065a4a4a02c8"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:10:06.494362 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-1c593a85-5e27-4aa5-a4a2-5464eea3df71 req-084151f5-aa4b-4792-ab6f-996597d8ff31 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:06.495152 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-1c593a85-5e27-4aa5-a4a2-5464eea3df71 req-084151f5-aa4b-4792-ab6f-996597d8ff31 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:06.495893 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-1c593a85-5e27-4aa5-a4a2-5464eea3df71 req-084151f5-aa4b-4792-ab6f-996597d8ff31 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:06.496398 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-d558a5be-f858-418c-bcf0-e7e3954c9197 tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] Getting quotas for project c5d2663e38e14a57be68a4fed1d4de31. Resources: dict_keys(['metadata_items']) {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:10:06.512361 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-1c593a85-5e27-4aa5-a4a2-5464eea3df71 req-084151f5-aa4b-4792-ab6f-996597d8ff31 service nova] Creating event network-vif-deleted:77991740-2ec4-4120-929b-065a4a4a02c8 for instance f27f0232-1c7a-433d-a8ed-9ef4f631b924 on n-h1-862686-1 Oct 26 13:10:06.514102 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-d558a5be-f858-418c-bcf0-e7e3954c9197 tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] Getting quotas for user 6cfc9abacc814a45a745d18f1ebc2ce2 and project c5d2663e38e14a57be68a4fed1d4de31. Resources: dict_keys(['metadata_items']) {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:10:06.533131 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-1c593a85-5e27-4aa5-a4a2-5464eea3df71 req-084151f5-aa4b-4792-ab6f-996597d8ff31 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078578 Oct 26 13:10:06.534099 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1045/2011] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:10:06.547762 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3e482b0b-ad1b-4000-b43e-0d027e1f296c tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:06.548402 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3e482b0b-ad1b-4000-b43e-0d027e1f296c tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] [instance: db4409fe-6b22-41d1-8c54-c8a5222a65b4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:06.559498 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3e482b0b-ad1b-4000-b43e-0d027e1f296c tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:06.560186 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3e482b0b-ad1b-4000-b43e-0d027e1f296c tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:06.560999 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3e482b0b-ad1b-4000-b43e-0d027e1f296c tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:06.562162 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3e482b0b-ad1b-4000-b43e-0d027e1f296c tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:06.562781 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3e482b0b-ad1b-4000-b43e-0d027e1f296c tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:06.563376 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3e482b0b-ad1b-4000-b43e-0d027e1f296c tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:06.810823 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3e482b0b-ad1b-4000-b43e-0d027e1f296c tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f37d1f2f0dfa49bd9b3b6bc7c86e7b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e689293a8bf44cff9b5ee773557c3e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:06.820614 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3e482b0b-ad1b-4000-b43e-0d027e1f296c tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f37d1f2f0dfa49bd9b3b6bc7c86e7b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e689293a8bf44cff9b5ee773557c3e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:06.823448 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3e482b0b-ad1b-4000-b43e-0d027e1f296c tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f37d1f2f0dfa49bd9b3b6bc7c86e7b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e689293a8bf44cff9b5ee773557c3e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:06.824982 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3e482b0b-ad1b-4000-b43e-0d027e1f296c tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] 10.222.0.40 "GET /compute/v2.1/servers/db4409fe-6b22-41d1-8c54-c8a5222a65b4" status: 200 len: 1358 microversion: 2.21 time: 0.289772 Oct 26 13:10:06.838021 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1046/2012] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:10:06 2022] GET /compute/v2.1/servers/db4409fe-6b22-41d1-8c54-c8a5222a65b4 => generated 1358 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:10:06.851978 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-327e2705-42e7-454f-b6f6-ef107d206fa9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:06.852939 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-327e2705-42e7-454f-b6f6-ef107d206fa9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:06.860000 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-327e2705-42e7-454f-b6f6-ef107d206fa9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:06.860497 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-327e2705-42e7-454f-b6f6-ef107d206fa9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:06.860939 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-327e2705-42e7-454f-b6f6-ef107d206fa9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:06.861995 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-327e2705-42e7-454f-b6f6-ef107d206fa9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:06.862624 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-327e2705-42e7-454f-b6f6-ef107d206fa9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:06.863305 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-327e2705-42e7-454f-b6f6-ef107d206fa9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:06.902380 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-327e2705-42e7-454f-b6f6-ef107d206fa9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:06.903748 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-327e2705-42e7-454f-b6f6-ef107d206fa9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:06.904486 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-327e2705-42e7-454f-b6f6-ef107d206fa9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:06.905107 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-327e2705-42e7-454f-b6f6-ef107d206fa9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lazy-loading 'fault' on Instance uuid f27f0232-1c7a-433d-a8ed-9ef4f631b924 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:10:06.949465 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-327e2705-42e7-454f-b6f6-ef107d206fa9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:06.959550 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-327e2705-42e7-454f-b6f6-ef107d206fa9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:06.961458 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-327e2705-42e7-454f-b6f6-ef107d206fa9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:06.963052 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-327e2705-42e7-454f-b6f6-ef107d206fa9 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924" status: 200 len: 1375 microversion: 2.25 time: 0.123451 Oct 26 13:10:06.963803 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1047/2013] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:10:06 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 => generated 1375 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:10:06.988260 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d5123130-3315-4163-9baa-afa97984ef6c tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:06.991217 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d5123130-3315-4163-9baa-afa97984ef6c tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 31d4915d-93b9-445d-aad6-4fbc96fd5326] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:07.008351 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5123130-3315-4163-9baa-afa97984ef6c tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:07.010645 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5123130-3315-4163-9baa-afa97984ef6c tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:07.011206 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5123130-3315-4163-9baa-afa97984ef6c tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:07.013556 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5123130-3315-4163-9baa-afa97984ef6c tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:07.018570 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5123130-3315-4163-9baa-afa97984ef6c tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:07.019288 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5123130-3315-4163-9baa-afa97984ef6c tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:07.091452 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d558a5be-f858-418c-bcf0-e7e3954c9197 tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] 10.222.0.40 "PUT /compute/v2.1/images/68273e9a-d6c8-4555-a9a3-af5f0508d770/metadata" status: 200 len: 61 microversion: 2.1 time: 0.723205 Oct 26 13:10:07.092057 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 967/2014] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 26 13:10:06 2022] PUT /compute/v2.1/images/68273e9a-d6c8-4555-a9a3-af5f0508d770/metadata => generated 61 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:10:07.097415 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-da60b97e-10c7-4a60-b530-cec2d24daa91 tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] Calling method '.version_select at 0x7f67321bff70>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:07.272156 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d5123130-3315-4163-9baa-afa97984ef6c tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:07.283878 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d5123130-3315-4163-9baa-afa97984ef6c tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/31d4915d-93b9-445d-aad6-4fbc96fd5326" status: 200 len: 1308 microversion: 2.1 time: 0.312105 Oct 26 13:10:07.292046 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1048/2015] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:10:06 2022] GET /compute/v2.1/servers/31d4915d-93b9-445d-aad6-4fbc96fd5326 => generated 1308 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:07.308289 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8eb65c49-dc3b-43fe-8d89-48eb4dc41aca tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] Calling method '.version_select at 0x7f67369dd790>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:07.375790 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-da60b97e-10c7-4a60-b530-cec2d24daa91 tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/85509d9f-0599-4175-9dde-2063de703780" status: 202 len: 0 microversion: 2.1 time: 0.282284 Oct 26 13:10:07.381083 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 968/2016] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 26 13:10:07 2022] DELETE /compute/v2.1/os-security-groups/85509d9f-0599-4175-9dde-2063de703780 => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:10:07.387306 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-daa6f1cb-265a-4dd9-804a-1c29314160d9 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:07.388137 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-daa6f1cb-265a-4dd9-804a-1c29314160d9 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] [instance: baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:07.405685 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-daa6f1cb-265a-4dd9-804a-1c29314160d9 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:07.406260 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-daa6f1cb-265a-4dd9-804a-1c29314160d9 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:07.409469 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-daa6f1cb-265a-4dd9-804a-1c29314160d9 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:07.410389 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-daa6f1cb-265a-4dd9-804a-1c29314160d9 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:07.410942 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-daa6f1cb-265a-4dd9-804a-1c29314160d9 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:07.411606 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-daa6f1cb-265a-4dd9-804a-1c29314160d9 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:07.592774 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-daa6f1cb-265a-4dd9-804a-1c29314160d9 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd933dcf6e541498daeb97cffb8bb3714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8dfdc9c02b4cac85a12b25ccf35afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:07.605436 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-daa6f1cb-265a-4dd9-804a-1c29314160d9 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] 10.222.0.40 "GET /compute/v2.1/servers/baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94" status: 200 len: 1498 microversion: 2.1 time: 0.222780 Oct 26 13:10:07.606278 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 969/2017] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:10:07 2022] GET /compute/v2.1/servers/baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94 => generated 1498 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:07.612771 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-86ac1717-b2a5-4bcd-ac30-59a525ccd516 tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] Calling method '.version_select at 0x7f67321bfc10>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:07.681838 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-86ac1717-b2a5-4bcd-ac30-59a525ccd516 tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups/0b187e79-9585-45ac-a37a-66d5ee54fedb" status: 200 len: 247 microversion: 2.1 time: 0.073786 Oct 26 13:10:07.683435 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 970/2018] 10.222.0.40 () {58 vars in 1269 bytes} [Wed Oct 26 13:10:07 2022] GET /compute/v2.1/os-security-groups/0b187e79-9585-45ac-a37a-66d5ee54fedb => generated 247 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:10:07.705002 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6c07d402-1f18-414c-991c-7ca7f61c8847 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:07.715878 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8eb65c49-dc3b-43fe-8d89-48eb4dc41aca tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] 10.222.0.40 "DELETE /compute/v2.1/images/68273e9a-d6c8-4555-a9a3-af5f0508d770/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.421123 Oct 26 13:10:07.716174 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1049/2019] 10.222.0.40 () {58 vars in 1296 bytes} [Wed Oct 26 13:10:07 2022] DELETE /compute/v2.1/images/68273e9a-d6c8-4555-a9a3-af5f0508d770/metadata/os_version => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:10:07.721786 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5e7fcabd-96fa-4aeb-b7d9-398ee361381f tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] Action: 'create', calling method: .version_select at 0x7f6736984040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1457713881", "description": "tempest-description-827181885"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:10:07.724441 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.compute.server_groups [None req-6c07d402-1f18-414c-991c-7ca7f61c8847 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Querying cell 2e5960f1-3c3d-401b-877c-fe82eb67bd3f(cell1) for 1 instances {{(pid=120597) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 26 13:10:07.726117 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6c07d402-1f18-414c-991c-7ca7f61c8847 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:07.726876 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6c07d402-1f18-414c-991c-7ca7f61c8847 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:07.728800 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6c07d402-1f18-414c-991c-7ca7f61c8847 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:07.750211 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6c07d402-1f18-414c-991c-7ca7f61c8847 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups/6a7a6fc4-6f4d-4478-978e-63a345ff4b35" status: 200 len: 222 microversion: 2.1 time: 0.051651 Oct 26 13:10:07.751247 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 971/2020] 10.222.0.40 () {58 vars in 1263 bytes} [Wed Oct 26 13:10:07 2022] GET /compute/v2.1/os-server-groups/6a7a6fc4-6f4d-4478-978e-63a345ff4b35 => generated 222 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:10:07.756950 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cd90f66f-0a46-41e9-9c25-19498d690474 tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] Calling method '.version_select at 0x7f673215c310>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:07.824849 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cd90f66f-0a46-41e9-9c25-19498d690474 tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] 10.222.0.40 "GET /compute/v2.1/images/68273e9a-d6c8-4555-a9a3-af5f0508d770/metadata" status: 200 len: 37 microversion: 2.1 time: 0.072365 Oct 26 13:10:07.825437 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 972/2021] 10.222.0.40 () {58 vars in 1260 bytes} [Wed Oct 26 13:10:07 2022] GET /compute/v2.1/images/68273e9a-d6c8-4555-a9a3-af5f0508d770/metadata => generated 37 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:10:07.839808 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cafc36f8-a90d-41ce-b12a-3f7ce3e012c8 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:07.840870 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cafc36f8-a90d-41ce-b12a-3f7ce3e012c8 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] [instance: baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:07.871333 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cafc36f8-a90d-41ce-b12a-3f7ce3e012c8 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:07.873415 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cafc36f8-a90d-41ce-b12a-3f7ce3e012c8 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:07.875564 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cafc36f8-a90d-41ce-b12a-3f7ce3e012c8 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:07.876879 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cafc36f8-a90d-41ce-b12a-3f7ce3e012c8 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:07.878084 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cafc36f8-a90d-41ce-b12a-3f7ce3e012c8 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:07.879651 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cafc36f8-a90d-41ce-b12a-3f7ce3e012c8 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:07.958505 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cafc36f8-a90d-41ce-b12a-3f7ce3e012c8 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] [instance: baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:10:07.959932 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5e7fcabd-96fa-4aeb-b7d9-398ee361381f tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.242563 Oct 26 13:10:07.961099 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1050/2022] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 26 13:10:07 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:10:07.970111 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-07a70c20-d4ad-4f93-9151-1690d2102aa4 tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] Action: 'update_all', calling method: .version_select at 0x7f67368ed430>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:10:08.062772 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-07a70c20-d4ad-4f93-9151-1690d2102aa4 tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] Getting quotas for project c5d2663e38e14a57be68a4fed1d4de31. Resources: dict_keys(['metadata_items']) {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:10:08.070965 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-07a70c20-d4ad-4f93-9151-1690d2102aa4 tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] Getting quotas for user 6cfc9abacc814a45a745d18f1ebc2ce2 and project c5d2663e38e14a57be68a4fed1d4de31. Resources: dict_keys(['metadata_items']) {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:10:08.117932 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cafc36f8-a90d-41ce-b12a-3f7ce3e012c8 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] 10.222.0.40 "DELETE /compute/v2.1/servers/baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94" status: 204 len: 0 microversion: 2.1 time: 0.290639 Oct 26 13:10:08.122495 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 973/2023] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:10:07 2022] DELETE /compute/v2.1/servers/baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:10:08.134081 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b6826790-317e-4f55-af9c-afb9ec7d6acc tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:08.134819 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b6826790-317e-4f55-af9c-afb9ec7d6acc tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] [instance: db4409fe-6b22-41d1-8c54-c8a5222a65b4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:08.147639 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6826790-317e-4f55-af9c-afb9ec7d6acc tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:08.153133 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6826790-317e-4f55-af9c-afb9ec7d6acc tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:08.153656 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6826790-317e-4f55-af9c-afb9ec7d6acc tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:08.154408 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6826790-317e-4f55-af9c-afb9ec7d6acc tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:08.154875 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6826790-317e-4f55-af9c-afb9ec7d6acc tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:08.155311 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6826790-317e-4f55-af9c-afb9ec7d6acc tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:08.389320 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b6826790-317e-4f55-af9c-afb9ec7d6acc tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f37d1f2f0dfa49bd9b3b6bc7c86e7b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e689293a8bf44cff9b5ee773557c3e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:08.431672 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b6826790-317e-4f55-af9c-afb9ec7d6acc tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f37d1f2f0dfa49bd9b3b6bc7c86e7b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e689293a8bf44cff9b5ee773557c3e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:08.437726 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b6826790-317e-4f55-af9c-afb9ec7d6acc tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f37d1f2f0dfa49bd9b3b6bc7c86e7b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e689293a8bf44cff9b5ee773557c3e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:08.444161 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b6826790-317e-4f55-af9c-afb9ec7d6acc tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] 10.222.0.40 "GET /compute/v2.1/servers/db4409fe-6b22-41d1-8c54-c8a5222a65b4" status: 200 len: 1358 microversion: 2.21 time: 0.316430 Oct 26 13:10:08.445045 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 974/2024] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:10:08 2022] GET /compute/v2.1/servers/db4409fe-6b22-41d1-8c54-c8a5222a65b4 => generated 1358 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:10:08.451052 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1af1d0df-aa90-4720-8c1d-49fa778b2b2d tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] Action: 'create', calling method: .version_select at 0x7f67320d4d30>, body: {"security_group_rule": {"parent_group_id": "59acab84-2c6f-4e6d-99dc-4a65165c995e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:10:08.471157 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-07a70c20-d4ad-4f93-9151-1690d2102aa4 tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] 10.222.0.40 "PUT /compute/v2.1/images/68273e9a-d6c8-4555-a9a3-af5f0508d770/metadata" status: 200 len: 61 microversion: 2.1 time: 0.508674 Oct 26 13:10:08.477216 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1051/2025] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 26 13:10:07 2022] PUT /compute/v2.1/images/68273e9a-d6c8-4555-a9a3-af5f0508d770/metadata => generated 61 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:10:08.483209 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-46054a6b-f614-45b1-b0bc-97455f73f094 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:08.484521 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-46054a6b-f614-45b1-b0bc-97455f73f094 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: f27f0232-1c7a-433d-a8ed-9ef4f631b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:08.494309 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46054a6b-f614-45b1-b0bc-97455f73f094 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:08.494922 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46054a6b-f614-45b1-b0bc-97455f73f094 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:08.495495 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46054a6b-f614-45b1-b0bc-97455f73f094 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:08.496866 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46054a6b-f614-45b1-b0bc-97455f73f094 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:08.497427 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46054a6b-f614-45b1-b0bc-97455f73f094 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:08.498104 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46054a6b-f614-45b1-b0bc-97455f73f094 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:08.538179 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-46054a6b-f614-45b1-b0bc-97455f73f094 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] HTTP exception thrown: Instance f27f0232-1c7a-433d-a8ed-9ef4f631b924 could not be found. Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-46054a6b-f614-45b1-b0bc-97455f73f094 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Request method failure captured: Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 HTTP/1.1 Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTAVYR0OVZ4Dphw165KOe64tVOSe2bRwO7lZpFQNjQsUumeonFRg55gQeR9IdnQvsDzhcBe3pVL-kelGNhzAXdpAoseAYNY9_pDGpAcVec-gDgRy0K7LaBXNjLW0ljiFS-rO59d5NadiTJVmzCzjaWlC4EdPCUsaZaUutubLIFWnPUc Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: X-Openstack-Nova-Api-Version: 2.25 Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 2f7b9165f0ff4c06a5d154ea24b17bac Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1206006244 Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2f7b9165f0ff4c06a5d154ea24b17bac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2f7b9165f0ff4c06a5d154ea24b17bac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2f7b9165f0ff4c06a5d154ea24b17bac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2f7b9165f0ff4c06a5d154ea24b17bac"}]}] Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1206006244 Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 2f7b9165f0ff4c06a5d154ea24b17bac Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1206006244 Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-LiveAutoBlockMigrationV225Test-1206006244-project Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 27f4a513ca654b0abf9f972e07270c10 Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1206006244-project Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance f27f0232-1c7a-433d-a8ed-9ef4f631b924 could not be found. Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'f27f0232-1c7a-433d-a8ed-9ef4f631b924'} Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f27f0232-1c7a-433d-a8ed-9ef4f631b924 could not be found. Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f27f0232-1c7a-433d-a8ed-9ef4f631b924 could not be found. Oct 26 13:10:08.540375 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:10:08.546186 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:10:08.546186 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:10:08.546186 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:08.546186 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:10:08.546186 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:10:08.546186 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:10:08.546186 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:10:08.546186 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f27f0232-1c7a-433d-a8ed-9ef4f631b924 could not be found. Oct 26 13:10:08.546186 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:10:08.546186 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-46054a6b-f614-45b1-b0bc-97455f73f094 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Returning 404 to user: Instance f27f0232-1c7a-433d-a8ed-9ef4f631b924 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:10:08.546186 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-46054a6b-f614-45b1-b0bc-97455f73f094 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924" status: 404 len: 111 microversion: 2.25 time: 0.064546 Oct 26 13:10:08.546186 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1052/2026] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:10:08 2022] GET /compute/v2.1/servers/f27f0232-1c7a-433d-a8ed-9ef4f631b924 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:10:08.548747 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f7a1c560-8607-4c61-9af2-69eceb5bb2a7 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:08.549371 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f7a1c560-8607-4c61-9af2-69eceb5bb2a7 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] [instance: baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:08.556364 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7a1c560-8607-4c61-9af2-69eceb5bb2a7 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:08.556853 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7a1c560-8607-4c61-9af2-69eceb5bb2a7 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:08.557297 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7a1c560-8607-4c61-9af2-69eceb5bb2a7 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:08.558041 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7a1c560-8607-4c61-9af2-69eceb5bb2a7 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:08.558495 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7a1c560-8607-4c61-9af2-69eceb5bb2a7 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:08.558921 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7a1c560-8607-4c61-9af2-69eceb5bb2a7 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:08.737999 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f7a1c560-8607-4c61-9af2-69eceb5bb2a7 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd933dcf6e541498daeb97cffb8bb3714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8dfdc9c02b4cac85a12b25ccf35afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:08.748349 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f7a1c560-8607-4c61-9af2-69eceb5bb2a7 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] 10.222.0.40 "GET /compute/v2.1/servers/baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94" status: 200 len: 1504 microversion: 2.1 time: 0.203333 Oct 26 13:10:08.749357 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1053/2027] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:10:08 2022] GET /compute/v2.1/servers/baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94 => generated 1504 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:08.754998 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e6ff9ba0-1845-41c5-b849-36f5ce672088 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:08.755615 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e6ff9ba0-1845-41c5-b849-36f5ce672088 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 31d4915d-93b9-445d-aad6-4fbc96fd5326] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:08.763149 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:10:08.765088 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6ff9ba0-1845-41c5-b849-36f5ce672088 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:08.765812 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6ff9ba0-1845-41c5-b849-36f5ce672088 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:08.766386 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6ff9ba0-1845-41c5-b849-36f5ce672088 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:08.767176 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6ff9ba0-1845-41c5-b849-36f5ce672088 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:08.768052 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6ff9ba0-1845-41c5-b849-36f5ce672088 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:08.768519 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6ff9ba0-1845-41c5-b849-36f5ce672088 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:08.900949 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1af1d0df-aa90-4720-8c1d-49fa778b2b2d tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.453970 Oct 26 13:10:08.909583 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 975/2028] 10.222.0.40 () {60 vars in 1195 bytes} [Wed Oct 26 13:10:08 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:10:08.915021 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-ad6d95ea-e2a2-41e3-9877-04056a6581aa req-a078e75c-e58c-43ab-ba3f-f4197d5baa41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31d4915d-93b9-445d-aad6-4fbc96fd5326", "tag": "3438b228-4d60-45ce-9603-e5edd9a6df9a"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:10:08.951772 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e6ff9ba0-1845-41c5-b849-36f5ce672088 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:08.953597 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ad6d95ea-e2a2-41e3-9877-04056a6581aa req-a078e75c-e58c-43ab-ba3f-f4197d5baa41 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:08.954285 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ad6d95ea-e2a2-41e3-9877-04056a6581aa req-a078e75c-e58c-43ab-ba3f-f4197d5baa41 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:08.955017 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ad6d95ea-e2a2-41e3-9877-04056a6581aa req-a078e75c-e58c-43ab-ba3f-f4197d5baa41 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:08.964555 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e6ff9ba0-1845-41c5-b849-36f5ce672088 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/31d4915d-93b9-445d-aad6-4fbc96fd5326" status: 200 len: 1308 microversion: 2.1 time: 0.213685 Oct 26 13:10:08.965461 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1054/2029] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:10:08 2022] GET /compute/v2.1/servers/31d4915d-93b9-445d-aad6-4fbc96fd5326 => generated 1308 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:08.971258 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-28718837-2a1e-4a03-82de-1c10bdb55ef4 tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] Calling method '.version_select at 0x7f67369dda60>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:08.990754 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-ad6d95ea-e2a2-41e3-9877-04056a6581aa req-a078e75c-e58c-43ab-ba3f-f4197d5baa41 service nova] Creating event network-changed:3438b228-4d60-45ce-9603-e5edd9a6df9a for instance 31d4915d-93b9-445d-aad6-4fbc96fd5326 on n-h1-862686-1 Oct 26 13:10:09.004530 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-ad6d95ea-e2a2-41e3-9877-04056a6581aa req-a078e75c-e58c-43ab-ba3f-f4197d5baa41 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092336 Oct 26 13:10:09.012949 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 976/2030] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:10:09.023649 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1b06be58-d0b1-4988-bf16-3de66bc4d39c tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '.version_select at 0x7f67320be310>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:09.025125 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-28718837-2a1e-4a03-82de-1c10bdb55ef4 tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] 10.222.0.40 "GET /compute/v2.1/images/68273e9a-d6c8-4555-a9a3-af5f0508d770/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.058098 Oct 26 13:10:09.032046 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1055/2031] 10.222.0.40 () {58 vars in 1290 bytes} [Wed Oct 26 13:10:08 2022] GET /compute/v2.1/images/68273e9a-d6c8-4555-a9a3-af5f0508d770/metadata/os_distro => generated 33 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:10:09.038115 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bd6d8d2a-83cf-4f16-89e8-42f8e264f31c tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] Action: 'create', calling method: .version_select at 0x7f67367f4ca0>, body: {"security_group_rule": {"parent_group_id": "59acab84-2c6f-4e6d-99dc-4a65165c995e", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:10:09.069188 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1b06be58-d0b1-4988-bf16-3de66bc4d39c tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1087202563" status: 204 len: 0 microversion: 2.25 time: 0.054642 Oct 26 13:10:09.070241 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 977/2032] 10.222.0.40 () {60 vars in 1262 bytes} [Wed Oct 26 13:10:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1087202563 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 13:10:09.077644 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-eef22231-8725-4414-9306-77f675ce21fa tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] Action: 'update_all', calling method: .version_select at 0x7f67321e85e0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:10:09.140963 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-eef22231-8725-4414-9306-77f675ce21fa tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] Getting quotas for project c5d2663e38e14a57be68a4fed1d4de31. Resources: dict_keys(['metadata_items']) {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:10:09.147772 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-eef22231-8725-4414-9306-77f675ce21fa tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] Getting quotas for user 6cfc9abacc814a45a745d18f1ebc2ce2 and project c5d2663e38e14a57be68a4fed1d4de31. Resources: dict_keys(['metadata_items']) {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:10:09.395195 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-eef22231-8725-4414-9306-77f675ce21fa tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] 10.222.0.40 "PUT /compute/v2.1/images/68273e9a-d6c8-4555-a9a3-af5f0508d770/metadata" status: 200 len: 61 microversion: 2.1 time: 0.322695 Oct 26 13:10:09.397349 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 978/2033] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 26 13:10:09 2022] PUT /compute/v2.1/images/68273e9a-d6c8-4555-a9a3-af5f0508d770/metadata => generated 61 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:10:09.407323 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6d18a67e-c6c5-49d7-bb5f-60e1afa55ce5 tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] Calling method '.version_select at 0x7f67320d4940>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:09.468394 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6d18a67e-c6c5-49d7-bb5f-60e1afa55ce5 tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] 10.222.0.40 "GET /compute/v2.1/images/68273e9a-d6c8-4555-a9a3-af5f0508d770/metadata" status: 200 len: 61 microversion: 2.1 time: 0.065711 Oct 26 13:10:09.469543 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 979/2034] 10.222.0.40 () {58 vars in 1260 bytes} [Wed Oct 26 13:10:09 2022] GET /compute/v2.1/images/68273e9a-d6c8-4555-a9a3-af5f0508d770/metadata => generated 61 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 26 13:10:09.483784 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b1f163a8-d007-402a-89f9-3ee992d785c0 tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] Action: 'update_all', calling method: .version_select at 0x7f67320bee50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:10:09.634332 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-b1f163a8-d007-402a-89f9-3ee992d785c0 tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] Getting quotas for project c5d2663e38e14a57be68a4fed1d4de31. Resources: dict_keys(['metadata_items']) {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:10:09.642101 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-b1f163a8-d007-402a-89f9-3ee992d785c0 tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] Getting quotas for user 6cfc9abacc814a45a745d18f1ebc2ce2 and project c5d2663e38e14a57be68a4fed1d4de31. Resources: dict_keys(['metadata_items']) {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:10:09.756058 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bd6d8d2a-83cf-4f16-89e8-42f8e264f31c tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.722519 Oct 26 13:10:09.756651 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1056/2035] 10.222.0.40 () {60 vars in 1195 bytes} [Wed Oct 26 13:10:09 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:10:09.761540 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6b35ec7f-5eb6-47e1-b6bf-ef9f68779e79 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:09.762330 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6b35ec7f-5eb6-47e1-b6bf-ef9f68779e79 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] [instance: db4409fe-6b22-41d1-8c54-c8a5222a65b4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:09.782902 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6b35ec7f-5eb6-47e1-b6bf-ef9f68779e79 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:09.783365 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6b35ec7f-5eb6-47e1-b6bf-ef9f68779e79 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:09.783867 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6b35ec7f-5eb6-47e1-b6bf-ef9f68779e79 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:09.786463 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6b35ec7f-5eb6-47e1-b6bf-ef9f68779e79 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:09.786971 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6b35ec7f-5eb6-47e1-b6bf-ef9f68779e79 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:09.787407 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6b35ec7f-5eb6-47e1-b6bf-ef9f68779e79 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:09.880571 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b1f163a8-d007-402a-89f9-3ee992d785c0 tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] 10.222.0.40 "PUT /compute/v2.1/images/68273e9a-d6c8-4555-a9a3-af5f0508d770/metadata" status: 200 len: 61 microversion: 2.1 time: 0.402314 Oct 26 13:10:09.884787 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 980/2036] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 26 13:10:09 2022] PUT /compute/v2.1/images/68273e9a-d6c8-4555-a9a3-af5f0508d770/metadata => generated 61 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:10:09.890573 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-523c773e-5ff9-4812-ab85-c4374a0ffaea tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] Calling method '.version_select at 0x7f67321443a0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:10.099856 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-523c773e-5ff9-4812-ab85-c4374a0ffaea tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups/59acab84-2c6f-4e6d-99dc-4a65165c995e" status: 200 len: 664 microversion: 2.1 time: 0.213423 Oct 26 13:10:10.111474 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 981/2037] 10.222.0.40 () {58 vars in 1269 bytes} [Wed Oct 26 13:10:09 2022] GET /compute/v2.1/os-security-groups/59acab84-2c6f-4e6d-99dc-4a65165c995e => generated 664 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:10:10.117114 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-90c9ca17-c7ee-4dcd-b646-a7c194a87507 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:10.118161 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-90c9ca17-c7ee-4dcd-b646-a7c194a87507 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] [instance: baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:10.125966 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90c9ca17-c7ee-4dcd-b646-a7c194a87507 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:10.126764 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90c9ca17-c7ee-4dcd-b646-a7c194a87507 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:10.127373 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90c9ca17-c7ee-4dcd-b646-a7c194a87507 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:10.128426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90c9ca17-c7ee-4dcd-b646-a7c194a87507 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:10.129233 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90c9ca17-c7ee-4dcd-b646-a7c194a87507 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:10.129880 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90c9ca17-c7ee-4dcd-b646-a7c194a87507 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:10.416655 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-90c9ca17-c7ee-4dcd-b646-a7c194a87507 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd933dcf6e541498daeb97cffb8bb3714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8dfdc9c02b4cac85a12b25ccf35afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:10.430637 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-90c9ca17-c7ee-4dcd-b646-a7c194a87507 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] 10.222.0.40 "GET /compute/v2.1/servers/baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94" status: 200 len: 1504 microversion: 2.1 time: 0.317642 Oct 26 13:10:10.432628 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 982/2038] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:10:10 2022] GET /compute/v2.1/servers/baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94 => generated 1504 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:10.441113 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2cf60f71-f533-4369-982e-8b7b78850ef3 tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] Action: 'update_all', calling method: .version_select at 0x7f6732210820>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:10:10.504427 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-2cf60f71-f533-4369-982e-8b7b78850ef3 tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] Getting quotas for project c5d2663e38e14a57be68a4fed1d4de31. Resources: dict_keys(['metadata_items']) {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:10:10.510636 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-2cf60f71-f533-4369-982e-8b7b78850ef3 tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] Getting quotas for user 6cfc9abacc814a45a745d18f1ebc2ce2 and project c5d2663e38e14a57be68a4fed1d4de31. Resources: dict_keys(['metadata_items']) {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:10:10.567917 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6b35ec7f-5eb6-47e1-b6bf-ef9f68779e79 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f37d1f2f0dfa49bd9b3b6bc7c86e7b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e689293a8bf44cff9b5ee773557c3e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:10.609652 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6b35ec7f-5eb6-47e1-b6bf-ef9f68779e79 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f37d1f2f0dfa49bd9b3b6bc7c86e7b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e689293a8bf44cff9b5ee773557c3e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:10.611300 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6b35ec7f-5eb6-47e1-b6bf-ef9f68779e79 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f37d1f2f0dfa49bd9b3b6bc7c86e7b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e689293a8bf44cff9b5ee773557c3e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:10.612501 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6b35ec7f-5eb6-47e1-b6bf-ef9f68779e79 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] 10.222.0.40 "GET /compute/v2.1/servers/db4409fe-6b22-41d1-8c54-c8a5222a65b4" status: 200 len: 1358 microversion: 2.21 time: 0.854664 Oct 26 13:10:10.614937 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1057/2039] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:10:09 2022] GET /compute/v2.1/servers/db4409fe-6b22-41d1-8c54-c8a5222a65b4 => generated 1358 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:10:10.634078 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-95f6dcbc-42a1-4fe8-874a-a9544606d0e9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:10.634928 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-95f6dcbc-42a1-4fe8-874a-a9544606d0e9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 31d4915d-93b9-445d-aad6-4fbc96fd5326] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:10.642900 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-95f6dcbc-42a1-4fe8-874a-a9544606d0e9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:10.643492 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-95f6dcbc-42a1-4fe8-874a-a9544606d0e9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:10.645871 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-95f6dcbc-42a1-4fe8-874a-a9544606d0e9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:10.646607 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-95f6dcbc-42a1-4fe8-874a-a9544606d0e9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:10.648859 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-95f6dcbc-42a1-4fe8-874a-a9544606d0e9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:10.650239 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-95f6dcbc-42a1-4fe8-874a-a9544606d0e9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:11.024752 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2cf60f71-f533-4369-982e-8b7b78850ef3 tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] 10.222.0.40 "PUT /compute/v2.1/images/68273e9a-d6c8-4555-a9a3-af5f0508d770/metadata" status: 200 len: 64 microversion: 2.1 time: 0.590724 Oct 26 13:10:11.025946 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 983/2040] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 26 13:10:10 2022] PUT /compute/v2.1/images/68273e9a-d6c8-4555-a9a3-af5f0508d770/metadata => generated 64 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:10:11.031448 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-beb3ca97-aa0b-4c82-a1c8-38ce93aaa2f2 tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] Calling method '.version_select at 0x7f6732262d30>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:11.151903 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-95f6dcbc-42a1-4fe8-874a-a9544606d0e9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:11.162088 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-95f6dcbc-42a1-4fe8-874a-a9544606d0e9 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/31d4915d-93b9-445d-aad6-4fbc96fd5326" status: 200 len: 1308 microversion: 2.1 time: 0.545748 Oct 26 13:10:11.162933 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1058/2041] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:10:10 2022] GET /compute/v2.1/servers/31d4915d-93b9-445d-aad6-4fbc96fd5326 => generated 1308 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:11.175413 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-edb2e2ab-ef79-4285-bdff-ae2145302d37 tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] Calling method '.version_select at 0x7f673690a550>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:11.248980 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-edb2e2ab-ef79-4285-bdff-ae2145302d37 tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] 10.222.0.40 "GET /compute/v2.1/images/68273e9a-d6c8-4555-a9a3-af5f0508d770/metadata" status: 200 len: 64 microversion: 2.1 time: 0.084765 Oct 26 13:10:11.249574 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1059/2042] 10.222.0.40 () {58 vars in 1260 bytes} [Wed Oct 26 13:10:11 2022] GET /compute/v2.1/images/68273e9a-d6c8-4555-a9a3-af5f0508d770/metadata => generated 64 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:10:11.274697 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4eb6a952-64b7-496c-a3f4-3211d81e3253 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1624044140", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "356f7a35-97c4-4d20-8492-41da7e963475"}, {"uuid": "e57e413b-7575-466e-9c4e-d86c7674e080"}, {"uuid": "356f7a35-97c4-4d20-8492-41da7e963475"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:10:11.344799 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-beb3ca97-aa0b-4c82-a1c8-38ce93aaa2f2 tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-group-rules/867ff6ce-9b3d-4b64-8701-b228499a178d" status: 202 len: 0 microversion: 2.1 time: 0.300396 Oct 26 13:10:11.344799 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 984/2043] 10.222.0.40 () {58 vars in 1287 bytes} [Wed Oct 26 13:10:11 2022] DELETE /compute/v2.1/os-security-group-rules/867ff6ce-9b3d-4b64-8701-b228499a178d => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:10:11.344799 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7b156eaf-e452-4662-8ea9-deb5839fce97 tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] Action: 'update_all', calling method: .version_select at 0x7f67320f0160>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:10:11.434848 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-4eb6a952-64b7-496c-a3f4-3211d81e3253 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] validate_networks() for [('356f7a35-97c4-4d20-8492-41da7e963475', None, None, None, None, None), ('e57e413b-7575-466e-9c4e-d86c7674e080', None, None, None, None, None), ('356f7a35-97c4-4d20-8492-41da7e963475', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:10:11.485749 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-7b156eaf-e452-4662-8ea9-deb5839fce97 tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] Getting quotas for project c5d2663e38e14a57be68a4fed1d4de31. Resources: dict_keys(['metadata_items']) {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:10:11.508607 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-7b156eaf-e452-4662-8ea9-deb5839fce97 tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] Getting quotas for user 6cfc9abacc814a45a745d18f1ebc2ce2 and project c5d2663e38e14a57be68a4fed1d4de31. Resources: dict_keys(['metadata_items']) {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:10:12.179424 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7b156eaf-e452-4662-8ea9-deb5839fce97 tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] 10.222.0.40 "PUT /compute/v2.1/images/68273e9a-d6c8-4555-a9a3-af5f0508d770/metadata" status: 200 len: 61 microversion: 2.1 time: 0.845311 Oct 26 13:10:12.186357 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 985/2044] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 26 13:10:11 2022] PUT /compute/v2.1/images/68273e9a-d6c8-4555-a9a3-af5f0508d770/metadata => generated 61 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:10:12.192489 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-961cce81-a791-43fd-a9f7-5015aea47140 tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] Calling method '.version_select at 0x7f673213bee0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:12.492437 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-961cce81-a791-43fd-a9f7-5015aea47140 tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/59acab84-2c6f-4e6d-99dc-4a65165c995e" status: 202 len: 0 microversion: 2.1 time: 0.304684 Oct 26 13:10:12.494649 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 986/2045] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 26 13:10:12 2022] DELETE /compute/v2.1/os-security-groups/59acab84-2c6f-4e6d-99dc-4a65165c995e => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:10:12.501456 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c25a0993-c197-441d-ae88-669968807726 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:12.503626 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c25a0993-c197-441d-ae88-669968807726 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] [instance: baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:12.517893 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c25a0993-c197-441d-ae88-669968807726 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:12.518655 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c25a0993-c197-441d-ae88-669968807726 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:12.520925 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c25a0993-c197-441d-ae88-669968807726 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:12.523625 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c25a0993-c197-441d-ae88-669968807726 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:12.524872 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c25a0993-c197-441d-ae88-669968807726 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:12.526017 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c25a0993-c197-441d-ae88-669968807726 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:12.546654 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-c25a0993-c197-441d-ae88-669968807726 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] HTTP exception thrown: Instance baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94 could not be found. Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c25a0993-c197-441d-ae88-669968807726 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Request method failure captured: Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94 HTTP/1.1 Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTGLO2xYmb1y0aLSoU9uajO1csE8CWAgrqS4kvyZ8oQ19_WFpTOZB6SZgjpa6IPr1YmHTqANuXORrJhRLSSkTFK4xK7TcVW6FaRYCBn0T-QqfIM302rYvTNjFIHNthZKhn8VyVx0VOK3aaHOGNl8pgB7yDYJJ8yQzhg_qF8yo-jCsFM Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 7a8dfdc9c02b4cac85a12b25ccf35afd Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServerGroupTestJSON-191537919 Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7a8dfdc9c02b4cac85a12b25ccf35afd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7a8dfdc9c02b4cac85a12b25ccf35afd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7a8dfdc9c02b4cac85a12b25ccf35afd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7a8dfdc9c02b4cac85a12b25ccf35afd"}]}] Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServerGroupTestJSON-191537919 Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 7a8dfdc9c02b4cac85a12b25ccf35afd Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServerGroupTestJSON-191537919 Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServerGroupTestJSON-191537919-project Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: d933dcf6e541498daeb97cffb8bb3714 Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServerGroupTestJSON-191537919-project Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94 could not be found. Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94'} Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94 could not be found. Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94 could not be found. Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:10:12.549683 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:12.555116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:12.555116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:10:12.555116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:10:12.555116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:10:12.555116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:10:12.555116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94 could not be found. Oct 26 13:10:12.555116 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:12.557140 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c25a0993-c197-441d-ae88-669968807726 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Returning 404 to user: Instance baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:10:12.558417 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c25a0993-c197-441d-ae88-669968807726 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] 10.222.0.40 "GET /compute/v2.1/servers/baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94" status: 404 len: 111 microversion: 2.1 time: 0.062490 Oct 26 13:10:12.561187 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 987/2046] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:10:12 2022] GET /compute/v2.1/servers/baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:10:12.567516 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d264a38f-d8d1-4adc-89da-2cfae17de5b0 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:12.569202 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d264a38f-d8d1-4adc-89da-2cfae17de5b0 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] [instance: db4409fe-6b22-41d1-8c54-c8a5222a65b4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:12.578004 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d264a38f-d8d1-4adc-89da-2cfae17de5b0 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:12.578870 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d264a38f-d8d1-4adc-89da-2cfae17de5b0 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:12.579550 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d264a38f-d8d1-4adc-89da-2cfae17de5b0 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:12.580975 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d264a38f-d8d1-4adc-89da-2cfae17de5b0 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:12.581708 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d264a38f-d8d1-4adc-89da-2cfae17de5b0 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:12.583696 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d264a38f-d8d1-4adc-89da-2cfae17de5b0 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:12.788277 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d264a38f-d8d1-4adc-89da-2cfae17de5b0 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f37d1f2f0dfa49bd9b3b6bc7c86e7b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e689293a8bf44cff9b5ee773557c3e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:12.799127 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d264a38f-d8d1-4adc-89da-2cfae17de5b0 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f37d1f2f0dfa49bd9b3b6bc7c86e7b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e689293a8bf44cff9b5ee773557c3e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:12.802021 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d264a38f-d8d1-4adc-89da-2cfae17de5b0 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f37d1f2f0dfa49bd9b3b6bc7c86e7b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e689293a8bf44cff9b5ee773557c3e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:12.803715 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d264a38f-d8d1-4adc-89da-2cfae17de5b0 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] 10.222.0.40 "GET /compute/v2.1/servers/db4409fe-6b22-41d1-8c54-c8a5222a65b4" status: 200 len: 1358 microversion: 2.21 time: 0.241478 Oct 26 13:10:12.804746 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 988/2047] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:10:12 2022] GET /compute/v2.1/servers/db4409fe-6b22-41d1-8c54-c8a5222a65b4 => generated 1358 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:10:12.811406 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-8d6b9db7-06ea-4c3a-9a86-c6be4a73ee3a req-e176cb60-a674-4c04-8bc4-fc956a3ee60d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94", "name": "network-vif-deleted", "tag": "d8096ac7-69b7-4caa-b06e-b66b36ad522d"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:10:12.823351 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-8d6b9db7-06ea-4c3a-9a86-c6be4a73ee3a req-e176cb60-a674-4c04-8bc4-fc956a3ee60d service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:12.824109 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-8d6b9db7-06ea-4c3a-9a86-c6be4a73ee3a req-e176cb60-a674-4c04-8bc4-fc956a3ee60d service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:12.824875 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-8d6b9db7-06ea-4c3a-9a86-c6be4a73ee3a req-e176cb60-a674-4c04-8bc4-fc956a3ee60d service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:12.840260 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-8d6b9db7-06ea-4c3a-9a86-c6be4a73ee3a req-e176cb60-a674-4c04-8bc4-fc956a3ee60d service nova] Creating event network-vif-deleted:d8096ac7-69b7-4caa-b06e-b66b36ad522d for instance baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94 on n-h2-862686-1 Oct 26 13:10:12.846697 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-8d6b9db7-06ea-4c3a-9a86-c6be4a73ee3a req-e176cb60-a674-4c04-8bc4-fc956a3ee60d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040193 Oct 26 13:10:12.848167 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 989/2048] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:10:12.856277 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bf28fd64-c7b2-4939-821e-a217ef319e69 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:12.857002 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bf28fd64-c7b2-4939-821e-a217ef319e69 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: a28883a5-9f17-4514-823e-7b33a316d33c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:12.865314 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf28fd64-c7b2-4939-821e-a217ef319e69 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:12.866697 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf28fd64-c7b2-4939-821e-a217ef319e69 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:12.867252 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-4eb6a952-64b7-496c-a3f4-3211d81e3253 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:10:12.867712 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-4eb6a952-64b7-496c-a3f4-3211d81e3253 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:10:12.868105 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf28fd64-c7b2-4939-821e-a217ef319e69 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:12.868234 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-4eb6a952-64b7-496c-a3f4-3211d81e3253 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:10:12.868594 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-4eb6a952-64b7-496c-a3f4-3211d81e3253 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:10:12.869042 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-4eb6a952-64b7-496c-a3f4-3211d81e3253 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:10:12.870101 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf28fd64-c7b2-4939-821e-a217ef319e69 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:12.871462 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf28fd64-c7b2-4939-821e-a217ef319e69 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:12.871672 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf28fd64-c7b2-4939-821e-a217ef319e69 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:12.885464 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4eb6a952-64b7-496c-a3f4-3211d81e3253 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:12.886403 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4eb6a952-64b7-496c-a3f4-3211d81e3253 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:12.887011 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4eb6a952-64b7-496c-a3f4-3211d81e3253 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:12.887924 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4eb6a952-64b7-496c-a3f4-3211d81e3253 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:12.888563 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4eb6a952-64b7-496c-a3f4-3211d81e3253 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:12.889195 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4eb6a952-64b7-496c-a3f4-3211d81e3253 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:12.906902 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bf28fd64-c7b2-4939-821e-a217ef319e69 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: a28883a5-9f17-4514-823e-7b33a316d33c] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:10:12.913566 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-4eb6a952-64b7-496c-a3f4-3211d81e3253 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Getting quotas for project 23b66b9b9c574fa799086c0733d28887. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:10:12.920746 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-4eb6a952-64b7-496c-a3f4-3211d81e3253 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Getting quotas for user c533afbf98454632a796eea300f50a35 and project 23b66b9b9c574fa799086c0733d28887. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:10:12.938022 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4eb6a952-64b7-496c-a3f4-3211d81e3253 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:10:12.940690 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4eb6a952-64b7-496c-a3f4-3211d81e3253 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: 5a49060c-d94a-4064-8e80-ef8fe20e3ff1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:10:13.002815 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4eb6a952-64b7-496c-a3f4-3211d81e3253 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.750274 Oct 26 13:10:13.003583 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1060/2049] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:10:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:10:13.008662 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-11e4e908-91db-4dda-8f67-04393f7175c5 req-7040d2dd-dbbf-4e5d-aa42-24f3d936a18a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db4409fe-6b22-41d1-8c54-c8a5222a65b4", "name": "network-vif-plugged", "status": "completed", "tag": "5c0f9fbe-abc9-46a1-82c7-fb7999c227df"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:10:13.023584 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-11e4e908-91db-4dda-8f67-04393f7175c5 req-7040d2dd-dbbf-4e5d-aa42-24f3d936a18a service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:13.024055 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-11e4e908-91db-4dda-8f67-04393f7175c5 req-7040d2dd-dbbf-4e5d-aa42-24f3d936a18a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:13.024534 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-11e4e908-91db-4dda-8f67-04393f7175c5 req-7040d2dd-dbbf-4e5d-aa42-24f3d936a18a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:13.039098 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-11e4e908-91db-4dda-8f67-04393f7175c5 req-7040d2dd-dbbf-4e5d-aa42-24f3d936a18a service nova] Creating event network-vif-plugged:5c0f9fbe-abc9-46a1-82c7-fb7999c227df for instance db4409fe-6b22-41d1-8c54-c8a5222a65b4 on n-h2-862686-1 Oct 26 13:10:13.045437 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-11e4e908-91db-4dda-8f67-04393f7175c5 req-7040d2dd-dbbf-4e5d-aa42-24f3d936a18a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039808 Oct 26 13:10:13.046636 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1061/2050] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:10:13.053587 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4a375511-c7e7-403c-bb6e-9ad070b80858 tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] Action: 'update', calling method: .version_select at 0x7f6736984700>, body: {"meta": {"os_version": "alt"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:10:13.070330 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bf28fd64-c7b2-4939-821e-a217ef319e69 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c" status: 204 len: 0 microversion: 2.25 time: 0.219825 Oct 26 13:10:13.071572 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 990/2051] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 26 13:10:12 2022] DELETE /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 13:10:13.092254 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-827b3978-0a9a-4339-aefd-1b737283111b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:13.093095 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-827b3978-0a9a-4339-aefd-1b737283111b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 31d4915d-93b9-445d-aad6-4fbc96fd5326] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:13.102933 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-827b3978-0a9a-4339-aefd-1b737283111b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:13.103624 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-827b3978-0a9a-4339-aefd-1b737283111b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:13.104232 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-827b3978-0a9a-4339-aefd-1b737283111b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:13.105327 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-827b3978-0a9a-4339-aefd-1b737283111b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:13.105966 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-827b3978-0a9a-4339-aefd-1b737283111b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:13.107478 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-827b3978-0a9a-4339-aefd-1b737283111b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:13.141204 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:10:13.163058 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-4a375511-c7e7-403c-bb6e-9ad070b80858 tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] Getting quotas for project c5d2663e38e14a57be68a4fed1d4de31. Resources: dict_keys(['metadata_items']) {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:10:13.183128 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-4a375511-c7e7-403c-bb6e-9ad070b80858 tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] Getting quotas for user 6cfc9abacc814a45a745d18f1ebc2ce2 and project c5d2663e38e14a57be68a4fed1d4de31. Resources: dict_keys(['metadata_items']) {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:10:13.443959 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-827b3978-0a9a-4339-aefd-1b737283111b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:13.451876 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-827b3978-0a9a-4339-aefd-1b737283111b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/31d4915d-93b9-445d-aad6-4fbc96fd5326" status: 200 len: 1308 microversion: 2.1 time: 0.370704 Oct 26 13:10:13.458914 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 991/2052] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:10:13 2022] GET /compute/v2.1/servers/31d4915d-93b9-445d-aad6-4fbc96fd5326 => generated 1308 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:13.473701 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3126d533-4ec9-407e-a548-e640bc460d56 tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] Calling method '.version_select at 0x7f67321864c0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:13.694691 n-d-862686-1 devstack@n-api.service[120597]: DEBUG neutronclient.v2_0.client [None req-3126d533-4ec9-407e-a548-e640bc460d56 tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 85509d9f-0599-4175-9dde-2063de703780 does not exist", "detail": ""}} {{(pid=120597) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 26 13:10:13.695678 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.security_group_api [None req-3126d533-4ec9-407e-a548-e640bc460d56 tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] Neutron security group 85509d9f-0599-4175-9dde-2063de703780 not found {{(pid=120597) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 26 13:10:13.696313 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-3126d533-4ec9-407e-a548-e640bc460d56 tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] HTTP exception thrown: Security group 85509d9f-0599-4175-9dde-2063de703780 does not exist Oct 26 13:10:13.696313 n-d-862686-1 devstack@n-api.service[120597]: Neutron server returns request_ids: ['req-6be7586f-3edd-41e0-bf3d-0961b7d11d3c'] Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3126d533-4ec9-407e-a548-e640bc460d56 tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] Request method failure captured: Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/os-security-groups/85509d9f-0599-4175-9dde-2063de703780 HTTP/1.1 Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTGdBSVotf33KQQKIv-PcTbIbb2RPkyCEE-LPdu7V9xJbqtja5sK3tScDdXKkySwARoXUSnVT2uqF5p-JT0uoDSxSlObIwhSuFGqWRUwHxoU0VrIkP9V1Dli6g2VPdYjF6skixAwVWEcxhU2Ih9abYKmGOwEQ1dAUuSPgmYXskoSpMU Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: e7cf18698db248709e60ffe53c2ba505 Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1927319584 Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e7cf18698db248709e60ffe53c2ba505"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e7cf18698db248709e60ffe53c2ba505"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e7cf18698db248709e60ffe53c2ba505"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e7cf18698db248709e60ffe53c2ba505"}]}] Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1927319584 Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: e7cf18698db248709e60ffe53c2ba505 Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1927319584 Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-SecurityGroupRulesTestJSON-1927319584-project Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 8bc82ba554f04936b27da983df072ad5 Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1927319584-project Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: method: Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: exception: Security group 85509d9f-0599-4175-9dde-2063de703780 does not exist Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: Neutron server returns request_ids: ['req-6be7586f-3edd-41e0-bf3d-0961b7d11d3c'] Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '85509d9f-0599-4175-9dde-2063de703780'} Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 26 13:10:13.698692 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 85509d9f-0599-4175-9dde-2063de703780 does not exist Oct 26 13:10:13.703543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6be7586f-3edd-41e0-bf3d-0961b7d11d3c'] Oct 26 13:10:13.703543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:13.703543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:10:13.703543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:13.703543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:13.703543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 26 13:10:13.703543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 26 13:10:13.703543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 26 13:10:13.703543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 26 13:10:13.703543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 85509d9f-0599-4175-9dde-2063de703780 does not exist Oct 26 13:10:13.703543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6be7586f-3edd-41e0-bf3d-0961b7d11d3c'] Oct 26 13:10:13.703543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:13.703543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:10:13.703543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:13.703543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:13.703543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:10:13.703543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:10:13.703543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:10:13.703543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:10:13.703543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:10:13.703543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:10:13.703543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:10:13.703543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:10:13.703543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 26 13:10:13.703543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 26 13:10:13.703543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 85509d9f-0599-4175-9dde-2063de703780 does not exist Oct 26 13:10:13.703543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6be7586f-3edd-41e0-bf3d-0961b7d11d3c'] Oct 26 13:10:13.703543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:13.703543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:10:13.703543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:13.703543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:13.703543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:10:13.703543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:10:13.703543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:10:13.703543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:10:13.703543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 85509d9f-0599-4175-9dde-2063de703780 does not exist Oct 26 13:10:13.703543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6be7586f-3edd-41e0-bf3d-0961b7d11d3c'] Oct 26 13:10:13.703543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:13.709560 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3126d533-4ec9-407e-a548-e640bc460d56 tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] Returning 404 to user: Security group 85509d9f-0599-4175-9dde-2063de703780 does not exist Oct 26 13:10:13.709560 n-d-862686-1 devstack@n-api.service[120597]: Neutron server returns request_ids: ['req-6be7586f-3edd-41e0-bf3d-0961b7d11d3c'] {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:10:13.710512 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3126d533-4ec9-407e-a548-e640bc460d56 tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/85509d9f-0599-4175-9dde-2063de703780" status: 404 len: 194 microversion: 2.1 time: 0.250738 Oct 26 13:10:13.711254 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 992/2053] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 26 13:10:13 2022] DELETE /compute/v2.1/os-security-groups/85509d9f-0599-4175-9dde-2063de703780 => generated 194 bytes in 252 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:10:13.723245 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-94801ad3-93fc-469c-95c7-d2109be3da34 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:13.730655 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4a375511-c7e7-403c-bb6e-9ad070b80858 tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] 10.222.0.40 "PUT /compute/v2.1/images/68273e9a-d6c8-4555-a9a3-af5f0508d770/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.682440 Oct 26 13:10:13.733373 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1062/2054] 10.222.0.40 () {60 vars in 1313 bytes} [Wed Oct 26 13:10:13 2022] PUT /compute/v2.1/images/68273e9a-d6c8-4555-a9a3-af5f0508d770/metadata/os_version => generated 31 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:10:13.748785 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a4d2affc-4ef6-4cf4-9244-63e4289b871f tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:13.752065 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a4d2affc-4ef6-4cf4-9244-63e4289b871f tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: 5a49060c-d94a-4064-8e80-ef8fe20e3ff1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:13.793838 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.compute.server_groups [None req-94801ad3-93fc-469c-95c7-d2109be3da34 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Querying cell 2e5960f1-3c3d-401b-877c-fe82eb67bd3f(cell1) for 1 instances {{(pid=120597) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 26 13:10:13.794718 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-94801ad3-93fc-469c-95c7-d2109be3da34 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:13.795589 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-94801ad3-93fc-469c-95c7-d2109be3da34 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:13.796344 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-94801ad3-93fc-469c-95c7-d2109be3da34 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:13.825088 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-94801ad3-93fc-469c-95c7-d2109be3da34 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.110019 Oct 26 13:10:13.826177 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 993/2055] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 26 13:10:13 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:10:13.840218 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-05e031ac-9423-49a8-9d02-6790a1d27680 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:13.841312 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-05e031ac-9423-49a8-9d02-6790a1d27680 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: a28883a5-9f17-4514-823e-7b33a316d33c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:13.863102 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05e031ac-9423-49a8-9d02-6790a1d27680 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:13.864827 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05e031ac-9423-49a8-9d02-6790a1d27680 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:13.865793 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05e031ac-9423-49a8-9d02-6790a1d27680 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:13.866867 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05e031ac-9423-49a8-9d02-6790a1d27680 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:13.867557 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05e031ac-9423-49a8-9d02-6790a1d27680 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:13.868244 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05e031ac-9423-49a8-9d02-6790a1d27680 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:13.895412 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a4d2affc-4ef6-4cf4-9244-63e4289b871f tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:13.904213 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a4d2affc-4ef6-4cf4-9244-63e4289b871f tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1" status: 200 len: 1213 microversion: 2.1 time: 0.169474 Oct 26 13:10:13.918136 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1063/2056] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:10:13 2022] GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1 => generated 1213 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:13.929558 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-23f62ca6-fac1-455d-b7e1-96e4660f5673 tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] Calling method '.version_select at 0x7f67368ed940>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:14.384955 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-23f62ca6-fac1-455d-b7e1-96e4660f5673 tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/0b187e79-9585-45ac-a37a-66d5ee54fedb" status: 202 len: 0 microversion: 2.1 time: 0.464965 Oct 26 13:10:14.385677 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1064/2057] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 26 13:10:13 2022] DELETE /compute/v2.1/os-security-groups/0b187e79-9585-45ac-a37a-66d5ee54fedb => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:10:14.393396 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7e92e879-ac13-4aa8-8ff8-cfa0587b4a41 tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] Calling method '.version_select at 0x7f67367f4c10>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:14.411421 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-05e031ac-9423-49a8-9d02-6790a1d27680 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:14.423411 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-05e031ac-9423-49a8-9d02-6790a1d27680 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:14.425239 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-05e031ac-9423-49a8-9d02-6790a1d27680 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:14.427197 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-05e031ac-9423-49a8-9d02-6790a1d27680 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c" status: 200 len: 1548 microversion: 2.25 time: 0.598678 Oct 26 13:10:14.432139 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 994/2058] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:10:13 2022] GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c => generated 1548 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:10:14.444316 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2cceaf0f-37dc-4b1c-8f86-6a2eed4a6d9d tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:14.445272 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2cceaf0f-37dc-4b1c-8f86-6a2eed4a6d9d tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] [instance: db4409fe-6b22-41d1-8c54-c8a5222a65b4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:14.461761 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2cceaf0f-37dc-4b1c-8f86-6a2eed4a6d9d tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:14.465403 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2cceaf0f-37dc-4b1c-8f86-6a2eed4a6d9d tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:14.466498 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2cceaf0f-37dc-4b1c-8f86-6a2eed4a6d9d tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:14.467665 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2cceaf0f-37dc-4b1c-8f86-6a2eed4a6d9d tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:14.469097 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2cceaf0f-37dc-4b1c-8f86-6a2eed4a6d9d tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:14.470902 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2cceaf0f-37dc-4b1c-8f86-6a2eed4a6d9d tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:14.481257 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7e92e879-ac13-4aa8-8ff8-cfa0587b4a41 tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] 10.222.0.40 "GET /compute/v2.1/images/68273e9a-d6c8-4555-a9a3-af5f0508d770/metadata" status: 200 len: 58 microversion: 2.1 time: 0.093994 Oct 26 13:10:14.482264 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1065/2059] 10.222.0.40 () {58 vars in 1260 bytes} [Wed Oct 26 13:10:14 2022] GET /compute/v2.1/images/68273e9a-d6c8-4555-a9a3-af5f0508d770/metadata => generated 58 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:10:14.493671 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e863a9a8-9a6d-4241-bf0f-e89a98433747 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:14.515722 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.compute.server_groups [None req-e863a9a8-9a6d-4241-bf0f-e89a98433747 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Querying cell 2e5960f1-3c3d-401b-877c-fe82eb67bd3f(cell1) for 1 instances {{(pid=120598) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 26 13:10:14.516365 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e863a9a8-9a6d-4241-bf0f-e89a98433747 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:14.516854 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e863a9a8-9a6d-4241-bf0f-e89a98433747 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:14.517296 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e863a9a8-9a6d-4241-bf0f-e89a98433747 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:14.528679 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e863a9a8-9a6d-4241-bf0f-e89a98433747 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups/6a7a6fc4-6f4d-4478-978e-63a345ff4b35" status: 200 len: 184 microversion: 2.1 time: 0.045220 Oct 26 13:10:14.529818 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1066/2060] 10.222.0.40 () {58 vars in 1263 bytes} [Wed Oct 26 13:10:14 2022] GET /compute/v2.1/os-server-groups/6a7a6fc4-6f4d-4478-978e-63a345ff4b35 => generated 184 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:10:14.540444 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f09e440e-e4bf-4938-8271-91833f93b632 tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] Calling method '.version_select at 0x7f6731f57310>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:14.874228 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2cceaf0f-37dc-4b1c-8f86-6a2eed4a6d9d tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f37d1f2f0dfa49bd9b3b6bc7c86e7b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e689293a8bf44cff9b5ee773557c3e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:14.888031 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2cceaf0f-37dc-4b1c-8f86-6a2eed4a6d9d tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f37d1f2f0dfa49bd9b3b6bc7c86e7b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e689293a8bf44cff9b5ee773557c3e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:14.898329 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2cceaf0f-37dc-4b1c-8f86-6a2eed4a6d9d tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f37d1f2f0dfa49bd9b3b6bc7c86e7b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e689293a8bf44cff9b5ee773557c3e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:14.900418 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2cceaf0f-37dc-4b1c-8f86-6a2eed4a6d9d tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] 10.222.0.40 "GET /compute/v2.1/servers/db4409fe-6b22-41d1-8c54-c8a5222a65b4" status: 200 len: 1358 microversion: 2.21 time: 0.464795 Oct 26 13:10:14.900978 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 995/2061] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:10:14 2022] GET /compute/v2.1/servers/db4409fe-6b22-41d1-8c54-c8a5222a65b4 => generated 1358 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:10:14.911521 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-39fc953d-0f79-4b36-a766-e1adf60f48e4 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:14.912426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-39fc953d-0f79-4b36-a766-e1adf60f48e4 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 31d4915d-93b9-445d-aad6-4fbc96fd5326] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:14.929140 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39fc953d-0f79-4b36-a766-e1adf60f48e4 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:14.932547 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39fc953d-0f79-4b36-a766-e1adf60f48e4 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:14.933622 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39fc953d-0f79-4b36-a766-e1adf60f48e4 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:14.934988 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39fc953d-0f79-4b36-a766-e1adf60f48e4 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:14.936393 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39fc953d-0f79-4b36-a766-e1adf60f48e4 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:14.937884 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39fc953d-0f79-4b36-a766-e1adf60f48e4 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:14.969546 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f09e440e-e4bf-4938-8271-91833f93b632 tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/7eb5a36f-6100-4644-955f-4bc0fe93f9fc" status: 202 len: 0 microversion: 2.1 time: 0.438230 Oct 26 13:10:14.970212 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1067/2062] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 26 13:10:14 2022] DELETE /compute/v2.1/os-security-groups/7eb5a36f-6100-4644-955f-4bc0fe93f9fc => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:10:14.979125 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9ca0477f-fe1e-4337-8839-80c7fd096f04 tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] Action: 'update_all', calling method: .version_select at 0x7f6731f54af0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:10:15.073424 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-9ca0477f-fe1e-4337-8839-80c7fd096f04 tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] Getting quotas for project c5d2663e38e14a57be68a4fed1d4de31. Resources: dict_keys(['metadata_items']) {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:10:15.083937 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-9ca0477f-fe1e-4337-8839-80c7fd096f04 tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] Getting quotas for user 6cfc9abacc814a45a745d18f1ebc2ce2 and project c5d2663e38e14a57be68a4fed1d4de31. Resources: dict_keys(['metadata_items']) {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:10:15.148263 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-39fc953d-0f79-4b36-a766-e1adf60f48e4 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:15.158126 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-39fc953d-0f79-4b36-a766-e1adf60f48e4 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/31d4915d-93b9-445d-aad6-4fbc96fd5326" status: 200 len: 1308 microversion: 2.1 time: 0.252303 Oct 26 13:10:15.171575 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 996/2063] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:10:14 2022] GET /compute/v2.1/servers/31d4915d-93b9-445d-aad6-4fbc96fd5326 => generated 1308 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:15.171575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b5e60f2e-9b28-410e-a71d-00b118f52906 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:15.171575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b5e60f2e-9b28-410e-a71d-00b118f52906 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] [instance: baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:15.171575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b5e60f2e-9b28-410e-a71d-00b118f52906 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:15.171575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b5e60f2e-9b28-410e-a71d-00b118f52906 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:15.177123 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b5e60f2e-9b28-410e-a71d-00b118f52906 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:15.178326 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b5e60f2e-9b28-410e-a71d-00b118f52906 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:15.178995 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b5e60f2e-9b28-410e-a71d-00b118f52906 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:15.179622 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b5e60f2e-9b28-410e-a71d-00b118f52906 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:15.196503 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-b5e60f2e-9b28-410e-a71d-00b118f52906 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] HTTP exception thrown: Instance baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94 could not be found. Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b5e60f2e-9b28-410e-a71d-00b118f52906 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Request method failure captured: Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/servers/baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94 HTTP/1.1 Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTGLO2xYmb1y0aLSoU9uajO1csE8CWAgrqS4kvyZ8oQ19_WFpTOZB6SZgjpa6IPr1YmHTqANuXORrJhRLSSkTFK4xK7TcVW6FaRYCBn0T-QqfIM302rYvTNjFIHNthZKhn8VyVx0VOK3aaHOGNl8pgB7yDYJJ8yQzhg_qF8yo-jCsFM Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 7a8dfdc9c02b4cac85a12b25ccf35afd Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServerGroupTestJSON-191537919 Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7a8dfdc9c02b4cac85a12b25ccf35afd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7a8dfdc9c02b4cac85a12b25ccf35afd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7a8dfdc9c02b4cac85a12b25ccf35afd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7a8dfdc9c02b4cac85a12b25ccf35afd"}]}] Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServerGroupTestJSON-191537919 Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 7a8dfdc9c02b4cac85a12b25ccf35afd Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServerGroupTestJSON-191537919 Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServerGroupTestJSON-191537919-project Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: d933dcf6e541498daeb97cffb8bb3714 Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServerGroupTestJSON-191537919-project Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94 could not be found. Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94'} Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94 could not be found. Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:10:15.198090 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:10:15.202600 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94 could not be found. Oct 26 13:10:15.202600 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:15.202600 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:10:15.202600 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:15.202600 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:15.202600 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:10:15.202600 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:10:15.202600 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:10:15.202600 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:10:15.202600 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94 could not be found. Oct 26 13:10:15.202600 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:15.202600 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b5e60f2e-9b28-410e-a71d-00b118f52906 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Returning 404 to user: Instance baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:10:15.202600 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b5e60f2e-9b28-410e-a71d-00b118f52906 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] 10.222.0.40 "DELETE /compute/v2.1/servers/baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94" status: 404 len: 111 microversion: 2.1 time: 0.039509 Oct 26 13:10:15.203898 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 997/2064] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:10:15 2022] DELETE /compute/v2.1/servers/baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:10:15.208770 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-c27d77e1-7803-438d-b7db-b0da060433d8 req-7ca66a35-46f3-4341-918e-087b64b304f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a28883a5-9f17-4514-823e-7b33a316d33c", "name": "network-vif-deleted", "tag": "aadc618b-ef02-4624-a6f3-811fbef8dddd"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:10:15.217350 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:10:15.219291 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-c27d77e1-7803-438d-b7db-b0da060433d8 req-7ca66a35-46f3-4341-918e-087b64b304f2 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:15.220065 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-c27d77e1-7803-438d-b7db-b0da060433d8 req-7ca66a35-46f3-4341-918e-087b64b304f2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:15.220519 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-c27d77e1-7803-438d-b7db-b0da060433d8 req-7ca66a35-46f3-4341-918e-087b64b304f2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:15.234920 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-c27d77e1-7803-438d-b7db-b0da060433d8 req-7ca66a35-46f3-4341-918e-087b64b304f2 service nova] Creating event network-vif-deleted:aadc618b-ef02-4624-a6f3-811fbef8dddd for instance a28883a5-9f17-4514-823e-7b33a316d33c on n-h2-862686-1 Oct 26 13:10:15.240322 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-c27d77e1-7803-438d-b7db-b0da060433d8 req-7ca66a35-46f3-4341-918e-087b64b304f2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036144 Oct 26 13:10:15.240907 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 998/2065] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:10:15.246195 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-90383928-4312-4b61-87c0-a481e29f61a9 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:15.246929 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-90383928-4312-4b61-87c0-a481e29f61a9 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: 5a49060c-d94a-4064-8e80-ef8fe20e3ff1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:15.258984 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90383928-4312-4b61-87c0-a481e29f61a9 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:15.259478 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90383928-4312-4b61-87c0-a481e29f61a9 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:15.259914 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90383928-4312-4b61-87c0-a481e29f61a9 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:15.260615 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90383928-4312-4b61-87c0-a481e29f61a9 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:15.261065 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90383928-4312-4b61-87c0-a481e29f61a9 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:15.261516 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90383928-4312-4b61-87c0-a481e29f61a9 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:15.363224 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-90383928-4312-4b61-87c0-a481e29f61a9 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:15.384805 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-90383928-4312-4b61-87c0-a481e29f61a9 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1" status: 200 len: 1265 microversion: 2.1 time: 0.140575 Oct 26 13:10:15.386959 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 999/2066] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:10:15 2022] GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1 => generated 1265 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:15.393136 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-092542e9-54a4-4a31-987a-374cb5381685 tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] Calling method '.version_select at 0x7f67320f0d30>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:15.465963 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9ca0477f-fe1e-4337-8839-80c7fd096f04 tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] 10.222.0.40 "PUT /compute/v2.1/images/68273e9a-d6c8-4555-a9a3-af5f0508d770/metadata" status: 200 len: 61 microversion: 2.1 time: 0.493466 Oct 26 13:10:15.466693 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1068/2067] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 26 13:10:14 2022] PUT /compute/v2.1/images/68273e9a-d6c8-4555-a9a3-af5f0508d770/metadata => generated 61 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:10:15.472774 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-122f84ae-fbe0-4c1c-b0dd-a6fb7f7fcfca req-73aef0f0-65ea-46ee-a4a0-ca1fb8138ec2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31d4915d-93b9-445d-aad6-4fbc96fd5326", "name": "network-vif-plugged", "status": "completed", "tag": "3438b228-4d60-45ce-9603-e5edd9a6df9a"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:10:15.510750 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-122f84ae-fbe0-4c1c-b0dd-a6fb7f7fcfca req-73aef0f0-65ea-46ee-a4a0-ca1fb8138ec2 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:15.511622 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-122f84ae-fbe0-4c1c-b0dd-a6fb7f7fcfca req-73aef0f0-65ea-46ee-a4a0-ca1fb8138ec2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:15.512801 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-122f84ae-fbe0-4c1c-b0dd-a6fb7f7fcfca req-73aef0f0-65ea-46ee-a4a0-ca1fb8138ec2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:15.527528 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-122f84ae-fbe0-4c1c-b0dd-a6fb7f7fcfca req-73aef0f0-65ea-46ee-a4a0-ca1fb8138ec2 service nova] Creating event network-vif-plugged:3438b228-4d60-45ce-9603-e5edd9a6df9a for instance 31d4915d-93b9-445d-aad6-4fbc96fd5326 on n-h1-862686-1 Oct 26 13:10:15.533707 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-122f84ae-fbe0-4c1c-b0dd-a6fb7f7fcfca req-73aef0f0-65ea-46ee-a4a0-ca1fb8138ec2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065160 Oct 26 13:10:15.534759 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1069/2068] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:10:15.540918 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-19b6d5f2-5574-47a4-9396-1361b3086245 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:15.542353 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-19b6d5f2-5574-47a4-9396-1361b3086245 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] [instance: baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:15.551233 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-19b6d5f2-5574-47a4-9396-1361b3086245 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:15.552446 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-19b6d5f2-5574-47a4-9396-1361b3086245 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:15.553336 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-19b6d5f2-5574-47a4-9396-1361b3086245 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:15.554276 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-19b6d5f2-5574-47a4-9396-1361b3086245 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:15.554935 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-19b6d5f2-5574-47a4-9396-1361b3086245 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:15.555648 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-19b6d5f2-5574-47a4-9396-1361b3086245 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:15.576801 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:10:15.578582 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-19b6d5f2-5574-47a4-9396-1361b3086245 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] HTTP exception thrown: Instance baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94 could not be found. Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-19b6d5f2-5574-47a4-9396-1361b3086245 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Request method failure captured: Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94 HTTP/1.1 Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTGLO2xYmb1y0aLSoU9uajO1csE8CWAgrqS4kvyZ8oQ19_WFpTOZB6SZgjpa6IPr1YmHTqANuXORrJhRLSSkTFK4xK7TcVW6FaRYCBn0T-QqfIM302rYvTNjFIHNthZKhn8VyVx0VOK3aaHOGNl8pgB7yDYJJ8yQzhg_qF8yo-jCsFM Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 7a8dfdc9c02b4cac85a12b25ccf35afd Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServerGroupTestJSON-191537919 Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7a8dfdc9c02b4cac85a12b25ccf35afd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7a8dfdc9c02b4cac85a12b25ccf35afd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7a8dfdc9c02b4cac85a12b25ccf35afd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7a8dfdc9c02b4cac85a12b25ccf35afd"}]}] Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServerGroupTestJSON-191537919 Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 7a8dfdc9c02b4cac85a12b25ccf35afd Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServerGroupTestJSON-191537919 Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServerGroupTestJSON-191537919-project Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: d933dcf6e541498daeb97cffb8bb3714 Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServerGroupTestJSON-191537919-project Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94 could not be found. Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94'} Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94 could not be found. Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94 could not be found. Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:10:15.581363 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:10:15.588350 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:15.588350 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:10:15.588350 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:10:15.588350 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:10:15.588350 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:10:15.588350 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94 could not be found. Oct 26 13:10:15.588350 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:10:15.588350 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-19b6d5f2-5574-47a4-9396-1361b3086245 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Returning 404 to user: Instance baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:10:15.588350 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-19b6d5f2-5574-47a4-9396-1361b3086245 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] 10.222.0.40 "GET /compute/v2.1/servers/baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94" status: 404 len: 111 microversion: 2.1 time: 0.046962 Oct 26 13:10:15.588350 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1070/2069] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:10:15 2022] GET /compute/v2.1/servers/baf2c4c7-0b46-4a70-89d7-d4f63e2f5c94 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:10:15.598596 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d8c02023-de8f-4489-b682-e228c7139e2d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:15.599438 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d8c02023-de8f-4489-b682-e228c7139e2d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: a28883a5-9f17-4514-823e-7b33a316d33c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:15.606362 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8c02023-de8f-4489-b682-e228c7139e2d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:15.606931 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8c02023-de8f-4489-b682-e228c7139e2d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:15.607383 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8c02023-de8f-4489-b682-e228c7139e2d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:15.608096 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8c02023-de8f-4489-b682-e228c7139e2d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:15.608551 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8c02023-de8f-4489-b682-e228c7139e2d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:15.608992 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8c02023-de8f-4489-b682-e228c7139e2d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:15.651249 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8c02023-de8f-4489-b682-e228c7139e2d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:15.657913 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8c02023-de8f-4489-b682-e228c7139e2d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:15.658405 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8c02023-de8f-4489-b682-e228c7139e2d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:15.659062 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-d8c02023-de8f-4489-b682-e228c7139e2d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lazy-loading 'fault' on Instance uuid a28883a5-9f17-4514-823e-7b33a316d33c {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:10:15.719563 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d8c02023-de8f-4489-b682-e228c7139e2d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:15.733445 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d8c02023-de8f-4489-b682-e228c7139e2d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:15.735023 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d8c02023-de8f-4489-b682-e228c7139e2d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:15.736238 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d8c02023-de8f-4489-b682-e228c7139e2d tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c" status: 200 len: 1352 microversion: 2.25 time: 0.151158 Oct 26 13:10:15.736810 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1071/2070] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:10:15 2022] GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c => generated 1352 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:10:15.744618 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e5e78f03-6259-4756-a352-90f6fa09b83b tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] Action: 'create', calling method: .version_select at 0x7f6731f57ca0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:10:15.817759 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-e5e78f03-6259-4756-a352-90f6fa09b83b tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] Getting quotas for project c5d2663e38e14a57be68a4fed1d4de31. Resources: dict_keys(['metadata_items']) {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:10:15.828101 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-e5e78f03-6259-4756-a352-90f6fa09b83b tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] Getting quotas for user 6cfc9abacc814a45a745d18f1ebc2ce2 and project c5d2663e38e14a57be68a4fed1d4de31. Resources: dict_keys(['metadata_items']) {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:10:16.244962 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e5e78f03-6259-4756-a352-90f6fa09b83b tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] 10.222.0.40 "POST /compute/v2.1/images/68273e9a-d6c8-4555-a9a3-af5f0508d770/metadata" status: 200 len: 85 microversion: 2.1 time: 0.504130 Oct 26 13:10:16.245865 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1072/2071] 10.222.0.40 () {60 vars in 1281 bytes} [Wed Oct 26 13:10:15 2022] POST /compute/v2.1/images/68273e9a-d6c8-4555-a9a3-af5f0508d770/metadata => generated 85 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:10:16.250624 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8134772c-8cc0-4744-9d72-0fff68988137 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "42fc241e-14d7-47f8-9b51-9a7d817cae54"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:10:16.253184 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8134772c-8cc0-4744-9d72-0fff68988137 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: 14fcf77a-99ed-4d7b-889a-19da49d9e4b4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:16.260382 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8134772c-8cc0-4744-9d72-0fff68988137 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:16.261156 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8134772c-8cc0-4744-9d72-0fff68988137 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:16.261809 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8134772c-8cc0-4744-9d72-0fff68988137 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:16.262740 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8134772c-8cc0-4744-9d72-0fff68988137 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:16.263399 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8134772c-8cc0-4744-9d72-0fff68988137 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:16.263983 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8134772c-8cc0-4744-9d72-0fff68988137 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:16.273441 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-092542e9-54a4-4a31-987a-374cb5381685 tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/e4740dcd-c598-417a-ae36-e07a4a71537b" status: 202 len: 0 microversion: 2.1 time: 0.884834 Oct 26 13:10:16.274134 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1000/2072] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 26 13:10:15 2022] DELETE /compute/v2.1/os-security-groups/e4740dcd-c598-417a-ae36-e07a4a71537b => generated 0 bytes in 886 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:10:16.279022 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a05a495a-d49c-4c11-b3b1-5d1546fbc225 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:16.298151 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-a05a495a-d49c-4c11-b3b1-5d1546fbc225 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] HTTP exception thrown: Instance group 929b99f5-601a-46dc-ad28-2cea5bd675d5 could not be found. Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a05a495a-d49c-4c11-b3b1-5d1546fbc225 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Request method failure captured: Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/os-server-groups/929b99f5-601a-46dc-ad28-2cea5bd675d5 HTTP/1.1 Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTGLO2xYmb1y0aLSoU9uajO1csE8CWAgrqS4kvyZ8oQ19_WFpTOZB6SZgjpa6IPr1YmHTqANuXORrJhRLSSkTFK4xK7TcVW6FaRYCBn0T-QqfIM302rYvTNjFIHNthZKhn8VyVx0VOK3aaHOGNl8pgB7yDYJJ8yQzhg_qF8yo-jCsFM Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 7a8dfdc9c02b4cac85a12b25ccf35afd Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServerGroupTestJSON-191537919 Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7a8dfdc9c02b4cac85a12b25ccf35afd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7a8dfdc9c02b4cac85a12b25ccf35afd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7a8dfdc9c02b4cac85a12b25ccf35afd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7a8dfdc9c02b4cac85a12b25ccf35afd"}]}] Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServerGroupTestJSON-191537919 Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 7a8dfdc9c02b4cac85a12b25ccf35afd Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServerGroupTestJSON-191537919 Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServerGroupTestJSON-191537919-project Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: d933dcf6e541498daeb97cffb8bb3714 Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServerGroupTestJSON-191537919-project Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance group 929b99f5-601a-46dc-ad28-2cea5bd675d5 could not be found. Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '929b99f5-601a-46dc-ad28-2cea5bd675d5'} Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 929b99f5-601a-46dc-ad28-2cea5bd675d5 could not be found. Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 929b99f5-601a-46dc-ad28-2cea5bd675d5 could not be found. Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:16.313850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:16.319378 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:10:16.319378 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:10:16.319378 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:10:16.319378 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:10:16.319378 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 929b99f5-601a-46dc-ad28-2cea5bd675d5 could not be found. Oct 26 13:10:16.319378 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:16.319378 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a05a495a-d49c-4c11-b3b1-5d1546fbc225 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Returning 404 to user: Instance group 929b99f5-601a-46dc-ad28-2cea5bd675d5 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:10:16.320256 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a05a495a-d49c-4c11-b3b1-5d1546fbc225 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/929b99f5-601a-46dc-ad28-2cea5bd675d5" status: 404 len: 117 microversion: 2.1 time: 0.044387 Oct 26 13:10:16.323633 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1001/2073] 10.222.0.40 () {58 vars in 1266 bytes} [Wed Oct 26 13:10:16 2022] DELETE /compute/v2.1/os-server-groups/929b99f5-601a-46dc-ad28-2cea5bd675d5 => generated 117 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:10:16.331280 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7450dd34-1bdc-4717-be89-2a69c21ee9e1 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:16.332635 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7450dd34-1bdc-4717-be89-2a69c21ee9e1 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] [instance: db4409fe-6b22-41d1-8c54-c8a5222a65b4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:16.344077 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7450dd34-1bdc-4717-be89-2a69c21ee9e1 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:16.344579 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7450dd34-1bdc-4717-be89-2a69c21ee9e1 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:16.345013 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7450dd34-1bdc-4717-be89-2a69c21ee9e1 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:16.346745 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7450dd34-1bdc-4717-be89-2a69c21ee9e1 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:16.347351 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7450dd34-1bdc-4717-be89-2a69c21ee9e1 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:16.348533 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7450dd34-1bdc-4717-be89-2a69c21ee9e1 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:16.594736 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7450dd34-1bdc-4717-be89-2a69c21ee9e1 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f37d1f2f0dfa49bd9b3b6bc7c86e7b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e689293a8bf44cff9b5ee773557c3e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:16.607099 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7450dd34-1bdc-4717-be89-2a69c21ee9e1 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f37d1f2f0dfa49bd9b3b6bc7c86e7b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e689293a8bf44cff9b5ee773557c3e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:16.608809 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7450dd34-1bdc-4717-be89-2a69c21ee9e1 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f37d1f2f0dfa49bd9b3b6bc7c86e7b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e689293a8bf44cff9b5ee773557c3e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:16.610239 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7450dd34-1bdc-4717-be89-2a69c21ee9e1 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] 10.222.0.40 "GET /compute/v2.1/servers/db4409fe-6b22-41d1-8c54-c8a5222a65b4" status: 200 len: 1551 microversion: 2.21 time: 0.285167 Oct 26 13:10:16.610795 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1002/2074] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:10:16 2022] GET /compute/v2.1/servers/db4409fe-6b22-41d1-8c54-c8a5222a65b4 => generated 1551 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:10:16.615753 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8c1e0c85-1c45-4cd0-9c4a-3149b13728f3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:16.616366 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8c1e0c85-1c45-4cd0-9c4a-3149b13728f3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 31d4915d-93b9-445d-aad6-4fbc96fd5326] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:16.622312 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8c1e0c85-1c45-4cd0-9c4a-3149b13728f3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:16.623007 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8c1e0c85-1c45-4cd0-9c4a-3149b13728f3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:16.623626 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8c1e0c85-1c45-4cd0-9c4a-3149b13728f3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:16.624588 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8c1e0c85-1c45-4cd0-9c4a-3149b13728f3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:16.625195 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8c1e0c85-1c45-4cd0-9c4a-3149b13728f3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:16.625834 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8c1e0c85-1c45-4cd0-9c4a-3149b13728f3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:16.703614 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8134772c-8cc0-4744-9d72-0fff68988137 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "POST /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.456615 Oct 26 13:10:16.714399 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1073/2075] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Oct 26 13:10:16 2022] POST /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4/os-volume_attachments => generated 194 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:10:16.714861 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e425f8e5-7ff4-41af-8d2d-50fdd3206665 tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] Calling method '.version_select at 0x7f6731f92ee0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:16.776993 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e425f8e5-7ff4-41af-8d2d-50fdd3206665 tempest-ImagesMetadataTestJSON-1294342189 tempest-ImagesMetadataTestJSON-1294342189-project] 10.222.0.40 "GET /compute/v2.1/images/68273e9a-d6c8-4555-a9a3-af5f0508d770/metadata" status: 200 len: 85 microversion: 2.1 time: 0.070317 Oct 26 13:10:16.777699 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1074/2076] 10.222.0.40 () {58 vars in 1260 bytes} [Wed Oct 26 13:10:16 2022] GET /compute/v2.1/images/68273e9a-d6c8-4555-a9a3-af5f0508d770/metadata => generated 85 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:10:16.783798 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6ad8b6a5-8259-45ed-8dc9-6417aacae981 tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] Calling method '.version_select at 0x7f6731f57d30>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:16.859797 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8c1e0c85-1c45-4cd0-9c4a-3149b13728f3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:16.873009 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8c1e0c85-1c45-4cd0-9c4a-3149b13728f3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/31d4915d-93b9-445d-aad6-4fbc96fd5326" status: 200 len: 1308 microversion: 2.1 time: 0.260797 Oct 26 13:10:16.889953 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1003/2077] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:10:16 2022] GET /compute/v2.1/servers/31d4915d-93b9-445d-aad6-4fbc96fd5326 => generated 1308 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:16.896484 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9893772d-ec61-4a38-8b53-8c0b0683c835 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:16.903760 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-9893772d-ec61-4a38-8b53-8c0b0683c835 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] HTTP exception thrown: Instance group db318960-6b03-4f04-9002-0e4eb1d40426 could not be found. Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9893772d-ec61-4a38-8b53-8c0b0683c835 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Request method failure captured: Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/os-server-groups/db318960-6b03-4f04-9002-0e4eb1d40426 HTTP/1.1 Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTGLO2xYmb1y0aLSoU9uajO1csE8CWAgrqS4kvyZ8oQ19_WFpTOZB6SZgjpa6IPr1YmHTqANuXORrJhRLSSkTFK4xK7TcVW6FaRYCBn0T-QqfIM302rYvTNjFIHNthZKhn8VyVx0VOK3aaHOGNl8pgB7yDYJJ8yQzhg_qF8yo-jCsFM Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 7a8dfdc9c02b4cac85a12b25ccf35afd Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServerGroupTestJSON-191537919 Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7a8dfdc9c02b4cac85a12b25ccf35afd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7a8dfdc9c02b4cac85a12b25ccf35afd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7a8dfdc9c02b4cac85a12b25ccf35afd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7a8dfdc9c02b4cac85a12b25ccf35afd"}]}] Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServerGroupTestJSON-191537919 Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 7a8dfdc9c02b4cac85a12b25ccf35afd Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServerGroupTestJSON-191537919 Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServerGroupTestJSON-191537919-project Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: d933dcf6e541498daeb97cffb8bb3714 Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServerGroupTestJSON-191537919-project Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance group db318960-6b03-4f04-9002-0e4eb1d40426 could not be found. Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'db318960-6b03-4f04-9002-0e4eb1d40426'} Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group db318960-6b03-4f04-9002-0e4eb1d40426 could not be found. Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group db318960-6b03-4f04-9002-0e4eb1d40426 could not be found. Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:16.905526 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:16.910625 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:10:16.910625 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:10:16.910625 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:10:16.910625 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:10:16.910625 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group db318960-6b03-4f04-9002-0e4eb1d40426 could not be found. Oct 26 13:10:16.910625 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:16.911958 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9893772d-ec61-4a38-8b53-8c0b0683c835 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Returning 404 to user: Instance group db318960-6b03-4f04-9002-0e4eb1d40426 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:10:16.913022 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9893772d-ec61-4a38-8b53-8c0b0683c835 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/db318960-6b03-4f04-9002-0e4eb1d40426" status: 404 len: 117 microversion: 2.1 time: 0.021291 Oct 26 13:10:16.913602 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1004/2078] 10.222.0.40 () {58 vars in 1266 bytes} [Wed Oct 26 13:10:16 2022] DELETE /compute/v2.1/os-server-groups/db318960-6b03-4f04-9002-0e4eb1d40426 => generated 117 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:10:16.919728 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8dea31c1-ba48-46df-856f-13479f9ce0a9 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:16.920500 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8dea31c1-ba48-46df-856f-13479f9ce0a9 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: 5a49060c-d94a-4064-8e80-ef8fe20e3ff1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:16.929140 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8dea31c1-ba48-46df-856f-13479f9ce0a9 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:16.929693 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8dea31c1-ba48-46df-856f-13479f9ce0a9 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:16.930131 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8dea31c1-ba48-46df-856f-13479f9ce0a9 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:16.930834 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8dea31c1-ba48-46df-856f-13479f9ce0a9 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:16.931284 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8dea31c1-ba48-46df-856f-13479f9ce0a9 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:16.931698 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8dea31c1-ba48-46df-856f-13479f9ce0a9 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:17.030583 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6ad8b6a5-8259-45ed-8dc9-6417aacae981 tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/27f99c73-ad94-4f22-8d6a-ed80c20663dd" status: 202 len: 0 microversion: 2.1 time: 0.251311 Oct 26 13:10:17.031731 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1075/2079] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 26 13:10:16 2022] DELETE /compute/v2.1/os-security-groups/27f99c73-ad94-4f22-8d6a-ed80c20663dd => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:10:17.050464 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-68694763-9781-4f3c-bf13-6d1a689901a0 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:17.053040 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-68694763-9781-4f3c-bf13-6d1a689901a0 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] [instance: db4409fe-6b22-41d1-8c54-c8a5222a65b4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:17.103100 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68694763-9781-4f3c-bf13-6d1a689901a0 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:17.103702 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68694763-9781-4f3c-bf13-6d1a689901a0 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:17.104860 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68694763-9781-4f3c-bf13-6d1a689901a0 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:17.105991 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68694763-9781-4f3c-bf13-6d1a689901a0 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:17.106697 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68694763-9781-4f3c-bf13-6d1a689901a0 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:17.107437 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68694763-9781-4f3c-bf13-6d1a689901a0 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:17.162067 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-68694763-9781-4f3c-bf13-6d1a689901a0 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] [instance: db4409fe-6b22-41d1-8c54-c8a5222a65b4] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:10:17.202276 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8dea31c1-ba48-46df-856f-13479f9ce0a9 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:17.212935 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8dea31c1-ba48-46df-856f-13479f9ce0a9 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1" status: 200 len: 1313 microversion: 2.1 time: 0.297863 Oct 26 13:10:17.214202 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1005/2080] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:10:16 2022] GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1 => generated 1313 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:17.230413 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-633af23d-5994-4d4e-b681-badf8756ab86 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:17.231380 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-633af23d-5994-4d4e-b681-badf8756ab86 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: a28883a5-9f17-4514-823e-7b33a316d33c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:17.241360 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-633af23d-5994-4d4e-b681-badf8756ab86 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:17.241897 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-633af23d-5994-4d4e-b681-badf8756ab86 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:17.242363 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-633af23d-5994-4d4e-b681-badf8756ab86 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:17.243172 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-633af23d-5994-4d4e-b681-badf8756ab86 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:17.243703 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-633af23d-5994-4d4e-b681-badf8756ab86 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:17.244176 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-633af23d-5994-4d4e-b681-badf8756ab86 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:17.266679 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-633af23d-5994-4d4e-b681-badf8756ab86 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] HTTP exception thrown: Instance a28883a5-9f17-4514-823e-7b33a316d33c could not be found. Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-633af23d-5994-4d4e-b681-badf8756ab86 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Request method failure captured: Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c HTTP/1.1 Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTAVYR0OVZ4Dphw165KOe64tVOSe2bRwO7lZpFQNjQsUumeonFRg55gQeR9IdnQvsDzhcBe3pVL-kelGNhzAXdpAoseAYNY9_pDGpAcVec-gDgRy0K7LaBXNjLW0ljiFS-rO59d5NadiTJVmzCzjaWlC4EdPCUsaZaUutubLIFWnPUc Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: X-Openstack-Nova-Api-Version: 2.25 Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 2f7b9165f0ff4c06a5d154ea24b17bac Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1206006244 Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2f7b9165f0ff4c06a5d154ea24b17bac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2f7b9165f0ff4c06a5d154ea24b17bac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2f7b9165f0ff4c06a5d154ea24b17bac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2f7b9165f0ff4c06a5d154ea24b17bac"}]}] Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1206006244 Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 2f7b9165f0ff4c06a5d154ea24b17bac Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1206006244 Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-LiveAutoBlockMigrationV225Test-1206006244-project Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 27f4a513ca654b0abf9f972e07270c10 Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1206006244-project Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance a28883a5-9f17-4514-823e-7b33a316d33c could not be found. Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'a28883a5-9f17-4514-823e-7b33a316d33c'} Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a28883a5-9f17-4514-823e-7b33a316d33c could not be found. Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a28883a5-9f17-4514-823e-7b33a316d33c could not be found. Oct 26 13:10:17.270810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:17.276344 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:10:17.276344 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:17.276344 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:17.276344 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:10:17.276344 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:10:17.276344 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:10:17.276344 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:10:17.276344 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a28883a5-9f17-4514-823e-7b33a316d33c could not be found. Oct 26 13:10:17.276344 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:17.279182 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-633af23d-5994-4d4e-b681-badf8756ab86 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Returning 404 to user: Instance a28883a5-9f17-4514-823e-7b33a316d33c could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:10:17.280270 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-633af23d-5994-4d4e-b681-badf8756ab86 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c" status: 404 len: 111 microversion: 2.25 time: 0.064857 Oct 26 13:10:17.280974 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1006/2081] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:10:17 2022] GET /compute/v2.1/servers/a28883a5-9f17-4514-823e-7b33a316d33c => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:10:17.300290 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0cc5cf12-4154-4da7-a0f0-5d0e682eeec7 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:17.314370 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-0cc5cf12-4154-4da7-a0f0-5d0e682eeec7 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] HTTP exception thrown: Instance group 6c8d91c6-f8e6-4d0c-8217-b5b43aac1700 could not be found. Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0cc5cf12-4154-4da7-a0f0-5d0e682eeec7 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Request method failure captured: Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/os-server-groups/6c8d91c6-f8e6-4d0c-8217-b5b43aac1700 HTTP/1.1 Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTGLO2xYmb1y0aLSoU9uajO1csE8CWAgrqS4kvyZ8oQ19_WFpTOZB6SZgjpa6IPr1YmHTqANuXORrJhRLSSkTFK4xK7TcVW6FaRYCBn0T-QqfIM302rYvTNjFIHNthZKhn8VyVx0VOK3aaHOGNl8pgB7yDYJJ8yQzhg_qF8yo-jCsFM Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 7a8dfdc9c02b4cac85a12b25ccf35afd Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServerGroupTestJSON-191537919 Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7a8dfdc9c02b4cac85a12b25ccf35afd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7a8dfdc9c02b4cac85a12b25ccf35afd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7a8dfdc9c02b4cac85a12b25ccf35afd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7a8dfdc9c02b4cac85a12b25ccf35afd"}]}] Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServerGroupTestJSON-191537919 Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 7a8dfdc9c02b4cac85a12b25ccf35afd Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServerGroupTestJSON-191537919 Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServerGroupTestJSON-191537919-project Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: d933dcf6e541498daeb97cffb8bb3714 Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServerGroupTestJSON-191537919-project Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance group 6c8d91c6-f8e6-4d0c-8217-b5b43aac1700 could not be found. Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '6c8d91c6-f8e6-4d0c-8217-b5b43aac1700'} Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 6c8d91c6-f8e6-4d0c-8217-b5b43aac1700 could not be found. Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 6c8d91c6-f8e6-4d0c-8217-b5b43aac1700 could not be found. Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:17.316830 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:17.321810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:10:17.321810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:10:17.321810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:10:17.321810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:10:17.321810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 6c8d91c6-f8e6-4d0c-8217-b5b43aac1700 could not be found. Oct 26 13:10:17.321810 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:17.326804 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0cc5cf12-4154-4da7-a0f0-5d0e682eeec7 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Returning 404 to user: Instance group 6c8d91c6-f8e6-4d0c-8217-b5b43aac1700 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:10:17.330198 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0cc5cf12-4154-4da7-a0f0-5d0e682eeec7 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/6c8d91c6-f8e6-4d0c-8217-b5b43aac1700" status: 404 len: 117 microversion: 2.1 time: 0.046599 Oct 26 13:10:17.334901 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1007/2082] 10.222.0.40 () {58 vars in 1266 bytes} [Wed Oct 26 13:10:17 2022] DELETE /compute/v2.1/os-server-groups/6c8d91c6-f8e6-4d0c-8217-b5b43aac1700 => generated 117 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:10:17.341240 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a8ece48b-d0c2-466e-bc1b-da235a0a70b7 tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] Calling method '.version_select at 0x7f67320be310>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:17.368283 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-68694763-9781-4f3c-bf13-6d1a689901a0 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] 10.222.0.40 "DELETE /compute/v2.1/servers/db4409fe-6b22-41d1-8c54-c8a5222a65b4" status: 204 len: 0 microversion: 2.21 time: 0.333779 Oct 26 13:10:17.369875 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1076/2083] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 26 13:10:17 2022] DELETE /compute/v2.1/servers/db4409fe-6b22-41d1-8c54-c8a5222a65b4 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 13:10:17.383506 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9ce0c5e8-003b-4ae1-be6a-e369560150bb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:17.387288 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9ce0c5e8-003b-4ae1-be6a-e369560150bb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3e395c36-3e81-4ca3-ab5c-a034d92f8288] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:17.400543 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9ce0c5e8-003b-4ae1-be6a-e369560150bb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:17.406969 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9ce0c5e8-003b-4ae1-be6a-e369560150bb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:17.406969 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9ce0c5e8-003b-4ae1-be6a-e369560150bb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:17.406969 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9ce0c5e8-003b-4ae1-be6a-e369560150bb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:17.406969 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9ce0c5e8-003b-4ae1-be6a-e369560150bb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:17.408932 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9ce0c5e8-003b-4ae1-be6a-e369560150bb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:17.471328 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9ce0c5e8-003b-4ae1-be6a-e369560150bb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3e395c36-3e81-4ca3-ab5c-a034d92f8288] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:10:17.619125 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9ce0c5e8-003b-4ae1-be6a-e369560150bb tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288" status: 204 len: 0 microversion: 2.25 time: 0.245484 Oct 26 13:10:17.621795 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1077/2084] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 26 13:10:17 2022] DELETE /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 13:10:17.630811 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7761a3d9-ce63-4751-801a-34ca6c979e1e tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:17.639089 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-7761a3d9-ce63-4751-801a-34ca6c979e1e tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] HTTP exception thrown: Instance group 7167619a-8b0c-4312-9157-4c0fb5812485 could not be found. Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7761a3d9-ce63-4751-801a-34ca6c979e1e tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Request method failure captured: Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: request: DELETE /compute/v2.1/os-server-groups/7167619a-8b0c-4312-9157-4c0fb5812485 HTTP/1.1 Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTGLO2xYmb1y0aLSoU9uajO1csE8CWAgrqS4kvyZ8oQ19_WFpTOZB6SZgjpa6IPr1YmHTqANuXORrJhRLSSkTFK4xK7TcVW6FaRYCBn0T-QqfIM302rYvTNjFIHNthZKhn8VyVx0VOK3aaHOGNl8pgB7yDYJJ8yQzhg_qF8yo-jCsFM Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 7a8dfdc9c02b4cac85a12b25ccf35afd Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServerGroupTestJSON-191537919 Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7a8dfdc9c02b4cac85a12b25ccf35afd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7a8dfdc9c02b4cac85a12b25ccf35afd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7a8dfdc9c02b4cac85a12b25ccf35afd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7a8dfdc9c02b4cac85a12b25ccf35afd"}]}] Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServerGroupTestJSON-191537919 Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 7a8dfdc9c02b4cac85a12b25ccf35afd Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServerGroupTestJSON-191537919 Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServerGroupTestJSON-191537919-project Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: d933dcf6e541498daeb97cffb8bb3714 Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServerGroupTestJSON-191537919-project Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance group 7167619a-8b0c-4312-9157-4c0fb5812485 could not be found. Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '7167619a-8b0c-4312-9157-4c0fb5812485'} Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 7167619a-8b0c-4312-9157-4c0fb5812485 could not be found. Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 7167619a-8b0c-4312-9157-4c0fb5812485 could not be found. Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:10:17.642246 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:17.648780 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:10:17.648780 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:10:17.648780 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:10:17.648780 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:10:17.648780 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 7167619a-8b0c-4312-9157-4c0fb5812485 could not be found. Oct 26 13:10:17.648780 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:10:17.650769 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7761a3d9-ce63-4751-801a-34ca6c979e1e tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Returning 404 to user: Instance group 7167619a-8b0c-4312-9157-4c0fb5812485 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:10:17.652097 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7761a3d9-ce63-4751-801a-34ca6c979e1e tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/7167619a-8b0c-4312-9157-4c0fb5812485" status: 404 len: 117 microversion: 2.1 time: 0.028489 Oct 26 13:10:17.656095 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1078/2085] 10.222.0.40 () {58 vars in 1266 bytes} [Wed Oct 26 13:10:17 2022] DELETE /compute/v2.1/os-server-groups/7167619a-8b0c-4312-9157-4c0fb5812485 => generated 117 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:10:17.662230 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b5dea545-e9f1-4451-9d76-43898bd6965a tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:17.663219 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b5dea545-e9f1-4451-9d76-43898bd6965a tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] [instance: db4409fe-6b22-41d1-8c54-c8a5222a65b4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:17.673229 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5dea545-e9f1-4451-9d76-43898bd6965a tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:17.674083 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5dea545-e9f1-4451-9d76-43898bd6965a tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:17.674705 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5dea545-e9f1-4451-9d76-43898bd6965a tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:17.676397 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5dea545-e9f1-4451-9d76-43898bd6965a tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:17.676900 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5dea545-e9f1-4451-9d76-43898bd6965a tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:17.677577 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5dea545-e9f1-4451-9d76-43898bd6965a tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:17.802398 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a8ece48b-d0c2-466e-bc1b-da235a0a70b7 tempest-SecurityGroupRulesTestJSON-1927319584 tempest-SecurityGroupRulesTestJSON-1927319584-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/677f7826-136d-4049-941d-8cfbfaac3de6" status: 202 len: 0 microversion: 2.1 time: 0.466115 Oct 26 13:10:17.802988 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1008/2086] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 26 13:10:17 2022] DELETE /compute/v2.1/os-security-groups/677f7826-136d-4049-941d-8cfbfaac3de6 => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:10:17.807999 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7d6ac033-107e-4e88-a1a4-9512d1c5ede0 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:17.808609 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7d6ac033-107e-4e88-a1a4-9512d1c5ede0 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3e395c36-3e81-4ca3-ab5c-a034d92f8288] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:17.825405 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d6ac033-107e-4e88-a1a4-9512d1c5ede0 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:17.827571 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d6ac033-107e-4e88-a1a4-9512d1c5ede0 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:17.828026 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d6ac033-107e-4e88-a1a4-9512d1c5ede0 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:17.828753 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d6ac033-107e-4e88-a1a4-9512d1c5ede0 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:17.829220 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d6ac033-107e-4e88-a1a4-9512d1c5ede0 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:17.829698 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d6ac033-107e-4e88-a1a4-9512d1c5ede0 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:17.905334 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b5dea545-e9f1-4451-9d76-43898bd6965a tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f37d1f2f0dfa49bd9b3b6bc7c86e7b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e689293a8bf44cff9b5ee773557c3e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:17.914174 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b5dea545-e9f1-4451-9d76-43898bd6965a tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f37d1f2f0dfa49bd9b3b6bc7c86e7b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e689293a8bf44cff9b5ee773557c3e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:17.915804 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b5dea545-e9f1-4451-9d76-43898bd6965a tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f37d1f2f0dfa49bd9b3b6bc7c86e7b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e689293a8bf44cff9b5ee773557c3e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:17.916995 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b5dea545-e9f1-4451-9d76-43898bd6965a tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] 10.222.0.40 "GET /compute/v2.1/servers/db4409fe-6b22-41d1-8c54-c8a5222a65b4" status: 200 len: 1557 microversion: 2.21 time: 0.259740 Oct 26 13:10:17.917580 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1079/2087] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:10:17 2022] GET /compute/v2.1/servers/db4409fe-6b22-41d1-8c54-c8a5222a65b4 => generated 1557 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:10:17.940927 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ac119598-24d8-4e90-ac28-8a24c027cf31 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:17.985731 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ac119598-24d8-4e90-ac28-8a24c027cf31 tempest-ServerGroupTestJSON-191537919 tempest-ServerGroupTestJSON-191537919-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/6a7a6fc4-6f4d-4478-978e-63a345ff4b35" status: 204 len: 0 microversion: 2.1 time: 0.049696 Oct 26 13:10:17.986992 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1080/2088] 10.222.0.40 () {58 vars in 1266 bytes} [Wed Oct 26 13:10:17 2022] DELETE /compute/v2.1/os-server-groups/6a7a6fc4-6f4d-4478-978e-63a345ff4b35 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:10:17.994321 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ab946704-3c44-4bf3-bf72-e7e9bfb1eeff tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:17.995280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ab946704-3c44-4bf3-bf72-e7e9bfb1eeff tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 31d4915d-93b9-445d-aad6-4fbc96fd5326] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:18.008425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab946704-3c44-4bf3-bf72-e7e9bfb1eeff tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:18.009265 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab946704-3c44-4bf3-bf72-e7e9bfb1eeff tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:18.009934 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab946704-3c44-4bf3-bf72-e7e9bfb1eeff tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:18.010917 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab946704-3c44-4bf3-bf72-e7e9bfb1eeff tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:18.011945 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab946704-3c44-4bf3-bf72-e7e9bfb1eeff tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:18.012651 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab946704-3c44-4bf3-bf72-e7e9bfb1eeff tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:18.277569 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ab946704-3c44-4bf3-bf72-e7e9bfb1eeff tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:18.287601 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ab946704-3c44-4bf3-bf72-e7e9bfb1eeff tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/31d4915d-93b9-445d-aad6-4fbc96fd5326" status: 200 len: 1489 microversion: 2.1 time: 0.299244 Oct 26 13:10:18.291049 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1081/2089] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:10:17 2022] GET /compute/v2.1/servers/31d4915d-93b9-445d-aad6-4fbc96fd5326 => generated 1489 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:18.293735 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7d6ac033-107e-4e88-a1a4-9512d1c5ede0 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:18.303160 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7d6ac033-107e-4e88-a1a4-9512d1c5ede0 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:18.304798 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7d6ac033-107e-4e88-a1a4-9512d1c5ede0 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:18.307484 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7d6ac033-107e-4e88-a1a4-9512d1c5ede0 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288" status: 200 len: 1562 microversion: 2.25 time: 0.502337 Oct 26 13:10:18.308308 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1009/2090] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:10:17 2022] GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288 => generated 1562 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:10:18.310224 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b50232f4-b044-427f-a63b-091d0ea8dcc4 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:18.312019 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b50232f4-b044-427f-a63b-091d0ea8dcc4 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: 5a49060c-d94a-4064-8e80-ef8fe20e3ff1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:18.334350 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-91c690e5-4081-49e1-9dcf-d7f5257a083e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1522175703"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:10:18.335517 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b50232f4-b044-427f-a63b-091d0ea8dcc4 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:18.336116 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b50232f4-b044-427f-a63b-091d0ea8dcc4 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:18.336779 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b50232f4-b044-427f-a63b-091d0ea8dcc4 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:18.336927 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-91c690e5-4081-49e1-9dcf-d7f5257a083e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 31d4915d-93b9-445d-aad6-4fbc96fd5326] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:18.337918 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b50232f4-b044-427f-a63b-091d0ea8dcc4 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:18.338987 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b50232f4-b044-427f-a63b-091d0ea8dcc4 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:18.339605 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b50232f4-b044-427f-a63b-091d0ea8dcc4 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:18.345433 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91c690e5-4081-49e1-9dcf-d7f5257a083e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:18.346000 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91c690e5-4081-49e1-9dcf-d7f5257a083e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:18.346478 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91c690e5-4081-49e1-9dcf-d7f5257a083e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:18.347211 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91c690e5-4081-49e1-9dcf-d7f5257a083e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:18.347876 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91c690e5-4081-49e1-9dcf-d7f5257a083e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:18.348336 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91c690e5-4081-49e1-9dcf-d7f5257a083e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:18.809130 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-91c690e5-4081-49e1-9dcf-d7f5257a083e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "POST /compute/v2.1/servers/31d4915d-93b9-445d-aad6-4fbc96fd5326/action" status: 202 len: 0 microversion: 2.1 time: 0.481289 Oct 26 13:10:18.818404 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1010/2091] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:10:18 2022] POST /compute/v2.1/servers/31d4915d-93b9-445d-aad6-4fbc96fd5326/action => generated 0 bytes in 491 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 26 13:10:18.827132 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b33368b8-787e-48eb-9681-57be0264e38f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f673213bee0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:18.927818 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b33368b8-787e-48eb-9681-57be0264e38f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04" status: 200 len: 1414 microversion: 2.1 time: 0.105078 Oct 26 13:10:18.935922 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1011/2092] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:10:18 2022] GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04 => generated 1414 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:18.951397 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5bc64fb0-11e9-415b-b54b-6aa0a9206e3d tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:18.957102 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5bc64fb0-11e9-415b-b54b-6aa0a9206e3d tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] [instance: db4409fe-6b22-41d1-8c54-c8a5222a65b4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:18.977319 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bc64fb0-11e9-415b-b54b-6aa0a9206e3d tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:18.978879 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bc64fb0-11e9-415b-b54b-6aa0a9206e3d tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:18.979651 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bc64fb0-11e9-415b-b54b-6aa0a9206e3d tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:18.985074 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bc64fb0-11e9-415b-b54b-6aa0a9206e3d tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:18.985950 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bc64fb0-11e9-415b-b54b-6aa0a9206e3d tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:18.986620 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bc64fb0-11e9-415b-b54b-6aa0a9206e3d tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:19.388110 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b50232f4-b044-427f-a63b-091d0ea8dcc4 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:19.398911 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b50232f4-b044-427f-a63b-091d0ea8dcc4 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1" status: 200 len: 1334 microversion: 2.1 time: 1.106228 Oct 26 13:10:19.402109 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1082/2093] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:10:18 2022] GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1 => generated 1334 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:19.413728 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-72668705-e1b4-40bb-b068-14f98ea70359 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:19.414682 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-72668705-e1b4-40bb-b068-14f98ea70359 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3e395c36-3e81-4ca3-ab5c-a034d92f8288] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:19.440465 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72668705-e1b4-40bb-b068-14f98ea70359 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:19.441276 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72668705-e1b4-40bb-b068-14f98ea70359 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:19.441948 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72668705-e1b4-40bb-b068-14f98ea70359 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:19.442916 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72668705-e1b4-40bb-b068-14f98ea70359 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:19.443897 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72668705-e1b4-40bb-b068-14f98ea70359 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:19.444538 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72668705-e1b4-40bb-b068-14f98ea70359 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:19.491844 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5bc64fb0-11e9-415b-b54b-6aa0a9206e3d tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f37d1f2f0dfa49bd9b3b6bc7c86e7b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e689293a8bf44cff9b5ee773557c3e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:19.503150 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5bc64fb0-11e9-415b-b54b-6aa0a9206e3d tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f37d1f2f0dfa49bd9b3b6bc7c86e7b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e689293a8bf44cff9b5ee773557c3e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:19.508722 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5bc64fb0-11e9-415b-b54b-6aa0a9206e3d tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f37d1f2f0dfa49bd9b3b6bc7c86e7b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e689293a8bf44cff9b5ee773557c3e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:19.510413 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5bc64fb0-11e9-415b-b54b-6aa0a9206e3d tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] 10.222.0.40 "GET /compute/v2.1/servers/db4409fe-6b22-41d1-8c54-c8a5222a65b4" status: 200 len: 1557 microversion: 2.21 time: 0.563437 Oct 26 13:10:19.522613 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1012/2094] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:10:18 2022] GET /compute/v2.1/servers/db4409fe-6b22-41d1-8c54-c8a5222a65b4 => generated 1557 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:10:19.842876 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-72668705-e1b4-40bb-b068-14f98ea70359 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:19.871462 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-72668705-e1b4-40bb-b068-14f98ea70359 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:19.875721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-72668705-e1b4-40bb-b068-14f98ea70359 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:19.877379 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-72668705-e1b4-40bb-b068-14f98ea70359 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288" status: 200 len: 1562 microversion: 2.25 time: 0.469203 Oct 26 13:10:19.883613 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1083/2095] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:10:19 2022] GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288 => generated 1562 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:10:19.951534 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3e58a44f-9b6a-4b0f-83e5-09ceb8dd8fbc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67321e85e0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:20.047659 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3e58a44f-9b6a-4b0f-83e5-09ceb8dd8fbc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04" status: 200 len: 1414 microversion: 2.1 time: 0.099915 Oct 26 13:10:20.056800 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1013/2096] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:10:19 2022] GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04 => generated 1414 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:20.286719 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-de1d39d4-0505-43ca-bdfe-d286109a2117 tempest-ListImageFiltersNegativeTestJSON-1750570489 tempest-ListImageFiltersNegativeTestJSON-1750570489-project] Calling method '.version_select at 0x7f67320a1ca0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:20.327968 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-de1d39d4-0505-43ca-bdfe-d286109a2117 tempest-ListImageFiltersNegativeTestJSON-1750570489 tempest-ListImageFiltersNegativeTestJSON-1750570489-project] HTTP exception thrown: Image not found. Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-de1d39d4-0505-43ca-bdfe-d286109a2117 tempest-ListImageFiltersNegativeTestJSON-1750570489 tempest-ListImageFiltersNegativeTestJSON-1750570489-project] Request method failure captured: Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/images/5202af21-2c24-47ea-a316-11ce3c1deb31 HTTP/1.1 Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTG71TRz-ZBPur3WHaRw-LwEHc-Jtt1uYjzzgMNtBClLlMMob3KJqdAHFyqM9eXJ2iqMNodoWUxt8MXaMLo2dPR181-ocMcuJ4QPNctPTqN97sHSiHW58_DJJO-eIRr6sPAeffIqJvPW_ca1wpUnuv2AjH24BS3CKIiOB13-AJ3Y8aE Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: a6dfc971096246b09dabb522b71e0003 Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1750570489 Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a6dfc971096246b09dabb522b71e0003"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a6dfc971096246b09dabb522b71e0003"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a6dfc971096246b09dabb522b71e0003"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a6dfc971096246b09dabb522b71e0003"}]}] Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1750570489 Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: a6dfc971096246b09dabb522b71e0003 Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1750570489 Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ListImageFiltersNegativeTestJSON-1750570489-project Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: bf7459434f6a431681b5f6385b37ae32 Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1750570489-project Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: exception: Image not found. Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '5202af21-2c24-47ea-a316-11ce3c1deb31'} Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5202af21-2c24-47ea-a316-11ce3c1deb31 Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 26 13:10:20.330313 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 26 13:10:20.335701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 26 13:10:20.335701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 26 13:10:20.335701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 26 13:10:20.335701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 13:10:20.335701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 13:10:20.335701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 26 13:10:20.335701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 26 13:10:20.335701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 13:10:20.335701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 13:10:20.335701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 26 13:10:20.335701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 26 13:10:20.335701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 26 13:10:20.335701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 26 13:10:20.335701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 13:10:20.335701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 13:10:20.335701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 13:10:20.335701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 13:10:20.335701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5202af21-2c24-47ea-a316-11ce3c1deb31 could not be found. Oct 26 13:10:20.335701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:10:20.335701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:10:20.335701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:10:20.335701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:20.335701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:10:20.335701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:10:20.335701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:10:20.335701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:10:20.335701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:10:20.335701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:10:20.335701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:10:20.335701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:10:20.335701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 26 13:10:20.335701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 26 13:10:20.335701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 26 13:10:20.335701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:10:20.335701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:10:20.335701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:10:20.335701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:20.335701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:10:20.335701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:10:20.335701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:10:20.335701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:10:20.335701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 26 13:10:20.335701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:10:20.339283 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-de1d39d4-0505-43ca-bdfe-d286109a2117 tempest-ListImageFiltersNegativeTestJSON-1750570489 tempest-ListImageFiltersNegativeTestJSON-1750570489-project] Returning 404 to user: Image not found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:10:20.340067 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-de1d39d4-0505-43ca-bdfe-d286109a2117 tempest-ListImageFiltersNegativeTestJSON-1750570489 tempest-ListImageFiltersNegativeTestJSON-1750570489-project] 10.222.0.40 "GET /compute/v2.1/images/5202af21-2c24-47ea-a316-11ce3c1deb31" status: 404 len: 62 microversion: 2.1 time: 0.221261 Oct 26 13:10:20.345172 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1084/2097] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:10:20 2022] GET /compute/v2.1/images/5202af21-2c24-47ea-a316-11ce3c1deb31 => generated 62 bytes in 223 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 26 13:10:20.439495 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0661903a-166f-4edc-94e1-0ebc43233af3 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:20.440132 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0661903a-166f-4edc-94e1-0ebc43233af3 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: 5a49060c-d94a-4064-8e80-ef8fe20e3ff1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:20.448288 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0661903a-166f-4edc-94e1-0ebc43233af3 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:20.448783 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0661903a-166f-4edc-94e1-0ebc43233af3 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:20.451186 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0661903a-166f-4edc-94e1-0ebc43233af3 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:20.452709 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0661903a-166f-4edc-94e1-0ebc43233af3 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:20.454367 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0661903a-166f-4edc-94e1-0ebc43233af3 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:20.456068 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0661903a-166f-4edc-94e1-0ebc43233af3 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:20.559753 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-89af2046-822c-4dbb-a1b7-8ee8d2d56463 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:20.567191 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-89af2046-822c-4dbb-a1b7-8ee8d2d56463 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] [instance: db4409fe-6b22-41d1-8c54-c8a5222a65b4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:20.584527 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:10:20.594171 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-89af2046-822c-4dbb-a1b7-8ee8d2d56463 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:20.604032 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-89af2046-822c-4dbb-a1b7-8ee8d2d56463 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:20.604413 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-89af2046-822c-4dbb-a1b7-8ee8d2d56463 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:20.605192 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-89af2046-822c-4dbb-a1b7-8ee8d2d56463 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:20.605695 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-89af2046-822c-4dbb-a1b7-8ee8d2d56463 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:20.606124 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-89af2046-822c-4dbb-a1b7-8ee8d2d56463 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:20.728651 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-89af2046-822c-4dbb-a1b7-8ee8d2d56463 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f37d1f2f0dfa49bd9b3b6bc7c86e7b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e689293a8bf44cff9b5ee773557c3e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:20.739111 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-89af2046-822c-4dbb-a1b7-8ee8d2d56463 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f37d1f2f0dfa49bd9b3b6bc7c86e7b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e689293a8bf44cff9b5ee773557c3e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:20.747634 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-89af2046-822c-4dbb-a1b7-8ee8d2d56463 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f37d1f2f0dfa49bd9b3b6bc7c86e7b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e689293a8bf44cff9b5ee773557c3e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:20.755957 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-89af2046-822c-4dbb-a1b7-8ee8d2d56463 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] 10.222.0.40 "GET /compute/v2.1/servers/db4409fe-6b22-41d1-8c54-c8a5222a65b4" status: 200 len: 1343 microversion: 2.21 time: 0.207370 Oct 26 13:10:20.790063 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1085/2098] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:10:20 2022] GET /compute/v2.1/servers/db4409fe-6b22-41d1-8c54-c8a5222a65b4 => generated 1343 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:10:20.803510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-f3886e31-69f9-4d71-8b32-cb6405a2cd9e req-a4a1aa95-b729-4b86-ab46-a78cde5403c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db4409fe-6b22-41d1-8c54-c8a5222a65b4", "name": "network-vif-deleted", "tag": "5c0f9fbe-abc9-46a1-82c7-fb7999c227df"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:10:20.838985 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f3886e31-69f9-4d71-8b32-cb6405a2cd9e req-a4a1aa95-b729-4b86-ab46-a78cde5403c9 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:20.846936 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f3886e31-69f9-4d71-8b32-cb6405a2cd9e req-a4a1aa95-b729-4b86-ab46-a78cde5403c9 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:20.847738 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f3886e31-69f9-4d71-8b32-cb6405a2cd9e req-a4a1aa95-b729-4b86-ab46-a78cde5403c9 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:20.871665 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-f3886e31-69f9-4d71-8b32-cb6405a2cd9e req-a4a1aa95-b729-4b86-ab46-a78cde5403c9 service nova] Creating event network-vif-deleted:5c0f9fbe-abc9-46a1-82c7-fb7999c227df for instance db4409fe-6b22-41d1-8c54-c8a5222a65b4 on n-h2-862686-1 Oct 26 13:10:20.889971 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-f3886e31-69f9-4d71-8b32-cb6405a2cd9e req-a4a1aa95-b729-4b86-ab46-a78cde5403c9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096691 Oct 26 13:10:20.892158 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1086/2099] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:10:20.911066 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9245321b-ca31-47ee-b989-0b4170276cb3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:20.912306 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9245321b-ca31-47ee-b989-0b4170276cb3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3e395c36-3e81-4ca3-ab5c-a034d92f8288] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:20.931963 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9245321b-ca31-47ee-b989-0b4170276cb3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:20.932855 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9245321b-ca31-47ee-b989-0b4170276cb3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:20.934430 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9245321b-ca31-47ee-b989-0b4170276cb3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:20.935534 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9245321b-ca31-47ee-b989-0b4170276cb3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:20.936200 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9245321b-ca31-47ee-b989-0b4170276cb3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:20.937557 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9245321b-ca31-47ee-b989-0b4170276cb3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:21.186545 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9245321b-ca31-47ee-b989-0b4170276cb3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:21.200011 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9245321b-ca31-47ee-b989-0b4170276cb3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:21.204290 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9245321b-ca31-47ee-b989-0b4170276cb3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f4a513ca654b0abf9f972e07270c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b9165f0ff4c06a5d154ea24b17bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:21.209907 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9245321b-ca31-47ee-b989-0b4170276cb3 tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288" status: 200 len: 1520 microversion: 2.25 time: 0.303322 Oct 26 13:10:21.212000 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1087/2100] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:10:20 2022] GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288 => generated 1520 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:10:21.219828 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-16ee22f9-291b-45cc-abe7-750877a7bbd4 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67320a1670>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:21.311918 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-16ee22f9-291b-45cc-abe7-750877a7bbd4 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04" status: 200 len: 1414 microversion: 2.1 time: 0.095959 Oct 26 13:10:21.317234 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1088/2101] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:10:21 2022] GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04 => generated 1414 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:21.323687 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-5f62285c-02ab-41f4-9b2a-5d2244304bcd req-58e0d55f-479c-43f3-ae06-f695167f4aae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e395c36-3e81-4ca3-ab5c-a034d92f8288", "name": "network-vif-deleted", "tag": "d76e25b3-751c-4d09-9c27-caeb06dd7081"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:10:21.351175 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-5f62285c-02ab-41f4-9b2a-5d2244304bcd req-58e0d55f-479c-43f3-ae06-f695167f4aae service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:21.352000 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-5f62285c-02ab-41f4-9b2a-5d2244304bcd req-58e0d55f-479c-43f3-ae06-f695167f4aae service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:21.352905 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-5f62285c-02ab-41f4-9b2a-5d2244304bcd req-58e0d55f-479c-43f3-ae06-f695167f4aae service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:21.381504 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-5f62285c-02ab-41f4-9b2a-5d2244304bcd req-58e0d55f-479c-43f3-ae06-f695167f4aae service nova] Creating event network-vif-deleted:d76e25b3-751c-4d09-9c27-caeb06dd7081 for instance 3e395c36-3e81-4ca3-ab5c-a034d92f8288 on n-h2-862686-1 Oct 26 13:10:21.395965 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-5f62285c-02ab-41f4-9b2a-5d2244304bcd req-58e0d55f-479c-43f3-ae06-f695167f4aae service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075938 Oct 26 13:10:21.396732 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1089/2102] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:10:21.455692 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0661903a-166f-4edc-94e1-0ebc43233af3 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:21.482910 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0661903a-166f-4edc-94e1-0ebc43233af3 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1" status: 200 len: 1334 microversion: 2.1 time: 1.053530 Oct 26 13:10:21.500976 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1014/2103] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:10:20 2022] GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1 => generated 1334 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:21.787653 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-377d8b1f-82b6-49df-8326-66abec64948d tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:21.788358 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-377d8b1f-82b6-49df-8326-66abec64948d tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] [instance: db4409fe-6b22-41d1-8c54-c8a5222a65b4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:21.801652 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-377d8b1f-82b6-49df-8326-66abec64948d tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:21.803096 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-377d8b1f-82b6-49df-8326-66abec64948d tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:21.805706 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-377d8b1f-82b6-49df-8326-66abec64948d tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:21.806895 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-377d8b1f-82b6-49df-8326-66abec64948d tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:21.808850 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-377d8b1f-82b6-49df-8326-66abec64948d tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:21.809882 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-377d8b1f-82b6-49df-8326-66abec64948d tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:21.843588 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-377d8b1f-82b6-49df-8326-66abec64948d tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] HTTP exception thrown: Instance db4409fe-6b22-41d1-8c54-c8a5222a65b4 could not be found. Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-377d8b1f-82b6-49df-8326-66abec64948d tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Request method failure captured: Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/db4409fe-6b22-41d1-8c54-c8a5222a65b4 HTTP/1.1 Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTGhuunLw8vCNIu0FAmdGP1gCg68R2rcMLvG25ZVsIRUbJxClbHsbpLmI4WdsM2UM2-mIS5mBk_ViRbQw2KE5a2BIxyQ9pKR947eBKuEBRH2QkDQWNZfgHmYGwySGan4PHaVNyPY0_fw4n6ae87M7PmX7r9ArqzLidHcZsfPnuAzO_o Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: X-Openstack-Nova-Api-Version: 2.21 Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: e689293a8bf44cff9b5ee773557c3e09 Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1842646878 Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e689293a8bf44cff9b5ee773557c3e09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e689293a8bf44cff9b5ee773557c3e09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e689293a8bf44cff9b5ee773557c3e09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e689293a8bf44cff9b5ee773557c3e09"}]}] Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-InstanceActionsV221TestJSON-1842646878 Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: e689293a8bf44cff9b5ee773557c3e09 Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1842646878 Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-InstanceActionsV221TestJSON-1842646878-project Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: f37d1f2f0dfa49bd9b3b6bc7c86e7b7f Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-InstanceActionsV221TestJSON-1842646878-project Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance db4409fe-6b22-41d1-8c54-c8a5222a65b4 could not be found. Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'db4409fe-6b22-41d1-8c54-c8a5222a65b4'} Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db4409fe-6b22-41d1-8c54-c8a5222a65b4 could not be found. Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db4409fe-6b22-41d1-8c54-c8a5222a65b4 could not be found. Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:10:21.845425 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:10:21.854057 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:10:21.854057 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:21.854057 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:10:21.854057 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:10:21.854057 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:10:21.854057 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:10:21.854057 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db4409fe-6b22-41d1-8c54-c8a5222a65b4 could not be found. Oct 26 13:10:21.854057 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:10:21.854057 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-377d8b1f-82b6-49df-8326-66abec64948d tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Returning 404 to user: Instance db4409fe-6b22-41d1-8c54-c8a5222a65b4 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:10:21.854057 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-377d8b1f-82b6-49df-8326-66abec64948d tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] 10.222.0.40 "GET /compute/v2.1/servers/db4409fe-6b22-41d1-8c54-c8a5222a65b4" status: 404 len: 111 microversion: 2.21 time: 0.068894 Oct 26 13:10:21.864198 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1090/2104] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:10:21 2022] GET /compute/v2.1/servers/db4409fe-6b22-41d1-8c54-c8a5222a65b4 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:10:21.864596 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=28 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:10:21.866337 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ae4a3404-2bc2-429f-92cb-b9c6aac2bd4c tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Calling method '.version_select at 0x7f67321bfee0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:21.866918 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ae4a3404-2bc2-429f-92cb-b9c6aac2bd4c tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] [instance: db4409fe-6b22-41d1-8c54-c8a5222a65b4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:21.876218 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae4a3404-2bc2-429f-92cb-b9c6aac2bd4c tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:21.884397 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae4a3404-2bc2-429f-92cb-b9c6aac2bd4c tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:21.886107 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae4a3404-2bc2-429f-92cb-b9c6aac2bd4c tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:21.890121 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae4a3404-2bc2-429f-92cb-b9c6aac2bd4c tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:21.897005 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae4a3404-2bc2-429f-92cb-b9c6aac2bd4c tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:21.897552 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae4a3404-2bc2-429f-92cb-b9c6aac2bd4c tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:22.085508 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ae4a3404-2bc2-429f-92cb-b9c6aac2bd4c tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] 10.222.0.40 "GET /compute/v2.1/servers/db4409fe-6b22-41d1-8c54-c8a5222a65b4/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.222810 Oct 26 13:10:22.086241 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1015/2105] 10.222.0.40 () {60 vars in 1337 bytes} [Wed Oct 26 13:10:21 2022] GET /compute/v2.1/servers/db4409fe-6b22-41d1-8c54-c8a5222a65b4/os-instance-actions => generated 611 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:10:22.100493 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-385bf3ce-75bf-42b4-8a10-2e31e4b3f282 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:22.100994 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-385bf3ce-75bf-42b4-8a10-2e31e4b3f282 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] [instance: db4409fe-6b22-41d1-8c54-c8a5222a65b4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:22.107418 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-385bf3ce-75bf-42b4-8a10-2e31e4b3f282 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:22.107918 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-385bf3ce-75bf-42b4-8a10-2e31e4b3f282 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:22.108347 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-385bf3ce-75bf-42b4-8a10-2e31e4b3f282 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:22.109064 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-385bf3ce-75bf-42b4-8a10-2e31e4b3f282 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:22.142604 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-385bf3ce-75bf-42b4-8a10-2e31e4b3f282 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:22.143566 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-385bf3ce-75bf-42b4-8a10-2e31e4b3f282 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:22.184398 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-385bf3ce-75bf-42b4-8a10-2e31e4b3f282 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] HTTP exception thrown: Instance db4409fe-6b22-41d1-8c54-c8a5222a65b4 could not be found. Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-385bf3ce-75bf-42b4-8a10-2e31e4b3f282 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Request method failure captured: Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: request: DELETE /compute/v2.1/servers/db4409fe-6b22-41d1-8c54-c8a5222a65b4 HTTP/1.1 Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTGhuunLw8vCNIu0FAmdGP1gCg68R2rcMLvG25ZVsIRUbJxClbHsbpLmI4WdsM2UM2-mIS5mBk_ViRbQw2KE5a2BIxyQ9pKR947eBKuEBRH2QkDQWNZfgHmYGwySGan4PHaVNyPY0_fw4n6ae87M7PmX7r9ArqzLidHcZsfPnuAzO_o Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: X-Openstack-Nova-Api-Version: 2.21 Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: e689293a8bf44cff9b5ee773557c3e09 Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1842646878 Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e689293a8bf44cff9b5ee773557c3e09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e689293a8bf44cff9b5ee773557c3e09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e689293a8bf44cff9b5ee773557c3e09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e689293a8bf44cff9b5ee773557c3e09"}]}] Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-InstanceActionsV221TestJSON-1842646878 Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: e689293a8bf44cff9b5ee773557c3e09 Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1842646878 Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-InstanceActionsV221TestJSON-1842646878-project Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: f37d1f2f0dfa49bd9b3b6bc7c86e7b7f Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-InstanceActionsV221TestJSON-1842646878-project Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance db4409fe-6b22-41d1-8c54-c8a5222a65b4 could not be found. Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'db4409fe-6b22-41d1-8c54-c8a5222a65b4'} Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db4409fe-6b22-41d1-8c54-c8a5222a65b4 could not be found. Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:10:22.189791 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:10:22.196316 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db4409fe-6b22-41d1-8c54-c8a5222a65b4 could not be found. Oct 26 13:10:22.196316 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:10:22.196316 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:10:22.196316 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:10:22.196316 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:22.196316 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:10:22.196316 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:10:22.196316 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:10:22.196316 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:10:22.196316 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db4409fe-6b22-41d1-8c54-c8a5222a65b4 could not be found. Oct 26 13:10:22.196316 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:10:22.199445 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-385bf3ce-75bf-42b4-8a10-2e31e4b3f282 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Returning 404 to user: Instance db4409fe-6b22-41d1-8c54-c8a5222a65b4 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:10:22.209167 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-385bf3ce-75bf-42b4-8a10-2e31e4b3f282 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] 10.222.0.40 "DELETE /compute/v2.1/servers/db4409fe-6b22-41d1-8c54-c8a5222a65b4" status: 404 len: 111 microversion: 2.21 time: 0.113457 Oct 26 13:10:22.210621 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1091/2106] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 26 13:10:22 2022] DELETE /compute/v2.1/servers/db4409fe-6b22-41d1-8c54-c8a5222a65b4 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:10:22.219439 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2720af38-2a1a-4123-ad92-098c760bfd48 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:22.220303 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2720af38-2a1a-4123-ad92-098c760bfd48 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] [instance: db4409fe-6b22-41d1-8c54-c8a5222a65b4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:22.241978 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7e7ed6d5-899d-40a4-ba77-0848c1aed55e tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:22.243029 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2720af38-2a1a-4123-ad92-098c760bfd48 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:22.243880 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7e7ed6d5-899d-40a4-ba77-0848c1aed55e tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] [instance: 3e395c36-3e81-4ca3-ab5c-a034d92f8288] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:22.245263 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2720af38-2a1a-4123-ad92-098c760bfd48 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:22.252721 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2720af38-2a1a-4123-ad92-098c760bfd48 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:22.256552 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2720af38-2a1a-4123-ad92-098c760bfd48 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:22.258329 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2720af38-2a1a-4123-ad92-098c760bfd48 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:22.258479 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2720af38-2a1a-4123-ad92-098c760bfd48 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:22.279484 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e7ed6d5-899d-40a4-ba77-0848c1aed55e tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:22.282511 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e7ed6d5-899d-40a4-ba77-0848c1aed55e tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:22.283731 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e7ed6d5-899d-40a4-ba77-0848c1aed55e tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:22.289568 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e7ed6d5-899d-40a4-ba77-0848c1aed55e tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:22.292872 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e7ed6d5-899d-40a4-ba77-0848c1aed55e tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:22.293938 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e7ed6d5-899d-40a4-ba77-0848c1aed55e tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:22.314724 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:10:22.334912 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-2720af38-2a1a-4123-ad92-098c760bfd48 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] HTTP exception thrown: Instance db4409fe-6b22-41d1-8c54-c8a5222a65b4 could not be found. Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2720af38-2a1a-4123-ad92-098c760bfd48 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Request method failure captured: Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/db4409fe-6b22-41d1-8c54-c8a5222a65b4 HTTP/1.1 Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTGhuunLw8vCNIu0FAmdGP1gCg68R2rcMLvG25ZVsIRUbJxClbHsbpLmI4WdsM2UM2-mIS5mBk_ViRbQw2KE5a2BIxyQ9pKR947eBKuEBRH2QkDQWNZfgHmYGwySGan4PHaVNyPY0_fw4n6ae87M7PmX7r9ArqzLidHcZsfPnuAzO_o Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: X-Openstack-Nova-Api-Version: 2.21 Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: e689293a8bf44cff9b5ee773557c3e09 Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1842646878 Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e689293a8bf44cff9b5ee773557c3e09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e689293a8bf44cff9b5ee773557c3e09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e689293a8bf44cff9b5ee773557c3e09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e689293a8bf44cff9b5ee773557c3e09"}]}] Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-InstanceActionsV221TestJSON-1842646878 Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: e689293a8bf44cff9b5ee773557c3e09 Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1842646878 Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-InstanceActionsV221TestJSON-1842646878-project Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: f37d1f2f0dfa49bd9b3b6bc7c86e7b7f Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-InstanceActionsV221TestJSON-1842646878-project Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance db4409fe-6b22-41d1-8c54-c8a5222a65b4 could not be found. Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'db4409fe-6b22-41d1-8c54-c8a5222a65b4'} Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db4409fe-6b22-41d1-8c54-c8a5222a65b4 could not be found. Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db4409fe-6b22-41d1-8c54-c8a5222a65b4 could not be found. Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:22.341515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:10:22.348390 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:22.348390 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:22.348390 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:10:22.348390 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:10:22.348390 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:10:22.348390 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:10:22.348390 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db4409fe-6b22-41d1-8c54-c8a5222a65b4 could not be found. Oct 26 13:10:22.348390 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:22.350239 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2720af38-2a1a-4123-ad92-098c760bfd48 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] Returning 404 to user: Instance db4409fe-6b22-41d1-8c54-c8a5222a65b4 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:10:22.358637 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2720af38-2a1a-4123-ad92-098c760bfd48 tempest-InstanceActionsV221TestJSON-1842646878 tempest-InstanceActionsV221TestJSON-1842646878-project] 10.222.0.40 "GET /compute/v2.1/servers/db4409fe-6b22-41d1-8c54-c8a5222a65b4" status: 404 len: 111 microversion: 2.21 time: 0.137640 Oct 26 13:10:22.361402 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1016/2107] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:10:22 2022] GET /compute/v2.1/servers/db4409fe-6b22-41d1-8c54-c8a5222a65b4 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:10:22.364271 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-7e7ed6d5-899d-40a4-ba77-0848c1aed55e tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] HTTP exception thrown: Instance 3e395c36-3e81-4ca3-ab5c-a034d92f8288 could not be found. Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7e7ed6d5-899d-40a4-ba77-0848c1aed55e tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Request method failure captured: Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288 HTTP/1.1 Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTAVYR0OVZ4Dphw165KOe64tVOSe2bRwO7lZpFQNjQsUumeonFRg55gQeR9IdnQvsDzhcBe3pVL-kelGNhzAXdpAoseAYNY9_pDGpAcVec-gDgRy0K7LaBXNjLW0ljiFS-rO59d5NadiTJVmzCzjaWlC4EdPCUsaZaUutubLIFWnPUc Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: X-Openstack-Nova-Api-Version: 2.25 Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 2f7b9165f0ff4c06a5d154ea24b17bac Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1206006244 Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2f7b9165f0ff4c06a5d154ea24b17bac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2f7b9165f0ff4c06a5d154ea24b17bac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2f7b9165f0ff4c06a5d154ea24b17bac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2f7b9165f0ff4c06a5d154ea24b17bac"}]}] Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1206006244 Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 2f7b9165f0ff4c06a5d154ea24b17bac Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1206006244 Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-LiveAutoBlockMigrationV225Test-1206006244-project Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 27f4a513ca654b0abf9f972e07270c10 Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1206006244-project Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 3e395c36-3e81-4ca3-ab5c-a034d92f8288 could not be found. Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '3e395c36-3e81-4ca3-ab5c-a034d92f8288'} Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e395c36-3e81-4ca3-ab5c-a034d92f8288 could not be found. Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e395c36-3e81-4ca3-ab5c-a034d92f8288 could not be found. Oct 26 13:10:22.370361 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:10:22.380082 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:10:22.380082 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:10:22.380082 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:22.380082 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:10:22.380082 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:10:22.380082 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:10:22.380082 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:10:22.380082 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e395c36-3e81-4ca3-ab5c-a034d92f8288 could not be found. Oct 26 13:10:22.380082 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:10:22.383830 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7e7ed6d5-899d-40a4-ba77-0848c1aed55e tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] Returning 404 to user: Instance 3e395c36-3e81-4ca3-ab5c-a034d92f8288 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:10:22.386049 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7e7ed6d5-899d-40a4-ba77-0848c1aed55e tempest-LiveAutoBlockMigrationV225Test-1206006244 tempest-LiveAutoBlockMigrationV225Test-1206006244-project] 10.222.0.40 "GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288" status: 404 len: 111 microversion: 2.25 time: 0.148391 Oct 26 13:10:22.388449 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1092/2108] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:10:22 2022] GET /compute/v2.1/servers/3e395c36-3e81-4ca3-ab5c-a034d92f8288 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 26 13:10:22.393517 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-08cb6baa-8a1d-4df0-9fe4-1ea9570d37b1 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67320caee0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:22.514118 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7ce8b91c-7400-4c4b-9cff-e824dea11671 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:22.514819 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7ce8b91c-7400-4c4b-9cff-e824dea11671 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: 5a49060c-d94a-4064-8e80-ef8fe20e3ff1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:22.522545 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ce8b91c-7400-4c4b-9cff-e824dea11671 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:22.531448 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ce8b91c-7400-4c4b-9cff-e824dea11671 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:22.532263 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ce8b91c-7400-4c4b-9cff-e824dea11671 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:22.533259 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ce8b91c-7400-4c4b-9cff-e824dea11671 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:22.534024 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ce8b91c-7400-4c4b-9cff-e824dea11671 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:22.536580 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ce8b91c-7400-4c4b-9cff-e824dea11671 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:22.544831 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-08cb6baa-8a1d-4df0-9fe4-1ea9570d37b1 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04" status: 200 len: 1414 microversion: 2.1 time: 0.176988 Oct 26 13:10:22.545390 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1017/2109] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:10:22 2022] GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04 => generated 1414 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:22.901805 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:10:23.298171 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7ce8b91c-7400-4c4b-9cff-e824dea11671 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:23.309772 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7ce8b91c-7400-4c4b-9cff-e824dea11671 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1" status: 200 len: 1355 microversion: 2.1 time: 0.801453 Oct 26 13:10:23.315542 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1093/2110] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:10:22 2022] GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1 => generated 1355 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:23.562266 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-008f80ad-3c70-446d-b911-165b5c138f15 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67320caf70>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:23.665467 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-008f80ad-3c70-446d-b911-165b5c138f15 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04" status: 200 len: 1414 microversion: 2.1 time: 0.107148 Oct 26 13:10:23.666070 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1018/2111] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:10:23 2022] GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04 => generated 1414 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:24.340574 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6451e4ae-279a-4cf7-800a-07bf037778ef tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:24.342054 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6451e4ae-279a-4cf7-800a-07bf037778ef tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: 5a49060c-d94a-4064-8e80-ef8fe20e3ff1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:24.367400 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6451e4ae-279a-4cf7-800a-07bf037778ef tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:24.370130 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6451e4ae-279a-4cf7-800a-07bf037778ef tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:24.371240 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6451e4ae-279a-4cf7-800a-07bf037778ef tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:24.373517 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6451e4ae-279a-4cf7-800a-07bf037778ef tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:24.374218 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6451e4ae-279a-4cf7-800a-07bf037778ef tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:24.375941 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6451e4ae-279a-4cf7-800a-07bf037778ef tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:24.689539 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ccd7ab94-ef67-4675-82a6-6d334a804a4b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67369ba5e0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:24.828722 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ccd7ab94-ef67-4675-82a6-6d334a804a4b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04" status: 200 len: 1414 microversion: 2.1 time: 0.150671 Oct 26 13:10:24.829626 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1019/2112] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:10:24 2022] GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04 => generated 1414 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:24.841772 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-30a0f110-fc0c-415b-8d8f-9a165ea9d4e9 req-7399e906-5437-4194-b4de-3335fecb3eb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a49060c-d94a-4064-8e80-ef8fe20e3ff1", "tag": "28386fec-d16c-4a5f-b2f6-7619b9050fa0"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:10:24.895701 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-30a0f110-fc0c-415b-8d8f-9a165ea9d4e9 req-7399e906-5437-4194-b4de-3335fecb3eb8 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:24.897057 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-30a0f110-fc0c-415b-8d8f-9a165ea9d4e9 req-7399e906-5437-4194-b4de-3335fecb3eb8 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:24.899923 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-30a0f110-fc0c-415b-8d8f-9a165ea9d4e9 req-7399e906-5437-4194-b4de-3335fecb3eb8 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:24.936160 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-30a0f110-fc0c-415b-8d8f-9a165ea9d4e9 req-7399e906-5437-4194-b4de-3335fecb3eb8 service nova] Creating event network-changed:28386fec-d16c-4a5f-b2f6-7619b9050fa0 for instance 5a49060c-d94a-4064-8e80-ef8fe20e3ff1 on n-h2-862686-1 Oct 26 13:10:24.951873 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-30a0f110-fc0c-415b-8d8f-9a165ea9d4e9 req-7399e906-5437-4194-b4de-3335fecb3eb8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120831 Oct 26 13:10:24.952790 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1020/2113] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:10:25.841463 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=24 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:10:25.845311 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f79f8868-fba3-46eb-85e2-a4b02e856248 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67369b5a60>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:25.994631 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f79f8868-fba3-46eb-85e2-a4b02e856248 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04" status: 200 len: 1414 microversion: 2.1 time: 0.153983 Oct 26 13:10:25.995219 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1021/2114] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:10:25 2022] GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04 => generated 1414 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:26.196599 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-fb5ae006-6d8c-41e0-99e7-da6d495c6a65 req-73e9823d-791e-4a3a-acb6-67177fafb9f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31d4915d-93b9-445d-aad6-4fbc96fd5326", "name": "network-vif-plugged", "status": "completed", "tag": "3438b228-4d60-45ce-9603-e5edd9a6df9a"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:10:26.216318 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-fb5ae006-6d8c-41e0-99e7-da6d495c6a65 req-73e9823d-791e-4a3a-acb6-67177fafb9f8 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:26.220485 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-fb5ae006-6d8c-41e0-99e7-da6d495c6a65 req-73e9823d-791e-4a3a-acb6-67177fafb9f8 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:26.222240 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-fb5ae006-6d8c-41e0-99e7-da6d495c6a65 req-73e9823d-791e-4a3a-acb6-67177fafb9f8 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:26.248015 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-fb5ae006-6d8c-41e0-99e7-da6d495c6a65 req-73e9823d-791e-4a3a-acb6-67177fafb9f8 service nova] Creating event network-vif-plugged:3438b228-4d60-45ce-9603-e5edd9a6df9a for instance 31d4915d-93b9-445d-aad6-4fbc96fd5326 on n-h1-862686-1 Oct 26 13:10:26.260870 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-fb5ae006-6d8c-41e0-99e7-da6d495c6a65 req-73e9823d-791e-4a3a-acb6-67177fafb9f8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069387 Oct 26 13:10:26.264230 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1022/2115] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:10:26.418768 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6451e4ae-279a-4cf7-800a-07bf037778ef tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:26.433301 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6451e4ae-279a-4cf7-800a-07bf037778ef tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1" status: 200 len: 1355 microversion: 2.1 time: 2.091941 Oct 26 13:10:26.434200 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1094/2116] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:10:24 2022] GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1 => generated 1355 bytes in 2098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:26.630418 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-425a83fe-544a-4c96-9bde-d18462ab9c88 tempest-ListImagesTestJSON-2115865762 tempest-ListImagesTestJSON-2115865762-project] Calling method '.version_select at 0x7f67320ca700>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:26.744283 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-425a83fe-544a-4c96-9bde-d18462ab9c88 tempest-ListImagesTestJSON-2115865762 tempest-ListImagesTestJSON-2115865762-project] 10.222.0.40 "GET /compute/v2.1/images/762c20f4-0f9b-45cb-bd95-cf21a747b33b" status: 200 len: 784 microversion: 2.1 time: 0.441888 Oct 26 13:10:26.745124 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1023/2117] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:10:26 2022] GET /compute/v2.1/images/762c20f4-0f9b-45cb-bd95-cf21a747b33b => generated 784 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:10:26.761876 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-651fd870-f735-4c57-a5c3-f0431abc5b68 tempest-ListImagesTestJSON-2115865762 tempest-ListImagesTestJSON-2115865762-project] Calling method '.version_select at 0x7f6731f30790>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:26.945287 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-651fd870-f735-4c57-a5c3-f0431abc5b68 tempest-ListImagesTestJSON-2115865762 tempest-ListImagesTestJSON-2115865762-project] 10.222.0.40 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.188163 Oct 26 13:10:26.946961 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1095/2118] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Oct 26 13:10:26 2022] GET /compute/v2.1/images => generated 445 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:10:26.959972 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c99886d7-f68b-4386-89ef-3026b720dba7 tempest-ListImagesTestJSON-2115865762 tempest-ListImagesTestJSON-2115865762-project] Calling method '.version_select at 0x7f67320f0550>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:27.012889 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9f0bf673-a667-4dbd-a3c9-94dff5120b80 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f6736922430>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:27.148078 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c99886d7-f68b-4386-89ef-3026b720dba7 tempest-ListImagesTestJSON-2115865762 tempest-ListImagesTestJSON-2115865762-project] 10.222.0.40 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.192228 Oct 26 13:10:27.149817 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1024/2119] 10.222.0.40 () {58 vars in 1143 bytes} [Wed Oct 26 13:10:26 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:10:27.199731 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9f0bf673-a667-4dbd-a3c9-94dff5120b80 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04" status: 200 len: 1414 microversion: 2.1 time: 0.192552 Oct 26 13:10:27.200328 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1096/2120] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:10:27 2022] GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04 => generated 1414 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:27.477278 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ac13e696-84ff-4901-9572-3de7ae09be55 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:27.478123 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ac13e696-84ff-4901-9572-3de7ae09be55 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: 5a49060c-d94a-4064-8e80-ef8fe20e3ff1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:27.491028 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ac13e696-84ff-4901-9572-3de7ae09be55 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:27.491553 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ac13e696-84ff-4901-9572-3de7ae09be55 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:27.491996 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ac13e696-84ff-4901-9572-3de7ae09be55 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:27.492738 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ac13e696-84ff-4901-9572-3de7ae09be55 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:27.493191 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ac13e696-84ff-4901-9572-3de7ae09be55 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:27.496392 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ac13e696-84ff-4901-9572-3de7ae09be55 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:27.561470 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:10:28.218538 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-93331198-fd2e-4a72-88d2-0bae6f776ecb tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67320cb310>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:28.302161 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-93331198-fd2e-4a72-88d2-0bae6f776ecb tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04" status: 200 len: 1414 microversion: 2.1 time: 0.089210 Oct 26 13:10:28.302736 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1097/2121] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:10:28 2022] GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04 => generated 1414 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:10:28.334752 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ac13e696-84ff-4901-9572-3de7ae09be55 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:28.351828 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ac13e696-84ff-4901-9572-3de7ae09be55 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1" status: 200 len: 1355 microversion: 2.1 time: 0.889555 Oct 26 13:10:28.369108 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1025/2122] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:10:27 2022] GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1 => generated 1355 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:29.216386 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-09c3522e-7d7b-4ebe-9c6a-63ca34e78a18 req-15a5e68c-50d2-4144-b9ae-1ccac022d5b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a49060c-d94a-4064-8e80-ef8fe20e3ff1", "tag": "ce410f45-f254-4af4-b501-67d0d5082737"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:10:29.255078 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-09c3522e-7d7b-4ebe-9c6a-63ca34e78a18 req-15a5e68c-50d2-4144-b9ae-1ccac022d5b3 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:29.255748 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-09c3522e-7d7b-4ebe-9c6a-63ca34e78a18 req-15a5e68c-50d2-4144-b9ae-1ccac022d5b3 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:29.255952 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-09c3522e-7d7b-4ebe-9c6a-63ca34e78a18 req-15a5e68c-50d2-4144-b9ae-1ccac022d5b3 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:29.279253 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-09c3522e-7d7b-4ebe-9c6a-63ca34e78a18 req-15a5e68c-50d2-4144-b9ae-1ccac022d5b3 service nova] Creating event network-changed:ce410f45-f254-4af4-b501-67d0d5082737 for instance 5a49060c-d94a-4064-8e80-ef8fe20e3ff1 on n-h2-862686-1 Oct 26 13:10:29.292448 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-09c3522e-7d7b-4ebe-9c6a-63ca34e78a18 req-15a5e68c-50d2-4144-b9ae-1ccac022d5b3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081808 Oct 26 13:10:29.293607 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1098/2123] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:10:29.319466 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6cd8c24e-c144-4cad-9225-1f245859420e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67369c21f0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:29.388888 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bec01e9b-eb11-4c62-ad3b-ec1fcdb2f458 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:29.392882 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bec01e9b-eb11-4c62-ad3b-ec1fcdb2f458 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: 5a49060c-d94a-4064-8e80-ef8fe20e3ff1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:29.424216 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bec01e9b-eb11-4c62-ad3b-ec1fcdb2f458 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:29.424805 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bec01e9b-eb11-4c62-ad3b-ec1fcdb2f458 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:29.425464 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bec01e9b-eb11-4c62-ad3b-ec1fcdb2f458 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:29.426619 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bec01e9b-eb11-4c62-ad3b-ec1fcdb2f458 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:29.429940 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bec01e9b-eb11-4c62-ad3b-ec1fcdb2f458 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:29.430849 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bec01e9b-eb11-4c62-ad3b-ec1fcdb2f458 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:29.451159 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6cd8c24e-c144-4cad-9225-1f245859420e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04" status: 200 len: 1414 microversion: 2.1 time: 0.136441 Oct 26 13:10:29.463318 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1026/2124] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:10:29 2022] GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04 => generated 1414 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:30.469780 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4cba3a81-54df-4dc8-9d95-3e7fa68de4e3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f6732144b80>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:30.584300 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4cba3a81-54df-4dc8-9d95-3e7fa68de4e3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04" status: 200 len: 1414 microversion: 2.1 time: 0.118889 Oct 26 13:10:30.585811 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1027/2125] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:10:30 2022] GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04 => generated 1414 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:10:30.933321 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bec01e9b-eb11-4c62-ad3b-ec1fcdb2f458 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:30.957681 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bec01e9b-eb11-4c62-ad3b-ec1fcdb2f458 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1" status: 200 len: 1355 microversion: 2.1 time: 1.577576 Oct 26 13:10:30.959962 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1099/2126] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:10:29 2022] GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1 => generated 1355 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:10:31.601794 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1d830392-cf34-4f13-8cae-5fa167b42de2 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67369bac10>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:31.722501 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1d830392-cf34-4f13-8cae-5fa167b42de2 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04" status: 200 len: 1414 microversion: 2.1 time: 0.125873 Oct 26 13:10:31.723274 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1028/2127] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:10:31 2022] GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04 => generated 1414 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:31.988490 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4b7749e2-7ec5-4c1a-ae5a-26f7056bcca8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:31.989734 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4b7749e2-7ec5-4c1a-ae5a-26f7056bcca8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: 5a49060c-d94a-4064-8e80-ef8fe20e3ff1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:32.003236 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4b7749e2-7ec5-4c1a-ae5a-26f7056bcca8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:32.005842 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4b7749e2-7ec5-4c1a-ae5a-26f7056bcca8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:32.007615 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4b7749e2-7ec5-4c1a-ae5a-26f7056bcca8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:32.011349 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4b7749e2-7ec5-4c1a-ae5a-26f7056bcca8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:32.012066 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4b7749e2-7ec5-4c1a-ae5a-26f7056bcca8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:32.014033 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4b7749e2-7ec5-4c1a-ae5a-26f7056bcca8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:32.743746 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3e8c514a-6bac-45d9-ba8a-9438723705ab tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67320cac10>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:32.852747 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3e8c514a-6bac-45d9-ba8a-9438723705ab tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04" status: 200 len: 1414 microversion: 2.1 time: 0.114525 Oct 26 13:10:32.853664 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1029/2128] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:10:32 2022] GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04 => generated 1414 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:10:33.438967 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4b7749e2-7ec5-4c1a-ae5a-26f7056bcca8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:33.455487 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4b7749e2-7ec5-4c1a-ae5a-26f7056bcca8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1" status: 200 len: 1355 microversion: 2.1 time: 1.472118 Oct 26 13:10:33.458317 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1100/2129] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:10:31 2022] GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1 => generated 1355 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:33.871572 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c027b252-78aa-426a-b8d4-f86220897afc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67369bad30>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:34.036526 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c027b252-78aa-426a-b8d4-f86220897afc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04" status: 200 len: 1414 microversion: 2.1 time: 0.170570 Oct 26 13:10:34.045760 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1030/2130] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:10:33 2022] GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04 => generated 1414 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:34.502777 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f7f2193d-6dab-4af4-9aef-44edd57be7f2 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:34.508532 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f7f2193d-6dab-4af4-9aef-44edd57be7f2 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: 5a49060c-d94a-4064-8e80-ef8fe20e3ff1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:34.578149 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7f2193d-6dab-4af4-9aef-44edd57be7f2 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:34.578926 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7f2193d-6dab-4af4-9aef-44edd57be7f2 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:34.581893 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7f2193d-6dab-4af4-9aef-44edd57be7f2 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:34.583990 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7f2193d-6dab-4af4-9aef-44edd57be7f2 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:34.589289 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7f2193d-6dab-4af4-9aef-44edd57be7f2 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:34.591829 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7f2193d-6dab-4af4-9aef-44edd57be7f2 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:35.064407 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dd9594f3-1eef-4ec5-9d15-4d10429cfec3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f673213aaf0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:35.189688 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-dd9594f3-1eef-4ec5-9d15-4d10429cfec3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04" status: 200 len: 1414 microversion: 2.1 time: 0.128201 Oct 26 13:10:35.190514 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1031/2131] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:10:35 2022] GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04 => generated 1414 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:10:35.923157 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f7f2193d-6dab-4af4-9aef-44edd57be7f2 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:35.937167 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f7f2193d-6dab-4af4-9aef-44edd57be7f2 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1" status: 200 len: 1355 microversion: 2.1 time: 1.453864 Oct 26 13:10:35.938926 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1101/2132] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:10:34 2022] GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1 => generated 1355 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:36.160745 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-edddf631-33ed-467c-94cc-655fcaacb87e tempest-VolumesAdminNegativeTest-518675211 tempest-VolumesAdminNegativeTest-518675211-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "be8b8999-cc5a-4323-a60e-5e8b7478780c"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:10:36.164777 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-edddf631-33ed-467c-94cc-655fcaacb87e tempest-VolumesAdminNegativeTest-518675211 tempest-VolumesAdminNegativeTest-518675211-project-admin] [instance: 14fcf77a-99ed-4d7b-889a-19da49d9e4b4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:36.186834 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-edddf631-33ed-467c-94cc-655fcaacb87e tempest-VolumesAdminNegativeTest-518675211 tempest-VolumesAdminNegativeTest-518675211-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:36.188639 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-edddf631-33ed-467c-94cc-655fcaacb87e tempest-VolumesAdminNegativeTest-518675211 tempest-VolumesAdminNegativeTest-518675211-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:36.192216 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-edddf631-33ed-467c-94cc-655fcaacb87e tempest-VolumesAdminNegativeTest-518675211 tempest-VolumesAdminNegativeTest-518675211-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:36.194506 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-edddf631-33ed-467c-94cc-655fcaacb87e tempest-VolumesAdminNegativeTest-518675211 tempest-VolumesAdminNegativeTest-518675211-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:36.197710 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-edddf631-33ed-467c-94cc-655fcaacb87e tempest-VolumesAdminNegativeTest-518675211 tempest-VolumesAdminNegativeTest-518675211-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:36.198482 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-edddf631-33ed-467c-94cc-655fcaacb87e tempest-VolumesAdminNegativeTest-518675211 tempest-VolumesAdminNegativeTest-518675211-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:36.205807 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1bef1afa-ef25-4bf1-b9c2-43fb67b98d15 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f6731f30790>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:36.295193 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1bef1afa-ef25-4bf1-b9c2-43fb67b98d15 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04" status: 200 len: 1414 microversion: 2.1 time: 0.087830 Oct 26 13:10:36.302580 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1102/2133] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:10:36 2022] GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04 => generated 1414 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:36.469964 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-edddf631-33ed-467c-94cc-655fcaacb87e tempest-VolumesAdminNegativeTest-518675211 tempest-VolumesAdminNegativeTest-518675211-project-admin] HTTP exception thrown: Volume be8b8999-cc5a-4323-a60e-5e8b7478780c could not be found. Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-edddf631-33ed-467c-94cc-655fcaacb87e tempest-VolumesAdminNegativeTest-518675211 tempest-VolumesAdminNegativeTest-518675211-project-admin] Request method failure captured: Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: request: PUT /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4/os-volume_attachments/42fc241e-14d7-47f8-9b51-9a7d817cae54 HTTP/1.1 Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 74 Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTFufuT7uACjxg0Cxj4LBQpsR8ZDOsDP_QeBtvAt8Q4DTAqbSNCuD528gStCPrrMEAMWyYfFIDj7YiFOIIGUiiEng30tNrRiwHop6alRaLnCZMbv8-SywVqkDkotwSIQbnxhwTeXx3PuP-x9ouzvJwXvSZrW1v8lV3klx9bTWw52LQU Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 07c58fb7be1e490f9ed227f711e168e2 Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-VolumesAdminNegativeTest-518675211 Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: X-Role: admin,member,reader Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: admin,member,reader Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/07c58fb7be1e490f9ed227f711e168e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/07c58fb7be1e490f9ed227f711e168e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_07c58fb7be1e490f9ed227f711e168e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/07c58fb7be1e490f9ed227f711e168e2"}]}] Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-VolumesAdminNegativeTest-518675211 Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 07c58fb7be1e490f9ed227f711e168e2 Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-518675211 Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-VolumesAdminNegativeTest-518675211-project-admin Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: ae250fafd8ad447f8a40e2005c7ce655 Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-VolumesAdminNegativeTest-518675211-project-admin Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: {"volumeAttachment": {"volumeId": "be8b8999-cc5a-4323-a60e-5e8b7478780c"}} Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: exception: Volume be8b8999-cc5a-4323-a60e-5e8b7478780c could not be found. Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'server_id': '14fcf77a-99ed-4d7b-889a-19da49d9e4b4', 'id': '42fc241e-14d7-47f8-9b51-9a7d817cae54', 'body': {'volumeAttachment': {'volumeId': 'be8b8999-cc5a-4323-a60e-5e8b7478780c'}}} Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume be8b8999-cc5a-4323-a60e-5e8b7478780c could not be found. (HTTP 404) (Request-ID: req-3d977f54-d79a-47db-a354-8ba0c730a7f8) Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 26 13:10:36.480298 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 26 13:10:36.485813 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 26 13:10:36.485813 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 26 13:10:36.485813 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 26 13:10:36.485813 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 13:10:36.485813 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 13:10:36.485813 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 26 13:10:36.485813 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 26 13:10:36.485813 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 26 13:10:36.485813 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 26 13:10:36.485813 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 26 13:10:36.485813 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 26 13:10:36.485813 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 26 13:10:36.485813 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 26 13:10:36.485813 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 13:10:36.485813 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 13:10:36.485813 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 13:10:36.485813 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 13:10:36.485813 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume be8b8999-cc5a-4323-a60e-5e8b7478780c could not be found. Oct 26 13:10:36.485813 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:36.485813 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:10:36.485813 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:36.485813 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:36.485813 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:10:36.485813 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:10:36.485813 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:10:36.485813 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:10:36.485813 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:10:36.485813 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:10:36.485813 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:10:36.485813 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:10:36.485813 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:10:36.485813 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:10:36.485813 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 26 13:10:36.485813 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 26 13:10:36.485813 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 26 13:10:36.485813 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 26 13:10:36.485813 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume be8b8999-cc5a-4323-a60e-5e8b7478780c could not be found. Oct 26 13:10:36.485813 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:36.485813 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:10:36.485813 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:36.485813 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:36.485813 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:10:36.485813 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:10:36.485813 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:10:36.485813 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:10:36.485813 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume be8b8999-cc5a-4323-a60e-5e8b7478780c could not be found. Oct 26 13:10:36.485813 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:36.485813 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-edddf631-33ed-467c-94cc-655fcaacb87e tempest-VolumesAdminNegativeTest-518675211 tempest-VolumesAdminNegativeTest-518675211-project-admin] Returning 400 to user: Volume be8b8999-cc5a-4323-a60e-5e8b7478780c could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:10:36.490521 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-edddf631-33ed-467c-94cc-655fcaacb87e tempest-VolumesAdminNegativeTest-518675211 tempest-VolumesAdminNegativeTest-518675211-project-admin] 10.222.0.40 "PUT /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4/os-volume_attachments/42fc241e-14d7-47f8-9b51-9a7d817cae54" status: 400 len: 107 microversion: 2.1 time: 1.082906 Oct 26 13:10:36.493861 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1032/2134] 10.222.0.40 () {60 vars in 1433 bytes} [Wed Oct 26 13:10:35 2022] PUT /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4/os-volume_attachments/42fc241e-14d7-47f8-9b51-9a7d817cae54 => generated 107 bytes in 1091 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 26 13:10:36.645378 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-77a5ca3e-7518-41cb-bbc8-cf3b8c804194 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:36.645945 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-77a5ca3e-7518-41cb-bbc8-cf3b8c804194 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: 14fcf77a-99ed-4d7b-889a-19da49d9e4b4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:36.662010 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77a5ca3e-7518-41cb-bbc8-cf3b8c804194 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:36.662571 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77a5ca3e-7518-41cb-bbc8-cf3b8c804194 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:36.663636 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77a5ca3e-7518-41cb-bbc8-cf3b8c804194 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:36.664384 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77a5ca3e-7518-41cb-bbc8-cf3b8c804194 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:36.668683 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77a5ca3e-7518-41cb-bbc8-cf3b8c804194 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:36.670308 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77a5ca3e-7518-41cb-bbc8-cf3b8c804194 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:36.931689 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-77a5ca3e-7518-41cb-bbc8-cf3b8c804194 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lazy-loading 'services' on Instance uuid 14fcf77a-99ed-4d7b-889a-19da49d9e4b4 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:10:36.952392 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-62e38e54-8ef8-4e39-9aa6-41bfc3703bf9 req-72a19575-23c5-47df-a2a9-25c464ca9a82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a49060c-d94a-4064-8e80-ef8fe20e3ff1", "tag": "62679969-e21a-4c0d-8549-d6b3c52bd46b"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:10:36.989914 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-62e38e54-8ef8-4e39-9aa6-41bfc3703bf9 req-72a19575-23c5-47df-a2a9-25c464ca9a82 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:36.990842 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-62e38e54-8ef8-4e39-9aa6-41bfc3703bf9 req-72a19575-23c5-47df-a2a9-25c464ca9a82 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:36.992120 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-62e38e54-8ef8-4e39-9aa6-41bfc3703bf9 req-72a19575-23c5-47df-a2a9-25c464ca9a82 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:37.042442 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-62e38e54-8ef8-4e39-9aa6-41bfc3703bf9 req-72a19575-23c5-47df-a2a9-25c464ca9a82 service nova] Creating event network-changed:62679969-e21a-4c0d-8549-d6b3c52bd46b for instance 5a49060c-d94a-4064-8e80-ef8fe20e3ff1 on n-h2-862686-1 Oct 26 13:10:37.055133 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-62e38e54-8ef8-4e39-9aa6-41bfc3703bf9 req-72a19575-23c5-47df-a2a9-25c464ca9a82 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107081 Oct 26 13:10:37.058245 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1033/2135] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:10:37.071563 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-80e1b80e-24e6-4468-b62c-1154c33e7d8d tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:37.072535 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-80e1b80e-24e6-4468-b62c-1154c33e7d8d tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: 5a49060c-d94a-4064-8e80-ef8fe20e3ff1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:37.090232 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-80e1b80e-24e6-4468-b62c-1154c33e7d8d tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:37.091050 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-80e1b80e-24e6-4468-b62c-1154c33e7d8d tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:37.091692 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-80e1b80e-24e6-4468-b62c-1154c33e7d8d tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:37.092607 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-80e1b80e-24e6-4468-b62c-1154c33e7d8d tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:37.093255 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-80e1b80e-24e6-4468-b62c-1154c33e7d8d tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:37.096377 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-80e1b80e-24e6-4468-b62c-1154c33e7d8d tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:37.136657 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-77a5ca3e-7518-41cb-bbc8-cf3b8c804194 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "DELETE /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4/os-volume_attachments/42fc241e-14d7-47f8-9b51-9a7d817cae54" status: 202 len: 0 microversion: 2.1 time: 0.495270 Oct 26 13:10:37.141046 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1103/2136] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Oct 26 13:10:36 2022] DELETE /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4/os-volume_attachments/42fc241e-14d7-47f8-9b51-9a7d817cae54 => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:10:37.160904 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-84b9a7d3-2134-4b44-b8bc-219c9782a8f4 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:37.166095 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-84b9a7d3-2134-4b44-b8bc-219c9782a8f4 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: 14fcf77a-99ed-4d7b-889a-19da49d9e4b4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:37.201752 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84b9a7d3-2134-4b44-b8bc-219c9782a8f4 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:37.202243 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84b9a7d3-2134-4b44-b8bc-219c9782a8f4 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:37.202888 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84b9a7d3-2134-4b44-b8bc-219c9782a8f4 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:37.203816 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84b9a7d3-2134-4b44-b8bc-219c9782a8f4 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:37.204583 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84b9a7d3-2134-4b44-b8bc-219c9782a8f4 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:37.205318 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84b9a7d3-2134-4b44-b8bc-219c9782a8f4 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:37.333882 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-84b9a7d3-2134-4b44-b8bc-219c9782a8f4 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.185768 Oct 26 13:10:37.334552 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1104/2137] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:10:37 2022] GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4/os-volume_attachments => generated 197 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:10:37.355035 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d8192388-254d-4540-abec-e22a0e226444 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67325375e0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:37.466800 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d8192388-254d-4540-abec-e22a0e226444 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04" status: 200 len: 1414 microversion: 2.1 time: 0.119235 Oct 26 13:10:37.467817 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1105/2138] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:10:37 2022] GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04 => generated 1414 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:37.698829 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-80e1b80e-24e6-4468-b62c-1154c33e7d8d tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:37.716529 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-80e1b80e-24e6-4468-b62c-1154c33e7d8d tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1" status: 200 len: 1355 microversion: 2.1 time: 0.655930 Oct 26 13:10:37.718323 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1034/2139] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:10:37 2022] GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1 => generated 1355 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:38.346902 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4cbd11a8-2e56-4b5f-9db2-7d33b29df4d9 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:38.349758 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4cbd11a8-2e56-4b5f-9db2-7d33b29df4d9 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: 14fcf77a-99ed-4d7b-889a-19da49d9e4b4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:38.370791 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cbd11a8-2e56-4b5f-9db2-7d33b29df4d9 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:38.372017 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cbd11a8-2e56-4b5f-9db2-7d33b29df4d9 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:38.377546 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cbd11a8-2e56-4b5f-9db2-7d33b29df4d9 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:38.379656 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cbd11a8-2e56-4b5f-9db2-7d33b29df4d9 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:38.381082 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cbd11a8-2e56-4b5f-9db2-7d33b29df4d9 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:38.381988 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cbd11a8-2e56-4b5f-9db2-7d33b29df4d9 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:38.472564 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4cbd11a8-2e56-4b5f-9db2-7d33b29df4d9 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129613 Oct 26 13:10:38.475676 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1106/2140] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:10:38 2022] GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:10:38.482436 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-54a95308-8b0a-4302-9c6f-5d2ce23391a4 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67369baaf0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:38.577436 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-54a95308-8b0a-4302-9c6f-5d2ce23391a4 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04" status: 200 len: 1414 microversion: 2.1 time: 0.098657 Oct 26 13:10:38.578374 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1035/2141] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:10:38 2022] GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04 => generated 1414 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:38.746082 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-667e8b01-5c1f-482a-b15c-f2b201130338 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:38.746781 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-667e8b01-5c1f-482a-b15c-f2b201130338 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: 5a49060c-d94a-4064-8e80-ef8fe20e3ff1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:38.758337 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-667e8b01-5c1f-482a-b15c-f2b201130338 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:38.763386 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-667e8b01-5c1f-482a-b15c-f2b201130338 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:38.764058 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-667e8b01-5c1f-482a-b15c-f2b201130338 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:38.768288 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-667e8b01-5c1f-482a-b15c-f2b201130338 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:38.770021 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-667e8b01-5c1f-482a-b15c-f2b201130338 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:38.773169 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-667e8b01-5c1f-482a-b15c-f2b201130338 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:39.375100 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-667e8b01-5c1f-482a-b15c-f2b201130338 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:39.391819 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-667e8b01-5c1f-482a-b15c-f2b201130338 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1" status: 200 len: 1355 microversion: 2.1 time: 0.649910 Oct 26 13:10:39.393394 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1107/2142] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:10:38 2022] GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1 => generated 1355 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:39.488416 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c1ca6b80-c2c1-425a-a320-20bc11ae80ae tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:39.491477 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c1ca6b80-c2c1-425a-a320-20bc11ae80ae tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: 14fcf77a-99ed-4d7b-889a-19da49d9e4b4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:39.501549 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c1ca6b80-c2c1-425a-a320-20bc11ae80ae tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:39.502315 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c1ca6b80-c2c1-425a-a320-20bc11ae80ae tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:39.503047 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c1ca6b80-c2c1-425a-a320-20bc11ae80ae tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:39.504721 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c1ca6b80-c2c1-425a-a320-20bc11ae80ae tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:39.505595 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c1ca6b80-c2c1-425a-a320-20bc11ae80ae tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:39.506320 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c1ca6b80-c2c1-425a-a320-20bc11ae80ae tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:39.551769 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c1ca6b80-c2c1-425a-a320-20bc11ae80ae tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069620 Oct 26 13:10:39.555577 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1036/2143] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:10:39 2022] GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:10:39.594148 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ed02ed29-ed9b-4b09-a054-6b4f9c7c982b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f6736912160>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:39.667009 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ed02ed29-ed9b-4b09-a054-6b4f9c7c982b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04" status: 200 len: 1414 microversion: 2.1 time: 0.077076 Oct 26 13:10:39.675926 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1108/2144] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:10:39 2022] GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04 => generated 1414 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:40.417308 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f28a6f48-8bcc-4212-970e-ebd76943dea8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:40.418177 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f28a6f48-8bcc-4212-970e-ebd76943dea8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: 5a49060c-d94a-4064-8e80-ef8fe20e3ff1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:40.428641 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f28a6f48-8bcc-4212-970e-ebd76943dea8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:40.432220 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f28a6f48-8bcc-4212-970e-ebd76943dea8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:40.432689 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f28a6f48-8bcc-4212-970e-ebd76943dea8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:40.434276 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f28a6f48-8bcc-4212-970e-ebd76943dea8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:40.437338 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f28a6f48-8bcc-4212-970e-ebd76943dea8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:40.438002 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f28a6f48-8bcc-4212-970e-ebd76943dea8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:40.569591 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-05b67b04-0986-49de-9607-43b40abc77b6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:40.571788 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-05b67b04-0986-49de-9607-43b40abc77b6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: 14fcf77a-99ed-4d7b-889a-19da49d9e4b4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:40.596853 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05b67b04-0986-49de-9607-43b40abc77b6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:40.612674 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05b67b04-0986-49de-9607-43b40abc77b6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:40.613342 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05b67b04-0986-49de-9607-43b40abc77b6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:40.619620 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05b67b04-0986-49de-9607-43b40abc77b6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:40.620127 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05b67b04-0986-49de-9607-43b40abc77b6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:40.630408 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05b67b04-0986-49de-9607-43b40abc77b6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:40.780116 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-05b67b04-0986-49de-9607-43b40abc77b6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.202883 Oct 26 13:10:40.798163 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1109/2145] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:10:40 2022] GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4/os-volume_attachments => generated 197 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:10:40.811214 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-49485d91-8a88-4e49-8c48-6f62fb2e64be tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f6732115430>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:40.935373 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-49485d91-8a88-4e49-8c48-6f62fb2e64be tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04" status: 200 len: 1414 microversion: 2.1 time: 0.134916 Oct 26 13:10:40.936326 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1110/2146] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:10:40 2022] GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04 => generated 1414 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:41.561747 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f28a6f48-8bcc-4212-970e-ebd76943dea8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:41.576293 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f28a6f48-8bcc-4212-970e-ebd76943dea8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1" status: 200 len: 1355 microversion: 2.1 time: 1.163402 Oct 26 13:10:41.580107 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1037/2147] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:10:40 2022] GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1 => generated 1355 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:41.821116 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c2a4e2d0-0e1c-488a-90a9-c393c215e9ff tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:41.826866 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c2a4e2d0-0e1c-488a-90a9-c393c215e9ff tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: 14fcf77a-99ed-4d7b-889a-19da49d9e4b4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:41.849968 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2a4e2d0-0e1c-488a-90a9-c393c215e9ff tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:41.850907 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2a4e2d0-0e1c-488a-90a9-c393c215e9ff tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:41.851581 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2a4e2d0-0e1c-488a-90a9-c393c215e9ff tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:41.853426 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2a4e2d0-0e1c-488a-90a9-c393c215e9ff tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:41.854947 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2a4e2d0-0e1c-488a-90a9-c393c215e9ff tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:41.858659 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2a4e2d0-0e1c-488a-90a9-c393c215e9ff tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:41.954606 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0841e49f-01ee-404e-9d69-0c2fc39d9544 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67321bf310>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:42.011351 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c2a4e2d0-0e1c-488a-90a9-c393c215e9ff tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.211334 Oct 26 13:10:42.011973 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1111/2148] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:10:41 2022] GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4/os-volume_attachments => generated 197 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:10:42.080639 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0841e49f-01ee-404e-9d69-0c2fc39d9544 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04" status: 200 len: 1414 microversion: 2.1 time: 0.131602 Oct 26 13:10:42.082265 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1038/2149] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:10:41 2022] GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04 => generated 1414 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:10:42.609208 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0006798f-e692-4305-98e4-da63f5e48a12 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:42.609977 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0006798f-e692-4305-98e4-da63f5e48a12 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: 5a49060c-d94a-4064-8e80-ef8fe20e3ff1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:42.622118 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0006798f-e692-4305-98e4-da63f5e48a12 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:42.631151 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0006798f-e692-4305-98e4-da63f5e48a12 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:42.631793 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0006798f-e692-4305-98e4-da63f5e48a12 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:42.632554 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0006798f-e692-4305-98e4-da63f5e48a12 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:42.633343 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0006798f-e692-4305-98e4-da63f5e48a12 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:42.633959 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0006798f-e692-4305-98e4-da63f5e48a12 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:43.026743 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-60e5a4b4-e87b-4e8d-863e-6e3fd5ab3ba1 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:43.030250 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-60e5a4b4-e87b-4e8d-863e-6e3fd5ab3ba1 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: 14fcf77a-99ed-4d7b-889a-19da49d9e4b4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:43.048323 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-60e5a4b4-e87b-4e8d-863e-6e3fd5ab3ba1 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:43.055755 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-60e5a4b4-e87b-4e8d-863e-6e3fd5ab3ba1 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:43.058011 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-60e5a4b4-e87b-4e8d-863e-6e3fd5ab3ba1 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:43.059070 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-60e5a4b4-e87b-4e8d-863e-6e3fd5ab3ba1 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:43.059936 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-60e5a4b4-e87b-4e8d-863e-6e3fd5ab3ba1 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:43.060603 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-60e5a4b4-e87b-4e8d-863e-6e3fd5ab3ba1 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:43.106630 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-60e5a4b4-e87b-4e8d-863e-6e3fd5ab3ba1 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085400 Oct 26 13:10:43.107654 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1039/2150] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:10:43 2022] GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:10:43.114574 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6f942a0e-b6db-4b45-bc3e-20b33792e9e3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f673213a040>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:43.183242 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6f942a0e-b6db-4b45-bc3e-20b33792e9e3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04" status: 200 len: 1414 microversion: 2.1 time: 0.073992 Oct 26 13:10:43.187251 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1040/2151] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:10:43 2022] GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04 => generated 1414 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:43.532635 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0006798f-e692-4305-98e4-da63f5e48a12 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:43.548311 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0006798f-e692-4305-98e4-da63f5e48a12 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1" status: 200 len: 1355 microversion: 2.1 time: 0.943809 Oct 26 13:10:43.567125 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1112/2152] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:10:42 2022] GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1 => generated 1355 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:44.122496 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dfc4e69c-f678-4e9c-a208-ecd17753221b tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:44.125798 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-dfc4e69c-f678-4e9c-a208-ecd17753221b tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: 14fcf77a-99ed-4d7b-889a-19da49d9e4b4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:44.140344 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dfc4e69c-f678-4e9c-a208-ecd17753221b tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:44.140830 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dfc4e69c-f678-4e9c-a208-ecd17753221b tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:44.141266 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dfc4e69c-f678-4e9c-a208-ecd17753221b tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:44.142001 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dfc4e69c-f678-4e9c-a208-ecd17753221b tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:44.142510 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dfc4e69c-f678-4e9c-a208-ecd17753221b tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:44.142933 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dfc4e69c-f678-4e9c-a208-ecd17753221b tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:44.203908 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2fdbc506-fe80-4df9-957e-b44a5489ab10 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67368c60d0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:44.365594 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-dfc4e69c-f678-4e9c-a208-ecd17753221b tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.248230 Oct 26 13:10:44.391778 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2fdbc506-fe80-4df9-957e-b44a5489ab10 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04" status: 200 len: 1414 microversion: 2.1 time: 0.193190 Oct 26 13:10:44.392875 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1113/2153] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:10:44 2022] GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04 => generated 1414 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:10:44.404992 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1041/2154] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:10:44 2022] GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4/os-volume_attachments => generated 197 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:10:44.578875 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-93134566-e59c-4a56-9b39-c5ff00ec144d tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:44.580000 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-93134566-e59c-4a56-9b39-c5ff00ec144d tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: 5a49060c-d94a-4064-8e80-ef8fe20e3ff1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:44.593617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-93134566-e59c-4a56-9b39-c5ff00ec144d tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:44.596884 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-93134566-e59c-4a56-9b39-c5ff00ec144d tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:44.598075 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-93134566-e59c-4a56-9b39-c5ff00ec144d tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:44.611061 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-93134566-e59c-4a56-9b39-c5ff00ec144d tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:44.614159 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-93134566-e59c-4a56-9b39-c5ff00ec144d tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:44.616157 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-93134566-e59c-4a56-9b39-c5ff00ec144d tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:45.378702 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-efc5a2f2-e53b-429d-a53d-378bccb41a23 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:45.381091 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-efc5a2f2-e53b-429d-a53d-378bccb41a23 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: 14fcf77a-99ed-4d7b-889a-19da49d9e4b4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:45.384074 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=49 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:10:45.421805 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-efc5a2f2-e53b-429d-a53d-378bccb41a23 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:45.422307 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-efc5a2f2-e53b-429d-a53d-378bccb41a23 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:45.422747 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-efc5a2f2-e53b-429d-a53d-378bccb41a23 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:45.423466 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-efc5a2f2-e53b-429d-a53d-378bccb41a23 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:45.423917 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-efc5a2f2-e53b-429d-a53d-378bccb41a23 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:45.424340 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-efc5a2f2-e53b-429d-a53d-378bccb41a23 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:45.629789 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-efc5a2f2-e53b-429d-a53d-378bccb41a23 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.252821 Oct 26 13:10:45.635853 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1042/2155] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:10:45 2022] GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4/os-volume_attachments => generated 197 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:10:45.661747 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d01246ba-34f1-4014-829b-0ae69ef3760a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f673213a040>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:45.793517 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d01246ba-34f1-4014-829b-0ae69ef3760a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04" status: 200 len: 1414 microversion: 2.1 time: 0.155156 Oct 26 13:10:45.794467 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1043/2156] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:10:45 2022] GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04 => generated 1414 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:46.646170 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8505fa8d-0ed5-4e04-a7bf-e4a87014a57a tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:46.648293 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8505fa8d-0ed5-4e04-a7bf-e4a87014a57a tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: 14fcf77a-99ed-4d7b-889a-19da49d9e4b4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:46.687520 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8505fa8d-0ed5-4e04-a7bf-e4a87014a57a tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:46.688250 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8505fa8d-0ed5-4e04-a7bf-e4a87014a57a tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:46.688817 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8505fa8d-0ed5-4e04-a7bf-e4a87014a57a tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:46.689752 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8505fa8d-0ed5-4e04-a7bf-e4a87014a57a tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:46.700328 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8505fa8d-0ed5-4e04-a7bf-e4a87014a57a tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:46.701070 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8505fa8d-0ed5-4e04-a7bf-e4a87014a57a tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:46.791178 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8505fa8d-0ed5-4e04-a7bf-e4a87014a57a tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.151798 Oct 26 13:10:46.798985 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1044/2157] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:10:46 2022] GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:10:46.828973 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a305897d-d2e7-4d37-a0c4-c51b9a64a881 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f673213a790>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:46.929014 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a305897d-d2e7-4d37-a0c4-c51b9a64a881 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04" status: 200 len: 1414 microversion: 2.1 time: 0.121767 Oct 26 13:10:46.930741 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1045/2158] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:10:46 2022] GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04 => generated 1414 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:47.152910 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-93134566-e59c-4a56-9b39-c5ff00ec144d tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:47.161560 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-93134566-e59c-4a56-9b39-c5ff00ec144d tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1" status: 200 len: 1355 microversion: 2.1 time: 2.586290 Oct 26 13:10:47.165630 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1114/2159] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:10:44 2022] GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1 => generated 1355 bytes in 2592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:47.810924 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0ba1409d-d84e-48a4-9821-e953710a25b6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:47.813115 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0ba1409d-d84e-48a4-9821-e953710a25b6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: 14fcf77a-99ed-4d7b-889a-19da49d9e4b4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:47.826257 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ba1409d-d84e-48a4-9821-e953710a25b6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:47.828426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ba1409d-d84e-48a4-9821-e953710a25b6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:47.831598 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ba1409d-d84e-48a4-9821-e953710a25b6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:47.842579 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ba1409d-d84e-48a4-9821-e953710a25b6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:47.843289 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ba1409d-d84e-48a4-9821-e953710a25b6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:47.843878 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ba1409d-d84e-48a4-9821-e953710a25b6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:47.908560 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0ba1409d-d84e-48a4-9821-e953710a25b6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103725 Oct 26 13:10:47.911184 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1046/2160] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:10:47 2022] GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:10:47.947848 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b2d24c44-9032-4093-87ed-181c4692a860 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67320a1280>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:48.090006 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b2d24c44-9032-4093-87ed-181c4692a860 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04" status: 200 len: 1414 microversion: 2.1 time: 0.146616 Oct 26 13:10:48.091043 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1115/2161] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:10:47 2022] GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04 => generated 1414 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:48.192755 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-45653940-4b34-4640-94df-813430af514b tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:48.193380 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-45653940-4b34-4640-94df-813430af514b tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: 5a49060c-d94a-4064-8e80-ef8fe20e3ff1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:48.214836 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-45653940-4b34-4640-94df-813430af514b tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:48.215347 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-45653940-4b34-4640-94df-813430af514b tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:48.215802 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-45653940-4b34-4640-94df-813430af514b tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:48.216536 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-45653940-4b34-4640-94df-813430af514b tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:48.217002 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-45653940-4b34-4640-94df-813430af514b tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:48.217429 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-45653940-4b34-4640-94df-813430af514b tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:48.637559 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-45653940-4b34-4640-94df-813430af514b tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:48.650949 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-45653940-4b34-4640-94df-813430af514b tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1" status: 200 len: 1355 microversion: 2.1 time: 0.462157 Oct 26 13:10:48.698140 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1047/2162] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:10:48 2022] GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1 => generated 1355 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:48.923458 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-69d5fa08-3709-4c1b-91f3-0957cf849b13 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:48.925795 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-69d5fa08-3709-4c1b-91f3-0957cf849b13 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: 14fcf77a-99ed-4d7b-889a-19da49d9e4b4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:48.941717 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-69d5fa08-3709-4c1b-91f3-0957cf849b13 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:48.942578 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-69d5fa08-3709-4c1b-91f3-0957cf849b13 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:48.943152 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-69d5fa08-3709-4c1b-91f3-0957cf849b13 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:48.944028 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-69d5fa08-3709-4c1b-91f3-0957cf849b13 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:48.944617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-69d5fa08-3709-4c1b-91f3-0957cf849b13 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:48.945177 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-69d5fa08-3709-4c1b-91f3-0957cf849b13 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:49.023335 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-69d5fa08-3709-4c1b-91f3-0957cf849b13 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.104759 Oct 26 13:10:49.025137 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1116/2163] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:10:48 2022] GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4/os-volume_attachments => generated 25 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:10:49.108312 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a4f6f962-86b6-4d1e-b603-068a6746baaa tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f6736951670>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:49.209060 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a4f6f962-86b6-4d1e-b603-068a6746baaa tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04" status: 200 len: 1414 microversion: 2.1 time: 0.095494 Oct 26 13:10:49.211067 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1048/2164] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:10:49 2022] GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04 => generated 1414 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:49.482253 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-57a7f894-3201-4ac9-b6a1-1f118a1e1298 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-415692072", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "ea467900-166a-4bae-8dfc-1d9c29684906"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:10:49.589588 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-57a7f894-3201-4ac9-b6a1-1f118a1e1298 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] validate_networks() for [('ea467900-166a-4bae-8dfc-1d9c29684906', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:10:49.679852 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d5051a74-1be3-45d3-bf77-e86477f9f0c8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:49.680857 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d5051a74-1be3-45d3-bf77-e86477f9f0c8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: 5a49060c-d94a-4064-8e80-ef8fe20e3ff1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:49.699320 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d5051a74-1be3-45d3-bf77-e86477f9f0c8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:49.700122 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d5051a74-1be3-45d3-bf77-e86477f9f0c8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:49.700700 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d5051a74-1be3-45d3-bf77-e86477f9f0c8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:49.701700 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d5051a74-1be3-45d3-bf77-e86477f9f0c8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:49.702293 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d5051a74-1be3-45d3-bf77-e86477f9f0c8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:49.702847 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d5051a74-1be3-45d3-bf77-e86477f9f0c8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:50.274634 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d5051a74-1be3-45d3-bf77-e86477f9f0c8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:50.288630 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d5051a74-1be3-45d3-bf77-e86477f9f0c8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1" status: 200 len: 1355 microversion: 2.1 time: 0.613404 Oct 26 13:10:50.289816 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1049/2165] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:10:49 2022] GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1 => generated 1355 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:50.294664 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f2118b19-e8d9-4f69-ac3d-364e5c8cf6a6 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f6732134f70>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:50.402522 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f2118b19-e8d9-4f69-ac3d-364e5c8cf6a6 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04" status: 200 len: 1414 microversion: 2.1 time: 0.111215 Oct 26 13:10:50.403919 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1050/2166] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:10:50 2022] GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04 => generated 1414 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:51.317400 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-601be2ed-af83-4332-bbd3-0f7fb8039bac tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:51.318371 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-601be2ed-af83-4332-bbd3-0f7fb8039bac tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: 5a49060c-d94a-4064-8e80-ef8fe20e3ff1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:51.330224 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-601be2ed-af83-4332-bbd3-0f7fb8039bac tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:51.331562 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-601be2ed-af83-4332-bbd3-0f7fb8039bac tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:51.332539 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-601be2ed-af83-4332-bbd3-0f7fb8039bac tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:51.333606 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-601be2ed-af83-4332-bbd3-0f7fb8039bac tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:51.334330 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-601be2ed-af83-4332-bbd3-0f7fb8039bac tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:51.335763 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-601be2ed-af83-4332-bbd3-0f7fb8039bac tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:51.568385 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-601be2ed-af83-4332-bbd3-0f7fb8039bac tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:51.580055 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-601be2ed-af83-4332-bbd3-0f7fb8039bac tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1" status: 200 len: 1355 microversion: 2.1 time: 0.267080 Oct 26 13:10:51.596510 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1051/2167] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:10:51 2022] GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1 => generated 1355 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:10:51.601247 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9d0244fc-3a23-439b-8e88-634b0c85c70e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f6732134f70>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:51.678506 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9d0244fc-3a23-439b-8e88-634b0c85c70e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04" status: 200 len: 1414 microversion: 2.1 time: 0.088876 Oct 26 13:10:51.679096 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1052/2168] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:10:51 2022] GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04 => generated 1414 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:51.870145 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ccfece6b-cead-413c-95fb-9f3aa25a66d6 tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] Action: 'create', calling method: .version_select at 0x7f67369a21f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-985978737", "description": "tempest-description-1594318948"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:10:52.018092 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-57a7f894-3201-4ac9-b6a1-1f118a1e1298 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:10:52.018593 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-57a7f894-3201-4ac9-b6a1-1f118a1e1298 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:10:52.019007 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-57a7f894-3201-4ac9-b6a1-1f118a1e1298 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:10:52.019865 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-57a7f894-3201-4ac9-b6a1-1f118a1e1298 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:10:52.020744 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-57a7f894-3201-4ac9-b6a1-1f118a1e1298 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:10:52.025467 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=45 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:10:52.042241 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57a7f894-3201-4ac9-b6a1-1f118a1e1298 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:52.042983 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57a7f894-3201-4ac9-b6a1-1f118a1e1298 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:52.043562 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57a7f894-3201-4ac9-b6a1-1f118a1e1298 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:52.049564 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57a7f894-3201-4ac9-b6a1-1f118a1e1298 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:52.051061 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57a7f894-3201-4ac9-b6a1-1f118a1e1298 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:52.051729 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57a7f894-3201-4ac9-b6a1-1f118a1e1298 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:52.074160 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ccfece6b-cead-413c-95fb-9f3aa25a66d6 tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.393757 Oct 26 13:10:52.074886 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1053/2169] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 26 13:10:51 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:10:52.090561 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0f354523-9774-43c4-b921-91639bf39a44 tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] Action: 'create', calling method: .version_select at 0x7f6736951040>, body: {"security_group_rule": {"parent_group_id": "6a4c58c8-0dcf-465f-9bb8-64d1ee98e1f5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:10:52.102894 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-57a7f894-3201-4ac9-b6a1-1f118a1e1298 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Getting quotas for project 2336994846d345aa86b5fd940d1b004f. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:10:52.113309 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-57a7f894-3201-4ac9-b6a1-1f118a1e1298 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Getting quotas for user cb4c9b05864d4d448b1c722659a3bc21 and project 2336994846d345aa86b5fd940d1b004f. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:10:52.141431 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-57a7f894-3201-4ac9-b6a1-1f118a1e1298 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:10:52.152973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-57a7f894-3201-4ac9-b6a1-1f118a1e1298 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: e57fd56b-c9ce-4668-b9ff-703b4b310d1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:10:52.256040 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-57a7f894-3201-4ac9-b6a1-1f118a1e1298 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.788515 Oct 26 13:10:52.260928 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1117/2170] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:10:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:10:52.284218 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f8652785-c249-406b-b111-46e9982148db tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:52.286830 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f8652785-c249-406b-b111-46e9982148db tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: e57fd56b-c9ce-4668-b9ff-703b4b310d1a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:52.489085 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f8652785-c249-406b-b111-46e9982148db tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4c9b05864d4d448b1c722659a3bc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2336994846d345aa86b5fd940d1b004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:52.496258 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f8652785-c249-406b-b111-46e9982148db tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/e57fd56b-c9ce-4668-b9ff-703b4b310d1a" status: 200 len: 1217 microversion: 2.1 time: 0.228756 Oct 26 13:10:52.499650 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1118/2171] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:10:52 2022] GET /compute/v2.1/servers/e57fd56b-c9ce-4668-b9ff-703b4b310d1a => generated 1217 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:10:52.558505 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0f354523-9774-43c4-b921-91639bf39a44 tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.473543 Oct 26 13:10:52.559430 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1054/2172] 10.222.0.40 () {60 vars in 1195 bytes} [Wed Oct 26 13:10:52 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:10:52.572232 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e1907e81-dfe4-40b7-b703-d24847ace56b tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] Action: 'create', calling method: .version_select at 0x7f6731ff3f70>, body: {"security_group_rule": {"parent_group_id": "6a4c58c8-0dcf-465f-9bb8-64d1ee98e1f5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:10:52.604754 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a36d9a24-0aca-4566-a25d-aed5a015d373 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:52.605505 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a36d9a24-0aca-4566-a25d-aed5a015d373 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: 5a49060c-d94a-4064-8e80-ef8fe20e3ff1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:52.614443 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a36d9a24-0aca-4566-a25d-aed5a015d373 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:52.618362 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a36d9a24-0aca-4566-a25d-aed5a015d373 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:52.618915 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a36d9a24-0aca-4566-a25d-aed5a015d373 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:52.621589 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a36d9a24-0aca-4566-a25d-aed5a015d373 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:52.622291 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a36d9a24-0aca-4566-a25d-aed5a015d373 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:52.625542 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a36d9a24-0aca-4566-a25d-aed5a015d373 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:52.926292 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-e1907e81-dfe4-40b7-b703-d24847ace56b tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] HTTP exception thrown: This rule already exists in group 6a4c58c8-0dcf-465f-9bb8-64d1ee98e1f5 Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e1907e81-dfe4-40b7-b703-d24847ace56b tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] Request method failure captured: Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 138 Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTHb3vswqjBizG6GlH2IOGvoP8uIeyT-jIq9V4VqokHz-5_rYmQgkG2BgWJwhFYh2cOchKfJfBMwkvYR-maaO1LgxeQyAYwlE0SQPTdeCYbSH5iEwjzQ2MAwDHUtnfMLS4tiJdBowMQzNK9Suf65PrUPPFowaxHsLXRNSaWqsUkah94 Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: f1228d83c0b44bf390fb1891799af9a3 Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1661532260 Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f1228d83c0b44bf390fb1891799af9a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f1228d83c0b44bf390fb1891799af9a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f1228d83c0b44bf390fb1891799af9a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f1228d83c0b44bf390fb1891799af9a3"}]}] Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1661532260 Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: f1228d83c0b44bf390fb1891799af9a3 Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1661532260 Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: fc5e9b0a4e2d4432b28817e45f543328 Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: {"security_group_rule": {"parent_group_id": "6a4c58c8-0dcf-465f-9bb8-64d1ee98e1f5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: exception: This rule already exists in group 6a4c58c8-0dcf-465f-9bb8-64d1ee98e1f5 Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'body': {'security_group_rule': {'parent_group_id': '6a4c58c8-0dcf-465f-9bb8-64d1ee98e1f5', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 6a4c58c8-0dcf-465f-9bb8-64d1ee98e1f5 Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 6a4c58c8-0dcf-465f-9bb8-64d1ee98e1f5 Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:10:52.928169 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:10:52.931949 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:10:52.931949 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:10:52.931949 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 6a4c58c8-0dcf-465f-9bb8-64d1ee98e1f5 Oct 26 13:10:52.931949 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:10:52.932518 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e1907e81-dfe4-40b7-b703-d24847ace56b tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] Returning 400 to user: This rule already exists in group 6a4c58c8-0dcf-465f-9bb8-64d1ee98e1f5 {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:10:52.933473 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e1907e81-dfe4-40b7-b703-d24847ace56b tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.366086 Oct 26 13:10:52.934585 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1119/2173] 10.222.0.40 () {60 vars in 1195 bytes} [Wed Oct 26 13:10:52 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 368 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:10:52.942933 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9f73e8b1-0ab8-44a9-98e1-49dde615fa66 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f6732b4b0d0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:53.016035 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9f73e8b1-0ab8-44a9-98e1-49dde615fa66 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04" status: 200 len: 1414 microversion: 2.1 time: 0.080248 Oct 26 13:10:53.016901 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1120/2174] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:10:52 2022] GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04 => generated 1414 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:53.031367 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1adff3e5-906a-4601-b463-4f4e03e1de96 tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] Calling method '.version_select at 0x7f6731f92a60>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:53.166622 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a36d9a24-0aca-4566-a25d-aed5a015d373 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:53.175735 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a36d9a24-0aca-4566-a25d-aed5a015d373 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1" status: 200 len: 1355 microversion: 2.1 time: 0.574600 Oct 26 13:10:53.182087 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1055/2175] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:10:52 2022] GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1 => generated 1355 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:10:53.536337 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a96ee655-87c9-4bb4-a12c-a68ecc8686d6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:53.536337 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a96ee655-87c9-4bb4-a12c-a68ecc8686d6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: e57fd56b-c9ce-4668-b9ff-703b4b310d1a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:53.547792 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a96ee655-87c9-4bb4-a12c-a68ecc8686d6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:53.548276 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a96ee655-87c9-4bb4-a12c-a68ecc8686d6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:53.548705 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a96ee655-87c9-4bb4-a12c-a68ecc8686d6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:53.549407 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a96ee655-87c9-4bb4-a12c-a68ecc8686d6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:53.549949 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a96ee655-87c9-4bb4-a12c-a68ecc8686d6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:53.550408 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a96ee655-87c9-4bb4-a12c-a68ecc8686d6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:53.740019 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a96ee655-87c9-4bb4-a12c-a68ecc8686d6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4c9b05864d4d448b1c722659a3bc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2336994846d345aa86b5fd940d1b004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:53.753008 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a96ee655-87c9-4bb4-a12c-a68ecc8686d6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/e57fd56b-c9ce-4668-b9ff-703b4b310d1a" status: 200 len: 1221 microversion: 2.1 time: 0.228729 Oct 26 13:10:53.759846 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1056/2176] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:10:53 2022] GET /compute/v2.1/servers/e57fd56b-c9ce-4668-b9ff-703b4b310d1a => generated 1221 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:53.783276 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-799cda16-92b7-4992-bfbf-38ee13f450b5 req-6e609c08-7316-42af-8242-7a9e5f9e7ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a49060c-d94a-4064-8e80-ef8fe20e3ff1", "name": "network-vif-plugged", "status": "completed", "tag": "ce410f45-f254-4af4-b501-67d0d5082737"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:10:53.844438 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-799cda16-92b7-4992-bfbf-38ee13f450b5 req-6e609c08-7316-42af-8242-7a9e5f9e7ec7 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:53.845502 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-799cda16-92b7-4992-bfbf-38ee13f450b5 req-6e609c08-7316-42af-8242-7a9e5f9e7ec7 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:53.848239 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-799cda16-92b7-4992-bfbf-38ee13f450b5 req-6e609c08-7316-42af-8242-7a9e5f9e7ec7 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:53.870278 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-799cda16-92b7-4992-bfbf-38ee13f450b5 req-6e609c08-7316-42af-8242-7a9e5f9e7ec7 service nova] Creating event network-vif-plugged:ce410f45-f254-4af4-b501-67d0d5082737 for instance 5a49060c-d94a-4064-8e80-ef8fe20e3ff1 on n-h2-862686-1 Oct 26 13:10:53.896023 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-799cda16-92b7-4992-bfbf-38ee13f450b5 req-6e609c08-7316-42af-8242-7a9e5f9e7ec7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124261 Oct 26 13:10:53.901099 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1057/2177] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:10:54.038935 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-05a568bb-73cf-4fc9-9b0a-8cfbfc1820da tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f673223a0d0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:54.225466 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1adff3e5-906a-4601-b463-4f4e03e1de96 tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-group-rules/0d944e3b-2a8d-4d95-950c-15b97d9b0f30" status: 202 len: 0 microversion: 2.1 time: 1.207162 Oct 26 13:10:54.226721 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1121/2178] 10.222.0.40 () {58 vars in 1287 bytes} [Wed Oct 26 13:10:53 2022] DELETE /compute/v2.1/os-security-group-rules/0d944e3b-2a8d-4d95-950c-15b97d9b0f30 => generated 0 bytes in 1209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:10:54.240767 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-05a568bb-73cf-4fc9-9b0a-8cfbfc1820da tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04" status: 200 len: 1414 microversion: 2.1 time: 0.192481 Oct 26 13:10:54.241433 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1058/2179] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:10:54 2022] GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04 => generated 1414 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:10:54.241894 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ef0349d4-7b1b-4877-90b9-8894597905d5 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:54.246745 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ef0349d4-7b1b-4877-90b9-8894597905d5 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: 5a49060c-d94a-4064-8e80-ef8fe20e3ff1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:54.283461 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef0349d4-7b1b-4877-90b9-8894597905d5 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:54.289968 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f3159439-805e-40b8-a22e-d94160814423 tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] Action: 'create', calling method: .version_select at 0x7f67321bf040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1211705065", "description": "tempest-description-162318259"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:10:54.294209 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef0349d4-7b1b-4877-90b9-8894597905d5 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:54.298154 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef0349d4-7b1b-4877-90b9-8894597905d5 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:54.299092 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef0349d4-7b1b-4877-90b9-8894597905d5 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:54.299854 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef0349d4-7b1b-4877-90b9-8894597905d5 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:54.300711 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef0349d4-7b1b-4877-90b9-8894597905d5 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:54.342457 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:10:55.747710 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ef0349d4-7b1b-4877-90b9-8894597905d5 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:55.757301 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ef0349d4-7b1b-4877-90b9-8894597905d5 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1" status: 200 len: 1355 microversion: 2.1 time: 1.527870 Oct 26 13:10:55.775563 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1122/2180] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:10:54 2022] GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1 => generated 1355 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:55.780789 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c2e295cb-a1e1-4df7-8a85-3a21e398b917 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:55.781391 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c2e295cb-a1e1-4df7-8a85-3a21e398b917 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: e57fd56b-c9ce-4668-b9ff-703b4b310d1a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:55.803425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2e295cb-a1e1-4df7-8a85-3a21e398b917 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:55.817272 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2e295cb-a1e1-4df7-8a85-3a21e398b917 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:55.817827 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2e295cb-a1e1-4df7-8a85-3a21e398b917 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:55.818606 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2e295cb-a1e1-4df7-8a85-3a21e398b917 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:55.819079 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2e295cb-a1e1-4df7-8a85-3a21e398b917 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:55.819611 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2e295cb-a1e1-4df7-8a85-3a21e398b917 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:56.137685 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c2e295cb-a1e1-4df7-8a85-3a21e398b917 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4c9b05864d4d448b1c722659a3bc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2336994846d345aa86b5fd940d1b004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:56.154369 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c2e295cb-a1e1-4df7-8a85-3a21e398b917 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/e57fd56b-c9ce-4668-b9ff-703b4b310d1a" status: 200 len: 1275 microversion: 2.1 time: 0.377699 Oct 26 13:10:56.160354 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1123/2181] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:10:55 2022] GET /compute/v2.1/servers/e57fd56b-c9ce-4668-b9ff-703b4b310d1a => generated 1275 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:56.165197 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-02083a0e-384b-48ba-9eb9-eacec7a567d3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67321a1790>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:56.266670 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-02083a0e-384b-48ba-9eb9-eacec7a567d3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04" status: 200 len: 1423 microversion: 2.1 time: 0.099940 Oct 26 13:10:56.267326 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1124/2182] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:10:56 2022] GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04 => generated 1423 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:56.291140 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-aeca3b30-cb0b-44d5-b15d-67fbc1ff369f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f6731f57d30>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:56.374288 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-aeca3b30-cb0b-44d5-b15d-67fbc1ff369f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04" status: 200 len: 1423 microversion: 2.1 time: 0.095504 Oct 26 13:10:56.375300 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1125/2183] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:10:56 2022] GET /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04 => generated 1423 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:56.383459 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-ec2e5891-36b9-4a24-bac1-0d78f270f00c req-a602d4ae-4af2-4f9c-bb8b-3cff3bb1173e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a49060c-d94a-4064-8e80-ef8fe20e3ff1", "name": "network-vif-plugged", "status": "completed", "tag": "62679969-e21a-4c0d-8549-d6b3c52bd46b"}, {"server_uuid": "5a49060c-d94a-4064-8e80-ef8fe20e3ff1", "name": "network-vif-plugged", "status": "completed", "tag": "28386fec-d16c-4a5f-b2f6-7619b9050fa0"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:10:56.411768 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ec2e5891-36b9-4a24-bac1-0d78f270f00c req-a602d4ae-4af2-4f9c-bb8b-3cff3bb1173e service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:56.415802 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ec2e5891-36b9-4a24-bac1-0d78f270f00c req-a602d4ae-4af2-4f9c-bb8b-3cff3bb1173e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:56.417047 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ec2e5891-36b9-4a24-bac1-0d78f270f00c req-a602d4ae-4af2-4f9c-bb8b-3cff3bb1173e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:56.449947 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-ec2e5891-36b9-4a24-bac1-0d78f270f00c req-a602d4ae-4af2-4f9c-bb8b-3cff3bb1173e service nova] Creating event network-vif-plugged:62679969-e21a-4c0d-8549-d6b3c52bd46b for instance 5a49060c-d94a-4064-8e80-ef8fe20e3ff1 on n-h2-862686-1 Oct 26 13:10:56.452791 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-ec2e5891-36b9-4a24-bac1-0d78f270f00c req-a602d4ae-4af2-4f9c-bb8b-3cff3bb1173e service nova] Creating event network-vif-plugged:28386fec-d16c-4a5f-b2f6-7619b9050fa0 for instance 5a49060c-d94a-4064-8e80-ef8fe20e3ff1 on n-h2-862686-1 Oct 26 13:10:56.467029 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-ec2e5891-36b9-4a24-bac1-0d78f270f00c req-a602d4ae-4af2-4f9c-bb8b-3cff3bb1173e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.087697 Oct 26 13:10:56.470286 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1126/2184] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:10:56.644468 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-28266bc4-3584-43e5-9319-302ac258227e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1602374611", "imageRef": "49180fbe-4c02-4e63-acc2-aec76f7e5c04", "flavorRef": "452", "networks": [{"uuid": "259bbcbd-929e-4d48-b53c-e8ded5da783d"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:10:56.749310 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-28266bc4-3584-43e5-9319-302ac258227e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] validate_networks() for [('259bbcbd-929e-4d48-b53c-e8ded5da783d', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:10:56.797115 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f3159439-805e-40b8-a22e-d94160814423 tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 2.544278 Oct 26 13:10:56.798331 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1059/2185] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 26 13:10:54 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 2556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:10:56.811909 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6b37366d-4d38-4a02-b088-51ec8f2c61e8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:56.812848 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6b37366d-4d38-4a02-b088-51ec8f2c61e8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: 5a49060c-d94a-4064-8e80-ef8fe20e3ff1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:56.825823 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b37366d-4d38-4a02-b088-51ec8f2c61e8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:56.826656 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b37366d-4d38-4a02-b088-51ec8f2c61e8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:56.827244 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b37366d-4d38-4a02-b088-51ec8f2c61e8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:56.830669 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b37366d-4d38-4a02-b088-51ec8f2c61e8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:56.831832 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b37366d-4d38-4a02-b088-51ec8f2c61e8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:56.832440 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b37366d-4d38-4a02-b088-51ec8f2c61e8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:57.528027 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6b37366d-4d38-4a02-b088-51ec8f2c61e8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:57.547374 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6b37366d-4d38-4a02-b088-51ec8f2c61e8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1" status: 200 len: 1355 microversion: 2.1 time: 0.738610 Oct 26 13:10:57.548103 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1060/2186] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:10:56 2022] GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1 => generated 1355 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:57.566151 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5952c90c-af9c-4798-9a55-5b46e6a77654 tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] Action: 'create', calling method: .version_select at 0x7f673223a0d0>, body: {"security_group_rule": {"parent_group_id": "e0d11d6b-46e2-44e5-a646-8ba6257c7ab2", "ip_protocol": "tcp", "from_port": 986829387, "to_port": 22}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:10:57.759381 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-5952c90c-af9c-4798-9a55-5b46e6a77654 tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] HTTP exception thrown: Invalid port range 986829387:22. Former value cannot be greater than the later Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5952c90c-af9c-4798-9a55-5b46e6a77654 tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] Request method failure captured: Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 145 Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTHb3vswqjBizG6GlH2IOGvoP8uIeyT-jIq9V4VqokHz-5_rYmQgkG2BgWJwhFYh2cOchKfJfBMwkvYR-maaO1LgxeQyAYwlE0SQPTdeCYbSH5iEwjzQ2MAwDHUtnfMLS4tiJdBowMQzNK9Suf65PrUPPFowaxHsLXRNSaWqsUkah94 Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: f1228d83c0b44bf390fb1891799af9a3 Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1661532260 Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f1228d83c0b44bf390fb1891799af9a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f1228d83c0b44bf390fb1891799af9a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f1228d83c0b44bf390fb1891799af9a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f1228d83c0b44bf390fb1891799af9a3"}]}] Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1661532260 Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: f1228d83c0b44bf390fb1891799af9a3 Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1661532260 Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: fc5e9b0a4e2d4432b28817e45f543328 Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: {"security_group_rule": {"parent_group_id": "e0d11d6b-46e2-44e5-a646-8ba6257c7ab2", "ip_protocol": "tcp", "from_port": 986829387, "to_port": 22}} Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: method: Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: exception: Invalid port range 986829387:22. Former value cannot be greater than the later Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'e0d11d6b-46e2-44e5-a646-8ba6257c7ab2', 'ip_protocol': 'tcp', 'from_port': 986829387, 'to_port': 22}}} Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 986829387:22. Former value cannot be greater than the later Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 986829387:22. Former value cannot be greater than the later Oct 26 13:10:57.762307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:57.765628 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:10:57.765628 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:57.765628 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:57.765628 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:10:57.765628 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:10:57.765628 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:10:57.765628 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:10:57.765628 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 986829387:22. Former value cannot be greater than the later Oct 26 13:10:57.765628 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:10:57.765628 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5952c90c-af9c-4798-9a55-5b46e6a77654 tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] Returning 400 to user: Invalid port range 986829387:22. Former value cannot be greater than the later {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:10:57.765628 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5952c90c-af9c-4798-9a55-5b46e6a77654 tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.214329 Oct 26 13:10:57.765628 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1061/2187] 10.222.0.40 () {60 vars in 1195 bytes} [Wed Oct 26 13:10:57 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 215 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:10:57.782197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-36492b57-e0fa-41c4-8ea7-b6ebe0ce06f7 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:57.782817 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-36492b57-e0fa-41c4-8ea7-b6ebe0ce06f7 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: e57fd56b-c9ce-4668-b9ff-703b4b310d1a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:57.805113 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-36492b57-e0fa-41c4-8ea7-b6ebe0ce06f7 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:57.806438 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-36492b57-e0fa-41c4-8ea7-b6ebe0ce06f7 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:57.807115 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-36492b57-e0fa-41c4-8ea7-b6ebe0ce06f7 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:57.809544 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-36492b57-e0fa-41c4-8ea7-b6ebe0ce06f7 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:57.810260 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-36492b57-e0fa-41c4-8ea7-b6ebe0ce06f7 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:57.810900 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-36492b57-e0fa-41c4-8ea7-b6ebe0ce06f7 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:57.815838 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=97 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:10:58.093745 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-28266bc4-3584-43e5-9319-302ac258227e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:10:58.094762 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-28266bc4-3584-43e5-9319-302ac258227e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:10:58.104175 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-28266bc4-3584-43e5-9319-302ac258227e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:10:58.105336 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-28266bc4-3584-43e5-9319-302ac258227e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:10:58.106115 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-28266bc4-3584-43e5-9319-302ac258227e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:10:58.141055 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28266bc4-3584-43e5-9319-302ac258227e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:58.141567 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28266bc4-3584-43e5-9319-302ac258227e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:58.142003 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28266bc4-3584-43e5-9319-302ac258227e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:58.142726 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28266bc4-3584-43e5-9319-302ac258227e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:58.143175 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28266bc4-3584-43e5-9319-302ac258227e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:58.143596 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28266bc4-3584-43e5-9319-302ac258227e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:58.249515 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-28266bc4-3584-43e5-9319-302ac258227e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Getting quotas for project cc4a21e57f1c4fd1ab3c60f6416f8b11. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:10:58.272169 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-28266bc4-3584-43e5-9319-302ac258227e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Getting quotas for user e3707c34798c48d584cff9dd46d9d7c0 and project cc4a21e57f1c4fd1ab3c60f6416f8b11. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:10:58.337674 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-28266bc4-3584-43e5-9319-302ac258227e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:10:58.342986 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-28266bc4-3584-43e5-9319-302ac258227e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 6a7c952c-3ac4-4fad-b539-13a7ed9a2056] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='49180fbe-4c02-4e63-acc2-aec76f7e5c04',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:10:58.498296 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-28266bc4-3584-43e5-9319-302ac258227e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.863393 Oct 26 13:10:58.499665 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1127/2188] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:10:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:10:58.512129 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-205c6d88-15bc-45f7-b193-b1ebab519efe tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] Action: 'create', calling method: .version_select at 0x7f6731f57820>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1024890930", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:10:58.516023 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-205c6d88-15bc-45f7-b193-b1ebab519efe tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] HTTP exception thrown: Security group id should be uuid Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-205c6d88-15bc-45f7-b193-b1ebab519efe tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] Request method failure captured: Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 131 Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTHb3vswqjBizG6GlH2IOGvoP8uIeyT-jIq9V4VqokHz-5_rYmQgkG2BgWJwhFYh2cOchKfJfBMwkvYR-maaO1LgxeQyAYwlE0SQPTdeCYbSH5iEwjzQ2MAwDHUtnfMLS4tiJdBowMQzNK9Suf65PrUPPFowaxHsLXRNSaWqsUkah94 Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: f1228d83c0b44bf390fb1891799af9a3 Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1661532260 Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f1228d83c0b44bf390fb1891799af9a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f1228d83c0b44bf390fb1891799af9a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f1228d83c0b44bf390fb1891799af9a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f1228d83c0b44bf390fb1891799af9a3"}]}] Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1661532260 Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: f1228d83c0b44bf390fb1891799af9a3 Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1661532260 Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: fc5e9b0a4e2d4432b28817e45f543328 Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1024890930", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: exception: Security group id should be uuid Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1024890930', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:10:58.521860 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:10:58.525317 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 26 13:10:58.525317 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:10:58.526828 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-205c6d88-15bc-45f7-b193-b1ebab519efe tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] Returning 400 to user: Security group id should be uuid {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:10:58.529720 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-205c6d88-15bc-45f7-b193-b1ebab519efe tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.028257 Oct 26 13:10:58.530715 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1128/2189] 10.222.0.40 () {60 vars in 1195 bytes} [Wed Oct 26 13:10:58 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 26 13:10:58.555196 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-01bdf9f2-f464-4a39-8741-98d2a2f8117e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:58.557196 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-01bdf9f2-f464-4a39-8741-98d2a2f8117e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 6a7c952c-3ac4-4fad-b539-13a7ed9a2056] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:58.803838 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-01bdf9f2-f464-4a39-8741-98d2a2f8117e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:58.820263 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-01bdf9f2-f464-4a39-8741-98d2a2f8117e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056" status: 200 len: 1208 microversion: 2.1 time: 0.284200 Oct 26 13:10:58.827213 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1129/2190] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:10:58 2022] GET /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056 => generated 1208 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:58.845363 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1558b632-ec08-4bd5-a1be-6d0f85bed1c3 tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] Action: 'create', calling method: .version_select at 0x7f6732537e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-427630866", "description": "tempest-description-1276883729"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:10:59.124868 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-36492b57-e0fa-41c4-8ea7-b6ebe0ce06f7 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4c9b05864d4d448b1c722659a3bc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2336994846d345aa86b5fd940d1b004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:10:59.133830 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-36492b57-e0fa-41c4-8ea7-b6ebe0ce06f7 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/e57fd56b-c9ce-4668-b9ff-703b4b310d1a" status: 200 len: 1317 microversion: 2.1 time: 1.368472 Oct 26 13:10:59.139972 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1062/2191] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:10:57 2022] GET /compute/v2.1/servers/e57fd56b-c9ce-4668-b9ff-703b4b310d1a => generated 1317 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:10:59.176822 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6cdb0519-bd13-4f39-9237-191ea01f4ba6 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:10:59.179662 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6cdb0519-bd13-4f39-9237-191ea01f4ba6 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: 5a49060c-d94a-4064-8e80-ef8fe20e3ff1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:10:59.209271 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6cdb0519-bd13-4f39-9237-191ea01f4ba6 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:59.210527 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6cdb0519-bd13-4f39-9237-191ea01f4ba6 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:59.221028 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6cdb0519-bd13-4f39-9237-191ea01f4ba6 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:10:59.222975 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6cdb0519-bd13-4f39-9237-191ea01f4ba6 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:10:59.223656 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6cdb0519-bd13-4f39-9237-191ea01f4ba6 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:10:59.226726 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6cdb0519-bd13-4f39-9237-191ea01f4ba6 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:00.030213 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6cdb0519-bd13-4f39-9237-191ea01f4ba6 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:00.041687 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6cdb0519-bd13-4f39-9237-191ea01f4ba6 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1" status: 200 len: 1805 microversion: 2.1 time: 0.894626 Oct 26 13:11:00.045772 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1063/2192] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:10:59 2022] GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1 => generated 1805 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:00.070503 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1cbb9e7c-4462-45f3-b33a-5b4416d1b5af tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:00.071431 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1cbb9e7c-4462-45f3-b33a-5b4416d1b5af tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 6a7c952c-3ac4-4fad-b539-13a7ed9a2056] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:00.087933 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1cbb9e7c-4462-45f3-b33a-5b4416d1b5af tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:00.090012 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1cbb9e7c-4462-45f3-b33a-5b4416d1b5af tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:00.091749 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1cbb9e7c-4462-45f3-b33a-5b4416d1b5af tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:00.092734 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1cbb9e7c-4462-45f3-b33a-5b4416d1b5af tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:00.093513 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1cbb9e7c-4462-45f3-b33a-5b4416d1b5af tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:00.094158 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1cbb9e7c-4462-45f3-b33a-5b4416d1b5af tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:00.622899 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1cbb9e7c-4462-45f3-b33a-5b4416d1b5af tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:00.633373 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1cbb9e7c-4462-45f3-b33a-5b4416d1b5af tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056" status: 200 len: 1260 microversion: 2.1 time: 0.586282 Oct 26 13:11:00.634356 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1064/2193] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:00 2022] GET /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056 => generated 1260 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:00.656206 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-34d3165a-f2db-4950-8188-adfc9db1dd5b tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:00.657103 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-34d3165a-f2db-4950-8188-adfc9db1dd5b tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: 5a49060c-d94a-4064-8e80-ef8fe20e3ff1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:00.675474 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-34d3165a-f2db-4950-8188-adfc9db1dd5b tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:00.676388 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-34d3165a-f2db-4950-8188-adfc9db1dd5b tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:00.682041 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-34d3165a-f2db-4950-8188-adfc9db1dd5b tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:00.683261 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-34d3165a-f2db-4950-8188-adfc9db1dd5b tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:00.684956 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-34d3165a-f2db-4950-8188-adfc9db1dd5b tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:00.691810 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-34d3165a-f2db-4950-8188-adfc9db1dd5b tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:00.763976 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-34d3165a-f2db-4950-8188-adfc9db1dd5b tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1/ips" status: 200 len: 218 microversion: 2.1 time: 0.114463 Oct 26 13:11:00.765233 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1065/2194] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Oct 26 13:11:00 2022] GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1/ips => generated 218 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:11:00.778159 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ca1e298e-cdc0-497f-a9b2-d1072893211b tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:00.778997 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ca1e298e-cdc0-497f-a9b2-d1072893211b tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: e57fd56b-c9ce-4668-b9ff-703b4b310d1a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:00.797453 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ca1e298e-cdc0-497f-a9b2-d1072893211b tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:00.798206 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ca1e298e-cdc0-497f-a9b2-d1072893211b tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:00.798786 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ca1e298e-cdc0-497f-a9b2-d1072893211b tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:00.799637 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ca1e298e-cdc0-497f-a9b2-d1072893211b tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:00.800276 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ca1e298e-cdc0-497f-a9b2-d1072893211b tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:00.802042 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ca1e298e-cdc0-497f-a9b2-d1072893211b tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:01.090313 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1558b632-ec08-4bd5-a1be-6d0f85bed1c3 tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 2.259519 Oct 26 13:11:01.091908 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1130/2195] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 26 13:10:58 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 2264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:11:01.104970 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-99c611e9-c78e-4b8f-bd0c-9b3d45a11cbc tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:01.106012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-99c611e9-c78e-4b8f-bd0c-9b3d45a11cbc tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: 5a49060c-d94a-4064-8e80-ef8fe20e3ff1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:01.119711 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99c611e9-c78e-4b8f-bd0c-9b3d45a11cbc tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:01.122154 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99c611e9-c78e-4b8f-bd0c-9b3d45a11cbc tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:01.123879 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99c611e9-c78e-4b8f-bd0c-9b3d45a11cbc tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:01.126292 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99c611e9-c78e-4b8f-bd0c-9b3d45a11cbc tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:01.127622 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99c611e9-c78e-4b8f-bd0c-9b3d45a11cbc tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:01.130698 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99c611e9-c78e-4b8f-bd0c-9b3d45a11cbc tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:01.197632 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-99c611e9-c78e-4b8f-bd0c-9b3d45a11cbc tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: 5a49060c-d94a-4064-8e80-ef8fe20e3ff1] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:11:01.384057 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-99c611e9-c78e-4b8f-bd0c-9b3d45a11cbc tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1" status: 204 len: 0 microversion: 2.1 time: 0.290435 Oct 26 13:11:01.384985 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1131/2196] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:11:01 2022] DELETE /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:11:01.392205 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5c13d526-fd05-4509-9dc0-aa39da753978 tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] Action: 'create', calling method: .version_select at 0x7f6731f543a0>, body: {"security_group_rule": {"parent_group_id": "50bc60b1-4e4b-4cb7-82a0-dd7c223e49d1", "ip_protocol": "tempest-999-2048964906", "from_port": 22, "to_port": 22}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:11:01.575485 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-5c13d526-fd05-4509-9dc0-aa39da753978 tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] HTTP exception thrown: Invalid IP protocol tempest-999-2048964906. Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5c13d526-fd05-4509-9dc0-aa39da753978 tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] Request method failure captured: Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 157 Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTHb3vswqjBizG6GlH2IOGvoP8uIeyT-jIq9V4VqokHz-5_rYmQgkG2BgWJwhFYh2cOchKfJfBMwkvYR-maaO1LgxeQyAYwlE0SQPTdeCYbSH5iEwjzQ2MAwDHUtnfMLS4tiJdBowMQzNK9Suf65PrUPPFowaxHsLXRNSaWqsUkah94 Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: f1228d83c0b44bf390fb1891799af9a3 Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1661532260 Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f1228d83c0b44bf390fb1891799af9a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f1228d83c0b44bf390fb1891799af9a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f1228d83c0b44bf390fb1891799af9a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f1228d83c0b44bf390fb1891799af9a3"}]}] Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1661532260 Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: f1228d83c0b44bf390fb1891799af9a3 Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1661532260 Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: fc5e9b0a4e2d4432b28817e45f543328 Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: {"security_group_rule": {"parent_group_id": "50bc60b1-4e4b-4cb7-82a0-dd7c223e49d1", "ip_protocol": "tempest-999-2048964906", "from_port": 22, "to_port": 22}} Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: exception: Invalid IP protocol tempest-999-2048964906. Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'body': {'security_group_rule': {'parent_group_id': '50bc60b1-4e4b-4cb7-82a0-dd7c223e49d1', 'ip_protocol': 'tempest-999-2048964906', 'from_port': 22, 'to_port': 22}}} Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-2048964906. Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-2048964906. Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:11:01.577297 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:11:01.586790 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:11:01.586790 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:11:01.586790 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:11:01.586790 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:11:01.586790 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:11:01.586790 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:11:01.586790 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-2048964906. Oct 26 13:11:01.586790 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:11:01.586790 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5c13d526-fd05-4509-9dc0-aa39da753978 tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] Returning 400 to user: Invalid IP protocol tempest-999-2048964906. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:11:01.586790 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5c13d526-fd05-4509-9dc0-aa39da753978 tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.192637 Oct 26 13:11:01.586790 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1132/2197] 10.222.0.40 () {60 vars in 1195 bytes} [Wed Oct 26 13:11:01 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 194 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 26 13:11:01.589275 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2abfb935-f0ad-4dcd-b4f6-50b45166940c tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:01.590048 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2abfb935-f0ad-4dcd-b4f6-50b45166940c tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: 5a49060c-d94a-4064-8e80-ef8fe20e3ff1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:01.617019 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2abfb935-f0ad-4dcd-b4f6-50b45166940c tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:01.617555 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2abfb935-f0ad-4dcd-b4f6-50b45166940c tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:01.620692 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2abfb935-f0ad-4dcd-b4f6-50b45166940c tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:01.621247 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2abfb935-f0ad-4dcd-b4f6-50b45166940c tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:01.621749 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2abfb935-f0ad-4dcd-b4f6-50b45166940c tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:01.622185 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2abfb935-f0ad-4dcd-b4f6-50b45166940c tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:01.767248 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ca1e298e-cdc0-497f-a9b2-d1072893211b tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4c9b05864d4d448b1c722659a3bc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2336994846d345aa86b5fd940d1b004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:01.781974 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ca1e298e-cdc0-497f-a9b2-d1072893211b tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/e57fd56b-c9ce-4668-b9ff-703b4b310d1a" status: 200 len: 1317 microversion: 2.1 time: 1.010176 Oct 26 13:11:01.785472 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1066/2198] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:00 2022] GET /compute/v2.1/servers/e57fd56b-c9ce-4668-b9ff-703b4b310d1a => generated 1317 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:01.811129 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-aeb76fe4-c02b-4df9-90e8-a99ca3a23a13 tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] Action: 'create', calling method: .version_select at 0x7f67369b54c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-180716247", "description": "tempest-description-598377162"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:11:02.035657 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2abfb935-f0ad-4dcd-b4f6-50b45166940c tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:02.052378 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2abfb935-f0ad-4dcd-b4f6-50b45166940c tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1" status: 200 len: 1811 microversion: 2.1 time: 0.471506 Oct 26 13:11:02.054335 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1133/2199] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:01 2022] GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1 => generated 1811 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:02.078189 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-e16cca69-afbc-446e-a6ec-eeb4596fab58 req-a74d65da-7d76-4a6f-b2a5-0173b9426639 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31d4915d-93b9-445d-aad6-4fbc96fd5326", "name": "network-vif-unplugged", "status": "completed", "tag": "3438b228-4d60-45ce-9603-e5edd9a6df9a"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:11:02.101835 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e16cca69-afbc-446e-a6ec-eeb4596fab58 req-a74d65da-7d76-4a6f-b2a5-0173b9426639 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:02.102727 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e16cca69-afbc-446e-a6ec-eeb4596fab58 req-a74d65da-7d76-4a6f-b2a5-0173b9426639 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:02.103178 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e16cca69-afbc-446e-a6ec-eeb4596fab58 req-a74d65da-7d76-4a6f-b2a5-0173b9426639 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:02.135705 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-e16cca69-afbc-446e-a6ec-eeb4596fab58 req-a74d65da-7d76-4a6f-b2a5-0173b9426639 service nova] Creating event network-vif-unplugged:3438b228-4d60-45ce-9603-e5edd9a6df9a for instance 31d4915d-93b9-445d-aad6-4fbc96fd5326 on n-h1-862686-1 Oct 26 13:11:02.154227 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-e16cca69-afbc-446e-a6ec-eeb4596fab58 req-a74d65da-7d76-4a6f-b2a5-0173b9426639 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097378 Oct 26 13:11:02.159057 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1134/2200] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:11:02.170603 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bc761ee9-4406-4bc4-99d0-00c0ae2ef377 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:02.173710 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bc761ee9-4406-4bc4-99d0-00c0ae2ef377 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 6a7c952c-3ac4-4fad-b539-13a7ed9a2056] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:02.189350 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc761ee9-4406-4bc4-99d0-00c0ae2ef377 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:02.190198 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc761ee9-4406-4bc4-99d0-00c0ae2ef377 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:02.191337 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc761ee9-4406-4bc4-99d0-00c0ae2ef377 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:02.192226 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc761ee9-4406-4bc4-99d0-00c0ae2ef377 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:02.192951 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc761ee9-4406-4bc4-99d0-00c0ae2ef377 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:02.194713 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc761ee9-4406-4bc4-99d0-00c0ae2ef377 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:02.360437 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bc761ee9-4406-4bc4-99d0-00c0ae2ef377 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:02.375339 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bc761ee9-4406-4bc4-99d0-00c0ae2ef377 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056" status: 200 len: 1266 microversion: 2.1 time: 0.214882 Oct 26 13:11:02.383571 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1135/2201] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:02 2022] GET /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056 => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:02.731038 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f7b5f373-c33c-44ef-99f4-70145a6b5864 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1920506567", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:11:02.812007 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-f7b5f373-c33c-44ef-99f4-70145a6b5864 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] validate_networks() for [('4a773957-72d6-4c1e-ba7d-408dfcfd6ae3', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:11:03.640187 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-f7b5f373-c33c-44ef-99f4-70145a6b5864 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:11:03.640848 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-f7b5f373-c33c-44ef-99f4-70145a6b5864 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:11:03.641902 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-f7b5f373-c33c-44ef-99f4-70145a6b5864 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:11:03.642491 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-f7b5f373-c33c-44ef-99f4-70145a6b5864 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:11:03.642938 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-f7b5f373-c33c-44ef-99f4-70145a6b5864 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:11:03.656258 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7b5f373-c33c-44ef-99f4-70145a6b5864 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:03.656792 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7b5f373-c33c-44ef-99f4-70145a6b5864 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:03.657476 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7b5f373-c33c-44ef-99f4-70145a6b5864 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:03.658415 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7b5f373-c33c-44ef-99f4-70145a6b5864 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:03.659434 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7b5f373-c33c-44ef-99f4-70145a6b5864 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:03.660328 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7b5f373-c33c-44ef-99f4-70145a6b5864 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:03.691306 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-f7b5f373-c33c-44ef-99f4-70145a6b5864 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Getting quotas for project 5902169366b646c7be94cb3521377225. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:11:03.706997 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-f7b5f373-c33c-44ef-99f4-70145a6b5864 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Getting quotas for user 0a8fd7d2f8014b85beecc30c93bc084d and project 5902169366b646c7be94cb3521377225. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:11:03.727789 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f7b5f373-c33c-44ef-99f4-70145a6b5864 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:11:03.731328 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f7b5f373-c33c-44ef-99f4-70145a6b5864 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] [instance: 6555760c-8bf4-467e-80cb-cdf6eee4b93c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:11:03.834466 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f7b5f373-c33c-44ef-99f4-70145a6b5864 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.319812 Oct 26 13:11:03.835785 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1136/2202] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:11:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 1322 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:11:03.843505 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ec95e8ec-ac34-424c-9f98-5b20c4558104 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:03.844141 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ec95e8ec-ac34-424c-9f98-5b20c4558104 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: e57fd56b-c9ce-4668-b9ff-703b4b310d1a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:03.855124 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec95e8ec-ac34-424c-9f98-5b20c4558104 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:03.856258 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec95e8ec-ac34-424c-9f98-5b20c4558104 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:03.857053 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec95e8ec-ac34-424c-9f98-5b20c4558104 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:03.858348 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec95e8ec-ac34-424c-9f98-5b20c4558104 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:03.859579 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec95e8ec-ac34-424c-9f98-5b20c4558104 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:03.860160 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec95e8ec-ac34-424c-9f98-5b20c4558104 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:04.119640 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ec95e8ec-ac34-424c-9f98-5b20c4558104 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4c9b05864d4d448b1c722659a3bc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2336994846d345aa86b5fd940d1b004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:04.135145 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ec95e8ec-ac34-424c-9f98-5b20c4558104 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/e57fd56b-c9ce-4668-b9ff-703b4b310d1a" status: 200 len: 1317 microversion: 2.1 time: 0.291386 Oct 26 13:11:04.135897 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1137/2203] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:03 2022] GET /compute/v2.1/servers/e57fd56b-c9ce-4668-b9ff-703b4b310d1a => generated 1317 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:04.150544 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6593bcb8-2265-46fe-b22b-0d12751072f7 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:04.151186 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6593bcb8-2265-46fe-b22b-0d12751072f7 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: 5a49060c-d94a-4064-8e80-ef8fe20e3ff1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:04.165829 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6593bcb8-2265-46fe-b22b-0d12751072f7 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:04.166420 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6593bcb8-2265-46fe-b22b-0d12751072f7 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:04.166890 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6593bcb8-2265-46fe-b22b-0d12751072f7 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:04.171438 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6593bcb8-2265-46fe-b22b-0d12751072f7 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:04.172036 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6593bcb8-2265-46fe-b22b-0d12751072f7 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:04.172491 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6593bcb8-2265-46fe-b22b-0d12751072f7 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:04.548873 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6593bcb8-2265-46fe-b22b-0d12751072f7 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:04.568605 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6593bcb8-2265-46fe-b22b-0d12751072f7 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1" status: 200 len: 1811 microversion: 2.1 time: 0.430528 Oct 26 13:11:04.569176 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1138/2204] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:04 2022] GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1 => generated 1811 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:04.583318 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a4825c52-06a3-4700-aabc-295f28344853 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:04.584328 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a4825c52-06a3-4700-aabc-295f28344853 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 6a7c952c-3ac4-4fad-b539-13a7ed9a2056] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:04.599981 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4825c52-06a3-4700-aabc-295f28344853 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:04.602944 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4825c52-06a3-4700-aabc-295f28344853 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:04.603749 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4825c52-06a3-4700-aabc-295f28344853 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:04.610229 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4825c52-06a3-4700-aabc-295f28344853 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:04.610856 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4825c52-06a3-4700-aabc-295f28344853 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:04.611459 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4825c52-06a3-4700-aabc-295f28344853 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:04.771609 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a4825c52-06a3-4700-aabc-295f28344853 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:04.780111 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a4825c52-06a3-4700-aabc-295f28344853 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056" status: 200 len: 1266 microversion: 2.1 time: 0.208382 Oct 26 13:11:04.780714 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1139/2205] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:04 2022] GET /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056 => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:04.796184 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-29ca706c-5db3-47dd-95c4-bb697ddfc06b tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:04.796858 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-29ca706c-5db3-47dd-95c4-bb697ddfc06b tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] [instance: 6555760c-8bf4-467e-80cb-cdf6eee4b93c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:04.900250 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-29ca706c-5db3-47dd-95c4-bb697ddfc06b tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8fd7d2f8014b85beecc30c93bc084d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5902169366b646c7be94cb3521377225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:04.911623 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-29ca706c-5db3-47dd-95c4-bb697ddfc06b tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] 10.222.0.40 "GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c" status: 200 len: 1223 microversion: 2.1 time: 0.128756 Oct 26 13:11:04.913608 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1140/2206] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:04 2022] GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c => generated 1223 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:05.163811 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-68778280-b4fa-426d-b814-9ae14c29b5df tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:05.168518 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-68778280-b4fa-426d-b814-9ae14c29b5df tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: e57fd56b-c9ce-4668-b9ff-703b4b310d1a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:05.194739 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68778280-b4fa-426d-b814-9ae14c29b5df tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:05.195475 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68778280-b4fa-426d-b814-9ae14c29b5df tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:05.196121 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68778280-b4fa-426d-b814-9ae14c29b5df tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:05.197031 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68778280-b4fa-426d-b814-9ae14c29b5df tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:05.198321 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68778280-b4fa-426d-b814-9ae14c29b5df tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:05.199020 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68778280-b4fa-426d-b814-9ae14c29b5df tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:05.271936 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-aeb76fe4-c02b-4df9-90e8-a99ca3a23a13 tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 3.484736 Oct 26 13:11:05.273876 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1067/2207] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 26 13:11:01 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 3488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:11:05.286694 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fb29dc1b-8fd1-4665-808d-51bd2e3663ce tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] Action: 'create', calling method: .version_select at 0x7f673694bee0>, body: {"security_group_rule": {"parent_group_id": "d63b155a-5078-49d6-841c-a2f1b2dac0da", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:11:05.578141 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-68778280-b4fa-426d-b814-9ae14c29b5df tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4c9b05864d4d448b1c722659a3bc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2336994846d345aa86b5fd940d1b004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:05.589902 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-68778280-b4fa-426d-b814-9ae14c29b5df tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/e57fd56b-c9ce-4668-b9ff-703b4b310d1a" status: 200 len: 1317 microversion: 2.1 time: 0.431045 Oct 26 13:11:05.638254 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1141/2208] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:05 2022] GET /compute/v2.1/servers/e57fd56b-c9ce-4668-b9ff-703b4b310d1a => generated 1317 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:05.662554 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-48481066-f161-4f08-9b08-df5154d14eea tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:05.663253 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-48481066-f161-4f08-9b08-df5154d14eea tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: 5a49060c-d94a-4064-8e80-ef8fe20e3ff1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:05.679741 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48481066-f161-4f08-9b08-df5154d14eea tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:05.680796 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48481066-f161-4f08-9b08-df5154d14eea tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:05.681391 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48481066-f161-4f08-9b08-df5154d14eea tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:05.682391 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48481066-f161-4f08-9b08-df5154d14eea tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:05.683030 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48481066-f161-4f08-9b08-df5154d14eea tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:05.684181 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48481066-f161-4f08-9b08-df5154d14eea tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:05.745141 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-fb29dc1b-8fd1-4665-808d-51bd2e3663ce tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fb29dc1b-8fd1-4665-808d-51bd2e3663ce tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] Request method failure captured: Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 138 Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTHb3vswqjBizG6GlH2IOGvoP8uIeyT-jIq9V4VqokHz-5_rYmQgkG2BgWJwhFYh2cOchKfJfBMwkvYR-maaO1LgxeQyAYwlE0SQPTdeCYbSH5iEwjzQ2MAwDHUtnfMLS4tiJdBowMQzNK9Suf65PrUPPFowaxHsLXRNSaWqsUkah94 Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: f1228d83c0b44bf390fb1891799af9a3 Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1661532260 Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f1228d83c0b44bf390fb1891799af9a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f1228d83c0b44bf390fb1891799af9a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f1228d83c0b44bf390fb1891799af9a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f1228d83c0b44bf390fb1891799af9a3"}]}] Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1661532260 Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: f1228d83c0b44bf390fb1891799af9a3 Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1661532260 Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: fc5e9b0a4e2d4432b28817e45f543328 Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: {"security_group_rule": {"parent_group_id": "d63b155a-5078-49d6-841c-a2f1b2dac0da", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: method: Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'd63b155a-5078-49d6-841c-a2f1b2dac0da', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 26 13:11:05.748087 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:11:05.751123 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:11:05.751123 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:11:05.751123 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:11:05.751123 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:11:05.751123 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:11:05.751123 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:11:05.751123 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:11:05.751123 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 26 13:11:05.751123 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:11:05.751123 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fb29dc1b-8fd1-4665-808d-51bd2e3663ce tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:11:05.751123 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fb29dc1b-8fd1-4665-808d-51bd2e3663ce tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.467549 Oct 26 13:11:05.756275 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1068/2209] 10.222.0.40 () {60 vars in 1195 bytes} [Wed Oct 26 13:11:05 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 475 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 26 13:11:05.764091 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ccc7c99b-9b46-4928-a9da-138d0eff4a93 tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] Action: 'create', calling method: .version_select at 0x7f67369b24c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1431899846", "description": "tempest-description-99058737"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:11:06.187864 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-48481066-f161-4f08-9b08-df5154d14eea tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:06.197856 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-48481066-f161-4f08-9b08-df5154d14eea tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1" status: 200 len: 1811 microversion: 2.1 time: 0.556070 Oct 26 13:11:06.206785 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1142/2210] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:05 2022] GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1 => generated 1811 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:06.596724 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-667b2e7f-37e8-4e9d-ae59-5e12ff9d91ac tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:06.597500 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-667b2e7f-37e8-4e9d-ae59-5e12ff9d91ac tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 6a7c952c-3ac4-4fad-b539-13a7ed9a2056] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:06.605209 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-667b2e7f-37e8-4e9d-ae59-5e12ff9d91ac tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:06.635542 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-667b2e7f-37e8-4e9d-ae59-5e12ff9d91ac tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:06.638663 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-667b2e7f-37e8-4e9d-ae59-5e12ff9d91ac tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:06.643499 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-667b2e7f-37e8-4e9d-ae59-5e12ff9d91ac tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:06.647019 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-667b2e7f-37e8-4e9d-ae59-5e12ff9d91ac tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:06.677098 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-667b2e7f-37e8-4e9d-ae59-5e12ff9d91ac tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:06.950231 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-667b2e7f-37e8-4e9d-ae59-5e12ff9d91ac tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:06.974123 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-667b2e7f-37e8-4e9d-ae59-5e12ff9d91ac tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056" status: 200 len: 1266 microversion: 2.1 time: 0.755184 Oct 26 13:11:06.978881 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1143/2211] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:06 2022] GET /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056 => generated 1266 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:07.009394 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-14709aba-ccb4-4d67-8906-7b4291a5c8e7 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:07.013956 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-14709aba-ccb4-4d67-8906-7b4291a5c8e7 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] [instance: 6555760c-8bf4-467e-80cb-cdf6eee4b93c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:07.027899 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-14709aba-ccb4-4d67-8906-7b4291a5c8e7 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:07.028687 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-14709aba-ccb4-4d67-8906-7b4291a5c8e7 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:07.029653 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-14709aba-ccb4-4d67-8906-7b4291a5c8e7 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:07.031184 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-14709aba-ccb4-4d67-8906-7b4291a5c8e7 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:07.032998 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-14709aba-ccb4-4d67-8906-7b4291a5c8e7 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:07.033633 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-14709aba-ccb4-4d67-8906-7b4291a5c8e7 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:07.275314 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-14709aba-ccb4-4d67-8906-7b4291a5c8e7 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8fd7d2f8014b85beecc30c93bc084d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5902169366b646c7be94cb3521377225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:07.283271 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-14709aba-ccb4-4d67-8906-7b4291a5c8e7 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] 10.222.0.40 "GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c" status: 200 len: 1281 microversion: 2.1 time: 0.288684 Oct 26 13:11:07.289815 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1144/2212] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:06 2022] GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c => generated 1281 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:07.522183 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-37b7d382-8bc2-485e-a35b-c74dd364912a tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Action: 'create', calling method: .version_select at 0x7f6731f92ee0>, body: {"keypair": {"name": "tempest-keypair-2021685027", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvc/KTh4zS11M3Vjw4+wdXnjrQgKvVYjzwtEIgF8sK3IFS8tbASLDjdSdKI0QoEiUH4FKNlau7z44g6yLcdV0nHJxO0HtXiEVnSBaznW+a1tGjliCoZSzqxhyPbVFAEQw=="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:11:07.574937 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-37b7d382-8bc2-485e-a35b-c74dd364912a tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Getting quotas for project dfd2c80c6e164a708040af3165617a0b. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:11:07.589862 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-37b7d382-8bc2-485e-a35b-c74dd364912a tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Getting quotas for user 329c4c283e1646f295472c59225753de and project dfd2c80c6e164a708040af3165617a0b. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:11:07.633979 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:11:07.670021 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-37b7d382-8bc2-485e-a35b-c74dd364912a tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.378760 Oct 26 13:11:07.670647 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1145/2213] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 13:11:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:11:07.688124 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-44a2002d-36cd-4b8e-a56d-4b29cef17327 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:07.689012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-44a2002d-36cd-4b8e-a56d-4b29cef17327 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: e57fd56b-c9ce-4668-b9ff-703b4b310d1a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:07.714356 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-44a2002d-36cd-4b8e-a56d-4b29cef17327 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:07.715092 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-44a2002d-36cd-4b8e-a56d-4b29cef17327 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:07.715719 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-44a2002d-36cd-4b8e-a56d-4b29cef17327 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:07.726607 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-44a2002d-36cd-4b8e-a56d-4b29cef17327 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:07.734287 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-44a2002d-36cd-4b8e-a56d-4b29cef17327 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:07.734973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-44a2002d-36cd-4b8e-a56d-4b29cef17327 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:08.607816 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-44a2002d-36cd-4b8e-a56d-4b29cef17327 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4c9b05864d4d448b1c722659a3bc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2336994846d345aa86b5fd940d1b004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:08.620034 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-44a2002d-36cd-4b8e-a56d-4b29cef17327 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/e57fd56b-c9ce-4668-b9ff-703b4b310d1a" status: 200 len: 1317 microversion: 2.1 time: 0.948129 Oct 26 13:11:08.620617 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1146/2214] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:07 2022] GET /compute/v2.1/servers/e57fd56b-c9ce-4668-b9ff-703b4b310d1a => generated 1317 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:08.648586 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-befc9a4d-af60-47e4-bea9-1fdf1c68bfaa tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:08.649920 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-befc9a4d-af60-47e4-bea9-1fdf1c68bfaa tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: 5a49060c-d94a-4064-8e80-ef8fe20e3ff1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:08.681254 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-befc9a4d-af60-47e4-bea9-1fdf1c68bfaa tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:08.682060 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-befc9a4d-af60-47e4-bea9-1fdf1c68bfaa tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:08.682742 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-befc9a4d-af60-47e4-bea9-1fdf1c68bfaa tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:08.685073 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-befc9a4d-af60-47e4-bea9-1fdf1c68bfaa tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:08.711266 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-befc9a4d-af60-47e4-bea9-1fdf1c68bfaa tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:08.711266 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-befc9a4d-af60-47e4-bea9-1fdf1c68bfaa tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:09.316611 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-befc9a4d-af60-47e4-bea9-1fdf1c68bfaa tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:09.334692 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:11:09.360750 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-befc9a4d-af60-47e4-bea9-1fdf1c68bfaa tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1" status: 200 len: 1790 microversion: 2.1 time: 0.739061 Oct 26 13:11:09.368486 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1147/2215] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:08 2022] GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1 => generated 1790 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:09.382067 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-a3bac9d1-c89e-4980-8fe6-57f1c0fc98b1 req-6a2dae86-9604-4cf7-a78f-adbf21cc4a96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e57fd56b-c9ce-4668-b9ff-703b4b310d1a", "tag": "c048e1bc-f12e-4daf-b7ad-6dc3affd08f5"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:11:09.420448 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-a3bac9d1-c89e-4980-8fe6-57f1c0fc98b1 req-6a2dae86-9604-4cf7-a78f-adbf21cc4a96 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:09.421171 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-a3bac9d1-c89e-4980-8fe6-57f1c0fc98b1 req-6a2dae86-9604-4cf7-a78f-adbf21cc4a96 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:09.421779 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-a3bac9d1-c89e-4980-8fe6-57f1c0fc98b1 req-6a2dae86-9604-4cf7-a78f-adbf21cc4a96 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:09.451704 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-a3bac9d1-c89e-4980-8fe6-57f1c0fc98b1 req-6a2dae86-9604-4cf7-a78f-adbf21cc4a96 service nova] Creating event network-changed:c048e1bc-f12e-4daf-b7ad-6dc3affd08f5 for instance e57fd56b-c9ce-4668-b9ff-703b4b310d1a on n-h1-862686-1 Oct 26 13:11:09.471986 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-a3bac9d1-c89e-4980-8fe6-57f1c0fc98b1 req-6a2dae86-9604-4cf7-a78f-adbf21cc4a96 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098984 Oct 26 13:11:09.472810 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1148/2216] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:11:09.478839 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e81c868e-60ec-4e32-80c9-56586efe11e8 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:09.484849 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e81c868e-60ec-4e32-80c9-56586efe11e8 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 6a7c952c-3ac4-4fad-b539-13a7ed9a2056] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:09.497624 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e81c868e-60ec-4e32-80c9-56586efe11e8 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:09.498600 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e81c868e-60ec-4e32-80c9-56586efe11e8 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:09.507094 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e81c868e-60ec-4e32-80c9-56586efe11e8 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:09.508216 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e81c868e-60ec-4e32-80c9-56586efe11e8 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:09.514947 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e81c868e-60ec-4e32-80c9-56586efe11e8 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:09.515723 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e81c868e-60ec-4e32-80c9-56586efe11e8 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:09.704365 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e81c868e-60ec-4e32-80c9-56586efe11e8 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:09.720328 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e81c868e-60ec-4e32-80c9-56586efe11e8 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056" status: 200 len: 1266 microversion: 2.1 time: 0.245879 Oct 26 13:11:09.729650 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1149/2217] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:09 2022] GET /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056 => generated 1266 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:09.751801 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f165a57d-bda4-4f52-8df8-d4e359ba8c33 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:09.759816 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f165a57d-bda4-4f52-8df8-d4e359ba8c33 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] [instance: 6555760c-8bf4-467e-80cb-cdf6eee4b93c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:09.779438 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f165a57d-bda4-4f52-8df8-d4e359ba8c33 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:09.779940 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f165a57d-bda4-4f52-8df8-d4e359ba8c33 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:09.780387 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f165a57d-bda4-4f52-8df8-d4e359ba8c33 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:09.781118 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f165a57d-bda4-4f52-8df8-d4e359ba8c33 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:09.781613 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f165a57d-bda4-4f52-8df8-d4e359ba8c33 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:09.782048 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f165a57d-bda4-4f52-8df8-d4e359ba8c33 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:10.548366 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ccc7c99b-9b46-4928-a9da-138d0eff4a93 tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 4.790589 Oct 26 13:11:10.561460 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1069/2218] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 26 13:11:05 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 4804 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:11:10.566733 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-81fbd7b5-059d-45e5-8e3b-c74e9015593e req-2edbf55d-04bf-4474-a369-192b65e4beeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a49060c-d94a-4064-8e80-ef8fe20e3ff1", "name": "network-vif-unplugged", "status": "completed", "tag": "62679969-e21a-4c0d-8549-d6b3c52bd46b"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:11:10.602134 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-81fbd7b5-059d-45e5-8e3b-c74e9015593e req-2edbf55d-04bf-4474-a369-192b65e4beeb service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:10.602612 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-81fbd7b5-059d-45e5-8e3b-c74e9015593e req-2edbf55d-04bf-4474-a369-192b65e4beeb service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:10.603048 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-81fbd7b5-059d-45e5-8e3b-c74e9015593e req-2edbf55d-04bf-4474-a369-192b65e4beeb service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:10.638131 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-81fbd7b5-059d-45e5-8e3b-c74e9015593e req-2edbf55d-04bf-4474-a369-192b65e4beeb service nova] Creating event network-vif-unplugged:62679969-e21a-4c0d-8549-d6b3c52bd46b for instance 5a49060c-d94a-4064-8e80-ef8fe20e3ff1 on n-h2-862686-1 Oct 26 13:11:10.653319 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-81fbd7b5-059d-45e5-8e3b-c74e9015593e req-2edbf55d-04bf-4474-a369-192b65e4beeb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090098 Oct 26 13:11:10.654347 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1070/2219] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:11:10.661310 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-825adda5-9cdb-44a9-8aa9-2955719e3a99 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:10.662600 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-825adda5-9cdb-44a9-8aa9-2955719e3a99 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: e57fd56b-c9ce-4668-b9ff-703b4b310d1a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:10.669751 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-825adda5-9cdb-44a9-8aa9-2955719e3a99 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:10.670458 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-825adda5-9cdb-44a9-8aa9-2955719e3a99 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:10.671080 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-825adda5-9cdb-44a9-8aa9-2955719e3a99 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:10.672355 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-825adda5-9cdb-44a9-8aa9-2955719e3a99 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:10.673033 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-825adda5-9cdb-44a9-8aa9-2955719e3a99 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:10.673738 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-825adda5-9cdb-44a9-8aa9-2955719e3a99 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:10.779122 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f165a57d-bda4-4f52-8df8-d4e359ba8c33 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8fd7d2f8014b85beecc30c93bc084d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5902169366b646c7be94cb3521377225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:10.798672 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f165a57d-bda4-4f52-8df8-d4e359ba8c33 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] 10.222.0.40 "GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c" status: 200 len: 1323 microversion: 2.1 time: 1.063596 Oct 26 13:11:10.799987 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1150/2220] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:09 2022] GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c => generated 1323 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:10.819188 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-70a91b43-6a1f-4755-8e79-ce7f29d351fd tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:10.820794 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-70a91b43-6a1f-4755-8e79-ce7f29d351fd tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: 5a49060c-d94a-4064-8e80-ef8fe20e3ff1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:10.831953 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70a91b43-6a1f-4755-8e79-ce7f29d351fd tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:10.845619 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70a91b43-6a1f-4755-8e79-ce7f29d351fd tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:10.847206 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70a91b43-6a1f-4755-8e79-ce7f29d351fd tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:10.849664 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70a91b43-6a1f-4755-8e79-ce7f29d351fd tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:10.851738 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70a91b43-6a1f-4755-8e79-ce7f29d351fd tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:10.853070 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70a91b43-6a1f-4755-8e79-ce7f29d351fd tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:11.458133 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-70a91b43-6a1f-4755-8e79-ce7f29d351fd tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:11.470810 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-70a91b43-6a1f-4755-8e79-ce7f29d351fd tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1" status: 200 len: 1790 microversion: 2.1 time: 0.669327 Oct 26 13:11:11.475560 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1151/2221] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:10 2022] GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1 => generated 1790 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:11.490500 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d695efe1-0960-4bcb-8d08-9d5963f06d4c tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] Action: 'create', calling method: .version_select at 0x7f6731f54af0>, body: {"security_group_rule": {"parent_group_id": "6532db43-807b-486e-b180-932b866693e2", "ip_protocol": "tcp", "from_port": 22, "to_port": 847506583}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:11:11.622624 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-d695efe1-0960-4bcb-8d08-9d5963f06d4c tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] HTTP exception thrown: Invalid port range 22:847506583. Valid TCP ports should be between 1-65535 Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d695efe1-0960-4bcb-8d08-9d5963f06d4c tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] Request method failure captured: Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 145 Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTHb3vswqjBizG6GlH2IOGvoP8uIeyT-jIq9V4VqokHz-5_rYmQgkG2BgWJwhFYh2cOchKfJfBMwkvYR-maaO1LgxeQyAYwlE0SQPTdeCYbSH5iEwjzQ2MAwDHUtnfMLS4tiJdBowMQzNK9Suf65PrUPPFowaxHsLXRNSaWqsUkah94 Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: f1228d83c0b44bf390fb1891799af9a3 Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1661532260 Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f1228d83c0b44bf390fb1891799af9a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f1228d83c0b44bf390fb1891799af9a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f1228d83c0b44bf390fb1891799af9a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f1228d83c0b44bf390fb1891799af9a3"}]}] Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1661532260 Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: f1228d83c0b44bf390fb1891799af9a3 Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1661532260 Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: fc5e9b0a4e2d4432b28817e45f543328 Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: {"security_group_rule": {"parent_group_id": "6532db43-807b-486e-b180-932b866693e2", "ip_protocol": "tcp", "from_port": 22, "to_port": 847506583}} Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: exception: Invalid port range 22:847506583. Valid TCP ports should be between 1-65535 Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'body': {'security_group_rule': {'parent_group_id': '6532db43-807b-486e-b180-932b866693e2', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 847506583}}} Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:847506583. Valid TCP ports should be between 1-65535 Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:847506583. Valid TCP ports should be between 1-65535 Oct 26 13:11:11.627455 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:11:11.632352 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:11:11.632352 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:11:11.632352 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:11:11.632352 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:11:11.632352 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:11:11.632352 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:11:11.632352 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:11:11.632352 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:847506583. Valid TCP ports should be between 1-65535 Oct 26 13:11:11.632352 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:11:11.635521 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d695efe1-0960-4bcb-8d08-9d5963f06d4c tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] Returning 400 to user: Invalid port range 22:847506583. Valid TCP ports should be between 1-65535 {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:11:11.637208 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d695efe1-0960-4bcb-8d08-9d5963f06d4c tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.160347 Oct 26 13:11:11.646278 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1152/2222] 10.222.0.40 () {60 vars in 1195 bytes} [Wed Oct 26 13:11:11 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 170 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:11:11.653949 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7de52d22-0c5d-4f50-b8ee-3f669df89e23 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:11.654775 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7de52d22-0c5d-4f50-b8ee-3f669df89e23 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 6a7c952c-3ac4-4fad-b539-13a7ed9a2056] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:11.664280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7de52d22-0c5d-4f50-b8ee-3f669df89e23 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:11.665041 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7de52d22-0c5d-4f50-b8ee-3f669df89e23 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:11.665817 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7de52d22-0c5d-4f50-b8ee-3f669df89e23 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:11.666721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7de52d22-0c5d-4f50-b8ee-3f669df89e23 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:11.667398 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7de52d22-0c5d-4f50-b8ee-3f669df89e23 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:11.668051 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7de52d22-0c5d-4f50-b8ee-3f669df89e23 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:11.795378 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7de52d22-0c5d-4f50-b8ee-3f669df89e23 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:11.812491 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7de52d22-0c5d-4f50-b8ee-3f669df89e23 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056" status: 200 len: 1266 microversion: 2.1 time: 0.162567 Oct 26 13:11:11.814600 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1153/2223] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:11 2022] GET /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:11.830062 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-71745d80-2b2f-4c23-9a92-075f377daeac tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] Action: 'create', calling method: .version_select at 0x7f6731f92430>, body: {"security_group_rule": {"parent_group_id": "bb2d31f5-f865-4a6e-9fab-8b0a706cd47b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:11:11.912605 n-d-862686-1 devstack@n-api.service[120598]: DEBUG neutronclient.v2_0.client [None req-71745d80-2b2f-4c23-9a92-075f377daeac tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group bb2d31f5-f865-4a6e-9fab-8b0a706cd47b does not exist", "detail": ""}} {{(pid=120598) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 26 13:11:11.913534 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.security_group_api [None req-71745d80-2b2f-4c23-9a92-075f377daeac tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] Neutron security group bb2d31f5-f865-4a6e-9fab-8b0a706cd47b not found {{(pid=120598) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 26 13:11:11.914206 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-71745d80-2b2f-4c23-9a92-075f377daeac tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] HTTP exception thrown: Security group bb2d31f5-f865-4a6e-9fab-8b0a706cd47b does not exist Oct 26 13:11:11.914206 n-d-862686-1 devstack@n-api.service[120598]: Neutron server returns request_ids: ['req-258bb78d-e917-4a01-a95c-ab8186fcf6bd'] Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-71745d80-2b2f-4c23-9a92-075f377daeac tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] Request method failure captured: Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 138 Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTHb3vswqjBizG6GlH2IOGvoP8uIeyT-jIq9V4VqokHz-5_rYmQgkG2BgWJwhFYh2cOchKfJfBMwkvYR-maaO1LgxeQyAYwlE0SQPTdeCYbSH5iEwjzQ2MAwDHUtnfMLS4tiJdBowMQzNK9Suf65PrUPPFowaxHsLXRNSaWqsUkah94 Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: f1228d83c0b44bf390fb1891799af9a3 Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1661532260 Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f1228d83c0b44bf390fb1891799af9a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f1228d83c0b44bf390fb1891799af9a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f1228d83c0b44bf390fb1891799af9a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f1228d83c0b44bf390fb1891799af9a3"}]}] Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1661532260 Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: f1228d83c0b44bf390fb1891799af9a3 Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1661532260 Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: fc5e9b0a4e2d4432b28817e45f543328 Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: {"security_group_rule": {"parent_group_id": "bb2d31f5-f865-4a6e-9fab-8b0a706cd47b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: exception: Security group bb2d31f5-f865-4a6e-9fab-8b0a706cd47b does not exist Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: Neutron server returns request_ids: ['req-258bb78d-e917-4a01-a95c-ab8186fcf6bd'] Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'bb2d31f5-f865-4a6e-9fab-8b0a706cd47b', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 26 13:11:11.916387 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 26 13:11:11.920249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 26 13:11:11.920249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group bb2d31f5-f865-4a6e-9fab-8b0a706cd47b does not exist Oct 26 13:11:11.920249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-258bb78d-e917-4a01-a95c-ab8186fcf6bd'] Oct 26 13:11:11.920249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:11:11.920249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:11:11.920249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:11:11.920249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:11:11.920249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 26 13:11:11.920249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 26 13:11:11.920249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 26 13:11:11.920249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 26 13:11:11.920249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group bb2d31f5-f865-4a6e-9fab-8b0a706cd47b does not exist Oct 26 13:11:11.920249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-258bb78d-e917-4a01-a95c-ab8186fcf6bd'] Oct 26 13:11:11.920249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:11:11.920249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:11:11.920249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:11:11.920249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:11:11.920249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:11:11.920249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:11:11.920249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:11:11.920249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:11:11.920249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:11:11.920249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:11:11.920249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:11:11.920249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:11:11.920249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 26 13:11:11.920249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 26 13:11:11.920249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group bb2d31f5-f865-4a6e-9fab-8b0a706cd47b does not exist Oct 26 13:11:11.920249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-258bb78d-e917-4a01-a95c-ab8186fcf6bd'] Oct 26 13:11:11.920249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:11:11.920249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:11:11.920249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:11:11.920249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:11:11.920249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:11:11.920249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:11:11.920249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:11:11.920249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:11:11.920249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group bb2d31f5-f865-4a6e-9fab-8b0a706cd47b does not exist Oct 26 13:11:11.920249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-258bb78d-e917-4a01-a95c-ab8186fcf6bd'] Oct 26 13:11:11.920249 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:11:11.924130 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-71745d80-2b2f-4c23-9a92-075f377daeac tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] Returning 404 to user: Security group bb2d31f5-f865-4a6e-9fab-8b0a706cd47b does not exist Oct 26 13:11:11.924130 n-d-862686-1 devstack@n-api.service[120598]: Neutron server returns request_ids: ['req-258bb78d-e917-4a01-a95c-ab8186fcf6bd'] {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:11:11.925725 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-71745d80-2b2f-4c23-9a92-075f377daeac tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.106232 Oct 26 13:11:11.931249 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1154/2224] 10.222.0.40 () {60 vars in 1195 bytes} [Wed Oct 26 13:11:11 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:11:11.944013 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5ec5c9fe-4406-4e2e-b1c9-c4c36af3057d tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:11.952628 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5ec5c9fe-4406-4e2e-b1c9-c4c36af3057d tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] [instance: 6555760c-8bf4-467e-80cb-cdf6eee4b93c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:11.966202 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5ec5c9fe-4406-4e2e-b1c9-c4c36af3057d tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:11.970232 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5ec5c9fe-4406-4e2e-b1c9-c4c36af3057d tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:11.971041 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5ec5c9fe-4406-4e2e-b1c9-c4c36af3057d tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:11.972603 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5ec5c9fe-4406-4e2e-b1c9-c4c36af3057d tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:11.973288 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5ec5c9fe-4406-4e2e-b1c9-c4c36af3057d tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:11.975309 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5ec5c9fe-4406-4e2e-b1c9-c4c36af3057d tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:12.024235 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-825adda5-9cdb-44a9-8aa9-2955719e3a99 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4c9b05864d4d448b1c722659a3bc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2336994846d345aa86b5fd940d1b004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:12.036151 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-825adda5-9cdb-44a9-8aa9-2955719e3a99 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/e57fd56b-c9ce-4668-b9ff-703b4b310d1a" status: 200 len: 1317 microversion: 2.1 time: 1.380250 Oct 26 13:11:12.049648 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1071/2225] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:10 2022] GET /compute/v2.1/servers/e57fd56b-c9ce-4668-b9ff-703b4b310d1a => generated 1317 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:12.059338 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1ffe859a-28a0-4b72-87c4-54ec96cfc1b0 tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] Calling method '.version_select at 0x7f673690b3a0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:12.216189 n-d-862686-1 devstack@n-api.service[120597]: DEBUG neutronclient.v2_0.client [None req-1ffe859a-28a0-4b72-87c4-54ec96cfc1b0 tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 5df69fb4-4da2-4220-b9f4-9708e72da871 does not exist", "detail": ""}} {{(pid=120597) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 26 13:11:12.217376 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.security_group_api [None req-1ffe859a-28a0-4b72-87c4-54ec96cfc1b0 tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] Neutron security group rule 5df69fb4-4da2-4220-b9f4-9708e72da871 not found {{(pid=120597) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 26 13:11:12.218047 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-1ffe859a-28a0-4b72-87c4-54ec96cfc1b0 tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] HTTP exception thrown: Security group rule 5df69fb4-4da2-4220-b9f4-9708e72da871 does not exist Oct 26 13:11:12.218047 n-d-862686-1 devstack@n-api.service[120597]: Neutron server returns request_ids: ['req-3166f3ca-a1bd-49b8-80da-1241fd094bf3'] Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1ffe859a-28a0-4b72-87c4-54ec96cfc1b0 tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] Request method failure captured: Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/os-security-group-rules/5df69fb4-4da2-4220-b9f4-9708e72da871 HTTP/1.1 Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTHb3vswqjBizG6GlH2IOGvoP8uIeyT-jIq9V4VqokHz-5_rYmQgkG2BgWJwhFYh2cOchKfJfBMwkvYR-maaO1LgxeQyAYwlE0SQPTdeCYbSH5iEwjzQ2MAwDHUtnfMLS4tiJdBowMQzNK9Suf65PrUPPFowaxHsLXRNSaWqsUkah94 Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: f1228d83c0b44bf390fb1891799af9a3 Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1661532260 Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f1228d83c0b44bf390fb1891799af9a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f1228d83c0b44bf390fb1891799af9a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f1228d83c0b44bf390fb1891799af9a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f1228d83c0b44bf390fb1891799af9a3"}]}] Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1661532260 Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: f1228d83c0b44bf390fb1891799af9a3 Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1661532260 Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: fc5e9b0a4e2d4432b28817e45f543328 Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: method: Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: exception: Security group rule 5df69fb4-4da2-4220-b9f4-9708e72da871 does not exist Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: Neutron server returns request_ids: ['req-3166f3ca-a1bd-49b8-80da-1241fd094bf3'] Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '5df69fb4-4da2-4220-b9f4-9708e72da871'} Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 26 13:11:12.222907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 26 13:11:12.230031 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 5df69fb4-4da2-4220-b9f4-9708e72da871 does not exist Oct 26 13:11:12.230031 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3166f3ca-a1bd-49b8-80da-1241fd094bf3'] Oct 26 13:11:12.230031 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:11:12.230031 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:11:12.230031 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:11:12.230031 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:11:12.230031 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 26 13:11:12.230031 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 26 13:11:12.230031 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 26 13:11:12.230031 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 26 13:11:12.230031 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 5df69fb4-4da2-4220-b9f4-9708e72da871 does not exist Oct 26 13:11:12.230031 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3166f3ca-a1bd-49b8-80da-1241fd094bf3'] Oct 26 13:11:12.230031 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:11:12.230031 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:11:12.230031 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:11:12.230031 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:11:12.230031 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:11:12.230031 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:11:12.230031 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:11:12.230031 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:11:12.230031 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:11:12.230031 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:11:12.230031 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:11:12.230031 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:11:12.230031 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 26 13:11:12.230031 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 26 13:11:12.230031 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 5df69fb4-4da2-4220-b9f4-9708e72da871 does not exist Oct 26 13:11:12.230031 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3166f3ca-a1bd-49b8-80da-1241fd094bf3'] Oct 26 13:11:12.230031 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:11:12.230031 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:11:12.230031 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:11:12.230031 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:11:12.230031 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:11:12.230031 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:11:12.230031 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:11:12.230031 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:11:12.230031 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 5df69fb4-4da2-4220-b9f4-9708e72da871 does not exist Oct 26 13:11:12.230031 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3166f3ca-a1bd-49b8-80da-1241fd094bf3'] Oct 26 13:11:12.230031 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:11:12.230031 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1ffe859a-28a0-4b72-87c4-54ec96cfc1b0 tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] Returning 404 to user: Security group rule 5df69fb4-4da2-4220-b9f4-9708e72da871 does not exist Oct 26 13:11:12.230031 n-d-862686-1 devstack@n-api.service[120597]: Neutron server returns request_ids: ['req-3166f3ca-a1bd-49b8-80da-1241fd094bf3'] {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:11:12.230031 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1ffe859a-28a0-4b72-87c4-54ec96cfc1b0 tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-group-rules/5df69fb4-4da2-4220-b9f4-9708e72da871" status: 404 len: 199 microversion: 2.1 time: 0.178019 Oct 26 13:11:12.232730 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1072/2226] 10.222.0.40 () {58 vars in 1287 bytes} [Wed Oct 26 13:11:12 2022] DELETE /compute/v2.1/os-security-group-rules/5df69fb4-4da2-4220-b9f4-9708e72da871 => generated 199 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:11:12.260068 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e338cb1d-9f3f-4860-8cb9-eeaf65cf1a42 tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] Calling method '.version_select at 0x7f6736951430>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:13.031340 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5ec5c9fe-4406-4e2e-b1c9-c4c36af3057d tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8fd7d2f8014b85beecc30c93bc084d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5902169366b646c7be94cb3521377225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:13.060766 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5ec5c9fe-4406-4e2e-b1c9-c4c36af3057d tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] 10.222.0.40 "GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c" status: 200 len: 1323 microversion: 2.1 time: 1.123697 Oct 26 13:11:13.069975 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1155/2227] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:11 2022] GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c => generated 1323 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:13.099732 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-0a6747f2-e44c-4583-956a-5d8484841b66 req-d9aa7fca-5aba-4a58-8810-80510ae28b02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a49060c-d94a-4064-8e80-ef8fe20e3ff1", "name": "network-vif-deleted", "tag": "ce410f45-f254-4af4-b501-67d0d5082737"}, {"server_uuid": "5a49060c-d94a-4064-8e80-ef8fe20e3ff1", "name": "network-vif-deleted", "tag": "28386fec-d16c-4a5f-b2f6-7619b9050fa0"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:11:13.156392 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-0a6747f2-e44c-4583-956a-5d8484841b66 req-d9aa7fca-5aba-4a58-8810-80510ae28b02 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:13.158206 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-0a6747f2-e44c-4583-956a-5d8484841b66 req-d9aa7fca-5aba-4a58-8810-80510ae28b02 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:13.158668 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-0a6747f2-e44c-4583-956a-5d8484841b66 req-d9aa7fca-5aba-4a58-8810-80510ae28b02 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:13.222209 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-0a6747f2-e44c-4583-956a-5d8484841b66 req-d9aa7fca-5aba-4a58-8810-80510ae28b02 service nova] Creating event network-vif-deleted:ce410f45-f254-4af4-b501-67d0d5082737 for instance 5a49060c-d94a-4064-8e80-ef8fe20e3ff1 on n-h2-862686-1 Oct 26 13:11:13.224837 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-0a6747f2-e44c-4583-956a-5d8484841b66 req-d9aa7fca-5aba-4a58-8810-80510ae28b02 service nova] Creating event network-vif-deleted:28386fec-d16c-4a5f-b2f6-7619b9050fa0 for instance 5a49060c-d94a-4064-8e80-ef8fe20e3ff1 on n-h2-862686-1 Oct 26 13:11:13.246056 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-0a6747f2-e44c-4583-956a-5d8484841b66 req-d9aa7fca-5aba-4a58-8810-80510ae28b02 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.174468 Oct 26 13:11:13.249973 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1156/2228] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:11:13.261739 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-a941e6e1-d8fb-4047-8ed3-5079bb3aab39 req-13651be2-ae6f-46f5-9e78-2e27b33a13eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6555760c-8bf4-467e-80cb-cdf6eee4b93c", "tag": "16bdf5c3-e3cb-4e23-93c3-2342697bd561"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:11:13.299650 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-a941e6e1-d8fb-4047-8ed3-5079bb3aab39 req-13651be2-ae6f-46f5-9e78-2e27b33a13eb service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:13.301271 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-a941e6e1-d8fb-4047-8ed3-5079bb3aab39 req-13651be2-ae6f-46f5-9e78-2e27b33a13eb service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:13.302887 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-a941e6e1-d8fb-4047-8ed3-5079bb3aab39 req-13651be2-ae6f-46f5-9e78-2e27b33a13eb service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:13.360958 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-a941e6e1-d8fb-4047-8ed3-5079bb3aab39 req-13651be2-ae6f-46f5-9e78-2e27b33a13eb service nova] Creating event network-changed:16bdf5c3-e3cb-4e23-93c3-2342697bd561 for instance 6555760c-8bf4-467e-80cb-cdf6eee4b93c on n-h1-862686-1 Oct 26 13:11:13.373066 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-a941e6e1-d8fb-4047-8ed3-5079bb3aab39 req-13651be2-ae6f-46f5-9e78-2e27b33a13eb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120464 Oct 26 13:11:13.377927 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1157/2229] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:11:13.399173 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e6b9db8b-3fbe-4f39-83a3-cfd026103620 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:13.400147 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e6b9db8b-3fbe-4f39-83a3-cfd026103620 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: 5a49060c-d94a-4064-8e80-ef8fe20e3ff1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:13.423702 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6b9db8b-3fbe-4f39-83a3-cfd026103620 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:13.425434 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6b9db8b-3fbe-4f39-83a3-cfd026103620 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:13.427956 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6b9db8b-3fbe-4f39-83a3-cfd026103620 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:13.430863 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6b9db8b-3fbe-4f39-83a3-cfd026103620 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:13.433128 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6b9db8b-3fbe-4f39-83a3-cfd026103620 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:13.434659 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6b9db8b-3fbe-4f39-83a3-cfd026103620 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:13.681472 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:11:14.468313 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e6b9db8b-3fbe-4f39-83a3-cfd026103620 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:14.493274 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e6b9db8b-3fbe-4f39-83a3-cfd026103620 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1" status: 200 len: 1496 microversion: 2.1 time: 1.113964 Oct 26 13:11:14.496060 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1158/2230] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:13 2022] GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1 => generated 1496 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:14.516504 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-464e135a-eedb-4fc4-8c38-561a27dc19bb req-957d26c4-a567-402f-983e-114d5cefa4f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a49060c-d94a-4064-8e80-ef8fe20e3ff1", "name": "network-vif-unplugged", "status": "completed", "tag": "28386fec-d16c-4a5f-b2f6-7619b9050fa0"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:11:14.554380 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-464e135a-eedb-4fc4-8c38-561a27dc19bb req-957d26c4-a567-402f-983e-114d5cefa4f4 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:14.562286 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-464e135a-eedb-4fc4-8c38-561a27dc19bb req-957d26c4-a567-402f-983e-114d5cefa4f4 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:14.563225 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-464e135a-eedb-4fc4-8c38-561a27dc19bb req-957d26c4-a567-402f-983e-114d5cefa4f4 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:14.605694 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-464e135a-eedb-4fc4-8c38-561a27dc19bb req-957d26c4-a567-402f-983e-114d5cefa4f4 service nova] Creating event network-vif-unplugged:28386fec-d16c-4a5f-b2f6-7619b9050fa0 for instance 5a49060c-d94a-4064-8e80-ef8fe20e3ff1 on n-h2-862686-1 Oct 26 13:11:14.627715 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-464e135a-eedb-4fc4-8c38-561a27dc19bb req-957d26c4-a567-402f-983e-114d5cefa4f4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.124641 Oct 26 13:11:14.630635 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1159/2231] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:11:14.646867 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4d69164f-eacc-4cbd-8a1b-33a15ebe9427 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:14.652990 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4d69164f-eacc-4cbd-8a1b-33a15ebe9427 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 6a7c952c-3ac4-4fad-b539-13a7ed9a2056] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:14.671561 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d69164f-eacc-4cbd-8a1b-33a15ebe9427 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:14.677296 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d69164f-eacc-4cbd-8a1b-33a15ebe9427 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:14.678117 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d69164f-eacc-4cbd-8a1b-33a15ebe9427 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:14.679114 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d69164f-eacc-4cbd-8a1b-33a15ebe9427 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:14.680730 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d69164f-eacc-4cbd-8a1b-33a15ebe9427 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:14.682645 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d69164f-eacc-4cbd-8a1b-33a15ebe9427 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:14.823510 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e338cb1d-9f3f-4860-8cb9-eeaf65cf1a42 tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/6532db43-807b-486e-b180-932b866693e2" status: 202 len: 0 microversion: 2.1 time: 2.586267 Oct 26 13:11:14.828489 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1073/2232] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 26 13:11:12 2022] DELETE /compute/v2.1/os-security-groups/6532db43-807b-486e-b180-932b866693e2 => generated 0 bytes in 2592 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:11:14.838038 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f1a114fe-e936-46cc-aaf5-dfda44c3eec0 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:14.839947 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f1a114fe-e936-46cc-aaf5-dfda44c3eec0 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: e57fd56b-c9ce-4668-b9ff-703b4b310d1a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:14.886949 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f1a114fe-e936-46cc-aaf5-dfda44c3eec0 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:14.887622 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f1a114fe-e936-46cc-aaf5-dfda44c3eec0 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:14.888226 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f1a114fe-e936-46cc-aaf5-dfda44c3eec0 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:14.889682 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f1a114fe-e936-46cc-aaf5-dfda44c3eec0 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:14.890398 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f1a114fe-e936-46cc-aaf5-dfda44c3eec0 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:14.890932 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f1a114fe-e936-46cc-aaf5-dfda44c3eec0 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:15.309081 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4d69164f-eacc-4cbd-8a1b-33a15ebe9427 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:15.326161 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4d69164f-eacc-4cbd-8a1b-33a15ebe9427 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056" status: 200 len: 1308 microversion: 2.1 time: 0.693360 Oct 26 13:11:15.329761 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1160/2233] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:14 2022] GET /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056 => generated 1308 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:15.346534 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-943b8d9f-98b8-47af-ae43-9cc09604c35d tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:15.349518 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-943b8d9f-98b8-47af-ae43-9cc09604c35d tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] [instance: 6555760c-8bf4-467e-80cb-cdf6eee4b93c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:15.367249 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-943b8d9f-98b8-47af-ae43-9cc09604c35d tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:15.368243 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-943b8d9f-98b8-47af-ae43-9cc09604c35d tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:15.368943 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-943b8d9f-98b8-47af-ae43-9cc09604c35d tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:15.373121 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-943b8d9f-98b8-47af-ae43-9cc09604c35d tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:15.374209 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-943b8d9f-98b8-47af-ae43-9cc09604c35d tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:15.376154 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-943b8d9f-98b8-47af-ae43-9cc09604c35d tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:15.662416 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-943b8d9f-98b8-47af-ae43-9cc09604c35d tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8fd7d2f8014b85beecc30c93bc084d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5902169366b646c7be94cb3521377225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:15.672414 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-943b8d9f-98b8-47af-ae43-9cc09604c35d tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] 10.222.0.40 "GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c" status: 200 len: 1323 microversion: 2.1 time: 0.341231 Oct 26 13:11:15.687720 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1161/2234] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:15 2022] GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c => generated 1323 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:15.689391 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3be11714-c744-48d3-b0a0-1643d6dc12e2 tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] Calling method '.version_select at 0x7f6732acc5e0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:15.880339 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3be11714-c744-48d3-b0a0-1643d6dc12e2 tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/d63b155a-5078-49d6-841c-a2f1b2dac0da" status: 202 len: 0 microversion: 2.1 time: 0.194649 Oct 26 13:11:15.897964 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1162/2235] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 26 13:11:15 2022] DELETE /compute/v2.1/os-security-groups/d63b155a-5078-49d6-841c-a2f1b2dac0da => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:11:15.911920 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-caf7b461-da80-4370-99b6-b13fbd502449 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "1a684ae4-a3ab-480d-a389-fb40f96cd694"}], "security_groups": [{"name": "tempest-securitygroup--823733125"}], "key_name": "tempest-keypair-2021685027", "user_data": "}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:11:16.028904 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-caf7b461-da80-4370-99b6-b13fbd502449 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] validate_networks() for [('1a684ae4-a3ab-480d-a389-fb40f96cd694', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:11:16.384122 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f1a114fe-e936-46cc-aaf5-dfda44c3eec0 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4c9b05864d4d448b1c722659a3bc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2336994846d345aa86b5fd940d1b004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:16.392902 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f1a114fe-e936-46cc-aaf5-dfda44c3eec0 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/e57fd56b-c9ce-4668-b9ff-703b4b310d1a" status: 200 len: 1317 microversion: 2.1 time: 1.562517 Oct 26 13:11:16.406231 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1074/2236] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:14 2022] GET /compute/v2.1/servers/e57fd56b-c9ce-4668-b9ff-703b4b310d1a => generated 1317 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:16.415446 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-46476669-4d95-44e1-a9f5-b05190211ba2 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:16.416661 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-46476669-4d95-44e1-a9f5-b05190211ba2 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: 5a49060c-d94a-4064-8e80-ef8fe20e3ff1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:16.423514 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=36 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:11:16.425797 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-46476669-4d95-44e1-a9f5-b05190211ba2 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:16.426852 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-46476669-4d95-44e1-a9f5-b05190211ba2 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:16.427454 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-46476669-4d95-44e1-a9f5-b05190211ba2 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:16.428314 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-46476669-4d95-44e1-a9f5-b05190211ba2 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:16.431636 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-46476669-4d95-44e1-a9f5-b05190211ba2 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:16.432321 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-46476669-4d95-44e1-a9f5-b05190211ba2 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:16.514335 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-46476669-4d95-44e1-a9f5-b05190211ba2 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:16.515155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-46476669-4d95-44e1-a9f5-b05190211ba2 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:16.515258 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-46476669-4d95-44e1-a9f5-b05190211ba2 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:16.515707 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-46476669-4d95-44e1-a9f5-b05190211ba2 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lazy-loading 'fault' on Instance uuid 5a49060c-d94a-4064-8e80-ef8fe20e3ff1 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:11:16.674096 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-46476669-4d95-44e1-a9f5-b05190211ba2 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:16.689993 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-46476669-4d95-44e1-a9f5-b05190211ba2 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1" status: 200 len: 1303 microversion: 2.1 time: 0.281785 Oct 26 13:11:16.689993 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1075/2237] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:16 2022] GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1 => generated 1303 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:16.717309 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-caf7b461-da80-4370-99b6-b13fbd502449 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:11:16.718685 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-caf7b461-da80-4370-99b6-b13fbd502449 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:11:16.720195 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-caf7b461-da80-4370-99b6-b13fbd502449 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:11:16.720816 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-caf7b461-da80-4370-99b6-b13fbd502449 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:11:16.722412 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-caf7b461-da80-4370-99b6-b13fbd502449 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:11:16.724882 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-332ffb9d-5650-4c86-b9c3-4a57941626b8 tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] Calling method '.version_select at 0x7f67369b54c0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:16.738597 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=29 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:11:16.741073 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-caf7b461-da80-4370-99b6-b13fbd502449 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:16.742082 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-caf7b461-da80-4370-99b6-b13fbd502449 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:16.743354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-caf7b461-da80-4370-99b6-b13fbd502449 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:16.744778 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-caf7b461-da80-4370-99b6-b13fbd502449 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:16.749914 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-caf7b461-da80-4370-99b6-b13fbd502449 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:16.753410 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-caf7b461-da80-4370-99b6-b13fbd502449 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:16.789988 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-caf7b461-da80-4370-99b6-b13fbd502449 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Getting quotas for project dfd2c80c6e164a708040af3165617a0b. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:11:16.799015 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-caf7b461-da80-4370-99b6-b13fbd502449 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Getting quotas for user 329c4c283e1646f295472c59225753de and project dfd2c80c6e164a708040af3165617a0b. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:11:16.818941 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-caf7b461-da80-4370-99b6-b13fbd502449 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:11:16.821721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-caf7b461-da80-4370-99b6-b13fbd502449 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] [instance: 945d807f-8341-49ca-ba3e-702bfd803dc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:11:16.899486 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-caf7b461-da80-4370-99b6-b13fbd502449 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.996224 Oct 26 13:11:16.902368 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1163/2238] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:11:15 2022] POST /compute/v2.1/servers => generated 408 bytes in 1003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:11:16.911359 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-18e839c7-f578-498a-b3ae-ea0543d1c09a req-2f5db8ac-97d5-4f0f-92fa-55442431fd83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a49060c-d94a-4064-8e80-ef8fe20e3ff1", "name": "network-vif-deleted", "tag": "62679969-e21a-4c0d-8549-d6b3c52bd46b"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:11:16.926191 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-18e839c7-f578-498a-b3ae-ea0543d1c09a req-2f5db8ac-97d5-4f0f-92fa-55442431fd83 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:16.927330 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-18e839c7-f578-498a-b3ae-ea0543d1c09a req-2f5db8ac-97d5-4f0f-92fa-55442431fd83 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:16.928052 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-18e839c7-f578-498a-b3ae-ea0543d1c09a req-2f5db8ac-97d5-4f0f-92fa-55442431fd83 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:16.947393 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-18e839c7-f578-498a-b3ae-ea0543d1c09a req-2f5db8ac-97d5-4f0f-92fa-55442431fd83 service nova] Creating event network-vif-deleted:62679969-e21a-4c0d-8549-d6b3c52bd46b for instance 5a49060c-d94a-4064-8e80-ef8fe20e3ff1 on n-h2-862686-1 Oct 26 13:11:16.955898 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-18e839c7-f578-498a-b3ae-ea0543d1c09a req-2f5db8ac-97d5-4f0f-92fa-55442431fd83 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050410 Oct 26 13:11:16.958625 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1164/2239] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:11:16.966774 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7b2984cf-3f32-48f0-9856-a4761e8f2002 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:16.973910 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7b2984cf-3f32-48f0-9856-a4761e8f2002 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 6a7c952c-3ac4-4fad-b539-13a7ed9a2056] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:16.994825 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7b2984cf-3f32-48f0-9856-a4761e8f2002 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:16.995470 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7b2984cf-3f32-48f0-9856-a4761e8f2002 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:16.995978 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7b2984cf-3f32-48f0-9856-a4761e8f2002 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:16.997746 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7b2984cf-3f32-48f0-9856-a4761e8f2002 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:16.999240 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7b2984cf-3f32-48f0-9856-a4761e8f2002 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:17.000636 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7b2984cf-3f32-48f0-9856-a4761e8f2002 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:17.385854 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7b2984cf-3f32-48f0-9856-a4761e8f2002 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:17.404732 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7b2984cf-3f32-48f0-9856-a4761e8f2002 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056" status: 200 len: 1308 microversion: 2.1 time: 0.444743 Oct 26 13:11:17.408686 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1165/2240] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:16 2022] GET /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056 => generated 1308 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:17.418329 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3ee090a5-6a6a-47b1-9cce-8cd855eafa8b tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:17.422249 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3ee090a5-6a6a-47b1-9cce-8cd855eafa8b tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] [instance: 6555760c-8bf4-467e-80cb-cdf6eee4b93c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:17.440030 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3ee090a5-6a6a-47b1-9cce-8cd855eafa8b tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:17.442886 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3ee090a5-6a6a-47b1-9cce-8cd855eafa8b tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:17.444972 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3ee090a5-6a6a-47b1-9cce-8cd855eafa8b tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:17.447746 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3ee090a5-6a6a-47b1-9cce-8cd855eafa8b tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:17.449660 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3ee090a5-6a6a-47b1-9cce-8cd855eafa8b tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:17.452359 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3ee090a5-6a6a-47b1-9cce-8cd855eafa8b tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:17.699320 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3ee090a5-6a6a-47b1-9cce-8cd855eafa8b tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8fd7d2f8014b85beecc30c93bc084d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5902169366b646c7be94cb3521377225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:17.714959 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3ee090a5-6a6a-47b1-9cce-8cd855eafa8b tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] 10.222.0.40 "GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c" status: 200 len: 1323 microversion: 2.1 time: 0.303814 Oct 26 13:11:17.715697 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1166/2241] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:17 2022] GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c => generated 1323 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:17.731175 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-752b12fb-4d17-4371-908d-f0a6c13e7fff tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:17.733979 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-752b12fb-4d17-4371-908d-f0a6c13e7fff tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] [instance: 945d807f-8341-49ca-ba3e-702bfd803dc3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:17.787901 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-332ffb9d-5650-4c86-b9c3-4a57941626b8 tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/50bc60b1-4e4b-4cb7-82a0-dd7c223e49d1" status: 202 len: 0 microversion: 2.1 time: 1.067293 Oct 26 13:11:17.793220 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1076/2242] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 26 13:11:16 2022] DELETE /compute/v2.1/os-security-groups/50bc60b1-4e4b-4cb7-82a0-dd7c223e49d1 => generated 0 bytes in 1103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:11:17.833728 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-752b12fb-4d17-4371-908d-f0a6c13e7fff tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329c4c283e1646f295472c59225753de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd2c80c6e164a708040af3165617a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:17.844108 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-752b12fb-4d17-4371-908d-f0a6c13e7fff tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] 10.222.0.40 "GET /compute/v2.1/servers/945d807f-8341-49ca-ba3e-702bfd803dc3" status: 200 len: 1226 microversion: 2.1 time: 0.125595 Oct 26 13:11:17.844919 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1167/2243] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:17 2022] GET /compute/v2.1/servers/945d807f-8341-49ca-ba3e-702bfd803dc3 => generated 1226 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:17.864600 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5f838e9a-78b6-40e8-9650-93fe4f3140f8 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:17.865217 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5f838e9a-78b6-40e8-9650-93fe4f3140f8 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: e57fd56b-c9ce-4668-b9ff-703b4b310d1a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:17.891817 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5f838e9a-78b6-40e8-9650-93fe4f3140f8 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:17.892507 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5f838e9a-78b6-40e8-9650-93fe4f3140f8 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:17.893347 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5f838e9a-78b6-40e8-9650-93fe4f3140f8 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:17.895463 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5f838e9a-78b6-40e8-9650-93fe4f3140f8 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:17.896087 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5f838e9a-78b6-40e8-9650-93fe4f3140f8 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:17.896728 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5f838e9a-78b6-40e8-9650-93fe4f3140f8 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:17.955083 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b8371fdb-486d-4dec-a778-50d7a46b473d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-756257055", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "9b018832-3265-4f0d-98c8-c1f53ee63290"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:11:18.081922 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-b8371fdb-486d-4dec-a778-50d7a46b473d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] validate_networks() for [('9b018832-3265-4f0d-98c8-c1f53ee63290', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:11:18.184765 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5f838e9a-78b6-40e8-9650-93fe4f3140f8 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4c9b05864d4d448b1c722659a3bc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2336994846d345aa86b5fd940d1b004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:18.194901 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5f838e9a-78b6-40e8-9650-93fe4f3140f8 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/e57fd56b-c9ce-4668-b9ff-703b4b310d1a" status: 200 len: 1317 microversion: 2.1 time: 0.348395 Oct 26 13:11:18.196780 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1168/2244] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:17 2022] GET /compute/v2.1/servers/e57fd56b-c9ce-4668-b9ff-703b4b310d1a => generated 1317 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:18.205124 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8840db46-7dc4-4d0b-bbf5-923d43f845cf tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:18.208195 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8840db46-7dc4-4d0b-bbf5-923d43f845cf tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: 5a49060c-d94a-4064-8e80-ef8fe20e3ff1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:18.224455 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8840db46-7dc4-4d0b-bbf5-923d43f845cf tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:18.225012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8840db46-7dc4-4d0b-bbf5-923d43f845cf tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:18.225947 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8840db46-7dc4-4d0b-bbf5-923d43f845cf tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:18.226312 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8840db46-7dc4-4d0b-bbf5-923d43f845cf tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:18.230469 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8840db46-7dc4-4d0b-bbf5-923d43f845cf tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:18.230940 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8840db46-7dc4-4d0b-bbf5-923d43f845cf tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:18.277094 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-8840db46-7dc4-4d0b-bbf5-923d43f845cf tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] HTTP exception thrown: Instance 5a49060c-d94a-4064-8e80-ef8fe20e3ff1 could not be found. Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8840db46-7dc4-4d0b-bbf5-923d43f845cf tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Request method failure captured: Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1 HTTP/1.1 Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTGuhT7Zbi_z_79A643Bxrqd2bB1VSqRYm6Jz4GuY9ExeFNGPXsuj7LBA9BXTdnCCGYDf6Ao3eaTBgELBCBSA6CFliksv3ntCDdpWnInF_PADrDmI3-58eMChsVyT9aHxLDdXaI6vgwbjOYl9-AB53UwK2Q7tevLaF23CDZGjXumZmg Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 23b66b9b9c574fa799086c0733d28887 Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersTestMultiNic-1880926120 Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/23b66b9b9c574fa799086c0733d28887"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/23b66b9b9c574fa799086c0733d28887"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_23b66b9b9c574fa799086c0733d28887"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/23b66b9b9c574fa799086c0733d28887"}]}] Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersTestMultiNic-1880926120 Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 23b66b9b9c574fa799086c0733d28887 Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersTestMultiNic-1880926120 Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersTestMultiNic-1880926120-project Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: c533afbf98454632a796eea300f50a35 Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersTestMultiNic-1880926120-project Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 5a49060c-d94a-4064-8e80-ef8fe20e3ff1 could not be found. Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '5a49060c-d94a-4064-8e80-ef8fe20e3ff1'} Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a49060c-d94a-4064-8e80-ef8fe20e3ff1 could not be found. Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a49060c-d94a-4064-8e80-ef8fe20e3ff1 could not be found. Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:11:18.281576 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:11:18.286245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:11:18.286245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:11:18.286245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:11:18.286245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:11:18.286245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:11:18.286245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a49060c-d94a-4064-8e80-ef8fe20e3ff1 could not be found. Oct 26 13:11:18.286245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:11:18.287757 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8840db46-7dc4-4d0b-bbf5-923d43f845cf tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Returning 404 to user: Instance 5a49060c-d94a-4064-8e80-ef8fe20e3ff1 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:11:18.288770 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8840db46-7dc4-4d0b-bbf5-923d43f845cf tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1" status: 404 len: 111 microversion: 2.1 time: 0.091034 Oct 26 13:11:18.292792 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1169/2245] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:18 2022] GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:11:18.311285 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9525f4de-dfc5-4bd3-892f-c772b5358ff5 tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] Calling method '.version_select at 0x7f6732cd1550>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:18.741401 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9525f4de-dfc5-4bd3-892f-c772b5358ff5 tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/e0d11d6b-46e2-44e5-a646-8ba6257c7ab2" status: 202 len: 0 microversion: 2.1 time: 0.450485 Oct 26 13:11:18.745149 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1170/2246] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 26 13:11:18 2022] DELETE /compute/v2.1/os-security-groups/e0d11d6b-46e2-44e5-a646-8ba6257c7ab2 => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:11:18.759872 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0562399d-e703-4ff7-a273-24844f47f73a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:18.764443 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0562399d-e703-4ff7-a273-24844f47f73a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 6a7c952c-3ac4-4fad-b539-13a7ed9a2056] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:18.781686 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0562399d-e703-4ff7-a273-24844f47f73a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:18.783555 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0562399d-e703-4ff7-a273-24844f47f73a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:18.796060 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0562399d-e703-4ff7-a273-24844f47f73a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:18.804745 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0562399d-e703-4ff7-a273-24844f47f73a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:18.805990 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0562399d-e703-4ff7-a273-24844f47f73a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:18.814225 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0562399d-e703-4ff7-a273-24844f47f73a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:19.458555 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0562399d-e703-4ff7-a273-24844f47f73a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:19.472051 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0562399d-e703-4ff7-a273-24844f47f73a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056" status: 200 len: 1308 microversion: 2.1 time: 0.725036 Oct 26 13:11:19.473809 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1171/2247] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:18 2022] GET /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056 => generated 1308 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:19.479654 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5daf65b6-9284-4872-9a7b-697f5596b34f tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:19.480845 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5daf65b6-9284-4872-9a7b-697f5596b34f tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] [instance: 6555760c-8bf4-467e-80cb-cdf6eee4b93c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:19.517511 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5daf65b6-9284-4872-9a7b-697f5596b34f tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:19.527627 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5daf65b6-9284-4872-9a7b-697f5596b34f tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:19.528182 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5daf65b6-9284-4872-9a7b-697f5596b34f tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:19.529141 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5daf65b6-9284-4872-9a7b-697f5596b34f tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:19.529763 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5daf65b6-9284-4872-9a7b-697f5596b34f tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:19.535798 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5daf65b6-9284-4872-9a7b-697f5596b34f tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:19.849865 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5daf65b6-9284-4872-9a7b-697f5596b34f tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8fd7d2f8014b85beecc30c93bc084d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5902169366b646c7be94cb3521377225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:19.860330 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5daf65b6-9284-4872-9a7b-697f5596b34f tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] 10.222.0.40 "GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c" status: 200 len: 1323 microversion: 2.1 time: 0.385236 Oct 26 13:11:19.860921 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1172/2248] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:19 2022] GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c => generated 1323 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:19.877717 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1949b9b6-913a-4a1c-973b-bf000bd94331 tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] Calling method '.version_select at 0x7f67367f4e50>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:20.152752 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-b8371fdb-486d-4dec-a778-50d7a46b473d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:11:20.153222 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-b8371fdb-486d-4dec-a778-50d7a46b473d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:11:20.153866 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-b8371fdb-486d-4dec-a778-50d7a46b473d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:11:20.154706 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-b8371fdb-486d-4dec-a778-50d7a46b473d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:11:20.155310 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-b8371fdb-486d-4dec-a778-50d7a46b473d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:11:20.169050 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8371fdb-486d-4dec-a778-50d7a46b473d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:20.170124 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8371fdb-486d-4dec-a778-50d7a46b473d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:20.170700 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8371fdb-486d-4dec-a778-50d7a46b473d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:20.171891 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8371fdb-486d-4dec-a778-50d7a46b473d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:20.173260 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8371fdb-486d-4dec-a778-50d7a46b473d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:20.173915 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8371fdb-486d-4dec-a778-50d7a46b473d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:20.215126 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-b8371fdb-486d-4dec-a778-50d7a46b473d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Getting quotas for project 37f9729793794fdca01a8e15bed9f4e9. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:11:20.221317 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-b8371fdb-486d-4dec-a778-50d7a46b473d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Getting quotas for user 3574f016449d43e7baf97212ed731304 and project 37f9729793794fdca01a8e15bed9f4e9. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:11:20.237829 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b8371fdb-486d-4dec-a778-50d7a46b473d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Going to run 3 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:11:20.240451 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b8371fdb-486d-4dec-a778-50d7a46b473d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] [instance: 8768fa8b-3989-4c11-a1cf-7841cf7e5c8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:11:20.333507 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b8371fdb-486d-4dec-a778-50d7a46b473d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] [instance: ef63aed1-fab4-4b5b-b9c3-3607bb737e31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=8768fa8b-3989-4c11-a1cf-7841cf7e5c8d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:11:20.450019 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b8371fdb-486d-4dec-a778-50d7a46b473d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] [instance: 5a42cb7d-b4c0-4771-a655-5e3f44adae05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=ef63aed1-fab4-4b5b-b9c3-3607bb737e31,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:11:20.526617 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b8371fdb-486d-4dec-a778-50d7a46b473d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.730974 Oct 26 13:11:20.527859 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1077/2249] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:11:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:11:20.532686 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1a7ab741-4c4b-4f4c-bd46-d4176ad0f1f3 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:20.533629 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1a7ab741-4c4b-4f4c-bd46-d4176ad0f1f3 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] [instance: 945d807f-8341-49ca-ba3e-702bfd803dc3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:20.540513 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a7ab741-4c4b-4f4c-bd46-d4176ad0f1f3 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:20.541007 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a7ab741-4c4b-4f4c-bd46-d4176ad0f1f3 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:20.541441 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a7ab741-4c4b-4f4c-bd46-d4176ad0f1f3 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:20.542443 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a7ab741-4c4b-4f4c-bd46-d4176ad0f1f3 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:20.543049 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a7ab741-4c4b-4f4c-bd46-d4176ad0f1f3 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:20.543476 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a7ab741-4c4b-4f4c-bd46-d4176ad0f1f3 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:20.560198 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1949b9b6-913a-4a1c-973b-bf000bd94331 tempest-SecurityGroupRulesNegativeTestJSON-1661532260 tempest-SecurityGroupRulesNegativeTestJSON-1661532260-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/6a4c58c8-0dcf-465f-9bb8-64d1ee98e1f5" status: 202 len: 0 microversion: 2.1 time: 0.696656 Oct 26 13:11:20.560780 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1173/2250] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 26 13:11:19 2022] DELETE /compute/v2.1/os-security-groups/6a4c58c8-0dcf-465f-9bb8-64d1ee98e1f5 => generated 0 bytes in 698 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:11:20.569645 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-d67bd39c-37a5-4e4f-bbba-5884323e55fa req-52696856-60b9-4010-b306-56fd88134038 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a7c952c-3ac4-4fad-b539-13a7ed9a2056", "tag": "67a20481-a759-4368-b7fd-a870213309ed"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:11:20.613750 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-d67bd39c-37a5-4e4f-bbba-5884323e55fa req-52696856-60b9-4010-b306-56fd88134038 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:20.617235 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-d67bd39c-37a5-4e4f-bbba-5884323e55fa req-52696856-60b9-4010-b306-56fd88134038 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:20.617713 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-d67bd39c-37a5-4e4f-bbba-5884323e55fa req-52696856-60b9-4010-b306-56fd88134038 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:20.649508 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-d67bd39c-37a5-4e4f-bbba-5884323e55fa req-52696856-60b9-4010-b306-56fd88134038 service nova] Creating event network-changed:67a20481-a759-4368-b7fd-a870213309ed for instance 6a7c952c-3ac4-4fad-b539-13a7ed9a2056 on n-h2-862686-1 Oct 26 13:11:20.663209 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-d67bd39c-37a5-4e4f-bbba-5884323e55fa req-52696856-60b9-4010-b306-56fd88134038 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100694 Oct 26 13:11:20.666073 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1174/2251] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:11:20.677356 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-36e85c8a-154f-426c-9a5b-6cd9387c953f tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:20.679814 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-36e85c8a-154f-426c-9a5b-6cd9387c953f tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: e57fd56b-c9ce-4668-b9ff-703b4b310d1a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:20.698636 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-36e85c8a-154f-426c-9a5b-6cd9387c953f tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:20.699357 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-36e85c8a-154f-426c-9a5b-6cd9387c953f tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:20.701596 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-36e85c8a-154f-426c-9a5b-6cd9387c953f tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:20.703393 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-36e85c8a-154f-426c-9a5b-6cd9387c953f tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:20.704931 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-36e85c8a-154f-426c-9a5b-6cd9387c953f tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:20.706855 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-36e85c8a-154f-426c-9a5b-6cd9387c953f tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:20.740259 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1a7ab741-4c4b-4f4c-bd46-d4176ad0f1f3 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329c4c283e1646f295472c59225753de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd2c80c6e164a708040af3165617a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:20.766840 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1a7ab741-4c4b-4f4c-bd46-d4176ad0f1f3 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] 10.222.0.40 "GET /compute/v2.1/servers/945d807f-8341-49ca-ba3e-702bfd803dc3" status: 200 len: 1284 microversion: 2.1 time: 0.237678 Oct 26 13:11:20.771859 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1078/2252] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:20 2022] GET /compute/v2.1/servers/945d807f-8341-49ca-ba3e-702bfd803dc3 => generated 1284 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:20.778361 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-91b80086-1b5c-45c7-a8b6-fa3a96176600 req-ab333707-4e34-40bd-8343-765f2e46ef69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e57fd56b-c9ce-4668-b9ff-703b4b310d1a", "name": "network-vif-plugged", "status": "completed", "tag": "c048e1bc-f12e-4daf-b7ad-6dc3affd08f5"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:11:20.807788 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-91b80086-1b5c-45c7-a8b6-fa3a96176600 req-ab333707-4e34-40bd-8343-765f2e46ef69 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:20.811340 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-91b80086-1b5c-45c7-a8b6-fa3a96176600 req-ab333707-4e34-40bd-8343-765f2e46ef69 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:20.812186 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-91b80086-1b5c-45c7-a8b6-fa3a96176600 req-ab333707-4e34-40bd-8343-765f2e46ef69 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:20.842591 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-91b80086-1b5c-45c7-a8b6-fa3a96176600 req-ab333707-4e34-40bd-8343-765f2e46ef69 service nova] Creating event network-vif-plugged:c048e1bc-f12e-4daf-b7ad-6dc3affd08f5 for instance e57fd56b-c9ce-4668-b9ff-703b4b310d1a on n-h1-862686-1 Oct 26 13:11:20.866337 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-91b80086-1b5c-45c7-a8b6-fa3a96176600 req-ab333707-4e34-40bd-8343-765f2e46ef69 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092976 Oct 26 13:11:20.868006 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1079/2253] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:11:20.883029 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-372af0f4-8770-4aa3-b728-bd6c242aced2 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:20.883740 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-372af0f4-8770-4aa3-b728-bd6c242aced2 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 6a7c952c-3ac4-4fad-b539-13a7ed9a2056] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:20.920063 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-372af0f4-8770-4aa3-b728-bd6c242aced2 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:20.920573 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-372af0f4-8770-4aa3-b728-bd6c242aced2 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:20.921743 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-372af0f4-8770-4aa3-b728-bd6c242aced2 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:20.922492 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-372af0f4-8770-4aa3-b728-bd6c242aced2 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:20.922946 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-372af0f4-8770-4aa3-b728-bd6c242aced2 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:20.923381 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-372af0f4-8770-4aa3-b728-bd6c242aced2 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:21.258933 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-36e85c8a-154f-426c-9a5b-6cd9387c953f tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4c9b05864d4d448b1c722659a3bc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2336994846d345aa86b5fd940d1b004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:21.266541 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:11:21.276875 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-36e85c8a-154f-426c-9a5b-6cd9387c953f tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/e57fd56b-c9ce-4668-b9ff-703b4b310d1a" status: 200 len: 1317 microversion: 2.1 time: 0.609207 Oct 26 13:11:21.278618 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1175/2254] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:20 2022] GET /compute/v2.1/servers/e57fd56b-c9ce-4668-b9ff-703b4b310d1a => generated 1317 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:21.291269 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-98ec05dd-c76d-4aec-a356-d5b553a7d392 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:21.298833 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-98ec05dd-c76d-4aec-a356-d5b553a7d392 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3574f016449d43e7baf97212ed731304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9729793794fdca01a8e15bed9f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:21.301574 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-98ec05dd-c76d-4aec-a356-d5b553a7d392 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Searching by: {'deleted': False, 'project_id': '37f9729793794fdca01a8e15bed9f4e9'} {{(pid=120598) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:11:21.332291 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-98ec05dd-c76d-4aec-a356-d5b553a7d392 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:21.332701 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-98ec05dd-c76d-4aec-a356-d5b553a7d392 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:21.333453 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-98ec05dd-c76d-4aec-a356-d5b553a7d392 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:21.334279 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-98ec05dd-c76d-4aec-a356-d5b553a7d392 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:21.335672 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-98ec05dd-c76d-4aec-a356-d5b553a7d392 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:21.336273 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-98ec05dd-c76d-4aec-a356-d5b553a7d392 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:21.482240 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-98ec05dd-c76d-4aec-a356-d5b553a7d392 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.201560 Oct 26 13:11:21.483125 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1176/2255] 10.222.0.40 () {58 vars in 1125 bytes} [Wed Oct 26 13:11:21 2022] GET /compute/v2.1/servers => generated 1015 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:21.492082 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9af654b2-0553-4eca-9c0a-8916180a46f9 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:21.494115 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9af654b2-0553-4eca-9c0a-8916180a46f9 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] [instance: 6555760c-8bf4-467e-80cb-cdf6eee4b93c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:21.503556 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9af654b2-0553-4eca-9c0a-8916180a46f9 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:21.504538 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9af654b2-0553-4eca-9c0a-8916180a46f9 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:21.505205 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9af654b2-0553-4eca-9c0a-8916180a46f9 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:21.506685 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9af654b2-0553-4eca-9c0a-8916180a46f9 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:21.507388 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9af654b2-0553-4eca-9c0a-8916180a46f9 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:21.508026 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9af654b2-0553-4eca-9c0a-8916180a46f9 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:21.891334 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9af654b2-0553-4eca-9c0a-8916180a46f9 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8fd7d2f8014b85beecc30c93bc084d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5902169366b646c7be94cb3521377225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:21.913918 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9af654b2-0553-4eca-9c0a-8916180a46f9 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] 10.222.0.40 "GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c" status: 200 len: 1323 microversion: 2.1 time: 0.425527 Oct 26 13:11:21.916253 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1177/2256] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:21 2022] GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c => generated 1323 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:21.932214 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-beeb2e30-2134-46d8-abb9-294a71473637 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:21.934133 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-beeb2e30-2134-46d8-abb9-294a71473637 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] [instance: 5a42cb7d-b4c0-4771-a655-5e3f44adae05] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:22.007845 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-372af0f4-8770-4aa3-b728-bd6c242aced2 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:22.017112 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-372af0f4-8770-4aa3-b728-bd6c242aced2 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056" status: 200 len: 1308 microversion: 2.1 time: 1.147874 Oct 26 13:11:22.024369 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1080/2257] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:20 2022] GET /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056 => generated 1308 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:22.030481 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4aa92135-0d22-430c-802d-b7e29eca36d8 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:22.032449 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4aa92135-0d22-430c-802d-b7e29eca36d8 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] [instance: 945d807f-8341-49ca-ba3e-702bfd803dc3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:22.046197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4aa92135-0d22-430c-802d-b7e29eca36d8 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:22.047780 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4aa92135-0d22-430c-802d-b7e29eca36d8 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:22.048944 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4aa92135-0d22-430c-802d-b7e29eca36d8 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:22.050921 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4aa92135-0d22-430c-802d-b7e29eca36d8 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:22.054184 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4aa92135-0d22-430c-802d-b7e29eca36d8 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:22.054975 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4aa92135-0d22-430c-802d-b7e29eca36d8 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:22.066199 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-beeb2e30-2134-46d8-abb9-294a71473637 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3574f016449d43e7baf97212ed731304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9729793794fdca01a8e15bed9f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:22.078167 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-beeb2e30-2134-46d8-abb9-294a71473637 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] 10.222.0.40 "GET /compute/v2.1/servers/5a42cb7d-b4c0-4771-a655-5e3f44adae05" status: 200 len: 1222 microversion: 2.1 time: 0.158869 Oct 26 13:11:22.080271 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1178/2258] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:21 2022] GET /compute/v2.1/servers/5a42cb7d-b4c0-4771-a655-5e3f44adae05 => generated 1222 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:22.302180 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ddffd92f-0c76-4b69-80a5-5d497d8c159a tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:22.302812 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ddffd92f-0c76-4b69-80a5-5d497d8c159a tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: e57fd56b-c9ce-4668-b9ff-703b4b310d1a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:22.318861 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ddffd92f-0c76-4b69-80a5-5d497d8c159a tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:22.319533 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ddffd92f-0c76-4b69-80a5-5d497d8c159a tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:22.322097 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ddffd92f-0c76-4b69-80a5-5d497d8c159a tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:22.323047 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ddffd92f-0c76-4b69-80a5-5d497d8c159a tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:22.332119 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ddffd92f-0c76-4b69-80a5-5d497d8c159a tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:22.332633 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ddffd92f-0c76-4b69-80a5-5d497d8c159a tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:22.637003 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ddffd92f-0c76-4b69-80a5-5d497d8c159a tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4c9b05864d4d448b1c722659a3bc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2336994846d345aa86b5fd940d1b004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:22.649796 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ddffd92f-0c76-4b69-80a5-5d497d8c159a tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/e57fd56b-c9ce-4668-b9ff-703b4b310d1a" status: 200 len: 1317 microversion: 2.1 time: 0.352898 Oct 26 13:11:22.667657 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1179/2259] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:22 2022] GET /compute/v2.1/servers/e57fd56b-c9ce-4668-b9ff-703b4b310d1a => generated 1317 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:11:22.919479 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-2208578e-d647-44b0-828f-9d26d895f654 req-8518220d-32e4-4945-824b-ff1433b655b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6555760c-8bf4-467e-80cb-cdf6eee4b93c", "name": "network-vif-plugged", "status": "completed", "tag": "16bdf5c3-e3cb-4e23-93c3-2342697bd561"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:11:22.930617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-2208578e-d647-44b0-828f-9d26d895f654 req-8518220d-32e4-4945-824b-ff1433b655b5 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:22.931192 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-2208578e-d647-44b0-828f-9d26d895f654 req-8518220d-32e4-4945-824b-ff1433b655b5 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:22.931787 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-2208578e-d647-44b0-828f-9d26d895f654 req-8518220d-32e4-4945-824b-ff1433b655b5 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:22.945416 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-2208578e-d647-44b0-828f-9d26d895f654 req-8518220d-32e4-4945-824b-ff1433b655b5 service nova] Creating event network-vif-plugged:16bdf5c3-e3cb-4e23-93c3-2342697bd561 for instance 6555760c-8bf4-467e-80cb-cdf6eee4b93c on n-h1-862686-1 Oct 26 13:11:22.950783 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-2208578e-d647-44b0-828f-9d26d895f654 req-8518220d-32e4-4945-824b-ff1433b655b5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035058 Oct 26 13:11:22.951395 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1180/2260] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:11:22.956974 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-408b5e96-c3d0-44dc-b20d-c5bdea41794a tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:22.957704 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-408b5e96-c3d0-44dc-b20d-c5bdea41794a tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] [instance: 6555760c-8bf4-467e-80cb-cdf6eee4b93c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:22.964143 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-408b5e96-c3d0-44dc-b20d-c5bdea41794a tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:22.964651 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-408b5e96-c3d0-44dc-b20d-c5bdea41794a tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:22.965082 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-408b5e96-c3d0-44dc-b20d-c5bdea41794a tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:22.965818 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-408b5e96-c3d0-44dc-b20d-c5bdea41794a tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:22.966275 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-408b5e96-c3d0-44dc-b20d-c5bdea41794a tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:22.966701 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-408b5e96-c3d0-44dc-b20d-c5bdea41794a tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:23.208547 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-408b5e96-c3d0-44dc-b20d-c5bdea41794a tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8fd7d2f8014b85beecc30c93bc084d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5902169366b646c7be94cb3521377225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:23.225721 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-408b5e96-c3d0-44dc-b20d-c5bdea41794a tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] 10.222.0.40 "GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c" status: 200 len: 1323 microversion: 2.1 time: 0.272852 Oct 26 13:11:23.226336 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1181/2261] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:22 2022] GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c => generated 1323 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:23.241698 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4a3d4eea-52c1-4edb-94d1-afd92f8a1274 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:23.244233 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4a3d4eea-52c1-4edb-94d1-afd92f8a1274 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 6a7c952c-3ac4-4fad-b539-13a7ed9a2056] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:23.263854 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a3d4eea-52c1-4edb-94d1-afd92f8a1274 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:23.265289 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a3d4eea-52c1-4edb-94d1-afd92f8a1274 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:23.267471 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a3d4eea-52c1-4edb-94d1-afd92f8a1274 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:23.272927 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a3d4eea-52c1-4edb-94d1-afd92f8a1274 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:23.273867 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a3d4eea-52c1-4edb-94d1-afd92f8a1274 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:23.274755 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a3d4eea-52c1-4edb-94d1-afd92f8a1274 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:23.698151 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4aa92135-0d22-430c-802d-b7e29eca36d8 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329c4c283e1646f295472c59225753de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd2c80c6e164a708040af3165617a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:23.711581 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4aa92135-0d22-430c-802d-b7e29eca36d8 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] 10.222.0.40 "GET /compute/v2.1/servers/945d807f-8341-49ca-ba3e-702bfd803dc3" status: 200 len: 1351 microversion: 2.1 time: 1.685586 Oct 26 13:11:23.712162 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1081/2262] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:22 2022] GET /compute/v2.1/servers/945d807f-8341-49ca-ba3e-702bfd803dc3 => generated 1351 bytes in 1687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:23.725736 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d6af5a58-2bb5-4002-9e8b-f0dc6859a112 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:23.726533 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d6af5a58-2bb5-4002-9e8b-f0dc6859a112 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] [instance: 5a42cb7d-b4c0-4771-a655-5e3f44adae05] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:23.743832 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6af5a58-2bb5-4002-9e8b-f0dc6859a112 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:23.744787 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6af5a58-2bb5-4002-9e8b-f0dc6859a112 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:23.744787 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6af5a58-2bb5-4002-9e8b-f0dc6859a112 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:23.745499 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6af5a58-2bb5-4002-9e8b-f0dc6859a112 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:23.746863 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4a3d4eea-52c1-4edb-94d1-afd92f8a1274 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:23.755960 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6af5a58-2bb5-4002-9e8b-f0dc6859a112 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:23.757752 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6af5a58-2bb5-4002-9e8b-f0dc6859a112 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:23.765710 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4a3d4eea-52c1-4edb-94d1-afd92f8a1274 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056" status: 200 len: 1308 microversion: 2.1 time: 0.533463 Oct 26 13:11:23.777536 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1182/2263] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:23 2022] GET /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056 => generated 1308 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:23.779950 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6d6a83a9-32aa-47d4-823f-8fb5e9430c7c tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:23.780624 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6d6a83a9-32aa-47d4-823f-8fb5e9430c7c tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: e57fd56b-c9ce-4668-b9ff-703b4b310d1a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:23.798180 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d6a83a9-32aa-47d4-823f-8fb5e9430c7c tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:23.798391 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d6a83a9-32aa-47d4-823f-8fb5e9430c7c tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:23.798800 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d6a83a9-32aa-47d4-823f-8fb5e9430c7c tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:23.800297 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d6a83a9-32aa-47d4-823f-8fb5e9430c7c tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:23.803198 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d6a83a9-32aa-47d4-823f-8fb5e9430c7c tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:23.803652 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d6a83a9-32aa-47d4-823f-8fb5e9430c7c tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:23.953500 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d6af5a58-2bb5-4002-9e8b-f0dc6859a112 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3574f016449d43e7baf97212ed731304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9729793794fdca01a8e15bed9f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:23.964553 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d6af5a58-2bb5-4002-9e8b-f0dc6859a112 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] 10.222.0.40 "GET /compute/v2.1/servers/5a42cb7d-b4c0-4771-a655-5e3f44adae05" status: 200 len: 1274 microversion: 2.1 time: 0.251144 Oct 26 13:11:23.974904 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1082/2264] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:23 2022] GET /compute/v2.1/servers/5a42cb7d-b4c0-4771-a655-5e3f44adae05 => generated 1274 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:24.252065 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-10f8ced1-9691-4bd0-8555-fc47bc0e39e4 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:24.252878 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-10f8ced1-9691-4bd0-8555-fc47bc0e39e4 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] [instance: 6555760c-8bf4-467e-80cb-cdf6eee4b93c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:24.263853 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-10f8ced1-9691-4bd0-8555-fc47bc0e39e4 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:24.264344 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-10f8ced1-9691-4bd0-8555-fc47bc0e39e4 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:24.264800 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-10f8ced1-9691-4bd0-8555-fc47bc0e39e4 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:24.265552 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-10f8ced1-9691-4bd0-8555-fc47bc0e39e4 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:24.266018 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-10f8ced1-9691-4bd0-8555-fc47bc0e39e4 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:24.266450 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-10f8ced1-9691-4bd0-8555-fc47bc0e39e4 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:24.619623 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6d6a83a9-32aa-47d4-823f-8fb5e9430c7c tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4c9b05864d4d448b1c722659a3bc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2336994846d345aa86b5fd940d1b004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:24.628757 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6d6a83a9-32aa-47d4-823f-8fb5e9430c7c tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/e57fd56b-c9ce-4668-b9ff-703b4b310d1a" status: 200 len: 1508 microversion: 2.1 time: 0.860384 Oct 26 13:11:24.646312 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1183/2265] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:23 2022] GET /compute/v2.1/servers/e57fd56b-c9ce-4668-b9ff-703b4b310d1a => generated 1508 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:24.738738 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d119ee68-210f-409f-af84-5f2adabe4336 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:24.739683 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d119ee68-210f-409f-af84-5f2adabe4336 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] [instance: 945d807f-8341-49ca-ba3e-702bfd803dc3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:24.749814 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d119ee68-210f-409f-af84-5f2adabe4336 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:24.751421 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d119ee68-210f-409f-af84-5f2adabe4336 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:24.753732 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d119ee68-210f-409f-af84-5f2adabe4336 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:24.756007 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d119ee68-210f-409f-af84-5f2adabe4336 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:24.756805 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d119ee68-210f-409f-af84-5f2adabe4336 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:24.758704 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d119ee68-210f-409f-af84-5f2adabe4336 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:25.247948 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d119ee68-210f-409f-af84-5f2adabe4336 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329c4c283e1646f295472c59225753de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd2c80c6e164a708040af3165617a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:25.269326 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d119ee68-210f-409f-af84-5f2adabe4336 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] 10.222.0.40 "GET /compute/v2.1/servers/945d807f-8341-49ca-ba3e-702bfd803dc3" status: 200 len: 1351 microversion: 2.1 time: 0.534024 Oct 26 13:11:25.271583 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1184/2266] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:24 2022] GET /compute/v2.1/servers/945d807f-8341-49ca-ba3e-702bfd803dc3 => generated 1351 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:25.277573 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e8108b76-8570-4160-96e0-b368d4271401 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:25.278609 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e8108b76-8570-4160-96e0-b368d4271401 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 6a7c952c-3ac4-4fad-b539-13a7ed9a2056] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:25.287474 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e8108b76-8570-4160-96e0-b368d4271401 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:25.288292 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e8108b76-8570-4160-96e0-b368d4271401 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:25.289217 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e8108b76-8570-4160-96e0-b368d4271401 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:25.291015 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e8108b76-8570-4160-96e0-b368d4271401 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:25.292390 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e8108b76-8570-4160-96e0-b368d4271401 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:25.293059 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e8108b76-8570-4160-96e0-b368d4271401 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:25.672459 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-10f8ced1-9691-4bd0-8555-fc47bc0e39e4 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8fd7d2f8014b85beecc30c93bc084d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5902169366b646c7be94cb3521377225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:25.685648 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-10f8ced1-9691-4bd0-8555-fc47bc0e39e4 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] 10.222.0.40 "GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c" status: 200 len: 1323 microversion: 2.1 time: 1.437764 Oct 26 13:11:25.692331 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1083/2267] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:24 2022] GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c => generated 1323 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:25.705017 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4c9d6202-e8db-4f3c-bb71-f494b8d95f2a tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:25.706805 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4c9d6202-e8db-4f3c-bb71-f494b8d95f2a tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] [instance: 5a42cb7d-b4c0-4771-a655-5e3f44adae05] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:25.727153 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4c9d6202-e8db-4f3c-bb71-f494b8d95f2a tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:25.727842 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4c9d6202-e8db-4f3c-bb71-f494b8d95f2a tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:25.728660 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4c9d6202-e8db-4f3c-bb71-f494b8d95f2a tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:25.729557 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4c9d6202-e8db-4f3c-bb71-f494b8d95f2a tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:25.733666 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4c9d6202-e8db-4f3c-bb71-f494b8d95f2a tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:25.734259 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4c9d6202-e8db-4f3c-bb71-f494b8d95f2a tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:25.906379 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e8108b76-8570-4160-96e0-b368d4271401 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:25.922690 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e8108b76-8570-4160-96e0-b368d4271401 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056" status: 200 len: 1308 microversion: 2.1 time: 0.649731 Oct 26 13:11:25.933868 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1185/2268] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:25 2022] GET /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056 => generated 1308 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:26.087847 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4c9d6202-e8db-4f3c-bb71-f494b8d95f2a tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3574f016449d43e7baf97212ed731304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9729793794fdca01a8e15bed9f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:26.102280 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4c9d6202-e8db-4f3c-bb71-f494b8d95f2a tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] 10.222.0.40 "GET /compute/v2.1/servers/5a42cb7d-b4c0-4771-a655-5e3f44adae05" status: 200 len: 1280 microversion: 2.1 time: 0.408571 Oct 26 13:11:26.117944 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1084/2269] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:25 2022] GET /compute/v2.1/servers/5a42cb7d-b4c0-4771-a655-5e3f44adae05 => generated 1280 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:26.296899 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-23423477-607e-4336-b2be-b838363790a7 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:26.297826 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-23423477-607e-4336-b2be-b838363790a7 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] [instance: 945d807f-8341-49ca-ba3e-702bfd803dc3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:26.308386 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-23423477-607e-4336-b2be-b838363790a7 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:26.320645 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-23423477-607e-4336-b2be-b838363790a7 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:26.321322 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-23423477-607e-4336-b2be-b838363790a7 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:26.323385 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-23423477-607e-4336-b2be-b838363790a7 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:26.324649 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-23423477-607e-4336-b2be-b838363790a7 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:26.325254 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-23423477-607e-4336-b2be-b838363790a7 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:26.721894 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0906bccd-8f6c-41aa-9e62-8ae7a81effb0 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:26.723633 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0906bccd-8f6c-41aa-9e62-8ae7a81effb0 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] [instance: 6555760c-8bf4-467e-80cb-cdf6eee4b93c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:26.738204 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0906bccd-8f6c-41aa-9e62-8ae7a81effb0 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:26.738697 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0906bccd-8f6c-41aa-9e62-8ae7a81effb0 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:26.745594 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0906bccd-8f6c-41aa-9e62-8ae7a81effb0 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:26.748185 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-23423477-607e-4336-b2be-b838363790a7 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329c4c283e1646f295472c59225753de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd2c80c6e164a708040af3165617a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:26.750580 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0906bccd-8f6c-41aa-9e62-8ae7a81effb0 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:26.754272 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0906bccd-8f6c-41aa-9e62-8ae7a81effb0 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:26.755526 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0906bccd-8f6c-41aa-9e62-8ae7a81effb0 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:26.761577 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-23423477-607e-4336-b2be-b838363790a7 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] 10.222.0.40 "GET /compute/v2.1/servers/945d807f-8341-49ca-ba3e-702bfd803dc3" status: 200 len: 1351 microversion: 2.1 time: 0.469013 Oct 26 13:11:26.774140 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1186/2270] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:26 2022] GET /compute/v2.1/servers/945d807f-8341-49ca-ba3e-702bfd803dc3 => generated 1351 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:26.947778 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f5c48192-490d-47dc-9a42-c35e791c12ec tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:26.948606 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f5c48192-490d-47dc-9a42-c35e791c12ec tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 6a7c952c-3ac4-4fad-b539-13a7ed9a2056] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:26.960249 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5c48192-490d-47dc-9a42-c35e791c12ec tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:26.961381 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5c48192-490d-47dc-9a42-c35e791c12ec tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:26.962812 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5c48192-490d-47dc-9a42-c35e791c12ec tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:26.963937 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5c48192-490d-47dc-9a42-c35e791c12ec tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:26.964627 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5c48192-490d-47dc-9a42-c35e791c12ec tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:26.965315 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5c48192-490d-47dc-9a42-c35e791c12ec tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:27.307820 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f5c48192-490d-47dc-9a42-c35e791c12ec tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:27.334612 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f5c48192-490d-47dc-9a42-c35e791c12ec tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056" status: 200 len: 1308 microversion: 2.1 time: 0.386138 Oct 26 13:11:27.336557 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1187/2271] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:26 2022] GET /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056 => generated 1308 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:27.343772 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5a5f5575-e7e2-4a1c-9d95-84eaecfcfefa tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:27.350355 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5a5f5575-e7e2-4a1c-9d95-84eaecfcfefa tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] [instance: 5a42cb7d-b4c0-4771-a655-5e3f44adae05] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:27.358735 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a5f5575-e7e2-4a1c-9d95-84eaecfcfefa tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:27.359576 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a5f5575-e7e2-4a1c-9d95-84eaecfcfefa tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:27.360314 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a5f5575-e7e2-4a1c-9d95-84eaecfcfefa tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:27.362949 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a5f5575-e7e2-4a1c-9d95-84eaecfcfefa tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:27.363671 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a5f5575-e7e2-4a1c-9d95-84eaecfcfefa tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:27.367071 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a5f5575-e7e2-4a1c-9d95-84eaecfcfefa tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:27.718113 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5a5f5575-e7e2-4a1c-9d95-84eaecfcfefa tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3574f016449d43e7baf97212ed731304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9729793794fdca01a8e15bed9f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:27.733655 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5a5f5575-e7e2-4a1c-9d95-84eaecfcfefa tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] 10.222.0.40 "GET /compute/v2.1/servers/5a42cb7d-b4c0-4771-a655-5e3f44adae05" status: 200 len: 1280 microversion: 2.1 time: 0.395484 Oct 26 13:11:27.734280 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1188/2272] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:27 2022] GET /compute/v2.1/servers/5a42cb7d-b4c0-4771-a655-5e3f44adae05 => generated 1280 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:27.741666 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-11c1ab92-39d3-4e58-8b48-3f598692f174 tempest-VolumesAdminNegativeTest-518675211 tempest-VolumesAdminNegativeTest-518675211-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "a7d6442e-dc2f-41c7-8722-2c5b9ce38940"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:11:27.751037 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-11c1ab92-39d3-4e58-8b48-3f598692f174 tempest-VolumesAdminNegativeTest-518675211 tempest-VolumesAdminNegativeTest-518675211-project-admin] [instance: e57fd56b-c9ce-4668-b9ff-703b4b310d1a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:27.759490 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:11:27.778020 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11c1ab92-39d3-4e58-8b48-3f598692f174 tempest-VolumesAdminNegativeTest-518675211 tempest-VolumesAdminNegativeTest-518675211-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:27.779022 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11c1ab92-39d3-4e58-8b48-3f598692f174 tempest-VolumesAdminNegativeTest-518675211 tempest-VolumesAdminNegativeTest-518675211-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:27.779719 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11c1ab92-39d3-4e58-8b48-3f598692f174 tempest-VolumesAdminNegativeTest-518675211 tempest-VolumesAdminNegativeTest-518675211-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:27.780667 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11c1ab92-39d3-4e58-8b48-3f598692f174 tempest-VolumesAdminNegativeTest-518675211 tempest-VolumesAdminNegativeTest-518675211-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:27.782159 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11c1ab92-39d3-4e58-8b48-3f598692f174 tempest-VolumesAdminNegativeTest-518675211 tempest-VolumesAdminNegativeTest-518675211-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:27.784192 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11c1ab92-39d3-4e58-8b48-3f598692f174 tempest-VolumesAdminNegativeTest-518675211 tempest-VolumesAdminNegativeTest-518675211-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:27.915946 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-11c1ab92-39d3-4e58-8b48-3f598692f174 tempest-VolumesAdminNegativeTest-518675211 tempest-VolumesAdminNegativeTest-518675211-project-admin] HTTP exception thrown: Volume 545716f5-1205-41ad-8dec-d97d4bc82ca6 could not be found. Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-11c1ab92-39d3-4e58-8b48-3f598692f174 tempest-VolumesAdminNegativeTest-518675211 tempest-VolumesAdminNegativeTest-518675211-project-admin] Request method failure captured: Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: request: PUT /compute/v2.1/servers/e57fd56b-c9ce-4668-b9ff-703b4b310d1a/os-volume_attachments/545716f5-1205-41ad-8dec-d97d4bc82ca6 HTTP/1.1 Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 74 Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTFufuT7uACjxg0Cxj4LBQpsR8ZDOsDP_QeBtvAt8Q4DTAqbSNCuD528gStCPrrMEAMWyYfFIDj7YiFOIIGUiiEng30tNrRiwHop6alRaLnCZMbv8-SywVqkDkotwSIQbnxhwTeXx3PuP-x9ouzvJwXvSZrW1v8lV3klx9bTWw52LQU Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 07c58fb7be1e490f9ed227f711e168e2 Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-VolumesAdminNegativeTest-518675211 Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: X-Role: admin,member,reader Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: admin,member,reader Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/07c58fb7be1e490f9ed227f711e168e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/07c58fb7be1e490f9ed227f711e168e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_07c58fb7be1e490f9ed227f711e168e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/07c58fb7be1e490f9ed227f711e168e2"}]}] Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-VolumesAdminNegativeTest-518675211 Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 07c58fb7be1e490f9ed227f711e168e2 Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-518675211 Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-VolumesAdminNegativeTest-518675211-project-admin Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: ae250fafd8ad447f8a40e2005c7ce655 Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-VolumesAdminNegativeTest-518675211-project-admin Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: {"volumeAttachment": {"volumeId": "a7d6442e-dc2f-41c7-8722-2c5b9ce38940"}} Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: exception: Volume 545716f5-1205-41ad-8dec-d97d4bc82ca6 could not be found. Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'server_id': 'e57fd56b-c9ce-4668-b9ff-703b4b310d1a', 'id': '545716f5-1205-41ad-8dec-d97d4bc82ca6', 'body': {'volumeAttachment': {'volumeId': 'a7d6442e-dc2f-41c7-8722-2c5b9ce38940'}}} Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 545716f5-1205-41ad-8dec-d97d4bc82ca6 could not be found. (HTTP 404) (Request-ID: req-74ffe8d1-8e2a-47ae-a6bd-6c7fbf7505e3) Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 26 13:11:27.927663 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 26 13:11:27.931598 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 26 13:11:27.931598 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 26 13:11:27.931598 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 26 13:11:27.931598 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 13:11:27.931598 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 13:11:27.931598 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 26 13:11:27.931598 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 26 13:11:27.931598 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 26 13:11:27.931598 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 26 13:11:27.931598 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 26 13:11:27.931598 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 26 13:11:27.931598 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 26 13:11:27.931598 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 26 13:11:27.931598 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 13:11:27.931598 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 13:11:27.931598 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 13:11:27.931598 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 13:11:27.931598 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 545716f5-1205-41ad-8dec-d97d4bc82ca6 could not be found. Oct 26 13:11:27.931598 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:11:27.931598 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:11:27.931598 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:11:27.931598 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:11:27.931598 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:11:27.931598 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:11:27.931598 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:11:27.931598 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:11:27.931598 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:11:27.931598 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:11:27.931598 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:11:27.931598 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:11:27.931598 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:11:27.931598 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:11:27.931598 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 26 13:11:27.931598 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 26 13:11:27.931598 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 26 13:11:27.931598 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:11:27.931598 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 545716f5-1205-41ad-8dec-d97d4bc82ca6 could not be found. Oct 26 13:11:27.931598 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:11:27.931598 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:11:27.931598 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:11:27.931598 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:11:27.931598 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:11:27.931598 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:11:27.931598 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:11:27.931598 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:11:27.931598 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 545716f5-1205-41ad-8dec-d97d4bc82ca6 could not be found. Oct 26 13:11:27.931598 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:11:27.935477 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-11c1ab92-39d3-4e58-8b48-3f598692f174 tempest-VolumesAdminNegativeTest-518675211 tempest-VolumesAdminNegativeTest-518675211-project-admin] Returning 404 to user: Volume 545716f5-1205-41ad-8dec-d97d4bc82ca6 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:11:27.936511 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-11c1ab92-39d3-4e58-8b48-3f598692f174 tempest-VolumesAdminNegativeTest-518675211 tempest-VolumesAdminNegativeTest-518675211-project-admin] 10.222.0.40 "PUT /compute/v2.1/servers/e57fd56b-c9ce-4668-b9ff-703b4b310d1a/os-volume_attachments/545716f5-1205-41ad-8dec-d97d4bc82ca6" status: 404 len: 109 microversion: 2.1 time: 0.201276 Oct 26 13:11:27.937263 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1189/2273] 10.222.0.40 () {60 vars in 1433 bytes} [Wed Oct 26 13:11:27 2022] PUT /compute/v2.1/servers/e57fd56b-c9ce-4668-b9ff-703b4b310d1a/os-volume_attachments/545716f5-1205-41ad-8dec-d97d4bc82ca6 => generated 109 bytes in 202 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:11:27.949859 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-00ce04e7-e866-4543-a40a-48afd38b8309 req-53a84cdb-fd4f-4c26-81b9-4d99ef5a6e56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a7c952c-3ac4-4fad-b539-13a7ed9a2056", "name": "network-vif-plugged", "status": "completed", "tag": "67a20481-a759-4368-b7fd-a870213309ed"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:11:27.962824 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-00ce04e7-e866-4543-a40a-48afd38b8309 req-53a84cdb-fd4f-4c26-81b9-4d99ef5a6e56 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:27.963550 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-00ce04e7-e866-4543-a40a-48afd38b8309 req-53a84cdb-fd4f-4c26-81b9-4d99ef5a6e56 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:27.966095 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-00ce04e7-e866-4543-a40a-48afd38b8309 req-53a84cdb-fd4f-4c26-81b9-4d99ef5a6e56 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:28.029126 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-00ce04e7-e866-4543-a40a-48afd38b8309 req-53a84cdb-fd4f-4c26-81b9-4d99ef5a6e56 service nova] Creating event network-vif-plugged:67a20481-a759-4368-b7fd-a870213309ed for instance 6a7c952c-3ac4-4fad-b539-13a7ed9a2056 on n-h2-862686-1 Oct 26 13:11:28.037731 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-00ce04e7-e866-4543-a40a-48afd38b8309 req-53a84cdb-fd4f-4c26-81b9-4d99ef5a6e56 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098558 Oct 26 13:11:28.039581 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1190/2274] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:11:28.048912 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c7c08f0d-94c1-46a9-a5e2-8b54465f4747 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:28.051511 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c7c08f0d-94c1-46a9-a5e2-8b54465f4747 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] [instance: 945d807f-8341-49ca-ba3e-702bfd803dc3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:28.094862 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c7c08f0d-94c1-46a9-a5e2-8b54465f4747 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:28.095578 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c7c08f0d-94c1-46a9-a5e2-8b54465f4747 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:28.096902 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c7c08f0d-94c1-46a9-a5e2-8b54465f4747 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:28.098112 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c7c08f0d-94c1-46a9-a5e2-8b54465f4747 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:28.098763 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c7c08f0d-94c1-46a9-a5e2-8b54465f4747 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:28.100624 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c7c08f0d-94c1-46a9-a5e2-8b54465f4747 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:28.274149 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0906bccd-8f6c-41aa-9e62-8ae7a81effb0 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8fd7d2f8014b85beecc30c93bc084d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5902169366b646c7be94cb3521377225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:28.288836 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=94 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:11:28.299361 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0906bccd-8f6c-41aa-9e62-8ae7a81effb0 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] 10.222.0.40 "GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c" status: 200 len: 1518 microversion: 2.1 time: 1.579032 Oct 26 13:11:28.324651 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1085/2275] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:26 2022] GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c => generated 1518 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:28.341972 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ef3fb6ce-8e28-451b-945f-012fdb5b19f3 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:11:28.352263 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ef3fb6ce-8e28-451b-945f-012fdb5b19f3 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] [instance: 6555760c-8bf4-467e-80cb-cdf6eee4b93c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:28.369572 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ef3fb6ce-8e28-451b-945f-012fdb5b19f3 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:28.373031 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ef3fb6ce-8e28-451b-945f-012fdb5b19f3 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:28.373529 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ef3fb6ce-8e28-451b-945f-012fdb5b19f3 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:28.374361 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ef3fb6ce-8e28-451b-945f-012fdb5b19f3 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:28.374746 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ef3fb6ce-8e28-451b-945f-012fdb5b19f3 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:28.375182 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ef3fb6ce-8e28-451b-945f-012fdb5b19f3 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:28.441804 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-ef3fb6ce-8e28-451b-945f-012fdb5b19f3 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lazy-loading 'flavor' on Instance uuid 6555760c-8bf4-467e-80cb-cdf6eee4b93c {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:11:28.619538 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ef3fb6ce-8e28-451b-945f-012fdb5b19f3 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] 10.222.0.40 "POST /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c/action" status: 200 len: 32 microversion: 2.1 time: 0.287109 Oct 26 13:11:28.621253 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1086/2276] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:11:28 2022] POST /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c/action => generated 32 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:11:28.633704 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e435bd96-0710-452d-9e7a-370e03d86e54 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:28.637427 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e435bd96-0710-452d-9e7a-370e03d86e54 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 6a7c952c-3ac4-4fad-b539-13a7ed9a2056] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:28.662197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e435bd96-0710-452d-9e7a-370e03d86e54 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:28.666046 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e435bd96-0710-452d-9e7a-370e03d86e54 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:28.666551 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e435bd96-0710-452d-9e7a-370e03d86e54 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:28.693684 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e435bd96-0710-452d-9e7a-370e03d86e54 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:28.696375 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e435bd96-0710-452d-9e7a-370e03d86e54 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:28.696853 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e435bd96-0710-452d-9e7a-370e03d86e54 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:29.515886 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c7c08f0d-94c1-46a9-a5e2-8b54465f4747 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329c4c283e1646f295472c59225753de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd2c80c6e164a708040af3165617a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:29.540035 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c7c08f0d-94c1-46a9-a5e2-8b54465f4747 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] 10.222.0.40 "GET /compute/v2.1/servers/945d807f-8341-49ca-ba3e-702bfd803dc3" status: 200 len: 1351 microversion: 2.1 time: 1.498821 Oct 26 13:11:29.544996 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1191/2277] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:28 2022] GET /compute/v2.1/servers/945d807f-8341-49ca-ba3e-702bfd803dc3 => generated 1351 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:29.555839 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-639614b7-181d-46d2-8f25-ca622d5c28fb tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:29.556825 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-639614b7-181d-46d2-8f25-ca622d5c28fb tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] [instance: 6555760c-8bf4-467e-80cb-cdf6eee4b93c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:29.572192 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-639614b7-181d-46d2-8f25-ca622d5c28fb tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:29.573041 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-639614b7-181d-46d2-8f25-ca622d5c28fb tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:29.575079 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-639614b7-181d-46d2-8f25-ca622d5c28fb tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:29.579360 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-639614b7-181d-46d2-8f25-ca622d5c28fb tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:29.581190 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-639614b7-181d-46d2-8f25-ca622d5c28fb tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:29.581908 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-639614b7-181d-46d2-8f25-ca622d5c28fb tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:29.713972 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e435bd96-0710-452d-9e7a-370e03d86e54 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:29.731921 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e435bd96-0710-452d-9e7a-370e03d86e54 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056" status: 200 len: 1308 microversion: 2.1 time: 1.109046 Oct 26 13:11:29.733081 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1087/2278] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:28 2022] GET /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056 => generated 1308 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:29.749069 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e489856a-2a24-47aa-a07a-d2f2473868af tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:29.752146 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e489856a-2a24-47aa-a07a-d2f2473868af tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] [instance: 5a42cb7d-b4c0-4771-a655-5e3f44adae05] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:29.768967 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e489856a-2a24-47aa-a07a-d2f2473868af tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:29.770467 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e489856a-2a24-47aa-a07a-d2f2473868af tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:29.771495 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e489856a-2a24-47aa-a07a-d2f2473868af tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:29.773631 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e489856a-2a24-47aa-a07a-d2f2473868af tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:29.774395 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e489856a-2a24-47aa-a07a-d2f2473868af tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:29.774972 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e489856a-2a24-47aa-a07a-d2f2473868af tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:30.196517 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:11:30.230420 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:11:30.609865 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e489856a-2a24-47aa-a07a-d2f2473868af tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3574f016449d43e7baf97212ed731304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9729793794fdca01a8e15bed9f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:30.621109 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e489856a-2a24-47aa-a07a-d2f2473868af tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] 10.222.0.40 "GET /compute/v2.1/servers/5a42cb7d-b4c0-4771-a655-5e3f44adae05" status: 200 len: 1322 microversion: 2.1 time: 0.876244 Oct 26 13:11:30.622328 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1088/2279] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:29 2022] GET /compute/v2.1/servers/5a42cb7d-b4c0-4771-a655-5e3f44adae05 => generated 1322 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:30.632841 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-cea65090-5236-4375-869b-81531d360bd2 req-d4f63afe-c7b9-4635-8a02-0d0e75058c85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "945d807f-8341-49ca-ba3e-702bfd803dc3", "tag": "d3c22259-adb6-472e-9aed-08a5fa660e6a"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:11:30.673719 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-cea65090-5236-4375-869b-81531d360bd2 req-d4f63afe-c7b9-4635-8a02-0d0e75058c85 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:30.675470 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-cea65090-5236-4375-869b-81531d360bd2 req-d4f63afe-c7b9-4635-8a02-0d0e75058c85 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:30.676073 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-cea65090-5236-4375-869b-81531d360bd2 req-d4f63afe-c7b9-4635-8a02-0d0e75058c85 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:30.696400 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-cea65090-5236-4375-869b-81531d360bd2 req-d4f63afe-c7b9-4635-8a02-0d0e75058c85 service nova] Creating event network-changed:d3c22259-adb6-472e-9aed-08a5fa660e6a for instance 945d807f-8341-49ca-ba3e-702bfd803dc3 on n-h2-862686-1 Oct 26 13:11:30.702481 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-cea65090-5236-4375-869b-81531d360bd2 req-d4f63afe-c7b9-4635-8a02-0d0e75058c85 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077834 Oct 26 13:11:30.703691 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1089/2280] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:11:30.719677 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5c7b1934-680f-4663-b076-542cec661142 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:30.721749 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5c7b1934-680f-4663-b076-542cec661142 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] [instance: 945d807f-8341-49ca-ba3e-702bfd803dc3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:30.729896 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c7b1934-680f-4663-b076-542cec661142 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:30.730685 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c7b1934-680f-4663-b076-542cec661142 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:30.731333 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c7b1934-680f-4663-b076-542cec661142 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:30.732269 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c7b1934-680f-4663-b076-542cec661142 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:30.732914 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c7b1934-680f-4663-b076-542cec661142 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:30.733772 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c7b1934-680f-4663-b076-542cec661142 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:30.753034 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-639614b7-181d-46d2-8f25-ca622d5c28fb tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8fd7d2f8014b85beecc30c93bc084d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5902169366b646c7be94cb3521377225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:30.765665 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-639614b7-181d-46d2-8f25-ca622d5c28fb tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] 10.222.0.40 "GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c" status: 200 len: 1524 microversion: 2.1 time: 1.218534 Oct 26 13:11:30.783641 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1192/2281] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:29 2022] GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c => generated 1524 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:30.783641 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-de835047-6579-4aba-a245-7f7622ea0255 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:30.783641 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-de835047-6579-4aba-a245-7f7622ea0255 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 6a7c952c-3ac4-4fad-b539-13a7ed9a2056] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:30.806308 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de835047-6579-4aba-a245-7f7622ea0255 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:30.814560 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de835047-6579-4aba-a245-7f7622ea0255 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:30.820271 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de835047-6579-4aba-a245-7f7622ea0255 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:30.822124 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de835047-6579-4aba-a245-7f7622ea0255 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:30.822591 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de835047-6579-4aba-a245-7f7622ea0255 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:30.823096 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de835047-6579-4aba-a245-7f7622ea0255 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:31.421371 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=4 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:11:31.553606 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5c7b1934-680f-4663-b076-542cec661142 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329c4c283e1646f295472c59225753de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd2c80c6e164a708040af3165617a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:31.566949 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5c7b1934-680f-4663-b076-542cec661142 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] 10.222.0.40 "GET /compute/v2.1/servers/945d807f-8341-49ca-ba3e-702bfd803dc3" status: 200 len: 1351 microversion: 2.1 time: 0.861881 Oct 26 13:11:31.581006 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1090/2282] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:30 2022] GET /compute/v2.1/servers/945d807f-8341-49ca-ba3e-702bfd803dc3 => generated 1351 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:31.581006 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-284bb921-d84f-4528-8d42-ed8da862226d tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1910278100", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "bc9fb6b0-7dd4-4196-b7a0-b7b83b2fdb57"}, {"uuid": "8e306f72-78d9-449e-822a-d848c881089b"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:11:31.695691 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-284bb921-d84f-4528-8d42-ed8da862226d tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] validate_networks() for [('bc9fb6b0-7dd4-4196-b7a0-b7b83b2fdb57', None, None, None, None, None), ('8e306f72-78d9-449e-822a-d848c881089b', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:11:31.760294 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-de835047-6579-4aba-a245-7f7622ea0255 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:31.777341 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-de835047-6579-4aba-a245-7f7622ea0255 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056" status: 200 len: 1488 microversion: 2.1 time: 1.007342 Oct 26 13:11:31.778721 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1193/2283] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:30 2022] GET /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056 => generated 1488 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:31.796606 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-affde330-9b79-45a9-8ad8-72a0d2ac4548 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:31.796606 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-affde330-9b79-45a9-8ad8-72a0d2ac4548 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] [instance: 5a42cb7d-b4c0-4771-a655-5e3f44adae05] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:31.809870 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-affde330-9b79-45a9-8ad8-72a0d2ac4548 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:31.811922 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-affde330-9b79-45a9-8ad8-72a0d2ac4548 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:31.812492 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-affde330-9b79-45a9-8ad8-72a0d2ac4548 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:31.817062 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-affde330-9b79-45a9-8ad8-72a0d2ac4548 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:31.819622 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-affde330-9b79-45a9-8ad8-72a0d2ac4548 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:31.820380 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-affde330-9b79-45a9-8ad8-72a0d2ac4548 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:32.077862 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=9 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:11:32.545841 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-affde330-9b79-45a9-8ad8-72a0d2ac4548 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3574f016449d43e7baf97212ed731304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9729793794fdca01a8e15bed9f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:32.559694 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-affde330-9b79-45a9-8ad8-72a0d2ac4548 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] 10.222.0.40 "GET /compute/v2.1/servers/5a42cb7d-b4c0-4771-a655-5e3f44adae05" status: 200 len: 1322 microversion: 2.1 time: 0.774668 Oct 26 13:11:32.560914 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1194/2284] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:31 2022] GET /compute/v2.1/servers/5a42cb7d-b4c0-4771-a655-5e3f44adae05 => generated 1322 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:32.573594 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-47961a11-017f-4ad9-97d2-587de24f8df0 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:32.575242 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-47961a11-017f-4ad9-97d2-587de24f8df0 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] [instance: 6555760c-8bf4-467e-80cb-cdf6eee4b93c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:32.589178 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47961a11-017f-4ad9-97d2-587de24f8df0 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:32.589930 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47961a11-017f-4ad9-97d2-587de24f8df0 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:32.590705 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47961a11-017f-4ad9-97d2-587de24f8df0 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:32.591571 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47961a11-017f-4ad9-97d2-587de24f8df0 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:32.592169 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47961a11-017f-4ad9-97d2-587de24f8df0 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:32.592739 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47961a11-017f-4ad9-97d2-587de24f8df0 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:33.186483 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-47961a11-017f-4ad9-97d2-587de24f8df0 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8fd7d2f8014b85beecc30c93bc084d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5902169366b646c7be94cb3521377225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:33.202294 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:11:33.230024 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-47961a11-017f-4ad9-97d2-587de24f8df0 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] 10.222.0.40 "GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c" status: 200 len: 1524 microversion: 2.1 time: 0.667005 Oct 26 13:11:33.233420 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1195/2285] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:32 2022] GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c => generated 1524 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:33.245694 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c872b83d-8230-4928-8d05-522437867386 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:33.246490 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c872b83d-8230-4928-8d05-522437867386 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 6a7c952c-3ac4-4fad-b539-13a7ed9a2056] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:33.261667 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c872b83d-8230-4928-8d05-522437867386 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:33.263760 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c872b83d-8230-4928-8d05-522437867386 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:33.264876 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c872b83d-8230-4928-8d05-522437867386 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:33.269848 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c872b83d-8230-4928-8d05-522437867386 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:33.270823 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c872b83d-8230-4928-8d05-522437867386 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:33.271557 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c872b83d-8230-4928-8d05-522437867386 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:33.326474 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c872b83d-8230-4928-8d05-522437867386 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 6a7c952c-3ac4-4fad-b539-13a7ed9a2056] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:11:33.503879 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c872b83d-8230-4928-8d05-522437867386 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056" status: 204 len: 0 microversion: 2.1 time: 0.267979 Oct 26 13:11:33.504922 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1196/2286] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:11:33 2022] DELETE /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:11:33.520936 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-9b163cc7-ac71-44df-915a-e9859414e1a2 req-71847aa1-29fc-4f3a-a6f8-0f52892c3787 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8768fa8b-3989-4c11-a1cf-7841cf7e5c8d", "tag": "c9389f47-0bb7-4ab3-99a5-538c3c3b76c9"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:11:33.542808 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9b163cc7-ac71-44df-915a-e9859414e1a2 req-71847aa1-29fc-4f3a-a6f8-0f52892c3787 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:33.543993 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9b163cc7-ac71-44df-915a-e9859414e1a2 req-71847aa1-29fc-4f3a-a6f8-0f52892c3787 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:33.544461 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9b163cc7-ac71-44df-915a-e9859414e1a2 req-71847aa1-29fc-4f3a-a6f8-0f52892c3787 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:33.562428 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-9b163cc7-ac71-44df-915a-e9859414e1a2 req-71847aa1-29fc-4f3a-a6f8-0f52892c3787 service nova] Creating event network-changed:c9389f47-0bb7-4ab3-99a5-538c3c3b76c9 for instance 8768fa8b-3989-4c11-a1cf-7841cf7e5c8d on n-h2-862686-1 Oct 26 13:11:33.568233 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-9b163cc7-ac71-44df-915a-e9859414e1a2 req-71847aa1-29fc-4f3a-a6f8-0f52892c3787 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061398 Oct 26 13:11:33.569254 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1197/2287] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:11:33.576893 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-74b5a86a-7e3b-4a81-906c-442fd741655e tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:33.577604 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-74b5a86a-7e3b-4a81-906c-442fd741655e tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: e57fd56b-c9ce-4668-b9ff-703b4b310d1a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:33.596653 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74b5a86a-7e3b-4a81-906c-442fd741655e tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:33.597164 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74b5a86a-7e3b-4a81-906c-442fd741655e tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:33.599869 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74b5a86a-7e3b-4a81-906c-442fd741655e tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:33.600616 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74b5a86a-7e3b-4a81-906c-442fd741655e tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:33.601541 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74b5a86a-7e3b-4a81-906c-442fd741655e tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:33.601541 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74b5a86a-7e3b-4a81-906c-442fd741655e tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:33.687358 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-74b5a86a-7e3b-4a81-906c-442fd741655e tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: e57fd56b-c9ce-4668-b9ff-703b4b310d1a] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:11:33.854734 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-74b5a86a-7e3b-4a81-906c-442fd741655e tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e57fd56b-c9ce-4668-b9ff-703b4b310d1a" status: 204 len: 0 microversion: 2.1 time: 0.282732 Oct 26 13:11:33.858505 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1198/2288] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:11:33 2022] DELETE /compute/v2.1/servers/e57fd56b-c9ce-4668-b9ff-703b4b310d1a => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:11:33.870668 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-013e4e31-6de5-4cfe-8828-89054c8add88 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:33.871904 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-013e4e31-6de5-4cfe-8828-89054c8add88 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] [instance: 945d807f-8341-49ca-ba3e-702bfd803dc3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:33.882400 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-013e4e31-6de5-4cfe-8828-89054c8add88 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:33.883120 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-013e4e31-6de5-4cfe-8828-89054c8add88 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:33.883918 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-013e4e31-6de5-4cfe-8828-89054c8add88 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:33.886027 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-013e4e31-6de5-4cfe-8828-89054c8add88 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:33.886983 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-013e4e31-6de5-4cfe-8828-89054c8add88 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:33.887745 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-013e4e31-6de5-4cfe-8828-89054c8add88 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:34.474345 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-284bb921-d84f-4528-8d42-ed8da862226d tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:11:34.475654 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-284bb921-d84f-4528-8d42-ed8da862226d tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:11:34.476429 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-284bb921-d84f-4528-8d42-ed8da862226d tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:11:34.477143 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-284bb921-d84f-4528-8d42-ed8da862226d tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:11:34.477810 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-284bb921-d84f-4528-8d42-ed8da862226d tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:11:34.488027 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-284bb921-d84f-4528-8d42-ed8da862226d tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:34.488920 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-284bb921-d84f-4528-8d42-ed8da862226d tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:34.489649 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-284bb921-d84f-4528-8d42-ed8da862226d tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:34.490637 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-284bb921-d84f-4528-8d42-ed8da862226d tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:34.491426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-284bb921-d84f-4528-8d42-ed8da862226d tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:34.492077 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-284bb921-d84f-4528-8d42-ed8da862226d tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:34.515257 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-284bb921-d84f-4528-8d42-ed8da862226d tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Getting quotas for project 23b66b9b9c574fa799086c0733d28887. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:11:34.522196 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-284bb921-d84f-4528-8d42-ed8da862226d tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Getting quotas for user c533afbf98454632a796eea300f50a35 and project 23b66b9b9c574fa799086c0733d28887. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:11:34.536357 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-284bb921-d84f-4528-8d42-ed8da862226d tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:11:34.539102 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-284bb921-d84f-4528-8d42-ed8da862226d tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: cd344db8-1e3a-498b-a4b4-54b0547fc063] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:11:34.547629 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-013e4e31-6de5-4cfe-8828-89054c8add88 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329c4c283e1646f295472c59225753de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd2c80c6e164a708040af3165617a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:34.562641 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-013e4e31-6de5-4cfe-8828-89054c8add88 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] 10.222.0.40 "GET /compute/v2.1/servers/945d807f-8341-49ca-ba3e-702bfd803dc3" status: 200 len: 1351 microversion: 2.1 time: 0.700012 Oct 26 13:11:34.563353 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1199/2289] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:33 2022] GET /compute/v2.1/servers/945d807f-8341-49ca-ba3e-702bfd803dc3 => generated 1351 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:34.573973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f1b85284-0aee-4e5a-8235-2f3f6d96938c tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:34.573973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f1b85284-0aee-4e5a-8235-2f3f6d96938c tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 6a7c952c-3ac4-4fad-b539-13a7ed9a2056] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:34.589970 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1b85284-0aee-4e5a-8235-2f3f6d96938c tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:34.595551 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1b85284-0aee-4e5a-8235-2f3f6d96938c tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:34.598024 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1b85284-0aee-4e5a-8235-2f3f6d96938c tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:34.600907 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1b85284-0aee-4e5a-8235-2f3f6d96938c tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:34.601369 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1b85284-0aee-4e5a-8235-2f3f6d96938c tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:34.601850 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1b85284-0aee-4e5a-8235-2f3f6d96938c tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:34.629033 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-284bb921-d84f-4528-8d42-ed8da862226d tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.057760 Oct 26 13:11:34.629991 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1091/2290] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:11:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 3060 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:11:34.635155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-645973c0-9e66-4fd4-9990-cca5e4c81835 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:34.636076 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-645973c0-9e66-4fd4-9990-cca5e4c81835 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] [instance: 5a42cb7d-b4c0-4771-a655-5e3f44adae05] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:34.642915 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-645973c0-9e66-4fd4-9990-cca5e4c81835 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:34.643869 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-645973c0-9e66-4fd4-9990-cca5e4c81835 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:34.644462 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-645973c0-9e66-4fd4-9990-cca5e4c81835 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:34.645779 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-645973c0-9e66-4fd4-9990-cca5e4c81835 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:34.647154 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-645973c0-9e66-4fd4-9990-cca5e4c81835 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:34.647950 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-645973c0-9e66-4fd4-9990-cca5e4c81835 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:34.994231 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-645973c0-9e66-4fd4-9990-cca5e4c81835 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3574f016449d43e7baf97212ed731304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9729793794fdca01a8e15bed9f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:35.006560 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-645973c0-9e66-4fd4-9990-cca5e4c81835 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] 10.222.0.40 "GET /compute/v2.1/servers/5a42cb7d-b4c0-4771-a655-5e3f44adae05" status: 200 len: 1322 microversion: 2.1 time: 0.375125 Oct 26 13:11:35.029994 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1092/2291] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:34 2022] GET /compute/v2.1/servers/5a42cb7d-b4c0-4771-a655-5e3f44adae05 => generated 1322 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:35.038222 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-50a817a8-fef8-4c4b-9e66-25bc77610846 req-26831956-2c90-4bfc-9f8e-d0b5194109ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a42cb7d-b4c0-4771-a655-5e3f44adae05", "tag": "33358974-4493-43ef-84db-4672cd97f231"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:11:35.050548 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-50a817a8-fef8-4c4b-9e66-25bc77610846 req-26831956-2c90-4bfc-9f8e-d0b5194109ee service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:35.051222 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-50a817a8-fef8-4c4b-9e66-25bc77610846 req-26831956-2c90-4bfc-9f8e-d0b5194109ee service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:35.051810 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-50a817a8-fef8-4c4b-9e66-25bc77610846 req-26831956-2c90-4bfc-9f8e-d0b5194109ee service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:35.096715 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-50a817a8-fef8-4c4b-9e66-25bc77610846 req-26831956-2c90-4bfc-9f8e-d0b5194109ee service nova] Creating event network-changed:33358974-4493-43ef-84db-4672cd97f231 for instance 5a42cb7d-b4c0-4771-a655-5e3f44adae05 on n-h2-862686-1 Oct 26 13:11:35.109471 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-50a817a8-fef8-4c4b-9e66-25bc77610846 req-26831956-2c90-4bfc-9f8e-d0b5194109ee service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074972 Oct 26 13:11:35.111264 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1093/2292] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:11:35.123270 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b6e0c2f1-210a-4fbf-bea2-3eff9ee5fa5f tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:35.129365 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b6e0c2f1-210a-4fbf-bea2-3eff9ee5fa5f tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: e57fd56b-c9ce-4668-b9ff-703b4b310d1a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:35.137856 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6e0c2f1-210a-4fbf-bea2-3eff9ee5fa5f tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:35.138764 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6e0c2f1-210a-4fbf-bea2-3eff9ee5fa5f tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:35.139944 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6e0c2f1-210a-4fbf-bea2-3eff9ee5fa5f tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:35.140830 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6e0c2f1-210a-4fbf-bea2-3eff9ee5fa5f tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:35.141446 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6e0c2f1-210a-4fbf-bea2-3eff9ee5fa5f tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:35.142063 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6e0c2f1-210a-4fbf-bea2-3eff9ee5fa5f tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:35.166014 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f1b85284-0aee-4e5a-8235-2f3f6d96938c tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:35.197174 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f1b85284-0aee-4e5a-8235-2f3f6d96938c tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056" status: 200 len: 1494 microversion: 2.1 time: 0.631759 Oct 26 13:11:35.198609 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1200/2293] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:34 2022] GET /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056 => generated 1494 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:35.210944 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9e6c039a-8ebf-429d-a0fb-17edea2239ca tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:35.213072 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9e6c039a-8ebf-429d-a0fb-17edea2239ca tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] [instance: 6555760c-8bf4-467e-80cb-cdf6eee4b93c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:35.235933 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e6c039a-8ebf-429d-a0fb-17edea2239ca tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:35.236458 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e6c039a-8ebf-429d-a0fb-17edea2239ca tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:35.237588 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e6c039a-8ebf-429d-a0fb-17edea2239ca tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:35.238562 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e6c039a-8ebf-429d-a0fb-17edea2239ca tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:35.239161 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e6c039a-8ebf-429d-a0fb-17edea2239ca tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:35.239854 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e6c039a-8ebf-429d-a0fb-17edea2239ca tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:35.981123 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b6e0c2f1-210a-4fbf-bea2-3eff9ee5fa5f tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4c9b05864d4d448b1c722659a3bc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2336994846d345aa86b5fd940d1b004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:35.982120 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9e6c039a-8ebf-429d-a0fb-17edea2239ca tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8fd7d2f8014b85beecc30c93bc084d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5902169366b646c7be94cb3521377225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:36.000570 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b6e0c2f1-210a-4fbf-bea2-3eff9ee5fa5f tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/e57fd56b-c9ce-4668-b9ff-703b4b310d1a" status: 200 len: 1514 microversion: 2.1 time: 0.884860 Oct 26 13:11:36.002007 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9e6c039a-8ebf-429d-a0fb-17edea2239ca tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] 10.222.0.40 "GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c" status: 200 len: 1524 microversion: 2.1 time: 0.800588 Oct 26 13:11:36.003020 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1094/2294] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:35 2022] GET /compute/v2.1/servers/e57fd56b-c9ce-4668-b9ff-703b4b310d1a => generated 1514 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:36.005358 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1201/2295] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:35 2022] GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c => generated 1524 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:36.012972 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-68fd82f4-0f5f-4547-84d5-db75da2ad12e tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:36.014177 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4d7f5148-6664-4620-afba-44a652a30257 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:36.014928 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4d7f5148-6664-4620-afba-44a652a30257 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: cd344db8-1e3a-498b-a4b4-54b0547fc063] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:36.017555 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-68fd82f4-0f5f-4547-84d5-db75da2ad12e tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] [instance: 945d807f-8341-49ca-ba3e-702bfd803dc3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:36.032693 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4d7f5148-6664-4620-afba-44a652a30257 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:36.033197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4d7f5148-6664-4620-afba-44a652a30257 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:36.036447 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68fd82f4-0f5f-4547-84d5-db75da2ad12e tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:36.036939 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68fd82f4-0f5f-4547-84d5-db75da2ad12e tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:36.037376 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68fd82f4-0f5f-4547-84d5-db75da2ad12e tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:36.037921 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4d7f5148-6664-4620-afba-44a652a30257 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:36.038669 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4d7f5148-6664-4620-afba-44a652a30257 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:36.039132 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4d7f5148-6664-4620-afba-44a652a30257 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:36.039558 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4d7f5148-6664-4620-afba-44a652a30257 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:36.042666 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68fd82f4-0f5f-4547-84d5-db75da2ad12e tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:36.043144 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68fd82f4-0f5f-4547-84d5-db75da2ad12e tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:36.043581 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68fd82f4-0f5f-4547-84d5-db75da2ad12e tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:36.342334 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4d7f5148-6664-4620-afba-44a652a30257 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:36.358311 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4d7f5148-6664-4620-afba-44a652a30257 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063" status: 200 len: 1209 microversion: 2.1 time: 0.353869 Oct 26 13:11:36.358916 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1095/2296] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:36 2022] GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063 => generated 1209 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:36.374229 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1195de48-371c-462a-ac97-85efe4a5c461 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:36.380542 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1195de48-371c-462a-ac97-85efe4a5c461 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] [instance: 5a42cb7d-b4c0-4771-a655-5e3f44adae05] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:36.405788 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1195de48-371c-462a-ac97-85efe4a5c461 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:36.406610 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1195de48-371c-462a-ac97-85efe4a5c461 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:36.407246 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1195de48-371c-462a-ac97-85efe4a5c461 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:36.408369 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1195de48-371c-462a-ac97-85efe4a5c461 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:36.409179 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1195de48-371c-462a-ac97-85efe4a5c461 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:36.409878 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1195de48-371c-462a-ac97-85efe4a5c461 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:37.272496 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-68fd82f4-0f5f-4547-84d5-db75da2ad12e tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329c4c283e1646f295472c59225753de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd2c80c6e164a708040af3165617a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:37.284746 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-68fd82f4-0f5f-4547-84d5-db75da2ad12e tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] 10.222.0.40 "GET /compute/v2.1/servers/945d807f-8341-49ca-ba3e-702bfd803dc3" status: 200 len: 1351 microversion: 2.1 time: 1.276530 Oct 26 13:11:37.285549 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1202/2297] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:36 2022] GET /compute/v2.1/servers/945d807f-8341-49ca-ba3e-702bfd803dc3 => generated 1351 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:37.295649 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-262db4aa-dff8-4f32-8587-9cdf994f3752 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:37.298677 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-262db4aa-dff8-4f32-8587-9cdf994f3752 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 6a7c952c-3ac4-4fad-b539-13a7ed9a2056] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:37.313618 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-262db4aa-dff8-4f32-8587-9cdf994f3752 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:37.315043 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-262db4aa-dff8-4f32-8587-9cdf994f3752 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:37.315742 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-262db4aa-dff8-4f32-8587-9cdf994f3752 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:37.317133 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-262db4aa-dff8-4f32-8587-9cdf994f3752 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:37.318058 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-262db4aa-dff8-4f32-8587-9cdf994f3752 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:37.320530 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-262db4aa-dff8-4f32-8587-9cdf994f3752 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:37.843611 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-262db4aa-dff8-4f32-8587-9cdf994f3752 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:37.856427 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-262db4aa-dff8-4f32-8587-9cdf994f3752 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056" status: 200 len: 1494 microversion: 2.1 time: 0.568431 Oct 26 13:11:37.858179 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1203/2298] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:37 2022] GET /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056 => generated 1494 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:37.868388 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6e076539-bdf8-4218-89fe-b647a93b5dc6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:37.875329 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6e076539-bdf8-4218-89fe-b647a93b5dc6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: e57fd56b-c9ce-4668-b9ff-703b4b310d1a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:37.888126 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e076539-bdf8-4218-89fe-b647a93b5dc6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:37.892587 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e076539-bdf8-4218-89fe-b647a93b5dc6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:37.893793 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e076539-bdf8-4218-89fe-b647a93b5dc6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:37.895256 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e076539-bdf8-4218-89fe-b647a93b5dc6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:37.897506 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e076539-bdf8-4218-89fe-b647a93b5dc6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:37.898900 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e076539-bdf8-4218-89fe-b647a93b5dc6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:38.243037 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6e076539-bdf8-4218-89fe-b647a93b5dc6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4c9b05864d4d448b1c722659a3bc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2336994846d345aa86b5fd940d1b004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:38.251627 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6e076539-bdf8-4218-89fe-b647a93b5dc6 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/e57fd56b-c9ce-4668-b9ff-703b4b310d1a" status: 200 len: 1514 microversion: 2.1 time: 0.388276 Oct 26 13:11:38.269448 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1204/2299] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:37 2022] GET /compute/v2.1/servers/e57fd56b-c9ce-4668-b9ff-703b4b310d1a => generated 1514 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:38.274957 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4f3ca71e-3c6b-4497-a7ed-5390dc86f370 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:38.276325 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4f3ca71e-3c6b-4497-a7ed-5390dc86f370 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] [instance: 6555760c-8bf4-467e-80cb-cdf6eee4b93c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:38.283010 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f3ca71e-3c6b-4497-a7ed-5390dc86f370 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:38.284351 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f3ca71e-3c6b-4497-a7ed-5390dc86f370 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:38.284995 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f3ca71e-3c6b-4497-a7ed-5390dc86f370 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:38.285955 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f3ca71e-3c6b-4497-a7ed-5390dc86f370 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:38.286617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f3ca71e-3c6b-4497-a7ed-5390dc86f370 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:38.287244 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f3ca71e-3c6b-4497-a7ed-5390dc86f370 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:38.348895 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1195de48-371c-462a-ac97-85efe4a5c461 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3574f016449d43e7baf97212ed731304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9729793794fdca01a8e15bed9f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:38.359311 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1195de48-371c-462a-ac97-85efe4a5c461 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] 10.222.0.40 "GET /compute/v2.1/servers/5a42cb7d-b4c0-4771-a655-5e3f44adae05" status: 200 len: 1322 microversion: 2.1 time: 1.999360 Oct 26 13:11:38.361193 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1096/2300] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:36 2022] GET /compute/v2.1/servers/5a42cb7d-b4c0-4771-a655-5e3f44adae05 => generated 1322 bytes in 2002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:38.368327 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-e9a601ca-7fdf-406a-955f-c89263e0f635 req-823f7af4-6eac-499b-aabd-0a6d38353213 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef63aed1-fab4-4b5b-b9c3-3607bb737e31", "tag": "d5de9727-eebc-4e98-8de0-53426dd8ddcf"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:11:38.385906 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-e9a601ca-7fdf-406a-955f-c89263e0f635 req-823f7af4-6eac-499b-aabd-0a6d38353213 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:38.387299 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-e9a601ca-7fdf-406a-955f-c89263e0f635 req-823f7af4-6eac-499b-aabd-0a6d38353213 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:38.388053 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-e9a601ca-7fdf-406a-955f-c89263e0f635 req-823f7af4-6eac-499b-aabd-0a6d38353213 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:38.407942 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-e9a601ca-7fdf-406a-955f-c89263e0f635 req-823f7af4-6eac-499b-aabd-0a6d38353213 service nova] Creating event network-changed:d5de9727-eebc-4e98-8de0-53426dd8ddcf for instance ef63aed1-fab4-4b5b-b9c3-3607bb737e31 on n-h1-862686-1 Oct 26 13:11:38.414776 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-e9a601ca-7fdf-406a-955f-c89263e0f635 req-823f7af4-6eac-499b-aabd-0a6d38353213 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050134 Oct 26 13:11:38.416740 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1097/2301] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:11:38.425529 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a6c4ec2e-1a11-484d-ad52-52f31ce17c8d tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:38.426962 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a6c4ec2e-1a11-484d-ad52-52f31ce17c8d tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: cd344db8-1e3a-498b-a4b4-54b0547fc063] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:38.433758 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a6c4ec2e-1a11-484d-ad52-52f31ce17c8d tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:38.435673 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a6c4ec2e-1a11-484d-ad52-52f31ce17c8d tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:38.436350 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a6c4ec2e-1a11-484d-ad52-52f31ce17c8d tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:38.440701 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a6c4ec2e-1a11-484d-ad52-52f31ce17c8d tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:38.442008 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a6c4ec2e-1a11-484d-ad52-52f31ce17c8d tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:38.443171 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a6c4ec2e-1a11-484d-ad52-52f31ce17c8d tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:38.791451 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a6c4ec2e-1a11-484d-ad52-52f31ce17c8d tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:38.805454 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a6c4ec2e-1a11-484d-ad52-52f31ce17c8d tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063" status: 200 len: 1271 microversion: 2.1 time: 0.385700 Oct 26 13:11:38.808786 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1098/2302] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:38 2022] GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063 => generated 1271 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:38.822977 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4f3ca71e-3c6b-4497-a7ed-5390dc86f370 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8fd7d2f8014b85beecc30c93bc084d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5902169366b646c7be94cb3521377225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:38.839491 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4f3ca71e-3c6b-4497-a7ed-5390dc86f370 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] 10.222.0.40 "GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c" status: 200 len: 1524 microversion: 2.1 time: 0.568319 Oct 26 13:11:38.849830 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-47e19680-ed47-4155-a59c-9e6b0f5e08d6 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:38.850408 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-47e19680-ed47-4155-a59c-9e6b0f5e08d6 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] [instance: 945d807f-8341-49ca-ba3e-702bfd803dc3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:38.868615 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-47e19680-ed47-4155-a59c-9e6b0f5e08d6 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:38.869475 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-47e19680-ed47-4155-a59c-9e6b0f5e08d6 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:38.870397 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1205/2303] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:38 2022] GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c => generated 1524 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:38.871942 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-47e19680-ed47-4155-a59c-9e6b0f5e08d6 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:38.874232 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-47e19680-ed47-4155-a59c-9e6b0f5e08d6 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:38.876192 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-47e19680-ed47-4155-a59c-9e6b0f5e08d6 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:38.876928 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-47e19680-ed47-4155-a59c-9e6b0f5e08d6 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:38.891790 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fd6d5410-2218-4db7-be27-2c8ba441681d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:38.892524 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fd6d5410-2218-4db7-be27-2c8ba441681d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 6a7c952c-3ac4-4fad-b539-13a7ed9a2056] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:38.909857 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd6d5410-2218-4db7-be27-2c8ba441681d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:38.910501 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd6d5410-2218-4db7-be27-2c8ba441681d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:38.911028 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd6d5410-2218-4db7-be27-2c8ba441681d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:38.912575 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd6d5410-2218-4db7-be27-2c8ba441681d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:38.915208 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd6d5410-2218-4db7-be27-2c8ba441681d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:38.915762 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd6d5410-2218-4db7-be27-2c8ba441681d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:39.574450 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fd6d5410-2218-4db7-be27-2c8ba441681d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:39.584270 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fd6d5410-2218-4db7-be27-2c8ba441681d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056" status: 200 len: 1494 microversion: 2.1 time: 0.701448 Oct 26 13:11:39.595523 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1206/2304] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:38 2022] GET /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056 => generated 1494 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:39.606597 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ee1202b7-f98b-4973-a0cd-2554e43dd854 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:39.608643 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ee1202b7-f98b-4973-a0cd-2554e43dd854 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: e57fd56b-c9ce-4668-b9ff-703b4b310d1a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:39.632154 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee1202b7-f98b-4973-a0cd-2554e43dd854 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:39.632650 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee1202b7-f98b-4973-a0cd-2554e43dd854 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:39.633288 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee1202b7-f98b-4973-a0cd-2554e43dd854 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:39.637495 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee1202b7-f98b-4973-a0cd-2554e43dd854 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:39.638553 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee1202b7-f98b-4973-a0cd-2554e43dd854 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:39.639003 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee1202b7-f98b-4973-a0cd-2554e43dd854 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:40.023394 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ee1202b7-f98b-4973-a0cd-2554e43dd854 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4c9b05864d4d448b1c722659a3bc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2336994846d345aa86b5fd940d1b004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:40.036026 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ee1202b7-f98b-4973-a0cd-2554e43dd854 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/e57fd56b-c9ce-4668-b9ff-703b4b310d1a" status: 200 len: 1472 microversion: 2.1 time: 0.433698 Oct 26 13:11:40.037462 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1207/2305] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:39 2022] GET /compute/v2.1/servers/e57fd56b-c9ce-4668-b9ff-703b4b310d1a => generated 1472 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:40.043152 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-91202273-f1ba-4b7b-af66-0f3f413445eb tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:40.043826 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-91202273-f1ba-4b7b-af66-0f3f413445eb tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] [instance: 5a42cb7d-b4c0-4771-a655-5e3f44adae05] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:40.057290 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91202273-f1ba-4b7b-af66-0f3f413445eb tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:40.059193 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91202273-f1ba-4b7b-af66-0f3f413445eb tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:40.059706 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91202273-f1ba-4b7b-af66-0f3f413445eb tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:40.060438 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91202273-f1ba-4b7b-af66-0f3f413445eb tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:40.061243 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91202273-f1ba-4b7b-af66-0f3f413445eb tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:40.061886 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91202273-f1ba-4b7b-af66-0f3f413445eb tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:40.362445 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-47e19680-ed47-4155-a59c-9e6b0f5e08d6 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329c4c283e1646f295472c59225753de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd2c80c6e164a708040af3165617a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:40.376012 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-47e19680-ed47-4155-a59c-9e6b0f5e08d6 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] 10.222.0.40 "GET /compute/v2.1/servers/945d807f-8341-49ca-ba3e-702bfd803dc3" status: 200 len: 1351 microversion: 2.1 time: 1.564779 Oct 26 13:11:40.377199 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1099/2306] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:38 2022] GET /compute/v2.1/servers/945d807f-8341-49ca-ba3e-702bfd803dc3 => generated 1351 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:40.382883 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-e4c14cc1-b3c5-493b-a309-c9c461687533 req-e06b8ccc-5067-44b8-b0f7-88e8420329a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "945d807f-8341-49ca-ba3e-702bfd803dc3", "name": "network-vif-plugged", "status": "completed", "tag": "d3c22259-adb6-472e-9aed-08a5fa660e6a"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:11:40.398789 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-91202273-f1ba-4b7b-af66-0f3f413445eb tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3574f016449d43e7baf97212ed731304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9729793794fdca01a8e15bed9f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:40.404561 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-e4c14cc1-b3c5-493b-a309-c9c461687533 req-e06b8ccc-5067-44b8-b0f7-88e8420329a7 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:40.413656 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-91202273-f1ba-4b7b-af66-0f3f413445eb tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] 10.222.0.40 "GET /compute/v2.1/servers/5a42cb7d-b4c0-4771-a655-5e3f44adae05" status: 200 len: 1322 microversion: 2.1 time: 0.374932 Oct 26 13:11:40.417875 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1208/2307] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:40 2022] GET /compute/v2.1/servers/5a42cb7d-b4c0-4771-a655-5e3f44adae05 => generated 1322 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:40.421088 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-e4c14cc1-b3c5-493b-a309-c9c461687533 req-e06b8ccc-5067-44b8-b0f7-88e8420329a7 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:40.421578 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-e4c14cc1-b3c5-493b-a309-c9c461687533 req-e06b8ccc-5067-44b8-b0f7-88e8420329a7 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:40.428061 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5c543b53-388a-46d8-9aea-467a4156b6f1 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:40.431060 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5c543b53-388a-46d8-9aea-467a4156b6f1 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: cd344db8-1e3a-498b-a4b4-54b0547fc063] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:40.445425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c543b53-388a-46d8-9aea-467a4156b6f1 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:40.448585 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-e4c14cc1-b3c5-493b-a309-c9c461687533 req-e06b8ccc-5067-44b8-b0f7-88e8420329a7 service nova] Creating event network-vif-plugged:d3c22259-adb6-472e-9aed-08a5fa660e6a for instance 945d807f-8341-49ca-ba3e-702bfd803dc3 on n-h2-862686-1 Oct 26 13:11:40.451458 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c543b53-388a-46d8-9aea-467a4156b6f1 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:40.454587 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-e4c14cc1-b3c5-493b-a309-c9c461687533 req-e06b8ccc-5067-44b8-b0f7-88e8420329a7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075162 Oct 26 13:11:40.456068 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1100/2308] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:11:40.462649 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c543b53-388a-46d8-9aea-467a4156b6f1 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:40.463236 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a4d2c6b5-d5f2-4c1f-bda8-d7f352462faf tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:40.463894 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c543b53-388a-46d8-9aea-467a4156b6f1 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:40.464531 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c543b53-388a-46d8-9aea-467a4156b6f1 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:40.465177 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a4d2c6b5-d5f2-4c1f-bda8-d7f352462faf tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] [instance: 6555760c-8bf4-467e-80cb-cdf6eee4b93c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:40.465839 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c543b53-388a-46d8-9aea-467a4156b6f1 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:40.474150 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4d2c6b5-d5f2-4c1f-bda8-d7f352462faf tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:40.474895 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4d2c6b5-d5f2-4c1f-bda8-d7f352462faf tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:40.475520 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4d2c6b5-d5f2-4c1f-bda8-d7f352462faf tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:40.476760 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4d2c6b5-d5f2-4c1f-bda8-d7f352462faf tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:40.477570 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4d2c6b5-d5f2-4c1f-bda8-d7f352462faf tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:40.478447 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4d2c6b5-d5f2-4c1f-bda8-d7f352462faf tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:40.587426 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5c543b53-388a-46d8-9aea-467a4156b6f1 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:40.590792 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:11:40.601503 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5c543b53-388a-46d8-9aea-467a4156b6f1 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063" status: 200 len: 1271 microversion: 2.1 time: 0.182289 Oct 26 13:11:40.607758 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1209/2309] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:40 2022] GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063 => generated 1271 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:40.621804 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-1994fa41-026c-441c-94c1-c7e421e45638 req-b8f5d18c-7315-413a-b7ff-75dbdc5799b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e57fd56b-c9ce-4668-b9ff-703b4b310d1a", "name": "network-vif-deleted", "tag": "c048e1bc-f12e-4daf-b7ad-6dc3affd08f5"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:11:40.636050 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-1994fa41-026c-441c-94c1-c7e421e45638 req-b8f5d18c-7315-413a-b7ff-75dbdc5799b8 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:40.636681 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-1994fa41-026c-441c-94c1-c7e421e45638 req-b8f5d18c-7315-413a-b7ff-75dbdc5799b8 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:40.637558 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-1994fa41-026c-441c-94c1-c7e421e45638 req-b8f5d18c-7315-413a-b7ff-75dbdc5799b8 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:40.655018 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-1994fa41-026c-441c-94c1-c7e421e45638 req-b8f5d18c-7315-413a-b7ff-75dbdc5799b8 service nova] Creating event network-vif-deleted:c048e1bc-f12e-4daf-b7ad-6dc3affd08f5 for instance e57fd56b-c9ce-4668-b9ff-703b4b310d1a on n-h1-862686-1 Oct 26 13:11:40.661809 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-1994fa41-026c-441c-94c1-c7e421e45638 req-b8f5d18c-7315-413a-b7ff-75dbdc5799b8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051643 Oct 26 13:11:40.663063 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1210/2310] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:11:40.669916 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b3220911-c610-4980-aac3-6777083648b3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:40.671845 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b3220911-c610-4980-aac3-6777083648b3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 6a7c952c-3ac4-4fad-b539-13a7ed9a2056] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:40.681742 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3220911-c610-4980-aac3-6777083648b3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:40.682649 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3220911-c610-4980-aac3-6777083648b3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:40.683713 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3220911-c610-4980-aac3-6777083648b3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:40.684638 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3220911-c610-4980-aac3-6777083648b3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:40.685351 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3220911-c610-4980-aac3-6777083648b3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:40.686169 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3220911-c610-4980-aac3-6777083648b3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:40.963714 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b3220911-c610-4980-aac3-6777083648b3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:40.984605 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b3220911-c610-4980-aac3-6777083648b3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056" status: 200 len: 1494 microversion: 2.1 time: 0.319900 Oct 26 13:11:40.988558 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1211/2311] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:40 2022] GET /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056 => generated 1494 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:41.063141 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-05cbe1b8-e2bf-4ad8-bfc5-33b284152964 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:41.063240 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a4d2c6b5-d5f2-4c1f-bda8-d7f352462faf tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8fd7d2f8014b85beecc30c93bc084d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5902169366b646c7be94cb3521377225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:41.064200 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-05cbe1b8-e2bf-4ad8-bfc5-33b284152964 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: e57fd56b-c9ce-4668-b9ff-703b4b310d1a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:41.077753 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05cbe1b8-e2bf-4ad8-bfc5-33b284152964 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:41.079229 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a4d2c6b5-d5f2-4c1f-bda8-d7f352462faf tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] 10.222.0.40 "GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c" status: 200 len: 1524 microversion: 2.1 time: 0.621609 Oct 26 13:11:41.079750 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05cbe1b8-e2bf-4ad8-bfc5-33b284152964 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:41.080439 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05cbe1b8-e2bf-4ad8-bfc5-33b284152964 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:41.083174 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05cbe1b8-e2bf-4ad8-bfc5-33b284152964 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:41.083697 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05cbe1b8-e2bf-4ad8-bfc5-33b284152964 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:41.084146 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05cbe1b8-e2bf-4ad8-bfc5-33b284152964 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:41.095043 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1101/2312] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:40 2022] GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c => generated 1524 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:41.138996 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-05cbe1b8-e2bf-4ad8-bfc5-33b284152964 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] HTTP exception thrown: Instance e57fd56b-c9ce-4668-b9ff-703b4b310d1a could not be found. Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-05cbe1b8-e2bf-4ad8-bfc5-33b284152964 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Request method failure captured: Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/e57fd56b-c9ce-4668-b9ff-703b4b310d1a HTTP/1.1 Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTFgIL_cRAPUdtHwI4x6yCEBx8ehHBkBaqKL9vP6UNAvXX6AbCbat_GtQS1eRfHYAPYvgrD2A19YwM4J3VT3mJzxKo4XJfkrSZxV-o9iFA8tNWYlWBNex4uCqA6LXksF8lOtQwt4YHlobIbNQUigiEpnxM8guytrO2gsBdqVUrkQwoQ Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 2336994846d345aa86b5fd940d1b004f Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-VolumesAdminNegativeTest-1487053027 Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2336994846d345aa86b5fd940d1b004f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2336994846d345aa86b5fd940d1b004f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2336994846d345aa86b5fd940d1b004f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2336994846d345aa86b5fd940d1b004f"}]}] Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-VolumesAdminNegativeTest-1487053027 Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 2336994846d345aa86b5fd940d1b004f Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1487053027 Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-VolumesAdminNegativeTest-1487053027-project Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: cb4c9b05864d4d448b1c722659a3bc21 Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-VolumesAdminNegativeTest-1487053027-project Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance e57fd56b-c9ce-4668-b9ff-703b4b310d1a could not be found. Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'e57fd56b-c9ce-4668-b9ff-703b4b310d1a'} Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e57fd56b-c9ce-4668-b9ff-703b4b310d1a could not be found. Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e57fd56b-c9ce-4668-b9ff-703b4b310d1a could not be found. Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:11:41.142110 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:11:41.146715 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:11:41.146715 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:11:41.146715 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:11:41.146715 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:11:41.146715 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:11:41.146715 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e57fd56b-c9ce-4668-b9ff-703b4b310d1a could not be found. Oct 26 13:11:41.146715 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:11:41.146715 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-05cbe1b8-e2bf-4ad8-bfc5-33b284152964 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Returning 404 to user: Instance e57fd56b-c9ce-4668-b9ff-703b4b310d1a could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:11:41.146715 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-05cbe1b8-e2bf-4ad8-bfc5-33b284152964 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/e57fd56b-c9ce-4668-b9ff-703b4b310d1a" status: 404 len: 111 microversion: 2.1 time: 0.088222 Oct 26 13:11:41.153256 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1212/2313] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:41 2022] GET /compute/v2.1/servers/e57fd56b-c9ce-4668-b9ff-703b4b310d1a => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 13:11:41.399449 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-580fd444-b4d4-4b74-98de-659b3cd28072 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:41.400063 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-580fd444-b4d4-4b74-98de-659b3cd28072 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] [instance: 945d807f-8341-49ca-ba3e-702bfd803dc3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:41.415249 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-580fd444-b4d4-4b74-98de-659b3cd28072 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:41.415755 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-580fd444-b4d4-4b74-98de-659b3cd28072 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:41.416202 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-580fd444-b4d4-4b74-98de-659b3cd28072 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:41.416921 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-580fd444-b4d4-4b74-98de-659b3cd28072 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:41.417387 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-580fd444-b4d4-4b74-98de-659b3cd28072 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:41.417835 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-580fd444-b4d4-4b74-98de-659b3cd28072 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:41.442702 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9be3f8ef-d903-4997-82d1-80f22edf4f43 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:41.443344 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9be3f8ef-d903-4997-82d1-80f22edf4f43 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] [instance: 5a42cb7d-b4c0-4771-a655-5e3f44adae05] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:41.454849 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9be3f8ef-d903-4997-82d1-80f22edf4f43 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:41.466339 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9be3f8ef-d903-4997-82d1-80f22edf4f43 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:41.467223 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9be3f8ef-d903-4997-82d1-80f22edf4f43 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:41.467869 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9be3f8ef-d903-4997-82d1-80f22edf4f43 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:41.470472 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9be3f8ef-d903-4997-82d1-80f22edf4f43 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:41.473065 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9be3f8ef-d903-4997-82d1-80f22edf4f43 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:42.016374 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9be3f8ef-d903-4997-82d1-80f22edf4f43 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3574f016449d43e7baf97212ed731304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9729793794fdca01a8e15bed9f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:42.042476 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9be3f8ef-d903-4997-82d1-80f22edf4f43 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] 10.222.0.40 "GET /compute/v2.1/servers/5a42cb7d-b4c0-4771-a655-5e3f44adae05" status: 200 len: 1322 microversion: 2.1 time: 0.604234 Oct 26 13:11:42.044564 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1213/2314] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:41 2022] GET /compute/v2.1/servers/5a42cb7d-b4c0-4771-a655-5e3f44adae05 => generated 1322 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:42.062538 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6991af72-5acb-4f33-9773-c0f97d0e96fb tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:42.063505 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6991af72-5acb-4f33-9773-c0f97d0e96fb tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: cd344db8-1e3a-498b-a4b4-54b0547fc063] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:42.087577 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6991af72-5acb-4f33-9773-c0f97d0e96fb tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:42.089535 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6991af72-5acb-4f33-9773-c0f97d0e96fb tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:42.092251 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6991af72-5acb-4f33-9773-c0f97d0e96fb tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:42.093032 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6991af72-5acb-4f33-9773-c0f97d0e96fb tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:42.102228 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6991af72-5acb-4f33-9773-c0f97d0e96fb tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:42.106066 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6991af72-5acb-4f33-9773-c0f97d0e96fb tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:42.209406 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-580fd444-b4d4-4b74-98de-659b3cd28072 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329c4c283e1646f295472c59225753de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd2c80c6e164a708040af3165617a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:42.246663 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-580fd444-b4d4-4b74-98de-659b3cd28072 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] 10.222.0.40 "GET /compute/v2.1/servers/945d807f-8341-49ca-ba3e-702bfd803dc3" status: 200 len: 1351 microversion: 2.1 time: 0.851312 Oct 26 13:11:42.250200 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1102/2315] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:41 2022] GET /compute/v2.1/servers/945d807f-8341-49ca-ba3e-702bfd803dc3 => generated 1351 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:42.281038 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5ef05d70-7c6c-42b3-93cd-bba10fdc8825 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:42.282571 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5ef05d70-7c6c-42b3-93cd-bba10fdc8825 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 6a7c952c-3ac4-4fad-b539-13a7ed9a2056] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:42.293994 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ef05d70-7c6c-42b3-93cd-bba10fdc8825 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:42.294708 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ef05d70-7c6c-42b3-93cd-bba10fdc8825 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:42.295323 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ef05d70-7c6c-42b3-93cd-bba10fdc8825 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:42.297584 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ef05d70-7c6c-42b3-93cd-bba10fdc8825 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:42.298385 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ef05d70-7c6c-42b3-93cd-bba10fdc8825 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:42.308968 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ef05d70-7c6c-42b3-93cd-bba10fdc8825 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:42.351417 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ef05d70-7c6c-42b3-93cd-bba10fdc8825 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:42.351831 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ef05d70-7c6c-42b3-93cd-bba10fdc8825 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:42.352267 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ef05d70-7c6c-42b3-93cd-bba10fdc8825 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:42.352919 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-5ef05d70-7c6c-42b3-93cd-bba10fdc8825 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lazy-loading 'fault' on Instance uuid 6a7c952c-3ac4-4fad-b539-13a7ed9a2056 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:11:42.356820 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:11:42.528635 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5ef05d70-7c6c-42b3-93cd-bba10fdc8825 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:42.546005 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5ef05d70-7c6c-42b3-93cd-bba10fdc8825 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056" status: 200 len: 1298 microversion: 2.1 time: 0.279228 Oct 26 13:11:42.547655 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1103/2316] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:42 2022] GET /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056 => generated 1298 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:42.562559 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b017be0b-0346-46d0-8c52-3082b0a8dc90 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:42.563358 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b017be0b-0346-46d0-8c52-3082b0a8dc90 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] [instance: 6555760c-8bf4-467e-80cb-cdf6eee4b93c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:42.571459 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b017be0b-0346-46d0-8c52-3082b0a8dc90 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:42.572221 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b017be0b-0346-46d0-8c52-3082b0a8dc90 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:42.572873 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b017be0b-0346-46d0-8c52-3082b0a8dc90 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:42.574277 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b017be0b-0346-46d0-8c52-3082b0a8dc90 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:42.574926 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b017be0b-0346-46d0-8c52-3082b0a8dc90 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:42.576079 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b017be0b-0346-46d0-8c52-3082b0a8dc90 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:42.826019 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6991af72-5acb-4f33-9773-c0f97d0e96fb tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:42.839066 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6991af72-5acb-4f33-9773-c0f97d0e96fb tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063" status: 200 len: 1313 microversion: 2.1 time: 0.793158 Oct 26 13:11:42.844539 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1214/2317] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:42 2022] GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063 => generated 1313 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:42.862010 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-a1b4eaea-15f7-498d-a605-e17c0bf53ae2 req-f5f51f45-001b-4a5e-88dd-7f21fa2e315d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a7c952c-3ac4-4fad-b539-13a7ed9a2056", "name": "network-vif-unplugged", "status": "completed", "tag": "67a20481-a759-4368-b7fd-a870213309ed"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:11:42.879623 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-a1b4eaea-15f7-498d-a605-e17c0bf53ae2 req-f5f51f45-001b-4a5e-88dd-7f21fa2e315d service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:42.880472 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-a1b4eaea-15f7-498d-a605-e17c0bf53ae2 req-f5f51f45-001b-4a5e-88dd-7f21fa2e315d service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:42.881118 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-a1b4eaea-15f7-498d-a605-e17c0bf53ae2 req-f5f51f45-001b-4a5e-88dd-7f21fa2e315d service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:42.915373 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-a1b4eaea-15f7-498d-a605-e17c0bf53ae2 req-f5f51f45-001b-4a5e-88dd-7f21fa2e315d service nova] Creating event network-vif-unplugged:67a20481-a759-4368-b7fd-a870213309ed for instance 6a7c952c-3ac4-4fad-b539-13a7ed9a2056 on n-h2-862686-1 Oct 26 13:11:42.933620 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-a1b4eaea-15f7-498d-a605-e17c0bf53ae2 req-f5f51f45-001b-4a5e-88dd-7f21fa2e315d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087140 Oct 26 13:11:42.937978 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1215/2318] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:11:42.963671 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-46058ed4-c36e-4420-9bdc-8d8ae03f4b8f req-0efd2d96-81b3-436b-892a-0f4baf7345c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a7c952c-3ac4-4fad-b539-13a7ed9a2056", "name": "network-vif-deleted", "tag": "67a20481-a759-4368-b7fd-a870213309ed"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:11:42.984876 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-46058ed4-c36e-4420-9bdc-8d8ae03f4b8f req-0efd2d96-81b3-436b-892a-0f4baf7345c2 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:42.986481 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-46058ed4-c36e-4420-9bdc-8d8ae03f4b8f req-0efd2d96-81b3-436b-892a-0f4baf7345c2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:42.987645 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-46058ed4-c36e-4420-9bdc-8d8ae03f4b8f req-0efd2d96-81b3-436b-892a-0f4baf7345c2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:43.020361 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-46058ed4-c36e-4420-9bdc-8d8ae03f4b8f req-0efd2d96-81b3-436b-892a-0f4baf7345c2 service nova] Creating event network-vif-deleted:67a20481-a759-4368-b7fd-a870213309ed for instance 6a7c952c-3ac4-4fad-b539-13a7ed9a2056 on n-h2-862686-1 Oct 26 13:11:43.037291 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-46058ed4-c36e-4420-9bdc-8d8ae03f4b8f req-0efd2d96-81b3-436b-892a-0f4baf7345c2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088486 Oct 26 13:11:43.038534 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1216/2319] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:11:43.070378 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fadfe2b1-0b98-41dc-8e4d-7a810a26f9f0 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:43.070378 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fadfe2b1-0b98-41dc-8e4d-7a810a26f9f0 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] [instance: 5a42cb7d-b4c0-4771-a655-5e3f44adae05] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:43.089421 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fadfe2b1-0b98-41dc-8e4d-7a810a26f9f0 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:43.101265 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fadfe2b1-0b98-41dc-8e4d-7a810a26f9f0 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:43.102022 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fadfe2b1-0b98-41dc-8e4d-7a810a26f9f0 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:43.103412 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fadfe2b1-0b98-41dc-8e4d-7a810a26f9f0 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:43.105328 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fadfe2b1-0b98-41dc-8e4d-7a810a26f9f0 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:43.105981 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fadfe2b1-0b98-41dc-8e4d-7a810a26f9f0 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:43.499268 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b017be0b-0346-46d0-8c52-3082b0a8dc90 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8fd7d2f8014b85beecc30c93bc084d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5902169366b646c7be94cb3521377225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:43.521403 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b017be0b-0346-46d0-8c52-3082b0a8dc90 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] 10.222.0.40 "GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c" status: 200 len: 1524 microversion: 2.1 time: 0.971087 Oct 26 13:11:43.523231 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1104/2320] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:42 2022] GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c => generated 1524 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:43.542080 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-00eabc4c-d5e8-4590-8457-4d3d0a725410 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:43.543524 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-00eabc4c-d5e8-4590-8457-4d3d0a725410 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] [instance: 945d807f-8341-49ca-ba3e-702bfd803dc3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:43.556613 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-00eabc4c-d5e8-4590-8457-4d3d0a725410 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:43.557500 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-00eabc4c-d5e8-4590-8457-4d3d0a725410 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:43.558167 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-00eabc4c-d5e8-4590-8457-4d3d0a725410 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:43.559098 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-00eabc4c-d5e8-4590-8457-4d3d0a725410 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:43.559809 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-00eabc4c-d5e8-4590-8457-4d3d0a725410 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:43.560420 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-00eabc4c-d5e8-4590-8457-4d3d0a725410 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:43.929298 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fadfe2b1-0b98-41dc-8e4d-7a810a26f9f0 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3574f016449d43e7baf97212ed731304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9729793794fdca01a8e15bed9f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:43.942190 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fadfe2b1-0b98-41dc-8e4d-7a810a26f9f0 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] 10.222.0.40 "GET /compute/v2.1/servers/5a42cb7d-b4c0-4771-a655-5e3f44adae05" status: 200 len: 1322 microversion: 2.1 time: 0.873834 Oct 26 13:11:43.942840 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1217/2321] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:43 2022] GET /compute/v2.1/servers/5a42cb7d-b4c0-4771-a655-5e3f44adae05 => generated 1322 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:11:43.962066 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f15e358a-ec5a-4bba-be69-3d74d900e172 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:43.962860 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f15e358a-ec5a-4bba-be69-3d74d900e172 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 6a7c952c-3ac4-4fad-b539-13a7ed9a2056] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:43.969997 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f15e358a-ec5a-4bba-be69-3d74d900e172 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:43.971284 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f15e358a-ec5a-4bba-be69-3d74d900e172 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:43.972168 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f15e358a-ec5a-4bba-be69-3d74d900e172 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:43.973045 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f15e358a-ec5a-4bba-be69-3d74d900e172 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:43.973687 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f15e358a-ec5a-4bba-be69-3d74d900e172 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:43.974295 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f15e358a-ec5a-4bba-be69-3d74d900e172 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:44.005346 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-f15e358a-ec5a-4bba-be69-3d74d900e172 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] HTTP exception thrown: Instance 6a7c952c-3ac4-4fad-b539-13a7ed9a2056 could not be found. Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f15e358a-ec5a-4bba-be69-3d74d900e172 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Request method failure captured: Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056 HTTP/1.1 Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTC9wyPfJuSJHapeMPJUKkbgKm2FQwvtt7BQDbWPm4GwQ8yWjgTo6lRUEA-e4jHkLSJjfv2QDJX2GMz9jukHMvyMDw_G0MjOwEgCjRSM3Ua7yPar79M8qXcqg6fT_UU9R41ThcILNxZyJfJrKJFP6QbT0FaEuXfNwh8wp6VXk-hvlMc Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: cc4a21e57f1c4fd1ab3c60f6416f8b11 Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ImagesTestJSON-2142360890 Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}] Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ImagesTestJSON-2142360890 Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: cc4a21e57f1c4fd1ab3c60f6416f8b11 Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ImagesTestJSON-2142360890 Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ImagesTestJSON-2142360890-project Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: e3707c34798c48d584cff9dd46d9d7c0 Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ImagesTestJSON-2142360890-project Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 6a7c952c-3ac4-4fad-b539-13a7ed9a2056 could not be found. Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '6a7c952c-3ac4-4fad-b539-13a7ed9a2056'} Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a7c952c-3ac4-4fad-b539-13a7ed9a2056 could not be found. Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a7c952c-3ac4-4fad-b539-13a7ed9a2056 could not be found. Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:11:44.013773 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:11:44.020246 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:11:44.020246 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:11:44.020246 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:11:44.020246 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:11:44.020246 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a7c952c-3ac4-4fad-b539-13a7ed9a2056 could not be found. Oct 26 13:11:44.020246 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:11:44.022632 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f15e358a-ec5a-4bba-be69-3d74d900e172 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Returning 404 to user: Instance 6a7c952c-3ac4-4fad-b539-13a7ed9a2056 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:11:44.023693 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f15e358a-ec5a-4bba-be69-3d74d900e172 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056" status: 404 len: 111 microversion: 2.1 time: 0.071658 Oct 26 13:11:44.025945 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1218/2322] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:43 2022] GET /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:11:44.036136 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c161e9a2-e4d5-4e81-8f1e-5fc5397845bb tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:44.038980 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c161e9a2-e4d5-4e81-8f1e-5fc5397845bb tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: cd344db8-1e3a-498b-a4b4-54b0547fc063] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:44.058939 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c161e9a2-e4d5-4e81-8f1e-5fc5397845bb tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:44.060444 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c161e9a2-e4d5-4e81-8f1e-5fc5397845bb tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:44.061194 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c161e9a2-e4d5-4e81-8f1e-5fc5397845bb tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:44.062832 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c161e9a2-e4d5-4e81-8f1e-5fc5397845bb tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:44.063514 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c161e9a2-e4d5-4e81-8f1e-5fc5397845bb tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:44.065322 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c161e9a2-e4d5-4e81-8f1e-5fc5397845bb tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:44.398635 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c161e9a2-e4d5-4e81-8f1e-5fc5397845bb tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:44.414009 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c161e9a2-e4d5-4e81-8f1e-5fc5397845bb tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063" status: 200 len: 1334 microversion: 2.1 time: 0.383355 Oct 26 13:11:44.430436 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1219/2323] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:44 2022] GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063 => generated 1334 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:44.449425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8c641e67-21b2-40a7-85ca-459e6093358a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f6736912af0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:44.506823 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:11:44.532034 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:11:44.570225 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-00eabc4c-d5e8-4590-8457-4d3d0a725410 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329c4c283e1646f295472c59225753de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd2c80c6e164a708040af3165617a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:44.584583 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-00eabc4c-d5e8-4590-8457-4d3d0a725410 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] 10.222.0.40 "GET /compute/v2.1/servers/945d807f-8341-49ca-ba3e-702bfd803dc3" status: 200 len: 1351 microversion: 2.1 time: 1.059712 Oct 26 13:11:44.585174 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1105/2324] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:43 2022] GET /compute/v2.1/servers/945d807f-8341-49ca-ba3e-702bfd803dc3 => generated 1351 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:44.592851 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8b1182b7-b67f-4798-a73b-e1757ea196ba tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:44.594287 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8b1182b7-b67f-4798-a73b-e1757ea196ba tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] [instance: 6555760c-8bf4-467e-80cb-cdf6eee4b93c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:44.607084 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:11:44.612661 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8b1182b7-b67f-4798-a73b-e1757ea196ba tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:44.613395 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8b1182b7-b67f-4798-a73b-e1757ea196ba tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:44.615188 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8b1182b7-b67f-4798-a73b-e1757ea196ba tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:44.616154 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8b1182b7-b67f-4798-a73b-e1757ea196ba tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:44.621351 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8b1182b7-b67f-4798-a73b-e1757ea196ba tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:44.622015 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8b1182b7-b67f-4798-a73b-e1757ea196ba tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:45.103167 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8b1182b7-b67f-4798-a73b-e1757ea196ba tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8fd7d2f8014b85beecc30c93bc084d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5902169366b646c7be94cb3521377225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:45.119705 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8b1182b7-b67f-4798-a73b-e1757ea196ba tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] 10.222.0.40 "GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c" status: 200 len: 1524 microversion: 2.1 time: 0.532285 Oct 26 13:11:45.120299 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1106/2325] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:44 2022] GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c => generated 1524 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:45.138818 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fce017f3-ca63-45fa-9fe0-1c532ee21e6b tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:45.139712 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fce017f3-ca63-45fa-9fe0-1c532ee21e6b tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] [instance: 5a42cb7d-b4c0-4771-a655-5e3f44adae05] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:45.178508 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fce017f3-ca63-45fa-9fe0-1c532ee21e6b tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:45.179007 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fce017f3-ca63-45fa-9fe0-1c532ee21e6b tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:45.179445 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fce017f3-ca63-45fa-9fe0-1c532ee21e6b tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:45.180175 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fce017f3-ca63-45fa-9fe0-1c532ee21e6b tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:45.185328 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fce017f3-ca63-45fa-9fe0-1c532ee21e6b tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:45.187409 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fce017f3-ca63-45fa-9fe0-1c532ee21e6b tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:45.772119 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fce017f3-ca63-45fa-9fe0-1c532ee21e6b tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3574f016449d43e7baf97212ed731304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9729793794fdca01a8e15bed9f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:45.797511 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8c641e67-21b2-40a7-85ca-459e6093358a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "DELETE /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04" status: 204 len: 0 microversion: 2.1 time: 1.358847 Oct 26 13:11:45.798334 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1220/2326] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:44 2022] DELETE /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04 => generated 0 bytes in 1367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:11:45.800131 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fce017f3-ca63-45fa-9fe0-1c532ee21e6b tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] 10.222.0.40 "GET /compute/v2.1/servers/5a42cb7d-b4c0-4771-a655-5e3f44adae05" status: 200 len: 1322 microversion: 2.1 time: 0.675225 Oct 26 13:11:45.804850 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1107/2327] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:45 2022] GET /compute/v2.1/servers/5a42cb7d-b4c0-4771-a655-5e3f44adae05 => generated 1322 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:45.818752 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-dbca3d2a-08f2-4bb4-830d-1ca40579cfcd req-1e8ce99b-6cb6-4b1a-8ed5-bc862ce1ec30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8768fa8b-3989-4c11-a1cf-7841cf7e5c8d", "name": "network-vif-plugged", "status": "completed", "tag": "c9389f47-0bb7-4ab3-99a5-538c3c3b76c9"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:11:45.823904 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2e2bdf30-1267-4e71-a474-88982e057355 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:45.824567 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2e2bdf30-1267-4e71-a474-88982e057355 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: cd344db8-1e3a-498b-a4b4-54b0547fc063] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:45.834432 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-dbca3d2a-08f2-4bb4-830d-1ca40579cfcd req-1e8ce99b-6cb6-4b1a-8ed5-bc862ce1ec30 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:45.835264 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-dbca3d2a-08f2-4bb4-830d-1ca40579cfcd req-1e8ce99b-6cb6-4b1a-8ed5-bc862ce1ec30 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:45.835902 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-dbca3d2a-08f2-4bb4-830d-1ca40579cfcd req-1e8ce99b-6cb6-4b1a-8ed5-bc862ce1ec30 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:45.840965 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e2bdf30-1267-4e71-a474-88982e057355 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:45.841614 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e2bdf30-1267-4e71-a474-88982e057355 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:45.842452 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e2bdf30-1267-4e71-a474-88982e057355 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:45.843445 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e2bdf30-1267-4e71-a474-88982e057355 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:45.843903 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e2bdf30-1267-4e71-a474-88982e057355 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:45.844327 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e2bdf30-1267-4e71-a474-88982e057355 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:45.849689 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-dbca3d2a-08f2-4bb4-830d-1ca40579cfcd req-1e8ce99b-6cb6-4b1a-8ed5-bc862ce1ec30 service nova] Creating event network-vif-plugged:c9389f47-0bb7-4ab3-99a5-538c3c3b76c9 for instance 8768fa8b-3989-4c11-a1cf-7841cf7e5c8d on n-h2-862686-1 Oct 26 13:11:45.855963 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-dbca3d2a-08f2-4bb4-830d-1ca40579cfcd req-1e8ce99b-6cb6-4b1a-8ed5-bc862ce1ec30 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055644 Oct 26 13:11:45.857174 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1221/2328] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:11:45.864775 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-924e3123-9812-44b2-912b-4bc2f79a1d8b tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:45.865878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-924e3123-9812-44b2-912b-4bc2f79a1d8b tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] [instance: 945d807f-8341-49ca-ba3e-702bfd803dc3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:45.874037 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-924e3123-9812-44b2-912b-4bc2f79a1d8b tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:45.874870 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-924e3123-9812-44b2-912b-4bc2f79a1d8b tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:45.875544 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-924e3123-9812-44b2-912b-4bc2f79a1d8b tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:45.876481 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-924e3123-9812-44b2-912b-4bc2f79a1d8b tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:45.877286 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-924e3123-9812-44b2-912b-4bc2f79a1d8b tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:45.891959 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-924e3123-9812-44b2-912b-4bc2f79a1d8b tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:46.566601 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2e2bdf30-1267-4e71-a474-88982e057355 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:46.572574 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-924e3123-9812-44b2-912b-4bc2f79a1d8b tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329c4c283e1646f295472c59225753de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd2c80c6e164a708040af3165617a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:46.578891 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2e2bdf30-1267-4e71-a474-88982e057355 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063" status: 200 len: 1334 microversion: 2.1 time: 0.772505 Oct 26 13:11:46.593779 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1108/2329] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:45 2022] GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063 => generated 1334 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:46.593779 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-f6c83a4d-677a-42a3-99d8-6dca60dd0027 req-1f0823df-8f82-4fa4-8110-9eb1095cee45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd344db8-1e3a-498b-a4b4-54b0547fc063", "tag": "4838ed53-ef5a-465a-9c02-b85243b9bc4c"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:11:46.604238 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-924e3123-9812-44b2-912b-4bc2f79a1d8b tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] 10.222.0.40 "GET /compute/v2.1/servers/945d807f-8341-49ca-ba3e-702bfd803dc3" status: 200 len: 1541 microversion: 2.1 time: 0.744673 Oct 26 13:11:46.606857 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1222/2330] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:45 2022] GET /compute/v2.1/servers/945d807f-8341-49ca-ba3e-702bfd803dc3 => generated 1541 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:46.623040 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0a98898f-8034-4c7e-979b-80b64f506638 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:46.623988 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0a98898f-8034-4c7e-979b-80b64f506638 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 31d4915d-93b9-445d-aad6-4fbc96fd5326] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:46.630343 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-f6c83a4d-677a-42a3-99d8-6dca60dd0027 req-1f0823df-8f82-4fa4-8110-9eb1095cee45 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:46.630944 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-f6c83a4d-677a-42a3-99d8-6dca60dd0027 req-1f0823df-8f82-4fa4-8110-9eb1095cee45 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:46.631373 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-f6c83a4d-677a-42a3-99d8-6dca60dd0027 req-1f0823df-8f82-4fa4-8110-9eb1095cee45 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:46.642804 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0a98898f-8034-4c7e-979b-80b64f506638 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:46.644544 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0a98898f-8034-4c7e-979b-80b64f506638 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:46.646749 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0a98898f-8034-4c7e-979b-80b64f506638 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:46.646920 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-f6c83a4d-677a-42a3-99d8-6dca60dd0027 req-1f0823df-8f82-4fa4-8110-9eb1095cee45 service nova] Creating event network-changed:4838ed53-ef5a-465a-9c02-b85243b9bc4c for instance cd344db8-1e3a-498b-a4b4-54b0547fc063 on n-h1-862686-1 Oct 26 13:11:46.648358 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0a98898f-8034-4c7e-979b-80b64f506638 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:46.652772 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0a98898f-8034-4c7e-979b-80b64f506638 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:46.652939 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-f6c83a4d-677a-42a3-99d8-6dca60dd0027 req-1f0823df-8f82-4fa4-8110-9eb1095cee45 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069038 Oct 26 13:11:46.653240 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0a98898f-8034-4c7e-979b-80b64f506638 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:46.653858 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1109/2331] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:11:46.660741 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a897bec8-f256-4eb3-959f-ca00c26a43fb tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:46.662182 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a897bec8-f256-4eb3-959f-ca00c26a43fb tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] [instance: 6555760c-8bf4-467e-80cb-cdf6eee4b93c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:46.670979 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a897bec8-f256-4eb3-959f-ca00c26a43fb tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:46.671466 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a897bec8-f256-4eb3-959f-ca00c26a43fb tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:46.671912 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a897bec8-f256-4eb3-959f-ca00c26a43fb tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:46.672632 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a897bec8-f256-4eb3-959f-ca00c26a43fb tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:46.673090 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a897bec8-f256-4eb3-959f-ca00c26a43fb tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:46.673540 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a897bec8-f256-4eb3-959f-ca00c26a43fb tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:46.738332 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0a98898f-8034-4c7e-979b-80b64f506638 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 31d4915d-93b9-445d-aad6-4fbc96fd5326] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:11:47.013188 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0a98898f-8034-4c7e-979b-80b64f506638 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "DELETE /compute/v2.1/servers/31d4915d-93b9-445d-aad6-4fbc96fd5326" status: 204 len: 0 microversion: 2.1 time: 0.404141 Oct 26 13:11:47.014985 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1223/2332] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:11:46 2022] DELETE /compute/v2.1/servers/31d4915d-93b9-445d-aad6-4fbc96fd5326 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:11:47.030270 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a5c45337-5d27-4892-83fa-19a054b597fd tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:47.032765 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a5c45337-5d27-4892-83fa-19a054b597fd tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] [instance: 945d807f-8341-49ca-ba3e-702bfd803dc3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:47.065728 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5c45337-5d27-4892-83fa-19a054b597fd tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:47.069656 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5c45337-5d27-4892-83fa-19a054b597fd tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:47.072007 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5c45337-5d27-4892-83fa-19a054b597fd tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:47.081174 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5c45337-5d27-4892-83fa-19a054b597fd tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:47.082733 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5c45337-5d27-4892-83fa-19a054b597fd tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:47.084801 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5c45337-5d27-4892-83fa-19a054b597fd tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:47.269447 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a897bec8-f256-4eb3-959f-ca00c26a43fb tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8fd7d2f8014b85beecc30c93bc084d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5902169366b646c7be94cb3521377225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:47.281027 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a897bec8-f256-4eb3-959f-ca00c26a43fb tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] 10.222.0.40 "GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c" status: 200 len: 1524 microversion: 2.1 time: 0.625892 Oct 26 13:11:47.293361 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1110/2333] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:46 2022] GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c => generated 1524 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:47.309732 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9e890e5c-9157-4306-a99b-de9f9f18ecf8 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:47.318023 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9e890e5c-9157-4306-a99b-de9f9f18ecf8 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] [instance: 5a42cb7d-b4c0-4771-a655-5e3f44adae05] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:47.333770 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9e890e5c-9157-4306-a99b-de9f9f18ecf8 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:47.336572 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9e890e5c-9157-4306-a99b-de9f9f18ecf8 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:47.337198 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9e890e5c-9157-4306-a99b-de9f9f18ecf8 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:47.338142 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9e890e5c-9157-4306-a99b-de9f9f18ecf8 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:47.346990 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9e890e5c-9157-4306-a99b-de9f9f18ecf8 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:47.347746 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9e890e5c-9157-4306-a99b-de9f9f18ecf8 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:47.644931 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a5c45337-5d27-4892-83fa-19a054b597fd tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] 10.222.0.40 "GET /compute/v2.1/servers/945d807f-8341-49ca-ba3e-702bfd803dc3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.627808 Oct 26 13:11:47.646391 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1224/2334] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 26 13:11:47 2022] GET /compute/v2.1/servers/945d807f-8341-49ca-ba3e-702bfd803dc3/os-interface => generated 285 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:11:47.659458 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b1188b2d-c225-4e1f-b075-154fe25e2817 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:47.660965 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b1188b2d-c225-4e1f-b075-154fe25e2817 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: 14fcf77a-99ed-4d7b-889a-19da49d9e4b4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:47.678690 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1188b2d-c225-4e1f-b075-154fe25e2817 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:47.679426 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1188b2d-c225-4e1f-b075-154fe25e2817 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:47.680022 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1188b2d-c225-4e1f-b075-154fe25e2817 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:47.680907 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1188b2d-c225-4e1f-b075-154fe25e2817 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:47.681619 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1188b2d-c225-4e1f-b075-154fe25e2817 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:47.682203 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1188b2d-c225-4e1f-b075-154fe25e2817 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:47.744596 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b1188b2d-c225-4e1f-b075-154fe25e2817 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: 14fcf77a-99ed-4d7b-889a-19da49d9e4b4] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:11:47.931667 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b1188b2d-c225-4e1f-b075-154fe25e2817 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "DELETE /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4" status: 204 len: 0 microversion: 2.1 time: 0.275990 Oct 26 13:11:47.937424 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1225/2335] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:11:47 2022] DELETE /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:11:47.949977 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-42ca2414-b825-4645-b8f0-437eb791110d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-568080904", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "259bbcbd-929e-4d48-b53c-e8ded5da783d"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:11:48.038436 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-42ca2414-b825-4645-b8f0-437eb791110d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] validate_networks() for [('259bbcbd-929e-4d48-b53c-e8ded5da783d', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:11:48.067516 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9e890e5c-9157-4306-a99b-de9f9f18ecf8 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3574f016449d43e7baf97212ed731304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9729793794fdca01a8e15bed9f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:48.078308 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9e890e5c-9157-4306-a99b-de9f9f18ecf8 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] 10.222.0.40 "GET /compute/v2.1/servers/5a42cb7d-b4c0-4771-a655-5e3f44adae05" status: 200 len: 1322 microversion: 2.1 time: 0.781352 Oct 26 13:11:48.079259 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1111/2336] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:47 2022] GET /compute/v2.1/servers/5a42cb7d-b4c0-4771-a655-5e3f44adae05 => generated 1322 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:48.099728 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1e9f72e6-39f7-43ac-b48a-aaf11ada4912 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:48.100354 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1e9f72e6-39f7-43ac-b48a-aaf11ada4912 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: cd344db8-1e3a-498b-a4b4-54b0547fc063] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:48.112695 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1e9f72e6-39f7-43ac-b48a-aaf11ada4912 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:48.113202 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1e9f72e6-39f7-43ac-b48a-aaf11ada4912 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:48.113730 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1e9f72e6-39f7-43ac-b48a-aaf11ada4912 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:48.115506 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1e9f72e6-39f7-43ac-b48a-aaf11ada4912 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:48.115506 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1e9f72e6-39f7-43ac-b48a-aaf11ada4912 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:48.115825 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1e9f72e6-39f7-43ac-b48a-aaf11ada4912 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:48.548806 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1e9f72e6-39f7-43ac-b48a-aaf11ada4912 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:48.562885 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1e9f72e6-39f7-43ac-b48a-aaf11ada4912 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063" status: 200 len: 1334 microversion: 2.1 time: 0.482398 Oct 26 13:11:48.563477 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1112/2337] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:48 2022] GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063 => generated 1334 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:48.569755 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7aaf4e16-5af5-49b0-a88a-b5c46e937475 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:48.570366 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7aaf4e16-5af5-49b0-a88a-b5c46e937475 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: 14fcf77a-99ed-4d7b-889a-19da49d9e4b4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:48.604990 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7aaf4e16-5af5-49b0-a88a-b5c46e937475 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:48.605601 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7aaf4e16-5af5-49b0-a88a-b5c46e937475 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:48.606047 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7aaf4e16-5af5-49b0-a88a-b5c46e937475 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:48.606771 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7aaf4e16-5af5-49b0-a88a-b5c46e937475 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:48.607227 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7aaf4e16-5af5-49b0-a88a-b5c46e937475 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:48.607651 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7aaf4e16-5af5-49b0-a88a-b5c46e937475 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:48.965580 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7aaf4e16-5af5-49b0-a88a-b5c46e937475 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4c9b05864d4d448b1c722659a3bc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2336994846d345aa86b5fd940d1b004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:48.979373 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7aaf4e16-5af5-49b0-a88a-b5c46e937475 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4" status: 200 len: 1680 microversion: 2.1 time: 0.414846 Oct 26 13:11:48.998839 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1113/2338] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:48 2022] GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4 => generated 1680 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:49.007229 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-2c30b1cb-6014-4104-994e-115f5ae7cdb1 req-ac64bc2d-cb7d-45ca-bba1-6eb656f8e5ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef63aed1-fab4-4b5b-b9c3-3607bb737e31", "name": "network-vif-plugged", "status": "completed", "tag": "d5de9727-eebc-4e98-8de0-53426dd8ddcf"}, {"server_uuid": "5a42cb7d-b4c0-4771-a655-5e3f44adae05", "name": "network-vif-plugged", "status": "completed", "tag": "33358974-4493-43ef-84db-4672cd97f231"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:11:49.020133 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2c30b1cb-6014-4104-994e-115f5ae7cdb1 req-ac64bc2d-cb7d-45ca-bba1-6eb656f8e5ee service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:49.020948 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2c30b1cb-6014-4104-994e-115f5ae7cdb1 req-ac64bc2d-cb7d-45ca-bba1-6eb656f8e5ee service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:49.021678 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2c30b1cb-6014-4104-994e-115f5ae7cdb1 req-ac64bc2d-cb7d-45ca-bba1-6eb656f8e5ee service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:49.037819 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-2c30b1cb-6014-4104-994e-115f5ae7cdb1 req-ac64bc2d-cb7d-45ca-bba1-6eb656f8e5ee service nova] Creating event network-vif-plugged:d5de9727-eebc-4e98-8de0-53426dd8ddcf for instance ef63aed1-fab4-4b5b-b9c3-3607bb737e31 on n-h1-862686-1 Oct 26 13:11:49.038578 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-2c30b1cb-6014-4104-994e-115f5ae7cdb1 req-ac64bc2d-cb7d-45ca-bba1-6eb656f8e5ee service nova] Creating event network-vif-plugged:33358974-4493-43ef-84db-4672cd97f231 for instance 5a42cb7d-b4c0-4771-a655-5e3f44adae05 on n-h2-862686-1 Oct 26 13:11:49.050126 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-2c30b1cb-6014-4104-994e-115f5ae7cdb1 req-ac64bc2d-cb7d-45ca-bba1-6eb656f8e5ee service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049736 Oct 26 13:11:49.056395 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1114/2339] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:11:49.071642 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-eb2c1625-39a1-475d-8e7e-6ca33603e1b2 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:49.072700 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-eb2c1625-39a1-475d-8e7e-6ca33603e1b2 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] [instance: 6555760c-8bf4-467e-80cb-cdf6eee4b93c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:49.108843 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eb2c1625-39a1-475d-8e7e-6ca33603e1b2 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:49.109870 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eb2c1625-39a1-475d-8e7e-6ca33603e1b2 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:49.110521 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eb2c1625-39a1-475d-8e7e-6ca33603e1b2 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:49.111898 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eb2c1625-39a1-475d-8e7e-6ca33603e1b2 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:49.112631 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eb2c1625-39a1-475d-8e7e-6ca33603e1b2 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:49.113273 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eb2c1625-39a1-475d-8e7e-6ca33603e1b2 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:49.584096 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-eb2c1625-39a1-475d-8e7e-6ca33603e1b2 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8fd7d2f8014b85beecc30c93bc084d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5902169366b646c7be94cb3521377225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:49.597117 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-eb2c1625-39a1-475d-8e7e-6ca33603e1b2 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] 10.222.0.40 "GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c" status: 200 len: 1524 microversion: 2.1 time: 0.538624 Oct 26 13:11:49.612173 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1115/2340] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:49 2022] GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c => generated 1524 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:49.622831 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a9e9e6f4-7df8-48a7-ada3-e98db3924cfb tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:49.623567 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a9e9e6f4-7df8-48a7-ada3-e98db3924cfb tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] [instance: 5a42cb7d-b4c0-4771-a655-5e3f44adae05] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:49.632675 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a9e9e6f4-7df8-48a7-ada3-e98db3924cfb tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:49.633202 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a9e9e6f4-7df8-48a7-ada3-e98db3924cfb tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:49.633827 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a9e9e6f4-7df8-48a7-ada3-e98db3924cfb tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:49.634577 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a9e9e6f4-7df8-48a7-ada3-e98db3924cfb tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:49.635118 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a9e9e6f4-7df8-48a7-ada3-e98db3924cfb tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:49.636400 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a9e9e6f4-7df8-48a7-ada3-e98db3924cfb tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:49.921916 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a9e9e6f4-7df8-48a7-ada3-e98db3924cfb tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3574f016449d43e7baf97212ed731304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9729793794fdca01a8e15bed9f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:49.936590 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a9e9e6f4-7df8-48a7-ada3-e98db3924cfb tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] 10.222.0.40 "GET /compute/v2.1/servers/5a42cb7d-b4c0-4771-a655-5e3f44adae05" status: 200 len: 1322 microversion: 2.1 time: 0.323048 Oct 26 13:11:49.937468 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1116/2341] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:49 2022] GET /compute/v2.1/servers/5a42cb7d-b4c0-4771-a655-5e3f44adae05 => generated 1322 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:49.953832 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f882eb2e-f792-497a-8fa1-701c8506c29e tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:49.956815 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f882eb2e-f792-497a-8fa1-701c8506c29e tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: cd344db8-1e3a-498b-a4b4-54b0547fc063] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:49.978190 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f882eb2e-f792-497a-8fa1-701c8506c29e tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:49.980969 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f882eb2e-f792-497a-8fa1-701c8506c29e tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:49.981563 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f882eb2e-f792-497a-8fa1-701c8506c29e tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:49.983550 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f882eb2e-f792-497a-8fa1-701c8506c29e tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:49.984954 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f882eb2e-f792-497a-8fa1-701c8506c29e tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:49.985400 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f882eb2e-f792-497a-8fa1-701c8506c29e tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:50.213794 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f882eb2e-f792-497a-8fa1-701c8506c29e tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:50.222609 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f882eb2e-f792-497a-8fa1-701c8506c29e tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063" status: 200 len: 1334 microversion: 2.1 time: 0.281565 Oct 26 13:11:50.228657 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1117/2342] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:49 2022] GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063 => generated 1334 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:50.235043 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e43ba776-4e2e-48e5-b081-146c89454a97 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:50.240392 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e43ba776-4e2e-48e5-b081-146c89454a97 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: 14fcf77a-99ed-4d7b-889a-19da49d9e4b4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:50.255544 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e43ba776-4e2e-48e5-b081-146c89454a97 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:50.256090 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e43ba776-4e2e-48e5-b081-146c89454a97 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:50.256628 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e43ba776-4e2e-48e5-b081-146c89454a97 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:50.260185 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e43ba776-4e2e-48e5-b081-146c89454a97 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:50.260745 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e43ba776-4e2e-48e5-b081-146c89454a97 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:50.261196 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e43ba776-4e2e-48e5-b081-146c89454a97 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:50.607164 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e43ba776-4e2e-48e5-b081-146c89454a97 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4c9b05864d4d448b1c722659a3bc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2336994846d345aa86b5fd940d1b004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:50.621824 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e43ba776-4e2e-48e5-b081-146c89454a97 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4" status: 200 len: 1680 microversion: 2.1 time: 0.391931 Oct 26 13:11:50.623230 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1118/2343] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:50 2022] GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4 => generated 1680 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:50.629455 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-2b7bdbcf-4aae-4bf2-a790-a04f960cd19a req-2244f7d9-862f-40cd-9644-48b44ff83d79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd344db8-1e3a-498b-a4b4-54b0547fc063", "tag": "10871312-274d-4b5f-8a2c-029559f9cb48"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:11:50.643332 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2b7bdbcf-4aae-4bf2-a790-a04f960cd19a req-2244f7d9-862f-40cd-9644-48b44ff83d79 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:50.644054 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2b7bdbcf-4aae-4bf2-a790-a04f960cd19a req-2244f7d9-862f-40cd-9644-48b44ff83d79 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:50.644938 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2b7bdbcf-4aae-4bf2-a790-a04f960cd19a req-2244f7d9-862f-40cd-9644-48b44ff83d79 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:50.666104 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-2b7bdbcf-4aae-4bf2-a790-a04f960cd19a req-2244f7d9-862f-40cd-9644-48b44ff83d79 service nova] Creating event network-changed:10871312-274d-4b5f-8a2c-029559f9cb48 for instance cd344db8-1e3a-498b-a4b4-54b0547fc063 on n-h1-862686-1 Oct 26 13:11:50.681013 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-42ca2414-b825-4645-b8f0-437eb791110d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:11:50.682531 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-42ca2414-b825-4645-b8f0-437eb791110d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:11:50.683272 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-42ca2414-b825-4645-b8f0-437eb791110d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:11:50.683865 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-2b7bdbcf-4aae-4bf2-a790-a04f960cd19a req-2244f7d9-862f-40cd-9644-48b44ff83d79 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059168 Oct 26 13:11:50.684418 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-42ca2414-b825-4645-b8f0-437eb791110d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:11:50.685099 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-42ca2414-b825-4645-b8f0-437eb791110d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:11:50.685554 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1119/2344] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:11:50.693446 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ab858225-6b3d-4632-adcf-5229f527e3e5 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:50.695143 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ab858225-6b3d-4632-adcf-5229f527e3e5 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] [instance: 6555760c-8bf4-467e-80cb-cdf6eee4b93c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:50.711660 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ab858225-6b3d-4632-adcf-5229f527e3e5 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:50.712221 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ab858225-6b3d-4632-adcf-5229f527e3e5 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:50.712684 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ab858225-6b3d-4632-adcf-5229f527e3e5 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:50.713544 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ab858225-6b3d-4632-adcf-5229f527e3e5 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:50.714068 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ab858225-6b3d-4632-adcf-5229f527e3e5 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:50.714561 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ab858225-6b3d-4632-adcf-5229f527e3e5 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:50.731257 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42ca2414-b825-4645-b8f0-437eb791110d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:50.734048 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42ca2414-b825-4645-b8f0-437eb791110d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:50.737080 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42ca2414-b825-4645-b8f0-437eb791110d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:50.741846 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42ca2414-b825-4645-b8f0-437eb791110d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:50.742450 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42ca2414-b825-4645-b8f0-437eb791110d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:50.744397 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42ca2414-b825-4645-b8f0-437eb791110d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:50.786812 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:11:50.796475 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-42ca2414-b825-4645-b8f0-437eb791110d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Getting quotas for project cc4a21e57f1c4fd1ab3c60f6416f8b11. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:11:50.813631 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-42ca2414-b825-4645-b8f0-437eb791110d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Getting quotas for user e3707c34798c48d584cff9dd46d9d7c0 and project cc4a21e57f1c4fd1ab3c60f6416f8b11. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:11:50.848883 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-42ca2414-b825-4645-b8f0-437eb791110d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:11:50.863339 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-42ca2414-b825-4645-b8f0-437eb791110d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 15a4a122-43f2-46c7-9168-722de25598c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:11:50.962770 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-42ca2414-b825-4645-b8f0-437eb791110d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.017679 Oct 26 13:11:50.972038 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1226/2345] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:11:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 3034 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:11:51.196230 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ab858225-6b3d-4632-adcf-5229f527e3e5 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8fd7d2f8014b85beecc30c93bc084d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5902169366b646c7be94cb3521377225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:51.213981 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ab858225-6b3d-4632-adcf-5229f527e3e5 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] 10.222.0.40 "GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c" status: 200 len: 1524 microversion: 2.1 time: 0.526329 Oct 26 13:11:51.214818 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1120/2346] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:50 2022] GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c => generated 1524 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:51.219481 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ad41c37b-3376-4fbd-a7dd-fa4abbf6a818 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:51.220452 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ad41c37b-3376-4fbd-a7dd-fa4abbf6a818 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] [instance: 5a42cb7d-b4c0-4771-a655-5e3f44adae05] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:51.235162 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad41c37b-3376-4fbd-a7dd-fa4abbf6a818 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:51.235651 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad41c37b-3376-4fbd-a7dd-fa4abbf6a818 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:51.236128 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad41c37b-3376-4fbd-a7dd-fa4abbf6a818 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:51.237300 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad41c37b-3376-4fbd-a7dd-fa4abbf6a818 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:51.237421 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad41c37b-3376-4fbd-a7dd-fa4abbf6a818 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:51.237792 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad41c37b-3376-4fbd-a7dd-fa4abbf6a818 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:51.273395 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3d3cebc2-b0fa-4ae3-93ea-9fce93fa67fe tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1438540131", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "4f5cd804-e666-4be2-8848-0a3733eede9c"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:11:51.383360 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-3d3cebc2-b0fa-4ae3-93ea-9fce93fa67fe tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] validate_networks() for [('4f5cd804-e666-4be2-8848-0a3733eede9c', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:11:51.480784 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ad41c37b-3376-4fbd-a7dd-fa4abbf6a818 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3574f016449d43e7baf97212ed731304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9729793794fdca01a8e15bed9f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:51.496431 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ad41c37b-3376-4fbd-a7dd-fa4abbf6a818 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] 10.222.0.40 "GET /compute/v2.1/servers/5a42cb7d-b4c0-4771-a655-5e3f44adae05" status: 200 len: 1514 microversion: 2.1 time: 0.280384 Oct 26 13:11:51.499159 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1121/2347] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:51 2022] GET /compute/v2.1/servers/5a42cb7d-b4c0-4771-a655-5e3f44adae05 => generated 1514 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:51.514786 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-516f0167-14e6-4b83-b0ed-4595d02c7a79 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:51.519055 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-516f0167-14e6-4b83-b0ed-4595d02c7a79 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 15a4a122-43f2-46c7-9168-722de25598c4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:51.663049 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-516f0167-14e6-4b83-b0ed-4595d02c7a79 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:51.670698 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-516f0167-14e6-4b83-b0ed-4595d02c7a79 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/15a4a122-43f2-46c7-9168-722de25598c4" status: 200 len: 1207 microversion: 2.1 time: 0.169463 Oct 26 13:11:51.672144 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1122/2348] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:51 2022] GET /compute/v2.1/servers/15a4a122-43f2-46c7-9168-722de25598c4 => generated 1207 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:51.685108 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-969c5805-b5bc-4fea-9cf0-2a4600d6d2f0 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:51.687733 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-969c5805-b5bc-4fea-9cf0-2a4600d6d2f0 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: cd344db8-1e3a-498b-a4b4-54b0547fc063] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:51.706293 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-969c5805-b5bc-4fea-9cf0-2a4600d6d2f0 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:51.708900 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-969c5805-b5bc-4fea-9cf0-2a4600d6d2f0 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:51.709715 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-969c5805-b5bc-4fea-9cf0-2a4600d6d2f0 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:51.711656 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-969c5805-b5bc-4fea-9cf0-2a4600d6d2f0 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:51.712390 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-969c5805-b5bc-4fea-9cf0-2a4600d6d2f0 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:51.715322 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-969c5805-b5bc-4fea-9cf0-2a4600d6d2f0 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:51.730067 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:11:52.001228 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-969c5805-b5bc-4fea-9cf0-2a4600d6d2f0 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:52.013318 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-969c5805-b5bc-4fea-9cf0-2a4600d6d2f0 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063" status: 200 len: 1334 microversion: 2.1 time: 0.337463 Oct 26 13:11:52.029514 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1123/2349] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:51 2022] GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063 => generated 1334 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:52.031471 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-09bd4cd0-c7a0-4d01-af82-5ba814eaeb54 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:52.031899 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-09bd4cd0-c7a0-4d01-af82-5ba814eaeb54 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] [instance: ef63aed1-fab4-4b5b-b9c3-3607bb737e31] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:52.044876 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09bd4cd0-c7a0-4d01-af82-5ba814eaeb54 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:52.045400 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09bd4cd0-c7a0-4d01-af82-5ba814eaeb54 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:52.046044 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09bd4cd0-c7a0-4d01-af82-5ba814eaeb54 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:52.046644 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09bd4cd0-c7a0-4d01-af82-5ba814eaeb54 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:52.047107 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09bd4cd0-c7a0-4d01-af82-5ba814eaeb54 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:52.047536 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09bd4cd0-c7a0-4d01-af82-5ba814eaeb54 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:52.352728 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-09bd4cd0-c7a0-4d01-af82-5ba814eaeb54 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3574f016449d43e7baf97212ed731304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9729793794fdca01a8e15bed9f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:52.365864 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-09bd4cd0-c7a0-4d01-af82-5ba814eaeb54 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] 10.222.0.40 "GET /compute/v2.1/servers/ef63aed1-fab4-4b5b-b9c3-3607bb737e31" status: 200 len: 1322 microversion: 2.1 time: 0.345829 Oct 26 13:11:52.367545 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1124/2350] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:52 2022] GET /compute/v2.1/servers/ef63aed1-fab4-4b5b-b9c3-3607bb737e31 => generated 1322 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:52.373776 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b98ead4f-127b-4af7-a6ab-b78dafbc7e7b tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:52.375176 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b98ead4f-127b-4af7-a6ab-b78dafbc7e7b tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: 14fcf77a-99ed-4d7b-889a-19da49d9e4b4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:52.384500 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b98ead4f-127b-4af7-a6ab-b78dafbc7e7b tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:52.385282 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b98ead4f-127b-4af7-a6ab-b78dafbc7e7b tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:52.385959 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b98ead4f-127b-4af7-a6ab-b78dafbc7e7b tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:52.387018 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b98ead4f-127b-4af7-a6ab-b78dafbc7e7b tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:52.388116 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b98ead4f-127b-4af7-a6ab-b78dafbc7e7b tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:52.388763 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b98ead4f-127b-4af7-a6ab-b78dafbc7e7b tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:52.613506 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b98ead4f-127b-4af7-a6ab-b78dafbc7e7b tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4c9b05864d4d448b1c722659a3bc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2336994846d345aa86b5fd940d1b004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:52.627103 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b98ead4f-127b-4af7-a6ab-b78dafbc7e7b tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4" status: 200 len: 1680 microversion: 2.1 time: 0.254892 Oct 26 13:11:52.628663 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1125/2351] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:52 2022] GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4 => generated 1680 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:52.637684 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-52585dcc-91d4-48ca-a98a-de7b3622cbbb tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:52.640294 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-52585dcc-91d4-48ca-a98a-de7b3622cbbb tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] [instance: 6555760c-8bf4-467e-80cb-cdf6eee4b93c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:52.649883 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52585dcc-91d4-48ca-a98a-de7b3622cbbb tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:52.652255 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52585dcc-91d4-48ca-a98a-de7b3622cbbb tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:52.652858 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52585dcc-91d4-48ca-a98a-de7b3622cbbb tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:52.655034 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52585dcc-91d4-48ca-a98a-de7b3622cbbb tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:52.655650 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52585dcc-91d4-48ca-a98a-de7b3622cbbb tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:52.656287 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52585dcc-91d4-48ca-a98a-de7b3622cbbb tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:52.864110 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-52585dcc-91d4-48ca-a98a-de7b3622cbbb tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8fd7d2f8014b85beecc30c93bc084d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5902169366b646c7be94cb3521377225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:52.874482 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-52585dcc-91d4-48ca-a98a-de7b3622cbbb tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] 10.222.0.40 "GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c" status: 200 len: 1504 microversion: 2.1 time: 0.243889 Oct 26 13:11:52.875445 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1126/2352] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:52 2022] GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c => generated 1504 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:52.881618 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f623bc25-5289-4d6e-b792-72b5b0c4acb5 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:52.882378 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f623bc25-5289-4d6e-b792-72b5b0c4acb5 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 15a4a122-43f2-46c7-9168-722de25598c4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:52.889117 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f623bc25-5289-4d6e-b792-72b5b0c4acb5 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:52.889654 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f623bc25-5289-4d6e-b792-72b5b0c4acb5 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:52.890098 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f623bc25-5289-4d6e-b792-72b5b0c4acb5 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:52.890833 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f623bc25-5289-4d6e-b792-72b5b0c4acb5 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:52.891544 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f623bc25-5289-4d6e-b792-72b5b0c4acb5 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:52.891851 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f623bc25-5289-4d6e-b792-72b5b0c4acb5 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:53.465528 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f623bc25-5289-4d6e-b792-72b5b0c4acb5 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:53.474800 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f623bc25-5289-4d6e-b792-72b5b0c4acb5 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/15a4a122-43f2-46c7-9168-722de25598c4" status: 200 len: 1259 microversion: 2.1 time: 0.597553 Oct 26 13:11:53.490869 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1127/2353] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:52 2022] GET /compute/v2.1/servers/15a4a122-43f2-46c7-9168-722de25598c4 => generated 1259 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:53.498397 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-eb9e8735-a241-4fa5-a941-d0731e39299f tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Action: 'create', calling method: .version_select at 0x7f673213b040>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1127345654", "description": "tempest-description-865864298"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:11:53.854015 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-eb9e8735-a241-4fa5-a941-d0731e39299f tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.361291 Oct 26 13:11:53.863622 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1128/2354] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 26 13:11:53 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:11:53.872002 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fd6c97b6-c036-46a6-8500-b206eb3c392b tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:53.874207 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fd6c97b6-c036-46a6-8500-b206eb3c392b tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: cd344db8-1e3a-498b-a4b4-54b0547fc063] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:53.908349 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd6c97b6-c036-46a6-8500-b206eb3c392b tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:53.909136 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd6c97b6-c036-46a6-8500-b206eb3c392b tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:53.910527 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd6c97b6-c036-46a6-8500-b206eb3c392b tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:53.916304 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd6c97b6-c036-46a6-8500-b206eb3c392b tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:53.917022 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd6c97b6-c036-46a6-8500-b206eb3c392b tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:53.917709 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd6c97b6-c036-46a6-8500-b206eb3c392b tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:54.228284 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-3d3cebc2-b0fa-4ae3-93ea-9fce93fa67fe tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:11:54.228865 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-3d3cebc2-b0fa-4ae3-93ea-9fce93fa67fe tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:11:54.229242 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-3d3cebc2-b0fa-4ae3-93ea-9fce93fa67fe tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:11:54.229691 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-3d3cebc2-b0fa-4ae3-93ea-9fce93fa67fe tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:11:54.230146 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-3d3cebc2-b0fa-4ae3-93ea-9fce93fa67fe tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:11:54.247557 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3d3cebc2-b0fa-4ae3-93ea-9fce93fa67fe tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:54.249750 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3d3cebc2-b0fa-4ae3-93ea-9fce93fa67fe tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:54.251040 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3d3cebc2-b0fa-4ae3-93ea-9fce93fa67fe tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:54.256146 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3d3cebc2-b0fa-4ae3-93ea-9fce93fa67fe tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:54.256663 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3d3cebc2-b0fa-4ae3-93ea-9fce93fa67fe tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:54.257112 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3d3cebc2-b0fa-4ae3-93ea-9fce93fa67fe tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:54.289008 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fd6c97b6-c036-46a6-8500-b206eb3c392b tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:54.301882 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fd6c97b6-c036-46a6-8500-b206eb3c392b tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063" status: 200 len: 1334 microversion: 2.1 time: 0.433783 Oct 26 13:11:54.302700 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1129/2355] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:53 2022] GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063 => generated 1334 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:54.305437 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-3d3cebc2-b0fa-4ae3-93ea-9fce93fa67fe tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Getting quotas for project 4f1ce8734839480ca6b07416a9c6d9c3. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:11:54.313123 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-d1af2b88-d42a-45b6-a8a4-923c8df93df5 req-291ff068-69b0-4ec4-9320-00c08d68673c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "945d807f-8341-49ca-ba3e-702bfd803dc3", "tag": "d3c22259-adb6-472e-9aed-08a5fa660e6a"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:11:54.331296 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-3d3cebc2-b0fa-4ae3-93ea-9fce93fa67fe tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Getting quotas for user f96da2e13ca64db2a16d58aee1fc921d and project 4f1ce8734839480ca6b07416a9c6d9c3. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:11:54.333541 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d1af2b88-d42a-45b6-a8a4-923c8df93df5 req-291ff068-69b0-4ec4-9320-00c08d68673c service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:54.334272 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d1af2b88-d42a-45b6-a8a4-923c8df93df5 req-291ff068-69b0-4ec4-9320-00c08d68673c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:54.335276 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d1af2b88-d42a-45b6-a8a4-923c8df93df5 req-291ff068-69b0-4ec4-9320-00c08d68673c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:54.369088 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-d1af2b88-d42a-45b6-a8a4-923c8df93df5 req-291ff068-69b0-4ec4-9320-00c08d68673c service nova] Creating event network-changed:d3c22259-adb6-472e-9aed-08a5fa660e6a for instance 945d807f-8341-49ca-ba3e-702bfd803dc3 on n-h2-862686-1 Oct 26 13:11:54.375001 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3d3cebc2-b0fa-4ae3-93ea-9fce93fa67fe tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:11:54.380304 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-d1af2b88-d42a-45b6-a8a4-923c8df93df5 req-291ff068-69b0-4ec4-9320-00c08d68673c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072045 Oct 26 13:11:54.383727 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3d3cebc2-b0fa-4ae3-93ea-9fce93fa67fe tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: f5da8a46-9260-405b-aa4e-1f1a585302bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:11:54.384213 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1130/2356] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:11:54.401263 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bc5b03b6-963a-4cd9-88e0-bcb7b27b3b1b tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:54.402683 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bc5b03b6-963a-4cd9-88e0-bcb7b27b3b1b tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] [instance: ef63aed1-fab4-4b5b-b9c3-3607bb737e31] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:54.412566 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc5b03b6-963a-4cd9-88e0-bcb7b27b3b1b tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:54.413419 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc5b03b6-963a-4cd9-88e0-bcb7b27b3b1b tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:54.414229 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc5b03b6-963a-4cd9-88e0-bcb7b27b3b1b tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:54.415867 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc5b03b6-963a-4cd9-88e0-bcb7b27b3b1b tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:54.416552 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc5b03b6-963a-4cd9-88e0-bcb7b27b3b1b tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:54.418912 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc5b03b6-963a-4cd9-88e0-bcb7b27b3b1b tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:54.515562 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3d3cebc2-b0fa-4ae3-93ea-9fce93fa67fe tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.541266 Oct 26 13:11:54.516235 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1227/2357] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:11:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 3543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:11:54.558040 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-30c34bd3-6582-4ff2-85b3-46c5b01eea65 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:54.558675 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-30c34bd3-6582-4ff2-85b3-46c5b01eea65 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: 14fcf77a-99ed-4d7b-889a-19da49d9e4b4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:54.575097 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30c34bd3-6582-4ff2-85b3-46c5b01eea65 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:54.576876 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30c34bd3-6582-4ff2-85b3-46c5b01eea65 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:54.577500 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30c34bd3-6582-4ff2-85b3-46c5b01eea65 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:54.578399 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30c34bd3-6582-4ff2-85b3-46c5b01eea65 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:54.579035 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30c34bd3-6582-4ff2-85b3-46c5b01eea65 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:54.579671 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30c34bd3-6582-4ff2-85b3-46c5b01eea65 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:55.097074 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bc5b03b6-963a-4cd9-88e0-bcb7b27b3b1b tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3574f016449d43e7baf97212ed731304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9729793794fdca01a8e15bed9f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:55.109382 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bc5b03b6-963a-4cd9-88e0-bcb7b27b3b1b tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] 10.222.0.40 "GET /compute/v2.1/servers/ef63aed1-fab4-4b5b-b9c3-3607bb737e31" status: 200 len: 1514 microversion: 2.1 time: 0.719929 Oct 26 13:11:55.124107 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1131/2358] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:54 2022] GET /compute/v2.1/servers/ef63aed1-fab4-4b5b-b9c3-3607bb737e31 => generated 1514 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:55.138766 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-1b6b5409-fc98-4faa-a91e-b5a0f7d9cc47 req-548ec9b4-3e5a-4aba-9020-86d5ae2f990e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14fcf77a-99ed-4d7b-889a-19da49d9e4b4", "name": "network-vif-unplugged", "status": "completed", "tag": "daf7da51-0b0e-451f-8b3d-8f82f9a71263"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:11:55.151416 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-1b6b5409-fc98-4faa-a91e-b5a0f7d9cc47 req-548ec9b4-3e5a-4aba-9020-86d5ae2f990e service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:55.152295 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-1b6b5409-fc98-4faa-a91e-b5a0f7d9cc47 req-548ec9b4-3e5a-4aba-9020-86d5ae2f990e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:55.152960 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-1b6b5409-fc98-4faa-a91e-b5a0f7d9cc47 req-548ec9b4-3e5a-4aba-9020-86d5ae2f990e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:55.168859 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-1b6b5409-fc98-4faa-a91e-b5a0f7d9cc47 req-548ec9b4-3e5a-4aba-9020-86d5ae2f990e service nova] Creating event network-vif-unplugged:daf7da51-0b0e-451f-8b3d-8f82f9a71263 for instance 14fcf77a-99ed-4d7b-889a-19da49d9e4b4 on n-h1-862686-1 Oct 26 13:11:55.179703 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-1b6b5409-fc98-4faa-a91e-b5a0f7d9cc47 req-548ec9b4-3e5a-4aba-9020-86d5ae2f990e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047085 Oct 26 13:11:55.181864 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1132/2359] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:11:55.192927 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7eb3c9f2-d62c-41ca-b985-497ade453df4 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1127345654"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:11:55.194667 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7eb3c9f2-d62c-41ca-b985-497ade453df4 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] [instance: 6555760c-8bf4-467e-80cb-cdf6eee4b93c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:55.203462 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7eb3c9f2-d62c-41ca-b985-497ade453df4 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:55.204362 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7eb3c9f2-d62c-41ca-b985-497ade453df4 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:55.205402 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7eb3c9f2-d62c-41ca-b985-497ade453df4 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:55.206979 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7eb3c9f2-d62c-41ca-b985-497ade453df4 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:55.208005 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7eb3c9f2-d62c-41ca-b985-497ade453df4 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:55.208714 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7eb3c9f2-d62c-41ca-b985-497ade453df4 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:55.407811 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-30c34bd3-6582-4ff2-85b3-46c5b01eea65 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4c9b05864d4d448b1c722659a3bc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2336994846d345aa86b5fd940d1b004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:55.419978 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-30c34bd3-6582-4ff2-85b3-46c5b01eea65 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4" status: 200 len: 1680 microversion: 2.1 time: 0.902615 Oct 26 13:11:55.424090 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1228/2360] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:54 2022] GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4 => generated 1680 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:55.446955 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c979cb3c-8a40-4376-a0d0-04e4a04532c6 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:55.457592 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c979cb3c-8a40-4376-a0d0-04e4a04532c6 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 15a4a122-43f2-46c7-9168-722de25598c4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:55.466149 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c979cb3c-8a40-4376-a0d0-04e4a04532c6 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:55.467150 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c979cb3c-8a40-4376-a0d0-04e4a04532c6 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:55.468752 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c979cb3c-8a40-4376-a0d0-04e4a04532c6 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:55.470270 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c979cb3c-8a40-4376-a0d0-04e4a04532c6 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:55.470774 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c979cb3c-8a40-4376-a0d0-04e4a04532c6 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:55.478987 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c979cb3c-8a40-4376-a0d0-04e4a04532c6 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:55.904323 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.network.security_group_api [None req-7eb3c9f2-d62c-41ca-b985-497ade453df4 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Adding security group 1b74409a-4ff5-44d9-b5c0-27fa342ea637 to port 16bdf5c3-e3cb-4e23-93c3-2342697bd561 Oct 26 13:11:56.206317 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c979cb3c-8a40-4376-a0d0-04e4a04532c6 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:56.215729 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:11:56.222397 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c979cb3c-8a40-4376-a0d0-04e4a04532c6 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/15a4a122-43f2-46c7-9168-722de25598c4" status: 200 len: 1307 microversion: 2.1 time: 0.776836 Oct 26 13:11:56.223170 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1229/2361] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:55 2022] GET /compute/v2.1/servers/15a4a122-43f2-46c7-9168-722de25598c4 => generated 1307 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:56.254304 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-45a47008-1601-4093-bf53-947dd9005e01 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:56.255153 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-45a47008-1601-4093-bf53-947dd9005e01 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: f5da8a46-9260-405b-aa4e-1f1a585302bb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:56.263916 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45a47008-1601-4093-bf53-947dd9005e01 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:56.264492 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45a47008-1601-4093-bf53-947dd9005e01 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:56.265016 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45a47008-1601-4093-bf53-947dd9005e01 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:56.265833 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45a47008-1601-4093-bf53-947dd9005e01 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:56.266356 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45a47008-1601-4093-bf53-947dd9005e01 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:56.266849 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45a47008-1601-4093-bf53-947dd9005e01 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:56.358034 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-45a47008-1601-4093-bf53-947dd9005e01 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:56.367253 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-45a47008-1601-4093-bf53-947dd9005e01 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb" status: 200 len: 1263 microversion: 2.1 time: 0.123094 Oct 26 13:11:56.370948 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1230/2362] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:56 2022] GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb => generated 1263 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:56.381851 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-51dfac16-4f33-4072-9722-f29cefd34ac1 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:56.382685 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-51dfac16-4f33-4072-9722-f29cefd34ac1 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] [instance: 8768fa8b-3989-4c11-a1cf-7841cf7e5c8d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:56.396803 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-51dfac16-4f33-4072-9722-f29cefd34ac1 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:56.400919 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-51dfac16-4f33-4072-9722-f29cefd34ac1 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:56.401578 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-51dfac16-4f33-4072-9722-f29cefd34ac1 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:56.402544 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-51dfac16-4f33-4072-9722-f29cefd34ac1 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:56.403212 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-51dfac16-4f33-4072-9722-f29cefd34ac1 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:56.403636 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-51dfac16-4f33-4072-9722-f29cefd34ac1 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:57.066257 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7eb3c9f2-d62c-41ca-b985-497ade453df4 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] 10.222.0.40 "POST /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c/action" status: 202 len: 0 microversion: 2.1 time: 1.882837 Oct 26 13:11:57.066881 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1133/2363] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:11:55 2022] POST /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c/action => generated 0 bytes in 1884 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:11:57.072760 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-880bd780-f026-44b9-a28b-36f51b340899 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:57.073708 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-880bd780-f026-44b9-a28b-36f51b340899 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: cd344db8-1e3a-498b-a4b4-54b0547fc063] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:57.088210 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-880bd780-f026-44b9-a28b-36f51b340899 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:57.088717 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-880bd780-f026-44b9-a28b-36f51b340899 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:57.089167 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-880bd780-f026-44b9-a28b-36f51b340899 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:57.092604 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-880bd780-f026-44b9-a28b-36f51b340899 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:57.093316 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-880bd780-f026-44b9-a28b-36f51b340899 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:57.093954 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-880bd780-f026-44b9-a28b-36f51b340899 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:57.325741 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-51dfac16-4f33-4072-9722-f29cefd34ac1 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3574f016449d43e7baf97212ed731304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9729793794fdca01a8e15bed9f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:57.342622 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-51dfac16-4f33-4072-9722-f29cefd34ac1 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] 10.222.0.40 "GET /compute/v2.1/servers/8768fa8b-3989-4c11-a1cf-7841cf7e5c8d" status: 200 len: 1514 microversion: 2.1 time: 0.968963 Oct 26 13:11:57.344085 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1231/2364] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:56 2022] GET /compute/v2.1/servers/8768fa8b-3989-4c11-a1cf-7841cf7e5c8d => generated 1514 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:57.353225 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-28e63224-a529-4d45-ad8f-d3640c84d221 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:57.353592 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-28e63224-a529-4d45-ad8f-d3640c84d221 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: 14fcf77a-99ed-4d7b-889a-19da49d9e4b4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:57.363304 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28e63224-a529-4d45-ad8f-d3640c84d221 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:57.364164 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28e63224-a529-4d45-ad8f-d3640c84d221 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:57.364826 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28e63224-a529-4d45-ad8f-d3640c84d221 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:57.381064 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28e63224-a529-4d45-ad8f-d3640c84d221 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:57.386094 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28e63224-a529-4d45-ad8f-d3640c84d221 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:57.387067 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28e63224-a529-4d45-ad8f-d3640c84d221 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:57.476418 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28e63224-a529-4d45-ad8f-d3640c84d221 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:57.477010 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28e63224-a529-4d45-ad8f-d3640c84d221 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:57.477586 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28e63224-a529-4d45-ad8f-d3640c84d221 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:57.478116 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-28e63224-a529-4d45-ad8f-d3640c84d221 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lazy-loading 'fault' on Instance uuid 14fcf77a-99ed-4d7b-889a-19da49d9e4b4 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:11:57.519963 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-880bd780-f026-44b9-a28b-36f51b340899 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:57.529124 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-880bd780-f026-44b9-a28b-36f51b340899 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063" status: 200 len: 1334 microversion: 2.1 time: 0.461024 Oct 26 13:11:57.566723 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1134/2365] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:57 2022] GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063 => generated 1334 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:57.578066 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-74ee3804-d4be-4f98-a491-b32497a19dc9 req-6d640d06-5f95-4fe6-a5f9-3fd2d87af24a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31d4915d-93b9-445d-aad6-4fbc96fd5326", "name": "network-vif-deleted", "tag": "3438b228-4d60-45ce-9603-e5edd9a6df9a"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:11:57.608702 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-74ee3804-d4be-4f98-a491-b32497a19dc9 req-6d640d06-5f95-4fe6-a5f9-3fd2d87af24a service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:57.612161 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-74ee3804-d4be-4f98-a491-b32497a19dc9 req-6d640d06-5f95-4fe6-a5f9-3fd2d87af24a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:57.613214 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-74ee3804-d4be-4f98-a491-b32497a19dc9 req-6d640d06-5f95-4fe6-a5f9-3fd2d87af24a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:57.641988 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-74ee3804-d4be-4f98-a491-b32497a19dc9 req-6d640d06-5f95-4fe6-a5f9-3fd2d87af24a service nova] Creating event network-vif-deleted:3438b228-4d60-45ce-9603-e5edd9a6df9a for instance 31d4915d-93b9-445d-aad6-4fbc96fd5326 on n-h1-862686-1 Oct 26 13:11:57.655072 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-74ee3804-d4be-4f98-a491-b32497a19dc9 req-6d640d06-5f95-4fe6-a5f9-3fd2d87af24a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086932 Oct 26 13:11:57.656926 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1135/2366] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:11:57.664125 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fc69c361-c3c4-4333-bc58-c5477ffd17a0 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1127345654"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:11:57.664979 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fc69c361-c3c4-4333-bc58-c5477ffd17a0 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] [instance: 6555760c-8bf4-467e-80cb-cdf6eee4b93c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:57.672913 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fc69c361-c3c4-4333-bc58-c5477ffd17a0 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:57.674118 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fc69c361-c3c4-4333-bc58-c5477ffd17a0 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:57.674874 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fc69c361-c3c4-4333-bc58-c5477ffd17a0 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:57.675786 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fc69c361-c3c4-4333-bc58-c5477ffd17a0 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:57.677319 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fc69c361-c3c4-4333-bc58-c5477ffd17a0 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:57.679732 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fc69c361-c3c4-4333-bc58-c5477ffd17a0 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:57.815435 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-28e63224-a529-4d45-ad8f-d3640c84d221 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4c9b05864d4d448b1c722659a3bc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2336994846d345aa86b5fd940d1b004f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:57.825540 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-28e63224-a529-4d45-ad8f-d3640c84d221 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4" status: 200 len: 1330 microversion: 2.1 time: 0.480161 Oct 26 13:11:57.827962 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1232/2367] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:57 2022] GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4 => generated 1330 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:57.836417 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-ddb967e1-3044-439e-9c8a-752185e6f59b req-3551e199-ad1a-4988-90bf-bc27fca3b723 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6555760c-8bf4-467e-80cb-cdf6eee4b93c", "tag": "16bdf5c3-e3cb-4e23-93c3-2342697bd561"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:11:57.849195 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ddb967e1-3044-439e-9c8a-752185e6f59b req-3551e199-ad1a-4988-90bf-bc27fca3b723 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:57.850067 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ddb967e1-3044-439e-9c8a-752185e6f59b req-3551e199-ad1a-4988-90bf-bc27fca3b723 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:57.850662 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ddb967e1-3044-439e-9c8a-752185e6f59b req-3551e199-ad1a-4988-90bf-bc27fca3b723 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:57.873095 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-ddb967e1-3044-439e-9c8a-752185e6f59b req-3551e199-ad1a-4988-90bf-bc27fca3b723 service nova] Creating event network-changed:16bdf5c3-e3cb-4e23-93c3-2342697bd561 for instance 6555760c-8bf4-467e-80cb-cdf6eee4b93c on n-h1-862686-1 Oct 26 13:11:57.888162 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-ddb967e1-3044-439e-9c8a-752185e6f59b req-3551e199-ad1a-4988-90bf-bc27fca3b723 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058678 Oct 26 13:11:57.889418 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1233/2368] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:11:57.895612 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0d24d44a-c2dd-485d-afc1-5788f7618940 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:57.896524 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0d24d44a-c2dd-485d-afc1-5788f7618940 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 15a4a122-43f2-46c7-9168-722de25598c4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:57.919187 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d24d44a-c2dd-485d-afc1-5788f7618940 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:57.921079 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d24d44a-c2dd-485d-afc1-5788f7618940 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:57.921949 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d24d44a-c2dd-485d-afc1-5788f7618940 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:57.924444 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d24d44a-c2dd-485d-afc1-5788f7618940 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:57.925284 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d24d44a-c2dd-485d-afc1-5788f7618940 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:57.926395 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d24d44a-c2dd-485d-afc1-5788f7618940 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:58.021681 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.network.security_group_api [None req-fc69c361-c3c4-4333-bc58-c5477ffd17a0 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Removing security group 1b74409a-4ff5-44d9-b5c0-27fa342ea637 from port 16bdf5c3-e3cb-4e23-93c3-2342697bd561 Oct 26 13:11:58.291554 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0d24d44a-c2dd-485d-afc1-5788f7618940 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:58.311940 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0d24d44a-c2dd-485d-afc1-5788f7618940 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/15a4a122-43f2-46c7-9168-722de25598c4" status: 200 len: 1307 microversion: 2.1 time: 0.420450 Oct 26 13:11:58.333151 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1234/2369] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:57 2022] GET /compute/v2.1/servers/15a4a122-43f2-46c7-9168-722de25598c4 => generated 1307 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:58.343616 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c52ae9ff-eb5b-4cd4-9037-9ab2cb82c7c0 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:58.344408 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c52ae9ff-eb5b-4cd4-9037-9ab2cb82c7c0 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] [instance: 8768fa8b-3989-4c11-a1cf-7841cf7e5c8d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:58.353079 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c52ae9ff-eb5b-4cd4-9037-9ab2cb82c7c0 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:58.353609 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c52ae9ff-eb5b-4cd4-9037-9ab2cb82c7c0 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:58.354108 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c52ae9ff-eb5b-4cd4-9037-9ab2cb82c7c0 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:58.354858 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c52ae9ff-eb5b-4cd4-9037-9ab2cb82c7c0 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:58.355315 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c52ae9ff-eb5b-4cd4-9037-9ab2cb82c7c0 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:58.355735 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c52ae9ff-eb5b-4cd4-9037-9ab2cb82c7c0 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:58.385522 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c52ae9ff-eb5b-4cd4-9037-9ab2cb82c7c0 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] [instance: 8768fa8b-3989-4c11-a1cf-7841cf7e5c8d] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:11:58.494903 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c52ae9ff-eb5b-4cd4-9037-9ab2cb82c7c0 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8768fa8b-3989-4c11-a1cf-7841cf7e5c8d" status: 204 len: 0 microversion: 2.1 time: 0.158150 Oct 26 13:11:58.496270 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1235/2370] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:11:58 2022] DELETE /compute/v2.1/servers/8768fa8b-3989-4c11-a1cf-7841cf7e5c8d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:11:58.511645 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d8e6f3cf-d0e2-4b02-8dec-2ce7d73503c1 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:58.512465 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d8e6f3cf-d0e2-4b02-8dec-2ce7d73503c1 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: f5da8a46-9260-405b-aa4e-1f1a585302bb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:58.522032 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8e6f3cf-d0e2-4b02-8dec-2ce7d73503c1 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:58.522528 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8e6f3cf-d0e2-4b02-8dec-2ce7d73503c1 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:58.524280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8e6f3cf-d0e2-4b02-8dec-2ce7d73503c1 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:58.525014 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8e6f3cf-d0e2-4b02-8dec-2ce7d73503c1 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:58.525471 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8e6f3cf-d0e2-4b02-8dec-2ce7d73503c1 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:58.525911 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8e6f3cf-d0e2-4b02-8dec-2ce7d73503c1 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:58.617934 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d8e6f3cf-d0e2-4b02-8dec-2ce7d73503c1 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:58.634120 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d8e6f3cf-d0e2-4b02-8dec-2ce7d73503c1 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb" status: 200 len: 1269 microversion: 2.1 time: 0.134877 Oct 26 13:11:58.634961 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1236/2371] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:58 2022] GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb => generated 1269 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:58.640974 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fba99767-e134-406e-b59f-e4f4a0f8b3e5 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:58.641962 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fba99767-e134-406e-b59f-e4f4a0f8b3e5 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] [instance: 8768fa8b-3989-4c11-a1cf-7841cf7e5c8d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:58.650914 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fba99767-e134-406e-b59f-e4f4a0f8b3e5 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:58.651639 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fba99767-e134-406e-b59f-e4f4a0f8b3e5 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:58.652911 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fba99767-e134-406e-b59f-e4f4a0f8b3e5 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:58.654054 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fba99767-e134-406e-b59f-e4f4a0f8b3e5 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:58.655268 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fba99767-e134-406e-b59f-e4f4a0f8b3e5 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:58.655858 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fba99767-e134-406e-b59f-e4f4a0f8b3e5 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:58.783936 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fc69c361-c3c4-4333-bc58-c5477ffd17a0 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] 10.222.0.40 "POST /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c/action" status: 202 len: 0 microversion: 2.1 time: 1.124566 Oct 26 13:11:58.785131 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1136/2372] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:11:57 2022] POST /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c/action => generated 0 bytes in 1127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:11:58.792792 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-efe6b684-d695-489d-9933-6cb30441794c tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:58.793821 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-efe6b684-d695-489d-9933-6cb30441794c tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: cd344db8-1e3a-498b-a4b4-54b0547fc063] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:58.801718 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-efe6b684-d695-489d-9933-6cb30441794c tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:58.802548 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-efe6b684-d695-489d-9933-6cb30441794c tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:58.803758 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-efe6b684-d695-489d-9933-6cb30441794c tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:58.804868 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-efe6b684-d695-489d-9933-6cb30441794c tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:58.805576 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-efe6b684-d695-489d-9933-6cb30441794c tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:58.806218 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-efe6b684-d695-489d-9933-6cb30441794c tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:58.979844 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fba99767-e134-406e-b59f-e4f4a0f8b3e5 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3574f016449d43e7baf97212ed731304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9729793794fdca01a8e15bed9f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:58.992643 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fba99767-e134-406e-b59f-e4f4a0f8b3e5 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] 10.222.0.40 "GET /compute/v2.1/servers/8768fa8b-3989-4c11-a1cf-7841cf7e5c8d" status: 200 len: 1520 microversion: 2.1 time: 0.356443 Oct 26 13:11:58.993513 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1237/2373] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:58 2022] GET /compute/v2.1/servers/8768fa8b-3989-4c11-a1cf-7841cf7e5c8d => generated 1520 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:59.008521 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-731ceebe-8e4e-4e45-9ddb-71ab1eadd88d tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Action: 'create', calling method: .version_select at 0x7f6732576940>, body: {"pool": null} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:11:59.085849 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-efe6b684-d695-489d-9933-6cb30441794c tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:59.096447 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-efe6b684-d695-489d-9933-6cb30441794c tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063" status: 200 len: 1334 microversion: 2.1 time: 0.309939 Oct 26 13:11:59.100115 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1137/2374] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:58 2022] GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063 => generated 1334 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:59.105650 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1c641b3e-41ca-4a89-8b35-534e91415731 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:59.106463 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1c641b3e-41ca-4a89-8b35-534e91415731 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] [instance: 14fcf77a-99ed-4d7b-889a-19da49d9e4b4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:59.127519 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1c641b3e-41ca-4a89-8b35-534e91415731 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:59.130062 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1c641b3e-41ca-4a89-8b35-534e91415731 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:59.130721 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1c641b3e-41ca-4a89-8b35-534e91415731 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:59.132767 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1c641b3e-41ca-4a89-8b35-534e91415731 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:59.133253 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1c641b3e-41ca-4a89-8b35-534e91415731 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:59.133764 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1c641b3e-41ca-4a89-8b35-534e91415731 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:59.150435 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-1c641b3e-41ca-4a89-8b35-534e91415731 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] HTTP exception thrown: Instance 14fcf77a-99ed-4d7b-889a-19da49d9e4b4 could not be found. Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1c641b3e-41ca-4a89-8b35-534e91415731 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Request method failure captured: Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4 HTTP/1.1 Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTFgIL_cRAPUdtHwI4x6yCEBx8ehHBkBaqKL9vP6UNAvXX6AbCbat_GtQS1eRfHYAPYvgrD2A19YwM4J3VT3mJzxKo4XJfkrSZxV-o9iFA8tNWYlWBNex4uCqA6LXksF8lOtQwt4YHlobIbNQUigiEpnxM8guytrO2gsBdqVUrkQwoQ Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 2336994846d345aa86b5fd940d1b004f Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-VolumesAdminNegativeTest-1487053027 Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2336994846d345aa86b5fd940d1b004f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2336994846d345aa86b5fd940d1b004f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2336994846d345aa86b5fd940d1b004f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2336994846d345aa86b5fd940d1b004f"}]}] Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-VolumesAdminNegativeTest-1487053027 Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 2336994846d345aa86b5fd940d1b004f Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1487053027 Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-VolumesAdminNegativeTest-1487053027-project Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: cb4c9b05864d4d448b1c722659a3bc21 Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-VolumesAdminNegativeTest-1487053027-project Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 14fcf77a-99ed-4d7b-889a-19da49d9e4b4 could not be found. Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '14fcf77a-99ed-4d7b-889a-19da49d9e4b4'} Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14fcf77a-99ed-4d7b-889a-19da49d9e4b4 could not be found. Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14fcf77a-99ed-4d7b-889a-19da49d9e4b4 could not be found. Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:11:59.152390 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:11:59.156710 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:11:59.156710 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:11:59.156710 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:11:59.156710 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:11:59.156710 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:11:59.156710 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14fcf77a-99ed-4d7b-889a-19da49d9e4b4 could not be found. Oct 26 13:11:59.156710 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:11:59.156710 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1c641b3e-41ca-4a89-8b35-534e91415731 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Returning 404 to user: Instance 14fcf77a-99ed-4d7b-889a-19da49d9e4b4 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:11:59.156710 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1c641b3e-41ca-4a89-8b35-534e91415731 tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4" status: 404 len: 111 microversion: 2.1 time: 0.052632 Oct 26 13:11:59.156710 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1138/2375] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:59 2022] GET /compute/v2.1/servers/14fcf77a-99ed-4d7b-889a-19da49d9e4b4 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:11:59.163117 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-127ee6dc-9956-455e-8974-7a285776d05a tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] Calling method '.version_select at 0x7f67321bfaf0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:59.185934 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-127ee6dc-9956-455e-8974-7a285776d05a tempest-VolumesAdminNegativeTest-1487053027 tempest-VolumesAdminNegativeTest-1487053027-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-587871191" status: 202 len: 0 microversion: 2.1 time: 0.026131 Oct 26 13:11:59.187801 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1139/2376] 10.222.0.40 () {58 vars in 1218 bytes} [Wed Oct 26 13:11:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-587871191 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 13:11:59.340958 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b16229d3-8beb-4fe8-a6d1-595f71a59f4f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:59.341879 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b16229d3-8beb-4fe8-a6d1-595f71a59f4f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 15a4a122-43f2-46c7-9168-722de25598c4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:59.350508 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b16229d3-8beb-4fe8-a6d1-595f71a59f4f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:59.351843 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b16229d3-8beb-4fe8-a6d1-595f71a59f4f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:59.352434 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b16229d3-8beb-4fe8-a6d1-595f71a59f4f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:59.353302 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b16229d3-8beb-4fe8-a6d1-595f71a59f4f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:59.354266 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b16229d3-8beb-4fe8-a6d1-595f71a59f4f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:59.355062 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b16229d3-8beb-4fe8-a6d1-595f71a59f4f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:59.694805 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b16229d3-8beb-4fe8-a6d1-595f71a59f4f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:11:59.707969 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b16229d3-8beb-4fe8-a6d1-595f71a59f4f tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/15a4a122-43f2-46c7-9168-722de25598c4" status: 200 len: 1307 microversion: 2.1 time: 0.369463 Oct 26 13:11:59.715806 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1140/2377] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:59 2022] GET /compute/v2.1/servers/15a4a122-43f2-46c7-9168-722de25598c4 => generated 1307 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:11:59.732588 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3da25578-6c44-4828-9498-d7a88aeafa21 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:11:59.733537 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3da25578-6c44-4828-9498-d7a88aeafa21 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: f5da8a46-9260-405b-aa4e-1f1a585302bb] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:11:59.742288 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3da25578-6c44-4828-9498-d7a88aeafa21 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:59.742910 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3da25578-6c44-4828-9498-d7a88aeafa21 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:59.743519 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3da25578-6c44-4828-9498-d7a88aeafa21 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:11:59.744765 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3da25578-6c44-4828-9498-d7a88aeafa21 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:11:59.746274 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3da25578-6c44-4828-9498-d7a88aeafa21 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:11:59.746844 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3da25578-6c44-4828-9498-d7a88aeafa21 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:00.156388 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3da25578-6c44-4828-9498-d7a88aeafa21 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:00.167582 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3da25578-6c44-4828-9498-d7a88aeafa21 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb" status: 200 len: 1311 microversion: 2.1 time: 0.450007 Oct 26 13:12:00.168384 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1141/2378] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:11:59 2022] GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb => generated 1311 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:00.175731 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-759e8589-93d5-4209-be76-ae0f3e3ee0c3 req-95b6044e-d7b6-404e-88a5-4fb4de7eaaea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14fcf77a-99ed-4d7b-889a-19da49d9e4b4", "name": "network-vif-deleted", "tag": "daf7da51-0b0e-451f-8b3d-8f82f9a71263"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:12:00.194072 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-759e8589-93d5-4209-be76-ae0f3e3ee0c3 req-95b6044e-d7b6-404e-88a5-4fb4de7eaaea service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:00.194925 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-759e8589-93d5-4209-be76-ae0f3e3ee0c3 req-95b6044e-d7b6-404e-88a5-4fb4de7eaaea service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:00.195420 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-759e8589-93d5-4209-be76-ae0f3e3ee0c3 req-95b6044e-d7b6-404e-88a5-4fb4de7eaaea service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:00.238835 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-759e8589-93d5-4209-be76-ae0f3e3ee0c3 req-95b6044e-d7b6-404e-88a5-4fb4de7eaaea service nova] Creating event network-vif-deleted:daf7da51-0b0e-451f-8b3d-8f82f9a71263 for instance 14fcf77a-99ed-4d7b-889a-19da49d9e4b4 on n-h1-862686-1 Oct 26 13:12:00.246416 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-759e8589-93d5-4209-be76-ae0f3e3ee0c3 req-95b6044e-d7b6-404e-88a5-4fb4de7eaaea service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076430 Oct 26 13:12:00.247574 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1142/2379] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:12:00.253506 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-ad58c463-b712-4362-9889-1f3324a8c8eb req-50f35b57-94ea-4c57-a2d9-859ef443f94c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15a4a122-43f2-46c7-9168-722de25598c4", "tag": "7ab26fa1-9fdc-446d-9a28-e6555fbad93b"}, {"name": "network-changed", "server_uuid": "6555760c-8bf4-467e-80cb-cdf6eee4b93c", "tag": "16bdf5c3-e3cb-4e23-93c3-2342697bd561"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:12:00.265416 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ad58c463-b712-4362-9889-1f3324a8c8eb req-50f35b57-94ea-4c57-a2d9-859ef443f94c service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:00.266289 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ad58c463-b712-4362-9889-1f3324a8c8eb req-50f35b57-94ea-4c57-a2d9-859ef443f94c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:00.266929 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ad58c463-b712-4362-9889-1f3324a8c8eb req-50f35b57-94ea-4c57-a2d9-859ef443f94c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:00.285151 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-ad58c463-b712-4362-9889-1f3324a8c8eb req-50f35b57-94ea-4c57-a2d9-859ef443f94c service nova] Creating event network-changed:7ab26fa1-9fdc-446d-9a28-e6555fbad93b for instance 15a4a122-43f2-46c7-9168-722de25598c4 on n-h2-862686-1 Oct 26 13:12:00.285963 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-ad58c463-b712-4362-9889-1f3324a8c8eb req-50f35b57-94ea-4c57-a2d9-859ef443f94c service nova] Creating event network-changed:16bdf5c3-e3cb-4e23-93c3-2342697bd561 for instance 6555760c-8bf4-467e-80cb-cdf6eee4b93c on n-h1-862686-1 Oct 26 13:12:00.296345 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-ad58c463-b712-4362-9889-1f3324a8c8eb req-50f35b57-94ea-4c57-a2d9-859ef443f94c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.047173 Oct 26 13:12:00.297629 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1143/2380] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:12:00.305784 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c2ab9168-d208-4cbd-86f0-f6125c720e0f tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:00.306347 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c2ab9168-d208-4cbd-86f0-f6125c720e0f tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] [instance: 8768fa8b-3989-4c11-a1cf-7841cf7e5c8d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:00.313249 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c2ab9168-d208-4cbd-86f0-f6125c720e0f tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:00.314366 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c2ab9168-d208-4cbd-86f0-f6125c720e0f tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:00.315272 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c2ab9168-d208-4cbd-86f0-f6125c720e0f tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:00.316189 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c2ab9168-d208-4cbd-86f0-f6125c720e0f tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:00.317197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c2ab9168-d208-4cbd-86f0-f6125c720e0f tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:00.317811 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c2ab9168-d208-4cbd-86f0-f6125c720e0f tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:00.874585 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c2ab9168-d208-4cbd-86f0-f6125c720e0f tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3574f016449d43e7baf97212ed731304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9729793794fdca01a8e15bed9f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:00.888296 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c2ab9168-d208-4cbd-86f0-f6125c720e0f tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] 10.222.0.40 "GET /compute/v2.1/servers/8768fa8b-3989-4c11-a1cf-7841cf7e5c8d" status: 200 len: 1520 microversion: 2.1 time: 0.587923 Oct 26 13:12:00.888661 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1144/2381] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:00 2022] GET /compute/v2.1/servers/8768fa8b-3989-4c11-a1cf-7841cf7e5c8d => generated 1520 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:00.897067 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-03335323-eaeb-4db8-8952-75941ac92cac tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:00.898488 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-03335323-eaeb-4db8-8952-75941ac92cac tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: cd344db8-1e3a-498b-a4b4-54b0547fc063] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:00.907218 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03335323-eaeb-4db8-8952-75941ac92cac tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:00.909147 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03335323-eaeb-4db8-8952-75941ac92cac tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:00.909619 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03335323-eaeb-4db8-8952-75941ac92cac tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:00.910378 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03335323-eaeb-4db8-8952-75941ac92cac tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:00.910861 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03335323-eaeb-4db8-8952-75941ac92cac tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:00.911284 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03335323-eaeb-4db8-8952-75941ac92cac tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:01.419902 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-03335323-eaeb-4db8-8952-75941ac92cac tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:01.434757 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-03335323-eaeb-4db8-8952-75941ac92cac tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063" status: 200 len: 1334 microversion: 2.1 time: 0.544871 Oct 26 13:12:01.441674 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1145/2382] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:00 2022] GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063 => generated 1334 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:01.453455 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-37a4da41-6bf1-4f00-b5a4-1d0ceb1098ef tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:01.456550 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-37a4da41-6bf1-4f00-b5a4-1d0ceb1098ef tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 15a4a122-43f2-46c7-9168-722de25598c4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:01.474919 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37a4da41-6bf1-4f00-b5a4-1d0ceb1098ef tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:01.476320 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37a4da41-6bf1-4f00-b5a4-1d0ceb1098ef tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:01.476973 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37a4da41-6bf1-4f00-b5a4-1d0ceb1098ef tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:01.478269 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37a4da41-6bf1-4f00-b5a4-1d0ceb1098ef tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:01.478941 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37a4da41-6bf1-4f00-b5a4-1d0ceb1098ef tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:01.479575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37a4da41-6bf1-4f00-b5a4-1d0ceb1098ef tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:01.528829 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:12:01.670458 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:12:01.947930 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-37a4da41-6bf1-4f00-b5a4-1d0ceb1098ef tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:01.965888 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-37a4da41-6bf1-4f00-b5a4-1d0ceb1098ef tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/15a4a122-43f2-46c7-9168-722de25598c4" status: 200 len: 1307 microversion: 2.1 time: 0.522335 Oct 26 13:12:01.977568 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1146/2383] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:01 2022] GET /compute/v2.1/servers/15a4a122-43f2-46c7-9168-722de25598c4 => generated 1307 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:01.992702 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-054b7e84-69ed-4d16-ab98-77e13c6f06a6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:01.993575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-054b7e84-69ed-4d16-ab98-77e13c6f06a6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: f5da8a46-9260-405b-aa4e-1f1a585302bb] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:01.999876 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-054b7e84-69ed-4d16-ab98-77e13c6f06a6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:02.000559 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-054b7e84-69ed-4d16-ab98-77e13c6f06a6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:02.001181 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-054b7e84-69ed-4d16-ab98-77e13c6f06a6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:02.002286 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-054b7e84-69ed-4d16-ab98-77e13c6f06a6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:02.002960 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-054b7e84-69ed-4d16-ab98-77e13c6f06a6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:02.003538 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-054b7e84-69ed-4d16-ab98-77e13c6f06a6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:02.419857 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-054b7e84-69ed-4d16-ab98-77e13c6f06a6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:02.432534 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-054b7e84-69ed-4d16-ab98-77e13c6f06a6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb" status: 200 len: 1311 microversion: 2.1 time: 0.453523 Oct 26 13:12:02.451420 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1147/2384] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:01 2022] GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb => generated 1311 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:02.456730 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e135a0fa-fc5f-4f37-9096-e84d9d6f78b6 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:02.472569 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e135a0fa-fc5f-4f37-9096-e84d9d6f78b6 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] [instance: 8768fa8b-3989-4c11-a1cf-7841cf7e5c8d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:02.485081 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e135a0fa-fc5f-4f37-9096-e84d9d6f78b6 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:02.486635 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e135a0fa-fc5f-4f37-9096-e84d9d6f78b6 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:02.487421 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e135a0fa-fc5f-4f37-9096-e84d9d6f78b6 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:02.488381 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e135a0fa-fc5f-4f37-9096-e84d9d6f78b6 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:02.489056 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e135a0fa-fc5f-4f37-9096-e84d9d6f78b6 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:02.489722 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e135a0fa-fc5f-4f37-9096-e84d9d6f78b6 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:02.650132 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e135a0fa-fc5f-4f37-9096-e84d9d6f78b6 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3574f016449d43e7baf97212ed731304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9729793794fdca01a8e15bed9f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:02.667874 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e135a0fa-fc5f-4f37-9096-e84d9d6f78b6 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] 10.222.0.40 "GET /compute/v2.1/servers/8768fa8b-3989-4c11-a1cf-7841cf7e5c8d" status: 200 len: 1478 microversion: 2.1 time: 0.214196 Oct 26 13:12:02.671748 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1148/2385] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:02 2022] GET /compute/v2.1/servers/8768fa8b-3989-4c11-a1cf-7841cf7e5c8d => generated 1478 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:02.682468 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-28196b89-9150-495f-9310-41232e390523 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:02.685023 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-28196b89-9150-495f-9310-41232e390523 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: cd344db8-1e3a-498b-a4b4-54b0547fc063] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:02.702977 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-28196b89-9150-495f-9310-41232e390523 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:02.714092 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-28196b89-9150-495f-9310-41232e390523 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:02.715968 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-28196b89-9150-495f-9310-41232e390523 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:02.717747 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-28196b89-9150-495f-9310-41232e390523 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:02.718557 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-28196b89-9150-495f-9310-41232e390523 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:02.720750 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-28196b89-9150-495f-9310-41232e390523 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:03.101953 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-28196b89-9150-495f-9310-41232e390523 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:03.118630 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-28196b89-9150-495f-9310-41232e390523 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063" status: 200 len: 1334 microversion: 2.1 time: 0.444942 Oct 26 13:12:03.119270 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1149/2386] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:02 2022] GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063 => generated 1334 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:03.124173 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-6839efdc-0ba1-4a5a-9809-9aae962836a4 req-995ff6b5-3f2d-4b7b-8c01-18847b9d5217 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8768fa8b-3989-4c11-a1cf-7841cf7e5c8d", "name": "network-vif-deleted", "tag": "c9389f47-0bb7-4ab3-99a5-538c3c3b76c9"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:12:03.141607 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-731ceebe-8e4e-4e45-9ddb-71ab1eadd88d tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.146914 Oct 26 13:12:03.143334 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-6839efdc-0ba1-4a5a-9809-9aae962836a4 req-995ff6b5-3f2d-4b7b-8c01-18847b9d5217 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:03.143814 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-6839efdc-0ba1-4a5a-9809-9aae962836a4 req-995ff6b5-3f2d-4b7b-8c01-18847b9d5217 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:03.144161 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1238/2387] 10.222.0.40 () {60 vars in 1170 bytes} [Wed Oct 26 13:11:58 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:12:03.150936 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-6839efdc-0ba1-4a5a-9809-9aae962836a4 req-995ff6b5-3f2d-4b7b-8c01-18847b9d5217 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:03.172771 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-6839efdc-0ba1-4a5a-9809-9aae962836a4 req-995ff6b5-3f2d-4b7b-8c01-18847b9d5217 service nova] Creating event network-vif-deleted:c9389f47-0bb7-4ab3-99a5-538c3c3b76c9 for instance 8768fa8b-3989-4c11-a1cf-7841cf7e5c8d on n-h2-862686-1 Oct 26 13:12:03.184843 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-6839efdc-0ba1-4a5a-9809-9aae962836a4 req-995ff6b5-3f2d-4b7b-8c01-18847b9d5217 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057037 Oct 26 13:12:03.186413 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1150/2388] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:12:03.202728 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0992232f-ee4f-49d2-ae0e-19207d9ea4d6 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:03.205571 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0992232f-ee4f-49d2-ae0e-19207d9ea4d6 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 15a4a122-43f2-46c7-9168-722de25598c4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:03.212670 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9a93f46a-a36b-46a6-966e-ec8042d6e6d5 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Action: 'create', calling method: .version_select at 0x7f6731fb5550>, body: {"keypair": {"name": "tempest-keypair-1448237638", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeZYZQgKQtclIFpBXUQRlEm0QC7R4E0hxz96nqdRszv9/Z+HOo2jqPSyPON4Lihe+zwCi/P9yrVeYvnLTPOEG4YXCCj6idTRViGogmsoIaxRqKse3a5HreiBf6bqX1/8w=="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:12:03.223426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0992232f-ee4f-49d2-ae0e-19207d9ea4d6 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:03.230976 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0992232f-ee4f-49d2-ae0e-19207d9ea4d6 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:03.231451 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0992232f-ee4f-49d2-ae0e-19207d9ea4d6 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:03.232214 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0992232f-ee4f-49d2-ae0e-19207d9ea4d6 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:03.234516 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0992232f-ee4f-49d2-ae0e-19207d9ea4d6 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:03.235143 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0992232f-ee4f-49d2-ae0e-19207d9ea4d6 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:03.246561 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-9a93f46a-a36b-46a6-966e-ec8042d6e6d5 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Getting quotas for project fd40483e170343f5a02795c16d063066. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:12:03.255358 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-9a93f46a-a36b-46a6-966e-ec8042d6e6d5 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Getting quotas for user ea62f9a8c1094cf6810848551cd4fd18 and project fd40483e170343f5a02795c16d063066. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:12:03.288178 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9a93f46a-a36b-46a6-966e-ec8042d6e6d5 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.142472 Oct 26 13:12:03.296561 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1239/2389] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 13:12:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:12:03.308685 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-71c67dbf-8263-4452-a336-0a1d72ec03ca req-f35c8996-fa61-4695-8563-f79ebb15cd25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5da8a46-9260-405b-aa4e-1f1a585302bb", "tag": "87173235-cfd2-4c33-ace5-d5e636ff43f4"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:12:03.343122 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-71c67dbf-8263-4452-a336-0a1d72ec03ca req-f35c8996-fa61-4695-8563-f79ebb15cd25 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:03.350214 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-71c67dbf-8263-4452-a336-0a1d72ec03ca req-f35c8996-fa61-4695-8563-f79ebb15cd25 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:03.351058 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-71c67dbf-8263-4452-a336-0a1d72ec03ca req-f35c8996-fa61-4695-8563-f79ebb15cd25 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:03.365029 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-71c67dbf-8263-4452-a336-0a1d72ec03ca req-f35c8996-fa61-4695-8563-f79ebb15cd25 service nova] Creating event network-changed:87173235-cfd2-4c33-ace5-d5e636ff43f4 for instance f5da8a46-9260-405b-aa4e-1f1a585302bb on n-h1-862686-1 Oct 26 13:12:03.387035 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-71c67dbf-8263-4452-a336-0a1d72ec03ca req-f35c8996-fa61-4695-8563-f79ebb15cd25 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087012 Oct 26 13:12:03.389023 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1240/2390] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:12:03.397258 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-88f1f42d-b92b-4182-8d1b-80d04b8bc9fc tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.46"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:12:03.401318 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-88f1f42d-b92b-4182-8d1b-80d04b8bc9fc tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] [instance: 6555760c-8bf4-467e-80cb-cdf6eee4b93c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:03.411516 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88f1f42d-b92b-4182-8d1b-80d04b8bc9fc tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:03.412446 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88f1f42d-b92b-4182-8d1b-80d04b8bc9fc tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:03.413284 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88f1f42d-b92b-4182-8d1b-80d04b8bc9fc tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:03.414314 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88f1f42d-b92b-4182-8d1b-80d04b8bc9fc tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:03.414956 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88f1f42d-b92b-4182-8d1b-80d04b8bc9fc tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:03.415420 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88f1f42d-b92b-4182-8d1b-80d04b8bc9fc tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:03.454167 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88f1f42d-b92b-4182-8d1b-80d04b8bc9fc tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "refresh_cache-6555760c-8bf4-467e-80cb-cdf6eee4b93c" {{(pid=120598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 26 13:12:03.455205 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88f1f42d-b92b-4182-8d1b-80d04b8bc9fc tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquired lock "refresh_cache-6555760c-8bf4-467e-80cb-cdf6eee4b93c" {{(pid=120598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 26 13:12:03.662030 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0992232f-ee4f-49d2-ae0e-19207d9ea4d6 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:03.677000 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0992232f-ee4f-49d2-ae0e-19207d9ea4d6 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/15a4a122-43f2-46c7-9168-722de25598c4" status: 200 len: 1307 microversion: 2.1 time: 0.486279 Oct 26 13:12:03.678629 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1151/2391] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:03 2022] GET /compute/v2.1/servers/15a4a122-43f2-46c7-9168-722de25598c4 => generated 1307 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:03.697327 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bcc142e5-397d-4159-88c4-cab0571e6225 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:03.698676 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bcc142e5-397d-4159-88c4-cab0571e6225 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: f5da8a46-9260-405b-aa4e-1f1a585302bb] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:03.708132 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bcc142e5-397d-4159-88c4-cab0571e6225 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:03.709056 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bcc142e5-397d-4159-88c4-cab0571e6225 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:03.710427 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bcc142e5-397d-4159-88c4-cab0571e6225 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:03.711634 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bcc142e5-397d-4159-88c4-cab0571e6225 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:03.712367 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bcc142e5-397d-4159-88c4-cab0571e6225 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:03.713122 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bcc142e5-397d-4159-88c4-cab0571e6225 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:04.287685 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=4 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:12:04.341951 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bcc142e5-397d-4159-88c4-cab0571e6225 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:04.356370 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bcc142e5-397d-4159-88c4-cab0571e6225 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb" status: 200 len: 1311 microversion: 2.1 time: 0.676173 Oct 26 13:12:04.358251 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1152/2392] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:03 2022] GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb => generated 1311 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:04.367427 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-92c6d693-65a9-4c46-b052-480e262c3d0b tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:04.368438 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-92c6d693-65a9-4c46-b052-480e262c3d0b tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] [instance: 8768fa8b-3989-4c11-a1cf-7841cf7e5c8d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:04.379873 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-92c6d693-65a9-4c46-b052-480e262c3d0b tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:04.381203 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-92c6d693-65a9-4c46-b052-480e262c3d0b tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:04.381977 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-92c6d693-65a9-4c46-b052-480e262c3d0b tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:04.383983 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-92c6d693-65a9-4c46-b052-480e262c3d0b tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:04.385048 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-92c6d693-65a9-4c46-b052-480e262c3d0b tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:04.387419 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-92c6d693-65a9-4c46-b052-480e262c3d0b tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:04.419095 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-92c6d693-65a9-4c46-b052-480e262c3d0b tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] HTTP exception thrown: Instance 8768fa8b-3989-4c11-a1cf-7841cf7e5c8d could not be found. Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-92c6d693-65a9-4c46-b052-480e262c3d0b tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Request method failure captured: Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/8768fa8b-3989-4c11-a1cf-7841cf7e5c8d HTTP/1.1 Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTH0pOdrYwU7cX_zxqqzQB7WhcpcufLLlY4QYeCwlT_hshwW2VTefrAAYgGkqycAhRBBftyc0BSZCnF8449StJMOpmfzvhUbg2_zLaAAogE4i3s9EGA2MryELylxmw8Zf2IKb1094KNvIjO0kID1MfzVGIv7hxNy9sYzIpL3gaRp-Z0 Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 37f9729793794fdca01a8e15bed9f4e9 Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ListServersNegativeTestJSON-854204148 Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/37f9729793794fdca01a8e15bed9f4e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/37f9729793794fdca01a8e15bed9f4e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_37f9729793794fdca01a8e15bed9f4e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/37f9729793794fdca01a8e15bed9f4e9"}]}] Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ListServersNegativeTestJSON-854204148 Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 37f9729793794fdca01a8e15bed9f4e9 Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-854204148 Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ListServersNegativeTestJSON-854204148-project Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 3574f016449d43e7baf97212ed731304 Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ListServersNegativeTestJSON-854204148-project Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 8768fa8b-3989-4c11-a1cf-7841cf7e5c8d could not be found. Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '8768fa8b-3989-4c11-a1cf-7841cf7e5c8d'} Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8768fa8b-3989-4c11-a1cf-7841cf7e5c8d could not be found. Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8768fa8b-3989-4c11-a1cf-7841cf7e5c8d could not be found. Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:04.421677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:04.426100 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:04.426100 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:04.426100 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:04.426100 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:04.426100 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:12:04.426100 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:12:04.426100 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8768fa8b-3989-4c11-a1cf-7841cf7e5c8d could not be found. Oct 26 13:12:04.426100 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:04.442611 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-92c6d693-65a9-4c46-b052-480e262c3d0b tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Returning 404 to user: Instance 8768fa8b-3989-4c11-a1cf-7841cf7e5c8d could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:12:04.444259 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-92c6d693-65a9-4c46-b052-480e262c3d0b tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] 10.222.0.40 "GET /compute/v2.1/servers/8768fa8b-3989-4c11-a1cf-7841cf7e5c8d" status: 404 len: 111 microversion: 2.1 time: 0.084690 Oct 26 13:12:04.446075 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1153/2393] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:04 2022] GET /compute/v2.1/servers/8768fa8b-3989-4c11-a1cf-7841cf7e5c8d => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:12:04.452604 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7bc061ef-f3d3-4111-9a34-491f0e8258ff tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:04.453560 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7bc061ef-f3d3-4111-9a34-491f0e8258ff tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: cd344db8-1e3a-498b-a4b4-54b0547fc063] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:04.469460 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7bc061ef-f3d3-4111-9a34-491f0e8258ff tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:04.471238 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7bc061ef-f3d3-4111-9a34-491f0e8258ff tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:04.482170 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7bc061ef-f3d3-4111-9a34-491f0e8258ff tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:04.487479 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7bc061ef-f3d3-4111-9a34-491f0e8258ff tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:04.488286 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7bc061ef-f3d3-4111-9a34-491f0e8258ff tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:04.489331 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7bc061ef-f3d3-4111-9a34-491f0e8258ff tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:04.777442 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7bc061ef-f3d3-4111-9a34-491f0e8258ff tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:04.788153 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7bc061ef-f3d3-4111-9a34-491f0e8258ff tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063" status: 200 len: 1334 microversion: 2.1 time: 0.340795 Oct 26 13:12:04.802902 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1154/2394] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:04 2022] GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063 => generated 1334 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:04.814928 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ad4eeb08-24c1-490f-9633-b112f9b5b1de tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:04.820212 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ad4eeb08-24c1-490f-9633-b112f9b5b1de tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3574f016449d43e7baf97212ed731304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9729793794fdca01a8e15bed9f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:04.821116 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ad4eeb08-24c1-490f-9633-b112f9b5b1de tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '37f9729793794fdca01a8e15bed9f4e9'} {{(pid=120597) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:12:04.835903 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:12:04.839126 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad4eeb08-24c1-490f-9633-b112f9b5b1de tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:04.839757 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad4eeb08-24c1-490f-9633-b112f9b5b1de tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:04.840206 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad4eeb08-24c1-490f-9633-b112f9b5b1de tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:04.840947 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad4eeb08-24c1-490f-9633-b112f9b5b1de tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:04.841408 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad4eeb08-24c1-490f-9633-b112f9b5b1de tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:04.841866 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad4eeb08-24c1-490f-9633-b112f9b5b1de tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:04.973900 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ad4eeb08-24c1-490f-9633-b112f9b5b1de tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] 10.222.0.40 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.169171 Oct 26 13:12:04.982186 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1155/2395] 10.222.0.40 () {58 vars in 1230 bytes} [Wed Oct 26 13:12:04 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:12:04.987738 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-20b9a08a-2f57-4f7c-9802-a113edfff9d0 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:04.988385 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-20b9a08a-2f57-4f7c-9802-a113edfff9d0 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 15a4a122-43f2-46c7-9168-722de25598c4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:04.996226 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20b9a08a-2f57-4f7c-9802-a113edfff9d0 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:04.996690 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20b9a08a-2f57-4f7c-9802-a113edfff9d0 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:04.997328 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20b9a08a-2f57-4f7c-9802-a113edfff9d0 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:05.008107 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20b9a08a-2f57-4f7c-9802-a113edfff9d0 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:05.008620 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20b9a08a-2f57-4f7c-9802-a113edfff9d0 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:05.009081 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20b9a08a-2f57-4f7c-9802-a113edfff9d0 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:05.615029 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-20b9a08a-2f57-4f7c-9802-a113edfff9d0 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:05.626070 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-20b9a08a-2f57-4f7c-9802-a113edfff9d0 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/15a4a122-43f2-46c7-9168-722de25598c4" status: 200 len: 1307 microversion: 2.1 time: 0.642591 Oct 26 13:12:05.628311 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1156/2396] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:04 2022] GET /compute/v2.1/servers/15a4a122-43f2-46c7-9168-722de25598c4 => generated 1307 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:05.638805 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e508ce6e-955e-48f8-890b-6f51b7d8132c tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e508ce6e-955e-48f8-890b-6f51b7d8132c tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Request method failure captured: Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTH0pOdrYwU7cX_zxqqzQB7WhcpcufLLlY4QYeCwlT_hshwW2VTefrAAYgGkqycAhRBBftyc0BSZCnF8449StJMOpmfzvhUbg2_zLaAAogE4i3s9EGA2MryELylxmw8Zf2IKb1094KNvIjO0kID1MfzVGIv7hxNy9sYzIpL3gaRp-Z0 Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 37f9729793794fdca01a8e15bed9f4e9 Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ListServersNegativeTestJSON-854204148 Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/37f9729793794fdca01a8e15bed9f4e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/37f9729793794fdca01a8e15bed9f4e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_37f9729793794fdca01a8e15bed9f4e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/37f9729793794fdca01a8e15bed9f4e9"}]}] Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ListServersNegativeTestJSON-854204148 Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 37f9729793794fdca01a8e15bed9f4e9 Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-854204148 Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ListServersNegativeTestJSON-854204148-project Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 3574f016449d43e7baf97212ed731304 Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ListServersNegativeTestJSON-854204148-project Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: action_args: {} Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise error Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 26 13:12:05.648242 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 13:12:05.652680 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 13:12:05.652680 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 13:12:05.652680 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 13:12:05.652680 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 26 13:12:05.652680 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:05.652680 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:05.652680 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:05.652680 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:05.652680 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:05.652680 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:05.652680 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 13:12:05.652680 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 13:12:05.652680 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 26 13:12:05.652680 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:05.654327 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e508ce6e-955e-48f8-890b-6f51b7d8132c tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:12:05.655337 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e508ce6e-955e-48f8-890b-6f51b7d8132c tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] 10.222.0.40 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.025920 Oct 26 13:12:05.662323 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1157/2397] 10.222.0.40 () {58 vars in 1182 bytes} [Wed Oct 26 13:12:05 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:12:05.674707 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2b039333-7b05-4bc0-ab6c-f729b57dbcae tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:05.675326 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2b039333-7b05-4bc0-ab6c-f729b57dbcae tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: f5da8a46-9260-405b-aa4e-1f1a585302bb] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:05.705040 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b039333-7b05-4bc0-ab6c-f729b57dbcae tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:05.705676 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b039333-7b05-4bc0-ab6c-f729b57dbcae tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:05.706307 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b039333-7b05-4bc0-ab6c-f729b57dbcae tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:05.707033 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b039333-7b05-4bc0-ab6c-f729b57dbcae tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:05.707496 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b039333-7b05-4bc0-ab6c-f729b57dbcae tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:05.711076 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b039333-7b05-4bc0-ab6c-f729b57dbcae tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:05.985076 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-88f1f42d-b92b-4182-8d1b-80d04b8bc9fc tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] [instance: 6555760c-8bf4-467e-80cb-cdf6eee4b93c] Building network info cache for instance {{(pid=120598) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 26 13:12:06.203449 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2b039333-7b05-4bc0-ab6c-f729b57dbcae tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:06.217945 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2b039333-7b05-4bc0-ab6c-f729b57dbcae tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb" status: 200 len: 1311 microversion: 2.1 time: 0.555281 Oct 26 13:12:06.222641 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1158/2398] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:05 2022] GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb => generated 1311 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:06.231635 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1d258a4a-aea2-47c1-a488-370cdb167098 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:06.251234 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1d258a4a-aea2-47c1-a488-370cdb167098 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3574f016449d43e7baf97212ed731304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9729793794fdca01a8e15bed9f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:06.252371 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1d258a4a-aea2-47c1-a488-370cdb167098 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Searching by: {'deleted': False, 'project_id': '37f9729793794fdca01a8e15bed9f4e9'} {{(pid=120597) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:12:06.263167 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d258a4a-aea2-47c1-a488-370cdb167098 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:06.264831 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d258a4a-aea2-47c1-a488-370cdb167098 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:06.265992 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d258a4a-aea2-47c1-a488-370cdb167098 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:06.268939 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d258a4a-aea2-47c1-a488-370cdb167098 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:06.270492 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d258a4a-aea2-47c1-a488-370cdb167098 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:06.271081 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d258a4a-aea2-47c1-a488-370cdb167098 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:06.321098 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.multi_cell_list [None req-1d258a4a-aea2-47c1-a488-370cdb167098 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120597) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 13:12:06.394379 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1d258a4a-aea2-47c1-a488-370cdb167098 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.167137 Oct 26 13:12:06.405714 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1159/2399] 10.222.0.40 () {58 vars in 1125 bytes} [Wed Oct 26 13:12:06 2022] GET /compute/v2.1/servers => generated 681 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:12:06.415518 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7c63f6f8-f660-4d24-b8e1-b7b3e3aeb432 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:06.418358 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7c63f6f8-f660-4d24-b8e1-b7b3e3aeb432 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: cd344db8-1e3a-498b-a4b4-54b0547fc063] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:06.429451 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7c63f6f8-f660-4d24-b8e1-b7b3e3aeb432 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:06.430462 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7c63f6f8-f660-4d24-b8e1-b7b3e3aeb432 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:06.431338 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7c63f6f8-f660-4d24-b8e1-b7b3e3aeb432 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:06.432197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7c63f6f8-f660-4d24-b8e1-b7b3e3aeb432 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:06.432797 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7c63f6f8-f660-4d24-b8e1-b7b3e3aeb432 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:06.433374 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7c63f6f8-f660-4d24-b8e1-b7b3e3aeb432 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:07.068419 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-88f1f42d-b92b-4182-8d1b-80d04b8bc9fc tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] [instance: 6555760c-8bf4-467e-80cb-cdf6eee4b93c] Updating instance_info_cache with network_info: [{"id": "16bdf5c3-e3cb-4e23-93c3-2342697bd561", "address": "fa:16:3e:81:a3:42", "network": {"id": "4a773957-72d6-4c1e-ba7d-408dfcfd6ae3", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-190236763-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5902169366b646c7be94cb3521377225", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap16bdf5c3-e3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120598) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 26 13:12:07.098237 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88f1f42d-b92b-4182-8d1b-80d04b8bc9fc tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Releasing lock "refresh_cache-6555760c-8bf4-467e-80cb-cdf6eee4b93c" {{(pid=120598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 26 13:12:07.099298 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-88f1f42d-b92b-4182-8d1b-80d04b8bc9fc tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] 10.222.0.40 "POST /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c/action" status: 202 len: 0 microversion: 2.1 time: 3.708752 Oct 26 13:12:07.099932 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1241/2400] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:12:03 2022] POST /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c/action => generated 0 bytes in 3710 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 26 13:12:07.134332 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-d1bae2e6-62c8-4875-af0f-2d896fb44128 req-74867c79-d0c2-44f1-870f-ff168a6d90df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6555760c-8bf4-467e-80cb-cdf6eee4b93c", "tag": "16bdf5c3-e3cb-4e23-93c3-2342697bd561"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:12:07.185897 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-d1bae2e6-62c8-4875-af0f-2d896fb44128 req-74867c79-d0c2-44f1-870f-ff168a6d90df service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:07.192288 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-d1bae2e6-62c8-4875-af0f-2d896fb44128 req-74867c79-d0c2-44f1-870f-ff168a6d90df service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:07.193373 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-d1bae2e6-62c8-4875-af0f-2d896fb44128 req-74867c79-d0c2-44f1-870f-ff168a6d90df service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:07.196951 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7c63f6f8-f660-4d24-b8e1-b7b3e3aeb432 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:07.209233 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7c63f6f8-f660-4d24-b8e1-b7b3e3aeb432 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063" status: 200 len: 1334 microversion: 2.1 time: 0.802286 Oct 26 13:12:07.212930 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1160/2401] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:06 2022] GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063 => generated 1334 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:07.218223 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-cf249cd8-3ae1-4bf1-9641-5759cac0472b req-383f5c7b-477d-4e0e-b572-e6928d453adc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd344db8-1e3a-498b-a4b4-54b0547fc063", "name": "network-vif-plugged", "status": "completed", "tag": "10871312-274d-4b5f-8a2c-029559f9cb48"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:12:07.224629 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-d1bae2e6-62c8-4875-af0f-2d896fb44128 req-74867c79-d0c2-44f1-870f-ff168a6d90df service nova] Creating event network-changed:16bdf5c3-e3cb-4e23-93c3-2342697bd561 for instance 6555760c-8bf4-467e-80cb-cdf6eee4b93c on n-h1-862686-1 Oct 26 13:12:07.231859 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-d1bae2e6-62c8-4875-af0f-2d896fb44128 req-74867c79-d0c2-44f1-870f-ff168a6d90df service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129233 Oct 26 13:12:07.237204 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1242/2402] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:12:07.246032 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-cf249cd8-3ae1-4bf1-9641-5759cac0472b req-383f5c7b-477d-4e0e-b572-e6928d453adc service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:07.246534 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-cf249cd8-3ae1-4bf1-9641-5759cac0472b req-383f5c7b-477d-4e0e-b572-e6928d453adc service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:07.246967 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-cf249cd8-3ae1-4bf1-9641-5759cac0472b req-383f5c7b-477d-4e0e-b572-e6928d453adc service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:07.259106 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7e30be22-2730-4b8b-8b2b-e47845b413b1 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:07.271269 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7e30be22-2730-4b8b-8b2b-e47845b413b1 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3574f016449d43e7baf97212ed731304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9729793794fdca01a8e15bed9f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:07.271727 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.compute.servers [None req-7e30be22-2730-4b8b-8b2b-e47845b413b1 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Removing options 'limit' from query {{(pid=120598) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 26 13:12:07.278294 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7e30be22-2730-4b8b-8b2b-e47845b413b1 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Searching by: {'deleted': False, 'project_id': '37f9729793794fdca01a8e15bed9f4e9'} {{(pid=120598) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:12:07.280894 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-cf249cd8-3ae1-4bf1-9641-5759cac0472b req-383f5c7b-477d-4e0e-b572-e6928d453adc service nova] Creating event network-vif-plugged:10871312-274d-4b5f-8a2c-029559f9cb48 for instance cd344db8-1e3a-498b-a4b4-54b0547fc063 on n-h1-862686-1 Oct 26 13:12:07.289378 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e30be22-2730-4b8b-8b2b-e47845b413b1 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:07.290236 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-cf249cd8-3ae1-4bf1-9641-5759cac0472b req-383f5c7b-477d-4e0e-b572-e6928d453adc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075850 Oct 26 13:12:07.296189 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e30be22-2730-4b8b-8b2b-e47845b413b1 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:07.296189 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e30be22-2730-4b8b-8b2b-e47845b413b1 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:07.296189 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e30be22-2730-4b8b-8b2b-e47845b413b1 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:07.296189 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e30be22-2730-4b8b-8b2b-e47845b413b1 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:07.298576 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e30be22-2730-4b8b-8b2b-e47845b413b1 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:07.305999 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1161/2403] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:12:07.316454 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-688dd353-27bf-4ee4-a322-d77f99e18726 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:07.317098 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-688dd353-27bf-4ee4-a322-d77f99e18726 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 15a4a122-43f2-46c7-9168-722de25598c4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:07.339298 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-688dd353-27bf-4ee4-a322-d77f99e18726 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:07.339794 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-688dd353-27bf-4ee4-a322-d77f99e18726 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:07.340235 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-688dd353-27bf-4ee4-a322-d77f99e18726 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:07.340956 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-688dd353-27bf-4ee4-a322-d77f99e18726 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:07.341414 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-688dd353-27bf-4ee4-a322-d77f99e18726 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:07.341870 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-688dd353-27bf-4ee4-a322-d77f99e18726 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:07.369472 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.multi_cell_list [None req-7e30be22-2730-4b8b-8b2b-e47845b413b1 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=120598) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 13:12:07.503788 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7e30be22-2730-4b8b-8b2b-e47845b413b1 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] 10.222.0.40 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.264977 Oct 26 13:12:07.504600 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1243/2404] 10.222.0.40 () {58 vars in 1144 bytes} [Wed Oct 26 13:12:07 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:12:07.514293 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a4497720-9760-41d2-96a3-a3976b016bc3 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.46"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:12:07.726642 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-688dd353-27bf-4ee4-a322-d77f99e18726 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:07.739030 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-688dd353-27bf-4ee4-a322-d77f99e18726 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/15a4a122-43f2-46c7-9168-722de25598c4" status: 200 len: 1307 microversion: 2.1 time: 0.431166 Oct 26 13:12:07.758153 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1162/2405] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:07 2022] GET /compute/v2.1/servers/15a4a122-43f2-46c7-9168-722de25598c4 => generated 1307 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:07.764562 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0fbe40de-0b18-4fbc-8fd8-c69522fabca2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:07.776617 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0fbe40de-0b18-4fbc-8fd8-c69522fabca2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: f5da8a46-9260-405b-aa4e-1f1a585302bb] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:07.784802 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0fbe40de-0b18-4fbc-8fd8-c69522fabca2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:07.785302 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0fbe40de-0b18-4fbc-8fd8-c69522fabca2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:07.785761 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0fbe40de-0b18-4fbc-8fd8-c69522fabca2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:07.786795 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0fbe40de-0b18-4fbc-8fd8-c69522fabca2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:07.787395 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0fbe40de-0b18-4fbc-8fd8-c69522fabca2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:07.787978 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0fbe40de-0b18-4fbc-8fd8-c69522fabca2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:07.995282 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0fbe40de-0b18-4fbc-8fd8-c69522fabca2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:08.010350 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0fbe40de-0b18-4fbc-8fd8-c69522fabca2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb" status: 200 len: 1311 microversion: 2.1 time: 0.247878 Oct 26 13:12:08.012723 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1163/2406] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:07 2022] GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb => generated 1311 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:08.022246 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-39be3558-0dfd-4db0-99ed-83532ebe5211 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-39be3558-0dfd-4db0-99ed-83532ebe5211 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Request method failure captured: Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTH0pOdrYwU7cX_zxqqzQB7WhcpcufLLlY4QYeCwlT_hshwW2VTefrAAYgGkqycAhRBBftyc0BSZCnF8449StJMOpmfzvhUbg2_zLaAAogE4i3s9EGA2MryELylxmw8Zf2IKb1094KNvIjO0kID1MfzVGIv7hxNy9sYzIpL3gaRp-Z0 Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 37f9729793794fdca01a8e15bed9f4e9 Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ListServersNegativeTestJSON-854204148 Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/37f9729793794fdca01a8e15bed9f4e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/37f9729793794fdca01a8e15bed9f4e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_37f9729793794fdca01a8e15bed9f4e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/37f9729793794fdca01a8e15bed9f4e9"}]}] Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ListServersNegativeTestJSON-854204148 Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 37f9729793794fdca01a8e15bed9f4e9 Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-854204148 Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ListServersNegativeTestJSON-854204148-project Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 3574f016449d43e7baf97212ed731304 Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ListServersNegativeTestJSON-854204148-project Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: action_args: {} Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise error Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi '-1' Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 26 13:12:08.028210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 26 13:12:08.031925 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 13:12:08.031925 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 13:12:08.031925 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 13:12:08.031925 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 13:12:08.031925 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 26 13:12:08.031925 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:08.031925 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:08.031925 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:08.031925 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:08.031925 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:08.031925 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:08.031925 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 13:12:08.031925 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 13:12:08.031925 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 26 13:12:08.031925 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:08.034872 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-39be3558-0dfd-4db0-99ed-83532ebe5211 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:12:08.035924 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-39be3558-0dfd-4db0-99ed-83532ebe5211 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] 10.222.0.40 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.022091 Oct 26 13:12:08.037374 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1164/2407] 10.222.0.40 () {58 vars in 1142 bytes} [Wed Oct 26 13:12:08 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:12:08.047433 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5d7b9d59-bb86-4fe3-a266-1bebcae75d61 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5d7b9d59-bb86-4fe3-a266-1bebcae75d61 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Request method failure captured: Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTH0pOdrYwU7cX_zxqqzQB7WhcpcufLLlY4QYeCwlT_hshwW2VTefrAAYgGkqycAhRBBftyc0BSZCnF8449StJMOpmfzvhUbg2_zLaAAogE4i3s9EGA2MryELylxmw8Zf2IKb1094KNvIjO0kID1MfzVGIv7hxNy9sYzIpL3gaRp-Z0 Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 37f9729793794fdca01a8e15bed9f4e9 Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ListServersNegativeTestJSON-854204148 Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/37f9729793794fdca01a8e15bed9f4e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/37f9729793794fdca01a8e15bed9f4e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_37f9729793794fdca01a8e15bed9f4e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/37f9729793794fdca01a8e15bed9f4e9"}]}] Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ListServersNegativeTestJSON-854204148 Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 37f9729793794fdca01a8e15bed9f4e9 Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-854204148 Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ListServersNegativeTestJSON-854204148-project Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 3574f016449d43e7baf97212ed731304 Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ListServersNegativeTestJSON-854204148-project Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: action_args: {} Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise error Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi 'testing' Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 26 13:12:08.058897 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 26 13:12:08.064391 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 13:12:08.064391 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 13:12:08.064391 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 13:12:08.064391 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 13:12:08.064391 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 26 13:12:08.064391 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:08.064391 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:08.064391 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:08.064391 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:08.064391 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:08.064391 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:08.064391 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 13:12:08.064391 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 13:12:08.064391 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 26 13:12:08.064391 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:08.064391 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5d7b9d59-bb86-4fe3-a266-1bebcae75d61 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:12:08.064391 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5d7b9d59-bb86-4fe3-a266-1bebcae75d61 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] 10.222.0.40 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.018104 Oct 26 13:12:08.064391 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1165/2408] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 26 13:12:08 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 26 13:12:08.079010 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a4497720-9760-41d2-96a3-a3976b016bc3 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] [instance: 6555760c-8bf4-467e-80cb-cdf6eee4b93c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:08.083489 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-07aafb2c-4ded-488f-a254-ceb2eeede206 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:08.086304 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4497720-9760-41d2-96a3-a3976b016bc3 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:08.086948 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4497720-9760-41d2-96a3-a3976b016bc3 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:08.087537 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4497720-9760-41d2-96a3-a3976b016bc3 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:08.088389 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4497720-9760-41d2-96a3-a3976b016bc3 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:08.092164 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-07aafb2c-4ded-488f-a254-ceb2eeede206 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3574f016449d43e7baf97212ed731304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9729793794fdca01a8e15bed9f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:08.092953 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4497720-9760-41d2-96a3-a3976b016bc3 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:08.093611 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4497720-9760-41d2-96a3-a3976b016bc3 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:08.096142 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-07aafb2c-4ded-488f-a254-ceb2eeede206 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '37f9729793794fdca01a8e15bed9f4e9'} {{(pid=120597) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:12:08.103057 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.compute.servers [None req-07aafb2c-4ded-488f-a254-ceb2eeede206 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Flavor 'non_existing_flavor' could not be found {{(pid=120597) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 26 13:12:08.104356 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-07aafb2c-4ded-488f-a254-ceb2eeede206 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] 10.222.0.40 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.030020 Oct 26 13:12:08.105577 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1166/2409] 10.222.0.40 () {58 vars in 1178 bytes} [Wed Oct 26 13:12:08 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:12:08.120897 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7ce628f5-d61e-481f-bcee-5e03616f6e4d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:08.126918 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7ce628f5-d61e-481f-bcee-5e03616f6e4d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3574f016449d43e7baf97212ed731304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9729793794fdca01a8e15bed9f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:08.130047 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7ce628f5-d61e-481f-bcee-5e03616f6e4d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '37f9729793794fdca01a8e15bed9f4e9'} {{(pid=120597) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:12:08.145942 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ce628f5-d61e-481f-bcee-5e03616f6e4d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:08.146502 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ce628f5-d61e-481f-bcee-5e03616f6e4d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:08.147009 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ce628f5-d61e-481f-bcee-5e03616f6e4d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:08.147816 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ce628f5-d61e-481f-bcee-5e03616f6e4d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:08.153429 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ce628f5-d61e-481f-bcee-5e03616f6e4d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:08.153972 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ce628f5-d61e-481f-bcee-5e03616f6e4d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:08.325448 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7ce628f5-d61e-481f-bcee-5e03616f6e4d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] 10.222.0.40 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.208440 Oct 26 13:12:08.326182 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1167/2410] 10.222.0.40 () {58 vars in 1174 bytes} [Wed Oct 26 13:12:08 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:12:08.334463 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f21c4acc-140d-47b9-b3b5-db38dd1a7cc1 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:08.334463 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f21c4acc-140d-47b9-b3b5-db38dd1a7cc1 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: cd344db8-1e3a-498b-a4b4-54b0547fc063] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:08.348735 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f21c4acc-140d-47b9-b3b5-db38dd1a7cc1 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:08.349235 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f21c4acc-140d-47b9-b3b5-db38dd1a7cc1 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:08.349738 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f21c4acc-140d-47b9-b3b5-db38dd1a7cc1 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:08.350454 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f21c4acc-140d-47b9-b3b5-db38dd1a7cc1 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:08.350904 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f21c4acc-140d-47b9-b3b5-db38dd1a7cc1 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:08.351327 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f21c4acc-140d-47b9-b3b5-db38dd1a7cc1 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:08.656767 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f21c4acc-140d-47b9-b3b5-db38dd1a7cc1 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:08.665779 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f21c4acc-140d-47b9-b3b5-db38dd1a7cc1 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063" status: 200 len: 1334 microversion: 2.1 time: 0.338428 Oct 26 13:12:08.667535 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1168/2411] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:08 2022] GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063 => generated 1334 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:08.672518 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d4a1fddd-efba-4786-8b6c-43aafafec9da tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:08.681773 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d4a1fddd-efba-4786-8b6c-43aafafec9da tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3574f016449d43e7baf97212ed731304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9729793794fdca01a8e15bed9f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:08.682689 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d4a1fddd-efba-4786-8b6c-43aafafec9da tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '37f9729793794fdca01a8e15bed9f4e9'} {{(pid=120597) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:12:08.688382 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4497720-9760-41d2-96a3-a3976b016bc3 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "refresh_cache-6555760c-8bf4-467e-80cb-cdf6eee4b93c" {{(pid=120598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 26 13:12:08.690421 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4497720-9760-41d2-96a3-a3976b016bc3 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquired lock "refresh_cache-6555760c-8bf4-467e-80cb-cdf6eee4b93c" {{(pid=120598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 26 13:12:08.703939 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d4a1fddd-efba-4786-8b6c-43aafafec9da tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:08.705732 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d4a1fddd-efba-4786-8b6c-43aafafec9da tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:08.706845 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d4a1fddd-efba-4786-8b6c-43aafafec9da tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:08.713720 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d4a1fddd-efba-4786-8b6c-43aafafec9da tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:08.714951 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d4a1fddd-efba-4786-8b6c-43aafafec9da tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:08.715687 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d4a1fddd-efba-4786-8b6c-43aafafec9da tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:08.930732 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d4a1fddd-efba-4786-8b6c-43aafafec9da tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] 10.222.0.40 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.261879 Oct 26 13:12:08.936315 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1169/2412] 10.222.0.40 () {58 vars in 1184 bytes} [Wed Oct 26 13:12:08 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:12:08.941352 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5df40f9b-2c08-474f-b5c0-74c9e4f0cf84 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:08.942139 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5df40f9b-2c08-474f-b5c0-74c9e4f0cf84 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 15a4a122-43f2-46c7-9168-722de25598c4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:08.948908 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5df40f9b-2c08-474f-b5c0-74c9e4f0cf84 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:08.949648 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5df40f9b-2c08-474f-b5c0-74c9e4f0cf84 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:08.950297 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5df40f9b-2c08-474f-b5c0-74c9e4f0cf84 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:08.951216 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5df40f9b-2c08-474f-b5c0-74c9e4f0cf84 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:08.951877 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5df40f9b-2c08-474f-b5c0-74c9e4f0cf84 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:08.952526 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5df40f9b-2c08-474f-b5c0-74c9e4f0cf84 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:09.212830 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5df40f9b-2c08-474f-b5c0-74c9e4f0cf84 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:09.215574 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:12:09.230990 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5df40f9b-2c08-474f-b5c0-74c9e4f0cf84 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/15a4a122-43f2-46c7-9168-722de25598c4" status: 200 len: 1307 microversion: 2.1 time: 0.293432 Oct 26 13:12:09.231603 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1170/2413] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:08 2022] GET /compute/v2.1/servers/15a4a122-43f2-46c7-9168-722de25598c4 => generated 1307 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:09.253223 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cf3bc512-0bc1-4257-af17-0499bd636415 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:09.260836 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cf3bc512-0bc1-4257-af17-0499bd636415 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3574f016449d43e7baf97212ed731304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9729793794fdca01a8e15bed9f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:09.261985 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cf3bc512-0bc1-4257-af17-0499bd636415 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Searching by: {'deleted': False, 'project_id': '37f9729793794fdca01a8e15bed9f4e9'} {{(pid=120597) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:12:09.271986 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf3bc512-0bc1-4257-af17-0499bd636415 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:09.272724 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf3bc512-0bc1-4257-af17-0499bd636415 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:09.273376 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf3bc512-0bc1-4257-af17-0499bd636415 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:09.274423 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf3bc512-0bc1-4257-af17-0499bd636415 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:09.275118 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf3bc512-0bc1-4257-af17-0499bd636415 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:09.275755 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf3bc512-0bc1-4257-af17-0499bd636415 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:09.338780 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.multi_cell_list [None req-cf3bc512-0bc1-4257-af17-0499bd636415 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120597) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 13:12:09.455727 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cf3bc512-0bc1-4257-af17-0499bd636415 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3574f016449d43e7baf97212ed731304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9729793794fdca01a8e15bed9f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:09.479449 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf3bc512-0bc1-4257-af17-0499bd636415 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:09.480217 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf3bc512-0bc1-4257-af17-0499bd636415 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:09.480689 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf3bc512-0bc1-4257-af17-0499bd636415 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:09.746844 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cf3bc512-0bc1-4257-af17-0499bd636415 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] 10.222.0.40 "GET /compute/v2.1/servers/detail" status: 200 len: 3021 microversion: 2.1 time: 0.503791 Oct 26 13:12:09.749362 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1171/2414] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:12:09 2022] GET /compute/v2.1/servers/detail => generated 3021 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:09.759319 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-459d0587-a2e3-4263-a61b-940d5752e3fc tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:09.760204 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-459d0587-a2e3-4263-a61b-940d5752e3fc tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: f5da8a46-9260-405b-aa4e-1f1a585302bb] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:09.771831 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-459d0587-a2e3-4263-a61b-940d5752e3fc tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:09.772986 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-459d0587-a2e3-4263-a61b-940d5752e3fc tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:09.773613 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-459d0587-a2e3-4263-a61b-940d5752e3fc tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:09.774508 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-459d0587-a2e3-4263-a61b-940d5752e3fc tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:09.775629 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-459d0587-a2e3-4263-a61b-940d5752e3fc tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:09.776214 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-459d0587-a2e3-4263-a61b-940d5752e3fc tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:09.986021 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-459d0587-a2e3-4263-a61b-940d5752e3fc tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:09.997406 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-459d0587-a2e3-4263-a61b-940d5752e3fc tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb" status: 200 len: 1311 microversion: 2.1 time: 0.246396 Oct 26 13:12:09.998511 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1172/2415] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:09 2022] GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb => generated 1311 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:10.004193 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-9d4898f5-6e9d-4216-b594-84f2d7e50b14 req-fef249b3-1b38-4a9e-ab59-62d31312e3ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15a4a122-43f2-46c7-9168-722de25598c4", "name": "network-vif-plugged", "status": "completed", "tag": "7ab26fa1-9fdc-446d-9a28-e6555fbad93b"}, {"server_uuid": "cd344db8-1e3a-498b-a4b4-54b0547fc063", "name": "network-vif-plugged", "status": "completed", "tag": "4838ed53-ef5a-465a-9c02-b85243b9bc4c"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:12:10.016544 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9d4898f5-6e9d-4216-b594-84f2d7e50b14 req-fef249b3-1b38-4a9e-ab59-62d31312e3ea service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:10.017841 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9d4898f5-6e9d-4216-b594-84f2d7e50b14 req-fef249b3-1b38-4a9e-ab59-62d31312e3ea service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:10.018296 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9d4898f5-6e9d-4216-b594-84f2d7e50b14 req-fef249b3-1b38-4a9e-ab59-62d31312e3ea service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:10.034508 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-9d4898f5-6e9d-4216-b594-84f2d7e50b14 req-fef249b3-1b38-4a9e-ab59-62d31312e3ea service nova] Creating event network-vif-plugged:7ab26fa1-9fdc-446d-9a28-e6555fbad93b for instance 15a4a122-43f2-46c7-9168-722de25598c4 on n-h2-862686-1 Oct 26 13:12:10.035016 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-9d4898f5-6e9d-4216-b594-84f2d7e50b14 req-fef249b3-1b38-4a9e-ab59-62d31312e3ea service nova] Creating event network-vif-plugged:4838ed53-ef5a-465a-9c02-b85243b9bc4c for instance cd344db8-1e3a-498b-a4b4-54b0547fc063 on n-h1-862686-1 Oct 26 13:12:10.044687 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-9d4898f5-6e9d-4216-b594-84f2d7e50b14 req-fef249b3-1b38-4a9e-ab59-62d31312e3ea service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044744 Oct 26 13:12:10.049686 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1173/2416] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:12:10.055658 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-29832f2c-87b6-446d-9749-9c395897d0d9 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:10.057695 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-29832f2c-87b6-446d-9749-9c395897d0d9 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: cd344db8-1e3a-498b-a4b4-54b0547fc063] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:10.066488 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-29832f2c-87b6-446d-9749-9c395897d0d9 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:10.067179 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-29832f2c-87b6-446d-9749-9c395897d0d9 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:10.068398 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-29832f2c-87b6-446d-9749-9c395897d0d9 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:10.069257 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-29832f2c-87b6-446d-9749-9c395897d0d9 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:10.069885 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-29832f2c-87b6-446d-9749-9c395897d0d9 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:10.070479 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-29832f2c-87b6-446d-9749-9c395897d0d9 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:10.419856 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-29832f2c-87b6-446d-9749-9c395897d0d9 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:10.428627 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-29832f2c-87b6-446d-9749-9c395897d0d9 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063" status: 200 len: 1334 microversion: 2.1 time: 0.377470 Oct 26 13:12:10.431639 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1174/2417] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:10 2022] GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063 => generated 1334 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:10.436603 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c074aff9-04c5-4432-8314-4eb9d25d06d5 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:10.442022 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c074aff9-04c5-4432-8314-4eb9d25d06d5 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3574f016449d43e7baf97212ed731304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9729793794fdca01a8e15bed9f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:10.443243 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c074aff9-04c5-4432-8314-4eb9d25d06d5 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] 10.222.0.40 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.010435 Oct 26 13:12:10.444261 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1175/2418] 10.222.0.40 () {58 vars in 1178 bytes} [Wed Oct 26 13:12:10 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:12:10.448708 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-802f4b33-1643-4cbd-8b61-8d81e1d7af93 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:10.449602 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-802f4b33-1643-4cbd-8b61-8d81e1d7af93 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 15a4a122-43f2-46c7-9168-722de25598c4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:10.456871 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-802f4b33-1643-4cbd-8b61-8d81e1d7af93 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:10.457644 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-802f4b33-1643-4cbd-8b61-8d81e1d7af93 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:10.458275 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-802f4b33-1643-4cbd-8b61-8d81e1d7af93 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:10.459237 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-802f4b33-1643-4cbd-8b61-8d81e1d7af93 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:10.459879 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-802f4b33-1643-4cbd-8b61-8d81e1d7af93 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:10.460488 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-802f4b33-1643-4cbd-8b61-8d81e1d7af93 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:10.575066 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-a4497720-9760-41d2-96a3-a3976b016bc3 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] [instance: 6555760c-8bf4-467e-80cb-cdf6eee4b93c] Building network info cache for instance {{(pid=120598) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 26 13:12:10.728736 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-802f4b33-1643-4cbd-8b61-8d81e1d7af93 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:10.741015 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-802f4b33-1643-4cbd-8b61-8d81e1d7af93 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/15a4a122-43f2-46c7-9168-722de25598c4" status: 200 len: 1307 microversion: 2.1 time: 0.295289 Oct 26 13:12:10.754660 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1176/2419] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:10 2022] GET /compute/v2.1/servers/15a4a122-43f2-46c7-9168-722de25598c4 => generated 1307 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:10.766723 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c06cec52-c827-4813-bca2-505711a3878d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:10.779869 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c06cec52-c827-4813-bca2-505711a3878d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3574f016449d43e7baf97212ed731304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9729793794fdca01a8e15bed9f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:10.780653 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c06cec52-c827-4813-bca2-505711a3878d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Searching by: {'deleted': False, 'project_id': '37f9729793794fdca01a8e15bed9f4e9'} {{(pid=120597) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:12:10.794071 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c06cec52-c827-4813-bca2-505711a3878d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:10.794789 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c06cec52-c827-4813-bca2-505711a3878d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:10.795649 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c06cec52-c827-4813-bca2-505711a3878d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:10.796676 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c06cec52-c827-4813-bca2-505711a3878d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:10.797299 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c06cec52-c827-4813-bca2-505711a3878d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:10.797941 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c06cec52-c827-4813-bca2-505711a3878d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:10.826013 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.multi_cell_list [None req-c06cec52-c827-4813-bca2-505711a3878d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120597) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 13:12:10.875189 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c06cec52-c827-4813-bca2-505711a3878d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.119360 Oct 26 13:12:10.880687 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1177/2420] 10.222.0.40 () {58 vars in 1125 bytes} [Wed Oct 26 13:12:10 2022] GET /compute/v2.1/servers => generated 681 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:12:10.895918 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-796b35b4-61fe-4440-b77f-dbc06a92701b req-ae36695d-a5f1-4bbd-89c0-22594eb68dd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6555760c-8bf4-467e-80cb-cdf6eee4b93c", "tag": "16bdf5c3-e3cb-4e23-93c3-2342697bd561"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:12:10.919254 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-796b35b4-61fe-4440-b77f-dbc06a92701b req-ae36695d-a5f1-4bbd-89c0-22594eb68dd2 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:10.924399 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-796b35b4-61fe-4440-b77f-dbc06a92701b req-ae36695d-a5f1-4bbd-89c0-22594eb68dd2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:10.926743 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-796b35b4-61fe-4440-b77f-dbc06a92701b req-ae36695d-a5f1-4bbd-89c0-22594eb68dd2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:10.953659 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-796b35b4-61fe-4440-b77f-dbc06a92701b req-ae36695d-a5f1-4bbd-89c0-22594eb68dd2 service nova] Creating event network-changed:16bdf5c3-e3cb-4e23-93c3-2342697bd561 for instance 6555760c-8bf4-467e-80cb-cdf6eee4b93c on n-h1-862686-1 Oct 26 13:12:10.959160 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-796b35b4-61fe-4440-b77f-dbc06a92701b req-ae36695d-a5f1-4bbd-89c0-22594eb68dd2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075919 Oct 26 13:12:10.960074 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1178/2421] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:12:10.965352 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4594669b-a108-4e55-9434-20264db186ae tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:10.965963 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4594669b-a108-4e55-9434-20264db186ae tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] [instance: 8768fa8b-3989-4c11-a1cf-7841cf7e5c8d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:10.973414 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4594669b-a108-4e55-9434-20264db186ae tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:10.976566 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4594669b-a108-4e55-9434-20264db186ae tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:10.977024 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4594669b-a108-4e55-9434-20264db186ae tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:10.977812 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4594669b-a108-4e55-9434-20264db186ae tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:10.978376 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4594669b-a108-4e55-9434-20264db186ae tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:10.978796 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4594669b-a108-4e55-9434-20264db186ae tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:10.995149 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-4594669b-a108-4e55-9434-20264db186ae tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] HTTP exception thrown: Instance 8768fa8b-3989-4c11-a1cf-7841cf7e5c8d could not be found. Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4594669b-a108-4e55-9434-20264db186ae tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Request method failure captured: Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/servers/8768fa8b-3989-4c11-a1cf-7841cf7e5c8d HTTP/1.1 Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTH0pOdrYwU7cX_zxqqzQB7WhcpcufLLlY4QYeCwlT_hshwW2VTefrAAYgGkqycAhRBBftyc0BSZCnF8449StJMOpmfzvhUbg2_zLaAAogE4i3s9EGA2MryELylxmw8Zf2IKb1094KNvIjO0kID1MfzVGIv7hxNy9sYzIpL3gaRp-Z0 Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 37f9729793794fdca01a8e15bed9f4e9 Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ListServersNegativeTestJSON-854204148 Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/37f9729793794fdca01a8e15bed9f4e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/37f9729793794fdca01a8e15bed9f4e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_37f9729793794fdca01a8e15bed9f4e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/37f9729793794fdca01a8e15bed9f4e9"}]}] Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ListServersNegativeTestJSON-854204148 Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 37f9729793794fdca01a8e15bed9f4e9 Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-854204148 Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ListServersNegativeTestJSON-854204148-project Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 3574f016449d43e7baf97212ed731304 Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ListServersNegativeTestJSON-854204148-project Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 8768fa8b-3989-4c11-a1cf-7841cf7e5c8d could not be found. Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '8768fa8b-3989-4c11-a1cf-7841cf7e5c8d'} Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8768fa8b-3989-4c11-a1cf-7841cf7e5c8d could not be found. Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:12:10.996838 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:12:11.000803 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8768fa8b-3989-4c11-a1cf-7841cf7e5c8d could not be found. Oct 26 13:12:11.000803 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:11.000803 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:11.000803 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:11.000803 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:11.000803 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:11.000803 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:11.000803 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:12:11.000803 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:12:11.000803 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8768fa8b-3989-4c11-a1cf-7841cf7e5c8d could not be found. Oct 26 13:12:11.000803 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:11.000803 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4594669b-a108-4e55-9434-20264db186ae tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Returning 404 to user: Instance 8768fa8b-3989-4c11-a1cf-7841cf7e5c8d could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:12:11.000803 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4594669b-a108-4e55-9434-20264db186ae tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8768fa8b-3989-4c11-a1cf-7841cf7e5c8d" status: 404 len: 111 microversion: 2.1 time: 0.037100 Oct 26 13:12:11.000803 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1179/2422] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:12:10 2022] DELETE /compute/v2.1/servers/8768fa8b-3989-4c11-a1cf-7841cf7e5c8d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:12:11.007313 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c817a756-fbb2-438b-a0a0-457f6d21900f tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:11.007994 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c817a756-fbb2-438b-a0a0-457f6d21900f tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] [instance: ef63aed1-fab4-4b5b-b9c3-3607bb737e31] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:11.014624 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c817a756-fbb2-438b-a0a0-457f6d21900f tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:11.015393 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c817a756-fbb2-438b-a0a0-457f6d21900f tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:11.015841 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c817a756-fbb2-438b-a0a0-457f6d21900f tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:11.016999 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c817a756-fbb2-438b-a0a0-457f6d21900f tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:11.017507 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c817a756-fbb2-438b-a0a0-457f6d21900f tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:11.018416 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c817a756-fbb2-438b-a0a0-457f6d21900f tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:11.049767 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c817a756-fbb2-438b-a0a0-457f6d21900f tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] [instance: ef63aed1-fab4-4b5b-b9c3-3607bb737e31] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:12:11.206945 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c817a756-fbb2-438b-a0a0-457f6d21900f tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ef63aed1-fab4-4b5b-b9c3-3607bb737e31" status: 204 len: 0 microversion: 2.1 time: 0.203079 Oct 26 13:12:11.208711 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1180/2423] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:12:11 2022] DELETE /compute/v2.1/servers/ef63aed1-fab4-4b5b-b9c3-3607bb737e31 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:12:11.216690 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8d31f47b-cca0-40d4-b8bf-4c673a5bf9f8 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:11.217781 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8d31f47b-cca0-40d4-b8bf-4c673a5bf9f8 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: f5da8a46-9260-405b-aa4e-1f1a585302bb] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:11.227626 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d31f47b-cca0-40d4-b8bf-4c673a5bf9f8 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:11.228202 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d31f47b-cca0-40d4-b8bf-4c673a5bf9f8 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:11.228651 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d31f47b-cca0-40d4-b8bf-4c673a5bf9f8 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:11.229379 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d31f47b-cca0-40d4-b8bf-4c673a5bf9f8 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:11.229872 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d31f47b-cca0-40d4-b8bf-4c673a5bf9f8 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:11.230527 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d31f47b-cca0-40d4-b8bf-4c673a5bf9f8 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:11.371508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-a4497720-9760-41d2-96a3-a3976b016bc3 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] [instance: 6555760c-8bf4-467e-80cb-cdf6eee4b93c] Updating instance_info_cache with network_info: [{"id": "16bdf5c3-e3cb-4e23-93c3-2342697bd561", "address": "fa:16:3e:81:a3:42", "network": {"id": "4a773957-72d6-4c1e-ba7d-408dfcfd6ae3", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-190236763-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5902169366b646c7be94cb3521377225", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap16bdf5c3-e3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120598) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 26 13:12:11.388173 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4497720-9760-41d2-96a3-a3976b016bc3 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Releasing lock "refresh_cache-6555760c-8bf4-467e-80cb-cdf6eee4b93c" {{(pid=120598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 26 13:12:11.389190 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a4497720-9760-41d2-96a3-a3976b016bc3 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] 10.222.0.40 "POST /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c/action" status: 202 len: 0 microversion: 2.1 time: 3.883498 Oct 26 13:12:11.390163 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1244/2424] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:12:07 2022] POST /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c/action => generated 0 bytes in 3885 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 26 13:12:11.396851 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0ce9577c-e986-4aa3-a5e5-59d95115e4da tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:11.398264 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0ce9577c-e986-4aa3-a5e5-59d95115e4da tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] [instance: 5a42cb7d-b4c0-4771-a655-5e3f44adae05] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:11.405370 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ce9577c-e986-4aa3-a5e5-59d95115e4da tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:11.406291 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ce9577c-e986-4aa3-a5e5-59d95115e4da tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:11.407414 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ce9577c-e986-4aa3-a5e5-59d95115e4da tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:11.408438 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ce9577c-e986-4aa3-a5e5-59d95115e4da tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:11.409099 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ce9577c-e986-4aa3-a5e5-59d95115e4da tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:11.409794 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ce9577c-e986-4aa3-a5e5-59d95115e4da tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:11.447468 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0ce9577c-e986-4aa3-a5e5-59d95115e4da tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] [instance: 5a42cb7d-b4c0-4771-a655-5e3f44adae05] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:12:11.503800 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8d31f47b-cca0-40d4-b8bf-4c673a5bf9f8 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:11.505551 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:12:11.513317 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8d31f47b-cca0-40d4-b8bf-4c673a5bf9f8 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb" status: 200 len: 1311 microversion: 2.1 time: 0.302429 Oct 26 13:12:11.529782 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1181/2425] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:11 2022] GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb => generated 1311 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:11.529782 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-87f5f690-adfc-441d-bf00-e52855e840b0 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Calling method '.version_select at 0x7f6732237b80>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:11.639948 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0ce9577c-e986-4aa3-a5e5-59d95115e4da tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5a42cb7d-b4c0-4771-a655-5e3f44adae05" status: 204 len: 0 microversion: 2.1 time: 0.248010 Oct 26 13:12:11.640635 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1245/2426] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:12:11 2022] DELETE /compute/v2.1/servers/5a42cb7d-b4c0-4771-a655-5e3f44adae05 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:12:11.655216 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d3ddcf46-8e46-4f77-95dd-ee70278353c1 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:11.656455 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d3ddcf46-8e46-4f77-95dd-ee70278353c1 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: cd344db8-1e3a-498b-a4b4-54b0547fc063] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:11.663830 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3ddcf46-8e46-4f77-95dd-ee70278353c1 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:11.664670 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3ddcf46-8e46-4f77-95dd-ee70278353c1 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:11.665326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3ddcf46-8e46-4f77-95dd-ee70278353c1 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:11.666309 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3ddcf46-8e46-4f77-95dd-ee70278353c1 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:11.666969 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3ddcf46-8e46-4f77-95dd-ee70278353c1 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:11.667598 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3ddcf46-8e46-4f77-95dd-ee70278353c1 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:11.870029 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d3ddcf46-8e46-4f77-95dd-ee70278353c1 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:11.888794 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d3ddcf46-8e46-4f77-95dd-ee70278353c1 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063" status: 200 len: 1334 microversion: 2.1 time: 0.245228 Oct 26 13:12:11.889429 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1246/2427] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:11 2022] GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063 => generated 1334 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:11.895125 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8a6ff58f-a801-4bf0-844a-b7685703572b tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:11.895941 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8a6ff58f-a801-4bf0-844a-b7685703572b tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] [instance: 8768fa8b-3989-4c11-a1cf-7841cf7e5c8d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:11.902853 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8a6ff58f-a801-4bf0-844a-b7685703572b tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:11.903590 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8a6ff58f-a801-4bf0-844a-b7685703572b tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:11.904174 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8a6ff58f-a801-4bf0-844a-b7685703572b tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:11.905040 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8a6ff58f-a801-4bf0-844a-b7685703572b tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:11.905840 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8a6ff58f-a801-4bf0-844a-b7685703572b tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:11.906419 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8a6ff58f-a801-4bf0-844a-b7685703572b tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:11.925857 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-8a6ff58f-a801-4bf0-844a-b7685703572b tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] HTTP exception thrown: Instance 8768fa8b-3989-4c11-a1cf-7841cf7e5c8d could not be found. Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8a6ff58f-a801-4bf0-844a-b7685703572b tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Request method failure captured: Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/8768fa8b-3989-4c11-a1cf-7841cf7e5c8d HTTP/1.1 Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTH0pOdrYwU7cX_zxqqzQB7WhcpcufLLlY4QYeCwlT_hshwW2VTefrAAYgGkqycAhRBBftyc0BSZCnF8449StJMOpmfzvhUbg2_zLaAAogE4i3s9EGA2MryELylxmw8Zf2IKb1094KNvIjO0kID1MfzVGIv7hxNy9sYzIpL3gaRp-Z0 Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 37f9729793794fdca01a8e15bed9f4e9 Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ListServersNegativeTestJSON-854204148 Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/37f9729793794fdca01a8e15bed9f4e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/37f9729793794fdca01a8e15bed9f4e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_37f9729793794fdca01a8e15bed9f4e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/37f9729793794fdca01a8e15bed9f4e9"}]}] Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ListServersNegativeTestJSON-854204148 Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 37f9729793794fdca01a8e15bed9f4e9 Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-854204148 Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ListServersNegativeTestJSON-854204148-project Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 3574f016449d43e7baf97212ed731304 Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ListServersNegativeTestJSON-854204148-project Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 8768fa8b-3989-4c11-a1cf-7841cf7e5c8d could not be found. Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '8768fa8b-3989-4c11-a1cf-7841cf7e5c8d'} Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8768fa8b-3989-4c11-a1cf-7841cf7e5c8d could not be found. Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8768fa8b-3989-4c11-a1cf-7841cf7e5c8d could not be found. Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:11.927535 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:11.934842 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:11.934842 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:11.934842 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:11.934842 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:11.934842 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:12:11.934842 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:12:11.934842 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8768fa8b-3989-4c11-a1cf-7841cf7e5c8d could not be found. Oct 26 13:12:11.934842 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:11.934842 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8a6ff58f-a801-4bf0-844a-b7685703572b tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Returning 404 to user: Instance 8768fa8b-3989-4c11-a1cf-7841cf7e5c8d could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:12:11.934842 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8a6ff58f-a801-4bf0-844a-b7685703572b tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] 10.222.0.40 "GET /compute/v2.1/servers/8768fa8b-3989-4c11-a1cf-7841cf7e5c8d" status: 404 len: 111 microversion: 2.1 time: 0.038267 Oct 26 13:12:11.934842 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1247/2428] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:11 2022] GET /compute/v2.1/servers/8768fa8b-3989-4c11-a1cf-7841cf7e5c8d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:12:11.936771 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9c27526a-32d0-472b-a23f-fdb195f83950 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:11.937374 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9c27526a-32d0-472b-a23f-fdb195f83950 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 15a4a122-43f2-46c7-9168-722de25598c4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:11.947906 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c27526a-32d0-472b-a23f-fdb195f83950 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:11.948506 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c27526a-32d0-472b-a23f-fdb195f83950 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:11.949014 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c27526a-32d0-472b-a23f-fdb195f83950 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:11.949864 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c27526a-32d0-472b-a23f-fdb195f83950 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:11.950392 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c27526a-32d0-472b-a23f-fdb195f83950 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:11.951186 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c27526a-32d0-472b-a23f-fdb195f83950 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:12.113461 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9c27526a-32d0-472b-a23f-fdb195f83950 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:12.122020 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9c27526a-32d0-472b-a23f-fdb195f83950 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/15a4a122-43f2-46c7-9168-722de25598c4" status: 200 len: 1487 microversion: 2.1 time: 0.188635 Oct 26 13:12:12.122902 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1248/2429] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:11 2022] GET /compute/v2.1/servers/15a4a122-43f2-46c7-9168-722de25598c4 => generated 1487 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:12.127960 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-82e4635e-a813-4138-872c-c7ab4ab9a769 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:12.135050 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-82e4635e-a813-4138-872c-c7ab4ab9a769 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] [instance: ef63aed1-fab4-4b5b-b9c3-3607bb737e31] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:12.154559 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-82e4635e-a813-4138-872c-c7ab4ab9a769 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:12.155322 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-82e4635e-a813-4138-872c-c7ab4ab9a769 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:12.156330 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-82e4635e-a813-4138-872c-c7ab4ab9a769 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:12.158612 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-82e4635e-a813-4138-872c-c7ab4ab9a769 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:12.160500 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-82e4635e-a813-4138-872c-c7ab4ab9a769 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:12.162018 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-82e4635e-a813-4138-872c-c7ab4ab9a769 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:12.332158 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-82e4635e-a813-4138-872c-c7ab4ab9a769 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3574f016449d43e7baf97212ed731304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9729793794fdca01a8e15bed9f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:12.341178 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-82e4635e-a813-4138-872c-c7ab4ab9a769 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] 10.222.0.40 "GET /compute/v2.1/servers/ef63aed1-fab4-4b5b-b9c3-3607bb737e31" status: 200 len: 1520 microversion: 2.1 time: 0.216911 Oct 26 13:12:12.342049 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1249/2430] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:12 2022] GET /compute/v2.1/servers/ef63aed1-fab4-4b5b-b9c3-3607bb737e31 => generated 1520 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:12.348067 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-c75a94f6-3454-4929-acb3-51501a5e3cd3 req-ac621650-e951-47cb-8837-2e0eb95cba19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5da8a46-9260-405b-aa4e-1f1a585302bb", "name": "network-vif-plugged", "status": "completed", "tag": "87173235-cfd2-4c33-ace5-d5e636ff43f4"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:12:12.370812 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-c75a94f6-3454-4929-acb3-51501a5e3cd3 req-ac621650-e951-47cb-8837-2e0eb95cba19 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:12.371710 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-c75a94f6-3454-4929-acb3-51501a5e3cd3 req-ac621650-e951-47cb-8837-2e0eb95cba19 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:12.372563 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-c75a94f6-3454-4929-acb3-51501a5e3cd3 req-ac621650-e951-47cb-8837-2e0eb95cba19 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:12.389010 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-c75a94f6-3454-4929-acb3-51501a5e3cd3 req-ac621650-e951-47cb-8837-2e0eb95cba19 service nova] Creating event network-vif-plugged:87173235-cfd2-4c33-ace5-d5e636ff43f4 for instance f5da8a46-9260-405b-aa4e-1f1a585302bb on n-h1-862686-1 Oct 26 13:12:12.410297 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-c75a94f6-3454-4929-acb3-51501a5e3cd3 req-ac621650-e951-47cb-8837-2e0eb95cba19 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065369 Oct 26 13:12:12.413204 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1250/2431] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:12:12.425337 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e5e5b10c-b6b1-4fae-bafd-cc3b90c38643 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1387208335"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:12:12.435382 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e5e5b10c-b6b1-4fae-bafd-cc3b90c38643 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 15a4a122-43f2-46c7-9168-722de25598c4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:12.454844 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e5e5b10c-b6b1-4fae-bafd-cc3b90c38643 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:12.459230 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e5e5b10c-b6b1-4fae-bafd-cc3b90c38643 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:12.460855 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e5e5b10c-b6b1-4fae-bafd-cc3b90c38643 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:12.462100 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e5e5b10c-b6b1-4fae-bafd-cc3b90c38643 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:12.463942 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e5e5b10c-b6b1-4fae-bafd-cc3b90c38643 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:12.464917 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e5e5b10c-b6b1-4fae-bafd-cc3b90c38643 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:12.958034 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e5e5b10c-b6b1-4fae-bafd-cc3b90c38643 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "POST /compute/v2.1/servers/15a4a122-43f2-46c7-9168-722de25598c4/action" status: 202 len: 0 microversion: 2.1 time: 0.542254 Oct 26 13:12:12.967502 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1251/2432] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:12:12 2022] POST /compute/v2.1/servers/15a4a122-43f2-46c7-9168-722de25598c4/action => generated 0 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 26 13:12:12.974247 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-54e7cdb2-3c8f-4659-b639-17ed8cab3d9b tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:12.975817 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-54e7cdb2-3c8f-4659-b639-17ed8cab3d9b tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: f5da8a46-9260-405b-aa4e-1f1a585302bb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:12.984717 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54e7cdb2-3c8f-4659-b639-17ed8cab3d9b tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:12.985312 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54e7cdb2-3c8f-4659-b639-17ed8cab3d9b tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:12.987772 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54e7cdb2-3c8f-4659-b639-17ed8cab3d9b tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:12.988465 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54e7cdb2-3c8f-4659-b639-17ed8cab3d9b tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:12.989121 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54e7cdb2-3c8f-4659-b639-17ed8cab3d9b tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:12.990136 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54e7cdb2-3c8f-4659-b639-17ed8cab3d9b tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:13.266314 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=16 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:12:13.527559 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-54e7cdb2-3c8f-4659-b639-17ed8cab3d9b tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:13.544903 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-54e7cdb2-3c8f-4659-b639-17ed8cab3d9b tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb" status: 200 len: 1311 microversion: 2.1 time: 0.570649 Oct 26 13:12:13.547383 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1252/2433] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:12 2022] GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb => generated 1311 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:13.561044 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5eb21055-a248-46b5-8bc5-50d858acf126 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:13.563234 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5eb21055-a248-46b5-8bc5-50d858acf126 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: cd344db8-1e3a-498b-a4b4-54b0547fc063] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:13.571902 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:12:13.587677 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5eb21055-a248-46b5-8bc5-50d858acf126 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:13.588511 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5eb21055-a248-46b5-8bc5-50d858acf126 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:13.589163 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5eb21055-a248-46b5-8bc5-50d858acf126 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:13.590124 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5eb21055-a248-46b5-8bc5-50d858acf126 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:13.590825 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5eb21055-a248-46b5-8bc5-50d858acf126 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:13.591496 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5eb21055-a248-46b5-8bc5-50d858acf126 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:13.884208 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-87f5f690-adfc-441d-bf00-e52855e840b0 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/3ac9fc77-a6c0-488a-b5ea-7dd0250c93ba" status: 202 len: 0 microversion: 2.1 time: 2.364882 Oct 26 13:12:13.885326 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1182/2434] 10.222.0.40 () {58 vars in 1263 bytes} [Wed Oct 26 13:12:11 2022] DELETE /compute/v2.1/os-floating-ips/3ac9fc77-a6c0-488a-b5ea-7dd0250c93ba => generated 0 bytes in 2367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:12:13.901877 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1138fc37-1d28-45c4-9a9b-757057a4ac79 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f6732264310>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:14.015329 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1138fc37-1d28-45c4-9a9b-757057a4ac79 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/fd2de631-0fbd-4ebd-9275-f60c3845e4ef" status: 200 len: 1414 microversion: 2.1 time: 0.128702 Oct 26 13:12:14.019255 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1183/2435] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:12:13 2022] GET /compute/v2.1/images/fd2de631-0fbd-4ebd-9275-f60c3845e4ef => generated 1414 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:14.041613 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5eb21055-a248-46b5-8bc5-50d858acf126 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:14.044077 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-54166a37-4a0e-471a-b1c1-77b9579f7e4d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:14.045159 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-54166a37-4a0e-471a-b1c1-77b9579f7e4d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] [instance: ef63aed1-fab4-4b5b-b9c3-3607bb737e31] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:14.047313 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5eb21055-a248-46b5-8bc5-50d858acf126 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063" status: 200 len: 1668 microversion: 2.1 time: 0.498620 Oct 26 13:12:14.048069 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1253/2436] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:13 2022] GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063 => generated 1668 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:14.055081 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54166a37-4a0e-471a-b1c1-77b9579f7e4d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:14.055715 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54166a37-4a0e-471a-b1c1-77b9579f7e4d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:14.056278 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54166a37-4a0e-471a-b1c1-77b9579f7e4d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:14.057250 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54166a37-4a0e-471a-b1c1-77b9579f7e4d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:14.057860 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54166a37-4a0e-471a-b1c1-77b9579f7e4d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:14.058537 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54166a37-4a0e-471a-b1c1-77b9579f7e4d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:14.066545 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e49a69ed-429f-4901-85ec-6ec072802999 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Calling method '.version_select at 0x7f67327599d0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:14.224249 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-54166a37-4a0e-471a-b1c1-77b9579f7e4d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3574f016449d43e7baf97212ed731304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9729793794fdca01a8e15bed9f4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:14.256969 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-54166a37-4a0e-471a-b1c1-77b9579f7e4d tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] 10.222.0.40 "GET /compute/v2.1/servers/ef63aed1-fab4-4b5b-b9c3-3607bb737e31" status: 200 len: 1307 microversion: 2.1 time: 0.230567 Oct 26 13:12:14.259878 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1184/2437] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:14 2022] GET /compute/v2.1/servers/ef63aed1-fab4-4b5b-b9c3-3607bb737e31 => generated 1307 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:14.271677 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-e527fe49-eeb7-4dea-8e94-99140bd22176 req-bd4d0fac-4793-40b1-ae85-dec329cc824a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef63aed1-fab4-4b5b-b9c3-3607bb737e31", "name": "network-vif-deleted", "tag": "d5de9727-eebc-4e98-8de0-53426dd8ddcf"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:12:14.297590 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-e527fe49-eeb7-4dea-8e94-99140bd22176 req-bd4d0fac-4793-40b1-ae85-dec329cc824a service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:14.298592 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-e527fe49-eeb7-4dea-8e94-99140bd22176 req-bd4d0fac-4793-40b1-ae85-dec329cc824a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:14.299031 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-e527fe49-eeb7-4dea-8e94-99140bd22176 req-bd4d0fac-4793-40b1-ae85-dec329cc824a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:14.326349 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-e527fe49-eeb7-4dea-8e94-99140bd22176 req-bd4d0fac-4793-40b1-ae85-dec329cc824a service nova] Creating event network-vif-deleted:d5de9727-eebc-4e98-8de0-53426dd8ddcf for instance ef63aed1-fab4-4b5b-b9c3-3607bb737e31 on n-h1-862686-1 Oct 26 13:12:14.338340 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-e527fe49-eeb7-4dea-8e94-99140bd22176 req-bd4d0fac-4793-40b1-ae85-dec329cc824a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076375 Oct 26 13:12:14.342223 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1185/2438] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:12:14.358199 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-75f4e210-a71c-4d37-8161-c6312c5b6a90 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67321f8ca0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:14.463795 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-75f4e210-a71c-4d37-8161-c6312c5b6a90 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/fd2de631-0fbd-4ebd-9275-f60c3845e4ef" status: 200 len: 1414 microversion: 2.1 time: 0.120029 Oct 26 13:12:14.464898 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1186/2439] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:12:14 2022] GET /compute/v2.1/images/fd2de631-0fbd-4ebd-9275-f60c3845e4ef => generated 1414 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:14.481991 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-867d9aa8-773f-4429-a471-fea89e5ab168 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:14.488447 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-867d9aa8-773f-4429-a471-fea89e5ab168 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: cd344db8-1e3a-498b-a4b4-54b0547fc063] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:14.496133 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-867d9aa8-773f-4429-a471-fea89e5ab168 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:14.497181 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-867d9aa8-773f-4429-a471-fea89e5ab168 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:14.497963 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-867d9aa8-773f-4429-a471-fea89e5ab168 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:14.498882 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-867d9aa8-773f-4429-a471-fea89e5ab168 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:14.499556 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-867d9aa8-773f-4429-a471-fea89e5ab168 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:14.500378 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-867d9aa8-773f-4429-a471-fea89e5ab168 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:14.580668 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-867d9aa8-773f-4429-a471-fea89e5ab168 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063/ips" status: 200 len: 178 microversion: 2.1 time: 0.108340 Oct 26 13:12:14.581273 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1187/2440] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Oct 26 13:12:14 2022] GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063/ips => generated 178 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:12:14.595414 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-536ca47f-a2f8-4891-a6ca-9fd1f4850c09 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f673229adc0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:14.607415 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e49a69ed-429f-4901-85ec-6ec072802999 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/1b74409a-4ff5-44d9-b5c0-27fa342ea637" status: 202 len: 0 microversion: 2.1 time: 0.558394 Oct 26 13:12:14.613740 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1254/2441] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 26 13:12:14 2022] DELETE /compute/v2.1/os-security-groups/1b74409a-4ff5-44d9-b5c0-27fa342ea637 => generated 0 bytes in 565 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:12:14.629368 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f4f6dde5-2aff-4a75-bb87-b5c39249d83c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:14.639363 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f4f6dde5-2aff-4a75-bb87-b5c39249d83c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: f5da8a46-9260-405b-aa4e-1f1a585302bb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:14.671431 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4f6dde5-2aff-4a75-bb87-b5c39249d83c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:14.674696 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4f6dde5-2aff-4a75-bb87-b5c39249d83c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:14.675770 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4f6dde5-2aff-4a75-bb87-b5c39249d83c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:14.678382 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4f6dde5-2aff-4a75-bb87-b5c39249d83c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:14.681879 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4f6dde5-2aff-4a75-bb87-b5c39249d83c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:14.682585 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4f6dde5-2aff-4a75-bb87-b5c39249d83c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:15.004106 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f4f6dde5-2aff-4a75-bb87-b5c39249d83c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:15.014301 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f4f6dde5-2aff-4a75-bb87-b5c39249d83c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb" status: 200 len: 1494 microversion: 2.1 time: 0.398563 Oct 26 13:12:15.014805 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1255/2442] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:14 2022] GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb => generated 1494 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:15.032074 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-54808b5b-7e6f-4525-af58-37d1943e45a7 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:15.033993 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-54808b5b-7e6f-4525-af58-37d1943e45a7 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: cd344db8-1e3a-498b-a4b4-54b0547fc063] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:15.047355 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54808b5b-7e6f-4525-af58-37d1943e45a7 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:15.048673 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54808b5b-7e6f-4525-af58-37d1943e45a7 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:15.052751 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-536ca47f-a2f8-4891-a6ca-9fd1f4850c09 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "DELETE /compute/v2.1/images/fd2de631-0fbd-4ebd-9275-f60c3845e4ef" status: 204 len: 0 microversion: 2.1 time: 0.463050 Oct 26 13:12:15.054034 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54808b5b-7e6f-4525-af58-37d1943e45a7 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:15.054990 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54808b5b-7e6f-4525-af58-37d1943e45a7 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:15.055460 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54808b5b-7e6f-4525-af58-37d1943e45a7 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:15.056626 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1188/2443] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:14 2022] DELETE /compute/v2.1/images/fd2de631-0fbd-4ebd-9275-f60c3845e4ef => generated 0 bytes in 472 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:12:15.058681 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54808b5b-7e6f-4525-af58-37d1943e45a7 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:15.062227 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-81f62ebc-968b-4cde-896e-3a6aefdecf17 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:15.062696 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-81f62ebc-968b-4cde-896e-3a6aefdecf17 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] [instance: 6555760c-8bf4-467e-80cb-cdf6eee4b93c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:15.083045 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81f62ebc-968b-4cde-896e-3a6aefdecf17 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:15.086226 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81f62ebc-968b-4cde-896e-3a6aefdecf17 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:15.086705 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81f62ebc-968b-4cde-896e-3a6aefdecf17 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:15.095203 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81f62ebc-968b-4cde-896e-3a6aefdecf17 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:15.099768 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81f62ebc-968b-4cde-896e-3a6aefdecf17 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:15.101417 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81f62ebc-968b-4cde-896e-3a6aefdecf17 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:15.164911 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-54808b5b-7e6f-4525-af58-37d1943e45a7 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: cd344db8-1e3a-498b-a4b4-54b0547fc063] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:12:15.208463 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-81f62ebc-968b-4cde-896e-3a6aefdecf17 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] [instance: 6555760c-8bf4-467e-80cb-cdf6eee4b93c] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:12:15.340032 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-54808b5b-7e6f-4525-af58-37d1943e45a7 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "DELETE /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063" status: 204 len: 0 microversion: 2.1 time: 0.316803 Oct 26 13:12:15.343682 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1256/2444] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:12:15 2022] DELETE /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:12:15.358794 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-40eccb7b-5c72-432a-a542-bd18fd16b7c9 req-cdb6b042-ae0e-4fc0-b1e8-ac5d42871ad4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a42cb7d-b4c0-4771-a655-5e3f44adae05", "name": "network-vif-deleted", "tag": "33358974-4493-43ef-84db-4672cd97f231"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:12:15.374204 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-40eccb7b-5c72-432a-a542-bd18fd16b7c9 req-cdb6b042-ae0e-4fc0-b1e8-ac5d42871ad4 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:15.381905 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-40eccb7b-5c72-432a-a542-bd18fd16b7c9 req-cdb6b042-ae0e-4fc0-b1e8-ac5d42871ad4 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:15.383021 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-40eccb7b-5c72-432a-a542-bd18fd16b7c9 req-cdb6b042-ae0e-4fc0-b1e8-ac5d42871ad4 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:15.407527 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-81f62ebc-968b-4cde-896e-3a6aefdecf17 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c" status: 204 len: 0 microversion: 2.1 time: 0.349385 Oct 26 13:12:15.408146 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1189/2445] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:12:15 2022] DELETE /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:12:15.420540 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-40eccb7b-5c72-432a-a542-bd18fd16b7c9 req-cdb6b042-ae0e-4fc0-b1e8-ac5d42871ad4 service nova] Creating event network-vif-deleted:33358974-4493-43ef-84db-4672cd97f231 for instance 5a42cb7d-b4c0-4771-a655-5e3f44adae05 on n-h2-862686-1 Oct 26 13:12:15.434151 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-40eccb7b-5c72-432a-a542-bd18fd16b7c9 req-cdb6b042-ae0e-4fc0-b1e8-ac5d42871ad4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088542 Oct 26 13:12:15.435253 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1257/2446] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:12:15.442399 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-422b2523-41db-402d-82ec-dd091417aaf8 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67322895e0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:15.503467 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-422b2523-41db-402d-82ec-dd091417aaf8 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] HTTP exception thrown: Image not found. Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-422b2523-41db-402d-82ec-dd091417aaf8 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Request method failure captured: Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/images/fd2de631-0fbd-4ebd-9275-f60c3845e4ef HTTP/1.1 Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTC9wyPfJuSJHapeMPJUKkbgKm2FQwvtt7BQDbWPm4GwQ8yWjgTo6lRUEA-e4jHkLSJjfv2QDJX2GMz9jukHMvyMDw_G0MjOwEgCjRSM3Ua7yPar79M8qXcqg6fT_UU9R41ThcILNxZyJfJrKJFP6QbT0FaEuXfNwh8wp6VXk-hvlMc Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: cc4a21e57f1c4fd1ab3c60f6416f8b11 Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}] Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: cc4a21e57f1c4fd1ab3c60f6416f8b11 Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ImagesTestJSON-2142360890-project Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: e3707c34798c48d584cff9dd46d9d7c0 Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ImagesTestJSON-2142360890-project Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: exception: Image not found. Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'fd2de631-0fbd-4ebd-9275-f60c3845e4ef'} Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID fd2de631-0fbd-4ebd-9275-f60c3845e4ef Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 26 13:12:15.512177 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 26 13:12:15.519336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 26 13:12:15.519336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 26 13:12:15.519336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 13:12:15.519336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 13:12:15.519336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 26 13:12:15.519336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 26 13:12:15.519336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 13:12:15.519336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 13:12:15.519336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 26 13:12:15.519336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 26 13:12:15.519336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 26 13:12:15.519336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 26 13:12:15.519336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 13:12:15.519336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 13:12:15.519336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 13:12:15.519336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 13:12:15.519336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fd2de631-0fbd-4ebd-9275-f60c3845e4ef could not be found. Oct 26 13:12:15.519336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:15.519336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:15.519336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:15.519336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:15.519336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:15.519336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:15.519336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:12:15.519336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:12:15.519336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:12:15.519336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:12:15.519336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:12:15.519336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:12:15.519336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 26 13:12:15.519336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 26 13:12:15.519336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 26 13:12:15.519336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:15.519336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:15.519336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:15.519336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:15.519336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:15.519336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:15.519336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:12:15.519336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:12:15.519336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 26 13:12:15.519336 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:15.519336 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-422b2523-41db-402d-82ec-dd091417aaf8 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Returning 404 to user: Image not found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:12:15.525297 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-422b2523-41db-402d-82ec-dd091417aaf8 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/images/fd2de631-0fbd-4ebd-9275-f60c3845e4ef" status: 404 len: 62 microversion: 2.1 time: 0.088802 Oct 26 13:12:15.528504 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1258/2447] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:12:15 2022] GET /compute/v2.1/images/fd2de631-0fbd-4ebd-9275-f60c3845e4ef => generated 62 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:12:15.543327 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d9ae4d95-d279-4271-9cee-baa18649eaf5 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:15.547655 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d9ae4d95-d279-4271-9cee-baa18649eaf5 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] [instance: ef63aed1-fab4-4b5b-b9c3-3607bb737e31] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:15.569346 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9ae4d95-d279-4271-9cee-baa18649eaf5 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:15.571073 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9ae4d95-d279-4271-9cee-baa18649eaf5 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:15.574131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9ae4d95-d279-4271-9cee-baa18649eaf5 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:15.575207 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9ae4d95-d279-4271-9cee-baa18649eaf5 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:15.575887 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9ae4d95-d279-4271-9cee-baa18649eaf5 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:15.577369 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9ae4d95-d279-4271-9cee-baa18649eaf5 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:15.584217 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-eaa2f8a3-b158-4ba2-af88-c4dde18c5e57 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:15.584935 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-eaa2f8a3-b158-4ba2-af88-c4dde18c5e57 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] [instance: f5da8a46-9260-405b-aa4e-1f1a585302bb] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:15.596561 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eaa2f8a3-b158-4ba2-af88-c4dde18c5e57 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:15.597068 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eaa2f8a3-b158-4ba2-af88-c4dde18c5e57 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:15.597529 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eaa2f8a3-b158-4ba2-af88-c4dde18c5e57 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:15.603587 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eaa2f8a3-b158-4ba2-af88-c4dde18c5e57 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:15.612241 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eaa2f8a3-b158-4ba2-af88-c4dde18c5e57 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:15.613811 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eaa2f8a3-b158-4ba2-af88-c4dde18c5e57 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:15.636577 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-d9ae4d95-d279-4271-9cee-baa18649eaf5 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] HTTP exception thrown: Instance ef63aed1-fab4-4b5b-b9c3-3607bb737e31 could not be found. Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d9ae4d95-d279-4271-9cee-baa18649eaf5 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Request method failure captured: Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/ef63aed1-fab4-4b5b-b9c3-3607bb737e31 HTTP/1.1 Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTH0pOdrYwU7cX_zxqqzQB7WhcpcufLLlY4QYeCwlT_hshwW2VTefrAAYgGkqycAhRBBftyc0BSZCnF8449StJMOpmfzvhUbg2_zLaAAogE4i3s9EGA2MryELylxmw8Zf2IKb1094KNvIjO0kID1MfzVGIv7hxNy9sYzIpL3gaRp-Z0 Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 37f9729793794fdca01a8e15bed9f4e9 Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ListServersNegativeTestJSON-854204148 Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/37f9729793794fdca01a8e15bed9f4e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/37f9729793794fdca01a8e15bed9f4e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_37f9729793794fdca01a8e15bed9f4e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/37f9729793794fdca01a8e15bed9f4e9"}]}] Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ListServersNegativeTestJSON-854204148 Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 37f9729793794fdca01a8e15bed9f4e9 Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-854204148 Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ListServersNegativeTestJSON-854204148-project Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 3574f016449d43e7baf97212ed731304 Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ListServersNegativeTestJSON-854204148-project Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance ef63aed1-fab4-4b5b-b9c3-3607bb737e31 could not be found. Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'ef63aed1-fab4-4b5b-b9c3-3607bb737e31'} Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef63aed1-fab4-4b5b-b9c3-3607bb737e31 could not be found. Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef63aed1-fab4-4b5b-b9c3-3607bb737e31 could not be found. Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:15.641311 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:15.645665 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:15.645665 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:15.645665 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:15.645665 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:15.645665 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:12:15.645665 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:12:15.645665 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef63aed1-fab4-4b5b-b9c3-3607bb737e31 could not be found. Oct 26 13:12:15.645665 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:15.649756 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d9ae4d95-d279-4271-9cee-baa18649eaf5 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Returning 404 to user: Instance ef63aed1-fab4-4b5b-b9c3-3607bb737e31 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:12:15.652282 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d9ae4d95-d279-4271-9cee-baa18649eaf5 tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] 10.222.0.40 "GET /compute/v2.1/servers/ef63aed1-fab4-4b5b-b9c3-3607bb737e31" status: 404 len: 111 microversion: 2.1 time: 0.121444 Oct 26 13:12:15.656485 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1259/2448] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:15 2022] GET /compute/v2.1/servers/ef63aed1-fab4-4b5b-b9c3-3607bb737e31 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:12:15.664674 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a6861c31-b534-40d6-ab08-f343ac9534ed tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:15.668111 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a6861c31-b534-40d6-ab08-f343ac9534ed tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: cd344db8-1e3a-498b-a4b4-54b0547fc063] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:15.675167 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a6861c31-b534-40d6-ab08-f343ac9534ed tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:15.675842 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a6861c31-b534-40d6-ab08-f343ac9534ed tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:15.676383 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a6861c31-b534-40d6-ab08-f343ac9534ed tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:15.677205 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a6861c31-b534-40d6-ab08-f343ac9534ed tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:15.677923 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a6861c31-b534-40d6-ab08-f343ac9534ed tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:15.678531 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a6861c31-b534-40d6-ab08-f343ac9534ed tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:15.874302 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a6861c31-b534-40d6-ab08-f343ac9534ed tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:15.885008 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a6861c31-b534-40d6-ab08-f343ac9534ed tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063" status: 200 len: 1674 microversion: 2.1 time: 0.226439 Oct 26 13:12:15.891729 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1260/2449] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:15 2022] GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063 => generated 1674 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:15.900987 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d8f5fb80-519e-418f-8a15-b35d85dff18a tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:15.902296 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d8f5fb80-519e-418f-8a15-b35d85dff18a tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] [instance: 6555760c-8bf4-467e-80cb-cdf6eee4b93c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:15.913193 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8f5fb80-519e-418f-8a15-b35d85dff18a tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:15.913775 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8f5fb80-519e-418f-8a15-b35d85dff18a tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:15.914217 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8f5fb80-519e-418f-8a15-b35d85dff18a tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:15.914933 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8f5fb80-519e-418f-8a15-b35d85dff18a tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:15.915391 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8f5fb80-519e-418f-8a15-b35d85dff18a tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:15.915973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8f5fb80-519e-418f-8a15-b35d85dff18a tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:16.028132 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-eaa2f8a3-b158-4ba2-af88-c4dde18c5e57 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb" status: 200 len: 1645 microversion: 2.1 time: 0.617859 Oct 26 13:12:16.033521 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1190/2450] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:15 2022] GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb => generated 1645 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:16.039386 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-37413a81-cb81-4ef8-a448-72662c5c3589 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:16.040010 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-37413a81-cb81-4ef8-a448-72662c5c3589 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 15a4a122-43f2-46c7-9168-722de25598c4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:16.056066 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37413a81-cb81-4ef8-a448-72662c5c3589 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:16.056693 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37413a81-cb81-4ef8-a448-72662c5c3589 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:16.057194 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37413a81-cb81-4ef8-a448-72662c5c3589 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:16.058016 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37413a81-cb81-4ef8-a448-72662c5c3589 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:16.058546 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37413a81-cb81-4ef8-a448-72662c5c3589 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:16.059099 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37413a81-cb81-4ef8-a448-72662c5c3589 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:16.062860 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:12:16.275674 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d8f5fb80-519e-418f-8a15-b35d85dff18a tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8fd7d2f8014b85beecc30c93bc084d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5902169366b646c7be94cb3521377225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:16.292310 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d8f5fb80-519e-418f-8a15-b35d85dff18a tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] 10.222.0.40 "GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c" status: 200 len: 1510 microversion: 2.1 time: 0.396858 Oct 26 13:12:16.306765 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1261/2451] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:15 2022] GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c => generated 1510 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:16.306765 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-92705150-0d98-4b84-b215-56befb9ff62a tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:16.306765 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-92705150-0d98-4b84-b215-56befb9ff62a tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] [instance: 5a42cb7d-b4c0-4771-a655-5e3f44adae05] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:16.309152 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-92705150-0d98-4b84-b215-56befb9ff62a tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:16.309739 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-92705150-0d98-4b84-b215-56befb9ff62a tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:16.310254 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-92705150-0d98-4b84-b215-56befb9ff62a tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:16.310869 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-92705150-0d98-4b84-b215-56befb9ff62a tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:16.311822 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-92705150-0d98-4b84-b215-56befb9ff62a tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:16.312190 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-92705150-0d98-4b84-b215-56befb9ff62a tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:16.321748 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-37413a81-cb81-4ef8-a448-72662c5c3589 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:16.336924 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-37413a81-cb81-4ef8-a448-72662c5c3589 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/15a4a122-43f2-46c7-9168-722de25598c4" status: 200 len: 1505 microversion: 2.1 time: 0.303540 Oct 26 13:12:16.356659 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1191/2452] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:16 2022] GET /compute/v2.1/servers/15a4a122-43f2-46c7-9168-722de25598c4 => generated 1505 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:16.359660 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-92705150-0d98-4b84-b215-56befb9ff62a tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] HTTP exception thrown: Instance 5a42cb7d-b4c0-4771-a655-5e3f44adae05 could not be found. Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-92705150-0d98-4b84-b215-56befb9ff62a tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Request method failure captured: Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/5a42cb7d-b4c0-4771-a655-5e3f44adae05 HTTP/1.1 Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTH0pOdrYwU7cX_zxqqzQB7WhcpcufLLlY4QYeCwlT_hshwW2VTefrAAYgGkqycAhRBBftyc0BSZCnF8449StJMOpmfzvhUbg2_zLaAAogE4i3s9EGA2MryELylxmw8Zf2IKb1094KNvIjO0kID1MfzVGIv7hxNy9sYzIpL3gaRp-Z0 Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 37f9729793794fdca01a8e15bed9f4e9 Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ListServersNegativeTestJSON-854204148 Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/37f9729793794fdca01a8e15bed9f4e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/37f9729793794fdca01a8e15bed9f4e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_37f9729793794fdca01a8e15bed9f4e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/37f9729793794fdca01a8e15bed9f4e9"}]}] Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ListServersNegativeTestJSON-854204148 Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 37f9729793794fdca01a8e15bed9f4e9 Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-854204148 Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ListServersNegativeTestJSON-854204148-project Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 3574f016449d43e7baf97212ed731304 Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ListServersNegativeTestJSON-854204148-project Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 5a42cb7d-b4c0-4771-a655-5e3f44adae05 could not be found. Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '5a42cb7d-b4c0-4771-a655-5e3f44adae05'} Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a42cb7d-b4c0-4771-a655-5e3f44adae05 could not be found. Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a42cb7d-b4c0-4771-a655-5e3f44adae05 could not be found. Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:16.365348 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:16.368923 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:16.368923 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:16.368923 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:16.368923 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:16.368923 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:12:16.368923 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:12:16.368923 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a42cb7d-b4c0-4771-a655-5e3f44adae05 could not be found. Oct 26 13:12:16.368923 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:16.372001 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c796c223-e745-46fe-b818-27707160b57e tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:16.377598 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c796c223-e745-46fe-b818-27707160b57e tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] [instance: f5da8a46-9260-405b-aa4e-1f1a585302bb] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:16.379658 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-92705150-0d98-4b84-b215-56befb9ff62a tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] Returning 404 to user: Instance 5a42cb7d-b4c0-4771-a655-5e3f44adae05 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:12:16.382134 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-92705150-0d98-4b84-b215-56befb9ff62a tempest-ListServersNegativeTestJSON-854204148 tempest-ListServersNegativeTestJSON-854204148-project] 10.222.0.40 "GET /compute/v2.1/servers/5a42cb7d-b4c0-4771-a655-5e3f44adae05" status: 404 len: 111 microversion: 2.1 time: 0.086338 Oct 26 13:12:16.386989 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1262/2453] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:16 2022] GET /compute/v2.1/servers/5a42cb7d-b4c0-4771-a655-5e3f44adae05 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:12:16.389250 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c796c223-e745-46fe-b818-27707160b57e tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:16.389886 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c796c223-e745-46fe-b818-27707160b57e tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:16.390552 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c796c223-e745-46fe-b818-27707160b57e tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:16.392365 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c796c223-e745-46fe-b818-27707160b57e tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:16.393888 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c796c223-e745-46fe-b818-27707160b57e tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:16.395423 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c796c223-e745-46fe-b818-27707160b57e tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:16.911005 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a9ad10c6-881c-4799-a7ef-f6bc69e15f52 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:16.912054 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a9ad10c6-881c-4799-a7ef-f6bc69e15f52 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: cd344db8-1e3a-498b-a4b4-54b0547fc063] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:16.918724 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a9ad10c6-881c-4799-a7ef-f6bc69e15f52 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:16.919586 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a9ad10c6-881c-4799-a7ef-f6bc69e15f52 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:16.920285 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a9ad10c6-881c-4799-a7ef-f6bc69e15f52 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:16.921259 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a9ad10c6-881c-4799-a7ef-f6bc69e15f52 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:16.921987 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a9ad10c6-881c-4799-a7ef-f6bc69e15f52 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:16.922672 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a9ad10c6-881c-4799-a7ef-f6bc69e15f52 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:17.150259 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c796c223-e745-46fe-b818-27707160b57e tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb" status: 200 len: 1645 microversion: 2.1 time: 0.791677 Oct 26 13:12:17.151850 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1192/2454] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:16 2022] GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb => generated 1645 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:17.174708 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e893ae79-aee2-4b7b-a901-59e3cf21f420 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:17.179857 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e893ae79-aee2-4b7b-a901-59e3cf21f420 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:17.180351 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e893ae79-aee2-4b7b-a901-59e3cf21f420 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:17.180792 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e893ae79-aee2-4b7b-a901-59e3cf21f420 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:17.181802 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e893ae79-aee2-4b7b-a901-59e3cf21f420 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:17.182475 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e893ae79-aee2-4b7b-a901-59e3cf21f420 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:17.183687 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e893ae79-aee2-4b7b-a901-59e3cf21f420 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:17.212965 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e893ae79-aee2-4b7b-a901-59e3cf21f420 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.043120 Oct 26 13:12:17.221885 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1193/2455] 10.222.0.40 () {58 vars in 1176 bytes} [Wed Oct 26 13:12:17 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:12:17.228992 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ab988fff-dfea-4acd-889a-a4a8bb7dcf91 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862686-1", "block_migration": true, "disk_over_commit": false}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:12:17.230272 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a9ad10c6-881c-4799-a7ef-f6bc69e15f52 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:17.232049 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ab988fff-dfea-4acd-889a-a4a8bb7dcf91 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] [instance: f5da8a46-9260-405b-aa4e-1f1a585302bb] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:17.232877 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:12:17.240415 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ab988fff-dfea-4acd-889a-a4a8bb7dcf91 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:17.241113 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ab988fff-dfea-4acd-889a-a4a8bb7dcf91 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:17.241931 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ab988fff-dfea-4acd-889a-a4a8bb7dcf91 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:17.242839 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ab988fff-dfea-4acd-889a-a4a8bb7dcf91 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:17.243484 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ab988fff-dfea-4acd-889a-a4a8bb7dcf91 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:17.244116 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ab988fff-dfea-4acd-889a-a4a8bb7dcf91 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:17.253256 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a9ad10c6-881c-4799-a7ef-f6bc69e15f52 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063" status: 200 len: 1674 microversion: 2.1 time: 0.347412 Oct 26 13:12:17.253896 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1263/2456] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:16 2022] GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063 => generated 1674 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:12:17.297405 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-ab988fff-dfea-4acd-889a-a4a8bb7dcf91 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lazy-loading 'flavor' on Instance uuid f5da8a46-9260-405b-aa4e-1f1a585302bb {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:12:17.312905 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ab988fff-dfea-4acd-889a-a4a8bb7dcf91 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] [instance: f5da8a46-9260-405b-aa4e-1f1a585302bb] Going to try to live migrate instance to n-h2-862686-1 {{(pid=120597) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 26 13:12:17.322218 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-82ab9f7e-4186-4023-bdea-1775eee890f7 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:17.322833 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-82ab9f7e-4186-4023-bdea-1775eee890f7 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] [instance: 6555760c-8bf4-467e-80cb-cdf6eee4b93c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:17.332767 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-82ab9f7e-4186-4023-bdea-1775eee890f7 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:17.334383 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-82ab9f7e-4186-4023-bdea-1775eee890f7 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:17.335756 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-82ab9f7e-4186-4023-bdea-1775eee890f7 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:17.337083 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-82ab9f7e-4186-4023-bdea-1775eee890f7 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:17.337944 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-82ab9f7e-4186-4023-bdea-1775eee890f7 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:17.339360 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-82ab9f7e-4186-4023-bdea-1775eee890f7 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:17.341215 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:12:17.645238 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-82ab9f7e-4186-4023-bdea-1775eee890f7 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8fd7d2f8014b85beecc30c93bc084d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5902169366b646c7be94cb3521377225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:17.656496 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-82ab9f7e-4186-4023-bdea-1775eee890f7 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] 10.222.0.40 "GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c" status: 200 len: 1510 microversion: 2.1 time: 0.339386 Oct 26 13:12:17.676461 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1264/2457] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:17 2022] GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c => generated 1510 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:17.681694 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1fce5c95-1581-44eb-b6e5-57c63fd75efc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:17.683046 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1fce5c95-1581-44eb-b6e5-57c63fd75efc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 15a4a122-43f2-46c7-9168-722de25598c4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:17.691511 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1fce5c95-1581-44eb-b6e5-57c63fd75efc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:17.693810 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1fce5c95-1581-44eb-b6e5-57c63fd75efc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:17.694433 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1fce5c95-1581-44eb-b6e5-57c63fd75efc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:17.695304 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1fce5c95-1581-44eb-b6e5-57c63fd75efc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:17.695914 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1fce5c95-1581-44eb-b6e5-57c63fd75efc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:17.697075 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1fce5c95-1581-44eb-b6e5-57c63fd75efc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:17.945613 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1fce5c95-1581-44eb-b6e5-57c63fd75efc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:17.956928 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1fce5c95-1581-44eb-b6e5-57c63fd75efc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/15a4a122-43f2-46c7-9168-722de25598c4" status: 200 len: 1487 microversion: 2.1 time: 0.279049 Oct 26 13:12:17.957758 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1265/2458] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:17 2022] GET /compute/v2.1/servers/15a4a122-43f2-46c7-9168-722de25598c4 => generated 1487 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:17.966443 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-ce3ca7d2-3a8b-42b5-b537-7d200b92eaca req-c744b98a-ced0-479e-8012-47b793166969 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15a4a122-43f2-46c7-9168-722de25598c4", "name": "network-vif-plugged", "status": "completed", "tag": "7ab26fa1-9fdc-446d-9a28-e6555fbad93b"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:12:17.992358 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ce3ca7d2-3a8b-42b5-b537-7d200b92eaca req-c744b98a-ced0-479e-8012-47b793166969 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:17.996473 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ce3ca7d2-3a8b-42b5-b537-7d200b92eaca req-c744b98a-ced0-479e-8012-47b793166969 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:18.004527 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ce3ca7d2-3a8b-42b5-b537-7d200b92eaca req-c744b98a-ced0-479e-8012-47b793166969 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:18.019509 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-ce3ca7d2-3a8b-42b5-b537-7d200b92eaca req-c744b98a-ced0-479e-8012-47b793166969 service nova] Creating event network-vif-plugged:7ab26fa1-9fdc-446d-9a28-e6555fbad93b for instance 15a4a122-43f2-46c7-9168-722de25598c4 on n-h2-862686-1 Oct 26 13:12:18.025141 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-ce3ca7d2-3a8b-42b5-b537-7d200b92eaca req-c744b98a-ced0-479e-8012-47b793166969 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064883 Oct 26 13:12:18.026338 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1266/2459] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:12:18.033704 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4633bba9-a303-4eaa-ac89-e16facadd19e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:18.034559 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4633bba9-a303-4eaa-ac89-e16facadd19e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 15a4a122-43f2-46c7-9168-722de25598c4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:18.042006 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4633bba9-a303-4eaa-ac89-e16facadd19e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:18.042711 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4633bba9-a303-4eaa-ac89-e16facadd19e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:18.043340 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4633bba9-a303-4eaa-ac89-e16facadd19e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:18.044270 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4633bba9-a303-4eaa-ac89-e16facadd19e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:18.045762 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4633bba9-a303-4eaa-ac89-e16facadd19e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:18.046423 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4633bba9-a303-4eaa-ac89-e16facadd19e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:18.076921 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4633bba9-a303-4eaa-ac89-e16facadd19e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 15a4a122-43f2-46c7-9168-722de25598c4] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:12:18.230449 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4633bba9-a303-4eaa-ac89-e16facadd19e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "DELETE /compute/v2.1/servers/15a4a122-43f2-46c7-9168-722de25598c4" status: 204 len: 0 microversion: 2.1 time: 0.202579 Oct 26 13:12:18.231052 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1267/2460] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:12:18 2022] DELETE /compute/v2.1/servers/15a4a122-43f2-46c7-9168-722de25598c4 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:12:18.241435 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-aa37d5c9-1ae2-4092-ad9f-aeb002f560fd tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f673247f280>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:18.265851 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-aa37d5c9-1ae2-4092-ad9f-aeb002f560fd tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] HTTP exception thrown: Image not found. Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-aa37d5c9-1ae2-4092-ad9f-aeb002f560fd tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Request method failure captured: Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: request: DELETE /compute/v2.1/images/fd2de631-0fbd-4ebd-9275-f60c3845e4ef HTTP/1.1 Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTC9wyPfJuSJHapeMPJUKkbgKm2FQwvtt7BQDbWPm4GwQ8yWjgTo6lRUEA-e4jHkLSJjfv2QDJX2GMz9jukHMvyMDw_G0MjOwEgCjRSM3Ua7yPar79M8qXcqg6fT_UU9R41ThcILNxZyJfJrKJFP6QbT0FaEuXfNwh8wp6VXk-hvlMc Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: cc4a21e57f1c4fd1ab3c60f6416f8b11 Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}] Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: cc4a21e57f1c4fd1ab3c60f6416f8b11 Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ImagesTestJSON-2142360890-project Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: e3707c34798c48d584cff9dd46d9d7c0 Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ImagesTestJSON-2142360890-project Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: exception: Image not found. Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'fd2de631-0fbd-4ebd-9275-f60c3845e4ef'} Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image fd2de631-0fbd-4ebd-9275-f60c3845e4ef to delete Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fd2de631-0fbd-4ebd-9275-f60c3845e4ef could not be found. Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:18.269459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:18.273471 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:18.273471 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:18.273471 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:12:18.273471 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:12:18.273471 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:12:18.273471 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:12:18.273471 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:12:18.273471 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:12:18.273471 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 26 13:12:18.273471 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 26 13:12:18.273471 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 26 13:12:18.273471 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:18.273471 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:18.273471 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:18.273471 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:18.273471 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:18.273471 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:18.273471 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:12:18.273471 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:12:18.273471 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 26 13:12:18.273471 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:18.273471 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-aa37d5c9-1ae2-4092-ad9f-aeb002f560fd tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Returning 404 to user: Image not found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:12:18.273471 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-aa37d5c9-1ae2-4092-ad9f-aeb002f560fd tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "DELETE /compute/v2.1/images/fd2de631-0fbd-4ebd-9275-f60c3845e4ef" status: 404 len: 62 microversion: 2.1 time: 0.034786 Oct 26 13:12:18.273471 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1268/2461] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:18 2022] DELETE /compute/v2.1/images/fd2de631-0fbd-4ebd-9275-f60c3845e4ef => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 26 13:12:18.286002 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3ae935f6-fc6d-4520-9cbf-619488b17cdc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:18.286606 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3ae935f6-fc6d-4520-9cbf-619488b17cdc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 15a4a122-43f2-46c7-9168-722de25598c4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:18.296193 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3ae935f6-fc6d-4520-9cbf-619488b17cdc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:18.296790 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3ae935f6-fc6d-4520-9cbf-619488b17cdc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:18.297230 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3ae935f6-fc6d-4520-9cbf-619488b17cdc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:18.299534 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3ae935f6-fc6d-4520-9cbf-619488b17cdc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:18.300007 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3ae935f6-fc6d-4520-9cbf-619488b17cdc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:18.300436 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3ae935f6-fc6d-4520-9cbf-619488b17cdc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:18.333256 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3ae935f6-fc6d-4520-9cbf-619488b17cdc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 15a4a122-43f2-46c7-9168-722de25598c4] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:12:18.392324 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.compute.api [None req-3ae935f6-fc6d-4520-9cbf-619488b17cdc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 15a4a122-43f2-46c7-9168-722de25598c4] Instance is already in deleting state, ignoring this request Oct 26 13:12:18.393698 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3ae935f6-fc6d-4520-9cbf-619488b17cdc tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "DELETE /compute/v2.1/servers/15a4a122-43f2-46c7-9168-722de25598c4" status: 204 len: 0 microversion: 2.1 time: 0.116796 Oct 26 13:12:18.395291 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1269/2462] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:12:18 2022] DELETE /compute/v2.1/servers/15a4a122-43f2-46c7-9168-722de25598c4 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:12:18.402147 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ef21883f-a9f8-44b0-8320-3c3058f2d3f8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:18.403006 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ef21883f-a9f8-44b0-8320-3c3058f2d3f8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: cd344db8-1e3a-498b-a4b4-54b0547fc063] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:18.411465 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef21883f-a9f8-44b0-8320-3c3058f2d3f8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:18.412739 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef21883f-a9f8-44b0-8320-3c3058f2d3f8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:18.413227 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef21883f-a9f8-44b0-8320-3c3058f2d3f8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:18.414136 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef21883f-a9f8-44b0-8320-3c3058f2d3f8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:18.414598 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef21883f-a9f8-44b0-8320-3c3058f2d3f8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:18.415079 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef21883f-a9f8-44b0-8320-3c3058f2d3f8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:18.603590 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ef21883f-a9f8-44b0-8320-3c3058f2d3f8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:18.612951 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ef21883f-a9f8-44b0-8320-3c3058f2d3f8 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063" status: 200 len: 1674 microversion: 2.1 time: 0.216245 Oct 26 13:12:18.613567 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1270/2463] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:18 2022] GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063 => generated 1674 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:18.619321 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-eabaebda-fa18-44a5-85c8-e450cbd9ea7e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:18.620043 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-eabaebda-fa18-44a5-85c8-e450cbd9ea7e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 15a4a122-43f2-46c7-9168-722de25598c4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:18.627836 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eabaebda-fa18-44a5-85c8-e450cbd9ea7e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:18.628477 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eabaebda-fa18-44a5-85c8-e450cbd9ea7e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:18.628922 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eabaebda-fa18-44a5-85c8-e450cbd9ea7e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:18.629793 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eabaebda-fa18-44a5-85c8-e450cbd9ea7e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:18.630255 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eabaebda-fa18-44a5-85c8-e450cbd9ea7e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:18.631359 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eabaebda-fa18-44a5-85c8-e450cbd9ea7e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:19.433178 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-eabaebda-fa18-44a5-85c8-e450cbd9ea7e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:19.447353 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-eabaebda-fa18-44a5-85c8-e450cbd9ea7e tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/15a4a122-43f2-46c7-9168-722de25598c4" status: 200 len: 1493 microversion: 2.1 time: 0.832635 Oct 26 13:12:19.448415 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:12:19.450193 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1271/2464] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:18 2022] GET /compute/v2.1/servers/15a4a122-43f2-46c7-9168-722de25598c4 => generated 1493 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:19.461571 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-984a602e-c95a-4b25-9a9c-3c4b81094a12 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:19.462920 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-984a602e-c95a-4b25-9a9c-3c4b81094a12 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] [instance: 6555760c-8bf4-467e-80cb-cdf6eee4b93c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:19.471305 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-984a602e-c95a-4b25-9a9c-3c4b81094a12 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:19.471934 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-984a602e-c95a-4b25-9a9c-3c4b81094a12 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:19.472601 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-984a602e-c95a-4b25-9a9c-3c4b81094a12 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:19.473950 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-984a602e-c95a-4b25-9a9c-3c4b81094a12 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:19.474480 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-984a602e-c95a-4b25-9a9c-3c4b81094a12 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:19.474987 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-984a602e-c95a-4b25-9a9c-3c4b81094a12 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:20.567118 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-984a602e-c95a-4b25-9a9c-3c4b81094a12 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8fd7d2f8014b85beecc30c93bc084d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5902169366b646c7be94cb3521377225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:20.577174 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-984a602e-c95a-4b25-9a9c-3c4b81094a12 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] 10.222.0.40 "GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c" status: 200 len: 1510 microversion: 2.1 time: 1.125699 Oct 26 13:12:20.577837 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1272/2465] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:19 2022] GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c => generated 1510 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:20.596206 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-69f7ac73-b818-49b5-8c0e-a16e62d7bbd9 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:20.606614 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-69f7ac73-b818-49b5-8c0e-a16e62d7bbd9 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: cd344db8-1e3a-498b-a4b4-54b0547fc063] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:20.615263 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-69f7ac73-b818-49b5-8c0e-a16e62d7bbd9 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:20.619770 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-69f7ac73-b818-49b5-8c0e-a16e62d7bbd9 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:20.620486 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-69f7ac73-b818-49b5-8c0e-a16e62d7bbd9 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:20.621412 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-69f7ac73-b818-49b5-8c0e-a16e62d7bbd9 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:20.622087 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-69f7ac73-b818-49b5-8c0e-a16e62d7bbd9 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:20.622699 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-69f7ac73-b818-49b5-8c0e-a16e62d7bbd9 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:21.306490 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-69f7ac73-b818-49b5-8c0e-a16e62d7bbd9 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:21.316235 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-69f7ac73-b818-49b5-8c0e-a16e62d7bbd9 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063" status: 200 len: 1653 microversion: 2.1 time: 0.737362 Oct 26 13:12:21.330308 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1273/2466] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:20 2022] GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063 => generated 1653 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:21.341850 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-e774a446-dd5e-41c9-b542-7eb57d1532b7 req-8a7f4361-0ea0-4ad9-a7b1-9c2985c17a0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15a4a122-43f2-46c7-9168-722de25598c4", "name": "network-vif-unplugged", "status": "completed", "tag": "7ab26fa1-9fdc-446d-9a28-e6555fbad93b"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:12:21.357233 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e774a446-dd5e-41c9-b542-7eb57d1532b7 req-8a7f4361-0ea0-4ad9-a7b1-9c2985c17a0b service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:21.357982 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e774a446-dd5e-41c9-b542-7eb57d1532b7 req-8a7f4361-0ea0-4ad9-a7b1-9c2985c17a0b service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:21.358570 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e774a446-dd5e-41c9-b542-7eb57d1532b7 req-8a7f4361-0ea0-4ad9-a7b1-9c2985c17a0b service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:21.374035 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-e774a446-dd5e-41c9-b542-7eb57d1532b7 req-8a7f4361-0ea0-4ad9-a7b1-9c2985c17a0b service nova] Creating event network-vif-unplugged:7ab26fa1-9fdc-446d-9a28-e6555fbad93b for instance 15a4a122-43f2-46c7-9168-722de25598c4 on n-h2-862686-1 Oct 26 13:12:21.382495 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-e774a446-dd5e-41c9-b542-7eb57d1532b7 req-8a7f4361-0ea0-4ad9-a7b1-9c2985c17a0b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049537 Oct 26 13:12:21.384575 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1274/2467] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:12:21.392725 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d5d341bc-9c64-4d8c-b436-5d4d2df4d6c3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:21.395344 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d5d341bc-9c64-4d8c-b436-5d4d2df4d6c3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 15a4a122-43f2-46c7-9168-722de25598c4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:21.409135 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5d341bc-9c64-4d8c-b436-5d4d2df4d6c3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:21.410918 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5d341bc-9c64-4d8c-b436-5d4d2df4d6c3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:21.411581 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5d341bc-9c64-4d8c-b436-5d4d2df4d6c3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:21.412937 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5d341bc-9c64-4d8c-b436-5d4d2df4d6c3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:21.415528 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5d341bc-9c64-4d8c-b436-5d4d2df4d6c3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:21.416423 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5d341bc-9c64-4d8c-b436-5d4d2df4d6c3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:21.968325 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d5d341bc-9c64-4d8c-b436-5d4d2df4d6c3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3707c34798c48d584cff9dd46d9d7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4a21e57f1c4fd1ab3c60f6416f8b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:21.997782 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d5d341bc-9c64-4d8c-b436-5d4d2df4d6c3 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/15a4a122-43f2-46c7-9168-722de25598c4" status: 200 len: 1451 microversion: 2.1 time: 0.610865 Oct 26 13:12:21.999223 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1275/2468] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:21 2022] GET /compute/v2.1/servers/15a4a122-43f2-46c7-9168-722de25598c4 => generated 1451 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:22.006052 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-2cdfa9cf-5535-43a6-9a70-3b9cb8420b56 req-dcd6b079-17ad-4e25-be00-43ac63e12729 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd344db8-1e3a-498b-a4b4-54b0547fc063", "name": "network-vif-deleted", "tag": "4838ed53-ef5a-465a-9c02-b85243b9bc4c"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:12:22.020804 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-2cdfa9cf-5535-43a6-9a70-3b9cb8420b56 req-dcd6b079-17ad-4e25-be00-43ac63e12729 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:22.022195 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-2cdfa9cf-5535-43a6-9a70-3b9cb8420b56 req-dcd6b079-17ad-4e25-be00-43ac63e12729 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:22.022907 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-2cdfa9cf-5535-43a6-9a70-3b9cb8420b56 req-dcd6b079-17ad-4e25-be00-43ac63e12729 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:22.044006 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-2cdfa9cf-5535-43a6-9a70-3b9cb8420b56 req-dcd6b079-17ad-4e25-be00-43ac63e12729 service nova] Creating event network-vif-deleted:4838ed53-ef5a-465a-9c02-b85243b9bc4c for instance cd344db8-1e3a-498b-a4b4-54b0547fc063 on n-h1-862686-1 Oct 26 13:12:22.052405 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-2cdfa9cf-5535-43a6-9a70-3b9cb8420b56 req-dcd6b079-17ad-4e25-be00-43ac63e12729 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051150 Oct 26 13:12:22.054135 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1276/2469] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:12:22.066038 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ac5b05e4-8d8e-41af-925f-50b31e53f70d tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:22.066848 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ac5b05e4-8d8e-41af-925f-50b31e53f70d tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] [instance: 6555760c-8bf4-467e-80cb-cdf6eee4b93c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:22.095076 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac5b05e4-8d8e-41af-925f-50b31e53f70d tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:22.095554 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac5b05e4-8d8e-41af-925f-50b31e53f70d tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:22.096762 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac5b05e4-8d8e-41af-925f-50b31e53f70d tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:22.097951 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac5b05e4-8d8e-41af-925f-50b31e53f70d tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:22.098574 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac5b05e4-8d8e-41af-925f-50b31e53f70d tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:22.099152 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac5b05e4-8d8e-41af-925f-50b31e53f70d tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:22.522369 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ac5b05e4-8d8e-41af-925f-50b31e53f70d tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8fd7d2f8014b85beecc30c93bc084d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5902169366b646c7be94cb3521377225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:22.535031 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ac5b05e4-8d8e-41af-925f-50b31e53f70d tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] 10.222.0.40 "GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c" status: 200 len: 1468 microversion: 2.1 time: 0.479492 Oct 26 13:12:22.537894 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1277/2470] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:22 2022] GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c => generated 1468 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:22.552842 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-323560f0-80b1-4ede-a7ae-bf510a31d861 req-fc20a52d-6fbf-437b-8198-ba75fbb5f46d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15a4a122-43f2-46c7-9168-722de25598c4", "name": "network-vif-deleted", "tag": "7ab26fa1-9fdc-446d-9a28-e6555fbad93b"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:12:22.574254 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-323560f0-80b1-4ede-a7ae-bf510a31d861 req-fc20a52d-6fbf-437b-8198-ba75fbb5f46d service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:22.576000 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-323560f0-80b1-4ede-a7ae-bf510a31d861 req-fc20a52d-6fbf-437b-8198-ba75fbb5f46d service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:22.577179 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-323560f0-80b1-4ede-a7ae-bf510a31d861 req-fc20a52d-6fbf-437b-8198-ba75fbb5f46d service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:22.610295 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-323560f0-80b1-4ede-a7ae-bf510a31d861 req-fc20a52d-6fbf-437b-8198-ba75fbb5f46d service nova] Creating event network-vif-deleted:7ab26fa1-9fdc-446d-9a28-e6555fbad93b for instance 15a4a122-43f2-46c7-9168-722de25598c4 on n-h2-862686-1 Oct 26 13:12:22.618071 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-323560f0-80b1-4ede-a7ae-bf510a31d861 req-fc20a52d-6fbf-437b-8198-ba75fbb5f46d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078636 Oct 26 13:12:22.619869 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1278/2471] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:12:22.636250 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-38d7b1e3-97a3-4f56-a821-a56d1b94c59e tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:22.636981 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-38d7b1e3-97a3-4f56-a821-a56d1b94c59e tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: cd344db8-1e3a-498b-a4b4-54b0547fc063] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:22.657220 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38d7b1e3-97a3-4f56-a821-a56d1b94c59e tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:22.658007 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38d7b1e3-97a3-4f56-a821-a56d1b94c59e tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:22.662054 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38d7b1e3-97a3-4f56-a821-a56d1b94c59e tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:22.663062 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38d7b1e3-97a3-4f56-a821-a56d1b94c59e tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:22.664596 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38d7b1e3-97a3-4f56-a821-a56d1b94c59e tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:22.669296 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38d7b1e3-97a3-4f56-a821-a56d1b94c59e tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:22.748342 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38d7b1e3-97a3-4f56-a821-a56d1b94c59e tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:22.749257 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38d7b1e3-97a3-4f56-a821-a56d1b94c59e tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:22.749991 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38d7b1e3-97a3-4f56-a821-a56d1b94c59e tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:22.752946 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-38d7b1e3-97a3-4f56-a821-a56d1b94c59e tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lazy-loading 'fault' on Instance uuid cd344db8-1e3a-498b-a4b4-54b0547fc063 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:12:22.901893 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ab988fff-dfea-4acd-889a-a4a8bb7dcf91 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb/action" status: 202 len: 0 microversion: 2.1 time: 5.678459 Oct 26 13:12:22.906458 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1194/2472] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:12:17 2022] POST /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb/action => generated 0 bytes in 5684 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:12:22.911851 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-18fea19d-6cba-47c4-9544-e0dc5a1890ee tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:22.912521 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-18fea19d-6cba-47c4-9544-e0dc5a1890ee tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: f5da8a46-9260-405b-aa4e-1f1a585302bb] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:22.948690 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18fea19d-6cba-47c4-9544-e0dc5a1890ee tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:22.948690 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18fea19d-6cba-47c4-9544-e0dc5a1890ee tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:22.948690 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18fea19d-6cba-47c4-9544-e0dc5a1890ee tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:22.948690 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18fea19d-6cba-47c4-9544-e0dc5a1890ee tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:22.948690 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18fea19d-6cba-47c4-9544-e0dc5a1890ee tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:22.949057 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-38d7b1e3-97a3-4f56-a821-a56d1b94c59e tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533afbf98454632a796eea300f50a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b66b9b9c574fa799086c0733d28887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:22.949151 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18fea19d-6cba-47c4-9544-e0dc5a1890ee tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:22.951559 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-38d7b1e3-97a3-4f56-a821-a56d1b94c59e tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063" status: 200 len: 1303 microversion: 2.1 time: 0.328726 Oct 26 13:12:22.952171 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1279/2473] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:22 2022] GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063 => generated 1303 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:23.027783 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e88e2302-cc3f-41d3-a3e2-7c4a4efb6366 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:23.028457 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e88e2302-cc3f-41d3-a3e2-7c4a4efb6366 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 15a4a122-43f2-46c7-9168-722de25598c4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:23.044160 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e88e2302-cc3f-41d3-a3e2-7c4a4efb6366 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:23.045988 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e88e2302-cc3f-41d3-a3e2-7c4a4efb6366 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:23.047039 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e88e2302-cc3f-41d3-a3e2-7c4a4efb6366 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:23.049762 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e88e2302-cc3f-41d3-a3e2-7c4a4efb6366 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:23.050563 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e88e2302-cc3f-41d3-a3e2-7c4a4efb6366 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:23.051002 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e88e2302-cc3f-41d3-a3e2-7c4a4efb6366 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:23.096614 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-e88e2302-cc3f-41d3-a3e2-7c4a4efb6366 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] HTTP exception thrown: Instance 15a4a122-43f2-46c7-9168-722de25598c4 could not be found. Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e88e2302-cc3f-41d3-a3e2-7c4a4efb6366 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Request method failure captured: Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/15a4a122-43f2-46c7-9168-722de25598c4 HTTP/1.1 Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTC9wyPfJuSJHapeMPJUKkbgKm2FQwvtt7BQDbWPm4GwQ8yWjgTo6lRUEA-e4jHkLSJjfv2QDJX2GMz9jukHMvyMDw_G0MjOwEgCjRSM3Ua7yPar79M8qXcqg6fT_UU9R41ThcILNxZyJfJrKJFP6QbT0FaEuXfNwh8wp6VXk-hvlMc Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: cc4a21e57f1c4fd1ab3c60f6416f8b11 Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}] Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: cc4a21e57f1c4fd1ab3c60f6416f8b11 Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ImagesTestJSON-2142360890-project Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: e3707c34798c48d584cff9dd46d9d7c0 Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ImagesTestJSON-2142360890-project Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 15a4a122-43f2-46c7-9168-722de25598c4 could not be found. Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '15a4a122-43f2-46c7-9168-722de25598c4'} Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15a4a122-43f2-46c7-9168-722de25598c4 could not be found. Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15a4a122-43f2-46c7-9168-722de25598c4 could not be found. Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.111403 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:23.115278 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:23.115278 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:23.115278 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:12:23.115278 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:12:23.115278 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15a4a122-43f2-46c7-9168-722de25598c4 could not be found. Oct 26 13:12:23.115278 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.115278 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e88e2302-cc3f-41d3-a3e2-7c4a4efb6366 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Returning 404 to user: Instance 15a4a122-43f2-46c7-9168-722de25598c4 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:12:23.115278 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e88e2302-cc3f-41d3-a3e2-7c4a4efb6366 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/15a4a122-43f2-46c7-9168-722de25598c4" status: 404 len: 111 microversion: 2.1 time: 0.090937 Oct 26 13:12:23.120374 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1280/2474] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:23 2022] GET /compute/v2.1/servers/15a4a122-43f2-46c7-9168-722de25598c4 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 13:12:23.130472 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5a1d9463-5212-4b0b-a5bb-9ae5f2cf7d4b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:23.131052 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5a1d9463-5212-4b0b-a5bb-9ae5f2cf7d4b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 6a7c952c-3ac4-4fad-b539-13a7ed9a2056] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:23.150972 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a1d9463-5212-4b0b-a5bb-9ae5f2cf7d4b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:23.153001 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a1d9463-5212-4b0b-a5bb-9ae5f2cf7d4b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:23.154248 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a1d9463-5212-4b0b-a5bb-9ae5f2cf7d4b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:23.157053 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a1d9463-5212-4b0b-a5bb-9ae5f2cf7d4b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:23.158785 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a1d9463-5212-4b0b-a5bb-9ae5f2cf7d4b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:23.159229 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a1d9463-5212-4b0b-a5bb-9ae5f2cf7d4b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:23.205403 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-5a1d9463-5212-4b0b-a5bb-9ae5f2cf7d4b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] HTTP exception thrown: Instance 6a7c952c-3ac4-4fad-b539-13a7ed9a2056 could not be found. Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5a1d9463-5212-4b0b-a5bb-9ae5f2cf7d4b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Request method failure captured: Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: request: DELETE /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056 HTTP/1.1 Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTC9wyPfJuSJHapeMPJUKkbgKm2FQwvtt7BQDbWPm4GwQ8yWjgTo6lRUEA-e4jHkLSJjfv2QDJX2GMz9jukHMvyMDw_G0MjOwEgCjRSM3Ua7yPar79M8qXcqg6fT_UU9R41ThcILNxZyJfJrKJFP6QbT0FaEuXfNwh8wp6VXk-hvlMc Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: cc4a21e57f1c4fd1ab3c60f6416f8b11 Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}] Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: cc4a21e57f1c4fd1ab3c60f6416f8b11 Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ImagesTestJSON-2142360890-project Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: e3707c34798c48d584cff9dd46d9d7c0 Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ImagesTestJSON-2142360890-project Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 6a7c952c-3ac4-4fad-b539-13a7ed9a2056 could not be found. Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '6a7c952c-3ac4-4fad-b539-13a7ed9a2056'} Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a7c952c-3ac4-4fad-b539-13a7ed9a2056 could not be found. Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:12:23.207014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a7c952c-3ac4-4fad-b539-13a7ed9a2056 could not be found. Oct 26 13:12:23.210617 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.210617 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:23.210617 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.210617 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:23.210617 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:23.210617 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:23.210617 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:12:23.210617 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:12:23.210617 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a7c952c-3ac4-4fad-b539-13a7ed9a2056 could not be found. Oct 26 13:12:23.210617 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.210617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5a1d9463-5212-4b0b-a5bb-9ae5f2cf7d4b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Returning 404 to user: Instance 6a7c952c-3ac4-4fad-b539-13a7ed9a2056 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:12:23.210617 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5a1d9463-5212-4b0b-a5bb-9ae5f2cf7d4b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056" status: 404 len: 111 microversion: 2.1 time: 0.086968 Oct 26 13:12:23.213291 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1281/2475] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:12:23 2022] DELETE /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:12:23.219259 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4e61ba2a-0101-4a16-addb-13ad0cdbf274 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:23.220600 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4e61ba2a-0101-4a16-addb-13ad0cdbf274 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 6a7c952c-3ac4-4fad-b539-13a7ed9a2056] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:23.228344 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e61ba2a-0101-4a16-addb-13ad0cdbf274 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:23.229359 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e61ba2a-0101-4a16-addb-13ad0cdbf274 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:23.229359 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e61ba2a-0101-4a16-addb-13ad0cdbf274 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:23.230100 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e61ba2a-0101-4a16-addb-13ad0cdbf274 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:23.230600 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e61ba2a-0101-4a16-addb-13ad0cdbf274 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:23.230970 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e61ba2a-0101-4a16-addb-13ad0cdbf274 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:23.237043 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:12:23.254128 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-4e61ba2a-0101-4a16-addb-13ad0cdbf274 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] HTTP exception thrown: Instance 6a7c952c-3ac4-4fad-b539-13a7ed9a2056 could not be found. Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4e61ba2a-0101-4a16-addb-13ad0cdbf274 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Request method failure captured: Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056 HTTP/1.1 Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTC9wyPfJuSJHapeMPJUKkbgKm2FQwvtt7BQDbWPm4GwQ8yWjgTo6lRUEA-e4jHkLSJjfv2QDJX2GMz9jukHMvyMDw_G0MjOwEgCjRSM3Ua7yPar79M8qXcqg6fT_UU9R41ThcILNxZyJfJrKJFP6QbT0FaEuXfNwh8wp6VXk-hvlMc Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: cc4a21e57f1c4fd1ab3c60f6416f8b11 Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}] Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: cc4a21e57f1c4fd1ab3c60f6416f8b11 Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ImagesTestJSON-2142360890-project Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: e3707c34798c48d584cff9dd46d9d7c0 Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ImagesTestJSON-2142360890-project Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 6a7c952c-3ac4-4fad-b539-13a7ed9a2056 could not be found. Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '6a7c952c-3ac4-4fad-b539-13a7ed9a2056'} Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a7c952c-3ac4-4fad-b539-13a7ed9a2056 could not be found. Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a7c952c-3ac4-4fad-b539-13a7ed9a2056 could not be found. Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.255685 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:23.259503 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:23.259503 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:23.259503 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:12:23.259503 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:12:23.259503 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a7c952c-3ac4-4fad-b539-13a7ed9a2056 could not be found. Oct 26 13:12:23.259503 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.259503 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4e61ba2a-0101-4a16-addb-13ad0cdbf274 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Returning 404 to user: Instance 6a7c952c-3ac4-4fad-b539-13a7ed9a2056 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:12:23.259503 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4e61ba2a-0101-4a16-addb-13ad0cdbf274 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056" status: 404 len: 111 microversion: 2.1 time: 0.043919 Oct 26 13:12:23.259503 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1282/2476] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:23 2022] GET /compute/v2.1/servers/6a7c952c-3ac4-4fad-b539-13a7ed9a2056 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:12:23.269546 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4251b574-e831-4c45-9c72-286d155e5c8a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67325844c0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:23.326039 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-4251b574-e831-4c45-9c72-286d155e5c8a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] HTTP exception thrown: Image not found. Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4251b574-e831-4c45-9c72-286d155e5c8a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Request method failure captured: Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: request: DELETE /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04 HTTP/1.1 Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTC9wyPfJuSJHapeMPJUKkbgKm2FQwvtt7BQDbWPm4GwQ8yWjgTo6lRUEA-e4jHkLSJjfv2QDJX2GMz9jukHMvyMDw_G0MjOwEgCjRSM3Ua7yPar79M8qXcqg6fT_UU9R41ThcILNxZyJfJrKJFP6QbT0FaEuXfNwh8wp6VXk-hvlMc Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: cc4a21e57f1c4fd1ab3c60f6416f8b11 Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}] Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: cc4a21e57f1c4fd1ab3c60f6416f8b11 Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ImagesTestJSON-2142360890-project Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: e3707c34798c48d584cff9dd46d9d7c0 Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ImagesTestJSON-2142360890-project Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: exception: Image not found. Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '49180fbe-4c02-4e63-acc2-aec76f7e5c04'} Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 49180fbe-4c02-4e63-acc2-aec76f7e5c04 to delete Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 49180fbe-4c02-4e63-acc2-aec76f7e5c04 could not be found. Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.328582 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:23.333365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:23.333365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:23.333365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:12:23.333365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:12:23.333365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:12:23.333365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:12:23.333365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:12:23.333365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:12:23.333365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 26 13:12:23.333365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 26 13:12:23.333365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 26 13:12:23.333365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.333365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:23.333365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.333365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:23.333365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:23.333365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:23.333365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:12:23.333365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:12:23.333365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 26 13:12:23.333365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.335041 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4251b574-e831-4c45-9c72-286d155e5c8a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Returning 404 to user: Image not found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:12:23.336063 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4251b574-e831-4c45-9c72-286d155e5c8a tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "DELETE /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04" status: 404 len: 62 microversion: 2.1 time: 0.073596 Oct 26 13:12:23.337112 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1283/2477] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:23 2022] DELETE /compute/v2.1/images/49180fbe-4c02-4e63-acc2-aec76f7e5c04 => generated 62 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:12:23.347050 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e618fcd4-1bde-4ecc-b04e-2cc9233afc56 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:23.347672 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e618fcd4-1bde-4ecc-b04e-2cc9233afc56 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 31d4915d-93b9-445d-aad6-4fbc96fd5326] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:23.355765 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e618fcd4-1bde-4ecc-b04e-2cc9233afc56 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:23.356368 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e618fcd4-1bde-4ecc-b04e-2cc9233afc56 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:23.356879 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e618fcd4-1bde-4ecc-b04e-2cc9233afc56 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:23.357830 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e618fcd4-1bde-4ecc-b04e-2cc9233afc56 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:23.358062 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e618fcd4-1bde-4ecc-b04e-2cc9233afc56 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:23.358492 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e618fcd4-1bde-4ecc-b04e-2cc9233afc56 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:23.384346 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-e618fcd4-1bde-4ecc-b04e-2cc9233afc56 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] HTTP exception thrown: Instance 31d4915d-93b9-445d-aad6-4fbc96fd5326 could not be found. Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e618fcd4-1bde-4ecc-b04e-2cc9233afc56 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Request method failure captured: Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: request: DELETE /compute/v2.1/servers/31d4915d-93b9-445d-aad6-4fbc96fd5326 HTTP/1.1 Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTC9wyPfJuSJHapeMPJUKkbgKm2FQwvtt7BQDbWPm4GwQ8yWjgTo6lRUEA-e4jHkLSJjfv2QDJX2GMz9jukHMvyMDw_G0MjOwEgCjRSM3Ua7yPar79M8qXcqg6fT_UU9R41ThcILNxZyJfJrKJFP6QbT0FaEuXfNwh8wp6VXk-hvlMc Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: cc4a21e57f1c4fd1ab3c60f6416f8b11 Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}] Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: cc4a21e57f1c4fd1ab3c60f6416f8b11 Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ImagesTestJSON-2142360890-project Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: e3707c34798c48d584cff9dd46d9d7c0 Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ImagesTestJSON-2142360890-project Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 31d4915d-93b9-445d-aad6-4fbc96fd5326 could not be found. Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '31d4915d-93b9-445d-aad6-4fbc96fd5326'} Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31d4915d-93b9-445d-aad6-4fbc96fd5326 could not be found. Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:12:23.389698 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31d4915d-93b9-445d-aad6-4fbc96fd5326 could not be found. Oct 26 13:12:23.393736 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.393736 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:23.393736 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.393736 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:23.393736 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:23.393736 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:23.393736 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:12:23.393736 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:12:23.393736 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31d4915d-93b9-445d-aad6-4fbc96fd5326 could not be found. Oct 26 13:12:23.393736 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.393736 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e618fcd4-1bde-4ecc-b04e-2cc9233afc56 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Returning 404 to user: Instance 31d4915d-93b9-445d-aad6-4fbc96fd5326 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:12:23.393736 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e618fcd4-1bde-4ecc-b04e-2cc9233afc56 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "DELETE /compute/v2.1/servers/31d4915d-93b9-445d-aad6-4fbc96fd5326" status: 404 len: 111 microversion: 2.1 time: 0.047516 Oct 26 13:12:23.393736 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1284/2478] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:12:23 2022] DELETE /compute/v2.1/servers/31d4915d-93b9-445d-aad6-4fbc96fd5326 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:12:23.411673 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f7ebed25-2e01-419d-a3b9-bf2c5944e1c1 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:23.412308 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f7ebed25-2e01-419d-a3b9-bf2c5944e1c1 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 31d4915d-93b9-445d-aad6-4fbc96fd5326] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:23.424244 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7ebed25-2e01-419d-a3b9-bf2c5944e1c1 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:23.425108 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7ebed25-2e01-419d-a3b9-bf2c5944e1c1 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:23.426038 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7ebed25-2e01-419d-a3b9-bf2c5944e1c1 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:23.434095 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7ebed25-2e01-419d-a3b9-bf2c5944e1c1 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:23.434954 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7ebed25-2e01-419d-a3b9-bf2c5944e1c1 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:23.436782 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7ebed25-2e01-419d-a3b9-bf2c5944e1c1 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:23.462640 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-f7ebed25-2e01-419d-a3b9-bf2c5944e1c1 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] HTTP exception thrown: Instance 31d4915d-93b9-445d-aad6-4fbc96fd5326 could not be found. Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f7ebed25-2e01-419d-a3b9-bf2c5944e1c1 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Request method failure captured: Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/31d4915d-93b9-445d-aad6-4fbc96fd5326 HTTP/1.1 Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTC9wyPfJuSJHapeMPJUKkbgKm2FQwvtt7BQDbWPm4GwQ8yWjgTo6lRUEA-e4jHkLSJjfv2QDJX2GMz9jukHMvyMDw_G0MjOwEgCjRSM3Ua7yPar79M8qXcqg6fT_UU9R41ThcILNxZyJfJrKJFP6QbT0FaEuXfNwh8wp6VXk-hvlMc Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: cc4a21e57f1c4fd1ab3c60f6416f8b11 Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}] Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: cc4a21e57f1c4fd1ab3c60f6416f8b11 Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ImagesTestJSON-2142360890-project Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: e3707c34798c48d584cff9dd46d9d7c0 Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ImagesTestJSON-2142360890-project Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 31d4915d-93b9-445d-aad6-4fbc96fd5326 could not be found. Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '31d4915d-93b9-445d-aad6-4fbc96fd5326'} Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31d4915d-93b9-445d-aad6-4fbc96fd5326 could not be found. Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31d4915d-93b9-445d-aad6-4fbc96fd5326 could not be found. Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.464351 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:23.468418 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:23.468418 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:23.468418 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:12:23.468418 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:12:23.468418 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31d4915d-93b9-445d-aad6-4fbc96fd5326 could not be found. Oct 26 13:12:23.468418 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.470585 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f7ebed25-2e01-419d-a3b9-bf2c5944e1c1 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Returning 404 to user: Instance 31d4915d-93b9-445d-aad6-4fbc96fd5326 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:12:23.471727 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f7ebed25-2e01-419d-a3b9-bf2c5944e1c1 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/31d4915d-93b9-445d-aad6-4fbc96fd5326" status: 404 len: 111 microversion: 2.1 time: 0.077242 Oct 26 13:12:23.472739 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1285/2479] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:23 2022] GET /compute/v2.1/servers/31d4915d-93b9-445d-aad6-4fbc96fd5326 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 13:12:23.482505 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-79bc4462-0998-4c9b-aa6d-f1d3afe2baba tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f673246bc10>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:23.489389 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-18fea19d-6cba-47c4-9544-e0dc5a1890ee tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:23.502567 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-18fea19d-6cba-47c4-9544-e0dc5a1890ee tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb" status: 200 len: 1504 microversion: 2.1 time: 0.590689 Oct 26 13:12:23.505028 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1195/2480] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:22 2022] GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb => generated 1504 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:23.511941 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-79bc4462-0998-4c9b-aa6d-f1d3afe2baba tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] HTTP exception thrown: Image not found. Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-79bc4462-0998-4c9b-aa6d-f1d3afe2baba tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Request method failure captured: Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: request: DELETE /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc HTTP/1.1 Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTC9wyPfJuSJHapeMPJUKkbgKm2FQwvtt7BQDbWPm4GwQ8yWjgTo6lRUEA-e4jHkLSJjfv2QDJX2GMz9jukHMvyMDw_G0MjOwEgCjRSM3Ua7yPar79M8qXcqg6fT_UU9R41ThcILNxZyJfJrKJFP6QbT0FaEuXfNwh8wp6VXk-hvlMc Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: cc4a21e57f1c4fd1ab3c60f6416f8b11 Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}] Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: cc4a21e57f1c4fd1ab3c60f6416f8b11 Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ImagesTestJSON-2142360890-project Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: e3707c34798c48d584cff9dd46d9d7c0 Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ImagesTestJSON-2142360890-project Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: exception: Image not found. Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '23c63297-4e51-4299-a2d6-a16c3bc578fc'} Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 23c63297-4e51-4299-a2d6-a16c3bc578fc to delete Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 23c63297-4e51-4299-a2d6-a16c3bc578fc could not be found. Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.514002 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:23.518987 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:23.518987 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:23.518987 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:12:23.518987 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:12:23.518987 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:12:23.518987 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:12:23.518987 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:12:23.518987 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:12:23.518987 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 26 13:12:23.518987 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 26 13:12:23.518987 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 26 13:12:23.518987 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.518987 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:23.518987 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.518987 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:23.518987 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:23.518987 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:23.518987 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:12:23.518987 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:12:23.518987 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 26 13:12:23.518987 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.521036 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-79bc4462-0998-4c9b-aa6d-f1d3afe2baba tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Returning 404 to user: Image not found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:12:23.522435 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-79bc4462-0998-4c9b-aa6d-f1d3afe2baba tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "DELETE /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc" status: 404 len: 62 microversion: 2.1 time: 0.045504 Oct 26 13:12:23.523397 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1286/2481] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:23 2022] DELETE /compute/v2.1/images/23c63297-4e51-4299-a2d6-a16c3bc578fc => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 26 13:12:23.534070 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2ceaec75-4fe5-4e76-931a-20e859290765 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:23.535121 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2ceaec75-4fe5-4e76-931a-20e859290765 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: cb087101-2eda-4145-bdcc-41673edfcbb7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:23.548155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ceaec75-4fe5-4e76-931a-20e859290765 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:23.548661 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ceaec75-4fe5-4e76-931a-20e859290765 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:23.549102 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ceaec75-4fe5-4e76-931a-20e859290765 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:23.549846 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ceaec75-4fe5-4e76-931a-20e859290765 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:23.550301 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ceaec75-4fe5-4e76-931a-20e859290765 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:23.550724 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ceaec75-4fe5-4e76-931a-20e859290765 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:23.564236 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-284e6969-da68-4340-84fa-4f1494235166 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:23.565434 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-284e6969-da68-4340-84fa-4f1494235166 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] [instance: 6555760c-8bf4-467e-80cb-cdf6eee4b93c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:23.585409 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-284e6969-da68-4340-84fa-4f1494235166 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:23.590394 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-284e6969-da68-4340-84fa-4f1494235166 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:23.592913 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-284e6969-da68-4340-84fa-4f1494235166 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:23.593720 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-284e6969-da68-4340-84fa-4f1494235166 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:23.599388 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-284e6969-da68-4340-84fa-4f1494235166 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:23.600171 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-284e6969-da68-4340-84fa-4f1494235166 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:23.604053 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-2ceaec75-4fe5-4e76-931a-20e859290765 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] HTTP exception thrown: Instance cb087101-2eda-4145-bdcc-41673edfcbb7 could not be found. Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2ceaec75-4fe5-4e76-931a-20e859290765 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Request method failure captured: Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/servers/cb087101-2eda-4145-bdcc-41673edfcbb7 HTTP/1.1 Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTC9wyPfJuSJHapeMPJUKkbgKm2FQwvtt7BQDbWPm4GwQ8yWjgTo6lRUEA-e4jHkLSJjfv2QDJX2GMz9jukHMvyMDw_G0MjOwEgCjRSM3Ua7yPar79M8qXcqg6fT_UU9R41ThcILNxZyJfJrKJFP6QbT0FaEuXfNwh8wp6VXk-hvlMc Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: cc4a21e57f1c4fd1ab3c60f6416f8b11 Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}] Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: cc4a21e57f1c4fd1ab3c60f6416f8b11 Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ImagesTestJSON-2142360890-project Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: e3707c34798c48d584cff9dd46d9d7c0 Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ImagesTestJSON-2142360890-project Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance cb087101-2eda-4145-bdcc-41673edfcbb7 could not be found. Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'cb087101-2eda-4145-bdcc-41673edfcbb7'} Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb087101-2eda-4145-bdcc-41673edfcbb7 could not be found. Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:12:23.612311 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb087101-2eda-4145-bdcc-41673edfcbb7 could not be found. Oct 26 13:12:23.616708 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.616708 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:23.616708 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.616708 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:23.616708 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:23.616708 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:23.616708 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:12:23.616708 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:12:23.616708 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb087101-2eda-4145-bdcc-41673edfcbb7 could not be found. Oct 26 13:12:23.616708 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.616708 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2ceaec75-4fe5-4e76-931a-20e859290765 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Returning 404 to user: Instance cb087101-2eda-4145-bdcc-41673edfcbb7 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:12:23.616708 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2ceaec75-4fe5-4e76-931a-20e859290765 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "DELETE /compute/v2.1/servers/cb087101-2eda-4145-bdcc-41673edfcbb7" status: 404 len: 111 microversion: 2.1 time: 0.088625 Oct 26 13:12:23.621837 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1196/2482] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:12:23 2022] DELETE /compute/v2.1/servers/cb087101-2eda-4145-bdcc-41673edfcbb7 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:12:23.649572 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-03319718-78d2-46f6-a058-f944176d9e37 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:23.651551 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-03319718-78d2-46f6-a058-f944176d9e37 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: cb087101-2eda-4145-bdcc-41673edfcbb7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:23.687266 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03319718-78d2-46f6-a058-f944176d9e37 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:23.692756 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03319718-78d2-46f6-a058-f944176d9e37 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:23.696079 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03319718-78d2-46f6-a058-f944176d9e37 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:23.697173 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03319718-78d2-46f6-a058-f944176d9e37 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:23.698922 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-284e6969-da68-4340-84fa-4f1494235166 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:23.700108 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03319718-78d2-46f6-a058-f944176d9e37 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:23.700996 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-284e6969-da68-4340-84fa-4f1494235166 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:23.701811 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-284e6969-da68-4340-84fa-4f1494235166 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:23.704574 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03319718-78d2-46f6-a058-f944176d9e37 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:23.705503 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-284e6969-da68-4340-84fa-4f1494235166 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lazy-loading 'fault' on Instance uuid 6555760c-8bf4-467e-80cb-cdf6eee4b93c {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:12:23.744559 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-03319718-78d2-46f6-a058-f944176d9e37 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] HTTP exception thrown: Instance cb087101-2eda-4145-bdcc-41673edfcbb7 could not be found. Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-03319718-78d2-46f6-a058-f944176d9e37 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Request method failure captured: Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/cb087101-2eda-4145-bdcc-41673edfcbb7 HTTP/1.1 Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTC9wyPfJuSJHapeMPJUKkbgKm2FQwvtt7BQDbWPm4GwQ8yWjgTo6lRUEA-e4jHkLSJjfv2QDJX2GMz9jukHMvyMDw_G0MjOwEgCjRSM3Ua7yPar79M8qXcqg6fT_UU9R41ThcILNxZyJfJrKJFP6QbT0FaEuXfNwh8wp6VXk-hvlMc Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: cc4a21e57f1c4fd1ab3c60f6416f8b11 Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}] Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: cc4a21e57f1c4fd1ab3c60f6416f8b11 Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ImagesTestJSON-2142360890-project Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: e3707c34798c48d584cff9dd46d9d7c0 Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ImagesTestJSON-2142360890-project Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance cb087101-2eda-4145-bdcc-41673edfcbb7 could not be found. Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'cb087101-2eda-4145-bdcc-41673edfcbb7'} Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb087101-2eda-4145-bdcc-41673edfcbb7 could not be found. Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb087101-2eda-4145-bdcc-41673edfcbb7 could not be found. Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.749745 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:23.756064 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:23.756064 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:23.756064 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:12:23.756064 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:12:23.756064 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb087101-2eda-4145-bdcc-41673edfcbb7 could not be found. Oct 26 13:12:23.756064 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.758967 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-03319718-78d2-46f6-a058-f944176d9e37 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Returning 404 to user: Instance cb087101-2eda-4145-bdcc-41673edfcbb7 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:12:23.764147 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-03319718-78d2-46f6-a058-f944176d9e37 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/cb087101-2eda-4145-bdcc-41673edfcbb7" status: 404 len: 111 microversion: 2.1 time: 0.129461 Oct 26 13:12:23.767854 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1197/2483] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:23 2022] GET /compute/v2.1/servers/cb087101-2eda-4145-bdcc-41673edfcbb7 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 13:12:23.775507 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ab07fa58-4502-417e-8ec7-1d5e9f75a82b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f67322c9940>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:23.783479 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-284e6969-da68-4340-84fa-4f1494235166 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8fd7d2f8014b85beecc30c93bc084d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5902169366b646c7be94cb3521377225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:23.793586 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-284e6969-da68-4340-84fa-4f1494235166 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] 10.222.0.40 "GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c" status: 200 len: 1313 microversion: 2.1 time: 0.235672 Oct 26 13:12:23.815228 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1287/2484] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:23 2022] GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:23.823641 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-ab07fa58-4502-417e-8ec7-1d5e9f75a82b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] HTTP exception thrown: Image not found. Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ab07fa58-4502-417e-8ec7-1d5e9f75a82b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Request method failure captured: Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/images/7d91cde1-e33e-4251-b5c9-7baac06f15a0 HTTP/1.1 Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTC9wyPfJuSJHapeMPJUKkbgKm2FQwvtt7BQDbWPm4GwQ8yWjgTo6lRUEA-e4jHkLSJjfv2QDJX2GMz9jukHMvyMDw_G0MjOwEgCjRSM3Ua7yPar79M8qXcqg6fT_UU9R41ThcILNxZyJfJrKJFP6QbT0FaEuXfNwh8wp6VXk-hvlMc Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: cc4a21e57f1c4fd1ab3c60f6416f8b11 Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}] Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: cc4a21e57f1c4fd1ab3c60f6416f8b11 Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ImagesTestJSON-2142360890-project Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: e3707c34798c48d584cff9dd46d9d7c0 Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ImagesTestJSON-2142360890-project Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: method: Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: exception: Image not found. Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '7d91cde1-e33e-4251-b5c9-7baac06f15a0'} Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7d91cde1-e33e-4251-b5c9-7baac06f15a0 to delete Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7d91cde1-e33e-4251-b5c9-7baac06f15a0 could not be found. Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.825885 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:23.830254 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:23.830254 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:23.830254 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:12:23.830254 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:12:23.830254 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:12:23.830254 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:12:23.830254 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:12:23.830254 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:12:23.830254 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 26 13:12:23.830254 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 26 13:12:23.830254 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 26 13:12:23.830254 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.830254 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:23.830254 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.830254 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:23.830254 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:23.830254 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:23.830254 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:12:23.830254 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:12:23.830254 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 26 13:12:23.830254 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.833009 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ab07fa58-4502-417e-8ec7-1d5e9f75a82b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Returning 404 to user: Image not found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:12:23.834116 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ab07fa58-4502-417e-8ec7-1d5e9f75a82b tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "DELETE /compute/v2.1/images/7d91cde1-e33e-4251-b5c9-7baac06f15a0" status: 404 len: 62 microversion: 2.1 time: 0.063063 Oct 26 13:12:23.834955 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1198/2485] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:23 2022] DELETE /compute/v2.1/images/7d91cde1-e33e-4251-b5c9-7baac06f15a0 => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:12:23.848077 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7ff57b4e-cb73-4b66-b867-518bff5b2e2d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:23.848972 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7ff57b4e-cb73-4b66-b867-518bff5b2e2d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: d426a4f6-fa08-47d2-a583-735600b77f27] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:23.856568 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ff57b4e-cb73-4b66-b867-518bff5b2e2d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:23.857436 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ff57b4e-cb73-4b66-b867-518bff5b2e2d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:23.858170 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ff57b4e-cb73-4b66-b867-518bff5b2e2d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:23.859206 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ff57b4e-cb73-4b66-b867-518bff5b2e2d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:23.859977 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ff57b4e-cb73-4b66-b867-518bff5b2e2d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:23.861446 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ff57b4e-cb73-4b66-b867-518bff5b2e2d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:23.897070 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-7ff57b4e-cb73-4b66-b867-518bff5b2e2d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] HTTP exception thrown: Instance d426a4f6-fa08-47d2-a583-735600b77f27 could not be found. Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7ff57b4e-cb73-4b66-b867-518bff5b2e2d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Request method failure captured: Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: request: DELETE /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27 HTTP/1.1 Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTC9wyPfJuSJHapeMPJUKkbgKm2FQwvtt7BQDbWPm4GwQ8yWjgTo6lRUEA-e4jHkLSJjfv2QDJX2GMz9jukHMvyMDw_G0MjOwEgCjRSM3Ua7yPar79M8qXcqg6fT_UU9R41ThcILNxZyJfJrKJFP6QbT0FaEuXfNwh8wp6VXk-hvlMc Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: cc4a21e57f1c4fd1ab3c60f6416f8b11 Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}] Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: cc4a21e57f1c4fd1ab3c60f6416f8b11 Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ImagesTestJSON-2142360890-project Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: e3707c34798c48d584cff9dd46d9d7c0 Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ImagesTestJSON-2142360890-project Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance d426a4f6-fa08-47d2-a583-735600b77f27 could not be found. Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'd426a4f6-fa08-47d2-a583-735600b77f27'} Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d426a4f6-fa08-47d2-a583-735600b77f27 could not be found. Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:12:23.902575 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d426a4f6-fa08-47d2-a583-735600b77f27 could not be found. Oct 26 13:12:23.909605 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.909605 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:23.909605 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.909605 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:23.909605 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:23.909605 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:23.909605 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:12:23.909605 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:12:23.909605 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d426a4f6-fa08-47d2-a583-735600b77f27 could not be found. Oct 26 13:12:23.909605 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.913611 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7ff57b4e-cb73-4b66-b867-518bff5b2e2d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Returning 404 to user: Instance d426a4f6-fa08-47d2-a583-735600b77f27 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:12:23.918422 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7ff57b4e-cb73-4b66-b867-518bff5b2e2d tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27" status: 404 len: 111 microversion: 2.1 time: 0.078665 Oct 26 13:12:23.924715 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1288/2486] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:12:23 2022] DELETE /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 13:12:23.935900 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f800877f-7cbe-444c-84f6-78f9074ff4e0 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:23.936598 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f800877f-7cbe-444c-84f6-78f9074ff4e0 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: d426a4f6-fa08-47d2-a583-735600b77f27] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:23.946921 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f800877f-7cbe-444c-84f6-78f9074ff4e0 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:23.948076 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f800877f-7cbe-444c-84f6-78f9074ff4e0 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:23.949164 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f800877f-7cbe-444c-84f6-78f9074ff4e0 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:23.954087 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f800877f-7cbe-444c-84f6-78f9074ff4e0 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:23.954757 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f800877f-7cbe-444c-84f6-78f9074ff4e0 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:23.955395 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f800877f-7cbe-444c-84f6-78f9074ff4e0 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:23.982506 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bc9fc17f-1bc6-4f8d-91e5-5e16613bba0a tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:23.983288 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bc9fc17f-1bc6-4f8d-91e5-5e16613bba0a tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: cd344db8-1e3a-498b-a4b4-54b0547fc063] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:23.996246 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-f800877f-7cbe-444c-84f6-78f9074ff4e0 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] HTTP exception thrown: Instance d426a4f6-fa08-47d2-a583-735600b77f27 could not be found. Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f800877f-7cbe-444c-84f6-78f9074ff4e0 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Request method failure captured: Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27 HTTP/1.1 Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTC9wyPfJuSJHapeMPJUKkbgKm2FQwvtt7BQDbWPm4GwQ8yWjgTo6lRUEA-e4jHkLSJjfv2QDJX2GMz9jukHMvyMDw_G0MjOwEgCjRSM3Ua7yPar79M8qXcqg6fT_UU9R41ThcILNxZyJfJrKJFP6QbT0FaEuXfNwh8wp6VXk-hvlMc Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: cc4a21e57f1c4fd1ab3c60f6416f8b11 Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}] Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: cc4a21e57f1c4fd1ab3c60f6416f8b11 Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ImagesTestJSON-2142360890-project Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: e3707c34798c48d584cff9dd46d9d7c0 Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ImagesTestJSON-2142360890-project Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance d426a4f6-fa08-47d2-a583-735600b77f27 could not be found. Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'd426a4f6-fa08-47d2-a583-735600b77f27'} Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d426a4f6-fa08-47d2-a583-735600b77f27 could not be found. Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d426a4f6-fa08-47d2-a583-735600b77f27 could not be found. Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:23.998558 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:24.004631 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:24.004631 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:24.004631 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:12:24.004631 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:12:24.004631 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d426a4f6-fa08-47d2-a583-735600b77f27 could not be found. Oct 26 13:12:24.004631 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:24.005314 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc9fc17f-1bc6-4f8d-91e5-5e16613bba0a tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:24.005314 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc9fc17f-1bc6-4f8d-91e5-5e16613bba0a tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:24.005314 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc9fc17f-1bc6-4f8d-91e5-5e16613bba0a tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:24.005314 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc9fc17f-1bc6-4f8d-91e5-5e16613bba0a tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:24.007240 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc9fc17f-1bc6-4f8d-91e5-5e16613bba0a tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:24.007676 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f800877f-7cbe-444c-84f6-78f9074ff4e0 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Returning 404 to user: Instance d426a4f6-fa08-47d2-a583-735600b77f27 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:12:24.007955 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc9fc17f-1bc6-4f8d-91e5-5e16613bba0a tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:24.008928 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f800877f-7cbe-444c-84f6-78f9074ff4e0 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27" status: 404 len: 111 microversion: 2.1 time: 0.079880 Oct 26 13:12:24.013094 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1199/2487] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:23 2022] GET /compute/v2.1/servers/d426a4f6-fa08-47d2-a583-735600b77f27 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:12:24.021962 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-78f435cc-cfde-4037-8b2b-b2383dda6ff2 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '.version_select at 0x7f6732270670>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:24.052838 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-bc9fc17f-1bc6-4f8d-91e5-5e16613bba0a tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] HTTP exception thrown: Instance cd344db8-1e3a-498b-a4b4-54b0547fc063 could not be found. Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bc9fc17f-1bc6-4f8d-91e5-5e16613bba0a tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Request method failure captured: Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063 HTTP/1.1 Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTGuhT7Zbi_z_79A643Bxrqd2bB1VSqRYm6Jz4GuY9ExeFNGPXsuj7LBA9BXTdnCCGYDf6Ao3eaTBgELBCBSA6CFliksv3ntCDdpWnInF_PADrDmI3-58eMChsVyT9aHxLDdXaI6vgwbjOYl9-AB53UwK2Q7tevLaF23CDZGjXumZmg Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 23b66b9b9c574fa799086c0733d28887 Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersTestMultiNic-1880926120 Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/23b66b9b9c574fa799086c0733d28887"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/23b66b9b9c574fa799086c0733d28887"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_23b66b9b9c574fa799086c0733d28887"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/23b66b9b9c574fa799086c0733d28887"}]}] Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersTestMultiNic-1880926120 Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 23b66b9b9c574fa799086c0733d28887 Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersTestMultiNic-1880926120 Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersTestMultiNic-1880926120-project Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: c533afbf98454632a796eea300f50a35 Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersTestMultiNic-1880926120-project Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance cd344db8-1e3a-498b-a4b4-54b0547fc063 could not be found. Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'cd344db8-1e3a-498b-a4b4-54b0547fc063'} Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd344db8-1e3a-498b-a4b4-54b0547fc063 could not be found. Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd344db8-1e3a-498b-a4b4-54b0547fc063 could not be found. Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:24.062641 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:24.067180 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:24.067180 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:24.067180 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:24.067180 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:12:24.067180 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:12:24.067180 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd344db8-1e3a-498b-a4b4-54b0547fc063 could not be found. Oct 26 13:12:24.067180 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:24.067180 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bc9fc17f-1bc6-4f8d-91e5-5e16613bba0a tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Returning 404 to user: Instance cd344db8-1e3a-498b-a4b4-54b0547fc063 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:12:24.067180 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bc9fc17f-1bc6-4f8d-91e5-5e16613bba0a tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063" status: 404 len: 111 microversion: 2.1 time: 0.088372 Oct 26 13:12:24.067180 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1289/2488] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:23 2022] GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:12:24.076662 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-78f435cc-cfde-4037-8b2b-b2383dda6ff2 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] HTTP exception thrown: Image not found. Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-78f435cc-cfde-4037-8b2b-b2383dda6ff2 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Request method failure captured: Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/images/ac122a22-843b-441e-bc8c-3e65b4dbcf63 HTTP/1.1 Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTC9wyPfJuSJHapeMPJUKkbgKm2FQwvtt7BQDbWPm4GwQ8yWjgTo6lRUEA-e4jHkLSJjfv2QDJX2GMz9jukHMvyMDw_G0MjOwEgCjRSM3Ua7yPar79M8qXcqg6fT_UU9R41ThcILNxZyJfJrKJFP6QbT0FaEuXfNwh8wp6VXk-hvlMc Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: cc4a21e57f1c4fd1ab3c60f6416f8b11 Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}] Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: cc4a21e57f1c4fd1ab3c60f6416f8b11 Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ImagesTestJSON-2142360890-project Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: e3707c34798c48d584cff9dd46d9d7c0 Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ImagesTestJSON-2142360890-project Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: method: Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: exception: Image not found. Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'ac122a22-843b-441e-bc8c-3e65b4dbcf63'} Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ac122a22-843b-441e-bc8c-3e65b4dbcf63 to delete Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ac122a22-843b-441e-bc8c-3e65b4dbcf63 could not be found. Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:24.078816 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:24.082672 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:24.082672 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:24.082672 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:12:24.082672 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:12:24.082672 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:12:24.082672 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:12:24.082672 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:12:24.082672 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:12:24.082672 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 26 13:12:24.082672 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 26 13:12:24.082672 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 26 13:12:24.082672 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:24.082672 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:24.082672 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:24.082672 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:24.082672 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:24.082672 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:24.082672 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:12:24.082672 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:12:24.082672 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 26 13:12:24.082672 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:24.082672 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-78f435cc-cfde-4037-8b2b-b2383dda6ff2 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Returning 404 to user: Image not found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:12:24.082672 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-78f435cc-cfde-4037-8b2b-b2383dda6ff2 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "DELETE /compute/v2.1/images/ac122a22-843b-441e-bc8c-3e65b4dbcf63" status: 404 len: 62 microversion: 2.1 time: 0.065933 Oct 26 13:12:24.086441 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1200/2489] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:24 2022] DELETE /compute/v2.1/images/ac122a22-843b-441e-bc8c-3e65b4dbcf63 => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:12:24.089933 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bddb8088-4df4-47c5-8b33-44b717f34400 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:24.090734 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bddb8088-4df4-47c5-8b33-44b717f34400 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 7fc68c75-8598-4bc7-b96b-852f31f09781] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:24.100617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bddb8088-4df4-47c5-8b33-44b717f34400 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:24.104521 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bddb8088-4df4-47c5-8b33-44b717f34400 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:24.105163 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bddb8088-4df4-47c5-8b33-44b717f34400 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:24.106296 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bddb8088-4df4-47c5-8b33-44b717f34400 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:24.107564 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bddb8088-4df4-47c5-8b33-44b717f34400 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:24.108026 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bddb8088-4df4-47c5-8b33-44b717f34400 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:24.108817 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-50c22c36-ee76-4389-b991-f151400d505a req-967a81a8-9f7e-46ef-9b7a-ebd78a6bf371 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd344db8-1e3a-498b-a4b4-54b0547fc063", "name": "network-vif-deleted", "tag": "10871312-274d-4b5f-8a2c-029559f9cb48"}, {"server_uuid": "6555760c-8bf4-467e-80cb-cdf6eee4b93c", "name": "network-vif-deleted", "tag": "16bdf5c3-e3cb-4e23-93c3-2342697bd561"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:12:24.145453 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-50c22c36-ee76-4389-b991-f151400d505a req-967a81a8-9f7e-46ef-9b7a-ebd78a6bf371 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:24.146380 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-50c22c36-ee76-4389-b991-f151400d505a req-967a81a8-9f7e-46ef-9b7a-ebd78a6bf371 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:24.147292 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-50c22c36-ee76-4389-b991-f151400d505a req-967a81a8-9f7e-46ef-9b7a-ebd78a6bf371 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:24.150200 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-bddb8088-4df4-47c5-8b33-44b717f34400 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] HTTP exception thrown: Instance 7fc68c75-8598-4bc7-b96b-852f31f09781 could not be found. Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bddb8088-4df4-47c5-8b33-44b717f34400 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Request method failure captured: Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: request: DELETE /compute/v2.1/servers/7fc68c75-8598-4bc7-b96b-852f31f09781 HTTP/1.1 Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTC9wyPfJuSJHapeMPJUKkbgKm2FQwvtt7BQDbWPm4GwQ8yWjgTo6lRUEA-e4jHkLSJjfv2QDJX2GMz9jukHMvyMDw_G0MjOwEgCjRSM3Ua7yPar79M8qXcqg6fT_UU9R41ThcILNxZyJfJrKJFP6QbT0FaEuXfNwh8wp6VXk-hvlMc Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: cc4a21e57f1c4fd1ab3c60f6416f8b11 Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}] Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: cc4a21e57f1c4fd1ab3c60f6416f8b11 Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ImagesTestJSON-2142360890-project Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: e3707c34798c48d584cff9dd46d9d7c0 Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ImagesTestJSON-2142360890-project Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 7fc68c75-8598-4bc7-b96b-852f31f09781 could not be found. Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '7fc68c75-8598-4bc7-b96b-852f31f09781'} Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fc68c75-8598-4bc7-b96b-852f31f09781 could not be found. Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:12:24.151786 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fc68c75-8598-4bc7-b96b-852f31f09781 could not be found. Oct 26 13:12:24.155871 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:24.155871 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:24.155871 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:24.155871 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:24.155871 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:24.155871 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:24.155871 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:12:24.155871 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:12:24.155871 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fc68c75-8598-4bc7-b96b-852f31f09781 could not be found. Oct 26 13:12:24.155871 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:24.155871 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bddb8088-4df4-47c5-8b33-44b717f34400 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Returning 404 to user: Instance 7fc68c75-8598-4bc7-b96b-852f31f09781 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:12:24.155871 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bddb8088-4df4-47c5-8b33-44b717f34400 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7fc68c75-8598-4bc7-b96b-852f31f09781" status: 404 len: 111 microversion: 2.1 time: 0.067991 Oct 26 13:12:24.168306 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1290/2490] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:12:24 2022] DELETE /compute/v2.1/servers/7fc68c75-8598-4bc7-b96b-852f31f09781 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:12:24.173673 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-50c22c36-ee76-4389-b991-f151400d505a req-967a81a8-9f7e-46ef-9b7a-ebd78a6bf371 service nova] Creating event network-vif-deleted:10871312-274d-4b5f-8a2c-029559f9cb48 for instance cd344db8-1e3a-498b-a4b4-54b0547fc063 on n-h1-862686-1 Oct 26 13:12:24.173832 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1a2fddb3-7b63-4ed9-b1b9-5511afce0702 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:24.174418 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1a2fddb3-7b63-4ed9-b1b9-5511afce0702 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] [instance: 7fc68c75-8598-4bc7-b96b-852f31f09781] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:24.174937 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-50c22c36-ee76-4389-b991-f151400d505a req-967a81a8-9f7e-46ef-9b7a-ebd78a6bf371 service nova] Creating event network-vif-deleted:16bdf5c3-e3cb-4e23-93c3-2342697bd561 for instance 6555760c-8bf4-467e-80cb-cdf6eee4b93c on n-h1-862686-1 Oct 26 13:12:24.180730 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a2fddb3-7b63-4ed9-b1b9-5511afce0702 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:24.181224 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a2fddb3-7b63-4ed9-b1b9-5511afce0702 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:24.181802 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a2fddb3-7b63-4ed9-b1b9-5511afce0702 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:24.182509 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a2fddb3-7b63-4ed9-b1b9-5511afce0702 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:24.182965 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a2fddb3-7b63-4ed9-b1b9-5511afce0702 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:24.183394 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a2fddb3-7b63-4ed9-b1b9-5511afce0702 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:24.185376 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-50c22c36-ee76-4389-b991-f151400d505a req-967a81a8-9f7e-46ef-9b7a-ebd78a6bf371 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.081175 Oct 26 13:12:24.186666 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1201/2491] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:12:24.199590 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-1a2fddb3-7b63-4ed9-b1b9-5511afce0702 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] HTTP exception thrown: Instance 7fc68c75-8598-4bc7-b96b-852f31f09781 could not be found. Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1a2fddb3-7b63-4ed9-b1b9-5511afce0702 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Request method failure captured: Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/7fc68c75-8598-4bc7-b96b-852f31f09781 HTTP/1.1 Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTC9wyPfJuSJHapeMPJUKkbgKm2FQwvtt7BQDbWPm4GwQ8yWjgTo6lRUEA-e4jHkLSJjfv2QDJX2GMz9jukHMvyMDw_G0MjOwEgCjRSM3Ua7yPar79M8qXcqg6fT_UU9R41ThcILNxZyJfJrKJFP6QbT0FaEuXfNwh8wp6VXk-hvlMc Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: cc4a21e57f1c4fd1ab3c60f6416f8b11 Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cc4a21e57f1c4fd1ab3c60f6416f8b11"}]}] Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: cc4a21e57f1c4fd1ab3c60f6416f8b11 Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ImagesTestJSON-2142360890 Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ImagesTestJSON-2142360890-project Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: e3707c34798c48d584cff9dd46d9d7c0 Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ImagesTestJSON-2142360890-project Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 7fc68c75-8598-4bc7-b96b-852f31f09781 could not be found. Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '7fc68c75-8598-4bc7-b96b-852f31f09781'} Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fc68c75-8598-4bc7-b96b-852f31f09781 could not be found. Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fc68c75-8598-4bc7-b96b-852f31f09781 could not be found. Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:24.201153 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:24.208911 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:24.208911 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:24.208911 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:12:24.208911 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:12:24.208911 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fc68c75-8598-4bc7-b96b-852f31f09781 could not be found. Oct 26 13:12:24.208911 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:24.208911 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1a2fddb3-7b63-4ed9-b1b9-5511afce0702 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] Returning 404 to user: Instance 7fc68c75-8598-4bc7-b96b-852f31f09781 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:12:24.208911 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1a2fddb3-7b63-4ed9-b1b9-5511afce0702 tempest-ImagesTestJSON-2142360890 tempest-ImagesTestJSON-2142360890-project] 10.222.0.40 "GET /compute/v2.1/servers/7fc68c75-8598-4bc7-b96b-852f31f09781" status: 404 len: 111 microversion: 2.1 time: 0.033290 Oct 26 13:12:24.208911 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1291/2492] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:24 2022] GET /compute/v2.1/servers/7fc68c75-8598-4bc7-b96b-852f31f09781 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:12:24.531387 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a787b18a-725b-404f-be75-dc6d8cf09b98 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:24.532258 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a787b18a-725b-404f-be75-dc6d8cf09b98 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: f5da8a46-9260-405b-aa4e-1f1a585302bb] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:24.542131 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a787b18a-725b-404f-be75-dc6d8cf09b98 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:24.542615 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a787b18a-725b-404f-be75-dc6d8cf09b98 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:24.543051 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a787b18a-725b-404f-be75-dc6d8cf09b98 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:24.543756 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a787b18a-725b-404f-be75-dc6d8cf09b98 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:24.544205 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a787b18a-725b-404f-be75-dc6d8cf09b98 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:24.544634 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a787b18a-725b-404f-be75-dc6d8cf09b98 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:24.816181 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7b082e91-00a5-4f58-a80e-ca40a7e151b5 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:24.816798 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7b082e91-00a5-4f58-a80e-ca40a7e151b5 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] [instance: 6555760c-8bf4-467e-80cb-cdf6eee4b93c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:24.827202 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7b082e91-00a5-4f58-a80e-ca40a7e151b5 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:24.827697 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7b082e91-00a5-4f58-a80e-ca40a7e151b5 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:24.837643 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7b082e91-00a5-4f58-a80e-ca40a7e151b5 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:24.838574 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7b082e91-00a5-4f58-a80e-ca40a7e151b5 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:24.839067 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7b082e91-00a5-4f58-a80e-ca40a7e151b5 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:24.839516 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7b082e91-00a5-4f58-a80e-ca40a7e151b5 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:24.864660 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-7b082e91-00a5-4f58-a80e-ca40a7e151b5 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] HTTP exception thrown: Instance 6555760c-8bf4-467e-80cb-cdf6eee4b93c could not be found. Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7b082e91-00a5-4f58-a80e-ca40a7e151b5 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Request method failure captured: Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c HTTP/1.1 Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTHm_KA6YqcGW_OA8hUNZBDSXP0-anUoN22gS8JUUl35YiIwp1sjr6N7mtfzR5oHyHgUPh32uvbl3J8StWmNprADPBwziT2o0n3CWWVJ5PiTVTyznS-9Nqp9AESebV2h9k1SZmdCS6_xRdYt1Sw1EjFfRor7Xahdc3cgKho9XAZQLbg Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 5902169366b646c7be94cb3521377225 Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-2009309428 Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5902169366b646c7be94cb3521377225"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5902169366b646c7be94cb3521377225"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5902169366b646c7be94cb3521377225"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5902169366b646c7be94cb3521377225"}]}] Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-2009309428 Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 5902169366b646c7be94cb3521377225 Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-2009309428 Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServerRescueTestJSONUnderV235-2009309428-project Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 0a8fd7d2f8014b85beecc30c93bc084d Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-2009309428-project Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 6555760c-8bf4-467e-80cb-cdf6eee4b93c could not be found. Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '6555760c-8bf4-467e-80cb-cdf6eee4b93c'} Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6555760c-8bf4-467e-80cb-cdf6eee4b93c could not be found. Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6555760c-8bf4-467e-80cb-cdf6eee4b93c could not be found. Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:24.866625 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:24.874764 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:24.874764 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:24.874764 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:24.874764 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:24.874764 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:12:24.874764 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:12:24.874764 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6555760c-8bf4-467e-80cb-cdf6eee4b93c could not be found. Oct 26 13:12:24.874764 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:24.887994 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7b082e91-00a5-4f58-a80e-ca40a7e151b5 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] Returning 404 to user: Instance 6555760c-8bf4-467e-80cb-cdf6eee4b93c could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:12:24.889304 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7b082e91-00a5-4f58-a80e-ca40a7e151b5 tempest-ServerRescueTestJSONUnderV235-2009309428 tempest-ServerRescueTestJSONUnderV235-2009309428-project] 10.222.0.40 "GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c" status: 404 len: 111 microversion: 2.1 time: 0.076972 Oct 26 13:12:24.904975 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1292/2493] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:24 2022] GET /compute/v2.1/servers/6555760c-8bf4-467e-80cb-cdf6eee4b93c => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:12:25.441790 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a787b18a-725b-404f-be75-dc6d8cf09b98 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:25.450902 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a787b18a-725b-404f-be75-dc6d8cf09b98 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb" status: 200 len: 1504 microversion: 2.1 time: 0.924473 Oct 26 13:12:25.464695 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1202/2494] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:24 2022] GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb => generated 1504 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:26.281123 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d3b5acba-bfe2-4684-8bd5-5164b831c4b6 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:26.282906 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d3b5acba-bfe2-4684-8bd5-5164b831c4b6 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] [instance: 945d807f-8341-49ca-ba3e-702bfd803dc3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:26.310416 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3b5acba-bfe2-4684-8bd5-5164b831c4b6 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:26.311420 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3b5acba-bfe2-4684-8bd5-5164b831c4b6 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:26.312206 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3b5acba-bfe2-4684-8bd5-5164b831c4b6 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:26.313789 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3b5acba-bfe2-4684-8bd5-5164b831c4b6 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:26.314466 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3b5acba-bfe2-4684-8bd5-5164b831c4b6 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:26.315083 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3b5acba-bfe2-4684-8bd5-5164b831c4b6 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:26.349608 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d3b5acba-bfe2-4684-8bd5-5164b831c4b6 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] [instance: 945d807f-8341-49ca-ba3e-702bfd803dc3] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:12:26.470626 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d3b5acba-bfe2-4684-8bd5-5164b831c4b6 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] 10.222.0.40 "DELETE /compute/v2.1/servers/945d807f-8341-49ca-ba3e-702bfd803dc3" status: 204 len: 0 microversion: 2.1 time: 0.192130 Oct 26 13:12:26.471520 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1293/2495] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:12:26 2022] DELETE /compute/v2.1/servers/945d807f-8341-49ca-ba3e-702bfd803dc3 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:12:26.479509 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-49ae1d45-5065-44c0-bb7d-4c1f32c1d453 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:26.480781 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-49ae1d45-5065-44c0-bb7d-4c1f32c1d453 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] [instance: 945d807f-8341-49ca-ba3e-702bfd803dc3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:26.495080 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4768954e-7b46-48c6-b16e-1851909e0444 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:26.495799 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4768954e-7b46-48c6-b16e-1851909e0444 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: f5da8a46-9260-405b-aa4e-1f1a585302bb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:26.499160 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49ae1d45-5065-44c0-bb7d-4c1f32c1d453 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:26.499255 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49ae1d45-5065-44c0-bb7d-4c1f32c1d453 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:26.499722 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49ae1d45-5065-44c0-bb7d-4c1f32c1d453 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:26.500423 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49ae1d45-5065-44c0-bb7d-4c1f32c1d453 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:26.501412 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49ae1d45-5065-44c0-bb7d-4c1f32c1d453 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:26.501861 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49ae1d45-5065-44c0-bb7d-4c1f32c1d453 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:26.504000 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4768954e-7b46-48c6-b16e-1851909e0444 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:26.505233 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4768954e-7b46-48c6-b16e-1851909e0444 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:26.505983 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4768954e-7b46-48c6-b16e-1851909e0444 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:26.506914 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4768954e-7b46-48c6-b16e-1851909e0444 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:26.507554 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4768954e-7b46-48c6-b16e-1851909e0444 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:26.508776 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4768954e-7b46-48c6-b16e-1851909e0444 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:26.943208 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4768954e-7b46-48c6-b16e-1851909e0444 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:26.955097 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4768954e-7b46-48c6-b16e-1851909e0444 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb" status: 200 len: 1504 microversion: 2.1 time: 0.463205 Oct 26 13:12:26.956423 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1294/2496] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:26 2022] GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb => generated 1504 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:12:27.158875 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-49ae1d45-5065-44c0-bb7d-4c1f32c1d453 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329c4c283e1646f295472c59225753de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd2c80c6e164a708040af3165617a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:27.168879 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-49ae1d45-5065-44c0-bb7d-4c1f32c1d453 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] 10.222.0.40 "GET /compute/v2.1/servers/945d807f-8341-49ca-ba3e-702bfd803dc3" status: 200 len: 1666 microversion: 2.1 time: 0.693017 Oct 26 13:12:27.197801 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1203/2497] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:26 2022] GET /compute/v2.1/servers/945d807f-8341-49ca-ba3e-702bfd803dc3 => generated 1666 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:27.249310 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2dc1068e-88e1-4bca-af58-d832db1aab15 tempest-MultipleCreateNegativeTestJSON-6831929 tempest-MultipleCreateNegativeTestJSON-6831929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-196425650", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:12:27.255577 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-2dc1068e-88e1-4bca-af58-d832db1aab15 tempest-MultipleCreateNegativeTestJSON-6831929 tempest-MultipleCreateNegativeTestJSON-6831929-project] HTTP exception thrown: min_count must be <= max_count Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2dc1068e-88e1-4bca-af58-d832db1aab15 tempest-MultipleCreateNegativeTestJSON-6831929 tempest-MultipleCreateNegativeTestJSON-6831929-project] Request method failure captured: Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 183 Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTI6HbeXeDBNRMH7kLTBkeXK1QkzmrmhNinRQZPF3OXt-E__7s2dJvh4wfEXiVstd4XR7vTc13V0Oeep4pP5gTwoJU1weKB88Rdgo8jDQ__ffcoRphZAAgTRjup5MT_3wxW3D-DWQEkFyzygwzOSigIFDkyd7BD3mI1kCdfO371UK7Y Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: a2569b98b1b34d5ea10c90517044fe25 Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-6831929 Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a2569b98b1b34d5ea10c90517044fe25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2569b98b1b34d5ea10c90517044fe25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a2569b98b1b34d5ea10c90517044fe25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2569b98b1b34d5ea10c90517044fe25"}]}] Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-6831929 Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: a2569b98b1b34d5ea10c90517044fe25 Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-6831929 Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-MultipleCreateNegativeTestJSON-6831929-project Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 0a46faa18c9d49368c3d077b24a78dc4 Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-6831929-project Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-196425650", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: exception: min_count must be <= max_count Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-196425650', 'imageRef': '762c20f4-0f9b-45cb-bd95-cf21a747b33b', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 26 13:12:27.257729 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:27.262908 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2dc1068e-88e1-4bca-af58-d832db1aab15 tempest-MultipleCreateNegativeTestJSON-6831929 tempest-MultipleCreateNegativeTestJSON-6831929-project] Returning 400 to user: min_count must be <= max_count {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:12:27.264222 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2dc1068e-88e1-4bca-af58-d832db1aab15 tempest-MultipleCreateNegativeTestJSON-6831929 tempest-MultipleCreateNegativeTestJSON-6831929-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.306345 Oct 26 13:12:27.265319 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1295/2498] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:12:26 2022] POST /compute/v2.1/servers => generated 74 bytes in 308 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 26 13:12:27.343158 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dfc3fe66-6d33-4a5a-8f53-c39eba837017 tempest-MultipleCreateNegativeTestJSON-6831929 tempest-MultipleCreateNegativeTestJSON-6831929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-951374434", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "max_count": 0}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dfc3fe66-6d33-4a5a-8f53-c39eba837017 tempest-MultipleCreateNegativeTestJSON-6831929 tempest-MultipleCreateNegativeTestJSON-6831929-project] Request method failure captured: Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 167 Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTI6HbeXeDBNRMH7kLTBkeXK1QkzmrmhNinRQZPF3OXt-E__7s2dJvh4wfEXiVstd4XR7vTc13V0Oeep4pP5gTwoJU1weKB88Rdgo8jDQ__ffcoRphZAAgTRjup5MT_3wxW3D-DWQEkFyzygwzOSigIFDkyd7BD3mI1kCdfO371UK7Y Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: a2569b98b1b34d5ea10c90517044fe25 Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-6831929 Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a2569b98b1b34d5ea10c90517044fe25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2569b98b1b34d5ea10c90517044fe25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a2569b98b1b34d5ea10c90517044fe25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2569b98b1b34d5ea10c90517044fe25"}]}] Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-6831929 Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: a2569b98b1b34d5ea10c90517044fe25 Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-6831929 Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-MultipleCreateNegativeTestJSON-6831929-project Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 0a46faa18c9d49368c3d077b24a78dc4 Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-6831929-project Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-951374434", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "max_count": 0}} Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-951374434', 'imageRef': '762c20f4-0f9b-45cb-bd95-cf21a747b33b', 'flavorRef': '452', 'max_count': 0}}} Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise error Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi 0 Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 13:12:27.349187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 13:12:27.353166 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 13:12:27.353166 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 13:12:27.353166 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 13:12:27.353166 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 26 13:12:27.353166 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:27.353166 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:27.353166 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:27.353166 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:27.353166 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:27.353166 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:27.353166 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 13:12:27.353166 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 13:12:27.353166 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 26 13:12:27.353166 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:27.357258 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dfc3fe66-6d33-4a5a-8f53-c39eba837017 tempest-MultipleCreateNegativeTestJSON-6831929 tempest-MultipleCreateNegativeTestJSON-6831929-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:12:27.358513 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-dfc3fe66-6d33-4a5a-8f53-c39eba837017 tempest-MultipleCreateNegativeTestJSON-6831929 tempest-MultipleCreateNegativeTestJSON-6831929-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.019676 Oct 26 13:12:27.362763 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1204/2499] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:12:27 2022] POST /compute/v2.1/servers => generated 130 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:12:27.479419 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6091b1c5-dea8-4459-8b43-c9b999296300 tempest-MultipleCreateNegativeTestJSON-6831929 tempest-MultipleCreateNegativeTestJSON-6831929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2084504918", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "max_count": 2.5}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6091b1c5-dea8-4459-8b43-c9b999296300 tempest-MultipleCreateNegativeTestJSON-6831929 tempest-MultipleCreateNegativeTestJSON-6831929-project] Request method failure captured: Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 170 Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTI6HbeXeDBNRMH7kLTBkeXK1QkzmrmhNinRQZPF3OXt-E__7s2dJvh4wfEXiVstd4XR7vTc13V0Oeep4pP5gTwoJU1weKB88Rdgo8jDQ__ffcoRphZAAgTRjup5MT_3wxW3D-DWQEkFyzygwzOSigIFDkyd7BD3mI1kCdfO371UK7Y Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: a2569b98b1b34d5ea10c90517044fe25 Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-6831929 Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a2569b98b1b34d5ea10c90517044fe25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2569b98b1b34d5ea10c90517044fe25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a2569b98b1b34d5ea10c90517044fe25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2569b98b1b34d5ea10c90517044fe25"}]}] Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-6831929 Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: a2569b98b1b34d5ea10c90517044fe25 Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-6831929 Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-MultipleCreateNegativeTestJSON-6831929-project Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 0a46faa18c9d49368c3d077b24a78dc4 Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-6831929-project Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2084504918", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "max_count": 2.5}} Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2084504918', 'imageRef': '762c20f4-0f9b-45cb-bd95-cf21a747b33b', 'flavorRef': '452', 'max_count': 2.5}}} Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise error Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi 2.5 Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 13:12:27.497977 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 13:12:27.501863 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 13:12:27.501863 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 13:12:27.501863 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 13:12:27.501863 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 13:12:27.501863 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 26 13:12:27.501863 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:27.501863 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:27.501863 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:27.501863 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:27.501863 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:27.501863 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:27.501863 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 13:12:27.501863 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 13:12:27.501863 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 26 13:12:27.501863 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:27.503313 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6091b1c5-dea8-4459-8b43-c9b999296300 tempest-MultipleCreateNegativeTestJSON-6831929 tempest-MultipleCreateNegativeTestJSON-6831929-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:12:27.508434 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6091b1c5-dea8-4459-8b43-c9b999296300 tempest-MultipleCreateNegativeTestJSON-6831929 tempest-MultipleCreateNegativeTestJSON-6831929-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.034719 Oct 26 13:12:27.509014 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1296/2500] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:12:27 2022] POST /compute/v2.1/servers => generated 139 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 26 13:12:27.587484 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6c64d1fc-f59b-4705-9cd3-d36b5a642c93 tempest-MultipleCreateNegativeTestJSON-6831929 tempest-MultipleCreateNegativeTestJSON-6831929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2061609927", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "min_count": 0}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6c64d1fc-f59b-4705-9cd3-d36b5a642c93 tempest-MultipleCreateNegativeTestJSON-6831929 tempest-MultipleCreateNegativeTestJSON-6831929-project] Request method failure captured: Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 168 Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTI6HbeXeDBNRMH7kLTBkeXK1QkzmrmhNinRQZPF3OXt-E__7s2dJvh4wfEXiVstd4XR7vTc13V0Oeep4pP5gTwoJU1weKB88Rdgo8jDQ__ffcoRphZAAgTRjup5MT_3wxW3D-DWQEkFyzygwzOSigIFDkyd7BD3mI1kCdfO371UK7Y Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: a2569b98b1b34d5ea10c90517044fe25 Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-6831929 Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a2569b98b1b34d5ea10c90517044fe25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2569b98b1b34d5ea10c90517044fe25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a2569b98b1b34d5ea10c90517044fe25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2569b98b1b34d5ea10c90517044fe25"}]}] Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-6831929 Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: a2569b98b1b34d5ea10c90517044fe25 Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-6831929 Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-MultipleCreateNegativeTestJSON-6831929-project Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 0a46faa18c9d49368c3d077b24a78dc4 Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-6831929-project Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2061609927", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "min_count": 0}} Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2061609927', 'imageRef': '762c20f4-0f9b-45cb-bd95-cf21a747b33b', 'flavorRef': '452', 'min_count': 0}}} Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise error Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi 0 Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 13:12:27.598416 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 13:12:27.602516 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 13:12:27.602516 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 13:12:27.602516 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 13:12:27.602516 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 26 13:12:27.602516 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:27.602516 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:27.602516 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:27.602516 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:27.602516 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:27.602516 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:27.602516 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 13:12:27.602516 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 13:12:27.602516 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 26 13:12:27.602516 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:27.602516 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6c64d1fc-f59b-4705-9cd3-d36b5a642c93 tempest-MultipleCreateNegativeTestJSON-6831929 tempest-MultipleCreateNegativeTestJSON-6831929-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:12:27.602516 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6c64d1fc-f59b-4705-9cd3-d36b5a642c93 tempest-MultipleCreateNegativeTestJSON-6831929 tempest-MultipleCreateNegativeTestJSON-6831929-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.019777 Oct 26 13:12:27.603866 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1205/2501] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:12:27 2022] POST /compute/v2.1/servers => generated 130 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:12:27.670894 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-b49bc566-7674-41f1-814d-07de52a1a78f req-70abee91-2a2c-4709-b123-e1c5b3a595b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5da8a46-9260-405b-aa4e-1f1a585302bb", "name": "network-vif-unplugged", "status": "completed", "tag": "87173235-cfd2-4c33-ace5-d5e636ff43f4"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:12:27.708235 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b49bc566-7674-41f1-814d-07de52a1a78f req-70abee91-2a2c-4709-b123-e1c5b3a595b2 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:27.708832 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b49bc566-7674-41f1-814d-07de52a1a78f req-70abee91-2a2c-4709-b123-e1c5b3a595b2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:27.711586 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b49bc566-7674-41f1-814d-07de52a1a78f req-70abee91-2a2c-4709-b123-e1c5b3a595b2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:27.753277 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-b49bc566-7674-41f1-814d-07de52a1a78f req-70abee91-2a2c-4709-b123-e1c5b3a595b2 service nova] Creating event network-vif-unplugged:87173235-cfd2-4c33-ace5-d5e636ff43f4 for instance f5da8a46-9260-405b-aa4e-1f1a585302bb on n-h1-862686-1 Oct 26 13:12:27.759332 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-b49bc566-7674-41f1-814d-07de52a1a78f req-70abee91-2a2c-4709-b123-e1c5b3a595b2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093840 Oct 26 13:12:27.761336 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1297/2502] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:12:27.773757 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=14 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:12:27.780104 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-aa564ac6-f526-422f-8f0e-2d53683589fe tempest-MultipleCreateNegativeTestJSON-6831929 tempest-MultipleCreateNegativeTestJSON-6831929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1139339346", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "min_count": 2.5}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-aa564ac6-f526-422f-8f0e-2d53683589fe tempest-MultipleCreateNegativeTestJSON-6831929 tempest-MultipleCreateNegativeTestJSON-6831929-project] Request method failure captured: Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 170 Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTI6HbeXeDBNRMH7kLTBkeXK1QkzmrmhNinRQZPF3OXt-E__7s2dJvh4wfEXiVstd4XR7vTc13V0Oeep4pP5gTwoJU1weKB88Rdgo8jDQ__ffcoRphZAAgTRjup5MT_3wxW3D-DWQEkFyzygwzOSigIFDkyd7BD3mI1kCdfO371UK7Y Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: a2569b98b1b34d5ea10c90517044fe25 Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-6831929 Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a2569b98b1b34d5ea10c90517044fe25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2569b98b1b34d5ea10c90517044fe25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a2569b98b1b34d5ea10c90517044fe25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2569b98b1b34d5ea10c90517044fe25"}]}] Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-6831929 Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: a2569b98b1b34d5ea10c90517044fe25 Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-6831929 Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-MultipleCreateNegativeTestJSON-6831929-project Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 0a46faa18c9d49368c3d077b24a78dc4 Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-6831929-project Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1139339346", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "min_count": 2.5}} Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1139339346', 'imageRef': '762c20f4-0f9b-45cb-bd95-cf21a747b33b', 'flavorRef': '452', 'min_count': 2.5}}} Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise error Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi 2.5 Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 13:12:27.790067 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 13:12:27.794326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 13:12:27.794326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 13:12:27.794326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 13:12:27.794326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 13:12:27.794326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 26 13:12:27.794326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:27.794326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:27.794326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:27.794326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:27.794326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:27.794326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:27.794326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 13:12:27.794326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 13:12:27.794326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 26 13:12:27.794326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:27.795312 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-aa564ac6-f526-422f-8f0e-2d53683589fe tempest-MultipleCreateNegativeTestJSON-6831929 tempest-MultipleCreateNegativeTestJSON-6831929-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:12:27.795780 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-aa564ac6-f526-422f-8f0e-2d53683589fe tempest-MultipleCreateNegativeTestJSON-6831929 tempest-MultipleCreateNegativeTestJSON-6831929-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.023913 Oct 26 13:12:27.798770 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1206/2503] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:12:27 2022] POST /compute/v2.1/servers => generated 139 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:12:27.983197 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-031e15c8-f7ea-4f4f-90c7-996e430ef175 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:27.985137 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-031e15c8-f7ea-4f4f-90c7-996e430ef175 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: f5da8a46-9260-405b-aa4e-1f1a585302bb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:27.997078 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-031e15c8-f7ea-4f4f-90c7-996e430ef175 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:28.001999 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-031e15c8-f7ea-4f4f-90c7-996e430ef175 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:28.004601 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-031e15c8-f7ea-4f4f-90c7-996e430ef175 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:28.006173 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-031e15c8-f7ea-4f4f-90c7-996e430ef175 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:28.012972 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-031e15c8-f7ea-4f4f-90c7-996e430ef175 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:28.013604 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-031e15c8-f7ea-4f4f-90c7-996e430ef175 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:28.217473 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-eb823b49-62a1-4e81-ba2b-a66a086f25d6 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:28.218097 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-eb823b49-62a1-4e81-ba2b-a66a086f25d6 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] [instance: 945d807f-8341-49ca-ba3e-702bfd803dc3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:28.232099 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eb823b49-62a1-4e81-ba2b-a66a086f25d6 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:28.234049 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eb823b49-62a1-4e81-ba2b-a66a086f25d6 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:28.237033 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eb823b49-62a1-4e81-ba2b-a66a086f25d6 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:28.238188 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eb823b49-62a1-4e81-ba2b-a66a086f25d6 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:28.239604 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eb823b49-62a1-4e81-ba2b-a66a086f25d6 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:28.241593 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eb823b49-62a1-4e81-ba2b-a66a086f25d6 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:28.731818 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-031e15c8-f7ea-4f4f-90c7-996e430ef175 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:28.743841 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-031e15c8-f7ea-4f4f-90c7-996e430ef175 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb" status: 200 len: 1504 microversion: 2.1 time: 0.768663 Oct 26 13:12:28.747511 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1298/2504] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:27 2022] GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb => generated 1504 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:29.275295 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-eb823b49-62a1-4e81-ba2b-a66a086f25d6 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329c4c283e1646f295472c59225753de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd2c80c6e164a708040af3165617a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:29.291589 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-eb823b49-62a1-4e81-ba2b-a66a086f25d6 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] 10.222.0.40 "GET /compute/v2.1/servers/945d807f-8341-49ca-ba3e-702bfd803dc3" status: 200 len: 1666 microversion: 2.1 time: 1.078743 Oct 26 13:12:29.292778 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1207/2505] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:28 2022] GET /compute/v2.1/servers/945d807f-8341-49ca-ba3e-702bfd803dc3 => generated 1666 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:12:29.780711 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-52c1877c-f98c-4a91-be49-471e321b8690 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:29.781276 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-52c1877c-f98c-4a91-be49-471e321b8690 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: f5da8a46-9260-405b-aa4e-1f1a585302bb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:29.787901 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:12:29.811303 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-52c1877c-f98c-4a91-be49-471e321b8690 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:29.811813 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-52c1877c-f98c-4a91-be49-471e321b8690 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:29.812267 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-52c1877c-f98c-4a91-be49-471e321b8690 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:29.815235 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-52c1877c-f98c-4a91-be49-471e321b8690 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:29.817850 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-52c1877c-f98c-4a91-be49-471e321b8690 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:29.818305 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-52c1877c-f98c-4a91-be49-471e321b8690 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:30.319970 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-06f86766-63fc-46b9-ae89-17d54e52df46 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:30.321732 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-06f86766-63fc-46b9-ae89-17d54e52df46 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] [instance: 945d807f-8341-49ca-ba3e-702bfd803dc3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:30.333977 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-06f86766-63fc-46b9-ae89-17d54e52df46 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:30.336166 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-06f86766-63fc-46b9-ae89-17d54e52df46 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:30.337976 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-06f86766-63fc-46b9-ae89-17d54e52df46 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:30.342307 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-06f86766-63fc-46b9-ae89-17d54e52df46 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:30.343034 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-06f86766-63fc-46b9-ae89-17d54e52df46 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:30.344057 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-06f86766-63fc-46b9-ae89-17d54e52df46 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:30.757574 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-52c1877c-f98c-4a91-be49-471e321b8690 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:30.774768 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-52c1877c-f98c-4a91-be49-471e321b8690 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb" status: 200 len: 1504 microversion: 2.1 time: 1.005597 Oct 26 13:12:30.776320 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1299/2506] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:29 2022] GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb => generated 1504 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:31.055886 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-0a66fa2a-bdc4-4d86-a2ba-99c2e50664a9 req-efd798e5-d567-49ac-ac02-1aa54a278c55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5da8a46-9260-405b-aa4e-1f1a585302bb", "tag": "87173235-cfd2-4c33-ace5-d5e636ff43f4"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:12:31.083146 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-0a66fa2a-bdc4-4d86-a2ba-99c2e50664a9 req-efd798e5-d567-49ac-ac02-1aa54a278c55 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:31.083691 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-0a66fa2a-bdc4-4d86-a2ba-99c2e50664a9 req-efd798e5-d567-49ac-ac02-1aa54a278c55 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:31.084143 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-0a66fa2a-bdc4-4d86-a2ba-99c2e50664a9 req-efd798e5-d567-49ac-ac02-1aa54a278c55 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:31.118804 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-0a66fa2a-bdc4-4d86-a2ba-99c2e50664a9 req-efd798e5-d567-49ac-ac02-1aa54a278c55 service nova] Creating event network-changed:87173235-cfd2-4c33-ace5-d5e636ff43f4 for instance f5da8a46-9260-405b-aa4e-1f1a585302bb on n-h1-862686-1 Oct 26 13:12:31.129668 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-0a66fa2a-bdc4-4d86-a2ba-99c2e50664a9 req-efd798e5-d567-49ac-ac02-1aa54a278c55 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076985 Oct 26 13:12:31.131861 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1300/2507] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:12:31.418483 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-06f86766-63fc-46b9-ae89-17d54e52df46 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329c4c283e1646f295472c59225753de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd2c80c6e164a708040af3165617a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:31.430968 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-06f86766-63fc-46b9-ae89-17d54e52df46 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] 10.222.0.40 "GET /compute/v2.1/servers/945d807f-8341-49ca-ba3e-702bfd803dc3" status: 200 len: 1666 microversion: 2.1 time: 1.115655 Oct 26 13:12:31.447072 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1208/2508] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:30 2022] GET /compute/v2.1/servers/945d807f-8341-49ca-ba3e-702bfd803dc3 => generated 1666 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:12:31.818249 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-478d563c-4fae-4ff6-bd30-3b44901bfca7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:31.820039 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-478d563c-4fae-4ff6-bd30-3b44901bfca7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: f5da8a46-9260-405b-aa4e-1f1a585302bb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:31.830029 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-478d563c-4fae-4ff6-bd30-3b44901bfca7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:31.833728 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-478d563c-4fae-4ff6-bd30-3b44901bfca7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:31.834576 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-478d563c-4fae-4ff6-bd30-3b44901bfca7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:31.835743 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-478d563c-4fae-4ff6-bd30-3b44901bfca7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:31.838134 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-478d563c-4fae-4ff6-bd30-3b44901bfca7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:31.838783 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-478d563c-4fae-4ff6-bd30-3b44901bfca7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:32.455070 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8be51043-0e77-4294-b191-1bc34114df65 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:32.456256 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8be51043-0e77-4294-b191-1bc34114df65 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] [instance: 945d807f-8341-49ca-ba3e-702bfd803dc3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:32.460778 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:12:32.465920 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8be51043-0e77-4294-b191-1bc34114df65 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:32.472158 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8be51043-0e77-4294-b191-1bc34114df65 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:32.475034 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8be51043-0e77-4294-b191-1bc34114df65 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:32.477879 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8be51043-0e77-4294-b191-1bc34114df65 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:32.484870 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8be51043-0e77-4294-b191-1bc34114df65 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:32.494230 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8be51043-0e77-4294-b191-1bc34114df65 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:32.683144 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8be51043-0e77-4294-b191-1bc34114df65 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329c4c283e1646f295472c59225753de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd2c80c6e164a708040af3165617a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:32.684505 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-478d563c-4fae-4ff6-bd30-3b44901bfca7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:32.706819 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8be51043-0e77-4294-b191-1bc34114df65 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] 10.222.0.40 "GET /compute/v2.1/servers/945d807f-8341-49ca-ba3e-702bfd803dc3" status: 200 len: 1599 microversion: 2.1 time: 0.255622 Oct 26 13:12:32.707578 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-478d563c-4fae-4ff6-bd30-3b44901bfca7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb" status: 200 len: 1504 microversion: 2.1 time: 0.905947 Oct 26 13:12:32.711031 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1301/2509] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:31 2022] GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb => generated 1504 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:32.713717 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1209/2510] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:32 2022] GET /compute/v2.1/servers/945d807f-8341-49ca-ba3e-702bfd803dc3 => generated 1599 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:12:32.729940 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f368f1d6-e673-4ae3-8ec8-d7873947d838 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:32.730705 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f368f1d6-e673-4ae3-8ec8-d7873947d838 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: cd344db8-1e3a-498b-a4b4-54b0547fc063] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:32.754694 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f368f1d6-e673-4ae3-8ec8-d7873947d838 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:32.755224 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f368f1d6-e673-4ae3-8ec8-d7873947d838 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:32.755666 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f368f1d6-e673-4ae3-8ec8-d7873947d838 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:32.756386 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f368f1d6-e673-4ae3-8ec8-d7873947d838 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:32.756848 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f368f1d6-e673-4ae3-8ec8-d7873947d838 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:32.757258 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f368f1d6-e673-4ae3-8ec8-d7873947d838 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:32.786152 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-f368f1d6-e673-4ae3-8ec8-d7873947d838 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] HTTP exception thrown: Instance cd344db8-1e3a-498b-a4b4-54b0547fc063 could not be found. Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f368f1d6-e673-4ae3-8ec8-d7873947d838 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Request method failure captured: Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: request: DELETE /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063 HTTP/1.1 Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTGuhT7Zbi_z_79A643Bxrqd2bB1VSqRYm6Jz4GuY9ExeFNGPXsuj7LBA9BXTdnCCGYDf6Ao3eaTBgELBCBSA6CFliksv3ntCDdpWnInF_PADrDmI3-58eMChsVyT9aHxLDdXaI6vgwbjOYl9-AB53UwK2Q7tevLaF23CDZGjXumZmg Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 23b66b9b9c574fa799086c0733d28887 Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersTestMultiNic-1880926120 Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/23b66b9b9c574fa799086c0733d28887"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/23b66b9b9c574fa799086c0733d28887"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_23b66b9b9c574fa799086c0733d28887"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/23b66b9b9c574fa799086c0733d28887"}]}] Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersTestMultiNic-1880926120 Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 23b66b9b9c574fa799086c0733d28887 Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersTestMultiNic-1880926120 Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersTestMultiNic-1880926120-project Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: c533afbf98454632a796eea300f50a35 Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersTestMultiNic-1880926120-project Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance cd344db8-1e3a-498b-a4b4-54b0547fc063 could not be found. Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'cd344db8-1e3a-498b-a4b4-54b0547fc063'} Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd344db8-1e3a-498b-a4b4-54b0547fc063 could not be found. Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:12:32.787835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:12:32.791404 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd344db8-1e3a-498b-a4b4-54b0547fc063 could not be found. Oct 26 13:12:32.791404 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:32.791404 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:32.791404 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:32.791404 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:32.791404 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:32.791404 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:32.791404 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:12:32.791404 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:12:32.791404 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd344db8-1e3a-498b-a4b4-54b0547fc063 could not be found. Oct 26 13:12:32.791404 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:32.791404 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f368f1d6-e673-4ae3-8ec8-d7873947d838 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Returning 404 to user: Instance cd344db8-1e3a-498b-a4b4-54b0547fc063 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:12:32.791404 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f368f1d6-e673-4ae3-8ec8-d7873947d838 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "DELETE /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063" status: 404 len: 111 microversion: 2.1 time: 0.076671 Oct 26 13:12:32.801142 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1302/2511] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:12:32 2022] DELETE /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:12:32.811543 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e35c6a06-eab6-4ee5-9f45-5168a4afa43c tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:32.812406 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e35c6a06-eab6-4ee5-9f45-5168a4afa43c tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: cd344db8-1e3a-498b-a4b4-54b0547fc063] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:32.824656 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e35c6a06-eab6-4ee5-9f45-5168a4afa43c tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:32.825577 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e35c6a06-eab6-4ee5-9f45-5168a4afa43c tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:32.828320 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e35c6a06-eab6-4ee5-9f45-5168a4afa43c tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:32.831426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e35c6a06-eab6-4ee5-9f45-5168a4afa43c tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:32.833600 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e35c6a06-eab6-4ee5-9f45-5168a4afa43c tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:32.834550 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e35c6a06-eab6-4ee5-9f45-5168a4afa43c tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:32.870643 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-e35c6a06-eab6-4ee5-9f45-5168a4afa43c tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] HTTP exception thrown: Instance cd344db8-1e3a-498b-a4b4-54b0547fc063 could not be found. Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e35c6a06-eab6-4ee5-9f45-5168a4afa43c tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Request method failure captured: Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063 HTTP/1.1 Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTGuhT7Zbi_z_79A643Bxrqd2bB1VSqRYm6Jz4GuY9ExeFNGPXsuj7LBA9BXTdnCCGYDf6Ao3eaTBgELBCBSA6CFliksv3ntCDdpWnInF_PADrDmI3-58eMChsVyT9aHxLDdXaI6vgwbjOYl9-AB53UwK2Q7tevLaF23CDZGjXumZmg Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 23b66b9b9c574fa799086c0733d28887 Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersTestMultiNic-1880926120 Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/23b66b9b9c574fa799086c0733d28887"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/23b66b9b9c574fa799086c0733d28887"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_23b66b9b9c574fa799086c0733d28887"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/23b66b9b9c574fa799086c0733d28887"}]}] Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersTestMultiNic-1880926120 Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 23b66b9b9c574fa799086c0733d28887 Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersTestMultiNic-1880926120 Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersTestMultiNic-1880926120-project Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: c533afbf98454632a796eea300f50a35 Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersTestMultiNic-1880926120-project Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance cd344db8-1e3a-498b-a4b4-54b0547fc063 could not be found. Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'cd344db8-1e3a-498b-a4b4-54b0547fc063'} Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd344db8-1e3a-498b-a4b4-54b0547fc063 could not be found. Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd344db8-1e3a-498b-a4b4-54b0547fc063 could not be found. Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:32.873320 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:32.877591 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:32.877591 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:32.877591 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:32.877591 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:12:32.877591 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:12:32.877591 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd344db8-1e3a-498b-a4b4-54b0547fc063 could not be found. Oct 26 13:12:32.877591 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:32.877591 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e35c6a06-eab6-4ee5-9f45-5168a4afa43c tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Returning 404 to user: Instance cd344db8-1e3a-498b-a4b4-54b0547fc063 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:12:32.877591 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e35c6a06-eab6-4ee5-9f45-5168a4afa43c tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063" status: 404 len: 111 microversion: 2.1 time: 0.069718 Oct 26 13:12:32.885130 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-abe3429b-a0aa-4b93-8ec1-69d9caf65315 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:32.885973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-abe3429b-a0aa-4b93-8ec1-69d9caf65315 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: 5a49060c-d94a-4064-8e80-ef8fe20e3ff1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:32.909041 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-abe3429b-a0aa-4b93-8ec1-69d9caf65315 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:32.911112 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1210/2512] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:32 2022] GET /compute/v2.1/servers/cd344db8-1e3a-498b-a4b4-54b0547fc063 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:12:32.916968 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-abe3429b-a0aa-4b93-8ec1-69d9caf65315 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:32.918912 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-abe3429b-a0aa-4b93-8ec1-69d9caf65315 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:32.921831 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-abe3429b-a0aa-4b93-8ec1-69d9caf65315 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:32.923325 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-abe3429b-a0aa-4b93-8ec1-69d9caf65315 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:32.928896 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-abe3429b-a0aa-4b93-8ec1-69d9caf65315 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:32.987892 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-abe3429b-a0aa-4b93-8ec1-69d9caf65315 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] HTTP exception thrown: Instance 5a49060c-d94a-4064-8e80-ef8fe20e3ff1 could not be found. Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-abe3429b-a0aa-4b93-8ec1-69d9caf65315 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Request method failure captured: Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: request: DELETE /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1 HTTP/1.1 Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTGuhT7Zbi_z_79A643Bxrqd2bB1VSqRYm6Jz4GuY9ExeFNGPXsuj7LBA9BXTdnCCGYDf6Ao3eaTBgELBCBSA6CFliksv3ntCDdpWnInF_PADrDmI3-58eMChsVyT9aHxLDdXaI6vgwbjOYl9-AB53UwK2Q7tevLaF23CDZGjXumZmg Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 23b66b9b9c574fa799086c0733d28887 Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersTestMultiNic-1880926120 Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/23b66b9b9c574fa799086c0733d28887"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/23b66b9b9c574fa799086c0733d28887"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_23b66b9b9c574fa799086c0733d28887"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/23b66b9b9c574fa799086c0733d28887"}]}] Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersTestMultiNic-1880926120 Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 23b66b9b9c574fa799086c0733d28887 Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersTestMultiNic-1880926120 Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersTestMultiNic-1880926120-project Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: c533afbf98454632a796eea300f50a35 Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersTestMultiNic-1880926120-project Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 5a49060c-d94a-4064-8e80-ef8fe20e3ff1 could not be found. Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '5a49060c-d94a-4064-8e80-ef8fe20e3ff1'} Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a49060c-d94a-4064-8e80-ef8fe20e3ff1 could not be found. Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:12:32.989941 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:12:32.994196 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a49060c-d94a-4064-8e80-ef8fe20e3ff1 could not be found. Oct 26 13:12:32.994196 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:32.994196 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:32.994196 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:32.994196 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:32.994196 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:32.994196 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:32.994196 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:12:32.994196 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:12:32.994196 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a49060c-d94a-4064-8e80-ef8fe20e3ff1 could not be found. Oct 26 13:12:32.994196 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:32.998647 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-abe3429b-a0aa-4b93-8ec1-69d9caf65315 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Returning 404 to user: Instance 5a49060c-d94a-4064-8e80-ef8fe20e3ff1 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:12:32.999790 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-abe3429b-a0aa-4b93-8ec1-69d9caf65315 tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1" status: 404 len: 111 microversion: 2.1 time: 0.119089 Oct 26 13:12:33.002041 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1303/2513] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:12:32 2022] DELETE /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 13:12:33.010682 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fde5c37f-ac18-4c17-a895-5c1692f423de tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:33.011539 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fde5c37f-ac18-4c17-a895-5c1692f423de tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] [instance: 5a49060c-d94a-4064-8e80-ef8fe20e3ff1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:33.022493 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fde5c37f-ac18-4c17-a895-5c1692f423de tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:33.022987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fde5c37f-ac18-4c17-a895-5c1692f423de tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:33.023432 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fde5c37f-ac18-4c17-a895-5c1692f423de tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:33.024152 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fde5c37f-ac18-4c17-a895-5c1692f423de tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:33.024613 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fde5c37f-ac18-4c17-a895-5c1692f423de tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:33.025041 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fde5c37f-ac18-4c17-a895-5c1692f423de tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:33.081867 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-fde5c37f-ac18-4c17-a895-5c1692f423de tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] HTTP exception thrown: Instance 5a49060c-d94a-4064-8e80-ef8fe20e3ff1 could not be found. Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fde5c37f-ac18-4c17-a895-5c1692f423de tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Request method failure captured: Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1 HTTP/1.1 Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTGuhT7Zbi_z_79A643Bxrqd2bB1VSqRYm6Jz4GuY9ExeFNGPXsuj7LBA9BXTdnCCGYDf6Ao3eaTBgELBCBSA6CFliksv3ntCDdpWnInF_PADrDmI3-58eMChsVyT9aHxLDdXaI6vgwbjOYl9-AB53UwK2Q7tevLaF23CDZGjXumZmg Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 23b66b9b9c574fa799086c0733d28887 Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersTestMultiNic-1880926120 Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/23b66b9b9c574fa799086c0733d28887"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/23b66b9b9c574fa799086c0733d28887"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_23b66b9b9c574fa799086c0733d28887"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/23b66b9b9c574fa799086c0733d28887"}]}] Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersTestMultiNic-1880926120 Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 23b66b9b9c574fa799086c0733d28887 Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersTestMultiNic-1880926120 Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersTestMultiNic-1880926120-project Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: c533afbf98454632a796eea300f50a35 Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersTestMultiNic-1880926120-project Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 5a49060c-d94a-4064-8e80-ef8fe20e3ff1 could not be found. Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '5a49060c-d94a-4064-8e80-ef8fe20e3ff1'} Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a49060c-d94a-4064-8e80-ef8fe20e3ff1 could not be found. Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a49060c-d94a-4064-8e80-ef8fe20e3ff1 could not be found. Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:33.084550 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:33.090168 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:33.090168 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:33.090168 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:33.090168 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:12:33.090168 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:12:33.090168 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a49060c-d94a-4064-8e80-ef8fe20e3ff1 could not be found. Oct 26 13:12:33.090168 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:33.092838 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fde5c37f-ac18-4c17-a895-5c1692f423de tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] Returning 404 to user: Instance 5a49060c-d94a-4064-8e80-ef8fe20e3ff1 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:12:33.095364 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fde5c37f-ac18-4c17-a895-5c1692f423de tempest-ServersTestMultiNic-1880926120 tempest-ServersTestMultiNic-1880926120-project] 10.222.0.40 "GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1" status: 404 len: 111 microversion: 2.1 time: 0.088370 Oct 26 13:12:33.097171 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1211/2514] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:33 2022] GET /compute/v2.1/servers/5a49060c-d94a-4064-8e80-ef8fe20e3ff1 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 13:12:33.283822 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-e63dbffb-6350-4b10-acf7-81555da48e42 req-5332b2f2-7eb3-46d4-b498-b1d9508dbadf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "945d807f-8341-49ca-ba3e-702bfd803dc3", "name": "network-vif-deleted", "tag": "d3c22259-adb6-472e-9aed-08a5fa660e6a"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:12:33.310677 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e63dbffb-6350-4b10-acf7-81555da48e42 req-5332b2f2-7eb3-46d4-b498-b1d9508dbadf service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:33.311162 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e63dbffb-6350-4b10-acf7-81555da48e42 req-5332b2f2-7eb3-46d4-b498-b1d9508dbadf service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:33.311601 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e63dbffb-6350-4b10-acf7-81555da48e42 req-5332b2f2-7eb3-46d4-b498-b1d9508dbadf service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:33.344935 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-e63dbffb-6350-4b10-acf7-81555da48e42 req-5332b2f2-7eb3-46d4-b498-b1d9508dbadf service nova] Creating event network-vif-deleted:d3c22259-adb6-472e-9aed-08a5fa660e6a for instance 945d807f-8341-49ca-ba3e-702bfd803dc3 on n-h2-862686-1 Oct 26 13:12:33.371584 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-e63dbffb-6350-4b10-acf7-81555da48e42 req-5332b2f2-7eb3-46d4-b498-b1d9508dbadf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091783 Oct 26 13:12:33.376284 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1304/2515] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:12:33.762355 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-53138d89-6fd1-4c85-81c8-c32a1c803f65 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:33.764138 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0f8cf886-d60b-4dc7-adaa-7eadfcddde9f tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:33.765387 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-53138d89-6fd1-4c85-81c8-c32a1c803f65 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: f5da8a46-9260-405b-aa4e-1f1a585302bb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:33.766896 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0f8cf886-d60b-4dc7-adaa-7eadfcddde9f tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] [instance: 945d807f-8341-49ca-ba3e-702bfd803dc3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:33.785669 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0f8cf886-d60b-4dc7-adaa-7eadfcddde9f tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:33.787561 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-53138d89-6fd1-4c85-81c8-c32a1c803f65 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:33.788250 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-53138d89-6fd1-4c85-81c8-c32a1c803f65 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:33.788869 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-53138d89-6fd1-4c85-81c8-c32a1c803f65 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:33.790065 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0f8cf886-d60b-4dc7-adaa-7eadfcddde9f tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:33.790482 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-53138d89-6fd1-4c85-81c8-c32a1c803f65 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:33.791069 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0f8cf886-d60b-4dc7-adaa-7eadfcddde9f tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:33.791695 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-53138d89-6fd1-4c85-81c8-c32a1c803f65 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:33.792624 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0f8cf886-d60b-4dc7-adaa-7eadfcddde9f tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:33.793216 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-53138d89-6fd1-4c85-81c8-c32a1c803f65 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:33.802467 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0f8cf886-d60b-4dc7-adaa-7eadfcddde9f tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:33.803191 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0f8cf886-d60b-4dc7-adaa-7eadfcddde9f tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:33.916016 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0f8cf886-d60b-4dc7-adaa-7eadfcddde9f tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:33.916614 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0f8cf886-d60b-4dc7-adaa-7eadfcddde9f tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:33.917433 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0f8cf886-d60b-4dc7-adaa-7eadfcddde9f tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:33.919649 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-0f8cf886-d60b-4dc7-adaa-7eadfcddde9f tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lazy-loading 'fault' on Instance uuid 945d807f-8341-49ca-ba3e-702bfd803dc3 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:12:34.101270 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0f8cf886-d60b-4dc7-adaa-7eadfcddde9f tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329c4c283e1646f295472c59225753de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd2c80c6e164a708040af3165617a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:34.111501 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0f8cf886-d60b-4dc7-adaa-7eadfcddde9f tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] 10.222.0.40 "GET /compute/v2.1/servers/945d807f-8341-49ca-ba3e-702bfd803dc3" status: 200 len: 1316 microversion: 2.1 time: 0.358740 Oct 26 13:12:34.117797 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1212/2516] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:33 2022] GET /compute/v2.1/servers/945d807f-8341-49ca-ba3e-702bfd803dc3 => generated 1316 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:34.899976 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-53138d89-6fd1-4c85-81c8-c32a1c803f65 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:34.913213 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-53138d89-6fd1-4c85-81c8-c32a1c803f65 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb" status: 200 len: 1504 microversion: 2.1 time: 1.153945 Oct 26 13:12:34.914991 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1305/2517] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:33 2022] GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb => generated 1504 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:35.141665 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-78a1e1b2-a22f-44f3-86df-4db0fd3357cb tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:35.142288 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-78a1e1b2-a22f-44f3-86df-4db0fd3357cb tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] [instance: 945d807f-8341-49ca-ba3e-702bfd803dc3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:35.156105 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78a1e1b2-a22f-44f3-86df-4db0fd3357cb tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:35.157286 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78a1e1b2-a22f-44f3-86df-4db0fd3357cb tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:35.158166 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78a1e1b2-a22f-44f3-86df-4db0fd3357cb tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:35.159073 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78a1e1b2-a22f-44f3-86df-4db0fd3357cb tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:35.160613 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78a1e1b2-a22f-44f3-86df-4db0fd3357cb tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:35.162165 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78a1e1b2-a22f-44f3-86df-4db0fd3357cb tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:35.220883 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-78a1e1b2-a22f-44f3-86df-4db0fd3357cb tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] HTTP exception thrown: Instance 945d807f-8341-49ca-ba3e-702bfd803dc3 could not be found. Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-78a1e1b2-a22f-44f3-86df-4db0fd3357cb tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Request method failure captured: Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/945d807f-8341-49ca-ba3e-702bfd803dc3 HTTP/1.1 Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTHpl2nFSTHwM5PQZlpNKA4l1deBr4PMgLa80ESuAueyNUC9VFMCWzzMOfXnfNEZBEd8lvbn89pwB8124eoVJ8OT8lP2cgCo4IWPbbD5MbG-5zmtsyX-V6d7XEb0LyY8me8ZteHijNkMoJhZ-PuCN-4GB7-48tY3JbZ3oJBfPGq_Qzk Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: dfd2c80c6e164a708040af3165617a0b Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersTestFqdnHostnames-357258149 Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/dfd2c80c6e164a708040af3165617a0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dfd2c80c6e164a708040af3165617a0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_dfd2c80c6e164a708040af3165617a0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dfd2c80c6e164a708040af3165617a0b"}]}] Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersTestFqdnHostnames-357258149 Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: dfd2c80c6e164a708040af3165617a0b Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-357258149 Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersTestFqdnHostnames-357258149-project Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 329c4c283e1646f295472c59225753de Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersTestFqdnHostnames-357258149-project Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 945d807f-8341-49ca-ba3e-702bfd803dc3 could not be found. Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '945d807f-8341-49ca-ba3e-702bfd803dc3'} Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 945d807f-8341-49ca-ba3e-702bfd803dc3 could not be found. Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 945d807f-8341-49ca-ba3e-702bfd803dc3 could not be found. Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:35.222357 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:35.226916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:35.226916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:35.226916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:35.226916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:12:35.226916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:12:35.226916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 945d807f-8341-49ca-ba3e-702bfd803dc3 could not be found. Oct 26 13:12:35.226916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:12:35.233342 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-78a1e1b2-a22f-44f3-86df-4db0fd3357cb tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Returning 404 to user: Instance 945d807f-8341-49ca-ba3e-702bfd803dc3 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:12:35.234504 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-78a1e1b2-a22f-44f3-86df-4db0fd3357cb tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] 10.222.0.40 "GET /compute/v2.1/servers/945d807f-8341-49ca-ba3e-702bfd803dc3" status: 404 len: 111 microversion: 2.1 time: 0.097061 Oct 26 13:12:35.236957 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1213/2518] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:35 2022] GET /compute/v2.1/servers/945d807f-8341-49ca-ba3e-702bfd803dc3 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:12:35.252261 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8244e069-f7f3-4a28-88fa-253d28b858c0 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] Calling method '.version_select at 0x7f67324ce160>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:35.299777 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8244e069-f7f3-4a28-88fa-253d28b858c0 tempest-ServersTestFqdnHostnames-357258149 tempest-ServersTestFqdnHostnames-357258149-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2021685027" status: 202 len: 0 microversion: 2.1 time: 0.056961 Oct 26 13:12:35.300614 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1306/2519] 10.222.0.40 () {58 vars in 1221 bytes} [Wed Oct 26 13:12:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2021685027 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:12:35.939805 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f533b052-38bf-499b-8383-b2388fe5e802 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:35.940720 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f533b052-38bf-499b-8383-b2388fe5e802 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: f5da8a46-9260-405b-aa4e-1f1a585302bb] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:35.955518 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f533b052-38bf-499b-8383-b2388fe5e802 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:35.956292 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f533b052-38bf-499b-8383-b2388fe5e802 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:35.956957 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f533b052-38bf-499b-8383-b2388fe5e802 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:35.957855 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f533b052-38bf-499b-8383-b2388fe5e802 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:35.963681 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f533b052-38bf-499b-8383-b2388fe5e802 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:35.964670 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f533b052-38bf-499b-8383-b2388fe5e802 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:36.529758 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f533b052-38bf-499b-8383-b2388fe5e802 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:36.544223 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f533b052-38bf-499b-8383-b2388fe5e802 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb" status: 200 len: 1504 microversion: 2.1 time: 0.606739 Oct 26 13:12:36.564577 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1214/2520] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:35 2022] GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb => generated 1504 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:37.574093 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6db68b3e-b2e5-4bfa-b4ef-354bf0b43e09 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:37.575491 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6db68b3e-b2e5-4bfa-b4ef-354bf0b43e09 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: f5da8a46-9260-405b-aa4e-1f1a585302bb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:37.595807 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6db68b3e-b2e5-4bfa-b4ef-354bf0b43e09 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:37.596275 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6db68b3e-b2e5-4bfa-b4ef-354bf0b43e09 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:37.596719 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6db68b3e-b2e5-4bfa-b4ef-354bf0b43e09 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:37.600549 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6db68b3e-b2e5-4bfa-b4ef-354bf0b43e09 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:37.602551 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6db68b3e-b2e5-4bfa-b4ef-354bf0b43e09 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:37.604827 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6db68b3e-b2e5-4bfa-b4ef-354bf0b43e09 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:38.788288 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6db68b3e-b2e5-4bfa-b4ef-354bf0b43e09 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:38.814651 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6db68b3e-b2e5-4bfa-b4ef-354bf0b43e09 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb" status: 200 len: 1504 microversion: 2.1 time: 1.246394 Oct 26 13:12:38.832237 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1307/2521] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:37 2022] GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb => generated 1504 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:39.689988 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a3451084-3b1b-43af-bb1b-e369326c61b1 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1294946040", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "8d86cbfb-70d2-4e58-9486-b43c3a5d676d"}], "security_groups": [{"name": "tempest-securitygroup--25536156"}], "key_name": "tempest-keypair-1448237638", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "8365f6e6-46fd-4063-a0c3-5cd71b2ce5d1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:12:39.842221 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-34edab48-f46c-4a09-9955-642b922f6f3c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:39.842955 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-34edab48-f46c-4a09-9955-642b922f6f3c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: f5da8a46-9260-405b-aa4e-1f1a585302bb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:39.862969 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-34edab48-f46c-4a09-9955-642b922f6f3c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:39.864068 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-34edab48-f46c-4a09-9955-642b922f6f3c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:39.864702 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-34edab48-f46c-4a09-9955-642b922f6f3c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:39.865829 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-34edab48-f46c-4a09-9955-642b922f6f3c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:39.866500 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-34edab48-f46c-4a09-9955-642b922f6f3c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:39.867131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-34edab48-f46c-4a09-9955-642b922f6f3c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:40.704659 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-a3451084-3b1b-43af-bb1b-e369326c61b1 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] validate_networks() for [('8d86cbfb-70d2-4e58-9486-b43c3a5d676d', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:12:40.750137 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-34edab48-f46c-4a09-9955-642b922f6f3c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:40.762674 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-34edab48-f46c-4a09-9955-642b922f6f3c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb" status: 200 len: 1504 microversion: 2.1 time: 0.927109 Oct 26 13:12:40.766857 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1308/2522] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:39 2022] GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb => generated 1504 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:12:41.558563 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2ccf0389-b2f1-422f-bc58-10dbb3005d7e tempest-FloatingIPDetailsNegativeTestJSON-835920193 tempest-FloatingIPDetailsNegativeTestJSON-835920193-project] Calling method '.version_select at 0x7f67369e7040>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:41.634104 n-d-862686-1 devstack@n-api.service[120598]: DEBUG neutronclient.v2_0.client [None req-2ccf0389-b2f1-422f-bc58-10dbb3005d7e tempest-FloatingIPDetailsNegativeTestJSON-835920193 tempest-FloatingIPDetailsNegativeTestJSON-835920193-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 41072871-7f54-41fe-bee7-fbf767797eb4 could not be found", "detail": ""}} {{(pid=120598) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 26 13:12:41.634859 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-2ccf0389-b2f1-422f-bc58-10dbb3005d7e tempest-FloatingIPDetailsNegativeTestJSON-835920193 tempest-FloatingIPDetailsNegativeTestJSON-835920193-project] HTTP exception thrown: Floating IP not found for ID 41072871-7f54-41fe-bee7-fbf767797eb4 Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2ccf0389-b2f1-422f-bc58-10dbb3005d7e tempest-FloatingIPDetailsNegativeTestJSON-835920193 tempest-FloatingIPDetailsNegativeTestJSON-835920193-project] Request method failure captured: Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/os-floating-ips/41072871-7f54-41fe-bee7-fbf767797eb4 HTTP/1.1 Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTJJ_jIomuDXW6PLXV-2NH5BuANKPa6DFJH8sP2NZHF5_QWYAHheSXT5lKp1f5ZEPU33ofqG-OSwPx0b_JCOn_W7SUUH2YB43QwBL91Xu7_AcB3q_UJF7ZGafnrq1sJuCSZHhNE1Dp-AH-8hU8mnUtakvMr8kFLCrgrCrxfz46vHoxY Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: c610db2155be41468cc3af97f7afc1a6 Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-835920193 Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c610db2155be41468cc3af97f7afc1a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c610db2155be41468cc3af97f7afc1a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c610db2155be41468cc3af97f7afc1a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c610db2155be41468cc3af97f7afc1a6"}]}] Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-835920193 Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: c610db2155be41468cc3af97f7afc1a6 Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-835920193 Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-835920193-project Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 1d54b653b401456ea1aaeb8806819774 Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-835920193-project Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: exception: Floating IP not found for ID 41072871-7f54-41fe-bee7-fbf767797eb4 Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '41072871-7f54-41fe-bee7-fbf767797eb4'} Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 41072871-7f54-41fe-bee7-fbf767797eb4 could not be found Oct 26 13:12:41.636855 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-27dd6ddc-d16f-4e78-9bad-c84b7d9f4a90'] Oct 26 13:12:41.642494 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:41.642494 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:41.642494 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:41.642494 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:41.642494 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 26 13:12:41.642494 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 26 13:12:41.642494 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 26 13:12:41.642494 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 26 13:12:41.642494 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 41072871-7f54-41fe-bee7-fbf767797eb4. Oct 26 13:12:41.642494 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:41.642494 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:41.642494 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:41.642494 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:41.642494 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:41.642494 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:41.642494 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:12:41.642494 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:12:41.642494 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:12:41.642494 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:12:41.642494 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:12:41.642494 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:12:41.642494 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 26 13:12:41.642494 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 26 13:12:41.642494 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 41072871-7f54-41fe-bee7-fbf767797eb4 Oct 26 13:12:41.642494 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:41.642494 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:12:41.642494 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:41.642494 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:12:41.642494 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:12:41.642494 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:12:41.642494 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:12:41.642494 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:12:41.642494 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 41072871-7f54-41fe-bee7-fbf767797eb4 Oct 26 13:12:41.642494 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:12:41.642494 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2ccf0389-b2f1-422f-bc58-10dbb3005d7e tempest-FloatingIPDetailsNegativeTestJSON-835920193 tempest-FloatingIPDetailsNegativeTestJSON-835920193-project] Returning 404 to user: Floating IP not found for ID 41072871-7f54-41fe-bee7-fbf767797eb4 {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:12:41.642494 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2ccf0389-b2f1-422f-bc58-10dbb3005d7e tempest-FloatingIPDetailsNegativeTestJSON-835920193 tempest-FloatingIPDetailsNegativeTestJSON-835920193-project] 10.222.0.40 "GET /compute/v2.1/os-floating-ips/41072871-7f54-41fe-bee7-fbf767797eb4" status: 404 len: 111 microversion: 2.1 time: 0.271338 Oct 26 13:12:41.648185 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1309/2523] 10.222.0.40 () {58 vars in 1260 bytes} [Wed Oct 26 13:12:41 2022] GET /compute/v2.1/os-floating-ips/41072871-7f54-41fe-bee7-fbf767797eb4 => generated 111 bytes in 280 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 13:12:41.792357 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f1b92116-0eba-4030-b7d0-99ee520dd1e2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:41.793650 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f1b92116-0eba-4030-b7d0-99ee520dd1e2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: f5da8a46-9260-405b-aa4e-1f1a585302bb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:41.809395 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1b92116-0eba-4030-b7d0-99ee520dd1e2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:41.815111 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1b92116-0eba-4030-b7d0-99ee520dd1e2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:41.815995 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1b92116-0eba-4030-b7d0-99ee520dd1e2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:41.816950 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1b92116-0eba-4030-b7d0-99ee520dd1e2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:41.817677 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1b92116-0eba-4030-b7d0-99ee520dd1e2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:41.818302 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1b92116-0eba-4030-b7d0-99ee520dd1e2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:42.188177 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f1b92116-0eba-4030-b7d0-99ee520dd1e2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:42.199508 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f1b92116-0eba-4030-b7d0-99ee520dd1e2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb" status: 200 len: 1504 microversion: 2.1 time: 0.413208 Oct 26 13:12:42.205512 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1310/2524] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:41 2022] GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb => generated 1504 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:43.231517 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c74ae794-7fc4-47b8-8990-c6e647e0b0fe tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:43.232789 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c74ae794-7fc4-47b8-8990-c6e647e0b0fe tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: f5da8a46-9260-405b-aa4e-1f1a585302bb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:43.241726 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c74ae794-7fc4-47b8-8990-c6e647e0b0fe tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:43.242600 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c74ae794-7fc4-47b8-8990-c6e647e0b0fe tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:43.244096 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c74ae794-7fc4-47b8-8990-c6e647e0b0fe tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:43.245340 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c74ae794-7fc4-47b8-8990-c6e647e0b0fe tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:43.246036 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c74ae794-7fc4-47b8-8990-c6e647e0b0fe tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:43.246610 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c74ae794-7fc4-47b8-8990-c6e647e0b0fe tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:43.289241 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:12:44.023265 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-a3451084-3b1b-43af-bb1b-e369326c61b1 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Getting quotas for project fd40483e170343f5a02795c16d063066. Resources: dict_keys(['metadata_items']) {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:12:44.030439 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-a3451084-3b1b-43af-bb1b-e369326c61b1 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Getting quotas for user ea62f9a8c1094cf6810848551cd4fd18 and project fd40483e170343f5a02795c16d063066. Resources: dict_keys(['metadata_items']) {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:12:44.060352 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-a3451084-3b1b-43af-bb1b-e369326c61b1 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:12:44.061274 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-a3451084-3b1b-43af-bb1b-e369326c61b1 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:12:44.061986 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-a3451084-3b1b-43af-bb1b-e369326c61b1 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:12:44.064575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-a3451084-3b1b-43af-bb1b-e369326c61b1 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:12:44.065590 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-a3451084-3b1b-43af-bb1b-e369326c61b1 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:12:44.091270 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a3451084-3b1b-43af-bb1b-e369326c61b1 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:44.092059 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a3451084-3b1b-43af-bb1b-e369326c61b1 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:44.092641 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a3451084-3b1b-43af-bb1b-e369326c61b1 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:44.096229 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a3451084-3b1b-43af-bb1b-e369326c61b1 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:44.096881 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a3451084-3b1b-43af-bb1b-e369326c61b1 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:44.097678 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a3451084-3b1b-43af-bb1b-e369326c61b1 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:44.134920 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-a3451084-3b1b-43af-bb1b-e369326c61b1 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Getting quotas for project fd40483e170343f5a02795c16d063066. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:12:44.151187 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-a3451084-3b1b-43af-bb1b-e369326c61b1 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Getting quotas for user ea62f9a8c1094cf6810848551cd4fd18 and project fd40483e170343f5a02795c16d063066. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:12:44.348105 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a3451084-3b1b-43af-bb1b-e369326c61b1 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:12:44.356277 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a3451084-3b1b-43af-bb1b-e369326c61b1 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] [instance: 54ffeffd-483c-4d6d-8517-105a666e2402] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8365f6e6-46fd-4063-a0c3-5cd71b2ce5d1',volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:12:44.491643 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c74ae794-7fc4-47b8-8990-c6e647e0b0fe tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:44.519406 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c74ae794-7fc4-47b8-8990-c6e647e0b0fe tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb" status: 200 len: 1504 microversion: 2.1 time: 1.291830 Oct 26 13:12:44.530453 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1311/2525] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:43 2022] GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb => generated 1504 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:12:44.664600 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-be8ab843-5e60-4bca-b29a-3f82e0296e08 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-514684186", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:12:44.762584 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-be8ab843-5e60-4bca-b29a-3f82e0296e08 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] validate_networks() for None {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:12:44.772482 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a3451084-3b1b-43af-bb1b-e369326c61b1 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 5.082322 Oct 26 13:12:44.774030 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1215/2526] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:12:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 5090 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:12:44.816469 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cc3a0e50-a147-4d52-89d8-b3857e5bf1b8 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:44.825347 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cc3a0e50-a147-4d52-89d8-b3857e5bf1b8 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] [instance: 54ffeffd-483c-4d6d-8517-105a666e2402] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:45.111233 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cc3a0e50-a147-4d52-89d8-b3857e5bf1b8 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea62f9a8c1094cf6810848551cd4fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd40483e170343f5a02795c16d063066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:45.121279 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cc3a0e50-a147-4d52-89d8-b3857e5bf1b8 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] 10.222.0.40 "GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402" status: 200 len: 1122 microversion: 2.1 time: 0.328662 Oct 26 13:12:45.134093 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1216/2527] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:44 2022] GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402 => generated 1122 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:45.553450 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-77882bd2-27c8-419f-9a00-a49c41449e9c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:45.554132 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-77882bd2-27c8-419f-9a00-a49c41449e9c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: f5da8a46-9260-405b-aa4e-1f1a585302bb] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:45.579758 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-77882bd2-27c8-419f-9a00-a49c41449e9c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:45.580622 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-77882bd2-27c8-419f-9a00-a49c41449e9c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:45.587849 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-77882bd2-27c8-419f-9a00-a49c41449e9c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:45.588641 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-77882bd2-27c8-419f-9a00-a49c41449e9c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:45.595429 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-77882bd2-27c8-419f-9a00-a49c41449e9c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:45.595666 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-77882bd2-27c8-419f-9a00-a49c41449e9c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:45.622905 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:12:46.212230 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-be8ab843-5e60-4bca-b29a-3f82e0296e08 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:12:46.212799 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-be8ab843-5e60-4bca-b29a-3f82e0296e08 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:12:46.213247 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-be8ab843-5e60-4bca-b29a-3f82e0296e08 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:12:46.213693 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-be8ab843-5e60-4bca-b29a-3f82e0296e08 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:12:46.214111 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-be8ab843-5e60-4bca-b29a-3f82e0296e08 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:12:46.255402 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be8ab843-5e60-4bca-b29a-3f82e0296e08 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:46.255895 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be8ab843-5e60-4bca-b29a-3f82e0296e08 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:46.256336 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be8ab843-5e60-4bca-b29a-3f82e0296e08 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:46.257072 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be8ab843-5e60-4bca-b29a-3f82e0296e08 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:46.263333 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be8ab843-5e60-4bca-b29a-3f82e0296e08 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:46.263838 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be8ab843-5e60-4bca-b29a-3f82e0296e08 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:46.301132 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-77882bd2-27c8-419f-9a00-a49c41449e9c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:46.311037 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-77882bd2-27c8-419f-9a00-a49c41449e9c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb" status: 200 len: 1494 microversion: 2.1 time: 0.761669 Oct 26 13:12:46.317551 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1217/2528] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:45 2022] GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb => generated 1494 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:12:46.322456 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2935cf9a-e64d-4f33-a632-cb93adfa6f83 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:46.337463 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-be8ab843-5e60-4bca-b29a-3f82e0296e08 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Getting quotas for project 1fffeaed862d4dfe9abdc2c36a66a0cc. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:12:46.346458 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2935cf9a-e64d-4f33-a632-cb93adfa6f83 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] [instance: 54ffeffd-483c-4d6d-8517-105a666e2402] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:46.351574 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-be8ab843-5e60-4bca-b29a-3f82e0296e08 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Getting quotas for user 6815934fa00041fba4d2a88b3648eb07 and project 1fffeaed862d4dfe9abdc2c36a66a0cc. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:12:46.356860 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2935cf9a-e64d-4f33-a632-cb93adfa6f83 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:46.357359 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2935cf9a-e64d-4f33-a632-cb93adfa6f83 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:46.357835 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2935cf9a-e64d-4f33-a632-cb93adfa6f83 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:46.358550 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2935cf9a-e64d-4f33-a632-cb93adfa6f83 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:46.359008 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2935cf9a-e64d-4f33-a632-cb93adfa6f83 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:46.359963 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2935cf9a-e64d-4f33-a632-cb93adfa6f83 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:46.374018 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-be8ab843-5e60-4bca-b29a-3f82e0296e08 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:12:46.378703 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-be8ab843-5e60-4bca-b29a-3f82e0296e08 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] [instance: 0dd070a1-a68f-4c94-9244-d59c94d109f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:12:46.545043 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-be8ab843-5e60-4bca-b29a-3f82e0296e08 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.005242 Oct 26 13:12:46.553438 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1312/2529] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:12:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:12:46.556607 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-70e3e3c9-d32c-46ea-a673-af3ba7528e8e tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Calling method '.version_select at 0x7f6732759f70>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:46.580805 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70e3e3c9-d32c-46ea-a673-af3ba7528e8e tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:46.583333 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70e3e3c9-d32c-46ea-a673-af3ba7528e8e tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:46.583781 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70e3e3c9-d32c-46ea-a673-af3ba7528e8e tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:46.619679 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-70e3e3c9-d32c-46ea-a673-af3ba7528e8e tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 398 microversion: 2.1 time: 0.060121 Oct 26 13:12:46.635413 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1313/2530] 10.222.0.40 () {58 vars in 1143 bytes} [Wed Oct 26 13:12:46 2022] GET /compute/v2.1/os-migrations => generated 398 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:12:46.643260 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8dad862a-1dad-452f-8854-2dae11bc1073 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:46.645153 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8dad862a-1dad-452f-8854-2dae11bc1073 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] [instance: 0dd070a1-a68f-4c94-9244-d59c94d109f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:46.775551 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8dad862a-1dad-452f-8854-2dae11bc1073 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6815934fa00041fba4d2a88b3648eb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fffeaed862d4dfe9abdc2c36a66a0cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:46.815658 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8dad862a-1dad-452f-8854-2dae11bc1073 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9" status: 200 len: 1216 microversion: 2.1 time: 0.166059 Oct 26 13:12:46.819306 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1314/2531] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:46 2022] GET /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9 => generated 1216 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:46.838033 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-13edfea2-880f-4a4b-801a-29d32b4ad5bc tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:46.838650 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-13edfea2-880f-4a4b-801a-29d32b4ad5bc tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] [instance: f5da8a46-9260-405b-aa4e-1f1a585302bb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:46.877984 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-13edfea2-880f-4a4b-801a-29d32b4ad5bc tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:46.880915 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-13edfea2-880f-4a4b-801a-29d32b4ad5bc tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:46.881500 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-13edfea2-880f-4a4b-801a-29d32b4ad5bc tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:46.883550 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-13edfea2-880f-4a4b-801a-29d32b4ad5bc tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:46.885613 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-13edfea2-880f-4a4b-801a-29d32b4ad5bc tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:46.887550 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-13edfea2-880f-4a4b-801a-29d32b4ad5bc tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:47.191703 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2935cf9a-e64d-4f33-a632-cb93adfa6f83 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea62f9a8c1094cf6810848551cd4fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd40483e170343f5a02795c16d063066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:47.215649 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2935cf9a-e64d-4f33-a632-cb93adfa6f83 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] 10.222.0.40 "GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402" status: 200 len: 1220 microversion: 2.1 time: 0.893840 Oct 26 13:12:47.216300 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1218/2532] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:46 2022] GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402 => generated 1220 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:47.761553 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-13edfea2-880f-4a4b-801a-29d32b4ad5bc tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb" status: 200 len: 1645 microversion: 2.1 time: 0.934327 Oct 26 13:12:47.765589 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1315/2533] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:46 2022] GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb => generated 1645 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:47.842948 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4cd3fb97-7ee8-4a09-9f03-98a7b1190eea tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:47.844219 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4cd3fb97-7ee8-4a09-9f03-98a7b1190eea tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] [instance: 0dd070a1-a68f-4c94-9244-d59c94d109f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:47.864892 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4cd3fb97-7ee8-4a09-9f03-98a7b1190eea tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:47.865588 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4cd3fb97-7ee8-4a09-9f03-98a7b1190eea tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:47.866219 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4cd3fb97-7ee8-4a09-9f03-98a7b1190eea tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:47.867257 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4cd3fb97-7ee8-4a09-9f03-98a7b1190eea tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:47.867867 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4cd3fb97-7ee8-4a09-9f03-98a7b1190eea tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:47.868446 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4cd3fb97-7ee8-4a09-9f03-98a7b1190eea tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:48.035370 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-88933f70-8d58-407a-8dba-7621d1bb671e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1247133291", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "4f5cd804-e666-4be2-8848-0a3733eede9c"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:12:48.143227 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-88933f70-8d58-407a-8dba-7621d1bb671e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] validate_networks() for [('4f5cd804-e666-4be2-8848-0a3733eede9c', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:12:48.604418 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4cd3fb97-7ee8-4a09-9f03-98a7b1190eea tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6815934fa00041fba4d2a88b3648eb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fffeaed862d4dfe9abdc2c36a66a0cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:48.614227 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4cd3fb97-7ee8-4a09-9f03-98a7b1190eea tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9" status: 200 len: 1212 microversion: 2.1 time: 0.774949 Oct 26 13:12:48.617334 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1219/2534] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:47 2022] GET /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9 => generated 1212 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:48.625137 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0539e92c-29aa-4043-948a-73087aa07ed1 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:48.633082 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0539e92c-29aa-4043-948a-73087aa07ed1 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] [instance: 54ffeffd-483c-4d6d-8517-105a666e2402] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:48.658752 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0539e92c-29aa-4043-948a-73087aa07ed1 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:48.664151 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0539e92c-29aa-4043-948a-73087aa07ed1 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:48.664638 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0539e92c-29aa-4043-948a-73087aa07ed1 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:48.665520 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0539e92c-29aa-4043-948a-73087aa07ed1 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:48.666010 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0539e92c-29aa-4043-948a-73087aa07ed1 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:48.666436 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0539e92c-29aa-4043-948a-73087aa07ed1 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:48.871991 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0539e92c-29aa-4043-948a-73087aa07ed1 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea62f9a8c1094cf6810848551cd4fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd40483e170343f5a02795c16d063066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:48.895264 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0539e92c-29aa-4043-948a-73087aa07ed1 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] 10.222.0.40 "GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402" status: 200 len: 1238 microversion: 2.1 time: 0.274108 Oct 26 13:12:48.905982 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1220/2535] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:48 2022] GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402 => generated 1238 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:49.636651 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-25519cfd-772f-4bf1-963b-c37082eac985 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:49.637269 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-25519cfd-772f-4bf1-963b-c37082eac985 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] [instance: 0dd070a1-a68f-4c94-9244-d59c94d109f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:49.652178 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-25519cfd-772f-4bf1-963b-c37082eac985 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:49.662312 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-25519cfd-772f-4bf1-963b-c37082eac985 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:49.663013 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-25519cfd-772f-4bf1-963b-c37082eac985 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:49.663924 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-25519cfd-772f-4bf1-963b-c37082eac985 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:49.664537 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-25519cfd-772f-4bf1-963b-c37082eac985 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:49.665899 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-25519cfd-772f-4bf1-963b-c37082eac985 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:50.428723 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-25519cfd-772f-4bf1-963b-c37082eac985 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6815934fa00041fba4d2a88b3648eb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fffeaed862d4dfe9abdc2c36a66a0cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:50.436462 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-25519cfd-772f-4bf1-963b-c37082eac985 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9" status: 200 len: 1274 microversion: 2.1 time: 0.803796 Oct 26 13:12:50.450242 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1221/2536] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:49 2022] GET /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9 => generated 1274 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:50.455672 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-25f632ef-4a69-4c95-adfa-a0920f6a13b6 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:50.456287 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-25f632ef-4a69-4c95-adfa-a0920f6a13b6 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] [instance: 54ffeffd-483c-4d6d-8517-105a666e2402] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:50.480155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-25f632ef-4a69-4c95-adfa-a0920f6a13b6 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:50.485051 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-25f632ef-4a69-4c95-adfa-a0920f6a13b6 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:50.485941 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-25f632ef-4a69-4c95-adfa-a0920f6a13b6 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:50.489019 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-25f632ef-4a69-4c95-adfa-a0920f6a13b6 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:50.490782 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-25f632ef-4a69-4c95-adfa-a0920f6a13b6 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:50.494941 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-25f632ef-4a69-4c95-adfa-a0920f6a13b6 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:51.006656 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-25f632ef-4a69-4c95-adfa-a0920f6a13b6 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea62f9a8c1094cf6810848551cd4fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd40483e170343f5a02795c16d063066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:51.025422 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-25f632ef-4a69-4c95-adfa-a0920f6a13b6 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] 10.222.0.40 "GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402" status: 200 len: 1238 microversion: 2.1 time: 0.573833 Oct 26 13:12:51.032665 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1222/2537] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:50 2022] GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402 => generated 1238 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:51.223575 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-88933f70-8d58-407a-8dba-7621d1bb671e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:12:51.224049 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-88933f70-8d58-407a-8dba-7621d1bb671e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:12:51.224458 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-88933f70-8d58-407a-8dba-7621d1bb671e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:12:51.224865 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-88933f70-8d58-407a-8dba-7621d1bb671e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:12:51.225273 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-88933f70-8d58-407a-8dba-7621d1bb671e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:12:51.235621 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88933f70-8d58-407a-8dba-7621d1bb671e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:51.236358 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88933f70-8d58-407a-8dba-7621d1bb671e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:51.236983 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88933f70-8d58-407a-8dba-7621d1bb671e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:51.237898 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88933f70-8d58-407a-8dba-7621d1bb671e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:51.246313 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88933f70-8d58-407a-8dba-7621d1bb671e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:51.247006 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88933f70-8d58-407a-8dba-7621d1bb671e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:51.311998 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-88933f70-8d58-407a-8dba-7621d1bb671e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Getting quotas for project 4f1ce8734839480ca6b07416a9c6d9c3. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:12:51.331203 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-88933f70-8d58-407a-8dba-7621d1bb671e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Getting quotas for user f96da2e13ca64db2a16d58aee1fc921d and project 4f1ce8734839480ca6b07416a9c6d9c3. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:12:51.365305 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-88933f70-8d58-407a-8dba-7621d1bb671e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:12:51.368160 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-88933f70-8d58-407a-8dba-7621d1bb671e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 9534d3ef-723b-4f68-b147-9c3aceed8206] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:12:51.463822 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2fe7e7f9-922a-4acb-9d69-ae6e55469af6 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:51.464469 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2fe7e7f9-922a-4acb-9d69-ae6e55469af6 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] [instance: 0dd070a1-a68f-4c94-9244-d59c94d109f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:51.499072 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2fe7e7f9-922a-4acb-9d69-ae6e55469af6 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:51.499377 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2fe7e7f9-922a-4acb-9d69-ae6e55469af6 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:51.500027 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2fe7e7f9-922a-4acb-9d69-ae6e55469af6 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:51.500761 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2fe7e7f9-922a-4acb-9d69-ae6e55469af6 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:51.501476 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2fe7e7f9-922a-4acb-9d69-ae6e55469af6 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:51.501851 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-88933f70-8d58-407a-8dba-7621d1bb671e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.471122 Oct 26 13:12:51.502407 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2fe7e7f9-922a-4acb-9d69-ae6e55469af6 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:51.513541 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1316/2538] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:12:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 3483 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:12:51.519132 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-95f89db1-65bb-43fb-b19c-19ff01664116 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:51.532928 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-95f89db1-65bb-43fb-b19c-19ff01664116 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 9534d3ef-723b-4f68-b147-9c3aceed8206] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:51.953114 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-95f89db1-65bb-43fb-b19c-19ff01664116 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:51.967067 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-95f89db1-65bb-43fb-b19c-19ff01664116 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206" status: 200 len: 1211 microversion: 2.1 time: 0.452304 Oct 26 13:12:51.968783 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1317/2539] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:51 2022] GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206 => generated 1211 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:52.064106 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a9ac204a-dd4d-4d75-8e9e-6e6e9d6b06d7 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:52.065082 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a9ac204a-dd4d-4d75-8e9e-6e6e9d6b06d7 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] [instance: 54ffeffd-483c-4d6d-8517-105a666e2402] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:52.075612 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a9ac204a-dd4d-4d75-8e9e-6e6e9d6b06d7 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:52.077549 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a9ac204a-dd4d-4d75-8e9e-6e6e9d6b06d7 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:52.080462 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a9ac204a-dd4d-4d75-8e9e-6e6e9d6b06d7 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:52.081570 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a9ac204a-dd4d-4d75-8e9e-6e6e9d6b06d7 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:52.082711 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a9ac204a-dd4d-4d75-8e9e-6e6e9d6b06d7 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:52.084138 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a9ac204a-dd4d-4d75-8e9e-6e6e9d6b06d7 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:52.769397 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a9ac204a-dd4d-4d75-8e9e-6e6e9d6b06d7 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea62f9a8c1094cf6810848551cd4fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd40483e170343f5a02795c16d063066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:52.792058 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a9ac204a-dd4d-4d75-8e9e-6e6e9d6b06d7 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] 10.222.0.40 "GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402" status: 200 len: 1304 microversion: 2.1 time: 0.731664 Oct 26 13:12:52.811899 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1318/2540] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:52 2022] GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402 => generated 1304 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:52.865145 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2fe7e7f9-922a-4acb-9d69-ae6e55469af6 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6815934fa00041fba4d2a88b3648eb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fffeaed862d4dfe9abdc2c36a66a0cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:52.921108 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2fe7e7f9-922a-4acb-9d69-ae6e55469af6 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9" status: 200 len: 1316 microversion: 2.1 time: 1.446775 Oct 26 13:12:52.941518 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1223/2541] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:51 2022] GET /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9 => generated 1316 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:52.992194 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-47a285eb-3503-448b-bd1f-0c8319ba5a7f tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:52.993429 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-47a285eb-3503-448b-bd1f-0c8319ba5a7f tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 9534d3ef-723b-4f68-b147-9c3aceed8206] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:53.003997 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47a285eb-3503-448b-bd1f-0c8319ba5a7f tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:53.004811 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47a285eb-3503-448b-bd1f-0c8319ba5a7f tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:53.005909 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47a285eb-3503-448b-bd1f-0c8319ba5a7f tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:53.006899 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47a285eb-3503-448b-bd1f-0c8319ba5a7f tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:53.007547 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47a285eb-3503-448b-bd1f-0c8319ba5a7f tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:53.008315 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47a285eb-3503-448b-bd1f-0c8319ba5a7f tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:53.363822 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-47a285eb-3503-448b-bd1f-0c8319ba5a7f tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:53.378447 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-47a285eb-3503-448b-bd1f-0c8319ba5a7f tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206" status: 200 len: 1263 microversion: 2.1 time: 0.390363 Oct 26 13:12:53.395504 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1319/2542] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:52 2022] GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206 => generated 1263 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:53.827709 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-58a73ee2-af0e-48c1-bbc6-a17a1ff541ec tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:53.831639 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-58a73ee2-af0e-48c1-bbc6-a17a1ff541ec tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] [instance: 54ffeffd-483c-4d6d-8517-105a666e2402] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:53.867106 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-58a73ee2-af0e-48c1-bbc6-a17a1ff541ec tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:53.867872 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-58a73ee2-af0e-48c1-bbc6-a17a1ff541ec tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:53.868413 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-58a73ee2-af0e-48c1-bbc6-a17a1ff541ec tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:53.869159 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-58a73ee2-af0e-48c1-bbc6-a17a1ff541ec tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:53.869760 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-58a73ee2-af0e-48c1-bbc6-a17a1ff541ec tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:53.870489 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-58a73ee2-af0e-48c1-bbc6-a17a1ff541ec tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:53.948877 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-682dc277-7f6d-43fb-9cc5-a06f29302875 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:53.949818 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-682dc277-7f6d-43fb-9cc5-a06f29302875 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] [instance: 0dd070a1-a68f-4c94-9244-d59c94d109f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:53.961027 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-682dc277-7f6d-43fb-9cc5-a06f29302875 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:53.964212 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-682dc277-7f6d-43fb-9cc5-a06f29302875 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:53.967402 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-682dc277-7f6d-43fb-9cc5-a06f29302875 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:53.968299 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-682dc277-7f6d-43fb-9cc5-a06f29302875 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:53.977731 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-682dc277-7f6d-43fb-9cc5-a06f29302875 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:53.979859 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-682dc277-7f6d-43fb-9cc5-a06f29302875 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:54.119785 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:12:54.334999 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-58a73ee2-af0e-48c1-bbc6-a17a1ff541ec tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea62f9a8c1094cf6810848551cd4fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd40483e170343f5a02795c16d063066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:54.343604 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-58a73ee2-af0e-48c1-bbc6-a17a1ff541ec tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] 10.222.0.40 "GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402" status: 200 len: 1304 microversion: 2.1 time: 0.529681 Oct 26 13:12:54.348038 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1224/2543] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:53 2022] GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402 => generated 1304 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:54.408055 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2b9cbeec-0ee5-43e5-b023-073ef10ff433 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:54.408887 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2b9cbeec-0ee5-43e5-b023-073ef10ff433 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 9534d3ef-723b-4f68-b147-9c3aceed8206] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:54.419080 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b9cbeec-0ee5-43e5-b023-073ef10ff433 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:54.422978 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b9cbeec-0ee5-43e5-b023-073ef10ff433 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:54.423678 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b9cbeec-0ee5-43e5-b023-073ef10ff433 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:54.426109 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b9cbeec-0ee5-43e5-b023-073ef10ff433 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:54.426791 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b9cbeec-0ee5-43e5-b023-073ef10ff433 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:54.429970 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b9cbeec-0ee5-43e5-b023-073ef10ff433 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:54.471527 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-682dc277-7f6d-43fb-9cc5-a06f29302875 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6815934fa00041fba4d2a88b3648eb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fffeaed862d4dfe9abdc2c36a66a0cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:54.489253 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-682dc277-7f6d-43fb-9cc5-a06f29302875 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9" status: 200 len: 1316 microversion: 2.1 time: 0.544274 Oct 26 13:12:54.490939 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1320/2544] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:53 2022] GET /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9 => generated 1316 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:12:54.599593 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2b9cbeec-0ee5-43e5-b023-073ef10ff433 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:54.618770 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2b9cbeec-0ee5-43e5-b023-073ef10ff433 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206" status: 200 len: 1269 microversion: 2.1 time: 0.204278 Oct 26 13:12:54.645692 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1225/2545] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:54 2022] GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206 => generated 1269 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:55.372293 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6dcfdb97-3485-4361-85fd-95db83672c6b tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:55.373169 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6dcfdb97-3485-4361-85fd-95db83672c6b tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] [instance: 54ffeffd-483c-4d6d-8517-105a666e2402] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:55.392083 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6dcfdb97-3485-4361-85fd-95db83672c6b tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:55.393176 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6dcfdb97-3485-4361-85fd-95db83672c6b tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:55.394605 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6dcfdb97-3485-4361-85fd-95db83672c6b tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:55.398558 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6dcfdb97-3485-4361-85fd-95db83672c6b tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:55.400132 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6dcfdb97-3485-4361-85fd-95db83672c6b tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:55.403613 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6dcfdb97-3485-4361-85fd-95db83672c6b tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:55.516729 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-109258f9-c5aa-42d2-9b4f-3e4cb3452e28 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:55.517538 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-109258f9-c5aa-42d2-9b4f-3e4cb3452e28 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] [instance: 0dd070a1-a68f-4c94-9244-d59c94d109f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:55.527852 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=12 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:12:55.533765 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-109258f9-c5aa-42d2-9b4f-3e4cb3452e28 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:55.534860 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-109258f9-c5aa-42d2-9b4f-3e4cb3452e28 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:55.537938 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-109258f9-c5aa-42d2-9b4f-3e4cb3452e28 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:55.541699 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-109258f9-c5aa-42d2-9b4f-3e4cb3452e28 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:55.544471 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-109258f9-c5aa-42d2-9b4f-3e4cb3452e28 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:55.545119 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-109258f9-c5aa-42d2-9b4f-3e4cb3452e28 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:56.832564 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-109258f9-c5aa-42d2-9b4f-3e4cb3452e28 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6815934fa00041fba4d2a88b3648eb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fffeaed862d4dfe9abdc2c36a66a0cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:56.844670 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-109258f9-c5aa-42d2-9b4f-3e4cb3452e28 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9" status: 200 len: 1316 microversion: 2.1 time: 1.331944 Oct 26 13:12:56.845569 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1226/2546] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:55 2022] GET /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9 => generated 1316 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:12:56.859796 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-9cbf3dd3-31b0-462a-b228-b11d08c71f4a req-c0d059dd-0628-4e0d-8215-72b2d7f5089f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54ffeffd-483c-4d6d-8517-105a666e2402", "tag": "a9d9e989-0192-4729-afb9-8ddfa02d05c4"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:12:56.886182 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9cbf3dd3-31b0-462a-b228-b11d08c71f4a req-c0d059dd-0628-4e0d-8215-72b2d7f5089f service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:56.886640 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9cbf3dd3-31b0-462a-b228-b11d08c71f4a req-c0d059dd-0628-4e0d-8215-72b2d7f5089f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:56.887166 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9cbf3dd3-31b0-462a-b228-b11d08c71f4a req-c0d059dd-0628-4e0d-8215-72b2d7f5089f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:56.901462 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-9cbf3dd3-31b0-462a-b228-b11d08c71f4a req-c0d059dd-0628-4e0d-8215-72b2d7f5089f service nova] Creating event network-changed:a9d9e989-0192-4729-afb9-8ddfa02d05c4 for instance 54ffeffd-483c-4d6d-8517-105a666e2402 on n-h1-862686-1 Oct 26 13:12:56.907977 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-9cbf3dd3-31b0-462a-b228-b11d08c71f4a req-c0d059dd-0628-4e0d-8215-72b2d7f5089f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060308 Oct 26 13:12:56.909205 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1227/2547] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:12:56.916036 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-250d806e-9cf7-45fd-88a4-d47d2b24c9f3 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:56.916920 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-250d806e-9cf7-45fd-88a4-d47d2b24c9f3 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 9534d3ef-723b-4f68-b147-9c3aceed8206] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:56.926842 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-250d806e-9cf7-45fd-88a4-d47d2b24c9f3 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:56.927540 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-250d806e-9cf7-45fd-88a4-d47d2b24c9f3 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:56.928367 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-250d806e-9cf7-45fd-88a4-d47d2b24c9f3 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:56.929284 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-250d806e-9cf7-45fd-88a4-d47d2b24c9f3 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:56.929936 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-250d806e-9cf7-45fd-88a4-d47d2b24c9f3 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:56.930613 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-250d806e-9cf7-45fd-88a4-d47d2b24c9f3 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:57.018499 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6dcfdb97-3485-4361-85fd-95db83672c6b tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea62f9a8c1094cf6810848551cd4fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd40483e170343f5a02795c16d063066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:57.034415 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6dcfdb97-3485-4361-85fd-95db83672c6b tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] 10.222.0.40 "GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402" status: 200 len: 1304 microversion: 2.1 time: 1.666558 Oct 26 13:12:57.035395 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1321/2548] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:55 2022] GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402 => generated 1304 bytes in 1669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:57.406438 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-250d806e-9cf7-45fd-88a4-d47d2b24c9f3 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:57.444286 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-250d806e-9cf7-45fd-88a4-d47d2b24c9f3 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206" status: 200 len: 1311 microversion: 2.1 time: 0.533500 Oct 26 13:12:57.468154 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1228/2549] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:56 2022] GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206 => generated 1311 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:57.612196 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-170c2b8d-8484-49aa-9be3-4232e2fc0741 req-35a60495-2489-42f6-92db-747d08e7ff72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dd070a1-a68f-4c94-9244-d59c94d109f9", "tag": "099ba429-75b7-4428-a8bf-6d2540652296"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:12:57.631946 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-170c2b8d-8484-49aa-9be3-4232e2fc0741 req-35a60495-2489-42f6-92db-747d08e7ff72 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:57.632432 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-170c2b8d-8484-49aa-9be3-4232e2fc0741 req-35a60495-2489-42f6-92db-747d08e7ff72 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:57.637566 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-170c2b8d-8484-49aa-9be3-4232e2fc0741 req-35a60495-2489-42f6-92db-747d08e7ff72 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:57.663634 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-170c2b8d-8484-49aa-9be3-4232e2fc0741 req-35a60495-2489-42f6-92db-747d08e7ff72 service nova] Creating event network-changed:099ba429-75b7-4428-a8bf-6d2540652296 for instance 0dd070a1-a68f-4c94-9244-d59c94d109f9 on n-h2-862686-1 Oct 26 13:12:57.677499 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-170c2b8d-8484-49aa-9be3-4232e2fc0741 req-35a60495-2489-42f6-92db-747d08e7ff72 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070620 Oct 26 13:12:57.678430 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1322/2550] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:12:57.877681 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1cc7ad86-d719-40fe-983a-ef2f9826dfd0 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:57.879247 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1cc7ad86-d719-40fe-983a-ef2f9826dfd0 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] [instance: 0dd070a1-a68f-4c94-9244-d59c94d109f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:57.902134 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1cc7ad86-d719-40fe-983a-ef2f9826dfd0 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:57.903495 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1cc7ad86-d719-40fe-983a-ef2f9826dfd0 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:57.904812 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1cc7ad86-d719-40fe-983a-ef2f9826dfd0 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:57.908149 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1cc7ad86-d719-40fe-983a-ef2f9826dfd0 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:57.909788 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1cc7ad86-d719-40fe-983a-ef2f9826dfd0 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:57.911033 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1cc7ad86-d719-40fe-983a-ef2f9826dfd0 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:58.060514 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-379794f3-9ce9-4cff-98ae-65933ccd176e tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:58.061900 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-379794f3-9ce9-4cff-98ae-65933ccd176e tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] [instance: 54ffeffd-483c-4d6d-8517-105a666e2402] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:58.069860 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-379794f3-9ce9-4cff-98ae-65933ccd176e tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:58.070649 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-379794f3-9ce9-4cff-98ae-65933ccd176e tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:58.071301 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-379794f3-9ce9-4cff-98ae-65933ccd176e tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:58.072466 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-379794f3-9ce9-4cff-98ae-65933ccd176e tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:58.073608 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-379794f3-9ce9-4cff-98ae-65933ccd176e tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:58.074251 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-379794f3-9ce9-4cff-98ae-65933ccd176e tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:58.714417 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1cc7ad86-d719-40fe-983a-ef2f9826dfd0 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6815934fa00041fba4d2a88b3648eb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fffeaed862d4dfe9abdc2c36a66a0cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:58.726301 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1cc7ad86-d719-40fe-983a-ef2f9826dfd0 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9" status: 200 len: 1316 microversion: 2.1 time: 0.861255 Oct 26 13:12:58.727611 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1229/2551] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:57 2022] GET /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9 => generated 1316 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:58.735309 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-16126108-bd95-46a2-9e13-e875cbc75b05 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:58.736381 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-16126108-bd95-46a2-9e13-e875cbc75b05 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 9534d3ef-723b-4f68-b147-9c3aceed8206] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:58.745870 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-16126108-bd95-46a2-9e13-e875cbc75b05 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:58.746677 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-16126108-bd95-46a2-9e13-e875cbc75b05 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:58.747415 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-16126108-bd95-46a2-9e13-e875cbc75b05 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:58.748329 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-16126108-bd95-46a2-9e13-e875cbc75b05 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:58.748864 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-16126108-bd95-46a2-9e13-e875cbc75b05 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:58.749357 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-16126108-bd95-46a2-9e13-e875cbc75b05 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:58.820135 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-379794f3-9ce9-4cff-98ae-65933ccd176e tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea62f9a8c1094cf6810848551cd4fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd40483e170343f5a02795c16d063066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:58.830449 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-379794f3-9ce9-4cff-98ae-65933ccd176e tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] 10.222.0.40 "GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402" status: 200 len: 1292 microversion: 2.1 time: 0.774020 Oct 26 13:12:58.831195 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1323/2552] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:58 2022] GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402 => generated 1292 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:12:59.256892 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-16126108-bd95-46a2-9e13-e875cbc75b05 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:12:59.272027 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-16126108-bd95-46a2-9e13-e875cbc75b05 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206" status: 200 len: 1311 microversion: 2.1 time: 0.542449 Oct 26 13:12:59.278109 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1230/2553] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:58 2022] GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206 => generated 1311 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:12:59.758853 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-af45980a-8578-4c61-ba63-65c0f201f731 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:59.759483 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-af45980a-8578-4c61-ba63-65c0f201f731 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] [instance: 0dd070a1-a68f-4c94-9244-d59c94d109f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:59.779337 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af45980a-8578-4c61-ba63-65c0f201f731 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:59.779832 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af45980a-8578-4c61-ba63-65c0f201f731 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:59.780465 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af45980a-8578-4c61-ba63-65c0f201f731 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:59.782187 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af45980a-8578-4c61-ba63-65c0f201f731 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:59.782852 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af45980a-8578-4c61-ba63-65c0f201f731 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:59.783450 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af45980a-8578-4c61-ba63-65c0f201f731 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:59.865595 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4cf6099e-6aa6-4da4-b1f6-869d62062e1a tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:12:59.866229 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4cf6099e-6aa6-4da4-b1f6-869d62062e1a tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] [instance: 54ffeffd-483c-4d6d-8517-105a666e2402] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:12:59.888676 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4cf6099e-6aa6-4da4-b1f6-869d62062e1a tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:59.889199 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4cf6099e-6aa6-4da4-b1f6-869d62062e1a tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:59.889699 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4cf6099e-6aa6-4da4-b1f6-869d62062e1a tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:12:59.890940 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4cf6099e-6aa6-4da4-b1f6-869d62062e1a tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:12:59.891427 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4cf6099e-6aa6-4da4-b1f6-869d62062e1a tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:12:59.891840 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4cf6099e-6aa6-4da4-b1f6-869d62062e1a tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:00.175815 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4cf6099e-6aa6-4da4-b1f6-869d62062e1a tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea62f9a8c1094cf6810848551cd4fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd40483e170343f5a02795c16d063066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:00.194788 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4cf6099e-6aa6-4da4-b1f6-869d62062e1a tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] 10.222.0.40 "GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402" status: 200 len: 1292 microversion: 2.1 time: 0.342443 Oct 26 13:13:00.195789 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1231/2554] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:59 2022] GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402 => generated 1292 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:00.301832 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7288e761-0bbc-4a2a-adfb-0b963650a7c7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:00.303296 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7288e761-0bbc-4a2a-adfb-0b963650a7c7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 9534d3ef-723b-4f68-b147-9c3aceed8206] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:00.315305 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7288e761-0bbc-4a2a-adfb-0b963650a7c7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:00.316083 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7288e761-0bbc-4a2a-adfb-0b963650a7c7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:00.316691 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7288e761-0bbc-4a2a-adfb-0b963650a7c7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:00.317620 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7288e761-0bbc-4a2a-adfb-0b963650a7c7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:00.322216 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7288e761-0bbc-4a2a-adfb-0b963650a7c7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:00.323082 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7288e761-0bbc-4a2a-adfb-0b963650a7c7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:01.226649 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-af45980a-8578-4c61-ba63-65c0f201f731 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6815934fa00041fba4d2a88b3648eb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fffeaed862d4dfe9abdc2c36a66a0cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:01.242830 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-af45980a-8578-4c61-ba63-65c0f201f731 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9" status: 200 len: 1316 microversion: 2.1 time: 1.486774 Oct 26 13:13:01.246398 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1324/2555] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:12:59 2022] GET /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9 => generated 1316 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:01.266911 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=4 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:13:01.695080 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7288e761-0bbc-4a2a-adfb-0b963650a7c7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:01.706323 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7288e761-0bbc-4a2a-adfb-0b963650a7c7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206" status: 200 len: 1311 microversion: 2.1 time: 1.406684 Oct 26 13:13:01.714562 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1232/2556] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:00 2022] GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206 => generated 1311 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:01.731558 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-a5e90cf8-50f6-4bfa-bdaa-d3fdd77ae71d req-432cb23b-42aa-468d-9315-46dea62b12ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9534d3ef-723b-4f68-b147-9c3aceed8206", "tag": "4076f66d-6130-489d-a954-7f1e23537cf4"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:13:01.776578 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a5e90cf8-50f6-4bfa-bdaa-d3fdd77ae71d req-432cb23b-42aa-468d-9315-46dea62b12ff service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:01.778064 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a5e90cf8-50f6-4bfa-bdaa-d3fdd77ae71d req-432cb23b-42aa-468d-9315-46dea62b12ff service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:01.779634 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a5e90cf8-50f6-4bfa-bdaa-d3fdd77ae71d req-432cb23b-42aa-468d-9315-46dea62b12ff service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:01.782912 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f5d326ab-b226-452c-813a-decc49f096c9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1331760529", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "bc8855c0-63b2-4c3e-b1b8-950c3dd488ef"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:13:01.805550 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:13:01.814977 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-a5e90cf8-50f6-4bfa-bdaa-d3fdd77ae71d req-432cb23b-42aa-468d-9315-46dea62b12ff service nova] Creating event network-changed:4076f66d-6130-489d-a954-7f1e23537cf4 for instance 9534d3ef-723b-4f68-b147-9c3aceed8206 on n-h1-862686-1 Oct 26 13:13:01.837141 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-a5e90cf8-50f6-4bfa-bdaa-d3fdd77ae71d req-432cb23b-42aa-468d-9315-46dea62b12ff service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121033 Oct 26 13:13:01.842594 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1233/2557] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:13:01.863020 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-41477b25-34ae-4051-b213-7775a8173104 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:01.867371 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-41477b25-34ae-4051-b213-7775a8173104 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] [instance: 54ffeffd-483c-4d6d-8517-105a666e2402] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:01.891482 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41477b25-34ae-4051-b213-7775a8173104 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:01.892002 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41477b25-34ae-4051-b213-7775a8173104 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:01.892430 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41477b25-34ae-4051-b213-7775a8173104 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:01.902070 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41477b25-34ae-4051-b213-7775a8173104 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:01.902584 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41477b25-34ae-4051-b213-7775a8173104 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:01.904828 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41477b25-34ae-4051-b213-7775a8173104 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:01.913305 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-f5d326ab-b226-452c-813a-decc49f096c9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] validate_networks() for [('bc8855c0-63b2-4c3e-b1b8-950c3dd488ef', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:13:01.959257 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=16 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:13:02.670878 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-41477b25-34ae-4051-b213-7775a8173104 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea62f9a8c1094cf6810848551cd4fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd40483e170343f5a02795c16d063066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:02.693661 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-41477b25-34ae-4051-b213-7775a8173104 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] 10.222.0.40 "GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402" status: 200 len: 1292 microversion: 2.1 time: 0.848560 Oct 26 13:13:02.695050 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1234/2558] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:01 2022] GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402 => generated 1292 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:02.782587 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e29a44be-d333-4a08-bc5a-5e01c336476b tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:02.784237 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e29a44be-d333-4a08-bc5a-5e01c336476b tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] [instance: 0dd070a1-a68f-4c94-9244-d59c94d109f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:02.809334 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:13:02.816446 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e29a44be-d333-4a08-bc5a-5e01c336476b tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:02.818401 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e29a44be-d333-4a08-bc5a-5e01c336476b tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:02.832818 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e29a44be-d333-4a08-bc5a-5e01c336476b tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:02.834183 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e29a44be-d333-4a08-bc5a-5e01c336476b tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:02.835280 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e29a44be-d333-4a08-bc5a-5e01c336476b tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:02.836135 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e29a44be-d333-4a08-bc5a-5e01c336476b tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:02.864480 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:13:03.375808 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e29a44be-d333-4a08-bc5a-5e01c336476b tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6815934fa00041fba4d2a88b3648eb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fffeaed862d4dfe9abdc2c36a66a0cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:03.392458 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e29a44be-d333-4a08-bc5a-5e01c336476b tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9" status: 200 len: 1316 microversion: 2.1 time: 0.693185 Oct 26 13:13:03.394566 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1235/2559] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:02 2022] GET /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9 => generated 1316 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:03.477258 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-f5d326ab-b226-452c-813a-decc49f096c9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:13:03.481807 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-f5d326ab-b226-452c-813a-decc49f096c9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:13:03.482483 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-f5d326ab-b226-452c-813a-decc49f096c9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:13:03.482864 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-f5d326ab-b226-452c-813a-decc49f096c9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:13:03.483292 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-f5d326ab-b226-452c-813a-decc49f096c9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:13:03.498789 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5d326ab-b226-452c-813a-decc49f096c9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:03.499714 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5d326ab-b226-452c-813a-decc49f096c9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:03.500805 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5d326ab-b226-452c-813a-decc49f096c9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:03.501815 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5d326ab-b226-452c-813a-decc49f096c9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:03.503750 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5d326ab-b226-452c-813a-decc49f096c9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:03.504512 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5d326ab-b226-452c-813a-decc49f096c9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:03.581949 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-f5d326ab-b226-452c-813a-decc49f096c9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Getting quotas for project 3f690a680b284d82ac586346427423c3. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:13:03.601943 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-f5d326ab-b226-452c-813a-decc49f096c9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Getting quotas for user fbe30a73a18d49afa07f7a66aee7805d and project 3f690a680b284d82ac586346427423c3. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:13:03.628304 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f5d326ab-b226-452c-813a-decc49f096c9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:13:03.632561 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f5d326ab-b226-452c-813a-decc49f096c9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 02c38c79-9670-4d6d-bad7-70953e1ff22b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:13:03.751584 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f5d326ab-b226-452c-813a-decc49f096c9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.499708 Oct 26 13:13:03.755302 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1325/2560] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:13:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:13:03.775202 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cc92892b-ced8-444a-8f13-bfea47f063c7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:03.794393 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cc92892b-ced8-444a-8f13-bfea47f063c7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 9534d3ef-723b-4f68-b147-9c3aceed8206] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:03.848326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cc92892b-ced8-444a-8f13-bfea47f063c7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:03.848745 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cc92892b-ced8-444a-8f13-bfea47f063c7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:03.849201 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cc92892b-ced8-444a-8f13-bfea47f063c7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:03.849950 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cc92892b-ced8-444a-8f13-bfea47f063c7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:03.850407 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cc92892b-ced8-444a-8f13-bfea47f063c7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:03.873073 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cc92892b-ced8-444a-8f13-bfea47f063c7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:04.004992 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6a0ac586-f5b4-44dd-81b3-18108f3912de tempest-ImagesDeleteNegativeTestJSON-530823802 tempest-ImagesDeleteNegativeTestJSON-530823802-project] 10.222.0.40 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.608781 Oct 26 13:13:04.010682 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1236/2561] 10.222.0.40 () {58 vars in 1128 bytes} [Wed Oct 26 13:13:03 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 615 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 26 13:13:04.016306 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7ed50152-b842-41cb-b3ed-d462fc5c20b8 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:04.044091 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7ed50152-b842-41cb-b3ed-d462fc5c20b8 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] [instance: 54ffeffd-483c-4d6d-8517-105a666e2402] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:04.051224 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ed50152-b842-41cb-b3ed-d462fc5c20b8 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:04.052088 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ed50152-b842-41cb-b3ed-d462fc5c20b8 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:04.052764 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ed50152-b842-41cb-b3ed-d462fc5c20b8 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:04.053714 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ed50152-b842-41cb-b3ed-d462fc5c20b8 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:04.054355 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ed50152-b842-41cb-b3ed-d462fc5c20b8 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:04.054889 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ed50152-b842-41cb-b3ed-d462fc5c20b8 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:04.568180 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-cc92892b-ced8-444a-8f13-bfea47f063c7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:04.578875 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cc92892b-ced8-444a-8f13-bfea47f063c7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206" status: 200 len: 1311 microversion: 2.1 time: 0.820920 Oct 26 13:13:04.597175 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1326/2562] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:03 2022] GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206 => generated 1311 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:04.602358 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bb96765e-075f-4f18-89f4-02f04e3bfb2b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:04.602910 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bb96765e-075f-4f18-89f4-02f04e3bfb2b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 02c38c79-9670-4d6d-bad7-70953e1ff22b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:04.611522 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7ed50152-b842-41cb-b3ed-d462fc5c20b8 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea62f9a8c1094cf6810848551cd4fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd40483e170343f5a02795c16d063066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:04.619770 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7ed50152-b842-41cb-b3ed-d462fc5c20b8 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] 10.222.0.40 "GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402" status: 200 len: 1292 microversion: 2.1 time: 0.607796 Oct 26 13:13:04.626796 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1237/2563] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:04 2022] GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402 => generated 1292 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:04.658845 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1c200be1-f9fb-43b6-a8fb-698cfaedec4a tempest-ImagesDeleteNegativeTestJSON-530823802 tempest-ImagesDeleteNegativeTestJSON-530823802-project] Calling method '.version_select at 0x7f6732318ee0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:04.719820 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-1c200be1-f9fb-43b6-a8fb-698cfaedec4a tempest-ImagesDeleteNegativeTestJSON-530823802 tempest-ImagesDeleteNegativeTestJSON-530823802-project] HTTP exception thrown: Image not found. Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1c200be1-f9fb-43b6-a8fb-698cfaedec4a tempest-ImagesDeleteNegativeTestJSON-530823802 tempest-ImagesDeleteNegativeTestJSON-530823802-project] Request method failure captured: Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTJe_441uUBpQUfRyu67zlCN1ouFdzLxU3GwPPv1VbjDX5UuDSsYRZB7dCltVAN_3RfTOMFaFcAJp0_TdqK-7Tqy-C89U2XPml5lCI0tlWp7E_4uGdSy1nyLKVX1cdagJaXCXhpiDb6wGOABfai25KZu03qPCdTqqa0Nu4AEH5glfG4 Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 089fe2a4d796453d9313ec738f86e23b Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-530823802 Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/089fe2a4d796453d9313ec738f86e23b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/089fe2a4d796453d9313ec738f86e23b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_089fe2a4d796453d9313ec738f86e23b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/089fe2a4d796453d9313ec738f86e23b"}]}] Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-530823802 Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 089fe2a4d796453d9313ec738f86e23b Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-530823802 Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ImagesDeleteNegativeTestJSON-530823802-project Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 9fa6f7dd3c4343058eb89e57c7744bf8 Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-530823802-project Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: method: Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: exception: Image not found. Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '-1'} Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:13:04.722520 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:13:04.726925 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:13:04.726925 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:13:04.726925 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:13:04.726925 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:13:04.726925 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:13:04.726925 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:13:04.726925 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:13:04.726925 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:13:04.726925 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 26 13:13:04.726925 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 26 13:13:04.726925 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 26 13:13:04.726925 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:13:04.726925 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:13:04.726925 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:13:04.726925 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:13:04.726925 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:13:04.726925 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:13:04.726925 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:13:04.726925 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:13:04.726925 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 26 13:13:04.726925 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:13:04.726925 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1c200be1-f9fb-43b6-a8fb-698cfaedec4a tempest-ImagesDeleteNegativeTestJSON-530823802 tempest-ImagesDeleteNegativeTestJSON-530823802-project] Returning 404 to user: Image not found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:13:04.726925 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1c200be1-f9fb-43b6-a8fb-698cfaedec4a tempest-ImagesDeleteNegativeTestJSON-530823802 tempest-ImagesDeleteNegativeTestJSON-530823802-project] 10.222.0.40 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.089320 Oct 26 13:13:04.733691 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1238/2564] 10.222.0.40 () {58 vars in 1134 bytes} [Wed Oct 26 13:13:04 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:13:04.746401 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e3d0ae03-ad65-4e8f-8035-936cc163284c tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:04.747042 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e3d0ae03-ad65-4e8f-8035-936cc163284c tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] [instance: 0dd070a1-a68f-4c94-9244-d59c94d109f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:04.769085 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3d0ae03-ad65-4e8f-8035-936cc163284c tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:04.770064 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3d0ae03-ad65-4e8f-8035-936cc163284c tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:04.771190 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3d0ae03-ad65-4e8f-8035-936cc163284c tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:04.772485 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3d0ae03-ad65-4e8f-8035-936cc163284c tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:04.772956 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3d0ae03-ad65-4e8f-8035-936cc163284c tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:04.773681 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3d0ae03-ad65-4e8f-8035-936cc163284c tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:04.857679 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bb96765e-075f-4f18-89f4-02f04e3bfb2b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:04.891235 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bb96765e-075f-4f18-89f4-02f04e3bfb2b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/02c38c79-9670-4d6d-bad7-70953e1ff22b" status: 200 len: 1193 microversion: 2.1 time: 0.289069 Oct 26 13:13:04.901516 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1327/2565] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:04 2022] GET /compute/v2.1/servers/02c38c79-9670-4d6d-bad7-70953e1ff22b => generated 1193 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:04.910966 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9aa15129-f38a-424c-970b-fa6a946ff3e7 tempest-ImagesDeleteNegativeTestJSON-530823802 tempest-ImagesDeleteNegativeTestJSON-530823802-project] Calling method '.version_select at 0x7f6732584af0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:04.942701 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-9aa15129-f38a-424c-970b-fa6a946ff3e7 tempest-ImagesDeleteNegativeTestJSON-530823802 tempest-ImagesDeleteNegativeTestJSON-530823802-project] HTTP exception thrown: Image not found. Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9aa15129-f38a-424c-970b-fa6a946ff3e7 tempest-ImagesDeleteNegativeTestJSON-530823802 tempest-ImagesDeleteNegativeTestJSON-530823802-project] Request method failure captured: Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: request: DELETE /compute/v2.1/images/126b3bda-758a-4ec6-a11e-36a041eda02j HTTP/1.1 Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTJe_441uUBpQUfRyu67zlCN1ouFdzLxU3GwPPv1VbjDX5UuDSsYRZB7dCltVAN_3RfTOMFaFcAJp0_TdqK-7Tqy-C89U2XPml5lCI0tlWp7E_4uGdSy1nyLKVX1cdagJaXCXhpiDb6wGOABfai25KZu03qPCdTqqa0Nu4AEH5glfG4 Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 089fe2a4d796453d9313ec738f86e23b Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-530823802 Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/089fe2a4d796453d9313ec738f86e23b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/089fe2a4d796453d9313ec738f86e23b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_089fe2a4d796453d9313ec738f86e23b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/089fe2a4d796453d9313ec738f86e23b"}]}] Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-530823802 Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 089fe2a4d796453d9313ec738f86e23b Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-530823802 Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ImagesDeleteNegativeTestJSON-530823802-project Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 9fa6f7dd3c4343058eb89e57c7744bf8 Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-530823802-project Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: exception: Image not found. Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '126b3bda-758a-4ec6-a11e-36a041eda02j'} Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 126b3bda-758a-4ec6-a11e-36a041eda02j to delete Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 126b3bda-758a-4ec6-a11e-36a041eda02j could not be found. Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:13:04.945452 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:13:04.949114 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:13:04.949114 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:13:04.949114 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:13:04.949114 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:13:04.949114 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:13:04.949114 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:13:04.949114 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:13:04.949114 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:13:04.949114 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:13:04.949114 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 26 13:13:04.949114 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 26 13:13:04.949114 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 26 13:13:04.949114 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:13:04.949114 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:13:04.949114 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:13:04.949114 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:13:04.949114 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:13:04.949114 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:13:04.949114 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:13:04.949114 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:13:04.949114 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 26 13:13:04.949114 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:13:04.949114 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9aa15129-f38a-424c-970b-fa6a946ff3e7 tempest-ImagesDeleteNegativeTestJSON-530823802 tempest-ImagesDeleteNegativeTestJSON-530823802-project] Returning 404 to user: Image not found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:13:04.949114 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9aa15129-f38a-424c-970b-fa6a946ff3e7 tempest-ImagesDeleteNegativeTestJSON-530823802 tempest-ImagesDeleteNegativeTestJSON-530823802-project] 10.222.0.40 "DELETE /compute/v2.1/images/126b3bda-758a-4ec6-a11e-36a041eda02j" status: 404 len: 62 microversion: 2.1 time: 0.053181 Oct 26 13:13:04.949114 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1328/2566] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:04 2022] DELETE /compute/v2.1/images/126b3bda-758a-4ec6-a11e-36a041eda02j => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:13:04.965312 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3a5453de-0972-4006-ae2b-8780f4b89f36 tempest-ImagesDeleteNegativeTestJSON-530823802 tempest-ImagesDeleteNegativeTestJSON-530823802-project] Calling method '.version_select at 0x7f6732cd1160>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:04.988798 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-3a5453de-0972-4006-ae2b-8780f4b89f36 tempest-ImagesDeleteNegativeTestJSON-530823802 tempest-ImagesDeleteNegativeTestJSON-530823802-project] HTTP exception thrown: Image not found. Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3a5453de-0972-4006-ae2b-8780f4b89f36 tempest-ImagesDeleteNegativeTestJSON-530823802 tempest-ImagesDeleteNegativeTestJSON-530823802-project] Request method failure captured: Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: request: DELETE /compute/v2.1/images/958084ea-e6fa-4791-b6f5-9770d1a787971 HTTP/1.1 Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTJe_441uUBpQUfRyu67zlCN1ouFdzLxU3GwPPv1VbjDX5UuDSsYRZB7dCltVAN_3RfTOMFaFcAJp0_TdqK-7Tqy-C89U2XPml5lCI0tlWp7E_4uGdSy1nyLKVX1cdagJaXCXhpiDb6wGOABfai25KZu03qPCdTqqa0Nu4AEH5glfG4 Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 089fe2a4d796453d9313ec738f86e23b Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-530823802 Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/089fe2a4d796453d9313ec738f86e23b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/089fe2a4d796453d9313ec738f86e23b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_089fe2a4d796453d9313ec738f86e23b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/089fe2a4d796453d9313ec738f86e23b"}]}] Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-530823802 Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 089fe2a4d796453d9313ec738f86e23b Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-530823802 Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ImagesDeleteNegativeTestJSON-530823802-project Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 9fa6f7dd3c4343058eb89e57c7744bf8 Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-530823802-project Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: exception: Image not found. Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '958084ea-e6fa-4791-b6f5-9770d1a787971'} Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 958084ea-e6fa-4791-b6f5-9770d1a787971 to delete Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 958084ea-e6fa-4791-b6f5-9770d1a787971 could not be found. Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:13:04.991903 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:13:04.995980 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:13:04.995980 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:13:04.995980 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:13:04.995980 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:13:04.995980 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:13:04.995980 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:13:04.995980 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:13:04.995980 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:13:04.995980 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:13:04.995980 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 26 13:13:04.995980 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 26 13:13:04.995980 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 26 13:13:04.995980 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:13:04.995980 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:13:04.995980 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:13:04.995980 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:13:04.995980 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:13:04.995980 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:13:04.995980 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:13:04.995980 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:13:04.995980 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 26 13:13:04.995980 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:13:04.995980 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3a5453de-0972-4006-ae2b-8780f4b89f36 tempest-ImagesDeleteNegativeTestJSON-530823802 tempest-ImagesDeleteNegativeTestJSON-530823802-project] Returning 404 to user: Image not found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:13:04.995980 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3a5453de-0972-4006-ae2b-8780f4b89f36 tempest-ImagesDeleteNegativeTestJSON-530823802 tempest-ImagesDeleteNegativeTestJSON-530823802-project] 10.222.0.40 "DELETE /compute/v2.1/images/958084ea-e6fa-4791-b6f5-9770d1a787971" status: 404 len: 62 microversion: 2.1 time: 0.037979 Oct 26 13:13:04.997337 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1329/2567] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:13:04 2022] DELETE /compute/v2.1/images/958084ea-e6fa-4791-b6f5-9770d1a787971 => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:13:05.008433 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cee35212-041d-4dd1-b8a7-2caa6cda6171 tempest-ImagesDeleteNegativeTestJSON-530823802 tempest-ImagesDeleteNegativeTestJSON-530823802-project] Calling method '.version_select at 0x7f67325c5790>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:05.052010 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-cee35212-041d-4dd1-b8a7-2caa6cda6171 tempest-ImagesDeleteNegativeTestJSON-530823802 tempest-ImagesDeleteNegativeTestJSON-530823802-project] HTTP exception thrown: Image not found. Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cee35212-041d-4dd1-b8a7-2caa6cda6171 tempest-ImagesDeleteNegativeTestJSON-530823802 tempest-ImagesDeleteNegativeTestJSON-530823802-project] Request method failure captured: Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: request: DELETE /compute/v2.1/images/tempest-invalid-1573544952 HTTP/1.1 Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTJe_441uUBpQUfRyu67zlCN1ouFdzLxU3GwPPv1VbjDX5UuDSsYRZB7dCltVAN_3RfTOMFaFcAJp0_TdqK-7Tqy-C89U2XPml5lCI0tlWp7E_4uGdSy1nyLKVX1cdagJaXCXhpiDb6wGOABfai25KZu03qPCdTqqa0Nu4AEH5glfG4 Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 089fe2a4d796453d9313ec738f86e23b Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-530823802 Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/089fe2a4d796453d9313ec738f86e23b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/089fe2a4d796453d9313ec738f86e23b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_089fe2a4d796453d9313ec738f86e23b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/089fe2a4d796453d9313ec738f86e23b"}]}] Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-530823802 Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 089fe2a4d796453d9313ec738f86e23b Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-530823802 Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ImagesDeleteNegativeTestJSON-530823802-project Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 9fa6f7dd3c4343058eb89e57c7744bf8 Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-530823802-project Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: exception: Image not found. Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'tempest-invalid-1573544952'} Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1573544952 to delete Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1573544952 could not be found. Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:13:05.058117 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:13:05.063801 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:13:05.063801 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:13:05.063801 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:13:05.063801 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:13:05.063801 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:13:05.063801 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:13:05.063801 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:13:05.063801 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:13:05.063801 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 26 13:13:05.063801 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 26 13:13:05.063801 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 26 13:13:05.063801 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:13:05.063801 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:13:05.063801 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:13:05.063801 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:13:05.063801 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:13:05.063801 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:13:05.063801 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:13:05.063801 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:13:05.063801 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 26 13:13:05.063801 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:13:05.063801 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cee35212-041d-4dd1-b8a7-2caa6cda6171 tempest-ImagesDeleteNegativeTestJSON-530823802 tempest-ImagesDeleteNegativeTestJSON-530823802-project] Returning 404 to user: Image not found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:13:05.063801 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cee35212-041d-4dd1-b8a7-2caa6cda6171 tempest-ImagesDeleteNegativeTestJSON-530823802 tempest-ImagesDeleteNegativeTestJSON-530823802-project] 10.222.0.40 "DELETE /compute/v2.1/images/tempest-invalid-1573544952" status: 404 len: 62 microversion: 2.1 time: 0.056149 Oct 26 13:13:05.068047 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1330/2568] 10.222.0.40 () {58 vars in 1206 bytes} [Wed Oct 26 13:13:05 2022] DELETE /compute/v2.1/images/tempest-invalid-1573544952 => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 26 13:13:05.088976 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-16b4991d-15bc-48fd-9860-5f797cc96f15 tempest-ImagesDeleteNegativeTestJSON-530823802 tempest-ImagesDeleteNegativeTestJSON-530823802-project] Calling method '.version_select at 0x7f67324ce790>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:05.139450 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-16b4991d-15bc-48fd-9860-5f797cc96f15 tempest-ImagesDeleteNegativeTestJSON-530823802 tempest-ImagesDeleteNegativeTestJSON-530823802-project] HTTP exception thrown: Image not found. Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-16b4991d-15bc-48fd-9860-5f797cc96f15 tempest-ImagesDeleteNegativeTestJSON-530823802 tempest-ImagesDeleteNegativeTestJSON-530823802-project] Request method failure captured: Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: request: DELETE /compute/v2.1/images/fbbd05ba-07bd-41b5-b033-710098abc0e7 HTTP/1.1 Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTJe_441uUBpQUfRyu67zlCN1ouFdzLxU3GwPPv1VbjDX5UuDSsYRZB7dCltVAN_3RfTOMFaFcAJp0_TdqK-7Tqy-C89U2XPml5lCI0tlWp7E_4uGdSy1nyLKVX1cdagJaXCXhpiDb6wGOABfai25KZu03qPCdTqqa0Nu4AEH5glfG4 Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 089fe2a4d796453d9313ec738f86e23b Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-530823802 Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/089fe2a4d796453d9313ec738f86e23b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/089fe2a4d796453d9313ec738f86e23b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_089fe2a4d796453d9313ec738f86e23b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/089fe2a4d796453d9313ec738f86e23b"}]}] Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-530823802 Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 089fe2a4d796453d9313ec738f86e23b Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-530823802 Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ImagesDeleteNegativeTestJSON-530823802-project Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 9fa6f7dd3c4343058eb89e57c7744bf8 Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-530823802-project Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: exception: Image not found. Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'fbbd05ba-07bd-41b5-b033-710098abc0e7'} Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image fbbd05ba-07bd-41b5-b033-710098abc0e7 to delete Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fbbd05ba-07bd-41b5-b033-710098abc0e7 could not be found. Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:13:05.142815 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:13:05.146866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:13:05.146866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:13:05.146866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:13:05.146866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:13:05.146866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:13:05.146866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:13:05.146866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:13:05.146866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:13:05.146866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:13:05.146866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 26 13:13:05.146866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 26 13:13:05.146866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 26 13:13:05.146866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:13:05.146866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:13:05.146866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:13:05.146866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:13:05.146866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:13:05.146866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:13:05.146866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:13:05.146866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:13:05.146866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 26 13:13:05.146866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:13:05.150104 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-16b4991d-15bc-48fd-9860-5f797cc96f15 tempest-ImagesDeleteNegativeTestJSON-530823802 tempest-ImagesDeleteNegativeTestJSON-530823802-project] Returning 404 to user: Image not found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:13:05.151848 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-16b4991d-15bc-48fd-9860-5f797cc96f15 tempest-ImagesDeleteNegativeTestJSON-530823802 tempest-ImagesDeleteNegativeTestJSON-530823802-project] 10.222.0.40 "DELETE /compute/v2.1/images/fbbd05ba-07bd-41b5-b033-710098abc0e7" status: 404 len: 62 microversion: 2.1 time: 0.075361 Oct 26 13:13:05.153818 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1331/2569] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:05 2022] DELETE /compute/v2.1/images/fbbd05ba-07bd-41b5-b033-710098abc0e7 => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:13:05.229382 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e3d0ae03-ad65-4e8f-8035-936cc163284c tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6815934fa00041fba4d2a88b3648eb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fffeaed862d4dfe9abdc2c36a66a0cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:05.240557 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e3d0ae03-ad65-4e8f-8035-936cc163284c tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9" status: 200 len: 1316 microversion: 2.1 time: 0.505596 Oct 26 13:13:05.243289 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1239/2570] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:04 2022] GET /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9 => generated 1316 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:05.604079 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2af1af1d-287c-47d0-85cf-35c2baf80d99 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:05.604929 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2af1af1d-287c-47d0-85cf-35c2baf80d99 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 9534d3ef-723b-4f68-b147-9c3aceed8206] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:05.623064 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2af1af1d-287c-47d0-85cf-35c2baf80d99 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:05.623905 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2af1af1d-287c-47d0-85cf-35c2baf80d99 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:05.626057 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2af1af1d-287c-47d0-85cf-35c2baf80d99 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:05.629012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2af1af1d-287c-47d0-85cf-35c2baf80d99 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:05.630205 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2af1af1d-287c-47d0-85cf-35c2baf80d99 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:05.631584 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2af1af1d-287c-47d0-85cf-35c2baf80d99 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:05.654729 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7d25f3df-a7e2-4e91-bee9-7ddebc02ef03 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:05.655647 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7d25f3df-a7e2-4e91-bee9-7ddebc02ef03 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] [instance: 54ffeffd-483c-4d6d-8517-105a666e2402] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:05.669474 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d25f3df-a7e2-4e91-bee9-7ddebc02ef03 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:05.670769 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d25f3df-a7e2-4e91-bee9-7ddebc02ef03 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:05.676997 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d25f3df-a7e2-4e91-bee9-7ddebc02ef03 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:05.677801 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d25f3df-a7e2-4e91-bee9-7ddebc02ef03 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:05.678279 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d25f3df-a7e2-4e91-bee9-7ddebc02ef03 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:05.678719 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d25f3df-a7e2-4e91-bee9-7ddebc02ef03 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:06.579528 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2af1af1d-287c-47d0-85cf-35c2baf80d99 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:06.594495 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2af1af1d-287c-47d0-85cf-35c2baf80d99 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206" status: 200 len: 1311 microversion: 2.1 time: 0.994262 Oct 26 13:13:06.609517 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1332/2571] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:05 2022] GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206 => generated 1311 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:06.609517 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8df5e297-8128-447a-a794-f61843fa1932 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:06.609517 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8df5e297-8128-447a-a794-f61843fa1932 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 02c38c79-9670-4d6d-bad7-70953e1ff22b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:06.623744 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8df5e297-8128-447a-a794-f61843fa1932 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:06.624994 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8df5e297-8128-447a-a794-f61843fa1932 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:06.629084 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8df5e297-8128-447a-a794-f61843fa1932 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:06.633659 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8df5e297-8128-447a-a794-f61843fa1932 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:06.637776 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8df5e297-8128-447a-a794-f61843fa1932 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:06.638440 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8df5e297-8128-447a-a794-f61843fa1932 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:06.919205 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8df5e297-8128-447a-a794-f61843fa1932 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:06.937530 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8df5e297-8128-447a-a794-f61843fa1932 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/02c38c79-9670-4d6d-bad7-70953e1ff22b" status: 200 len: 1251 microversion: 2.1 time: 0.337636 Oct 26 13:13:06.939878 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1333/2572] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:06 2022] GET /compute/v2.1/servers/02c38c79-9670-4d6d-bad7-70953e1ff22b => generated 1251 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:06.953973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-72e6503b-ac28-4d92-ab38-58e86fe5efd9 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:06.954751 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-72e6503b-ac28-4d92-ab38-58e86fe5efd9 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] [instance: 0dd070a1-a68f-4c94-9244-d59c94d109f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:06.970826 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72e6503b-ac28-4d92-ab38-58e86fe5efd9 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:06.972458 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72e6503b-ac28-4d92-ab38-58e86fe5efd9 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:06.973068 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72e6503b-ac28-4d92-ab38-58e86fe5efd9 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:06.974363 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72e6503b-ac28-4d92-ab38-58e86fe5efd9 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:06.975169 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72e6503b-ac28-4d92-ab38-58e86fe5efd9 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:06.977295 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72e6503b-ac28-4d92-ab38-58e86fe5efd9 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:07.122293 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7d25f3df-a7e2-4e91-bee9-7ddebc02ef03 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea62f9a8c1094cf6810848551cd4fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd40483e170343f5a02795c16d063066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:07.143663 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7d25f3df-a7e2-4e91-bee9-7ddebc02ef03 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] 10.222.0.40 "GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402" status: 200 len: 1292 microversion: 2.1 time: 1.493427 Oct 26 13:13:07.148235 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1240/2573] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:05 2022] GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402 => generated 1292 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:13:07.336424 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-72e6503b-ac28-4d92-ab38-58e86fe5efd9 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6815934fa00041fba4d2a88b3648eb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fffeaed862d4dfe9abdc2c36a66a0cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:07.354327 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-72e6503b-ac28-4d92-ab38-58e86fe5efd9 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9" status: 200 len: 1316 microversion: 2.1 time: 0.412292 Oct 26 13:13:07.356891 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1334/2574] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:06 2022] GET /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9 => generated 1316 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:07.628985 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4041ab3a-d735-4450-bfdf-97b5de68b906 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:07.630566 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4041ab3a-d735-4450-bfdf-97b5de68b906 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 9534d3ef-723b-4f68-b147-9c3aceed8206] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:07.640028 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4041ab3a-d735-4450-bfdf-97b5de68b906 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:07.642487 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4041ab3a-d735-4450-bfdf-97b5de68b906 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:07.643770 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4041ab3a-d735-4450-bfdf-97b5de68b906 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:07.644705 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4041ab3a-d735-4450-bfdf-97b5de68b906 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:07.645819 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4041ab3a-d735-4450-bfdf-97b5de68b906 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:07.646408 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4041ab3a-d735-4450-bfdf-97b5de68b906 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:07.966822 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-58101d51-7292-4699-84e6-59319abbe94f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:07.967430 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-58101d51-7292-4699-84e6-59319abbe94f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 02c38c79-9670-4d6d-bad7-70953e1ff22b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:07.977968 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-58101d51-7292-4699-84e6-59319abbe94f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:07.990412 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-58101d51-7292-4699-84e6-59319abbe94f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:07.991167 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-58101d51-7292-4699-84e6-59319abbe94f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:07.992212 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-58101d51-7292-4699-84e6-59319abbe94f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:07.992682 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-58101d51-7292-4699-84e6-59319abbe94f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:07.993118 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-58101d51-7292-4699-84e6-59319abbe94f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:08.182450 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4041ab3a-d735-4450-bfdf-97b5de68b906 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:08.198070 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-58101d51-7292-4699-84e6-59319abbe94f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:08.198625 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4041ab3a-d735-4450-bfdf-97b5de68b906 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206" status: 200 len: 1311 microversion: 2.1 time: 0.579282 Oct 26 13:13:08.199226 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1241/2575] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:07 2022] GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206 => generated 1311 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:08.210352 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dedb4398-9f90-454d-9f38-9211953bbc61 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:08.210977 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-dedb4398-9f90-454d-9f38-9211953bbc61 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] [instance: 54ffeffd-483c-4d6d-8517-105a666e2402] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:08.215217 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-58101d51-7292-4699-84e6-59319abbe94f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/02c38c79-9670-4d6d-bad7-70953e1ff22b" status: 200 len: 1251 microversion: 2.1 time: 0.251753 Oct 26 13:13:08.216684 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1335/2576] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:07 2022] GET /compute/v2.1/servers/02c38c79-9670-4d6d-bad7-70953e1ff22b => generated 1251 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:08.229097 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dedb4398-9f90-454d-9f38-9211953bbc61 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:08.229631 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dedb4398-9f90-454d-9f38-9211953bbc61 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:08.230083 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dedb4398-9f90-454d-9f38-9211953bbc61 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:08.230801 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dedb4398-9f90-454d-9f38-9211953bbc61 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:08.231264 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dedb4398-9f90-454d-9f38-9211953bbc61 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:08.231700 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dedb4398-9f90-454d-9f38-9211953bbc61 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:08.383301 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d0ad6180-6248-4f83-8600-b61894e17741 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:08.383931 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d0ad6180-6248-4f83-8600-b61894e17741 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] [instance: 0dd070a1-a68f-4c94-9244-d59c94d109f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:08.391532 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0ad6180-6248-4f83-8600-b61894e17741 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:08.392334 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0ad6180-6248-4f83-8600-b61894e17741 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:08.402178 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0ad6180-6248-4f83-8600-b61894e17741 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:08.407438 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0ad6180-6248-4f83-8600-b61894e17741 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:08.408211 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0ad6180-6248-4f83-8600-b61894e17741 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:08.410052 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0ad6180-6248-4f83-8600-b61894e17741 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:08.997156 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d0ad6180-6248-4f83-8600-b61894e17741 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6815934fa00041fba4d2a88b3648eb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fffeaed862d4dfe9abdc2c36a66a0cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:09.017421 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d0ad6180-6248-4f83-8600-b61894e17741 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9" status: 200 len: 1316 microversion: 2.1 time: 0.637629 Oct 26 13:13:09.019383 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1336/2577] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:08 2022] GET /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9 => generated 1316 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:13:09.163017 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-dedb4398-9f90-454d-9f38-9211953bbc61 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea62f9a8c1094cf6810848551cd4fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd40483e170343f5a02795c16d063066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:09.174796 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-dedb4398-9f90-454d-9f38-9211953bbc61 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] 10.222.0.40 "GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402" status: 200 len: 1292 microversion: 2.1 time: 0.974372 Oct 26 13:13:09.192505 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1242/2578] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:08 2022] GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402 => generated 1292 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:09.257846 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-578497a2-151c-4c75-97b7-6d311dd7204e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:09.258703 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-578497a2-151c-4c75-97b7-6d311dd7204e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 9534d3ef-723b-4f68-b147-9c3aceed8206] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:09.259154 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5c5d0c23-ba03-43bc-841e-54313af5b65c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:09.259791 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5c5d0c23-ba03-43bc-841e-54313af5b65c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 02c38c79-9670-4d6d-bad7-70953e1ff22b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:09.266952 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-578497a2-151c-4c75-97b7-6d311dd7204e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:09.267668 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-578497a2-151c-4c75-97b7-6d311dd7204e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:09.268250 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-578497a2-151c-4c75-97b7-6d311dd7204e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:09.269411 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-578497a2-151c-4c75-97b7-6d311dd7204e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:09.273599 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-578497a2-151c-4c75-97b7-6d311dd7204e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:09.274221 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c5d0c23-ba03-43bc-841e-54313af5b65c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:09.274569 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-578497a2-151c-4c75-97b7-6d311dd7204e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:09.274716 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c5d0c23-ba03-43bc-841e-54313af5b65c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:09.283493 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c5d0c23-ba03-43bc-841e-54313af5b65c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:09.286335 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c5d0c23-ba03-43bc-841e-54313af5b65c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:09.286840 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c5d0c23-ba03-43bc-841e-54313af5b65c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:09.287288 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c5d0c23-ba03-43bc-841e-54313af5b65c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:09.855483 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5c5d0c23-ba03-43bc-841e-54313af5b65c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:09.892174 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5c5d0c23-ba03-43bc-841e-54313af5b65c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/02c38c79-9670-4d6d-bad7-70953e1ff22b" status: 200 len: 1293 microversion: 2.1 time: 0.641269 Oct 26 13:13:09.921945 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1243/2579] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:09 2022] GET /compute/v2.1/servers/02c38c79-9670-4d6d-bad7-70953e1ff22b => generated 1293 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:09.950954 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-a6b5f7d7-7333-4858-b839-0e6bf7530fa4 req-88c5fb92-15fb-465a-a9cf-beda711f6a08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dd070a1-a68f-4c94-9244-d59c94d109f9", "name": "network-vif-plugged", "status": "completed", "tag": "099ba429-75b7-4428-a8bf-6d2540652296"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:13:09.982028 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a6b5f7d7-7333-4858-b839-0e6bf7530fa4 req-88c5fb92-15fb-465a-a9cf-beda711f6a08 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:09.982874 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a6b5f7d7-7333-4858-b839-0e6bf7530fa4 req-88c5fb92-15fb-465a-a9cf-beda711f6a08 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:09.983565 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a6b5f7d7-7333-4858-b839-0e6bf7530fa4 req-88c5fb92-15fb-465a-a9cf-beda711f6a08 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:10.006708 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-578497a2-151c-4c75-97b7-6d311dd7204e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:10.010971 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-a6b5f7d7-7333-4858-b839-0e6bf7530fa4 req-88c5fb92-15fb-465a-a9cf-beda711f6a08 service nova] Creating event network-vif-plugged:099ba429-75b7-4428-a8bf-6d2540652296 for instance 0dd070a1-a68f-4c94-9244-d59c94d109f9 on n-h2-862686-1 Oct 26 13:13:10.018256 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-a6b5f7d7-7333-4858-b839-0e6bf7530fa4 req-88c5fb92-15fb-465a-a9cf-beda711f6a08 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077240 Oct 26 13:13:10.019590 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1244/2580] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:13:10.024867 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-578497a2-151c-4c75-97b7-6d311dd7204e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206" status: 200 len: 1311 microversion: 2.1 time: 0.776140 Oct 26 13:13:10.051858 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1337/2581] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:09 2022] GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206 => generated 1311 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:10.073007 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7d846d5b-60e6-43f9-a7a6-d9833fe3634a tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:10.074458 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7d846d5b-60e6-43f9-a7a6-d9833fe3634a tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] [instance: 0dd070a1-a68f-4c94-9244-d59c94d109f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:10.100888 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d846d5b-60e6-43f9-a7a6-d9833fe3634a tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:10.102399 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d846d5b-60e6-43f9-a7a6-d9833fe3634a tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:10.103109 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d846d5b-60e6-43f9-a7a6-d9833fe3634a tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:10.106383 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d846d5b-60e6-43f9-a7a6-d9833fe3634a tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:10.107170 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d846d5b-60e6-43f9-a7a6-d9833fe3634a tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:10.107801 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d846d5b-60e6-43f9-a7a6-d9833fe3634a tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:10.199605 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e4d503e1-9726-4a40-81b8-5f7b4eb29c57 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:10.200311 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e4d503e1-9726-4a40-81b8-5f7b4eb29c57 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] [instance: 54ffeffd-483c-4d6d-8517-105a666e2402] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:10.213532 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4d503e1-9726-4a40-81b8-5f7b4eb29c57 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:10.217736 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4d503e1-9726-4a40-81b8-5f7b4eb29c57 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:10.221678 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4d503e1-9726-4a40-81b8-5f7b4eb29c57 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:10.222734 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4d503e1-9726-4a40-81b8-5f7b4eb29c57 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:10.223402 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4d503e1-9726-4a40-81b8-5f7b4eb29c57 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:10.223855 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4d503e1-9726-4a40-81b8-5f7b4eb29c57 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:10.261641 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:13:10.842705 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7d846d5b-60e6-43f9-a7a6-d9833fe3634a tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6815934fa00041fba4d2a88b3648eb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fffeaed862d4dfe9abdc2c36a66a0cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:10.857378 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e4d503e1-9726-4a40-81b8-5f7b4eb29c57 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea62f9a8c1094cf6810848551cd4fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd40483e170343f5a02795c16d063066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:10.867024 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7d846d5b-60e6-43f9-a7a6-d9833fe3634a tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9" status: 200 len: 1316 microversion: 2.1 time: 0.799170 Oct 26 13:13:10.867704 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1245/2582] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:10 2022] GET /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9 => generated 1316 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:10.869242 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e4d503e1-9726-4a40-81b8-5f7b4eb29c57 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] 10.222.0.40 "GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402" status: 200 len: 1292 microversion: 2.1 time: 0.673810 Oct 26 13:13:10.887504 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1338/2583] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:10 2022] GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402 => generated 1292 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:13:10.929811 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-176319dd-653e-42be-aed2-f843b5c4e7d6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:10.930433 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-176319dd-653e-42be-aed2-f843b5c4e7d6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 02c38c79-9670-4d6d-bad7-70953e1ff22b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:10.938629 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-176319dd-653e-42be-aed2-f843b5c4e7d6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:10.939130 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-176319dd-653e-42be-aed2-f843b5c4e7d6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:10.939574 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-176319dd-653e-42be-aed2-f843b5c4e7d6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:10.941084 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-176319dd-653e-42be-aed2-f843b5c4e7d6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:10.941604 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-176319dd-653e-42be-aed2-f843b5c4e7d6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:10.942035 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-176319dd-653e-42be-aed2-f843b5c4e7d6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:11.057087 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-99c10bfc-499b-4cb5-99a8-fb4b23134af9 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:11.058810 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-99c10bfc-499b-4cb5-99a8-fb4b23134af9 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 9534d3ef-723b-4f68-b147-9c3aceed8206] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:11.080511 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99c10bfc-499b-4cb5-99a8-fb4b23134af9 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:11.081750 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99c10bfc-499b-4cb5-99a8-fb4b23134af9 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:11.083825 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99c10bfc-499b-4cb5-99a8-fb4b23134af9 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:11.085816 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99c10bfc-499b-4cb5-99a8-fb4b23134af9 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:11.087746 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99c10bfc-499b-4cb5-99a8-fb4b23134af9 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:11.088428 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99c10bfc-499b-4cb5-99a8-fb4b23134af9 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:11.620579 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-176319dd-653e-42be-aed2-f843b5c4e7d6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:11.631977 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-176319dd-653e-42be-aed2-f843b5c4e7d6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/02c38c79-9670-4d6d-bad7-70953e1ff22b" status: 200 len: 1293 microversion: 2.1 time: 0.706120 Oct 26 13:13:11.644362 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1246/2584] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:10 2022] GET /compute/v2.1/servers/02c38c79-9670-4d6d-bad7-70953e1ff22b => generated 1293 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:11.890645 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4e077a4d-4485-4c60-b4e4-2572c52174c9 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:11.891459 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4e077a4d-4485-4c60-b4e4-2572c52174c9 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] [instance: 0dd070a1-a68f-4c94-9244-d59c94d109f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:11.909738 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e077a4d-4485-4c60-b4e4-2572c52174c9 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:11.910415 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e077a4d-4485-4c60-b4e4-2572c52174c9 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:11.910881 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e077a4d-4485-4c60-b4e4-2572c52174c9 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:11.911640 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e077a4d-4485-4c60-b4e4-2572c52174c9 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:11.912104 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e077a4d-4485-4c60-b4e4-2572c52174c9 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:11.912536 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e077a4d-4485-4c60-b4e4-2572c52174c9 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:11.971997 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-99c10bfc-499b-4cb5-99a8-fb4b23134af9 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:11.987873 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-99c10bfc-499b-4cb5-99a8-fb4b23134af9 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206" status: 200 len: 1311 microversion: 2.1 time: 0.935212 Oct 26 13:13:11.988489 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1339/2585] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:11 2022] GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206 => generated 1311 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:12.013787 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-07b7c4dd-c4be-4021-8928-6755ce044bcf tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:12.014400 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-07b7c4dd-c4be-4021-8928-6755ce044bcf tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] [instance: 54ffeffd-483c-4d6d-8517-105a666e2402] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:12.037822 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07b7c4dd-c4be-4021-8928-6755ce044bcf tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:12.038657 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07b7c4dd-c4be-4021-8928-6755ce044bcf tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:12.039315 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07b7c4dd-c4be-4021-8928-6755ce044bcf tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:12.040259 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07b7c4dd-c4be-4021-8928-6755ce044bcf tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:12.042226 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07b7c4dd-c4be-4021-8928-6755ce044bcf tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:12.042852 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07b7c4dd-c4be-4021-8928-6755ce044bcf tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:12.371382 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-07b7c4dd-c4be-4021-8928-6755ce044bcf tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea62f9a8c1094cf6810848551cd4fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd40483e170343f5a02795c16d063066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:12.393102 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-07b7c4dd-c4be-4021-8928-6755ce044bcf tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] 10.222.0.40 "GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402" status: 200 len: 1292 microversion: 2.1 time: 0.383076 Oct 26 13:13:12.393996 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1340/2586] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:11 2022] GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402 => generated 1292 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:12.399072 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-33641720-703d-467f-b617-f8a2ee497c81 req-bd54e765-c2df-4581-8eb7-09d7d4eb03b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9534d3ef-723b-4f68-b147-9c3aceed8206", "name": "network-vif-plugged", "status": "completed", "tag": "4076f66d-6130-489d-a954-7f1e23537cf4"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:13:12.417385 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-33641720-703d-467f-b617-f8a2ee497c81 req-bd54e765-c2df-4581-8eb7-09d7d4eb03b1 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:12.417781 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-33641720-703d-467f-b617-f8a2ee497c81 req-bd54e765-c2df-4581-8eb7-09d7d4eb03b1 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:12.418220 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-33641720-703d-467f-b617-f8a2ee497c81 req-bd54e765-c2df-4581-8eb7-09d7d4eb03b1 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:12.464814 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4e077a4d-4485-4c60-b4e4-2572c52174c9 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6815934fa00041fba4d2a88b3648eb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fffeaed862d4dfe9abdc2c36a66a0cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:12.472795 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4e077a4d-4485-4c60-b4e4-2572c52174c9 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9" status: 200 len: 1316 microversion: 2.1 time: 0.586669 Oct 26 13:13:12.473083 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-33641720-703d-467f-b617-f8a2ee497c81 req-bd54e765-c2df-4581-8eb7-09d7d4eb03b1 service nova] Creating event network-vif-plugged:4076f66d-6130-489d-a954-7f1e23537cf4 for instance 9534d3ef-723b-4f68-b147-9c3aceed8206 on n-h1-862686-1 Oct 26 13:13:12.491315 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1247/2587] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:11 2022] GET /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9 => generated 1316 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:12.491512 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-33641720-703d-467f-b617-f8a2ee497c81 req-bd54e765-c2df-4581-8eb7-09d7d4eb03b1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094770 Oct 26 13:13:12.491512 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1341/2588] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:13:12.670630 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-04be9145-1130-4556-9cb6-1a37ae5d9ea3 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:12.671772 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-04be9145-1130-4556-9cb6-1a37ae5d9ea3 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 02c38c79-9670-4d6d-bad7-70953e1ff22b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:12.680297 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-04be9145-1130-4556-9cb6-1a37ae5d9ea3 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:12.689462 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-04be9145-1130-4556-9cb6-1a37ae5d9ea3 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:12.692718 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-04be9145-1130-4556-9cb6-1a37ae5d9ea3 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:12.695438 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-04be9145-1130-4556-9cb6-1a37ae5d9ea3 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:12.696108 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-04be9145-1130-4556-9cb6-1a37ae5d9ea3 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:12.698974 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-04be9145-1130-4556-9cb6-1a37ae5d9ea3 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:13.017843 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-052a6528-8c7f-4612-b3b7-e2668f7c9da5 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:13.018794 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-052a6528-8c7f-4612-b3b7-e2668f7c9da5 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 9534d3ef-723b-4f68-b147-9c3aceed8206] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:13.032530 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-052a6528-8c7f-4612-b3b7-e2668f7c9da5 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:13.034748 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-052a6528-8c7f-4612-b3b7-e2668f7c9da5 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:13.042032 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-052a6528-8c7f-4612-b3b7-e2668f7c9da5 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:13.042982 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-052a6528-8c7f-4612-b3b7-e2668f7c9da5 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:13.043578 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-052a6528-8c7f-4612-b3b7-e2668f7c9da5 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:13.044130 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-052a6528-8c7f-4612-b3b7-e2668f7c9da5 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:13.353354 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-04be9145-1130-4556-9cb6-1a37ae5d9ea3 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:13.379571 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-04be9145-1130-4556-9cb6-1a37ae5d9ea3 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/02c38c79-9670-4d6d-bad7-70953e1ff22b" status: 200 len: 1293 microversion: 2.1 time: 0.712973 Oct 26 13:13:13.381353 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1248/2589] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:12 2022] GET /compute/v2.1/servers/02c38c79-9670-4d6d-bad7-70953e1ff22b => generated 1293 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:13.399366 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-dd89a21d-c4f4-4a07-92a4-0a3fb9c061ca req-4b279db2-5e26-4d13-918d-8d07abe89894 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02c38c79-9670-4d6d-bad7-70953e1ff22b", "tag": "7b0590e9-6a63-49e0-9f2c-d75d9101c143"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:13:13.447222 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-dd89a21d-c4f4-4a07-92a4-0a3fb9c061ca req-4b279db2-5e26-4d13-918d-8d07abe89894 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:13.448124 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-dd89a21d-c4f4-4a07-92a4-0a3fb9c061ca req-4b279db2-5e26-4d13-918d-8d07abe89894 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:13.449077 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-dd89a21d-c4f4-4a07-92a4-0a3fb9c061ca req-4b279db2-5e26-4d13-918d-8d07abe89894 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:13.482753 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-dd89a21d-c4f4-4a07-92a4-0a3fb9c061ca req-4b279db2-5e26-4d13-918d-8d07abe89894 service nova] Creating event network-changed:7b0590e9-6a63-49e0-9f2c-d75d9101c143 for instance 02c38c79-9670-4d6d-bad7-70953e1ff22b on n-h2-862686-1 Oct 26 13:13:13.500900 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-dd89a21d-c4f4-4a07-92a4-0a3fb9c061ca req-4b279db2-5e26-4d13-918d-8d07abe89894 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115937 Oct 26 13:13:13.503513 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1249/2590] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:13:13.523769 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f5ac30af-89af-4582-b2d0-106dbd720b99 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:13.525258 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f5ac30af-89af-4582-b2d0-106dbd720b99 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] [instance: 54ffeffd-483c-4d6d-8517-105a666e2402] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:13.550422 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f5ac30af-89af-4582-b2d0-106dbd720b99 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:13.550931 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f5ac30af-89af-4582-b2d0-106dbd720b99 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:13.551385 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f5ac30af-89af-4582-b2d0-106dbd720b99 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:13.552907 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:13:13.555491 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f5ac30af-89af-4582-b2d0-106dbd720b99 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:13.556461 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f5ac30af-89af-4582-b2d0-106dbd720b99 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:13.556461 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f5ac30af-89af-4582-b2d0-106dbd720b99 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:13.685459 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-052a6528-8c7f-4612-b3b7-e2668f7c9da5 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:13.695605 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-052a6528-8c7f-4612-b3b7-e2668f7c9da5 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206" status: 200 len: 1311 microversion: 2.1 time: 0.683240 Oct 26 13:13:13.700372 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1342/2591] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:13 2022] GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206 => generated 1311 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:13.710669 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-38fde3f1-a28a-4a5d-b057-43c20378d86e tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:13.714762 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-38fde3f1-a28a-4a5d-b057-43c20378d86e tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] [instance: 0dd070a1-a68f-4c94-9244-d59c94d109f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:13.730464 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38fde3f1-a28a-4a5d-b057-43c20378d86e tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:13.732183 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38fde3f1-a28a-4a5d-b057-43c20378d86e tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:13.734472 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38fde3f1-a28a-4a5d-b057-43c20378d86e tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:13.737878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38fde3f1-a28a-4a5d-b057-43c20378d86e tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:13.742123 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38fde3f1-a28a-4a5d-b057-43c20378d86e tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:13.742829 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38fde3f1-a28a-4a5d-b057-43c20378d86e tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:14.297557 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-38fde3f1-a28a-4a5d-b057-43c20378d86e tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6815934fa00041fba4d2a88b3648eb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fffeaed862d4dfe9abdc2c36a66a0cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:14.311609 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-38fde3f1-a28a-4a5d-b057-43c20378d86e tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9" status: 200 len: 1465 microversion: 2.1 time: 0.608934 Oct 26 13:13:14.321558 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1343/2592] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:13 2022] GET /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9 => generated 1465 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:14.343778 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ef98d1b1-e959-47d4-9792-c3d40291802e tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1113551730", "metadata": {"image_type": "test"}}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:13:14.346525 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ef98d1b1-e959-47d4-9792-c3d40291802e tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] [instance: 0dd070a1-a68f-4c94-9244-d59c94d109f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:14.360736 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef98d1b1-e959-47d4-9792-c3d40291802e tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:14.361510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef98d1b1-e959-47d4-9792-c3d40291802e tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:14.363796 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef98d1b1-e959-47d4-9792-c3d40291802e tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:14.364746 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef98d1b1-e959-47d4-9792-c3d40291802e tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:14.365419 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef98d1b1-e959-47d4-9792-c3d40291802e tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:14.369454 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef98d1b1-e959-47d4-9792-c3d40291802e tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:14.453324 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-ef98d1b1-e959-47d4-9792-c3d40291802e tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Getting quotas for project 1fffeaed862d4dfe9abdc2c36a66a0cc. Resources: dict_keys(['metadata_items']) {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:13:14.459822 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-ef98d1b1-e959-47d4-9792-c3d40291802e tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Getting quotas for user 6815934fa00041fba4d2a88b3648eb07 and project 1fffeaed862d4dfe9abdc2c36a66a0cc. Resources: dict_keys(['metadata_items']) {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:13:14.575019 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f5ac30af-89af-4582-b2d0-106dbd720b99 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea62f9a8c1094cf6810848551cd4fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd40483e170343f5a02795c16d063066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:14.604690 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f5ac30af-89af-4582-b2d0-106dbd720b99 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] 10.222.0.40 "GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402" status: 200 len: 1292 microversion: 2.1 time: 1.096939 Oct 26 13:13:14.611996 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1250/2593] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:13 2022] GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402 => generated 1292 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:14.631197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ea490c8f-dddb-4db3-9093-2a6156c9a6d2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:14.632248 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ea490c8f-dddb-4db3-9093-2a6156c9a6d2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 02c38c79-9670-4d6d-bad7-70953e1ff22b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:14.660247 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ea490c8f-dddb-4db3-9093-2a6156c9a6d2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:14.665457 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ea490c8f-dddb-4db3-9093-2a6156c9a6d2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:14.666211 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ea490c8f-dddb-4db3-9093-2a6156c9a6d2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:14.668136 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ea490c8f-dddb-4db3-9093-2a6156c9a6d2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:14.684930 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ea490c8f-dddb-4db3-9093-2a6156c9a6d2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:14.694157 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ea490c8f-dddb-4db3-9093-2a6156c9a6d2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:14.878475 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=8 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:13:14.982256 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ef98d1b1-e959-47d4-9792-c3d40291802e tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "POST /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9/action" status: 202 len: 0 microversion: 2.1 time: 0.642640 Oct 26 13:13:14.985703 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1344/2594] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:13:14 2022] POST /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9/action => generated 0 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 26 13:13:15.006204 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-aecec929-c28a-4d7f-926b-39d418fd3f18 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:15.007173 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-aecec929-c28a-4d7f-926b-39d418fd3f18 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 9534d3ef-723b-4f68-b147-9c3aceed8206] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:15.014256 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aecec929-c28a-4d7f-926b-39d418fd3f18 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:15.015668 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aecec929-c28a-4d7f-926b-39d418fd3f18 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:15.016391 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aecec929-c28a-4d7f-926b-39d418fd3f18 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:15.018316 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aecec929-c28a-4d7f-926b-39d418fd3f18 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:15.030340 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aecec929-c28a-4d7f-926b-39d418fd3f18 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:15.031207 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aecec929-c28a-4d7f-926b-39d418fd3f18 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:15.458598 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-aecec929-c28a-4d7f-926b-39d418fd3f18 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:15.487317 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-aecec929-c28a-4d7f-926b-39d418fd3f18 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206" status: 200 len: 1494 microversion: 2.1 time: 0.499035 Oct 26 13:13:15.489009 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1345/2595] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:14 2022] GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206 => generated 1494 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:15.508407 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-98e1ff4b-d33e-48a6-b64d-2d829b566e8b tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '.version_select at 0x7f67319eaa60>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:15.596720 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-98e1ff4b-d33e-48a6-b64d-2d829b566e8b tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/images/5776a9e0-e1dd-4524-89a1-d9ff0baf64b1" status: 200 len: 1424 microversion: 2.1 time: 0.106257 Oct 26 13:13:15.600881 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1346/2596] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:13:15 2022] GET /compute/v2.1/images/5776a9e0-e1dd-4524-89a1-d9ff0baf64b1 => generated 1424 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:15.748912 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ea490c8f-dddb-4db3-9093-2a6156c9a6d2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:15.772792 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ea490c8f-dddb-4db3-9093-2a6156c9a6d2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/02c38c79-9670-4d6d-bad7-70953e1ff22b" status: 200 len: 1293 microversion: 2.1 time: 1.150226 Oct 26 13:13:15.775817 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1251/2597] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:14 2022] GET /compute/v2.1/servers/02c38c79-9670-4d6d-bad7-70953e1ff22b => generated 1293 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:15.785279 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-804a01de-1e18-4bd6-9cc6-10a036b93cfc tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:15.786865 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-804a01de-1e18-4bd6-9cc6-10a036b93cfc tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] [instance: 9534d3ef-723b-4f68-b147-9c3aceed8206] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:15.801056 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-804a01de-1e18-4bd6-9cc6-10a036b93cfc tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:15.802654 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-804a01de-1e18-4bd6-9cc6-10a036b93cfc tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:15.805252 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-804a01de-1e18-4bd6-9cc6-10a036b93cfc tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:15.806201 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-804a01de-1e18-4bd6-9cc6-10a036b93cfc tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:15.806881 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-804a01de-1e18-4bd6-9cc6-10a036b93cfc tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:15.809382 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-804a01de-1e18-4bd6-9cc6-10a036b93cfc tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:15.904728 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-2f346b3c-5a12-4401-a652-de614bab803a req-bd8d14ee-5ad2-4421-9cea-b00e164abc2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54ffeffd-483c-4d6d-8517-105a666e2402", "name": "network-vif-plugged", "status": "completed", "tag": "a9d9e989-0192-4729-afb9-8ddfa02d05c4"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:13:15.921855 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-2f346b3c-5a12-4401-a652-de614bab803a req-bd8d14ee-5ad2-4421-9cea-b00e164abc2c service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:15.922720 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-2f346b3c-5a12-4401-a652-de614bab803a req-bd8d14ee-5ad2-4421-9cea-b00e164abc2c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:15.923845 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-2f346b3c-5a12-4401-a652-de614bab803a req-bd8d14ee-5ad2-4421-9cea-b00e164abc2c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:15.951151 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-2f346b3c-5a12-4401-a652-de614bab803a req-bd8d14ee-5ad2-4421-9cea-b00e164abc2c service nova] Creating event network-vif-plugged:a9d9e989-0192-4729-afb9-8ddfa02d05c4 for instance 54ffeffd-483c-4d6d-8517-105a666e2402 on n-h1-862686-1 Oct 26 13:13:15.959600 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-2f346b3c-5a12-4401-a652-de614bab803a req-bd8d14ee-5ad2-4421-9cea-b00e164abc2c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.356610 Oct 26 13:13:15.960897 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1347/2598] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:13:15.999149 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8378f5bf-dda0-4e0a-bdb1-582341882c2d tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:16.000413 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8378f5bf-dda0-4e0a-bdb1-582341882c2d tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] [instance: 54ffeffd-483c-4d6d-8517-105a666e2402] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:16.034660 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8378f5bf-dda0-4e0a-bdb1-582341882c2d tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:16.036126 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8378f5bf-dda0-4e0a-bdb1-582341882c2d tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:16.038508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8378f5bf-dda0-4e0a-bdb1-582341882c2d tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:16.042070 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8378f5bf-dda0-4e0a-bdb1-582341882c2d tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:16.044305 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8378f5bf-dda0-4e0a-bdb1-582341882c2d tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:16.046403 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8378f5bf-dda0-4e0a-bdb1-582341882c2d tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:16.120064 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-804a01de-1e18-4bd6-9cc6-10a036b93cfc tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206" status: 200 len: 1645 microversion: 2.1 time: 0.343177 Oct 26 13:13:16.122560 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1252/2599] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:15 2022] GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206 => generated 1645 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:16.146341 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d5895c92-325e-463e-a963-6d981ca7bf20 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:16.147186 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d5895c92-325e-463e-a963-6d981ca7bf20 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] [instance: 9534d3ef-723b-4f68-b147-9c3aceed8206] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:16.161309 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d5895c92-325e-463e-a963-6d981ca7bf20 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:16.161919 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d5895c92-325e-463e-a963-6d981ca7bf20 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:16.162579 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d5895c92-325e-463e-a963-6d981ca7bf20 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:16.163365 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d5895c92-325e-463e-a963-6d981ca7bf20 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:16.163896 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d5895c92-325e-463e-a963-6d981ca7bf20 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:16.164387 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d5895c92-325e-463e-a963-6d981ca7bf20 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:16.628093 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8378f5bf-dda0-4e0a-bdb1-582341882c2d tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea62f9a8c1094cf6810848551cd4fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd40483e170343f5a02795c16d063066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:16.646143 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8378f5bf-dda0-4e0a-bdb1-582341882c2d tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] 10.222.0.40 "GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402" status: 200 len: 1292 microversion: 2.1 time: 0.683413 Oct 26 13:13:16.648257 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1348/2600] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:15 2022] GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402 => generated 1292 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:16.667516 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6a29548b-7378-416a-9ad8-e487ad6b4918 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '.version_select at 0x7f67368e1430>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:16.695992 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d5895c92-325e-463e-a963-6d981ca7bf20 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206" status: 200 len: 1645 microversion: 2.1 time: 0.553779 Oct 26 13:13:16.720089 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1253/2601] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:16 2022] GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206 => generated 1645 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:16.735750 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4c1cf213-d17c-4f5d-8743-cf1568a99519 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:16.741599 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4c1cf213-d17c-4f5d-8743-cf1568a99519 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:16.744173 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4c1cf213-d17c-4f5d-8743-cf1568a99519 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:16.746174 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4c1cf213-d17c-4f5d-8743-cf1568a99519 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:16.761040 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4c1cf213-d17c-4f5d-8743-cf1568a99519 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:16.761678 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4c1cf213-d17c-4f5d-8743-cf1568a99519 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:16.763795 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6a29548b-7378-416a-9ad8-e487ad6b4918 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/images/5776a9e0-e1dd-4524-89a1-d9ff0baf64b1" status: 200 len: 1424 microversion: 2.1 time: 0.112330 Oct 26 13:13:16.764385 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1349/2602] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:13:16 2022] GET /compute/v2.1/images/5776a9e0-e1dd-4524-89a1-d9ff0baf64b1 => generated 1424 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:16.764806 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4c1cf213-d17c-4f5d-8743-cf1568a99519 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:16.801623 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-31a7b0d1-ff61-4a6e-b79b-fb89ce1c607c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:16.802463 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-31a7b0d1-ff61-4a6e-b79b-fb89ce1c607c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 02c38c79-9670-4d6d-bad7-70953e1ff22b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:16.816034 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31a7b0d1-ff61-4a6e-b79b-fb89ce1c607c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:16.816776 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31a7b0d1-ff61-4a6e-b79b-fb89ce1c607c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:16.817380 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31a7b0d1-ff61-4a6e-b79b-fb89ce1c607c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:16.822689 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31a7b0d1-ff61-4a6e-b79b-fb89ce1c607c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:16.823393 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31a7b0d1-ff61-4a6e-b79b-fb89ce1c607c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:16.824583 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31a7b0d1-ff61-4a6e-b79b-fb89ce1c607c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:16.832543 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4c1cf213-d17c-4f5d-8743-cf1568a99519 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.102795 Oct 26 13:13:16.845276 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1254/2603] 10.222.0.40 () {58 vars in 1176 bytes} [Wed Oct 26 13:13:16 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:13:16.857527 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fcba1814-06d4-489f-be8c-83fad973664a tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:13:16.858488 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fcba1814-06d4-489f-be8c-83fad973664a tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] [instance: 9534d3ef-723b-4f68-b147-9c3aceed8206] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:16.873789 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fcba1814-06d4-489f-be8c-83fad973664a tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:16.876138 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fcba1814-06d4-489f-be8c-83fad973664a tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:16.876757 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fcba1814-06d4-489f-be8c-83fad973664a tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:16.879880 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fcba1814-06d4-489f-be8c-83fad973664a tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:16.881687 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fcba1814-06d4-489f-be8c-83fad973664a tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:16.882335 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fcba1814-06d4-489f-be8c-83fad973664a tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:16.972744 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:13:17.048176 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fcba1814-06d4-489f-be8c-83fad973664a tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206/action" status: 202 len: 0 microversion: 2.1 time: 0.197337 Oct 26 13:13:17.054853 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1255/2604] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:13:16 2022] POST /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:13:17.065746 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8d151107-2e73-431f-9a74-9d07030ca4db tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:17.067108 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8d151107-2e73-431f-9a74-9d07030ca4db tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] [instance: 9534d3ef-723b-4f68-b147-9c3aceed8206] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:17.076310 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d151107-2e73-431f-9a74-9d07030ca4db tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:17.077057 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d151107-2e73-431f-9a74-9d07030ca4db tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:17.077773 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d151107-2e73-431f-9a74-9d07030ca4db tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:17.078649 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d151107-2e73-431f-9a74-9d07030ca4db tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:17.079483 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d151107-2e73-431f-9a74-9d07030ca4db tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:17.081179 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d151107-2e73-431f-9a74-9d07030ca4db tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:17.724680 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-31a7b0d1-ff61-4a6e-b79b-fb89ce1c607c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:17.735370 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-31a7b0d1-ff61-4a6e-b79b-fb89ce1c607c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/02c38c79-9670-4d6d-bad7-70953e1ff22b" status: 200 len: 1293 microversion: 2.1 time: 0.937621 Oct 26 13:13:17.757897 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1350/2605] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:16 2022] GET /compute/v2.1/servers/02c38c79-9670-4d6d-bad7-70953e1ff22b => generated 1293 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:13:17.768164 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7db3e831-bfcd-4f27-a2b8-26d0d63e430f tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:17.773017 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7db3e831-bfcd-4f27-a2b8-26d0d63e430f tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] [instance: 54ffeffd-483c-4d6d-8517-105a666e2402] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:17.787489 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7db3e831-bfcd-4f27-a2b8-26d0d63e430f tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:17.788303 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7db3e831-bfcd-4f27-a2b8-26d0d63e430f tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:17.788981 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7db3e831-bfcd-4f27-a2b8-26d0d63e430f tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:17.790626 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7db3e831-bfcd-4f27-a2b8-26d0d63e430f tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:17.791346 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7db3e831-bfcd-4f27-a2b8-26d0d63e430f tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:17.792143 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7db3e831-bfcd-4f27-a2b8-26d0d63e430f tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:17.975501 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8d151107-2e73-431f-9a74-9d07030ca4db tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206" status: 200 len: 1650 microversion: 2.1 time: 0.919090 Oct 26 13:13:17.978526 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1256/2606] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:17 2022] GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206 => generated 1650 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:17.986754 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3228fa29-0f91-4c02-9e27-89617bc0d26d tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '.version_select at 0x7f67323181f0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:18.058434 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3228fa29-0f91-4c02-9e27-89617bc0d26d tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/images/5776a9e0-e1dd-4524-89a1-d9ff0baf64b1" status: 200 len: 1424 microversion: 2.1 time: 0.078523 Oct 26 13:13:18.059619 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1257/2607] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:13:17 2022] GET /compute/v2.1/images/5776a9e0-e1dd-4524-89a1-d9ff0baf64b1 => generated 1424 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:18.151431 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7db3e831-bfcd-4f27-a2b8-26d0d63e430f tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea62f9a8c1094cf6810848551cd4fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd40483e170343f5a02795c16d063066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:18.164260 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7db3e831-bfcd-4f27-a2b8-26d0d63e430f tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] 10.222.0.40 "GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402" status: 200 len: 1292 microversion: 2.1 time: 0.401596 Oct 26 13:13:18.164952 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1351/2608] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:17 2022] GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402 => generated 1292 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:18.770866 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fb4c7ad2-9665-47f3-b70b-b3b4c0beb7f3 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:18.771785 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fb4c7ad2-9665-47f3-b70b-b3b4c0beb7f3 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 02c38c79-9670-4d6d-bad7-70953e1ff22b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:18.781030 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fb4c7ad2-9665-47f3-b70b-b3b4c0beb7f3 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:18.781756 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fb4c7ad2-9665-47f3-b70b-b3b4c0beb7f3 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:18.782336 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fb4c7ad2-9665-47f3-b70b-b3b4c0beb7f3 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:18.783381 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fb4c7ad2-9665-47f3-b70b-b3b4c0beb7f3 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:18.784024 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fb4c7ad2-9665-47f3-b70b-b3b4c0beb7f3 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:18.785333 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fb4c7ad2-9665-47f3-b70b-b3b4c0beb7f3 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:19.001838 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-10002429-a8ff-4f82-b066-67d3024e0a71 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:19.002572 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-10002429-a8ff-4f82-b066-67d3024e0a71 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] [instance: 9534d3ef-723b-4f68-b147-9c3aceed8206] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:19.025579 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10002429-a8ff-4f82-b066-67d3024e0a71 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:19.027290 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10002429-a8ff-4f82-b066-67d3024e0a71 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:19.029100 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10002429-a8ff-4f82-b066-67d3024e0a71 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:19.035967 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10002429-a8ff-4f82-b066-67d3024e0a71 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:19.038683 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10002429-a8ff-4f82-b066-67d3024e0a71 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:19.039144 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10002429-a8ff-4f82-b066-67d3024e0a71 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:19.200476 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fb4c7ad2-9665-47f3-b70b-b3b4c0beb7f3 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:19.211492 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fb4c7ad2-9665-47f3-b70b-b3b4c0beb7f3 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/02c38c79-9670-4d6d-bad7-70953e1ff22b" status: 200 len: 1293 microversion: 2.1 time: 0.445385 Oct 26 13:13:19.224287 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1258/2609] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:18 2022] GET /compute/v2.1/servers/02c38c79-9670-4d6d-bad7-70953e1ff22b => generated 1293 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:19.234960 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9be4444a-c8d4-4f2c-902f-8928e366d75b tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '.version_select at 0x7f673231d820>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:19.320164 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9be4444a-c8d4-4f2c-902f-8928e366d75b tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/images/5776a9e0-e1dd-4524-89a1-d9ff0baf64b1" status: 200 len: 1424 microversion: 2.1 time: 0.094485 Oct 26 13:13:19.330592 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1259/2610] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:13:19 2022] GET /compute/v2.1/images/5776a9e0-e1dd-4524-89a1-d9ff0baf64b1 => generated 1424 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:19.352627 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fb668cc5-2169-4206-9428-5b8ffb41150e tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:19.361266 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fb668cc5-2169-4206-9428-5b8ffb41150e tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] [instance: 54ffeffd-483c-4d6d-8517-105a666e2402] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:19.375628 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fb668cc5-2169-4206-9428-5b8ffb41150e tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:19.376134 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fb668cc5-2169-4206-9428-5b8ffb41150e tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:19.376720 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fb668cc5-2169-4206-9428-5b8ffb41150e tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:19.379385 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fb668cc5-2169-4206-9428-5b8ffb41150e tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:19.380788 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fb668cc5-2169-4206-9428-5b8ffb41150e tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:19.381461 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fb668cc5-2169-4206-9428-5b8ffb41150e tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:19.853886 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fb668cc5-2169-4206-9428-5b8ffb41150e tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea62f9a8c1094cf6810848551cd4fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd40483e170343f5a02795c16d063066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:19.870634 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fb668cc5-2169-4206-9428-5b8ffb41150e tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] 10.222.0.40 "GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402" status: 200 len: 1483 microversion: 2.1 time: 0.532106 Oct 26 13:13:19.875194 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1260/2611] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:19 2022] GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402 => generated 1483 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:19.881396 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-10002429-a8ff-4f82-b066-67d3024e0a71 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206" status: 200 len: 1630 microversion: 2.1 time: 0.884210 Oct 26 13:13:19.895501 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1352/2612] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:18 2022] GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206 => generated 1630 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:19.917435 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9a88441f-c91c-4225-8857-5af50d787143 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:19.918323 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9a88441f-c91c-4225-8857-5af50d787143 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] [instance: 54ffeffd-483c-4d6d-8517-105a666e2402] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:19.927172 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a88441f-c91c-4225-8857-5af50d787143 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:19.928038 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a88441f-c91c-4225-8857-5af50d787143 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:19.928699 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a88441f-c91c-4225-8857-5af50d787143 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:19.932936 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a88441f-c91c-4225-8857-5af50d787143 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:19.933821 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a88441f-c91c-4225-8857-5af50d787143 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:19.938791 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a88441f-c91c-4225-8857-5af50d787143 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:20.099698 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7cf8ccf4-b20a-42a0-8432-37635f8fba8f tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Action: 'create', calling method: .version_select at 0x7f67323a5af0>, body: {"keypair": {"name": "tempest-keypair-1091356544", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCh1ilTHTkn74W+I8Q7L6FGytP/oN3MlCjULM/ovD1RIdeSjEfIVcQmjW5YobgAqSYKQqIs1fXvsFRaur8ljkbX/VnLZ09ZZejPdyS9QlBS7Bvg9Qt1HeXev7oLjV0G8SQ=="}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:13:20.183394 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-7cf8ccf4-b20a-42a0-8432-37635f8fba8f tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Getting quotas for project 4b1661af840e4aaaba8cb8ec5e8a4a6a. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:13:20.205577 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-7cf8ccf4-b20a-42a0-8432-37635f8fba8f tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Getting quotas for user 7231628702cd4fe59f9bc17f79146195 and project 4b1661af840e4aaaba8cb8ec5e8a4a6a. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:13:20.283897 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9a88441f-c91c-4225-8857-5af50d787143 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] 10.222.0.40 "GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.383506 Oct 26 13:13:20.284713 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1353/2613] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 26 13:13:19 2022] GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402/os-interface => generated 284 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:13:20.286087 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7cf8ccf4-b20a-42a0-8432-37635f8fba8f tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.408185 Oct 26 13:13:20.287041 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1261/2614] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 13:13:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:13:20.306625 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3645a927-69fa-41f8-b958-88fa32416147 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862686-1", "block_migration": true, "disk_over_commit": false}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:13:20.311077 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fc8a1f54-2f4c-4aaa-9ef7-8458077139c0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:20.312743 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fc8a1f54-2f4c-4aaa-9ef7-8458077139c0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 02c38c79-9670-4d6d-bad7-70953e1ff22b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:20.315608 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3645a927-69fa-41f8-b958-88fa32416147 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] [instance: 9534d3ef-723b-4f68-b147-9c3aceed8206] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:20.332821 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fc8a1f54-2f4c-4aaa-9ef7-8458077139c0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:20.333501 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fc8a1f54-2f4c-4aaa-9ef7-8458077139c0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:20.334065 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fc8a1f54-2f4c-4aaa-9ef7-8458077139c0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:20.334889 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fc8a1f54-2f4c-4aaa-9ef7-8458077139c0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:20.337853 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fc8a1f54-2f4c-4aaa-9ef7-8458077139c0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:20.338346 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fc8a1f54-2f4c-4aaa-9ef7-8458077139c0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:20.344689 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3645a927-69fa-41f8-b958-88fa32416147 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:20.345236 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3645a927-69fa-41f8-b958-88fa32416147 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:20.345721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3645a927-69fa-41f8-b958-88fa32416147 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:20.348298 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3645a927-69fa-41f8-b958-88fa32416147 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:20.348790 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3645a927-69fa-41f8-b958-88fa32416147 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:20.349234 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3645a927-69fa-41f8-b958-88fa32416147 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:20.474187 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-3645a927-69fa-41f8-b958-88fa32416147 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lazy-loading 'flavor' on Instance uuid 9534d3ef-723b-4f68-b147-9c3aceed8206 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:13:20.504063 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3645a927-69fa-41f8-b958-88fa32416147 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] [instance: 9534d3ef-723b-4f68-b147-9c3aceed8206] Going to try to live migrate instance to n-h2-862686-1 {{(pid=120598) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 26 13:13:20.728802 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:13:22.566821 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fc8a1f54-2f4c-4aaa-9ef7-8458077139c0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:22.586352 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fc8a1f54-2f4c-4aaa-9ef7-8458077139c0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/02c38c79-9670-4d6d-bad7-70953e1ff22b" status: 200 len: 1293 microversion: 2.1 time: 2.284025 Oct 26 13:13:22.587200 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1262/2615] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:20 2022] GET /compute/v2.1/servers/02c38c79-9670-4d6d-bad7-70953e1ff22b => generated 1293 bytes in 2286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:22.592224 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-83385f5a-0721-4c02-b1ad-b2476dc14ad7 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '.version_select at 0x7f673251a820>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:22.678031 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-83385f5a-0721-4c02-b1ad-b2476dc14ad7 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/images/5776a9e0-e1dd-4524-89a1-d9ff0baf64b1" status: 200 len: 1424 microversion: 2.1 time: 0.089458 Oct 26 13:13:22.678613 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1263/2616] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:13:22 2022] GET /compute/v2.1/images/5776a9e0-e1dd-4524-89a1-d9ff0baf64b1 => generated 1424 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:22.950963 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0c64179b-9f97-424b-9c29-627f277e59cc tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-864416302", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "f18eec76-b04e-45a4-8320-a888ab1bcda1"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:13:23.101702 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-0c64179b-9f97-424b-9c29-627f277e59cc tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] validate_networks() for [('f18eec76-b04e-45a4-8320-a888ab1bcda1', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:13:24.585845 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-0c64179b-9f97-424b-9c29-627f277e59cc tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:13:24.587023 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-0c64179b-9f97-424b-9c29-627f277e59cc tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:13:24.587736 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-0c64179b-9f97-424b-9c29-627f277e59cc tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:13:24.588933 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-0c64179b-9f97-424b-9c29-627f277e59cc tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:13:24.589583 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-0c64179b-9f97-424b-9c29-627f277e59cc tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:13:24.611000 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c64179b-9f97-424b-9c29-627f277e59cc tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:24.611495 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c64179b-9f97-424b-9c29-627f277e59cc tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:24.611938 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c64179b-9f97-424b-9c29-627f277e59cc tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:24.612677 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c64179b-9f97-424b-9c29-627f277e59cc tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:24.619586 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c64179b-9f97-424b-9c29-627f277e59cc tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:24.620162 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c64179b-9f97-424b-9c29-627f277e59cc tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:24.685284 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-0c64179b-9f97-424b-9c29-627f277e59cc tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Getting quotas for project 6a8f148e91c2419980d161899865d574. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:13:24.708989 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-0c64179b-9f97-424b-9c29-627f277e59cc tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Getting quotas for user 674053f357854715a7035b381e435368 and project 6a8f148e91c2419980d161899865d574. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:13:24.742614 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0c64179b-9f97-424b-9c29-627f277e59cc tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:13:24.750293 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0c64179b-9f97-424b-9c29-627f277e59cc tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] [instance: 0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:13:24.891914 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0c64179b-9f97-424b-9c29-627f277e59cc tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.199732 Oct 26 13:13:24.892842 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1264/2617] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:13:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2214 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:13:24.905359 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7dac1f22-d669-4ec9-883d-efbd7251e325 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:24.906260 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7dac1f22-d669-4ec9-883d-efbd7251e325 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 02c38c79-9670-4d6d-bad7-70953e1ff22b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:24.922786 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7dac1f22-d669-4ec9-883d-efbd7251e325 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:24.932039 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7dac1f22-d669-4ec9-883d-efbd7251e325 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:24.932876 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7dac1f22-d669-4ec9-883d-efbd7251e325 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:24.934011 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7dac1f22-d669-4ec9-883d-efbd7251e325 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:24.934640 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7dac1f22-d669-4ec9-883d-efbd7251e325 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:24.935248 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7dac1f22-d669-4ec9-883d-efbd7251e325 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:25.257441 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7dac1f22-d669-4ec9-883d-efbd7251e325 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:25.285437 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7dac1f22-d669-4ec9-883d-efbd7251e325 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/02c38c79-9670-4d6d-bad7-70953e1ff22b" status: 200 len: 1293 microversion: 2.1 time: 0.390347 Oct 26 13:13:25.286479 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1265/2618] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:24 2022] GET /compute/v2.1/servers/02c38c79-9670-4d6d-bad7-70953e1ff22b => generated 1293 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:25.304227 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-18b2bfa9-bce9-45d4-9f2d-beb8914006a9 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '.version_select at 0x7f673231dc10>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:25.388370 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-18b2bfa9-bce9-45d4-9f2d-beb8914006a9 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/images/5776a9e0-e1dd-4524-89a1-d9ff0baf64b1" status: 200 len: 1424 microversion: 2.1 time: 0.100587 Oct 26 13:13:25.389302 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1266/2619] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:13:25 2022] GET /compute/v2.1/images/5776a9e0-e1dd-4524-89a1-d9ff0baf64b1 => generated 1424 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:25.411073 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-78a0344a-a8cc-4433-81c7-60f452e42aa1 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:25.411692 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-78a0344a-a8cc-4433-81c7-60f452e42aa1 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] [instance: 54ffeffd-483c-4d6d-8517-105a666e2402] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:25.442199 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78a0344a-a8cc-4433-81c7-60f452e42aa1 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:25.444021 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78a0344a-a8cc-4433-81c7-60f452e42aa1 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:25.445588 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78a0344a-a8cc-4433-81c7-60f452e42aa1 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:25.447188 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78a0344a-a8cc-4433-81c7-60f452e42aa1 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:25.453574 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78a0344a-a8cc-4433-81c7-60f452e42aa1 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:25.454284 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78a0344a-a8cc-4433-81c7-60f452e42aa1 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:25.644064 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-78a0344a-a8cc-4433-81c7-60f452e42aa1 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea62f9a8c1094cf6810848551cd4fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd40483e170343f5a02795c16d063066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:25.653660 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-78a0344a-a8cc-4433-81c7-60f452e42aa1 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] 10.222.0.40 "GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402" status: 200 len: 1483 microversion: 2.1 time: 0.246688 Oct 26 13:13:25.654313 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1267/2620] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:25 2022] GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402 => generated 1483 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:25.789975 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-4abb97d8-949e-458e-a771-382e4101bae1 req-bbba1cf3-c168-47a7-b100-978383f5f13a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54ffeffd-483c-4d6d-8517-105a666e2402", "tag": "a9d9e989-0192-4729-afb9-8ddfa02d05c4"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:13:25.815887 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-4abb97d8-949e-458e-a771-382e4101bae1 req-bbba1cf3-c168-47a7-b100-978383f5f13a service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:25.817606 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-4abb97d8-949e-458e-a771-382e4101bae1 req-bbba1cf3-c168-47a7-b100-978383f5f13a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:25.823272 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-4abb97d8-949e-458e-a771-382e4101bae1 req-bbba1cf3-c168-47a7-b100-978383f5f13a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:25.876454 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-4abb97d8-949e-458e-a771-382e4101bae1 req-bbba1cf3-c168-47a7-b100-978383f5f13a service nova] Creating event network-changed:a9d9e989-0192-4729-afb9-8ddfa02d05c4 for instance 54ffeffd-483c-4d6d-8517-105a666e2402 on n-h1-862686-1 Oct 26 13:13:25.896704 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-4abb97d8-949e-458e-a771-382e4101bae1 req-bbba1cf3-c168-47a7-b100-978383f5f13a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.228866 Oct 26 13:13:25.904686 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1268/2621] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:13:25.923960 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-300ab720-d4b2-4785-a295-104e25709648 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:25.924700 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-300ab720-d4b2-4785-a295-104e25709648 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] [instance: 0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:26.065058 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-300ab720-d4b2-4785-a295-104e25709648 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674053f357854715a7035b381e435368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a8f148e91c2419980d161899865d574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:26.073370 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-300ab720-d4b2-4785-a295-104e25709648 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] 10.222.0.40 "GET /compute/v2.1/servers/0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44" status: 200 len: 1227 microversion: 2.1 time: 0.167227 Oct 26 13:13:26.091891 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1269/2622] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:25 2022] GET /compute/v2.1/servers/0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44 => generated 1227 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:26.313414 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a7b4076f-5504-42c8-97b7-7c24674fe6df tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:26.315305 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a7b4076f-5504-42c8-97b7-7c24674fe6df tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 02c38c79-9670-4d6d-bad7-70953e1ff22b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:26.337327 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7b4076f-5504-42c8-97b7-7c24674fe6df tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:26.339878 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7b4076f-5504-42c8-97b7-7c24674fe6df tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:26.340563 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7b4076f-5504-42c8-97b7-7c24674fe6df tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:26.342653 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7b4076f-5504-42c8-97b7-7c24674fe6df tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:26.344805 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7b4076f-5504-42c8-97b7-7c24674fe6df tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:26.345751 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7b4076f-5504-42c8-97b7-7c24674fe6df tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:26.714606 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a7b4076f-5504-42c8-97b7-7c24674fe6df tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:26.727915 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a7b4076f-5504-42c8-97b7-7c24674fe6df tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/02c38c79-9670-4d6d-bad7-70953e1ff22b" status: 200 len: 1293 microversion: 2.1 time: 0.423150 Oct 26 13:13:26.730598 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1270/2623] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:26 2022] GET /compute/v2.1/servers/02c38c79-9670-4d6d-bad7-70953e1ff22b => generated 1293 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:13:26.738613 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-73746fe3-28aa-4246-b197-c25fcea9e664 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '.version_select at 0x7f673251a820>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:26.868155 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-73746fe3-28aa-4246-b197-c25fcea9e664 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/images/5776a9e0-e1dd-4524-89a1-d9ff0baf64b1" status: 200 len: 1424 microversion: 2.1 time: 0.136340 Oct 26 13:13:26.871795 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1271/2624] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:13:26 2022] GET /compute/v2.1/images/5776a9e0-e1dd-4524-89a1-d9ff0baf64b1 => generated 1424 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:27.104008 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ce505451-aaff-4435-8110-384131989bef tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:27.104817 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ce505451-aaff-4435-8110-384131989bef tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] [instance: 0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:27.120913 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce505451-aaff-4435-8110-384131989bef tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:27.121733 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce505451-aaff-4435-8110-384131989bef tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:27.122477 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce505451-aaff-4435-8110-384131989bef tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:27.123444 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce505451-aaff-4435-8110-384131989bef tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:27.124739 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce505451-aaff-4435-8110-384131989bef tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:27.125389 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce505451-aaff-4435-8110-384131989bef tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:27.221212 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3645a927-69fa-41f8-b958-88fa32416147 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206/action" status: 202 len: 0 microversion: 2.1 time: 6.932746 Oct 26 13:13:27.221873 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1354/2625] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:13:20 2022] POST /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206/action => generated 0 bytes in 6936 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:13:27.229316 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c8724943-60da-4e6a-b7d5-d075cb567dbf tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:27.229959 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c8724943-60da-4e6a-b7d5-d075cb567dbf tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 9534d3ef-723b-4f68-b147-9c3aceed8206] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:27.242885 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c8724943-60da-4e6a-b7d5-d075cb567dbf tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:27.243924 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ce505451-aaff-4435-8110-384131989bef tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674053f357854715a7035b381e435368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a8f148e91c2419980d161899865d574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:27.244178 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c8724943-60da-4e6a-b7d5-d075cb567dbf tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:27.245138 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c8724943-60da-4e6a-b7d5-d075cb567dbf tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:27.246359 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c8724943-60da-4e6a-b7d5-d075cb567dbf tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:27.248090 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c8724943-60da-4e6a-b7d5-d075cb567dbf tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:27.250719 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c8724943-60da-4e6a-b7d5-d075cb567dbf tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:27.259461 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ce505451-aaff-4435-8110-384131989bef tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] 10.222.0.40 "GET /compute/v2.1/servers/0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44" status: 200 len: 1279 microversion: 2.1 time: 0.160398 Oct 26 13:13:27.276941 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1272/2626] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:27 2022] GET /compute/v2.1/servers/0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44 => generated 1279 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:27.771609 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4ceaf632-58ea-4a91-abe8-cd1b12245283 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:27.774379 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4ceaf632-58ea-4a91-abe8-cd1b12245283 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 02c38c79-9670-4d6d-bad7-70953e1ff22b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:27.794421 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4ceaf632-58ea-4a91-abe8-cd1b12245283 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:27.799634 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4ceaf632-58ea-4a91-abe8-cd1b12245283 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:27.801726 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4ceaf632-58ea-4a91-abe8-cd1b12245283 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:27.802623 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4ceaf632-58ea-4a91-abe8-cd1b12245283 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:27.804408 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4ceaf632-58ea-4a91-abe8-cd1b12245283 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:27.805977 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4ceaf632-58ea-4a91-abe8-cd1b12245283 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:28.208552 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4ceaf632-58ea-4a91-abe8-cd1b12245283 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:28.221826 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4ceaf632-58ea-4a91-abe8-cd1b12245283 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/02c38c79-9670-4d6d-bad7-70953e1ff22b" status: 200 len: 1293 microversion: 2.1 time: 0.469174 Oct 26 13:13:28.223839 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1273/2627] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:27 2022] GET /compute/v2.1/servers/02c38c79-9670-4d6d-bad7-70953e1ff22b => generated 1293 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:28.236294 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ac925914-20b9-42c4-b5c8-433fff7167f2 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '.version_select at 0x7f6732b364c0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:28.324348 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ac925914-20b9-42c4-b5c8-433fff7167f2 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/images/5776a9e0-e1dd-4524-89a1-d9ff0baf64b1" status: 200 len: 1424 microversion: 2.1 time: 0.097905 Oct 26 13:13:28.325389 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1274/2628] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:13:28 2022] GET /compute/v2.1/images/5776a9e0-e1dd-4524-89a1-d9ff0baf64b1 => generated 1424 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:28.338161 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bc069ca4-2e22-4971-85f2-a482980026d3 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:28.338934 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bc069ca4-2e22-4971-85f2-a482980026d3 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] [instance: 0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:28.355598 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc069ca4-2e22-4971-85f2-a482980026d3 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:28.356598 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc069ca4-2e22-4971-85f2-a482980026d3 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:28.357248 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc069ca4-2e22-4971-85f2-a482980026d3 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:28.358983 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc069ca4-2e22-4971-85f2-a482980026d3 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:28.361049 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc069ca4-2e22-4971-85f2-a482980026d3 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:28.361840 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc069ca4-2e22-4971-85f2-a482980026d3 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:28.522969 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bc069ca4-2e22-4971-85f2-a482980026d3 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674053f357854715a7035b381e435368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a8f148e91c2419980d161899865d574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:28.535400 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bc069ca4-2e22-4971-85f2-a482980026d3 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] 10.222.0.40 "GET /compute/v2.1/servers/0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44" status: 200 len: 1285 microversion: 2.1 time: 0.208382 Oct 26 13:13:28.576390 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1275/2629] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:28 2022] GET /compute/v2.1/servers/0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44 => generated 1285 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:29.254371 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d6d98ed0-e8d6-4632-a20d-a3248777a295 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:29.255796 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d6d98ed0-e8d6-4632-a20d-a3248777a295 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 02c38c79-9670-4d6d-bad7-70953e1ff22b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:29.282206 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6d98ed0-e8d6-4632-a20d-a3248777a295 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:29.283901 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6d98ed0-e8d6-4632-a20d-a3248777a295 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:29.285658 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6d98ed0-e8d6-4632-a20d-a3248777a295 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:29.288754 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6d98ed0-e8d6-4632-a20d-a3248777a295 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:29.290106 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6d98ed0-e8d6-4632-a20d-a3248777a295 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:29.291729 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6d98ed0-e8d6-4632-a20d-a3248777a295 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:29.323680 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c8724943-60da-4e6a-b7d5-d075cb567dbf tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:29.344937 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c8724943-60da-4e6a-b7d5-d075cb567dbf tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206" status: 200 len: 1504 microversion: 2.1 time: 2.119174 Oct 26 13:13:29.350657 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1355/2630] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:27 2022] GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206 => generated 1504 bytes in 2126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:13:29.358322 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-30b22df6-1f18-4526-930f-cb48fd098e95 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1705689855", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "e0ba6f7b-13ac-42ce-8212-7ebe97f6a70f"}], "security_groups": [{"name": "tempest-securitygroup--799740328"}], "key_name": "tempest-keypair-1091356544", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:13:29.771709 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d6d98ed0-e8d6-4632-a20d-a3248777a295 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:29.784297 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d6d98ed0-e8d6-4632-a20d-a3248777a295 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/02c38c79-9670-4d6d-bad7-70953e1ff22b" status: 200 len: 1293 microversion: 2.1 time: 0.538190 Oct 26 13:13:29.791191 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1276/2631] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:29 2022] GET /compute/v2.1/servers/02c38c79-9670-4d6d-bad7-70953e1ff22b => generated 1293 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:29.821000 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b03d67db-b582-4d88-9fd6-c3a757b2e6d2 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '.version_select at 0x7f67321f8c10>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:29.940266 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b03d67db-b582-4d88-9fd6-c3a757b2e6d2 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/images/5776a9e0-e1dd-4524-89a1-d9ff0baf64b1" status: 200 len: 1424 microversion: 2.1 time: 0.146958 Oct 26 13:13:29.941031 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1277/2632] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:13:29 2022] GET /compute/v2.1/images/5776a9e0-e1dd-4524-89a1-d9ff0baf64b1 => generated 1424 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:29.956603 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9485ee51-848d-4ef7-ace2-114a0ee492f7 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:29.957357 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9485ee51-848d-4ef7-ace2-114a0ee492f7 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] [instance: 0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:29.979705 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9485ee51-848d-4ef7-ace2-114a0ee492f7 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:29.988171 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9485ee51-848d-4ef7-ace2-114a0ee492f7 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:29.989020 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9485ee51-848d-4ef7-ace2-114a0ee492f7 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:29.990024 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9485ee51-848d-4ef7-ace2-114a0ee492f7 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:29.990772 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9485ee51-848d-4ef7-ace2-114a0ee492f7 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:29.991421 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9485ee51-848d-4ef7-ace2-114a0ee492f7 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:30.162273 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9485ee51-848d-4ef7-ace2-114a0ee492f7 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674053f357854715a7035b381e435368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a8f148e91c2419980d161899865d574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:30.176203 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9485ee51-848d-4ef7-ace2-114a0ee492f7 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] 10.222.0.40 "GET /compute/v2.1/servers/0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44" status: 200 len: 1285 microversion: 2.1 time: 0.232344 Oct 26 13:13:30.177038 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1278/2633] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:29 2022] GET /compute/v2.1/servers/0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44 => generated 1285 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:30.229951 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-7f9c2793-620a-40b3-9cc5-0538f299ec26 req-2ac89927-641e-4016-9606-ee346c13c9b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9534d3ef-723b-4f68-b147-9c3aceed8206", "name": "network-vif-unplugged", "status": "completed", "tag": "4076f66d-6130-489d-a954-7f1e23537cf4"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:13:30.275055 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-7f9c2793-620a-40b3-9cc5-0538f299ec26 req-2ac89927-641e-4016-9606-ee346c13c9b1 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:30.281550 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-7f9c2793-620a-40b3-9cc5-0538f299ec26 req-2ac89927-641e-4016-9606-ee346c13c9b1 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:30.282791 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-7f9c2793-620a-40b3-9cc5-0538f299ec26 req-2ac89927-641e-4016-9606-ee346c13c9b1 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:30.318029 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-7f9c2793-620a-40b3-9cc5-0538f299ec26 req-2ac89927-641e-4016-9606-ee346c13c9b1 service nova] Creating event network-vif-unplugged:4076f66d-6130-489d-a954-7f1e23537cf4 for instance 9534d3ef-723b-4f68-b147-9c3aceed8206 on n-h1-862686-1 Oct 26 13:13:30.328459 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-7f9c2793-620a-40b3-9cc5-0538f299ec26 req-2ac89927-641e-4016-9606-ee346c13c9b1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102145 Oct 26 13:13:30.329837 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1279/2634] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:13:30.381179 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7f5ab839-dc9a-4618-bbd0-604c200dbe0e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:30.382341 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7f5ab839-dc9a-4618-bbd0-604c200dbe0e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 9534d3ef-723b-4f68-b147-9c3aceed8206] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:30.397106 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:13:30.399282 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f5ab839-dc9a-4618-bbd0-604c200dbe0e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:30.400137 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f5ab839-dc9a-4618-bbd0-604c200dbe0e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:30.400859 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f5ab839-dc9a-4618-bbd0-604c200dbe0e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:30.407100 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f5ab839-dc9a-4618-bbd0-604c200dbe0e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:30.407924 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f5ab839-dc9a-4618-bbd0-604c200dbe0e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:30.408628 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f5ab839-dc9a-4618-bbd0-604c200dbe0e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:30.743154 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-30b22df6-1f18-4526-930f-cb48fd098e95 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] validate_networks() for [('e0ba6f7b-13ac-42ce-8212-7ebe97f6a70f', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:13:31.005881 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7f5ab839-dc9a-4618-bbd0-604c200dbe0e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:31.020310 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7f5ab839-dc9a-4618-bbd0-604c200dbe0e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206" status: 200 len: 1504 microversion: 2.1 time: 0.643091 Oct 26 13:13:31.034537 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1280/2635] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:30 2022] GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206 => generated 1504 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:13:31.045526 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-971fb7f0-86b3-4a07-bc3c-e582f4aad1b2 req-6a6634dd-b861-4b32-99d0-62e92db11e16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02c38c79-9670-4d6d-bad7-70953e1ff22b", "name": "network-vif-plugged", "status": "completed", "tag": "7b0590e9-6a63-49e0-9f2c-d75d9101c143"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:13:31.057650 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-971fb7f0-86b3-4a07-bc3c-e582f4aad1b2 req-6a6634dd-b861-4b32-99d0-62e92db11e16 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:31.058590 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-971fb7f0-86b3-4a07-bc3c-e582f4aad1b2 req-6a6634dd-b861-4b32-99d0-62e92db11e16 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:31.059389 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-971fb7f0-86b3-4a07-bc3c-e582f4aad1b2 req-6a6634dd-b861-4b32-99d0-62e92db11e16 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:31.072510 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-971fb7f0-86b3-4a07-bc3c-e582f4aad1b2 req-6a6634dd-b861-4b32-99d0-62e92db11e16 service nova] Creating event network-vif-plugged:7b0590e9-6a63-49e0-9f2c-d75d9101c143 for instance 02c38c79-9670-4d6d-bad7-70953e1ff22b on n-h2-862686-1 Oct 26 13:13:31.087047 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-971fb7f0-86b3-4a07-bc3c-e582f4aad1b2 req-6a6634dd-b861-4b32-99d0-62e92db11e16 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045660 Oct 26 13:13:31.088330 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1281/2636] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:13:31.113867 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7ce6d9db-b210-4637-8ffd-849ed5e2b895 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:31.120316 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7ce6d9db-b210-4637-8ffd-849ed5e2b895 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 02c38c79-9670-4d6d-bad7-70953e1ff22b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:31.140930 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ce6d9db-b210-4637-8ffd-849ed5e2b895 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:31.145082 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ce6d9db-b210-4637-8ffd-849ed5e2b895 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:31.146409 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ce6d9db-b210-4637-8ffd-849ed5e2b895 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:31.149709 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ce6d9db-b210-4637-8ffd-849ed5e2b895 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:31.155647 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ce6d9db-b210-4637-8ffd-849ed5e2b895 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:31.156634 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ce6d9db-b210-4637-8ffd-849ed5e2b895 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:31.662232 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7ce6d9db-b210-4637-8ffd-849ed5e2b895 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:31.672610 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7ce6d9db-b210-4637-8ffd-849ed5e2b895 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/02c38c79-9670-4d6d-bad7-70953e1ff22b" status: 200 len: 1293 microversion: 2.1 time: 0.581367 Oct 26 13:13:31.685411 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1282/2637] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:31 2022] GET /compute/v2.1/servers/02c38c79-9670-4d6d-bad7-70953e1ff22b => generated 1293 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:31.685411 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-992e36e3-2f5e-432b-88e1-81b27541e4f5 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '.version_select at 0x7f673251a550>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:31.732137 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-992e36e3-2f5e-432b-88e1-81b27541e4f5 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/images/5776a9e0-e1dd-4524-89a1-d9ff0baf64b1" status: 200 len: 1424 microversion: 2.1 time: 0.057231 Oct 26 13:13:31.732977 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1283/2638] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:13:31 2022] GET /compute/v2.1/images/5776a9e0-e1dd-4524-89a1-d9ff0baf64b1 => generated 1424 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:31.739701 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fb875943-002c-41d6-8fa6-254c89f927ef tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:31.740905 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fb875943-002c-41d6-8fa6-254c89f927ef tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] [instance: 0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:31.749616 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fb875943-002c-41d6-8fa6-254c89f927ef tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:31.750964 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fb875943-002c-41d6-8fa6-254c89f927ef tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:31.751573 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fb875943-002c-41d6-8fa6-254c89f927ef tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:31.752482 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fb875943-002c-41d6-8fa6-254c89f927ef tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:31.753117 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fb875943-002c-41d6-8fa6-254c89f927ef tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:31.753828 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fb875943-002c-41d6-8fa6-254c89f927ef tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:31.789973 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:13:31.919849 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fb875943-002c-41d6-8fa6-254c89f927ef tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674053f357854715a7035b381e435368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a8f148e91c2419980d161899865d574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:31.932557 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fb875943-002c-41d6-8fa6-254c89f927ef tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] 10.222.0.40 "GET /compute/v2.1/servers/0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44" status: 200 len: 1285 microversion: 2.1 time: 0.194772 Oct 26 13:13:31.933206 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1284/2639] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:31 2022] GET /compute/v2.1/servers/0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44 => generated 1285 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:32.047402 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f6b7783a-8c19-4090-bde4-1304a989ab8e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:32.048028 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f6b7783a-8c19-4090-bde4-1304a989ab8e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 9534d3ef-723b-4f68-b147-9c3aceed8206] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:32.064141 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f6b7783a-8c19-4090-bde4-1304a989ab8e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:32.064643 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f6b7783a-8c19-4090-bde4-1304a989ab8e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:32.065083 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f6b7783a-8c19-4090-bde4-1304a989ab8e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:32.065820 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f6b7783a-8c19-4090-bde4-1304a989ab8e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:32.066275 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f6b7783a-8c19-4090-bde4-1304a989ab8e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:32.066698 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f6b7783a-8c19-4090-bde4-1304a989ab8e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:32.272714 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f6b7783a-8c19-4090-bde4-1304a989ab8e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:32.282909 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f6b7783a-8c19-4090-bde4-1304a989ab8e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206" status: 200 len: 1504 microversion: 2.1 time: 0.239948 Oct 26 13:13:32.297807 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1285/2640] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:32 2022] GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206 => generated 1504 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:32.378761 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-7afdf1cf-f65b-4ae7-8882-1c196c90561d req-b359e741-0f8b-41d1-8c2f-9bac96265d89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9534d3ef-723b-4f68-b147-9c3aceed8206", "tag": "4076f66d-6130-489d-a954-7f1e23537cf4"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:13:32.392348 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-7afdf1cf-f65b-4ae7-8882-1c196c90561d req-b359e741-0f8b-41d1-8c2f-9bac96265d89 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:32.393110 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-7afdf1cf-f65b-4ae7-8882-1c196c90561d req-b359e741-0f8b-41d1-8c2f-9bac96265d89 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:32.393737 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-7afdf1cf-f65b-4ae7-8882-1c196c90561d req-b359e741-0f8b-41d1-8c2f-9bac96265d89 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:32.411700 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-7afdf1cf-f65b-4ae7-8882-1c196c90561d req-b359e741-0f8b-41d1-8c2f-9bac96265d89 service nova] Creating event network-changed:4076f66d-6130-489d-a954-7f1e23537cf4 for instance 9534d3ef-723b-4f68-b147-9c3aceed8206 on n-h1-862686-1 Oct 26 13:13:32.429875 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-7afdf1cf-f65b-4ae7-8882-1c196c90561d req-b359e741-0f8b-41d1-8c2f-9bac96265d89 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056844 Oct 26 13:13:32.436238 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1286/2641] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:13:32.593235 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:13:32.606988 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-30b22df6-1f18-4526-930f-cb48fd098e95 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Getting quotas for project 4b1661af840e4aaaba8cb8ec5e8a4a6a. Resources: dict_keys(['metadata_items']) {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:13:32.624919 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-30b22df6-1f18-4526-930f-cb48fd098e95 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Getting quotas for user 7231628702cd4fe59f9bc17f79146195 and project 4b1661af840e4aaaba8cb8ec5e8a4a6a. Resources: dict_keys(['metadata_items']) {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:13:32.656684 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-30b22df6-1f18-4526-930f-cb48fd098e95 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:13:32.657591 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-30b22df6-1f18-4526-930f-cb48fd098e95 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:13:32.658225 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-30b22df6-1f18-4526-930f-cb48fd098e95 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:13:32.658911 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-30b22df6-1f18-4526-930f-cb48fd098e95 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:13:32.659554 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-30b22df6-1f18-4526-930f-cb48fd098e95 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:13:32.675034 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30b22df6-1f18-4526-930f-cb48fd098e95 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:32.676089 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30b22df6-1f18-4526-930f-cb48fd098e95 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:32.676692 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30b22df6-1f18-4526-930f-cb48fd098e95 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:32.677853 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30b22df6-1f18-4526-930f-cb48fd098e95 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:32.678470 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30b22df6-1f18-4526-930f-cb48fd098e95 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:32.679069 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30b22df6-1f18-4526-930f-cb48fd098e95 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:32.700298 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-021af7cd-22b1-4703-b831-150fc297e75e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:32.701154 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-021af7cd-22b1-4703-b831-150fc297e75e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 02c38c79-9670-4d6d-bad7-70953e1ff22b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:32.710292 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-30b22df6-1f18-4526-930f-cb48fd098e95 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Getting quotas for project 4b1661af840e4aaaba8cb8ec5e8a4a6a. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:13:32.714251 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-021af7cd-22b1-4703-b831-150fc297e75e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:32.717252 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-021af7cd-22b1-4703-b831-150fc297e75e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:32.718841 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-021af7cd-22b1-4703-b831-150fc297e75e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:32.719802 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-30b22df6-1f18-4526-930f-cb48fd098e95 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Getting quotas for user 7231628702cd4fe59f9bc17f79146195 and project 4b1661af840e4aaaba8cb8ec5e8a4a6a. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:13:32.721004 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-021af7cd-22b1-4703-b831-150fc297e75e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:32.722242 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-021af7cd-22b1-4703-b831-150fc297e75e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:32.723207 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-021af7cd-22b1-4703-b831-150fc297e75e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:32.741339 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-30b22df6-1f18-4526-930f-cb48fd098e95 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:13:32.745238 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-30b22df6-1f18-4526-930f-cb48fd098e95 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] [instance: ce37d19f-ed04-4e29-8210-62813d7a031d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:13:32.965181 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-30b22df6-1f18-4526-930f-cb48fd098e95 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.612650 Oct 26 13:13:32.974539 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1356/2642] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:13:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 3623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:13:32.993473 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-daee4b6e-6f42-49d5-9697-8460c3d75f74 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '.version_select at 0x7f6731942430>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:33.106065 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-021af7cd-22b1-4703-b831-150fc297e75e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:33.129385 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-021af7cd-22b1-4703-b831-150fc297e75e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/02c38c79-9670-4d6d-bad7-70953e1ff22b" status: 200 len: 1293 microversion: 2.1 time: 0.433220 Oct 26 13:13:33.132942 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-daee4b6e-6f42-49d5-9697-8460c3d75f74 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/images/5776a9e0-e1dd-4524-89a1-d9ff0baf64b1" status: 200 len: 1424 microversion: 2.1 time: 0.155831 Oct 26 13:13:33.134606 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1287/2643] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:32 2022] GET /compute/v2.1/servers/02c38c79-9670-4d6d-bad7-70953e1ff22b => generated 1293 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:13:33.136275 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1357/2644] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:13:32 2022] GET /compute/v2.1/images/5776a9e0-e1dd-4524-89a1-d9ff0baf64b1 => generated 1424 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:33.145217 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a871f5b7-1519-434a-9b3f-007b5f434485 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:33.147369 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a871f5b7-1519-434a-9b3f-007b5f434485 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] [instance: 0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:33.148176 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-62069c58-772e-444f-b3e9-ba2b359d5780 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:33.150254 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-62069c58-772e-444f-b3e9-ba2b359d5780 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] [instance: ce37d19f-ed04-4e29-8210-62813d7a031d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:33.178064 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a871f5b7-1519-434a-9b3f-007b5f434485 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:33.183461 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a871f5b7-1519-434a-9b3f-007b5f434485 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:33.185777 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a871f5b7-1519-434a-9b3f-007b5f434485 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:33.187882 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a871f5b7-1519-434a-9b3f-007b5f434485 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:33.197828 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a871f5b7-1519-434a-9b3f-007b5f434485 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:33.200135 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a871f5b7-1519-434a-9b3f-007b5f434485 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:33.430493 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-62069c58-772e-444f-b3e9-ba2b359d5780 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231628702cd4fe59f9bc17f79146195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1661af840e4aaaba8cb8ec5e8a4a6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:33.440228 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-62069c58-772e-444f-b3e9-ba2b359d5780 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] 10.222.0.40 "GET /compute/v2.1/servers/ce37d19f-ed04-4e29-8210-62813d7a031d" status: 200 len: 1270 microversion: 2.1 time: 0.302673 Oct 26 13:13:33.447531 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1358/2645] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:33 2022] GET /compute/v2.1/servers/ce37d19f-ed04-4e29-8210-62813d7a031d => generated 1270 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:33.455312 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-e54bd9b8-ec24-4467-af11-e0421489f498 req-db15a80c-876f-457e-8956-eb28da139029 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dd070a1-a68f-4c94-9244-d59c94d109f9", "name": "network-vif-plugged", "status": "completed", "tag": "099ba429-75b7-4428-a8bf-6d2540652296"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:13:33.476021 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e54bd9b8-ec24-4467-af11-e0421489f498 req-db15a80c-876f-457e-8956-eb28da139029 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:33.478101 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e54bd9b8-ec24-4467-af11-e0421489f498 req-db15a80c-876f-457e-8956-eb28da139029 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:33.478719 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e54bd9b8-ec24-4467-af11-e0421489f498 req-db15a80c-876f-457e-8956-eb28da139029 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:33.510599 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-e54bd9b8-ec24-4467-af11-e0421489f498 req-db15a80c-876f-457e-8956-eb28da139029 service nova] Creating event network-vif-plugged:099ba429-75b7-4428-a8bf-6d2540652296 for instance 0dd070a1-a68f-4c94-9244-d59c94d109f9 on n-h2-862686-1 Oct 26 13:13:33.522409 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-e54bd9b8-ec24-4467-af11-e0421489f498 req-db15a80c-876f-457e-8956-eb28da139029 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071291 Oct 26 13:13:33.525773 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1359/2646] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:13:33.546864 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4cacb85b-43b8-403a-bde9-989550226c39 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:33.547920 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4cacb85b-43b8-403a-bde9-989550226c39 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 9534d3ef-723b-4f68-b147-9c3aceed8206] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:33.555127 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cacb85b-43b8-403a-bde9-989550226c39 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:33.555858 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cacb85b-43b8-403a-bde9-989550226c39 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:33.556829 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cacb85b-43b8-403a-bde9-989550226c39 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:33.557837 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cacb85b-43b8-403a-bde9-989550226c39 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:33.558687 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cacb85b-43b8-403a-bde9-989550226c39 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:33.560616 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cacb85b-43b8-403a-bde9-989550226c39 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:33.600289 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a871f5b7-1519-434a-9b3f-007b5f434485 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674053f357854715a7035b381e435368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a8f148e91c2419980d161899865d574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:33.612985 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a871f5b7-1519-434a-9b3f-007b5f434485 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] 10.222.0.40 "GET /compute/v2.1/servers/0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44" status: 200 len: 1327 microversion: 2.1 time: 0.476990 Oct 26 13:13:33.616201 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1288/2647] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:33 2022] GET /compute/v2.1/servers/0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44 => generated 1327 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:34.152084 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c05f44df-b627-4a7d-99a6-7a20076ec88b tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '.version_select at 0x7f6732318f70>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:34.251072 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c05f44df-b627-4a7d-99a6-7a20076ec88b tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/images/5776a9e0-e1dd-4524-89a1-d9ff0baf64b1" status: 200 len: 1424 microversion: 2.1 time: 0.101642 Oct 26 13:13:34.253106 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1289/2648] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:13:34 2022] GET /compute/v2.1/images/5776a9e0-e1dd-4524-89a1-d9ff0baf64b1 => generated 1424 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:34.261207 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b2607239-c0a2-4d7f-90c5-b328b7082fe0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:34.261853 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b2607239-c0a2-4d7f-90c5-b328b7082fe0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 02c38c79-9670-4d6d-bad7-70953e1ff22b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:34.278730 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b2607239-c0a2-4d7f-90c5-b328b7082fe0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:34.280132 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b2607239-c0a2-4d7f-90c5-b328b7082fe0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:34.281313 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b2607239-c0a2-4d7f-90c5-b328b7082fe0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:34.282475 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b2607239-c0a2-4d7f-90c5-b328b7082fe0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:34.283255 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b2607239-c0a2-4d7f-90c5-b328b7082fe0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:34.283910 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b2607239-c0a2-4d7f-90c5-b328b7082fe0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:34.399427 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4cacb85b-43b8-403a-bde9-989550226c39 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:34.424326 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4cacb85b-43b8-403a-bde9-989550226c39 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206" status: 200 len: 1504 microversion: 2.1 time: 0.896771 Oct 26 13:13:34.426541 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1360/2649] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:33 2022] GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206 => generated 1504 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:34.481530 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-016fb18b-aad5-483d-b0c7-fce8a44b9d67 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:34.486103 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-016fb18b-aad5-483d-b0c7-fce8a44b9d67 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] [instance: ce37d19f-ed04-4e29-8210-62813d7a031d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:34.523230 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-016fb18b-aad5-483d-b0c7-fce8a44b9d67 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:34.534857 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-016fb18b-aad5-483d-b0c7-fce8a44b9d67 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:34.535527 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-016fb18b-aad5-483d-b0c7-fce8a44b9d67 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:34.536306 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-016fb18b-aad5-483d-b0c7-fce8a44b9d67 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:34.537807 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-016fb18b-aad5-483d-b0c7-fce8a44b9d67 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:34.546255 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-016fb18b-aad5-483d-b0c7-fce8a44b9d67 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:34.634398 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=4 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:13:34.661973 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b2607239-c0a2-4d7f-90c5-b328b7082fe0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:34.686522 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b2607239-c0a2-4d7f-90c5-b328b7082fe0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/02c38c79-9670-4d6d-bad7-70953e1ff22b" status: 200 len: 1473 microversion: 2.1 time: 0.431925 Oct 26 13:13:34.687789 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1290/2650] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:34 2022] GET /compute/v2.1/servers/02c38c79-9670-4d6d-bad7-70953e1ff22b => generated 1473 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:34.695719 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7873d7b1-c59a-4b3d-9591-adb65585eb52 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:34.697761 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7873d7b1-c59a-4b3d-9591-adb65585eb52 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] [instance: 0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:34.708280 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7873d7b1-c59a-4b3d-9591-adb65585eb52 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:34.709079 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7873d7b1-c59a-4b3d-9591-adb65585eb52 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:34.709781 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7873d7b1-c59a-4b3d-9591-adb65585eb52 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:34.722963 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7873d7b1-c59a-4b3d-9591-adb65585eb52 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:34.725122 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7873d7b1-c59a-4b3d-9591-adb65585eb52 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:34.728737 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7873d7b1-c59a-4b3d-9591-adb65585eb52 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:35.118873 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7873d7b1-c59a-4b3d-9591-adb65585eb52 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674053f357854715a7035b381e435368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a8f148e91c2419980d161899865d574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:35.130048 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7873d7b1-c59a-4b3d-9591-adb65585eb52 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] 10.222.0.40 "GET /compute/v2.1/servers/0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44" status: 200 len: 1327 microversion: 2.1 time: 0.439509 Oct 26 13:13:35.131662 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1291/2651] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:34 2022] GET /compute/v2.1/servers/0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44 => generated 1327 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:35.140966 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-eef9189f-b145-449b-9f3d-54773d54096c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1917842009", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:13:35.248464 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-eef9189f-b145-449b-9f3d-54773d54096c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] validate_networks() for [('bc8855c0-63b2-4c3e-b1b8-950c3dd488ef', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:13:35.483444 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-016fb18b-aad5-483d-b0c7-fce8a44b9d67 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231628702cd4fe59f9bc17f79146195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1661af840e4aaaba8cb8ec5e8a4a6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:35.496885 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-016fb18b-aad5-483d-b0c7-fce8a44b9d67 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] 10.222.0.40 "GET /compute/v2.1/servers/ce37d19f-ed04-4e29-8210-62813d7a031d" status: 200 len: 1322 microversion: 2.1 time: 1.030586 Oct 26 13:13:35.500713 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1361/2652] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:34 2022] GET /compute/v2.1/servers/ce37d19f-ed04-4e29-8210-62813d7a031d => generated 1322 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:35.517396 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f94ec3ec-73ba-4095-bbd9-79a153b94d71 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '.version_select at 0x7f67319421f0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:35.633852 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f94ec3ec-73ba-4095-bbd9-79a153b94d71 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/images/5776a9e0-e1dd-4524-89a1-d9ff0baf64b1" status: 200 len: 1424 microversion: 2.1 time: 0.129602 Oct 26 13:13:35.641786 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1362/2653] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:13:35 2022] GET /compute/v2.1/images/5776a9e0-e1dd-4524-89a1-d9ff0baf64b1 => generated 1424 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:35.668179 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ec825066-033c-4cfe-a693-c0f421343987 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:35.673410 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ec825066-033c-4cfe-a693-c0f421343987 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 9534d3ef-723b-4f68-b147-9c3aceed8206] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:35.689587 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec825066-033c-4cfe-a693-c0f421343987 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:35.692692 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec825066-033c-4cfe-a693-c0f421343987 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:35.693138 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec825066-033c-4cfe-a693-c0f421343987 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:35.693946 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec825066-033c-4cfe-a693-c0f421343987 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:35.697166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec825066-033c-4cfe-a693-c0f421343987 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:35.698056 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec825066-033c-4cfe-a693-c0f421343987 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:36.076230 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=12 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:13:37.153902 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ec825066-033c-4cfe-a693-c0f421343987 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:37.167397 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ec825066-033c-4cfe-a693-c0f421343987 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206" status: 200 len: 1504 microversion: 2.1 time: 1.514835 Oct 26 13:13:37.168012 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1363/2654] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:35 2022] GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206 => generated 1504 bytes in 1526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:37.183869 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f42c7ab4-33c3-4a42-83b2-79ad246b4f75 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:37.206560 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f42c7ab4-33c3-4a42-83b2-79ad246b4f75 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] [instance: 0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:37.230918 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f42c7ab4-33c3-4a42-83b2-79ad246b4f75 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:37.236831 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f42c7ab4-33c3-4a42-83b2-79ad246b4f75 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:37.238348 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f42c7ab4-33c3-4a42-83b2-79ad246b4f75 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:37.239913 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f42c7ab4-33c3-4a42-83b2-79ad246b4f75 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:37.240621 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f42c7ab4-33c3-4a42-83b2-79ad246b4f75 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:37.241277 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f42c7ab4-33c3-4a42-83b2-79ad246b4f75 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:38.062747 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f42c7ab4-33c3-4a42-83b2-79ad246b4f75 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674053f357854715a7035b381e435368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a8f148e91c2419980d161899865d574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:38.134019 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f42c7ab4-33c3-4a42-83b2-79ad246b4f75 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] 10.222.0.40 "GET /compute/v2.1/servers/0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44" status: 200 len: 1327 microversion: 2.1 time: 0.952343 Oct 26 13:13:38.149510 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1364/2655] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:37 2022] GET /compute/v2.1/servers/0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44 => generated 1327 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:38.149510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-afdffa4e-1367-4d4f-8182-19265bda6259 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:38.149510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-afdffa4e-1367-4d4f-8182-19265bda6259 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] [instance: ce37d19f-ed04-4e29-8210-62813d7a031d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:38.164579 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afdffa4e-1367-4d4f-8182-19265bda6259 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:38.165266 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afdffa4e-1367-4d4f-8182-19265bda6259 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:38.165764 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afdffa4e-1367-4d4f-8182-19265bda6259 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:38.166485 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afdffa4e-1367-4d4f-8182-19265bda6259 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:38.166949 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afdffa4e-1367-4d4f-8182-19265bda6259 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:38.167377 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afdffa4e-1367-4d4f-8182-19265bda6259 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:38.324773 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-afdffa4e-1367-4d4f-8182-19265bda6259 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231628702cd4fe59f9bc17f79146195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1661af840e4aaaba8cb8ec5e8a4a6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:38.341101 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-afdffa4e-1367-4d4f-8182-19265bda6259 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] 10.222.0.40 "GET /compute/v2.1/servers/ce37d19f-ed04-4e29-8210-62813d7a031d" status: 200 len: 1328 microversion: 2.1 time: 0.204580 Oct 26 13:13:38.344798 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1365/2656] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:38 2022] GET /compute/v2.1/servers/ce37d19f-ed04-4e29-8210-62813d7a031d => generated 1328 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:38.358779 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-24d3443d-207a-450e-837e-447797a9e038 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '.version_select at 0x7f6731991f70>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:38.463103 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-24d3443d-207a-450e-837e-447797a9e038 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/images/5776a9e0-e1dd-4524-89a1-d9ff0baf64b1" status: 200 len: 1424 microversion: 2.1 time: 0.116568 Oct 26 13:13:38.466858 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1366/2657] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:13:38 2022] GET /compute/v2.1/images/5776a9e0-e1dd-4524-89a1-d9ff0baf64b1 => generated 1424 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:38.615410 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-418a199b-aebe-40f0-a1aa-9db22c53e797 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-891282169", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "340efa1a-ce32-4ee5-be29-96387dba2183"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:13:38.820068 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-418a199b-aebe-40f0-a1aa-9db22c53e797 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] validate_networks() for [('340efa1a-ce32-4ee5-be29-96387dba2183', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:13:39.699440 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-eef9189f-b145-449b-9f3d-54773d54096c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:13:39.699980 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-eef9189f-b145-449b-9f3d-54773d54096c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:13:39.700693 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-eef9189f-b145-449b-9f3d-54773d54096c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:13:39.701319 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-eef9189f-b145-449b-9f3d-54773d54096c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:13:39.702949 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-eef9189f-b145-449b-9f3d-54773d54096c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:13:39.729071 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eef9189f-b145-449b-9f3d-54773d54096c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:39.733308 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eef9189f-b145-449b-9f3d-54773d54096c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:39.735748 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eef9189f-b145-449b-9f3d-54773d54096c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:39.738288 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eef9189f-b145-449b-9f3d-54773d54096c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:39.740431 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eef9189f-b145-449b-9f3d-54773d54096c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:39.743678 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eef9189f-b145-449b-9f3d-54773d54096c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:39.816094 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-eef9189f-b145-449b-9f3d-54773d54096c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Getting quotas for project 3f690a680b284d82ac586346427423c3. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:13:39.833600 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-eef9189f-b145-449b-9f3d-54773d54096c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Getting quotas for user fbe30a73a18d49afa07f7a66aee7805d and project 3f690a680b284d82ac586346427423c3. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:13:39.887107 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-eef9189f-b145-449b-9f3d-54773d54096c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:13:39.900434 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-eef9189f-b145-449b-9f3d-54773d54096c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 32577336-ef39-4814-a807-19dd6dcc442b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:13:40.008979 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-eef9189f-b145-449b-9f3d-54773d54096c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.875775 Oct 26 13:13:40.010621 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1292/2658] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:13:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 4878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:13:40.017046 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-86e4a40e-03eb-474a-a097-00135168cbff tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:40.018247 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-86e4a40e-03eb-474a-a097-00135168cbff tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 9534d3ef-723b-4f68-b147-9c3aceed8206] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:40.026364 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-86e4a40e-03eb-474a-a097-00135168cbff tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:40.027426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-86e4a40e-03eb-474a-a097-00135168cbff tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:40.028168 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-86e4a40e-03eb-474a-a097-00135168cbff tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:40.029805 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-86e4a40e-03eb-474a-a097-00135168cbff tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:40.030538 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-86e4a40e-03eb-474a-a097-00135168cbff tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:40.031478 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-86e4a40e-03eb-474a-a097-00135168cbff tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:40.746966 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-418a199b-aebe-40f0-a1aa-9db22c53e797 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:13:40.747531 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-418a199b-aebe-40f0-a1aa-9db22c53e797 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:13:40.749994 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-418a199b-aebe-40f0-a1aa-9db22c53e797 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:13:40.750449 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-418a199b-aebe-40f0-a1aa-9db22c53e797 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:13:40.750903 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-418a199b-aebe-40f0-a1aa-9db22c53e797 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:13:40.792557 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-418a199b-aebe-40f0-a1aa-9db22c53e797 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:40.802338 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-418a199b-aebe-40f0-a1aa-9db22c53e797 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:40.803072 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-418a199b-aebe-40f0-a1aa-9db22c53e797 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:40.805695 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-418a199b-aebe-40f0-a1aa-9db22c53e797 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:40.808499 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-418a199b-aebe-40f0-a1aa-9db22c53e797 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:40.809683 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-418a199b-aebe-40f0-a1aa-9db22c53e797 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:40.841010 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-86e4a40e-03eb-474a-a097-00135168cbff tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:40.877904 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-86e4a40e-03eb-474a-a097-00135168cbff tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206" status: 200 len: 1504 microversion: 2.1 time: 0.858442 Oct 26 13:13:40.882810 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1293/2659] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:40 2022] GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206 => generated 1504 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:40.891420 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-418a199b-aebe-40f0-a1aa-9db22c53e797 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Getting quotas for project 5291f3c81016423cbc1164c82551f648. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:13:40.935850 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-418a199b-aebe-40f0-a1aa-9db22c53e797 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Getting quotas for user 5744e7524e4c4d2c896ce178572ada0c and project 5291f3c81016423cbc1164c82551f648. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:13:40.975333 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-418a199b-aebe-40f0-a1aa-9db22c53e797 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:13:40.984542 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-418a199b-aebe-40f0-a1aa-9db22c53e797 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 9ae69130-8857-4d30-a434-6d8ca54f5cce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:13:41.031407 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-3dc39d16-7322-4824-a292-f826749ffa89 req-9ac08716-937e-403d-9916-7dfc78d7f6c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44", "tag": "ffd97d61-95c2-4db3-bdd2-c4204cd8a9b1"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:13:41.057768 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-3dc39d16-7322-4824-a292-f826749ffa89 req-9ac08716-937e-403d-9916-7dfc78d7f6c6 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:41.066160 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-3dc39d16-7322-4824-a292-f826749ffa89 req-9ac08716-937e-403d-9916-7dfc78d7f6c6 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:41.066720 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-3dc39d16-7322-4824-a292-f826749ffa89 req-9ac08716-937e-403d-9916-7dfc78d7f6c6 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:41.103744 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-418a199b-aebe-40f0-a1aa-9db22c53e797 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.635042 Oct 26 13:13:41.105941 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1367/2660] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:13:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:13:41.115912 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-3dc39d16-7322-4824-a292-f826749ffa89 req-9ac08716-937e-403d-9916-7dfc78d7f6c6 service nova] Creating event network-changed:ffd97d61-95c2-4db3-bdd2-c4204cd8a9b1 for instance 0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44 on n-h1-862686-1 Oct 26 13:13:41.121401 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-32219d8c-2a35-420f-93fd-12ece7768d72 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:41.126210 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-32219d8c-2a35-420f-93fd-12ece7768d72 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] [instance: 0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:41.137576 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-3dc39d16-7322-4824-a292-f826749ffa89 req-9ac08716-937e-403d-9916-7dfc78d7f6c6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.250113 Oct 26 13:13:41.141942 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1294/2661] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:13:41.153941 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32219d8c-2a35-420f-93fd-12ece7768d72 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:41.154464 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32219d8c-2a35-420f-93fd-12ece7768d72 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:41.154954 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32219d8c-2a35-420f-93fd-12ece7768d72 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:41.155680 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32219d8c-2a35-420f-93fd-12ece7768d72 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:41.156185 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32219d8c-2a35-420f-93fd-12ece7768d72 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:41.160244 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32219d8c-2a35-420f-93fd-12ece7768d72 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:41.162643 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ae212a6b-f168-4b6d-9af7-567c2e7e0c91 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:41.168223 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ae212a6b-f168-4b6d-9af7-567c2e7e0c91 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] [instance: ce37d19f-ed04-4e29-8210-62813d7a031d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:41.216003 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae212a6b-f168-4b6d-9af7-567c2e7e0c91 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:41.216508 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae212a6b-f168-4b6d-9af7-567c2e7e0c91 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:41.216958 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae212a6b-f168-4b6d-9af7-567c2e7e0c91 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:41.228796 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae212a6b-f168-4b6d-9af7-567c2e7e0c91 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:41.229402 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae212a6b-f168-4b6d-9af7-567c2e7e0c91 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:41.229881 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae212a6b-f168-4b6d-9af7-567c2e7e0c91 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:41.681061 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-32219d8c-2a35-420f-93fd-12ece7768d72 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674053f357854715a7035b381e435368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a8f148e91c2419980d161899865d574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:41.690027 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-32219d8c-2a35-420f-93fd-12ece7768d72 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] 10.222.0.40 "GET /compute/v2.1/servers/0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44" status: 200 len: 1327 microversion: 2.1 time: 0.579526 Oct 26 13:13:41.709255 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1368/2662] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:41 2022] GET /compute/v2.1/servers/0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44 => generated 1327 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:41.720540 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8cae8fe3-8da5-4d54-8b4e-d7cd17ca7f8b tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '.version_select at 0x7f67369973a0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:42.808096 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ae212a6b-f168-4b6d-9af7-567c2e7e0c91 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231628702cd4fe59f9bc17f79146195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1661af840e4aaaba8cb8ec5e8a4a6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:42.840516 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ae212a6b-f168-4b6d-9af7-567c2e7e0c91 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] 10.222.0.40 "GET /compute/v2.1/servers/ce37d19f-ed04-4e29-8210-62813d7a031d" status: 200 len: 1395 microversion: 2.1 time: 1.674988 Oct 26 13:13:42.855009 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1295/2663] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:41 2022] GET /compute/v2.1/servers/ce37d19f-ed04-4e29-8210-62813d7a031d => generated 1395 bytes in 1712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:42.884415 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7bf44c1a-a74c-463a-916b-19d9fab8aac6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:42.886064 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7bf44c1a-a74c-463a-916b-19d9fab8aac6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 32577336-ef39-4814-a807-19dd6dcc442b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:42.906350 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7bf44c1a-a74c-463a-916b-19d9fab8aac6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:42.907139 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7bf44c1a-a74c-463a-916b-19d9fab8aac6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:42.907749 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7bf44c1a-a74c-463a-916b-19d9fab8aac6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:42.908671 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7bf44c1a-a74c-463a-916b-19d9fab8aac6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:42.909303 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7bf44c1a-a74c-463a-916b-19d9fab8aac6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:42.909949 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7bf44c1a-a74c-463a-916b-19d9fab8aac6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:42.943481 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7bf44c1a-a74c-463a-916b-19d9fab8aac6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 32577336-ef39-4814-a807-19dd6dcc442b] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:13:43.181955 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7bf44c1a-a74c-463a-916b-19d9fab8aac6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "DELETE /compute/v2.1/servers/32577336-ef39-4814-a807-19dd6dcc442b" status: 204 len: 0 microversion: 2.1 time: 0.305449 Oct 26 13:13:43.183084 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1296/2664] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:13:42 2022] DELETE /compute/v2.1/servers/32577336-ef39-4814-a807-19dd6dcc442b => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:13:43.196055 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f3b15ec2-fd87-4674-8746-2a02ee1f915a tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:43.198455 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f3b15ec2-fd87-4674-8746-2a02ee1f915a tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 9ae69130-8857-4d30-a434-6d8ca54f5cce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:43.223347 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3b15ec2-fd87-4674-8746-2a02ee1f915a tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:43.224984 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3b15ec2-fd87-4674-8746-2a02ee1f915a tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:43.225943 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3b15ec2-fd87-4674-8746-2a02ee1f915a tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:43.227706 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3b15ec2-fd87-4674-8746-2a02ee1f915a tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:43.230225 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3b15ec2-fd87-4674-8746-2a02ee1f915a tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:43.231896 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3b15ec2-fd87-4674-8746-2a02ee1f915a tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:43.397995 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f3b15ec2-fd87-4674-8746-2a02ee1f915a tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:43.417970 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f3b15ec2-fd87-4674-8746-2a02ee1f915a tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce" status: 200 len: 1213 microversion: 2.1 time: 0.229272 Oct 26 13:13:43.418908 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1297/2665] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:43 2022] GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce => generated 1213 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:43.454970 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-64533214-d3f4-4f57-8b66-b56b53802794 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:43.455585 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-64533214-d3f4-4f57-8b66-b56b53802794 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 9534d3ef-723b-4f68-b147-9c3aceed8206] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:43.464317 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64533214-d3f4-4f57-8b66-b56b53802794 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:43.464963 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64533214-d3f4-4f57-8b66-b56b53802794 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:43.465806 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64533214-d3f4-4f57-8b66-b56b53802794 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:43.480393 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64533214-d3f4-4f57-8b66-b56b53802794 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:43.481588 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64533214-d3f4-4f57-8b66-b56b53802794 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:43.482111 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64533214-d3f4-4f57-8b66-b56b53802794 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:43.876054 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-64533214-d3f4-4f57-8b66-b56b53802794 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:43.894825 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-64533214-d3f4-4f57-8b66-b56b53802794 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206" status: 200 len: 1504 microversion: 2.1 time: 0.442060 Oct 26 13:13:43.896028 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1298/2666] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:43 2022] GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206 => generated 1504 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:43.909831 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-274ba659-e1f4-40de-a28d-a0e70fd3de7c tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:43.911313 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-274ba659-e1f4-40de-a28d-a0e70fd3de7c tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] [instance: 0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:43.929873 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-274ba659-e1f4-40de-a28d-a0e70fd3de7c tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:43.930687 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-274ba659-e1f4-40de-a28d-a0e70fd3de7c tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:43.931310 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-274ba659-e1f4-40de-a28d-a0e70fd3de7c tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:43.935413 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-274ba659-e1f4-40de-a28d-a0e70fd3de7c tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:43.937755 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-274ba659-e1f4-40de-a28d-a0e70fd3de7c tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:43.940792 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-274ba659-e1f4-40de-a28d-a0e70fd3de7c tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:44.586422 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-274ba659-e1f4-40de-a28d-a0e70fd3de7c tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674053f357854715a7035b381e435368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a8f148e91c2419980d161899865d574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:44.611453 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-274ba659-e1f4-40de-a28d-a0e70fd3de7c tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] 10.222.0.40 "GET /compute/v2.1/servers/0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44" status: 200 len: 1327 microversion: 2.1 time: 0.712293 Oct 26 13:13:44.614047 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1299/2667] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:43 2022] GET /compute/v2.1/servers/0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44 => generated 1327 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:44.626902 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7ba00a30-524b-4eb7-a2ce-fa1a76bda205 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:44.633638 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7ba00a30-524b-4eb7-a2ce-fa1a76bda205 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 32577336-ef39-4814-a807-19dd6dcc442b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:44.662196 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ba00a30-524b-4eb7-a2ce-fa1a76bda205 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:44.662676 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ba00a30-524b-4eb7-a2ce-fa1a76bda205 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:44.663143 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ba00a30-524b-4eb7-a2ce-fa1a76bda205 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:44.663845 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ba00a30-524b-4eb7-a2ce-fa1a76bda205 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:44.664309 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ba00a30-524b-4eb7-a2ce-fa1a76bda205 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:44.664741 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ba00a30-524b-4eb7-a2ce-fa1a76bda205 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:44.931263 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7ba00a30-524b-4eb7-a2ce-fa1a76bda205 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:44.956815 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7ba00a30-524b-4eb7-a2ce-fa1a76bda205 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/32577336-ef39-4814-a807-19dd6dcc442b" status: 200 len: 1211 microversion: 2.1 time: 0.337749 Oct 26 13:13:44.958073 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1300/2668] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:44 2022] GET /compute/v2.1/servers/32577336-ef39-4814-a807-19dd6dcc442b => generated 1211 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:44.978017 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7fbc00e2-b77a-473e-b612-0603cb630c31 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:44.984164 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7fbc00e2-b77a-473e-b612-0603cb630c31 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] [instance: ce37d19f-ed04-4e29-8210-62813d7a031d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:45.002336 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7fbc00e2-b77a-473e-b612-0603cb630c31 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:45.003258 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7fbc00e2-b77a-473e-b612-0603cb630c31 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:45.005758 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7fbc00e2-b77a-473e-b612-0603cb630c31 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:45.006675 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7fbc00e2-b77a-473e-b612-0603cb630c31 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:45.007322 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7fbc00e2-b77a-473e-b612-0603cb630c31 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:45.010277 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7fbc00e2-b77a-473e-b612-0603cb630c31 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:46.093438 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7fbc00e2-b77a-473e-b612-0603cb630c31 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231628702cd4fe59f9bc17f79146195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1661af840e4aaaba8cb8ec5e8a4a6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:46.111708 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7fbc00e2-b77a-473e-b612-0603cb630c31 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] 10.222.0.40 "GET /compute/v2.1/servers/ce37d19f-ed04-4e29-8210-62813d7a031d" status: 200 len: 1395 microversion: 2.1 time: 1.150697 Oct 26 13:13:46.135146 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1301/2669] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:44 2022] GET /compute/v2.1/servers/ce37d19f-ed04-4e29-8210-62813d7a031d => generated 1395 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:46.151046 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f51e57a6-54d4-4ba5-a80c-3f114955b03d tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:46.153475 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f51e57a6-54d4-4ba5-a80c-3f114955b03d tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 9ae69130-8857-4d30-a434-6d8ca54f5cce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:46.174131 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f51e57a6-54d4-4ba5-a80c-3f114955b03d tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:46.176698 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f51e57a6-54d4-4ba5-a80c-3f114955b03d tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:46.179739 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f51e57a6-54d4-4ba5-a80c-3f114955b03d tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:46.182812 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f51e57a6-54d4-4ba5-a80c-3f114955b03d tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:46.184776 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f51e57a6-54d4-4ba5-a80c-3f114955b03d tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:46.186512 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f51e57a6-54d4-4ba5-a80c-3f114955b03d tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:46.255641 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:13:46.421310 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f51e57a6-54d4-4ba5-a80c-3f114955b03d tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:46.457341 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f51e57a6-54d4-4ba5-a80c-3f114955b03d tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce" status: 200 len: 1275 microversion: 2.1 time: 0.318526 Oct 26 13:13:46.458442 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1302/2670] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:46 2022] GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce => generated 1275 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:46.486555 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2a4b554d-19c5-414f-800f-4cd00f800916 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:46.489055 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2a4b554d-19c5-414f-800f-4cd00f800916 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 9534d3ef-723b-4f68-b147-9c3aceed8206] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:46.506476 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2a4b554d-19c5-414f-800f-4cd00f800916 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:46.508603 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2a4b554d-19c5-414f-800f-4cd00f800916 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:46.515512 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2a4b554d-19c5-414f-800f-4cd00f800916 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:46.516802 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2a4b554d-19c5-414f-800f-4cd00f800916 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:46.519079 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2a4b554d-19c5-414f-800f-4cd00f800916 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:46.519823 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2a4b554d-19c5-414f-800f-4cd00f800916 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:48.174488 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2a4b554d-19c5-414f-800f-4cd00f800916 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:48.184678 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2a4b554d-19c5-414f-800f-4cd00f800916 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206" status: 200 len: 1479 microversion: 2.1 time: 1.721850 Oct 26 13:13:48.185271 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1303/2671] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:46 2022] GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206 => generated 1479 bytes in 1723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:48.198739 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5bdeaaa0-4391-43a9-8880-49db77f25d8e tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:48.199360 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5bdeaaa0-4391-43a9-8880-49db77f25d8e tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] [instance: 0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:48.233094 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bdeaaa0-4391-43a9-8880-49db77f25d8e tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:48.238544 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bdeaaa0-4391-43a9-8880-49db77f25d8e tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:48.239084 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bdeaaa0-4391-43a9-8880-49db77f25d8e tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:48.239854 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bdeaaa0-4391-43a9-8880-49db77f25d8e tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:48.240334 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bdeaaa0-4391-43a9-8880-49db77f25d8e tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:48.240772 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bdeaaa0-4391-43a9-8880-49db77f25d8e tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:48.600311 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5bdeaaa0-4391-43a9-8880-49db77f25d8e tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674053f357854715a7035b381e435368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a8f148e91c2419980d161899865d574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:48.621519 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5bdeaaa0-4391-43a9-8880-49db77f25d8e tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] 10.222.0.40 "GET /compute/v2.1/servers/0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44" status: 200 len: 1327 microversion: 2.1 time: 0.430202 Oct 26 13:13:48.629543 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1304/2672] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:48 2022] GET /compute/v2.1/servers/0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44 => generated 1327 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:48.629758 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a01a1713-5c9e-4468-a47e-be4cea0439a5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:48.631187 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a01a1713-5c9e-4468-a47e-be4cea0439a5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 32577336-ef39-4814-a807-19dd6dcc442b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:48.648388 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a01a1713-5c9e-4468-a47e-be4cea0439a5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:48.649160 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a01a1713-5c9e-4468-a47e-be4cea0439a5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:48.649783 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a01a1713-5c9e-4468-a47e-be4cea0439a5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:48.650697 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a01a1713-5c9e-4468-a47e-be4cea0439a5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:48.651301 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a01a1713-5c9e-4468-a47e-be4cea0439a5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:48.652681 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a01a1713-5c9e-4468-a47e-be4cea0439a5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:48.808020 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a01a1713-5c9e-4468-a47e-be4cea0439a5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:48.828301 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a01a1713-5c9e-4468-a47e-be4cea0439a5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/32577336-ef39-4814-a807-19dd6dcc442b" status: 200 len: 1213 microversion: 2.1 time: 0.202309 Oct 26 13:13:48.833006 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1305/2673] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:48 2022] GET /compute/v2.1/servers/32577336-ef39-4814-a807-19dd6dcc442b => generated 1213 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:48.843694 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-d9458636-6132-49ed-87d9-0fe01fcab449 req-799fec34-89f9-4b02-b887-de04228edabc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce37d19f-ed04-4e29-8210-62813d7a031d", "tag": "cd6cbdca-c4c5-42cc-a245-540904c7ed8d"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:13:48.864464 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d9458636-6132-49ed-87d9-0fe01fcab449 req-799fec34-89f9-4b02-b887-de04228edabc service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:48.864464 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d9458636-6132-49ed-87d9-0fe01fcab449 req-799fec34-89f9-4b02-b887-de04228edabc service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:48.864464 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d9458636-6132-49ed-87d9-0fe01fcab449 req-799fec34-89f9-4b02-b887-de04228edabc service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:48.875563 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-d9458636-6132-49ed-87d9-0fe01fcab449 req-799fec34-89f9-4b02-b887-de04228edabc service nova] Creating event network-changed:cd6cbdca-c4c5-42cc-a245-540904c7ed8d for instance ce37d19f-ed04-4e29-8210-62813d7a031d on n-h2-862686-1 Oct 26 13:13:48.886767 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-d9458636-6132-49ed-87d9-0fe01fcab449 req-799fec34-89f9-4b02-b887-de04228edabc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051594 Oct 26 13:13:48.890489 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1306/2674] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:13:48.909569 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a0dd8af0-8174-4238-b955-d591b429d586 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:48.911601 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a0dd8af0-8174-4238-b955-d591b429d586 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] [instance: ce37d19f-ed04-4e29-8210-62813d7a031d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:48.930826 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0dd8af0-8174-4238-b955-d591b429d586 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:48.931337 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0dd8af0-8174-4238-b955-d591b429d586 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:48.931791 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0dd8af0-8174-4238-b955-d591b429d586 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:48.932530 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0dd8af0-8174-4238-b955-d591b429d586 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:48.932993 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0dd8af0-8174-4238-b955-d591b429d586 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:48.933429 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0dd8af0-8174-4238-b955-d591b429d586 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:49.178326 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a0dd8af0-8174-4238-b955-d591b429d586 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231628702cd4fe59f9bc17f79146195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1661af840e4aaaba8cb8ec5e8a4a6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:49.193518 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a0dd8af0-8174-4238-b955-d591b429d586 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] 10.222.0.40 "GET /compute/v2.1/servers/ce37d19f-ed04-4e29-8210-62813d7a031d" status: 200 len: 1395 microversion: 2.1 time: 0.301422 Oct 26 13:13:49.194369 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1307/2675] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:48 2022] GET /compute/v2.1/servers/ce37d19f-ed04-4e29-8210-62813d7a031d => generated 1395 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:49.199555 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e4f4f414-3637-41f2-8997-81d86df262e3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:49.200169 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e4f4f414-3637-41f2-8997-81d86df262e3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 9ae69130-8857-4d30-a434-6d8ca54f5cce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:49.208174 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e4f4f414-3637-41f2-8997-81d86df262e3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:49.208663 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e4f4f414-3637-41f2-8997-81d86df262e3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:49.209256 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e4f4f414-3637-41f2-8997-81d86df262e3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:49.210139 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e4f4f414-3637-41f2-8997-81d86df262e3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:49.210595 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e4f4f414-3637-41f2-8997-81d86df262e3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:49.211022 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e4f4f414-3637-41f2-8997-81d86df262e3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:49.521992 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e4f4f414-3637-41f2-8997-81d86df262e3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:49.535722 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e4f4f414-3637-41f2-8997-81d86df262e3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce" status: 200 len: 1317 microversion: 2.1 time: 0.339956 Oct 26 13:13:49.536327 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1308/2676] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:49 2022] GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce => generated 1317 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:49.561693 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fa8c5685-1a83-4003-abba-3a0f8f87f182 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Calling method '.version_select at 0x7f67323c4820>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:49.565170 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa8c5685-1a83-4003-abba-3a0f8f87f182 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:49.565702 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa8c5685-1a83-4003-abba-3a0f8f87f182 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:49.566260 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa8c5685-1a83-4003-abba-3a0f8f87f182 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:49.609968 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fa8c5685-1a83-4003-abba-3a0f8f87f182 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 785 microversion: 2.1 time: 0.051191 Oct 26 13:13:49.612840 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1309/2677] 10.222.0.40 () {58 vars in 1143 bytes} [Wed Oct 26 13:13:49 2022] GET /compute/v2.1/os-migrations => generated 785 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:13:49.643942 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-dee21318-3f36-4197-a464-abf13c28b009 req-deccb96c-46d6-4e7d-af0b-8bf1e4486e06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44", "name": "network-vif-plugged", "status": "completed", "tag": "ffd97d61-95c2-4db3-bdd2-c4204cd8a9b1"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:13:49.694851 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-dee21318-3f36-4197-a464-abf13c28b009 req-deccb96c-46d6-4e7d-af0b-8bf1e4486e06 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:49.695351 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-dee21318-3f36-4197-a464-abf13c28b009 req-deccb96c-46d6-4e7d-af0b-8bf1e4486e06 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:49.697250 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-dee21318-3f36-4197-a464-abf13c28b009 req-deccb96c-46d6-4e7d-af0b-8bf1e4486e06 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:49.753880 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-dee21318-3f36-4197-a464-abf13c28b009 req-deccb96c-46d6-4e7d-af0b-8bf1e4486e06 service nova] Creating event network-vif-plugged:ffd97d61-95c2-4db3-bdd2-c4204cd8a9b1 for instance 0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44 on n-h1-862686-1 Oct 26 13:13:49.773933 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-dee21318-3f36-4197-a464-abf13c28b009 req-deccb96c-46d6-4e7d-af0b-8bf1e4486e06 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157416 Oct 26 13:13:49.784913 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1310/2678] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:13:49.788019 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:13:49.805070 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-913ce9b5-e12a-4d6b-91e0-22d506d42cc9 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:49.808941 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-913ce9b5-e12a-4d6b-91e0-22d506d42cc9 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] [instance: 9534d3ef-723b-4f68-b147-9c3aceed8206] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:49.831736 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-913ce9b5-e12a-4d6b-91e0-22d506d42cc9 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:49.834811 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-913ce9b5-e12a-4d6b-91e0-22d506d42cc9 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:49.836074 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-913ce9b5-e12a-4d6b-91e0-22d506d42cc9 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:49.844470 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-913ce9b5-e12a-4d6b-91e0-22d506d42cc9 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:49.845977 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-913ce9b5-e12a-4d6b-91e0-22d506d42cc9 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:49.850146 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-913ce9b5-e12a-4d6b-91e0-22d506d42cc9 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:49.902382 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:13:50.493826 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-913ce9b5-e12a-4d6b-91e0-22d506d42cc9 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206" status: 200 len: 1630 microversion: 2.1 time: 0.705971 Oct 26 13:13:50.494413 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1311/2679] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:49 2022] GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206 => generated 1630 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:50.514241 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8cae8fe3-8da5-4d54-8b4e-d7cd17ca7f8b tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/images/5776a9e0-e1dd-4524-89a1-d9ff0baf64b1" status: 200 len: 1433 microversion: 2.1 time: 8.802310 Oct 26 13:13:50.516636 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1369/2680] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:13:41 2022] GET /compute/v2.1/images/5776a9e0-e1dd-4524-89a1-d9ff0baf64b1 => generated 1433 bytes in 8807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:50.536999 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-79c70c15-a8b8-4bff-b855-a9a97c6c9f31 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:50.538105 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dd00ed73-d0f3-4f6f-8b46-90d75c40b320 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:50.538816 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-dd00ed73-d0f3-4f6f-8b46-90d75c40b320 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] [instance: 0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:50.539661 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-79c70c15-a8b8-4bff-b855-a9a97c6c9f31 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 32577336-ef39-4814-a807-19dd6dcc442b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:50.555802 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-79c70c15-a8b8-4bff-b855-a9a97c6c9f31 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:50.556314 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-79c70c15-a8b8-4bff-b855-a9a97c6c9f31 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:50.556758 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-79c70c15-a8b8-4bff-b855-a9a97c6c9f31 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:50.557622 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-79c70c15-a8b8-4bff-b855-a9a97c6c9f31 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:50.558182 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-79c70c15-a8b8-4bff-b855-a9a97c6c9f31 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:50.558634 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-79c70c15-a8b8-4bff-b855-a9a97c6c9f31 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:50.561941 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd00ed73-d0f3-4f6f-8b46-90d75c40b320 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:50.564211 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd00ed73-d0f3-4f6f-8b46-90d75c40b320 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:50.565786 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd00ed73-d0f3-4f6f-8b46-90d75c40b320 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:50.567631 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd00ed73-d0f3-4f6f-8b46-90d75c40b320 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:50.569155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd00ed73-d0f3-4f6f-8b46-90d75c40b320 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:50.572001 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd00ed73-d0f3-4f6f-8b46-90d75c40b320 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:50.579549 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-79c70c15-a8b8-4bff-b855-a9a97c6c9f31 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] HTTP exception thrown: Instance 32577336-ef39-4814-a807-19dd6dcc442b could not be found. Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-79c70c15-a8b8-4bff-b855-a9a97c6c9f31 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Request method failure captured: Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/32577336-ef39-4814-a807-19dd6dcc442b HTTP/1.1 Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTJbgpOJ6_WXapLDSc4DXB2ybbuKvfF9irakf13MnXe_PUvQw0tvwC_KXpEDb02nWk9gKVB2DnChPFFUGp_xOUQaSFHL5E80bTALTu8ZJijTkAv_z2Y1Gdi1cyNAMKmLE7ZnzWq0oDflWXhf1sSJNtguU-rMZFkiGbBps0dj1yOxZiU Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 3f690a680b284d82ac586346427423c3 Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersTestJSON-1612525130 Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3f690a680b284d82ac586346427423c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f690a680b284d82ac586346427423c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3f690a680b284d82ac586346427423c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f690a680b284d82ac586346427423c3"}]}] Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersTestJSON-1612525130 Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 3f690a680b284d82ac586346427423c3 Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersTestJSON-1612525130 Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersTestJSON-1612525130-project Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: fbe30a73a18d49afa07f7a66aee7805d Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersTestJSON-1612525130-project Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 32577336-ef39-4814-a807-19dd6dcc442b could not be found. Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '32577336-ef39-4814-a807-19dd6dcc442b'} Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32577336-ef39-4814-a807-19dd6dcc442b could not be found. Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32577336-ef39-4814-a807-19dd6dcc442b could not be found. Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:13:50.581325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:13:50.588618 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:13:50.588618 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:13:50.588618 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:13:50.588618 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:13:50.588618 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:13:50.588618 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32577336-ef39-4814-a807-19dd6dcc442b could not be found. Oct 26 13:13:50.588618 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:13:50.588618 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-79c70c15-a8b8-4bff-b855-a9a97c6c9f31 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Returning 404 to user: Instance 32577336-ef39-4814-a807-19dd6dcc442b could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:13:50.588618 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-79c70c15-a8b8-4bff-b855-a9a97c6c9f31 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/32577336-ef39-4814-a807-19dd6dcc442b" status: 404 len: 111 microversion: 2.1 time: 0.064911 Oct 26 13:13:50.588618 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1370/2681] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:50 2022] GET /compute/v2.1/servers/32577336-ef39-4814-a807-19dd6dcc442b => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:13:50.590289 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cf9e56df-91d2-4e93-9044-f0961b855cfb tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:50.590589 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cf9e56df-91d2-4e93-9044-f0961b855cfb tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] [instance: ce37d19f-ed04-4e29-8210-62813d7a031d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:50.598081 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf9e56df-91d2-4e93-9044-f0961b855cfb tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:50.599195 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf9e56df-91d2-4e93-9044-f0961b855cfb tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:50.599746 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf9e56df-91d2-4e93-9044-f0961b855cfb tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:50.600853 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf9e56df-91d2-4e93-9044-f0961b855cfb tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:50.601398 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf9e56df-91d2-4e93-9044-f0961b855cfb tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:50.602419 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf9e56df-91d2-4e93-9044-f0961b855cfb tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:50.834694 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-cf9e56df-91d2-4e93-9044-f0961b855cfb tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231628702cd4fe59f9bc17f79146195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1661af840e4aaaba8cb8ec5e8a4a6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:50.852062 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=55 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:13:50.853608 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=4 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:13:50.865354 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cf9e56df-91d2-4e93-9044-f0961b855cfb tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] 10.222.0.40 "GET /compute/v2.1/servers/ce37d19f-ed04-4e29-8210-62813d7a031d" status: 200 len: 1395 microversion: 2.1 time: 0.278415 Oct 26 13:13:50.886613 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1371/2682] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:50 2022] GET /compute/v2.1/servers/ce37d19f-ed04-4e29-8210-62813d7a031d => generated 1395 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:50.905454 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-9ede3f31-85be-4e34-b81d-e4a58efbe7d1 req-f2396d3b-03da-4f28-accf-6feeeb560713 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ae69130-8857-4d30-a434-6d8ca54f5cce", "tag": "874b6621-32e1-4309-945a-0d50400c3292"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:13:50.944915 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9ede3f31-85be-4e34-b81d-e4a58efbe7d1 req-f2396d3b-03da-4f28-accf-6feeeb560713 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:50.945427 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9ede3f31-85be-4e34-b81d-e4a58efbe7d1 req-f2396d3b-03da-4f28-accf-6feeeb560713 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:50.945974 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9ede3f31-85be-4e34-b81d-e4a58efbe7d1 req-f2396d3b-03da-4f28-accf-6feeeb560713 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:50.956061 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-dd00ed73-d0f3-4f6f-8b46-90d75c40b320 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674053f357854715a7035b381e435368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a8f148e91c2419980d161899865d574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:50.958658 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=18 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:13:50.969282 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-dd00ed73-d0f3-4f6f-8b46-90d75c40b320 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] 10.222.0.40 "GET /compute/v2.1/servers/0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44" status: 200 len: 1327 microversion: 2.1 time: 0.455792 Oct 26 13:13:50.973865 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1312/2683] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:50 2022] GET /compute/v2.1/servers/0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44 => generated 1327 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:50.976507 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-9ede3f31-85be-4e34-b81d-e4a58efbe7d1 req-f2396d3b-03da-4f28-accf-6feeeb560713 service nova] Creating event network-changed:874b6621-32e1-4309-945a-0d50400c3292 for instance 9ae69130-8857-4d30-a434-6d8ca54f5cce on n-h1-862686-1 Oct 26 13:13:50.987308 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-9ede3f31-85be-4e34-b81d-e4a58efbe7d1 req-f2396d3b-03da-4f28-accf-6feeeb560713 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092407 Oct 26 13:13:50.989203 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4d72de1d-30a6-4096-9cae-e4be89da3936 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Action: 'create', calling method: .version_select at 0x7f6732daf700>, body: {"keypair": {"name": "tempest-keypair-2033132549", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsut60VP6aWBkcSrWIOu4pZICKiI4dQU0H4QgaSQkan5++RhKhZW9Umsh5mX1l/QyBfoXCAvELS9WNgniZjaiZ+YnUMa0/omC5IwIqsBl/PqPO0pFYK4YoIai65prXlLw=="}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:13:50.989372 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1372/2684] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:13:50.997865 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-affc6596-7a53-45a6-8975-a0848d82e0b2 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '.version_select at 0x7f6736904af0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:51.053298 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-4d72de1d-30a6-4096-9cae-e4be89da3936 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Getting quotas for project 4f1ce8734839480ca6b07416a9c6d9c3. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:13:51.067586 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-4d72de1d-30a6-4096-9cae-e4be89da3936 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Getting quotas for user f96da2e13ca64db2a16d58aee1fc921d and project 4f1ce8734839480ca6b07416a9c6d9c3. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:13:51.068228 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-affc6596-7a53-45a6-8975-a0848d82e0b2 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/images/5776a9e0-e1dd-4524-89a1-d9ff0baf64b1" status: 200 len: 1433 microversion: 2.1 time: 0.077679 Oct 26 13:13:51.068817 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1373/2685] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:13:50 2022] GET /compute/v2.1/images/5776a9e0-e1dd-4524-89a1-d9ff0baf64b1 => generated 1433 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:51.075004 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bc649416-fc2c-40f8-b54a-4be17f0248ee tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:51.075728 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bc649416-fc2c-40f8-b54a-4be17f0248ee tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 9ae69130-8857-4d30-a434-6d8ca54f5cce] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:51.083607 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc649416-fc2c-40f8-b54a-4be17f0248ee tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:51.084465 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc649416-fc2c-40f8-b54a-4be17f0248ee tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:51.085096 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc649416-fc2c-40f8-b54a-4be17f0248ee tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:51.086039 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc649416-fc2c-40f8-b54a-4be17f0248ee tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:51.086660 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc649416-fc2c-40f8-b54a-4be17f0248ee tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:51.087257 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc649416-fc2c-40f8-b54a-4be17f0248ee tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:51.138609 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4d72de1d-30a6-4096-9cae-e4be89da3936 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.162749 Oct 26 13:13:51.151766 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1313/2686] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 13:13:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:13:51.164853 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f934052b-4a06-46d7-a1c5-74e190a4bed8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1179500852", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "bc8855c0-63b2-4c3e-b1b8-950c3dd488ef"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:13:51.323020 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-f934052b-4a06-46d7-a1c5-74e190a4bed8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] validate_networks() for [('bc8855c0-63b2-4c3e-b1b8-950c3dd488ef', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:13:51.429327 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bc649416-fc2c-40f8-b54a-4be17f0248ee tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:51.444882 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bc649416-fc2c-40f8-b54a-4be17f0248ee tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce" status: 200 len: 1317 microversion: 2.1 time: 0.374766 Oct 26 13:13:51.445499 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1374/2687] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:51 2022] GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce => generated 1317 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:51.451846 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d3253366-bb8e-4599-9e6f-8a7f949a73f2 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:51.452542 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d3253366-bb8e-4599-9e6f-8a7f949a73f2 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] [instance: 0dd070a1-a68f-4c94-9244-d59c94d109f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:51.466217 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3253366-bb8e-4599-9e6f-8a7f949a73f2 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:51.467024 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3253366-bb8e-4599-9e6f-8a7f949a73f2 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:51.468161 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3253366-bb8e-4599-9e6f-8a7f949a73f2 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:51.469076 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3253366-bb8e-4599-9e6f-8a7f949a73f2 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:51.469766 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3253366-bb8e-4599-9e6f-8a7f949a73f2 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:51.470194 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3253366-bb8e-4599-9e6f-8a7f949a73f2 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:51.763442 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d3253366-bb8e-4599-9e6f-8a7f949a73f2 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6815934fa00041fba4d2a88b3648eb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fffeaed862d4dfe9abdc2c36a66a0cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:51.780944 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d3253366-bb8e-4599-9e6f-8a7f949a73f2 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9" status: 200 len: 1465 microversion: 2.1 time: 0.331226 Oct 26 13:13:51.781625 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1375/2688] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:51 2022] GET /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9 => generated 1465 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:51.821183 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-126114a3-ab07-46c3-b264-e55fb824d183 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '.version_select at 0x7f6732442040>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:51.909166 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-126114a3-ab07-46c3-b264-e55fb824d183 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/images/762c20f4-0f9b-45cb-bd95-cf21a747b33b" status: 200 len: 784 microversion: 2.1 time: 0.104033 Oct 26 13:13:51.909859 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1376/2689] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:13:51 2022] GET /compute/v2.1/images/762c20f4-0f9b-45cb-bd95-cf21a747b33b => generated 784 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:13:51.923679 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ef06c361-533b-4c13-a238-78804466c073 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:51.924236 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ef06c361-533b-4c13-a238-78804466c073 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] [instance: ce37d19f-ed04-4e29-8210-62813d7a031d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:51.934873 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef06c361-533b-4c13-a238-78804466c073 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:51.936545 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef06c361-533b-4c13-a238-78804466c073 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:51.936998 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef06c361-533b-4c13-a238-78804466c073 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:51.937787 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef06c361-533b-4c13-a238-78804466c073 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:51.938260 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef06c361-533b-4c13-a238-78804466c073 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:51.938703 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef06c361-533b-4c13-a238-78804466c073 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:52.100035 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-f934052b-4a06-46d7-a1c5-74e190a4bed8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:13:52.100515 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-f934052b-4a06-46d7-a1c5-74e190a4bed8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:13:52.100910 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-f934052b-4a06-46d7-a1c5-74e190a4bed8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:13:52.101376 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-f934052b-4a06-46d7-a1c5-74e190a4bed8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:13:52.101834 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-f934052b-4a06-46d7-a1c5-74e190a4bed8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:13:52.114306 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f934052b-4a06-46d7-a1c5-74e190a4bed8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:52.115066 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f934052b-4a06-46d7-a1c5-74e190a4bed8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:52.115509 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f934052b-4a06-46d7-a1c5-74e190a4bed8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:52.117084 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f934052b-4a06-46d7-a1c5-74e190a4bed8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:52.117764 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f934052b-4a06-46d7-a1c5-74e190a4bed8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:52.118714 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f934052b-4a06-46d7-a1c5-74e190a4bed8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:52.142584 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-f934052b-4a06-46d7-a1c5-74e190a4bed8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Getting quotas for project 3f690a680b284d82ac586346427423c3. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:13:52.150621 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-f934052b-4a06-46d7-a1c5-74e190a4bed8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Getting quotas for user fbe30a73a18d49afa07f7a66aee7805d and project 3f690a680b284d82ac586346427423c3. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:13:52.152458 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:13:52.168370 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f934052b-4a06-46d7-a1c5-74e190a4bed8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:13:52.172149 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f934052b-4a06-46d7-a1c5-74e190a4bed8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: a97f1ba5-167d-4b32-a9db-7f68bdb2a255] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:13:52.213962 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ef06c361-533b-4c13-a238-78804466c073 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231628702cd4fe59f9bc17f79146195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1661af840e4aaaba8cb8ec5e8a4a6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:52.223318 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ef06c361-533b-4c13-a238-78804466c073 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] 10.222.0.40 "GET /compute/v2.1/servers/ce37d19f-ed04-4e29-8210-62813d7a031d" status: 200 len: 1395 microversion: 2.1 time: 0.312103 Oct 26 13:13:52.241568 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f934052b-4a06-46d7-a1c5-74e190a4bed8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.088558 Oct 26 13:13:52.249824 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1377/2690] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:51 2022] GET /compute/v2.1/servers/ce37d19f-ed04-4e29-8210-62813d7a031d => generated 1395 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:52.249824 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-36f259c4-9207-4654-8860-657366d3219e tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:52.252542 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1314/2691] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:13:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1100 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:13:52.257982 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-36f259c4-9207-4654-8860-657366d3219e tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013299 Oct 26 13:13:52.258835 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c94275cd-ddc0-4a0d-9cc1-bce4324a0b5a tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:52.260129 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c94275cd-ddc0-4a0d-9cc1-bce4324a0b5a tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] [instance: 0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:52.267058 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1378/2692] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 26 13:13:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:13:52.273687 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-65f893a3-1ea6-4de5-bc87-17eb8125de9b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:52.274672 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-65f893a3-1ea6-4de5-bc87-17eb8125de9b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: a97f1ba5-167d-4b32-a9db-7f68bdb2a255] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:52.285879 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c94275cd-ddc0-4a0d-9cc1-bce4324a0b5a tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:52.289614 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c94275cd-ddc0-4a0d-9cc1-bce4324a0b5a tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:52.289614 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c94275cd-ddc0-4a0d-9cc1-bce4324a0b5a tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:52.289614 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c94275cd-ddc0-4a0d-9cc1-bce4324a0b5a tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:52.290340 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c94275cd-ddc0-4a0d-9cc1-bce4324a0b5a tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:52.290450 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c94275cd-ddc0-4a0d-9cc1-bce4324a0b5a tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:52.395283 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-65f893a3-1ea6-4de5-bc87-17eb8125de9b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:52.403739 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-65f893a3-1ea6-4de5-bc87-17eb8125de9b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/a97f1ba5-167d-4b32-a9db-7f68bdb2a255" status: 200 len: 1221 microversion: 2.1 time: 0.135238 Oct 26 13:13:52.406376 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1379/2693] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:52 2022] GET /compute/v2.1/servers/a97f1ba5-167d-4b32-a9db-7f68bdb2a255 => generated 1221 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:52.415788 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6c343f9b-9f83-43fb-b01e-1a0fa9b36cb9 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '.version_select at 0x7f6732145820>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:52.649200 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c94275cd-ddc0-4a0d-9cc1-bce4324a0b5a tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674053f357854715a7035b381e435368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a8f148e91c2419980d161899865d574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:52.661883 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c94275cd-ddc0-4a0d-9cc1-bce4324a0b5a tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] 10.222.0.40 "GET /compute/v2.1/servers/0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44" status: 200 len: 1526 microversion: 2.1 time: 0.407260 Oct 26 13:13:52.673632 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1315/2694] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:52 2022] GET /compute/v2.1/servers/0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44 => generated 1526 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:52.673632 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-50d85e3c-4d37-418e-8c19-3826e937acae req-287f09c5-58a0-41da-b18a-10b3bcc5ad34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce37d19f-ed04-4e29-8210-62813d7a031d", "name": "network-vif-plugged", "status": "completed", "tag": "cd6cbdca-c4c5-42cc-a245-540904c7ed8d"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:13:52.683762 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-50d85e3c-4d37-418e-8c19-3826e937acae req-287f09c5-58a0-41da-b18a-10b3bcc5ad34 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:52.684234 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-50d85e3c-4d37-418e-8c19-3826e937acae req-287f09c5-58a0-41da-b18a-10b3bcc5ad34 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:52.684608 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-50d85e3c-4d37-418e-8c19-3826e937acae req-287f09c5-58a0-41da-b18a-10b3bcc5ad34 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:52.702843 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-50d85e3c-4d37-418e-8c19-3826e937acae req-287f09c5-58a0-41da-b18a-10b3bcc5ad34 service nova] Creating event network-vif-plugged:cd6cbdca-c4c5-42cc-a245-540904c7ed8d for instance ce37d19f-ed04-4e29-8210-62813d7a031d on n-h2-862686-1 Oct 26 13:13:52.715181 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-50d85e3c-4d37-418e-8c19-3826e937acae req-287f09c5-58a0-41da-b18a-10b3bcc5ad34 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047143 Oct 26 13:13:52.719822 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1316/2695] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:13:52.728361 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d0b81a33-94d4-4cd7-bf82-d6dcedaaedbc tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:52.729066 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d0b81a33-94d4-4cd7-bf82-d6dcedaaedbc tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 9ae69130-8857-4d30-a434-6d8ca54f5cce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:52.739700 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d0b81a33-94d4-4cd7-bf82-d6dcedaaedbc tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:52.741682 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d0b81a33-94d4-4cd7-bf82-d6dcedaaedbc tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:52.743299 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d0b81a33-94d4-4cd7-bf82-d6dcedaaedbc tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:52.744428 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d0b81a33-94d4-4cd7-bf82-d6dcedaaedbc tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:52.745343 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d0b81a33-94d4-4cd7-bf82-d6dcedaaedbc tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:52.746540 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d0b81a33-94d4-4cd7-bf82-d6dcedaaedbc tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:53.128552 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6c343f9b-9f83-43fb-b01e-1a0fa9b36cb9 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "DELETE /compute/v2.1/images/5776a9e0-e1dd-4524-89a1-d9ff0baf64b1" status: 204 len: 0 microversion: 2.1 time: 0.720583 Oct 26 13:13:53.135616 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1380/2696] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:52 2022] DELETE /compute/v2.1/images/5776a9e0-e1dd-4524-89a1-d9ff0baf64b1 => generated 0 bytes in 728 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:13:53.152471 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fcb49b3f-5eed-4cd9-a8df-fb8aa9a2639c tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:53.156731 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fcb49b3f-5eed-4cd9-a8df-fb8aa9a2639c tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] [instance: 0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:53.172175 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fcb49b3f-5eed-4cd9-a8df-fb8aa9a2639c tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:53.173909 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fcb49b3f-5eed-4cd9-a8df-fb8aa9a2639c tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:53.174779 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fcb49b3f-5eed-4cd9-a8df-fb8aa9a2639c tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:53.177657 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fcb49b3f-5eed-4cd9-a8df-fb8aa9a2639c tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:53.178384 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fcb49b3f-5eed-4cd9-a8df-fb8aa9a2639c tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:53.179388 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fcb49b3f-5eed-4cd9-a8df-fb8aa9a2639c tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:53.223204 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d0b81a33-94d4-4cd7-bf82-d6dcedaaedbc tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:53.238321 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d0b81a33-94d4-4cd7-bf82-d6dcedaaedbc tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce" status: 200 len: 1317 microversion: 2.1 time: 0.514161 Oct 26 13:13:53.239516 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1317/2697] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:52 2022] GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce => generated 1317 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:53.250053 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-74f3e9bb-0261-45e2-9c2b-456cb6f271de tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '.version_select at 0x7f6732af9e50>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:53.283645 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-74f3e9bb-0261-45e2-9c2b-456cb6f271de tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] HTTP exception thrown: Image not found. Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-74f3e9bb-0261-45e2-9c2b-456cb6f271de tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Request method failure captured: Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/images/5776a9e0-e1dd-4524-89a1-d9ff0baf64b1 HTTP/1.1 Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTJL5lHYu_BV_ImvUPhmtF9YowoD8VrGQ6jACMWHvb37jk754h0O62bBHoPQi5Gy1PKg3iI5kMBDBUv0iI8qAy8L083ulIiE2f8D9ojNPnpAoRIbEU6GPrsQgaYcQfUcUFIAvwmbCRRUzNJ0dy8ZePj3TJnDq7Jk9f9IlVtEOO9d5eE Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 1fffeaed862d4dfe9abdc2c36a66a0cc Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ImagesOneServerTestJSON-1487843474 Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1fffeaed862d4dfe9abdc2c36a66a0cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fffeaed862d4dfe9abdc2c36a66a0cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1fffeaed862d4dfe9abdc2c36a66a0cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fffeaed862d4dfe9abdc2c36a66a0cc"}]}] Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ImagesOneServerTestJSON-1487843474 Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 1fffeaed862d4dfe9abdc2c36a66a0cc Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1487843474 Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ImagesOneServerTestJSON-1487843474-project Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 6815934fa00041fba4d2a88b3648eb07 Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ImagesOneServerTestJSON-1487843474-project Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: method: Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: exception: Image not found. Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '5776a9e0-e1dd-4524-89a1-d9ff0baf64b1'} Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5776a9e0-e1dd-4524-89a1-d9ff0baf64b1 Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 26 13:13:53.286577 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 26 13:13:53.291316 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 26 13:13:53.291316 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 26 13:13:53.291316 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 26 13:13:53.291316 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 13:13:53.291316 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 13:13:53.291316 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 26 13:13:53.291316 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 26 13:13:53.291316 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 13:13:53.291316 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 13:13:53.291316 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 26 13:13:53.291316 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 26 13:13:53.291316 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 26 13:13:53.291316 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 26 13:13:53.291316 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 13:13:53.291316 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 13:13:53.291316 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 13:13:53.291316 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 13:13:53.291316 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5776a9e0-e1dd-4524-89a1-d9ff0baf64b1 could not be found. Oct 26 13:13:53.291316 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:13:53.291316 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:13:53.291316 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:13:53.291316 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:13:53.291316 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:13:53.291316 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:13:53.291316 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:13:53.291316 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:13:53.291316 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:13:53.291316 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:13:53.291316 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:13:53.291316 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:13:53.291316 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 26 13:13:53.291316 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 26 13:13:53.291316 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 26 13:13:53.291316 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:13:53.291316 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:13:53.291316 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:13:53.291316 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:13:53.291316 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:13:53.291316 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:13:53.291316 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:13:53.291316 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:13:53.291316 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 26 13:13:53.291316 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:13:53.296912 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-74f3e9bb-0261-45e2-9c2b-456cb6f271de tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Returning 404 to user: Image not found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:13:53.298171 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-74f3e9bb-0261-45e2-9c2b-456cb6f271de tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/images/5776a9e0-e1dd-4524-89a1-d9ff0baf64b1" status: 404 len: 62 microversion: 2.1 time: 0.057611 Oct 26 13:13:53.298949 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1318/2698] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:13:53 2022] GET /compute/v2.1/images/5776a9e0-e1dd-4524-89a1-d9ff0baf64b1 => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:13:53.310699 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a8bf7f30-94a4-4cbc-8372-b6a20ade3287 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:53.311564 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a8bf7f30-94a4-4cbc-8372-b6a20ade3287 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] [instance: ce37d19f-ed04-4e29-8210-62813d7a031d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:53.320270 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8bf7f30-94a4-4cbc-8372-b6a20ade3287 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:53.320922 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8bf7f30-94a4-4cbc-8372-b6a20ade3287 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:53.321432 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8bf7f30-94a4-4cbc-8372-b6a20ade3287 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:53.322249 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8bf7f30-94a4-4cbc-8372-b6a20ade3287 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:53.322775 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8bf7f30-94a4-4cbc-8372-b6a20ade3287 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:53.323539 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8bf7f30-94a4-4cbc-8372-b6a20ade3287 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:53.599127 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fcb49b3f-5eed-4cd9-a8df-fb8aa9a2639c tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674053f357854715a7035b381e435368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a8f148e91c2419980d161899865d574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:53.611741 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fcb49b3f-5eed-4cd9-a8df-fb8aa9a2639c tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] 10.222.0.40 "GET /compute/v2.1/servers/0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44" status: 200 len: 1526 microversion: 2.1 time: 0.474377 Oct 26 13:13:53.615059 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1381/2699] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:53 2022] GET /compute/v2.1/servers/0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44 => generated 1526 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:53.620678 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fca05b24-4619-4dcb-b63b-95a3da27696a tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-784463202"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:13:53.624337 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fca05b24-4619-4dcb-b63b-95a3da27696a tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] [instance: 0dd070a1-a68f-4c94-9244-d59c94d109f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:53.634877 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a8bf7f30-94a4-4cbc-8372-b6a20ade3287 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231628702cd4fe59f9bc17f79146195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1661af840e4aaaba8cb8ec5e8a4a6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:53.637686 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fca05b24-4619-4dcb-b63b-95a3da27696a tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:53.640332 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fca05b24-4619-4dcb-b63b-95a3da27696a tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:53.641053 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fca05b24-4619-4dcb-b63b-95a3da27696a tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:53.648663 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a8bf7f30-94a4-4cbc-8372-b6a20ade3287 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] 10.222.0.40 "GET /compute/v2.1/servers/ce37d19f-ed04-4e29-8210-62813d7a031d" status: 200 len: 1395 microversion: 2.1 time: 0.348355 Oct 26 13:13:53.649567 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1319/2700] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:53 2022] GET /compute/v2.1/servers/ce37d19f-ed04-4e29-8210-62813d7a031d => generated 1395 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:53.659322 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cd277653-b9ea-4903-93fe-53ffa01c541c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:53.661855 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cd277653-b9ea-4903-93fe-53ffa01c541c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: a97f1ba5-167d-4b32-a9db-7f68bdb2a255] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:53.667631 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fca05b24-4619-4dcb-b63b-95a3da27696a tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:53.670050 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fca05b24-4619-4dcb-b63b-95a3da27696a tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:53.671515 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fca05b24-4619-4dcb-b63b-95a3da27696a tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:53.676297 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cd277653-b9ea-4903-93fe-53ffa01c541c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:53.677891 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cd277653-b9ea-4903-93fe-53ffa01c541c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:53.678491 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cd277653-b9ea-4903-93fe-53ffa01c541c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:53.680206 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cd277653-b9ea-4903-93fe-53ffa01c541c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:53.681599 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cd277653-b9ea-4903-93fe-53ffa01c541c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:53.683579 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cd277653-b9ea-4903-93fe-53ffa01c541c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:53.784399 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cd277653-b9ea-4903-93fe-53ffa01c541c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:53.798587 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cd277653-b9ea-4903-93fe-53ffa01c541c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/a97f1ba5-167d-4b32-a9db-7f68bdb2a255" status: 200 len: 1273 microversion: 2.1 time: 0.146335 Oct 26 13:13:53.800756 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1320/2701] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:53 2022] GET /compute/v2.1/servers/a97f1ba5-167d-4b32-a9db-7f68bdb2a255 => generated 1273 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:53.909301 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9d266dbe-aa5a-4de8-8818-03b45c615faa tempest-ServersNegativeTestMultiTenantJSON-680785266 tempest-ServersNegativeTestMultiTenantJSON-680785266-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:53.910446 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9d266dbe-aa5a-4de8-8818-03b45c615faa tempest-ServersNegativeTestMultiTenantJSON-680785266 tempest-ServersNegativeTestMultiTenantJSON-680785266-project] [instance: 0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:53.941430 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9d266dbe-aa5a-4de8-8818-03b45c615faa tempest-ServersNegativeTestMultiTenantJSON-680785266 tempest-ServersNegativeTestMultiTenantJSON-680785266-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:53.941987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9d266dbe-aa5a-4de8-8818-03b45c615faa tempest-ServersNegativeTestMultiTenantJSON-680785266 tempest-ServersNegativeTestMultiTenantJSON-680785266-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:53.942578 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9d266dbe-aa5a-4de8-8818-03b45c615faa tempest-ServersNegativeTestMultiTenantJSON-680785266 tempest-ServersNegativeTestMultiTenantJSON-680785266-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:53.943375 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9d266dbe-aa5a-4de8-8818-03b45c615faa tempest-ServersNegativeTestMultiTenantJSON-680785266 tempest-ServersNegativeTestMultiTenantJSON-680785266-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:53.943829 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9d266dbe-aa5a-4de8-8818-03b45c615faa tempest-ServersNegativeTestMultiTenantJSON-680785266 tempest-ServersNegativeTestMultiTenantJSON-680785266-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:53.944247 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9d266dbe-aa5a-4de8-8818-03b45c615faa tempest-ServersNegativeTestMultiTenantJSON-680785266 tempest-ServersNegativeTestMultiTenantJSON-680785266-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:53.981519 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-9d266dbe-aa5a-4de8-8818-03b45c615faa tempest-ServersNegativeTestMultiTenantJSON-680785266 tempest-ServersNegativeTestMultiTenantJSON-680785266-project] HTTP exception thrown: Instance 0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44 could not be found. Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9d266dbe-aa5a-4de8-8818-03b45c615faa tempest-ServersNegativeTestMultiTenantJSON-680785266 tempest-ServersNegativeTestMultiTenantJSON-680785266-project] Request method failure captured: Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/servers/0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44 HTTP/1.1 Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTJvcSoyUftYekG2tvf3sxFNLy3WTtO8aW9tfHQX3SsUvOWSIV-e17L12HWTvo4pwcpVfS6h3l_fVnxEmNWTw2DGUJZ7XCQfhZHL8UQY57LBzuMl2nUgzY-eNzSrZzup8vpkCOZSLyFQHguB-pc4LZtXO8USBRcpwLIwHXHlX1DgmPg Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 70afa9d71745463baf968487253c5de7 Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-680785266 Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/70afa9d71745463baf968487253c5de7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/70afa9d71745463baf968487253c5de7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_70afa9d71745463baf968487253c5de7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/70afa9d71745463baf968487253c5de7"}]}] Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-680785266 Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 70afa9d71745463baf968487253c5de7 Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-680785266 Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersNegativeTestMultiTenantJSON-680785266-project Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 3aeb4c48929341bd9e56b87290bedd1b Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-680785266-project Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44 could not be found. Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44'} Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44 could not be found. Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:13:53.985931 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:13:53.990550 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44 could not be found. Oct 26 13:13:53.990550 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:13:53.990550 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:13:53.990550 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:13:53.990550 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:13:53.990550 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:13:53.990550 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:13:53.990550 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:13:53.990550 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:13:53.990550 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44 could not be found. Oct 26 13:13:53.990550 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:13:53.995967 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9d266dbe-aa5a-4de8-8818-03b45c615faa tempest-ServersNegativeTestMultiTenantJSON-680785266 tempest-ServersNegativeTestMultiTenantJSON-680785266-project] Returning 404 to user: Instance 0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:13:53.997299 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9d266dbe-aa5a-4de8-8818-03b45c615faa tempest-ServersNegativeTestMultiTenantJSON-680785266 tempest-ServersNegativeTestMultiTenantJSON-680785266-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44" status: 404 len: 111 microversion: 2.1 time: 0.195020 Oct 26 13:13:54.000107 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1321/2702] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:13:53 2022] DELETE /compute/v2.1/servers/0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44 => generated 111 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:13:54.028853 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2c114373-8661-4e80-8380-fdc18c7175c4 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:54.029567 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2c114373-8661-4e80-8380-fdc18c7175c4 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] [instance: 0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:54.036561 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2c114373-8661-4e80-8380-fdc18c7175c4 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:54.037054 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2c114373-8661-4e80-8380-fdc18c7175c4 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:54.037718 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2c114373-8661-4e80-8380-fdc18c7175c4 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:54.038724 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2c114373-8661-4e80-8380-fdc18c7175c4 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:54.039416 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2c114373-8661-4e80-8380-fdc18c7175c4 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:54.040137 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2c114373-8661-4e80-8380-fdc18c7175c4 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:54.084928 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fca05b24-4619-4dcb-b63b-95a3da27696a tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "POST /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9/action" status: 202 len: 0 microversion: 2.1 time: 0.465422 Oct 26 13:13:54.086285 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1382/2703] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:13:53 2022] POST /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9/action => generated 0 bytes in 470 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 26 13:13:54.097795 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2da0e67c-4116-41ca-b2c1-47fa60bd7ba5 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '.version_select at 0x7f67319ad280>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:54.177221 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2da0e67c-4116-41ca-b2c1-47fa60bd7ba5 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938" status: 200 len: 1428 microversion: 2.1 time: 0.080389 Oct 26 13:13:54.182479 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1383/2704] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:13:54 2022] GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938 => generated 1428 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:13:54.265526 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e7645120-6d75-4dee-b4c8-30b38df3a830 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:54.267793 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e7645120-6d75-4dee-b4c8-30b38df3a830 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 9ae69130-8857-4d30-a434-6d8ca54f5cce] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:54.288410 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e7645120-6d75-4dee-b4c8-30b38df3a830 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:54.291635 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e7645120-6d75-4dee-b4c8-30b38df3a830 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:54.292373 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e7645120-6d75-4dee-b4c8-30b38df3a830 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:54.293145 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e7645120-6d75-4dee-b4c8-30b38df3a830 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:54.294330 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e7645120-6d75-4dee-b4c8-30b38df3a830 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:54.299934 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e7645120-6d75-4dee-b4c8-30b38df3a830 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:54.444696 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2c114373-8661-4e80-8380-fdc18c7175c4 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674053f357854715a7035b381e435368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a8f148e91c2419980d161899865d574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:54.472879 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2c114373-8661-4e80-8380-fdc18c7175c4 tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] 10.222.0.40 "GET /compute/v2.1/servers/0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44" status: 200 len: 1526 microversion: 2.1 time: 0.448162 Oct 26 13:13:54.473418 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1322/2705] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:54 2022] GET /compute/v2.1/servers/0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44 => generated 1526 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:13:54.526544 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-eb89f3cf-b24a-4dd2-a4b5-64665963effe tempest-ServersNegativeTestMultiTenantJSON-680785266 tempest-ServersNegativeTestMultiTenantJSON-680785266-project] Action: 'update', calling method: >, body: {"server": {"name": "0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44_new"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:13:54.533290 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-eb89f3cf-b24a-4dd2-a4b5-64665963effe tempest-ServersNegativeTestMultiTenantJSON-680785266 tempest-ServersNegativeTestMultiTenantJSON-680785266-project] [instance: 0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:54.537930 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e7645120-6d75-4dee-b4c8-30b38df3a830 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:54.548687 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eb89f3cf-b24a-4dd2-a4b5-64665963effe tempest-ServersNegativeTestMultiTenantJSON-680785266 tempest-ServersNegativeTestMultiTenantJSON-680785266-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:54.549019 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eb89f3cf-b24a-4dd2-a4b5-64665963effe tempest-ServersNegativeTestMultiTenantJSON-680785266 tempest-ServersNegativeTestMultiTenantJSON-680785266-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:54.550611 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eb89f3cf-b24a-4dd2-a4b5-64665963effe tempest-ServersNegativeTestMultiTenantJSON-680785266 tempest-ServersNegativeTestMultiTenantJSON-680785266-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:54.553743 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eb89f3cf-b24a-4dd2-a4b5-64665963effe tempest-ServersNegativeTestMultiTenantJSON-680785266 tempest-ServersNegativeTestMultiTenantJSON-680785266-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:54.554674 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eb89f3cf-b24a-4dd2-a4b5-64665963effe tempest-ServersNegativeTestMultiTenantJSON-680785266 tempest-ServersNegativeTestMultiTenantJSON-680785266-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:54.556096 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e7645120-6d75-4dee-b4c8-30b38df3a830 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce" status: 200 len: 1317 microversion: 2.1 time: 0.291455 Oct 26 13:13:54.558674 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eb89f3cf-b24a-4dd2-a4b5-64665963effe tempest-ServersNegativeTestMultiTenantJSON-680785266 tempest-ServersNegativeTestMultiTenantJSON-680785266-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:54.562307 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1384/2706] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:54 2022] GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce => generated 1317 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:13:54.598271 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-eb89f3cf-b24a-4dd2-a4b5-64665963effe tempest-ServersNegativeTestMultiTenantJSON-680785266 tempest-ServersNegativeTestMultiTenantJSON-680785266-project] HTTP exception thrown: Instance 0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44 could not be found. Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-eb89f3cf-b24a-4dd2-a4b5-64665963effe tempest-ServersNegativeTestMultiTenantJSON-680785266 tempest-ServersNegativeTestMultiTenantJSON-680785266-project] Request method failure captured: Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: request: PUT /compute/v2.1/servers/0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44 HTTP/1.1 Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 64 Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTJvcSoyUftYekG2tvf3sxFNLy3WTtO8aW9tfHQX3SsUvOWSIV-e17L12HWTvo4pwcpVfS6h3l_fVnxEmNWTw2DGUJZ7XCQfhZHL8UQY57LBzuMl2nUgzY-eNzSrZzup8vpkCOZSLyFQHguB-pc4LZtXO8USBRcpwLIwHXHlX1DgmPg Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 70afa9d71745463baf968487253c5de7 Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-680785266 Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/70afa9d71745463baf968487253c5de7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/70afa9d71745463baf968487253c5de7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_70afa9d71745463baf968487253c5de7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/70afa9d71745463baf968487253c5de7"}]}] Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-680785266 Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 70afa9d71745463baf968487253c5de7 Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-680785266 Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersNegativeTestMultiTenantJSON-680785266-project Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 3aeb4c48929341bd9e56b87290bedd1b Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-680785266-project Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: {"server": {"name": "0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44_new"}} Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44 could not be found. Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44', 'body': {'server': {'name': '0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44_new'}}} Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44 could not be found. Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:13:54.600673 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 26 13:13:54.608740 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 26 13:13:54.608740 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 26 13:13:54.608740 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:13:54.608740 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:13:54.608740 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:13:54.608740 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:13:54.608740 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44 could not be found. Oct 26 13:13:54.608740 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:13:54.608740 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:13:54.608740 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:13:54.608740 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:13:54.608740 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:13:54.608740 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:13:54.608740 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:13:54.608740 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:13:54.608740 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44 could not be found. Oct 26 13:13:54.608740 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:13:54.608740 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-eb89f3cf-b24a-4dd2-a4b5-64665963effe tempest-ServersNegativeTestMultiTenantJSON-680785266 tempest-ServersNegativeTestMultiTenantJSON-680785266-project] Returning 404 to user: Instance 0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:13:54.608740 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-eb89f3cf-b24a-4dd2-a4b5-64665963effe tempest-ServersNegativeTestMultiTenantJSON-680785266 tempest-ServersNegativeTestMultiTenantJSON-680785266-project] 10.222.0.40 "PUT /compute/v2.1/servers/0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44" status: 404 len: 111 microversion: 2.1 time: 0.106242 Oct 26 13:13:54.608740 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1323/2707] 10.222.0.40 () {60 vars in 1256 bytes} [Wed Oct 26 13:13:54 2022] PUT /compute/v2.1/servers/0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 13:13:54.617588 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1b888b72-8ea5-4fe7-a8e6-ad4c30b39f9e tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:54.617996 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1b888b72-8ea5-4fe7-a8e6-ad4c30b39f9e tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] [instance: 0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:54.627690 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b888b72-8ea5-4fe7-a8e6-ad4c30b39f9e tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:54.628237 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b888b72-8ea5-4fe7-a8e6-ad4c30b39f9e tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:54.628681 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b888b72-8ea5-4fe7-a8e6-ad4c30b39f9e tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:54.629388 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b888b72-8ea5-4fe7-a8e6-ad4c30b39f9e tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:54.631057 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b888b72-8ea5-4fe7-a8e6-ad4c30b39f9e tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:54.631485 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b888b72-8ea5-4fe7-a8e6-ad4c30b39f9e tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:54.667068 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1b888b72-8ea5-4fe7-a8e6-ad4c30b39f9e tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] [instance: 0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:13:54.675791 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-13036ae0-542c-4cbc-8d6a-bb33bce4cb51 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:54.676727 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-13036ae0-542c-4cbc-8d6a-bb33bce4cb51 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] [instance: ce37d19f-ed04-4e29-8210-62813d7a031d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:54.684778 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-13036ae0-542c-4cbc-8d6a-bb33bce4cb51 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:54.685344 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-13036ae0-542c-4cbc-8d6a-bb33bce4cb51 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:54.686412 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-13036ae0-542c-4cbc-8d6a-bb33bce4cb51 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:54.687506 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-13036ae0-542c-4cbc-8d6a-bb33bce4cb51 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:54.688029 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-13036ae0-542c-4cbc-8d6a-bb33bce4cb51 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:54.688527 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-13036ae0-542c-4cbc-8d6a-bb33bce4cb51 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:54.777265 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1b888b72-8ea5-4fe7-a8e6-ad4c30b39f9e tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44" status: 204 len: 0 microversion: 2.1 time: 0.163558 Oct 26 13:13:54.778008 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1385/2708] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:13:54 2022] DELETE /compute/v2.1/servers/0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:13:54.784838 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-dbcac1f3-49bf-497f-a652-ae09821503d2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-326851994", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "4f5cd804-e666-4be2-8848-0a3733eede9c"}], "security_groups": [{"name": "tempest-securitygroup--154603964"}], "key_name": "tempest-keypair-2033132549", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:13:54.874641 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-13036ae0-542c-4cbc-8d6a-bb33bce4cb51 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231628702cd4fe59f9bc17f79146195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1661af840e4aaaba8cb8ec5e8a4a6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:54.885128 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-13036ae0-542c-4cbc-8d6a-bb33bce4cb51 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] 10.222.0.40 "GET /compute/v2.1/servers/ce37d19f-ed04-4e29-8210-62813d7a031d" status: 200 len: 1576 microversion: 2.1 time: 0.214458 Oct 26 13:13:54.885754 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1324/2709] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:54 2022] GET /compute/v2.1/servers/ce37d19f-ed04-4e29-8210-62813d7a031d => generated 1576 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:13:54.892000 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-105742b8-c1bc-4c90-928d-887f631b537e req-5401caf0-ada8-45e3-be44-3d525bcf15af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dd070a1-a68f-4c94-9244-d59c94d109f9", "name": "network-vif-unplugged", "status": "completed", "tag": "099ba429-75b7-4428-a8bf-6d2540652296"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:13:54.902232 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-105742b8-c1bc-4c90-928d-887f631b537e req-5401caf0-ada8-45e3-be44-3d525bcf15af service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:54.902999 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-105742b8-c1bc-4c90-928d-887f631b537e req-5401caf0-ada8-45e3-be44-3d525bcf15af service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:54.903596 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-105742b8-c1bc-4c90-928d-887f631b537e req-5401caf0-ada8-45e3-be44-3d525bcf15af service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:54.911853 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-dbcac1f3-49bf-497f-a652-ae09821503d2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] validate_networks() for [('4f5cd804-e666-4be2-8848-0a3733eede9c', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:13:54.921914 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-105742b8-c1bc-4c90-928d-887f631b537e req-5401caf0-ada8-45e3-be44-3d525bcf15af service nova] Creating event network-vif-unplugged:099ba429-75b7-4428-a8bf-6d2540652296 for instance 0dd070a1-a68f-4c94-9244-d59c94d109f9 on n-h2-862686-1 Oct 26 13:13:54.928178 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-105742b8-c1bc-4c90-928d-887f631b537e req-5401caf0-ada8-45e3-be44-3d525bcf15af service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040019 Oct 26 13:13:54.929112 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1325/2710] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:13:54.938479 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b2c6a82b-ca14-4309-a5cf-2b9eb9424a5e tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:54.939548 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b2c6a82b-ca14-4309-a5cf-2b9eb9424a5e tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] [instance: 0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:54.946300 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b2c6a82b-ca14-4309-a5cf-2b9eb9424a5e tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:54.946779 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b2c6a82b-ca14-4309-a5cf-2b9eb9424a5e tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:54.947439 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b2c6a82b-ca14-4309-a5cf-2b9eb9424a5e tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:54.948313 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b2c6a82b-ca14-4309-a5cf-2b9eb9424a5e tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:54.948919 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b2c6a82b-ca14-4309-a5cf-2b9eb9424a5e tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:54.949341 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b2c6a82b-ca14-4309-a5cf-2b9eb9424a5e tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:54.970950 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:13:55.142967 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b2c6a82b-ca14-4309-a5cf-2b9eb9424a5e tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674053f357854715a7035b381e435368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a8f148e91c2419980d161899865d574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:55.152118 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b2c6a82b-ca14-4309-a5cf-2b9eb9424a5e tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] 10.222.0.40 "GET /compute/v2.1/servers/0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44" status: 200 len: 1532 microversion: 2.1 time: 0.221699 Oct 26 13:13:55.153077 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1326/2711] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:54 2022] GET /compute/v2.1/servers/0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44 => generated 1532 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:55.158384 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-32cb8655-fddd-40cf-b4df-3184063ac697 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:55.159351 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-32cb8655-fddd-40cf-b4df-3184063ac697 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: a97f1ba5-167d-4b32-a9db-7f68bdb2a255] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:55.166491 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32cb8655-fddd-40cf-b4df-3184063ac697 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:55.167700 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32cb8655-fddd-40cf-b4df-3184063ac697 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:55.168357 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32cb8655-fddd-40cf-b4df-3184063ac697 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:55.169323 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32cb8655-fddd-40cf-b4df-3184063ac697 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:55.171052 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32cb8655-fddd-40cf-b4df-3184063ac697 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:55.171809 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32cb8655-fddd-40cf-b4df-3184063ac697 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:55.259348 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-32cb8655-fddd-40cf-b4df-3184063ac697 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:55.271739 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-32cb8655-fddd-40cf-b4df-3184063ac697 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/a97f1ba5-167d-4b32-a9db-7f68bdb2a255" status: 200 len: 1281 microversion: 2.1 time: 0.117249 Oct 26 13:13:55.273316 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1327/2712] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:55 2022] GET /compute/v2.1/servers/a97f1ba5-167d-4b32-a9db-7f68bdb2a255 => generated 1281 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:55.283198 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-64efbf1f-9886-4219-a66a-1845bea86ebe tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:55.286351 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-64efbf1f-9886-4219-a66a-1845bea86ebe tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] [instance: ce37d19f-ed04-4e29-8210-62813d7a031d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:55.306703 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64efbf1f-9886-4219-a66a-1845bea86ebe tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:55.309886 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64efbf1f-9886-4219-a66a-1845bea86ebe tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:55.309886 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64efbf1f-9886-4219-a66a-1845bea86ebe tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:55.313768 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64efbf1f-9886-4219-a66a-1845bea86ebe tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:55.315274 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64efbf1f-9886-4219-a66a-1845bea86ebe tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:55.317630 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64efbf1f-9886-4219-a66a-1845bea86ebe tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:55.429070 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-dbcac1f3-49bf-497f-a652-ae09821503d2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:13:55.429559 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-dbcac1f3-49bf-497f-a652-ae09821503d2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:13:55.429981 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-dbcac1f3-49bf-497f-a652-ae09821503d2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:13:55.430404 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-dbcac1f3-49bf-497f-a652-ae09821503d2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:13:55.430789 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-dbcac1f3-49bf-497f-a652-ae09821503d2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:13:55.440652 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dbcac1f3-49bf-497f-a652-ae09821503d2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:55.441379 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dbcac1f3-49bf-497f-a652-ae09821503d2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:55.442248 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dbcac1f3-49bf-497f-a652-ae09821503d2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:55.442969 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dbcac1f3-49bf-497f-a652-ae09821503d2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:55.443417 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dbcac1f3-49bf-497f-a652-ae09821503d2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:55.443835 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dbcac1f3-49bf-497f-a652-ae09821503d2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:55.462945 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-dbcac1f3-49bf-497f-a652-ae09821503d2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Getting quotas for project 4f1ce8734839480ca6b07416a9c6d9c3. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:13:55.476072 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-dbcac1f3-49bf-497f-a652-ae09821503d2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Getting quotas for user f96da2e13ca64db2a16d58aee1fc921d and project 4f1ce8734839480ca6b07416a9c6d9c3. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:13:55.487066 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:13:55.491498 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-dbcac1f3-49bf-497f-a652-ae09821503d2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:13:55.493931 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-dbcac1f3-49bf-497f-a652-ae09821503d2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:13:55.545047 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-64efbf1f-9886-4219-a66a-1845bea86ebe tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] 10.222.0.40 "GET /compute/v2.1/servers/ce37d19f-ed04-4e29-8210-62813d7a031d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.268901 Oct 26 13:13:55.546569 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1328/2713] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 26 13:13:55 2022] GET /compute/v2.1/servers/ce37d19f-ed04-4e29-8210-62813d7a031d/os-interface => generated 285 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:13:55.551878 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-72248ab0-7f3e-4749-93ed-831524d6457d tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '.version_select at 0x7f6732af98b0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:55.591599 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-dbcac1f3-49bf-497f-a652-ae09821503d2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.810556 Oct 26 13:13:55.593121 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1386/2714] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:13:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:13:55.617735 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-020006d8-9b6e-4005-a5b1-ef1c6ebb99d4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:55.618488 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-020006d8-9b6e-4005-a5b1-ef1c6ebb99d4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 9ae69130-8857-4d30-a434-6d8ca54f5cce] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:55.621463 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-72248ab0-7f3e-4749-93ed-831524d6457d tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938" status: 200 len: 1428 microversion: 2.1 time: 0.073830 Oct 26 13:13:55.625420 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1329/2715] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:13:55 2022] GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938 => generated 1428 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:55.633180 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-809d320d-757c-4760-95d2-e8124862eac3 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:55.633180 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-809d320d-757c-4760-95d2-e8124862eac3 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:55.638774 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-020006d8-9b6e-4005-a5b1-ef1c6ebb99d4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:55.640931 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-020006d8-9b6e-4005-a5b1-ef1c6ebb99d4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:55.641393 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-020006d8-9b6e-4005-a5b1-ef1c6ebb99d4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:55.644425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-020006d8-9b6e-4005-a5b1-ef1c6ebb99d4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:55.645338 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-020006d8-9b6e-4005-a5b1-ef1c6ebb99d4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:55.645793 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-020006d8-9b6e-4005-a5b1-ef1c6ebb99d4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:55.844778 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-809d320d-757c-4760-95d2-e8124862eac3 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:55.856939 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-809d320d-757c-4760-95d2-e8124862eac3 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c" status: 200 len: 1234 microversion: 2.1 time: 0.230405 Oct 26 13:13:55.857750 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1330/2716] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:55 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c => generated 1234 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:56.089449 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-020006d8-9b6e-4005-a5b1-ef1c6ebb99d4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:56.121317 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-020006d8-9b6e-4005-a5b1-ef1c6ebb99d4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce" status: 200 len: 1317 microversion: 2.1 time: 0.526081 Oct 26 13:13:56.143579 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1387/2717] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:55 2022] GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce => generated 1317 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:56.179798 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2fb6eaf2-4523-4e25-a5f9-ed0c4b25417f tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:56.180414 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2fb6eaf2-4523-4e25-a5f9-ed0c4b25417f tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] [instance: 0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:56.191351 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2fb6eaf2-4523-4e25-a5f9-ed0c4b25417f tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:56.191843 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2fb6eaf2-4523-4e25-a5f9-ed0c4b25417f tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:56.199970 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2fb6eaf2-4523-4e25-a5f9-ed0c4b25417f tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:56.204636 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2fb6eaf2-4523-4e25-a5f9-ed0c4b25417f tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:56.207704 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2fb6eaf2-4523-4e25-a5f9-ed0c4b25417f tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:56.209170 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2fb6eaf2-4523-4e25-a5f9-ed0c4b25417f tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:56.301972 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-99e61277-2d76-41a2-9ffb-2a3229839943 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:56.302612 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-99e61277-2d76-41a2-9ffb-2a3229839943 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: a97f1ba5-167d-4b32-a9db-7f68bdb2a255] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:56.331578 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99e61277-2d76-41a2-9ffb-2a3229839943 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:56.331578 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99e61277-2d76-41a2-9ffb-2a3229839943 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:56.331578 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99e61277-2d76-41a2-9ffb-2a3229839943 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:56.331578 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99e61277-2d76-41a2-9ffb-2a3229839943 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:56.331578 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99e61277-2d76-41a2-9ffb-2a3229839943 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:56.331578 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99e61277-2d76-41a2-9ffb-2a3229839943 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:56.536545 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2fb6eaf2-4523-4e25-a5f9-ed0c4b25417f tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674053f357854715a7035b381e435368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a8f148e91c2419980d161899865d574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:56.547249 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2fb6eaf2-4523-4e25-a5f9-ed0c4b25417f tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] 10.222.0.40 "GET /compute/v2.1/servers/0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44" status: 200 len: 1532 microversion: 2.1 time: 0.371464 Oct 26 13:13:56.547909 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1331/2718] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:56 2022] GET /compute/v2.1/servers/0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44 => generated 1532 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:56.635950 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-99e61277-2d76-41a2-9ffb-2a3229839943 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:56.642432 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-edd09f27-4ba1-4553-ada7-8f0c5c15ca50 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '.version_select at 0x7f6732270430>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:56.656243 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-99e61277-2d76-41a2-9ffb-2a3229839943 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/a97f1ba5-167d-4b32-a9db-7f68bdb2a255" status: 200 len: 1279 microversion: 2.1 time: 0.358787 Oct 26 13:13:56.657422 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1388/2719] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:56 2022] GET /compute/v2.1/servers/a97f1ba5-167d-4b32-a9db-7f68bdb2a255 => generated 1279 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:56.726712 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-edd09f27-4ba1-4553-ada7-8f0c5c15ca50 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938" status: 200 len: 1428 microversion: 2.1 time: 0.088487 Oct 26 13:13:56.736559 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1332/2720] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:13:56 2022] GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938 => generated 1428 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:56.882554 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ed2080bd-caa1-4b18-9082-b743e40e85d6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:56.883582 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ed2080bd-caa1-4b18-9082-b743e40e85d6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:56.912273 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ed2080bd-caa1-4b18-9082-b743e40e85d6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:56.914200 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ed2080bd-caa1-4b18-9082-b743e40e85d6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:56.933088 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ed2080bd-caa1-4b18-9082-b743e40e85d6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:56.938184 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ed2080bd-caa1-4b18-9082-b743e40e85d6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:56.939652 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ed2080bd-caa1-4b18-9082-b743e40e85d6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:56.942296 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ed2080bd-caa1-4b18-9082-b743e40e85d6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:56.979506 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-e7a3a7fc-088a-45ec-a81c-27cd86e38443 req-ce61e4d0-0007-497e-ac6a-17c1a8ad6ebd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ae69130-8857-4d30-a434-6d8ca54f5cce", "name": "network-vif-plugged", "status": "completed", "tag": "874b6621-32e1-4309-945a-0d50400c3292"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:13:57.020559 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-e7a3a7fc-088a-45ec-a81c-27cd86e38443 req-ce61e4d0-0007-497e-ac6a-17c1a8ad6ebd service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:57.021071 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-e7a3a7fc-088a-45ec-a81c-27cd86e38443 req-ce61e4d0-0007-497e-ac6a-17c1a8ad6ebd service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:57.021864 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-e7a3a7fc-088a-45ec-a81c-27cd86e38443 req-ce61e4d0-0007-497e-ac6a-17c1a8ad6ebd service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:57.060634 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-e7a3a7fc-088a-45ec-a81c-27cd86e38443 req-ce61e4d0-0007-497e-ac6a-17c1a8ad6ebd service nova] Creating event network-vif-plugged:874b6621-32e1-4309-945a-0d50400c3292 for instance 9ae69130-8857-4d30-a434-6d8ca54f5cce on n-h1-862686-1 Oct 26 13:13:57.078942 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-e7a3a7fc-088a-45ec-a81c-27cd86e38443 req-ce61e4d0-0007-497e-ac6a-17c1a8ad6ebd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106843 Oct 26 13:13:57.079699 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1333/2721] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:13:57.154831 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ae8a3fad-090c-48f2-8b68-7702db02213b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:57.155636 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ae8a3fad-090c-48f2-8b68-7702db02213b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 9ae69130-8857-4d30-a434-6d8ca54f5cce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:57.177231 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae8a3fad-090c-48f2-8b68-7702db02213b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:57.178039 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae8a3fad-090c-48f2-8b68-7702db02213b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:57.178487 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae8a3fad-090c-48f2-8b68-7702db02213b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:57.179204 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae8a3fad-090c-48f2-8b68-7702db02213b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:57.179730 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae8a3fad-090c-48f2-8b68-7702db02213b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:57.180166 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae8a3fad-090c-48f2-8b68-7702db02213b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:57.273236 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ed2080bd-caa1-4b18-9082-b743e40e85d6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:57.282823 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ed2080bd-caa1-4b18-9082-b743e40e85d6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c" status: 200 len: 1286 microversion: 2.1 time: 0.406328 Oct 26 13:13:57.284091 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1389/2722] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:56 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c => generated 1286 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:57.439854 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ae8a3fad-090c-48f2-8b68-7702db02213b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:57.466676 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ae8a3fad-090c-48f2-8b68-7702db02213b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce" status: 200 len: 1317 microversion: 2.1 time: 0.315789 Oct 26 13:13:57.473231 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1334/2723] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:57 2022] GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce => generated 1317 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:13:57.650367 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e2b501cb-d29d-4bd1-b3fc-313526094aac tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:57.650987 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e2b501cb-d29d-4bd1-b3fc-313526094aac tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] [instance: 0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:57.663119 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e2b501cb-d29d-4bd1-b3fc-313526094aac tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:57.663617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e2b501cb-d29d-4bd1-b3fc-313526094aac tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:57.664061 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e2b501cb-d29d-4bd1-b3fc-313526094aac tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:57.674520 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e2b501cb-d29d-4bd1-b3fc-313526094aac tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:57.675106 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e2b501cb-d29d-4bd1-b3fc-313526094aac tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:57.675563 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e2b501cb-d29d-4bd1-b3fc-313526094aac tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:57.682401 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e47b286e-5225-47b9-b634-02eee062e8e9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:57.683456 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e47b286e-5225-47b9-b634-02eee062e8e9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: a97f1ba5-167d-4b32-a9db-7f68bdb2a255] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:57.697861 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e47b286e-5225-47b9-b634-02eee062e8e9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:57.703384 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e47b286e-5225-47b9-b634-02eee062e8e9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:57.704072 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e47b286e-5225-47b9-b634-02eee062e8e9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:57.705447 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e47b286e-5225-47b9-b634-02eee062e8e9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:57.709974 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e47b286e-5225-47b9-b634-02eee062e8e9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:57.722271 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e47b286e-5225-47b9-b634-02eee062e8e9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:58.134049 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e47b286e-5225-47b9-b634-02eee062e8e9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:58.165998 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e47b286e-5225-47b9-b634-02eee062e8e9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/a97f1ba5-167d-4b32-a9db-7f68bdb2a255" status: 200 len: 1321 microversion: 2.1 time: 0.469867 Oct 26 13:13:58.167919 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1335/2724] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:57 2022] GET /compute/v2.1/servers/a97f1ba5-167d-4b32-a9db-7f68bdb2a255 => generated 1321 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:13:58.175909 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-89b2deca-7c94-4cce-a53c-ea595db31163 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '.version_select at 0x7f673278e4c0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:58.274427 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-89b2deca-7c94-4cce-a53c-ea595db31163 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938" status: 200 len: 1428 microversion: 2.1 time: 0.105148 Oct 26 13:13:58.275253 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1336/2725] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:13:58 2022] GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938 => generated 1428 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:58.300679 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-00bb44b7-50e1-4be7-be3c-492d131409fd req-40d51e74-0f53-4a8c-85c5-0abf8c42f8d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a97f1ba5-167d-4b32-a9db-7f68bdb2a255", "tag": "618f7d0a-f47c-45b1-bf2b-ac8685a06278"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:13:58.325826 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-00bb44b7-50e1-4be7-be3c-492d131409fd req-40d51e74-0f53-4a8c-85c5-0abf8c42f8d0 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:58.326834 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-00bb44b7-50e1-4be7-be3c-492d131409fd req-40d51e74-0f53-4a8c-85c5-0abf8c42f8d0 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:58.327464 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-00bb44b7-50e1-4be7-be3c-492d131409fd req-40d51e74-0f53-4a8c-85c5-0abf8c42f8d0 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:58.347686 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-00bb44b7-50e1-4be7-be3c-492d131409fd req-40d51e74-0f53-4a8c-85c5-0abf8c42f8d0 service nova] Creating event network-changed:618f7d0a-f47c-45b1-bf2b-ac8685a06278 for instance a97f1ba5-167d-4b32-a9db-7f68bdb2a255 on n-h2-862686-1 Oct 26 13:13:58.374611 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-00bb44b7-50e1-4be7-be3c-492d131409fd req-40d51e74-0f53-4a8c-85c5-0abf8c42f8d0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094369 Oct 26 13:13:58.376014 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1337/2726] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:13:58.388888 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4c96e0a1-9fe2-47e4-a109-3a90dd98aea8 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:58.390263 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4c96e0a1-9fe2-47e4-a109-3a90dd98aea8 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:58.407450 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4c96e0a1-9fe2-47e4-a109-3a90dd98aea8 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:58.414105 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4c96e0a1-9fe2-47e4-a109-3a90dd98aea8 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:58.414904 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4c96e0a1-9fe2-47e4-a109-3a90dd98aea8 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:58.415670 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4c96e0a1-9fe2-47e4-a109-3a90dd98aea8 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:58.416290 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4c96e0a1-9fe2-47e4-a109-3a90dd98aea8 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:58.416727 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4c96e0a1-9fe2-47e4-a109-3a90dd98aea8 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:58.574985 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e2b501cb-d29d-4bd1-b3fc-313526094aac tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674053f357854715a7035b381e435368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a8f148e91c2419980d161899865d574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:58.584277 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4c96e0a1-9fe2-47e4-a109-3a90dd98aea8 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:58.599671 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4c96e0a1-9fe2-47e4-a109-3a90dd98aea8 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c" status: 200 len: 1292 microversion: 2.1 time: 0.222166 Oct 26 13:13:58.602231 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1338/2727] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:58 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c => generated 1292 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:58.603050 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e2b501cb-d29d-4bd1-b3fc-313526094aac tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] 10.222.0.40 "GET /compute/v2.1/servers/0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44" status: 200 len: 1532 microversion: 2.1 time: 0.957533 Oct 26 13:13:58.605983 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1390/2728] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:57 2022] GET /compute/v2.1/servers/0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44 => generated 1532 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:13:58.630094 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a8ee4811-d166-40ab-b5f7-9c63fbd0c9a5 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:58.630713 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a8ee4811-d166-40ab-b5f7-9c63fbd0c9a5 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 9ae69130-8857-4d30-a434-6d8ca54f5cce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:58.647459 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8ee4811-d166-40ab-b5f7-9c63fbd0c9a5 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:58.648675 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8ee4811-d166-40ab-b5f7-9c63fbd0c9a5 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:58.651083 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8ee4811-d166-40ab-b5f7-9c63fbd0c9a5 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:58.652737 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8ee4811-d166-40ab-b5f7-9c63fbd0c9a5 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:58.653247 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8ee4811-d166-40ab-b5f7-9c63fbd0c9a5 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:58.653720 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8ee4811-d166-40ab-b5f7-9c63fbd0c9a5 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:59.018827 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-78a49bd7-5e43-424e-b4b1-83a9dd23194d req-100d4176-bdd2-47ba-8691-8015b68ea48e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44", "name": "network-vif-deleted", "tag": "ffd97d61-95c2-4db3-bdd2-c4204cd8a9b1"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:13:59.054530 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-78a49bd7-5e43-424e-b4b1-83a9dd23194d req-100d4176-bdd2-47ba-8691-8015b68ea48e service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:59.056054 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-78a49bd7-5e43-424e-b4b1-83a9dd23194d req-100d4176-bdd2-47ba-8691-8015b68ea48e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:59.059130 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-78a49bd7-5e43-424e-b4b1-83a9dd23194d req-100d4176-bdd2-47ba-8691-8015b68ea48e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:59.111618 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-78a49bd7-5e43-424e-b4b1-83a9dd23194d req-100d4176-bdd2-47ba-8691-8015b68ea48e service nova] Creating event network-vif-deleted:ffd97d61-95c2-4db3-bdd2-c4204cd8a9b1 for instance 0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44 on n-h1-862686-1 Oct 26 13:13:59.142353 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-78a49bd7-5e43-424e-b4b1-83a9dd23194d req-100d4176-bdd2-47ba-8691-8015b68ea48e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135868 Oct 26 13:13:59.144338 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1391/2729] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:13:59.153725 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-f21c345e-0dfa-4c16-bcf3-26e019de9a12 req-44c97414-9b84-4f2b-a87f-984c62e06747 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dd070a1-a68f-4c94-9244-d59c94d109f9", "name": "network-vif-plugged", "status": "completed", "tag": "099ba429-75b7-4428-a8bf-6d2540652296"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:13:59.196556 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f21c345e-0dfa-4c16-bcf3-26e019de9a12 req-44c97414-9b84-4f2b-a87f-984c62e06747 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:59.197316 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f21c345e-0dfa-4c16-bcf3-26e019de9a12 req-44c97414-9b84-4f2b-a87f-984c62e06747 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:59.197960 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f21c345e-0dfa-4c16-bcf3-26e019de9a12 req-44c97414-9b84-4f2b-a87f-984c62e06747 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:59.224478 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-f21c345e-0dfa-4c16-bcf3-26e019de9a12 req-44c97414-9b84-4f2b-a87f-984c62e06747 service nova] Creating event network-vif-plugged:099ba429-75b7-4428-a8bf-6d2540652296 for instance 0dd070a1-a68f-4c94-9244-d59c94d109f9 on n-h2-862686-1 Oct 26 13:13:59.231164 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-f21c345e-0dfa-4c16-bcf3-26e019de9a12 req-44c97414-9b84-4f2b-a87f-984c62e06747 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084845 Oct 26 13:13:59.234887 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1392/2730] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:13:59.242611 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a96c0863-4da4-42f7-a586-d8be9066cd3e tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:59.243905 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a96c0863-4da4-42f7-a586-d8be9066cd3e tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] [instance: ce37d19f-ed04-4e29-8210-62813d7a031d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:59.253149 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a96c0863-4da4-42f7-a586-d8be9066cd3e tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:59.254288 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a96c0863-4da4-42f7-a586-d8be9066cd3e tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:59.255196 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a96c0863-4da4-42f7-a586-d8be9066cd3e tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:59.256644 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a96c0863-4da4-42f7-a586-d8be9066cd3e tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:59.257341 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a96c0863-4da4-42f7-a586-d8be9066cd3e tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:59.258022 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a96c0863-4da4-42f7-a586-d8be9066cd3e tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:59.569559 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a8ee4811-d166-40ab-b5f7-9c63fbd0c9a5 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:59.584842 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a8ee4811-d166-40ab-b5f7-9c63fbd0c9a5 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce" status: 200 len: 1317 microversion: 2.1 time: 0.976802 Oct 26 13:13:59.590208 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1339/2731] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:58 2022] GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce => generated 1317 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:59.618715 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ce1ed117-527b-48a4-9e5e-bfaebd64bd0d tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:13:59.621450 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ce1ed117-527b-48a4-9e5e-bfaebd64bd0d tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: a97f1ba5-167d-4b32-a9db-7f68bdb2a255] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:13:59.668804 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce1ed117-527b-48a4-9e5e-bfaebd64bd0d tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:59.675056 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce1ed117-527b-48a4-9e5e-bfaebd64bd0d tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:59.675529 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce1ed117-527b-48a4-9e5e-bfaebd64bd0d tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:59.676289 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce1ed117-527b-48a4-9e5e-bfaebd64bd0d tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:13:59.676745 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce1ed117-527b-48a4-9e5e-bfaebd64bd0d tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:13:59.687095 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce1ed117-527b-48a4-9e5e-bfaebd64bd0d tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:13:59.803523 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a96c0863-4da4-42f7-a586-d8be9066cd3e tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231628702cd4fe59f9bc17f79146195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1661af840e4aaaba8cb8ec5e8a4a6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:13:59.814453 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a96c0863-4da4-42f7-a586-d8be9066cd3e tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] 10.222.0.40 "GET /compute/v2.1/servers/ce37d19f-ed04-4e29-8210-62813d7a031d" status: 200 len: 1576 microversion: 2.1 time: 0.576301 Oct 26 13:13:59.821278 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1393/2732] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:59 2022] GET /compute/v2.1/servers/ce37d19f-ed04-4e29-8210-62813d7a031d => generated 1576 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:13:59.834015 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ba83d197-1ae8-4d9e-8fff-e112a2923ac2 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '.version_select at 0x7f67318f80d0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:00.036412 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ce1ed117-527b-48a4-9e5e-bfaebd64bd0d tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:00.078128 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ce1ed117-527b-48a4-9e5e-bfaebd64bd0d tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/a97f1ba5-167d-4b32-a9db-7f68bdb2a255" status: 200 len: 1321 microversion: 2.1 time: 0.484854 Oct 26 13:14:00.080762 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1340/2733] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:13:59 2022] GET /compute/v2.1/servers/a97f1ba5-167d-4b32-a9db-7f68bdb2a255 => generated 1321 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:00.114316 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dfb505a8-3038-41fa-9d6b-6745fb67c269 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:00.116279 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-dfb505a8-3038-41fa-9d6b-6745fb67c269 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:00.153989 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dfb505a8-3038-41fa-9d6b-6745fb67c269 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:00.155580 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dfb505a8-3038-41fa-9d6b-6745fb67c269 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:00.157070 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dfb505a8-3038-41fa-9d6b-6745fb67c269 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:00.159123 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dfb505a8-3038-41fa-9d6b-6745fb67c269 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:00.161386 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dfb505a8-3038-41fa-9d6b-6745fb67c269 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:00.163826 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dfb505a8-3038-41fa-9d6b-6745fb67c269 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:00.670556 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-dfb505a8-3038-41fa-9d6b-6745fb67c269 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:00.695282 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-dfb505a8-3038-41fa-9d6b-6745fb67c269 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c" status: 200 len: 1359 microversion: 2.1 time: 0.612706 Oct 26 13:14:00.696182 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1341/2734] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:00 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c => generated 1359 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:00.703137 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6eff084c-d611-4d24-8517-3e675cb5c38d tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:00.704609 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6eff084c-d611-4d24-8517-3e675cb5c38d tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] [instance: 0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:00.711922 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6eff084c-d611-4d24-8517-3e675cb5c38d tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:00.713704 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6eff084c-d611-4d24-8517-3e675cb5c38d tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:00.715185 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6eff084c-d611-4d24-8517-3e675cb5c38d tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:00.716579 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6eff084c-d611-4d24-8517-3e675cb5c38d tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:00.717852 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6eff084c-d611-4d24-8517-3e675cb5c38d tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:00.718309 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6eff084c-d611-4d24-8517-3e675cb5c38d tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:00.751305 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-6eff084c-d611-4d24-8517-3e675cb5c38d tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] HTTP exception thrown: Instance 0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44 could not be found. Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6eff084c-d611-4d24-8517-3e675cb5c38d tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Request method failure captured: Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44 HTTP/1.1 Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTJd_q2Tv-GqT_Xk0sH-DeUpxC-6fiEZZalNj1ESvTSHvwOXg1O0bjMxuA5ecPb6uVtXxnj4mnIlZR9TN21Rj_rohwW5qxuskqQTUXwSOC4_ec0cwfHCiNNSe2gImZQn-VgA0xJx0Rf-0yVOz1AupeOSbeGMcvtWHuxUE67EU4_-QFU Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 6a8f148e91c2419980d161899865d574 Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-171394300 Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6a8f148e91c2419980d161899865d574"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6a8f148e91c2419980d161899865d574"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6a8f148e91c2419980d161899865d574"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6a8f148e91c2419980d161899865d574"}]}] Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-171394300 Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 6a8f148e91c2419980d161899865d574 Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-171394300 Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersNegativeTestMultiTenantJSON-171394300-project Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 674053f357854715a7035b381e435368 Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-171394300-project Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44 could not be found. Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44'} Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44 could not be found. Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44 could not be found. Oct 26 13:14:00.754238 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:14:00.759310 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:14:00.759310 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:14:00.759310 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:14:00.759310 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:14:00.759310 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:14:00.759310 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:14:00.759310 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:14:00.759310 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44 could not be found. Oct 26 13:14:00.759310 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:14:00.761741 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6eff084c-d611-4d24-8517-3e675cb5c38d tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] Returning 404 to user: Instance 0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:14:00.764398 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6eff084c-d611-4d24-8517-3e675cb5c38d tempest-ServersNegativeTestMultiTenantJSON-171394300 tempest-ServersNegativeTestMultiTenantJSON-171394300-project] 10.222.0.40 "GET /compute/v2.1/servers/0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44" status: 404 len: 111 microversion: 2.1 time: 0.066353 Oct 26 13:14:00.765741 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1342/2735] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:00 2022] GET /compute/v2.1/servers/0b8fdcc2-f168-4d94-b3e7-6e4d69d44a44 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:14:00.792133 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e355cf90-5287-48a9-9e91-6754491181fa tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:00.796890 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e355cf90-5287-48a9-9e91-6754491181fa tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 9ae69130-8857-4d30-a434-6d8ca54f5cce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:00.812689 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e355cf90-5287-48a9-9e91-6754491181fa tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:00.814445 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e355cf90-5287-48a9-9e91-6754491181fa tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:00.816637 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e355cf90-5287-48a9-9e91-6754491181fa tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:00.817593 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e355cf90-5287-48a9-9e91-6754491181fa tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:00.818926 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e355cf90-5287-48a9-9e91-6754491181fa tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:00.820861 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e355cf90-5287-48a9-9e91-6754491181fa tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:01.090052 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e355cf90-5287-48a9-9e91-6754491181fa tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:01.099582 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e355cf90-5287-48a9-9e91-6754491181fa tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce" status: 200 len: 1507 microversion: 2.1 time: 0.332379 Oct 26 13:14:01.103109 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1343/2736] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:00 2022] GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce => generated 1507 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:01.123349 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d57f9d1c-e09c-45ce-b076-e4c7a646a25c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:01.124219 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d57f9d1c-e09c-45ce-b076-e4c7a646a25c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: a97f1ba5-167d-4b32-a9db-7f68bdb2a255] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:01.134263 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d57f9d1c-e09c-45ce-b076-e4c7a646a25c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:01.139936 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d57f9d1c-e09c-45ce-b076-e4c7a646a25c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:01.142302 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d57f9d1c-e09c-45ce-b076-e4c7a646a25c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:01.144690 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d57f9d1c-e09c-45ce-b076-e4c7a646a25c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:01.146264 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d57f9d1c-e09c-45ce-b076-e4c7a646a25c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:01.147803 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d57f9d1c-e09c-45ce-b076-e4c7a646a25c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:01.719900 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d57f9d1c-e09c-45ce-b076-e4c7a646a25c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:01.738772 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d57f9d1c-e09c-45ce-b076-e4c7a646a25c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/a97f1ba5-167d-4b32-a9db-7f68bdb2a255" status: 200 len: 1321 microversion: 2.1 time: 0.633305 Oct 26 13:14:01.740380 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1344/2737] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:01 2022] GET /compute/v2.1/servers/a97f1ba5-167d-4b32-a9db-7f68bdb2a255 => generated 1321 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:01.770726 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8f62bdcd-8b7d-4f2e-a6f5-96173e1d282e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:01.772116 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8f62bdcd-8b7d-4f2e-a6f5-96173e1d282e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 9ae69130-8857-4d30-a434-6d8ca54f5cce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:01.781269 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8f62bdcd-8b7d-4f2e-a6f5-96173e1d282e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:01.782080 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8f62bdcd-8b7d-4f2e-a6f5-96173e1d282e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:01.783005 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8f62bdcd-8b7d-4f2e-a6f5-96173e1d282e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:01.784557 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8f62bdcd-8b7d-4f2e-a6f5-96173e1d282e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:01.785156 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8f62bdcd-8b7d-4f2e-a6f5-96173e1d282e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:01.786945 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8f62bdcd-8b7d-4f2e-a6f5-96173e1d282e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:01.854008 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ba83d197-1ae8-4d9e-8fff-e112a2923ac2 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938" status: 200 len: 1428 microversion: 2.1 time: 2.030885 Oct 26 13:14:01.864703 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1394/2738] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:13:59 2022] GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938 => generated 1428 bytes in 2042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:01.870147 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-cfeb2138-a8a2-4a7e-a3ca-291d5a01cd4f req-0f346f76-63a5-4e26-8692-6034902a9fc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce37d19f-ed04-4e29-8210-62813d7a031d", "tag": "cd6cbdca-c4c5-42cc-a245-540904c7ed8d"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:14:01.883294 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-cfeb2138-a8a2-4a7e-a3ca-291d5a01cd4f req-0f346f76-63a5-4e26-8692-6034902a9fc8 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:01.884067 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-cfeb2138-a8a2-4a7e-a3ca-291d5a01cd4f req-0f346f76-63a5-4e26-8692-6034902a9fc8 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:01.885253 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-cfeb2138-a8a2-4a7e-a3ca-291d5a01cd4f req-0f346f76-63a5-4e26-8692-6034902a9fc8 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:01.910234 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:14:01.932938 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-cfeb2138-a8a2-4a7e-a3ca-291d5a01cd4f req-0f346f76-63a5-4e26-8692-6034902a9fc8 service nova] Creating event network-changed:cd6cbdca-c4c5-42cc-a245-540904c7ed8d for instance ce37d19f-ed04-4e29-8210-62813d7a031d on n-h2-862686-1 Oct 26 13:14:01.954062 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-cfeb2138-a8a2-4a7e-a3ca-291d5a01cd4f req-0f346f76-63a5-4e26-8692-6034902a9fc8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087354 Oct 26 13:14:01.955716 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1395/2739] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:14:01.967966 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-32230d7d-c990-4615-b134-77a6ff4ede6f tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:01.971050 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-32230d7d-c990-4615-b134-77a6ff4ede6f tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:01.980597 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32230d7d-c990-4615-b134-77a6ff4ede6f tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:01.991683 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32230d7d-c990-4615-b134-77a6ff4ede6f tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:01.992145 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32230d7d-c990-4615-b134-77a6ff4ede6f tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:01.992905 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32230d7d-c990-4615-b134-77a6ff4ede6f tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:01.999952 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32230d7d-c990-4615-b134-77a6ff4ede6f tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:02.000673 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32230d7d-c990-4615-b134-77a6ff4ede6f tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:02.129150 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:14:02.342016 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-32230d7d-c990-4615-b134-77a6ff4ede6f tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:02.357473 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-32230d7d-c990-4615-b134-77a6ff4ede6f tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c" status: 200 len: 1359 microversion: 2.1 time: 0.400247 Oct 26 13:14:02.373553 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1396/2740] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:01 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c => generated 1359 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:02.769224 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c762ebf3-c764-4991-ae27-ba2dfe537941 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:02.770172 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c762ebf3-c764-4991-ae27-ba2dfe537941 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: a97f1ba5-167d-4b32-a9db-7f68bdb2a255] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:02.783696 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c762ebf3-c764-4991-ae27-ba2dfe537941 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:02.789941 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c762ebf3-c764-4991-ae27-ba2dfe537941 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:02.791783 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c762ebf3-c764-4991-ae27-ba2dfe537941 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:02.794738 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c762ebf3-c764-4991-ae27-ba2dfe537941 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:02.795493 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c762ebf3-c764-4991-ae27-ba2dfe537941 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:02.796128 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c762ebf3-c764-4991-ae27-ba2dfe537941 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:03.462138 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8f62bdcd-8b7d-4f2e-a6f5-96173e1d282e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:03.476519 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8f62bdcd-8b7d-4f2e-a6f5-96173e1d282e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce" status: 200 len: 1507 microversion: 2.1 time: 1.717370 Oct 26 13:14:03.477388 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1345/2741] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:01 2022] GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce => generated 1507 bytes in 1719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:03.490464 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-af46883e-34b5-4265-a08b-a7ab763cc694 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '.version_select at 0x7f6732237820>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:03.591687 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-af46883e-34b5-4265-a08b-a7ab763cc694 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938" status: 200 len: 1428 microversion: 2.1 time: 0.112975 Oct 26 13:14:03.593653 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1346/2742] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:14:03 2022] GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938 => generated 1428 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:03.595954 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c762ebf3-c764-4991-ae27-ba2dfe537941 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:03.610010 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7720e1bb-0d21-4718-ab47-d32f009d54cf tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:03.610670 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7720e1bb-0d21-4718-ab47-d32f009d54cf tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:03.610953 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c762ebf3-c764-4991-ae27-ba2dfe537941 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/a97f1ba5-167d-4b32-a9db-7f68bdb2a255" status: 200 len: 1321 microversion: 2.1 time: 0.846252 Oct 26 13:14:03.615246 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1397/2743] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:02 2022] GET /compute/v2.1/servers/a97f1ba5-167d-4b32-a9db-7f68bdb2a255 => generated 1321 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:14:03.632381 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a5b70c4d-2725-40cf-817f-ff0d48a67270 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:14:03.641448 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a5b70c4d-2725-40cf-817f-ff0d48a67270 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 9ae69130-8857-4d30-a434-6d8ca54f5cce] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:03.642196 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7720e1bb-0d21-4718-ab47-d32f009d54cf tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:03.646343 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7720e1bb-0d21-4718-ab47-d32f009d54cf tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:03.648197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7720e1bb-0d21-4718-ab47-d32f009d54cf tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:03.651657 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7720e1bb-0d21-4718-ab47-d32f009d54cf tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:03.652444 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7720e1bb-0d21-4718-ab47-d32f009d54cf tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:03.656049 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7720e1bb-0d21-4718-ab47-d32f009d54cf tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:03.680894 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5b70c4d-2725-40cf-817f-ff0d48a67270 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:03.684360 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5b70c4d-2725-40cf-817f-ff0d48a67270 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:03.688073 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5b70c4d-2725-40cf-817f-ff0d48a67270 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:03.700610 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5b70c4d-2725-40cf-817f-ff0d48a67270 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:03.702635 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5b70c4d-2725-40cf-817f-ff0d48a67270 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:03.703335 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5b70c4d-2725-40cf-817f-ff0d48a67270 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:03.959043 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-a5b70c4d-2725-40cf-817f-ff0d48a67270 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:14:03.972070 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-a5b70c4d-2725-40cf-817f-ff0d48a67270 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:14:03.975286 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-a5b70c4d-2725-40cf-817f-ff0d48a67270 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:14:03.976403 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-a5b70c4d-2725-40cf-817f-ff0d48a67270 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:14:03.979127 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-a5b70c4d-2725-40cf-817f-ff0d48a67270 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:14:04.136657 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a5b70c4d-2725-40cf-817f-ff0d48a67270 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 9ae69130-8857-4d30-a434-6d8ca54f5cce] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:04.148097 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5b70c4d-2725-40cf-817f-ff0d48a67270 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:04.148873 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5b70c4d-2725-40cf-817f-ff0d48a67270 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:04.149475 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5b70c4d-2725-40cf-817f-ff0d48a67270 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:04.150917 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5b70c4d-2725-40cf-817f-ff0d48a67270 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:04.151533 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5b70c4d-2725-40cf-817f-ff0d48a67270 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:04.152157 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5b70c4d-2725-40cf-817f-ff0d48a67270 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:04.199441 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a5b70c4d-2725-40cf-817f-ff0d48a67270 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "POST /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce/action" status: 202 len: 1109 microversion: 2.1 time: 0.579609 Oct 26 13:14:04.206623 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1398/2744] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:14:03 2022] POST /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce/action => generated 1109 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 26 13:14:04.223209 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-a23e5698-2896-4e17-8379-ffad428018c6 req-e742a55e-20bf-4131-b720-db14d3430eb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e73c452-6277-4845-b64e-e3eca2528e4c", "tag": "48f9022a-e360-40a8-bd91-61687277f232"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:14:04.274968 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-a23e5698-2896-4e17-8379-ffad428018c6 req-e742a55e-20bf-4131-b720-db14d3430eb2 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:04.279044 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-a23e5698-2896-4e17-8379-ffad428018c6 req-e742a55e-20bf-4131-b720-db14d3430eb2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:04.279935 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-a23e5698-2896-4e17-8379-ffad428018c6 req-e742a55e-20bf-4131-b720-db14d3430eb2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:04.312810 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-a23e5698-2896-4e17-8379-ffad428018c6 req-e742a55e-20bf-4131-b720-db14d3430eb2 service nova] Creating event network-changed:48f9022a-e360-40a8-bd91-61687277f232 for instance 5e73c452-6277-4845-b64e-e3eca2528e4c on n-h2-862686-1 Oct 26 13:14:04.343725 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-a23e5698-2896-4e17-8379-ffad428018c6 req-e742a55e-20bf-4131-b720-db14d3430eb2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135273 Oct 26 13:14:04.345216 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1399/2745] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:14:04.364696 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e366a24c-2ca9-499e-b62e-4f439cd7ba5c tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:04.370949 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e366a24c-2ca9-499e-b62e-4f439cd7ba5c tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 9ae69130-8857-4d30-a434-6d8ca54f5cce] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:04.397803 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e366a24c-2ca9-499e-b62e-4f439cd7ba5c tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:04.402241 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e366a24c-2ca9-499e-b62e-4f439cd7ba5c tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:04.403394 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e366a24c-2ca9-499e-b62e-4f439cd7ba5c tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:04.404141 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e366a24c-2ca9-499e-b62e-4f439cd7ba5c tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:04.404737 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e366a24c-2ca9-499e-b62e-4f439cd7ba5c tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:04.405234 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e366a24c-2ca9-499e-b62e-4f439cd7ba5c tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:04.996074 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7720e1bb-0d21-4718-ab47-d32f009d54cf tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:05.012880 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7720e1bb-0d21-4718-ab47-d32f009d54cf tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c" status: 200 len: 1359 microversion: 2.1 time: 1.412819 Oct 26 13:14:05.015281 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1347/2746] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:03 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c => generated 1359 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:05.029086 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1d3db394-8a1a-4c6b-a0f2-8b8703e8730c tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '.version_select at 0x7f673271ddc0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:05.127321 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1d3db394-8a1a-4c6b-a0f2-8b8703e8730c tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938" status: 200 len: 1428 microversion: 2.1 time: 0.110604 Oct 26 13:14:05.134469 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1348/2747] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:14:05 2022] GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938 => generated 1428 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:05.156185 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-190e7b29-1a3b-4d28-84d4-9197b79dceb4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:05.157304 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-190e7b29-1a3b-4d28-84d4-9197b79dceb4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: a97f1ba5-167d-4b32-a9db-7f68bdb2a255] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:05.172451 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-190e7b29-1a3b-4d28-84d4-9197b79dceb4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:05.173264 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-190e7b29-1a3b-4d28-84d4-9197b79dceb4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:05.173909 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-190e7b29-1a3b-4d28-84d4-9197b79dceb4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:05.176429 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-190e7b29-1a3b-4d28-84d4-9197b79dceb4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:05.177373 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-190e7b29-1a3b-4d28-84d4-9197b79dceb4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:05.178723 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-190e7b29-1a3b-4d28-84d4-9197b79dceb4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:05.300041 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e366a24c-2ca9-499e-b62e-4f439cd7ba5c tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:05.311103 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e366a24c-2ca9-499e-b62e-4f439cd7ba5c tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce" status: 200 len: 1514 microversion: 2.1 time: 0.963470 Oct 26 13:14:05.334091 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1400/2748] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:04 2022] GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce => generated 1514 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:05.366271 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-f2cf9a53-7ba0-4ddc-a408-f3c355a7e019 req-dd9a2c23-4ee4-4ed5-bd53-bb4c3fb1210b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a97f1ba5-167d-4b32-a9db-7f68bdb2a255", "name": "network-vif-plugged", "status": "completed", "tag": "618f7d0a-f47c-45b1-bf2b-ac8685a06278"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:14:05.416645 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f2cf9a53-7ba0-4ddc-a408-f3c355a7e019 req-dd9a2c23-4ee4-4ed5-bd53-bb4c3fb1210b service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:05.417155 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f2cf9a53-7ba0-4ddc-a408-f3c355a7e019 req-dd9a2c23-4ee4-4ed5-bd53-bb4c3fb1210b service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:05.417660 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f2cf9a53-7ba0-4ddc-a408-f3c355a7e019 req-dd9a2c23-4ee4-4ed5-bd53-bb4c3fb1210b service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:05.451632 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-f2cf9a53-7ba0-4ddc-a408-f3c355a7e019 req-dd9a2c23-4ee4-4ed5-bd53-bb4c3fb1210b service nova] Creating event network-vif-plugged:618f7d0a-f47c-45b1-bf2b-ac8685a06278 for instance a97f1ba5-167d-4b32-a9db-7f68bdb2a255 on n-h2-862686-1 Oct 26 13:14:05.472021 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-f2cf9a53-7ba0-4ddc-a408-f3c355a7e019 req-dd9a2c23-4ee4-4ed5-bd53-bb4c3fb1210b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124225 Oct 26 13:14:05.474003 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1401/2749] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:14:05.850673 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=12 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:14:06.053869 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-190e7b29-1a3b-4d28-84d4-9197b79dceb4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:06.061589 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0d23df90-1222-4b3f-aaa7-1f84377cec57 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:06.064328 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0d23df90-1222-4b3f-aaa7-1f84377cec57 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:06.071804 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:14:06.075407 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=8 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:14:06.081980 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-190e7b29-1a3b-4d28-84d4-9197b79dceb4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/a97f1ba5-167d-4b32-a9db-7f68bdb2a255" status: 200 len: 1321 microversion: 2.1 time: 0.945700 Oct 26 13:14:06.099620 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1349/2750] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:05 2022] GET /compute/v2.1/servers/a97f1ba5-167d-4b32-a9db-7f68bdb2a255 => generated 1321 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:06.105266 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d23df90-1222-4b3f-aaa7-1f84377cec57 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:06.110591 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d23df90-1222-4b3f-aaa7-1f84377cec57 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:06.111348 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d23df90-1222-4b3f-aaa7-1f84377cec57 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:06.113333 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d23df90-1222-4b3f-aaa7-1f84377cec57 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:06.114235 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d23df90-1222-4b3f-aaa7-1f84377cec57 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:06.114869 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d23df90-1222-4b3f-aaa7-1f84377cec57 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:06.146436 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-36d7b911-c955-4aa0-8522-4e283d98057d tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '.version_select at 0x7f6732daf4c0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:06.222053 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-36d7b911-c955-4aa0-8522-4e283d98057d tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938" status: 200 len: 1428 microversion: 2.1 time: 0.080894 Oct 26 13:14:06.222955 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1350/2751] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:14:06 2022] GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938 => generated 1428 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:06.353547 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bfeaf694-18d2-4194-a3fb-4c57e4f1bd84 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:06.354161 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bfeaf694-18d2-4194-a3fb-4c57e4f1bd84 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 9ae69130-8857-4d30-a434-6d8ca54f5cce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:06.367312 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bfeaf694-18d2-4194-a3fb-4c57e4f1bd84 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:06.367826 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bfeaf694-18d2-4194-a3fb-4c57e4f1bd84 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:06.369210 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bfeaf694-18d2-4194-a3fb-4c57e4f1bd84 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:06.372160 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bfeaf694-18d2-4194-a3fb-4c57e4f1bd84 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:06.372788 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bfeaf694-18d2-4194-a3fb-4c57e4f1bd84 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:06.374557 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bfeaf694-18d2-4194-a3fb-4c57e4f1bd84 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:06.484036 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0d23df90-1222-4b3f-aaa7-1f84377cec57 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:06.494683 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0d23df90-1222-4b3f-aaa7-1f84377cec57 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c" status: 200 len: 1359 microversion: 2.1 time: 0.454647 Oct 26 13:14:06.496085 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1402/2752] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:06 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c => generated 1359 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:06.508184 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e4e53b6d-a54c-49c1-b14e-654e21497c5b tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:06.514757 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e4e53b6d-a54c-49c1-b14e-654e21497c5b tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ea62f9a8c1094cf6810848551cd4fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd40483e170343f5a02795c16d063066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:06.515778 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e4e53b6d-a54c-49c1-b14e-654e21497c5b tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Searching by: {'deleted': False, 'project_id': 'fd40483e170343f5a02795c16d063066'} {{(pid=120598) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:14:06.524634 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4e53b6d-a54c-49c1-b14e-654e21497c5b tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:06.535911 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4e53b6d-a54c-49c1-b14e-654e21497c5b tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:06.539207 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4e53b6d-a54c-49c1-b14e-654e21497c5b tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:06.543495 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4e53b6d-a54c-49c1-b14e-654e21497c5b tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:06.544289 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4e53b6d-a54c-49c1-b14e-654e21497c5b tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:06.545872 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4e53b6d-a54c-49c1-b14e-654e21497c5b tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:06.611904 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.multi_cell_list [None req-e4e53b6d-a54c-49c1-b14e-654e21497c5b tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120598) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 13:14:06.631094 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bfeaf694-18d2-4194-a3fb-4c57e4f1bd84 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:06.643324 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bfeaf694-18d2-4194-a3fb-4c57e4f1bd84 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce" status: 200 len: 1514 microversion: 2.1 time: 0.294195 Oct 26 13:14:06.645473 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1351/2753] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:06 2022] GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce => generated 1514 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:06.672530 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e4e53b6d-a54c-49c1-b14e-654e21497c5b tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.175106 Oct 26 13:14:06.673393 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1403/2754] 10.222.0.40 () {58 vars in 1125 bytes} [Wed Oct 26 13:14:06 2022] GET /compute/v2.1/servers => generated 344 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:14:06.731091 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0f286941-41ac-41e6-963e-ea2e9067373d tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:06.742224 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0f286941-41ac-41e6-963e-ea2e9067373d tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ea62f9a8c1094cf6810848551cd4fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd40483e170343f5a02795c16d063066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:06.743491 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0f286941-41ac-41e6-963e-ea2e9067373d tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Searching by: {'deleted': False, 'project_id': 'fd40483e170343f5a02795c16d063066'} {{(pid=120597) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:14:06.750931 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0f286941-41ac-41e6-963e-ea2e9067373d tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:06.751614 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0f286941-41ac-41e6-963e-ea2e9067373d tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:06.774154 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0f286941-41ac-41e6-963e-ea2e9067373d tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:06.775318 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0f286941-41ac-41e6-963e-ea2e9067373d tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:06.776021 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0f286941-41ac-41e6-963e-ea2e9067373d tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:06.776681 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0f286941-41ac-41e6-963e-ea2e9067373d tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:06.821309 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:14:06.833955 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.multi_cell_list [None req-0f286941-41ac-41e6-963e-ea2e9067373d tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120597) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 13:14:06.959871 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0f286941-41ac-41e6-963e-ea2e9067373d tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea62f9a8c1094cf6810848551cd4fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd40483e170343f5a02795c16d063066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:06.974353 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0f286941-41ac-41e6-963e-ea2e9067373d tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:06.975062 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0f286941-41ac-41e6-963e-ea2e9067373d tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:06.975665 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0f286941-41ac-41e6-963e-ea2e9067373d tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:07.111026 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f18ed575-713d-40fa-b54c-f543ff2b1b16 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:07.111576 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f18ed575-713d-40fa-b54c-f543ff2b1b16 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: a97f1ba5-167d-4b32-a9db-7f68bdb2a255] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:07.128601 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f18ed575-713d-40fa-b54c-f543ff2b1b16 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:07.129096 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f18ed575-713d-40fa-b54c-f543ff2b1b16 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:07.140971 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f18ed575-713d-40fa-b54c-f543ff2b1b16 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:07.141828 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f18ed575-713d-40fa-b54c-f543ff2b1b16 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:07.142335 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f18ed575-713d-40fa-b54c-f543ff2b1b16 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:07.142784 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f18ed575-713d-40fa-b54c-f543ff2b1b16 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:07.200519 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0f286941-41ac-41e6-963e-ea2e9067373d tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] 10.222.0.40 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 0.514701 Oct 26 13:14:07.217537 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1352/2755] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:14:06 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:07.236412 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8a08ef7a-7293-44eb-add7-04e3339a7c61 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:07.250359 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8a08ef7a-7293-44eb-add7-04e3339a7c61 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018899 Oct 26 13:14:07.258903 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1353/2756] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 26 13:14:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:14:07.266435 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0a377129-8be7-47f9-a1a9-cfe5c90a3630 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '.version_select at 0x7f6732e47ee0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:07.356480 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0a377129-8be7-47f9-a1a9-cfe5c90a3630 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938" status: 200 len: 1428 microversion: 2.1 time: 0.096199 Oct 26 13:14:07.357058 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1354/2757] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:14:07 2022] GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938 => generated 1428 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:07.520355 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cf8545b8-1a79-4aab-8f98-4604b5df7dda tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:07.520977 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cf8545b8-1a79-4aab-8f98-4604b5df7dda tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:07.531055 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf8545b8-1a79-4aab-8f98-4604b5df7dda tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:07.532775 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf8545b8-1a79-4aab-8f98-4604b5df7dda tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:07.533443 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf8545b8-1a79-4aab-8f98-4604b5df7dda tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:07.534616 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf8545b8-1a79-4aab-8f98-4604b5df7dda tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:07.536102 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf8545b8-1a79-4aab-8f98-4604b5df7dda tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:07.536930 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf8545b8-1a79-4aab-8f98-4604b5df7dda tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:07.690062 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cf8545b8-1a79-4aab-8f98-4604b5df7dda tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:07.697717 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f18ed575-713d-40fa-b54c-f543ff2b1b16 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:07.698301 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cf8545b8-1a79-4aab-8f98-4604b5df7dda tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c" status: 200 len: 1359 microversion: 2.1 time: 0.181929 Oct 26 13:14:07.699976 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1355/2758] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:07 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:07.706028 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-96eea528-4bb9-4507-a1a4-e6c57b0a22f7 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:07.706653 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-96eea528-4bb9-4507-a1a4-e6c57b0a22f7 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] [instance: 54ffeffd-483c-4d6d-8517-105a666e2402] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:07.711366 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f18ed575-713d-40fa-b54c-f543ff2b1b16 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/a97f1ba5-167d-4b32-a9db-7f68bdb2a255" status: 200 len: 1321 microversion: 2.1 time: 0.603047 Oct 26 13:14:07.712677 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96eea528-4bb9-4507-a1a4-e6c57b0a22f7 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:07.713282 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96eea528-4bb9-4507-a1a4-e6c57b0a22f7 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:07.713797 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96eea528-4bb9-4507-a1a4-e6c57b0a22f7 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:07.714246 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1404/2759] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:07 2022] GET /compute/v2.1/servers/a97f1ba5-167d-4b32-a9db-7f68bdb2a255 => generated 1321 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:07.714640 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96eea528-4bb9-4507-a1a4-e6c57b0a22f7 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:07.715104 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96eea528-4bb9-4507-a1a4-e6c57b0a22f7 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:07.715532 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96eea528-4bb9-4507-a1a4-e6c57b0a22f7 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:07.726245 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e4144717-9663-42f5-bd28-0646a98887c3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:07.727600 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e4144717-9663-42f5-bd28-0646a98887c3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 9ae69130-8857-4d30-a434-6d8ca54f5cce] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:07.742743 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4144717-9663-42f5-bd28-0646a98887c3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:07.745061 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4144717-9663-42f5-bd28-0646a98887c3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:07.747604 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-96eea528-4bb9-4507-a1a4-e6c57b0a22f7 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] [instance: 54ffeffd-483c-4d6d-8517-105a666e2402] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:14:07.755296 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4144717-9663-42f5-bd28-0646a98887c3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:07.758489 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4144717-9663-42f5-bd28-0646a98887c3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:07.759129 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4144717-9663-42f5-bd28-0646a98887c3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:07.760482 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4144717-9663-42f5-bd28-0646a98887c3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:07.920721 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-96eea528-4bb9-4507-a1a4-e6c57b0a22f7 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] 10.222.0.40 "DELETE /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402" status: 204 len: 0 microversion: 2.1 time: 0.217914 Oct 26 13:14:07.926956 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1356/2760] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:14:07 2022] DELETE /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:14:07.938674 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dd33400a-a882-4ed0-a91d-6b3976b3f03b tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:07.939690 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-dd33400a-a882-4ed0-a91d-6b3976b3f03b tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] [instance: 54ffeffd-483c-4d6d-8517-105a666e2402] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:07.949796 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd33400a-a882-4ed0-a91d-6b3976b3f03b tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:07.950527 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd33400a-a882-4ed0-a91d-6b3976b3f03b tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:07.951186 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd33400a-a882-4ed0-a91d-6b3976b3f03b tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:07.952218 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd33400a-a882-4ed0-a91d-6b3976b3f03b tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:07.953353 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd33400a-a882-4ed0-a91d-6b3976b3f03b tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:07.955788 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd33400a-a882-4ed0-a91d-6b3976b3f03b tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:08.083205 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e4144717-9663-42f5-bd28-0646a98887c3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:08.092514 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e4144717-9663-42f5-bd28-0646a98887c3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce" status: 200 len: 1514 microversion: 2.1 time: 0.376458 Oct 26 13:14:08.093644 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1405/2761] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:07 2022] GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce => generated 1514 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:08.374393 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-82d960f1-5eeb-40bb-aeae-3b74a772c301 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '.version_select at 0x7f67318f6d30>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:08.485962 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-82d960f1-5eeb-40bb-aeae-3b74a772c301 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938" status: 200 len: 1428 microversion: 2.1 time: 0.115550 Oct 26 13:14:08.488109 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1406/2762] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:14:08 2022] GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938 => generated 1428 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:08.725357 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-10bc2763-4c7c-46aa-b7f4-4f31697ee76c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:08.726033 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-10bc2763-4c7c-46aa-b7f4-4f31697ee76c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:08.740842 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10bc2763-4c7c-46aa-b7f4-4f31697ee76c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:08.746336 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10bc2763-4c7c-46aa-b7f4-4f31697ee76c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:08.747388 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10bc2763-4c7c-46aa-b7f4-4f31697ee76c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:08.748296 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10bc2763-4c7c-46aa-b7f4-4f31697ee76c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:08.748799 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10bc2763-4c7c-46aa-b7f4-4f31697ee76c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:08.758304 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10bc2763-4c7c-46aa-b7f4-4f31697ee76c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:08.974401 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-dd33400a-a882-4ed0-a91d-6b3976b3f03b tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea62f9a8c1094cf6810848551cd4fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd40483e170343f5a02795c16d063066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:08.986599 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-dd33400a-a882-4ed0-a91d-6b3976b3f03b tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] 10.222.0.40 "GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402" status: 200 len: 1608 microversion: 2.1 time: 1.054294 Oct 26 13:14:08.987222 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1357/2763] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:07 2022] GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402 => generated 1608 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:14:08.992003 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fa0b5607-9fe8-41ff-b03d-af07545bb902 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:08.997077 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fa0b5607-9fe8-41ff-b03d-af07545bb902 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: a97f1ba5-167d-4b32-a9db-7f68bdb2a255] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:09.011758 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa0b5607-9fe8-41ff-b03d-af07545bb902 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:09.018734 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa0b5607-9fe8-41ff-b03d-af07545bb902 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:09.019491 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa0b5607-9fe8-41ff-b03d-af07545bb902 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:09.020702 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa0b5607-9fe8-41ff-b03d-af07545bb902 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:09.021363 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa0b5607-9fe8-41ff-b03d-af07545bb902 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:09.021995 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa0b5607-9fe8-41ff-b03d-af07545bb902 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:09.123937 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-10bc2763-4c7c-46aa-b7f4-4f31697ee76c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:09.138196 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-10bc2763-4c7c-46aa-b7f4-4f31697ee76c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c" status: 200 len: 1359 microversion: 2.1 time: 0.417361 Oct 26 13:14:09.138875 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1407/2764] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:08 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c => generated 1359 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:09.154636 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-da259a8c-47a2-4804-b0c5-0feeade736ec tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:09.155277 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-da259a8c-47a2-4804-b0c5-0feeade736ec tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 9ae69130-8857-4d30-a434-6d8ca54f5cce] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:09.169511 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da259a8c-47a2-4804-b0c5-0feeade736ec tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:09.171276 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da259a8c-47a2-4804-b0c5-0feeade736ec tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:09.171777 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da259a8c-47a2-4804-b0c5-0feeade736ec tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:09.175998 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da259a8c-47a2-4804-b0c5-0feeade736ec tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:09.176518 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da259a8c-47a2-4804-b0c5-0feeade736ec tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:09.176970 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da259a8c-47a2-4804-b0c5-0feeade736ec tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:09.314134 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fa0b5607-9fe8-41ff-b03d-af07545bb902 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:09.324977 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fa0b5607-9fe8-41ff-b03d-af07545bb902 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/a97f1ba5-167d-4b32-a9db-7f68bdb2a255" status: 200 len: 1500 microversion: 2.1 time: 0.336538 Oct 26 13:14:09.347267 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1358/2765] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:08 2022] GET /compute/v2.1/servers/a97f1ba5-167d-4b32-a9db-7f68bdb2a255 => generated 1500 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:09.355494 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-96fbae51-bafe-4cee-aa5c-86d6e179c2ac tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:09.363281 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-96fbae51-bafe-4cee-aa5c-86d6e179c2ac tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: a97f1ba5-167d-4b32-a9db-7f68bdb2a255] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:09.376809 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96fbae51-bafe-4cee-aa5c-86d6e179c2ac tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:09.381151 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96fbae51-bafe-4cee-aa5c-86d6e179c2ac tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:09.381896 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96fbae51-bafe-4cee-aa5c-86d6e179c2ac tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:09.382838 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96fbae51-bafe-4cee-aa5c-86d6e179c2ac tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:09.384089 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96fbae51-bafe-4cee-aa5c-86d6e179c2ac tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:09.388245 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96fbae51-bafe-4cee-aa5c-86d6e179c2ac tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:09.500819 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-da259a8c-47a2-4804-b0c5-0feeade736ec tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:09.512377 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-da259a8c-47a2-4804-b0c5-0feeade736ec tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce" status: 200 len: 1514 microversion: 2.1 time: 0.372282 Oct 26 13:14:09.516107 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1408/2766] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:09 2022] GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce => generated 1514 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:09.525397 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ef6c6df9-3985-4f9c-9b4d-5400dca9340b tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '.version_select at 0x7f67318f1ee0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:09.634320 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ef6c6df9-3985-4f9c-9b4d-5400dca9340b tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938" status: 200 len: 1428 microversion: 2.1 time: 0.116822 Oct 26 13:14:09.641795 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1409/2767] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:14:09 2022] GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938 => generated 1428 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:09.953737 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-96fbae51-bafe-4cee-aa5c-86d6e179c2ac tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:09.973213 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-96fbae51-bafe-4cee-aa5c-86d6e179c2ac tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/a97f1ba5-167d-4b32-a9db-7f68bdb2a255" status: 200 len: 1500 microversion: 2.1 time: 0.622009 Oct 26 13:14:09.990722 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1359/2768] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:09 2022] GET /compute/v2.1/servers/a97f1ba5-167d-4b32-a9db-7f68bdb2a255 => generated 1500 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:10.000719 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-814cdc6d-2650-4414-b31a-6f01899c3336 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:10.001366 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-814cdc6d-2650-4414-b31a-6f01899c3336 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: a97f1ba5-167d-4b32-a9db-7f68bdb2a255] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:10.012970 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-814cdc6d-2650-4414-b31a-6f01899c3336 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:10.014710 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-814cdc6d-2650-4414-b31a-6f01899c3336 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:10.016289 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-814cdc6d-2650-4414-b31a-6f01899c3336 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:10.018242 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e1ab673e-26ee-4b83-ae7d-508b692ff362 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:10.018636 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-814cdc6d-2650-4414-b31a-6f01899c3336 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:10.019362 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e1ab673e-26ee-4b83-ae7d-508b692ff362 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] [instance: 54ffeffd-483c-4d6d-8517-105a666e2402] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:10.020280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-814cdc6d-2650-4414-b31a-6f01899c3336 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:10.023212 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-814cdc6d-2650-4414-b31a-6f01899c3336 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:10.035121 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1ab673e-26ee-4b83-ae7d-508b692ff362 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:10.035799 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1ab673e-26ee-4b83-ae7d-508b692ff362 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:10.038960 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1ab673e-26ee-4b83-ae7d-508b692ff362 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:10.039833 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1ab673e-26ee-4b83-ae7d-508b692ff362 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:10.041545 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1ab673e-26ee-4b83-ae7d-508b692ff362 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:10.042181 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1ab673e-26ee-4b83-ae7d-508b692ff362 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:10.067338 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-814cdc6d-2650-4414-b31a-6f01899c3336 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: a97f1ba5-167d-4b32-a9db-7f68bdb2a255] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:14:10.274946 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-814cdc6d-2650-4414-b31a-6f01899c3336 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a97f1ba5-167d-4b32-a9db-7f68bdb2a255" status: 204 len: 0 microversion: 2.1 time: 0.277925 Oct 26 13:14:10.289869 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1410/2769] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:14:09 2022] DELETE /compute/v2.1/servers/a97f1ba5-167d-4b32-a9db-7f68bdb2a255 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:14:10.297141 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-02ff20f5-230c-4637-8196-91ba38a711c4 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:10.298204 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-02ff20f5-230c-4637-8196-91ba38a711c4 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:10.327977 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02ff20f5-230c-4637-8196-91ba38a711c4 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:10.328517 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02ff20f5-230c-4637-8196-91ba38a711c4 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:10.329034 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02ff20f5-230c-4637-8196-91ba38a711c4 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:10.329867 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02ff20f5-230c-4637-8196-91ba38a711c4 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:10.330420 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02ff20f5-230c-4637-8196-91ba38a711c4 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:10.330921 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02ff20f5-230c-4637-8196-91ba38a711c4 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:10.361794 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e1ab673e-26ee-4b83-ae7d-508b692ff362 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea62f9a8c1094cf6810848551cd4fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd40483e170343f5a02795c16d063066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:10.370260 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e1ab673e-26ee-4b83-ae7d-508b692ff362 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] 10.222.0.40 "GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402" status: 200 len: 1608 microversion: 2.1 time: 0.362488 Oct 26 13:14:10.392279 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1360/2770] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:10 2022] GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402 => generated 1608 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:10.406997 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6bbf94c2-3b1c-479a-8c69-ff470022b110 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:10.408095 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6bbf94c2-3b1c-479a-8c69-ff470022b110 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: a97f1ba5-167d-4b32-a9db-7f68bdb2a255] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:10.415044 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6bbf94c2-3b1c-479a-8c69-ff470022b110 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:10.420325 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6bbf94c2-3b1c-479a-8c69-ff470022b110 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:10.420996 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6bbf94c2-3b1c-479a-8c69-ff470022b110 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:10.429668 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6bbf94c2-3b1c-479a-8c69-ff470022b110 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:10.430337 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6bbf94c2-3b1c-479a-8c69-ff470022b110 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:10.430955 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6bbf94c2-3b1c-479a-8c69-ff470022b110 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:10.628793 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6bbf94c2-3b1c-479a-8c69-ff470022b110 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:10.637779 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6bbf94c2-3b1c-479a-8c69-ff470022b110 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/a97f1ba5-167d-4b32-a9db-7f68bdb2a255" status: 200 len: 1506 microversion: 2.1 time: 0.244337 Oct 26 13:14:10.639259 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1361/2771] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:10 2022] GET /compute/v2.1/servers/a97f1ba5-167d-4b32-a9db-7f68bdb2a255 => generated 1506 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:10.644209 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-412cbf8f-34bd-43e4-8bd0-9dfc480cb730 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:10.645231 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-412cbf8f-34bd-43e4-8bd0-9dfc480cb730 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 9ae69130-8857-4d30-a434-6d8ca54f5cce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:10.652706 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-412cbf8f-34bd-43e4-8bd0-9dfc480cb730 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:10.653434 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-412cbf8f-34bd-43e4-8bd0-9dfc480cb730 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:10.654611 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-412cbf8f-34bd-43e4-8bd0-9dfc480cb730 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:10.655487 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-412cbf8f-34bd-43e4-8bd0-9dfc480cb730 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:10.657011 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-412cbf8f-34bd-43e4-8bd0-9dfc480cb730 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:10.657640 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-412cbf8f-34bd-43e4-8bd0-9dfc480cb730 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:10.688239 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-02ff20f5-230c-4637-8196-91ba38a711c4 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:10.697928 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:14:10.708130 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-02ff20f5-230c-4637-8196-91ba38a711c4 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c" status: 200 len: 1359 microversion: 2.1 time: 0.416519 Oct 26 13:14:10.708747 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1411/2772] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:10 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c => generated 1359 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:10.730596 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f2822193-93a7-4409-afd1-8dc01c412df7 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '.version_select at 0x7f67318f8c10>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:10.846861 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f2822193-93a7-4409-afd1-8dc01c412df7 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938" status: 200 len: 1428 microversion: 2.1 time: 0.137013 Oct 26 13:14:10.847774 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1412/2773] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:14:10 2022] GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938 => generated 1428 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:10.880496 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-412cbf8f-34bd-43e4-8bd0-9dfc480cb730 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:10.893424 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-412cbf8f-34bd-43e4-8bd0-9dfc480cb730 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce" status: 200 len: 1514 microversion: 2.1 time: 0.252809 Oct 26 13:14:10.912937 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1362/2774] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:10 2022] GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce => generated 1514 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:11.179082 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-034da110-ffc3-42d1-bea7-dbde61bd41dc req-62d4d7ef-16e0-49ef-9481-556139f10d7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e73c452-6277-4845-b64e-e3eca2528e4c", "name": "network-vif-plugged", "status": "completed", "tag": "48f9022a-e360-40a8-bd91-61687277f232"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:14:11.197826 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-034da110-ffc3-42d1-bea7-dbde61bd41dc req-62d4d7ef-16e0-49ef-9481-556139f10d7a service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:11.199428 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-034da110-ffc3-42d1-bea7-dbde61bd41dc req-62d4d7ef-16e0-49ef-9481-556139f10d7a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:11.200845 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-034da110-ffc3-42d1-bea7-dbde61bd41dc req-62d4d7ef-16e0-49ef-9481-556139f10d7a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:11.216022 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-034da110-ffc3-42d1-bea7-dbde61bd41dc req-62d4d7ef-16e0-49ef-9481-556139f10d7a service nova] Creating event network-vif-plugged:48f9022a-e360-40a8-bd91-61687277f232 for instance 5e73c452-6277-4845-b64e-e3eca2528e4c on n-h2-862686-1 Oct 26 13:14:11.225198 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-034da110-ffc3-42d1-bea7-dbde61bd41dc req-62d4d7ef-16e0-49ef-9481-556139f10d7a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050594 Oct 26 13:14:11.230714 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1413/2775] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:14:11.400390 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-100a4895-4862-45dd-802a-91ffa8d344db tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:11.400950 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-100a4895-4862-45dd-802a-91ffa8d344db tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] [instance: 54ffeffd-483c-4d6d-8517-105a666e2402] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:11.408635 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-100a4895-4862-45dd-802a-91ffa8d344db tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:11.409374 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-100a4895-4862-45dd-802a-91ffa8d344db tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:11.414620 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-100a4895-4862-45dd-802a-91ffa8d344db tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:11.415687 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-100a4895-4862-45dd-802a-91ffa8d344db tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:11.416381 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-100a4895-4862-45dd-802a-91ffa8d344db tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:11.417161 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-100a4895-4862-45dd-802a-91ffa8d344db tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:11.579745 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-100a4895-4862-45dd-802a-91ffa8d344db tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea62f9a8c1094cf6810848551cd4fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd40483e170343f5a02795c16d063066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:11.596130 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-100a4895-4862-45dd-802a-91ffa8d344db tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] 10.222.0.40 "GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402" status: 200 len: 1542 microversion: 2.1 time: 0.198451 Oct 26 13:14:11.597057 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1363/2776] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:11 2022] GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402 => generated 1542 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:11.669191 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-23a9cd43-4376-40c7-b8ee-bb22bde67740 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:11.670163 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-23a9cd43-4376-40c7-b8ee-bb22bde67740 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: a97f1ba5-167d-4b32-a9db-7f68bdb2a255] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:11.687819 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-23a9cd43-4376-40c7-b8ee-bb22bde67740 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:11.688669 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-23a9cd43-4376-40c7-b8ee-bb22bde67740 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:11.689328 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-23a9cd43-4376-40c7-b8ee-bb22bde67740 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:11.690822 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-23a9cd43-4376-40c7-b8ee-bb22bde67740 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:11.691617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-23a9cd43-4376-40c7-b8ee-bb22bde67740 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:11.692219 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-23a9cd43-4376-40c7-b8ee-bb22bde67740 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:11.733629 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a9d7255d-0ea1-41cc-ab4d-c390ec793635 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:11.734902 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a9d7255d-0ea1-41cc-ab4d-c390ec793635 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:11.737527 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:14:11.751755 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a9d7255d-0ea1-41cc-ab4d-c390ec793635 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:11.754108 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a9d7255d-0ea1-41cc-ab4d-c390ec793635 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:11.754959 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a9d7255d-0ea1-41cc-ab4d-c390ec793635 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:11.760163 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a9d7255d-0ea1-41cc-ab4d-c390ec793635 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:11.763193 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a9d7255d-0ea1-41cc-ab4d-c390ec793635 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:11.764352 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a9d7255d-0ea1-41cc-ab4d-c390ec793635 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:12.010637 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-23a9cd43-4376-40c7-b8ee-bb22bde67740 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:12.020524 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-23a9cd43-4376-40c7-b8ee-bb22bde67740 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/a97f1ba5-167d-4b32-a9db-7f68bdb2a255" status: 200 len: 1506 microversion: 2.1 time: 0.357250 Oct 26 13:14:12.023789 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1414/2777] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:11 2022] GET /compute/v2.1/servers/a97f1ba5-167d-4b32-a9db-7f68bdb2a255 => generated 1506 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:14:12.032406 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6c3081c5-d09a-4cf6-89f2-9e8e27e6c90f tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '.version_select at 0x7f67319ad790>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:12.125739 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6c3081c5-d09a-4cf6-89f2-9e8e27e6c90f tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938" status: 200 len: 1428 microversion: 2.1 time: 0.100705 Oct 26 13:14:12.137809 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1415/2778] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:14:12 2022] GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938 => generated 1428 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:12.143077 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ec01d0a6-d524-4a3f-914a-dae23aa65f6c tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:12.143797 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ec01d0a6-d524-4a3f-914a-dae23aa65f6c tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 9ae69130-8857-4d30-a434-6d8ca54f5cce] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:12.165111 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec01d0a6-d524-4a3f-914a-dae23aa65f6c tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:12.165808 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec01d0a6-d524-4a3f-914a-dae23aa65f6c tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:12.166356 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec01d0a6-d524-4a3f-914a-dae23aa65f6c tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:12.169348 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec01d0a6-d524-4a3f-914a-dae23aa65f6c tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:12.170543 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec01d0a6-d524-4a3f-914a-dae23aa65f6c tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:12.174905 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec01d0a6-d524-4a3f-914a-dae23aa65f6c tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:12.302734 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a9d7255d-0ea1-41cc-ab4d-c390ec793635 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:12.311250 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a9d7255d-0ea1-41cc-ab4d-c390ec793635 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c" status: 200 len: 1359 microversion: 2.1 time: 0.582726 Oct 26 13:14:12.329939 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1364/2779] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:11 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c => generated 1359 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:12.334786 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-faef3270-d871-4518-ac1a-1dbd87cb5c41 req-f6896e16-8e31-4afd-a573-f580bdcc9515 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54ffeffd-483c-4d6d-8517-105a666e2402", "name": "network-vif-deleted", "tag": "a9d9e989-0192-4729-afb9-8ddfa02d05c4"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:14:12.346298 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-faef3270-d871-4518-ac1a-1dbd87cb5c41 req-f6896e16-8e31-4afd-a573-f580bdcc9515 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:12.347057 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-faef3270-d871-4518-ac1a-1dbd87cb5c41 req-f6896e16-8e31-4afd-a573-f580bdcc9515 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:12.347659 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-faef3270-d871-4518-ac1a-1dbd87cb5c41 req-f6896e16-8e31-4afd-a573-f580bdcc9515 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:12.365720 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-faef3270-d871-4518-ac1a-1dbd87cb5c41 req-f6896e16-8e31-4afd-a573-f580bdcc9515 service nova] Creating event network-vif-deleted:a9d9e989-0192-4729-afb9-8ddfa02d05c4 for instance 54ffeffd-483c-4d6d-8517-105a666e2402 on n-h1-862686-1 Oct 26 13:14:12.380801 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-faef3270-d871-4518-ac1a-1dbd87cb5c41 req-f6896e16-8e31-4afd-a573-f580bdcc9515 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049476 Oct 26 13:14:12.383978 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1365/2780] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:14:12.629043 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-13d95b9d-5e41-4b38-87fa-b3d925f36660 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:12.629770 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-13d95b9d-5e41-4b38-87fa-b3d925f36660 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] [instance: 54ffeffd-483c-4d6d-8517-105a666e2402] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:12.640916 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-13d95b9d-5e41-4b38-87fa-b3d925f36660 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:12.641413 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-13d95b9d-5e41-4b38-87fa-b3d925f36660 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:12.646124 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-13d95b9d-5e41-4b38-87fa-b3d925f36660 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:12.646901 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-13d95b9d-5e41-4b38-87fa-b3d925f36660 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:12.647383 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-13d95b9d-5e41-4b38-87fa-b3d925f36660 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:12.647821 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-13d95b9d-5e41-4b38-87fa-b3d925f36660 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:12.748777 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ec01d0a6-d524-4a3f-914a-dae23aa65f6c tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:12.760223 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ec01d0a6-d524-4a3f-914a-dae23aa65f6c tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce" status: 200 len: 1514 microversion: 2.1 time: 0.621116 Oct 26 13:14:12.764223 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1416/2781] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:12 2022] GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce => generated 1514 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:12.940252 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-13d95b9d-5e41-4b38-87fa-b3d925f36660 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea62f9a8c1094cf6810848551cd4fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd40483e170343f5a02795c16d063066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:12.951555 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-13d95b9d-5e41-4b38-87fa-b3d925f36660 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] 10.222.0.40 "GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402" status: 200 len: 1253 microversion: 2.1 time: 0.326142 Oct 26 13:14:12.963365 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1366/2782] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:12 2022] GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402 => generated 1253 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:12.984396 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-62ee19d5-1674-4bd8-978a-ddaac1342a71 req-1eec391e-914b-4433-9245-b261c7c2d048 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a97f1ba5-167d-4b32-a9db-7f68bdb2a255", "name": "network-vif-deleted", "tag": "618f7d0a-f47c-45b1-bf2b-ac8685a06278"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:14:13.007267 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-62ee19d5-1674-4bd8-978a-ddaac1342a71 req-1eec391e-914b-4433-9245-b261c7c2d048 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:13.010152 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-62ee19d5-1674-4bd8-978a-ddaac1342a71 req-1eec391e-914b-4433-9245-b261c7c2d048 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:13.010810 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-62ee19d5-1674-4bd8-978a-ddaac1342a71 req-1eec391e-914b-4433-9245-b261c7c2d048 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:13.050436 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a4d55bfe-1100-486f-8c96-1db97716ec4a tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:13.051456 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a4d55bfe-1100-486f-8c96-1db97716ec4a tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: a97f1ba5-167d-4b32-a9db-7f68bdb2a255] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:13.071262 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4d55bfe-1100-486f-8c96-1db97716ec4a tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:13.071942 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4d55bfe-1100-486f-8c96-1db97716ec4a tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:13.072392 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4d55bfe-1100-486f-8c96-1db97716ec4a tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:13.073112 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4d55bfe-1100-486f-8c96-1db97716ec4a tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:13.073593 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4d55bfe-1100-486f-8c96-1db97716ec4a tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:13.074023 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4d55bfe-1100-486f-8c96-1db97716ec4a tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:13.075649 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-62ee19d5-1674-4bd8-978a-ddaac1342a71 req-1eec391e-914b-4433-9245-b261c7c2d048 service nova] Creating event network-vif-deleted:618f7d0a-f47c-45b1-bf2b-ac8685a06278 for instance a97f1ba5-167d-4b32-a9db-7f68bdb2a255 on n-h2-862686-1 Oct 26 13:14:13.089603 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-62ee19d5-1674-4bd8-978a-ddaac1342a71 req-1eec391e-914b-4433-9245-b261c7c2d048 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106137 Oct 26 13:14:13.094242 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1417/2783] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:14:13.148999 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-67ef6438-7bc0-4bcf-84c9-48348dd71219 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '.version_select at 0x7f6731947820>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:13.276577 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-67ef6438-7bc0-4bcf-84c9-48348dd71219 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938" status: 200 len: 1428 microversion: 2.1 time: 0.133838 Oct 26 13:14:13.286224 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1418/2784] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:14:13 2022] GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938 => generated 1428 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:13.294362 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a4d55bfe-1100-486f-8c96-1db97716ec4a tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:13.315081 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a4d55bfe-1100-486f-8c96-1db97716ec4a tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/a97f1ba5-167d-4b32-a9db-7f68bdb2a255" status: 200 len: 1306 microversion: 2.1 time: 0.270018 Oct 26 13:14:13.316033 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1367/2785] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:13 2022] GET /compute/v2.1/servers/a97f1ba5-167d-4b32-a9db-7f68bdb2a255 => generated 1306 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:13.341336 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fd1ed657-11ac-4780-a664-a969cbd8aa69 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:13.343126 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fd1ed657-11ac-4780-a664-a969cbd8aa69 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:13.353662 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd1ed657-11ac-4780-a664-a969cbd8aa69 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:13.355150 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd1ed657-11ac-4780-a664-a969cbd8aa69 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:13.362162 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd1ed657-11ac-4780-a664-a969cbd8aa69 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:13.363169 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd1ed657-11ac-4780-a664-a969cbd8aa69 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:13.363804 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd1ed657-11ac-4780-a664-a969cbd8aa69 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:13.364412 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd1ed657-11ac-4780-a664-a969cbd8aa69 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:13.784687 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-840d09f6-bb09-48aa-81ea-4de383312cac tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:13.785428 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-840d09f6-bb09-48aa-81ea-4de383312cac tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 9ae69130-8857-4d30-a434-6d8ca54f5cce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:13.802416 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-840d09f6-bb09-48aa-81ea-4de383312cac tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:13.806828 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-840d09f6-bb09-48aa-81ea-4de383312cac tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:13.810027 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-840d09f6-bb09-48aa-81ea-4de383312cac tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:13.820104 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-840d09f6-bb09-48aa-81ea-4de383312cac tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:13.820650 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-840d09f6-bb09-48aa-81ea-4de383312cac tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:13.821098 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-840d09f6-bb09-48aa-81ea-4de383312cac tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:13.939780 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fd1ed657-11ac-4780-a664-a969cbd8aa69 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:13.952703 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fd1ed657-11ac-4780-a664-a969cbd8aa69 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c" status: 200 len: 1359 microversion: 2.1 time: 0.614294 Oct 26 13:14:13.957822 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1419/2786] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:13 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c => generated 1359 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:13.989212 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f045d646-8bdb-433f-91da-eb5722762e77 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:13.990245 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f045d646-8bdb-433f-91da-eb5722762e77 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] [instance: 54ffeffd-483c-4d6d-8517-105a666e2402] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:14.001667 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f045d646-8bdb-433f-91da-eb5722762e77 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:14.002430 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f045d646-8bdb-433f-91da-eb5722762e77 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:14.003295 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f045d646-8bdb-433f-91da-eb5722762e77 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:14.004184 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f045d646-8bdb-433f-91da-eb5722762e77 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:14.006041 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f045d646-8bdb-433f-91da-eb5722762e77 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:14.006668 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f045d646-8bdb-433f-91da-eb5722762e77 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:14.178643 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-840d09f6-bb09-48aa-81ea-4de383312cac tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:14.206701 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-840d09f6-bb09-48aa-81ea-4de383312cac tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce" status: 200 len: 1514 microversion: 2.1 time: 0.424026 Oct 26 13:14:14.216028 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f045d646-8bdb-433f-91da-eb5722762e77 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea62f9a8c1094cf6810848551cd4fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd40483e170343f5a02795c16d063066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:14.226510 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f045d646-8bdb-433f-91da-eb5722762e77 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] 10.222.0.40 "GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402" status: 200 len: 1253 microversion: 2.1 time: 0.241062 Oct 26 13:14:14.227105 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1420/2787] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:13 2022] GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402 => generated 1253 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:14:14.231816 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1368/2788] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:13 2022] GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce => generated 1514 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:14.298066 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-42c9e39a-4429-4682-a49f-7efffa3fa044 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '.version_select at 0x7f67318f1e50>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:14.339190 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-81299449-c910-402a-9cb3-c0cf9437c0b1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:14.339818 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-81299449-c910-402a-9cb3-c0cf9437c0b1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: a97f1ba5-167d-4b32-a9db-7f68bdb2a255] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:14.355481 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81299449-c910-402a-9cb3-c0cf9437c0b1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:14.362413 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81299449-c910-402a-9cb3-c0cf9437c0b1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:14.364052 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81299449-c910-402a-9cb3-c0cf9437c0b1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:14.369285 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81299449-c910-402a-9cb3-c0cf9437c0b1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:14.369727 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81299449-c910-402a-9cb3-c0cf9437c0b1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:14.370182 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81299449-c910-402a-9cb3-c0cf9437c0b1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:14.394167 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-42c9e39a-4429-4682-a49f-7efffa3fa044 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938" status: 200 len: 1428 microversion: 2.1 time: 0.103237 Oct 26 13:14:14.406664 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1421/2789] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:14:14 2022] GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938 => generated 1428 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:14.464159 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:14:14.541453 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81299449-c910-402a-9cb3-c0cf9437c0b1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:14.547831 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81299449-c910-402a-9cb3-c0cf9437c0b1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:14.551755 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81299449-c910-402a-9cb3-c0cf9437c0b1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:14.552527 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-81299449-c910-402a-9cb3-c0cf9437c0b1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lazy-loading 'fault' on Instance uuid a97f1ba5-167d-4b32-a9db-7f68bdb2a255 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:14:14.704981 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-81299449-c910-402a-9cb3-c0cf9437c0b1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:14.718301 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-81299449-c910-402a-9cb3-c0cf9437c0b1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/a97f1ba5-167d-4b32-a9db-7f68bdb2a255" status: 200 len: 1311 microversion: 2.1 time: 0.381682 Oct 26 13:14:14.732389 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1369/2790] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:14 2022] GET /compute/v2.1/servers/a97f1ba5-167d-4b32-a9db-7f68bdb2a255 => generated 1311 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:14:14.979931 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4d513d14-f275-4d32-a5d8-c38d046f5b46 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:14.980550 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4d513d14-f275-4d32-a5d8-c38d046f5b46 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:14.999056 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d513d14-f275-4d32-a5d8-c38d046f5b46 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:14.999709 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d513d14-f275-4d32-a5d8-c38d046f5b46 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:15.000351 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d513d14-f275-4d32-a5d8-c38d046f5b46 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:15.001086 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d513d14-f275-4d32-a5d8-c38d046f5b46 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:15.004858 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d513d14-f275-4d32-a5d8-c38d046f5b46 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:15.005345 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d513d14-f275-4d32-a5d8-c38d046f5b46 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:15.232201 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-33fc9bdd-1cd0-4b48-a411-0f5cd06307d0 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:15.233869 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-33fc9bdd-1cd0-4b48-a411-0f5cd06307d0 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 9ae69130-8857-4d30-a434-6d8ca54f5cce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:15.250468 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-33fc9bdd-1cd0-4b48-a411-0f5cd06307d0 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:15.257810 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-33fc9bdd-1cd0-4b48-a411-0f5cd06307d0 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:15.258288 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-33fc9bdd-1cd0-4b48-a411-0f5cd06307d0 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:15.259050 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-33fc9bdd-1cd0-4b48-a411-0f5cd06307d0 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:15.259524 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-33fc9bdd-1cd0-4b48-a411-0f5cd06307d0 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:15.259956 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-33fc9bdd-1cd0-4b48-a411-0f5cd06307d0 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:15.372187 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4d513d14-f275-4d32-a5d8-c38d046f5b46 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:15.390238 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4d513d14-f275-4d32-a5d8-c38d046f5b46 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c" status: 200 len: 1542 microversion: 2.1 time: 0.414833 Oct 26 13:14:15.391147 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1422/2791] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:14 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c => generated 1542 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:15.410779 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8118126b-6921-4323-bec1-281b5cb917bb tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:15.411769 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8118126b-6921-4323-bec1-281b5cb917bb tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] [instance: 54ffeffd-483c-4d6d-8517-105a666e2402] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:15.425745 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8118126b-6921-4323-bec1-281b5cb917bb tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:15.429104 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8118126b-6921-4323-bec1-281b5cb917bb tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:15.430132 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8118126b-6921-4323-bec1-281b5cb917bb tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:15.436715 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8118126b-6921-4323-bec1-281b5cb917bb tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:15.439475 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8118126b-6921-4323-bec1-281b5cb917bb tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:15.440484 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8118126b-6921-4323-bec1-281b5cb917bb tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:15.606731 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8118126b-6921-4323-bec1-281b5cb917bb tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea62f9a8c1094cf6810848551cd4fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd40483e170343f5a02795c16d063066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:15.616783 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8118126b-6921-4323-bec1-281b5cb917bb tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] 10.222.0.40 "GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402" status: 200 len: 1253 microversion: 2.1 time: 0.224363 Oct 26 13:14:15.617964 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1423/2792] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:15 2022] GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402 => generated 1253 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:15.624377 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fb6974e3-3182-4e9d-82e6-409194a358dc tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '.version_select at 0x7f6731921430>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:15.705702 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fb6974e3-3182-4e9d-82e6-409194a358dc tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938" status: 200 len: 1428 microversion: 2.1 time: 0.086112 Oct 26 13:14:15.706531 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1424/2793] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:14:15 2022] GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938 => generated 1428 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:15.715699 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-185b844e-b265-48f2-99c3-349e9b78ba0a tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:15.718033 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-185b844e-b265-48f2-99c3-349e9b78ba0a tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:15.735134 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-185b844e-b265-48f2-99c3-349e9b78ba0a tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:15.738703 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-185b844e-b265-48f2-99c3-349e9b78ba0a tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:15.742692 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-185b844e-b265-48f2-99c3-349e9b78ba0a tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:15.743662 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-185b844e-b265-48f2-99c3-349e9b78ba0a tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:15.744286 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-185b844e-b265-48f2-99c3-349e9b78ba0a tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:15.744895 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-185b844e-b265-48f2-99c3-349e9b78ba0a tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:15.842379 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-33fc9bdd-1cd0-4b48-a411-0f5cd06307d0 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:15.888637 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-33fc9bdd-1cd0-4b48-a411-0f5cd06307d0 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce" status: 200 len: 1514 microversion: 2.1 time: 0.655562 Oct 26 13:14:15.896961 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1370/2794] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:15 2022] GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce => generated 1514 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:15.915608 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6bc0813d-e359-42d9-91d6-74c62d131e65 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:15.921911 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6bc0813d-e359-42d9-91d6-74c62d131e65 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: a97f1ba5-167d-4b32-a9db-7f68bdb2a255] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:15.956674 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6bc0813d-e359-42d9-91d6-74c62d131e65 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:15.957176 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6bc0813d-e359-42d9-91d6-74c62d131e65 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:15.957564 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-185b844e-b265-48f2-99c3-349e9b78ba0a tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.248934 Oct 26 13:14:15.957713 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6bc0813d-e359-42d9-91d6-74c62d131e65 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:15.958346 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6bc0813d-e359-42d9-91d6-74c62d131e65 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:15.959019 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1425/2795] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 26 13:14:15 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c/os-interface => generated 285 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:14:15.966995 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6bc0813d-e359-42d9-91d6-74c62d131e65 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:15.967959 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6bc0813d-e359-42d9-91d6-74c62d131e65 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:15.996581 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-6bc0813d-e359-42d9-91d6-74c62d131e65 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] HTTP exception thrown: Instance a97f1ba5-167d-4b32-a9db-7f68bdb2a255 could not be found. Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6bc0813d-e359-42d9-91d6-74c62d131e65 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Request method failure captured: Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/a97f1ba5-167d-4b32-a9db-7f68bdb2a255 HTTP/1.1 Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTJbgpOJ6_WXapLDSc4DXB2ybbuKvfF9irakf13MnXe_PUvQw0tvwC_KXpEDb02nWk9gKVB2DnChPFFUGp_xOUQaSFHL5E80bTALTu8ZJijTkAv_z2Y1Gdi1cyNAMKmLE7ZnzWq0oDflWXhf1sSJNtguU-rMZFkiGbBps0dj1yOxZiU Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 3f690a680b284d82ac586346427423c3 Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersTestJSON-1612525130 Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3f690a680b284d82ac586346427423c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f690a680b284d82ac586346427423c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3f690a680b284d82ac586346427423c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f690a680b284d82ac586346427423c3"}]}] Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersTestJSON-1612525130 Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 3f690a680b284d82ac586346427423c3 Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersTestJSON-1612525130 Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersTestJSON-1612525130-project Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: fbe30a73a18d49afa07f7a66aee7805d Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersTestJSON-1612525130-project Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance a97f1ba5-167d-4b32-a9db-7f68bdb2a255 could not be found. Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'a97f1ba5-167d-4b32-a9db-7f68bdb2a255'} Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a97f1ba5-167d-4b32-a9db-7f68bdb2a255 could not be found. Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a97f1ba5-167d-4b32-a9db-7f68bdb2a255 could not be found. Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:14:15.998522 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:14:16.002965 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:14:16.002965 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:14:16.002965 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:14:16.002965 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:14:16.002965 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:14:16.002965 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a97f1ba5-167d-4b32-a9db-7f68bdb2a255 could not be found. Oct 26 13:14:16.002965 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:14:16.002965 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6bc0813d-e359-42d9-91d6-74c62d131e65 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Returning 404 to user: Instance a97f1ba5-167d-4b32-a9db-7f68bdb2a255 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:14:16.002965 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6bc0813d-e359-42d9-91d6-74c62d131e65 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/a97f1ba5-167d-4b32-a9db-7f68bdb2a255" status: 404 len: 111 microversion: 2.1 time: 0.101909 Oct 26 13:14:16.002965 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1371/2796] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:15 2022] GET /compute/v2.1/servers/a97f1ba5-167d-4b32-a9db-7f68bdb2a255 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:14:16.013364 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-926970f5-e203-468b-b780-cdd9624d7723 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Action: 'create', calling method: .version_select at 0x7f67319391f0>, body: {"keypair": {"name": "tempest-key-855270516", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqP9BkAmF8Co946ybKzx/8Zy0LkirTD9Uc3jaE5SJUKHTCAwu/6P2IR/PHrMvAs67PePMr8C3le5UL9nuJQGEQ4lCdUbndBoeFDZIxD5VVUadivWrk63svU+e/Z+zuipA=="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:14:16.048277 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-926970f5-e203-468b-b780-cdd9624d7723 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Getting quotas for project 3f690a680b284d82ac586346427423c3. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:14:16.065126 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-926970f5-e203-468b-b780-cdd9624d7723 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Getting quotas for user fbe30a73a18d49afa07f7a66aee7805d and project 3f690a680b284d82ac586346427423c3. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:14:16.123639 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-926970f5-e203-468b-b780-cdd9624d7723 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.113337 Oct 26 13:14:16.130395 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1426/2797] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 13:14:16 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:14:16.135807 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f85d0899-c816-4b3f-b017-fdfa092ca349 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '.version_select at 0x7f67326f6b80>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:16.140507 n-d-862686-1 devstack@n-api.service[120597]: WARNING oslo_db.sqlalchemy.utils [None req-f85d0899-c816-4b3f-b017-fdfa092ca349 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 26 13:14:16.156906 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f85d0899-c816-4b3f-b017-fdfa092ca349 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.025227 Oct 26 13:14:16.157515 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1372/2798] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 26 13:14:16 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:14:16.284326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8dc4a04b-dc1e-4b5e-8ce9-5d412f9cd9c6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1501454582", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "key_name": "tempest-key-855270516", "networks": [{"uuid": "bc8855c0-63b2-4c3e-b1b8-950c3dd488ef"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:14:16.397329 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-8dc4a04b-dc1e-4b5e-8ce9-5d412f9cd9c6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] validate_networks() for [('bc8855c0-63b2-4c3e-b1b8-950c3dd488ef', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:14:16.574341 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:14:16.646417 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8c5ff189-0014-48c8-9759-684e93c35131 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:16.647017 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8c5ff189-0014-48c8-9759-684e93c35131 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] [instance: 54ffeffd-483c-4d6d-8517-105a666e2402] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:16.659020 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8c5ff189-0014-48c8-9759-684e93c35131 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:16.662123 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8c5ff189-0014-48c8-9759-684e93c35131 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:16.664900 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8c5ff189-0014-48c8-9759-684e93c35131 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:16.665906 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8c5ff189-0014-48c8-9759-684e93c35131 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:16.668307 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8c5ff189-0014-48c8-9759-684e93c35131 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:16.668928 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8c5ff189-0014-48c8-9759-684e93c35131 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:16.783168 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:14:16.950648 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:14:17.062740 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8c5ff189-0014-48c8-9759-684e93c35131 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea62f9a8c1094cf6810848551cd4fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd40483e170343f5a02795c16d063066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:17.074852 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8c5ff189-0014-48c8-9759-684e93c35131 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] 10.222.0.40 "GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402" status: 200 len: 1253 microversion: 2.1 time: 0.432378 Oct 26 13:14:17.079237 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1373/2799] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:16 2022] GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402 => generated 1253 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:17.084388 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7d2c18bd-1827-40de-bfe9-8a280fcf084d tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '.version_select at 0x7f67326f64c0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:17.163414 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7d2c18bd-1827-40de-bfe9-8a280fcf084d tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938" status: 200 len: 1428 microversion: 2.1 time: 0.082758 Oct 26 13:14:17.164161 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1374/2800] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:14:17 2022] GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938 => generated 1428 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:17.168992 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-83df6a2e-e187-4ab3-bfba-92c5313898f2 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:17.176386 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-83df6a2e-e187-4ab3-bfba-92c5313898f2 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 9ae69130-8857-4d30-a434-6d8ca54f5cce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:17.188531 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-83df6a2e-e187-4ab3-bfba-92c5313898f2 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:17.191535 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-83df6a2e-e187-4ab3-bfba-92c5313898f2 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:17.194579 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-83df6a2e-e187-4ab3-bfba-92c5313898f2 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:17.195700 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-83df6a2e-e187-4ab3-bfba-92c5313898f2 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:17.196407 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-83df6a2e-e187-4ab3-bfba-92c5313898f2 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:17.197235 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-83df6a2e-e187-4ab3-bfba-92c5313898f2 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:17.481450 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-83df6a2e-e187-4ab3-bfba-92c5313898f2 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:17.493536 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-83df6a2e-e187-4ab3-bfba-92c5313898f2 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce" status: 200 len: 1514 microversion: 2.1 time: 0.327997 Oct 26 13:14:17.514862 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1375/2801] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:17 2022] GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce => generated 1514 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:18.104097 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-90c02bed-0976-4d9c-a159-02ceb120b98e tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:18.105667 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-90c02bed-0976-4d9c-a159-02ceb120b98e tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] [instance: 54ffeffd-483c-4d6d-8517-105a666e2402] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:18.132098 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90c02bed-0976-4d9c-a159-02ceb120b98e tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:18.134388 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90c02bed-0976-4d9c-a159-02ceb120b98e tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:18.140325 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90c02bed-0976-4d9c-a159-02ceb120b98e tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:18.142855 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90c02bed-0976-4d9c-a159-02ceb120b98e tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:18.146551 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90c02bed-0976-4d9c-a159-02ceb120b98e tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:18.147992 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90c02bed-0976-4d9c-a159-02ceb120b98e tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:18.320500 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-8dc4a04b-dc1e-4b5e-8ce9-5d412f9cd9c6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:14:18.321324 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-8dc4a04b-dc1e-4b5e-8ce9-5d412f9cd9c6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:14:18.322240 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-8dc4a04b-dc1e-4b5e-8ce9-5d412f9cd9c6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:14:18.322832 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-8dc4a04b-dc1e-4b5e-8ce9-5d412f9cd9c6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:14:18.323403 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-8dc4a04b-dc1e-4b5e-8ce9-5d412f9cd9c6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:14:18.355080 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8dc4a04b-dc1e-4b5e-8ce9-5d412f9cd9c6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:18.356433 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8dc4a04b-dc1e-4b5e-8ce9-5d412f9cd9c6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:18.356884 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8dc4a04b-dc1e-4b5e-8ce9-5d412f9cd9c6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:18.360140 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8dc4a04b-dc1e-4b5e-8ce9-5d412f9cd9c6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:18.360614 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8dc4a04b-dc1e-4b5e-8ce9-5d412f9cd9c6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:18.361044 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8dc4a04b-dc1e-4b5e-8ce9-5d412f9cd9c6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:18.422861 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-8dc4a04b-dc1e-4b5e-8ce9-5d412f9cd9c6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Getting quotas for project 3f690a680b284d82ac586346427423c3. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:14:18.439423 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-8dc4a04b-dc1e-4b5e-8ce9-5d412f9cd9c6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Getting quotas for user fbe30a73a18d49afa07f7a66aee7805d and project 3f690a680b284d82ac586346427423c3. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:14:18.443959 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:14:18.478905 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8dc4a04b-dc1e-4b5e-8ce9-5d412f9cd9c6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:14:18.490031 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8dc4a04b-dc1e-4b5e-8ce9-5d412f9cd9c6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 4f175b39-6703-43a3-a93b-e64e411d53b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:14:18.636351 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8dc4a04b-dc1e-4b5e-8ce9-5d412f9cd9c6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.353742 Oct 26 13:14:18.643237 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1427/2802] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:14:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2364 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:14:18.665520 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6d3f5188-b9b9-46f6-9792-1b550cc1652e tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '.version_select at 0x7f6731939310>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:18.728914 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-90c02bed-0976-4d9c-a159-02ceb120b98e tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea62f9a8c1094cf6810848551cd4fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd40483e170343f5a02795c16d063066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:18.754043 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-90c02bed-0976-4d9c-a159-02ceb120b98e tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] 10.222.0.40 "GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402" status: 200 len: 1253 microversion: 2.1 time: 0.653675 Oct 26 13:14:18.755799 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6d3f5188-b9b9-46f6-9792-1b550cc1652e tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938" status: 200 len: 1428 microversion: 2.1 time: 0.111110 Oct 26 13:14:18.762156 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1428/2803] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:14:18 2022] GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938 => generated 1428 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:18.777282 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1376/2804] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:18 2022] GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402 => generated 1253 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:14:18.780456 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9935a48e-4b19-4d7b-8e6d-623af88e0d43 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:18.780604 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9935a48e-4b19-4d7b-8e6d-623af88e0d43 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 4f175b39-6703-43a3-a93b-e64e411d53b5] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:18.782528 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2d130dec-c11d-4ef2-8db8-31ed0f4558fe tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:18.785033 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2d130dec-c11d-4ef2-8db8-31ed0f4558fe tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 9ae69130-8857-4d30-a434-6d8ca54f5cce] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:18.811748 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d130dec-c11d-4ef2-8db8-31ed0f4558fe tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:18.813873 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d130dec-c11d-4ef2-8db8-31ed0f4558fe tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:18.814559 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d130dec-c11d-4ef2-8db8-31ed0f4558fe tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:18.817307 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d130dec-c11d-4ef2-8db8-31ed0f4558fe tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:18.820414 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d130dec-c11d-4ef2-8db8-31ed0f4558fe tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:18.823908 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d130dec-c11d-4ef2-8db8-31ed0f4558fe tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:18.928415 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9935a48e-4b19-4d7b-8e6d-623af88e0d43 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:18.944951 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9935a48e-4b19-4d7b-8e6d-623af88e0d43 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/4f175b39-6703-43a3-a93b-e64e411d53b5" status: 200 len: 1228 microversion: 2.1 time: 0.159709 Oct 26 13:14:18.945907 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1377/2805] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:18 2022] GET /compute/v2.1/servers/4f175b39-6703-43a3-a93b-e64e411d53b5 => generated 1228 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:19.288424 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2d130dec-c11d-4ef2-8db8-31ed0f4558fe tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:19.298642 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2d130dec-c11d-4ef2-8db8-31ed0f4558fe tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce" status: 200 len: 1514 microversion: 2.1 time: 0.535094 Oct 26 13:14:19.314517 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1429/2806] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:18 2022] GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce => generated 1514 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:19.781297 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-427458e1-041d-47a5-ba48-ea2011d103f6 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '.version_select at 0x7f6732693820>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:19.789798 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-beeacaad-8fe3-4b8f-8726-959185c503bd req-dcaaca0c-fd68-4f59-9475-aa4645bd29b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e73c452-6277-4845-b64e-e3eca2528e4c", "tag": "48f9022a-e360-40a8-bd91-61687277f232"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:14:19.816720 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-beeacaad-8fe3-4b8f-8726-959185c503bd req-dcaaca0c-fd68-4f59-9475-aa4645bd29b8 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:19.817198 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-beeacaad-8fe3-4b8f-8726-959185c503bd req-dcaaca0c-fd68-4f59-9475-aa4645bd29b8 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:19.817665 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-beeacaad-8fe3-4b8f-8726-959185c503bd req-dcaaca0c-fd68-4f59-9475-aa4645bd29b8 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:19.870516 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-beeacaad-8fe3-4b8f-8726-959185c503bd req-dcaaca0c-fd68-4f59-9475-aa4645bd29b8 service nova] Creating event network-changed:48f9022a-e360-40a8-bd91-61687277f232 for instance 5e73c452-6277-4845-b64e-e3eca2528e4c on n-h2-862686-1 Oct 26 13:14:19.886028 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-427458e1-041d-47a5-ba48-ea2011d103f6 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938" status: 200 len: 1428 microversion: 2.1 time: 0.108557 Oct 26 13:14:19.886621 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1378/2807] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:14:19 2022] GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938 => generated 1428 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:19.914282 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-beeacaad-8fe3-4b8f-8726-959185c503bd req-dcaaca0c-fd68-4f59-9475-aa4645bd29b8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128013 Oct 26 13:14:19.916371 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0adbae67-8a22-4b32-abe7-8156ab07b349 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:19.917173 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0adbae67-8a22-4b32-abe7-8156ab07b349 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] [instance: 54ffeffd-483c-4d6d-8517-105a666e2402] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:19.929602 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1430/2808] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:14:19.938834 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0adbae67-8a22-4b32-abe7-8156ab07b349 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:19.939332 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0adbae67-8a22-4b32-abe7-8156ab07b349 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:19.939773 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0adbae67-8a22-4b32-abe7-8156ab07b349 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:19.940489 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0adbae67-8a22-4b32-abe7-8156ab07b349 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:19.940941 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0adbae67-8a22-4b32-abe7-8156ab07b349 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:19.941366 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0adbae67-8a22-4b32-abe7-8156ab07b349 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:19.973660 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ca76a27b-9a7c-4a44-87ee-1e2f1cfd6ef9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:19.974379 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ca76a27b-9a7c-4a44-87ee-1e2f1cfd6ef9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 4f175b39-6703-43a3-a93b-e64e411d53b5] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:19.994883 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca76a27b-9a7c-4a44-87ee-1e2f1cfd6ef9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:19.995366 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca76a27b-9a7c-4a44-87ee-1e2f1cfd6ef9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:20.006699 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca76a27b-9a7c-4a44-87ee-1e2f1cfd6ef9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:20.010802 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca76a27b-9a7c-4a44-87ee-1e2f1cfd6ef9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:20.012975 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca76a27b-9a7c-4a44-87ee-1e2f1cfd6ef9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:20.014113 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca76a27b-9a7c-4a44-87ee-1e2f1cfd6ef9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:20.171462 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0adbae67-8a22-4b32-abe7-8156ab07b349 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea62f9a8c1094cf6810848551cd4fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd40483e170343f5a02795c16d063066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:20.184521 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0adbae67-8a22-4b32-abe7-8156ab07b349 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] 10.222.0.40 "GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402" status: 200 len: 1253 microversion: 2.1 time: 0.283357 Oct 26 13:14:20.193613 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1379/2809] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:19 2022] GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402 => generated 1253 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:20.210611 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ca76a27b-9a7c-4a44-87ee-1e2f1cfd6ef9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:20.226176 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ca76a27b-9a7c-4a44-87ee-1e2f1cfd6ef9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/4f175b39-6703-43a3-a93b-e64e411d53b5" status: 200 len: 1280 microversion: 2.1 time: 0.260229 Oct 26 13:14:20.228860 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1431/2810] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:19 2022] GET /compute/v2.1/servers/4f175b39-6703-43a3-a93b-e64e411d53b5 => generated 1280 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:20.323310 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-84722ce2-d38c-4457-910b-b45ea599cd94 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:20.323858 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-84722ce2-d38c-4457-910b-b45ea599cd94 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 9ae69130-8857-4d30-a434-6d8ca54f5cce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:20.338262 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-84722ce2-d38c-4457-910b-b45ea599cd94 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:20.342375 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-84722ce2-d38c-4457-910b-b45ea599cd94 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:20.347233 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-84722ce2-d38c-4457-910b-b45ea599cd94 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:20.348221 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-84722ce2-d38c-4457-910b-b45ea599cd94 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:20.354694 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-84722ce2-d38c-4457-910b-b45ea599cd94 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:20.355553 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-84722ce2-d38c-4457-910b-b45ea599cd94 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:20.677654 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-84722ce2-d38c-4457-910b-b45ea599cd94 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:20.693977 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-84722ce2-d38c-4457-910b-b45ea599cd94 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce" status: 200 len: 1514 microversion: 2.1 time: 0.374419 Oct 26 13:14:20.701975 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1380/2811] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:20 2022] GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce => generated 1514 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:20.905435 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-66fe5f81-1f28-44ee-8fb7-8ddea8a6f430 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '.version_select at 0x7f67319ea5e0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:20.992052 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-66fe5f81-1f28-44ee-8fb7-8ddea8a6f430 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938" status: 200 len: 1428 microversion: 2.1 time: 0.093267 Oct 26 13:14:21.010269 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1432/2812] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:14:20 2022] GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938 => generated 1428 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:21.219236 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ad4c363e-3b1c-4533-a5a9-e78f1124459f tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:21.219964 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ad4c363e-3b1c-4533-a5a9-e78f1124459f tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] [instance: 54ffeffd-483c-4d6d-8517-105a666e2402] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:21.230337 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad4c363e-3b1c-4533-a5a9-e78f1124459f tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:21.230969 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad4c363e-3b1c-4533-a5a9-e78f1124459f tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:21.235724 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad4c363e-3b1c-4533-a5a9-e78f1124459f tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:21.237314 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad4c363e-3b1c-4533-a5a9-e78f1124459f tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:21.238032 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad4c363e-3b1c-4533-a5a9-e78f1124459f tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:21.238680 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad4c363e-3b1c-4533-a5a9-e78f1124459f tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:21.258926 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f1afd789-5db0-455e-aa32-26aa34e4ee00 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:21.259533 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f1afd789-5db0-455e-aa32-26aa34e4ee00 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 4f175b39-6703-43a3-a93b-e64e411d53b5] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:21.269564 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1afd789-5db0-455e-aa32-26aa34e4ee00 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:21.270311 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1afd789-5db0-455e-aa32-26aa34e4ee00 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:21.270746 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1afd789-5db0-455e-aa32-26aa34e4ee00 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:21.271447 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1afd789-5db0-455e-aa32-26aa34e4ee00 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:21.271902 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1afd789-5db0-455e-aa32-26aa34e4ee00 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:21.272323 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1afd789-5db0-455e-aa32-26aa34e4ee00 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:21.353879 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ad4c363e-3b1c-4533-a5a9-e78f1124459f tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea62f9a8c1094cf6810848551cd4fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd40483e170343f5a02795c16d063066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:21.376455 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ad4c363e-3b1c-4533-a5a9-e78f1124459f tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] 10.222.0.40 "GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402" status: 200 len: 1253 microversion: 2.1 time: 0.161795 Oct 26 13:14:21.381727 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1381/2813] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:21 2022] GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402 => generated 1253 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:21.463465 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f1afd789-5db0-455e-aa32-26aa34e4ee00 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:21.472182 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f1afd789-5db0-455e-aa32-26aa34e4ee00 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/4f175b39-6703-43a3-a93b-e64e411d53b5" status: 200 len: 1280 microversion: 2.1 time: 0.217894 Oct 26 13:14:21.488740 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1433/2814] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:21 2022] GET /compute/v2.1/servers/4f175b39-6703-43a3-a93b-e64e411d53b5 => generated 1280 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:21.735289 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5705c46a-9484-48fe-8849-f9f5259860d5 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:21.736690 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5705c46a-9484-48fe-8849-f9f5259860d5 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 9ae69130-8857-4d30-a434-6d8ca54f5cce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:21.776640 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5705c46a-9484-48fe-8849-f9f5259860d5 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:21.777197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5705c46a-9484-48fe-8849-f9f5259860d5 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:21.777706 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5705c46a-9484-48fe-8849-f9f5259860d5 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:21.778467 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5705c46a-9484-48fe-8849-f9f5259860d5 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:21.784138 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5705c46a-9484-48fe-8849-f9f5259860d5 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:21.785518 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5705c46a-9484-48fe-8849-f9f5259860d5 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:22.016526 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8854bb3d-bc5f-4a17-80fe-22ce76fcd569 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '.version_select at 0x7f67319ea5e0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:22.141806 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8854bb3d-bc5f-4a17-80fe-22ce76fcd569 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938" status: 200 len: 1428 microversion: 2.1 time: 0.130839 Oct 26 13:14:22.149909 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1434/2815] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:14:22 2022] GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938 => generated 1428 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:22.405329 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-19238de0-e1d0-420d-a6bd-aba7138759a3 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:22.406343 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-19238de0-e1d0-420d-a6bd-aba7138759a3 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] [instance: 54ffeffd-483c-4d6d-8517-105a666e2402] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:22.416583 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-19238de0-e1d0-420d-a6bd-aba7138759a3 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:22.417749 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-19238de0-e1d0-420d-a6bd-aba7138759a3 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:22.418908 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-19238de0-e1d0-420d-a6bd-aba7138759a3 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:22.420528 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-19238de0-e1d0-420d-a6bd-aba7138759a3 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:22.421304 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-19238de0-e1d0-420d-a6bd-aba7138759a3 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:22.422370 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-19238de0-e1d0-420d-a6bd-aba7138759a3 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:22.547759 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-19238de0-e1d0-420d-a6bd-aba7138759a3 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea62f9a8c1094cf6810848551cd4fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd40483e170343f5a02795c16d063066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:22.575075 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-19238de0-e1d0-420d-a6bd-aba7138759a3 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] 10.222.0.40 "GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402" status: 200 len: 1253 microversion: 2.1 time: 0.176814 Oct 26 13:14:22.577280 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1435/2816] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:22 2022] GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402 => generated 1253 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:14:22.589157 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c02c6c6b-4bcc-4c9f-af03-04496a7cf60b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:22.590046 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c02c6c6b-4bcc-4c9f-af03-04496a7cf60b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 4f175b39-6703-43a3-a93b-e64e411d53b5] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:22.604703 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c02c6c6b-4bcc-4c9f-af03-04496a7cf60b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:22.605424 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c02c6c6b-4bcc-4c9f-af03-04496a7cf60b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:22.608694 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c02c6c6b-4bcc-4c9f-af03-04496a7cf60b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:22.610561 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c02c6c6b-4bcc-4c9f-af03-04496a7cf60b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:22.619227 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5705c46a-9484-48fe-8849-f9f5259860d5 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:22.627048 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c02c6c6b-4bcc-4c9f-af03-04496a7cf60b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:22.632315 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5705c46a-9484-48fe-8849-f9f5259860d5 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce" status: 200 len: 1514 microversion: 2.1 time: 0.904965 Oct 26 13:14:22.633130 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c02c6c6b-4bcc-4c9f-af03-04496a7cf60b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:22.650231 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1382/2817] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:21 2022] GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce => generated 1514 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:22.809243 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c02c6c6b-4bcc-4c9f-af03-04496a7cf60b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:22.819012 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c02c6c6b-4bcc-4c9f-af03-04496a7cf60b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/4f175b39-6703-43a3-a93b-e64e411d53b5" status: 200 len: 1286 microversion: 2.1 time: 0.240428 Oct 26 13:14:22.822489 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1436/2818] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:22 2022] GET /compute/v2.1/servers/4f175b39-6703-43a3-a93b-e64e411d53b5 => generated 1286 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:23.163713 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-36b18fd3-858d-4eb9-9ee5-d26a88993858 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '.version_select at 0x7f6732693550>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:23.235154 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-36b18fd3-858d-4eb9-9ee5-d26a88993858 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938" status: 200 len: 1428 microversion: 2.1 time: 0.075315 Oct 26 13:14:23.245855 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1383/2819] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:14:23 2022] GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938 => generated 1428 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:23.598598 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e46de179-c220-4381-bf74-45dab220d050 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:23.599507 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e46de179-c220-4381-bf74-45dab220d050 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] [instance: 54ffeffd-483c-4d6d-8517-105a666e2402] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:23.610900 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e46de179-c220-4381-bf74-45dab220d050 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:23.616564 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e46de179-c220-4381-bf74-45dab220d050 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:23.619963 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e46de179-c220-4381-bf74-45dab220d050 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:23.623051 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e46de179-c220-4381-bf74-45dab220d050 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:23.627680 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e46de179-c220-4381-bf74-45dab220d050 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:23.629789 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e46de179-c220-4381-bf74-45dab220d050 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:23.676213 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2d4d6fb2-1339-46fb-91be-d86c940f7bbb tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:23.677429 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2d4d6fb2-1339-46fb-91be-d86c940f7bbb tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 9ae69130-8857-4d30-a434-6d8ca54f5cce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:23.702761 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2d4d6fb2-1339-46fb-91be-d86c940f7bbb tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:23.703548 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2d4d6fb2-1339-46fb-91be-d86c940f7bbb tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:23.704105 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2d4d6fb2-1339-46fb-91be-d86c940f7bbb tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:23.706707 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2d4d6fb2-1339-46fb-91be-d86c940f7bbb tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:23.708627 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2d4d6fb2-1339-46fb-91be-d86c940f7bbb tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:23.711082 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2d4d6fb2-1339-46fb-91be-d86c940f7bbb tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:23.791631 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e46de179-c220-4381-bf74-45dab220d050 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:23.797622 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e46de179-c220-4381-bf74-45dab220d050 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:23.800625 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e46de179-c220-4381-bf74-45dab220d050 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:23.802824 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-e46de179-c220-4381-bf74-45dab220d050 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lazy-loading 'fault' on Instance uuid 54ffeffd-483c-4d6d-8517-105a666e2402 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:14:24.427505 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e46de179-c220-4381-bf74-45dab220d050 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea62f9a8c1094cf6810848551cd4fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd40483e170343f5a02795c16d063066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:24.440874 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e46de179-c220-4381-bf74-45dab220d050 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] 10.222.0.40 "GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402" status: 200 len: 1212 microversion: 2.1 time: 0.846073 Oct 26 13:14:24.441563 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1437/2820] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:23 2022] GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402 => generated 1212 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:14:24.446105 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-dfa55db1-d3b7-4515-8b46-04fd7b050fbe tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:24.446647 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-dfa55db1-d3b7-4515-8b46-04fd7b050fbe tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 4f175b39-6703-43a3-a93b-e64e411d53b5] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:24.474543 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dfa55db1-d3b7-4515-8b46-04fd7b050fbe tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:24.481440 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dfa55db1-d3b7-4515-8b46-04fd7b050fbe tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:24.489910 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dfa55db1-d3b7-4515-8b46-04fd7b050fbe tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:24.490920 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dfa55db1-d3b7-4515-8b46-04fd7b050fbe tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:24.494252 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dfa55db1-d3b7-4515-8b46-04fd7b050fbe tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:24.497359 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dfa55db1-d3b7-4515-8b46-04fd7b050fbe tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:24.506678 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2d4d6fb2-1339-46fb-91be-d86c940f7bbb tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:24.516115 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2d4d6fb2-1339-46fb-91be-d86c940f7bbb tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce" status: 200 len: 1520 microversion: 2.1 time: 0.845233 Oct 26 13:14:24.532631 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1384/2821] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:23 2022] GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce => generated 1520 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:24.550377 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-72177d2e-f944-475b-8c0e-d8a107e2e680 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '.version_select at 0x7f673231d550>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:24.642871 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-72177d2e-f944-475b-8c0e-d8a107e2e680 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938" status: 200 len: 1428 microversion: 2.1 time: 0.108855 Oct 26 13:14:24.643828 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1385/2822] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:14:24 2022] GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938 => generated 1428 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:24.836034 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-dfa55db1-d3b7-4515-8b46-04fd7b050fbe tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:24.851282 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-dfa55db1-d3b7-4515-8b46-04fd7b050fbe tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/4f175b39-6703-43a3-a93b-e64e411d53b5" status: 200 len: 1328 microversion: 2.1 time: 0.406968 Oct 26 13:14:24.866371 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1438/2823] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:24 2022] GET /compute/v2.1/servers/4f175b39-6703-43a3-a93b-e64e411d53b5 => generated 1328 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:25.137630 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-b06b4d51-5d85-45cc-8560-e37e4994baed req-7f7ac08b-2d2a-4247-91a1-3d4b4f9bb5ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f175b39-6703-43a3-a93b-e64e411d53b5", "tag": "c19db2ad-ad1d-4563-9cee-7daf42934acf"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:14:25.163326 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-b06b4d51-5d85-45cc-8560-e37e4994baed req-7f7ac08b-2d2a-4247-91a1-3d4b4f9bb5ef service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:25.163832 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-b06b4d51-5d85-45cc-8560-e37e4994baed req-7f7ac08b-2d2a-4247-91a1-3d4b4f9bb5ef service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:25.164217 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-b06b4d51-5d85-45cc-8560-e37e4994baed req-7f7ac08b-2d2a-4247-91a1-3d4b4f9bb5ef service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:25.181006 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-b06b4d51-5d85-45cc-8560-e37e4994baed req-7f7ac08b-2d2a-4247-91a1-3d4b4f9bb5ef service nova] Creating event network-changed:c19db2ad-ad1d-4563-9cee-7daf42934acf for instance 4f175b39-6703-43a3-a93b-e64e411d53b5 on n-h1-862686-1 Oct 26 13:14:25.195415 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-b06b4d51-5d85-45cc-8560-e37e4994baed req-7f7ac08b-2d2a-4247-91a1-3d4b4f9bb5ef service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061897 Oct 26 13:14:25.200108 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1386/2824] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:14:25.465350 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-72af81b3-3118-46dc-b67e-290c3bbf1f34 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:25.466067 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-72af81b3-3118-46dc-b67e-290c3bbf1f34 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] [instance: 54ffeffd-483c-4d6d-8517-105a666e2402] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:25.478563 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72af81b3-3118-46dc-b67e-290c3bbf1f34 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:25.481142 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72af81b3-3118-46dc-b67e-290c3bbf1f34 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:25.483533 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72af81b3-3118-46dc-b67e-290c3bbf1f34 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:25.485007 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72af81b3-3118-46dc-b67e-290c3bbf1f34 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:25.486684 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72af81b3-3118-46dc-b67e-290c3bbf1f34 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:25.487614 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72af81b3-3118-46dc-b67e-290c3bbf1f34 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:25.523555 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-72af81b3-3118-46dc-b67e-290c3bbf1f34 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] HTTP exception thrown: Instance 54ffeffd-483c-4d6d-8517-105a666e2402 could not be found. Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-72af81b3-3118-46dc-b67e-290c3bbf1f34 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Request method failure captured: Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402 HTTP/1.1 Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTIigJdNydNQiLxZxhE5NJJeQdi7P3KEWyaEY85MElkyU44kRusfnO-dsYm2lE74eW_Ul6U2ojhAHU1gl8-faEixK6_Mgjl5FsI1xUPhcWol3SmHOuEHTAWV7XLTMeLWbENa9PbjNx8kDAYNQe0KvqpbkDkaL5kf2a1arA3dDcCPqss Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: fd40483e170343f5a02795c16d063066 Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersTestBootFromVolume-2068515750 Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fd40483e170343f5a02795c16d063066"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fd40483e170343f5a02795c16d063066"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fd40483e170343f5a02795c16d063066"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fd40483e170343f5a02795c16d063066"}]}] Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersTestBootFromVolume-2068515750 Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: fd40483e170343f5a02795c16d063066 Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersTestBootFromVolume-2068515750 Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersTestBootFromVolume-2068515750-project Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: ea62f9a8c1094cf6810848551cd4fd18 Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersTestBootFromVolume-2068515750-project Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 54ffeffd-483c-4d6d-8517-105a666e2402 could not be found. Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '54ffeffd-483c-4d6d-8517-105a666e2402'} Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54ffeffd-483c-4d6d-8517-105a666e2402 could not be found. Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54ffeffd-483c-4d6d-8517-105a666e2402 could not be found. Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:14:25.525719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:14:25.531210 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:14:25.531210 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:14:25.531210 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:14:25.531210 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:14:25.531210 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:14:25.531210 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54ffeffd-483c-4d6d-8517-105a666e2402 could not be found. Oct 26 13:14:25.531210 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:14:25.536963 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-72af81b3-3118-46dc-b67e-290c3bbf1f34 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Returning 404 to user: Instance 54ffeffd-483c-4d6d-8517-105a666e2402 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:14:25.538398 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-72af81b3-3118-46dc-b67e-290c3bbf1f34 tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] 10.222.0.40 "GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402" status: 404 len: 111 microversion: 2.1 time: 0.077165 Oct 26 13:14:25.539929 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1439/2825] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:25 2022] GET /compute/v2.1/servers/54ffeffd-483c-4d6d-8517-105a666e2402 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:14:25.552788 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7feb09d3-728e-4b09-8cc1-38eb0430527a tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] Calling method '.version_select at 0x7f673231daf0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:25.556809 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-143ffcb7-d6d3-4c60-bd20-3139281f28a8 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:25.557423 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-143ffcb7-d6d3-4c60-bd20-3139281f28a8 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 9ae69130-8857-4d30-a434-6d8ca54f5cce] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:25.564321 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-143ffcb7-d6d3-4c60-bd20-3139281f28a8 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:25.565184 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-143ffcb7-d6d3-4c60-bd20-3139281f28a8 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:25.565805 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-143ffcb7-d6d3-4c60-bd20-3139281f28a8 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:25.566677 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-143ffcb7-d6d3-4c60-bd20-3139281f28a8 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:25.567294 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-143ffcb7-d6d3-4c60-bd20-3139281f28a8 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:25.567875 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-143ffcb7-d6d3-4c60-bd20-3139281f28a8 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:25.600384 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7feb09d3-728e-4b09-8cc1-38eb0430527a tempest-ServersTestBootFromVolume-2068515750 tempest-ServersTestBootFromVolume-2068515750-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1448237638" status: 202 len: 0 microversion: 2.1 time: 0.055903 Oct 26 13:14:25.601234 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1387/2826] 10.222.0.40 () {58 vars in 1221 bytes} [Wed Oct 26 13:14:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1448237638 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:14:25.660532 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a01586de-3476-47d1-bf6a-cacb54e3c748 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '.version_select at 0x7f6732674ee0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:25.753031 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a01586de-3476-47d1-bf6a-cacb54e3c748 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938" status: 200 len: 1428 microversion: 2.1 time: 0.096131 Oct 26 13:14:25.758966 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1388/2827] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:14:25 2022] GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938 => generated 1428 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:25.876032 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5dc14aa4-85c9-4587-8b1b-b35acf22ace2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:25.877201 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5dc14aa4-85c9-4587-8b1b-b35acf22ace2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 4f175b39-6703-43a3-a93b-e64e411d53b5] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:25.891850 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5dc14aa4-85c9-4587-8b1b-b35acf22ace2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:25.892696 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5dc14aa4-85c9-4587-8b1b-b35acf22ace2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:25.893308 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5dc14aa4-85c9-4587-8b1b-b35acf22ace2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:25.894217 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5dc14aa4-85c9-4587-8b1b-b35acf22ace2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:25.894837 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5dc14aa4-85c9-4587-8b1b-b35acf22ace2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:25.897961 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5dc14aa4-85c9-4587-8b1b-b35acf22ace2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:26.273246 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-143ffcb7-d6d3-4c60-bd20-3139281f28a8 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:26.277764 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:14:26.298366 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-143ffcb7-d6d3-4c60-bd20-3139281f28a8 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce" status: 200 len: 1520 microversion: 2.1 time: 0.745484 Oct 26 13:14:26.299022 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1440/2828] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:25 2022] GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce => generated 1520 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:26.480977 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5dc14aa4-85c9-4587-8b1b-b35acf22ace2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:26.495794 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5dc14aa4-85c9-4587-8b1b-b35acf22ace2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/4f175b39-6703-43a3-a93b-e64e411d53b5" status: 200 len: 1328 microversion: 2.1 time: 0.624075 Oct 26 13:14:26.498221 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1389/2829] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:25 2022] GET /compute/v2.1/servers/4f175b39-6703-43a3-a93b-e64e411d53b5 => generated 1328 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:14:26.780122 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2255d255-91e3-41be-8add-0e494ed5b16f tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '.version_select at 0x7f67318f1af0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:26.864712 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2255d255-91e3-41be-8add-0e494ed5b16f tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938" status: 200 len: 1437 microversion: 2.1 time: 0.092823 Oct 26 13:14:26.867955 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1441/2830] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:14:26 2022] GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938 => generated 1437 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:26.883861 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c069192b-dbac-4406-b76d-3568bdfdb136 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '.version_select at 0x7f6732674310>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:26.979211 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c069192b-dbac-4406-b76d-3568bdfdb136 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938" status: 200 len: 1437 microversion: 2.1 time: 0.099373 Oct 26 13:14:26.981170 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1390/2831] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:14:26 2022] GET /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938 => generated 1437 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:26.999327 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7f2e33c7-02b6-46be-86b7-89967f3ed32c tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:26.999952 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7f2e33c7-02b6-46be-86b7-89967f3ed32c tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] [instance: 0dd070a1-a68f-4c94-9244-d59c94d109f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:27.008354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f2e33c7-02b6-46be-86b7-89967f3ed32c tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:27.010563 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f2e33c7-02b6-46be-86b7-89967f3ed32c tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:27.011014 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f2e33c7-02b6-46be-86b7-89967f3ed32c tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:27.011824 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f2e33c7-02b6-46be-86b7-89967f3ed32c tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:27.012307 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f2e33c7-02b6-46be-86b7-89967f3ed32c tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:27.012733 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f2e33c7-02b6-46be-86b7-89967f3ed32c tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:27.051574 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-8f09f8f2-46ac-4ba0-bd17-018b3960e4b4 req-7c5e6919-f693-4618-9178-528a987d0e54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ae69130-8857-4d30-a434-6d8ca54f5cce", "name": "network-vif-unplugged", "status": "completed", "tag": "874b6621-32e1-4309-945a-0d50400c3292"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:14:27.072223 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-8f09f8f2-46ac-4ba0-bd17-018b3960e4b4 req-7c5e6919-f693-4618-9178-528a987d0e54 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:27.072705 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-8f09f8f2-46ac-4ba0-bd17-018b3960e4b4 req-7c5e6919-f693-4618-9178-528a987d0e54 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:27.073304 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-8f09f8f2-46ac-4ba0-bd17-018b3960e4b4 req-7c5e6919-f693-4618-9178-528a987d0e54 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:27.087366 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-8f09f8f2-46ac-4ba0-bd17-018b3960e4b4 req-7c5e6919-f693-4618-9178-528a987d0e54 service nova] Creating event network-vif-unplugged:874b6621-32e1-4309-945a-0d50400c3292 for instance 9ae69130-8857-4d30-a434-6d8ca54f5cce on n-h1-862686-1 Oct 26 13:14:27.092620 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-8f09f8f2-46ac-4ba0-bd17-018b3960e4b4 req-7c5e6919-f693-4618-9178-528a987d0e54 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055032 Oct 26 13:14:27.093565 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1391/2832] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:14:27.322833 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a801dec2-7040-48a3-af29-63a27320c2c1 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:27.324125 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a801dec2-7040-48a3-af29-63a27320c2c1 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 9ae69130-8857-4d30-a434-6d8ca54f5cce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:27.337354 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a801dec2-7040-48a3-af29-63a27320c2c1 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:27.339128 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a801dec2-7040-48a3-af29-63a27320c2c1 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:27.339774 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a801dec2-7040-48a3-af29-63a27320c2c1 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:27.340677 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a801dec2-7040-48a3-af29-63a27320c2c1 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:27.341556 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a801dec2-7040-48a3-af29-63a27320c2c1 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:27.345445 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7f2e33c7-02b6-46be-86b7-89967f3ed32c tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6815934fa00041fba4d2a88b3648eb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fffeaed862d4dfe9abdc2c36a66a0cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:27.356159 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7f2e33c7-02b6-46be-86b7-89967f3ed32c tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9" status: 200 len: 1465 microversion: 2.1 time: 0.363845 Oct 26 13:14:27.356592 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a801dec2-7040-48a3-af29-63a27320c2c1 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:27.374898 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1442/2833] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:26 2022] GET /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9 => generated 1465 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:27.390992 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-019f170e-f705-474e-b190-36ba6fc54a6c tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '.version_select at 0x7f67318f68b0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:28.142054 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a801dec2-7040-48a3-af29-63a27320c2c1 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:28.151877 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a801dec2-7040-48a3-af29-63a27320c2c1 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce" status: 200 len: 1520 microversion: 2.1 time: 0.833411 Oct 26 13:14:28.158535 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1392/2834] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:27 2022] GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce => generated 1520 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:28.163768 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cd6c6f6e-3465-42eb-a90d-8f72f4d109c8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:28.168036 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cd6c6f6e-3465-42eb-a90d-8f72f4d109c8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 4f175b39-6703-43a3-a93b-e64e411d53b5] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:28.180802 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cd6c6f6e-3465-42eb-a90d-8f72f4d109c8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:28.183696 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cd6c6f6e-3465-42eb-a90d-8f72f4d109c8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:28.190092 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cd6c6f6e-3465-42eb-a90d-8f72f4d109c8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:28.193202 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cd6c6f6e-3465-42eb-a90d-8f72f4d109c8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:28.193875 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cd6c6f6e-3465-42eb-a90d-8f72f4d109c8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:28.198454 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cd6c6f6e-3465-42eb-a90d-8f72f4d109c8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:28.398140 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:14:28.457106 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=10 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:14:28.619418 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-019f170e-f705-474e-b190-36ba6fc54a6c tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "DELETE /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938" status: 204 len: 0 microversion: 2.1 time: 1.233133 Oct 26 13:14:28.623093 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1443/2835] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:27 2022] DELETE /compute/v2.1/images/07e09c94-149c-42e8-b068-0f8ec7291938 => generated 0 bytes in 1235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:14:28.630772 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-24520bd5-ecf1-49a8-af11-c91cb8604d20 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '.version_select at 0x7f6731939af0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:28.654919 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-24520bd5-ecf1-49a8-af11-c91cb8604d20 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] HTTP exception thrown: Image not found. Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-24520bd5-ecf1-49a8-af11-c91cb8604d20 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Request method failure captured: Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: request: DELETE /compute/v2.1/images/5776a9e0-e1dd-4524-89a1-d9ff0baf64b1 HTTP/1.1 Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTJL5lHYu_BV_ImvUPhmtF9YowoD8VrGQ6jACMWHvb37jk754h0O62bBHoPQi5Gy1PKg3iI5kMBDBUv0iI8qAy8L083ulIiE2f8D9ojNPnpAoRIbEU6GPrsQgaYcQfUcUFIAvwmbCRRUzNJ0dy8ZePj3TJnDq7Jk9f9IlVtEOO9d5eE Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 1fffeaed862d4dfe9abdc2c36a66a0cc Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ImagesOneServerTestJSON-1487843474 Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1fffeaed862d4dfe9abdc2c36a66a0cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fffeaed862d4dfe9abdc2c36a66a0cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1fffeaed862d4dfe9abdc2c36a66a0cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fffeaed862d4dfe9abdc2c36a66a0cc"}]}] Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ImagesOneServerTestJSON-1487843474 Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 1fffeaed862d4dfe9abdc2c36a66a0cc Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1487843474 Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ImagesOneServerTestJSON-1487843474-project Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 6815934fa00041fba4d2a88b3648eb07 Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ImagesOneServerTestJSON-1487843474-project Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: exception: Image not found. Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '5776a9e0-e1dd-4524-89a1-d9ff0baf64b1'} Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5776a9e0-e1dd-4524-89a1-d9ff0baf64b1 to delete Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5776a9e0-e1dd-4524-89a1-d9ff0baf64b1 could not be found. Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:14:28.666958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:14:28.672524 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:14:28.672524 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:14:28.672524 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:14:28.672524 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:14:28.672524 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:14:28.672524 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:14:28.672524 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:14:28.672524 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:14:28.672524 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 26 13:14:28.672524 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 26 13:14:28.672524 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 26 13:14:28.672524 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:14:28.672524 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:14:28.672524 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:14:28.672524 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:14:28.672524 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:14:28.672524 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:14:28.672524 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:14:28.672524 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:14:28.672524 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 26 13:14:28.672524 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:14:28.677931 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-24520bd5-ecf1-49a8-af11-c91cb8604d20 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Returning 404 to user: Image not found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:14:28.678954 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-24520bd5-ecf1-49a8-af11-c91cb8604d20 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "DELETE /compute/v2.1/images/5776a9e0-e1dd-4524-89a1-d9ff0baf64b1" status: 404 len: 62 microversion: 2.1 time: 0.054399 Oct 26 13:14:28.679540 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1444/2836] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:28 2022] DELETE /compute/v2.1/images/5776a9e0-e1dd-4524-89a1-d9ff0baf64b1 => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:14:28.691541 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-43b992a5-88a2-4839-a0ed-64b127e329a8 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:28.692142 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-43b992a5-88a2-4839-a0ed-64b127e329a8 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] [instance: 0dd070a1-a68f-4c94-9244-d59c94d109f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:28.706965 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-43b992a5-88a2-4839-a0ed-64b127e329a8 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:28.710258 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-43b992a5-88a2-4839-a0ed-64b127e329a8 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:28.712088 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-43b992a5-88a2-4839-a0ed-64b127e329a8 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:28.714898 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-43b992a5-88a2-4839-a0ed-64b127e329a8 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:28.717315 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-43b992a5-88a2-4839-a0ed-64b127e329a8 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:28.718022 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-43b992a5-88a2-4839-a0ed-64b127e329a8 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:28.775143 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-43b992a5-88a2-4839-a0ed-64b127e329a8 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] [instance: 0dd070a1-a68f-4c94-9244-d59c94d109f9] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:14:28.933078 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:14:28.953107 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-43b992a5-88a2-4839-a0ed-64b127e329a8 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9" status: 204 len: 0 microversion: 2.1 time: 0.269038 Oct 26 13:14:28.954226 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1445/2837] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:14:28 2022] DELETE /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:14:28.963482 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ae7dcab5-e0bc-4651-a0b3-0ccf3bb565cc tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:28.966062 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ae7dcab5-e0bc-4651-a0b3-0ccf3bb565cc tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] [instance: 0dd070a1-a68f-4c94-9244-d59c94d109f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:28.982892 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae7dcab5-e0bc-4651-a0b3-0ccf3bb565cc tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:28.983582 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae7dcab5-e0bc-4651-a0b3-0ccf3bb565cc tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:28.984041 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae7dcab5-e0bc-4651-a0b3-0ccf3bb565cc tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:28.984780 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae7dcab5-e0bc-4651-a0b3-0ccf3bb565cc tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:28.990298 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae7dcab5-e0bc-4651-a0b3-0ccf3bb565cc tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:28.991049 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae7dcab5-e0bc-4651-a0b3-0ccf3bb565cc tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:29.042663 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cd6c6f6e-3465-42eb-a90d-8f72f4d109c8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:29.059110 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cd6c6f6e-3465-42eb-a90d-8f72f4d109c8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/4f175b39-6703-43a3-a93b-e64e411d53b5" status: 200 len: 1328 microversion: 2.1 time: 0.899094 Oct 26 13:14:29.086474 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1393/2838] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:28 2022] GET /compute/v2.1/servers/4f175b39-6703-43a3-a93b-e64e411d53b5 => generated 1328 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:29.190616 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-74c0431c-83a9-4eb8-ab8a-3a289b7d7dde tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:29.195236 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-74c0431c-83a9-4eb8-ab8a-3a289b7d7dde tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 9ae69130-8857-4d30-a434-6d8ca54f5cce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:29.219434 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-74c0431c-83a9-4eb8-ab8a-3a289b7d7dde tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:29.221856 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-74c0431c-83a9-4eb8-ab8a-3a289b7d7dde tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:29.224306 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-74c0431c-83a9-4eb8-ab8a-3a289b7d7dde tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:29.225391 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-74c0431c-83a9-4eb8-ab8a-3a289b7d7dde tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:29.229003 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-74c0431c-83a9-4eb8-ab8a-3a289b7d7dde tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:29.229922 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-74c0431c-83a9-4eb8-ab8a-3a289b7d7dde tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:29.683498 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ae7dcab5-e0bc-4651-a0b3-0ccf3bb565cc tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6815934fa00041fba4d2a88b3648eb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fffeaed862d4dfe9abdc2c36a66a0cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:29.699953 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ae7dcab5-e0bc-4651-a0b3-0ccf3bb565cc tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9" status: 200 len: 1471 microversion: 2.1 time: 0.741543 Oct 26 13:14:29.701082 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1446/2839] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:28 2022] GET /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9 => generated 1471 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:14:29.843213 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-74c0431c-83a9-4eb8-ab8a-3a289b7d7dde tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:29.852166 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-74c0431c-83a9-4eb8-ab8a-3a289b7d7dde tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce" status: 200 len: 1520 microversion: 2.1 time: 0.669184 Oct 26 13:14:29.858781 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1394/2840] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:29 2022] GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce => generated 1520 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:30.088893 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-13973aa3-408d-419d-944e-02de92fa67af tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:30.091009 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-13973aa3-408d-419d-944e-02de92fa67af tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 4f175b39-6703-43a3-a93b-e64e411d53b5] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:30.108481 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-13973aa3-408d-419d-944e-02de92fa67af tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:30.112561 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-13973aa3-408d-419d-944e-02de92fa67af tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:30.115522 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-13973aa3-408d-419d-944e-02de92fa67af tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:30.118707 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-13973aa3-408d-419d-944e-02de92fa67af tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:30.120975 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-13973aa3-408d-419d-944e-02de92fa67af tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:30.123128 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-13973aa3-408d-419d-944e-02de92fa67af tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:30.389885 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b1fc4a02-6cda-4600-a355-eb4daae081db tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Action: 'create', calling method: .version_select at 0x7f6732264160>, body: {"keypair": {"name": "tempest-keypair-1732132591", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwB+l6mn0H9hub17Clo4yl2M/e0LlGRQHOzx/ivgnIuDpuW+xB5HLEgB2PQqrYAQV5jfOMzpuh7VllEdmuKOCCZUq0FbemFgAb74xcDsCgeMAfLeDUjvKO3srqpNYXHyQ=="}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:14:30.450180 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-b1fc4a02-6cda-4600-a355-eb4daae081db tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Getting quotas for project de138b5bb5ac44c9be139ab7ceb26a32. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:14:30.469635 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-b1fc4a02-6cda-4600-a355-eb4daae081db tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Getting quotas for user d09f69ec8c514a6789ede382cdbdbebb and project de138b5bb5ac44c9be139ab7ceb26a32. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:14:30.552190 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b1fc4a02-6cda-4600-a355-eb4daae081db tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.167743 Oct 26 13:14:30.552818 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1395/2841] 10.222.0.40 () {62 vars in 1200 bytes} [Wed Oct 26 13:14:30 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 169 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 26 13:14:30.560634 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-13973aa3-408d-419d-944e-02de92fa67af tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:30.574412 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-13973aa3-408d-419d-944e-02de92fa67af tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/4f175b39-6703-43a3-a93b-e64e411d53b5" status: 200 len: 1328 microversion: 2.1 time: 0.490572 Oct 26 13:14:30.585549 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1447/2842] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:30 2022] GET /compute/v2.1/servers/4f175b39-6703-43a3-a93b-e64e411d53b5 => generated 1328 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:30.726897 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d407b41c-bd38-4877-97d3-9b8a17f46ba4 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:30.727524 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d407b41c-bd38-4877-97d3-9b8a17f46ba4 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] [instance: 0dd070a1-a68f-4c94-9244-d59c94d109f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:30.752438 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d407b41c-bd38-4877-97d3-9b8a17f46ba4 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:30.754542 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d407b41c-bd38-4877-97d3-9b8a17f46ba4 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:30.756170 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d407b41c-bd38-4877-97d3-9b8a17f46ba4 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:30.760414 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d407b41c-bd38-4877-97d3-9b8a17f46ba4 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:30.761960 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d407b41c-bd38-4877-97d3-9b8a17f46ba4 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:30.762878 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d407b41c-bd38-4877-97d3-9b8a17f46ba4 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:30.886996 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7e5ebbfd-b036-41c4-b494-276222c4ef7a tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:30.887613 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7e5ebbfd-b036-41c4-b494-276222c4ef7a tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 9ae69130-8857-4d30-a434-6d8ca54f5cce] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:30.904256 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e5ebbfd-b036-41c4-b494-276222c4ef7a tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:30.906496 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e5ebbfd-b036-41c4-b494-276222c4ef7a tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:30.906935 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e5ebbfd-b036-41c4-b494-276222c4ef7a tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:30.910835 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e5ebbfd-b036-41c4-b494-276222c4ef7a tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:30.911317 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e5ebbfd-b036-41c4-b494-276222c4ef7a tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:30.914068 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e5ebbfd-b036-41c4-b494-276222c4ef7a tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:31.238163 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d407b41c-bd38-4877-97d3-9b8a17f46ba4 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6815934fa00041fba4d2a88b3648eb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fffeaed862d4dfe9abdc2c36a66a0cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:31.249870 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d407b41c-bd38-4877-97d3-9b8a17f46ba4 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9" status: 200 len: 1471 microversion: 2.1 time: 0.529914 Oct 26 13:14:31.250845 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1396/2843] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:30 2022] GET /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9 => generated 1471 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:31.288399 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-40b183b7-4a8a-4e9a-95f9-a45218d9ca18 req-851d1ffc-99ab-487e-a5b5-b805767d7b44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dd070a1-a68f-4c94-9244-d59c94d109f9", "name": "network-vif-unplugged", "status": "completed", "tag": "099ba429-75b7-4428-a8bf-6d2540652296"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:14:31.307631 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-40b183b7-4a8a-4e9a-95f9-a45218d9ca18 req-851d1ffc-99ab-487e-a5b5-b805767d7b44 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:31.310394 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-40b183b7-4a8a-4e9a-95f9-a45218d9ca18 req-851d1ffc-99ab-487e-a5b5-b805767d7b44 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:31.311139 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-40b183b7-4a8a-4e9a-95f9-a45218d9ca18 req-851d1ffc-99ab-487e-a5b5-b805767d7b44 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:31.337304 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-40b183b7-4a8a-4e9a-95f9-a45218d9ca18 req-851d1ffc-99ab-487e-a5b5-b805767d7b44 service nova] Creating event network-vif-unplugged:099ba429-75b7-4428-a8bf-6d2540652296 for instance 0dd070a1-a68f-4c94-9244-d59c94d109f9 on n-h2-862686-1 Oct 26 13:14:31.349973 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-40b183b7-4a8a-4e9a-95f9-a45218d9ca18 req-851d1ffc-99ab-487e-a5b5-b805767d7b44 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065341 Oct 26 13:14:31.357223 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1397/2844] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:14:31.383518 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7e5ebbfd-b036-41c4-b494-276222c4ef7a tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:31.417127 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7e5ebbfd-b036-41c4-b494-276222c4ef7a tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce" status: 200 len: 1520 microversion: 2.1 time: 0.533208 Oct 26 13:14:31.422392 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1448/2845] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:30 2022] GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce => generated 1520 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:14:31.602107 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6800733f-b572-496c-ae38-b24183c6f3a7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:31.603682 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6800733f-b572-496c-ae38-b24183c6f3a7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 4f175b39-6703-43a3-a93b-e64e411d53b5] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:31.611621 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6800733f-b572-496c-ae38-b24183c6f3a7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:31.612482 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6800733f-b572-496c-ae38-b24183c6f3a7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:31.613265 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6800733f-b572-496c-ae38-b24183c6f3a7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:31.614345 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6800733f-b572-496c-ae38-b24183c6f3a7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:31.615086 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6800733f-b572-496c-ae38-b24183c6f3a7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:31.615762 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6800733f-b572-496c-ae38-b24183c6f3a7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:31.662969 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:14:32.280195 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fe932db6-5dd2-499f-9393-61e11631430a tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:32.282197 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fe932db6-5dd2-499f-9393-61e11631430a tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] [instance: 0dd070a1-a68f-4c94-9244-d59c94d109f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:32.297394 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe932db6-5dd2-499f-9393-61e11631430a tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:32.298273 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe932db6-5dd2-499f-9393-61e11631430a tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:32.307524 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe932db6-5dd2-499f-9393-61e11631430a tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:32.308538 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe932db6-5dd2-499f-9393-61e11631430a tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:32.309264 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe932db6-5dd2-499f-9393-61e11631430a tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:32.310343 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe932db6-5dd2-499f-9393-61e11631430a tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:32.425000 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6800733f-b572-496c-ae38-b24183c6f3a7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:32.434043 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6800733f-b572-496c-ae38-b24183c6f3a7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/4f175b39-6703-43a3-a93b-e64e411d53b5" status: 200 len: 1328 microversion: 2.1 time: 0.837519 Oct 26 13:14:32.437299 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1398/2846] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:31 2022] GET /compute/v2.1/servers/4f175b39-6703-43a3-a93b-e64e411d53b5 => generated 1328 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:32.454713 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6cd6ebd0-3bf6-4330-a6e1-fdaa76e83275 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:32.455233 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6cd6ebd0-3bf6-4330-a6e1-fdaa76e83275 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 9ae69130-8857-4d30-a434-6d8ca54f5cce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:32.470896 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6cd6ebd0-3bf6-4330-a6e1-fdaa76e83275 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:32.471363 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6cd6ebd0-3bf6-4330-a6e1-fdaa76e83275 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:32.471901 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6cd6ebd0-3bf6-4330-a6e1-fdaa76e83275 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:32.475556 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6cd6ebd0-3bf6-4330-a6e1-fdaa76e83275 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:32.476039 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6cd6ebd0-3bf6-4330-a6e1-fdaa76e83275 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:32.476607 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6cd6ebd0-3bf6-4330-a6e1-fdaa76e83275 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:32.549965 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fe932db6-5dd2-499f-9393-61e11631430a tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6815934fa00041fba4d2a88b3648eb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fffeaed862d4dfe9abdc2c36a66a0cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:32.565431 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fe932db6-5dd2-499f-9393-61e11631430a tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9" status: 200 len: 1429 microversion: 2.1 time: 0.292175 Oct 26 13:14:32.596098 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1449/2847] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:32 2022] GET /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9 => generated 1429 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:14:32.604130 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-eb4deaba-5e49-4c42-b0e0-408a907d026a req-24dbb29a-84ae-4100-94e4-8ddfa7c3f9f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dd070a1-a68f-4c94-9244-d59c94d109f9", "name": "network-vif-deleted", "tag": "099ba429-75b7-4428-a8bf-6d2540652296"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:14:32.622570 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-eb4deaba-5e49-4c42-b0e0-408a907d026a req-24dbb29a-84ae-4100-94e4-8ddfa7c3f9f3 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:32.623361 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-eb4deaba-5e49-4c42-b0e0-408a907d026a req-24dbb29a-84ae-4100-94e4-8ddfa7c3f9f3 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:32.623945 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-eb4deaba-5e49-4c42-b0e0-408a907d026a req-24dbb29a-84ae-4100-94e4-8ddfa7c3f9f3 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:32.642045 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-eb4deaba-5e49-4c42-b0e0-408a907d026a req-24dbb29a-84ae-4100-94e4-8ddfa7c3f9f3 service nova] Creating event network-vif-deleted:099ba429-75b7-4428-a8bf-6d2540652296 for instance 0dd070a1-a68f-4c94-9244-d59c94d109f9 on n-h2-862686-1 Oct 26 13:14:32.665631 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-eb4deaba-5e49-4c42-b0e0-408a907d026a req-24dbb29a-84ae-4100-94e4-8ddfa7c3f9f3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064329 Oct 26 13:14:32.669029 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1450/2848] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:14:32.846420 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6cd6ebd0-3bf6-4330-a6e1-fdaa76e83275 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:32.861940 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6cd6ebd0-3bf6-4330-a6e1-fdaa76e83275 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce" status: 200 len: 1520 microversion: 2.1 time: 0.415496 Oct 26 13:14:32.890660 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1399/2849] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:32 2022] GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce => generated 1520 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:33.392151 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-f67345c5-fd39-4aeb-bea3-54c843161747 req-5acee5df-798b-4d86-aed5-a54dbcc20290 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ae69130-8857-4d30-a434-6d8ca54f5cce", "name": "network-vif-plugged", "status": "completed", "tag": "874b6621-32e1-4309-945a-0d50400c3292"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:14:33.411857 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f67345c5-fd39-4aeb-bea3-54c843161747 req-5acee5df-798b-4d86-aed5-a54dbcc20290 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:33.419063 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f67345c5-fd39-4aeb-bea3-54c843161747 req-5acee5df-798b-4d86-aed5-a54dbcc20290 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:33.421105 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f67345c5-fd39-4aeb-bea3-54c843161747 req-5acee5df-798b-4d86-aed5-a54dbcc20290 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:33.445929 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-f67345c5-fd39-4aeb-bea3-54c843161747 req-5acee5df-798b-4d86-aed5-a54dbcc20290 service nova] Creating event network-vif-plugged:874b6621-32e1-4309-945a-0d50400c3292 for instance 9ae69130-8857-4d30-a434-6d8ca54f5cce on n-h1-862686-1 Oct 26 13:14:33.460453 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-f67345c5-fd39-4aeb-bea3-54c843161747 req-5acee5df-798b-4d86-aed5-a54dbcc20290 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075551 Oct 26 13:14:33.461830 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1451/2850] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:14:33.463022 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-852762d7-e175-4990-b4a2-648d1d1c07f2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:33.463743 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-852762d7-e175-4990-b4a2-648d1d1c07f2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 4f175b39-6703-43a3-a93b-e64e411d53b5] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:33.483657 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-852762d7-e175-4990-b4a2-648d1d1c07f2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:33.487987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-852762d7-e175-4990-b4a2-648d1d1c07f2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:33.492986 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-852762d7-e175-4990-b4a2-648d1d1c07f2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:33.494201 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-852762d7-e175-4990-b4a2-648d1d1c07f2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:33.495096 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-852762d7-e175-4990-b4a2-648d1d1c07f2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:33.496246 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-852762d7-e175-4990-b4a2-648d1d1c07f2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:33.597821 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-166e59da-3565-4113-97a4-a4bd89e38628 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:33.598555 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-166e59da-3565-4113-97a4-a4bd89e38628 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] [instance: 0dd070a1-a68f-4c94-9244-d59c94d109f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:33.630717 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-166e59da-3565-4113-97a4-a4bd89e38628 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:33.631259 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-166e59da-3565-4113-97a4-a4bd89e38628 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:33.639186 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-166e59da-3565-4113-97a4-a4bd89e38628 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:33.643205 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-166e59da-3565-4113-97a4-a4bd89e38628 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:33.646938 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-166e59da-3565-4113-97a4-a4bd89e38628 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:33.648847 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-166e59da-3565-4113-97a4-a4bd89e38628 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:33.693019 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-166e59da-3565-4113-97a4-a4bd89e38628 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] HTTP exception thrown: Instance 0dd070a1-a68f-4c94-9244-d59c94d109f9 could not be found. Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-166e59da-3565-4113-97a4-a4bd89e38628 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Request method failure captured: Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9 HTTP/1.1 Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTJL5lHYu_BV_ImvUPhmtF9YowoD8VrGQ6jACMWHvb37jk754h0O62bBHoPQi5Gy1PKg3iI5kMBDBUv0iI8qAy8L083ulIiE2f8D9ojNPnpAoRIbEU6GPrsQgaYcQfUcUFIAvwmbCRRUzNJ0dy8ZePj3TJnDq7Jk9f9IlVtEOO9d5eE Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 1fffeaed862d4dfe9abdc2c36a66a0cc Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ImagesOneServerTestJSON-1487843474 Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1fffeaed862d4dfe9abdc2c36a66a0cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fffeaed862d4dfe9abdc2c36a66a0cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1fffeaed862d4dfe9abdc2c36a66a0cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fffeaed862d4dfe9abdc2c36a66a0cc"}]}] Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ImagesOneServerTestJSON-1487843474 Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 1fffeaed862d4dfe9abdc2c36a66a0cc Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1487843474 Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ImagesOneServerTestJSON-1487843474-project Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 6815934fa00041fba4d2a88b3648eb07 Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ImagesOneServerTestJSON-1487843474-project Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 0dd070a1-a68f-4c94-9244-d59c94d109f9 could not be found. Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '0dd070a1-a68f-4c94-9244-d59c94d109f9'} Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dd070a1-a68f-4c94-9244-d59c94d109f9 could not be found. Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dd070a1-a68f-4c94-9244-d59c94d109f9 could not be found. Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:14:33.695930 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:14:33.699971 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:14:33.699971 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:14:33.699971 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:14:33.699971 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:14:33.699971 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:14:33.699971 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dd070a1-a68f-4c94-9244-d59c94d109f9 could not be found. Oct 26 13:14:33.699971 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:14:33.705771 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-166e59da-3565-4113-97a4-a4bd89e38628 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] Returning 404 to user: Instance 0dd070a1-a68f-4c94-9244-d59c94d109f9 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:14:33.706944 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-166e59da-3565-4113-97a4-a4bd89e38628 tempest-ImagesOneServerTestJSON-1487843474 tempest-ImagesOneServerTestJSON-1487843474-project] 10.222.0.40 "GET /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9" status: 404 len: 111 microversion: 2.1 time: 0.122049 Oct 26 13:14:33.708058 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1452/2851] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:33 2022] GET /compute/v2.1/servers/0dd070a1-a68f-4c94-9244-d59c94d109f9 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:14:33.897365 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bd4f6756-e046-4766-8a10-baf85de205db tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:33.898334 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bd4f6756-e046-4766-8a10-baf85de205db tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 9ae69130-8857-4d30-a434-6d8ca54f5cce] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:33.914079 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd4f6756-e046-4766-8a10-baf85de205db tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:33.915196 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd4f6756-e046-4766-8a10-baf85de205db tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:33.916758 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd4f6756-e046-4766-8a10-baf85de205db tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:33.917787 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd4f6756-e046-4766-8a10-baf85de205db tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:33.918547 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd4f6756-e046-4766-8a10-baf85de205db tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:33.919474 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd4f6756-e046-4766-8a10-baf85de205db tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:34.133642 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-852762d7-e175-4990-b4a2-648d1d1c07f2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:34.148339 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-852762d7-e175-4990-b4a2-648d1d1c07f2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/4f175b39-6703-43a3-a93b-e64e411d53b5" status: 200 len: 1328 microversion: 2.1 time: 0.688754 Oct 26 13:14:34.149759 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1400/2852] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:33 2022] GET /compute/v2.1/servers/4f175b39-6703-43a3-a93b-e64e411d53b5 => generated 1328 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:34.522025 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bd4f6756-e046-4766-8a10-baf85de205db tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:34.535915 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bd4f6756-e046-4766-8a10-baf85de205db tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce" status: 200 len: 1520 microversion: 2.1 time: 0.643531 Oct 26 13:14:34.536502 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1453/2853] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:33 2022] GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce => generated 1520 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:35.175807 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-12db2d2c-33da-4cff-8e22-ab7b4006ed15 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:35.177460 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-12db2d2c-33da-4cff-8e22-ab7b4006ed15 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 4f175b39-6703-43a3-a93b-e64e411d53b5] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:35.186836 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-12db2d2c-33da-4cff-8e22-ab7b4006ed15 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:35.187597 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-12db2d2c-33da-4cff-8e22-ab7b4006ed15 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:35.188176 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-12db2d2c-33da-4cff-8e22-ab7b4006ed15 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:35.189045 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-12db2d2c-33da-4cff-8e22-ab7b4006ed15 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:35.189671 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-12db2d2c-33da-4cff-8e22-ab7b4006ed15 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:35.190264 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-12db2d2c-33da-4cff-8e22-ab7b4006ed15 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:35.410320 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9daecab2-72cf-4d38-be6f-4fbdd4041060 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-729539974", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "9d89bfcb-b6c1-48c8-9536-adf0a648fc82"}, {"port": "bb5fa759-fb42-4724-9c5e-6a0f92fc97d1", "tag": "port-1"}, {"port": "fbf03382-47b3-45b7-be91-c664781050c5", "tag": "port-2"}, {"uuid": "253d6756-5fce-4d40-b7d5-bfd76e19db64", "tag": "net-1"}, {"uuid": "253d6756-5fce-4d40-b7d5-bfd76e19db64"}, {"uuid": "caef0d6b-f6df-4f87-8c2d-9e5898d0077f", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "caef0d6b-f6df-4f87-8c2d-9e5898d0077f", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "539e11ab-a673-4bfb-ad9d-d4b644ebb5e8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "a3c26523-732e-422b-a3a4-bb96116f050c", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "4a0ea55b-edc8-44e2-9073-7dd2b7aadec4", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1562480560"}], "key_name": "tempest-keypair-1732132591", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:14:35.517077 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-12db2d2c-33da-4cff-8e22-ab7b4006ed15 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:35.557876 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-12db2d2c-33da-4cff-8e22-ab7b4006ed15 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/4f175b39-6703-43a3-a93b-e64e411d53b5" status: 200 len: 1328 microversion: 2.1 time: 0.386049 Oct 26 13:14:35.592685 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1401/2854] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:35 2022] GET /compute/v2.1/servers/4f175b39-6703-43a3-a93b-e64e411d53b5 => generated 1328 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:35.618260 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d6dd9125-cc0c-45ef-981f-bc5a7be18a55 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:35.619314 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d6dd9125-cc0c-45ef-981f-bc5a7be18a55 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 9ae69130-8857-4d30-a434-6d8ca54f5cce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:35.626278 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6dd9125-cc0c-45ef-981f-bc5a7be18a55 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:35.627811 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6dd9125-cc0c-45ef-981f-bc5a7be18a55 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:35.628512 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6dd9125-cc0c-45ef-981f-bc5a7be18a55 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:35.629621 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6dd9125-cc0c-45ef-981f-bc5a7be18a55 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:35.630857 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6dd9125-cc0c-45ef-981f-bc5a7be18a55 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:35.635232 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6dd9125-cc0c-45ef-981f-bc5a7be18a55 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:35.818935 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-9daecab2-72cf-4d38-be6f-4fbdd4041060 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] validate_networks() for [('9d89bfcb-b6c1-48c8-9536-adf0a648fc82', None, None, None, None, None), (None, None, 'bb5fa759-fb42-4724-9c5e-6a0f92fc97d1', None, None, None), (None, None, 'fbf03382-47b3-45b7-be91-c664781050c5', None, None, None), ('253d6756-5fce-4d40-b7d5-bfd76e19db64', None, None, None, None, None), ('253d6756-5fce-4d40-b7d5-bfd76e19db64', None, None, None, None, None), ('caef0d6b-f6df-4f87-8c2d-9e5898d0077f', '10.2.2.100', None, None, None, None), ('caef0d6b-f6df-4f87-8c2d-9e5898d0077f', '10.2.2.200', None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:14:35.926422 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d6dd9125-cc0c-45ef-981f-bc5a7be18a55 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:35.935668 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d6dd9125-cc0c-45ef-981f-bc5a7be18a55 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce" status: 200 len: 1505 microversion: 2.1 time: 0.339862 Oct 26 13:14:35.952965 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1402/2855] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:35 2022] GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce => generated 1505 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:35.982597 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-752e4d11-158a-4d10-a370-6352d586b05c tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:35.983457 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-752e4d11-158a-4d10-a370-6352d586b05c tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 9ae69130-8857-4d30-a434-6d8ca54f5cce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:35.994068 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-752e4d11-158a-4d10-a370-6352d586b05c tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:35.996405 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-752e4d11-158a-4d10-a370-6352d586b05c tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:35.998032 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-752e4d11-158a-4d10-a370-6352d586b05c tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:35.999048 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-752e4d11-158a-4d10-a370-6352d586b05c tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:36.000288 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-752e4d11-158a-4d10-a370-6352d586b05c tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:36.001350 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-752e4d11-158a-4d10-a370-6352d586b05c tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:36.438387 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-752e4d11-158a-4d10-a370-6352d586b05c tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:36.452769 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-752e4d11-158a-4d10-a370-6352d586b05c tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce" status: 200 len: 1505 microversion: 2.1 time: 0.476003 Oct 26 13:14:36.453378 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1403/2856] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:35 2022] GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce => generated 1505 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:36.464270 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-ebfd378c-c1b7-4b67-a8a2-b2aa3a9b862c req-224d67a6-ddbb-4d61-b883-653121ef49ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f175b39-6703-43a3-a93b-e64e411d53b5", "name": "network-vif-plugged", "status": "completed", "tag": "c19db2ad-ad1d-4563-9cee-7daf42934acf"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:14:36.488737 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ebfd378c-c1b7-4b67-a8a2-b2aa3a9b862c req-224d67a6-ddbb-4d61-b883-653121ef49ad service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:36.491613 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ebfd378c-c1b7-4b67-a8a2-b2aa3a9b862c req-224d67a6-ddbb-4d61-b883-653121ef49ad service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:36.492334 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ebfd378c-c1b7-4b67-a8a2-b2aa3a9b862c req-224d67a6-ddbb-4d61-b883-653121ef49ad service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:36.532821 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-ebfd378c-c1b7-4b67-a8a2-b2aa3a9b862c req-224d67a6-ddbb-4d61-b883-653121ef49ad service nova] Creating event network-vif-plugged:c19db2ad-ad1d-4563-9cee-7daf42934acf for instance 4f175b39-6703-43a3-a93b-e64e411d53b5 on n-h1-862686-1 Oct 26 13:14:36.545243 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-ebfd378c-c1b7-4b67-a8a2-b2aa3a9b862c req-224d67a6-ddbb-4d61-b883-653121ef49ad service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083879 Oct 26 13:14:36.548500 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1404/2857] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:14:36.557042 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ff51a6c6-8e0a-40a0-b6f2-a9c767654571 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:36.563052 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ff51a6c6-8e0a-40a0-b6f2-a9c767654571 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7231628702cd4fe59f9bc17f79146195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1661af840e4aaaba8cb8ec5e8a4a6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:36.564157 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ff51a6c6-8e0a-40a0-b6f2-a9c767654571 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Searching by: {'deleted': False, 'project_id': '4b1661af840e4aaaba8cb8ec5e8a4a6a'} {{(pid=120597) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:14:36.573734 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff51a6c6-8e0a-40a0-b6f2-a9c767654571 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:36.574487 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff51a6c6-8e0a-40a0-b6f2-a9c767654571 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:36.575128 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff51a6c6-8e0a-40a0-b6f2-a9c767654571 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:36.580434 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff51a6c6-8e0a-40a0-b6f2-a9c767654571 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:36.581180 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff51a6c6-8e0a-40a0-b6f2-a9c767654571 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:36.581864 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff51a6c6-8e0a-40a0-b6f2-a9c767654571 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:36.636927 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.multi_cell_list [None req-ff51a6c6-8e0a-40a0-b6f2-a9c767654571 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120597) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 13:14:36.682901 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ff51a6c6-8e0a-40a0-b6f2-a9c767654571 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.132873 Oct 26 13:14:36.683848 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1405/2858] 10.222.0.40 () {58 vars in 1125 bytes} [Wed Oct 26 13:14:36 2022] GET /compute/v2.1/servers => generated 334 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:14:37.052343 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a914767f-b0fb-400d-8285-f141ba0e7abf tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Action: 'create', calling method: .version_select at 0x7f67326744c0>, body: {"keypair": {"name": "tempest-keypair-1087581627", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUNNklc2FWkSJe1XTv8Prob7pf0rlEk6qxRrSoNW0etphKxfYdLDOyQITGfb0psGNEM5922jirnvWhmtvOyUCf6cWGKBSeUSUQsqSHGBZPXSpZTcWlGlnLAy/z/Q5/utA=="}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:14:37.078566 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-a914767f-b0fb-400d-8285-f141ba0e7abf tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Getting quotas for project 174da5e5c60449b7a04e9cf2aa3b9fda. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:14:37.085745 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-a914767f-b0fb-400d-8285-f141ba0e7abf tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Getting quotas for user 168c83cd1b014f82945f4915e3ece079 and project 174da5e5c60449b7a04e9cf2aa3b9fda. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:14:37.134491 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a914767f-b0fb-400d-8285-f141ba0e7abf tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.446321 Oct 26 13:14:37.134491 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1406/2859] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 13:14:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:14:37.137099 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-210ef853-15be-4d2f-9824-cfee4e74a0b8 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:37.137795 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-210ef853-15be-4d2f-9824-cfee4e74a0b8 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 9ae69130-8857-4d30-a434-6d8ca54f5cce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:37.148864 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:INSERT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:14:37.156652 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-210ef853-15be-4d2f-9824-cfee4e74a0b8 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:37.157203 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-210ef853-15be-4d2f-9824-cfee4e74a0b8 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:37.157821 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-210ef853-15be-4d2f-9824-cfee4e74a0b8 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:37.158397 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-210ef853-15be-4d2f-9824-cfee4e74a0b8 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:37.159130 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-210ef853-15be-4d2f-9824-cfee4e74a0b8 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:37.159567 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-210ef853-15be-4d2f-9824-cfee4e74a0b8 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:37.195263 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-210ef853-15be-4d2f-9824-cfee4e74a0b8 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 9ae69130-8857-4d30-a434-6d8ca54f5cce] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:14:37.358139 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-210ef853-15be-4d2f-9824-cfee4e74a0b8 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce" status: 204 len: 0 microversion: 2.1 time: 0.223541 Oct 26 13:14:37.358802 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1407/2860] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:14:37 2022] DELETE /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:14:37.371149 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6fc13a7c-fc56-40f4-bc34-92882272844e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:37.371970 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6fc13a7c-fc56-40f4-bc34-92882272844e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 4f175b39-6703-43a3-a93b-e64e411d53b5] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:37.380574 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6fc13a7c-fc56-40f4-bc34-92882272844e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:37.381341 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6fc13a7c-fc56-40f4-bc34-92882272844e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:37.382433 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6fc13a7c-fc56-40f4-bc34-92882272844e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:37.382610 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6fc13a7c-fc56-40f4-bc34-92882272844e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:37.383150 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6fc13a7c-fc56-40f4-bc34-92882272844e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:37.383797 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6fc13a7c-fc56-40f4-bc34-92882272844e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:37.805514 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6fc13a7c-fc56-40f4-bc34-92882272844e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:37.814563 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6fc13a7c-fc56-40f4-bc34-92882272844e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/4f175b39-6703-43a3-a93b-e64e411d53b5" status: 200 len: 1328 microversion: 2.1 time: 0.448107 Oct 26 13:14:37.821774 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1408/2861] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:37 2022] GET /compute/v2.1/servers/4f175b39-6703-43a3-a93b-e64e411d53b5 => generated 1328 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:37.944179 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-05d45328-d71f-43c2-99f5-22a25fe68d23 tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] Action: 'create', calling method: .version_select at 0x7f6732cb5a60>, body: {"keypair": {"name": "tempest-keypair-498493967", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOBBqscj/D7Y39a9zjdnfamTE1x3Vihsyf6oxx3ZussamYUIs4ZH6Gh08lzuKtCFDvdgfOiroKaDuK3VOmx74mKFgg9eA+cnYAosNDEihKdDj1fXWvhj0/x7WLz22duYQ=="}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:14:37.987566 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-05d45328-d71f-43c2-99f5-22a25fe68d23 tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] Getting quotas for project c2fcb0b837304706a19b8ad7bd0411fd. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:14:38.004082 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-05d45328-d71f-43c2-99f5-22a25fe68d23 tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] Getting quotas for user b0e717887ba248a480fb5b232bf82231 and project c2fcb0b837304706a19b8ad7bd0411fd. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:14:38.063045 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-05d45328-d71f-43c2-99f5-22a25fe68d23 tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.239873 Oct 26 13:14:38.064119 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1409/2862] 10.222.0.40 () {62 vars in 1199 bytes} [Wed Oct 26 13:14:37 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 242 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 26 13:14:38.071695 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1f5cf4aa-2d2e-4200-aeff-8863ec425422 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:38.086779 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1f5cf4aa-2d2e-4200-aeff-8863ec425422 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7231628702cd4fe59f9bc17f79146195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1661af840e4aaaba8cb8ec5e8a4a6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:38.088112 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1f5cf4aa-2d2e-4200-aeff-8863ec425422 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Searching by: {'deleted': False, 'project_id': '4b1661af840e4aaaba8cb8ec5e8a4a6a'} {{(pid=120597) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:14:38.102046 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1f5cf4aa-2d2e-4200-aeff-8863ec425422 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:38.103780 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1f5cf4aa-2d2e-4200-aeff-8863ec425422 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:38.104283 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1f5cf4aa-2d2e-4200-aeff-8863ec425422 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:38.107684 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1f5cf4aa-2d2e-4200-aeff-8863ec425422 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:38.109268 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1f5cf4aa-2d2e-4200-aeff-8863ec425422 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:38.109765 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1f5cf4aa-2d2e-4200-aeff-8863ec425422 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:38.203435 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.multi_cell_list [None req-1f5cf4aa-2d2e-4200-aeff-8863ec425422 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120597) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 13:14:38.284378 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1f5cf4aa-2d2e-4200-aeff-8863ec425422 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231628702cd4fe59f9bc17f79146195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1661af840e4aaaba8cb8ec5e8a4a6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:38.303194 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1f5cf4aa-2d2e-4200-aeff-8863ec425422 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:38.303803 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1f5cf4aa-2d2e-4200-aeff-8863ec425422 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:38.304440 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1f5cf4aa-2d2e-4200-aeff-8863ec425422 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:38.645606 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1f5cf4aa-2d2e-4200-aeff-8863ec425422 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] 10.222.0.40 "GET /compute/v2.1/servers/detail" status: 200 len: 1698 microversion: 2.1 time: 0.579847 Oct 26 13:14:38.648928 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1410/2863] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:14:38 2022] GET /compute/v2.1/servers/detail => generated 1698 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:38.657783 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-19221bd9-253a-4d2f-8e7a-19b8ea2d06c9 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-50068114", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "340efa1a-ce32-4ee5-be29-96387dba2183"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:14:38.752216 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-19221bd9-253a-4d2f-8e7a-19b8ea2d06c9 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] validate_networks() for [('340efa1a-ce32-4ee5-be29-96387dba2183', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:14:39.799433 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-19221bd9-253a-4d2f-8e7a-19b8ea2d06c9 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:14:39.799991 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-19221bd9-253a-4d2f-8e7a-19b8ea2d06c9 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:14:39.800745 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-19221bd9-253a-4d2f-8e7a-19b8ea2d06c9 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:14:39.801364 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-19221bd9-253a-4d2f-8e7a-19b8ea2d06c9 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:14:39.802162 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-19221bd9-253a-4d2f-8e7a-19b8ea2d06c9 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:14:39.818829 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-19221bd9-253a-4d2f-8e7a-19b8ea2d06c9 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:39.820146 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-19221bd9-253a-4d2f-8e7a-19b8ea2d06c9 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:39.821367 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-19221bd9-253a-4d2f-8e7a-19b8ea2d06c9 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:39.822986 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-19221bd9-253a-4d2f-8e7a-19b8ea2d06c9 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:39.824462 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-19221bd9-253a-4d2f-8e7a-19b8ea2d06c9 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:39.825143 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-19221bd9-253a-4d2f-8e7a-19b8ea2d06c9 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:39.855456 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-19221bd9-253a-4d2f-8e7a-19b8ea2d06c9 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Getting quotas for project 5291f3c81016423cbc1164c82551f648. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:14:39.865852 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-19221bd9-253a-4d2f-8e7a-19b8ea2d06c9 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Getting quotas for user 5744e7524e4c4d2c896ce178572ada0c and project 5291f3c81016423cbc1164c82551f648. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:14:39.884833 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-19221bd9-253a-4d2f-8e7a-19b8ea2d06c9 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:14:39.887283 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-19221bd9-253a-4d2f-8e7a-19b8ea2d06c9 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: a1dbfc30-8cbf-4a85-8847-a24031f5e3dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:14:39.947643 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-19221bd9-253a-4d2f-8e7a-19b8ea2d06c9 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.297189 Oct 26 13:14:39.948593 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1411/2864] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:14:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1299 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:14:39.969521 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-653747cf-dceb-447e-b0f5-21564874730f tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] Calling method '.version_select at 0x7f6732cb5a60>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:39.989451 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-653747cf-dceb-447e-b0f5-21564874730f tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] 10.222.0.40 "GET /compute/v2.1/os-keypairs/tempest-keypair-498493967" status: 200 len: 512 microversion: 2.2 time: 0.039540 Oct 26 13:14:39.990340 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1412/2865] 10.222.0.40 () {60 vars in 1255 bytes} [Wed Oct 26 13:14:39 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-498493967 => generated 512 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:14:39.997889 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8791ade2-96c2-44c7-a33c-9a8c8aa3507e tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:40.007740 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8791ade2-96c2-44c7-a33c-9a8c8aa3507e tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015794 Oct 26 13:14:40.016681 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1413/2866] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 26 13:14:39 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:14:40.024829 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7b33f389-a077-461e-aaf9-309e2074b5f1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:40.025841 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7b33f389-a077-461e-aaf9-309e2074b5f1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 4f175b39-6703-43a3-a93b-e64e411d53b5] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:40.034498 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b33f389-a077-461e-aaf9-309e2074b5f1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:40.035226 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b33f389-a077-461e-aaf9-309e2074b5f1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:40.035851 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b33f389-a077-461e-aaf9-309e2074b5f1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:40.037637 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b33f389-a077-461e-aaf9-309e2074b5f1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:40.038285 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b33f389-a077-461e-aaf9-309e2074b5f1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:40.039284 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b33f389-a077-461e-aaf9-309e2074b5f1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:40.256195 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7b33f389-a077-461e-aaf9-309e2074b5f1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:40.266659 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7b33f389-a077-461e-aaf9-309e2074b5f1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/4f175b39-6703-43a3-a93b-e64e411d53b5" status: 200 len: 1507 microversion: 2.1 time: 0.247335 Oct 26 13:14:40.273719 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1414/2867] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:40 2022] GET /compute/v2.1/servers/4f175b39-6703-43a3-a93b-e64e411d53b5 => generated 1507 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:40.282928 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-001b5815-3045-4299-ae90-a68ee4a88ca3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:40.284292 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-001b5815-3045-4299-ae90-a68ee4a88ca3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: a1dbfc30-8cbf-4a85-8847-a24031f5e3dc] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:40.370549 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-001b5815-3045-4299-ae90-a68ee4a88ca3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:40.379736 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-001b5815-3045-4299-ae90-a68ee4a88ca3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc" status: 200 len: 1216 microversion: 2.1 time: 0.103725 Oct 26 13:14:40.381721 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1415/2868] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:40 2022] GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc => generated 1216 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:40.406772 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6e542a2b-ccaf-49aa-806e-1a17a8f5c6c0 tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] Calling method '.version_select at 0x7f6732648dc0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:40.445217 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6e542a2b-ccaf-49aa-806e-1a17a8f5c6c0 tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-498493967" status: 204 len: 0 microversion: 2.2 time: 0.062094 Oct 26 13:14:40.448229 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1416/2869] 10.222.0.40 () {60 vars in 1258 bytes} [Wed Oct 26 13:14:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-498493967 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:14:40.457861 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0130d4fa-a19f-4f7f-8741-734d607fe1ce tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:40.458492 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0130d4fa-a19f-4f7f-8741-734d607fe1ce tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 4f175b39-6703-43a3-a93b-e64e411d53b5] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:40.465328 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0130d4fa-a19f-4f7f-8741-734d607fe1ce tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:40.466821 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0130d4fa-a19f-4f7f-8741-734d607fe1ce tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:40.467269 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0130d4fa-a19f-4f7f-8741-734d607fe1ce tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:40.468026 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0130d4fa-a19f-4f7f-8741-734d607fe1ce tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:40.468645 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0130d4fa-a19f-4f7f-8741-734d607fe1ce tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:40.469226 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0130d4fa-a19f-4f7f-8741-734d607fe1ce tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:40.742217 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0130d4fa-a19f-4f7f-8741-734d607fe1ce tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:40.752624 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0130d4fa-a19f-4f7f-8741-734d607fe1ce tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/4f175b39-6703-43a3-a93b-e64e411d53b5" status: 200 len: 1507 microversion: 2.1 time: 0.302555 Oct 26 13:14:40.754767 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1417/2870] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:40 2022] GET /compute/v2.1/servers/4f175b39-6703-43a3-a93b-e64e411d53b5 => generated 1507 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:40.762853 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f2a28179-040a-46e5-961c-2c8d98758794 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:40.765006 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f2a28179-040a-46e5-961c-2c8d98758794 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] [instance: ce37d19f-ed04-4e29-8210-62813d7a031d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:40.774704 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2a28179-040a-46e5-961c-2c8d98758794 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:40.775470 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2a28179-040a-46e5-961c-2c8d98758794 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:40.776069 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2a28179-040a-46e5-961c-2c8d98758794 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:40.776982 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2a28179-040a-46e5-961c-2c8d98758794 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:40.777921 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2a28179-040a-46e5-961c-2c8d98758794 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:40.778887 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2a28179-040a-46e5-961c-2c8d98758794 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:40.826077 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f2a28179-040a-46e5-961c-2c8d98758794 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] [instance: ce37d19f-ed04-4e29-8210-62813d7a031d] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:14:40.902519 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:14:40.999866 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f2a28179-040a-46e5-961c-2c8d98758794 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ce37d19f-ed04-4e29-8210-62813d7a031d" status: 204 len: 0 microversion: 2.1 time: 0.243037 Oct 26 13:14:41.000987 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1418/2871] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:14:40 2022] DELETE /compute/v2.1/servers/ce37d19f-ed04-4e29-8210-62813d7a031d => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:14:41.014375 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e6c5e9c3-451e-4937-9c90-7dc5f6500c7a tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] Action: 'create', calling method: .version_select at 0x7f6732b29ca0>, body: {"keypair": {"name": "tempest-keypair-243995083", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGeP04JD0zlD7fy7LMNPhCckSEQwJutFVEfxmem38YG8lx/wq8oy6YnBFcCotFjNZ9OP1Zxv23kh1Nx58G61//UrJGVSzVEc0uZ64zrQ5BSm/FACubKYNGq7CeTcZx+gQQ=="}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:14:41.063463 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-e6c5e9c3-451e-4937-9c90-7dc5f6500c7a tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] Getting quotas for project c2fcb0b837304706a19b8ad7bd0411fd. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:14:41.078587 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-e6c5e9c3-451e-4937-9c90-7dc5f6500c7a tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] Getting quotas for user b0e717887ba248a480fb5b232bf82231 and project c2fcb0b837304706a19b8ad7bd0411fd. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:14:41.134133 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e6c5e9c3-451e-4937-9c90-7dc5f6500c7a tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.131196 Oct 26 13:14:41.135527 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1419/2872] 10.222.0.40 () {62 vars in 1199 bytes} [Wed Oct 26 13:14:41 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 134 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 26 13:14:41.142106 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-93e19ee2-8af9-40f1-8be9-dbd2fed04701 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:41.143339 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-93e19ee2-8af9-40f1-8be9-dbd2fed04701 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 4f175b39-6703-43a3-a93b-e64e411d53b5] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:41.156524 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-93e19ee2-8af9-40f1-8be9-dbd2fed04701 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:41.166383 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-93e19ee2-8af9-40f1-8be9-dbd2fed04701 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:41.166845 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-93e19ee2-8af9-40f1-8be9-dbd2fed04701 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:41.167609 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-93e19ee2-8af9-40f1-8be9-dbd2fed04701 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:41.168070 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-93e19ee2-8af9-40f1-8be9-dbd2fed04701 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:41.168503 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-93e19ee2-8af9-40f1-8be9-dbd2fed04701 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:41.200210 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-93e19ee2-8af9-40f1-8be9-dbd2fed04701 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 4f175b39-6703-43a3-a93b-e64e411d53b5] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:14:41.302497 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-93e19ee2-8af9-40f1-8be9-dbd2fed04701 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4f175b39-6703-43a3-a93b-e64e411d53b5" status: 204 len: 0 microversion: 2.1 time: 0.164944 Oct 26 13:14:41.306297 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1420/2873] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:14:41 2022] DELETE /compute/v2.1/servers/4f175b39-6703-43a3-a93b-e64e411d53b5 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:14:41.309439 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-a4abd960-ba55-4cc4-b5f2-25cd4badc506 req-fec76b27-9f6f-4fc2-8297-1ac3cefc2712 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ae69130-8857-4d30-a434-6d8ca54f5cce", "name": "network-vif-deleted", "tag": "874b6621-32e1-4309-945a-0d50400c3292"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:14:41.320614 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a4abd960-ba55-4cc4-b5f2-25cd4badc506 req-fec76b27-9f6f-4fc2-8297-1ac3cefc2712 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:41.321155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a4abd960-ba55-4cc4-b5f2-25cd4badc506 req-fec76b27-9f6f-4fc2-8297-1ac3cefc2712 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:41.321624 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a4abd960-ba55-4cc4-b5f2-25cd4badc506 req-fec76b27-9f6f-4fc2-8297-1ac3cefc2712 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:41.334931 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-a4abd960-ba55-4cc4-b5f2-25cd4badc506 req-fec76b27-9f6f-4fc2-8297-1ac3cefc2712 service nova] Creating event network-vif-deleted:874b6621-32e1-4309-945a-0d50400c3292 for instance 9ae69130-8857-4d30-a434-6d8ca54f5cce on n-h1-862686-1 Oct 26 13:14:41.339670 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-a4abd960-ba55-4cc4-b5f2-25cd4badc506 req-fec76b27-9f6f-4fc2-8297-1ac3cefc2712 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034562 Oct 26 13:14:41.340273 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1421/2874] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:14:41.346230 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-458d94e8-381d-444d-9a93-53805a1cfe8b tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:41.346929 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-458d94e8-381d-444d-9a93-53805a1cfe8b tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] [instance: ce37d19f-ed04-4e29-8210-62813d7a031d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:41.353188 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-458d94e8-381d-444d-9a93-53805a1cfe8b tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:41.353708 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-458d94e8-381d-444d-9a93-53805a1cfe8b tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:41.354152 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-458d94e8-381d-444d-9a93-53805a1cfe8b tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:41.354848 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-458d94e8-381d-444d-9a93-53805a1cfe8b tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:41.355305 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-458d94e8-381d-444d-9a93-53805a1cfe8b tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:41.355728 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-458d94e8-381d-444d-9a93-53805a1cfe8b tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:41.494309 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-458d94e8-381d-444d-9a93-53805a1cfe8b tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231628702cd4fe59f9bc17f79146195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1661af840e4aaaba8cb8ec5e8a4a6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:41.503216 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-458d94e8-381d-444d-9a93-53805a1cfe8b tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] 10.222.0.40 "GET /compute/v2.1/servers/ce37d19f-ed04-4e29-8210-62813d7a031d" status: 200 len: 1701 microversion: 2.1 time: 0.160945 Oct 26 13:14:41.503899 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1422/2875] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:41 2022] GET /compute/v2.1/servers/ce37d19f-ed04-4e29-8210-62813d7a031d => generated 1701 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:41.515324 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1a9b861a-aa3b-4bcf-bf22-ac038d113246 tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] Calling method '.version_select at 0x7f67325565e0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:41.534835 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1a9b861a-aa3b-4bcf-bf22-ac038d113246 tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-243995083" status: 204 len: 0 microversion: 2.2 time: 0.024032 Oct 26 13:14:41.535573 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1423/2876] 10.222.0.40 () {60 vars in 1258 bytes} [Wed Oct 26 13:14:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-243995083 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:14:41.540600 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-64ce90a5-3c5b-463c-80e4-3924786ef6ae tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:41.541214 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-64ce90a5-3c5b-463c-80e4-3924786ef6ae tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 4f175b39-6703-43a3-a93b-e64e411d53b5] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:41.547250 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64ce90a5-3c5b-463c-80e4-3924786ef6ae tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:41.547732 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64ce90a5-3c5b-463c-80e4-3924786ef6ae tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:41.548169 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64ce90a5-3c5b-463c-80e4-3924786ef6ae tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:41.548859 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64ce90a5-3c5b-463c-80e4-3924786ef6ae tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:41.549312 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64ce90a5-3c5b-463c-80e4-3924786ef6ae tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:41.549765 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64ce90a5-3c5b-463c-80e4-3924786ef6ae tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:41.688505 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-64ce90a5-3c5b-463c-80e4-3924786ef6ae tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:41.696251 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-64ce90a5-3c5b-463c-80e4-3924786ef6ae tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/4f175b39-6703-43a3-a93b-e64e411d53b5" status: 200 len: 1513 microversion: 2.1 time: 0.159619 Oct 26 13:14:41.696822 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1424/2877] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:41 2022] GET /compute/v2.1/servers/4f175b39-6703-43a3-a93b-e64e411d53b5 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:41.702206 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a857ec17-0270-4877-a514-2ab4dcfb4435 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:41.702814 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a857ec17-0270-4877-a514-2ab4dcfb4435 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: a1dbfc30-8cbf-4a85-8847-a24031f5e3dc] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:41.718473 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a857ec17-0270-4877-a514-2ab4dcfb4435 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:41.718966 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a857ec17-0270-4877-a514-2ab4dcfb4435 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:41.719434 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a857ec17-0270-4877-a514-2ab4dcfb4435 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:41.720164 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a857ec17-0270-4877-a514-2ab4dcfb4435 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:41.720620 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a857ec17-0270-4877-a514-2ab4dcfb4435 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:41.721043 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a857ec17-0270-4877-a514-2ab4dcfb4435 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:41.786731 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a857ec17-0270-4877-a514-2ab4dcfb4435 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:41.795496 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a857ec17-0270-4877-a514-2ab4dcfb4435 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc" status: 200 len: 1268 microversion: 2.1 time: 0.097645 Oct 26 13:14:41.796095 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1425/2878] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:41 2022] GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc => generated 1268 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:41.804489 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ea918995-cb1b-449f-9ce4-5186071a6c54 tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] Action: 'create', calling method: .version_select at 0x7f6732556790>, body: {"keypair": {"name": "tempest-keypair-1158790399", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:14:41.813815 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=3,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:14:41.820677 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-ea918995-cb1b-449f-9ce4-5186071a6c54 tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] Getting quotas for project c2fcb0b837304706a19b8ad7bd0411fd. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:14:41.827440 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-ea918995-cb1b-449f-9ce4-5186071a6c54 tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] Getting quotas for user b0e717887ba248a480fb5b232bf82231 and project c2fcb0b837304706a19b8ad7bd0411fd. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:14:41.855224 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ea918995-cb1b-449f-9ce4-5186071a6c54 tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.058091 Oct 26 13:14:41.856001 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1426/2879] 10.222.0.40 () {62 vars in 1199 bytes} [Wed Oct 26 13:14:41 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 59 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 26 13:14:41.866352 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3b9f0689-9f8a-464d-bba8-b1c3000a67f5 tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] Calling method '.version_select at 0x7f6732674550>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:41.889292 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3b9f0689-9f8a-464d-bba8-b1c3000a67f5 tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1158790399" status: 204 len: 0 microversion: 2.2 time: 0.026511 Oct 26 13:14:41.889991 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1427/2880] 10.222.0.40 () {60 vars in 1261 bytes} [Wed Oct 26 13:14:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1158790399 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:14:41.902013 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d413e925-6e4a-49e7-82aa-4c9b4babf465 tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] Action: 'create', calling method: .version_select at 0x7f67326ed1f0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-397323208", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1VxmLeTtqSUTQupSNCG9jaoKBX04C2tNyZyQy4sZ1d2k7edcdt49uVW6Ywt0bPn+Lb/Xjpj8dTM9HSvGS2TV7u0LWH4ysz0FHkFZqBlpUdDfioR1qzSVdhxIRIcUM9UA=="}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:14:41.919922 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-d413e925-6e4a-49e7-82aa-4c9b4babf465 tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] Getting quotas for project c2fcb0b837304706a19b8ad7bd0411fd. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:14:41.925472 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-d413e925-6e4a-49e7-82aa-4c9b4babf465 tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] Getting quotas for user b0e717887ba248a480fb5b232bf82231 and project c2fcb0b837304706a19b8ad7bd0411fd. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:14:41.952614 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d413e925-6e4a-49e7-82aa-4c9b4babf465 tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.054930 Oct 26 13:14:41.953464 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1428/2881] 10.222.0.40 () {62 vars in 1199 bytes} [Wed Oct 26 13:14:41 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 56 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 26 13:14:41.966507 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f4fc7b4b-7103-479f-ade1-43210c9804e7 tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] Action: 'create', calling method: .version_select at 0x7f67369b2d30>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1756475653", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGk9MzADTjTbIgSJZHC+OeUyvems5VP07VQCjIZGrVShFahRQnx2kpZC0NNsaTECzut1qwKGj3F6w64wEhSGMeK7jRhgfqPBr8xyGHq9k+kzS71MO2jv1907Pm12fl0xg=="}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:14:41.982101 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-f4fc7b4b-7103-479f-ade1-43210c9804e7 tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] Getting quotas for project c2fcb0b837304706a19b8ad7bd0411fd. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:14:41.987323 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-f4fc7b4b-7103-479f-ade1-43210c9804e7 tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] Getting quotas for user b0e717887ba248a480fb5b232bf82231 and project c2fcb0b837304706a19b8ad7bd0411fd. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:14:42.011800 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f4fc7b4b-7103-479f-ade1-43210c9804e7 tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.049130 Oct 26 13:14:42.012619 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1429/2882] 10.222.0.40 () {62 vars in 1199 bytes} [Wed Oct 26 13:14:41 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 26 13:14:42.022168 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-9daecab2-72cf-4d38-be6f-4fbdd4041060 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:14:42.023121 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-9daecab2-72cf-4d38-be6f-4fbdd4041060 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:14:42.026320 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1d4992f9-80d8-49d5-922b-131bbbda613c tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] Action: 'create', calling method: .version_select at 0x7f6732237dc0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1559499572", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEG5+M2SjM3fhkiueiO9+dkGax62P4+L9ziB2PiGfztEVtd+jZj7/CLYVd4vbT82U3Ko1eP/j5cZVY0uxFUoA8LO9th/hbnxTwiSNBejj87q2pOlrA/DZqFkvVVVIoz/cA=="}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:14:42.034996 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-9daecab2-72cf-4d38-be6f-4fbdd4041060 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:14:42.036014 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-9daecab2-72cf-4d38-be6f-4fbdd4041060 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:14:42.036406 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-9daecab2-72cf-4d38-be6f-4fbdd4041060 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:14:42.043381 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-1d4992f9-80d8-49d5-922b-131bbbda613c tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] Getting quotas for project c2fcb0b837304706a19b8ad7bd0411fd. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:14:42.048298 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9daecab2-72cf-4d38-be6f-4fbdd4041060 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:42.049162 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9daecab2-72cf-4d38-be6f-4fbdd4041060 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:42.049910 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9daecab2-72cf-4d38-be6f-4fbdd4041060 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:42.050807 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-1d4992f9-80d8-49d5-922b-131bbbda613c tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] Getting quotas for user b0e717887ba248a480fb5b232bf82231 and project c2fcb0b837304706a19b8ad7bd0411fd. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:14:42.050955 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9daecab2-72cf-4d38-be6f-4fbdd4041060 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:42.051474 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9daecab2-72cf-4d38-be6f-4fbdd4041060 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:42.052017 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9daecab2-72cf-4d38-be6f-4fbdd4041060 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:42.082774 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1d4992f9-80d8-49d5-922b-131bbbda613c tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.060108 Oct 26 13:14:42.090429 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1430/2883] 10.222.0.40 () {62 vars in 1199 bytes} [Wed Oct 26 13:14:42 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 68 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 26 13:14:42.093305 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-9daecab2-72cf-4d38-be6f-4fbdd4041060 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Getting quotas for project de138b5bb5ac44c9be139ab7ceb26a32. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:14:42.098416 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-37d59327-457a-404f-97eb-f05addf9d1a5 tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] Calling method '.version_select at 0x7f67326928b0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:42.102330 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-9daecab2-72cf-4d38-be6f-4fbdd4041060 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Getting quotas for user d09f69ec8c514a6789ede382cdbdbebb and project de138b5bb5ac44c9be139ab7ceb26a32. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:14:42.103700 n-d-862686-1 devstack@n-api.service[120597]: WARNING oslo_db.sqlalchemy.utils [None req-37d59327-457a-404f-97eb-f05addf9d1a5 tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 26 13:14:42.110569 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-37d59327-457a-404f-97eb-f05addf9d1a5 tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] 10.222.0.40 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.017388 Oct 26 13:14:42.117741 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1431/2884] 10.222.0.40 () {60 vars in 1177 bytes} [Wed Oct 26 13:14:42 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:42.129799 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9c4a8468-9bc6-4baa-945b-61a0d2ad18ba tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] Calling method '.version_select at 0x7f67326eda60>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:42.163092 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9c4a8468-9bc6-4baa-945b-61a0d2ad18ba tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1559499572" status: 204 len: 0 microversion: 2.2 time: 0.041671 Oct 26 13:14:42.164167 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1432/2885] 10.222.0.40 () {60 vars in 1321 bytes} [Wed Oct 26 13:14:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1559499572 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:14:42.173034 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8a9671a7-9fbc-4865-91a1-84b2fc6ef246 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1106513170", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6fd403f3-cdf4-4a71-b3b7-5fccfc8063f7"}], "security_groups": [{"name": "tempest-securitygroup--854304407"}], "key_name": "tempest-keypair-1087581627", "user_data": "}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:14:42.353368 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-8a9671a7-9fbc-4865-91a1-84b2fc6ef246 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] validate_networks() for [('6fd403f3-cdf4-4a71-b3b7-5fccfc8063f7', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:14:42.361790 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9daecab2-72cf-4d38-be6f-4fbdd4041060 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:14:42.365518 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9daecab2-72cf-4d38-be6f-4fbdd4041060 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='539e11ab-a673-4bfb-ad9d-d4b644ebb5e8',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='a3c26523-732e-422b-a3a4-bb96116f050c',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4a0ea55b-edc8-44e2-9073-7dd2b7aadec4',volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:14:42.963892 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9daecab2-72cf-4d38-be6f-4fbdd4041060 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 7.569064 Oct 26 13:14:42.973096 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1454/2886] 10.222.0.40 () {62 vars in 1189 bytes} [Wed Oct 26 13:14:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 7580 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 26 13:14:42.979274 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cc3714eb-4f07-4893-8cae-efcb44d3cb7b tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] Calling method '.version_select at 0x7f67319add30>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:43.041702 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cc3714eb-4f07-4893-8cae-efcb44d3cb7b tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1756475653" status: 204 len: 0 microversion: 2.2 time: 0.066005 Oct 26 13:14:43.043212 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1455/2887] 10.222.0.40 () {60 vars in 1321 bytes} [Wed Oct 26 13:14:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1756475653 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:14:43.056039 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-927843f2-bcb4-4274-b790-7ee1b186fa4e tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:43.057015 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-927843f2-bcb4-4274-b790-7ee1b186fa4e tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] [instance: ce37d19f-ed04-4e29-8210-62813d7a031d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:43.066305 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-927843f2-bcb4-4274-b790-7ee1b186fa4e tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:43.067173 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-927843f2-bcb4-4274-b790-7ee1b186fa4e tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:43.067901 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-927843f2-bcb4-4274-b790-7ee1b186fa4e tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:43.069280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-927843f2-bcb4-4274-b790-7ee1b186fa4e tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:43.070099 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-927843f2-bcb4-4274-b790-7ee1b186fa4e tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:43.070748 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-927843f2-bcb4-4274-b790-7ee1b186fa4e tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:43.357668 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-8a9671a7-9fbc-4865-91a1-84b2fc6ef246 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:14:43.358155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-8a9671a7-9fbc-4865-91a1-84b2fc6ef246 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:14:43.358560 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-8a9671a7-9fbc-4865-91a1-84b2fc6ef246 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:14:43.358965 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-8a9671a7-9fbc-4865-91a1-84b2fc6ef246 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:14:43.359576 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-8a9671a7-9fbc-4865-91a1-84b2fc6ef246 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:14:43.374070 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8a9671a7-9fbc-4865-91a1-84b2fc6ef246 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:43.379337 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8a9671a7-9fbc-4865-91a1-84b2fc6ef246 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:43.379804 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8a9671a7-9fbc-4865-91a1-84b2fc6ef246 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:43.380575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8a9671a7-9fbc-4865-91a1-84b2fc6ef246 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:43.381218 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8a9671a7-9fbc-4865-91a1-84b2fc6ef246 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:43.381685 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8a9671a7-9fbc-4865-91a1-84b2fc6ef246 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:43.405875 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-8a9671a7-9fbc-4865-91a1-84b2fc6ef246 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Getting quotas for project 174da5e5c60449b7a04e9cf2aa3b9fda. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:14:43.411781 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-8a9671a7-9fbc-4865-91a1-84b2fc6ef246 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Getting quotas for user 168c83cd1b014f82945f4915e3ece079 and project 174da5e5c60449b7a04e9cf2aa3b9fda. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:14:43.426115 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8a9671a7-9fbc-4865-91a1-84b2fc6ef246 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:14:43.428793 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8a9671a7-9fbc-4865-91a1-84b2fc6ef246 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 789a55e0-21ba-4b2e-b8d4-c95999955e2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:14:43.496697 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8a9671a7-9fbc-4865-91a1-84b2fc6ef246 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.331101 Oct 26 13:14:43.498166 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1433/2888] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:14:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 1333 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:14:43.503403 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a06ef311-24ba-491d-b33d-1afd3b31d6ad tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:43.504970 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a06ef311-24ba-491d-b33d-1afd3b31d6ad tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 4f175b39-6703-43a3-a93b-e64e411d53b5] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:43.515840 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a06ef311-24ba-491d-b33d-1afd3b31d6ad tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:43.517045 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a06ef311-24ba-491d-b33d-1afd3b31d6ad tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:43.517721 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a06ef311-24ba-491d-b33d-1afd3b31d6ad tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:43.518694 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a06ef311-24ba-491d-b33d-1afd3b31d6ad tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:43.519359 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a06ef311-24ba-491d-b33d-1afd3b31d6ad tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:43.519948 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a06ef311-24ba-491d-b33d-1afd3b31d6ad tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:43.566346 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-927843f2-bcb4-4274-b790-7ee1b186fa4e tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231628702cd4fe59f9bc17f79146195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1661af840e4aaaba8cb8ec5e8a4a6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:43.574869 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-927843f2-bcb4-4274-b790-7ee1b186fa4e tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] 10.222.0.40 "GET /compute/v2.1/servers/ce37d19f-ed04-4e29-8210-62813d7a031d" status: 200 len: 1701 microversion: 2.1 time: 0.523484 Oct 26 13:14:43.590112 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1456/2889] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:43 2022] GET /compute/v2.1/servers/ce37d19f-ed04-4e29-8210-62813d7a031d => generated 1701 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:43.591539 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-aa5a0952-25e1-423b-8ee5-d93056f82bad tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:43.592425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-aa5a0952-25e1-423b-8ee5-d93056f82bad tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: a1dbfc30-8cbf-4a85-8847-a24031f5e3dc] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:43.606434 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa5a0952-25e1-423b-8ee5-d93056f82bad tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:43.607483 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa5a0952-25e1-423b-8ee5-d93056f82bad tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:43.610452 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa5a0952-25e1-423b-8ee5-d93056f82bad tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:43.611705 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa5a0952-25e1-423b-8ee5-d93056f82bad tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:43.612336 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa5a0952-25e1-423b-8ee5-d93056f82bad tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:43.613781 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa5a0952-25e1-423b-8ee5-d93056f82bad tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:43.743297 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-aa5a0952-25e1-423b-8ee5-d93056f82bad tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:43.757377 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-aa5a0952-25e1-423b-8ee5-d93056f82bad tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc" status: 200 len: 1274 microversion: 2.1 time: 0.173544 Oct 26 13:14:43.760538 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1457/2890] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:43 2022] GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc => generated 1274 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:43.783644 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a5a6418e-7f95-4988-b049-868fbf193449 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:43.784342 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a5a6418e-7f95-4988-b049-868fbf193449 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:43.992700 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a5a6418e-7f95-4988-b049-868fbf193449 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:44.030794 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a5a6418e-7f95-4988-b049-868fbf193449 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:44.036138 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a5a6418e-7f95-4988-b049-868fbf193449 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:44.039007 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a5a6418e-7f95-4988-b049-868fbf193449 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1285 microversion: 2.42 time: 0.268836 Oct 26 13:14:44.046828 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1458/2891] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:14:43 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1285 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:14:44.081607 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-be720a01-693e-4933-9cf3-0d589c3fd03a tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] Calling method '.version_select at 0x7f6731921b80>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:44.128529 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-be720a01-693e-4933-9cf3-0d589c3fd03a tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-397323208" status: 204 len: 0 microversion: 2.2 time: 0.066985 Oct 26 13:14:44.129505 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a06ef311-24ba-491d-b33d-1afd3b31d6ad tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:44.129730 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1459/2892] 10.222.0.40 () {60 vars in 1318 bytes} [Wed Oct 26 13:14:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-397323208 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:14:44.142856 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a06ef311-24ba-491d-b33d-1afd3b31d6ad tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/4f175b39-6703-43a3-a93b-e64e411d53b5" status: 200 len: 1513 microversion: 2.1 time: 0.643361 Oct 26 13:14:44.143474 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1434/2893] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:43 2022] GET /compute/v2.1/servers/4f175b39-6703-43a3-a93b-e64e411d53b5 => generated 1513 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:44.154027 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2efe962d-4ebb-4f93-87c4-e4b5989bd54f tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] Action: 'create', calling method: .version_select at 0x7f67326ed550>, body: {"keypair": {"name": "tempest-keypair-598725248", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVE56+UL6hEKyQBTHjEq128JUJfhO4znywB5t731KpvdfFFK0J7vjPYE9zR6bibixHMRNix/UfH1oXs86l0EfvxNbzWpa/1Eb7Al/QSc7oV9LeE1BgOLQYnqFcnXNcWRQ=="}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:14:44.164539 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e85f7b5e-a9ea-45ee-a040-4e864a7fc03a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:44.166894 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e85f7b5e-a9ea-45ee-a040-4e864a7fc03a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 789a55e0-21ba-4b2e-b8d4-c95999955e2b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:44.222692 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-2efe962d-4ebb-4f93-87c4-e4b5989bd54f tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] Getting quotas for project c2fcb0b837304706a19b8ad7bd0411fd. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:14:44.252124 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-2efe962d-4ebb-4f93-87c4-e4b5989bd54f tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] Getting quotas for user b0e717887ba248a480fb5b232bf82231 and project c2fcb0b837304706a19b8ad7bd0411fd. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:14:44.319549 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2efe962d-4ebb-4f93-87c4-e4b5989bd54f tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.172169 Oct 26 13:14:44.322665 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1435/2894] 10.222.0.40 () {62 vars in 1199 bytes} [Wed Oct 26 13:14:44 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 179 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 26 13:14:44.337308 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-00f8ff0d-292d-4db4-9db0-e08b57642476 tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] Calling method '.version_select at 0x7f6732715430>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:44.370113 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-00f8ff0d-292d-4db4-9db0-e08b57642476 tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] 10.222.0.40 "GET /compute/v2.1/os-keypairs/tempest-keypair-598725248" status: 200 len: 512 microversion: 2.2 time: 0.034908 Oct 26 13:14:44.370764 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1436/2895] 10.222.0.40 () {60 vars in 1255 bytes} [Wed Oct 26 13:14:44 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-598725248 => generated 512 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:14:44.384676 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9d871d90-462b-410b-af28-de6e3e20670c tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] Calling method '.version_select at 0x7f67369b2550>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:44.389473 n-d-862686-1 devstack@n-api.service[120597]: WARNING oslo_db.sqlalchemy.utils [None req-9d871d90-462b-410b-af28-de6e3e20670c tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 26 13:14:44.408025 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9d871d90-462b-410b-af28-de6e3e20670c tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] 10.222.0.40 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.028323 Oct 26 13:14:44.408983 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1437/2896] 10.222.0.40 () {60 vars in 1177 bytes} [Wed Oct 26 13:14:44 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:14:44.428198 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-13c1fdec-9375-42cd-a675-0157970b883f tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] Calling method '.version_select at 0x7f6732556160>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:44.479207 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-13c1fdec-9375-42cd-a675-0157970b883f tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-598725248" status: 204 len: 0 microversion: 2.2 time: 0.061960 Oct 26 13:14:44.485643 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1438/2897] 10.222.0.40 () {60 vars in 1258 bytes} [Wed Oct 26 13:14:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-598725248 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:14:44.491353 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1f3b9bb1-7aec-4104-9f3d-d372bf1bd899 tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] Action: 'create', calling method: .version_select at 0x7f67320ca4c0>, body: {"keypair": {"name": "tempest-keypair-298553633", "type": "x509"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:14:44.503873 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e85f7b5e-a9ea-45ee-a040-4e864a7fc03a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:44.520575 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e85f7b5e-a9ea-45ee-a040-4e864a7fc03a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b" status: 200 len: 1242 microversion: 2.1 time: 0.387067 Oct 26 13:14:44.539037 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1460/2898] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:44 2022] GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b => generated 1242 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:44.563025 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-1f3b9bb1-7aec-4104-9f3d-d372bf1bd899 tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] Getting quotas for project c2fcb0b837304706a19b8ad7bd0411fd. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:14:44.570559 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=8,nova_api:DELETE=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:14:44.584195 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-1f3b9bb1-7aec-4104-9f3d-d372bf1bd899 tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] Getting quotas for user b0e717887ba248a480fb5b232bf82231 and project c2fcb0b837304706a19b8ad7bd0411fd. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:14:44.603122 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0d20efad-3b93-407e-b2c9-442a86b64350 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:44.603744 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0d20efad-3b93-407e-b2c9-442a86b64350 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] [instance: ce37d19f-ed04-4e29-8210-62813d7a031d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:44.616313 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d20efad-3b93-407e-b2c9-442a86b64350 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:44.616816 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d20efad-3b93-407e-b2c9-442a86b64350 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:44.617359 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d20efad-3b93-407e-b2c9-442a86b64350 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:44.618235 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d20efad-3b93-407e-b2c9-442a86b64350 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:44.618797 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d20efad-3b93-407e-b2c9-442a86b64350 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:44.619583 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d20efad-3b93-407e-b2c9-442a86b64350 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:44.667650 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.processutils [None req-1f3b9bb1-7aec-4104-9f3d-d372bf1bd899 tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp2nzbgfbh/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp2nzbgfbh/temp.key -subj /CN=b0e717887ba248a480fb5b232bf82231 -extensions v3_req_client {{(pid=120597) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 26 13:14:44.820737 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.processutils [None req-1f3b9bb1-7aec-4104-9f3d-d372bf1bd899 tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp2nzbgfbh/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp2nzbgfbh/temp.key -subj /CN=b0e717887ba248a480fb5b232bf82231 -extensions v3_req_client" returned: 0 in 0.152s {{(pid=120597) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 26 13:14:44.823503 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.processutils [None req-1f3b9bb1-7aec-4104-9f3d-d372bf1bd899 tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp2nzbgfbh/temp.key -password pass: {{(pid=120597) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 26 13:14:44.827330 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0d20efad-3b93-407e-b2c9-442a86b64350 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231628702cd4fe59f9bc17f79146195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1661af840e4aaaba8cb8ec5e8a4a6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:44.838503 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0d20efad-3b93-407e-b2c9-442a86b64350 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] 10.222.0.40 "GET /compute/v2.1/servers/ce37d19f-ed04-4e29-8210-62813d7a031d" status: 200 len: 1634 microversion: 2.1 time: 0.239495 Oct 26 13:14:44.839101 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1461/2899] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:44 2022] GET /compute/v2.1/servers/ce37d19f-ed04-4e29-8210-62813d7a031d => generated 1634 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:14:44.850628 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-833c45a3-4ac1-4be8-b266-4a039c860be4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:44.864900 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-833c45a3-4ac1-4be8-b266-4a039c860be4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: a1dbfc30-8cbf-4a85-8847-a24031f5e3dc] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:44.887157 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.processutils [None req-1f3b9bb1-7aec-4104-9f3d-d372bf1bd899 tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp2nzbgfbh/temp.key -password pass:" returned: 0 in 0.062s {{(pid=120597) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 26 13:14:44.889020 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-833c45a3-4ac1-4be8-b266-4a039c860be4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:44.889728 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-833c45a3-4ac1-4be8-b266-4a039c860be4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:44.890195 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-833c45a3-4ac1-4be8-b266-4a039c860be4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:44.890955 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-833c45a3-4ac1-4be8-b266-4a039c860be4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:44.891417 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-833c45a3-4ac1-4be8-b266-4a039c860be4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:44.893869 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-833c45a3-4ac1-4be8-b266-4a039c860be4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:44.991188 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-1f3b9bb1-7aec-4104-9f3d-d372bf1bd899 tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] Getting quotas for project c2fcb0b837304706a19b8ad7bd0411fd. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:14:45.025110 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-1f3b9bb1-7aec-4104-9f3d-d372bf1bd899 tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] Getting quotas for user b0e717887ba248a480fb5b232bf82231 and project c2fcb0b837304706a19b8ad7bd0411fd. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:14:45.142503 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1f3b9bb1-7aec-4104-9f3d-d372bf1bd899 tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 4680 microversion: 2.2 time: 0.649669 Oct 26 13:14:45.164994 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1439/2900] 10.222.0.40 () {62 vars in 1198 bytes} [Wed Oct 26 13:14:44 2022] POST /compute/v2.1/os-keypairs => generated 4680 bytes in 679 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:14:45.197147 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b0a4eca1-719d-4374-8db0-7396bbd832d3 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:45.203926 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b0a4eca1-719d-4374-8db0-7396bbd832d3 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:45.262053 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-833c45a3-4ac1-4be8-b266-4a039c860be4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:45.279473 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-833c45a3-4ac1-4be8-b266-4a039c860be4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc" status: 200 len: 1274 microversion: 2.1 time: 0.430068 Oct 26 13:14:45.283474 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1462/2901] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:44 2022] GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc => generated 1274 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:45.298837 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8fd5f98c-4cda-4b8d-8e7c-cce75367332f tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] Calling method '.version_select at 0x7f67368e1d30>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:45.350633 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8fd5f98c-4cda-4b8d-8e7c-cce75367332f tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] 10.222.0.40 "GET /compute/v2.1/os-keypairs/tempest-keypair-298553633" status: 200 len: 1533 microversion: 2.2 time: 0.065316 Oct 26 13:14:45.352559 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1463/2902] 10.222.0.40 () {60 vars in 1255 bytes} [Wed Oct 26 13:14:45 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-298553633 => generated 1533 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:45.405555 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e3bb6409-84f5-4fc7-a503-ef6e79caddd7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:45.406510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e3bb6409-84f5-4fc7-a503-ef6e79caddd7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 4f175b39-6703-43a3-a93b-e64e411d53b5] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:45.418473 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:14:45.466011 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e3bb6409-84f5-4fc7-a503-ef6e79caddd7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:45.466882 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e3bb6409-84f5-4fc7-a503-ef6e79caddd7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:45.467506 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e3bb6409-84f5-4fc7-a503-ef6e79caddd7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:45.468411 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e3bb6409-84f5-4fc7-a503-ef6e79caddd7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:45.469031 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e3bb6409-84f5-4fc7-a503-ef6e79caddd7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:45.469662 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e3bb6409-84f5-4fc7-a503-ef6e79caddd7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:45.523082 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b0a4eca1-719d-4374-8db0-7396bbd832d3 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:45.564082 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b0a4eca1-719d-4374-8db0-7396bbd832d3 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:45.583257 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b0a4eca1-719d-4374-8db0-7396bbd832d3 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:45.586891 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b0a4eca1-719d-4374-8db0-7396bbd832d3 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1285 microversion: 2.42 time: 0.418373 Oct 26 13:14:45.589663 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1440/2903] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:14:45 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1285 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:14:45.612132 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-17e3855a-c18b-43cf-8740-58579a052651 tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] Calling method '.version_select at 0x7f6732656040>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:45.617045 n-d-862686-1 devstack@n-api.service[120597]: WARNING oslo_db.sqlalchemy.utils [None req-17e3855a-c18b-43cf-8740-58579a052651 tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 26 13:14:45.667022 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-17e3855a-c18b-43cf-8740-58579a052651 tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] 10.222.0.40 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.059817 Oct 26 13:14:45.670685 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1441/2904] 10.222.0.40 () {60 vars in 1177 bytes} [Wed Oct 26 13:14:45 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:45.688377 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9d90db7c-f50d-41f6-9b37-7a904da8d46f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:45.693933 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9d90db7c-f50d-41f6-9b37-7a904da8d46f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 789a55e0-21ba-4b2e-b8d4-c95999955e2b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:45.731861 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9d90db7c-f50d-41f6-9b37-7a904da8d46f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:45.734660 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9d90db7c-f50d-41f6-9b37-7a904da8d46f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:45.737755 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9d90db7c-f50d-41f6-9b37-7a904da8d46f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:45.738746 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9d90db7c-f50d-41f6-9b37-7a904da8d46f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:45.743413 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9d90db7c-f50d-41f6-9b37-7a904da8d46f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:45.744729 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9d90db7c-f50d-41f6-9b37-7a904da8d46f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:45.863901 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e3bb6409-84f5-4fc7-a503-ef6e79caddd7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:45.885863 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e3bb6409-84f5-4fc7-a503-ef6e79caddd7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/4f175b39-6703-43a3-a93b-e64e411d53b5" status: 200 len: 1471 microversion: 2.1 time: 0.521814 Oct 26 13:14:45.909357 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1464/2905] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:45 2022] GET /compute/v2.1/servers/4f175b39-6703-43a3-a93b-e64e411d53b5 => generated 1471 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:45.915790 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b38bac24-0550-4c0c-a962-37c3656b3514 tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] Calling method '.version_select at 0x7f67318bc280>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:45.954769 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b38bac24-0550-4c0c-a962-37c3656b3514 tempest-KeyPairsV22TestJSON-839797762 tempest-KeyPairsV22TestJSON-839797762-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-298553633" status: 204 len: 0 microversion: 2.2 time: 0.043564 Oct 26 13:14:45.957103 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1465/2906] 10.222.0.40 () {60 vars in 1258 bytes} [Wed Oct 26 13:14:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-298553633 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:14:45.968519 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7e0ad136-90a3-41a9-9bf2-9d993ac6ebb9 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:45.969460 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7e0ad136-90a3-41a9-9bf2-9d993ac6ebb9 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] [instance: ce37d19f-ed04-4e29-8210-62813d7a031d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:45.982326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e0ad136-90a3-41a9-9bf2-9d993ac6ebb9 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:45.987276 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e0ad136-90a3-41a9-9bf2-9d993ac6ebb9 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:45.987739 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e0ad136-90a3-41a9-9bf2-9d993ac6ebb9 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:45.988496 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e0ad136-90a3-41a9-9bf2-9d993ac6ebb9 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:45.988993 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e0ad136-90a3-41a9-9bf2-9d993ac6ebb9 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:45.989395 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e0ad136-90a3-41a9-9bf2-9d993ac6ebb9 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:46.137190 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9d90db7c-f50d-41f6-9b37-7a904da8d46f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:46.165626 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9d90db7c-f50d-41f6-9b37-7a904da8d46f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b" status: 200 len: 1294 microversion: 2.1 time: 0.492622 Oct 26 13:14:46.178876 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1442/2907] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:45 2022] GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b => generated 1294 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:46.202335 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-2cd14aa0-cf83-4349-a47f-2c03ca805817 req-986bc35d-7d30-4139-8696-15a6fccca575 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f175b39-6703-43a3-a93b-e64e411d53b5", "name": "network-vif-deleted", "tag": "c19db2ad-ad1d-4563-9cee-7daf42934acf"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:14:46.240612 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2cd14aa0-cf83-4349-a47f-2c03ca805817 req-986bc35d-7d30-4139-8696-15a6fccca575 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:46.248606 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2cd14aa0-cf83-4349-a47f-2c03ca805817 req-986bc35d-7d30-4139-8696-15a6fccca575 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:46.249369 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2cd14aa0-cf83-4349-a47f-2c03ca805817 req-986bc35d-7d30-4139-8696-15a6fccca575 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:46.280535 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-2cd14aa0-cf83-4349-a47f-2c03ca805817 req-986bc35d-7d30-4139-8696-15a6fccca575 service nova] Creating event network-vif-deleted:c19db2ad-ad1d-4563-9cee-7daf42934acf for instance 4f175b39-6703-43a3-a93b-e64e411d53b5 on n-h1-862686-1 Oct 26 13:14:46.291477 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-2cd14aa0-cf83-4349-a47f-2c03ca805817 req-986bc35d-7d30-4139-8696-15a6fccca575 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110998 Oct 26 13:14:46.295805 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1443/2908] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:14:46.307945 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-be010e60-e4c2-471a-987b-e4c770a84054 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:46.311520 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-be010e60-e4c2-471a-987b-e4c770a84054 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: a1dbfc30-8cbf-4a85-8847-a24031f5e3dc] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:46.329719 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-be010e60-e4c2-471a-987b-e4c770a84054 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:46.331334 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-be010e60-e4c2-471a-987b-e4c770a84054 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:46.331334 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-be010e60-e4c2-471a-987b-e4c770a84054 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:46.331545 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-be010e60-e4c2-471a-987b-e4c770a84054 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:46.331871 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-be010e60-e4c2-471a-987b-e4c770a84054 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:46.332333 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-be010e60-e4c2-471a-987b-e4c770a84054 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:46.398034 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7e0ad136-90a3-41a9-9bf2-9d993ac6ebb9 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231628702cd4fe59f9bc17f79146195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1661af840e4aaaba8cb8ec5e8a4a6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:46.414460 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7e0ad136-90a3-41a9-9bf2-9d993ac6ebb9 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] 10.222.0.40 "GET /compute/v2.1/servers/ce37d19f-ed04-4e29-8210-62813d7a031d" status: 200 len: 1634 microversion: 2.1 time: 0.455358 Oct 26 13:14:46.415934 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1466/2909] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:45 2022] GET /compute/v2.1/servers/ce37d19f-ed04-4e29-8210-62813d7a031d => generated 1634 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:46.423703 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-a8e0e19d-96ce-47e3-b075-dd46356c377c req-ea1c2952-7028-4e1a-9ce9-687f12a69d2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce37d19f-ed04-4e29-8210-62813d7a031d", "name": "network-vif-deleted", "tag": "cd6cbdca-c4c5-42cc-a245-540904c7ed8d"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:14:46.437882 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-a8e0e19d-96ce-47e3-b075-dd46356c377c req-ea1c2952-7028-4e1a-9ce9-687f12a69d2c service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:46.438591 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-a8e0e19d-96ce-47e3-b075-dd46356c377c req-ea1c2952-7028-4e1a-9ce9-687f12a69d2c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:46.439246 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-a8e0e19d-96ce-47e3-b075-dd46356c377c req-ea1c2952-7028-4e1a-9ce9-687f12a69d2c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:46.467562 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-a8e0e19d-96ce-47e3-b075-dd46356c377c req-ea1c2952-7028-4e1a-9ce9-687f12a69d2c service nova] Creating event network-vif-deleted:cd6cbdca-c4c5-42cc-a245-540904c7ed8d for instance ce37d19f-ed04-4e29-8210-62813d7a031d on n-h2-862686-1 Oct 26 13:14:46.474316 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-a8e0e19d-96ce-47e3-b075-dd46356c377c req-ea1c2952-7028-4e1a-9ce9-687f12a69d2c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055025 Oct 26 13:14:46.475084 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1467/2910] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:14:46.619664 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4e94f85a-07de-432a-808b-62177208b064 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:46.620371 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4e94f85a-07de-432a-808b-62177208b064 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:46.633169 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e94f85a-07de-432a-808b-62177208b064 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:46.648500 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e94f85a-07de-432a-808b-62177208b064 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:46.649957 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e94f85a-07de-432a-808b-62177208b064 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:46.652395 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e94f85a-07de-432a-808b-62177208b064 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:46.655539 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e94f85a-07de-432a-808b-62177208b064 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:46.660642 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e94f85a-07de-432a-808b-62177208b064 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:46.909621 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:14:46.984444 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-be010e60-e4c2-471a-987b-e4c770a84054 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:46.998224 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-be010e60-e4c2-471a-987b-e4c770a84054 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc" status: 200 len: 1316 microversion: 2.1 time: 0.694127 Oct 26 13:14:47.022641 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1444/2911] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:46 2022] GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc => generated 1316 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:47.034568 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3c8e439e-4eec-482b-97e3-f1ee6eb2def0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:47.036439 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3c8e439e-4eec-482b-97e3-f1ee6eb2def0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 4f175b39-6703-43a3-a93b-e64e411d53b5] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:47.047907 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3c8e439e-4eec-482b-97e3-f1ee6eb2def0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:47.048612 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3c8e439e-4eec-482b-97e3-f1ee6eb2def0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:47.049236 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3c8e439e-4eec-482b-97e3-f1ee6eb2def0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:47.050429 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3c8e439e-4eec-482b-97e3-f1ee6eb2def0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:47.051069 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3c8e439e-4eec-482b-97e3-f1ee6eb2def0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:47.051676 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3c8e439e-4eec-482b-97e3-f1ee6eb2def0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:47.103607 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4e94f85a-07de-432a-808b-62177208b064 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:47.119931 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4e94f85a-07de-432a-808b-62177208b064 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:47.121393 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4e94f85a-07de-432a-808b-62177208b064 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:47.123545 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4e94f85a-07de-432a-808b-62177208b064 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1575 microversion: 2.42 time: 0.509130 Oct 26 13:14:47.136680 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3c8e439e-4eec-482b-97e3-f1ee6eb2def0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:47.137339 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3c8e439e-4eec-482b-97e3-f1ee6eb2def0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:47.138340 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3c8e439e-4eec-482b-97e3-f1ee6eb2def0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:47.139021 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-3c8e439e-4eec-482b-97e3-f1ee6eb2def0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lazy-loading 'fault' on Instance uuid 4f175b39-6703-43a3-a93b-e64e411d53b5 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:14:47.150880 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1468/2912] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:14:46 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1575 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:14:47.203215 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-356dea89-4de9-446f-88d5-4ffd173d0fcf tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:47.204151 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-356dea89-4de9-446f-88d5-4ffd173d0fcf tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 789a55e0-21ba-4b2e-b8d4-c95999955e2b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:47.213150 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-356dea89-4de9-446f-88d5-4ffd173d0fcf tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:47.219895 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-356dea89-4de9-446f-88d5-4ffd173d0fcf tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:47.220348 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-356dea89-4de9-446f-88d5-4ffd173d0fcf tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:47.221088 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-356dea89-4de9-446f-88d5-4ffd173d0fcf tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:47.221820 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-356dea89-4de9-446f-88d5-4ffd173d0fcf tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:47.221981 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-356dea89-4de9-446f-88d5-4ffd173d0fcf tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:47.301930 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3c8e439e-4eec-482b-97e3-f1ee6eb2def0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:47.314612 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3c8e439e-4eec-482b-97e3-f1ee6eb2def0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/4f175b39-6703-43a3-a93b-e64e411d53b5" status: 200 len: 1318 microversion: 2.1 time: 0.289561 Oct 26 13:14:47.319215 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1445/2913] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:47 2022] GET /compute/v2.1/servers/4f175b39-6703-43a3-a93b-e64e411d53b5 => generated 1318 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:47.443642 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-625ca46e-f3bd-41fe-8da6-3ef6c2a34b22 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:47.444337 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-625ca46e-f3bd-41fe-8da6-3ef6c2a34b22 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] [instance: ce37d19f-ed04-4e29-8210-62813d7a031d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:47.457464 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-625ca46e-f3bd-41fe-8da6-3ef6c2a34b22 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:47.458705 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-625ca46e-f3bd-41fe-8da6-3ef6c2a34b22 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:47.461022 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-625ca46e-f3bd-41fe-8da6-3ef6c2a34b22 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:47.461872 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-625ca46e-f3bd-41fe-8da6-3ef6c2a34b22 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:47.463735 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-625ca46e-f3bd-41fe-8da6-3ef6c2a34b22 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:47.464285 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-625ca46e-f3bd-41fe-8da6-3ef6c2a34b22 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:47.563310 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-356dea89-4de9-446f-88d5-4ffd173d0fcf tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:47.579512 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-356dea89-4de9-446f-88d5-4ffd173d0fcf tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b" status: 200 len: 1300 microversion: 2.1 time: 0.378960 Oct 26 13:14:47.579741 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-625ca46e-f3bd-41fe-8da6-3ef6c2a34b22 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:47.580228 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-625ca46e-f3bd-41fe-8da6-3ef6c2a34b22 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:47.580679 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-625ca46e-f3bd-41fe-8da6-3ef6c2a34b22 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:47.596232 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1469/2914] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:47 2022] GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b => generated 1300 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:47.596461 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-625ca46e-f3bd-41fe-8da6-3ef6c2a34b22 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lazy-loading 'fault' on Instance uuid ce37d19f-ed04-4e29-8210-62813d7a031d {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:14:47.736535 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-625ca46e-f3bd-41fe-8da6-3ef6c2a34b22 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231628702cd4fe59f9bc17f79146195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1661af840e4aaaba8cb8ec5e8a4a6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:47.749074 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-625ca46e-f3bd-41fe-8da6-3ef6c2a34b22 tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] 10.222.0.40 "GET /compute/v2.1/servers/ce37d19f-ed04-4e29-8210-62813d7a031d" status: 200 len: 1360 microversion: 2.1 time: 0.310311 Oct 26 13:14:47.769343 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1446/2915] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:47 2022] GET /compute/v2.1/servers/ce37d19f-ed04-4e29-8210-62813d7a031d => generated 1360 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:48.029604 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3e705507-5629-491a-8139-a8bcf53fe49e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:48.030403 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3e705507-5629-491a-8139-a8bcf53fe49e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: a1dbfc30-8cbf-4a85-8847-a24031f5e3dc] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:48.041730 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3e705507-5629-491a-8139-a8bcf53fe49e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:48.046274 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3e705507-5629-491a-8139-a8bcf53fe49e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:48.046919 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3e705507-5629-491a-8139-a8bcf53fe49e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:48.047792 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3e705507-5629-491a-8139-a8bcf53fe49e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:48.049710 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3e705507-5629-491a-8139-a8bcf53fe49e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:48.050262 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3e705507-5629-491a-8139-a8bcf53fe49e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:48.154996 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-30a08ad0-7eb6-41bd-8e70-d475c94ec3f4 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:48.156204 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-30a08ad0-7eb6-41bd-8e70-d475c94ec3f4 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:48.163439 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-30a08ad0-7eb6-41bd-8e70-d475c94ec3f4 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:48.164266 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-30a08ad0-7eb6-41bd-8e70-d475c94ec3f4 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:48.164971 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-30a08ad0-7eb6-41bd-8e70-d475c94ec3f4 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:48.165948 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-30a08ad0-7eb6-41bd-8e70-d475c94ec3f4 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:48.166959 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-30a08ad0-7eb6-41bd-8e70-d475c94ec3f4 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:48.167626 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-30a08ad0-7eb6-41bd-8e70-d475c94ec3f4 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:48.430499 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-30a08ad0-7eb6-41bd-8e70-d475c94ec3f4 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:48.444793 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-30a08ad0-7eb6-41bd-8e70-d475c94ec3f4 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:48.447118 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-30a08ad0-7eb6-41bd-8e70-d475c94ec3f4 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:48.450646 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-30a08ad0-7eb6-41bd-8e70-d475c94ec3f4 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1593 microversion: 2.42 time: 0.298246 Oct 26 13:14:48.463422 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1447/2916] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:14:48 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1593 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:14:48.478325 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c0adf8b3-6b1b-4797-bff2-f89c8c6057ed tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:48.479100 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c0adf8b3-6b1b-4797-bff2-f89c8c6057ed tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 4f175b39-6703-43a3-a93b-e64e411d53b5] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:48.487786 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0adf8b3-6b1b-4797-bff2-f89c8c6057ed tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:48.488470 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0adf8b3-6b1b-4797-bff2-f89c8c6057ed tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:48.489005 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0adf8b3-6b1b-4797-bff2-f89c8c6057ed tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:48.490067 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0adf8b3-6b1b-4797-bff2-f89c8c6057ed tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:48.490618 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0adf8b3-6b1b-4797-bff2-f89c8c6057ed tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:48.491230 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0adf8b3-6b1b-4797-bff2-f89c8c6057ed tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:48.509644 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-c0adf8b3-6b1b-4797-bff2-f89c8c6057ed tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] HTTP exception thrown: Instance 4f175b39-6703-43a3-a93b-e64e411d53b5 could not be found. Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c0adf8b3-6b1b-4797-bff2-f89c8c6057ed tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Request method failure captured: Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/4f175b39-6703-43a3-a93b-e64e411d53b5 HTTP/1.1 Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTJbgpOJ6_WXapLDSc4DXB2ybbuKvfF9irakf13MnXe_PUvQw0tvwC_KXpEDb02nWk9gKVB2DnChPFFUGp_xOUQaSFHL5E80bTALTu8ZJijTkAv_z2Y1Gdi1cyNAMKmLE7ZnzWq0oDflWXhf1sSJNtguU-rMZFkiGbBps0dj1yOxZiU Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 3f690a680b284d82ac586346427423c3 Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersTestJSON-1612525130 Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3f690a680b284d82ac586346427423c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f690a680b284d82ac586346427423c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3f690a680b284d82ac586346427423c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f690a680b284d82ac586346427423c3"}]}] Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersTestJSON-1612525130 Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 3f690a680b284d82ac586346427423c3 Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersTestJSON-1612525130 Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersTestJSON-1612525130-project Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: fbe30a73a18d49afa07f7a66aee7805d Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersTestJSON-1612525130-project Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 4f175b39-6703-43a3-a93b-e64e411d53b5 could not be found. Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '4f175b39-6703-43a3-a93b-e64e411d53b5'} Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f175b39-6703-43a3-a93b-e64e411d53b5 could not be found. Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f175b39-6703-43a3-a93b-e64e411d53b5 could not be found. Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:14:48.513199 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:14:48.518876 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:14:48.518876 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:14:48.518876 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:14:48.518876 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:14:48.518876 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:14:48.518876 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f175b39-6703-43a3-a93b-e64e411d53b5 could not be found. Oct 26 13:14:48.518876 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:14:48.518876 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c0adf8b3-6b1b-4797-bff2-f89c8c6057ed tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Returning 404 to user: Instance 4f175b39-6703-43a3-a93b-e64e411d53b5 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:14:48.520524 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c0adf8b3-6b1b-4797-bff2-f89c8c6057ed tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/4f175b39-6703-43a3-a93b-e64e411d53b5" status: 404 len: 111 microversion: 2.1 time: 0.055605 Oct 26 13:14:48.522052 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1448/2917] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:48 2022] GET /compute/v2.1/servers/4f175b39-6703-43a3-a93b-e64e411d53b5 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:14:48.527217 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-27c4fdb7-3e84-4834-a635-12036f4b18f5 req-caba2d59-ebf4-46ac-8e89-52b5ebb2ac00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1dbfc30-8cbf-4a85-8847-a24031f5e3dc", "tag": "6a1b48d4-d8c0-4f57-984c-ddd4f192ec77"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:14:48.538999 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-27c4fdb7-3e84-4834-a635-12036f4b18f5 req-caba2d59-ebf4-46ac-8e89-52b5ebb2ac00 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:48.539747 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-27c4fdb7-3e84-4834-a635-12036f4b18f5 req-caba2d59-ebf4-46ac-8e89-52b5ebb2ac00 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:48.540390 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-27c4fdb7-3e84-4834-a635-12036f4b18f5 req-caba2d59-ebf4-46ac-8e89-52b5ebb2ac00 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:48.555135 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-27c4fdb7-3e84-4834-a635-12036f4b18f5 req-caba2d59-ebf4-46ac-8e89-52b5ebb2ac00 service nova] Creating event network-changed:6a1b48d4-d8c0-4f57-984c-ddd4f192ec77 for instance a1dbfc30-8cbf-4a85-8847-a24031f5e3dc on n-h2-862686-1 Oct 26 13:14:48.561510 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-27c4fdb7-3e84-4834-a635-12036f4b18f5 req-caba2d59-ebf4-46ac-8e89-52b5ebb2ac00 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038170 Oct 26 13:14:48.563024 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1449/2918] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:14:48.569221 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8577749b-c24c-4169-af73-d50171efe62b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '.version_select at 0x7f6732692ca0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:48.615975 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8577749b-c24c-4169-af73-d50171efe62b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-key-855270516" status: 202 len: 0 microversion: 2.1 time: 0.051459 Oct 26 13:14:48.617185 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1450/2919] 10.222.0.40 () {58 vars in 1206 bytes} [Wed Oct 26 13:14:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-855270516 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:14:48.622979 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d625b1b0-2722-4696-b099-23847e6ef8d4 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:48.623899 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d625b1b0-2722-4696-b099-23847e6ef8d4 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 789a55e0-21ba-4b2e-b8d4-c95999955e2b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:48.632145 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d625b1b0-2722-4696-b099-23847e6ef8d4 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:48.632798 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d625b1b0-2722-4696-b099-23847e6ef8d4 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:48.633337 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d625b1b0-2722-4696-b099-23847e6ef8d4 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:48.634338 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d625b1b0-2722-4696-b099-23847e6ef8d4 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:48.635701 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d625b1b0-2722-4696-b099-23847e6ef8d4 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:48.636321 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d625b1b0-2722-4696-b099-23847e6ef8d4 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:48.833170 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d625b1b0-2722-4696-b099-23847e6ef8d4 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:48.862052 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d625b1b0-2722-4696-b099-23847e6ef8d4 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b" status: 200 len: 1300 microversion: 2.1 time: 0.243470 Oct 26 13:14:48.864587 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1451/2920] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:48 2022] GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b => generated 1300 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:48.889364 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fd3cd412-cfca-44cc-bf22-62affc301e1e tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:48.890477 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fd3cd412-cfca-44cc-bf22-62affc301e1e tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] [instance: ce37d19f-ed04-4e29-8210-62813d7a031d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:48.900547 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd3cd412-cfca-44cc-bf22-62affc301e1e tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:48.901295 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd3cd412-cfca-44cc-bf22-62affc301e1e tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:48.902000 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd3cd412-cfca-44cc-bf22-62affc301e1e tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:48.908414 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd3cd412-cfca-44cc-bf22-62affc301e1e tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:48.909187 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd3cd412-cfca-44cc-bf22-62affc301e1e tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:48.910894 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd3cd412-cfca-44cc-bf22-62affc301e1e tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:48.938925 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-fd3cd412-cfca-44cc-bf22-62affc301e1e tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] HTTP exception thrown: Instance ce37d19f-ed04-4e29-8210-62813d7a031d could not be found. Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fd3cd412-cfca-44cc-bf22-62affc301e1e tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Request method failure captured: Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/ce37d19f-ed04-4e29-8210-62813d7a031d HTTP/1.1 Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTJv4_FyB5VkqXgYaAWfm6CMkRcAH2PrTjpiz_zHoF8PwA5fqmOhNjZXl6Uy5RmsQCB2UFnNx4f3duZp09r3odPqXknhQwwuQtPjTrtBPRVn9AMv11Hdhwd9PpFyYwWiuM7h5tviyADYGx-2AgdbkXgOmsRMUE7c-llaXxdor9UudRM Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 4b1661af840e4aaaba8cb8ec5e8a4a6a Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersTestJSON-1156790596 Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4b1661af840e4aaaba8cb8ec5e8a4a6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4b1661af840e4aaaba8cb8ec5e8a4a6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4b1661af840e4aaaba8cb8ec5e8a4a6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4b1661af840e4aaaba8cb8ec5e8a4a6a"}]}] Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersTestJSON-1156790596 Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 4b1661af840e4aaaba8cb8ec5e8a4a6a Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersTestJSON-1156790596 Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersTestJSON-1156790596-project Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 7231628702cd4fe59f9bc17f79146195 Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersTestJSON-1156790596-project Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance ce37d19f-ed04-4e29-8210-62813d7a031d could not be found. Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'ce37d19f-ed04-4e29-8210-62813d7a031d'} Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce37d19f-ed04-4e29-8210-62813d7a031d could not be found. Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce37d19f-ed04-4e29-8210-62813d7a031d could not be found. Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:14:48.942183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:14:48.946894 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:14:48.946894 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:14:48.946894 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:14:48.946894 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:14:48.946894 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:14:48.946894 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce37d19f-ed04-4e29-8210-62813d7a031d could not be found. Oct 26 13:14:48.946894 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:14:48.951273 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fd3cd412-cfca-44cc-bf22-62affc301e1e tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Returning 404 to user: Instance ce37d19f-ed04-4e29-8210-62813d7a031d could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:14:48.952649 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fd3cd412-cfca-44cc-bf22-62affc301e1e tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] 10.222.0.40 "GET /compute/v2.1/servers/ce37d19f-ed04-4e29-8210-62813d7a031d" status: 404 len: 111 microversion: 2.1 time: 0.085280 Oct 26 13:14:48.956817 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1452/2921] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:48 2022] GET /compute/v2.1/servers/ce37d19f-ed04-4e29-8210-62813d7a031d => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:14:48.964137 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-19abd4ed-d1c2-4b7f-ba04-0d9b8f8fc9e8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-289149436", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "bc8855c0-63b2-4c3e-b1b8-950c3dd488ef"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:14:48.975330 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3e705507-5629-491a-8139-a8bcf53fe49e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:48.985389 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3e705507-5629-491a-8139-a8bcf53fe49e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc" status: 200 len: 1316 microversion: 2.1 time: 0.959133 Oct 26 13:14:48.987797 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1470/2922] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:48 2022] GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc => generated 1316 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:48.997855 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5bdaff50-7a7c-47f4-9132-4b76b42d54ba tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] Calling method '.version_select at 0x7f673680c4c0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:49.047703 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5bdaff50-7a7c-47f4-9132-4b76b42d54ba tempest-ServersTestJSON-1156790596 tempest-ServersTestJSON-1156790596-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1091356544" status: 202 len: 0 microversion: 2.1 time: 0.058813 Oct 26 13:14:49.048605 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1471/2923] 10.222.0.40 () {58 vars in 1221 bytes} [Wed Oct 26 13:14:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1091356544 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:14:49.078697 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-19abd4ed-d1c2-4b7f-ba04-0d9b8f8fc9e8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] validate_networks() for [('bc8855c0-63b2-4c3e-b1b8-950c3dd488ef', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:14:49.489331 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ad397f8a-22d4-45ba-948b-d72079811082 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:49.490178 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ad397f8a-22d4-45ba-948b-d72079811082 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:49.512434 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ad397f8a-22d4-45ba-948b-d72079811082 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:49.513932 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ad397f8a-22d4-45ba-948b-d72079811082 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:49.514619 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ad397f8a-22d4-45ba-948b-d72079811082 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:49.517172 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ad397f8a-22d4-45ba-948b-d72079811082 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:49.517913 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ad397f8a-22d4-45ba-948b-d72079811082 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:49.520876 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ad397f8a-22d4-45ba-948b-d72079811082 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:49.789572 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ad397f8a-22d4-45ba-948b-d72079811082 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:49.810690 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ad397f8a-22d4-45ba-948b-d72079811082 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:49.812881 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ad397f8a-22d4-45ba-948b-d72079811082 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:49.816127 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ad397f8a-22d4-45ba-948b-d72079811082 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1593 microversion: 2.42 time: 0.334007 Oct 26 13:14:49.818891 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1472/2924] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:14:49 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1593 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:14:49.890475 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4f6f3616-0e28-4a42-bc93-1e592a0451f2 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:49.891104 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4f6f3616-0e28-4a42-bc93-1e592a0451f2 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 789a55e0-21ba-4b2e-b8d4-c95999955e2b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:49.900392 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f6f3616-0e28-4a42-bc93-1e592a0451f2 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:49.900815 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f6f3616-0e28-4a42-bc93-1e592a0451f2 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:49.901258 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f6f3616-0e28-4a42-bc93-1e592a0451f2 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:49.902001 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f6f3616-0e28-4a42-bc93-1e592a0451f2 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:49.902452 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f6f3616-0e28-4a42-bc93-1e592a0451f2 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:49.903172 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f6f3616-0e28-4a42-bc93-1e592a0451f2 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:50.202775 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4f6f3616-0e28-4a42-bc93-1e592a0451f2 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:50.210964 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4f6f3616-0e28-4a42-bc93-1e592a0451f2 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b" status: 200 len: 1300 microversion: 2.1 time: 0.325032 Oct 26 13:14:50.216715 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1473/2925] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:49 2022] GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b => generated 1300 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:14:50.222169 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c61788b3-7b82-4ee7-9a93-fc2dec117635 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:50.227951 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c61788b3-7b82-4ee7-9a93-fc2dec117635 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: a1dbfc30-8cbf-4a85-8847-a24031f5e3dc] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:50.252167 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c61788b3-7b82-4ee7-9a93-fc2dec117635 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:50.257000 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c61788b3-7b82-4ee7-9a93-fc2dec117635 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:50.257772 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c61788b3-7b82-4ee7-9a93-fc2dec117635 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:50.261164 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c61788b3-7b82-4ee7-9a93-fc2dec117635 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:50.264113 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c61788b3-7b82-4ee7-9a93-fc2dec117635 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:50.269526 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c61788b3-7b82-4ee7-9a93-fc2dec117635 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:50.390479 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-19abd4ed-d1c2-4b7f-ba04-0d9b8f8fc9e8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:14:50.391070 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-19abd4ed-d1c2-4b7f-ba04-0d9b8f8fc9e8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:14:50.391821 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-19abd4ed-d1c2-4b7f-ba04-0d9b8f8fc9e8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:14:50.392331 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-19abd4ed-d1c2-4b7f-ba04-0d9b8f8fc9e8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:14:50.392839 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-19abd4ed-d1c2-4b7f-ba04-0d9b8f8fc9e8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:14:50.410882 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-19abd4ed-d1c2-4b7f-ba04-0d9b8f8fc9e8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:50.411766 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-19abd4ed-d1c2-4b7f-ba04-0d9b8f8fc9e8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:50.414246 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-19abd4ed-d1c2-4b7f-ba04-0d9b8f8fc9e8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:50.415522 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-19abd4ed-d1c2-4b7f-ba04-0d9b8f8fc9e8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:50.417827 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-19abd4ed-d1c2-4b7f-ba04-0d9b8f8fc9e8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:50.419604 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-19abd4ed-d1c2-4b7f-ba04-0d9b8f8fc9e8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:50.463306 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-19abd4ed-d1c2-4b7f-ba04-0d9b8f8fc9e8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Getting quotas for project 3f690a680b284d82ac586346427423c3. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:14:50.483804 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-19abd4ed-d1c2-4b7f-ba04-0d9b8f8fc9e8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Getting quotas for user fbe30a73a18d49afa07f7a66aee7805d and project 3f690a680b284d82ac586346427423c3. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:14:50.500544 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-19abd4ed-d1c2-4b7f-ba04-0d9b8f8fc9e8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:14:50.504102 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-19abd4ed-d1c2-4b7f-ba04-0d9b8f8fc9e8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: a15dcabd-f50e-41f3-a7df-6b26412222a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:14:50.569170 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-19abd4ed-d1c2-4b7f-ba04-0d9b8f8fc9e8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.611147 Oct 26 13:14:50.572432 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1453/2926] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:14:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:14:50.584070 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8831eee2-521f-487d-adbb-332ace898ee7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:50.585015 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8831eee2-521f-487d-adbb-332ace898ee7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: a15dcabd-f50e-41f3-a7df-6b26412222a9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:50.757883 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8831eee2-521f-487d-adbb-332ace898ee7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:50.766276 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8831eee2-521f-487d-adbb-332ace898ee7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9" status: 200 len: 1208 microversion: 2.1 time: 0.186292 Oct 26 13:14:50.769361 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1454/2927] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:50 2022] GET /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9 => generated 1208 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:14:50.843619 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c61788b3-7b82-4ee7-9a93-fc2dec117635 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:50.845925 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-49670d27-1cf4-4cda-bed1-0a104ea7685d tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:50.846547 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-49670d27-1cf4-4cda-bed1-0a104ea7685d tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:50.865431 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49670d27-1cf4-4cda-bed1-0a104ea7685d tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:50.866015 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49670d27-1cf4-4cda-bed1-0a104ea7685d tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:50.866462 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49670d27-1cf4-4cda-bed1-0a104ea7685d tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:50.867662 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49670d27-1cf4-4cda-bed1-0a104ea7685d tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:50.867832 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c61788b3-7b82-4ee7-9a93-fc2dec117635 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc" status: 200 len: 1316 microversion: 2.1 time: 0.649152 Oct 26 13:14:50.867921 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49670d27-1cf4-4cda-bed1-0a104ea7685d tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:50.868090 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1474/2928] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:50 2022] GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc => generated 1316 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:50.882387 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49670d27-1cf4-4cda-bed1-0a104ea7685d tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:50.896430 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:14:51.153573 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-49670d27-1cf4-4cda-bed1-0a104ea7685d tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:51.167130 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-49670d27-1cf4-4cda-bed1-0a104ea7685d tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:51.176786 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-49670d27-1cf4-4cda-bed1-0a104ea7685d tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:51.181908 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-49670d27-1cf4-4cda-bed1-0a104ea7685d tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1593 microversion: 2.42 time: 0.336587 Oct 26 13:14:51.193888 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1455/2929] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:14:50 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1593 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:14:51.247624 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8f99cae8-37fd-4523-afd7-872a69e75de1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:51.249039 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8f99cae8-37fd-4523-afd7-872a69e75de1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 789a55e0-21ba-4b2e-b8d4-c95999955e2b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:51.264780 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f99cae8-37fd-4523-afd7-872a69e75de1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:51.266667 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f99cae8-37fd-4523-afd7-872a69e75de1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:51.267384 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f99cae8-37fd-4523-afd7-872a69e75de1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:51.271553 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f99cae8-37fd-4523-afd7-872a69e75de1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:51.272377 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f99cae8-37fd-4523-afd7-872a69e75de1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:51.273404 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f99cae8-37fd-4523-afd7-872a69e75de1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:51.792898 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ccc197a5-626d-42e1-ae7d-0417cf0ced4f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:51.795185 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ccc197a5-626d-42e1-ae7d-0417cf0ced4f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: a15dcabd-f50e-41f3-a7df-6b26412222a9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:51.814198 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ccc197a5-626d-42e1-ae7d-0417cf0ced4f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:51.817375 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ccc197a5-626d-42e1-ae7d-0417cf0ced4f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:51.820768 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ccc197a5-626d-42e1-ae7d-0417cf0ced4f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:51.822509 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ccc197a5-626d-42e1-ae7d-0417cf0ced4f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:51.823874 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ccc197a5-626d-42e1-ae7d-0417cf0ced4f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:51.824479 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ccc197a5-626d-42e1-ae7d-0417cf0ced4f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:52.040262 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ccc197a5-626d-42e1-ae7d-0417cf0ced4f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:52.059008 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ccc197a5-626d-42e1-ae7d-0417cf0ced4f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9" status: 200 len: 1204 microversion: 2.1 time: 0.271946 Oct 26 13:14:52.060938 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:14:52.079458 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1456/2930] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:51 2022] GET /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9 => generated 1204 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:52.092434 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-952bad10-677a-4587-bf56-ee54b9191ac5 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:52.093059 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-952bad10-677a-4587-bf56-ee54b9191ac5 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: a1dbfc30-8cbf-4a85-8847-a24031f5e3dc] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:52.112267 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-952bad10-677a-4587-bf56-ee54b9191ac5 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:52.115607 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-952bad10-677a-4587-bf56-ee54b9191ac5 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:52.116232 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-952bad10-677a-4587-bf56-ee54b9191ac5 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:52.119096 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-952bad10-677a-4587-bf56-ee54b9191ac5 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:52.119955 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-952bad10-677a-4587-bf56-ee54b9191ac5 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:52.120613 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-952bad10-677a-4587-bf56-ee54b9191ac5 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:52.161913 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8f99cae8-37fd-4523-afd7-872a69e75de1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:52.175605 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8f99cae8-37fd-4523-afd7-872a69e75de1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b" status: 200 len: 1367 microversion: 2.1 time: 0.936888 Oct 26 13:14:52.182717 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1475/2931] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:51 2022] GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b => generated 1367 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:52.215151 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1dba6bd1-c13a-4885-8b31-14ae83c59074 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:52.218476 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1dba6bd1-c13a-4885-8b31-14ae83c59074 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:52.236009 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1dba6bd1-c13a-4885-8b31-14ae83c59074 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:52.237673 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1dba6bd1-c13a-4885-8b31-14ae83c59074 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:52.240118 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1dba6bd1-c13a-4885-8b31-14ae83c59074 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:52.243483 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1dba6bd1-c13a-4885-8b31-14ae83c59074 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:52.246040 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1dba6bd1-c13a-4885-8b31-14ae83c59074 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:52.247473 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1dba6bd1-c13a-4885-8b31-14ae83c59074 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:52.478066 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-952bad10-677a-4587-bf56-ee54b9191ac5 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:52.490325 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-952bad10-677a-4587-bf56-ee54b9191ac5 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc" status: 200 len: 1316 microversion: 2.1 time: 0.406147 Oct 26 13:14:52.491219 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1457/2932] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:52 2022] GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc => generated 1316 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:53.082683 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1e3fb72c-c8ec-48af-b4f1-b0d4cc43b40c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:53.083750 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1e3fb72c-c8ec-48af-b4f1-b0d4cc43b40c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: a15dcabd-f50e-41f3-a7df-6b26412222a9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:53.103171 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1e3fb72c-c8ec-48af-b4f1-b0d4cc43b40c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:53.105952 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1e3fb72c-c8ec-48af-b4f1-b0d4cc43b40c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:53.106949 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1e3fb72c-c8ec-48af-b4f1-b0d4cc43b40c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:53.109963 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1e3fb72c-c8ec-48af-b4f1-b0d4cc43b40c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:53.112283 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1e3fb72c-c8ec-48af-b4f1-b0d4cc43b40c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:53.113060 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1e3fb72c-c8ec-48af-b4f1-b0d4cc43b40c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:53.330333 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1e3fb72c-c8ec-48af-b4f1-b0d4cc43b40c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:53.342057 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1e3fb72c-c8ec-48af-b4f1-b0d4cc43b40c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9" status: 200 len: 1266 microversion: 2.1 time: 0.261832 Oct 26 13:14:53.343819 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1458/2933] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:53 2022] GET /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9 => generated 1266 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:14:53.354226 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ad29cc4a-1d29-4f74-b981-05da31decf16 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:53.355889 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ad29cc4a-1d29-4f74-b981-05da31decf16 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 789a55e0-21ba-4b2e-b8d4-c95999955e2b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:53.370242 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad29cc4a-1d29-4f74-b981-05da31decf16 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:53.372707 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad29cc4a-1d29-4f74-b981-05da31decf16 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:53.373197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad29cc4a-1d29-4f74-b981-05da31decf16 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:53.374143 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad29cc4a-1d29-4f74-b981-05da31decf16 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:53.374601 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad29cc4a-1d29-4f74-b981-05da31decf16 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:53.375025 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad29cc4a-1d29-4f74-b981-05da31decf16 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:53.512197 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1dba6bd1-c13a-4885-8b31-14ae83c59074 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:53.530000 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1dba6bd1-c13a-4885-8b31-14ae83c59074 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:53.531474 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1dba6bd1-c13a-4885-8b31-14ae83c59074 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:53.532706 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1dba6bd1-c13a-4885-8b31-14ae83c59074 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1661 microversion: 2.42 time: 1.324775 Oct 26 13:14:53.533277 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1476/2934] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:14:52 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1661 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:14:53.578269 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ad04daf5-dc0e-4112-8ac0-eab25753f817 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:53.579205 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ad04daf5-dc0e-4112-8ac0-eab25753f817 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: a1dbfc30-8cbf-4a85-8847-a24031f5e3dc] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:53.585630 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ad04daf5-dc0e-4112-8ac0-eab25753f817 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:53.586342 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ad04daf5-dc0e-4112-8ac0-eab25753f817 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:53.586940 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ad04daf5-dc0e-4112-8ac0-eab25753f817 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:53.588619 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ad04daf5-dc0e-4112-8ac0-eab25753f817 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:53.594122 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ad04daf5-dc0e-4112-8ac0-eab25753f817 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:53.594810 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ad04daf5-dc0e-4112-8ac0-eab25753f817 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:53.986468 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ad29cc4a-1d29-4f74-b981-05da31decf16 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:53.998584 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ad29cc4a-1d29-4f74-b981-05da31decf16 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b" status: 200 len: 1367 microversion: 2.1 time: 0.653619 Oct 26 13:14:54.002803 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1459/2935] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:53 2022] GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b => generated 1367 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:54.011528 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-0cdbadc4-d2d6-4133-ad58-fac0fcd39b97 req-cf25b720-327b-48a2-a965-ce746317652d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1dbfc30-8cbf-4a85-8847-a24031f5e3dc", "name": "network-vif-plugged", "status": "completed", "tag": "6a1b48d4-d8c0-4f57-984c-ddd4f192ec77"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:14:54.034732 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-0cdbadc4-d2d6-4133-ad58-fac0fcd39b97 req-cf25b720-327b-48a2-a965-ce746317652d service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:54.046931 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-0cdbadc4-d2d6-4133-ad58-fac0fcd39b97 req-cf25b720-327b-48a2-a965-ce746317652d service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:54.047670 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-0cdbadc4-d2d6-4133-ad58-fac0fcd39b97 req-cf25b720-327b-48a2-a965-ce746317652d service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:54.070773 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-0cdbadc4-d2d6-4133-ad58-fac0fcd39b97 req-cf25b720-327b-48a2-a965-ce746317652d service nova] Creating event network-vif-plugged:6a1b48d4-d8c0-4f57-984c-ddd4f192ec77 for instance a1dbfc30-8cbf-4a85-8847-a24031f5e3dc on n-h2-862686-1 Oct 26 13:14:54.077042 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-0cdbadc4-d2d6-4133-ad58-fac0fcd39b97 req-cf25b720-327b-48a2-a965-ce746317652d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072697 Oct 26 13:14:54.078101 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1460/2936] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:14:54.374028 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-678004b6-c272-46c5-a2d7-c2b78e0d98e4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:54.376858 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-678004b6-c272-46c5-a2d7-c2b78e0d98e4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: a15dcabd-f50e-41f3-a7df-6b26412222a9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:54.397541 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-678004b6-c272-46c5-a2d7-c2b78e0d98e4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:54.398019 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-678004b6-c272-46c5-a2d7-c2b78e0d98e4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:54.402231 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-678004b6-c272-46c5-a2d7-c2b78e0d98e4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:54.403062 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-678004b6-c272-46c5-a2d7-c2b78e0d98e4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:54.403558 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-678004b6-c272-46c5-a2d7-c2b78e0d98e4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:54.404005 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-678004b6-c272-46c5-a2d7-c2b78e0d98e4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:54.465380 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ad04daf5-dc0e-4112-8ac0-eab25753f817 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:54.474605 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ad04daf5-dc0e-4112-8ac0-eab25753f817 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc" status: 200 len: 1316 microversion: 2.1 time: 0.910410 Oct 26 13:14:54.480263 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1477/2937] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:53 2022] GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc => generated 1316 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:54.566619 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ed35df3b-ddfc-46c1-8320-6dee61491d2f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:54.567399 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ed35df3b-ddfc-46c1-8320-6dee61491d2f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:54.576390 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=10 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:14:54.583110 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ed35df3b-ddfc-46c1-8320-6dee61491d2f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:54.583616 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ed35df3b-ddfc-46c1-8320-6dee61491d2f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:54.584063 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ed35df3b-ddfc-46c1-8320-6dee61491d2f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:54.584790 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ed35df3b-ddfc-46c1-8320-6dee61491d2f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:54.585253 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ed35df3b-ddfc-46c1-8320-6dee61491d2f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:54.594196 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ed35df3b-ddfc-46c1-8320-6dee61491d2f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:54.944294 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-678004b6-c272-46c5-a2d7-c2b78e0d98e4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:54.955183 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-678004b6-c272-46c5-a2d7-c2b78e0d98e4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9" status: 200 len: 1308 microversion: 2.1 time: 0.591089 Oct 26 13:14:54.957571 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1461/2938] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:54 2022] GET /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9 => generated 1308 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:14:54.963755 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9555dbc7-ba74-4918-aba5-6058426cece1 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:54.964302 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9555dbc7-ba74-4918-aba5-6058426cece1 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:54.979418 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9555dbc7-ba74-4918-aba5-6058426cece1 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:54.983769 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9555dbc7-ba74-4918-aba5-6058426cece1 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:54.984425 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9555dbc7-ba74-4918-aba5-6058426cece1 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:54.985382 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9555dbc7-ba74-4918-aba5-6058426cece1 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:54.988586 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9555dbc7-ba74-4918-aba5-6058426cece1 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:54.989214 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9555dbc7-ba74-4918-aba5-6058426cece1 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:55.392078 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9555dbc7-ba74-4918-aba5-6058426cece1 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c" status: 200 len: 1812 microversion: 2.1 time: 0.433388 Oct 26 13:14:55.397073 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1462/2939] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:54 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c => generated 1812 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:55.403567 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a986cb14-8ea4-413f-abcd-6242d320fc42 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:55.411220 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a986cb14-8ea4-413f-abcd-6242d320fc42 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 789a55e0-21ba-4b2e-b8d4-c95999955e2b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:55.425243 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a986cb14-8ea4-413f-abcd-6242d320fc42 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:55.426385 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a986cb14-8ea4-413f-abcd-6242d320fc42 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:55.426984 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a986cb14-8ea4-413f-abcd-6242d320fc42 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:55.429450 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a986cb14-8ea4-413f-abcd-6242d320fc42 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:55.432651 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a986cb14-8ea4-413f-abcd-6242d320fc42 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:55.435562 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a986cb14-8ea4-413f-abcd-6242d320fc42 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:55.710763 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ed35df3b-ddfc-46c1-8320-6dee61491d2f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:55.734200 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ed35df3b-ddfc-46c1-8320-6dee61491d2f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:55.742964 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ed35df3b-ddfc-46c1-8320-6dee61491d2f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:55.746519 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ed35df3b-ddfc-46c1-8320-6dee61491d2f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1661 microversion: 2.42 time: 1.185009 Oct 26 13:14:55.767077 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1478/2940] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:14:54 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1661 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:14:55.780549 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-683b1c46-0d54-4ecb-a715-2ca45b7e719f tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:55.784678 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-683b1c46-0d54-4ecb-a715-2ca45b7e719f tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:55.790418 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-683b1c46-0d54-4ecb-a715-2ca45b7e719f tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:55.791094 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-683b1c46-0d54-4ecb-a715-2ca45b7e719f tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:55.792091 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-683b1c46-0d54-4ecb-a715-2ca45b7e719f tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:55.793461 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-683b1c46-0d54-4ecb-a715-2ca45b7e719f tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:55.795152 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-683b1c46-0d54-4ecb-a715-2ca45b7e719f tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:55.799464 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a986cb14-8ea4-413f-abcd-6242d320fc42 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:55.808301 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a986cb14-8ea4-413f-abcd-6242d320fc42 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b" status: 200 len: 1367 microversion: 2.1 time: 0.409832 Oct 26 13:14:55.813441 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1463/2941] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:55 2022] GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b => generated 1367 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:55.821335 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0dadcfa8-4ac2-4f4a-83c2-a03684b6bcab tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:55.824081 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0dadcfa8-4ac2-4f4a-83c2-a03684b6bcab tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: a1dbfc30-8cbf-4a85-8847-a24031f5e3dc] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:55.837459 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0dadcfa8-4ac2-4f4a-83c2-a03684b6bcab tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:55.838894 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0dadcfa8-4ac2-4f4a-83c2-a03684b6bcab tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:55.839545 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0dadcfa8-4ac2-4f4a-83c2-a03684b6bcab tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:55.841009 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0dadcfa8-4ac2-4f4a-83c2-a03684b6bcab tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:55.842073 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0dadcfa8-4ac2-4f4a-83c2-a03684b6bcab tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:55.843029 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0dadcfa8-4ac2-4f4a-83c2-a03684b6bcab tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:55.865550 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-683b1c46-0d54-4ecb-a715-2ca45b7e719f tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.086740 Oct 26 13:14:55.867623 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1479/2942] 10.222.0.40 () {58 vars in 1176 bytes} [Wed Oct 26 13:14:55 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:14:55.991827 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-44121e2a-6d90-4f71-b38e-5e63dd5235f2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:55.992648 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-44121e2a-6d90-4f71-b38e-5e63dd5235f2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: a15dcabd-f50e-41f3-a7df-6b26412222a9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:56.009107 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-44121e2a-6d90-4f71-b38e-5e63dd5235f2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:56.009882 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-44121e2a-6d90-4f71-b38e-5e63dd5235f2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:56.010477 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-44121e2a-6d90-4f71-b38e-5e63dd5235f2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:56.011368 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-44121e2a-6d90-4f71-b38e-5e63dd5235f2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:56.018212 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-44121e2a-6d90-4f71-b38e-5e63dd5235f2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:56.019309 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-44121e2a-6d90-4f71-b38e-5e63dd5235f2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:56.217788 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0dadcfa8-4ac2-4f4a-83c2-a03684b6bcab tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:56.243591 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0dadcfa8-4ac2-4f4a-83c2-a03684b6bcab tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc" status: 200 len: 1316 microversion: 2.1 time: 0.424323 Oct 26 13:14:56.244267 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1464/2943] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:55 2022] GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc => generated 1316 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:56.580643 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-45f85957-9190-4964-8125-648785d797ec req-12df0195-8f77-4ece-90ae-ce7a164f87c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "789a55e0-21ba-4b2e-b8d4-c95999955e2b", "tag": "ef8bf176-1c77-4039-a167-e88ec9e88a43"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:14:56.658958 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-45f85957-9190-4964-8125-648785d797ec req-12df0195-8f77-4ece-90ae-ce7a164f87c4 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:56.662770 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-45f85957-9190-4964-8125-648785d797ec req-12df0195-8f77-4ece-90ae-ce7a164f87c4 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:56.664783 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-45f85957-9190-4964-8125-648785d797ec req-12df0195-8f77-4ece-90ae-ce7a164f87c4 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:56.708064 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-45f85957-9190-4964-8125-648785d797ec req-12df0195-8f77-4ece-90ae-ce7a164f87c4 service nova] Creating event network-changed:ef8bf176-1c77-4039-a167-e88ec9e88a43 for instance 789a55e0-21ba-4b2e-b8d4-c95999955e2b on n-h1-862686-1 Oct 26 13:14:56.722252 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-45f85957-9190-4964-8125-648785d797ec req-12df0195-8f77-4ece-90ae-ce7a164f87c4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147587 Oct 26 13:14:56.728606 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1465/2944] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:14:56.785280 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5f8f1995-94c4-426e-bc98-b60d922be235 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:56.786029 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5f8f1995-94c4-426e-bc98-b60d922be235 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:56.799812 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5f8f1995-94c4-426e-bc98-b60d922be235 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:56.800564 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5f8f1995-94c4-426e-bc98-b60d922be235 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:56.801361 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5f8f1995-94c4-426e-bc98-b60d922be235 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:56.802955 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5f8f1995-94c4-426e-bc98-b60d922be235 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:56.803560 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5f8f1995-94c4-426e-bc98-b60d922be235 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:56.804139 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5f8f1995-94c4-426e-bc98-b60d922be235 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:57.076279 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-44121e2a-6d90-4f71-b38e-5e63dd5235f2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:57.098748 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-44121e2a-6d90-4f71-b38e-5e63dd5235f2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9" status: 200 len: 1308 microversion: 2.1 time: 1.108035 Oct 26 13:14:57.099424 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1480/2945] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:55 2022] GET /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9 => generated 1308 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:57.123377 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3ab59303-59b9-467e-9ba7-3f52fd88856e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:57.135408 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3ab59303-59b9-467e-9ba7-3f52fd88856e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 789a55e0-21ba-4b2e-b8d4-c95999955e2b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:57.149347 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3ab59303-59b9-467e-9ba7-3f52fd88856e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:57.153761 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3ab59303-59b9-467e-9ba7-3f52fd88856e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:57.154780 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3ab59303-59b9-467e-9ba7-3f52fd88856e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:57.157275 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3ab59303-59b9-467e-9ba7-3f52fd88856e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:57.160880 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3ab59303-59b9-467e-9ba7-3f52fd88856e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:57.165414 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3ab59303-59b9-467e-9ba7-3f52fd88856e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:57.832091 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5f8f1995-94c4-426e-bc98-b60d922be235 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:57.851101 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5f8f1995-94c4-426e-bc98-b60d922be235 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:57.855185 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5f8f1995-94c4-426e-bc98-b60d922be235 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:57.857896 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5f8f1995-94c4-426e-bc98-b60d922be235 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1708 microversion: 2.42 time: 1.076872 Oct 26 13:14:57.859441 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1466/2946] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:14:56 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1708 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:14:57.878744 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c6b4d4d2-0471-465f-a6ff-ffe88644112f tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:57.879806 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c6b4d4d2-0471-465f-a6ff-ffe88644112f tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: a1dbfc30-8cbf-4a85-8847-a24031f5e3dc] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:57.889793 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c6b4d4d2-0471-465f-a6ff-ffe88644112f tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:57.890565 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c6b4d4d2-0471-465f-a6ff-ffe88644112f tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:57.891220 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c6b4d4d2-0471-465f-a6ff-ffe88644112f tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:57.892282 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c6b4d4d2-0471-465f-a6ff-ffe88644112f tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:57.892946 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c6b4d4d2-0471-465f-a6ff-ffe88644112f tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:57.894248 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c6b4d4d2-0471-465f-a6ff-ffe88644112f tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:58.334916 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c6b4d4d2-0471-465f-a6ff-ffe88644112f tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:58.350855 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c6b4d4d2-0471-465f-a6ff-ffe88644112f tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc" status: 200 len: 1506 microversion: 2.1 time: 0.490120 Oct 26 13:14:58.351454 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1467/2947] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:57 2022] GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc => generated 1506 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:58.365810 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-de621053-f734-40c5-9fce-0e2886b1a1b3 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:58.365810 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-de621053-f734-40c5-9fce-0e2886b1a1b3 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: a15dcabd-f50e-41f3-a7df-6b26412222a9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:58.371662 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-de621053-f734-40c5-9fce-0e2886b1a1b3 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:58.372853 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-de621053-f734-40c5-9fce-0e2886b1a1b3 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:58.373510 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-de621053-f734-40c5-9fce-0e2886b1a1b3 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:58.374222 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-de621053-f734-40c5-9fce-0e2886b1a1b3 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:58.374685 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-de621053-f734-40c5-9fce-0e2886b1a1b3 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:58.375112 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-de621053-f734-40c5-9fce-0e2886b1a1b3 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:58.641856 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3ab59303-59b9-467e-9ba7-3f52fd88856e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:58.651925 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3ab59303-59b9-467e-9ba7-3f52fd88856e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b" status: 200 len: 1367 microversion: 2.1 time: 1.536532 Oct 26 13:14:58.652812 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1481/2948] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:57 2022] GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b => generated 1367 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:58.658464 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1ad7b3b4-1252-4012-a6b1-550dfdd8ebd3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:58.659358 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1ad7b3b4-1252-4012-a6b1-550dfdd8ebd3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: a1dbfc30-8cbf-4a85-8847-a24031f5e3dc] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:58.665863 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ad7b3b4-1252-4012-a6b1-550dfdd8ebd3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:58.666652 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ad7b3b4-1252-4012-a6b1-550dfdd8ebd3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:58.667307 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ad7b3b4-1252-4012-a6b1-550dfdd8ebd3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:58.668365 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ad7b3b4-1252-4012-a6b1-550dfdd8ebd3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:58.669732 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ad7b3b4-1252-4012-a6b1-550dfdd8ebd3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:58.670378 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ad7b3b4-1252-4012-a6b1-550dfdd8ebd3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:58.737029 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-de621053-f734-40c5-9fce-0e2886b1a1b3 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:58.749748 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-de621053-f734-40c5-9fce-0e2886b1a1b3 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9" status: 200 len: 1308 microversion: 2.1 time: 0.394953 Oct 26 13:14:58.751834 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1468/2949] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:58 2022] GET /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9 => generated 1308 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:58.761935 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-ef2175e4-9bc6-4948-ae01-9bb89bd8bc24 req-13d70d48-7dfc-4e78-9e44-4e23e4b7f15b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a15dcabd-f50e-41f3-a7df-6b26412222a9", "tag": "0fc9a692-64c3-4d89-8074-c30f1ec979b6"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:14:58.788984 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:14:58.801552 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ef2175e4-9bc6-4948-ae01-9bb89bd8bc24 req-13d70d48-7dfc-4e78-9e44-4e23e4b7f15b service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:58.802144 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ef2175e4-9bc6-4948-ae01-9bb89bd8bc24 req-13d70d48-7dfc-4e78-9e44-4e23e4b7f15b service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:58.802592 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ef2175e4-9bc6-4948-ae01-9bb89bd8bc24 req-13d70d48-7dfc-4e78-9e44-4e23e4b7f15b service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:58.816405 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-ef2175e4-9bc6-4948-ae01-9bb89bd8bc24 req-13d70d48-7dfc-4e78-9e44-4e23e4b7f15b service nova] Creating event network-changed:0fc9a692-64c3-4d89-8074-c30f1ec979b6 for instance a15dcabd-f50e-41f3-a7df-6b26412222a9 on n-h2-862686-1 Oct 26 13:14:58.822389 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-ef2175e4-9bc6-4948-ae01-9bb89bd8bc24 req-13d70d48-7dfc-4e78-9e44-4e23e4b7f15b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068566 Oct 26 13:14:58.823391 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1469/2950] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:14:58.830684 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e43231c0-3c27-44e0-a937-b837901a4cdd tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c19ce93b-fdbc-4456-a52e-4d977d3a0cb6", "device": "/dev/xvdb"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:14:58.835063 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e43231c0-3c27-44e0-a937-b837901a4cdd tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:58.844127 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e43231c0-3c27-44e0-a937-b837901a4cdd tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:58.844836 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e43231c0-3c27-44e0-a937-b837901a4cdd tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:58.846048 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e43231c0-3c27-44e0-a937-b837901a4cdd tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:58.847143 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e43231c0-3c27-44e0-a937-b837901a4cdd tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:58.863042 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e43231c0-3c27-44e0-a937-b837901a4cdd tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:58.863867 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e43231c0-3c27-44e0-a937-b837901a4cdd tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:59.380078 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e43231c0-3c27-44e0-a937-b837901a4cdd tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "POST /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.554813 Oct 26 13:14:59.380632 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1470/2951] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Oct 26 13:14:58 2022] POST /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c/os-volume_attachments => generated 194 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:14:59.390140 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-27913339-004c-43f3-a6bc-1deb064cf19b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:59.390930 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-27913339-004c-43f3-a6bc-1deb064cf19b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:59.406077 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-27913339-004c-43f3-a6bc-1deb064cf19b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:59.406581 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-27913339-004c-43f3-a6bc-1deb064cf19b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:59.407014 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-27913339-004c-43f3-a6bc-1deb064cf19b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:59.407778 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-27913339-004c-43f3-a6bc-1deb064cf19b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:59.408170 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-27913339-004c-43f3-a6bc-1deb064cf19b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:59.408590 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-27913339-004c-43f3-a6bc-1deb064cf19b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:59.603093 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1ad7b3b4-1252-4012-a6b1-550dfdd8ebd3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:59.619731 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1ad7b3b4-1252-4012-a6b1-550dfdd8ebd3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc" status: 200 len: 1506 microversion: 2.1 time: 0.964755 Oct 26 13:14:59.621656 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1482/2952] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:58 2022] GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc => generated 1506 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:59.648246 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5243e00f-c401-43ea-9608-bdf62464d199 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:14:59.652781 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5243e00f-c401-43ea-9608-bdf62464d199 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: a1dbfc30-8cbf-4a85-8847-a24031f5e3dc] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:59.666470 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5243e00f-c401-43ea-9608-bdf62464d199 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:59.666887 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5243e00f-c401-43ea-9608-bdf62464d199 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:59.667329 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5243e00f-c401-43ea-9608-bdf62464d199 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:59.668042 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5243e00f-c401-43ea-9608-bdf62464d199 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:59.671596 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5243e00f-c401-43ea-9608-bdf62464d199 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:59.672113 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5243e00f-c401-43ea-9608-bdf62464d199 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:59.769715 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5243e00f-c401-43ea-9608-bdf62464d199 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "PUT /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc" status: 200 len: 1078 microversion: 2.1 time: 0.126987 Oct 26 13:14:59.771240 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1483/2953] 10.222.0.40 () {60 vars in 1256 bytes} [Wed Oct 26 13:14:59 2022] PUT /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc => generated 1078 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:14:59.777618 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-84f48581-3682-495a-8d46-987f2ccdeaed tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:14:59.780400 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-84f48581-3682-495a-8d46-987f2ccdeaed tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 789a55e0-21ba-4b2e-b8d4-c95999955e2b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:14:59.787835 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84f48581-3682-495a-8d46-987f2ccdeaed tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:59.788659 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84f48581-3682-495a-8d46-987f2ccdeaed tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:59.789251 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84f48581-3682-495a-8d46-987f2ccdeaed tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:59.790258 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84f48581-3682-495a-8d46-987f2ccdeaed tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:14:59.790871 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84f48581-3682-495a-8d46-987f2ccdeaed tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:14:59.791454 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84f48581-3682-495a-8d46-987f2ccdeaed tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:14:59.957897 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-27913339-004c-43f3-a6bc-1deb064cf19b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:59.979607 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-27913339-004c-43f3-a6bc-1deb064cf19b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:59.980779 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-27913339-004c-43f3-a6bc-1deb064cf19b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:14:59.994299 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-27913339-004c-43f3-a6bc-1deb064cf19b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1708 microversion: 2.42 time: 0.609669 Oct 26 13:14:59.994955 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1471/2954] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:14:59 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1708 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:15:00.006086 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a5098198-5c21-40e1-aa4b-df568984fda6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:00.016518 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a5098198-5c21-40e1-aa4b-df568984fda6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: a15dcabd-f50e-41f3-a7df-6b26412222a9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:00.051421 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5098198-5c21-40e1-aa4b-df568984fda6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:00.052281 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5098198-5c21-40e1-aa4b-df568984fda6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:00.052941 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5098198-5c21-40e1-aa4b-df568984fda6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:00.053948 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5098198-5c21-40e1-aa4b-df568984fda6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:00.054623 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5098198-5c21-40e1-aa4b-df568984fda6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:00.055262 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5098198-5c21-40e1-aa4b-df568984fda6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:00.084535 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:15:00.250738 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-84f48581-3682-495a-8d46-987f2ccdeaed tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:00.259039 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-84f48581-3682-495a-8d46-987f2ccdeaed tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b" status: 200 len: 1367 microversion: 2.1 time: 0.486497 Oct 26 13:15:00.274250 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1484/2955] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:59 2022] GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b => generated 1367 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:00.284932 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ed799be3-5067-48fb-ac6c-2fcb1402e922 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:00.285775 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ed799be3-5067-48fb-ac6c-2fcb1402e922 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: a1dbfc30-8cbf-4a85-8847-a24031f5e3dc] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:00.294191 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ed799be3-5067-48fb-ac6c-2fcb1402e922 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:00.294969 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ed799be3-5067-48fb-ac6c-2fcb1402e922 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:00.295574 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ed799be3-5067-48fb-ac6c-2fcb1402e922 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:00.296534 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ed799be3-5067-48fb-ac6c-2fcb1402e922 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:00.297264 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ed799be3-5067-48fb-ac6c-2fcb1402e922 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:00.297921 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ed799be3-5067-48fb-ac6c-2fcb1402e922 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:00.452821 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=10 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:15:00.760927 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ed799be3-5067-48fb-ac6c-2fcb1402e922 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:00.765125 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:15:00.765660 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=70 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:15:00.775595 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ed799be3-5067-48fb-ac6c-2fcb1402e922 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc" status: 200 len: 1504 microversion: 2.1 time: 0.499971 Oct 26 13:15:00.776474 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1485/2956] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:00 2022] GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc => generated 1504 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:00.795549 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a5098198-5c21-40e1-aa4b-df568984fda6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:00.846061 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a5098198-5c21-40e1-aa4b-df568984fda6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9" status: 200 len: 1308 microversion: 2.1 time: 0.828151 Oct 26 13:15:00.859380 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1472/2957] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:14:59 2022] GET /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9 => generated 1308 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:00.894512 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0443d721-d0c3-4a87-b8d0-c2d3a96b75f9 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:00.906710 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0443d721-d0c3-4a87-b8d0-c2d3a96b75f9 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: a1dbfc30-8cbf-4a85-8847-a24031f5e3dc] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:00.937857 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0443d721-d0c3-4a87-b8d0-c2d3a96b75f9 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:00.942987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0443d721-d0c3-4a87-b8d0-c2d3a96b75f9 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:00.945496 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0443d721-d0c3-4a87-b8d0-c2d3a96b75f9 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:00.946637 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0443d721-d0c3-4a87-b8d0-c2d3a96b75f9 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:00.950174 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0443d721-d0c3-4a87-b8d0-c2d3a96b75f9 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:00.950824 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0443d721-d0c3-4a87-b8d0-c2d3a96b75f9 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:01.224250 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-58bc787b-d117-4ab6-b244-4fd1c866f6cc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1058570620", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "cb59e2c8-6bcb-4fcf-b9e4-c01412b43c60"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:15:01.322085 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-58bc787b-d117-4ab6-b244-4fd1c866f6cc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] validate_networks() for [('cb59e2c8-6bcb-4fcf-b9e4-c01412b43c60', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:15:01.614999 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0443d721-d0c3-4a87-b8d0-c2d3a96b75f9 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:01.626751 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0443d721-d0c3-4a87-b8d0-c2d3a96b75f9 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc" status: 200 len: 1504 microversion: 2.1 time: 0.756854 Oct 26 13:15:01.641513 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1473/2958] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:00 2022] GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc => generated 1504 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:01.644332 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b035193a-53d4-42ac-8297-6658c837c99a tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:01.647513 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b035193a-53d4-42ac-8297-6658c837c99a tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:01.660609 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b035193a-53d4-42ac-8297-6658c837c99a tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:01.661380 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b035193a-53d4-42ac-8297-6658c837c99a tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:01.661902 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b035193a-53d4-42ac-8297-6658c837c99a tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:01.663035 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b035193a-53d4-42ac-8297-6658c837c99a tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:01.663185 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b035193a-53d4-42ac-8297-6658c837c99a tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:01.663583 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b035193a-53d4-42ac-8297-6658c837c99a tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:01.942931 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b035193a-53d4-42ac-8297-6658c837c99a tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:01.967619 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b035193a-53d4-42ac-8297-6658c837c99a tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:01.969082 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b035193a-53d4-42ac-8297-6658c837c99a tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:01.970306 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b035193a-53d4-42ac-8297-6658c837c99a tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1755 microversion: 2.42 time: 0.342028 Oct 26 13:15:01.983523 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1474/2959] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:15:01 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1755 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:15:01.983523 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-65288aec-39ab-4332-8fa7-2c99cbd2300b tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:01.983523 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-65288aec-39ab-4332-8fa7-2c99cbd2300b tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 789a55e0-21ba-4b2e-b8d4-c95999955e2b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:02.015405 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-65288aec-39ab-4332-8fa7-2c99cbd2300b tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:02.015904 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-65288aec-39ab-4332-8fa7-2c99cbd2300b tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:02.016363 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-65288aec-39ab-4332-8fa7-2c99cbd2300b tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:02.017067 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-65288aec-39ab-4332-8fa7-2c99cbd2300b tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:02.017543 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-65288aec-39ab-4332-8fa7-2c99cbd2300b tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:02.017970 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-65288aec-39ab-4332-8fa7-2c99cbd2300b tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:02.561324 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-65288aec-39ab-4332-8fa7-2c99cbd2300b tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:02.569747 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-65288aec-39ab-4332-8fa7-2c99cbd2300b tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b" status: 200 len: 1367 microversion: 2.1 time: 0.596537 Oct 26 13:15:02.580130 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1475/2960] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:01 2022] GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b => generated 1367 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:02.598548 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f3f45199-a7e3-4103-86ac-3153f0ad2fd3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:15:02.601869 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f3f45199-a7e3-4103-86ac-3153f0ad2fd3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: a1dbfc30-8cbf-4a85-8847-a24031f5e3dc] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:02.620506 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3f45199-a7e3-4103-86ac-3153f0ad2fd3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:02.623281 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3f45199-a7e3-4103-86ac-3153f0ad2fd3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:02.625573 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3f45199-a7e3-4103-86ac-3153f0ad2fd3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:02.627134 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3f45199-a7e3-4103-86ac-3153f0ad2fd3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:02.628492 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3f45199-a7e3-4103-86ac-3153f0ad2fd3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:02.639310 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3f45199-a7e3-4103-86ac-3153f0ad2fd3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:02.823123 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-f3f45199-a7e3-4103-86ac-3153f0ad2fd3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:15:02.823926 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-f3f45199-a7e3-4103-86ac-3153f0ad2fd3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:15:02.827583 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-f3f45199-a7e3-4103-86ac-3153f0ad2fd3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:15:02.828121 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-f3f45199-a7e3-4103-86ac-3153f0ad2fd3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:15:02.828652 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-f3f45199-a7e3-4103-86ac-3153f0ad2fd3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:15:03.011818 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f3f45199-a7e3-4103-86ac-3153f0ad2fd3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: a1dbfc30-8cbf-4a85-8847-a24031f5e3dc] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:03.048052 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3f45199-a7e3-4103-86ac-3153f0ad2fd3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:03.052924 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3f45199-a7e3-4103-86ac-3153f0ad2fd3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:03.054636 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3f45199-a7e3-4103-86ac-3153f0ad2fd3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:03.058528 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3f45199-a7e3-4103-86ac-3153f0ad2fd3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:03.061212 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3f45199-a7e3-4103-86ac-3153f0ad2fd3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:03.063813 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3f45199-a7e3-4103-86ac-3153f0ad2fd3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:03.146202 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f3f45199-a7e3-4103-86ac-3153f0ad2fd3 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "POST /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc/action" status: 202 len: 1110 microversion: 2.1 time: 0.564443 Oct 26 13:15:03.147685 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1476/2961] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:15:02 2022] POST /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc/action => generated 1110 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 26 13:15:03.158793 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-da538acd-155b-4028-ae12-19359c718ac7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:03.159594 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-da538acd-155b-4028-ae12-19359c718ac7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: a15dcabd-f50e-41f3-a7df-6b26412222a9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:03.174552 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-da538acd-155b-4028-ae12-19359c718ac7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:03.175309 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-da538acd-155b-4028-ae12-19359c718ac7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:03.175927 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-da538acd-155b-4028-ae12-19359c718ac7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:03.178236 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-da538acd-155b-4028-ae12-19359c718ac7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:03.178942 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-da538acd-155b-4028-ae12-19359c718ac7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:03.179557 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-da538acd-155b-4028-ae12-19359c718ac7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:03.540056 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-da538acd-155b-4028-ae12-19359c718ac7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:03.555324 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-da538acd-155b-4028-ae12-19359c718ac7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9" status: 200 len: 1308 microversion: 2.1 time: 0.406205 Oct 26 13:15:03.556020 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1477/2962] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:03 2022] GET /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9 => generated 1308 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:03.567628 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3d43281b-3c45-4165-be17-113efc9920d1 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:03.568371 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3d43281b-3c45-4165-be17-113efc9920d1 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:03.584205 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3d43281b-3c45-4165-be17-113efc9920d1 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:03.587488 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3d43281b-3c45-4165-be17-113efc9920d1 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:03.589197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3d43281b-3c45-4165-be17-113efc9920d1 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:03.592810 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3d43281b-3c45-4165-be17-113efc9920d1 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:03.594001 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3d43281b-3c45-4165-be17-113efc9920d1 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:03.595597 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3d43281b-3c45-4165-be17-113efc9920d1 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:03.913174 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3d43281b-3c45-4165-be17-113efc9920d1 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:03.932408 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3d43281b-3c45-4165-be17-113efc9920d1 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:03.935081 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3d43281b-3c45-4165-be17-113efc9920d1 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:03.941377 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-58bc787b-d117-4ab6-b244-4fd1c866f6cc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:15:03.941845 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3d43281b-3c45-4165-be17-113efc9920d1 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1755 microversion: 2.42 time: 0.382953 Oct 26 13:15:03.942422 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-58bc787b-d117-4ab6-b244-4fd1c866f6cc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:15:03.942939 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1478/2963] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:15:03 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1755 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:15:03.943094 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-58bc787b-d117-4ab6-b244-4fd1c866f6cc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:15:03.943507 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-58bc787b-d117-4ab6-b244-4fd1c866f6cc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:15:03.943926 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-58bc787b-d117-4ab6-b244-4fd1c866f6cc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:15:03.948472 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9ffc679e-c1d8-4a06-9626-c368773dc5e2 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:03.949331 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9ffc679e-c1d8-4a06-9626-c368773dc5e2 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: a1dbfc30-8cbf-4a85-8847-a24031f5e3dc] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:03.956412 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9ffc679e-c1d8-4a06-9626-c368773dc5e2 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:03.957245 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9ffc679e-c1d8-4a06-9626-c368773dc5e2 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:03.957943 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9ffc679e-c1d8-4a06-9626-c368773dc5e2 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:03.958870 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9ffc679e-c1d8-4a06-9626-c368773dc5e2 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:03.959693 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9ffc679e-c1d8-4a06-9626-c368773dc5e2 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:03.960435 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9ffc679e-c1d8-4a06-9626-c368773dc5e2 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:03.964428 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-58bc787b-d117-4ab6-b244-4fd1c866f6cc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:03.964527 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-58bc787b-d117-4ab6-b244-4fd1c866f6cc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:03.964958 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-58bc787b-d117-4ab6-b244-4fd1c866f6cc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:03.973769 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-58bc787b-d117-4ab6-b244-4fd1c866f6cc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:03.975428 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-58bc787b-d117-4ab6-b244-4fd1c866f6cc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:03.975884 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-58bc787b-d117-4ab6-b244-4fd1c866f6cc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:04.025068 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-58bc787b-d117-4ab6-b244-4fd1c866f6cc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Getting quotas for project ece49f83e645408598655bece0873fd0. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:15:04.040015 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-58bc787b-d117-4ab6-b244-4fd1c866f6cc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Getting quotas for user 8d56acbbbc3545d19cbb80f4e349c763 and project ece49f83e645408598655bece0873fd0. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:15:04.062941 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-58bc787b-d117-4ab6-b244-4fd1c866f6cc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:15:04.066403 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-58bc787b-d117-4ab6-b244-4fd1c866f6cc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 424df7e6-aed0-42c5-9536-28db79dcc003] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:15:04.130591 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-58bc787b-d117-4ab6-b244-4fd1c866f6cc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.351543 Oct 26 13:15:04.131510 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1486/2964] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:15:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 3354 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:15:04.136535 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-976b78bf-f86f-4f27-8030-84218d0ee5be tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:04.138077 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-976b78bf-f86f-4f27-8030-84218d0ee5be tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 789a55e0-21ba-4b2e-b8d4-c95999955e2b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:04.145052 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-976b78bf-f86f-4f27-8030-84218d0ee5be tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:04.146126 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-976b78bf-f86f-4f27-8030-84218d0ee5be tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:04.146723 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-976b78bf-f86f-4f27-8030-84218d0ee5be tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:04.147618 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-976b78bf-f86f-4f27-8030-84218d0ee5be tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:04.148310 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-976b78bf-f86f-4f27-8030-84218d0ee5be tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:04.148892 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-976b78bf-f86f-4f27-8030-84218d0ee5be tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:04.291328 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9ffc679e-c1d8-4a06-9626-c368773dc5e2 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:04.302994 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9ffc679e-c1d8-4a06-9626-c368773dc5e2 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc" status: 200 len: 1515 microversion: 2.1 time: 0.358095 Oct 26 13:15:04.306246 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1479/2965] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:03 2022] GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc => generated 1515 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:04.329552 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9e59cd86-38c1-4bcc-bbd6-167a2d086279 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:04.330455 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9e59cd86-38c1-4bcc-bbd6-167a2d086279 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 424df7e6-aed0-42c5-9536-28db79dcc003] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:04.498085 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9e59cd86-38c1-4bcc-bbd6-167a2d086279 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:04.508992 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9e59cd86-38c1-4bcc-bbd6-167a2d086279 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/424df7e6-aed0-42c5-9536-28db79dcc003" status: 200 len: 1215 microversion: 2.1 time: 0.183032 Oct 26 13:15:04.531627 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1480/2966] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:04 2022] GET /compute/v2.1/servers/424df7e6-aed0-42c5-9536-28db79dcc003 => generated 1215 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:04.587216 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a7235170-3f92-4d8a-83cd-50d06a24254f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:04.587732 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a7235170-3f92-4d8a-83cd-50d06a24254f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: a15dcabd-f50e-41f3-a7df-6b26412222a9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:04.598585 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7235170-3f92-4d8a-83cd-50d06a24254f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:04.599092 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7235170-3f92-4d8a-83cd-50d06a24254f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:04.599538 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7235170-3f92-4d8a-83cd-50d06a24254f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:04.603543 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7235170-3f92-4d8a-83cd-50d06a24254f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:04.603543 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7235170-3f92-4d8a-83cd-50d06a24254f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:04.603988 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7235170-3f92-4d8a-83cd-50d06a24254f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:04.693763 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-976b78bf-f86f-4f27-8030-84218d0ee5be tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:04.707451 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-976b78bf-f86f-4f27-8030-84218d0ee5be tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b" status: 200 len: 1367 microversion: 2.1 time: 0.574634 Oct 26 13:15:04.714341 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1487/2967] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:04 2022] GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b => generated 1367 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:04.973160 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bb149a1a-42d5-4d20-a7b5-666e38c7c839 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:04.974578 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bb149a1a-42d5-4d20-a7b5-666e38c7c839 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:04.987119 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb149a1a-42d5-4d20-a7b5-666e38c7c839 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:04.989793 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb149a1a-42d5-4d20-a7b5-666e38c7c839 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:04.991015 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb149a1a-42d5-4d20-a7b5-666e38c7c839 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:04.991967 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb149a1a-42d5-4d20-a7b5-666e38c7c839 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:04.994701 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb149a1a-42d5-4d20-a7b5-666e38c7c839 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:04.995618 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb149a1a-42d5-4d20-a7b5-666e38c7c839 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:05.193334 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a7235170-3f92-4d8a-83cd-50d06a24254f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:05.206980 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a7235170-3f92-4d8a-83cd-50d06a24254f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9" status: 200 len: 1308 microversion: 2.1 time: 0.624201 Oct 26 13:15:05.210327 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1481/2968] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:04 2022] GET /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9 => generated 1308 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:05.333014 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ce57e2c5-549c-46ba-86ca-3283d61875dd tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:05.333884 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ce57e2c5-549c-46ba-86ca-3283d61875dd tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: a1dbfc30-8cbf-4a85-8847-a24031f5e3dc] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:05.347268 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce57e2c5-549c-46ba-86ca-3283d61875dd tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:05.348226 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce57e2c5-549c-46ba-86ca-3283d61875dd tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:05.349324 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce57e2c5-549c-46ba-86ca-3283d61875dd tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:05.372463 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce57e2c5-549c-46ba-86ca-3283d61875dd tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:05.373576 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce57e2c5-549c-46ba-86ca-3283d61875dd tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:05.381676 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce57e2c5-549c-46ba-86ca-3283d61875dd tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:05.475251 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bb149a1a-42d5-4d20-a7b5-666e38c7c839 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:05.493243 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bb149a1a-42d5-4d20-a7b5-666e38c7c839 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:05.495065 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bb149a1a-42d5-4d20-a7b5-666e38c7c839 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:05.497009 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bb149a1a-42d5-4d20-a7b5-666e38c7c839 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1755 microversion: 2.42 time: 0.527696 Oct 26 13:15:05.498186 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1488/2969] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:15:04 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1755 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:15:05.539686 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d16582c5-85a8-48a0-b955-c96487d2d17c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:05.541215 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d16582c5-85a8-48a0-b955-c96487d2d17c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 424df7e6-aed0-42c5-9536-28db79dcc003] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:05.551255 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d16582c5-85a8-48a0-b955-c96487d2d17c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:05.554459 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d16582c5-85a8-48a0-b955-c96487d2d17c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:05.562494 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d16582c5-85a8-48a0-b955-c96487d2d17c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:05.563597 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d16582c5-85a8-48a0-b955-c96487d2d17c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:05.564303 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d16582c5-85a8-48a0-b955-c96487d2d17c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:05.564969 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d16582c5-85a8-48a0-b955-c96487d2d17c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:05.761022 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d16582c5-85a8-48a0-b955-c96487d2d17c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:05.771987 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d16582c5-85a8-48a0-b955-c96487d2d17c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/424df7e6-aed0-42c5-9536-28db79dcc003" status: 200 len: 1211 microversion: 2.1 time: 0.236932 Oct 26 13:15:05.789536 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1489/2970] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:05 2022] GET /compute/v2.1/servers/424df7e6-aed0-42c5-9536-28db79dcc003 => generated 1211 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:15:05.876677 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ce57e2c5-549c-46ba-86ca-3283d61875dd tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:05.892660 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ce57e2c5-549c-46ba-86ca-3283d61875dd tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc" status: 200 len: 1515 microversion: 2.1 time: 0.564192 Oct 26 13:15:05.905784 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1482/2971] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:05 2022] GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc => generated 1515 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:05.905784 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8ad61501-410c-474f-b8ef-b66500fea1f1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:05.905784 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8ad61501-410c-474f-b8ef-b66500fea1f1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 789a55e0-21ba-4b2e-b8d4-c95999955e2b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:05.914318 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8ad61501-410c-474f-b8ef-b66500fea1f1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:05.914819 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8ad61501-410c-474f-b8ef-b66500fea1f1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:05.915601 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8ad61501-410c-474f-b8ef-b66500fea1f1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:05.916321 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8ad61501-410c-474f-b8ef-b66500fea1f1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:05.916849 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8ad61501-410c-474f-b8ef-b66500fea1f1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:05.917293 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8ad61501-410c-474f-b8ef-b66500fea1f1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:05.945950 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1f8abeef-1f7b-47c1-8872-7ecc31c044ee tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Action: 'create', calling method: .version_select at 0x7f67319364c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1349941559", "description": "tempest-description-817535190"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:15:06.129228 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8ad61501-410c-474f-b8ef-b66500fea1f1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:06.146459 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8ad61501-410c-474f-b8ef-b66500fea1f1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b" status: 200 len: 1367 microversion: 2.1 time: 0.249435 Oct 26 13:15:06.161576 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1483/2972] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:05 2022] GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b => generated 1367 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:06.240534 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7288638d-c947-4c9c-b8b3-14c9538e0d57 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:06.241236 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7288638d-c947-4c9c-b8b3-14c9538e0d57 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: a15dcabd-f50e-41f3-a7df-6b26412222a9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:06.254565 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7288638d-c947-4c9c-b8b3-14c9538e0d57 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:06.255068 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7288638d-c947-4c9c-b8b3-14c9538e0d57 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:06.258414 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7288638d-c947-4c9c-b8b3-14c9538e0d57 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:06.259181 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7288638d-c947-4c9c-b8b3-14c9538e0d57 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:06.259654 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7288638d-c947-4c9c-b8b3-14c9538e0d57 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:06.260090 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7288638d-c947-4c9c-b8b3-14c9538e0d57 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:06.742010 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7288638d-c947-4c9c-b8b3-14c9538e0d57 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:06.759598 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7288638d-c947-4c9c-b8b3-14c9538e0d57 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9" status: 200 len: 1308 microversion: 2.1 time: 0.524278 Oct 26 13:15:06.760234 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1484/2973] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:06 2022] GET /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9 => generated 1308 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:15:06.780341 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4dac0572-d0dd-4bdb-b1b4-2bf61b8c59f0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:06.795783 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4dac0572-d0dd-4bdb-b1b4-2bf61b8c59f0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:06.839295 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4dac0572-d0dd-4bdb-b1b4-2bf61b8c59f0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:06.839942 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4dac0572-d0dd-4bdb-b1b4-2bf61b8c59f0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:06.844046 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4dac0572-d0dd-4bdb-b1b4-2bf61b8c59f0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:06.848708 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4dac0572-d0dd-4bdb-b1b4-2bf61b8c59f0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:06.849242 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4dac0572-d0dd-4bdb-b1b4-2bf61b8c59f0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:06.853365 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4dac0572-d0dd-4bdb-b1b4-2bf61b8c59f0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:07.212266 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1f8abeef-1f7b-47c1-8872-7ecc31c044ee tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.430194 Oct 26 13:15:07.213796 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1490/2974] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 26 13:15:05 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:15:07.219589 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-41c70917-20aa-4bcd-82da-4e6bf56a8a5c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:07.220721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-41c70917-20aa-4bcd-82da-4e6bf56a8a5c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 424df7e6-aed0-42c5-9536-28db79dcc003] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:07.240608 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-41c70917-20aa-4bcd-82da-4e6bf56a8a5c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:07.241866 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-41c70917-20aa-4bcd-82da-4e6bf56a8a5c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:07.243275 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-41c70917-20aa-4bcd-82da-4e6bf56a8a5c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:07.244046 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-41c70917-20aa-4bcd-82da-4e6bf56a8a5c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:07.249340 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-41c70917-20aa-4bcd-82da-4e6bf56a8a5c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:07.250123 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-41c70917-20aa-4bcd-82da-4e6bf56a8a5c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:07.370751 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4dac0572-d0dd-4bdb-b1b4-2bf61b8c59f0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:07.383333 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4dac0572-d0dd-4bdb-b1b4-2bf61b8c59f0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:07.393964 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4dac0572-d0dd-4bdb-b1b4-2bf61b8c59f0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:07.404938 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4dac0572-d0dd-4bdb-b1b4-2bf61b8c59f0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1802 microversion: 2.42 time: 0.625504 Oct 26 13:15:07.423847 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1485/2975] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:15:06 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1802 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:15:07.450299 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-254dd15b-f96b-4cce-836f-d403ad86d2ee tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:07.455102 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-254dd15b-f96b-4cce-836f-d403ad86d2ee tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: a1dbfc30-8cbf-4a85-8847-a24031f5e3dc] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:07.482776 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-254dd15b-f96b-4cce-836f-d403ad86d2ee tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:07.483417 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-254dd15b-f96b-4cce-836f-d403ad86d2ee tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:07.483979 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-254dd15b-f96b-4cce-836f-d403ad86d2ee tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:07.484827 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-254dd15b-f96b-4cce-836f-d403ad86d2ee tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:07.486010 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-254dd15b-f96b-4cce-836f-d403ad86d2ee tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:07.487805 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-254dd15b-f96b-4cce-836f-d403ad86d2ee tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:07.703979 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-41c70917-20aa-4bcd-82da-4e6bf56a8a5c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:07.727813 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-41c70917-20aa-4bcd-82da-4e6bf56a8a5c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/424df7e6-aed0-42c5-9536-28db79dcc003" status: 200 len: 1273 microversion: 2.1 time: 0.508411 Oct 26 13:15:07.730666 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1491/2976] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:07 2022] GET /compute/v2.1/servers/424df7e6-aed0-42c5-9536-28db79dcc003 => generated 1273 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:07.746924 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-81c95e3c-c44d-4a88-b5ca-dafa41491d9a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:07.748721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-81c95e3c-c44d-4a88-b5ca-dafa41491d9a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 789a55e0-21ba-4b2e-b8d4-c95999955e2b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:07.766134 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81c95e3c-c44d-4a88-b5ca-dafa41491d9a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:07.766664 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81c95e3c-c44d-4a88-b5ca-dafa41491d9a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:07.768181 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81c95e3c-c44d-4a88-b5ca-dafa41491d9a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:07.771619 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81c95e3c-c44d-4a88-b5ca-dafa41491d9a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:07.772097 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81c95e3c-c44d-4a88-b5ca-dafa41491d9a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:07.772597 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81c95e3c-c44d-4a88-b5ca-dafa41491d9a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:07.822576 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-254dd15b-f96b-4cce-836f-d403ad86d2ee tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:07.830989 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-254dd15b-f96b-4cce-836f-d403ad86d2ee tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc" status: 200 len: 1515 microversion: 2.1 time: 0.399244 Oct 26 13:15:07.843738 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1486/2977] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:07 2022] GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc => generated 1515 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:07.848977 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e52fb2f1-02f3-4af7-9f11-07ff81a768b3 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Action: 'create', calling method: .version_select at 0x7f673278eb80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1342764752", "description": "tempest-description-1455440002"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:15:08.044151 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e52fb2f1-02f3-4af7-9f11-07ff81a768b3 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.198484 Oct 26 13:15:08.045227 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1487/2978] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 26 13:15:07 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:15:08.050809 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6868207a-7af9-4f50-9fec-df811240a198 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:08.052671 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6868207a-7af9-4f50-9fec-df811240a198 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: a15dcabd-f50e-41f3-a7df-6b26412222a9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:08.068804 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6868207a-7af9-4f50-9fec-df811240a198 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:08.069682 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6868207a-7af9-4f50-9fec-df811240a198 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:08.070342 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6868207a-7af9-4f50-9fec-df811240a198 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:08.071497 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6868207a-7af9-4f50-9fec-df811240a198 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:08.072244 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6868207a-7af9-4f50-9fec-df811240a198 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:08.073280 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6868207a-7af9-4f50-9fec-df811240a198 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:08.261032 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6868207a-7af9-4f50-9fec-df811240a198 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:08.271347 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6868207a-7af9-4f50-9fec-df811240a198 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9" status: 200 len: 1308 microversion: 2.1 time: 0.224441 Oct 26 13:15:08.273144 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1488/2979] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:08 2022] GET /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9 => generated 1308 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:08.284580 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ffef7c18-1461-4b2a-a296-f0405b8ae08b tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-29622723", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "d692bb3d-41c2-468e-ac58-e733dd16e498"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:15:08.359164 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-ffef7c18-1461-4b2a-a296-f0405b8ae08b tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] validate_networks() for [('d692bb3d-41c2-468e-ac58-e733dd16e498', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:15:08.838225 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-81c95e3c-c44d-4a88-b5ca-dafa41491d9a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:08.880077 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-81c95e3c-c44d-4a88-b5ca-dafa41491d9a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b" status: 200 len: 1367 microversion: 2.1 time: 1.147511 Oct 26 13:15:08.886910 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1492/2980] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:07 2022] GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b => generated 1367 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:08.895129 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-193eda1e-2a4e-44c6-94bf-9590f6f408bd tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:08.896302 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-193eda1e-2a4e-44c6-94bf-9590f6f408bd tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:08.920423 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-193eda1e-2a4e-44c6-94bf-9590f6f408bd tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:08.923443 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-193eda1e-2a4e-44c6-94bf-9590f6f408bd tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:08.924232 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-193eda1e-2a4e-44c6-94bf-9590f6f408bd tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:08.925149 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-193eda1e-2a4e-44c6-94bf-9590f6f408bd tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:08.925859 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-193eda1e-2a4e-44c6-94bf-9590f6f408bd tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:08.926497 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-193eda1e-2a4e-44c6-94bf-9590f6f408bd tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:09.192192 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-ffef7c18-1461-4b2a-a296-f0405b8ae08b tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:15:09.193977 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-ffef7c18-1461-4b2a-a296-f0405b8ae08b tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:15:09.194666 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-ffef7c18-1461-4b2a-a296-f0405b8ae08b tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:15:09.195528 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-ffef7c18-1461-4b2a-a296-f0405b8ae08b tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:15:09.196171 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-ffef7c18-1461-4b2a-a296-f0405b8ae08b tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:15:09.211416 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ffef7c18-1461-4b2a-a296-f0405b8ae08b tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:09.212515 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ffef7c18-1461-4b2a-a296-f0405b8ae08b tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:09.213791 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ffef7c18-1461-4b2a-a296-f0405b8ae08b tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:09.214917 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ffef7c18-1461-4b2a-a296-f0405b8ae08b tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:09.215883 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ffef7c18-1461-4b2a-a296-f0405b8ae08b tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:09.217046 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ffef7c18-1461-4b2a-a296-f0405b8ae08b tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:09.233007 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:15:09.250657 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-ffef7c18-1461-4b2a-a296-f0405b8ae08b tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Getting quotas for project 875ebd1c99c746f7b4f1a3c08156e6a0. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:15:09.258507 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-ffef7c18-1461-4b2a-a296-f0405b8ae08b tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Getting quotas for user a13285463ba34e89931d667bc327bb2a and project 875ebd1c99c746f7b4f1a3c08156e6a0. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:15:09.280376 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ffef7c18-1461-4b2a-a296-f0405b8ae08b tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:15:09.287851 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ffef7c18-1461-4b2a-a296-f0405b8ae08b tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 7ee2d61f-352e-4762-aeec-9c2571e7e054] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:15:09.349018 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-193eda1e-2a4e-44c6-94bf-9590f6f408bd tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:09.366941 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ffef7c18-1461-4b2a-a296-f0405b8ae08b tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.092440 Oct 26 13:15:09.388282 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-193eda1e-2a4e-44c6-94bf-9590f6f408bd tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:09.399539 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-193eda1e-2a4e-44c6-94bf-9590f6f408bd tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:09.400761 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1489/2981] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:15:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:15:09.407777 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-193eda1e-2a4e-44c6-94bf-9590f6f408bd tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1802 microversion: 2.42 time: 0.516989 Oct 26 13:15:09.408717 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1493/2982] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:15:08 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1802 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:15:09.430947 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-38b75d23-6546-4194-a9fc-10df3cde6042 req-79e5f4aa-ff2f-4112-a44c-8dba0ee0e077 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a15dcabd-f50e-41f3-a7df-6b26412222a9", "name": "network-vif-plugged", "status": "completed", "tag": "0fc9a692-64c3-4d89-8074-c30f1ec979b6"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:15:09.436807 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4be3cc8d-6b7b-4869-a933-dee3a8830c3a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:09.438505 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4be3cc8d-6b7b-4869-a933-dee3a8830c3a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 424df7e6-aed0-42c5-9536-28db79dcc003] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:09.454576 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4be3cc8d-6b7b-4869-a933-dee3a8830c3a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:09.456502 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4be3cc8d-6b7b-4869-a933-dee3a8830c3a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:09.457025 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4be3cc8d-6b7b-4869-a933-dee3a8830c3a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:09.461342 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4be3cc8d-6b7b-4869-a933-dee3a8830c3a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:09.462862 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-38b75d23-6546-4194-a9fc-10df3cde6042 req-79e5f4aa-ff2f-4112-a44c-8dba0ee0e077 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:09.463345 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-38b75d23-6546-4194-a9fc-10df3cde6042 req-79e5f4aa-ff2f-4112-a44c-8dba0ee0e077 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:09.463770 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-38b75d23-6546-4194-a9fc-10df3cde6042 req-79e5f4aa-ff2f-4112-a44c-8dba0ee0e077 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:09.464159 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4be3cc8d-6b7b-4869-a933-dee3a8830c3a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:09.464798 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4be3cc8d-6b7b-4869-a933-dee3a8830c3a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:09.505111 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-38b75d23-6546-4194-a9fc-10df3cde6042 req-79e5f4aa-ff2f-4112-a44c-8dba0ee0e077 service nova] Creating event network-vif-plugged:0fc9a692-64c3-4d89-8074-c30f1ec979b6 for instance a15dcabd-f50e-41f3-a7df-6b26412222a9 on n-h2-862686-1 Oct 26 13:15:09.514045 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-38b75d23-6546-4194-a9fc-10df3cde6042 req-79e5f4aa-ff2f-4112-a44c-8dba0ee0e077 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110196 Oct 26 13:15:09.514673 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1490/2983] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:15:09.529386 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6be5831f-b903-4e57-b7e1-698498ca4a9e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:09.536064 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6be5831f-b903-4e57-b7e1-698498ca4a9e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: a1dbfc30-8cbf-4a85-8847-a24031f5e3dc] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:09.550195 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6be5831f-b903-4e57-b7e1-698498ca4a9e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:09.550689 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6be5831f-b903-4e57-b7e1-698498ca4a9e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:09.551129 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6be5831f-b903-4e57-b7e1-698498ca4a9e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:09.551833 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6be5831f-b903-4e57-b7e1-698498ca4a9e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:09.552286 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6be5831f-b903-4e57-b7e1-698498ca4a9e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:09.552711 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6be5831f-b903-4e57-b7e1-698498ca4a9e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:09.903154 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4be3cc8d-6b7b-4869-a933-dee3a8830c3a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:09.927396 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4be3cc8d-6b7b-4869-a933-dee3a8830c3a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/424df7e6-aed0-42c5-9536-28db79dcc003" status: 200 len: 1273 microversion: 2.1 time: 0.517268 Oct 26 13:15:09.946659 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1494/2984] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:09 2022] GET /compute/v2.1/servers/424df7e6-aed0-42c5-9536-28db79dcc003 => generated 1273 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:09.970352 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ed36550d-a613-4256-b0a8-517e53c2dd51 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:09.978095 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ed36550d-a613-4256-b0a8-517e53c2dd51 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: a15dcabd-f50e-41f3-a7df-6b26412222a9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:09.991879 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ed36550d-a613-4256-b0a8-517e53c2dd51 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:09.993467 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ed36550d-a613-4256-b0a8-517e53c2dd51 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:09.994200 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ed36550d-a613-4256-b0a8-517e53c2dd51 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:09.995284 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ed36550d-a613-4256-b0a8-517e53c2dd51 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:09.998144 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ed36550d-a613-4256-b0a8-517e53c2dd51 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:09.998590 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ed36550d-a613-4256-b0a8-517e53c2dd51 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:10.129389 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6be5831f-b903-4e57-b7e1-698498ca4a9e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:10.140488 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6be5831f-b903-4e57-b7e1-698498ca4a9e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc" status: 200 len: 1515 microversion: 2.1 time: 0.617693 Oct 26 13:15:10.141192 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1491/2985] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:09 2022] GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc => generated 1515 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:10.164941 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3dfdf07e-627c-41e5-ad9c-df3280cdb9eb tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:10.171088 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3dfdf07e-627c-41e5-ad9c-df3280cdb9eb tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 7ee2d61f-352e-4762-aeec-9c2571e7e054] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:10.258502 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3dfdf07e-627c-41e5-ad9c-df3280cdb9eb tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13285463ba34e89931d667bc327bb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875ebd1c99c746f7b4f1a3c08156e6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:10.267383 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3dfdf07e-627c-41e5-ad9c-df3280cdb9eb tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee2d61f-352e-4762-aeec-9c2571e7e054" status: 200 len: 1214 microversion: 2.1 time: 0.113805 Oct 26 13:15:10.272354 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1492/2986] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:10 2022] GET /compute/v2.1/servers/7ee2d61f-352e-4762-aeec-9c2571e7e054 => generated 1214 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:10.283840 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-185df19f-5977-4919-a081-633b2a195aac tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:10.284468 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-185df19f-5977-4919-a081-633b2a195aac tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 789a55e0-21ba-4b2e-b8d4-c95999955e2b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:10.300113 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-185df19f-5977-4919-a081-633b2a195aac tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:10.300633 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-185df19f-5977-4919-a081-633b2a195aac tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:10.301078 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-185df19f-5977-4919-a081-633b2a195aac tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:10.301875 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-185df19f-5977-4919-a081-633b2a195aac tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:10.302341 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-185df19f-5977-4919-a081-633b2a195aac tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:10.309084 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-185df19f-5977-4919-a081-633b2a195aac tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:10.528520 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-185df19f-5977-4919-a081-633b2a195aac tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:10.552832 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-185df19f-5977-4919-a081-633b2a195aac tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b" status: 200 len: 1367 microversion: 2.1 time: 0.279284 Oct 26 13:15:10.569408 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1493/2987] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:10 2022] GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b => generated 1367 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:10.569408 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-61ba0382-0667-442e-9c1c-889c3410f725 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:10.569408 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-61ba0382-0667-442e-9c1c-889c3410f725 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:10.569408 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-61ba0382-0667-442e-9c1c-889c3410f725 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:10.569803 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-61ba0382-0667-442e-9c1c-889c3410f725 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:10.570238 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-61ba0382-0667-442e-9c1c-889c3410f725 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:10.571131 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-61ba0382-0667-442e-9c1c-889c3410f725 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:10.571749 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-61ba0382-0667-442e-9c1c-889c3410f725 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:10.572485 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-61ba0382-0667-442e-9c1c-889c3410f725 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:10.827799 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-61ba0382-0667-442e-9c1c-889c3410f725 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:10.839282 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-61ba0382-0667-442e-9c1c-889c3410f725 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:10.841883 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-61ba0382-0667-442e-9c1c-889c3410f725 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:10.844168 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-61ba0382-0667-442e-9c1c-889c3410f725 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1802 microversion: 2.42 time: 0.286433 Oct 26 13:15:10.845556 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1494/2988] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:15:10 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1802 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:15:10.962643 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-44b49780-de6c-474a-9648-95bd8db3219e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:10.963674 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-44b49780-de6c-474a-9648-95bd8db3219e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 424df7e6-aed0-42c5-9536-28db79dcc003] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:10.979957 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-44b49780-de6c-474a-9648-95bd8db3219e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:10.983802 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-44b49780-de6c-474a-9648-95bd8db3219e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:10.984268 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-44b49780-de6c-474a-9648-95bd8db3219e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:10.985027 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-44b49780-de6c-474a-9648-95bd8db3219e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:10.985510 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-44b49780-de6c-474a-9648-95bd8db3219e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:10.985952 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-44b49780-de6c-474a-9648-95bd8db3219e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:11.047123 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ed36550d-a613-4256-b0a8-517e53c2dd51 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:11.065031 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ed36550d-a613-4256-b0a8-517e53c2dd51 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9" status: 200 len: 1308 microversion: 2.1 time: 1.117035 Oct 26 13:15:11.066268 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1495/2989] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:09 2022] GET /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9 => generated 1308 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:11.113692 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-44b49780-de6c-474a-9648-95bd8db3219e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:11.124065 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-44b49780-de6c-474a-9648-95bd8db3219e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/424df7e6-aed0-42c5-9536-28db79dcc003" status: 200 len: 1273 microversion: 2.1 time: 0.166816 Oct 26 13:15:11.125508 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1495/2990] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:10 2022] GET /compute/v2.1/servers/424df7e6-aed0-42c5-9536-28db79dcc003 => generated 1273 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:11.169014 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-48a7ff0f-2c13-4546-a008-36dd610cc280 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:11.170250 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-48a7ff0f-2c13-4546-a008-36dd610cc280 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: a1dbfc30-8cbf-4a85-8847-a24031f5e3dc] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:11.180667 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48a7ff0f-2c13-4546-a008-36dd610cc280 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:11.183722 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48a7ff0f-2c13-4546-a008-36dd610cc280 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:11.184947 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48a7ff0f-2c13-4546-a008-36dd610cc280 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:11.187107 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48a7ff0f-2c13-4546-a008-36dd610cc280 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:11.189140 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48a7ff0f-2c13-4546-a008-36dd610cc280 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:11.189931 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48a7ff0f-2c13-4546-a008-36dd610cc280 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:11.300078 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7b01d2d9-eb6c-459e-8ac8-80401d380ee0 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:11.300630 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7b01d2d9-eb6c-459e-8ac8-80401d380ee0 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 7ee2d61f-352e-4762-aeec-9c2571e7e054] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:11.312938 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b01d2d9-eb6c-459e-8ac8-80401d380ee0 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:11.315274 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b01d2d9-eb6c-459e-8ac8-80401d380ee0 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:11.315746 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b01d2d9-eb6c-459e-8ac8-80401d380ee0 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:11.319724 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b01d2d9-eb6c-459e-8ac8-80401d380ee0 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:11.320485 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b01d2d9-eb6c-459e-8ac8-80401d380ee0 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:11.321175 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b01d2d9-eb6c-459e-8ac8-80401d380ee0 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:11.516155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7b01d2d9-eb6c-459e-8ac8-80401d380ee0 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13285463ba34e89931d667bc327bb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875ebd1c99c746f7b4f1a3c08156e6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:11.529245 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7b01d2d9-eb6c-459e-8ac8-80401d380ee0 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee2d61f-352e-4762-aeec-9c2571e7e054" status: 200 len: 1266 microversion: 2.1 time: 0.233675 Oct 26 13:15:11.531954 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1496/2991] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:11 2022] GET /compute/v2.1/servers/7ee2d61f-352e-4762-aeec-9c2571e7e054 => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:15:11.547742 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-71647284-0a41-4c6a-be6f-53f1e189db8f req-c7e76356-256e-4058-8fd0-456de7a505e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "789a55e0-21ba-4b2e-b8d4-c95999955e2b", "name": "network-vif-plugged", "status": "completed", "tag": "ef8bf176-1c77-4039-a167-e88ec9e88a43"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:15:11.564480 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-71647284-0a41-4c6a-be6f-53f1e189db8f req-c7e76356-256e-4058-8fd0-456de7a505e8 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:11.576742 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-71647284-0a41-4c6a-be6f-53f1e189db8f req-c7e76356-256e-4058-8fd0-456de7a505e8 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:11.576742 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-71647284-0a41-4c6a-be6f-53f1e189db8f req-c7e76356-256e-4058-8fd0-456de7a505e8 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:11.616918 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-71647284-0a41-4c6a-be6f-53f1e189db8f req-c7e76356-256e-4058-8fd0-456de7a505e8 service nova] Creating event network-vif-plugged:ef8bf176-1c77-4039-a167-e88ec9e88a43 for instance 789a55e0-21ba-4b2e-b8d4-c95999955e2b on n-h1-862686-1 Oct 26 13:15:11.624230 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-71647284-0a41-4c6a-be6f-53f1e189db8f req-c7e76356-256e-4058-8fd0-456de7a505e8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080926 Oct 26 13:15:11.638367 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1497/2992] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:15:11.651050 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5ba31b01-2c9a-4a1c-91c6-ab863e47ff6f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:11.652180 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5ba31b01-2c9a-4a1c-91c6-ab863e47ff6f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 789a55e0-21ba-4b2e-b8d4-c95999955e2b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:11.661532 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ba31b01-2c9a-4a1c-91c6-ab863e47ff6f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:11.662311 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ba31b01-2c9a-4a1c-91c6-ab863e47ff6f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:11.663002 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ba31b01-2c9a-4a1c-91c6-ab863e47ff6f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:11.663971 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ba31b01-2c9a-4a1c-91c6-ab863e47ff6f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:11.664589 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ba31b01-2c9a-4a1c-91c6-ab863e47ff6f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:11.665205 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ba31b01-2c9a-4a1c-91c6-ab863e47ff6f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:12.100162 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5ba31b01-2c9a-4a1c-91c6-ab863e47ff6f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:12.116399 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5ba31b01-2c9a-4a1c-91c6-ab863e47ff6f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b" status: 200 len: 1367 microversion: 2.1 time: 0.472373 Oct 26 13:15:12.116865 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1498/2993] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:11 2022] GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b => generated 1367 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:12.130730 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cadb85fd-8302-4542-9600-c7d5072359a7 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:12.133942 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cadb85fd-8302-4542-9600-c7d5072359a7 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:12.140281 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cadb85fd-8302-4542-9600-c7d5072359a7 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:12.140790 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cadb85fd-8302-4542-9600-c7d5072359a7 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:12.141262 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cadb85fd-8302-4542-9600-c7d5072359a7 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:12.142035 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cadb85fd-8302-4542-9600-c7d5072359a7 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:12.142848 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cadb85fd-8302-4542-9600-c7d5072359a7 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:12.143532 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cadb85fd-8302-4542-9600-c7d5072359a7 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:12.249237 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-48a7ff0f-2c13-4546-a008-36dd610cc280 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:12.270643 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-48a7ff0f-2c13-4546-a008-36dd610cc280 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc" status: 200 len: 1515 microversion: 2.1 time: 1.106024 Oct 26 13:15:12.273617 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1496/2994] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:11 2022] GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc => generated 1515 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:12.286394 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ceab2640-ef73-4eac-b23d-64ae9e5ae36f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:12.289765 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ceab2640-ef73-4eac-b23d-64ae9e5ae36f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: a15dcabd-f50e-41f3-a7df-6b26412222a9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:12.305284 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ceab2640-ef73-4eac-b23d-64ae9e5ae36f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:12.307473 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ceab2640-ef73-4eac-b23d-64ae9e5ae36f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:12.308142 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ceab2640-ef73-4eac-b23d-64ae9e5ae36f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:12.310617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ceab2640-ef73-4eac-b23d-64ae9e5ae36f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:12.311106 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ceab2640-ef73-4eac-b23d-64ae9e5ae36f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:12.312766 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ceab2640-ef73-4eac-b23d-64ae9e5ae36f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:12.351057 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cadb85fd-8302-4542-9600-c7d5072359a7 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:12.362041 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cadb85fd-8302-4542-9600-c7d5072359a7 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:12.365087 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cadb85fd-8302-4542-9600-c7d5072359a7 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:12.367118 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cadb85fd-8302-4542-9600-c7d5072359a7 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1849 microversion: 2.42 time: 0.246732 Oct 26 13:15:12.367879 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1499/2995] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:15:12 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1849 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:15:12.374657 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3302d056-722f-4c9e-8585-bf2e4c845dc0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:12.375534 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3302d056-722f-4c9e-8585-bf2e4c845dc0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 424df7e6-aed0-42c5-9536-28db79dcc003] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:12.382887 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3302d056-722f-4c9e-8585-bf2e4c845dc0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:12.383703 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3302d056-722f-4c9e-8585-bf2e4c845dc0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:12.384404 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3302d056-722f-4c9e-8585-bf2e4c845dc0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:12.385347 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3302d056-722f-4c9e-8585-bf2e4c845dc0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:12.386063 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3302d056-722f-4c9e-8585-bf2e4c845dc0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:12.386727 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3302d056-722f-4c9e-8585-bf2e4c845dc0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:12.786704 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3302d056-722f-4c9e-8585-bf2e4c845dc0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:12.798813 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3302d056-722f-4c9e-8585-bf2e4c845dc0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/424df7e6-aed0-42c5-9536-28db79dcc003" status: 200 len: 1315 microversion: 2.1 time: 0.429563 Oct 26 13:15:12.799526 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1500/2996] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:12 2022] GET /compute/v2.1/servers/424df7e6-aed0-42c5-9536-28db79dcc003 => generated 1315 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:12.807030 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cb52e870-6166-4772-8972-64cf4d72b79b tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:12.810660 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cb52e870-6166-4772-8972-64cf4d72b79b tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 7ee2d61f-352e-4762-aeec-9c2571e7e054] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:12.828049 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb52e870-6166-4772-8972-64cf4d72b79b tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:12.829176 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb52e870-6166-4772-8972-64cf4d72b79b tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:12.829833 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb52e870-6166-4772-8972-64cf4d72b79b tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:12.830729 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb52e870-6166-4772-8972-64cf4d72b79b tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:12.831380 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb52e870-6166-4772-8972-64cf4d72b79b tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:12.832909 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb52e870-6166-4772-8972-64cf4d72b79b tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:12.841517 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ceab2640-ef73-4eac-b23d-64ae9e5ae36f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:12.857347 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ceab2640-ef73-4eac-b23d-64ae9e5ae36f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9" status: 200 len: 1488 microversion: 2.1 time: 0.580444 Oct 26 13:15:12.858456 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1497/2997] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:12 2022] GET /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9 => generated 1488 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:13.083282 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8b536b96-ee31-46d4-a8f1-cff38ed31c96 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-289149436", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "bc8855c0-63b2-4c3e-b1b8-950c3dd488ef"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:15:13.145883 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cb52e870-6166-4772-8972-64cf4d72b79b tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13285463ba34e89931d667bc327bb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875ebd1c99c746f7b4f1a3c08156e6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:13.161959 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cb52e870-6166-4772-8972-64cf4d72b79b tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee2d61f-352e-4762-aeec-9c2571e7e054" status: 200 len: 1272 microversion: 2.1 time: 0.356529 Oct 26 13:15:13.163800 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-8b536b96-ee31-46d4-a8f1-cff38ed31c96 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] validate_networks() for [('bc8855c0-63b2-4c3e-b1b8-950c3dd488ef', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:15:13.165277 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1501/2998] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:12 2022] GET /compute/v2.1/servers/7ee2d61f-352e-4762-aeec-9c2571e7e054 => generated 1272 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:13.172398 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c6c9bdad-a527-48ab-a056-93813152e344 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:13.173341 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c6c9bdad-a527-48ab-a056-93813152e344 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 789a55e0-21ba-4b2e-b8d4-c95999955e2b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:13.181939 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c6c9bdad-a527-48ab-a056-93813152e344 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:13.183056 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c6c9bdad-a527-48ab-a056-93813152e344 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:13.183808 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c6c9bdad-a527-48ab-a056-93813152e344 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:13.185380 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c6c9bdad-a527-48ab-a056-93813152e344 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:13.186194 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c6c9bdad-a527-48ab-a056-93813152e344 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:13.186920 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c6c9bdad-a527-48ab-a056-93813152e344 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:13.490172 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c6c9bdad-a527-48ab-a056-93813152e344 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:13.525333 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c6c9bdad-a527-48ab-a056-93813152e344 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b" status: 200 len: 1367 microversion: 2.1 time: 0.350108 Oct 26 13:15:13.526036 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1502/2999] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:13 2022] GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b => generated 1367 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:13.546811 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3f5ce254-bd11-43ff-8091-533280d4525a tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:13.547066 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3f5ce254-bd11-43ff-8091-533280d4525a tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: a1dbfc30-8cbf-4a85-8847-a24031f5e3dc] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:13.558382 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3f5ce254-bd11-43ff-8091-533280d4525a tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:13.559453 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3f5ce254-bd11-43ff-8091-533280d4525a tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:13.559926 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3f5ce254-bd11-43ff-8091-533280d4525a tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:13.560669 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3f5ce254-bd11-43ff-8091-533280d4525a tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:13.561157 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3f5ce254-bd11-43ff-8091-533280d4525a tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:13.561623 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3f5ce254-bd11-43ff-8091-533280d4525a tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:13.848250 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3f5ce254-bd11-43ff-8091-533280d4525a tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:13.856884 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3f5ce254-bd11-43ff-8091-533280d4525a tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc" status: 200 len: 1515 microversion: 2.1 time: 0.314613 Oct 26 13:15:13.878609 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1503/3000] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:13 2022] GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc => generated 1515 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:13.887839 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d8f4bd7c-fbec-4663-8646-38fbc1cd1a00 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:13.890024 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d8f4bd7c-fbec-4663-8646-38fbc1cd1a00 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:13.905193 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8f4bd7c-fbec-4663-8646-38fbc1cd1a00 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:13.909378 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8f4bd7c-fbec-4663-8646-38fbc1cd1a00 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:13.910072 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8f4bd7c-fbec-4663-8646-38fbc1cd1a00 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:13.910975 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8f4bd7c-fbec-4663-8646-38fbc1cd1a00 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:13.911599 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8f4bd7c-fbec-4663-8646-38fbc1cd1a00 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:13.912203 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8f4bd7c-fbec-4663-8646-38fbc1cd1a00 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:13.999662 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=4 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:15:14.055122 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:15:14.228282 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d8f4bd7c-fbec-4663-8646-38fbc1cd1a00 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:14.238326 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d8f4bd7c-fbec-4663-8646-38fbc1cd1a00 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:14.239784 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d8f4bd7c-fbec-4663-8646-38fbc1cd1a00 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:14.247845 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d8f4bd7c-fbec-4663-8646-38fbc1cd1a00 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1849 microversion: 2.42 time: 0.367821 Oct 26 13:15:14.250784 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1504/3001] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:15:13 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1849 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:15:14.258360 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-38aa856c-5217-402d-8b82-0df07e5884dc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:14.262307 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-38aa856c-5217-402d-8b82-0df07e5884dc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 424df7e6-aed0-42c5-9536-28db79dcc003] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:14.272630 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38aa856c-5217-402d-8b82-0df07e5884dc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:14.273442 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38aa856c-5217-402d-8b82-0df07e5884dc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:14.274149 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38aa856c-5217-402d-8b82-0df07e5884dc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:14.275124 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38aa856c-5217-402d-8b82-0df07e5884dc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:14.275797 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38aa856c-5217-402d-8b82-0df07e5884dc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:14.276662 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38aa856c-5217-402d-8b82-0df07e5884dc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:14.492446 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-38aa856c-5217-402d-8b82-0df07e5884dc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:14.501792 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-8b536b96-ee31-46d4-a8f1-cff38ed31c96 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:15:14.502234 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-8b536b96-ee31-46d4-a8f1-cff38ed31c96 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:15:14.502837 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-8b536b96-ee31-46d4-a8f1-cff38ed31c96 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:15:14.503256 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-8b536b96-ee31-46d4-a8f1-cff38ed31c96 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:15:14.504488 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-8b536b96-ee31-46d4-a8f1-cff38ed31c96 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:15:14.505092 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-38aa856c-5217-402d-8b82-0df07e5884dc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/424df7e6-aed0-42c5-9536-28db79dcc003" status: 200 len: 1315 microversion: 2.1 time: 0.249707 Oct 26 13:15:14.506629 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1505/3002] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:14 2022] GET /compute/v2.1/servers/424df7e6-aed0-42c5-9536-28db79dcc003 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:14.514131 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-33260c70-fb08-4eb7-a116-428354131721 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:14.514131 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-33260c70-fb08-4eb7-a116-428354131721 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 7ee2d61f-352e-4762-aeec-9c2571e7e054] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:14.522817 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-33260c70-fb08-4eb7-a116-428354131721 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:14.523639 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-33260c70-fb08-4eb7-a116-428354131721 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:14.524046 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-33260c70-fb08-4eb7-a116-428354131721 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:14.525338 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-33260c70-fb08-4eb7-a116-428354131721 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:14.526144 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-33260c70-fb08-4eb7-a116-428354131721 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:14.528151 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-33260c70-fb08-4eb7-a116-428354131721 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:14.554877 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b536b96-ee31-46d4-a8f1-cff38ed31c96 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:14.556258 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b536b96-ee31-46d4-a8f1-cff38ed31c96 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:14.556807 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b536b96-ee31-46d4-a8f1-cff38ed31c96 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:14.558188 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b536b96-ee31-46d4-a8f1-cff38ed31c96 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:14.559861 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b536b96-ee31-46d4-a8f1-cff38ed31c96 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:14.560315 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b536b96-ee31-46d4-a8f1-cff38ed31c96 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:14.613994 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-8b536b96-ee31-46d4-a8f1-cff38ed31c96 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Getting quotas for project 3f690a680b284d82ac586346427423c3. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:15:14.620703 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-8b536b96-ee31-46d4-a8f1-cff38ed31c96 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Getting quotas for user fbe30a73a18d49afa07f7a66aee7805d and project 3f690a680b284d82ac586346427423c3. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:15:14.649686 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8b536b96-ee31-46d4-a8f1-cff38ed31c96 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:15:14.653605 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8b536b96-ee31-46d4-a8f1-cff38ed31c96 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 6668f03f-2108-4ade-88e9-d51f6e696338] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:15:14.734618 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:INSERT=5 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:15:14.768893 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-33260c70-fb08-4eb7-a116-428354131721 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13285463ba34e89931d667bc327bb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875ebd1c99c746f7b4f1a3c08156e6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:14.778302 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8b536b96-ee31-46d4-a8f1-cff38ed31c96 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.696769 Oct 26 13:15:14.778578 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-33260c70-fb08-4eb7-a116-428354131721 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee2d61f-352e-4762-aeec-9c2571e7e054" status: 200 len: 1314 microversion: 2.1 time: 0.269963 Oct 26 13:15:14.786059 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1506/3003] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:14 2022] GET /compute/v2.1/servers/7ee2d61f-352e-4762-aeec-9c2571e7e054 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:14.787156 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1498/3004] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:15:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 26 13:15:14.792541 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-f950c511-3888-4b9c-96f4-0aab46f58763 req-a6bac35c-1b91-400f-9898-6b9d4704080f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5fa9733-f49b-43ab-8586-68d113b73476", "tag": "dae3728e-b93b-4eed-a07b-aea0efaacfac"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:15:14.796057 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-69a41238-ff09-4cf4-b9be-f9c79b0638d6 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:14.796914 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-69a41238-ff09-4cf4-b9be-f9c79b0638d6 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 789a55e0-21ba-4b2e-b8d4-c95999955e2b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:14.815751 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-f950c511-3888-4b9c-96f4-0aab46f58763 req-a6bac35c-1b91-400f-9898-6b9d4704080f service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:14.816254 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-f950c511-3888-4b9c-96f4-0aab46f58763 req-a6bac35c-1b91-400f-9898-6b9d4704080f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:14.816694 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-f950c511-3888-4b9c-96f4-0aab46f58763 req-a6bac35c-1b91-400f-9898-6b9d4704080f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:14.829009 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-69a41238-ff09-4cf4-b9be-f9c79b0638d6 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:14.831231 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-69a41238-ff09-4cf4-b9be-f9c79b0638d6 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:14.833448 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-69a41238-ff09-4cf4-b9be-f9c79b0638d6 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:14.835257 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-69a41238-ff09-4cf4-b9be-f9c79b0638d6 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:14.837313 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-69a41238-ff09-4cf4-b9be-f9c79b0638d6 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:14.838251 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-69a41238-ff09-4cf4-b9be-f9c79b0638d6 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:14.847787 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-f950c511-3888-4b9c-96f4-0aab46f58763 req-a6bac35c-1b91-400f-9898-6b9d4704080f service nova] Creating event network-changed:dae3728e-b93b-4eed-a07b-aea0efaacfac for instance b5fa9733-f49b-43ab-8586-68d113b73476 on n-h1-862686-1 Oct 26 13:15:14.880277 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-f950c511-3888-4b9c-96f4-0aab46f58763 req-a6bac35c-1b91-400f-9898-6b9d4704080f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067546 Oct 26 13:15:14.882301 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1507/3005] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:15:14.892387 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2007eb2d-cdbf-440b-b62e-be84bd44d814 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:14.898381 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2007eb2d-cdbf-440b-b62e-be84bd44d814 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 6668f03f-2108-4ade-88e9-d51f6e696338] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:14.922495 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:15:15.000952 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2007eb2d-cdbf-440b-b62e-be84bd44d814 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:15.013011 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2007eb2d-cdbf-440b-b62e-be84bd44d814 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/6668f03f-2108-4ade-88e9-d51f6e696338" status: 200 len: 1208 microversion: 2.1 time: 0.126045 Oct 26 13:15:15.013667 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1508/3006] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:14 2022] GET /compute/v2.1/servers/6668f03f-2108-4ade-88e9-d51f6e696338 => generated 1208 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:15.018393 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f91f092c-c9cd-40e3-96d5-2aed4780ebff tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:15.022835 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f91f092c-c9cd-40e3-96d5-2aed4780ebff tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: a1dbfc30-8cbf-4a85-8847-a24031f5e3dc] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:15.037300 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f91f092c-c9cd-40e3-96d5-2aed4780ebff tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:15.039002 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f91f092c-c9cd-40e3-96d5-2aed4780ebff tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:15.043803 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f91f092c-c9cd-40e3-96d5-2aed4780ebff tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:15.045097 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f91f092c-c9cd-40e3-96d5-2aed4780ebff tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:15.045728 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f91f092c-c9cd-40e3-96d5-2aed4780ebff tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:15.046236 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f91f092c-c9cd-40e3-96d5-2aed4780ebff tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:15.303274 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f91f092c-c9cd-40e3-96d5-2aed4780ebff tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:15.311980 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f91f092c-c9cd-40e3-96d5-2aed4780ebff tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc" status: 200 len: 1515 microversion: 2.1 time: 0.297074 Oct 26 13:15:15.315685 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1509/3007] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:15 2022] GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc => generated 1515 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:15.330416 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d957843c-241a-4024-bcba-eab6d7d192d6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:15.336947 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d957843c-241a-4024-bcba-eab6d7d192d6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:15.349493 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d957843c-241a-4024-bcba-eab6d7d192d6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:15.350657 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d957843c-241a-4024-bcba-eab6d7d192d6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:15.351677 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d957843c-241a-4024-bcba-eab6d7d192d6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:15.353769 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d957843c-241a-4024-bcba-eab6d7d192d6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:15.354799 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d957843c-241a-4024-bcba-eab6d7d192d6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:15.355597 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d957843c-241a-4024-bcba-eab6d7d192d6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:15.385176 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:15:15.758430 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d957843c-241a-4024-bcba-eab6d7d192d6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:15.777556 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d957843c-241a-4024-bcba-eab6d7d192d6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:15.779149 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d957843c-241a-4024-bcba-eab6d7d192d6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:15.780551 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d957843c-241a-4024-bcba-eab6d7d192d6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1849 microversion: 2.42 time: 0.463078 Oct 26 13:15:15.783864 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1510/3008] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:15:15 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1849 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:15:15.802314 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-28e8b0c6-e7a3-4661-9076-abcb58094014 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:15.802617 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-28e8b0c6-e7a3-4661-9076-abcb58094014 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 424df7e6-aed0-42c5-9536-28db79dcc003] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:15.820561 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-28e8b0c6-e7a3-4661-9076-abcb58094014 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:15.821074 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-28e8b0c6-e7a3-4661-9076-abcb58094014 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:15.821546 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-28e8b0c6-e7a3-4661-9076-abcb58094014 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:15.822275 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-28e8b0c6-e7a3-4661-9076-abcb58094014 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:15.822740 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-28e8b0c6-e7a3-4661-9076-abcb58094014 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:15.823164 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-28e8b0c6-e7a3-4661-9076-abcb58094014 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:16.208265 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-69a41238-ff09-4cf4-b9be-f9c79b0638d6 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:16.216946 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-69a41238-ff09-4cf4-b9be-f9c79b0638d6 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b" status: 200 len: 1558 microversion: 2.1 time: 1.427505 Oct 26 13:15:16.217533 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1499/3009] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:14 2022] GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b => generated 1558 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:16.250971 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-8100f426-1a97-438f-b4fe-d8a9242c3564 req-176f76b4-e22c-4d66-86f2-f93298d37f66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ee2d61f-352e-4762-aeec-9c2571e7e054", "tag": "42f887f0-054f-4215-9647-53bc789b0ab4"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:15:16.263098 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8100f426-1a97-438f-b4fe-d8a9242c3564 req-176f76b4-e22c-4d66-86f2-f93298d37f66 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:16.263773 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8100f426-1a97-438f-b4fe-d8a9242c3564 req-176f76b4-e22c-4d66-86f2-f93298d37f66 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:16.264362 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8100f426-1a97-438f-b4fe-d8a9242c3564 req-176f76b4-e22c-4d66-86f2-f93298d37f66 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:16.280264 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-8100f426-1a97-438f-b4fe-d8a9242c3564 req-176f76b4-e22c-4d66-86f2-f93298d37f66 service nova] Creating event network-changed:42f887f0-054f-4215-9647-53bc789b0ab4 for instance 7ee2d61f-352e-4762-aeec-9c2571e7e054 on n-h1-862686-1 Oct 26 13:15:16.285736 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-8100f426-1a97-438f-b4fe-d8a9242c3564 req-176f76b4-e22c-4d66-86f2-f93298d37f66 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040827 Oct 26 13:15:16.286988 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1500/3010] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:15:16.292439 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-053e665d-2ecd-46d9-b59c-b4d6cace602f tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:16.293786 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-053e665d-2ecd-46d9-b59c-b4d6cace602f tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 7ee2d61f-352e-4762-aeec-9c2571e7e054] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:16.302844 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-053e665d-2ecd-46d9-b59c-b4d6cace602f tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:16.303785 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-053e665d-2ecd-46d9-b59c-b4d6cace602f tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:16.304403 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-053e665d-2ecd-46d9-b59c-b4d6cace602f tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:16.305653 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-053e665d-2ecd-46d9-b59c-b4d6cace602f tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:16.306308 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-053e665d-2ecd-46d9-b59c-b4d6cace602f tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:16.307019 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-053e665d-2ecd-46d9-b59c-b4d6cace602f tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:16.693132 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-28e8b0c6-e7a3-4661-9076-abcb58094014 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:16.704177 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-28e8b0c6-e7a3-4661-9076-abcb58094014 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/424df7e6-aed0-42c5-9536-28db79dcc003" status: 200 len: 1315 microversion: 2.1 time: 0.918702 Oct 26 13:15:16.728064 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1511/3011] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:15 2022] GET /compute/v2.1/servers/424df7e6-aed0-42c5-9536-28db79dcc003 => generated 1315 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:16.733115 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-eab26167-7565-4cb7-8c48-3bbf7ea9fd7a tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:16.733772 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-eab26167-7565-4cb7-8c48-3bbf7ea9fd7a tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 6668f03f-2108-4ade-88e9-d51f6e696338] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:16.740697 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eab26167-7565-4cb7-8c48-3bbf7ea9fd7a tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:16.741611 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eab26167-7565-4cb7-8c48-3bbf7ea9fd7a tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:16.742226 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eab26167-7565-4cb7-8c48-3bbf7ea9fd7a tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:16.743686 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eab26167-7565-4cb7-8c48-3bbf7ea9fd7a tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:16.744305 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eab26167-7565-4cb7-8c48-3bbf7ea9fd7a tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:16.744888 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eab26167-7565-4cb7-8c48-3bbf7ea9fd7a tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:17.001617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-053e665d-2ecd-46d9-b59c-b4d6cace602f tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13285463ba34e89931d667bc327bb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875ebd1c99c746f7b4f1a3c08156e6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:17.019089 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-053e665d-2ecd-46d9-b59c-b4d6cace602f tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee2d61f-352e-4762-aeec-9c2571e7e054" status: 200 len: 1314 microversion: 2.1 time: 0.730377 Oct 26 13:15:17.019727 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1501/3012] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:16 2022] GET /compute/v2.1/servers/7ee2d61f-352e-4762-aeec-9c2571e7e054 => generated 1314 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:17.028432 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cd6057c5-41b8-4806-8c85-8afb0980a81e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:17.029265 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cd6057c5-41b8-4806-8c85-8afb0980a81e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 789a55e0-21ba-4b2e-b8d4-c95999955e2b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:17.040645 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-eab26167-7565-4cb7-8c48-3bbf7ea9fd7a tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:17.044551 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cd6057c5-41b8-4806-8c85-8afb0980a81e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:17.048944 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cd6057c5-41b8-4806-8c85-8afb0980a81e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:17.050442 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-eab26167-7565-4cb7-8c48-3bbf7ea9fd7a tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/6668f03f-2108-4ade-88e9-d51f6e696338" status: 200 len: 1260 microversion: 2.1 time: 0.321154 Oct 26 13:15:17.050634 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cd6057c5-41b8-4806-8c85-8afb0980a81e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:17.051552 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cd6057c5-41b8-4806-8c85-8afb0980a81e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:17.052470 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cd6057c5-41b8-4806-8c85-8afb0980a81e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:17.053625 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cd6057c5-41b8-4806-8c85-8afb0980a81e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:17.073668 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1512/3013] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:16 2022] GET /compute/v2.1/servers/6668f03f-2108-4ade-88e9-d51f6e696338 => generated 1260 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:17.091015 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a439b26a-eda2-417d-b222-1f9c623fe282 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:17.092819 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a439b26a-eda2-417d-b222-1f9c623fe282 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: a1dbfc30-8cbf-4a85-8847-a24031f5e3dc] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:17.110654 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a439b26a-eda2-417d-b222-1f9c623fe282 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:17.111885 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a439b26a-eda2-417d-b222-1f9c623fe282 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:17.113294 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a439b26a-eda2-417d-b222-1f9c623fe282 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:17.114456 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a439b26a-eda2-417d-b222-1f9c623fe282 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:17.115274 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a439b26a-eda2-417d-b222-1f9c623fe282 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:17.116610 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a439b26a-eda2-417d-b222-1f9c623fe282 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:17.382153 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cd6057c5-41b8-4806-8c85-8afb0980a81e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.360688 Oct 26 13:15:17.383580 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1502/3014] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 26 13:15:17 2022] GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b/os-interface => generated 285 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:15:17.393120 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-365831f2-fdd7-481c-a34e-bf14c70c281b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:17.398084 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-365831f2-fdd7-481c-a34e-bf14c70c281b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:17.423852 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-365831f2-fdd7-481c-a34e-bf14c70c281b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:17.425157 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-365831f2-fdd7-481c-a34e-bf14c70c281b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:17.428328 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-365831f2-fdd7-481c-a34e-bf14c70c281b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:17.432260 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-365831f2-fdd7-481c-a34e-bf14c70c281b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:17.433044 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-365831f2-fdd7-481c-a34e-bf14c70c281b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:17.436021 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-365831f2-fdd7-481c-a34e-bf14c70c281b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:17.449022 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a439b26a-eda2-417d-b222-1f9c623fe282 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:17.462584 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a439b26a-eda2-417d-b222-1f9c623fe282 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc" status: 200 len: 1515 microversion: 2.1 time: 0.385329 Oct 26 13:15:17.466126 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1513/3015] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:17 2022] GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc => generated 1515 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:17.485966 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-994b1119-eeb8-4b2e-9823-331049e7e86a req-e26a2abc-ffa2-4ad6-8300-d824ad66745b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "424df7e6-aed0-42c5-9536-28db79dcc003", "tag": "bed86f43-2734-4595-b60c-4c47312165c5"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:15:17.508148 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-994b1119-eeb8-4b2e-9823-331049e7e86a req-e26a2abc-ffa2-4ad6-8300-d824ad66745b service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:17.510325 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-994b1119-eeb8-4b2e-9823-331049e7e86a req-e26a2abc-ffa2-4ad6-8300-d824ad66745b service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:17.512979 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-994b1119-eeb8-4b2e-9823-331049e7e86a req-e26a2abc-ffa2-4ad6-8300-d824ad66745b service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:17.534500 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-994b1119-eeb8-4b2e-9823-331049e7e86a req-e26a2abc-ffa2-4ad6-8300-d824ad66745b service nova] Creating event network-changed:bed86f43-2734-4595-b60c-4c47312165c5 for instance 424df7e6-aed0-42c5-9536-28db79dcc003 on n-h1-862686-1 Oct 26 13:15:17.540247 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-994b1119-eeb8-4b2e-9823-331049e7e86a req-e26a2abc-ffa2-4ad6-8300-d824ad66745b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072154 Oct 26 13:15:17.541162 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1514/3016] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:15:17.735278 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2cf7dfb3-b3e1-4f5c-bf97-4f5cc6a216c8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:17.736347 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2cf7dfb3-b3e1-4f5c-bf97-4f5cc6a216c8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 424df7e6-aed0-42c5-9536-28db79dcc003] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:17.743845 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2cf7dfb3-b3e1-4f5c-bf97-4f5cc6a216c8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:17.744936 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2cf7dfb3-b3e1-4f5c-bf97-4f5cc6a216c8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:17.745883 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2cf7dfb3-b3e1-4f5c-bf97-4f5cc6a216c8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:17.747523 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2cf7dfb3-b3e1-4f5c-bf97-4f5cc6a216c8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:17.748330 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2cf7dfb3-b3e1-4f5c-bf97-4f5cc6a216c8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:17.748977 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2cf7dfb3-b3e1-4f5c-bf97-4f5cc6a216c8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:17.890160 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-365831f2-fdd7-481c-a34e-bf14c70c281b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:17.901856 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-365831f2-fdd7-481c-a34e-bf14c70c281b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:17.908105 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-365831f2-fdd7-481c-a34e-bf14c70c281b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:17.909885 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-365831f2-fdd7-481c-a34e-bf14c70c281b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1870 microversion: 2.42 time: 0.524821 Oct 26 13:15:17.910792 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1503/3017] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:15:17 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1870 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:15:18.052081 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f1e9ed4e-5dcc-409b-a96a-e6f36ab2b2e0 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:18.053282 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f1e9ed4e-5dcc-409b-a96a-e6f36ab2b2e0 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 7ee2d61f-352e-4762-aeec-9c2571e7e054] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:18.074037 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1e9ed4e-5dcc-409b-a96a-e6f36ab2b2e0 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:18.075893 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1e9ed4e-5dcc-409b-a96a-e6f36ab2b2e0 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:18.077808 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1e9ed4e-5dcc-409b-a96a-e6f36ab2b2e0 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:18.079274 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1e9ed4e-5dcc-409b-a96a-e6f36ab2b2e0 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:18.080748 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1e9ed4e-5dcc-409b-a96a-e6f36ab2b2e0 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:18.084154 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1e9ed4e-5dcc-409b-a96a-e6f36ab2b2e0 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:18.218774 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2cf7dfb3-b3e1-4f5c-bf97-4f5cc6a216c8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:18.236584 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2cf7dfb3-b3e1-4f5c-bf97-4f5cc6a216c8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/424df7e6-aed0-42c5-9536-28db79dcc003" status: 200 len: 1315 microversion: 2.1 time: 0.506897 Oct 26 13:15:18.238162 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1515/3018] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:17 2022] GET /compute/v2.1/servers/424df7e6-aed0-42c5-9536-28db79dcc003 => generated 1315 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:18.248246 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ca3e81f0-eade-4a5b-a0d3-f2c96ad5ed87 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:18.249392 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ca3e81f0-eade-4a5b-a0d3-f2c96ad5ed87 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 6668f03f-2108-4ade-88e9-d51f6e696338] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:18.264883 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ca3e81f0-eade-4a5b-a0d3-f2c96ad5ed87 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:18.267385 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ca3e81f0-eade-4a5b-a0d3-f2c96ad5ed87 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:18.268310 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ca3e81f0-eade-4a5b-a0d3-f2c96ad5ed87 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:18.280098 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ca3e81f0-eade-4a5b-a0d3-f2c96ad5ed87 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:18.281078 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ca3e81f0-eade-4a5b-a0d3-f2c96ad5ed87 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:18.282026 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ca3e81f0-eade-4a5b-a0d3-f2c96ad5ed87 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:18.778516 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f1e9ed4e-5dcc-409b-a96a-e6f36ab2b2e0 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13285463ba34e89931d667bc327bb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875ebd1c99c746f7b4f1a3c08156e6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:18.789306 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f1e9ed4e-5dcc-409b-a96a-e6f36ab2b2e0 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee2d61f-352e-4762-aeec-9c2571e7e054" status: 200 len: 1314 microversion: 2.1 time: 0.750556 Oct 26 13:15:18.790599 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1504/3019] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:18 2022] GET /compute/v2.1/servers/7ee2d61f-352e-4762-aeec-9c2571e7e054 => generated 1314 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:18.799934 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a042680f-5eff-4e52-b49f-3831d053499b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:18.800787 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a042680f-5eff-4e52-b49f-3831d053499b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: a1dbfc30-8cbf-4a85-8847-a24031f5e3dc] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:18.816063 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a042680f-5eff-4e52-b49f-3831d053499b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:18.816567 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a042680f-5eff-4e52-b49f-3831d053499b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:18.817272 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a042680f-5eff-4e52-b49f-3831d053499b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:18.819893 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a042680f-5eff-4e52-b49f-3831d053499b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:18.820513 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a042680f-5eff-4e52-b49f-3831d053499b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:18.821181 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a042680f-5eff-4e52-b49f-3831d053499b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:18.829855 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ca3e81f0-eade-4a5b-a0d3-f2c96ad5ed87 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:18.841952 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ca3e81f0-eade-4a5b-a0d3-f2c96ad5ed87 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/6668f03f-2108-4ade-88e9-d51f6e696338" status: 200 len: 1308 microversion: 2.1 time: 0.601152 Oct 26 13:15:18.849394 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1516/3020] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:18 2022] GET /compute/v2.1/servers/6668f03f-2108-4ade-88e9-d51f6e696338 => generated 1308 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:18.943405 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c62ad19a-cd5a-43d6-a5e4-5c20e6e01ea6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:18.944018 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c62ad19a-cd5a-43d6-a5e4-5c20e6e01ea6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:18.951299 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c62ad19a-cd5a-43d6-a5e4-5c20e6e01ea6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:18.952469 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c62ad19a-cd5a-43d6-a5e4-5c20e6e01ea6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:18.953093 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c62ad19a-cd5a-43d6-a5e4-5c20e6e01ea6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:18.954029 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c62ad19a-cd5a-43d6-a5e4-5c20e6e01ea6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:18.955287 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c62ad19a-cd5a-43d6-a5e4-5c20e6e01ea6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:18.955907 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c62ad19a-cd5a-43d6-a5e4-5c20e6e01ea6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:19.233983 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:15:19.259097 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a042680f-5eff-4e52-b49f-3831d053499b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:19.262384 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:15:19.286400 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a042680f-5eff-4e52-b49f-3831d053499b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc" status: 200 len: 1515 microversion: 2.1 time: 0.492337 Oct 26 13:15:19.288456 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1505/3021] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:18 2022] GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc => generated 1515 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:19.294740 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-71ad959a-c184-4ef7-b06d-b2dd419d77d4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:19.295693 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-71ad959a-c184-4ef7-b06d-b2dd419d77d4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 424df7e6-aed0-42c5-9536-28db79dcc003] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:19.305145 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-71ad959a-c184-4ef7-b06d-b2dd419d77d4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:19.306172 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-71ad959a-c184-4ef7-b06d-b2dd419d77d4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:19.306969 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-71ad959a-c184-4ef7-b06d-b2dd419d77d4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:19.307765 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-71ad959a-c184-4ef7-b06d-b2dd419d77d4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:19.308250 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-71ad959a-c184-4ef7-b06d-b2dd419d77d4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:19.309927 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-71ad959a-c184-4ef7-b06d-b2dd419d77d4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:19.595202 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c62ad19a-cd5a-43d6-a5e4-5c20e6e01ea6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:19.617909 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c62ad19a-cd5a-43d6-a5e4-5c20e6e01ea6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:19.624794 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c62ad19a-cd5a-43d6-a5e4-5c20e6e01ea6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:19.630427 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c62ad19a-cd5a-43d6-a5e4-5c20e6e01ea6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1870 microversion: 2.42 time: 0.691550 Oct 26 13:15:19.631382 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1517/3022] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:15:18 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1870 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:15:19.649909 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-c5d0a736-ec00-435f-b7e5-c7d1c8ff3121 req-bc7eb9f5-f4c8-4748-913c-46f4684d9d94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5fa9733-f49b-43ab-8586-68d113b73476", "tag": "bb5fa759-fb42-4724-9c5e-6a0f92fc97d1"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:15:19.682183 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-c5d0a736-ec00-435f-b7e5-c7d1c8ff3121 req-bc7eb9f5-f4c8-4748-913c-46f4684d9d94 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:19.684522 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-c5d0a736-ec00-435f-b7e5-c7d1c8ff3121 req-bc7eb9f5-f4c8-4748-913c-46f4684d9d94 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:19.686835 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-c5d0a736-ec00-435f-b7e5-c7d1c8ff3121 req-bc7eb9f5-f4c8-4748-913c-46f4684d9d94 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:19.728206 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-c5d0a736-ec00-435f-b7e5-c7d1c8ff3121 req-bc7eb9f5-f4c8-4748-913c-46f4684d9d94 service nova] Creating event network-changed:bb5fa759-fb42-4724-9c5e-6a0f92fc97d1 for instance b5fa9733-f49b-43ab-8586-68d113b73476 on n-h1-862686-1 Oct 26 13:15:19.742958 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-c5d0a736-ec00-435f-b7e5-c7d1c8ff3121 req-bc7eb9f5-f4c8-4748-913c-46f4684d9d94 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108075 Oct 26 13:15:19.743983 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1518/3023] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:15:19.816941 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6a6f4c02-09e1-4606-aa33-f584446dbe95 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:19.817844 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6a6f4c02-09e1-4606-aa33-f584446dbe95 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 7ee2d61f-352e-4762-aeec-9c2571e7e054] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:19.829170 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6a6f4c02-09e1-4606-aa33-f584446dbe95 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:19.829615 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6a6f4c02-09e1-4606-aa33-f584446dbe95 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:19.830064 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6a6f4c02-09e1-4606-aa33-f584446dbe95 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:19.830775 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6a6f4c02-09e1-4606-aa33-f584446dbe95 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:19.834754 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6a6f4c02-09e1-4606-aa33-f584446dbe95 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:19.835390 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6a6f4c02-09e1-4606-aa33-f584446dbe95 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:19.935529 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-71ad959a-c184-4ef7-b06d-b2dd419d77d4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:19.944355 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-71ad959a-c184-4ef7-b06d-b2dd419d77d4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/424df7e6-aed0-42c5-9536-28db79dcc003" status: 200 len: 1315 microversion: 2.1 time: 0.654443 Oct 26 13:15:19.950670 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1506/3024] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:19 2022] GET /compute/v2.1/servers/424df7e6-aed0-42c5-9536-28db79dcc003 => generated 1315 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:19.957007 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-909d0ddd-12b1-4687-8bcf-bfbb9f86a93e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:19.961110 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-909d0ddd-12b1-4687-8bcf-bfbb9f86a93e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 6668f03f-2108-4ade-88e9-d51f6e696338] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:19.970572 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-909d0ddd-12b1-4687-8bcf-bfbb9f86a93e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:19.972226 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-909d0ddd-12b1-4687-8bcf-bfbb9f86a93e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:19.973058 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-909d0ddd-12b1-4687-8bcf-bfbb9f86a93e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:19.974043 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-909d0ddd-12b1-4687-8bcf-bfbb9f86a93e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:19.974672 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-909d0ddd-12b1-4687-8bcf-bfbb9f86a93e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:19.975302 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-909d0ddd-12b1-4687-8bcf-bfbb9f86a93e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:20.753086 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-909d0ddd-12b1-4687-8bcf-bfbb9f86a93e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:20.762066 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6a6f4c02-09e1-4606-aa33-f584446dbe95 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13285463ba34e89931d667bc327bb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875ebd1c99c746f7b4f1a3c08156e6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:20.764117 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-909d0ddd-12b1-4687-8bcf-bfbb9f86a93e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/6668f03f-2108-4ade-88e9-d51f6e696338" status: 200 len: 1308 microversion: 2.1 time: 0.812276 Oct 26 13:15:20.764743 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1507/3025] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:19 2022] GET /compute/v2.1/servers/6668f03f-2108-4ade-88e9-d51f6e696338 => generated 1308 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:20.773573 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c2116973-5c83-4c1f-8991-9013dc94afcd tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:20.774201 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c2116973-5c83-4c1f-8991-9013dc94afcd tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: a1dbfc30-8cbf-4a85-8847-a24031f5e3dc] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:20.788513 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6a6f4c02-09e1-4606-aa33-f584446dbe95 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee2d61f-352e-4762-aeec-9c2571e7e054" status: 200 len: 1314 microversion: 2.1 time: 0.975595 Oct 26 13:15:20.791650 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2116973-5c83-4c1f-8991-9013dc94afcd tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:20.792489 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2116973-5c83-4c1f-8991-9013dc94afcd tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:20.793924 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2116973-5c83-4c1f-8991-9013dc94afcd tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:20.794938 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2116973-5c83-4c1f-8991-9013dc94afcd tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:20.795567 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2116973-5c83-4c1f-8991-9013dc94afcd tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:20.796148 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2116973-5c83-4c1f-8991-9013dc94afcd tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:20.806556 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1519/3026] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:19 2022] GET /compute/v2.1/servers/7ee2d61f-352e-4762-aeec-9c2571e7e054 => generated 1314 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:15:20.825007 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fac7836f-4f56-4ef4-b9aa-26d7017afa00 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:20.825656 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fac7836f-4f56-4ef4-b9aa-26d7017afa00 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:20.832512 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fac7836f-4f56-4ef4-b9aa-26d7017afa00 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:20.841450 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fac7836f-4f56-4ef4-b9aa-26d7017afa00 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:20.842058 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fac7836f-4f56-4ef4-b9aa-26d7017afa00 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:20.843901 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fac7836f-4f56-4ef4-b9aa-26d7017afa00 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:20.844401 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fac7836f-4f56-4ef4-b9aa-26d7017afa00 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:20.844838 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fac7836f-4f56-4ef4-b9aa-26d7017afa00 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:21.301384 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fac7836f-4f56-4ef4-b9aa-26d7017afa00 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:21.313856 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fac7836f-4f56-4ef4-b9aa-26d7017afa00 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:21.317340 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fac7836f-4f56-4ef4-b9aa-26d7017afa00 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:21.318862 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fac7836f-4f56-4ef4-b9aa-26d7017afa00 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1879 microversion: 2.42 time: 0.510634 Oct 26 13:15:21.328063 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1520/3027] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:15:20 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1879 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:15:21.333309 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-bb6805d7-0c94-474e-885d-d7dc9c1c3d61 req-5c269f14-6ad6-441d-987e-5ca1cf216f12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "789a55e0-21ba-4b2e-b8d4-c95999955e2b", "tag": "ef8bf176-1c77-4039-a167-e88ec9e88a43"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:15:21.344328 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-bb6805d7-0c94-474e-885d-d7dc9c1c3d61 req-5c269f14-6ad6-441d-987e-5ca1cf216f12 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:21.345853 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-bb6805d7-0c94-474e-885d-d7dc9c1c3d61 req-5c269f14-6ad6-441d-987e-5ca1cf216f12 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:21.346517 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-bb6805d7-0c94-474e-885d-d7dc9c1c3d61 req-5c269f14-6ad6-441d-987e-5ca1cf216f12 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:21.367820 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-bb6805d7-0c94-474e-885d-d7dc9c1c3d61 req-5c269f14-6ad6-441d-987e-5ca1cf216f12 service nova] Creating event network-changed:ef8bf176-1c77-4039-a167-e88ec9e88a43 for instance 789a55e0-21ba-4b2e-b8d4-c95999955e2b on n-h1-862686-1 Oct 26 13:15:21.374633 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-bb6805d7-0c94-474e-885d-d7dc9c1c3d61 req-5c269f14-6ad6-441d-987e-5ca1cf216f12 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044963 Oct 26 13:15:21.375740 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1521/3028] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:15:21.387731 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a5245924-f4b4-4bef-b74c-64599dcd87d4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:21.388960 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a5245924-f4b4-4bef-b74c-64599dcd87d4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 424df7e6-aed0-42c5-9536-28db79dcc003] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:21.398102 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5245924-f4b4-4bef-b74c-64599dcd87d4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:21.399191 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5245924-f4b4-4bef-b74c-64599dcd87d4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:21.399934 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5245924-f4b4-4bef-b74c-64599dcd87d4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:21.400937 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5245924-f4b4-4bef-b74c-64599dcd87d4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:21.401723 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5245924-f4b4-4bef-b74c-64599dcd87d4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:21.402429 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5245924-f4b4-4bef-b74c-64599dcd87d4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:21.507583 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c2116973-5c83-4c1f-8991-9013dc94afcd tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:21.516943 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c2116973-5c83-4c1f-8991-9013dc94afcd tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc" status: 200 len: 1515 microversion: 2.1 time: 0.751105 Oct 26 13:15:21.520930 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1508/3029] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:20 2022] GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc => generated 1515 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:21.788973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4c927379-afa0-472e-be2d-71c96c969a4f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:21.789849 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4c927379-afa0-472e-be2d-71c96c969a4f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 6668f03f-2108-4ade-88e9-d51f6e696338] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:21.801307 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c927379-afa0-472e-be2d-71c96c969a4f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:21.807524 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c927379-afa0-472e-be2d-71c96c969a4f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:21.808244 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c927379-afa0-472e-be2d-71c96c969a4f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:21.809454 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c927379-afa0-472e-be2d-71c96c969a4f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:21.809964 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c927379-afa0-472e-be2d-71c96c969a4f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:21.810454 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c927379-afa0-472e-be2d-71c96c969a4f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:21.936233 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a5245924-f4b4-4bef-b74c-64599dcd87d4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:21.971549 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a5245924-f4b4-4bef-b74c-64599dcd87d4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/424df7e6-aed0-42c5-9536-28db79dcc003" status: 200 len: 1315 microversion: 2.1 time: 0.590576 Oct 26 13:15:21.972157 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1522/3030] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:21 2022] GET /compute/v2.1/servers/424df7e6-aed0-42c5-9536-28db79dcc003 => generated 1315 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:21.999716 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1b1538af-9ae8-4c90-a565-ec548f21f0f6 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:22.001290 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1b1538af-9ae8-4c90-a565-ec548f21f0f6 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 7ee2d61f-352e-4762-aeec-9c2571e7e054] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:22.011277 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b1538af-9ae8-4c90-a565-ec548f21f0f6 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:22.012559 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b1538af-9ae8-4c90-a565-ec548f21f0f6 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:22.013519 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b1538af-9ae8-4c90-a565-ec548f21f0f6 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:22.014407 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b1538af-9ae8-4c90-a565-ec548f21f0f6 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:22.015032 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b1538af-9ae8-4c90-a565-ec548f21f0f6 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:22.015619 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b1538af-9ae8-4c90-a565-ec548f21f0f6 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:22.356510 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1b1538af-9ae8-4c90-a565-ec548f21f0f6 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13285463ba34e89931d667bc327bb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875ebd1c99c746f7b4f1a3c08156e6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:22.367689 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1b1538af-9ae8-4c90-a565-ec548f21f0f6 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee2d61f-352e-4762-aeec-9c2571e7e054" status: 200 len: 1314 microversion: 2.1 time: 0.373247 Oct 26 13:15:22.369655 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1523/3031] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:21 2022] GET /compute/v2.1/servers/7ee2d61f-352e-4762-aeec-9c2571e7e054 => generated 1314 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:22.378372 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-70dc9420-34a2-47f5-a6f7-09b00638a8dc req-ddf1ada8-86ce-46e4-aad8-dafe4e2cc99b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5fa9733-f49b-43ab-8586-68d113b73476", "tag": "fbf03382-47b3-45b7-be91-c664781050c5"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:15:22.394967 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-70dc9420-34a2-47f5-a6f7-09b00638a8dc req-ddf1ada8-86ce-46e4-aad8-dafe4e2cc99b service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:22.398427 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-70dc9420-34a2-47f5-a6f7-09b00638a8dc req-ddf1ada8-86ce-46e4-aad8-dafe4e2cc99b service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:22.399118 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-70dc9420-34a2-47f5-a6f7-09b00638a8dc req-ddf1ada8-86ce-46e4-aad8-dafe4e2cc99b service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:22.419407 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4c927379-afa0-472e-be2d-71c96c969a4f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:22.439623 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-70dc9420-34a2-47f5-a6f7-09b00638a8dc req-ddf1ada8-86ce-46e4-aad8-dafe4e2cc99b service nova] Creating event network-changed:fbf03382-47b3-45b7-be91-c664781050c5 for instance b5fa9733-f49b-43ab-8586-68d113b73476 on n-h1-862686-1 Oct 26 13:15:22.445550 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4c927379-afa0-472e-be2d-71c96c969a4f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/6668f03f-2108-4ade-88e9-d51f6e696338" status: 200 len: 1308 microversion: 2.1 time: 0.660890 Oct 26 13:15:22.447876 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1509/3032] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:21 2022] GET /compute/v2.1/servers/6668f03f-2108-4ade-88e9-d51f6e696338 => generated 1308 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:15:22.454700 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-21bca1a8-6110-42fa-ad78-1fd35f300e1d tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:22.457425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-21bca1a8-6110-42fa-ad78-1fd35f300e1d tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:22.466153 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-21bca1a8-6110-42fa-ad78-1fd35f300e1d tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:22.467366 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-21bca1a8-6110-42fa-ad78-1fd35f300e1d tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:22.467996 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-21bca1a8-6110-42fa-ad78-1fd35f300e1d tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:22.469435 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-21bca1a8-6110-42fa-ad78-1fd35f300e1d tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:22.469727 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-70dc9420-34a2-47f5-a6f7-09b00638a8dc req-ddf1ada8-86ce-46e4-aad8-dafe4e2cc99b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097773 Oct 26 13:15:22.470298 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-21bca1a8-6110-42fa-ad78-1fd35f300e1d tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:22.470850 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1524/3033] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:15:22.471050 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-21bca1a8-6110-42fa-ad78-1fd35f300e1d tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:22.549103 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cb19b317-75dc-4e4c-8d77-63ea3753c250 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:22.549990 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cb19b317-75dc-4e4c-8d77-63ea3753c250 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: a1dbfc30-8cbf-4a85-8847-a24031f5e3dc] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:22.563857 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb19b317-75dc-4e4c-8d77-63ea3753c250 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:22.573983 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb19b317-75dc-4e4c-8d77-63ea3753c250 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:22.575224 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb19b317-75dc-4e4c-8d77-63ea3753c250 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:22.576010 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb19b317-75dc-4e4c-8d77-63ea3753c250 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:22.576622 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb19b317-75dc-4e4c-8d77-63ea3753c250 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:22.577054 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb19b317-75dc-4e4c-8d77-63ea3753c250 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:22.905285 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cb19b317-75dc-4e4c-8d77-63ea3753c250 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:22.915773 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cb19b317-75dc-4e4c-8d77-63ea3753c250 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc" status: 200 len: 1515 microversion: 2.1 time: 0.371244 Oct 26 13:15:22.916642 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1525/3034] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:22 2022] GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc => generated 1515 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:22.989747 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-342320b3-8b50-4f0b-85ca-63825d65348c req-4e8c7ac3-7e8b-4098-af68-977f110a1602 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ee2d61f-352e-4762-aeec-9c2571e7e054", "name": "network-vif-plugged", "status": "completed", "tag": "42f887f0-054f-4215-9647-53bc789b0ab4"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:15:23.031464 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-342320b3-8b50-4f0b-85ca-63825d65348c req-4e8c7ac3-7e8b-4098-af68-977f110a1602 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:23.032107 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-342320b3-8b50-4f0b-85ca-63825d65348c req-4e8c7ac3-7e8b-4098-af68-977f110a1602 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:23.032999 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-342320b3-8b50-4f0b-85ca-63825d65348c req-4e8c7ac3-7e8b-4098-af68-977f110a1602 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:23.054049 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-342320b3-8b50-4f0b-85ca-63825d65348c req-4e8c7ac3-7e8b-4098-af68-977f110a1602 service nova] Creating event network-vif-plugged:42f887f0-054f-4215-9647-53bc789b0ab4 for instance 7ee2d61f-352e-4762-aeec-9c2571e7e054 on n-h1-862686-1 Oct 26 13:15:23.062415 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-342320b3-8b50-4f0b-85ca-63825d65348c req-4e8c7ac3-7e8b-4098-af68-977f110a1602 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078318 Oct 26 13:15:23.063757 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1526/3035] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:15:23.088788 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-34843309-9407-48bb-9f94-78720e0f9c30 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:23.090991 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-34843309-9407-48bb-9f94-78720e0f9c30 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 424df7e6-aed0-42c5-9536-28db79dcc003] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:23.101115 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-34843309-9407-48bb-9f94-78720e0f9c30 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:23.101831 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-34843309-9407-48bb-9f94-78720e0f9c30 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:23.102445 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-34843309-9407-48bb-9f94-78720e0f9c30 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:23.103321 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-34843309-9407-48bb-9f94-78720e0f9c30 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:23.103934 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-34843309-9407-48bb-9f94-78720e0f9c30 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:23.104887 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-34843309-9407-48bb-9f94-78720e0f9c30 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:23.144205 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-21bca1a8-6110-42fa-ad78-1fd35f300e1d tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:23.163595 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-21bca1a8-6110-42fa-ad78-1fd35f300e1d tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:23.170361 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-21bca1a8-6110-42fa-ad78-1fd35f300e1d tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:23.171920 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-21bca1a8-6110-42fa-ad78-1fd35f300e1d tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1879 microversion: 2.42 time: 0.722760 Oct 26 13:15:23.175790 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1510/3036] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:15:22 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1879 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:15:23.348052 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-34843309-9407-48bb-9f94-78720e0f9c30 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:23.357263 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-34843309-9407-48bb-9f94-78720e0f9c30 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/424df7e6-aed0-42c5-9536-28db79dcc003" status: 200 len: 1315 microversion: 2.1 time: 0.290345 Oct 26 13:15:23.373093 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1527/3037] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:23 2022] GET /compute/v2.1/servers/424df7e6-aed0-42c5-9536-28db79dcc003 => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:23.397166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d9a58681-7d38-412d-917e-1a4da2760379 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:23.398105 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d9a58681-7d38-412d-917e-1a4da2760379 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 7ee2d61f-352e-4762-aeec-9c2571e7e054] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:23.411058 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9a58681-7d38-412d-917e-1a4da2760379 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:23.412114 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9a58681-7d38-412d-917e-1a4da2760379 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:23.412361 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9a58681-7d38-412d-917e-1a4da2760379 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:23.414045 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-d5abe280-b286-4cd3-a311-04eb650e1f04 req-ad31676c-197a-4c8c-82da-6817ad9175c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6668f03f-2108-4ade-88e9-d51f6e696338", "tag": "0ec524f1-818c-446c-8559-2f6a15d3170f"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:15:23.414460 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9a58681-7d38-412d-917e-1a4da2760379 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:23.415855 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9a58681-7d38-412d-917e-1a4da2760379 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:23.416459 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9a58681-7d38-412d-917e-1a4da2760379 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:23.434815 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d5abe280-b286-4cd3-a311-04eb650e1f04 req-ad31676c-197a-4c8c-82da-6817ad9175c8 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:23.440780 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d5abe280-b286-4cd3-a311-04eb650e1f04 req-ad31676c-197a-4c8c-82da-6817ad9175c8 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:23.441232 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d5abe280-b286-4cd3-a311-04eb650e1f04 req-ad31676c-197a-4c8c-82da-6817ad9175c8 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:23.457003 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-d5abe280-b286-4cd3-a311-04eb650e1f04 req-ad31676c-197a-4c8c-82da-6817ad9175c8 service nova] Creating event network-changed:0ec524f1-818c-446c-8559-2f6a15d3170f for instance 6668f03f-2108-4ade-88e9-d51f6e696338 on n-h2-862686-1 Oct 26 13:15:23.461940 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-d5abe280-b286-4cd3-a311-04eb650e1f04 req-ad31676c-197a-4c8c-82da-6817ad9175c8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057111 Oct 26 13:15:23.462723 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1528/3038] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:15:23.474818 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-65b2a5bc-dedd-4f69-8750-60a9bdff3d32 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:23.475571 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-65b2a5bc-dedd-4f69-8750-60a9bdff3d32 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 6668f03f-2108-4ade-88e9-d51f6e696338] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:23.482537 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-65b2a5bc-dedd-4f69-8750-60a9bdff3d32 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:23.483023 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-65b2a5bc-dedd-4f69-8750-60a9bdff3d32 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:23.483458 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-65b2a5bc-dedd-4f69-8750-60a9bdff3d32 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:23.484167 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-65b2a5bc-dedd-4f69-8750-60a9bdff3d32 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:23.484618 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-65b2a5bc-dedd-4f69-8750-60a9bdff3d32 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:23.485045 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-65b2a5bc-dedd-4f69-8750-60a9bdff3d32 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:23.639793 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-65b2a5bc-dedd-4f69-8750-60a9bdff3d32 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:23.648578 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-65b2a5bc-dedd-4f69-8750-60a9bdff3d32 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/6668f03f-2108-4ade-88e9-d51f6e696338" status: 200 len: 1308 microversion: 2.1 time: 0.177787 Oct 26 13:15:23.649456 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1529/3039] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:23 2022] GET /compute/v2.1/servers/6668f03f-2108-4ade-88e9-d51f6e696338 => generated 1308 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:15:23.941215 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bbea0e39-4f89-4aa3-a442-6e443b4a759e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:23.942138 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bbea0e39-4f89-4aa3-a442-6e443b4a759e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: a1dbfc30-8cbf-4a85-8847-a24031f5e3dc] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:23.948292 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bbea0e39-4f89-4aa3-a442-6e443b4a759e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:23.949029 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bbea0e39-4f89-4aa3-a442-6e443b4a759e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:23.949463 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bbea0e39-4f89-4aa3-a442-6e443b4a759e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:23.950233 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bbea0e39-4f89-4aa3-a442-6e443b4a759e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:23.950627 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bbea0e39-4f89-4aa3-a442-6e443b4a759e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:23.951053 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bbea0e39-4f89-4aa3-a442-6e443b4a759e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:24.057129 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d9a58681-7d38-412d-917e-1a4da2760379 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13285463ba34e89931d667bc327bb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875ebd1c99c746f7b4f1a3c08156e6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:24.066231 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d9a58681-7d38-412d-917e-1a4da2760379 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee2d61f-352e-4762-aeec-9c2571e7e054" status: 200 len: 1314 microversion: 2.1 time: 0.673773 Oct 26 13:15:24.067224 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1511/3040] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:23 2022] GET /compute/v2.1/servers/7ee2d61f-352e-4762-aeec-9c2571e7e054 => generated 1314 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:24.104919 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bbea0e39-4f89-4aa3-a442-6e443b4a759e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:24.113031 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bbea0e39-4f89-4aa3-a442-6e443b4a759e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc" status: 200 len: 1515 microversion: 2.1 time: 0.175685 Oct 26 13:15:24.113956 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1530/3041] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:23 2022] GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc => generated 1515 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:24.210520 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-05e874c9-b608-441f-aa2c-4af7649307cf tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:24.211912 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-05e874c9-b608-441f-aa2c-4af7649307cf tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:24.219582 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05e874c9-b608-441f-aa2c-4af7649307cf tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:24.220294 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05e874c9-b608-441f-aa2c-4af7649307cf tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:24.220939 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05e874c9-b608-441f-aa2c-4af7649307cf tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:24.221991 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05e874c9-b608-441f-aa2c-4af7649307cf tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:24.222593 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05e874c9-b608-441f-aa2c-4af7649307cf tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:24.223162 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05e874c9-b608-441f-aa2c-4af7649307cf tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:24.380331 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9f4b5690-c2da-4acb-8f91-030b7874871c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:24.381422 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9f4b5690-c2da-4acb-8f91-030b7874871c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 424df7e6-aed0-42c5-9536-28db79dcc003] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:24.402716 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f4b5690-c2da-4acb-8f91-030b7874871c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:24.403912 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f4b5690-c2da-4acb-8f91-030b7874871c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:24.405319 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f4b5690-c2da-4acb-8f91-030b7874871c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:24.406858 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f4b5690-c2da-4acb-8f91-030b7874871c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:24.407542 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f4b5690-c2da-4acb-8f91-030b7874871c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:24.408221 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f4b5690-c2da-4acb-8f91-030b7874871c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:24.411588 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:15:24.587546 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:15:24.639287 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-05e874c9-b608-441f-aa2c-4af7649307cf tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:24.644772 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:15:24.663126 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-05e874c9-b608-441f-aa2c-4af7649307cf tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:24.667532 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-05e874c9-b608-441f-aa2c-4af7649307cf tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:24.669357 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-05e874c9-b608-441f-aa2c-4af7649307cf tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1879 microversion: 2.42 time: 0.462964 Oct 26 13:15:24.689032 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1512/3042] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:15:24 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1879 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:15:24.696500 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c997bd70-07cf-447e-a644-f3cc4d03c089 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:24.697128 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c997bd70-07cf-447e-a644-f3cc4d03c089 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:24.704743 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c997bd70-07cf-447e-a644-f3cc4d03c089 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:24.705370 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c997bd70-07cf-447e-a644-f3cc4d03c089 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:24.705922 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c997bd70-07cf-447e-a644-f3cc4d03c089 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:24.706721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c997bd70-07cf-447e-a644-f3cc4d03c089 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:24.707275 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c997bd70-07cf-447e-a644-f3cc4d03c089 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:24.707787 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c997bd70-07cf-447e-a644-f3cc4d03c089 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:24.734453 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9f4b5690-c2da-4acb-8f91-030b7874871c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:24.748713 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9f4b5690-c2da-4acb-8f91-030b7874871c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/424df7e6-aed0-42c5-9536-28db79dcc003" status: 200 len: 1315 microversion: 2.1 time: 0.371274 Oct 26 13:15:24.764655 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1531/3043] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:24 2022] GET /compute/v2.1/servers/424df7e6-aed0-42c5-9536-28db79dcc003 => generated 1315 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:15:24.777784 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-13ee4944-f581-4ded-9aa6-27c75d8e7c05 req-cafaa713-fd6e-4ae9-9850-532d5fb89f56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5fa9733-f49b-43ab-8586-68d113b73476", "tag": "f2fe44e4-4b3a-4974-85cd-bdb8df938561"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:15:24.787444 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-13ee4944-f581-4ded-9aa6-27c75d8e7c05 req-cafaa713-fd6e-4ae9-9850-532d5fb89f56 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:24.787931 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-13ee4944-f581-4ded-9aa6-27c75d8e7c05 req-cafaa713-fd6e-4ae9-9850-532d5fb89f56 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:24.788368 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-13ee4944-f581-4ded-9aa6-27c75d8e7c05 req-cafaa713-fd6e-4ae9-9850-532d5fb89f56 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:24.803284 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-13ee4944-f581-4ded-9aa6-27c75d8e7c05 req-cafaa713-fd6e-4ae9-9850-532d5fb89f56 service nova] Creating event network-changed:f2fe44e4-4b3a-4974-85cd-bdb8df938561 for instance b5fa9733-f49b-43ab-8586-68d113b73476 on n-h1-862686-1 Oct 26 13:15:24.809819 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-13ee4944-f581-4ded-9aa6-27c75d8e7c05 req-cafaa713-fd6e-4ae9-9850-532d5fb89f56 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039921 Oct 26 13:15:24.810446 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1532/3044] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:15:24.820152 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3d0f23a5-1182-433c-a022-db0bb416c77e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:24.821124 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3d0f23a5-1182-433c-a022-db0bb416c77e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 6668f03f-2108-4ade-88e9-d51f6e696338] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:24.829318 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3d0f23a5-1182-433c-a022-db0bb416c77e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:24.829844 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3d0f23a5-1182-433c-a022-db0bb416c77e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:24.830357 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3d0f23a5-1182-433c-a022-db0bb416c77e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:24.831075 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3d0f23a5-1182-433c-a022-db0bb416c77e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:24.831537 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3d0f23a5-1182-433c-a022-db0bb416c77e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:24.831971 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3d0f23a5-1182-433c-a022-db0bb416c77e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:25.005155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3d0f23a5-1182-433c-a022-db0bb416c77e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:25.007570 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=12 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:15:25.016152 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3d0f23a5-1182-433c-a022-db0bb416c77e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/6668f03f-2108-4ade-88e9-d51f6e696338" status: 200 len: 1308 microversion: 2.1 time: 0.204520 Oct 26 13:15:25.016737 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1533/3045] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:24 2022] GET /compute/v2.1/servers/6668f03f-2108-4ade-88e9-d51f6e696338 => generated 1308 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:25.078893 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-36ac34b6-6bf4-453c-998f-3ce3a3fc80ae req-12a65a9b-e583-4863-9992-831b2e90688a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "424df7e6-aed0-42c5-9536-28db79dcc003", "name": "network-vif-plugged", "status": "completed", "tag": "bed86f43-2734-4595-b60c-4c47312165c5"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:15:25.088560 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-36ac34b6-6bf4-453c-998f-3ce3a3fc80ae req-12a65a9b-e583-4863-9992-831b2e90688a service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:25.089264 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-36ac34b6-6bf4-453c-998f-3ce3a3fc80ae req-12a65a9b-e583-4863-9992-831b2e90688a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:25.090221 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-36ac34b6-6bf4-453c-998f-3ce3a3fc80ae req-12a65a9b-e583-4863-9992-831b2e90688a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:25.101521 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-36ac34b6-6bf4-453c-998f-3ce3a3fc80ae req-12a65a9b-e583-4863-9992-831b2e90688a service nova] Creating event network-vif-plugged:bed86f43-2734-4595-b60c-4c47312165c5 for instance 424df7e6-aed0-42c5-9536-28db79dcc003 on n-h1-862686-1 Oct 26 13:15:25.106620 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-36ac34b6-6bf4-453c-998f-3ce3a3fc80ae req-12a65a9b-e583-4863-9992-831b2e90688a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032034 Oct 26 13:15:25.107559 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1534/3046] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:15:25.112523 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-239fd6a0-f8ff-4a44-85ef-c4dffe9f5525 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:25.113214 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-239fd6a0-f8ff-4a44-85ef-c4dffe9f5525 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 7ee2d61f-352e-4762-aeec-9c2571e7e054] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:25.119400 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-239fd6a0-f8ff-4a44-85ef-c4dffe9f5525 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:25.119815 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-239fd6a0-f8ff-4a44-85ef-c4dffe9f5525 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:25.120255 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-239fd6a0-f8ff-4a44-85ef-c4dffe9f5525 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:25.121458 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-239fd6a0-f8ff-4a44-85ef-c4dffe9f5525 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:25.121921 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-239fd6a0-f8ff-4a44-85ef-c4dffe9f5525 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:25.122349 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-239fd6a0-f8ff-4a44-85ef-c4dffe9f5525 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:25.253818 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c997bd70-07cf-447e-a644-f3cc4d03c089 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c" status: 200 len: 1858 microversion: 2.1 time: 0.566367 Oct 26 13:15:25.255155 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1513/3047] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:24 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c => generated 1858 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:25.260284 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6d4c8505-57fc-4aae-b095-a9a16feb1d94 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:25.261191 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6d4c8505-57fc-4aae-b095-a9a16feb1d94 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: a1dbfc30-8cbf-4a85-8847-a24031f5e3dc] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:25.269593 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d4c8505-57fc-4aae-b095-a9a16feb1d94 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:25.271545 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d4c8505-57fc-4aae-b095-a9a16feb1d94 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:25.272230 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d4c8505-57fc-4aae-b095-a9a16feb1d94 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:25.274128 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d4c8505-57fc-4aae-b095-a9a16feb1d94 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:25.274839 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d4c8505-57fc-4aae-b095-a9a16feb1d94 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:25.275530 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d4c8505-57fc-4aae-b095-a9a16feb1d94 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:25.458524 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-239fd6a0-f8ff-4a44-85ef-c4dffe9f5525 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13285463ba34e89931d667bc327bb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875ebd1c99c746f7b4f1a3c08156e6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:25.467557 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-239fd6a0-f8ff-4a44-85ef-c4dffe9f5525 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee2d61f-352e-4762-aeec-9c2571e7e054" status: 200 len: 1502 microversion: 2.1 time: 0.358809 Oct 26 13:15:25.468831 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1535/3048] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:25 2022] GET /compute/v2.1/servers/7ee2d61f-352e-4762-aeec-9c2571e7e054 => generated 1502 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:25.474126 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a16dcdb2-bc2f-4488-8481-bfc69a76adef tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-862686-1", "block_migration": true, "disk_over_commit": false}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:15:25.476873 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a16dcdb2-bc2f-4488-8481-bfc69a76adef tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:25.484453 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a16dcdb2-bc2f-4488-8481-bfc69a76adef tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:25.485253 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a16dcdb2-bc2f-4488-8481-bfc69a76adef tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:25.486140 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a16dcdb2-bc2f-4488-8481-bfc69a76adef tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:25.487185 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a16dcdb2-bc2f-4488-8481-bfc69a76adef tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:25.487867 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a16dcdb2-bc2f-4488-8481-bfc69a76adef tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:25.489028 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a16dcdb2-bc2f-4488-8481-bfc69a76adef tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:25.557687 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-a16dcdb2-bc2f-4488-8481-bfc69a76adef tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lazy-loading 'flavor' on Instance uuid 5e73c452-6277-4845-b64e-e3eca2528e4c {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:15:25.584313 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a16dcdb2-bc2f-4488-8481-bfc69a76adef tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Going to try to live migrate instance to n-h1-862686-1 {{(pid=120597) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 26 13:15:25.623142 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6d4c8505-57fc-4aae-b095-a9a16feb1d94 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:25.631467 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6d4c8505-57fc-4aae-b095-a9a16feb1d94 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc" status: 200 len: 1515 microversion: 2.1 time: 0.375062 Oct 26 13:15:25.641979 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1514/3049] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:25 2022] GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc => generated 1515 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:25.648965 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2cbe971d-5145-449c-b247-9347ae52ceab tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1349941559"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:15:25.650598 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2cbe971d-5145-449c-b247-9347ae52ceab tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 7ee2d61f-352e-4762-aeec-9c2571e7e054] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:25.665523 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2cbe971d-5145-449c-b247-9347ae52ceab tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:25.665715 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2cbe971d-5145-449c-b247-9347ae52ceab tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:25.666080 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2cbe971d-5145-449c-b247-9347ae52ceab tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:25.666792 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2cbe971d-5145-449c-b247-9347ae52ceab tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:25.667251 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2cbe971d-5145-449c-b247-9347ae52ceab tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:25.667679 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2cbe971d-5145-449c-b247-9347ae52ceab tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:25.978715 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.network.security_group_api [None req-2cbe971d-5145-449c-b247-9347ae52ceab tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Adding security group 7c93be56-e3b8-48a2-bf3c-83a3139d8347 to port 42f887f0-054f-4215-9647-53bc789b0ab4 Oct 26 13:15:26.754862 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2cbe971d-5145-449c-b247-9347ae52ceab tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "POST /compute/v2.1/servers/7ee2d61f-352e-4762-aeec-9c2571e7e054/action" status: 202 len: 0 microversion: 2.1 time: 1.111129 Oct 26 13:15:26.759214 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1515/3050] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:15:25 2022] POST /compute/v2.1/servers/7ee2d61f-352e-4762-aeec-9c2571e7e054/action => generated 0 bytes in 1113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:15:26.769681 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-664a0967-9838-47b7-8912-19af9fd3b367 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:26.778297 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-664a0967-9838-47b7-8912-19af9fd3b367 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:26.788937 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-664a0967-9838-47b7-8912-19af9fd3b367 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:26.789960 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-664a0967-9838-47b7-8912-19af9fd3b367 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:26.793522 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-664a0967-9838-47b7-8912-19af9fd3b367 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:26.796430 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-664a0967-9838-47b7-8912-19af9fd3b367 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:26.797106 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-664a0967-9838-47b7-8912-19af9fd3b367 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:26.797819 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-664a0967-9838-47b7-8912-19af9fd3b367 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:27.352814 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-664a0967-9838-47b7-8912-19af9fd3b367 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:27.373267 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-664a0967-9838-47b7-8912-19af9fd3b367 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:27.383358 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-664a0967-9838-47b7-8912-19af9fd3b367 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:27.385678 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-664a0967-9838-47b7-8912-19af9fd3b367 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1879 microversion: 2.42 time: 0.627518 Oct 26 13:15:27.386835 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1516/3051] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:15:26 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1879 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:15:27.403432 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-103b6812-8278-4ec3-9023-980da0024e04 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:27.405154 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-103b6812-8278-4ec3-9023-980da0024e04 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 424df7e6-aed0-42c5-9536-28db79dcc003] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:27.412972 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-103b6812-8278-4ec3-9023-980da0024e04 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:27.416718 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-103b6812-8278-4ec3-9023-980da0024e04 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:27.417373 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-103b6812-8278-4ec3-9023-980da0024e04 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:27.420243 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-103b6812-8278-4ec3-9023-980da0024e04 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:27.422308 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-103b6812-8278-4ec3-9023-980da0024e04 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:27.424917 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-103b6812-8278-4ec3-9023-980da0024e04 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:28.238480 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-103b6812-8278-4ec3-9023-980da0024e04 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:28.258736 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-103b6812-8278-4ec3-9023-980da0024e04 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/424df7e6-aed0-42c5-9536-28db79dcc003" status: 200 len: 1502 microversion: 2.1 time: 0.870152 Oct 26 13:15:28.259606 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1517/3052] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:27 2022] GET /compute/v2.1/servers/424df7e6-aed0-42c5-9536-28db79dcc003 => generated 1502 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:28.283800 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4a762956-80b9-4185-b721-1403fe8f0075 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:28.284663 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4a762956-80b9-4185-b721-1403fe8f0075 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 6668f03f-2108-4ade-88e9-d51f6e696338] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:28.292033 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a762956-80b9-4185-b721-1403fe8f0075 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:28.292800 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a762956-80b9-4185-b721-1403fe8f0075 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:28.293403 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a762956-80b9-4185-b721-1403fe8f0075 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:28.294335 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a762956-80b9-4185-b721-1403fe8f0075 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:28.294974 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a762956-80b9-4185-b721-1403fe8f0075 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:28.297897 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a762956-80b9-4185-b721-1403fe8f0075 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:28.501381 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a16dcdb2-bc2f-4488-8481-bfc69a76adef tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c/action" status: 202 len: 0 microversion: 2.1 time: 3.031045 Oct 26 13:15:28.507660 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1536/3053] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:15:25 2022] POST /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c/action => generated 0 bytes in 3032 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:15:28.524366 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c3e14b46-45a3-4cdf-98ce-5dbbbd4cb374 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:28.526827 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c3e14b46-45a3-4cdf-98ce-5dbbbd4cb374 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: a1dbfc30-8cbf-4a85-8847-a24031f5e3dc] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:28.541968 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4a762956-80b9-4185-b721-1403fe8f0075 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:28.554782 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c3e14b46-45a3-4cdf-98ce-5dbbbd4cb374 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:28.555577 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c3e14b46-45a3-4cdf-98ce-5dbbbd4cb374 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:28.556246 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4a762956-80b9-4185-b721-1403fe8f0075 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/6668f03f-2108-4ade-88e9-d51f6e696338" status: 200 len: 1308 microversion: 2.1 time: 0.281575 Oct 26 13:15:28.571611 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c3e14b46-45a3-4cdf-98ce-5dbbbd4cb374 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:28.571979 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1518/3054] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:28 2022] GET /compute/v2.1/servers/6668f03f-2108-4ade-88e9-d51f6e696338 => generated 1308 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:28.572081 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c3e14b46-45a3-4cdf-98ce-5dbbbd4cb374 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:28.572081 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c3e14b46-45a3-4cdf-98ce-5dbbbd4cb374 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:28.572081 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c3e14b46-45a3-4cdf-98ce-5dbbbd4cb374 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:28.572326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-dbd20695-99c9-45e7-9db3-a986c5a51394 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1342764752"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:15:28.572326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-dbd20695-99c9-45e7-9db3-a986c5a51394 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 7ee2d61f-352e-4762-aeec-9c2571e7e054] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:28.592146 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dbd20695-99c9-45e7-9db3-a986c5a51394 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:28.594063 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dbd20695-99c9-45e7-9db3-a986c5a51394 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:28.595873 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dbd20695-99c9-45e7-9db3-a986c5a51394 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:28.597929 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dbd20695-99c9-45e7-9db3-a986c5a51394 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:28.600162 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dbd20695-99c9-45e7-9db3-a986c5a51394 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:28.600931 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dbd20695-99c9-45e7-9db3-a986c5a51394 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:28.878812 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c3e14b46-45a3-4cdf-98ce-5dbbbd4cb374 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:28.885752 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c3e14b46-45a3-4cdf-98ce-5dbbbd4cb374 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc" status: 200 len: 1515 microversion: 2.1 time: 0.382320 Oct 26 13:15:28.888226 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1537/3055] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:28 2022] GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc => generated 1515 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:28.892977 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-4ac5dd21-182d-4d9c-a8b8-0890ffca5eae req-d1844c23-2334-4473-93e4-3c63465d18cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5fa9733-f49b-43ab-8586-68d113b73476", "tag": "d85d2737-225d-489a-bdd1-412eb1f237ba"}, {"name": "network-changed", "server_uuid": "7ee2d61f-352e-4762-aeec-9c2571e7e054", "tag": "42f887f0-054f-4215-9647-53bc789b0ab4"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:15:28.906014 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-4ac5dd21-182d-4d9c-a8b8-0890ffca5eae req-d1844c23-2334-4473-93e4-3c63465d18cb service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:28.906684 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-4ac5dd21-182d-4d9c-a8b8-0890ffca5eae req-d1844c23-2334-4473-93e4-3c63465d18cb service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:28.907112 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-4ac5dd21-182d-4d9c-a8b8-0890ffca5eae req-d1844c23-2334-4473-93e4-3c63465d18cb service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:28.932243 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-4ac5dd21-182d-4d9c-a8b8-0890ffca5eae req-d1844c23-2334-4473-93e4-3c63465d18cb service nova] Creating event network-changed:d85d2737-225d-489a-bdd1-412eb1f237ba for instance b5fa9733-f49b-43ab-8586-68d113b73476 on n-h1-862686-1 Oct 26 13:15:28.933382 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-4ac5dd21-182d-4d9c-a8b8-0890ffca5eae req-d1844c23-2334-4473-93e4-3c63465d18cb service nova] Creating event network-changed:42f887f0-054f-4215-9647-53bc789b0ab4 for instance 7ee2d61f-352e-4762-aeec-9c2571e7e054 on n-h1-862686-1 Oct 26 13:15:28.942027 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-4ac5dd21-182d-4d9c-a8b8-0890ffca5eae req-d1844c23-2334-4473-93e4-3c63465d18cb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.052215 Oct 26 13:15:28.943361 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1538/3056] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:15:28.962547 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-f67f58e5-2795-4bb4-ba65-5962fd0a5361 req-591fe1ff-8c76-439f-9c3c-fbf7c2eac0fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6668f03f-2108-4ade-88e9-d51f6e696338", "name": "network-vif-plugged", "status": "completed", "tag": "0ec524f1-818c-446c-8559-2f6a15d3170f"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:15:28.982075 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-f67f58e5-2795-4bb4-ba65-5962fd0a5361 req-591fe1ff-8c76-439f-9c3c-fbf7c2eac0fa service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:28.982883 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-f67f58e5-2795-4bb4-ba65-5962fd0a5361 req-591fe1ff-8c76-439f-9c3c-fbf7c2eac0fa service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:28.983537 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-f67f58e5-2795-4bb4-ba65-5962fd0a5361 req-591fe1ff-8c76-439f-9c3c-fbf7c2eac0fa service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:29.000049 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-f67f58e5-2795-4bb4-ba65-5962fd0a5361 req-591fe1ff-8c76-439f-9c3c-fbf7c2eac0fa service nova] Creating event network-vif-plugged:0ec524f1-818c-446c-8559-2f6a15d3170f for instance 6668f03f-2108-4ade-88e9-d51f6e696338 on n-h2-862686-1 Oct 26 13:15:29.005392 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-f67f58e5-2795-4bb4-ba65-5962fd0a5361 req-591fe1ff-8c76-439f-9c3c-fbf7c2eac0fa service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060515 Oct 26 13:15:29.007384 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1539/3057] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:15:29.014684 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b04e5318-19cc-44fa-8707-afc4f7ae04bc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:29.015574 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b04e5318-19cc-44fa-8707-afc4f7ae04bc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 424df7e6-aed0-42c5-9536-28db79dcc003] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:29.022604 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b04e5318-19cc-44fa-8707-afc4f7ae04bc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:29.023384 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b04e5318-19cc-44fa-8707-afc4f7ae04bc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:29.024024 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b04e5318-19cc-44fa-8707-afc4f7ae04bc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:29.025646 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b04e5318-19cc-44fa-8707-afc4f7ae04bc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:29.026317 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b04e5318-19cc-44fa-8707-afc4f7ae04bc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:29.027249 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b04e5318-19cc-44fa-8707-afc4f7ae04bc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:29.071946 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b04e5318-19cc-44fa-8707-afc4f7ae04bc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 424df7e6-aed0-42c5-9536-28db79dcc003] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:15:29.073587 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.network.security_group_api [None req-dbd20695-99c9-45e7-9db3-a986c5a51394 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Adding security group 7ca874d8-0331-43cc-89e9-4609f5dd6911 to port 42f887f0-054f-4215-9647-53bc789b0ab4 Oct 26 13:15:29.253911 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b04e5318-19cc-44fa-8707-afc4f7ae04bc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "DELETE /compute/v2.1/servers/424df7e6-aed0-42c5-9536-28db79dcc003" status: 204 len: 0 microversion: 2.1 time: 0.243701 Oct 26 13:15:29.255428 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1540/3058] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:15:29 2022] DELETE /compute/v2.1/servers/424df7e6-aed0-42c5-9536-28db79dcc003 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:15:29.264439 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-170d35d5-a614-45f5-a38e-a21581590898 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:29.267233 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-170d35d5-a614-45f5-a38e-a21581590898 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:29.278802 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-170d35d5-a614-45f5-a38e-a21581590898 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:29.280004 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-170d35d5-a614-45f5-a38e-a21581590898 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:29.280925 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-170d35d5-a614-45f5-a38e-a21581590898 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:29.283109 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-170d35d5-a614-45f5-a38e-a21581590898 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:29.283950 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-170d35d5-a614-45f5-a38e-a21581590898 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:29.284602 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-170d35d5-a614-45f5-a38e-a21581590898 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:29.492014 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-170d35d5-a614-45f5-a38e-a21581590898 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:29.503114 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-170d35d5-a614-45f5-a38e-a21581590898 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:29.505391 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-170d35d5-a614-45f5-a38e-a21581590898 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:29.507131 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-170d35d5-a614-45f5-a38e-a21581590898 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1879 microversion: 2.42 time: 0.250308 Oct 26 13:15:29.508176 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1541/3059] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:15:29 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1879 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:15:29.514025 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cce8e079-7f61-4282-8933-f2cd995998fe tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:29.515019 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cce8e079-7f61-4282-8933-f2cd995998fe tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:29.521761 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cce8e079-7f61-4282-8933-f2cd995998fe tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:29.522489 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cce8e079-7f61-4282-8933-f2cd995998fe tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:29.523328 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cce8e079-7f61-4282-8933-f2cd995998fe tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:29.524199 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cce8e079-7f61-4282-8933-f2cd995998fe tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:29.524823 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cce8e079-7f61-4282-8933-f2cd995998fe tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:29.525405 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cce8e079-7f61-4282-8933-f2cd995998fe tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:29.669388 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cce8e079-7f61-4282-8933-f2cd995998fe tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:29.679356 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cce8e079-7f61-4282-8933-f2cd995998fe tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c" status: 200 len: 1717 microversion: 2.1 time: 0.169896 Oct 26 13:15:29.680988 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1542/3060] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:29 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c => generated 1717 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:29.687107 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-592cca47-27fe-40fb-9e9d-e99274d43b2c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:29.688025 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-592cca47-27fe-40fb-9e9d-e99274d43b2c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 424df7e6-aed0-42c5-9536-28db79dcc003] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:29.694283 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-592cca47-27fe-40fb-9e9d-e99274d43b2c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:29.694779 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-592cca47-27fe-40fb-9e9d-e99274d43b2c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:29.695221 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-592cca47-27fe-40fb-9e9d-e99274d43b2c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:29.696207 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-592cca47-27fe-40fb-9e9d-e99274d43b2c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:29.696649 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-592cca47-27fe-40fb-9e9d-e99274d43b2c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:29.697438 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-592cca47-27fe-40fb-9e9d-e99274d43b2c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:29.870162 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-592cca47-27fe-40fb-9e9d-e99274d43b2c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:29.883317 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-592cca47-27fe-40fb-9e9d-e99274d43b2c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/424df7e6-aed0-42c5-9536-28db79dcc003" status: 200 len: 1508 microversion: 2.1 time: 0.200832 Oct 26 13:15:29.883920 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1543/3061] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:29 2022] GET /compute/v2.1/servers/424df7e6-aed0-42c5-9536-28db79dcc003 => generated 1508 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:29.889993 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-596764f4-b434-4125-98ab-8fa76c17a520 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:29.891166 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-596764f4-b434-4125-98ab-8fa76c17a520 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 6668f03f-2108-4ade-88e9-d51f6e696338] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:29.898111 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-596764f4-b434-4125-98ab-8fa76c17a520 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:29.898801 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-596764f4-b434-4125-98ab-8fa76c17a520 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:29.899437 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-596764f4-b434-4125-98ab-8fa76c17a520 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:29.900359 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-596764f4-b434-4125-98ab-8fa76c17a520 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:29.901413 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-596764f4-b434-4125-98ab-8fa76c17a520 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:29.901920 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-596764f4-b434-4125-98ab-8fa76c17a520 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:30.060383 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-596764f4-b434-4125-98ab-8fa76c17a520 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:30.068518 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-596764f4-b434-4125-98ab-8fa76c17a520 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/6668f03f-2108-4ade-88e9-d51f6e696338" status: 200 len: 1308 microversion: 2.1 time: 0.182780 Oct 26 13:15:30.069175 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1544/3062] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:29 2022] GET /compute/v2.1/servers/6668f03f-2108-4ade-88e9-d51f6e696338 => generated 1308 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:30.074740 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-18b0edce-0128-4ed6-8236-d0bfe5e9c5bb tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:30.076385 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-18b0edce-0128-4ed6-8236-d0bfe5e9c5bb tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: a1dbfc30-8cbf-4a85-8847-a24031f5e3dc] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:30.086113 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18b0edce-0128-4ed6-8236-d0bfe5e9c5bb tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:30.087030 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18b0edce-0128-4ed6-8236-d0bfe5e9c5bb tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:30.087818 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18b0edce-0128-4ed6-8236-d0bfe5e9c5bb tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:30.089364 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18b0edce-0128-4ed6-8236-d0bfe5e9c5bb tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:30.090777 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18b0edce-0128-4ed6-8236-d0bfe5e9c5bb tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:30.091270 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18b0edce-0128-4ed6-8236-d0bfe5e9c5bb tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:30.110870 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-dbd20695-99c9-45e7-9db3-a986c5a51394 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "POST /compute/v2.1/servers/7ee2d61f-352e-4762-aeec-9c2571e7e054/action" status: 202 len: 0 microversion: 2.1 time: 1.549817 Oct 26 13:15:30.112014 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1519/3063] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:15:28 2022] POST /compute/v2.1/servers/7ee2d61f-352e-4762-aeec-9c2571e7e054/action => generated 0 bytes in 1552 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:15:30.120977 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-089f7877-c0f5-47e0-87d2-700da34c9457 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:30.121893 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-089f7877-c0f5-47e0-87d2-700da34c9457 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 7ee2d61f-352e-4762-aeec-9c2571e7e054] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:30.134248 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-089f7877-c0f5-47e0-87d2-700da34c9457 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:30.137958 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-089f7877-c0f5-47e0-87d2-700da34c9457 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:30.139347 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-089f7877-c0f5-47e0-87d2-700da34c9457 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:30.141142 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-089f7877-c0f5-47e0-87d2-700da34c9457 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:30.141906 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-089f7877-c0f5-47e0-87d2-700da34c9457 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:30.143891 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-089f7877-c0f5-47e0-87d2-700da34c9457 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:30.468073 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-089f7877-c0f5-47e0-87d2-700da34c9457 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee2d61f-352e-4762-aeec-9c2571e7e054/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.351313 Oct 26 13:15:30.469603 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1520/3064] 10.222.0.40 () {58 vars in 1293 bytes} [Wed Oct 26 13:15:30 2022] GET /compute/v2.1/servers/7ee2d61f-352e-4762-aeec-9c2571e7e054/os-security-groups => generated 1158 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:30.485420 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-dce5dd28-e876-4b2f-b7f3-ece7c57a0c3d tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Action: 'create', calling method: .version_select at 0x7f6736904b80>, body: {"security_group": {"name": " tempest-securitygroup -2007015414 ", "description": "tempest-description-1170065675"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:15:30.502462 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-18b0edce-0128-4ed6-8236-d0bfe5e9c5bb tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:30.518787 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-18b0edce-0128-4ed6-8236-d0bfe5e9c5bb tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc" status: 200 len: 1515 microversion: 2.1 time: 0.448204 Oct 26 13:15:30.519438 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1545/3065] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:30 2022] GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc => generated 1515 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:30.535762 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-62aeeab7-4c46-4501-8ff0-8e83f2e82d75 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:30.536665 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-62aeeab7-4c46-4501-8ff0-8e83f2e82d75 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:30.549226 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-62aeeab7-4c46-4501-8ff0-8e83f2e82d75 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:30.554720 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-62aeeab7-4c46-4501-8ff0-8e83f2e82d75 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:30.555178 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-62aeeab7-4c46-4501-8ff0-8e83f2e82d75 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:30.556097 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-62aeeab7-4c46-4501-8ff0-8e83f2e82d75 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:30.556719 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-62aeeab7-4c46-4501-8ff0-8e83f2e82d75 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:30.557331 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-62aeeab7-4c46-4501-8ff0-8e83f2e82d75 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:31.059568 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-62aeeab7-4c46-4501-8ff0-8e83f2e82d75 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:31.063569 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:15:31.086649 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-62aeeab7-4c46-4501-8ff0-8e83f2e82d75 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:31.091964 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-62aeeab7-4c46-4501-8ff0-8e83f2e82d75 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:31.097252 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-62aeeab7-4c46-4501-8ff0-8e83f2e82d75 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1879 microversion: 2.42 time: 0.564955 Oct 26 13:15:31.099941 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1546/3066] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:15:30 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1879 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:15:31.111632 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c0896a75-f5f9-4f46-bf61-defe8571b733 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:31.113674 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c0896a75-f5f9-4f46-bf61-defe8571b733 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:31.128755 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0896a75-f5f9-4f46-bf61-defe8571b733 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:31.129569 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0896a75-f5f9-4f46-bf61-defe8571b733 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:31.130164 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0896a75-f5f9-4f46-bf61-defe8571b733 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:31.131098 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0896a75-f5f9-4f46-bf61-defe8571b733 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:31.131817 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0896a75-f5f9-4f46-bf61-defe8571b733 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:31.132448 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0896a75-f5f9-4f46-bf61-defe8571b733 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:31.418039 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c0896a75-f5f9-4f46-bf61-defe8571b733 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:31.430029 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c0896a75-f5f9-4f46-bf61-defe8571b733 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c" status: 200 len: 1717 microversion: 2.1 time: 0.327583 Oct 26 13:15:31.431152 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1547/3067] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:31 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c => generated 1717 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:31.436690 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a9434c0e-f438-43d5-8564-06d3400e6e77 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:31.437649 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a9434c0e-f438-43d5-8564-06d3400e6e77 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 424df7e6-aed0-42c5-9536-28db79dcc003] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:31.444996 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a9434c0e-f438-43d5-8564-06d3400e6e77 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:31.445893 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a9434c0e-f438-43d5-8564-06d3400e6e77 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:31.446566 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a9434c0e-f438-43d5-8564-06d3400e6e77 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:31.447822 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a9434c0e-f438-43d5-8564-06d3400e6e77 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:31.448502 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a9434c0e-f438-43d5-8564-06d3400e6e77 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:31.450064 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a9434c0e-f438-43d5-8564-06d3400e6e77 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:31.506489 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-dce5dd28-e876-4b2f-b7f3-ece7c57a0c3d tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 1.025627 Oct 26 13:15:31.508084 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1521/3068] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 26 13:15:30 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:15:31.516494 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-cf20043e-aaf3-40df-9add-f87951b44032 req-abe74f1a-0d5a-46d5-9310-876a0b7f0307 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5fa9733-f49b-43ab-8586-68d113b73476", "tag": "b4a99c4e-af6c-4bd4-bdc0-d0c89b5dec6c"}, {"name": "network-changed", "server_uuid": "7ee2d61f-352e-4762-aeec-9c2571e7e054", "tag": "42f887f0-054f-4215-9647-53bc789b0ab4"}, {"name": "network-changed", "server_uuid": "b5fa9733-f49b-43ab-8586-68d113b73476", "tag": "3e876899-0ec1-4d6a-bf24-cae0a92e06ac"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:15:31.533803 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-cf20043e-aaf3-40df-9add-f87951b44032 req-abe74f1a-0d5a-46d5-9310-876a0b7f0307 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:31.534715 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-cf20043e-aaf3-40df-9add-f87951b44032 req-abe74f1a-0d5a-46d5-9310-876a0b7f0307 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:31.535309 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-cf20043e-aaf3-40df-9add-f87951b44032 req-abe74f1a-0d5a-46d5-9310-876a0b7f0307 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:31.557792 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-cf20043e-aaf3-40df-9add-f87951b44032 req-abe74f1a-0d5a-46d5-9310-876a0b7f0307 service nova] Creating event network-changed:b4a99c4e-af6c-4bd4-bdc0-d0c89b5dec6c for instance b5fa9733-f49b-43ab-8586-68d113b73476 on n-h1-862686-1 Oct 26 13:15:31.559371 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-cf20043e-aaf3-40df-9add-f87951b44032 req-abe74f1a-0d5a-46d5-9310-876a0b7f0307 service nova] Creating event network-changed:42f887f0-054f-4215-9647-53bc789b0ab4 for instance 7ee2d61f-352e-4762-aeec-9c2571e7e054 on n-h1-862686-1 Oct 26 13:15:31.560668 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-cf20043e-aaf3-40df-9add-f87951b44032 req-abe74f1a-0d5a-46d5-9310-876a0b7f0307 service nova] Creating event network-changed:3e876899-0ec1-4d6a-bf24-cae0a92e06ac for instance b5fa9733-f49b-43ab-8586-68d113b73476 on n-h1-862686-1 Oct 26 13:15:31.576821 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-cf20043e-aaf3-40df-9add-f87951b44032 req-abe74f1a-0d5a-46d5-9310-876a0b7f0307 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.065099 Oct 26 13:15:31.578665 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1522/3069] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:15:31.588686 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fe6f4c08-b4af-41e4-aac8-bfb6951fbcf9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:31.590763 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fe6f4c08-b4af-41e4-aac8-bfb6951fbcf9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 6668f03f-2108-4ade-88e9-d51f6e696338] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:31.618833 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe6f4c08-b4af-41e4-aac8-bfb6951fbcf9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:31.619694 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe6f4c08-b4af-41e4-aac8-bfb6951fbcf9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:31.621599 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe6f4c08-b4af-41e4-aac8-bfb6951fbcf9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:31.622668 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe6f4c08-b4af-41e4-aac8-bfb6951fbcf9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:31.623300 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe6f4c08-b4af-41e4-aac8-bfb6951fbcf9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:31.624229 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe6f4c08-b4af-41e4-aac8-bfb6951fbcf9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:31.785655 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a9434c0e-f438-43d5-8564-06d3400e6e77 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:31.798787 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a9434c0e-f438-43d5-8564-06d3400e6e77 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/424df7e6-aed0-42c5-9536-28db79dcc003" status: 200 len: 1508 microversion: 2.1 time: 0.366377 Oct 26 13:15:31.799559 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1548/3070] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:31 2022] GET /compute/v2.1/servers/424df7e6-aed0-42c5-9536-28db79dcc003 => generated 1508 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:31.808564 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-826fd3e3-3a6f-4d2e-8282-1f5ef7457771 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '.version_select at 0x7f6731b1f280>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:31.947528 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-826fd3e3-3a6f-4d2e-8282-1f5ef7457771 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups/5bf34b61-c952-454a-aed6-16b6535b4606" status: 200 len: 224 microversion: 2.1 time: 0.142780 Oct 26 13:15:31.948121 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1549/3071] 10.222.0.40 () {58 vars in 1269 bytes} [Wed Oct 26 13:15:31 2022] GET /compute/v2.1/os-security-groups/5bf34b61-c952-454a-aed6-16b6535b4606 => generated 224 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:15:31.953613 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fe565774-47fc-4987-a5cb-b4a4d98e3e77 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:31.954447 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fe565774-47fc-4987-a5cb-b4a4d98e3e77 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: a1dbfc30-8cbf-4a85-8847-a24031f5e3dc] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:31.967056 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fe565774-47fc-4987-a5cb-b4a4d98e3e77 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:31.970091 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fe565774-47fc-4987-a5cb-b4a4d98e3e77 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:31.970825 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fe565774-47fc-4987-a5cb-b4a4d98e3e77 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:31.974371 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fe565774-47fc-4987-a5cb-b4a4d98e3e77 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:31.974858 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fe565774-47fc-4987-a5cb-b4a4d98e3e77 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:31.975298 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fe565774-47fc-4987-a5cb-b4a4d98e3e77 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:32.267257 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fe565774-47fc-4987-a5cb-b4a4d98e3e77 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:32.291808 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fe565774-47fc-4987-a5cb-b4a4d98e3e77 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc" status: 200 len: 1515 microversion: 2.1 time: 0.341820 Oct 26 13:15:32.294772 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1550/3072] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:31 2022] GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc => generated 1515 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:32.303646 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5525c703-704a-4ab5-b669-408448455fed tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '.version_select at 0x7f6731ac9550>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:32.526954 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fe6f4c08-b4af-41e4-aac8-bfb6951fbcf9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:32.543654 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fe6f4c08-b4af-41e4-aac8-bfb6951fbcf9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/6668f03f-2108-4ade-88e9-d51f6e696338" status: 200 len: 1488 microversion: 2.1 time: 0.962564 Oct 26 13:15:32.543824 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1523/3073] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:31 2022] GET /compute/v2.1/servers/6668f03f-2108-4ade-88e9-d51f6e696338 => generated 1488 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:32.559297 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d60620af-bbcd-4cc4-b9eb-2d2fb66ebdd0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:32.560291 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d60620af-bbcd-4cc4-b9eb-2d2fb66ebdd0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:32.566998 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d60620af-bbcd-4cc4-b9eb-2d2fb66ebdd0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:32.567787 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d60620af-bbcd-4cc4-b9eb-2d2fb66ebdd0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:32.568439 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d60620af-bbcd-4cc4-b9eb-2d2fb66ebdd0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:32.570578 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d60620af-bbcd-4cc4-b9eb-2d2fb66ebdd0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:32.574092 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d60620af-bbcd-4cc4-b9eb-2d2fb66ebdd0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:32.574766 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d60620af-bbcd-4cc4-b9eb-2d2fb66ebdd0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:32.787785 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5525c703-704a-4ab5-b669-408448455fed tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/5bf34b61-c952-454a-aed6-16b6535b4606" status: 202 len: 0 microversion: 2.1 time: 0.490546 Oct 26 13:15:32.788365 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1551/3074] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 26 13:15:32 2022] DELETE /compute/v2.1/os-security-groups/5bf34b61-c952-454a-aed6-16b6535b4606 => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:15:32.796298 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ce21ee1e-0927-476f-bd4b-9617ada98ea3 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:32.797167 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ce21ee1e-0927-476f-bd4b-9617ada98ea3 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:32.815273 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce21ee1e-0927-476f-bd4b-9617ada98ea3 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:32.815803 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce21ee1e-0927-476f-bd4b-9617ada98ea3 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:32.816254 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce21ee1e-0927-476f-bd4b-9617ada98ea3 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:32.816997 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce21ee1e-0927-476f-bd4b-9617ada98ea3 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:32.817460 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce21ee1e-0927-476f-bd4b-9617ada98ea3 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:32.817932 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce21ee1e-0927-476f-bd4b-9617ada98ea3 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:33.091755 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d60620af-bbcd-4cc4-b9eb-2d2fb66ebdd0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:33.127047 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d60620af-bbcd-4cc4-b9eb-2d2fb66ebdd0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:33.128935 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d60620af-bbcd-4cc4-b9eb-2d2fb66ebdd0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:33.130370 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d60620af-bbcd-4cc4-b9eb-2d2fb66ebdd0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1879 microversion: 2.42 time: 0.585408 Oct 26 13:15:33.131648 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1524/3075] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:15:32 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1879 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:15:33.137157 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9fb2aedb-4631-464f-bb8a-595dbb5248f9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:33.159456 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9fb2aedb-4631-464f-bb8a-595dbb5248f9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: a15dcabd-f50e-41f3-a7df-6b26412222a9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:33.172799 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9fb2aedb-4631-464f-bb8a-595dbb5248f9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:33.179964 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9fb2aedb-4631-464f-bb8a-595dbb5248f9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:33.180726 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9fb2aedb-4631-464f-bb8a-595dbb5248f9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:33.188722 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9fb2aedb-4631-464f-bb8a-595dbb5248f9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:33.191170 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9fb2aedb-4631-464f-bb8a-595dbb5248f9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:33.191843 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9fb2aedb-4631-464f-bb8a-595dbb5248f9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:33.204217 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:15:33.510497 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ce21ee1e-0927-476f-bd4b-9617ada98ea3 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:33.531835 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ce21ee1e-0927-476f-bd4b-9617ada98ea3 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c" status: 200 len: 1717 microversion: 2.1 time: 0.741421 Oct 26 13:15:33.534677 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1552/3076] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:32 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c => generated 1717 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:33.556275 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-89351532-d677-48a6-8cf8-2383954f3d35 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '.version_select at 0x7f6731b08ee0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:33.632529 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9fb2aedb-4631-464f-bb8a-595dbb5248f9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:33.639431 n-d-862686-1 devstack@n-api.service[120597]: DEBUG neutronclient.v2_0.client [None req-89351532-d677-48a6-8cf8-2383954f3d35 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5bf34b61-c952-454a-aed6-16b6535b4606 does not exist", "detail": ""}} {{(pid=120597) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 26 13:15:33.640342 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.security_group_api [None req-89351532-d677-48a6-8cf8-2383954f3d35 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Neutron security group 5bf34b61-c952-454a-aed6-16b6535b4606 not found {{(pid=120597) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 26 13:15:33.641053 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-89351532-d677-48a6-8cf8-2383954f3d35 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] HTTP exception thrown: Security group 5bf34b61-c952-454a-aed6-16b6535b4606 does not exist Oct 26 13:15:33.641053 n-d-862686-1 devstack@n-api.service[120597]: Neutron server returns request_ids: ['req-d2715e53-6ae2-49a1-b464-cb21bd5c2c23'] Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-89351532-d677-48a6-8cf8-2383954f3d35 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Request method failure captured: Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/os-security-groups/5bf34b61-c952-454a-aed6-16b6535b4606 HTTP/1.1 Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTLZwemdkOoZmTGSmy6KZvPDtVHD2_E9ZUR49ovbPsQaFz77JmwG34xaymuHO8vYj9Nv7h8paBonBJqeJ-iGNHh66dW9zr2o-PVtLnq2ivVkvSk_ngG_K5FTR8-56OwV4JEOB5RsCmAZvvKkRYejOCKTdf6hjGlyGC2s57RFn_cJWHQ Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 875ebd1c99c746f7b4f1a3c08156e6a0 Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-SecurityGroupsTestJSON-256228496 Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/875ebd1c99c746f7b4f1a3c08156e6a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/875ebd1c99c746f7b4f1a3c08156e6a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_875ebd1c99c746f7b4f1a3c08156e6a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/875ebd1c99c746f7b4f1a3c08156e6a0"}]}] Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-SecurityGroupsTestJSON-256228496 Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 875ebd1c99c746f7b4f1a3c08156e6a0 Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-256228496 Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-SecurityGroupsTestJSON-256228496-project Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: a13285463ba34e89931d667bc327bb2a Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-SecurityGroupsTestJSON-256228496-project Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: method: Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: exception: Security group 5bf34b61-c952-454a-aed6-16b6535b4606 does not exist Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: Neutron server returns request_ids: ['req-d2715e53-6ae2-49a1-b464-cb21bd5c2c23'] Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '5bf34b61-c952-454a-aed6-16b6535b4606'} Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 26 13:15:33.643527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5bf34b61-c952-454a-aed6-16b6535b4606 does not exist Oct 26 13:15:33.648760 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2715e53-6ae2-49a1-b464-cb21bd5c2c23'] Oct 26 13:15:33.648760 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:15:33.648760 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:15:33.648760 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:15:33.648760 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:15:33.648760 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 26 13:15:33.648760 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 26 13:15:33.648760 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 26 13:15:33.648760 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 26 13:15:33.648760 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5bf34b61-c952-454a-aed6-16b6535b4606 does not exist Oct 26 13:15:33.648760 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2715e53-6ae2-49a1-b464-cb21bd5c2c23'] Oct 26 13:15:33.648760 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:15:33.648760 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:15:33.648760 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:15:33.648760 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:15:33.648760 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:15:33.648760 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:15:33.648760 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:15:33.648760 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:15:33.648760 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:15:33.648760 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:15:33.648760 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:15:33.648760 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:15:33.648760 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 26 13:15:33.648760 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 26 13:15:33.648760 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5bf34b61-c952-454a-aed6-16b6535b4606 does not exist Oct 26 13:15:33.648760 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2715e53-6ae2-49a1-b464-cb21bd5c2c23'] Oct 26 13:15:33.648760 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:15:33.648760 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:15:33.648760 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:15:33.648760 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:15:33.648760 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:15:33.648760 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:15:33.648760 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:15:33.648760 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:15:33.648760 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5bf34b61-c952-454a-aed6-16b6535b4606 does not exist Oct 26 13:15:33.648760 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2715e53-6ae2-49a1-b464-cb21bd5c2c23'] Oct 26 13:15:33.648760 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:15:33.651509 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9fb2aedb-4631-464f-bb8a-595dbb5248f9 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9" status: 200 len: 1488 microversion: 2.1 time: 0.515658 Oct 26 13:15:33.651509 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1525/3077] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:33 2022] GET /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9 => generated 1488 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:33.653086 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-89351532-d677-48a6-8cf8-2383954f3d35 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Returning 404 to user: Security group 5bf34b61-c952-454a-aed6-16b6535b4606 does not exist Oct 26 13:15:33.653086 n-d-862686-1 devstack@n-api.service[120597]: Neutron server returns request_ids: ['req-d2715e53-6ae2-49a1-b464-cb21bd5c2c23'] {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:15:33.654229 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-89351532-d677-48a6-8cf8-2383954f3d35 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups/5bf34b61-c952-454a-aed6-16b6535b4606" status: 404 len: 194 microversion: 2.1 time: 0.117162 Oct 26 13:15:33.655980 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-502c0a0e-a00e-42dc-ba2e-219cf5efa433 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:33.656602 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-502c0a0e-a00e-42dc-ba2e-219cf5efa433 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 424df7e6-aed0-42c5-9536-28db79dcc003] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:33.659173 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1553/3078] 10.222.0.40 () {58 vars in 1269 bytes} [Wed Oct 26 13:15:33 2022] GET /compute/v2.1/os-security-groups/5bf34b61-c952-454a-aed6-16b6535b4606 => generated 194 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:15:33.664071 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-87602099-dbca-4218-9c08-40f74f436a4d tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:33.665043 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-87602099-dbca-4218-9c08-40f74f436a4d tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: a1dbfc30-8cbf-4a85-8847-a24031f5e3dc] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:33.668703 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-502c0a0e-a00e-42dc-ba2e-219cf5efa433 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:33.669497 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-502c0a0e-a00e-42dc-ba2e-219cf5efa433 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:33.669960 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-502c0a0e-a00e-42dc-ba2e-219cf5efa433 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:33.670674 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-502c0a0e-a00e-42dc-ba2e-219cf5efa433 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:33.671356 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-502c0a0e-a00e-42dc-ba2e-219cf5efa433 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:33.671981 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-502c0a0e-a00e-42dc-ba2e-219cf5efa433 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:33.695224 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-87602099-dbca-4218-9c08-40f74f436a4d tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:33.696017 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-87602099-dbca-4218-9c08-40f74f436a4d tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:33.696662 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-87602099-dbca-4218-9c08-40f74f436a4d tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:33.700594 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-87602099-dbca-4218-9c08-40f74f436a4d tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:33.702097 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-87602099-dbca-4218-9c08-40f74f436a4d tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:33.704965 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-87602099-dbca-4218-9c08-40f74f436a4d tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:33.770908 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-502c0a0e-a00e-42dc-ba2e-219cf5efa433 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:33.773115 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-502c0a0e-a00e-42dc-ba2e-219cf5efa433 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:33.775356 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-502c0a0e-a00e-42dc-ba2e-219cf5efa433 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:33.778289 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-502c0a0e-a00e-42dc-ba2e-219cf5efa433 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lazy-loading 'fault' on Instance uuid 424df7e6-aed0-42c5-9536-28db79dcc003 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:15:33.883055 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-502c0a0e-a00e-42dc-ba2e-219cf5efa433 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:33.894748 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-502c0a0e-a00e-42dc-ba2e-219cf5efa433 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/424df7e6-aed0-42c5-9536-28db79dcc003" status: 200 len: 1305 microversion: 2.1 time: 0.243617 Oct 26 13:15:33.895341 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1526/3079] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:33 2022] GET /compute/v2.1/servers/424df7e6-aed0-42c5-9536-28db79dcc003 => generated 1305 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:33.922707 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-1914d830-64e8-4f34-a4f4-443c0c85b193 req-c7cb3df0-f257-4ec6-9ddd-7b5262d707c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "424df7e6-aed0-42c5-9536-28db79dcc003", "name": "network-vif-deleted", "tag": "bed86f43-2734-4595-b60c-4c47312165c5"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:15:33.987862 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-1914d830-64e8-4f34-a4f4-443c0c85b193 req-c7cb3df0-f257-4ec6-9ddd-7b5262d707c8 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:33.988354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-1914d830-64e8-4f34-a4f4-443c0c85b193 req-c7cb3df0-f257-4ec6-9ddd-7b5262d707c8 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:33.988802 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-1914d830-64e8-4f34-a4f4-443c0c85b193 req-c7cb3df0-f257-4ec6-9ddd-7b5262d707c8 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:34.023483 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-1914d830-64e8-4f34-a4f4-443c0c85b193 req-c7cb3df0-f257-4ec6-9ddd-7b5262d707c8 service nova] Creating event network-vif-deleted:bed86f43-2734-4595-b60c-4c47312165c5 for instance 424df7e6-aed0-42c5-9536-28db79dcc003 on n-h1-862686-1 Oct 26 13:15:34.042186 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-1914d830-64e8-4f34-a4f4-443c0c85b193 req-c7cb3df0-f257-4ec6-9ddd-7b5262d707c8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123055 Oct 26 13:15:34.043981 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1527/3080] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:15:34.051098 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8d62f019-ec7f-419d-93d8-083a171d1d62 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Action: 'create', calling method: .version_select at 0x7f6731936d30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-479054976", "description": "tempest-description-123252820"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:15:34.567636 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8d62f019-ec7f-419d-93d8-083a171d1d62 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.521899 Oct 26 13:15:34.568798 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1528/3081] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 26 13:15:34 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:15:34.574600 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f607d1cd-cd92-4f4e-ab28-cd7fc67d60e5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:34.575911 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f607d1cd-cd92-4f4e-ab28-cd7fc67d60e5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 6668f03f-2108-4ade-88e9-d51f6e696338] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:34.600380 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f607d1cd-cd92-4f4e-ab28-cd7fc67d60e5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:34.600878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f607d1cd-cd92-4f4e-ab28-cd7fc67d60e5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:34.601733 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f607d1cd-cd92-4f4e-ab28-cd7fc67d60e5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:34.602061 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f607d1cd-cd92-4f4e-ab28-cd7fc67d60e5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:34.606517 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f607d1cd-cd92-4f4e-ab28-cd7fc67d60e5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:34.607927 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f607d1cd-cd92-4f4e-ab28-cd7fc67d60e5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:34.972673 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-87602099-dbca-4218-9c08-40f74f436a4d tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:34.986608 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-87602099-dbca-4218-9c08-40f74f436a4d tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc" status: 200 len: 1515 microversion: 2.1 time: 1.326136 Oct 26 13:15:35.002611 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1554/3082] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:33 2022] GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc => generated 1515 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:35.019791 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-52b1d937-5b48-4ec4-8abc-b7c5c7915a15 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:35.021239 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-52b1d937-5b48-4ec4-8abc-b7c5c7915a15 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:35.029101 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52b1d937-5b48-4ec4-8abc-b7c5c7915a15 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:35.029988 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52b1d937-5b48-4ec4-8abc-b7c5c7915a15 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:35.030677 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52b1d937-5b48-4ec4-8abc-b7c5c7915a15 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:35.031630 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52b1d937-5b48-4ec4-8abc-b7c5c7915a15 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:35.032378 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52b1d937-5b48-4ec4-8abc-b7c5c7915a15 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:35.034405 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52b1d937-5b48-4ec4-8abc-b7c5c7915a15 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:35.293099 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-52b1d937-5b48-4ec4-8abc-b7c5c7915a15 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:35.304438 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f607d1cd-cd92-4f4e-ab28-cd7fc67d60e5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:35.307423 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-52b1d937-5b48-4ec4-8abc-b7c5c7915a15 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:35.312122 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-52b1d937-5b48-4ec4-8abc-b7c5c7915a15 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:35.319119 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-52b1d937-5b48-4ec4-8abc-b7c5c7915a15 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1879 microversion: 2.42 time: 0.309590 Oct 26 13:15:35.322328 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1555/3083] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:15:35 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1879 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:15:35.323417 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f607d1cd-cd92-4f4e-ab28-cd7fc67d60e5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/6668f03f-2108-4ade-88e9-d51f6e696338" status: 200 len: 1488 microversion: 2.1 time: 0.749345 Oct 26 13:15:35.341727 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1529/3084] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:34 2022] GET /compute/v2.1/servers/6668f03f-2108-4ade-88e9-d51f6e696338 => generated 1488 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:35.352125 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4010b3ca-b51b-40b5-9e01-180b71f20007 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Action: 'create', calling method: .version_select at 0x7f67368545e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1073439401", "description": "tempest-description-1381722467"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:15:35.353787 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9b0e3d63-c890-45dc-9f36-69e0ee3d45ec tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:35.355518 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9b0e3d63-c890-45dc-9f36-69e0ee3d45ec tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:35.372824 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9b0e3d63-c890-45dc-9f36-69e0ee3d45ec tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:35.373832 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9b0e3d63-c890-45dc-9f36-69e0ee3d45ec tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:35.375018 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9b0e3d63-c890-45dc-9f36-69e0ee3d45ec tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:35.376919 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9b0e3d63-c890-45dc-9f36-69e0ee3d45ec tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:35.378958 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9b0e3d63-c890-45dc-9f36-69e0ee3d45ec tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:35.379629 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9b0e3d63-c890-45dc-9f36-69e0ee3d45ec tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:35.875824 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9b0e3d63-c890-45dc-9f36-69e0ee3d45ec tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:35.913558 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9b0e3d63-c890-45dc-9f36-69e0ee3d45ec tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c" status: 200 len: 1717 microversion: 2.1 time: 0.584964 Oct 26 13:15:35.914859 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1556/3085] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:35 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c => generated 1717 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:35.937179 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4ed28fcb-4a36-4d6d-b5c4-6a9f7edeb815 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:35.938203 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4ed28fcb-4a36-4d6d-b5c4-6a9f7edeb815 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 424df7e6-aed0-42c5-9536-28db79dcc003] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:35.944650 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:15:35.946463 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4ed28fcb-4a36-4d6d-b5c4-6a9f7edeb815 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:35.947146 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4ed28fcb-4a36-4d6d-b5c4-6a9f7edeb815 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:35.948312 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4ed28fcb-4a36-4d6d-b5c4-6a9f7edeb815 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:35.951278 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4ed28fcb-4a36-4d6d-b5c4-6a9f7edeb815 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:35.952869 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4ed28fcb-4a36-4d6d-b5c4-6a9f7edeb815 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:35.954148 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4ed28fcb-4a36-4d6d-b5c4-6a9f7edeb815 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:35.980470 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4010b3ca-b51b-40b5-9e01-180b71f20007 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.653119 Oct 26 13:15:35.989761 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1530/3086] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 26 13:15:35 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:15:35.995351 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b111b3c6-fc7a-441a-ac2a-89c4159fc5dc tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:35.998521 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b111b3c6-fc7a-441a-ac2a-89c4159fc5dc tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 6668f03f-2108-4ade-88e9-d51f6e696338] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:36.035277 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b111b3c6-fc7a-441a-ac2a-89c4159fc5dc tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:36.036063 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b111b3c6-fc7a-441a-ac2a-89c4159fc5dc tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:36.036790 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b111b3c6-fc7a-441a-ac2a-89c4159fc5dc tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:36.037702 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b111b3c6-fc7a-441a-ac2a-89c4159fc5dc tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:36.038323 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b111b3c6-fc7a-441a-ac2a-89c4159fc5dc tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:36.038918 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b111b3c6-fc7a-441a-ac2a-89c4159fc5dc tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:36.070442 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-4ed28fcb-4a36-4d6d-b5c4-6a9f7edeb815 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] HTTP exception thrown: Instance 424df7e6-aed0-42c5-9536-28db79dcc003 could not be found. Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4ed28fcb-4a36-4d6d-b5c4-6a9f7edeb815 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Request method failure captured: Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/424df7e6-aed0-42c5-9536-28db79dcc003 HTTP/1.1 Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTLTNOlsUS_LQCwMyQbAmNSS-N_AQOqf9a-vHlBM4RS64aXMIGczutoYb0yXKXV63kqVyJMbrGhj1O0dIymI3rB4OYRTseWpFfzGHfB9PKKsR2NnI_ukYFvVdYRwcazuK9kTcZsmuh-2k9d7Yqn3gprd7n0NXcu2P16gbCixvzOdrAQ Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: ece49f83e645408598655bece0873fd0 Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ece49f83e645408598655bece0873fd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ece49f83e645408598655bece0873fd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ece49f83e645408598655bece0873fd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ece49f83e645408598655bece0873fd0"}]}] Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: ece49f83e645408598655bece0873fd0 Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-DeleteServersTestJSON-1847538505-project Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 8d56acbbbc3545d19cbb80f4e349c763 Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-DeleteServersTestJSON-1847538505-project Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 424df7e6-aed0-42c5-9536-28db79dcc003 could not be found. Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '424df7e6-aed0-42c5-9536-28db79dcc003'} Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 424df7e6-aed0-42c5-9536-28db79dcc003 could not be found. Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 424df7e6-aed0-42c5-9536-28db79dcc003 could not be found. Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:15:36.072047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:15:36.077777 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:15:36.077777 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:15:36.077777 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:15:36.077777 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:15:36.077777 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:15:36.077777 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 424df7e6-aed0-42c5-9536-28db79dcc003 could not be found. Oct 26 13:15:36.077777 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:15:36.077777 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4ed28fcb-4a36-4d6d-b5c4-6a9f7edeb815 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Returning 404 to user: Instance 424df7e6-aed0-42c5-9536-28db79dcc003 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:15:36.077777 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4ed28fcb-4a36-4d6d-b5c4-6a9f7edeb815 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/424df7e6-aed0-42c5-9536-28db79dcc003" status: 404 len: 111 microversion: 2.1 time: 0.145546 Oct 26 13:15:36.080386 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1557/3087] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:35 2022] GET /compute/v2.1/servers/424df7e6-aed0-42c5-9536-28db79dcc003 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:15:36.087072 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b111b3c6-fc7a-441a-ac2a-89c4159fc5dc tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 6668f03f-2108-4ade-88e9-d51f6e696338] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:15:36.097436 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0e4484f4-d48d-4104-97cc-c60f5a011a78 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Action: 'create', calling method: .version_select at 0x7f67326ed8b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1366453154", "description": "tempest-description-1302315576"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:15:36.254968 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b111b3c6-fc7a-441a-ac2a-89c4159fc5dc tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6668f03f-2108-4ade-88e9-d51f6e696338" status: 204 len: 0 microversion: 2.1 time: 0.262013 Oct 26 13:15:36.256035 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1531/3088] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:15:35 2022] DELETE /compute/v2.1/servers/6668f03f-2108-4ade-88e9-d51f6e696338 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:15:36.272845 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9ca3b6fb-b450-4046-9e1d-34646f34282e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:36.274191 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9ca3b6fb-b450-4046-9e1d-34646f34282e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: a1dbfc30-8cbf-4a85-8847-a24031f5e3dc] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:36.288745 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9ca3b6fb-b450-4046-9e1d-34646f34282e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:36.290101 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9ca3b6fb-b450-4046-9e1d-34646f34282e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:36.291752 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9ca3b6fb-b450-4046-9e1d-34646f34282e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:36.298239 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9ca3b6fb-b450-4046-9e1d-34646f34282e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:36.300401 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9ca3b6fb-b450-4046-9e1d-34646f34282e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:36.301042 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9ca3b6fb-b450-4046-9e1d-34646f34282e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:36.604734 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9ca3b6fb-b450-4046-9e1d-34646f34282e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:36.617401 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9ca3b6fb-b450-4046-9e1d-34646f34282e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc" status: 200 len: 1521 microversion: 2.1 time: 0.358506 Oct 26 13:15:36.624247 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1532/3089] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:36 2022] GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc => generated 1521 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:36.635979 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-97e2b167-5696-49cd-bfa1-49a61471fda7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:36.637180 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-97e2b167-5696-49cd-bfa1-49a61471fda7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 6668f03f-2108-4ade-88e9-d51f6e696338] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:36.655186 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97e2b167-5696-49cd-bfa1-49a61471fda7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:36.655999 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97e2b167-5696-49cd-bfa1-49a61471fda7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:36.656601 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97e2b167-5696-49cd-bfa1-49a61471fda7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:36.657517 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97e2b167-5696-49cd-bfa1-49a61471fda7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:36.658138 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97e2b167-5696-49cd-bfa1-49a61471fda7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:36.658729 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97e2b167-5696-49cd-bfa1-49a61471fda7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:36.980763 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-97e2b167-5696-49cd-bfa1-49a61471fda7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:37.018470 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-97e2b167-5696-49cd-bfa1-49a61471fda7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/6668f03f-2108-4ade-88e9-d51f6e696338" status: 200 len: 1494 microversion: 2.1 time: 0.390055 Oct 26 13:15:37.023280 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1533/3090] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:36 2022] GET /compute/v2.1/servers/6668f03f-2108-4ade-88e9-d51f6e696338 => generated 1494 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:37.051738 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-335bfd7b-0382-400d-ab38-ca916d890fe0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1648436485", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "cb59e2c8-6bcb-4fcf-b9e4-c01412b43c60"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:15:37.059391 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0e4484f4-d48d-4104-97cc-c60f5a011a78 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.973164 Oct 26 13:15:37.060069 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1558/3091] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 26 13:15:36 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:15:37.064694 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9e9ddb2c-acf3-4898-aaf1-e2e76d0628c6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:37.065309 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9e9ddb2c-acf3-4898-aaf1-e2e76d0628c6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:37.081938 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9e9ddb2c-acf3-4898-aaf1-e2e76d0628c6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:37.082528 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9e9ddb2c-acf3-4898-aaf1-e2e76d0628c6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:37.082865 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9e9ddb2c-acf3-4898-aaf1-e2e76d0628c6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:37.083581 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9e9ddb2c-acf3-4898-aaf1-e2e76d0628c6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:37.084043 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9e9ddb2c-acf3-4898-aaf1-e2e76d0628c6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:37.084473 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9e9ddb2c-acf3-4898-aaf1-e2e76d0628c6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:37.175914 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-335bfd7b-0382-400d-ab38-ca916d890fe0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] validate_networks() for [('cb59e2c8-6bcb-4fcf-b9e4-c01412b43c60', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:15:37.393516 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9e9ddb2c-acf3-4898-aaf1-e2e76d0628c6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:37.421368 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9e9ddb2c-acf3-4898-aaf1-e2e76d0628c6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:37.423348 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9e9ddb2c-acf3-4898-aaf1-e2e76d0628c6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:37.425863 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9e9ddb2c-acf3-4898-aaf1-e2e76d0628c6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1879 microversion: 2.42 time: 0.364445 Oct 26 13:15:37.427363 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1559/3092] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:15:37 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1879 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:15:37.434451 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2ecdb9db-98d6-4db4-8d1e-8c190b8de555 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:37.435460 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2ecdb9db-98d6-4db4-8d1e-8c190b8de555 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:37.449334 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ecdb9db-98d6-4db4-8d1e-8c190b8de555 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:37.455054 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ecdb9db-98d6-4db4-8d1e-8c190b8de555 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:37.455797 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ecdb9db-98d6-4db4-8d1e-8c190b8de555 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:37.457405 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ecdb9db-98d6-4db4-8d1e-8c190b8de555 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:37.458222 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ecdb9db-98d6-4db4-8d1e-8c190b8de555 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:37.459064 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ecdb9db-98d6-4db4-8d1e-8c190b8de555 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:37.627346 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2ecdb9db-98d6-4db4-8d1e-8c190b8de555 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:37.637475 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2ecdb9db-98d6-4db4-8d1e-8c190b8de555 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c" status: 200 len: 1717 microversion: 2.1 time: 0.208637 Oct 26 13:15:37.639021 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1560/3093] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:37 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c => generated 1717 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:37.644799 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dde6af07-0437-4038-8f50-0ff0166e15d1 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '.version_select at 0x7f67320ca280>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:38.012607 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-dde6af07-0437-4038-8f50-0ff0166e15d1 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups" status: 200 len: 1834 microversion: 2.1 time: 0.372249 Oct 26 13:15:38.013418 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1561/3094] 10.222.0.40 () {58 vars in 1158 bytes} [Wed Oct 26 13:15:37 2022] GET /compute/v2.1/os-security-groups => generated 1834 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:38.018020 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2df67589-a5fe-47f2-a755-9770ad64ced9 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:38.018809 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2df67589-a5fe-47f2-a755-9770ad64ced9 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: a1dbfc30-8cbf-4a85-8847-a24031f5e3dc] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:38.031714 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2df67589-a5fe-47f2-a755-9770ad64ced9 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:38.032392 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2df67589-a5fe-47f2-a755-9770ad64ced9 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:38.033635 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2df67589-a5fe-47f2-a755-9770ad64ced9 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:38.034465 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2df67589-a5fe-47f2-a755-9770ad64ced9 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:38.035190 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2df67589-a5fe-47f2-a755-9770ad64ced9 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:38.035888 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2df67589-a5fe-47f2-a755-9770ad64ced9 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:38.305090 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2df67589-a5fe-47f2-a755-9770ad64ced9 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:38.317993 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2df67589-a5fe-47f2-a755-9770ad64ced9 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc" status: 200 len: 1521 microversion: 2.1 time: 0.303657 Oct 26 13:15:38.320081 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1562/3095] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:38 2022] GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc => generated 1521 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:38.331472 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3c5a1ffc-e655-42af-bf8a-8a63c9be572e tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '.version_select at 0x7f67320ca3a0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:38.439828 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-335bfd7b-0382-400d-ab38-ca916d890fe0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:15:38.441856 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-335bfd7b-0382-400d-ab38-ca916d890fe0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:15:38.442830 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-335bfd7b-0382-400d-ab38-ca916d890fe0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:15:38.443875 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-335bfd7b-0382-400d-ab38-ca916d890fe0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:15:38.444467 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-335bfd7b-0382-400d-ab38-ca916d890fe0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:15:38.471405 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-335bfd7b-0382-400d-ab38-ca916d890fe0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:38.472309 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-335bfd7b-0382-400d-ab38-ca916d890fe0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:38.472905 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-335bfd7b-0382-400d-ab38-ca916d890fe0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:38.474103 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-335bfd7b-0382-400d-ab38-ca916d890fe0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:38.474726 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-335bfd7b-0382-400d-ab38-ca916d890fe0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:38.475459 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-335bfd7b-0382-400d-ab38-ca916d890fe0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:38.499151 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-335bfd7b-0382-400d-ab38-ca916d890fe0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Getting quotas for project ece49f83e645408598655bece0873fd0. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:15:38.506145 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-335bfd7b-0382-400d-ab38-ca916d890fe0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Getting quotas for user 8d56acbbbc3545d19cbb80f4e349c763 and project ece49f83e645408598655bece0873fd0. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:15:38.522184 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-335bfd7b-0382-400d-ab38-ca916d890fe0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:15:38.525195 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-335bfd7b-0382-400d-ab38-ca916d890fe0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: d0b8440f-677e-428d-8566-29fe4624fce1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:15:38.618356 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-335bfd7b-0382-400d-ab38-ca916d890fe0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.593641 Oct 26 13:15:38.625704 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1534/3096] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:15:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:15:38.631915 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6cf7810e-5093-4d38-95dc-d5d7702e65e1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:38.632835 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6cf7810e-5093-4d38-95dc-d5d7702e65e1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 6668f03f-2108-4ade-88e9-d51f6e696338] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:38.675398 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6cf7810e-5093-4d38-95dc-d5d7702e65e1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:38.690188 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6cf7810e-5093-4d38-95dc-d5d7702e65e1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:38.691879 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6cf7810e-5093-4d38-95dc-d5d7702e65e1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:38.695814 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6cf7810e-5093-4d38-95dc-d5d7702e65e1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:38.700324 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6cf7810e-5093-4d38-95dc-d5d7702e65e1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:38.707465 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6cf7810e-5093-4d38-95dc-d5d7702e65e1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:38.968069 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6cf7810e-5093-4d38-95dc-d5d7702e65e1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:38.976905 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6cf7810e-5093-4d38-95dc-d5d7702e65e1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/6668f03f-2108-4ade-88e9-d51f6e696338" status: 200 len: 1494 microversion: 2.1 time: 0.349161 Oct 26 13:15:38.981380 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1535/3097] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:38 2022] GET /compute/v2.1/servers/6668f03f-2108-4ade-88e9-d51f6e696338 => generated 1494 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:38.987793 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6cd1ef8c-b47f-498f-bf34-e16dd3be6e28 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:38.989788 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6cd1ef8c-b47f-498f-bf34-e16dd3be6e28 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:39.006125 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6cd1ef8c-b47f-498f-bf34-e16dd3be6e28 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:39.006627 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6cd1ef8c-b47f-498f-bf34-e16dd3be6e28 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:39.008245 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6cd1ef8c-b47f-498f-bf34-e16dd3be6e28 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:39.012921 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6cd1ef8c-b47f-498f-bf34-e16dd3be6e28 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:39.013458 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6cd1ef8c-b47f-498f-bf34-e16dd3be6e28 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:39.013933 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6cd1ef8c-b47f-498f-bf34-e16dd3be6e28 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:39.444284 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3c5a1ffc-e655-42af-bf8a-8a63c9be572e tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/9089c470-5a1d-4576-bb55-2c2818b7fff7" status: 202 len: 0 microversion: 2.1 time: 1.120100 Oct 26 13:15:39.445926 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1563/3098] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 26 13:15:38 2022] DELETE /compute/v2.1/os-security-groups/9089c470-5a1d-4576-bb55-2c2818b7fff7 => generated 0 bytes in 1124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:15:39.454100 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b592d270-d802-4eb5-ae64-73ff03a66435 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:39.455321 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b592d270-d802-4eb5-ae64-73ff03a66435 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: d0b8440f-677e-428d-8566-29fe4624fce1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:39.669454 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6cd1ef8c-b47f-498f-bf34-e16dd3be6e28 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:39.697581 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6cd1ef8c-b47f-498f-bf34-e16dd3be6e28 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:39.707518 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6cd1ef8c-b47f-498f-bf34-e16dd3be6e28 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:39.712302 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6cd1ef8c-b47f-498f-bf34-e16dd3be6e28 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1879 microversion: 2.42 time: 0.729679 Oct 26 13:15:39.720214 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1536/3099] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:15:38 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1879 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:15:39.722110 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b592d270-d802-4eb5-ae64-73ff03a66435 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:39.731038 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b592d270-d802-4eb5-ae64-73ff03a66435 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1" status: 200 len: 1215 microversion: 2.1 time: 0.282485 Oct 26 13:15:39.737634 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1564/3100] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:39 2022] GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1 => generated 1215 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:39.742707 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d5101b0f-d7fe-4b43-8163-eb0b2db76598 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:39.751395 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d5101b0f-d7fe-4b43-8163-eb0b2db76598 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: a1dbfc30-8cbf-4a85-8847-a24031f5e3dc] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:39.763839 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d5101b0f-d7fe-4b43-8163-eb0b2db76598 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:39.764365 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d5101b0f-d7fe-4b43-8163-eb0b2db76598 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:39.764939 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d5101b0f-d7fe-4b43-8163-eb0b2db76598 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:39.765718 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d5101b0f-d7fe-4b43-8163-eb0b2db76598 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:39.772813 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a2503436-8955-4cfd-bcc3-2b35b142be47 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:39.773784 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d5101b0f-d7fe-4b43-8163-eb0b2db76598 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:39.774300 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d5101b0f-d7fe-4b43-8163-eb0b2db76598 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:39.775151 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a2503436-8955-4cfd-bcc3-2b35b142be47 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:39.783426 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a2503436-8955-4cfd-bcc3-2b35b142be47 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:39.784156 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a2503436-8955-4cfd-bcc3-2b35b142be47 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:39.784808 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a2503436-8955-4cfd-bcc3-2b35b142be47 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:39.785850 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a2503436-8955-4cfd-bcc3-2b35b142be47 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:39.786473 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a2503436-8955-4cfd-bcc3-2b35b142be47 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:39.787080 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a2503436-8955-4cfd-bcc3-2b35b142be47 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:40.374450 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a2503436-8955-4cfd-bcc3-2b35b142be47 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:40.389358 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a2503436-8955-4cfd-bcc3-2b35b142be47 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c" status: 200 len: 1717 microversion: 2.1 time: 0.667564 Oct 26 13:15:40.390004 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1537/3101] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:39 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c => generated 1717 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:40.399040 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-35cb0c8c-8aa3-49d2-b12c-06d9f3a5e2f7 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '.version_select at 0x7f6736904e50>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:40.474020 n-d-862686-1 devstack@n-api.service[120598]: DEBUG neutronclient.v2_0.client [None req-35cb0c8c-8aa3-49d2-b12c-06d9f3a5e2f7 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9089c470-5a1d-4576-bb55-2c2818b7fff7 does not exist", "detail": ""}} {{(pid=120598) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 26 13:15:40.475955 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.security_group_api [None req-35cb0c8c-8aa3-49d2-b12c-06d9f3a5e2f7 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Neutron security group 9089c470-5a1d-4576-bb55-2c2818b7fff7 not found {{(pid=120598) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 26 13:15:40.477132 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-35cb0c8c-8aa3-49d2-b12c-06d9f3a5e2f7 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] HTTP exception thrown: Security group 9089c470-5a1d-4576-bb55-2c2818b7fff7 does not exist Oct 26 13:15:40.477132 n-d-862686-1 devstack@n-api.service[120598]: Neutron server returns request_ids: ['req-0e739724-1e7e-4441-b849-ee1f87a82791'] Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-35cb0c8c-8aa3-49d2-b12c-06d9f3a5e2f7 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Request method failure captured: Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/os-security-groups/9089c470-5a1d-4576-bb55-2c2818b7fff7 HTTP/1.1 Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTLZwemdkOoZmTGSmy6KZvPDtVHD2_E9ZUR49ovbPsQaFz77JmwG34xaymuHO8vYj9Nv7h8paBonBJqeJ-iGNHh66dW9zr2o-PVtLnq2ivVkvSk_ngG_K5FTR8-56OwV4JEOB5RsCmAZvvKkRYejOCKTdf6hjGlyGC2s57RFn_cJWHQ Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 875ebd1c99c746f7b4f1a3c08156e6a0 Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-SecurityGroupsTestJSON-256228496 Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/875ebd1c99c746f7b4f1a3c08156e6a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/875ebd1c99c746f7b4f1a3c08156e6a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_875ebd1c99c746f7b4f1a3c08156e6a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/875ebd1c99c746f7b4f1a3c08156e6a0"}]}] Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-SecurityGroupsTestJSON-256228496 Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 875ebd1c99c746f7b4f1a3c08156e6a0 Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-256228496 Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-SecurityGroupsTestJSON-256228496-project Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: a13285463ba34e89931d667bc327bb2a Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-SecurityGroupsTestJSON-256228496-project Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: exception: Security group 9089c470-5a1d-4576-bb55-2c2818b7fff7 does not exist Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: Neutron server returns request_ids: ['req-0e739724-1e7e-4441-b849-ee1f87a82791'] Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '9089c470-5a1d-4576-bb55-2c2818b7fff7'} Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 26 13:15:40.481170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9089c470-5a1d-4576-bb55-2c2818b7fff7 does not exist Oct 26 13:15:40.485401 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0e739724-1e7e-4441-b849-ee1f87a82791'] Oct 26 13:15:40.485401 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:15:40.485401 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:15:40.485401 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:15:40.485401 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:15:40.485401 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 26 13:15:40.485401 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 26 13:15:40.485401 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 26 13:15:40.485401 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 26 13:15:40.485401 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9089c470-5a1d-4576-bb55-2c2818b7fff7 does not exist Oct 26 13:15:40.485401 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0e739724-1e7e-4441-b849-ee1f87a82791'] Oct 26 13:15:40.485401 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:15:40.485401 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:15:40.485401 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:15:40.485401 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:15:40.485401 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:15:40.485401 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:15:40.485401 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:15:40.485401 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:15:40.485401 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:15:40.485401 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:15:40.485401 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:15:40.485401 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:15:40.485401 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 26 13:15:40.485401 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 26 13:15:40.485401 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9089c470-5a1d-4576-bb55-2c2818b7fff7 does not exist Oct 26 13:15:40.485401 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0e739724-1e7e-4441-b849-ee1f87a82791'] Oct 26 13:15:40.485401 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:15:40.485401 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:15:40.485401 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:15:40.485401 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:15:40.485401 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:15:40.485401 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:15:40.485401 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:15:40.485401 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:15:40.485401 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9089c470-5a1d-4576-bb55-2c2818b7fff7 does not exist Oct 26 13:15:40.485401 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0e739724-1e7e-4441-b849-ee1f87a82791'] Oct 26 13:15:40.485401 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:15:40.490709 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-35cb0c8c-8aa3-49d2-b12c-06d9f3a5e2f7 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Returning 404 to user: Security group 9089c470-5a1d-4576-bb55-2c2818b7fff7 does not exist Oct 26 13:15:40.490709 n-d-862686-1 devstack@n-api.service[120598]: Neutron server returns request_ids: ['req-0e739724-1e7e-4441-b849-ee1f87a82791'] {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:15:40.491185 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-35cb0c8c-8aa3-49d2-b12c-06d9f3a5e2f7 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups/9089c470-5a1d-4576-bb55-2c2818b7fff7" status: 404 len: 194 microversion: 2.1 time: 0.096288 Oct 26 13:15:40.491813 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1538/3102] 10.222.0.40 () {58 vars in 1269 bytes} [Wed Oct 26 13:15:40 2022] GET /compute/v2.1/os-security-groups/9089c470-5a1d-4576-bb55-2c2818b7fff7 => generated 194 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:15:40.502790 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-18826ef0-80a5-4b7f-a687-489e5ba6a254 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:40.505613 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-18826ef0-80a5-4b7f-a687-489e5ba6a254 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 6668f03f-2108-4ade-88e9-d51f6e696338] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:40.514101 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18826ef0-80a5-4b7f-a687-489e5ba6a254 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:40.517791 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18826ef0-80a5-4b7f-a687-489e5ba6a254 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:40.518829 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18826ef0-80a5-4b7f-a687-489e5ba6a254 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:40.519680 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18826ef0-80a5-4b7f-a687-489e5ba6a254 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:40.520259 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18826ef0-80a5-4b7f-a687-489e5ba6a254 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:40.521046 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18826ef0-80a5-4b7f-a687-489e5ba6a254 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:40.793888 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d5101b0f-d7fe-4b43-8163-eb0b2db76598 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:40.804123 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d5101b0f-d7fe-4b43-8163-eb0b2db76598 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc" status: 200 len: 1521 microversion: 2.1 time: 1.064964 Oct 26 13:15:40.806012 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1565/3103] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:39 2022] GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc => generated 1521 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:40.812169 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ef76fca5-8d43-408a-a815-9d084306ecdd tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '.version_select at 0x7f6732b4b0d0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:40.847278 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-18826ef0-80a5-4b7f-a687-489e5ba6a254 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:40.860500 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-18826ef0-80a5-4b7f-a687-489e5ba6a254 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/6668f03f-2108-4ade-88e9-d51f6e696338" status: 200 len: 1494 microversion: 2.1 time: 0.367531 Oct 26 13:15:40.861097 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1539/3104] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:40 2022] GET /compute/v2.1/servers/6668f03f-2108-4ade-88e9-d51f6e696338 => generated 1494 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:40.877917 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-24f2f24c-f0b3-42c8-961e-a82d0063aa74 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:40.878897 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-24f2f24c-f0b3-42c8-961e-a82d0063aa74 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:40.893059 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24f2f24c-f0b3-42c8-961e-a82d0063aa74 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:40.893884 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24f2f24c-f0b3-42c8-961e-a82d0063aa74 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:40.894506 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24f2f24c-f0b3-42c8-961e-a82d0063aa74 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:40.895644 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24f2f24c-f0b3-42c8-961e-a82d0063aa74 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:40.899631 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24f2f24c-f0b3-42c8-961e-a82d0063aa74 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:40.900085 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24f2f24c-f0b3-42c8-961e-a82d0063aa74 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:41.501721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-24f2f24c-f0b3-42c8-961e-a82d0063aa74 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:41.520163 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-24f2f24c-f0b3-42c8-961e-a82d0063aa74 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:41.526077 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-24f2f24c-f0b3-42c8-961e-a82d0063aa74 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:41.528514 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-24f2f24c-f0b3-42c8-961e-a82d0063aa74 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1879 microversion: 2.42 time: 0.666431 Oct 26 13:15:41.535143 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1540/3105] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:15:40 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1879 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:15:41.578350 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c366517c-c4ae-4f64-8cb7-3de371fb8929 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:41.580428 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c366517c-c4ae-4f64-8cb7-3de371fb8929 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: d0b8440f-677e-428d-8566-29fe4624fce1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:41.630706 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:15:41.633883 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c366517c-c4ae-4f64-8cb7-3de371fb8929 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:41.637918 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c366517c-c4ae-4f64-8cb7-3de371fb8929 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:41.640131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c366517c-c4ae-4f64-8cb7-3de371fb8929 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:41.641051 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c366517c-c4ae-4f64-8cb7-3de371fb8929 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:41.643386 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c366517c-c4ae-4f64-8cb7-3de371fb8929 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:41.644763 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c366517c-c4ae-4f64-8cb7-3de371fb8929 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:41.734703 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ef76fca5-8d43-408a-a815-9d084306ecdd tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/fe5c0a02-8552-47ff-9db7-f09c2aa42c10" status: 202 len: 0 microversion: 2.1 time: 0.927161 Oct 26 13:15:41.735285 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1566/3106] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 26 13:15:40 2022] DELETE /compute/v2.1/os-security-groups/fe5c0a02-8552-47ff-9db7-f09c2aa42c10 => generated 0 bytes in 929 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:15:41.740597 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4238f2a9-b090-4ed8-9df4-a132870e32f4 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:41.741425 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4238f2a9-b090-4ed8-9df4-a132870e32f4 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:41.762085 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4238f2a9-b090-4ed8-9df4-a132870e32f4 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:41.762674 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4238f2a9-b090-4ed8-9df4-a132870e32f4 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:41.763004 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4238f2a9-b090-4ed8-9df4-a132870e32f4 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:41.763717 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4238f2a9-b090-4ed8-9df4-a132870e32f4 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:41.764178 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4238f2a9-b090-4ed8-9df4-a132870e32f4 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:41.764600 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4238f2a9-b090-4ed8-9df4-a132870e32f4 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:41.808804 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c366517c-c4ae-4f64-8cb7-3de371fb8929 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:41.822518 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c366517c-c4ae-4f64-8cb7-3de371fb8929 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1" status: 200 len: 1273 microversion: 2.1 time: 0.286063 Oct 26 13:15:41.823102 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1541/3107] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:41 2022] GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1 => generated 1273 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:41.833624 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-aeb82ec7-0c01-49ca-a33c-9adb128f02ec req-2e41401d-2de3-4acb-ad49-7914386a9ef4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6668f03f-2108-4ade-88e9-d51f6e696338", "name": "network-vif-deleted", "tag": "0ec524f1-818c-446c-8559-2f6a15d3170f"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:15:41.848315 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-aeb82ec7-0c01-49ca-a33c-9adb128f02ec req-2e41401d-2de3-4acb-ad49-7914386a9ef4 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:41.849558 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-aeb82ec7-0c01-49ca-a33c-9adb128f02ec req-2e41401d-2de3-4acb-ad49-7914386a9ef4 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:41.850468 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-aeb82ec7-0c01-49ca-a33c-9adb128f02ec req-2e41401d-2de3-4acb-ad49-7914386a9ef4 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:41.867198 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-aeb82ec7-0c01-49ca-a33c-9adb128f02ec req-2e41401d-2de3-4acb-ad49-7914386a9ef4 service nova] Creating event network-vif-deleted:0ec524f1-818c-446c-8559-2f6a15d3170f for instance 6668f03f-2108-4ade-88e9-d51f6e696338 on n-h2-862686-1 Oct 26 13:15:41.881814 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-aeb82ec7-0c01-49ca-a33c-9adb128f02ec req-2e41401d-2de3-4acb-ad49-7914386a9ef4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057168 Oct 26 13:15:41.883028 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1542/3108] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:15:41.889095 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cd5a22cf-25d4-4e83-8e0c-e25981dcfb66 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '.version_select at 0x7f67323f7790>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:41.965747 n-d-862686-1 devstack@n-api.service[120598]: DEBUG neutronclient.v2_0.client [None req-cd5a22cf-25d4-4e83-8e0c-e25981dcfb66 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group fe5c0a02-8552-47ff-9db7-f09c2aa42c10 does not exist", "detail": ""}} {{(pid=120598) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 26 13:15:41.967854 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.security_group_api [None req-cd5a22cf-25d4-4e83-8e0c-e25981dcfb66 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Neutron security group fe5c0a02-8552-47ff-9db7-f09c2aa42c10 not found {{(pid=120598) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 26 13:15:41.968607 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-cd5a22cf-25d4-4e83-8e0c-e25981dcfb66 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] HTTP exception thrown: Security group fe5c0a02-8552-47ff-9db7-f09c2aa42c10 does not exist Oct 26 13:15:41.968607 n-d-862686-1 devstack@n-api.service[120598]: Neutron server returns request_ids: ['req-64d0c677-dda0-4a47-ac10-20ccd8c7b4f3'] Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cd5a22cf-25d4-4e83-8e0c-e25981dcfb66 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Request method failure captured: Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/os-security-groups/fe5c0a02-8552-47ff-9db7-f09c2aa42c10 HTTP/1.1 Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTLZwemdkOoZmTGSmy6KZvPDtVHD2_E9ZUR49ovbPsQaFz77JmwG34xaymuHO8vYj9Nv7h8paBonBJqeJ-iGNHh66dW9zr2o-PVtLnq2ivVkvSk_ngG_K5FTR8-56OwV4JEOB5RsCmAZvvKkRYejOCKTdf6hjGlyGC2s57RFn_cJWHQ Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 875ebd1c99c746f7b4f1a3c08156e6a0 Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-SecurityGroupsTestJSON-256228496 Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/875ebd1c99c746f7b4f1a3c08156e6a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/875ebd1c99c746f7b4f1a3c08156e6a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_875ebd1c99c746f7b4f1a3c08156e6a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/875ebd1c99c746f7b4f1a3c08156e6a0"}]}] Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-SecurityGroupsTestJSON-256228496 Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 875ebd1c99c746f7b4f1a3c08156e6a0 Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-256228496 Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-SecurityGroupsTestJSON-256228496-project Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: a13285463ba34e89931d667bc327bb2a Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-SecurityGroupsTestJSON-256228496-project Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: exception: Security group fe5c0a02-8552-47ff-9db7-f09c2aa42c10 does not exist Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: Neutron server returns request_ids: ['req-64d0c677-dda0-4a47-ac10-20ccd8c7b4f3'] Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'fe5c0a02-8552-47ff-9db7-f09c2aa42c10'} Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 26 13:15:41.972048 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group fe5c0a02-8552-47ff-9db7-f09c2aa42c10 does not exist Oct 26 13:15:41.976392 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-64d0c677-dda0-4a47-ac10-20ccd8c7b4f3'] Oct 26 13:15:41.976392 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:15:41.976392 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:15:41.976392 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:15:41.976392 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:15:41.976392 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 26 13:15:41.976392 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 26 13:15:41.976392 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 26 13:15:41.976392 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 26 13:15:41.976392 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group fe5c0a02-8552-47ff-9db7-f09c2aa42c10 does not exist Oct 26 13:15:41.976392 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-64d0c677-dda0-4a47-ac10-20ccd8c7b4f3'] Oct 26 13:15:41.976392 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:15:41.976392 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:15:41.976392 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:15:41.976392 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:15:41.976392 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:15:41.976392 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:15:41.976392 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:15:41.976392 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:15:41.976392 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:15:41.976392 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:15:41.976392 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:15:41.976392 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:15:41.976392 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 26 13:15:41.976392 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 26 13:15:41.976392 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group fe5c0a02-8552-47ff-9db7-f09c2aa42c10 does not exist Oct 26 13:15:41.976392 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-64d0c677-dda0-4a47-ac10-20ccd8c7b4f3'] Oct 26 13:15:41.976392 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:15:41.976392 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:15:41.976392 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:15:41.976392 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:15:41.976392 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:15:41.976392 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:15:41.976392 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:15:41.976392 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:15:41.976392 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group fe5c0a02-8552-47ff-9db7-f09c2aa42c10 does not exist Oct 26 13:15:41.976392 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-64d0c677-dda0-4a47-ac10-20ccd8c7b4f3'] Oct 26 13:15:41.976392 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:15:41.981003 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cd5a22cf-25d4-4e83-8e0c-e25981dcfb66 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Returning 404 to user: Security group fe5c0a02-8552-47ff-9db7-f09c2aa42c10 does not exist Oct 26 13:15:41.981003 n-d-862686-1 devstack@n-api.service[120598]: Neutron server returns request_ids: ['req-64d0c677-dda0-4a47-ac10-20ccd8c7b4f3'] {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:15:41.982311 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cd5a22cf-25d4-4e83-8e0c-e25981dcfb66 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups/fe5c0a02-8552-47ff-9db7-f09c2aa42c10" status: 404 len: 194 microversion: 2.1 time: 0.097777 Oct 26 13:15:41.983332 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1543/3109] 10.222.0.40 () {58 vars in 1269 bytes} [Wed Oct 26 13:15:41 2022] GET /compute/v2.1/os-security-groups/fe5c0a02-8552-47ff-9db7-f09c2aa42c10 => generated 194 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:15:41.992870 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-384e4974-3500-4af6-b8d8-04e5222cced9 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:41.997590 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-384e4974-3500-4af6-b8d8-04e5222cced9 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: a1dbfc30-8cbf-4a85-8847-a24031f5e3dc] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:42.008035 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-384e4974-3500-4af6-b8d8-04e5222cced9 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:42.009058 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-384e4974-3500-4af6-b8d8-04e5222cced9 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:42.009896 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-384e4974-3500-4af6-b8d8-04e5222cced9 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:42.011093 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-384e4974-3500-4af6-b8d8-04e5222cced9 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:42.012186 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-384e4974-3500-4af6-b8d8-04e5222cced9 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:42.013710 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-384e4974-3500-4af6-b8d8-04e5222cced9 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:42.322219 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-384e4974-3500-4af6-b8d8-04e5222cced9 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:42.335892 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-384e4974-3500-4af6-b8d8-04e5222cced9 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc" status: 200 len: 1521 microversion: 2.1 time: 0.351151 Oct 26 13:15:42.337720 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1544/3110] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:41 2022] GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc => generated 1521 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:42.346884 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2cb8920b-cfe5-4c4b-b18a-446b7f500954 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:42.349630 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2cb8920b-cfe5-4c4b-b18a-446b7f500954 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 6668f03f-2108-4ade-88e9-d51f6e696338] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:42.396601 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2cb8920b-cfe5-4c4b-b18a-446b7f500954 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:42.397438 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2cb8920b-cfe5-4c4b-b18a-446b7f500954 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:42.398333 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2cb8920b-cfe5-4c4b-b18a-446b7f500954 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:42.404817 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2cb8920b-cfe5-4c4b-b18a-446b7f500954 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:42.406158 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2cb8920b-cfe5-4c4b-b18a-446b7f500954 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:42.407775 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2cb8920b-cfe5-4c4b-b18a-446b7f500954 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:42.458978 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2cb8920b-cfe5-4c4b-b18a-446b7f500954 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:42.459643 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2cb8920b-cfe5-4c4b-b18a-446b7f500954 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:42.460089 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2cb8920b-cfe5-4c4b-b18a-446b7f500954 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:42.460541 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-2cb8920b-cfe5-4c4b-b18a-446b7f500954 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lazy-loading 'fault' on Instance uuid 6668f03f-2108-4ade-88e9-d51f6e696338 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:15:42.472824 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:15:42.526727 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4238f2a9-b090-4ed8-9df4-a132870e32f4 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:42.535952 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4238f2a9-b090-4ed8-9df4-a132870e32f4 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c" status: 200 len: 1717 microversion: 2.1 time: 0.799256 Oct 26 13:15:42.553662 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1567/3111] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:41 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c => generated 1717 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:42.560478 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b6d407a5-7cd4-4529-8a59-246709884fd1 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '.version_select at 0x7f6732d358b0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:42.589183 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2cb8920b-cfe5-4c4b-b18a-446b7f500954 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:42.601775 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2cb8920b-cfe5-4c4b-b18a-446b7f500954 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/6668f03f-2108-4ade-88e9-d51f6e696338" status: 200 len: 1298 microversion: 2.1 time: 0.261367 Oct 26 13:15:42.606607 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1545/3112] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:42 2022] GET /compute/v2.1/servers/6668f03f-2108-4ade-88e9-d51f6e696338 => generated 1298 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:42.616902 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-71a70af3-2ed1-4cc4-8022-e02f4dcfccf7 req-eeffc5f1-f771-42a6-9cc3-d42f8aee86e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1dbfc30-8cbf-4a85-8847-a24031f5e3dc", "name": "network-vif-plugged", "status": "completed", "tag": "6a1b48d4-d8c0-4f57-984c-ddd4f192ec77"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:15:42.639238 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-71a70af3-2ed1-4cc4-8022-e02f4dcfccf7 req-eeffc5f1-f771-42a6-9cc3-d42f8aee86e6 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:42.639638 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-71a70af3-2ed1-4cc4-8022-e02f4dcfccf7 req-eeffc5f1-f771-42a6-9cc3-d42f8aee86e6 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:42.640062 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-71a70af3-2ed1-4cc4-8022-e02f4dcfccf7 req-eeffc5f1-f771-42a6-9cc3-d42f8aee86e6 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:42.678627 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-71a70af3-2ed1-4cc4-8022-e02f4dcfccf7 req-eeffc5f1-f771-42a6-9cc3-d42f8aee86e6 service nova] Creating event network-vif-plugged:6a1b48d4-d8c0-4f57-984c-ddd4f192ec77 for instance a1dbfc30-8cbf-4a85-8847-a24031f5e3dc on n-h2-862686-1 Oct 26 13:15:42.693163 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-71a70af3-2ed1-4cc4-8022-e02f4dcfccf7 req-eeffc5f1-f771-42a6-9cc3-d42f8aee86e6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083419 Oct 26 13:15:42.695480 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1546/3113] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:15:42.718829 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bd457eb2-3e6f-4985-af46-e972a5ad7efe tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:42.721682 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bd457eb2-3e6f-4985-af46-e972a5ad7efe tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:42.737748 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd457eb2-3e6f-4985-af46-e972a5ad7efe tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:42.739340 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd457eb2-3e6f-4985-af46-e972a5ad7efe tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:42.740485 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd457eb2-3e6f-4985-af46-e972a5ad7efe tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:42.744119 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd457eb2-3e6f-4985-af46-e972a5ad7efe tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:42.744617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd457eb2-3e6f-4985-af46-e972a5ad7efe tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:42.745065 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd457eb2-3e6f-4985-af46-e972a5ad7efe tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:43.315752 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bd457eb2-3e6f-4985-af46-e972a5ad7efe tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:43.330937 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bd457eb2-3e6f-4985-af46-e972a5ad7efe tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:43.333163 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bd457eb2-3e6f-4985-af46-e972a5ad7efe tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:43.349163 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bd457eb2-3e6f-4985-af46-e972a5ad7efe tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1879 microversion: 2.42 time: 0.641233 Oct 26 13:15:43.373458 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1547/3114] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:15:42 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1879 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:15:43.384279 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1999f5f8-9db8-4da5-954b-1fc8df67f1b0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:43.385746 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1999f5f8-9db8-4da5-954b-1fc8df67f1b0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: d0b8440f-677e-428d-8566-29fe4624fce1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:43.395798 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1999f5f8-9db8-4da5-954b-1fc8df67f1b0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:43.396753 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1999f5f8-9db8-4da5-954b-1fc8df67f1b0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:43.397389 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1999f5f8-9db8-4da5-954b-1fc8df67f1b0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:43.398299 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1999f5f8-9db8-4da5-954b-1fc8df67f1b0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:43.398974 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1999f5f8-9db8-4da5-954b-1fc8df67f1b0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:43.399548 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1999f5f8-9db8-4da5-954b-1fc8df67f1b0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:43.910635 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1999f5f8-9db8-4da5-954b-1fc8df67f1b0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:43.931730 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1999f5f8-9db8-4da5-954b-1fc8df67f1b0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1" status: 200 len: 1315 microversion: 2.1 time: 0.550397 Oct 26 13:15:43.946165 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1548/3115] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:43 2022] GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1 => generated 1315 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:43.946165 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4f80b1db-2749-45b2-b388-28112959a1d5 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:43.947011 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4f80b1db-2749-45b2-b388-28112959a1d5 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: a1dbfc30-8cbf-4a85-8847-a24031f5e3dc] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:43.953861 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f80b1db-2749-45b2-b388-28112959a1d5 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:43.954532 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f80b1db-2749-45b2-b388-28112959a1d5 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:43.954974 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f80b1db-2749-45b2-b388-28112959a1d5 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:43.955680 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f80b1db-2749-45b2-b388-28112959a1d5 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:43.956189 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f80b1db-2749-45b2-b388-28112959a1d5 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:43.956559 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f80b1db-2749-45b2-b388-28112959a1d5 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:43.970431 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b6d407a5-7cd4-4529-8a59-246709884fd1 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/1e83a99e-78d2-40bf-b4c9-44063ff6e8fa" status: 202 len: 0 microversion: 2.1 time: 1.415331 Oct 26 13:15:43.972302 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1568/3116] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 26 13:15:42 2022] DELETE /compute/v2.1/os-security-groups/1e83a99e-78d2-40bf-b4c9-44063ff6e8fa => generated 0 bytes in 1418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:15:43.979443 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8e71ae90-4ed8-46af-90a8-1802c14f4f36 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:43.980584 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8e71ae90-4ed8-46af-90a8-1802c14f4f36 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:43.989061 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8e71ae90-4ed8-46af-90a8-1802c14f4f36 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:43.989680 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8e71ae90-4ed8-46af-90a8-1802c14f4f36 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:43.990268 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8e71ae90-4ed8-46af-90a8-1802c14f4f36 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:43.991216 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8e71ae90-4ed8-46af-90a8-1802c14f4f36 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:43.991946 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8e71ae90-4ed8-46af-90a8-1802c14f4f36 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:43.992585 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8e71ae90-4ed8-46af-90a8-1802c14f4f36 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:44.208115 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8e71ae90-4ed8-46af-90a8-1802c14f4f36 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:44.219870 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8e71ae90-4ed8-46af-90a8-1802c14f4f36 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c" status: 200 len: 1717 microversion: 2.1 time: 0.246197 Oct 26 13:15:44.220784 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1569/3117] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:43 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c => generated 1717 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:44.238075 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cc9164be-150b-4c72-9991-39c1711ce1c2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:44.239061 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cc9164be-150b-4c72-9991-39c1711ce1c2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 6668f03f-2108-4ade-88e9-d51f6e696338] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:44.247360 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc9164be-150b-4c72-9991-39c1711ce1c2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:44.248420 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc9164be-150b-4c72-9991-39c1711ce1c2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:44.249318 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc9164be-150b-4c72-9991-39c1711ce1c2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:44.250322 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc9164be-150b-4c72-9991-39c1711ce1c2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:44.251007 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc9164be-150b-4c72-9991-39c1711ce1c2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:44.251626 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc9164be-150b-4c72-9991-39c1711ce1c2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:44.270741 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-cc9164be-150b-4c72-9991-39c1711ce1c2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] HTTP exception thrown: Instance 6668f03f-2108-4ade-88e9-d51f6e696338 could not be found. Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cc9164be-150b-4c72-9991-39c1711ce1c2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Request method failure captured: Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/6668f03f-2108-4ade-88e9-d51f6e696338 HTTP/1.1 Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTJbgpOJ6_WXapLDSc4DXB2ybbuKvfF9irakf13MnXe_PUvQw0tvwC_KXpEDb02nWk9gKVB2DnChPFFUGp_xOUQaSFHL5E80bTALTu8ZJijTkAv_z2Y1Gdi1cyNAMKmLE7ZnzWq0oDflWXhf1sSJNtguU-rMZFkiGbBps0dj1yOxZiU Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 3f690a680b284d82ac586346427423c3 Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersTestJSON-1612525130 Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3f690a680b284d82ac586346427423c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f690a680b284d82ac586346427423c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3f690a680b284d82ac586346427423c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f690a680b284d82ac586346427423c3"}]}] Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersTestJSON-1612525130 Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 3f690a680b284d82ac586346427423c3 Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersTestJSON-1612525130 Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersTestJSON-1612525130-project Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: fbe30a73a18d49afa07f7a66aee7805d Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersTestJSON-1612525130-project Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 6668f03f-2108-4ade-88e9-d51f6e696338 could not be found. Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '6668f03f-2108-4ade-88e9-d51f6e696338'} Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6668f03f-2108-4ade-88e9-d51f6e696338 could not be found. Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6668f03f-2108-4ade-88e9-d51f6e696338 could not be found. Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:15:44.272707 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:15:44.276873 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:15:44.276873 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:15:44.276873 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:15:44.276873 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:15:44.276873 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:15:44.276873 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6668f03f-2108-4ade-88e9-d51f6e696338 could not be found. Oct 26 13:15:44.276873 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:15:44.279385 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cc9164be-150b-4c72-9991-39c1711ce1c2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Returning 404 to user: Instance 6668f03f-2108-4ade-88e9-d51f6e696338 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:15:44.280687 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cc9164be-150b-4c72-9991-39c1711ce1c2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/6668f03f-2108-4ade-88e9-d51f6e696338" status: 404 len: 111 microversion: 2.1 time: 0.058305 Oct 26 13:15:44.281725 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1570/3118] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:44 2022] GET /compute/v2.1/servers/6668f03f-2108-4ade-88e9-d51f6e696338 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:15:44.286954 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d46b075d-a8bc-42bb-a4f7-e1f5d5b282a4 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '.version_select at 0x7f6731b68940>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:44.311766 n-d-862686-1 devstack@n-api.service[120597]: DEBUG neutronclient.v2_0.client [None req-d46b075d-a8bc-42bb-a4f7-e1f5d5b282a4 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1e83a99e-78d2-40bf-b4c9-44063ff6e8fa does not exist", "detail": ""}} {{(pid=120597) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 26 13:15:44.312380 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.security_group_api [None req-d46b075d-a8bc-42bb-a4f7-e1f5d5b282a4 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Neutron security group 1e83a99e-78d2-40bf-b4c9-44063ff6e8fa not found {{(pid=120597) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 26 13:15:44.312904 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-d46b075d-a8bc-42bb-a4f7-e1f5d5b282a4 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] HTTP exception thrown: Security group 1e83a99e-78d2-40bf-b4c9-44063ff6e8fa does not exist Oct 26 13:15:44.312904 n-d-862686-1 devstack@n-api.service[120597]: Neutron server returns request_ids: ['req-d192a321-e5ea-45f5-aa12-bc35cad675f2'] Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d46b075d-a8bc-42bb-a4f7-e1f5d5b282a4 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Request method failure captured: Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/os-security-groups/1e83a99e-78d2-40bf-b4c9-44063ff6e8fa HTTP/1.1 Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTLZwemdkOoZmTGSmy6KZvPDtVHD2_E9ZUR49ovbPsQaFz77JmwG34xaymuHO8vYj9Nv7h8paBonBJqeJ-iGNHh66dW9zr2o-PVtLnq2ivVkvSk_ngG_K5FTR8-56OwV4JEOB5RsCmAZvvKkRYejOCKTdf6hjGlyGC2s57RFn_cJWHQ Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 875ebd1c99c746f7b4f1a3c08156e6a0 Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-SecurityGroupsTestJSON-256228496 Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/875ebd1c99c746f7b4f1a3c08156e6a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/875ebd1c99c746f7b4f1a3c08156e6a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_875ebd1c99c746f7b4f1a3c08156e6a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/875ebd1c99c746f7b4f1a3c08156e6a0"}]}] Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-SecurityGroupsTestJSON-256228496 Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 875ebd1c99c746f7b4f1a3c08156e6a0 Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-256228496 Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-SecurityGroupsTestJSON-256228496-project Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: a13285463ba34e89931d667bc327bb2a Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-SecurityGroupsTestJSON-256228496-project Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: method: Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: exception: Security group 1e83a99e-78d2-40bf-b4c9-44063ff6e8fa does not exist Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: Neutron server returns request_ids: ['req-d192a321-e5ea-45f5-aa12-bc35cad675f2'] Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '1e83a99e-78d2-40bf-b4c9-44063ff6e8fa'} Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 26 13:15:44.314762 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1e83a99e-78d2-40bf-b4c9-44063ff6e8fa does not exist Oct 26 13:15:44.319158 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d192a321-e5ea-45f5-aa12-bc35cad675f2'] Oct 26 13:15:44.319158 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:15:44.319158 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:15:44.319158 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:15:44.319158 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:15:44.319158 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 26 13:15:44.319158 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 26 13:15:44.319158 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 26 13:15:44.319158 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 26 13:15:44.319158 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1e83a99e-78d2-40bf-b4c9-44063ff6e8fa does not exist Oct 26 13:15:44.319158 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d192a321-e5ea-45f5-aa12-bc35cad675f2'] Oct 26 13:15:44.319158 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:15:44.319158 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:15:44.319158 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:15:44.319158 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:15:44.319158 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:15:44.319158 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:15:44.319158 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:15:44.319158 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:15:44.319158 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:15:44.319158 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:15:44.319158 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:15:44.319158 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:15:44.319158 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 26 13:15:44.319158 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 26 13:15:44.319158 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1e83a99e-78d2-40bf-b4c9-44063ff6e8fa does not exist Oct 26 13:15:44.319158 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d192a321-e5ea-45f5-aa12-bc35cad675f2'] Oct 26 13:15:44.319158 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:15:44.319158 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:15:44.319158 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:15:44.319158 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:15:44.319158 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:15:44.319158 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:15:44.319158 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:15:44.319158 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:15:44.319158 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1e83a99e-78d2-40bf-b4c9-44063ff6e8fa does not exist Oct 26 13:15:44.319158 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d192a321-e5ea-45f5-aa12-bc35cad675f2'] Oct 26 13:15:44.319158 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:15:44.319158 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d46b075d-a8bc-42bb-a4f7-e1f5d5b282a4 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Returning 404 to user: Security group 1e83a99e-78d2-40bf-b4c9-44063ff6e8fa does not exist Oct 26 13:15:44.319158 n-d-862686-1 devstack@n-api.service[120597]: Neutron server returns request_ids: ['req-d192a321-e5ea-45f5-aa12-bc35cad675f2'] {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:15:44.319158 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d46b075d-a8bc-42bb-a4f7-e1f5d5b282a4 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups/1e83a99e-78d2-40bf-b4c9-44063ff6e8fa" status: 404 len: 194 microversion: 2.1 time: 0.033211 Oct 26 13:15:44.321758 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1571/3119] 10.222.0.40 () {58 vars in 1269 bytes} [Wed Oct 26 13:15:44 2022] GET /compute/v2.1/os-security-groups/1e83a99e-78d2-40bf-b4c9-44063ff6e8fa => generated 194 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:15:44.326417 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6a669af1-7b38-4649-aa6e-497bf09db14a tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:44.326924 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6a669af1-7b38-4649-aa6e-497bf09db14a tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: a15dcabd-f50e-41f3-a7df-6b26412222a9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:44.336769 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6a669af1-7b38-4649-aa6e-497bf09db14a tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:44.337581 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6a669af1-7b38-4649-aa6e-497bf09db14a tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:44.338031 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6a669af1-7b38-4649-aa6e-497bf09db14a tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:44.339021 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6a669af1-7b38-4649-aa6e-497bf09db14a tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:44.339512 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6a669af1-7b38-4649-aa6e-497bf09db14a tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:44.339942 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6a669af1-7b38-4649-aa6e-497bf09db14a tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:44.372549 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6a669af1-7b38-4649-aa6e-497bf09db14a tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: a15dcabd-f50e-41f3-a7df-6b26412222a9] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:15:44.482807 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6a669af1-7b38-4649-aa6e-497bf09db14a tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9" status: 204 len: 0 microversion: 2.1 time: 0.160825 Oct 26 13:15:44.483930 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1572/3120] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:15:44 2022] DELETE /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:15:44.489788 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6226e295-7cd6-4d0f-b372-c5dc702860d9 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '.version_select at 0x7f67320cadc0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:44.656824 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4f80b1db-2749-45b2-b388-28112959a1d5 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:44.688073 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4f80b1db-2749-45b2-b388-28112959a1d5 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc" status: 200 len: 1521 microversion: 2.1 time: 0.749750 Oct 26 13:15:44.702495 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1549/3121] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:43 2022] GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc => generated 1521 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:44.715992 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c9b78a9d-b480-4361-8dd2-78010897c368 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:44.717026 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c9b78a9d-b480-4361-8dd2-78010897c368 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:44.731650 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9b78a9d-b480-4361-8dd2-78010897c368 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:44.733086 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9b78a9d-b480-4361-8dd2-78010897c368 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:44.734108 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9b78a9d-b480-4361-8dd2-78010897c368 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:44.735519 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9b78a9d-b480-4361-8dd2-78010897c368 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:44.736233 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9b78a9d-b480-4361-8dd2-78010897c368 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:44.738315 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9b78a9d-b480-4361-8dd2-78010897c368 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:44.843155 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6226e295-7cd6-4d0f-b372-c5dc702860d9 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.357696 Oct 26 13:15:44.854126 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1573/3122] 10.222.0.40 () {58 vars in 1158 bytes} [Wed Oct 26 13:15:44 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:44.854126 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e0f1cc6e-56ca-4bef-9001-ea8bf0c72ebd tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:44.854126 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e0f1cc6e-56ca-4bef-9001-ea8bf0c72ebd tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: a15dcabd-f50e-41f3-a7df-6b26412222a9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:44.888960 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e0f1cc6e-56ca-4bef-9001-ea8bf0c72ebd tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:44.889573 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e0f1cc6e-56ca-4bef-9001-ea8bf0c72ebd tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:44.890084 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e0f1cc6e-56ca-4bef-9001-ea8bf0c72ebd tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:44.890868 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e0f1cc6e-56ca-4bef-9001-ea8bf0c72ebd tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:44.891431 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e0f1cc6e-56ca-4bef-9001-ea8bf0c72ebd tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:44.891937 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e0f1cc6e-56ca-4bef-9001-ea8bf0c72ebd tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:44.895871 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:15:45.191284 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c9b78a9d-b480-4361-8dd2-78010897c368 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:45.206469 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c9b78a9d-b480-4361-8dd2-78010897c368 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:45.208253 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c9b78a9d-b480-4361-8dd2-78010897c368 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:45.209780 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c9b78a9d-b480-4361-8dd2-78010897c368 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1879 microversion: 2.42 time: 0.505487 Oct 26 13:15:45.210362 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1550/3123] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:15:44 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1879 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:15:45.215978 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-13a001d1-92e9-4a97-b36a-feecdf2f1915 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Action: 'create', calling method: .version_select at 0x7f67318bcb80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1295053597", "description": "tempest-description-384696677"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:15:45.217983 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e0f1cc6e-56ca-4bef-9001-ea8bf0c72ebd tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:45.234433 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e0f1cc6e-56ca-4bef-9001-ea8bf0c72ebd tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9" status: 200 len: 1494 microversion: 2.1 time: 0.388553 Oct 26 13:15:45.235368 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1574/3124] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:44 2022] GET /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9 => generated 1494 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:45.241916 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6659c4be-328c-4621-8ab2-d9f4fed49ac2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:45.242538 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6659c4be-328c-4621-8ab2-d9f4fed49ac2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: d0b8440f-677e-428d-8566-29fe4624fce1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:45.251793 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6659c4be-328c-4621-8ab2-d9f4fed49ac2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:45.252328 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6659c4be-328c-4621-8ab2-d9f4fed49ac2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:45.252814 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6659c4be-328c-4621-8ab2-d9f4fed49ac2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:45.253610 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6659c4be-328c-4621-8ab2-d9f4fed49ac2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:45.254087 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6659c4be-328c-4621-8ab2-d9f4fed49ac2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:45.254535 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6659c4be-328c-4621-8ab2-d9f4fed49ac2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:45.500888 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6659c4be-328c-4621-8ab2-d9f4fed49ac2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:45.533095 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6659c4be-328c-4621-8ab2-d9f4fed49ac2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1" status: 200 len: 1315 microversion: 2.1 time: 0.296435 Oct 26 13:15:45.535361 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1575/3125] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:45 2022] GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1 => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:45.567837 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-a2adfcd6-174d-427c-aaac-e295024af39c req-4e5e2839-dc42-4674-af79-3e1b61c7d877 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0b8440f-677e-428d-8566-29fe4624fce1", "tag": "7a6e9c8d-c37d-469c-a839-6185fac0b35e"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:15:45.584554 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a2adfcd6-174d-427c-aaac-e295024af39c req-4e5e2839-dc42-4674-af79-3e1b61c7d877 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:45.586065 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a2adfcd6-174d-427c-aaac-e295024af39c req-4e5e2839-dc42-4674-af79-3e1b61c7d877 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:45.588442 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a2adfcd6-174d-427c-aaac-e295024af39c req-4e5e2839-dc42-4674-af79-3e1b61c7d877 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:45.611250 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-a2adfcd6-174d-427c-aaac-e295024af39c req-4e5e2839-dc42-4674-af79-3e1b61c7d877 service nova] Creating event network-changed:7a6e9c8d-c37d-469c-a839-6185fac0b35e for instance d0b8440f-677e-428d-8566-29fe4624fce1 on n-h1-862686-1 Oct 26 13:15:45.618182 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-a2adfcd6-174d-427c-aaac-e295024af39c req-4e5e2839-dc42-4674-af79-3e1b61c7d877 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062452 Oct 26 13:15:45.623575 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1576/3126] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:15:45.631954 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b8cdfcc2-e745-44a7-a600-2c87434c444e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:45.634597 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b8cdfcc2-e745-44a7-a600-2c87434c444e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:45.643996 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8cdfcc2-e745-44a7-a600-2c87434c444e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:45.644782 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8cdfcc2-e745-44a7-a600-2c87434c444e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:45.645351 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8cdfcc2-e745-44a7-a600-2c87434c444e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:45.646488 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8cdfcc2-e745-44a7-a600-2c87434c444e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:45.647077 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8cdfcc2-e745-44a7-a600-2c87434c444e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:45.648108 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8cdfcc2-e745-44a7-a600-2c87434c444e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:45.713567 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-13a001d1-92e9-4a97-b36a-feecdf2f1915 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.501513 Oct 26 13:15:45.715064 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1551/3127] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 26 13:15:45 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:15:45.720768 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-30fe0181-baca-4e32-ba0f-77aa76fb4569 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:45.723063 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-30fe0181-baca-4e32-ba0f-77aa76fb4569 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: a1dbfc30-8cbf-4a85-8847-a24031f5e3dc] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:45.739340 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30fe0181-baca-4e32-ba0f-77aa76fb4569 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:45.739860 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30fe0181-baca-4e32-ba0f-77aa76fb4569 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:45.740496 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30fe0181-baca-4e32-ba0f-77aa76fb4569 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:45.741515 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30fe0181-baca-4e32-ba0f-77aa76fb4569 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:45.742138 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30fe0181-baca-4e32-ba0f-77aa76fb4569 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:45.742808 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30fe0181-baca-4e32-ba0f-77aa76fb4569 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:45.937521 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b8cdfcc2-e745-44a7-a600-2c87434c444e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:45.952413 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b8cdfcc2-e745-44a7-a600-2c87434c444e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c" status: 200 len: 1717 microversion: 2.1 time: 0.326855 Oct 26 13:15:45.953877 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1577/3128] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:45 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c => generated 1717 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:45.991459 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-879217b8-d45b-4ceb-8441-58c578101ef5 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Action: 'create', calling method: .version_select at 0x7f67320ca940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-164374479", "description": "tempest-description-876883922"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:15:46.021804 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-30fe0181-baca-4e32-ba0f-77aa76fb4569 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:46.033884 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-30fe0181-baca-4e32-ba0f-77aa76fb4569 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc" status: 200 len: 1521 microversion: 2.1 time: 0.317454 Oct 26 13:15:46.053613 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1552/3129] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:45 2022] GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc => generated 1521 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:46.238554 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-879217b8-d45b-4ceb-8441-58c578101ef5 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.282599 Oct 26 13:15:46.239712 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1578/3130] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 26 13:15:45 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:15:46.249909 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-06b8fcc1-76e0-44b8-b030-d73d90470c35 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:46.249909 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-06b8fcc1-76e0-44b8-b030-d73d90470c35 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:46.267764 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-179e500d-b75f-4cda-b7e8-77615c31b8fd tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:46.268811 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-179e500d-b75f-4cda-b7e8-77615c31b8fd tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: a15dcabd-f50e-41f3-a7df-6b26412222a9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:46.276810 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-179e500d-b75f-4cda-b7e8-77615c31b8fd tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:46.281368 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-179e500d-b75f-4cda-b7e8-77615c31b8fd tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:46.282249 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-179e500d-b75f-4cda-b7e8-77615c31b8fd tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:46.282387 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06b8fcc1-76e0-44b8-b030-d73d90470c35 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:46.283750 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-179e500d-b75f-4cda-b7e8-77615c31b8fd tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:46.284410 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-179e500d-b75f-4cda-b7e8-77615c31b8fd tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:46.285066 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-179e500d-b75f-4cda-b7e8-77615c31b8fd tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:46.287936 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06b8fcc1-76e0-44b8-b030-d73d90470c35 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:46.293853 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06b8fcc1-76e0-44b8-b030-d73d90470c35 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:46.299554 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06b8fcc1-76e0-44b8-b030-d73d90470c35 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:46.303572 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06b8fcc1-76e0-44b8-b030-d73d90470c35 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:46.304878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06b8fcc1-76e0-44b8-b030-d73d90470c35 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:46.791973 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-179e500d-b75f-4cda-b7e8-77615c31b8fd tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:46.801060 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-179e500d-b75f-4cda-b7e8-77615c31b8fd tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9" status: 200 len: 1494 microversion: 2.1 time: 0.537527 Oct 26 13:15:46.805410 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1579/3131] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:46 2022] GET /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9 => generated 1494 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:46.824731 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1b439673-2797-4bb0-b4c9-46254bfa796a tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-2012642870", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "d692bb3d-41c2-468e-ac58-e733dd16e498"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:15:46.885424 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-06b8fcc1-76e0-44b8-b030-d73d90470c35 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:46.916319 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-06b8fcc1-76e0-44b8-b030-d73d90470c35 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:46.917175 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-1b439673-2797-4bb0-b4c9-46254bfa796a tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] validate_networks() for [('d692bb3d-41c2-468e-ac58-e733dd16e498', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:15:46.922021 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-06b8fcc1-76e0-44b8-b030-d73d90470c35 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:46.925094 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-06b8fcc1-76e0-44b8-b030-d73d90470c35 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1879 microversion: 2.42 time: 0.688980 Oct 26 13:15:46.927477 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1553/3132] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:15:46 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1879 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:15:46.936400 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-76e05c67-b085-46b3-a060-e64fba13b889 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:46.937018 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-76e05c67-b085-46b3-a060-e64fba13b889 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: d0b8440f-677e-428d-8566-29fe4624fce1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:46.946942 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76e05c67-b085-46b3-a060-e64fba13b889 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:46.947428 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76e05c67-b085-46b3-a060-e64fba13b889 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:46.947878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76e05c67-b085-46b3-a060-e64fba13b889 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:46.955391 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76e05c67-b085-46b3-a060-e64fba13b889 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:46.956299 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76e05c67-b085-46b3-a060-e64fba13b889 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:46.956756 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76e05c67-b085-46b3-a060-e64fba13b889 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:47.125476 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-76e05c67-b085-46b3-a060-e64fba13b889 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:47.134982 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-76e05c67-b085-46b3-a060-e64fba13b889 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1" status: 200 len: 1315 microversion: 2.1 time: 0.206475 Oct 26 13:15:47.138984 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1554/3133] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:46 2022] GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:47.146346 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-580b5b2a-d429-47e6-b9e3-1f574b9d8a81 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:47.146956 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-580b5b2a-d429-47e6-b9e3-1f574b9d8a81 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:47.154639 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-580b5b2a-d429-47e6-b9e3-1f574b9d8a81 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:47.157123 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-580b5b2a-d429-47e6-b9e3-1f574b9d8a81 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:47.157612 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-580b5b2a-d429-47e6-b9e3-1f574b9d8a81 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:47.158336 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-580b5b2a-d429-47e6-b9e3-1f574b9d8a81 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:47.158798 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-580b5b2a-d429-47e6-b9e3-1f574b9d8a81 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:47.159264 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-580b5b2a-d429-47e6-b9e3-1f574b9d8a81 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:47.312481 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-580b5b2a-d429-47e6-b9e3-1f574b9d8a81 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:47.323315 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-580b5b2a-d429-47e6-b9e3-1f574b9d8a81 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c" status: 200 len: 1717 microversion: 2.1 time: 0.182829 Oct 26 13:15:47.324791 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1555/3134] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:47 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c => generated 1717 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:47.330405 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9a2750df-4d54-45f3-8d72-1b98bea7d914 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:47.331444 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9a2750df-4d54-45f3-8d72-1b98bea7d914 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: a1dbfc30-8cbf-4a85-8847-a24031f5e3dc] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:47.351971 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a2750df-4d54-45f3-8d72-1b98bea7d914 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:47.352235 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a2750df-4d54-45f3-8d72-1b98bea7d914 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:47.352672 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a2750df-4d54-45f3-8d72-1b98bea7d914 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:47.353369 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a2750df-4d54-45f3-8d72-1b98bea7d914 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:47.353860 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a2750df-4d54-45f3-8d72-1b98bea7d914 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:47.354286 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a2750df-4d54-45f3-8d72-1b98bea7d914 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:47.538967 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9a2750df-4d54-45f3-8d72-1b98bea7d914 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:47.548099 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9a2750df-4d54-45f3-8d72-1b98bea7d914 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc" status: 200 len: 1506 microversion: 2.1 time: 0.222111 Oct 26 13:15:47.549791 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1556/3135] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:47 2022] GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc => generated 1506 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:47.565748 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-fd3bd241-d9c0-4024-8324-49baa34b49e9 req-3bb13f84-961a-4351-ad70-95a473296125 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e73c452-6277-4845-b64e-e3eca2528e4c", "name": "network-vif-unplugged", "status": "completed", "tag": "48f9022a-e360-40a8-bd91-61687277f232"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:15:47.579565 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-fd3bd241-d9c0-4024-8324-49baa34b49e9 req-3bb13f84-961a-4351-ad70-95a473296125 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:47.580425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-fd3bd241-d9c0-4024-8324-49baa34b49e9 req-3bb13f84-961a-4351-ad70-95a473296125 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:47.581471 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-fd3bd241-d9c0-4024-8324-49baa34b49e9 req-3bb13f84-961a-4351-ad70-95a473296125 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:47.594736 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-fd3bd241-d9c0-4024-8324-49baa34b49e9 req-3bb13f84-961a-4351-ad70-95a473296125 service nova] Creating event network-vif-unplugged:48f9022a-e360-40a8-bd91-61687277f232 for instance 5e73c452-6277-4845-b64e-e3eca2528e4c on n-h2-862686-1 Oct 26 13:15:47.601119 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-fd3bd241-d9c0-4024-8324-49baa34b49e9 req-3bb13f84-961a-4351-ad70-95a473296125 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039068 Oct 26 13:15:47.601992 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1557/3136] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:15:47.607581 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cecdf22e-0078-4d95-be0f-0df18cd2f250 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:47.608347 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cecdf22e-0078-4d95-be0f-0df18cd2f250 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: a1dbfc30-8cbf-4a85-8847-a24031f5e3dc] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:47.614601 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cecdf22e-0078-4d95-be0f-0df18cd2f250 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:47.615176 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cecdf22e-0078-4d95-be0f-0df18cd2f250 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:47.615686 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cecdf22e-0078-4d95-be0f-0df18cd2f250 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:47.616447 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cecdf22e-0078-4d95-be0f-0df18cd2f250 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:47.616972 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cecdf22e-0078-4d95-be0f-0df18cd2f250 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:47.617501 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cecdf22e-0078-4d95-be0f-0df18cd2f250 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:47.790044 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-cecdf22e-0078-4d95-be0f-0df18cd2f250 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:47.802328 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cecdf22e-0078-4d95-be0f-0df18cd2f250 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc" status: 200 len: 1506 microversion: 2.1 time: 0.198642 Oct 26 13:15:47.809553 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1558/3137] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:47 2022] GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc => generated 1506 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:47.842098 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5cd841ef-49e9-4577-bb1f-3d9c62424d90 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:47.843053 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5cd841ef-49e9-4577-bb1f-3d9c62424d90 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: a15dcabd-f50e-41f3-a7df-6b26412222a9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:47.851679 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5cd841ef-49e9-4577-bb1f-3d9c62424d90 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:47.852454 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5cd841ef-49e9-4577-bb1f-3d9c62424d90 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:47.853943 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5cd841ef-49e9-4577-bb1f-3d9c62424d90 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:47.857259 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5cd841ef-49e9-4577-bb1f-3d9c62424d90 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:47.857954 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5cd841ef-49e9-4577-bb1f-3d9c62424d90 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:47.858791 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5cd841ef-49e9-4577-bb1f-3d9c62424d90 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:48.003760 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5cd841ef-49e9-4577-bb1f-3d9c62424d90 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:48.016096 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5cd841ef-49e9-4577-bb1f-3d9c62424d90 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9" status: 200 len: 1452 microversion: 2.1 time: 0.186212 Oct 26 13:15:48.017856 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1559/3138] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:47 2022] GET /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9 => generated 1452 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:48.036965 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-1b439673-2797-4bb0-b4c9-46254bfa796a tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:15:48.037517 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-1b439673-2797-4bb0-b4c9-46254bfa796a tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:15:48.037840 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c324f24f-ee60-4d61-8de2-d46143098c19 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:48.038371 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-1b439673-2797-4bb0-b4c9-46254bfa796a tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:15:48.038503 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c324f24f-ee60-4d61-8de2-d46143098c19 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: a1dbfc30-8cbf-4a85-8847-a24031f5e3dc] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:48.038907 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-1b439673-2797-4bb0-b4c9-46254bfa796a tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:15:48.039713 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-1b439673-2797-4bb0-b4c9-46254bfa796a tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:15:48.051234 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b439673-2797-4bb0-b4c9-46254bfa796a tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:48.052102 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b439673-2797-4bb0-b4c9-46254bfa796a tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:48.052775 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b439673-2797-4bb0-b4c9-46254bfa796a tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:48.053799 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b439673-2797-4bb0-b4c9-46254bfa796a tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:48.054862 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b439673-2797-4bb0-b4c9-46254bfa796a tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:48.054993 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c324f24f-ee60-4d61-8de2-d46143098c19 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:48.055646 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b439673-2797-4bb0-b4c9-46254bfa796a tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:48.055899 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c324f24f-ee60-4d61-8de2-d46143098c19 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:48.057085 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c324f24f-ee60-4d61-8de2-d46143098c19 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:48.057896 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c324f24f-ee60-4d61-8de2-d46143098c19 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:48.058514 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c324f24f-ee60-4d61-8de2-d46143098c19 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:48.060643 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c324f24f-ee60-4d61-8de2-d46143098c19 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:48.128547 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-1b439673-2797-4bb0-b4c9-46254bfa796a tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Getting quotas for project 875ebd1c99c746f7b4f1a3c08156e6a0. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:15:48.140522 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-1b439673-2797-4bb0-b4c9-46254bfa796a tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Getting quotas for user a13285463ba34e89931d667bc327bb2a and project 875ebd1c99c746f7b4f1a3c08156e6a0. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:15:48.149227 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c324f24f-ee60-4d61-8de2-d46143098c19 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: a1dbfc30-8cbf-4a85-8847-a24031f5e3dc] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:15:48.175365 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1b439673-2797-4bb0-b4c9-46254bfa796a tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:15:48.177892 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1b439673-2797-4bb0-b4c9-46254bfa796a tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 6b3fe85a-699d-438b-b809-0539f2fd25b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:15:48.303850 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1b439673-2797-4bb0-b4c9-46254bfa796a tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.496482 Oct 26 13:15:48.305393 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1580/3139] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:15:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:15:48.315131 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6ed13083-15c8-4ea7-aa95-7e27a0a52cd4 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:48.315980 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6ed13083-15c8-4ea7-aa95-7e27a0a52cd4 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:48.333220 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ed13083-15c8-4ea7-aa95-7e27a0a52cd4 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:48.341644 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ed13083-15c8-4ea7-aa95-7e27a0a52cd4 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:48.348799 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ed13083-15c8-4ea7-aa95-7e27a0a52cd4 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:48.350082 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ed13083-15c8-4ea7-aa95-7e27a0a52cd4 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:48.350850 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ed13083-15c8-4ea7-aa95-7e27a0a52cd4 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:48.354393 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ed13083-15c8-4ea7-aa95-7e27a0a52cd4 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:48.396193 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c324f24f-ee60-4d61-8de2-d46143098c19 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc" status: 204 len: 0 microversion: 2.1 time: 0.376425 Oct 26 13:15:48.406712 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1560/3140] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:15:48 2022] DELETE /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:15:48.416373 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-322fe81d-6905-4c55-b447-51d4230f9bd0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:48.418755 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-322fe81d-6905-4c55-b447-51d4230f9bd0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: d0b8440f-677e-428d-8566-29fe4624fce1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:48.439860 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-322fe81d-6905-4c55-b447-51d4230f9bd0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:48.440416 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-322fe81d-6905-4c55-b447-51d4230f9bd0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:48.440947 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-322fe81d-6905-4c55-b447-51d4230f9bd0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:48.441796 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-322fe81d-6905-4c55-b447-51d4230f9bd0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:48.442347 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-322fe81d-6905-4c55-b447-51d4230f9bd0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:48.445819 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-322fe81d-6905-4c55-b447-51d4230f9bd0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:48.508963 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:15:48.533793 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:15:48.782914 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-322fe81d-6905-4c55-b447-51d4230f9bd0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:48.797168 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-322fe81d-6905-4c55-b447-51d4230f9bd0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1" status: 200 len: 1315 microversion: 2.1 time: 0.387935 Oct 26 13:15:48.814774 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1561/3141] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:48 2022] GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1 => generated 1315 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:48.821315 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6a7bd8b2-b08c-4743-a8d5-71553a34e62f tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:48.821985 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6a7bd8b2-b08c-4743-a8d5-71553a34e62f tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 6b3fe85a-699d-438b-b809-0539f2fd25b3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:48.895426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6ed13083-15c8-4ea7-aa95-7e27a0a52cd4 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:48.909437 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6ed13083-15c8-4ea7-aa95-7e27a0a52cd4 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:48.911637 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6ed13083-15c8-4ea7-aa95-7e27a0a52cd4 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:48.913512 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6ed13083-15c8-4ea7-aa95-7e27a0a52cd4 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1879 microversion: 2.42 time: 0.606886 Oct 26 13:15:48.914824 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1581/3142] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:15:48 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1879 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:15:48.919865 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5c6890be-2fa9-4e17-961a-ebc53e8bfe63 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:48.920889 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5c6890be-2fa9-4e17-961a-ebc53e8bfe63 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:48.928350 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c6890be-2fa9-4e17-961a-ebc53e8bfe63 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:48.929111 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c6890be-2fa9-4e17-961a-ebc53e8bfe63 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:48.929948 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c6890be-2fa9-4e17-961a-ebc53e8bfe63 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:48.931128 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c6890be-2fa9-4e17-961a-ebc53e8bfe63 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:48.931789 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c6890be-2fa9-4e17-961a-ebc53e8bfe63 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:48.932538 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c6890be-2fa9-4e17-961a-ebc53e8bfe63 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:48.989822 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6a7bd8b2-b08c-4743-a8d5-71553a34e62f tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13285463ba34e89931d667bc327bb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875ebd1c99c746f7b4f1a3c08156e6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:49.022502 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6a7bd8b2-b08c-4743-a8d5-71553a34e62f tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "GET /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3" status: 200 len: 1216 microversion: 2.1 time: 0.203117 Oct 26 13:15:49.026522 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1562/3143] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:48 2022] GET /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3 => generated 1216 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:49.043577 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ff2f8dff-3030-4942-a65d-934eb121d8d1 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1172812323", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "340efa1a-ce32-4ee5-be29-96387dba2183"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:15:49.162479 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-ff2f8dff-3030-4942-a65d-934eb121d8d1 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] validate_networks() for [('340efa1a-ce32-4ee5-be29-96387dba2183', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:15:49.202741 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5c6890be-2fa9-4e17-961a-ebc53e8bfe63 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:49.212177 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5c6890be-2fa9-4e17-961a-ebc53e8bfe63 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c" status: 200 len: 1717 microversion: 2.1 time: 0.296132 Oct 26 13:15:49.228492 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1582/3144] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:48 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c => generated 1717 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:49.230208 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-610a43dc-5934-43a0-aa64-4e78d203de40 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:49.230843 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-610a43dc-5934-43a0-aa64-4e78d203de40 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: a15dcabd-f50e-41f3-a7df-6b26412222a9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:49.239273 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-610a43dc-5934-43a0-aa64-4e78d203de40 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:49.239772 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-610a43dc-5934-43a0-aa64-4e78d203de40 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:49.240642 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-610a43dc-5934-43a0-aa64-4e78d203de40 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:49.241966 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-610a43dc-5934-43a0-aa64-4e78d203de40 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:49.243106 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-610a43dc-5934-43a0-aa64-4e78d203de40 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:49.243929 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-610a43dc-5934-43a0-aa64-4e78d203de40 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:49.284598 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-610a43dc-5934-43a0-aa64-4e78d203de40 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:49.285197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-610a43dc-5934-43a0-aa64-4e78d203de40 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:49.285759 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-610a43dc-5934-43a0-aa64-4e78d203de40 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:49.286503 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-610a43dc-5934-43a0-aa64-4e78d203de40 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lazy-loading 'fault' on Instance uuid a15dcabd-f50e-41f3-a7df-6b26412222a9 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:15:49.336979 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-610a43dc-5934-43a0-aa64-4e78d203de40 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:49.350777 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-610a43dc-5934-43a0-aa64-4e78d203de40 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9" status: 200 len: 1298 microversion: 2.1 time: 0.130725 Oct 26 13:15:49.351769 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1583/3145] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:49 2022] GET /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9 => generated 1298 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:49.640723 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-7c4cf4e6-e80b-4a60-ae97-fad041d5b1eb req-c5c0e057-0c21-480a-a882-26fcae351f94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a15dcabd-f50e-41f3-a7df-6b26412222a9", "name": "network-vif-deleted", "tag": "0fc9a692-64c3-4d89-8074-c30f1ec979b6"}, {"name": "network-changed", "server_uuid": "5e73c452-6277-4845-b64e-e3eca2528e4c", "tag": "48f9022a-e360-40a8-bd91-61687277f232"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:15:49.654856 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-7c4cf4e6-e80b-4a60-ae97-fad041d5b1eb req-c5c0e057-0c21-480a-a882-26fcae351f94 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:49.655774 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-7c4cf4e6-e80b-4a60-ae97-fad041d5b1eb req-c5c0e057-0c21-480a-a882-26fcae351f94 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:49.656404 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-7c4cf4e6-e80b-4a60-ae97-fad041d5b1eb req-c5c0e057-0c21-480a-a882-26fcae351f94 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:49.670562 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-7c4cf4e6-e80b-4a60-ae97-fad041d5b1eb req-c5c0e057-0c21-480a-a882-26fcae351f94 service nova] Creating event network-vif-deleted:0fc9a692-64c3-4d89-8074-c30f1ec979b6 for instance a15dcabd-f50e-41f3-a7df-6b26412222a9 on n-h2-862686-1 Oct 26 13:15:49.671160 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-7c4cf4e6-e80b-4a60-ae97-fad041d5b1eb req-c5c0e057-0c21-480a-a882-26fcae351f94 service nova] Creating event network-changed:48f9022a-e360-40a8-bd91-61687277f232 for instance 5e73c452-6277-4845-b64e-e3eca2528e4c on n-h2-862686-1 Oct 26 13:15:49.678185 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-7c4cf4e6-e80b-4a60-ae97-fad041d5b1eb req-c5c0e057-0c21-480a-a882-26fcae351f94 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.041183 Oct 26 13:15:49.682832 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1584/3146] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:15:49.748590 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-ff2f8dff-3030-4942-a65d-934eb121d8d1 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:15:49.749339 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-ff2f8dff-3030-4942-a65d-934eb121d8d1 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:15:49.749973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-ff2f8dff-3030-4942-a65d-934eb121d8d1 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:15:49.750461 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-ff2f8dff-3030-4942-a65d-934eb121d8d1 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:15:49.751172 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-ff2f8dff-3030-4942-a65d-934eb121d8d1 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:15:49.760588 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ff2f8dff-3030-4942-a65d-934eb121d8d1 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:49.761140 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ff2f8dff-3030-4942-a65d-934eb121d8d1 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:49.761613 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ff2f8dff-3030-4942-a65d-934eb121d8d1 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:49.762376 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ff2f8dff-3030-4942-a65d-934eb121d8d1 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:49.762830 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ff2f8dff-3030-4942-a65d-934eb121d8d1 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:49.763253 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ff2f8dff-3030-4942-a65d-934eb121d8d1 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:49.781086 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-ff2f8dff-3030-4942-a65d-934eb121d8d1 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Getting quotas for project 5291f3c81016423cbc1164c82551f648. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:15:49.786354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-ff2f8dff-3030-4942-a65d-934eb121d8d1 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Getting quotas for user 5744e7524e4c4d2c896ce178572ada0c and project 5291f3c81016423cbc1164c82551f648. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:15:49.799527 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ff2f8dff-3030-4942-a65d-934eb121d8d1 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:15:49.801873 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ff2f8dff-3030-4942-a65d-934eb121d8d1 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 7d459ce7-b3e3-4ae8-868b-2ff408d2c200] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:15:49.826600 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e16581dd-9301-4d29-ad98-b23a97d0dfde tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:49.827705 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e16581dd-9301-4d29-ad98-b23a97d0dfde tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: d0b8440f-677e-428d-8566-29fe4624fce1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:49.834977 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e16581dd-9301-4d29-ad98-b23a97d0dfde tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:49.838021 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e16581dd-9301-4d29-ad98-b23a97d0dfde tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:49.838613 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e16581dd-9301-4d29-ad98-b23a97d0dfde tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:49.840176 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e16581dd-9301-4d29-ad98-b23a97d0dfde tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:49.841094 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e16581dd-9301-4d29-ad98-b23a97d0dfde tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:49.841620 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e16581dd-9301-4d29-ad98-b23a97d0dfde tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:49.852652 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ff2f8dff-3030-4942-a65d-934eb121d8d1 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.823246 Oct 26 13:15:49.853645 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1563/3147] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:15:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:15:49.869248 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f8718606-e660-4327-bceb-0305629945fa tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:49.870000 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f8718606-e660-4327-bceb-0305629945fa tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 7d459ce7-b3e3-4ae8-868b-2ff408d2c200] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:49.956198 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f8718606-e660-4327-bceb-0305629945fa tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:49.965196 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f8718606-e660-4327-bceb-0305629945fa tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200" status: 200 len: 1218 microversion: 2.1 time: 0.099596 Oct 26 13:15:49.969522 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1564/3148] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:49 2022] GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200 => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:49.970623 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c019a371-05de-4566-9211-862c20c55547 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:49.971369 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c019a371-05de-4566-9211-862c20c55547 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:49.977793 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c019a371-05de-4566-9211-862c20c55547 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:49.978288 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c019a371-05de-4566-9211-862c20c55547 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:49.978729 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c019a371-05de-4566-9211-862c20c55547 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:49.979436 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c019a371-05de-4566-9211-862c20c55547 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:49.979935 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c019a371-05de-4566-9211-862c20c55547 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:49.980365 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c019a371-05de-4566-9211-862c20c55547 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:50.000790 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:15:50.044793 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e16581dd-9301-4d29-ad98-b23a97d0dfde tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:50.058666 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e16581dd-9301-4d29-ad98-b23a97d0dfde tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1" status: 200 len: 1315 microversion: 2.1 time: 0.236047 Oct 26 13:15:50.059276 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1585/3149] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:49 2022] GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:15:50.063989 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e6eab1d5-08e6-481a-9688-3bcb299588cc tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:50.065799 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e6eab1d5-08e6-481a-9688-3bcb299588cc tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 6b3fe85a-699d-438b-b809-0539f2fd25b3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:50.072258 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e6eab1d5-08e6-481a-9688-3bcb299588cc tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:50.072710 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e6eab1d5-08e6-481a-9688-3bcb299588cc tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:50.073161 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e6eab1d5-08e6-481a-9688-3bcb299588cc tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:50.074640 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e6eab1d5-08e6-481a-9688-3bcb299588cc tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:50.075215 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e6eab1d5-08e6-481a-9688-3bcb299588cc tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:50.075591 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e6eab1d5-08e6-481a-9688-3bcb299588cc tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:50.146894 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e6eab1d5-08e6-481a-9688-3bcb299588cc tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13285463ba34e89931d667bc327bb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875ebd1c99c746f7b4f1a3c08156e6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:50.157967 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e6eab1d5-08e6-481a-9688-3bcb299588cc tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "GET /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3" status: 200 len: 1212 microversion: 2.1 time: 0.096876 Oct 26 13:15:50.159518 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1586/3150] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:50 2022] GET /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3 => generated 1212 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:50.205914 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c019a371-05de-4566-9211-862c20c55547 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:50.217588 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c019a371-05de-4566-9211-862c20c55547 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:50.219279 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c019a371-05de-4566-9211-862c20c55547 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:50.220657 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c019a371-05de-4566-9211-862c20c55547 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1879 microversion: 2.42 time: 0.253645 Oct 26 13:15:50.221256 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1565/3151] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:15:49 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1879 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:15:50.236749 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-170e5b5c-0c84-47c5-8b6a-9b03cac779c0 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:50.241183 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-170e5b5c-0c84-47c5-8b6a-9b03cac779c0 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:50.248759 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-170e5b5c-0c84-47c5-8b6a-9b03cac779c0 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:50.249253 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-170e5b5c-0c84-47c5-8b6a-9b03cac779c0 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:50.249718 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-170e5b5c-0c84-47c5-8b6a-9b03cac779c0 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:50.250415 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-170e5b5c-0c84-47c5-8b6a-9b03cac779c0 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:50.250902 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-170e5b5c-0c84-47c5-8b6a-9b03cac779c0 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:50.251356 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-170e5b5c-0c84-47c5-8b6a-9b03cac779c0 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:50.375760 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d7170f90-82ad-4c0e-bfd7-82b70643dccd tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:50.376376 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d7170f90-82ad-4c0e-bfd7-82b70643dccd tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: a15dcabd-f50e-41f3-a7df-6b26412222a9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:50.391473 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d7170f90-82ad-4c0e-bfd7-82b70643dccd tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:50.391976 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d7170f90-82ad-4c0e-bfd7-82b70643dccd tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:50.393296 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d7170f90-82ad-4c0e-bfd7-82b70643dccd tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:50.395983 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d7170f90-82ad-4c0e-bfd7-82b70643dccd tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:50.395983 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d7170f90-82ad-4c0e-bfd7-82b70643dccd tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:50.396365 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d7170f90-82ad-4c0e-bfd7-82b70643dccd tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:50.449345 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d7170f90-82ad-4c0e-bfd7-82b70643dccd tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:50.450065 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d7170f90-82ad-4c0e-bfd7-82b70643dccd tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:50.450656 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d7170f90-82ad-4c0e-bfd7-82b70643dccd tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:50.451256 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-d7170f90-82ad-4c0e-bfd7-82b70643dccd tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lazy-loading 'fault' on Instance uuid a15dcabd-f50e-41f3-a7df-6b26412222a9 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:15:50.504616 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d7170f90-82ad-4c0e-bfd7-82b70643dccd tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:50.516523 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d7170f90-82ad-4c0e-bfd7-82b70643dccd tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9" status: 200 len: 1298 microversion: 2.1 time: 0.146270 Oct 26 13:15:50.517895 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1566/3152] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:50 2022] GET /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9 => generated 1298 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:15:50.767354 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-170e5b5c-0c84-47c5-8b6a-9b03cac779c0 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:50.775973 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-170e5b5c-0c84-47c5-8b6a-9b03cac779c0 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c" status: 200 len: 1717 microversion: 2.1 time: 0.543535 Oct 26 13:15:50.776560 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1587/3153] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:50 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c => generated 1717 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:50.990952 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5009be04-9776-4dea-8ba9-d42b6fb0bc2d tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:50.991646 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5009be04-9776-4dea-8ba9-d42b6fb0bc2d tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 7d459ce7-b3e3-4ae8-868b-2ff408d2c200] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:51.000361 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5009be04-9776-4dea-8ba9-d42b6fb0bc2d tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:51.001118 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5009be04-9776-4dea-8ba9-d42b6fb0bc2d tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:51.001894 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5009be04-9776-4dea-8ba9-d42b6fb0bc2d tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:51.002837 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5009be04-9776-4dea-8ba9-d42b6fb0bc2d tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:51.003506 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5009be04-9776-4dea-8ba9-d42b6fb0bc2d tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:51.004243 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5009be04-9776-4dea-8ba9-d42b6fb0bc2d tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:51.076399 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5009be04-9776-4dea-8ba9-d42b6fb0bc2d tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:51.084078 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-13fbfdb8-579b-40f7-887e-51340b462d59 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:51.084697 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-13fbfdb8-579b-40f7-887e-51340b462d59 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: d0b8440f-677e-428d-8566-29fe4624fce1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:51.087138 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5009be04-9776-4dea-8ba9-d42b6fb0bc2d tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200" status: 200 len: 1214 microversion: 2.1 time: 0.100266 Oct 26 13:15:51.088104 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1567/3154] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:50 2022] GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200 => generated 1214 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:51.092710 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-13fbfdb8-579b-40f7-887e-51340b462d59 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:51.093200 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-13fbfdb8-579b-40f7-887e-51340b462d59 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:51.093688 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-13fbfdb8-579b-40f7-887e-51340b462d59 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:51.094395 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-13fbfdb8-579b-40f7-887e-51340b462d59 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:51.094854 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-13fbfdb8-579b-40f7-887e-51340b462d59 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:51.095281 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-13fbfdb8-579b-40f7-887e-51340b462d59 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:51.186705 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bd540992-4b87-45c0-947d-22f7730cf2f8 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:51.187067 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bd540992-4b87-45c0-947d-22f7730cf2f8 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 6b3fe85a-699d-438b-b809-0539f2fd25b3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:51.200870 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd540992-4b87-45c0-947d-22f7730cf2f8 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:51.202068 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd540992-4b87-45c0-947d-22f7730cf2f8 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:51.202861 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd540992-4b87-45c0-947d-22f7730cf2f8 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:51.203798 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd540992-4b87-45c0-947d-22f7730cf2f8 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:51.204758 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd540992-4b87-45c0-947d-22f7730cf2f8 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:51.205389 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd540992-4b87-45c0-947d-22f7730cf2f8 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:51.343588 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bd540992-4b87-45c0-947d-22f7730cf2f8 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13285463ba34e89931d667bc327bb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875ebd1c99c746f7b4f1a3c08156e6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:51.354298 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bd540992-4b87-45c0-947d-22f7730cf2f8 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "GET /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3" status: 200 len: 1268 microversion: 2.1 time: 0.175499 Oct 26 13:15:51.359814 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1568/3155] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:51 2022] GET /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3 => generated 1268 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:51.374654 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-480ac9d9-3ba6-4bc6-a943-59cbbda7dbbc tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:51.375577 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-480ac9d9-3ba6-4bc6-a943-59cbbda7dbbc tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:51.395159 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-480ac9d9-3ba6-4bc6-a943-59cbbda7dbbc tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:51.397425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-480ac9d9-3ba6-4bc6-a943-59cbbda7dbbc tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:51.398273 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-480ac9d9-3ba6-4bc6-a943-59cbbda7dbbc tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:51.403001 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-480ac9d9-3ba6-4bc6-a943-59cbbda7dbbc tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:51.403698 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-480ac9d9-3ba6-4bc6-a943-59cbbda7dbbc tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:51.404246 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-480ac9d9-3ba6-4bc6-a943-59cbbda7dbbc tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:51.413442 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-13fbfdb8-579b-40f7-887e-51340b462d59 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:51.422463 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-13fbfdb8-579b-40f7-887e-51340b462d59 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1" status: 200 len: 1315 microversion: 2.1 time: 0.342097 Oct 26 13:15:51.426364 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1588/3156] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:51 2022] GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1 => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:15:51.546173 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-31f1b4f7-ff62-4eaf-858a-3a53a87fe6e0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:51.546812 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-31f1b4f7-ff62-4eaf-858a-3a53a87fe6e0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: a15dcabd-f50e-41f3-a7df-6b26412222a9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:51.554221 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31f1b4f7-ff62-4eaf-858a-3a53a87fe6e0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:51.554823 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31f1b4f7-ff62-4eaf-858a-3a53a87fe6e0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:51.555267 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31f1b4f7-ff62-4eaf-858a-3a53a87fe6e0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:51.556007 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31f1b4f7-ff62-4eaf-858a-3a53a87fe6e0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:51.556471 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31f1b4f7-ff62-4eaf-858a-3a53a87fe6e0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:51.556893 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31f1b4f7-ff62-4eaf-858a-3a53a87fe6e0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:51.599678 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-31f1b4f7-ff62-4eaf-858a-3a53a87fe6e0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] HTTP exception thrown: Instance a15dcabd-f50e-41f3-a7df-6b26412222a9 could not be found. Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-31f1b4f7-ff62-4eaf-858a-3a53a87fe6e0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Request method failure captured: Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9 HTTP/1.1 Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTJbgpOJ6_WXapLDSc4DXB2ybbuKvfF9irakf13MnXe_PUvQw0tvwC_KXpEDb02nWk9gKVB2DnChPFFUGp_xOUQaSFHL5E80bTALTu8ZJijTkAv_z2Y1Gdi1cyNAMKmLE7ZnzWq0oDflWXhf1sSJNtguU-rMZFkiGbBps0dj1yOxZiU Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 3f690a680b284d82ac586346427423c3 Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersTestJSON-1612525130 Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3f690a680b284d82ac586346427423c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f690a680b284d82ac586346427423c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3f690a680b284d82ac586346427423c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f690a680b284d82ac586346427423c3"}]}] Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersTestJSON-1612525130 Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 3f690a680b284d82ac586346427423c3 Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersTestJSON-1612525130 Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersTestJSON-1612525130-project Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: fbe30a73a18d49afa07f7a66aee7805d Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersTestJSON-1612525130-project Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance a15dcabd-f50e-41f3-a7df-6b26412222a9 could not be found. Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'a15dcabd-f50e-41f3-a7df-6b26412222a9'} Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a15dcabd-f50e-41f3-a7df-6b26412222a9 could not be found. Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a15dcabd-f50e-41f3-a7df-6b26412222a9 could not be found. Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:15:51.602003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:15:51.606691 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:15:51.606691 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:15:51.606691 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:15:51.606691 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:15:51.606691 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:15:51.606691 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a15dcabd-f50e-41f3-a7df-6b26412222a9 could not be found. Oct 26 13:15:51.606691 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:15:51.610919 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-31f1b4f7-ff62-4eaf-858a-3a53a87fe6e0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Returning 404 to user: Instance a15dcabd-f50e-41f3-a7df-6b26412222a9 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:15:51.612188 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-31f1b4f7-ff62-4eaf-858a-3a53a87fe6e0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9" status: 404 len: 111 microversion: 2.1 time: 0.074625 Oct 26 13:15:51.613382 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1589/3157] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:51 2022] GET /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:15:51.713113 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-ab59f3a0-31bc-4c22-b62f-9f2af450d89e req-31996bc7-180b-4904-9517-db417011f0b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1dbfc30-8cbf-4a85-8847-a24031f5e3dc", "name": "network-vif-deleted", "tag": "6a1b48d4-d8c0-4f57-984c-ddd4f192ec77"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:15:51.760450 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-480ac9d9-3ba6-4bc6-a943-59cbbda7dbbc tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:51.769837 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ab59f3a0-31bc-4c22-b62f-9f2af450d89e req-31996bc7-180b-4904-9517-db417011f0b0 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:51.770347 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ab59f3a0-31bc-4c22-b62f-9f2af450d89e req-31996bc7-180b-4904-9517-db417011f0b0 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:51.771046 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ab59f3a0-31bc-4c22-b62f-9f2af450d89e req-31996bc7-180b-4904-9517-db417011f0b0 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:51.774583 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-480ac9d9-3ba6-4bc6-a943-59cbbda7dbbc tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:51.779042 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-480ac9d9-3ba6-4bc6-a943-59cbbda7dbbc tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:51.781448 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-480ac9d9-3ba6-4bc6-a943-59cbbda7dbbc tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1879 microversion: 2.42 time: 0.420140 Oct 26 13:15:51.783004 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1569/3158] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:15:51 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1879 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:15:51.802700 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-958a54b8-3a65-4c88-80d8-1fc81ef9db32 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:51.804163 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-958a54b8-3a65-4c88-80d8-1fc81ef9db32 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:51.804340 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-ab59f3a0-31bc-4c22-b62f-9f2af450d89e req-31996bc7-180b-4904-9517-db417011f0b0 service nova] Creating event network-vif-deleted:6a1b48d4-d8c0-4f57-984c-ddd4f192ec77 for instance a1dbfc30-8cbf-4a85-8847-a24031f5e3dc on n-h2-862686-1 Oct 26 13:15:51.814600 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-958a54b8-3a65-4c88-80d8-1fc81ef9db32 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:51.815449 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-958a54b8-3a65-4c88-80d8-1fc81ef9db32 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:51.816062 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-958a54b8-3a65-4c88-80d8-1fc81ef9db32 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:51.816839 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-958a54b8-3a65-4c88-80d8-1fc81ef9db32 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:51.817367 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-958a54b8-3a65-4c88-80d8-1fc81ef9db32 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:51.818193 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-958a54b8-3a65-4c88-80d8-1fc81ef9db32 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:51.828198 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-ab59f3a0-31bc-4c22-b62f-9f2af450d89e req-31996bc7-180b-4904-9517-db417011f0b0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118844 Oct 26 13:15:51.829255 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1590/3159] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:15:51.850202 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b81f89e9-814c-42ce-93e5-e4a2687efac5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2059877105", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "bc8855c0-63b2-4c3e-b1b8-950c3dd488ef"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:15:51.988179 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-b81f89e9-814c-42ce-93e5-e4a2687efac5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] validate_networks() for [('bc8855c0-63b2-4c3e-b1b8-950c3dd488ef', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:15:52.040012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-958a54b8-3a65-4c88-80d8-1fc81ef9db32 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:52.050210 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-958a54b8-3a65-4c88-80d8-1fc81ef9db32 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c" status: 200 len: 1717 microversion: 2.1 time: 0.253562 Oct 26 13:15:52.053573 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1570/3160] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:51 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c => generated 1717 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:15:52.112356 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5be95261-bac0-405c-be0e-94efb4ad2814 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:52.113083 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5be95261-bac0-405c-be0e-94efb4ad2814 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 7d459ce7-b3e3-4ae8-868b-2ff408d2c200] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:52.121731 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5be95261-bac0-405c-be0e-94efb4ad2814 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:52.122331 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5be95261-bac0-405c-be0e-94efb4ad2814 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:52.122923 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5be95261-bac0-405c-be0e-94efb4ad2814 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:52.123657 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5be95261-bac0-405c-be0e-94efb4ad2814 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:52.124116 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5be95261-bac0-405c-be0e-94efb4ad2814 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:52.124739 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5be95261-bac0-405c-be0e-94efb4ad2814 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:52.199714 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5be95261-bac0-405c-be0e-94efb4ad2814 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:52.208841 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5be95261-bac0-405c-be0e-94efb4ad2814 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200" status: 200 len: 1270 microversion: 2.1 time: 0.100349 Oct 26 13:15:52.209862 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1571/3161] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:52 2022] GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200 => generated 1270 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:52.384015 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b5c324df-c842-45ee-ae5c-a767937cc806 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:52.384684 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b5c324df-c842-45ee-ae5c-a767937cc806 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 6b3fe85a-699d-438b-b809-0539f2fd25b3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:52.399040 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5c324df-c842-45ee-ae5c-a767937cc806 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:52.402348 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5c324df-c842-45ee-ae5c-a767937cc806 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:52.404672 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5c324df-c842-45ee-ae5c-a767937cc806 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:52.405526 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5c324df-c842-45ee-ae5c-a767937cc806 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:52.406021 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5c324df-c842-45ee-ae5c-a767937cc806 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:52.406460 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5c324df-c842-45ee-ae5c-a767937cc806 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:52.491773 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b5c324df-c842-45ee-ae5c-a767937cc806 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13285463ba34e89931d667bc327bb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875ebd1c99c746f7b4f1a3c08156e6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:52.510583 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b5c324df-c842-45ee-ae5c-a767937cc806 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "GET /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3" status: 200 len: 1274 microversion: 2.1 time: 0.131394 Oct 26 13:15:52.514440 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1572/3162] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:52 2022] GET /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3 => generated 1274 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:15:52.543686 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fe189a83-7c9c-4554-ade8-456987fb422c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:52.544779 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fe189a83-7c9c-4554-ade8-456987fb422c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: d0b8440f-677e-428d-8566-29fe4624fce1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:52.552985 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe189a83-7c9c-4554-ade8-456987fb422c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:52.553123 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe189a83-7c9c-4554-ade8-456987fb422c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:52.553510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe189a83-7c9c-4554-ade8-456987fb422c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:52.554301 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe189a83-7c9c-4554-ade8-456987fb422c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:52.554941 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe189a83-7c9c-4554-ade8-456987fb422c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:52.555373 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe189a83-7c9c-4554-ade8-456987fb422c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:52.795981 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fe189a83-7c9c-4554-ade8-456987fb422c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:52.804825 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fe189a83-7c9c-4554-ade8-456987fb422c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1" status: 200 len: 1315 microversion: 2.1 time: 0.267985 Oct 26 13:15:52.818319 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1573/3163] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:52 2022] GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1 => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:52.829300 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e4a470ca-31cf-45f0-a797-da6dfc8d09aa tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:52.829951 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e4a470ca-31cf-45f0-a797-da6dfc8d09aa tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:52.836144 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4a470ca-31cf-45f0-a797-da6dfc8d09aa tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:52.836906 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4a470ca-31cf-45f0-a797-da6dfc8d09aa tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:52.837342 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4a470ca-31cf-45f0-a797-da6dfc8d09aa tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:52.838571 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4a470ca-31cf-45f0-a797-da6dfc8d09aa tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:52.839654 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4a470ca-31cf-45f0-a797-da6dfc8d09aa tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:52.840089 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4a470ca-31cf-45f0-a797-da6dfc8d09aa tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:53.114977 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e4a470ca-31cf-45f0-a797-da6dfc8d09aa tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:53.139007 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e4a470ca-31cf-45f0-a797-da6dfc8d09aa tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:53.141236 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e4a470ca-31cf-45f0-a797-da6dfc8d09aa tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:53.142701 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e4a470ca-31cf-45f0-a797-da6dfc8d09aa tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1879 microversion: 2.42 time: 0.323331 Oct 26 13:15:53.143632 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1574/3164] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:15:52 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1879 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:15:53.150234 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-23e03679-b63e-4ede-8ab2-11ac02246539 req-6946951a-6002-40a7-b223-2edc4ee01e9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0b8440f-677e-428d-8566-29fe4624fce1", "name": "network-vif-plugged", "status": "completed", "tag": "7a6e9c8d-c37d-469c-a839-6185fac0b35e"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:15:53.161184 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-23e03679-b63e-4ede-8ab2-11ac02246539 req-6946951a-6002-40a7-b223-2edc4ee01e9f service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:53.161891 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-23e03679-b63e-4ede-8ab2-11ac02246539 req-6946951a-6002-40a7-b223-2edc4ee01e9f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:53.162546 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-23e03679-b63e-4ede-8ab2-11ac02246539 req-6946951a-6002-40a7-b223-2edc4ee01e9f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:53.177842 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-23e03679-b63e-4ede-8ab2-11ac02246539 req-6946951a-6002-40a7-b223-2edc4ee01e9f service nova] Creating event network-vif-plugged:7a6e9c8d-c37d-469c-a839-6185fac0b35e for instance d0b8440f-677e-428d-8566-29fe4624fce1 on n-h1-862686-1 Oct 26 13:15:53.185416 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-23e03679-b63e-4ede-8ab2-11ac02246539 req-6946951a-6002-40a7-b223-2edc4ee01e9f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039761 Oct 26 13:15:53.186067 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1575/3165] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:15:53.193300 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cba41ffd-9c5e-431b-a105-f97ff2d1f93e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:53.194753 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cba41ffd-9c5e-431b-a105-f97ff2d1f93e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:53.198306 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-b81f89e9-814c-42ce-93e5-e4a2687efac5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:15:53.198879 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-b81f89e9-814c-42ce-93e5-e4a2687efac5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:15:53.199326 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-b81f89e9-814c-42ce-93e5-e4a2687efac5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:15:53.200033 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-b81f89e9-814c-42ce-93e5-e4a2687efac5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:15:53.200569 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-b81f89e9-814c-42ce-93e5-e4a2687efac5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:15:53.204383 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cba41ffd-9c5e-431b-a105-f97ff2d1f93e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:53.205162 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cba41ffd-9c5e-431b-a105-f97ff2d1f93e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:53.206170 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cba41ffd-9c5e-431b-a105-f97ff2d1f93e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:53.207272 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cba41ffd-9c5e-431b-a105-f97ff2d1f93e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:53.208143 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cba41ffd-9c5e-431b-a105-f97ff2d1f93e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:53.209131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cba41ffd-9c5e-431b-a105-f97ff2d1f93e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:53.214148 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b81f89e9-814c-42ce-93e5-e4a2687efac5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:53.214654 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b81f89e9-814c-42ce-93e5-e4a2687efac5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:53.215222 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b81f89e9-814c-42ce-93e5-e4a2687efac5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:53.216153 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b81f89e9-814c-42ce-93e5-e4a2687efac5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:53.216830 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b81f89e9-814c-42ce-93e5-e4a2687efac5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:53.217659 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b81f89e9-814c-42ce-93e5-e4a2687efac5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:53.255029 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-b81f89e9-814c-42ce-93e5-e4a2687efac5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Getting quotas for project 3f690a680b284d82ac586346427423c3. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:15:53.262818 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-b81f89e9-814c-42ce-93e5-e4a2687efac5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Getting quotas for user fbe30a73a18d49afa07f7a66aee7805d and project 3f690a680b284d82ac586346427423c3. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:15:53.281333 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b81f89e9-814c-42ce-93e5-e4a2687efac5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:15:53.284142 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b81f89e9-814c-42ce-93e5-e4a2687efac5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 8718e439-6247-480e-9887-eab549630975] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:15:53.359496 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b81f89e9-814c-42ce-93e5-e4a2687efac5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.513041 Oct 26 13:15:53.360805 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1591/3166] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:15:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 26 13:15:53.369470 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-749e39f7-4600-43af-8e3e-f9f99919de55 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:53.370845 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-749e39f7-4600-43af-8e3e-f9f99919de55 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 7d459ce7-b3e3-4ae8-868b-2ff408d2c200] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:53.380418 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-749e39f7-4600-43af-8e3e-f9f99919de55 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:53.382362 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-749e39f7-4600-43af-8e3e-f9f99919de55 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:53.383076 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-749e39f7-4600-43af-8e3e-f9f99919de55 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:53.384198 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-749e39f7-4600-43af-8e3e-f9f99919de55 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:53.384823 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-749e39f7-4600-43af-8e3e-f9f99919de55 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:53.387573 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-749e39f7-4600-43af-8e3e-f9f99919de55 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:53.496863 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-749e39f7-4600-43af-8e3e-f9f99919de55 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:53.504998 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-cba41ffd-9c5e-431b-a105-f97ff2d1f93e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:53.514034 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-749e39f7-4600-43af-8e3e-f9f99919de55 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200" status: 200 len: 1276 microversion: 2.1 time: 0.148113 Oct 26 13:15:53.525785 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cba41ffd-9c5e-431b-a105-f97ff2d1f93e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c" status: 200 len: 1717 microversion: 2.1 time: 0.338173 Oct 26 13:15:53.527172 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1576/3167] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:53 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c => generated 1717 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:53.532990 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1592/3168] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:53 2022] GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200 => generated 1276 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:53.543785 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ae5fe388-fa1e-44e9-8388-5c87d6e6240c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:53.547459 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ae5fe388-fa1e-44e9-8388-5c87d6e6240c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 8718e439-6247-480e-9887-eab549630975] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:53.549945 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7328bdfb-32ba-4243-866b-438e2b59c858 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:53.550757 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7328bdfb-32ba-4243-866b-438e2b59c858 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 6b3fe85a-699d-438b-b809-0539f2fd25b3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:53.569302 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7328bdfb-32ba-4243-866b-438e2b59c858 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:53.572720 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7328bdfb-32ba-4243-866b-438e2b59c858 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:53.573360 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7328bdfb-32ba-4243-866b-438e2b59c858 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:53.579085 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7328bdfb-32ba-4243-866b-438e2b59c858 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:53.580739 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7328bdfb-32ba-4243-866b-438e2b59c858 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:53.583992 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7328bdfb-32ba-4243-866b-438e2b59c858 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:53.680075 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ae5fe388-fa1e-44e9-8388-5c87d6e6240c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:53.688707 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ae5fe388-fa1e-44e9-8388-5c87d6e6240c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975" status: 200 len: 1209 microversion: 2.1 time: 0.160182 Oct 26 13:15:53.705812 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1577/3169] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:53 2022] GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975 => generated 1209 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:53.835916 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e4571604-710f-4149-9a71-cdfc784a362b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:53.844480 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e4571604-710f-4149-9a71-cdfc784a362b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: d0b8440f-677e-428d-8566-29fe4624fce1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:53.850273 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:15:53.866795 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4571604-710f-4149-9a71-cdfc784a362b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:53.873249 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4571604-710f-4149-9a71-cdfc784a362b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:53.873973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4571604-710f-4149-9a71-cdfc784a362b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:53.876900 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4571604-710f-4149-9a71-cdfc784a362b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:53.878289 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4571604-710f-4149-9a71-cdfc784a362b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:53.879305 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4571604-710f-4149-9a71-cdfc784a362b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:54.157061 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e4571604-710f-4149-9a71-cdfc784a362b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:54.166830 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e4571604-710f-4149-9a71-cdfc784a362b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1" status: 200 len: 1315 microversion: 2.1 time: 0.338472 Oct 26 13:15:54.168555 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1578/3170] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:53 2022] GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1 => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:54.174973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-aefad4b8-2243-406e-a072-25448375154d tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:54.175960 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-aefad4b8-2243-406e-a072-25448375154d tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:54.179958 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7328bdfb-32ba-4243-866b-438e2b59c858 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13285463ba34e89931d667bc327bb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875ebd1c99c746f7b4f1a3c08156e6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:54.187957 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aefad4b8-2243-406e-a072-25448375154d tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:54.188737 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aefad4b8-2243-406e-a072-25448375154d tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:54.189174 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aefad4b8-2243-406e-a072-25448375154d tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:54.190134 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aefad4b8-2243-406e-a072-25448375154d tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:54.190589 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aefad4b8-2243-406e-a072-25448375154d tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:54.191010 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aefad4b8-2243-406e-a072-25448375154d tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:54.191579 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7328bdfb-32ba-4243-866b-438e2b59c858 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "GET /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3" status: 200 len: 1316 microversion: 2.1 time: 0.655264 Oct 26 13:15:54.192338 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1593/3171] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:53 2022] GET /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3 => generated 1316 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:54.426236 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7e464975-1cee-49c0-9e49-2ce43add4f32 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:54.426840 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7e464975-1cee-49c0-9e49-2ce43add4f32 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 789a55e0-21ba-4b2e-b8d4-c95999955e2b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:54.435294 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e464975-1cee-49c0-9e49-2ce43add4f32 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:54.435801 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e464975-1cee-49c0-9e49-2ce43add4f32 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:54.436246 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e464975-1cee-49c0-9e49-2ce43add4f32 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:54.436968 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e464975-1cee-49c0-9e49-2ce43add4f32 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:54.437431 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e464975-1cee-49c0-9e49-2ce43add4f32 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:54.437893 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e464975-1cee-49c0-9e49-2ce43add4f32 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:54.450561 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-aefad4b8-2243-406e-a072-25448375154d tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:54.465905 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-aefad4b8-2243-406e-a072-25448375154d tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:54.469054 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-aefad4b8-2243-406e-a072-25448375154d tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:54.470299 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-aefad4b8-2243-406e-a072-25448375154d tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1879 microversion: 2.42 time: 0.300302 Oct 26 13:15:54.471298 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1579/3172] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:15:54 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1879 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:15:54.488724 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7e464975-1cee-49c0-9e49-2ce43add4f32 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b/ips" status: 200 len: 150 microversion: 2.1 time: 0.066881 Oct 26 13:15:54.489718 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1594/3173] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Oct 26 13:15:54 2022] GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b/ips => generated 150 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:15:54.550642 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-13bb20ef-b9f5-413e-ba7b-b5fce76df9fd tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:54.551482 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5b0687cb-b24c-4c40-8639-4e327b76966c tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:54.552264 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-13bb20ef-b9f5-413e-ba7b-b5fce76df9fd tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:54.552403 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5b0687cb-b24c-4c40-8639-4e327b76966c tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 7d459ce7-b3e3-4ae8-868b-2ff408d2c200] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:54.561290 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-13bb20ef-b9f5-413e-ba7b-b5fce76df9fd tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:54.562004 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-13bb20ef-b9f5-413e-ba7b-b5fce76df9fd tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:54.562765 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-13bb20ef-b9f5-413e-ba7b-b5fce76df9fd tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:54.563167 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b0687cb-b24c-4c40-8639-4e327b76966c tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:54.563887 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-13bb20ef-b9f5-413e-ba7b-b5fce76df9fd tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:54.564050 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b0687cb-b24c-4c40-8639-4e327b76966c tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:54.564534 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-13bb20ef-b9f5-413e-ba7b-b5fce76df9fd tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:54.564801 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b0687cb-b24c-4c40-8639-4e327b76966c tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:54.565154 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-13bb20ef-b9f5-413e-ba7b-b5fce76df9fd tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:54.565852 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b0687cb-b24c-4c40-8639-4e327b76966c tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:54.567047 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b0687cb-b24c-4c40-8639-4e327b76966c tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:54.567687 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b0687cb-b24c-4c40-8639-4e327b76966c tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:54.840342 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5b0687cb-b24c-4c40-8639-4e327b76966c tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:54.851976 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5b0687cb-b24c-4c40-8639-4e327b76966c tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200" status: 200 len: 1318 microversion: 2.1 time: 0.305212 Oct 26 13:15:54.865981 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1580/3174] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:54 2022] GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200 => generated 1318 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:54.875277 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-76d9c8a8-662c-4893-b1dc-5046b79479a4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:54.876285 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-76d9c8a8-662c-4893-b1dc-5046b79479a4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 8718e439-6247-480e-9887-eab549630975] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:54.888448 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76d9c8a8-662c-4893-b1dc-5046b79479a4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:54.888955 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76d9c8a8-662c-4893-b1dc-5046b79479a4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:54.889643 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76d9c8a8-662c-4893-b1dc-5046b79479a4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:54.891869 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76d9c8a8-662c-4893-b1dc-5046b79479a4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:54.892524 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76d9c8a8-662c-4893-b1dc-5046b79479a4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:54.901126 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76d9c8a8-662c-4893-b1dc-5046b79479a4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:54.926308 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-13bb20ef-b9f5-413e-ba7b-b5fce76df9fd tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:54.935323 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:15:54.941651 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-13bb20ef-b9f5-413e-ba7b-b5fce76df9fd tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c" status: 200 len: 1717 microversion: 2.1 time: 0.395301 Oct 26 13:15:54.942779 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1595/3175] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:54 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c => generated 1717 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:55.023463 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-76d9c8a8-662c-4893-b1dc-5046b79479a4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:55.033538 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-76d9c8a8-662c-4893-b1dc-5046b79479a4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975" status: 200 len: 1213 microversion: 2.1 time: 0.166475 Oct 26 13:15:55.045582 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1581/3176] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:54 2022] GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975 => generated 1213 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:55.191845 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-52d6dd68-2404-48c6-baa3-7df42604fbfe tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:55.192753 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-52d6dd68-2404-48c6-baa3-7df42604fbfe tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: d0b8440f-677e-428d-8566-29fe4624fce1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:55.197073 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:15:55.202978 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52d6dd68-2404-48c6-baa3-7df42604fbfe tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:55.203572 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52d6dd68-2404-48c6-baa3-7df42604fbfe tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:55.204087 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52d6dd68-2404-48c6-baa3-7df42604fbfe tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:55.204959 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52d6dd68-2404-48c6-baa3-7df42604fbfe tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:55.205496 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52d6dd68-2404-48c6-baa3-7df42604fbfe tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:55.206169 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52d6dd68-2404-48c6-baa3-7df42604fbfe tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:55.221038 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2dcf0784-473c-4fa0-bc10-8b0d789d12e7 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:55.221702 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2dcf0784-473c-4fa0-bc10-8b0d789d12e7 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 6b3fe85a-699d-438b-b809-0539f2fd25b3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:55.233094 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2dcf0784-473c-4fa0-bc10-8b0d789d12e7 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:55.234171 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2dcf0784-473c-4fa0-bc10-8b0d789d12e7 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:55.234979 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2dcf0784-473c-4fa0-bc10-8b0d789d12e7 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:55.238224 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2dcf0784-473c-4fa0-bc10-8b0d789d12e7 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:55.238949 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2dcf0784-473c-4fa0-bc10-8b0d789d12e7 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:55.239637 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2dcf0784-473c-4fa0-bc10-8b0d789d12e7 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:55.462270 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2dcf0784-473c-4fa0-bc10-8b0d789d12e7 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13285463ba34e89931d667bc327bb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875ebd1c99c746f7b4f1a3c08156e6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:55.475640 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2dcf0784-473c-4fa0-bc10-8b0d789d12e7 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "GET /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3" status: 200 len: 1316 microversion: 2.1 time: 0.262380 Oct 26 13:15:55.490125 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1582/3177] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:55 2022] GET /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3 => generated 1316 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:55.500563 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-72959de7-ac6e-40a6-8557-cb83398980ad tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:55.501308 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-72959de7-ac6e-40a6-8557-cb83398980ad tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:55.510790 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-52d6dd68-2404-48c6-baa3-7df42604fbfe tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:55.513139 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72959de7-ac6e-40a6-8557-cb83398980ad tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:55.513975 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72959de7-ac6e-40a6-8557-cb83398980ad tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:55.514993 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72959de7-ac6e-40a6-8557-cb83398980ad tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:55.515968 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72959de7-ac6e-40a6-8557-cb83398980ad tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:55.516773 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72959de7-ac6e-40a6-8557-cb83398980ad tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:55.517497 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72959de7-ac6e-40a6-8557-cb83398980ad tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:55.521411 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-52d6dd68-2404-48c6-baa3-7df42604fbfe tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1" status: 200 len: 1315 microversion: 2.1 time: 0.332966 Oct 26 13:15:55.530783 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1596/3178] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:55 2022] GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1 => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:55.549733 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:15:55.786996 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-72959de7-ac6e-40a6-8557-cb83398980ad tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:55.788995 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-d54b57cd-d1cd-4b42-a5e7-d55acf770b81 req-208b0eb2-a97a-45e3-a756-a134d442912a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b3fe85a-699d-438b-b809-0539f2fd25b3", "tag": "f95eafb3-a2e9-4243-a442-390ae39acdbe"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:15:55.802801 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-72959de7-ac6e-40a6-8557-cb83398980ad tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:55.804565 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-72959de7-ac6e-40a6-8557-cb83398980ad tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:55.805399 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d54b57cd-d1cd-4b42-a5e7-d55acf770b81 req-208b0eb2-a97a-45e3-a756-a134d442912a service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:55.806157 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d54b57cd-d1cd-4b42-a5e7-d55acf770b81 req-208b0eb2-a97a-45e3-a756-a134d442912a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:55.806598 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d54b57cd-d1cd-4b42-a5e7-d55acf770b81 req-208b0eb2-a97a-45e3-a756-a134d442912a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:55.808442 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-72959de7-ac6e-40a6-8557-cb83398980ad tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1879 microversion: 2.42 time: 0.312871 Oct 26 13:15:55.810910 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1583/3179] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:15:55 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1879 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:15:55.857962 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-d54b57cd-d1cd-4b42-a5e7-d55acf770b81 req-208b0eb2-a97a-45e3-a756-a134d442912a service nova] Creating event network-changed:f95eafb3-a2e9-4243-a442-390ae39acdbe for instance 6b3fe85a-699d-438b-b809-0539f2fd25b3 on n-h2-862686-1 Oct 26 13:15:55.864496 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-d54b57cd-d1cd-4b42-a5e7-d55acf770b81 req-208b0eb2-a97a-45e3-a756-a134d442912a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080878 Oct 26 13:15:55.865518 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1597/3180] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:15:55.918809 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-120315f1-84e4-4652-aaa2-eab958852e70 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:55.919140 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-120315f1-84e4-4652-aaa2-eab958852e70 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 7d459ce7-b3e3-4ae8-868b-2ff408d2c200] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:55.985371 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4b0abc7a-8154-4c36-a1a2-4ebe030bb8a6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:55.988269 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4b0abc7a-8154-4c36-a1a2-4ebe030bb8a6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:56.003524 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4b0abc7a-8154-4c36-a1a2-4ebe030bb8a6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:56.006076 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4b0abc7a-8154-4c36-a1a2-4ebe030bb8a6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:56.016367 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4b0abc7a-8154-4c36-a1a2-4ebe030bb8a6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:56.016367 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4b0abc7a-8154-4c36-a1a2-4ebe030bb8a6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:56.016367 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4b0abc7a-8154-4c36-a1a2-4ebe030bb8a6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:56.016367 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4b0abc7a-8154-4c36-a1a2-4ebe030bb8a6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:56.026281 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-120315f1-84e4-4652-aaa2-eab958852e70 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:56.034897 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-120315f1-84e4-4652-aaa2-eab958852e70 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:56.034897 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-120315f1-84e4-4652-aaa2-eab958852e70 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:56.034897 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-120315f1-84e4-4652-aaa2-eab958852e70 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:56.034897 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-120315f1-84e4-4652-aaa2-eab958852e70 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:56.034897 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-120315f1-84e4-4652-aaa2-eab958852e70 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:56.298939 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-120315f1-84e4-4652-aaa2-eab958852e70 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:56.310366 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-120315f1-84e4-4652-aaa2-eab958852e70 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200" status: 200 len: 1318 microversion: 2.1 time: 0.429369 Oct 26 13:15:56.318273 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1584/3181] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:55 2022] GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200 => generated 1318 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:56.335815 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c8a20717-cd1e-4db8-bc7f-5bb595f2dd75 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:56.336574 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c8a20717-cd1e-4db8-bc7f-5bb595f2dd75 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 8718e439-6247-480e-9887-eab549630975] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:56.344790 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c8a20717-cd1e-4db8-bc7f-5bb595f2dd75 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:56.345583 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c8a20717-cd1e-4db8-bc7f-5bb595f2dd75 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:56.346277 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c8a20717-cd1e-4db8-bc7f-5bb595f2dd75 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:56.347053 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c8a20717-cd1e-4db8-bc7f-5bb595f2dd75 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:56.347559 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c8a20717-cd1e-4db8-bc7f-5bb595f2dd75 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:56.352258 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c8a20717-cd1e-4db8-bc7f-5bb595f2dd75 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:56.432709 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c8a20717-cd1e-4db8-bc7f-5bb595f2dd75 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:56.445345 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c8a20717-cd1e-4db8-bc7f-5bb595f2dd75 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975" status: 200 len: 1205 microversion: 2.1 time: 0.124274 Oct 26 13:15:56.462467 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1585/3182] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:56 2022] GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975 => generated 1205 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:56.501532 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-aaefe2e8-bccf-47e3-8560-317d35ebbbd9 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:56.502627 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-aaefe2e8-bccf-47e3-8560-317d35ebbbd9 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 6b3fe85a-699d-438b-b809-0539f2fd25b3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:56.512023 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aaefe2e8-bccf-47e3-8560-317d35ebbbd9 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:56.512794 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aaefe2e8-bccf-47e3-8560-317d35ebbbd9 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:56.513247 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aaefe2e8-bccf-47e3-8560-317d35ebbbd9 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:56.514523 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aaefe2e8-bccf-47e3-8560-317d35ebbbd9 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:56.514915 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aaefe2e8-bccf-47e3-8560-317d35ebbbd9 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:56.515521 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aaefe2e8-bccf-47e3-8560-317d35ebbbd9 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:56.545024 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4b0abc7a-8154-4c36-a1a2-4ebe030bb8a6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:56.560212 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4b0abc7a-8154-4c36-a1a2-4ebe030bb8a6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c" status: 200 len: 1717 microversion: 2.1 time: 0.593640 Oct 26 13:15:56.560805 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1598/3183] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:55 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c => generated 1717 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:56.589801 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0d8b7955-f5db-4818-8dcf-572044228fa5 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:56.590430 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0d8b7955-f5db-4818-8dcf-572044228fa5 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: d0b8440f-677e-428d-8566-29fe4624fce1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:56.609829 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0d8b7955-f5db-4818-8dcf-572044228fa5 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:56.610328 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0d8b7955-f5db-4818-8dcf-572044228fa5 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:56.610767 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0d8b7955-f5db-4818-8dcf-572044228fa5 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:56.611477 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0d8b7955-f5db-4818-8dcf-572044228fa5 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:56.611931 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0d8b7955-f5db-4818-8dcf-572044228fa5 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:56.612353 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0d8b7955-f5db-4818-8dcf-572044228fa5 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:56.730357 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-aaefe2e8-bccf-47e3-8560-317d35ebbbd9 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13285463ba34e89931d667bc327bb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875ebd1c99c746f7b4f1a3c08156e6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:56.739204 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-aaefe2e8-bccf-47e3-8560-317d35ebbbd9 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "GET /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3" status: 200 len: 1316 microversion: 2.1 time: 0.242218 Oct 26 13:15:56.740134 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1586/3184] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:56 2022] GET /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3 => generated 1316 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:56.838056 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b3756275-3053-4e79-a674-410c8a1604c4 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:56.838726 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b3756275-3053-4e79-a674-410c8a1604c4 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:56.851976 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3756275-3053-4e79-a674-410c8a1604c4 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:56.855938 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3756275-3053-4e79-a674-410c8a1604c4 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:56.856480 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3756275-3053-4e79-a674-410c8a1604c4 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:56.857408 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3756275-3053-4e79-a674-410c8a1604c4 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:56.859654 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3756275-3053-4e79-a674-410c8a1604c4 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:56.861164 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3756275-3053-4e79-a674-410c8a1604c4 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:57.123020 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b3756275-3053-4e79-a674-410c8a1604c4 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:57.135544 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b3756275-3053-4e79-a674-410c8a1604c4 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:57.138490 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b3756275-3053-4e79-a674-410c8a1604c4 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:57.139694 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b3756275-3053-4e79-a674-410c8a1604c4 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1879 microversion: 2.42 time: 0.307376 Oct 26 13:15:57.153525 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1587/3185] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:15:56 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1879 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:15:57.229100 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-75cf6a7e-ea3d-435d-abf5-db4fca9f5d6d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1852432-c514-4ea8-b96a-e4d142fe3d24"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:15:57.233012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-75cf6a7e-ea3d-435d-abf5-db4fca9f5d6d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 789a55e0-21ba-4b2e-b8d4-c95999955e2b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:57.252320 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-75cf6a7e-ea3d-435d-abf5-db4fca9f5d6d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:57.253605 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-75cf6a7e-ea3d-435d-abf5-db4fca9f5d6d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:57.254915 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-75cf6a7e-ea3d-435d-abf5-db4fca9f5d6d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:57.257165 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-75cf6a7e-ea3d-435d-abf5-db4fca9f5d6d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:57.258663 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-75cf6a7e-ea3d-435d-abf5-db4fca9f5d6d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:57.259161 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-75cf6a7e-ea3d-435d-abf5-db4fca9f5d6d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:57.277151 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0d8b7955-f5db-4818-8dcf-572044228fa5 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:57.288013 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0d8b7955-f5db-4818-8dcf-572044228fa5 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1" status: 200 len: 1503 microversion: 2.1 time: 0.720555 Oct 26 13:15:57.289907 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1599/3186] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:56 2022] GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1 => generated 1503 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:57.338373 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-85511994-63fe-4a4c-9fef-3830f8289f64 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:57.339463 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-85511994-63fe-4a4c-9fef-3830f8289f64 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 7d459ce7-b3e3-4ae8-868b-2ff408d2c200] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:57.346691 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-85511994-63fe-4a4c-9fef-3830f8289f64 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:57.347254 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-85511994-63fe-4a4c-9fef-3830f8289f64 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:57.347626 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-85511994-63fe-4a4c-9fef-3830f8289f64 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:57.348783 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-85511994-63fe-4a4c-9fef-3830f8289f64 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:57.349568 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-85511994-63fe-4a4c-9fef-3830f8289f64 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:57.350027 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-85511994-63fe-4a4c-9fef-3830f8289f64 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:57.802892 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-85511994-63fe-4a4c-9fef-3830f8289f64 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:57.812644 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-85511994-63fe-4a4c-9fef-3830f8289f64 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200" status: 200 len: 1318 microversion: 2.1 time: 0.478170 Oct 26 13:15:57.823958 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1600/3187] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:57 2022] GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200 => generated 1318 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:15:57.830270 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d82f9361-1d4d-4315-a1bb-0cd0fdad8989 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:57.838471 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d82f9361-1d4d-4315-a1bb-0cd0fdad8989 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 8718e439-6247-480e-9887-eab549630975] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:57.853359 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d82f9361-1d4d-4315-a1bb-0cd0fdad8989 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:57.857940 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d82f9361-1d4d-4315-a1bb-0cd0fdad8989 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:57.858606 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d82f9361-1d4d-4315-a1bb-0cd0fdad8989 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:57.859520 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d82f9361-1d4d-4315-a1bb-0cd0fdad8989 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:57.860189 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d82f9361-1d4d-4315-a1bb-0cd0fdad8989 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:57.860791 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d82f9361-1d4d-4315-a1bb-0cd0fdad8989 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:57.998981 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d82f9361-1d4d-4315-a1bb-0cd0fdad8989 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:58.019632 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d82f9361-1d4d-4315-a1bb-0cd0fdad8989 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975" status: 200 len: 1267 microversion: 2.1 time: 0.193413 Oct 26 13:15:58.020236 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1601/3188] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:57 2022] GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975 => generated 1267 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:58.030749 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ebfccf48-2a4d-4c59-b982-9a7b303b0251 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:58.031374 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ebfccf48-2a4d-4c59-b982-9a7b303b0251 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:58.040919 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ebfccf48-2a4d-4c59-b982-9a7b303b0251 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:58.041786 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ebfccf48-2a4d-4c59-b982-9a7b303b0251 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:58.044001 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ebfccf48-2a4d-4c59-b982-9a7b303b0251 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:58.050203 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ebfccf48-2a4d-4c59-b982-9a7b303b0251 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:58.053800 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ebfccf48-2a4d-4c59-b982-9a7b303b0251 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:58.054469 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ebfccf48-2a4d-4c59-b982-9a7b303b0251 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:58.333015 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ebfccf48-2a4d-4c59-b982-9a7b303b0251 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:58.342349 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ebfccf48-2a4d-4c59-b982-9a7b303b0251 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c" status: 200 len: 1717 microversion: 2.1 time: 0.318274 Oct 26 13:15:58.350524 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1602/3189] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:58 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c => generated 1717 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:58.356208 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5ef9e680-e49a-4afd-8ada-3707eb6be879 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:58.359134 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5ef9e680-e49a-4afd-8ada-3707eb6be879 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 6b3fe85a-699d-438b-b809-0539f2fd25b3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:58.367025 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ef9e680-e49a-4afd-8ada-3707eb6be879 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:58.367524 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ef9e680-e49a-4afd-8ada-3707eb6be879 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:58.367970 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ef9e680-e49a-4afd-8ada-3707eb6be879 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:58.368677 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ef9e680-e49a-4afd-8ada-3707eb6be879 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:58.375378 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ef9e680-e49a-4afd-8ada-3707eb6be879 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:58.381656 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ef9e680-e49a-4afd-8ada-3707eb6be879 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:58.419467 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-75cf6a7e-ea3d-435d-abf5-db4fca9f5d6d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "POST /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.195168 Oct 26 13:15:58.426218 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1588/3190] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Oct 26 13:15:57 2022] POST /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b/os-volume_attachments => generated 194 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:15:58.445874 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-aa741020-bf22-49ec-a0ab-f6f0c2ad7d14 req-90ecac87-30be-473b-93ca-4fc73e866e39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d459ce7-b3e3-4ae8-868b-2ff408d2c200", "tag": "c1c64a7d-ef07-46c0-9c88-01d86fb7dd9b"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:15:58.476253 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-aa741020-bf22-49ec-a0ab-f6f0c2ad7d14 req-90ecac87-30be-473b-93ca-4fc73e866e39 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:58.476978 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-aa741020-bf22-49ec-a0ab-f6f0c2ad7d14 req-90ecac87-30be-473b-93ca-4fc73e866e39 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:58.478085 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-aa741020-bf22-49ec-a0ab-f6f0c2ad7d14 req-90ecac87-30be-473b-93ca-4fc73e866e39 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:58.502299 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-aa741020-bf22-49ec-a0ab-f6f0c2ad7d14 req-90ecac87-30be-473b-93ca-4fc73e866e39 service nova] Creating event network-changed:c1c64a7d-ef07-46c0-9c88-01d86fb7dd9b for instance 7d459ce7-b3e3-4ae8-868b-2ff408d2c200 on n-h2-862686-1 Oct 26 13:15:58.512801 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-aa741020-bf22-49ec-a0ab-f6f0c2ad7d14 req-90ecac87-30be-473b-93ca-4fc73e866e39 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089912 Oct 26 13:15:58.520818 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1589/3191] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:15:58.531032 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4ea37d19-d8b5-4c51-975c-ea6d868eb86a tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:58.531748 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4ea37d19-d8b5-4c51-975c-ea6d868eb86a tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:58.552775 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4ea37d19-d8b5-4c51-975c-ea6d868eb86a tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:58.553279 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4ea37d19-d8b5-4c51-975c-ea6d868eb86a tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:58.559016 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4ea37d19-d8b5-4c51-975c-ea6d868eb86a tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:58.560243 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4ea37d19-d8b5-4c51-975c-ea6d868eb86a tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:58.560959 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4ea37d19-d8b5-4c51-975c-ea6d868eb86a tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:58.563374 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4ea37d19-d8b5-4c51-975c-ea6d868eb86a tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:58.936077 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5ef9e680-e49a-4afd-8ada-3707eb6be879 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13285463ba34e89931d667bc327bb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875ebd1c99c746f7b4f1a3c08156e6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:58.946530 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5ef9e680-e49a-4afd-8ada-3707eb6be879 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "GET /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3" status: 200 len: 1316 microversion: 2.1 time: 0.594508 Oct 26 13:15:58.952408 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1603/3192] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:58 2022] GET /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3 => generated 1316 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:58.964690 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-09471cf5-348d-490c-836a-d877c41e708a tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:58.965861 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-09471cf5-348d-490c-836a-d877c41e708a tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 7d459ce7-b3e3-4ae8-868b-2ff408d2c200] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:58.983348 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09471cf5-348d-490c-836a-d877c41e708a tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:58.983957 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09471cf5-348d-490c-836a-d877c41e708a tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:58.990167 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09471cf5-348d-490c-836a-d877c41e708a tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:58.997055 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09471cf5-348d-490c-836a-d877c41e708a tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:58.998183 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09471cf5-348d-490c-836a-d877c41e708a tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:58.998863 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09471cf5-348d-490c-836a-d877c41e708a tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:59.499570 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-09471cf5-348d-490c-836a-d877c41e708a tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:59.509787 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-09471cf5-348d-490c-836a-d877c41e708a tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200" status: 200 len: 1318 microversion: 2.1 time: 0.555831 Oct 26 13:15:59.514381 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1604/3193] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:58 2022] GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200 => generated 1318 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:59.519312 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-18e0ff78-30b7-4935-83b2-380c26a3691b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:59.520205 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-18e0ff78-30b7-4935-83b2-380c26a3691b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 8718e439-6247-480e-9887-eab549630975] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:59.533415 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18e0ff78-30b7-4935-83b2-380c26a3691b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:59.538240 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18e0ff78-30b7-4935-83b2-380c26a3691b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:59.542801 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18e0ff78-30b7-4935-83b2-380c26a3691b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:59.546998 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18e0ff78-30b7-4935-83b2-380c26a3691b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:59.550247 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18e0ff78-30b7-4935-83b2-380c26a3691b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:59.552992 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18e0ff78-30b7-4935-83b2-380c26a3691b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:59.590754 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4ea37d19-d8b5-4c51-975c-ea6d868eb86a tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:59.603703 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4ea37d19-d8b5-4c51-975c-ea6d868eb86a tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:59.611721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4ea37d19-d8b5-4c51-975c-ea6d868eb86a tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:59.624137 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4ea37d19-d8b5-4c51-975c-ea6d868eb86a tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1879 microversion: 2.42 time: 1.095843 Oct 26 13:15:59.625673 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1590/3194] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:15:58 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1879 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:15:59.655181 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4eacd117-fcf1-4e3b-9fb9-45eeab58c25e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:59.659726 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4eacd117-fcf1-4e3b-9fb9-45eeab58c25e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:59.669652 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4eacd117-fcf1-4e3b-9fb9-45eeab58c25e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:59.670390 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4eacd117-fcf1-4e3b-9fb9-45eeab58c25e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:59.671025 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4eacd117-fcf1-4e3b-9fb9-45eeab58c25e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:59.671919 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4eacd117-fcf1-4e3b-9fb9-45eeab58c25e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:15:59.672542 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4eacd117-fcf1-4e3b-9fb9-45eeab58c25e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:15:59.673126 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4eacd117-fcf1-4e3b-9fb9-45eeab58c25e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:15:59.772383 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:15:59.947778 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-18e0ff78-30b7-4935-83b2-380c26a3691b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:59.967660 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-18e0ff78-30b7-4935-83b2-380c26a3691b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975" status: 200 len: 1309 microversion: 2.1 time: 0.448689 Oct 26 13:15:59.968346 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1605/3195] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:59 2022] GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975 => generated 1309 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:15:59.985041 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4eacd117-fcf1-4e3b-9fb9-45eeab58c25e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:15:59.985209 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-605ca867-e252-4595-8475-f8d9d60979dd tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:15:59.986865 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-605ca867-e252-4595-8475-f8d9d60979dd tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 6b3fe85a-699d-438b-b809-0539f2fd25b3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:15:59.997460 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4eacd117-fcf1-4e3b-9fb9-45eeab58c25e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c" status: 200 len: 1717 microversion: 2.1 time: 0.351842 Oct 26 13:15:59.998430 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1591/3196] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:59 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c => generated 1717 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:00.012917 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-605ca867-e252-4595-8475-f8d9d60979dd tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:00.016847 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-605ca867-e252-4595-8475-f8d9d60979dd tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:00.017309 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-605ca867-e252-4595-8475-f8d9d60979dd tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:00.018072 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-605ca867-e252-4595-8475-f8d9d60979dd tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:00.018556 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-605ca867-e252-4595-8475-f8d9d60979dd tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:00.018961 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-605ca867-e252-4595-8475-f8d9d60979dd tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:00.254746 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-605ca867-e252-4595-8475-f8d9d60979dd tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13285463ba34e89931d667bc327bb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875ebd1c99c746f7b4f1a3c08156e6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:00.265712 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-605ca867-e252-4595-8475-f8d9d60979dd tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "GET /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3" status: 200 len: 1316 microversion: 2.1 time: 0.290175 Oct 26 13:16:00.272866 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1606/3197] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:15:59 2022] GET /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3 => generated 1316 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:00.548155 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b0179d31-e394-48fd-b770-b6db25481f0e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:00.548891 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b0179d31-e394-48fd-b770-b6db25481f0e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 7d459ce7-b3e3-4ae8-868b-2ff408d2c200] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:00.567147 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b0179d31-e394-48fd-b770-b6db25481f0e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:00.570268 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b0179d31-e394-48fd-b770-b6db25481f0e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:00.570854 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b0179d31-e394-48fd-b770-b6db25481f0e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:00.571802 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b0179d31-e394-48fd-b770-b6db25481f0e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:00.574386 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b0179d31-e394-48fd-b770-b6db25481f0e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:00.575121 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b0179d31-e394-48fd-b770-b6db25481f0e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:00.654894 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-64e8570f-e81d-40b5-902a-5020ea50aa52 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:00.655699 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-64e8570f-e81d-40b5-902a-5020ea50aa52 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:00.665781 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64e8570f-e81d-40b5-902a-5020ea50aa52 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:00.668029 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64e8570f-e81d-40b5-902a-5020ea50aa52 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:00.669956 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64e8570f-e81d-40b5-902a-5020ea50aa52 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:00.670894 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64e8570f-e81d-40b5-902a-5020ea50aa52 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:00.671610 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64e8570f-e81d-40b5-902a-5020ea50aa52 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:00.673837 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64e8570f-e81d-40b5-902a-5020ea50aa52 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:00.995762 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b0179d31-e394-48fd-b770-b6db25481f0e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:01.023446 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b0179d31-e394-48fd-b770-b6db25481f0e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200" status: 200 len: 1318 microversion: 2.1 time: 0.491540 Oct 26 13:16:01.043242 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1592/3198] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:00 2022] GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200 => generated 1318 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:01.059264 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-de91e11c-21ef-472f-9636-67a79246fa1e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bc3573b6-586b-4947-bc7f-20b1d579c59c"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:16:01.063792 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-de91e11c-21ef-472f-9636-67a79246fa1e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: d0b8440f-677e-428d-8566-29fe4624fce1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:01.071648 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de91e11c-21ef-472f-9636-67a79246fa1e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:01.072479 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de91e11c-21ef-472f-9636-67a79246fa1e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:01.073156 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de91e11c-21ef-472f-9636-67a79246fa1e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:01.075203 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de91e11c-21ef-472f-9636-67a79246fa1e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:01.076530 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de91e11c-21ef-472f-9636-67a79246fa1e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:01.077198 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de91e11c-21ef-472f-9636-67a79246fa1e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:01.564100 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-de91e11c-21ef-472f-9636-67a79246fa1e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "POST /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.519016 Oct 26 13:16:01.566537 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1593/3199] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Oct 26 13:16:01 2022] POST /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1/os-volume_attachments => generated 194 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:16:01.581410 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-747e4378-b44a-4b2e-9a54-6aeaf7fb9a83 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:01.582757 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-747e4378-b44a-4b2e-9a54-6aeaf7fb9a83 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 8718e439-6247-480e-9887-eab549630975] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:01.593463 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-747e4378-b44a-4b2e-9a54-6aeaf7fb9a83 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:01.594049 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-747e4378-b44a-4b2e-9a54-6aeaf7fb9a83 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:01.594689 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-747e4378-b44a-4b2e-9a54-6aeaf7fb9a83 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:01.595582 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-747e4378-b44a-4b2e-9a54-6aeaf7fb9a83 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:01.596524 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-747e4378-b44a-4b2e-9a54-6aeaf7fb9a83 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:01.597134 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-747e4378-b44a-4b2e-9a54-6aeaf7fb9a83 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:01.688505 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-64e8570f-e81d-40b5-902a-5020ea50aa52 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:01.722200 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-64e8570f-e81d-40b5-902a-5020ea50aa52 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:01.728525 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-64e8570f-e81d-40b5-902a-5020ea50aa52 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:01.734344 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-64e8570f-e81d-40b5-902a-5020ea50aa52 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1879 microversion: 2.42 time: 1.082453 Oct 26 13:16:01.736091 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1607/3200] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:16:00 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1879 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:16:01.755268 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-833aa69f-e698-4911-ab4d-80b03be9df86 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:01.757971 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-833aa69f-e698-4911-ab4d-80b03be9df86 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:01.789988 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-833aa69f-e698-4911-ab4d-80b03be9df86 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:01.790533 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-833aa69f-e698-4911-ab4d-80b03be9df86 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:01.790992 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-833aa69f-e698-4911-ab4d-80b03be9df86 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:01.796130 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-833aa69f-e698-4911-ab4d-80b03be9df86 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:01.796654 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-833aa69f-e698-4911-ab4d-80b03be9df86 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:01.797108 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-833aa69f-e698-4911-ab4d-80b03be9df86 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:01.962241 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-747e4378-b44a-4b2e-9a54-6aeaf7fb9a83 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:01.978779 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-747e4378-b44a-4b2e-9a54-6aeaf7fb9a83 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975" status: 200 len: 1309 microversion: 2.1 time: 0.404597 Oct 26 13:16:01.980176 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1594/3201] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:01 2022] GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975 => generated 1309 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:01.991013 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-63fd2be7-a756-4e87-815c-fdb5ec898d6f req-0344701c-7839-4a1b-997e-7b7721c487fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8718e439-6247-480e-9887-eab549630975", "tag": "7e6108c5-cc9c-4df8-828e-0fdfced3896d"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:16:02.003063 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-63fd2be7-a756-4e87-815c-fdb5ec898d6f req-0344701c-7839-4a1b-997e-7b7721c487fe service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:02.004378 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-63fd2be7-a756-4e87-815c-fdb5ec898d6f req-0344701c-7839-4a1b-997e-7b7721c487fe service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:02.005571 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-63fd2be7-a756-4e87-815c-fdb5ec898d6f req-0344701c-7839-4a1b-997e-7b7721c487fe service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:02.020083 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-63fd2be7-a756-4e87-815c-fdb5ec898d6f req-0344701c-7839-4a1b-997e-7b7721c487fe service nova] Creating event network-changed:7e6108c5-cc9c-4df8-828e-0fdfced3896d for instance 8718e439-6247-480e-9887-eab549630975 on n-h1-862686-1 Oct 26 13:16:02.031192 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-63fd2be7-a756-4e87-815c-fdb5ec898d6f req-0344701c-7839-4a1b-997e-7b7721c487fe service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045045 Oct 26 13:16:02.036184 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1595/3202] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:16:02.041717 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-35e8aa4c-bc60-4781-ac98-b0433653372d tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:02.043474 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-35e8aa4c-bc60-4781-ac98-b0433653372d tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 6b3fe85a-699d-438b-b809-0539f2fd25b3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:02.051889 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-35e8aa4c-bc60-4781-ac98-b0433653372d tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:02.052616 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-35e8aa4c-bc60-4781-ac98-b0433653372d tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:02.053235 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-35e8aa4c-bc60-4781-ac98-b0433653372d tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:02.054136 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-35e8aa4c-bc60-4781-ac98-b0433653372d tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:02.054754 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-35e8aa4c-bc60-4781-ac98-b0433653372d tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:02.055426 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-35e8aa4c-bc60-4781-ac98-b0433653372d tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:02.255051 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-35e8aa4c-bc60-4781-ac98-b0433653372d tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13285463ba34e89931d667bc327bb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875ebd1c99c746f7b4f1a3c08156e6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:02.269089 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-35e8aa4c-bc60-4781-ac98-b0433653372d tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "GET /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3" status: 200 len: 1316 microversion: 2.1 time: 0.227059 Oct 26 13:16:02.270311 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1596/3203] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:02 2022] GET /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3 => generated 1316 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:02.282658 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d372f7bc-e317-487c-8860-a131c3cfc445 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:02.283734 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d372f7bc-e317-487c-8860-a131c3cfc445 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 7d459ce7-b3e3-4ae8-868b-2ff408d2c200] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:02.297717 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d372f7bc-e317-487c-8860-a131c3cfc445 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:02.298370 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d372f7bc-e317-487c-8860-a131c3cfc445 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:02.298922 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d372f7bc-e317-487c-8860-a131c3cfc445 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:02.299763 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d372f7bc-e317-487c-8860-a131c3cfc445 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:02.300498 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d372f7bc-e317-487c-8860-a131c3cfc445 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:02.301035 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d372f7bc-e317-487c-8860-a131c3cfc445 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:02.577223 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d372f7bc-e317-487c-8860-a131c3cfc445 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:02.592202 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d372f7bc-e317-487c-8860-a131c3cfc445 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200" status: 200 len: 1318 microversion: 2.1 time: 0.319922 Oct 26 13:16:02.593101 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1597/3204] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:02 2022] GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200 => generated 1318 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:02.766508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2fad7c91-36b2-466a-83ca-528f3b9669aa tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:02.767120 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2fad7c91-36b2-466a-83ca-528f3b9669aa tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:02.776905 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2fad7c91-36b2-466a-83ca-528f3b9669aa tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:02.778747 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2fad7c91-36b2-466a-83ca-528f3b9669aa tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:02.780730 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2fad7c91-36b2-466a-83ca-528f3b9669aa tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:02.783565 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2fad7c91-36b2-466a-83ca-528f3b9669aa tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:02.784239 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2fad7c91-36b2-466a-83ca-528f3b9669aa tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:02.784880 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2fad7c91-36b2-466a-83ca-528f3b9669aa tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:02.825221 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-833aa69f-e698-4911-ab4d-80b03be9df86 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:02.834352 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-833aa69f-e698-4911-ab4d-80b03be9df86 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c" status: 200 len: 1717 microversion: 2.1 time: 1.095938 Oct 26 13:16:02.840843 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1608/3205] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:01 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c => generated 1717 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:03.003456 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1b50c83e-534a-4aca-b2f3-1f0dce29cee8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:03.004324 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1b50c83e-534a-4aca-b2f3-1f0dce29cee8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 8718e439-6247-480e-9887-eab549630975] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:03.012696 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b50c83e-534a-4aca-b2f3-1f0dce29cee8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:03.015164 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b50c83e-534a-4aca-b2f3-1f0dce29cee8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:03.016745 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b50c83e-534a-4aca-b2f3-1f0dce29cee8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:03.022456 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b50c83e-534a-4aca-b2f3-1f0dce29cee8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:03.033931 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b50c83e-534a-4aca-b2f3-1f0dce29cee8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:03.034745 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b50c83e-534a-4aca-b2f3-1f0dce29cee8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:03.232558 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=4 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:16:03.272590 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=14 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:16:03.619158 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1b50c83e-534a-4aca-b2f3-1f0dce29cee8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:03.630571 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1b50c83e-534a-4aca-b2f3-1f0dce29cee8 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975" status: 200 len: 1309 microversion: 2.1 time: 0.631514 Oct 26 13:16:03.631145 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1609/3206] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:02 2022] GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975 => generated 1309 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:16:03.650856 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-070df4f5-5dfe-47d9-98e3-4498d5ceffa2 req-84e0cdf8-8c25-45b7-97b6-6126d74d0922 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b3fe85a-699d-438b-b809-0539f2fd25b3", "name": "network-vif-plugged", "status": "completed", "tag": "f95eafb3-a2e9-4243-a442-390ae39acdbe"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:16:03.672643 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-070df4f5-5dfe-47d9-98e3-4498d5ceffa2 req-84e0cdf8-8c25-45b7-97b6-6126d74d0922 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:03.673940 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-070df4f5-5dfe-47d9-98e3-4498d5ceffa2 req-84e0cdf8-8c25-45b7-97b6-6126d74d0922 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:03.681014 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-070df4f5-5dfe-47d9-98e3-4498d5ceffa2 req-84e0cdf8-8c25-45b7-97b6-6126d74d0922 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:03.683798 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2fad7c91-36b2-466a-83ca-528f3b9669aa tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:03.696199 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=12 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:16:03.699011 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:16:03.701762 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-070df4f5-5dfe-47d9-98e3-4498d5ceffa2 req-84e0cdf8-8c25-45b7-97b6-6126d74d0922 service nova] Creating event network-vif-plugged:f95eafb3-a2e9-4243-a442-390ae39acdbe for instance 6b3fe85a-699d-438b-b809-0539f2fd25b3 on n-h2-862686-1 Oct 26 13:16:03.705238 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2fad7c91-36b2-466a-83ca-528f3b9669aa tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:03.709207 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2fad7c91-36b2-466a-83ca-528f3b9669aa tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:03.712773 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2fad7c91-36b2-466a-83ca-528f3b9669aa tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1879 microversion: 2.42 time: 0.950373 Oct 26 13:16:03.726102 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-070df4f5-5dfe-47d9-98e3-4498d5ceffa2 req-84e0cdf8-8c25-45b7-97b6-6126d74d0922 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073219 Oct 26 13:16:03.726102 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1610/3207] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:16:03.728012 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1598/3208] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:16:02 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1879 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:16:03.741823 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-086ffca6-6b59-409d-ad0a-c1fbf6f29a79 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:03.742532 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-086ffca6-6b59-409d-ad0a-c1fbf6f29a79 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 6b3fe85a-699d-438b-b809-0539f2fd25b3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:03.746019 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0731567e-79aa-44a7-892f-95f24406a054 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:03.747321 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0731567e-79aa-44a7-892f-95f24406a054 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 7d459ce7-b3e3-4ae8-868b-2ff408d2c200] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:03.759016 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0731567e-79aa-44a7-892f-95f24406a054 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:03.759715 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0731567e-79aa-44a7-892f-95f24406a054 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:03.760260 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0731567e-79aa-44a7-892f-95f24406a054 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:03.761628 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0731567e-79aa-44a7-892f-95f24406a054 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:03.762310 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0731567e-79aa-44a7-892f-95f24406a054 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:03.762891 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0731567e-79aa-44a7-892f-95f24406a054 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:03.784058 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-086ffca6-6b59-409d-ad0a-c1fbf6f29a79 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:03.798291 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-086ffca6-6b59-409d-ad0a-c1fbf6f29a79 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:03.799038 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-086ffca6-6b59-409d-ad0a-c1fbf6f29a79 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:03.800774 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-086ffca6-6b59-409d-ad0a-c1fbf6f29a79 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:03.802559 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-086ffca6-6b59-409d-ad0a-c1fbf6f29a79 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:03.804271 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-086ffca6-6b59-409d-ad0a-c1fbf6f29a79 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:04.052112 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0731567e-79aa-44a7-892f-95f24406a054 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:04.061763 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0731567e-79aa-44a7-892f-95f24406a054 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200" status: 200 len: 1318 microversion: 2.1 time: 0.323109 Oct 26 13:16:04.068195 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1599/3209] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:03 2022] GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200 => generated 1318 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:04.081213 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-afdd5400-cc91-459a-b10d-d32b74ff94d0 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:04.082149 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-afdd5400-cc91-459a-b10d-d32b74ff94d0 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:04.085453 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-086ffca6-6b59-409d-ad0a-c1fbf6f29a79 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13285463ba34e89931d667bc327bb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875ebd1c99c746f7b4f1a3c08156e6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:04.098236 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afdd5400-cc91-459a-b10d-d32b74ff94d0 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:04.098976 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afdd5400-cc91-459a-b10d-d32b74ff94d0 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:04.099624 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afdd5400-cc91-459a-b10d-d32b74ff94d0 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:04.102916 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-086ffca6-6b59-409d-ad0a-c1fbf6f29a79 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "GET /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3" status: 200 len: 1316 microversion: 2.1 time: 0.379035 Oct 26 13:16:04.117508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afdd5400-cc91-459a-b10d-d32b74ff94d0 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:04.117508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afdd5400-cc91-459a-b10d-d32b74ff94d0 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:04.117508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afdd5400-cc91-459a-b10d-d32b74ff94d0 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:04.120925 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1611/3210] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:03 2022] GET /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3 => generated 1316 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:04.424828 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-afdd5400-cc91-459a-b10d-d32b74ff94d0 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:04.435458 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-afdd5400-cc91-459a-b10d-d32b74ff94d0 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c" status: 200 len: 1717 microversion: 2.1 time: 0.365817 Oct 26 13:16:04.438133 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1600/3211] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:04 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c => generated 1717 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:04.657382 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b2698df7-2cd9-49a5-a38c-21ef12fd7611 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:04.658680 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b2698df7-2cd9-49a5-a38c-21ef12fd7611 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 8718e439-6247-480e-9887-eab549630975] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:04.675343 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b2698df7-2cd9-49a5-a38c-21ef12fd7611 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:04.677378 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b2698df7-2cd9-49a5-a38c-21ef12fd7611 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:04.680539 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b2698df7-2cd9-49a5-a38c-21ef12fd7611 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:04.682023 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b2698df7-2cd9-49a5-a38c-21ef12fd7611 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:04.685835 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b2698df7-2cd9-49a5-a38c-21ef12fd7611 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:04.686509 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b2698df7-2cd9-49a5-a38c-21ef12fd7611 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:04.742587 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0f332016-1a3c-4be7-87b9-85f65d085e98 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:04.743850 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0f332016-1a3c-4be7-87b9-85f65d085e98 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:04.756251 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f332016-1a3c-4be7-87b9-85f65d085e98 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:04.768107 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f332016-1a3c-4be7-87b9-85f65d085e98 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:04.768803 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f332016-1a3c-4be7-87b9-85f65d085e98 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:04.769765 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f332016-1a3c-4be7-87b9-85f65d085e98 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:04.770424 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f332016-1a3c-4be7-87b9-85f65d085e98 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:04.771317 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f332016-1a3c-4be7-87b9-85f65d085e98 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:05.077087 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b2698df7-2cd9-49a5-a38c-21ef12fd7611 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:05.078137 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0f332016-1a3c-4be7-87b9-85f65d085e98 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:05.087460 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b2698df7-2cd9-49a5-a38c-21ef12fd7611 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975" status: 200 len: 1309 microversion: 2.1 time: 0.435169 Oct 26 13:16:05.088160 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0f332016-1a3c-4be7-87b9-85f65d085e98 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:05.090197 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1612/3212] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:04 2022] GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975 => generated 1309 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:05.092353 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0f332016-1a3c-4be7-87b9-85f65d085e98 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:05.093606 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0f332016-1a3c-4be7-87b9-85f65d085e98 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1879 microversion: 2.42 time: 0.354897 Oct 26 13:16:05.105505 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1601/3213] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:16:04 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1879 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:16:05.105700 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-720dad2b-9cc4-4500-82a7-5db280167350 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:05.105700 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-720dad2b-9cc4-4500-82a7-5db280167350 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 7d459ce7-b3e3-4ae8-868b-2ff408d2c200] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:05.114889 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-720dad2b-9cc4-4500-82a7-5db280167350 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:05.115402 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-720dad2b-9cc4-4500-82a7-5db280167350 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:05.116435 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-720dad2b-9cc4-4500-82a7-5db280167350 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:05.117399 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-720dad2b-9cc4-4500-82a7-5db280167350 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:05.118097 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-720dad2b-9cc4-4500-82a7-5db280167350 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:05.118731 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-720dad2b-9cc4-4500-82a7-5db280167350 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:05.134363 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4dabddd7-2fae-4853-9c27-254fbe4b58c4 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:05.134971 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4dabddd7-2fae-4853-9c27-254fbe4b58c4 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 6b3fe85a-699d-438b-b809-0539f2fd25b3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:05.146926 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4dabddd7-2fae-4853-9c27-254fbe4b58c4 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:05.148034 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4dabddd7-2fae-4853-9c27-254fbe4b58c4 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:05.149024 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4dabddd7-2fae-4853-9c27-254fbe4b58c4 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:05.152414 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4dabddd7-2fae-4853-9c27-254fbe4b58c4 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:05.153030 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4dabddd7-2fae-4853-9c27-254fbe4b58c4 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:05.153547 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4dabddd7-2fae-4853-9c27-254fbe4b58c4 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:05.345771 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-720dad2b-9cc4-4500-82a7-5db280167350 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:05.348651 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:16:05.364614 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-720dad2b-9cc4-4500-82a7-5db280167350 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200" status: 200 len: 1318 microversion: 2.1 time: 0.271208 Oct 26 13:16:05.366757 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1613/3214] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:05 2022] GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200 => generated 1318 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:05.419492 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4dabddd7-2fae-4853-9c27-254fbe4b58c4 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13285463ba34e89931d667bc327bb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875ebd1c99c746f7b4f1a3c08156e6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:05.433175 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4dabddd7-2fae-4853-9c27-254fbe4b58c4 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "GET /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3" status: 200 len: 1316 microversion: 2.1 time: 0.301974 Oct 26 13:16:05.437208 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1602/3215] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:05 2022] GET /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3 => generated 1316 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:16:05.463527 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ac684d92-afc7-4e05-a596-bec662dddd05 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:05.471543 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ac684d92-afc7-4e05-a596-bec662dddd05 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:05.481044 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ac684d92-afc7-4e05-a596-bec662dddd05 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:05.482537 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ac684d92-afc7-4e05-a596-bec662dddd05 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:05.483604 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ac684d92-afc7-4e05-a596-bec662dddd05 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:05.484847 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ac684d92-afc7-4e05-a596-bec662dddd05 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:05.485763 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ac684d92-afc7-4e05-a596-bec662dddd05 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:05.486718 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ac684d92-afc7-4e05-a596-bec662dddd05 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:05.732770 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ac684d92-afc7-4e05-a596-bec662dddd05 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:05.747217 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ac684d92-afc7-4e05-a596-bec662dddd05 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c" status: 200 len: 1707 microversion: 2.1 time: 0.287877 Oct 26 13:16:05.755373 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1614/3216] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:05 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c => generated 1707 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:05.769935 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-03fc151f-d961-4abc-8031-0c957ea84a76 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Calling method '.version_select at 0x7f67325c5790>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:05.774521 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03fc151f-d961-4abc-8031-0c957ea84a76 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:05.775192 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03fc151f-d961-4abc-8031-0c957ea84a76 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:05.782439 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03fc151f-d961-4abc-8031-0c957ea84a76 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:05.798939 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-03fc151f-d961-4abc-8031-0c957ea84a76 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 1168 microversion: 2.1 time: 0.032644 Oct 26 13:16:05.808833 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1603/3217] 10.222.0.40 () {58 vars in 1143 bytes} [Wed Oct 26 13:16:05 2022] GET /compute/v2.1/os-migrations => generated 1168 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:05.816695 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0bbeb4f1-96a0-4368-86a3-4ecdc6a85092 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:05.817317 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0bbeb4f1-96a0-4368-86a3-4ecdc6a85092 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:05.830164 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0bbeb4f1-96a0-4368-86a3-4ecdc6a85092 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:05.830673 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0bbeb4f1-96a0-4368-86a3-4ecdc6a85092 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:05.831121 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0bbeb4f1-96a0-4368-86a3-4ecdc6a85092 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:05.831852 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0bbeb4f1-96a0-4368-86a3-4ecdc6a85092 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:05.832809 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0bbeb4f1-96a0-4368-86a3-4ecdc6a85092 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:05.833269 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0bbeb4f1-96a0-4368-86a3-4ecdc6a85092 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:06.000140 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0bbeb4f1-96a0-4368-86a3-4ecdc6a85092 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c" status: 200 len: 1858 microversion: 2.1 time: 0.189382 Oct 26 13:16:06.001130 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1615/3218] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:05 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c => generated 1858 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:06.025104 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ce7d25af-bd13-47fa-b46b-fd8c7a5e2615 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:06.025908 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ce7d25af-bd13-47fa-b46b-fd8c7a5e2615 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:06.033151 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ce7d25af-bd13-47fa-b46b-fd8c7a5e2615 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:06.033886 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ce7d25af-bd13-47fa-b46b-fd8c7a5e2615 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:06.035360 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ce7d25af-bd13-47fa-b46b-fd8c7a5e2615 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:06.036357 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ce7d25af-bd13-47fa-b46b-fd8c7a5e2615 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:06.037384 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ce7d25af-bd13-47fa-b46b-fd8c7a5e2615 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:06.038045 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ce7d25af-bd13-47fa-b46b-fd8c7a5e2615 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:06.116280 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-247a5a8f-25d9-48b1-a875-f4b875a34319 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:06.117287 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-247a5a8f-25d9-48b1-a875-f4b875a34319 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 8718e439-6247-480e-9887-eab549630975] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:06.127284 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-247a5a8f-25d9-48b1-a875-f4b875a34319 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:06.130587 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-247a5a8f-25d9-48b1-a875-f4b875a34319 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:06.131029 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-247a5a8f-25d9-48b1-a875-f4b875a34319 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:06.132604 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-247a5a8f-25d9-48b1-a875-f4b875a34319 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:06.133152 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-247a5a8f-25d9-48b1-a875-f4b875a34319 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:06.134496 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-247a5a8f-25d9-48b1-a875-f4b875a34319 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:06.231296 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ce7d25af-bd13-47fa-b46b-fd8c7a5e2615 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c" status: 200 len: 1858 microversion: 2.1 time: 0.210753 Oct 26 13:16:06.232668 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1604/3219] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:06 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c => generated 1858 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:06.237671 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0b830678-814e-4d4b-a588-867678f9fec8 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:06.238226 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0b830678-814e-4d4b-a588-867678f9fec8 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:06.250175 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0b830678-814e-4d4b-a588-867678f9fec8 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:06.250818 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0b830678-814e-4d4b-a588-867678f9fec8 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:06.251574 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0b830678-814e-4d4b-a588-867678f9fec8 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:06.253789 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0b830678-814e-4d4b-a588-867678f9fec8 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:06.256480 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0b830678-814e-4d4b-a588-867678f9fec8 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:06.256962 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0b830678-814e-4d4b-a588-867678f9fec8 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:06.440014 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-247a5a8f-25d9-48b1-a875-f4b875a34319 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:06.447889 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-247a5a8f-25d9-48b1-a875-f4b875a34319 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975" status: 200 len: 1309 microversion: 2.1 time: 0.336729 Oct 26 13:16:06.448418 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1616/3220] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:06 2022] GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975 => generated 1309 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:06.453419 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-43dfbb18-4f60-4cf9-9662-2c3ff9e95db5 req-6f9612de-e340-4b8d-a6db-bf5054e37482 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d459ce7-b3e3-4ae8-868b-2ff408d2c200", "name": "network-vif-plugged", "status": "completed", "tag": "c1c64a7d-ef07-46c0-9c88-01d86fb7dd9b"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:16:06.465179 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-43dfbb18-4f60-4cf9-9662-2c3ff9e95db5 req-6f9612de-e340-4b8d-a6db-bf5054e37482 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:06.465929 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-43dfbb18-4f60-4cf9-9662-2c3ff9e95db5 req-6f9612de-e340-4b8d-a6db-bf5054e37482 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:06.466524 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-43dfbb18-4f60-4cf9-9662-2c3ff9e95db5 req-6f9612de-e340-4b8d-a6db-bf5054e37482 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:06.481523 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-43dfbb18-4f60-4cf9-9662-2c3ff9e95db5 req-6f9612de-e340-4b8d-a6db-bf5054e37482 service nova] Creating event network-vif-plugged:c1c64a7d-ef07-46c0-9c88-01d86fb7dd9b for instance 7d459ce7-b3e3-4ae8-868b-2ff408d2c200 on n-h2-862686-1 Oct 26 13:16:06.489906 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-43dfbb18-4f60-4cf9-9662-2c3ff9e95db5 req-6f9612de-e340-4b8d-a6db-bf5054e37482 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040191 Oct 26 13:16:06.490673 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1617/3221] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:16:06.497568 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d167a5eb-d303-4224-83b3-a8bd6d1e8e1f tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:06.498499 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d167a5eb-d303-4224-83b3-a8bd6d1e8e1f tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 7d459ce7-b3e3-4ae8-868b-2ff408d2c200] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:06.506142 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d167a5eb-d303-4224-83b3-a8bd6d1e8e1f tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:06.506877 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d167a5eb-d303-4224-83b3-a8bd6d1e8e1f tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:06.507487 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d167a5eb-d303-4224-83b3-a8bd6d1e8e1f tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:06.508377 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d167a5eb-d303-4224-83b3-a8bd6d1e8e1f tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:06.508987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d167a5eb-d303-4224-83b3-a8bd6d1e8e1f tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:06.509587 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d167a5eb-d303-4224-83b3-a8bd6d1e8e1f tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:06.558799 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0b830678-814e-4d4b-a588-867678f9fec8 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:06.572526 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0b830678-814e-4d4b-a588-867678f9fec8 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:06.574542 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0b830678-814e-4d4b-a588-867678f9fec8 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:06.575935 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0b830678-814e-4d4b-a588-867678f9fec8 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1879 microversion: 2.42 time: 0.342437 Oct 26 13:16:06.591470 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1605/3222] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:16:06 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1879 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:16:06.605259 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-09fde235-fb09-450d-989f-f407336fc79a tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:06.606617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-09fde235-fb09-450d-989f-f407336fc79a tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 6b3fe85a-699d-438b-b809-0539f2fd25b3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:06.614746 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-09fde235-fb09-450d-989f-f407336fc79a tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:06.615368 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-09fde235-fb09-450d-989f-f407336fc79a tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:06.615994 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-09fde235-fb09-450d-989f-f407336fc79a tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:06.616732 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-09fde235-fb09-450d-989f-f407336fc79a tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:06.617326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-09fde235-fb09-450d-989f-f407336fc79a tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:06.617882 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-09fde235-fb09-450d-989f-f407336fc79a tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:06.665312 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d167a5eb-d303-4224-83b3-a8bd6d1e8e1f tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:06.674633 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d167a5eb-d303-4224-83b3-a8bd6d1e8e1f tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200" status: 200 len: 1318 microversion: 2.1 time: 0.182593 Oct 26 13:16:06.689573 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1618/3223] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:06 2022] GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:06.811318 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-09fde235-fb09-450d-989f-f407336fc79a tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13285463ba34e89931d667bc327bb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875ebd1c99c746f7b4f1a3c08156e6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:06.821886 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-09fde235-fb09-450d-989f-f407336fc79a tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "GET /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3" status: 200 len: 1504 microversion: 2.1 time: 0.228783 Oct 26 13:16:06.822988 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1606/3224] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:06 2022] GET /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3 => generated 1504 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:06.848219 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d7518da5-7cc8-4d5d-8422-96858af24087 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1295053597"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:16:06.848830 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d7518da5-7cc8-4d5d-8422-96858af24087 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 6b3fe85a-699d-438b-b809-0539f2fd25b3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:06.856172 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7518da5-7cc8-4d5d-8422-96858af24087 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:06.857007 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7518da5-7cc8-4d5d-8422-96858af24087 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:06.857723 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7518da5-7cc8-4d5d-8422-96858af24087 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:06.858660 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7518da5-7cc8-4d5d-8422-96858af24087 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:06.859375 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7518da5-7cc8-4d5d-8422-96858af24087 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:06.860041 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7518da5-7cc8-4d5d-8422-96858af24087 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:07.033800 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.network.security_group_api [None req-d7518da5-7cc8-4d5d-8422-96858af24087 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Adding security group 998ece2e-dd9c-454a-88e7-780bfda95e02 to port f95eafb3-a2e9-4243-a442-390ae39acdbe Oct 26 13:16:07.373520 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d7518da5-7cc8-4d5d-8422-96858af24087 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "POST /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3/action" status: 202 len: 0 microversion: 2.1 time: 0.530194 Oct 26 13:16:07.376364 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1619/3225] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:16:06 2022] POST /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3/action => generated 0 bytes in 534 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:16:07.381641 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-45ecdb7e-49f2-4308-828c-bffe34ad5c10 req-16be411b-f42f-4178-b9df-515eb1b55f11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b3fe85a-699d-438b-b809-0539f2fd25b3", "tag": "f95eafb3-a2e9-4243-a442-390ae39acdbe"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:16:07.386202 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1761bb0e-a438-4d24-a3d1-95f150b25ca0 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '.version_select at 0x7f6731b3e0d0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:07.406866 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-45ecdb7e-49f2-4308-828c-bffe34ad5c10 req-16be411b-f42f-4178-b9df-515eb1b55f11 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:07.407359 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-45ecdb7e-49f2-4308-828c-bffe34ad5c10 req-16be411b-f42f-4178-b9df-515eb1b55f11 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:07.413183 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-45ecdb7e-49f2-4308-828c-bffe34ad5c10 req-16be411b-f42f-4178-b9df-515eb1b55f11 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:07.444590 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-45ecdb7e-49f2-4308-828c-bffe34ad5c10 req-16be411b-f42f-4178-b9df-515eb1b55f11 service nova] Creating event network-changed:f95eafb3-a2e9-4243-a442-390ae39acdbe for instance 6b3fe85a-699d-438b-b809-0539f2fd25b3 on n-h2-862686-1 Oct 26 13:16:07.453402 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-45ecdb7e-49f2-4308-828c-bffe34ad5c10 req-16be411b-f42f-4178-b9df-515eb1b55f11 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075831 Oct 26 13:16:07.454438 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1607/3226] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:16:07.477255 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-465f80a3-0288-4646-ac6d-f0f16e5fea6c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:07.478329 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-465f80a3-0288-4646-ac6d-f0f16e5fea6c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 8718e439-6247-480e-9887-eab549630975] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:07.491697 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-465f80a3-0288-4646-ac6d-f0f16e5fea6c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:07.492278 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-465f80a3-0288-4646-ac6d-f0f16e5fea6c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:07.492790 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-465f80a3-0288-4646-ac6d-f0f16e5fea6c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:07.493604 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-465f80a3-0288-4646-ac6d-f0f16e5fea6c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:07.494144 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-465f80a3-0288-4646-ac6d-f0f16e5fea6c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:07.498518 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-465f80a3-0288-4646-ac6d-f0f16e5fea6c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:07.534631 n-d-862686-1 devstack@n-api.service[120597]: DEBUG neutronclient.v2_0.client [None req-1761bb0e-a438-4d24-a3d1-95f150b25ca0 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 998ece2e-dd9c-454a-88e7-780bfda95e02 in use.", "detail": ""}} {{(pid=120597) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 26 13:16:07.536110 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-1761bb0e-a438-4d24-a3d1-95f150b25ca0 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] HTTP exception thrown: Security Group 998ece2e-dd9c-454a-88e7-780bfda95e02 in use. Oct 26 13:16:07.536110 n-d-862686-1 devstack@n-api.service[120597]: Neutron server returns request_ids: ['req-f71476cc-ff88-43e0-9126-83efe044dd52'] Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1761bb0e-a438-4d24-a3d1-95f150b25ca0 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Request method failure captured: Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/os-security-groups/998ece2e-dd9c-454a-88e7-780bfda95e02 HTTP/1.1 Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTLZwemdkOoZmTGSmy6KZvPDtVHD2_E9ZUR49ovbPsQaFz77JmwG34xaymuHO8vYj9Nv7h8paBonBJqeJ-iGNHh66dW9zr2o-PVtLnq2ivVkvSk_ngG_K5FTR8-56OwV4JEOB5RsCmAZvvKkRYejOCKTdf6hjGlyGC2s57RFn_cJWHQ Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 875ebd1c99c746f7b4f1a3c08156e6a0 Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-SecurityGroupsTestJSON-256228496 Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/875ebd1c99c746f7b4f1a3c08156e6a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/875ebd1c99c746f7b4f1a3c08156e6a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_875ebd1c99c746f7b4f1a3c08156e6a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/875ebd1c99c746f7b4f1a3c08156e6a0"}]}] Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-SecurityGroupsTestJSON-256228496 Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 875ebd1c99c746f7b4f1a3c08156e6a0 Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-256228496 Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-SecurityGroupsTestJSON-256228496-project Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: a13285463ba34e89931d667bc327bb2a Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-SecurityGroupsTestJSON-256228496-project Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: method: Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: exception: Security Group 998ece2e-dd9c-454a-88e7-780bfda95e02 in use. Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: Neutron server returns request_ids: ['req-f71476cc-ff88-43e0-9126-83efe044dd52'] Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '998ece2e-dd9c-454a-88e7-780bfda95e02'} Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 26 13:16:07.538561 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 998ece2e-dd9c-454a-88e7-780bfda95e02 in use. Oct 26 13:16:07.545147 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f71476cc-ff88-43e0-9126-83efe044dd52'] Oct 26 13:16:07.545147 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:07.545147 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:07.545147 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:07.545147 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:07.545147 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 26 13:16:07.545147 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 26 13:16:07.545147 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 26 13:16:07.545147 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 26 13:16:07.545147 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 998ece2e-dd9c-454a-88e7-780bfda95e02 in use. Oct 26 13:16:07.545147 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f71476cc-ff88-43e0-9126-83efe044dd52'] Oct 26 13:16:07.545147 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:07.545147 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:07.545147 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:07.545147 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:07.545147 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:16:07.545147 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:16:07.545147 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:16:07.545147 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:16:07.545147 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:16:07.545147 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:16:07.545147 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:16:07.545147 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:16:07.545147 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 26 13:16:07.545147 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 26 13:16:07.545147 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 998ece2e-dd9c-454a-88e7-780bfda95e02 in use. Oct 26 13:16:07.545147 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f71476cc-ff88-43e0-9126-83efe044dd52'] Oct 26 13:16:07.545147 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:07.545147 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:07.545147 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:07.545147 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:07.545147 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:16:07.545147 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:16:07.545147 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:16:07.545147 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:16:07.545147 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 998ece2e-dd9c-454a-88e7-780bfda95e02 in use. Oct 26 13:16:07.545147 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f71476cc-ff88-43e0-9126-83efe044dd52'] Oct 26 13:16:07.545147 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:07.550617 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1761bb0e-a438-4d24-a3d1-95f150b25ca0 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Returning 400 to user: Security Group 998ece2e-dd9c-454a-88e7-780bfda95e02 in use. Oct 26 13:16:07.550617 n-d-862686-1 devstack@n-api.service[120597]: Neutron server returns request_ids: ['req-f71476cc-ff88-43e0-9126-83efe044dd52'] {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:16:07.552292 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1761bb0e-a438-4d24-a3d1-95f150b25ca0 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/998ece2e-dd9c-454a-88e7-780bfda95e02" status: 400 len: 185 microversion: 2.1 time: 0.172620 Oct 26 13:16:07.556467 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1620/3227] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 26 13:16:07 2022] DELETE /compute/v2.1/os-security-groups/998ece2e-dd9c-454a-88e7-780bfda95e02 => generated 185 bytes in 177 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:16:07.563446 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8fa0210f-a387-4d11-af61-4304f4316e9e tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:16:07.567338 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8fa0210f-a387-4d11-af61-4304f4316e9e tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 6b3fe85a-699d-438b-b809-0539f2fd25b3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:07.591516 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8fa0210f-a387-4d11-af61-4304f4316e9e tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:07.594110 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8fa0210f-a387-4d11-af61-4304f4316e9e tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:07.601553 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8fa0210f-a387-4d11-af61-4304f4316e9e tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:07.603225 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8fa0210f-a387-4d11-af61-4304f4316e9e tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:07.603725 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8fa0210f-a387-4d11-af61-4304f4316e9e tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:07.604174 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8fa0210f-a387-4d11-af61-4304f4316e9e tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:07.776763 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8fa0210f-a387-4d11-af61-4304f4316e9e tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "POST /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3/action" status: 202 len: 0 microversion: 2.1 time: 0.218569 Oct 26 13:16:07.777345 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1621/3228] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:16:07 2022] POST /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:16:07.788118 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-803738ee-7859-40a2-b8d6-b9c0b4bd86b6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:07.788827 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-803738ee-7859-40a2-b8d6-b9c0b4bd86b6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:07.809942 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-465f80a3-0288-4646-ac6d-f0f16e5fea6c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:07.820195 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-465f80a3-0288-4646-ac6d-f0f16e5fea6c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975" status: 200 len: 1309 microversion: 2.1 time: 0.347218 Oct 26 13:16:07.847761 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1608/3229] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:07 2022] GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975 => generated 1309 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:16:07.880854 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-803738ee-7859-40a2-b8d6-b9c0b4bd86b6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:07.881377 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-803738ee-7859-40a2-b8d6-b9c0b4bd86b6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:07.881859 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-803738ee-7859-40a2-b8d6-b9c0b4bd86b6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:07.886522 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-803738ee-7859-40a2-b8d6-b9c0b4bd86b6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:07.888863 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4e55162a-643e-41e5-bc7b-92ef41caa74b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:07.889606 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-803738ee-7859-40a2-b8d6-b9c0b4bd86b6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:07.893876 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4e55162a-643e-41e5-bc7b-92ef41caa74b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 7d459ce7-b3e3-4ae8-868b-2ff408d2c200] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:07.896063 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-803738ee-7859-40a2-b8d6-b9c0b4bd86b6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:07.914142 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e55162a-643e-41e5-bc7b-92ef41caa74b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:07.918672 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e55162a-643e-41e5-bc7b-92ef41caa74b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:07.919199 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e55162a-643e-41e5-bc7b-92ef41caa74b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:07.919948 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e55162a-643e-41e5-bc7b-92ef41caa74b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:07.920438 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e55162a-643e-41e5-bc7b-92ef41caa74b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:07.920853 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e55162a-643e-41e5-bc7b-92ef41caa74b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:08.187401 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4e55162a-643e-41e5-bc7b-92ef41caa74b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:08.198861 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4e55162a-643e-41e5-bc7b-92ef41caa74b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200" status: 200 len: 1318 microversion: 2.1 time: 0.348133 Oct 26 13:16:08.199873 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1609/3230] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:07 2022] GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200 => generated 1318 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:08.205071 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ed397947-7765-46ea-b712-d35e0d3ba6ef tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:08.206032 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ed397947-7765-46ea-b712-d35e0d3ba6ef tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 6b3fe85a-699d-438b-b809-0539f2fd25b3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:08.214586 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ed397947-7765-46ea-b712-d35e0d3ba6ef tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:08.216122 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ed397947-7765-46ea-b712-d35e0d3ba6ef tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:08.216960 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ed397947-7765-46ea-b712-d35e0d3ba6ef tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:08.217958 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ed397947-7765-46ea-b712-d35e0d3ba6ef tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:08.218830 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ed397947-7765-46ea-b712-d35e0d3ba6ef tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:08.219605 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ed397947-7765-46ea-b712-d35e0d3ba6ef tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:08.406955 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ed397947-7765-46ea-b712-d35e0d3ba6ef tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13285463ba34e89931d667bc327bb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875ebd1c99c746f7b4f1a3c08156e6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:08.416176 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ed397947-7765-46ea-b712-d35e0d3ba6ef tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "GET /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3" status: 200 len: 1575 microversion: 2.1 time: 0.215037 Oct 26 13:16:08.418777 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1610/3231] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:08 2022] GET /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3 => generated 1575 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:08.565223 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-803738ee-7859-40a2-b8d6-b9c0b4bd86b6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:08.579521 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-803738ee-7859-40a2-b8d6-b9c0b4bd86b6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:08.581280 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-803738ee-7859-40a2-b8d6-b9c0b4bd86b6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:08.582646 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-803738ee-7859-40a2-b8d6-b9c0b4bd86b6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1879 microversion: 2.42 time: 0.800522 Oct 26 13:16:08.597972 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1622/3232] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:16:07 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1879 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:16:08.849748 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a8608707-d063-4b3b-884f-38ede2fae802 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:08.851010 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a8608707-d063-4b3b-884f-38ede2fae802 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 8718e439-6247-480e-9887-eab549630975] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:08.875589 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a8608707-d063-4b3b-884f-38ede2fae802 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:08.877370 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a8608707-d063-4b3b-884f-38ede2fae802 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:08.878924 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a8608707-d063-4b3b-884f-38ede2fae802 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:08.882094 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a8608707-d063-4b3b-884f-38ede2fae802 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:08.886937 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a8608707-d063-4b3b-884f-38ede2fae802 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:08.888186 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a8608707-d063-4b3b-884f-38ede2fae802 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:09.114303 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a8608707-d063-4b3b-884f-38ede2fae802 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:09.153224 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a8608707-d063-4b3b-884f-38ede2fae802 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975" status: 200 len: 1309 microversion: 2.1 time: 0.307640 Oct 26 13:16:09.158176 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1611/3233] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:08 2022] GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975 => generated 1309 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:09.227153 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fedb30b3-92b8-4c9e-a8e7-654ab9ef3707 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:09.227781 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fedb30b3-92b8-4c9e-a8e7-654ab9ef3707 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 7d459ce7-b3e3-4ae8-868b-2ff408d2c200] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:09.242179 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fedb30b3-92b8-4c9e-a8e7-654ab9ef3707 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:09.242752 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fedb30b3-92b8-4c9e-a8e7-654ab9ef3707 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:09.243141 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fedb30b3-92b8-4c9e-a8e7-654ab9ef3707 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:09.244105 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fedb30b3-92b8-4c9e-a8e7-654ab9ef3707 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:09.244340 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fedb30b3-92b8-4c9e-a8e7-654ab9ef3707 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:09.252358 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fedb30b3-92b8-4c9e-a8e7-654ab9ef3707 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:09.441879 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-db6766c5-07f0-4170-88a1-179ed0cd5fe0 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:09.442521 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-db6766c5-07f0-4170-88a1-179ed0cd5fe0 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 6b3fe85a-699d-438b-b809-0539f2fd25b3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:09.457166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db6766c5-07f0-4170-88a1-179ed0cd5fe0 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:09.457711 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db6766c5-07f0-4170-88a1-179ed0cd5fe0 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:09.458152 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db6766c5-07f0-4170-88a1-179ed0cd5fe0 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:09.458871 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db6766c5-07f0-4170-88a1-179ed0cd5fe0 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:09.459326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db6766c5-07f0-4170-88a1-179ed0cd5fe0 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:09.459754 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db6766c5-07f0-4170-88a1-179ed0cd5fe0 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:09.633767 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fedb30b3-92b8-4c9e-a8e7-654ab9ef3707 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:09.648088 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fedb30b3-92b8-4c9e-a8e7-654ab9ef3707 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200" status: 200 len: 1507 microversion: 2.1 time: 0.425454 Oct 26 13:16:09.655085 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1623/3234] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:09 2022] GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200 => generated 1507 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:09.660760 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c4d958c8-0def-4d3e-a66a-c6734be02c18 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:09.665059 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c4d958c8-0def-4d3e-a66a-c6734be02c18 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:09.673423 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4d958c8-0def-4d3e-a66a-c6734be02c18 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:09.675041 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4d958c8-0def-4d3e-a66a-c6734be02c18 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:09.675683 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4d958c8-0def-4d3e-a66a-c6734be02c18 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:09.677031 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4d958c8-0def-4d3e-a66a-c6734be02c18 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:09.677849 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4d958c8-0def-4d3e-a66a-c6734be02c18 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:09.678625 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4d958c8-0def-4d3e-a66a-c6734be02c18 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:09.762720 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-db6766c5-07f0-4170-88a1-179ed0cd5fe0 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13285463ba34e89931d667bc327bb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875ebd1c99c746f7b4f1a3c08156e6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:09.774782 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-db6766c5-07f0-4170-88a1-179ed0cd5fe0 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "GET /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3" status: 200 len: 1575 microversion: 2.1 time: 0.336832 Oct 26 13:16:09.776015 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1612/3235] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:09 2022] GET /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3 => generated 1575 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:09.782214 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-30470a91-61f1-4fd9-88f9-f61b99a457c6 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:09.783064 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-30470a91-61f1-4fd9-88f9-f61b99a457c6 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 7d459ce7-b3e3-4ae8-868b-2ff408d2c200] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:09.790080 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30470a91-61f1-4fd9-88f9-f61b99a457c6 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:09.790826 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30470a91-61f1-4fd9-88f9-f61b99a457c6 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:09.791443 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30470a91-61f1-4fd9-88f9-f61b99a457c6 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:09.792936 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30470a91-61f1-4fd9-88f9-f61b99a457c6 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:09.793632 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30470a91-61f1-4fd9-88f9-f61b99a457c6 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:09.794413 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30470a91-61f1-4fd9-88f9-f61b99a457c6 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:10.039157 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-30470a91-61f1-4fd9-88f9-f61b99a457c6 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:10.050715 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-30470a91-61f1-4fd9-88f9-f61b99a457c6 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200" status: 200 len: 1507 microversion: 2.1 time: 0.272543 Oct 26 13:16:10.055098 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1613/3236] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:09 2022] GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200 => generated 1507 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:10.066122 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-cb58a622-2a3f-42f6-b7db-62bd0025b29d req-727a07b0-9af5-4871-9f40-3e9a50bf4fc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5fa9733-f49b-43ab-8586-68d113b73476", "name": "network-vif-plugged", "status": "completed", "tag": "d85d2737-225d-489a-bdd1-412eb1f237ba"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:16:10.077025 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c4d958c8-0def-4d3e-a66a-c6734be02c18 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:10.094293 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c4d958c8-0def-4d3e-a66a-c6734be02c18 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:10.101350 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c4d958c8-0def-4d3e-a66a-c6734be02c18 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:10.105931 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c4d958c8-0def-4d3e-a66a-c6734be02c18 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1879 microversion: 2.42 time: 0.449470 Oct 26 13:16:10.108064 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-cb58a622-2a3f-42f6-b7db-62bd0025b29d req-727a07b0-9af5-4871-9f40-3e9a50bf4fc7 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:10.127700 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1624/3237] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:16:09 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1879 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:16:10.128866 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-cb58a622-2a3f-42f6-b7db-62bd0025b29d req-727a07b0-9af5-4871-9f40-3e9a50bf4fc7 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:10.129420 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-cb58a622-2a3f-42f6-b7db-62bd0025b29d req-727a07b0-9af5-4871-9f40-3e9a50bf4fc7 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:10.140069 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-623f6dce-a8e0-4d50-b396-52fbb0ebf595 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:16:10.142979 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-623f6dce-a8e0-4d50-b396-52fbb0ebf595 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 7d459ce7-b3e3-4ae8-868b-2ff408d2c200] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:10.149922 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-623f6dce-a8e0-4d50-b396-52fbb0ebf595 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:10.151639 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-623f6dce-a8e0-4d50-b396-52fbb0ebf595 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:10.152154 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-623f6dce-a8e0-4d50-b396-52fbb0ebf595 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:10.152941 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-623f6dce-a8e0-4d50-b396-52fbb0ebf595 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:10.153435 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-623f6dce-a8e0-4d50-b396-52fbb0ebf595 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:10.153951 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-623f6dce-a8e0-4d50-b396-52fbb0ebf595 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:10.167863 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-cb58a622-2a3f-42f6-b7db-62bd0025b29d req-727a07b0-9af5-4871-9f40-3e9a50bf4fc7 service nova] Creating event network-vif-plugged:d85d2737-225d-489a-bdd1-412eb1f237ba for instance b5fa9733-f49b-43ab-8586-68d113b73476 on n-h1-862686-1 Oct 26 13:16:10.188553 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-cb58a622-2a3f-42f6-b7db-62bd0025b29d req-727a07b0-9af5-4871-9f40-3e9a50bf4fc7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131909 Oct 26 13:16:10.189177 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1614/3238] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:16:10.194842 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9789f7d8-12cc-43e6-bbd9-79879e6bab2f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:10.195784 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9789f7d8-12cc-43e6-bbd9-79879e6bab2f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 8718e439-6247-480e-9887-eab549630975] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:10.203517 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9789f7d8-12cc-43e6-bbd9-79879e6bab2f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:10.204719 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9789f7d8-12cc-43e6-bbd9-79879e6bab2f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:10.205392 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9789f7d8-12cc-43e6-bbd9-79879e6bab2f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:10.206387 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9789f7d8-12cc-43e6-bbd9-79879e6bab2f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:10.207051 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9789f7d8-12cc-43e6-bbd9-79879e6bab2f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:10.207715 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9789f7d8-12cc-43e6-bbd9-79879e6bab2f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:10.245357 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-623f6dce-a8e0-4d50-b396-52fbb0ebf595 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "PUT /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200" status: 200 len: 1079 microversion: 2.1 time: 0.114814 Oct 26 13:16:10.246081 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1625/3239] 10.222.0.40 () {60 vars in 1256 bytes} [Wed Oct 26 13:16:10 2022] PUT /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200 => generated 1079 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:10.269161 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6f5c2266-9dff-47d7-b56e-57eebef2384e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:10.270232 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6f5c2266-9dff-47d7-b56e-57eebef2384e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 7d459ce7-b3e3-4ae8-868b-2ff408d2c200] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:10.281878 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f5c2266-9dff-47d7-b56e-57eebef2384e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:10.282385 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f5c2266-9dff-47d7-b56e-57eebef2384e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:10.282859 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f5c2266-9dff-47d7-b56e-57eebef2384e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:10.283614 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f5c2266-9dff-47d7-b56e-57eebef2384e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:10.284101 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f5c2266-9dff-47d7-b56e-57eebef2384e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:10.284560 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f5c2266-9dff-47d7-b56e-57eebef2384e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:10.488016 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9789f7d8-12cc-43e6-bbd9-79879e6bab2f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:10.497668 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9789f7d8-12cc-43e6-bbd9-79879e6bab2f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975" status: 200 len: 1309 microversion: 2.1 time: 0.306977 Oct 26 13:16:10.498258 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1615/3240] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:10 2022] GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975 => generated 1309 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:10.519870 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6f5c2266-9dff-47d7-b56e-57eebef2384e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:10.530338 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6f5c2266-9dff-47d7-b56e-57eebef2384e tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200" status: 200 len: 1505 microversion: 2.1 time: 0.264845 Oct 26 13:16:10.531882 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1626/3241] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:10 2022] GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200 => generated 1505 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:16:10.554859 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-96be5d47-4559-43e2-abc2-3990440bf9da tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:10.555557 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-96be5d47-4559-43e2-abc2-3990440bf9da tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 7d459ce7-b3e3-4ae8-868b-2ff408d2c200] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:10.562943 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-96be5d47-4559-43e2-abc2-3990440bf9da tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:10.563327 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-96be5d47-4559-43e2-abc2-3990440bf9da tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:10.563811 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-96be5d47-4559-43e2-abc2-3990440bf9da tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:10.564879 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-96be5d47-4559-43e2-abc2-3990440bf9da tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:10.565016 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-96be5d47-4559-43e2-abc2-3990440bf9da tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:10.565359 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-96be5d47-4559-43e2-abc2-3990440bf9da tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:10.770476 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-96be5d47-4559-43e2-abc2-3990440bf9da tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:10.780870 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-96be5d47-4559-43e2-abc2-3990440bf9da tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200" status: 200 len: 1505 microversion: 2.1 time: 0.229618 Oct 26 13:16:10.794399 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1616/3242] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:10 2022] GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200 => generated 1505 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:10.809565 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cb4adb09-66c9-4e08-abe2-0f3721da2639 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:10.811892 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cb4adb09-66c9-4e08-abe2-0f3721da2639 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 6b3fe85a-699d-438b-b809-0539f2fd25b3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:10.830393 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb4adb09-66c9-4e08-abe2-0f3721da2639 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:10.838380 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb4adb09-66c9-4e08-abe2-0f3721da2639 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:10.839741 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb4adb09-66c9-4e08-abe2-0f3721da2639 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:10.841070 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2d182cc5-5d25-4bcf-b367-b611560dbade tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:16:10.847360 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb4adb09-66c9-4e08-abe2-0f3721da2639 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:10.849207 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb4adb09-66c9-4e08-abe2-0f3721da2639 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:10.853506 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb4adb09-66c9-4e08-abe2-0f3721da2639 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:10.863113 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2d182cc5-5d25-4bcf-b367-b611560dbade tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 7d459ce7-b3e3-4ae8-868b-2ff408d2c200] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:10.882381 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d182cc5-5d25-4bcf-b367-b611560dbade tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:10.883090 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d182cc5-5d25-4bcf-b367-b611560dbade tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:10.883824 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d182cc5-5d25-4bcf-b367-b611560dbade tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:10.884547 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d182cc5-5d25-4bcf-b367-b611560dbade tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:10.885112 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d182cc5-5d25-4bcf-b367-b611560dbade tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:10.885746 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d182cc5-5d25-4bcf-b367-b611560dbade tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:10.908894 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:16:11.030562 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2d182cc5-5d25-4bcf-b367-b611560dbade tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "PUT /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200" status: 200 len: 1081 microversion: 2.1 time: 0.203733 Oct 26 13:16:11.031648 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1617/3243] 10.222.0.40 () {60 vars in 1256 bytes} [Wed Oct 26 13:16:10 2022] PUT /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200 => generated 1081 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:11.041121 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-76f10efe-1288-4f8e-ad57-6497074ecb73 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:11.044374 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-76f10efe-1288-4f8e-ad57-6497074ecb73 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:11.055944 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76f10efe-1288-4f8e-ad57-6497074ecb73 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:11.056443 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76f10efe-1288-4f8e-ad57-6497074ecb73 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:11.056887 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76f10efe-1288-4f8e-ad57-6497074ecb73 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:11.058379 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76f10efe-1288-4f8e-ad57-6497074ecb73 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:11.058856 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76f10efe-1288-4f8e-ad57-6497074ecb73 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:11.059284 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76f10efe-1288-4f8e-ad57-6497074ecb73 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:11.110460 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cb4adb09-66c9-4e08-abe2-0f3721da2639 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13285463ba34e89931d667bc327bb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875ebd1c99c746f7b4f1a3c08156e6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:11.122775 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cb4adb09-66c9-4e08-abe2-0f3721da2639 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "GET /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3" status: 200 len: 1573 microversion: 2.1 time: 0.325979 Oct 26 13:16:11.126536 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1627/3244] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:10 2022] GET /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3 => generated 1573 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:11.132330 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-18e28a9d-c14e-4b10-95d7-3b2c225a84da tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:11.133129 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-18e28a9d-c14e-4b10-95d7-3b2c225a84da tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 7d459ce7-b3e3-4ae8-868b-2ff408d2c200] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:11.140110 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18e28a9d-c14e-4b10-95d7-3b2c225a84da tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:11.140865 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18e28a9d-c14e-4b10-95d7-3b2c225a84da tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:11.141611 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18e28a9d-c14e-4b10-95d7-3b2c225a84da tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:11.142828 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18e28a9d-c14e-4b10-95d7-3b2c225a84da tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:11.143927 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18e28a9d-c14e-4b10-95d7-3b2c225a84da tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:11.144988 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18e28a9d-c14e-4b10-95d7-3b2c225a84da tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:11.191031 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-76f10efe-1288-4f8e-ad57-6497074ecb73 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lazy-loading 'services' on Instance uuid 5e73c452-6277-4845-b64e-e3eca2528e4c {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:16:11.293068 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-76f10efe-1288-4f8e-ad57-6497074ecb73 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c/os-volume_attachments/c19ce93b-fdbc-4456-a52e-4d977d3a0cb6" status: 202 len: 0 microversion: 2.1 time: 0.259559 Oct 26 13:16:11.293908 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1618/3245] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Oct 26 13:16:11 2022] DELETE /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c/os-volume_attachments/c19ce93b-fdbc-4456-a52e-4d977d3a0cb6 => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:16:11.299904 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bf4783c2-e12f-4271-b335-2ace640f3637 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:11.300609 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bf4783c2-e12f-4271-b335-2ace640f3637 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:11.320355 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bf4783c2-e12f-4271-b335-2ace640f3637 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:11.320861 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bf4783c2-e12f-4271-b335-2ace640f3637 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:11.321346 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bf4783c2-e12f-4271-b335-2ace640f3637 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:11.322070 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bf4783c2-e12f-4271-b335-2ace640f3637 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:11.322538 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bf4783c2-e12f-4271-b335-2ace640f3637 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:11.322972 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bf4783c2-e12f-4271-b335-2ace640f3637 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:11.382298 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-18e28a9d-c14e-4b10-95d7-3b2c225a84da tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:11.390623 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-18e28a9d-c14e-4b10-95d7-3b2c225a84da tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200" status: 200 len: 1507 microversion: 2.1 time: 0.262806 Oct 26 13:16:11.396408 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1628/3246] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:11 2022] GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200 => generated 1507 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:11.403032 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-95f4dbe8-041d-461c-8387-dd3e914f5ac8 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-164374479"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:16:11.403586 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-95f4dbe8-041d-461c-8387-dd3e914f5ac8 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 6b3fe85a-699d-438b-b809-0539f2fd25b3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:11.419102 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-95f4dbe8-041d-461c-8387-dd3e914f5ac8 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:11.419733 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-95f4dbe8-041d-461c-8387-dd3e914f5ac8 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:11.420274 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-95f4dbe8-041d-461c-8387-dd3e914f5ac8 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:11.421225 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-95f4dbe8-041d-461c-8387-dd3e914f5ac8 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:11.421947 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-95f4dbe8-041d-461c-8387-dd3e914f5ac8 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:11.422593 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-95f4dbe8-041d-461c-8387-dd3e914f5ac8 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:11.611302 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.network.security_group_api [None req-95f4dbe8-041d-461c-8387-dd3e914f5ac8 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Adding security group 48bf9323-610f-4e89-a245-5ed18e4fb78b to port f95eafb3-a2e9-4243-a442-390ae39acdbe Oct 26 13:16:11.650572 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bf4783c2-e12f-4271-b335-2ace640f3637 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:11.670981 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bf4783c2-e12f-4271-b335-2ace640f3637 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:11.676956 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bf4783c2-e12f-4271-b335-2ace640f3637 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:11.678324 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bf4783c2-e12f-4271-b335-2ace640f3637 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1879 microversion: 2.42 time: 0.383317 Oct 26 13:16:11.693829 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1619/3247] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:16:11 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1879 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:16:11.693829 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-70653ec4-8b47-4fac-a1dc-6adeece2e8b6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:11.701526 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-70653ec4-8b47-4fac-a1dc-6adeece2e8b6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:11.714592 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70653ec4-8b47-4fac-a1dc-6adeece2e8b6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:11.715550 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70653ec4-8b47-4fac-a1dc-6adeece2e8b6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:11.716252 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70653ec4-8b47-4fac-a1dc-6adeece2e8b6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:11.717212 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70653ec4-8b47-4fac-a1dc-6adeece2e8b6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:11.717805 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70653ec4-8b47-4fac-a1dc-6adeece2e8b6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:11.718480 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70653ec4-8b47-4fac-a1dc-6adeece2e8b6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:11.754411 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-70653ec4-8b47-4fac-a1dc-6adeece2e8b6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069152 Oct 26 13:16:11.755345 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1620/3248] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:16:11 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:16:11.761024 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-35a9102e-abb2-4d1b-90a5-aeb9a727d358 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:11.762059 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-35a9102e-abb2-4d1b-90a5-aeb9a727d358 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 7d459ce7-b3e3-4ae8-868b-2ff408d2c200] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:11.769051 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-35a9102e-abb2-4d1b-90a5-aeb9a727d358 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:11.770023 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-35a9102e-abb2-4d1b-90a5-aeb9a727d358 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:11.770948 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-35a9102e-abb2-4d1b-90a5-aeb9a727d358 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:11.771975 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-35a9102e-abb2-4d1b-90a5-aeb9a727d358 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:11.772665 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-35a9102e-abb2-4d1b-90a5-aeb9a727d358 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:11.773635 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-35a9102e-abb2-4d1b-90a5-aeb9a727d358 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:12.009912 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-35a9102e-abb2-4d1b-90a5-aeb9a727d358 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:12.021613 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-35a9102e-abb2-4d1b-90a5-aeb9a727d358 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200" status: 200 len: 1507 microversion: 2.1 time: 0.264524 Oct 26 13:16:12.028137 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1621/3249] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:11 2022] GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200 => generated 1507 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:12.040643 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2e0303bf-37dc-4a35-95f2-d221707ed50f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:12.042471 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2e0303bf-37dc-4a35-95f2-d221707ed50f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 8718e439-6247-480e-9887-eab549630975] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:12.062766 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e0303bf-37dc-4a35-95f2-d221707ed50f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:12.065025 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e0303bf-37dc-4a35-95f2-d221707ed50f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:12.065955 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e0303bf-37dc-4a35-95f2-d221707ed50f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:12.067314 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e0303bf-37dc-4a35-95f2-d221707ed50f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:12.069283 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e0303bf-37dc-4a35-95f2-d221707ed50f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:12.070318 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e0303bf-37dc-4a35-95f2-d221707ed50f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:12.256717 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-95f4dbe8-041d-461c-8387-dd3e914f5ac8 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "POST /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3/action" status: 202 len: 0 microversion: 2.1 time: 0.858896 Oct 26 13:16:12.258830 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1629/3250] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:16:11 2022] POST /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3/action => generated 0 bytes in 860 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:16:12.266624 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a0df955c-419e-4c54-a64e-c4b2f2b09111 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:12.267354 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a0df955c-419e-4c54-a64e-c4b2f2b09111 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 7d459ce7-b3e3-4ae8-868b-2ff408d2c200] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:12.294422 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0df955c-419e-4c54-a64e-c4b2f2b09111 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:12.294925 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0df955c-419e-4c54-a64e-c4b2f2b09111 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:12.295377 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0df955c-419e-4c54-a64e-c4b2f2b09111 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:12.296106 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0df955c-419e-4c54-a64e-c4b2f2b09111 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:12.296565 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0df955c-419e-4c54-a64e-c4b2f2b09111 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:12.296995 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0df955c-419e-4c54-a64e-c4b2f2b09111 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:12.392077 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a0df955c-419e-4c54-a64e-c4b2f2b09111 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 7d459ce7-b3e3-4ae8-868b-2ff408d2c200] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:16:12.426628 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2e0303bf-37dc-4a35-95f2-d221707ed50f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:12.431102 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:16:12.438590 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2e0303bf-37dc-4a35-95f2-d221707ed50f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975" status: 200 len: 1309 microversion: 2.1 time: 0.408590 Oct 26 13:16:12.451564 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1622/3251] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:12 2022] GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975 => generated 1309 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:12.469027 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c8df3f12-9a4b-4f28-8e63-34d61826aec7 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '.version_select at 0x7f67325764c0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:12.551165 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a0df955c-419e-4c54-a64e-c4b2f2b09111 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200" status: 204 len: 0 microversion: 2.1 time: 0.290592 Oct 26 13:16:12.552420 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1630/3252] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:16:12 2022] DELETE /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:16:12.558730 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-2cf15a02-5ec4-4119-a61a-7ddc2369b432 req-77a79667-2a1a-48a9-8c67-c81d568b7c6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b3fe85a-699d-438b-b809-0539f2fd25b3", "tag": "f95eafb3-a2e9-4243-a442-390ae39acdbe"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:16:12.571624 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2cf15a02-5ec4-4119-a61a-7ddc2369b432 req-77a79667-2a1a-48a9-8c67-c81d568b7c6d service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:12.572423 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2cf15a02-5ec4-4119-a61a-7ddc2369b432 req-77a79667-2a1a-48a9-8c67-c81d568b7c6d service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:12.574039 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2cf15a02-5ec4-4119-a61a-7ddc2369b432 req-77a79667-2a1a-48a9-8c67-c81d568b7c6d service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:12.587610 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-2cf15a02-5ec4-4119-a61a-7ddc2369b432 req-77a79667-2a1a-48a9-8c67-c81d568b7c6d service nova] Creating event network-changed:f95eafb3-a2e9-4243-a442-390ae39acdbe for instance 6b3fe85a-699d-438b-b809-0539f2fd25b3 on n-h2-862686-1 Oct 26 13:16:12.594477 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-2cf15a02-5ec4-4119-a61a-7ddc2369b432 req-77a79667-2a1a-48a9-8c67-c81d568b7c6d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040401 Oct 26 13:16:12.595922 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1631/3253] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:16:12.603594 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-2155b2a2-111c-484b-b907-0bf8ec2b36cb req-64d2262a-6b0f-493f-8166-6974bc49e1ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5fa9733-f49b-43ab-8586-68d113b73476", "name": "network-vif-plugged", "status": "completed", "tag": "fbf03382-47b3-45b7-be91-c664781050c5"}, {"server_uuid": "b5fa9733-f49b-43ab-8586-68d113b73476", "name": "network-vif-plugged", "status": "completed", "tag": "dae3728e-b93b-4eed-a07b-aea0efaacfac"}, {"server_uuid": "b5fa9733-f49b-43ab-8586-68d113b73476", "name": "network-vif-plugged", "status": "completed", "tag": "f2fe44e4-4b3a-4974-85cd-bdb8df938561"}, {"server_uuid": "b5fa9733-f49b-43ab-8586-68d113b73476", "name": "network-vif-plugged", "status": "completed", "tag": "b4a99c4e-af6c-4bd4-bdc0-d0c89b5dec6c"}, {"server_uuid": "b5fa9733-f49b-43ab-8586-68d113b73476", "name": "network-vif-plugged", "status": "completed", "tag": "3e876899-0ec1-4d6a-bf24-cae0a92e06ac"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:16:12.617078 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2155b2a2-111c-484b-b907-0bf8ec2b36cb req-64d2262a-6b0f-493f-8166-6974bc49e1ca service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:12.617790 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2155b2a2-111c-484b-b907-0bf8ec2b36cb req-64d2262a-6b0f-493f-8166-6974bc49e1ca service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:12.618383 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2155b2a2-111c-484b-b907-0bf8ec2b36cb req-64d2262a-6b0f-493f-8166-6974bc49e1ca service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:12.632696 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-2155b2a2-111c-484b-b907-0bf8ec2b36cb req-64d2262a-6b0f-493f-8166-6974bc49e1ca service nova] Creating event network-vif-plugged:fbf03382-47b3-45b7-be91-c664781050c5 for instance b5fa9733-f49b-43ab-8586-68d113b73476 on n-h1-862686-1 Oct 26 13:16:12.633476 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-2155b2a2-111c-484b-b907-0bf8ec2b36cb req-64d2262a-6b0f-493f-8166-6974bc49e1ca service nova] Creating event network-vif-plugged:dae3728e-b93b-4eed-a07b-aea0efaacfac for instance b5fa9733-f49b-43ab-8586-68d113b73476 on n-h1-862686-1 Oct 26 13:16:12.634645 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-2155b2a2-111c-484b-b907-0bf8ec2b36cb req-64d2262a-6b0f-493f-8166-6974bc49e1ca service nova] Creating event network-vif-plugged:f2fe44e4-4b3a-4974-85cd-bdb8df938561 for instance b5fa9733-f49b-43ab-8586-68d113b73476 on n-h1-862686-1 Oct 26 13:16:12.635334 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-2155b2a2-111c-484b-b907-0bf8ec2b36cb req-64d2262a-6b0f-493f-8166-6974bc49e1ca service nova] Creating event network-vif-plugged:b4a99c4e-af6c-4bd4-bdc0-d0c89b5dec6c for instance b5fa9733-f49b-43ab-8586-68d113b73476 on n-h1-862686-1 Oct 26 13:16:12.637109 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-2155b2a2-111c-484b-b907-0bf8ec2b36cb req-64d2262a-6b0f-493f-8166-6974bc49e1ca service nova] Creating event network-vif-plugged:3e876899-0ec1-4d6a-bf24-cae0a92e06ac for instance b5fa9733-f49b-43ab-8586-68d113b73476 on n-h1-862686-1 Oct 26 13:16:12.643729 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-2155b2a2-111c-484b-b907-0bf8ec2b36cb req-64d2262a-6b0f-493f-8166-6974bc49e1ca service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.046269 Oct 26 13:16:12.644963 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1632/3254] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:16:12.650925 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-838bf0d6-9cbb-4791-a7e7-061abdfdc116 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:12.652485 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-838bf0d6-9cbb-4791-a7e7-061abdfdc116 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 7d459ce7-b3e3-4ae8-868b-2ff408d2c200] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:12.660568 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-838bf0d6-9cbb-4791-a7e7-061abdfdc116 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:12.661278 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-838bf0d6-9cbb-4791-a7e7-061abdfdc116 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:12.661932 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-838bf0d6-9cbb-4791-a7e7-061abdfdc116 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:12.664401 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-838bf0d6-9cbb-4791-a7e7-061abdfdc116 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:12.665539 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-838bf0d6-9cbb-4791-a7e7-061abdfdc116 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:12.666123 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-838bf0d6-9cbb-4791-a7e7-061abdfdc116 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:12.681260 n-d-862686-1 devstack@n-api.service[120598]: DEBUG neutronclient.v2_0.client [None req-c8df3f12-9a4b-4f28-8e63-34d61826aec7 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 48bf9323-610f-4e89-a245-5ed18e4fb78b in use.", "detail": ""}} {{(pid=120598) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 26 13:16:12.682280 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-c8df3f12-9a4b-4f28-8e63-34d61826aec7 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] HTTP exception thrown: Security Group 48bf9323-610f-4e89-a245-5ed18e4fb78b in use. Oct 26 13:16:12.682280 n-d-862686-1 devstack@n-api.service[120598]: Neutron server returns request_ids: ['req-3fda3177-b6c8-43ff-95fe-1c844be6b02b'] Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c8df3f12-9a4b-4f28-8e63-34d61826aec7 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Request method failure captured: Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: request: DELETE /compute/v2.1/os-security-groups/48bf9323-610f-4e89-a245-5ed18e4fb78b HTTP/1.1 Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTLZwemdkOoZmTGSmy6KZvPDtVHD2_E9ZUR49ovbPsQaFz77JmwG34xaymuHO8vYj9Nv7h8paBonBJqeJ-iGNHh66dW9zr2o-PVtLnq2ivVkvSk_ngG_K5FTR8-56OwV4JEOB5RsCmAZvvKkRYejOCKTdf6hjGlyGC2s57RFn_cJWHQ Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 875ebd1c99c746f7b4f1a3c08156e6a0 Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-SecurityGroupsTestJSON-256228496 Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/875ebd1c99c746f7b4f1a3c08156e6a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/875ebd1c99c746f7b4f1a3c08156e6a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_875ebd1c99c746f7b4f1a3c08156e6a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/875ebd1c99c746f7b4f1a3c08156e6a0"}]}] Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-SecurityGroupsTestJSON-256228496 Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 875ebd1c99c746f7b4f1a3c08156e6a0 Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-256228496 Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-SecurityGroupsTestJSON-256228496-project Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: a13285463ba34e89931d667bc327bb2a Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-SecurityGroupsTestJSON-256228496-project Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: exception: Security Group 48bf9323-610f-4e89-a245-5ed18e4fb78b in use. Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: Neutron server returns request_ids: ['req-3fda3177-b6c8-43ff-95fe-1c844be6b02b'] Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '48bf9323-610f-4e89-a245-5ed18e4fb78b'} Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 26 13:16:12.685196 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 48bf9323-610f-4e89-a245-5ed18e4fb78b in use. Oct 26 13:16:12.689955 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3fda3177-b6c8-43ff-95fe-1c844be6b02b'] Oct 26 13:16:12.689955 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:12.689955 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:12.689955 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:12.689955 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:12.689955 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 26 13:16:12.689955 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 26 13:16:12.689955 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 26 13:16:12.689955 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 26 13:16:12.689955 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 48bf9323-610f-4e89-a245-5ed18e4fb78b in use. Oct 26 13:16:12.689955 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3fda3177-b6c8-43ff-95fe-1c844be6b02b'] Oct 26 13:16:12.689955 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:12.689955 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:12.689955 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:12.689955 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:12.689955 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:16:12.689955 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:16:12.689955 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:16:12.689955 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:16:12.689955 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:16:12.689955 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:16:12.689955 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:16:12.689955 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:16:12.689955 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 26 13:16:12.689955 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 26 13:16:12.689955 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 48bf9323-610f-4e89-a245-5ed18e4fb78b in use. Oct 26 13:16:12.689955 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3fda3177-b6c8-43ff-95fe-1c844be6b02b'] Oct 26 13:16:12.689955 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:12.689955 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:12.689955 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:12.689955 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:12.689955 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:16:12.689955 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:16:12.689955 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:16:12.689955 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:16:12.689955 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 48bf9323-610f-4e89-a245-5ed18e4fb78b in use. Oct 26 13:16:12.689955 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3fda3177-b6c8-43ff-95fe-1c844be6b02b'] Oct 26 13:16:12.689955 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:12.695127 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c8df3f12-9a4b-4f28-8e63-34d61826aec7 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Returning 400 to user: Security Group 48bf9323-610f-4e89-a245-5ed18e4fb78b in use. Oct 26 13:16:12.695127 n-d-862686-1 devstack@n-api.service[120598]: Neutron server returns request_ids: ['req-3fda3177-b6c8-43ff-95fe-1c844be6b02b'] {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:16:12.696746 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c8df3f12-9a4b-4f28-8e63-34d61826aec7 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/48bf9323-610f-4e89-a245-5ed18e4fb78b" status: 400 len: 185 microversion: 2.1 time: 0.244068 Oct 26 13:16:12.698865 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1623/3255] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 26 13:16:12 2022] DELETE /compute/v2.1/os-security-groups/48bf9323-610f-4e89-a245-5ed18e4fb78b => generated 185 bytes in 247 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:16:12.712129 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e1c6e13b-d794-4268-b580-92b102ad1139 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:12.712888 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e1c6e13b-d794-4268-b580-92b102ad1139 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 6b3fe85a-699d-438b-b809-0539f2fd25b3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:12.723721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e1c6e13b-d794-4268-b580-92b102ad1139 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:12.725310 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e1c6e13b-d794-4268-b580-92b102ad1139 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:12.725985 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e1c6e13b-d794-4268-b580-92b102ad1139 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:12.726909 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e1c6e13b-d794-4268-b580-92b102ad1139 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:12.727533 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e1c6e13b-d794-4268-b580-92b102ad1139 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:12.728171 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e1c6e13b-d794-4268-b580-92b102ad1139 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:12.730346 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-838bf0d6-9cbb-4791-a7e7-061abdfdc116 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 7d459ce7-b3e3-4ae8-868b-2ff408d2c200] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:16:12.769237 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e1c6e13b-d794-4268-b580-92b102ad1139 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 6b3fe85a-699d-438b-b809-0539f2fd25b3] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:16:12.835779 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.compute.api [None req-838bf0d6-9cbb-4791-a7e7-061abdfdc116 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 7d459ce7-b3e3-4ae8-868b-2ff408d2c200] Instance is already in deleting state, ignoring this request Oct 26 13:16:12.836600 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-838bf0d6-9cbb-4791-a7e7-061abdfdc116 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200" status: 204 len: 0 microversion: 2.1 time: 0.190055 Oct 26 13:16:12.837355 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1633/3256] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:16:12 2022] DELETE /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:16:12.850610 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0c12170d-dd5b-4190-8cdf-21b9eea5c203 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:12.851240 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0c12170d-dd5b-4190-8cdf-21b9eea5c203 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:12.863392 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c12170d-dd5b-4190-8cdf-21b9eea5c203 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:12.868931 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c12170d-dd5b-4190-8cdf-21b9eea5c203 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:12.869668 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c12170d-dd5b-4190-8cdf-21b9eea5c203 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:12.870668 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c12170d-dd5b-4190-8cdf-21b9eea5c203 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:12.871416 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c12170d-dd5b-4190-8cdf-21b9eea5c203 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:12.872038 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c12170d-dd5b-4190-8cdf-21b9eea5c203 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:12.941860 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e1c6e13b-d794-4268-b580-92b102ad1139 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3" status: 204 len: 0 microversion: 2.1 time: 0.238573 Oct 26 13:16:12.943112 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1624/3257] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:16:12 2022] DELETE /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:16:12.949291 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-13765087-0dab-4f40-87ca-6dbbaae3b812 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:12.953153 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-13765087-0dab-4f40-87ca-6dbbaae3b812 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:12.962638 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-13765087-0dab-4f40-87ca-6dbbaae3b812 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:12.963441 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-13765087-0dab-4f40-87ca-6dbbaae3b812 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:12.964811 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-13765087-0dab-4f40-87ca-6dbbaae3b812 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:12.966619 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-13765087-0dab-4f40-87ca-6dbbaae3b812 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:12.967289 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-13765087-0dab-4f40-87ca-6dbbaae3b812 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:12.967928 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-13765087-0dab-4f40-87ca-6dbbaae3b812 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:13.008938 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-13765087-0dab-4f40-87ca-6dbbaae3b812 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064274 Oct 26 13:16:13.010209 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1625/3258] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:16:12 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:16:13.017291 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-87dbf19d-f29e-4f9b-b410-919d93c5cb18 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:13.018665 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-87dbf19d-f29e-4f9b-b410-919d93c5cb18 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 7d459ce7-b3e3-4ae8-868b-2ff408d2c200] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:13.027769 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87dbf19d-f29e-4f9b-b410-919d93c5cb18 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:13.028520 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87dbf19d-f29e-4f9b-b410-919d93c5cb18 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:13.029181 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87dbf19d-f29e-4f9b-b410-919d93c5cb18 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:13.030304 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87dbf19d-f29e-4f9b-b410-919d93c5cb18 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:13.031010 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87dbf19d-f29e-4f9b-b410-919d93c5cb18 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:13.031738 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87dbf19d-f29e-4f9b-b410-919d93c5cb18 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:13.186350 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0c12170d-dd5b-4190-8cdf-21b9eea5c203 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:13.203245 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0c12170d-dd5b-4190-8cdf-21b9eea5c203 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:13.204706 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0c12170d-dd5b-4190-8cdf-21b9eea5c203 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:13.208170 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0c12170d-dd5b-4190-8cdf-21b9eea5c203 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1879 microversion: 2.42 time: 0.366993 Oct 26 13:16:13.209629 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1634/3259] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:16:12 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1879 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:16:13.223486 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6930256d-e0e2-4574-bff5-4fc42f37ce92 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:13.224342 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6930256d-e0e2-4574-bff5-4fc42f37ce92 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 6b3fe85a-699d-438b-b809-0539f2fd25b3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:13.233584 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6930256d-e0e2-4574-bff5-4fc42f37ce92 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:13.236987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6930256d-e0e2-4574-bff5-4fc42f37ce92 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:13.237977 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6930256d-e0e2-4574-bff5-4fc42f37ce92 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:13.243291 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-87dbf19d-f29e-4f9b-b410-919d93c5cb18 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:13.253405 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-87dbf19d-f29e-4f9b-b410-919d93c5cb18 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200" status: 200 len: 1513 microversion: 2.1 time: 0.241291 Oct 26 13:16:13.253673 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6930256d-e0e2-4574-bff5-4fc42f37ce92 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:13.254420 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6930256d-e0e2-4574-bff5-4fc42f37ce92 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:13.255037 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6930256d-e0e2-4574-bff5-4fc42f37ce92 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:13.256579 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1626/3260] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:13 2022] GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200 => generated 1513 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:13.468937 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a47aeb3f-d6f2-45e8-947c-de26c45dc222 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:13.469730 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a47aeb3f-d6f2-45e8-947c-de26c45dc222 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 8718e439-6247-480e-9887-eab549630975] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:13.484872 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:16:13.489399 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a47aeb3f-d6f2-45e8-947c-de26c45dc222 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:13.489947 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a47aeb3f-d6f2-45e8-947c-de26c45dc222 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:13.490386 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a47aeb3f-d6f2-45e8-947c-de26c45dc222 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:13.491091 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a47aeb3f-d6f2-45e8-947c-de26c45dc222 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:13.491766 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a47aeb3f-d6f2-45e8-947c-de26c45dc222 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:13.491966 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a47aeb3f-d6f2-45e8-947c-de26c45dc222 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:13.538230 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6930256d-e0e2-4574-bff5-4fc42f37ce92 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13285463ba34e89931d667bc327bb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875ebd1c99c746f7b4f1a3c08156e6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:13.549981 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6930256d-e0e2-4574-bff5-4fc42f37ce92 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "GET /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3" status: 200 len: 1647 microversion: 2.1 time: 0.339011 Oct 26 13:16:13.550588 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1635/3261] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:13 2022] GET /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3 => generated 1647 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:13.690698 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a47aeb3f-d6f2-45e8-947c-de26c45dc222 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:13.698026 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a47aeb3f-d6f2-45e8-947c-de26c45dc222 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975" status: 200 len: 1309 microversion: 2.1 time: 0.235180 Oct 26 13:16:13.698958 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1627/3262] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:13 2022] GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975 => generated 1309 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:16:14.022437 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-87fdc161-8b28-4643-bd07-b8d78bbbc802 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:14.024611 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-87fdc161-8b28-4643-bd07-b8d78bbbc802 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:14.031895 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-87fdc161-8b28-4643-bd07-b8d78bbbc802 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:14.032379 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-87fdc161-8b28-4643-bd07-b8d78bbbc802 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:14.032818 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-87fdc161-8b28-4643-bd07-b8d78bbbc802 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:14.033541 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-87fdc161-8b28-4643-bd07-b8d78bbbc802 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:14.034003 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-87fdc161-8b28-4643-bd07-b8d78bbbc802 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:14.034429 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-87fdc161-8b28-4643-bd07-b8d78bbbc802 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:14.068095 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-87fdc161-8b28-4643-bd07-b8d78bbbc802 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049922 Oct 26 13:16:14.068686 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1636/3263] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:16:14 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:16:14.243022 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2194503c-8930-4542-8ae3-4e8259d9d81b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:14.243783 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2194503c-8930-4542-8ae3-4e8259d9d81b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:14.251656 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2194503c-8930-4542-8ae3-4e8259d9d81b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:14.252237 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2194503c-8930-4542-8ae3-4e8259d9d81b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:14.252747 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2194503c-8930-4542-8ae3-4e8259d9d81b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:14.253550 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2194503c-8930-4542-8ae3-4e8259d9d81b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:14.254011 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2194503c-8930-4542-8ae3-4e8259d9d81b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:14.254441 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2194503c-8930-4542-8ae3-4e8259d9d81b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:14.283873 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a85dcd63-bbd4-4948-8d0d-2236beb66ce4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:14.284417 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a85dcd63-bbd4-4948-8d0d-2236beb66ce4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 7d459ce7-b3e3-4ae8-868b-2ff408d2c200] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:14.290876 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a85dcd63-bbd4-4948-8d0d-2236beb66ce4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:14.291679 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a85dcd63-bbd4-4948-8d0d-2236beb66ce4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:14.292311 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a85dcd63-bbd4-4948-8d0d-2236beb66ce4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:14.293027 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a85dcd63-bbd4-4948-8d0d-2236beb66ce4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:14.293508 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a85dcd63-bbd4-4948-8d0d-2236beb66ce4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:14.293955 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a85dcd63-bbd4-4948-8d0d-2236beb66ce4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:14.455362 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2194503c-8930-4542-8ae3-4e8259d9d81b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:14.462771 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a85dcd63-bbd4-4948-8d0d-2236beb66ce4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:14.466582 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2194503c-8930-4542-8ae3-4e8259d9d81b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:14.470284 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2194503c-8930-4542-8ae3-4e8259d9d81b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:14.471907 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2194503c-8930-4542-8ae3-4e8259d9d81b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1879 microversion: 2.42 time: 0.233259 Oct 26 13:16:14.472943 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1628/3264] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:16:14 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1879 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:16:14.474148 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a85dcd63-bbd4-4948-8d0d-2236beb66ce4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200" status: 200 len: 1513 microversion: 2.1 time: 0.193102 Oct 26 13:16:14.489979 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1637/3265] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:14 2022] GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200 => generated 1513 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:16:14.583513 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-77ee0202-6c4f-4dce-9fad-049c272ddea3 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:14.584356 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-77ee0202-6c4f-4dce-9fad-049c272ddea3 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 6b3fe85a-699d-438b-b809-0539f2fd25b3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:14.591345 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77ee0202-6c4f-4dce-9fad-049c272ddea3 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:14.591835 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77ee0202-6c4f-4dce-9fad-049c272ddea3 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:14.592456 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77ee0202-6c4f-4dce-9fad-049c272ddea3 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:14.593166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77ee0202-6c4f-4dce-9fad-049c272ddea3 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:14.593862 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77ee0202-6c4f-4dce-9fad-049c272ddea3 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:14.594323 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77ee0202-6c4f-4dce-9fad-049c272ddea3 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:14.679970 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-bd4c5822-b739-4333-bf42-aa68bc0b1fb5 req-284bbaf3-d533-46a8-ad6a-d4bb2226f20e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5fa9733-f49b-43ab-8586-68d113b73476", "name": "network-vif-plugged", "status": "completed", "tag": "bb5fa759-fb42-4724-9c5e-6a0f92fc97d1"}, {"server_uuid": "8718e439-6247-480e-9887-eab549630975", "name": "network-vif-plugged", "status": "completed", "tag": "7e6108c5-cc9c-4df8-828e-0fdfced3896d"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:16:14.702987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-bd4c5822-b739-4333-bf42-aa68bc0b1fb5 req-284bbaf3-d533-46a8-ad6a-d4bb2226f20e service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:14.707242 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-bd4c5822-b739-4333-bf42-aa68bc0b1fb5 req-284bbaf3-d533-46a8-ad6a-d4bb2226f20e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:14.707713 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-bd4c5822-b739-4333-bf42-aa68bc0b1fb5 req-284bbaf3-d533-46a8-ad6a-d4bb2226f20e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:14.742767 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-bd4c5822-b739-4333-bf42-aa68bc0b1fb5 req-284bbaf3-d533-46a8-ad6a-d4bb2226f20e service nova] Creating event network-vif-plugged:bb5fa759-fb42-4724-9c5e-6a0f92fc97d1 for instance b5fa9733-f49b-43ab-8586-68d113b73476 on n-h1-862686-1 Oct 26 13:16:14.747569 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-bd4c5822-b739-4333-bf42-aa68bc0b1fb5 req-284bbaf3-d533-46a8-ad6a-d4bb2226f20e service nova] Creating event network-vif-plugged:7e6108c5-cc9c-4df8-828e-0fdfced3896d for instance 8718e439-6247-480e-9887-eab549630975 on n-h1-862686-1 Oct 26 13:16:14.766465 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-bd4c5822-b739-4333-bf42-aa68bc0b1fb5 req-284bbaf3-d533-46a8-ad6a-d4bb2226f20e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.086815 Oct 26 13:16:14.772460 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1638/3266] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:16:14.779454 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9db73dfb-49e9-4ccb-b5c2-4f5fed7d06b5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:14.780484 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9db73dfb-49e9-4ccb-b5c2-4f5fed7d06b5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 8718e439-6247-480e-9887-eab549630975] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:14.787718 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-77ee0202-6c4f-4dce-9fad-049c272ddea3 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13285463ba34e89931d667bc327bb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875ebd1c99c746f7b4f1a3c08156e6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:14.797150 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-77ee0202-6c4f-4dce-9fad-049c272ddea3 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "GET /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3" status: 200 len: 1647 microversion: 2.1 time: 0.217542 Oct 26 13:16:14.803074 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9db73dfb-49e9-4ccb-b5c2-4f5fed7d06b5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:14.803763 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9db73dfb-49e9-4ccb-b5c2-4f5fed7d06b5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:14.810312 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1629/3267] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:14 2022] GET /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3 => generated 1647 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:14.813014 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9db73dfb-49e9-4ccb-b5c2-4f5fed7d06b5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:14.815475 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9db73dfb-49e9-4ccb-b5c2-4f5fed7d06b5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:14.818910 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9db73dfb-49e9-4ccb-b5c2-4f5fed7d06b5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:14.819634 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9db73dfb-49e9-4ccb-b5c2-4f5fed7d06b5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:15.081691 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-22f2b225-6db4-4177-b9e7-526c9be25429 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:15.088055 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-22f2b225-6db4-4177-b9e7-526c9be25429 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:15.095513 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22f2b225-6db4-4177-b9e7-526c9be25429 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:15.096006 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22f2b225-6db4-4177-b9e7-526c9be25429 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:15.096437 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22f2b225-6db4-4177-b9e7-526c9be25429 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:15.097331 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22f2b225-6db4-4177-b9e7-526c9be25429 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:15.097988 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22f2b225-6db4-4177-b9e7-526c9be25429 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:15.098615 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22f2b225-6db4-4177-b9e7-526c9be25429 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:15.153567 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-22f2b225-6db4-4177-b9e7-526c9be25429 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076881 Oct 26 13:16:15.154487 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1630/3268] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:16:15 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:16:15.213522 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9db73dfb-49e9-4ccb-b5c2-4f5fed7d06b5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:15.223905 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9db73dfb-49e9-4ccb-b5c2-4f5fed7d06b5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975" status: 200 len: 1309 microversion: 2.1 time: 0.449111 Oct 26 13:16:15.225584 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1639/3269] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:14 2022] GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975 => generated 1309 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:15.500733 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3528215e-2524-4e43-9c28-32965c272093 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:15.501360 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3528215e-2524-4e43-9c28-32965c272093 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:15.501866 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e7aec6c9-9481-4c0d-8d4b-4c03e25f7867 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:15.503122 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e7aec6c9-9481-4c0d-8d4b-4c03e25f7867 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 7d459ce7-b3e3-4ae8-868b-2ff408d2c200] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:15.507442 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3528215e-2524-4e43-9c28-32965c272093 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:15.507944 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3528215e-2524-4e43-9c28-32965c272093 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:15.508385 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3528215e-2524-4e43-9c28-32965c272093 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:15.509093 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3528215e-2524-4e43-9c28-32965c272093 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:15.509210 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e7aec6c9-9481-4c0d-8d4b-4c03e25f7867 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:15.509584 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3528215e-2524-4e43-9c28-32965c272093 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:15.509717 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e7aec6c9-9481-4c0d-8d4b-4c03e25f7867 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:15.510018 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3528215e-2524-4e43-9c28-32965c272093 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:15.510142 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e7aec6c9-9481-4c0d-8d4b-4c03e25f7867 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:15.511038 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e7aec6c9-9481-4c0d-8d4b-4c03e25f7867 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:15.511615 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e7aec6c9-9481-4c0d-8d4b-4c03e25f7867 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:15.512076 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e7aec6c9-9481-4c0d-8d4b-4c03e25f7867 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:15.716834 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e7aec6c9-9481-4c0d-8d4b-4c03e25f7867 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:15.725903 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e7aec6c9-9481-4c0d-8d4b-4c03e25f7867 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200" status: 200 len: 1513 microversion: 2.1 time: 0.230549 Oct 26 13:16:15.727060 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1631/3270] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:15 2022] GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200 => generated 1513 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:15.822233 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-24356d42-dd4d-4a70-8070-b89f20bd9a10 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:15.822847 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-24356d42-dd4d-4a70-8070-b89f20bd9a10 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 6b3fe85a-699d-438b-b809-0539f2fd25b3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:15.828940 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24356d42-dd4d-4a70-8070-b89f20bd9a10 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:15.829642 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24356d42-dd4d-4a70-8070-b89f20bd9a10 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:15.830417 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24356d42-dd4d-4a70-8070-b89f20bd9a10 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:15.831290 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24356d42-dd4d-4a70-8070-b89f20bd9a10 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:15.831897 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24356d42-dd4d-4a70-8070-b89f20bd9a10 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:15.832629 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24356d42-dd4d-4a70-8070-b89f20bd9a10 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:15.837086 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:16:16.030256 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3528215e-2524-4e43-9c28-32965c272093 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:16.058601 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3528215e-2524-4e43-9c28-32965c272093 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:16.062185 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3528215e-2524-4e43-9c28-32965c272093 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:16.068948 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3528215e-2524-4e43-9c28-32965c272093 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1879 microversion: 2.42 time: 0.570659 Oct 26 13:16:16.069973 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1640/3271] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:16:15 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1879 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:16:16.098378 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-24356d42-dd4d-4a70-8070-b89f20bd9a10 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13285463ba34e89931d667bc327bb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875ebd1c99c746f7b4f1a3c08156e6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:16.109177 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-24356d42-dd4d-4a70-8070-b89f20bd9a10 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "GET /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3" status: 200 len: 1647 microversion: 2.1 time: 0.291023 Oct 26 13:16:16.110067 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1632/3272] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:15 2022] GET /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3 => generated 1647 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:16:16.168987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cdda38cf-b96f-48fc-bd57-586730d951e2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:16.172209 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cdda38cf-b96f-48fc-bd57-586730d951e2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:16.184127 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cdda38cf-b96f-48fc-bd57-586730d951e2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:16.186217 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cdda38cf-b96f-48fc-bd57-586730d951e2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:16.186988 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cdda38cf-b96f-48fc-bd57-586730d951e2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:16.189264 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cdda38cf-b96f-48fc-bd57-586730d951e2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:16.190610 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cdda38cf-b96f-48fc-bd57-586730d951e2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:16.191722 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cdda38cf-b96f-48fc-bd57-586730d951e2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:16.242543 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cdda38cf-b96f-48fc-bd57-586730d951e2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079465 Oct 26 13:16:16.248171 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2152aa6c-ebeb-48c5-8f69-0e7152aca120 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:16.248357 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1641/3273] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:16:16 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:16:16.249117 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2152aa6c-ebeb-48c5-8f69-0e7152aca120 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 8718e439-6247-480e-9887-eab549630975] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:16.268401 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2152aa6c-ebeb-48c5-8f69-0e7152aca120 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:16.269143 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2152aa6c-ebeb-48c5-8f69-0e7152aca120 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:16.269628 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2152aa6c-ebeb-48c5-8f69-0e7152aca120 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:16.270597 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2152aa6c-ebeb-48c5-8f69-0e7152aca120 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:16.271526 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2152aa6c-ebeb-48c5-8f69-0e7152aca120 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:16.272199 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2152aa6c-ebeb-48c5-8f69-0e7152aca120 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:16.529751 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2152aa6c-ebeb-48c5-8f69-0e7152aca120 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:16.550163 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2152aa6c-ebeb-48c5-8f69-0e7152aca120 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975" status: 200 len: 1309 microversion: 2.1 time: 0.303806 Oct 26 13:16:16.552601 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1633/3274] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:16 2022] GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975 => generated 1309 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:16:16.742211 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-936edb92-20ed-447a-aa1b-0be9f6dbbf8c req-209e59e3-c407-4b82-9417-e42afe193548 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d459ce7-b3e3-4ae8-868b-2ff408d2c200", "name": "network-vif-deleted", "tag": "c1c64a7d-ef07-46c0-9c88-01d86fb7dd9b"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:16:16.750021 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-aa0f1ed7-149d-4917-8526-655f2545070b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:16.751060 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-aa0f1ed7-149d-4917-8526-655f2545070b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 7d459ce7-b3e3-4ae8-868b-2ff408d2c200] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:16.775031 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-936edb92-20ed-447a-aa1b-0be9f6dbbf8c req-209e59e3-c407-4b82-9417-e42afe193548 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:16.775511 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-936edb92-20ed-447a-aa1b-0be9f6dbbf8c req-209e59e3-c407-4b82-9417-e42afe193548 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:16.775938 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-936edb92-20ed-447a-aa1b-0be9f6dbbf8c req-209e59e3-c407-4b82-9417-e42afe193548 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:16.777643 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa0f1ed7-149d-4917-8526-655f2545070b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:16.778242 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa0f1ed7-149d-4917-8526-655f2545070b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:16.778682 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa0f1ed7-149d-4917-8526-655f2545070b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:16.779411 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa0f1ed7-149d-4917-8526-655f2545070b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:16.789770 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa0f1ed7-149d-4917-8526-655f2545070b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:16.790583 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa0f1ed7-149d-4917-8526-655f2545070b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:16.834002 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-936edb92-20ed-447a-aa1b-0be9f6dbbf8c req-209e59e3-c407-4b82-9417-e42afe193548 service nova] Creating event network-vif-deleted:c1c64a7d-ef07-46c0-9c88-01d86fb7dd9b for instance 7d459ce7-b3e3-4ae8-868b-2ff408d2c200 on n-h2-862686-1 Oct 26 13:16:16.856691 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-936edb92-20ed-447a-aa1b-0be9f6dbbf8c req-209e59e3-c407-4b82-9417-e42afe193548 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118252 Oct 26 13:16:16.858867 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1642/3275] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:16:17.006972 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-aa0f1ed7-149d-4917-8526-655f2545070b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:17.033296 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-aa0f1ed7-149d-4917-8526-655f2545070b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200" status: 200 len: 1303 microversion: 2.1 time: 0.283102 Oct 26 13:16:17.037900 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1634/3276] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:16 2022] GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200 => generated 1303 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:17.098942 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5e35fb1b-8bca-45db-a9ae-3bcc59255268 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:17.099930 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5e35fb1b-8bca-45db-a9ae-3bcc59255268 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:17.119209 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5e35fb1b-8bca-45db-a9ae-3bcc59255268 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:17.122042 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5e35fb1b-8bca-45db-a9ae-3bcc59255268 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:17.124336 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5e35fb1b-8bca-45db-a9ae-3bcc59255268 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:17.126986 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5e35fb1b-8bca-45db-a9ae-3bcc59255268 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:17.133531 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8b0db509-0640-4e6b-8b07-3ffdb5171521 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:17.134310 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8b0db509-0640-4e6b-8b07-3ffdb5171521 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 6b3fe85a-699d-438b-b809-0539f2fd25b3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:17.139572 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5e35fb1b-8bca-45db-a9ae-3bcc59255268 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:17.142633 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5e35fb1b-8bca-45db-a9ae-3bcc59255268 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:17.152657 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b0db509-0640-4e6b-8b07-3ffdb5171521 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:17.153452 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b0db509-0640-4e6b-8b07-3ffdb5171521 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:17.155729 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b0db509-0640-4e6b-8b07-3ffdb5171521 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:17.158413 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b0db509-0640-4e6b-8b07-3ffdb5171521 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:17.159386 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b0db509-0640-4e6b-8b07-3ffdb5171521 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:17.161732 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b0db509-0640-4e6b-8b07-3ffdb5171521 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:17.379071 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8b0db509-0640-4e6b-8b07-3ffdb5171521 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13285463ba34e89931d667bc327bb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875ebd1c99c746f7b4f1a3c08156e6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:17.396784 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8b0db509-0640-4e6b-8b07-3ffdb5171521 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "GET /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3" status: 200 len: 1301 microversion: 2.1 time: 0.268091 Oct 26 13:16:17.397443 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1635/3277] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:17 2022] GET /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3 => generated 1301 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:16:17.417544 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9b6da92a-08c8-4ff5-9eb1-910623d35c41 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:17.428952 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9b6da92a-08c8-4ff5-9eb1-910623d35c41 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:17.459411 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b6da92a-08c8-4ff5-9eb1-910623d35c41 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:17.459904 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b6da92a-08c8-4ff5-9eb1-910623d35c41 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:17.460404 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b6da92a-08c8-4ff5-9eb1-910623d35c41 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:17.461178 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b6da92a-08c8-4ff5-9eb1-910623d35c41 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:17.461677 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b6da92a-08c8-4ff5-9eb1-910623d35c41 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:17.466555 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b6da92a-08c8-4ff5-9eb1-910623d35c41 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:17.534396 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9b6da92a-08c8-4ff5-9eb1-910623d35c41 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129884 Oct 26 13:16:17.537126 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1636/3278] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:16:17 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:16:17.538471 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5e35fb1b-8bca-45db-a9ae-3bcc59255268 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:17.562424 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5e35fb1b-8bca-45db-a9ae-3bcc59255268 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:17.566187 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5e35fb1b-8bca-45db-a9ae-3bcc59255268 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:17.567838 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5e35fb1b-8bca-45db-a9ae-3bcc59255268 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1879 microversion: 2.42 time: 0.473952 Oct 26 13:16:17.567981 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1643/3279] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:16:17 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1879 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:16:17.591653 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-545b31f1-05ac-4111-89ff-d251d90f25ee tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:17.592276 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-545b31f1-05ac-4111-89ff-d251d90f25ee tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 8718e439-6247-480e-9887-eab549630975] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:17.598871 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-545b31f1-05ac-4111-89ff-d251d90f25ee tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:17.599396 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-545b31f1-05ac-4111-89ff-d251d90f25ee tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:17.599837 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-545b31f1-05ac-4111-89ff-d251d90f25ee tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:17.600548 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-545b31f1-05ac-4111-89ff-d251d90f25ee tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:17.606384 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-545b31f1-05ac-4111-89ff-d251d90f25ee tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:17.606904 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-545b31f1-05ac-4111-89ff-d251d90f25ee tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:17.783258 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-545b31f1-05ac-4111-89ff-d251d90f25ee tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:17.793160 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-545b31f1-05ac-4111-89ff-d251d90f25ee tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975" status: 200 len: 1489 microversion: 2.1 time: 0.209262 Oct 26 13:16:17.794634 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1637/3280] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:17 2022] GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975 => generated 1489 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:17.816627 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f263f4fb-32c1-4fdc-bbab-194aefc5276b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:16:17.822254 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f263f4fb-32c1-4fdc-bbab-194aefc5276b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 8718e439-6247-480e-9887-eab549630975] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:17.825584 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:16:17.831135 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f263f4fb-32c1-4fdc-bbab-194aefc5276b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:17.831829 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f263f4fb-32c1-4fdc-bbab-194aefc5276b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:17.832267 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f263f4fb-32c1-4fdc-bbab-194aefc5276b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:17.832972 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f263f4fb-32c1-4fdc-bbab-194aefc5276b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:17.833425 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f263f4fb-32c1-4fdc-bbab-194aefc5276b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:17.833874 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f263f4fb-32c1-4fdc-bbab-194aefc5276b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:17.925770 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f263f4fb-32c1-4fdc-bbab-194aefc5276b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "PUT /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975" status: 200 len: 1084 microversion: 2.1 time: 0.112506 Oct 26 13:16:17.928111 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1644/3281] 10.222.0.40 () {60 vars in 1256 bytes} [Wed Oct 26 13:16:17 2022] PUT /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975 => generated 1084 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:17.950555 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-540fea2d-e18a-4604-868c-d23b6703cc87 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:17.951357 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-540fea2d-e18a-4604-868c-d23b6703cc87 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 8718e439-6247-480e-9887-eab549630975] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:17.960382 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-540fea2d-e18a-4604-868c-d23b6703cc87 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:17.961800 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-540fea2d-e18a-4604-868c-d23b6703cc87 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:17.962751 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-540fea2d-e18a-4604-868c-d23b6703cc87 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:17.964450 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-540fea2d-e18a-4604-868c-d23b6703cc87 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:17.965418 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-540fea2d-e18a-4604-868c-d23b6703cc87 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:17.966218 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-540fea2d-e18a-4604-868c-d23b6703cc87 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:18.063995 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b4842f23-cb61-4455-a460-06f903d283a4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:18.064922 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b4842f23-cb61-4455-a460-06f903d283a4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 7d459ce7-b3e3-4ae8-868b-2ff408d2c200] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:18.074590 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b4842f23-cb61-4455-a460-06f903d283a4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:18.075341 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b4842f23-cb61-4455-a460-06f903d283a4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:18.077533 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b4842f23-cb61-4455-a460-06f903d283a4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:18.078505 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b4842f23-cb61-4455-a460-06f903d283a4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:18.079676 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b4842f23-cb61-4455-a460-06f903d283a4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:18.081959 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b4842f23-cb61-4455-a460-06f903d283a4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:18.172299 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b4842f23-cb61-4455-a460-06f903d283a4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:18.174258 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b4842f23-cb61-4455-a460-06f903d283a4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:18.174770 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b4842f23-cb61-4455-a460-06f903d283a4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:18.175266 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-b4842f23-cb61-4455-a460-06f903d283a4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lazy-loading 'fault' on Instance uuid 7d459ce7-b3e3-4ae8-868b-2ff408d2c200 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:16:18.277181 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b4842f23-cb61-4455-a460-06f903d283a4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5744e7524e4c4d2c896ce178572ada0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5291f3c81016423cbc1164c82551f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:18.288614 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b4842f23-cb61-4455-a460-06f903d283a4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200" status: 200 len: 1308 microversion: 2.1 time: 0.228625 Oct 26 13:16:18.290523 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1645/3282] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:18 2022] GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200 => generated 1308 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:18.297692 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-57e3ad51-4194-452d-ab7d-fb76937f7e1d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Action: 'create', calling method: .version_select at 0x7f6732674f70>, body: {"keypair": {"name": "tempest-keypair-1420444742", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3VJWlM050cnzfopx/9ml5rlalr2fmAMy6BF41LCnHlSgfm383WEkUd6x9PLTT1ZgtGQB5EcWkGLGLcVTqfkDx+zMl7D4PQB1Q5utUOoz/RSmA/CycHqTpcYO+Eaqyxfg=="}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:16:18.326331 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-57e3ad51-4194-452d-ab7d-fb76937f7e1d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Getting quotas for project 174da5e5c60449b7a04e9cf2aa3b9fda. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:16:18.335647 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-57e3ad51-4194-452d-ab7d-fb76937f7e1d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Getting quotas for user 168c83cd1b014f82945f4915e3ece079 and project 174da5e5c60449b7a04e9cf2aa3b9fda. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:16:18.349061 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-540fea2d-e18a-4604-868c-d23b6703cc87 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:18.360887 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-540fea2d-e18a-4604-868c-d23b6703cc87 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975" status: 200 len: 1510 microversion: 2.1 time: 0.416404 Oct 26 13:16:18.362799 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1638/3283] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:17 2022] GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975 => generated 1510 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:18.386268 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-53c1cdd4-9e16-45c7-8505-58fd115f8520 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:18.386984 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-53c1cdd4-9e16-45c7-8505-58fd115f8520 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 8718e439-6247-480e-9887-eab549630975] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:18.395503 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-53c1cdd4-9e16-45c7-8505-58fd115f8520 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:18.396415 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-57e3ad51-4194-452d-ab7d-fb76937f7e1d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.102361 Oct 26 13:16:18.396608 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-53c1cdd4-9e16-45c7-8505-58fd115f8520 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:18.397148 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-53c1cdd4-9e16-45c7-8505-58fd115f8520 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:18.403741 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-53c1cdd4-9e16-45c7-8505-58fd115f8520 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:18.403741 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-53c1cdd4-9e16-45c7-8505-58fd115f8520 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:18.403741 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-53c1cdd4-9e16-45c7-8505-58fd115f8520 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:18.406266 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1646/3284] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 13:16:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:16:18.426950 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-69f330b3-9e0c-413f-b795-7446d82a3e67 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:18.429801 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-69f330b3-9e0c-413f-b795-7446d82a3e67 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 6b3fe85a-699d-438b-b809-0539f2fd25b3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:18.452928 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69f330b3-9e0c-413f-b795-7446d82a3e67 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:18.454528 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69f330b3-9e0c-413f-b795-7446d82a3e67 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:18.456305 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69f330b3-9e0c-413f-b795-7446d82a3e67 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:18.459402 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69f330b3-9e0c-413f-b795-7446d82a3e67 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:18.463026 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69f330b3-9e0c-413f-b795-7446d82a3e67 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:18.465179 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69f330b3-9e0c-413f-b795-7446d82a3e67 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:18.536829 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:16:18.574934 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69f330b3-9e0c-413f-b795-7446d82a3e67 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:18.576982 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69f330b3-9e0c-413f-b795-7446d82a3e67 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:18.577439 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69f330b3-9e0c-413f-b795-7446d82a3e67 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:18.579029 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-69f330b3-9e0c-413f-b795-7446d82a3e67 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lazy-loading 'fault' on Instance uuid 6b3fe85a-699d-438b-b809-0539f2fd25b3 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:16:18.659726 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-53c1cdd4-9e16-45c7-8505-58fd115f8520 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:18.668356 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-53c1cdd4-9e16-45c7-8505-58fd115f8520 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975" status: 200 len: 1510 microversion: 2.1 time: 0.286423 Oct 26 13:16:18.681748 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1639/3285] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:18 2022] GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975 => generated 1510 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:16:18.706515 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-06d49620-e6be-402f-9909-9946e79cf7fc tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:18.708841 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-06d49620-e6be-402f-9909-9946e79cf7fc tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:18.718675 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06d49620-e6be-402f-9909-9946e79cf7fc tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:18.719176 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06d49620-e6be-402f-9909-9946e79cf7fc tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:18.719614 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06d49620-e6be-402f-9909-9946e79cf7fc tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:18.720335 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06d49620-e6be-402f-9909-9946e79cf7fc tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:18.720797 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06d49620-e6be-402f-9909-9946e79cf7fc tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:18.721228 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06d49620-e6be-402f-9909-9946e79cf7fc tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:18.722768 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-69f330b3-9e0c-413f-b795-7446d82a3e67 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13285463ba34e89931d667bc327bb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875ebd1c99c746f7b4f1a3c08156e6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:18.735618 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-69f330b3-9e0c-413f-b795-7446d82a3e67 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "GET /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3" status: 200 len: 1306 microversion: 2.1 time: 0.315166 Oct 26 13:16:18.739835 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1647/3286] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:18 2022] GET /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3 => generated 1306 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:16:18.755000 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b83037b5-a7f0-45bf-886d-89cdf6968e81 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:18.755684 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b83037b5-a7f0-45bf-886d-89cdf6968e81 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:18.774190 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b83037b5-a7f0-45bf-886d-89cdf6968e81 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:18.777798 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b83037b5-a7f0-45bf-886d-89cdf6968e81 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:18.778928 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b83037b5-a7f0-45bf-886d-89cdf6968e81 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:18.779702 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b83037b5-a7f0-45bf-886d-89cdf6968e81 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:18.783452 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b83037b5-a7f0-45bf-886d-89cdf6968e81 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:18.783955 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b83037b5-a7f0-45bf-886d-89cdf6968e81 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:18.891898 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-06d49620-e6be-402f-9909-9946e79cf7fc tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.216880 Oct 26 13:16:18.892492 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1640/3287] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:16:18 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c/os-volume_attachments => generated 197 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:16:18.910480 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-05f0fdd3-8d96-4947-b6e8-8e54f999b9cd tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:18.914315 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-05f0fdd3-8d96-4947-b6e8-8e54f999b9cd tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 8718e439-6247-480e-9887-eab549630975] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:18.931332 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05f0fdd3-8d96-4947-b6e8-8e54f999b9cd tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:18.933846 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05f0fdd3-8d96-4947-b6e8-8e54f999b9cd tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:18.935950 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05f0fdd3-8d96-4947-b6e8-8e54f999b9cd tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:18.937638 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05f0fdd3-8d96-4947-b6e8-8e54f999b9cd tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:18.939699 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05f0fdd3-8d96-4947-b6e8-8e54f999b9cd tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:18.940883 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05f0fdd3-8d96-4947-b6e8-8e54f999b9cd tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:19.014301 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-05f0fdd3-8d96-4947-b6e8-8e54f999b9cd tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 8718e439-6247-480e-9887-eab549630975] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:16:19.218357 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-05f0fdd3-8d96-4947-b6e8-8e54f999b9cd tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975" status: 204 len: 0 microversion: 2.1 time: 0.320434 Oct 26 13:16:19.222882 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1641/3288] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:16:18 2022] DELETE /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:16:19.228910 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-c9affb90-1882-4742-a70d-20986bfc310f req-fe1f7453-e177-4db0-a822-ec8a216a29c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b3fe85a-699d-438b-b809-0539f2fd25b3", "name": "network-vif-deleted", "tag": "f95eafb3-a2e9-4243-a442-390ae39acdbe"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:16:19.240257 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-c9affb90-1882-4742-a70d-20986bfc310f req-fe1f7453-e177-4db0-a822-ec8a216a29c2 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:19.241069 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-c9affb90-1882-4742-a70d-20986bfc310f req-fe1f7453-e177-4db0-a822-ec8a216a29c2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:19.241728 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-c9affb90-1882-4742-a70d-20986bfc310f req-fe1f7453-e177-4db0-a822-ec8a216a29c2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:19.257475 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-c9affb90-1882-4742-a70d-20986bfc310f req-fe1f7453-e177-4db0-a822-ec8a216a29c2 service nova] Creating event network-vif-deleted:f95eafb3-a2e9-4243-a442-390ae39acdbe for instance 6b3fe85a-699d-438b-b809-0539f2fd25b3 on n-h2-862686-1 Oct 26 13:16:19.267897 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-c9affb90-1882-4742-a70d-20986bfc310f req-fe1f7453-e177-4db0-a822-ec8a216a29c2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043062 Oct 26 13:16:19.274367 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1642/3289] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:16:19.281847 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-89e75821-68da-42ef-8228-ae2734cbd3a1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:19.282546 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-89e75821-68da-42ef-8228-ae2734cbd3a1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 8718e439-6247-480e-9887-eab549630975] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:19.289529 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-89e75821-68da-42ef-8228-ae2734cbd3a1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:19.290033 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-89e75821-68da-42ef-8228-ae2734cbd3a1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:19.290999 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-89e75821-68da-42ef-8228-ae2734cbd3a1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:19.291873 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-89e75821-68da-42ef-8228-ae2734cbd3a1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:19.292211 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-89e75821-68da-42ef-8228-ae2734cbd3a1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:19.292767 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-89e75821-68da-42ef-8228-ae2734cbd3a1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:19.537853 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b83037b5-a7f0-45bf-886d-89cdf6968e81 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:19.547586 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b83037b5-a7f0-45bf-886d-89cdf6968e81 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:19.549027 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b83037b5-a7f0-45bf-886d-89cdf6968e81 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:19.554782 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b83037b5-a7f0-45bf-886d-89cdf6968e81 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 2836 microversion: 2.42 time: 0.814373 Oct 26 13:16:19.555992 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1648/3290] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:16:18 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 2836 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:16:19.561719 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6fe641e0-b084-413e-80cc-c0f3caef5c6b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:19.568926 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6fe641e0-b084-413e-80cc-c0f3caef5c6b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 7d459ce7-b3e3-4ae8-868b-2ff408d2c200] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:19.587156 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6fe641e0-b084-413e-80cc-c0f3caef5c6b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:19.587879 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6fe641e0-b084-413e-80cc-c0f3caef5c6b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:19.589066 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6fe641e0-b084-413e-80cc-c0f3caef5c6b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:19.589989 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6fe641e0-b084-413e-80cc-c0f3caef5c6b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:19.590594 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6fe641e0-b084-413e-80cc-c0f3caef5c6b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:19.591172 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6fe641e0-b084-413e-80cc-c0f3caef5c6b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:19.609767 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-6fe641e0-b084-413e-80cc-c0f3caef5c6b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] HTTP exception thrown: Instance 7d459ce7-b3e3-4ae8-868b-2ff408d2c200 could not be found. Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6fe641e0-b084-413e-80cc-c0f3caef5c6b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Request method failure captured: Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200 HTTP/1.1 Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTKAmly9e-P6_tAu62nwltFHIH6V4qGg3XOBuRmES2riu97c9sqoI1-q9WD1lwRlJKXzWW2SXROWz1XCi_ZW7duRQg6op4hkt4QBlcn1CBRyEPhs0Xi1ZAKZC2lAaALmqaqqgxlKQQC3k30GkVj1WFE-zoUa5LJWaTarkq2sZYpzvPg Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 5291f3c81016423cbc1164c82551f648 Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServerDiskConfigTestJSON-762059440 Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5291f3c81016423cbc1164c82551f648"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5291f3c81016423cbc1164c82551f648"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5291f3c81016423cbc1164c82551f648"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5291f3c81016423cbc1164c82551f648"}]}] Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServerDiskConfigTestJSON-762059440 Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 5291f3c81016423cbc1164c82551f648 Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-762059440 Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServerDiskConfigTestJSON-762059440-project Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 5744e7524e4c4d2c896ce178572ada0c Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServerDiskConfigTestJSON-762059440-project Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 7d459ce7-b3e3-4ae8-868b-2ff408d2c200 could not be found. Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '7d459ce7-b3e3-4ae8-868b-2ff408d2c200'} Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d459ce7-b3e3-4ae8-868b-2ff408d2c200 could not be found. Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d459ce7-b3e3-4ae8-868b-2ff408d2c200 could not be found. Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:19.612350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:19.617019 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:19.617019 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:16:19.617019 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:16:19.617019 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:16:19.617019 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:16:19.617019 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d459ce7-b3e3-4ae8-868b-2ff408d2c200 could not be found. Oct 26 13:16:19.617019 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:19.617019 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6fe641e0-b084-413e-80cc-c0f3caef5c6b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Returning 404 to user: Instance 7d459ce7-b3e3-4ae8-868b-2ff408d2c200 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:16:19.617019 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6fe641e0-b084-413e-80cc-c0f3caef5c6b tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200" status: 404 len: 111 microversion: 2.1 time: 0.057205 Oct 26 13:16:19.617019 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1649/3291] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:19 2022] GET /compute/v2.1/servers/7d459ce7-b3e3-4ae8-868b-2ff408d2c200 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:16:19.619930 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cb08ec6e-266b-4ad2-aa43-1ca7ec53cb2b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:19.620439 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cb08ec6e-266b-4ad2-aa43-1ca7ec53cb2b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: d0b8440f-677e-428d-8566-29fe4624fce1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:19.627335 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb08ec6e-266b-4ad2-aa43-1ca7ec53cb2b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:19.627780 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb08ec6e-266b-4ad2-aa43-1ca7ec53cb2b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:19.628248 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb08ec6e-266b-4ad2-aa43-1ca7ec53cb2b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:19.628940 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb08ec6e-266b-4ad2-aa43-1ca7ec53cb2b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:19.629397 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb08ec6e-266b-4ad2-aa43-1ca7ec53cb2b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:19.629874 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb08ec6e-266b-4ad2-aa43-1ca7ec53cb2b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:19.640797 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-89e75821-68da-42ef-8228-ae2734cbd3a1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:19.660364 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-89e75821-68da-42ef-8228-ae2734cbd3a1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975" status: 200 len: 1516 microversion: 2.1 time: 0.383646 Oct 26 13:16:19.661067 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cb08ec6e-266b-4ad2-aa43-1ca7ec53cb2b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: d0b8440f-677e-428d-8566-29fe4624fce1] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:16:19.663077 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1643/3292] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:19 2022] GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975 => generated 1516 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:19.678381 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e70a1543-e5e7-4163-bf90-046863d47144 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:19.690744 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e70a1543-e5e7-4163-bf90-046863d47144 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:19.700295 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e70a1543-e5e7-4163-bf90-046863d47144 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:19.700952 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e70a1543-e5e7-4163-bf90-046863d47144 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:19.701399 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e70a1543-e5e7-4163-bf90-046863d47144 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:19.702154 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e70a1543-e5e7-4163-bf90-046863d47144 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:19.702762 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e70a1543-e5e7-4163-bf90-046863d47144 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:19.704470 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e70a1543-e5e7-4163-bf90-046863d47144 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:19.839467 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cb08ec6e-266b-4ad2-aa43-1ca7ec53cb2b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1" status: 204 len: 0 microversion: 2.1 time: 0.222556 Oct 26 13:16:19.840475 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1650/3293] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:16:19 2022] DELETE /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:16:19.849902 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0c7685ab-1b60-4445-a7cc-8a9e190b1084 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:19.850688 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0c7685ab-1b60-4445-a7cc-8a9e190b1084 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: a1dbfc30-8cbf-4a85-8847-a24031f5e3dc] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:19.865282 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c7685ab-1b60-4445-a7cc-8a9e190b1084 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:19.866449 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c7685ab-1b60-4445-a7cc-8a9e190b1084 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:19.866926 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c7685ab-1b60-4445-a7cc-8a9e190b1084 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:19.870336 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c7685ab-1b60-4445-a7cc-8a9e190b1084 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:19.873797 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c7685ab-1b60-4445-a7cc-8a9e190b1084 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:19.874562 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c7685ab-1b60-4445-a7cc-8a9e190b1084 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:19.900582 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-0c7685ab-1b60-4445-a7cc-8a9e190b1084 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] HTTP exception thrown: Instance a1dbfc30-8cbf-4a85-8847-a24031f5e3dc could not be found. Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0c7685ab-1b60-4445-a7cc-8a9e190b1084 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Request method failure captured: Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc HTTP/1.1 Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTKAmly9e-P6_tAu62nwltFHIH6V4qGg3XOBuRmES2riu97c9sqoI1-q9WD1lwRlJKXzWW2SXROWz1XCi_ZW7duRQg6op4hkt4QBlcn1CBRyEPhs0Xi1ZAKZC2lAaALmqaqqgxlKQQC3k30GkVj1WFE-zoUa5LJWaTarkq2sZYpzvPg Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 5291f3c81016423cbc1164c82551f648 Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServerDiskConfigTestJSON-762059440 Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5291f3c81016423cbc1164c82551f648"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5291f3c81016423cbc1164c82551f648"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5291f3c81016423cbc1164c82551f648"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5291f3c81016423cbc1164c82551f648"}]}] Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServerDiskConfigTestJSON-762059440 Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 5291f3c81016423cbc1164c82551f648 Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-762059440 Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServerDiskConfigTestJSON-762059440-project Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 5744e7524e4c4d2c896ce178572ada0c Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServerDiskConfigTestJSON-762059440-project Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance a1dbfc30-8cbf-4a85-8847-a24031f5e3dc could not be found. Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'a1dbfc30-8cbf-4a85-8847-a24031f5e3dc'} Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1dbfc30-8cbf-4a85-8847-a24031f5e3dc could not be found. Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:16:19.904070 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:16:19.908749 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1dbfc30-8cbf-4a85-8847-a24031f5e3dc could not be found. Oct 26 13:16:19.908749 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:19.908749 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:19.908749 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:19.908749 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:19.908749 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:16:19.908749 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:16:19.908749 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:16:19.908749 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:16:19.908749 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1dbfc30-8cbf-4a85-8847-a24031f5e3dc could not be found. Oct 26 13:16:19.908749 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:19.915562 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0c7685ab-1b60-4445-a7cc-8a9e190b1084 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Returning 404 to user: Instance a1dbfc30-8cbf-4a85-8847-a24031f5e3dc could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:16:19.916937 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0c7685ab-1b60-4445-a7cc-8a9e190b1084 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc" status: 404 len: 111 microversion: 2.1 time: 0.074838 Oct 26 13:16:19.917818 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1651/3294] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:16:19 2022] DELETE /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:16:19.926714 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-73de236e-f818-40cd-835d-d89380d9b137 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:19.929474 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-73de236e-f818-40cd-835d-d89380d9b137 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 6b3fe85a-699d-438b-b809-0539f2fd25b3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:19.951639 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73de236e-f818-40cd-835d-d89380d9b137 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:19.952413 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73de236e-f818-40cd-835d-d89380d9b137 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:19.953014 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73de236e-f818-40cd-835d-d89380d9b137 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:19.954357 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73de236e-f818-40cd-835d-d89380d9b137 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:19.957281 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73de236e-f818-40cd-835d-d89380d9b137 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:19.957931 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73de236e-f818-40cd-835d-d89380d9b137 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:20.009338 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-73de236e-f818-40cd-835d-d89380d9b137 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] HTTP exception thrown: Instance 6b3fe85a-699d-438b-b809-0539f2fd25b3 could not be found. Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-73de236e-f818-40cd-835d-d89380d9b137 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Request method failure captured: Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3 HTTP/1.1 Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTLZwemdkOoZmTGSmy6KZvPDtVHD2_E9ZUR49ovbPsQaFz77JmwG34xaymuHO8vYj9Nv7h8paBonBJqeJ-iGNHh66dW9zr2o-PVtLnq2ivVkvSk_ngG_K5FTR8-56OwV4JEOB5RsCmAZvvKkRYejOCKTdf6hjGlyGC2s57RFn_cJWHQ Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 875ebd1c99c746f7b4f1a3c08156e6a0 Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-SecurityGroupsTestJSON-256228496 Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/875ebd1c99c746f7b4f1a3c08156e6a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/875ebd1c99c746f7b4f1a3c08156e6a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_875ebd1c99c746f7b4f1a3c08156e6a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/875ebd1c99c746f7b4f1a3c08156e6a0"}]}] Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-SecurityGroupsTestJSON-256228496 Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 875ebd1c99c746f7b4f1a3c08156e6a0 Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-256228496 Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-SecurityGroupsTestJSON-256228496-project Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: a13285463ba34e89931d667bc327bb2a Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-SecurityGroupsTestJSON-256228496-project Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 6b3fe85a-699d-438b-b809-0539f2fd25b3 could not be found. Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '6b3fe85a-699d-438b-b809-0539f2fd25b3'} Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b3fe85a-699d-438b-b809-0539f2fd25b3 could not be found. Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b3fe85a-699d-438b-b809-0539f2fd25b3 could not be found. Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:20.011669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:20.016756 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:20.016756 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:16:20.016756 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:16:20.016756 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:16:20.016756 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:16:20.016756 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b3fe85a-699d-438b-b809-0539f2fd25b3 could not be found. Oct 26 13:16:20.016756 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:20.016756 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-73de236e-f818-40cd-835d-d89380d9b137 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Returning 404 to user: Instance 6b3fe85a-699d-438b-b809-0539f2fd25b3 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:16:20.018316 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-73de236e-f818-40cd-835d-d89380d9b137 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "GET /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3" status: 404 len: 111 microversion: 2.1 time: 0.099257 Oct 26 13:16:20.019565 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1652/3295] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:19 2022] GET /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:16:20.028765 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2422a813-ab9a-4f80-b2bc-1e8d9c1a40b4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:20.031331 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2422a813-ab9a-4f80-b2bc-1e8d9c1a40b4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: d0b8440f-677e-428d-8566-29fe4624fce1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:20.039961 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2422a813-ab9a-4f80-b2bc-1e8d9c1a40b4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:20.040762 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2422a813-ab9a-4f80-b2bc-1e8d9c1a40b4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:20.041409 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2422a813-ab9a-4f80-b2bc-1e8d9c1a40b4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:20.043726 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2422a813-ab9a-4f80-b2bc-1e8d9c1a40b4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:20.044558 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2422a813-ab9a-4f80-b2bc-1e8d9c1a40b4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:20.045239 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2422a813-ab9a-4f80-b2bc-1e8d9c1a40b4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:20.102233 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e70a1543-e5e7-4163-bf90-046863d47144 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.436988 Oct 26 13:16:20.103247 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1644/3296] 10.222.0.40 () {60 vars in 1316 bytes} [Wed Oct 26 13:16:19 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476/os-interface => generated 1830 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:16:20.109648 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f5524888-cca8-4590-b611-77e12d990949 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:20.116704 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f5524888-cca8-4590-b611-77e12d990949 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:20.131040 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5524888-cca8-4590-b611-77e12d990949 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:20.131897 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5524888-cca8-4590-b611-77e12d990949 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:20.133400 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5524888-cca8-4590-b611-77e12d990949 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:20.134383 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5524888-cca8-4590-b611-77e12d990949 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:20.135028 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5524888-cca8-4590-b611-77e12d990949 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:20.135741 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5524888-cca8-4590-b611-77e12d990949 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:20.205600 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f5524888-cca8-4590-b611-77e12d990949 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100213 Oct 26 13:16:20.210753 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1645/3297] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:16:20 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:16:20.216268 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cae88f43-df9d-4320-b571-b2a5a41ccf46 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:20.216887 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cae88f43-df9d-4320-b571-b2a5a41ccf46 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: a1dbfc30-8cbf-4a85-8847-a24031f5e3dc] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:20.223400 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cae88f43-df9d-4320-b571-b2a5a41ccf46 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:20.224326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cae88f43-df9d-4320-b571-b2a5a41ccf46 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:20.225073 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cae88f43-df9d-4320-b571-b2a5a41ccf46 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:20.227091 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cae88f43-df9d-4320-b571-b2a5a41ccf46 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:20.227732 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cae88f43-df9d-4320-b571-b2a5a41ccf46 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:20.229980 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cae88f43-df9d-4320-b571-b2a5a41ccf46 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:20.250547 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-cae88f43-df9d-4320-b571-b2a5a41ccf46 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] HTTP exception thrown: Instance a1dbfc30-8cbf-4a85-8847-a24031f5e3dc could not be found. Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cae88f43-df9d-4320-b571-b2a5a41ccf46 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Request method failure captured: Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc HTTP/1.1 Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTKAmly9e-P6_tAu62nwltFHIH6V4qGg3XOBuRmES2riu97c9sqoI1-q9WD1lwRlJKXzWW2SXROWz1XCi_ZW7duRQg6op4hkt4QBlcn1CBRyEPhs0Xi1ZAKZC2lAaALmqaqqgxlKQQC3k30GkVj1WFE-zoUa5LJWaTarkq2sZYpzvPg Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 5291f3c81016423cbc1164c82551f648 Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServerDiskConfigTestJSON-762059440 Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5291f3c81016423cbc1164c82551f648"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5291f3c81016423cbc1164c82551f648"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5291f3c81016423cbc1164c82551f648"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5291f3c81016423cbc1164c82551f648"}]}] Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServerDiskConfigTestJSON-762059440 Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 5291f3c81016423cbc1164c82551f648 Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-762059440 Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServerDiskConfigTestJSON-762059440-project Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 5744e7524e4c4d2c896ce178572ada0c Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServerDiskConfigTestJSON-762059440-project Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance a1dbfc30-8cbf-4a85-8847-a24031f5e3dc could not be found. Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'a1dbfc30-8cbf-4a85-8847-a24031f5e3dc'} Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1dbfc30-8cbf-4a85-8847-a24031f5e3dc could not be found. Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1dbfc30-8cbf-4a85-8847-a24031f5e3dc could not be found. Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:20.252254 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:20.269231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:20.269231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:16:20.269231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:16:20.269231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:16:20.269231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:16:20.269231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1dbfc30-8cbf-4a85-8847-a24031f5e3dc could not be found. Oct 26 13:16:20.269231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:20.269231 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cae88f43-df9d-4320-b571-b2a5a41ccf46 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Returning 404 to user: Instance a1dbfc30-8cbf-4a85-8847-a24031f5e3dc could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:16:20.269231 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cae88f43-df9d-4320-b571-b2a5a41ccf46 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc" status: 404 len: 111 microversion: 2.1 time: 0.041621 Oct 26 13:16:20.269231 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1646/3298] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:20 2022] GET /compute/v2.1/servers/a1dbfc30-8cbf-4a85-8847-a24031f5e3dc => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:16:20.269231 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0b67feac-d24d-42ac-9c0d-537b917658ea tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '.version_select at 0x7f6732fe74c0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:20.519664 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2422a813-ab9a-4f80-b2bc-1e8d9c1a40b4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:20.536336 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2422a813-ab9a-4f80-b2bc-1e8d9c1a40b4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1" status: 200 len: 1555 microversion: 2.1 time: 0.513153 Oct 26 13:16:20.549559 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1653/3299] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:20 2022] GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1 => generated 1555 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:20.554925 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-33045610-08a7-4ccb-82f2-613017841e38 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:20.555433 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-33045610-08a7-4ccb-82f2-613017841e38 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 9ae69130-8857-4d30-a434-6d8ca54f5cce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:20.566170 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-33045610-08a7-4ccb-82f2-613017841e38 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:20.566959 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-33045610-08a7-4ccb-82f2-613017841e38 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:20.567568 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-33045610-08a7-4ccb-82f2-613017841e38 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:20.568525 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-33045610-08a7-4ccb-82f2-613017841e38 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:20.573566 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-33045610-08a7-4ccb-82f2-613017841e38 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:20.574263 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-33045610-08a7-4ccb-82f2-613017841e38 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:20.610019 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-33045610-08a7-4ccb-82f2-613017841e38 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] HTTP exception thrown: Instance 9ae69130-8857-4d30-a434-6d8ca54f5cce could not be found. Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-33045610-08a7-4ccb-82f2-613017841e38 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Request method failure captured: Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce HTTP/1.1 Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTKAmly9e-P6_tAu62nwltFHIH6V4qGg3XOBuRmES2riu97c9sqoI1-q9WD1lwRlJKXzWW2SXROWz1XCi_ZW7duRQg6op4hkt4QBlcn1CBRyEPhs0Xi1ZAKZC2lAaALmqaqqgxlKQQC3k30GkVj1WFE-zoUa5LJWaTarkq2sZYpzvPg Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 5291f3c81016423cbc1164c82551f648 Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServerDiskConfigTestJSON-762059440 Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5291f3c81016423cbc1164c82551f648"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5291f3c81016423cbc1164c82551f648"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5291f3c81016423cbc1164c82551f648"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5291f3c81016423cbc1164c82551f648"}]}] Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServerDiskConfigTestJSON-762059440 Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 5291f3c81016423cbc1164c82551f648 Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-762059440 Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServerDiskConfigTestJSON-762059440-project Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 5744e7524e4c4d2c896ce178572ada0c Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServerDiskConfigTestJSON-762059440-project Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 9ae69130-8857-4d30-a434-6d8ca54f5cce could not be found. Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '9ae69130-8857-4d30-a434-6d8ca54f5cce'} Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ae69130-8857-4d30-a434-6d8ca54f5cce could not be found. Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:16:20.611614 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:16:20.615830 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ae69130-8857-4d30-a434-6d8ca54f5cce could not be found. Oct 26 13:16:20.615830 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:20.615830 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:20.615830 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:20.615830 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:20.615830 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:16:20.615830 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:16:20.615830 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:16:20.615830 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:16:20.615830 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ae69130-8857-4d30-a434-6d8ca54f5cce could not be found. Oct 26 13:16:20.615830 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:20.617595 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-33045610-08a7-4ccb-82f2-613017841e38 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Returning 404 to user: Instance 9ae69130-8857-4d30-a434-6d8ca54f5cce could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:16:20.618616 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-33045610-08a7-4ccb-82f2-613017841e38 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce" status: 404 len: 111 microversion: 2.1 time: 0.080097 Oct 26 13:16:20.619887 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1654/3300] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:16:20 2022] DELETE /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:16:20.632710 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0187dc8f-2551-4707-a7fd-d361f39465c4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:20.633476 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0187dc8f-2551-4707-a7fd-d361f39465c4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] [instance: 9ae69130-8857-4d30-a434-6d8ca54f5cce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:20.644150 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0187dc8f-2551-4707-a7fd-d361f39465c4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:20.644661 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0187dc8f-2551-4707-a7fd-d361f39465c4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:20.645108 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0187dc8f-2551-4707-a7fd-d361f39465c4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:20.646165 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0187dc8f-2551-4707-a7fd-d361f39465c4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:20.646746 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0187dc8f-2551-4707-a7fd-d361f39465c4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:20.647354 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0187dc8f-2551-4707-a7fd-d361f39465c4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:20.664136 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-0187dc8f-2551-4707-a7fd-d361f39465c4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] HTTP exception thrown: Instance 9ae69130-8857-4d30-a434-6d8ca54f5cce could not be found. Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0187dc8f-2551-4707-a7fd-d361f39465c4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Request method failure captured: Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce HTTP/1.1 Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTKAmly9e-P6_tAu62nwltFHIH6V4qGg3XOBuRmES2riu97c9sqoI1-q9WD1lwRlJKXzWW2SXROWz1XCi_ZW7duRQg6op4hkt4QBlcn1CBRyEPhs0Xi1ZAKZC2lAaALmqaqqgxlKQQC3k30GkVj1WFE-zoUa5LJWaTarkq2sZYpzvPg Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 5291f3c81016423cbc1164c82551f648 Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServerDiskConfigTestJSON-762059440 Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5291f3c81016423cbc1164c82551f648"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5291f3c81016423cbc1164c82551f648"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5291f3c81016423cbc1164c82551f648"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5291f3c81016423cbc1164c82551f648"}]}] Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServerDiskConfigTestJSON-762059440 Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 5291f3c81016423cbc1164c82551f648 Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-762059440 Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServerDiskConfigTestJSON-762059440-project Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 5744e7524e4c4d2c896ce178572ada0c Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServerDiskConfigTestJSON-762059440-project Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 9ae69130-8857-4d30-a434-6d8ca54f5cce could not be found. Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '9ae69130-8857-4d30-a434-6d8ca54f5cce'} Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ae69130-8857-4d30-a434-6d8ca54f5cce could not be found. Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ae69130-8857-4d30-a434-6d8ca54f5cce could not be found. Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:20.666259 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:20.673215 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:20.673215 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:16:20.673215 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:16:20.673215 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:16:20.673215 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:16:20.673215 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ae69130-8857-4d30-a434-6d8ca54f5cce could not be found. Oct 26 13:16:20.673215 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:20.673215 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0187dc8f-2551-4707-a7fd-d361f39465c4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] Returning 404 to user: Instance 9ae69130-8857-4d30-a434-6d8ca54f5cce could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:16:20.673215 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0187dc8f-2551-4707-a7fd-d361f39465c4 tempest-ServerDiskConfigTestJSON-762059440 tempest-ServerDiskConfigTestJSON-762059440-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce" status: 404 len: 111 microversion: 2.1 time: 0.043821 Oct 26 13:16:20.673215 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1655/3301] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:20 2022] GET /compute/v2.1/servers/9ae69130-8857-4d30-a434-6d8ca54f5cce => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:16:20.688964 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6b34e45e-ef2d-442e-8818-ef1ba77afa00 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:20.689647 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6b34e45e-ef2d-442e-8818-ef1ba77afa00 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 8718e439-6247-480e-9887-eab549630975] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:20.699408 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b34e45e-ef2d-442e-8818-ef1ba77afa00 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:20.700568 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b34e45e-ef2d-442e-8818-ef1ba77afa00 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:20.701360 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b34e45e-ef2d-442e-8818-ef1ba77afa00 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:20.702303 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b34e45e-ef2d-442e-8818-ef1ba77afa00 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:20.702945 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b34e45e-ef2d-442e-8818-ef1ba77afa00 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:20.703557 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b34e45e-ef2d-442e-8818-ef1ba77afa00 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:20.799868 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0b67feac-d24d-42ac-9c0d-537b917658ea tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/998ece2e-dd9c-454a-88e7-780bfda95e02" status: 202 len: 0 microversion: 2.1 time: 0.536357 Oct 26 13:16:20.801257 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1647/3302] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 26 13:16:20 2022] DELETE /compute/v2.1/os-security-groups/998ece2e-dd9c-454a-88e7-780bfda95e02 => generated 0 bytes in 540 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:16:20.811191 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-59892d92-3cf2-4634-8a13-0065ca5a0de2 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '.version_select at 0x7f6732fe70d0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:21.320364 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6b34e45e-ef2d-442e-8818-ef1ba77afa00 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:21.332856 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6b34e45e-ef2d-442e-8818-ef1ba77afa00 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975" status: 200 len: 1516 microversion: 2.1 time: 0.648040 Oct 26 13:16:21.335469 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1656/3303] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:20 2022] GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975 => generated 1516 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:16:21.346600 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-96cd9956-24fe-4888-921f-6a5beae8eee0 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:21.359483 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-96cd9956-24fe-4888-921f-6a5beae8eee0 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:21.377846 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96cd9956-24fe-4888-921f-6a5beae8eee0 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:21.379247 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96cd9956-24fe-4888-921f-6a5beae8eee0 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:21.379926 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96cd9956-24fe-4888-921f-6a5beae8eee0 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:21.381250 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96cd9956-24fe-4888-921f-6a5beae8eee0 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:21.382234 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96cd9956-24fe-4888-921f-6a5beae8eee0 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:21.383074 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96cd9956-24fe-4888-921f-6a5beae8eee0 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:21.428949 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-96cd9956-24fe-4888-921f-6a5beae8eee0 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.091994 Oct 26 13:16:21.430238 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1657/3304] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:16:21 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:16:21.572048 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c76d2f31-f5c1-4ac0-b367-83f8501f0d9f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:21.572663 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c76d2f31-f5c1-4ac0-b367-83f8501f0d9f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: d0b8440f-677e-428d-8566-29fe4624fce1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:21.587560 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c76d2f31-f5c1-4ac0-b367-83f8501f0d9f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:21.588069 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c76d2f31-f5c1-4ac0-b367-83f8501f0d9f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:21.589086 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c76d2f31-f5c1-4ac0-b367-83f8501f0d9f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:21.590212 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c76d2f31-f5c1-4ac0-b367-83f8501f0d9f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:21.595084 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c76d2f31-f5c1-4ac0-b367-83f8501f0d9f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:21.595545 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c76d2f31-f5c1-4ac0-b367-83f8501f0d9f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:22.046690 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-59892d92-3cf2-4634-8a13-0065ca5a0de2 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/48bf9323-610f-4e89-a245-5ed18e4fb78b" status: 202 len: 0 microversion: 2.1 time: 1.240935 Oct 26 13:16:22.048106 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1648/3305] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 26 13:16:20 2022] DELETE /compute/v2.1/os-security-groups/48bf9323-610f-4e89-a245-5ed18e4fb78b => generated 0 bytes in 1243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:16:22.060753 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6ac99604-b4f3-4c94-8acc-ebfcef62b9c8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1696130978", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6fd403f3-cdf4-4a71-b3b7-5fccfc8063f7"}], "security_groups": [{"name": "tempest-securitygroup--295458716"}], "key_name": "tempest-keypair-1420444742", "user_data": "}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:16:22.470230 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c76d2f31-f5c1-4ac0-b367-83f8501f0d9f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:22.490479 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c76d2f31-f5c1-4ac0-b367-83f8501f0d9f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1" status: 200 len: 1555 microversion: 2.1 time: 0.922283 Oct 26 13:16:22.491430 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1658/3306] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:21 2022] GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1 => generated 1555 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:22.511362 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-eb285587-89c0-401d-9f10-c772281278b3 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Action: 'create', calling method: .version_select at 0x7f6732dafc10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1527770651", "description": "tempest-description-1459384159"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:16:22.889761 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-6ac99604-b4f3-4c94-8acc-ebfcef62b9c8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] validate_networks() for [('6fd403f3-cdf4-4a71-b3b7-5fccfc8063f7', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:16:23.009130 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-eb285587-89c0-401d-9f10-c772281278b3 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.515937 Oct 26 13:16:23.010097 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1659/3307] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 26 13:16:22 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:16:23.015339 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c20608c5-ed46-4ef1-acf2-e8063f128b07 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:23.016149 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c20608c5-ed46-4ef1-acf2-e8063f128b07 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 8718e439-6247-480e-9887-eab549630975] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:23.034553 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c20608c5-ed46-4ef1-acf2-e8063f128b07 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:23.035303 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c20608c5-ed46-4ef1-acf2-e8063f128b07 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:23.036242 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c20608c5-ed46-4ef1-acf2-e8063f128b07 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:23.037557 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c20608c5-ed46-4ef1-acf2-e8063f128b07 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:23.038283 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c20608c5-ed46-4ef1-acf2-e8063f128b07 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:23.039070 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c20608c5-ed46-4ef1-acf2-e8063f128b07 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:23.282596 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c20608c5-ed46-4ef1-acf2-e8063f128b07 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:23.291148 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c20608c5-ed46-4ef1-acf2-e8063f128b07 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975" status: 200 len: 1516 microversion: 2.1 time: 0.279428 Oct 26 13:16:23.292312 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1660/3308] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:23 2022] GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975 => generated 1516 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:23.309351 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-678c8bfe-26a2-404a-b202-34adee779201 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Action: 'update', calling method: .version_select at 0x7f6732674280>, body: {"security_group": {"name": "tempest-sg-hth-1892872274", "description": "tempest-description-hth-1034779463"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:16:23.659538 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-678c8bfe-26a2-404a-b202-34adee779201 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "PUT /compute/v2.1/os-security-groups/aab91eb8-d9e5-44cd-a7f1-f461f589d9d0" status: 200 len: 218 microversion: 2.1 time: 0.362469 Oct 26 13:16:23.660278 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1661/3309] 10.222.0.40 () {60 vars in 1290 bytes} [Wed Oct 26 13:16:23 2022] PUT /compute/v2.1/os-security-groups/aab91eb8-d9e5-44cd-a7f1-f461f589d9d0 => generated 218 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:16:23.665778 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-47a6dca4-9881-4575-a5f3-a172992f2348 req-367adffa-a226-46e8-a044-11bc2fbd4e33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5fa9733-f49b-43ab-8586-68d113b73476", "tag": "dae3728e-b93b-4eed-a07b-aea0efaacfac"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:16:23.692670 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-47a6dca4-9881-4575-a5f3-a172992f2348 req-367adffa-a226-46e8-a044-11bc2fbd4e33 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:23.699481 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-47a6dca4-9881-4575-a5f3-a172992f2348 req-367adffa-a226-46e8-a044-11bc2fbd4e33 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:23.700538 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-47a6dca4-9881-4575-a5f3-a172992f2348 req-367adffa-a226-46e8-a044-11bc2fbd4e33 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:23.723823 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-47a6dca4-9881-4575-a5f3-a172992f2348 req-367adffa-a226-46e8-a044-11bc2fbd4e33 service nova] Creating event network-changed:dae3728e-b93b-4eed-a07b-aea0efaacfac for instance b5fa9733-f49b-43ab-8586-68d113b73476 on n-h1-862686-1 Oct 26 13:16:23.740278 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-47a6dca4-9881-4575-a5f3-a172992f2348 req-367adffa-a226-46e8-a044-11bc2fbd4e33 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078236 Oct 26 13:16:23.747026 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1662/3310] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:16:23.754976 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9b75d854-b77f-4cb1-b504-120e3dcb3a3d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:23.756408 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9b75d854-b77f-4cb1-b504-120e3dcb3a3d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: d0b8440f-677e-428d-8566-29fe4624fce1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:23.765004 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9b75d854-b77f-4cb1-b504-120e3dcb3a3d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:23.766177 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9b75d854-b77f-4cb1-b504-120e3dcb3a3d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:23.766877 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9b75d854-b77f-4cb1-b504-120e3dcb3a3d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:23.768138 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9b75d854-b77f-4cb1-b504-120e3dcb3a3d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:23.769669 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9b75d854-b77f-4cb1-b504-120e3dcb3a3d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:23.770322 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9b75d854-b77f-4cb1-b504-120e3dcb3a3d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:24.273066 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9b75d854-b77f-4cb1-b504-120e3dcb3a3d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:24.291248 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9b75d854-b77f-4cb1-b504-120e3dcb3a3d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1" status: 200 len: 1346 microversion: 2.1 time: 0.538331 Oct 26 13:16:24.292140 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1663/3311] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:23 2022] GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1 => generated 1346 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:24.327339 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3c9054eb-38a5-4369-bb7b-e6bac5e8b8d2 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '.version_select at 0x7f67327a7b80>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:24.598208 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3c9054eb-38a5-4369-bb7b-e6bac5e8b8d2 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups/aab91eb8-d9e5-44cd-a7f1-f461f589d9d0" status: 200 len: 218 microversion: 2.1 time: 0.282383 Oct 26 13:16:24.598959 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1664/3312] 10.222.0.40 () {58 vars in 1269 bytes} [Wed Oct 26 13:16:24 2022] GET /compute/v2.1/os-security-groups/aab91eb8-d9e5-44cd-a7f1-f461f589d9d0 => generated 218 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:16:24.605154 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e6f2cd6e-182a-4e81-ad4b-1ab88eb7b49c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:24.606579 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e6f2cd6e-182a-4e81-ad4b-1ab88eb7b49c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 8718e439-6247-480e-9887-eab549630975] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:24.623856 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e6f2cd6e-182a-4e81-ad4b-1ab88eb7b49c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:24.626157 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e6f2cd6e-182a-4e81-ad4b-1ab88eb7b49c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:24.626722 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e6f2cd6e-182a-4e81-ad4b-1ab88eb7b49c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:24.629472 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e6f2cd6e-182a-4e81-ad4b-1ab88eb7b49c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:24.630999 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e6f2cd6e-182a-4e81-ad4b-1ab88eb7b49c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:24.631550 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e6f2cd6e-182a-4e81-ad4b-1ab88eb7b49c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:24.722462 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e6f2cd6e-182a-4e81-ad4b-1ab88eb7b49c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:24.725957 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e6f2cd6e-182a-4e81-ad4b-1ab88eb7b49c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:24.727527 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e6f2cd6e-182a-4e81-ad4b-1ab88eb7b49c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:24.728686 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-e6f2cd6e-182a-4e81-ad4b-1ab88eb7b49c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lazy-loading 'fault' on Instance uuid 8718e439-6247-480e-9887-eab549630975 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:16:24.878691 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e6f2cd6e-182a-4e81-ad4b-1ab88eb7b49c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:24.889034 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e6f2cd6e-182a-4e81-ad4b-1ab88eb7b49c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975" status: 200 len: 1320 microversion: 2.1 time: 0.288418 Oct 26 13:16:24.901517 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1665/3313] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:24 2022] GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975 => generated 1320 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:24.901517 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-30938942-1089-4e20-81e1-0f04effb30af req-e615d157-b494-49f2-9734-8fad2226b2c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8718e439-6247-480e-9887-eab549630975", "name": "network-vif-deleted", "tag": "7e6108c5-cc9c-4df8-828e-0fdfced3896d"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:16:24.910213 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-30938942-1089-4e20-81e1-0f04effb30af req-e615d157-b494-49f2-9734-8fad2226b2c7 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:24.911592 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-30938942-1089-4e20-81e1-0f04effb30af req-e615d157-b494-49f2-9734-8fad2226b2c7 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:24.912685 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-30938942-1089-4e20-81e1-0f04effb30af req-e615d157-b494-49f2-9734-8fad2226b2c7 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:24.930221 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-30938942-1089-4e20-81e1-0f04effb30af req-e615d157-b494-49f2-9734-8fad2226b2c7 service nova] Creating event network-vif-deleted:7e6108c5-cc9c-4df8-828e-0fdfced3896d for instance 8718e439-6247-480e-9887-eab549630975 on n-h1-862686-1 Oct 26 13:16:24.939694 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-30938942-1089-4e20-81e1-0f04effb30af req-e615d157-b494-49f2-9734-8fad2226b2c7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044735 Oct 26 13:16:24.940496 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1666/3314] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:16:24.946971 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-13a863b0-1a11-4f06-82eb-ecb529a27448 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '.version_select at 0x7f67327a7b80>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:25.487085 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-13a863b0-1a11-4f06-82eb-ecb529a27448 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/aab91eb8-d9e5-44cd-a7f1-f461f589d9d0" status: 202 len: 0 microversion: 2.1 time: 0.544744 Oct 26 13:16:25.487679 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1667/3315] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 26 13:16:24 2022] DELETE /compute/v2.1/os-security-groups/aab91eb8-d9e5-44cd-a7f1-f461f589d9d0 => generated 0 bytes in 546 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:16:25.493875 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ad7fb1ef-6296-4adc-886b-070ace2d5513 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:25.495630 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ad7fb1ef-6296-4adc-886b-070ace2d5513 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: d0b8440f-677e-428d-8566-29fe4624fce1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:25.509878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-6ac99604-b4f3-4c94-8acc-ebfcef62b9c8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:16:25.510838 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-6ac99604-b4f3-4c94-8acc-ebfcef62b9c8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:16:25.511439 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-6ac99604-b4f3-4c94-8acc-ebfcef62b9c8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:16:25.512075 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-6ac99604-b4f3-4c94-8acc-ebfcef62b9c8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:16:25.512691 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-6ac99604-b4f3-4c94-8acc-ebfcef62b9c8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:16:25.521538 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad7fb1ef-6296-4adc-886b-070ace2d5513 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:25.522470 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad7fb1ef-6296-4adc-886b-070ace2d5513 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:25.523071 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad7fb1ef-6296-4adc-886b-070ace2d5513 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:25.524239 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad7fb1ef-6296-4adc-886b-070ace2d5513 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:25.524851 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad7fb1ef-6296-4adc-886b-070ace2d5513 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:25.529024 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad7fb1ef-6296-4adc-886b-070ace2d5513 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:25.537351 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ac99604-b4f3-4c94-8acc-ebfcef62b9c8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:25.542700 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ac99604-b4f3-4c94-8acc-ebfcef62b9c8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:25.545607 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ac99604-b4f3-4c94-8acc-ebfcef62b9c8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:25.552651 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ac99604-b4f3-4c94-8acc-ebfcef62b9c8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:25.554861 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ac99604-b4f3-4c94-8acc-ebfcef62b9c8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:25.555536 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ac99604-b4f3-4c94-8acc-ebfcef62b9c8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:25.617920 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-6ac99604-b4f3-4c94-8acc-ebfcef62b9c8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Getting quotas for project 174da5e5c60449b7a04e9cf2aa3b9fda. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:16:25.639239 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-6ac99604-b4f3-4c94-8acc-ebfcef62b9c8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Getting quotas for user 168c83cd1b014f82945f4915e3ece079 and project 174da5e5c60449b7a04e9cf2aa3b9fda. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:16:25.699086 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6ac99604-b4f3-4c94-8acc-ebfcef62b9c8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:16:25.702496 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6ac99604-b4f3-4c94-8acc-ebfcef62b9c8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 2c859d43-c102-4189-9e7a-6c88ff38f311] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:16:25.734700 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ad7fb1ef-6296-4adc-886b-070ace2d5513 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:25.765553 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ad7fb1ef-6296-4adc-886b-070ace2d5513 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1" status: 200 len: 1346 microversion: 2.1 time: 0.275950 Oct 26 13:16:25.767863 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1668/3316] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:25 2022] GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1 => generated 1346 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:25.774123 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0e37baed-7738-4983-8f9c-a548296ada26 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:25.774833 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0e37baed-7738-4983-8f9c-a548296ada26 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 6b3fe85a-699d-438b-b809-0539f2fd25b3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:25.784167 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0e37baed-7738-4983-8f9c-a548296ada26 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:25.785028 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0e37baed-7738-4983-8f9c-a548296ada26 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:25.785650 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0e37baed-7738-4983-8f9c-a548296ada26 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:25.787203 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0e37baed-7738-4983-8f9c-a548296ada26 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:25.788116 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0e37baed-7738-4983-8f9c-a548296ada26 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:25.788725 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0e37baed-7738-4983-8f9c-a548296ada26 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:25.803375 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6ac99604-b4f3-4c94-8acc-ebfcef62b9c8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.753957 Oct 26 13:16:25.804190 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1649/3317] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:16:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 3755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:16:25.809782 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-b98a4d51-3c52-4924-8067-dd71f45c2ca0 req-8a1cdbf4-9fc5-497c-862b-803bd991d4f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0b8440f-677e-428d-8566-29fe4624fce1", "name": "network-vif-deleted", "tag": "7a6e9c8d-c37d-469c-a839-6185fac0b35e"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:16:25.821878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b98a4d51-3c52-4924-8067-dd71f45c2ca0 req-8a1cdbf4-9fc5-497c-862b-803bd991d4f6 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:25.822606 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b98a4d51-3c52-4924-8067-dd71f45c2ca0 req-8a1cdbf4-9fc5-497c-862b-803bd991d4f6 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:25.824052 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b98a4d51-3c52-4924-8067-dd71f45c2ca0 req-8a1cdbf4-9fc5-497c-862b-803bd991d4f6 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:25.825028 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-0e37baed-7738-4983-8f9c-a548296ada26 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] HTTP exception thrown: Instance 6b3fe85a-699d-438b-b809-0539f2fd25b3 could not be found. Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0e37baed-7738-4983-8f9c-a548296ada26 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Request method failure captured: Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3 HTTP/1.1 Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTLZwemdkOoZmTGSmy6KZvPDtVHD2_E9ZUR49ovbPsQaFz77JmwG34xaymuHO8vYj9Nv7h8paBonBJqeJ-iGNHh66dW9zr2o-PVtLnq2ivVkvSk_ngG_K5FTR8-56OwV4JEOB5RsCmAZvvKkRYejOCKTdf6hjGlyGC2s57RFn_cJWHQ Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 875ebd1c99c746f7b4f1a3c08156e6a0 Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-SecurityGroupsTestJSON-256228496 Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/875ebd1c99c746f7b4f1a3c08156e6a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/875ebd1c99c746f7b4f1a3c08156e6a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_875ebd1c99c746f7b4f1a3c08156e6a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/875ebd1c99c746f7b4f1a3c08156e6a0"}]}] Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-SecurityGroupsTestJSON-256228496 Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 875ebd1c99c746f7b4f1a3c08156e6a0 Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-256228496 Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-SecurityGroupsTestJSON-256228496-project Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: a13285463ba34e89931d667bc327bb2a Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-SecurityGroupsTestJSON-256228496-project Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 6b3fe85a-699d-438b-b809-0539f2fd25b3 could not be found. Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '6b3fe85a-699d-438b-b809-0539f2fd25b3'} Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b3fe85a-699d-438b-b809-0539f2fd25b3 could not be found. Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:16:25.826793 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:16:25.830819 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b3fe85a-699d-438b-b809-0539f2fd25b3 could not be found. Oct 26 13:16:25.830819 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:25.830819 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:25.830819 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:25.830819 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:25.830819 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:16:25.830819 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:16:25.830819 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:16:25.830819 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:16:25.830819 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b3fe85a-699d-438b-b809-0539f2fd25b3 could not be found. Oct 26 13:16:25.830819 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:25.834183 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0e37baed-7738-4983-8f9c-a548296ada26 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Returning 404 to user: Instance 6b3fe85a-699d-438b-b809-0539f2fd25b3 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:16:25.835332 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0e37baed-7738-4983-8f9c-a548296ada26 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3" status: 404 len: 111 microversion: 2.1 time: 0.066254 Oct 26 13:16:25.840956 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1669/3318] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:16:25 2022] DELETE /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:16:25.844430 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-b98a4d51-3c52-4924-8067-dd71f45c2ca0 req-8a1cdbf4-9fc5-497c-862b-803bd991d4f6 service nova] Creating event network-vif-deleted:7a6e9c8d-c37d-469c-a839-6185fac0b35e for instance d0b8440f-677e-428d-8566-29fe4624fce1 on n-h1-862686-1 Oct 26 13:16:25.849697 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-b98a4d51-3c52-4924-8067-dd71f45c2ca0 req-8a1cdbf4-9fc5-497c-862b-803bd991d4f6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044044 Oct 26 13:16:25.852613 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a9e523d1-923a-4319-92a1-e2f48a232df8 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Action: 'create', calling method: .version_select at 0x7f6731b3ed30>, body: {"keypair": {"name": "tempest-keypair-459688330", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/HZq86BrPXEJDKXM0RjPs5ClERQabCiKrioFipSWO4ZmBaJQFGC6At6xdH4dvC2VCHN76ORMIZWOzx0br1Ztdkev5SxY5idPYvo6vAcIwtp9oFR+XTQOx//IrClBMlrA=="}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:16:25.858230 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1650/3319] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:16:25.863830 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6d5da054-f96a-4524-8eb5-5e03ce17e1a3 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:25.864874 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6d5da054-f96a-4524-8eb5-5e03ce17e1a3 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 2c859d43-c102-4189-9e7a-6c88ff38f311] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:25.965070 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-a9e523d1-923a-4319-92a1-e2f48a232df8 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Getting quotas for project 8020c4d2858a4c6cbd194758e958dad0. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:16:25.965460 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6d5da054-f96a-4524-8eb5-5e03ce17e1a3 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:25.978910 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-a9e523d1-923a-4319-92a1-e2f48a232df8 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Getting quotas for user 6097043a9a7d455bb4a8e2146a14dbdd and project 8020c4d2858a4c6cbd194758e958dad0. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:16:25.992641 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6d5da054-f96a-4524-8eb5-5e03ce17e1a3 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311" status: 200 len: 1242 microversion: 2.1 time: 0.132311 Oct 26 13:16:25.994663 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1651/3320] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:25 2022] GET /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311 => generated 1242 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:26.008587 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-33d312be-75e9-4385-b1f6-225667de815a tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:26.012798 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-33d312be-75e9-4385-b1f6-225667de815a tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 6b3fe85a-699d-438b-b809-0539f2fd25b3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:26.031612 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33d312be-75e9-4385-b1f6-225667de815a tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:26.032417 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33d312be-75e9-4385-b1f6-225667de815a tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:26.048025 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33d312be-75e9-4385-b1f6-225667de815a tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:26.049660 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33d312be-75e9-4385-b1f6-225667de815a tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:26.052856 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33d312be-75e9-4385-b1f6-225667de815a tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:26.054478 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33d312be-75e9-4385-b1f6-225667de815a tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:26.060139 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a9e523d1-923a-4319-92a1-e2f48a232df8 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.217375 Oct 26 13:16:26.066144 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1670/3321] 10.222.0.40 () {62 vars in 1200 bytes} [Wed Oct 26 13:16:25 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 224 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 26 13:16:26.075786 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a458871a-5a6d-4660-bfa3-c01c151a53f7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:26.079908 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a458871a-5a6d-4660-bfa3-c01c151a53f7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 8718e439-6247-480e-9887-eab549630975] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:26.090964 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a458871a-5a6d-4660-bfa3-c01c151a53f7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:26.091474 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a458871a-5a6d-4660-bfa3-c01c151a53f7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:26.091929 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a458871a-5a6d-4660-bfa3-c01c151a53f7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:26.092757 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a458871a-5a6d-4660-bfa3-c01c151a53f7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:26.093318 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a458871a-5a6d-4660-bfa3-c01c151a53f7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:26.093844 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a458871a-5a6d-4660-bfa3-c01c151a53f7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:26.108490 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-33d312be-75e9-4385-b1f6-225667de815a tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] HTTP exception thrown: Instance 6b3fe85a-699d-438b-b809-0539f2fd25b3 could not be found. Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-33d312be-75e9-4385-b1f6-225667de815a tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Request method failure captured: Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3 HTTP/1.1 Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTLZwemdkOoZmTGSmy6KZvPDtVHD2_E9ZUR49ovbPsQaFz77JmwG34xaymuHO8vYj9Nv7h8paBonBJqeJ-iGNHh66dW9zr2o-PVtLnq2ivVkvSk_ngG_K5FTR8-56OwV4JEOB5RsCmAZvvKkRYejOCKTdf6hjGlyGC2s57RFn_cJWHQ Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 875ebd1c99c746f7b4f1a3c08156e6a0 Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-SecurityGroupsTestJSON-256228496 Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/875ebd1c99c746f7b4f1a3c08156e6a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/875ebd1c99c746f7b4f1a3c08156e6a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_875ebd1c99c746f7b4f1a3c08156e6a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/875ebd1c99c746f7b4f1a3c08156e6a0"}]}] Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-SecurityGroupsTestJSON-256228496 Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 875ebd1c99c746f7b4f1a3c08156e6a0 Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-256228496 Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-SecurityGroupsTestJSON-256228496-project Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: a13285463ba34e89931d667bc327bb2a Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-SecurityGroupsTestJSON-256228496-project Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 6b3fe85a-699d-438b-b809-0539f2fd25b3 could not be found. Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '6b3fe85a-699d-438b-b809-0539f2fd25b3'} Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b3fe85a-699d-438b-b809-0539f2fd25b3 could not be found. Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b3fe85a-699d-438b-b809-0539f2fd25b3 could not be found. Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:26.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:26.121050 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:26.121050 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:16:26.121050 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:16:26.121050 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:16:26.121050 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:16:26.121050 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b3fe85a-699d-438b-b809-0539f2fd25b3 could not be found. Oct 26 13:16:26.121050 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:26.125384 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-33d312be-75e9-4385-b1f6-225667de815a tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Returning 404 to user: Instance 6b3fe85a-699d-438b-b809-0539f2fd25b3 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:16:26.131447 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-33d312be-75e9-4385-b1f6-225667de815a tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "GET /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3" status: 404 len: 111 microversion: 2.1 time: 0.130215 Oct 26 13:16:26.135745 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1652/3322] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:25 2022] GET /compute/v2.1/servers/6b3fe85a-699d-438b-b809-0539f2fd25b3 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:16:26.150905 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-a458871a-5a6d-4660-bfa3-c01c151a53f7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] HTTP exception thrown: Instance 8718e439-6247-480e-9887-eab549630975 could not be found. Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a458871a-5a6d-4660-bfa3-c01c151a53f7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Request method failure captured: Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975 HTTP/1.1 Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTJbgpOJ6_WXapLDSc4DXB2ybbuKvfF9irakf13MnXe_PUvQw0tvwC_KXpEDb02nWk9gKVB2DnChPFFUGp_xOUQaSFHL5E80bTALTu8ZJijTkAv_z2Y1Gdi1cyNAMKmLE7ZnzWq0oDflWXhf1sSJNtguU-rMZFkiGbBps0dj1yOxZiU Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 3f690a680b284d82ac586346427423c3 Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersTestJSON-1612525130 Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3f690a680b284d82ac586346427423c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f690a680b284d82ac586346427423c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3f690a680b284d82ac586346427423c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f690a680b284d82ac586346427423c3"}]}] Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersTestJSON-1612525130 Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 3f690a680b284d82ac586346427423c3 Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersTestJSON-1612525130 Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersTestJSON-1612525130-project Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: fbe30a73a18d49afa07f7a66aee7805d Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersTestJSON-1612525130-project Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 8718e439-6247-480e-9887-eab549630975 could not be found. Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '8718e439-6247-480e-9887-eab549630975'} Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8718e439-6247-480e-9887-eab549630975 could not be found. Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8718e439-6247-480e-9887-eab549630975 could not be found. Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:26.153303 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:26.158103 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:26.158103 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:16:26.158103 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:16:26.158103 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:16:26.158103 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:16:26.158103 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8718e439-6247-480e-9887-eab549630975 could not be found. Oct 26 13:16:26.158103 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:26.158103 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a458871a-5a6d-4660-bfa3-c01c151a53f7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Returning 404 to user: Instance 8718e439-6247-480e-9887-eab549630975 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:16:26.158103 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a458871a-5a6d-4660-bfa3-c01c151a53f7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975" status: 404 len: 111 microversion: 2.1 time: 0.086982 Oct 26 13:16:26.158103 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1671/3323] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:26 2022] GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:16:26.160726 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8d8ec050-9edd-442d-93b3-0c7ee5145890 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '.version_select at 0x7f67322895e0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:26.235561 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-90ff26e0-f369-47e0-ba38-51269cf3d90d tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1327951559", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "bc8855c0-63b2-4c3e-b1b8-950c3dd488ef"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:16:26.329464 n-d-862686-1 devstack@n-api.service[120598]: DEBUG neutronclient.v2_0.client [None req-8d8ec050-9edd-442d-93b3-0c7ee5145890 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 48bf9323-610f-4e89-a245-5ed18e4fb78b does not exist", "detail": ""}} {{(pid=120598) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 26 13:16:26.330077 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.security_group_api [None req-8d8ec050-9edd-442d-93b3-0c7ee5145890 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Neutron security group 48bf9323-610f-4e89-a245-5ed18e4fb78b not found {{(pid=120598) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 26 13:16:26.330596 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-8d8ec050-9edd-442d-93b3-0c7ee5145890 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] HTTP exception thrown: Security group 48bf9323-610f-4e89-a245-5ed18e4fb78b does not exist Oct 26 13:16:26.330596 n-d-862686-1 devstack@n-api.service[120598]: Neutron server returns request_ids: ['req-90f6a7db-e240-4c51-8ed1-10e3d9442485'] Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8d8ec050-9edd-442d-93b3-0c7ee5145890 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Request method failure captured: Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: request: DELETE /compute/v2.1/os-security-groups/48bf9323-610f-4e89-a245-5ed18e4fb78b HTTP/1.1 Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTLZwemdkOoZmTGSmy6KZvPDtVHD2_E9ZUR49ovbPsQaFz77JmwG34xaymuHO8vYj9Nv7h8paBonBJqeJ-iGNHh66dW9zr2o-PVtLnq2ivVkvSk_ngG_K5FTR8-56OwV4JEOB5RsCmAZvvKkRYejOCKTdf6hjGlyGC2s57RFn_cJWHQ Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 875ebd1c99c746f7b4f1a3c08156e6a0 Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-SecurityGroupsTestJSON-256228496 Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/875ebd1c99c746f7b4f1a3c08156e6a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/875ebd1c99c746f7b4f1a3c08156e6a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_875ebd1c99c746f7b4f1a3c08156e6a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/875ebd1c99c746f7b4f1a3c08156e6a0"}]}] Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-SecurityGroupsTestJSON-256228496 Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 875ebd1c99c746f7b4f1a3c08156e6a0 Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-256228496 Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-SecurityGroupsTestJSON-256228496-project Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: a13285463ba34e89931d667bc327bb2a Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-SecurityGroupsTestJSON-256228496-project Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: exception: Security group 48bf9323-610f-4e89-a245-5ed18e4fb78b does not exist Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: Neutron server returns request_ids: ['req-90f6a7db-e240-4c51-8ed1-10e3d9442485'] Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '48bf9323-610f-4e89-a245-5ed18e4fb78b'} Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 26 13:16:26.334659 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 48bf9323-610f-4e89-a245-5ed18e4fb78b does not exist Oct 26 13:16:26.341579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-90f6a7db-e240-4c51-8ed1-10e3d9442485'] Oct 26 13:16:26.341579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:26.341579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:26.341579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:26.341579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:26.341579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 26 13:16:26.341579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 26 13:16:26.341579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 26 13:16:26.341579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 26 13:16:26.341579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 48bf9323-610f-4e89-a245-5ed18e4fb78b does not exist Oct 26 13:16:26.341579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-90f6a7db-e240-4c51-8ed1-10e3d9442485'] Oct 26 13:16:26.341579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:26.341579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:26.341579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:26.341579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:26.341579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:16:26.341579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:16:26.341579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:16:26.341579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:16:26.341579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:16:26.341579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:16:26.341579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:16:26.341579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:16:26.341579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 26 13:16:26.341579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 26 13:16:26.341579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 48bf9323-610f-4e89-a245-5ed18e4fb78b does not exist Oct 26 13:16:26.341579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-90f6a7db-e240-4c51-8ed1-10e3d9442485'] Oct 26 13:16:26.341579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:26.341579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:26.341579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:26.341579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:26.341579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:16:26.341579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:16:26.341579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:16:26.341579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:16:26.341579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 48bf9323-610f-4e89-a245-5ed18e4fb78b does not exist Oct 26 13:16:26.341579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-90f6a7db-e240-4c51-8ed1-10e3d9442485'] Oct 26 13:16:26.341579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:26.341579 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8d8ec050-9edd-442d-93b3-0c7ee5145890 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Returning 404 to user: Security group 48bf9323-610f-4e89-a245-5ed18e4fb78b does not exist Oct 26 13:16:26.341579 n-d-862686-1 devstack@n-api.service[120598]: Neutron server returns request_ids: ['req-90f6a7db-e240-4c51-8ed1-10e3d9442485'] {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:16:26.341579 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8d8ec050-9edd-442d-93b3-0c7ee5145890 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/48bf9323-610f-4e89-a245-5ed18e4fb78b" status: 404 len: 194 microversion: 2.1 time: 0.199015 Oct 26 13:16:26.346624 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1653/3324] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 26 13:16:26 2022] DELETE /compute/v2.1/os-security-groups/48bf9323-610f-4e89-a245-5ed18e4fb78b => generated 194 bytes in 203 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:16:26.359246 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7ea78fd1-7bc2-4f62-bd6d-bac2e33c34fb tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '.version_select at 0x7f6732ba81f0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:26.370718 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-90ff26e0-f369-47e0-ba38-51269cf3d90d tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] validate_networks() for [('bc8855c0-63b2-4c3e-b1b8-950c3dd488ef', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:16:26.484178 n-d-862686-1 devstack@n-api.service[120598]: DEBUG neutronclient.v2_0.client [None req-7ea78fd1-7bc2-4f62-bd6d-bac2e33c34fb tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 998ece2e-dd9c-454a-88e7-780bfda95e02 does not exist", "detail": ""}} {{(pid=120598) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 26 13:16:26.489899 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.security_group_api [None req-7ea78fd1-7bc2-4f62-bd6d-bac2e33c34fb tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Neutron security group 998ece2e-dd9c-454a-88e7-780bfda95e02 not found {{(pid=120598) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 26 13:16:26.491208 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-7ea78fd1-7bc2-4f62-bd6d-bac2e33c34fb tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] HTTP exception thrown: Security group 998ece2e-dd9c-454a-88e7-780bfda95e02 does not exist Oct 26 13:16:26.491208 n-d-862686-1 devstack@n-api.service[120598]: Neutron server returns request_ids: ['req-b15a2f6b-03cc-49c3-998e-0925d2f77513'] Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7ea78fd1-7bc2-4f62-bd6d-bac2e33c34fb tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Request method failure captured: Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: request: DELETE /compute/v2.1/os-security-groups/998ece2e-dd9c-454a-88e7-780bfda95e02 HTTP/1.1 Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTLZwemdkOoZmTGSmy6KZvPDtVHD2_E9ZUR49ovbPsQaFz77JmwG34xaymuHO8vYj9Nv7h8paBonBJqeJ-iGNHh66dW9zr2o-PVtLnq2ivVkvSk_ngG_K5FTR8-56OwV4JEOB5RsCmAZvvKkRYejOCKTdf6hjGlyGC2s57RFn_cJWHQ Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 875ebd1c99c746f7b4f1a3c08156e6a0 Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-SecurityGroupsTestJSON-256228496 Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/875ebd1c99c746f7b4f1a3c08156e6a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/875ebd1c99c746f7b4f1a3c08156e6a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_875ebd1c99c746f7b4f1a3c08156e6a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/875ebd1c99c746f7b4f1a3c08156e6a0"}]}] Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-SecurityGroupsTestJSON-256228496 Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 875ebd1c99c746f7b4f1a3c08156e6a0 Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-256228496 Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-SecurityGroupsTestJSON-256228496-project Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: a13285463ba34e89931d667bc327bb2a Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-SecurityGroupsTestJSON-256228496-project Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: exception: Security group 998ece2e-dd9c-454a-88e7-780bfda95e02 does not exist Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: Neutron server returns request_ids: ['req-b15a2f6b-03cc-49c3-998e-0925d2f77513'] Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '998ece2e-dd9c-454a-88e7-780bfda95e02'} Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 26 13:16:26.495725 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 998ece2e-dd9c-454a-88e7-780bfda95e02 does not exist Oct 26 13:16:26.500128 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b15a2f6b-03cc-49c3-998e-0925d2f77513'] Oct 26 13:16:26.500128 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:26.500128 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:26.500128 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:26.500128 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:26.500128 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 26 13:16:26.500128 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 26 13:16:26.500128 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 26 13:16:26.500128 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 26 13:16:26.500128 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 998ece2e-dd9c-454a-88e7-780bfda95e02 does not exist Oct 26 13:16:26.500128 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b15a2f6b-03cc-49c3-998e-0925d2f77513'] Oct 26 13:16:26.500128 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:26.500128 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:26.500128 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:26.500128 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:26.500128 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:16:26.500128 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:16:26.500128 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:16:26.500128 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:16:26.500128 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:16:26.500128 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:16:26.500128 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:16:26.500128 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:16:26.500128 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 26 13:16:26.500128 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 26 13:16:26.500128 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 998ece2e-dd9c-454a-88e7-780bfda95e02 does not exist Oct 26 13:16:26.500128 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b15a2f6b-03cc-49c3-998e-0925d2f77513'] Oct 26 13:16:26.500128 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:26.500128 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:26.500128 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:26.500128 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:26.500128 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:16:26.500128 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:16:26.500128 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:16:26.500128 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:16:26.500128 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 998ece2e-dd9c-454a-88e7-780bfda95e02 does not exist Oct 26 13:16:26.500128 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b15a2f6b-03cc-49c3-998e-0925d2f77513'] Oct 26 13:16:26.500128 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:26.508558 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7ea78fd1-7bc2-4f62-bd6d-bac2e33c34fb tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Returning 404 to user: Security group 998ece2e-dd9c-454a-88e7-780bfda95e02 does not exist Oct 26 13:16:26.508558 n-d-862686-1 devstack@n-api.service[120598]: Neutron server returns request_ids: ['req-b15a2f6b-03cc-49c3-998e-0925d2f77513'] {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:16:26.511184 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7ea78fd1-7bc2-4f62-bd6d-bac2e33c34fb tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/998ece2e-dd9c-454a-88e7-780bfda95e02" status: 404 len: 194 microversion: 2.1 time: 0.161569 Oct 26 13:16:26.512764 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1654/3325] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 26 13:16:26 2022] DELETE /compute/v2.1/os-security-groups/998ece2e-dd9c-454a-88e7-780bfda95e02 => generated 194 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:16:26.523591 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f8474cab-e8cf-4c00-88e7-9c3c186b2660 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '.version_select at 0x7f67325c58b0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:26.598508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG neutronclient.v2_0.client [None req-f8474cab-e8cf-4c00-88e7-9c3c186b2660 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1e83a99e-78d2-40bf-b4c9-44063ff6e8fa does not exist", "detail": ""}} {{(pid=120598) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 26 13:16:26.599157 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.security_group_api [None req-f8474cab-e8cf-4c00-88e7-9c3c186b2660 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Neutron security group 1e83a99e-78d2-40bf-b4c9-44063ff6e8fa not found {{(pid=120598) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 26 13:16:26.599726 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-f8474cab-e8cf-4c00-88e7-9c3c186b2660 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] HTTP exception thrown: Security group 1e83a99e-78d2-40bf-b4c9-44063ff6e8fa does not exist Oct 26 13:16:26.599726 n-d-862686-1 devstack@n-api.service[120598]: Neutron server returns request_ids: ['req-6c78471c-8f65-401a-bd83-0a1c908be1e0'] Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f8474cab-e8cf-4c00-88e7-9c3c186b2660 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Request method failure captured: Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: request: DELETE /compute/v2.1/os-security-groups/1e83a99e-78d2-40bf-b4c9-44063ff6e8fa HTTP/1.1 Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTLZwemdkOoZmTGSmy6KZvPDtVHD2_E9ZUR49ovbPsQaFz77JmwG34xaymuHO8vYj9Nv7h8paBonBJqeJ-iGNHh66dW9zr2o-PVtLnq2ivVkvSk_ngG_K5FTR8-56OwV4JEOB5RsCmAZvvKkRYejOCKTdf6hjGlyGC2s57RFn_cJWHQ Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 875ebd1c99c746f7b4f1a3c08156e6a0 Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-SecurityGroupsTestJSON-256228496 Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/875ebd1c99c746f7b4f1a3c08156e6a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/875ebd1c99c746f7b4f1a3c08156e6a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_875ebd1c99c746f7b4f1a3c08156e6a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/875ebd1c99c746f7b4f1a3c08156e6a0"}]}] Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-SecurityGroupsTestJSON-256228496 Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 875ebd1c99c746f7b4f1a3c08156e6a0 Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-256228496 Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-SecurityGroupsTestJSON-256228496-project Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: a13285463ba34e89931d667bc327bb2a Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-SecurityGroupsTestJSON-256228496-project Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: exception: Security group 1e83a99e-78d2-40bf-b4c9-44063ff6e8fa does not exist Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: Neutron server returns request_ids: ['req-6c78471c-8f65-401a-bd83-0a1c908be1e0'] Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '1e83a99e-78d2-40bf-b4c9-44063ff6e8fa'} Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 26 13:16:26.602098 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1e83a99e-78d2-40bf-b4c9-44063ff6e8fa does not exist Oct 26 13:16:26.607919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c78471c-8f65-401a-bd83-0a1c908be1e0'] Oct 26 13:16:26.607919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:26.607919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:26.607919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:26.607919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:26.607919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 26 13:16:26.607919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 26 13:16:26.607919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 26 13:16:26.607919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 26 13:16:26.607919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1e83a99e-78d2-40bf-b4c9-44063ff6e8fa does not exist Oct 26 13:16:26.607919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c78471c-8f65-401a-bd83-0a1c908be1e0'] Oct 26 13:16:26.607919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:26.607919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:26.607919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:26.607919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:26.607919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:16:26.607919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:16:26.607919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:16:26.607919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:16:26.607919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:16:26.607919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:16:26.607919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:16:26.607919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:16:26.607919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 26 13:16:26.607919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 26 13:16:26.607919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1e83a99e-78d2-40bf-b4c9-44063ff6e8fa does not exist Oct 26 13:16:26.607919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c78471c-8f65-401a-bd83-0a1c908be1e0'] Oct 26 13:16:26.607919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:26.607919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:26.607919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:26.607919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:26.607919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:16:26.607919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:16:26.607919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:16:26.607919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:16:26.607919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1e83a99e-78d2-40bf-b4c9-44063ff6e8fa does not exist Oct 26 13:16:26.607919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c78471c-8f65-401a-bd83-0a1c908be1e0'] Oct 26 13:16:26.607919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:26.614752 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f8474cab-e8cf-4c00-88e7-9c3c186b2660 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Returning 404 to user: Security group 1e83a99e-78d2-40bf-b4c9-44063ff6e8fa does not exist Oct 26 13:16:26.614752 n-d-862686-1 devstack@n-api.service[120598]: Neutron server returns request_ids: ['req-6c78471c-8f65-401a-bd83-0a1c908be1e0'] {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:16:26.616031 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f8474cab-e8cf-4c00-88e7-9c3c186b2660 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/1e83a99e-78d2-40bf-b4c9-44063ff6e8fa" status: 404 len: 194 microversion: 2.1 time: 0.099051 Oct 26 13:16:26.617239 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1655/3326] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 26 13:16:26 2022] DELETE /compute/v2.1/os-security-groups/1e83a99e-78d2-40bf-b4c9-44063ff6e8fa => generated 194 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 13:16:26.634278 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3bea7d0b-c607-447b-acb0-9ad765645ec5 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '.version_select at 0x7f6732e3b700>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:26.685786 n-d-862686-1 devstack@n-api.service[120598]: DEBUG neutronclient.v2_0.client [None req-3bea7d0b-c607-447b-acb0-9ad765645ec5 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group fe5c0a02-8552-47ff-9db7-f09c2aa42c10 does not exist", "detail": ""}} {{(pid=120598) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 26 13:16:26.687865 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.security_group_api [None req-3bea7d0b-c607-447b-acb0-9ad765645ec5 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Neutron security group fe5c0a02-8552-47ff-9db7-f09c2aa42c10 not found {{(pid=120598) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 26 13:16:26.688565 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-3bea7d0b-c607-447b-acb0-9ad765645ec5 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] HTTP exception thrown: Security group fe5c0a02-8552-47ff-9db7-f09c2aa42c10 does not exist Oct 26 13:16:26.688565 n-d-862686-1 devstack@n-api.service[120598]: Neutron server returns request_ids: ['req-86a37941-a09c-464d-a9b3-b78b6eb05b69'] Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3bea7d0b-c607-447b-acb0-9ad765645ec5 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Request method failure captured: Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: request: DELETE /compute/v2.1/os-security-groups/fe5c0a02-8552-47ff-9db7-f09c2aa42c10 HTTP/1.1 Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTLZwemdkOoZmTGSmy6KZvPDtVHD2_E9ZUR49ovbPsQaFz77JmwG34xaymuHO8vYj9Nv7h8paBonBJqeJ-iGNHh66dW9zr2o-PVtLnq2ivVkvSk_ngG_K5FTR8-56OwV4JEOB5RsCmAZvvKkRYejOCKTdf6hjGlyGC2s57RFn_cJWHQ Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 875ebd1c99c746f7b4f1a3c08156e6a0 Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-SecurityGroupsTestJSON-256228496 Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/875ebd1c99c746f7b4f1a3c08156e6a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/875ebd1c99c746f7b4f1a3c08156e6a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_875ebd1c99c746f7b4f1a3c08156e6a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/875ebd1c99c746f7b4f1a3c08156e6a0"}]}] Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-SecurityGroupsTestJSON-256228496 Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 875ebd1c99c746f7b4f1a3c08156e6a0 Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-256228496 Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-SecurityGroupsTestJSON-256228496-project Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: a13285463ba34e89931d667bc327bb2a Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-SecurityGroupsTestJSON-256228496-project Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: exception: Security group fe5c0a02-8552-47ff-9db7-f09c2aa42c10 does not exist Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: Neutron server returns request_ids: ['req-86a37941-a09c-464d-a9b3-b78b6eb05b69'] Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'fe5c0a02-8552-47ff-9db7-f09c2aa42c10'} Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 26 13:16:26.691064 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group fe5c0a02-8552-47ff-9db7-f09c2aa42c10 does not exist Oct 26 13:16:26.695707 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-86a37941-a09c-464d-a9b3-b78b6eb05b69'] Oct 26 13:16:26.695707 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:26.695707 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:26.695707 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:26.695707 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:26.695707 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 26 13:16:26.695707 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 26 13:16:26.695707 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 26 13:16:26.695707 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 26 13:16:26.695707 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group fe5c0a02-8552-47ff-9db7-f09c2aa42c10 does not exist Oct 26 13:16:26.695707 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-86a37941-a09c-464d-a9b3-b78b6eb05b69'] Oct 26 13:16:26.695707 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:26.695707 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:26.695707 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:26.695707 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:26.695707 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:16:26.695707 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:16:26.695707 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:16:26.695707 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:16:26.695707 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:16:26.695707 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:16:26.695707 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:16:26.695707 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:16:26.695707 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 26 13:16:26.695707 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 26 13:16:26.695707 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group fe5c0a02-8552-47ff-9db7-f09c2aa42c10 does not exist Oct 26 13:16:26.695707 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-86a37941-a09c-464d-a9b3-b78b6eb05b69'] Oct 26 13:16:26.695707 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:26.695707 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:26.695707 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:26.695707 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:26.695707 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:16:26.695707 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:16:26.695707 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:16:26.695707 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:16:26.695707 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group fe5c0a02-8552-47ff-9db7-f09c2aa42c10 does not exist Oct 26 13:16:26.695707 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-86a37941-a09c-464d-a9b3-b78b6eb05b69'] Oct 26 13:16:26.695707 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:26.700470 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3bea7d0b-c607-447b-acb0-9ad765645ec5 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Returning 404 to user: Security group fe5c0a02-8552-47ff-9db7-f09c2aa42c10 does not exist Oct 26 13:16:26.700470 n-d-862686-1 devstack@n-api.service[120598]: Neutron server returns request_ids: ['req-86a37941-a09c-464d-a9b3-b78b6eb05b69'] {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:16:26.702920 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3bea7d0b-c607-447b-acb0-9ad765645ec5 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/fe5c0a02-8552-47ff-9db7-f09c2aa42c10" status: 404 len: 194 microversion: 2.1 time: 0.078764 Oct 26 13:16:26.704041 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1656/3327] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 26 13:16:26 2022] DELETE /compute/v2.1/os-security-groups/fe5c0a02-8552-47ff-9db7-f09c2aa42c10 => generated 194 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:16:26.735750 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3e2f9c5e-64c3-4b3e-82b3-2033231d43a2 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '.version_select at 0x7f673266b1f0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:26.916408 n-d-862686-1 devstack@n-api.service[120598]: DEBUG neutronclient.v2_0.client [None req-3e2f9c5e-64c3-4b3e-82b3-2033231d43a2 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9089c470-5a1d-4576-bb55-2c2818b7fff7 does not exist", "detail": ""}} {{(pid=120598) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 26 13:16:26.917098 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.security_group_api [None req-3e2f9c5e-64c3-4b3e-82b3-2033231d43a2 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Neutron security group 9089c470-5a1d-4576-bb55-2c2818b7fff7 not found {{(pid=120598) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 26 13:16:26.917709 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-3e2f9c5e-64c3-4b3e-82b3-2033231d43a2 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] HTTP exception thrown: Security group 9089c470-5a1d-4576-bb55-2c2818b7fff7 does not exist Oct 26 13:16:26.917709 n-d-862686-1 devstack@n-api.service[120598]: Neutron server returns request_ids: ['req-c79da6b8-927a-41d3-931b-d19482c73080'] Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3e2f9c5e-64c3-4b3e-82b3-2033231d43a2 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Request method failure captured: Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: request: DELETE /compute/v2.1/os-security-groups/9089c470-5a1d-4576-bb55-2c2818b7fff7 HTTP/1.1 Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTLZwemdkOoZmTGSmy6KZvPDtVHD2_E9ZUR49ovbPsQaFz77JmwG34xaymuHO8vYj9Nv7h8paBonBJqeJ-iGNHh66dW9zr2o-PVtLnq2ivVkvSk_ngG_K5FTR8-56OwV4JEOB5RsCmAZvvKkRYejOCKTdf6hjGlyGC2s57RFn_cJWHQ Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 875ebd1c99c746f7b4f1a3c08156e6a0 Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-SecurityGroupsTestJSON-256228496 Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/875ebd1c99c746f7b4f1a3c08156e6a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/875ebd1c99c746f7b4f1a3c08156e6a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_875ebd1c99c746f7b4f1a3c08156e6a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/875ebd1c99c746f7b4f1a3c08156e6a0"}]}] Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-SecurityGroupsTestJSON-256228496 Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 875ebd1c99c746f7b4f1a3c08156e6a0 Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-256228496 Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-SecurityGroupsTestJSON-256228496-project Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: a13285463ba34e89931d667bc327bb2a Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-SecurityGroupsTestJSON-256228496-project Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: exception: Security group 9089c470-5a1d-4576-bb55-2c2818b7fff7 does not exist Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: Neutron server returns request_ids: ['req-c79da6b8-927a-41d3-931b-d19482c73080'] Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '9089c470-5a1d-4576-bb55-2c2818b7fff7'} Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 26 13:16:26.919528 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9089c470-5a1d-4576-bb55-2c2818b7fff7 does not exist Oct 26 13:16:26.924025 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c79da6b8-927a-41d3-931b-d19482c73080'] Oct 26 13:16:26.924025 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:26.924025 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:26.924025 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:26.924025 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:26.924025 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 26 13:16:26.924025 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 26 13:16:26.924025 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 26 13:16:26.924025 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 26 13:16:26.924025 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9089c470-5a1d-4576-bb55-2c2818b7fff7 does not exist Oct 26 13:16:26.924025 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c79da6b8-927a-41d3-931b-d19482c73080'] Oct 26 13:16:26.924025 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:26.924025 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:26.924025 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:26.924025 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:26.924025 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:16:26.924025 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:16:26.924025 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:16:26.924025 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:16:26.924025 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:16:26.924025 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:16:26.924025 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:16:26.924025 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:16:26.924025 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 26 13:16:26.924025 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 26 13:16:26.924025 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9089c470-5a1d-4576-bb55-2c2818b7fff7 does not exist Oct 26 13:16:26.924025 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c79da6b8-927a-41d3-931b-d19482c73080'] Oct 26 13:16:26.924025 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:26.924025 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:26.924025 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:26.924025 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:26.924025 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:16:26.924025 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:16:26.924025 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:16:26.924025 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:16:26.924025 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9089c470-5a1d-4576-bb55-2c2818b7fff7 does not exist Oct 26 13:16:26.924025 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c79da6b8-927a-41d3-931b-d19482c73080'] Oct 26 13:16:26.924025 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:26.924025 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3e2f9c5e-64c3-4b3e-82b3-2033231d43a2 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Returning 404 to user: Security group 9089c470-5a1d-4576-bb55-2c2818b7fff7 does not exist Oct 26 13:16:26.924025 n-d-862686-1 devstack@n-api.service[120598]: Neutron server returns request_ids: ['req-c79da6b8-927a-41d3-931b-d19482c73080'] {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:16:26.924025 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3e2f9c5e-64c3-4b3e-82b3-2033231d43a2 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/9089c470-5a1d-4576-bb55-2c2818b7fff7" status: 404 len: 194 microversion: 2.1 time: 0.209405 Oct 26 13:16:26.924025 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1657/3328] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 26 13:16:26 2022] DELETE /compute/v2.1/os-security-groups/9089c470-5a1d-4576-bb55-2c2818b7fff7 => generated 194 bytes in 211 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:16:26.929095 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e9fa549e-239e-433a-b40f-26844f1b7f27 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:26.929515 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e9fa549e-239e-433a-b40f-26844f1b7f27 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: d0b8440f-677e-428d-8566-29fe4624fce1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:26.947525 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e9fa549e-239e-433a-b40f-26844f1b7f27 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:26.948550 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e9fa549e-239e-433a-b40f-26844f1b7f27 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:26.948996 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e9fa549e-239e-433a-b40f-26844f1b7f27 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:26.952514 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e9fa549e-239e-433a-b40f-26844f1b7f27 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:26.953164 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e9fa549e-239e-433a-b40f-26844f1b7f27 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:26.953497 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e9fa549e-239e-433a-b40f-26844f1b7f27 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:27.075792 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-90ff26e0-f369-47e0-ba38-51269cf3d90d tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:16:27.076362 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-90ff26e0-f369-47e0-ba38-51269cf3d90d tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:16:27.076687 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-90ff26e0-f369-47e0-ba38-51269cf3d90d tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:16:27.077103 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-90ff26e0-f369-47e0-ba38-51269cf3d90d tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:16:27.077565 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-90ff26e0-f369-47e0-ba38-51269cf3d90d tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:16:27.087944 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90ff26e0-f369-47e0-ba38-51269cf3d90d tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:27.089028 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90ff26e0-f369-47e0-ba38-51269cf3d90d tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:27.089685 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90ff26e0-f369-47e0-ba38-51269cf3d90d tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:27.090615 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90ff26e0-f369-47e0-ba38-51269cf3d90d tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:27.091256 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90ff26e0-f369-47e0-ba38-51269cf3d90d tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:27.091862 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90ff26e0-f369-47e0-ba38-51269cf3d90d tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:27.114845 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-90ff26e0-f369-47e0-ba38-51269cf3d90d tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Getting quotas for project 3f690a680b284d82ac586346427423c3. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:16:27.121760 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-90ff26e0-f369-47e0-ba38-51269cf3d90d tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Getting quotas for user fbe30a73a18d49afa07f7a66aee7805d and project 3f690a680b284d82ac586346427423c3. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:16:27.150749 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-90ff26e0-f369-47e0-ba38-51269cf3d90d tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:16:27.153400 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-90ff26e0-f369-47e0-ba38-51269cf3d90d tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:16:27.218020 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-90ff26e0-f369-47e0-ba38-51269cf3d90d tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.990714 Oct 26 13:16:27.219260 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1672/3329] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:16:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 993 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 26 13:16:27.226767 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0d98adf9-2bb1-4b10-85d1-c7737637fed6 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '.version_select at 0x7f67325183a0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:27.276451 n-d-862686-1 devstack@n-api.service[120597]: DEBUG neutronclient.v2_0.client [None req-0d98adf9-2bb1-4b10-85d1-c7737637fed6 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5bf34b61-c952-454a-aed6-16b6535b4606 does not exist", "detail": ""}} {{(pid=120597) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 26 13:16:27.277063 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.security_group_api [None req-0d98adf9-2bb1-4b10-85d1-c7737637fed6 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Neutron security group 5bf34b61-c952-454a-aed6-16b6535b4606 not found {{(pid=120597) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 26 13:16:27.277623 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-0d98adf9-2bb1-4b10-85d1-c7737637fed6 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] HTTP exception thrown: Security group 5bf34b61-c952-454a-aed6-16b6535b4606 does not exist Oct 26 13:16:27.277623 n-d-862686-1 devstack@n-api.service[120597]: Neutron server returns request_ids: ['req-407a4593-c2bc-4052-8cfe-8f65979af7a2'] Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0d98adf9-2bb1-4b10-85d1-c7737637fed6 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Request method failure captured: Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/os-security-groups/5bf34b61-c952-454a-aed6-16b6535b4606 HTTP/1.1 Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTLZwemdkOoZmTGSmy6KZvPDtVHD2_E9ZUR49ovbPsQaFz77JmwG34xaymuHO8vYj9Nv7h8paBonBJqeJ-iGNHh66dW9zr2o-PVtLnq2ivVkvSk_ngG_K5FTR8-56OwV4JEOB5RsCmAZvvKkRYejOCKTdf6hjGlyGC2s57RFn_cJWHQ Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 875ebd1c99c746f7b4f1a3c08156e6a0 Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-SecurityGroupsTestJSON-256228496 Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/875ebd1c99c746f7b4f1a3c08156e6a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/875ebd1c99c746f7b4f1a3c08156e6a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_875ebd1c99c746f7b4f1a3c08156e6a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/875ebd1c99c746f7b4f1a3c08156e6a0"}]}] Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-SecurityGroupsTestJSON-256228496 Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 875ebd1c99c746f7b4f1a3c08156e6a0 Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-256228496 Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-SecurityGroupsTestJSON-256228496-project Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: a13285463ba34e89931d667bc327bb2a Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-SecurityGroupsTestJSON-256228496-project Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: method: Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: exception: Security group 5bf34b61-c952-454a-aed6-16b6535b4606 does not exist Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: Neutron server returns request_ids: ['req-407a4593-c2bc-4052-8cfe-8f65979af7a2'] Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '5bf34b61-c952-454a-aed6-16b6535b4606'} Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 26 13:16:27.279481 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5bf34b61-c952-454a-aed6-16b6535b4606 does not exist Oct 26 13:16:27.284170 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-407a4593-c2bc-4052-8cfe-8f65979af7a2'] Oct 26 13:16:27.284170 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:27.284170 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:27.284170 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:27.284170 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:27.284170 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 26 13:16:27.284170 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 26 13:16:27.284170 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 26 13:16:27.284170 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 26 13:16:27.284170 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5bf34b61-c952-454a-aed6-16b6535b4606 does not exist Oct 26 13:16:27.284170 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-407a4593-c2bc-4052-8cfe-8f65979af7a2'] Oct 26 13:16:27.284170 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:27.284170 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:27.284170 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:27.284170 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:27.284170 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:16:27.284170 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:16:27.284170 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:16:27.284170 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:16:27.284170 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:16:27.284170 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:16:27.284170 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:16:27.284170 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:16:27.284170 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 26 13:16:27.284170 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 26 13:16:27.284170 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5bf34b61-c952-454a-aed6-16b6535b4606 does not exist Oct 26 13:16:27.284170 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-407a4593-c2bc-4052-8cfe-8f65979af7a2'] Oct 26 13:16:27.284170 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:27.284170 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:27.284170 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:27.284170 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:27.284170 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:16:27.284170 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:16:27.284170 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:16:27.284170 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:16:27.284170 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5bf34b61-c952-454a-aed6-16b6535b4606 does not exist Oct 26 13:16:27.284170 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-407a4593-c2bc-4052-8cfe-8f65979af7a2'] Oct 26 13:16:27.284170 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:16:27.284170 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0d98adf9-2bb1-4b10-85d1-c7737637fed6 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Returning 404 to user: Security group 5bf34b61-c952-454a-aed6-16b6535b4606 does not exist Oct 26 13:16:27.284170 n-d-862686-1 devstack@n-api.service[120597]: Neutron server returns request_ids: ['req-407a4593-c2bc-4052-8cfe-8f65979af7a2'] {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:16:27.284170 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0d98adf9-2bb1-4b10-85d1-c7737637fed6 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/5bf34b61-c952-454a-aed6-16b6535b4606" status: 404 len: 194 microversion: 2.1 time: 0.060520 Oct 26 13:16:27.287218 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1673/3330] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 26 13:16:27 2022] DELETE /compute/v2.1/os-security-groups/5bf34b61-c952-454a-aed6-16b6535b4606 => generated 194 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:16:27.294729 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-561f7616-cab3-4da1-87f4-062dcb232e9d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:27.295364 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-561f7616-cab3-4da1-87f4-062dcb232e9d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 2c859d43-c102-4189-9e7a-6c88ff38f311] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:27.315945 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-561f7616-cab3-4da1-87f4-062dcb232e9d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:27.316457 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-561f7616-cab3-4da1-87f4-062dcb232e9d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:27.319740 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-561f7616-cab3-4da1-87f4-062dcb232e9d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:27.320510 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-561f7616-cab3-4da1-87f4-062dcb232e9d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:27.320989 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-561f7616-cab3-4da1-87f4-062dcb232e9d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:27.321430 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-561f7616-cab3-4da1-87f4-062dcb232e9d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:27.362368 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:16:27.524751 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-561f7616-cab3-4da1-87f4-062dcb232e9d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:27.541153 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-561f7616-cab3-4da1-87f4-062dcb232e9d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311" status: 200 len: 1294 microversion: 2.1 time: 0.255366 Oct 26 13:16:27.545032 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1674/3331] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:27 2022] GET /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311 => generated 1294 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:27.550070 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-29597c39-4a2f-4839-b94c-aef19ae90b0e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:27.554619 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-29597c39-4a2f-4839-b94c-aef19ae90b0e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:27.574146 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:16:27.688245 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-29597c39-4a2f-4839-b94c-aef19ae90b0e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:27.698828 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-29597c39-4a2f-4839-b94c-aef19ae90b0e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8" status: 200 len: 1209 microversion: 2.1 time: 0.150359 Oct 26 13:16:27.701514 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1675/3332] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:27 2022] GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 => generated 1209 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:27.707575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f7eba953-747f-4333-a04d-1f2d3ec394a6 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:27.708269 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f7eba953-747f-4333-a04d-1f2d3ec394a6 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 7ee2d61f-352e-4762-aeec-9c2571e7e054] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:27.728544 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f7eba953-747f-4333-a04d-1f2d3ec394a6 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:27.729142 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f7eba953-747f-4333-a04d-1f2d3ec394a6 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:27.736556 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f7eba953-747f-4333-a04d-1f2d3ec394a6 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:27.737759 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f7eba953-747f-4333-a04d-1f2d3ec394a6 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:27.738412 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f7eba953-747f-4333-a04d-1f2d3ec394a6 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:27.739156 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f7eba953-747f-4333-a04d-1f2d3ec394a6 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:27.809135 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f7eba953-747f-4333-a04d-1f2d3ec394a6 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 7ee2d61f-352e-4762-aeec-9c2571e7e054] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:16:28.029419 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f7eba953-747f-4333-a04d-1f2d3ec394a6 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7ee2d61f-352e-4762-aeec-9c2571e7e054" status: 204 len: 0 microversion: 2.1 time: 0.326376 Oct 26 13:16:28.033787 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1676/3333] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:16:27 2022] DELETE /compute/v2.1/servers/7ee2d61f-352e-4762-aeec-9c2571e7e054 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:16:28.054636 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4d04a4c9-a680-4770-beae-4d059cda6002 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:28.056858 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4d04a4c9-a680-4770-beae-4d059cda6002 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 7ee2d61f-352e-4762-aeec-9c2571e7e054] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:28.065330 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4d04a4c9-a680-4770-beae-4d059cda6002 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:28.066226 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4d04a4c9-a680-4770-beae-4d059cda6002 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:28.068099 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4d04a4c9-a680-4770-beae-4d059cda6002 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:28.069645 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4d04a4c9-a680-4770-beae-4d059cda6002 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:28.070379 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4d04a4c9-a680-4770-beae-4d059cda6002 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:28.071023 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4d04a4c9-a680-4770-beae-4d059cda6002 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:28.413446 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e9fa549e-239e-433a-b40f-26844f1b7f27 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:28.434316 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:16:28.441408 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e9fa549e-239e-433a-b40f-26844f1b7f27 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1" status: 200 len: 1346 microversion: 2.1 time: 1.518797 Oct 26 13:16:28.443811 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1658/3334] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:26 2022] GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1 => generated 1346 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:28.565286 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0276bcbb-0caa-47d5-a6a7-a0676467f562 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:28.565956 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0276bcbb-0caa-47d5-a6a7-a0676467f562 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 2c859d43-c102-4189-9e7a-6c88ff38f311] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:28.582694 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0276bcbb-0caa-47d5-a6a7-a0676467f562 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:28.583303 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0276bcbb-0caa-47d5-a6a7-a0676467f562 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:28.583626 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0276bcbb-0caa-47d5-a6a7-a0676467f562 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:28.584339 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0276bcbb-0caa-47d5-a6a7-a0676467f562 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:28.610342 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0276bcbb-0caa-47d5-a6a7-a0676467f562 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:28.610809 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0276bcbb-0caa-47d5-a6a7-a0676467f562 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:28.689345 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4d04a4c9-a680-4770-beae-4d059cda6002 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13285463ba34e89931d667bc327bb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875ebd1c99c746f7b4f1a3c08156e6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:28.697404 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4d04a4c9-a680-4770-beae-4d059cda6002 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee2d61f-352e-4762-aeec-9c2571e7e054" status: 200 len: 1646 microversion: 2.1 time: 0.658548 Oct 26 13:16:28.722881 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1677/3335] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:28 2022] GET /compute/v2.1/servers/7ee2d61f-352e-4762-aeec-9c2571e7e054 => generated 1646 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:28.728044 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5207de85-185e-481e-b9be-c21860e7282f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:28.751982 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5207de85-185e-481e-b9be-c21860e7282f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:28.766986 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5207de85-185e-481e-b9be-c21860e7282f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:28.767821 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5207de85-185e-481e-b9be-c21860e7282f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:28.768420 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5207de85-185e-481e-b9be-c21860e7282f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:28.776653 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5207de85-185e-481e-b9be-c21860e7282f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:28.778115 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5207de85-185e-481e-b9be-c21860e7282f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:28.778876 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5207de85-185e-481e-b9be-c21860e7282f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:28.799771 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0276bcbb-0caa-47d5-a6a7-a0676467f562 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:28.808361 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0276bcbb-0caa-47d5-a6a7-a0676467f562 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311" status: 200 len: 1300 microversion: 2.1 time: 0.246933 Oct 26 13:16:28.815977 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1659/3336] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:28 2022] GET /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311 => generated 1300 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:28.993092 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5207de85-185e-481e-b9be-c21860e7282f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:29.008091 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5207de85-185e-481e-b9be-c21860e7282f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8" status: 200 len: 1261 microversion: 2.1 time: 0.283707 Oct 26 13:16:29.011506 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1678/3337] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:28 2022] GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 => generated 1261 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:29.473017 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fac0c31e-594b-4d41-8ff0-6a68e2ebc351 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:29.473739 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fac0c31e-594b-4d41-8ff0-6a68e2ebc351 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: d0b8440f-677e-428d-8566-29fe4624fce1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:29.507727 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fac0c31e-594b-4d41-8ff0-6a68e2ebc351 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:29.509935 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fac0c31e-594b-4d41-8ff0-6a68e2ebc351 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:29.513263 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fac0c31e-594b-4d41-8ff0-6a68e2ebc351 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:29.514127 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fac0c31e-594b-4d41-8ff0-6a68e2ebc351 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:29.514642 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fac0c31e-594b-4d41-8ff0-6a68e2ebc351 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:29.517580 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fac0c31e-594b-4d41-8ff0-6a68e2ebc351 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:29.732138 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f3e2bd7c-2bb3-4bd2-9fa0-fb1d916bc622 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:29.732825 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f3e2bd7c-2bb3-4bd2-9fa0-fb1d916bc622 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 7ee2d61f-352e-4762-aeec-9c2571e7e054] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:29.735299 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fac0c31e-594b-4d41-8ff0-6a68e2ebc351 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:29.748942 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3e2bd7c-2bb3-4bd2-9fa0-fb1d916bc622 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:29.754132 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3e2bd7c-2bb3-4bd2-9fa0-fb1d916bc622 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:29.757320 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3e2bd7c-2bb3-4bd2-9fa0-fb1d916bc622 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:29.762770 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3e2bd7c-2bb3-4bd2-9fa0-fb1d916bc622 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:29.763339 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fac0c31e-594b-4d41-8ff0-6a68e2ebc351 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1" status: 200 len: 1346 microversion: 2.1 time: 0.295080 Oct 26 13:16:29.764491 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3e2bd7c-2bb3-4bd2-9fa0-fb1d916bc622 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:29.765384 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1660/3338] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:29 2022] GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1 => generated 1346 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:29.782010 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3e2bd7c-2bb3-4bd2-9fa0-fb1d916bc622 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:29.833823 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a69192c2-27de-4cff-a5e5-c71e3bdba7f4 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:29.834595 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a69192c2-27de-4cff-a5e5-c71e3bdba7f4 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 2c859d43-c102-4189-9e7a-6c88ff38f311] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:29.849830 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a69192c2-27de-4cff-a5e5-c71e3bdba7f4 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:29.851358 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a69192c2-27de-4cff-a5e5-c71e3bdba7f4 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:29.852670 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a69192c2-27de-4cff-a5e5-c71e3bdba7f4 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:29.865414 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a69192c2-27de-4cff-a5e5-c71e3bdba7f4 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:29.869542 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a69192c2-27de-4cff-a5e5-c71e3bdba7f4 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:29.870134 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a69192c2-27de-4cff-a5e5-c71e3bdba7f4 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:30.378227 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a69192c2-27de-4cff-a5e5-c71e3bdba7f4 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:30.395609 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a69192c2-27de-4cff-a5e5-c71e3bdba7f4 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311" status: 200 len: 1367 microversion: 2.1 time: 0.566060 Oct 26 13:16:30.401918 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1661/3339] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:29 2022] GET /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311 => generated 1367 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:16:30.410982 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3742140b-5522-404e-aa59-6ebd2bbe4db3 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:30.411660 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3742140b-5522-404e-aa59-6ebd2bbe4db3 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:30.427808 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3742140b-5522-404e-aa59-6ebd2bbe4db3 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:30.428356 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3742140b-5522-404e-aa59-6ebd2bbe4db3 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:30.428929 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3742140b-5522-404e-aa59-6ebd2bbe4db3 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:30.429775 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3742140b-5522-404e-aa59-6ebd2bbe4db3 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:30.430244 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3742140b-5522-404e-aa59-6ebd2bbe4db3 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:30.433724 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3742140b-5522-404e-aa59-6ebd2bbe4db3 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:30.611889 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3742140b-5522-404e-aa59-6ebd2bbe4db3 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:30.635584 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3742140b-5522-404e-aa59-6ebd2bbe4db3 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8" status: 200 len: 1267 microversion: 2.1 time: 0.231434 Oct 26 13:16:30.640601 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1662/3340] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:30 2022] GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 => generated 1267 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:30.797702 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e32a4aff-95cc-47e5-b75d-f26cbe1588ba tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:30.803147 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e32a4aff-95cc-47e5-b75d-f26cbe1588ba tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: d0b8440f-677e-428d-8566-29fe4624fce1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:30.816397 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e32a4aff-95cc-47e5-b75d-f26cbe1588ba tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:30.820100 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e32a4aff-95cc-47e5-b75d-f26cbe1588ba tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:30.821575 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e32a4aff-95cc-47e5-b75d-f26cbe1588ba tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:30.823759 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e32a4aff-95cc-47e5-b75d-f26cbe1588ba tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:30.825793 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e32a4aff-95cc-47e5-b75d-f26cbe1588ba tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:30.827214 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e32a4aff-95cc-47e5-b75d-f26cbe1588ba tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:30.982283 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e32a4aff-95cc-47e5-b75d-f26cbe1588ba tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:31.015818 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e32a4aff-95cc-47e5-b75d-f26cbe1588ba tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1" status: 200 len: 1346 microversion: 2.1 time: 0.222790 Oct 26 13:16:31.045952 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1663/3341] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:30 2022] GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1 => generated 1346 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:31.337245 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f3e2bd7c-2bb3-4bd2-9fa0-fb1d916bc622 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13285463ba34e89931d667bc327bb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875ebd1c99c746f7b4f1a3c08156e6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:31.352024 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f3e2bd7c-2bb3-4bd2-9fa0-fb1d916bc622 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee2d61f-352e-4762-aeec-9c2571e7e054" status: 200 len: 1646 microversion: 2.1 time: 1.625207 Oct 26 13:16:31.352691 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1679/3342] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:29 2022] GET /compute/v2.1/servers/7ee2d61f-352e-4762-aeec-9c2571e7e054 => generated 1646 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:16:31.422398 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-832cf9ad-5a6c-43a8-88a7-172ab5de9cea tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:31.423020 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-832cf9ad-5a6c-43a8-88a7-172ab5de9cea tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 2c859d43-c102-4189-9e7a-6c88ff38f311] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:31.433434 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-832cf9ad-5a6c-43a8-88a7-172ab5de9cea tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:31.433952 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-832cf9ad-5a6c-43a8-88a7-172ab5de9cea tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:31.434394 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-832cf9ad-5a6c-43a8-88a7-172ab5de9cea tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:31.435110 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-832cf9ad-5a6c-43a8-88a7-172ab5de9cea tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:31.435570 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-832cf9ad-5a6c-43a8-88a7-172ab5de9cea tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:31.435999 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-832cf9ad-5a6c-43a8-88a7-172ab5de9cea tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:31.668410 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a11c896d-9426-4f09-b94d-8634ece21f66 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:31.669029 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a11c896d-9426-4f09-b94d-8634ece21f66 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:31.688522 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a11c896d-9426-4f09-b94d-8634ece21f66 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:31.689049 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a11c896d-9426-4f09-b94d-8634ece21f66 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:31.689514 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a11c896d-9426-4f09-b94d-8634ece21f66 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:31.690269 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a11c896d-9426-4f09-b94d-8634ece21f66 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:31.690731 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a11c896d-9426-4f09-b94d-8634ece21f66 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:31.691176 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a11c896d-9426-4f09-b94d-8634ece21f66 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:31.815249 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-832cf9ad-5a6c-43a8-88a7-172ab5de9cea tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:31.824528 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-832cf9ad-5a6c-43a8-88a7-172ab5de9cea tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311" status: 200 len: 1367 microversion: 2.1 time: 0.406345 Oct 26 13:16:31.841910 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1664/3343] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:31 2022] GET /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311 => generated 1367 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:32.016741 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a11c896d-9426-4f09-b94d-8634ece21f66 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:32.030864 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a11c896d-9426-4f09-b94d-8634ece21f66 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8" status: 200 len: 1267 microversion: 2.1 time: 0.366708 Oct 26 13:16:32.046462 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1680/3344] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:31 2022] GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 => generated 1267 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:16:32.056506 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-42603f9d-923a-4563-8b00-8a0b0fca091b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:32.057289 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-42603f9d-923a-4563-8b00-8a0b0fca091b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: d0b8440f-677e-428d-8566-29fe4624fce1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:32.068435 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42603f9d-923a-4563-8b00-8a0b0fca091b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:32.071909 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42603f9d-923a-4563-8b00-8a0b0fca091b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:32.075431 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42603f9d-923a-4563-8b00-8a0b0fca091b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:32.076603 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42603f9d-923a-4563-8b00-8a0b0fca091b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:32.077296 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42603f9d-923a-4563-8b00-8a0b0fca091b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:32.090594 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42603f9d-923a-4563-8b00-8a0b0fca091b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:32.254954 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-42603f9d-923a-4563-8b00-8a0b0fca091b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:32.266598 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-42603f9d-923a-4563-8b00-8a0b0fca091b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1" status: 200 len: 1346 microversion: 2.1 time: 0.226068 Oct 26 13:16:32.272196 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1665/3345] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:32 2022] GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1 => generated 1346 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:32.316680 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-02b6418b-9651-4707-99c5-4687c0a6cc20 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-373437019", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "d6cea624-72e8-47d7-aeec-bb581ace6ccb"}, {"port": "6f7441d1-08c7-4242-af8c-89ef53af5a68", "tag": "port-1"}, {"port": "ba719c25-4dde-4810-8e01-3a65db1889d6", "tag": "port-2"}, {"uuid": "47423609-f47f-45d9-8885-e5bc69eabb41", "tag": "net-1"}, {"uuid": "47423609-f47f-45d9-8885-e5bc69eabb41"}, {"uuid": "9310a441-0c47-40a8-82da-a63b028e57f9", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "9310a441-0c47-40a8-82da-a63b028e57f9", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "d42d9d4e-833b-409b-95b0-786d72ad14ec", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "bfa3dd32-0086-4281-a39d-6453311ad6bd", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "d43fbd5b-01af-42ee-b13b-bef13e69ea04", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--853614684"}], "key_name": "tempest-keypair-459688330", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:16:32.376013 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-907d1b2f-9617-4b02-9a85-fb25fe82db67 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:32.376876 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-907d1b2f-9617-4b02-9a85-fb25fe82db67 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 7ee2d61f-352e-4762-aeec-9c2571e7e054] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:32.399836 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-907d1b2f-9617-4b02-9a85-fb25fe82db67 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:32.400447 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-907d1b2f-9617-4b02-9a85-fb25fe82db67 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:32.402292 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-907d1b2f-9617-4b02-9a85-fb25fe82db67 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:32.403118 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-907d1b2f-9617-4b02-9a85-fb25fe82db67 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:32.403615 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-907d1b2f-9617-4b02-9a85-fb25fe82db67 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:32.404085 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-907d1b2f-9617-4b02-9a85-fb25fe82db67 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:32.530140 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-907d1b2f-9617-4b02-9a85-fb25fe82db67 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13285463ba34e89931d667bc327bb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875ebd1c99c746f7b4f1a3c08156e6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:32.551586 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-907d1b2f-9617-4b02-9a85-fb25fe82db67 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee2d61f-352e-4762-aeec-9c2571e7e054" status: 200 len: 1466 microversion: 2.1 time: 0.179609 Oct 26 13:16:32.558514 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1666/3346] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:32 2022] GET /compute/v2.1/servers/7ee2d61f-352e-4762-aeec-9c2571e7e054 => generated 1466 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:32.649689 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-02b6418b-9651-4707-99c5-4687c0a6cc20 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] validate_networks() for [('d6cea624-72e8-47d7-aeec-bb581ace6ccb', None, None, None, None, None), (None, None, '6f7441d1-08c7-4242-af8c-89ef53af5a68', None, None, None), (None, None, 'ba719c25-4dde-4810-8e01-3a65db1889d6', None, None, None), ('47423609-f47f-45d9-8885-e5bc69eabb41', None, None, None, None, None), ('47423609-f47f-45d9-8885-e5bc69eabb41', None, None, None, None, None), ('9310a441-0c47-40a8-82da-a63b028e57f9', '10.2.2.100', None, None, None, None), ('9310a441-0c47-40a8-82da-a63b028e57f9', '10.2.2.200', None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:16:32.850334 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-aa173769-22e1-42c9-a746-4d5ec6b38a02 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:32.851218 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-aa173769-22e1-42c9-a746-4d5ec6b38a02 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 2c859d43-c102-4189-9e7a-6c88ff38f311] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:32.861184 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa173769-22e1-42c9-a746-4d5ec6b38a02 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:32.861823 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa173769-22e1-42c9-a746-4d5ec6b38a02 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:32.862344 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa173769-22e1-42c9-a746-4d5ec6b38a02 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:32.865325 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa173769-22e1-42c9-a746-4d5ec6b38a02 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:32.866617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa173769-22e1-42c9-a746-4d5ec6b38a02 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:32.867100 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa173769-22e1-42c9-a746-4d5ec6b38a02 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:33.116917 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-aa173769-22e1-42c9-a746-4d5ec6b38a02 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:33.125727 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-aa173769-22e1-42c9-a746-4d5ec6b38a02 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311" status: 200 len: 1367 microversion: 2.1 time: 0.281175 Oct 26 13:16:33.126913 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1667/3347] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:32 2022] GET /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311 => generated 1367 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:33.133363 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-ef573787-e538-455f-9110-e4ab215dc108 req-0cefdae9-8806-492b-9ff0-0aee58e72570 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ee2d61f-352e-4762-aeec-9c2571e7e054", "name": "network-vif-deleted", "tag": "42f887f0-054f-4215-9647-53bc789b0ab4"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:16:33.148109 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ef573787-e538-455f-9110-e4ab215dc108 req-0cefdae9-8806-492b-9ff0-0aee58e72570 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:33.148849 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ef573787-e538-455f-9110-e4ab215dc108 req-0cefdae9-8806-492b-9ff0-0aee58e72570 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:33.149470 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ef573787-e538-455f-9110-e4ab215dc108 req-0cefdae9-8806-492b-9ff0-0aee58e72570 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:33.162274 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-ef573787-e538-455f-9110-e4ab215dc108 req-0cefdae9-8806-492b-9ff0-0aee58e72570 service nova] Creating event network-vif-deleted:42f887f0-054f-4215-9647-53bc789b0ab4 for instance 7ee2d61f-352e-4762-aeec-9c2571e7e054 on n-h1-862686-1 Oct 26 13:16:33.169090 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-ef573787-e538-455f-9110-e4ab215dc108 req-0cefdae9-8806-492b-9ff0-0aee58e72570 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040468 Oct 26 13:16:33.170075 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1668/3348] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:16:33.176126 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9016512e-63a8-4b61-8fa7-18cac6ad731b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:33.177052 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9016512e-63a8-4b61-8fa7-18cac6ad731b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:33.185452 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9016512e-63a8-4b61-8fa7-18cac6ad731b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:33.186223 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9016512e-63a8-4b61-8fa7-18cac6ad731b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:33.186825 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9016512e-63a8-4b61-8fa7-18cac6ad731b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:33.187733 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9016512e-63a8-4b61-8fa7-18cac6ad731b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:33.188354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9016512e-63a8-4b61-8fa7-18cac6ad731b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:33.188945 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9016512e-63a8-4b61-8fa7-18cac6ad731b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:33.300867 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9016512e-63a8-4b61-8fa7-18cac6ad731b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:33.311021 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9016512e-63a8-4b61-8fa7-18cac6ad731b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8" status: 200 len: 1267 microversion: 2.1 time: 0.139391 Oct 26 13:16:33.312312 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1669/3349] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:33 2022] GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 => generated 1267 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:33.317776 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-30c8ac48-55c6-49e4-98e7-5f8b0351fe59 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:33.318705 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-30c8ac48-55c6-49e4-98e7-5f8b0351fe59 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: d0b8440f-677e-428d-8566-29fe4624fce1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:33.325434 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30c8ac48-55c6-49e4-98e7-5f8b0351fe59 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:33.326395 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30c8ac48-55c6-49e4-98e7-5f8b0351fe59 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:33.327059 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30c8ac48-55c6-49e4-98e7-5f8b0351fe59 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:33.328518 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30c8ac48-55c6-49e4-98e7-5f8b0351fe59 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:33.329164 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30c8ac48-55c6-49e4-98e7-5f8b0351fe59 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:33.330271 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30c8ac48-55c6-49e4-98e7-5f8b0351fe59 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:33.377250 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30c8ac48-55c6-49e4-98e7-5f8b0351fe59 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:33.378057 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30c8ac48-55c6-49e4-98e7-5f8b0351fe59 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:33.378647 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30c8ac48-55c6-49e4-98e7-5f8b0351fe59 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:33.379425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-30c8ac48-55c6-49e4-98e7-5f8b0351fe59 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lazy-loading 'fault' on Instance uuid d0b8440f-677e-428d-8566-29fe4624fce1 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:16:33.452201 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-30c8ac48-55c6-49e4-98e7-5f8b0351fe59 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:33.476689 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-30c8ac48-55c6-49e4-98e7-5f8b0351fe59 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1" status: 200 len: 1351 microversion: 2.1 time: 0.162801 Oct 26 13:16:33.481260 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1670/3350] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:33 2022] GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1 => generated 1351 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:33.584165 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3bdd2367-0043-42cb-bb86-a86766e40d0e tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:33.584780 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3bdd2367-0043-42cb-bb86-a86766e40d0e tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 7ee2d61f-352e-4762-aeec-9c2571e7e054] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:33.588229 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:16:33.593670 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bdd2367-0043-42cb-bb86-a86766e40d0e tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:33.594056 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bdd2367-0043-42cb-bb86-a86766e40d0e tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:33.594603 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bdd2367-0043-42cb-bb86-a86766e40d0e tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:33.595508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bdd2367-0043-42cb-bb86-a86766e40d0e tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:33.595970 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bdd2367-0043-42cb-bb86-a86766e40d0e tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:33.596638 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bdd2367-0043-42cb-bb86-a86766e40d0e tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:33.641362 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bdd2367-0043-42cb-bb86-a86766e40d0e tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:33.641877 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bdd2367-0043-42cb-bb86-a86766e40d0e tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:33.657423 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bdd2367-0043-42cb-bb86-a86766e40d0e tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:33.658045 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-3bdd2367-0043-42cb-bb86-a86766e40d0e tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lazy-loading 'fault' on Instance uuid 7ee2d61f-352e-4762-aeec-9c2571e7e054 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:16:33.707916 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3bdd2367-0043-42cb-bb86-a86766e40d0e tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13285463ba34e89931d667bc327bb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875ebd1c99c746f7b4f1a3c08156e6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:33.718081 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3bdd2367-0043-42cb-bb86-a86766e40d0e tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee2d61f-352e-4762-aeec-9c2571e7e054" status: 200 len: 1304 microversion: 2.1 time: 0.137945 Oct 26 13:16:33.718987 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1671/3351] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:33 2022] GET /compute/v2.1/servers/7ee2d61f-352e-4762-aeec-9c2571e7e054 => generated 1304 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:34.173645 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-86e2dd10-a3f2-4698-ad8a-c9fb375bc57a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:34.174323 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-86e2dd10-a3f2-4698-ad8a-c9fb375bc57a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 2c859d43-c102-4189-9e7a-6c88ff38f311] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:34.189438 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-86e2dd10-a3f2-4698-ad8a-c9fb375bc57a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:34.189983 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-86e2dd10-a3f2-4698-ad8a-c9fb375bc57a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:34.190559 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-86e2dd10-a3f2-4698-ad8a-c9fb375bc57a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:34.191489 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-86e2dd10-a3f2-4698-ad8a-c9fb375bc57a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:34.192057 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-86e2dd10-a3f2-4698-ad8a-c9fb375bc57a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:34.192658 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-86e2dd10-a3f2-4698-ad8a-c9fb375bc57a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:34.378979 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-86e2dd10-a3f2-4698-ad8a-c9fb375bc57a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:34.388063 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-86e2dd10-a3f2-4698-ad8a-c9fb375bc57a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311" status: 200 len: 1367 microversion: 2.1 time: 0.238079 Oct 26 13:16:34.403643 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1672/3352] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:34 2022] GET /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311 => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:16:34.403643 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-83778733-0dfa-4381-8881-830eae061b4f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:34.403643 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-83778733-0dfa-4381-8881-830eae061b4f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:34.404509 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83778733-0dfa-4381-8881-830eae061b4f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:34.405012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83778733-0dfa-4381-8881-830eae061b4f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:34.405528 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83778733-0dfa-4381-8881-830eae061b4f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:34.406494 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83778733-0dfa-4381-8881-830eae061b4f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:34.407196 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83778733-0dfa-4381-8881-830eae061b4f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:34.407890 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83778733-0dfa-4381-8881-830eae061b4f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:34.615852 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-83778733-0dfa-4381-8881-830eae061b4f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:34.640121 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-83778733-0dfa-4381-8881-830eae061b4f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8" status: 200 len: 1309 microversion: 2.1 time: 0.249414 Oct 26 13:16:34.640602 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1673/3353] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:34 2022] GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 => generated 1309 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:34.647080 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8d777405-b11b-4f81-8594-57aafe6485b9 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:34.648172 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8d777405-b11b-4f81-8594-57aafe6485b9 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: d0b8440f-677e-428d-8566-29fe4624fce1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:34.661967 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d777405-b11b-4f81-8594-57aafe6485b9 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:34.662488 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d777405-b11b-4f81-8594-57aafe6485b9 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:34.663237 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d777405-b11b-4f81-8594-57aafe6485b9 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:34.664051 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d777405-b11b-4f81-8594-57aafe6485b9 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:34.664549 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d777405-b11b-4f81-8594-57aafe6485b9 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:34.664970 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d777405-b11b-4f81-8594-57aafe6485b9 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:34.681650 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-8d777405-b11b-4f81-8594-57aafe6485b9 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] HTTP exception thrown: Instance d0b8440f-677e-428d-8566-29fe4624fce1 could not be found. Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8d777405-b11b-4f81-8594-57aafe6485b9 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Request method failure captured: Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1 HTTP/1.1 Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTLTNOlsUS_LQCwMyQbAmNSS-N_AQOqf9a-vHlBM4RS64aXMIGczutoYb0yXKXV63kqVyJMbrGhj1O0dIymI3rB4OYRTseWpFfzGHfB9PKKsR2NnI_ukYFvVdYRwcazuK9kTcZsmuh-2k9d7Yqn3gprd7n0NXcu2P16gbCixvzOdrAQ Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: ece49f83e645408598655bece0873fd0 Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ece49f83e645408598655bece0873fd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ece49f83e645408598655bece0873fd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ece49f83e645408598655bece0873fd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ece49f83e645408598655bece0873fd0"}]}] Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: ece49f83e645408598655bece0873fd0 Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-DeleteServersTestJSON-1847538505-project Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 8d56acbbbc3545d19cbb80f4e349c763 Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-DeleteServersTestJSON-1847538505-project Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance d0b8440f-677e-428d-8566-29fe4624fce1 could not be found. Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'd0b8440f-677e-428d-8566-29fe4624fce1'} Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0b8440f-677e-428d-8566-29fe4624fce1 could not be found. Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0b8440f-677e-428d-8566-29fe4624fce1 could not be found. Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:34.683904 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:34.690360 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:34.690360 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:16:34.690360 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:16:34.690360 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:16:34.690360 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:16:34.690360 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0b8440f-677e-428d-8566-29fe4624fce1 could not be found. Oct 26 13:16:34.690360 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:34.690360 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8d777405-b11b-4f81-8594-57aafe6485b9 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Returning 404 to user: Instance d0b8440f-677e-428d-8566-29fe4624fce1 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:16:34.690360 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8d777405-b11b-4f81-8594-57aafe6485b9 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1" status: 404 len: 111 microversion: 2.1 time: 0.043898 Oct 26 13:16:34.690360 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1674/3354] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:34 2022] GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:16:34.743289 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4da693c0-950e-4cc8-a77f-622f3485d4a4 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:34.744085 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4da693c0-950e-4cc8-a77f-622f3485d4a4 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] [instance: 7ee2d61f-352e-4762-aeec-9c2571e7e054] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:34.751495 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4da693c0-950e-4cc8-a77f-622f3485d4a4 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:34.752195 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4da693c0-950e-4cc8-a77f-622f3485d4a4 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:34.752956 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4da693c0-950e-4cc8-a77f-622f3485d4a4 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:34.753877 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4da693c0-950e-4cc8-a77f-622f3485d4a4 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:34.754517 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4da693c0-950e-4cc8-a77f-622f3485d4a4 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:34.755562 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4da693c0-950e-4cc8-a77f-622f3485d4a4 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:34.783596 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-4da693c0-950e-4cc8-a77f-622f3485d4a4 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] HTTP exception thrown: Instance 7ee2d61f-352e-4762-aeec-9c2571e7e054 could not be found. Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4da693c0-950e-4cc8-a77f-622f3485d4a4 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Request method failure captured: Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/7ee2d61f-352e-4762-aeec-9c2571e7e054 HTTP/1.1 Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTLZwemdkOoZmTGSmy6KZvPDtVHD2_E9ZUR49ovbPsQaFz77JmwG34xaymuHO8vYj9Nv7h8paBonBJqeJ-iGNHh66dW9zr2o-PVtLnq2ivVkvSk_ngG_K5FTR8-56OwV4JEOB5RsCmAZvvKkRYejOCKTdf6hjGlyGC2s57RFn_cJWHQ Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 875ebd1c99c746f7b4f1a3c08156e6a0 Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-SecurityGroupsTestJSON-256228496 Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/875ebd1c99c746f7b4f1a3c08156e6a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/875ebd1c99c746f7b4f1a3c08156e6a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_875ebd1c99c746f7b4f1a3c08156e6a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/875ebd1c99c746f7b4f1a3c08156e6a0"}]}] Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-SecurityGroupsTestJSON-256228496 Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 875ebd1c99c746f7b4f1a3c08156e6a0 Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-256228496 Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-SecurityGroupsTestJSON-256228496-project Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: a13285463ba34e89931d667bc327bb2a Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-SecurityGroupsTestJSON-256228496-project Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 7ee2d61f-352e-4762-aeec-9c2571e7e054 could not be found. Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '7ee2d61f-352e-4762-aeec-9c2571e7e054'} Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ee2d61f-352e-4762-aeec-9c2571e7e054 could not be found. Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ee2d61f-352e-4762-aeec-9c2571e7e054 could not be found. Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:34.790908 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:34.796843 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:34.796843 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:16:34.796843 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:16:34.796843 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:16:34.796843 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:16:34.796843 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ee2d61f-352e-4762-aeec-9c2571e7e054 could not be found. Oct 26 13:16:34.796843 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:34.796843 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4da693c0-950e-4cc8-a77f-622f3485d4a4 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Returning 404 to user: Instance 7ee2d61f-352e-4762-aeec-9c2571e7e054 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:16:34.796843 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4da693c0-950e-4cc8-a77f-622f3485d4a4 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "GET /compute/v2.1/servers/7ee2d61f-352e-4762-aeec-9c2571e7e054" status: 404 len: 111 microversion: 2.1 time: 0.055853 Oct 26 13:16:34.803765 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1675/3355] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:34 2022] GET /compute/v2.1/servers/7ee2d61f-352e-4762-aeec-9c2571e7e054 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 13:16:34.814605 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-35ef7df3-2c24-4639-b412-49922d6e6de2 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '.version_select at 0x7f67327bdee0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:35.095097 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-35ef7df3-2c24-4639-b412-49922d6e6de2 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/7ca874d8-0331-43cc-89e9-4609f5dd6911" status: 202 len: 0 microversion: 2.1 time: 0.289045 Oct 26 13:16:35.099946 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1676/3356] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 26 13:16:34 2022] DELETE /compute/v2.1/os-security-groups/7ca874d8-0331-43cc-89e9-4609f5dd6911 => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:16:35.108868 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-92cd2504-0413-47f2-9752-318c79991abe tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:35.112543 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-92cd2504-0413-47f2-9752-318c79991abe tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: d0b8440f-677e-428d-8566-29fe4624fce1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:35.121086 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-92cd2504-0413-47f2-9752-318c79991abe tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:35.121883 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-92cd2504-0413-47f2-9752-318c79991abe tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:35.122793 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-92cd2504-0413-47f2-9752-318c79991abe tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:35.124486 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-92cd2504-0413-47f2-9752-318c79991abe tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:35.125417 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-92cd2504-0413-47f2-9752-318c79991abe tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:35.126338 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-92cd2504-0413-47f2-9752-318c79991abe tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:35.147736 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-92cd2504-0413-47f2-9752-318c79991abe tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] HTTP exception thrown: Instance d0b8440f-677e-428d-8566-29fe4624fce1 could not be found. Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-92cd2504-0413-47f2-9752-318c79991abe tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Request method failure captured: Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1/os-volume_attachments HTTP/1.1 Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTLTNOlsUS_LQCwMyQbAmNSS-N_AQOqf9a-vHlBM4RS64aXMIGczutoYb0yXKXV63kqVyJMbrGhj1O0dIymI3rB4OYRTseWpFfzGHfB9PKKsR2NnI_ukYFvVdYRwcazuK9kTcZsmuh-2k9d7Yqn3gprd7n0NXcu2P16gbCixvzOdrAQ Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: ece49f83e645408598655bece0873fd0 Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ece49f83e645408598655bece0873fd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ece49f83e645408598655bece0873fd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ece49f83e645408598655bece0873fd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ece49f83e645408598655bece0873fd0"}]}] Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: ece49f83e645408598655bece0873fd0 Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-DeleteServersTestJSON-1847538505-project Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 8d56acbbbc3545d19cbb80f4e349c763 Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-DeleteServersTestJSON-1847538505-project Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance d0b8440f-677e-428d-8566-29fe4624fce1 could not be found. Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'server_id': 'd0b8440f-677e-428d-8566-29fe4624fce1'} Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0b8440f-677e-428d-8566-29fe4624fce1 could not be found. Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:16:35.154293 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:16:35.162497 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0b8440f-677e-428d-8566-29fe4624fce1 could not be found. Oct 26 13:16:35.162497 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:35.162497 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:35.162497 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:35.162497 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:35.162497 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:16:35.162497 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:16:35.162497 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:16:35.162497 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:16:35.162497 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0b8440f-677e-428d-8566-29fe4624fce1 could not be found. Oct 26 13:16:35.162497 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:35.165072 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-92cd2504-0413-47f2-9752-318c79991abe tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Returning 404 to user: Instance d0b8440f-677e-428d-8566-29fe4624fce1 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:16:35.166934 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-92cd2504-0413-47f2-9752-318c79991abe tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.065498 Oct 26 13:16:35.168005 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1677/3357] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:16:35 2022] GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1/os-volume_attachments => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:16:35.175306 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c7213334-dbc0-4720-8d4b-d27170260996 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] Calling method '.version_select at 0x7f67325b6a60>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:35.543372 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c7213334-dbc0-4720-8d4b-d27170260996 tempest-SecurityGroupsTestJSON-256228496 tempest-SecurityGroupsTestJSON-256228496-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/7c93be56-e3b8-48a2-bf3c-83a3139d8347" status: 202 len: 0 microversion: 2.1 time: 0.373769 Oct 26 13:16:35.544205 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1678/3358] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 26 13:16:35 2022] DELETE /compute/v2.1/os-security-groups/7c93be56-e3b8-48a2-bf3c-83a3139d8347 => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:16:35.550935 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-948691fd-9666-4a50-a2f4-7ddca6856b0b req-0af8aacb-6f1d-4d97-aaa3-10296440f64c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c859d43-c102-4189-9e7a-6c88ff38f311", "tag": "7b29700f-b95c-4338-847f-0573694835c8"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:16:35.634138 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-948691fd-9666-4a50-a2f4-7ddca6856b0b req-0af8aacb-6f1d-4d97-aaa3-10296440f64c service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:35.636231 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-948691fd-9666-4a50-a2f4-7ddca6856b0b req-0af8aacb-6f1d-4d97-aaa3-10296440f64c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:35.642239 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-948691fd-9666-4a50-a2f4-7ddca6856b0b req-0af8aacb-6f1d-4d97-aaa3-10296440f64c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:35.653285 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:16:35.676193 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-948691fd-9666-4a50-a2f4-7ddca6856b0b req-0af8aacb-6f1d-4d97-aaa3-10296440f64c service nova] Creating event network-changed:7b29700f-b95c-4338-847f-0573694835c8 for instance 2c859d43-c102-4189-9e7a-6c88ff38f311 on n-h2-862686-1 Oct 26 13:16:35.685704 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-948691fd-9666-4a50-a2f4-7ddca6856b0b req-0af8aacb-6f1d-4d97-aaa3-10296440f64c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139110 Oct 26 13:16:35.687229 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1679/3359] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:16:35.696640 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ec21aa61-d0d5-4135-8091-52619756eb3a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:35.697703 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ec21aa61-d0d5-4135-8091-52619756eb3a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 2c859d43-c102-4189-9e7a-6c88ff38f311] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:35.709381 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec21aa61-d0d5-4135-8091-52619756eb3a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:35.710394 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec21aa61-d0d5-4135-8091-52619756eb3a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:35.711023 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec21aa61-d0d5-4135-8091-52619756eb3a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:35.712661 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec21aa61-d0d5-4135-8091-52619756eb3a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:35.713661 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec21aa61-d0d5-4135-8091-52619756eb3a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:35.714639 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec21aa61-d0d5-4135-8091-52619756eb3a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:35.723671 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:16:35.991451 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=8 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:16:36.055634 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ec21aa61-d0d5-4135-8091-52619756eb3a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:36.063645 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ec21aa61-d0d5-4135-8091-52619756eb3a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311" status: 200 len: 1367 microversion: 2.1 time: 0.374757 Oct 26 13:16:36.064436 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1680/3360] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:35 2022] GET /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311 => generated 1367 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:36.069249 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-216f2a9f-be8a-403d-91b6-75e7b6f9a625 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2084851109", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "cb59e2c8-6bcb-4fcf-b9e4-c01412b43c60"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:16:36.131751 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-216f2a9f-be8a-403d-91b6-75e7b6f9a625 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] validate_networks() for [('cb59e2c8-6bcb-4fcf-b9e4-c01412b43c60', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:16:37.104953 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:16:37.610148 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-216f2a9f-be8a-403d-91b6-75e7b6f9a625 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:16:37.610786 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-216f2a9f-be8a-403d-91b6-75e7b6f9a625 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:16:37.611040 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-216f2a9f-be8a-403d-91b6-75e7b6f9a625 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:16:37.611452 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-216f2a9f-be8a-403d-91b6-75e7b6f9a625 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:16:37.611866 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-216f2a9f-be8a-403d-91b6-75e7b6f9a625 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:16:37.637806 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-216f2a9f-be8a-403d-91b6-75e7b6f9a625 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:37.638306 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-216f2a9f-be8a-403d-91b6-75e7b6f9a625 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:37.638751 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-216f2a9f-be8a-403d-91b6-75e7b6f9a625 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:37.639488 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-216f2a9f-be8a-403d-91b6-75e7b6f9a625 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:37.639951 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-216f2a9f-be8a-403d-91b6-75e7b6f9a625 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:37.641017 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-216f2a9f-be8a-403d-91b6-75e7b6f9a625 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:37.674992 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-216f2a9f-be8a-403d-91b6-75e7b6f9a625 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Getting quotas for project ece49f83e645408598655bece0873fd0. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:16:37.684912 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-216f2a9f-be8a-403d-91b6-75e7b6f9a625 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Getting quotas for user 8d56acbbbc3545d19cbb80f4e349c763 and project ece49f83e645408598655bece0873fd0. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:16:37.695784 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=16 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:16:37.706210 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-216f2a9f-be8a-403d-91b6-75e7b6f9a625 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:16:37.709062 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-216f2a9f-be8a-403d-91b6-75e7b6f9a625 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 1d894bed-14f0-4c87-a41b-a50cb8c0a61e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:16:37.780471 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-216f2a9f-be8a-403d-91b6-75e7b6f9a625 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.714799 Oct 26 13:16:37.781772 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1681/3361] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:16:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:16:37.786596 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cb8c226c-e705-481f-acdc-72647763ab7b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:37.787507 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cb8c226c-e705-481f-acdc-72647763ab7b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:37.794535 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cb8c226c-e705-481f-acdc-72647763ab7b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:37.795321 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cb8c226c-e705-481f-acdc-72647763ab7b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:37.795938 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cb8c226c-e705-481f-acdc-72647763ab7b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:37.796829 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cb8c226c-e705-481f-acdc-72647763ab7b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:37.797450 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cb8c226c-e705-481f-acdc-72647763ab7b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:37.798055 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cb8c226c-e705-481f-acdc-72647763ab7b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:38.023643 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-02b6418b-9651-4707-99c5-4687c0a6cc20 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:16:38.024382 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-02b6418b-9651-4707-99c5-4687c0a6cc20 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:16:38.025054 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-02b6418b-9651-4707-99c5-4687c0a6cc20 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:16:38.025704 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-02b6418b-9651-4707-99c5-4687c0a6cc20 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:16:38.026289 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-02b6418b-9651-4707-99c5-4687c0a6cc20 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:16:38.045003 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-02b6418b-9651-4707-99c5-4687c0a6cc20 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:38.045519 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-02b6418b-9651-4707-99c5-4687c0a6cc20 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:38.045968 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-02b6418b-9651-4707-99c5-4687c0a6cc20 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:38.046792 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-02b6418b-9651-4707-99c5-4687c0a6cc20 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:38.047140 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-02b6418b-9651-4707-99c5-4687c0a6cc20 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:38.051638 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-02b6418b-9651-4707-99c5-4687c0a6cc20 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:38.098277 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-02b6418b-9651-4707-99c5-4687c0a6cc20 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Getting quotas for project 8020c4d2858a4c6cbd194758e958dad0. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:16:38.112287 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-02b6418b-9651-4707-99c5-4687c0a6cc20 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Getting quotas for user 6097043a9a7d455bb4a8e2146a14dbdd and project 8020c4d2858a4c6cbd194758e958dad0. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:16:38.170680 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-cb8c226c-e705-481f-acdc-72647763ab7b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:38.183064 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cb8c226c-e705-481f-acdc-72647763ab7b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8" status: 200 len: 1309 microversion: 2.1 time: 0.399756 Oct 26 13:16:38.186990 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1682/3362] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:37 2022] GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 => generated 1309 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:38.202207 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a6e550cb-eacd-43f8-bc09-af73760d9ae8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:38.204958 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a6e550cb-eacd-43f8-bc09-af73760d9ae8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 2c859d43-c102-4189-9e7a-6c88ff38f311] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:38.228602 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a6e550cb-eacd-43f8-bc09-af73760d9ae8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:38.229442 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a6e550cb-eacd-43f8-bc09-af73760d9ae8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:38.230016 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a6e550cb-eacd-43f8-bc09-af73760d9ae8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:38.230742 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a6e550cb-eacd-43f8-bc09-af73760d9ae8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:38.231196 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a6e550cb-eacd-43f8-bc09-af73760d9ae8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:38.231755 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a6e550cb-eacd-43f8-bc09-af73760d9ae8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:38.528761 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-02b6418b-9651-4707-99c5-4687c0a6cc20 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:16:38.531908 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-02b6418b-9651-4707-99c5-4687c0a6cc20 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='d42d9d4e-833b-409b-95b0-786d72ad14ec',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='bfa3dd32-0086-4281-a39d-6453311ad6bd',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d43fbd5b-01af-42ee-b13b-bef13e69ea04',volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:16:39.014354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a6e550cb-eacd-43f8-bc09-af73760d9ae8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:39.028198 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a6e550cb-eacd-43f8-bc09-af73760d9ae8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311" status: 200 len: 1367 microversion: 2.1 time: 0.839932 Oct 26 13:16:39.032689 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1683/3363] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:38 2022] GET /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311 => generated 1367 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:39.057592 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3929ffe5-1c88-4fa6-802a-8e15bb0f5d9a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:39.058791 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3929ffe5-1c88-4fa6-802a-8e15bb0f5d9a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 1d894bed-14f0-4c87-a41b-a50cb8c0a61e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:39.089695 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3929ffe5-1c88-4fa6-802a-8e15bb0f5d9a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:39.091705 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3929ffe5-1c88-4fa6-802a-8e15bb0f5d9a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:39.092470 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3929ffe5-1c88-4fa6-802a-8e15bb0f5d9a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:39.093755 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3929ffe5-1c88-4fa6-802a-8e15bb0f5d9a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:39.094479 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3929ffe5-1c88-4fa6-802a-8e15bb0f5d9a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:39.095773 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3929ffe5-1c88-4fa6-802a-8e15bb0f5d9a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:39.246538 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-02b6418b-9651-4707-99c5-4687c0a6cc20 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 6.931797 Oct 26 13:16:39.249946 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1681/3364] 10.222.0.40 () {62 vars in 1189 bytes} [Wed Oct 26 13:16:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 6938 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 26 13:16:39.255155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-3139f524-be19-4fef-8940-ff651c3b4bf4 req-9988b0ab-dc91-4a85-9ebc-fd0675e2489f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8", "tag": "865dd839-e1fa-4d8d-bcd4-1b698f4e4b5f"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:16:39.285909 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3929ffe5-1c88-4fa6-802a-8e15bb0f5d9a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:39.305073 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-3139f524-be19-4fef-8940-ff651c3b4bf4 req-9988b0ab-dc91-4a85-9ebc-fd0675e2489f service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:39.305310 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3929ffe5-1c88-4fa6-802a-8e15bb0f5d9a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/1d894bed-14f0-4c87-a41b-a50cb8c0a61e" status: 200 len: 1219 microversion: 2.1 time: 0.265578 Oct 26 13:16:39.307533 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-3139f524-be19-4fef-8940-ff651c3b4bf4 req-9988b0ab-dc91-4a85-9ebc-fd0675e2489f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:39.308359 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-3139f524-be19-4fef-8940-ff651c3b4bf4 req-9988b0ab-dc91-4a85-9ebc-fd0675e2489f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:39.329523 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1684/3365] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:39 2022] GET /compute/v2.1/servers/1d894bed-14f0-4c87-a41b-a50cb8c0a61e => generated 1219 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:39.345997 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-3139f524-be19-4fef-8940-ff651c3b4bf4 req-9988b0ab-dc91-4a85-9ebc-fd0675e2489f service nova] Creating event network-changed:865dd839-e1fa-4d8d-bcd4-1b698f4e4b5f for instance 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 on n-h2-862686-1 Oct 26 13:16:39.350849 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c451fac6-4c86-4242-9298-8dafb79c42f6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:39.351589 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c451fac6-4c86-4242-9298-8dafb79c42f6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:39.352916 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-3139f524-be19-4fef-8940-ff651c3b4bf4 req-9988b0ab-dc91-4a85-9ebc-fd0675e2489f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100613 Oct 26 13:16:39.354433 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1682/3366] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:16:39.365945 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bdbd1a9c-fcaa-4e65-94e1-1085dc057b8c tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:39.367112 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bdbd1a9c-fcaa-4e65-94e1-1085dc057b8c tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:39.373293 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c451fac6-4c86-4242-9298-8dafb79c42f6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:39.374969 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c451fac6-4c86-4242-9298-8dafb79c42f6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:39.376190 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c451fac6-4c86-4242-9298-8dafb79c42f6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:39.378818 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c451fac6-4c86-4242-9298-8dafb79c42f6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:39.380330 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c451fac6-4c86-4242-9298-8dafb79c42f6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:39.380959 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c451fac6-4c86-4242-9298-8dafb79c42f6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:39.517296 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bdbd1a9c-fcaa-4e65-94e1-1085dc057b8c tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:39.527399 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bdbd1a9c-fcaa-4e65-94e1-1085dc057b8c tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:39.529920 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bdbd1a9c-fcaa-4e65-94e1-1085dc057b8c tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:39.531413 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bdbd1a9c-fcaa-4e65-94e1-1085dc057b8c tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1284 microversion: 2.32 time: 0.175004 Oct 26 13:16:39.532490 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1683/3367] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:16:39 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1284 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:16:39.537309 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2f0196d6-5a2e-4b0d-a70a-b05b18a3fa3a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:39.538044 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2f0196d6-5a2e-4b0d-a70a-b05b18a3fa3a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 1d894bed-14f0-4c87-a41b-a50cb8c0a61e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:39.546654 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2f0196d6-5a2e-4b0d-a70a-b05b18a3fa3a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:39.547469 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2f0196d6-5a2e-4b0d-a70a-b05b18a3fa3a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:39.548096 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2f0196d6-5a2e-4b0d-a70a-b05b18a3fa3a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:39.549413 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2f0196d6-5a2e-4b0d-a70a-b05b18a3fa3a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:39.550163 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2f0196d6-5a2e-4b0d-a70a-b05b18a3fa3a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:39.550753 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2f0196d6-5a2e-4b0d-a70a-b05b18a3fa3a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:39.602405 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2f0196d6-5a2e-4b0d-a70a-b05b18a3fa3a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 1d894bed-14f0-4c87-a41b-a50cb8c0a61e] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:16:39.774798 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2f0196d6-5a2e-4b0d-a70a-b05b18a3fa3a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1d894bed-14f0-4c87-a41b-a50cb8c0a61e" status: 204 len: 0 microversion: 2.1 time: 0.240216 Oct 26 13:16:39.780364 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1684/3368] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:16:39 2022] DELETE /compute/v2.1/servers/1d894bed-14f0-4c87-a41b-a50cb8c0a61e => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:16:39.796530 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7f58cfd7-6e50-4c51-86e8-02675b6b63e6 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:39.797890 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7f58cfd7-6e50-4c51-86e8-02675b6b63e6 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 1d894bed-14f0-4c87-a41b-a50cb8c0a61e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:39.813985 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f58cfd7-6e50-4c51-86e8-02675b6b63e6 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:39.814527 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f58cfd7-6e50-4c51-86e8-02675b6b63e6 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:39.815018 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f58cfd7-6e50-4c51-86e8-02675b6b63e6 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:39.815804 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f58cfd7-6e50-4c51-86e8-02675b6b63e6 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:39.816269 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f58cfd7-6e50-4c51-86e8-02675b6b63e6 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:39.816703 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f58cfd7-6e50-4c51-86e8-02675b6b63e6 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:39.939805 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c451fac6-4c86-4242-9298-8dafb79c42f6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:39.948281 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c451fac6-4c86-4242-9298-8dafb79c42f6 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8" status: 200 len: 1309 microversion: 2.1 time: 0.617543 Oct 26 13:16:39.955931 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1685/3369] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:39 2022] GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 => generated 1309 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:40.057080 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a7249e4f-cc28-4031-a610-a9601c8a75a7 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:40.058536 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a7249e4f-cc28-4031-a610-a9601c8a75a7 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 2c859d43-c102-4189-9e7a-6c88ff38f311] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:40.071401 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a7249e4f-cc28-4031-a610-a9601c8a75a7 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:40.072096 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a7249e4f-cc28-4031-a610-a9601c8a75a7 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:40.075420 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a7249e4f-cc28-4031-a610-a9601c8a75a7 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:40.078761 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a7249e4f-cc28-4031-a610-a9601c8a75a7 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:40.079385 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a7249e4f-cc28-4031-a610-a9601c8a75a7 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:40.080792 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a7249e4f-cc28-4031-a610-a9601c8a75a7 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:40.179629 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7f58cfd7-6e50-4c51-86e8-02675b6b63e6 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:40.189036 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7f58cfd7-6e50-4c51-86e8-02675b6b63e6 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/1d894bed-14f0-4c87-a41b-a50cb8c0a61e" status: 200 len: 1273 microversion: 2.1 time: 0.407248 Oct 26 13:16:40.192728 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1685/3370] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:39 2022] GET /compute/v2.1/servers/1d894bed-14f0-4c87-a41b-a50cb8c0a61e => generated 1273 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:40.564010 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9329f5e1-9bbd-4b02-a04e-7f079f5f56bb tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:40.565511 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9329f5e1-9bbd-4b02-a04e-7f079f5f56bb tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:40.765211 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a7249e4f-cc28-4031-a610-a9601c8a75a7 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:40.786695 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a7249e4f-cc28-4031-a610-a9601c8a75a7 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311" status: 200 len: 1367 microversion: 2.1 time: 0.725870 Oct 26 13:16:40.788567 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1686/3371] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:40 2022] GET /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311 => generated 1367 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:16:40.802866 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-c9f555cf-0615-4b9e-8d3c-0e2c7509a59f req-7da8601a-61d8-4e99-a3c8-c92885821a03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c859d43-c102-4189-9e7a-6c88ff38f311", "name": "network-vif-plugged", "status": "completed", "tag": "7b29700f-b95c-4338-847f-0573694835c8"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:16:40.837524 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9329f5e1-9bbd-4b02-a04e-7f079f5f56bb tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:40.852341 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9329f5e1-9bbd-4b02-a04e-7f079f5f56bb tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:40.863166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-c9f555cf-0615-4b9e-8d3c-0e2c7509a59f req-7da8601a-61d8-4e99-a3c8-c92885821a03 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:40.863901 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9329f5e1-9bbd-4b02-a04e-7f079f5f56bb tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:40.870294 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9329f5e1-9bbd-4b02-a04e-7f079f5f56bb tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1284 microversion: 2.32 time: 0.309675 Oct 26 13:16:40.871185 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-c9f555cf-0615-4b9e-8d3c-0e2c7509a59f req-7da8601a-61d8-4e99-a3c8-c92885821a03 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:40.871763 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-c9f555cf-0615-4b9e-8d3c-0e2c7509a59f req-7da8601a-61d8-4e99-a3c8-c92885821a03 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:40.873355 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1686/3372] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:16:40 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1284 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:16:40.933514 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-c9f555cf-0615-4b9e-8d3c-0e2c7509a59f req-7da8601a-61d8-4e99-a3c8-c92885821a03 service nova] Creating event network-vif-plugged:7b29700f-b95c-4338-847f-0573694835c8 for instance 2c859d43-c102-4189-9e7a-6c88ff38f311 on n-h2-862686-1 Oct 26 13:16:40.943335 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-c9f555cf-0615-4b9e-8d3c-0e2c7509a59f req-7da8601a-61d8-4e99-a3c8-c92885821a03 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152461 Oct 26 13:16:40.948799 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1687/3373] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:16:40.986316 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-56113b44-5325-4dc4-bb91-69644cb4af4b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:40.987137 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-56113b44-5325-4dc4-bb91-69644cb4af4b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:41.022144 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-56113b44-5325-4dc4-bb91-69644cb4af4b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:41.022674 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-56113b44-5325-4dc4-bb91-69644cb4af4b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:41.023152 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-56113b44-5325-4dc4-bb91-69644cb4af4b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:41.028152 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-56113b44-5325-4dc4-bb91-69644cb4af4b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:41.028670 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-56113b44-5325-4dc4-bb91-69644cb4af4b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:41.029165 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-56113b44-5325-4dc4-bb91-69644cb4af4b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:41.225470 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a0868b38-03fb-46d8-87ee-9f79a4d0e6a0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:41.227098 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a0868b38-03fb-46d8-87ee-9f79a4d0e6a0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 1d894bed-14f0-4c87-a41b-a50cb8c0a61e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:41.246331 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0868b38-03fb-46d8-87ee-9f79a4d0e6a0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:41.246821 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0868b38-03fb-46d8-87ee-9f79a4d0e6a0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:41.249389 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0868b38-03fb-46d8-87ee-9f79a4d0e6a0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:41.251484 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0868b38-03fb-46d8-87ee-9f79a4d0e6a0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:41.251925 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0868b38-03fb-46d8-87ee-9f79a4d0e6a0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:41.252378 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0868b38-03fb-46d8-87ee-9f79a4d0e6a0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:41.433642 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a0868b38-03fb-46d8-87ee-9f79a4d0e6a0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:41.449910 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a0868b38-03fb-46d8-87ee-9f79a4d0e6a0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/1d894bed-14f0-4c87-a41b-a50cb8c0a61e" status: 200 len: 1217 microversion: 2.1 time: 0.230456 Oct 26 13:16:41.450464 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1688/3374] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:41 2022] GET /compute/v2.1/servers/1d894bed-14f0-4c87-a41b-a50cb8c0a61e => generated 1217 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:16:41.822067 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-32f03acc-544f-49ee-b3ad-9427624ad39b tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:41.823277 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-32f03acc-544f-49ee-b3ad-9427624ad39b tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 2c859d43-c102-4189-9e7a-6c88ff38f311] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:41.839883 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32f03acc-544f-49ee-b3ad-9427624ad39b tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:41.841593 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32f03acc-544f-49ee-b3ad-9427624ad39b tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:41.844574 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32f03acc-544f-49ee-b3ad-9427624ad39b tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:41.845359 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32f03acc-544f-49ee-b3ad-9427624ad39b tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:41.845867 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32f03acc-544f-49ee-b3ad-9427624ad39b tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:41.846304 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32f03acc-544f-49ee-b3ad-9427624ad39b tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:42.181249 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-32f03acc-544f-49ee-b3ad-9427624ad39b tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:42.196855 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-32f03acc-544f-49ee-b3ad-9427624ad39b tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311" status: 200 len: 1367 microversion: 2.1 time: 0.381331 Oct 26 13:16:42.200078 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1689/3375] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:41 2022] GET /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311 => generated 1367 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:42.205063 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4bb97991-63d2-438d-880f-5930c40d14ed tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:42.205711 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4bb97991-63d2-438d-880f-5930c40d14ed tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:42.223074 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4bb97991-63d2-438d-880f-5930c40d14ed tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:42.223617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4bb97991-63d2-438d-880f-5930c40d14ed tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:42.224064 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4bb97991-63d2-438d-880f-5930c40d14ed tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:42.229992 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4bb97991-63d2-438d-880f-5930c40d14ed tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:42.230870 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4bb97991-63d2-438d-880f-5930c40d14ed tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:42.231330 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4bb97991-63d2-438d-880f-5930c40d14ed tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:42.253857 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-56113b44-5325-4dc4-bb91-69644cb4af4b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:42.265014 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-56113b44-5325-4dc4-bb91-69644cb4af4b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8" status: 200 len: 1309 microversion: 2.1 time: 1.283468 Oct 26 13:16:42.265668 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1687/3376] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:40 2022] GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 => generated 1309 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:42.472382 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e4c8da50-a50e-4bff-986a-df7f196fa877 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:42.473009 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e4c8da50-a50e-4bff-986a-df7f196fa877 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 1d894bed-14f0-4c87-a41b-a50cb8c0a61e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:42.482759 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e4c8da50-a50e-4bff-986a-df7f196fa877 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:42.483253 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e4c8da50-a50e-4bff-986a-df7f196fa877 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:42.483690 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e4c8da50-a50e-4bff-986a-df7f196fa877 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:42.495417 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e4c8da50-a50e-4bff-986a-df7f196fa877 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:42.498249 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e4c8da50-a50e-4bff-986a-df7f196fa877 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:42.501460 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e4c8da50-a50e-4bff-986a-df7f196fa877 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:42.902118 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e4c8da50-a50e-4bff-986a-df7f196fa877 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:42.909866 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4bb97991-63d2-438d-880f-5930c40d14ed tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:42.926727 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e4c8da50-a50e-4bff-986a-df7f196fa877 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/1d894bed-14f0-4c87-a41b-a50cb8c0a61e" status: 200 len: 1217 microversion: 2.1 time: 0.458257 Oct 26 13:16:42.941581 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1688/3377] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:42 2022] GET /compute/v2.1/servers/1d894bed-14f0-4c87-a41b-a50cb8c0a61e => generated 1217 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:16:42.941821 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4bb97991-63d2-438d-880f-5930c40d14ed tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:42.941821 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4bb97991-63d2-438d-880f-5930c40d14ed tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:42.941821 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4bb97991-63d2-438d-880f-5930c40d14ed tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1582 microversion: 2.32 time: 0.737515 Oct 26 13:16:42.952175 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1690/3378] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:16:42 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1582 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:16:43.222662 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fbf72869-766e-48f2-a9ff-76c4c421619e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:43.223346 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fbf72869-766e-48f2-a9ff-76c4c421619e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 2c859d43-c102-4189-9e7a-6c88ff38f311] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:43.245326 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fbf72869-766e-48f2-a9ff-76c4c421619e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:43.247071 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fbf72869-766e-48f2-a9ff-76c4c421619e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:43.249008 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fbf72869-766e-48f2-a9ff-76c4c421619e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:43.250473 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fbf72869-766e-48f2-a9ff-76c4c421619e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:43.250963 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fbf72869-766e-48f2-a9ff-76c4c421619e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:43.253054 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fbf72869-766e-48f2-a9ff-76c4c421619e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:43.292047 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fd3961f1-e376-40b0-b2e2-1a68c5e41a1d tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:43.292745 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fd3961f1-e376-40b0-b2e2-1a68c5e41a1d tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:43.308212 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd3961f1-e376-40b0-b2e2-1a68c5e41a1d tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:43.309987 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd3961f1-e376-40b0-b2e2-1a68c5e41a1d tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:43.310440 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd3961f1-e376-40b0-b2e2-1a68c5e41a1d tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:43.314694 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd3961f1-e376-40b0-b2e2-1a68c5e41a1d tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:43.316777 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd3961f1-e376-40b0-b2e2-1a68c5e41a1d tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:43.317390 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd3961f1-e376-40b0-b2e2-1a68c5e41a1d tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:43.843452 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fbf72869-766e-48f2-a9ff-76c4c421619e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:43.869124 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fbf72869-766e-48f2-a9ff-76c4c421619e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311" status: 200 len: 1367 microversion: 2.1 time: 0.651169 Oct 26 13:16:43.878204 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1689/3379] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:43 2022] GET /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311 => generated 1367 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:43.946933 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fd3961f1-e376-40b0-b2e2-1a68c5e41a1d tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:43.955070 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1d52fd33-0352-4a32-98b2-0b5a62a3d433 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:43.955803 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1d52fd33-0352-4a32-98b2-0b5a62a3d433 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 1d894bed-14f0-4c87-a41b-a50cb8c0a61e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:43.972617 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fd3961f1-e376-40b0-b2e2-1a68c5e41a1d tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8" status: 200 len: 1309 microversion: 2.1 time: 0.683303 Oct 26 13:16:43.973414 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d52fd33-0352-4a32-98b2-0b5a62a3d433 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:43.975409 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d52fd33-0352-4a32-98b2-0b5a62a3d433 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:43.976395 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d52fd33-0352-4a32-98b2-0b5a62a3d433 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:43.976811 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1691/3380] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:43 2022] GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 => generated 1309 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:16:43.979122 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d52fd33-0352-4a32-98b2-0b5a62a3d433 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:43.982837 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-690829f2-acc3-43c8-8c47-619d3d5cce80 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:43.983547 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d52fd33-0352-4a32-98b2-0b5a62a3d433 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:43.984143 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d52fd33-0352-4a32-98b2-0b5a62a3d433 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:43.988684 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-690829f2-acc3-43c8-8c47-619d3d5cce80 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:44.007973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-690829f2-acc3-43c8-8c47-619d3d5cce80 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:44.012593 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-690829f2-acc3-43c8-8c47-619d3d5cce80 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:44.013289 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-690829f2-acc3-43c8-8c47-619d3d5cce80 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:44.016064 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-690829f2-acc3-43c8-8c47-619d3d5cce80 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:44.016765 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-690829f2-acc3-43c8-8c47-619d3d5cce80 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:44.019227 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-690829f2-acc3-43c8-8c47-619d3d5cce80 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:44.149194 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1d52fd33-0352-4a32-98b2-0b5a62a3d433 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:44.163817 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1d52fd33-0352-4a32-98b2-0b5a62a3d433 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/1d894bed-14f0-4c87-a41b-a50cb8c0a61e" status: 200 len: 1219 microversion: 2.1 time: 0.213262 Oct 26 13:16:44.167620 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1690/3381] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:43 2022] GET /compute/v2.1/servers/1d894bed-14f0-4c87-a41b-a50cb8c0a61e => generated 1219 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:44.265238 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-690829f2-acc3-43c8-8c47-619d3d5cce80 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:44.301276 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-690829f2-acc3-43c8-8c47-619d3d5cce80 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:44.304368 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-690829f2-acc3-43c8-8c47-619d3d5cce80 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:44.312719 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-690829f2-acc3-43c8-8c47-619d3d5cce80 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1592 microversion: 2.32 time: 0.334368 Oct 26 13:16:44.314050 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1692/3382] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:16:43 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1592 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:16:44.772200 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-171b5ef9-5b38-407d-a6af-23e0b06651d4 req-765585d2-0380-45c8-bf6f-3f2ff1e00068 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8", "name": "network-vif-plugged", "status": "completed", "tag": "865dd839-e1fa-4d8d-bcd4-1b698f4e4b5f"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:16:44.810091 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-171b5ef9-5b38-407d-a6af-23e0b06651d4 req-765585d2-0380-45c8-bf6f-3f2ff1e00068 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:44.812309 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-171b5ef9-5b38-407d-a6af-23e0b06651d4 req-765585d2-0380-45c8-bf6f-3f2ff1e00068 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:44.816065 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-171b5ef9-5b38-407d-a6af-23e0b06651d4 req-765585d2-0380-45c8-bf6f-3f2ff1e00068 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:44.847498 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-171b5ef9-5b38-407d-a6af-23e0b06651d4 req-765585d2-0380-45c8-bf6f-3f2ff1e00068 service nova] Creating event network-vif-plugged:865dd839-e1fa-4d8d-bcd4-1b698f4e4b5f for instance 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 on n-h2-862686-1 Oct 26 13:16:44.861352 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-171b5ef9-5b38-407d-a6af-23e0b06651d4 req-765585d2-0380-45c8-bf6f-3f2ff1e00068 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094485 Oct 26 13:16:44.862294 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1691/3383] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:16:44.907944 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b0469a10-f65f-4957-9d6a-2b4d0d93e0cf tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:44.908746 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b0469a10-f65f-4957-9d6a-2b4d0d93e0cf tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 2c859d43-c102-4189-9e7a-6c88ff38f311] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:44.930032 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b0469a10-f65f-4957-9d6a-2b4d0d93e0cf tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:44.934435 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b0469a10-f65f-4957-9d6a-2b4d0d93e0cf tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:44.935060 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b0469a10-f65f-4957-9d6a-2b4d0d93e0cf tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:44.937354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b0469a10-f65f-4957-9d6a-2b4d0d93e0cf tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:44.938889 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b0469a10-f65f-4957-9d6a-2b4d0d93e0cf tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:44.941088 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b0469a10-f65f-4957-9d6a-2b4d0d93e0cf tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:45.005452 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b8b118c1-2af2-4015-8c0d-57d03c1d5ad7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:45.006356 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b8b118c1-2af2-4015-8c0d-57d03c1d5ad7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:45.035145 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8b118c1-2af2-4015-8c0d-57d03c1d5ad7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:45.036026 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8b118c1-2af2-4015-8c0d-57d03c1d5ad7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:45.038099 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8b118c1-2af2-4015-8c0d-57d03c1d5ad7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:45.039314 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8b118c1-2af2-4015-8c0d-57d03c1d5ad7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:45.054092 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8b118c1-2af2-4015-8c0d-57d03c1d5ad7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:45.054619 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8b118c1-2af2-4015-8c0d-57d03c1d5ad7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:45.655829 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b0469a10-f65f-4957-9d6a-2b4d0d93e0cf tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:45.672901 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b0469a10-f65f-4957-9d6a-2b4d0d93e0cf tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311" status: 200 len: 1558 microversion: 2.1 time: 0.764123 Oct 26 13:16:45.674081 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1693/3384] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:44 2022] GET /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311 => generated 1558 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:16:45.684718 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8f065c6d-d9ee-4ade-8aa3-3a60e09afa22 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:45.685346 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8f065c6d-d9ee-4ade-8aa3-3a60e09afa22 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 1d894bed-14f0-4c87-a41b-a50cb8c0a61e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:45.703813 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f065c6d-d9ee-4ade-8aa3-3a60e09afa22 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:45.707432 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f065c6d-d9ee-4ade-8aa3-3a60e09afa22 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:45.708006 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f065c6d-d9ee-4ade-8aa3-3a60e09afa22 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:45.708846 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f065c6d-d9ee-4ade-8aa3-3a60e09afa22 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:45.709377 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f065c6d-d9ee-4ade-8aa3-3a60e09afa22 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:45.710281 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f065c6d-d9ee-4ade-8aa3-3a60e09afa22 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:45.751606 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-8f065c6d-d9ee-4ade-8aa3-3a60e09afa22 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] HTTP exception thrown: Instance 1d894bed-14f0-4c87-a41b-a50cb8c0a61e could not be found. Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8f065c6d-d9ee-4ade-8aa3-3a60e09afa22 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Request method failure captured: Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/1d894bed-14f0-4c87-a41b-a50cb8c0a61e HTTP/1.1 Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTLTNOlsUS_LQCwMyQbAmNSS-N_AQOqf9a-vHlBM4RS64aXMIGczutoYb0yXKXV63kqVyJMbrGhj1O0dIymI3rB4OYRTseWpFfzGHfB9PKKsR2NnI_ukYFvVdYRwcazuK9kTcZsmuh-2k9d7Yqn3gprd7n0NXcu2P16gbCixvzOdrAQ Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: ece49f83e645408598655bece0873fd0 Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ece49f83e645408598655bece0873fd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ece49f83e645408598655bece0873fd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ece49f83e645408598655bece0873fd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ece49f83e645408598655bece0873fd0"}]}] Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: ece49f83e645408598655bece0873fd0 Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-DeleteServersTestJSON-1847538505-project Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 8d56acbbbc3545d19cbb80f4e349c763 Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-DeleteServersTestJSON-1847538505-project Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 1d894bed-14f0-4c87-a41b-a50cb8c0a61e could not be found. Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '1d894bed-14f0-4c87-a41b-a50cb8c0a61e'} Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d894bed-14f0-4c87-a41b-a50cb8c0a61e could not be found. Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d894bed-14f0-4c87-a41b-a50cb8c0a61e could not be found. Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:16:45.759757 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:45.765180 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:16:45.765180 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:16:45.765180 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:16:45.765180 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:16:45.765180 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:16:45.765180 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d894bed-14f0-4c87-a41b-a50cb8c0a61e could not be found. Oct 26 13:16:45.765180 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:16:45.769403 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8f065c6d-d9ee-4ade-8aa3-3a60e09afa22 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Returning 404 to user: Instance 1d894bed-14f0-4c87-a41b-a50cb8c0a61e could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:16:45.771166 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8f065c6d-d9ee-4ade-8aa3-3a60e09afa22 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/1d894bed-14f0-4c87-a41b-a50cb8c0a61e" status: 404 len: 111 microversion: 2.1 time: 0.095600 Oct 26 13:16:45.782789 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1694/3385] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:45 2022] GET /compute/v2.1/servers/1d894bed-14f0-4c87-a41b-a50cb8c0a61e => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:16:45.788985 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-edcf6fb6-54a8-4939-ac72-1fca304887e0 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:45.789998 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-edcf6fb6-54a8-4939-ac72-1fca304887e0 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:45.797937 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-edcf6fb6-54a8-4939-ac72-1fca304887e0 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:45.799560 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-edcf6fb6-54a8-4939-ac72-1fca304887e0 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:45.800863 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-edcf6fb6-54a8-4939-ac72-1fca304887e0 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:45.802614 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-edcf6fb6-54a8-4939-ac72-1fca304887e0 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:45.804706 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-edcf6fb6-54a8-4939-ac72-1fca304887e0 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:45.805827 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-edcf6fb6-54a8-4939-ac72-1fca304887e0 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:45.934853 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b8b118c1-2af2-4015-8c0d-57d03c1d5ad7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:45.938567 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:16:45.953360 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b8b118c1-2af2-4015-8c0d-57d03c1d5ad7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8" status: 200 len: 1309 microversion: 2.1 time: 0.948218 Oct 26 13:16:45.954959 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1692/3386] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:44 2022] GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 => generated 1309 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:46.021933 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ad9c692a-efb5-4344-a2d9-3e7838015e13 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:46.028052 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ad9c692a-efb5-4344-a2d9-3e7838015e13 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 2c859d43-c102-4189-9e7a-6c88ff38f311] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:46.079182 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad9c692a-efb5-4344-a2d9-3e7838015e13 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:46.083341 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad9c692a-efb5-4344-a2d9-3e7838015e13 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:46.085434 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad9c692a-efb5-4344-a2d9-3e7838015e13 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:46.090855 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad9c692a-efb5-4344-a2d9-3e7838015e13 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:46.094610 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad9c692a-efb5-4344-a2d9-3e7838015e13 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:46.098795 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad9c692a-efb5-4344-a2d9-3e7838015e13 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:46.524076 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ad9c692a-efb5-4344-a2d9-3e7838015e13 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.567624 Oct 26 13:16:46.524791 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1693/3387] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 26 13:16:45 2022] GET /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311/os-interface => generated 285 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:16:46.542271 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9f5cf4ae-f97f-47e4-8963-b9cd9fb3a578 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-20635222", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "cb59e2c8-6bcb-4fcf-b9e4-c01412b43c60"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:16:46.708600 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-9f5cf4ae-f97f-47e4-8963-b9cd9fb3a578 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] validate_networks() for [('cb59e2c8-6bcb-4fcf-b9e4-c01412b43c60', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:16:47.222771 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-edcf6fb6-54a8-4939-ac72-1fca304887e0 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:47.246532 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-edcf6fb6-54a8-4939-ac72-1fca304887e0 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:47.253571 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-edcf6fb6-54a8-4939-ac72-1fca304887e0 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:47.258154 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-edcf6fb6-54a8-4939-ac72-1fca304887e0 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1659 microversion: 2.32 time: 1.471190 Oct 26 13:16:47.260325 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1695/3388] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:16:45 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1659 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:16:47.281140 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-db2f1328-c48e-4ac4-9dca-9cc29f85782f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:47.284701 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-db2f1328-c48e-4ac4-9dca-9cc29f85782f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:47.305746 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db2f1328-c48e-4ac4-9dca-9cc29f85782f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:47.308296 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db2f1328-c48e-4ac4-9dca-9cc29f85782f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:47.308929 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db2f1328-c48e-4ac4-9dca-9cc29f85782f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:47.311198 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db2f1328-c48e-4ac4-9dca-9cc29f85782f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:47.315447 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db2f1328-c48e-4ac4-9dca-9cc29f85782f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:47.316072 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db2f1328-c48e-4ac4-9dca-9cc29f85782f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:47.652335 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:16:47.702426 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:16:48.019982 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-db2f1328-c48e-4ac4-9dca-9cc29f85782f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:48.044083 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-db2f1328-c48e-4ac4-9dca-9cc29f85782f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8" status: 200 len: 1488 microversion: 2.1 time: 0.772052 Oct 26 13:16:48.048587 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1696/3389] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:47 2022] GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 => generated 1488 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:48.073971 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a1f2297c-cf7b-48c5-b404-9817e2a0e770 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-2120352153"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:16:48.074352 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:16:48.077780 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a1f2297c-cf7b-48c5-b404-9817e2a0e770 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:48.100093 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a1f2297c-cf7b-48c5-b404-9817e2a0e770 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:48.100889 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a1f2297c-cf7b-48c5-b404-9817e2a0e770 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:48.101538 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a1f2297c-cf7b-48c5-b404-9817e2a0e770 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:48.102468 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a1f2297c-cf7b-48c5-b404-9817e2a0e770 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:48.107274 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a1f2297c-cf7b-48c5-b404-9817e2a0e770 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:48.113468 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a1f2297c-cf7b-48c5-b404-9817e2a0e770 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:48.261150 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a1f2297c-cf7b-48c5-b404-9817e2a0e770 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "PUT /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8" status: 200 len: 1073 microversion: 2.1 time: 0.191540 Oct 26 13:16:48.283259 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1697/3390] 10.222.0.40 () {60 vars in 1256 bytes} [Wed Oct 26 13:16:48 2022] PUT /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 => generated 1073 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:48.288639 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-319fc2df-8cd2-405a-8ba7-837fd8d6810a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:48.297760 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-319fc2df-8cd2-405a-8ba7-837fd8d6810a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:48.324337 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-319fc2df-8cd2-405a-8ba7-837fd8d6810a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:48.325119 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-319fc2df-8cd2-405a-8ba7-837fd8d6810a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:48.325765 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-319fc2df-8cd2-405a-8ba7-837fd8d6810a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:48.326668 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-319fc2df-8cd2-405a-8ba7-837fd8d6810a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:48.327493 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-319fc2df-8cd2-405a-8ba7-837fd8d6810a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:48.332528 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-319fc2df-8cd2-405a-8ba7-837fd8d6810a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:48.342939 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:16:48.827326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-319fc2df-8cd2-405a-8ba7-837fd8d6810a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:48.837301 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-319fc2df-8cd2-405a-8ba7-837fd8d6810a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:48.848705 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-319fc2df-8cd2-405a-8ba7-837fd8d6810a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:48.849965 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-319fc2df-8cd2-405a-8ba7-837fd8d6810a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1659 microversion: 2.32 time: 0.565327 Oct 26 13:16:48.862317 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1698/3391] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:16:48 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1659 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:16:48.862317 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0d7f4c11-b10a-411e-b95c-b740f8a8a814 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:48.862317 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0d7f4c11-b10a-411e-b95c-b740f8a8a814 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:48.878261 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d7f4c11-b10a-411e-b95c-b740f8a8a814 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:48.878768 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d7f4c11-b10a-411e-b95c-b740f8a8a814 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:48.889951 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d7f4c11-b10a-411e-b95c-b740f8a8a814 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:48.891262 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d7f4c11-b10a-411e-b95c-b740f8a8a814 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:48.892033 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d7f4c11-b10a-411e-b95c-b740f8a8a814 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:48.892819 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d7f4c11-b10a-411e-b95c-b740f8a8a814 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:49.913980 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-9f5cf4ae-f97f-47e4-8963-b9cd9fb3a578 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:16:49.914495 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-9f5cf4ae-f97f-47e4-8963-b9cd9fb3a578 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:16:49.914953 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-9f5cf4ae-f97f-47e4-8963-b9cd9fb3a578 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:16:49.915357 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-9f5cf4ae-f97f-47e4-8963-b9cd9fb3a578 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:16:49.915776 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-9f5cf4ae-f97f-47e4-8963-b9cd9fb3a578 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:16:49.942389 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0d7f4c11-b10a-411e-b95c-b740f8a8a814 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:49.943355 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f5cf4ae-f97f-47e4-8963-b9cd9fb3a578 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:49.944545 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f5cf4ae-f97f-47e4-8963-b9cd9fb3a578 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:49.945172 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f5cf4ae-f97f-47e4-8963-b9cd9fb3a578 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:49.947001 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f5cf4ae-f97f-47e4-8963-b9cd9fb3a578 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:49.948241 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f5cf4ae-f97f-47e4-8963-b9cd9fb3a578 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:49.948939 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f5cf4ae-f97f-47e4-8963-b9cd9fb3a578 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:49.961365 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0d7f4c11-b10a-411e-b95c-b740f8a8a814 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8" status: 200 len: 1499 microversion: 2.1 time: 1.109234 Oct 26 13:16:49.964366 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1699/3392] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:48 2022] GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 => generated 1499 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:49.969985 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f4e08787-f7f7-4c9a-b25a-c05298474feb tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:49.970798 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f4e08787-f7f7-4c9a-b25a-c05298474feb tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:49.978085 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4e08787-f7f7-4c9a-b25a-c05298474feb tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:49.990037 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4e08787-f7f7-4c9a-b25a-c05298474feb tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:49.990893 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4e08787-f7f7-4c9a-b25a-c05298474feb tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:49.991827 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4e08787-f7f7-4c9a-b25a-c05298474feb tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:49.992741 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4e08787-f7f7-4c9a-b25a-c05298474feb tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:49.993376 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4e08787-f7f7-4c9a-b25a-c05298474feb tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:50.020703 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-9f5cf4ae-f97f-47e4-8963-b9cd9fb3a578 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Getting quotas for project ece49f83e645408598655bece0873fd0. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:16:50.035503 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-9f5cf4ae-f97f-47e4-8963-b9cd9fb3a578 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Getting quotas for user 8d56acbbbc3545d19cbb80f4e349c763 and project ece49f83e645408598655bece0873fd0. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:16:50.076342 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9f5cf4ae-f97f-47e4-8963-b9cd9fb3a578 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:16:50.081188 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9f5cf4ae-f97f-47e4-8963-b9cd9fb3a578 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: c188efbd-a2ba-40c5-ad9e-8352eea04b8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:16:50.140760 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9f5cf4ae-f97f-47e4-8963-b9cd9fb3a578 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.613740 Oct 26 13:16:50.141353 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1694/3393] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:16:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 3616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:16:50.159176 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9463b360-c914-4396-8311-9b16888f362e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:50.165707 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9463b360-c914-4396-8311-9b16888f362e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:50.187496 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9463b360-c914-4396-8311-9b16888f362e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:50.190585 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9463b360-c914-4396-8311-9b16888f362e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:50.191055 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9463b360-c914-4396-8311-9b16888f362e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:50.191817 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9463b360-c914-4396-8311-9b16888f362e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:50.192250 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9463b360-c914-4396-8311-9b16888f362e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:50.192689 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9463b360-c914-4396-8311-9b16888f362e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:50.815170 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9463b360-c914-4396-8311-9b16888f362e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:50.827197 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9463b360-c914-4396-8311-9b16888f362e tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8" status: 200 len: 1499 microversion: 2.1 time: 0.684733 Oct 26 13:16:50.830414 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1695/3394] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:50 2022] GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 => generated 1499 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:50.847403 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f59405ef-19fd-4091-a1bb-86126c365ddb tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:50.851487 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f59405ef-19fd-4091-a1bb-86126c365ddb tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: c188efbd-a2ba-40c5-ad9e-8352eea04b8f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:51.057256 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f59405ef-19fd-4091-a1bb-86126c365ddb tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:51.067061 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f59405ef-19fd-4091-a1bb-86126c365ddb tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/c188efbd-a2ba-40c5-ad9e-8352eea04b8f" status: 200 len: 1213 microversion: 2.1 time: 0.233671 Oct 26 13:16:51.073248 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1696/3395] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:50 2022] GET /compute/v2.1/servers/c188efbd-a2ba-40c5-ad9e-8352eea04b8f => generated 1213 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:51.108543 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6ae5cb3d-a164-497e-a76d-1486877e1dd0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:16:51.131703 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ae5cb3d-a164-497e-a76d-1486877e1dd0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:51.140216 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ae5cb3d-a164-497e-a76d-1486877e1dd0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:51.143427 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ae5cb3d-a164-497e-a76d-1486877e1dd0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:51.170372 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f4e08787-f7f7-4c9a-b25a-c05298474feb tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:51.182826 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f4e08787-f7f7-4c9a-b25a-c05298474feb tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:51.187103 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f4e08787-f7f7-4c9a-b25a-c05298474feb tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:51.189660 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f4e08787-f7f7-4c9a-b25a-c05298474feb tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1705 microversion: 2.32 time: 1.223942 Oct 26 13:16:51.194168 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1700/3396] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:16:49 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1705 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:16:51.204948 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-f247d8c4-d2d6-4727-8bdf-99e75e73d508 req-84e3003d-1b45-4e27-aa34-923063ec8428 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c859d43-c102-4189-9e7a-6c88ff38f311", "tag": "7b29700f-b95c-4338-847f-0573694835c8"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:16:51.227286 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6ae5cb3d-a164-497e-a76d-1486877e1dd0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8] Going to try to stop instance {{(pid=120597) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 26 13:16:51.239671 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f247d8c4-d2d6-4727-8bdf-99e75e73d508 req-84e3003d-1b45-4e27-aa34-923063ec8428 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:51.240541 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f247d8c4-d2d6-4727-8bdf-99e75e73d508 req-84e3003d-1b45-4e27-aa34-923063ec8428 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:51.241198 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f247d8c4-d2d6-4727-8bdf-99e75e73d508 req-84e3003d-1b45-4e27-aa34-923063ec8428 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:51.256680 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-f247d8c4-d2d6-4727-8bdf-99e75e73d508 req-84e3003d-1b45-4e27-aa34-923063ec8428 service nova] Creating event network-changed:7b29700f-b95c-4338-847f-0573694835c8 for instance 2c859d43-c102-4189-9e7a-6c88ff38f311 on n-h2-862686-1 Oct 26 13:16:51.263049 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-f247d8c4-d2d6-4727-8bdf-99e75e73d508 req-84e3003d-1b45-4e27-aa34-923063ec8428 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066259 Oct 26 13:16:51.268494 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1701/3397] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:16:51.323071 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6ae5cb3d-a164-497e-a76d-1486877e1dd0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "POST /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8/action" status: 202 len: 0 microversion: 2.1 time: 0.235469 Oct 26 13:16:51.330486 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1697/3398] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:16:51 2022] POST /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:16:51.339561 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e4d0b9f3-f660-41ca-9e53-c2faad1eb9ec tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:51.340678 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e4d0b9f3-f660-41ca-9e53-c2faad1eb9ec tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:51.354016 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4d0b9f3-f660-41ca-9e53-c2faad1eb9ec tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:51.359693 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4d0b9f3-f660-41ca-9e53-c2faad1eb9ec tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:51.360437 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4d0b9f3-f660-41ca-9e53-c2faad1eb9ec tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:51.361352 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4d0b9f3-f660-41ca-9e53-c2faad1eb9ec tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:51.365439 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4d0b9f3-f660-41ca-9e53-c2faad1eb9ec tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:51.366293 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4d0b9f3-f660-41ca-9e53-c2faad1eb9ec tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:52.204130 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e4d0b9f3-f660-41ca-9e53-c2faad1eb9ec tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:52.263014 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e4d0b9f3-f660-41ca-9e53-c2faad1eb9ec tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8" status: 200 len: 1509 microversion: 2.1 time: 0.925097 Oct 26 13:16:52.266158 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1702/3399] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:51 2022] GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 => generated 1509 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:16:52.310328 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6988d3e6-2f56-4c6a-bccd-f920ad1fbaa1 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:52.311396 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6988d3e6-2f56-4c6a-bccd-f920ad1fbaa1 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: c188efbd-a2ba-40c5-ad9e-8352eea04b8f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:52.324197 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6988d3e6-2f56-4c6a-bccd-f920ad1fbaa1 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:52.325315 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6988d3e6-2f56-4c6a-bccd-f920ad1fbaa1 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:52.327774 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6988d3e6-2f56-4c6a-bccd-f920ad1fbaa1 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:52.329855 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6988d3e6-2f56-4c6a-bccd-f920ad1fbaa1 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:52.331939 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6988d3e6-2f56-4c6a-bccd-f920ad1fbaa1 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:52.333242 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6988d3e6-2f56-4c6a-bccd-f920ad1fbaa1 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:52.510308 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ced203cb-42d6-4346-a850-3c152a5d6d81 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1105461001", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:16:52.638247 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-ced203cb-42d6-4346-a850-3c152a5d6d81 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] validate_networks() for [('2ceab633-30cd-49f2-a9d6-d02f524955d7', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:16:52.704023 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6988d3e6-2f56-4c6a-bccd-f920ad1fbaa1 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:52.720299 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6988d3e6-2f56-4c6a-bccd-f920ad1fbaa1 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/c188efbd-a2ba-40c5-ad9e-8352eea04b8f" status: 200 len: 1265 microversion: 2.1 time: 0.430218 Oct 26 13:16:52.720922 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1703/3400] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:52 2022] GET /compute/v2.1/servers/c188efbd-a2ba-40c5-ad9e-8352eea04b8f => generated 1265 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:52.763773 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d570b97b-d05b-4c54-b8a4-91b528db8bf7 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:52.765920 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d570b97b-d05b-4c54-b8a4-91b528db8bf7 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:52.783722 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d570b97b-d05b-4c54-b8a4-91b528db8bf7 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:52.789906 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d570b97b-d05b-4c54-b8a4-91b528db8bf7 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:52.795268 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d570b97b-d05b-4c54-b8a4-91b528db8bf7 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:52.796046 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d570b97b-d05b-4c54-b8a4-91b528db8bf7 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:52.796524 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d570b97b-d05b-4c54-b8a4-91b528db8bf7 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:52.801810 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d570b97b-d05b-4c54-b8a4-91b528db8bf7 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:53.525497 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d570b97b-d05b-4c54-b8a4-91b528db8bf7 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:53.549218 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d570b97b-d05b-4c54-b8a4-91b528db8bf7 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:53.551194 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d570b97b-d05b-4c54-b8a4-91b528db8bf7 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:53.552401 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d570b97b-d05b-4c54-b8a4-91b528db8bf7 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1751 microversion: 2.32 time: 0.818840 Oct 26 13:16:53.562614 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1704/3401] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:16:52 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1751 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:16:53.587999 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ef355a16-d7de-442f-83dd-08f0b4b7a2c0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:53.588809 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ef355a16-d7de-442f-83dd-08f0b4b7a2c0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:53.627772 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef355a16-d7de-442f-83dd-08f0b4b7a2c0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:53.628324 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef355a16-d7de-442f-83dd-08f0b4b7a2c0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:53.628787 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef355a16-d7de-442f-83dd-08f0b4b7a2c0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:53.638151 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef355a16-d7de-442f-83dd-08f0b4b7a2c0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:53.638667 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef355a16-d7de-442f-83dd-08f0b4b7a2c0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:53.639112 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef355a16-d7de-442f-83dd-08f0b4b7a2c0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:54.091095 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-ced203cb-42d6-4346-a850-3c152a5d6d81 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:16:54.091650 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-ced203cb-42d6-4346-a850-3c152a5d6d81 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:16:54.092548 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-ced203cb-42d6-4346-a850-3c152a5d6d81 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:16:54.093190 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-ced203cb-42d6-4346-a850-3c152a5d6d81 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:16:54.093936 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-ced203cb-42d6-4346-a850-3c152a5d6d81 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:16:54.116637 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ced203cb-42d6-4346-a850-3c152a5d6d81 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:54.125887 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ced203cb-42d6-4346-a850-3c152a5d6d81 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:54.126479 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ced203cb-42d6-4346-a850-3c152a5d6d81 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:54.127526 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ced203cb-42d6-4346-a850-3c152a5d6d81 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:54.128792 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ced203cb-42d6-4346-a850-3c152a5d6d81 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:54.131318 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ced203cb-42d6-4346-a850-3c152a5d6d81 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:54.206435 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-ced203cb-42d6-4346-a850-3c152a5d6d81 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Getting quotas for project 99b33dc51c4e489ea14f20bc582aa259. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:16:54.208546 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:16:54.241226 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-ced203cb-42d6-4346-a850-3c152a5d6d81 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Getting quotas for user f35fb6e657dd4799b6928ffb97b24c2d and project 99b33dc51c4e489ea14f20bc582aa259. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:16:54.291916 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ced203cb-42d6-4346-a850-3c152a5d6d81 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:16:54.296798 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ced203cb-42d6-4346-a850-3c152a5d6d81 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: b29a1a98-a428-4967-bc4a-237971dcd264] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:16:54.439752 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ced203cb-42d6-4346-a850-3c152a5d6d81 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.369362 Oct 26 13:16:54.441923 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1698/3402] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:16:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 2372 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:16:54.460398 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-41ffb126-2115-49a9-a5b2-a849d0651a89 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:54.463959 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-41ffb126-2115-49a9-a5b2-a849d0651a89 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: c188efbd-a2ba-40c5-ad9e-8352eea04b8f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:54.485471 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41ffb126-2115-49a9-a5b2-a849d0651a89 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:54.486359 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41ffb126-2115-49a9-a5b2-a849d0651a89 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:54.487080 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41ffb126-2115-49a9-a5b2-a849d0651a89 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:54.488054 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41ffb126-2115-49a9-a5b2-a849d0651a89 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:54.488744 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41ffb126-2115-49a9-a5b2-a849d0651a89 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:54.492758 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41ffb126-2115-49a9-a5b2-a849d0651a89 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:54.636435 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ef355a16-d7de-442f-83dd-08f0b4b7a2c0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:54.647332 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ef355a16-d7de-442f-83dd-08f0b4b7a2c0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8" status: 200 len: 1509 microversion: 2.1 time: 1.083821 Oct 26 13:16:54.648008 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1705/3403] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:53 2022] GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 => generated 1509 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:54.652644 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8965b751-4e4f-4e5d-bc5d-88411297e4d4 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:54.653244 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8965b751-4e4f-4e5d-bc5d-88411297e4d4 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: b29a1a98-a428-4967-bc4a-237971dcd264] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:54.760337 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-41ffb126-2115-49a9-a5b2-a849d0651a89 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:54.777154 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-41ffb126-2115-49a9-a5b2-a849d0651a89 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/c188efbd-a2ba-40c5-ad9e-8352eea04b8f" status: 200 len: 1271 microversion: 2.1 time: 0.333124 Oct 26 13:16:54.778328 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1699/3404] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:54 2022] GET /compute/v2.1/servers/c188efbd-a2ba-40c5-ad9e-8352eea04b8f => generated 1271 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:54.789945 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-493bcd16-faa9-41d4-a805-e57d3a7fe70b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:54.790673 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-493bcd16-faa9-41d4-a805-e57d3a7fe70b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:54.810669 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-493bcd16-faa9-41d4-a805-e57d3a7fe70b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:54.811184 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-493bcd16-faa9-41d4-a805-e57d3a7fe70b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:54.814918 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-493bcd16-faa9-41d4-a805-e57d3a7fe70b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:54.816130 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-493bcd16-faa9-41d4-a805-e57d3a7fe70b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:54.818987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-493bcd16-faa9-41d4-a805-e57d3a7fe70b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:54.819747 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-493bcd16-faa9-41d4-a805-e57d3a7fe70b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:54.926158 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8965b751-4e4f-4e5d-bc5d-88411297e4d4 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:54.939024 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8965b751-4e4f-4e5d-bc5d-88411297e4d4 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264" status: 200 len: 1214 microversion: 2.1 time: 0.289001 Oct 26 13:16:54.939632 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1706/3405] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:54 2022] GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264 => generated 1214 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:55.234357 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-493bcd16-faa9-41d4-a805-e57d3a7fe70b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:55.244337 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-493bcd16-faa9-41d4-a805-e57d3a7fe70b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:55.245765 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-493bcd16-faa9-41d4-a805-e57d3a7fe70b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:55.246893 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-493bcd16-faa9-41d4-a805-e57d3a7fe70b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1751 microversion: 2.32 time: 0.466967 Oct 26 13:16:55.260754 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1700/3406] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:16:54 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1751 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:16:55.676401 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-02cd5313-349a-46d1-ac1f-e48d43fc7cae tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:55.677018 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-02cd5313-349a-46d1-ac1f-e48d43fc7cae tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:55.696047 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02cd5313-349a-46d1-ac1f-e48d43fc7cae tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:55.696543 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02cd5313-349a-46d1-ac1f-e48d43fc7cae tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:55.696976 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02cd5313-349a-46d1-ac1f-e48d43fc7cae tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:55.702883 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02cd5313-349a-46d1-ac1f-e48d43fc7cae tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:55.703441 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02cd5313-349a-46d1-ac1f-e48d43fc7cae tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:55.703884 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02cd5313-349a-46d1-ac1f-e48d43fc7cae tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:55.804075 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3a7961ef-97ac-47f4-858a-4acede9611be tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:55.804788 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3a7961ef-97ac-47f4-858a-4acede9611be tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: c188efbd-a2ba-40c5-ad9e-8352eea04b8f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:55.817019 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a7961ef-97ac-47f4-858a-4acede9611be tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:55.817534 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a7961ef-97ac-47f4-858a-4acede9611be tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:55.818005 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a7961ef-97ac-47f4-858a-4acede9611be tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:55.818702 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a7961ef-97ac-47f4-858a-4acede9611be tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:55.819165 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a7961ef-97ac-47f4-858a-4acede9611be tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:55.819597 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a7961ef-97ac-47f4-858a-4acede9611be tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:56.550900 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-02cd5313-349a-46d1-ac1f-e48d43fc7cae tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:56.567544 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-02cd5313-349a-46d1-ac1f-e48d43fc7cae tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8" status: 200 len: 1509 microversion: 2.1 time: 0.894940 Oct 26 13:16:56.584784 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1707/3407] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:55 2022] GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 => generated 1509 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:56.602023 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d733e360-2ce4-4980-acef-ac4195bbc3c1 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1880531295", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "4f5cd804-e666-4be2-8848-0a3733eede9c"}], "block_device_mapping_v2": [{"uuid": "07975007-709c-451f-a99a-9ab0cf6bc492", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:16:56.769742 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-d733e360-2ce4-4980-acef-ac4195bbc3c1 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] validate_networks() for [('4f5cd804-e666-4be2-8848-0a3733eede9c', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:16:56.802548 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3a7961ef-97ac-47f4-858a-4acede9611be tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:56.822094 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3a7961ef-97ac-47f4-858a-4acede9611be tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/c188efbd-a2ba-40c5-ad9e-8352eea04b8f" status: 200 len: 1313 microversion: 2.1 time: 1.020099 Oct 26 13:16:56.826651 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1701/3408] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:55 2022] GET /compute/v2.1/servers/c188efbd-a2ba-40c5-ad9e-8352eea04b8f => generated 1313 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:56.845523 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e91f6f51-bd7c-4d31-b6ea-4018774a52b8 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:56.849292 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e91f6f51-bd7c-4d31-b6ea-4018774a52b8 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: b29a1a98-a428-4967-bc4a-237971dcd264] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:56.879886 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e91f6f51-bd7c-4d31-b6ea-4018774a52b8 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:56.884048 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e91f6f51-bd7c-4d31-b6ea-4018774a52b8 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:56.885333 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e91f6f51-bd7c-4d31-b6ea-4018774a52b8 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:56.886189 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e91f6f51-bd7c-4d31-b6ea-4018774a52b8 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:56.886673 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e91f6f51-bd7c-4d31-b6ea-4018774a52b8 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:56.892114 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e91f6f51-bd7c-4d31-b6ea-4018774a52b8 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:57.799383 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e91f6f51-bd7c-4d31-b6ea-4018774a52b8 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:57.820850 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e91f6f51-bd7c-4d31-b6ea-4018774a52b8 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264" status: 200 len: 1274 microversion: 2.1 time: 0.992715 Oct 26 13:16:57.822232 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1702/3409] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:56 2022] GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264 => generated 1274 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:57.827434 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dba34de3-9291-4586-afbf-9c5779dc3288 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:57.828282 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-dba34de3-9291-4586-afbf-9c5779dc3288 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:57.843760 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dba34de3-9291-4586-afbf-9c5779dc3288 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:57.844256 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dba34de3-9291-4586-afbf-9c5779dc3288 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:57.844699 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dba34de3-9291-4586-afbf-9c5779dc3288 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:57.845403 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dba34de3-9291-4586-afbf-9c5779dc3288 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:57.864416 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dba34de3-9291-4586-afbf-9c5779dc3288 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:57.864878 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dba34de3-9291-4586-afbf-9c5779dc3288 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:58.132730 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-d733e360-2ce4-4980-acef-ac4195bbc3c1 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:16:58.136048 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-d733e360-2ce4-4980-acef-ac4195bbc3c1 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:16:58.137513 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-d733e360-2ce4-4980-acef-ac4195bbc3c1 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:16:58.145605 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-d733e360-2ce4-4980-acef-ac4195bbc3c1 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:16:58.147491 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-d733e360-2ce4-4980-acef-ac4195bbc3c1 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:16:58.163319 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d733e360-2ce4-4980-acef-ac4195bbc3c1 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:58.163938 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d733e360-2ce4-4980-acef-ac4195bbc3c1 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:58.167646 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d733e360-2ce4-4980-acef-ac4195bbc3c1 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:58.173825 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d733e360-2ce4-4980-acef-ac4195bbc3c1 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:58.190245 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d733e360-2ce4-4980-acef-ac4195bbc3c1 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:58.194538 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d733e360-2ce4-4980-acef-ac4195bbc3c1 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:58.271666 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-d733e360-2ce4-4980-acef-ac4195bbc3c1 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Getting quotas for project 4f1ce8734839480ca6b07416a9c6d9c3. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:16:58.284943 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-d733e360-2ce4-4980-acef-ac4195bbc3c1 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Getting quotas for user f96da2e13ca64db2a16d58aee1fc921d and project 4f1ce8734839480ca6b07416a9c6d9c3. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:16:58.398748 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d733e360-2ce4-4980-acef-ac4195bbc3c1 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:16:58.402162 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d733e360-2ce4-4980-acef-ac4195bbc3c1 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='07975007-709c-451f-a99a-9ab0cf6bc492',volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:16:58.568201 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:16:58.606388 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d733e360-2ce4-4980-acef-ac4195bbc3c1 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.018440 Oct 26 13:16:58.609456 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1708/3410] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:16:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:16:58.622190 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6ce2558c-7190-4b88-944c-ec9cbe9713dc tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:58.623270 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6ce2558c-7190-4b88-944c-ec9cbe9713dc tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:58.636977 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ce2558c-7190-4b88-944c-ec9cbe9713dc tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:58.637503 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ce2558c-7190-4b88-944c-ec9cbe9713dc tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:58.637945 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ce2558c-7190-4b88-944c-ec9cbe9713dc tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:58.641439 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ce2558c-7190-4b88-944c-ec9cbe9713dc tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:58.645244 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ce2558c-7190-4b88-944c-ec9cbe9713dc tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:58.646977 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ce2558c-7190-4b88-944c-ec9cbe9713dc tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:58.882806 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-dba34de3-9291-4586-afbf-9c5779dc3288 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:58.896290 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-dba34de3-9291-4586-afbf-9c5779dc3288 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:58.898737 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-dba34de3-9291-4586-afbf-9c5779dc3288 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:58.900931 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-dba34de3-9291-4586-afbf-9c5779dc3288 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1843 microversion: 2.32 time: 1.077327 Oct 26 13:16:58.914495 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1703/3411] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:16:57 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1843 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:16:58.927394 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a4788d1c-568b-4f82-b8b4-0a55e8cf0890 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:58.928338 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a4788d1c-568b-4f82-b8b4-0a55e8cf0890 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: c188efbd-a2ba-40c5-ad9e-8352eea04b8f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:58.936153 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4788d1c-568b-4f82-b8b4-0a55e8cf0890 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:58.936848 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4788d1c-568b-4f82-b8b4-0a55e8cf0890 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:58.937525 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4788d1c-568b-4f82-b8b4-0a55e8cf0890 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:58.938428 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4788d1c-568b-4f82-b8b4-0a55e8cf0890 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:58.939087 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4788d1c-568b-4f82-b8b4-0a55e8cf0890 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:58.939712 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4788d1c-568b-4f82-b8b4-0a55e8cf0890 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:59.181061 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6ce2558c-7190-4b88-944c-ec9cbe9713dc tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:59.195141 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6ce2558c-7190-4b88-944c-ec9cbe9713dc tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8" status: 200 len: 1509 microversion: 2.1 time: 0.584190 Oct 26 13:16:59.198513 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1709/3412] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:58 2022] GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 => generated 1509 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:59.226852 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e6111dec-a755-4ad9-b291-bc30fcbe7ab8 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:59.231827 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e6111dec-a755-4ad9-b291-bc30fcbe7ab8 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:59.379309 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e6111dec-a755-4ad9-b291-bc30fcbe7ab8 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:59.399694 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e6111dec-a755-4ad9-b291-bc30fcbe7ab8 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1053 microversion: 2.1 time: 0.198951 Oct 26 13:16:59.432906 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1710/3413] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:59 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1053 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:59.440059 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d6ac07eb-13f1-48c6-a617-86db991ce3a1 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:59.440702 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d6ac07eb-13f1-48c6-a617-86db991ce3a1 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: b29a1a98-a428-4967-bc4a-237971dcd264] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:59.463709 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6ac07eb-13f1-48c6-a617-86db991ce3a1 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:59.464217 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6ac07eb-13f1-48c6-a617-86db991ce3a1 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:59.476440 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6ac07eb-13f1-48c6-a617-86db991ce3a1 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:59.477395 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6ac07eb-13f1-48c6-a617-86db991ce3a1 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:59.477926 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6ac07eb-13f1-48c6-a617-86db991ce3a1 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:59.479120 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6ac07eb-13f1-48c6-a617-86db991ce3a1 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:59.586895 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a4788d1c-568b-4f82-b8b4-0a55e8cf0890 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:59.603006 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a4788d1c-568b-4f82-b8b4-0a55e8cf0890 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/c188efbd-a2ba-40c5-ad9e-8352eea04b8f" status: 200 len: 1313 microversion: 2.1 time: 0.687115 Oct 26 13:16:59.604573 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1704/3414] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:58 2022] GET /compute/v2.1/servers/c188efbd-a2ba-40c5-ad9e-8352eea04b8f => generated 1313 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:59.618234 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d6ac07eb-13f1-48c6-a617-86db991ce3a1 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:16:59.625110 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d6ac07eb-13f1-48c6-a617-86db991ce3a1 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264" status: 200 len: 1272 microversion: 2.1 time: 0.188100 Oct 26 13:16:59.628914 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1711/3415] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:16:59 2022] GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264 => generated 1272 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:16:59.931572 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e321a6ea-98dd-4779-87e5-db91835648ca tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:16:59.932233 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e321a6ea-98dd-4779-87e5-db91835648ca tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:16:59.942826 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e321a6ea-98dd-4779-87e5-db91835648ca tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:59.943327 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e321a6ea-98dd-4779-87e5-db91835648ca tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:59.943776 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e321a6ea-98dd-4779-87e5-db91835648ca tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:16:59.944793 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e321a6ea-98dd-4779-87e5-db91835648ca tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:16:59.944962 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e321a6ea-98dd-4779-87e5-db91835648ca tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:16:59.948011 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e321a6ea-98dd-4779-87e5-db91835648ca tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:00.071337 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-57892b8a-7b27-4547-a425-54618f1d3187 req-ae3acc71-780d-4e25-ab06-2120ebff264a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "893420b7-27d9-4240-8182-87dd3231cbe2", "tag": "fdc12d04-26b7-4153-91a7-171ed0f8798d"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:17:00.092765 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-57892b8a-7b27-4547-a425-54618f1d3187 req-ae3acc71-780d-4e25-ab06-2120ebff264a service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:00.101891 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-57892b8a-7b27-4547-a425-54618f1d3187 req-ae3acc71-780d-4e25-ab06-2120ebff264a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:00.102673 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-57892b8a-7b27-4547-a425-54618f1d3187 req-ae3acc71-780d-4e25-ab06-2120ebff264a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:00.139573 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-57892b8a-7b27-4547-a425-54618f1d3187 req-ae3acc71-780d-4e25-ab06-2120ebff264a service nova] Creating event network-changed:fdc12d04-26b7-4153-91a7-171ed0f8798d for instance 893420b7-27d9-4240-8182-87dd3231cbe2 on n-h1-862686-1 Oct 26 13:17:00.154472 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-57892b8a-7b27-4547-a425-54618f1d3187 req-ae3acc71-780d-4e25-ab06-2120ebff264a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088774 Oct 26 13:17:00.155674 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1712/3416] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:17:00.223101 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cbbe9836-485a-43b3-81dd-3050cea11f98 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:00.224592 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cbbe9836-485a-43b3-81dd-3050cea11f98 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:00.236591 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cbbe9836-485a-43b3-81dd-3050cea11f98 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:00.238664 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cbbe9836-485a-43b3-81dd-3050cea11f98 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:00.239368 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cbbe9836-485a-43b3-81dd-3050cea11f98 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:00.242608 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cbbe9836-485a-43b3-81dd-3050cea11f98 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:00.245617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cbbe9836-485a-43b3-81dd-3050cea11f98 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:00.246419 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cbbe9836-485a-43b3-81dd-3050cea11f98 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:00.709279 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e321a6ea-98dd-4779-87e5-db91835648ca tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:00.719409 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e321a6ea-98dd-4779-87e5-db91835648ca tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:00.721355 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e321a6ea-98dd-4779-87e5-db91835648ca tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:00.722853 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e321a6ea-98dd-4779-87e5-db91835648ca tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1843 microversion: 2.32 time: 0.795339 Oct 26 13:17:00.733945 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1705/3417] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:16:59 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1843 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:17:00.748614 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-163c710e-177f-441a-b7db-acef32733a3f req-7cfd69a2-b0d7-4342-bb5a-c2b3f177aba0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c188efbd-a2ba-40c5-ad9e-8352eea04b8f", "tag": "0e6f8688-de29-4b32-9dc4-f97b8fc35edd"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:17:00.759317 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-163c710e-177f-441a-b7db-acef32733a3f req-7cfd69a2-b0d7-4342-bb5a-c2b3f177aba0 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:00.760325 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-163c710e-177f-441a-b7db-acef32733a3f req-7cfd69a2-b0d7-4342-bb5a-c2b3f177aba0 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:00.761034 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-163c710e-177f-441a-b7db-acef32733a3f req-7cfd69a2-b0d7-4342-bb5a-c2b3f177aba0 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:00.778054 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-163c710e-177f-441a-b7db-acef32733a3f req-7cfd69a2-b0d7-4342-bb5a-c2b3f177aba0 service nova] Creating event network-changed:0e6f8688-de29-4b32-9dc4-f97b8fc35edd for instance c188efbd-a2ba-40c5-ad9e-8352eea04b8f on n-h1-862686-1 Oct 26 13:17:00.786718 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-163c710e-177f-441a-b7db-acef32733a3f req-7cfd69a2-b0d7-4342-bb5a-c2b3f177aba0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050779 Oct 26 13:17:00.787905 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1706/3418] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:17:00.794463 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-18bd4be7-26e5-47b6-899f-c455650d252f tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:00.795516 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-18bd4be7-26e5-47b6-899f-c455650d252f tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:00.819350 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18bd4be7-26e5-47b6-899f-c455650d252f tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:00.820404 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18bd4be7-26e5-47b6-899f-c455650d252f tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:00.821237 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18bd4be7-26e5-47b6-899f-c455650d252f tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:00.822312 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18bd4be7-26e5-47b6-899f-c455650d252f tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:00.823047 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18bd4be7-26e5-47b6-899f-c455650d252f tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:00.823645 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18bd4be7-26e5-47b6-899f-c455650d252f tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:01.007656 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-18bd4be7-26e5-47b6-899f-c455650d252f tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:01.036812 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-18bd4be7-26e5-47b6-899f-c455650d252f tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1169 microversion: 2.1 time: 0.247379 Oct 26 13:17:01.039508 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1707/3419] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:00 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1169 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:01.051708 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6bb30d36-3f15-4f11-acb3-21ef81fb2434 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:01.052947 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6bb30d36-3f15-4f11-acb3-21ef81fb2434 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: c188efbd-a2ba-40c5-ad9e-8352eea04b8f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:01.080030 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6bb30d36-3f15-4f11-acb3-21ef81fb2434 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:01.080589 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6bb30d36-3f15-4f11-acb3-21ef81fb2434 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:01.081052 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6bb30d36-3f15-4f11-acb3-21ef81fb2434 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:01.081847 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6bb30d36-3f15-4f11-acb3-21ef81fb2434 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:01.082318 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6bb30d36-3f15-4f11-acb3-21ef81fb2434 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:01.082751 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6bb30d36-3f15-4f11-acb3-21ef81fb2434 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:01.109909 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-cbbe9836-485a-43b3-81dd-3050cea11f98 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:01.128033 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cbbe9836-485a-43b3-81dd-3050cea11f98 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8" status: 200 len: 1509 microversion: 2.1 time: 0.907224 Oct 26 13:17:01.129643 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1713/3420] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:00 2022] GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 => generated 1509 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:01.151543 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b96f6455-beb0-41f6-bd1c-1d500b801c82 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:01.153150 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b96f6455-beb0-41f6-bd1c-1d500b801c82 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: b29a1a98-a428-4967-bc4a-237971dcd264] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:01.160822 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b96f6455-beb0-41f6-bd1c-1d500b801c82 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:01.162259 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b96f6455-beb0-41f6-bd1c-1d500b801c82 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:01.163661 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b96f6455-beb0-41f6-bd1c-1d500b801c82 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:01.164584 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b96f6455-beb0-41f6-bd1c-1d500b801c82 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:01.168045 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b96f6455-beb0-41f6-bd1c-1d500b801c82 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:01.169450 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b96f6455-beb0-41f6-bd1c-1d500b801c82 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:01.504036 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b96f6455-beb0-41f6-bd1c-1d500b801c82 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:01.517325 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b96f6455-beb0-41f6-bd1c-1d500b801c82 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264" status: 200 len: 1272 microversion: 2.1 time: 0.383214 Oct 26 13:17:01.520880 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1714/3421] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:01 2022] GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264 => generated 1272 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:01.759187 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-262e3114-93a5-47ab-98ee-38b1e4aea05e tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:01.760375 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-262e3114-93a5-47ab-98ee-38b1e4aea05e tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:01.770459 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-262e3114-93a5-47ab-98ee-38b1e4aea05e tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:01.771572 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-262e3114-93a5-47ab-98ee-38b1e4aea05e tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:01.772322 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-262e3114-93a5-47ab-98ee-38b1e4aea05e tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:01.773628 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-262e3114-93a5-47ab-98ee-38b1e4aea05e tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:01.774563 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-262e3114-93a5-47ab-98ee-38b1e4aea05e tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:01.776568 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-262e3114-93a5-47ab-98ee-38b1e4aea05e tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:02.121413 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-262e3114-93a5-47ab-98ee-38b1e4aea05e tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:02.151092 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-262e3114-93a5-47ab-98ee-38b1e4aea05e tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:02.158008 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-262e3114-93a5-47ab-98ee-38b1e4aea05e tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:02.161561 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-262e3114-93a5-47ab-98ee-38b1e4aea05e tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1864 microversion: 2.32 time: 0.409247 Oct 26 13:17:02.162442 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1715/3422] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:17:01 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1864 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:17:02.179406 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f027d010-50fd-43e0-ae96-20397d83ef2a tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:02.180474 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f027d010-50fd-43e0-ae96-20397d83ef2a tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:02.188200 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6bb30d36-3f15-4f11-acb3-21ef81fb2434 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:02.200995 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6bb30d36-3f15-4f11-acb3-21ef81fb2434 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/c188efbd-a2ba-40c5-ad9e-8352eea04b8f" status: 200 len: 1313 microversion: 2.1 time: 1.160085 Oct 26 13:17:02.201999 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f027d010-50fd-43e0-ae96-20397d83ef2a tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:02.202676 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f027d010-50fd-43e0-ae96-20397d83ef2a tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:02.203352 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f027d010-50fd-43e0-ae96-20397d83ef2a tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:02.204740 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1708/3423] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:01 2022] GET /compute/v2.1/servers/c188efbd-a2ba-40c5-ad9e-8352eea04b8f => generated 1313 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:02.206106 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f027d010-50fd-43e0-ae96-20397d83ef2a tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:02.206744 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f027d010-50fd-43e0-ae96-20397d83ef2a tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:02.207405 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f027d010-50fd-43e0-ae96-20397d83ef2a tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:02.215226 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4010d393-017d-442e-b396-8ab2bacc4b71 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:02.220095 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4010d393-017d-442e-b396-8ab2bacc4b71 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:02.234969 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4010d393-017d-442e-b396-8ab2bacc4b71 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:02.235863 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4010d393-017d-442e-b396-8ab2bacc4b71 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:02.239169 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4010d393-017d-442e-b396-8ab2bacc4b71 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:02.240503 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4010d393-017d-442e-b396-8ab2bacc4b71 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:02.241174 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4010d393-017d-442e-b396-8ab2bacc4b71 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:02.252093 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4010d393-017d-442e-b396-8ab2bacc4b71 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:02.311927 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f027d010-50fd-43e0-ae96-20397d83ef2a tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:02.328545 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f027d010-50fd-43e0-ae96-20397d83ef2a tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1169 microversion: 2.1 time: 0.160746 Oct 26 13:17:02.342403 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1716/3424] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:02 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1169 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:02.349667 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-3461ac37-6255-4cf9-9d70-caa5d13d6759 req-d1798884-378e-49c2-8a12-0e9a3e5273bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "893420b7-27d9-4240-8182-87dd3231cbe2", "tag": "6f7441d1-08c7-4242-af8c-89ef53af5a68"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:17:02.369583 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-3461ac37-6255-4cf9-9d70-caa5d13d6759 req-d1798884-378e-49c2-8a12-0e9a3e5273bf service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:02.370174 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-3461ac37-6255-4cf9-9d70-caa5d13d6759 req-d1798884-378e-49c2-8a12-0e9a3e5273bf service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:02.370705 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-3461ac37-6255-4cf9-9d70-caa5d13d6759 req-d1798884-378e-49c2-8a12-0e9a3e5273bf service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:02.382632 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-3461ac37-6255-4cf9-9d70-caa5d13d6759 req-d1798884-378e-49c2-8a12-0e9a3e5273bf service nova] Creating event network-changed:6f7441d1-08c7-4242-af8c-89ef53af5a68 for instance 893420b7-27d9-4240-8182-87dd3231cbe2 on n-h1-862686-1 Oct 26 13:17:02.388993 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-3461ac37-6255-4cf9-9d70-caa5d13d6759 req-d1798884-378e-49c2-8a12-0e9a3e5273bf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044618 Oct 26 13:17:02.390106 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1717/3425] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:17:02.544416 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e8940918-5e49-4cf9-aebe-daf9f5ccc3b7 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:02.545193 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e8940918-5e49-4cf9-aebe-daf9f5ccc3b7 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: b29a1a98-a428-4967-bc4a-237971dcd264] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:02.551623 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e8940918-5e49-4cf9-aebe-daf9f5ccc3b7 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:02.552413 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e8940918-5e49-4cf9-aebe-daf9f5ccc3b7 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:02.553051 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e8940918-5e49-4cf9-aebe-daf9f5ccc3b7 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:02.554018 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e8940918-5e49-4cf9-aebe-daf9f5ccc3b7 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:02.554697 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e8940918-5e49-4cf9-aebe-daf9f5ccc3b7 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:02.555322 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e8940918-5e49-4cf9-aebe-daf9f5ccc3b7 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:02.939343 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4010d393-017d-442e-b396-8ab2bacc4b71 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:02.953086 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4010d393-017d-442e-b396-8ab2bacc4b71 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8" status: 200 len: 1509 microversion: 2.1 time: 0.744250 Oct 26 13:17:02.955310 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e8940918-5e49-4cf9-aebe-daf9f5ccc3b7 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:02.955460 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1709/3426] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:02 2022] GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 => generated 1509 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:02.964198 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e8940918-5e49-4cf9-aebe-daf9f5ccc3b7 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264" status: 200 len: 1314 microversion: 2.1 time: 0.424166 Oct 26 13:17:02.970773 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1718/3427] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:02 2022] GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264 => generated 1314 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:17:03.198254 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c815ac11-3742-478c-bb3a-d31fb636fce9 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:03.199926 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c815ac11-3742-478c-bb3a-d31fb636fce9 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:03.210710 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c815ac11-3742-478c-bb3a-d31fb636fce9 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:03.211627 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c815ac11-3742-478c-bb3a-d31fb636fce9 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:03.212298 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c815ac11-3742-478c-bb3a-d31fb636fce9 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:03.213565 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c815ac11-3742-478c-bb3a-d31fb636fce9 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:03.214828 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c815ac11-3742-478c-bb3a-d31fb636fce9 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:03.215452 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c815ac11-3742-478c-bb3a-d31fb636fce9 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:03.229622 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7cf15658-a22f-4d80-8fdc-df93b08826cf tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:03.230338 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7cf15658-a22f-4d80-8fdc-df93b08826cf tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: c188efbd-a2ba-40c5-ad9e-8352eea04b8f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:03.249978 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7cf15658-a22f-4d80-8fdc-df93b08826cf tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:03.251922 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7cf15658-a22f-4d80-8fdc-df93b08826cf tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:03.252548 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7cf15658-a22f-4d80-8fdc-df93b08826cf tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:03.253458 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7cf15658-a22f-4d80-8fdc-df93b08826cf tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:03.254573 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7cf15658-a22f-4d80-8fdc-df93b08826cf tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:03.254573 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7cf15658-a22f-4d80-8fdc-df93b08826cf tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:03.298672 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:17:03.584635 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7cf15658-a22f-4d80-8fdc-df93b08826cf tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:03.596698 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7cf15658-a22f-4d80-8fdc-df93b08826cf tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/c188efbd-a2ba-40c5-ad9e-8352eea04b8f" status: 200 len: 1313 microversion: 2.1 time: 0.370940 Oct 26 13:17:03.597445 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1719/3428] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:03 2022] GET /compute/v2.1/servers/c188efbd-a2ba-40c5-ad9e-8352eea04b8f => generated 1313 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:03.606482 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1ca9a0f2-18c2-4f82-98dd-37d0b0c169d2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:03.612461 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1ca9a0f2-18c2-4f82-98dd-37d0b0c169d2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:03.649944 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ca9a0f2-18c2-4f82-98dd-37d0b0c169d2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:03.653162 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ca9a0f2-18c2-4f82-98dd-37d0b0c169d2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:03.653764 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ca9a0f2-18c2-4f82-98dd-37d0b0c169d2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:03.654525 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ca9a0f2-18c2-4f82-98dd-37d0b0c169d2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:03.657125 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ca9a0f2-18c2-4f82-98dd-37d0b0c169d2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:03.659859 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ca9a0f2-18c2-4f82-98dd-37d0b0c169d2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:04.063683 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1ca9a0f2-18c2-4f82-98dd-37d0b0c169d2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:04.082209 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1ca9a0f2-18c2-4f82-98dd-37d0b0c169d2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1211 microversion: 2.1 time: 0.482183 Oct 26 13:17:04.083091 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1720/3429] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:03 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1211 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:04.095598 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a0cdcb9f-1780-48cf-9bfd-1418869e2405 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:04.096403 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a0cdcb9f-1780-48cf-9bfd-1418869e2405 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:04.111129 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0cdcb9f-1780-48cf-9bfd-1418869e2405 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:04.112448 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0cdcb9f-1780-48cf-9bfd-1418869e2405 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:04.120155 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0cdcb9f-1780-48cf-9bfd-1418869e2405 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:04.121671 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0cdcb9f-1780-48cf-9bfd-1418869e2405 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:04.122696 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0cdcb9f-1780-48cf-9bfd-1418869e2405 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:04.123318 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0cdcb9f-1780-48cf-9bfd-1418869e2405 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:04.155454 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=4 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:17:04.208099 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c815ac11-3742-478c-bb3a-d31fb636fce9 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:04.224741 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c815ac11-3742-478c-bb3a-d31fb636fce9 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:04.231634 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c815ac11-3742-478c-bb3a-d31fb636fce9 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:04.234122 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c815ac11-3742-478c-bb3a-d31fb636fce9 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1885 microversion: 2.32 time: 1.043442 Oct 26 13:17:04.240444 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1710/3430] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:17:03 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1885 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:17:04.251518 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6ba1b820-88be-4c81-8a5f-ac6cd6021171 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:04.253524 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6ba1b820-88be-4c81-8a5f-ac6cd6021171 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: b29a1a98-a428-4967-bc4a-237971dcd264] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:04.268636 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ba1b820-88be-4c81-8a5f-ac6cd6021171 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:04.271734 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ba1b820-88be-4c81-8a5f-ac6cd6021171 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:04.273136 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ba1b820-88be-4c81-8a5f-ac6cd6021171 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:04.277162 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ba1b820-88be-4c81-8a5f-ac6cd6021171 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:04.282368 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ba1b820-88be-4c81-8a5f-ac6cd6021171 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:04.283393 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ba1b820-88be-4c81-8a5f-ac6cd6021171 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:04.283995 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=24 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:17:04.535372 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a0cdcb9f-1780-48cf-9bfd-1418869e2405 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:04.556899 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a0cdcb9f-1780-48cf-9bfd-1418869e2405 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8" status: 200 len: 1509 microversion: 2.1 time: 0.471616 Oct 26 13:17:04.573046 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1721/3431] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:04 2022] GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 => generated 1509 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:04.579577 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-d011dd46-1ebc-42fe-b463-50113eb3bd53 req-faff8a7b-be3d-4f81-a282-d6925fb3bde2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "893420b7-27d9-4240-8182-87dd3231cbe2", "tag": "ba719c25-4dde-4810-8e01-3a65db1889d6"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:17:04.591900 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-d011dd46-1ebc-42fe-b463-50113eb3bd53 req-faff8a7b-be3d-4f81-a282-d6925fb3bde2 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:04.593471 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-d011dd46-1ebc-42fe-b463-50113eb3bd53 req-faff8a7b-be3d-4f81-a282-d6925fb3bde2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:04.594173 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-d011dd46-1ebc-42fe-b463-50113eb3bd53 req-faff8a7b-be3d-4f81-a282-d6925fb3bde2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:04.610682 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-d011dd46-1ebc-42fe-b463-50113eb3bd53 req-faff8a7b-be3d-4f81-a282-d6925fb3bde2 service nova] Creating event network-changed:ba719c25-4dde-4810-8e01-3a65db1889d6 for instance 893420b7-27d9-4240-8182-87dd3231cbe2 on n-h1-862686-1 Oct 26 13:17:04.619239 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-d011dd46-1ebc-42fe-b463-50113eb3bd53 req-faff8a7b-be3d-4f81-a282-d6925fb3bde2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044056 Oct 26 13:17:04.620332 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1722/3432] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:17:04.643660 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-216cfdb9-b4f1-4d3b-a50b-b897aeed72bb tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:04.646892 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-216cfdb9-b4f1-4d3b-a50b-b897aeed72bb tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: c188efbd-a2ba-40c5-ad9e-8352eea04b8f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:04.655901 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-216cfdb9-b4f1-4d3b-a50b-b897aeed72bb tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:04.656740 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-216cfdb9-b4f1-4d3b-a50b-b897aeed72bb tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:04.657361 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-216cfdb9-b4f1-4d3b-a50b-b897aeed72bb tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:04.658476 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-216cfdb9-b4f1-4d3b-a50b-b897aeed72bb tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:04.659095 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-216cfdb9-b4f1-4d3b-a50b-b897aeed72bb tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:04.659668 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-216cfdb9-b4f1-4d3b-a50b-b897aeed72bb tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:04.801327 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6ba1b820-88be-4c81-8a5f-ac6cd6021171 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:04.804637 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:17:04.845472 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6ba1b820-88be-4c81-8a5f-ac6cd6021171 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264" status: 200 len: 1314 microversion: 2.1 time: 0.602165 Oct 26 13:17:04.849907 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1711/3433] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:04 2022] GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264 => generated 1314 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:04.913918 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-216cfdb9-b4f1-4d3b-a50b-b897aeed72bb tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:04.925576 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-216cfdb9-b4f1-4d3b-a50b-b897aeed72bb tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/c188efbd-a2ba-40c5-ad9e-8352eea04b8f" status: 200 len: 1313 microversion: 2.1 time: 0.298990 Oct 26 13:17:04.925576 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1723/3434] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:04 2022] GET /compute/v2.1/servers/c188efbd-a2ba-40c5-ad9e-8352eea04b8f => generated 1313 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:05.110454 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-31f05c12-7644-4ba1-b5d1-da0932e118ec tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:05.112255 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-31f05c12-7644-4ba1-b5d1-da0932e118ec tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:05.124281 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31f05c12-7644-4ba1-b5d1-da0932e118ec tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:05.130917 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31f05c12-7644-4ba1-b5d1-da0932e118ec tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:05.131630 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31f05c12-7644-4ba1-b5d1-da0932e118ec tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:05.132784 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31f05c12-7644-4ba1-b5d1-da0932e118ec tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:05.133556 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31f05c12-7644-4ba1-b5d1-da0932e118ec tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:05.134297 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31f05c12-7644-4ba1-b5d1-da0932e118ec tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:05.263484 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fff93a8e-2ece-434b-aae0-125007bae223 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:05.264200 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fff93a8e-2ece-434b-aae0-125007bae223 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:05.273057 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fff93a8e-2ece-434b-aae0-125007bae223 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:05.276983 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fff93a8e-2ece-434b-aae0-125007bae223 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:05.282673 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fff93a8e-2ece-434b-aae0-125007bae223 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:05.283558 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fff93a8e-2ece-434b-aae0-125007bae223 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:05.284231 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fff93a8e-2ece-434b-aae0-125007bae223 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:05.284891 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fff93a8e-2ece-434b-aae0-125007bae223 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:05.746578 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-31f05c12-7644-4ba1-b5d1-da0932e118ec tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:05.758693 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-31f05c12-7644-4ba1-b5d1-da0932e118ec tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1211 microversion: 2.1 time: 0.651829 Oct 26 13:17:05.777764 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1712/3435] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:05 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1211 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:05.785356 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bfac8379-a294-419c-b910-26329efe6189 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:05.787086 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bfac8379-a294-419c-b910-26329efe6189 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:05.795313 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bfac8379-a294-419c-b910-26329efe6189 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:05.796078 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bfac8379-a294-419c-b910-26329efe6189 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:05.797301 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bfac8379-a294-419c-b910-26329efe6189 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:05.798285 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bfac8379-a294-419c-b910-26329efe6189 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:05.798901 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bfac8379-a294-419c-b910-26329efe6189 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:05.799487 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bfac8379-a294-419c-b910-26329efe6189 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:05.881392 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fff93a8e-2ece-434b-aae0-125007bae223 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:05.906527 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fff93a8e-2ece-434b-aae0-125007bae223 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:05.913557 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fff93a8e-2ece-434b-aae0-125007bae223 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:05.914986 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fff93a8e-2ece-434b-aae0-125007bae223 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1885 microversion: 2.32 time: 0.655375 Oct 26 13:17:05.919727 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1724/3436] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:17:05 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1885 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:17:05.940129 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c966fd5a-c9a3-4ced-96ee-db09dacac4c4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:05.946077 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c966fd5a-c9a3-4ced-96ee-db09dacac4c4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:05.976210 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c966fd5a-c9a3-4ced-96ee-db09dacac4c4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:05.980596 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c966fd5a-c9a3-4ced-96ee-db09dacac4c4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:05.982336 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c966fd5a-c9a3-4ced-96ee-db09dacac4c4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:05.988259 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c966fd5a-c9a3-4ced-96ee-db09dacac4c4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:05.988844 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c966fd5a-c9a3-4ced-96ee-db09dacac4c4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:05.989293 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c966fd5a-c9a3-4ced-96ee-db09dacac4c4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:06.274146 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bfac8379-a294-419c-b910-26329efe6189 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:06.293243 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bfac8379-a294-419c-b910-26329efe6189 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:06.297859 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bfac8379-a294-419c-b910-26329efe6189 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:06.301153 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bfac8379-a294-419c-b910-26329efe6189 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 2955 microversion: 2.42 time: 0.521639 Oct 26 13:17:06.304233 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1713/3437] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:17:05 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 2955 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:17:06.320631 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3cb74a19-e105-42c5-95e4-f8ee4070db82 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:06.321977 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3cb74a19-e105-42c5-95e4-f8ee4070db82 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: b29a1a98-a428-4967-bc4a-237971dcd264] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:06.340536 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3cb74a19-e105-42c5-95e4-f8ee4070db82 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:06.344740 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3cb74a19-e105-42c5-95e4-f8ee4070db82 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:06.345422 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3cb74a19-e105-42c5-95e4-f8ee4070db82 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:06.346389 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3cb74a19-e105-42c5-95e4-f8ee4070db82 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:06.347199 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3cb74a19-e105-42c5-95e4-f8ee4070db82 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:06.348624 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3cb74a19-e105-42c5-95e4-f8ee4070db82 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:06.655282 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c966fd5a-c9a3-4ced-96ee-db09dacac4c4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:06.663957 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c966fd5a-c9a3-4ced-96ee-db09dacac4c4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8" status: 200 len: 1509 microversion: 2.1 time: 0.739425 Oct 26 13:17:06.674684 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1725/3438] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:05 2022] GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 => generated 1509 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:06.680509 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-6d515d87-b09a-40f2-9ddd-643dc116fec7 req-f2e0a93f-7796-4d05-87ad-45fbe0c1768a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c188efbd-a2ba-40c5-ad9e-8352eea04b8f", "name": "network-vif-plugged", "status": "completed", "tag": "0e6f8688-de29-4b32-9dc4-f97b8fc35edd"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:17:06.695070 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-6d515d87-b09a-40f2-9ddd-643dc116fec7 req-f2e0a93f-7796-4d05-87ad-45fbe0c1768a service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:06.695812 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-6d515d87-b09a-40f2-9ddd-643dc116fec7 req-f2e0a93f-7796-4d05-87ad-45fbe0c1768a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:06.696471 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-6d515d87-b09a-40f2-9ddd-643dc116fec7 req-f2e0a93f-7796-4d05-87ad-45fbe0c1768a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:06.722391 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-6d515d87-b09a-40f2-9ddd-643dc116fec7 req-f2e0a93f-7796-4d05-87ad-45fbe0c1768a service nova] Creating event network-vif-plugged:0e6f8688-de29-4b32-9dc4-f97b8fc35edd for instance c188efbd-a2ba-40c5-ad9e-8352eea04b8f on n-h1-862686-1 Oct 26 13:17:06.731274 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-6d515d87-b09a-40f2-9ddd-643dc116fec7 req-f2e0a93f-7796-4d05-87ad-45fbe0c1768a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054613 Oct 26 13:17:06.732551 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1726/3439] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:17:06.741619 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e82818cb-f4f5-4e25-a888-25b162645724 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:06.745715 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e82818cb-f4f5-4e25-a888-25b162645724 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: c188efbd-a2ba-40c5-ad9e-8352eea04b8f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:06.764483 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e82818cb-f4f5-4e25-a888-25b162645724 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:06.765584 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e82818cb-f4f5-4e25-a888-25b162645724 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:06.766257 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e82818cb-f4f5-4e25-a888-25b162645724 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:06.767227 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e82818cb-f4f5-4e25-a888-25b162645724 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:06.767878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e82818cb-f4f5-4e25-a888-25b162645724 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:06.768508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e82818cb-f4f5-4e25-a888-25b162645724 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:07.113705 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3cb74a19-e105-42c5-95e4-f8ee4070db82 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:07.127213 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3cb74a19-e105-42c5-95e4-f8ee4070db82 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264" status: 200 len: 1314 microversion: 2.1 time: 0.821402 Oct 26 13:17:07.128328 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1714/3440] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:06 2022] GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264 => generated 1314 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:07.136671 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-305a9594-cf89-4660-932e-ebdb9113de6f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:07.137439 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-305a9594-cf89-4660-932e-ebdb9113de6f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:07.147089 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-305a9594-cf89-4660-932e-ebdb9113de6f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:07.148856 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-305a9594-cf89-4660-932e-ebdb9113de6f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:07.151251 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-305a9594-cf89-4660-932e-ebdb9113de6f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:07.152404 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-305a9594-cf89-4660-932e-ebdb9113de6f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:07.153108 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-305a9594-cf89-4660-932e-ebdb9113de6f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:07.154170 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-305a9594-cf89-4660-932e-ebdb9113de6f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:07.434709 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e82818cb-f4f5-4e25-a888-25b162645724 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:07.449782 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e82818cb-f4f5-4e25-a888-25b162645724 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/c188efbd-a2ba-40c5-ad9e-8352eea04b8f" status: 200 len: 1313 microversion: 2.1 time: 0.715686 Oct 26 13:17:07.450386 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1727/3441] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:06 2022] GET /compute/v2.1/servers/c188efbd-a2ba-40c5-ad9e-8352eea04b8f => generated 1313 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:07.462412 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-cd881294-ca9e-4ff7-96b1-4a8ae3bfae35 req-c34dcbc9-a174-4eef-8a3e-914ecbc4b33a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "893420b7-27d9-4240-8182-87dd3231cbe2", "tag": "5767d9fc-18c2-418f-b31e-29c55d94a15e"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:17:07.485360 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-cd881294-ca9e-4ff7-96b1-4a8ae3bfae35 req-c34dcbc9-a174-4eef-8a3e-914ecbc4b33a service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:07.485878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-cd881294-ca9e-4ff7-96b1-4a8ae3bfae35 req-c34dcbc9-a174-4eef-8a3e-914ecbc4b33a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:07.486403 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-cd881294-ca9e-4ff7-96b1-4a8ae3bfae35 req-c34dcbc9-a174-4eef-8a3e-914ecbc4b33a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:07.513938 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-305a9594-cf89-4660-932e-ebdb9113de6f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.382584 Oct 26 13:17:07.525951 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1715/3442] 10.222.0.40 () {60 vars in 1316 bytes} [Wed Oct 26 13:17:07 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476/os-interface => generated 1830 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:17:07.526574 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-cd881294-ca9e-4ff7-96b1-4a8ae3bfae35 req-c34dcbc9-a174-4eef-8a3e-914ecbc4b33a service nova] Creating event network-changed:5767d9fc-18c2-418f-b31e-29c55d94a15e for instance 893420b7-27d9-4240-8182-87dd3231cbe2 on n-h1-862686-1 Oct 26 13:17:07.526701 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1b05e753-7939-4307-ae64-ad3f7414cd1c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:07.527219 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-cd881294-ca9e-4ff7-96b1-4a8ae3bfae35 req-c34dcbc9-a174-4eef-8a3e-914ecbc4b33a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075577 Oct 26 13:17:07.527759 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1b05e753-7939-4307-ae64-ad3f7414cd1c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:07.527885 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1728/3443] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:17:07.545950 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b05e753-7939-4307-ae64-ad3f7414cd1c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:07.547893 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b05e753-7939-4307-ae64-ad3f7414cd1c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:07.549336 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b05e753-7939-4307-ae64-ad3f7414cd1c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:07.549660 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5023d8a8-403a-47f0-bdc5-8067529ad673 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:07.553233 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b05e753-7939-4307-ae64-ad3f7414cd1c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:07.554227 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b05e753-7939-4307-ae64-ad3f7414cd1c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:07.556761 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b05e753-7939-4307-ae64-ad3f7414cd1c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:07.557073 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5023d8a8-403a-47f0-bdc5-8067529ad673 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:07.572418 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5023d8a8-403a-47f0-bdc5-8067529ad673 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:07.573156 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5023d8a8-403a-47f0-bdc5-8067529ad673 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:07.573637 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5023d8a8-403a-47f0-bdc5-8067529ad673 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:07.574608 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5023d8a8-403a-47f0-bdc5-8067529ad673 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:07.575261 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5023d8a8-403a-47f0-bdc5-8067529ad673 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:07.576840 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5023d8a8-403a-47f0-bdc5-8067529ad673 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:08.158924 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5023d8a8-403a-47f0-bdc5-8067529ad673 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:08.184307 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1b05e753-7939-4307-ae64-ad3f7414cd1c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:08.188970 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5023d8a8-403a-47f0-bdc5-8067529ad673 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:08.192312 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5023d8a8-403a-47f0-bdc5-8067529ad673 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:08.199263 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1b05e753-7939-4307-ae64-ad3f7414cd1c tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1211 microversion: 2.1 time: 0.681283 Oct 26 13:17:08.201229 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5023d8a8-403a-47f0-bdc5-8067529ad673 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1885 microversion: 2.32 time: 0.669070 Oct 26 13:17:08.201936 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1716/3444] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:07 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1211 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:08.213155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-bfb6e8bf-5c55-4ee2-a6ac-43bf448597df req-ac016799-586e-4401-853a-b9b65e994334 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b29a1a98-a428-4967-bc4a-237971dcd264", "tag": "2898cac6-24b9-4e25-b557-8f996344f010"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:17:08.217293 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1729/3445] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:17:07 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1885 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:17:08.240453 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-bfb6e8bf-5c55-4ee2-a6ac-43bf448597df req-ac016799-586e-4401-853a-b9b65e994334 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:08.241195 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-bfb6e8bf-5c55-4ee2-a6ac-43bf448597df req-ac016799-586e-4401-853a-b9b65e994334 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:08.242349 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-bfb6e8bf-5c55-4ee2-a6ac-43bf448597df req-ac016799-586e-4401-853a-b9b65e994334 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:08.246383 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-afec4a8a-bebf-46d7-916a-f2efb3b48d87 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:08.248482 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-afec4a8a-bebf-46d7-916a-f2efb3b48d87 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:08.261631 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:17:08.264027 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afec4a8a-bebf-46d7-916a-f2efb3b48d87 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:08.269539 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afec4a8a-bebf-46d7-916a-f2efb3b48d87 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:08.270297 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afec4a8a-bebf-46d7-916a-f2efb3b48d87 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:08.272453 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afec4a8a-bebf-46d7-916a-f2efb3b48d87 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:08.273914 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afec4a8a-bebf-46d7-916a-f2efb3b48d87 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:08.277148 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-bfb6e8bf-5c55-4ee2-a6ac-43bf448597df req-ac016799-586e-4401-853a-b9b65e994334 service nova] Creating event network-changed:2898cac6-24b9-4e25-b557-8f996344f010 for instance b29a1a98-a428-4967-bc4a-237971dcd264 on n-h2-862686-1 Oct 26 13:17:08.278901 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afec4a8a-bebf-46d7-916a-f2efb3b48d87 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:08.291602 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-bfb6e8bf-5c55-4ee2-a6ac-43bf448597df req-ac016799-586e-4401-853a-b9b65e994334 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087737 Oct 26 13:17:08.295369 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1717/3446] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:17:08.312474 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3d52edbc-f681-4463-82a5-8a806accac75 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:08.314576 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3d52edbc-f681-4463-82a5-8a806accac75 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: b29a1a98-a428-4967-bc4a-237971dcd264] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:08.332206 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3d52edbc-f681-4463-82a5-8a806accac75 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:08.334637 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3d52edbc-f681-4463-82a5-8a806accac75 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:08.335643 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3d52edbc-f681-4463-82a5-8a806accac75 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:08.341337 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3d52edbc-f681-4463-82a5-8a806accac75 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:08.342192 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3d52edbc-f681-4463-82a5-8a806accac75 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:08.342926 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3d52edbc-f681-4463-82a5-8a806accac75 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:08.648978 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-afec4a8a-bebf-46d7-916a-f2efb3b48d87 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:08.662717 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-afec4a8a-bebf-46d7-916a-f2efb3b48d87 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8" status: 200 len: 1509 microversion: 2.1 time: 0.427851 Oct 26 13:17:08.664002 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1730/3447] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:08 2022] GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 => generated 1509 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:08.669291 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d9bcfb68-bca9-47bf-b7e5-02aafb4de8c4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:08.670332 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d9bcfb68-bca9-47bf-b7e5-02aafb4de8c4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: c188efbd-a2ba-40c5-ad9e-8352eea04b8f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:08.679043 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9bcfb68-bca9-47bf-b7e5-02aafb4de8c4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:08.679828 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9bcfb68-bca9-47bf-b7e5-02aafb4de8c4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:08.680707 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9bcfb68-bca9-47bf-b7e5-02aafb4de8c4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:08.683422 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9bcfb68-bca9-47bf-b7e5-02aafb4de8c4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:08.684261 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9bcfb68-bca9-47bf-b7e5-02aafb4de8c4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:08.684873 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9bcfb68-bca9-47bf-b7e5-02aafb4de8c4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:09.137246 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d9bcfb68-bca9-47bf-b7e5-02aafb4de8c4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:09.148598 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d9bcfb68-bca9-47bf-b7e5-02aafb4de8c4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/c188efbd-a2ba-40c5-ad9e-8352eea04b8f" status: 200 len: 1501 microversion: 2.1 time: 0.483084 Oct 26 13:17:09.161922 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1731/3448] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:08 2022] GET /compute/v2.1/servers/c188efbd-a2ba-40c5-ad9e-8352eea04b8f => generated 1501 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:09.162150 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3d52edbc-f681-4463-82a5-8a806accac75 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:09.173974 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3d52edbc-f681-4463-82a5-8a806accac75 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264" status: 200 len: 1314 microversion: 2.1 time: 0.876256 Oct 26 13:17:09.174577 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1718/3449] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:08 2022] GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264 => generated 1314 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:09.176476 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-64116886-1290-44dc-9176-f2917079189c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:17:09.177015 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-64116886-1290-44dc-9176-f2917079189c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: c188efbd-a2ba-40c5-ad9e-8352eea04b8f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:09.191064 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64116886-1290-44dc-9176-f2917079189c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:09.192598 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64116886-1290-44dc-9176-f2917079189c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:09.193047 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64116886-1290-44dc-9176-f2917079189c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:09.193794 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64116886-1290-44dc-9176-f2917079189c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:09.194248 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64116886-1290-44dc-9176-f2917079189c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:09.194673 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64116886-1290-44dc-9176-f2917079189c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:09.232305 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ea854ada-c650-4664-b876-19242cbd624e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:09.240824 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ea854ada-c650-4664-b876-19242cbd624e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:09.261811 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ea854ada-c650-4664-b876-19242cbd624e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:09.262775 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ea854ada-c650-4664-b876-19242cbd624e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:09.263491 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ea854ada-c650-4664-b876-19242cbd624e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:09.264710 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ea854ada-c650-4664-b876-19242cbd624e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:09.265344 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ea854ada-c650-4664-b876-19242cbd624e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:09.265959 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ea854ada-c650-4664-b876-19242cbd624e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:09.351032 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-64116886-1290-44dc-9176-f2917079189c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "POST /compute/v2.1/servers/c188efbd-a2ba-40c5-ad9e-8352eea04b8f/action" status: 202 len: 0 microversion: 2.1 time: 0.177939 Oct 26 13:17:09.369380 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1732/3450] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:17:09 2022] POST /compute/v2.1/servers/c188efbd-a2ba-40c5-ad9e-8352eea04b8f/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:17:09.385523 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-81ee72a9-329c-43ca-bb54-c3619bf0ef8a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:09.387008 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-81ee72a9-329c-43ca-bb54-c3619bf0ef8a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:09.409417 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=10 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:17:09.414567 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81ee72a9-329c-43ca-bb54-c3619bf0ef8a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:09.415301 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81ee72a9-329c-43ca-bb54-c3619bf0ef8a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:09.418313 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81ee72a9-329c-43ca-bb54-c3619bf0ef8a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:09.420659 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81ee72a9-329c-43ca-bb54-c3619bf0ef8a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:09.424163 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81ee72a9-329c-43ca-bb54-c3619bf0ef8a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:09.424893 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81ee72a9-329c-43ca-bb54-c3619bf0ef8a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:09.546792 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ea854ada-c650-4664-b876-19242cbd624e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:09.556712 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ea854ada-c650-4664-b876-19242cbd624e tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1211 microversion: 2.1 time: 0.333552 Oct 26 13:17:09.559784 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1719/3451] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:09 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1211 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:17:09.575489 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5a47fb88-0193-45b0-a866-21a85490c01c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:09.576642 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5a47fb88-0193-45b0-a866-21a85490c01c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: c188efbd-a2ba-40c5-ad9e-8352eea04b8f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:09.591092 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5a47fb88-0193-45b0-a866-21a85490c01c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:09.591746 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5a47fb88-0193-45b0-a866-21a85490c01c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:09.592917 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5a47fb88-0193-45b0-a866-21a85490c01c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:09.594405 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5a47fb88-0193-45b0-a866-21a85490c01c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:09.595793 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5a47fb88-0193-45b0-a866-21a85490c01c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:09.596632 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5a47fb88-0193-45b0-a866-21a85490c01c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:09.901283 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5a47fb88-0193-45b0-a866-21a85490c01c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:09.928614 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5a47fb88-0193-45b0-a866-21a85490c01c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/c188efbd-a2ba-40c5-ad9e-8352eea04b8f" status: 200 len: 1486 microversion: 2.1 time: 0.366928 Oct 26 13:17:09.952553 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1720/3452] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:09 2022] GET /compute/v2.1/servers/c188efbd-a2ba-40c5-ad9e-8352eea04b8f => generated 1486 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:09.960575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4ab4c3ca-f934-48b0-9229-933019d27ae1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:09.965587 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4ab4c3ca-f934-48b0-9229-933019d27ae1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:09.976856 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4ab4c3ca-f934-48b0-9229-933019d27ae1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:09.979201 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4ab4c3ca-f934-48b0-9229-933019d27ae1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:09.979875 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4ab4c3ca-f934-48b0-9229-933019d27ae1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:09.983457 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4ab4c3ca-f934-48b0-9229-933019d27ae1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:09.984257 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4ab4c3ca-f934-48b0-9229-933019d27ae1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:09.985680 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4ab4c3ca-f934-48b0-9229-933019d27ae1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:10.111064 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-81ee72a9-329c-43ca-bb54-c3619bf0ef8a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:10.126840 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-81ee72a9-329c-43ca-bb54-c3619bf0ef8a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:10.128862 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-81ee72a9-329c-43ca-bb54-c3619bf0ef8a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:10.130329 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-81ee72a9-329c-43ca-bb54-c3619bf0ef8a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1885 microversion: 2.32 time: 0.758449 Oct 26 13:17:10.148071 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1733/3453] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:17:09 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1885 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:17:10.158433 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-43704c22-b7e7-4177-b2c1-7f7554f417fc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:10.159240 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-43704c22-b7e7-4177-b2c1-7f7554f417fc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: c188efbd-a2ba-40c5-ad9e-8352eea04b8f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:10.180173 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-43704c22-b7e7-4177-b2c1-7f7554f417fc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:10.190096 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-43704c22-b7e7-4177-b2c1-7f7554f417fc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:10.190864 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-43704c22-b7e7-4177-b2c1-7f7554f417fc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:10.192813 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-43704c22-b7e7-4177-b2c1-7f7554f417fc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:10.193452 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-43704c22-b7e7-4177-b2c1-7f7554f417fc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:10.194169 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-43704c22-b7e7-4177-b2c1-7f7554f417fc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:10.253860 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-43704c22-b7e7-4177-b2c1-7f7554f417fc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: c188efbd-a2ba-40c5-ad9e-8352eea04b8f] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:17:10.477711 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-43704c22-b7e7-4177-b2c1-7f7554f417fc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c188efbd-a2ba-40c5-ad9e-8352eea04b8f" status: 204 len: 0 microversion: 2.1 time: 0.327523 Oct 26 13:17:10.484575 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1734/3454] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:17:10 2022] DELETE /compute/v2.1/servers/c188efbd-a2ba-40c5-ad9e-8352eea04b8f => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:17:10.498336 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-941c58b3-002b-4ab4-baf8-a7c7f0834331 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:10.499542 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-941c58b3-002b-4ab4-baf8-a7c7f0834331 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: b29a1a98-a428-4967-bc4a-237971dcd264] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:10.508222 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-941c58b3-002b-4ab4-baf8-a7c7f0834331 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:10.509183 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-941c58b3-002b-4ab4-baf8-a7c7f0834331 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:10.510986 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-941c58b3-002b-4ab4-baf8-a7c7f0834331 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:10.511898 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-941c58b3-002b-4ab4-baf8-a7c7f0834331 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:10.512583 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-941c58b3-002b-4ab4-baf8-a7c7f0834331 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:10.513267 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-941c58b3-002b-4ab4-baf8-a7c7f0834331 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:10.539920 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4ab4c3ca-f934-48b0-9229-933019d27ae1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:10.546508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:17:10.552064 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4ab4c3ca-f934-48b0-9229-933019d27ae1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8" status: 200 len: 1509 microversion: 2.1 time: 0.598100 Oct 26 13:17:10.558598 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1721/3455] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:09 2022] GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 => generated 1509 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:10.563465 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-423e2988-1e68-444b-96f4-bd06168ea013 req-9d6b811b-ef78-403e-93be-158d1327ac29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "893420b7-27d9-4240-8182-87dd3231cbe2", "tag": "01969fd5-4e79-4f2e-9b74-9329ffa7cebd"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:17:10.583652 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-423e2988-1e68-444b-96f4-bd06168ea013 req-9d6b811b-ef78-403e-93be-158d1327ac29 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:10.584946 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-423e2988-1e68-444b-96f4-bd06168ea013 req-9d6b811b-ef78-403e-93be-158d1327ac29 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:10.585522 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-423e2988-1e68-444b-96f4-bd06168ea013 req-9d6b811b-ef78-403e-93be-158d1327ac29 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:10.601467 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-423e2988-1e68-444b-96f4-bd06168ea013 req-9d6b811b-ef78-403e-93be-158d1327ac29 service nova] Creating event network-changed:01969fd5-4e79-4f2e-9b74-9329ffa7cebd for instance 893420b7-27d9-4240-8182-87dd3231cbe2 on n-h1-862686-1 Oct 26 13:17:10.610113 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-423e2988-1e68-444b-96f4-bd06168ea013 req-9d6b811b-ef78-403e-93be-158d1327ac29 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049975 Oct 26 13:17:10.611384 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1722/3456] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:17:10.620952 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-048d690b-cfa3-4534-bcf9-9f2e07ee72f7 req-89ebf309-75dc-467c-8614-3139ae6ca8ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7743d90-f9dc-4601-a6d3-a4901bf9cc05", "tag": "cd05a893-6fb7-45ab-985e-5e98b6a0306b"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:17:10.635575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-048d690b-cfa3-4534-bcf9-9f2e07ee72f7 req-89ebf309-75dc-467c-8614-3139ae6ca8ff service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:10.636425 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-048d690b-cfa3-4534-bcf9-9f2e07ee72f7 req-89ebf309-75dc-467c-8614-3139ae6ca8ff service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:10.637275 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-048d690b-cfa3-4534-bcf9-9f2e07ee72f7 req-89ebf309-75dc-467c-8614-3139ae6ca8ff service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:10.652850 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-048d690b-cfa3-4534-bcf9-9f2e07ee72f7 req-89ebf309-75dc-467c-8614-3139ae6ca8ff service nova] Creating event network-changed:cd05a893-6fb7-45ab-985e-5e98b6a0306b for instance b7743d90-f9dc-4601-a6d3-a4901bf9cc05 on n-h2-862686-1 Oct 26 13:17:10.660602 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-048d690b-cfa3-4534-bcf9-9f2e07ee72f7 req-89ebf309-75dc-467c-8614-3139ae6ca8ff service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047618 Oct 26 13:17:10.661247 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1723/3457] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:17:10.669475 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8bccea00-a75d-4a05-a9bb-552df4c8f93e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:10.670323 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8bccea00-a75d-4a05-a9bb-552df4c8f93e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: c188efbd-a2ba-40c5-ad9e-8352eea04b8f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:10.679368 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8bccea00-a75d-4a05-a9bb-552df4c8f93e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:10.680135 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8bccea00-a75d-4a05-a9bb-552df4c8f93e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:10.680809 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8bccea00-a75d-4a05-a9bb-552df4c8f93e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:10.681946 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8bccea00-a75d-4a05-a9bb-552df4c8f93e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:10.683320 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8bccea00-a75d-4a05-a9bb-552df4c8f93e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:10.683988 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8bccea00-a75d-4a05-a9bb-552df4c8f93e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:10.886264 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-941c58b3-002b-4ab4-baf8-a7c7f0834331 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:10.898704 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-941c58b3-002b-4ab4-baf8-a7c7f0834331 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264" status: 200 len: 1314 microversion: 2.1 time: 0.406918 Oct 26 13:17:10.899338 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1735/3458] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:10 2022] GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264 => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:10.904014 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f32e040f-b646-42a2-b3e0-97cc1faa2f61 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:10.904624 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f32e040f-b646-42a2-b3e0-97cc1faa2f61 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:10.923885 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f32e040f-b646-42a2-b3e0-97cc1faa2f61 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:10.924775 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f32e040f-b646-42a2-b3e0-97cc1faa2f61 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:10.924901 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f32e040f-b646-42a2-b3e0-97cc1faa2f61 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:10.925655 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f32e040f-b646-42a2-b3e0-97cc1faa2f61 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:10.926183 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f32e040f-b646-42a2-b3e0-97cc1faa2f61 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:10.926656 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f32e040f-b646-42a2-b3e0-97cc1faa2f61 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:11.155846 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8bccea00-a75d-4a05-a9bb-552df4c8f93e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:11.173964 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8bccea00-a75d-4a05-a9bb-552df4c8f93e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/c188efbd-a2ba-40c5-ad9e-8352eea04b8f" status: 200 len: 1492 microversion: 2.1 time: 0.510998 Oct 26 13:17:11.178107 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1724/3459] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:10 2022] GET /compute/v2.1/servers/c188efbd-a2ba-40c5-ad9e-8352eea04b8f => generated 1492 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:11.249570 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f32e040f-b646-42a2-b3e0-97cc1faa2f61 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:11.260829 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f32e040f-b646-42a2-b3e0-97cc1faa2f61 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1211 microversion: 2.1 time: 0.360232 Oct 26 13:17:11.283126 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1736/3460] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:10 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1211 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:11.288340 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-77728c76-7b16-4c05-8c08-255e62a7cb61 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:11.289113 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-77728c76-7b16-4c05-8c08-255e62a7cb61 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:11.297099 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77728c76-7b16-4c05-8c08-255e62a7cb61 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:11.297966 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77728c76-7b16-4c05-8c08-255e62a7cb61 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:11.298511 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77728c76-7b16-4c05-8c08-255e62a7cb61 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:11.299333 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77728c76-7b16-4c05-8c08-255e62a7cb61 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:11.299894 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77728c76-7b16-4c05-8c08-255e62a7cb61 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:11.300421 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77728c76-7b16-4c05-8c08-255e62a7cb61 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:11.419799 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-57d69bf5-903a-440a-baaf-add42801ffa3 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-440391000", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "734e6a93-2c07-4934-9126-941a6fbf632d"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:17:11.513940 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-57d69bf5-903a-440a-baaf-add42801ffa3 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] validate_networks() for [('734e6a93-2c07-4934-9126-941a6fbf632d', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:17:11.643464 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-77728c76-7b16-4c05-8c08-255e62a7cb61 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:11.665254 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-77728c76-7b16-4c05-8c08-255e62a7cb61 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:11.667262 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-77728c76-7b16-4c05-8c08-255e62a7cb61 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:11.672145 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-77728c76-7b16-4c05-8c08-255e62a7cb61 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1885 microversion: 2.32 time: 0.388700 Oct 26 13:17:11.673781 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1737/3461] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:17:11 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1885 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:17:11.686616 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7fdc6c4d-4d89-4da9-b6b9-c8b190603c0c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:11.687354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7fdc6c4d-4d89-4da9-b6b9-c8b190603c0c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:11.700340 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7fdc6c4d-4d89-4da9-b6b9-c8b190603c0c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:11.701577 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7fdc6c4d-4d89-4da9-b6b9-c8b190603c0c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:11.705960 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7fdc6c4d-4d89-4da9-b6b9-c8b190603c0c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:11.707108 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7fdc6c4d-4d89-4da9-b6b9-c8b190603c0c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:11.707664 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7fdc6c4d-4d89-4da9-b6b9-c8b190603c0c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:11.708195 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7fdc6c4d-4d89-4da9-b6b9-c8b190603c0c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:12.399506 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7fdc6c4d-4d89-4da9-b6b9-c8b190603c0c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:12.410827 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7fdc6c4d-4d89-4da9-b6b9-c8b190603c0c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8" status: 200 len: 1509 microversion: 2.1 time: 0.733723 Oct 26 13:17:12.412176 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1738/3462] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:11 2022] GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 => generated 1509 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:12.419498 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6b643eb3-24d2-4847-8335-ad87d9d412e3 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:12.420401 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6b643eb3-24d2-4847-8335-ad87d9d412e3 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: b29a1a98-a428-4967-bc4a-237971dcd264] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:12.428179 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6b643eb3-24d2-4847-8335-ad87d9d412e3 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:12.429732 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6b643eb3-24d2-4847-8335-ad87d9d412e3 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:12.430445 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6b643eb3-24d2-4847-8335-ad87d9d412e3 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:12.431787 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6b643eb3-24d2-4847-8335-ad87d9d412e3 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:12.432526 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6b643eb3-24d2-4847-8335-ad87d9d412e3 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:12.433158 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6b643eb3-24d2-4847-8335-ad87d9d412e3 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:12.852066 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-57d69bf5-903a-440a-baaf-add42801ffa3 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:17:12.852635 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-57d69bf5-903a-440a-baaf-add42801ffa3 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:17:12.853276 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-57d69bf5-903a-440a-baaf-add42801ffa3 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:17:12.854100 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-57d69bf5-903a-440a-baaf-add42801ffa3 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:17:12.854623 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-57d69bf5-903a-440a-baaf-add42801ffa3 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:17:12.864642 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57d69bf5-903a-440a-baaf-add42801ffa3 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:12.865454 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57d69bf5-903a-440a-baaf-add42801ffa3 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:12.866149 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57d69bf5-903a-440a-baaf-add42801ffa3 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:12.867232 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57d69bf5-903a-440a-baaf-add42801ffa3 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:12.867907 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57d69bf5-903a-440a-baaf-add42801ffa3 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:12.869239 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57d69bf5-903a-440a-baaf-add42801ffa3 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:12.891376 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-57d69bf5-903a-440a-baaf-add42801ffa3 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Getting quotas for project 18c0302538ba431684624b8d41dfc2f0. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:17:12.897863 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-57d69bf5-903a-440a-baaf-add42801ffa3 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Getting quotas for user 53010c15247443b29ce39f037e22ca24 and project 18c0302538ba431684624b8d41dfc2f0. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:17:12.911946 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-57d69bf5-903a-440a-baaf-add42801ffa3 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:17:12.914760 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-57d69bf5-903a-440a-baaf-add42801ffa3 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] [instance: b777991e-573a-43e3-abcb-ec40283e625d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:17:12.973438 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-57d69bf5-903a-440a-baaf-add42801ffa3 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.784443 Oct 26 13:17:12.984844 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1725/3463] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:17:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:17:12.984844 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-65c6303a-72d1-4423-9f1d-24f2ba0f5128 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:12.984844 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-65c6303a-72d1-4423-9f1d-24f2ba0f5128 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: c188efbd-a2ba-40c5-ad9e-8352eea04b8f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:13.003533 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-65c6303a-72d1-4423-9f1d-24f2ba0f5128 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:13.004032 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-65c6303a-72d1-4423-9f1d-24f2ba0f5128 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:13.004933 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-65c6303a-72d1-4423-9f1d-24f2ba0f5128 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:13.005178 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-65c6303a-72d1-4423-9f1d-24f2ba0f5128 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:13.005879 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-65c6303a-72d1-4423-9f1d-24f2ba0f5128 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:13.006285 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-65c6303a-72d1-4423-9f1d-24f2ba0f5128 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:13.225670 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-65c6303a-72d1-4423-9f1d-24f2ba0f5128 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:13.238035 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-65c6303a-72d1-4423-9f1d-24f2ba0f5128 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/c188efbd-a2ba-40c5-ad9e-8352eea04b8f" status: 200 len: 1450 microversion: 2.1 time: 0.257782 Oct 26 13:17:13.238655 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1726/3464] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:12 2022] GET /compute/v2.1/servers/c188efbd-a2ba-40c5-ad9e-8352eea04b8f => generated 1450 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:13.244384 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3cf11ef4-54c4-4a08-aa40-fb395c868ead tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:13.245223 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3cf11ef4-54c4-4a08-aa40-fb395c868ead tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:13.253172 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3cf11ef4-54c4-4a08-aa40-fb395c868ead tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:13.261092 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3cf11ef4-54c4-4a08-aa40-fb395c868ead tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:13.261746 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3cf11ef4-54c4-4a08-aa40-fb395c868ead tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:13.263060 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3cf11ef4-54c4-4a08-aa40-fb395c868ead tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:13.263547 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3cf11ef4-54c4-4a08-aa40-fb395c868ead tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:13.263983 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3cf11ef4-54c4-4a08-aa40-fb395c868ead tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:13.541891 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3cf11ef4-54c4-4a08-aa40-fb395c868ead tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:13.550733 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3cf11ef4-54c4-4a08-aa40-fb395c868ead tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1211 microversion: 2.1 time: 0.310800 Oct 26 13:17:13.557065 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1727/3465] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:13 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1211 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:13.566627 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b32d69db-fcf9-4eac-8e96-a0c93eacc04a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:13.567821 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b32d69db-fcf9-4eac-8e96-a0c93eacc04a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:13.588825 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b32d69db-fcf9-4eac-8e96-a0c93eacc04a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:13.589795 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b32d69db-fcf9-4eac-8e96-a0c93eacc04a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:13.590952 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b32d69db-fcf9-4eac-8e96-a0c93eacc04a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:13.595499 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b32d69db-fcf9-4eac-8e96-a0c93eacc04a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:13.596328 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b32d69db-fcf9-4eac-8e96-a0c93eacc04a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:13.598021 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b32d69db-fcf9-4eac-8e96-a0c93eacc04a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:13.660078 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6b643eb3-24d2-4847-8335-ad87d9d412e3 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:13.668395 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6b643eb3-24d2-4847-8335-ad87d9d412e3 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264" status: 200 len: 1314 microversion: 2.1 time: 1.254972 Oct 26 13:17:13.671186 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1739/3466] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:12 2022] GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264 => generated 1314 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:13.705343 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-25c668d2-175d-45ee-89c1-925ddd08e0e7 req-40e4514e-18f2-41ba-b317-f3249e976b7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "893420b7-27d9-4240-8182-87dd3231cbe2", "tag": "82a2023f-2039-4f62-94a6-f0654d4f4db3"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:17:13.738280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-25c668d2-175d-45ee-89c1-925ddd08e0e7 req-40e4514e-18f2-41ba-b317-f3249e976b7a service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:13.741268 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-25c668d2-175d-45ee-89c1-925ddd08e0e7 req-40e4514e-18f2-41ba-b317-f3249e976b7a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:13.744095 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-25c668d2-175d-45ee-89c1-925ddd08e0e7 req-40e4514e-18f2-41ba-b317-f3249e976b7a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:13.773101 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-25c668d2-175d-45ee-89c1-925ddd08e0e7 req-40e4514e-18f2-41ba-b317-f3249e976b7a service nova] Creating event network-changed:82a2023f-2039-4f62-94a6-f0654d4f4db3 for instance 893420b7-27d9-4240-8182-87dd3231cbe2 on n-h1-862686-1 Oct 26 13:17:13.807458 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-25c668d2-175d-45ee-89c1-925ddd08e0e7 req-40e4514e-18f2-41ba-b317-f3249e976b7a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113483 Oct 26 13:17:13.808080 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1740/3467] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:17:13.829709 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bbceec83-a4a6-4378-8b95-0008232dc29e tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:13.831244 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bbceec83-a4a6-4378-8b95-0008232dc29e tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] [instance: b777991e-573a-43e3-abcb-ec40283e625d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:13.989662 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b32d69db-fcf9-4eac-8e96-a0c93eacc04a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:14.013766 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b32d69db-fcf9-4eac-8e96-a0c93eacc04a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:14.015242 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b32d69db-fcf9-4eac-8e96-a0c93eacc04a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:14.016460 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b32d69db-fcf9-4eac-8e96-a0c93eacc04a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1885 microversion: 2.32 time: 0.457549 Oct 26 13:17:14.017042 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1728/3468] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:17:13 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1885 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:17:14.022593 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bbceec83-a4a6-4378-8b95-0008232dc29e tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53010c15247443b29ce39f037e22ca24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c0302538ba431684624b8d41dfc2f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:14.029877 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bbceec83-a4a6-4378-8b95-0008232dc29e tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] 10.222.0.40 "GET /compute/v2.1/servers/b777991e-573a-43e3-abcb-ec40283e625d" status: 200 len: 1216 microversion: 2.1 time: 0.220629 Oct 26 13:17:14.042322 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1741/3469] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:13 2022] GET /compute/v2.1/servers/b777991e-573a-43e3-abcb-ec40283e625d => generated 1216 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:14.047180 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f699e484-85fc-4226-b135-7b16b835fa11 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:14.047802 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f699e484-85fc-4226-b135-7b16b835fa11 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:14.069987 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f699e484-85fc-4226-b135-7b16b835fa11 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:14.070493 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f699e484-85fc-4226-b135-7b16b835fa11 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:14.070973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f699e484-85fc-4226-b135-7b16b835fa11 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:14.072311 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f699e484-85fc-4226-b135-7b16b835fa11 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:14.073000 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f699e484-85fc-4226-b135-7b16b835fa11 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:14.073456 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f699e484-85fc-4226-b135-7b16b835fa11 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:14.274242 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bc236fb2-1b84-470e-90e6-a0a0311ad06b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:14.275769 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bc236fb2-1b84-470e-90e6-a0a0311ad06b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: c188efbd-a2ba-40c5-ad9e-8352eea04b8f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:14.284905 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc236fb2-1b84-470e-90e6-a0a0311ad06b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:14.286430 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f699e484-85fc-4226-b135-7b16b835fa11 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:14.299806 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc236fb2-1b84-470e-90e6-a0a0311ad06b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:14.300544 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f699e484-85fc-4226-b135-7b16b835fa11 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8" status: 200 len: 1509 microversion: 2.1 time: 0.254197 Oct 26 13:17:14.301578 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc236fb2-1b84-470e-90e6-a0a0311ad06b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:14.302592 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc236fb2-1b84-470e-90e6-a0a0311ad06b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:14.303253 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc236fb2-1b84-470e-90e6-a0a0311ad06b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:14.303853 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc236fb2-1b84-470e-90e6-a0a0311ad06b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:14.317202 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1742/3470] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:14 2022] GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 => generated 1509 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:14.419957 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc236fb2-1b84-470e-90e6-a0a0311ad06b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:14.421604 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc236fb2-1b84-470e-90e6-a0a0311ad06b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:14.424120 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc236fb2-1b84-470e-90e6-a0a0311ad06b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:14.424783 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-bc236fb2-1b84-470e-90e6-a0a0311ad06b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lazy-loading 'fault' on Instance uuid c188efbd-a2ba-40c5-ad9e-8352eea04b8f {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:17:14.531146 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bc236fb2-1b84-470e-90e6-a0a0311ad06b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:14.542273 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bc236fb2-1b84-470e-90e6-a0a0311ad06b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/c188efbd-a2ba-40c5-ad9e-8352eea04b8f" status: 200 len: 1303 microversion: 2.1 time: 0.281208 Oct 26 13:17:14.559526 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1729/3471] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:14 2022] GET /compute/v2.1/servers/c188efbd-a2ba-40c5-ad9e-8352eea04b8f => generated 1303 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:14.587102 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2ca7bf10-3b2e-453f-bc23-3ef2a6a55ee2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:14.588843 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2ca7bf10-3b2e-453f-bc23-3ef2a6a55ee2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:14.622680 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ca7bf10-3b2e-453f-bc23-3ef2a6a55ee2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:14.625041 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ca7bf10-3b2e-453f-bc23-3ef2a6a55ee2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:14.628071 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ca7bf10-3b2e-453f-bc23-3ef2a6a55ee2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:14.631560 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ca7bf10-3b2e-453f-bc23-3ef2a6a55ee2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:14.632068 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ca7bf10-3b2e-453f-bc23-3ef2a6a55ee2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:14.632511 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ca7bf10-3b2e-453f-bc23-3ef2a6a55ee2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:14.700073 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d2a8dba1-ee28-4364-b1cf-6d5af0882fbe tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:14.701239 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d2a8dba1-ee28-4364-b1cf-6d5af0882fbe tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: b29a1a98-a428-4967-bc4a-237971dcd264] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:14.714278 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d2a8dba1-ee28-4364-b1cf-6d5af0882fbe tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:14.716813 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d2a8dba1-ee28-4364-b1cf-6d5af0882fbe tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:14.718533 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d2a8dba1-ee28-4364-b1cf-6d5af0882fbe tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:14.719470 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d2a8dba1-ee28-4364-b1cf-6d5af0882fbe tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:14.722109 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d2a8dba1-ee28-4364-b1cf-6d5af0882fbe tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:14.725564 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d2a8dba1-ee28-4364-b1cf-6d5af0882fbe tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:15.000613 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d2a8dba1-ee28-4364-b1cf-6d5af0882fbe tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:15.012279 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d2a8dba1-ee28-4364-b1cf-6d5af0882fbe tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264" status: 200 len: 1314 microversion: 2.1 time: 0.317570 Oct 26 13:17:15.013902 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1730/3472] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:14 2022] GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264 => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:15.018819 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-bec27497-842c-4b22-90c6-914e684428a5 req-5c7c2135-271a-401d-8a5b-9944ccd40da5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b29a1a98-a428-4967-bc4a-237971dcd264", "name": "network-vif-plugged", "status": "completed", "tag": "2898cac6-24b9-4e25-b557-8f996344f010"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:17:15.034078 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-bec27497-842c-4b22-90c6-914e684428a5 req-5c7c2135-271a-401d-8a5b-9944ccd40da5 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:15.034738 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-bec27497-842c-4b22-90c6-914e684428a5 req-5c7c2135-271a-401d-8a5b-9944ccd40da5 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:15.035265 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-bec27497-842c-4b22-90c6-914e684428a5 req-5c7c2135-271a-401d-8a5b-9944ccd40da5 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:15.041381 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:17:15.053820 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-bec27497-842c-4b22-90c6-914e684428a5 req-5c7c2135-271a-401d-8a5b-9944ccd40da5 service nova] Creating event network-vif-plugged:2898cac6-24b9-4e25-b557-8f996344f010 for instance b29a1a98-a428-4967-bc4a-237971dcd264 on n-h2-862686-1 Oct 26 13:17:15.060108 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-bec27497-842c-4b22-90c6-914e684428a5 req-5c7c2135-271a-401d-8a5b-9944ccd40da5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044772 Oct 26 13:17:15.061151 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1731/3473] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:17:15.069685 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5b323bbc-d868-4313-a8b0-571937d87b09 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:15.070475 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5b323bbc-d868-4313-a8b0-571937d87b09 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:15.078872 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5b323bbc-d868-4313-a8b0-571937d87b09 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:15.079878 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5b323bbc-d868-4313-a8b0-571937d87b09 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:15.080540 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5b323bbc-d868-4313-a8b0-571937d87b09 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:15.081502 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5b323bbc-d868-4313-a8b0-571937d87b09 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:15.082170 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5b323bbc-d868-4313-a8b0-571937d87b09 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:15.083099 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5b323bbc-d868-4313-a8b0-571937d87b09 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:15.306926 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5b323bbc-d868-4313-a8b0-571937d87b09 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:15.321101 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5b323bbc-d868-4313-a8b0-571937d87b09 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:15.323744 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5b323bbc-d868-4313-a8b0-571937d87b09 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:15.327324 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5b323bbc-d868-4313-a8b0-571937d87b09 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1885 microversion: 2.32 time: 0.262297 Oct 26 13:17:15.329676 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1732/3474] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:17:15 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1885 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:17:15.335337 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4233e0df-13e8-4d3b-b240-4d51217a37b2 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:15.336330 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4233e0df-13e8-4d3b-b240-4d51217a37b2 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] [instance: b777991e-573a-43e3-abcb-ec40283e625d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:15.343757 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4233e0df-13e8-4d3b-b240-4d51217a37b2 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:15.345319 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4233e0df-13e8-4d3b-b240-4d51217a37b2 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:15.345900 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4233e0df-13e8-4d3b-b240-4d51217a37b2 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:15.346865 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4233e0df-13e8-4d3b-b240-4d51217a37b2 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:15.347524 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4233e0df-13e8-4d3b-b240-4d51217a37b2 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:15.348410 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4233e0df-13e8-4d3b-b240-4d51217a37b2 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:15.406173 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2ca7bf10-3b2e-453f-bc23-3ef2a6a55ee2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:15.415963 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2ca7bf10-3b2e-453f-bc23-3ef2a6a55ee2 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1211 microversion: 2.1 time: 0.840378 Oct 26 13:17:15.417337 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1743/3475] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:14 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1211 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:15.422901 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7a8f2fcc-2fea-4858-9963-5d56c2397c15 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:15.423830 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7a8f2fcc-2fea-4858-9963-5d56c2397c15 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:15.430160 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a8f2fcc-2fea-4858-9963-5d56c2397c15 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:15.432207 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a8f2fcc-2fea-4858-9963-5d56c2397c15 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:15.432865 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a8f2fcc-2fea-4858-9963-5d56c2397c15 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:15.433618 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a8f2fcc-2fea-4858-9963-5d56c2397c15 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:15.434258 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a8f2fcc-2fea-4858-9963-5d56c2397c15 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:15.434688 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a8f2fcc-2fea-4858-9963-5d56c2397c15 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:15.443254 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4233e0df-13e8-4d3b-b240-4d51217a37b2 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53010c15247443b29ce39f037e22ca24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c0302538ba431684624b8d41dfc2f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:15.453622 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4233e0df-13e8-4d3b-b240-4d51217a37b2 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] 10.222.0.40 "GET /compute/v2.1/servers/b777991e-573a-43e3-abcb-ec40283e625d" status: 200 len: 1268 microversion: 2.1 time: 0.122858 Oct 26 13:17:15.455546 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1733/3476] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:15 2022] GET /compute/v2.1/servers/b777991e-573a-43e3-abcb-ec40283e625d => generated 1268 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:15.566225 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-732941cf-0efe-4e76-a33f-60e300b81051 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:15.567222 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-732941cf-0efe-4e76-a33f-60e300b81051 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: c188efbd-a2ba-40c5-ad9e-8352eea04b8f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:15.594061 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-732941cf-0efe-4e76-a33f-60e300b81051 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:15.599608 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-732941cf-0efe-4e76-a33f-60e300b81051 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:15.600303 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-732941cf-0efe-4e76-a33f-60e300b81051 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:15.601270 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-732941cf-0efe-4e76-a33f-60e300b81051 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:15.603158 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-732941cf-0efe-4e76-a33f-60e300b81051 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:15.603983 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-732941cf-0efe-4e76-a33f-60e300b81051 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:15.628621 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-732941cf-0efe-4e76-a33f-60e300b81051 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] HTTP exception thrown: Instance c188efbd-a2ba-40c5-ad9e-8352eea04b8f could not be found. Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-732941cf-0efe-4e76-a33f-60e300b81051 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Request method failure captured: Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/c188efbd-a2ba-40c5-ad9e-8352eea04b8f HTTP/1.1 Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTLTNOlsUS_LQCwMyQbAmNSS-N_AQOqf9a-vHlBM4RS64aXMIGczutoYb0yXKXV63kqVyJMbrGhj1O0dIymI3rB4OYRTseWpFfzGHfB9PKKsR2NnI_ukYFvVdYRwcazuK9kTcZsmuh-2k9d7Yqn3gprd7n0NXcu2P16gbCixvzOdrAQ Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: ece49f83e645408598655bece0873fd0 Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ece49f83e645408598655bece0873fd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ece49f83e645408598655bece0873fd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ece49f83e645408598655bece0873fd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ece49f83e645408598655bece0873fd0"}]}] Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: ece49f83e645408598655bece0873fd0 Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-DeleteServersTestJSON-1847538505-project Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 8d56acbbbc3545d19cbb80f4e349c763 Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-DeleteServersTestJSON-1847538505-project Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance c188efbd-a2ba-40c5-ad9e-8352eea04b8f could not be found. Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'c188efbd-a2ba-40c5-ad9e-8352eea04b8f'} Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c188efbd-a2ba-40c5-ad9e-8352eea04b8f could not be found. Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c188efbd-a2ba-40c5-ad9e-8352eea04b8f could not be found. Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:17:15.630859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:15.640198 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:15.640198 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:17:15.640198 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:17:15.640198 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:17:15.640198 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:17:15.640198 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c188efbd-a2ba-40c5-ad9e-8352eea04b8f could not be found. Oct 26 13:17:15.640198 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:15.640198 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-732941cf-0efe-4e76-a33f-60e300b81051 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Returning 404 to user: Instance c188efbd-a2ba-40c5-ad9e-8352eea04b8f could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:17:15.640198 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-732941cf-0efe-4e76-a33f-60e300b81051 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/c188efbd-a2ba-40c5-ad9e-8352eea04b8f" status: 404 len: 111 microversion: 2.1 time: 0.074213 Oct 26 13:17:15.650961 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1734/3477] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:15 2022] GET /compute/v2.1/servers/c188efbd-a2ba-40c5-ad9e-8352eea04b8f => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 13:17:15.722409 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7a8f2fcc-2fea-4858-9963-5d56c2397c15 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:15.732882 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7a8f2fcc-2fea-4858-9963-5d56c2397c15 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8" status: 200 len: 1509 microversion: 2.1 time: 0.314193 Oct 26 13:17:15.739040 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1744/3478] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:15 2022] GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 => generated 1509 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:15.807772 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-11a8ac94-2423-4d79-ac7b-dfe90e5426fa tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1153062306", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "cb59e2c8-6bcb-4fcf-b9e4-c01412b43c60"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:17:15.891354 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-11a8ac94-2423-4d79-ac7b-dfe90e5426fa tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] validate_networks() for [('cb59e2c8-6bcb-4fcf-b9e4-c01412b43c60', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:17:15.895147 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-000560db-5d29-49a0-bea8-163755f46057 req-a47827d1-564f-4d39-8792-7906fcff766c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c188efbd-a2ba-40c5-ad9e-8352eea04b8f", "name": "network-vif-deleted", "tag": "0e6f8688-de29-4b32-9dc4-f97b8fc35edd"}, {"name": "network-changed", "server_uuid": "893420b7-27d9-4240-8182-87dd3231cbe2", "tag": "4f406596-ab15-464c-88f4-1a3c9b70369c"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:17:15.915006 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-000560db-5d29-49a0-bea8-163755f46057 req-a47827d1-564f-4d39-8792-7906fcff766c service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:15.916386 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-000560db-5d29-49a0-bea8-163755f46057 req-a47827d1-564f-4d39-8792-7906fcff766c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:15.917007 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-000560db-5d29-49a0-bea8-163755f46057 req-a47827d1-564f-4d39-8792-7906fcff766c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:15.946434 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-000560db-5d29-49a0-bea8-163755f46057 req-a47827d1-564f-4d39-8792-7906fcff766c service nova] Creating event network-vif-deleted:0e6f8688-de29-4b32-9dc4-f97b8fc35edd for instance c188efbd-a2ba-40c5-ad9e-8352eea04b8f on n-h1-862686-1 Oct 26 13:17:15.947089 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-000560db-5d29-49a0-bea8-163755f46057 req-a47827d1-564f-4d39-8792-7906fcff766c service nova] Creating event network-changed:4f406596-ab15-464c-88f4-1a3c9b70369c for instance 893420b7-27d9-4240-8182-87dd3231cbe2 on n-h1-862686-1 Oct 26 13:17:15.964038 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-000560db-5d29-49a0-bea8-163755f46057 req-a47827d1-564f-4d39-8792-7906fcff766c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.072495 Oct 26 13:17:15.966590 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1745/3479] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:17:16.039762 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5056634b-97df-4291-a05b-54ff5d12f2e5 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:16.041086 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5056634b-97df-4291-a05b-54ff5d12f2e5 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: b29a1a98-a428-4967-bc4a-237971dcd264] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:16.057191 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5056634b-97df-4291-a05b-54ff5d12f2e5 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:16.057648 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5056634b-97df-4291-a05b-54ff5d12f2e5 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:16.058102 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5056634b-97df-4291-a05b-54ff5d12f2e5 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:16.058825 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5056634b-97df-4291-a05b-54ff5d12f2e5 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:16.059280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5056634b-97df-4291-a05b-54ff5d12f2e5 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:16.059706 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5056634b-97df-4291-a05b-54ff5d12f2e5 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:16.392998 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5056634b-97df-4291-a05b-54ff5d12f2e5 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:16.405325 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5056634b-97df-4291-a05b-54ff5d12f2e5 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264" status: 200 len: 1314 microversion: 2.1 time: 0.370190 Oct 26 13:17:16.406882 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1746/3480] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:16 2022] GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264 => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:16.412977 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-32e76938-abb6-41ef-ab9f-76a6dcfe5a8b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:16.414504 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-32e76938-abb6-41ef-ab9f-76a6dcfe5a8b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:16.423339 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32e76938-abb6-41ef-ab9f-76a6dcfe5a8b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:16.424095 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32e76938-abb6-41ef-ab9f-76a6dcfe5a8b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:16.424703 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32e76938-abb6-41ef-ab9f-76a6dcfe5a8b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:16.425714 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32e76938-abb6-41ef-ab9f-76a6dcfe5a8b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:16.426330 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32e76938-abb6-41ef-ab9f-76a6dcfe5a8b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:16.426914 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32e76938-abb6-41ef-ab9f-76a6dcfe5a8b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:16.731304 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-11a8ac94-2423-4d79-ac7b-dfe90e5426fa tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:17:16.731841 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-11a8ac94-2423-4d79-ac7b-dfe90e5426fa tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:17:16.732195 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-11a8ac94-2423-4d79-ac7b-dfe90e5426fa tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:17:16.732600 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-11a8ac94-2423-4d79-ac7b-dfe90e5426fa tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:17:16.733008 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-11a8ac94-2423-4d79-ac7b-dfe90e5426fa tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:17:16.735454 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:17:16.762759 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-11a8ac94-2423-4d79-ac7b-dfe90e5426fa tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:16.763267 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-11a8ac94-2423-4d79-ac7b-dfe90e5426fa tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:16.763760 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-11a8ac94-2423-4d79-ac7b-dfe90e5426fa tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:16.764659 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-11a8ac94-2423-4d79-ac7b-dfe90e5426fa tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:16.765252 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-11a8ac94-2423-4d79-ac7b-dfe90e5426fa tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:16.765794 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-11a8ac94-2423-4d79-ac7b-dfe90e5426fa tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:16.784675 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-32e76938-abb6-41ef-ab9f-76a6dcfe5a8b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:16.787933 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-11a8ac94-2423-4d79-ac7b-dfe90e5426fa tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Getting quotas for project ece49f83e645408598655bece0873fd0. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:17:16.795054 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-11a8ac94-2423-4d79-ac7b-dfe90e5426fa tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Getting quotas for user 8d56acbbbc3545d19cbb80f4e349c763 and project ece49f83e645408598655bece0873fd0. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:17:16.812589 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-11a8ac94-2423-4d79-ac7b-dfe90e5426fa tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:17:16.815227 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-11a8ac94-2423-4d79-ac7b-dfe90e5426fa tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:17:16.819281 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-32e76938-abb6-41ef-ab9f-76a6dcfe5a8b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:16.826785 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-32e76938-abb6-41ef-ab9f-76a6dcfe5a8b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:16.832816 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-32e76938-abb6-41ef-ab9f-76a6dcfe5a8b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1885 microversion: 2.32 time: 0.421542 Oct 26 13:17:16.844436 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1747/3481] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:17:16 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1885 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:17:16.849171 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-840ed0ed-c833-4ead-92c4-c4eacce6de4d tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:16.854407 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-840ed0ed-c833-4ead-92c4-c4eacce6de4d tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:16.869510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-840ed0ed-c833-4ead-92c4-c4eacce6de4d tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:16.870260 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-840ed0ed-c833-4ead-92c4-c4eacce6de4d tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:16.871954 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-840ed0ed-c833-4ead-92c4-c4eacce6de4d tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:16.872701 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-840ed0ed-c833-4ead-92c4-c4eacce6de4d tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:16.873165 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-840ed0ed-c833-4ead-92c4-c4eacce6de4d tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:16.873628 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-840ed0ed-c833-4ead-92c4-c4eacce6de4d tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:16.930576 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-11a8ac94-2423-4d79-ac7b-dfe90e5426fa tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.127331 Oct 26 13:17:16.934804 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1735/3482] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:17:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1133 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:17:16.945925 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-17795b5b-7a4b-4fe1-b30f-48872a776f46 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:16.947068 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-17795b5b-7a4b-4fe1-b30f-48872a776f46 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] [instance: b777991e-573a-43e3-abcb-ec40283e625d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:16.960218 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17795b5b-7a4b-4fe1-b30f-48872a776f46 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:16.961148 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17795b5b-7a4b-4fe1-b30f-48872a776f46 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:16.961892 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17795b5b-7a4b-4fe1-b30f-48872a776f46 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:16.963564 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17795b5b-7a4b-4fe1-b30f-48872a776f46 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:16.964759 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17795b5b-7a4b-4fe1-b30f-48872a776f46 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:16.966253 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17795b5b-7a4b-4fe1-b30f-48872a776f46 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:17.268783 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-840ed0ed-c833-4ead-92c4-c4eacce6de4d tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:17.298242 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-840ed0ed-c833-4ead-92c4-c4eacce6de4d tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1199 microversion: 2.1 time: 0.458340 Oct 26 13:17:17.312819 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1748/3483] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:16 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1199 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:17.330846 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-76751cd9-d9c4-44f8-ae5d-2fbe4fe0be19 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:17.331510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-76751cd9-d9c4-44f8-ae5d-2fbe4fe0be19 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:17.340205 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76751cd9-d9c4-44f8-ae5d-2fbe4fe0be19 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:17.340945 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76751cd9-d9c4-44f8-ae5d-2fbe4fe0be19 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:17.341610 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76751cd9-d9c4-44f8-ae5d-2fbe4fe0be19 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:17.345975 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76751cd9-d9c4-44f8-ae5d-2fbe4fe0be19 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:17.346647 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76751cd9-d9c4-44f8-ae5d-2fbe4fe0be19 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:17.350717 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76751cd9-d9c4-44f8-ae5d-2fbe4fe0be19 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:17.379425 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-17795b5b-7a4b-4fe1-b30f-48872a776f46 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53010c15247443b29ce39f037e22ca24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c0302538ba431684624b8d41dfc2f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:17.393225 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-17795b5b-7a4b-4fe1-b30f-48872a776f46 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] 10.222.0.40 "GET /compute/v2.1/servers/b777991e-573a-43e3-abcb-ec40283e625d" status: 200 len: 1316 microversion: 2.1 time: 0.457019 Oct 26 13:17:17.414198 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1736/3484] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:16 2022] GET /compute/v2.1/servers/b777991e-573a-43e3-abcb-ec40283e625d => generated 1316 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:17.420286 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c724d958-08fe-4e90-826a-57957abaf85c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:17.420903 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c724d958-08fe-4e90-826a-57957abaf85c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:17.526758 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c724d958-08fe-4e90-826a-57957abaf85c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:17.534011 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c724d958-08fe-4e90-826a-57957abaf85c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1215 microversion: 2.1 time: 0.118305 Oct 26 13:17:17.534413 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1737/3485] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:17 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1215 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:17.556059 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5d0b3fae-1aa5-4348-8676-76de569b3487 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:17.557208 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5d0b3fae-1aa5-4348-8676-76de569b3487 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: b29a1a98-a428-4967-bc4a-237971dcd264] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:17.564284 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d0b3fae-1aa5-4348-8676-76de569b3487 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:17.564962 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d0b3fae-1aa5-4348-8676-76de569b3487 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:17.565646 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d0b3fae-1aa5-4348-8676-76de569b3487 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:17.566599 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d0b3fae-1aa5-4348-8676-76de569b3487 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:17.567225 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d0b3fae-1aa5-4348-8676-76de569b3487 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:17.567816 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d0b3fae-1aa5-4348-8676-76de569b3487 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:17.652330 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-76751cd9-d9c4-44f8-ae5d-2fbe4fe0be19 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:17.664330 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-76751cd9-d9c4-44f8-ae5d-2fbe4fe0be19 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8" status: 200 len: 1486 microversion: 2.1 time: 0.343228 Oct 26 13:17:17.682746 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1749/3486] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:17 2022] GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 => generated 1486 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:17.690506 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5b803b40-d9d8-4f07-92c7-363bce22f627 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-582011164"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:17:17.695256 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5b803b40-d9d8-4f07-92c7-363bce22f627 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:17.705036 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b803b40-d9d8-4f07-92c7-363bce22f627 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:17.705568 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b803b40-d9d8-4f07-92c7-363bce22f627 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:17.706016 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b803b40-d9d8-4f07-92c7-363bce22f627 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:17.706776 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b803b40-d9d8-4f07-92c7-363bce22f627 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:17.707246 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b803b40-d9d8-4f07-92c7-363bce22f627 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:17.707676 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b803b40-d9d8-4f07-92c7-363bce22f627 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:17.793023 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5b803b40-d9d8-4f07-92c7-363bce22f627 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "PUT /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8" status: 200 len: 1058 microversion: 2.1 time: 0.107047 Oct 26 13:17:17.794525 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1750/3487] 10.222.0.40 () {60 vars in 1256 bytes} [Wed Oct 26 13:17:17 2022] PUT /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 => generated 1058 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:17:17.813185 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8afb2984-5e24-4ba3-8e3f-624417460b75 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:17.814109 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8afb2984-5e24-4ba3-8e3f-624417460b75 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:17.820609 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8afb2984-5e24-4ba3-8e3f-624417460b75 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:17.821022 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8afb2984-5e24-4ba3-8e3f-624417460b75 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:17.821457 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8afb2984-5e24-4ba3-8e3f-624417460b75 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:17.822528 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8afb2984-5e24-4ba3-8e3f-624417460b75 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:17.823117 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8afb2984-5e24-4ba3-8e3f-624417460b75 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:17.823680 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8afb2984-5e24-4ba3-8e3f-624417460b75 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:17.857741 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5d0b3fae-1aa5-4348-8676-76de569b3487 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:17.871977 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5d0b3fae-1aa5-4348-8676-76de569b3487 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264" status: 200 len: 1314 microversion: 2.1 time: 0.320540 Oct 26 13:17:17.872953 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1738/3488] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:17 2022] GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264 => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:17.879770 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-78bd611a-ef69-4a17-81ce-282e68d64ac9 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:17.880619 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-78bd611a-ef69-4a17-81ce-282e68d64ac9 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:17.888148 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78bd611a-ef69-4a17-81ce-282e68d64ac9 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:17.888710 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78bd611a-ef69-4a17-81ce-282e68d64ac9 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:17.889163 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78bd611a-ef69-4a17-81ce-282e68d64ac9 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:17.890951 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78bd611a-ef69-4a17-81ce-282e68d64ac9 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:17.891876 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78bd611a-ef69-4a17-81ce-282e68d64ac9 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:17.892393 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78bd611a-ef69-4a17-81ce-282e68d64ac9 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:18.091554 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8afb2984-5e24-4ba3-8e3f-624417460b75 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:18.100154 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8afb2984-5e24-4ba3-8e3f-624417460b75 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8" status: 200 len: 1485 microversion: 2.1 time: 0.290883 Oct 26 13:17:18.101401 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1751/3489] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:17 2022] GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 => generated 1485 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:17:18.123320 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c4fe7d42-2b5c-4784-a1a8-c0335cf9d8cf tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:18.124230 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c4fe7d42-2b5c-4784-a1a8-c0335cf9d8cf tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:18.130408 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:17:18.131837 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4fe7d42-2b5c-4784-a1a8-c0335cf9d8cf tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:18.132335 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4fe7d42-2b5c-4784-a1a8-c0335cf9d8cf tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:18.132773 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4fe7d42-2b5c-4784-a1a8-c0335cf9d8cf tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:18.134741 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4fe7d42-2b5c-4784-a1a8-c0335cf9d8cf tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:18.135455 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4fe7d42-2b5c-4784-a1a8-c0335cf9d8cf tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:18.135880 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4fe7d42-2b5c-4784-a1a8-c0335cf9d8cf tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:18.237620 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-78bd611a-ef69-4a17-81ce-282e68d64ac9 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:18.247737 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-78bd611a-ef69-4a17-81ce-282e68d64ac9 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:18.249567 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-78bd611a-ef69-4a17-81ce-282e68d64ac9 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:18.250489 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-78bd611a-ef69-4a17-81ce-282e68d64ac9 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1873 microversion: 2.32 time: 0.375057 Oct 26 13:17:18.251156 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1739/3490] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:17:17 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1873 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:17:18.328405 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d90c1342-0506-4f1e-9a9b-68120f19f622 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:18.329076 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d90c1342-0506-4f1e-9a9b-68120f19f622 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:18.335695 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d90c1342-0506-4f1e-9a9b-68120f19f622 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:18.336266 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d90c1342-0506-4f1e-9a9b-68120f19f622 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:18.336808 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d90c1342-0506-4f1e-9a9b-68120f19f622 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:18.337683 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d90c1342-0506-4f1e-9a9b-68120f19f622 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:18.338420 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d90c1342-0506-4f1e-9a9b-68120f19f622 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:18.338926 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d90c1342-0506-4f1e-9a9b-68120f19f622 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:18.371918 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c4fe7d42-2b5c-4784-a1a8-c0335cf9d8cf tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:18.383843 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c4fe7d42-2b5c-4784-a1a8-c0335cf9d8cf tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8" status: 200 len: 1485 microversion: 2.1 time: 0.265166 Oct 26 13:17:18.384825 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1752/3491] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:18 2022] GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 => generated 1485 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:18.406878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-90b07ec6-2d01-434e-89ff-bf89c800c96d tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:18.407375 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-90b07ec6-2d01-434e-89ff-bf89c800c96d tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:18.413790 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90b07ec6-2d01-434e-89ff-bf89c800c96d tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:18.414670 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90b07ec6-2d01-434e-89ff-bf89c800c96d tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:18.416164 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90b07ec6-2d01-434e-89ff-bf89c800c96d tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:18.418044 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90b07ec6-2d01-434e-89ff-bf89c800c96d tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:18.418669 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90b07ec6-2d01-434e-89ff-bf89c800c96d tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:18.419087 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90b07ec6-2d01-434e-89ff-bf89c800c96d tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:18.447169 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-90b07ec6-2d01-434e-89ff-bf89c800c96d tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:17:18.450191 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:17:18.536032 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-90b07ec6-2d01-434e-89ff-bf89c800c96d tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8" status: 204 len: 0 microversion: 2.1 time: 0.132859 Oct 26 13:17:18.537701 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1753/3492] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:17:18 2022] DELETE /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 26 13:17:18.547005 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-033b2ad8-4756-473f-b5bc-c00b62601973 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:18.547803 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-033b2ad8-4756-473f-b5bc-c00b62601973 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] [instance: b777991e-573a-43e3-abcb-ec40283e625d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:18.554852 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-033b2ad8-4756-473f-b5bc-c00b62601973 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:18.555577 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-033b2ad8-4756-473f-b5bc-c00b62601973 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:18.556722 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-033b2ad8-4756-473f-b5bc-c00b62601973 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:18.557760 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-033b2ad8-4756-473f-b5bc-c00b62601973 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:18.558423 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-033b2ad8-4756-473f-b5bc-c00b62601973 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:18.558857 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-033b2ad8-4756-473f-b5bc-c00b62601973 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:18.598617 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d90c1342-0506-4f1e-9a9b-68120f19f622 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:18.607486 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d90c1342-0506-4f1e-9a9b-68120f19f622 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1199 microversion: 2.1 time: 0.285626 Oct 26 13:17:18.608340 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1740/3493] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:18 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1199 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:17:18.613222 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-96838276-c014-40cb-96e1-b9b03a81abef req-777b7cc4-f1dd-4b5b-88a8-a32266448b49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b777991e-573a-43e3-abcb-ec40283e625d", "tag": "42310a0c-3052-4cd8-b220-3b7a3cb26c88"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:17:18.626972 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-96838276-c014-40cb-96e1-b9b03a81abef req-777b7cc4-f1dd-4b5b-88a8-a32266448b49 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:18.627452 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-96838276-c014-40cb-96e1-b9b03a81abef req-777b7cc4-f1dd-4b5b-88a8-a32266448b49 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:18.628077 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-96838276-c014-40cb-96e1-b9b03a81abef req-777b7cc4-f1dd-4b5b-88a8-a32266448b49 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:18.641184 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-96838276-c014-40cb-96e1-b9b03a81abef req-777b7cc4-f1dd-4b5b-88a8-a32266448b49 service nova] Creating event network-changed:42310a0c-3052-4cd8-b220-3b7a3cb26c88 for instance b777991e-573a-43e3-abcb-ec40283e625d on n-h2-862686-1 Oct 26 13:17:18.646793 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-96838276-c014-40cb-96e1-b9b03a81abef req-777b7cc4-f1dd-4b5b-88a8-a32266448b49 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036857 Oct 26 13:17:18.647743 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1741/3494] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:17:18.653325 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f27dbdb7-2c05-462d-9db7-3457e8cfff98 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:18.654364 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f27dbdb7-2c05-462d-9db7-3457e8cfff98 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:18.660699 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f27dbdb7-2c05-462d-9db7-3457e8cfff98 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:18.661400 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f27dbdb7-2c05-462d-9db7-3457e8cfff98 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:18.662054 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f27dbdb7-2c05-462d-9db7-3457e8cfff98 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:18.662925 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f27dbdb7-2c05-462d-9db7-3457e8cfff98 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:18.663539 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f27dbdb7-2c05-462d-9db7-3457e8cfff98 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:18.664230 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f27dbdb7-2c05-462d-9db7-3457e8cfff98 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:18.815768 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f27dbdb7-2c05-462d-9db7-3457e8cfff98 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:18.824551 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f27dbdb7-2c05-462d-9db7-3457e8cfff98 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8" status: 200 len: 1491 microversion: 2.1 time: 0.175647 Oct 26 13:17:18.825138 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1742/3495] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:18 2022] GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 => generated 1491 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:18.830417 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1081b36c-91a2-4565-aa27-007dffbaa83c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:18.831232 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1081b36c-91a2-4565-aa27-007dffbaa83c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:18.836990 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1081b36c-91a2-4565-aa27-007dffbaa83c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:18.838180 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1081b36c-91a2-4565-aa27-007dffbaa83c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:18.838751 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1081b36c-91a2-4565-aa27-007dffbaa83c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:18.839279 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1081b36c-91a2-4565-aa27-007dffbaa83c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:18.839743 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1081b36c-91a2-4565-aa27-007dffbaa83c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:18.840190 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1081b36c-91a2-4565-aa27-007dffbaa83c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:18.889857 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-033b2ad8-4756-473f-b5bc-c00b62601973 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53010c15247443b29ce39f037e22ca24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c0302538ba431684624b8d41dfc2f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:18.899538 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-033b2ad8-4756-473f-b5bc-c00b62601973 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] 10.222.0.40 "GET /compute/v2.1/servers/b777991e-573a-43e3-abcb-ec40283e625d" status: 200 len: 1316 microversion: 2.1 time: 0.360196 Oct 26 13:17:18.900917 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1754/3496] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:18 2022] GET /compute/v2.1/servers/b777991e-573a-43e3-abcb-ec40283e625d => generated 1316 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:18.906486 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1081b36c-91a2-4565-aa27-007dffbaa83c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:18.916478 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-70ab2188-5b16-48c0-98b1-9f6a8f9ddf40 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:18.918292 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-70ab2188-5b16-48c0-98b1-9f6a8f9ddf40 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: b29a1a98-a428-4967-bc4a-237971dcd264] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:18.919324 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1081b36c-91a2-4565-aa27-007dffbaa83c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1273 microversion: 2.1 time: 0.093081 Oct 26 13:17:18.920172 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1743/3497] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:18 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1273 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:18.934990 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70ab2188-5b16-48c0-98b1-9f6a8f9ddf40 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:18.935640 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70ab2188-5b16-48c0-98b1-9f6a8f9ddf40 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:18.936149 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70ab2188-5b16-48c0-98b1-9f6a8f9ddf40 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:18.937067 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70ab2188-5b16-48c0-98b1-9f6a8f9ddf40 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:18.937552 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70ab2188-5b16-48c0-98b1-9f6a8f9ddf40 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:18.937985 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70ab2188-5b16-48c0-98b1-9f6a8f9ddf40 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:19.203977 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-70ab2188-5b16-48c0-98b1-9f6a8f9ddf40 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:19.214738 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-70ab2188-5b16-48c0-98b1-9f6a8f9ddf40 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264" status: 200 len: 1501 microversion: 2.1 time: 0.309757 Oct 26 13:17:19.230027 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1755/3498] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:18 2022] GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264 => generated 1501 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:19.238252 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bd61300d-4cf2-4fe9-afd1-6d337010874e tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:17:19.241242 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bd61300d-4cf2-4fe9-afd1-6d337010874e tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: b29a1a98-a428-4967-bc4a-237971dcd264] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:19.248657 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd61300d-4cf2-4fe9-afd1-6d337010874e tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:19.249178 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd61300d-4cf2-4fe9-afd1-6d337010874e tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:19.249711 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd61300d-4cf2-4fe9-afd1-6d337010874e tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:19.250862 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd61300d-4cf2-4fe9-afd1-6d337010874e tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:19.251832 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd61300d-4cf2-4fe9-afd1-6d337010874e tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:19.252270 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd61300d-4cf2-4fe9-afd1-6d337010874e tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:19.277130 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-429e91fc-a695-4fa0-b228-f4775227f542 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:19.277952 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-429e91fc-a695-4fa0-b228-f4775227f542 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:19.281791 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-bd61300d-4cf2-4fe9-afd1-6d337010874e tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lazy-loading 'flavor' on Instance uuid b29a1a98-a428-4967-bc4a-237971dcd264 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:17:19.284921 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-429e91fc-a695-4fa0-b228-f4775227f542 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:19.285552 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-429e91fc-a695-4fa0-b228-f4775227f542 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:19.286262 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-429e91fc-a695-4fa0-b228-f4775227f542 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:19.287209 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-429e91fc-a695-4fa0-b228-f4775227f542 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:19.287798 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-429e91fc-a695-4fa0-b228-f4775227f542 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:19.288331 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-429e91fc-a695-4fa0-b228-f4775227f542 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:19.360830 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bd61300d-4cf2-4fe9-afd1-6d337010874e tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "POST /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264/action" status: 200 len: 32 microversion: 2.1 time: 0.127614 Oct 26 13:17:19.361447 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1744/3499] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:17:19 2022] POST /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264/action => generated 32 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:17:19.371664 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-54e00373-c927-47cf-b739-5293cc153d73 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:19.372371 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-54e00373-c927-47cf-b739-5293cc153d73 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: b29a1a98-a428-4967-bc4a-237971dcd264] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:19.378525 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54e00373-c927-47cf-b739-5293cc153d73 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:19.379015 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54e00373-c927-47cf-b739-5293cc153d73 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:19.379456 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54e00373-c927-47cf-b739-5293cc153d73 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:19.380155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54e00373-c927-47cf-b739-5293cc153d73 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:19.380617 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54e00373-c927-47cf-b739-5293cc153d73 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:19.381049 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54e00373-c927-47cf-b739-5293cc153d73 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:19.520696 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-54e00373-c927-47cf-b739-5293cc153d73 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:19.529830 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-54e00373-c927-47cf-b739-5293cc153d73 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264" status: 200 len: 1507 microversion: 2.1 time: 0.162409 Oct 26 13:17:19.530422 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1745/3500] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:19 2022] GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264 => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:17:19.633154 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-38559d62-97af-4734-a734-40fe538c4c08 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:19.633791 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-38559d62-97af-4734-a734-40fe538c4c08 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:19.641183 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38559d62-97af-4734-a734-40fe538c4c08 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:19.641705 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38559d62-97af-4734-a734-40fe538c4c08 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:19.642168 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38559d62-97af-4734-a734-40fe538c4c08 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:19.642862 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38559d62-97af-4734-a734-40fe538c4c08 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:19.643314 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38559d62-97af-4734-a734-40fe538c4c08 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:19.643734 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38559d62-97af-4734-a734-40fe538c4c08 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:19.647754 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-429e91fc-a695-4fa0-b228-f4775227f542 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:19.659410 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-429e91fc-a695-4fa0-b228-f4775227f542 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:19.661859 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-429e91fc-a695-4fa0-b228-f4775227f542 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:19.664482 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-429e91fc-a695-4fa0-b228-f4775227f542 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1873 microversion: 2.32 time: 0.391936 Oct 26 13:17:19.672031 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1756/3501] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:17:19 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1873 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:17:19.851172 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-96862d23-0c0d-4bf4-8e3a-53a6e0faf8a5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:19.852065 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-96862d23-0c0d-4bf4-8e3a-53a6e0faf8a5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:19.869907 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-96862d23-0c0d-4bf4-8e3a-53a6e0faf8a5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:19.870549 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-96862d23-0c0d-4bf4-8e3a-53a6e0faf8a5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:19.878320 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-96862d23-0c0d-4bf4-8e3a-53a6e0faf8a5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:19.879497 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-96862d23-0c0d-4bf4-8e3a-53a6e0faf8a5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:19.879886 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-96862d23-0c0d-4bf4-8e3a-53a6e0faf8a5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:19.880570 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-96862d23-0c0d-4bf4-8e3a-53a6e0faf8a5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:19.903291 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-38559d62-97af-4734-a734-40fe538c4c08 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:19.914875 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-38559d62-97af-4734-a734-40fe538c4c08 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1199 microversion: 2.1 time: 0.286193 Oct 26 13:17:19.917386 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1746/3502] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:19 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1199 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:19.955259 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c3060206-5df2-40aa-ba70-ce799923d58f tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:19.956268 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c3060206-5df2-40aa-ba70-ce799923d58f tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] [instance: b777991e-573a-43e3-abcb-ec40283e625d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:19.965003 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c3060206-5df2-40aa-ba70-ce799923d58f tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:19.965521 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c3060206-5df2-40aa-ba70-ce799923d58f tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:19.966117 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c3060206-5df2-40aa-ba70-ce799923d58f tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:19.966827 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c3060206-5df2-40aa-ba70-ce799923d58f tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:19.967456 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c3060206-5df2-40aa-ba70-ce799923d58f tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:19.968036 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c3060206-5df2-40aa-ba70-ce799923d58f tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:20.139198 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-96862d23-0c0d-4bf4-8e3a-53a6e0faf8a5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:20.148368 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-96862d23-0c0d-4bf4-8e3a-53a6e0faf8a5 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8" status: 200 len: 1491 microversion: 2.1 time: 0.301601 Oct 26 13:17:20.149110 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1757/3503] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:19 2022] GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 => generated 1491 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:17:20.173858 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3611698a-cc94-4b1c-bea4-ae79f247c502 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:20.174788 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3611698a-cc94-4b1c-bea4-ae79f247c502 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:20.183785 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3611698a-cc94-4b1c-bea4-ae79f247c502 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:20.184620 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3611698a-cc94-4b1c-bea4-ae79f247c502 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:20.185422 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3611698a-cc94-4b1c-bea4-ae79f247c502 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:20.186661 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3611698a-cc94-4b1c-bea4-ae79f247c502 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:20.187453 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3611698a-cc94-4b1c-bea4-ae79f247c502 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:20.188702 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3611698a-cc94-4b1c-bea4-ae79f247c502 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:20.373435 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c3060206-5df2-40aa-ba70-ce799923d58f tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53010c15247443b29ce39f037e22ca24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c0302538ba431684624b8d41dfc2f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:20.383575 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c3060206-5df2-40aa-ba70-ce799923d58f tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] 10.222.0.40 "GET /compute/v2.1/servers/b777991e-573a-43e3-abcb-ec40283e625d" status: 200 len: 1316 microversion: 2.1 time: 0.445304 Oct 26 13:17:20.384587 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1747/3504] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:19 2022] GET /compute/v2.1/servers/b777991e-573a-43e3-abcb-ec40283e625d => generated 1316 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:20.555393 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-374c1fc7-b3f8-46b5-a77f-4bfc5d0c0d1d tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:20.556955 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-374c1fc7-b3f8-46b5-a77f-4bfc5d0c0d1d tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: b29a1a98-a428-4967-bc4a-237971dcd264] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:20.563535 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-374c1fc7-b3f8-46b5-a77f-4bfc5d0c0d1d tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:20.564133 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-374c1fc7-b3f8-46b5-a77f-4bfc5d0c0d1d tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:20.564802 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-374c1fc7-b3f8-46b5-a77f-4bfc5d0c0d1d tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:20.565711 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-374c1fc7-b3f8-46b5-a77f-4bfc5d0c0d1d tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:20.566211 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-374c1fc7-b3f8-46b5-a77f-4bfc5d0c0d1d tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:20.566645 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-374c1fc7-b3f8-46b5-a77f-4bfc5d0c0d1d tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:20.851196 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-374c1fc7-b3f8-46b5-a77f-4bfc5d0c0d1d tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:20.869920 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-374c1fc7-b3f8-46b5-a77f-4bfc5d0c0d1d tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264" status: 200 len: 1507 microversion: 2.1 time: 0.318564 Oct 26 13:17:20.871052 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1748/3505] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:20 2022] GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264 => generated 1507 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:17:20.877414 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6e2ebfb1-4197-4473-b198-c77a9bd3b0a2 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:20.878191 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6e2ebfb1-4197-4473-b198-c77a9bd3b0a2 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:20.884910 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3611698a-cc94-4b1c-bea4-ae79f247c502 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:20.885142 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e2ebfb1-4197-4473-b198-c77a9bd3b0a2 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:20.885907 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e2ebfb1-4197-4473-b198-c77a9bd3b0a2 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:20.886885 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e2ebfb1-4197-4473-b198-c77a9bd3b0a2 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:20.888018 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e2ebfb1-4197-4473-b198-c77a9bd3b0a2 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:20.888705 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e2ebfb1-4197-4473-b198-c77a9bd3b0a2 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:20.889936 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e2ebfb1-4197-4473-b198-c77a9bd3b0a2 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:20.899358 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3611698a-cc94-4b1c-bea4-ae79f247c502 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1315 microversion: 2.1 time: 0.730743 Oct 26 13:17:20.900420 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1758/3506] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:20 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1315 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:20.916497 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:17:20.941222 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-50f53112-f7b7-4fad-aa03-0106b9f14251 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:20.942258 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-50f53112-f7b7-4fad-aa03-0106b9f14251 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:20.949771 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50f53112-f7b7-4fad-aa03-0106b9f14251 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:20.950588 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50f53112-f7b7-4fad-aa03-0106b9f14251 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:20.951247 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50f53112-f7b7-4fad-aa03-0106b9f14251 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:20.952163 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50f53112-f7b7-4fad-aa03-0106b9f14251 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:20.952886 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50f53112-f7b7-4fad-aa03-0106b9f14251 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:20.953649 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50f53112-f7b7-4fad-aa03-0106b9f14251 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:21.269424 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-50f53112-f7b7-4fad-aa03-0106b9f14251 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:21.278050 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-50f53112-f7b7-4fad-aa03-0106b9f14251 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1199 microversion: 2.1 time: 0.341348 Oct 26 13:17:21.278830 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1759/3507] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:20 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1199 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:21.284877 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d3a34af8-64ce-485c-94d1-5d603a071ce1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:21.285872 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d3a34af8-64ce-485c-94d1-5d603a071ce1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:21.293121 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3a34af8-64ce-485c-94d1-5d603a071ce1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:21.294409 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3a34af8-64ce-485c-94d1-5d603a071ce1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:21.295130 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3a34af8-64ce-485c-94d1-5d603a071ce1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:21.296161 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3a34af8-64ce-485c-94d1-5d603a071ce1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:21.296878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3a34af8-64ce-485c-94d1-5d603a071ce1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:21.297609 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3a34af8-64ce-485c-94d1-5d603a071ce1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:21.421952 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d3a34af8-64ce-485c-94d1-5d603a071ce1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:21.431738 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d3a34af8-64ce-485c-94d1-5d603a071ce1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8" status: 200 len: 1449 microversion: 2.1 time: 0.150283 Oct 26 13:17:21.432712 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1760/3508] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:21 2022] GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:21.437471 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6470e2d0-7337-46e1-b143-c5167b70f2f8 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:21.438113 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6470e2d0-7337-46e1-b143-c5167b70f2f8 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] [instance: b777991e-573a-43e3-abcb-ec40283e625d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:21.451627 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6470e2d0-7337-46e1-b143-c5167b70f2f8 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:21.452134 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6470e2d0-7337-46e1-b143-c5167b70f2f8 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:21.452580 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6470e2d0-7337-46e1-b143-c5167b70f2f8 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:21.453294 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6470e2d0-7337-46e1-b143-c5167b70f2f8 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:21.453784 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6470e2d0-7337-46e1-b143-c5167b70f2f8 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:21.454219 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6470e2d0-7337-46e1-b143-c5167b70f2f8 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:21.580865 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6e2ebfb1-4197-4473-b198-c77a9bd3b0a2 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:21.592185 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6e2ebfb1-4197-4473-b198-c77a9bd3b0a2 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:21.593816 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6e2ebfb1-4197-4473-b198-c77a9bd3b0a2 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:21.595167 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6e2ebfb1-4197-4473-b198-c77a9bd3b0a2 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1873 microversion: 2.32 time: 0.721763 Oct 26 13:17:21.595922 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1749/3509] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:17:20 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1873 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:17:21.600682 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-a5c507b6-04d0-42c9-87d4-f8b535b4df19 req-7ada6456-762f-4d26-96f0-4d5247b3f898 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8", "name": "network-vif-deleted", "tag": "865dd839-e1fa-4d8d-bcd4-1b698f4e4b5f"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:17:21.612590 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a5c507b6-04d0-42c9-87d4-f8b535b4df19 req-7ada6456-762f-4d26-96f0-4d5247b3f898 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:21.613158 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a5c507b6-04d0-42c9-87d4-f8b535b4df19 req-7ada6456-762f-4d26-96f0-4d5247b3f898 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:21.613526 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a5c507b6-04d0-42c9-87d4-f8b535b4df19 req-7ada6456-762f-4d26-96f0-4d5247b3f898 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:21.625734 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-a5c507b6-04d0-42c9-87d4-f8b535b4df19 req-7ada6456-762f-4d26-96f0-4d5247b3f898 service nova] Creating event network-vif-deleted:865dd839-e1fa-4d8d-bcd4-1b698f4e4b5f for instance 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 on n-h2-862686-1 Oct 26 13:17:21.630746 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-a5c507b6-04d0-42c9-87d4-f8b535b4df19 req-7ada6456-762f-4d26-96f0-4d5247b3f898 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033506 Oct 26 13:17:21.631672 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1750/3510] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:17:21.786586 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6470e2d0-7337-46e1-b143-c5167b70f2f8 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53010c15247443b29ce39f037e22ca24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c0302538ba431684624b8d41dfc2f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:21.795561 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6470e2d0-7337-46e1-b143-c5167b70f2f8 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] 10.222.0.40 "GET /compute/v2.1/servers/b777991e-573a-43e3-abcb-ec40283e625d" status: 200 len: 1316 microversion: 2.1 time: 0.361783 Oct 26 13:17:21.796151 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1761/3511] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:21 2022] GET /compute/v2.1/servers/b777991e-573a-43e3-abcb-ec40283e625d => generated 1316 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:21.901627 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2a6f2c07-c956-4926-8437-cad77c1ead92 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:21.902363 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2a6f2c07-c956-4926-8437-cad77c1ead92 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: b29a1a98-a428-4967-bc4a-237971dcd264] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:21.908481 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2a6f2c07-c956-4926-8437-cad77c1ead92 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:21.908969 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2a6f2c07-c956-4926-8437-cad77c1ead92 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:21.909417 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2a6f2c07-c956-4926-8437-cad77c1ead92 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:21.910136 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2a6f2c07-c956-4926-8437-cad77c1ead92 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:21.910603 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2a6f2c07-c956-4926-8437-cad77c1ead92 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:21.911036 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2a6f2c07-c956-4926-8437-cad77c1ead92 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:21.925204 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ecf61eff-3157-4e97-b613-9582a3147452 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:21.925981 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ecf61eff-3157-4e97-b613-9582a3147452 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:21.937137 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ecf61eff-3157-4e97-b613-9582a3147452 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:21.937668 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ecf61eff-3157-4e97-b613-9582a3147452 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:21.938108 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ecf61eff-3157-4e97-b613-9582a3147452 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:21.938806 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ecf61eff-3157-4e97-b613-9582a3147452 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:21.939431 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ecf61eff-3157-4e97-b613-9582a3147452 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:21.940219 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ecf61eff-3157-4e97-b613-9582a3147452 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:22.072932 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2a6f2c07-c956-4926-8437-cad77c1ead92 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:22.080870 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2a6f2c07-c956-4926-8437-cad77c1ead92 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264" status: 200 len: 1507 microversion: 2.1 time: 0.184292 Oct 26 13:17:22.090366 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1751/3512] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:21 2022] GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264 => generated 1507 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:22.090366 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-2b39061b-a7ae-4361-a723-521e8b2eb179 req-ea9e5f82-f545-425e-bd05-478e04f6602c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59bb4f3c-d633-42db-b86b-274fa8b95f44", "tag": "1484b291-b3a0-410d-a1af-3a79c7d02eba"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:17:22.098633 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2b39061b-a7ae-4361-a723-521e8b2eb179 req-ea9e5f82-f545-425e-bd05-478e04f6602c service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:22.099053 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2b39061b-a7ae-4361-a723-521e8b2eb179 req-ea9e5f82-f545-425e-bd05-478e04f6602c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:22.099668 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2b39061b-a7ae-4361-a723-521e8b2eb179 req-ea9e5f82-f545-425e-bd05-478e04f6602c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:22.112243 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-2b39061b-a7ae-4361-a723-521e8b2eb179 req-ea9e5f82-f545-425e-bd05-478e04f6602c service nova] Creating event network-changed:1484b291-b3a0-410d-a1af-3a79c7d02eba for instance 59bb4f3c-d633-42db-b86b-274fa8b95f44 on n-h1-862686-1 Oct 26 13:17:22.116993 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-2b39061b-a7ae-4361-a723-521e8b2eb179 req-ea9e5f82-f545-425e-bd05-478e04f6602c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034060 Oct 26 13:17:22.117648 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1752/3513] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:17:22.251414 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ecf61eff-3157-4e97-b613-9582a3147452 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:22.260038 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ecf61eff-3157-4e97-b613-9582a3147452 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1315 microversion: 2.1 time: 0.339285 Oct 26 13:17:22.260715 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1762/3514] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:21 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:17:22.303775 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ae051b9c-cde8-48fa-b768-ae30f33bad96 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:22.304545 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ae051b9c-cde8-48fa-b768-ae30f33bad96 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:22.311208 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae051b9c-cde8-48fa-b768-ae30f33bad96 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:22.311695 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae051b9c-cde8-48fa-b768-ae30f33bad96 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:22.312133 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae051b9c-cde8-48fa-b768-ae30f33bad96 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:22.312827 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae051b9c-cde8-48fa-b768-ae30f33bad96 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:22.313284 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae051b9c-cde8-48fa-b768-ae30f33bad96 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:22.313739 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae051b9c-cde8-48fa-b768-ae30f33bad96 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:22.458474 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e0d1f690-2358-4c04-adef-6e4e857d60f4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:22.459809 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e0d1f690-2358-4c04-adef-6e4e857d60f4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:22.469625 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0d1f690-2358-4c04-adef-6e4e857d60f4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:22.471838 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0d1f690-2358-4c04-adef-6e4e857d60f4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:22.472285 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0d1f690-2358-4c04-adef-6e4e857d60f4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:22.474789 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0d1f690-2358-4c04-adef-6e4e857d60f4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:22.475255 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0d1f690-2358-4c04-adef-6e4e857d60f4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:22.475686 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0d1f690-2358-4c04-adef-6e4e857d60f4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:22.606043 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ae051b9c-cde8-48fa-b768-ae30f33bad96 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:22.617876 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ae051b9c-cde8-48fa-b768-ae30f33bad96 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1199 microversion: 2.1 time: 0.316920 Oct 26 13:17:22.625638 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1753/3515] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:22 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1199 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:22.634030 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-64b8d1ee-ed01-4cd9-9268-c3a368533637 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:22.637516 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-64b8d1ee-ed01-4cd9-9268-c3a368533637 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:22.651879 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64b8d1ee-ed01-4cd9-9268-c3a368533637 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:22.652464 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64b8d1ee-ed01-4cd9-9268-c3a368533637 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:22.652809 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64b8d1ee-ed01-4cd9-9268-c3a368533637 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:22.657642 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64b8d1ee-ed01-4cd9-9268-c3a368533637 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:22.660112 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64b8d1ee-ed01-4cd9-9268-c3a368533637 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:22.660596 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64b8d1ee-ed01-4cd9-9268-c3a368533637 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:22.663898 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e0d1f690-2358-4c04-adef-6e4e857d60f4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:22.674345 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e0d1f690-2358-4c04-adef-6e4e857d60f4 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8" status: 200 len: 1291 microversion: 2.1 time: 0.220267 Oct 26 13:17:22.675698 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1763/3516] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:22 2022] GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 => generated 1291 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:17:22.822205 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-566deb76-ccdc-421b-a9f8-4ed3a2bee58c tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:22.823375 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-566deb76-ccdc-421b-a9f8-4ed3a2bee58c tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] [instance: b777991e-573a-43e3-abcb-ec40283e625d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:22.831118 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-566deb76-ccdc-421b-a9f8-4ed3a2bee58c tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:22.831901 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-566deb76-ccdc-421b-a9f8-4ed3a2bee58c tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:22.832421 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-566deb76-ccdc-421b-a9f8-4ed3a2bee58c tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:22.833248 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-566deb76-ccdc-421b-a9f8-4ed3a2bee58c tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:22.833845 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-566deb76-ccdc-421b-a9f8-4ed3a2bee58c tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:22.834411 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-566deb76-ccdc-421b-a9f8-4ed3a2bee58c tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:22.976563 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-64b8d1ee-ed01-4cd9-9268-c3a368533637 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:22.979887 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-566deb76-ccdc-421b-a9f8-4ed3a2bee58c tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53010c15247443b29ce39f037e22ca24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c0302538ba431684624b8d41dfc2f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:22.986390 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-64b8d1ee-ed01-4cd9-9268-c3a368533637 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:22.987713 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-566deb76-ccdc-421b-a9f8-4ed3a2bee58c tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] 10.222.0.40 "GET /compute/v2.1/servers/b777991e-573a-43e3-abcb-ec40283e625d" status: 200 len: 1316 microversion: 2.1 time: 0.172886 Oct 26 13:17:22.987943 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-64b8d1ee-ed01-4cd9-9268-c3a368533637 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:22.988287 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1764/3517] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:22 2022] GET /compute/v2.1/servers/b777991e-573a-43e3-abcb-ec40283e625d => generated 1316 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:22.989174 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-64b8d1ee-ed01-4cd9-9268-c3a368533637 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1873 microversion: 2.32 time: 0.361404 Oct 26 13:17:22.989905 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1754/3518] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:17:22 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1873 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:17:23.104983 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ca3f68d4-ea81-4ed5-a70e-7ada37b857ed tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:23.105663 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ca3f68d4-ea81-4ed5-a70e-7ada37b857ed tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: b29a1a98-a428-4967-bc4a-237971dcd264] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:23.112130 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca3f68d4-ea81-4ed5-a70e-7ada37b857ed tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:23.112623 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca3f68d4-ea81-4ed5-a70e-7ada37b857ed tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:23.113093 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca3f68d4-ea81-4ed5-a70e-7ada37b857ed tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:23.113834 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca3f68d4-ea81-4ed5-a70e-7ada37b857ed tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:23.114294 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca3f68d4-ea81-4ed5-a70e-7ada37b857ed tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:23.114727 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca3f68d4-ea81-4ed5-a70e-7ada37b857ed tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:23.283333 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cc3c0a14-e51b-4fab-bb2b-241ef7d67379 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:23.284024 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cc3c0a14-e51b-4fab-bb2b-241ef7d67379 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:23.293465 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc3c0a14-e51b-4fab-bb2b-241ef7d67379 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:23.294302 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc3c0a14-e51b-4fab-bb2b-241ef7d67379 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:23.294977 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc3c0a14-e51b-4fab-bb2b-241ef7d67379 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:23.295916 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc3c0a14-e51b-4fab-bb2b-241ef7d67379 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:23.296586 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc3c0a14-e51b-4fab-bb2b-241ef7d67379 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:23.297092 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc3c0a14-e51b-4fab-bb2b-241ef7d67379 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:23.337870 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ca3f68d4-ea81-4ed5-a70e-7ada37b857ed tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:23.346471 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ca3f68d4-ea81-4ed5-a70e-7ada37b857ed tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264" status: 200 len: 1507 microversion: 2.1 time: 0.245368 Oct 26 13:17:23.348026 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1765/3519] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:23 2022] GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264 => generated 1507 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:23.375591 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f18ba398-de27-40fc-b51e-8446a505aec0 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:23.376154 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f18ba398-de27-40fc-b51e-8446a505aec0 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 2c859d43-c102-4189-9e7a-6c88ff38f311] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:23.382196 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f18ba398-de27-40fc-b51e-8446a505aec0 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:23.382686 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f18ba398-de27-40fc-b51e-8446a505aec0 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:23.383123 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f18ba398-de27-40fc-b51e-8446a505aec0 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:23.383827 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f18ba398-de27-40fc-b51e-8446a505aec0 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:23.385680 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f18ba398-de27-40fc-b51e-8446a505aec0 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:23.386120 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f18ba398-de27-40fc-b51e-8446a505aec0 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:23.411900 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f18ba398-de27-40fc-b51e-8446a505aec0 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311/ips" status: 200 len: 151 microversion: 2.1 time: 0.040279 Oct 26 13:17:23.412588 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1766/3520] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Oct 26 13:17:23 2022] GET /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:17:23.427380 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6b4b3b4d-1190-47a7-8c8f-b74e097b411f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1852432-c514-4ea8-b96a-e4d142fe3d24"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:17:23.430334 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6b4b3b4d-1190-47a7-8c8f-b74e097b411f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 2c859d43-c102-4189-9e7a-6c88ff38f311] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:23.436346 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6b4b3b4d-1190-47a7-8c8f-b74e097b411f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:23.436831 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6b4b3b4d-1190-47a7-8c8f-b74e097b411f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:23.437265 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6b4b3b4d-1190-47a7-8c8f-b74e097b411f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:23.437991 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6b4b3b4d-1190-47a7-8c8f-b74e097b411f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:23.438442 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6b4b3b4d-1190-47a7-8c8f-b74e097b411f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:23.438867 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6b4b3b4d-1190-47a7-8c8f-b74e097b411f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:23.518858 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-6b4b3b4d-1190-47a7-8c8f-b74e097b411f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] HTTP exception thrown: Invalid volume: volume b1852432-c514-4ea8-b96a-e4d142fe3d24 is already attached to instances: 789a55e0-21ba-4b2e-b8d4-c95999955e2b Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6b4b3b4d-1190-47a7-8c8f-b74e097b411f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Request method failure captured: Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311/os-volume_attachments HTTP/1.1 Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 74 Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTK8yiFaYn6FsK4kYH1E6E6NSE9_hIaDskjf1tRy-XgeLhCgjcaBIDqmW8VSjfB2Cmb6DMkQzh-y_Wh40jTHlXsuv7XA0N3K6RDEzKD5nf9Z6iWWIgYAqlJtxWSsEOqwe1NAtEPEvPHN4gJ5RH5unfT6e5xSWJOJigX6JmjW0X-SjQA Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 174da5e5c60449b7a04e9cf2aa3b9fda Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-AttachVolumeNegativeTest-770748596 Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/174da5e5c60449b7a04e9cf2aa3b9fda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/174da5e5c60449b7a04e9cf2aa3b9fda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_174da5e5c60449b7a04e9cf2aa3b9fda"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/174da5e5c60449b7a04e9cf2aa3b9fda"}]}] Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-AttachVolumeNegativeTest-770748596 Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 174da5e5c60449b7a04e9cf2aa3b9fda Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-770748596 Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-AttachVolumeNegativeTest-770748596-project Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 168c83cd1b014f82945f4915e3ece079 Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-AttachVolumeNegativeTest-770748596-project Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: {"volumeAttachment": {"volumeId": "b1852432-c514-4ea8-b96a-e4d142fe3d24"}} Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: exception: Invalid volume: volume b1852432-c514-4ea8-b96a-e4d142fe3d24 is already attached to instances: 789a55e0-21ba-4b2e-b8d4-c95999955e2b Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'server_id': '2c859d43-c102-4189-9e7a-6c88ff38f311', 'body': {'volumeAttachment': {'volumeId': 'b1852432-c514-4ea8-b96a-e4d142fe3d24'}}} Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b1852432-c514-4ea8-b96a-e4d142fe3d24 is already attached to instances: 789a55e0-21ba-4b2e-b8d4-c95999955e2b Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:17:23.520753 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:17:23.529616 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:17:23.529616 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:17:23.529616 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 26 13:17:23.529616 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 26 13:17:23.529616 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b1852432-c514-4ea8-b96a-e4d142fe3d24 is already attached to instances: 789a55e0-21ba-4b2e-b8d4-c95999955e2b Oct 26 13:17:23.529616 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:17:23.529616 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:17:23.529616 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:17:23.529616 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:23.529616 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:17:23.529616 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:17:23.529616 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:17:23.529616 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:17:23.529616 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b1852432-c514-4ea8-b96a-e4d142fe3d24 is already attached to instances: 789a55e0-21ba-4b2e-b8d4-c95999955e2b Oct 26 13:17:23.529616 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:17:23.529616 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6b4b3b4d-1190-47a7-8c8f-b74e097b411f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Returning 400 to user: Invalid volume: volume b1852432-c514-4ea8-b96a-e4d142fe3d24 is already attached to instances: 789a55e0-21ba-4b2e-b8d4-c95999955e2b {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:17:23.529616 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6b4b3b4d-1190-47a7-8c8f-b74e097b411f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "POST /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100019 Oct 26 13:17:23.529616 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1767/3521] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Oct 26 13:17:23 2022] POST /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 26 13:17:23.531093 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cc3c0a14-e51b-4fab-bb2b-241ef7d67379 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:23.531843 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7f44fa42-43f1-46f0-b8ba-f33b3602c53f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:23.532271 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7f44fa42-43f1-46f0-b8ba-f33b3602c53f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 2c859d43-c102-4189-9e7a-6c88ff38f311] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:23.539268 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f44fa42-43f1-46f0-b8ba-f33b3602c53f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:23.539735 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f44fa42-43f1-46f0-b8ba-f33b3602c53f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:23.540234 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f44fa42-43f1-46f0-b8ba-f33b3602c53f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:23.540382 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cc3c0a14-e51b-4fab-bb2b-241ef7d67379 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1315 microversion: 2.1 time: 0.260693 Oct 26 13:17:23.540941 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f44fa42-43f1-46f0-b8ba-f33b3602c53f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:23.541743 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1755/3522] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:23 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:17:23.541915 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f44fa42-43f1-46f0-b8ba-f33b3602c53f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:23.541915 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f44fa42-43f1-46f0-b8ba-f33b3602c53f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:23.576491 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7f44fa42-43f1-46f0-b8ba-f33b3602c53f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 2c859d43-c102-4189-9e7a-6c88ff38f311] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:17:23.592008 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:17:23.644137 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7f9430cc-ae44-4366-9302-8632739172e7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:23.644784 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7f9430cc-ae44-4366-9302-8632739172e7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:23.651347 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f9430cc-ae44-4366-9302-8632739172e7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:23.652061 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f9430cc-ae44-4366-9302-8632739172e7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:23.652665 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f9430cc-ae44-4366-9302-8632739172e7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:23.653659 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f9430cc-ae44-4366-9302-8632739172e7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:23.654129 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f9430cc-ae44-4366-9302-8632739172e7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:23.654556 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f9430cc-ae44-4366-9302-8632739172e7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:23.658047 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7f44fa42-43f1-46f0-b8ba-f33b3602c53f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311" status: 204 len: 0 microversion: 2.1 time: 0.129932 Oct 26 13:17:23.658639 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1768/3523] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:17:23 2022] DELETE /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 26 13:17:23.668455 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f019bafb-65a6-430d-bf02-80b945e2b2c0 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:23.669902 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f019bafb-65a6-430d-bf02-80b945e2b2c0 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 2c859d43-c102-4189-9e7a-6c88ff38f311] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:23.676798 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f019bafb-65a6-430d-bf02-80b945e2b2c0 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:23.677496 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f019bafb-65a6-430d-bf02-80b945e2b2c0 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:23.678011 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f019bafb-65a6-430d-bf02-80b945e2b2c0 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:23.678817 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f019bafb-65a6-430d-bf02-80b945e2b2c0 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:23.679378 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f019bafb-65a6-430d-bf02-80b945e2b2c0 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:23.679911 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f019bafb-65a6-430d-bf02-80b945e2b2c0 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:23.805938 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7f9430cc-ae44-4366-9302-8632739172e7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:23.814582 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7f9430cc-ae44-4366-9302-8632739172e7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1199 microversion: 2.1 time: 0.174423 Oct 26 13:17:23.815169 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1756/3524] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:23 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1199 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:23.819845 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6dab276c-54c9-4864-916d-f6dccc6c6ec2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:23.820448 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6dab276c-54c9-4864-916d-f6dccc6c6ec2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:23.827162 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6dab276c-54c9-4864-916d-f6dccc6c6ec2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:23.827652 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6dab276c-54c9-4864-916d-f6dccc6c6ec2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:23.828088 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6dab276c-54c9-4864-916d-f6dccc6c6ec2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:23.828778 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6dab276c-54c9-4864-916d-f6dccc6c6ec2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:23.829244 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6dab276c-54c9-4864-916d-f6dccc6c6ec2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:23.829683 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6dab276c-54c9-4864-916d-f6dccc6c6ec2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:23.844323 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-6dab276c-54c9-4864-916d-f6dccc6c6ec2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] HTTP exception thrown: Instance 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 could not be found. Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6dab276c-54c9-4864-916d-f6dccc6c6ec2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Request method failure captured: Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 HTTP/1.1 Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTJbgpOJ6_WXapLDSc4DXB2ybbuKvfF9irakf13MnXe_PUvQw0tvwC_KXpEDb02nWk9gKVB2DnChPFFUGp_xOUQaSFHL5E80bTALTu8ZJijTkAv_z2Y1Gdi1cyNAMKmLE7ZnzWq0oDflWXhf1sSJNtguU-rMZFkiGbBps0dj1yOxZiU Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 3f690a680b284d82ac586346427423c3 Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersTestJSON-1612525130 Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3f690a680b284d82ac586346427423c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f690a680b284d82ac586346427423c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3f690a680b284d82ac586346427423c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f690a680b284d82ac586346427423c3"}]}] Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersTestJSON-1612525130 Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 3f690a680b284d82ac586346427423c3 Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersTestJSON-1612525130 Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersTestJSON-1612525130-project Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: fbe30a73a18d49afa07f7a66aee7805d Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersTestJSON-1612525130-project Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 could not be found. Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8'} Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 could not be found. Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 could not be found. Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:17:23.846057 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:23.850475 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:23.850475 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:17:23.850475 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:17:23.850475 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:17:23.850475 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:17:23.850475 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 could not be found. Oct 26 13:17:23.850475 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:23.850475 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6dab276c-54c9-4864-916d-f6dccc6c6ec2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Returning 404 to user: Instance 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:17:23.850475 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6dab276c-54c9-4864-916d-f6dccc6c6ec2 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8" status: 404 len: 111 microversion: 2.1 time: 0.031323 Oct 26 13:17:23.850475 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1757/3525] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:23 2022] GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:17:23.863354 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7a694deb-ca20-4186-97b9-4590aa45d71f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:23.863689 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7a694deb-ca20-4186-97b9-4590aa45d71f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:23.870270 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7a694deb-ca20-4186-97b9-4590aa45d71f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:23.870828 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7a694deb-ca20-4186-97b9-4590aa45d71f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:23.871450 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7a694deb-ca20-4186-97b9-4590aa45d71f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:23.872308 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7a694deb-ca20-4186-97b9-4590aa45d71f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:23.872909 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7a694deb-ca20-4186-97b9-4590aa45d71f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:23.873547 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7a694deb-ca20-4186-97b9-4590aa45d71f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:23.888545 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-7a694deb-ca20-4186-97b9-4590aa45d71f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] HTTP exception thrown: Instance 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 could not be found. Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7a694deb-ca20-4186-97b9-4590aa45d71f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Request method failure captured: Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 HTTP/1.1 Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTJbgpOJ6_WXapLDSc4DXB2ybbuKvfF9irakf13MnXe_PUvQw0tvwC_KXpEDb02nWk9gKVB2DnChPFFUGp_xOUQaSFHL5E80bTALTu8ZJijTkAv_z2Y1Gdi1cyNAMKmLE7ZnzWq0oDflWXhf1sSJNtguU-rMZFkiGbBps0dj1yOxZiU Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 3f690a680b284d82ac586346427423c3 Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersTestJSON-1612525130 Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3f690a680b284d82ac586346427423c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f690a680b284d82ac586346427423c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3f690a680b284d82ac586346427423c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f690a680b284d82ac586346427423c3"}]}] Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersTestJSON-1612525130 Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 3f690a680b284d82ac586346427423c3 Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersTestJSON-1612525130 Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersTestJSON-1612525130-project Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: fbe30a73a18d49afa07f7a66aee7805d Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersTestJSON-1612525130-project Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 could not be found. Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8'} Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 could not be found. Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:17:23.890204 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 could not be found. Oct 26 13:17:23.894618 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:23.894618 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:17:23.894618 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:23.894618 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:23.894618 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:17:23.894618 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:17:23.894618 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:17:23.894618 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:17:23.894618 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 could not be found. Oct 26 13:17:23.894618 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:23.894618 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7a694deb-ca20-4186-97b9-4590aa45d71f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Returning 404 to user: Instance 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:17:23.894618 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7a694deb-ca20-4186-97b9-4590aa45d71f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8" status: 404 len: 111 microversion: 2.1 time: 0.032330 Oct 26 13:17:23.894618 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1758/3526] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:17:23 2022] DELETE /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:17:23.903008 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-57495204-93bc-430d-b348-58b9d548eb6f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:23.903634 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-57495204-93bc-430d-b348-58b9d548eb6f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:23.909598 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57495204-93bc-430d-b348-58b9d548eb6f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:23.910094 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57495204-93bc-430d-b348-58b9d548eb6f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:23.910678 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57495204-93bc-430d-b348-58b9d548eb6f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:23.911509 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57495204-93bc-430d-b348-58b9d548eb6f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:23.911850 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57495204-93bc-430d-b348-58b9d548eb6f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:23.912287 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57495204-93bc-430d-b348-58b9d548eb6f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:23.914947 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f019bafb-65a6-430d-bf02-80b945e2b2c0 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:23.924934 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f019bafb-65a6-430d-bf02-80b945e2b2c0 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311" status: 200 len: 1683 microversion: 2.1 time: 0.261186 Oct 26 13:17:23.926069 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1769/3527] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:23 2022] GET /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311 => generated 1683 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:23.936838 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-57495204-93bc-430d-b348-58b9d548eb6f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] HTTP exception thrown: Instance 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 could not be found. Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-57495204-93bc-430d-b348-58b9d548eb6f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Request method failure captured: Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 HTTP/1.1 Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTJbgpOJ6_WXapLDSc4DXB2ybbuKvfF9irakf13MnXe_PUvQw0tvwC_KXpEDb02nWk9gKVB2DnChPFFUGp_xOUQaSFHL5E80bTALTu8ZJijTkAv_z2Y1Gdi1cyNAMKmLE7ZnzWq0oDflWXhf1sSJNtguU-rMZFkiGbBps0dj1yOxZiU Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 3f690a680b284d82ac586346427423c3 Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersTestJSON-1612525130 Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3f690a680b284d82ac586346427423c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f690a680b284d82ac586346427423c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3f690a680b284d82ac586346427423c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f690a680b284d82ac586346427423c3"}]}] Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersTestJSON-1612525130 Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 3f690a680b284d82ac586346427423c3 Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersTestJSON-1612525130 Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersTestJSON-1612525130-project Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: fbe30a73a18d49afa07f7a66aee7805d Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersTestJSON-1612525130-project Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 could not be found. Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8'} Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 could not be found. Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 could not be found. Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:17:23.938580 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:23.943425 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:23.943425 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:17:23.943425 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:17:23.943425 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:17:23.943425 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:17:23.943425 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 could not be found. Oct 26 13:17:23.943425 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:23.943425 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-57495204-93bc-430d-b348-58b9d548eb6f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Returning 404 to user: Instance 1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:17:23.943425 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-57495204-93bc-430d-b348-58b9d548eb6f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8" status: 404 len: 111 microversion: 2.1 time: 0.045438 Oct 26 13:17:23.945701 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1759/3528] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:23 2022] GET /compute/v2.1/servers/1ce7e6c8-ddc9-45e5-b4c5-009ff50d2ae8 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:17:23.951580 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-194c7bbc-5848-4d85-ba01-d3514a564cdc tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:23.952076 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-194c7bbc-5848-4d85-ba01-d3514a564cdc tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 8718e439-6247-480e-9887-eab549630975] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:23.958395 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-194c7bbc-5848-4d85-ba01-d3514a564cdc tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:23.958879 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-194c7bbc-5848-4d85-ba01-d3514a564cdc tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:23.959317 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-194c7bbc-5848-4d85-ba01-d3514a564cdc tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:23.960005 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-194c7bbc-5848-4d85-ba01-d3514a564cdc tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:23.960461 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-194c7bbc-5848-4d85-ba01-d3514a564cdc tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:23.960901 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-194c7bbc-5848-4d85-ba01-d3514a564cdc tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:23.977086 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-194c7bbc-5848-4d85-ba01-d3514a564cdc tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] HTTP exception thrown: Instance 8718e439-6247-480e-9887-eab549630975 could not be found. Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-194c7bbc-5848-4d85-ba01-d3514a564cdc tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Request method failure captured: Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: request: DELETE /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975 HTTP/1.1 Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTJbgpOJ6_WXapLDSc4DXB2ybbuKvfF9irakf13MnXe_PUvQw0tvwC_KXpEDb02nWk9gKVB2DnChPFFUGp_xOUQaSFHL5E80bTALTu8ZJijTkAv_z2Y1Gdi1cyNAMKmLE7ZnzWq0oDflWXhf1sSJNtguU-rMZFkiGbBps0dj1yOxZiU Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 3f690a680b284d82ac586346427423c3 Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersTestJSON-1612525130 Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3f690a680b284d82ac586346427423c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f690a680b284d82ac586346427423c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3f690a680b284d82ac586346427423c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f690a680b284d82ac586346427423c3"}]}] Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersTestJSON-1612525130 Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 3f690a680b284d82ac586346427423c3 Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersTestJSON-1612525130 Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersTestJSON-1612525130-project Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: fbe30a73a18d49afa07f7a66aee7805d Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersTestJSON-1612525130-project Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 8718e439-6247-480e-9887-eab549630975 could not be found. Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '8718e439-6247-480e-9887-eab549630975'} Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8718e439-6247-480e-9887-eab549630975 could not be found. Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:17:23.979587 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8718e439-6247-480e-9887-eab549630975 could not be found. Oct 26 13:17:23.984188 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:17:23.984188 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:17:23.984188 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:17:23.984188 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:23.984188 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:17:23.984188 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:17:23.984188 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:17:23.984188 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:17:23.984188 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8718e439-6247-480e-9887-eab549630975 could not be found. Oct 26 13:17:23.984188 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:17:23.984188 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-194c7bbc-5848-4d85-ba01-d3514a564cdc tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Returning 404 to user: Instance 8718e439-6247-480e-9887-eab549630975 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:17:23.984188 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-194c7bbc-5848-4d85-ba01-d3514a564cdc tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975" status: 404 len: 111 microversion: 2.1 time: 0.033370 Oct 26 13:17:23.984988 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1770/3529] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:17:23 2022] DELETE /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:17:23.989738 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dac627bf-921a-4e87-b597-ff0ebaf74504 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:23.990346 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-dac627bf-921a-4e87-b597-ff0ebaf74504 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 8718e439-6247-480e-9887-eab549630975] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:23.996551 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dac627bf-921a-4e87-b597-ff0ebaf74504 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:23.997033 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dac627bf-921a-4e87-b597-ff0ebaf74504 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:23.997464 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dac627bf-921a-4e87-b597-ff0ebaf74504 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:23.998174 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dac627bf-921a-4e87-b597-ff0ebaf74504 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:23.998625 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dac627bf-921a-4e87-b597-ff0ebaf74504 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:23.999047 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dac627bf-921a-4e87-b597-ff0ebaf74504 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:24.011282 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ebe706ed-c5da-4135-b731-79694d0e3104 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:24.012037 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ebe706ed-c5da-4135-b731-79694d0e3104 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] [instance: b777991e-573a-43e3-abcb-ec40283e625d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:24.013709 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-dac627bf-921a-4e87-b597-ff0ebaf74504 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] HTTP exception thrown: Instance 8718e439-6247-480e-9887-eab549630975 could not be found. Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dac627bf-921a-4e87-b597-ff0ebaf74504 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Request method failure captured: Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975 HTTP/1.1 Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTJbgpOJ6_WXapLDSc4DXB2ybbuKvfF9irakf13MnXe_PUvQw0tvwC_KXpEDb02nWk9gKVB2DnChPFFUGp_xOUQaSFHL5E80bTALTu8ZJijTkAv_z2Y1Gdi1cyNAMKmLE7ZnzWq0oDflWXhf1sSJNtguU-rMZFkiGbBps0dj1yOxZiU Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 3f690a680b284d82ac586346427423c3 Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersTestJSON-1612525130 Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3f690a680b284d82ac586346427423c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f690a680b284d82ac586346427423c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3f690a680b284d82ac586346427423c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f690a680b284d82ac586346427423c3"}]}] Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersTestJSON-1612525130 Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 3f690a680b284d82ac586346427423c3 Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersTestJSON-1612525130 Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersTestJSON-1612525130-project Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: fbe30a73a18d49afa07f7a66aee7805d Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersTestJSON-1612525130-project Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 8718e439-6247-480e-9887-eab549630975 could not be found. Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '8718e439-6247-480e-9887-eab549630975'} Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8718e439-6247-480e-9887-eab549630975 could not be found. Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8718e439-6247-480e-9887-eab549630975 could not be found. Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:17:24.015338 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.019447 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:24.019447 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:17:24.019447 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:17:24.019447 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:17:24.019447 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:17:24.019447 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8718e439-6247-480e-9887-eab549630975 could not be found. Oct 26 13:17:24.019447 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.019447 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dac627bf-921a-4e87-b597-ff0ebaf74504 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Returning 404 to user: Instance 8718e439-6247-480e-9887-eab549630975 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:17:24.019447 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-dac627bf-921a-4e87-b597-ff0ebaf74504 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975" status: 404 len: 111 microversion: 2.1 time: 0.031288 Oct 26 13:17:24.019447 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1760/3530] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:23 2022] GET /compute/v2.1/servers/8718e439-6247-480e-9887-eab549630975 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:17:24.024113 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-599acebc-1c1d-4772-9990-83dd2f3963de tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:24.025270 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-599acebc-1c1d-4772-9990-83dd2f3963de tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:24.025700 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ebe706ed-c5da-4135-b731-79694d0e3104 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:24.026341 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ebe706ed-c5da-4135-b731-79694d0e3104 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:24.026783 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ebe706ed-c5da-4135-b731-79694d0e3104 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:24.027489 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ebe706ed-c5da-4135-b731-79694d0e3104 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:24.028435 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ebe706ed-c5da-4135-b731-79694d0e3104 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:24.028435 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ebe706ed-c5da-4135-b731-79694d0e3104 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:24.028924 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:17:24.032517 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-599acebc-1c1d-4772-9990-83dd2f3963de tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:24.033030 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-599acebc-1c1d-4772-9990-83dd2f3963de tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:24.033830 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-599acebc-1c1d-4772-9990-83dd2f3963de tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:24.034820 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-599acebc-1c1d-4772-9990-83dd2f3963de tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:24.035326 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-599acebc-1c1d-4772-9990-83dd2f3963de tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:24.035764 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-599acebc-1c1d-4772-9990-83dd2f3963de tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:24.229677 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ebe706ed-c5da-4135-b731-79694d0e3104 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53010c15247443b29ce39f037e22ca24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c0302538ba431684624b8d41dfc2f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:24.238093 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ebe706ed-c5da-4135-b731-79694d0e3104 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] 10.222.0.40 "GET /compute/v2.1/servers/b777991e-573a-43e3-abcb-ec40283e625d" status: 200 len: 1316 microversion: 2.1 time: 0.230364 Oct 26 13:17:24.238775 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1771/3531] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:24 2022] GET /compute/v2.1/servers/b777991e-573a-43e3-abcb-ec40283e625d => generated 1316 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:17:24.240194 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-599acebc-1c1d-4772-9990-83dd2f3963de tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:24.244560 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1954d89f-c502-42aa-9843-54d4674a8fee tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:24.245326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1954d89f-c502-42aa-9843-54d4674a8fee tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 6668f03f-2108-4ade-88e9-d51f6e696338] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:24.251669 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1954d89f-c502-42aa-9843-54d4674a8fee tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:24.252402 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1954d89f-c502-42aa-9843-54d4674a8fee tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:24.253038 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1954d89f-c502-42aa-9843-54d4674a8fee tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:24.254019 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1954d89f-c502-42aa-9843-54d4674a8fee tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:24.254696 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1954d89f-c502-42aa-9843-54d4674a8fee tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:24.255366 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1954d89f-c502-42aa-9843-54d4674a8fee tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:24.257534 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-599acebc-1c1d-4772-9990-83dd2f3963de tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:24.259323 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-599acebc-1c1d-4772-9990-83dd2f3963de tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:24.260750 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-599acebc-1c1d-4772-9990-83dd2f3963de tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1873 microversion: 2.32 time: 0.241020 Oct 26 13:17:24.261357 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1761/3532] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:17:24 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1873 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:17:24.270568 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-1954d89f-c502-42aa-9843-54d4674a8fee tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] HTTP exception thrown: Instance 6668f03f-2108-4ade-88e9-d51f6e696338 could not be found. Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1954d89f-c502-42aa-9843-54d4674a8fee tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Request method failure captured: Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: request: DELETE /compute/v2.1/servers/6668f03f-2108-4ade-88e9-d51f6e696338 HTTP/1.1 Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTJbgpOJ6_WXapLDSc4DXB2ybbuKvfF9irakf13MnXe_PUvQw0tvwC_KXpEDb02nWk9gKVB2DnChPFFUGp_xOUQaSFHL5E80bTALTu8ZJijTkAv_z2Y1Gdi1cyNAMKmLE7ZnzWq0oDflWXhf1sSJNtguU-rMZFkiGbBps0dj1yOxZiU Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 3f690a680b284d82ac586346427423c3 Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersTestJSON-1612525130 Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3f690a680b284d82ac586346427423c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f690a680b284d82ac586346427423c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3f690a680b284d82ac586346427423c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f690a680b284d82ac586346427423c3"}]}] Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersTestJSON-1612525130 Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 3f690a680b284d82ac586346427423c3 Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersTestJSON-1612525130 Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersTestJSON-1612525130-project Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: fbe30a73a18d49afa07f7a66aee7805d Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersTestJSON-1612525130-project Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 6668f03f-2108-4ade-88e9-d51f6e696338 could not be found. Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '6668f03f-2108-4ade-88e9-d51f6e696338'} Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6668f03f-2108-4ade-88e9-d51f6e696338 could not be found. Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:17:24.273125 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6668f03f-2108-4ade-88e9-d51f6e696338 could not be found. Oct 26 13:17:24.277349 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.277349 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:17:24.277349 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.277349 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:24.277349 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:17:24.277349 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:17:24.277349 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:17:24.277349 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:17:24.277349 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6668f03f-2108-4ade-88e9-d51f6e696338 could not be found. Oct 26 13:17:24.277349 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.277349 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1954d89f-c502-42aa-9843-54d4674a8fee tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Returning 404 to user: Instance 6668f03f-2108-4ade-88e9-d51f6e696338 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:17:24.277349 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1954d89f-c502-42aa-9843-54d4674a8fee tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6668f03f-2108-4ade-88e9-d51f6e696338" status: 404 len: 111 microversion: 2.1 time: 0.034261 Oct 26 13:17:24.278767 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1772/3533] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:17:24 2022] DELETE /compute/v2.1/servers/6668f03f-2108-4ade-88e9-d51f6e696338 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:17:24.283005 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-158a9384-e95c-41af-9c47-91cc05955742 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:24.283687 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-158a9384-e95c-41af-9c47-91cc05955742 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 6668f03f-2108-4ade-88e9-d51f6e696338] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:24.289860 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-158a9384-e95c-41af-9c47-91cc05955742 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:24.290864 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-158a9384-e95c-41af-9c47-91cc05955742 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:24.291338 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-158a9384-e95c-41af-9c47-91cc05955742 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:24.292281 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-158a9384-e95c-41af-9c47-91cc05955742 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:24.292835 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-158a9384-e95c-41af-9c47-91cc05955742 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:24.293273 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-158a9384-e95c-41af-9c47-91cc05955742 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:24.307642 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-158a9384-e95c-41af-9c47-91cc05955742 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] HTTP exception thrown: Instance 6668f03f-2108-4ade-88e9-d51f6e696338 could not be found. Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-158a9384-e95c-41af-9c47-91cc05955742 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Request method failure captured: Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/6668f03f-2108-4ade-88e9-d51f6e696338 HTTP/1.1 Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTJbgpOJ6_WXapLDSc4DXB2ybbuKvfF9irakf13MnXe_PUvQw0tvwC_KXpEDb02nWk9gKVB2DnChPFFUGp_xOUQaSFHL5E80bTALTu8ZJijTkAv_z2Y1Gdi1cyNAMKmLE7ZnzWq0oDflWXhf1sSJNtguU-rMZFkiGbBps0dj1yOxZiU Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 3f690a680b284d82ac586346427423c3 Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersTestJSON-1612525130 Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3f690a680b284d82ac586346427423c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f690a680b284d82ac586346427423c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3f690a680b284d82ac586346427423c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f690a680b284d82ac586346427423c3"}]}] Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersTestJSON-1612525130 Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 3f690a680b284d82ac586346427423c3 Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersTestJSON-1612525130 Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersTestJSON-1612525130-project Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: fbe30a73a18d49afa07f7a66aee7805d Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersTestJSON-1612525130-project Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 6668f03f-2108-4ade-88e9-d51f6e696338 could not be found. Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '6668f03f-2108-4ade-88e9-d51f6e696338'} Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6668f03f-2108-4ade-88e9-d51f6e696338 could not be found. Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6668f03f-2108-4ade-88e9-d51f6e696338 could not be found. Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:17:24.309195 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.313643 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:24.313643 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:17:24.313643 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:17:24.313643 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:17:24.313643 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:17:24.313643 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6668f03f-2108-4ade-88e9-d51f6e696338 could not be found. Oct 26 13:17:24.313643 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.313643 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-158a9384-e95c-41af-9c47-91cc05955742 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Returning 404 to user: Instance 6668f03f-2108-4ade-88e9-d51f6e696338 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:17:24.313643 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-158a9384-e95c-41af-9c47-91cc05955742 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/6668f03f-2108-4ade-88e9-d51f6e696338" status: 404 len: 111 microversion: 2.1 time: 0.031598 Oct 26 13:17:24.315394 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1762/3534] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:24 2022] GET /compute/v2.1/servers/6668f03f-2108-4ade-88e9-d51f6e696338 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:17:24.319204 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-13b70646-7b83-4d79-b203-501a31a6456f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:24.319766 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-13b70646-7b83-4d79-b203-501a31a6456f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: a15dcabd-f50e-41f3-a7df-6b26412222a9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:24.325996 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-13b70646-7b83-4d79-b203-501a31a6456f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:24.326486 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-13b70646-7b83-4d79-b203-501a31a6456f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:24.326948 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-13b70646-7b83-4d79-b203-501a31a6456f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:24.327645 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-13b70646-7b83-4d79-b203-501a31a6456f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:24.328101 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-13b70646-7b83-4d79-b203-501a31a6456f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:24.328529 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-13b70646-7b83-4d79-b203-501a31a6456f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:24.342944 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-13b70646-7b83-4d79-b203-501a31a6456f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] HTTP exception thrown: Instance a15dcabd-f50e-41f3-a7df-6b26412222a9 could not be found. Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-13b70646-7b83-4d79-b203-501a31a6456f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Request method failure captured: Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: request: DELETE /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9 HTTP/1.1 Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTJbgpOJ6_WXapLDSc4DXB2ybbuKvfF9irakf13MnXe_PUvQw0tvwC_KXpEDb02nWk9gKVB2DnChPFFUGp_xOUQaSFHL5E80bTALTu8ZJijTkAv_z2Y1Gdi1cyNAMKmLE7ZnzWq0oDflWXhf1sSJNtguU-rMZFkiGbBps0dj1yOxZiU Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 3f690a680b284d82ac586346427423c3 Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersTestJSON-1612525130 Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3f690a680b284d82ac586346427423c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f690a680b284d82ac586346427423c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3f690a680b284d82ac586346427423c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f690a680b284d82ac586346427423c3"}]}] Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersTestJSON-1612525130 Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 3f690a680b284d82ac586346427423c3 Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersTestJSON-1612525130 Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersTestJSON-1612525130-project Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: fbe30a73a18d49afa07f7a66aee7805d Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersTestJSON-1612525130-project Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance a15dcabd-f50e-41f3-a7df-6b26412222a9 could not be found. Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'a15dcabd-f50e-41f3-a7df-6b26412222a9'} Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a15dcabd-f50e-41f3-a7df-6b26412222a9 could not be found. Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:17:24.344513 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a15dcabd-f50e-41f3-a7df-6b26412222a9 could not be found. Oct 26 13:17:24.350366 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.350366 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:17:24.350366 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.350366 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:24.350366 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:17:24.350366 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:17:24.350366 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:17:24.350366 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:17:24.350366 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a15dcabd-f50e-41f3-a7df-6b26412222a9 could not be found. Oct 26 13:17:24.350366 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.350366 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-13b70646-7b83-4d79-b203-501a31a6456f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Returning 404 to user: Instance a15dcabd-f50e-41f3-a7df-6b26412222a9 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:17:24.350366 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-13b70646-7b83-4d79-b203-501a31a6456f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9" status: 404 len: 111 microversion: 2.1 time: 0.030651 Oct 26 13:17:24.353562 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1773/3535] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:17:24 2022] DELETE /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 13:17:24.355193 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-731f4858-9897-4e32-a479-2bd591869f54 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:24.355817 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-731f4858-9897-4e32-a479-2bd591869f54 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: a15dcabd-f50e-41f3-a7df-6b26412222a9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:24.362405 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-731f4858-9897-4e32-a479-2bd591869f54 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:24.362933 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-731f4858-9897-4e32-a479-2bd591869f54 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:24.363418 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-731f4858-9897-4e32-a479-2bd591869f54 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:24.364142 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-731f4858-9897-4e32-a479-2bd591869f54 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:24.364674 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-731f4858-9897-4e32-a479-2bd591869f54 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:24.365808 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-731f4858-9897-4e32-a479-2bd591869f54 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:24.373868 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6d9b5347-f062-46f6-a8a5-3ebe9ddcc3c9 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:24.374756 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6d9b5347-f062-46f6-a8a5-3ebe9ddcc3c9 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: b29a1a98-a428-4967-bc4a-237971dcd264] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:24.381187 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-731f4858-9897-4e32-a479-2bd591869f54 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] HTTP exception thrown: Instance a15dcabd-f50e-41f3-a7df-6b26412222a9 could not be found. Oct 26 13:17:24.381341 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d9b5347-f062-46f6-a8a5-3ebe9ddcc3c9 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:24.381891 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d9b5347-f062-46f6-a8a5-3ebe9ddcc3c9 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:24.382437 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d9b5347-f062-46f6-a8a5-3ebe9ddcc3c9 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-731f4858-9897-4e32-a479-2bd591869f54 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Request method failure captured: Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9 HTTP/1.1 Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTJbgpOJ6_WXapLDSc4DXB2ybbuKvfF9irakf13MnXe_PUvQw0tvwC_KXpEDb02nWk9gKVB2DnChPFFUGp_xOUQaSFHL5E80bTALTu8ZJijTkAv_z2Y1Gdi1cyNAMKmLE7ZnzWq0oDflWXhf1sSJNtguU-rMZFkiGbBps0dj1yOxZiU Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 3f690a680b284d82ac586346427423c3 Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersTestJSON-1612525130 Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3f690a680b284d82ac586346427423c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f690a680b284d82ac586346427423c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3f690a680b284d82ac586346427423c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f690a680b284d82ac586346427423c3"}]}] Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersTestJSON-1612525130 Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 3f690a680b284d82ac586346427423c3 Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersTestJSON-1612525130 Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersTestJSON-1612525130-project Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: fbe30a73a18d49afa07f7a66aee7805d Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersTestJSON-1612525130-project Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance a15dcabd-f50e-41f3-a7df-6b26412222a9 could not be found. Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'a15dcabd-f50e-41f3-a7df-6b26412222a9'} Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a15dcabd-f50e-41f3-a7df-6b26412222a9 could not be found. Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a15dcabd-f50e-41f3-a7df-6b26412222a9 could not be found. Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:17:24.382908 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.388462 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:24.388462 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:17:24.388462 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:17:24.388462 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:17:24.388462 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:17:24.388462 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a15dcabd-f50e-41f3-a7df-6b26412222a9 could not be found. Oct 26 13:17:24.388462 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.388462 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-731f4858-9897-4e32-a479-2bd591869f54 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Returning 404 to user: Instance a15dcabd-f50e-41f3-a7df-6b26412222a9 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:17:24.388462 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-731f4858-9897-4e32-a479-2bd591869f54 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9" status: 404 len: 111 microversion: 2.1 time: 0.033699 Oct 26 13:17:24.389152 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d9b5347-f062-46f6-a8a5-3ebe9ddcc3c9 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:24.389152 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d9b5347-f062-46f6-a8a5-3ebe9ddcc3c9 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:24.389342 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1763/3536] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:24 2022] GET /compute/v2.1/servers/a15dcabd-f50e-41f3-a7df-6b26412222a9 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:17:24.389441 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d9b5347-f062-46f6-a8a5-3ebe9ddcc3c9 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:24.393193 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a033df9a-dd23-4b3a-872e-50b6e55c772c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:24.393727 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a033df9a-dd23-4b3a-872e-50b6e55c772c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 4f175b39-6703-43a3-a93b-e64e411d53b5] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:24.400558 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a033df9a-dd23-4b3a-872e-50b6e55c772c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:24.401073 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a033df9a-dd23-4b3a-872e-50b6e55c772c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:24.401544 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a033df9a-dd23-4b3a-872e-50b6e55c772c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:24.402268 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a033df9a-dd23-4b3a-872e-50b6e55c772c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:24.402750 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a033df9a-dd23-4b3a-872e-50b6e55c772c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:24.403181 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a033df9a-dd23-4b3a-872e-50b6e55c772c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:24.417641 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-a033df9a-dd23-4b3a-872e-50b6e55c772c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] HTTP exception thrown: Instance 4f175b39-6703-43a3-a93b-e64e411d53b5 could not be found. Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a033df9a-dd23-4b3a-872e-50b6e55c772c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Request method failure captured: Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/servers/4f175b39-6703-43a3-a93b-e64e411d53b5 HTTP/1.1 Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTJbgpOJ6_WXapLDSc4DXB2ybbuKvfF9irakf13MnXe_PUvQw0tvwC_KXpEDb02nWk9gKVB2DnChPFFUGp_xOUQaSFHL5E80bTALTu8ZJijTkAv_z2Y1Gdi1cyNAMKmLE7ZnzWq0oDflWXhf1sSJNtguU-rMZFkiGbBps0dj1yOxZiU Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 3f690a680b284d82ac586346427423c3 Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersTestJSON-1612525130 Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3f690a680b284d82ac586346427423c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f690a680b284d82ac586346427423c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3f690a680b284d82ac586346427423c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f690a680b284d82ac586346427423c3"}]}] Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersTestJSON-1612525130 Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 3f690a680b284d82ac586346427423c3 Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersTestJSON-1612525130 Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersTestJSON-1612525130-project Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: fbe30a73a18d49afa07f7a66aee7805d Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersTestJSON-1612525130-project Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 4f175b39-6703-43a3-a93b-e64e411d53b5 could not be found. Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '4f175b39-6703-43a3-a93b-e64e411d53b5'} Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f175b39-6703-43a3-a93b-e64e411d53b5 could not be found. Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:17:24.419214 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f175b39-6703-43a3-a93b-e64e411d53b5 could not be found. Oct 26 13:17:24.424597 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.424597 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:17:24.424597 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.424597 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:24.424597 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:17:24.424597 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:17:24.424597 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:17:24.424597 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:17:24.424597 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f175b39-6703-43a3-a93b-e64e411d53b5 could not be found. Oct 26 13:17:24.424597 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.424597 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a033df9a-dd23-4b3a-872e-50b6e55c772c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Returning 404 to user: Instance 4f175b39-6703-43a3-a93b-e64e411d53b5 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:17:24.424597 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a033df9a-dd23-4b3a-872e-50b6e55c772c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4f175b39-6703-43a3-a93b-e64e411d53b5" status: 404 len: 111 microversion: 2.1 time: 0.031274 Oct 26 13:17:24.424597 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1764/3537] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:17:24 2022] DELETE /compute/v2.1/servers/4f175b39-6703-43a3-a93b-e64e411d53b5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:17:24.429189 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ce45861e-f91f-49a7-9f65-d2d1e8cda0a7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:24.429829 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ce45861e-f91f-49a7-9f65-d2d1e8cda0a7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 4f175b39-6703-43a3-a93b-e64e411d53b5] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:24.436563 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce45861e-f91f-49a7-9f65-d2d1e8cda0a7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:24.437070 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce45861e-f91f-49a7-9f65-d2d1e8cda0a7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:24.437543 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce45861e-f91f-49a7-9f65-d2d1e8cda0a7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:24.438247 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce45861e-f91f-49a7-9f65-d2d1e8cda0a7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:24.438709 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce45861e-f91f-49a7-9f65-d2d1e8cda0a7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:24.439140 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce45861e-f91f-49a7-9f65-d2d1e8cda0a7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:24.453177 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-ce45861e-f91f-49a7-9f65-d2d1e8cda0a7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] HTTP exception thrown: Instance 4f175b39-6703-43a3-a93b-e64e411d53b5 could not be found. Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ce45861e-f91f-49a7-9f65-d2d1e8cda0a7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Request method failure captured: Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/4f175b39-6703-43a3-a93b-e64e411d53b5 HTTP/1.1 Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTJbgpOJ6_WXapLDSc4DXB2ybbuKvfF9irakf13MnXe_PUvQw0tvwC_KXpEDb02nWk9gKVB2DnChPFFUGp_xOUQaSFHL5E80bTALTu8ZJijTkAv_z2Y1Gdi1cyNAMKmLE7ZnzWq0oDflWXhf1sSJNtguU-rMZFkiGbBps0dj1yOxZiU Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 3f690a680b284d82ac586346427423c3 Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersTestJSON-1612525130 Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3f690a680b284d82ac586346427423c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f690a680b284d82ac586346427423c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3f690a680b284d82ac586346427423c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f690a680b284d82ac586346427423c3"}]}] Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersTestJSON-1612525130 Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 3f690a680b284d82ac586346427423c3 Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersTestJSON-1612525130 Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersTestJSON-1612525130-project Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: fbe30a73a18d49afa07f7a66aee7805d Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersTestJSON-1612525130-project Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 4f175b39-6703-43a3-a93b-e64e411d53b5 could not be found. Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '4f175b39-6703-43a3-a93b-e64e411d53b5'} Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f175b39-6703-43a3-a93b-e64e411d53b5 could not be found. Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f175b39-6703-43a3-a93b-e64e411d53b5 could not be found. Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:17:24.454797 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.459568 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:24.459568 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:17:24.459568 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:17:24.459568 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:17:24.459568 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:17:24.459568 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f175b39-6703-43a3-a93b-e64e411d53b5 could not be found. Oct 26 13:17:24.459568 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.459568 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ce45861e-f91f-49a7-9f65-d2d1e8cda0a7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Returning 404 to user: Instance 4f175b39-6703-43a3-a93b-e64e411d53b5 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:17:24.459568 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ce45861e-f91f-49a7-9f65-d2d1e8cda0a7 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/4f175b39-6703-43a3-a93b-e64e411d53b5" status: 404 len: 111 microversion: 2.1 time: 0.030764 Oct 26 13:17:24.460277 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1765/3538] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:24 2022] GET /compute/v2.1/servers/4f175b39-6703-43a3-a93b-e64e411d53b5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 13:17:24.465280 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-834099a2-38d6-4574-9099-0535adc2cdf0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:24.465805 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-834099a2-38d6-4574-9099-0535adc2cdf0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: a97f1ba5-167d-4b32-a9db-7f68bdb2a255] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:24.471760 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-834099a2-38d6-4574-9099-0535adc2cdf0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:24.472295 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-834099a2-38d6-4574-9099-0535adc2cdf0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:24.472740 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-834099a2-38d6-4574-9099-0535adc2cdf0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:24.473709 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-834099a2-38d6-4574-9099-0535adc2cdf0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:24.474603 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-834099a2-38d6-4574-9099-0535adc2cdf0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:24.475101 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-834099a2-38d6-4574-9099-0535adc2cdf0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:24.492101 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-834099a2-38d6-4574-9099-0535adc2cdf0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] HTTP exception thrown: Instance a97f1ba5-167d-4b32-a9db-7f68bdb2a255 could not be found. Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-834099a2-38d6-4574-9099-0535adc2cdf0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Request method failure captured: Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/servers/a97f1ba5-167d-4b32-a9db-7f68bdb2a255 HTTP/1.1 Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTJbgpOJ6_WXapLDSc4DXB2ybbuKvfF9irakf13MnXe_PUvQw0tvwC_KXpEDb02nWk9gKVB2DnChPFFUGp_xOUQaSFHL5E80bTALTu8ZJijTkAv_z2Y1Gdi1cyNAMKmLE7ZnzWq0oDflWXhf1sSJNtguU-rMZFkiGbBps0dj1yOxZiU Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 3f690a680b284d82ac586346427423c3 Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersTestJSON-1612525130 Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3f690a680b284d82ac586346427423c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f690a680b284d82ac586346427423c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3f690a680b284d82ac586346427423c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f690a680b284d82ac586346427423c3"}]}] Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersTestJSON-1612525130 Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 3f690a680b284d82ac586346427423c3 Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersTestJSON-1612525130 Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersTestJSON-1612525130-project Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: fbe30a73a18d49afa07f7a66aee7805d Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersTestJSON-1612525130-project Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance a97f1ba5-167d-4b32-a9db-7f68bdb2a255 could not be found. Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'a97f1ba5-167d-4b32-a9db-7f68bdb2a255'} Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a97f1ba5-167d-4b32-a9db-7f68bdb2a255 could not be found. Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:17:24.494152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a97f1ba5-167d-4b32-a9db-7f68bdb2a255 could not be found. Oct 26 13:17:24.498774 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.498774 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:17:24.498774 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.498774 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:24.498774 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:17:24.498774 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:17:24.498774 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:17:24.498774 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:17:24.498774 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a97f1ba5-167d-4b32-a9db-7f68bdb2a255 could not be found. Oct 26 13:17:24.498774 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.498774 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-834099a2-38d6-4574-9099-0535adc2cdf0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Returning 404 to user: Instance a97f1ba5-167d-4b32-a9db-7f68bdb2a255 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:17:24.499602 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-834099a2-38d6-4574-9099-0535adc2cdf0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a97f1ba5-167d-4b32-a9db-7f68bdb2a255" status: 404 len: 111 microversion: 2.1 time: 0.038555 Oct 26 13:17:24.499980 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1766/3539] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:17:24 2022] DELETE /compute/v2.1/servers/a97f1ba5-167d-4b32-a9db-7f68bdb2a255 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:17:24.508207 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-41aaef00-9b8d-49b2-ac30-71bab0cffb6f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:24.508865 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-41aaef00-9b8d-49b2-ac30-71bab0cffb6f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: a97f1ba5-167d-4b32-a9db-7f68bdb2a255] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:24.515787 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41aaef00-9b8d-49b2-ac30-71bab0cffb6f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:24.516273 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41aaef00-9b8d-49b2-ac30-71bab0cffb6f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:24.516709 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41aaef00-9b8d-49b2-ac30-71bab0cffb6f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:24.517407 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41aaef00-9b8d-49b2-ac30-71bab0cffb6f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:24.517917 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41aaef00-9b8d-49b2-ac30-71bab0cffb6f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:24.518340 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41aaef00-9b8d-49b2-ac30-71bab0cffb6f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:24.537121 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-41aaef00-9b8d-49b2-ac30-71bab0cffb6f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] HTTP exception thrown: Instance a97f1ba5-167d-4b32-a9db-7f68bdb2a255 could not be found. Oct 26 13:17:24.540080 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6d9b5347-f062-46f6-a8a5-3ebe9ddcc3c9 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-41aaef00-9b8d-49b2-ac30-71bab0cffb6f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Request method failure captured: Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/a97f1ba5-167d-4b32-a9db-7f68bdb2a255 HTTP/1.1 Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTJbgpOJ6_WXapLDSc4DXB2ybbuKvfF9irakf13MnXe_PUvQw0tvwC_KXpEDb02nWk9gKVB2DnChPFFUGp_xOUQaSFHL5E80bTALTu8ZJijTkAv_z2Y1Gdi1cyNAMKmLE7ZnzWq0oDflWXhf1sSJNtguU-rMZFkiGbBps0dj1yOxZiU Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 3f690a680b284d82ac586346427423c3 Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersTestJSON-1612525130 Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3f690a680b284d82ac586346427423c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f690a680b284d82ac586346427423c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3f690a680b284d82ac586346427423c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f690a680b284d82ac586346427423c3"}]}] Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersTestJSON-1612525130 Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 3f690a680b284d82ac586346427423c3 Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersTestJSON-1612525130 Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersTestJSON-1612525130-project Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: fbe30a73a18d49afa07f7a66aee7805d Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersTestJSON-1612525130-project Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance a97f1ba5-167d-4b32-a9db-7f68bdb2a255 could not be found. Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'a97f1ba5-167d-4b32-a9db-7f68bdb2a255'} Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a97f1ba5-167d-4b32-a9db-7f68bdb2a255 could not be found. Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a97f1ba5-167d-4b32-a9db-7f68bdb2a255 could not be found. Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:17:24.543476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.552001 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:24.552001 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:17:24.552001 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:17:24.552001 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:17:24.552001 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:17:24.552001 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a97f1ba5-167d-4b32-a9db-7f68bdb2a255 could not be found. Oct 26 13:17:24.552001 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.552001 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-41aaef00-9b8d-49b2-ac30-71bab0cffb6f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Returning 404 to user: Instance a97f1ba5-167d-4b32-a9db-7f68bdb2a255 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:17:24.552001 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-41aaef00-9b8d-49b2-ac30-71bab0cffb6f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/a97f1ba5-167d-4b32-a9db-7f68bdb2a255" status: 404 len: 111 microversion: 2.1 time: 0.041652 Oct 26 13:17:24.552001 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1767/3540] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:24 2022] GET /compute/v2.1/servers/a97f1ba5-167d-4b32-a9db-7f68bdb2a255 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 13:17:24.554488 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6d9b5347-f062-46f6-a8a5-3ebe9ddcc3c9 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264" status: 200 len: 1507 microversion: 2.1 time: 0.184644 Oct 26 13:17:24.554933 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-de1d65e2-e99a-4c60-8c0d-2c82959e6994 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:24.555246 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1774/3541] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:24 2022] GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264 => generated 1507 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:17:24.555499 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-de1d65e2-e99a-4c60-8c0d-2c82959e6994 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 32577336-ef39-4814-a807-19dd6dcc442b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:24.562605 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-de1d65e2-e99a-4c60-8c0d-2c82959e6994 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:24.563104 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-de1d65e2-e99a-4c60-8c0d-2c82959e6994 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:24.563542 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-de1d65e2-e99a-4c60-8c0d-2c82959e6994 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:24.564469 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0e870c36-ab6b-4276-9599-c828c8bcdfab tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:24.564593 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-de1d65e2-e99a-4c60-8c0d-2c82959e6994 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:24.564992 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-de1d65e2-e99a-4c60-8c0d-2c82959e6994 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:24.565426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-de1d65e2-e99a-4c60-8c0d-2c82959e6994 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:24.565938 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0e870c36-ab6b-4276-9599-c828c8bcdfab tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:24.572213 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0e870c36-ab6b-4276-9599-c828c8bcdfab tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:24.572808 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0e870c36-ab6b-4276-9599-c828c8bcdfab tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:24.573339 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0e870c36-ab6b-4276-9599-c828c8bcdfab tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:24.574599 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0e870c36-ab6b-4276-9599-c828c8bcdfab tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:24.575433 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0e870c36-ab6b-4276-9599-c828c8bcdfab tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:24.576127 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0e870c36-ab6b-4276-9599-c828c8bcdfab tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:24.587717 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-de1d65e2-e99a-4c60-8c0d-2c82959e6994 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] HTTP exception thrown: Instance 32577336-ef39-4814-a807-19dd6dcc442b could not be found. Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-de1d65e2-e99a-4c60-8c0d-2c82959e6994 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Request method failure captured: Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/servers/32577336-ef39-4814-a807-19dd6dcc442b HTTP/1.1 Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTJbgpOJ6_WXapLDSc4DXB2ybbuKvfF9irakf13MnXe_PUvQw0tvwC_KXpEDb02nWk9gKVB2DnChPFFUGp_xOUQaSFHL5E80bTALTu8ZJijTkAv_z2Y1Gdi1cyNAMKmLE7ZnzWq0oDflWXhf1sSJNtguU-rMZFkiGbBps0dj1yOxZiU Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 3f690a680b284d82ac586346427423c3 Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersTestJSON-1612525130 Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3f690a680b284d82ac586346427423c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f690a680b284d82ac586346427423c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3f690a680b284d82ac586346427423c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f690a680b284d82ac586346427423c3"}]}] Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersTestJSON-1612525130 Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 3f690a680b284d82ac586346427423c3 Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersTestJSON-1612525130 Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersTestJSON-1612525130-project Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: fbe30a73a18d49afa07f7a66aee7805d Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersTestJSON-1612525130-project Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 32577336-ef39-4814-a807-19dd6dcc442b could not be found. Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '32577336-ef39-4814-a807-19dd6dcc442b'} Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32577336-ef39-4814-a807-19dd6dcc442b could not be found. Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:17:24.589591 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32577336-ef39-4814-a807-19dd6dcc442b could not be found. Oct 26 13:17:24.597512 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.597512 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:17:24.597512 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.597512 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:24.597512 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:17:24.597512 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:17:24.597512 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:17:24.597512 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:17:24.597512 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32577336-ef39-4814-a807-19dd6dcc442b could not be found. Oct 26 13:17:24.597512 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.597512 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-de1d65e2-e99a-4c60-8c0d-2c82959e6994 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Returning 404 to user: Instance 32577336-ef39-4814-a807-19dd6dcc442b could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:17:24.597512 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-de1d65e2-e99a-4c60-8c0d-2c82959e6994 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "DELETE /compute/v2.1/servers/32577336-ef39-4814-a807-19dd6dcc442b" status: 404 len: 111 microversion: 2.1 time: 0.041204 Oct 26 13:17:24.597512 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1768/3542] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:17:24 2022] DELETE /compute/v2.1/servers/32577336-ef39-4814-a807-19dd6dcc442b => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:17:24.604955 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2e040524-d48f-4a97-8e34-acb73baddcf0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:24.605603 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2e040524-d48f-4a97-8e34-acb73baddcf0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 32577336-ef39-4814-a807-19dd6dcc442b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:24.611934 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e040524-d48f-4a97-8e34-acb73baddcf0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:24.612416 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e040524-d48f-4a97-8e34-acb73baddcf0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:24.613030 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e040524-d48f-4a97-8e34-acb73baddcf0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:24.614051 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e040524-d48f-4a97-8e34-acb73baddcf0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:24.614830 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e040524-d48f-4a97-8e34-acb73baddcf0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:24.615265 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e040524-d48f-4a97-8e34-acb73baddcf0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:24.629742 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-2e040524-d48f-4a97-8e34-acb73baddcf0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] HTTP exception thrown: Instance 32577336-ef39-4814-a807-19dd6dcc442b could not be found. Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2e040524-d48f-4a97-8e34-acb73baddcf0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Request method failure captured: Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/32577336-ef39-4814-a807-19dd6dcc442b HTTP/1.1 Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTJbgpOJ6_WXapLDSc4DXB2ybbuKvfF9irakf13MnXe_PUvQw0tvwC_KXpEDb02nWk9gKVB2DnChPFFUGp_xOUQaSFHL5E80bTALTu8ZJijTkAv_z2Y1Gdi1cyNAMKmLE7ZnzWq0oDflWXhf1sSJNtguU-rMZFkiGbBps0dj1yOxZiU Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 3f690a680b284d82ac586346427423c3 Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersTestJSON-1612525130 Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3f690a680b284d82ac586346427423c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f690a680b284d82ac586346427423c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3f690a680b284d82ac586346427423c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f690a680b284d82ac586346427423c3"}]}] Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersTestJSON-1612525130 Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 3f690a680b284d82ac586346427423c3 Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersTestJSON-1612525130 Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersTestJSON-1612525130-project Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: fbe30a73a18d49afa07f7a66aee7805d Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersTestJSON-1612525130-project Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 32577336-ef39-4814-a807-19dd6dcc442b could not be found. Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '32577336-ef39-4814-a807-19dd6dcc442b'} Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32577336-ef39-4814-a807-19dd6dcc442b could not be found. Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32577336-ef39-4814-a807-19dd6dcc442b could not be found. Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:17:24.631639 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.636751 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:24.636751 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:17:24.636751 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:17:24.636751 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:17:24.636751 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:17:24.636751 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32577336-ef39-4814-a807-19dd6dcc442b could not be found. Oct 26 13:17:24.636751 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:24.639416 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2e040524-d48f-4a97-8e34-acb73baddcf0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Returning 404 to user: Instance 32577336-ef39-4814-a807-19dd6dcc442b could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:17:24.639416 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2e040524-d48f-4a97-8e34-acb73baddcf0 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/32577336-ef39-4814-a807-19dd6dcc442b" status: 404 len: 111 microversion: 2.1 time: 0.039044 Oct 26 13:17:24.639416 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1769/3543] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:24 2022] GET /compute/v2.1/servers/32577336-ef39-4814-a807-19dd6dcc442b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 13:17:24.647821 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-921f80a9-f019-4f5b-9afd-c74e4dcd67c1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:24.648327 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-921f80a9-f019-4f5b-9afd-c74e4dcd67c1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 02c38c79-9670-4d6d-bad7-70953e1ff22b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:24.655074 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-921f80a9-f019-4f5b-9afd-c74e4dcd67c1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:24.655569 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-921f80a9-f019-4f5b-9afd-c74e4dcd67c1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:24.656017 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-921f80a9-f019-4f5b-9afd-c74e4dcd67c1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:24.656725 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-921f80a9-f019-4f5b-9afd-c74e4dcd67c1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:24.657188 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-921f80a9-f019-4f5b-9afd-c74e4dcd67c1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:24.657660 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-921f80a9-f019-4f5b-9afd-c74e4dcd67c1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:24.690644 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-921f80a9-f019-4f5b-9afd-c74e4dcd67c1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 02c38c79-9670-4d6d-bad7-70953e1ff22b] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:17:24.726045 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0e870c36-ab6b-4276-9599-c828c8bcdfab tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:24.734251 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0e870c36-ab6b-4276-9599-c828c8bcdfab tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1315 microversion: 2.1 time: 0.174417 Oct 26 13:17:24.735124 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1775/3544] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:24 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:17:24.789920 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-921f80a9-f019-4f5b-9afd-c74e4dcd67c1 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "DELETE /compute/v2.1/servers/02c38c79-9670-4d6d-bad7-70953e1ff22b" status: 204 len: 0 microversion: 2.1 time: 0.145818 Oct 26 13:17:24.791570 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1770/3545] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:17:24 2022] DELETE /compute/v2.1/servers/02c38c79-9670-4d6d-bad7-70953e1ff22b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 26 13:17:24.799370 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-20ddce06-f442-476c-8a81-c45516ffaf08 req-7db5136c-d8f5-4aad-8c64-7019d7f5cae4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7743d90-f9dc-4601-a6d3-a4901bf9cc05", "name": "network-vif-plugged", "status": "completed", "tag": "cd05a893-6fb7-45ab-985e-5e98b6a0306b"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:17:24.801405 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-202dd05a-316b-47b5-9294-47d3f54cc355 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:24.801927 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-202dd05a-316b-47b5-9294-47d3f54cc355 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 02c38c79-9670-4d6d-bad7-70953e1ff22b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:24.811916 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-202dd05a-316b-47b5-9294-47d3f54cc355 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:24.813150 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-202dd05a-316b-47b5-9294-47d3f54cc355 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:24.814082 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-202dd05a-316b-47b5-9294-47d3f54cc355 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:24.814657 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-20ddce06-f442-476c-8a81-c45516ffaf08 req-7db5136c-d8f5-4aad-8c64-7019d7f5cae4 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:24.815484 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-202dd05a-316b-47b5-9294-47d3f54cc355 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:24.815629 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-20ddce06-f442-476c-8a81-c45516ffaf08 req-7db5136c-d8f5-4aad-8c64-7019d7f5cae4 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:24.815987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-202dd05a-316b-47b5-9294-47d3f54cc355 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:24.816122 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-20ddce06-f442-476c-8a81-c45516ffaf08 req-7db5136c-d8f5-4aad-8c64-7019d7f5cae4 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:24.816760 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-202dd05a-316b-47b5-9294-47d3f54cc355 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:24.833092 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-20ddce06-f442-476c-8a81-c45516ffaf08 req-7db5136c-d8f5-4aad-8c64-7019d7f5cae4 service nova] Creating event network-vif-plugged:cd05a893-6fb7-45ab-985e-5e98b6a0306b for instance b7743d90-f9dc-4601-a6d3-a4901bf9cc05 on n-h2-862686-1 Oct 26 13:17:24.838917 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-20ddce06-f442-476c-8a81-c45516ffaf08 req-7db5136c-d8f5-4aad-8c64-7019d7f5cae4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050479 Oct 26 13:17:24.839522 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1776/3546] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:17:24.844999 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a3de9a78-cbaf-483f-ae17-48485ecc3215 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:24.845729 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a3de9a78-cbaf-483f-ae17-48485ecc3215 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:24.852108 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a3de9a78-cbaf-483f-ae17-48485ecc3215 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:24.852630 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a3de9a78-cbaf-483f-ae17-48485ecc3215 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:24.853083 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a3de9a78-cbaf-483f-ae17-48485ecc3215 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:24.853945 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a3de9a78-cbaf-483f-ae17-48485ecc3215 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:24.854412 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a3de9a78-cbaf-483f-ae17-48485ecc3215 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:24.854856 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a3de9a78-cbaf-483f-ae17-48485ecc3215 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:24.989623 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-202dd05a-316b-47b5-9294-47d3f54cc355 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:24.998887 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-202dd05a-316b-47b5-9294-47d3f54cc355 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/02c38c79-9670-4d6d-bad7-70953e1ff22b" status: 200 len: 1479 microversion: 2.1 time: 0.202976 Oct 26 13:17:24.999492 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1771/3547] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:24 2022] GET /compute/v2.1/servers/02c38c79-9670-4d6d-bad7-70953e1ff22b => generated 1479 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:17:25.005593 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-76c25e85-4109-420d-8461-844b42887a46 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:25.006498 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-76c25e85-4109-420d-8461-844b42887a46 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 2c859d43-c102-4189-9e7a-6c88ff38f311] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:25.013091 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a3de9a78-cbaf-483f-ae17-48485ecc3215 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:25.019956 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-76c25e85-4109-420d-8461-844b42887a46 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:25.020719 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-76c25e85-4109-420d-8461-844b42887a46 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:25.021636 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-76c25e85-4109-420d-8461-844b42887a46 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:25.022671 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-76c25e85-4109-420d-8461-844b42887a46 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:25.022819 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a3de9a78-cbaf-483f-ae17-48485ecc3215 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1199 microversion: 2.1 time: 0.181725 Oct 26 13:17:25.023343 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-76c25e85-4109-420d-8461-844b42887a46 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:25.023645 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1777/3548] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:24 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1199 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:25.024357 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-76c25e85-4109-420d-8461-844b42887a46 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:25.159986 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-76c25e85-4109-420d-8461-844b42887a46 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:25.167783 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-76c25e85-4109-420d-8461-844b42887a46 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311" status: 200 len: 1683 microversion: 2.1 time: 0.167137 Oct 26 13:17:25.168364 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1772/3549] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:24 2022] GET /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311 => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:25.265416 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1e418e3f-c1a3-4923-b8b8-7bd8844c223d tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:25.266043 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1e418e3f-c1a3-4923-b8b8-7bd8844c223d tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] [instance: b777991e-573a-43e3-abcb-ec40283e625d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:25.273373 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1e418e3f-c1a3-4923-b8b8-7bd8844c223d tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:25.273883 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1e418e3f-c1a3-4923-b8b8-7bd8844c223d tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:25.274316 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1e418e3f-c1a3-4923-b8b8-7bd8844c223d tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:25.275604 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1e418e3f-c1a3-4923-b8b8-7bd8844c223d tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:25.276106 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1e418e3f-c1a3-4923-b8b8-7bd8844c223d tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:25.276533 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1e418e3f-c1a3-4923-b8b8-7bd8844c223d tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:25.288039 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1b5bed37-561a-49df-98cd-4ae451678479 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:25.288730 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1b5bed37-561a-49df-98cd-4ae451678479 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:25.295124 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b5bed37-561a-49df-98cd-4ae451678479 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:25.295626 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b5bed37-561a-49df-98cd-4ae451678479 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:25.296078 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b5bed37-561a-49df-98cd-4ae451678479 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:25.296790 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b5bed37-561a-49df-98cd-4ae451678479 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:25.297255 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b5bed37-561a-49df-98cd-4ae451678479 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:25.297726 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b5bed37-561a-49df-98cd-4ae451678479 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:25.419535 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1e418e3f-c1a3-4923-b8b8-7bd8844c223d tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53010c15247443b29ce39f037e22ca24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c0302538ba431684624b8d41dfc2f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:25.427557 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1e418e3f-c1a3-4923-b8b8-7bd8844c223d tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] 10.222.0.40 "GET /compute/v2.1/servers/b777991e-573a-43e3-abcb-ec40283e625d" status: 200 len: 1316 microversion: 2.1 time: 0.166220 Oct 26 13:17:25.428212 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1778/3550] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:25 2022] GET /compute/v2.1/servers/b777991e-573a-43e3-abcb-ec40283e625d => generated 1316 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:25.488995 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1b5bed37-561a-49df-98cd-4ae451678479 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:25.491372 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:17:25.500496 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1b5bed37-561a-49df-98cd-4ae451678479 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:25.501990 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1b5bed37-561a-49df-98cd-4ae451678479 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:25.503148 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1b5bed37-561a-49df-98cd-4ae451678479 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1873 microversion: 2.32 time: 0.219133 Oct 26 13:17:25.503727 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1773/3551] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:17:25 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1873 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:17:25.579595 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a5488134-64b0-4f54-876e-aafbc2f8b992 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:25.580219 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a5488134-64b0-4f54-876e-aafbc2f8b992 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: b29a1a98-a428-4967-bc4a-237971dcd264] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:25.586492 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5488134-64b0-4f54-876e-aafbc2f8b992 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:25.587125 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5488134-64b0-4f54-876e-aafbc2f8b992 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:25.587634 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5488134-64b0-4f54-876e-aafbc2f8b992 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:25.588361 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5488134-64b0-4f54-876e-aafbc2f8b992 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:25.588825 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5488134-64b0-4f54-876e-aafbc2f8b992 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:25.589405 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5488134-64b0-4f54-876e-aafbc2f8b992 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:25.723284 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a5488134-64b0-4f54-876e-aafbc2f8b992 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:25.731352 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a5488134-64b0-4f54-876e-aafbc2f8b992 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264" status: 200 len: 1507 microversion: 2.1 time: 0.155815 Oct 26 13:17:25.731929 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1779/3552] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:25 2022] GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:25.758655 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d79d3cb6-b97f-4cc2-baac-146e329b07f8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:25.760142 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d79d3cb6-b97f-4cc2-baac-146e329b07f8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:25.768120 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d79d3cb6-b97f-4cc2-baac-146e329b07f8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:25.768618 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d79d3cb6-b97f-4cc2-baac-146e329b07f8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:25.769062 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d79d3cb6-b97f-4cc2-baac-146e329b07f8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:25.769798 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d79d3cb6-b97f-4cc2-baac-146e329b07f8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:25.770265 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d79d3cb6-b97f-4cc2-baac-146e329b07f8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:25.770701 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d79d3cb6-b97f-4cc2-baac-146e329b07f8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:25.908373 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d79d3cb6-b97f-4cc2-baac-146e329b07f8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:25.916372 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d79d3cb6-b97f-4cc2-baac-146e329b07f8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1315 microversion: 2.1 time: 0.162694 Oct 26 13:17:25.916991 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1774/3553] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:25 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:26.024160 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-10736326-0a51-4d5d-b241-641ee5de0c5b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:26.024874 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-10736326-0a51-4d5d-b241-641ee5de0c5b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 02c38c79-9670-4d6d-bad7-70953e1ff22b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:26.031050 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10736326-0a51-4d5d-b241-641ee5de0c5b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:26.031540 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10736326-0a51-4d5d-b241-641ee5de0c5b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:26.031979 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10736326-0a51-4d5d-b241-641ee5de0c5b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:26.032676 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10736326-0a51-4d5d-b241-641ee5de0c5b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:26.033132 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10736326-0a51-4d5d-b241-641ee5de0c5b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:26.033586 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10736326-0a51-4d5d-b241-641ee5de0c5b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:26.048265 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a151e0a5-0dfc-4773-b2ca-7c0ea4d43b64 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:26.049049 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a151e0a5-0dfc-4773-b2ca-7c0ea4d43b64 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:26.050943 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:17:26.059486 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a151e0a5-0dfc-4773-b2ca-7c0ea4d43b64 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:26.059980 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a151e0a5-0dfc-4773-b2ca-7c0ea4d43b64 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:26.060420 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a151e0a5-0dfc-4773-b2ca-7c0ea4d43b64 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:26.061115 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a151e0a5-0dfc-4773-b2ca-7c0ea4d43b64 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:26.061590 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a151e0a5-0dfc-4773-b2ca-7c0ea4d43b64 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:26.062489 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a151e0a5-0dfc-4773-b2ca-7c0ea4d43b64 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:26.183821 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-10736326-0a51-4d5d-b241-641ee5de0c5b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:26.194407 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-10736326-0a51-4d5d-b241-641ee5de0c5b tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/02c38c79-9670-4d6d-bad7-70953e1ff22b" status: 200 len: 1479 microversion: 2.1 time: 0.174485 Oct 26 13:17:26.194993 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1780/3554] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:26 2022] GET /compute/v2.1/servers/02c38c79-9670-4d6d-bad7-70953e1ff22b => generated 1479 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:26.215112 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-739b9394-bd65-4519-9028-91a78aca8ff1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:26.215733 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-739b9394-bd65-4519-9028-91a78aca8ff1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 2c859d43-c102-4189-9e7a-6c88ff38f311] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:26.223208 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-739b9394-bd65-4519-9028-91a78aca8ff1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:26.223704 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-739b9394-bd65-4519-9028-91a78aca8ff1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:26.224144 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-739b9394-bd65-4519-9028-91a78aca8ff1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:26.224853 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-739b9394-bd65-4519-9028-91a78aca8ff1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:26.225318 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-739b9394-bd65-4519-9028-91a78aca8ff1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:26.225772 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-739b9394-bd65-4519-9028-91a78aca8ff1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:26.260458 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a151e0a5-0dfc-4773-b2ca-7c0ea4d43b64 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:26.269717 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a151e0a5-0dfc-4773-b2ca-7c0ea4d43b64 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1199 microversion: 2.1 time: 0.226795 Oct 26 13:17:26.282133 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1775/3555] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:26 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1199 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:17:26.359705 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-739b9394-bd65-4519-9028-91a78aca8ff1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:26.367670 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-739b9394-bd65-4519-9028-91a78aca8ff1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311" status: 200 len: 1683 microversion: 2.1 time: 0.156642 Oct 26 13:17:26.368330 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1781/3556] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:26 2022] GET /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:26.452586 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c176859d-074d-4c69-84ad-688c7d98759e tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:26.453302 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c176859d-074d-4c69-84ad-688c7d98759e tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] [instance: b777991e-573a-43e3-abcb-ec40283e625d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:26.459919 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c176859d-074d-4c69-84ad-688c7d98759e tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:26.460479 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c176859d-074d-4c69-84ad-688c7d98759e tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:26.460994 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c176859d-074d-4c69-84ad-688c7d98759e tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:26.461713 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c176859d-074d-4c69-84ad-688c7d98759e tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:26.462798 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c176859d-074d-4c69-84ad-688c7d98759e tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:26.463241 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c176859d-074d-4c69-84ad-688c7d98759e tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:26.531911 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-97da298a-f5b7-4e51-93e2-6d514272cbe1 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:26.532732 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-97da298a-f5b7-4e51-93e2-6d514272cbe1 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:26.540983 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97da298a-f5b7-4e51-93e2-6d514272cbe1 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:26.541710 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97da298a-f5b7-4e51-93e2-6d514272cbe1 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:26.542157 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97da298a-f5b7-4e51-93e2-6d514272cbe1 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:26.542861 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97da298a-f5b7-4e51-93e2-6d514272cbe1 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:26.543383 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97da298a-f5b7-4e51-93e2-6d514272cbe1 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:26.543981 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97da298a-f5b7-4e51-93e2-6d514272cbe1 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:26.744600 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-97da298a-f5b7-4e51-93e2-6d514272cbe1 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:26.758284 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-97da298a-f5b7-4e51-93e2-6d514272cbe1 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:26.760018 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-97da298a-f5b7-4e51-93e2-6d514272cbe1 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:26.761415 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-97da298a-f5b7-4e51-93e2-6d514272cbe1 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1873 microversion: 2.32 time: 0.233557 Oct 26 13:17:26.762173 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1782/3557] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:17:26 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1873 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:17:26.775795 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cb1b32f6-08f2-4636-ba3a-ab71a444cf71 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:26.776582 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cb1b32f6-08f2-4636-ba3a-ab71a444cf71 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: b29a1a98-a428-4967-bc4a-237971dcd264] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:26.778842 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=4 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:17:26.783045 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cb1b32f6-08f2-4636-ba3a-ab71a444cf71 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:26.783537 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cb1b32f6-08f2-4636-ba3a-ab71a444cf71 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:26.783969 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cb1b32f6-08f2-4636-ba3a-ab71a444cf71 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:26.784668 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cb1b32f6-08f2-4636-ba3a-ab71a444cf71 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:26.785151 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cb1b32f6-08f2-4636-ba3a-ab71a444cf71 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:26.785568 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cb1b32f6-08f2-4636-ba3a-ab71a444cf71 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:26.799410 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c176859d-074d-4c69-84ad-688c7d98759e tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53010c15247443b29ce39f037e22ca24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c0302538ba431684624b8d41dfc2f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:26.808616 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c176859d-074d-4c69-84ad-688c7d98759e tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] 10.222.0.40 "GET /compute/v2.1/servers/b777991e-573a-43e3-abcb-ec40283e625d" status: 200 len: 1316 microversion: 2.1 time: 0.359962 Oct 26 13:17:26.809437 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1776/3558] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:26 2022] GET /compute/v2.1/servers/b777991e-573a-43e3-abcb-ec40283e625d => generated 1316 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:26.875792 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-ec93ed8a-a2bb-4433-b768-6d766ce76b74 req-b8540674-3ec4-4405-bdd9-60e5567e0c72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b777991e-573a-43e3-abcb-ec40283e625d", "name": "network-vif-plugged", "status": "completed", "tag": "42310a0c-3052-4cd8-b220-3b7a3cb26c88"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:17:26.886066 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ec93ed8a-a2bb-4433-b768-6d766ce76b74 req-b8540674-3ec4-4405-bdd9-60e5567e0c72 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:26.886536 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ec93ed8a-a2bb-4433-b768-6d766ce76b74 req-b8540674-3ec4-4405-bdd9-60e5567e0c72 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:26.886963 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ec93ed8a-a2bb-4433-b768-6d766ce76b74 req-b8540674-3ec4-4405-bdd9-60e5567e0c72 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:26.899246 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-ec93ed8a-a2bb-4433-b768-6d766ce76b74 req-b8540674-3ec4-4405-bdd9-60e5567e0c72 service nova] Creating event network-vif-plugged:42310a0c-3052-4cd8-b220-3b7a3cb26c88 for instance b777991e-573a-43e3-abcb-ec40283e625d on n-h2-862686-1 Oct 26 13:17:26.904886 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-ec93ed8a-a2bb-4433-b768-6d766ce76b74 req-b8540674-3ec4-4405-bdd9-60e5567e0c72 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032796 Oct 26 13:17:26.905870 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1777/3559] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:17:26.929208 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-cb1b32f6-08f2-4636-ba3a-ab71a444cf71 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:26.937684 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cb1b32f6-08f2-4636-ba3a-ab71a444cf71 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264" status: 200 len: 1507 microversion: 2.1 time: 0.167355 Oct 26 13:17:26.938360 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1783/3560] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:26 2022] GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264 => generated 1507 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:26.940347 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-acb44954-1f38-481e-984c-678fc5676cb2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:26.941126 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-acb44954-1f38-481e-984c-678fc5676cb2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:26.947926 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-acb44954-1f38-481e-984c-678fc5676cb2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:26.948493 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-acb44954-1f38-481e-984c-678fc5676cb2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:26.949006 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-acb44954-1f38-481e-984c-678fc5676cb2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:26.949809 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-acb44954-1f38-481e-984c-678fc5676cb2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:26.950340 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-acb44954-1f38-481e-984c-678fc5676cb2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:26.950840 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-acb44954-1f38-481e-984c-678fc5676cb2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:27.227263 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1bcef76f-e959-445f-ad39-1850beca211c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:27.228834 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1bcef76f-e959-445f-ad39-1850beca211c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 02c38c79-9670-4d6d-bad7-70953e1ff22b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:27.236546 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1bcef76f-e959-445f-ad39-1850beca211c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:27.237266 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1bcef76f-e959-445f-ad39-1850beca211c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:27.237721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1bcef76f-e959-445f-ad39-1850beca211c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:27.238947 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1bcef76f-e959-445f-ad39-1850beca211c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:27.240755 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1bcef76f-e959-445f-ad39-1850beca211c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:27.249579 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1bcef76f-e959-445f-ad39-1850beca211c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:27.320941 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1bcef76f-e959-445f-ad39-1850beca211c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:27.330236 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1bcef76f-e959-445f-ad39-1850beca211c tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/02c38c79-9670-4d6d-bad7-70953e1ff22b" status: 200 len: 1437 microversion: 2.1 time: 0.107492 Oct 26 13:17:27.330815 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1784/3561] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:27 2022] GET /compute/v2.1/servers/02c38c79-9670-4d6d-bad7-70953e1ff22b => generated 1437 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:17:27.335329 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-762b6532-d675-464b-9dee-4468fdab98d6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:27.335924 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-762b6532-d675-464b-9dee-4468fdab98d6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:27.343272 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-762b6532-d675-464b-9dee-4468fdab98d6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:27.343877 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-762b6532-d675-464b-9dee-4468fdab98d6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:27.344311 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-762b6532-d675-464b-9dee-4468fdab98d6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:27.345012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-762b6532-d675-464b-9dee-4468fdab98d6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:27.345462 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-762b6532-d675-464b-9dee-4468fdab98d6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:27.346315 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-762b6532-d675-464b-9dee-4468fdab98d6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:27.347212 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-acb44954-1f38-481e-984c-678fc5676cb2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:27.358842 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-acb44954-1f38-481e-984c-678fc5676cb2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1315 microversion: 2.1 time: 0.422688 Oct 26 13:17:27.359789 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1778/3562] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:26 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:17:27.400736 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-453c55dd-df23-4f6f-9a18-40820ab19eb1 req-9ee719b4-e5c0-4afe-bc02-11ccfeed69d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02c38c79-9670-4d6d-bad7-70953e1ff22b", "name": "network-vif-deleted", "tag": "7b0590e9-6a63-49e0-9f2c-d75d9101c143"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:17:27.423709 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-453c55dd-df23-4f6f-9a18-40820ab19eb1 req-9ee719b4-e5c0-4afe-bc02-11ccfeed69d8 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:27.424208 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-453c55dd-df23-4f6f-9a18-40820ab19eb1 req-9ee719b4-e5c0-4afe-bc02-11ccfeed69d8 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:27.424685 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-453c55dd-df23-4f6f-9a18-40820ab19eb1 req-9ee719b4-e5c0-4afe-bc02-11ccfeed69d8 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:27.451796 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-453c55dd-df23-4f6f-9a18-40820ab19eb1 req-9ee719b4-e5c0-4afe-bc02-11ccfeed69d8 service nova] Creating event network-vif-deleted:7b0590e9-6a63-49e0-9f2c-d75d9101c143 for instance 02c38c79-9670-4d6d-bad7-70953e1ff22b on n-h2-862686-1 Oct 26 13:17:27.463800 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-453c55dd-df23-4f6f-9a18-40820ab19eb1 req-9ee719b4-e5c0-4afe-bc02-11ccfeed69d8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072571 Oct 26 13:17:27.464645 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1779/3563] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:17:27.469979 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-227ae028-5888-4bcb-8415-4efcf88d28ee tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:27.471605 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-227ae028-5888-4bcb-8415-4efcf88d28ee tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 2c859d43-c102-4189-9e7a-6c88ff38f311] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:27.479589 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-227ae028-5888-4bcb-8415-4efcf88d28ee tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:27.480091 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-227ae028-5888-4bcb-8415-4efcf88d28ee tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:27.480583 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-227ae028-5888-4bcb-8415-4efcf88d28ee tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:27.481296 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-227ae028-5888-4bcb-8415-4efcf88d28ee tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:27.481831 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-227ae028-5888-4bcb-8415-4efcf88d28ee tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:27.482271 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-227ae028-5888-4bcb-8415-4efcf88d28ee tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:27.534489 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=14 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:17:27.535533 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-762b6532-d675-464b-9dee-4468fdab98d6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:27.544981 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-762b6532-d675-464b-9dee-4468fdab98d6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1199 microversion: 2.1 time: 0.213000 Oct 26 13:17:27.559323 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1785/3564] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:27 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1199 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:27.602812 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-227ae028-5888-4bcb-8415-4efcf88d28ee tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:27.612363 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-227ae028-5888-4bcb-8415-4efcf88d28ee tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311" status: 200 len: 1616 microversion: 2.1 time: 0.146462 Oct 26 13:17:27.627513 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1780/3565] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:27 2022] GET /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311 => generated 1616 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:27.789099 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ab4abca3-589f-459d-a2a3-db8ec0d9fcbe tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:27.790605 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ab4abca3-589f-459d-a2a3-db8ec0d9fcbe tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:27.798577 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab4abca3-589f-459d-a2a3-db8ec0d9fcbe tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:27.799016 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab4abca3-589f-459d-a2a3-db8ec0d9fcbe tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:27.799553 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab4abca3-589f-459d-a2a3-db8ec0d9fcbe tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:27.800681 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab4abca3-589f-459d-a2a3-db8ec0d9fcbe tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:27.800917 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab4abca3-589f-459d-a2a3-db8ec0d9fcbe tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:27.801730 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab4abca3-589f-459d-a2a3-db8ec0d9fcbe tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:27.832433 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f5902583-31dd-418b-97e2-f60d3cf59b0d tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:27.833408 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f5902583-31dd-418b-97e2-f60d3cf59b0d tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] [instance: b777991e-573a-43e3-abcb-ec40283e625d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:27.841775 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f5902583-31dd-418b-97e2-f60d3cf59b0d tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:27.842553 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f5902583-31dd-418b-97e2-f60d3cf59b0d tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:27.843233 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f5902583-31dd-418b-97e2-f60d3cf59b0d tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:27.844168 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f5902583-31dd-418b-97e2-f60d3cf59b0d tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:27.844796 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f5902583-31dd-418b-97e2-f60d3cf59b0d tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:27.845423 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f5902583-31dd-418b-97e2-f60d3cf59b0d tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:28.099980 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ab4abca3-589f-459d-a2a3-db8ec0d9fcbe tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:28.102665 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:17:28.117413 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f5902583-31dd-418b-97e2-f60d3cf59b0d tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53010c15247443b29ce39f037e22ca24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c0302538ba431684624b8d41dfc2f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:28.123257 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ab4abca3-589f-459d-a2a3-db8ec0d9fcbe tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:28.125955 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ab4abca3-589f-459d-a2a3-db8ec0d9fcbe tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:28.126176 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f5902583-31dd-418b-97e2-f60d3cf59b0d tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] 10.222.0.40 "GET /compute/v2.1/servers/b777991e-573a-43e3-abcb-ec40283e625d" status: 200 len: 1316 microversion: 2.1 time: 0.298108 Oct 26 13:17:28.126733 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1781/3566] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:27 2022] GET /compute/v2.1/servers/b777991e-573a-43e3-abcb-ec40283e625d => generated 1316 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:28.128907 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ab4abca3-589f-459d-a2a3-db8ec0d9fcbe tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1873 microversion: 2.32 time: 0.344534 Oct 26 13:17:28.129854 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1786/3567] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:17:27 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1873 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:17:28.131800 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4cbcd12f-0d65-416c-823c-fe767f9aa670 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:28.132413 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4cbcd12f-0d65-416c-823c-fe767f9aa670 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: b29a1a98-a428-4967-bc4a-237971dcd264] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:28.138984 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4cbcd12f-0d65-416c-823c-fe767f9aa670 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:28.139477 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4cbcd12f-0d65-416c-823c-fe767f9aa670 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:28.139918 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4cbcd12f-0d65-416c-823c-fe767f9aa670 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:28.140621 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4cbcd12f-0d65-416c-823c-fe767f9aa670 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:28.141079 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4cbcd12f-0d65-416c-823c-fe767f9aa670 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:28.141577 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4cbcd12f-0d65-416c-823c-fe767f9aa670 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:28.289619 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4cbcd12f-0d65-416c-823c-fe767f9aa670 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:28.300163 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4cbcd12f-0d65-416c-823c-fe767f9aa670 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264" status: 200 len: 1507 microversion: 2.1 time: 0.171971 Oct 26 13:17:28.300754 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1782/3568] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:28 2022] GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264 => generated 1507 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:28.354169 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-61774005-5fef-4910-8fca-4867f1915c04 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:28.354960 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-61774005-5fef-4910-8fca-4867f1915c04 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 02c38c79-9670-4d6d-bad7-70953e1ff22b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:28.363579 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-61774005-5fef-4910-8fca-4867f1915c04 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:28.364192 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-61774005-5fef-4910-8fca-4867f1915c04 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:28.364637 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-61774005-5fef-4910-8fca-4867f1915c04 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:28.365339 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-61774005-5fef-4910-8fca-4867f1915c04 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:28.365825 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-61774005-5fef-4910-8fca-4867f1915c04 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:28.366252 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-61774005-5fef-4910-8fca-4867f1915c04 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:28.382295 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-43e8297c-fb91-4c22-88a2-1852bb537f3d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:28.384035 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-43e8297c-fb91-4c22-88a2-1852bb537f3d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:28.391096 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-43e8297c-fb91-4c22-88a2-1852bb537f3d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:28.391808 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-43e8297c-fb91-4c22-88a2-1852bb537f3d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:28.392568 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-43e8297c-fb91-4c22-88a2-1852bb537f3d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:28.394489 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-43e8297c-fb91-4c22-88a2-1852bb537f3d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:28.395381 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-43e8297c-fb91-4c22-88a2-1852bb537f3d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:28.396095 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-43e8297c-fb91-4c22-88a2-1852bb537f3d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:28.403731 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-61774005-5fef-4910-8fca-4867f1915c04 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:28.404240 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-61774005-5fef-4910-8fca-4867f1915c04 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:28.404904 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-61774005-5fef-4910-8fca-4867f1915c04 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:28.405382 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-61774005-5fef-4910-8fca-4867f1915c04 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lazy-loading 'fault' on Instance uuid 02c38c79-9670-4d6d-bad7-70953e1ff22b {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:17:28.458882 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-61774005-5fef-4910-8fca-4867f1915c04 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe30a73a18d49afa07f7a66aee7805d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f690a680b284d82ac586346427423c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:28.467870 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-61774005-5fef-4910-8fca-4867f1915c04 tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/02c38c79-9670-4d6d-bad7-70953e1ff22b" status: 200 len: 1283 microversion: 2.1 time: 0.118058 Oct 26 13:17:28.468495 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1787/3569] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:28 2022] GET /compute/v2.1/servers/02c38c79-9670-4d6d-bad7-70953e1ff22b => generated 1283 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:28.551985 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-43e8297c-fb91-4c22-88a2-1852bb537f3d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:28.560209 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-43e8297c-fb91-4c22-88a2-1852bb537f3d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1315 microversion: 2.1 time: 0.182277 Oct 26 13:17:28.560783 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1783/3570] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:28 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:17:28.572260 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9730a3c0-5f16-4d3a-9519-7da2bb32bb4f tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:28.573155 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9730a3c0-5f16-4d3a-9519-7da2bb32bb4f tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:28.579315 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9730a3c0-5f16-4d3a-9519-7da2bb32bb4f tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:28.579792 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9730a3c0-5f16-4d3a-9519-7da2bb32bb4f tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:28.580222 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9730a3c0-5f16-4d3a-9519-7da2bb32bb4f tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:28.580911 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9730a3c0-5f16-4d3a-9519-7da2bb32bb4f tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:28.581357 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9730a3c0-5f16-4d3a-9519-7da2bb32bb4f tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:28.582012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9730a3c0-5f16-4d3a-9519-7da2bb32bb4f tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:28.640355 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ed11984e-46ff-4a54-b0cb-ed64d557d874 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:28.640972 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ed11984e-46ff-4a54-b0cb-ed64d557d874 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 2c859d43-c102-4189-9e7a-6c88ff38f311] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:28.648603 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed11984e-46ff-4a54-b0cb-ed64d557d874 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:28.648603 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed11984e-46ff-4a54-b0cb-ed64d557d874 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:28.648918 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed11984e-46ff-4a54-b0cb-ed64d557d874 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:28.649518 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed11984e-46ff-4a54-b0cb-ed64d557d874 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:28.651374 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed11984e-46ff-4a54-b0cb-ed64d557d874 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:28.651374 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed11984e-46ff-4a54-b0cb-ed64d557d874 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:28.684041 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed11984e-46ff-4a54-b0cb-ed64d557d874 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:28.684535 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed11984e-46ff-4a54-b0cb-ed64d557d874 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:28.684971 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed11984e-46ff-4a54-b0cb-ed64d557d874 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:28.685426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-ed11984e-46ff-4a54-b0cb-ed64d557d874 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lazy-loading 'fault' on Instance uuid 2c859d43-c102-4189-9e7a-6c88ff38f311 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:17:28.725575 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9730a3c0-5f16-4d3a-9519-7da2bb32bb4f tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:28.728565 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ed11984e-46ff-4a54-b0cb-ed64d557d874 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:28.734720 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9730a3c0-5f16-4d3a-9519-7da2bb32bb4f tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1381 microversion: 2.1 time: 0.166949 Oct 26 13:17:28.735894 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1788/3571] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:28 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1381 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:17:28.737145 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ed11984e-46ff-4a54-b0cb-ed64d557d874 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311" status: 200 len: 1332 microversion: 2.1 time: 0.101690 Oct 26 13:17:28.748540 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1784/3572] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:28 2022] GET /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311 => generated 1332 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:17:28.882832 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5442c480-d9e3-420a-b678-459c39ad7a49 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:28.883460 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5442c480-d9e3-420a-b678-459c39ad7a49 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:28.890160 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5442c480-d9e3-420a-b678-459c39ad7a49 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:28.890656 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5442c480-d9e3-420a-b678-459c39ad7a49 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:28.891100 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5442c480-d9e3-420a-b678-459c39ad7a49 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:28.891814 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5442c480-d9e3-420a-b678-459c39ad7a49 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:28.892274 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5442c480-d9e3-420a-b678-459c39ad7a49 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:28.892701 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5442c480-d9e3-420a-b678-459c39ad7a49 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:28.920773 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-f1bc8938-b077-472f-bac9-e0a14d673faa req-08a30906-9c37-4bde-a095-f69b3804bf83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59bb4f3c-d633-42db-b86b-274fa8b95f44", "name": "network-vif-plugged", "status": "completed", "tag": "1484b291-b3a0-410d-a1af-3a79c7d02eba"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:17:28.935894 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-f1bc8938-b077-472f-bac9-e0a14d673faa req-08a30906-9c37-4bde-a095-f69b3804bf83 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:28.936810 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-f1bc8938-b077-472f-bac9-e0a14d673faa req-08a30906-9c37-4bde-a095-f69b3804bf83 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:28.937373 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-f1bc8938-b077-472f-bac9-e0a14d673faa req-08a30906-9c37-4bde-a095-f69b3804bf83 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:28.950592 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-f1bc8938-b077-472f-bac9-e0a14d673faa req-08a30906-9c37-4bde-a095-f69b3804bf83 service nova] Creating event network-vif-plugged:1484b291-b3a0-410d-a1af-3a79c7d02eba for instance 59bb4f3c-d633-42db-b86b-274fa8b95f44 on n-h1-862686-1 Oct 26 13:17:28.956847 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-f1bc8938-b077-472f-bac9-e0a14d673faa req-08a30906-9c37-4bde-a095-f69b3804bf83 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038849 Oct 26 13:17:28.957464 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1785/3573] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:17:29.046808 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5442c480-d9e3-420a-b678-459c39ad7a49 tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1532 microversion: 2.1 time: 0.292809 Oct 26 13:17:29.057942 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1789/3574] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:28 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1532 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:29.072855 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-018480a4-05d9-4b46-ae5b-e48d79b5eaad tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:29.074570 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-018480a4-05d9-4b46-ae5b-e48d79b5eaad tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:29.082540 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-018480a4-05d9-4b46-ae5b-e48d79b5eaad tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:29.083210 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-018480a4-05d9-4b46-ae5b-e48d79b5eaad tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:29.083807 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-018480a4-05d9-4b46-ae5b-e48d79b5eaad tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:29.085006 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-018480a4-05d9-4b46-ae5b-e48d79b5eaad tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:29.085717 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-018480a4-05d9-4b46-ae5b-e48d79b5eaad tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:29.086383 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-018480a4-05d9-4b46-ae5b-e48d79b5eaad tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:29.166803 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f6c0c86a-66b4-4342-9360-96a3d6663174 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:29.167641 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f6c0c86a-66b4-4342-9360-96a3d6663174 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] [instance: b777991e-573a-43e3-abcb-ec40283e625d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:29.185686 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6c0c86a-66b4-4342-9360-96a3d6663174 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:29.186205 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6c0c86a-66b4-4342-9360-96a3d6663174 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:29.186620 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6c0c86a-66b4-4342-9360-96a3d6663174 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:29.187328 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6c0c86a-66b4-4342-9360-96a3d6663174 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:29.187780 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6c0c86a-66b4-4342-9360-96a3d6663174 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:29.188209 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6c0c86a-66b4-4342-9360-96a3d6663174 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:29.287578 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-018480a4-05d9-4b46-ae5b-e48d79b5eaad tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1532 microversion: 2.1 time: 0.220311 Oct 26 13:17:29.288160 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1786/3575] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:29 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1532 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:29.298273 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-759fa7d6-69c7-470a-92c6-08da16bce673 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:29.298883 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-759fa7d6-69c7-470a-92c6-08da16bce673 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:29.309641 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-759fa7d6-69c7-470a-92c6-08da16bce673 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:29.310138 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-759fa7d6-69c7-470a-92c6-08da16bce673 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:29.310580 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-759fa7d6-69c7-470a-92c6-08da16bce673 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:29.311285 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-759fa7d6-69c7-470a-92c6-08da16bce673 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:29.311839 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-759fa7d6-69c7-470a-92c6-08da16bce673 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:29.312164 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-759fa7d6-69c7-470a-92c6-08da16bce673 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:29.367799 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f6c0c86a-66b4-4342-9360-96a3d6663174 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53010c15247443b29ce39f037e22ca24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c0302538ba431684624b8d41dfc2f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:29.376490 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f6c0c86a-66b4-4342-9360-96a3d6663174 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] 10.222.0.40 "GET /compute/v2.1/servers/b777991e-573a-43e3-abcb-ec40283e625d" status: 200 len: 1505 microversion: 2.1 time: 0.222748 Oct 26 13:17:29.377077 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1790/3576] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:29 2022] GET /compute/v2.1/servers/b777991e-573a-43e3-abcb-ec40283e625d => generated 1505 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:17:29.386503 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e6844b09-4b69-4385-9faf-6dd9b957fa4c tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:29.390455 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6844b09-4b69-4385-9faf-6dd9b957fa4c tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:29.390994 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6844b09-4b69-4385-9faf-6dd9b957fa4c tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:29.391439 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6844b09-4b69-4385-9faf-6dd9b957fa4c tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:29.392166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6844b09-4b69-4385-9faf-6dd9b957fa4c tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:29.392891 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6844b09-4b69-4385-9faf-6dd9b957fa4c tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:29.393092 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6844b09-4b69-4385-9faf-6dd9b957fa4c tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:29.418065 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e6844b09-4b69-4385-9faf-6dd9b957fa4c tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.035552 Oct 26 13:17:29.418678 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1791/3577] 10.222.0.40 () {58 vars in 1176 bytes} [Wed Oct 26 13:17:29 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:17:29.423198 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-91a810c0-3be8-4897-801b-87d4537d65dd tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:29.423814 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-91a810c0-3be8-4897-801b-87d4537d65dd tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: b29a1a98-a428-4967-bc4a-237971dcd264] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:29.429850 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91a810c0-3be8-4897-801b-87d4537d65dd tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:29.430333 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91a810c0-3be8-4897-801b-87d4537d65dd tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:29.431325 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91a810c0-3be8-4897-801b-87d4537d65dd tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:29.432254 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91a810c0-3be8-4897-801b-87d4537d65dd tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:29.432716 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91a810c0-3be8-4897-801b-87d4537d65dd tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:29.433142 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91a810c0-3be8-4897-801b-87d4537d65dd tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:29.515019 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-759fa7d6-69c7-470a-92c6-08da16bce673 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:29.525249 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-759fa7d6-69c7-470a-92c6-08da16bce673 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:29.526935 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-759fa7d6-69c7-470a-92c6-08da16bce673 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:29.528258 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-759fa7d6-69c7-470a-92c6-08da16bce673 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1873 microversion: 2.32 time: 0.239148 Oct 26 13:17:29.528970 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1787/3578] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:17:29 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1873 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:17:29.533879 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-24bd27f6-97b5-42c6-a1b1-59032c7541b3 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:29.534510 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-24bd27f6-97b5-42c6-a1b1-59032c7541b3 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] [instance: b777991e-573a-43e3-abcb-ec40283e625d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:29.541738 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-24bd27f6-97b5-42c6-a1b1-59032c7541b3 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:29.542502 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-24bd27f6-97b5-42c6-a1b1-59032c7541b3 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:29.543143 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-24bd27f6-97b5-42c6-a1b1-59032c7541b3 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:29.544573 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-24bd27f6-97b5-42c6-a1b1-59032c7541b3 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:29.545462 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-24bd27f6-97b5-42c6-a1b1-59032c7541b3 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:29.546725 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-24bd27f6-97b5-42c6-a1b1-59032c7541b3 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:29.573902 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-91a810c0-3be8-4897-801b-87d4537d65dd tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:29.581259 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-24bd27f6-97b5-42c6-a1b1-59032c7541b3 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '53010c15247443b29ce39f037e22ca24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c0302538ba431684624b8d41dfc2f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:29.582458 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-24bd27f6-97b5-42c6-a1b1-59032c7541b3 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] 10.222.0.40 "GET /compute/v2.1/servers/b777991e-573a-43e3-abcb-ec40283e625d/os-instance-actions/req-57d69bf5-903a-440a-baaf-add42801ffa3" status: 200 len: 313 microversion: 2.1 time: 0.052436 Oct 26 13:17:29.583066 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1788/3579] 10.222.0.40 () {58 vars in 1419 bytes} [Wed Oct 26 13:17:29 2022] GET /compute/v2.1/servers/b777991e-573a-43e3-abcb-ec40283e625d/os-instance-actions/req-57d69bf5-903a-440a-baaf-add42801ffa3 => generated 313 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:17:29.584206 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-91a810c0-3be8-4897-801b-87d4537d65dd tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264" status: 200 len: 1507 microversion: 2.1 time: 0.164500 Oct 26 13:17:29.584792 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1792/3580] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:29 2022] GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264 => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:29.588488 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-41e609bb-f20c-41cb-b741-b38b69a7e50f tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-862686-1", "block_migration": false, "disk_over_commit": false}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:17:29.590901 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-e83a2346-68e9-4099-ac63-d123b428ce8e req-6abb5f6e-7395-4b59-811b-af3fa9bdf81c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c859d43-c102-4189-9e7a-6c88ff38f311", "name": "network-vif-deleted", "tag": "7b29700f-b95c-4338-847f-0573694835c8"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:17:29.593230 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-41e609bb-f20c-41cb-b741-b38b69a7e50f tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:29.599652 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41e609bb-f20c-41cb-b741-b38b69a7e50f tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:29.600515 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41e609bb-f20c-41cb-b741-b38b69a7e50f tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:29.601212 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41e609bb-f20c-41cb-b741-b38b69a7e50f tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:29.602284 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41e609bb-f20c-41cb-b741-b38b69a7e50f tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:29.603383 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41e609bb-f20c-41cb-b741-b38b69a7e50f tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:29.603990 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41e609bb-f20c-41cb-b741-b38b69a7e50f tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:29.604280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e83a2346-68e9-4099-ac63-d123b428ce8e req-6abb5f6e-7395-4b59-811b-af3fa9bdf81c service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:29.605036 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e83a2346-68e9-4099-ac63-d123b428ce8e req-6abb5f6e-7395-4b59-811b-af3fa9bdf81c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:29.605523 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e83a2346-68e9-4099-ac63-d123b428ce8e req-6abb5f6e-7395-4b59-811b-af3fa9bdf81c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:29.617376 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-e83a2346-68e9-4099-ac63-d123b428ce8e req-6abb5f6e-7395-4b59-811b-af3fa9bdf81c service nova] Creating event network-vif-deleted:7b29700f-b95c-4338-847f-0573694835c8 for instance 2c859d43-c102-4189-9e7a-6c88ff38f311 on n-h2-862686-1 Oct 26 13:17:29.623084 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-e83a2346-68e9-4099-ac63-d123b428ce8e req-6abb5f6e-7395-4b59-811b-af3fa9bdf81c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037170 Oct 26 13:17:29.623693 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1793/3581] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:17:29.631673 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4d0cc582-2c86-4333-9a9b-0c861c4bbe5f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:29.632381 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4d0cc582-2c86-4333-9a9b-0c861c4bbe5f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] [instance: 02c38c79-9670-4d6d-bad7-70953e1ff22b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:29.633547 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-41e609bb-f20c-41cb-b741-b38b69a7e50f tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lazy-loading 'flavor' on Instance uuid b7743d90-f9dc-4601-a6d3-a4901bf9cc05 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:17:29.634536 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:17:29.640798 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d0cc582-2c86-4333-9a9b-0c861c4bbe5f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:29.641293 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d0cc582-2c86-4333-9a9b-0c861c4bbe5f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:29.641757 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d0cc582-2c86-4333-9a9b-0c861c4bbe5f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:29.642645 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d0cc582-2c86-4333-9a9b-0c861c4bbe5f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:29.643280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d0cc582-2c86-4333-9a9b-0c861c4bbe5f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:29.643712 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d0cc582-2c86-4333-9a9b-0c861c4bbe5f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:29.648074 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-41e609bb-f20c-41cb-b741-b38b69a7e50f tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Going to try to live migrate instance to n-h1-862686-1 {{(pid=120597) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 26 13:17:29.659068 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-4d0cc582-2c86-4333-9a9b-0c861c4bbe5f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] HTTP exception thrown: Instance 02c38c79-9670-4d6d-bad7-70953e1ff22b could not be found. Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4d0cc582-2c86-4333-9a9b-0c861c4bbe5f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Request method failure captured: Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/02c38c79-9670-4d6d-bad7-70953e1ff22b HTTP/1.1 Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTJbgpOJ6_WXapLDSc4DXB2ybbuKvfF9irakf13MnXe_PUvQw0tvwC_KXpEDb02nWk9gKVB2DnChPFFUGp_xOUQaSFHL5E80bTALTu8ZJijTkAv_z2Y1Gdi1cyNAMKmLE7ZnzWq0oDflWXhf1sSJNtguU-rMZFkiGbBps0dj1yOxZiU Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 3f690a680b284d82ac586346427423c3 Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersTestJSON-1612525130 Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3f690a680b284d82ac586346427423c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f690a680b284d82ac586346427423c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3f690a680b284d82ac586346427423c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f690a680b284d82ac586346427423c3"}]}] Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersTestJSON-1612525130 Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 3f690a680b284d82ac586346427423c3 Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersTestJSON-1612525130 Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersTestJSON-1612525130-project Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: fbe30a73a18d49afa07f7a66aee7805d Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersTestJSON-1612525130-project Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 02c38c79-9670-4d6d-bad7-70953e1ff22b could not be found. Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '02c38c79-9670-4d6d-bad7-70953e1ff22b'} Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02c38c79-9670-4d6d-bad7-70953e1ff22b could not be found. Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02c38c79-9670-4d6d-bad7-70953e1ff22b could not be found. Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:17:29.660807 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:17:29.665697 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:29.665697 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:17:29.665697 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:17:29.665697 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:17:29.665697 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:17:29.665697 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02c38c79-9670-4d6d-bad7-70953e1ff22b could not be found. Oct 26 13:17:29.665697 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:17:29.665697 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4d0cc582-2c86-4333-9a9b-0c861c4bbe5f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] Returning 404 to user: Instance 02c38c79-9670-4d6d-bad7-70953e1ff22b could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:17:29.665697 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4d0cc582-2c86-4333-9a9b-0c861c4bbe5f tempest-ServersTestJSON-1612525130 tempest-ServersTestJSON-1612525130-project] 10.222.0.40 "GET /compute/v2.1/servers/02c38c79-9670-4d6d-bad7-70953e1ff22b" status: 404 len: 111 microversion: 2.1 time: 0.034646 Oct 26 13:17:29.665697 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1794/3582] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:29 2022] GET /compute/v2.1/servers/02c38c79-9670-4d6d-bad7-70953e1ff22b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:17:29.671611 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f39e7ced-287f-46cc-b030-0181f030623f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:29.672642 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f39e7ced-287f-46cc-b030-0181f030623f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:29.680907 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f39e7ced-287f-46cc-b030-0181f030623f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:29.681830 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f39e7ced-287f-46cc-b030-0181f030623f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:29.682587 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f39e7ced-287f-46cc-b030-0181f030623f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:29.683476 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f39e7ced-287f-46cc-b030-0181f030623f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:29.683945 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f39e7ced-287f-46cc-b030-0181f030623f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:29.684424 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f39e7ced-287f-46cc-b030-0181f030623f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:29.856589 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f39e7ced-287f-46cc-b030-0181f030623f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:29.865212 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f39e7ced-287f-46cc-b030-0181f030623f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1315 microversion: 2.1 time: 0.201385 Oct 26 13:17:29.869626 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1795/3583] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:29 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:29.874508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1697cbfa-3ed6-4a04-a6bd-23371965cca8 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:17:29.876770 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1697cbfa-3ed6-4a04-a6bd-23371965cca8 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] [instance: b777991e-573a-43e3-abcb-ec40283e625d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:29.883439 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1697cbfa-3ed6-4a04-a6bd-23371965cca8 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:29.885352 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1697cbfa-3ed6-4a04-a6bd-23371965cca8 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:29.886011 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1697cbfa-3ed6-4a04-a6bd-23371965cca8 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:29.887445 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1697cbfa-3ed6-4a04-a6bd-23371965cca8 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:29.887906 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1697cbfa-3ed6-4a04-a6bd-23371965cca8 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:29.888492 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1697cbfa-3ed6-4a04-a6bd-23371965cca8 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:29.986250 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1697cbfa-3ed6-4a04-a6bd-23371965cca8 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] 10.222.0.40 "POST /compute/v2.1/servers/b777991e-573a-43e3-abcb-ec40283e625d/action" status: 202 len: 0 microversion: 2.1 time: 0.118515 Oct 26 13:17:29.994185 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1796/3584] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:17:29 2022] POST /compute/v2.1/servers/b777991e-573a-43e3-abcb-ec40283e625d/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:17:30.005780 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9baa3c57-1d5c-4f32-a55f-d0123542bd9f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:30.007797 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9baa3c57-1d5c-4f32-a55f-d0123542bd9f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 2c859d43-c102-4189-9e7a-6c88ff38f311] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:30.018732 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9baa3c57-1d5c-4f32-a55f-d0123542bd9f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:30.019139 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9baa3c57-1d5c-4f32-a55f-d0123542bd9f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:30.019573 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9baa3c57-1d5c-4f32-a55f-d0123542bd9f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:30.022198 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9baa3c57-1d5c-4f32-a55f-d0123542bd9f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:30.024887 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9baa3c57-1d5c-4f32-a55f-d0123542bd9f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:30.026074 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9baa3c57-1d5c-4f32-a55f-d0123542bd9f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:30.057284 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-9baa3c57-1d5c-4f32-a55f-d0123542bd9f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] HTTP exception thrown: Instance 2c859d43-c102-4189-9e7a-6c88ff38f311 could not be found. Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9baa3c57-1d5c-4f32-a55f-d0123542bd9f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Request method failure captured: Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311 HTTP/1.1 Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTK8yiFaYn6FsK4kYH1E6E6NSE9_hIaDskjf1tRy-XgeLhCgjcaBIDqmW8VSjfB2Cmb6DMkQzh-y_Wh40jTHlXsuv7XA0N3K6RDEzKD5nf9Z6iWWIgYAqlJtxWSsEOqwe1NAtEPEvPHN4gJ5RH5unfT6e5xSWJOJigX6JmjW0X-SjQA Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 174da5e5c60449b7a04e9cf2aa3b9fda Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-AttachVolumeNegativeTest-770748596 Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/174da5e5c60449b7a04e9cf2aa3b9fda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/174da5e5c60449b7a04e9cf2aa3b9fda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_174da5e5c60449b7a04e9cf2aa3b9fda"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/174da5e5c60449b7a04e9cf2aa3b9fda"}]}] Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-AttachVolumeNegativeTest-770748596 Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 174da5e5c60449b7a04e9cf2aa3b9fda Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-770748596 Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-AttachVolumeNegativeTest-770748596-project Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 168c83cd1b014f82945f4915e3ece079 Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-AttachVolumeNegativeTest-770748596-project Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 2c859d43-c102-4189-9e7a-6c88ff38f311 could not be found. Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '2c859d43-c102-4189-9e7a-6c88ff38f311'} Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c859d43-c102-4189-9e7a-6c88ff38f311 could not be found. Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c859d43-c102-4189-9e7a-6c88ff38f311 could not be found. Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:17:30.059231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:17:30.063625 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:30.063625 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:17:30.063625 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:17:30.063625 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:17:30.063625 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:17:30.063625 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c859d43-c102-4189-9e7a-6c88ff38f311 could not be found. Oct 26 13:17:30.063625 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:17:30.063625 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9baa3c57-1d5c-4f32-a55f-d0123542bd9f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Returning 404 to user: Instance 2c859d43-c102-4189-9e7a-6c88ff38f311 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:17:30.063625 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9baa3c57-1d5c-4f32-a55f-d0123542bd9f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311" status: 404 len: 111 microversion: 2.1 time: 0.064360 Oct 26 13:17:30.065597 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1797/3585] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:29 2022] GET /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:17:30.070865 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-add7e91d-aac5-4bb1-add7-0dd6f915ced3 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:30.072677 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-add7e91d-aac5-4bb1-add7-0dd6f915ced3 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] [instance: b777991e-573a-43e3-abcb-ec40283e625d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:30.080650 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-add7e91d-aac5-4bb1-add7-0dd6f915ced3 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:30.081381 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-add7e91d-aac5-4bb1-add7-0dd6f915ced3 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:30.081915 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-add7e91d-aac5-4bb1-add7-0dd6f915ced3 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:30.082720 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-add7e91d-aac5-4bb1-add7-0dd6f915ced3 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:30.083181 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-add7e91d-aac5-4bb1-add7-0dd6f915ced3 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:30.083605 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-add7e91d-aac5-4bb1-add7-0dd6f915ced3 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:30.244432 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-add7e91d-aac5-4bb1-add7-0dd6f915ced3 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53010c15247443b29ce39f037e22ca24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c0302538ba431684624b8d41dfc2f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:30.252702 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-add7e91d-aac5-4bb1-add7-0dd6f915ced3 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] 10.222.0.40 "GET /compute/v2.1/servers/b777991e-573a-43e3-abcb-ec40283e625d" status: 200 len: 1507 microversion: 2.1 time: 0.186100 Oct 26 13:17:30.253977 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1798/3586] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:30 2022] GET /compute/v2.1/servers/b777991e-573a-43e3-abcb-ec40283e625d => generated 1507 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:30.260069 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e3751b35-afc1-448b-a9a6-c96e9624787f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '.version_select at 0x7f6731f575e0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:30.281997 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e3751b35-afc1-448b-a9a6-c96e9624787f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1420444742" status: 202 len: 0 microversion: 2.1 time: 0.026275 Oct 26 13:17:30.283205 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1799/3587] 10.222.0.40 () {58 vars in 1221 bytes} [Wed Oct 26 13:17:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1420444742 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:17:30.556800 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-11c192e9-d3dc-4822-abfe-9f68dbee609d tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:30.557626 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-11c192e9-d3dc-4822-abfe-9f68dbee609d tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:30.574536 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11c192e9-d3dc-4822-abfe-9f68dbee609d tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:30.576088 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11c192e9-d3dc-4822-abfe-9f68dbee609d tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:30.577470 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11c192e9-d3dc-4822-abfe-9f68dbee609d tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:30.579070 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11c192e9-d3dc-4822-abfe-9f68dbee609d tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:30.580772 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11c192e9-d3dc-4822-abfe-9f68dbee609d tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:30.581413 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11c192e9-d3dc-4822-abfe-9f68dbee609d tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:31.246092 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-11c192e9-d3dc-4822-abfe-9f68dbee609d tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:31.272240 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-11c192e9-d3dc-4822-abfe-9f68dbee609d tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:31.275383 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-11c192e9-d3dc-4822-abfe-9f68dbee609d tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:31.277326 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-11c192e9-d3dc-4822-abfe-9f68dbee609d tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1873 microversion: 2.32 time: 0.726460 Oct 26 13:17:31.278569 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1800/3588] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:17:30 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1873 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:17:31.283883 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4e1943e7-965b-4cf5-9af2-3705ffd7770a tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:31.284829 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4e1943e7-965b-4cf5-9af2-3705ffd7770a tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: b29a1a98-a428-4967-bc4a-237971dcd264] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:31.295451 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e1943e7-965b-4cf5-9af2-3705ffd7770a tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:31.296124 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e1943e7-965b-4cf5-9af2-3705ffd7770a tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:31.296823 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e1943e7-965b-4cf5-9af2-3705ffd7770a tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:31.297737 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e1943e7-965b-4cf5-9af2-3705ffd7770a tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:31.298388 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e1943e7-965b-4cf5-9af2-3705ffd7770a tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:31.299096 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e1943e7-965b-4cf5-9af2-3705ffd7770a tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:31.640001 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4e1943e7-965b-4cf5-9af2-3705ffd7770a tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:31.661780 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4e1943e7-965b-4cf5-9af2-3705ffd7770a tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264" status: 200 len: 1507 microversion: 2.1 time: 0.379594 Oct 26 13:17:31.669192 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1801/3589] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:31 2022] GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264 => generated 1507 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:31.694874 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2900bcd5-867f-41b0-913f-cdd94a90da5f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:31.695729 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2900bcd5-867f-41b0-913f-cdd94a90da5f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:31.703594 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2900bcd5-867f-41b0-913f-cdd94a90da5f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:31.704500 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2900bcd5-867f-41b0-913f-cdd94a90da5f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:31.705256 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2900bcd5-867f-41b0-913f-cdd94a90da5f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:31.706192 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2900bcd5-867f-41b0-913f-cdd94a90da5f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:31.706867 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2900bcd5-867f-41b0-913f-cdd94a90da5f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:31.707474 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2900bcd5-867f-41b0-913f-cdd94a90da5f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:31.967715 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2900bcd5-867f-41b0-913f-cdd94a90da5f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:31.977252 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2900bcd5-867f-41b0-913f-cdd94a90da5f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1503 microversion: 2.1 time: 0.298841 Oct 26 13:17:31.978921 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1802/3590] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:31 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1503 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:31.984160 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-da083e41-9b57-4223-ab39-95646b644de0 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:31.988396 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-da083e41-9b57-4223-ab39-95646b644de0 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] [instance: b777991e-573a-43e3-abcb-ec40283e625d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:32.007914 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da083e41-9b57-4223-ab39-95646b644de0 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:32.012167 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da083e41-9b57-4223-ab39-95646b644de0 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:32.012917 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da083e41-9b57-4223-ab39-95646b644de0 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:32.013920 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da083e41-9b57-4223-ab39-95646b644de0 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:32.015854 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da083e41-9b57-4223-ab39-95646b644de0 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:32.017297 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da083e41-9b57-4223-ab39-95646b644de0 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:32.239280 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-41e609bb-f20c-41cb-b741-b38b69a7e50f tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05/action" status: 202 len: 0 microversion: 2.1 time: 2.654620 Oct 26 13:17:32.239900 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1789/3591] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:17:29 2022] POST /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05/action => generated 0 bytes in 2656 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:17:32.247542 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-da083e41-9b57-4223-ab39-95646b644de0 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53010c15247443b29ce39f037e22ca24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c0302538ba431684624b8d41dfc2f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:32.252092 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-55a6a31e-4824-460a-80e4-340d76c8a67a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:32.254051 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-55a6a31e-4824-460a-80e4-340d76c8a67a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 789a55e0-21ba-4b2e-b8d4-c95999955e2b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:32.258035 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-da083e41-9b57-4223-ab39-95646b644de0 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] 10.222.0.40 "GET /compute/v2.1/servers/b777991e-573a-43e3-abcb-ec40283e625d" status: 200 len: 1505 microversion: 2.1 time: 0.277645 Oct 26 13:17:32.265391 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-55a6a31e-4824-460a-80e4-340d76c8a67a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:32.266448 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-55a6a31e-4824-460a-80e4-340d76c8a67a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:32.267072 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-55a6a31e-4824-460a-80e4-340d76c8a67a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:32.268989 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-55a6a31e-4824-460a-80e4-340d76c8a67a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:32.269749 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-55a6a31e-4824-460a-80e4-340d76c8a67a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:32.270444 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-55a6a31e-4824-460a-80e4-340d76c8a67a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:32.271470 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1803/3592] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:31 2022] GET /compute/v2.1/servers/b777991e-573a-43e3-abcb-ec40283e625d => generated 1505 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:32.299543 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-64d53de8-a974-4e53-9b3c-99022b2d2d1c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:17:32.302125 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-64d53de8-a974-4e53-9b3c-99022b2d2d1c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:32.322639 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64d53de8-a974-4e53-9b3c-99022b2d2d1c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:32.323163 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64d53de8-a974-4e53-9b3c-99022b2d2d1c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:32.323611 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64d53de8-a974-4e53-9b3c-99022b2d2d1c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:32.324326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64d53de8-a974-4e53-9b3c-99022b2d2d1c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:32.324782 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64d53de8-a974-4e53-9b3c-99022b2d2d1c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:32.325208 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64d53de8-a974-4e53-9b3c-99022b2d2d1c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:32.357338 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:17:32.375024 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-64d53de8-a974-4e53-9b3c-99022b2d2d1c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lazy-loading 'flavor' on Instance uuid 59bb4f3c-d633-42db-b86b-274fa8b95f44 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:17:32.482668 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-55a6a31e-4824-460a-80e4-340d76c8a67a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lazy-loading 'services' on Instance uuid 789a55e0-21ba-4b2e-b8d4-c95999955e2b {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:17:32.594320 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:17:32.724763 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-55a6a31e-4824-460a-80e4-340d76c8a67a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "DELETE /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b/os-volume_attachments/b1852432-c514-4ea8-b96a-e4d142fe3d24" status: 202 len: 0 microversion: 2.1 time: 0.482947 Oct 26 13:17:32.747705 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1790/3593] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Oct 26 13:17:32 2022] DELETE /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b/os-volume_attachments/b1852432-c514-4ea8-b96a-e4d142fe3d24 => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:17:32.764531 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9c9e7884-5c4d-46a6-a4ae-a94e52ef778a tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:32.768252 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9c9e7884-5c4d-46a6-a4ae-a94e52ef778a tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:32.793800 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c9e7884-5c4d-46a6-a4ae-a94e52ef778a tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:32.794298 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c9e7884-5c4d-46a6-a4ae-a94e52ef778a tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:32.794742 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c9e7884-5c4d-46a6-a4ae-a94e52ef778a tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:32.795462 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c9e7884-5c4d-46a6-a4ae-a94e52ef778a tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:32.795920 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c9e7884-5c4d-46a6-a4ae-a94e52ef778a tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:32.796348 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c9e7884-5c4d-46a6-a4ae-a94e52ef778a tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:32.905984 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-64d53de8-a974-4e53-9b3c-99022b2d2d1c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "POST /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44/action" status: 202 len: 0 microversion: 2.1 time: 0.629722 Oct 26 13:17:32.906906 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1804/3594] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:17:32 2022] POST /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44/action => generated 0 bytes in 635 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:17:32.920226 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9777cb27-7faf-4130-a25d-ba95615805c5 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Calling method '.version_select at 0x7f6732907b80>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:32.920981 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9777cb27-7faf-4130-a25d-ba95615805c5 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] [instance: b777991e-573a-43e3-abcb-ec40283e625d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:32.932813 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9777cb27-7faf-4130-a25d-ba95615805c5 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:32.934131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9777cb27-7faf-4130-a25d-ba95615805c5 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:32.934969 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9777cb27-7faf-4130-a25d-ba95615805c5 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:32.936093 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9777cb27-7faf-4130-a25d-ba95615805c5 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:32.936812 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9777cb27-7faf-4130-a25d-ba95615805c5 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:32.937442 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9777cb27-7faf-4130-a25d-ba95615805c5 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:32.979816 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9777cb27-7faf-4130-a25d-ba95615805c5 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] 10.222.0.40 "GET /compute/v2.1/servers/b777991e-573a-43e3-abcb-ec40283e625d/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.071356 Oct 26 13:17:32.980278 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1805/3595] 10.222.0.40 () {58 vars in 1296 bytes} [Wed Oct 26 13:17:32 2022] GET /compute/v2.1/servers/b777991e-573a-43e3-abcb-ec40283e625d/os-instance-actions => generated 611 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:17:32.985521 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d039af67-c3f9-4c42-8c1f-40aae9786a4b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:32.987340 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d039af67-c3f9-4c42-8c1f-40aae9786a4b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:32.992388 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d039af67-c3f9-4c42-8c1f-40aae9786a4b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:32.992939 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d039af67-c3f9-4c42-8c1f-40aae9786a4b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:32.994124 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d039af67-c3f9-4c42-8c1f-40aae9786a4b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:32.998618 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d039af67-c3f9-4c42-8c1f-40aae9786a4b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:32.999719 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d039af67-c3f9-4c42-8c1f-40aae9786a4b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:33.000237 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d039af67-c3f9-4c42-8c1f-40aae9786a4b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:33.099597 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9c9e7884-5c4d-46a6-a4ae-a94e52ef778a tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:33.108497 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9c9e7884-5c4d-46a6-a4ae-a94e52ef778a tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1391 microversion: 2.1 time: 0.362113 Oct 26 13:17:33.109439 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1791/3596] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:32 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1391 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:33.114672 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-91d118aa-380a-4165-b1fa-d28016239604 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:33.115623 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-91d118aa-380a-4165-b1fa-d28016239604 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: b29a1a98-a428-4967-bc4a-237971dcd264] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:33.122621 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91d118aa-380a-4165-b1fa-d28016239604 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:33.123259 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91d118aa-380a-4165-b1fa-d28016239604 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:33.123870 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91d118aa-380a-4165-b1fa-d28016239604 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:33.124935 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91d118aa-380a-4165-b1fa-d28016239604 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:33.125666 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91d118aa-380a-4165-b1fa-d28016239604 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:33.126251 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91d118aa-380a-4165-b1fa-d28016239604 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:33.234263 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d039af67-c3f9-4c42-8c1f-40aae9786a4b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:33.252573 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d039af67-c3f9-4c42-8c1f-40aae9786a4b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:33.256869 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d039af67-c3f9-4c42-8c1f-40aae9786a4b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:33.261162 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d039af67-c3f9-4c42-8c1f-40aae9786a4b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1873 microversion: 2.32 time: 0.277745 Oct 26 13:17:33.262156 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1806/3597] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:17:32 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1873 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:17:33.270197 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-36b734c1-6dba-45bd-8b2a-d8a7ad296635 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:33.273138 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-36b734c1-6dba-45bd-8b2a-d8a7ad296635 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 789a55e0-21ba-4b2e-b8d4-c95999955e2b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:33.289008 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-36b734c1-6dba-45bd-8b2a-d8a7ad296635 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:33.290456 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-36b734c1-6dba-45bd-8b2a-d8a7ad296635 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:33.291652 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-36b734c1-6dba-45bd-8b2a-d8a7ad296635 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:33.292512 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-36b734c1-6dba-45bd-8b2a-d8a7ad296635 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:33.293091 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-36b734c1-6dba-45bd-8b2a-d8a7ad296635 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:33.293716 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-36b734c1-6dba-45bd-8b2a-d8a7ad296635 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:33.332910 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-36b734c1-6dba-45bd-8b2a-d8a7ad296635 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069080 Oct 26 13:17:33.334152 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1807/3598] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:17:33 2022] GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:17:33.339911 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2b859931-6ae4-4bdd-b126-7ed2519a5a4c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:33.340850 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2b859931-6ae4-4bdd-b126-7ed2519a5a4c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:33.348721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2b859931-6ae4-4bdd-b126-7ed2519a5a4c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:33.349816 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2b859931-6ae4-4bdd-b126-7ed2519a5a4c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:33.350472 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2b859931-6ae4-4bdd-b126-7ed2519a5a4c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:33.351843 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2b859931-6ae4-4bdd-b126-7ed2519a5a4c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:33.352521 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2b859931-6ae4-4bdd-b126-7ed2519a5a4c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:33.354080 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2b859931-6ae4-4bdd-b126-7ed2519a5a4c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:33.468918 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-91d118aa-380a-4165-b1fa-d28016239604 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:33.500426 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-91d118aa-380a-4165-b1fa-d28016239604 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264" status: 200 len: 1507 microversion: 2.1 time: 0.369746 Oct 26 13:17:33.501343 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1792/3599] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:33 2022] GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264 => generated 1507 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:33.507879 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4e9d2298-988f-41e3-aaf1-f692049ecafa tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:33.509552 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4e9d2298-988f-41e3-aaf1-f692049ecafa tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] [instance: b777991e-573a-43e3-abcb-ec40283e625d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:33.518290 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e9d2298-988f-41e3-aaf1-f692049ecafa tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:33.518989 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e9d2298-988f-41e3-aaf1-f692049ecafa tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:33.519755 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e9d2298-988f-41e3-aaf1-f692049ecafa tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:33.520681 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e9d2298-988f-41e3-aaf1-f692049ecafa tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:33.522712 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e9d2298-988f-41e3-aaf1-f692049ecafa tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:33.523157 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e9d2298-988f-41e3-aaf1-f692049ecafa tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:33.559862 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4e9d2298-988f-41e3-aaf1-f692049ecafa tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] [instance: b777991e-573a-43e3-abcb-ec40283e625d] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:17:33.648350 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2b859931-6ae4-4bdd-b126-7ed2519a5a4c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:33.661105 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4e9d2298-988f-41e3-aaf1-f692049ecafa tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b777991e-573a-43e3-abcb-ec40283e625d" status: 204 len: 0 microversion: 2.1 time: 0.156607 Oct 26 13:17:33.662126 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1793/3600] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:17:33 2022] DELETE /compute/v2.1/servers/b777991e-573a-43e3-abcb-ec40283e625d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:17:33.663471 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2b859931-6ae4-4bdd-b126-7ed2519a5a4c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1509 microversion: 2.1 time: 0.328193 Oct 26 13:17:33.666968 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1808/3601] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:33 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1509 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:33.691254 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-90d1e7ad-cfdf-44b3-89cf-690a9b622293 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:33.692211 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-90d1e7ad-cfdf-44b3-89cf-690a9b622293 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] [instance: b777991e-573a-43e3-abcb-ec40283e625d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:33.700769 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90d1e7ad-cfdf-44b3-89cf-690a9b622293 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:33.701405 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90d1e7ad-cfdf-44b3-89cf-690a9b622293 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:33.701946 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90d1e7ad-cfdf-44b3-89cf-690a9b622293 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:33.702737 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90d1e7ad-cfdf-44b3-89cf-690a9b622293 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:33.703277 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90d1e7ad-cfdf-44b3-89cf-690a9b622293 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:33.703795 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90d1e7ad-cfdf-44b3-89cf-690a9b622293 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:33.929196 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-90d1e7ad-cfdf-44b3-89cf-690a9b622293 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53010c15247443b29ce39f037e22ca24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c0302538ba431684624b8d41dfc2f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:33.944953 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-90d1e7ad-cfdf-44b3-89cf-690a9b622293 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] 10.222.0.40 "GET /compute/v2.1/servers/b777991e-573a-43e3-abcb-ec40283e625d" status: 200 len: 1511 microversion: 2.1 time: 0.261668 Oct 26 13:17:33.945571 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1794/3602] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:33 2022] GET /compute/v2.1/servers/b777991e-573a-43e3-abcb-ec40283e625d => generated 1511 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:34.132113 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-04081bb1-674b-4ecc-ac5d-ecdaaf9badc1 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:34.132721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-04081bb1-674b-4ecc-ac5d-ecdaaf9badc1 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:34.144957 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-04081bb1-674b-4ecc-ac5d-ecdaaf9badc1 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:34.145455 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-04081bb1-674b-4ecc-ac5d-ecdaaf9badc1 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:34.145917 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-04081bb1-674b-4ecc-ac5d-ecdaaf9badc1 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:34.146884 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-04081bb1-674b-4ecc-ac5d-ecdaaf9badc1 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:34.147334 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-04081bb1-674b-4ecc-ac5d-ecdaaf9badc1 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:34.147763 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-04081bb1-674b-4ecc-ac5d-ecdaaf9badc1 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:34.291407 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4e37416a-804b-4d0e-a88b-1e0d07c5431c tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:34.292304 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4e37416a-804b-4d0e-a88b-1e0d07c5431c tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:34.313352 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e37416a-804b-4d0e-a88b-1e0d07c5431c tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:34.313889 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e37416a-804b-4d0e-a88b-1e0d07c5431c tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:34.314334 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e37416a-804b-4d0e-a88b-1e0d07c5431c tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:34.315057 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e37416a-804b-4d0e-a88b-1e0d07c5431c tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:34.315517 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e37416a-804b-4d0e-a88b-1e0d07c5431c tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:34.315941 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e37416a-804b-4d0e-a88b-1e0d07c5431c tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:34.555427 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-04081bb1-674b-4ecc-ac5d-ecdaaf9badc1 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:34.569868 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-04081bb1-674b-4ecc-ac5d-ecdaaf9badc1 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1391 microversion: 2.1 time: 0.441476 Oct 26 13:17:34.570719 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1809/3603] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:34 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1391 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:34.580428 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-de00c01c-208f-4cc9-a61b-e56a0e194b3a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:34.596347 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-de00c01c-208f-4cc9-a61b-e56a0e194b3a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 789a55e0-21ba-4b2e-b8d4-c95999955e2b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:34.605753 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4e37416a-804b-4d0e-a88b-1e0d07c5431c tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:34.608621 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de00c01c-208f-4cc9-a61b-e56a0e194b3a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:34.612310 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de00c01c-208f-4cc9-a61b-e56a0e194b3a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:34.612310 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de00c01c-208f-4cc9-a61b-e56a0e194b3a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:34.612310 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de00c01c-208f-4cc9-a61b-e56a0e194b3a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:34.612310 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de00c01c-208f-4cc9-a61b-e56a0e194b3a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:34.617740 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de00c01c-208f-4cc9-a61b-e56a0e194b3a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:34.618830 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4e37416a-804b-4d0e-a88b-1e0d07c5431c tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:34.621180 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4e37416a-804b-4d0e-a88b-1e0d07c5431c tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:34.622486 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4e37416a-804b-4d0e-a88b-1e0d07c5431c tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1873 microversion: 2.32 time: 0.335052 Oct 26 13:17:34.633984 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1795/3604] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:17:34 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1873 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:17:34.633984 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-10e00872-499a-4217-9573-8db3a5a34a53 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:34.633984 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-10e00872-499a-4217-9573-8db3a5a34a53 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: b29a1a98-a428-4967-bc4a-237971dcd264] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:34.636850 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-10e00872-499a-4217-9573-8db3a5a34a53 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:34.637589 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-10e00872-499a-4217-9573-8db3a5a34a53 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:34.638413 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-10e00872-499a-4217-9573-8db3a5a34a53 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:34.639389 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-10e00872-499a-4217-9573-8db3a5a34a53 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:34.640101 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-10e00872-499a-4217-9573-8db3a5a34a53 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:34.644224 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-10e00872-499a-4217-9573-8db3a5a34a53 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:34.730170 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-de00c01c-208f-4cc9-a61b-e56a0e194b3a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154681 Oct 26 13:17:34.730772 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1810/3605] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:17:34 2022] GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:17:34.751132 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fc818572-066d-4908-858d-3b687d1a900e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:34.752020 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fc818572-066d-4908-858d-3b687d1a900e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:34.768273 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fc818572-066d-4908-858d-3b687d1a900e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:34.769030 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fc818572-066d-4908-858d-3b687d1a900e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:34.769680 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fc818572-066d-4908-858d-3b687d1a900e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:34.770576 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fc818572-066d-4908-858d-3b687d1a900e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:34.771493 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fc818572-066d-4908-858d-3b687d1a900e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:34.772085 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fc818572-066d-4908-858d-3b687d1a900e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:34.830218 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-10e00872-499a-4217-9573-8db3a5a34a53 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:34.845317 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-10e00872-499a-4217-9573-8db3a5a34a53 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264" status: 200 len: 1507 microversion: 2.1 time: 0.220379 Oct 26 13:17:34.851593 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1796/3606] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:34 2022] GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264 => generated 1507 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:34.969437 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-62b8dee4-f775-4f02-9904-6edd667f0231 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:34.970316 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-62b8dee4-f775-4f02-9904-6edd667f0231 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] [instance: b777991e-573a-43e3-abcb-ec40283e625d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:34.976773 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-62b8dee4-f775-4f02-9904-6edd667f0231 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:34.977294 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-62b8dee4-f775-4f02-9904-6edd667f0231 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:34.978402 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-62b8dee4-f775-4f02-9904-6edd667f0231 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:34.979204 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-62b8dee4-f775-4f02-9904-6edd667f0231 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:34.979863 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-62b8dee4-f775-4f02-9904-6edd667f0231 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:34.980291 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-62b8dee4-f775-4f02-9904-6edd667f0231 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:35.064369 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fc818572-066d-4908-858d-3b687d1a900e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:35.079009 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fc818572-066d-4908-858d-3b687d1a900e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1509 microversion: 2.1 time: 0.332176 Oct 26 13:17:35.080409 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1811/3607] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:34 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1509 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:35.124994 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-62b8dee4-f775-4f02-9904-6edd667f0231 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53010c15247443b29ce39f037e22ca24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c0302538ba431684624b8d41dfc2f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:35.133534 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-62b8dee4-f775-4f02-9904-6edd667f0231 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] 10.222.0.40 "GET /compute/v2.1/servers/b777991e-573a-43e3-abcb-ec40283e625d" status: 200 len: 1511 microversion: 2.1 time: 0.168539 Oct 26 13:17:35.146552 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1797/3608] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:34 2022] GET /compute/v2.1/servers/b777991e-573a-43e3-abcb-ec40283e625d => generated 1511 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:17:35.597564 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ca930527-7ab8-4676-9bc4-86486c82fa8d tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:35.598115 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ca930527-7ab8-4676-9bc4-86486c82fa8d tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:35.605827 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca930527-7ab8-4676-9bc4-86486c82fa8d tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:35.606634 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca930527-7ab8-4676-9bc4-86486c82fa8d tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:35.607267 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca930527-7ab8-4676-9bc4-86486c82fa8d tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:35.609070 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca930527-7ab8-4676-9bc4-86486c82fa8d tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:35.610287 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca930527-7ab8-4676-9bc4-86486c82fa8d tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:35.610898 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca930527-7ab8-4676-9bc4-86486c82fa8d tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:35.660662 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-df87a91f-f196-4567-b627-3abca5061717 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:35.662504 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-df87a91f-f196-4567-b627-3abca5061717 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:35.676881 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-df87a91f-f196-4567-b627-3abca5061717 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:35.677914 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-df87a91f-f196-4567-b627-3abca5061717 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:35.678555 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-df87a91f-f196-4567-b627-3abca5061717 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:35.679715 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-df87a91f-f196-4567-b627-3abca5061717 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:35.680356 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-df87a91f-f196-4567-b627-3abca5061717 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:35.681885 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-df87a91f-f196-4567-b627-3abca5061717 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:35.827792 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ca930527-7ab8-4676-9bc4-86486c82fa8d tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:35.845141 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ca930527-7ab8-4676-9bc4-86486c82fa8d tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1391 microversion: 2.1 time: 0.251217 Oct 26 13:17:35.858957 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1812/3609] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:35 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1391 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:35.871644 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a64172e3-c2ef-49ee-b5af-ee6032be92ad tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:35.875929 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a64172e3-c2ef-49ee-b5af-ee6032be92ad tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 789a55e0-21ba-4b2e-b8d4-c95999955e2b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:35.885356 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a64172e3-c2ef-49ee-b5af-ee6032be92ad tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:35.886297 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a64172e3-c2ef-49ee-b5af-ee6032be92ad tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:35.893544 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a64172e3-c2ef-49ee-b5af-ee6032be92ad tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:35.894503 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a64172e3-c2ef-49ee-b5af-ee6032be92ad tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:35.907110 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a64172e3-c2ef-49ee-b5af-ee6032be92ad tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:35.907979 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a64172e3-c2ef-49ee-b5af-ee6032be92ad tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:35.954068 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a64172e3-c2ef-49ee-b5af-ee6032be92ad tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093619 Oct 26 13:17:35.955156 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1813/3610] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:17:35 2022] GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:17:35.960248 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e18115a5-1962-49cb-b241-ea1b618da6df tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:35.961188 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e18115a5-1962-49cb-b241-ea1b618da6df tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: b29a1a98-a428-4967-bc4a-237971dcd264] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:35.977000 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e18115a5-1962-49cb-b241-ea1b618da6df tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:35.977665 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e18115a5-1962-49cb-b241-ea1b618da6df tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:35.978417 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e18115a5-1962-49cb-b241-ea1b618da6df tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:35.980121 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e18115a5-1962-49cb-b241-ea1b618da6df tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:35.985303 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e18115a5-1962-49cb-b241-ea1b618da6df tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:35.988330 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e18115a5-1962-49cb-b241-ea1b618da6df tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:36.096985 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-df87a91f-f196-4567-b627-3abca5061717 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:36.111237 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-df87a91f-f196-4567-b627-3abca5061717 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:36.113656 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-df87a91f-f196-4567-b627-3abca5061717 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:36.115088 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-df87a91f-f196-4567-b627-3abca5061717 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1873 microversion: 2.32 time: 0.460322 Oct 26 13:17:36.116168 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1798/3611] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:17:35 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1873 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:17:36.136821 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-452b94cc-dbb1-4b2d-b61f-936aac119b23 req-15af1f2a-a671-4654-953b-6e4dc6a129d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b777991e-573a-43e3-abcb-ec40283e625d", "name": "network-vif-deleted", "tag": "42310a0c-3052-4cd8-b220-3b7a3cb26c88"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:17:36.149984 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-452b94cc-dbb1-4b2d-b61f-936aac119b23 req-15af1f2a-a671-4654-953b-6e4dc6a129d5 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:36.150470 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-452b94cc-dbb1-4b2d-b61f-936aac119b23 req-15af1f2a-a671-4654-953b-6e4dc6a129d5 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:36.150896 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-452b94cc-dbb1-4b2d-b61f-936aac119b23 req-15af1f2a-a671-4654-953b-6e4dc6a129d5 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:36.171161 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-452b94cc-dbb1-4b2d-b61f-936aac119b23 req-15af1f2a-a671-4654-953b-6e4dc6a129d5 service nova] Creating event network-vif-deleted:42310a0c-3052-4cd8-b220-3b7a3cb26c88 for instance b777991e-573a-43e3-abcb-ec40283e625d on n-h2-862686-1 Oct 26 13:17:36.179542 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-452b94cc-dbb1-4b2d-b61f-936aac119b23 req-15af1f2a-a671-4654-953b-6e4dc6a129d5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061876 Oct 26 13:17:36.181334 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1799/3612] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:17:36.188121 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6e275b14-0b74-4940-a78f-c79b2b0a7e34 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:36.188996 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6e275b14-0b74-4940-a78f-c79b2b0a7e34 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:36.196748 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e275b14-0b74-4940-a78f-c79b2b0a7e34 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:36.197725 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e275b14-0b74-4940-a78f-c79b2b0a7e34 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:36.198341 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e275b14-0b74-4940-a78f-c79b2b0a7e34 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:36.199058 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e275b14-0b74-4940-a78f-c79b2b0a7e34 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:36.199511 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e275b14-0b74-4940-a78f-c79b2b0a7e34 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:36.200093 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e275b14-0b74-4940-a78f-c79b2b0a7e34 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:36.344677 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e18115a5-1962-49cb-b241-ea1b618da6df tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:36.355079 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e18115a5-1962-49cb-b241-ea1b618da6df tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264" status: 200 len: 1507 microversion: 2.1 time: 0.398525 Oct 26 13:17:36.362614 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1814/3613] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:35 2022] GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264 => generated 1507 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:36.371312 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4e2aa0af-0d1c-4de4-a4f4-fd8837f4c847 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:36.372731 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4e2aa0af-0d1c-4de4-a4f4-fd8837f4c847 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] [instance: b777991e-573a-43e3-abcb-ec40283e625d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:36.398514 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e2aa0af-0d1c-4de4-a4f4-fd8837f4c847 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:36.399036 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e2aa0af-0d1c-4de4-a4f4-fd8837f4c847 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:36.399526 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e2aa0af-0d1c-4de4-a4f4-fd8837f4c847 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:36.400242 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e2aa0af-0d1c-4de4-a4f4-fd8837f4c847 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:36.400707 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e2aa0af-0d1c-4de4-a4f4-fd8837f4c847 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:36.400887 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6e275b14-0b74-4940-a78f-c79b2b0a7e34 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:36.406025 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e2aa0af-0d1c-4de4-a4f4-fd8837f4c847 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:36.410770 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6e275b14-0b74-4940-a78f-c79b2b0a7e34 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1509 microversion: 2.1 time: 0.227817 Oct 26 13:17:36.411672 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1800/3614] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:36 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1509 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:36.458529 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e2aa0af-0d1c-4de4-a4f4-fd8837f4c847 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:36.459017 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e2aa0af-0d1c-4de4-a4f4-fd8837f4c847 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:36.459650 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e2aa0af-0d1c-4de4-a4f4-fd8837f4c847 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:36.461099 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-4e2aa0af-0d1c-4de4-a4f4-fd8837f4c847 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lazy-loading 'fault' on Instance uuid b777991e-573a-43e3-abcb-ec40283e625d {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:17:36.511548 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4e2aa0af-0d1c-4de4-a4f4-fd8837f4c847 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53010c15247443b29ce39f037e22ca24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c0302538ba431684624b8d41dfc2f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:36.519457 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4e2aa0af-0d1c-4de4-a4f4-fd8837f4c847 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] 10.222.0.40 "GET /compute/v2.1/servers/b777991e-573a-43e3-abcb-ec40283e625d" status: 200 len: 1306 microversion: 2.1 time: 0.154248 Oct 26 13:17:36.521530 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1815/3615] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:36 2022] GET /compute/v2.1/servers/b777991e-573a-43e3-abcb-ec40283e625d => generated 1306 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:36.870804 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f8e2c56b-58d4-42c1-8e95-82ead9105691 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:36.872234 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f8e2c56b-58d4-42c1-8e95-82ead9105691 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:36.883688 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f8e2c56b-58d4-42c1-8e95-82ead9105691 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:36.884435 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f8e2c56b-58d4-42c1-8e95-82ead9105691 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:36.885100 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f8e2c56b-58d4-42c1-8e95-82ead9105691 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:36.886007 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f8e2c56b-58d4-42c1-8e95-82ead9105691 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:36.886659 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f8e2c56b-58d4-42c1-8e95-82ead9105691 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:36.887127 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f8e2c56b-58d4-42c1-8e95-82ead9105691 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:36.969007 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0846b7e0-d04c-45db-97ad-66b520d396be tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:36.971523 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0846b7e0-d04c-45db-97ad-66b520d396be tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 789a55e0-21ba-4b2e-b8d4-c95999955e2b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:36.984685 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0846b7e0-d04c-45db-97ad-66b520d396be tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:36.985191 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0846b7e0-d04c-45db-97ad-66b520d396be tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:36.985659 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0846b7e0-d04c-45db-97ad-66b520d396be tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:36.986377 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0846b7e0-d04c-45db-97ad-66b520d396be tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:36.986835 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0846b7e0-d04c-45db-97ad-66b520d396be tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:36.987283 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0846b7e0-d04c-45db-97ad-66b520d396be tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:37.057774 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0846b7e0-d04c-45db-97ad-66b520d396be tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094144 Oct 26 13:17:37.063163 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1816/3616] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:17:36 2022] GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:17:37.142064 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cee6ad7c-428b-4303-bb8f-693eaaca46d8 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:37.143340 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cee6ad7c-428b-4303-bb8f-693eaaca46d8 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:37.151697 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cee6ad7c-428b-4303-bb8f-693eaaca46d8 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:37.152566 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cee6ad7c-428b-4303-bb8f-693eaaca46d8 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:37.153113 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cee6ad7c-428b-4303-bb8f-693eaaca46d8 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:37.154009 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cee6ad7c-428b-4303-bb8f-693eaaca46d8 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:37.154869 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cee6ad7c-428b-4303-bb8f-693eaaca46d8 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:37.155489 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cee6ad7c-428b-4303-bb8f-693eaaca46d8 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:37.162876 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f8e2c56b-58d4-42c1-8e95-82ead9105691 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:37.172428 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f8e2c56b-58d4-42c1-8e95-82ead9105691 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1391 microversion: 2.1 time: 0.306899 Oct 26 13:17:37.186383 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1801/3617] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:36 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1391 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:37.384594 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1710a749-a117-4b2a-8a4e-5960898f34b7 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:37.385787 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1710a749-a117-4b2a-8a4e-5960898f34b7 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: b29a1a98-a428-4967-bc4a-237971dcd264] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:37.394614 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1710a749-a117-4b2a-8a4e-5960898f34b7 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:37.395466 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1710a749-a117-4b2a-8a4e-5960898f34b7 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:37.396804 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1710a749-a117-4b2a-8a4e-5960898f34b7 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:37.397611 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1710a749-a117-4b2a-8a4e-5960898f34b7 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:37.398531 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1710a749-a117-4b2a-8a4e-5960898f34b7 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:37.399340 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1710a749-a117-4b2a-8a4e-5960898f34b7 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:37.422742 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-cee6ad7c-428b-4303-bb8f-693eaaca46d8 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:37.453750 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-cee6ad7c-428b-4303-bb8f-693eaaca46d8 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:37.465498 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-cee6ad7c-428b-4303-bb8f-693eaaca46d8 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:37.468416 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cee6ad7c-428b-4303-bb8f-693eaaca46d8 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1873 microversion: 2.32 time: 0.330562 Oct 26 13:17:37.470210 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1817/3618] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:17:37 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1873 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:17:37.491644 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-408f0faf-a590-44f1-ae90-260f6d8bb572 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:37.498636 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-408f0faf-a590-44f1-ae90-260f6d8bb572 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:37.515460 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-408f0faf-a590-44f1-ae90-260f6d8bb572 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:37.518120 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-408f0faf-a590-44f1-ae90-260f6d8bb572 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:37.521581 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-408f0faf-a590-44f1-ae90-260f6d8bb572 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:37.522545 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-408f0faf-a590-44f1-ae90-260f6d8bb572 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:37.527691 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-408f0faf-a590-44f1-ae90-260f6d8bb572 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:37.528354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-408f0faf-a590-44f1-ae90-260f6d8bb572 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:37.701514 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1710a749-a117-4b2a-8a4e-5960898f34b7 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:37.717825 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1710a749-a117-4b2a-8a4e-5960898f34b7 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264" status: 200 len: 1507 microversion: 2.1 time: 0.342160 Oct 26 13:17:37.718346 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1802/3619] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:37 2022] GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264 => generated 1507 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:17:37.723257 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f1ad4ad6-3fe7-44a5-8001-b02eb36d2614 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:37.723873 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f1ad4ad6-3fe7-44a5-8001-b02eb36d2614 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] [instance: b777991e-573a-43e3-abcb-ec40283e625d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:37.739744 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f1ad4ad6-3fe7-44a5-8001-b02eb36d2614 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:37.740231 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f1ad4ad6-3fe7-44a5-8001-b02eb36d2614 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:37.740691 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f1ad4ad6-3fe7-44a5-8001-b02eb36d2614 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:37.741458 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f1ad4ad6-3fe7-44a5-8001-b02eb36d2614 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:37.741951 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f1ad4ad6-3fe7-44a5-8001-b02eb36d2614 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:37.742379 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f1ad4ad6-3fe7-44a5-8001-b02eb36d2614 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:37.769966 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-f1ad4ad6-3fe7-44a5-8001-b02eb36d2614 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] HTTP exception thrown: Instance b777991e-573a-43e3-abcb-ec40283e625d could not be found. Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f1ad4ad6-3fe7-44a5-8001-b02eb36d2614 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Request method failure captured: Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/b777991e-573a-43e3-abcb-ec40283e625d HTTP/1.1 Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTNWL5lZ_UKAEh3DCgVz5wdS6WWMRUt3u4uKhp0Xqk35LPOKpsN-aAxabGhBTgde98hyyIs5N76sOxfDe97T9eVrv3N5r5zanscvmjpdCBWt3DYp4Vh8Fd011HwXcHFb__X5EQZfZiVidFZK98_aGXr3wA3ql2tp9-wbspn7PmQ6OBU Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 18c0302538ba431684624b8d41dfc2f0 Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-InstanceActionsTestJSON-800978124 Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/18c0302538ba431684624b8d41dfc2f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/18c0302538ba431684624b8d41dfc2f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_18c0302538ba431684624b8d41dfc2f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/18c0302538ba431684624b8d41dfc2f0"}]}] Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-InstanceActionsTestJSON-800978124 Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 18c0302538ba431684624b8d41dfc2f0 Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-InstanceActionsTestJSON-800978124 Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-InstanceActionsTestJSON-800978124-project Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 53010c15247443b29ce39f037e22ca24 Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-InstanceActionsTestJSON-800978124-project Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance b777991e-573a-43e3-abcb-ec40283e625d could not be found. Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'b777991e-573a-43e3-abcb-ec40283e625d'} Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b777991e-573a-43e3-abcb-ec40283e625d could not be found. Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b777991e-573a-43e3-abcb-ec40283e625d could not be found. Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:17:37.773879 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:37.780434 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:37.780434 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:17:37.780434 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:17:37.780434 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:17:37.780434 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:17:37.780434 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b777991e-573a-43e3-abcb-ec40283e625d could not be found. Oct 26 13:17:37.780434 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:37.783508 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f1ad4ad6-3fe7-44a5-8001-b02eb36d2614 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] Returning 404 to user: Instance b777991e-573a-43e3-abcb-ec40283e625d could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:17:37.784663 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f1ad4ad6-3fe7-44a5-8001-b02eb36d2614 tempest-InstanceActionsTestJSON-800978124 tempest-InstanceActionsTestJSON-800978124-project] 10.222.0.40 "GET /compute/v2.1/servers/b777991e-573a-43e3-abcb-ec40283e625d" status: 404 len: 111 microversion: 2.1 time: 0.065362 Oct 26 13:17:37.785850 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1803/3620] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:37 2022] GET /compute/v2.1/servers/b777991e-573a-43e3-abcb-ec40283e625d => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:17:37.819232 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-408f0faf-a590-44f1-ae90-260f6d8bb572 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:37.832089 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-408f0faf-a590-44f1-ae90-260f6d8bb572 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1509 microversion: 2.1 time: 0.360505 Oct 26 13:17:37.832702 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1818/3621] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:37 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1509 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:38.071950 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b4906fe6-7a75-4b49-95a3-cbb07b9b0683 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:38.074532 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b4906fe6-7a75-4b49-95a3-cbb07b9b0683 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 789a55e0-21ba-4b2e-b8d4-c95999955e2b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:38.101766 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b4906fe6-7a75-4b49-95a3-cbb07b9b0683 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:38.102766 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b4906fe6-7a75-4b49-95a3-cbb07b9b0683 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:38.103976 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b4906fe6-7a75-4b49-95a3-cbb07b9b0683 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:38.106326 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b4906fe6-7a75-4b49-95a3-cbb07b9b0683 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:38.110275 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b4906fe6-7a75-4b49-95a3-cbb07b9b0683 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:38.111126 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b4906fe6-7a75-4b49-95a3-cbb07b9b0683 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:38.180126 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b4906fe6-7a75-4b49-95a3-cbb07b9b0683 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113235 Oct 26 13:17:38.187215 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1804/3622] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:17:38 2022] GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:17:38.202473 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c49e22d5-97cc-4ecc-8fd9-a6128fcd48fa tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:38.203639 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c49e22d5-97cc-4ecc-8fd9-a6128fcd48fa tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:38.216343 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c49e22d5-97cc-4ecc-8fd9-a6128fcd48fa tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:38.216931 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c49e22d5-97cc-4ecc-8fd9-a6128fcd48fa tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:38.217638 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c49e22d5-97cc-4ecc-8fd9-a6128fcd48fa tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:38.219397 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c49e22d5-97cc-4ecc-8fd9-a6128fcd48fa tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:38.219997 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c49e22d5-97cc-4ecc-8fd9-a6128fcd48fa tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:38.220935 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c49e22d5-97cc-4ecc-8fd9-a6128fcd48fa tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:38.500324 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c7f682cc-dbba-4a04-b5b2-4d984716eb01 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:38.501049 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c7f682cc-dbba-4a04-b5b2-4d984716eb01 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:38.524535 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c7f682cc-dbba-4a04-b5b2-4d984716eb01 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:38.535474 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c7f682cc-dbba-4a04-b5b2-4d984716eb01 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:38.535933 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c7f682cc-dbba-4a04-b5b2-4d984716eb01 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:38.536694 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c7f682cc-dbba-4a04-b5b2-4d984716eb01 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:38.537352 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c7f682cc-dbba-4a04-b5b2-4d984716eb01 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:38.537975 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c7f682cc-dbba-4a04-b5b2-4d984716eb01 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:38.659822 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c49e22d5-97cc-4ecc-8fd9-a6128fcd48fa tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:38.669286 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c49e22d5-97cc-4ecc-8fd9-a6128fcd48fa tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1391 microversion: 2.1 time: 0.474672 Oct 26 13:17:38.672453 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1819/3623] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:38 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1391 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:17:38.743210 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4a1df091-8a54-43dd-8fde-8d9eae7c92bb tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:38.744108 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4a1df091-8a54-43dd-8fde-8d9eae7c92bb tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: b29a1a98-a428-4967-bc4a-237971dcd264] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:38.750864 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a1df091-8a54-43dd-8fde-8d9eae7c92bb tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:38.751579 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a1df091-8a54-43dd-8fde-8d9eae7c92bb tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:38.752186 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a1df091-8a54-43dd-8fde-8d9eae7c92bb tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:38.753062 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a1df091-8a54-43dd-8fde-8d9eae7c92bb tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:38.753713 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a1df091-8a54-43dd-8fde-8d9eae7c92bb tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:38.754305 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a1df091-8a54-43dd-8fde-8d9eae7c92bb tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:38.775449 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:17:38.984429 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c7f682cc-dbba-4a04-b5b2-4d984716eb01 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:38.988763 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:17:39.006548 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c7f682cc-dbba-4a04-b5b2-4d984716eb01 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:39.014054 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c7f682cc-dbba-4a04-b5b2-4d984716eb01 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:39.015281 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c7f682cc-dbba-4a04-b5b2-4d984716eb01 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1873 microversion: 2.32 time: 0.518955 Oct 26 13:17:39.015864 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1805/3624] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:17:38 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1873 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:17:39.023735 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ff49f8e0-9249-4cc3-a6d4-164207fb972d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:39.026734 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ff49f8e0-9249-4cc3-a6d4-164207fb972d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:39.041707 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff49f8e0-9249-4cc3-a6d4-164207fb972d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:39.044944 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff49f8e0-9249-4cc3-a6d4-164207fb972d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:39.045602 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff49f8e0-9249-4cc3-a6d4-164207fb972d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:39.046502 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff49f8e0-9249-4cc3-a6d4-164207fb972d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:39.047172 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff49f8e0-9249-4cc3-a6d4-164207fb972d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:39.048353 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff49f8e0-9249-4cc3-a6d4-164207fb972d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:39.239150 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ff49f8e0-9249-4cc3-a6d4-164207fb972d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:39.248672 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ff49f8e0-9249-4cc3-a6d4-164207fb972d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1509 microversion: 2.1 time: 0.231729 Oct 26 13:17:39.254073 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1806/3625] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:39 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1509 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:39.266114 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6c9d7dd9-cb07-4481-a001-4995dec2c300 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:39.272227 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6c9d7dd9-cb07-4481-a001-4995dec2c300 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 789a55e0-21ba-4b2e-b8d4-c95999955e2b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:39.292839 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6c9d7dd9-cb07-4481-a001-4995dec2c300 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:39.293674 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6c9d7dd9-cb07-4481-a001-4995dec2c300 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:39.294445 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6c9d7dd9-cb07-4481-a001-4995dec2c300 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:39.295326 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6c9d7dd9-cb07-4481-a001-4995dec2c300 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:39.295942 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6c9d7dd9-cb07-4481-a001-4995dec2c300 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:39.296526 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6c9d7dd9-cb07-4481-a001-4995dec2c300 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:39.369278 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6c9d7dd9-cb07-4481-a001-4995dec2c300 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113626 Oct 26 13:17:39.369907 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1807/3626] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:17:39 2022] GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:17:39.401598 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:17:39.620711 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4a1df091-8a54-43dd-8fde-8d9eae7c92bb tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:39.634618 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4a1df091-8a54-43dd-8fde-8d9eae7c92bb tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264" status: 200 len: 1507 microversion: 2.1 time: 0.893429 Oct 26 13:17:39.638468 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1820/3627] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:38 2022] GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264 => generated 1507 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:39.695301 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-73d85744-c203-4f76-b3f7-48165e2ec9fa tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:39.696076 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-73d85744-c203-4f76-b3f7-48165e2ec9fa tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:39.717518 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73d85744-c203-4f76-b3f7-48165e2ec9fa tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:39.721040 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73d85744-c203-4f76-b3f7-48165e2ec9fa tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:39.721740 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73d85744-c203-4f76-b3f7-48165e2ec9fa tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:39.726215 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73d85744-c203-4f76-b3f7-48165e2ec9fa tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:39.728244 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73d85744-c203-4f76-b3f7-48165e2ec9fa tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:39.728858 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73d85744-c203-4f76-b3f7-48165e2ec9fa tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:40.047052 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3c390c8d-6343-418c-b2ef-91c3fc588b4f tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:40.048049 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3c390c8d-6343-418c-b2ef-91c3fc588b4f tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:40.068201 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c390c8d-6343-418c-b2ef-91c3fc588b4f tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:40.072347 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c390c8d-6343-418c-b2ef-91c3fc588b4f tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:40.074128 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c390c8d-6343-418c-b2ef-91c3fc588b4f tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:40.075180 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c390c8d-6343-418c-b2ef-91c3fc588b4f tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:40.079328 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c390c8d-6343-418c-b2ef-91c3fc588b4f tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:40.080138 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c390c8d-6343-418c-b2ef-91c3fc588b4f tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:40.142605 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-73d85744-c203-4f76-b3f7-48165e2ec9fa tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:40.164088 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-73d85744-c203-4f76-b3f7-48165e2ec9fa tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1391 microversion: 2.1 time: 0.469258 Oct 26 13:17:40.171461 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1808/3628] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:39 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1391 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:40.276718 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-77b90348-2819-44e0-b4b9-2a92c6035474 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:40.278100 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-77b90348-2819-44e0-b4b9-2a92c6035474 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:40.288134 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-77b90348-2819-44e0-b4b9-2a92c6035474 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:40.288888 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-77b90348-2819-44e0-b4b9-2a92c6035474 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:40.290307 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-77b90348-2819-44e0-b4b9-2a92c6035474 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:40.291285 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-77b90348-2819-44e0-b4b9-2a92c6035474 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:40.292032 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-77b90348-2819-44e0-b4b9-2a92c6035474 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:40.292797 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-77b90348-2819-44e0-b4b9-2a92c6035474 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:40.658979 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-77b90348-2819-44e0-b4b9-2a92c6035474 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:40.680702 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-77b90348-2819-44e0-b4b9-2a92c6035474 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1509 microversion: 2.1 time: 0.407835 Oct 26 13:17:40.683951 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1809/3629] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:40 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1509 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:40.696743 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-00e34e8a-5440-4671-883e-95d6522170f9 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:40.702458 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-00e34e8a-5440-4671-883e-95d6522170f9 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 789a55e0-21ba-4b2e-b8d4-c95999955e2b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:40.721455 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-00e34e8a-5440-4671-883e-95d6522170f9 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:40.724887 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-00e34e8a-5440-4671-883e-95d6522170f9 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:40.725591 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-00e34e8a-5440-4671-883e-95d6522170f9 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:40.728110 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-00e34e8a-5440-4671-883e-95d6522170f9 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:40.729049 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-00e34e8a-5440-4671-883e-95d6522170f9 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:40.729824 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-00e34e8a-5440-4671-883e-95d6522170f9 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:40.841388 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-00e34e8a-5440-4671-883e-95d6522170f9 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.155460 Oct 26 13:17:40.849857 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1810/3630] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:17:40 2022] GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b/os-volume_attachments => generated 25 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:17:40.861252 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-528c4f46-097b-4864-9a18-3fe7f9ddc008 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:40.862213 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-528c4f46-097b-4864-9a18-3fe7f9ddc008 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: b29a1a98-a428-4967-bc4a-237971dcd264] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:40.866384 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3c390c8d-6343-418c-b2ef-91c3fc588b4f tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:40.884774 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-528c4f46-097b-4864-9a18-3fe7f9ddc008 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:40.885562 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-528c4f46-097b-4864-9a18-3fe7f9ddc008 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:40.886191 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-528c4f46-097b-4864-9a18-3fe7f9ddc008 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:40.886393 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3c390c8d-6343-418c-b2ef-91c3fc588b4f tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:40.888238 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-528c4f46-097b-4864-9a18-3fe7f9ddc008 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:40.890055 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-528c4f46-097b-4864-9a18-3fe7f9ddc008 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:40.891364 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-528c4f46-097b-4864-9a18-3fe7f9ddc008 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:40.894728 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3c390c8d-6343-418c-b2ef-91c3fc588b4f tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:40.897816 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3c390c8d-6343-418c-b2ef-91c3fc588b4f tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1873 microversion: 2.32 time: 0.854446 Oct 26 13:17:40.904793 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1821/3631] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:17:40 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1873 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:17:41.007518 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1a1bfa19-e236-4a18-91ef-97f62b1a6dd1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:41.008025 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1a1bfa19-e236-4a18-91ef-97f62b1a6dd1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 789a55e0-21ba-4b2e-b8d4-c95999955e2b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:41.016919 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a1bfa19-e236-4a18-91ef-97f62b1a6dd1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:41.017414 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a1bfa19-e236-4a18-91ef-97f62b1a6dd1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:41.018082 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a1bfa19-e236-4a18-91ef-97f62b1a6dd1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:41.018822 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a1bfa19-e236-4a18-91ef-97f62b1a6dd1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:41.019278 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a1bfa19-e236-4a18-91ef-97f62b1a6dd1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:41.019697 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a1bfa19-e236-4a18-91ef-97f62b1a6dd1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:41.085469 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1a1bfa19-e236-4a18-91ef-97f62b1a6dd1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 789a55e0-21ba-4b2e-b8d4-c95999955e2b] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:17:41.246833 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1a1bfa19-e236-4a18-91ef-97f62b1a6dd1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "DELETE /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b" status: 204 len: 0 microversion: 2.1 time: 0.243454 Oct 26 13:17:41.248281 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1822/3632] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:17:41 2022] DELETE /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 26 13:17:41.260558 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f6375c40-aafd-4a4f-8f1d-c7efeca437bb tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:41.262170 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f6375c40-aafd-4a4f-8f1d-c7efeca437bb tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:41.269688 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6375c40-aafd-4a4f-8f1d-c7efeca437bb tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:41.270721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6375c40-aafd-4a4f-8f1d-c7efeca437bb tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:41.271667 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6375c40-aafd-4a4f-8f1d-c7efeca437bb tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:41.272588 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6375c40-aafd-4a4f-8f1d-c7efeca437bb tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:41.273337 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6375c40-aafd-4a4f-8f1d-c7efeca437bb tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:41.275088 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6375c40-aafd-4a4f-8f1d-c7efeca437bb tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:41.278413 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-528c4f46-097b-4864-9a18-3fe7f9ddc008 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:41.286738 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-528c4f46-097b-4864-9a18-3fe7f9ddc008 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264" status: 200 len: 1507 microversion: 2.1 time: 0.435529 Oct 26 13:17:41.291262 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1811/3633] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:40 2022] GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264 => generated 1507 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:41.302615 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1820acce-b63c-4b80-bb02-256e495dd704 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:41.303583 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1820acce-b63c-4b80-bb02-256e495dd704 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 789a55e0-21ba-4b2e-b8d4-c95999955e2b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:41.315592 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1820acce-b63c-4b80-bb02-256e495dd704 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:41.322568 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1820acce-b63c-4b80-bb02-256e495dd704 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:41.323667 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1820acce-b63c-4b80-bb02-256e495dd704 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:41.325939 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1820acce-b63c-4b80-bb02-256e495dd704 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:41.326640 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1820acce-b63c-4b80-bb02-256e495dd704 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:41.327093 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1820acce-b63c-4b80-bb02-256e495dd704 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:41.531698 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1820acce-b63c-4b80-bb02-256e495dd704 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:41.542422 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1820acce-b63c-4b80-bb02-256e495dd704 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b" status: 200 len: 1682 microversion: 2.1 time: 0.249842 Oct 26 13:17:41.563588 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f6375c40-aafd-4a4f-8f1d-c7efeca437bb tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:41.564387 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1812/3634] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:41 2022] GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b => generated 1682 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:41.576337 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f6375c40-aafd-4a4f-8f1d-c7efeca437bb tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1391 microversion: 2.1 time: 0.325583 Oct 26 13:17:41.577566 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1823/3635] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:41 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1391 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:41.713372 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-29e38f0f-be79-4b99-b768-903bf1d6946d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:41.714975 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-29e38f0f-be79-4b99-b768-903bf1d6946d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:41.726712 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-29e38f0f-be79-4b99-b768-903bf1d6946d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:41.730302 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-29e38f0f-be79-4b99-b768-903bf1d6946d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:41.730938 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-29e38f0f-be79-4b99-b768-903bf1d6946d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:41.732135 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-29e38f0f-be79-4b99-b768-903bf1d6946d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:41.734052 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-29e38f0f-be79-4b99-b768-903bf1d6946d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:41.741880 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-29e38f0f-be79-4b99-b768-903bf1d6946d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:41.934885 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f2f56ed5-d7cf-494b-8a3f-afe632f04077 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:41.935979 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f2f56ed5-d7cf-494b-8a3f-afe632f04077 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:41.945062 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f2f56ed5-d7cf-494b-8a3f-afe632f04077 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:41.946829 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f2f56ed5-d7cf-494b-8a3f-afe632f04077 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:41.948062 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f2f56ed5-d7cf-494b-8a3f-afe632f04077 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:41.952422 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f2f56ed5-d7cf-494b-8a3f-afe632f04077 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:41.953090 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f2f56ed5-d7cf-494b-8a3f-afe632f04077 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:41.953762 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f2f56ed5-d7cf-494b-8a3f-afe632f04077 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:42.127620 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-29e38f0f-be79-4b99-b768-903bf1d6946d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:42.140513 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-29e38f0f-be79-4b99-b768-903bf1d6946d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1509 microversion: 2.1 time: 0.432037 Oct 26 13:17:42.154590 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1813/3636] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:41 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1509 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:42.311403 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f2f56ed5-d7cf-494b-8a3f-afe632f04077 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:42.312699 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f8952681-3dc2-4735-ae7a-90d221e8b468 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:42.313419 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f8952681-3dc2-4735-ae7a-90d221e8b468 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: b29a1a98-a428-4967-bc4a-237971dcd264] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:42.319798 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f8952681-3dc2-4735-ae7a-90d221e8b468 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:42.320645 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f8952681-3dc2-4735-ae7a-90d221e8b468 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:42.322191 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f8952681-3dc2-4735-ae7a-90d221e8b468 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:42.323389 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f8952681-3dc2-4735-ae7a-90d221e8b468 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:42.324093 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f8952681-3dc2-4735-ae7a-90d221e8b468 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:42.324745 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f8952681-3dc2-4735-ae7a-90d221e8b468 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:42.327061 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f2f56ed5-d7cf-494b-8a3f-afe632f04077 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:42.328792 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f2f56ed5-d7cf-494b-8a3f-afe632f04077 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:42.331387 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f2f56ed5-d7cf-494b-8a3f-afe632f04077 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1873 microversion: 2.32 time: 0.399330 Oct 26 13:17:42.333183 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1824/3637] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:17:41 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1873 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:17:42.574589 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d5cc9cc6-95b8-4d58-9fe8-c797fecb0638 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:42.575909 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d5cc9cc6-95b8-4d58-9fe8-c797fecb0638 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 789a55e0-21ba-4b2e-b8d4-c95999955e2b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:42.587872 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5cc9cc6-95b8-4d58-9fe8-c797fecb0638 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:42.590762 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5cc9cc6-95b8-4d58-9fe8-c797fecb0638 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:42.592781 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5cc9cc6-95b8-4d58-9fe8-c797fecb0638 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:42.593703 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5cc9cc6-95b8-4d58-9fe8-c797fecb0638 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:42.597962 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5cc9cc6-95b8-4d58-9fe8-c797fecb0638 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:42.600888 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5cc9cc6-95b8-4d58-9fe8-c797fecb0638 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:42.723843 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f8952681-3dc2-4735-ae7a-90d221e8b468 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:42.732453 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f8952681-3dc2-4735-ae7a-90d221e8b468 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264" status: 200 len: 1507 microversion: 2.1 time: 0.423678 Oct 26 13:17:42.737457 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1814/3638] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:42 2022] GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264 => generated 1507 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:17:42.748104 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a0911ba8-3a32-4036-98cd-d0579369cc68 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:42.749017 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a0911ba8-3a32-4036-98cd-d0579369cc68 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:42.762134 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0911ba8-3a32-4036-98cd-d0579369cc68 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:42.765906 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0911ba8-3a32-4036-98cd-d0579369cc68 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:42.766362 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0911ba8-3a32-4036-98cd-d0579369cc68 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:42.767100 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0911ba8-3a32-4036-98cd-d0579369cc68 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:42.774849 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0911ba8-3a32-4036-98cd-d0579369cc68 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:42.775935 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0911ba8-3a32-4036-98cd-d0579369cc68 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:42.871357 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d5cc9cc6-95b8-4d58-9fe8-c797fecb0638 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:42.880159 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d5cc9cc6-95b8-4d58-9fe8-c797fecb0638 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b" status: 200 len: 1682 microversion: 2.1 time: 0.312574 Oct 26 13:17:42.881013 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1825/3639] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:42 2022] GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b => generated 1682 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:43.174847 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7dd82410-fa1b-4709-b39a-6ebfe1b48f1e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:43.176270 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7dd82410-fa1b-4709-b39a-6ebfe1b48f1e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:43.185161 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7dd82410-fa1b-4709-b39a-6ebfe1b48f1e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:43.185716 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7dd82410-fa1b-4709-b39a-6ebfe1b48f1e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:43.194608 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7dd82410-fa1b-4709-b39a-6ebfe1b48f1e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:43.195617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7dd82410-fa1b-4709-b39a-6ebfe1b48f1e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:43.196287 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7dd82410-fa1b-4709-b39a-6ebfe1b48f1e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:43.196795 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7dd82410-fa1b-4709-b39a-6ebfe1b48f1e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:43.782142 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a0911ba8-3a32-4036-98cd-d0579369cc68 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:43.790750 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a0911ba8-3a32-4036-98cd-d0579369cc68 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1391 microversion: 2.1 time: 1.051295 Oct 26 13:17:43.791568 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1815/3640] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:42 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1391 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:43.817066 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-08670b72-0b88-4a24-ba5f-30d1f740c6b6 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:43.817708 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-08670b72-0b88-4a24-ba5f-30d1f740c6b6 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:43.845306 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-08670b72-0b88-4a24-ba5f-30d1f740c6b6 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:43.847329 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-08670b72-0b88-4a24-ba5f-30d1f740c6b6 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:43.847968 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-08670b72-0b88-4a24-ba5f-30d1f740c6b6 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:43.848860 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-08670b72-0b88-4a24-ba5f-30d1f740c6b6 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:43.849681 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-08670b72-0b88-4a24-ba5f-30d1f740c6b6 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:43.850265 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-08670b72-0b88-4a24-ba5f-30d1f740c6b6 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:44.255859 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7dd82410-fa1b-4709-b39a-6ebfe1b48f1e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:44.271976 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7dd82410-fa1b-4709-b39a-6ebfe1b48f1e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1509 microversion: 2.1 time: 1.101418 Oct 26 13:17:44.272592 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1826/3641] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:43 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1509 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:17:44.283976 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f3e02a90-2924-4225-be72-0f6e8c9c8a24 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:44.284634 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f3e02a90-2924-4225-be72-0f6e8c9c8a24 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: b29a1a98-a428-4967-bc4a-237971dcd264] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:44.301307 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f3e02a90-2924-4225-be72-0f6e8c9c8a24 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:44.301843 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f3e02a90-2924-4225-be72-0f6e8c9c8a24 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:44.303535 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f3e02a90-2924-4225-be72-0f6e8c9c8a24 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:44.304271 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f3e02a90-2924-4225-be72-0f6e8c9c8a24 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:44.304874 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f3e02a90-2924-4225-be72-0f6e8c9c8a24 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:44.308007 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f3e02a90-2924-4225-be72-0f6e8c9c8a24 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:44.532960 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-08670b72-0b88-4a24-ba5f-30d1f740c6b6 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:44.551162 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-08670b72-0b88-4a24-ba5f-30d1f740c6b6 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:44.559610 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-08670b72-0b88-4a24-ba5f-30d1f740c6b6 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:44.561720 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-08670b72-0b88-4a24-ba5f-30d1f740c6b6 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1873 microversion: 2.32 time: 0.750450 Oct 26 13:17:44.565027 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1816/3642] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:17:43 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1873 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:17:44.579778 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-79d36ce7-7ecf-4473-bcdc-b21f774e4093 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:44.580678 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-79d36ce7-7ecf-4473-bcdc-b21f774e4093 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 789a55e0-21ba-4b2e-b8d4-c95999955e2b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:44.594147 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-79d36ce7-7ecf-4473-bcdc-b21f774e4093 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:44.595009 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-79d36ce7-7ecf-4473-bcdc-b21f774e4093 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:44.598153 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-79d36ce7-7ecf-4473-bcdc-b21f774e4093 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:44.599688 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-79d36ce7-7ecf-4473-bcdc-b21f774e4093 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:44.600329 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-79d36ce7-7ecf-4473-bcdc-b21f774e4093 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:44.600919 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-79d36ce7-7ecf-4473-bcdc-b21f774e4093 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:44.751111 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f3e02a90-2924-4225-be72-0f6e8c9c8a24 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:44.775281 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f3e02a90-2924-4225-be72-0f6e8c9c8a24 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264" status: 200 len: 1507 microversion: 2.1 time: 0.497581 Oct 26 13:17:44.789507 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1827/3643] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:44 2022] GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264 => generated 1507 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:44.801757 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-200fbaad-4bd3-495c-afff-ea0a10603d42 req-e619cce5-ce1e-4289-8122-a33104eac0d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "789a55e0-21ba-4b2e-b8d4-c95999955e2b", "name": "network-vif-deleted", "tag": "ef8bf176-1c77-4039-a167-e88ec9e88a43"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:17:44.822212 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-200fbaad-4bd3-495c-afff-ea0a10603d42 req-e619cce5-ce1e-4289-8122-a33104eac0d1 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:44.822715 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-200fbaad-4bd3-495c-afff-ea0a10603d42 req-e619cce5-ce1e-4289-8122-a33104eac0d1 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:44.823149 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-200fbaad-4bd3-495c-afff-ea0a10603d42 req-e619cce5-ce1e-4289-8122-a33104eac0d1 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:44.841176 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-200fbaad-4bd3-495c-afff-ea0a10603d42 req-e619cce5-ce1e-4289-8122-a33104eac0d1 service nova] Creating event network-vif-deleted:ef8bf176-1c77-4039-a167-e88ec9e88a43 for instance 789a55e0-21ba-4b2e-b8d4-c95999955e2b on n-h1-862686-1 Oct 26 13:17:44.887209 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-200fbaad-4bd3-495c-afff-ea0a10603d42 req-e619cce5-ce1e-4289-8122-a33104eac0d1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095912 Oct 26 13:17:44.891515 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1828/3644] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:17:44.904456 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3a7c3dd1-615d-44f4-968b-769792c2cf58 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:44.904456 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3a7c3dd1-615d-44f4-968b-769792c2cf58 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:44.910223 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3a7c3dd1-615d-44f4-968b-769792c2cf58 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:44.910717 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3a7c3dd1-615d-44f4-968b-769792c2cf58 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:44.911156 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3a7c3dd1-615d-44f4-968b-769792c2cf58 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:44.911855 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3a7c3dd1-615d-44f4-968b-769792c2cf58 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:44.912306 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3a7c3dd1-615d-44f4-968b-769792c2cf58 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:44.912956 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3a7c3dd1-615d-44f4-968b-769792c2cf58 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:45.175853 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3a7c3dd1-615d-44f4-968b-769792c2cf58 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:45.185898 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3a7c3dd1-615d-44f4-968b-769792c2cf58 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1391 microversion: 2.1 time: 0.289734 Oct 26 13:17:45.186907 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1829/3645] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:44 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1391 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:45.220676 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-79d36ce7-7ecf-4473-bcdc-b21f774e4093 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:45.237695 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-79d36ce7-7ecf-4473-bcdc-b21f774e4093 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b" status: 200 len: 1615 microversion: 2.1 time: 0.668782 Oct 26 13:17:45.239500 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1817/3646] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:44 2022] GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b => generated 1615 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:45.298685 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f40c5594-78e2-4857-8173-fd52baa17144 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:45.298685 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f40c5594-78e2-4857-8173-fd52baa17144 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:45.324211 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f40c5594-78e2-4857-8173-fd52baa17144 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:45.324458 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f40c5594-78e2-4857-8173-fd52baa17144 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:45.324779 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f40c5594-78e2-4857-8173-fd52baa17144 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:45.332256 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f40c5594-78e2-4857-8173-fd52baa17144 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:45.332837 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f40c5594-78e2-4857-8173-fd52baa17144 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:45.333208 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f40c5594-78e2-4857-8173-fd52baa17144 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:45.595604 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3bd571cb-4c2c-47fb-928e-791780643b55 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:45.596925 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3bd571cb-4c2c-47fb-928e-791780643b55 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:45.608578 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3bd571cb-4c2c-47fb-928e-791780643b55 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:45.609085 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3bd571cb-4c2c-47fb-928e-791780643b55 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:45.611208 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3bd571cb-4c2c-47fb-928e-791780643b55 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:45.612616 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3bd571cb-4c2c-47fb-928e-791780643b55 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:45.613106 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3bd571cb-4c2c-47fb-928e-791780643b55 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:45.620200 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3bd571cb-4c2c-47fb-928e-791780643b55 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:45.822916 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f40c5594-78e2-4857-8173-fd52baa17144 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:45.834365 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f40c5594-78e2-4857-8173-fd52baa17144 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1509 microversion: 2.1 time: 0.541967 Oct 26 13:17:45.849534 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1830/3647] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:45 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1509 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:45.849534 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1b941983-1ca4-41db-a475-569fa246b80b tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:45.849534 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1b941983-1ca4-41db-a475-569fa246b80b tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: b29a1a98-a428-4967-bc4a-237971dcd264] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:45.874776 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b941983-1ca4-41db-a475-569fa246b80b tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:45.875512 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b941983-1ca4-41db-a475-569fa246b80b tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:45.876156 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b941983-1ca4-41db-a475-569fa246b80b tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:45.877032 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b941983-1ca4-41db-a475-569fa246b80b tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:45.877702 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b941983-1ca4-41db-a475-569fa246b80b tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:45.878304 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b941983-1ca4-41db-a475-569fa246b80b tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:46.574433 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1b941983-1ca4-41db-a475-569fa246b80b tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:46.588735 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1b941983-1ca4-41db-a475-569fa246b80b tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264" status: 200 len: 1507 microversion: 2.1 time: 0.747880 Oct 26 13:17:46.609680 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1831/3648] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:45 2022] GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264 => generated 1507 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:46.620977 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-11c9ce64-fdcf-40f6-a2a3-a1de562e8db1 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:46.621889 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-11c9ce64-fdcf-40f6-a2a3-a1de562e8db1 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:46.629924 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11c9ce64-fdcf-40f6-a2a3-a1de562e8db1 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:46.631287 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11c9ce64-fdcf-40f6-a2a3-a1de562e8db1 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:46.631726 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11c9ce64-fdcf-40f6-a2a3-a1de562e8db1 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:46.635862 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11c9ce64-fdcf-40f6-a2a3-a1de562e8db1 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:46.636571 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11c9ce64-fdcf-40f6-a2a3-a1de562e8db1 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:46.637567 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11c9ce64-fdcf-40f6-a2a3-a1de562e8db1 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:46.679245 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3bd571cb-4c2c-47fb-928e-791780643b55 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:46.702996 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3bd571cb-4c2c-47fb-928e-791780643b55 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:46.711880 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3bd571cb-4c2c-47fb-928e-791780643b55 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:46.715890 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3bd571cb-4c2c-47fb-928e-791780643b55 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1873 microversion: 2.32 time: 1.124152 Oct 26 13:17:46.720012 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1818/3649] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:17:45 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1873 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:17:46.730513 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a20b825b-a613-440e-bdbd-0ca647c8d720 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:46.730962 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a20b825b-a613-440e-bdbd-0ca647c8d720 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 789a55e0-21ba-4b2e-b8d4-c95999955e2b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:46.788427 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a20b825b-a613-440e-bdbd-0ca647c8d720 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:46.793961 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a20b825b-a613-440e-bdbd-0ca647c8d720 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:46.794525 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a20b825b-a613-440e-bdbd-0ca647c8d720 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:46.797920 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a20b825b-a613-440e-bdbd-0ca647c8d720 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:46.798823 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a20b825b-a613-440e-bdbd-0ca647c8d720 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:46.800149 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a20b825b-a613-440e-bdbd-0ca647c8d720 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:46.844118 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-a20b825b-a613-440e-bdbd-0ca647c8d720 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] HTTP exception thrown: Instance 789a55e0-21ba-4b2e-b8d4-c95999955e2b could not be found. Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a20b825b-a613-440e-bdbd-0ca647c8d720 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Request method failure captured: Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b HTTP/1.1 Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTK8yiFaYn6FsK4kYH1E6E6NSE9_hIaDskjf1tRy-XgeLhCgjcaBIDqmW8VSjfB2Cmb6DMkQzh-y_Wh40jTHlXsuv7XA0N3K6RDEzKD5nf9Z6iWWIgYAqlJtxWSsEOqwe1NAtEPEvPHN4gJ5RH5unfT6e5xSWJOJigX6JmjW0X-SjQA Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 174da5e5c60449b7a04e9cf2aa3b9fda Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-AttachVolumeNegativeTest-770748596 Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/174da5e5c60449b7a04e9cf2aa3b9fda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/174da5e5c60449b7a04e9cf2aa3b9fda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_174da5e5c60449b7a04e9cf2aa3b9fda"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/174da5e5c60449b7a04e9cf2aa3b9fda"}]}] Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-AttachVolumeNegativeTest-770748596 Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 174da5e5c60449b7a04e9cf2aa3b9fda Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-770748596 Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-AttachVolumeNegativeTest-770748596-project Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 168c83cd1b014f82945f4915e3ece079 Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-AttachVolumeNegativeTest-770748596-project Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 789a55e0-21ba-4b2e-b8d4-c95999955e2b could not be found. Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '789a55e0-21ba-4b2e-b8d4-c95999955e2b'} Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 789a55e0-21ba-4b2e-b8d4-c95999955e2b could not be found. Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 789a55e0-21ba-4b2e-b8d4-c95999955e2b could not be found. Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:17:46.848510 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:46.863614 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:17:46.863614 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:17:46.863614 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:17:46.863614 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:17:46.863614 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:17:46.863614 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 789a55e0-21ba-4b2e-b8d4-c95999955e2b could not be found. Oct 26 13:17:46.863614 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:17:46.865882 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a20b825b-a613-440e-bdbd-0ca647c8d720 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Returning 404 to user: Instance 789a55e0-21ba-4b2e-b8d4-c95999955e2b could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:17:46.867306 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a20b825b-a613-440e-bdbd-0ca647c8d720 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b" status: 404 len: 111 microversion: 2.1 time: 0.146476 Oct 26 13:17:46.884724 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1819/3650] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:46 2022] GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:17:46.891664 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c094b16b-9760-4d08-b7d9-3a8292f8d49c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:46.892546 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c094b16b-9760-4d08-b7d9-3a8292f8d49c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:46.899087 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:17:46.902049 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c094b16b-9760-4d08-b7d9-3a8292f8d49c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:46.903088 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c094b16b-9760-4d08-b7d9-3a8292f8d49c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:46.903725 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c094b16b-9760-4d08-b7d9-3a8292f8d49c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:46.904943 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c094b16b-9760-4d08-b7d9-3a8292f8d49c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:46.905694 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c094b16b-9760-4d08-b7d9-3a8292f8d49c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:46.906325 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c094b16b-9760-4d08-b7d9-3a8292f8d49c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:47.103603 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-11c9ce64-fdcf-40f6-a2a3-a1de562e8db1 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:47.119432 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-11c9ce64-fdcf-40f6-a2a3-a1de562e8db1 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1391 microversion: 2.1 time: 0.504813 Oct 26 13:17:47.125415 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1832/3651] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:46 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1391 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:47.136512 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1d5b0b15-c23d-476e-91e5-50e52597acc7 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '.version_select at 0x7f67368f0af0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:47.199402 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1d5b0b15-c23d-476e-91e5-50e52597acc7 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1087581627" status: 202 len: 0 microversion: 2.1 time: 0.072673 Oct 26 13:17:47.208099 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1833/3652] 10.222.0.40 () {58 vars in 1221 bytes} [Wed Oct 26 13:17:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1087581627 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:17:47.643870 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7f71ee27-0ece-413c-9a12-c9339550c123 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Action: 'create', calling method: .version_select at 0x7f6731f65550>, body: {"keypair": {"name": "tempest-keypair-319333818", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkwANskoQ08pAin2B9WCACH86v6H+o5I9kMyCBRUz0wTPo6QfieuJe4r7c6P0ZN3kpCG4rcAKJ26fxJ2rz7thJvv9m14h6Afm84sTum634lgOuG4WGkEzPcWRhcGcHZew=="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:17:47.652182 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c094b16b-9760-4d08-b7d9-3a8292f8d49c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:47.665061 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c094b16b-9760-4d08-b7d9-3a8292f8d49c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1509 microversion: 2.1 time: 0.778221 Oct 26 13:17:47.666396 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1820/3653] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:46 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1509 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:47.672711 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e7ea7a3a-c2fe-4ea2-9eb8-0604f204dea9 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:47.673757 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e7ea7a3a-c2fe-4ea2-9eb8-0604f204dea9 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: b29a1a98-a428-4967-bc4a-237971dcd264] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:47.686706 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-7f71ee27-0ece-413c-9a12-c9339550c123 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Getting quotas for project e1f158446a544e5680969f4ef7512e49. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:17:47.689409 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e7ea7a3a-c2fe-4ea2-9eb8-0604f204dea9 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:47.690979 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e7ea7a3a-c2fe-4ea2-9eb8-0604f204dea9 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:47.692376 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e7ea7a3a-c2fe-4ea2-9eb8-0604f204dea9 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:47.693844 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e7ea7a3a-c2fe-4ea2-9eb8-0604f204dea9 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:47.695259 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e7ea7a3a-c2fe-4ea2-9eb8-0604f204dea9 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:47.697048 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e7ea7a3a-c2fe-4ea2-9eb8-0604f204dea9 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:47.723156 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-7f71ee27-0ece-413c-9a12-c9339550c123 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Getting quotas for user 0b457ab0af5e41b1a1e10290b67656a7 and project e1f158446a544e5680969f4ef7512e49. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:17:47.804885 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:17:47.844119 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7f71ee27-0ece-413c-9a12-c9339550c123 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.314341 Oct 26 13:17:47.862433 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1834/3654] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 13:17:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:17:47.879574 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b91aeee2-f921-46c8-b3b0-0f2229334993 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:47.880627 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b91aeee2-f921-46c8-b3b0-0f2229334993 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:47.893006 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b91aeee2-f921-46c8-b3b0-0f2229334993 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:47.893926 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b91aeee2-f921-46c8-b3b0-0f2229334993 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:47.894603 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b91aeee2-f921-46c8-b3b0-0f2229334993 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:47.895521 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b91aeee2-f921-46c8-b3b0-0f2229334993 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:47.896146 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b91aeee2-f921-46c8-b3b0-0f2229334993 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:47.897129 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b91aeee2-f921-46c8-b3b0-0f2229334993 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:48.365646 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e7ea7a3a-c2fe-4ea2-9eb8-0604f204dea9 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:48.393855 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e7ea7a3a-c2fe-4ea2-9eb8-0604f204dea9 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264" status: 200 len: 1507 microversion: 2.1 time: 0.723095 Oct 26 13:17:48.419395 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1821/3655] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:47 2022] GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264 => generated 1507 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:48.424706 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-20f5de74-444f-42d3-b287-5628a5a7b1dc tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:48.425664 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-20f5de74-444f-42d3-b287-5628a5a7b1dc tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:48.432938 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20f5de74-444f-42d3-b287-5628a5a7b1dc tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:48.433895 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20f5de74-444f-42d3-b287-5628a5a7b1dc tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:48.434562 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20f5de74-444f-42d3-b287-5628a5a7b1dc tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:48.435527 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20f5de74-444f-42d3-b287-5628a5a7b1dc tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:48.436208 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20f5de74-444f-42d3-b287-5628a5a7b1dc tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:48.436862 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20f5de74-444f-42d3-b287-5628a5a7b1dc tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:48.477308 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b91aeee2-f921-46c8-b3b0-0f2229334993 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:48.494365 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b91aeee2-f921-46c8-b3b0-0f2229334993 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:48.496075 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b91aeee2-f921-46c8-b3b0-0f2229334993 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:48.508486 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b91aeee2-f921-46c8-b3b0-0f2229334993 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1873 microversion: 2.32 time: 0.640653 Oct 26 13:17:48.509941 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1835/3656] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:17:47 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1873 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:17:48.700268 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6b705a6b-143f-445d-97e2-b39e386fcf01 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:48.706444 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6b705a6b-143f-445d-97e2-b39e386fcf01 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:48.743545 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6b705a6b-143f-445d-97e2-b39e386fcf01 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:48.756265 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6b705a6b-143f-445d-97e2-b39e386fcf01 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:48.761931 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6b705a6b-143f-445d-97e2-b39e386fcf01 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:48.763368 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6b705a6b-143f-445d-97e2-b39e386fcf01 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:48.766948 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6b705a6b-143f-445d-97e2-b39e386fcf01 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:48.768612 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6b705a6b-143f-445d-97e2-b39e386fcf01 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:48.784638 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-20f5de74-444f-42d3-b287-5628a5a7b1dc tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:48.797245 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-20f5de74-444f-42d3-b287-5628a5a7b1dc tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1391 microversion: 2.1 time: 0.375938 Oct 26 13:17:48.798097 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1822/3657] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:48 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1391 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:49.088651 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d4b7af28-304c-4409-a648-111ebad771dc tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Action: 'create', calling method: .version_select at 0x7f67320be670>, body: {"keypair": {"name": "tempest-keypair-1358652336", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPD4ZdEiZdnBxCPKfWFPng9qo+AnxDVt2Ay6k+IPYRESHo9oOF02OWpkR1qXWGaK0VCCJa4s4xbPL+w+tVaprWghbwox5ApZqYfg0xDPvqmOh/ZKZex3dEY1xTUHao3ng=="}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:17:49.117550 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6b705a6b-143f-445d-97e2-b39e386fcf01 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:49.131722 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6b705a6b-143f-445d-97e2-b39e386fcf01 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1509 microversion: 2.1 time: 0.439907 Oct 26 13:17:49.132288 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-d4b7af28-304c-4409-a648-111ebad771dc tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Getting quotas for project 174da5e5c60449b7a04e9cf2aa3b9fda. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:17:49.132460 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1836/3658] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:48 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1509 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:17:49.162982 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-d4b7af28-304c-4409-a648-111ebad771dc tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Getting quotas for user 168c83cd1b014f82945f4915e3ece079 and project 174da5e5c60449b7a04e9cf2aa3b9fda. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:17:49.218390 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d4b7af28-304c-4409-a648-111ebad771dc tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.135313 Oct 26 13:17:49.220065 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1823/3659] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 13:17:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:17:49.428163 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9d0d9b67-ea28-4fb9-9cf8-b87cb2ee3ce1 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:49.429409 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9d0d9b67-ea28-4fb9-9cf8-b87cb2ee3ce1 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: b29a1a98-a428-4967-bc4a-237971dcd264] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:49.444846 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d0d9b67-ea28-4fb9-9cf8-b87cb2ee3ce1 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:49.445775 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d0d9b67-ea28-4fb9-9cf8-b87cb2ee3ce1 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:49.448710 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d0d9b67-ea28-4fb9-9cf8-b87cb2ee3ce1 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:49.450033 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d0d9b67-ea28-4fb9-9cf8-b87cb2ee3ce1 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:49.453317 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d0d9b67-ea28-4fb9-9cf8-b87cb2ee3ce1 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:49.454118 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d0d9b67-ea28-4fb9-9cf8-b87cb2ee3ce1 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:49.539360 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9bac1e77-eb56-45c6-8e5f-1312b536a783 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:49.540136 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9bac1e77-eb56-45c6-8e5f-1312b536a783 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:49.549763 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9bac1e77-eb56-45c6-8e5f-1312b536a783 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:49.558345 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9bac1e77-eb56-45c6-8e5f-1312b536a783 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:49.559233 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9bac1e77-eb56-45c6-8e5f-1312b536a783 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:49.560256 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9bac1e77-eb56-45c6-8e5f-1312b536a783 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:49.560705 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9bac1e77-eb56-45c6-8e5f-1312b536a783 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:49.561218 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9bac1e77-eb56-45c6-8e5f-1312b536a783 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:49.570033 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:17:49.747782 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9d0d9b67-ea28-4fb9-9cf8-b87cb2ee3ce1 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:49.751623 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:17:49.770038 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9d0d9b67-ea28-4fb9-9cf8-b87cb2ee3ce1 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264" status: 200 len: 1507 microversion: 2.1 time: 0.347159 Oct 26 13:17:49.772156 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1837/3660] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:49 2022] GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264 => generated 1507 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:49.830902 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3bef1c61-ab4c-446d-af2d-4de6bb5981df tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:49.832040 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3bef1c61-ab4c-446d-af2d-4de6bb5981df tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:49.856805 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bef1c61-ab4c-446d-af2d-4de6bb5981df tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:49.859837 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bef1c61-ab4c-446d-af2d-4de6bb5981df tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:49.860818 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bef1c61-ab4c-446d-af2d-4de6bb5981df tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:49.864729 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bef1c61-ab4c-446d-af2d-4de6bb5981df tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:49.865527 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bef1c61-ab4c-446d-af2d-4de6bb5981df tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:49.866872 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bef1c61-ab4c-446d-af2d-4de6bb5981df tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:50.085707 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9bac1e77-eb56-45c6-8e5f-1312b536a783 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:50.105270 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9bac1e77-eb56-45c6-8e5f-1312b536a783 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:50.107757 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9bac1e77-eb56-45c6-8e5f-1312b536a783 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:50.112725 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9bac1e77-eb56-45c6-8e5f-1312b536a783 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1873 microversion: 2.32 time: 0.576312 Oct 26 13:17:50.114852 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1824/3661] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:17:49 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1873 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:17:50.164134 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a50f2227-1696-4733-a95e-f3d7cd62cf99 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:50.166898 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a50f2227-1696-4733-a95e-f3d7cd62cf99 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:50.177101 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a50f2227-1696-4733-a95e-f3d7cd62cf99 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:50.177950 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a50f2227-1696-4733-a95e-f3d7cd62cf99 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:50.178773 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a50f2227-1696-4733-a95e-f3d7cd62cf99 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:50.179941 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a50f2227-1696-4733-a95e-f3d7cd62cf99 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:50.181330 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a50f2227-1696-4733-a95e-f3d7cd62cf99 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:50.182219 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a50f2227-1696-4733-a95e-f3d7cd62cf99 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:50.210277 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3bef1c61-ab4c-446d-af2d-4de6bb5981df tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:50.224791 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3bef1c61-ab4c-446d-af2d-4de6bb5981df tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1391 microversion: 2.1 time: 0.406930 Oct 26 13:17:50.228836 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1838/3662] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:49 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1391 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:50.523857 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a50f2227-1696-4733-a95e-f3d7cd62cf99 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:50.532779 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a50f2227-1696-4733-a95e-f3d7cd62cf99 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1509 microversion: 2.1 time: 0.373807 Oct 26 13:17:50.550312 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1825/3663] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:50 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1509 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:50.800465 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bf7c988f-7561-4411-b467-4d03f7ce860c tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:50.802576 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bf7c988f-7561-4411-b467-4d03f7ce860c tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: b29a1a98-a428-4967-bc4a-237971dcd264] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:50.814390 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bf7c988f-7561-4411-b467-4d03f7ce860c tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:50.815150 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bf7c988f-7561-4411-b467-4d03f7ce860c tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:50.815827 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bf7c988f-7561-4411-b467-4d03f7ce860c tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:50.816865 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bf7c988f-7561-4411-b467-4d03f7ce860c tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:50.817723 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bf7c988f-7561-4411-b467-4d03f7ce860c tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:50.818620 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bf7c988f-7561-4411-b467-4d03f7ce860c tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:51.148075 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-194f99ec-3033-4234-aa9d-6855a17ebe8e tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:51.150081 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-194f99ec-3033-4234-aa9d-6855a17ebe8e tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:51.160382 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bf7c988f-7561-4411-b467-4d03f7ce860c tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:51.160957 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-194f99ec-3033-4234-aa9d-6855a17ebe8e tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:51.161461 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-194f99ec-3033-4234-aa9d-6855a17ebe8e tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:51.161969 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-194f99ec-3033-4234-aa9d-6855a17ebe8e tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:51.162767 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-194f99ec-3033-4234-aa9d-6855a17ebe8e tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:51.163243 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-194f99ec-3033-4234-aa9d-6855a17ebe8e tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:51.163674 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-194f99ec-3033-4234-aa9d-6855a17ebe8e tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:51.184117 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bf7c988f-7561-4411-b467-4d03f7ce860c tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264" status: 200 len: 1507 microversion: 2.1 time: 0.389274 Oct 26 13:17:51.185185 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1839/3664] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:50 2022] GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264 => generated 1507 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:17:51.231648 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-21e0f865-ca22-4c83-a818-7d5560f4e9be tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1410482240", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6564d3ba-587e-4d4c-8bc6-474830ea64a0"}], "security_groups": [{"name": "tempest-securitygroup--261874718"}], "key_name": "tempest-keypair-319333818", "user_data": "}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:17:51.405953 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-21e0f865-ca22-4c83-a818-7d5560f4e9be tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] validate_networks() for [('6564d3ba-587e-4d4c-8bc6-474830ea64a0', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:17:51.444944 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-194f99ec-3033-4234-aa9d-6855a17ebe8e tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:51.460572 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-194f99ec-3033-4234-aa9d-6855a17ebe8e tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:51.463633 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-194f99ec-3033-4234-aa9d-6855a17ebe8e tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:51.465398 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-194f99ec-3033-4234-aa9d-6855a17ebe8e tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1873 microversion: 2.32 time: 0.327876 Oct 26 13:17:51.479038 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1826/3665] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:17:51 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1873 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:17:51.497317 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-795c6592-5ed5-4a53-98ee-a869e5fda8fa tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:51.498330 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-795c6592-5ed5-4a53-98ee-a869e5fda8fa tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:51.506859 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-795c6592-5ed5-4a53-98ee-a869e5fda8fa tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:51.507934 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-795c6592-5ed5-4a53-98ee-a869e5fda8fa tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:51.509214 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-795c6592-5ed5-4a53-98ee-a869e5fda8fa tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:51.510232 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-795c6592-5ed5-4a53-98ee-a869e5fda8fa tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:51.510863 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-795c6592-5ed5-4a53-98ee-a869e5fda8fa tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:51.511955 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-795c6592-5ed5-4a53-98ee-a869e5fda8fa tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:51.853184 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-795c6592-5ed5-4a53-98ee-a869e5fda8fa tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:51.870953 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-795c6592-5ed5-4a53-98ee-a869e5fda8fa tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1391 microversion: 2.1 time: 0.381598 Oct 26 13:17:51.872628 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1827/3666] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:51 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1391 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:51.878102 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-aae95d2a-5c95-45e3-8583-4d2e51f40774 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:51.879491 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-aae95d2a-5c95-45e3-8583-4d2e51f40774 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:51.887980 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aae95d2a-5c95-45e3-8583-4d2e51f40774 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:51.888801 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aae95d2a-5c95-45e3-8583-4d2e51f40774 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:51.889613 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aae95d2a-5c95-45e3-8583-4d2e51f40774 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:51.890741 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aae95d2a-5c95-45e3-8583-4d2e51f40774 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:51.891411 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aae95d2a-5c95-45e3-8583-4d2e51f40774 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:51.892076 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aae95d2a-5c95-45e3-8583-4d2e51f40774 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:52.176955 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-aae95d2a-5c95-45e3-8583-4d2e51f40774 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:52.220778 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-aae95d2a-5c95-45e3-8583-4d2e51f40774 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1509 microversion: 2.1 time: 0.344608 Oct 26 13:17:52.222633 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1828/3667] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:51 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1509 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:52.256309 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-30d4f21f-304f-4694-9abc-a1f58a8e6228 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:52.257839 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-30d4f21f-304f-4694-9abc-a1f58a8e6228 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: b29a1a98-a428-4967-bc4a-237971dcd264] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:52.266059 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-30d4f21f-304f-4694-9abc-a1f58a8e6228 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:52.266591 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-30d4f21f-304f-4694-9abc-a1f58a8e6228 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:52.267192 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-30d4f21f-304f-4694-9abc-a1f58a8e6228 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:52.269151 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-30d4f21f-304f-4694-9abc-a1f58a8e6228 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:52.269925 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-30d4f21f-304f-4694-9abc-a1f58a8e6228 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:52.271225 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-30d4f21f-304f-4694-9abc-a1f58a8e6228 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:52.563494 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-21e0f865-ca22-4c83-a818-7d5560f4e9be tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:17:52.563939 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-21e0f865-ca22-4c83-a818-7d5560f4e9be tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:17:52.565781 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-21e0f865-ca22-4c83-a818-7d5560f4e9be tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:17:52.566272 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-21e0f865-ca22-4c83-a818-7d5560f4e9be tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:17:52.566706 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-21e0f865-ca22-4c83-a818-7d5560f4e9be tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:17:52.577565 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-21e0f865-ca22-4c83-a818-7d5560f4e9be tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:52.578412 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-21e0f865-ca22-4c83-a818-7d5560f4e9be tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:52.578851 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-21e0f865-ca22-4c83-a818-7d5560f4e9be tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:52.579575 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-21e0f865-ca22-4c83-a818-7d5560f4e9be tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:52.580031 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-21e0f865-ca22-4c83-a818-7d5560f4e9be tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:52.580455 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-21e0f865-ca22-4c83-a818-7d5560f4e9be tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:52.601699 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-21e0f865-ca22-4c83-a818-7d5560f4e9be tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Getting quotas for project e1f158446a544e5680969f4ef7512e49. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:17:52.609002 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-21e0f865-ca22-4c83-a818-7d5560f4e9be tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Getting quotas for user 0b457ab0af5e41b1a1e10290b67656a7 and project e1f158446a544e5680969f4ef7512e49. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:17:52.624128 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-21e0f865-ca22-4c83-a818-7d5560f4e9be tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:17:52.626484 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-21e0f865-ca22-4c83-a818-7d5560f4e9be tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:17:52.678680 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-21e0f865-ca22-4c83-a818-7d5560f4e9be tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.451366 Oct 26 13:17:52.680168 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1840/3668] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:17:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 1453 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:17:52.686521 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-27246a87-3ec8-4202-9a3c-3e9f1d1dc05c tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2017324092", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6fd403f3-cdf4-4a71-b3b7-5fccfc8063f7"}], "security_groups": [{"name": "tempest-securitygroup--840169498"}], "key_name": "tempest-keypair-1358652336", "user_data": "}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:17:52.786033 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-30d4f21f-304f-4694-9abc-a1f58a8e6228 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:52.800760 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-30d4f21f-304f-4694-9abc-a1f58a8e6228 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264" status: 200 len: 1487 microversion: 2.1 time: 0.574905 Oct 26 13:17:52.801474 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1829/3669] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:52 2022] GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264 => generated 1487 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:52.806867 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f44201fc-f28b-4ff7-a9d4-6347251e1f75 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:52.813177 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f44201fc-f28b-4ff7-a9d4-6347251e1f75 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:52.832479 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f44201fc-f28b-4ff7-a9d4-6347251e1f75 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:52.834239 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f44201fc-f28b-4ff7-a9d4-6347251e1f75 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:52.834850 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f44201fc-f28b-4ff7-a9d4-6347251e1f75 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:52.835559 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-27246a87-3ec8-4202-9a3c-3e9f1d1dc05c tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] validate_networks() for [('6fd403f3-cdf4-4a71-b3b7-5fccfc8063f7', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:17:52.836547 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f44201fc-f28b-4ff7-a9d4-6347251e1f75 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:52.837309 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f44201fc-f28b-4ff7-a9d4-6347251e1f75 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:52.838624 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f44201fc-f28b-4ff7-a9d4-6347251e1f75 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:53.154269 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f44201fc-f28b-4ff7-a9d4-6347251e1f75 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:53.180083 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f44201fc-f28b-4ff7-a9d4-6347251e1f75 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:53.191769 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f44201fc-f28b-4ff7-a9d4-6347251e1f75 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:53.196561 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f44201fc-f28b-4ff7-a9d4-6347251e1f75 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1873 microversion: 2.32 time: 0.392509 Oct 26 13:17:53.199042 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1830/3670] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:17:52 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1873 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:17:53.210950 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6bdb0bcf-c9ae-4ea3-b342-b4edc8ad9349 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:53.213831 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6bdb0bcf-c9ae-4ea3-b342-b4edc8ad9349 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:53.352458 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6bdb0bcf-c9ae-4ea3-b342-b4edc8ad9349 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:53.365420 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6bdb0bcf-c9ae-4ea3-b342-b4edc8ad9349 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c" status: 200 len: 1237 microversion: 2.1 time: 0.164732 Oct 26 13:17:53.385001 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1831/3671] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:53 2022] GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c => generated 1237 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:53.391236 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d509a114-3a10-4f30-a939-58d4caea8911 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:53.392234 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d509a114-3a10-4f30-a939-58d4caea8911 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:53.400752 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d509a114-3a10-4f30-a939-58d4caea8911 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:53.401609 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d509a114-3a10-4f30-a939-58d4caea8911 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:53.403000 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d509a114-3a10-4f30-a939-58d4caea8911 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:53.404019 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d509a114-3a10-4f30-a939-58d4caea8911 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:53.404981 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d509a114-3a10-4f30-a939-58d4caea8911 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:53.405796 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d509a114-3a10-4f30-a939-58d4caea8911 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:53.771314 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d509a114-3a10-4f30-a939-58d4caea8911 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:53.784922 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d509a114-3a10-4f30-a939-58d4caea8911 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1391 microversion: 2.1 time: 0.398554 Oct 26 13:17:53.789798 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1832/3672] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:53 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1391 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:53.801970 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8f9603d7-8f69-45aa-888f-6dda3fedb340 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-459752766", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:17:53.927888 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-8f9603d7-8f69-45aa-888f-6dda3fedb340 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] validate_networks() for [('2ceab633-30cd-49f2-a9d6-d02f524955d7', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:17:53.931307 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-27246a87-3ec8-4202-9a3c-3e9f1d1dc05c tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:17:53.931825 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-27246a87-3ec8-4202-9a3c-3e9f1d1dc05c tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:17:53.932353 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-27246a87-3ec8-4202-9a3c-3e9f1d1dc05c tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:17:53.932768 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-27246a87-3ec8-4202-9a3c-3e9f1d1dc05c tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:17:53.933180 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-27246a87-3ec8-4202-9a3c-3e9f1d1dc05c tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:17:53.955862 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-27246a87-3ec8-4202-9a3c-3e9f1d1dc05c tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:53.956606 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-27246a87-3ec8-4202-9a3c-3e9f1d1dc05c tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:53.957337 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-27246a87-3ec8-4202-9a3c-3e9f1d1dc05c tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:53.958411 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-27246a87-3ec8-4202-9a3c-3e9f1d1dc05c tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:53.959095 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-27246a87-3ec8-4202-9a3c-3e9f1d1dc05c tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:53.959752 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-27246a87-3ec8-4202-9a3c-3e9f1d1dc05c tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:53.981014 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-27246a87-3ec8-4202-9a3c-3e9f1d1dc05c tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Getting quotas for project 174da5e5c60449b7a04e9cf2aa3b9fda. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:17:53.987115 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-27246a87-3ec8-4202-9a3c-3e9f1d1dc05c tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Getting quotas for user 168c83cd1b014f82945f4915e3ece079 and project 174da5e5c60449b7a04e9cf2aa3b9fda. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:17:54.021001 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-27246a87-3ec8-4202-9a3c-3e9f1d1dc05c tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:17:54.029335 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-27246a87-3ec8-4202-9a3c-3e9f1d1dc05c tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:17:54.158215 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-27246a87-3ec8-4202-9a3c-3e9f1d1dc05c tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.474975 Oct 26 13:17:54.167415 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1841/3673] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:17:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 1486 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:17:54.180426 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9e015cb1-9c51-4eb5-aba0-def3d25c89c3 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:54.181562 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9e015cb1-9c51-4eb5-aba0-def3d25c89c3 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:54.199788 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e015cb1-9c51-4eb5-aba0-def3d25c89c3 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:54.200872 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e015cb1-9c51-4eb5-aba0-def3d25c89c3 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:54.201529 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e015cb1-9c51-4eb5-aba0-def3d25c89c3 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:54.202416 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e015cb1-9c51-4eb5-aba0-def3d25c89c3 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:54.203051 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e015cb1-9c51-4eb5-aba0-def3d25c89c3 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:54.203645 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e015cb1-9c51-4eb5-aba0-def3d25c89c3 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:54.580085 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9e015cb1-9c51-4eb5-aba0-def3d25c89c3 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:54.590204 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9e015cb1-9c51-4eb5-aba0-def3d25c89c3 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1509 microversion: 2.1 time: 0.420450 Oct 26 13:17:54.590806 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1842/3674] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:54 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1509 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:54.610350 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e4883806-bbbf-4be4-b787-8011914a1201 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:54.613526 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e4883806-bbbf-4be4-b787-8011914a1201 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:54.795538 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e4883806-bbbf-4be4-b787-8011914a1201 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:54.805522 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e4883806-bbbf-4be4-b787-8011914a1201 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9" status: 200 len: 1242 microversion: 2.1 time: 0.209733 Oct 26 13:17:54.806586 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1843/3675] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:54 2022] GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 => generated 1242 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:54.812343 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b1f93012-5a4d-44e2-aac9-c8140673daea tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:54.826018 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b1f93012-5a4d-44e2-aac9-c8140673daea tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:54.866878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1f93012-5a4d-44e2-aac9-c8140673daea tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:54.867379 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1f93012-5a4d-44e2-aac9-c8140673daea tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:54.868553 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1f93012-5a4d-44e2-aac9-c8140673daea tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:54.869354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1f93012-5a4d-44e2-aac9-c8140673daea tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:54.873703 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1f93012-5a4d-44e2-aac9-c8140673daea tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:54.874487 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1f93012-5a4d-44e2-aac9-c8140673daea tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:55.497621 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b1f93012-5a4d-44e2-aac9-c8140673daea tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:55.517130 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b1f93012-5a4d-44e2-aac9-c8140673daea tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:55.519382 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b1f93012-5a4d-44e2-aac9-c8140673daea tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:55.524597 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b1f93012-5a4d-44e2-aac9-c8140673daea tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1873 microversion: 2.32 time: 0.713804 Oct 26 13:17:55.525454 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1844/3676] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:17:54 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1873 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:17:55.546552 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-dbdc4d38-cdeb-418c-8144-ee4540b8d385 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:55.548196 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-dbdc4d38-cdeb-418c-8144-ee4540b8d385 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:55.556676 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dbdc4d38-cdeb-418c-8144-ee4540b8d385 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:55.567497 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dbdc4d38-cdeb-418c-8144-ee4540b8d385 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:55.569495 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dbdc4d38-cdeb-418c-8144-ee4540b8d385 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:55.570408 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dbdc4d38-cdeb-418c-8144-ee4540b8d385 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:55.573160 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dbdc4d38-cdeb-418c-8144-ee4540b8d385 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:55.573649 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dbdc4d38-cdeb-418c-8144-ee4540b8d385 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:55.715298 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-dbdc4d38-cdeb-418c-8144-ee4540b8d385 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:55.733113 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-8f9603d7-8f69-45aa-888f-6dda3fedb340 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:17:55.733717 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-8f9603d7-8f69-45aa-888f-6dda3fedb340 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:17:55.734272 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-8f9603d7-8f69-45aa-888f-6dda3fedb340 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:17:55.734735 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-8f9603d7-8f69-45aa-888f-6dda3fedb340 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:17:55.735149 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-8f9603d7-8f69-45aa-888f-6dda3fedb340 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:17:55.741510 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-dbdc4d38-cdeb-418c-8144-ee4540b8d385 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c" status: 200 len: 1295 microversion: 2.1 time: 0.210396 Oct 26 13:17:55.744981 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1845/3677] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:55 2022] GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c => generated 1295 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:55.751477 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8f9603d7-8f69-45aa-888f-6dda3fedb340 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:55.752592 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-61090068-ad49-46c8-8567-110aad3d4244 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:55.753298 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8f9603d7-8f69-45aa-888f-6dda3fedb340 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:55.753772 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-61090068-ad49-46c8-8567-110aad3d4244 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:55.754404 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8f9603d7-8f69-45aa-888f-6dda3fedb340 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:55.756730 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8f9603d7-8f69-45aa-888f-6dda3fedb340 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:55.761216 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8f9603d7-8f69-45aa-888f-6dda3fedb340 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:55.761934 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8f9603d7-8f69-45aa-888f-6dda3fedb340 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:55.775912 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-61090068-ad49-46c8-8567-110aad3d4244 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:55.777252 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-61090068-ad49-46c8-8567-110aad3d4244 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:55.778367 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-61090068-ad49-46c8-8567-110aad3d4244 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:55.779889 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-61090068-ad49-46c8-8567-110aad3d4244 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:55.781023 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-61090068-ad49-46c8-8567-110aad3d4244 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:55.781779 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-61090068-ad49-46c8-8567-110aad3d4244 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:55.794016 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-8f9603d7-8f69-45aa-888f-6dda3fedb340 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Getting quotas for project 99b33dc51c4e489ea14f20bc582aa259. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:17:55.802753 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-8f9603d7-8f69-45aa-888f-6dda3fedb340 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Getting quotas for user f35fb6e657dd4799b6928ffb97b24c2d and project 99b33dc51c4e489ea14f20bc582aa259. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:17:55.857750 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8f9603d7-8f69-45aa-888f-6dda3fedb340 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:17:55.862800 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8f9603d7-8f69-45aa-888f-6dda3fedb340 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:17:56.012993 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8f9603d7-8f69-45aa-888f-6dda3fedb340 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.219115 Oct 26 13:17:56.018851 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1833/3678] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:17:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 2229 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:17:56.036283 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-1dc5c14f-5b82-4d43-8df6-c474041bcd8b req-2ee67578-a794-41ff-855c-5e96a53e017e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7743d90-f9dc-4601-a6d3-a4901bf9cc05", "name": "network-vif-unplugged", "status": "completed", "tag": "cd05a893-6fb7-45ab-985e-5e98b6a0306b"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:17:56.074794 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-1dc5c14f-5b82-4d43-8df6-c474041bcd8b req-2ee67578-a794-41ff-855c-5e96a53e017e service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:56.075305 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-1dc5c14f-5b82-4d43-8df6-c474041bcd8b req-2ee67578-a794-41ff-855c-5e96a53e017e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:56.083352 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-1dc5c14f-5b82-4d43-8df6-c474041bcd8b req-2ee67578-a794-41ff-855c-5e96a53e017e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:56.123440 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-1dc5c14f-5b82-4d43-8df6-c474041bcd8b req-2ee67578-a794-41ff-855c-5e96a53e017e service nova] Creating event network-vif-unplugged:cd05a893-6fb7-45ab-985e-5e98b6a0306b for instance b7743d90-f9dc-4601-a6d3-a4901bf9cc05 on n-h2-862686-1 Oct 26 13:17:56.135713 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-1dc5c14f-5b82-4d43-8df6-c474041bcd8b req-2ee67578-a794-41ff-855c-5e96a53e017e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114763 Oct 26 13:17:56.138380 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1834/3679] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:17:56.155224 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5a65f136-e327-42c1-99c0-ac086aacac90 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:56.156780 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5a65f136-e327-42c1-99c0-ac086aacac90 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:56.166468 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5a65f136-e327-42c1-99c0-ac086aacac90 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:56.173832 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5a65f136-e327-42c1-99c0-ac086aacac90 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:56.174931 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5a65f136-e327-42c1-99c0-ac086aacac90 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:56.176184 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5a65f136-e327-42c1-99c0-ac086aacac90 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:56.176944 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5a65f136-e327-42c1-99c0-ac086aacac90 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:56.177641 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5a65f136-e327-42c1-99c0-ac086aacac90 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:56.255885 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-61090068-ad49-46c8-8567-110aad3d4244 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:56.276341 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-61090068-ad49-46c8-8567-110aad3d4244 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1391 microversion: 2.1 time: 0.526049 Oct 26 13:17:56.293516 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1846/3680] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:55 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1391 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:56.304147 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-14dc821c-7ab3-451c-adb4-8e3127181dda tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:56.306010 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-14dc821c-7ab3-451c-adb4-8e3127181dda tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:56.323179 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-14dc821c-7ab3-451c-adb4-8e3127181dda tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:56.324554 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-14dc821c-7ab3-451c-adb4-8e3127181dda tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:56.325558 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-14dc821c-7ab3-451c-adb4-8e3127181dda tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:56.327904 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-14dc821c-7ab3-451c-adb4-8e3127181dda tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:56.330419 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-14dc821c-7ab3-451c-adb4-8e3127181dda tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:56.332953 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-14dc821c-7ab3-451c-adb4-8e3127181dda tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:56.560327 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-14dc821c-7ab3-451c-adb4-8e3127181dda tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:56.569272 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-14dc821c-7ab3-451c-adb4-8e3127181dda tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9" status: 200 len: 1302 microversion: 2.1 time: 0.288212 Oct 26 13:17:56.573191 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1847/3681] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:56 2022] GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 => generated 1302 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:56.586122 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9068d300-8a38-43c5-a202-631249b0b66b tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:56.587642 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9068d300-8a38-43c5-a202-631249b0b66b tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:56.709342 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9068d300-8a38-43c5-a202-631249b0b66b tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:56.717037 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9068d300-8a38-43c5-a202-631249b0b66b tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6" status: 200 len: 1213 microversion: 2.1 time: 0.142475 Oct 26 13:17:56.717665 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1848/3682] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:56 2022] GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 => generated 1213 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:56.734106 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6ee7ef85-488b-4d0e-b7ac-8119138908cf tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:56.734890 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6ee7ef85-488b-4d0e-b7ac-8119138908cf tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:56.752359 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ee7ef85-488b-4d0e-b7ac-8119138908cf tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:56.755692 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ee7ef85-488b-4d0e-b7ac-8119138908cf tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:56.756357 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ee7ef85-488b-4d0e-b7ac-8119138908cf tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:56.757442 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ee7ef85-488b-4d0e-b7ac-8119138908cf tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:56.758957 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ee7ef85-488b-4d0e-b7ac-8119138908cf tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:56.762101 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ee7ef85-488b-4d0e-b7ac-8119138908cf tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:56.899624 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5a65f136-e327-42c1-99c0-ac086aacac90 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:56.915837 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5a65f136-e327-42c1-99c0-ac086aacac90 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1509 microversion: 2.1 time: 0.774324 Oct 26 13:17:56.919101 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1835/3683] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:56 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1509 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:56.934315 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-48de2dec-a27f-4114-b76e-e6555e2f7a32 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:56.935371 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-48de2dec-a27f-4114-b76e-e6555e2f7a32 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:56.950118 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-48de2dec-a27f-4114-b76e-e6555e2f7a32 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:56.951980 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-48de2dec-a27f-4114-b76e-e6555e2f7a32 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:56.953770 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-48de2dec-a27f-4114-b76e-e6555e2f7a32 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:56.956427 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-48de2dec-a27f-4114-b76e-e6555e2f7a32 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:56.957973 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-48de2dec-a27f-4114-b76e-e6555e2f7a32 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:56.959753 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-48de2dec-a27f-4114-b76e-e6555e2f7a32 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:57.395120 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6ee7ef85-488b-4d0e-b7ac-8119138908cf tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:57.410763 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6ee7ef85-488b-4d0e-b7ac-8119138908cf tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:57.412046 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6ee7ef85-488b-4d0e-b7ac-8119138908cf tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:57.413242 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6ee7ef85-488b-4d0e-b7ac-8119138908cf tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1873 microversion: 2.32 time: 0.694631 Oct 26 13:17:57.433876 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1849/3684] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:17:56 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1873 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:17:57.455161 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5418c334-8b57-47bf-b499-2b98e95235e4 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:57.456056 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5418c334-8b57-47bf-b499-2b98e95235e4 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:57.463828 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5418c334-8b57-47bf-b499-2b98e95235e4 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:57.464329 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5418c334-8b57-47bf-b499-2b98e95235e4 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:57.464775 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5418c334-8b57-47bf-b499-2b98e95235e4 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:57.465501 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5418c334-8b57-47bf-b499-2b98e95235e4 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:57.467738 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5418c334-8b57-47bf-b499-2b98e95235e4 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:57.468456 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5418c334-8b57-47bf-b499-2b98e95235e4 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:57.763691 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5418c334-8b57-47bf-b499-2b98e95235e4 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:57.775477 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5418c334-8b57-47bf-b499-2b98e95235e4 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1391 microversion: 2.1 time: 0.340078 Oct 26 13:17:57.777430 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1850/3685] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:57 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1391 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:57.784955 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-84f1d25f-6b0f-4778-b4a4-b946bc459c53 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:57.790983 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-84f1d25f-6b0f-4778-b4a4-b946bc459c53 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:57.806699 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84f1d25f-6b0f-4778-b4a4-b946bc459c53 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:57.813236 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84f1d25f-6b0f-4778-b4a4-b946bc459c53 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:57.819790 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84f1d25f-6b0f-4778-b4a4-b946bc459c53 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:57.823799 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84f1d25f-6b0f-4778-b4a4-b946bc459c53 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:57.824659 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84f1d25f-6b0f-4778-b4a4-b946bc459c53 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:57.825183 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84f1d25f-6b0f-4778-b4a4-b946bc459c53 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:57.931847 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-84f1d25f-6b0f-4778-b4a4-b946bc459c53 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:57.942334 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-84f1d25f-6b0f-4778-b4a4-b946bc459c53 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9" status: 200 len: 1300 microversion: 2.1 time: 0.160045 Oct 26 13:17:57.944323 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1851/3686] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:57 2022] GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 => generated 1300 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:57.957031 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-01d10c4e-dbdb-409e-8928-c06b45988dbb req-b2ef5f10-a723-4c67-b79a-f7b6651e7b7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "893420b7-27d9-4240-8182-87dd3231cbe2", "name": "network-vif-plugged", "status": "completed", "tag": "5767d9fc-18c2-418f-b31e-29c55d94a15e"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:17:58.004034 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-01d10c4e-dbdb-409e-8928-c06b45988dbb req-b2ef5f10-a723-4c67-b79a-f7b6651e7b7c service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:58.004956 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-01d10c4e-dbdb-409e-8928-c06b45988dbb req-b2ef5f10-a723-4c67-b79a-f7b6651e7b7c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:58.007268 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-01d10c4e-dbdb-409e-8928-c06b45988dbb req-b2ef5f10-a723-4c67-b79a-f7b6651e7b7c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:58.034198 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-01d10c4e-dbdb-409e-8928-c06b45988dbb req-b2ef5f10-a723-4c67-b79a-f7b6651e7b7c service nova] Creating event network-vif-plugged:5767d9fc-18c2-418f-b31e-29c55d94a15e for instance 893420b7-27d9-4240-8182-87dd3231cbe2 on n-h1-862686-1 Oct 26 13:17:58.056273 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-01d10c4e-dbdb-409e-8928-c06b45988dbb req-b2ef5f10-a723-4c67-b79a-f7b6651e7b7c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106231 Oct 26 13:17:58.058044 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1852/3687] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:17:58.068495 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8b7217d4-6229-44f3-ba83-212cb5278e21 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:58.071319 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8b7217d4-6229-44f3-ba83-212cb5278e21 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:58.088561 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b7217d4-6229-44f3-ba83-212cb5278e21 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:58.089460 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b7217d4-6229-44f3-ba83-212cb5278e21 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:58.089937 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b7217d4-6229-44f3-ba83-212cb5278e21 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:58.090683 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b7217d4-6229-44f3-ba83-212cb5278e21 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:58.091144 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b7217d4-6229-44f3-ba83-212cb5278e21 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:58.091575 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b7217d4-6229-44f3-ba83-212cb5278e21 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:58.141366 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-48de2dec-a27f-4114-b76e-e6555e2f7a32 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:58.151617 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-48de2dec-a27f-4114-b76e-e6555e2f7a32 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c" status: 200 len: 1362 microversion: 2.1 time: 1.229771 Oct 26 13:17:58.157129 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1836/3688] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:56 2022] GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c => generated 1362 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:58.173441 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-37bc7c1d-c118-440d-a9ec-3b967f587545 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:58.176017 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-37bc7c1d-c118-440d-a9ec-3b967f587545 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:58.205212 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37bc7c1d-c118-440d-a9ec-3b967f587545 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:58.210144 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37bc7c1d-c118-440d-a9ec-3b967f587545 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:58.213199 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37bc7c1d-c118-440d-a9ec-3b967f587545 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:58.214465 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37bc7c1d-c118-440d-a9ec-3b967f587545 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:58.216820 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37bc7c1d-c118-440d-a9ec-3b967f587545 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:58.218546 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37bc7c1d-c118-440d-a9ec-3b967f587545 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:58.274895 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8b7217d4-6229-44f3-ba83-212cb5278e21 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:58.286890 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8b7217d4-6229-44f3-ba83-212cb5278e21 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6" status: 200 len: 1265 microversion: 2.1 time: 0.222261 Oct 26 13:17:58.290798 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1853/3689] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:58 2022] GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 => generated 1265 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:58.301874 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-8d7cf2c9-b87e-4703-a5c5-4aafc0b2e3ad req-f563eca5-24b4-44c0-b636-7616bdd8020f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7743d90-f9dc-4601-a6d3-a4901bf9cc05", "tag": "cd05a893-6fb7-45ab-985e-5e98b6a0306b"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:17:58.330689 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8d7cf2c9-b87e-4703-a5c5-4aafc0b2e3ad req-f563eca5-24b4-44c0-b636-7616bdd8020f service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:58.331459 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8d7cf2c9-b87e-4703-a5c5-4aafc0b2e3ad req-f563eca5-24b4-44c0-b636-7616bdd8020f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:58.332064 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8d7cf2c9-b87e-4703-a5c5-4aafc0b2e3ad req-f563eca5-24b4-44c0-b636-7616bdd8020f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:58.347735 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-8d7cf2c9-b87e-4703-a5c5-4aafc0b2e3ad req-f563eca5-24b4-44c0-b636-7616bdd8020f service nova] Creating event network-changed:cd05a893-6fb7-45ab-985e-5e98b6a0306b for instance b7743d90-f9dc-4601-a6d3-a4901bf9cc05 on n-h2-862686-1 Oct 26 13:17:58.363569 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-8d7cf2c9-b87e-4703-a5c5-4aafc0b2e3ad req-f563eca5-24b4-44c0-b636-7616bdd8020f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071028 Oct 26 13:17:58.364815 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1854/3690] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:17:58.452768 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8665498c-d096-4c5d-a032-da631c211e13 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:58.453814 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8665498c-d096-4c5d-a032-da631c211e13 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:58.462000 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8665498c-d096-4c5d-a032-da631c211e13 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:58.462828 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8665498c-d096-4c5d-a032-da631c211e13 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:58.463993 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8665498c-d096-4c5d-a032-da631c211e13 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:58.464941 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8665498c-d096-4c5d-a032-da631c211e13 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:58.466142 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8665498c-d096-4c5d-a032-da631c211e13 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:58.467086 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8665498c-d096-4c5d-a032-da631c211e13 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:58.689409 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-37bc7c1d-c118-440d-a9ec-3b967f587545 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:58.702363 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-37bc7c1d-c118-440d-a9ec-3b967f587545 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1509 microversion: 2.1 time: 0.543813 Oct 26 13:17:58.702962 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1837/3691] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:58 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1509 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:58.804417 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8612722d-95c0-417b-b4c8-42bab887cafe tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:58.805053 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8612722d-95c0-417b-b4c8-42bab887cafe tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:58.818715 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8665498c-d096-4c5d-a032-da631c211e13 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:58.819603 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8612722d-95c0-417b-b4c8-42bab887cafe tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:58.820124 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8612722d-95c0-417b-b4c8-42bab887cafe tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:58.820694 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8612722d-95c0-417b-b4c8-42bab887cafe tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:58.821443 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8612722d-95c0-417b-b4c8-42bab887cafe tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:58.821928 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8612722d-95c0-417b-b4c8-42bab887cafe tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:58.822351 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8612722d-95c0-417b-b4c8-42bab887cafe tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:58.855711 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8665498c-d096-4c5d-a032-da631c211e13 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:58.869053 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8665498c-d096-4c5d-a032-da631c211e13 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:58.871486 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8665498c-d096-4c5d-a032-da631c211e13 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1873 microversion: 2.32 time: 0.423842 Oct 26 13:17:58.875646 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1855/3692] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:17:58 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1873 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:17:58.972010 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-78fbd811-635f-495d-bcce-aae74f3bfa0f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:58.973299 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-78fbd811-635f-495d-bcce-aae74f3bfa0f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:58.991545 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78fbd811-635f-495d-bcce-aae74f3bfa0f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:58.995259 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78fbd811-635f-495d-bcce-aae74f3bfa0f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:58.998150 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78fbd811-635f-495d-bcce-aae74f3bfa0f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:59.001556 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78fbd811-635f-495d-bcce-aae74f3bfa0f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:59.004448 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78fbd811-635f-495d-bcce-aae74f3bfa0f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:59.005290 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78fbd811-635f-495d-bcce-aae74f3bfa0f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:59.458358 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-78fbd811-635f-495d-bcce-aae74f3bfa0f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:59.473516 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-78fbd811-635f-495d-bcce-aae74f3bfa0f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9" status: 200 len: 1367 microversion: 2.1 time: 0.506673 Oct 26 13:17:59.476967 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1856/3693] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:58 2022] GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 => generated 1367 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:17:59.482270 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b259fc10-2cdd-4d5a-9c4f-508496a2ed62 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:59.482876 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b259fc10-2cdd-4d5a-9c4f-508496a2ed62 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:59.497848 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b259fc10-2cdd-4d5a-9c4f-508496a2ed62 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:59.499036 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b259fc10-2cdd-4d5a-9c4f-508496a2ed62 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:59.499961 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b259fc10-2cdd-4d5a-9c4f-508496a2ed62 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:59.501093 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b259fc10-2cdd-4d5a-9c4f-508496a2ed62 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:59.501921 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b259fc10-2cdd-4d5a-9c4f-508496a2ed62 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:59.511578 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b259fc10-2cdd-4d5a-9c4f-508496a2ed62 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:59.798566 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8612722d-95c0-417b-b4c8-42bab887cafe tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:59.811924 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8612722d-95c0-417b-b4c8-42bab887cafe tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1391 microversion: 2.1 time: 1.011738 Oct 26 13:17:59.819888 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1838/3694] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:58 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1391 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:17:59.844847 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1a424497-01b1-4d81-b96f-e5ff236de1db tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:59.845997 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1a424497-01b1-4d81-b96f-e5ff236de1db tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:59.854576 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a424497-01b1-4d81-b96f-e5ff236de1db tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:59.854852 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b259fc10-2cdd-4d5a-9c4f-508496a2ed62 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:17:59.864910 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a424497-01b1-4d81-b96f-e5ff236de1db tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:59.865773 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a424497-01b1-4d81-b96f-e5ff236de1db tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:59.865903 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b259fc10-2cdd-4d5a-9c4f-508496a2ed62 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c" status: 200 len: 1362 microversion: 2.1 time: 0.385571 Oct 26 13:17:59.866795 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a424497-01b1-4d81-b96f-e5ff236de1db tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:59.868247 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1857/3695] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:59 2022] GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c => generated 1362 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:17:59.870474 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a424497-01b1-4d81-b96f-e5ff236de1db tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:59.870936 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a424497-01b1-4d81-b96f-e5ff236de1db tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:59.887730 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-50496c30-db25-4e73-8925-4bc05204ba7e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:17:59.888744 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-50496c30-db25-4e73-8925-4bc05204ba7e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:17:59.903357 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50496c30-db25-4e73-8925-4bc05204ba7e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:59.904141 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50496c30-db25-4e73-8925-4bc05204ba7e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:59.905221 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50496c30-db25-4e73-8925-4bc05204ba7e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:17:59.907018 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50496c30-db25-4e73-8925-4bc05204ba7e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:17:59.908708 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50496c30-db25-4e73-8925-4bc05204ba7e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:17:59.910900 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50496c30-db25-4e73-8925-4bc05204ba7e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:00.143536 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1a424497-01b1-4d81-b96f-e5ff236de1db tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:00.152882 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1a424497-01b1-4d81-b96f-e5ff236de1db tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6" status: 200 len: 1271 microversion: 2.1 time: 0.325623 Oct 26 13:18:00.153535 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1839/3696] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:59 2022] GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 => generated 1271 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:00.158499 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9a8f70ab-6930-49bb-80c3-5403e18ba105 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:00.159152 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9a8f70ab-6930-49bb-80c3-5403e18ba105 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:00.192634 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9a8f70ab-6930-49bb-80c3-5403e18ba105 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:00.193514 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9a8f70ab-6930-49bb-80c3-5403e18ba105 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:00.194240 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9a8f70ab-6930-49bb-80c3-5403e18ba105 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:00.195207 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9a8f70ab-6930-49bb-80c3-5403e18ba105 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:00.197450 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9a8f70ab-6930-49bb-80c3-5403e18ba105 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:00.202243 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9a8f70ab-6930-49bb-80c3-5403e18ba105 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:00.334196 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-50496c30-db25-4e73-8925-4bc05204ba7e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:00.350560 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-50496c30-db25-4e73-8925-4bc05204ba7e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1509 microversion: 2.1 time: 0.474170 Oct 26 13:18:00.352339 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1858/3697] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:17:59 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1509 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:00.369345 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-9e1c6967-7930-421d-8f29-f20b59b69773 req-45acba67-a97e-4519-8429-2793ffa148ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "893420b7-27d9-4240-8182-87dd3231cbe2", "name": "network-vif-plugged", "status": "completed", "tag": "ba719c25-4dde-4810-8e01-3a65db1889d6"}, {"server_uuid": "893420b7-27d9-4240-8182-87dd3231cbe2", "name": "network-vif-plugged", "status": "completed", "tag": "6f7441d1-08c7-4242-af8c-89ef53af5a68"}, {"server_uuid": "893420b7-27d9-4240-8182-87dd3231cbe2", "name": "network-vif-plugged", "status": "completed", "tag": "01969fd5-4e79-4f2e-9b74-9329ffa7cebd"}, {"server_uuid": "893420b7-27d9-4240-8182-87dd3231cbe2", "name": "network-vif-plugged", "status": "completed", "tag": "fdc12d04-26b7-4153-91a7-171ed0f8798d"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:18:00.408866 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9e1c6967-7930-421d-8f29-f20b59b69773 req-45acba67-a97e-4519-8429-2793ffa148ea service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:00.412336 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9e1c6967-7930-421d-8f29-f20b59b69773 req-45acba67-a97e-4519-8429-2793ffa148ea service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:00.413860 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9e1c6967-7930-421d-8f29-f20b59b69773 req-45acba67-a97e-4519-8429-2793ffa148ea service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:00.455130 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:18:00.465569 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-9e1c6967-7930-421d-8f29-f20b59b69773 req-45acba67-a97e-4519-8429-2793ffa148ea service nova] Creating event network-vif-plugged:ba719c25-4dde-4810-8e01-3a65db1889d6 for instance 893420b7-27d9-4240-8182-87dd3231cbe2 on n-h1-862686-1 Oct 26 13:18:00.467346 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-9e1c6967-7930-421d-8f29-f20b59b69773 req-45acba67-a97e-4519-8429-2793ffa148ea service nova] Creating event network-vif-plugged:6f7441d1-08c7-4242-af8c-89ef53af5a68 for instance 893420b7-27d9-4240-8182-87dd3231cbe2 on n-h1-862686-1 Oct 26 13:18:00.469836 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-9e1c6967-7930-421d-8f29-f20b59b69773 req-45acba67-a97e-4519-8429-2793ffa148ea service nova] Creating event network-vif-plugged:01969fd5-4e79-4f2e-9b74-9329ffa7cebd for instance 893420b7-27d9-4240-8182-87dd3231cbe2 on n-h1-862686-1 Oct 26 13:18:00.471357 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-9e1c6967-7930-421d-8f29-f20b59b69773 req-45acba67-a97e-4519-8429-2793ffa148ea service nova] Creating event network-vif-plugged:fdc12d04-26b7-4153-91a7-171ed0f8798d for instance 893420b7-27d9-4240-8182-87dd3231cbe2 on n-h1-862686-1 Oct 26 13:18:00.492976 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-9e1c6967-7930-421d-8f29-f20b59b69773 req-45acba67-a97e-4519-8429-2793ffa148ea service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.131705 Oct 26 13:18:00.495914 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1859/3698] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:18:00.509889 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-6709338c-cf5e-48e7-a47f-f77fe0af1cab req-36950915-0319-4eaf-8ae1-3a8f5b5ea2b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9", "tag": "3a104c30-3b08-4b47-ba9a-ae590f82e5ab"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:18:00.535587 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-6709338c-cf5e-48e7-a47f-f77fe0af1cab req-36950915-0319-4eaf-8ae1-3a8f5b5ea2b9 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:00.536076 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-6709338c-cf5e-48e7-a47f-f77fe0af1cab req-36950915-0319-4eaf-8ae1-3a8f5b5ea2b9 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:00.536512 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-6709338c-cf5e-48e7-a47f-f77fe0af1cab req-36950915-0319-4eaf-8ae1-3a8f5b5ea2b9 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:00.562537 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-6709338c-cf5e-48e7-a47f-f77fe0af1cab req-36950915-0319-4eaf-8ae1-3a8f5b5ea2b9 service nova] Creating event network-changed:3a104c30-3b08-4b47-ba9a-ae590f82e5ab for instance bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 on n-h1-862686-1 Oct 26 13:18:00.573567 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-6709338c-cf5e-48e7-a47f-f77fe0af1cab req-36950915-0319-4eaf-8ae1-3a8f5b5ea2b9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074908 Oct 26 13:18:00.575471 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1860/3699] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:18:00.584818 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a6316e35-3e06-42a8-9130-3e851037a8b8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:00.587108 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a6316e35-3e06-42a8-9130-3e851037a8b8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:00.597866 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a6316e35-3e06-42a8-9130-3e851037a8b8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:00.600582 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a6316e35-3e06-42a8-9130-3e851037a8b8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:00.603396 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a6316e35-3e06-42a8-9130-3e851037a8b8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:00.604648 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a6316e35-3e06-42a8-9130-3e851037a8b8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:00.606153 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a6316e35-3e06-42a8-9130-3e851037a8b8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:00.606909 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a6316e35-3e06-42a8-9130-3e851037a8b8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:00.934268 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a6316e35-3e06-42a8-9130-3e851037a8b8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:00.954987 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a6316e35-3e06-42a8-9130-3e851037a8b8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9" status: 200 len: 1367 microversion: 2.1 time: 0.377136 Oct 26 13:18:00.956498 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1861/3700] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:00 2022] GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 => generated 1367 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:00.986593 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8fcee1e6-061c-420c-93bf-d84d254dc925 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:00.987460 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8fcee1e6-061c-420c-93bf-d84d254dc925 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:01.006416 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8fcee1e6-061c-420c-93bf-d84d254dc925 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:01.007230 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8fcee1e6-061c-420c-93bf-d84d254dc925 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:01.010792 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8fcee1e6-061c-420c-93bf-d84d254dc925 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:01.011932 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8fcee1e6-061c-420c-93bf-d84d254dc925 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:01.012509 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8fcee1e6-061c-420c-93bf-d84d254dc925 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:01.013166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8fcee1e6-061c-420c-93bf-d84d254dc925 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:01.121526 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9a8f70ab-6930-49bb-80c3-5403e18ba105 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:01.140832 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9a8f70ab-6930-49bb-80c3-5403e18ba105 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:01.149975 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9a8f70ab-6930-49bb-80c3-5403e18ba105 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:01.152865 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9a8f70ab-6930-49bb-80c3-5403e18ba105 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1873 microversion: 2.32 time: 0.998309 Oct 26 13:18:01.155544 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1840/3701] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:18:00 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1873 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:18:01.171905 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7b5dcfe1-8529-458d-a6ad-6995b8e50fbe tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:01.174468 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7b5dcfe1-8529-458d-a6ad-6995b8e50fbe tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:01.193124 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b5dcfe1-8529-458d-a6ad-6995b8e50fbe tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:01.195390 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b5dcfe1-8529-458d-a6ad-6995b8e50fbe tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:01.196333 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b5dcfe1-8529-458d-a6ad-6995b8e50fbe tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:01.197685 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b5dcfe1-8529-458d-a6ad-6995b8e50fbe tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:01.201264 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b5dcfe1-8529-458d-a6ad-6995b8e50fbe tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:01.201908 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b5dcfe1-8529-458d-a6ad-6995b8e50fbe tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:01.387918 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8fcee1e6-061c-420c-93bf-d84d254dc925 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:01.401629 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8fcee1e6-061c-420c-93bf-d84d254dc925 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1391 microversion: 2.1 time: 0.443249 Oct 26 13:18:01.403166 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1862/3702] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:00 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1391 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:01.446983 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c2726d04-4920-4e5f-9a48-b68d647fca30 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:01.447830 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c2726d04-4920-4e5f-9a48-b68d647fca30 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:01.462705 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2726d04-4920-4e5f-9a48-b68d647fca30 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:01.463724 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2726d04-4920-4e5f-9a48-b68d647fca30 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:01.464557 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2726d04-4920-4e5f-9a48-b68d647fca30 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:01.465645 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2726d04-4920-4e5f-9a48-b68d647fca30 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:01.474996 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2726d04-4920-4e5f-9a48-b68d647fca30 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:01.475991 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2726d04-4920-4e5f-9a48-b68d647fca30 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:01.573412 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c2726d04-4920-4e5f-9a48-b68d647fca30 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:01.582265 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c2726d04-4920-4e5f-9a48-b68d647fca30 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6" status: 200 len: 1271 microversion: 2.1 time: 0.155699 Oct 26 13:18:01.584040 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1863/3703] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:01 2022] GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 => generated 1271 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:01.597713 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2f01a741-7b4b-4a65-ad2d-164dbe676335 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:01.600939 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2f01a741-7b4b-4a65-ad2d-164dbe676335 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:01.605553 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f01a741-7b4b-4a65-ad2d-164dbe676335 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:01.606195 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f01a741-7b4b-4a65-ad2d-164dbe676335 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:01.606817 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f01a741-7b4b-4a65-ad2d-164dbe676335 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:01.607520 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f01a741-7b4b-4a65-ad2d-164dbe676335 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:01.608183 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f01a741-7b4b-4a65-ad2d-164dbe676335 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:01.608687 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f01a741-7b4b-4a65-ad2d-164dbe676335 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:01.769305 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2f01a741-7b4b-4a65-ad2d-164dbe676335 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:01.779000 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2f01a741-7b4b-4a65-ad2d-164dbe676335 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1509 microversion: 2.1 time: 0.188159 Oct 26 13:18:01.779598 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1864/3704] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:01 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1509 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:01.988241 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f8957075-7093-4514-92d7-ab95e366867e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:01.989269 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f8957075-7093-4514-92d7-ab95e366867e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:01.999079 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:18:02.004073 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8957075-7093-4514-92d7-ab95e366867e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:02.005359 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8957075-7093-4514-92d7-ab95e366867e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:02.007244 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8957075-7093-4514-92d7-ab95e366867e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:02.008838 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8957075-7093-4514-92d7-ab95e366867e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:02.013000 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8957075-7093-4514-92d7-ab95e366867e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:02.013627 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8957075-7093-4514-92d7-ab95e366867e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:02.129155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7b5dcfe1-8529-458d-a6ad-6995b8e50fbe tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:02.142831 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7b5dcfe1-8529-458d-a6ad-6995b8e50fbe tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c" status: 200 len: 1362 microversion: 2.1 time: 0.984971 Oct 26 13:18:02.149321 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1841/3705] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:01 2022] GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c => generated 1362 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:02.190043 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f2708f4b-5150-4563-9f76-6968f8d6bc9b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:02.190664 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f2708f4b-5150-4563-9f76-6968f8d6bc9b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:02.207081 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2708f4b-5150-4563-9f76-6968f8d6bc9b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:02.207586 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2708f4b-5150-4563-9f76-6968f8d6bc9b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:02.208032 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2708f4b-5150-4563-9f76-6968f8d6bc9b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:02.208972 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2708f4b-5150-4563-9f76-6968f8d6bc9b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:02.209665 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2708f4b-5150-4563-9f76-6968f8d6bc9b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:02.210265 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2708f4b-5150-4563-9f76-6968f8d6bc9b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:02.217376 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f8957075-7093-4514-92d7-ab95e366867e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:02.229866 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f8957075-7093-4514-92d7-ab95e366867e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9" status: 200 len: 1367 microversion: 2.1 time: 0.249637 Oct 26 13:18:02.241572 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1865/3706] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:01 2022] GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:02.432697 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9b3b8577-cc37-4c77-93f7-024d5fe160d7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:02.433569 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9b3b8577-cc37-4c77-93f7-024d5fe160d7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:02.440758 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b3b8577-cc37-4c77-93f7-024d5fe160d7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:02.441250 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b3b8577-cc37-4c77-93f7-024d5fe160d7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:02.441705 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b3b8577-cc37-4c77-93f7-024d5fe160d7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:02.442632 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b3b8577-cc37-4c77-93f7-024d5fe160d7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:02.443282 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b3b8577-cc37-4c77-93f7-024d5fe160d7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:02.443974 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b3b8577-cc37-4c77-93f7-024d5fe160d7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:02.730396 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9b3b8577-cc37-4c77-93f7-024d5fe160d7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:02.753194 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9b3b8577-cc37-4c77-93f7-024d5fe160d7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1391 microversion: 2.1 time: 0.324415 Oct 26 13:18:02.754961 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1866/3707] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:02 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1391 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:18:02.769663 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0f02b84c-c451-45f3-8486-6c1c717d2ee2 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:02.772041 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0f02b84c-c451-45f3-8486-6c1c717d2ee2 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:02.780688 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f02b84c-c451-45f3-8486-6c1c717d2ee2 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:02.782296 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f02b84c-c451-45f3-8486-6c1c717d2ee2 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:02.783257 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f02b84c-c451-45f3-8486-6c1c717d2ee2 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:02.784405 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f02b84c-c451-45f3-8486-6c1c717d2ee2 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:02.785442 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f02b84c-c451-45f3-8486-6c1c717d2ee2 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:02.786511 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f02b84c-c451-45f3-8486-6c1c717d2ee2 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:02.840390 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f2708f4b-5150-4563-9f76-6968f8d6bc9b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:02.854021 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f2708f4b-5150-4563-9f76-6968f8d6bc9b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:02.856253 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f2708f4b-5150-4563-9f76-6968f8d6bc9b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:02.858977 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f2708f4b-5150-4563-9f76-6968f8d6bc9b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1873 microversion: 2.32 time: 0.671160 Oct 26 13:18:02.860856 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1842/3708] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:18:02 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1873 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:18:02.866230 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-ad8e3657-0ed1-459e-b7d0-3de56633bb6a req-56ebee71-dde1-4d7e-9f5c-236e2374c6e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "893420b7-27d9-4240-8182-87dd3231cbe2", "name": "network-vif-plugged", "status": "completed", "tag": "4f406596-ab15-464c-88f4-1a3c9b70369c"}, {"server_uuid": "893420b7-27d9-4240-8182-87dd3231cbe2", "name": "network-vif-plugged", "status": "completed", "tag": "82a2023f-2039-4f62-94a6-f0654d4f4db3"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:18:02.878175 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ad8e3657-0ed1-459e-b7d0-3de56633bb6a req-56ebee71-dde1-4d7e-9f5c-236e2374c6e4 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:02.879081 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ad8e3657-0ed1-459e-b7d0-3de56633bb6a req-56ebee71-dde1-4d7e-9f5c-236e2374c6e4 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:02.880046 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ad8e3657-0ed1-459e-b7d0-3de56633bb6a req-56ebee71-dde1-4d7e-9f5c-236e2374c6e4 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:02.884814 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:18:02.909390 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-ad8e3657-0ed1-459e-b7d0-3de56633bb6a req-56ebee71-dde1-4d7e-9f5c-236e2374c6e4 service nova] Creating event network-vif-plugged:4f406596-ab15-464c-88f4-1a3c9b70369c for instance 893420b7-27d9-4240-8182-87dd3231cbe2 on n-h1-862686-1 Oct 26 13:18:02.910184 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-ad8e3657-0ed1-459e-b7d0-3de56633bb6a req-56ebee71-dde1-4d7e-9f5c-236e2374c6e4 service nova] Creating event network-vif-plugged:82a2023f-2039-4f62-94a6-f0654d4f4db3 for instance 893420b7-27d9-4240-8182-87dd3231cbe2 on n-h1-862686-1 Oct 26 13:18:02.918383 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-ad8e3657-0ed1-459e-b7d0-3de56633bb6a req-56ebee71-dde1-4d7e-9f5c-236e2374c6e4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.055861 Oct 26 13:18:02.919324 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1843/3709] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:18:02.927542 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d7324f82-d950-4aca-acef-602c3142edbf tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:02.928663 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d7324f82-d950-4aca-acef-602c3142edbf tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:02.938009 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7324f82-d950-4aca-acef-602c3142edbf tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:02.938811 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7324f82-d950-4aca-acef-602c3142edbf tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:02.939424 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7324f82-d950-4aca-acef-602c3142edbf tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:02.940343 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7324f82-d950-4aca-acef-602c3142edbf tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:02.940973 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7324f82-d950-4aca-acef-602c3142edbf tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:02.941607 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7324f82-d950-4aca-acef-602c3142edbf tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:03.079703 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0f02b84c-c451-45f3-8486-6c1c717d2ee2 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:03.093562 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0f02b84c-c451-45f3-8486-6c1c717d2ee2 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6" status: 200 len: 1313 microversion: 2.1 time: 0.336374 Oct 26 13:18:03.105540 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1867/3710] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:02 2022] GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 => generated 1313 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:03.105540 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-3e04ba6c-18b3-47c3-8a15-e87f17030462 req-0a59ce04-6731-488d-9b36-4de89190bc98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c1ed300-eac2-4e60-a903-2f17e7df792c", "tag": "3bb2a1a3-90e2-4559-a739-93834bf16890"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:18:03.116352 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-3e04ba6c-18b3-47c3-8a15-e87f17030462 req-0a59ce04-6731-488d-9b36-4de89190bc98 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:03.117109 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-3e04ba6c-18b3-47c3-8a15-e87f17030462 req-0a59ce04-6731-488d-9b36-4de89190bc98 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:03.117801 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-3e04ba6c-18b3-47c3-8a15-e87f17030462 req-0a59ce04-6731-488d-9b36-4de89190bc98 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:03.132148 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-3e04ba6c-18b3-47c3-8a15-e87f17030462 req-0a59ce04-6731-488d-9b36-4de89190bc98 service nova] Creating event network-changed:3bb2a1a3-90e2-4559-a739-93834bf16890 for instance 9c1ed300-eac2-4e60-a903-2f17e7df792c on n-h2-862686-1 Oct 26 13:18:03.140362 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-3e04ba6c-18b3-47c3-8a15-e87f17030462 req-0a59ce04-6731-488d-9b36-4de89190bc98 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044042 Oct 26 13:18:03.141206 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1868/3711] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:18:03.173280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0922c08c-b481-4229-bda8-01f6dd9735b3 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:03.174374 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0922c08c-b481-4229-bda8-01f6dd9735b3 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:03.181752 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0922c08c-b481-4229-bda8-01f6dd9735b3 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:03.182399 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0922c08c-b481-4229-bda8-01f6dd9735b3 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:03.183000 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0922c08c-b481-4229-bda8-01f6dd9735b3 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:03.184373 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0922c08c-b481-4229-bda8-01f6dd9735b3 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:03.185021 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0922c08c-b481-4229-bda8-01f6dd9735b3 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:03.185605 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0922c08c-b481-4229-bda8-01f6dd9735b3 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:03.371913 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0922c08c-b481-4229-bda8-01f6dd9735b3 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:03.380466 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0922c08c-b481-4229-bda8-01f6dd9735b3 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c" status: 200 len: 1362 microversion: 2.1 time: 0.212366 Oct 26 13:18:03.381089 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1869/3712] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:03 2022] GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:18:03.385782 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d96661b2-8825-495c-9da3-e6e088ea5080 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:03.386395 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d96661b2-8825-495c-9da3-e6e088ea5080 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:03.392266 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d96661b2-8825-495c-9da3-e6e088ea5080 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:03.392757 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d96661b2-8825-495c-9da3-e6e088ea5080 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:03.393201 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d96661b2-8825-495c-9da3-e6e088ea5080 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:03.393931 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d96661b2-8825-495c-9da3-e6e088ea5080 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:03.394422 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d96661b2-8825-495c-9da3-e6e088ea5080 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:03.394888 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d96661b2-8825-495c-9da3-e6e088ea5080 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:03.533748 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d96661b2-8825-495c-9da3-e6e088ea5080 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:03.542223 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d96661b2-8825-495c-9da3-e6e088ea5080 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9" status: 200 len: 1367 microversion: 2.1 time: 0.160077 Oct 26 13:18:03.542808 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1870/3713] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:03 2022] GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:03.663931 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d7324f82-d950-4aca-acef-602c3142edbf tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:03.680236 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d7324f82-d950-4aca-acef-602c3142edbf tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1509 microversion: 2.1 time: 0.758379 Oct 26 13:18:03.703012 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1844/3714] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:02 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1509 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:03.782493 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2b6dea54-672e-4c5d-81c3-796261dea86a tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:03.783274 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2b6dea54-672e-4c5d-81c3-796261dea86a tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:03.789402 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2b6dea54-672e-4c5d-81c3-796261dea86a tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:03.791013 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2b6dea54-672e-4c5d-81c3-796261dea86a tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:03.791451 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2b6dea54-672e-4c5d-81c3-796261dea86a tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:03.792148 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2b6dea54-672e-4c5d-81c3-796261dea86a tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:03.792600 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2b6dea54-672e-4c5d-81c3-796261dea86a tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:03.793021 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2b6dea54-672e-4c5d-81c3-796261dea86a tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:03.887964 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ecacd479-0338-44d2-8c40-6df43dc82e65 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:03.888587 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ecacd479-0338-44d2-8c40-6df43dc82e65 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:03.896203 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ecacd479-0338-44d2-8c40-6df43dc82e65 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:03.897237 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ecacd479-0338-44d2-8c40-6df43dc82e65 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:03.897691 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ecacd479-0338-44d2-8c40-6df43dc82e65 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:03.898428 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ecacd479-0338-44d2-8c40-6df43dc82e65 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:03.899862 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ecacd479-0338-44d2-8c40-6df43dc82e65 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:03.900553 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ecacd479-0338-44d2-8c40-6df43dc82e65 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:03.959712 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2b6dea54-672e-4c5d-81c3-796261dea86a tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:03.971737 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=4 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:18:03.983273 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2b6dea54-672e-4c5d-81c3-796261dea86a tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1391 microversion: 2.1 time: 0.204531 Oct 26 13:18:03.984593 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1871/3715] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:03 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1391 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:04.117329 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-892098f4-04b8-4489-b6ef-5e07a5b35ee6 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:04.119223 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-892098f4-04b8-4489-b6ef-5e07a5b35ee6 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:04.127322 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-892098f4-04b8-4489-b6ef-5e07a5b35ee6 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:04.127866 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-892098f4-04b8-4489-b6ef-5e07a5b35ee6 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:04.128685 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-892098f4-04b8-4489-b6ef-5e07a5b35ee6 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:04.129571 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-892098f4-04b8-4489-b6ef-5e07a5b35ee6 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:04.130020 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-892098f4-04b8-4489-b6ef-5e07a5b35ee6 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:04.130610 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-892098f4-04b8-4489-b6ef-5e07a5b35ee6 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:04.315481 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-892098f4-04b8-4489-b6ef-5e07a5b35ee6 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:04.326444 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-892098f4-04b8-4489-b6ef-5e07a5b35ee6 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6" status: 200 len: 1313 microversion: 2.1 time: 0.212333 Oct 26 13:18:04.327365 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1872/3716] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:04 2022] GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:18:04.404643 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fa16f048-887e-47d6-8771-fec5ca674e6d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:04.405393 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fa16f048-887e-47d6-8771-fec5ca674e6d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:04.412596 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa16f048-887e-47d6-8771-fec5ca674e6d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:04.413240 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa16f048-887e-47d6-8771-fec5ca674e6d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:04.413726 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa16f048-887e-47d6-8771-fec5ca674e6d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:04.415244 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa16f048-887e-47d6-8771-fec5ca674e6d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:04.415853 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa16f048-887e-47d6-8771-fec5ca674e6d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:04.416371 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa16f048-887e-47d6-8771-fec5ca674e6d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:04.480664 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ecacd479-0338-44d2-8c40-6df43dc82e65 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:04.490507 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ecacd479-0338-44d2-8c40-6df43dc82e65 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:04.492195 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ecacd479-0338-44d2-8c40-6df43dc82e65 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:04.493687 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ecacd479-0338-44d2-8c40-6df43dc82e65 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1873 microversion: 2.32 time: 0.610543 Oct 26 13:18:04.494638 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1845/3717] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:18:03 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1873 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:18:04.564407 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-199bf809-240c-46a0-896c-a0312783185c tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:04.565350 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-199bf809-240c-46a0-896c-a0312783185c tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:04.573387 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-199bf809-240c-46a0-896c-a0312783185c tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:04.574033 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-199bf809-240c-46a0-896c-a0312783185c tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:04.574482 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fa16f048-887e-47d6-8771-fec5ca674e6d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:04.574653 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-199bf809-240c-46a0-896c-a0312783185c tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:04.575645 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-199bf809-240c-46a0-896c-a0312783185c tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:04.576194 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-199bf809-240c-46a0-896c-a0312783185c tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:04.576718 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-199bf809-240c-46a0-896c-a0312783185c tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:04.583021 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fa16f048-887e-47d6-8771-fec5ca674e6d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c" status: 200 len: 1362 microversion: 2.1 time: 0.182443 Oct 26 13:18:04.584300 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1873/3718] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:04 2022] GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:18:04.713933 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a5efe37f-bda7-4b0a-8220-044917b6606c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:04.714608 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a5efe37f-bda7-4b0a-8220-044917b6606c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:04.720919 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5efe37f-bda7-4b0a-8220-044917b6606c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:04.721411 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5efe37f-bda7-4b0a-8220-044917b6606c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:04.721882 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5efe37f-bda7-4b0a-8220-044917b6606c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:04.722591 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5efe37f-bda7-4b0a-8220-044917b6606c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:04.723045 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5efe37f-bda7-4b0a-8220-044917b6606c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:04.723483 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5efe37f-bda7-4b0a-8220-044917b6606c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:04.886497 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a5efe37f-bda7-4b0a-8220-044917b6606c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:04.895734 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a5efe37f-bda7-4b0a-8220-044917b6606c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1530 microversion: 2.1 time: 0.186252 Oct 26 13:18:04.896802 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1874/3719] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:04 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1530 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:18:05.007179 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-feb1faaf-6608-4035-a045-3c4542f7a46d tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:05.007923 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-feb1faaf-6608-4035-a045-3c4542f7a46d tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:05.015228 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-feb1faaf-6608-4035-a045-3c4542f7a46d tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:05.015815 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-feb1faaf-6608-4035-a045-3c4542f7a46d tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:05.016314 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-feb1faaf-6608-4035-a045-3c4542f7a46d tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:05.017076 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-feb1faaf-6608-4035-a045-3c4542f7a46d tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:05.017630 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-feb1faaf-6608-4035-a045-3c4542f7a46d tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:05.018124 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-feb1faaf-6608-4035-a045-3c4542f7a46d tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:05.178694 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-feb1faaf-6608-4035-a045-3c4542f7a46d tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:05.192947 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-feb1faaf-6608-4035-a045-3c4542f7a46d tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1391 microversion: 2.1 time: 0.189543 Oct 26 13:18:05.194101 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1875/3720] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:05 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1391 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:18:05.195659 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-199bf809-240c-46a0-896c-a0312783185c tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:05.204772 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-199bf809-240c-46a0-896c-a0312783185c tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9" status: 200 len: 1367 microversion: 2.1 time: 0.643388 Oct 26 13:18:05.218013 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1846/3721] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:04 2022] GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 => generated 1367 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:18:05.353359 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-af2f0954-98cb-42ab-ab3c-a6ab46944d4d tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:05.354323 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-af2f0954-98cb-42ab-ab3c-a6ab46944d4d tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:05.362771 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af2f0954-98cb-42ab-ab3c-a6ab46944d4d tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:05.363528 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af2f0954-98cb-42ab-ab3c-a6ab46944d4d tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:05.364714 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af2f0954-98cb-42ab-ab3c-a6ab46944d4d tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:05.365796 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af2f0954-98cb-42ab-ab3c-a6ab46944d4d tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:05.366613 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af2f0954-98cb-42ab-ab3c-a6ab46944d4d tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:05.367260 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af2f0954-98cb-42ab-ab3c-a6ab46944d4d tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:05.513728 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e90a0bed-78e6-48b7-a7c6-e05799726d11 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1114773234", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "5ee8b432-5161-41a1-ac0f-f87034b1fccb"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:18:05.618692 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-e90a0bed-78e6-48b7-a7c6-e05799726d11 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] validate_networks() for [('5ee8b432-5161-41a1-ac0f-f87034b1fccb', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:18:05.774974 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:18:05.795733 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-af2f0954-98cb-42ab-ab3c-a6ab46944d4d tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:05.809673 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-af2f0954-98cb-42ab-ab3c-a6ab46944d4d tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6" status: 200 len: 1313 microversion: 2.1 time: 0.461032 Oct 26 13:18:05.838866 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1847/3722] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:05 2022] GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 => generated 1313 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:05.845005 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-22192629-8d75-413c-ab3a-a8962d049959 req-d5fefc61-0854-49e9-b55e-2c6bbe31d232 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9", "name": "network-vif-plugged", "status": "completed", "tag": "3a104c30-3b08-4b47-ba9a-ae590f82e5ab"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:18:05.856849 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=12 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:18:05.859926 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-22192629-8d75-413c-ab3a-a8962d049959 req-d5fefc61-0854-49e9-b55e-2c6bbe31d232 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:05.860643 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-22192629-8d75-413c-ab3a-a8962d049959 req-d5fefc61-0854-49e9-b55e-2c6bbe31d232 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:05.861400 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-22192629-8d75-413c-ab3a-a8962d049959 req-d5fefc61-0854-49e9-b55e-2c6bbe31d232 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:05.880899 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-22192629-8d75-413c-ab3a-a8962d049959 req-d5fefc61-0854-49e9-b55e-2c6bbe31d232 service nova] Creating event network-vif-plugged:3a104c30-3b08-4b47-ba9a-ae590f82e5ab for instance bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 on n-h1-862686-1 Oct 26 13:18:05.888348 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-22192629-8d75-413c-ab3a-a8962d049959 req-d5fefc61-0854-49e9-b55e-2c6bbe31d232 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047493 Oct 26 13:18:05.889759 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1848/3723] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:18:05.895575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-c2fcf903-c323-4927-9a12-7e20e61003ed req-326b2520-1bd5-483f-a9aa-0c532ec1ddf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8551999d-fecc-4f6b-9e0a-c524ce5e96e6", "tag": "93e5472f-fae2-476e-aeb5-be62761a9511"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:18:05.935571 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-c2fcf903-c323-4927-9a12-7e20e61003ed req-326b2520-1bd5-483f-a9aa-0c532ec1ddf3 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:05.936600 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-c2fcf903-c323-4927-9a12-7e20e61003ed req-326b2520-1bd5-483f-a9aa-0c532ec1ddf3 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:05.937508 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-c2fcf903-c323-4927-9a12-7e20e61003ed req-326b2520-1bd5-483f-a9aa-0c532ec1ddf3 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:06.003965 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-c2fcf903-c323-4927-9a12-7e20e61003ed req-326b2520-1bd5-483f-a9aa-0c532ec1ddf3 service nova] Creating event network-changed:93e5472f-fae2-476e-aeb5-be62761a9511 for instance 8551999d-fecc-4f6b-9e0a-c524ce5e96e6 on n-h2-862686-1 Oct 26 13:18:06.020851 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-c2fcf903-c323-4927-9a12-7e20e61003ed req-326b2520-1bd5-483f-a9aa-0c532ec1ddf3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128146 Oct 26 13:18:06.022700 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1849/3724] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:18:06.030068 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4959a2ba-cdeb-4ced-8fba-e95d2889a07c tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:06.031135 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4959a2ba-cdeb-4ced-8fba-e95d2889a07c tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:06.038732 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4959a2ba-cdeb-4ced-8fba-e95d2889a07c tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:06.040392 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4959a2ba-cdeb-4ced-8fba-e95d2889a07c tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:06.041200 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4959a2ba-cdeb-4ced-8fba-e95d2889a07c tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:06.042161 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4959a2ba-cdeb-4ced-8fba-e95d2889a07c tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:06.042794 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4959a2ba-cdeb-4ced-8fba-e95d2889a07c tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:06.043410 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4959a2ba-cdeb-4ced-8fba-e95d2889a07c tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:06.319899 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4959a2ba-cdeb-4ced-8fba-e95d2889a07c tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:06.332886 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4959a2ba-cdeb-4ced-8fba-e95d2889a07c tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:06.334735 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4959a2ba-cdeb-4ced-8fba-e95d2889a07c tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:06.337044 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4959a2ba-cdeb-4ced-8fba-e95d2889a07c tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 2826 microversion: 2.32 time: 0.312215 Oct 26 13:18:06.340336 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1850/3725] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:18:06 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 2826 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:18:06.346464 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d4a74ff4-2981-4412-9f9b-4ea394a22823 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:06.347363 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d4a74ff4-2981-4412-9f9b-4ea394a22823 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:06.355608 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d4a74ff4-2981-4412-9f9b-4ea394a22823 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:06.356451 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d4a74ff4-2981-4412-9f9b-4ea394a22823 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:06.357756 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d4a74ff4-2981-4412-9f9b-4ea394a22823 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:06.359004 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d4a74ff4-2981-4412-9f9b-4ea394a22823 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:06.359700 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d4a74ff4-2981-4412-9f9b-4ea394a22823 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:06.361268 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d4a74ff4-2981-4412-9f9b-4ea394a22823 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:06.526624 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d4a74ff4-2981-4412-9f9b-4ea394a22823 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:06.536943 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d4a74ff4-2981-4412-9f9b-4ea394a22823 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c" status: 200 len: 1362 microversion: 2.1 time: 0.195071 Oct 26 13:18:06.552851 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1851/3726] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:06 2022] GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:06.552851 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-aa89954a-0cab-4524-9f3a-a1c1026c525a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:06.552851 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-aa89954a-0cab-4524-9f3a-a1c1026c525a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:06.564933 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aa89954a-0cab-4524-9f3a-a1c1026c525a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:06.570170 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aa89954a-0cab-4524-9f3a-a1c1026c525a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:06.571257 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aa89954a-0cab-4524-9f3a-a1c1026c525a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:06.572091 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aa89954a-0cab-4524-9f3a-a1c1026c525a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:06.572779 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aa89954a-0cab-4524-9f3a-a1c1026c525a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:06.573258 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aa89954a-0cab-4524-9f3a-a1c1026c525a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:06.678872 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-e90a0bed-78e6-48b7-a7c6-e05799726d11 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:18:06.680457 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-e90a0bed-78e6-48b7-a7c6-e05799726d11 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:18:06.681960 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-e90a0bed-78e6-48b7-a7c6-e05799726d11 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:18:06.682681 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-e90a0bed-78e6-48b7-a7c6-e05799726d11 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:18:06.683402 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-e90a0bed-78e6-48b7-a7c6-e05799726d11 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:18:06.698793 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e90a0bed-78e6-48b7-a7c6-e05799726d11 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:06.704006 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e90a0bed-78e6-48b7-a7c6-e05799726d11 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:06.704685 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e90a0bed-78e6-48b7-a7c6-e05799726d11 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:06.705646 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e90a0bed-78e6-48b7-a7c6-e05799726d11 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:06.706289 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e90a0bed-78e6-48b7-a7c6-e05799726d11 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:06.708649 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e90a0bed-78e6-48b7-a7c6-e05799726d11 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:06.748442 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-aa89954a-0cab-4524-9f3a-a1c1026c525a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:06.749658 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-e90a0bed-78e6-48b7-a7c6-e05799726d11 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Getting quotas for project 6c40ceb3374847ec8685b67f7c94a3c7. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:18:06.755153 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-e90a0bed-78e6-48b7-a7c6-e05799726d11 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Getting quotas for user d49ecfb3d5514177b2100631aa944200 and project 6c40ceb3374847ec8685b67f7c94a3c7. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:18:06.761136 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-aa89954a-0cab-4524-9f3a-a1c1026c525a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1525 microversion: 2.1 time: 0.222242 Oct 26 13:18:06.766618 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1852/3727] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:06 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1525 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:06.771348 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e90a0bed-78e6-48b7-a7c6-e05799726d11 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Going to run 2 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:18:06.771794 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7cbefa5d-d474-4b6f-b730-645f3930e375 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:06.772717 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7cbefa5d-d474-4b6f-b730-645f3930e375 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:06.775870 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e90a0bed-78e6-48b7-a7c6-e05799726d11 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: 9db9b3b9-b9cd-4fa1-8091-4c6ad1c26aba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:18:06.779629 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7cbefa5d-d474-4b6f-b730-645f3930e375 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:06.780340 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7cbefa5d-d474-4b6f-b730-645f3930e375 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:06.781741 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7cbefa5d-d474-4b6f-b730-645f3930e375 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:06.782466 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7cbefa5d-d474-4b6f-b730-645f3930e375 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:06.783873 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7cbefa5d-d474-4b6f-b730-645f3930e375 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:06.784316 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7cbefa5d-d474-4b6f-b730-645f3930e375 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:06.820535 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e90a0bed-78e6-48b7-a7c6-e05799726d11 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: c61efb26-4f8c-470d-b0b2-ad428f1c7458] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=9db9b3b9-b9cd-4fa1-8091-4c6ad1c26aba,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:18:06.895560 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e90a0bed-78e6-48b7-a7c6-e05799726d11 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.565736 Oct 26 13:18:06.896865 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1876/3728] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:18:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:18:06.904297 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f6f0356a-3f92-46ce-8550-e923301fd75d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:06.905135 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f6f0356a-3f92-46ce-8550-e923301fd75d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:06.912097 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6f0356a-3f92-46ce-8550-e923301fd75d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:06.912802 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6f0356a-3f92-46ce-8550-e923301fd75d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:06.913646 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6f0356a-3f92-46ce-8550-e923301fd75d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:06.915080 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6f0356a-3f92-46ce-8550-e923301fd75d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:06.915702 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6f0356a-3f92-46ce-8550-e923301fd75d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:06.916303 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6f0356a-3f92-46ce-8550-e923301fd75d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:06.997883 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7cbefa5d-d474-4b6f-b730-645f3930e375 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:07.009639 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7cbefa5d-d474-4b6f-b730-645f3930e375 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1391 microversion: 2.1 time: 0.240858 Oct 26 13:18:07.010918 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1853/3729] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:06 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1391 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:07.017115 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-91e46273-1af5-4895-b3cc-b764277fc26c tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:07.018635 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-91e46273-1af5-4895-b3cc-b764277fc26c tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:07.029188 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91e46273-1af5-4895-b3cc-b764277fc26c tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:07.030393 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91e46273-1af5-4895-b3cc-b764277fc26c tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:07.031251 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91e46273-1af5-4895-b3cc-b764277fc26c tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:07.032136 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91e46273-1af5-4895-b3cc-b764277fc26c tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:07.032800 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91e46273-1af5-4895-b3cc-b764277fc26c tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:07.033662 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91e46273-1af5-4895-b3cc-b764277fc26c tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:07.119919 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f6f0356a-3f92-46ce-8550-e923301fd75d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:07.156155 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f6f0356a-3f92-46ce-8550-e923301fd75d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9" status: 200 len: 1367 microversion: 2.1 time: 0.257937 Oct 26 13:18:07.166133 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1877/3730] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:06 2022] GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 => generated 1367 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:07.178530 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-54528177-7f8c-4421-b1c7-af9e465b25c3 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:07.180769 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-54528177-7f8c-4421-b1c7-af9e465b25c3 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:07.199505 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54528177-7f8c-4421-b1c7-af9e465b25c3 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:07.200901 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54528177-7f8c-4421-b1c7-af9e465b25c3 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:07.203596 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54528177-7f8c-4421-b1c7-af9e465b25c3 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:07.204901 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54528177-7f8c-4421-b1c7-af9e465b25c3 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:07.205632 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54528177-7f8c-4421-b1c7-af9e465b25c3 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:07.206659 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54528177-7f8c-4421-b1c7-af9e465b25c3 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:07.237563 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:18:07.259246 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-91e46273-1af5-4895-b3cc-b764277fc26c tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.246294 Oct 26 13:18:07.260870 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1854/3731] 10.222.0.40 () {60 vars in 1316 bytes} [Wed Oct 26 13:18:07 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2/os-interface => generated 1831 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:18:07.275036 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0bd7e77d-cc7e-4c36-b353-842294d593e6 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:07.284188 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0bd7e77d-cc7e-4c36-b353-842294d593e6 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd49ecfb3d5514177b2100631aa944200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c40ceb3374847ec8685b67f7c94a3c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:07.285170 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0bd7e77d-cc7e-4c36-b353-842294d593e6 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Searching by: {'deleted': False, 'project_id': '6c40ceb3374847ec8685b67f7c94a3c7'} {{(pid=120597) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:18:07.308350 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0bd7e77d-cc7e-4c36-b353-842294d593e6 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:07.309007 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0bd7e77d-cc7e-4c36-b353-842294d593e6 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:07.309604 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0bd7e77d-cc7e-4c36-b353-842294d593e6 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:07.310886 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0bd7e77d-cc7e-4c36-b353-842294d593e6 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:07.311422 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0bd7e77d-cc7e-4c36-b353-842294d593e6 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:07.312068 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0bd7e77d-cc7e-4c36-b353-842294d593e6 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:07.345421 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0bd7e77d-cc7e-4c36-b353-842294d593e6 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.082543 Oct 26 13:18:07.346469 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1855/3732] 10.222.0.40 () {58 vars in 1125 bytes} [Wed Oct 26 13:18:07 2022] GET /compute/v2.1/servers => generated 677 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:18:07.361172 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b5989ded-c6af-46d5-95df-b9ddbe231bd6 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:07.362186 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b5989ded-c6af-46d5-95df-b9ddbe231bd6 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: c61efb26-4f8c-470d-b0b2-ad428f1c7458] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:07.377609 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:18:07.525160 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b5989ded-c6af-46d5-95df-b9ddbe231bd6 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49ecfb3d5514177b2100631aa944200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c40ceb3374847ec8685b67f7c94a3c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:07.538462 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b5989ded-c6af-46d5-95df-b9ddbe231bd6 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] 10.222.0.40 "GET /compute/v2.1/servers/c61efb26-4f8c-470d-b0b2-ad428f1c7458" status: 200 len: 1220 microversion: 2.1 time: 0.181385 Oct 26 13:18:07.556313 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1856/3733] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:07 2022] GET /compute/v2.1/servers/c61efb26-4f8c-470d-b0b2-ad428f1c7458 => generated 1220 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:07.582821 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-253c0155-6bea-45c2-830b-1a1b3383715f tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:07.583341 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-253c0155-6bea-45c2-830b-1a1b3383715f tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:07.627255 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-253c0155-6bea-45c2-830b-1a1b3383715f tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:07.630745 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-253c0155-6bea-45c2-830b-1a1b3383715f tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:07.631317 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-253c0155-6bea-45c2-830b-1a1b3383715f tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:07.633267 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-253c0155-6bea-45c2-830b-1a1b3383715f tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:07.634066 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-253c0155-6bea-45c2-830b-1a1b3383715f tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:07.634210 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-253c0155-6bea-45c2-830b-1a1b3383715f tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:08.214248 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-54528177-7f8c-4421-b1c7-af9e465b25c3 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:08.227505 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-54528177-7f8c-4421-b1c7-af9e465b25c3 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6" status: 200 len: 1313 microversion: 2.1 time: 1.059352 Oct 26 13:18:08.246717 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1878/3734] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:07 2022] GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 => generated 1313 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:08.253930 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-beb93459-d7dd-40be-997c-2527efdb545a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:08.267484 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-beb93459-d7dd-40be-997c-2527efdb545a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:08.290948 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-beb93459-d7dd-40be-997c-2527efdb545a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:08.293011 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-beb93459-d7dd-40be-997c-2527efdb545a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:08.293850 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-beb93459-d7dd-40be-997c-2527efdb545a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:08.298109 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-beb93459-d7dd-40be-997c-2527efdb545a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:08.301153 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-beb93459-d7dd-40be-997c-2527efdb545a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:08.301911 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-beb93459-d7dd-40be-997c-2527efdb545a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:08.398285 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-253c0155-6bea-45c2-830b-1a1b3383715f tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:08.411527 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-253c0155-6bea-45c2-830b-1a1b3383715f tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c" status: 200 len: 1362 microversion: 2.1 time: 0.851360 Oct 26 13:18:08.430246 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1857/3735] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:07 2022] GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c => generated 1362 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:08.437188 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9a0ae111-a160-4f8b-aac1-792e5f4152e0 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:08.453235 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9a0ae111-a160-4f8b-aac1-792e5f4152e0 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:08.471386 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9a0ae111-a160-4f8b-aac1-792e5f4152e0 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:08.472209 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9a0ae111-a160-4f8b-aac1-792e5f4152e0 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:08.475216 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9a0ae111-a160-4f8b-aac1-792e5f4152e0 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:08.476046 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9a0ae111-a160-4f8b-aac1-792e5f4152e0 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:08.476521 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9a0ae111-a160-4f8b-aac1-792e5f4152e0 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:08.477260 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9a0ae111-a160-4f8b-aac1-792e5f4152e0 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:08.885476 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9a0ae111-a160-4f8b-aac1-792e5f4152e0 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:08.893860 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9a0ae111-a160-4f8b-aac1-792e5f4152e0 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1381 microversion: 2.1 time: 0.466888 Oct 26 13:18:08.933616 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1858/3736] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:08 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1381 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:08.953220 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d8272bfc-2b1a-447b-ab3a-527dc05ac3b4 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:08.958009 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d8272bfc-2b1a-447b-ab3a-527dc05ac3b4 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:08.974603 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8272bfc-2b1a-447b-ab3a-527dc05ac3b4 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:08.978582 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8272bfc-2b1a-447b-ab3a-527dc05ac3b4 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:08.979841 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8272bfc-2b1a-447b-ab3a-527dc05ac3b4 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:08.980582 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8272bfc-2b1a-447b-ab3a-527dc05ac3b4 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:08.981043 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8272bfc-2b1a-447b-ab3a-527dc05ac3b4 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:08.983300 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8272bfc-2b1a-447b-ab3a-527dc05ac3b4 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:09.427064 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d8272bfc-2b1a-447b-ab3a-527dc05ac3b4 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:09.437430 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-beb93459-d7dd-40be-997c-2527efdb545a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:09.444140 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d8272bfc-2b1a-447b-ab3a-527dc05ac3b4 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9" status: 200 len: 1557 microversion: 2.1 time: 0.508646 Oct 26 13:18:09.445193 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1859/3737] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:08 2022] GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 => generated 1557 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:09.451998 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-beb93459-d7dd-40be-997c-2527efdb545a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1525 microversion: 2.1 time: 1.209776 Oct 26 13:18:09.452921 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1879/3738] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:08 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1525 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:09.453795 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-89319efa-e0a3-47e7-9312-24ae0cd19186 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:09.454746 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-89319efa-e0a3-47e7-9312-24ae0cd19186 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: c61efb26-4f8c-470d-b0b2-ad428f1c7458] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:09.462072 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89319efa-e0a3-47e7-9312-24ae0cd19186 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:09.462738 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-198e1f2a-66ce-42e2-b51e-de3c25af847f tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Calling method '.version_select at 0x7f67318e05e0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:09.463121 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89319efa-e0a3-47e7-9312-24ae0cd19186 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:09.463798 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89319efa-e0a3-47e7-9312-24ae0cd19186 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:09.464823 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89319efa-e0a3-47e7-9312-24ae0cd19186 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:09.466270 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89319efa-e0a3-47e7-9312-24ae0cd19186 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:09.467513 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89319efa-e0a3-47e7-9312-24ae0cd19186 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:09.484753 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-198e1f2a-66ce-42e2-b51e-de3c25af847f tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:09.485646 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-198e1f2a-66ce-42e2-b51e-de3c25af847f tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:09.487446 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-198e1f2a-66ce-42e2-b51e-de3c25af847f tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:09.510474 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-198e1f2a-66ce-42e2-b51e-de3c25af847f tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 1553 microversion: 2.1 time: 0.052723 Oct 26 13:18:09.513103 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1880/3739] 10.222.0.40 () {58 vars in 1143 bytes} [Wed Oct 26 13:18:09 2022] GET /compute/v2.1/os-migrations => generated 1553 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:09.527852 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-dd90f7bc-795f-4582-9a12-eccf3ba95e50 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:09.532427 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-dd90f7bc-795f-4582-9a12-eccf3ba95e50 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:09.572459 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dd90f7bc-795f-4582-9a12-eccf3ba95e50 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:09.573738 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dd90f7bc-795f-4582-9a12-eccf3ba95e50 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:09.575316 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dd90f7bc-795f-4582-9a12-eccf3ba95e50 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:09.579679 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dd90f7bc-795f-4582-9a12-eccf3ba95e50 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:09.580784 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dd90f7bc-795f-4582-9a12-eccf3ba95e50 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:09.582892 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dd90f7bc-795f-4582-9a12-eccf3ba95e50 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:09.625408 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-89319efa-e0a3-47e7-9312-24ae0cd19186 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49ecfb3d5514177b2100631aa944200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c40ceb3374847ec8685b67f7c94a3c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:09.645145 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-89319efa-e0a3-47e7-9312-24ae0cd19186 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] 10.222.0.40 "GET /compute/v2.1/servers/c61efb26-4f8c-470d-b0b2-ad428f1c7458" status: 200 len: 1272 microversion: 2.1 time: 0.195792 Oct 26 13:18:09.657189 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1860/3740] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:09 2022] GET /compute/v2.1/servers/c61efb26-4f8c-470d-b0b2-ad428f1c7458 => generated 1272 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:09.689517 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ceb6adf7-5f0c-44ad-b60e-3f4edd24c5e0 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:09.695763 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ceb6adf7-5f0c-44ad-b60e-3f4edd24c5e0 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:09.714128 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ceb6adf7-5f0c-44ad-b60e-3f4edd24c5e0 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:09.716136 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ceb6adf7-5f0c-44ad-b60e-3f4edd24c5e0 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:09.716670 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ceb6adf7-5f0c-44ad-b60e-3f4edd24c5e0 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:09.718270 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ceb6adf7-5f0c-44ad-b60e-3f4edd24c5e0 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:09.720075 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ceb6adf7-5f0c-44ad-b60e-3f4edd24c5e0 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:09.721370 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ceb6adf7-5f0c-44ad-b60e-3f4edd24c5e0 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:10.417565 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ceb6adf7-5f0c-44ad-b60e-3f4edd24c5e0 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:10.429493 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-dd90f7bc-795f-4582-9a12-eccf3ba95e50 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:10.439663 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-dd90f7bc-795f-4582-9a12-eccf3ba95e50 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6" status: 200 len: 1313 microversion: 2.1 time: 0.921909 Oct 26 13:18:10.440534 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ceb6adf7-5f0c-44ad-b60e-3f4edd24c5e0 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c" status: 200 len: 1362 microversion: 2.1 time: 0.770852 Oct 26 13:18:10.441953 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1861/3741] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:09 2022] GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c => generated 1362 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:10.447982 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-36c23034-becf-4f3c-a62c-42e0659afe3d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:10.448821 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1881/3742] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:09 2022] GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 => generated 1313 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:10.449985 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-36c23034-becf-4f3c-a62c-42e0659afe3d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:10.470827 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-36c23034-becf-4f3c-a62c-42e0659afe3d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:10.471652 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-36c23034-becf-4f3c-a62c-42e0659afe3d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:10.472034 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e6cde154-3839-4332-91dd-030fe063c2ee tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:10.472508 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-36c23034-becf-4f3c-a62c-42e0659afe3d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:10.473607 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-36c23034-becf-4f3c-a62c-42e0659afe3d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:10.475439 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-36c23034-becf-4f3c-a62c-42e0659afe3d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:10.476066 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-36c23034-becf-4f3c-a62c-42e0659afe3d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:10.477925 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e6cde154-3839-4332-91dd-030fe063c2ee tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:10.502910 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6cde154-3839-4332-91dd-030fe063c2ee tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:10.503413 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6cde154-3839-4332-91dd-030fe063c2ee tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:10.503859 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6cde154-3839-4332-91dd-030fe063c2ee tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:10.511403 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6cde154-3839-4332-91dd-030fe063c2ee tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:10.511943 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6cde154-3839-4332-91dd-030fe063c2ee tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:10.517419 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6cde154-3839-4332-91dd-030fe063c2ee tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:10.611720 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-36c23034-becf-4f3c-a62c-42e0659afe3d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.168306 Oct 26 13:18:10.614303 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1862/3743] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 26 13:18:10 2022] GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9/os-interface => generated 284 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:18:10.624253 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dc2b1e7a-3e3f-4c4a-9d60-ac34ce425e71 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:10.625312 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-dc2b1e7a-3e3f-4c4a-9d60-ac34ce425e71 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:10.640996 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc2b1e7a-3e3f-4c4a-9d60-ac34ce425e71 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:10.646032 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc2b1e7a-3e3f-4c4a-9d60-ac34ce425e71 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:10.648094 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc2b1e7a-3e3f-4c4a-9d60-ac34ce425e71 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:10.649796 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc2b1e7a-3e3f-4c4a-9d60-ac34ce425e71 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:10.654135 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc2b1e7a-3e3f-4c4a-9d60-ac34ce425e71 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:10.655846 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc2b1e7a-3e3f-4c4a-9d60-ac34ce425e71 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:11.038643 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-dc2b1e7a-3e3f-4c4a-9d60-ac34ce425e71 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:11.056169 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-dc2b1e7a-3e3f-4c4a-9d60-ac34ce425e71 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1525 microversion: 2.1 time: 0.440449 Oct 26 13:18:11.056789 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1863/3744] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:10 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1525 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:11.061456 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e6cde154-3839-4332-91dd-030fe063c2ee tempest-LiveMigrationTest-1957473482 tempest-LiveMigrationTest-1957473482-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1532 microversion: 2.1 time: 0.610672 Oct 26 13:18:11.062610 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1882/3745] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:10 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1532 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:11.086721 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-40daa4bc-f008-4450-bca6-15a52fc7470c tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:11.087545 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-40daa4bc-f008-4450-bca6-15a52fc7470c tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: c61efb26-4f8c-470d-b0b2-ad428f1c7458] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:11.117763 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-40daa4bc-f008-4450-bca6-15a52fc7470c tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:11.119291 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-40daa4bc-f008-4450-bca6-15a52fc7470c tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:11.119762 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-40daa4bc-f008-4450-bca6-15a52fc7470c tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:11.120503 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-40daa4bc-f008-4450-bca6-15a52fc7470c tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:11.126227 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-40daa4bc-f008-4450-bca6-15a52fc7470c tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:11.132062 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-40daa4bc-f008-4450-bca6-15a52fc7470c tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:11.137026 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b6be5fb7-b87d-459f-8690-0324110f09ef tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:11.137793 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b6be5fb7-b87d-459f-8690-0324110f09ef tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:11.149440 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b6be5fb7-b87d-459f-8690-0324110f09ef tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:11.153979 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b6be5fb7-b87d-459f-8690-0324110f09ef tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:11.154932 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b6be5fb7-b87d-459f-8690-0324110f09ef tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:11.157003 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b6be5fb7-b87d-459f-8690-0324110f09ef tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:11.157773 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b6be5fb7-b87d-459f-8690-0324110f09ef tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:11.159267 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b6be5fb7-b87d-459f-8690-0324110f09ef tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:11.204604 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:18:11.293992 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b6be5fb7-b87d-459f-8690-0324110f09ef tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:18:11.518432 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b6be5fb7-b87d-459f-8690-0324110f09ef tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 204 len: 0 microversion: 2.1 time: 0.386833 Oct 26 13:18:11.524496 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1883/3746] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:18:11 2022] DELETE /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:18:11.554948 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-4036d978-7a1b-4ec5-b0e6-e27c544183ea req-7056b703-cb5a-4f6b-bfd7-f410a5264eb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8551999d-fecc-4f6b-9e0a-c524ce5e96e6", "name": "network-vif-plugged", "status": "completed", "tag": "93e5472f-fae2-476e-aeb5-be62761a9511"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:18:11.601439 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-4036d978-7a1b-4ec5-b0e6-e27c544183ea req-7056b703-cb5a-4f6b-bfd7-f410a5264eb9 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:11.602609 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-4036d978-7a1b-4ec5-b0e6-e27c544183ea req-7056b703-cb5a-4f6b-bfd7-f410a5264eb9 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:11.603027 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-4036d978-7a1b-4ec5-b0e6-e27c544183ea req-7056b703-cb5a-4f6b-bfd7-f410a5264eb9 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:11.646750 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-4036d978-7a1b-4ec5-b0e6-e27c544183ea req-7056b703-cb5a-4f6b-bfd7-f410a5264eb9 service nova] Creating event network-vif-plugged:93e5472f-fae2-476e-aeb5-be62761a9511 for instance 8551999d-fecc-4f6b-9e0a-c524ce5e96e6 on n-h2-862686-1 Oct 26 13:18:11.659073 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-4036d978-7a1b-4ec5-b0e6-e27c544183ea req-7056b703-cb5a-4f6b-bfd7-f410a5264eb9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130301 Oct 26 13:18:11.660043 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1884/3747] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:18:11.680978 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d47c43ac-6f24-4210-afce-1469a95711b9 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:11.681740 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d47c43ac-6f24-4210-afce-1469a95711b9 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:11.706305 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d47c43ac-6f24-4210-afce-1469a95711b9 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:11.706804 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d47c43ac-6f24-4210-afce-1469a95711b9 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:11.707246 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d47c43ac-6f24-4210-afce-1469a95711b9 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:11.708032 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d47c43ac-6f24-4210-afce-1469a95711b9 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:11.708551 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d47c43ac-6f24-4210-afce-1469a95711b9 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:11.709031 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d47c43ac-6f24-4210-afce-1469a95711b9 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:12.102130 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d47c43ac-6f24-4210-afce-1469a95711b9 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:12.114475 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d47c43ac-6f24-4210-afce-1469a95711b9 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c" status: 200 len: 1362 microversion: 2.1 time: 0.452554 Oct 26 13:18:12.117138 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1885/3748] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:11 2022] GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c => generated 1362 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:12.126166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-56110988-d6d9-4234-9c6f-319a440830cc tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:12.126790 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-56110988-d6d9-4234-9c6f-319a440830cc tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:12.140263 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-56110988-d6d9-4234-9c6f-319a440830cc tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:12.140874 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-56110988-d6d9-4234-9c6f-319a440830cc tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:12.141466 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-56110988-d6d9-4234-9c6f-319a440830cc tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:12.148980 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-56110988-d6d9-4234-9c6f-319a440830cc tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:12.151619 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-56110988-d6d9-4234-9c6f-319a440830cc tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:12.152102 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-56110988-d6d9-4234-9c6f-319a440830cc tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:12.472876 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-40daa4bc-f008-4450-bca6-15a52fc7470c tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49ecfb3d5514177b2100631aa944200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c40ceb3374847ec8685b67f7c94a3c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:12.498101 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-40daa4bc-f008-4450-bca6-15a52fc7470c tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] 10.222.0.40 "GET /compute/v2.1/servers/c61efb26-4f8c-470d-b0b2-ad428f1c7458" status: 200 len: 1278 microversion: 2.1 time: 1.421551 Oct 26 13:18:12.499672 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1864/3749] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:11 2022] GET /compute/v2.1/servers/c61efb26-4f8c-470d-b0b2-ad428f1c7458 => generated 1278 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:12.507644 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c200d050-039c-4466-b9e8-b1bf727cf4bd tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:12.508038 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c200d050-039c-4466-b9e8-b1bf727cf4bd tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:12.516165 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c200d050-039c-4466-b9e8-b1bf727cf4bd tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:12.516932 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c200d050-039c-4466-b9e8-b1bf727cf4bd tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:12.517571 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c200d050-039c-4466-b9e8-b1bf727cf4bd tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:12.518901 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c200d050-039c-4466-b9e8-b1bf727cf4bd tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:12.519611 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c200d050-039c-4466-b9e8-b1bf727cf4bd tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:12.519611 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c200d050-039c-4466-b9e8-b1bf727cf4bd tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:12.790404 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c200d050-039c-4466-b9e8-b1bf727cf4bd tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:12.805835 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c200d050-039c-4466-b9e8-b1bf727cf4bd tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1387 microversion: 2.1 time: 0.304308 Oct 26 13:18:12.808539 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1865/3750] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:12 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1387 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:12.825549 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-42ff0f6b-498e-478d-87f1-581388d3f54d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:12.826144 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-42ff0f6b-498e-478d-87f1-581388d3f54d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:12.837519 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-42ff0f6b-498e-478d-87f1-581388d3f54d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:12.838031 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-42ff0f6b-498e-478d-87f1-581388d3f54d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:12.838480 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-42ff0f6b-498e-478d-87f1-581388d3f54d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:12.839192 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-42ff0f6b-498e-478d-87f1-581388d3f54d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:12.839659 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-42ff0f6b-498e-478d-87f1-581388d3f54d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:12.840083 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-42ff0f6b-498e-478d-87f1-581388d3f54d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:12.967914 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-56110988-d6d9-4234-9c6f-319a440830cc tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:13.000939 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-56110988-d6d9-4234-9c6f-319a440830cc tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6" status: 200 len: 1313 microversion: 2.1 time: 0.881590 Oct 26 13:18:13.016535 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1886/3751] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:12 2022] GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 => generated 1313 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:13.145324 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-42ff0f6b-498e-478d-87f1-581388d3f54d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:13.151624 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a9373f38-80ad-4ee8-9edb-d0be34d14d45 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:13.153761 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a9373f38-80ad-4ee8-9edb-d0be34d14d45 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:13.169957 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-42ff0f6b-498e-478d-87f1-581388d3f54d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1525 microversion: 2.1 time: 0.357091 Oct 26 13:18:13.174089 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1866/3752] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:12 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1525 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:13.174607 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a9373f38-80ad-4ee8-9edb-d0be34d14d45 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:13.175115 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a9373f38-80ad-4ee8-9edb-d0be34d14d45 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:13.182279 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a9373f38-80ad-4ee8-9edb-d0be34d14d45 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:13.186782 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a9373f38-80ad-4ee8-9edb-d0be34d14d45 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:13.187239 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a9373f38-80ad-4ee8-9edb-d0be34d14d45 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:13.187699 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a9373f38-80ad-4ee8-9edb-d0be34d14d45 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:13.250202 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-5b9523e7-54c6-4ffd-ac67-842c45cd4561 req-c7c95834-3600-4335-afad-0272295f2125 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "893420b7-27d9-4240-8182-87dd3231cbe2", "tag": "fdc12d04-26b7-4153-91a7-171ed0f8798d"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:18:13.271005 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-5b9523e7-54c6-4ffd-ac67-842c45cd4561 req-c7c95834-3600-4335-afad-0272295f2125 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:13.272139 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-5b9523e7-54c6-4ffd-ac67-842c45cd4561 req-c7c95834-3600-4335-afad-0272295f2125 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:13.272360 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-5b9523e7-54c6-4ffd-ac67-842c45cd4561 req-c7c95834-3600-4335-afad-0272295f2125 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:13.303818 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-5b9523e7-54c6-4ffd-ac67-842c45cd4561 req-c7c95834-3600-4335-afad-0272295f2125 service nova] Creating event network-changed:fdc12d04-26b7-4153-91a7-171ed0f8798d for instance 893420b7-27d9-4240-8182-87dd3231cbe2 on n-h1-862686-1 Oct 26 13:18:13.322396 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-5b9523e7-54c6-4ffd-ac67-842c45cd4561 req-c7c95834-3600-4335-afad-0272295f2125 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076307 Oct 26 13:18:13.326204 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1867/3753] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:18:13.527743 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a3a21d02-b86b-496f-b85f-b1a7ac7c46f2 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:13.529703 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a3a21d02-b86b-496f-b85f-b1a7ac7c46f2 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: c61efb26-4f8c-470d-b0b2-ad428f1c7458] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:13.541564 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a3a21d02-b86b-496f-b85f-b1a7ac7c46f2 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:13.547130 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a3a21d02-b86b-496f-b85f-b1a7ac7c46f2 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:13.548201 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a3a21d02-b86b-496f-b85f-b1a7ac7c46f2 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:13.550494 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a3a21d02-b86b-496f-b85f-b1a7ac7c46f2 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:13.551980 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a3a21d02-b86b-496f-b85f-b1a7ac7c46f2 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:13.554785 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a3a21d02-b86b-496f-b85f-b1a7ac7c46f2 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:13.558731 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a9373f38-80ad-4ee8-9edb-d0be34d14d45 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:13.570006 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a9373f38-80ad-4ee8-9edb-d0be34d14d45 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c" status: 200 len: 1362 microversion: 2.1 time: 0.428222 Oct 26 13:18:13.571543 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1887/3754] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:13 2022] GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c => generated 1362 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:18:13.831479 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-448749eb-e479-4f7a-b927-4d2bb46a52a6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:13.832363 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-448749eb-e479-4f7a-b927-4d2bb46a52a6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:13.849626 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-448749eb-e479-4f7a-b927-4d2bb46a52a6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:13.866398 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-448749eb-e479-4f7a-b927-4d2bb46a52a6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:13.867239 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-448749eb-e479-4f7a-b927-4d2bb46a52a6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:13.868681 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-448749eb-e479-4f7a-b927-4d2bb46a52a6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:13.869371 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-448749eb-e479-4f7a-b927-4d2bb46a52a6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:13.869999 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-448749eb-e479-4f7a-b927-4d2bb46a52a6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:13.997155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a3a21d02-b86b-496f-b85f-b1a7ac7c46f2 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49ecfb3d5514177b2100631aa944200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c40ceb3374847ec8685b67f7c94a3c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:14.008085 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a3a21d02-b86b-496f-b85f-b1a7ac7c46f2 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] 10.222.0.40 "GET /compute/v2.1/servers/c61efb26-4f8c-470d-b0b2-ad428f1c7458" status: 200 len: 1278 microversion: 2.1 time: 0.487498 Oct 26 13:18:14.019544 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1868/3755] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:13 2022] GET /compute/v2.1/servers/c61efb26-4f8c-470d-b0b2-ad428f1c7458 => generated 1278 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:18:14.042524 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fa2147b5-3f90-4ab6-a0b9-0034877fafef tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:14.043201 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fa2147b5-3f90-4ab6-a0b9-0034877fafef tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:14.076748 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa2147b5-3f90-4ab6-a0b9-0034877fafef tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:14.077311 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa2147b5-3f90-4ab6-a0b9-0034877fafef tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:14.077794 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa2147b5-3f90-4ab6-a0b9-0034877fafef tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:14.081597 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa2147b5-3f90-4ab6-a0b9-0034877fafef tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:14.085884 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa2147b5-3f90-4ab6-a0b9-0034877fafef tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:14.087911 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa2147b5-3f90-4ab6-a0b9-0034877fafef tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:14.158225 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-448749eb-e479-4f7a-b927-4d2bb46a52a6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:14.175208 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-448749eb-e479-4f7a-b927-4d2bb46a52a6 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1345 microversion: 2.1 time: 0.345585 Oct 26 13:18:14.176582 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1888/3756] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:13 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1345 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:14.187889 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-51f3faf9-649e-4053-95fb-d95994c54fa4 req-e463e4f9-5297-488b-a504-20dcf8517028 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59bb4f3c-d633-42db-b86b-274fa8b95f44", "name": "network-vif-plugged", "status": "completed", "tag": "1484b291-b3a0-410d-a1af-3a79c7d02eba"}, {"server_uuid": "9c1ed300-eac2-4e60-a903-2f17e7df792c", "name": "network-vif-plugged", "status": "completed", "tag": "3bb2a1a3-90e2-4559-a739-93834bf16890"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:18:14.256396 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-51f3faf9-649e-4053-95fb-d95994c54fa4 req-e463e4f9-5297-488b-a504-20dcf8517028 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:14.257569 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-51f3faf9-649e-4053-95fb-d95994c54fa4 req-e463e4f9-5297-488b-a504-20dcf8517028 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:14.258876 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-51f3faf9-649e-4053-95fb-d95994c54fa4 req-e463e4f9-5297-488b-a504-20dcf8517028 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:14.303440 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-51f3faf9-649e-4053-95fb-d95994c54fa4 req-e463e4f9-5297-488b-a504-20dcf8517028 service nova] Creating event network-vif-plugged:1484b291-b3a0-410d-a1af-3a79c7d02eba for instance 59bb4f3c-d633-42db-b86b-274fa8b95f44 on n-h1-862686-1 Oct 26 13:18:14.304536 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-51f3faf9-649e-4053-95fb-d95994c54fa4 req-e463e4f9-5297-488b-a504-20dcf8517028 service nova] Creating event network-vif-plugged:3bb2a1a3-90e2-4559-a739-93834bf16890 for instance 9c1ed300-eac2-4e60-a903-2f17e7df792c on n-h2-862686-1 Oct 26 13:18:14.314856 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-51f3faf9-649e-4053-95fb-d95994c54fa4 req-e463e4f9-5297-488b-a504-20dcf8517028 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.136781 Oct 26 13:18:14.316354 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1889/3757] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:18:14.325580 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-b335ea76-d1f3-4cf1-990c-df124b484397 req-f41d22a9-f87a-492e-b9fe-d275773f9dfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9", "tag": "3a104c30-3b08-4b47-ba9a-ae590f82e5ab"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:18:14.353057 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b335ea76-d1f3-4cf1-990c-df124b484397 req-f41d22a9-f87a-492e-b9fe-d275773f9dfe service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:14.354185 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b335ea76-d1f3-4cf1-990c-df124b484397 req-f41d22a9-f87a-492e-b9fe-d275773f9dfe service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:14.355662 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b335ea76-d1f3-4cf1-990c-df124b484397 req-f41d22a9-f87a-492e-b9fe-d275773f9dfe service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:14.384475 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-b335ea76-d1f3-4cf1-990c-df124b484397 req-f41d22a9-f87a-492e-b9fe-d275773f9dfe service nova] Creating event network-changed:3a104c30-3b08-4b47-ba9a-ae590f82e5ab for instance bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 on n-h1-862686-1 Oct 26 13:18:14.391370 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-b335ea76-d1f3-4cf1-990c-df124b484397 req-f41d22a9-f87a-492e-b9fe-d275773f9dfe service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072841 Oct 26 13:18:14.392578 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1890/3758] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:18:14.400950 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0984aee1-99c3-4c78-87e8-5287c5ea78d5 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:14.402523 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0984aee1-99c3-4c78-87e8-5287c5ea78d5 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:14.411490 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0984aee1-99c3-4c78-87e8-5287c5ea78d5 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:14.413033 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0984aee1-99c3-4c78-87e8-5287c5ea78d5 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:14.413723 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0984aee1-99c3-4c78-87e8-5287c5ea78d5 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:14.415990 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0984aee1-99c3-4c78-87e8-5287c5ea78d5 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:14.416741 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0984aee1-99c3-4c78-87e8-5287c5ea78d5 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:14.417367 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0984aee1-99c3-4c78-87e8-5287c5ea78d5 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:14.989573 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fa2147b5-3f90-4ab6-a0b9-0034877fafef tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:15.007103 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fa2147b5-3f90-4ab6-a0b9-0034877fafef tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6" status: 200 len: 1499 microversion: 2.1 time: 0.976571 Oct 26 13:18:15.021172 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1869/3759] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:14 2022] GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 => generated 1499 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:15.037087 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2e749147-919a-4967-bdab-1be79574a2e9 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:15.038139 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2e749147-919a-4967-bdab-1be79574a2e9 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:15.045369 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e749147-919a-4967-bdab-1be79574a2e9 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:15.046327 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e749147-919a-4967-bdab-1be79574a2e9 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:15.047097 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e749147-919a-4967-bdab-1be79574a2e9 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:15.048772 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e749147-919a-4967-bdab-1be79574a2e9 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:15.049460 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e749147-919a-4967-bdab-1be79574a2e9 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:15.050128 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e749147-919a-4967-bdab-1be79574a2e9 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:15.191161 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0984aee1-99c3-4c78-87e8-5287c5ea78d5 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:15.201649 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0984aee1-99c3-4c78-87e8-5287c5ea78d5 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1525 microversion: 2.1 time: 0.807327 Oct 26 13:18:15.206408 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1891/3760] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:14 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1525 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:15.216601 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-de7c3095-5c22-4455-abfb-ee63b0f4985b tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:18:15.225469 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-de7c3095-5c22-4455-abfb-ee63b0f4985b tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:15.235813 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de7c3095-5c22-4455-abfb-ee63b0f4985b tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:15.236441 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de7c3095-5c22-4455-abfb-ee63b0f4985b tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:15.238088 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de7c3095-5c22-4455-abfb-ee63b0f4985b tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:15.238912 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de7c3095-5c22-4455-abfb-ee63b0f4985b tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:15.248633 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de7c3095-5c22-4455-abfb-ee63b0f4985b tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:15.249203 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de7c3095-5c22-4455-abfb-ee63b0f4985b tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:15.291403 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-de7c3095-5c22-4455-abfb-ee63b0f4985b tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lazy-loading 'flavor' on Instance uuid 8551999d-fecc-4f6b-9e0a-c524ce5e96e6 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:18:15.425994 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-de7c3095-5c22-4455-abfb-ee63b0f4985b tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "POST /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6/action" status: 200 len: 32 microversion: 2.1 time: 0.217621 Oct 26 13:18:15.433887 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1892/3761] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:18:15 2022] POST /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6/action => generated 32 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:18:15.439977 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cdb32ab9-4ee7-4388-a576-8dce06a7a77c tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:15.441091 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cdb32ab9-4ee7-4388-a576-8dce06a7a77c tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: c61efb26-4f8c-470d-b0b2-ad428f1c7458] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:15.451462 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cdb32ab9-4ee7-4388-a576-8dce06a7a77c tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:15.452489 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cdb32ab9-4ee7-4388-a576-8dce06a7a77c tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:15.453297 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cdb32ab9-4ee7-4388-a576-8dce06a7a77c tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:15.454803 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cdb32ab9-4ee7-4388-a576-8dce06a7a77c tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:15.455546 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cdb32ab9-4ee7-4388-a576-8dce06a7a77c tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:15.456414 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cdb32ab9-4ee7-4388-a576-8dce06a7a77c tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:15.558732 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-cdb32ab9-4ee7-4388-a576-8dce06a7a77c tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49ecfb3d5514177b2100631aa944200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c40ceb3374847ec8685b67f7c94a3c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:15.576062 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cdb32ab9-4ee7-4388-a576-8dce06a7a77c tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] 10.222.0.40 "GET /compute/v2.1/servers/c61efb26-4f8c-470d-b0b2-ad428f1c7458" status: 200 len: 1278 microversion: 2.1 time: 0.137814 Oct 26 13:18:15.576683 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1893/3762] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:15 2022] GET /compute/v2.1/servers/c61efb26-4f8c-470d-b0b2-ad428f1c7458 => generated 1278 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:15.587579 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-31eced0e-c5e7-4723-a43e-9bcc9d47508b tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:15.588213 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-31eced0e-c5e7-4723-a43e-9bcc9d47508b tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:15.600635 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31eced0e-c5e7-4723-a43e-9bcc9d47508b tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:15.601137 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31eced0e-c5e7-4723-a43e-9bcc9d47508b tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:15.604653 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31eced0e-c5e7-4723-a43e-9bcc9d47508b tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:15.609617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31eced0e-c5e7-4723-a43e-9bcc9d47508b tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:15.610150 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31eced0e-c5e7-4723-a43e-9bcc9d47508b tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:15.610604 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31eced0e-c5e7-4723-a43e-9bcc9d47508b tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:15.624236 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:18:15.752237 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2e749147-919a-4967-bdab-1be79574a2e9 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:15.778044 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2e749147-919a-4967-bdab-1be79574a2e9 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c" status: 200 len: 1362 microversion: 2.1 time: 0.754822 Oct 26 13:18:15.784215 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1870/3763] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:15 2022] GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c => generated 1362 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:15.796942 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-8694a4fd-016a-4a2e-bb4c-da77e8c7dfd2 req-13646c5b-8740-4814-a647-8f47c29568bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7743d90-f9dc-4601-a6d3-a4901bf9cc05", "name": "network-vif-deleted", "tag": "cd05a893-6fb7-45ab-985e-5e98b6a0306b"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:18:15.829592 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-8694a4fd-016a-4a2e-bb4c-da77e8c7dfd2 req-13646c5b-8740-4814-a647-8f47c29568bc service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:15.832641 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-8694a4fd-016a-4a2e-bb4c-da77e8c7dfd2 req-13646c5b-8740-4814-a647-8f47c29568bc service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:15.833702 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-8694a4fd-016a-4a2e-bb4c-da77e8c7dfd2 req-13646c5b-8740-4814-a647-8f47c29568bc service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:15.871795 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-8694a4fd-016a-4a2e-bb4c-da77e8c7dfd2 req-13646c5b-8740-4814-a647-8f47c29568bc service nova] Creating event network-vif-deleted:cd05a893-6fb7-45ab-985e-5e98b6a0306b for instance b7743d90-f9dc-4601-a6d3-a4901bf9cc05 on n-h1-862686-1 Oct 26 13:18:15.881145 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-8694a4fd-016a-4a2e-bb4c-da77e8c7dfd2 req-13646c5b-8740-4814-a647-8f47c29568bc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094639 Oct 26 13:18:15.884806 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1871/3764] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:18:15.893297 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-84ca93a5-4b90-418f-8478-40a9ef7458e1 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:15.899723 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-84ca93a5-4b90-418f-8478-40a9ef7458e1 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:15.911972 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-84ca93a5-4b90-418f-8478-40a9ef7458e1 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:15.916726 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-84ca93a5-4b90-418f-8478-40a9ef7458e1 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:15.917558 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-84ca93a5-4b90-418f-8478-40a9ef7458e1 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:15.919172 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-84ca93a5-4b90-418f-8478-40a9ef7458e1 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:15.921695 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-84ca93a5-4b90-418f-8478-40a9ef7458e1 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:15.934590 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-84ca93a5-4b90-418f-8478-40a9ef7458e1 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:16.030254 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-31eced0e-c5e7-4723-a43e-9bcc9d47508b tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:16.054564 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-31eced0e-c5e7-4723-a43e-9bcc9d47508b tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1184 microversion: 2.1 time: 0.474493 Oct 26 13:18:16.062371 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1894/3765] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:15 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1184 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:16.246964 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-78a6cb4f-3f09-44d7-99d8-12bca6f4cd19 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:16.247764 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-78a6cb4f-3f09-44d7-99d8-12bca6f4cd19 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:16.266391 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78a6cb4f-3f09-44d7-99d8-12bca6f4cd19 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:16.267275 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78a6cb4f-3f09-44d7-99d8-12bca6f4cd19 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:16.267960 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78a6cb4f-3f09-44d7-99d8-12bca6f4cd19 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:16.268917 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78a6cb4f-3f09-44d7-99d8-12bca6f4cd19 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:16.269672 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78a6cb4f-3f09-44d7-99d8-12bca6f4cd19 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:16.270357 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78a6cb4f-3f09-44d7-99d8-12bca6f4cd19 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:16.735849 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:18:16.763238 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=26 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:18:16.874159 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-78a6cb4f-3f09-44d7-99d8-12bca6f4cd19 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:16.877006 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-84ca93a5-4b90-418f-8478-40a9ef7458e1 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:16.887250 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-78a6cb4f-3f09-44d7-99d8-12bca6f4cd19 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1525 microversion: 2.1 time: 0.644155 Oct 26 13:18:16.888834 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1895/3766] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:16 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1525 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:18:16.904606 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-84ca93a5-4b90-418f-8478-40a9ef7458e1 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6" status: 200 len: 1505 microversion: 2.1 time: 1.008075 Oct 26 13:18:16.904606 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1872/3767] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:15 2022] GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 => generated 1505 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:16.904606 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-00aa2950-9e93-4b6c-b85f-5bf10a58d6cd tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:16.905084 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-00aa2950-9e93-4b6c-b85f-5bf10a58d6cd tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: c61efb26-4f8c-470d-b0b2-ad428f1c7458] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:16.918442 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-00aa2950-9e93-4b6c-b85f-5bf10a58d6cd tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:16.918962 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3732b79b-59e8-4aa5-83b1-55bdb57c93d8 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:16.919118 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-00aa2950-9e93-4b6c-b85f-5bf10a58d6cd tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:16.919509 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-00aa2950-9e93-4b6c-b85f-5bf10a58d6cd tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:16.920217 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-00aa2950-9e93-4b6c-b85f-5bf10a58d6cd tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:16.920911 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3732b79b-59e8-4aa5-83b1-55bdb57c93d8 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:16.925724 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-00aa2950-9e93-4b6c-b85f-5bf10a58d6cd tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:16.926243 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-00aa2950-9e93-4b6c-b85f-5bf10a58d6cd tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:16.936876 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3732b79b-59e8-4aa5-83b1-55bdb57c93d8 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:16.938591 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3732b79b-59e8-4aa5-83b1-55bdb57c93d8 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:16.939244 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3732b79b-59e8-4aa5-83b1-55bdb57c93d8 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:16.940798 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3732b79b-59e8-4aa5-83b1-55bdb57c93d8 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:16.942841 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3732b79b-59e8-4aa5-83b1-55bdb57c93d8 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:16.943511 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3732b79b-59e8-4aa5-83b1-55bdb57c93d8 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:17.216440 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3732b79b-59e8-4aa5-83b1-55bdb57c93d8 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:17.225950 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3732b79b-59e8-4aa5-83b1-55bdb57c93d8 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c" status: 200 len: 1548 microversion: 2.1 time: 0.317402 Oct 26 13:18:17.236242 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1896/3768] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:16 2022] GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c => generated 1548 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:17.241810 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ca3080fd-9dd9-4b3a-bc89-cd1e2aed09a7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:17.242809 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ca3080fd-9dd9-4b3a-bc89-cd1e2aed09a7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:17.254735 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca3080fd-9dd9-4b3a-bc89-cd1e2aed09a7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:17.256105 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca3080fd-9dd9-4b3a-bc89-cd1e2aed09a7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:17.265132 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca3080fd-9dd9-4b3a-bc89-cd1e2aed09a7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:17.266459 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca3080fd-9dd9-4b3a-bc89-cd1e2aed09a7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:17.267167 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca3080fd-9dd9-4b3a-bc89-cd1e2aed09a7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:17.268231 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca3080fd-9dd9-4b3a-bc89-cd1e2aed09a7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:17.320775 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:18:17.391577 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ca3080fd-9dd9-4b3a-bc89-cd1e2aed09a7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:17.402788 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ca3080fd-9dd9-4b3a-bc89-cd1e2aed09a7 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1184 microversion: 2.1 time: 0.165035 Oct 26 13:18:17.403379 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1897/3769] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:17 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1184 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:17.417359 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-65409352-0825-4bd8-a57f-91f9c0e9bc92 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:17.420689 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-65409352-0825-4bd8-a57f-91f9c0e9bc92 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:17.432339 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65409352-0825-4bd8-a57f-91f9c0e9bc92 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:17.434025 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65409352-0825-4bd8-a57f-91f9c0e9bc92 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:17.434677 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65409352-0825-4bd8-a57f-91f9c0e9bc92 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:17.435667 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65409352-0825-4bd8-a57f-91f9c0e9bc92 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:17.439526 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65409352-0825-4bd8-a57f-91f9c0e9bc92 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:17.440258 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65409352-0825-4bd8-a57f-91f9c0e9bc92 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:17.457533 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-00aa2950-9e93-4b6c-b85f-5bf10a58d6cd tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49ecfb3d5514177b2100631aa944200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c40ceb3374847ec8685b67f7c94a3c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:17.479988 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-00aa2950-9e93-4b6c-b85f-5bf10a58d6cd tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] 10.222.0.40 "GET /compute/v2.1/servers/c61efb26-4f8c-470d-b0b2-ad428f1c7458" status: 200 len: 1320 microversion: 2.1 time: 0.579343 Oct 26 13:18:17.499961 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1873/3770] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:16 2022] GET /compute/v2.1/servers/c61efb26-4f8c-470d-b0b2-ad428f1c7458 => generated 1320 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:17.615317 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-65409352-0825-4bd8-a57f-91f9c0e9bc92 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.210821 Oct 26 13:18:17.616247 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1898/3771] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 26 13:18:17 2022] GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c/os-interface => generated 285 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:18:17.915281 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-921c1986-dd1b-4bde-b272-71988f6b77e9 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:17.917031 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-921c1986-dd1b-4bde-b272-71988f6b77e9 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:17.926155 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c5f92004-8547-4d29-a00c-6ab166d89da0 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:17.926770 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c5f92004-8547-4d29-a00c-6ab166d89da0 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:17.930041 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:18:17.935169 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-921c1986-dd1b-4bde-b272-71988f6b77e9 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:17.937316 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-921c1986-dd1b-4bde-b272-71988f6b77e9 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:17.940573 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c5f92004-8547-4d29-a00c-6ab166d89da0 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:17.940991 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-921c1986-dd1b-4bde-b272-71988f6b77e9 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:17.941613 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c5f92004-8547-4d29-a00c-6ab166d89da0 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:17.941965 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-921c1986-dd1b-4bde-b272-71988f6b77e9 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:17.942462 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c5f92004-8547-4d29-a00c-6ab166d89da0 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:17.942632 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-921c1986-dd1b-4bde-b272-71988f6b77e9 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:17.943549 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c5f92004-8547-4d29-a00c-6ab166d89da0 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:17.944136 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-921c1986-dd1b-4bde-b272-71988f6b77e9 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:17.945563 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c5f92004-8547-4d29-a00c-6ab166d89da0 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:17.948355 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c5f92004-8547-4d29-a00c-6ab166d89da0 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:18.299740 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-921c1986-dd1b-4bde-b272-71988f6b77e9 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:18.312844 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-921c1986-dd1b-4bde-b272-71988f6b77e9 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1525 microversion: 2.1 time: 0.403023 Oct 26 13:18:18.317159 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1874/3772] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:17 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1525 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:18.324256 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-5a7e4b17-bd04-4208-b033-83ce74ced751 req-c74b22b3-76cc-4ae0-911e-855a59d2b9c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9db9b3b9-b9cd-4fa1-8091-4c6ad1c26aba", "tag": "b9f05af1-d34e-4087-8153-7eb70c348110"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:18:18.347875 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-5a7e4b17-bd04-4208-b033-83ce74ced751 req-c74b22b3-76cc-4ae0-911e-855a59d2b9c4 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:18.352361 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-5a7e4b17-bd04-4208-b033-83ce74ced751 req-c74b22b3-76cc-4ae0-911e-855a59d2b9c4 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:18.356634 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-5a7e4b17-bd04-4208-b033-83ce74ced751 req-c74b22b3-76cc-4ae0-911e-855a59d2b9c4 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:18.383873 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-5a7e4b17-bd04-4208-b033-83ce74ced751 req-c74b22b3-76cc-4ae0-911e-855a59d2b9c4 service nova] Creating event network-changed:b9f05af1-d34e-4087-8153-7eb70c348110 for instance 9db9b3b9-b9cd-4fa1-8091-4c6ad1c26aba on n-h1-862686-1 Oct 26 13:18:18.393610 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-5a7e4b17-bd04-4208-b033-83ce74ced751 req-c74b22b3-76cc-4ae0-911e-855a59d2b9c4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074932 Oct 26 13:18:18.395713 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1875/3773] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:18:18.431629 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c5f92004-8547-4d29-a00c-6ab166d89da0 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:18.439860 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c74d2ae2-e3c4-4215-a93b-a273e4210884 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:18.440825 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c74d2ae2-e3c4-4215-a93b-a273e4210884 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:18.457075 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c5f92004-8547-4d29-a00c-6ab166d89da0 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6" status: 200 len: 1505 microversion: 2.1 time: 0.536498 Oct 26 13:18:18.459309 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c74d2ae2-e3c4-4215-a93b-a273e4210884 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:18.464663 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c74d2ae2-e3c4-4215-a93b-a273e4210884 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:18.465119 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1899/3774] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:17 2022] GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 => generated 1505 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:18:18.465977 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c74d2ae2-e3c4-4215-a93b-a273e4210884 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:18.466876 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c74d2ae2-e3c4-4215-a93b-a273e4210884 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:18.467496 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c74d2ae2-e3c4-4215-a93b-a273e4210884 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:18.468111 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c74d2ae2-e3c4-4215-a93b-a273e4210884 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:18.518226 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-037e8c68-ab67-4acc-9fd5-71a85c819447 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:18.518951 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-037e8c68-ab67-4acc-9fd5-71a85c819447 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: c61efb26-4f8c-470d-b0b2-ad428f1c7458] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:18.532871 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-037e8c68-ab67-4acc-9fd5-71a85c819447 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:18.536581 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-037e8c68-ab67-4acc-9fd5-71a85c819447 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:18.537285 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-037e8c68-ab67-4acc-9fd5-71a85c819447 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:18.538177 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-037e8c68-ab67-4acc-9fd5-71a85c819447 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:18.540226 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-037e8c68-ab67-4acc-9fd5-71a85c819447 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:18.547521 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-037e8c68-ab67-4acc-9fd5-71a85c819447 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:18.654315 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c74d2ae2-e3c4-4215-a93b-a273e4210884 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:18.667022 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c74d2ae2-e3c4-4215-a93b-a273e4210884 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1184 microversion: 2.1 time: 0.241005 Oct 26 13:18:18.667636 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1876/3775] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:18 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1184 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:18.677368 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-a6739055-f13d-4d5f-9533-84d67e97d92c req-85df1539-e6b8-4b0e-b49b-ad561a26056a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c61efb26-4f8c-470d-b0b2-ad428f1c7458", "tag": "a16e9360-e1a0-45d2-8c46-b724a446349d"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:18:18.696284 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a6739055-f13d-4d5f-9533-84d67e97d92c req-85df1539-e6b8-4b0e-b49b-ad561a26056a service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:18.701080 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a6739055-f13d-4d5f-9533-84d67e97d92c req-85df1539-e6b8-4b0e-b49b-ad561a26056a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:18.701740 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a6739055-f13d-4d5f-9533-84d67e97d92c req-85df1539-e6b8-4b0e-b49b-ad561a26056a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:18.725724 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-a6739055-f13d-4d5f-9533-84d67e97d92c req-85df1539-e6b8-4b0e-b49b-ad561a26056a service nova] Creating event network-changed:a16e9360-e1a0-45d2-8c46-b724a446349d for instance c61efb26-4f8c-470d-b0b2-ad428f1c7458 on n-h2-862686-1 Oct 26 13:18:18.739658 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-a6739055-f13d-4d5f-9533-84d67e97d92c req-85df1539-e6b8-4b0e-b49b-ad561a26056a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067777 Oct 26 13:18:18.741432 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1877/3776] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:18:18.799237 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-037e8c68-ab67-4acc-9fd5-71a85c819447 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49ecfb3d5514177b2100631aa944200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c40ceb3374847ec8685b67f7c94a3c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:18.807928 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-037e8c68-ab67-4acc-9fd5-71a85c819447 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] 10.222.0.40 "GET /compute/v2.1/servers/c61efb26-4f8c-470d-b0b2-ad428f1c7458" status: 200 len: 1320 microversion: 2.1 time: 0.293848 Oct 26 13:18:18.809179 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1900/3777] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:18 2022] GET /compute/v2.1/servers/c61efb26-4f8c-470d-b0b2-ad428f1c7458 => generated 1320 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:18:19.347971 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a646a5c4-5cce-4940-8ebd-4a459e2f2355 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:19.348579 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a646a5c4-5cce-4940-8ebd-4a459e2f2355 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:19.362743 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a646a5c4-5cce-4940-8ebd-4a459e2f2355 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:19.363518 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a646a5c4-5cce-4940-8ebd-4a459e2f2355 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:19.364127 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a646a5c4-5cce-4940-8ebd-4a459e2f2355 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:19.377824 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a646a5c4-5cce-4940-8ebd-4a459e2f2355 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:19.378503 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a646a5c4-5cce-4940-8ebd-4a459e2f2355 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:19.378984 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a646a5c4-5cce-4940-8ebd-4a459e2f2355 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:19.488155 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8be5d936-7767-4eff-a94d-9bb66a4238a4 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:19.489742 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8be5d936-7767-4eff-a94d-9bb66a4238a4 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:19.516208 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8be5d936-7767-4eff-a94d-9bb66a4238a4 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:19.523990 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8be5d936-7767-4eff-a94d-9bb66a4238a4 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:19.525710 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8be5d936-7767-4eff-a94d-9bb66a4238a4 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:19.529435 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8be5d936-7767-4eff-a94d-9bb66a4238a4 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:19.530219 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8be5d936-7767-4eff-a94d-9bb66a4238a4 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:19.531012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8be5d936-7767-4eff-a94d-9bb66a4238a4 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:19.608281 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a646a5c4-5cce-4940-8ebd-4a459e2f2355 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:19.628085 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a646a5c4-5cce-4940-8ebd-4a459e2f2355 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1525 microversion: 2.1 time: 0.273830 Oct 26 13:18:19.629151 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1878/3778] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:19 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1525 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:19.689789 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5ce39cb1-7937-4c43-8ab2-46e5c594d5ee tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:19.690681 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5ce39cb1-7937-4c43-8ab2-46e5c594d5ee tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:19.705297 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ce39cb1-7937-4c43-8ab2-46e5c594d5ee tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:19.706134 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ce39cb1-7937-4c43-8ab2-46e5c594d5ee tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:19.706740 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ce39cb1-7937-4c43-8ab2-46e5c594d5ee tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:19.707646 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ce39cb1-7937-4c43-8ab2-46e5c594d5ee tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:19.708276 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ce39cb1-7937-4c43-8ab2-46e5c594d5ee tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:19.708873 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ce39cb1-7937-4c43-8ab2-46e5c594d5ee tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:19.843058 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5ce39cb1-7937-4c43-8ab2-46e5c594d5ee tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:19.858443 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5ce39cb1-7937-4c43-8ab2-46e5c594d5ee tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1184 microversion: 2.1 time: 0.172817 Oct 26 13:18:19.873932 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1879/3779] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:19 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1184 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:18:19.885648 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fd3ed38b-e152-40d9-a6ed-6ad94d46a03a tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:19.886578 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fd3ed38b-e152-40d9-a6ed-6ad94d46a03a tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: c61efb26-4f8c-470d-b0b2-ad428f1c7458] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:19.893214 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd3ed38b-e152-40d9-a6ed-6ad94d46a03a tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:19.894006 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd3ed38b-e152-40d9-a6ed-6ad94d46a03a tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:19.894632 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd3ed38b-e152-40d9-a6ed-6ad94d46a03a tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:19.895514 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd3ed38b-e152-40d9-a6ed-6ad94d46a03a tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:19.896161 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd3ed38b-e152-40d9-a6ed-6ad94d46a03a tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:19.897013 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd3ed38b-e152-40d9-a6ed-6ad94d46a03a tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:20.158015 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fd3ed38b-e152-40d9-a6ed-6ad94d46a03a tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49ecfb3d5514177b2100631aa944200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c40ceb3374847ec8685b67f7c94a3c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:20.169901 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fd3ed38b-e152-40d9-a6ed-6ad94d46a03a tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] 10.222.0.40 "GET /compute/v2.1/servers/c61efb26-4f8c-470d-b0b2-ad428f1c7458" status: 200 len: 1320 microversion: 2.1 time: 0.294429 Oct 26 13:18:20.171168 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1880/3780] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:19 2022] GET /compute/v2.1/servers/c61efb26-4f8c-470d-b0b2-ad428f1c7458 => generated 1320 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:20.313759 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8be5d936-7767-4eff-a94d-9bb66a4238a4 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:20.329470 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8be5d936-7767-4eff-a94d-9bb66a4238a4 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6" status: 200 len: 1505 microversion: 2.1 time: 0.845020 Oct 26 13:18:20.333221 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1901/3781] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:19 2022] GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 => generated 1505 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:18:20.451982 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-51f27760-30f8-4d47-aed2-68e1c20499d2 req-af16fc46-ad56-43a7-a555-304e520bd9ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c1ed300-eac2-4e60-a903-2f17e7df792c", "tag": "3bb2a1a3-90e2-4559-a739-93834bf16890"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:18:20.475814 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-51f27760-30f8-4d47-aed2-68e1c20499d2 req-af16fc46-ad56-43a7-a555-304e520bd9ec service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:20.478199 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-51f27760-30f8-4d47-aed2-68e1c20499d2 req-af16fc46-ad56-43a7-a555-304e520bd9ec service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:20.478650 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-51f27760-30f8-4d47-aed2-68e1c20499d2 req-af16fc46-ad56-43a7-a555-304e520bd9ec service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:20.500196 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-51f27760-30f8-4d47-aed2-68e1c20499d2 req-af16fc46-ad56-43a7-a555-304e520bd9ec service nova] Creating event network-changed:3bb2a1a3-90e2-4559-a739-93834bf16890 for instance 9c1ed300-eac2-4e60-a903-2f17e7df792c on n-h2-862686-1 Oct 26 13:18:20.517086 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-51f27760-30f8-4d47-aed2-68e1c20499d2 req-af16fc46-ad56-43a7-a555-304e520bd9ec service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068636 Oct 26 13:18:20.518384 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1881/3782] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:18:20.654582 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3373f6d8-da9a-4d72-b53a-830634fbda0d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:20.656263 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3373f6d8-da9a-4d72-b53a-830634fbda0d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:20.673188 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3373f6d8-da9a-4d72-b53a-830634fbda0d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:20.676052 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3373f6d8-da9a-4d72-b53a-830634fbda0d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:20.676807 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3373f6d8-da9a-4d72-b53a-830634fbda0d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:20.684131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3373f6d8-da9a-4d72-b53a-830634fbda0d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:20.685384 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3373f6d8-da9a-4d72-b53a-830634fbda0d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:20.686572 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3373f6d8-da9a-4d72-b53a-830634fbda0d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:20.887280 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-05c23a95-18ae-46a1-9481-74065e9bb909 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:20.887996 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-05c23a95-18ae-46a1-9481-74065e9bb909 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:20.901465 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05c23a95-18ae-46a1-9481-74065e9bb909 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:20.902000 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05c23a95-18ae-46a1-9481-74065e9bb909 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:20.902446 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05c23a95-18ae-46a1-9481-74065e9bb909 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:20.903168 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05c23a95-18ae-46a1-9481-74065e9bb909 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:20.903633 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05c23a95-18ae-46a1-9481-74065e9bb909 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:20.904067 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05c23a95-18ae-46a1-9481-74065e9bb909 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:21.043613 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3373f6d8-da9a-4d72-b53a-830634fbda0d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:21.055462 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3373f6d8-da9a-4d72-b53a-830634fbda0d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1525 microversion: 2.1 time: 0.403334 Oct 26 13:18:21.055684 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1902/3783] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:20 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1525 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:21.201564 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-34bbb209-74c0-42fe-9600-e27a759b3429 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:21.202111 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-34bbb209-74c0-42fe-9600-e27a759b3429 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: c61efb26-4f8c-470d-b0b2-ad428f1c7458] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:21.219747 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-34bbb209-74c0-42fe-9600-e27a759b3429 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:21.222219 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-34bbb209-74c0-42fe-9600-e27a759b3429 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:21.222689 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-34bbb209-74c0-42fe-9600-e27a759b3429 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:21.225358 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-34bbb209-74c0-42fe-9600-e27a759b3429 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:21.228261 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-34bbb209-74c0-42fe-9600-e27a759b3429 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:21.238751 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-34bbb209-74c0-42fe-9600-e27a759b3429 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:21.439329 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-34bbb209-74c0-42fe-9600-e27a759b3429 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49ecfb3d5514177b2100631aa944200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c40ceb3374847ec8685b67f7c94a3c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:21.448282 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-34bbb209-74c0-42fe-9600-e27a759b3429 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] 10.222.0.40 "GET /compute/v2.1/servers/c61efb26-4f8c-470d-b0b2-ad428f1c7458" status: 200 len: 1320 microversion: 2.1 time: 0.252164 Oct 26 13:18:21.453627 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1903/3784] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:21 2022] GET /compute/v2.1/servers/c61efb26-4f8c-470d-b0b2-ad428f1c7458 => generated 1320 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:21.470818 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-82a8b708-d455-4225-acbb-b3acf9ad0e88 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:21.471844 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-82a8b708-d455-4225-acbb-b3acf9ad0e88 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:21.474162 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:18:21.494305 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-82a8b708-d455-4225-acbb-b3acf9ad0e88 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:21.497208 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-82a8b708-d455-4225-acbb-b3acf9ad0e88 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:21.497847 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-82a8b708-d455-4225-acbb-b3acf9ad0e88 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:21.498702 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-82a8b708-d455-4225-acbb-b3acf9ad0e88 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:21.502129 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-82a8b708-d455-4225-acbb-b3acf9ad0e88 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:21.502822 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-82a8b708-d455-4225-acbb-b3acf9ad0e88 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:21.579194 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-05c23a95-18ae-46a1-9481-74065e9bb909 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:21.588048 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-05c23a95-18ae-46a1-9481-74065e9bb909 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 200 len: 1184 microversion: 2.1 time: 0.705941 Oct 26 13:18:21.610000 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1882/3785] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:20 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 1184 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:18:21.779817 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-82a8b708-d455-4225-acbb-b3acf9ad0e88 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:21.792046 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-82a8b708-d455-4225-acbb-b3acf9ad0e88 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6" status: 200 len: 1505 microversion: 2.1 time: 0.336829 Oct 26 13:18:21.792833 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1904/3786] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:21 2022] GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 => generated 1505 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:22.080581 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6c91e5b9-1bc9-4f86-b0d2-1bfaea756f3b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:22.081905 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6c91e5b9-1bc9-4f86-b0d2-1bfaea756f3b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:22.089331 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6c91e5b9-1bc9-4f86-b0d2-1bfaea756f3b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:22.090843 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6c91e5b9-1bc9-4f86-b0d2-1bfaea756f3b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:22.091841 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6c91e5b9-1bc9-4f86-b0d2-1bfaea756f3b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:22.092652 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6c91e5b9-1bc9-4f86-b0d2-1bfaea756f3b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:22.093245 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6c91e5b9-1bc9-4f86-b0d2-1bfaea756f3b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:22.093801 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6c91e5b9-1bc9-4f86-b0d2-1bfaea756f3b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:22.311220 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6c91e5b9-1bc9-4f86-b0d2-1bfaea756f3b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:22.319564 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6c91e5b9-1bc9-4f86-b0d2-1bfaea756f3b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1525 microversion: 2.1 time: 0.243078 Oct 26 13:18:22.320171 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1883/3787] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:22 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1525 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:22.479045 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-03276337-4c65-4756-a4d4-0d357938467a tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:22.480063 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-03276337-4c65-4756-a4d4-0d357938467a tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: c61efb26-4f8c-470d-b0b2-ad428f1c7458] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:22.488461 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03276337-4c65-4756-a4d4-0d357938467a tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:22.489833 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03276337-4c65-4756-a4d4-0d357938467a tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:22.490506 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03276337-4c65-4756-a4d4-0d357938467a tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:22.491499 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03276337-4c65-4756-a4d4-0d357938467a tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:22.492862 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03276337-4c65-4756-a4d4-0d357938467a tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:22.493546 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03276337-4c65-4756-a4d4-0d357938467a tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:22.621796 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-12ad3f26-3812-45ca-9cae-5b9d6e107b80 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:22.623205 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-12ad3f26-3812-45ca-9cae-5b9d6e107b80 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: b7743d90-f9dc-4601-a6d3-a4901bf9cc05] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:22.635658 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-12ad3f26-3812-45ca-9cae-5b9d6e107b80 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:22.636680 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-12ad3f26-3812-45ca-9cae-5b9d6e107b80 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:22.637321 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-12ad3f26-3812-45ca-9cae-5b9d6e107b80 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:22.638396 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-12ad3f26-3812-45ca-9cae-5b9d6e107b80 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:22.639938 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-12ad3f26-3812-45ca-9cae-5b9d6e107b80 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:22.640571 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-12ad3f26-3812-45ca-9cae-5b9d6e107b80 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:22.647235 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:18:22.668255 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-12ad3f26-3812-45ca-9cae-5b9d6e107b80 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] HTTP exception thrown: Instance b7743d90-f9dc-4601-a6d3-a4901bf9cc05 could not be found. Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-12ad3f26-3812-45ca-9cae-5b9d6e107b80 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Request method failure captured: Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 HTTP/1.1 Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTIDulnGf0cfDzb6ABf0P9I0OR8ZAxrEjf3dsSmpUDBvfTi0mRMx4cnhHxwYFoMK39PFCBGQwWgxaNanJAX2G7nZO-H0M0Y6hwrlddJMmZCT53RGEg2CCJF8JIuVVNqAQoy1FBD1Oqrvpehc-uuXoY42tDl5BuJKOtwJ5b-GC60JvCw Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 4f1ce8734839480ca6b07416a9c6d9c3 Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-LiveMigrationTest-1487865039 Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4f1ce8734839480ca6b07416a9c6d9c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4f1ce8734839480ca6b07416a9c6d9c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4f1ce8734839480ca6b07416a9c6d9c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4f1ce8734839480ca6b07416a9c6d9c3"}]}] Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-LiveMigrationTest-1487865039 Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 4f1ce8734839480ca6b07416a9c6d9c3 Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-LiveMigrationTest-1487865039 Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-LiveMigrationTest-1487865039-project Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: f96da2e13ca64db2a16d58aee1fc921d Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-LiveMigrationTest-1487865039-project Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance b7743d90-f9dc-4601-a6d3-a4901bf9cc05 could not be found. Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'b7743d90-f9dc-4601-a6d3-a4901bf9cc05'} Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7743d90-f9dc-4601-a6d3-a4901bf9cc05 could not be found. Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7743d90-f9dc-4601-a6d3-a4901bf9cc05 could not be found. Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:18:22.673160 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:18:22.678948 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:18:22.678948 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:18:22.678948 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:18:22.678948 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:18:22.678948 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:18:22.678948 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7743d90-f9dc-4601-a6d3-a4901bf9cc05 could not be found. Oct 26 13:18:22.678948 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:18:22.680695 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-12ad3f26-3812-45ca-9cae-5b9d6e107b80 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Returning 404 to user: Instance b7743d90-f9dc-4601-a6d3-a4901bf9cc05 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:18:22.681787 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-12ad3f26-3812-45ca-9cae-5b9d6e107b80 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05" status: 404 len: 111 microversion: 2.1 time: 0.068099 Oct 26 13:18:22.687719 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1884/3788] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:22 2022] GET /compute/v2.1/servers/b7743d90-f9dc-4601-a6d3-a4901bf9cc05 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 13:18:22.702784 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-03276337-4c65-4756-a4d4-0d357938467a tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49ecfb3d5514177b2100631aa944200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c40ceb3374847ec8685b67f7c94a3c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:22.725883 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-03276337-4c65-4756-a4d4-0d357938467a tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] 10.222.0.40 "GET /compute/v2.1/servers/c61efb26-4f8c-470d-b0b2-ad428f1c7458" status: 200 len: 1320 microversion: 2.1 time: 0.251226 Oct 26 13:18:22.738636 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1905/3789] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:22 2022] GET /compute/v2.1/servers/c61efb26-4f8c-470d-b0b2-ad428f1c7458 => generated 1320 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:22.820777 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0c11662c-ef19-4532-884d-dcab712661b2 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:22.821219 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0c11662c-ef19-4532-884d-dcab712661b2 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:22.833533 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c11662c-ef19-4532-884d-dcab712661b2 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:22.834046 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c11662c-ef19-4532-884d-dcab712661b2 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:22.834489 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c11662c-ef19-4532-884d-dcab712661b2 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:22.835206 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c11662c-ef19-4532-884d-dcab712661b2 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:22.835676 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c11662c-ef19-4532-884d-dcab712661b2 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:22.836900 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c11662c-ef19-4532-884d-dcab712661b2 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:23.040650 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0c11662c-ef19-4532-884d-dcab712661b2 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:23.052155 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0c11662c-ef19-4532-884d-dcab712661b2 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6" status: 200 len: 1505 microversion: 2.1 time: 0.236025 Oct 26 13:18:23.053457 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1885/3790] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:22 2022] GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 => generated 1505 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:23.348757 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-435f56c5-a587-424a-ade0-d1af1dda61af tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:23.350027 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-435f56c5-a587-424a-ade0-d1af1dda61af tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:23.360798 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-435f56c5-a587-424a-ade0-d1af1dda61af tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:23.362842 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-435f56c5-a587-424a-ade0-d1af1dda61af tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:23.368056 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-435f56c5-a587-424a-ade0-d1af1dda61af tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:23.369024 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-435f56c5-a587-424a-ade0-d1af1dda61af tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:23.369700 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-435f56c5-a587-424a-ade0-d1af1dda61af tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:23.370314 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-435f56c5-a587-424a-ade0-d1af1dda61af tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:23.659828 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-435f56c5-a587-424a-ade0-d1af1dda61af tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:23.682198 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-435f56c5-a587-424a-ade0-d1af1dda61af tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1525 microversion: 2.1 time: 0.335173 Oct 26 13:18:23.683952 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1906/3791] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:23 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1525 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:23.755452 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ef8f3a5b-0936-4ec2-985c-79b66f3d10aa tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:23.756654 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ef8f3a5b-0936-4ec2-985c-79b66f3d10aa tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: c61efb26-4f8c-470d-b0b2-ad428f1c7458] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:23.769620 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ef8f3a5b-0936-4ec2-985c-79b66f3d10aa tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:23.773091 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ef8f3a5b-0936-4ec2-985c-79b66f3d10aa tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:23.773989 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ef8f3a5b-0936-4ec2-985c-79b66f3d10aa tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:23.776165 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ef8f3a5b-0936-4ec2-985c-79b66f3d10aa tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:23.778405 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ef8f3a5b-0936-4ec2-985c-79b66f3d10aa tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:23.779035 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ef8f3a5b-0936-4ec2-985c-79b66f3d10aa tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:24.087466 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-45c3e008-0909-4066-bed3-7b002a06559d tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:24.089530 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-45c3e008-0909-4066-bed3-7b002a06559d tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:24.110242 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ef8f3a5b-0936-4ec2-985c-79b66f3d10aa tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49ecfb3d5514177b2100631aa944200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c40ceb3374847ec8685b67f7c94a3c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:24.116098 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45c3e008-0909-4066-bed3-7b002a06559d tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:24.122431 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45c3e008-0909-4066-bed3-7b002a06559d tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:24.124653 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45c3e008-0909-4066-bed3-7b002a06559d tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:24.125636 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45c3e008-0909-4066-bed3-7b002a06559d tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:24.126705 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ef8f3a5b-0936-4ec2-985c-79b66f3d10aa tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] 10.222.0.40 "GET /compute/v2.1/servers/c61efb26-4f8c-470d-b0b2-ad428f1c7458" status: 200 len: 1320 microversion: 2.1 time: 0.375238 Oct 26 13:18:24.127351 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45c3e008-0909-4066-bed3-7b002a06559d tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:24.129058 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45c3e008-0909-4066-bed3-7b002a06559d tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:24.141952 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1886/3792] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:23 2022] GET /compute/v2.1/servers/c61efb26-4f8c-470d-b0b2-ad428f1c7458 => generated 1320 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:24.380414 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-45c3e008-0909-4066-bed3-7b002a06559d tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:24.390865 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-45c3e008-0909-4066-bed3-7b002a06559d tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6" status: 200 len: 1505 microversion: 2.1 time: 0.316892 Oct 26 13:18:24.393405 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1907/3793] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:24 2022] GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 => generated 1505 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:18:24.727197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a0684803-763d-4eaf-902f-924a4eabc9d2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:24.728884 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a0684803-763d-4eaf-902f-924a4eabc9d2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:24.745820 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0684803-763d-4eaf-902f-924a4eabc9d2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:24.746581 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0684803-763d-4eaf-902f-924a4eabc9d2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:24.751001 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0684803-763d-4eaf-902f-924a4eabc9d2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:24.752026 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0684803-763d-4eaf-902f-924a4eabc9d2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:24.752659 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0684803-763d-4eaf-902f-924a4eabc9d2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:24.753263 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0684803-763d-4eaf-902f-924a4eabc9d2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:24.929218 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a0684803-763d-4eaf-902f-924a4eabc9d2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:24.939875 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a0684803-763d-4eaf-902f-924a4eabc9d2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1525 microversion: 2.1 time: 0.230829 Oct 26 13:18:24.960842 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1887/3794] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:24 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1525 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:25.157063 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-52043ad7-428f-402e-8fc9-023c81a84802 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:25.166275 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-52043ad7-428f-402e-8fc9-023c81a84802 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: c61efb26-4f8c-470d-b0b2-ad428f1c7458] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:25.173045 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-52043ad7-428f-402e-8fc9-023c81a84802 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:25.173561 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-52043ad7-428f-402e-8fc9-023c81a84802 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:25.174005 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-52043ad7-428f-402e-8fc9-023c81a84802 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:25.174709 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-52043ad7-428f-402e-8fc9-023c81a84802 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:25.175171 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-52043ad7-428f-402e-8fc9-023c81a84802 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:25.175596 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-52043ad7-428f-402e-8fc9-023c81a84802 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:25.340271 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-72b94fb4-2992-49d2-89c6-1c743ea1e02f req-75182162-e77f-4da9-98fe-2b88a94a0a27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c61efb26-4f8c-470d-b0b2-ad428f1c7458", "name": "network-vif-plugged", "status": "completed", "tag": "a16e9360-e1a0-45d2-8c46-b724a446349d"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:18:25.353285 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-72b94fb4-2992-49d2-89c6-1c743ea1e02f req-75182162-e77f-4da9-98fe-2b88a94a0a27 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:25.354194 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-72b94fb4-2992-49d2-89c6-1c743ea1e02f req-75182162-e77f-4da9-98fe-2b88a94a0a27 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:25.354860 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-72b94fb4-2992-49d2-89c6-1c743ea1e02f req-75182162-e77f-4da9-98fe-2b88a94a0a27 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:25.368539 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-72b94fb4-2992-49d2-89c6-1c743ea1e02f req-75182162-e77f-4da9-98fe-2b88a94a0a27 service nova] Creating event network-vif-plugged:a16e9360-e1a0-45d2-8c46-b724a446349d for instance c61efb26-4f8c-470d-b0b2-ad428f1c7458 on n-h2-862686-1 Oct 26 13:18:25.374346 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-72b94fb4-2992-49d2-89c6-1c743ea1e02f req-75182162-e77f-4da9-98fe-2b88a94a0a27 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165981 Oct 26 13:18:25.375254 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1888/3795] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:18:25.385370 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-52043ad7-428f-402e-8fc9-023c81a84802 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49ecfb3d5514177b2100631aa944200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c40ceb3374847ec8685b67f7c94a3c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:25.394227 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-52043ad7-428f-402e-8fc9-023c81a84802 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] 10.222.0.40 "GET /compute/v2.1/servers/c61efb26-4f8c-470d-b0b2-ad428f1c7458" status: 200 len: 1320 microversion: 2.1 time: 0.244027 Oct 26 13:18:25.396376 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1908/3796] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:25 2022] GET /compute/v2.1/servers/c61efb26-4f8c-470d-b0b2-ad428f1c7458 => generated 1320 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:25.430028 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-15dfdac2-a90d-4e60-b420-5bc9bcb7d036 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:25.431465 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-15dfdac2-a90d-4e60-b420-5bc9bcb7d036 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:25.440495 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-15dfdac2-a90d-4e60-b420-5bc9bcb7d036 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:25.441281 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-15dfdac2-a90d-4e60-b420-5bc9bcb7d036 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:25.453155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-15dfdac2-a90d-4e60-b420-5bc9bcb7d036 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:25.454333 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-15dfdac2-a90d-4e60-b420-5bc9bcb7d036 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:25.455794 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-15dfdac2-a90d-4e60-b420-5bc9bcb7d036 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:25.456470 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-15dfdac2-a90d-4e60-b420-5bc9bcb7d036 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:25.723506 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-15dfdac2-a90d-4e60-b420-5bc9bcb7d036 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:25.737826 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-15dfdac2-a90d-4e60-b420-5bc9bcb7d036 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6" status: 200 len: 1505 microversion: 2.1 time: 0.318875 Oct 26 13:18:25.738441 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1889/3797] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:25 2022] GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 => generated 1505 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:25.973678 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2ae05b79-e379-4d8d-81ad-658e678b2c67 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:25.974761 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2ae05b79-e379-4d8d-81ad-658e678b2c67 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:26.005246 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ae05b79-e379-4d8d-81ad-658e678b2c67 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:26.010190 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ae05b79-e379-4d8d-81ad-658e678b2c67 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:26.011817 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ae05b79-e379-4d8d-81ad-658e678b2c67 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:26.014772 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ae05b79-e379-4d8d-81ad-658e678b2c67 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:26.027579 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ae05b79-e379-4d8d-81ad-658e678b2c67 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:26.030336 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ae05b79-e379-4d8d-81ad-658e678b2c67 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:26.229311 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2ae05b79-e379-4d8d-81ad-658e678b2c67 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:26.242503 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2ae05b79-e379-4d8d-81ad-658e678b2c67 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1525 microversion: 2.1 time: 0.278126 Oct 26 13:18:26.260674 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1909/3798] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:25 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1525 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:26.420406 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4085c41c-d162-447f-aeaf-a83fcaec6a12 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:26.420994 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4085c41c-d162-447f-aeaf-a83fcaec6a12 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: c61efb26-4f8c-470d-b0b2-ad428f1c7458] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:26.434563 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4085c41c-d162-447f-aeaf-a83fcaec6a12 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:26.435777 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4085c41c-d162-447f-aeaf-a83fcaec6a12 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:26.436230 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4085c41c-d162-447f-aeaf-a83fcaec6a12 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:26.438228 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4085c41c-d162-447f-aeaf-a83fcaec6a12 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:26.438952 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4085c41c-d162-447f-aeaf-a83fcaec6a12 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:26.439673 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4085c41c-d162-447f-aeaf-a83fcaec6a12 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:26.650238 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4085c41c-d162-447f-aeaf-a83fcaec6a12 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49ecfb3d5514177b2100631aa944200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c40ceb3374847ec8685b67f7c94a3c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:26.662401 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4085c41c-d162-447f-aeaf-a83fcaec6a12 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] 10.222.0.40 "GET /compute/v2.1/servers/c61efb26-4f8c-470d-b0b2-ad428f1c7458" status: 200 len: 1320 microversion: 2.1 time: 0.246381 Oct 26 13:18:26.663534 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1890/3799] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:26 2022] GET /compute/v2.1/servers/c61efb26-4f8c-470d-b0b2-ad428f1c7458 => generated 1320 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:26.773740 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a6f15c20-26a3-44c1-8d58-e74975752f68 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:26.778020 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a6f15c20-26a3-44c1-8d58-e74975752f68 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:26.795351 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a6f15c20-26a3-44c1-8d58-e74975752f68 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:26.796613 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a6f15c20-26a3-44c1-8d58-e74975752f68 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:26.797748 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a6f15c20-26a3-44c1-8d58-e74975752f68 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:26.798865 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a6f15c20-26a3-44c1-8d58-e74975752f68 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:26.799515 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a6f15c20-26a3-44c1-8d58-e74975752f68 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:26.800265 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a6f15c20-26a3-44c1-8d58-e74975752f68 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:27.090394 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a6f15c20-26a3-44c1-8d58-e74975752f68 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:27.099291 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a6f15c20-26a3-44c1-8d58-e74975752f68 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6" status: 200 len: 1505 microversion: 2.1 time: 0.336064 Oct 26 13:18:27.118006 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1910/3800] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:26 2022] GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 => generated 1505 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:27.270640 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c0ced8d9-da2f-455f-83a7-fb9a4eaa8b52 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:27.271307 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c0ced8d9-da2f-455f-83a7-fb9a4eaa8b52 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:27.283006 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0ced8d9-da2f-455f-83a7-fb9a4eaa8b52 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:27.283662 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0ced8d9-da2f-455f-83a7-fb9a4eaa8b52 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:27.284229 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0ced8d9-da2f-455f-83a7-fb9a4eaa8b52 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:27.287414 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0ced8d9-da2f-455f-83a7-fb9a4eaa8b52 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:27.287907 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0ced8d9-da2f-455f-83a7-fb9a4eaa8b52 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:27.288493 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0ced8d9-da2f-455f-83a7-fb9a4eaa8b52 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:27.401068 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-58d893e4-75d6-4840-85fa-4a2363f978e9 req-ec885463-67ce-401d-be90-668d8180508f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9db9b3b9-b9cd-4fa1-8091-4c6ad1c26aba", "name": "network-vif-plugged", "status": "completed", "tag": "b9f05af1-d34e-4087-8153-7eb70c348110"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:18:27.439909 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-58d893e4-75d6-4840-85fa-4a2363f978e9 req-ec885463-67ce-401d-be90-668d8180508f service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:27.440315 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-58d893e4-75d6-4840-85fa-4a2363f978e9 req-ec885463-67ce-401d-be90-668d8180508f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:27.441243 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-58d893e4-75d6-4840-85fa-4a2363f978e9 req-ec885463-67ce-401d-be90-668d8180508f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:27.445959 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:18:27.460869 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c0ced8d9-da2f-455f-83a7-fb9a4eaa8b52 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:27.467116 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-58d893e4-75d6-4840-85fa-4a2363f978e9 req-ec885463-67ce-401d-be90-668d8180508f service nova] Creating event network-vif-plugged:b9f05af1-d34e-4087-8153-7eb70c348110 for instance 9db9b3b9-b9cd-4fa1-8091-4c6ad1c26aba on n-h1-862686-1 Oct 26 13:18:27.469367 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c0ced8d9-da2f-455f-83a7-fb9a4eaa8b52 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1525 microversion: 2.1 time: 0.203120 Oct 26 13:18:27.472683 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-58d893e4-75d6-4840-85fa-4a2363f978e9 req-ec885463-67ce-401d-be90-668d8180508f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076989 Oct 26 13:18:27.473881 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1911/3801] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:18:27.481867 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1891/3802] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:27 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1525 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:27.688589 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f18d35f6-eb11-4771-a1a4-9c8df3384099 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:27.692890 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f18d35f6-eb11-4771-a1a4-9c8df3384099 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: c61efb26-4f8c-470d-b0b2-ad428f1c7458] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:27.708493 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f18d35f6-eb11-4771-a1a4-9c8df3384099 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:27.710171 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f18d35f6-eb11-4771-a1a4-9c8df3384099 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:27.713253 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f18d35f6-eb11-4771-a1a4-9c8df3384099 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:27.714411 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f18d35f6-eb11-4771-a1a4-9c8df3384099 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:27.716223 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f18d35f6-eb11-4771-a1a4-9c8df3384099 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:27.718110 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f18d35f6-eb11-4771-a1a4-9c8df3384099 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:27.949633 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f18d35f6-eb11-4771-a1a4-9c8df3384099 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49ecfb3d5514177b2100631aa944200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c40ceb3374847ec8685b67f7c94a3c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:27.957980 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f18d35f6-eb11-4771-a1a4-9c8df3384099 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] 10.222.0.40 "GET /compute/v2.1/servers/c61efb26-4f8c-470d-b0b2-ad428f1c7458" status: 200 len: 1508 microversion: 2.1 time: 0.273734 Oct 26 13:18:27.958554 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1912/3803] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:27 2022] GET /compute/v2.1/servers/c61efb26-4f8c-470d-b0b2-ad428f1c7458 => generated 1508 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:28.034032 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8ced5ac3-ca38-40e7-8720-10e4f496455e tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:28.034650 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8ced5ac3-ca38-40e7-8720-10e4f496455e tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: 9db9b3b9-b9cd-4fa1-8091-4c6ad1c26aba] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:28.041562 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8ced5ac3-ca38-40e7-8720-10e4f496455e tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:28.042050 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8ced5ac3-ca38-40e7-8720-10e4f496455e tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:28.042492 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8ced5ac3-ca38-40e7-8720-10e4f496455e tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:28.043194 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8ced5ac3-ca38-40e7-8720-10e4f496455e tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:28.043669 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8ced5ac3-ca38-40e7-8720-10e4f496455e tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:28.044103 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8ced5ac3-ca38-40e7-8720-10e4f496455e tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:28.126650 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0d1aed79-3647-4862-9439-5462a6eed9c5 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:28.127424 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0d1aed79-3647-4862-9439-5462a6eed9c5 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:28.135611 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d1aed79-3647-4862-9439-5462a6eed9c5 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:28.138102 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d1aed79-3647-4862-9439-5462a6eed9c5 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:28.142111 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d1aed79-3647-4862-9439-5462a6eed9c5 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:28.143096 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d1aed79-3647-4862-9439-5462a6eed9c5 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:28.144096 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d1aed79-3647-4862-9439-5462a6eed9c5 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:28.144799 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d1aed79-3647-4862-9439-5462a6eed9c5 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:28.231194 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8ced5ac3-ca38-40e7-8720-10e4f496455e tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49ecfb3d5514177b2100631aa944200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c40ceb3374847ec8685b67f7c94a3c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:28.243622 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8ced5ac3-ca38-40e7-8720-10e4f496455e tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] 10.222.0.40 "GET /compute/v2.1/servers/9db9b3b9-b9cd-4fa1-8091-4c6ad1c26aba" status: 200 len: 1320 microversion: 2.1 time: 0.215955 Oct 26 13:18:28.250685 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1892/3804] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:28 2022] GET /compute/v2.1/servers/9db9b3b9-b9cd-4fa1-8091-4c6ad1c26aba => generated 1320 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:18:28.281695 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fb3adb01-f2ec-4277-a799-1e6af6550c56 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:28.282388 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fb3adb01-f2ec-4277-a799-1e6af6550c56 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:28.292870 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fb3adb01-f2ec-4277-a799-1e6af6550c56 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:28.293739 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fb3adb01-f2ec-4277-a799-1e6af6550c56 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:28.294405 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fb3adb01-f2ec-4277-a799-1e6af6550c56 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:28.295416 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fb3adb01-f2ec-4277-a799-1e6af6550c56 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:28.296077 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fb3adb01-f2ec-4277-a799-1e6af6550c56 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:28.296693 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fb3adb01-f2ec-4277-a799-1e6af6550c56 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:28.326750 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0d1aed79-3647-4862-9439-5462a6eed9c5 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:28.338504 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0d1aed79-3647-4862-9439-5462a6eed9c5 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6" status: 200 len: 1505 microversion: 2.1 time: 0.215741 Oct 26 13:18:28.343264 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1913/3805] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:28 2022] GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 => generated 1505 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:28.347664 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fb3adb01-f2ec-4277-a799-1e6af6550c56 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:18:28.458413 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fb3adb01-f2ec-4277-a799-1e6af6550c56 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c" status: 204 len: 0 microversion: 2.1 time: 0.179632 Oct 26 13:18:28.462718 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1893/3806] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:18:28 2022] DELETE /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 26 13:18:28.470982 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fd81cb49-bdc5-40fc-a2a5-b010295f4f97 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:28.472266 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fd81cb49-bdc5-40fc-a2a5-b010295f4f97 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:28.479634 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd81cb49-bdc5-40fc-a2a5-b010295f4f97 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:28.480400 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd81cb49-bdc5-40fc-a2a5-b010295f4f97 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:28.481067 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd81cb49-bdc5-40fc-a2a5-b010295f4f97 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:28.482024 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd81cb49-bdc5-40fc-a2a5-b010295f4f97 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:28.482557 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd81cb49-bdc5-40fc-a2a5-b010295f4f97 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:28.483303 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd81cb49-bdc5-40fc-a2a5-b010295f4f97 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:28.495417 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-03dd5cc6-e434-4a17-affd-6fefa941a5cf tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:28.496500 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-03dd5cc6-e434-4a17-affd-6fefa941a5cf tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:28.507601 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03dd5cc6-e434-4a17-affd-6fefa941a5cf tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:28.509730 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03dd5cc6-e434-4a17-affd-6fefa941a5cf tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:28.511122 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03dd5cc6-e434-4a17-affd-6fefa941a5cf tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:28.512674 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03dd5cc6-e434-4a17-affd-6fefa941a5cf tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:28.513887 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03dd5cc6-e434-4a17-affd-6fefa941a5cf tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:28.514648 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03dd5cc6-e434-4a17-affd-6fefa941a5cf tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:28.647413 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fd81cb49-bdc5-40fc-a2a5-b010295f4f97 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:28.660609 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fd81cb49-bdc5-40fc-a2a5-b010295f4f97 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c" status: 200 len: 1667 microversion: 2.1 time: 0.193584 Oct 26 13:18:28.661933 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1914/3807] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:28 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c => generated 1667 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:28.693946 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-03dd5cc6-e434-4a17-affd-6fefa941a5cf tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:28.703903 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-03dd5cc6-e434-4a17-affd-6fefa941a5cf tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1525 microversion: 2.1 time: 0.213691 Oct 26 13:18:28.711939 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1894/3808] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:28 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1525 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:18:29.277813 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d451f99c-11e2-46ad-a391-21e65e9d01ab tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:29.278434 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d451f99c-11e2-46ad-a391-21e65e9d01ab tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: 9db9b3b9-b9cd-4fa1-8091-4c6ad1c26aba] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:29.284780 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d451f99c-11e2-46ad-a391-21e65e9d01ab tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:29.285269 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d451f99c-11e2-46ad-a391-21e65e9d01ab tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:29.285738 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d451f99c-11e2-46ad-a391-21e65e9d01ab tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:29.286444 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d451f99c-11e2-46ad-a391-21e65e9d01ab tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:29.286892 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d451f99c-11e2-46ad-a391-21e65e9d01ab tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:29.287322 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d451f99c-11e2-46ad-a391-21e65e9d01ab tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:29.368462 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-89d64393-7a30-49a8-9da3-d9b40a023f6a tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:29.369085 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-89d64393-7a30-49a8-9da3-d9b40a023f6a tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:29.375202 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89d64393-7a30-49a8-9da3-d9b40a023f6a tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:29.375694 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89d64393-7a30-49a8-9da3-d9b40a023f6a tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:29.376138 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89d64393-7a30-49a8-9da3-d9b40a023f6a tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:29.376848 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89d64393-7a30-49a8-9da3-d9b40a023f6a tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:29.377309 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89d64393-7a30-49a8-9da3-d9b40a023f6a tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:29.377835 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89d64393-7a30-49a8-9da3-d9b40a023f6a tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:29.509415 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-89d64393-7a30-49a8-9da3-d9b40a023f6a tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:29.516308 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d451f99c-11e2-46ad-a391-21e65e9d01ab tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49ecfb3d5514177b2100631aa944200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c40ceb3374847ec8685b67f7c94a3c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:29.517292 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-89d64393-7a30-49a8-9da3-d9b40a023f6a tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6" status: 200 len: 1505 microversion: 2.1 time: 0.153682 Oct 26 13:18:29.517907 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1895/3809] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:29 2022] GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:18:29.524905 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d451f99c-11e2-46ad-a391-21e65e9d01ab tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] 10.222.0.40 "GET /compute/v2.1/servers/9db9b3b9-b9cd-4fa1-8091-4c6ad1c26aba" status: 200 len: 1508 microversion: 2.1 time: 0.251062 Oct 26 13:18:29.525835 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1915/3810] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:29 2022] GET /compute/v2.1/servers/9db9b3b9-b9cd-4fa1-8091-4c6ad1c26aba => generated 1508 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:29.548209 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0b57cbf0-cbbc-4f23-9836-591adfeadca2 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:29.548709 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0b57cbf0-cbbc-4f23-9836-591adfeadca2 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: 9db9b3b9-b9cd-4fa1-8091-4c6ad1c26aba] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:29.555834 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b57cbf0-cbbc-4f23-9836-591adfeadca2 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:29.556391 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b57cbf0-cbbc-4f23-9836-591adfeadca2 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:29.556884 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b57cbf0-cbbc-4f23-9836-591adfeadca2 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:29.557859 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b57cbf0-cbbc-4f23-9836-591adfeadca2 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:29.558324 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b57cbf0-cbbc-4f23-9836-591adfeadca2 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:29.558754 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b57cbf0-cbbc-4f23-9836-591adfeadca2 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:29.586298 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0b57cbf0-cbbc-4f23-9836-591adfeadca2 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: 9db9b3b9-b9cd-4fa1-8091-4c6ad1c26aba] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:18:29.672977 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0b57cbf0-cbbc-4f23-9836-591adfeadca2 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9db9b3b9-b9cd-4fa1-8091-4c6ad1c26aba" status: 204 len: 0 microversion: 2.1 time: 0.128218 Oct 26 13:18:29.673548 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1896/3811] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:18:29 2022] DELETE /compute/v2.1/servers/9db9b3b9-b9cd-4fa1-8091-4c6ad1c26aba => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 26 13:18:29.683229 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ae6f606a-2fde-471f-bc75-18f90cc8de01 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:29.683973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ae6f606a-2fde-471f-bc75-18f90cc8de01 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: c61efb26-4f8c-470d-b0b2-ad428f1c7458] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:29.688450 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-75e53e72-3396-40ab-8f01-735cd6bb0115 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:29.689202 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-75e53e72-3396-40ab-8f01-735cd6bb0115 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:29.690185 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae6f606a-2fde-471f-bc75-18f90cc8de01 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:29.690677 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae6f606a-2fde-471f-bc75-18f90cc8de01 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:29.691348 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae6f606a-2fde-471f-bc75-18f90cc8de01 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:29.692057 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae6f606a-2fde-471f-bc75-18f90cc8de01 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:29.692520 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae6f606a-2fde-471f-bc75-18f90cc8de01 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:29.692947 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae6f606a-2fde-471f-bc75-18f90cc8de01 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:29.695402 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-75e53e72-3396-40ab-8f01-735cd6bb0115 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:29.695883 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-75e53e72-3396-40ab-8f01-735cd6bb0115 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:29.696356 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-75e53e72-3396-40ab-8f01-735cd6bb0115 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:29.697028 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-75e53e72-3396-40ab-8f01-735cd6bb0115 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:29.697582 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-75e53e72-3396-40ab-8f01-735cd6bb0115 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:29.697986 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-75e53e72-3396-40ab-8f01-735cd6bb0115 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:29.729029 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ae6f606a-2fde-471f-bc75-18f90cc8de01 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: c61efb26-4f8c-470d-b0b2-ad428f1c7458] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:18:29.819370 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ae6f606a-2fde-471f-bc75-18f90cc8de01 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c61efb26-4f8c-470d-b0b2-ad428f1c7458" status: 204 len: 0 microversion: 2.1 time: 0.140590 Oct 26 13:18:29.820670 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1916/3812] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:18:29 2022] DELETE /compute/v2.1/servers/c61efb26-4f8c-470d-b0b2-ad428f1c7458 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:18:29.833793 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-57e0e780-dd2e-47b3-b5a8-b70e083add2a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:29.834825 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-57e0e780-dd2e-47b3-b5a8-b70e083add2a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:29.842468 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57e0e780-dd2e-47b3-b5a8-b70e083add2a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:29.842982 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57e0e780-dd2e-47b3-b5a8-b70e083add2a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:29.843537 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57e0e780-dd2e-47b3-b5a8-b70e083add2a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:29.844600 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57e0e780-dd2e-47b3-b5a8-b70e083add2a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:29.845143 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57e0e780-dd2e-47b3-b5a8-b70e083add2a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:29.845782 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57e0e780-dd2e-47b3-b5a8-b70e083add2a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:29.894808 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-75e53e72-3396-40ab-8f01-735cd6bb0115 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:29.904008 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-75e53e72-3396-40ab-8f01-735cd6bb0115 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c" status: 200 len: 1667 microversion: 2.1 time: 0.219694 Oct 26 13:18:29.904673 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1897/3813] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:29 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c => generated 1667 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:29.909449 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2ecc5404-f348-4529-afc0-a0d6c0d288ad tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1063823986", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "5ee8b432-5161-41a1-ac0f-f87034b1fccb"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:18:29.967819 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-2ecc5404-f348-4529-afc0-a0d6c0d288ad tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] validate_networks() for [('5ee8b432-5161-41a1-ac0f-f87034b1fccb', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:18:30.084039 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-57e0e780-dd2e-47b3-b5a8-b70e083add2a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:30.093212 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-57e0e780-dd2e-47b3-b5a8-b70e083add2a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1507 microversion: 2.1 time: 0.270944 Oct 26 13:18:30.094300 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1917/3814] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:29 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1507 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:30.317137 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-86c0aa27-ba7c-4cb2-a67b-c3857b7d4efb req-54422361-dfe5-4580-916b-2faf04e9ffc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e73c452-6277-4845-b64e-e3eca2528e4c", "name": "network-vif-deleted", "tag": "48f9022a-e360-40a8-bd91-61687277f232"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:18:30.328313 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-86c0aa27-ba7c-4cb2-a67b-c3857b7d4efb req-54422361-dfe5-4580-916b-2faf04e9ffc2 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:30.329004 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-86c0aa27-ba7c-4cb2-a67b-c3857b7d4efb req-54422361-dfe5-4580-916b-2faf04e9ffc2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:30.329293 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-86c0aa27-ba7c-4cb2-a67b-c3857b7d4efb req-54422361-dfe5-4580-916b-2faf04e9ffc2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:30.342913 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-86c0aa27-ba7c-4cb2-a67b-c3857b7d4efb req-54422361-dfe5-4580-916b-2faf04e9ffc2 service nova] Creating event network-vif-deleted:48f9022a-e360-40a8-bd91-61687277f232 for instance 5e73c452-6277-4845-b64e-e3eca2528e4c on n-h1-862686-1 Oct 26 13:18:30.348426 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-86c0aa27-ba7c-4cb2-a67b-c3857b7d4efb req-54422361-dfe5-4580-916b-2faf04e9ffc2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034792 Oct 26 13:18:30.349355 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1918/3815] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:18:30.390939 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-2ecc5404-f348-4529-afc0-a0d6c0d288ad tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:18:30.391369 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-2ecc5404-f348-4529-afc0-a0d6c0d288ad tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:18:30.391845 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-2ecc5404-f348-4529-afc0-a0d6c0d288ad tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:18:30.392372 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-2ecc5404-f348-4529-afc0-a0d6c0d288ad tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:18:30.392871 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-2ecc5404-f348-4529-afc0-a0d6c0d288ad tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:18:30.404193 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ecc5404-f348-4529-afc0-a0d6c0d288ad tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:30.405218 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ecc5404-f348-4529-afc0-a0d6c0d288ad tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:30.405692 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ecc5404-f348-4529-afc0-a0d6c0d288ad tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:30.406447 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ecc5404-f348-4529-afc0-a0d6c0d288ad tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:30.406913 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ecc5404-f348-4529-afc0-a0d6c0d288ad tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:30.407345 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ecc5404-f348-4529-afc0-a0d6c0d288ad tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:30.422697 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:18:30.430154 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-2ecc5404-f348-4529-afc0-a0d6c0d288ad tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Getting quotas for project 6c40ceb3374847ec8685b67f7c94a3c7. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:18:30.437158 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-2ecc5404-f348-4529-afc0-a0d6c0d288ad tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Getting quotas for user d49ecfb3d5514177b2100631aa944200 and project 6c40ceb3374847ec8685b67f7c94a3c7. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:18:30.451877 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2ecc5404-f348-4529-afc0-a0d6c0d288ad tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Going to run 2 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:18:30.454339 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2ecc5404-f348-4529-afc0-a0d6c0d288ad tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: b3260894-8fb6-44ee-9f97-3159a47b4a6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:18:30.495189 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2ecc5404-f348-4529-afc0-a0d6c0d288ad tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: 84ed9a1e-36b9-4d54-8118-b803cff45f62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=b3260894-8fb6-44ee-9f97-3159a47b4a6d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:18:30.544835 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-254fc88e-5c20-43cf-a41f-d8cb74adf15e tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:30.545643 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-254fc88e-5c20-43cf-a41f-d8cb74adf15e tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:30.553348 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-254fc88e-5c20-43cf-a41f-d8cb74adf15e tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:30.553865 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-254fc88e-5c20-43cf-a41f-d8cb74adf15e tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:30.554430 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-254fc88e-5c20-43cf-a41f-d8cb74adf15e tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:30.555774 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-254fc88e-5c20-43cf-a41f-d8cb74adf15e tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:30.556232 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-254fc88e-5c20-43cf-a41f-d8cb74adf15e tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:30.557037 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-254fc88e-5c20-43cf-a41f-d8cb74adf15e tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:30.564655 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2ecc5404-f348-4529-afc0-a0d6c0d288ad tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.658790 Oct 26 13:18:30.565469 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1898/3816] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:18:29 2022] POST /compute/v2.1/servers => generated 32 bytes in 660 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 26 13:18:30.573974 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cca84c81-c85a-4fef-9064-4b04aa078fec tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:30.579085 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cca84c81-c85a-4fef-9064-4b04aa078fec tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd49ecfb3d5514177b2100631aa944200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c40ceb3374847ec8685b67f7c94a3c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:30.579841 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cca84c81-c85a-4fef-9064-4b04aa078fec tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Searching by: {'deleted': False, 'project_id': '6c40ceb3374847ec8685b67f7c94a3c7'} {{(pid=120597) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:18:30.606581 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cca84c81-c85a-4fef-9064-4b04aa078fec tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:30.607248 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cca84c81-c85a-4fef-9064-4b04aa078fec tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:30.607695 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cca84c81-c85a-4fef-9064-4b04aa078fec tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:30.608574 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cca84c81-c85a-4fef-9064-4b04aa078fec tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:30.609173 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cca84c81-c85a-4fef-9064-4b04aa078fec tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:30.609735 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cca84c81-c85a-4fef-9064-4b04aa078fec tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:30.639296 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:18:30.646469 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.multi_cell_list [None req-cca84c81-c85a-4fef-9064-4b04aa078fec tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=120597) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 13:18:30.683242 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cca84c81-c85a-4fef-9064-4b04aa078fec tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 1337 microversion: 2.1 time: 0.113557 Oct 26 13:18:30.691876 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1899/3817] 10.222.0.40 () {58 vars in 1125 bytes} [Wed Oct 26 13:18:30 2022] GET /compute/v2.1/servers => generated 1337 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:30.697290 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9f67f516-4770-4390-8318-f661a6adb8e9 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:30.702062 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9f67f516-4770-4390-8318-f661a6adb8e9 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: 84ed9a1e-36b9-4d54-8118-b803cff45f62] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:30.755580 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-254fc88e-5c20-43cf-a41f-d8cb74adf15e tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:30.764615 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9f67f516-4770-4390-8318-f661a6adb8e9 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49ecfb3d5514177b2100631aa944200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c40ceb3374847ec8685b67f7c94a3c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:30.765433 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-254fc88e-5c20-43cf-a41f-d8cb74adf15e tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6" status: 200 len: 1505 microversion: 2.1 time: 0.226794 Oct 26 13:18:30.766462 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1919/3818] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:30 2022] GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 => generated 1505 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:30.772370 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9f67f516-4770-4390-8318-f661a6adb8e9 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] 10.222.0.40 "GET /compute/v2.1/servers/84ed9a1e-36b9-4d54-8118-b803cff45f62" status: 200 len: 1218 microversion: 2.1 time: 0.078968 Oct 26 13:18:30.773767 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1900/3819] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:30 2022] GET /compute/v2.1/servers/84ed9a1e-36b9-4d54-8118-b803cff45f62 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:30.934665 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-06eddaf6-9559-4c4b-8c4b-e6cc46ea7077 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:30.936281 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-06eddaf6-9559-4c4b-8c4b-e6cc46ea7077 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:30.954294 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06eddaf6-9559-4c4b-8c4b-e6cc46ea7077 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:30.956363 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06eddaf6-9559-4c4b-8c4b-e6cc46ea7077 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:30.956904 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06eddaf6-9559-4c4b-8c4b-e6cc46ea7077 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:30.957761 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06eddaf6-9559-4c4b-8c4b-e6cc46ea7077 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:30.961843 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06eddaf6-9559-4c4b-8c4b-e6cc46ea7077 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:30.962430 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06eddaf6-9559-4c4b-8c4b-e6cc46ea7077 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:31.059360 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-06eddaf6-9559-4c4b-8c4b-e6cc46ea7077 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:31.069596 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-06eddaf6-9559-4c4b-8c4b-e6cc46ea7077 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c" status: 200 len: 1319 microversion: 2.1 time: 0.142099 Oct 26 13:18:31.071071 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1920/3820] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:30 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:31.121446 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a2e2ba3a-aa90-45b4-9c91-25ee8971df81 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:31.122268 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a2e2ba3a-aa90-45b4-9c91-25ee8971df81 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:31.143596 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2e2ba3a-aa90-45b4-9c91-25ee8971df81 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:31.144231 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2e2ba3a-aa90-45b4-9c91-25ee8971df81 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:31.144689 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2e2ba3a-aa90-45b4-9c91-25ee8971df81 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:31.147987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2e2ba3a-aa90-45b4-9c91-25ee8971df81 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:31.148520 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2e2ba3a-aa90-45b4-9c91-25ee8971df81 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:31.148966 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2e2ba3a-aa90-45b4-9c91-25ee8971df81 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:31.489163 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a2e2ba3a-aa90-45b4-9c91-25ee8971df81 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:31.498546 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a2e2ba3a-aa90-45b4-9c91-25ee8971df81 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1507 microversion: 2.1 time: 0.383142 Oct 26 13:18:31.503389 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1901/3821] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:31 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1507 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:31.806641 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-869b7938-d4f9-415b-b864-f3e694d5ab7c tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:31.807841 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ba741084-2539-40f0-afca-cc94340d6aaa tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:31.809130 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ba741084-2539-40f0-afca-cc94340d6aaa tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: 84ed9a1e-36b9-4d54-8118-b803cff45f62] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:31.810152 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-869b7938-d4f9-415b-b864-f3e694d5ab7c tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:31.826934 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ba741084-2539-40f0-afca-cc94340d6aaa tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:31.830782 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ba741084-2539-40f0-afca-cc94340d6aaa tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:31.834824 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ba741084-2539-40f0-afca-cc94340d6aaa tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:31.837830 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ba741084-2539-40f0-afca-cc94340d6aaa tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:31.840749 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ba741084-2539-40f0-afca-cc94340d6aaa tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:31.841171 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-869b7938-d4f9-415b-b864-f3e694d5ab7c tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:31.841873 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ba741084-2539-40f0-afca-cc94340d6aaa tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:31.842531 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-869b7938-d4f9-415b-b864-f3e694d5ab7c tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:31.844540 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-869b7938-d4f9-415b-b864-f3e694d5ab7c tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:31.846277 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-869b7938-d4f9-415b-b864-f3e694d5ab7c tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:31.849106 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-869b7938-d4f9-415b-b864-f3e694d5ab7c tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:31.850096 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-869b7938-d4f9-415b-b864-f3e694d5ab7c tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:32.106096 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ba741084-2539-40f0-afca-cc94340d6aaa tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49ecfb3d5514177b2100631aa944200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c40ceb3374847ec8685b67f7c94a3c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:32.115045 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-869b7938-d4f9-415b-b864-f3e694d5ab7c tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:32.116688 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ba741084-2539-40f0-afca-cc94340d6aaa tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] 10.222.0.40 "GET /compute/v2.1/servers/84ed9a1e-36b9-4d54-8118-b803cff45f62" status: 200 len: 1222 microversion: 2.1 time: 0.323722 Oct 26 13:18:32.130768 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1902/3822] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:31 2022] GET /compute/v2.1/servers/84ed9a1e-36b9-4d54-8118-b803cff45f62 => generated 1222 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:32.142122 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-869b7938-d4f9-415b-b864-f3e694d5ab7c tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6" status: 200 len: 1505 microversion: 2.1 time: 0.352817 Oct 26 13:18:32.142827 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1921/3823] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:31 2022] GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 => generated 1505 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:32.157431 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-32f6c4cd-b308-4fdc-a395-775724e1b9e9 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:32.160310 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-32f6c4cd-b308-4fdc-a395-775724e1b9e9 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:32.177256 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32f6c4cd-b308-4fdc-a395-775724e1b9e9 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:32.179825 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32f6c4cd-b308-4fdc-a395-775724e1b9e9 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:32.182360 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32f6c4cd-b308-4fdc-a395-775724e1b9e9 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:32.185804 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32f6c4cd-b308-4fdc-a395-775724e1b9e9 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:32.186236 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32f6c4cd-b308-4fdc-a395-775724e1b9e9 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:32.186705 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32f6c4cd-b308-4fdc-a395-775724e1b9e9 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:32.275257 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32f6c4cd-b308-4fdc-a395-775724e1b9e9 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:32.275765 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32f6c4cd-b308-4fdc-a395-775724e1b9e9 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:32.276207 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32f6c4cd-b308-4fdc-a395-775724e1b9e9 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:32.276664 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-32f6c4cd-b308-4fdc-a395-775724e1b9e9 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lazy-loading 'fault' on Instance uuid 5e73c452-6277-4845-b64e-e3eca2528e4c {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:18:32.365087 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-3af9e642-03c4-44cd-8aff-fac3dcc35726 req-ed20e582-187c-4dee-9562-2c6850fee2eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59bb4f3c-d633-42db-b86b-274fa8b95f44", "name": "network-vif-unplugged", "status": "completed", "tag": "1484b291-b3a0-410d-a1af-3a79c7d02eba"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:18:32.388567 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-3af9e642-03c4-44cd-8aff-fac3dcc35726 req-ed20e582-187c-4dee-9562-2c6850fee2eb service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:32.389087 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-3af9e642-03c4-44cd-8aff-fac3dcc35726 req-ed20e582-187c-4dee-9562-2c6850fee2eb service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:32.389539 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-3af9e642-03c4-44cd-8aff-fac3dcc35726 req-ed20e582-187c-4dee-9562-2c6850fee2eb service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:32.406982 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-3af9e642-03c4-44cd-8aff-fac3dcc35726 req-ed20e582-187c-4dee-9562-2c6850fee2eb service nova] Creating event network-vif-unplugged:1484b291-b3a0-410d-a1af-3a79c7d02eba for instance 59bb4f3c-d633-42db-b86b-274fa8b95f44 on n-h1-862686-1 Oct 26 13:18:32.415594 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-32f6c4cd-b308-4fdc-a395-775724e1b9e9 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:32.423078 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-32f6c4cd-b308-4fdc-a395-775724e1b9e9 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c" status: 200 len: 1324 microversion: 2.1 time: 0.286266 Oct 26 13:18:32.423704 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1903/3824] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:32 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c => generated 1324 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:32.426831 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-3af9e642-03c4-44cd-8aff-fac3dcc35726 req-ed20e582-187c-4dee-9562-2c6850fee2eb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065517 Oct 26 13:18:32.427803 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1922/3825] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:18:32.439376 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-502298a1-63b7-483f-9674-28e394c49387 req-352a1fa7-b972-4aa3-bd9b-06e722636488 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9db9b3b9-b9cd-4fa1-8091-4c6ad1c26aba", "name": "network-vif-deleted", "tag": "b9f05af1-d34e-4087-8153-7eb70c348110"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:18:32.454376 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-502298a1-63b7-483f-9674-28e394c49387 req-352a1fa7-b972-4aa3-bd9b-06e722636488 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:32.455871 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-502298a1-63b7-483f-9674-28e394c49387 req-352a1fa7-b972-4aa3-bd9b-06e722636488 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:32.456534 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-502298a1-63b7-483f-9674-28e394c49387 req-352a1fa7-b972-4aa3-bd9b-06e722636488 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:32.477155 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-502298a1-63b7-483f-9674-28e394c49387 req-352a1fa7-b972-4aa3-bd9b-06e722636488 service nova] Creating event network-vif-deleted:b9f05af1-d34e-4087-8153-7eb70c348110 for instance 9db9b3b9-b9cd-4fa1-8091-4c6ad1c26aba on n-h1-862686-1 Oct 26 13:18:32.484610 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-502298a1-63b7-483f-9674-28e394c49387 req-352a1fa7-b972-4aa3-bd9b-06e722636488 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056176 Oct 26 13:18:32.486451 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1904/3826] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:18:32.527972 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1ed196d1-cb0a-4fc6-938c-c0111b30b4c8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:32.529047 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1ed196d1-cb0a-4fc6-938c-c0111b30b4c8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:32.539320 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ed196d1-cb0a-4fc6-938c-c0111b30b4c8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:32.540100 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ed196d1-cb0a-4fc6-938c-c0111b30b4c8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:32.540913 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ed196d1-cb0a-4fc6-938c-c0111b30b4c8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:32.542173 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ed196d1-cb0a-4fc6-938c-c0111b30b4c8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:32.542839 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ed196d1-cb0a-4fc6-938c-c0111b30b4c8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:32.543544 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ed196d1-cb0a-4fc6-938c-c0111b30b4c8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:32.701569 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1ed196d1-cb0a-4fc6-938c-c0111b30b4c8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:32.710382 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1ed196d1-cb0a-4fc6-938c-c0111b30b4c8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1507 microversion: 2.1 time: 0.188793 Oct 26 13:18:32.711605 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1923/3827] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:32 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1507 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:32.751389 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-19407df2-fed6-42e9-8c97-2e2a8177a8f7 req-07c073bb-5f1d-4b87-8dc0-74d7f9d88a6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c61efb26-4f8c-470d-b0b2-ad428f1c7458", "name": "network-vif-deleted", "tag": "a16e9360-e1a0-45d2-8c46-b724a446349d"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:18:32.761303 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-19407df2-fed6-42e9-8c97-2e2a8177a8f7 req-07c073bb-5f1d-4b87-8dc0-74d7f9d88a6b service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:32.761807 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-19407df2-fed6-42e9-8c97-2e2a8177a8f7 req-07c073bb-5f1d-4b87-8dc0-74d7f9d88a6b service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:32.762243 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-19407df2-fed6-42e9-8c97-2e2a8177a8f7 req-07c073bb-5f1d-4b87-8dc0-74d7f9d88a6b service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:32.777260 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-19407df2-fed6-42e9-8c97-2e2a8177a8f7 req-07c073bb-5f1d-4b87-8dc0-74d7f9d88a6b service nova] Creating event network-vif-deleted:a16e9360-e1a0-45d2-8c46-b724a446349d for instance c61efb26-4f8c-470d-b0b2-ad428f1c7458 on n-h2-862686-1 Oct 26 13:18:32.782326 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-19407df2-fed6-42e9-8c97-2e2a8177a8f7 req-07c073bb-5f1d-4b87-8dc0-74d7f9d88a6b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095834 Oct 26 13:18:32.783260 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1905/3828] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:18:33.149764 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-06e6611a-2c2b-4e43-9c02-93bdc8de3701 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:33.150990 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-06e6611a-2c2b-4e43-9c02-93bdc8de3701 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: 84ed9a1e-36b9-4d54-8118-b803cff45f62] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:33.158247 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06e6611a-2c2b-4e43-9c02-93bdc8de3701 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:33.158736 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06e6611a-2c2b-4e43-9c02-93bdc8de3701 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:33.159174 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06e6611a-2c2b-4e43-9c02-93bdc8de3701 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:33.160076 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06e6611a-2c2b-4e43-9c02-93bdc8de3701 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:33.160854 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06e6611a-2c2b-4e43-9c02-93bdc8de3701 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:33.161285 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06e6611a-2c2b-4e43-9c02-93bdc8de3701 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:33.174912 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-16ed2527-1510-4dbb-bc5e-db6aaf28bda8 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:33.175757 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-16ed2527-1510-4dbb-bc5e-db6aaf28bda8 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:33.183821 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-16ed2527-1510-4dbb-bc5e-db6aaf28bda8 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:33.184388 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-16ed2527-1510-4dbb-bc5e-db6aaf28bda8 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:33.184890 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-16ed2527-1510-4dbb-bc5e-db6aaf28bda8 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:33.185664 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-16ed2527-1510-4dbb-bc5e-db6aaf28bda8 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:33.186117 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-16ed2527-1510-4dbb-bc5e-db6aaf28bda8 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:33.186538 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-16ed2527-1510-4dbb-bc5e-db6aaf28bda8 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:33.233530 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-06e6611a-2c2b-4e43-9c02-93bdc8de3701 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49ecfb3d5514177b2100631aa944200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c40ceb3374847ec8685b67f7c94a3c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:33.243650 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-06e6611a-2c2b-4e43-9c02-93bdc8de3701 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] 10.222.0.40 "GET /compute/v2.1/servers/84ed9a1e-36b9-4d54-8118-b803cff45f62" status: 200 len: 1270 microversion: 2.1 time: 0.098114 Oct 26 13:18:33.245525 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1924/3829] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:33 2022] GET /compute/v2.1/servers/84ed9a1e-36b9-4d54-8118-b803cff45f62 => generated 1270 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:33.387100 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-16ed2527-1510-4dbb-bc5e-db6aaf28bda8 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:33.394845 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-16ed2527-1510-4dbb-bc5e-db6aaf28bda8 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6" status: 200 len: 1505 microversion: 2.1 time: 0.225877 Oct 26 13:18:33.395424 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1906/3830] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:33 2022] GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 => generated 1505 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:18:33.450466 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3d96455d-de6b-48ff-b4e0-958c9517d573 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:33.451075 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3d96455d-de6b-48ff-b4e0-958c9517d573 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 5e73c452-6277-4845-b64e-e3eca2528e4c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:33.457091 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3d96455d-de6b-48ff-b4e0-958c9517d573 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:33.457596 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3d96455d-de6b-48ff-b4e0-958c9517d573 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:33.458030 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3d96455d-de6b-48ff-b4e0-958c9517d573 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:33.458718 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3d96455d-de6b-48ff-b4e0-958c9517d573 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:33.459165 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3d96455d-de6b-48ff-b4e0-958c9517d573 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:33.459581 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3d96455d-de6b-48ff-b4e0-958c9517d573 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:33.473982 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-3d96455d-de6b-48ff-b4e0-958c9517d573 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] HTTP exception thrown: Instance 5e73c452-6277-4845-b64e-e3eca2528e4c could not be found. Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3d96455d-de6b-48ff-b4e0-958c9517d573 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Request method failure captured: Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c HTTP/1.1 Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTIDulnGf0cfDzb6ABf0P9I0OR8ZAxrEjf3dsSmpUDBvfTi0mRMx4cnhHxwYFoMK39PFCBGQwWgxaNanJAX2G7nZO-H0M0Y6hwrlddJMmZCT53RGEg2CCJF8JIuVVNqAQoy1FBD1Oqrvpehc-uuXoY42tDl5BuJKOtwJ5b-GC60JvCw Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 4f1ce8734839480ca6b07416a9c6d9c3 Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-LiveMigrationTest-1487865039 Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4f1ce8734839480ca6b07416a9c6d9c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4f1ce8734839480ca6b07416a9c6d9c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4f1ce8734839480ca6b07416a9c6d9c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4f1ce8734839480ca6b07416a9c6d9c3"}]}] Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-LiveMigrationTest-1487865039 Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 4f1ce8734839480ca6b07416a9c6d9c3 Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-LiveMigrationTest-1487865039 Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-LiveMigrationTest-1487865039-project Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: f96da2e13ca64db2a16d58aee1fc921d Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-LiveMigrationTest-1487865039-project Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 5e73c452-6277-4845-b64e-e3eca2528e4c could not be found. Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '5e73c452-6277-4845-b64e-e3eca2528e4c'} Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e73c452-6277-4845-b64e-e3eca2528e4c could not be found. Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e73c452-6277-4845-b64e-e3eca2528e4c could not be found. Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:18:33.475879 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:18:33.481296 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:18:33.481296 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:18:33.481296 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:18:33.481296 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:18:33.481296 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:18:33.481296 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e73c452-6277-4845-b64e-e3eca2528e4c could not be found. Oct 26 13:18:33.481296 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:18:33.481296 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3d96455d-de6b-48ff-b4e0-958c9517d573 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Returning 404 to user: Instance 5e73c452-6277-4845-b64e-e3eca2528e4c could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:18:33.481296 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3d96455d-de6b-48ff-b4e0-958c9517d573 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c" status: 404 len: 111 microversion: 2.1 time: 0.031390 Oct 26 13:18:33.481296 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1925/3831] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:33 2022] GET /compute/v2.1/servers/5e73c452-6277-4845-b64e-e3eca2528e4c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:18:33.487516 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-41178063-015e-4ac8-8eb4-329360c675f0 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '.version_select at 0x7f67369ba940>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:33.511264 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-41178063-015e-4ac8-8eb4-329360c675f0 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2033132549" status: 202 len: 0 microversion: 2.1 time: 0.027349 Oct 26 13:18:33.514973 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1907/3832] 10.222.0.40 () {58 vars in 1221 bytes} [Wed Oct 26 13:18:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2033132549 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:18:33.745012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3f12d6d7-37d5-4ef6-a4f7-06961ce02b59 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:33.746002 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3f12d6d7-37d5-4ef6-a4f7-06961ce02b59 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:33.760376 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3f12d6d7-37d5-4ef6-a4f7-06961ce02b59 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:33.761025 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3f12d6d7-37d5-4ef6-a4f7-06961ce02b59 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:33.761798 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3f12d6d7-37d5-4ef6-a4f7-06961ce02b59 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:33.764087 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3f12d6d7-37d5-4ef6-a4f7-06961ce02b59 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:33.764653 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3f12d6d7-37d5-4ef6-a4f7-06961ce02b59 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:33.765187 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3f12d6d7-37d5-4ef6-a4f7-06961ce02b59 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:34.022007 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3f12d6d7-37d5-4ef6-a4f7-06961ce02b59 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:34.035513 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3f12d6d7-37d5-4ef6-a4f7-06961ce02b59 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1507 microversion: 2.1 time: 0.303632 Oct 26 13:18:34.036634 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1926/3833] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:33 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1507 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:34.267120 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ae3e042e-11ac-4960-adfd-7a9d55a0ddd6 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:34.268141 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ae3e042e-11ac-4960-adfd-7a9d55a0ddd6 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: 84ed9a1e-36b9-4d54-8118-b803cff45f62] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:34.278137 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae3e042e-11ac-4960-adfd-7a9d55a0ddd6 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:34.279164 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae3e042e-11ac-4960-adfd-7a9d55a0ddd6 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:34.279614 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae3e042e-11ac-4960-adfd-7a9d55a0ddd6 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:34.280468 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae3e042e-11ac-4960-adfd-7a9d55a0ddd6 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:34.280934 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae3e042e-11ac-4960-adfd-7a9d55a0ddd6 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:34.281854 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae3e042e-11ac-4960-adfd-7a9d55a0ddd6 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:34.340053 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-12b28eba-9567-4c70-b1d9-259af8ec8ef5 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:34.340760 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-12b28eba-9567-4c70-b1d9-259af8ec8ef5 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 9534d3ef-723b-4f68-b147-9c3aceed8206] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:34.348700 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-12b28eba-9567-4c70-b1d9-259af8ec8ef5 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:34.349343 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-12b28eba-9567-4c70-b1d9-259af8ec8ef5 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:34.349820 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-12b28eba-9567-4c70-b1d9-259af8ec8ef5 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:34.350584 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-12b28eba-9567-4c70-b1d9-259af8ec8ef5 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:34.352127 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-12b28eba-9567-4c70-b1d9-259af8ec8ef5 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:34.352560 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-12b28eba-9567-4c70-b1d9-259af8ec8ef5 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:34.381719 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-12b28eba-9567-4c70-b1d9-259af8ec8ef5 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 9534d3ef-723b-4f68-b147-9c3aceed8206] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:18:34.392007 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ae3e042e-11ac-4960-adfd-7a9d55a0ddd6 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49ecfb3d5514177b2100631aa944200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c40ceb3374847ec8685b67f7c94a3c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:34.401291 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ae3e042e-11ac-4960-adfd-7a9d55a0ddd6 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] 10.222.0.40 "GET /compute/v2.1/servers/84ed9a1e-36b9-4d54-8118-b803cff45f62" status: 200 len: 1270 microversion: 2.1 time: 0.138104 Oct 26 13:18:34.402993 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1908/3834] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:34 2022] GET /compute/v2.1/servers/84ed9a1e-36b9-4d54-8118-b803cff45f62 => generated 1270 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:18:34.422160 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ff32f037-9b28-4ebb-9315-2145a4874873 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:34.422772 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ff32f037-9b28-4ebb-9315-2145a4874873 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:34.428837 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:18:34.429282 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff32f037-9b28-4ebb-9315-2145a4874873 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:34.430046 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff32f037-9b28-4ebb-9315-2145a4874873 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:34.430505 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff32f037-9b28-4ebb-9315-2145a4874873 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:34.431349 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff32f037-9b28-4ebb-9315-2145a4874873 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:34.432231 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff32f037-9b28-4ebb-9315-2145a4874873 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:34.432231 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff32f037-9b28-4ebb-9315-2145a4874873 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:34.492935 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-12b28eba-9567-4c70-b1d9-259af8ec8ef5 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206" status: 204 len: 0 microversion: 2.1 time: 0.157875 Oct 26 13:18:34.496590 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1927/3835] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:18:34 2022] DELETE /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 26 13:18:34.505350 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2e91c221-6eb4-46bd-ad0f-63ded883a1d8 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:34.506113 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2e91c221-6eb4-46bd-ad0f-63ded883a1d8 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 9534d3ef-723b-4f68-b147-9c3aceed8206] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:34.512288 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e91c221-6eb4-46bd-ad0f-63ded883a1d8 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:34.513505 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e91c221-6eb4-46bd-ad0f-63ded883a1d8 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:34.513940 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e91c221-6eb4-46bd-ad0f-63ded883a1d8 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:34.515828 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e91c221-6eb4-46bd-ad0f-63ded883a1d8 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:34.516564 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e91c221-6eb4-46bd-ad0f-63ded883a1d8 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:34.517256 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e91c221-6eb4-46bd-ad0f-63ded883a1d8 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:34.656013 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ff32f037-9b28-4ebb-9315-2145a4874873 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:34.673344 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ff32f037-9b28-4ebb-9315-2145a4874873 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6" status: 200 len: 1505 microversion: 2.1 time: 0.252761 Oct 26 13:18:34.674033 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1909/3836] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:34 2022] GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 => generated 1505 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:34.736629 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2e91c221-6eb4-46bd-ad0f-63ded883a1d8 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:34.746472 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2e91c221-6eb4-46bd-ad0f-63ded883a1d8 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206" status: 200 len: 1485 microversion: 2.1 time: 0.248410 Oct 26 13:18:34.747522 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1928/3837] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:34 2022] GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206 => generated 1485 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:35.061934 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0daeb384-e673-4573-a999-3361ef54bbba tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:35.063016 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0daeb384-e673-4573-a999-3361ef54bbba tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:35.070515 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0daeb384-e673-4573-a999-3361ef54bbba tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:35.072512 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0daeb384-e673-4573-a999-3361ef54bbba tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:35.073962 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0daeb384-e673-4573-a999-3361ef54bbba tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:35.074990 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0daeb384-e673-4573-a999-3361ef54bbba tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:35.075602 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0daeb384-e673-4573-a999-3361ef54bbba tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:35.076986 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0daeb384-e673-4573-a999-3361ef54bbba tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:35.117091 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-e27a26d2-27b9-4ecb-9074-e6f2bb9aed22 req-30568686-6ed5-42a0-901b-0dd6387ae9f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3260894-8fb6-44ee-9f97-3159a47b4a6d", "tag": "c0df8658-e943-4400-b663-6329b86c3bb7"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:18:35.139736 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e27a26d2-27b9-4ecb-9074-e6f2bb9aed22 req-30568686-6ed5-42a0-901b-0dd6387ae9f2 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:35.140489 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e27a26d2-27b9-4ecb-9074-e6f2bb9aed22 req-30568686-6ed5-42a0-901b-0dd6387ae9f2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:35.141145 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e27a26d2-27b9-4ecb-9074-e6f2bb9aed22 req-30568686-6ed5-42a0-901b-0dd6387ae9f2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:35.154524 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-e27a26d2-27b9-4ecb-9074-e6f2bb9aed22 req-30568686-6ed5-42a0-901b-0dd6387ae9f2 service nova] Creating event network-changed:c0df8658-e943-4400-b663-6329b86c3bb7 for instance b3260894-8fb6-44ee-9f97-3159a47b4a6d on n-h2-862686-1 Oct 26 13:18:35.159306 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-e27a26d2-27b9-4ecb-9074-e6f2bb9aed22 req-30568686-6ed5-42a0-901b-0dd6387ae9f2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046557 Oct 26 13:18:35.160117 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1929/3838] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:18:35.426518 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1c0fe96c-504e-4e2b-952a-65da66f706f4 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:35.427360 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1c0fe96c-504e-4e2b-952a-65da66f706f4 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: 84ed9a1e-36b9-4d54-8118-b803cff45f62] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:35.435051 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c0fe96c-504e-4e2b-952a-65da66f706f4 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:35.435660 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c0fe96c-504e-4e2b-952a-65da66f706f4 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:35.436318 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c0fe96c-504e-4e2b-952a-65da66f706f4 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:35.437099 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c0fe96c-504e-4e2b-952a-65da66f706f4 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:35.437695 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c0fe96c-504e-4e2b-952a-65da66f706f4 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:35.438198 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c0fe96c-504e-4e2b-952a-65da66f706f4 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:35.516355 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1c0fe96c-504e-4e2b-952a-65da66f706f4 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49ecfb3d5514177b2100631aa944200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c40ceb3374847ec8685b67f7c94a3c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:35.526740 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1c0fe96c-504e-4e2b-952a-65da66f706f4 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] 10.222.0.40 "GET /compute/v2.1/servers/84ed9a1e-36b9-4d54-8118-b803cff45f62" status: 200 len: 1276 microversion: 2.1 time: 0.104830 Oct 26 13:18:35.527702 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1930/3839] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:35 2022] GET /compute/v2.1/servers/84ed9a1e-36b9-4d54-8118-b803cff45f62 => generated 1276 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:18:35.574898 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0daeb384-e673-4573-a999-3361ef54bbba tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:35.585298 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0daeb384-e673-4573-a999-3361ef54bbba tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 200 len: 1510 microversion: 2.1 time: 0.528936 Oct 26 13:18:35.586699 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1910/3840] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:35 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 1510 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:35.614354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f9fa4b7c-438e-416f-9964-c1c1fbf2f844 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:35.615078 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f9fa4b7c-438e-416f-9964-c1c1fbf2f844 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:35.622884 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f9fa4b7c-438e-416f-9964-c1c1fbf2f844 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:35.623566 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f9fa4b7c-438e-416f-9964-c1c1fbf2f844 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:35.624370 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f9fa4b7c-438e-416f-9964-c1c1fbf2f844 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:35.625503 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f9fa4b7c-438e-416f-9964-c1c1fbf2f844 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:35.625971 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f9fa4b7c-438e-416f-9964-c1c1fbf2f844 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:35.626508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f9fa4b7c-438e-416f-9964-c1c1fbf2f844 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:35.657380 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f9fa4b7c-438e-416f-9964-c1c1fbf2f844 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:18:35.665436 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.compute.api [None req-f9fa4b7c-438e-416f-9964-c1c1fbf2f844 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Working on deleting snapshot cbd8fb2a-dcff-40a4-88b1-4b297423d763 from shelved instance... Oct 26 13:18:35.698784 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dbf44879-37c2-4dc5-a847-e4fc58a385ad tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:35.699896 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-dbf44879-37c2-4dc5-a847-e4fc58a385ad tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:35.708556 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dbf44879-37c2-4dc5-a847-e4fc58a385ad tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:35.709207 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dbf44879-37c2-4dc5-a847-e4fc58a385ad tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:35.710026 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dbf44879-37c2-4dc5-a847-e4fc58a385ad tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:35.711402 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dbf44879-37c2-4dc5-a847-e4fc58a385ad tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:35.711820 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dbf44879-37c2-4dc5-a847-e4fc58a385ad tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:35.712270 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dbf44879-37c2-4dc5-a847-e4fc58a385ad tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:36.183102 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-dbf44879-37c2-4dc5-a847-e4fc58a385ad tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:36.192791 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-dbf44879-37c2-4dc5-a847-e4fc58a385ad tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6" status: 200 len: 1505 microversion: 2.1 time: 0.499715 Oct 26 13:18:36.194246 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1911/3841] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:35 2022] GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 => generated 1505 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:36.201090 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6b685dca-a10b-4882-b32a-27529cb819f3 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:36.202013 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6b685dca-a10b-4882-b32a-27529cb819f3 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 9534d3ef-723b-4f68-b147-9c3aceed8206] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:36.205474 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f9fa4b7c-438e-416f-9964-c1c1fbf2f844 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Doing local delete in cell 2e5960f1-3c3d-401b-877c-fe82eb67bd3f(cell1) {{(pid=120598) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 26 13:18:36.206366 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f9fa4b7c-438e-416f-9964-c1c1fbf2f844 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:36.206842 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f9fa4b7c-438e-416f-9964-c1c1fbf2f844 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:36.207300 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f9fa4b7c-438e-416f-9964-c1c1fbf2f844 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:36.207728 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.compute.api [None req-f9fa4b7c-438e-416f-9964-c1c1fbf2f844 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 26 13:18:36.213763 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b685dca-a10b-4882-b32a-27529cb819f3 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:36.214339 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-f9fa4b7c-438e-416f-9964-c1c1fbf2f844 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] deallocate_for_instance() {{(pid=120598) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 26 13:18:36.214738 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b685dca-a10b-4882-b32a-27529cb819f3 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:36.215481 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b685dca-a10b-4882-b32a-27529cb819f3 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:36.216940 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b685dca-a10b-4882-b32a-27529cb819f3 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:36.217407 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b685dca-a10b-4882-b32a-27529cb819f3 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:36.218208 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b685dca-a10b-4882-b32a-27529cb819f3 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:36.486268 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6b685dca-a10b-4882-b32a-27529cb819f3 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:36.504131 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6b685dca-a10b-4882-b32a-27529cb819f3 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206" status: 200 len: 1485 microversion: 2.1 time: 0.307192 Oct 26 13:18:36.505814 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1912/3842] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:36 2022] GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206 => generated 1485 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:36.551386 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a258ca8f-48fa-4e58-8a3e-a1259f0a8507 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:36.552181 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a258ca8f-48fa-4e58-8a3e-a1259f0a8507 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: 84ed9a1e-36b9-4d54-8118-b803cff45f62] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:36.560485 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a258ca8f-48fa-4e58-8a3e-a1259f0a8507 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:36.561292 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a258ca8f-48fa-4e58-8a3e-a1259f0a8507 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:36.561966 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a258ca8f-48fa-4e58-8a3e-a1259f0a8507 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:36.563146 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a258ca8f-48fa-4e58-8a3e-a1259f0a8507 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:36.563804 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a258ca8f-48fa-4e58-8a3e-a1259f0a8507 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:36.564651 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a258ca8f-48fa-4e58-8a3e-a1259f0a8507 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:36.665657 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a258ca8f-48fa-4e58-8a3e-a1259f0a8507 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49ecfb3d5514177b2100631aa944200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c40ceb3374847ec8685b67f7c94a3c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:36.678262 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a258ca8f-48fa-4e58-8a3e-a1259f0a8507 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] 10.222.0.40 "GET /compute/v2.1/servers/84ed9a1e-36b9-4d54-8118-b803cff45f62" status: 200 len: 1276 microversion: 2.1 time: 0.130888 Oct 26 13:18:36.698495 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1913/3843] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:36 2022] GET /compute/v2.1/servers/84ed9a1e-36b9-4d54-8118-b803cff45f62 => generated 1276 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:18:36.882834 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-f9fa4b7c-438e-416f-9964-c1c1fbf2f844 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Updating instance_info_cache with network_info: [] {{(pid=120598) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 26 13:18:36.896393 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-e490bcfc-f99d-4407-8e66-33aa86b7fc6c req-dc21eb42-ff64-4c0b-b2d5-f6cef4d63168 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59bb4f3c-d633-42db-b86b-274fa8b95f44", "name": "network-vif-deleted", "tag": "1484b291-b3a0-410d-a1af-3a79c7d02eba"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:18:36.916386 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-e490bcfc-f99d-4407-8e66-33aa86b7fc6c req-dc21eb42-ff64-4c0b-b2d5-f6cef4d63168 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:36.917019 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-e490bcfc-f99d-4407-8e66-33aa86b7fc6c req-dc21eb42-ff64-4c0b-b2d5-f6cef4d63168 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:36.917582 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-e490bcfc-f99d-4407-8e66-33aa86b7fc6c req-dc21eb42-ff64-4c0b-b2d5-f6cef4d63168 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:36.953801 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.compute.server_external_events [req-e490bcfc-f99d-4407-8e66-33aa86b7fc6c req-dc21eb42-ff64-4c0b-b2d5-f6cef4d63168 service nova] Unable to find a host for instance 59bb4f3c-d633-42db-b86b-274fa8b95f44. Dropping event network-vif-deleted {{(pid=120597) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 26 13:18:36.956090 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-e490bcfc-f99d-4407-8e66-33aa86b7fc6c req-dc21eb42-ff64-4c0b-b2d5-f6cef4d63168 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.063825 Oct 26 13:18:36.969546 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1914/3844] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 78 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 26 13:18:37.188451 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-126cd984-cd37-4d56-b964-6de866717553 req-6f796c30-1a55-4ad3-adb3-e35fede9caaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9534d3ef-723b-4f68-b147-9c3aceed8206", "name": "network-vif-deleted", "tag": "4076f66d-6130-489d-a954-7f1e23537cf4"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:18:37.199919 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-126cd984-cd37-4d56-b964-6de866717553 req-6f796c30-1a55-4ad3-adb3-e35fede9caaa service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:37.200393 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-126cd984-cd37-4d56-b964-6de866717553 req-6f796c30-1a55-4ad3-adb3-e35fede9caaa service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:37.200853 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-126cd984-cd37-4d56-b964-6de866717553 req-6f796c30-1a55-4ad3-adb3-e35fede9caaa service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:37.214864 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-126cd984-cd37-4d56-b964-6de866717553 req-6f796c30-1a55-4ad3-adb3-e35fede9caaa service nova] Creating event network-vif-deleted:4076f66d-6130-489d-a954-7f1e23537cf4 for instance 9534d3ef-723b-4f68-b147-9c3aceed8206 on n-h2-862686-1 Oct 26 13:18:37.221524 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-126cd984-cd37-4d56-b964-6de866717553 req-6f796c30-1a55-4ad3-adb3-e35fede9caaa service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036943 Oct 26 13:18:37.222449 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1915/3845] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:18:37.230018 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f26c1474-4d2e-479a-9bdf-c2111c140140 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:37.230979 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f26c1474-4d2e-479a-9bdf-c2111c140140 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:37.238711 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f26c1474-4d2e-479a-9bdf-c2111c140140 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:37.239525 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f26c1474-4d2e-479a-9bdf-c2111c140140 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:37.240243 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f26c1474-4d2e-479a-9bdf-c2111c140140 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:37.241055 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f26c1474-4d2e-479a-9bdf-c2111c140140 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:37.241538 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f26c1474-4d2e-479a-9bdf-c2111c140140 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:37.242764 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f26c1474-4d2e-479a-9bdf-c2111c140140 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:37.250465 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f9fa4b7c-438e-416f-9964-c1c1fbf2f844 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "DELETE /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 204 len: 0 microversion: 2.1 time: 1.642232 Oct 26 13:18:37.251428 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1931/3846] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:18:35 2022] DELETE /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 0 bytes in 1644 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:18:37.260587 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9cd26a0f-2dbf-4e8f-8eec-1021074598c5 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:37.261504 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9cd26a0f-2dbf-4e8f-8eec-1021074598c5 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:37.268568 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9cd26a0f-2dbf-4e8f-8eec-1021074598c5 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:37.269348 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9cd26a0f-2dbf-4e8f-8eec-1021074598c5 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:37.269972 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9cd26a0f-2dbf-4e8f-8eec-1021074598c5 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:37.271006 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9cd26a0f-2dbf-4e8f-8eec-1021074598c5 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:37.271680 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9cd26a0f-2dbf-4e8f-8eec-1021074598c5 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:37.272653 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9cd26a0f-2dbf-4e8f-8eec-1021074598c5 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:37.289544 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-9cd26a0f-2dbf-4e8f-8eec-1021074598c5 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] HTTP exception thrown: Instance 59bb4f3c-d633-42db-b86b-274fa8b95f44 could not be found. Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9cd26a0f-2dbf-4e8f-8eec-1021074598c5 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Request method failure captured: Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 HTTP/1.1 Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTLTNOlsUS_LQCwMyQbAmNSS-N_AQOqf9a-vHlBM4RS64aXMIGczutoYb0yXKXV63kqVyJMbrGhj1O0dIymI3rB4OYRTseWpFfzGHfB9PKKsR2NnI_ukYFvVdYRwcazuK9kTcZsmuh-2k9d7Yqn3gprd7n0NXcu2P16gbCixvzOdrAQ Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: ece49f83e645408598655bece0873fd0 Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ece49f83e645408598655bece0873fd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ece49f83e645408598655bece0873fd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ece49f83e645408598655bece0873fd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ece49f83e645408598655bece0873fd0"}]}] Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: ece49f83e645408598655bece0873fd0 Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-DeleteServersTestJSON-1847538505-project Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 8d56acbbbc3545d19cbb80f4e349c763 Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-DeleteServersTestJSON-1847538505-project Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 59bb4f3c-d633-42db-b86b-274fa8b95f44 could not be found. Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '59bb4f3c-d633-42db-b86b-274fa8b95f44'} Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59bb4f3c-d633-42db-b86b-274fa8b95f44 could not be found. Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59bb4f3c-d633-42db-b86b-274fa8b95f44 could not be found. Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:18:37.291173 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:18:37.299979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:18:37.299979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:18:37.299979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:18:37.299979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:18:37.299979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:18:37.299979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59bb4f3c-d633-42db-b86b-274fa8b95f44 could not be found. Oct 26 13:18:37.299979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:18:37.299979 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9cd26a0f-2dbf-4e8f-8eec-1021074598c5 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Returning 404 to user: Instance 59bb4f3c-d633-42db-b86b-274fa8b95f44 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:18:37.299979 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9cd26a0f-2dbf-4e8f-8eec-1021074598c5 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 404 len: 111 microversion: 2.1 time: 0.036908 Oct 26 13:18:37.299979 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1932/3847] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:37 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 13:18:37.436199 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d9ac97c8-b93d-43f8-b73f-940ba1f6cdfe tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-737357883", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "cb59e2c8-6bcb-4fcf-b9e4-c01412b43c60"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:18:37.499284 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-d9ac97c8-b93d-43f8-b73f-940ba1f6cdfe tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] validate_networks() for [('cb59e2c8-6bcb-4fcf-b9e4-c01412b43c60', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:18:37.593957 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f26c1474-4d2e-479a-9bdf-c2111c140140 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:37.604358 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f26c1474-4d2e-479a-9bdf-c2111c140140 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6" status: 200 len: 1505 microversion: 2.1 time: 0.379980 Oct 26 13:18:37.605007 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1916/3848] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:37 2022] GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 => generated 1505 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:37.616472 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6507acde-5096-4020-a611-f4ac1ddcc283 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:37.619504 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6507acde-5096-4020-a611-f4ac1ddcc283 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 9534d3ef-723b-4f68-b147-9c3aceed8206] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:37.629915 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6507acde-5096-4020-a611-f4ac1ddcc283 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:37.630573 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6507acde-5096-4020-a611-f4ac1ddcc283 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:37.631086 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6507acde-5096-4020-a611-f4ac1ddcc283 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:37.631853 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6507acde-5096-4020-a611-f4ac1ddcc283 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:37.632474 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6507acde-5096-4020-a611-f4ac1ddcc283 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:37.632966 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6507acde-5096-4020-a611-f4ac1ddcc283 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:37.669602 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6507acde-5096-4020-a611-f4ac1ddcc283 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:37.671096 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6507acde-5096-4020-a611-f4ac1ddcc283 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:37.671810 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6507acde-5096-4020-a611-f4ac1ddcc283 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:37.672500 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-6507acde-5096-4020-a611-f4ac1ddcc283 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lazy-loading 'fault' on Instance uuid 9534d3ef-723b-4f68-b147-9c3aceed8206 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:18:37.776002 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6507acde-5096-4020-a611-f4ac1ddcc283 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:37.790438 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6507acde-5096-4020-a611-f4ac1ddcc283 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206" status: 200 len: 1301 microversion: 2.1 time: 0.184358 Oct 26 13:18:37.791026 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1917/3849] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:37 2022] GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206 => generated 1301 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:37.795753 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-df47a7c3-909b-4269-85e0-acc9149e1cc5 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:37.796552 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-df47a7c3-909b-4269-85e0-acc9149e1cc5 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: 84ed9a1e-36b9-4d54-8118-b803cff45f62] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:37.803512 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-df47a7c3-909b-4269-85e0-acc9149e1cc5 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:37.804284 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-df47a7c3-909b-4269-85e0-acc9149e1cc5 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:37.805403 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-df47a7c3-909b-4269-85e0-acc9149e1cc5 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:37.806321 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-df47a7c3-909b-4269-85e0-acc9149e1cc5 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:37.806950 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-df47a7c3-909b-4269-85e0-acc9149e1cc5 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:37.807537 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-df47a7c3-909b-4269-85e0-acc9149e1cc5 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:37.964274 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-d9ac97c8-b93d-43f8-b73f-940ba1f6cdfe tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:18:37.964793 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-d9ac97c8-b93d-43f8-b73f-940ba1f6cdfe tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:18:37.965143 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-d9ac97c8-b93d-43f8-b73f-940ba1f6cdfe tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:18:37.965759 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-d9ac97c8-b93d-43f8-b73f-940ba1f6cdfe tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:18:37.966325 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-d9ac97c8-b93d-43f8-b73f-940ba1f6cdfe tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:18:37.977645 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9ac97c8-b93d-43f8-b73f-940ba1f6cdfe tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:37.979680 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9ac97c8-b93d-43f8-b73f-940ba1f6cdfe tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:37.980361 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9ac97c8-b93d-43f8-b73f-940ba1f6cdfe tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:37.981533 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9ac97c8-b93d-43f8-b73f-940ba1f6cdfe tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:37.982378 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9ac97c8-b93d-43f8-b73f-940ba1f6cdfe tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:37.982886 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9ac97c8-b93d-43f8-b73f-940ba1f6cdfe tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:38.001730 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-d9ac97c8-b93d-43f8-b73f-940ba1f6cdfe tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Getting quotas for project ece49f83e645408598655bece0873fd0. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:18:38.007987 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-d9ac97c8-b93d-43f8-b73f-940ba1f6cdfe tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Getting quotas for user 8d56acbbbc3545d19cbb80f4e349c763 and project ece49f83e645408598655bece0873fd0. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:18:38.025393 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d9ac97c8-b93d-43f8-b73f-940ba1f6cdfe tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:18:38.028176 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d9ac97c8-b93d-43f8-b73f-940ba1f6cdfe tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 47c25651-2bed-4595-b4cf-69f3d8f05655] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:18:38.077445 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d9ac97c8-b93d-43f8-b73f-940ba1f6cdfe tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.646961 Oct 26 13:18:38.079043 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1933/3850] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:18:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:18:38.096492 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ca72e1e8-a252-4579-a865-39f7cc57ab74 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:38.097727 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ca72e1e8-a252-4579-a865-39f7cc57ab74 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 47c25651-2bed-4595-b4cf-69f3d8f05655] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:38.158108 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ca72e1e8-a252-4579-a865-39f7cc57ab74 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:38.162090 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-df47a7c3-909b-4269-85e0-acc9149e1cc5 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49ecfb3d5514177b2100631aa944200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c40ceb3374847ec8685b67f7c94a3c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:38.167097 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ca72e1e8-a252-4579-a865-39f7cc57ab74 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655" status: 200 len: 1214 microversion: 2.1 time: 0.080452 Oct 26 13:18:38.168885 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1934/3851] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:38 2022] GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:38.174550 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-df47a7c3-909b-4269-85e0-acc9149e1cc5 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] 10.222.0.40 "GET /compute/v2.1/servers/84ed9a1e-36b9-4d54-8118-b803cff45f62" status: 200 len: 1318 microversion: 2.1 time: 0.382267 Oct 26 13:18:38.176503 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1918/3852] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:37 2022] GET /compute/v2.1/servers/84ed9a1e-36b9-4d54-8118-b803cff45f62 => generated 1318 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:38.634899 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3cdbd1f3-41da-4fb6-b5de-eee556192549 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:38.635412 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3cdbd1f3-41da-4fb6-b5de-eee556192549 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:38.642791 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cdbd1f3-41da-4fb6-b5de-eee556192549 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:38.643571 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cdbd1f3-41da-4fb6-b5de-eee556192549 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:38.644757 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cdbd1f3-41da-4fb6-b5de-eee556192549 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:38.645716 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cdbd1f3-41da-4fb6-b5de-eee556192549 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:38.646691 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cdbd1f3-41da-4fb6-b5de-eee556192549 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:38.649646 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cdbd1f3-41da-4fb6-b5de-eee556192549 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:38.801704 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3cdbd1f3-41da-4fb6-b5de-eee556192549 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:38.812867 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3cdbd1f3-41da-4fb6-b5de-eee556192549 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6" status: 200 len: 1505 microversion: 2.1 time: 0.182977 Oct 26 13:18:38.816176 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4f6773f6-c588-4ec9-bc5d-d103e1bdc5e9 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:38.816798 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4f6773f6-c588-4ec9-bc5d-d103e1bdc5e9 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: 9534d3ef-723b-4f68-b147-9c3aceed8206] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:38.824757 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f6773f6-c588-4ec9-bc5d-d103e1bdc5e9 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:38.825242 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f6773f6-c588-4ec9-bc5d-d103e1bdc5e9 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:38.825702 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f6773f6-c588-4ec9-bc5d-d103e1bdc5e9 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:38.827163 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f6773f6-c588-4ec9-bc5d-d103e1bdc5e9 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:38.827620 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f6773f6-c588-4ec9-bc5d-d103e1bdc5e9 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:38.828042 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f6773f6-c588-4ec9-bc5d-d103e1bdc5e9 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:38.830326 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1935/3853] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:38 2022] GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 => generated 1505 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:38.843063 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-4f6773f6-c588-4ec9-bc5d-d103e1bdc5e9 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] HTTP exception thrown: Instance 9534d3ef-723b-4f68-b147-9c3aceed8206 could not be found. Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4f6773f6-c588-4ec9-bc5d-d103e1bdc5e9 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Request method failure captured: Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206 HTTP/1.1 Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTIDulnGf0cfDzb6ABf0P9I0OR8ZAxrEjf3dsSmpUDBvfTi0mRMx4cnhHxwYFoMK39PFCBGQwWgxaNanJAX2G7nZO-H0M0Y6hwrlddJMmZCT53RGEg2CCJF8JIuVVNqAQoy1FBD1Oqrvpehc-uuXoY42tDl5BuJKOtwJ5b-GC60JvCw Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 4f1ce8734839480ca6b07416a9c6d9c3 Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-LiveMigrationTest-1487865039 Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4f1ce8734839480ca6b07416a9c6d9c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4f1ce8734839480ca6b07416a9c6d9c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4f1ce8734839480ca6b07416a9c6d9c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4f1ce8734839480ca6b07416a9c6d9c3"}]}] Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-LiveMigrationTest-1487865039 Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 4f1ce8734839480ca6b07416a9c6d9c3 Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-LiveMigrationTest-1487865039 Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-LiveMigrationTest-1487865039-project Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: f96da2e13ca64db2a16d58aee1fc921d Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-LiveMigrationTest-1487865039-project Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 9534d3ef-723b-4f68-b147-9c3aceed8206 could not be found. Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '9534d3ef-723b-4f68-b147-9c3aceed8206'} Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9534d3ef-723b-4f68-b147-9c3aceed8206 could not be found. Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9534d3ef-723b-4f68-b147-9c3aceed8206 could not be found. Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:18:38.844842 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:18:38.850445 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:18:38.850445 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:18:38.850445 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:18:38.850445 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:18:38.850445 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:18:38.850445 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9534d3ef-723b-4f68-b147-9c3aceed8206 could not be found. Oct 26 13:18:38.850445 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:18:38.850445 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4f6773f6-c588-4ec9-bc5d-d103e1bdc5e9 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Returning 404 to user: Instance 9534d3ef-723b-4f68-b147-9c3aceed8206 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:18:38.850445 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4f6773f6-c588-4ec9-bc5d-d103e1bdc5e9 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206" status: 404 len: 111 microversion: 2.1 time: 0.034640 Oct 26 13:18:38.850445 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1919/3854] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:38 2022] GET /compute/v2.1/servers/9534d3ef-723b-4f68-b147-9c3aceed8206 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:18:38.858116 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-618973ac-242e-4266-9046-eacf6b7fcc94 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:38.858870 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-618973ac-242e-4266-9046-eacf6b7fcc94 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: f5da8a46-9260-405b-aa4e-1f1a585302bb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:38.861752 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:18:38.874421 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-618973ac-242e-4266-9046-eacf6b7fcc94 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:38.875167 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-618973ac-242e-4266-9046-eacf6b7fcc94 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:38.876180 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-618973ac-242e-4266-9046-eacf6b7fcc94 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:38.877374 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-618973ac-242e-4266-9046-eacf6b7fcc94 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:38.878139 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-618973ac-242e-4266-9046-eacf6b7fcc94 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:38.878800 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-618973ac-242e-4266-9046-eacf6b7fcc94 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:38.933979 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-618973ac-242e-4266-9046-eacf6b7fcc94 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: f5da8a46-9260-405b-aa4e-1f1a585302bb] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:18:39.022762 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-618973ac-242e-4266-9046-eacf6b7fcc94 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb" status: 204 len: 0 microversion: 2.1 time: 0.170421 Oct 26 13:18:39.024079 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1936/3855] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:18:38 2022] DELETE /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:18:39.032520 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-37f47cdb-794a-46e8-b76f-876ca2dfabbb tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:39.033133 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-37f47cdb-794a-46e8-b76f-876ca2dfabbb tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: f5da8a46-9260-405b-aa4e-1f1a585302bb] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:39.041546 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37f47cdb-794a-46e8-b76f-876ca2dfabbb tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:39.042053 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37f47cdb-794a-46e8-b76f-876ca2dfabbb tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:39.042494 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37f47cdb-794a-46e8-b76f-876ca2dfabbb tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:39.043195 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37f47cdb-794a-46e8-b76f-876ca2dfabbb tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:39.043651 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37f47cdb-794a-46e8-b76f-876ca2dfabbb tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:39.044074 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37f47cdb-794a-46e8-b76f-876ca2dfabbb tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:39.060281 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:18:39.189788 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-37f47cdb-794a-46e8-b76f-876ca2dfabbb tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:39.193195 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-518e2d5a-14fd-4177-b1d9-89994c2f4936 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:39.193933 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-518e2d5a-14fd-4177-b1d9-89994c2f4936 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 47c25651-2bed-4595-b4cf-69f3d8f05655] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:39.200662 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-518e2d5a-14fd-4177-b1d9-89994c2f4936 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:39.201153 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-518e2d5a-14fd-4177-b1d9-89994c2f4936 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:39.201691 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-37f47cdb-794a-46e8-b76f-876ca2dfabbb tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb" status: 200 len: 1500 microversion: 2.1 time: 0.173653 Oct 26 13:18:39.201801 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-518e2d5a-14fd-4177-b1d9-89994c2f4936 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:39.202543 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-518e2d5a-14fd-4177-b1d9-89994c2f4936 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:39.202672 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1920/3856] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:39 2022] GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb => generated 1500 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:39.206171 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-518e2d5a-14fd-4177-b1d9-89994c2f4936 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:39.206847 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-518e2d5a-14fd-4177-b1d9-89994c2f4936 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:39.207487 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-415202d5-6073-4851-b53a-b1432ce67bb0 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:39.208256 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-415202d5-6073-4851-b53a-b1432ce67bb0 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: 84ed9a1e-36b9-4d54-8118-b803cff45f62] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:39.217069 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-415202d5-6073-4851-b53a-b1432ce67bb0 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:39.217842 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-415202d5-6073-4851-b53a-b1432ce67bb0 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:39.218471 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-415202d5-6073-4851-b53a-b1432ce67bb0 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:39.219334 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-415202d5-6073-4851-b53a-b1432ce67bb0 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:39.220055 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-415202d5-6073-4851-b53a-b1432ce67bb0 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:39.220601 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-415202d5-6073-4851-b53a-b1432ce67bb0 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:39.292440 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-518e2d5a-14fd-4177-b1d9-89994c2f4936 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:39.316330 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-518e2d5a-14fd-4177-b1d9-89994c2f4936 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655" status: 200 len: 1266 microversion: 2.1 time: 0.127236 Oct 26 13:18:39.317098 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1937/3857] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:39 2022] GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655 => generated 1266 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:39.322823 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-25bdeaeb-a5d3-4ba8-add0-a5690ee60dc6 req-c0764e4c-7ef4-450b-aee2-28fc042e08cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84ed9a1e-36b9-4d54-8118-b803cff45f62", "tag": "411f438c-71f9-4eaa-9722-4b121d003b8f"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:18:39.332719 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-25bdeaeb-a5d3-4ba8-add0-a5690ee60dc6 req-c0764e4c-7ef4-450b-aee2-28fc042e08cd service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:39.333137 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-25bdeaeb-a5d3-4ba8-add0-a5690ee60dc6 req-c0764e4c-7ef4-450b-aee2-28fc042e08cd service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:39.333585 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-25bdeaeb-a5d3-4ba8-add0-a5690ee60dc6 req-c0764e4c-7ef4-450b-aee2-28fc042e08cd service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:39.347043 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-25bdeaeb-a5d3-4ba8-add0-a5690ee60dc6 req-c0764e4c-7ef4-450b-aee2-28fc042e08cd service nova] Creating event network-changed:411f438c-71f9-4eaa-9722-4b121d003b8f for instance 84ed9a1e-36b9-4d54-8118-b803cff45f62 on n-h1-862686-1 Oct 26 13:18:39.352241 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-25bdeaeb-a5d3-4ba8-add0-a5690ee60dc6 req-c0764e4c-7ef4-450b-aee2-28fc042e08cd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034230 Oct 26 13:18:39.352872 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1938/3858] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:18:39.366664 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-415202d5-6073-4851-b53a-b1432ce67bb0 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49ecfb3d5514177b2100631aa944200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c40ceb3374847ec8685b67f7c94a3c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:39.374544 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-415202d5-6073-4851-b53a-b1432ce67bb0 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] 10.222.0.40 "GET /compute/v2.1/servers/84ed9a1e-36b9-4d54-8118-b803cff45f62" status: 200 len: 1318 microversion: 2.1 time: 0.171051 Oct 26 13:18:39.375051 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1921/3859] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:39 2022] GET /compute/v2.1/servers/84ed9a1e-36b9-4d54-8118-b803cff45f62 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:39.839087 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-174ff091-a0a2-46ce-a687-f26339e5db6f tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:39.839795 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-174ff091-a0a2-46ce-a687-f26339e5db6f tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:39.847249 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-174ff091-a0a2-46ce-a687-f26339e5db6f tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:39.847743 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-174ff091-a0a2-46ce-a687-f26339e5db6f tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:39.848180 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-174ff091-a0a2-46ce-a687-f26339e5db6f tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:39.848890 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-174ff091-a0a2-46ce-a687-f26339e5db6f tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:39.849349 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-174ff091-a0a2-46ce-a687-f26339e5db6f tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:39.849805 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-174ff091-a0a2-46ce-a687-f26339e5db6f tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:39.867459 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=2,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:18:40.026691 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-174ff091-a0a2-46ce-a687-f26339e5db6f tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:40.046246 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-174ff091-a0a2-46ce-a687-f26339e5db6f tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6" status: 200 len: 1505 microversion: 2.1 time: 0.212026 Oct 26 13:18:40.046842 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1939/3860] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:39 2022] GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 => generated 1505 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:40.225180 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-904cdbb9-3bc2-4a55-bf11-686424b08eeb tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:40.226767 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-904cdbb9-3bc2-4a55-bf11-686424b08eeb tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: f5da8a46-9260-405b-aa4e-1f1a585302bb] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:40.233694 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-904cdbb9-3bc2-4a55-bf11-686424b08eeb tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:40.234362 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-904cdbb9-3bc2-4a55-bf11-686424b08eeb tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:40.234802 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-904cdbb9-3bc2-4a55-bf11-686424b08eeb tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:40.235512 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-904cdbb9-3bc2-4a55-bf11-686424b08eeb tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:40.235972 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-904cdbb9-3bc2-4a55-bf11-686424b08eeb tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:40.236397 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-904cdbb9-3bc2-4a55-bf11-686424b08eeb tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:40.342270 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0fb18f36-754c-4240-9fdc-8dbc15fa3890 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:40.342804 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0fb18f36-754c-4240-9fdc-8dbc15fa3890 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 47c25651-2bed-4595-b4cf-69f3d8f05655] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:40.353476 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0fb18f36-754c-4240-9fdc-8dbc15fa3890 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:40.353995 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0fb18f36-754c-4240-9fdc-8dbc15fa3890 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:40.354436 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0fb18f36-754c-4240-9fdc-8dbc15fa3890 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:40.355148 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0fb18f36-754c-4240-9fdc-8dbc15fa3890 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:40.355598 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0fb18f36-754c-4240-9fdc-8dbc15fa3890 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:40.356018 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0fb18f36-754c-4240-9fdc-8dbc15fa3890 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:40.513976 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0fb18f36-754c-4240-9fdc-8dbc15fa3890 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:40.522824 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0fb18f36-754c-4240-9fdc-8dbc15fa3890 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655" status: 200 len: 1266 microversion: 2.1 time: 0.184829 Oct 26 13:18:40.524907 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1940/3861] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:40 2022] GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:40.529839 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9dd7cf04-88ef-4ae8-a46b-fe86d03a8a79 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:40.530716 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9dd7cf04-88ef-4ae8-a46b-fe86d03a8a79 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: 84ed9a1e-36b9-4d54-8118-b803cff45f62] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:40.543791 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9dd7cf04-88ef-4ae8-a46b-fe86d03a8a79 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:40.549947 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9dd7cf04-88ef-4ae8-a46b-fe86d03a8a79 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:40.560339 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9dd7cf04-88ef-4ae8-a46b-fe86d03a8a79 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:40.561229 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9dd7cf04-88ef-4ae8-a46b-fe86d03a8a79 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:40.561818 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9dd7cf04-88ef-4ae8-a46b-fe86d03a8a79 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:40.562318 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9dd7cf04-88ef-4ae8-a46b-fe86d03a8a79 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:40.615902 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=4 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:18:40.720443 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-904cdbb9-3bc2-4a55-bf11-686424b08eeb tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:40.730724 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-904cdbb9-3bc2-4a55-bf11-686424b08eeb tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb" status: 200 len: 1500 microversion: 2.1 time: 0.509392 Oct 26 13:18:40.742552 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1922/3862] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:40 2022] GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb => generated 1500 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:40.917729 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9dd7cf04-88ef-4ae8-a46b-fe86d03a8a79 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49ecfb3d5514177b2100631aa944200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c40ceb3374847ec8685b67f7c94a3c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:40.928362 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9dd7cf04-88ef-4ae8-a46b-fe86d03a8a79 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] 10.222.0.40 "GET /compute/v2.1/servers/84ed9a1e-36b9-4d54-8118-b803cff45f62" status: 200 len: 1318 microversion: 2.1 time: 0.402013 Oct 26 13:18:40.933802 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1941/3863] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:40 2022] GET /compute/v2.1/servers/84ed9a1e-36b9-4d54-8118-b803cff45f62 => generated 1318 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:41.073623 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-807cb3bc-e141-44d4-9cee-4a2a4b934c7a tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:41.074537 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-807cb3bc-e141-44d4-9cee-4a2a4b934c7a tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:41.087607 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=8 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:18:41.090993 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-807cb3bc-e141-44d4-9cee-4a2a4b934c7a tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:41.091510 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-807cb3bc-e141-44d4-9cee-4a2a4b934c7a tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:41.092225 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-807cb3bc-e141-44d4-9cee-4a2a4b934c7a tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:41.093044 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-807cb3bc-e141-44d4-9cee-4a2a4b934c7a tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:41.094609 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-807cb3bc-e141-44d4-9cee-4a2a4b934c7a tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:41.097231 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-807cb3bc-e141-44d4-9cee-4a2a4b934c7a tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:41.303672 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-2ca5243a-d671-4cb4-b36b-accd31257f35 req-66d9bc34-72ea-402b-a8f2-e0fcd0f5e249 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3260894-8fb6-44ee-9f97-3159a47b4a6d", "name": "network-vif-plugged", "status": "completed", "tag": "c0df8658-e943-4400-b663-6329b86c3bb7"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:18:41.321679 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-2ca5243a-d671-4cb4-b36b-accd31257f35 req-66d9bc34-72ea-402b-a8f2-e0fcd0f5e249 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:41.322735 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-2ca5243a-d671-4cb4-b36b-accd31257f35 req-66d9bc34-72ea-402b-a8f2-e0fcd0f5e249 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:41.323629 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-2ca5243a-d671-4cb4-b36b-accd31257f35 req-66d9bc34-72ea-402b-a8f2-e0fcd0f5e249 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:41.339266 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-2ca5243a-d671-4cb4-b36b-accd31257f35 req-66d9bc34-72ea-402b-a8f2-e0fcd0f5e249 service nova] Creating event network-vif-plugged:c0df8658-e943-4400-b663-6329b86c3bb7 for instance b3260894-8fb6-44ee-9f97-3159a47b4a6d on n-h2-862686-1 Oct 26 13:18:41.346368 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-2ca5243a-d671-4cb4-b36b-accd31257f35 req-66d9bc34-72ea-402b-a8f2-e0fcd0f5e249 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049826 Oct 26 13:18:41.347932 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1942/3864] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:18:41.374011 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-70dd1512-a699-4268-85cf-122b9c137b32 req-f9f18c4f-ea8a-4c2e-a704-edad00e22719 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5da8a46-9260-405b-aa4e-1f1a585302bb", "name": "network-vif-deleted", "tag": "87173235-cfd2-4c33-ace5-d5e636ff43f4"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:18:41.395290 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-70dd1512-a699-4268-85cf-122b9c137b32 req-f9f18c4f-ea8a-4c2e-a704-edad00e22719 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:41.395799 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-70dd1512-a699-4268-85cf-122b9c137b32 req-f9f18c4f-ea8a-4c2e-a704-edad00e22719 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:41.396401 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-70dd1512-a699-4268-85cf-122b9c137b32 req-f9f18c4f-ea8a-4c2e-a704-edad00e22719 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:41.416903 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-70dd1512-a699-4268-85cf-122b9c137b32 req-f9f18c4f-ea8a-4c2e-a704-edad00e22719 service nova] Creating event network-vif-deleted:87173235-cfd2-4c33-ace5-d5e636ff43f4 for instance f5da8a46-9260-405b-aa4e-1f1a585302bb on n-h2-862686-1 Oct 26 13:18:41.424811 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-70dd1512-a699-4268-85cf-122b9c137b32 req-f9f18c4f-ea8a-4c2e-a704-edad00e22719 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057835 Oct 26 13:18:41.426370 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1943/3865] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:18:41.438174 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-807cb3bc-e141-44d4-9cee-4a2a4b934c7a tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:41.447339 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-807cb3bc-e141-44d4-9cee-4a2a4b934c7a tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6" status: 200 len: 1505 microversion: 2.1 time: 0.379241 Oct 26 13:18:41.448163 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1923/3866] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:41 2022] GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 => generated 1505 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:41.550285 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f6512f26-9ea2-4d70-a4e9-08425675e830 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:41.551017 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f6512f26-9ea2-4d70-a4e9-08425675e830 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 47c25651-2bed-4595-b4cf-69f3d8f05655] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:41.557634 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6512f26-9ea2-4d70-a4e9-08425675e830 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:41.558130 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6512f26-9ea2-4d70-a4e9-08425675e830 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:41.558567 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6512f26-9ea2-4d70-a4e9-08425675e830 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:41.559277 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6512f26-9ea2-4d70-a4e9-08425675e830 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:41.559732 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6512f26-9ea2-4d70-a4e9-08425675e830 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:41.560157 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6512f26-9ea2-4d70-a4e9-08425675e830 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:41.708732 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f6512f26-9ea2-4d70-a4e9-08425675e830 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:41.718747 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f6512f26-9ea2-4d70-a4e9-08425675e830 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655" status: 200 len: 1272 microversion: 2.1 time: 0.172754 Oct 26 13:18:41.719742 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1944/3867] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:41 2022] GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655 => generated 1272 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:41.760013 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-45280682-d757-4bc2-9684-9704eb58aa04 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:41.762504 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-45280682-d757-4bc2-9684-9704eb58aa04 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: f5da8a46-9260-405b-aa4e-1f1a585302bb] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:41.772804 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-45280682-d757-4bc2-9684-9704eb58aa04 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:41.773834 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-45280682-d757-4bc2-9684-9704eb58aa04 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:41.774503 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-45280682-d757-4bc2-9684-9704eb58aa04 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:41.775455 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-45280682-d757-4bc2-9684-9704eb58aa04 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:41.775993 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-45280682-d757-4bc2-9684-9704eb58aa04 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:41.776801 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-45280682-d757-4bc2-9684-9704eb58aa04 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:41.826101 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-45280682-d757-4bc2-9684-9704eb58aa04 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:41.826778 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-45280682-d757-4bc2-9684-9704eb58aa04 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:41.827390 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-45280682-d757-4bc2-9684-9704eb58aa04 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:41.828060 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-45280682-d757-4bc2-9684-9704eb58aa04 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lazy-loading 'fault' on Instance uuid f5da8a46-9260-405b-aa4e-1f1a585302bb {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:18:41.904172 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-45280682-d757-4bc2-9684-9704eb58aa04 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96da2e13ca64db2a16d58aee1fc921d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1ce8734839480ca6b07416a9c6d9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:41.911801 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-45280682-d757-4bc2-9684-9704eb58aa04 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb" status: 200 len: 1301 microversion: 2.1 time: 0.159345 Oct 26 13:18:41.912387 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1924/3868] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:41 2022] GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb => generated 1301 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:41.954025 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ec3ae6c1-ebf0-4143-9951-5f1989abdbfd tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:41.954808 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ec3ae6c1-ebf0-4143-9951-5f1989abdbfd tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: 84ed9a1e-36b9-4d54-8118-b803cff45f62] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:41.961999 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec3ae6c1-ebf0-4143-9951-5f1989abdbfd tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:41.962549 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec3ae6c1-ebf0-4143-9951-5f1989abdbfd tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:41.963218 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec3ae6c1-ebf0-4143-9951-5f1989abdbfd tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:41.964068 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec3ae6c1-ebf0-4143-9951-5f1989abdbfd tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:41.964704 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec3ae6c1-ebf0-4143-9951-5f1989abdbfd tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:41.965215 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec3ae6c1-ebf0-4143-9951-5f1989abdbfd tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:42.252534 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ec3ae6c1-ebf0-4143-9951-5f1989abdbfd tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49ecfb3d5514177b2100631aa944200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c40ceb3374847ec8685b67f7c94a3c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:42.260904 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ec3ae6c1-ebf0-4143-9951-5f1989abdbfd tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] 10.222.0.40 "GET /compute/v2.1/servers/84ed9a1e-36b9-4d54-8118-b803cff45f62" status: 200 len: 1318 microversion: 2.1 time: 0.310959 Oct 26 13:18:42.261532 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1945/3869] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:41 2022] GET /compute/v2.1/servers/84ed9a1e-36b9-4d54-8118-b803cff45f62 => generated 1318 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:42.473518 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1c2da0fb-7ccb-4970-ac88-89cdc6fd0e63 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:42.474209 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1c2da0fb-7ccb-4970-ac88-89cdc6fd0e63 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:42.482374 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1c2da0fb-7ccb-4970-ac88-89cdc6fd0e63 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:42.483079 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1c2da0fb-7ccb-4970-ac88-89cdc6fd0e63 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:42.483615 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1c2da0fb-7ccb-4970-ac88-89cdc6fd0e63 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:42.484296 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1c2da0fb-7ccb-4970-ac88-89cdc6fd0e63 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:42.484947 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1c2da0fb-7ccb-4970-ac88-89cdc6fd0e63 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:42.485378 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1c2da0fb-7ccb-4970-ac88-89cdc6fd0e63 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:42.635925 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1c2da0fb-7ccb-4970-ac88-89cdc6fd0e63 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:42.644924 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1c2da0fb-7ccb-4970-ac88-89cdc6fd0e63 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6" status: 200 len: 1505 microversion: 2.1 time: 0.174917 Oct 26 13:18:42.645934 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1925/3870] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:42 2022] GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 => generated 1505 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:42.743920 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cfda3667-0991-4686-9888-2730bb4f58f3 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:42.744479 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cfda3667-0991-4686-9888-2730bb4f58f3 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 47c25651-2bed-4595-b4cf-69f3d8f05655] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:42.750372 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cfda3667-0991-4686-9888-2730bb4f58f3 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:42.750860 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cfda3667-0991-4686-9888-2730bb4f58f3 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:42.751295 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cfda3667-0991-4686-9888-2730bb4f58f3 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:42.751982 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cfda3667-0991-4686-9888-2730bb4f58f3 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:42.752445 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cfda3667-0991-4686-9888-2730bb4f58f3 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:42.752857 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cfda3667-0991-4686-9888-2730bb4f58f3 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:42.934910 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-74ce215a-8be6-41e7-9084-dd63bc98a172 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:42.935666 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-74ce215a-8be6-41e7-9084-dd63bc98a172 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] [instance: f5da8a46-9260-405b-aa4e-1f1a585302bb] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:42.941848 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-74ce215a-8be6-41e7-9084-dd63bc98a172 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:42.942343 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-74ce215a-8be6-41e7-9084-dd63bc98a172 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:42.942786 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-74ce215a-8be6-41e7-9084-dd63bc98a172 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:42.943489 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-74ce215a-8be6-41e7-9084-dd63bc98a172 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:42.944152 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-74ce215a-8be6-41e7-9084-dd63bc98a172 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:42.944584 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-74ce215a-8be6-41e7-9084-dd63bc98a172 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:42.959300 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-74ce215a-8be6-41e7-9084-dd63bc98a172 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] HTTP exception thrown: Instance f5da8a46-9260-405b-aa4e-1f1a585302bb could not be found. Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-74ce215a-8be6-41e7-9084-dd63bc98a172 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Request method failure captured: Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb HTTP/1.1 Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTIDulnGf0cfDzb6ABf0P9I0OR8ZAxrEjf3dsSmpUDBvfTi0mRMx4cnhHxwYFoMK39PFCBGQwWgxaNanJAX2G7nZO-H0M0Y6hwrlddJMmZCT53RGEg2CCJF8JIuVVNqAQoy1FBD1Oqrvpehc-uuXoY42tDl5BuJKOtwJ5b-GC60JvCw Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 4f1ce8734839480ca6b07416a9c6d9c3 Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-LiveMigrationTest-1487865039 Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4f1ce8734839480ca6b07416a9c6d9c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4f1ce8734839480ca6b07416a9c6d9c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4f1ce8734839480ca6b07416a9c6d9c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4f1ce8734839480ca6b07416a9c6d9c3"}]}] Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-LiveMigrationTest-1487865039 Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 4f1ce8734839480ca6b07416a9c6d9c3 Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-LiveMigrationTest-1487865039 Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-LiveMigrationTest-1487865039-project Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: f96da2e13ca64db2a16d58aee1fc921d Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-LiveMigrationTest-1487865039-project Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance f5da8a46-9260-405b-aa4e-1f1a585302bb could not be found. Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'f5da8a46-9260-405b-aa4e-1f1a585302bb'} Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5da8a46-9260-405b-aa4e-1f1a585302bb could not be found. Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5da8a46-9260-405b-aa4e-1f1a585302bb could not be found. Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:18:42.961460 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:18:42.966866 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:18:42.966866 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:18:42.966866 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:18:42.966866 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:18:42.966866 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:18:42.966866 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5da8a46-9260-405b-aa4e-1f1a585302bb could not be found. Oct 26 13:18:42.966866 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:18:42.966866 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-74ce215a-8be6-41e7-9084-dd63bc98a172 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] Returning 404 to user: Instance f5da8a46-9260-405b-aa4e-1f1a585302bb could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:18:42.966866 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-74ce215a-8be6-41e7-9084-dd63bc98a172 tempest-LiveMigrationTest-1487865039 tempest-LiveMigrationTest-1487865039-project] 10.222.0.40 "GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb" status: 404 len: 111 microversion: 2.1 time: 0.031997 Oct 26 13:18:42.966866 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1926/3871] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:42 2022] GET /compute/v2.1/servers/f5da8a46-9260-405b-aa4e-1f1a585302bb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 13:18:43.103506 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-cfda3667-0991-4686-9888-2730bb4f58f3 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:43.111550 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cfda3667-0991-4686-9888-2730bb4f58f3 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655" status: 200 len: 1314 microversion: 2.1 time: 0.372211 Oct 26 13:18:43.112540 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1946/3872] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:42 2022] GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655 => generated 1314 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:43.284742 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4585ec65-88d5-4a52-ae58-b4d833a327fd tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:43.285556 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4585ec65-88d5-4a52-ae58-b4d833a327fd tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: 84ed9a1e-36b9-4d54-8118-b803cff45f62] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:43.294228 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4585ec65-88d5-4a52-ae58-b4d833a327fd tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:43.294950 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4585ec65-88d5-4a52-ae58-b4d833a327fd tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:43.295386 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4585ec65-88d5-4a52-ae58-b4d833a327fd tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:43.296085 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4585ec65-88d5-4a52-ae58-b4d833a327fd tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:43.296555 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4585ec65-88d5-4a52-ae58-b4d833a327fd tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:43.296985 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4585ec65-88d5-4a52-ae58-b4d833a327fd tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:43.558266 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4585ec65-88d5-4a52-ae58-b4d833a327fd tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49ecfb3d5514177b2100631aa944200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c40ceb3374847ec8685b67f7c94a3c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:43.567939 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4585ec65-88d5-4a52-ae58-b4d833a327fd tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] 10.222.0.40 "GET /compute/v2.1/servers/84ed9a1e-36b9-4d54-8118-b803cff45f62" status: 200 len: 1318 microversion: 2.1 time: 0.287169 Oct 26 13:18:43.569034 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1927/3873] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:43 2022] GET /compute/v2.1/servers/84ed9a1e-36b9-4d54-8118-b803cff45f62 => generated 1318 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:43.670094 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-454efdc8-9ebf-403e-8c6e-4449f2397f97 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:43.671891 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-454efdc8-9ebf-403e-8c6e-4449f2397f97 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:43.678890 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-454efdc8-9ebf-403e-8c6e-4449f2397f97 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:43.680579 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-454efdc8-9ebf-403e-8c6e-4449f2397f97 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:43.681033 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-454efdc8-9ebf-403e-8c6e-4449f2397f97 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:43.684651 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-454efdc8-9ebf-403e-8c6e-4449f2397f97 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:43.684651 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-454efdc8-9ebf-403e-8c6e-4449f2397f97 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:43.684651 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-454efdc8-9ebf-403e-8c6e-4449f2397f97 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:43.972941 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-a1b1a727-7a25-4390-8347-379c93610207 req-0bd2268b-6921-4362-b95c-793c5f01f9e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47c25651-2bed-4595-b4cf-69f3d8f05655", "tag": "e94455b1-262f-442f-8c2c-cbd20f6a92e1"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:18:43.983777 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a1b1a727-7a25-4390-8347-379c93610207 req-0bd2268b-6921-4362-b95c-793c5f01f9e0 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:43.984532 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a1b1a727-7a25-4390-8347-379c93610207 req-0bd2268b-6921-4362-b95c-793c5f01f9e0 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:43.985197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a1b1a727-7a25-4390-8347-379c93610207 req-0bd2268b-6921-4362-b95c-793c5f01f9e0 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:43.999704 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-a1b1a727-7a25-4390-8347-379c93610207 req-0bd2268b-6921-4362-b95c-793c5f01f9e0 service nova] Creating event network-changed:e94455b1-262f-442f-8c2c-cbd20f6a92e1 for instance 47c25651-2bed-4595-b4cf-69f3d8f05655 on n-h1-862686-1 Oct 26 13:18:44.005547 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-a1b1a727-7a25-4390-8347-379c93610207 req-0bd2268b-6921-4362-b95c-793c5f01f9e0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095559 Oct 26 13:18:44.006381 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1928/3874] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:18:44.059054 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-454efdc8-9ebf-403e-8c6e-4449f2397f97 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:44.068460 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-454efdc8-9ebf-403e-8c6e-4449f2397f97 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6" status: 200 len: 1505 microversion: 2.1 time: 0.402127 Oct 26 13:18:44.080023 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1947/3875] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:43 2022] GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 => generated 1505 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:44.137855 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-180f1aac-b2fc-4813-8e00-e87ef33eb203 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:44.138678 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-180f1aac-b2fc-4813-8e00-e87ef33eb203 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 47c25651-2bed-4595-b4cf-69f3d8f05655] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:44.148910 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-180f1aac-b2fc-4813-8e00-e87ef33eb203 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:44.149732 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-180f1aac-b2fc-4813-8e00-e87ef33eb203 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:44.150991 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-180f1aac-b2fc-4813-8e00-e87ef33eb203 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:44.152008 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-180f1aac-b2fc-4813-8e00-e87ef33eb203 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:44.152646 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-180f1aac-b2fc-4813-8e00-e87ef33eb203 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:44.164238 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-180f1aac-b2fc-4813-8e00-e87ef33eb203 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:44.171123 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-1f9888e8-d4f1-4d30-b0f9-ec80aa8d897e req-ea8750d8-ef5d-45b0-9d8c-da3960b547dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84ed9a1e-36b9-4d54-8118-b803cff45f62", "name": "network-vif-plugged", "status": "completed", "tag": "411f438c-71f9-4eaa-9722-4b121d003b8f"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:18:44.188801 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-1f9888e8-d4f1-4d30-b0f9-ec80aa8d897e req-ea8750d8-ef5d-45b0-9d8c-da3960b547dd service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:44.189282 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-1f9888e8-d4f1-4d30-b0f9-ec80aa8d897e req-ea8750d8-ef5d-45b0-9d8c-da3960b547dd service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:44.192757 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-1f9888e8-d4f1-4d30-b0f9-ec80aa8d897e req-ea8750d8-ef5d-45b0-9d8c-da3960b547dd service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:44.224990 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-1f9888e8-d4f1-4d30-b0f9-ec80aa8d897e req-ea8750d8-ef5d-45b0-9d8c-da3960b547dd service nova] Creating event network-vif-plugged:411f438c-71f9-4eaa-9722-4b121d003b8f for instance 84ed9a1e-36b9-4d54-8118-b803cff45f62 on n-h1-862686-1 Oct 26 13:18:44.232184 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-1f9888e8-d4f1-4d30-b0f9-ec80aa8d897e req-ea8750d8-ef5d-45b0-9d8c-da3960b547dd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064859 Oct 26 13:18:44.234936 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1948/3876] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:18:44.491223 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-180f1aac-b2fc-4813-8e00-e87ef33eb203 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:44.501871 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-180f1aac-b2fc-4813-8e00-e87ef33eb203 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655" status: 200 len: 1314 microversion: 2.1 time: 0.369463 Oct 26 13:18:44.502465 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1929/3877] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:44 2022] GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655 => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:18:44.593359 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f0ae5559-7af2-473c-a44c-88010b51edca tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:44.594466 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f0ae5559-7af2-473c-a44c-88010b51edca tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: 84ed9a1e-36b9-4d54-8118-b803cff45f62] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:44.603001 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0ae5559-7af2-473c-a44c-88010b51edca tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:44.603786 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0ae5559-7af2-473c-a44c-88010b51edca tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:44.604573 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0ae5559-7af2-473c-a44c-88010b51edca tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:44.606118 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0ae5559-7af2-473c-a44c-88010b51edca tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:44.606751 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0ae5559-7af2-473c-a44c-88010b51edca tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:44.607419 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0ae5559-7af2-473c-a44c-88010b51edca tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:44.754805 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f0ae5559-7af2-473c-a44c-88010b51edca tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49ecfb3d5514177b2100631aa944200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c40ceb3374847ec8685b67f7c94a3c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:44.763621 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f0ae5559-7af2-473c-a44c-88010b51edca tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] 10.222.0.40 "GET /compute/v2.1/servers/84ed9a1e-36b9-4d54-8118-b803cff45f62" status: 200 len: 1318 microversion: 2.1 time: 0.175483 Oct 26 13:18:44.764445 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1949/3878] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:44 2022] GET /compute/v2.1/servers/84ed9a1e-36b9-4d54-8118-b803cff45f62 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:45.094596 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7356f876-d10d-4f8b-b924-90b4fd845ec8 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:45.096000 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7356f876-d10d-4f8b-b924-90b4fd845ec8 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:45.113729 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7356f876-d10d-4f8b-b924-90b4fd845ec8 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:45.116485 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7356f876-d10d-4f8b-b924-90b4fd845ec8 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:45.119413 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7356f876-d10d-4f8b-b924-90b4fd845ec8 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:45.123082 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7356f876-d10d-4f8b-b924-90b4fd845ec8 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:45.123811 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7356f876-d10d-4f8b-b924-90b4fd845ec8 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:45.125087 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7356f876-d10d-4f8b-b924-90b4fd845ec8 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:45.525706 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-46620885-7fac-46ad-a869-5e7214c017b9 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:45.527078 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-46620885-7fac-46ad-a869-5e7214c017b9 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 47c25651-2bed-4595-b4cf-69f3d8f05655] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:45.535404 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46620885-7fac-46ad-a869-5e7214c017b9 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:45.535900 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46620885-7fac-46ad-a869-5e7214c017b9 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:45.536346 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46620885-7fac-46ad-a869-5e7214c017b9 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:45.537101 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46620885-7fac-46ad-a869-5e7214c017b9 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:45.537605 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46620885-7fac-46ad-a869-5e7214c017b9 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:45.538221 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46620885-7fac-46ad-a869-5e7214c017b9 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:45.583069 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7356f876-d10d-4f8b-b924-90b4fd845ec8 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:45.595273 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7356f876-d10d-4f8b-b924-90b4fd845ec8 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6" status: 200 len: 1505 microversion: 2.1 time: 0.505297 Oct 26 13:18:45.595880 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1930/3879] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:45 2022] GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 => generated 1505 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:45.789987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e73424f5-7baa-4c8a-9509-547e042b10c6 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:45.790850 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e73424f5-7baa-4c8a-9509-547e042b10c6 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: 84ed9a1e-36b9-4d54-8118-b803cff45f62] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:45.803147 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-46620885-7fac-46ad-a869-5e7214c017b9 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:45.808510 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e73424f5-7baa-4c8a-9509-547e042b10c6 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:45.811443 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e73424f5-7baa-4c8a-9509-547e042b10c6 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:45.815020 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-46620885-7fac-46ad-a869-5e7214c017b9 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655" status: 200 len: 1314 microversion: 2.1 time: 0.294135 Oct 26 13:18:45.815889 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1950/3880] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:45 2022] GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:18:45.816649 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e73424f5-7baa-4c8a-9509-547e042b10c6 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:45.817996 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e73424f5-7baa-4c8a-9509-547e042b10c6 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:45.818700 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e73424f5-7baa-4c8a-9509-547e042b10c6 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:45.819375 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e73424f5-7baa-4c8a-9509-547e042b10c6 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:46.154253 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e73424f5-7baa-4c8a-9509-547e042b10c6 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49ecfb3d5514177b2100631aa944200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c40ceb3374847ec8685b67f7c94a3c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:46.165083 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e73424f5-7baa-4c8a-9509-547e042b10c6 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] 10.222.0.40 "GET /compute/v2.1/servers/84ed9a1e-36b9-4d54-8118-b803cff45f62" status: 200 len: 1318 microversion: 2.1 time: 0.378460 Oct 26 13:18:46.166341 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1931/3881] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:45 2022] GET /compute/v2.1/servers/84ed9a1e-36b9-4d54-8118-b803cff45f62 => generated 1318 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:46.627381 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-96acae23-2053-4001-b889-3c1135e83b60 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:46.628588 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-96acae23-2053-4001-b889-3c1135e83b60 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:46.643006 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-96acae23-2053-4001-b889-3c1135e83b60 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:46.644467 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-96acae23-2053-4001-b889-3c1135e83b60 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:46.645276 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-96acae23-2053-4001-b889-3c1135e83b60 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:46.646234 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-96acae23-2053-4001-b889-3c1135e83b60 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:46.647122 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-96acae23-2053-4001-b889-3c1135e83b60 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:46.648559 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-96acae23-2053-4001-b889-3c1135e83b60 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:46.840635 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ed12dd0a-20f0-42e1-af8d-914cfec1a1a9 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:46.841250 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ed12dd0a-20f0-42e1-af8d-914cfec1a1a9 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 47c25651-2bed-4595-b4cf-69f3d8f05655] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:46.848337 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed12dd0a-20f0-42e1-af8d-914cfec1a1a9 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:46.849134 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed12dd0a-20f0-42e1-af8d-914cfec1a1a9 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:46.849908 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed12dd0a-20f0-42e1-af8d-914cfec1a1a9 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:46.850480 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed12dd0a-20f0-42e1-af8d-914cfec1a1a9 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:46.851601 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed12dd0a-20f0-42e1-af8d-914cfec1a1a9 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:46.852151 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed12dd0a-20f0-42e1-af8d-914cfec1a1a9 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:47.052006 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ed12dd0a-20f0-42e1-af8d-914cfec1a1a9 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:47.064010 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ed12dd0a-20f0-42e1-af8d-914cfec1a1a9 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655" status: 200 len: 1314 microversion: 2.1 time: 0.227720 Oct 26 13:18:47.064630 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1932/3882] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:46 2022] GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:18:47.137457 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-96acae23-2053-4001-b889-3c1135e83b60 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:47.145200 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-96acae23-2053-4001-b889-3c1135e83b60 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6" status: 200 len: 1505 microversion: 2.1 time: 0.524598 Oct 26 13:18:47.145806 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1951/3883] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:46 2022] GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 => generated 1505 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:47.190733 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c6dba446-66cb-4e94-80b5-8a1868925ab7 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:47.191332 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c6dba446-66cb-4e94-80b5-8a1868925ab7 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: 84ed9a1e-36b9-4d54-8118-b803cff45f62] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:47.199666 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c6dba446-66cb-4e94-80b5-8a1868925ab7 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:47.200238 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c6dba446-66cb-4e94-80b5-8a1868925ab7 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:47.200717 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c6dba446-66cb-4e94-80b5-8a1868925ab7 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:47.201470 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c6dba446-66cb-4e94-80b5-8a1868925ab7 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:47.201951 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c6dba446-66cb-4e94-80b5-8a1868925ab7 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:47.202408 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c6dba446-66cb-4e94-80b5-8a1868925ab7 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:47.394282 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c6dba446-66cb-4e94-80b5-8a1868925ab7 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49ecfb3d5514177b2100631aa944200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c40ceb3374847ec8685b67f7c94a3c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:47.403492 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c6dba446-66cb-4e94-80b5-8a1868925ab7 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] 10.222.0.40 "GET /compute/v2.1/servers/84ed9a1e-36b9-4d54-8118-b803cff45f62" status: 200 len: 1507 microversion: 2.1 time: 0.216864 Oct 26 13:18:47.404100 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1933/3884] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:47 2022] GET /compute/v2.1/servers/84ed9a1e-36b9-4d54-8118-b803cff45f62 => generated 1507 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:47.427281 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9d42fcdc-fa79-46d9-8540-a4e6ec99075c tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:47.427969 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9d42fcdc-fa79-46d9-8540-a4e6ec99075c tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: b3260894-8fb6-44ee-9f97-3159a47b4a6d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:47.435733 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d42fcdc-fa79-46d9-8540-a4e6ec99075c tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:47.436241 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d42fcdc-fa79-46d9-8540-a4e6ec99075c tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:47.436681 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d42fcdc-fa79-46d9-8540-a4e6ec99075c tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:47.437684 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d42fcdc-fa79-46d9-8540-a4e6ec99075c tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:47.438153 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d42fcdc-fa79-46d9-8540-a4e6ec99075c tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:47.438607 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d42fcdc-fa79-46d9-8540-a4e6ec99075c tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:47.992758 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:18:48.027658 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9d42fcdc-fa79-46d9-8540-a4e6ec99075c tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49ecfb3d5514177b2100631aa944200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c40ceb3374847ec8685b67f7c94a3c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:48.041137 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9d42fcdc-fa79-46d9-8540-a4e6ec99075c tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] 10.222.0.40 "GET /compute/v2.1/servers/b3260894-8fb6-44ee-9f97-3159a47b4a6d" status: 200 len: 1506 microversion: 2.1 time: 0.617490 Oct 26 13:18:48.041687 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1952/3885] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:47 2022] GET /compute/v2.1/servers/b3260894-8fb6-44ee-9f97-3159a47b4a6d => generated 1506 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:48.069515 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c66b8d16-90d6-42dc-9fa9-1fb89774b459 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:48.071033 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c66b8d16-90d6-42dc-9fa9-1fb89774b459 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: b3260894-8fb6-44ee-9f97-3159a47b4a6d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:48.078997 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c66b8d16-90d6-42dc-9fa9-1fb89774b459 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:48.079801 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c66b8d16-90d6-42dc-9fa9-1fb89774b459 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:48.080612 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c66b8d16-90d6-42dc-9fa9-1fb89774b459 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:48.081666 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c66b8d16-90d6-42dc-9fa9-1fb89774b459 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:48.082382 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c66b8d16-90d6-42dc-9fa9-1fb89774b459 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:48.083048 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c66b8d16-90d6-42dc-9fa9-1fb89774b459 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:48.088930 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2860a4c7-55c5-452a-8f2f-56c2b86fd70d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:48.090061 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2860a4c7-55c5-452a-8f2f-56c2b86fd70d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 47c25651-2bed-4595-b4cf-69f3d8f05655] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:48.099192 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2860a4c7-55c5-452a-8f2f-56c2b86fd70d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:48.101424 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2860a4c7-55c5-452a-8f2f-56c2b86fd70d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:48.103848 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2860a4c7-55c5-452a-8f2f-56c2b86fd70d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:48.105091 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2860a4c7-55c5-452a-8f2f-56c2b86fd70d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:48.105862 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2860a4c7-55c5-452a-8f2f-56c2b86fd70d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:48.110376 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2860a4c7-55c5-452a-8f2f-56c2b86fd70d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:48.154441 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c66b8d16-90d6-42dc-9fa9-1fb89774b459 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: b3260894-8fb6-44ee-9f97-3159a47b4a6d] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:18:48.169129 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=8 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:18:48.256481 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:18:48.270576 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c66b8d16-90d6-42dc-9fa9-1fb89774b459 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b3260894-8fb6-44ee-9f97-3159a47b4a6d" status: 204 len: 0 microversion: 2.1 time: 0.204980 Oct 26 13:18:48.271785 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1934/3886] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:18:48 2022] DELETE /compute/v2.1/servers/b3260894-8fb6-44ee-9f97-3159a47b4a6d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:18:48.279463 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a2623e9a-3044-43b3-887b-502c46cd9479 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:48.280175 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a2623e9a-3044-43b3-887b-502c46cd9479 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:48.288170 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2623e9a-3044-43b3-887b-502c46cd9479 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:48.288718 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2623e9a-3044-43b3-887b-502c46cd9479 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:48.289315 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2623e9a-3044-43b3-887b-502c46cd9479 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:48.290125 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2623e9a-3044-43b3-887b-502c46cd9479 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:48.290591 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2623e9a-3044-43b3-887b-502c46cd9479 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:48.291022 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2623e9a-3044-43b3-887b-502c46cd9479 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:48.469021 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a2623e9a-3044-43b3-887b-502c46cd9479 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:48.474199 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2860a4c7-55c5-452a-8f2f-56c2b86fd70d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:48.478788 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a2623e9a-3044-43b3-887b-502c46cd9479 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6" status: 200 len: 1505 microversion: 2.1 time: 0.204683 Oct 26 13:18:48.479399 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1935/3887] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:48 2022] GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 => generated 1505 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:48.485765 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-acdce49e-0402-4291-9ce8-775c764c9d97 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:48.486288 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-acdce49e-0402-4291-9ce8-775c764c9d97 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: 84ed9a1e-36b9-4d54-8118-b803cff45f62] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:48.493917 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-acdce49e-0402-4291-9ce8-775c764c9d97 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:48.494625 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-acdce49e-0402-4291-9ce8-775c764c9d97 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:48.495185 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-acdce49e-0402-4291-9ce8-775c764c9d97 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:48.496857 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-acdce49e-0402-4291-9ce8-775c764c9d97 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:48.498005 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-acdce49e-0402-4291-9ce8-775c764c9d97 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:48.498707 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-acdce49e-0402-4291-9ce8-775c764c9d97 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:48.508432 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2860a4c7-55c5-452a-8f2f-56c2b86fd70d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655" status: 200 len: 1314 microversion: 2.1 time: 0.423944 Oct 26 13:18:48.509417 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1953/3888] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:48 2022] GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655 => generated 1314 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:48.519963 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:18:48.536450 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-acdce49e-0402-4291-9ce8-775c764c9d97 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: 84ed9a1e-36b9-4d54-8118-b803cff45f62] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:18:48.627093 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-acdce49e-0402-4291-9ce8-775c764c9d97 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] 10.222.0.40 "DELETE /compute/v2.1/servers/84ed9a1e-36b9-4d54-8118-b803cff45f62" status: 204 len: 0 microversion: 2.1 time: 0.146462 Oct 26 13:18:48.627685 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1936/3889] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:18:48 2022] DELETE /compute/v2.1/servers/84ed9a1e-36b9-4d54-8118-b803cff45f62 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:18:48.636797 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-26dcf1fa-78ec-4433-96ef-3e6392a540a2 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:48.637649 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-26dcf1fa-78ec-4433-96ef-3e6392a540a2 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: b3260894-8fb6-44ee-9f97-3159a47b4a6d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:48.644532 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26dcf1fa-78ec-4433-96ef-3e6392a540a2 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:48.645129 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26dcf1fa-78ec-4433-96ef-3e6392a540a2 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:48.645600 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26dcf1fa-78ec-4433-96ef-3e6392a540a2 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:48.646308 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26dcf1fa-78ec-4433-96ef-3e6392a540a2 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:48.646764 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26dcf1fa-78ec-4433-96ef-3e6392a540a2 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:48.647444 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26dcf1fa-78ec-4433-96ef-3e6392a540a2 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:48.806890 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-26dcf1fa-78ec-4433-96ef-3e6392a540a2 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49ecfb3d5514177b2100631aa944200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c40ceb3374847ec8685b67f7c94a3c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:48.816404 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-26dcf1fa-78ec-4433-96ef-3e6392a540a2 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] 10.222.0.40 "GET /compute/v2.1/servers/b3260894-8fb6-44ee-9f97-3159a47b4a6d" status: 200 len: 1512 microversion: 2.1 time: 0.184397 Oct 26 13:18:48.825526 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1954/3890] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:48 2022] GET /compute/v2.1/servers/b3260894-8fb6-44ee-9f97-3159a47b4a6d => generated 1512 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:18:49.331124 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-644cf08a-d489-4713-817d-bd16d36552f1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:49.332499 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-644cf08a-d489-4713-817d-bd16d36552f1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:49.342296 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-644cf08a-d489-4713-817d-bd16d36552f1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:49.343101 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-644cf08a-d489-4713-817d-bd16d36552f1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:49.343545 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-644cf08a-d489-4713-817d-bd16d36552f1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:49.344473 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-644cf08a-d489-4713-817d-bd16d36552f1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:49.344982 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-644cf08a-d489-4713-817d-bd16d36552f1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:49.345414 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-644cf08a-d489-4713-817d-bd16d36552f1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:49.375705 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-644cf08a-d489-4713-817d-bd16d36552f1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9/ips" status: 200 len: 149 microversion: 2.1 time: 0.050528 Oct 26 13:18:49.376309 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1937/3891] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Oct 26 13:18:49 2022] GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9/ips => generated 149 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:18:49.508894 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c0d18717-1498-46b4-b0b9-13f7671bd348 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:49.512829 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c0d18717-1498-46b4-b0b9-13f7671bd348 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:49.520531 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0d18717-1498-46b4-b0b9-13f7671bd348 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:49.521150 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0d18717-1498-46b4-b0b9-13f7671bd348 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:49.522472 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0d18717-1498-46b4-b0b9-13f7671bd348 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:49.523498 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0d18717-1498-46b4-b0b9-13f7671bd348 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:49.524182 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0d18717-1498-46b4-b0b9-13f7671bd348 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:49.524598 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0d18717-1498-46b4-b0b9-13f7671bd348 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:49.535860 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d2df4bcb-6bd4-4c28-b06a-45942031766a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:49.536527 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d2df4bcb-6bd4-4c28-b06a-45942031766a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 47c25651-2bed-4595-b4cf-69f3d8f05655] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:49.550295 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d2df4bcb-6bd4-4c28-b06a-45942031766a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:49.551207 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d2df4bcb-6bd4-4c28-b06a-45942031766a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:49.552377 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d2df4bcb-6bd4-4c28-b06a-45942031766a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:49.553588 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d2df4bcb-6bd4-4c28-b06a-45942031766a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:49.555338 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d2df4bcb-6bd4-4c28-b06a-45942031766a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:49.556855 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d2df4bcb-6bd4-4c28-b06a-45942031766a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:49.729468 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c0d18717-1498-46b4-b0b9-13f7671bd348 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:49.756858 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c0d18717-1498-46b4-b0b9-13f7671bd348 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6" status: 200 len: 1505 microversion: 2.1 time: 0.253309 Oct 26 13:18:49.759201 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1955/3892] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:49 2022] GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 => generated 1505 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:18:49.846115 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1ea2172a-eb87-418e-a78e-1b65a9caf3a0 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:49.847350 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1ea2172a-eb87-418e-a78e-1b65a9caf3a0 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: b3260894-8fb6-44ee-9f97-3159a47b4a6d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:49.855960 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ea2172a-eb87-418e-a78e-1b65a9caf3a0 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:49.859744 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ea2172a-eb87-418e-a78e-1b65a9caf3a0 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:49.860509 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ea2172a-eb87-418e-a78e-1b65a9caf3a0 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:49.862894 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ea2172a-eb87-418e-a78e-1b65a9caf3a0 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:49.864692 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ea2172a-eb87-418e-a78e-1b65a9caf3a0 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:49.865167 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ea2172a-eb87-418e-a78e-1b65a9caf3a0 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:49.966334 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d2df4bcb-6bd4-4c28-b06a-45942031766a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:49.991044 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d2df4bcb-6bd4-4c28-b06a-45942031766a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655" status: 200 len: 1314 microversion: 2.1 time: 0.459257 Oct 26 13:18:50.011280 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1938/3893] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:49 2022] GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655 => generated 1314 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:18:50.061177 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1ea2172a-eb87-418e-a78e-1b65a9caf3a0 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49ecfb3d5514177b2100631aa944200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c40ceb3374847ec8685b67f7c94a3c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:50.077074 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1ea2172a-eb87-418e-a78e-1b65a9caf3a0 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] 10.222.0.40 "GET /compute/v2.1/servers/b3260894-8fb6-44ee-9f97-3159a47b4a6d" status: 200 len: 1512 microversion: 2.1 time: 0.234798 Oct 26 13:18:50.078019 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1956/3894] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:49 2022] GET /compute/v2.1/servers/b3260894-8fb6-44ee-9f97-3159a47b4a6d => generated 1512 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:18:50.553723 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-3448717c-e339-4517-91ec-ca729d88fda5 req-f321fe14-7c5a-4e37-bb01-137c636cb38e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47c25651-2bed-4595-b4cf-69f3d8f05655", "name": "network-vif-plugged", "status": "completed", "tag": "e94455b1-262f-442f-8c2c-cbd20f6a92e1"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:18:50.574556 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-3448717c-e339-4517-91ec-ca729d88fda5 req-f321fe14-7c5a-4e37-bb01-137c636cb38e service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:50.575465 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-3448717c-e339-4517-91ec-ca729d88fda5 req-f321fe14-7c5a-4e37-bb01-137c636cb38e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:50.576059 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-3448717c-e339-4517-91ec-ca729d88fda5 req-f321fe14-7c5a-4e37-bb01-137c636cb38e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:50.597294 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-3448717c-e339-4517-91ec-ca729d88fda5 req-f321fe14-7c5a-4e37-bb01-137c636cb38e service nova] Creating event network-vif-plugged:e94455b1-262f-442f-8c2c-cbd20f6a92e1 for instance 47c25651-2bed-4595-b4cf-69f3d8f05655 on n-h1-862686-1 Oct 26 13:18:50.606073 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-3448717c-e339-4517-91ec-ca729d88fda5 req-f321fe14-7c5a-4e37-bb01-137c636cb38e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056693 Oct 26 13:18:50.607995 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1939/3895] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:18:50.791978 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2b62af4c-bf11-437f-9a5d-be749887c589 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:50.793980 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2b62af4c-bf11-437f-9a5d-be749887c589 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:50.804080 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2b62af4c-bf11-437f-9a5d-be749887c589 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:50.804857 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2b62af4c-bf11-437f-9a5d-be749887c589 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:50.805554 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2b62af4c-bf11-437f-9a5d-be749887c589 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:50.806980 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2b62af4c-bf11-437f-9a5d-be749887c589 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:50.807624 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2b62af4c-bf11-437f-9a5d-be749887c589 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:50.808215 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2b62af4c-bf11-437f-9a5d-be749887c589 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:51.027293 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-68866a9b-7fe8-4338-aa13-41c4894cd994 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:51.031237 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-68866a9b-7fe8-4338-aa13-41c4894cd994 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 47c25651-2bed-4595-b4cf-69f3d8f05655] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:51.064134 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-68866a9b-7fe8-4338-aa13-41c4894cd994 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:51.064953 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-68866a9b-7fe8-4338-aa13-41c4894cd994 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:51.068826 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-68866a9b-7fe8-4338-aa13-41c4894cd994 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:51.070234 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-68866a9b-7fe8-4338-aa13-41c4894cd994 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:51.071083 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-68866a9b-7fe8-4338-aa13-41c4894cd994 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:51.073774 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-68866a9b-7fe8-4338-aa13-41c4894cd994 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:51.398960 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2b62af4c-bf11-437f-9a5d-be749887c589 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:51.416010 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2b62af4c-bf11-437f-9a5d-be749887c589 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6" status: 200 len: 1505 microversion: 2.1 time: 0.621848 Oct 26 13:18:51.417307 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1957/3896] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:50 2022] GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 => generated 1505 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:51.422392 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bf279f4c-5f8e-4213-bca0-773aed981069 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:51.423251 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bf279f4c-5f8e-4213-bca0-773aed981069 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: b3260894-8fb6-44ee-9f97-3159a47b4a6d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:51.437226 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bf279f4c-5f8e-4213-bca0-773aed981069 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:51.438117 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bf279f4c-5f8e-4213-bca0-773aed981069 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:51.438743 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bf279f4c-5f8e-4213-bca0-773aed981069 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:51.439638 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bf279f4c-5f8e-4213-bca0-773aed981069 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:51.440285 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bf279f4c-5f8e-4213-bca0-773aed981069 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:51.440964 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bf279f4c-5f8e-4213-bca0-773aed981069 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:51.446802 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:18:51.604579 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bf279f4c-5f8e-4213-bca0-773aed981069 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49ecfb3d5514177b2100631aa944200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c40ceb3374847ec8685b67f7c94a3c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:51.614329 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bf279f4c-5f8e-4213-bca0-773aed981069 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] 10.222.0.40 "GET /compute/v2.1/servers/b3260894-8fb6-44ee-9f97-3159a47b4a6d" status: 200 len: 1512 microversion: 2.1 time: 0.195533 Oct 26 13:18:51.615288 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1958/3897] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:51 2022] GET /compute/v2.1/servers/b3260894-8fb6-44ee-9f97-3159a47b4a6d => generated 1512 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:51.621459 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-8815d091-5e1d-475f-aa87-fc043e23f1fb req-7db3c15f-a53c-4425-a066-9c99cc8ba500 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84ed9a1e-36b9-4d54-8118-b803cff45f62", "name": "network-vif-deleted", "tag": "411f438c-71f9-4eaa-9722-4b121d003b8f"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:18:51.632653 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8815d091-5e1d-475f-aa87-fc043e23f1fb req-7db3c15f-a53c-4425-a066-9c99cc8ba500 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:51.633337 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8815d091-5e1d-475f-aa87-fc043e23f1fb req-7db3c15f-a53c-4425-a066-9c99cc8ba500 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:51.633834 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8815d091-5e1d-475f-aa87-fc043e23f1fb req-7db3c15f-a53c-4425-a066-9c99cc8ba500 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:51.657125 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-68866a9b-7fe8-4338-aa13-41c4894cd994 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:51.667068 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-68866a9b-7fe8-4338-aa13-41c4894cd994 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655" status: 200 len: 1314 microversion: 2.1 time: 0.650073 Oct 26 13:18:51.667676 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1940/3898] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:51 2022] GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655 => generated 1314 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:51.674231 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-8815d091-5e1d-475f-aa87-fc043e23f1fb req-7db3c15f-a53c-4425-a066-9c99cc8ba500 service nova] Creating event network-vif-deleted:411f438c-71f9-4eaa-9722-4b121d003b8f for instance 84ed9a1e-36b9-4d54-8118-b803cff45f62 on n-h1-862686-1 Oct 26 13:18:51.687359 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-8815d091-5e1d-475f-aa87-fc043e23f1fb req-7db3c15f-a53c-4425-a066-9c99cc8ba500 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070682 Oct 26 13:18:51.687998 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1959/3899] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:18:52.038735 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c04f6b8a-9863-4c77-8150-0d071464c6b9 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72d889e1-4eff-40fd-ac5e-85c6f5715586"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:18:52.041644 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c04f6b8a-9863-4c77-8150-0d071464c6b9 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:52.055461 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c04f6b8a-9863-4c77-8150-0d071464c6b9 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:52.057788 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c04f6b8a-9863-4c77-8150-0d071464c6b9 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:52.058267 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c04f6b8a-9863-4c77-8150-0d071464c6b9 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:52.059015 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c04f6b8a-9863-4c77-8150-0d071464c6b9 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:52.059489 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c04f6b8a-9863-4c77-8150-0d071464c6b9 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:52.059929 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c04f6b8a-9863-4c77-8150-0d071464c6b9 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:52.307599 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-da3e4d44-d1c4-4242-a283-39c6713e5e37 req-ff7e766e-84df-44ef-9c97-8dc11c7a6a63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3260894-8fb6-44ee-9f97-3159a47b4a6d", "name": "network-vif-deleted", "tag": "c0df8658-e943-4400-b663-6329b86c3bb7"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:18:52.329418 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-da3e4d44-d1c4-4242-a283-39c6713e5e37 req-ff7e766e-84df-44ef-9c97-8dc11c7a6a63 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:52.331098 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-da3e4d44-d1c4-4242-a283-39c6713e5e37 req-ff7e766e-84df-44ef-9c97-8dc11c7a6a63 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:52.331717 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-da3e4d44-d1c4-4242-a283-39c6713e5e37 req-ff7e766e-84df-44ef-9c97-8dc11c7a6a63 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:52.352981 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-da3e4d44-d1c4-4242-a283-39c6713e5e37 req-ff7e766e-84df-44ef-9c97-8dc11c7a6a63 service nova] Creating event network-vif-deleted:c0df8658-e943-4400-b663-6329b86c3bb7 for instance b3260894-8fb6-44ee-9f97-3159a47b4a6d on n-h2-862686-1 Oct 26 13:18:52.363791 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-da3e4d44-d1c4-4242-a283-39c6713e5e37 req-ff7e766e-84df-44ef-9c97-8dc11c7a6a63 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061122 Oct 26 13:18:52.365888 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1960/3900] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:18:52.446016 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6edc845e-8f27-477d-9b8c-d362cd960562 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:52.447020 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6edc845e-8f27-477d-9b8c-d362cd960562 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:52.454225 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6edc845e-8f27-477d-9b8c-d362cd960562 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:52.455039 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6edc845e-8f27-477d-9b8c-d362cd960562 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:52.455724 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6edc845e-8f27-477d-9b8c-d362cd960562 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:52.456605 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6edc845e-8f27-477d-9b8c-d362cd960562 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:52.457256 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6edc845e-8f27-477d-9b8c-d362cd960562 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:52.457885 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6edc845e-8f27-477d-9b8c-d362cd960562 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:52.485076 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c04f6b8a-9863-4c77-8150-0d071464c6b9 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "POST /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.447286 Oct 26 13:18:52.494160 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1941/3901] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Oct 26 13:18:52 2022] POST /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9/os-volume_attachments => generated 194 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:18:52.654072 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9d17ef40-8f72-4164-8cae-ce2daa20b017 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:52.654887 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9d17ef40-8f72-4164-8cae-ce2daa20b017 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: b3260894-8fb6-44ee-9f97-3159a47b4a6d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:52.678641 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9d17ef40-8f72-4164-8cae-ce2daa20b017 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:52.679964 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9d17ef40-8f72-4164-8cae-ce2daa20b017 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:52.680436 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9d17ef40-8f72-4164-8cae-ce2daa20b017 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:52.681161 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9d17ef40-8f72-4164-8cae-ce2daa20b017 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:52.681648 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9d17ef40-8f72-4164-8cae-ce2daa20b017 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:52.682076 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9d17ef40-8f72-4164-8cae-ce2daa20b017 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:52.718180 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6edc845e-8f27-477d-9b8c-d362cd960562 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:52.731464 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6edc845e-8f27-477d-9b8c-d362cd960562 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6" status: 200 len: 1485 microversion: 2.1 time: 0.290287 Oct 26 13:18:52.733057 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9d17ef40-8f72-4164-8cae-ce2daa20b017 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:52.738340 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9d17ef40-8f72-4164-8cae-ce2daa20b017 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:52.738798 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9d17ef40-8f72-4164-8cae-ce2daa20b017 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:52.739262 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-9d17ef40-8f72-4164-8cae-ce2daa20b017 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lazy-loading 'fault' on Instance uuid b3260894-8fb6-44ee-9f97-3159a47b4a6d {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:18:52.752063 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1961/3902] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:52 2022] GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 => generated 1485 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:18:52.764423 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-02a06a58-5a77-4830-9611-a52ad9e4aa8f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:52.765456 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-02a06a58-5a77-4830-9611-a52ad9e4aa8f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 47c25651-2bed-4595-b4cf-69f3d8f05655] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:52.800932 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02a06a58-5a77-4830-9611-a52ad9e4aa8f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:52.801440 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02a06a58-5a77-4830-9611-a52ad9e4aa8f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:52.801907 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02a06a58-5a77-4830-9611-a52ad9e4aa8f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:52.805909 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02a06a58-5a77-4830-9611-a52ad9e4aa8f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:52.806400 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02a06a58-5a77-4830-9611-a52ad9e4aa8f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:52.814738 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02a06a58-5a77-4830-9611-a52ad9e4aa8f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:52.854735 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9d17ef40-8f72-4164-8cae-ce2daa20b017 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49ecfb3d5514177b2100631aa944200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c40ceb3374847ec8685b67f7c94a3c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:52.862770 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9d17ef40-8f72-4164-8cae-ce2daa20b017 tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] 10.222.0.40 "GET /compute/v2.1/servers/b3260894-8fb6-44ee-9f97-3159a47b4a6d" status: 200 len: 1308 microversion: 2.1 time: 0.227161 Oct 26 13:18:52.863355 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1942/3903] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:52 2022] GET /compute/v2.1/servers/b3260894-8fb6-44ee-9f97-3159a47b4a6d => generated 1308 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:52.872732 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-991fb1c1-8a87-46f1-86f9-fa7816940e50 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:18:52.875677 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-991fb1c1-8a87-46f1-86f9-fa7816940e50 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:52.895384 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-991fb1c1-8a87-46f1-86f9-fa7816940e50 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:52.896087 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-991fb1c1-8a87-46f1-86f9-fa7816940e50 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:52.897140 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-991fb1c1-8a87-46f1-86f9-fa7816940e50 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:52.900043 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-991fb1c1-8a87-46f1-86f9-fa7816940e50 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:52.900693 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-991fb1c1-8a87-46f1-86f9-fa7816940e50 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:52.906116 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-991fb1c1-8a87-46f1-86f9-fa7816940e50 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:52.993580 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-991fb1c1-8a87-46f1-86f9-fa7816940e50 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "POST /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6/action" status: 202 len: 0 microversion: 2.1 time: 0.126148 Oct 26 13:18:52.995747 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1943/3904] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:18:52 2022] POST /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:18:53.012832 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a72ca13b-d102-48e2-a969-4903cd0d3053 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:53.014183 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a72ca13b-d102-48e2-a969-4903cd0d3053 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:53.028381 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a72ca13b-d102-48e2-a969-4903cd0d3053 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:53.029240 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a72ca13b-d102-48e2-a969-4903cd0d3053 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:53.030024 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a72ca13b-d102-48e2-a969-4903cd0d3053 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:53.031262 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a72ca13b-d102-48e2-a969-4903cd0d3053 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:53.032333 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a72ca13b-d102-48e2-a969-4903cd0d3053 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:53.033092 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a72ca13b-d102-48e2-a969-4903cd0d3053 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:53.225340 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-02a06a58-5a77-4830-9611-a52ad9e4aa8f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:53.249240 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-02a06a58-5a77-4830-9611-a52ad9e4aa8f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655" status: 200 len: 1501 microversion: 2.1 time: 0.495956 Oct 26 13:18:53.251313 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1962/3905] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:52 2022] GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655 => generated 1501 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:53.280525 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a631aa6e-f5fa-4120-9238-8f480384b63c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:18:53.291249 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a631aa6e-f5fa-4120-9238-8f480384b63c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:53.292684 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a631aa6e-f5fa-4120-9238-8f480384b63c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:53.293111 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a631aa6e-f5fa-4120-9238-8f480384b63c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:53.424535 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a631aa6e-f5fa-4120-9238-8f480384b63c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 47c25651-2bed-4595-b4cf-69f3d8f05655] Going to try to stop instance {{(pid=120598) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 26 13:18:53.484461 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a631aa6e-f5fa-4120-9238-8f480384b63c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "POST /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655/action" status: 202 len: 0 microversion: 2.1 time: 0.208877 Oct 26 13:18:53.485602 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1963/3906] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:18:53 2022] POST /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 13:18:53.505412 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4fafa487-a1ad-443b-bfae-e5db4923e731 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:53.506340 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4fafa487-a1ad-443b-bfae-e5db4923e731 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 47c25651-2bed-4595-b4cf-69f3d8f05655] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:53.513308 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4fafa487-a1ad-443b-bfae-e5db4923e731 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:53.513845 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4fafa487-a1ad-443b-bfae-e5db4923e731 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:53.514561 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4fafa487-a1ad-443b-bfae-e5db4923e731 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:53.515359 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4fafa487-a1ad-443b-bfae-e5db4923e731 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:53.515832 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4fafa487-a1ad-443b-bfae-e5db4923e731 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:53.516388 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4fafa487-a1ad-443b-bfae-e5db4923e731 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:53.538847 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a72ca13b-d102-48e2-a969-4903cd0d3053 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:53.548376 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a72ca13b-d102-48e2-a969-4903cd0d3053 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6" status: 200 len: 1493 microversion: 2.1 time: 0.544323 Oct 26 13:18:53.553648 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1944/3907] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:53 2022] GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 => generated 1493 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:53.847326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4fafa487-a1ad-443b-bfae-e5db4923e731 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:53.856538 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4fafa487-a1ad-443b-bfae-e5db4923e731 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655" status: 200 len: 1511 microversion: 2.1 time: 0.358755 Oct 26 13:18:53.864117 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1964/3908] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:53 2022] GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655 => generated 1511 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:53.889404 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a544ba02-500c-4ecc-939a-a0cb5462d09a tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:53.890159 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a544ba02-500c-4ecc-939a-a0cb5462d09a tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: b3260894-8fb6-44ee-9f97-3159a47b4a6d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:53.898378 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a544ba02-500c-4ecc-939a-a0cb5462d09a tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:53.899896 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a544ba02-500c-4ecc-939a-a0cb5462d09a tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:53.901057 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a544ba02-500c-4ecc-939a-a0cb5462d09a tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:53.902033 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a544ba02-500c-4ecc-939a-a0cb5462d09a tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:53.903028 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a544ba02-500c-4ecc-939a-a0cb5462d09a tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:53.903703 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a544ba02-500c-4ecc-939a-a0cb5462d09a tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:53.928622 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-a544ba02-500c-4ecc-939a-a0cb5462d09a tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] HTTP exception thrown: Instance b3260894-8fb6-44ee-9f97-3159a47b4a6d could not be found. Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a544ba02-500c-4ecc-939a-a0cb5462d09a tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Request method failure captured: Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/b3260894-8fb6-44ee-9f97-3159a47b4a6d HTTP/1.1 Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTONna7hK6L7ZrdkjD9yKh2Ng8VS9NpLUD1PHTSryIaYngDX0GdMV-9nLWZc-MgU9aYIG1m6Mx4Ej5-C6X_4vmLKbKlGvhm6QQn9nOuvBT3cIWLz80ceNppwR7MWRUSBLwWP71xLSNPWrB2ddvCugLcCT8-u__EXhDyBoRsrV7lh9C8 Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 6c40ceb3374847ec8685b67f7c94a3c7 Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-MultipleCreateTestJSON-1898598889 Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6c40ceb3374847ec8685b67f7c94a3c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6c40ceb3374847ec8685b67f7c94a3c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6c40ceb3374847ec8685b67f7c94a3c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6c40ceb3374847ec8685b67f7c94a3c7"}]}] Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-MultipleCreateTestJSON-1898598889 Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 6c40ceb3374847ec8685b67f7c94a3c7 Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1898598889 Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-MultipleCreateTestJSON-1898598889-project Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: d49ecfb3d5514177b2100631aa944200 Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-MultipleCreateTestJSON-1898598889-project Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance b3260894-8fb6-44ee-9f97-3159a47b4a6d could not be found. Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'b3260894-8fb6-44ee-9f97-3159a47b4a6d'} Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3260894-8fb6-44ee-9f97-3159a47b4a6d could not be found. Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3260894-8fb6-44ee-9f97-3159a47b4a6d could not be found. Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:18:53.932015 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:18:53.938811 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:18:53.938811 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:18:53.938811 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:18:53.938811 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:18:53.938811 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:18:53.938811 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3260894-8fb6-44ee-9f97-3159a47b4a6d could not be found. Oct 26 13:18:53.938811 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:18:53.941319 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a544ba02-500c-4ecc-939a-a0cb5462d09a tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Returning 404 to user: Instance b3260894-8fb6-44ee-9f97-3159a47b4a6d could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:18:53.943194 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a544ba02-500c-4ecc-939a-a0cb5462d09a tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] 10.222.0.40 "GET /compute/v2.1/servers/b3260894-8fb6-44ee-9f97-3159a47b4a6d" status: 404 len: 111 microversion: 2.1 time: 0.058079 Oct 26 13:18:53.947601 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1945/3909] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:53 2022] GET /compute/v2.1/servers/b3260894-8fb6-44ee-9f97-3159a47b4a6d => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:18:53.952624 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b0bedb72-7f13-4a67-9b85-5244c5c66abd tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:53.953242 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b0bedb72-7f13-4a67-9b85-5244c5c66abd tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] [instance: 84ed9a1e-36b9-4d54-8118-b803cff45f62] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:53.964398 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b0bedb72-7f13-4a67-9b85-5244c5c66abd tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:53.964926 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b0bedb72-7f13-4a67-9b85-5244c5c66abd tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:53.965389 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b0bedb72-7f13-4a67-9b85-5244c5c66abd tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:53.966145 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b0bedb72-7f13-4a67-9b85-5244c5c66abd tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:53.966603 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b0bedb72-7f13-4a67-9b85-5244c5c66abd tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:53.968395 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b0bedb72-7f13-4a67-9b85-5244c5c66abd tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:53.987879 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-b0bedb72-7f13-4a67-9b85-5244c5c66abd tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] HTTP exception thrown: Instance 84ed9a1e-36b9-4d54-8118-b803cff45f62 could not be found. Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b0bedb72-7f13-4a67-9b85-5244c5c66abd tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Request method failure captured: Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/84ed9a1e-36b9-4d54-8118-b803cff45f62 HTTP/1.1 Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTONna7hK6L7ZrdkjD9yKh2Ng8VS9NpLUD1PHTSryIaYngDX0GdMV-9nLWZc-MgU9aYIG1m6Mx4Ej5-C6X_4vmLKbKlGvhm6QQn9nOuvBT3cIWLz80ceNppwR7MWRUSBLwWP71xLSNPWrB2ddvCugLcCT8-u__EXhDyBoRsrV7lh9C8 Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 6c40ceb3374847ec8685b67f7c94a3c7 Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-MultipleCreateTestJSON-1898598889 Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6c40ceb3374847ec8685b67f7c94a3c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6c40ceb3374847ec8685b67f7c94a3c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6c40ceb3374847ec8685b67f7c94a3c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6c40ceb3374847ec8685b67f7c94a3c7"}]}] Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-MultipleCreateTestJSON-1898598889 Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 6c40ceb3374847ec8685b67f7c94a3c7 Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1898598889 Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-MultipleCreateTestJSON-1898598889-project Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: d49ecfb3d5514177b2100631aa944200 Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-MultipleCreateTestJSON-1898598889-project Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 84ed9a1e-36b9-4d54-8118-b803cff45f62 could not be found. Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '84ed9a1e-36b9-4d54-8118-b803cff45f62'} Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84ed9a1e-36b9-4d54-8118-b803cff45f62 could not be found. Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84ed9a1e-36b9-4d54-8118-b803cff45f62 could not be found. Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:18:53.989759 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:18:53.996672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:18:53.996672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:18:53.996672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:18:53.996672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:18:53.996672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:18:53.996672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84ed9a1e-36b9-4d54-8118-b803cff45f62 could not be found. Oct 26 13:18:53.996672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:18:53.998458 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b0bedb72-7f13-4a67-9b85-5244c5c66abd tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] Returning 404 to user: Instance 84ed9a1e-36b9-4d54-8118-b803cff45f62 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:18:53.999487 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b0bedb72-7f13-4a67-9b85-5244c5c66abd tempest-MultipleCreateTestJSON-1898598889 tempest-MultipleCreateTestJSON-1898598889-project] 10.222.0.40 "GET /compute/v2.1/servers/84ed9a1e-36b9-4d54-8118-b803cff45f62" status: 404 len: 111 microversion: 2.1 time: 0.050917 Oct 26 13:18:54.000244 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1965/3910] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:53 2022] GET /compute/v2.1/servers/84ed9a1e-36b9-4d54-8118-b803cff45f62 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 13:18:54.587259 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ad4602b2-9f44-4d95-95bb-65992b057b27 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:54.588181 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ad4602b2-9f44-4d95-95bb-65992b057b27 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:54.595523 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad4602b2-9f44-4d95-95bb-65992b057b27 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:54.596233 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad4602b2-9f44-4d95-95bb-65992b057b27 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:54.596890 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad4602b2-9f44-4d95-95bb-65992b057b27 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:54.597632 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad4602b2-9f44-4d95-95bb-65992b057b27 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:54.598086 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad4602b2-9f44-4d95-95bb-65992b057b27 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:54.598822 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad4602b2-9f44-4d95-95bb-65992b057b27 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:54.804388 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ad4602b2-9f44-4d95-95bb-65992b057b27 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:54.813953 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ad4602b2-9f44-4d95-95bb-65992b057b27 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6" status: 200 len: 1493 microversion: 2.1 time: 0.233584 Oct 26 13:18:54.815112 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1946/3911] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:54 2022] GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 => generated 1493 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:54.880535 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d4465879-2392-4426-91d5-44933c35944a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:54.881580 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d4465879-2392-4426-91d5-44933c35944a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 47c25651-2bed-4595-b4cf-69f3d8f05655] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:54.889824 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4465879-2392-4426-91d5-44933c35944a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:54.890558 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4465879-2392-4426-91d5-44933c35944a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:54.891299 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4465879-2392-4426-91d5-44933c35944a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:54.892178 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4465879-2392-4426-91d5-44933c35944a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:54.892789 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4465879-2392-4426-91d5-44933c35944a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:54.893572 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4465879-2392-4426-91d5-44933c35944a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:55.157041 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d4465879-2392-4426-91d5-44933c35944a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:55.169696 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d4465879-2392-4426-91d5-44933c35944a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655" status: 200 len: 1511 microversion: 2.1 time: 0.293124 Oct 26 13:18:55.186988 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1966/3912] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:54 2022] GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655 => generated 1511 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:55.839504 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e6b76bbe-f048-4956-afaf-6f710a02cf73 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:55.841329 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e6b76bbe-f048-4956-afaf-6f710a02cf73 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:55.870465 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e6b76bbe-f048-4956-afaf-6f710a02cf73 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:55.870885 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e6b76bbe-f048-4956-afaf-6f710a02cf73 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:55.875618 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e6b76bbe-f048-4956-afaf-6f710a02cf73 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:55.878147 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e6b76bbe-f048-4956-afaf-6f710a02cf73 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:55.879604 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e6b76bbe-f048-4956-afaf-6f710a02cf73 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:55.883537 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e6b76bbe-f048-4956-afaf-6f710a02cf73 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:56.181162 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e6b76bbe-f048-4956-afaf-6f710a02cf73 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:56.192082 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e6b76bbe-f048-4956-afaf-6f710a02cf73 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6" status: 200 len: 1499 microversion: 2.1 time: 0.357501 Oct 26 13:18:56.192859 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1947/3913] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:55 2022] GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 => generated 1499 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:56.213022 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-64e4beee-2f5e-49ff-bd1c-001321a73ecc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:56.214520 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-64e4beee-2f5e-49ff-bd1c-001321a73ecc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 47c25651-2bed-4595-b4cf-69f3d8f05655] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:56.227506 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64e4beee-2f5e-49ff-bd1c-001321a73ecc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:56.228254 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64e4beee-2f5e-49ff-bd1c-001321a73ecc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:56.228891 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64e4beee-2f5e-49ff-bd1c-001321a73ecc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:56.229793 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64e4beee-2f5e-49ff-bd1c-001321a73ecc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:56.230414 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64e4beee-2f5e-49ff-bd1c-001321a73ecc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:56.230548 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-52f5de73-6b9c-40a6-be26-ddce9e0175e4 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:56.231052 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-52f5de73-6b9c-40a6-be26-ddce9e0175e4 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:56.232400 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64e4beee-2f5e-49ff-bd1c-001321a73ecc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:56.256633 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52f5de73-6b9c-40a6-be26-ddce9e0175e4 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:56.260289 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52f5de73-6b9c-40a6-be26-ddce9e0175e4 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:56.262249 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52f5de73-6b9c-40a6-be26-ddce9e0175e4 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:56.263019 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52f5de73-6b9c-40a6-be26-ddce9e0175e4 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:56.263488 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52f5de73-6b9c-40a6-be26-ddce9e0175e4 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:56.263912 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52f5de73-6b9c-40a6-be26-ddce9e0175e4 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:56.345436 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-52f5de73-6b9c-40a6-be26-ddce9e0175e4 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:18:56.454455 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:18:56.462054 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-64e4beee-2f5e-49ff-bd1c-001321a73ecc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:56.473433 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-64e4beee-2f5e-49ff-bd1c-001321a73ecc tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655" status: 200 len: 1511 microversion: 2.1 time: 0.282175 Oct 26 13:18:56.476469 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1967/3914] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:56 2022] GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655 => generated 1511 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:56.482661 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0560aa1e-e2d1-48fc-b913-7f0c72aef5b0 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:56.483431 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0560aa1e-e2d1-48fc-b913-7f0c72aef5b0 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:56.490436 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0560aa1e-e2d1-48fc-b913-7f0c72aef5b0 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:56.491400 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0560aa1e-e2d1-48fc-b913-7f0c72aef5b0 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:56.492047 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0560aa1e-e2d1-48fc-b913-7f0c72aef5b0 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:56.493688 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0560aa1e-e2d1-48fc-b913-7f0c72aef5b0 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:56.494456 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0560aa1e-e2d1-48fc-b913-7f0c72aef5b0 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:56.495778 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0560aa1e-e2d1-48fc-b913-7f0c72aef5b0 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:56.531634 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0560aa1e-e2d1-48fc-b913-7f0c72aef5b0 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c/ips" status: 200 len: 146 microversion: 2.1 time: 0.053808 Oct 26 13:18:56.533757 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1968/3915] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Oct 26 13:18:56 2022] GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c/ips => generated 146 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:18:56.559495 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-52f5de73-6b9c-40a6-be26-ddce9e0175e4 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6" status: 204 len: 0 microversion: 2.1 time: 0.336374 Oct 26 13:18:56.560536 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1948/3916] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:18:56 2022] DELETE /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:18:56.571539 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7363fe4a-4460-493f-983a-547fb723017b tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:56.572618 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7363fe4a-4460-493f-983a-547fb723017b tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:56.583917 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7363fe4a-4460-493f-983a-547fb723017b tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:56.584476 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7363fe4a-4460-493f-983a-547fb723017b tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:56.584919 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7363fe4a-4460-493f-983a-547fb723017b tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:56.586782 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7363fe4a-4460-493f-983a-547fb723017b tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:56.587514 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7363fe4a-4460-493f-983a-547fb723017b tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:56.587947 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7363fe4a-4460-493f-983a-547fb723017b tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:56.795138 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7363fe4a-4460-493f-983a-547fb723017b tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:56.806794 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7363fe4a-4460-493f-983a-547fb723017b tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6" status: 200 len: 1505 microversion: 2.1 time: 0.241650 Oct 26 13:18:56.807960 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1969/3917] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:56 2022] GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 => generated 1505 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:57.504296 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9f1b54d9-8917-4ee2-b0d5-a54a42766ed2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:57.505334 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9f1b54d9-8917-4ee2-b0d5-a54a42766ed2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 47c25651-2bed-4595-b4cf-69f3d8f05655] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:57.513037 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f1b54d9-8917-4ee2-b0d5-a54a42766ed2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:57.513884 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f1b54d9-8917-4ee2-b0d5-a54a42766ed2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:57.514567 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f1b54d9-8917-4ee2-b0d5-a54a42766ed2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:57.515438 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f1b54d9-8917-4ee2-b0d5-a54a42766ed2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:57.516048 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f1b54d9-8917-4ee2-b0d5-a54a42766ed2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:57.516629 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f1b54d9-8917-4ee2-b0d5-a54a42766ed2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:57.546325 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-24050d5e-50e1-48ca-a76b-20b0e2a45d01 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:57.546951 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-24050d5e-50e1-48ca-a76b-20b0e2a45d01 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:57.562789 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24050d5e-50e1-48ca-a76b-20b0e2a45d01 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:57.565728 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24050d5e-50e1-48ca-a76b-20b0e2a45d01 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:57.566392 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24050d5e-50e1-48ca-a76b-20b0e2a45d01 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:57.569080 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24050d5e-50e1-48ca-a76b-20b0e2a45d01 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:57.570694 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24050d5e-50e1-48ca-a76b-20b0e2a45d01 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:57.572413 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24050d5e-50e1-48ca-a76b-20b0e2a45d01 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:57.743727 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9f1b54d9-8917-4ee2-b0d5-a54a42766ed2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:57.752938 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9f1b54d9-8917-4ee2-b0d5-a54a42766ed2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655" status: 200 len: 1511 microversion: 2.1 time: 0.253346 Oct 26 13:18:57.761530 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1949/3918] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:57 2022] GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655 => generated 1511 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:57.836287 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8824d9e6-f334-48bd-99d5-211a2e64608d tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:57.836915 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8824d9e6-f334-48bd-99d5-211a2e64608d tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:57.844802 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8824d9e6-f334-48bd-99d5-211a2e64608d tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:57.845412 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8824d9e6-f334-48bd-99d5-211a2e64608d tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:57.845759 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8824d9e6-f334-48bd-99d5-211a2e64608d tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:57.851225 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8824d9e6-f334-48bd-99d5-211a2e64608d tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:57.853000 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8824d9e6-f334-48bd-99d5-211a2e64608d tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:57.855013 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8824d9e6-f334-48bd-99d5-211a2e64608d tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:58.136593 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8824d9e6-f334-48bd-99d5-211a2e64608d tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:58.152296 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8824d9e6-f334-48bd-99d5-211a2e64608d tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6" status: 200 len: 1505 microversion: 2.1 time: 0.318737 Oct 26 13:18:58.153321 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1950/3919] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:57 2022] GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 => generated 1505 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:18:58.494162 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-24050d5e-50e1-48ca-a76b-20b0e2a45d01 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:58.507574 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-24050d5e-50e1-48ca-a76b-20b0e2a45d01 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:58.512133 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-24050d5e-50e1-48ca-a76b-20b0e2a45d01 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:58.513401 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-24050d5e-50e1-48ca-a76b-20b0e2a45d01 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 2943 microversion: 2.32 time: 0.971825 Oct 26 13:18:58.514929 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1970/3920] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:18:57 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 2943 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:18:58.547956 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0fa1786a-d43d-4b51-a5aa-cb9a08cce2ed tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:58.548568 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0fa1786a-d43d-4b51-a5aa-cb9a08cce2ed tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:58.560619 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8e8daa6a-ad45-4087-9924-4acdd975fe02 tempest-NetworksTest-2137990278 tempest-NetworksTest-2137990278-project-admin] Calling method '.version_select at 0x7f6731a27a60>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:58.592777 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0fa1786a-d43d-4b51-a5aa-cb9a08cce2ed tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:58.595130 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0fa1786a-d43d-4b51-a5aa-cb9a08cce2ed tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:58.596027 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0fa1786a-d43d-4b51-a5aa-cb9a08cce2ed tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:58.597311 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0fa1786a-d43d-4b51-a5aa-cb9a08cce2ed tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:58.598273 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0fa1786a-d43d-4b51-a5aa-cb9a08cce2ed tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:58.598791 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0fa1786a-d43d-4b51-a5aa-cb9a08cce2ed tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:58.823846 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0fa1786a-d43d-4b51-a5aa-cb9a08cce2ed tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.280004 Oct 26 13:18:58.824453 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1971/3921] 10.222.0.40 () {60 vars in 1316 bytes} [Wed Oct 26 13:18:58 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2/os-interface => generated 1831 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:18:58.840448 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-def3e886-1845-4b68-b675-acdbdf195d27 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:58.841059 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-def3e886-1845-4b68-b675-acdbdf195d27 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 47c25651-2bed-4595-b4cf-69f3d8f05655] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:58.860028 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-def3e886-1845-4b68-b675-acdbdf195d27 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:58.860814 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-def3e886-1845-4b68-b675-acdbdf195d27 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:58.861435 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-def3e886-1845-4b68-b675-acdbdf195d27 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:58.863958 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-def3e886-1845-4b68-b675-acdbdf195d27 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:58.864597 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-def3e886-1845-4b68-b675-acdbdf195d27 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:58.868718 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-def3e886-1845-4b68-b675-acdbdf195d27 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:59.031501 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8e8daa6a-ad45-4087-9924-4acdd975fe02 tempest-NetworksTest-2137990278 tempest-NetworksTest-2137990278-project-admin] 10.222.0.40 "GET /compute/v2.1/os-networks" status: 200 len: 10785 microversion: 2.1 time: 0.722782 Oct 26 13:18:59.032101 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1951/3922] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 26 13:18:58 2022] GET /compute/v2.1/os-networks => generated 10785 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:18:59.040614 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a7f4bc79-c6e7-4ab4-bef8-4e2e4abb9fa2 tempest-NetworksTest-2137990278 tempest-NetworksTest-2137990278-project-admin] Calling method '.version_select at 0x7f673229dc10>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:59.076490 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-def3e886-1845-4b68-b675-acdbdf195d27 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:59.090235 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-def3e886-1845-4b68-b675-acdbdf195d27 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655" status: 200 len: 1511 microversion: 2.1 time: 0.253578 Oct 26 13:18:59.113273 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1972/3923] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:58 2022] GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655 => generated 1511 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:59.176747 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ca894de2-b0d7-4e35-94ed-2c634fdd5773 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:59.177701 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ca894de2-b0d7-4e35-94ed-2c634fdd5773 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:18:59.184693 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca894de2-b0d7-4e35-94ed-2c634fdd5773 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:59.185670 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca894de2-b0d7-4e35-94ed-2c634fdd5773 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:59.186297 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca894de2-b0d7-4e35-94ed-2c634fdd5773 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:59.187172 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca894de2-b0d7-4e35-94ed-2c634fdd5773 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:18:59.187801 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca894de2-b0d7-4e35-94ed-2c634fdd5773 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:18:59.188395 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca894de2-b0d7-4e35-94ed-2c634fdd5773 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:18:59.193239 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a7f4bc79-c6e7-4ab4-bef8-4e2e4abb9fa2 tempest-NetworksTest-2137990278 tempest-NetworksTest-2137990278-project-admin] 10.222.0.40 "GET /compute/v2.1/os-networks/41c3ece9-8653-47df-8de8-fa897ccc9072" status: 200 len: 652 microversion: 2.1 time: 0.156252 Oct 26 13:18:59.204525 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1952/3924] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Oct 26 13:18:59 2022] GET /compute/v2.1/os-networks/41c3ece9-8653-47df-8de8-fa897ccc9072 => generated 652 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:18:59.217897 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7d402ca1-99dd-4874-85e4-1f78b9a207f9 tempest-NetworksTest-2137990278 tempest-NetworksTest-2137990278-project-admin] Calling method '.version_select at 0x7f67326e6c10>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:18:59.386144 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ca894de2-b0d7-4e35-94ed-2c634fdd5773 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:18:59.404201 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ca894de2-b0d7-4e35-94ed-2c634fdd5773 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6" status: 200 len: 1505 microversion: 2.1 time: 0.231602 Oct 26 13:18:59.410940 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1973/3925] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:18:59 2022] GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 => generated 1505 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:18:59.712555 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7d402ca1-99dd-4874-85e4-1f78b9a207f9 tempest-NetworksTest-2137990278 tempest-NetworksTest-2137990278-project-admin] 10.222.0.40 "GET /compute/v2.1/os-networks" status: 200 len: 10785 microversion: 2.1 time: 0.506293 Oct 26 13:18:59.713627 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1953/3926] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 26 13:18:59 2022] GET /compute/v2.1/os-networks => generated 10785 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:19:00.124377 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bacaf1c9-e2a5-40f6-9001-fa603dd6be8d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:00.126159 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bacaf1c9-e2a5-40f6-9001-fa603dd6be8d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 47c25651-2bed-4595-b4cf-69f3d8f05655] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:00.155925 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bacaf1c9-e2a5-40f6-9001-fa603dd6be8d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:00.156431 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bacaf1c9-e2a5-40f6-9001-fa603dd6be8d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:00.156904 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bacaf1c9-e2a5-40f6-9001-fa603dd6be8d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:00.157682 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bacaf1c9-e2a5-40f6-9001-fa603dd6be8d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:00.158200 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bacaf1c9-e2a5-40f6-9001-fa603dd6be8d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:00.158654 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bacaf1c9-e2a5-40f6-9001-fa603dd6be8d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:00.439952 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2bb77499-819f-4e2d-a568-0d2ddc672493 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:00.440817 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2bb77499-819f-4e2d-a568-0d2ddc672493 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:00.450950 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2bb77499-819f-4e2d-a568-0d2ddc672493 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:00.451826 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2bb77499-819f-4e2d-a568-0d2ddc672493 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:00.452594 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2bb77499-819f-4e2d-a568-0d2ddc672493 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:00.453823 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2bb77499-819f-4e2d-a568-0d2ddc672493 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:00.454589 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2bb77499-819f-4e2d-a568-0d2ddc672493 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:00.455241 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2bb77499-819f-4e2d-a568-0d2ddc672493 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:00.483626 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bacaf1c9-e2a5-40f6-9001-fa603dd6be8d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:00.497514 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bacaf1c9-e2a5-40f6-9001-fa603dd6be8d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655" status: 200 len: 1511 microversion: 2.1 time: 0.381208 Oct 26 13:19:00.498728 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1974/3927] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:00 2022] GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655 => generated 1511 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:00.649237 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-32d9a515-e881-443f-a152-732c262d7676 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09978d8f-626c-45c2-871c-b8fceb935c12"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:19:00.652712 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-32d9a515-e881-443f-a152-732c262d7676 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:00.660029 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32d9a515-e881-443f-a152-732c262d7676 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:00.660943 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32d9a515-e881-443f-a152-732c262d7676 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:00.661397 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32d9a515-e881-443f-a152-732c262d7676 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:00.662726 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32d9a515-e881-443f-a152-732c262d7676 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:00.664315 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32d9a515-e881-443f-a152-732c262d7676 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:00.665134 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32d9a515-e881-443f-a152-732c262d7676 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:00.795015 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2bb77499-819f-4e2d-a568-0d2ddc672493 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:00.821842 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2bb77499-819f-4e2d-a568-0d2ddc672493 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6" status: 200 len: 1505 microversion: 2.1 time: 0.386789 Oct 26 13:19:00.825505 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1954/3928] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:00 2022] GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 => generated 1505 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:19:00.877513 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:19:01.101244 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-acf47a1e-11f4-49ee-a37e-c768e5009991 req-1c2d15d7-878b-4ec6-bf68-f7bf15db919e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8551999d-fecc-4f6b-9e0a-c524ce5e96e6", "name": "network-vif-deleted", "tag": "93e5472f-fae2-476e-aeb5-be62761a9511"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:19:01.120921 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-32d9a515-e881-443f-a152-732c262d7676 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "POST /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.474335 Oct 26 13:19:01.123082 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1975/3929] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Oct 26 13:19:00 2022] POST /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c/os-volume_attachments => generated 194 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:19:01.141073 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-acf47a1e-11f4-49ee-a37e-c768e5009991 req-1c2d15d7-878b-4ec6-bf68-f7bf15db919e service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:01.142513 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-acf47a1e-11f4-49ee-a37e-c768e5009991 req-1c2d15d7-878b-4ec6-bf68-f7bf15db919e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:01.144493 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-acf47a1e-11f4-49ee-a37e-c768e5009991 req-1c2d15d7-878b-4ec6-bf68-f7bf15db919e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:01.170439 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-acf47a1e-11f4-49ee-a37e-c768e5009991 req-1c2d15d7-878b-4ec6-bf68-f7bf15db919e service nova] Creating event network-vif-deleted:93e5472f-fae2-476e-aeb5-be62761a9511 for instance 8551999d-fecc-4f6b-9e0a-c524ce5e96e6 on n-h2-862686-1 Oct 26 13:19:01.177141 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-acf47a1e-11f4-49ee-a37e-c768e5009991 req-1c2d15d7-878b-4ec6-bf68-f7bf15db919e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082475 Oct 26 13:19:01.189615 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1955/3930] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:19:01.532761 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-10a9bea9-a733-4adf-bff0-6a02615394e8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:01.533730 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-10a9bea9-a733-4adf-bff0-6a02615394e8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 47c25651-2bed-4595-b4cf-69f3d8f05655] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:01.557348 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10a9bea9-a733-4adf-bff0-6a02615394e8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:01.557879 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10a9bea9-a733-4adf-bff0-6a02615394e8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:01.558315 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10a9bea9-a733-4adf-bff0-6a02615394e8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:01.563118 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10a9bea9-a733-4adf-bff0-6a02615394e8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:01.564413 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10a9bea9-a733-4adf-bff0-6a02615394e8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:01.569139 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10a9bea9-a733-4adf-bff0-6a02615394e8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:01.852653 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-10a9bea9-a733-4adf-bff0-6a02615394e8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:01.860311 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cbe24dff-f180-49ff-9630-89a60d3b5caf tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:01.864366 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cbe24dff-f180-49ff-9630-89a60d3b5caf tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:01.873236 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-10a9bea9-a733-4adf-bff0-6a02615394e8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655" status: 200 len: 1511 microversion: 2.1 time: 0.346665 Oct 26 13:19:01.875733 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1976/3931] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:01 2022] GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655 => generated 1511 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:01.878763 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cbe24dff-f180-49ff-9630-89a60d3b5caf tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:01.879446 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cbe24dff-f180-49ff-9630-89a60d3b5caf tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:01.880050 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cbe24dff-f180-49ff-9630-89a60d3b5caf tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:01.881187 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cbe24dff-f180-49ff-9630-89a60d3b5caf tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:01.882437 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cbe24dff-f180-49ff-9630-89a60d3b5caf tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:01.883416 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cbe24dff-f180-49ff-9630-89a60d3b5caf tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:01.986777 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cbe24dff-f180-49ff-9630-89a60d3b5caf tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:01.989448 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cbe24dff-f180-49ff-9630-89a60d3b5caf tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:01.990552 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cbe24dff-f180-49ff-9630-89a60d3b5caf tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:01.992130 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-cbe24dff-f180-49ff-9630-89a60d3b5caf tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lazy-loading 'fault' on Instance uuid 8551999d-fecc-4f6b-9e0a-c524ce5e96e6 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:19:02.077120 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cbe24dff-f180-49ff-9630-89a60d3b5caf tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:02.090834 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cbe24dff-f180-49ff-9630-89a60d3b5caf tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6" status: 200 len: 1303 microversion: 2.1 time: 0.241055 Oct 26 13:19:02.092017 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1956/3932] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:01 2022] GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 => generated 1303 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:02.875400 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-aec6e2fb-ec87-467e-babb-0ff12dcd442b tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-465365595", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": "none"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:19:02.902867 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9713fa23-70bd-4706-9276-cf2c67106407 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:02.903378 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9713fa23-70bd-4706-9276-cf2c67106407 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 47c25651-2bed-4595-b4cf-69f3d8f05655] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:02.911129 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9713fa23-70bd-4706-9276-cf2c67106407 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:02.911813 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9713fa23-70bd-4706-9276-cf2c67106407 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:02.912428 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9713fa23-70bd-4706-9276-cf2c67106407 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:02.914349 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9713fa23-70bd-4706-9276-cf2c67106407 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:02.915014 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9713fa23-70bd-4706-9276-cf2c67106407 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:02.916209 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9713fa23-70bd-4706-9276-cf2c67106407 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:02.951938 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-aec6e2fb-ec87-467e-babb-0ff12dcd442b tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:19:02.952458 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-aec6e2fb-ec87-467e-babb-0ff12dcd442b tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:19:02.953140 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-aec6e2fb-ec87-467e-babb-0ff12dcd442b tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:19:02.953649 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-aec6e2fb-ec87-467e-babb-0ff12dcd442b tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:19:02.954137 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-aec6e2fb-ec87-467e-babb-0ff12dcd442b tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:19:02.966861 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aec6e2fb-ec87-467e-babb-0ff12dcd442b tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:02.967841 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aec6e2fb-ec87-467e-babb-0ff12dcd442b tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:02.968360 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aec6e2fb-ec87-467e-babb-0ff12dcd442b tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:02.969524 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aec6e2fb-ec87-467e-babb-0ff12dcd442b tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:02.970069 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aec6e2fb-ec87-467e-babb-0ff12dcd442b tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:02.970654 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aec6e2fb-ec87-467e-babb-0ff12dcd442b tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:02.996056 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-aec6e2fb-ec87-467e-babb-0ff12dcd442b tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Getting quotas for project 3949369469eb4fa4bc69d4f26c38f960. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:19:03.003144 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-aec6e2fb-ec87-467e-babb-0ff12dcd442b tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Getting quotas for user 5d334f897a4c483683c91e60c54dc53d and project 3949369469eb4fa4bc69d4f26c38f960. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:19:03.019471 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-aec6e2fb-ec87-467e-babb-0ff12dcd442b tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:19:03.022225 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-aec6e2fb-ec87-467e-babb-0ff12dcd442b tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] [instance: c9339f95-48ac-4bd8-b1a2-08acdc995530] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:19:03.036545 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:19:03.108538 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-aec6e2fb-ec87-467e-babb-0ff12dcd442b tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.557291 Oct 26 13:19:03.120961 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1977/3933] 10.222.0.40 () {62 vars in 1188 bytes} [Wed Oct 26 13:19:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 26 13:19:03.127752 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-555c1366-5a9e-45c7-90eb-1907877f8792 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:03.128909 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-555c1366-5a9e-45c7-90eb-1907877f8792 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: 8551999d-fecc-4f6b-9e0a-c524ce5e96e6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:03.145689 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9713fa23-70bd-4706-9276-cf2c67106407 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:03.151534 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-555c1366-5a9e-45c7-90eb-1907877f8792 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:03.152807 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-555c1366-5a9e-45c7-90eb-1907877f8792 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:03.153764 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-555c1366-5a9e-45c7-90eb-1907877f8792 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:03.154674 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-555c1366-5a9e-45c7-90eb-1907877f8792 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:03.155508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-555c1366-5a9e-45c7-90eb-1907877f8792 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:03.156112 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-555c1366-5a9e-45c7-90eb-1907877f8792 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:03.176772 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9713fa23-70bd-4706-9276-cf2c67106407 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655" status: 200 len: 1511 microversion: 2.1 time: 0.277859 Oct 26 13:19:03.180439 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1957/3934] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:02 2022] GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655 => generated 1511 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:03.197904 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7c7da1bb-3ed1-424c-9e1a-03b82a38eb88 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:03.198664 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7c7da1bb-3ed1-424c-9e1a-03b82a38eb88 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] [instance: c9339f95-48ac-4bd8-b1a2-08acdc995530] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:03.200126 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-555c1366-5a9e-45c7-90eb-1907877f8792 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] HTTP exception thrown: Instance 8551999d-fecc-4f6b-9e0a-c524ce5e96e6 could not be found. Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-555c1366-5a9e-45c7-90eb-1907877f8792 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Request method failure captured: Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 HTTP/1.1 Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTNDVHwyJ5tkAkYLKWG7FqqwCXMXafBr_7fHY14PznIs5qxlo5-M09UZ51GptjH5nuWrhOPhunHVruD6SBG84vYQ0r0K8z4_Upq2-4HShJMAuyi0mQ7YcXb3lAI5TW3QlnUU3kuaGugv_fAhD1QIy1tDZSSf2D-K2B4-rO0lgUY8ZqY Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 99b33dc51c4e489ea14f20bc582aa259 Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServerRescueTestJSON-1096734904 Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/99b33dc51c4e489ea14f20bc582aa259"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/99b33dc51c4e489ea14f20bc582aa259"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_99b33dc51c4e489ea14f20bc582aa259"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/99b33dc51c4e489ea14f20bc582aa259"}]}] Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServerRescueTestJSON-1096734904 Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 99b33dc51c4e489ea14f20bc582aa259 Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServerRescueTestJSON-1096734904 Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServerRescueTestJSON-1096734904-project Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: f35fb6e657dd4799b6928ffb97b24c2d Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServerRescueTestJSON-1096734904-project Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 8551999d-fecc-4f6b-9e0a-c524ce5e96e6 could not be found. Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '8551999d-fecc-4f6b-9e0a-c524ce5e96e6'} Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8551999d-fecc-4f6b-9e0a-c524ce5e96e6 could not be found. Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8551999d-fecc-4f6b-9e0a-c524ce5e96e6 could not be found. Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:19:03.202579 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:19:03.208288 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:03.208288 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:19:03.208288 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:19:03.208288 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:19:03.208288 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:19:03.208288 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8551999d-fecc-4f6b-9e0a-c524ce5e96e6 could not be found. Oct 26 13:19:03.208288 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:19:03.208288 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-555c1366-5a9e-45c7-90eb-1907877f8792 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Returning 404 to user: Instance 8551999d-fecc-4f6b-9e0a-c524ce5e96e6 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:19:03.208288 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-555c1366-5a9e-45c7-90eb-1907877f8792 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6" status: 404 len: 111 microversion: 2.1 time: 0.081362 Oct 26 13:19:03.209059 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1978/3935] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:03 2022] GET /compute/v2.1/servers/8551999d-fecc-4f6b-9e0a-c524ce5e96e6 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:19:03.215310 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e276c920-47d2-42b0-94b3-5642fd54c72f tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:03.215982 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e276c920-47d2-42b0-94b3-5642fd54c72f tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: b29a1a98-a428-4967-bc4a-237971dcd264] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:03.222555 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e276c920-47d2-42b0-94b3-5642fd54c72f tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:03.223075 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e276c920-47d2-42b0-94b3-5642fd54c72f tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:03.223636 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e276c920-47d2-42b0-94b3-5642fd54c72f tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:03.224758 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e276c920-47d2-42b0-94b3-5642fd54c72f tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:03.225399 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e276c920-47d2-42b0-94b3-5642fd54c72f tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:03.226620 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e276c920-47d2-42b0-94b3-5642fd54c72f tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:03.295504 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e276c920-47d2-42b0-94b3-5642fd54c72f tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: b29a1a98-a428-4967-bc4a-237971dcd264] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:19:03.326989 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7c7da1bb-3ed1-424c-9e1a-03b82a38eb88 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d334f897a4c483683c91e60c54dc53d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3949369469eb4fa4bc69d4f26c38f960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:03.336472 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7c7da1bb-3ed1-424c-9e1a-03b82a38eb88 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d334f897a4c483683c91e60c54dc53d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3949369469eb4fa4bc69d4f26c38f960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:03.342980 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7c7da1bb-3ed1-424c-9e1a-03b82a38eb88 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d334f897a4c483683c91e60c54dc53d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3949369469eb4fa4bc69d4f26c38f960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:03.346709 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7c7da1bb-3ed1-424c-9e1a-03b82a38eb88 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] 10.222.0.40 "GET /compute/v2.1/servers/c9339f95-48ac-4bd8-b1a2-08acdc995530" status: 200 len: 1280 microversion: 2.47 time: 0.164683 Oct 26 13:19:03.361512 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1958/3936] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:03 2022] GET /compute/v2.1/servers/c9339f95-48ac-4bd8-b1a2-08acdc995530 => generated 1280 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:03.436598 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e276c920-47d2-42b0-94b3-5642fd54c72f tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264" status: 204 len: 0 microversion: 2.1 time: 0.226358 Oct 26 13:19:03.437944 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1979/3937] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:19:03 2022] DELETE /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:19:03.447907 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9f79fda2-49ef-4733-9973-77ff9d973c01 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:03.449117 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9f79fda2-49ef-4733-9973-77ff9d973c01 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: b29a1a98-a428-4967-bc4a-237971dcd264] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:03.470457 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f79fda2-49ef-4733-9973-77ff9d973c01 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:03.470457 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f79fda2-49ef-4733-9973-77ff9d973c01 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:03.470668 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f79fda2-49ef-4733-9973-77ff9d973c01 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:03.471423 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f79fda2-49ef-4733-9973-77ff9d973c01 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:03.471993 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f79fda2-49ef-4733-9973-77ff9d973c01 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:03.472428 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f79fda2-49ef-4733-9973-77ff9d973c01 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:03.666887 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9f79fda2-49ef-4733-9973-77ff9d973c01 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:03.677247 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9f79fda2-49ef-4733-9973-77ff9d973c01 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264" status: 200 len: 1493 microversion: 2.1 time: 0.234736 Oct 26 13:19:03.678394 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1959/3938] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:03 2022] GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264 => generated 1493 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:04.073016 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9e9f3662-0c48-4777-a287-58a36ac05c32 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-1610153207", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": "none"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:19:04.129145 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-9e9f3662-0c48-4777-a287-58a36ac05c32 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:19:04.129599 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-9e9f3662-0c48-4777-a287-58a36ac05c32 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:19:04.130097 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-9e9f3662-0c48-4777-a287-58a36ac05c32 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:19:04.130508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-9e9f3662-0c48-4777-a287-58a36ac05c32 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:19:04.130921 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-9e9f3662-0c48-4777-a287-58a36ac05c32 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:19:04.140732 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e9f3662-0c48-4777-a287-58a36ac05c32 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:04.141215 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e9f3662-0c48-4777-a287-58a36ac05c32 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:04.141698 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e9f3662-0c48-4777-a287-58a36ac05c32 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:04.142423 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e9f3662-0c48-4777-a287-58a36ac05c32 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:04.142884 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e9f3662-0c48-4777-a287-58a36ac05c32 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:04.143311 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e9f3662-0c48-4777-a287-58a36ac05c32 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:04.161465 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-9e9f3662-0c48-4777-a287-58a36ac05c32 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Getting quotas for project f5f4e071a15d44e2ab931387494bbd13. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:19:04.167273 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-9e9f3662-0c48-4777-a287-58a36ac05c32 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Getting quotas for user ea7f38defef74d38a63f467b56bd411b and project f5f4e071a15d44e2ab931387494bbd13. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:19:04.181044 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9e9f3662-0c48-4777-a287-58a36ac05c32 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:19:04.183497 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9e9f3662-0c48-4777-a287-58a36ac05c32 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:19:04.207740 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e7ed48c6-1cc0-4477-b2af-0eb51dfc2b92 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:04.208346 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e7ed48c6-1cc0-4477-b2af-0eb51dfc2b92 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 47c25651-2bed-4595-b4cf-69f3d8f05655] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:04.215788 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e7ed48c6-1cc0-4477-b2af-0eb51dfc2b92 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:04.216301 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e7ed48c6-1cc0-4477-b2af-0eb51dfc2b92 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:04.216728 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e7ed48c6-1cc0-4477-b2af-0eb51dfc2b92 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:04.217441 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e7ed48c6-1cc0-4477-b2af-0eb51dfc2b92 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:04.218115 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e7ed48c6-1cc0-4477-b2af-0eb51dfc2b92 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:04.218715 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e7ed48c6-1cc0-4477-b2af-0eb51dfc2b92 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:04.234105 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9e9f3662-0c48-4777-a287-58a36ac05c32 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.283115 Oct 26 13:19:04.235294 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1980/3939] 10.222.0.40 () {62 vars in 1188 bytes} [Wed Oct 26 13:19:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 285 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 26 13:19:04.249659 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-17143910-8ff5-4562-9ba8-0a7f597aa016 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:04.250428 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-17143910-8ff5-4562-9ba8-0a7f597aa016 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:04.329797 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-17143910-8ff5-4562-9ba8-0a7f597aa016 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:04.339235 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-17143910-8ff5-4562-9ba8-0a7f597aa016 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:04.343360 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-17143910-8ff5-4562-9ba8-0a7f597aa016 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:04.353255 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-17143910-8ff5-4562-9ba8-0a7f597aa016 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1454 microversion: 2.91 time: 0.109972 Oct 26 13:19:04.361021 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1981/3940] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:04 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1454 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:04.389628 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cb34fd13-7937-47c4-88a9-03fbfcfd1f64 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:04.391543 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cb34fd13-7937-47c4-88a9-03fbfcfd1f64 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] [instance: c9339f95-48ac-4bd8-b1a2-08acdc995530] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:04.403195 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cb34fd13-7937-47c4-88a9-03fbfcfd1f64 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:04.404499 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cb34fd13-7937-47c4-88a9-03fbfcfd1f64 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:04.405113 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cb34fd13-7937-47c4-88a9-03fbfcfd1f64 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:04.406220 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cb34fd13-7937-47c4-88a9-03fbfcfd1f64 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:04.407984 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e7ed48c6-1cc0-4477-b2af-0eb51dfc2b92 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:04.413177 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cb34fd13-7937-47c4-88a9-03fbfcfd1f64 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:04.413878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cb34fd13-7937-47c4-88a9-03fbfcfd1f64 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:04.426855 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e7ed48c6-1cc0-4477-b2af-0eb51dfc2b92 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655" status: 200 len: 1511 microversion: 2.1 time: 0.223266 Oct 26 13:19:04.439230 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1960/3941] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:04 2022] GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655 => generated 1511 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:04.502038 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-cb34fd13-7937-47c4-88a9-03fbfcfd1f64 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d334f897a4c483683c91e60c54dc53d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3949369469eb4fa4bc69d4f26c38f960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:04.513574 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-cb34fd13-7937-47c4-88a9-03fbfcfd1f64 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d334f897a4c483683c91e60c54dc53d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3949369469eb4fa4bc69d4f26c38f960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:04.515103 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-cb34fd13-7937-47c4-88a9-03fbfcfd1f64 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d334f897a4c483683c91e60c54dc53d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3949369469eb4fa4bc69d4f26c38f960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:04.516307 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cb34fd13-7937-47c4-88a9-03fbfcfd1f64 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] 10.222.0.40 "GET /compute/v2.1/servers/c9339f95-48ac-4bd8-b1a2-08acdc995530" status: 200 len: 1284 microversion: 2.47 time: 0.135921 Oct 26 13:19:04.516937 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1982/3942] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:04 2022] GET /compute/v2.1/servers/c9339f95-48ac-4bd8-b1a2-08acdc995530 => generated 1284 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:19:04.704649 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6283fcc5-2657-43dd-bc4c-1908e1e01dbf tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:04.705258 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6283fcc5-2657-43dd-bc4c-1908e1e01dbf tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: b29a1a98-a428-4967-bc4a-237971dcd264] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:04.712095 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6283fcc5-2657-43dd-bc4c-1908e1e01dbf tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:04.712504 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6283fcc5-2657-43dd-bc4c-1908e1e01dbf tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:04.713129 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6283fcc5-2657-43dd-bc4c-1908e1e01dbf tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:04.714047 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6283fcc5-2657-43dd-bc4c-1908e1e01dbf tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:04.714632 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6283fcc5-2657-43dd-bc4c-1908e1e01dbf tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:04.715061 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6283fcc5-2657-43dd-bc4c-1908e1e01dbf tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:04.859188 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6283fcc5-2657-43dd-bc4c-1908e1e01dbf tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:04.867787 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6283fcc5-2657-43dd-bc4c-1908e1e01dbf tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264" status: 200 len: 1493 microversion: 2.1 time: 0.167397 Oct 26 13:19:04.868403 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1961/3943] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:04 2022] GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264 => generated 1493 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:05.382166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-04db444e-3ff7-45b3-9aa2-9c77c4070ef5 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:05.382922 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-04db444e-3ff7-45b3-9aa2-9c77c4070ef5 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:05.389805 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-04db444e-3ff7-45b3-9aa2-9c77c4070ef5 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:05.390284 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-04db444e-3ff7-45b3-9aa2-9c77c4070ef5 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:05.390713 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-04db444e-3ff7-45b3-9aa2-9c77c4070ef5 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:05.391427 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-04db444e-3ff7-45b3-9aa2-9c77c4070ef5 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:05.391876 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-04db444e-3ff7-45b3-9aa2-9c77c4070ef5 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:05.392292 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-04db444e-3ff7-45b3-9aa2-9c77c4070ef5 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:05.461914 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2120666e-29dd-4328-8d32-7402b95e0d34 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:05.463124 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2120666e-29dd-4328-8d32-7402b95e0d34 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 47c25651-2bed-4595-b4cf-69f3d8f05655] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:05.472459 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2120666e-29dd-4328-8d32-7402b95e0d34 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:05.473162 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2120666e-29dd-4328-8d32-7402b95e0d34 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:05.473768 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2120666e-29dd-4328-8d32-7402b95e0d34 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:05.474656 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2120666e-29dd-4328-8d32-7402b95e0d34 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:05.475274 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2120666e-29dd-4328-8d32-7402b95e0d34 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:05.477417 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2120666e-29dd-4328-8d32-7402b95e0d34 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:05.492908 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-04db444e-3ff7-45b3-9aa2-9c77c4070ef5 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:05.503875 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-04db444e-3ff7-45b3-9aa2-9c77c4070ef5 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:05.506840 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-04db444e-3ff7-45b3-9aa2-9c77c4070ef5 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:05.513355 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-04db444e-3ff7-45b3-9aa2-9c77c4070ef5 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1458 microversion: 2.91 time: 0.135075 Oct 26 13:19:05.514414 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1983/3944] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:05 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1458 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:05.546546 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a712216f-7821-45c7-b202-4c11f74f3a6b tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:05.547585 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a712216f-7821-45c7-b202-4c11f74f3a6b tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] [instance: c9339f95-48ac-4bd8-b1a2-08acdc995530] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:05.555457 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a712216f-7821-45c7-b202-4c11f74f3a6b tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:05.556214 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a712216f-7821-45c7-b202-4c11f74f3a6b tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:05.557026 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a712216f-7821-45c7-b202-4c11f74f3a6b tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:05.558424 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a712216f-7821-45c7-b202-4c11f74f3a6b tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:05.559478 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a712216f-7821-45c7-b202-4c11f74f3a6b tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:05.560123 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a712216f-7821-45c7-b202-4c11f74f3a6b tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:05.677355 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a712216f-7821-45c7-b202-4c11f74f3a6b tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d334f897a4c483683c91e60c54dc53d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3949369469eb4fa4bc69d4f26c38f960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:05.689223 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a712216f-7821-45c7-b202-4c11f74f3a6b tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d334f897a4c483683c91e60c54dc53d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3949369469eb4fa4bc69d4f26c38f960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:05.691348 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a712216f-7821-45c7-b202-4c11f74f3a6b tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d334f897a4c483683c91e60c54dc53d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3949369469eb4fa4bc69d4f26c38f960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:05.692729 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a712216f-7821-45c7-b202-4c11f74f3a6b tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] 10.222.0.40 "GET /compute/v2.1/servers/c9339f95-48ac-4bd8-b1a2-08acdc995530" status: 200 len: 1284 microversion: 2.47 time: 0.151065 Oct 26 13:19:05.693900 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1984/3945] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:05 2022] GET /compute/v2.1/servers/c9339f95-48ac-4bd8-b1a2-08acdc995530 => generated 1284 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:19:05.698167 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2120666e-29dd-4328-8d32-7402b95e0d34 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:05.720814 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2120666e-29dd-4328-8d32-7402b95e0d34 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655" status: 200 len: 1511 microversion: 2.1 time: 0.265426 Oct 26 13:19:05.734605 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1962/3946] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:05 2022] GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655 => generated 1511 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:05.891622 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8f3d95fb-70b5-425b-a9f5-6e8c8fe40330 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:05.892434 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8f3d95fb-70b5-425b-a9f5-6e8c8fe40330 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: b29a1a98-a428-4967-bc4a-237971dcd264] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:05.899989 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f3d95fb-70b5-425b-a9f5-6e8c8fe40330 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:05.900547 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f3d95fb-70b5-425b-a9f5-6e8c8fe40330 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:05.901091 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f3d95fb-70b5-425b-a9f5-6e8c8fe40330 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:05.901885 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f3d95fb-70b5-425b-a9f5-6e8c8fe40330 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:05.902527 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f3d95fb-70b5-425b-a9f5-6e8c8fe40330 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:05.903021 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f3d95fb-70b5-425b-a9f5-6e8c8fe40330 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:06.084357 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8f3d95fb-70b5-425b-a9f5-6e8c8fe40330 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:06.094588 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8f3d95fb-70b5-425b-a9f5-6e8c8fe40330 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264" status: 200 len: 1493 microversion: 2.1 time: 0.206155 Oct 26 13:19:06.095605 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1985/3947] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:05 2022] GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264 => generated 1493 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:06.187875 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8283c947-1593-4f19-86ed-ca8796c17d06 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72d889e1-4eff-40fd-ac5e-85c6f5715586"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:19:06.191485 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8283c947-1593-4f19-86ed-ca8796c17d06 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:06.200054 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8283c947-1593-4f19-86ed-ca8796c17d06 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:06.200563 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8283c947-1593-4f19-86ed-ca8796c17d06 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:06.201155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8283c947-1593-4f19-86ed-ca8796c17d06 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:06.201985 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8283c947-1593-4f19-86ed-ca8796c17d06 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:06.202452 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8283c947-1593-4f19-86ed-ca8796c17d06 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:06.203464 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8283c947-1593-4f19-86ed-ca8796c17d06 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:06.307165 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-8283c947-1593-4f19-86ed-ca8796c17d06 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] HTTP exception thrown: Invalid volume: volume 72d889e1-4eff-40fd-ac5e-85c6f5715586 is already attached to instances: bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8283c947-1593-4f19-86ed-ca8796c17d06 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Request method failure captured: Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9/os-volume_attachments HTTP/1.1 Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 74 Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTK8yiFaYn6FsK4kYH1E6E6NSE9_hIaDskjf1tRy-XgeLhCgjcaBIDqmW8VSjfB2Cmb6DMkQzh-y_Wh40jTHlXsuv7XA0N3K6RDEzKD5nf9Z6iWWIgYAqlJtxWSsEOqwe1NAtEPEvPHN4gJ5RH5unfT6e5xSWJOJigX6JmjW0X-SjQA Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 174da5e5c60449b7a04e9cf2aa3b9fda Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-AttachVolumeNegativeTest-770748596 Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/174da5e5c60449b7a04e9cf2aa3b9fda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/174da5e5c60449b7a04e9cf2aa3b9fda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_174da5e5c60449b7a04e9cf2aa3b9fda"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/174da5e5c60449b7a04e9cf2aa3b9fda"}]}] Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-AttachVolumeNegativeTest-770748596 Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 174da5e5c60449b7a04e9cf2aa3b9fda Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-770748596 Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-AttachVolumeNegativeTest-770748596-project Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 168c83cd1b014f82945f4915e3ece079 Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-AttachVolumeNegativeTest-770748596-project Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: {"volumeAttachment": {"volumeId": "72d889e1-4eff-40fd-ac5e-85c6f5715586"}} Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: exception: Invalid volume: volume 72d889e1-4eff-40fd-ac5e-85c6f5715586 is already attached to instances: bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'server_id': 'bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9', 'body': {'volumeAttachment': {'volumeId': '72d889e1-4eff-40fd-ac5e-85c6f5715586'}}} Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 72d889e1-4eff-40fd-ac5e-85c6f5715586 is already attached to instances: bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:19:06.309268 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:19:06.314330 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:19:06.314330 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:19:06.314330 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 26 13:19:06.314330 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 26 13:19:06.314330 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 72d889e1-4eff-40fd-ac5e-85c6f5715586 is already attached to instances: bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 Oct 26 13:19:06.314330 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:06.314330 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:19:06.314330 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:06.314330 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:06.314330 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:19:06.314330 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:19:06.314330 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:19:06.314330 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:19:06.314330 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 72d889e1-4eff-40fd-ac5e-85c6f5715586 is already attached to instances: bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 Oct 26 13:19:06.314330 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:06.314330 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8283c947-1593-4f19-86ed-ca8796c17d06 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Returning 400 to user: Invalid volume: volume 72d889e1-4eff-40fd-ac5e-85c6f5715586 is already attached to instances: bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:19:06.314330 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8283c947-1593-4f19-86ed-ca8796c17d06 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "POST /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.129949 Oct 26 13:19:06.314330 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1963/3948] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Oct 26 13:19:06 2022] POST /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9/os-volume_attachments => generated 174 bytes in 131 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:19:06.400355 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-29c5b953-33b5-4899-8686-6e26cfe51bc3 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:06.401013 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-29c5b953-33b5-4899-8686-6e26cfe51bc3 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:06.410433 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29c5b953-33b5-4899-8686-6e26cfe51bc3 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:06.411136 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29c5b953-33b5-4899-8686-6e26cfe51bc3 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:06.411643 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29c5b953-33b5-4899-8686-6e26cfe51bc3 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:06.428048 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29c5b953-33b5-4899-8686-6e26cfe51bc3 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:06.429132 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29c5b953-33b5-4899-8686-6e26cfe51bc3 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:06.429703 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29c5b953-33b5-4899-8686-6e26cfe51bc3 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:06.494407 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-70218ca1-841e-4a26-ab78-0014d8d8f8bf req-c7bdefc0-a6c9-4ea6-891e-01efa53027a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b29a1a98-a428-4967-bc4a-237971dcd264", "name": "network-vif-deleted", "tag": "2898cac6-24b9-4e25-b557-8f996344f010"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:19:06.525949 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-70218ca1-841e-4a26-ab78-0014d8d8f8bf req-c7bdefc0-a6c9-4ea6-891e-01efa53027a9 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:06.526503 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-70218ca1-841e-4a26-ab78-0014d8d8f8bf req-c7bdefc0-a6c9-4ea6-891e-01efa53027a9 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:06.527005 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-70218ca1-841e-4a26-ab78-0014d8d8f8bf req-c7bdefc0-a6c9-4ea6-891e-01efa53027a9 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:06.555220 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-70218ca1-841e-4a26-ab78-0014d8d8f8bf req-c7bdefc0-a6c9-4ea6-891e-01efa53027a9 service nova] Creating event network-vif-deleted:2898cac6-24b9-4e25-b557-8f996344f010 for instance b29a1a98-a428-4967-bc4a-237971dcd264 on n-h2-862686-1 Oct 26 13:19:06.565749 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-70218ca1-841e-4a26-ab78-0014d8d8f8bf req-c7bdefc0-a6c9-4ea6-891e-01efa53027a9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081505 Oct 26 13:19:06.568519 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1964/3949] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:19:06.576351 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-29c5b953-33b5-4899-8686-6e26cfe51bc3 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lazy-loading 'services' on Instance uuid bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:19:06.583006 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ff0a044f-6547-4ac3-8907-27a97b4c47c6 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:06.583705 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ff0a044f-6547-4ac3-8907-27a97b4c47c6 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:06.607667 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff0a044f-6547-4ac3-8907-27a97b4c47c6 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:06.608167 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff0a044f-6547-4ac3-8907-27a97b4c47c6 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:06.608607 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff0a044f-6547-4ac3-8907-27a97b4c47c6 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:06.609314 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff0a044f-6547-4ac3-8907-27a97b4c47c6 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:06.609797 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff0a044f-6547-4ac3-8907-27a97b4c47c6 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:06.610276 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff0a044f-6547-4ac3-8907-27a97b4c47c6 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:06.709041 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-29c5b953-33b5-4899-8686-6e26cfe51bc3 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "DELETE /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9/os-volume_attachments/72d889e1-4eff-40fd-ac5e-85c6f5715586" status: 202 len: 0 microversion: 2.1 time: 0.315016 Oct 26 13:19:06.711070 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1986/3950] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Oct 26 13:19:06 2022] DELETE /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9/os-volume_attachments/72d889e1-4eff-40fd-ac5e-85c6f5715586 => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:19:06.734107 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ff0a044f-6547-4ac3-8907-27a97b4c47c6 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:06.743315 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-049ce99a-e2af-4d5e-a801-bcd8a244cf30 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:06.747232 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ff0a044f-6547-4ac3-8907-27a97b4c47c6 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:06.748630 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ff0a044f-6547-4ac3-8907-27a97b4c47c6 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:06.753104 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-049ce99a-e2af-4d5e-a801-bcd8a244cf30 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:06.754603 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ff0a044f-6547-4ac3-8907-27a97b4c47c6 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1450 microversion: 2.91 time: 0.184858 Oct 26 13:19:06.755555 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1965/3951] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:06 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1450 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:06.762299 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e02ab5d0-b96a-49de-9ab6-31c1286c48b5 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:06.762965 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e02ab5d0-b96a-49de-9ab6-31c1286c48b5 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] [instance: c9339f95-48ac-4bd8-b1a2-08acdc995530] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:06.764914 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-049ce99a-e2af-4d5e-a801-bcd8a244cf30 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:06.769165 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-049ce99a-e2af-4d5e-a801-bcd8a244cf30 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:06.769580 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e02ab5d0-b96a-49de-9ab6-31c1286c48b5 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:06.770265 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e02ab5d0-b96a-49de-9ab6-31c1286c48b5 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:06.770470 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-049ce99a-e2af-4d5e-a801-bcd8a244cf30 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:06.771203 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e02ab5d0-b96a-49de-9ab6-31c1286c48b5 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:06.771763 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-049ce99a-e2af-4d5e-a801-bcd8a244cf30 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:06.772539 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e02ab5d0-b96a-49de-9ab6-31c1286c48b5 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:06.773157 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e02ab5d0-b96a-49de-9ab6-31c1286c48b5 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:06.773433 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-049ce99a-e2af-4d5e-a801-bcd8a244cf30 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:06.774287 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e02ab5d0-b96a-49de-9ab6-31c1286c48b5 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:06.775044 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-049ce99a-e2af-4d5e-a801-bcd8a244cf30 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:06.828527 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-049ce99a-e2af-4d5e-a801-bcd8a244cf30 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101018 Oct 26 13:19:06.829432 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1987/3952] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:19:06 2022] GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:19:06.834388 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9a5b5f1e-0fcb-48c1-ae93-802202eed65a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:06.835446 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9a5b5f1e-0fcb-48c1-ae93-802202eed65a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 47c25651-2bed-4595-b4cf-69f3d8f05655] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:06.842317 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a5b5f1e-0fcb-48c1-ae93-802202eed65a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:06.843247 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a5b5f1e-0fcb-48c1-ae93-802202eed65a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:06.843889 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a5b5f1e-0fcb-48c1-ae93-802202eed65a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:06.845410 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a5b5f1e-0fcb-48c1-ae93-802202eed65a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:06.846437 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a5b5f1e-0fcb-48c1-ae93-802202eed65a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:06.847218 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a5b5f1e-0fcb-48c1-ae93-802202eed65a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:06.868873 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e02ab5d0-b96a-49de-9ab6-31c1286c48b5 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d334f897a4c483683c91e60c54dc53d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3949369469eb4fa4bc69d4f26c38f960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:06.878476 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e02ab5d0-b96a-49de-9ab6-31c1286c48b5 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d334f897a4c483683c91e60c54dc53d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3949369469eb4fa4bc69d4f26c38f960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:06.879984 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e02ab5d0-b96a-49de-9ab6-31c1286c48b5 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d334f897a4c483683c91e60c54dc53d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3949369469eb4fa4bc69d4f26c38f960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:06.889877 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e02ab5d0-b96a-49de-9ab6-31c1286c48b5 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] 10.222.0.40 "GET /compute/v2.1/servers/c9339f95-48ac-4bd8-b1a2-08acdc995530" status: 200 len: 1340 microversion: 2.47 time: 0.130651 Oct 26 13:19:06.891721 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1966/3953] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:06 2022] GET /compute/v2.1/servers/c9339f95-48ac-4bd8-b1a2-08acdc995530 => generated 1340 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:07.015818 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9a5b5f1e-0fcb-48c1-ae93-802202eed65a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:07.026737 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9a5b5f1e-0fcb-48c1-ae93-802202eed65a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655" status: 200 len: 1511 microversion: 2.1 time: 0.195963 Oct 26 13:19:07.028100 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1988/3954] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:06 2022] GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655 => generated 1511 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:07.120114 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f506f632-45ba-45cb-8875-6acc62b95d1a tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:07.120729 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f506f632-45ba-45cb-8875-6acc62b95d1a tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: b29a1a98-a428-4967-bc4a-237971dcd264] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:07.127050 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f506f632-45ba-45cb-8875-6acc62b95d1a tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:07.127549 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f506f632-45ba-45cb-8875-6acc62b95d1a tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:07.127989 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f506f632-45ba-45cb-8875-6acc62b95d1a tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:07.128731 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f506f632-45ba-45cb-8875-6acc62b95d1a tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:07.129189 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f506f632-45ba-45cb-8875-6acc62b95d1a tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:07.129644 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f506f632-45ba-45cb-8875-6acc62b95d1a tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:07.163131 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f506f632-45ba-45cb-8875-6acc62b95d1a tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:07.164282 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f506f632-45ba-45cb-8875-6acc62b95d1a tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:07.164723 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f506f632-45ba-45cb-8875-6acc62b95d1a tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:07.165176 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-f506f632-45ba-45cb-8875-6acc62b95d1a tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lazy-loading 'fault' on Instance uuid b29a1a98-a428-4967-bc4a-237971dcd264 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:19:07.211842 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f506f632-45ba-45cb-8875-6acc62b95d1a tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:07.219648 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f506f632-45ba-45cb-8875-6acc62b95d1a tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264" status: 200 len: 1304 microversion: 2.1 time: 0.103734 Oct 26 13:19:07.220431 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1967/3955] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:07 2022] GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264 => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:07.787197 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0d37b120-b244-45ab-af1a-b47c899ede04 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:07.787733 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0d37b120-b244-45ab-af1a-b47c899ede04 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:07.795181 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d37b120-b244-45ab-af1a-b47c899ede04 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:07.795662 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d37b120-b244-45ab-af1a-b47c899ede04 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:07.796095 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d37b120-b244-45ab-af1a-b47c899ede04 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:07.796774 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d37b120-b244-45ab-af1a-b47c899ede04 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:07.797222 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d37b120-b244-45ab-af1a-b47c899ede04 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:07.797679 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d37b120-b244-45ab-af1a-b47c899ede04 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:07.842036 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c223c18d-b8f9-43cd-b30c-8a609d4370eb tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:07.844515 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c223c18d-b8f9-43cd-b30c-8a609d4370eb tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:07.851605 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c223c18d-b8f9-43cd-b30c-8a609d4370eb tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:07.852189 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c223c18d-b8f9-43cd-b30c-8a609d4370eb tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:07.852704 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c223c18d-b8f9-43cd-b30c-8a609d4370eb tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:07.853474 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c223c18d-b8f9-43cd-b30c-8a609d4370eb tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:07.854029 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c223c18d-b8f9-43cd-b30c-8a609d4370eb tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:07.854526 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c223c18d-b8f9-43cd-b30c-8a609d4370eb tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:07.874304 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0d37b120-b244-45ab-af1a-b47c899ede04 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:07.884255 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0d37b120-b244-45ab-af1a-b47c899ede04 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:07.886571 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0d37b120-b244-45ab-af1a-b47c899ede04 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:07.889851 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c223c18d-b8f9-43cd-b30c-8a609d4370eb tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051650 Oct 26 13:19:07.890445 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1968/3956] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:19:07 2022] GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:19:07.892178 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0d37b120-b244-45ab-af1a-b47c899ede04 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1506 microversion: 2.91 time: 0.108828 Oct 26 13:19:07.892770 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1989/3957] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:07 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1506 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:07.917928 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-01428066-8c93-49ed-9d5c-fbdcef6a3e70 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:07.918538 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-01428066-8c93-49ed-9d5c-fbdcef6a3e70 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] [instance: c9339f95-48ac-4bd8-b1a2-08acdc995530] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:07.924425 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-01428066-8c93-49ed-9d5c-fbdcef6a3e70 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:07.924935 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-01428066-8c93-49ed-9d5c-fbdcef6a3e70 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:07.925350 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-01428066-8c93-49ed-9d5c-fbdcef6a3e70 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:07.926071 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-01428066-8c93-49ed-9d5c-fbdcef6a3e70 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:07.926525 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-01428066-8c93-49ed-9d5c-fbdcef6a3e70 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:07.926957 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-01428066-8c93-49ed-9d5c-fbdcef6a3e70 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:07.996623 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-01428066-8c93-49ed-9d5c-fbdcef6a3e70 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d334f897a4c483683c91e60c54dc53d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3949369469eb4fa4bc69d4f26c38f960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:08.012887 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-01428066-8c93-49ed-9d5c-fbdcef6a3e70 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d334f897a4c483683c91e60c54dc53d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3949369469eb4fa4bc69d4f26c38f960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:08.014462 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-01428066-8c93-49ed-9d5c-fbdcef6a3e70 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d334f897a4c483683c91e60c54dc53d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3949369469eb4fa4bc69d4f26c38f960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:08.015773 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-01428066-8c93-49ed-9d5c-fbdcef6a3e70 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] 10.222.0.40 "GET /compute/v2.1/servers/c9339f95-48ac-4bd8-b1a2-08acdc995530" status: 200 len: 1338 microversion: 2.47 time: 0.101566 Oct 26 13:19:08.016429 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1969/3958] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:07 2022] GET /compute/v2.1/servers/c9339f95-48ac-4bd8-b1a2-08acdc995530 => generated 1338 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:08.052124 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-57a7dc05-202e-451c-b3f2-5a3207eda923 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:08.052816 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-57a7dc05-202e-451c-b3f2-5a3207eda923 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 47c25651-2bed-4595-b4cf-69f3d8f05655] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:08.059480 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57a7dc05-202e-451c-b3f2-5a3207eda923 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:08.060044 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57a7dc05-202e-451c-b3f2-5a3207eda923 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:08.060548 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57a7dc05-202e-451c-b3f2-5a3207eda923 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:08.061312 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57a7dc05-202e-451c-b3f2-5a3207eda923 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:08.061796 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57a7dc05-202e-451c-b3f2-5a3207eda923 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:08.062220 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57a7dc05-202e-451c-b3f2-5a3207eda923 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:08.196047 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-57a7dc05-202e-451c-b3f2-5a3207eda923 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:08.203974 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-57a7dc05-202e-451c-b3f2-5a3207eda923 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655" status: 200 len: 1511 microversion: 2.1 time: 0.155755 Oct 26 13:19:08.204578 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1990/3959] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:08 2022] GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655 => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:19:08.244614 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0705dd23-fcb2-49c8-9288-e12648753914 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:08.245290 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0705dd23-fcb2-49c8-9288-e12648753914 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: b29a1a98-a428-4967-bc4a-237971dcd264] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:08.251542 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0705dd23-fcb2-49c8-9288-e12648753914 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:08.252030 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0705dd23-fcb2-49c8-9288-e12648753914 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:08.252465 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0705dd23-fcb2-49c8-9288-e12648753914 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:08.253169 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0705dd23-fcb2-49c8-9288-e12648753914 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:08.253664 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0705dd23-fcb2-49c8-9288-e12648753914 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:08.254091 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0705dd23-fcb2-49c8-9288-e12648753914 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:08.259954 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:19:08.291023 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0705dd23-fcb2-49c8-9288-e12648753914 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:08.291427 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0705dd23-fcb2-49c8-9288-e12648753914 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:08.291859 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0705dd23-fcb2-49c8-9288-e12648753914 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:08.292308 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-0705dd23-fcb2-49c8-9288-e12648753914 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lazy-loading 'fault' on Instance uuid b29a1a98-a428-4967-bc4a-237971dcd264 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:19:08.334727 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0705dd23-fcb2-49c8-9288-e12648753914 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:08.342905 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0705dd23-fcb2-49c8-9288-e12648753914 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264" status: 200 len: 1304 microversion: 2.1 time: 0.103539 Oct 26 13:19:08.343468 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1970/3960] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:08 2022] GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264 => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:08.903317 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-23e28b1c-8a4e-444e-bb23-c5a6cd04a53d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:08.905512 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-23e28b1c-8a4e-444e-bb23-c5a6cd04a53d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:08.912408 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-23e28b1c-8a4e-444e-bb23-c5a6cd04a53d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:08.913025 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-23e28b1c-8a4e-444e-bb23-c5a6cd04a53d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:08.914013 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-23e28b1c-8a4e-444e-bb23-c5a6cd04a53d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:08.914712 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-23e28b1c-8a4e-444e-bb23-c5a6cd04a53d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:08.915172 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-23e28b1c-8a4e-444e-bb23-c5a6cd04a53d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:08.915593 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-23e28b1c-8a4e-444e-bb23-c5a6cd04a53d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:08.920302 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7e4ddc4c-6faa-4838-9901-e4ce5a9cdaa7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:08.920916 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7e4ddc4c-6faa-4838-9901-e4ce5a9cdaa7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:08.927784 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e4ddc4c-6faa-4838-9901-e4ce5a9cdaa7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:08.928268 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e4ddc4c-6faa-4838-9901-e4ce5a9cdaa7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:08.928752 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e4ddc4c-6faa-4838-9901-e4ce5a9cdaa7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:08.929458 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e4ddc4c-6faa-4838-9901-e4ce5a9cdaa7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:08.929956 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e4ddc4c-6faa-4838-9901-e4ce5a9cdaa7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:08.930382 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e4ddc4c-6faa-4838-9901-e4ce5a9cdaa7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:08.948661 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-23e28b1c-8a4e-444e-bb23-c5a6cd04a53d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049277 Oct 26 13:19:08.949542 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1991/3961] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:19:08 2022] GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:19:09.009186 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7e4ddc4c-6faa-4838-9901-e4ce5a9cdaa7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:09.019864 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7e4ddc4c-6faa-4838-9901-e4ce5a9cdaa7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:09.021402 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7e4ddc4c-6faa-4838-9901-e4ce5a9cdaa7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:09.028574 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7e4ddc4c-6faa-4838-9901-e4ce5a9cdaa7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1524 microversion: 2.91 time: 0.112059 Oct 26 13:19:09.029146 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1971/3962] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:08 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1524 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:09.050759 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-719e2836-7ee9-485a-9d2e-5f529276091e tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:09.051411 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-719e2836-7ee9-485a-9d2e-5f529276091e tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] [instance: c9339f95-48ac-4bd8-b1a2-08acdc995530] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:09.057727 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-719e2836-7ee9-485a-9d2e-5f529276091e tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:09.058217 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-719e2836-7ee9-485a-9d2e-5f529276091e tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:09.058659 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-719e2836-7ee9-485a-9d2e-5f529276091e tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:09.059357 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-719e2836-7ee9-485a-9d2e-5f529276091e tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:09.059844 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-719e2836-7ee9-485a-9d2e-5f529276091e tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:09.060296 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-719e2836-7ee9-485a-9d2e-5f529276091e tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:09.077150 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:19:09.137136 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-719e2836-7ee9-485a-9d2e-5f529276091e tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d334f897a4c483683c91e60c54dc53d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3949369469eb4fa4bc69d4f26c38f960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:09.145605 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-719e2836-7ee9-485a-9d2e-5f529276091e tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d334f897a4c483683c91e60c54dc53d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3949369469eb4fa4bc69d4f26c38f960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:09.147398 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-719e2836-7ee9-485a-9d2e-5f529276091e tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d334f897a4c483683c91e60c54dc53d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3949369469eb4fa4bc69d4f26c38f960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:09.149313 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-719e2836-7ee9-485a-9d2e-5f529276091e tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] 10.222.0.40 "GET /compute/v2.1/servers/c9339f95-48ac-4bd8-b1a2-08acdc995530" status: 200 len: 1338 microversion: 2.47 time: 0.102626 Oct 26 13:19:09.149901 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1992/3963] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:09 2022] GET /compute/v2.1/servers/c9339f95-48ac-4bd8-b1a2-08acdc995530 => generated 1338 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:09.227778 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bee8d85d-8d55-4e25-a280-4989628c3366 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:09.228401 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bee8d85d-8d55-4e25-a280-4989628c3366 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 47c25651-2bed-4595-b4cf-69f3d8f05655] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:09.235165 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bee8d85d-8d55-4e25-a280-4989628c3366 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:09.235307 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bee8d85d-8d55-4e25-a280-4989628c3366 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:09.235977 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bee8d85d-8d55-4e25-a280-4989628c3366 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:09.236383 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bee8d85d-8d55-4e25-a280-4989628c3366 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:09.236838 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bee8d85d-8d55-4e25-a280-4989628c3366 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:09.237265 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bee8d85d-8d55-4e25-a280-4989628c3366 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:09.367222 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6ca7eba9-4cc7-4281-a1c8-af0491a5fc73 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:09.368149 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6ca7eba9-4cc7-4281-a1c8-af0491a5fc73 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: b29a1a98-a428-4967-bc4a-237971dcd264] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:09.374390 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ca7eba9-4cc7-4281-a1c8-af0491a5fc73 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:09.374992 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ca7eba9-4cc7-4281-a1c8-af0491a5fc73 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:09.375533 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ca7eba9-4cc7-4281-a1c8-af0491a5fc73 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:09.376494 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ca7eba9-4cc7-4281-a1c8-af0491a5fc73 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:09.377254 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ca7eba9-4cc7-4281-a1c8-af0491a5fc73 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:09.377910 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ca7eba9-4cc7-4281-a1c8-af0491a5fc73 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:09.385028 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bee8d85d-8d55-4e25-a280-4989628c3366 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:09.394143 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bee8d85d-8d55-4e25-a280-4989628c3366 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655" status: 200 len: 1511 microversion: 2.1 time: 0.170405 Oct 26 13:19:09.394766 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1972/3964] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:09 2022] GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655 => generated 1511 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:09.413834 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ca7eba9-4cc7-4281-a1c8-af0491a5fc73 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:09.414743 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ca7eba9-4cc7-4281-a1c8-af0491a5fc73 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:09.414961 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ca7eba9-4cc7-4281-a1c8-af0491a5fc73 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:09.415544 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-6ca7eba9-4cc7-4281-a1c8-af0491a5fc73 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lazy-loading 'fault' on Instance uuid b29a1a98-a428-4967-bc4a-237971dcd264 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:19:09.463782 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6ca7eba9-4cc7-4281-a1c8-af0491a5fc73 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35fb6e657dd4799b6928ffb97b24c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b33dc51c4e489ea14f20bc582aa259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:09.475486 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6ca7eba9-4cc7-4281-a1c8-af0491a5fc73 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264" status: 200 len: 1304 microversion: 2.1 time: 0.111961 Oct 26 13:19:09.476798 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1993/3965] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:09 2022] GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264 => generated 1304 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:19:09.960729 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-59d9cf1d-574d-4498-9ccf-256ed04ef390 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:09.963181 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-59d9cf1d-574d-4498-9ccf-256ed04ef390 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:09.966014 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:19:09.972133 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59d9cf1d-574d-4498-9ccf-256ed04ef390 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:09.972636 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59d9cf1d-574d-4498-9ccf-256ed04ef390 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:09.973079 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59d9cf1d-574d-4498-9ccf-256ed04ef390 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:09.973831 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59d9cf1d-574d-4498-9ccf-256ed04ef390 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:09.974296 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59d9cf1d-574d-4498-9ccf-256ed04ef390 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:09.974729 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59d9cf1d-574d-4498-9ccf-256ed04ef390 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:10.009827 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-59d9cf1d-574d-4498-9ccf-256ed04ef390 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052947 Oct 26 13:19:10.010492 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1973/3966] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:19:09 2022] GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:19:10.056380 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5d024718-4d86-473e-90e6-b961b2b68982 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:10.056993 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5d024718-4d86-473e-90e6-b961b2b68982 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:10.063880 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5d024718-4d86-473e-90e6-b961b2b68982 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:10.064367 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5d024718-4d86-473e-90e6-b961b2b68982 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:10.064806 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5d024718-4d86-473e-90e6-b961b2b68982 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:10.065524 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5d024718-4d86-473e-90e6-b961b2b68982 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:10.065981 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5d024718-4d86-473e-90e6-b961b2b68982 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:10.066403 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5d024718-4d86-473e-90e6-b961b2b68982 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:10.135378 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5d024718-4d86-473e-90e6-b961b2b68982 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:10.143568 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5d024718-4d86-473e-90e6-b961b2b68982 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:10.145008 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5d024718-4d86-473e-90e6-b961b2b68982 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:10.151450 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5d024718-4d86-473e-90e6-b961b2b68982 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1512 microversion: 2.91 time: 0.099128 Oct 26 13:19:10.152026 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1994/3967] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:10 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1512 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:19:10.176200 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-679648f7-a882-49ac-8091-691c15fdf532 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:10.176928 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-679648f7-a882-49ac-8091-691c15fdf532 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] [instance: c9339f95-48ac-4bd8-b1a2-08acdc995530] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:10.183989 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-679648f7-a882-49ac-8091-691c15fdf532 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:10.184554 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-679648f7-a882-49ac-8091-691c15fdf532 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:10.185091 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-679648f7-a882-49ac-8091-691c15fdf532 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:10.185882 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-679648f7-a882-49ac-8091-691c15fdf532 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:10.186414 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-679648f7-a882-49ac-8091-691c15fdf532 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:10.186915 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-679648f7-a882-49ac-8091-691c15fdf532 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:10.251585 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-679648f7-a882-49ac-8091-691c15fdf532 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d334f897a4c483683c91e60c54dc53d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3949369469eb4fa4bc69d4f26c38f960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:10.260676 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-679648f7-a882-49ac-8091-691c15fdf532 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d334f897a4c483683c91e60c54dc53d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3949369469eb4fa4bc69d4f26c38f960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:10.262222 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-679648f7-a882-49ac-8091-691c15fdf532 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d334f897a4c483683c91e60c54dc53d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3949369469eb4fa4bc69d4f26c38f960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:10.263381 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-679648f7-a882-49ac-8091-691c15fdf532 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] 10.222.0.40 "GET /compute/v2.1/servers/c9339f95-48ac-4bd8-b1a2-08acdc995530" status: 200 len: 1359 microversion: 2.47 time: 0.091459 Oct 26 13:19:10.263942 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1974/3968] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:10 2022] GET /compute/v2.1/servers/c9339f95-48ac-4bd8-b1a2-08acdc995530 => generated 1359 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:10.288810 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c454e2ca-3f3f-4d37-a8d8-3f3796ab58b7 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-823937539"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:19:10.291295 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c454e2ca-3f3f-4d37-a8d8-3f3796ab58b7 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] [instance: c9339f95-48ac-4bd8-b1a2-08acdc995530] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:10.297356 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c454e2ca-3f3f-4d37-a8d8-3f3796ab58b7 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:10.297873 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c454e2ca-3f3f-4d37-a8d8-3f3796ab58b7 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:10.298303 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c454e2ca-3f3f-4d37-a8d8-3f3796ab58b7 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:10.298985 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c454e2ca-3f3f-4d37-a8d8-3f3796ab58b7 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:10.299436 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c454e2ca-3f3f-4d37-a8d8-3f3796ab58b7 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:10.299857 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c454e2ca-3f3f-4d37-a8d8-3f3796ab58b7 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:10.421531 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a0897020-1ce5-4199-8d84-a1a8ac400b9a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:10.422401 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a0897020-1ce5-4199-8d84-a1a8ac400b9a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 47c25651-2bed-4595-b4cf-69f3d8f05655] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:10.429850 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0897020-1ce5-4199-8d84-a1a8ac400b9a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:10.430706 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0897020-1ce5-4199-8d84-a1a8ac400b9a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:10.431373 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0897020-1ce5-4199-8d84-a1a8ac400b9a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:10.432302 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0897020-1ce5-4199-8d84-a1a8ac400b9a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:10.432985 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0897020-1ce5-4199-8d84-a1a8ac400b9a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:10.433783 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0897020-1ce5-4199-8d84-a1a8ac400b9a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:10.514076 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c454e2ca-3f3f-4d37-a8d8-3f3796ab58b7 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] 10.222.0.40 "POST /compute/v2.1/servers/c9339f95-48ac-4bd8-b1a2-08acdc995530/action" status: 202 len: 52 microversion: 2.47 time: 0.228911 Oct 26 13:19:10.515307 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1995/3969] 10.222.0.40 () {62 vars in 1319 bytes} [Wed Oct 26 13:19:10 2022] POST /compute/v2.1/servers/c9339f95-48ac-4bd8-b1a2-08acdc995530/action => generated 52 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 26 13:19:10.531145 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d33f8e44-885a-424a-ad7a-ccde89675875 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:10.532317 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d33f8e44-885a-424a-ad7a-ccde89675875 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] [instance: b29a1a98-a428-4967-bc4a-237971dcd264] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:10.541436 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d33f8e44-885a-424a-ad7a-ccde89675875 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:10.542093 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d33f8e44-885a-424a-ad7a-ccde89675875 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:10.542651 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d33f8e44-885a-424a-ad7a-ccde89675875 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:10.543791 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d33f8e44-885a-424a-ad7a-ccde89675875 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:10.544345 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d33f8e44-885a-424a-ad7a-ccde89675875 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:10.544931 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d33f8e44-885a-424a-ad7a-ccde89675875 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:10.560332 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-d33f8e44-885a-424a-ad7a-ccde89675875 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] HTTP exception thrown: Instance b29a1a98-a428-4967-bc4a-237971dcd264 could not be found. Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d33f8e44-885a-424a-ad7a-ccde89675875 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Request method failure captured: Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264 HTTP/1.1 Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTNDVHwyJ5tkAkYLKWG7FqqwCXMXafBr_7fHY14PznIs5qxlo5-M09UZ51GptjH5nuWrhOPhunHVruD6SBG84vYQ0r0K8z4_Upq2-4HShJMAuyi0mQ7YcXb3lAI5TW3QlnUU3kuaGugv_fAhD1QIy1tDZSSf2D-K2B4-rO0lgUY8ZqY Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 99b33dc51c4e489ea14f20bc582aa259 Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServerRescueTestJSON-1096734904 Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/99b33dc51c4e489ea14f20bc582aa259"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/99b33dc51c4e489ea14f20bc582aa259"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_99b33dc51c4e489ea14f20bc582aa259"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/99b33dc51c4e489ea14f20bc582aa259"}]}] Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServerRescueTestJSON-1096734904 Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 99b33dc51c4e489ea14f20bc582aa259 Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServerRescueTestJSON-1096734904 Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServerRescueTestJSON-1096734904-project Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: f35fb6e657dd4799b6928ffb97b24c2d Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServerRescueTestJSON-1096734904-project Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance b29a1a98-a428-4967-bc4a-237971dcd264 could not be found. Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'b29a1a98-a428-4967-bc4a-237971dcd264'} Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b29a1a98-a428-4967-bc4a-237971dcd264 could not be found. Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b29a1a98-a428-4967-bc4a-237971dcd264 could not be found. Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:19:10.562433 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:19:10.567862 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:10.567862 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:19:10.567862 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:19:10.567862 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:19:10.567862 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:19:10.567862 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b29a1a98-a428-4967-bc4a-237971dcd264 could not be found. Oct 26 13:19:10.567862 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:19:10.567862 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d33f8e44-885a-424a-ad7a-ccde89675875 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] Returning 404 to user: Instance b29a1a98-a428-4967-bc4a-237971dcd264 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:19:10.568702 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d33f8e44-885a-424a-ad7a-ccde89675875 tempest-ServerRescueTestJSON-1096734904 tempest-ServerRescueTestJSON-1096734904-project] 10.222.0.40 "GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264" status: 404 len: 111 microversion: 2.1 time: 0.050565 Oct 26 13:19:10.570418 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1996/3970] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:10 2022] GET /compute/v2.1/servers/b29a1a98-a428-4967-bc4a-237971dcd264 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:19:10.581323 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a2626ca2-9312-4328-be4c-6c3fb1cb102e tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:10.582161 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a2626ca2-9312-4328-be4c-6c3fb1cb102e tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] [instance: c9339f95-48ac-4bd8-b1a2-08acdc995530] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:10.588445 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a2626ca2-9312-4328-be4c-6c3fb1cb102e tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:10.588943 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a2626ca2-9312-4328-be4c-6c3fb1cb102e tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:10.589985 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a2626ca2-9312-4328-be4c-6c3fb1cb102e tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:10.591139 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a2626ca2-9312-4328-be4c-6c3fb1cb102e tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:10.591596 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a2626ca2-9312-4328-be4c-6c3fb1cb102e tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:10.592995 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a2626ca2-9312-4328-be4c-6c3fb1cb102e tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:10.630492 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a0897020-1ce5-4199-8d84-a1a8ac400b9a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:10.644109 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a0897020-1ce5-4199-8d84-a1a8ac400b9a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655" status: 200 len: 1511 microversion: 2.1 time: 0.227649 Oct 26 13:19:10.645222 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1975/3971] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:10 2022] GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655 => generated 1511 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:19:10.666203 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a2626ca2-9312-4328-be4c-6c3fb1cb102e tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] [instance: c9339f95-48ac-4bd8-b1a2-08acdc995530] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:19:10.751170 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a2626ca2-9312-4328-be4c-6c3fb1cb102e tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c9339f95-48ac-4bd8-b1a2-08acdc995530" status: 204 len: 0 microversion: 2.47 time: 0.179011 Oct 26 13:19:10.751855 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1997/3972] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 26 13:19:10 2022] DELETE /compute/v2.1/servers/c9339f95-48ac-4bd8-b1a2-08acdc995530 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 13:19:10.760423 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6902b229-03df-477d-973b-0b7a4a3e599a tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:10.761027 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6902b229-03df-477d-973b-0b7a4a3e599a tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] [instance: c9339f95-48ac-4bd8-b1a2-08acdc995530] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:10.766985 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6902b229-03df-477d-973b-0b7a4a3e599a tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:10.767399 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6902b229-03df-477d-973b-0b7a4a3e599a tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:10.767834 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6902b229-03df-477d-973b-0b7a4a3e599a tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:10.768530 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6902b229-03df-477d-973b-0b7a4a3e599a tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:10.768982 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6902b229-03df-477d-973b-0b7a4a3e599a tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:10.769409 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6902b229-03df-477d-973b-0b7a4a3e599a tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:10.894880 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6902b229-03df-477d-973b-0b7a4a3e599a tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d334f897a4c483683c91e60c54dc53d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3949369469eb4fa4bc69d4f26c38f960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:10.905766 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6902b229-03df-477d-973b-0b7a4a3e599a tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d334f897a4c483683c91e60c54dc53d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3949369469eb4fa4bc69d4f26c38f960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:10.907508 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6902b229-03df-477d-973b-0b7a4a3e599a tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d334f897a4c483683c91e60c54dc53d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3949369469eb4fa4bc69d4f26c38f960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:10.908402 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6902b229-03df-477d-973b-0b7a4a3e599a tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] 10.222.0.40 "GET /compute/v2.1/servers/c9339f95-48ac-4bd8-b1a2-08acdc995530" status: 200 len: 1365 microversion: 2.47 time: 0.152357 Oct 26 13:19:10.914917 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1976/3973] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:10 2022] GET /compute/v2.1/servers/c9339f95-48ac-4bd8-b1a2-08acdc995530 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:11.024088 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-48f496ba-5cc2-4c72-a718-90b5e144d65d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:11.028404 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-48f496ba-5cc2-4c72-a718-90b5e144d65d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:11.043270 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48f496ba-5cc2-4c72-a718-90b5e144d65d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:11.044084 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48f496ba-5cc2-4c72-a718-90b5e144d65d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:11.044533 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48f496ba-5cc2-4c72-a718-90b5e144d65d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:11.045245 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48f496ba-5cc2-4c72-a718-90b5e144d65d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:11.045726 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48f496ba-5cc2-4c72-a718-90b5e144d65d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:11.046335 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48f496ba-5cc2-4c72-a718-90b5e144d65d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:11.099072 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-48f496ba-5cc2-4c72-a718-90b5e144d65d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080841 Oct 26 13:19:11.100937 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1998/3974] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:19:11 2022] GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:19:11.179573 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dcacd877-af62-4738-b479-395d752c70ac tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:11.180105 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-dcacd877-af62-4738-b479-395d752c70ac tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:11.187936 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dcacd877-af62-4738-b479-395d752c70ac tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:11.188816 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dcacd877-af62-4738-b479-395d752c70ac tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:11.189548 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dcacd877-af62-4738-b479-395d752c70ac tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:11.190794 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dcacd877-af62-4738-b479-395d752c70ac tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:11.191363 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dcacd877-af62-4738-b479-395d752c70ac tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:11.191902 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dcacd877-af62-4738-b479-395d752c70ac tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:11.280149 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-dcacd877-af62-4738-b479-395d752c70ac tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:11.299270 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-dcacd877-af62-4738-b479-395d752c70ac tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:11.299270 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-dcacd877-af62-4738-b479-395d752c70ac tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:11.307192 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-dcacd877-af62-4738-b479-395d752c70ac tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1512 microversion: 2.91 time: 0.131789 Oct 26 13:19:11.314840 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1977/3975] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:11 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1512 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:11.668096 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c67f27ff-83ce-4f34-b81a-26e37d2158ff tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:11.668928 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c67f27ff-83ce-4f34-b81a-26e37d2158ff tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 47c25651-2bed-4595-b4cf-69f3d8f05655] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:11.675178 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c67f27ff-83ce-4f34-b81a-26e37d2158ff tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:11.675860 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c67f27ff-83ce-4f34-b81a-26e37d2158ff tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:11.676298 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c67f27ff-83ce-4f34-b81a-26e37d2158ff tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:11.676995 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c67f27ff-83ce-4f34-b81a-26e37d2158ff tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:11.677450 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c67f27ff-83ce-4f34-b81a-26e37d2158ff tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:11.678025 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c67f27ff-83ce-4f34-b81a-26e37d2158ff tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:11.920204 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c67f27ff-83ce-4f34-b81a-26e37d2158ff tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:11.930318 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c67f27ff-83ce-4f34-b81a-26e37d2158ff tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655" status: 200 len: 1511 microversion: 2.1 time: 0.266313 Oct 26 13:19:11.931314 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1999/3976] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:11 2022] GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655 => generated 1511 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:11.936469 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1aeb320f-b513-4088-b6c1-87f3fc238240 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:11.937344 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1aeb320f-b513-4088-b6c1-87f3fc238240 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] [instance: c9339f95-48ac-4bd8-b1a2-08acdc995530] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:11.949520 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1aeb320f-b513-4088-b6c1-87f3fc238240 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:11.949520 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1aeb320f-b513-4088-b6c1-87f3fc238240 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:11.949520 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1aeb320f-b513-4088-b6c1-87f3fc238240 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:11.949520 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1aeb320f-b513-4088-b6c1-87f3fc238240 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:11.949520 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1aeb320f-b513-4088-b6c1-87f3fc238240 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:11.949520 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1aeb320f-b513-4088-b6c1-87f3fc238240 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:12.020750 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1aeb320f-b513-4088-b6c1-87f3fc238240 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d334f897a4c483683c91e60c54dc53d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3949369469eb4fa4bc69d4f26c38f960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:12.029796 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1aeb320f-b513-4088-b6c1-87f3fc238240 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d334f897a4c483683c91e60c54dc53d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3949369469eb4fa4bc69d4f26c38f960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:12.031227 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1aeb320f-b513-4088-b6c1-87f3fc238240 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d334f897a4c483683c91e60c54dc53d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3949369469eb4fa4bc69d4f26c38f960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:12.032395 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1aeb320f-b513-4088-b6c1-87f3fc238240 tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] 10.222.0.40 "GET /compute/v2.1/servers/c9339f95-48ac-4bd8-b1a2-08acdc995530" status: 200 len: 1365 microversion: 2.47 time: 0.100645 Oct 26 13:19:12.032967 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1978/3977] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:11 2022] GET /compute/v2.1/servers/c9339f95-48ac-4bd8-b1a2-08acdc995530 => generated 1365 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:12.113178 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e4530866-4586-4b43-bc07-5e61c57f4704 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:12.115425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e4530866-4586-4b43-bc07-5e61c57f4704 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:12.122793 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4530866-4586-4b43-bc07-5e61c57f4704 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:12.123379 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4530866-4586-4b43-bc07-5e61c57f4704 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:12.123823 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4530866-4586-4b43-bc07-5e61c57f4704 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:12.124524 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4530866-4586-4b43-bc07-5e61c57f4704 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:12.125081 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4530866-4586-4b43-bc07-5e61c57f4704 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:12.125639 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4530866-4586-4b43-bc07-5e61c57f4704 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:12.158494 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e4530866-4586-4b43-bc07-5e61c57f4704 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049810 Oct 26 13:19:12.159095 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2000/3978] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:19:12 2022] GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:19:12.223262 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-011e8544-b509-4d13-a94f-e535d9f14714 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:12.223831 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-011e8544-b509-4d13-a94f-e535d9f14714 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:12.230655 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-011e8544-b509-4d13-a94f-e535d9f14714 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:12.231397 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-011e8544-b509-4d13-a94f-e535d9f14714 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:12.231837 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-011e8544-b509-4d13-a94f-e535d9f14714 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:12.232541 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-011e8544-b509-4d13-a94f-e535d9f14714 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:12.232999 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-011e8544-b509-4d13-a94f-e535d9f14714 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:12.233425 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-011e8544-b509-4d13-a94f-e535d9f14714 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:12.259797 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-011e8544-b509-4d13-a94f-e535d9f14714 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:19:12.335819 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a94c9a0b-0811-46c7-ac70-f47171a8dab0 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:12.336429 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a94c9a0b-0811-46c7-ac70-f47171a8dab0 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:12.348649 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a94c9a0b-0811-46c7-ac70-f47171a8dab0 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:12.349168 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a94c9a0b-0811-46c7-ac70-f47171a8dab0 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:12.349702 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a94c9a0b-0811-46c7-ac70-f47171a8dab0 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:12.353826 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a94c9a0b-0811-46c7-ac70-f47171a8dab0 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:12.354911 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a94c9a0b-0811-46c7-ac70-f47171a8dab0 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:12.355365 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a94c9a0b-0811-46c7-ac70-f47171a8dab0 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:12.356701 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-011e8544-b509-4d13-a94f-e535d9f14714 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "DELETE /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9" status: 204 len: 0 microversion: 2.1 time: 0.137054 Oct 26 13:19:12.357541 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1979/3979] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:19:12 2022] DELETE /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:19:12.371181 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-394c52e4-e859-429a-b5dc-5d73dce41995 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:12.372011 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-394c52e4-e859-429a-b5dc-5d73dce41995 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:12.378912 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-394c52e4-e859-429a-b5dc-5d73dce41995 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:12.379501 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-394c52e4-e859-429a-b5dc-5d73dce41995 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:12.380018 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-394c52e4-e859-429a-b5dc-5d73dce41995 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:12.380799 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-394c52e4-e859-429a-b5dc-5d73dce41995 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:12.381327 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-394c52e4-e859-429a-b5dc-5d73dce41995 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:12.382125 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-394c52e4-e859-429a-b5dc-5d73dce41995 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:12.446164 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a94c9a0b-0811-46c7-ac70-f47171a8dab0 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:12.455079 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a94c9a0b-0811-46c7-ac70-f47171a8dab0 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:12.456541 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a94c9a0b-0811-46c7-ac70-f47171a8dab0 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:12.462708 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a94c9a0b-0811-46c7-ac70-f47171a8dab0 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1533 microversion: 2.91 time: 0.131062 Oct 26 13:19:12.465545 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2001/3980] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:12 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1533 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:12.548347 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-98bffb3e-7d97-4201-92b1-3fe59f1c1346 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:12.549221 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-98bffb3e-7d97-4201-92b1-3fe59f1c1346 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:12.556595 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-98bffb3e-7d97-4201-92b1-3fe59f1c1346 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:12.557185 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-98bffb3e-7d97-4201-92b1-3fe59f1c1346 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:12.557731 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-98bffb3e-7d97-4201-92b1-3fe59f1c1346 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:12.558510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-98bffb3e-7d97-4201-92b1-3fe59f1c1346 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:12.559196 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-98bffb3e-7d97-4201-92b1-3fe59f1c1346 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:12.559693 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-98bffb3e-7d97-4201-92b1-3fe59f1c1346 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:12.642579 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-98bffb3e-7d97-4201-92b1-3fe59f1c1346 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Lazy-loading 'services' on Instance uuid f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:19:12.661894 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-98bffb3e-7d97-4201-92b1-3fe59f1c1346 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1938 microversion: 2.91 time: 0.174977 Oct 26 13:19:12.662489 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2002/3981] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:12 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1938 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:19:12.716411 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-394c52e4-e859-429a-b5dc-5d73dce41995 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:12.727523 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-394c52e4-e859-429a-b5dc-5d73dce41995 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9" status: 200 len: 1681 microversion: 2.1 time: 0.360603 Oct 26 13:19:12.728116 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1980/3982] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:12 2022] GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 => generated 1681 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:12.737666 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f5deb100-ccf9-4194-859c-f57bc8272f18 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:12.737666 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f5deb100-ccf9-4194-859c-f57bc8272f18 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:12.763203 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f5deb100-ccf9-4194-859c-f57bc8272f18 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:12.763834 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f5deb100-ccf9-4194-859c-f57bc8272f18 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:12.764351 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f5deb100-ccf9-4194-859c-f57bc8272f18 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:12.765158 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f5deb100-ccf9-4194-859c-f57bc8272f18 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:12.766190 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f5deb100-ccf9-4194-859c-f57bc8272f18 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:12.766691 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f5deb100-ccf9-4194-859c-f57bc8272f18 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:12.793842 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7e588cda-65e2-46ef-adb5-18e172f347f0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:12.794340 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7e588cda-65e2-46ef-adb5-18e172f347f0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:12.800758 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e588cda-65e2-46ef-adb5-18e172f347f0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:12.801209 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e588cda-65e2-46ef-adb5-18e172f347f0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:12.801674 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e588cda-65e2-46ef-adb5-18e172f347f0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:12.802509 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e588cda-65e2-46ef-adb5-18e172f347f0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:12.803083 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e588cda-65e2-46ef-adb5-18e172f347f0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:12.803229 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e588cda-65e2-46ef-adb5-18e172f347f0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:12.831637 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7e588cda-65e2-46ef-adb5-18e172f347f0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:19:12.912409 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-f5deb100-ccf9-4194-859c-f57bc8272f18 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Lazy-loading 'services' on Instance uuid f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:19:12.945418 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f5deb100-ccf9-4194-859c-f57bc8272f18 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1938 microversion: 2.91 time: 0.212068 Oct 26 13:19:12.946596 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1981/3983] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:12 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1938 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:12.955947 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e256bc57-39ea-40ec-95a1-8aa29a432c8e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:12.957267 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e256bc57-39ea-40ec-95a1-8aa29a432c8e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 47c25651-2bed-4595-b4cf-69f3d8f05655] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:12.964422 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e256bc57-39ea-40ec-95a1-8aa29a432c8e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:12.964986 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e256bc57-39ea-40ec-95a1-8aa29a432c8e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:12.965508 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e256bc57-39ea-40ec-95a1-8aa29a432c8e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:12.967460 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e256bc57-39ea-40ec-95a1-8aa29a432c8e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:12.967460 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e256bc57-39ea-40ec-95a1-8aa29a432c8e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:12.967925 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e256bc57-39ea-40ec-95a1-8aa29a432c8e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:13.002798 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=92,nova_api:UPDATE=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:19:13.007107 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7e588cda-65e2-46ef-adb5-18e172f347f0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 204 len: 0 microversion: 2.42 time: 0.342984 Oct 26 13:19:13.009070 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2003/3984] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 26 13:19:12 2022] DELETE /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 13:19:13.016171 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cfb740d2-2469-4dda-a334-2537947663e8 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:13.019996 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cfb740d2-2469-4dda-a334-2537947663e8 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:13.020327 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cfb740d2-2469-4dda-a334-2537947663e8 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:13.020767 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cfb740d2-2469-4dda-a334-2537947663e8 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:13.021511 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cfb740d2-2469-4dda-a334-2537947663e8 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:13.022280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cfb740d2-2469-4dda-a334-2537947663e8 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:13.022751 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cfb740d2-2469-4dda-a334-2537947663e8 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:13.048392 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cfb740d2-2469-4dda-a334-2537947663e8 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.037905 Oct 26 13:19:13.049168 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2004/3985] 10.222.0.40 () {60 vars in 1217 bytes} [Wed Oct 26 13:19:13 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:19:13.054384 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-31a2c4fd-a490-49e9-996f-c226853ebdd3 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:13.055039 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-31a2c4fd-a490-49e9-996f-c226853ebdd3 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:13.060967 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31a2c4fd-a490-49e9-996f-c226853ebdd3 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:13.061805 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31a2c4fd-a490-49e9-996f-c226853ebdd3 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:13.061962 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31a2c4fd-a490-49e9-996f-c226853ebdd3 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:13.062601 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31a2c4fd-a490-49e9-996f-c226853ebdd3 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:13.063059 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31a2c4fd-a490-49e9-996f-c226853ebdd3 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:13.063566 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31a2c4fd-a490-49e9-996f-c226853ebdd3 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:13.069315 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:19:13.250424 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-31a2c4fd-a490-49e9-996f-c226853ebdd3 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:13.255370 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e256bc57-39ea-40ec-95a1-8aa29a432c8e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:13.260712 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-31a2c4fd-a490-49e9-996f-c226853ebdd3 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:13.262392 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-31a2c4fd-a490-49e9-996f-c226853ebdd3 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:13.263645 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-31a2c4fd-a490-49e9-996f-c226853ebdd3 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 2961 microversion: 2.42 time: 0.213714 Oct 26 13:19:13.263889 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e256bc57-39ea-40ec-95a1-8aa29a432c8e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655" status: 200 len: 1511 microversion: 2.1 time: 0.313576 Oct 26 13:19:13.264235 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2005/3986] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:13 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 2961 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:13.264658 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1982/3987] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:12 2022] GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655 => generated 1511 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:13.268991 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a159b2fd-538b-4d3d-9763-dff60e57fc3f tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:13.269662 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a159b2fd-538b-4d3d-9763-dff60e57fc3f tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] [instance: c9339f95-48ac-4bd8-b1a2-08acdc995530] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:13.276948 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a159b2fd-538b-4d3d-9763-dff60e57fc3f tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:13.277656 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a159b2fd-538b-4d3d-9763-dff60e57fc3f tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:13.278251 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a159b2fd-538b-4d3d-9763-dff60e57fc3f tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:13.279219 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a159b2fd-538b-4d3d-9763-dff60e57fc3f tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:13.279839 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a159b2fd-538b-4d3d-9763-dff60e57fc3f tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:13.280482 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a159b2fd-538b-4d3d-9763-dff60e57fc3f tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:13.282872 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-91043469-97ec-421c-8770-278b8c9141aa tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:19:13.283791 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-91043469-97ec-421c-8770-278b8c9141aa tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:13.301385 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91043469-97ec-421c-8770-278b8c9141aa tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:13.302632 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91043469-97ec-421c-8770-278b8c9141aa tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:13.303204 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91043469-97ec-421c-8770-278b8c9141aa tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:13.304369 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91043469-97ec-421c-8770-278b8c9141aa tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:13.304924 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91043469-97ec-421c-8770-278b8c9141aa tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:13.305450 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91043469-97ec-421c-8770-278b8c9141aa tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:13.335550 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:19:13.341360 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-91043469-97ec-421c-8770-278b8c9141aa tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lazy-loading 'flavor' on Instance uuid f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:19:13.374285 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:19:13.383688 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a159b2fd-538b-4d3d-9763-dff60e57fc3f tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d334f897a4c483683c91e60c54dc53d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3949369469eb4fa4bc69d4f26c38f960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:13.395396 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a159b2fd-538b-4d3d-9763-dff60e57fc3f tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d334f897a4c483683c91e60c54dc53d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3949369469eb4fa4bc69d4f26c38f960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:13.398697 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a159b2fd-538b-4d3d-9763-dff60e57fc3f tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d334f897a4c483683c91e60c54dc53d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3949369469eb4fa4bc69d4f26c38f960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:13.401591 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a159b2fd-538b-4d3d-9763-dff60e57fc3f tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] 10.222.0.40 "GET /compute/v2.1/servers/c9339f95-48ac-4bd8-b1a2-08acdc995530" status: 200 len: 1365 microversion: 2.47 time: 0.135336 Oct 26 13:19:13.416659 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2006/3988] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:13 2022] GET /compute/v2.1/servers/c9339f95-48ac-4bd8-b1a2-08acdc995530 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:13.641526 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-91043469-97ec-421c-8770-278b8c9141aa tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "POST /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3/action" status: 202 len: 0 microversion: 2.91 time: 0.375484 Oct 26 13:19:13.652229 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1983/3989] 10.222.0.40 () {62 vars in 1319 bytes} [Wed Oct 26 13:19:13 2022] POST /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3/action => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:19:13.660238 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f0577f4e-86d7-491a-b8cb-13ff5ca17118 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:13.661729 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f0577f4e-86d7-491a-b8cb-13ff5ca17118 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:13.677252 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0577f4e-86d7-491a-b8cb-13ff5ca17118 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:13.677771 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0577f4e-86d7-491a-b8cb-13ff5ca17118 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:13.678463 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0577f4e-86d7-491a-b8cb-13ff5ca17118 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:13.679946 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0577f4e-86d7-491a-b8cb-13ff5ca17118 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:13.680764 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0577f4e-86d7-491a-b8cb-13ff5ca17118 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:13.681422 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0577f4e-86d7-491a-b8cb-13ff5ca17118 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:13.760611 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d6dfb815-dbc1-4bc9-99ae-9f144ac4ba05 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:13.761740 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d6dfb815-dbc1-4bc9-99ae-9f144ac4ba05 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:13.770252 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6dfb815-dbc1-4bc9-99ae-9f144ac4ba05 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:13.771521 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6dfb815-dbc1-4bc9-99ae-9f144ac4ba05 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:13.772731 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6dfb815-dbc1-4bc9-99ae-9f144ac4ba05 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:13.773993 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6dfb815-dbc1-4bc9-99ae-9f144ac4ba05 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:13.774912 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6dfb815-dbc1-4bc9-99ae-9f144ac4ba05 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:13.776005 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6dfb815-dbc1-4bc9-99ae-9f144ac4ba05 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:13.818881 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f0577f4e-86d7-491a-b8cb-13ff5ca17118 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:13.841228 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f0577f4e-86d7-491a-b8cb-13ff5ca17118 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:13.842903 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f0577f4e-86d7-491a-b8cb-13ff5ca17118 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:13.864195 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f0577f4e-86d7-491a-b8cb-13ff5ca17118 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1539 microversion: 2.91 time: 0.207682 Oct 26 13:19:13.870000 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2007/3990] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:13 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1539 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:13.957706 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d6dfb815-dbc1-4bc9-99ae-9f144ac4ba05 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:13.966406 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d6dfb815-dbc1-4bc9-99ae-9f144ac4ba05 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9" status: 200 len: 1681 microversion: 2.1 time: 0.211471 Oct 26 13:19:13.967034 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1984/3991] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:13 2022] GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 => generated 1681 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:14.197452 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-002c7d79-cccf-4661-9f60-652403b82d62 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:19:14.206078 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-002c7d79-cccf-4661-9f60-652403b82d62 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:14.206688 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-002c7d79-cccf-4661-9f60-652403b82d62 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:14.207192 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-002c7d79-cccf-4661-9f60-652403b82d62 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:14.236740 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-002c7d79-cccf-4661-9f60-652403b82d62 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Going to try to stop instance {{(pid=120598) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 26 13:19:14.284253 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-002c7d79-cccf-4661-9f60-652403b82d62 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "POST /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c/action" status: 202 len: 0 microversion: 2.1 time: 0.091740 Oct 26 13:19:14.285230 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2008/3992] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:19:14 2022] POST /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 13:19:14.294458 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4f682812-9d57-47d1-bc91-3826bffd9831 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:14.295309 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4f682812-9d57-47d1-bc91-3826bffd9831 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:14.304212 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-42988f72-436b-46af-b51e-a0f9022fa294 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:14.305205 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-42988f72-436b-46af-b51e-a0f9022fa294 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:14.310015 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f682812-9d57-47d1-bc91-3826bffd9831 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:14.310864 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f682812-9d57-47d1-bc91-3826bffd9831 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:14.311313 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f682812-9d57-47d1-bc91-3826bffd9831 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:14.312243 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f682812-9d57-47d1-bc91-3826bffd9831 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:14.313231 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f682812-9d57-47d1-bc91-3826bffd9831 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:14.313947 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f682812-9d57-47d1-bc91-3826bffd9831 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:14.317707 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42988f72-436b-46af-b51e-a0f9022fa294 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:14.318559 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42988f72-436b-46af-b51e-a0f9022fa294 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:14.319969 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42988f72-436b-46af-b51e-a0f9022fa294 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:14.320690 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42988f72-436b-46af-b51e-a0f9022fa294 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:14.321149 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42988f72-436b-46af-b51e-a0f9022fa294 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:14.321656 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42988f72-436b-46af-b51e-a0f9022fa294 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:14.345865 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=14 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:19:14.529450 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4f682812-9d57-47d1-bc91-3826bffd9831 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:14.540404 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4f682812-9d57-47d1-bc91-3826bffd9831 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c" status: 200 len: 1723 microversion: 2.1 time: 0.249669 Oct 26 13:19:14.541153 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1985/3993] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:14 2022] GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:14.549100 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-947cf4b8-9dc7-4e15-a7bc-9eae624d5760 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:14.550039 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-947cf4b8-9dc7-4e15-a7bc-9eae624d5760 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 47c25651-2bed-4595-b4cf-69f3d8f05655] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:14.559759 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-947cf4b8-9dc7-4e15-a7bc-9eae624d5760 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:14.560460 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-947cf4b8-9dc7-4e15-a7bc-9eae624d5760 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:14.561277 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-947cf4b8-9dc7-4e15-a7bc-9eae624d5760 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:14.562285 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-947cf4b8-9dc7-4e15-a7bc-9eae624d5760 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:14.562979 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-947cf4b8-9dc7-4e15-a7bc-9eae624d5760 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:14.565862 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-42988f72-436b-46af-b51e-a0f9022fa294 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:14.570182 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-947cf4b8-9dc7-4e15-a7bc-9eae624d5760 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:14.576622 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-42988f72-436b-46af-b51e-a0f9022fa294 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:14.578167 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-42988f72-436b-46af-b51e-a0f9022fa294 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:14.579451 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-42988f72-436b-46af-b51e-a0f9022fa294 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 2961 microversion: 2.42 time: 0.280599 Oct 26 13:19:14.580017 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2009/3994] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:14 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 2961 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:14.589200 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1460f354-2353-4185-88df-f0137301cadc tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:14.589876 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1460f354-2353-4185-88df-f0137301cadc tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] [instance: c9339f95-48ac-4bd8-b1a2-08acdc995530] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:14.602420 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1460f354-2353-4185-88df-f0137301cadc tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:14.602950 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1460f354-2353-4185-88df-f0137301cadc tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:14.603400 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1460f354-2353-4185-88df-f0137301cadc tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:14.604162 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1460f354-2353-4185-88df-f0137301cadc tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:14.607867 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1460f354-2353-4185-88df-f0137301cadc tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:14.608440 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1460f354-2353-4185-88df-f0137301cadc tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:14.629419 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-1460f354-2353-4185-88df-f0137301cadc tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] HTTP exception thrown: Instance c9339f95-48ac-4bd8-b1a2-08acdc995530 could not be found. Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1460f354-2353-4185-88df-f0137301cadc tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Request method failure captured: Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/c9339f95-48ac-4bd8-b1a2-08acdc995530 HTTP/1.1 Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTPGj3spsqi6MUsk-Ya7T3eeI3oXxEibS8SgrR8ORDrLyOmSgcLNboA43MexXKubF8jXvdEpAdFRkP3yyfohSXKAyYNdv8xw6pm0e2E9eqmQ1tqqrYpHaBP1ckKKvHoIpz_qYHlmWVu41p9kCnumkYq3vtRkps61ELKA2_OUdhbXt5Q Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: X-Openstack-Nova-Api-Version: 2.47 Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 3949369469eb4fa4bc69d4f26c38f960 Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersAaction247Test-282410358 Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3949369469eb4fa4bc69d4f26c38f960"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3949369469eb4fa4bc69d4f26c38f960"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3949369469eb4fa4bc69d4f26c38f960"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3949369469eb4fa4bc69d4f26c38f960"}]}] Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersAaction247Test-282410358 Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 3949369469eb4fa4bc69d4f26c38f960 Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersAaction247Test-282410358 Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersAaction247Test-282410358-project Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 5d334f897a4c483683c91e60c54dc53d Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersAaction247Test-282410358-project Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance c9339f95-48ac-4bd8-b1a2-08acdc995530 could not be found. Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'c9339f95-48ac-4bd8-b1a2-08acdc995530'} Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9339f95-48ac-4bd8-b1a2-08acdc995530 could not be found. Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9339f95-48ac-4bd8-b1a2-08acdc995530 could not be found. Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:19:14.631255 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:19:14.637325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:14.637325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:19:14.637325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:19:14.637325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:19:14.637325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:19:14.637325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9339f95-48ac-4bd8-b1a2-08acdc995530 could not be found. Oct 26 13:19:14.637325 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:19:14.638429 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1460f354-2353-4185-88df-f0137301cadc tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] Returning 404 to user: Instance c9339f95-48ac-4bd8-b1a2-08acdc995530 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:19:14.642379 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1460f354-2353-4185-88df-f0137301cadc tempest-ServersAaction247Test-282410358 tempest-ServersAaction247Test-282410358-project] 10.222.0.40 "GET /compute/v2.1/servers/c9339f95-48ac-4bd8-b1a2-08acdc995530" status: 404 len: 111 microversion: 2.47 time: 0.060757 Oct 26 13:19:14.645628 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2010/3995] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:14 2022] GET /compute/v2.1/servers/c9339f95-48ac-4bd8-b1a2-08acdc995530 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:19:14.740167 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-947cf4b8-9dc7-4e15-a7bc-9eae624d5760 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:14.750249 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-947cf4b8-9dc7-4e15-a7bc-9eae624d5760 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655" status: 200 len: 1511 microversion: 2.1 time: 0.207775 Oct 26 13:19:14.751028 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1986/3996] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:14 2022] GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655 => generated 1511 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:14.901354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-70f38d60-a849-4e60-9084-56c451ec4c07 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:14.901354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-70f38d60-a849-4e60-9084-56c451ec4c07 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:14.905222 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70f38d60-a849-4e60-9084-56c451ec4c07 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:14.905768 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70f38d60-a849-4e60-9084-56c451ec4c07 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:14.906228 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70f38d60-a849-4e60-9084-56c451ec4c07 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:14.907000 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70f38d60-a849-4e60-9084-56c451ec4c07 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:14.907490 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70f38d60-a849-4e60-9084-56c451ec4c07 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:14.907916 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70f38d60-a849-4e60-9084-56c451ec4c07 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:14.981247 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-70f38d60-a849-4e60-9084-56c451ec4c07 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:14.989750 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-70f38d60-a849-4e60-9084-56c451ec4c07 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:14.991686 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9575bc40-6a2b-4716-b446-7e54544768be tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:14.992530 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9575bc40-6a2b-4716-b446-7e54544768be tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:14.992988 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-70f38d60-a849-4e60-9084-56c451ec4c07 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:14.998788 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-70f38d60-a849-4e60-9084-56c451ec4c07 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1539 microversion: 2.91 time: 0.105980 Oct 26 13:19:15.000008 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2011/3997] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:14 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1539 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:15.000308 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9575bc40-6a2b-4716-b446-7e54544768be tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:15.000845 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9575bc40-6a2b-4716-b446-7e54544768be tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:15.001290 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9575bc40-6a2b-4716-b446-7e54544768be tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:15.002163 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9575bc40-6a2b-4716-b446-7e54544768be tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:15.002916 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9575bc40-6a2b-4716-b446-7e54544768be tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:15.004169 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9575bc40-6a2b-4716-b446-7e54544768be tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:15.163893 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9575bc40-6a2b-4716-b446-7e54544768be tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:15.174287 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9575bc40-6a2b-4716-b446-7e54544768be tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9" status: 200 len: 1681 microversion: 2.1 time: 0.187218 Oct 26 13:19:15.189167 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1987/3998] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:14 2022] GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 => generated 1681 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:19:15.567252 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-54d9e3bd-df66-4e1a-bf0a-f8cabe5aad44 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:15.567924 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-54d9e3bd-df66-4e1a-bf0a-f8cabe5aad44 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:15.575845 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54d9e3bd-df66-4e1a-bf0a-f8cabe5aad44 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:15.576339 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54d9e3bd-df66-4e1a-bf0a-f8cabe5aad44 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:15.576810 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54d9e3bd-df66-4e1a-bf0a-f8cabe5aad44 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:15.577788 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54d9e3bd-df66-4e1a-bf0a-f8cabe5aad44 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:15.578475 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54d9e3bd-df66-4e1a-bf0a-f8cabe5aad44 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:15.579107 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54d9e3bd-df66-4e1a-bf0a-f8cabe5aad44 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:15.609783 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ef5a2079-ab82-4ad1-9f37-661d8c1f7c5f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:15.610571 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ef5a2079-ab82-4ad1-9f37-661d8c1f7c5f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:15.621049 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ef5a2079-ab82-4ad1-9f37-661d8c1f7c5f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:15.622043 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ef5a2079-ab82-4ad1-9f37-661d8c1f7c5f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:15.622043 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ef5a2079-ab82-4ad1-9f37-661d8c1f7c5f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:15.623078 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ef5a2079-ab82-4ad1-9f37-661d8c1f7c5f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:15.623245 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ef5a2079-ab82-4ad1-9f37-661d8c1f7c5f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:15.623582 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ef5a2079-ab82-4ad1-9f37-661d8c1f7c5f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:15.833331 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-54d9e3bd-df66-4e1a-bf0a-f8cabe5aad44 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:15.844365 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-54d9e3bd-df66-4e1a-bf0a-f8cabe5aad44 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c" status: 200 len: 1723 microversion: 2.1 time: 0.280878 Oct 26 13:19:15.845367 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2012/3999] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:15 2022] GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c => generated 1723 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:19:15.851853 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ef5a2079-ab82-4ad1-9f37-661d8c1f7c5f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:15.869821 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ef5a2079-ab82-4ad1-9f37-661d8c1f7c5f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:15.874019 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2b953197-eebb-44d8-9ad5-82f468449efa tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:15.874640 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2b953197-eebb-44d8-9ad5-82f468449efa tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 47c25651-2bed-4595-b4cf-69f3d8f05655] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:15.878856 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ef5a2079-ab82-4ad1-9f37-661d8c1f7c5f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:15.880611 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ef5a2079-ab82-4ad1-9f37-661d8c1f7c5f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 2961 microversion: 2.42 time: 0.274658 Oct 26 13:19:15.880718 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1988/4000] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:15 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 2961 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:19:15.885020 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2b953197-eebb-44d8-9ad5-82f468449efa tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:15.885540 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2b953197-eebb-44d8-9ad5-82f468449efa tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:15.886165 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2b953197-eebb-44d8-9ad5-82f468449efa tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:15.887030 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2b953197-eebb-44d8-9ad5-82f468449efa tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:15.887635 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2b953197-eebb-44d8-9ad5-82f468449efa tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:15.888229 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2b953197-eebb-44d8-9ad5-82f468449efa tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:16.032051 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ead18e2b-a8a3-41de-9353-4642f232a8af tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:16.032980 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ead18e2b-a8a3-41de-9353-4642f232a8af tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:16.044913 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ead18e2b-a8a3-41de-9353-4642f232a8af tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:16.046004 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ead18e2b-a8a3-41de-9353-4642f232a8af tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:16.046551 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ead18e2b-a8a3-41de-9353-4642f232a8af tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:16.047266 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ead18e2b-a8a3-41de-9353-4642f232a8af tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:16.048826 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ead18e2b-a8a3-41de-9353-4642f232a8af tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:16.049521 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ead18e2b-a8a3-41de-9353-4642f232a8af tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:16.072378 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2b953197-eebb-44d8-9ad5-82f468449efa tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:16.080814 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2b953197-eebb-44d8-9ad5-82f468449efa tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655" status: 200 len: 1511 microversion: 2.1 time: 0.234066 Oct 26 13:19:16.081535 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2013/4001] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:15 2022] GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655 => generated 1511 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:16.155256 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ead18e2b-a8a3-41de-9353-4642f232a8af tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:16.165773 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ead18e2b-a8a3-41de-9353-4642f232a8af tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:16.167699 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ead18e2b-a8a3-41de-9353-4642f232a8af tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:16.174318 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ead18e2b-a8a3-41de-9353-4642f232a8af tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1539 microversion: 2.91 time: 0.147875 Oct 26 13:19:16.175092 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1989/4002] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:16 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1539 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:19:16.201390 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4a4cb8d4-2e52-41c2-92d0-305e22951f84 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:16.202235 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4a4cb8d4-2e52-41c2-92d0-305e22951f84 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:16.210328 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a4cb8d4-2e52-41c2-92d0-305e22951f84 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:16.211294 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a4cb8d4-2e52-41c2-92d0-305e22951f84 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:16.211748 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a4cb8d4-2e52-41c2-92d0-305e22951f84 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:16.212520 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a4cb8d4-2e52-41c2-92d0-305e22951f84 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:16.213080 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a4cb8d4-2e52-41c2-92d0-305e22951f84 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:16.213764 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a4cb8d4-2e52-41c2-92d0-305e22951f84 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:16.450013 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4a4cb8d4-2e52-41c2-92d0-305e22951f84 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:16.459078 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4a4cb8d4-2e52-41c2-92d0-305e22951f84 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9" status: 200 len: 1681 microversion: 2.1 time: 0.265182 Oct 26 13:19:16.469982 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2014/4003] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:16 2022] GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 => generated 1681 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:19:16.868786 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5ed770cb-eebd-4b76-9bde-caad0a8abbad tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:16.869408 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5ed770cb-eebd-4b76-9bde-caad0a8abbad tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:16.899520 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ed770cb-eebd-4b76-9bde-caad0a8abbad tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:16.900030 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ed770cb-eebd-4b76-9bde-caad0a8abbad tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:16.900478 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ed770cb-eebd-4b76-9bde-caad0a8abbad tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:16.901207 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ed770cb-eebd-4b76-9bde-caad0a8abbad tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:16.901701 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ed770cb-eebd-4b76-9bde-caad0a8abbad tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:16.902136 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ed770cb-eebd-4b76-9bde-caad0a8abbad tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:16.915035 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a042afb7-ead4-4bb8-a266-404c93ffd561 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:16.916397 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a042afb7-ead4-4bb8-a266-404c93ffd561 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:16.933821 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a042afb7-ead4-4bb8-a266-404c93ffd561 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:16.934458 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a042afb7-ead4-4bb8-a266-404c93ffd561 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:16.935090 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a042afb7-ead4-4bb8-a266-404c93ffd561 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:16.935984 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a042afb7-ead4-4bb8-a266-404c93ffd561 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:16.936609 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a042afb7-ead4-4bb8-a266-404c93ffd561 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:16.938236 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a042afb7-ead4-4bb8-a266-404c93ffd561 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:17.388251 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5ed770cb-eebd-4b76-9bde-caad0a8abbad tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:17.403205 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5ed770cb-eebd-4b76-9bde-caad0a8abbad tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c" status: 200 len: 1723 microversion: 2.1 time: 0.538817 Oct 26 13:19:17.404216 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1990/4004] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:16 2022] GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c => generated 1723 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:17.409012 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-93586da1-3f97-4a9e-b5a8-e7f4aa70c4a0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:17.409736 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-93586da1-3f97-4a9e-b5a8-e7f4aa70c4a0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 47c25651-2bed-4595-b4cf-69f3d8f05655] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:17.417031 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-93586da1-3f97-4a9e-b5a8-e7f4aa70c4a0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:17.417753 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-93586da1-3f97-4a9e-b5a8-e7f4aa70c4a0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:17.418245 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-93586da1-3f97-4a9e-b5a8-e7f4aa70c4a0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:17.421747 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-93586da1-3f97-4a9e-b5a8-e7f4aa70c4a0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:17.423827 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-93586da1-3f97-4a9e-b5a8-e7f4aa70c4a0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:17.424713 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-93586da1-3f97-4a9e-b5a8-e7f4aa70c4a0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:17.438012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a042afb7-ead4-4bb8-a266-404c93ffd561 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:17.453545 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a042afb7-ead4-4bb8-a266-404c93ffd561 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:17.460262 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a042afb7-ead4-4bb8-a266-404c93ffd561 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:17.462637 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a042afb7-ead4-4bb8-a266-404c93ffd561 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 2961 microversion: 2.42 time: 0.554126 Oct 26 13:19:17.463642 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2015/4005] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:16 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 2961 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:17.471352 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6d37e934-d069-4458-8ded-895d3cea2ce4 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:17.472231 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6d37e934-d069-4458-8ded-895d3cea2ce4 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:17.490107 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d37e934-d069-4458-8ded-895d3cea2ce4 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:17.490707 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d37e934-d069-4458-8ded-895d3cea2ce4 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:17.492955 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d37e934-d069-4458-8ded-895d3cea2ce4 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:17.493815 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d37e934-d069-4458-8ded-895d3cea2ce4 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:17.494281 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d37e934-d069-4458-8ded-895d3cea2ce4 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:17.494704 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d37e934-d069-4458-8ded-895d3cea2ce4 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:17.880943 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-93586da1-3f97-4a9e-b5a8-e7f4aa70c4a0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:17.890821 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6d37e934-d069-4458-8ded-895d3cea2ce4 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:17.896578 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-93586da1-3f97-4a9e-b5a8-e7f4aa70c4a0 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655" status: 200 len: 1511 microversion: 2.1 time: 0.491173 Oct 26 13:19:17.899718 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1991/4006] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:17 2022] GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655 => generated 1511 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:17.907051 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6d37e934-d069-4458-8ded-895d3cea2ce4 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:17.908651 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6d37e934-d069-4458-8ded-895d3cea2ce4 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:17.917763 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-508eedfe-7c81-4142-8423-922431f0b8bd tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:17.918924 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-508eedfe-7c81-4142-8423-922431f0b8bd tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:17.924670 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6d37e934-d069-4458-8ded-895d3cea2ce4 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1539 microversion: 2.91 time: 0.459251 Oct 26 13:19:17.925275 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2016/4007] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:17 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1539 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:17.946538 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-508eedfe-7c81-4142-8423-922431f0b8bd tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:17.947572 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-508eedfe-7c81-4142-8423-922431f0b8bd tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:17.948111 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-508eedfe-7c81-4142-8423-922431f0b8bd tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:17.948943 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-508eedfe-7c81-4142-8423-922431f0b8bd tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:17.949722 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-508eedfe-7c81-4142-8423-922431f0b8bd tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:17.950395 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-508eedfe-7c81-4142-8423-922431f0b8bd tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:18.122921 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-508eedfe-7c81-4142-8423-922431f0b8bd tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:18.133395 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-508eedfe-7c81-4142-8423-922431f0b8bd tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9" status: 200 len: 1614 microversion: 2.1 time: 0.230900 Oct 26 13:19:18.134258 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1992/4008] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:17 2022] GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 => generated 1614 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:18.430040 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-07aaa8ad-50e2-4a3b-a4d1-ab366e742583 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:18.430661 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-07aaa8ad-50e2-4a3b-a4d1-ab366e742583 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:18.448277 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07aaa8ad-50e2-4a3b-a4d1-ab366e742583 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:18.448775 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07aaa8ad-50e2-4a3b-a4d1-ab366e742583 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:18.449222 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07aaa8ad-50e2-4a3b-a4d1-ab366e742583 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:18.449971 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07aaa8ad-50e2-4a3b-a4d1-ab366e742583 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:18.450429 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07aaa8ad-50e2-4a3b-a4d1-ab366e742583 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:18.450856 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07aaa8ad-50e2-4a3b-a4d1-ab366e742583 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:18.495544 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-27219e9e-fc1d-472f-ac54-c592c69952b9 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:18.496822 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-27219e9e-fc1d-472f-ac54-c592c69952b9 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:18.509137 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-27219e9e-fc1d-472f-ac54-c592c69952b9 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:18.512199 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-27219e9e-fc1d-472f-ac54-c592c69952b9 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:18.512860 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-27219e9e-fc1d-472f-ac54-c592c69952b9 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:18.515598 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-27219e9e-fc1d-472f-ac54-c592c69952b9 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:18.516198 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-27219e9e-fc1d-472f-ac54-c592c69952b9 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:18.517234 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-27219e9e-fc1d-472f-ac54-c592c69952b9 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:18.764676 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-07aaa8ad-50e2-4a3b-a4d1-ab366e742583 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:18.794240 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-07aaa8ad-50e2-4a3b-a4d1-ab366e742583 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c" status: 200 len: 1723 microversion: 2.1 time: 0.369994 Oct 26 13:19:18.797760 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2017/4009] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:18 2022] GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c => generated 1723 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:18.811532 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-17a77d72-3eb7-4133-ba1c-afec589e9598 req-a62ace64-728d-43bf-af74-7265e449d61f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9", "name": "network-vif-deleted", "tag": "3a104c30-3b08-4b47-ba9a-ae590f82e5ab"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:19:18.854194 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-17a77d72-3eb7-4133-ba1c-afec589e9598 req-a62ace64-728d-43bf-af74-7265e449d61f service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:18.856783 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-17a77d72-3eb7-4133-ba1c-afec589e9598 req-a62ace64-728d-43bf-af74-7265e449d61f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:18.859100 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-17a77d72-3eb7-4133-ba1c-afec589e9598 req-a62ace64-728d-43bf-af74-7265e449d61f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:19.232322 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-17a77d72-3eb7-4133-ba1c-afec589e9598 req-a62ace64-728d-43bf-af74-7265e449d61f service nova] Creating event network-vif-deleted:3a104c30-3b08-4b47-ba9a-ae590f82e5ab for instance bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 on n-h1-862686-1 Oct 26 13:19:19.238258 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-17a77d72-3eb7-4133-ba1c-afec589e9598 req-a62ace64-728d-43bf-af74-7265e449d61f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.438586 Oct 26 13:19:19.239301 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2018/4010] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:19:19.245166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-17c6cffd-dfe2-4544-8c70-d30411bda30f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:19.246044 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-17c6cffd-dfe2-4544-8c70-d30411bda30f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 47c25651-2bed-4595-b4cf-69f3d8f05655] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:19.252425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17c6cffd-dfe2-4544-8c70-d30411bda30f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:19.253260 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17c6cffd-dfe2-4544-8c70-d30411bda30f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:19.253994 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17c6cffd-dfe2-4544-8c70-d30411bda30f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:19.254938 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17c6cffd-dfe2-4544-8c70-d30411bda30f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:19.255639 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17c6cffd-dfe2-4544-8c70-d30411bda30f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:19.256761 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17c6cffd-dfe2-4544-8c70-d30411bda30f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:19.379766 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-27219e9e-fc1d-472f-ac54-c592c69952b9 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:19.403968 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-27219e9e-fc1d-472f-ac54-c592c69952b9 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:19.405941 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-27219e9e-fc1d-472f-ac54-c592c69952b9 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:19.407891 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-27219e9e-fc1d-472f-ac54-c592c69952b9 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 2961 microversion: 2.42 time: 0.916866 Oct 26 13:19:19.408832 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1993/4011] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:18 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 2961 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:19:19.451693 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f17cd7d5-7389-4c05-91f0-813727c86bb1 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:19.452693 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f17cd7d5-7389-4c05-91f0-813727c86bb1 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:19.461839 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f17cd7d5-7389-4c05-91f0-813727c86bb1 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:19.462721 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f17cd7d5-7389-4c05-91f0-813727c86bb1 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:19.463401 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f17cd7d5-7389-4c05-91f0-813727c86bb1 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:19.464720 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f17cd7d5-7389-4c05-91f0-813727c86bb1 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:19.465395 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f17cd7d5-7389-4c05-91f0-813727c86bb1 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:19.467455 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f17cd7d5-7389-4c05-91f0-813727c86bb1 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:19.589362 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f17cd7d5-7389-4c05-91f0-813727c86bb1 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:19.608371 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f17cd7d5-7389-4c05-91f0-813727c86bb1 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:19.612521 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f17cd7d5-7389-4c05-91f0-813727c86bb1 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:19.626132 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f17cd7d5-7389-4c05-91f0-813727c86bb1 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1539 microversion: 2.91 time: 0.184148 Oct 26 13:19:19.627220 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1994/4012] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:19 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1539 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:19.636506 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-07eaed1e-78c6-4339-b92b-760b430e3f69 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:19.637440 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-17c6cffd-dfe2-4544-8c70-d30411bda30f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:19.637990 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-07eaed1e-78c6-4339-b92b-760b430e3f69 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:19.645159 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-17c6cffd-dfe2-4544-8c70-d30411bda30f tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655" status: 200 len: 1511 microversion: 2.1 time: 0.404615 Oct 26 13:19:19.646695 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-07eaed1e-78c6-4339-b92b-760b430e3f69 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:19.649716 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2019/4013] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:19 2022] GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655 => generated 1511 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:19.677245 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-07eaed1e-78c6-4339-b92b-760b430e3f69 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:19.680221 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-07eaed1e-78c6-4339-b92b-760b430e3f69 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:19.680997 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-07eaed1e-78c6-4339-b92b-760b430e3f69 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:19.684658 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-07eaed1e-78c6-4339-b92b-760b430e3f69 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:19.685175 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-07eaed1e-78c6-4339-b92b-760b430e3f69 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:19.733557 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-07eaed1e-78c6-4339-b92b-760b430e3f69 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] HTTP exception thrown: Instance bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 could not be found. Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-07eaed1e-78c6-4339-b92b-760b430e3f69 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Request method failure captured: Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 HTTP/1.1 Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTK8yiFaYn6FsK4kYH1E6E6NSE9_hIaDskjf1tRy-XgeLhCgjcaBIDqmW8VSjfB2Cmb6DMkQzh-y_Wh40jTHlXsuv7XA0N3K6RDEzKD5nf9Z6iWWIgYAqlJtxWSsEOqwe1NAtEPEvPHN4gJ5RH5unfT6e5xSWJOJigX6JmjW0X-SjQA Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 174da5e5c60449b7a04e9cf2aa3b9fda Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-AttachVolumeNegativeTest-770748596 Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/174da5e5c60449b7a04e9cf2aa3b9fda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/174da5e5c60449b7a04e9cf2aa3b9fda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_174da5e5c60449b7a04e9cf2aa3b9fda"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/174da5e5c60449b7a04e9cf2aa3b9fda"}]}] Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-AttachVolumeNegativeTest-770748596 Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 174da5e5c60449b7a04e9cf2aa3b9fda Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-770748596 Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-AttachVolumeNegativeTest-770748596-project Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 168c83cd1b014f82945f4915e3ece079 Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-AttachVolumeNegativeTest-770748596-project Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 could not be found. Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9'} Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 could not be found. Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 could not be found. Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:19:19.737886 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:19.743839 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:19.743839 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:19:19.743839 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:19:19.743839 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:19:19.743839 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:19:19.743839 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 could not be found. Oct 26 13:19:19.743839 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:19.743839 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-07eaed1e-78c6-4339-b92b-760b430e3f69 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Returning 404 to user: Instance bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:19:19.744548 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-07eaed1e-78c6-4339-b92b-760b430e3f69 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9" status: 404 len: 111 microversion: 2.1 time: 0.115143 Oct 26 13:19:19.745404 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1995/4014] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:19 2022] GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:19:19.754523 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2cbbdca9-0ac9-4cdc-bbce-9173db364055 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '.version_select at 0x7f6731711af0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:19.794978 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2cbbdca9-0ac9-4cdc-bbce-9173db364055 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1358652336" status: 202 len: 0 microversion: 2.1 time: 0.044999 Oct 26 13:19:19.799007 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2020/4015] 10.222.0.40 () {58 vars in 1221 bytes} [Wed Oct 26 13:19:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1358652336 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:19:19.825630 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-479a247f-128e-43dc-a693-3af9fc7dfbbe tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:19.826300 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-479a247f-128e-43dc-a693-3af9fc7dfbbe tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:19.843036 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-479a247f-128e-43dc-a693-3af9fc7dfbbe tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:19.843959 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-479a247f-128e-43dc-a693-3af9fc7dfbbe tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:19.844641 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-479a247f-128e-43dc-a693-3af9fc7dfbbe tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:19.845614 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-479a247f-128e-43dc-a693-3af9fc7dfbbe tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:19.846316 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-479a247f-128e-43dc-a693-3af9fc7dfbbe tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:19.846988 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-479a247f-128e-43dc-a693-3af9fc7dfbbe tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:20.169521 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-479a247f-128e-43dc-a693-3af9fc7dfbbe tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:20.181296 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-479a247f-128e-43dc-a693-3af9fc7dfbbe tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c" status: 200 len: 1723 microversion: 2.1 time: 0.360019 Oct 26 13:19:20.184344 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1996/4016] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:19 2022] GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c => generated 1723 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:20.442361 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1b15cd4f-db15-43a0-a95f-edb90a6b41b0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:20.443040 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1b15cd4f-db15-43a0-a95f-edb90a6b41b0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:20.456013 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b15cd4f-db15-43a0-a95f-edb90a6b41b0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:20.456501 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b15cd4f-db15-43a0-a95f-edb90a6b41b0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:20.456954 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b15cd4f-db15-43a0-a95f-edb90a6b41b0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:20.457675 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b15cd4f-db15-43a0-a95f-edb90a6b41b0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:20.458133 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b15cd4f-db15-43a0-a95f-edb90a6b41b0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:20.458555 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b15cd4f-db15-43a0-a95f-edb90a6b41b0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:20.655708 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-507cbc4c-0868-42f4-8960-5478b19863c7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:20.656376 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-507cbc4c-0868-42f4-8960-5478b19863c7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:20.668282 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-507cbc4c-0868-42f4-8960-5478b19863c7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:20.671416 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-507cbc4c-0868-42f4-8960-5478b19863c7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:20.671903 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-507cbc4c-0868-42f4-8960-5478b19863c7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:20.674086 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-507cbc4c-0868-42f4-8960-5478b19863c7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:20.674584 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-507cbc4c-0868-42f4-8960-5478b19863c7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:20.675025 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-507cbc4c-0868-42f4-8960-5478b19863c7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:20.809408 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-507cbc4c-0868-42f4-8960-5478b19863c7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:20.829000 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-507cbc4c-0868-42f4-8960-5478b19863c7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:20.832978 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-507cbc4c-0868-42f4-8960-5478b19863c7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:20.839904 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-507cbc4c-0868-42f4-8960-5478b19863c7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1539 microversion: 2.91 time: 0.189356 Oct 26 13:19:20.842702 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1997/4017] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:20 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1539 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:20.849575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6d125d91-3f42-45d5-99e0-fa6b6997ed56 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:20.851436 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6d125d91-3f42-45d5-99e0-fa6b6997ed56 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 47c25651-2bed-4595-b4cf-69f3d8f05655] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:20.863556 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6d125d91-3f42-45d5-99e0-fa6b6997ed56 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:20.864504 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6d125d91-3f42-45d5-99e0-fa6b6997ed56 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:20.865175 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6d125d91-3f42-45d5-99e0-fa6b6997ed56 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:20.867375 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6d125d91-3f42-45d5-99e0-fa6b6997ed56 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:20.868004 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6d125d91-3f42-45d5-99e0-fa6b6997ed56 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:20.868597 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6d125d91-3f42-45d5-99e0-fa6b6997ed56 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:21.084525 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1b15cd4f-db15-43a0-a95f-edb90a6b41b0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:21.096252 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1b15cd4f-db15-43a0-a95f-edb90a6b41b0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:21.102842 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1b15cd4f-db15-43a0-a95f-edb90a6b41b0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:21.104649 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1b15cd4f-db15-43a0-a95f-edb90a6b41b0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 2919 microversion: 2.42 time: 0.668217 Oct 26 13:19:21.107237 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2021/4018] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:20 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 2919 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:21.120139 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-9f61fd01-b69d-4989-bd09-9427a360d67b req-41a29636-ed53-42d5-b219-31cf07471908 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5fa9733-f49b-43ab-8586-68d113b73476", "name": "network-vif-unplugged", "status": "completed", "tag": "d85d2737-225d-489a-bdd1-412eb1f237ba"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:19:21.141782 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9f61fd01-b69d-4989-bd09-9427a360d67b req-41a29636-ed53-42d5-b219-31cf07471908 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:21.142450 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9f61fd01-b69d-4989-bd09-9427a360d67b req-41a29636-ed53-42d5-b219-31cf07471908 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:21.143642 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9f61fd01-b69d-4989-bd09-9427a360d67b req-41a29636-ed53-42d5-b219-31cf07471908 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:21.169740 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-9f61fd01-b69d-4989-bd09-9427a360d67b req-41a29636-ed53-42d5-b219-31cf07471908 service nova] Creating event network-vif-unplugged:d85d2737-225d-489a-bdd1-412eb1f237ba for instance b5fa9733-f49b-43ab-8586-68d113b73476 on n-h1-862686-1 Oct 26 13:19:21.177046 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-9f61fd01-b69d-4989-bd09-9427a360d67b req-41a29636-ed53-42d5-b219-31cf07471908 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067757 Oct 26 13:19:21.178079 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2022/4019] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:19:21.224055 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e9a8f438-0d50-4dec-89b7-ae0765e28587 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:21.225691 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e9a8f438-0d50-4dec-89b7-ae0765e28587 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:21.234261 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e9a8f438-0d50-4dec-89b7-ae0765e28587 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:21.235224 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e9a8f438-0d50-4dec-89b7-ae0765e28587 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:21.235903 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e9a8f438-0d50-4dec-89b7-ae0765e28587 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:21.236937 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e9a8f438-0d50-4dec-89b7-ae0765e28587 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:21.237931 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e9a8f438-0d50-4dec-89b7-ae0765e28587 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:21.238826 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e9a8f438-0d50-4dec-89b7-ae0765e28587 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:21.340958 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6d125d91-3f42-45d5-99e0-fa6b6997ed56 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:21.348959 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6d125d91-3f42-45d5-99e0-fa6b6997ed56 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655" status: 200 len: 1511 microversion: 2.1 time: 0.504934 Oct 26 13:19:21.350123 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1998/4020] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:20 2022] GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655 => generated 1511 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:21.589368 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4c4704f2-706c-4ac5-a91d-dbe214e59c9e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Action: 'create', calling method: .version_select at 0x7f67319ea8b0>, body: {"keypair": {"name": "tempest-keypair-634851606", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK46hqAzegydIlnYsWX6c9+aeCQQMWhmwlz3PM4j+FBnAEOfiBU0xkTuWGjr5e4O+p+djG4tqOddQltc7v5rfGjVBzRrpUF1xG7U9UA8yJwNYWKWyDlipCq/msnzpkElFA=="}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:19:21.601286 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e9a8f438-0d50-4dec-89b7-ae0765e28587 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:21.604072 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:19:21.630607 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e9a8f438-0d50-4dec-89b7-ae0765e28587 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c" status: 200 len: 1723 microversion: 2.1 time: 0.418587 Oct 26 13:19:21.633727 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2023/4021] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:21 2022] GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c => generated 1723 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:21.636588 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-4c4704f2-706c-4ac5-a91d-dbe214e59c9e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Getting quotas for project 174da5e5c60449b7a04e9cf2aa3b9fda. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:19:21.649959 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-4c4704f2-706c-4ac5-a91d-dbe214e59c9e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Getting quotas for user 168c83cd1b014f82945f4915e3ece079 and project 174da5e5c60449b7a04e9cf2aa3b9fda. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:19:21.698702 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4c4704f2-706c-4ac5-a91d-dbe214e59c9e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.115898 Oct 26 13:19:21.700021 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1999/4022] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 13:19:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:19:21.878178 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-38bdd689-79b4-4543-95df-7b9904358107 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:21.878808 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-38bdd689-79b4-4543-95df-7b9904358107 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:21.897795 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38bdd689-79b4-4543-95df-7b9904358107 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:21.898594 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38bdd689-79b4-4543-95df-7b9904358107 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:21.901376 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38bdd689-79b4-4543-95df-7b9904358107 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:21.903333 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38bdd689-79b4-4543-95df-7b9904358107 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:21.903838 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38bdd689-79b4-4543-95df-7b9904358107 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:21.904293 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38bdd689-79b4-4543-95df-7b9904358107 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:22.058375 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-38bdd689-79b4-4543-95df-7b9904358107 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:22.073190 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-38bdd689-79b4-4543-95df-7b9904358107 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:22.079281 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-38bdd689-79b4-4543-95df-7b9904358107 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:22.102206 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-38bdd689-79b4-4543-95df-7b9904358107 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1539 microversion: 2.91 time: 0.230381 Oct 26 13:19:22.102875 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2024/4023] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:21 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1539 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:22.138180 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-26fe40d1-b628-4c83-b41d-423b6bf58847 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:22.138404 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-26fe40d1-b628-4c83-b41d-423b6bf58847 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:22.171601 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26fe40d1-b628-4c83-b41d-423b6bf58847 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:22.172105 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26fe40d1-b628-4c83-b41d-423b6bf58847 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:22.172547 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26fe40d1-b628-4c83-b41d-423b6bf58847 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:22.173268 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26fe40d1-b628-4c83-b41d-423b6bf58847 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:22.173753 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26fe40d1-b628-4c83-b41d-423b6bf58847 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:22.174179 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26fe40d1-b628-4c83-b41d-423b6bf58847 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:22.373643 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4d42251b-69d6-41d8-b58c-91159a7446b8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:22.374231 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4d42251b-69d6-41d8-b58c-91159a7446b8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 47c25651-2bed-4595-b4cf-69f3d8f05655] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:22.389685 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d42251b-69d6-41d8-b58c-91159a7446b8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:22.392319 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d42251b-69d6-41d8-b58c-91159a7446b8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:22.392790 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d42251b-69d6-41d8-b58c-91159a7446b8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:22.399635 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d42251b-69d6-41d8-b58c-91159a7446b8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:22.400314 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d42251b-69d6-41d8-b58c-91159a7446b8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:22.400767 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d42251b-69d6-41d8-b58c-91159a7446b8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:22.748081 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-26fe40d1-b628-4c83-b41d-423b6bf58847 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:22.751981 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:19:22.765718 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-26fe40d1-b628-4c83-b41d-423b6bf58847 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:22.767181 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-26fe40d1-b628-4c83-b41d-423b6bf58847 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:22.772082 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-26fe40d1-b628-4c83-b41d-423b6bf58847 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 2872 microversion: 2.42 time: 0.638370 Oct 26 13:19:22.773364 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2000/4024] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:22 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 2872 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:22.794038 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-ebb9e97a-756c-4f87-ac84-657be0abb2ec req-73678ff0-9b56-40aa-a3e7-5a79b82583e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5fa9733-f49b-43ab-8586-68d113b73476", "name": "network-vif-deleted", "tag": "d85d2737-225d-489a-bdd1-412eb1f237ba"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:19:22.836921 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ebb9e97a-756c-4f87-ac84-657be0abb2ec req-73678ff0-9b56-40aa-a3e7-5a79b82583e0 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:22.837711 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ebb9e97a-756c-4f87-ac84-657be0abb2ec req-73678ff0-9b56-40aa-a3e7-5a79b82583e0 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:22.838303 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ebb9e97a-756c-4f87-ac84-657be0abb2ec req-73678ff0-9b56-40aa-a3e7-5a79b82583e0 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:22.884049 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-ebb9e97a-756c-4f87-ac84-657be0abb2ec req-73678ff0-9b56-40aa-a3e7-5a79b82583e0 service nova] Creating event network-vif-deleted:d85d2737-225d-489a-bdd1-412eb1f237ba for instance b5fa9733-f49b-43ab-8586-68d113b73476 on n-h1-862686-1 Oct 26 13:19:22.893412 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-ebb9e97a-756c-4f87-ac84-657be0abb2ec req-73678ff0-9b56-40aa-a3e7-5a79b82583e0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115948 Oct 26 13:19:22.894411 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2001/4025] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:19:22.908038 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4a08cac7-091f-472d-b607-0032929e31cc tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:22.908770 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4a08cac7-091f-472d-b607-0032929e31cc tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:22.933025 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4a08cac7-091f-472d-b607-0032929e31cc tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:22.933585 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4a08cac7-091f-472d-b607-0032929e31cc tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:22.934033 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4a08cac7-091f-472d-b607-0032929e31cc tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:22.940412 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4a08cac7-091f-472d-b607-0032929e31cc tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:22.941008 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4a08cac7-091f-472d-b607-0032929e31cc tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:22.941599 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4a08cac7-091f-472d-b607-0032929e31cc tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:23.029299 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:19:23.049086 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4d42251b-69d6-41d8-b58c-91159a7446b8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:23.062300 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4d42251b-69d6-41d8-b58c-91159a7446b8 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655" status: 200 len: 1511 microversion: 2.1 time: 0.692439 Oct 26 13:19:23.062940 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2025/4026] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:22 2022] GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655 => generated 1511 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:23.141108 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3c2d1c0a-443c-436e-8d4c-8bc6d18412be tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:23.141745 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3c2d1c0a-443c-436e-8d4c-8bc6d18412be tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:23.155185 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c2d1c0a-443c-436e-8d4c-8bc6d18412be tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:23.156469 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c2d1c0a-443c-436e-8d4c-8bc6d18412be tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:23.157107 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c2d1c0a-443c-436e-8d4c-8bc6d18412be tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:23.157871 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c2d1c0a-443c-436e-8d4c-8bc6d18412be tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:23.162305 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c2d1c0a-443c-436e-8d4c-8bc6d18412be tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:23.163553 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c2d1c0a-443c-436e-8d4c-8bc6d18412be tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:23.354952 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3c2d1c0a-443c-436e-8d4c-8bc6d18412be tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:23.378074 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3c2d1c0a-443c-436e-8d4c-8bc6d18412be tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:23.386651 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3c2d1c0a-443c-436e-8d4c-8bc6d18412be tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:23.394876 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4a08cac7-091f-472d-b607-0032929e31cc tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:23.404787 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3c2d1c0a-443c-436e-8d4c-8bc6d18412be tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1539 microversion: 2.91 time: 0.270490 Oct 26 13:19:23.406142 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2026/4027] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:23 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1539 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:23.422280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-ef775dae-1226-4bd5-8404-e89f902ea095 req-5a64754c-a00e-4d27-862f-eda7a79ed561 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5fa9733-f49b-43ab-8586-68d113b73476", "name": "network-vif-unplugged", "status": "completed", "tag": "f2fe44e4-4b3a-4974-85cd-bdb8df938561"}, {"server_uuid": "b5fa9733-f49b-43ab-8586-68d113b73476", "name": "network-vif-unplugged", "status": "completed", "tag": "b4a99c4e-af6c-4bd4-bdc0-d0c89b5dec6c"}, {"server_uuid": "b5fa9733-f49b-43ab-8586-68d113b73476", "name": "network-vif-unplugged", "status": "completed", "tag": "3e876899-0ec1-4d6a-bf24-cae0a92e06ac"}, {"server_uuid": "b5fa9733-f49b-43ab-8586-68d113b73476", "name": "network-vif-unplugged", "status": "completed", "tag": "dae3728e-b93b-4eed-a07b-aea0efaacfac"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:19:23.443711 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4a08cac7-091f-472d-b607-0032929e31cc tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c" status: 200 len: 1723 microversion: 2.1 time: 0.547862 Oct 26 13:19:23.449664 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2002/4028] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:22 2022] GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c => generated 1723 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:23.459283 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ef775dae-1226-4bd5-8404-e89f902ea095 req-5a64754c-a00e-4d27-862f-eda7a79ed561 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:23.460130 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ef775dae-1226-4bd5-8404-e89f902ea095 req-5a64754c-a00e-4d27-862f-eda7a79ed561 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:23.461104 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ef775dae-1226-4bd5-8404-e89f902ea095 req-5a64754c-a00e-4d27-862f-eda7a79ed561 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:23.488651 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-ef775dae-1226-4bd5-8404-e89f902ea095 req-5a64754c-a00e-4d27-862f-eda7a79ed561 service nova] Creating event network-vif-unplugged:f2fe44e4-4b3a-4974-85cd-bdb8df938561 for instance b5fa9733-f49b-43ab-8586-68d113b73476 on n-h1-862686-1 Oct 26 13:19:23.489405 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-ef775dae-1226-4bd5-8404-e89f902ea095 req-5a64754c-a00e-4d27-862f-eda7a79ed561 service nova] Creating event network-vif-unplugged:b4a99c4e-af6c-4bd4-bdc0-d0c89b5dec6c for instance b5fa9733-f49b-43ab-8586-68d113b73476 on n-h1-862686-1 Oct 26 13:19:23.490103 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-ef775dae-1226-4bd5-8404-e89f902ea095 req-5a64754c-a00e-4d27-862f-eda7a79ed561 service nova] Creating event network-vif-unplugged:3e876899-0ec1-4d6a-bf24-cae0a92e06ac for instance b5fa9733-f49b-43ab-8586-68d113b73476 on n-h1-862686-1 Oct 26 13:19:23.491437 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-ef775dae-1226-4bd5-8404-e89f902ea095 req-5a64754c-a00e-4d27-862f-eda7a79ed561 service nova] Creating event network-vif-unplugged:dae3728e-b93b-4eed-a07b-aea0efaacfac for instance b5fa9733-f49b-43ab-8586-68d113b73476 on n-h1-862686-1 Oct 26 13:19:23.507779 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-ef775dae-1226-4bd5-8404-e89f902ea095 req-5a64754c-a00e-4d27-862f-eda7a79ed561 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.099404 Oct 26 13:19:23.508686 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2027/4029] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:19:23.806004 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b3d03536-4047-4479-8bd1-bb9445cefe18 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:23.806798 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b3d03536-4047-4479-8bd1-bb9445cefe18 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:23.815869 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b3d03536-4047-4479-8bd1-bb9445cefe18 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:23.816961 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b3d03536-4047-4479-8bd1-bb9445cefe18 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:23.817530 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b3d03536-4047-4479-8bd1-bb9445cefe18 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:23.821038 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b3d03536-4047-4479-8bd1-bb9445cefe18 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:23.824845 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b3d03536-4047-4479-8bd1-bb9445cefe18 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:23.825775 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b3d03536-4047-4479-8bd1-bb9445cefe18 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:24.091865 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7a57cde0-524b-475e-8aa6-52ae82e245e4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:24.092624 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7a57cde0-524b-475e-8aa6-52ae82e245e4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 47c25651-2bed-4595-b4cf-69f3d8f05655] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:24.114521 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a57cde0-524b-475e-8aa6-52ae82e245e4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:24.115027 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a57cde0-524b-475e-8aa6-52ae82e245e4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:24.115471 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a57cde0-524b-475e-8aa6-52ae82e245e4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:24.117591 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a57cde0-524b-475e-8aa6-52ae82e245e4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:24.118060 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a57cde0-524b-475e-8aa6-52ae82e245e4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:24.119510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a57cde0-524b-475e-8aa6-52ae82e245e4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:24.278090 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b3d03536-4047-4479-8bd1-bb9445cefe18 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:24.293919 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b3d03536-4047-4479-8bd1-bb9445cefe18 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:24.295388 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b3d03536-4047-4479-8bd1-bb9445cefe18 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:24.296645 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b3d03536-4047-4479-8bd1-bb9445cefe18 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 2712 microversion: 2.42 time: 0.496260 Oct 26 13:19:24.297221 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2003/4030] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:23 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 2712 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:24.439453 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2157b37e-5e90-44cf-96fb-5cff2dce23f7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:24.440056 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2157b37e-5e90-44cf-96fb-5cff2dce23f7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:24.452088 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2157b37e-5e90-44cf-96fb-5cff2dce23f7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:24.455145 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2157b37e-5e90-44cf-96fb-5cff2dce23f7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:24.456235 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2157b37e-5e90-44cf-96fb-5cff2dce23f7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:24.458505 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2157b37e-5e90-44cf-96fb-5cff2dce23f7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:24.459001 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2157b37e-5e90-44cf-96fb-5cff2dce23f7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:24.463420 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2157b37e-5e90-44cf-96fb-5cff2dce23f7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:24.597743 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7a57cde0-524b-475e-8aa6-52ae82e245e4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:24.610127 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7a57cde0-524b-475e-8aa6-52ae82e245e4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655" status: 200 len: 1488 microversion: 2.1 time: 0.520031 Oct 26 13:19:24.611392 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2028/4031] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:24 2022] GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655 => generated 1488 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:24.628753 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0cfed06c-57d3-4c28-a5ca-55adf47b9ddd tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:24.630746 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0cfed06c-57d3-4c28-a5ca-55adf47b9ddd tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:24.642016 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0cfed06c-57d3-4c28-a5ca-55adf47b9ddd tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:24.642912 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0cfed06c-57d3-4c28-a5ca-55adf47b9ddd tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:24.643687 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0cfed06c-57d3-4c28-a5ca-55adf47b9ddd tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:24.645309 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0cfed06c-57d3-4c28-a5ca-55adf47b9ddd tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:24.646338 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0cfed06c-57d3-4c28-a5ca-55adf47b9ddd tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:24.647617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0cfed06c-57d3-4c28-a5ca-55adf47b9ddd tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:25.009414 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0cfed06c-57d3-4c28-a5ca-55adf47b9ddd tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:25.030994 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2157b37e-5e90-44cf-96fb-5cff2dce23f7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:25.032734 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0cfed06c-57d3-4c28-a5ca-55adf47b9ddd tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c" status: 200 len: 1700 microversion: 2.1 time: 0.416997 Oct 26 13:19:25.033810 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2029/4032] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:24 2022] GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c => generated 1700 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:25.044349 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2157b37e-5e90-44cf-96fb-5cff2dce23f7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:25.048982 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2157b37e-5e90-44cf-96fb-5cff2dce23f7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:25.053619 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-245406a2-910a-4751-a1e1-b3d5cdbfbd90 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:25.054433 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-245406a2-910a-4751-a1e1-b3d5cdbfbd90 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 47c25651-2bed-4595-b4cf-69f3d8f05655] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:25.062036 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2157b37e-5e90-44cf-96fb-5cff2dce23f7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1539 microversion: 2.91 time: 0.627307 Oct 26 13:19:25.062765 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2004/4033] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:24 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1539 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:25.075999 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-245406a2-910a-4751-a1e1-b3d5cdbfbd90 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:25.076507 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-245406a2-910a-4751-a1e1-b3d5cdbfbd90 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:25.082761 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-245406a2-910a-4751-a1e1-b3d5cdbfbd90 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:25.082964 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-0a8e7de8-3bcb-4256-a17a-cf4a6d79cc66 req-c7eafb64-b537-4b78-a929-e525294600cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5fa9733-f49b-43ab-8586-68d113b73476", "name": "network-vif-deleted", "tag": "b4a99c4e-af6c-4bd4-bdc0-d0c89b5dec6c"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:19:25.089380 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-245406a2-910a-4751-a1e1-b3d5cdbfbd90 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:25.095555 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-245406a2-910a-4751-a1e1-b3d5cdbfbd90 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:25.096197 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-245406a2-910a-4751-a1e1-b3d5cdbfbd90 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:25.101624 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-0a8e7de8-3bcb-4256-a17a-cf4a6d79cc66 req-c7eafb64-b537-4b78-a929-e525294600cf service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:25.102308 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-0a8e7de8-3bcb-4256-a17a-cf4a6d79cc66 req-c7eafb64-b537-4b78-a929-e525294600cf service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:25.102543 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-0a8e7de8-3bcb-4256-a17a-cf4a6d79cc66 req-c7eafb64-b537-4b78-a929-e525294600cf service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:25.127388 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-0a8e7de8-3bcb-4256-a17a-cf4a6d79cc66 req-c7eafb64-b537-4b78-a929-e525294600cf service nova] Creating event network-vif-deleted:b4a99c4e-af6c-4bd4-bdc0-d0c89b5dec6c for instance b5fa9733-f49b-43ab-8586-68d113b73476 on n-h1-862686-1 Oct 26 13:19:25.132785 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-245406a2-910a-4751-a1e1-b3d5cdbfbd90 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 47c25651-2bed-4595-b4cf-69f3d8f05655] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:19:25.140783 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-0a8e7de8-3bcb-4256-a17a-cf4a6d79cc66 req-c7eafb64-b537-4b78-a929-e525294600cf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073428 Oct 26 13:19:25.143035 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2005/4034] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:19:25.156304 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ab352a7c-1c33-4786-bdb4-e34c8298b5b0 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:19:25.188404 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ab352a7c-1c33-4786-bdb4-e34c8298b5b0 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:25.190585 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ab352a7c-1c33-4786-bdb4-e34c8298b5b0 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:25.192987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ab352a7c-1c33-4786-bdb4-e34c8298b5b0 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:25.321700 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-245406a2-910a-4751-a1e1-b3d5cdbfbd90 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "DELETE /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655" status: 204 len: 0 microversion: 2.1 time: 0.286067 Oct 26 13:19:25.322827 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2030/4035] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:19:25 2022] DELETE /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:19:25.323253 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ab352a7c-1c33-4786-bdb4-e34c8298b5b0 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Going to try to start instance {{(pid=120597) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 26 13:19:25.333933 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4a81dddb-93a2-4864-9ee9-8c9710180931 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:25.337706 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4a81dddb-93a2-4864-9ee9-8c9710180931 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:25.352317 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a81dddb-93a2-4864-9ee9-8c9710180931 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:25.353905 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a81dddb-93a2-4864-9ee9-8c9710180931 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:25.354697 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a81dddb-93a2-4864-9ee9-8c9710180931 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:25.355785 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a81dddb-93a2-4864-9ee9-8c9710180931 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:25.356877 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a81dddb-93a2-4864-9ee9-8c9710180931 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:25.357919 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a81dddb-93a2-4864-9ee9-8c9710180931 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:25.455948 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ab352a7c-1c33-4786-bdb4-e34c8298b5b0 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "POST /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c/action" status: 202 len: 0 microversion: 2.1 time: 0.311088 Oct 26 13:19:25.462209 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2006/4036] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:19:25 2022] POST /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:19:25.475934 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-941d2410-cf81-4f67-ac35-355864ca8fc5 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:25.477103 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-941d2410-cf81-4f67-ac35-355864ca8fc5 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 47c25651-2bed-4595-b4cf-69f3d8f05655] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:25.490589 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-941d2410-cf81-4f67-ac35-355864ca8fc5 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:25.491462 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-941d2410-cf81-4f67-ac35-355864ca8fc5 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:25.492332 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-941d2410-cf81-4f67-ac35-355864ca8fc5 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:25.493868 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-941d2410-cf81-4f67-ac35-355864ca8fc5 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:25.494593 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-941d2410-cf81-4f67-ac35-355864ca8fc5 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:25.495270 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-941d2410-cf81-4f67-ac35-355864ca8fc5 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:25.983515 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4a81dddb-93a2-4864-9ee9-8c9710180931 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:25.990566 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-941d2410-cf81-4f67-ac35-355864ca8fc5 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:26.000962 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4a81dddb-93a2-4864-9ee9-8c9710180931 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:26.001934 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-941d2410-cf81-4f67-ac35-355864ca8fc5 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655" status: 200 len: 1494 microversion: 2.1 time: 0.536914 Oct 26 13:19:26.003627 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4a81dddb-93a2-4864-9ee9-8c9710180931 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:26.007012 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4a81dddb-93a2-4864-9ee9-8c9710180931 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 2598 microversion: 2.42 time: 0.681251 Oct 26 13:19:26.023241 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2007/4037] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:25 2022] GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655 => generated 1494 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:26.029081 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2031/4038] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:25 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 2598 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:26.037693 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-37d24afb-f8e7-4758-aa54-91d49b535d3d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:26.039697 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-37d24afb-f8e7-4758-aa54-91d49b535d3d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:26.052401 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37d24afb-f8e7-4758-aa54-91d49b535d3d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:26.053195 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37d24afb-f8e7-4758-aa54-91d49b535d3d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:26.053930 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37d24afb-f8e7-4758-aa54-91d49b535d3d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:26.054982 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37d24afb-f8e7-4758-aa54-91d49b535d3d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:26.058021 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37d24afb-f8e7-4758-aa54-91d49b535d3d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:26.058749 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37d24afb-f8e7-4758-aa54-91d49b535d3d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:26.096496 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fff792f8-a184-49e9-8180-f50cd08b244a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:26.097115 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fff792f8-a184-49e9-8180-f50cd08b244a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:26.105972 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fff792f8-a184-49e9-8180-f50cd08b244a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:26.106477 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fff792f8-a184-49e9-8180-f50cd08b244a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:26.106920 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fff792f8-a184-49e9-8180-f50cd08b244a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:26.107638 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fff792f8-a184-49e9-8180-f50cd08b244a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:26.108098 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fff792f8-a184-49e9-8180-f50cd08b244a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:26.108528 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fff792f8-a184-49e9-8180-f50cd08b244a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:26.328329 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fff792f8-a184-49e9-8180-f50cd08b244a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:26.345281 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fff792f8-a184-49e9-8180-f50cd08b244a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:26.348680 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fff792f8-a184-49e9-8180-f50cd08b244a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:26.358300 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fff792f8-a184-49e9-8180-f50cd08b244a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1539 microversion: 2.91 time: 0.265641 Oct 26 13:19:26.362640 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2032/4039] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:26 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1539 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:19:26.558804 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-37d24afb-f8e7-4758-aa54-91d49b535d3d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:26.570757 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-37d24afb-f8e7-4758-aa54-91d49b535d3d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c" status: 200 len: 1709 microversion: 2.1 time: 0.545934 Oct 26 13:19:26.571633 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2008/4040] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:26 2022] GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c => generated 1709 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:26.675939 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7a73d51d-13cc-4285-be10-efb9e1a50a88 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1916067565", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "df534cfb-2cf9-4d8e-8e23-fa2d774b3fd9"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:19:26.728893 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-55475047-1a5c-4bd5-87f5-5b6022882a34 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1128048521", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6fd403f3-cdf4-4a71-b3b7-5fccfc8063f7"}], "security_groups": [{"name": "tempest-securitygroup--2034617111"}], "key_name": "tempest-keypair-634851606", "user_data": "}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:19:26.754519 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:19:26.783609 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-7a73d51d-13cc-4285-be10-efb9e1a50a88 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] validate_networks() for [('df534cfb-2cf9-4d8e-8e23-fa2d774b3fd9', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:19:26.983413 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-55475047-1a5c-4bd5-87f5-5b6022882a34 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] validate_networks() for [('6fd403f3-cdf4-4a71-b3b7-5fccfc8063f7', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:19:27.509105 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-55475047-1a5c-4bd5-87f5-5b6022882a34 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:19:27.510312 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-55475047-1a5c-4bd5-87f5-5b6022882a34 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:19:27.510693 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-55475047-1a5c-4bd5-87f5-5b6022882a34 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:19:27.511909 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-55475047-1a5c-4bd5-87f5-5b6022882a34 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:19:27.513106 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-55475047-1a5c-4bd5-87f5-5b6022882a34 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:19:27.551162 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-55475047-1a5c-4bd5-87f5-5b6022882a34 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:27.551576 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-55475047-1a5c-4bd5-87f5-5b6022882a34 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:27.554223 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-55475047-1a5c-4bd5-87f5-5b6022882a34 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:27.555287 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-55475047-1a5c-4bd5-87f5-5b6022882a34 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:27.556064 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-55475047-1a5c-4bd5-87f5-5b6022882a34 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:27.556833 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-55475047-1a5c-4bd5-87f5-5b6022882a34 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:27.590909 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-55475047-1a5c-4bd5-87f5-5b6022882a34 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Getting quotas for project 174da5e5c60449b7a04e9cf2aa3b9fda. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:19:27.601290 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-55475047-1a5c-4bd5-87f5-5b6022882a34 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Getting quotas for user 168c83cd1b014f82945f4915e3ece079 and project 174da5e5c60449b7a04e9cf2aa3b9fda. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:19:27.625457 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-55475047-1a5c-4bd5-87f5-5b6022882a34 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:19:27.628182 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-55475047-1a5c-4bd5-87f5-5b6022882a34 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 42f50b1b-9531-43dd-bb5f-cbca3b7d306f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:19:27.714454 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-55475047-1a5c-4bd5-87f5-5b6022882a34 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.993187 Oct 26 13:19:27.716146 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2009/4041] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:19:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 995 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:19:27.721255 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-65c12fc3-cbc2-4f98-9501-0877a0e3b510 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:27.721913 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-65c12fc3-cbc2-4f98-9501-0877a0e3b510 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 47c25651-2bed-4595-b4cf-69f3d8f05655] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:27.731322 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-65c12fc3-cbc2-4f98-9501-0877a0e3b510 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:27.743911 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-65c12fc3-cbc2-4f98-9501-0877a0e3b510 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:27.744878 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-65c12fc3-cbc2-4f98-9501-0877a0e3b510 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:27.746142 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-65c12fc3-cbc2-4f98-9501-0877a0e3b510 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:27.746667 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-65c12fc3-cbc2-4f98-9501-0877a0e3b510 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:27.747276 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-65c12fc3-cbc2-4f98-9501-0877a0e3b510 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:28.088692 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-65c12fc3-cbc2-4f98-9501-0877a0e3b510 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:28.099708 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-65c12fc3-cbc2-4f98-9501-0877a0e3b510 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655" status: 200 len: 1494 microversion: 2.1 time: 0.382109 Oct 26 13:19:28.101064 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2010/4042] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:27 2022] GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655 => generated 1494 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:28.129305 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1a419a4d-ee10-456a-8f1b-6511afab7f1e tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:28.129952 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1a419a4d-ee10-456a-8f1b-6511afab7f1e tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:28.162234 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a419a4d-ee10-456a-8f1b-6511afab7f1e tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:28.168355 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a419a4d-ee10-456a-8f1b-6511afab7f1e tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:28.172926 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a419a4d-ee10-456a-8f1b-6511afab7f1e tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:28.173976 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a419a4d-ee10-456a-8f1b-6511afab7f1e tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:28.175584 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a419a4d-ee10-456a-8f1b-6511afab7f1e tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:28.179121 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a419a4d-ee10-456a-8f1b-6511afab7f1e tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:28.419787 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1a419a4d-ee10-456a-8f1b-6511afab7f1e tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:28.437281 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1a419a4d-ee10-456a-8f1b-6511afab7f1e tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:28.441991 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1a419a4d-ee10-456a-8f1b-6511afab7f1e tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:28.445032 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1a419a4d-ee10-456a-8f1b-6511afab7f1e tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 2551 microversion: 2.42 time: 0.319644 Oct 26 13:19:28.457512 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2011/4043] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:28 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 2551 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:28.457512 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-1b1a27a2-7956-45a4-b3ff-f48c4d8d8776 req-197951ff-ac91-4ad8-a333-0c64bdb13a7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5fa9733-f49b-43ab-8586-68d113b73476", "name": "network-vif-deleted", "tag": "3e876899-0ec1-4d6a-bf24-cae0a92e06ac"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:19:28.481196 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-1b1a27a2-7956-45a4-b3ff-f48c4d8d8776 req-197951ff-ac91-4ad8-a333-0c64bdb13a7e service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:28.482015 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-1b1a27a2-7956-45a4-b3ff-f48c4d8d8776 req-197951ff-ac91-4ad8-a333-0c64bdb13a7e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:28.482619 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-1b1a27a2-7956-45a4-b3ff-f48c4d8d8776 req-197951ff-ac91-4ad8-a333-0c64bdb13a7e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:28.503715 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-1b1a27a2-7956-45a4-b3ff-f48c4d8d8776 req-197951ff-ac91-4ad8-a333-0c64bdb13a7e service nova] Creating event network-vif-deleted:3e876899-0ec1-4d6a-bf24-cae0a92e06ac for instance b5fa9733-f49b-43ab-8586-68d113b73476 on n-h1-862686-1 Oct 26 13:19:28.513262 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-1b1a27a2-7956-45a4-b3ff-f48c4d8d8776 req-197951ff-ac91-4ad8-a333-0c64bdb13a7e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063685 Oct 26 13:19:28.515069 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2012/4044] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:19:28.521048 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-46ddcfee-5f86-4cf2-8ab9-743cae0424ff tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:28.522869 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-46ddcfee-5f86-4cf2-8ab9-743cae0424ff tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:28.533218 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-46ddcfee-5f86-4cf2-8ab9-743cae0424ff tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:28.535905 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-46ddcfee-5f86-4cf2-8ab9-743cae0424ff tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:28.536464 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-46ddcfee-5f86-4cf2-8ab9-743cae0424ff tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:28.537212 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-46ddcfee-5f86-4cf2-8ab9-743cae0424ff tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:28.537778 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-46ddcfee-5f86-4cf2-8ab9-743cae0424ff tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:28.538214 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-46ddcfee-5f86-4cf2-8ab9-743cae0424ff tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:28.693022 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-46ddcfee-5f86-4cf2-8ab9-743cae0424ff tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:28.703266 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-46ddcfee-5f86-4cf2-8ab9-743cae0424ff tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:28.705248 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-46ddcfee-5f86-4cf2-8ab9-743cae0424ff tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:28.717411 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-46ddcfee-5f86-4cf2-8ab9-743cae0424ff tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1539 microversion: 2.91 time: 0.200933 Oct 26 13:19:28.718053 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2013/4045] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:28 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1539 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:28.722631 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-351ba262-0b59-4e1d-b685-d3e4dcb30f5e tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:28.723246 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-351ba262-0b59-4e1d-b685-d3e4dcb30f5e tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:28.731409 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-351ba262-0b59-4e1d-b685-d3e4dcb30f5e tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:28.732128 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-351ba262-0b59-4e1d-b685-d3e4dcb30f5e tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:28.732762 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-351ba262-0b59-4e1d-b685-d3e4dcb30f5e tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:28.740059 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-351ba262-0b59-4e1d-b685-d3e4dcb30f5e tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:28.740671 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-351ba262-0b59-4e1d-b685-d3e4dcb30f5e tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:28.741159 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-351ba262-0b59-4e1d-b685-d3e4dcb30f5e tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:29.051263 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-351ba262-0b59-4e1d-b685-d3e4dcb30f5e tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:29.075133 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-351ba262-0b59-4e1d-b685-d3e4dcb30f5e tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c" status: 200 len: 1713 microversion: 2.1 time: 0.352251 Oct 26 13:19:29.076172 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2014/4046] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:28 2022] GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c => generated 1713 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:29.089457 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dce21e61-aa0d-4c96-b8e5-5309a3e97c5d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:29.090197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-dce21e61-aa0d-4c96-b8e5-5309a3e97c5d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 42f50b1b-9531-43dd-bb5f-cbca3b7d306f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:29.101623 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dce21e61-aa0d-4c96-b8e5-5309a3e97c5d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:29.102139 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dce21e61-aa0d-4c96-b8e5-5309a3e97c5d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:29.102667 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dce21e61-aa0d-4c96-b8e5-5309a3e97c5d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:29.103308 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dce21e61-aa0d-4c96-b8e5-5309a3e97c5d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:29.103786 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dce21e61-aa0d-4c96-b8e5-5309a3e97c5d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:29.104209 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dce21e61-aa0d-4c96-b8e5-5309a3e97c5d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:29.133815 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-7a73d51d-13cc-4285-be10-efb9e1a50a88 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:19:29.134394 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-7a73d51d-13cc-4285-be10-efb9e1a50a88 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:19:29.135040 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-7a73d51d-13cc-4285-be10-efb9e1a50a88 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:19:29.136167 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-7a73d51d-13cc-4285-be10-efb9e1a50a88 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:19:29.136795 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-7a73d51d-13cc-4285-be10-efb9e1a50a88 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:19:29.160257 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a73d51d-13cc-4285-be10-efb9e1a50a88 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:29.161161 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a73d51d-13cc-4285-be10-efb9e1a50a88 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:29.161890 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a73d51d-13cc-4285-be10-efb9e1a50a88 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:29.163450 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a73d51d-13cc-4285-be10-efb9e1a50a88 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:29.164164 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a73d51d-13cc-4285-be10-efb9e1a50a88 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:29.164845 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a73d51d-13cc-4285-be10-efb9e1a50a88 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:29.196567 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-7a73d51d-13cc-4285-be10-efb9e1a50a88 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Getting quotas for project 69892d7a76e94fcfbe4b5541a022e220. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:19:29.203714 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-7a73d51d-13cc-4285-be10-efb9e1a50a88 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Getting quotas for user db0d11e415d94d0b904eb901f421f6aa and project 69892d7a76e94fcfbe4b5541a022e220. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:19:29.219361 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7a73d51d-13cc-4285-be10-efb9e1a50a88 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:19:29.222137 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7a73d51d-13cc-4285-be10-efb9e1a50a88 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] [instance: d3605776-7db3-44b2-acdc-8023126131ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:19:29.254779 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-dce21e61-aa0d-4c96-b8e5-5309a3e97c5d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:29.267736 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-dce21e61-aa0d-4c96-b8e5-5309a3e97c5d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f" status: 200 len: 1237 microversion: 2.1 time: 0.188701 Oct 26 13:19:29.281542 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2015/4047] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:29 2022] GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f => generated 1237 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:29.281542 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-59201f1f-914c-42a1-b18b-4e324e4ce92a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:29.281542 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-59201f1f-914c-42a1-b18b-4e324e4ce92a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 47c25651-2bed-4595-b4cf-69f3d8f05655] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:29.288746 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59201f1f-914c-42a1-b18b-4e324e4ce92a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:29.288746 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59201f1f-914c-42a1-b18b-4e324e4ce92a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:29.288746 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59201f1f-914c-42a1-b18b-4e324e4ce92a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:29.288746 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59201f1f-914c-42a1-b18b-4e324e4ce92a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:29.288746 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59201f1f-914c-42a1-b18b-4e324e4ce92a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:29.288746 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59201f1f-914c-42a1-b18b-4e324e4ce92a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:29.333573 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59201f1f-914c-42a1-b18b-4e324e4ce92a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:29.335363 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59201f1f-914c-42a1-b18b-4e324e4ce92a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:29.335851 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7a73d51d-13cc-4285-be10-efb9e1a50a88 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.971033 Oct 26 13:19:29.335996 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59201f1f-914c-42a1-b18b-4e324e4ce92a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:29.342874 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-59201f1f-914c-42a1-b18b-4e324e4ce92a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lazy-loading 'fault' on Instance uuid 47c25651-2bed-4595-b4cf-69f3d8f05655 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:19:29.343108 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2033/4048] 10.222.0.40 () {62 vars in 1188 bytes} [Wed Oct 26 13:19:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2979 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 26 13:19:29.382496 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5199f9a0-967e-411f-8b16-247a322a95c4 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:29.382964 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5199f9a0-967e-411f-8b16-247a322a95c4 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] [instance: d3605776-7db3-44b2-acdc-8023126131ff] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:29.386563 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:19:29.431837 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-59201f1f-914c-42a1-b18b-4e324e4ce92a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:29.443025 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-59201f1f-914c-42a1-b18b-4e324e4ce92a tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655" status: 200 len: 1304 microversion: 2.1 time: 0.171966 Oct 26 13:19:29.445009 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2016/4049] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:29 2022] GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655 => generated 1304 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:29.485234 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a2f8bb15-326b-451b-9967-8d3ce2e3d70d tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:29.485730 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a2f8bb15-326b-451b-9967-8d3ce2e3d70d tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:29.494356 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2f8bb15-326b-451b-9967-8d3ce2e3d70d tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:29.495325 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2f8bb15-326b-451b-9967-8d3ce2e3d70d tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:29.495791 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2f8bb15-326b-451b-9967-8d3ce2e3d70d tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:29.497904 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2f8bb15-326b-451b-9967-8d3ce2e3d70d tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:29.498660 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2f8bb15-326b-451b-9967-8d3ce2e3d70d tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:29.499302 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2f8bb15-326b-451b-9967-8d3ce2e3d70d tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:29.713973 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a2f8bb15-326b-451b-9967-8d3ce2e3d70d tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:29.726941 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a2f8bb15-326b-451b-9967-8d3ce2e3d70d tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:29.728710 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a2f8bb15-326b-451b-9967-8d3ce2e3d70d tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:29.730280 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a2f8bb15-326b-451b-9967-8d3ce2e3d70d tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 2393 microversion: 2.42 time: 0.251582 Oct 26 13:19:29.731109 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2017/4050] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:29 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 2393 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:19:29.747985 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cc475261-96ed-46b9-b6f2-dba92dc8c97d tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:29.748748 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cc475261-96ed-46b9-b6f2-dba92dc8c97d tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:29.755981 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc475261-96ed-46b9-b6f2-dba92dc8c97d tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:29.757162 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc475261-96ed-46b9-b6f2-dba92dc8c97d tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:29.759735 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc475261-96ed-46b9-b6f2-dba92dc8c97d tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:29.759735 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc475261-96ed-46b9-b6f2-dba92dc8c97d tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:29.760033 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc475261-96ed-46b9-b6f2-dba92dc8c97d tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:29.760372 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc475261-96ed-46b9-b6f2-dba92dc8c97d tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:29.836042 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5199f9a0-967e-411f-8b16-247a322a95c4 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0d11e415d94d0b904eb901f421f6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69892d7a76e94fcfbe4b5541a022e220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:29.838886 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cc475261-96ed-46b9-b6f2-dba92dc8c97d tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:29.852936 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5199f9a0-967e-411f-8b16-247a322a95c4 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db0d11e415d94d0b904eb901f421f6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69892d7a76e94fcfbe4b5541a022e220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:29.854690 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5199f9a0-967e-411f-8b16-247a322a95c4 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db0d11e415d94d0b904eb901f421f6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69892d7a76e94fcfbe4b5541a022e220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:29.864567 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:19:29.866931 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5199f9a0-967e-411f-8b16-247a322a95c4 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] 10.222.0.40 "GET /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff" status: 200 len: 1262 microversion: 2.26 time: 0.509866 Oct 26 13:19:29.881885 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2034/4051] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:29 2022] GET /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff => generated 1262 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:29.882911 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cc475261-96ed-46b9-b6f2-dba92dc8c97d tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:29.890519 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cc475261-96ed-46b9-b6f2-dba92dc8c97d tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:29.905069 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cc475261-96ed-46b9-b6f2-dba92dc8c97d tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1539 microversion: 2.91 time: 0.161350 Oct 26 13:19:29.906235 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2018/4052] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:29 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1539 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:30.297031 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-eac583a2-a0f9-455a-a044-5c945fdcf2a8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:30.298485 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-eac583a2-a0f9-455a-a044-5c945fdcf2a8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 42f50b1b-9531-43dd-bb5f-cbca3b7d306f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:30.316041 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eac583a2-a0f9-455a-a044-5c945fdcf2a8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:30.322537 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eac583a2-a0f9-455a-a044-5c945fdcf2a8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:30.337182 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eac583a2-a0f9-455a-a044-5c945fdcf2a8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:30.338216 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eac583a2-a0f9-455a-a044-5c945fdcf2a8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:30.340821 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eac583a2-a0f9-455a-a044-5c945fdcf2a8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:30.342002 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eac583a2-a0f9-455a-a044-5c945fdcf2a8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:30.470846 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-64c2bf1e-1d06-4f0f-a6fe-1c2e24a015a4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:30.471526 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-64c2bf1e-1d06-4f0f-a6fe-1c2e24a015a4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 47c25651-2bed-4595-b4cf-69f3d8f05655] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:30.492183 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64c2bf1e-1d06-4f0f-a6fe-1c2e24a015a4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:30.492694 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64c2bf1e-1d06-4f0f-a6fe-1c2e24a015a4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:30.493142 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64c2bf1e-1d06-4f0f-a6fe-1c2e24a015a4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:30.493907 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64c2bf1e-1d06-4f0f-a6fe-1c2e24a015a4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:30.494372 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64c2bf1e-1d06-4f0f-a6fe-1c2e24a015a4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:30.494792 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64c2bf1e-1d06-4f0f-a6fe-1c2e24a015a4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:30.541711 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-64c2bf1e-1d06-4f0f-a6fe-1c2e24a015a4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] HTTP exception thrown: Instance 47c25651-2bed-4595-b4cf-69f3d8f05655 could not be found. Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-64c2bf1e-1d06-4f0f-a6fe-1c2e24a015a4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Request method failure captured: Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655 HTTP/1.1 Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTLTNOlsUS_LQCwMyQbAmNSS-N_AQOqf9a-vHlBM4RS64aXMIGczutoYb0yXKXV63kqVyJMbrGhj1O0dIymI3rB4OYRTseWpFfzGHfB9PKKsR2NnI_ukYFvVdYRwcazuK9kTcZsmuh-2k9d7Yqn3gprd7n0NXcu2P16gbCixvzOdrAQ Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: ece49f83e645408598655bece0873fd0 Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ece49f83e645408598655bece0873fd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ece49f83e645408598655bece0873fd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ece49f83e645408598655bece0873fd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ece49f83e645408598655bece0873fd0"}]}] Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: ece49f83e645408598655bece0873fd0 Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-DeleteServersTestJSON-1847538505-project Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 8d56acbbbc3545d19cbb80f4e349c763 Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-DeleteServersTestJSON-1847538505-project Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 47c25651-2bed-4595-b4cf-69f3d8f05655 could not be found. Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '47c25651-2bed-4595-b4cf-69f3d8f05655'} Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47c25651-2bed-4595-b4cf-69f3d8f05655 could not be found. Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47c25651-2bed-4595-b4cf-69f3d8f05655 could not be found. Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:19:30.543449 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:30.548478 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:30.548478 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:19:30.548478 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:19:30.548478 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:19:30.548478 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:19:30.548478 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47c25651-2bed-4595-b4cf-69f3d8f05655 could not be found. Oct 26 13:19:30.548478 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:30.548478 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-64c2bf1e-1d06-4f0f-a6fe-1c2e24a015a4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Returning 404 to user: Instance 47c25651-2bed-4595-b4cf-69f3d8f05655 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:19:30.548478 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-64c2bf1e-1d06-4f0f-a6fe-1c2e24a015a4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655" status: 404 len: 111 microversion: 2.1 time: 0.078503 Oct 26 13:19:30.548478 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2019/4053] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:30 2022] GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:19:30.592866 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-eac583a2-a0f9-455a-a044-5c945fdcf2a8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:30.620489 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-eac583a2-a0f9-455a-a044-5c945fdcf2a8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f" status: 200 len: 1311 microversion: 2.1 time: 0.328020 Oct 26 13:19:30.622065 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2035/4054] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:30 2022] GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f => generated 1311 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:30.672945 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-7310d912-baa9-4059-8470-ec529589252b req-ea5be849-33d6-41e1-a137-c7ec9c59cea3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47c25651-2bed-4595-b4cf-69f3d8f05655", "name": "network-vif-deleted", "tag": "e94455b1-262f-442f-8c2c-cbd20f6a92e1"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:19:30.687879 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-7310d912-baa9-4059-8470-ec529589252b req-ea5be849-33d6-41e1-a137-c7ec9c59cea3 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:30.688372 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-7310d912-baa9-4059-8470-ec529589252b req-ea5be849-33d6-41e1-a137-c7ec9c59cea3 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:30.688812 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-7310d912-baa9-4059-8470-ec529589252b req-ea5be849-33d6-41e1-a137-c7ec9c59cea3 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:30.718856 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-7310d912-baa9-4059-8470-ec529589252b req-ea5be849-33d6-41e1-a137-c7ec9c59cea3 service nova] Creating event network-vif-deleted:e94455b1-262f-442f-8c2c-cbd20f6a92e1 for instance 47c25651-2bed-4595-b4cf-69f3d8f05655 on n-h1-862686-1 Oct 26 13:19:30.730601 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-7310d912-baa9-4059-8470-ec529589252b req-ea5be849-33d6-41e1-a137-c7ec9c59cea3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063936 Oct 26 13:19:30.736192 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2020/4055] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:19:30.763214 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-73112009-9012-4911-b588-64b74cb904d6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:30.764869 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-73112009-9012-4911-b588-64b74cb904d6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:30.788346 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73112009-9012-4911-b588-64b74cb904d6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:30.789425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73112009-9012-4911-b588-64b74cb904d6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:30.791739 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73112009-9012-4911-b588-64b74cb904d6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:30.794126 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73112009-9012-4911-b588-64b74cb904d6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:30.795956 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73112009-9012-4911-b588-64b74cb904d6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:30.796401 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73112009-9012-4911-b588-64b74cb904d6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:30.821453 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6079c2b2-b866-49ca-b63a-b2668a95ff76 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-563572794", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "cb59e2c8-6bcb-4fcf-b9e4-c01412b43c60"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:19:30.950602 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-6079c2b2-b866-49ca-b63a-b2668a95ff76 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] validate_networks() for [('cb59e2c8-6bcb-4fcf-b9e4-c01412b43c60', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:19:31.352952 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-73112009-9012-4911-b588-64b74cb904d6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:31.372542 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-73112009-9012-4911-b588-64b74cb904d6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:31.379662 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-73112009-9012-4911-b588-64b74cb904d6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:31.382181 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-73112009-9012-4911-b588-64b74cb904d6 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 2346 microversion: 2.42 time: 0.623340 Oct 26 13:19:31.383517 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2036/4056] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:30 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 2346 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:31.398062 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c4397df8-1e58-40e6-995d-56300902c66b tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:31.400545 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c4397df8-1e58-40e6-995d-56300902c66b tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] [instance: d3605776-7db3-44b2-acdc-8023126131ff] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:31.413966 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4397df8-1e58-40e6-995d-56300902c66b tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:31.416857 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4397df8-1e58-40e6-995d-56300902c66b tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:31.418423 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4397df8-1e58-40e6-995d-56300902c66b tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:31.420759 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4397df8-1e58-40e6-995d-56300902c66b tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:31.424055 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4397df8-1e58-40e6-995d-56300902c66b tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:31.424699 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4397df8-1e58-40e6-995d-56300902c66b tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:31.595026 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c4397df8-1e58-40e6-995d-56300902c66b tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0d11e415d94d0b904eb901f421f6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69892d7a76e94fcfbe4b5541a022e220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:31.620937 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c4397df8-1e58-40e6-995d-56300902c66b tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db0d11e415d94d0b904eb901f421f6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69892d7a76e94fcfbe4b5541a022e220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:31.628082 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c4397df8-1e58-40e6-995d-56300902c66b tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db0d11e415d94d0b904eb901f421f6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69892d7a76e94fcfbe4b5541a022e220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:31.632633 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c4397df8-1e58-40e6-995d-56300902c66b tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] 10.222.0.40 "GET /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff" status: 200 len: 1332 microversion: 2.26 time: 0.247920 Oct 26 13:19:31.638043 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2037/4057] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:31 2022] GET /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff => generated 1332 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:31.643836 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4085096d-f604-46fc-a3ee-d4f9e4bfaa5a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:31.648852 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4085096d-f604-46fc-a3ee-d4f9e4bfaa5a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:31.676798 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4085096d-f604-46fc-a3ee-d4f9e4bfaa5a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:31.677759 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4085096d-f604-46fc-a3ee-d4f9e4bfaa5a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:31.679100 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4085096d-f604-46fc-a3ee-d4f9e4bfaa5a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:31.680188 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4085096d-f604-46fc-a3ee-d4f9e4bfaa5a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:31.680777 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4085096d-f604-46fc-a3ee-d4f9e4bfaa5a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:31.681333 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4085096d-f604-46fc-a3ee-d4f9e4bfaa5a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:31.839547 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-6079c2b2-b866-49ca-b63a-b2668a95ff76 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:19:31.840301 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-6079c2b2-b866-49ca-b63a-b2668a95ff76 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:19:31.841075 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-6079c2b2-b866-49ca-b63a-b2668a95ff76 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:19:31.841651 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-6079c2b2-b866-49ca-b63a-b2668a95ff76 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:19:31.842329 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-6079c2b2-b866-49ca-b63a-b2668a95ff76 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:19:31.864184 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6079c2b2-b866-49ca-b63a-b2668a95ff76 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:31.865003 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6079c2b2-b866-49ca-b63a-b2668a95ff76 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:31.866341 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6079c2b2-b866-49ca-b63a-b2668a95ff76 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:31.867902 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6079c2b2-b866-49ca-b63a-b2668a95ff76 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:31.868748 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6079c2b2-b866-49ca-b63a-b2668a95ff76 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:31.869426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6079c2b2-b866-49ca-b63a-b2668a95ff76 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:31.906538 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-6079c2b2-b866-49ca-b63a-b2668a95ff76 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Getting quotas for project ece49f83e645408598655bece0873fd0. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:19:31.914008 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-6079c2b2-b866-49ca-b63a-b2668a95ff76 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Getting quotas for user 8d56acbbbc3545d19cbb80f4e349c763 and project ece49f83e645408598655bece0873fd0. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:19:31.928658 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6079c2b2-b866-49ca-b63a-b2668a95ff76 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:19:31.931915 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6079c2b2-b866-49ca-b63a-b2668a95ff76 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 798f0deb-3412-479f-bf6b-d11872c9f680] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:19:31.978811 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4085096d-f604-46fc-a3ee-d4f9e4bfaa5a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:31.999809 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4085096d-f604-46fc-a3ee-d4f9e4bfaa5a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:32.002082 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4085096d-f604-46fc-a3ee-d4f9e4bfaa5a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:32.007292 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6079c2b2-b866-49ca-b63a-b2668a95ff76 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.191241 Oct 26 13:19:32.012467 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2021/4058] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:19:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1197 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:19:32.016028 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4085096d-f604-46fc-a3ee-d4f9e4bfaa5a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1539 microversion: 2.91 time: 0.375935 Oct 26 13:19:32.019865 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2038/4059] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:31 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1539 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:32.033706 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bc1aa786-bf3a-4cdb-b449-72330ea57ad1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:32.033706 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bc1aa786-bf3a-4cdb-b449-72330ea57ad1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 42f50b1b-9531-43dd-bb5f-cbca3b7d306f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:32.033706 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc1aa786-bf3a-4cdb-b449-72330ea57ad1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:32.033706 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc1aa786-bf3a-4cdb-b449-72330ea57ad1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:32.033706 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc1aa786-bf3a-4cdb-b449-72330ea57ad1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:32.033706 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc1aa786-bf3a-4cdb-b449-72330ea57ad1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:32.033706 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc1aa786-bf3a-4cdb-b449-72330ea57ad1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:32.033706 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc1aa786-bf3a-4cdb-b449-72330ea57ad1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:32.202435 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5a872abe-5ae0-4235-aea2-fb6453ccc2d9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-774971725", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:19:32.344367 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-5a872abe-5ae0-4235-aea2-fb6453ccc2d9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] validate_networks() for [('8122bd35-175c-4158-bd9f-4d231f20a1e9', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:19:32.475569 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bc1aa786-bf3a-4cdb-b449-72330ea57ad1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:32.501915 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bc1aa786-bf3a-4cdb-b449-72330ea57ad1 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f" status: 200 len: 1367 microversion: 2.1 time: 0.487608 Oct 26 13:19:32.517509 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2022/4060] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:32 2022] GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f => generated 1367 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:32.517509 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f16debf9-795d-4e4b-a670-5d00bb50ddfd tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:32.517509 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f16debf9-795d-4e4b-a670-5d00bb50ddfd tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 798f0deb-3412-479f-bf6b-d11872c9f680] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:32.721385 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f16debf9-795d-4e4b-a670-5d00bb50ddfd tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:32.731688 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f16debf9-795d-4e4b-a670-5d00bb50ddfd tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680" status: 200 len: 1214 microversion: 2.1 time: 0.221912 Oct 26 13:19:32.735008 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2023/4061] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:32 2022] GET /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680 => generated 1214 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:32.744425 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-17ae811b-214c-4e60-a3b2-aa85b7ef684f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:32.745509 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-17ae811b-214c-4e60-a3b2-aa85b7ef684f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:32.785981 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17ae811b-214c-4e60-a3b2-aa85b7ef684f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:32.787006 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17ae811b-214c-4e60-a3b2-aa85b7ef684f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:32.789312 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17ae811b-214c-4e60-a3b2-aa85b7ef684f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:32.791954 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17ae811b-214c-4e60-a3b2-aa85b7ef684f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:32.792663 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17ae811b-214c-4e60-a3b2-aa85b7ef684f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:32.795286 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17ae811b-214c-4e60-a3b2-aa85b7ef684f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:32.993619 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-17ae811b-214c-4e60-a3b2-aa85b7ef684f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:33.008091 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-17ae811b-214c-4e60-a3b2-aa85b7ef684f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:33.012941 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-17ae811b-214c-4e60-a3b2-aa85b7ef684f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:33.016550 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-17ae811b-214c-4e60-a3b2-aa85b7ef684f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1604 microversion: 2.42 time: 0.279161 Oct 26 13:19:33.023114 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2024/4062] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:32 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1604 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:33.050538 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-704ae914-f806-4dec-9df3-6fc264e42480 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:33.051176 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-704ae914-f806-4dec-9df3-6fc264e42480 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] [instance: d3605776-7db3-44b2-acdc-8023126131ff] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:33.060954 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-704ae914-f806-4dec-9df3-6fc264e42480 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:33.060954 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-704ae914-f806-4dec-9df3-6fc264e42480 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:33.061465 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-704ae914-f806-4dec-9df3-6fc264e42480 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:33.062145 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-704ae914-f806-4dec-9df3-6fc264e42480 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:33.062666 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-704ae914-f806-4dec-9df3-6fc264e42480 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:33.063604 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-704ae914-f806-4dec-9df3-6fc264e42480 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:33.347366 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-704ae914-f806-4dec-9df3-6fc264e42480 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0d11e415d94d0b904eb901f421f6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69892d7a76e94fcfbe4b5541a022e220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:33.380192 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-704ae914-f806-4dec-9df3-6fc264e42480 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db0d11e415d94d0b904eb901f421f6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69892d7a76e94fcfbe4b5541a022e220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:33.383319 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-704ae914-f806-4dec-9df3-6fc264e42480 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db0d11e415d94d0b904eb901f421f6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69892d7a76e94fcfbe4b5541a022e220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:33.391122 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-704ae914-f806-4dec-9df3-6fc264e42480 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] 10.222.0.40 "GET /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff" status: 200 len: 1320 microversion: 2.26 time: 0.368859 Oct 26 13:19:33.405594 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2025/4063] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:33 2022] GET /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff => generated 1320 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:33.415647 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-f7884b9c-67ca-44e5-aa37-e17e4283de59 req-1fd293db-0b9a-4a64-adf7-e78cefa0ca15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5fa9733-f49b-43ab-8586-68d113b73476", "name": "network-vif-deleted", "tag": "dae3728e-b93b-4eed-a07b-aea0efaacfac"}, {"server_uuid": "b5fa9733-f49b-43ab-8586-68d113b73476", "name": "network-vif-deleted", "tag": "f2fe44e4-4b3a-4974-85cd-bdb8df938561"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:19:33.446090 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-f7884b9c-67ca-44e5-aa37-e17e4283de59 req-1fd293db-0b9a-4a64-adf7-e78cefa0ca15 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:33.446575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-f7884b9c-67ca-44e5-aa37-e17e4283de59 req-1fd293db-0b9a-4a64-adf7-e78cefa0ca15 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:33.447008 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-f7884b9c-67ca-44e5-aa37-e17e4283de59 req-1fd293db-0b9a-4a64-adf7-e78cefa0ca15 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:33.479059 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-f7884b9c-67ca-44e5-aa37-e17e4283de59 req-1fd293db-0b9a-4a64-adf7-e78cefa0ca15 service nova] Creating event network-vif-deleted:dae3728e-b93b-4eed-a07b-aea0efaacfac for instance b5fa9733-f49b-43ab-8586-68d113b73476 on n-h1-862686-1 Oct 26 13:19:33.479059 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-f7884b9c-67ca-44e5-aa37-e17e4283de59 req-1fd293db-0b9a-4a64-adf7-e78cefa0ca15 service nova] Creating event network-vif-deleted:f2fe44e4-4b3a-4974-85cd-bdb8df938561 for instance b5fa9733-f49b-43ab-8586-68d113b73476 on n-h1-862686-1 Oct 26 13:19:33.491118 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-f7884b9c-67ca-44e5-aa37-e17e4283de59 req-1fd293db-0b9a-4a64-adf7-e78cefa0ca15 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.091085 Oct 26 13:19:33.493676 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2026/4064] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:19:33.505604 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4f601e9c-4b98-441b-b76d-add886d440f3 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:33.506395 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4f601e9c-4b98-441b-b76d-add886d440f3 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:33.529280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-5a872abe-5ae0-4235-aea2-fb6453ccc2d9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:19:33.529753 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-5a872abe-5ae0-4235-aea2-fb6453ccc2d9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:19:33.530203 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-5a872abe-5ae0-4235-aea2-fb6453ccc2d9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:19:33.530614 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-5a872abe-5ae0-4235-aea2-fb6453ccc2d9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:19:33.531084 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-5a872abe-5ae0-4235-aea2-fb6453ccc2d9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:19:33.535681 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f601e9c-4b98-441b-b76d-add886d440f3 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:33.536187 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f601e9c-4b98-441b-b76d-add886d440f3 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:33.536628 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f601e9c-4b98-441b-b76d-add886d440f3 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:33.541119 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f601e9c-4b98-441b-b76d-add886d440f3 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:33.545563 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a872abe-5ae0-4235-aea2-fb6453ccc2d9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:33.546064 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a872abe-5ae0-4235-aea2-fb6453ccc2d9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:33.546669 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f601e9c-4b98-441b-b76d-add886d440f3 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:33.547196 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f601e9c-4b98-441b-b76d-add886d440f3 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:33.550168 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a872abe-5ae0-4235-aea2-fb6453ccc2d9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:33.551220 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a872abe-5ae0-4235-aea2-fb6453ccc2d9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:33.552270 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a872abe-5ae0-4235-aea2-fb6453ccc2d9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:33.552901 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a872abe-5ae0-4235-aea2-fb6453ccc2d9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:33.595853 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-5a872abe-5ae0-4235-aea2-fb6453ccc2d9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Getting quotas for project 9cdd45be745d4828b5a111472254156c. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:19:33.609159 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-5a872abe-5ae0-4235-aea2-fb6453ccc2d9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Getting quotas for user 363fc117da70484f9d8cf2040e8391e4 and project 9cdd45be745d4828b5a111472254156c. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:19:33.639457 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5a872abe-5ae0-4235-aea2-fb6453ccc2d9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:19:33.645713 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5a872abe-5ae0-4235-aea2-fb6453ccc2d9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 97825703-89d9-457a-b6c3-b694f8eee97c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:19:33.747089 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5a872abe-5ae0-4235-aea2-fb6453ccc2d9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.706642 Oct 26 13:19:33.753196 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2039/4065] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:19:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 1714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:19:33.759546 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-386e1f6b-7a68-431e-9ad2-a0a731ddfb4d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:33.766861 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-386e1f6b-7a68-431e-9ad2-a0a731ddfb4d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 42f50b1b-9531-43dd-bb5f-cbca3b7d306f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:33.776779 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-386e1f6b-7a68-431e-9ad2-a0a731ddfb4d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:33.779713 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-386e1f6b-7a68-431e-9ad2-a0a731ddfb4d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:33.780373 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-386e1f6b-7a68-431e-9ad2-a0a731ddfb4d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:33.783317 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-386e1f6b-7a68-431e-9ad2-a0a731ddfb4d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:33.783814 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-386e1f6b-7a68-431e-9ad2-a0a731ddfb4d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:33.784238 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-386e1f6b-7a68-431e-9ad2-a0a731ddfb4d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:33.868768 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4f601e9c-4b98-441b-b76d-add886d440f3 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:33.883875 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4f601e9c-4b98-441b-b76d-add886d440f3 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:33.885313 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4f601e9c-4b98-441b-b76d-add886d440f3 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:33.900058 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4f601e9c-4b98-441b-b76d-add886d440f3 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1539 microversion: 2.91 time: 0.404005 Oct 26 13:19:33.900654 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2027/4066] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:33 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1539 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:33.909705 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d4404632-15a4-46ba-9d8f-751c749fb51d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:33.921652 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d4404632-15a4-46ba-9d8f-751c749fb51d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 798f0deb-3412-479f-bf6b-d11872c9f680] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:33.935117 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d4404632-15a4-46ba-9d8f-751c749fb51d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:33.935836 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d4404632-15a4-46ba-9d8f-751c749fb51d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:33.937053 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d4404632-15a4-46ba-9d8f-751c749fb51d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:33.953405 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d4404632-15a4-46ba-9d8f-751c749fb51d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:33.953929 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d4404632-15a4-46ba-9d8f-751c749fb51d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:33.954369 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d4404632-15a4-46ba-9d8f-751c749fb51d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:34.089599 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d4404632-15a4-46ba-9d8f-751c749fb51d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:34.103545 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d4404632-15a4-46ba-9d8f-751c749fb51d tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680" status: 200 len: 1266 microversion: 2.1 time: 0.200683 Oct 26 13:19:34.105817 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2028/4067] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:33 2022] GET /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680 => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:34.119554 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-40a8d19b-9827-4a88-91e7-330d72e8170b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:34.121715 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-40a8d19b-9827-4a88-91e7-330d72e8170b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 97825703-89d9-457a-b6c3-b694f8eee97c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:34.190388 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-386e1f6b-7a68-431e-9ad2-a0a731ddfb4d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:34.204836 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-386e1f6b-7a68-431e-9ad2-a0a731ddfb4d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f" status: 200 len: 1367 microversion: 2.1 time: 0.450114 Oct 26 13:19:34.207878 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2040/4068] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:33 2022] GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f => generated 1367 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:34.223493 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-6e495fe2-cba6-46cc-84ea-30442986a549 req-91f14db9-37dd-4c24-9643-f242cbcf6877 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42f50b1b-9531-43dd-bb5f-cbca3b7d306f", "tag": "50a0dadf-b074-4b74-ba98-54c14d6828bb"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:19:34.242686 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-40a8d19b-9827-4a88-91e7-330d72e8170b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:34.251031 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-40a8d19b-9827-4a88-91e7-330d72e8170b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c" status: 200 len: 1221 microversion: 2.1 time: 0.144046 Oct 26 13:19:34.254214 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2029/4069] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:34 2022] GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c => generated 1221 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:34.265714 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-6e495fe2-cba6-46cc-84ea-30442986a549 req-91f14db9-37dd-4c24-9643-f242cbcf6877 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:34.266863 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-6e495fe2-cba6-46cc-84ea-30442986a549 req-91f14db9-37dd-4c24-9643-f242cbcf6877 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:34.267547 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-6e495fe2-cba6-46cc-84ea-30442986a549 req-91f14db9-37dd-4c24-9643-f242cbcf6877 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:34.269147 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7109b890-a96a-4fef-ac4d-e7a32abde013 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:34.269950 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7109b890-a96a-4fef-ac4d-e7a32abde013 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:34.282474 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7109b890-a96a-4fef-ac4d-e7a32abde013 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:34.283133 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7109b890-a96a-4fef-ac4d-e7a32abde013 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:34.283839 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7109b890-a96a-4fef-ac4d-e7a32abde013 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:34.284894 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7109b890-a96a-4fef-ac4d-e7a32abde013 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:34.288039 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7109b890-a96a-4fef-ac4d-e7a32abde013 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:34.289404 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7109b890-a96a-4fef-ac4d-e7a32abde013 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:34.299511 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-6e495fe2-cba6-46cc-84ea-30442986a549 req-91f14db9-37dd-4c24-9643-f242cbcf6877 service nova] Creating event network-changed:50a0dadf-b074-4b74-ba98-54c14d6828bb for instance 42f50b1b-9531-43dd-bb5f-cbca3b7d306f on n-h2-862686-1 Oct 26 13:19:34.314692 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-6e495fe2-cba6-46cc-84ea-30442986a549 req-91f14db9-37dd-4c24-9643-f242cbcf6877 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103517 Oct 26 13:19:34.317238 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2041/4070] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:19:34.364583 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cc400f04-38a6-43d9-8782-359f20a2346a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-422694007", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:19:34.510703 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-cc400f04-38a6-43d9-8782-359f20a2346a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] validate_networks() for [('8122bd35-175c-4158-bd9f-4d231f20a1e9', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:19:34.944580 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7109b890-a96a-4fef-ac4d-e7a32abde013 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:34.961559 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7109b890-a96a-4fef-ac4d-e7a32abde013 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:34.963822 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7109b890-a96a-4fef-ac4d-e7a32abde013 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:34.965332 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7109b890-a96a-4fef-ac4d-e7a32abde013 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1604 microversion: 2.42 time: 0.709862 Oct 26 13:19:34.980185 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2030/4071] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:34 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1604 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:35.002899 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ef5fa6b1-7201-4167-9d3c-9251da7cd0e8 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:35.004367 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ef5fa6b1-7201-4167-9d3c-9251da7cd0e8 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] [instance: d3605776-7db3-44b2-acdc-8023126131ff] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:35.018226 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ef5fa6b1-7201-4167-9d3c-9251da7cd0e8 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:35.024773 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ef5fa6b1-7201-4167-9d3c-9251da7cd0e8 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:35.025502 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ef5fa6b1-7201-4167-9d3c-9251da7cd0e8 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:35.026495 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ef5fa6b1-7201-4167-9d3c-9251da7cd0e8 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:35.027199 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ef5fa6b1-7201-4167-9d3c-9251da7cd0e8 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:35.027892 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ef5fa6b1-7201-4167-9d3c-9251da7cd0e8 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:35.270555 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ef5fa6b1-7201-4167-9d3c-9251da7cd0e8 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0d11e415d94d0b904eb901f421f6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69892d7a76e94fcfbe4b5541a022e220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:35.280484 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ef5fa6b1-7201-4167-9d3c-9251da7cd0e8 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db0d11e415d94d0b904eb901f421f6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69892d7a76e94fcfbe4b5541a022e220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:35.298874 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ef5fa6b1-7201-4167-9d3c-9251da7cd0e8 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db0d11e415d94d0b904eb901f421f6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69892d7a76e94fcfbe4b5541a022e220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:35.300473 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ef5fa6b1-7201-4167-9d3c-9251da7cd0e8 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] 10.222.0.40 "GET /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff" status: 200 len: 1362 microversion: 2.26 time: 0.319102 Oct 26 13:19:35.301644 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2031/4072] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:34 2022] GET /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff => generated 1362 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:35.308205 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2b3fd290-6804-422d-81da-8bbc283711a0 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:35.309130 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2b3fd290-6804-422d-81da-8bbc283711a0 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:35.320039 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b3fd290-6804-422d-81da-8bbc283711a0 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:35.321260 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b3fd290-6804-422d-81da-8bbc283711a0 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:35.322391 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b3fd290-6804-422d-81da-8bbc283711a0 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:35.323659 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b3fd290-6804-422d-81da-8bbc283711a0 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:35.324445 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b3fd290-6804-422d-81da-8bbc283711a0 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:35.325156 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b3fd290-6804-422d-81da-8bbc283711a0 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:35.445625 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2b3fd290-6804-422d-81da-8bbc283711a0 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:35.460791 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2b3fd290-6804-422d-81da-8bbc283711a0 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:35.466924 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2b3fd290-6804-422d-81da-8bbc283711a0 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:35.480285 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2b3fd290-6804-422d-81da-8bbc283711a0 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1539 microversion: 2.91 time: 0.176554 Oct 26 13:19:35.481437 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2032/4073] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:35 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1539 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:35.495569 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b1f58824-bdaa-4e2a-a39d-535bb78e7cc7 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:35.502165 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b1f58824-bdaa-4e2a-a39d-535bb78e7cc7 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 798f0deb-3412-479f-bf6b-d11872c9f680] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:35.513852 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b1f58824-bdaa-4e2a-a39d-535bb78e7cc7 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:35.514691 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b1f58824-bdaa-4e2a-a39d-535bb78e7cc7 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:35.515576 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b1f58824-bdaa-4e2a-a39d-535bb78e7cc7 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:35.516631 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b1f58824-bdaa-4e2a-a39d-535bb78e7cc7 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:35.517444 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b1f58824-bdaa-4e2a-a39d-535bb78e7cc7 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:35.517972 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b1f58824-bdaa-4e2a-a39d-535bb78e7cc7 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:35.593376 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b1f58824-bdaa-4e2a-a39d-535bb78e7cc7 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:35.602564 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b1f58824-bdaa-4e2a-a39d-535bb78e7cc7 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680" status: 200 len: 1272 microversion: 2.1 time: 0.119882 Oct 26 13:19:35.604117 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2033/4074] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:35 2022] GET /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680 => generated 1272 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:35.608984 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cb98ccdd-e3d2-46a6-86b7-3d964b3ce5d9 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:35.609836 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cb98ccdd-e3d2-46a6-86b7-3d964b3ce5d9 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 42f50b1b-9531-43dd-bb5f-cbca3b7d306f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:35.617246 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb98ccdd-e3d2-46a6-86b7-3d964b3ce5d9 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:35.617776 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb98ccdd-e3d2-46a6-86b7-3d964b3ce5d9 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:35.618218 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb98ccdd-e3d2-46a6-86b7-3d964b3ce5d9 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:35.618911 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb98ccdd-e3d2-46a6-86b7-3d964b3ce5d9 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:35.619388 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb98ccdd-e3d2-46a6-86b7-3d964b3ce5d9 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:35.619809 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb98ccdd-e3d2-46a6-86b7-3d964b3ce5d9 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:36.089758 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cb98ccdd-e3d2-46a6-86b7-3d964b3ce5d9 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:36.099913 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cb98ccdd-e3d2-46a6-86b7-3d964b3ce5d9 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f" status: 200 len: 1367 microversion: 2.1 time: 0.494408 Oct 26 13:19:36.106352 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2034/4075] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:35 2022] GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f => generated 1367 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:36.118376 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a0b45fd6-f19d-4c5e-b994-ff13f3df2f09 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:36.118994 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a0b45fd6-f19d-4c5e-b994-ff13f3df2f09 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:36.140035 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0b45fd6-f19d-4c5e-b994-ff13f3df2f09 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:36.140560 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0b45fd6-f19d-4c5e-b994-ff13f3df2f09 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:36.141013 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0b45fd6-f19d-4c5e-b994-ff13f3df2f09 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:36.142020 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0b45fd6-f19d-4c5e-b994-ff13f3df2f09 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:36.142650 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0b45fd6-f19d-4c5e-b994-ff13f3df2f09 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:36.143245 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0b45fd6-f19d-4c5e-b994-ff13f3df2f09 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:36.220820 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a0b45fd6-f19d-4c5e-b994-ff13f3df2f09 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:36.231843 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a0b45fd6-f19d-4c5e-b994-ff13f3df2f09 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:36.233271 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a0b45fd6-f19d-4c5e-b994-ff13f3df2f09 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:36.234819 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a0b45fd6-f19d-4c5e-b994-ff13f3df2f09 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1604 microversion: 2.42 time: 0.126883 Oct 26 13:19:36.235464 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2035/4076] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:36 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1604 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:36.333840 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8e09a709-f51e-467a-b03d-a182d9de613d tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:36.335098 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8e09a709-f51e-467a-b03d-a182d9de613d tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] [instance: d3605776-7db3-44b2-acdc-8023126131ff] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:36.346374 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8e09a709-f51e-467a-b03d-a182d9de613d tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:36.347285 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8e09a709-f51e-467a-b03d-a182d9de613d tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:36.347838 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8e09a709-f51e-467a-b03d-a182d9de613d tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:36.348661 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8e09a709-f51e-467a-b03d-a182d9de613d tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:36.349431 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8e09a709-f51e-467a-b03d-a182d9de613d tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:36.350044 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8e09a709-f51e-467a-b03d-a182d9de613d tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:36.529592 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-cc400f04-38a6-43d9-8782-359f20a2346a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:19:36.530691 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-cc400f04-38a6-43d9-8782-359f20a2346a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:19:36.531376 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-cc400f04-38a6-43d9-8782-359f20a2346a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:19:36.532103 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-cc400f04-38a6-43d9-8782-359f20a2346a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:19:36.532719 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-cc400f04-38a6-43d9-8782-359f20a2346a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:19:36.553537 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cc400f04-38a6-43d9-8782-359f20a2346a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:36.556308 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cc400f04-38a6-43d9-8782-359f20a2346a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:36.559110 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cc400f04-38a6-43d9-8782-359f20a2346a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:36.559357 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8e09a709-f51e-467a-b03d-a182d9de613d tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0d11e415d94d0b904eb901f421f6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69892d7a76e94fcfbe4b5541a022e220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:36.564077 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cc400f04-38a6-43d9-8782-359f20a2346a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:36.567673 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cc400f04-38a6-43d9-8782-359f20a2346a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:36.568376 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cc400f04-38a6-43d9-8782-359f20a2346a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:36.570769 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8e09a709-f51e-467a-b03d-a182d9de613d tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db0d11e415d94d0b904eb901f421f6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69892d7a76e94fcfbe4b5541a022e220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:36.572594 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8e09a709-f51e-467a-b03d-a182d9de613d tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db0d11e415d94d0b904eb901f421f6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69892d7a76e94fcfbe4b5541a022e220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:36.574599 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8e09a709-f51e-467a-b03d-a182d9de613d tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] 10.222.0.40 "GET /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff" status: 200 len: 1362 microversion: 2.26 time: 0.245651 Oct 26 13:19:36.575792 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2036/4077] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:36 2022] GET /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff => generated 1362 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:19:36.580878 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-093b57e3-c975-43ba-b9fd-2eab747ec5c5 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:36.581840 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-093b57e3-c975-43ba-b9fd-2eab747ec5c5 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:36.589096 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:19:36.597136 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-093b57e3-c975-43ba-b9fd-2eab747ec5c5 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:36.598430 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-093b57e3-c975-43ba-b9fd-2eab747ec5c5 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:36.599282 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-093b57e3-c975-43ba-b9fd-2eab747ec5c5 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:36.600363 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-093b57e3-c975-43ba-b9fd-2eab747ec5c5 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:36.601163 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-093b57e3-c975-43ba-b9fd-2eab747ec5c5 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:36.601920 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-093b57e3-c975-43ba-b9fd-2eab747ec5c5 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:36.635269 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-cc400f04-38a6-43d9-8782-359f20a2346a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Getting quotas for project 9cdd45be745d4828b5a111472254156c. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:19:36.650875 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-cc400f04-38a6-43d9-8782-359f20a2346a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Getting quotas for user 363fc117da70484f9d8cf2040e8391e4 and project 9cdd45be745d4828b5a111472254156c. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:19:36.683311 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cc400f04-38a6-43d9-8782-359f20a2346a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:19:36.688860 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cc400f04-38a6-43d9-8782-359f20a2346a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 53426b7d-0bba-46ce-ab7e-32451f413745] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:19:36.767331 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-093b57e3-c975-43ba-b9fd-2eab747ec5c5 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:36.783034 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-093b57e3-c975-43ba-b9fd-2eab747ec5c5 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:36.790370 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-093b57e3-c975-43ba-b9fd-2eab747ec5c5 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:36.802737 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-093b57e3-c975-43ba-b9fd-2eab747ec5c5 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1539 microversion: 2.91 time: 0.225518 Oct 26 13:19:36.821993 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2037/4078] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:36 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1539 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:36.832690 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cc400f04-38a6-43d9-8782-359f20a2346a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.486222 Oct 26 13:19:36.833352 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2042/4079] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:19:34 2022] POST /compute/v2.1/servers => generated 383 bytes in 2489 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 26 13:19:36.841501 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6ce65cb4-89fa-4cab-94e0-18ca6ac09f44 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:36.844916 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6ce65cb4-89fa-4cab-94e0-18ca6ac09f44 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 798f0deb-3412-479f-bf6b-d11872c9f680] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:36.854597 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-61f836f1-e905-4d83-807d-e7bf06aa46ed tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:36.855663 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-61f836f1-e905-4d83-807d-e7bf06aa46ed tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 53426b7d-0bba-46ce-ab7e-32451f413745] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:36.889955 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ce65cb4-89fa-4cab-94e0-18ca6ac09f44 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:36.891687 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ce65cb4-89fa-4cab-94e0-18ca6ac09f44 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:36.893956 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ce65cb4-89fa-4cab-94e0-18ca6ac09f44 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:36.895025 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ce65cb4-89fa-4cab-94e0-18ca6ac09f44 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:36.896240 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ce65cb4-89fa-4cab-94e0-18ca6ac09f44 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:36.900601 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ce65cb4-89fa-4cab-94e0-18ca6ac09f44 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:36.994610 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-61f836f1-e905-4d83-807d-e7bf06aa46ed tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:37.009553 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-61f836f1-e905-4d83-807d-e7bf06aa46ed tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745" status: 200 len: 1221 microversion: 2.1 time: 0.168263 Oct 26 13:19:37.024204 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2043/4080] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:36 2022] GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745 => generated 1221 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:37.065514 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6ce65cb4-89fa-4cab-94e0-18ca6ac09f44 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:37.073598 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6ce65cb4-89fa-4cab-94e0-18ca6ac09f44 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680" status: 200 len: 1272 microversion: 2.1 time: 0.247939 Oct 26 13:19:37.074281 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2038/4081] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:36 2022] GET /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680 => generated 1272 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:37.234172 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b1e652e6-58c2-47c4-961f-c421b3e05423 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:37.235154 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b1e652e6-58c2-47c4-961f-c421b3e05423 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 42f50b1b-9531-43dd-bb5f-cbca3b7d306f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:37.256546 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1e652e6-58c2-47c4-961f-c421b3e05423 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:37.257530 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1e652e6-58c2-47c4-961f-c421b3e05423 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:37.258879 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1e652e6-58c2-47c4-961f-c421b3e05423 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:37.262456 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1e652e6-58c2-47c4-961f-c421b3e05423 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:37.264664 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1e652e6-58c2-47c4-961f-c421b3e05423 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:37.264924 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-12311c00-140a-4128-86d2-153fbeba4b85 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:37.265570 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-12311c00-140a-4128-86d2-153fbeba4b85 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:37.267243 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1e652e6-58c2-47c4-961f-c421b3e05423 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:37.273623 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-12311c00-140a-4128-86d2-153fbeba4b85 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:37.281713 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-12311c00-140a-4128-86d2-153fbeba4b85 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:37.282632 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-12311c00-140a-4128-86d2-153fbeba4b85 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:37.283770 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-12311c00-140a-4128-86d2-153fbeba4b85 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:37.290527 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:19:37.293144 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-12311c00-140a-4128-86d2-153fbeba4b85 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:37.293851 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-12311c00-140a-4128-86d2-153fbeba4b85 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:37.544956 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-12311c00-140a-4128-86d2-153fbeba4b85 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:37.564063 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-12311c00-140a-4128-86d2-153fbeba4b85 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:37.571358 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-12311c00-140a-4128-86d2-153fbeba4b85 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:37.579480 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-12311c00-140a-4128-86d2-153fbeba4b85 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1604 microversion: 2.42 time: 0.314283 Oct 26 13:19:37.581057 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2039/4082] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:37 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1604 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:37.605193 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cb0dc1c2-2603-45c8-8beb-065f860423d3 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:37.606116 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cb0dc1c2-2603-45c8-8beb-065f860423d3 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] [instance: d3605776-7db3-44b2-acdc-8023126131ff] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:37.615071 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb0dc1c2-2603-45c8-8beb-065f860423d3 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:37.615821 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb0dc1c2-2603-45c8-8beb-065f860423d3 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:37.616555 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb0dc1c2-2603-45c8-8beb-065f860423d3 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:37.617599 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb0dc1c2-2603-45c8-8beb-065f860423d3 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:37.618344 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb0dc1c2-2603-45c8-8beb-065f860423d3 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:37.618988 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb0dc1c2-2603-45c8-8beb-065f860423d3 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:37.625640 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:19:37.640705 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b1e652e6-58c2-47c4-961f-c421b3e05423 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:37.650228 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b1e652e6-58c2-47c4-961f-c421b3e05423 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f" status: 200 len: 1367 microversion: 2.1 time: 0.530227 Oct 26 13:19:37.662190 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2044/4083] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:37 2022] GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f => generated 1367 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:37.837505 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-375e6532-f116-4323-b826-c66215daa3f5 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:37.838459 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-375e6532-f116-4323-b826-c66215daa3f5 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:37.851211 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-375e6532-f116-4323-b826-c66215daa3f5 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:37.852320 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-375e6532-f116-4323-b826-c66215daa3f5 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:37.853037 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-375e6532-f116-4323-b826-c66215daa3f5 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:37.853981 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-375e6532-f116-4323-b826-c66215daa3f5 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:37.864831 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-375e6532-f116-4323-b826-c66215daa3f5 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:37.868908 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-375e6532-f116-4323-b826-c66215daa3f5 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:38.028695 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-375e6532-f116-4323-b826-c66215daa3f5 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:38.079862 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-375e6532-f116-4323-b826-c66215daa3f5 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:38.086568 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-375e6532-f116-4323-b826-c66215daa3f5 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:38.110870 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-375e6532-f116-4323-b826-c66215daa3f5 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1539 microversion: 2.91 time: 0.278218 Oct 26 13:19:38.130519 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2045/4084] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:37 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1539 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:38.156247 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2cf257d0-b70c-4648-a30a-b6f565983381 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:38.156873 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2cf257d0-b70c-4648-a30a-b6f565983381 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 53426b7d-0bba-46ce-ab7e-32451f413745] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:38.178567 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2cf257d0-b70c-4648-a30a-b6f565983381 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:38.180098 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2cf257d0-b70c-4648-a30a-b6f565983381 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:38.183768 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2cf257d0-b70c-4648-a30a-b6f565983381 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:38.185906 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2cf257d0-b70c-4648-a30a-b6f565983381 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:38.186595 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2cf257d0-b70c-4648-a30a-b6f565983381 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:38.188466 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2cf257d0-b70c-4648-a30a-b6f565983381 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:38.188609 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cb0dc1c2-2603-45c8-8beb-065f860423d3 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0d11e415d94d0b904eb901f421f6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69892d7a76e94fcfbe4b5541a022e220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:38.216266 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cb0dc1c2-2603-45c8-8beb-065f860423d3 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db0d11e415d94d0b904eb901f421f6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69892d7a76e94fcfbe4b5541a022e220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:38.231695 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cb0dc1c2-2603-45c8-8beb-065f860423d3 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db0d11e415d94d0b904eb901f421f6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69892d7a76e94fcfbe4b5541a022e220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:38.232976 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cb0dc1c2-2603-45c8-8beb-065f860423d3 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] 10.222.0.40 "GET /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff" status: 200 len: 1362 microversion: 2.26 time: 0.633931 Oct 26 13:19:38.238330 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2040/4085] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:37 2022] GET /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff => generated 1362 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:38.246003 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-90edaa7d-dbd8-4d3f-98dd-0fb21d07a48b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:38.266678 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-90edaa7d-dbd8-4d3f-98dd-0fb21d07a48b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 798f0deb-3412-479f-bf6b-d11872c9f680] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:38.280695 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90edaa7d-dbd8-4d3f-98dd-0fb21d07a48b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:38.281199 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90edaa7d-dbd8-4d3f-98dd-0fb21d07a48b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:38.286850 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90edaa7d-dbd8-4d3f-98dd-0fb21d07a48b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:38.287840 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90edaa7d-dbd8-4d3f-98dd-0fb21d07a48b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:38.288581 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90edaa7d-dbd8-4d3f-98dd-0fb21d07a48b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:38.289189 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90edaa7d-dbd8-4d3f-98dd-0fb21d07a48b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:38.338338 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2cf257d0-b70c-4648-a30a-b6f565983381 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:38.349522 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2cf257d0-b70c-4648-a30a-b6f565983381 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745" status: 200 len: 1217 microversion: 2.1 time: 0.217012 Oct 26 13:19:38.353738 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2046/4086] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:38 2022] GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745 => generated 1217 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:38.358716 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-0cbe3326-a225-4a4b-a66c-eaa39d76de51 req-c37f0525-3f38-46c7-b1bb-e4babb9e6a58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3605776-7db3-44b2-acdc-8023126131ff", "tag": "f5641673-c057-4ee7-8f80-b811c5d64916"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:19:38.380225 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-0cbe3326-a225-4a4b-a66c-eaa39d76de51 req-c37f0525-3f38-46c7-b1bb-e4babb9e6a58 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:38.380925 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-0cbe3326-a225-4a4b-a66c-eaa39d76de51 req-c37f0525-3f38-46c7-b1bb-e4babb9e6a58 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:38.381525 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-0cbe3326-a225-4a4b-a66c-eaa39d76de51 req-c37f0525-3f38-46c7-b1bb-e4babb9e6a58 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:38.397119 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-0cbe3326-a225-4a4b-a66c-eaa39d76de51 req-c37f0525-3f38-46c7-b1bb-e4babb9e6a58 service nova] Creating event network-changed:f5641673-c057-4ee7-8f80-b811c5d64916 for instance d3605776-7db3-44b2-acdc-8023126131ff on n-h1-862686-1 Oct 26 13:19:38.410616 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-0cbe3326-a225-4a4b-a66c-eaa39d76de51 req-c37f0525-3f38-46c7-b1bb-e4babb9e6a58 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055463 Oct 26 13:19:38.414086 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2047/4087] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:19:38.616215 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fd3b20fb-ceea-4748-b4a6-89fb3cec7d6f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:38.617037 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fd3b20fb-ceea-4748-b4a6-89fb3cec7d6f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:38.626916 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd3b20fb-ceea-4748-b4a6-89fb3cec7d6f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:38.627738 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd3b20fb-ceea-4748-b4a6-89fb3cec7d6f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:38.628529 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd3b20fb-ceea-4748-b4a6-89fb3cec7d6f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:38.629537 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd3b20fb-ceea-4748-b4a6-89fb3cec7d6f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:38.630222 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd3b20fb-ceea-4748-b4a6-89fb3cec7d6f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:38.630878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd3b20fb-ceea-4748-b4a6-89fb3cec7d6f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:38.700295 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-90edaa7d-dbd8-4d3f-98dd-0fb21d07a48b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:38.712481 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-90edaa7d-dbd8-4d3f-98dd-0fb21d07a48b tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680" status: 200 len: 1314 microversion: 2.1 time: 0.472531 Oct 26 13:19:38.713325 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2041/4088] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:38 2022] GET /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680 => generated 1314 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:38.734315 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c374858b-7156-4760-b86d-56130d8d7937 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:38.735314 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c374858b-7156-4760-b86d-56130d8d7937 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 42f50b1b-9531-43dd-bb5f-cbca3b7d306f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:38.743362 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c374858b-7156-4760-b86d-56130d8d7937 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:38.744531 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c374858b-7156-4760-b86d-56130d8d7937 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:38.745155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c374858b-7156-4760-b86d-56130d8d7937 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:38.746081 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c374858b-7156-4760-b86d-56130d8d7937 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:38.746760 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c374858b-7156-4760-b86d-56130d8d7937 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:38.747530 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c374858b-7156-4760-b86d-56130d8d7937 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:38.801048 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fd3b20fb-ceea-4748-b4a6-89fb3cec7d6f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:38.828827 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fd3b20fb-ceea-4748-b4a6-89fb3cec7d6f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:38.830766 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fd3b20fb-ceea-4748-b4a6-89fb3cec7d6f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:38.833781 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fd3b20fb-ceea-4748-b4a6-89fb3cec7d6f tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1604 microversion: 2.42 time: 0.227447 Oct 26 13:19:38.839995 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2048/4089] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:38 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1604 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:19:39.088233 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c374858b-7156-4760-b86d-56130d8d7937 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:39.135005 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c374858b-7156-4760-b86d-56130d8d7937 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f" status: 200 len: 1367 microversion: 2.1 time: 0.402765 Oct 26 13:19:39.140407 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2042/4090] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:38 2022] GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f => generated 1367 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:39.149323 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-295f4067-8d8f-4c7d-8375-24f1c684e8ed tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:39.150204 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-295f4067-8d8f-4c7d-8375-24f1c684e8ed tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:39.158213 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-295f4067-8d8f-4c7d-8375-24f1c684e8ed tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:39.158843 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-295f4067-8d8f-4c7d-8375-24f1c684e8ed tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:39.159302 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-295f4067-8d8f-4c7d-8375-24f1c684e8ed tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:39.160084 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-295f4067-8d8f-4c7d-8375-24f1c684e8ed tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:39.160611 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-295f4067-8d8f-4c7d-8375-24f1c684e8ed tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:39.161177 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-295f4067-8d8f-4c7d-8375-24f1c684e8ed tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:39.266598 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-09f91062-81ce-41f2-bc06-61a685fdd228 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:39.267412 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-09f91062-81ce-41f2-bc06-61a685fdd228 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] [instance: d3605776-7db3-44b2-acdc-8023126131ff] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:39.278495 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-295f4067-8d8f-4c7d-8375-24f1c684e8ed tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:39.283933 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09f91062-81ce-41f2-bc06-61a685fdd228 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:39.284476 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09f91062-81ce-41f2-bc06-61a685fdd228 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:39.284925 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09f91062-81ce-41f2-bc06-61a685fdd228 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:39.288061 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09f91062-81ce-41f2-bc06-61a685fdd228 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:39.289920 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09f91062-81ce-41f2-bc06-61a685fdd228 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:39.292590 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09f91062-81ce-41f2-bc06-61a685fdd228 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:39.293321 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-295f4067-8d8f-4c7d-8375-24f1c684e8ed tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:39.295086 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-295f4067-8d8f-4c7d-8375-24f1c684e8ed tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:39.311732 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-295f4067-8d8f-4c7d-8375-24f1c684e8ed tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1539 microversion: 2.91 time: 0.166939 Oct 26 13:19:39.313102 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2049/4091] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:39 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1539 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:39.379924 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b3183924-cedd-4b41-8bdf-5d9e009374c6 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:39.380828 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b3183924-cedd-4b41-8bdf-5d9e009374c6 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 53426b7d-0bba-46ce-ab7e-32451f413745] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:39.398057 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3183924-cedd-4b41-8bdf-5d9e009374c6 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:39.398818 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3183924-cedd-4b41-8bdf-5d9e009374c6 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:39.399447 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3183924-cedd-4b41-8bdf-5d9e009374c6 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:39.400371 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3183924-cedd-4b41-8bdf-5d9e009374c6 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:39.401006 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3183924-cedd-4b41-8bdf-5d9e009374c6 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:39.401643 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3183924-cedd-4b41-8bdf-5d9e009374c6 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:39.677461 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b3183924-cedd-4b41-8bdf-5d9e009374c6 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:39.688791 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b3183924-cedd-4b41-8bdf-5d9e009374c6 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745" status: 200 len: 1273 microversion: 2.1 time: 0.312670 Oct 26 13:19:39.689386 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2050/4092] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:39 2022] GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745 => generated 1273 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:19:39.712786 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-4cc1e599-3791-48eb-8197-e80bc5771001 req-18c49463-0715-49ad-a4b8-8cf74c1afda9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42f50b1b-9531-43dd-bb5f-cbca3b7d306f", "name": "network-vif-plugged", "status": "completed", "tag": "50a0dadf-b074-4b74-ba98-54c14d6828bb"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:19:39.729890 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-4cc1e599-3791-48eb-8197-e80bc5771001 req-18c49463-0715-49ad-a4b8-8cf74c1afda9 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:39.730502 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-4cc1e599-3791-48eb-8197-e80bc5771001 req-18c49463-0715-49ad-a4b8-8cf74c1afda9 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:39.731107 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-4cc1e599-3791-48eb-8197-e80bc5771001 req-18c49463-0715-49ad-a4b8-8cf74c1afda9 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:39.748730 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-4cc1e599-3791-48eb-8197-e80bc5771001 req-18c49463-0715-49ad-a4b8-8cf74c1afda9 service nova] Creating event network-vif-plugged:50a0dadf-b074-4b74-ba98-54c14d6828bb for instance 42f50b1b-9531-43dd-bb5f-cbca3b7d306f on n-h2-862686-1 Oct 26 13:19:39.754994 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-4cc1e599-3791-48eb-8197-e80bc5771001 req-18c49463-0715-49ad-a4b8-8cf74c1afda9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062176 Oct 26 13:19:39.758610 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2051/4093] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:19:39.769032 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-838aa63e-33ee-4127-a07e-612e313aefe2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:39.769236 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-09f91062-81ce-41f2-bc06-61a685fdd228 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0d11e415d94d0b904eb901f421f6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69892d7a76e94fcfbe4b5541a022e220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:39.770668 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-838aa63e-33ee-4127-a07e-612e313aefe2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 798f0deb-3412-479f-bf6b-d11872c9f680] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:39.780850 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-838aa63e-33ee-4127-a07e-612e313aefe2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:39.781948 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-838aa63e-33ee-4127-a07e-612e313aefe2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:39.783358 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-838aa63e-33ee-4127-a07e-612e313aefe2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:39.784450 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-838aa63e-33ee-4127-a07e-612e313aefe2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:39.785097 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-838aa63e-33ee-4127-a07e-612e313aefe2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:39.785826 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-838aa63e-33ee-4127-a07e-612e313aefe2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:39.790153 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-09f91062-81ce-41f2-bc06-61a685fdd228 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db0d11e415d94d0b904eb901f421f6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69892d7a76e94fcfbe4b5541a022e220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:39.791678 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-09f91062-81ce-41f2-bc06-61a685fdd228 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db0d11e415d94d0b904eb901f421f6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69892d7a76e94fcfbe4b5541a022e220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:39.792875 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-09f91062-81ce-41f2-bc06-61a685fdd228 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] 10.222.0.40 "GET /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff" status: 200 len: 1362 microversion: 2.26 time: 0.531550 Oct 26 13:19:39.796372 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2043/4094] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:39 2022] GET /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff => generated 1362 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:19:39.868623 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dcd37600-1736-4bba-a712-31703471a7a2 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:39.869527 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-dcd37600-1736-4bba-a712-31703471a7a2 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:39.881110 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dcd37600-1736-4bba-a712-31703471a7a2 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:39.881782 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dcd37600-1736-4bba-a712-31703471a7a2 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:39.882425 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dcd37600-1736-4bba-a712-31703471a7a2 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:39.883348 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dcd37600-1736-4bba-a712-31703471a7a2 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:39.884001 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dcd37600-1736-4bba-a712-31703471a7a2 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:39.884605 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dcd37600-1736-4bba-a712-31703471a7a2 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:40.030184 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-dcd37600-1736-4bba-a712-31703471a7a2 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:40.050738 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-dcd37600-1736-4bba-a712-31703471a7a2 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:40.055083 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-dcd37600-1736-4bba-a712-31703471a7a2 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:40.057833 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-dcd37600-1736-4bba-a712-31703471a7a2 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1604 microversion: 2.42 time: 0.193305 Oct 26 13:19:40.072985 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2044/4095] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:39 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1604 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:40.090919 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-838aa63e-33ee-4127-a07e-612e313aefe2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:40.100809 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-838aa63e-33ee-4127-a07e-612e313aefe2 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680" status: 200 len: 1314 microversion: 2.1 time: 0.336357 Oct 26 13:19:40.101879 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2052/4096] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:39 2022] GET /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680 => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:40.161938 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7778131a-9b54-45b0-8565-cb87b1788f61 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:40.163540 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7778131a-9b54-45b0-8565-cb87b1788f61 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 42f50b1b-9531-43dd-bb5f-cbca3b7d306f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:40.170306 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7778131a-9b54-45b0-8565-cb87b1788f61 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:40.170912 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7778131a-9b54-45b0-8565-cb87b1788f61 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:40.171426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7778131a-9b54-45b0-8565-cb87b1788f61 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:40.172215 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7778131a-9b54-45b0-8565-cb87b1788f61 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:40.172734 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7778131a-9b54-45b0-8565-cb87b1788f61 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:40.173657 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7778131a-9b54-45b0-8565-cb87b1788f61 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:40.346916 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ba9be531-b146-49a7-ac0e-f55505614e13 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:40.347528 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ba9be531-b146-49a7-ac0e-f55505614e13 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:40.354231 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ba9be531-b146-49a7-ac0e-f55505614e13 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:40.354719 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ba9be531-b146-49a7-ac0e-f55505614e13 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:40.355162 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ba9be531-b146-49a7-ac0e-f55505614e13 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:40.355861 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ba9be531-b146-49a7-ac0e-f55505614e13 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:40.356326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ba9be531-b146-49a7-ac0e-f55505614e13 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:40.356755 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ba9be531-b146-49a7-ac0e-f55505614e13 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:40.398671 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7778131a-9b54-45b0-8565-cb87b1788f61 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:40.407294 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7778131a-9b54-45b0-8565-cb87b1788f61 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f" status: 200 len: 1367 microversion: 2.1 time: 0.250024 Oct 26 13:19:40.408001 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2045/4097] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:40 2022] GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f => generated 1367 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:40.433089 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ba9be531-b146-49a7-ac0e-f55505614e13 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:40.442365 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ba9be531-b146-49a7-ac0e-f55505614e13 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:40.444226 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ba9be531-b146-49a7-ac0e-f55505614e13 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:40.447767 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-bce3463a-61de-400a-89ba-4cbc33dfb07e req-9466e66e-40d0-4326-ae59-a958338ba180 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "798f0deb-3412-479f-bf6b-d11872c9f680", "tag": "d3460729-599e-482a-a95d-fb9175204857"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:19:40.449083 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ba9be531-b146-49a7-ac0e-f55505614e13 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1560 microversion: 2.91 time: 0.106071 Oct 26 13:19:40.461684 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2053/4098] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:40 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1560 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:19:40.462466 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-bce3463a-61de-400a-89ba-4cbc33dfb07e req-9466e66e-40d0-4326-ae59-a958338ba180 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:40.462466 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-bce3463a-61de-400a-89ba-4cbc33dfb07e req-9466e66e-40d0-4326-ae59-a958338ba180 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:40.462466 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-bce3463a-61de-400a-89ba-4cbc33dfb07e req-9466e66e-40d0-4326-ae59-a958338ba180 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:40.472425 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-bce3463a-61de-400a-89ba-4cbc33dfb07e req-9466e66e-40d0-4326-ae59-a958338ba180 service nova] Creating event network-changed:d3460729-599e-482a-a95d-fb9175204857 for instance 798f0deb-3412-479f-bf6b-d11872c9f680 on n-h1-862686-1 Oct 26 13:19:40.478187 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-bce3463a-61de-400a-89ba-4cbc33dfb07e req-9466e66e-40d0-4326-ae59-a958338ba180 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034423 Oct 26 13:19:40.478839 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2046/4099] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:19:40.545375 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-ea3fe8ed-52c1-4b3a-97c9-799c5fb50744 req-5326e91f-b959-482c-85bd-1a716cac5716 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97825703-89d9-457a-b6c3-b694f8eee97c", "tag": "8e2f2c44-360b-45b6-aa25-4848c446d113"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:19:40.555536 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ea3fe8ed-52c1-4b3a-97c9-799c5fb50744 req-5326e91f-b959-482c-85bd-1a716cac5716 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:40.556025 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ea3fe8ed-52c1-4b3a-97c9-799c5fb50744 req-5326e91f-b959-482c-85bd-1a716cac5716 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:40.556472 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ea3fe8ed-52c1-4b3a-97c9-799c5fb50744 req-5326e91f-b959-482c-85bd-1a716cac5716 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:40.567867 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-ea3fe8ed-52c1-4b3a-97c9-799c5fb50744 req-5326e91f-b959-482c-85bd-1a716cac5716 service nova] Creating event network-changed:8e2f2c44-360b-45b6-aa25-4848c446d113 for instance 97825703-89d9-457a-b6c3-b694f8eee97c on n-h2-862686-1 Oct 26 13:19:40.573289 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-ea3fe8ed-52c1-4b3a-97c9-799c5fb50744 req-5326e91f-b959-482c-85bd-1a716cac5716 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032012 Oct 26 13:19:40.574098 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2054/4100] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:19:40.716788 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-57199de9-c21e-4049-9727-a7c4abb28ccc tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:40.717500 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-57199de9-c21e-4049-9727-a7c4abb28ccc tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 53426b7d-0bba-46ce-ab7e-32451f413745] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:40.724160 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57199de9-c21e-4049-9727-a7c4abb28ccc tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:40.724645 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57199de9-c21e-4049-9727-a7c4abb28ccc tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:40.725242 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57199de9-c21e-4049-9727-a7c4abb28ccc tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:40.725967 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57199de9-c21e-4049-9727-a7c4abb28ccc tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:40.726426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57199de9-c21e-4049-9727-a7c4abb28ccc tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:40.726857 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57199de9-c21e-4049-9727-a7c4abb28ccc tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:40.790360 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-57199de9-c21e-4049-9727-a7c4abb28ccc tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:40.798077 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-57199de9-c21e-4049-9727-a7c4abb28ccc tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745" status: 200 len: 1279 microversion: 2.1 time: 0.085513 Oct 26 13:19:40.798652 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2047/4101] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:40 2022] GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745 => generated 1279 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:40.824274 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-267b8ac2-6e48-4d39-beed-f3a17a9127eb tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:40.824977 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-267b8ac2-6e48-4d39-beed-f3a17a9127eb tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] [instance: d3605776-7db3-44b2-acdc-8023126131ff] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:40.831131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-267b8ac2-6e48-4d39-beed-f3a17a9127eb tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:40.831622 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-267b8ac2-6e48-4d39-beed-f3a17a9127eb tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:40.832060 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-267b8ac2-6e48-4d39-beed-f3a17a9127eb tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:40.832777 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-267b8ac2-6e48-4d39-beed-f3a17a9127eb tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:40.833235 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-267b8ac2-6e48-4d39-beed-f3a17a9127eb tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:40.833821 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-267b8ac2-6e48-4d39-beed-f3a17a9127eb tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:41.090521 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-84627b0a-153e-447e-af65-18fd1376b21e tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:41.091629 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-84627b0a-153e-447e-af65-18fd1376b21e tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:41.100692 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-84627b0a-153e-447e-af65-18fd1376b21e tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:41.101773 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-84627b0a-153e-447e-af65-18fd1376b21e tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:41.102443 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-84627b0a-153e-447e-af65-18fd1376b21e tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:41.103411 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-84627b0a-153e-447e-af65-18fd1376b21e tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:41.104104 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-84627b0a-153e-447e-af65-18fd1376b21e tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:41.104930 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-84627b0a-153e-447e-af65-18fd1376b21e tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:41.112278 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-267b8ac2-6e48-4d39-beed-f3a17a9127eb tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0d11e415d94d0b904eb901f421f6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69892d7a76e94fcfbe4b5541a022e220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:41.134385 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-267b8ac2-6e48-4d39-beed-f3a17a9127eb tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db0d11e415d94d0b904eb901f421f6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69892d7a76e94fcfbe4b5541a022e220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:41.136092 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-267b8ac2-6e48-4d39-beed-f3a17a9127eb tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db0d11e415d94d0b904eb901f421f6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69892d7a76e94fcfbe4b5541a022e220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:41.137300 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-267b8ac2-6e48-4d39-beed-f3a17a9127eb tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] 10.222.0.40 "GET /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff" status: 200 len: 1362 microversion: 2.26 time: 0.318719 Oct 26 13:19:41.137970 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2055/4102] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:40 2022] GET /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff => generated 1362 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:41.142626 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0ceb0ef6-9302-4a81-b945-c31abdd4ddf7 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:41.143248 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0ceb0ef6-9302-4a81-b945-c31abdd4ddf7 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 798f0deb-3412-479f-bf6b-d11872c9f680] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:41.156746 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ceb0ef6-9302-4a81-b945-c31abdd4ddf7 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:41.157251 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ceb0ef6-9302-4a81-b945-c31abdd4ddf7 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:41.157728 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ceb0ef6-9302-4a81-b945-c31abdd4ddf7 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:41.158480 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ceb0ef6-9302-4a81-b945-c31abdd4ddf7 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:41.158945 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ceb0ef6-9302-4a81-b945-c31abdd4ddf7 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:41.159378 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ceb0ef6-9302-4a81-b945-c31abdd4ddf7 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:41.303990 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-84627b0a-153e-447e-af65-18fd1376b21e tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:41.331334 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-84627b0a-153e-447e-af65-18fd1376b21e tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:41.332789 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-84627b0a-153e-447e-af65-18fd1376b21e tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:41.334034 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-84627b0a-153e-447e-af65-18fd1376b21e tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1604 microversion: 2.42 time: 0.249980 Oct 26 13:19:41.345240 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2048/4103] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:41 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1604 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:19:41.430994 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c28dd25f-4c05-40cd-b33c-61717195d19f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:41.432009 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c28dd25f-4c05-40cd-b33c-61717195d19f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 42f50b1b-9531-43dd-bb5f-cbca3b7d306f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:41.441126 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c28dd25f-4c05-40cd-b33c-61717195d19f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:41.441968 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c28dd25f-4c05-40cd-b33c-61717195d19f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:41.446029 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c28dd25f-4c05-40cd-b33c-61717195d19f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:41.447038 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c28dd25f-4c05-40cd-b33c-61717195d19f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:41.447873 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c28dd25f-4c05-40cd-b33c-61717195d19f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:41.448533 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c28dd25f-4c05-40cd-b33c-61717195d19f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:41.481162 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0ceb0ef6-9302-4a81-b945-c31abdd4ddf7 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:41.492391 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0ceb0ef6-9302-4a81-b945-c31abdd4ddf7 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680" status: 200 len: 1314 microversion: 2.1 time: 0.353351 Oct 26 13:19:41.493587 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2056/4104] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:41 2022] GET /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680 => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:41.499025 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0fcc2389-4b79-491d-8cb4-757151a1ff4a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:41.499649 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0fcc2389-4b79-491d-8cb4-757151a1ff4a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:41.508646 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0fcc2389-4b79-491d-8cb4-757151a1ff4a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:41.509167 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0fcc2389-4b79-491d-8cb4-757151a1ff4a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:41.509649 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0fcc2389-4b79-491d-8cb4-757151a1ff4a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:41.510438 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0fcc2389-4b79-491d-8cb4-757151a1ff4a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:41.510911 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0fcc2389-4b79-491d-8cb4-757151a1ff4a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:41.511349 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0fcc2389-4b79-491d-8cb4-757151a1ff4a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:41.681305 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0fcc2389-4b79-491d-8cb4-757151a1ff4a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:41.691598 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0fcc2389-4b79-491d-8cb4-757151a1ff4a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:41.694447 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0fcc2389-4b79-491d-8cb4-757151a1ff4a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:41.701840 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0fcc2389-4b79-491d-8cb4-757151a1ff4a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1560 microversion: 2.91 time: 0.206834 Oct 26 13:19:41.714611 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2057/4105] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:41 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1560 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:41.822432 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1460d0da-96cd-40e3-ab0f-018844635507 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:41.823329 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1460d0da-96cd-40e3-ab0f-018844635507 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 53426b7d-0bba-46ce-ab7e-32451f413745] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:41.832691 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1460d0da-96cd-40e3-ab0f-018844635507 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:41.833465 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1460d0da-96cd-40e3-ab0f-018844635507 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:41.834314 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1460d0da-96cd-40e3-ab0f-018844635507 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:41.835432 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1460d0da-96cd-40e3-ab0f-018844635507 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:41.836097 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1460d0da-96cd-40e3-ab0f-018844635507 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:41.836703 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1460d0da-96cd-40e3-ab0f-018844635507 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:41.890900 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=4 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:19:41.898455 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c28dd25f-4c05-40cd-b33c-61717195d19f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:41.919817 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c28dd25f-4c05-40cd-b33c-61717195d19f tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f" status: 200 len: 1557 microversion: 2.1 time: 0.492604 Oct 26 13:19:41.939428 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2049/4106] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:41 2022] GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f => generated 1557 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:41.945882 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-05077ed7-1a1c-4ff6-8a2b-e03476f02cd9 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:41.946643 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-05077ed7-1a1c-4ff6-8a2b-e03476f02cd9 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 42f50b1b-9531-43dd-bb5f-cbca3b7d306f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:41.953868 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05077ed7-1a1c-4ff6-8a2b-e03476f02cd9 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:41.954806 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05077ed7-1a1c-4ff6-8a2b-e03476f02cd9 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:41.955423 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05077ed7-1a1c-4ff6-8a2b-e03476f02cd9 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:41.956512 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05077ed7-1a1c-4ff6-8a2b-e03476f02cd9 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:41.957149 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05077ed7-1a1c-4ff6-8a2b-e03476f02cd9 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:41.957779 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05077ed7-1a1c-4ff6-8a2b-e03476f02cd9 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:42.093197 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-05077ed7-1a1c-4ff6-8a2b-e03476f02cd9 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.151852 Oct 26 13:19:42.093823 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2050/4107] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 26 13:19:41 2022] GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f/os-interface => generated 284 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:19:42.171006 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1a791f04-a1c2-4e34-b59f-618849f68931 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:42.171889 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1a791f04-a1c2-4e34-b59f-618849f68931 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] [instance: d3605776-7db3-44b2-acdc-8023126131ff] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:42.185229 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a791f04-a1c2-4e34-b59f-618849f68931 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:42.188093 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a791f04-a1c2-4e34-b59f-618849f68931 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:42.189132 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a791f04-a1c2-4e34-b59f-618849f68931 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:42.190937 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a791f04-a1c2-4e34-b59f-618849f68931 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:42.192831 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a791f04-a1c2-4e34-b59f-618849f68931 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:42.198282 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a791f04-a1c2-4e34-b59f-618849f68931 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:42.299784 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1460d0da-96cd-40e3-ab0f-018844635507 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:42.314119 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1460d0da-96cd-40e3-ab0f-018844635507 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745" status: 200 len: 1321 microversion: 2.1 time: 0.494981 Oct 26 13:19:42.331932 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2058/4108] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:41 2022] GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745 => generated 1321 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:42.362114 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e0d9f788-3911-4089-8b95-e4169eee3593 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:42.363201 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e0d9f788-3911-4089-8b95-e4169eee3593 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:42.375902 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0d9f788-3911-4089-8b95-e4169eee3593 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:42.376591 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0d9f788-3911-4089-8b95-e4169eee3593 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:42.377230 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0d9f788-3911-4089-8b95-e4169eee3593 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:42.380147 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0d9f788-3911-4089-8b95-e4169eee3593 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:42.381217 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0d9f788-3911-4089-8b95-e4169eee3593 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:42.382545 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0d9f788-3911-4089-8b95-e4169eee3593 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:42.528134 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e0d9f788-3911-4089-8b95-e4169eee3593 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:42.539985 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e0d9f788-3911-4089-8b95-e4169eee3593 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:42.541154 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e0d9f788-3911-4089-8b95-e4169eee3593 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:42.542426 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e0d9f788-3911-4089-8b95-e4169eee3593 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1604 microversion: 2.42 time: 0.185004 Oct 26 13:19:42.562123 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2059/4109] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:42 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1604 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:19:42.572382 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e6ccc528-11f2-4308-afa2-4deb1d1be070 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:42.573024 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e6ccc528-11f2-4308-afa2-4deb1d1be070 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 798f0deb-3412-479f-bf6b-d11872c9f680] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:42.580892 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6ccc528-11f2-4308-afa2-4deb1d1be070 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:42.581389 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6ccc528-11f2-4308-afa2-4deb1d1be070 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:42.581848 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6ccc528-11f2-4308-afa2-4deb1d1be070 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:42.583012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6ccc528-11f2-4308-afa2-4deb1d1be070 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:42.583476 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6ccc528-11f2-4308-afa2-4deb1d1be070 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:42.583903 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6ccc528-11f2-4308-afa2-4deb1d1be070 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:42.829976 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e6ccc528-11f2-4308-afa2-4deb1d1be070 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:42.847227 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e6ccc528-11f2-4308-afa2-4deb1d1be070 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680" status: 200 len: 1314 microversion: 2.1 time: 0.283568 Oct 26 13:19:42.849244 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2060/4110] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:42 2022] GET /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680 => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:42.878681 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-699e353f-0a26-4d34-a7d3-058e9a27a88f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:42.883910 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-699e353f-0a26-4d34-a7d3-058e9a27a88f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:42.900743 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-699e353f-0a26-4d34-a7d3-058e9a27a88f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:42.901408 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-699e353f-0a26-4d34-a7d3-058e9a27a88f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:42.902165 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-699e353f-0a26-4d34-a7d3-058e9a27a88f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:42.903150 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-699e353f-0a26-4d34-a7d3-058e9a27a88f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:42.903851 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-699e353f-0a26-4d34-a7d3-058e9a27a88f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:42.904526 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-699e353f-0a26-4d34-a7d3-058e9a27a88f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:43.160661 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-699e353f-0a26-4d34-a7d3-058e9a27a88f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:43.177466 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-699e353f-0a26-4d34-a7d3-058e9a27a88f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:43.181318 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-699e353f-0a26-4d34-a7d3-058e9a27a88f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:43.187805 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-699e353f-0a26-4d34-a7d3-058e9a27a88f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1555 microversion: 2.91 time: 0.336092 Oct 26 13:19:43.188709 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2061/4111] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:42 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1555 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:43.342329 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ad5a64c1-e339-4582-ad76-4f6f9ba826d2 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:43.343543 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ad5a64c1-e339-4582-ad76-4f6f9ba826d2 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 53426b7d-0bba-46ce-ab7e-32451f413745] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:43.351063 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:19:43.356663 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ad5a64c1-e339-4582-ad76-4f6f9ba826d2 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:43.361369 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ad5a64c1-e339-4582-ad76-4f6f9ba826d2 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:43.361912 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ad5a64c1-e339-4582-ad76-4f6f9ba826d2 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:43.370305 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1a791f04-a1c2-4e34-b59f-618849f68931 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0d11e415d94d0b904eb901f421f6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69892d7a76e94fcfbe4b5541a022e220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:43.377909 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ad5a64c1-e339-4582-ad76-4f6f9ba826d2 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:43.378527 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ad5a64c1-e339-4582-ad76-4f6f9ba826d2 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:43.378970 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ad5a64c1-e339-4582-ad76-4f6f9ba826d2 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:43.382508 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1a791f04-a1c2-4e34-b59f-618849f68931 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db0d11e415d94d0b904eb901f421f6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69892d7a76e94fcfbe4b5541a022e220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:43.383965 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1a791f04-a1c2-4e34-b59f-618849f68931 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db0d11e415d94d0b904eb901f421f6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69892d7a76e94fcfbe4b5541a022e220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:43.385123 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1a791f04-a1c2-4e34-b59f-618849f68931 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] 10.222.0.40 "GET /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff" status: 200 len: 1362 microversion: 2.26 time: 1.217943 Oct 26 13:19:43.385717 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2051/4112] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:42 2022] GET /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff => generated 1362 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:43.576556 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-aa2817f7-e6a6-4f56-a556-0daa0a735264 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:43.577087 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-aa2817f7-e6a6-4f56-a556-0daa0a735264 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:43.590024 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aa2817f7-e6a6-4f56-a556-0daa0a735264 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:43.590481 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aa2817f7-e6a6-4f56-a556-0daa0a735264 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:43.591112 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aa2817f7-e6a6-4f56-a556-0daa0a735264 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:43.592024 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aa2817f7-e6a6-4f56-a556-0daa0a735264 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:43.592651 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aa2817f7-e6a6-4f56-a556-0daa0a735264 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:43.593240 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aa2817f7-e6a6-4f56-a556-0daa0a735264 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:43.720936 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-aa2817f7-e6a6-4f56-a556-0daa0a735264 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:43.737894 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-aa2817f7-e6a6-4f56-a556-0daa0a735264 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:43.739349 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-aa2817f7-e6a6-4f56-a556-0daa0a735264 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:43.740571 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-aa2817f7-e6a6-4f56-a556-0daa0a735264 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1604 microversion: 2.42 time: 0.168044 Oct 26 13:19:43.741790 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2052/4113] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:43 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1604 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:43.872877 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7a40d1c4-d009-4a64-9e59-9d3a5fcd61ec tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:43.873765 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7a40d1c4-d009-4a64-9e59-9d3a5fcd61ec tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 798f0deb-3412-479f-bf6b-d11872c9f680] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:43.883044 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7a40d1c4-d009-4a64-9e59-9d3a5fcd61ec tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:43.883724 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7a40d1c4-d009-4a64-9e59-9d3a5fcd61ec tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:43.889264 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7a40d1c4-d009-4a64-9e59-9d3a5fcd61ec tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:43.890332 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7a40d1c4-d009-4a64-9e59-9d3a5fcd61ec tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:43.890976 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7a40d1c4-d009-4a64-9e59-9d3a5fcd61ec tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:43.891563 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7a40d1c4-d009-4a64-9e59-9d3a5fcd61ec tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:44.136166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ad5a64c1-e339-4582-ad76-4f6f9ba826d2 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:44.143415 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:19:44.146107 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ad5a64c1-e339-4582-ad76-4f6f9ba826d2 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745" status: 200 len: 1321 microversion: 2.1 time: 0.808281 Oct 26 13:19:44.162517 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2062/4114] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:43 2022] GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745 => generated 1321 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:44.208700 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7a40d1c4-d009-4a64-9e59-9d3a5fcd61ec tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:44.224453 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-eaac6185-6b08-4b3d-b3c3-9eac83fcd58e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:44.226109 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-eaac6185-6b08-4b3d-b3c3-9eac83fcd58e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:44.234794 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eaac6185-6b08-4b3d-b3c3-9eac83fcd58e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:44.236131 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7a40d1c4-d009-4a64-9e59-9d3a5fcd61ec tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680" status: 200 len: 1314 microversion: 2.1 time: 0.367068 Oct 26 13:19:44.237652 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eaac6185-6b08-4b3d-b3c3-9eac83fcd58e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:44.238094 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2053/4115] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:43 2022] GET /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680 => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:44.238750 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eaac6185-6b08-4b3d-b3c3-9eac83fcd58e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:44.239706 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eaac6185-6b08-4b3d-b3c3-9eac83fcd58e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:44.240458 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eaac6185-6b08-4b3d-b3c3-9eac83fcd58e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:44.241041 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eaac6185-6b08-4b3d-b3c3-9eac83fcd58e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:44.319205 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-eaac6185-6b08-4b3d-b3c3-9eac83fcd58e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:44.329152 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-eaac6185-6b08-4b3d-b3c3-9eac83fcd58e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:44.330664 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-eaac6185-6b08-4b3d-b3c3-9eac83fcd58e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:44.338854 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-eaac6185-6b08-4b3d-b3c3-9eac83fcd58e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1555 microversion: 2.91 time: 0.118963 Oct 26 13:19:44.339777 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2063/4116] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:44 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1555 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:19:44.413414 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0bf1d896-cf2f-4e74-bb18-d7ab5c921c2c tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:44.414224 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0bf1d896-cf2f-4e74-bb18-d7ab5c921c2c tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] [instance: d3605776-7db3-44b2-acdc-8023126131ff] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:44.421658 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=20 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:19:44.427111 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0bf1d896-cf2f-4e74-bb18-d7ab5c921c2c tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:44.429101 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0bf1d896-cf2f-4e74-bb18-d7ab5c921c2c tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:44.429893 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0bf1d896-cf2f-4e74-bb18-d7ab5c921c2c tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:44.432260 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0bf1d896-cf2f-4e74-bb18-d7ab5c921c2c tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:44.434641 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0bf1d896-cf2f-4e74-bb18-d7ab5c921c2c tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:44.435995 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0bf1d896-cf2f-4e74-bb18-d7ab5c921c2c tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:44.772826 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f3350c82-e050-4210-aa32-61d49d4f1d93 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:44.773664 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f3350c82-e050-4210-aa32-61d49d4f1d93 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:44.788347 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f3350c82-e050-4210-aa32-61d49d4f1d93 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:44.790035 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f3350c82-e050-4210-aa32-61d49d4f1d93 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:44.790467 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f3350c82-e050-4210-aa32-61d49d4f1d93 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:44.791669 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f3350c82-e050-4210-aa32-61d49d4f1d93 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:44.792290 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f3350c82-e050-4210-aa32-61d49d4f1d93 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:44.792977 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f3350c82-e050-4210-aa32-61d49d4f1d93 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:44.917219 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f3350c82-e050-4210-aa32-61d49d4f1d93 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:44.943156 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f3350c82-e050-4210-aa32-61d49d4f1d93 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:44.945269 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f3350c82-e050-4210-aa32-61d49d4f1d93 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:44.951002 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f3350c82-e050-4210-aa32-61d49d4f1d93 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1604 microversion: 2.42 time: 0.183689 Oct 26 13:19:44.955642 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2064/4117] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:44 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1604 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:19:44.979424 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-5dd66617-01a3-4d0c-bdd9-c59dc0001fff req-df98005f-af80-4508-bd22-3e77c1ade4ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3605776-7db3-44b2-acdc-8023126131ff", "name": "network-vif-plugged", "status": "completed", "tag": "f5641673-c057-4ee7-8f80-b811c5d64916"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:19:45.010745 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-5dd66617-01a3-4d0c-bdd9-c59dc0001fff req-df98005f-af80-4508-bd22-3e77c1ade4ed service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:45.013727 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-5dd66617-01a3-4d0c-bdd9-c59dc0001fff req-df98005f-af80-4508-bd22-3e77c1ade4ed service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:45.014430 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-5dd66617-01a3-4d0c-bdd9-c59dc0001fff req-df98005f-af80-4508-bd22-3e77c1ade4ed service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:45.034070 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-5dd66617-01a3-4d0c-bdd9-c59dc0001fff req-df98005f-af80-4508-bd22-3e77c1ade4ed service nova] Creating event network-vif-plugged:f5641673-c057-4ee7-8f80-b811c5d64916 for instance d3605776-7db3-44b2-acdc-8023126131ff on n-h1-862686-1 Oct 26 13:19:45.039733 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-5dd66617-01a3-4d0c-bdd9-c59dc0001fff req-df98005f-af80-4508-bd22-3e77c1ade4ed service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081948 Oct 26 13:19:45.040945 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2065/4118] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:19:45.172064 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-20fcab8d-816f-445a-8b2f-4408c7b6e459 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:45.173264 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-20fcab8d-816f-445a-8b2f-4408c7b6e459 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 53426b7d-0bba-46ce-ab7e-32451f413745] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:45.189798 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-20fcab8d-816f-445a-8b2f-4408c7b6e459 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:45.195595 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-20fcab8d-816f-445a-8b2f-4408c7b6e459 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:45.196753 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-20fcab8d-816f-445a-8b2f-4408c7b6e459 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:45.197806 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-20fcab8d-816f-445a-8b2f-4408c7b6e459 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:45.198538 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-20fcab8d-816f-445a-8b2f-4408c7b6e459 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:45.199213 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-20fcab8d-816f-445a-8b2f-4408c7b6e459 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:45.512300 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-20fcab8d-816f-445a-8b2f-4408c7b6e459 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:45.530839 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-20fcab8d-816f-445a-8b2f-4408c7b6e459 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745" status: 200 len: 1321 microversion: 2.1 time: 0.357754 Oct 26 13:19:45.531995 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2066/4119] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:45 2022] GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745 => generated 1321 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:45.550778 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2853bec0-88f3-4b8b-9d3c-24f40ca89280 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:45.555523 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2853bec0-88f3-4b8b-9d3c-24f40ca89280 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 798f0deb-3412-479f-bf6b-d11872c9f680] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:45.573847 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2853bec0-88f3-4b8b-9d3c-24f40ca89280 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:45.574367 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2853bec0-88f3-4b8b-9d3c-24f40ca89280 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:45.574821 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2853bec0-88f3-4b8b-9d3c-24f40ca89280 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:45.575556 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2853bec0-88f3-4b8b-9d3c-24f40ca89280 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:45.576020 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2853bec0-88f3-4b8b-9d3c-24f40ca89280 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:45.576453 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2853bec0-88f3-4b8b-9d3c-24f40ca89280 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:45.888332 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2853bec0-88f3-4b8b-9d3c-24f40ca89280 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:45.896818 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2853bec0-88f3-4b8b-9d3c-24f40ca89280 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680" status: 200 len: 1314 microversion: 2.1 time: 0.363677 Oct 26 13:19:45.909997 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2067/4120] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:45 2022] GET /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680 => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:45.915544 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8d9afe7c-c864-4698-b346-70029788398c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:45.916418 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8d9afe7c-c864-4698-b346-70029788398c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:45.930085 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d9afe7c-c864-4698-b346-70029788398c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:45.931018 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d9afe7c-c864-4698-b346-70029788398c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:45.931654 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d9afe7c-c864-4698-b346-70029788398c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:45.932584 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d9afe7c-c864-4698-b346-70029788398c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:45.933219 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d9afe7c-c864-4698-b346-70029788398c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:45.933853 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d9afe7c-c864-4698-b346-70029788398c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:46.005764 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0bf1d896-cf2f-4e74-bb18-d7ab5c921c2c tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0d11e415d94d0b904eb901f421f6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69892d7a76e94fcfbe4b5541a022e220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:46.021273 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0bf1d896-cf2f-4e74-bb18-d7ab5c921c2c tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db0d11e415d94d0b904eb901f421f6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69892d7a76e94fcfbe4b5541a022e220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:46.024024 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0bf1d896-cf2f-4e74-bb18-d7ab5c921c2c tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db0d11e415d94d0b904eb901f421f6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69892d7a76e94fcfbe4b5541a022e220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:46.028369 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0bf1d896-cf2f-4e74-bb18-d7ab5c921c2c tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] 10.222.0.40 "GET /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff" status: 200 len: 1362 microversion: 2.26 time: 1.619938 Oct 26 13:19:46.035996 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2054/4121] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:44 2022] GET /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff => generated 1362 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:46.043065 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a1644818-c930-4b7e-b2d9-b0bc33043575 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:46.051811 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a1644818-c930-4b7e-b2d9-b0bc33043575 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:46.074562 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a1644818-c930-4b7e-b2d9-b0bc33043575 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:46.075187 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a1644818-c930-4b7e-b2d9-b0bc33043575 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:46.075655 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a1644818-c930-4b7e-b2d9-b0bc33043575 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:46.080029 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a1644818-c930-4b7e-b2d9-b0bc33043575 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:46.080511 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a1644818-c930-4b7e-b2d9-b0bc33043575 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:46.083436 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a1644818-c930-4b7e-b2d9-b0bc33043575 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:46.107248 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8d9afe7c-c864-4698-b346-70029788398c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:46.117975 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8d9afe7c-c864-4698-b346-70029788398c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:46.119675 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8d9afe7c-c864-4698-b346-70029788398c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:46.125910 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8d9afe7c-c864-4698-b346-70029788398c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1555 microversion: 2.91 time: 0.214448 Oct 26 13:19:46.138115 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2068/4122] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:45 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1555 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:46.435435 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a1644818-c930-4b7e-b2d9-b0bc33043575 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:46.459800 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a1644818-c930-4b7e-b2d9-b0bc33043575 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:46.461285 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a1644818-c930-4b7e-b2d9-b0bc33043575 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:46.470817 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a1644818-c930-4b7e-b2d9-b0bc33043575 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1604 microversion: 2.42 time: 0.433300 Oct 26 13:19:46.485513 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2055/4123] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:46 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1604 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:46.563879 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d78f833a-3f87-47f1-9a2f-a2e791a2c807 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:46.564572 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d78f833a-3f87-47f1-9a2f-a2e791a2c807 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 53426b7d-0bba-46ce-ab7e-32451f413745] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:46.582033 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d78f833a-3f87-47f1-9a2f-a2e791a2c807 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:46.582545 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d78f833a-3f87-47f1-9a2f-a2e791a2c807 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:46.583024 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d78f833a-3f87-47f1-9a2f-a2e791a2c807 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:46.584723 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d78f833a-3f87-47f1-9a2f-a2e791a2c807 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:46.585216 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d78f833a-3f87-47f1-9a2f-a2e791a2c807 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:46.586522 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d78f833a-3f87-47f1-9a2f-a2e791a2c807 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:46.621170 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:19:46.801812 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d78f833a-3f87-47f1-9a2f-a2e791a2c807 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:46.814453 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d78f833a-3f87-47f1-9a2f-a2e791a2c807 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745" status: 200 len: 1321 microversion: 2.1 time: 0.262689 Oct 26 13:19:46.830434 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2069/4124] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:46 2022] GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745 => generated 1321 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:46.924225 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6fa50e16-43c9-45a0-8c6f-6ed7969dae04 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:46.924841 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6fa50e16-43c9-45a0-8c6f-6ed7969dae04 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 798f0deb-3412-479f-bf6b-d11872c9f680] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:46.935747 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6fa50e16-43c9-45a0-8c6f-6ed7969dae04 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:46.936237 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6fa50e16-43c9-45a0-8c6f-6ed7969dae04 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:46.936683 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6fa50e16-43c9-45a0-8c6f-6ed7969dae04 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:46.937392 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6fa50e16-43c9-45a0-8c6f-6ed7969dae04 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:46.937876 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6fa50e16-43c9-45a0-8c6f-6ed7969dae04 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:46.938302 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6fa50e16-43c9-45a0-8c6f-6ed7969dae04 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:47.066283 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2ef55f4e-95a0-4f71-82d6-682f37d2a6ef tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:47.069641 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2ef55f4e-95a0-4f71-82d6-682f37d2a6ef tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] [instance: d3605776-7db3-44b2-acdc-8023126131ff] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:47.082462 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=22 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:19:47.092105 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ef55f4e-95a0-4f71-82d6-682f37d2a6ef tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:47.092612 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ef55f4e-95a0-4f71-82d6-682f37d2a6ef tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:47.093056 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ef55f4e-95a0-4f71-82d6-682f37d2a6ef tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:47.093808 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ef55f4e-95a0-4f71-82d6-682f37d2a6ef tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:47.094271 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ef55f4e-95a0-4f71-82d6-682f37d2a6ef tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:47.094701 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ef55f4e-95a0-4f71-82d6-682f37d2a6ef tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:47.419291 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2ef55f4e-95a0-4f71-82d6-682f37d2a6ef tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0d11e415d94d0b904eb901f421f6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69892d7a76e94fcfbe4b5541a022e220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:47.433727 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2ef55f4e-95a0-4f71-82d6-682f37d2a6ef tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db0d11e415d94d0b904eb901f421f6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69892d7a76e94fcfbe4b5541a022e220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:47.439391 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2ef55f4e-95a0-4f71-82d6-682f37d2a6ef tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db0d11e415d94d0b904eb901f421f6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69892d7a76e94fcfbe4b5541a022e220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:47.442203 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2ef55f4e-95a0-4f71-82d6-682f37d2a6ef tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] 10.222.0.40 "GET /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff" status: 200 len: 1545 microversion: 2.26 time: 0.381222 Oct 26 13:19:47.443085 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2070/4125] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:47 2022] GET /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff => generated 1545 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:19:47.477901 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ef26910c-01cd-4180-9fb3-a461415a25b8 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:47.478523 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ef26910c-01cd-4180-9fb3-a461415a25b8 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:47.496537 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef26910c-01cd-4180-9fb3-a461415a25b8 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:47.497044 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef26910c-01cd-4180-9fb3-a461415a25b8 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:47.497517 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef26910c-01cd-4180-9fb3-a461415a25b8 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:47.503024 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef26910c-01cd-4180-9fb3-a461415a25b8 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:47.504087 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef26910c-01cd-4180-9fb3-a461415a25b8 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:47.504087 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef26910c-01cd-4180-9fb3-a461415a25b8 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:47.642464 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ef26910c-01cd-4180-9fb3-a461415a25b8 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:47.655688 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ef26910c-01cd-4180-9fb3-a461415a25b8 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:47.667914 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ef26910c-01cd-4180-9fb3-a461415a25b8 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:47.675941 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ef26910c-01cd-4180-9fb3-a461415a25b8 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1555 microversion: 2.91 time: 0.207982 Oct 26 13:19:47.691386 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2071/4126] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:47 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1555 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:47.754004 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-bfcd6b34-0cc9-4a4c-a507-4e5984b6a475 req-0257bf29-6f5b-419d-8cfa-b5ad4181a2d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "798f0deb-3412-479f-bf6b-d11872c9f680", "name": "network-vif-plugged", "status": "completed", "tag": "d3460729-599e-482a-a95d-fb9175204857"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:19:47.792204 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-bfcd6b34-0cc9-4a4c-a507-4e5984b6a475 req-0257bf29-6f5b-419d-8cfa-b5ad4181a2d2 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:47.807371 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-bfcd6b34-0cc9-4a4c-a507-4e5984b6a475 req-0257bf29-6f5b-419d-8cfa-b5ad4181a2d2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:47.807371 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-bfcd6b34-0cc9-4a4c-a507-4e5984b6a475 req-0257bf29-6f5b-419d-8cfa-b5ad4181a2d2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:47.836342 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-bfcd6b34-0cc9-4a4c-a507-4e5984b6a475 req-0257bf29-6f5b-419d-8cfa-b5ad4181a2d2 service nova] Creating event network-vif-plugged:d3460729-599e-482a-a95d-fb9175204857 for instance 798f0deb-3412-479f-bf6b-d11872c9f680 on n-h1-862686-1 Oct 26 13:19:47.848684 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-bfcd6b34-0cc9-4a4c-a507-4e5984b6a475 req-0257bf29-6f5b-419d-8cfa-b5ad4181a2d2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143624 Oct 26 13:19:47.849470 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2072/4127] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:19:47.885049 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6a0578bc-8fd7-4fe5-b389-ee2a78f88287 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Calling method '.version_select at 0x7f67317ec280>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:47.905351 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a0578bc-8fd7-4fe5-b389-ee2a78f88287 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:47.907460 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a0578bc-8fd7-4fe5-b389-ee2a78f88287 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:47.909601 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a0578bc-8fd7-4fe5-b389-ee2a78f88287 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:47.910290 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6a0578bc-8fd7-4fe5-b389-ee2a78f88287 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] [instance: d3605776-7db3-44b2-acdc-8023126131ff] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:47.922378 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a0578bc-8fd7-4fe5-b389-ee2a78f88287 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:47.923995 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a0578bc-8fd7-4fe5-b389-ee2a78f88287 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:47.924658 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a0578bc-8fd7-4fe5-b389-ee2a78f88287 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:47.925882 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a0578bc-8fd7-4fe5-b389-ee2a78f88287 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:47.926725 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a0578bc-8fd7-4fe5-b389-ee2a78f88287 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:47.927592 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a0578bc-8fd7-4fe5-b389-ee2a78f88287 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:47.963735 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a0578bc-8fd7-4fe5-b389-ee2a78f88287 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:47.964759 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a0578bc-8fd7-4fe5-b389-ee2a78f88287 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:47.965432 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a0578bc-8fd7-4fe5-b389-ee2a78f88287 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:47.984622 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a0578bc-8fd7-4fe5-b389-ee2a78f88287 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:47.985521 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a0578bc-8fd7-4fe5-b389-ee2a78f88287 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:47.986173 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a0578bc-8fd7-4fe5-b389-ee2a78f88287 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:48.045631 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-6a0578bc-8fd7-4fe5-b389-ee2a78f88287 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lazy-loading 'flavor' on Instance uuid d3605776-7db3-44b2-acdc-8023126131ff {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:19:48.078151 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6a0578bc-8fd7-4fe5-b389-ee2a78f88287 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] 10.222.0.40 "PUT /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff/tags/tempest-tag-854752763" status: 201 len: 0 microversion: 2.26 time: 0.227348 Oct 26 13:19:48.080316 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2073/4128] 10.222.0.40 () {62 vars in 1377 bytes} [Wed Oct 26 13:19:47 2022] PUT /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff/tags/tempest-tag-854752763 => generated 0 bytes in 230 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 26 13:19:48.086963 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0fb21dd6-5666-4650-853a-2f972c21fcac tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:48.088025 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0fb21dd6-5666-4650-853a-2f972c21fcac tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:48.097193 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0fb21dd6-5666-4650-853a-2f972c21fcac tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:48.098888 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0fb21dd6-5666-4650-853a-2f972c21fcac tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:48.099803 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0fb21dd6-5666-4650-853a-2f972c21fcac tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:48.101145 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0fb21dd6-5666-4650-853a-2f972c21fcac tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:48.102265 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0fb21dd6-5666-4650-853a-2f972c21fcac tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:48.103063 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0fb21dd6-5666-4650-853a-2f972c21fcac tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:48.234281 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0fb21dd6-5666-4650-853a-2f972c21fcac tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:48.258855 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0fb21dd6-5666-4650-853a-2f972c21fcac tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:48.265572 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6fa50e16-43c9-45a0-8c6f-6ed7969dae04 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:48.268971 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0fb21dd6-5666-4650-853a-2f972c21fcac tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:48.275916 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0fb21dd6-5666-4650-853a-2f972c21fcac tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1604 microversion: 2.42 time: 0.193893 Oct 26 13:19:48.276965 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2074/4129] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:48 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1604 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:48.282955 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a5072477-9b55-45de-944b-79cd76ab1381 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:48.284011 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6fa50e16-43c9-45a0-8c6f-6ed7969dae04 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680" status: 200 len: 1314 microversion: 2.1 time: 1.363548 Oct 26 13:19:48.297599 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a5072477-9b55-45de-944b-79cd76ab1381 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 53426b7d-0bba-46ce-ab7e-32451f413745] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:48.298238 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2056/4130] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:46 2022] GET /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680 => generated 1314 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:48.306481 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5072477-9b55-45de-944b-79cd76ab1381 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:48.310469 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-44874860-4dd0-48cc-a21d-2abe139b7aa6 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Calling method '.version_select at 0x7f67319be0d0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:48.312759 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5072477-9b55-45de-944b-79cd76ab1381 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:48.313225 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5072477-9b55-45de-944b-79cd76ab1381 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:48.317807 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5072477-9b55-45de-944b-79cd76ab1381 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:48.318973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5072477-9b55-45de-944b-79cd76ab1381 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:48.319467 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5072477-9b55-45de-944b-79cd76ab1381 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:48.349694 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-44874860-4dd0-48cc-a21d-2abe139b7aa6 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:48.350585 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-44874860-4dd0-48cc-a21d-2abe139b7aa6 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:48.351271 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-44874860-4dd0-48cc-a21d-2abe139b7aa6 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:48.383971 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-44874860-4dd0-48cc-a21d-2abe139b7aa6 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] 10.222.0.40 "GET /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff/tags/tempest-tag-854752763" status: 204 len: 0 microversion: 2.26 time: 0.084233 Oct 26 13:19:48.391949 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2057/4131] 10.222.0.40 () {60 vars in 1358 bytes} [Wed Oct 26 13:19:48 2022] GET /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff/tags/tempest-tag-854752763 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 13:19:48.410405 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e9104c32-db9f-42ab-a081-d71325d764f0 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Calling method '.version_select at 0x7f6731a25160>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:48.423214 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e9104c32-db9f-42ab-a081-d71325d764f0 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:48.424084 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e9104c32-db9f-42ab-a081-d71325d764f0 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:48.424877 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e9104c32-db9f-42ab-a081-d71325d764f0 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:48.425629 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e9104c32-db9f-42ab-a081-d71325d764f0 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] [instance: d3605776-7db3-44b2-acdc-8023126131ff] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:48.436121 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e9104c32-db9f-42ab-a081-d71325d764f0 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:48.437027 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e9104c32-db9f-42ab-a081-d71325d764f0 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:48.437685 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e9104c32-db9f-42ab-a081-d71325d764f0 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:48.439673 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e9104c32-db9f-42ab-a081-d71325d764f0 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:48.440338 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e9104c32-db9f-42ab-a081-d71325d764f0 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:48.440950 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e9104c32-db9f-42ab-a081-d71325d764f0 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:48.447021 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:19:48.470960 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e9104c32-db9f-42ab-a081-d71325d764f0 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:48.471735 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e9104c32-db9f-42ab-a081-d71325d764f0 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:48.472353 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e9104c32-db9f-42ab-a081-d71325d764f0 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:48.511542 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-e9104c32-db9f-42ab-a081-d71325d764f0 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lazy-loading 'flavor' on Instance uuid d3605776-7db3-44b2-acdc-8023126131ff {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:19:48.541224 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e9104c32-db9f-42ab-a081-d71325d764f0 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff/tags" status: 204 len: 0 microversion: 2.26 time: 0.147603 Oct 26 13:19:48.542273 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2058/4132] 10.222.0.40 () {60 vars in 1295 bytes} [Wed Oct 26 13:19:48 2022] DELETE /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff/tags => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 13:19:48.569729 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-18311b53-a8ad-4aaa-b34a-b8340f3c665d tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Calling method '.version_select at 0x7f673198f0d0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:48.579865 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18311b53-a8ad-4aaa-b34a-b8340f3c665d tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:48.580768 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18311b53-a8ad-4aaa-b34a-b8340f3c665d tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:48.581728 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18311b53-a8ad-4aaa-b34a-b8340f3c665d tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:48.610001 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-18311b53-a8ad-4aaa-b34a-b8340f3c665d tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] 10.222.0.40 "GET /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff/tags" status: 200 len: 12 microversion: 2.26 time: 0.047643 Oct 26 13:19:48.613927 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2059/4133] 10.222.0.40 () {60 vars in 1292 bytes} [Wed Oct 26 13:19:48 2022] GET /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff/tags => generated 12 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:48.630523 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dd5417db-4a73-4193-86f9-c7ffb33a610b tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Calling method '.version_select at 0x7f67369b2e50>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:48.645069 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd5417db-4a73-4193-86f9-c7ffb33a610b tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:48.645788 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd5417db-4a73-4193-86f9-c7ffb33a610b tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:48.646466 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd5417db-4a73-4193-86f9-c7ffb33a610b tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:48.647899 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-dd5417db-4a73-4193-86f9-c7ffb33a610b tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] [instance: d3605776-7db3-44b2-acdc-8023126131ff] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:48.657350 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd5417db-4a73-4193-86f9-c7ffb33a610b tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:48.658150 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd5417db-4a73-4193-86f9-c7ffb33a610b tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:48.658782 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd5417db-4a73-4193-86f9-c7ffb33a610b tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:48.659663 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd5417db-4a73-4193-86f9-c7ffb33a610b tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:48.660480 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd5417db-4a73-4193-86f9-c7ffb33a610b tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:48.661856 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd5417db-4a73-4193-86f9-c7ffb33a610b tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:48.708344 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a5072477-9b55-45de-944b-79cd76ab1381 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:48.731082 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a5072477-9b55-45de-944b-79cd76ab1381 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745" status: 200 len: 1321 microversion: 2.1 time: 0.447719 Oct 26 13:19:48.732105 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd5417db-4a73-4193-86f9-c7ffb33a610b tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:48.732389 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2075/4134] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:48 2022] GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745 => generated 1321 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:48.733100 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd5417db-4a73-4193-86f9-c7ffb33a610b tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:48.733794 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd5417db-4a73-4193-86f9-c7ffb33a610b tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:48.743798 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-fee34a01-c7cb-4d06-ab0d-3e0b13e8913b req-35a250f0-1162-4930-b789-81e951741729 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53426b7d-0bba-46ce-ab7e-32451f413745", "tag": "db0d2628-762c-46cd-b5ff-d3ca7355ba01"}, {"name": "network-changed", "server_uuid": "42f50b1b-9531-43dd-bb5f-cbca3b7d306f", "tag": "50a0dadf-b074-4b74-ba98-54c14d6828bb"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:19:48.752201 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd5417db-4a73-4193-86f9-c7ffb33a610b tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:48.753590 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd5417db-4a73-4193-86f9-c7ffb33a610b tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:48.754283 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd5417db-4a73-4193-86f9-c7ffb33a610b tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:48.770375 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-fee34a01-c7cb-4d06-ab0d-3e0b13e8913b req-35a250f0-1162-4930-b789-81e951741729 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:48.771022 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-fee34a01-c7cb-4d06-ab0d-3e0b13e8913b req-35a250f0-1162-4930-b789-81e951741729 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:48.773582 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-fee34a01-c7cb-4d06-ab0d-3e0b13e8913b req-35a250f0-1162-4930-b789-81e951741729 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:48.810927 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-fee34a01-c7cb-4d06-ab0d-3e0b13e8913b req-35a250f0-1162-4930-b789-81e951741729 service nova] Creating event network-changed:db0d2628-762c-46cd-b5ff-d3ca7355ba01 for instance 53426b7d-0bba-46ce-ab7e-32451f413745 on n-h1-862686-1 Oct 26 13:19:48.813085 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-fee34a01-c7cb-4d06-ab0d-3e0b13e8913b req-35a250f0-1162-4930-b789-81e951741729 service nova] Creating event network-changed:50a0dadf-b074-4b74-ba98-54c14d6828bb for instance 42f50b1b-9531-43dd-bb5f-cbca3b7d306f on n-h2-862686-1 Oct 26 13:19:48.829678 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-fee34a01-c7cb-4d06-ab0d-3e0b13e8913b req-35a250f0-1162-4930-b789-81e951741729 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.093922 Oct 26 13:19:48.835211 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-dd5417db-4a73-4193-86f9-c7ffb33a610b tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lazy-loading 'flavor' on Instance uuid d3605776-7db3-44b2-acdc-8023126131ff {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:19:48.851598 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2076/4135] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:19:48.873596 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-dd5417db-4a73-4193-86f9-c7ffb33a610b tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] 10.222.0.40 "PUT /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff/tags/tempest-tag-1821478572" status: 201 len: 0 microversion: 2.26 time: 0.247596 Oct 26 13:19:48.875613 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2060/4136] 10.222.0.40 () {62 vars in 1380 bytes} [Wed Oct 26 13:19:48 2022] PUT /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff/tags/tempest-tag-1821478572 => generated 0 bytes in 256 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 26 13:19:48.894834 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-10181788-aac4-4f8f-beef-99ba2cd1bd25 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Calling method '.version_select at 0x7f673198fd30>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:48.900366 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ae7133a2-32e3-4faa-90b4-3f0de57a3b33 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:48.904691 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ae7133a2-32e3-4faa-90b4-3f0de57a3b33 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:48.918846 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-10181788-aac4-4f8f-beef-99ba2cd1bd25 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:48.919315 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-10181788-aac4-4f8f-beef-99ba2cd1bd25 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:48.919601 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-10181788-aac4-4f8f-beef-99ba2cd1bd25 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:48.938753 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae7133a2-32e3-4faa-90b4-3f0de57a3b33 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:48.940071 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae7133a2-32e3-4faa-90b4-3f0de57a3b33 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:48.942183 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae7133a2-32e3-4faa-90b4-3f0de57a3b33 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:48.943224 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae7133a2-32e3-4faa-90b4-3f0de57a3b33 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:48.948915 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae7133a2-32e3-4faa-90b4-3f0de57a3b33 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:48.950617 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-10181788-aac4-4f8f-beef-99ba2cd1bd25 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] 10.222.0.40 "GET /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff/tags" status: 200 len: 36 microversion: 2.26 time: 0.061385 Oct 26 13:19:48.951187 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae7133a2-32e3-4faa-90b4-3f0de57a3b33 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:48.951535 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2061/4137] 10.222.0.40 () {60 vars in 1292 bytes} [Wed Oct 26 13:19:48 2022] GET /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff/tags => generated 36 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:48.964385 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dba697fd-6071-46b4-b345-10f852c58128 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Calling method '.version_select at 0x7f6731b1f8b0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:48.986362 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dba697fd-6071-46b4-b345-10f852c58128 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:48.986857 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dba697fd-6071-46b4-b345-10f852c58128 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:48.987302 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dba697fd-6071-46b4-b345-10f852c58128 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:48.987787 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-dba697fd-6071-46b4-b345-10f852c58128 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] [instance: d3605776-7db3-44b2-acdc-8023126131ff] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:49.005762 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dba697fd-6071-46b4-b345-10f852c58128 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:49.011647 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dba697fd-6071-46b4-b345-10f852c58128 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:49.012197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dba697fd-6071-46b4-b345-10f852c58128 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:49.013031 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dba697fd-6071-46b4-b345-10f852c58128 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:49.015845 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dba697fd-6071-46b4-b345-10f852c58128 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:49.016706 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dba697fd-6071-46b4-b345-10f852c58128 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:49.066591 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dba697fd-6071-46b4-b345-10f852c58128 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:49.067114 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dba697fd-6071-46b4-b345-10f852c58128 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:49.067602 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dba697fd-6071-46b4-b345-10f852c58128 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:49.092088 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ae7133a2-32e3-4faa-90b4-3f0de57a3b33 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:49.108460 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ae7133a2-32e3-4faa-90b4-3f0de57a3b33 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:49.110407 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ae7133a2-32e3-4faa-90b4-3f0de57a3b33 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:49.113389 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-dba697fd-6071-46b4-b345-10f852c58128 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lazy-loading 'flavor' on Instance uuid d3605776-7db3-44b2-acdc-8023126131ff {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:19:49.120270 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ae7133a2-32e3-4faa-90b4-3f0de57a3b33 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1555 microversion: 2.91 time: 0.266678 Oct 26 13:19:49.138436 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2077/4138] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:48 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1555 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:49.158491 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-dba697fd-6071-46b4-b345-10f852c58128 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff/tags/tempest-tag-1821478572" status: 204 len: 0 microversion: 2.26 time: 0.199712 Oct 26 13:19:49.159481 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2062/4139] 10.222.0.40 () {60 vars in 1364 bytes} [Wed Oct 26 13:19:48 2022] DELETE /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff/tags/tempest-tag-1821478572 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 26 13:19:49.170558 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f350c333-4db8-4a12-a57c-bf37f29f6d58 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Calling method '.version_select at 0x7f67317d69d0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:49.200201 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f350c333-4db8-4a12-a57c-bf37f29f6d58 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:49.201023 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f350c333-4db8-4a12-a57c-bf37f29f6d58 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:49.201679 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f350c333-4db8-4a12-a57c-bf37f29f6d58 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:49.225658 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f350c333-4db8-4a12-a57c-bf37f29f6d58 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] 10.222.0.40 "GET /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff/tags" status: 200 len: 12 microversion: 2.26 time: 0.060353 Oct 26 13:19:49.231902 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2078/4140] 10.222.0.40 () {60 vars in 1292 bytes} [Wed Oct 26 13:19:49 2022] GET /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff/tags => generated 12 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:49.243323 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3415a752-269e-4046-ac14-a1d4098d7ed2 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Calling method '.version_select at 0x7f6731b1fb80>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:49.258277 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3415a752-269e-4046-ac14-a1d4098d7ed2 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:49.265592 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3415a752-269e-4046-ac14-a1d4098d7ed2 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:49.266293 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3415a752-269e-4046-ac14-a1d4098d7ed2 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:49.268432 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3415a752-269e-4046-ac14-a1d4098d7ed2 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] [instance: d3605776-7db3-44b2-acdc-8023126131ff] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:49.289885 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3415a752-269e-4046-ac14-a1d4098d7ed2 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:49.290895 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3415a752-269e-4046-ac14-a1d4098d7ed2 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:49.292671 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3415a752-269e-4046-ac14-a1d4098d7ed2 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:49.296140 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3415a752-269e-4046-ac14-a1d4098d7ed2 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:49.298265 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3415a752-269e-4046-ac14-a1d4098d7ed2 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:49.299261 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3415a752-269e-4046-ac14-a1d4098d7ed2 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:49.310648 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-83cbd096-0b45-4d21-a35a-54964e2b43ad tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:49.314042 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-83cbd096-0b45-4d21-a35a-54964e2b43ad tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:49.330111 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83cbd096-0b45-4d21-a35a-54964e2b43ad tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:49.330987 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83cbd096-0b45-4d21-a35a-54964e2b43ad tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:49.331721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83cbd096-0b45-4d21-a35a-54964e2b43ad tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:49.335488 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83cbd096-0b45-4d21-a35a-54964e2b43ad tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:49.337880 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83cbd096-0b45-4d21-a35a-54964e2b43ad tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:49.341232 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83cbd096-0b45-4d21-a35a-54964e2b43ad tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:49.368622 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3415a752-269e-4046-ac14-a1d4098d7ed2 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:49.373319 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3415a752-269e-4046-ac14-a1d4098d7ed2 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:49.374035 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3415a752-269e-4046-ac14-a1d4098d7ed2 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:49.400902 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-3415a752-269e-4046-ac14-a1d4098d7ed2 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lazy-loading 'flavor' on Instance uuid d3605776-7db3-44b2-acdc-8023126131ff {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:19:49.442478 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3415a752-269e-4046-ac14-a1d4098d7ed2 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff/tags" status: 204 len: 0 microversion: 2.26 time: 0.203765 Oct 26 13:19:49.445354 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2063/4141] 10.222.0.40 () {60 vars in 1295 bytes} [Wed Oct 26 13:19:49 2022] DELETE /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff/tags => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 13:19:49.455115 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b159e847-ad37-4805-91b2-2c4a1ab919cb tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:49.457682 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b159e847-ad37-4805-91b2-2c4a1ab919cb tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 798f0deb-3412-479f-bf6b-d11872c9f680] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:49.473669 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b159e847-ad37-4805-91b2-2c4a1ab919cb tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:49.474346 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b159e847-ad37-4805-91b2-2c4a1ab919cb tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:49.475166 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b159e847-ad37-4805-91b2-2c4a1ab919cb tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:49.476019 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b159e847-ad37-4805-91b2-2c4a1ab919cb tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:49.476608 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b159e847-ad37-4805-91b2-2c4a1ab919cb tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:49.480570 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b159e847-ad37-4805-91b2-2c4a1ab919cb tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:49.499390 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-83cbd096-0b45-4d21-a35a-54964e2b43ad tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:49.514275 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-83cbd096-0b45-4d21-a35a-54964e2b43ad tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:49.516170 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-83cbd096-0b45-4d21-a35a-54964e2b43ad tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:49.517650 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-83cbd096-0b45-4d21-a35a-54964e2b43ad tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1604 microversion: 2.42 time: 0.216759 Oct 26 13:19:49.518819 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2079/4142] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:49 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1604 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:49.524832 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-aeacdeee-f79f-432d-8d1a-d161cacf0802 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Calling method '.version_select at 0x7f67318e0af0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:49.546498 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aeacdeee-f79f-432d-8d1a-d161cacf0802 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:49.547217 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aeacdeee-f79f-432d-8d1a-d161cacf0802 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:49.550935 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aeacdeee-f79f-432d-8d1a-d161cacf0802 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:49.551660 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-aeacdeee-f79f-432d-8d1a-d161cacf0802 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] [instance: d3605776-7db3-44b2-acdc-8023126131ff] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:49.560353 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aeacdeee-f79f-432d-8d1a-d161cacf0802 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:49.561107 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aeacdeee-f79f-432d-8d1a-d161cacf0802 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:49.561747 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aeacdeee-f79f-432d-8d1a-d161cacf0802 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:49.562667 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aeacdeee-f79f-432d-8d1a-d161cacf0802 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:49.563305 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aeacdeee-f79f-432d-8d1a-d161cacf0802 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:49.564196 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aeacdeee-f79f-432d-8d1a-d161cacf0802 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:49.570065 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:19:49.633680 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aeacdeee-f79f-432d-8d1a-d161cacf0802 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:49.634187 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aeacdeee-f79f-432d-8d1a-d161cacf0802 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:49.634634 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aeacdeee-f79f-432d-8d1a-d161cacf0802 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:49.646742 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aeacdeee-f79f-432d-8d1a-d161cacf0802 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:49.647961 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aeacdeee-f79f-432d-8d1a-d161cacf0802 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:49.655668 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aeacdeee-f79f-432d-8d1a-d161cacf0802 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:49.720488 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-aeacdeee-f79f-432d-8d1a-d161cacf0802 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lazy-loading 'flavor' on Instance uuid d3605776-7db3-44b2-acdc-8023126131ff {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:19:49.762901 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-aeacdeee-f79f-432d-8d1a-d161cacf0802 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] 10.222.0.40 "PUT /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff/tags/tempest-tag-1547052512" status: 201 len: 0 microversion: 2.26 time: 0.242543 Oct 26 13:19:49.763599 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2080/4143] 10.222.0.40 () {62 vars in 1380 bytes} [Wed Oct 26 13:19:49 2022] PUT /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff/tags/tempest-tag-1547052512 => generated 0 bytes in 244 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 26 13:19:49.768789 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-29f71f53-789b-486d-a874-d19bcfb41bd0 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:49.769407 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-29f71f53-789b-486d-a874-d19bcfb41bd0 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 53426b7d-0bba-46ce-ab7e-32451f413745] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:49.777720 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29f71f53-789b-486d-a874-d19bcfb41bd0 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:49.779772 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29f71f53-789b-486d-a874-d19bcfb41bd0 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:49.780284 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29f71f53-789b-486d-a874-d19bcfb41bd0 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:49.781591 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29f71f53-789b-486d-a874-d19bcfb41bd0 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:49.782071 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29f71f53-789b-486d-a874-d19bcfb41bd0 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:49.782514 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29f71f53-789b-486d-a874-d19bcfb41bd0 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:49.852938 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b159e847-ad37-4805-91b2-2c4a1ab919cb tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:49.862337 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b159e847-ad37-4805-91b2-2c4a1ab919cb tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680" status: 200 len: 1501 microversion: 2.1 time: 0.416552 Oct 26 13:19:49.866458 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2064/4144] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:49 2022] GET /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680 => generated 1501 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:49.876916 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4f3ed1b1-bbec-4bc3-b348-c87f50d79ea7 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Calling method '.version_select at 0x7f673197d820>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:49.901575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f3ed1b1-bbec-4bc3-b348-c87f50d79ea7 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:49.904885 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f3ed1b1-bbec-4bc3-b348-c87f50d79ea7 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:49.907440 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f3ed1b1-bbec-4bc3-b348-c87f50d79ea7 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:49.908063 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4f3ed1b1-bbec-4bc3-b348-c87f50d79ea7 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] [instance: d3605776-7db3-44b2-acdc-8023126131ff] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:49.928553 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f3ed1b1-bbec-4bc3-b348-c87f50d79ea7 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:49.928553 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f3ed1b1-bbec-4bc3-b348-c87f50d79ea7 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:49.928553 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f3ed1b1-bbec-4bc3-b348-c87f50d79ea7 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:49.930371 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f3ed1b1-bbec-4bc3-b348-c87f50d79ea7 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:49.931400 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f3ed1b1-bbec-4bc3-b348-c87f50d79ea7 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:49.935427 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f3ed1b1-bbec-4bc3-b348-c87f50d79ea7 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:49.998203 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f3ed1b1-bbec-4bc3-b348-c87f50d79ea7 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:49.998860 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f3ed1b1-bbec-4bc3-b348-c87f50d79ea7 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:49.999420 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f3ed1b1-bbec-4bc3-b348-c87f50d79ea7 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:50.016390 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f3ed1b1-bbec-4bc3-b348-c87f50d79ea7 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:50.017048 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f3ed1b1-bbec-4bc3-b348-c87f50d79ea7 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:50.017816 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f3ed1b1-bbec-4bc3-b348-c87f50d79ea7 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:50.065329 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-4f3ed1b1-bbec-4bc3-b348-c87f50d79ea7 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lazy-loading 'flavor' on Instance uuid d3605776-7db3-44b2-acdc-8023126131ff {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:19:50.087928 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4f3ed1b1-bbec-4bc3-b348-c87f50d79ea7 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] 10.222.0.40 "PUT /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff/tags/tempest-tag-108179597" status: 201 len: 0 microversion: 2.26 time: 0.220005 Oct 26 13:19:50.089030 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2065/4145] 10.222.0.40 () {62 vars in 1377 bytes} [Wed Oct 26 13:19:49 2022] PUT /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff/tags/tempest-tag-108179597 => generated 0 bytes in 222 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 26 13:19:50.094986 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d2a2588c-f114-43b7-a9ac-909a79545600 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:19:50.095624 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d2a2588c-f114-43b7-a9ac-909a79545600 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 798f0deb-3412-479f-bf6b-d11872c9f680] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:50.104886 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d2a2588c-f114-43b7-a9ac-909a79545600 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:50.105397 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d2a2588c-f114-43b7-a9ac-909a79545600 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:50.105872 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d2a2588c-f114-43b7-a9ac-909a79545600 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:50.106828 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d2a2588c-f114-43b7-a9ac-909a79545600 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:50.107291 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d2a2588c-f114-43b7-a9ac-909a79545600 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:50.107727 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d2a2588c-f114-43b7-a9ac-909a79545600 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:50.159678 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-d2a2588c-f114-43b7-a9ac-909a79545600 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lazy-loading 'flavor' on Instance uuid 798f0deb-3412-479f-bf6b-d11872c9f680 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:19:50.221715 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-29f71f53-789b-486d-a874-d19bcfb41bd0 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:50.238938 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-29f71f53-789b-486d-a874-d19bcfb41bd0 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745" status: 200 len: 1321 microversion: 2.1 time: 0.473377 Oct 26 13:19:50.242801 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2081/4146] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:49 2022] GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745 => generated 1321 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:50.266601 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-26ef9b88-af25-42cd-8d94-f3cd4ede29d6 req-4165c742-0422-4be8-b63b-259a04935468 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97825703-89d9-457a-b6c3-b694f8eee97c", "name": "network-vif-plugged", "status": "completed", "tag": "8e2f2c44-360b-45b6-aa25-4848c446d113"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:19:50.307845 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-26ef9b88-af25-42cd-8d94-f3cd4ede29d6 req-4165c742-0422-4be8-b63b-259a04935468 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:50.310088 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-26ef9b88-af25-42cd-8d94-f3cd4ede29d6 req-4165c742-0422-4be8-b63b-259a04935468 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:50.312103 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-26ef9b88-af25-42cd-8d94-f3cd4ede29d6 req-4165c742-0422-4be8-b63b-259a04935468 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:50.312851 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d2a2588c-f114-43b7-a9ac-909a79545600 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "POST /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680/action" status: 202 len: 0 microversion: 2.1 time: 0.222541 Oct 26 13:19:50.315204 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2066/4147] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:19:50 2022] POST /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:19:50.339289 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-32924f16-0276-445a-aaa7-a0324eeb1904 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Calling method '.version_select at 0x7f6731985310>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:50.354905 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-26ef9b88-af25-42cd-8d94-f3cd4ede29d6 req-4165c742-0422-4be8-b63b-259a04935468 service nova] Creating event network-vif-plugged:8e2f2c44-360b-45b6-aa25-4848c446d113 for instance 97825703-89d9-457a-b6c3-b694f8eee97c on n-h2-862686-1 Oct 26 13:19:50.362163 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32924f16-0276-445a-aaa7-a0324eeb1904 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:50.362873 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32924f16-0276-445a-aaa7-a0324eeb1904 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:50.363322 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32924f16-0276-445a-aaa7-a0324eeb1904 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:50.365767 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-32924f16-0276-445a-aaa7-a0324eeb1904 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] [instance: d3605776-7db3-44b2-acdc-8023126131ff] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:50.366258 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-26ef9b88-af25-42cd-8d94-f3cd4ede29d6 req-4165c742-0422-4be8-b63b-259a04935468 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121234 Oct 26 13:19:50.369020 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2082/4148] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:19:50.379707 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32924f16-0276-445a-aaa7-a0324eeb1904 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:50.381675 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32924f16-0276-445a-aaa7-a0324eeb1904 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:50.382285 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-68e04fab-b368-43fd-8dd4-ef816398dbdb tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:50.383001 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32924f16-0276-445a-aaa7-a0324eeb1904 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:50.383726 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32924f16-0276-445a-aaa7-a0324eeb1904 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:50.384188 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32924f16-0276-445a-aaa7-a0324eeb1904 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:50.384616 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32924f16-0276-445a-aaa7-a0324eeb1904 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:50.385036 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-68e04fab-b368-43fd-8dd4-ef816398dbdb tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:50.412989 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68e04fab-b368-43fd-8dd4-ef816398dbdb tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:50.414809 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68e04fab-b368-43fd-8dd4-ef816398dbdb tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:50.415273 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68e04fab-b368-43fd-8dd4-ef816398dbdb tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:50.416023 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68e04fab-b368-43fd-8dd4-ef816398dbdb tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:50.416479 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68e04fab-b368-43fd-8dd4-ef816398dbdb tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:50.416907 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68e04fab-b368-43fd-8dd4-ef816398dbdb tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:50.441353 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32924f16-0276-445a-aaa7-a0324eeb1904 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:50.441899 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32924f16-0276-445a-aaa7-a0324eeb1904 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:50.442337 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32924f16-0276-445a-aaa7-a0324eeb1904 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:50.466144 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-32924f16-0276-445a-aaa7-a0324eeb1904 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lazy-loading 'flavor' on Instance uuid d3605776-7db3-44b2-acdc-8023126131ff {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:19:50.487159 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-32924f16-0276-445a-aaa7-a0324eeb1904 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff/tags" status: 204 len: 0 microversion: 2.26 time: 0.170730 Oct 26 13:19:50.491209 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2067/4149] 10.222.0.40 () {60 vars in 1295 bytes} [Wed Oct 26 13:19:50 2022] DELETE /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff/tags => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 13:19:50.497537 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c275fee4-82c2-4c25-83b7-a4e7d39a7e8c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:50.498248 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c275fee4-82c2-4c25-83b7-a4e7d39a7e8c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 798f0deb-3412-479f-bf6b-d11872c9f680] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:50.504861 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c275fee4-82c2-4c25-83b7-a4e7d39a7e8c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:50.505282 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c275fee4-82c2-4c25-83b7-a4e7d39a7e8c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:50.506458 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c275fee4-82c2-4c25-83b7-a4e7d39a7e8c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:50.508248 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c275fee4-82c2-4c25-83b7-a4e7d39a7e8c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:50.508725 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c275fee4-82c2-4c25-83b7-a4e7d39a7e8c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:50.509161 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c275fee4-82c2-4c25-83b7-a4e7d39a7e8c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:50.533658 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=87,nova_cell1:DELETE=4,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2,nova_cell1:UPDATE=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:19:50.599277 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-68e04fab-b368-43fd-8dd4-ef816398dbdb tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:50.609190 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-68e04fab-b368-43fd-8dd4-ef816398dbdb tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:50.610866 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-68e04fab-b368-43fd-8dd4-ef816398dbdb tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:50.618875 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-68e04fab-b368-43fd-8dd4-ef816398dbdb tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1555 microversion: 2.91 time: 0.247545 Oct 26 13:19:50.634813 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2083/4150] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:50 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1555 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:50.634813 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e9c1a79e-0d40-431b-bb2f-5abfb0c260dd tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Calling method '.version_select at 0x7f67319ea5e0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:50.646079 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e9c1a79e-0d40-431b-bb2f-5abfb0c260dd tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:50.646763 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e9c1a79e-0d40-431b-bb2f-5abfb0c260dd tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:50.647241 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e9c1a79e-0d40-431b-bb2f-5abfb0c260dd tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:50.659544 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e9c1a79e-0d40-431b-bb2f-5abfb0c260dd tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] 10.222.0.40 "GET /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff/tags" status: 200 len: 12 microversion: 2.26 time: 0.037714 Oct 26 13:19:50.659544 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2084/4151] 10.222.0.40 () {60 vars in 1292 bytes} [Wed Oct 26 13:19:50 2022] GET /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff/tags => generated 12 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:50.668239 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e1c2fc0b-9367-471e-a60a-d6751f6c7c25 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:50.669181 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e1c2fc0b-9367-471e-a60a-d6751f6c7c25 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:50.681580 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e1c2fc0b-9367-471e-a60a-d6751f6c7c25 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:50.682483 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e1c2fc0b-9367-471e-a60a-d6751f6c7c25 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:50.683410 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e1c2fc0b-9367-471e-a60a-d6751f6c7c25 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:50.685688 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e1c2fc0b-9367-471e-a60a-d6751f6c7c25 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:50.686554 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e1c2fc0b-9367-471e-a60a-d6751f6c7c25 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:50.687313 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e1c2fc0b-9367-471e-a60a-d6751f6c7c25 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:50.767029 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e1c2fc0b-9367-471e-a60a-d6751f6c7c25 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:50.782695 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e1c2fc0b-9367-471e-a60a-d6751f6c7c25 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:50.784807 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e1c2fc0b-9367-471e-a60a-d6751f6c7c25 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:50.786291 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e1c2fc0b-9367-471e-a60a-d6751f6c7c25 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1604 microversion: 2.42 time: 0.126203 Oct 26 13:19:50.787010 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2085/4152] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:50 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1604 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:50.794321 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-74eec2b3-7e5b-4467-b651-e1764ef592a9 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Calling method '.version_select at 0x7f67317118b0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:50.802620 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74eec2b3-7e5b-4467-b651-e1764ef592a9 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:50.803392 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74eec2b3-7e5b-4467-b651-e1764ef592a9 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:50.803834 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74eec2b3-7e5b-4467-b651-e1764ef592a9 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:50.804360 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-74eec2b3-7e5b-4467-b651-e1764ef592a9 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] [instance: d3605776-7db3-44b2-acdc-8023126131ff] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:50.811089 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74eec2b3-7e5b-4467-b651-e1764ef592a9 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:50.811281 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74eec2b3-7e5b-4467-b651-e1764ef592a9 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:50.811655 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74eec2b3-7e5b-4467-b651-e1764ef592a9 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:50.812364 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74eec2b3-7e5b-4467-b651-e1764ef592a9 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:50.812813 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74eec2b3-7e5b-4467-b651-e1764ef592a9 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:50.813624 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74eec2b3-7e5b-4467-b651-e1764ef592a9 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:50.868002 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74eec2b3-7e5b-4467-b651-e1764ef592a9 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:50.868503 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74eec2b3-7e5b-4467-b651-e1764ef592a9 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:50.868945 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74eec2b3-7e5b-4467-b651-e1764ef592a9 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:50.884438 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c275fee4-82c2-4c25-83b7-a4e7d39a7e8c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:50.894250 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c275fee4-82c2-4c25-83b7-a4e7d39a7e8c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680" status: 200 len: 1509 microversion: 2.1 time: 0.401920 Oct 26 13:19:50.895575 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2068/4153] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:50 2022] GET /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680 => generated 1509 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:50.898669 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-74eec2b3-7e5b-4467-b651-e1764ef592a9 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lazy-loading 'flavor' on Instance uuid d3605776-7db3-44b2-acdc-8023126131ff {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:19:50.948865 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-74eec2b3-7e5b-4467-b651-e1764ef592a9 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff/tags" status: 204 len: 0 microversion: 2.26 time: 0.159748 Oct 26 13:19:50.949526 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2086/4154] 10.222.0.40 () {60 vars in 1295 bytes} [Wed Oct 26 13:19:50 2022] DELETE /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff/tags => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 13:19:50.962010 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-57fc6633-eb73-47c4-8305-313e32cf9d27 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Calling method '.version_select at 0x7f673278e9d0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:50.980968 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57fc6633-eb73-47c4-8305-313e32cf9d27 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:50.981458 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57fc6633-eb73-47c4-8305-313e32cf9d27 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:50.981926 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57fc6633-eb73-47c4-8305-313e32cf9d27 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:50.982417 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-57fc6633-eb73-47c4-8305-313e32cf9d27 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] [instance: d3605776-7db3-44b2-acdc-8023126131ff] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:50.989295 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57fc6633-eb73-47c4-8305-313e32cf9d27 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:50.989828 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57fc6633-eb73-47c4-8305-313e32cf9d27 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:50.990374 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57fc6633-eb73-47c4-8305-313e32cf9d27 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:50.991101 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57fc6633-eb73-47c4-8305-313e32cf9d27 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:50.991554 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57fc6633-eb73-47c4-8305-313e32cf9d27 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:50.991984 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57fc6633-eb73-47c4-8305-313e32cf9d27 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:51.044838 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57fc6633-eb73-47c4-8305-313e32cf9d27 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:51.045897 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57fc6633-eb73-47c4-8305-313e32cf9d27 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:51.046986 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57fc6633-eb73-47c4-8305-313e32cf9d27 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:51.057544 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57fc6633-eb73-47c4-8305-313e32cf9d27 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:51.058453 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57fc6633-eb73-47c4-8305-313e32cf9d27 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:51.058902 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57fc6633-eb73-47c4-8305-313e32cf9d27 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:51.103280 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-57fc6633-eb73-47c4-8305-313e32cf9d27 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lazy-loading 'flavor' on Instance uuid d3605776-7db3-44b2-acdc-8023126131ff {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:19:51.126098 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-57fc6633-eb73-47c4-8305-313e32cf9d27 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] 10.222.0.40 "PUT /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff/tags/tempest-tag-882634093" status: 201 len: 0 microversion: 2.26 time: 0.170923 Oct 26 13:19:51.134253 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2069/4155] 10.222.0.40 () {62 vars in 1377 bytes} [Wed Oct 26 13:19:50 2022] PUT /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff/tags/tempest-tag-882634093 => generated 0 bytes in 179 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 26 13:19:51.139461 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fa46110b-11dc-4243-a862-afea0ee164fd tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Calling method '.version_select at 0x7f67319ea430>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:51.151190 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa46110b-11dc-4243-a862-afea0ee164fd tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:51.151674 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa46110b-11dc-4243-a862-afea0ee164fd tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:51.152326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa46110b-11dc-4243-a862-afea0ee164fd tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:51.153209 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fa46110b-11dc-4243-a862-afea0ee164fd tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] [instance: d3605776-7db3-44b2-acdc-8023126131ff] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:51.159052 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa46110b-11dc-4243-a862-afea0ee164fd tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:51.159534 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa46110b-11dc-4243-a862-afea0ee164fd tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:51.159968 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa46110b-11dc-4243-a862-afea0ee164fd tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:51.160656 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa46110b-11dc-4243-a862-afea0ee164fd tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:51.161110 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa46110b-11dc-4243-a862-afea0ee164fd tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:51.161590 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa46110b-11dc-4243-a862-afea0ee164fd tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:51.191244 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa46110b-11dc-4243-a862-afea0ee164fd tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:51.191746 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa46110b-11dc-4243-a862-afea0ee164fd tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:51.192191 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa46110b-11dc-4243-a862-afea0ee164fd tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:51.216061 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa46110b-11dc-4243-a862-afea0ee164fd tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:51.216547 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa46110b-11dc-4243-a862-afea0ee164fd tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:51.219507 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa46110b-11dc-4243-a862-afea0ee164fd tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:51.259017 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-fa46110b-11dc-4243-a862-afea0ee164fd tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lazy-loading 'flavor' on Instance uuid d3605776-7db3-44b2-acdc-8023126131ff {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:19:51.281955 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fa46110b-11dc-4243-a862-afea0ee164fd tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] 10.222.0.40 "PUT /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff/tags/tempest-tag-1114656695" status: 201 len: 0 microversion: 2.26 time: 0.146593 Oct 26 13:19:51.283182 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2087/4156] 10.222.0.40 () {62 vars in 1380 bytes} [Wed Oct 26 13:19:51 2022] PUT /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff/tags/tempest-tag-1114656695 => generated 0 bytes in 149 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Oct 26 13:19:51.287116 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f6d4ba6d-2855-4c7e-882c-7433e6e66458 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:51.289140 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f6d4ba6d-2855-4c7e-882c-7433e6e66458 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 53426b7d-0bba-46ce-ab7e-32451f413745] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:51.294132 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-85be5eeb-2d64-4326-b6cb-1e8178c66b1e tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Action: 'update_all', calling method: .version_select at 0x7f67369971f0>, body: {"tags": ["tempest-tag-755237158", "tempest-tag-986731680"]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:19:51.300470 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f6d4ba6d-2855-4c7e-882c-7433e6e66458 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:51.300981 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f6d4ba6d-2855-4c7e-882c-7433e6e66458 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:51.301432 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f6d4ba6d-2855-4c7e-882c-7433e6e66458 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:51.305041 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f6d4ba6d-2855-4c7e-882c-7433e6e66458 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:51.306282 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f6d4ba6d-2855-4c7e-882c-7433e6e66458 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:51.306735 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f6d4ba6d-2855-4c7e-882c-7433e6e66458 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:51.307138 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-85be5eeb-2d64-4326-b6cb-1e8178c66b1e tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:51.307878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-85be5eeb-2d64-4326-b6cb-1e8178c66b1e tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:51.308641 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-85be5eeb-2d64-4326-b6cb-1e8178c66b1e tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:51.310121 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-85be5eeb-2d64-4326-b6cb-1e8178c66b1e tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] [instance: d3605776-7db3-44b2-acdc-8023126131ff] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:51.319986 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-85be5eeb-2d64-4326-b6cb-1e8178c66b1e tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:51.320841 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-85be5eeb-2d64-4326-b6cb-1e8178c66b1e tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:51.321522 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-85be5eeb-2d64-4326-b6cb-1e8178c66b1e tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:51.322510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-85be5eeb-2d64-4326-b6cb-1e8178c66b1e tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:51.323190 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-85be5eeb-2d64-4326-b6cb-1e8178c66b1e tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:51.323838 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-85be5eeb-2d64-4326-b6cb-1e8178c66b1e tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:51.369397 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-85be5eeb-2d64-4326-b6cb-1e8178c66b1e tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:51.370389 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-85be5eeb-2d64-4326-b6cb-1e8178c66b1e tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:51.371054 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-85be5eeb-2d64-4326-b6cb-1e8178c66b1e tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:51.406400 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-85be5eeb-2d64-4326-b6cb-1e8178c66b1e tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lazy-loading 'flavor' on Instance uuid d3605776-7db3-44b2-acdc-8023126131ff {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:19:51.429981 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-85be5eeb-2d64-4326-b6cb-1e8178c66b1e tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] 10.222.0.40 "PUT /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff/tags" status: 200 len: 60 microversion: 2.26 time: 0.139749 Oct 26 13:19:51.437369 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2088/4157] 10.222.0.40 () {62 vars in 1312 bytes} [Wed Oct 26 13:19:51 2022] PUT /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff/tags => generated 60 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:19:51.442875 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-38746e1d-a50c-4953-903f-21f35c3f8f9e tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Calling method '.version_select at 0x7f67317ec670>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:51.453192 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38746e1d-a50c-4953-903f-21f35c3f8f9e tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:51.454330 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38746e1d-a50c-4953-903f-21f35c3f8f9e tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:51.456123 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38746e1d-a50c-4953-903f-21f35c3f8f9e tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:51.469154 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-38746e1d-a50c-4953-903f-21f35c3f8f9e tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] 10.222.0.40 "GET /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff/tags" status: 200 len: 60 microversion: 2.26 time: 0.030301 Oct 26 13:19:51.470386 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2089/4158] 10.222.0.40 () {60 vars in 1292 bytes} [Wed Oct 26 13:19:51 2022] GET /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff/tags => generated 60 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:51.481446 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-928f2cc1-6257-4cfe-bf43-e39cf5b1f946 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Calling method '.version_select at 0x7f67317164c0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:51.489298 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-928f2cc1-6257-4cfe-bf43-e39cf5b1f946 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:51.490171 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-928f2cc1-6257-4cfe-bf43-e39cf5b1f946 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:51.491553 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-928f2cc1-6257-4cfe-bf43-e39cf5b1f946 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:51.492366 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-928f2cc1-6257-4cfe-bf43-e39cf5b1f946 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] [instance: d3605776-7db3-44b2-acdc-8023126131ff] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:51.499072 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-928f2cc1-6257-4cfe-bf43-e39cf5b1f946 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:51.499962 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-928f2cc1-6257-4cfe-bf43-e39cf5b1f946 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:51.500623 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-928f2cc1-6257-4cfe-bf43-e39cf5b1f946 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:51.501595 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-928f2cc1-6257-4cfe-bf43-e39cf5b1f946 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:51.502412 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-928f2cc1-6257-4cfe-bf43-e39cf5b1f946 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:51.502695 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f6d4ba6d-2855-4c7e-882c-7433e6e66458 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:51.504054 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-928f2cc1-6257-4cfe-bf43-e39cf5b1f946 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:51.511670 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f6d4ba6d-2855-4c7e-882c-7433e6e66458 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745" status: 200 len: 1321 microversion: 2.1 time: 0.228845 Oct 26 13:19:51.526317 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2070/4159] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:51 2022] GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745 => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:19:51.531995 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-928f2cc1-6257-4cfe-bf43-e39cf5b1f946 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:51.532833 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-928f2cc1-6257-4cfe-bf43-e39cf5b1f946 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:51.533565 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-928f2cc1-6257-4cfe-bf43-e39cf5b1f946 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:51.549242 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-928f2cc1-6257-4cfe-bf43-e39cf5b1f946 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lazy-loading 'flavor' on Instance uuid d3605776-7db3-44b2-acdc-8023126131ff {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:19:51.568831 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-928f2cc1-6257-4cfe-bf43-e39cf5b1f946 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff/tags" status: 204 len: 0 microversion: 2.26 time: 0.091120 Oct 26 13:19:51.571059 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2090/4160] 10.222.0.40 () {60 vars in 1295 bytes} [Wed Oct 26 13:19:51 2022] DELETE /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff/tags => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 13:19:51.585600 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8b7dc0f6-caca-44d6-b570-b81fe245f8e8 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:51.586521 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8b7dc0f6-caca-44d6-b570-b81fe245f8e8 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] [instance: d3605776-7db3-44b2-acdc-8023126131ff] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:51.597196 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8b7dc0f6-caca-44d6-b570-b81fe245f8e8 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:51.598249 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8b7dc0f6-caca-44d6-b570-b81fe245f8e8 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:51.598804 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8b7dc0f6-caca-44d6-b570-b81fe245f8e8 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:51.600972 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8b7dc0f6-caca-44d6-b570-b81fe245f8e8 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:51.601908 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8b7dc0f6-caca-44d6-b570-b81fe245f8e8 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:51.602702 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8b7dc0f6-caca-44d6-b570-b81fe245f8e8 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:51.649374 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8b7dc0f6-caca-44d6-b570-b81fe245f8e8 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] [instance: d3605776-7db3-44b2-acdc-8023126131ff] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:19:51.656045 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d1fc1784-7706-4914-b98f-bc5715239c0f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:51.656958 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d1fc1784-7706-4914-b98f-bc5715239c0f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:51.674303 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d1fc1784-7706-4914-b98f-bc5715239c0f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:51.677823 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d1fc1784-7706-4914-b98f-bc5715239c0f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:51.679435 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d1fc1784-7706-4914-b98f-bc5715239c0f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:51.681470 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d1fc1784-7706-4914-b98f-bc5715239c0f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:51.682147 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d1fc1784-7706-4914-b98f-bc5715239c0f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:51.687140 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d1fc1784-7706-4914-b98f-bc5715239c0f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:51.780518 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8b7dc0f6-caca-44d6-b570-b81fe245f8e8 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff" status: 204 len: 0 microversion: 2.26 time: 0.201346 Oct 26 13:19:51.781399 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2071/4161] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 26 13:19:51 2022] DELETE /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 13:19:51.790325 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2e4449df-1293-4459-b37b-d792efe8cb4e tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:51.791031 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2e4449df-1293-4459-b37b-d792efe8cb4e tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] [instance: d3605776-7db3-44b2-acdc-8023126131ff] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:51.797919 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e4449df-1293-4459-b37b-d792efe8cb4e tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:51.798396 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e4449df-1293-4459-b37b-d792efe8cb4e tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:51.798844 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e4449df-1293-4459-b37b-d792efe8cb4e tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:51.799559 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e4449df-1293-4459-b37b-d792efe8cb4e tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:51.800046 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e4449df-1293-4459-b37b-d792efe8cb4e tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:51.800467 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e4449df-1293-4459-b37b-d792efe8cb4e tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:51.815326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d1fc1784-7706-4914-b98f-bc5715239c0f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:51.827668 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d1fc1784-7706-4914-b98f-bc5715239c0f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:51.831783 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d1fc1784-7706-4914-b98f-bc5715239c0f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:51.844712 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d1fc1784-7706-4914-b98f-bc5715239c0f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1555 microversion: 2.91 time: 0.195762 Oct 26 13:19:51.852660 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2091/4162] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:51 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1555 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:19:51.881664 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0bf2fa5f-d6c1-4657-aeb7-1fd30127457a tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:51.882886 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0bf2fa5f-d6c1-4657-aeb7-1fd30127457a tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:51.898260 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0bf2fa5f-d6c1-4657-aeb7-1fd30127457a tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:51.898760 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0bf2fa5f-d6c1-4657-aeb7-1fd30127457a tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:51.899202 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0bf2fa5f-d6c1-4657-aeb7-1fd30127457a tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:51.899916 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0bf2fa5f-d6c1-4657-aeb7-1fd30127457a tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:51.900370 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0bf2fa5f-d6c1-4657-aeb7-1fd30127457a tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:51.900796 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0bf2fa5f-d6c1-4657-aeb7-1fd30127457a tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:52.024416 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0bf2fa5f-d6c1-4657-aeb7-1fd30127457a tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:52.026790 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=90,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2,nova_cell1:DELETE=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:19:52.047421 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0bf2fa5f-d6c1-4657-aeb7-1fd30127457a tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:52.051487 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0bf2fa5f-d6c1-4657-aeb7-1fd30127457a tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:52.054344 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0bf2fa5f-d6c1-4657-aeb7-1fd30127457a tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1604 microversion: 2.42 time: 0.187578 Oct 26 13:19:52.069511 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2092/4163] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:51 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1604 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:52.069511 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-154b5f2e-326f-4541-b0ac-cdd7a1a2b79e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:52.069511 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-154b5f2e-326f-4541-b0ac-cdd7a1a2b79e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 798f0deb-3412-479f-bf6b-d11872c9f680] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:52.080572 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-154b5f2e-326f-4541-b0ac-cdd7a1a2b79e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:52.080572 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-154b5f2e-326f-4541-b0ac-cdd7a1a2b79e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:52.081906 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-154b5f2e-326f-4541-b0ac-cdd7a1a2b79e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:52.100429 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-154b5f2e-326f-4541-b0ac-cdd7a1a2b79e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:52.101279 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-154b5f2e-326f-4541-b0ac-cdd7a1a2b79e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:52.102216 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-154b5f2e-326f-4541-b0ac-cdd7a1a2b79e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:52.126117 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2e4449df-1293-4459-b37b-d792efe8cb4e tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0d11e415d94d0b904eb901f421f6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69892d7a76e94fcfbe4b5541a022e220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:52.136771 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2e4449df-1293-4459-b37b-d792efe8cb4e tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db0d11e415d94d0b904eb901f421f6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69892d7a76e94fcfbe4b5541a022e220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:52.140264 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2e4449df-1293-4459-b37b-d792efe8cb4e tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db0d11e415d94d0b904eb901f421f6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69892d7a76e94fcfbe4b5541a022e220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:52.141542 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2e4449df-1293-4459-b37b-d792efe8cb4e tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] 10.222.0.40 "GET /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff" status: 200 len: 1551 microversion: 2.26 time: 0.355727 Oct 26 13:19:52.158272 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2072/4164] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:51 2022] GET /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff => generated 1551 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:52.280621 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-154b5f2e-326f-4541-b0ac-cdd7a1a2b79e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:52.289301 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-154b5f2e-326f-4541-b0ac-cdd7a1a2b79e tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680" status: 200 len: 1492 microversion: 2.1 time: 0.229372 Oct 26 13:19:52.289926 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2093/4165] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:52 2022] GET /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680 => generated 1492 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:52.317893 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5bf54c5d-243a-4705-9931-34ba090984b6 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:52.318857 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5bf54c5d-243a-4705-9931-34ba090984b6 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 798f0deb-3412-479f-bf6b-d11872c9f680] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:52.331426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bf54c5d-243a-4705-9931-34ba090984b6 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:52.332038 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bf54c5d-243a-4705-9931-34ba090984b6 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:52.332609 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bf54c5d-243a-4705-9931-34ba090984b6 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:52.333440 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bf54c5d-243a-4705-9931-34ba090984b6 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:52.334679 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bf54c5d-243a-4705-9931-34ba090984b6 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:52.335490 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bf54c5d-243a-4705-9931-34ba090984b6 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:52.369338 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5bf54c5d-243a-4705-9931-34ba090984b6 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 798f0deb-3412-479f-bf6b-d11872c9f680] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:19:52.469552 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:19:52.476134 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5bf54c5d-243a-4705-9931-34ba090984b6 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "DELETE /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680" status: 204 len: 0 microversion: 2.1 time: 0.163932 Oct 26 13:19:52.476873 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2073/4166] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:19:52 2022] DELETE /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:19:52.485373 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b13e361e-03e3-48fd-94f7-ba81266f98a4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:52.487104 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b13e361e-03e3-48fd-94f7-ba81266f98a4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 798f0deb-3412-479f-bf6b-d11872c9f680] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:52.495587 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b13e361e-03e3-48fd-94f7-ba81266f98a4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:52.496086 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b13e361e-03e3-48fd-94f7-ba81266f98a4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:52.496590 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b13e361e-03e3-48fd-94f7-ba81266f98a4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:52.497849 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b13e361e-03e3-48fd-94f7-ba81266f98a4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:52.498316 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b13e361e-03e3-48fd-94f7-ba81266f98a4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:52.498746 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b13e361e-03e3-48fd-94f7-ba81266f98a4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:52.537879 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2df7e555-34c9-4479-a9e6-3f5b94cda385 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:52.538781 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2df7e555-34c9-4479-a9e6-3f5b94cda385 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 53426b7d-0bba-46ce-ab7e-32451f413745] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:52.550572 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2df7e555-34c9-4479-a9e6-3f5b94cda385 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:52.551062 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2df7e555-34c9-4479-a9e6-3f5b94cda385 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:52.551520 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2df7e555-34c9-4479-a9e6-3f5b94cda385 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:52.568309 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2df7e555-34c9-4479-a9e6-3f5b94cda385 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:52.569973 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2df7e555-34c9-4479-a9e6-3f5b94cda385 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:52.574151 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2df7e555-34c9-4479-a9e6-3f5b94cda385 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:52.710126 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b13e361e-03e3-48fd-94f7-ba81266f98a4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:52.728475 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b13e361e-03e3-48fd-94f7-ba81266f98a4 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680" status: 200 len: 1498 microversion: 2.1 time: 0.247105 Oct 26 13:19:52.730501 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2094/4167] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:52 2022] GET /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680 => generated 1498 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:19:52.857516 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2df7e555-34c9-4479-a9e6-3f5b94cda385 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:52.865423 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2df7e555-34c9-4479-a9e6-3f5b94cda385 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745" status: 200 len: 1321 microversion: 2.1 time: 0.332952 Oct 26 13:19:52.866901 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2074/4168] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:52 2022] GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745 => generated 1321 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:52.884814 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9cdd3ce7-0c05-4baf-a80c-41e3ca6daa7f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:52.888420 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9cdd3ce7-0c05-4baf-a80c-41e3ca6daa7f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:52.905755 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9cdd3ce7-0c05-4baf-a80c-41e3ca6daa7f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:52.908621 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9cdd3ce7-0c05-4baf-a80c-41e3ca6daa7f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:52.909404 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9cdd3ce7-0c05-4baf-a80c-41e3ca6daa7f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:52.910479 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9cdd3ce7-0c05-4baf-a80c-41e3ca6daa7f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:52.912036 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9cdd3ce7-0c05-4baf-a80c-41e3ca6daa7f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:52.913280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9cdd3ce7-0c05-4baf-a80c-41e3ca6daa7f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:53.010903 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9cdd3ce7-0c05-4baf-a80c-41e3ca6daa7f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:53.020843 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9cdd3ce7-0c05-4baf-a80c-41e3ca6daa7f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:53.023397 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9cdd3ce7-0c05-4baf-a80c-41e3ca6daa7f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:53.029977 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9cdd3ce7-0c05-4baf-a80c-41e3ca6daa7f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1555 microversion: 2.91 time: 0.150940 Oct 26 13:19:53.046221 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2095/4169] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:52 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1555 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:53.089938 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-70749981-1b8a-4651-a2ae-cb0b727c0672 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:53.090715 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-70749981-1b8a-4651-a2ae-cb0b727c0672 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:53.097898 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-70749981-1b8a-4651-a2ae-cb0b727c0672 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:53.098517 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-70749981-1b8a-4651-a2ae-cb0b727c0672 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:53.099000 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-70749981-1b8a-4651-a2ae-cb0b727c0672 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:53.100454 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-70749981-1b8a-4651-a2ae-cb0b727c0672 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:53.101522 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-70749981-1b8a-4651-a2ae-cb0b727c0672 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:53.101987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-70749981-1b8a-4651-a2ae-cb0b727c0672 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:53.171836 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f0d11e8c-83a3-4832-b608-038f5d0e3222 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:53.172677 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f0d11e8c-83a3-4832-b608-038f5d0e3222 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] [instance: d3605776-7db3-44b2-acdc-8023126131ff] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:53.211203 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0d11e8c-83a3-4832-b608-038f5d0e3222 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:53.212809 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0d11e8c-83a3-4832-b608-038f5d0e3222 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:53.213327 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0d11e8c-83a3-4832-b608-038f5d0e3222 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:53.214149 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0d11e8c-83a3-4832-b608-038f5d0e3222 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:53.214730 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0d11e8c-83a3-4832-b608-038f5d0e3222 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:53.215425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0d11e8c-83a3-4832-b608-038f5d0e3222 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:53.232220 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-70749981-1b8a-4651-a2ae-cb0b727c0672 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:53.246621 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-70749981-1b8a-4651-a2ae-cb0b727c0672 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:53.251507 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-70749981-1b8a-4651-a2ae-cb0b727c0672 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:53.254348 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-70749981-1b8a-4651-a2ae-cb0b727c0672 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1604 microversion: 2.42 time: 0.168591 Oct 26 13:19:53.255819 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2075/4170] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:53 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1604 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:53.415086 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f0d11e8c-83a3-4832-b608-038f5d0e3222 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0d11e415d94d0b904eb901f421f6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69892d7a76e94fcfbe4b5541a022e220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:53.429376 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f0d11e8c-83a3-4832-b608-038f5d0e3222 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db0d11e415d94d0b904eb901f421f6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69892d7a76e94fcfbe4b5541a022e220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:53.433543 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f0d11e8c-83a3-4832-b608-038f5d0e3222 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db0d11e415d94d0b904eb901f421f6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69892d7a76e94fcfbe4b5541a022e220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:53.435029 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f0d11e8c-83a3-4832-b608-038f5d0e3222 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] 10.222.0.40 "GET /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff" status: 200 len: 1551 microversion: 2.26 time: 0.267119 Oct 26 13:19:53.436177 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2096/4171] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:53 2022] GET /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff => generated 1551 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:19:53.754823 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9c4f0bd2-3d62-4299-91d1-67c898feee9c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:53.755616 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9c4f0bd2-3d62-4299-91d1-67c898feee9c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 798f0deb-3412-479f-bf6b-d11872c9f680] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:53.762721 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c4f0bd2-3d62-4299-91d1-67c898feee9c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:53.763321 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c4f0bd2-3d62-4299-91d1-67c898feee9c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:53.763856 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c4f0bd2-3d62-4299-91d1-67c898feee9c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:53.764676 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c4f0bd2-3d62-4299-91d1-67c898feee9c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:53.765239 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c4f0bd2-3d62-4299-91d1-67c898feee9c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:53.765768 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c4f0bd2-3d62-4299-91d1-67c898feee9c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:53.898178 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8d68aa0e-810c-42de-b32c-51e9593ebf0d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:53.898791 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8d68aa0e-810c-42de-b32c-51e9593ebf0d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 53426b7d-0bba-46ce-ab7e-32451f413745] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:53.907553 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d68aa0e-810c-42de-b32c-51e9593ebf0d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:53.908042 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d68aa0e-810c-42de-b32c-51e9593ebf0d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:53.908485 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d68aa0e-810c-42de-b32c-51e9593ebf0d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:53.909190 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d68aa0e-810c-42de-b32c-51e9593ebf0d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:53.909680 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d68aa0e-810c-42de-b32c-51e9593ebf0d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:53.910104 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d68aa0e-810c-42de-b32c-51e9593ebf0d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:53.963382 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9c4f0bd2-3d62-4299-91d1-67c898feee9c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:53.974675 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9c4f0bd2-3d62-4299-91d1-67c898feee9c tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680" status: 200 len: 1498 microversion: 2.1 time: 0.223677 Oct 26 13:19:53.978487 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2076/4172] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:53 2022] GET /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680 => generated 1498 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:54.062602 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5efca526-3436-4a4b-bdb9-8de98cdd2bbf tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:54.064217 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5efca526-3436-4a4b-bdb9-8de98cdd2bbf tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:54.080084 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5efca526-3436-4a4b-bdb9-8de98cdd2bbf tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:54.087400 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5efca526-3436-4a4b-bdb9-8de98cdd2bbf tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:54.089908 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5efca526-3436-4a4b-bdb9-8de98cdd2bbf tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:54.090998 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8d68aa0e-810c-42de-b32c-51e9593ebf0d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:54.092183 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5efca526-3436-4a4b-bdb9-8de98cdd2bbf tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:54.099041 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5efca526-3436-4a4b-bdb9-8de98cdd2bbf tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:54.099605 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5efca526-3436-4a4b-bdb9-8de98cdd2bbf tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:54.109578 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8d68aa0e-810c-42de-b32c-51e9593ebf0d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745" status: 200 len: 1321 microversion: 2.1 time: 0.218250 Oct 26 13:19:54.134277 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2097/4173] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:53 2022] GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745 => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:54.207984 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5efca526-3436-4a4b-bdb9-8de98cdd2bbf tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:54.220247 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5efca526-3436-4a4b-bdb9-8de98cdd2bbf tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:54.222200 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5efca526-3436-4a4b-bdb9-8de98cdd2bbf tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:54.229558 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5efca526-3436-4a4b-bdb9-8de98cdd2bbf tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1555 microversion: 2.91 time: 0.172204 Oct 26 13:19:54.241524 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2077/4174] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:54 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1555 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:19:54.285720 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-47800433-01ed-44e6-afc9-569f1192ede0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:54.286267 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-47800433-01ed-44e6-afc9-569f1192ede0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:54.292386 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47800433-01ed-44e6-afc9-569f1192ede0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:54.293132 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47800433-01ed-44e6-afc9-569f1192ede0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:54.293592 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47800433-01ed-44e6-afc9-569f1192ede0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:54.294549 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47800433-01ed-44e6-afc9-569f1192ede0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:54.295504 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47800433-01ed-44e6-afc9-569f1192ede0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:54.296158 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47800433-01ed-44e6-afc9-569f1192ede0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:54.364450 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-47800433-01ed-44e6-afc9-569f1192ede0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:54.374092 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-47800433-01ed-44e6-afc9-569f1192ede0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:54.375555 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-47800433-01ed-44e6-afc9-569f1192ede0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:54.376739 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-47800433-01ed-44e6-afc9-569f1192ede0 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1604 microversion: 2.42 time: 0.095662 Oct 26 13:19:54.395560 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2098/4175] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:54 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1604 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:54.466807 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2fa04596-8c3c-419f-b2bf-d16b57f3a86d tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:54.467383 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2fa04596-8c3c-419f-b2bf-d16b57f3a86d tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] [instance: d3605776-7db3-44b2-acdc-8023126131ff] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:54.474362 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2fa04596-8c3c-419f-b2bf-d16b57f3a86d tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:54.474896 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2fa04596-8c3c-419f-b2bf-d16b57f3a86d tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:54.475398 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2fa04596-8c3c-419f-b2bf-d16b57f3a86d tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:54.476174 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2fa04596-8c3c-419f-b2bf-d16b57f3a86d tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:54.476641 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2fa04596-8c3c-419f-b2bf-d16b57f3a86d tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:54.477077 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2fa04596-8c3c-419f-b2bf-d16b57f3a86d tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:54.661140 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2fa04596-8c3c-419f-b2bf-d16b57f3a86d tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0d11e415d94d0b904eb901f421f6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69892d7a76e94fcfbe4b5541a022e220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:54.669637 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2fa04596-8c3c-419f-b2bf-d16b57f3a86d tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db0d11e415d94d0b904eb901f421f6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69892d7a76e94fcfbe4b5541a022e220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:54.671088 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2fa04596-8c3c-419f-b2bf-d16b57f3a86d tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db0d11e415d94d0b904eb901f421f6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69892d7a76e94fcfbe4b5541a022e220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:54.672279 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2fa04596-8c3c-419f-b2bf-d16b57f3a86d tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] 10.222.0.40 "GET /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff" status: 200 len: 1551 microversion: 2.26 time: 0.209692 Oct 26 13:19:54.672851 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2078/4176] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:54 2022] GET /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff => generated 1551 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:55.002574 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-803fe59c-a28a-4dfa-881e-b3fc1ae1edf6 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:55.003267 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-803fe59c-a28a-4dfa-881e-b3fc1ae1edf6 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 798f0deb-3412-479f-bf6b-d11872c9f680] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:55.006313 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:19:55.018859 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-803fe59c-a28a-4dfa-881e-b3fc1ae1edf6 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:55.019467 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-803fe59c-a28a-4dfa-881e-b3fc1ae1edf6 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:55.019986 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-803fe59c-a28a-4dfa-881e-b3fc1ae1edf6 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:55.025414 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-803fe59c-a28a-4dfa-881e-b3fc1ae1edf6 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:55.026368 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-803fe59c-a28a-4dfa-881e-b3fc1ae1edf6 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:55.027878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-803fe59c-a28a-4dfa-881e-b3fc1ae1edf6 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:55.141952 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4f8246ec-1c32-4e1f-be99-52774875527a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:55.142819 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4f8246ec-1c32-4e1f-be99-52774875527a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 53426b7d-0bba-46ce-ab7e-32451f413745] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:55.159489 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f8246ec-1c32-4e1f-be99-52774875527a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:55.162539 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f8246ec-1c32-4e1f-be99-52774875527a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:55.163312 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f8246ec-1c32-4e1f-be99-52774875527a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:55.165092 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f8246ec-1c32-4e1f-be99-52774875527a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:55.167008 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f8246ec-1c32-4e1f-be99-52774875527a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:55.169910 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f8246ec-1c32-4e1f-be99-52774875527a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:55.203879 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=3,nova_cell1:RELEASE=1,nova_cell1:UPDATE=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:19:55.433716 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4f8246ec-1c32-4e1f-be99-52774875527a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:55.444598 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4f8246ec-1c32-4e1f-be99-52774875527a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745" status: 200 len: 1321 microversion: 2.1 time: 0.306569 Oct 26 13:19:55.449829 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2079/4177] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:55 2022] GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745 => generated 1321 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:19:55.454660 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-efdef609-118f-400b-878a-d09df8809bea req-77fc0c86-f6da-4572-8087-ae553db161a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53426b7d-0bba-46ce-ab7e-32451f413745", "name": "network-vif-plugged", "status": "completed", "tag": "db0d2628-762c-46cd-b5ff-d3ca7355ba01"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:19:55.488063 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-efdef609-118f-400b-878a-d09df8809bea req-77fc0c86-f6da-4572-8087-ae553db161a1 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:55.488973 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-efdef609-118f-400b-878a-d09df8809bea req-77fc0c86-f6da-4572-8087-ae553db161a1 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:55.489558 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-efdef609-118f-400b-878a-d09df8809bea req-77fc0c86-f6da-4572-8087-ae553db161a1 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:55.508271 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-efdef609-118f-400b-878a-d09df8809bea req-77fc0c86-f6da-4572-8087-ae553db161a1 service nova] Creating event network-vif-plugged:db0d2628-762c-46cd-b5ff-d3ca7355ba01 for instance 53426b7d-0bba-46ce-ab7e-32451f413745 on n-h1-862686-1 Oct 26 13:19:55.517304 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-efdef609-118f-400b-878a-d09df8809bea req-77fc0c86-f6da-4572-8087-ae553db161a1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065596 Oct 26 13:19:55.518574 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2080/4178] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:19:55.525647 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c41cc428-e31c-45ad-abf7-73113bf7fbd7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:55.526711 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c41cc428-e31c-45ad-abf7-73113bf7fbd7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:55.534297 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c41cc428-e31c-45ad-abf7-73113bf7fbd7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:55.534968 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c41cc428-e31c-45ad-abf7-73113bf7fbd7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:55.535508 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c41cc428-e31c-45ad-abf7-73113bf7fbd7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:55.536560 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c41cc428-e31c-45ad-abf7-73113bf7fbd7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:55.536917 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c41cc428-e31c-45ad-abf7-73113bf7fbd7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:55.538093 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c41cc428-e31c-45ad-abf7-73113bf7fbd7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:55.653976 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c41cc428-e31c-45ad-abf7-73113bf7fbd7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:55.678672 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c41cc428-e31c-45ad-abf7-73113bf7fbd7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:55.683800 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c41cc428-e31c-45ad-abf7-73113bf7fbd7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:55.698793 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c41cc428-e31c-45ad-abf7-73113bf7fbd7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1555 microversion: 2.91 time: 0.178634 Oct 26 13:19:55.700117 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2081/4179] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:55 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1555 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:55.706305 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dbb174a6-36f8-464a-9583-4bab69e8dc0b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:55.713339 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-dbb174a6-36f8-464a-9583-4bab69e8dc0b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:55.734740 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dbb174a6-36f8-464a-9583-4bab69e8dc0b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:55.735953 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dbb174a6-36f8-464a-9583-4bab69e8dc0b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:55.737180 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dbb174a6-36f8-464a-9583-4bab69e8dc0b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:55.741392 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dbb174a6-36f8-464a-9583-4bab69e8dc0b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:55.741392 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dbb174a6-36f8-464a-9583-4bab69e8dc0b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:55.741392 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dbb174a6-36f8-464a-9583-4bab69e8dc0b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:55.851106 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dbb174a6-36f8-464a-9583-4bab69e8dc0b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:55.866359 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dbb174a6-36f8-464a-9583-4bab69e8dc0b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:55.873765 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dbb174a6-36f8-464a-9583-4bab69e8dc0b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:55.874368 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-dbb174a6-36f8-464a-9583-4bab69e8dc0b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lazy-loading 'fault' on Instance uuid b5fa9733-f49b-43ab-8586-68d113b73476 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:19:55.918221 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-803fe59c-a28a-4dfa-881e-b3fc1ae1edf6 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:55.929517 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-803fe59c-a28a-4dfa-881e-b3fc1ae1edf6 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680" status: 200 len: 1498 microversion: 2.1 time: 0.930838 Oct 26 13:19:55.941793 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2099/4180] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:54 2022] GET /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680 => generated 1498 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:55.945069 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-eadfe402-de4b-4ada-8e22-5d3419902158 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:55.946049 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-eadfe402-de4b-4ada-8e22-5d3419902158 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] [instance: d3605776-7db3-44b2-acdc-8023126131ff] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:55.961803 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eadfe402-de4b-4ada-8e22-5d3419902158 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:55.963216 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eadfe402-de4b-4ada-8e22-5d3419902158 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:55.965455 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eadfe402-de4b-4ada-8e22-5d3419902158 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:55.967510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eadfe402-de4b-4ada-8e22-5d3419902158 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:55.969658 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eadfe402-de4b-4ada-8e22-5d3419902158 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:55.971284 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eadfe402-de4b-4ada-8e22-5d3419902158 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:55.981715 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-dbb174a6-36f8-464a-9583-4bab69e8dc0b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:55.992333 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-dbb174a6-36f8-464a-9583-4bab69e8dc0b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:56.003403 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-dbb174a6-36f8-464a-9583-4bab69e8dc0b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd09f69ec8c514a6789ede382cdbdbebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de138b5bb5ac44c9be139ab7ceb26a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:56.004856 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-dbb174a6-36f8-464a-9583-4bab69e8dc0b tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 200 len: 1371 microversion: 2.42 time: 0.303473 Oct 26 13:19:56.030764 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2082/4181] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:55 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 1371 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:56.030764 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-3c2ae075-5598-4657-bc83-6240a7ba16ee req-09131497-ab95-4ee4-b1a6-f4f33ba71dcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3605776-7db3-44b2-acdc-8023126131ff", "name": "network-vif-deleted", "tag": "f5641673-c057-4ee7-8f80-b811c5d64916"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:19:56.040329 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eadfe402-de4b-4ada-8e22-5d3419902158 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:56.040924 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eadfe402-de4b-4ada-8e22-5d3419902158 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:56.041370 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eadfe402-de4b-4ada-8e22-5d3419902158 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:56.041879 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-eadfe402-de4b-4ada-8e22-5d3419902158 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lazy-loading 'fault' on Instance uuid d3605776-7db3-44b2-acdc-8023126131ff {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:19:56.066354 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-3c2ae075-5598-4657-bc83-6240a7ba16ee req-09131497-ab95-4ee4-b1a6-f4f33ba71dcb service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:56.067000 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-3c2ae075-5598-4657-bc83-6240a7ba16ee req-09131497-ab95-4ee4-b1a6-f4f33ba71dcb service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:56.067709 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-3c2ae075-5598-4657-bc83-6240a7ba16ee req-09131497-ab95-4ee4-b1a6-f4f33ba71dcb service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:56.096851 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-3c2ae075-5598-4657-bc83-6240a7ba16ee req-09131497-ab95-4ee4-b1a6-f4f33ba71dcb service nova] Creating event network-vif-deleted:f5641673-c057-4ee7-8f80-b811c5d64916 for instance d3605776-7db3-44b2-acdc-8023126131ff on n-h1-862686-1 Oct 26 13:19:56.102669 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-3c2ae075-5598-4657-bc83-6240a7ba16ee req-09131497-ab95-4ee4-b1a6-f4f33ba71dcb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082010 Oct 26 13:19:56.108040 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2083/4182] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:19:56.113451 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-7e44c164-eddb-413a-ba02-bcec0c4f8215 req-ef4ce068-2775-4ce6-994e-eb865a852afe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "798f0deb-3412-479f-bf6b-d11872c9f680", "name": "network-vif-deleted", "tag": "d3460729-599e-482a-a95d-fb9175204857"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:19:56.129678 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-7e44c164-eddb-413a-ba02-bcec0c4f8215 req-ef4ce068-2775-4ce6-994e-eb865a852afe service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:56.130337 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-7e44c164-eddb-413a-ba02-bcec0c4f8215 req-ef4ce068-2775-4ce6-994e-eb865a852afe service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:56.131566 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-7e44c164-eddb-413a-ba02-bcec0c4f8215 req-ef4ce068-2775-4ce6-994e-eb865a852afe service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:56.148686 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-eadfe402-de4b-4ada-8e22-5d3419902158 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0d11e415d94d0b904eb901f421f6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69892d7a76e94fcfbe4b5541a022e220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:56.156354 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-7e44c164-eddb-413a-ba02-bcec0c4f8215 req-ef4ce068-2775-4ce6-994e-eb865a852afe service nova] Creating event network-vif-deleted:d3460729-599e-482a-a95d-fb9175204857 for instance 798f0deb-3412-479f-bf6b-d11872c9f680 on n-h1-862686-1 Oct 26 13:19:56.163667 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-7e44c164-eddb-413a-ba02-bcec0c4f8215 req-ef4ce068-2775-4ce6-994e-eb865a852afe service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054065 Oct 26 13:19:56.165071 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2084/4183] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:19:56.166255 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-eadfe402-de4b-4ada-8e22-5d3419902158 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db0d11e415d94d0b904eb901f421f6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69892d7a76e94fcfbe4b5541a022e220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:56.168209 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-eadfe402-de4b-4ada-8e22-5d3419902158 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db0d11e415d94d0b904eb901f421f6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69892d7a76e94fcfbe4b5541a022e220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:56.169455 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-eadfe402-de4b-4ada-8e22-5d3419902158 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] 10.222.0.40 "GET /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff" status: 200 len: 1352 microversion: 2.26 time: 0.237811 Oct 26 13:19:56.170042 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2100/4184] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:55 2022] GET /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff => generated 1352 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:56.472839 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3e9d2096-ac85-4cfa-8b8c-9f8ff8fb3670 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:56.473777 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3e9d2096-ac85-4cfa-8b8c-9f8ff8fb3670 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 53426b7d-0bba-46ce-ab7e-32451f413745] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:56.483960 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3e9d2096-ac85-4cfa-8b8c-9f8ff8fb3670 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:56.484547 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3e9d2096-ac85-4cfa-8b8c-9f8ff8fb3670 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:56.485087 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3e9d2096-ac85-4cfa-8b8c-9f8ff8fb3670 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:56.485928 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3e9d2096-ac85-4cfa-8b8c-9f8ff8fb3670 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:56.486445 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3e9d2096-ac85-4cfa-8b8c-9f8ff8fb3670 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:56.486965 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3e9d2096-ac85-4cfa-8b8c-9f8ff8fb3670 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:56.647188 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3e9d2096-ac85-4cfa-8b8c-9f8ff8fb3670 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:56.656404 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3e9d2096-ac85-4cfa-8b8c-9f8ff8fb3670 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745" status: 200 len: 1321 microversion: 2.1 time: 0.187812 Oct 26 13:19:56.657228 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2085/4185] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:56 2022] GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745 => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:56.729980 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-32ae1619-9536-4347-ae3d-4bf2aeebc239 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:56.730590 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-32ae1619-9536-4347-ae3d-4bf2aeebc239 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:56.744575 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32ae1619-9536-4347-ae3d-4bf2aeebc239 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:56.745621 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32ae1619-9536-4347-ae3d-4bf2aeebc239 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:56.746076 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32ae1619-9536-4347-ae3d-4bf2aeebc239 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:56.746807 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32ae1619-9536-4347-ae3d-4bf2aeebc239 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:56.747271 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32ae1619-9536-4347-ae3d-4bf2aeebc239 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:56.747708 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32ae1619-9536-4347-ae3d-4bf2aeebc239 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:56.838372 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-32ae1619-9536-4347-ae3d-4bf2aeebc239 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:56.851380 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-32ae1619-9536-4347-ae3d-4bf2aeebc239 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:56.853694 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-32ae1619-9536-4347-ae3d-4bf2aeebc239 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:56.860360 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-32ae1619-9536-4347-ae3d-4bf2aeebc239 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1555 microversion: 2.91 time: 0.134366 Oct 26 13:19:56.860946 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2101/4186] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:56 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1555 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:56.956836 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0c58166e-3448-48df-9dd2-606737aeb2dd tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:56.957874 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0c58166e-3448-48df-9dd2-606737aeb2dd tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 798f0deb-3412-479f-bf6b-d11872c9f680] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:56.965722 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c58166e-3448-48df-9dd2-606737aeb2dd tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:56.966310 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c58166e-3448-48df-9dd2-606737aeb2dd tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:56.966825 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c58166e-3448-48df-9dd2-606737aeb2dd tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:56.967606 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c58166e-3448-48df-9dd2-606737aeb2dd tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:56.968160 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c58166e-3448-48df-9dd2-606737aeb2dd tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:56.968721 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c58166e-3448-48df-9dd2-606737aeb2dd tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:57.004206 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c58166e-3448-48df-9dd2-606737aeb2dd tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:57.004966 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c58166e-3448-48df-9dd2-606737aeb2dd tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:57.005662 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c58166e-3448-48df-9dd2-606737aeb2dd tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:57.006715 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-0c58166e-3448-48df-9dd2-606737aeb2dd tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lazy-loading 'fault' on Instance uuid 798f0deb-3412-479f-bf6b-d11872c9f680 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:19:57.042777 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b46afe23-fd4d-4ba7-a79b-1a8bddc92abd tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:57.044403 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b46afe23-fd4d-4ba7-a79b-1a8bddc92abd tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:57.051735 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b46afe23-fd4d-4ba7-a79b-1a8bddc92abd tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:57.052492 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b46afe23-fd4d-4ba7-a79b-1a8bddc92abd tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:57.054086 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b46afe23-fd4d-4ba7-a79b-1a8bddc92abd tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:57.054808 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b46afe23-fd4d-4ba7-a79b-1a8bddc92abd tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:57.055265 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b46afe23-fd4d-4ba7-a79b-1a8bddc92abd tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:57.057983 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b46afe23-fd4d-4ba7-a79b-1a8bddc92abd tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:57.060635 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0c58166e-3448-48df-9dd2-606737aeb2dd tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d56acbbbc3545d19cbb80f4e349c763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece49f83e645408598655bece0873fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:57.070771 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0c58166e-3448-48df-9dd2-606737aeb2dd tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680" status: 200 len: 1304 microversion: 2.1 time: 0.120238 Oct 26 13:19:57.073532 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2086/4187] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:56 2022] GET /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680 => generated 1304 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:57.075518 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-b46afe23-fd4d-4ba7-a79b-1a8bddc92abd tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] HTTP exception thrown: Instance b5fa9733-f49b-43ab-8586-68d113b73476 could not be found. Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b46afe23-fd4d-4ba7-a79b-1a8bddc92abd tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Request method failure captured: Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 HTTP/1.1 Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTJnfaV7EkMOl7x-unkxv9rOB7rVjZEcj262l0JhR041fOelsAVHPCAqeFcM9g08iS88HWWfMWQJF28oijsns10Vt1iYqoDgS_G-2JJsfX-pPHEHhksJuwWoNX_ymImmLW2dEIaW841cPzgwyJDGmPQ6HpqtzWZvXLoJUqPLV8PLTZo Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: X-Openstack-Nova-Api-Version: 2.42 Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: de138b5bb5ac44c9be139ab7ceb26a32 Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1759760870 Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/de138b5bb5ac44c9be139ab7ceb26a32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/de138b5bb5ac44c9be139ab7ceb26a32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_de138b5bb5ac44c9be139ab7ceb26a32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/de138b5bb5ac44c9be139ab7ceb26a32"}]}] Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1759760870 Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: de138b5bb5ac44c9be139ab7ceb26a32 Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1759760870 Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-TaggedBootDevicesTest_v242-1759760870-project Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: d09f69ec8c514a6789ede382cdbdbebb Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1759760870-project Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance b5fa9733-f49b-43ab-8586-68d113b73476 could not be found. Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'b5fa9733-f49b-43ab-8586-68d113b73476'} Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5fa9733-f49b-43ab-8586-68d113b73476 could not be found. Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5fa9733-f49b-43ab-8586-68d113b73476 could not be found. Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:19:57.077218 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:19:57.082390 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:19:57.082390 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:57.082390 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:19:57.082390 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:19:57.082390 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:19:57.082390 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:19:57.082390 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5fa9733-f49b-43ab-8586-68d113b73476 could not be found. Oct 26 13:19:57.082390 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:19:57.082390 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b46afe23-fd4d-4ba7-a79b-1a8bddc92abd tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Returning 404 to user: Instance b5fa9733-f49b-43ab-8586-68d113b73476 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:19:57.082390 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b46afe23-fd4d-4ba7-a79b-1a8bddc92abd tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 404 len: 111 microversion: 2.42 time: 0.040013 Oct 26 13:19:57.082390 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2102/4188] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:57 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 26 13:19:57.091372 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b4872048-d3a9-43b3-bcb7-8d97c03ac9b8 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '.version_select at 0x7f6731a07670>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:57.120271 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b4872048-d3a9-43b3-bcb7-8d97c03ac9b8 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1732132591" status: 204 len: 0 microversion: 2.42 time: 0.034064 Oct 26 13:19:57.124880 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2087/4189] 10.222.0.40 () {60 vars in 1262 bytes} [Wed Oct 26 13:19:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1732132591 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 13:19:57.196760 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e34c140c-7a88-4221-a477-c6b32dfd2aea tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:57.197707 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e34c140c-7a88-4221-a477-c6b32dfd2aea tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] [instance: d3605776-7db3-44b2-acdc-8023126131ff] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:57.221748 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e34c140c-7a88-4221-a477-c6b32dfd2aea tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:57.224000 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e34c140c-7a88-4221-a477-c6b32dfd2aea tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:57.225414 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e34c140c-7a88-4221-a477-c6b32dfd2aea tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:57.230478 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e34c140c-7a88-4221-a477-c6b32dfd2aea tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:57.231245 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e34c140c-7a88-4221-a477-c6b32dfd2aea tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:57.234437 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e34c140c-7a88-4221-a477-c6b32dfd2aea tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:57.322992 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e34c140c-7a88-4221-a477-c6b32dfd2aea tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:57.323949 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e34c140c-7a88-4221-a477-c6b32dfd2aea tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:57.324441 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e34c140c-7a88-4221-a477-c6b32dfd2aea tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:57.325366 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-e34c140c-7a88-4221-a477-c6b32dfd2aea tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lazy-loading 'fault' on Instance uuid d3605776-7db3-44b2-acdc-8023126131ff {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:19:57.423962 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e34c140c-7a88-4221-a477-c6b32dfd2aea tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0d11e415d94d0b904eb901f421f6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69892d7a76e94fcfbe4b5541a022e220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:57.432464 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e34c140c-7a88-4221-a477-c6b32dfd2aea tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db0d11e415d94d0b904eb901f421f6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69892d7a76e94fcfbe4b5541a022e220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:57.434157 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e34c140c-7a88-4221-a477-c6b32dfd2aea tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db0d11e415d94d0b904eb901f421f6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69892d7a76e94fcfbe4b5541a022e220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:57.435372 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e34c140c-7a88-4221-a477-c6b32dfd2aea tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] 10.222.0.40 "GET /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff" status: 200 len: 1352 microversion: 2.26 time: 0.243329 Oct 26 13:19:57.436245 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2103/4190] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:57 2022] GET /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff => generated 1352 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:57.684648 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b27ce814-5a99-4b56-9479-63dff3d1e896 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:57.686067 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b27ce814-5a99-4b56-9479-63dff3d1e896 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 53426b7d-0bba-46ce-ab7e-32451f413745] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:57.697196 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b27ce814-5a99-4b56-9479-63dff3d1e896 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:57.698203 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b27ce814-5a99-4b56-9479-63dff3d1e896 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:57.698894 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b27ce814-5a99-4b56-9479-63dff3d1e896 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:57.700056 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b27ce814-5a99-4b56-9479-63dff3d1e896 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:57.700954 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b27ce814-5a99-4b56-9479-63dff3d1e896 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:57.701811 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b27ce814-5a99-4b56-9479-63dff3d1e896 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:57.892984 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-291ad097-238a-442f-bd6b-af56c935d25a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:57.893721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-291ad097-238a-442f-bd6b-af56c935d25a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:57.905557 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-291ad097-238a-442f-bd6b-af56c935d25a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:57.906142 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-291ad097-238a-442f-bd6b-af56c935d25a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:57.912548 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-291ad097-238a-442f-bd6b-af56c935d25a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:57.913966 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-291ad097-238a-442f-bd6b-af56c935d25a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:57.914681 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-291ad097-238a-442f-bd6b-af56c935d25a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:57.915263 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-291ad097-238a-442f-bd6b-af56c935d25a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:57.934460 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b27ce814-5a99-4b56-9479-63dff3d1e896 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:57.944639 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b27ce814-5a99-4b56-9479-63dff3d1e896 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745" status: 200 len: 1516 microversion: 2.1 time: 0.264149 Oct 26 13:19:57.945817 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2088/4191] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:57 2022] GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745 => generated 1516 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:57.970930 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0efe0922-14e5-4a20-aefc-dd37229b0a09 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:19:57.973763 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0efe0922-14e5-4a20-aefc-dd37229b0a09 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 53426b7d-0bba-46ce-ab7e-32451f413745] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:57.987224 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0efe0922-14e5-4a20-aefc-dd37229b0a09 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:57.987727 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0efe0922-14e5-4a20-aefc-dd37229b0a09 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:57.988174 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0efe0922-14e5-4a20-aefc-dd37229b0a09 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:57.988883 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0efe0922-14e5-4a20-aefc-dd37229b0a09 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:57.989343 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0efe0922-14e5-4a20-aefc-dd37229b0a09 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:57.989803 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0efe0922-14e5-4a20-aefc-dd37229b0a09 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:57.998372 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-291ad097-238a-442f-bd6b-af56c935d25a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:58.008848 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-291ad097-238a-442f-bd6b-af56c935d25a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:58.010498 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-291ad097-238a-442f-bd6b-af56c935d25a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:58.017340 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-291ad097-238a-442f-bd6b-af56c935d25a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1555 microversion: 2.91 time: 0.128956 Oct 26 13:19:58.019107 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2104/4192] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:57 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1555 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:58.040492 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-0efe0922-14e5-4a20-aefc-dd37229b0a09 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lazy-loading 'flavor' on Instance uuid 53426b7d-0bba-46ce-ab7e-32451f413745 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:19:58.098801 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f059e557-b786-474a-84d5-f5c9c2551e88 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:58.099939 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f059e557-b786-474a-84d5-f5c9c2551e88 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 798f0deb-3412-479f-bf6b-d11872c9f680] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:58.107832 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f059e557-b786-474a-84d5-f5c9c2551e88 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:58.108585 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f059e557-b786-474a-84d5-f5c9c2551e88 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:58.109176 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f059e557-b786-474a-84d5-f5c9c2551e88 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:58.110147 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f059e557-b786-474a-84d5-f5c9c2551e88 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:58.110803 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f059e557-b786-474a-84d5-f5c9c2551e88 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:58.111383 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f059e557-b786-474a-84d5-f5c9c2551e88 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:58.145627 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-f059e557-b786-474a-84d5-f5c9c2551e88 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] HTTP exception thrown: Instance 798f0deb-3412-479f-bf6b-d11872c9f680 could not be found. Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f059e557-b786-474a-84d5-f5c9c2551e88 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Request method failure captured: Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680 HTTP/1.1 Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTLTNOlsUS_LQCwMyQbAmNSS-N_AQOqf9a-vHlBM4RS64aXMIGczutoYb0yXKXV63kqVyJMbrGhj1O0dIymI3rB4OYRTseWpFfzGHfB9PKKsR2NnI_ukYFvVdYRwcazuK9kTcZsmuh-2k9d7Yqn3gprd7n0NXcu2P16gbCixvzOdrAQ Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: ece49f83e645408598655bece0873fd0 Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ece49f83e645408598655bece0873fd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ece49f83e645408598655bece0873fd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ece49f83e645408598655bece0873fd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ece49f83e645408598655bece0873fd0"}]}] Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: ece49f83e645408598655bece0873fd0 Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-DeleteServersTestJSON-1847538505-project Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 8d56acbbbc3545d19cbb80f4e349c763 Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-DeleteServersTestJSON-1847538505-project Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 798f0deb-3412-479f-bf6b-d11872c9f680 could not be found. Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '798f0deb-3412-479f-bf6b-d11872c9f680'} Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 798f0deb-3412-479f-bf6b-d11872c9f680 could not be found. Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 798f0deb-3412-479f-bf6b-d11872c9f680 could not be found. Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:19:58.149958 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.154613 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:58.154613 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:19:58.154613 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:19:58.154613 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:19:58.154613 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:19:58.154613 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 798f0deb-3412-479f-bf6b-d11872c9f680 could not be found. Oct 26 13:19:58.154613 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.156897 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f059e557-b786-474a-84d5-f5c9c2551e88 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Returning 404 to user: Instance 798f0deb-3412-479f-bf6b-d11872c9f680 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:19:58.158036 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f059e557-b786-474a-84d5-f5c9c2551e88 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680" status: 404 len: 111 microversion: 2.1 time: 0.063261 Oct 26 13:19:58.160962 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0efe0922-14e5-4a20-aefc-dd37229b0a09 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "POST /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745/action" status: 200 len: 32 microversion: 2.1 time: 0.194296 Oct 26 13:19:58.162702 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2089/4193] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:19:57 2022] POST /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745/action => generated 32 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 26 13:19:58.165084 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2105/4194] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:58 2022] GET /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:19:58.173233 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c60711f2-6934-4d18-93dd-e91d5bc1e5ca tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:58.173860 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c60711f2-6934-4d18-93dd-e91d5bc1e5ca tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 798f0deb-3412-479f-bf6b-d11872c9f680] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:58.184009 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-78cec89d-03fb-4f5c-82ed-c9c26d0d0943 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:58.184260 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c60711f2-6934-4d18-93dd-e91d5bc1e5ca tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:58.184662 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c60711f2-6934-4d18-93dd-e91d5bc1e5ca tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:58.185163 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c60711f2-6934-4d18-93dd-e91d5bc1e5ca tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:58.186164 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c60711f2-6934-4d18-93dd-e91d5bc1e5ca tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:58.186800 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c60711f2-6934-4d18-93dd-e91d5bc1e5ca tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:58.187498 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-78cec89d-03fb-4f5c-82ed-c9c26d0d0943 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 53426b7d-0bba-46ce-ab7e-32451f413745] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:58.188256 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c60711f2-6934-4d18-93dd-e91d5bc1e5ca tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:58.196795 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78cec89d-03fb-4f5c-82ed-c9c26d0d0943 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:58.197705 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78cec89d-03fb-4f5c-82ed-c9c26d0d0943 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:58.198403 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78cec89d-03fb-4f5c-82ed-c9c26d0d0943 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:58.199358 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78cec89d-03fb-4f5c-82ed-c9c26d0d0943 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:58.200033 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78cec89d-03fb-4f5c-82ed-c9c26d0d0943 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:58.200682 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78cec89d-03fb-4f5c-82ed-c9c26d0d0943 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:58.223635 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-c60711f2-6934-4d18-93dd-e91d5bc1e5ca tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] HTTP exception thrown: Instance 798f0deb-3412-479f-bf6b-d11872c9f680 could not be found. Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c60711f2-6934-4d18-93dd-e91d5bc1e5ca tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Request method failure captured: Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680 HTTP/1.1 Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTLTNOlsUS_LQCwMyQbAmNSS-N_AQOqf9a-vHlBM4RS64aXMIGczutoYb0yXKXV63kqVyJMbrGhj1O0dIymI3rB4OYRTseWpFfzGHfB9PKKsR2NnI_ukYFvVdYRwcazuK9kTcZsmuh-2k9d7Yqn3gprd7n0NXcu2P16gbCixvzOdrAQ Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: ece49f83e645408598655bece0873fd0 Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ece49f83e645408598655bece0873fd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ece49f83e645408598655bece0873fd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ece49f83e645408598655bece0873fd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ece49f83e645408598655bece0873fd0"}]}] Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: ece49f83e645408598655bece0873fd0 Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-DeleteServersTestJSON-1847538505-project Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 8d56acbbbc3545d19cbb80f4e349c763 Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-DeleteServersTestJSON-1847538505-project Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 798f0deb-3412-479f-bf6b-d11872c9f680 could not be found. Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '798f0deb-3412-479f-bf6b-d11872c9f680'} Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 798f0deb-3412-479f-bf6b-d11872c9f680 could not be found. Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:19:58.234803 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:19:58.240370 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 798f0deb-3412-479f-bf6b-d11872c9f680 could not be found. Oct 26 13:19:58.240370 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.240370 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:19:58.240370 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.240370 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:58.240370 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:19:58.240370 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:19:58.240370 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:19:58.240370 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:19:58.240370 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 798f0deb-3412-479f-bf6b-d11872c9f680 could not be found. Oct 26 13:19:58.240370 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.242368 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c60711f2-6934-4d18-93dd-e91d5bc1e5ca tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Returning 404 to user: Instance 798f0deb-3412-479f-bf6b-d11872c9f680 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:19:58.243443 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c60711f2-6934-4d18-93dd-e91d5bc1e5ca tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "DELETE /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680" status: 404 len: 111 microversion: 2.1 time: 0.074456 Oct 26 13:19:58.244399 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2090/4195] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:19:58 2022] DELETE /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:19:58.257298 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d399154a-e700-4178-86b0-02c00116a875 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:58.257943 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d399154a-e700-4178-86b0-02c00116a875 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 798f0deb-3412-479f-bf6b-d11872c9f680] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:58.264344 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d399154a-e700-4178-86b0-02c00116a875 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:58.264852 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d399154a-e700-4178-86b0-02c00116a875 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:58.265301 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d399154a-e700-4178-86b0-02c00116a875 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:58.266128 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d399154a-e700-4178-86b0-02c00116a875 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:58.266895 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d399154a-e700-4178-86b0-02c00116a875 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:58.267852 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d399154a-e700-4178-86b0-02c00116a875 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:58.286220 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-d399154a-e700-4178-86b0-02c00116a875 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] HTTP exception thrown: Instance 798f0deb-3412-479f-bf6b-d11872c9f680 could not be found. Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d399154a-e700-4178-86b0-02c00116a875 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Request method failure captured: Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680 HTTP/1.1 Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTLTNOlsUS_LQCwMyQbAmNSS-N_AQOqf9a-vHlBM4RS64aXMIGczutoYb0yXKXV63kqVyJMbrGhj1O0dIymI3rB4OYRTseWpFfzGHfB9PKKsR2NnI_ukYFvVdYRwcazuK9kTcZsmuh-2k9d7Yqn3gprd7n0NXcu2P16gbCixvzOdrAQ Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: ece49f83e645408598655bece0873fd0 Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ece49f83e645408598655bece0873fd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ece49f83e645408598655bece0873fd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ece49f83e645408598655bece0873fd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ece49f83e645408598655bece0873fd0"}]}] Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: ece49f83e645408598655bece0873fd0 Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-DeleteServersTestJSON-1847538505-project Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 8d56acbbbc3545d19cbb80f4e349c763 Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-DeleteServersTestJSON-1847538505-project Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 798f0deb-3412-479f-bf6b-d11872c9f680 could not be found. Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '798f0deb-3412-479f-bf6b-d11872c9f680'} Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 798f0deb-3412-479f-bf6b-d11872c9f680 could not be found. Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 798f0deb-3412-479f-bf6b-d11872c9f680 could not be found. Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:19:58.289646 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.300764 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:58.300764 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:19:58.300764 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:19:58.300764 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:19:58.300764 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:19:58.300764 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 798f0deb-3412-479f-bf6b-d11872c9f680 could not be found. Oct 26 13:19:58.300764 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.300764 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d399154a-e700-4178-86b0-02c00116a875 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Returning 404 to user: Instance 798f0deb-3412-479f-bf6b-d11872c9f680 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:19:58.300764 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d399154a-e700-4178-86b0-02c00116a875 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680" status: 404 len: 111 microversion: 2.1 time: 0.046108 Oct 26 13:19:58.300764 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2091/4196] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:58 2022] GET /compute/v2.1/servers/798f0deb-3412-479f-bf6b-d11872c9f680 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:19:58.309292 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3b30c10e-8fbb-442f-aa47-c106a7b80baf tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:58.309895 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3b30c10e-8fbb-442f-aa47-c106a7b80baf tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 47c25651-2bed-4595-b4cf-69f3d8f05655] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:58.317242 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3b30c10e-8fbb-442f-aa47-c106a7b80baf tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:58.317754 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3b30c10e-8fbb-442f-aa47-c106a7b80baf tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:58.323561 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3b30c10e-8fbb-442f-aa47-c106a7b80baf tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:58.324607 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3b30c10e-8fbb-442f-aa47-c106a7b80baf tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:58.325099 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3b30c10e-8fbb-442f-aa47-c106a7b80baf tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:58.325538 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3b30c10e-8fbb-442f-aa47-c106a7b80baf tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:58.348313 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-3b30c10e-8fbb-442f-aa47-c106a7b80baf tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] HTTP exception thrown: Instance 47c25651-2bed-4595-b4cf-69f3d8f05655 could not be found. Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3b30c10e-8fbb-442f-aa47-c106a7b80baf tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Request method failure captured: Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655 HTTP/1.1 Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTLTNOlsUS_LQCwMyQbAmNSS-N_AQOqf9a-vHlBM4RS64aXMIGczutoYb0yXKXV63kqVyJMbrGhj1O0dIymI3rB4OYRTseWpFfzGHfB9PKKsR2NnI_ukYFvVdYRwcazuK9kTcZsmuh-2k9d7Yqn3gprd7n0NXcu2P16gbCixvzOdrAQ Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: ece49f83e645408598655bece0873fd0 Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ece49f83e645408598655bece0873fd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ece49f83e645408598655bece0873fd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ece49f83e645408598655bece0873fd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ece49f83e645408598655bece0873fd0"}]}] Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: ece49f83e645408598655bece0873fd0 Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-DeleteServersTestJSON-1847538505-project Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 8d56acbbbc3545d19cbb80f4e349c763 Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-DeleteServersTestJSON-1847538505-project Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 47c25651-2bed-4595-b4cf-69f3d8f05655 could not be found. Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '47c25651-2bed-4595-b4cf-69f3d8f05655'} Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47c25651-2bed-4595-b4cf-69f3d8f05655 could not be found. Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:19:58.350755 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:19:58.356809 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47c25651-2bed-4595-b4cf-69f3d8f05655 could not be found. Oct 26 13:19:58.356809 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.356809 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:19:58.356809 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.356809 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:58.356809 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:19:58.356809 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:19:58.356809 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:19:58.356809 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:19:58.356809 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47c25651-2bed-4595-b4cf-69f3d8f05655 could not be found. Oct 26 13:19:58.356809 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.360196 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3b30c10e-8fbb-442f-aa47-c106a7b80baf tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Returning 404 to user: Instance 47c25651-2bed-4595-b4cf-69f3d8f05655 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:19:58.360196 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3b30c10e-8fbb-442f-aa47-c106a7b80baf tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "DELETE /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655" status: 404 len: 111 microversion: 2.1 time: 0.054518 Oct 26 13:19:58.360196 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2092/4197] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:19:58 2022] DELETE /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:19:58.367965 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7e811709-865e-4e9f-b384-2360bb274881 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:58.368864 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7e811709-865e-4e9f-b384-2360bb274881 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 47c25651-2bed-4595-b4cf-69f3d8f05655] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:58.379011 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e811709-865e-4e9f-b384-2360bb274881 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:58.379499 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e811709-865e-4e9f-b384-2360bb274881 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:58.380137 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e811709-865e-4e9f-b384-2360bb274881 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:58.381063 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e811709-865e-4e9f-b384-2360bb274881 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:58.381543 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e811709-865e-4e9f-b384-2360bb274881 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:58.381985 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e811709-865e-4e9f-b384-2360bb274881 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:58.396903 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-7e811709-865e-4e9f-b384-2360bb274881 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] HTTP exception thrown: Instance 47c25651-2bed-4595-b4cf-69f3d8f05655 could not be found. Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7e811709-865e-4e9f-b384-2360bb274881 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Request method failure captured: Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655 HTTP/1.1 Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTLTNOlsUS_LQCwMyQbAmNSS-N_AQOqf9a-vHlBM4RS64aXMIGczutoYb0yXKXV63kqVyJMbrGhj1O0dIymI3rB4OYRTseWpFfzGHfB9PKKsR2NnI_ukYFvVdYRwcazuK9kTcZsmuh-2k9d7Yqn3gprd7n0NXcu2P16gbCixvzOdrAQ Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: ece49f83e645408598655bece0873fd0 Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ece49f83e645408598655bece0873fd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ece49f83e645408598655bece0873fd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ece49f83e645408598655bece0873fd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ece49f83e645408598655bece0873fd0"}]}] Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: ece49f83e645408598655bece0873fd0 Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-DeleteServersTestJSON-1847538505-project Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 8d56acbbbc3545d19cbb80f4e349c763 Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-DeleteServersTestJSON-1847538505-project Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 47c25651-2bed-4595-b4cf-69f3d8f05655 could not be found. Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '47c25651-2bed-4595-b4cf-69f3d8f05655'} Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47c25651-2bed-4595-b4cf-69f3d8f05655 could not be found. Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47c25651-2bed-4595-b4cf-69f3d8f05655 could not be found. Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:19:58.399376 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.407618 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:58.407618 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:19:58.407618 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:19:58.407618 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:19:58.407618 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:19:58.407618 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47c25651-2bed-4595-b4cf-69f3d8f05655 could not be found. Oct 26 13:19:58.407618 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.407618 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7e811709-865e-4e9f-b384-2360bb274881 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Returning 404 to user: Instance 47c25651-2bed-4595-b4cf-69f3d8f05655 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:19:58.407618 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7e811709-865e-4e9f-b384-2360bb274881 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655" status: 404 len: 111 microversion: 2.1 time: 0.036788 Oct 26 13:19:58.407618 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2093/4198] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:58 2022] GET /compute/v2.1/servers/47c25651-2bed-4595-b4cf-69f3d8f05655 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:19:58.409845 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cdd3fa9e-2f8a-43cc-87ce-8bb76bf98260 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:58.410051 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cdd3fa9e-2f8a-43cc-87ce-8bb76bf98260 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:58.416783 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cdd3fa9e-2f8a-43cc-87ce-8bb76bf98260 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:58.417422 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cdd3fa9e-2f8a-43cc-87ce-8bb76bf98260 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:58.417896 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cdd3fa9e-2f8a-43cc-87ce-8bb76bf98260 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:58.418595 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cdd3fa9e-2f8a-43cc-87ce-8bb76bf98260 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:58.419050 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cdd3fa9e-2f8a-43cc-87ce-8bb76bf98260 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:58.419487 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cdd3fa9e-2f8a-43cc-87ce-8bb76bf98260 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:58.433603 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-cdd3fa9e-2f8a-43cc-87ce-8bb76bf98260 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] HTTP exception thrown: Instance 59bb4f3c-d633-42db-b86b-274fa8b95f44 could not be found. Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cdd3fa9e-2f8a-43cc-87ce-8bb76bf98260 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Request method failure captured: Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 HTTP/1.1 Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTLTNOlsUS_LQCwMyQbAmNSS-N_AQOqf9a-vHlBM4RS64aXMIGczutoYb0yXKXV63kqVyJMbrGhj1O0dIymI3rB4OYRTseWpFfzGHfB9PKKsR2NnI_ukYFvVdYRwcazuK9kTcZsmuh-2k9d7Yqn3gprd7n0NXcu2P16gbCixvzOdrAQ Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: ece49f83e645408598655bece0873fd0 Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ece49f83e645408598655bece0873fd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ece49f83e645408598655bece0873fd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ece49f83e645408598655bece0873fd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ece49f83e645408598655bece0873fd0"}]}] Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: ece49f83e645408598655bece0873fd0 Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-DeleteServersTestJSON-1847538505-project Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 8d56acbbbc3545d19cbb80f4e349c763 Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-DeleteServersTestJSON-1847538505-project Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 59bb4f3c-d633-42db-b86b-274fa8b95f44 could not be found. Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '59bb4f3c-d633-42db-b86b-274fa8b95f44'} Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59bb4f3c-d633-42db-b86b-274fa8b95f44 could not be found. Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:19:58.436752 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:19:58.442173 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59bb4f3c-d633-42db-b86b-274fa8b95f44 could not be found. Oct 26 13:19:58.442173 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.442173 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:19:58.442173 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.442173 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:58.442173 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:19:58.442173 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:19:58.442173 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:19:58.442173 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:19:58.442173 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59bb4f3c-d633-42db-b86b-274fa8b95f44 could not be found. Oct 26 13:19:58.442173 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.442173 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cdd3fa9e-2f8a-43cc-87ce-8bb76bf98260 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Returning 404 to user: Instance 59bb4f3c-d633-42db-b86b-274fa8b95f44 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:19:58.442173 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cdd3fa9e-2f8a-43cc-87ce-8bb76bf98260 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "DELETE /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 404 len: 111 microversion: 2.1 time: 0.031027 Oct 26 13:19:58.442173 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2094/4199] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:19:58 2022] DELETE /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:19:58.447953 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-acc64b24-f1af-4c83-9d5e-e4a32b91fd89 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:58.447953 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-acc64b24-f1af-4c83-9d5e-e4a32b91fd89 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 59bb4f3c-d633-42db-b86b-274fa8b95f44] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:58.452151 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-acc64b24-f1af-4c83-9d5e-e4a32b91fd89 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:58.452630 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-acc64b24-f1af-4c83-9d5e-e4a32b91fd89 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:58.453068 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-acc64b24-f1af-4c83-9d5e-e4a32b91fd89 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:58.453796 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-acc64b24-f1af-4c83-9d5e-e4a32b91fd89 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:58.454249 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-acc64b24-f1af-4c83-9d5e-e4a32b91fd89 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:58.454669 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-acc64b24-f1af-4c83-9d5e-e4a32b91fd89 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:58.473976 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-acc64b24-f1af-4c83-9d5e-e4a32b91fd89 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] HTTP exception thrown: Instance 59bb4f3c-d633-42db-b86b-274fa8b95f44 could not be found. Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-acc64b24-f1af-4c83-9d5e-e4a32b91fd89 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Request method failure captured: Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 HTTP/1.1 Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTLTNOlsUS_LQCwMyQbAmNSS-N_AQOqf9a-vHlBM4RS64aXMIGczutoYb0yXKXV63kqVyJMbrGhj1O0dIymI3rB4OYRTseWpFfzGHfB9PKKsR2NnI_ukYFvVdYRwcazuK9kTcZsmuh-2k9d7Yqn3gprd7n0NXcu2P16gbCixvzOdrAQ Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: ece49f83e645408598655bece0873fd0 Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ece49f83e645408598655bece0873fd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ece49f83e645408598655bece0873fd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ece49f83e645408598655bece0873fd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ece49f83e645408598655bece0873fd0"}]}] Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: ece49f83e645408598655bece0873fd0 Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-DeleteServersTestJSON-1847538505-project Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 8d56acbbbc3545d19cbb80f4e349c763 Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-DeleteServersTestJSON-1847538505-project Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 59bb4f3c-d633-42db-b86b-274fa8b95f44 could not be found. Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '59bb4f3c-d633-42db-b86b-274fa8b95f44'} Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59bb4f3c-d633-42db-b86b-274fa8b95f44 could not be found. Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59bb4f3c-d633-42db-b86b-274fa8b95f44 could not be found. Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:19:58.475893 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.481398 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:58.481398 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:19:58.481398 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:19:58.481398 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:19:58.481398 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:19:58.481398 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59bb4f3c-d633-42db-b86b-274fa8b95f44 could not be found. Oct 26 13:19:58.481398 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.481398 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-acc64b24-f1af-4c83-9d5e-e4a32b91fd89 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Returning 404 to user: Instance 59bb4f3c-d633-42db-b86b-274fa8b95f44 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:19:58.481398 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-acc64b24-f1af-4c83-9d5e-e4a32b91fd89 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44" status: 404 len: 111 microversion: 2.1 time: 0.035813 Oct 26 13:19:58.481398 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2095/4200] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:58 2022] GET /compute/v2.1/servers/59bb4f3c-d633-42db-b86b-274fa8b95f44 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:19:58.486073 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4162538b-5a13-4dcd-bbbc-c8ad878a1de6 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:58.486687 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4162538b-5a13-4dcd-bbbc-c8ad878a1de6 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] [instance: d3605776-7db3-44b2-acdc-8023126131ff] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:58.493026 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4162538b-5a13-4dcd-bbbc-c8ad878a1de6 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:58.493557 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4162538b-5a13-4dcd-bbbc-c8ad878a1de6 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:58.494049 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4162538b-5a13-4dcd-bbbc-c8ad878a1de6 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:58.494785 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4162538b-5a13-4dcd-bbbc-c8ad878a1de6 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:58.495286 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4162538b-5a13-4dcd-bbbc-c8ad878a1de6 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:58.495764 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4162538b-5a13-4dcd-bbbc-c8ad878a1de6 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:58.521995 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-4162538b-5a13-4dcd-bbbc-c8ad878a1de6 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] HTTP exception thrown: Instance d3605776-7db3-44b2-acdc-8023126131ff could not be found. Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4162538b-5a13-4dcd-bbbc-c8ad878a1de6 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Request method failure captured: Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff HTTP/1.1 Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTPdxOqDibumbreKNqy9tiKEpMqJ_lGQdhwy1q79XbCP06E5IN7AssrlAizdcJihL0_YGV5LMx9YMB982I5o6OptFIw7dZ7Xv_4m0K-Pa1BeT3z5k_909B6HcrvTATFITNtvPpE6mhZZDivfwPjXYtWLMnuJ_YHfwKl6b-Kl_z3_ClQ Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: X-Openstack-Nova-Api-Version: 2.26 Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 69892d7a76e94fcfbe4b5541a022e220 Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServerTagsTestJSON-848934261 Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/69892d7a76e94fcfbe4b5541a022e220"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/69892d7a76e94fcfbe4b5541a022e220"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_69892d7a76e94fcfbe4b5541a022e220"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/69892d7a76e94fcfbe4b5541a022e220"}]}] Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServerTagsTestJSON-848934261 Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 69892d7a76e94fcfbe4b5541a022e220 Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServerTagsTestJSON-848934261 Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServerTagsTestJSON-848934261-project Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: db0d11e415d94d0b904eb901f421f6aa Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServerTagsTestJSON-848934261-project Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance d3605776-7db3-44b2-acdc-8023126131ff could not be found. Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'd3605776-7db3-44b2-acdc-8023126131ff'} Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3605776-7db3-44b2-acdc-8023126131ff could not be found. Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3605776-7db3-44b2-acdc-8023126131ff could not be found. Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:19:58.524050 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.535054 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:58.535054 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:19:58.535054 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:19:58.535054 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:19:58.535054 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:19:58.535054 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3605776-7db3-44b2-acdc-8023126131ff could not be found. Oct 26 13:19:58.535054 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.535054 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4162538b-5a13-4dcd-bbbc-c8ad878a1de6 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] Returning 404 to user: Instance d3605776-7db3-44b2-acdc-8023126131ff could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:19:58.535054 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4162538b-5a13-4dcd-bbbc-c8ad878a1de6 tempest-ServerTagsTestJSON-848934261 tempest-ServerTagsTestJSON-848934261-project] 10.222.0.40 "GET /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff" status: 404 len: 111 microversion: 2.26 time: 0.043202 Oct 26 13:19:58.535054 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2096/4201] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:58 2022] GET /compute/v2.1/servers/d3605776-7db3-44b2-acdc-8023126131ff => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:19:58.535054 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4e0c04b3-cd61-46e6-a5c6-85596b0bb041 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:58.535054 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4e0c04b3-cd61-46e6-a5c6-85596b0bb041 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: c188efbd-a2ba-40c5-ad9e-8352eea04b8f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:58.541983 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e0c04b3-cd61-46e6-a5c6-85596b0bb041 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:58.542485 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e0c04b3-cd61-46e6-a5c6-85596b0bb041 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:58.543216 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e0c04b3-cd61-46e6-a5c6-85596b0bb041 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:58.545002 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e0c04b3-cd61-46e6-a5c6-85596b0bb041 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:58.545508 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e0c04b3-cd61-46e6-a5c6-85596b0bb041 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:58.546122 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e0c04b3-cd61-46e6-a5c6-85596b0bb041 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:58.566221 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-4e0c04b3-cd61-46e6-a5c6-85596b0bb041 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] HTTP exception thrown: Instance c188efbd-a2ba-40c5-ad9e-8352eea04b8f could not be found. Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4e0c04b3-cd61-46e6-a5c6-85596b0bb041 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Request method failure captured: Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/servers/c188efbd-a2ba-40c5-ad9e-8352eea04b8f HTTP/1.1 Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTLTNOlsUS_LQCwMyQbAmNSS-N_AQOqf9a-vHlBM4RS64aXMIGczutoYb0yXKXV63kqVyJMbrGhj1O0dIymI3rB4OYRTseWpFfzGHfB9PKKsR2NnI_ukYFvVdYRwcazuK9kTcZsmuh-2k9d7Yqn3gprd7n0NXcu2P16gbCixvzOdrAQ Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: ece49f83e645408598655bece0873fd0 Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ece49f83e645408598655bece0873fd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ece49f83e645408598655bece0873fd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ece49f83e645408598655bece0873fd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ece49f83e645408598655bece0873fd0"}]}] Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: ece49f83e645408598655bece0873fd0 Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-DeleteServersTestJSON-1847538505-project Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 8d56acbbbc3545d19cbb80f4e349c763 Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-DeleteServersTestJSON-1847538505-project Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance c188efbd-a2ba-40c5-ad9e-8352eea04b8f could not be found. Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'c188efbd-a2ba-40c5-ad9e-8352eea04b8f'} Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c188efbd-a2ba-40c5-ad9e-8352eea04b8f could not be found. Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:19:58.567850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:19:58.575254 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c188efbd-a2ba-40c5-ad9e-8352eea04b8f could not be found. Oct 26 13:19:58.575254 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.575254 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:19:58.575254 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.575254 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:58.575254 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:19:58.575254 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:19:58.575254 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:19:58.575254 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:19:58.575254 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c188efbd-a2ba-40c5-ad9e-8352eea04b8f could not be found. Oct 26 13:19:58.575254 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.575254 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4e0c04b3-cd61-46e6-a5c6-85596b0bb041 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Returning 404 to user: Instance c188efbd-a2ba-40c5-ad9e-8352eea04b8f could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:19:58.575254 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4e0c04b3-cd61-46e6-a5c6-85596b0bb041 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c188efbd-a2ba-40c5-ad9e-8352eea04b8f" status: 404 len: 111 microversion: 2.1 time: 0.039941 Oct 26 13:19:58.575254 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2097/4202] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:19:58 2022] DELETE /compute/v2.1/servers/c188efbd-a2ba-40c5-ad9e-8352eea04b8f => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:19:58.580384 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0f860e96-0832-4826-bdbe-2ad9c26a78ed tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:58.581014 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0f860e96-0832-4826-bdbe-2ad9c26a78ed tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: c188efbd-a2ba-40c5-ad9e-8352eea04b8f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:58.588733 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0f860e96-0832-4826-bdbe-2ad9c26a78ed tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:58.589242 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0f860e96-0832-4826-bdbe-2ad9c26a78ed tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:58.589750 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0f860e96-0832-4826-bdbe-2ad9c26a78ed tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:58.590485 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0f860e96-0832-4826-bdbe-2ad9c26a78ed tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:58.590953 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0f860e96-0832-4826-bdbe-2ad9c26a78ed tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:58.591589 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0f860e96-0832-4826-bdbe-2ad9c26a78ed tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:58.608227 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-0f860e96-0832-4826-bdbe-2ad9c26a78ed tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] HTTP exception thrown: Instance c188efbd-a2ba-40c5-ad9e-8352eea04b8f could not be found. Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0f860e96-0832-4826-bdbe-2ad9c26a78ed tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Request method failure captured: Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/c188efbd-a2ba-40c5-ad9e-8352eea04b8f HTTP/1.1 Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTLTNOlsUS_LQCwMyQbAmNSS-N_AQOqf9a-vHlBM4RS64aXMIGczutoYb0yXKXV63kqVyJMbrGhj1O0dIymI3rB4OYRTseWpFfzGHfB9PKKsR2NnI_ukYFvVdYRwcazuK9kTcZsmuh-2k9d7Yqn3gprd7n0NXcu2P16gbCixvzOdrAQ Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: ece49f83e645408598655bece0873fd0 Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ece49f83e645408598655bece0873fd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ece49f83e645408598655bece0873fd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ece49f83e645408598655bece0873fd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ece49f83e645408598655bece0873fd0"}]}] Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: ece49f83e645408598655bece0873fd0 Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-DeleteServersTestJSON-1847538505-project Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 8d56acbbbc3545d19cbb80f4e349c763 Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-DeleteServersTestJSON-1847538505-project Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance c188efbd-a2ba-40c5-ad9e-8352eea04b8f could not be found. Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'c188efbd-a2ba-40c5-ad9e-8352eea04b8f'} Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c188efbd-a2ba-40c5-ad9e-8352eea04b8f could not be found. Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c188efbd-a2ba-40c5-ad9e-8352eea04b8f could not be found. Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:19:58.610904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.616533 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:58.616533 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:19:58.616533 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:19:58.616533 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:19:58.616533 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:19:58.616533 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c188efbd-a2ba-40c5-ad9e-8352eea04b8f could not be found. Oct 26 13:19:58.616533 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.619859 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-78cec89d-03fb-4f5c-82ed-c9c26d0d0943 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:58.621517 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0f860e96-0832-4826-bdbe-2ad9c26a78ed tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Returning 404 to user: Instance c188efbd-a2ba-40c5-ad9e-8352eea04b8f could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:19:58.622454 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0f860e96-0832-4826-bdbe-2ad9c26a78ed tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/c188efbd-a2ba-40c5-ad9e-8352eea04b8f" status: 404 len: 111 microversion: 2.1 time: 0.046540 Oct 26 13:19:58.628089 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2098/4203] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:58 2022] GET /compute/v2.1/servers/c188efbd-a2ba-40c5-ad9e-8352eea04b8f => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:19:58.629789 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-78cec89d-03fb-4f5c-82ed-c9c26d0d0943 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745" status: 200 len: 1522 microversion: 2.1 time: 0.454418 Oct 26 13:19:58.634954 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6e537d48-a753-4bbb-b9ce-49b4a3883ef1 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:58.635980 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6e537d48-a753-4bbb-b9ce-49b4a3883ef1 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 1d894bed-14f0-4c87-a41b-a50cb8c0a61e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:58.643570 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e537d48-a753-4bbb-b9ce-49b4a3883ef1 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:58.644482 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e537d48-a753-4bbb-b9ce-49b4a3883ef1 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:58.645172 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e537d48-a753-4bbb-b9ce-49b4a3883ef1 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:58.645872 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2106/4204] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:58 2022] GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745 => generated 1522 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:19:58.646979 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e537d48-a753-4bbb-b9ce-49b4a3883ef1 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:58.648131 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e537d48-a753-4bbb-b9ce-49b4a3883ef1 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:58.648946 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e537d48-a753-4bbb-b9ce-49b4a3883ef1 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:58.665051 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-6e537d48-a753-4bbb-b9ce-49b4a3883ef1 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] HTTP exception thrown: Instance 1d894bed-14f0-4c87-a41b-a50cb8c0a61e could not be found. Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6e537d48-a753-4bbb-b9ce-49b4a3883ef1 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Request method failure captured: Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/servers/1d894bed-14f0-4c87-a41b-a50cb8c0a61e HTTP/1.1 Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTLTNOlsUS_LQCwMyQbAmNSS-N_AQOqf9a-vHlBM4RS64aXMIGczutoYb0yXKXV63kqVyJMbrGhj1O0dIymI3rB4OYRTseWpFfzGHfB9PKKsR2NnI_ukYFvVdYRwcazuK9kTcZsmuh-2k9d7Yqn3gprd7n0NXcu2P16gbCixvzOdrAQ Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: ece49f83e645408598655bece0873fd0 Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ece49f83e645408598655bece0873fd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ece49f83e645408598655bece0873fd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ece49f83e645408598655bece0873fd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ece49f83e645408598655bece0873fd0"}]}] Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: ece49f83e645408598655bece0873fd0 Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-DeleteServersTestJSON-1847538505-project Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 8d56acbbbc3545d19cbb80f4e349c763 Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-DeleteServersTestJSON-1847538505-project Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 1d894bed-14f0-4c87-a41b-a50cb8c0a61e could not be found. Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '1d894bed-14f0-4c87-a41b-a50cb8c0a61e'} Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d894bed-14f0-4c87-a41b-a50cb8c0a61e could not be found. Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:19:58.667097 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:19:58.672903 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d894bed-14f0-4c87-a41b-a50cb8c0a61e could not be found. Oct 26 13:19:58.672903 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.672903 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:19:58.672903 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.672903 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:58.672903 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:19:58.672903 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:19:58.672903 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:19:58.672903 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:19:58.672903 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d894bed-14f0-4c87-a41b-a50cb8c0a61e could not be found. Oct 26 13:19:58.672903 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.676130 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6e537d48-a753-4bbb-b9ce-49b4a3883ef1 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Returning 404 to user: Instance 1d894bed-14f0-4c87-a41b-a50cb8c0a61e could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:19:58.677124 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6e537d48-a753-4bbb-b9ce-49b4a3883ef1 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1d894bed-14f0-4c87-a41b-a50cb8c0a61e" status: 404 len: 111 microversion: 2.1 time: 0.047161 Oct 26 13:19:58.678058 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2099/4205] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:19:58 2022] DELETE /compute/v2.1/servers/1d894bed-14f0-4c87-a41b-a50cb8c0a61e => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:19:58.689200 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-066ca916-058d-4de8-8ef1-0945f768e0e6 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:58.690303 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-066ca916-058d-4de8-8ef1-0945f768e0e6 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 1d894bed-14f0-4c87-a41b-a50cb8c0a61e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:58.699814 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-066ca916-058d-4de8-8ef1-0945f768e0e6 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:58.700446 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-066ca916-058d-4de8-8ef1-0945f768e0e6 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:58.700976 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-066ca916-058d-4de8-8ef1-0945f768e0e6 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:58.701891 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-066ca916-058d-4de8-8ef1-0945f768e0e6 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:58.702420 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-066ca916-058d-4de8-8ef1-0945f768e0e6 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:58.702964 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-066ca916-058d-4de8-8ef1-0945f768e0e6 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:58.723255 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-066ca916-058d-4de8-8ef1-0945f768e0e6 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] HTTP exception thrown: Instance 1d894bed-14f0-4c87-a41b-a50cb8c0a61e could not be found. Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-066ca916-058d-4de8-8ef1-0945f768e0e6 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Request method failure captured: Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/1d894bed-14f0-4c87-a41b-a50cb8c0a61e HTTP/1.1 Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTLTNOlsUS_LQCwMyQbAmNSS-N_AQOqf9a-vHlBM4RS64aXMIGczutoYb0yXKXV63kqVyJMbrGhj1O0dIymI3rB4OYRTseWpFfzGHfB9PKKsR2NnI_ukYFvVdYRwcazuK9kTcZsmuh-2k9d7Yqn3gprd7n0NXcu2P16gbCixvzOdrAQ Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: ece49f83e645408598655bece0873fd0 Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ece49f83e645408598655bece0873fd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ece49f83e645408598655bece0873fd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ece49f83e645408598655bece0873fd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ece49f83e645408598655bece0873fd0"}]}] Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: ece49f83e645408598655bece0873fd0 Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-DeleteServersTestJSON-1847538505-project Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 8d56acbbbc3545d19cbb80f4e349c763 Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-DeleteServersTestJSON-1847538505-project Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 1d894bed-14f0-4c87-a41b-a50cb8c0a61e could not be found. Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '1d894bed-14f0-4c87-a41b-a50cb8c0a61e'} Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d894bed-14f0-4c87-a41b-a50cb8c0a61e could not be found. Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d894bed-14f0-4c87-a41b-a50cb8c0a61e could not be found. Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:19:58.726234 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.731672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:19:58.731672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:19:58.731672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:19:58.731672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:19:58.731672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:19:58.731672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d894bed-14f0-4c87-a41b-a50cb8c0a61e could not be found. Oct 26 13:19:58.731672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:19:58.733457 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-066ca916-058d-4de8-8ef1-0945f768e0e6 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Returning 404 to user: Instance 1d894bed-14f0-4c87-a41b-a50cb8c0a61e could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:19:58.734544 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-066ca916-058d-4de8-8ef1-0945f768e0e6 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/1d894bed-14f0-4c87-a41b-a50cb8c0a61e" status: 404 len: 111 microversion: 2.1 time: 0.050551 Oct 26 13:19:58.736474 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2107/4206] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:58 2022] GET /compute/v2.1/servers/1d894bed-14f0-4c87-a41b-a50cb8c0a61e => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:19:59.046848 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e990119b-2418-4f1a-a852-fbce1a2af0b9 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:59.047766 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e990119b-2418-4f1a-a852-fbce1a2af0b9 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:59.076682 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e990119b-2418-4f1a-a852-fbce1a2af0b9 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:59.077209 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e990119b-2418-4f1a-a852-fbce1a2af0b9 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:59.077719 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e990119b-2418-4f1a-a852-fbce1a2af0b9 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:59.080622 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e990119b-2418-4f1a-a852-fbce1a2af0b9 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:59.081087 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e990119b-2418-4f1a-a852-fbce1a2af0b9 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:59.081825 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e990119b-2418-4f1a-a852-fbce1a2af0b9 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:59.216368 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e990119b-2418-4f1a-a852-fbce1a2af0b9 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:59.230354 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e990119b-2418-4f1a-a852-fbce1a2af0b9 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:59.235096 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e990119b-2418-4f1a-a852-fbce1a2af0b9 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:59.245980 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e990119b-2418-4f1a-a852-fbce1a2af0b9 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1555 microversion: 2.91 time: 0.203251 Oct 26 13:19:59.251794 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2100/4207] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:19:59 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1555 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:19:59.655222 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-68a527a4-2afc-4f93-8672-daa947a195a4 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:19:59.656867 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-68a527a4-2afc-4f93-8672-daa947a195a4 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 53426b7d-0bba-46ce-ab7e-32451f413745] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:19:59.668415 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68a527a4-2afc-4f93-8672-daa947a195a4 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:59.669838 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68a527a4-2afc-4f93-8672-daa947a195a4 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:59.674283 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68a527a4-2afc-4f93-8672-daa947a195a4 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:59.675150 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68a527a4-2afc-4f93-8672-daa947a195a4 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:19:59.675752 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68a527a4-2afc-4f93-8672-daa947a195a4 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:19:59.676263 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68a527a4-2afc-4f93-8672-daa947a195a4 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:19:59.912796 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-68a527a4-2afc-4f93-8672-daa947a195a4 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:19:59.922939 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-68a527a4-2afc-4f93-8672-daa947a195a4 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745" status: 200 len: 1522 microversion: 2.1 time: 0.272061 Oct 26 13:19:59.924131 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2108/4208] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:19:59 2022] GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:00.281260 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-45fb8862-5326-42cc-98ea-33b3c8f9d1cc tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:00.283366 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-45fb8862-5326-42cc-98ea-33b3c8f9d1cc tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:00.295219 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-45fb8862-5326-42cc-98ea-33b3c8f9d1cc tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:00.296602 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-45fb8862-5326-42cc-98ea-33b3c8f9d1cc tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:00.297890 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-45fb8862-5326-42cc-98ea-33b3c8f9d1cc tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:00.300066 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-45fb8862-5326-42cc-98ea-33b3c8f9d1cc tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:00.301130 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-45fb8862-5326-42cc-98ea-33b3c8f9d1cc tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:00.301932 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-45fb8862-5326-42cc-98ea-33b3c8f9d1cc tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:00.434592 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-45fb8862-5326-42cc-98ea-33b3c8f9d1cc tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:00.444557 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-45fb8862-5326-42cc-98ea-33b3c8f9d1cc tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:00.450822 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-45fb8862-5326-42cc-98ea-33b3c8f9d1cc tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:00.460419 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-45fb8862-5326-42cc-98ea-33b3c8f9d1cc tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1555 microversion: 2.91 time: 0.184447 Oct 26 13:20:00.461720 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2101/4209] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:20:00 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1555 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:20:00.948043 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5d1e2488-5e47-4d13-9e8b-c24cc3f3825f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:00.949404 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5d1e2488-5e47-4d13-9e8b-c24cc3f3825f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 53426b7d-0bba-46ce-ab7e-32451f413745] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:00.960314 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5d1e2488-5e47-4d13-9e8b-c24cc3f3825f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:00.961339 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5d1e2488-5e47-4d13-9e8b-c24cc3f3825f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:00.962335 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5d1e2488-5e47-4d13-9e8b-c24cc3f3825f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:00.963951 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5d1e2488-5e47-4d13-9e8b-c24cc3f3825f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:00.964634 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5d1e2488-5e47-4d13-9e8b-c24cc3f3825f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:00.966037 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5d1e2488-5e47-4d13-9e8b-c24cc3f3825f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:01.238519 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5d1e2488-5e47-4d13-9e8b-c24cc3f3825f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:01.248662 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5d1e2488-5e47-4d13-9e8b-c24cc3f3825f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745" status: 200 len: 1522 microversion: 2.1 time: 0.307038 Oct 26 13:20:01.255361 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2109/4210] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:00 2022] GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745 => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:01.490159 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-392e6ff6-8145-4258-a9e9-ca76fa503e25 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:01.491486 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-392e6ff6-8145-4258-a9e9-ca76fa503e25 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:01.498505 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-392e6ff6-8145-4258-a9e9-ca76fa503e25 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:01.499218 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-392e6ff6-8145-4258-a9e9-ca76fa503e25 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:01.499856 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-392e6ff6-8145-4258-a9e9-ca76fa503e25 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:01.500747 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-392e6ff6-8145-4258-a9e9-ca76fa503e25 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:01.501369 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-392e6ff6-8145-4258-a9e9-ca76fa503e25 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:01.501982 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-392e6ff6-8145-4258-a9e9-ca76fa503e25 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:01.603272 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-392e6ff6-8145-4258-a9e9-ca76fa503e25 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:01.616846 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-392e6ff6-8145-4258-a9e9-ca76fa503e25 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:01.620204 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-392e6ff6-8145-4258-a9e9-ca76fa503e25 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:01.627682 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-392e6ff6-8145-4258-a9e9-ca76fa503e25 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1537 microversion: 2.91 time: 0.141410 Oct 26 13:20:01.629173 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2102/4211] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:20:01 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1537 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:20:02.283055 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1b4ab31e-2014-4c9b-978f-3d81dcbfc91f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:02.283727 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1b4ab31e-2014-4c9b-978f-3d81dcbfc91f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 53426b7d-0bba-46ce-ab7e-32451f413745] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:02.296941 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b4ab31e-2014-4c9b-978f-3d81dcbfc91f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:02.297449 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b4ab31e-2014-4c9b-978f-3d81dcbfc91f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:02.297967 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b4ab31e-2014-4c9b-978f-3d81dcbfc91f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:02.298686 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b4ab31e-2014-4c9b-978f-3d81dcbfc91f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:02.299145 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b4ab31e-2014-4c9b-978f-3d81dcbfc91f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:02.299568 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b4ab31e-2014-4c9b-978f-3d81dcbfc91f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:02.543229 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1b4ab31e-2014-4c9b-978f-3d81dcbfc91f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:02.552016 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:20:02.559263 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1b4ab31e-2014-4c9b-978f-3d81dcbfc91f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745" status: 200 len: 1522 microversion: 2.1 time: 0.281638 Oct 26 13:20:02.560350 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2110/4212] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:02 2022] GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745 => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:02.658663 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4df13637-6202-43b2-a401-57e255e79043 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:02.659958 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4df13637-6202-43b2-a401-57e255e79043 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:02.669773 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4df13637-6202-43b2-a401-57e255e79043 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:02.670253 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4df13637-6202-43b2-a401-57e255e79043 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:02.670703 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4df13637-6202-43b2-a401-57e255e79043 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:02.671459 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4df13637-6202-43b2-a401-57e255e79043 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:02.671918 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4df13637-6202-43b2-a401-57e255e79043 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:02.672310 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4df13637-6202-43b2-a401-57e255e79043 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:02.677612 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:20:02.811443 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4df13637-6202-43b2-a401-57e255e79043 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:02.823120 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4df13637-6202-43b2-a401-57e255e79043 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:02.825309 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4df13637-6202-43b2-a401-57e255e79043 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:02.832314 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4df13637-6202-43b2-a401-57e255e79043 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1537 microversion: 2.91 time: 0.177889 Oct 26 13:20:02.834047 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2103/4213] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:20:02 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1537 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:20:03.438019 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d4f3503a-c607-472f-9000-87434b78f275 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:03.439166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d4f3503a-c607-472f-9000-87434b78f275 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: d0b8440f-677e-428d-8566-29fe4624fce1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:03.448028 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4f3503a-c607-472f-9000-87434b78f275 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:03.448540 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4f3503a-c607-472f-9000-87434b78f275 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:03.448986 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4f3503a-c607-472f-9000-87434b78f275 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:03.449728 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4f3503a-c607-472f-9000-87434b78f275 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:03.450258 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4f3503a-c607-472f-9000-87434b78f275 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:03.450699 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4f3503a-c607-472f-9000-87434b78f275 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:03.482012 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-d4f3503a-c607-472f-9000-87434b78f275 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] HTTP exception thrown: Instance d0b8440f-677e-428d-8566-29fe4624fce1 could not be found. Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d4f3503a-c607-472f-9000-87434b78f275 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Request method failure captured: Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: request: DELETE /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1 HTTP/1.1 Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTLTNOlsUS_LQCwMyQbAmNSS-N_AQOqf9a-vHlBM4RS64aXMIGczutoYb0yXKXV63kqVyJMbrGhj1O0dIymI3rB4OYRTseWpFfzGHfB9PKKsR2NnI_ukYFvVdYRwcazuK9kTcZsmuh-2k9d7Yqn3gprd7n0NXcu2P16gbCixvzOdrAQ Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: ece49f83e645408598655bece0873fd0 Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ece49f83e645408598655bece0873fd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ece49f83e645408598655bece0873fd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ece49f83e645408598655bece0873fd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ece49f83e645408598655bece0873fd0"}]}] Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: ece49f83e645408598655bece0873fd0 Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-DeleteServersTestJSON-1847538505-project Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 8d56acbbbc3545d19cbb80f4e349c763 Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-DeleteServersTestJSON-1847538505-project Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance d0b8440f-677e-428d-8566-29fe4624fce1 could not be found. Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'd0b8440f-677e-428d-8566-29fe4624fce1'} Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0b8440f-677e-428d-8566-29fe4624fce1 could not be found. Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:20:03.484974 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:20:03.489848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0b8440f-677e-428d-8566-29fe4624fce1 could not be found. Oct 26 13:20:03.489848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:20:03.489848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:20:03.489848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:20:03.489848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:20:03.489848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:20:03.489848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:20:03.489848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:20:03.489848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:20:03.489848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0b8440f-677e-428d-8566-29fe4624fce1 could not be found. Oct 26 13:20:03.489848 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:20:03.489848 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d4f3503a-c607-472f-9000-87434b78f275 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Returning 404 to user: Instance d0b8440f-677e-428d-8566-29fe4624fce1 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:20:03.489848 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d4f3503a-c607-472f-9000-87434b78f275 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1" status: 404 len: 111 microversion: 2.1 time: 0.055374 Oct 26 13:20:03.493687 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2111/4214] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:20:03 2022] DELETE /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:20:03.498781 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9492ccdf-b9e2-40f1-83de-6e8334b4e460 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:03.499418 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9492ccdf-b9e2-40f1-83de-6e8334b4e460 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: d0b8440f-677e-428d-8566-29fe4624fce1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:03.515575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9492ccdf-b9e2-40f1-83de-6e8334b4e460 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:03.516097 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9492ccdf-b9e2-40f1-83de-6e8334b4e460 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:03.516554 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9492ccdf-b9e2-40f1-83de-6e8334b4e460 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:03.517292 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9492ccdf-b9e2-40f1-83de-6e8334b4e460 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:03.517792 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9492ccdf-b9e2-40f1-83de-6e8334b4e460 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:03.518448 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9492ccdf-b9e2-40f1-83de-6e8334b4e460 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:03.555414 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-9492ccdf-b9e2-40f1-83de-6e8334b4e460 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] HTTP exception thrown: Instance d0b8440f-677e-428d-8566-29fe4624fce1 could not be found. Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9492ccdf-b9e2-40f1-83de-6e8334b4e460 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Request method failure captured: Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1 HTTP/1.1 Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTLTNOlsUS_LQCwMyQbAmNSS-N_AQOqf9a-vHlBM4RS64aXMIGczutoYb0yXKXV63kqVyJMbrGhj1O0dIymI3rB4OYRTseWpFfzGHfB9PKKsR2NnI_ukYFvVdYRwcazuK9kTcZsmuh-2k9d7Yqn3gprd7n0NXcu2P16gbCixvzOdrAQ Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: ece49f83e645408598655bece0873fd0 Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ece49f83e645408598655bece0873fd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ece49f83e645408598655bece0873fd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ece49f83e645408598655bece0873fd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ece49f83e645408598655bece0873fd0"}]}] Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: ece49f83e645408598655bece0873fd0 Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-DeleteServersTestJSON-1847538505-project Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 8d56acbbbc3545d19cbb80f4e349c763 Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-DeleteServersTestJSON-1847538505-project Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance d0b8440f-677e-428d-8566-29fe4624fce1 could not be found. Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'd0b8440f-677e-428d-8566-29fe4624fce1'} Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0b8440f-677e-428d-8566-29fe4624fce1 could not be found. Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0b8440f-677e-428d-8566-29fe4624fce1 could not be found. Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:20:03.557350 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:20:03.562761 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:20:03.562761 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:20:03.562761 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:20:03.562761 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:20:03.562761 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:20:03.562761 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0b8440f-677e-428d-8566-29fe4624fce1 could not be found. Oct 26 13:20:03.562761 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:20:03.564229 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9492ccdf-b9e2-40f1-83de-6e8334b4e460 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Returning 404 to user: Instance d0b8440f-677e-428d-8566-29fe4624fce1 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:20:03.571444 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9492ccdf-b9e2-40f1-83de-6e8334b4e460 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1" status: 404 len: 111 microversion: 2.1 time: 0.076599 Oct 26 13:20:03.572040 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2104/4215] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:03 2022] GET /compute/v2.1/servers/d0b8440f-677e-428d-8566-29fe4624fce1 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 13:20:03.588105 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-116a24ce-6dd0-4e99-934c-f963e5835622 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:03.589281 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-116a24ce-6dd0-4e99-934c-f963e5835622 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 53426b7d-0bba-46ce-ab7e-32451f413745] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:03.593890 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f68f978d-cadd-4ce7-8d4f-405bdea38d47 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:03.597393 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f68f978d-cadd-4ce7-8d4f-405bdea38d47 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 424df7e6-aed0-42c5-9536-28db79dcc003] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:03.600215 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-116a24ce-6dd0-4e99-934c-f963e5835622 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:03.605907 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-116a24ce-6dd0-4e99-934c-f963e5835622 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:03.606606 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-116a24ce-6dd0-4e99-934c-f963e5835622 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:03.607584 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-116a24ce-6dd0-4e99-934c-f963e5835622 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:03.608290 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-116a24ce-6dd0-4e99-934c-f963e5835622 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:03.622301 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-116a24ce-6dd0-4e99-934c-f963e5835622 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:03.626948 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f68f978d-cadd-4ce7-8d4f-405bdea38d47 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:03.627485 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f68f978d-cadd-4ce7-8d4f-405bdea38d47 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:03.627938 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f68f978d-cadd-4ce7-8d4f-405bdea38d47 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:03.632366 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f68f978d-cadd-4ce7-8d4f-405bdea38d47 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:03.632926 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f68f978d-cadd-4ce7-8d4f-405bdea38d47 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:03.633589 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f68f978d-cadd-4ce7-8d4f-405bdea38d47 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:03.655438 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-f68f978d-cadd-4ce7-8d4f-405bdea38d47 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] HTTP exception thrown: Instance 424df7e6-aed0-42c5-9536-28db79dcc003 could not be found. Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f68f978d-cadd-4ce7-8d4f-405bdea38d47 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Request method failure captured: Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: request: DELETE /compute/v2.1/servers/424df7e6-aed0-42c5-9536-28db79dcc003 HTTP/1.1 Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTLTNOlsUS_LQCwMyQbAmNSS-N_AQOqf9a-vHlBM4RS64aXMIGczutoYb0yXKXV63kqVyJMbrGhj1O0dIymI3rB4OYRTseWpFfzGHfB9PKKsR2NnI_ukYFvVdYRwcazuK9kTcZsmuh-2k9d7Yqn3gprd7n0NXcu2P16gbCixvzOdrAQ Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: ece49f83e645408598655bece0873fd0 Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ece49f83e645408598655bece0873fd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ece49f83e645408598655bece0873fd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ece49f83e645408598655bece0873fd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ece49f83e645408598655bece0873fd0"}]}] Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: ece49f83e645408598655bece0873fd0 Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-DeleteServersTestJSON-1847538505-project Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 8d56acbbbc3545d19cbb80f4e349c763 Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-DeleteServersTestJSON-1847538505-project Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 424df7e6-aed0-42c5-9536-28db79dcc003 could not be found. Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '424df7e6-aed0-42c5-9536-28db79dcc003'} Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 424df7e6-aed0-42c5-9536-28db79dcc003 could not be found. Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:20:03.657623 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:20:03.663565 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 424df7e6-aed0-42c5-9536-28db79dcc003 could not be found. Oct 26 13:20:03.663565 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:20:03.663565 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:20:03.663565 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:20:03.663565 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:20:03.663565 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:20:03.663565 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:20:03.663565 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:20:03.663565 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:20:03.663565 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 424df7e6-aed0-42c5-9536-28db79dcc003 could not be found. Oct 26 13:20:03.663565 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:20:03.670678 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f68f978d-cadd-4ce7-8d4f-405bdea38d47 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Returning 404 to user: Instance 424df7e6-aed0-42c5-9536-28db79dcc003 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:20:03.671954 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f68f978d-cadd-4ce7-8d4f-405bdea38d47 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "DELETE /compute/v2.1/servers/424df7e6-aed0-42c5-9536-28db79dcc003" status: 404 len: 111 microversion: 2.1 time: 0.095371 Oct 26 13:20:03.673073 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2112/4216] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:20:03 2022] DELETE /compute/v2.1/servers/424df7e6-aed0-42c5-9536-28db79dcc003 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:20:03.684849 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d92a7eb5-01a4-48bf-b6ad-c64ad1c03887 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:03.685809 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d92a7eb5-01a4-48bf-b6ad-c64ad1c03887 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] [instance: 424df7e6-aed0-42c5-9536-28db79dcc003] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:03.692635 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d92a7eb5-01a4-48bf-b6ad-c64ad1c03887 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:03.694068 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d92a7eb5-01a4-48bf-b6ad-c64ad1c03887 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:03.694692 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d92a7eb5-01a4-48bf-b6ad-c64ad1c03887 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:03.696443 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d92a7eb5-01a4-48bf-b6ad-c64ad1c03887 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:03.697310 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d92a7eb5-01a4-48bf-b6ad-c64ad1c03887 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:03.698074 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d92a7eb5-01a4-48bf-b6ad-c64ad1c03887 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:03.720170 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-d92a7eb5-01a4-48bf-b6ad-c64ad1c03887 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] HTTP exception thrown: Instance 424df7e6-aed0-42c5-9536-28db79dcc003 could not be found. Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d92a7eb5-01a4-48bf-b6ad-c64ad1c03887 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Request method failure captured: Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/424df7e6-aed0-42c5-9536-28db79dcc003 HTTP/1.1 Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTLTNOlsUS_LQCwMyQbAmNSS-N_AQOqf9a-vHlBM4RS64aXMIGczutoYb0yXKXV63kqVyJMbrGhj1O0dIymI3rB4OYRTseWpFfzGHfB9PKKsR2NnI_ukYFvVdYRwcazuK9kTcZsmuh-2k9d7Yqn3gprd7n0NXcu2P16gbCixvzOdrAQ Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: ece49f83e645408598655bece0873fd0 Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ece49f83e645408598655bece0873fd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ece49f83e645408598655bece0873fd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ece49f83e645408598655bece0873fd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ece49f83e645408598655bece0873fd0"}]}] Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: ece49f83e645408598655bece0873fd0 Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-DeleteServersTestJSON-1847538505 Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-DeleteServersTestJSON-1847538505-project Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 8d56acbbbc3545d19cbb80f4e349c763 Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-DeleteServersTestJSON-1847538505-project Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 424df7e6-aed0-42c5-9536-28db79dcc003 could not be found. Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '424df7e6-aed0-42c5-9536-28db79dcc003'} Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 424df7e6-aed0-42c5-9536-28db79dcc003 could not be found. Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 424df7e6-aed0-42c5-9536-28db79dcc003 could not be found. Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:20:03.722231 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:20:03.727116 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:20:03.727116 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:20:03.727116 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:20:03.727116 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:20:03.727116 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:20:03.727116 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 424df7e6-aed0-42c5-9536-28db79dcc003 could not be found. Oct 26 13:20:03.727116 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:20:03.727116 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d92a7eb5-01a4-48bf-b6ad-c64ad1c03887 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] Returning 404 to user: Instance 424df7e6-aed0-42c5-9536-28db79dcc003 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:20:03.727116 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d92a7eb5-01a4-48bf-b6ad-c64ad1c03887 tempest-DeleteServersTestJSON-1847538505 tempest-DeleteServersTestJSON-1847538505-project] 10.222.0.40 "GET /compute/v2.1/servers/424df7e6-aed0-42c5-9536-28db79dcc003" status: 404 len: 111 microversion: 2.1 time: 0.046050 Oct 26 13:20:03.729534 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2113/4217] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:03 2022] GET /compute/v2.1/servers/424df7e6-aed0-42c5-9536-28db79dcc003 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:20:03.868472 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3a2d7b66-cf48-4837-a3c3-641a4083a593 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:03.869671 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3a2d7b66-cf48-4837-a3c3-641a4083a593 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:03.891068 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3a2d7b66-cf48-4837-a3c3-641a4083a593 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:03.895422 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3a2d7b66-cf48-4837-a3c3-641a4083a593 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:03.895888 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3a2d7b66-cf48-4837-a3c3-641a4083a593 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:03.899471 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3a2d7b66-cf48-4837-a3c3-641a4083a593 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:03.899973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3a2d7b66-cf48-4837-a3c3-641a4083a593 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:03.900424 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3a2d7b66-cf48-4837-a3c3-641a4083a593 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:03.948495 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-116a24ce-6dd0-4e99-934c-f963e5835622 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:03.962101 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-116a24ce-6dd0-4e99-934c-f963e5835622 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745" status: 200 len: 1522 microversion: 2.1 time: 0.378630 Oct 26 13:20:03.970123 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2105/4218] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:03 2022] GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745 => generated 1522 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:03.978427 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-206971d7-ddd2-42f9-9dac-7b1d70e34004 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:03.978427 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-206971d7-ddd2-42f9-9dac-7b1d70e34004 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:03.996608 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-206971d7-ddd2-42f9-9dac-7b1d70e34004 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:03.997035 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-206971d7-ddd2-42f9-9dac-7b1d70e34004 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:03.997511 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-206971d7-ddd2-42f9-9dac-7b1d70e34004 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:03.998364 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-206971d7-ddd2-42f9-9dac-7b1d70e34004 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:03.999029 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-206971d7-ddd2-42f9-9dac-7b1d70e34004 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:03.999511 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-206971d7-ddd2-42f9-9dac-7b1d70e34004 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:04.033875 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-206971d7-ddd2-42f9-9dac-7b1d70e34004 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] HTTP exception thrown: Instance b5fa9733-f49b-43ab-8586-68d113b73476 could not be found. Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-206971d7-ddd2-42f9-9dac-7b1d70e34004 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Request method failure captured: Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 HTTP/1.1 Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTJnfaV7EkMOl7x-unkxv9rOB7rVjZEcj262l0JhR041fOelsAVHPCAqeFcM9g08iS88HWWfMWQJF28oijsns10Vt1iYqoDgS_G-2JJsfX-pPHEHhksJuwWoNX_ymImmLW2dEIaW841cPzgwyJDGmPQ6HpqtzWZvXLoJUqPLV8PLTZo Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: X-Openstack-Nova-Api-Version: 2.42 Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: de138b5bb5ac44c9be139ab7ceb26a32 Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1759760870 Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/de138b5bb5ac44c9be139ab7ceb26a32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/de138b5bb5ac44c9be139ab7ceb26a32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_de138b5bb5ac44c9be139ab7ceb26a32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/de138b5bb5ac44c9be139ab7ceb26a32"}]}] Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1759760870 Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: de138b5bb5ac44c9be139ab7ceb26a32 Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1759760870 Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-TaggedBootDevicesTest_v242-1759760870-project Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: d09f69ec8c514a6789ede382cdbdbebb Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1759760870-project Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance b5fa9733-f49b-43ab-8586-68d113b73476 could not be found. Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'b5fa9733-f49b-43ab-8586-68d113b73476'} Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5fa9733-f49b-43ab-8586-68d113b73476 could not be found. Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:20:04.035916 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:20:04.041405 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5fa9733-f49b-43ab-8586-68d113b73476 could not be found. Oct 26 13:20:04.041405 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:20:04.041405 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:20:04.041405 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:20:04.041405 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:20:04.041405 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:20:04.041405 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:20:04.041405 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:20:04.041405 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:20:04.041405 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5fa9733-f49b-43ab-8586-68d113b73476 could not be found. Oct 26 13:20:04.041405 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:20:04.043303 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-206971d7-ddd2-42f9-9dac-7b1d70e34004 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Returning 404 to user: Instance b5fa9733-f49b-43ab-8586-68d113b73476 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:20:04.044533 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-206971d7-ddd2-42f9-9dac-7b1d70e34004 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 404 len: 111 microversion: 2.42 time: 0.080052 Oct 26 13:20:04.048753 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2106/4219] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 26 13:20:03 2022] DELETE /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:20:04.054587 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e28a3cb3-550a-4d68-a028-379f4ba931b1 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:04.055429 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e28a3cb3-550a-4d68-a028-379f4ba931b1 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] [instance: b5fa9733-f49b-43ab-8586-68d113b73476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:04.061733 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3a2d7b66-cf48-4837-a3c3-641a4083a593 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:04.062738 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e28a3cb3-550a-4d68-a028-379f4ba931b1 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:04.063573 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e28a3cb3-550a-4d68-a028-379f4ba931b1 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:04.064273 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e28a3cb3-550a-4d68-a028-379f4ba931b1 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:04.065245 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e28a3cb3-550a-4d68-a028-379f4ba931b1 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:04.066242 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e28a3cb3-550a-4d68-a028-379f4ba931b1 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:04.066945 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e28a3cb3-550a-4d68-a028-379f4ba931b1 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:04.080081 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3a2d7b66-cf48-4837-a3c3-641a4083a593 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:04.082123 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3a2d7b66-cf48-4837-a3c3-641a4083a593 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:04.087356 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-e28a3cb3-550a-4d68-a028-379f4ba931b1 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] HTTP exception thrown: Instance b5fa9733-f49b-43ab-8586-68d113b73476 could not be found. Oct 26 13:20:04.088624 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3a2d7b66-cf48-4837-a3c3-641a4083a593 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1480 microversion: 2.91 time: 0.227818 Oct 26 13:20:04.089265 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2114/4220] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:20:03 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1480 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e28a3cb3-550a-4d68-a028-379f4ba931b1 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Request method failure captured: Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 HTTP/1.1 Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTJnfaV7EkMOl7x-unkxv9rOB7rVjZEcj262l0JhR041fOelsAVHPCAqeFcM9g08iS88HWWfMWQJF28oijsns10Vt1iYqoDgS_G-2JJsfX-pPHEHhksJuwWoNX_ymImmLW2dEIaW841cPzgwyJDGmPQ6HpqtzWZvXLoJUqPLV8PLTZo Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: X-Openstack-Nova-Api-Version: 2.42 Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: de138b5bb5ac44c9be139ab7ceb26a32 Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1759760870 Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/de138b5bb5ac44c9be139ab7ceb26a32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/de138b5bb5ac44c9be139ab7ceb26a32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_de138b5bb5ac44c9be139ab7ceb26a32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/de138b5bb5ac44c9be139ab7ceb26a32"}]}] Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1759760870 Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: de138b5bb5ac44c9be139ab7ceb26a32 Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1759760870 Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-TaggedBootDevicesTest_v242-1759760870-project Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: d09f69ec8c514a6789ede382cdbdbebb Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1759760870-project Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance b5fa9733-f49b-43ab-8586-68d113b73476 could not be found. Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'b5fa9733-f49b-43ab-8586-68d113b73476'} Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5fa9733-f49b-43ab-8586-68d113b73476 could not be found. Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5fa9733-f49b-43ab-8586-68d113b73476 could not be found. Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:20:04.089746 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:20:04.094646 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:20:04.094646 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:20:04.094646 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:20:04.094646 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:20:04.094646 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:20:04.094646 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:20:04.094646 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5fa9733-f49b-43ab-8586-68d113b73476 could not be found. Oct 26 13:20:04.094646 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:20:04.096633 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e28a3cb3-550a-4d68-a028-379f4ba931b1 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] Returning 404 to user: Instance b5fa9733-f49b-43ab-8586-68d113b73476 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:20:04.097756 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e28a3cb3-550a-4d68-a028-379f4ba931b1 tempest-TaggedBootDevicesTest_v242-1759760870 tempest-TaggedBootDevicesTest_v242-1759760870-project] 10.222.0.40 "GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476" status: 404 len: 111 microversion: 2.42 time: 0.047703 Oct 26 13:20:04.098858 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2107/4221] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:20:04 2022] GET /compute/v2.1/servers/b5fa9733-f49b-43ab-8586-68d113b73476 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:20:04.133861 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-faf28985-e0f0-4f46-b9c4-c78bc527a498 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-862686-1"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:20:04.139221 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-faf28985-e0f0-4f46-b9c4-c78bc527a498 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:04.154648 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-faf28985-e0f0-4f46-b9c4-c78bc527a498 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:04.155988 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-faf28985-e0f0-4f46-b9c4-c78bc527a498 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:04.158185 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-faf28985-e0f0-4f46-b9c4-c78bc527a498 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:04.214399 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-faf28985-e0f0-4f46-b9c4-c78bc527a498 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:04.214399 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-faf28985-e0f0-4f46-b9c4-c78bc527a498 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:04.214399 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-faf28985-e0f0-4f46-b9c4-c78bc527a498 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:04.311064 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-faf28985-e0f0-4f46-b9c4-c78bc527a498 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-862686-1". {{(pid=120598) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 26 13:20:04.390720 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8efbc719-6dbc-4175-bb2a-0e36f48a869d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:04.392829 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8efbc719-6dbc-4175-bb2a-0e36f48a869d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:04.405890 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8efbc719-6dbc-4175-bb2a-0e36f48a869d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:04.406867 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8efbc719-6dbc-4175-bb2a-0e36f48a869d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:04.407723 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8efbc719-6dbc-4175-bb2a-0e36f48a869d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:04.409012 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8efbc719-6dbc-4175-bb2a-0e36f48a869d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:04.409819 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8efbc719-6dbc-4175-bb2a-0e36f48a869d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:04.410836 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8efbc719-6dbc-4175-bb2a-0e36f48a869d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:04.441317 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-faf28985-e0f0-4f46-b9c4-c78bc527a498 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3/action" status: 202 len: 0 microversion: 2.91 time: 0.312572 Oct 26 13:20:04.443333 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2115/4222] 10.222.0.40 () {62 vars in 1319 bytes} [Wed Oct 26 13:20:04 2022] POST /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:20:04.452792 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1c195cf8-158d-434a-b3c7-ce9ca065a424 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:04.457988 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1c195cf8-158d-434a-b3c7-ce9ca065a424 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:04.473184 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c195cf8-158d-434a-b3c7-ce9ca065a424 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:04.473814 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c195cf8-158d-434a-b3c7-ce9ca065a424 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:04.474656 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c195cf8-158d-434a-b3c7-ce9ca065a424 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:04.476929 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c195cf8-158d-434a-b3c7-ce9ca065a424 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:04.477841 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c195cf8-158d-434a-b3c7-ce9ca065a424 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:04.478344 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c195cf8-158d-434a-b3c7-ce9ca065a424 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:04.592586 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-8efbc719-6dbc-4175-bb2a-0e36f48a869d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lazy-loading 'services' on Instance uuid 9c1ed300-eac2-4e60-a903-2f17e7df792c {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:20:04.758043 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8efbc719-6dbc-4175-bb2a-0e36f48a869d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c/os-volume_attachments/09978d8f-626c-45c2-871c-b8fceb935c12" status: 202 len: 0 microversion: 2.1 time: 0.375095 Oct 26 13:20:04.758043 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2108/4223] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Oct 26 13:20:04 2022] DELETE /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c/os-volume_attachments/09978d8f-626c-45c2-871c-b8fceb935c12 => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 13:20:04.767280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1c195cf8-158d-434a-b3c7-ce9ca065a424 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:04.785454 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1c195cf8-158d-434a-b3c7-ce9ca065a424 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:04.792303 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1c195cf8-158d-434a-b3c7-ce9ca065a424 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:04.812528 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1c195cf8-158d-434a-b3c7-ce9ca065a424 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1488 microversion: 2.91 time: 0.364489 Oct 26 13:20:04.831032 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2116/4224] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:20:04 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1488 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:20:04.995312 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7ae3f30d-6b5f-42b6-8c3a-54653803231b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:04.996143 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7ae3f30d-6b5f-42b6-8c3a-54653803231b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 53426b7d-0bba-46ce-ab7e-32451f413745] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:05.016693 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ae3f30d-6b5f-42b6-8c3a-54653803231b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:05.017205 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ae3f30d-6b5f-42b6-8c3a-54653803231b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:05.018004 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ae3f30d-6b5f-42b6-8c3a-54653803231b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:05.022086 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ae3f30d-6b5f-42b6-8c3a-54653803231b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:05.023034 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ae3f30d-6b5f-42b6-8c3a-54653803231b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:05.023568 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ae3f30d-6b5f-42b6-8c3a-54653803231b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:05.563976 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7ae3f30d-6b5f-42b6-8c3a-54653803231b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:05.580831 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7ae3f30d-6b5f-42b6-8c3a-54653803231b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745" status: 200 len: 1522 microversion: 2.1 time: 0.597333 Oct 26 13:20:05.581589 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2109/4225] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:04 2022] GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745 => generated 1522 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:05.853918 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1d26e8de-472d-4261-84de-1acdeeb5a55e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:05.855377 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1d26e8de-472d-4261-84de-1acdeeb5a55e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:05.872568 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1d26e8de-472d-4261-84de-1acdeeb5a55e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:05.873134 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1d26e8de-472d-4261-84de-1acdeeb5a55e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:05.873627 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1d26e8de-472d-4261-84de-1acdeeb5a55e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:05.874370 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1d26e8de-472d-4261-84de-1acdeeb5a55e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:05.874842 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1d26e8de-472d-4261-84de-1acdeeb5a55e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:05.888157 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1d26e8de-472d-4261-84de-1acdeeb5a55e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:06.093569 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1d26e8de-472d-4261-84de-1acdeeb5a55e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:06.109676 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1d26e8de-472d-4261-84de-1acdeeb5a55e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:06.111444 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1d26e8de-472d-4261-84de-1acdeeb5a55e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:06.123733 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1d26e8de-472d-4261-84de-1acdeeb5a55e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1546 microversion: 2.91 time: 0.274375 Oct 26 13:20:06.127069 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2117/4226] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:20:05 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1546 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:20:06.606275 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-403a0b95-5314-4f77-bef2-3952f064ce97 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:06.607078 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-403a0b95-5314-4f77-bef2-3952f064ce97 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 53426b7d-0bba-46ce-ab7e-32451f413745] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:06.627925 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-403a0b95-5314-4f77-bef2-3952f064ce97 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:06.630680 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-403a0b95-5314-4f77-bef2-3952f064ce97 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:06.632560 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-403a0b95-5314-4f77-bef2-3952f064ce97 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:06.634111 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-403a0b95-5314-4f77-bef2-3952f064ce97 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:06.636778 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-403a0b95-5314-4f77-bef2-3952f064ce97 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:06.639714 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-403a0b95-5314-4f77-bef2-3952f064ce97 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:06.955028 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-403a0b95-5314-4f77-bef2-3952f064ce97 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:06.971698 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-403a0b95-5314-4f77-bef2-3952f064ce97 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745" status: 200 len: 1522 microversion: 2.1 time: 0.369929 Oct 26 13:20:06.975364 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2110/4227] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:06 2022] GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745 => generated 1522 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:07.156784 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f3e6ee8e-311c-4a62-b552-5172005c5970 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:07.158212 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f3e6ee8e-311c-4a62-b552-5172005c5970 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:07.183353 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f3e6ee8e-311c-4a62-b552-5172005c5970 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:07.185777 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f3e6ee8e-311c-4a62-b552-5172005c5970 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:07.186555 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f3e6ee8e-311c-4a62-b552-5172005c5970 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:07.187997 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f3e6ee8e-311c-4a62-b552-5172005c5970 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:07.189506 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f3e6ee8e-311c-4a62-b552-5172005c5970 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:07.191080 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f3e6ee8e-311c-4a62-b552-5172005c5970 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:07.480846 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f3e6ee8e-311c-4a62-b552-5172005c5970 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:07.490860 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f3e6ee8e-311c-4a62-b552-5172005c5970 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:07.493616 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f3e6ee8e-311c-4a62-b552-5172005c5970 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:07.501609 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f3e6ee8e-311c-4a62-b552-5172005c5970 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1546 microversion: 2.91 time: 0.350045 Oct 26 13:20:07.502701 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2118/4228] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:20:07 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1546 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:20:07.996965 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-da7dea92-660e-4bae-8e83-8fad814ae0e6 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:07.997542 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-da7dea92-660e-4bae-8e83-8fad814ae0e6 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 53426b7d-0bba-46ce-ab7e-32451f413745] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:08.012447 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-da7dea92-660e-4bae-8e83-8fad814ae0e6 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:08.012973 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-da7dea92-660e-4bae-8e83-8fad814ae0e6 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:08.013434 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-da7dea92-660e-4bae-8e83-8fad814ae0e6 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:08.017338 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-da7dea92-660e-4bae-8e83-8fad814ae0e6 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:08.019591 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-da7dea92-660e-4bae-8e83-8fad814ae0e6 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:08.020238 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-da7dea92-660e-4bae-8e83-8fad814ae0e6 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:08.494029 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-da7dea92-660e-4bae-8e83-8fad814ae0e6 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:08.512362 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-da7dea92-660e-4bae-8e83-8fad814ae0e6 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745" status: 200 len: 1522 microversion: 2.1 time: 0.518865 Oct 26 13:20:08.514698 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2111/4229] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:07 2022] GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745 => generated 1522 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:08.535922 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-36dfca68-3ba0-4684-ae09-905144eb0f6c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:08.537889 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-36dfca68-3ba0-4684-ae09-905144eb0f6c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:08.564585 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-36dfca68-3ba0-4684-ae09-905144eb0f6c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:08.565353 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-36dfca68-3ba0-4684-ae09-905144eb0f6c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:08.566098 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-36dfca68-3ba0-4684-ae09-905144eb0f6c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:08.567692 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-36dfca68-3ba0-4684-ae09-905144eb0f6c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:08.569678 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-36dfca68-3ba0-4684-ae09-905144eb0f6c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:08.570298 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-36dfca68-3ba0-4684-ae09-905144eb0f6c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:08.839510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-36dfca68-3ba0-4684-ae09-905144eb0f6c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:08.857186 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-36dfca68-3ba0-4684-ae09-905144eb0f6c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:08.859598 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-36dfca68-3ba0-4684-ae09-905144eb0f6c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:08.882633 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-36dfca68-3ba0-4684-ae09-905144eb0f6c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1546 microversion: 2.91 time: 0.352502 Oct 26 13:20:08.883219 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2119/4230] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:20:08 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1546 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:20:09.545025 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-01f818b6-60e7-4eb1-8de2-50c3ddd67900 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:09.546784 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-01f818b6-60e7-4eb1-8de2-50c3ddd67900 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 53426b7d-0bba-46ce-ab7e-32451f413745] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:09.567242 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-01f818b6-60e7-4eb1-8de2-50c3ddd67900 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:09.569843 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-01f818b6-60e7-4eb1-8de2-50c3ddd67900 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:09.570529 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-01f818b6-60e7-4eb1-8de2-50c3ddd67900 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:09.573627 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-01f818b6-60e7-4eb1-8de2-50c3ddd67900 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:09.574320 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-01f818b6-60e7-4eb1-8de2-50c3ddd67900 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:09.574945 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-01f818b6-60e7-4eb1-8de2-50c3ddd67900 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:09.925423 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3c870b8c-caf2-4f5d-ac0b-5b92e1e1cc62 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:09.926625 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3c870b8c-caf2-4f5d-ac0b-5b92e1e1cc62 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:09.937471 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c870b8c-caf2-4f5d-ac0b-5b92e1e1cc62 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:09.949061 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c870b8c-caf2-4f5d-ac0b-5b92e1e1cc62 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:09.957660 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c870b8c-caf2-4f5d-ac0b-5b92e1e1cc62 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:09.958753 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c870b8c-caf2-4f5d-ac0b-5b92e1e1cc62 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:09.959464 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c870b8c-caf2-4f5d-ac0b-5b92e1e1cc62 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:09.967686 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c870b8c-caf2-4f5d-ac0b-5b92e1e1cc62 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:10.152155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-01f818b6-60e7-4eb1-8de2-50c3ddd67900 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:10.175214 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-01f818b6-60e7-4eb1-8de2-50c3ddd67900 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745" status: 200 len: 1522 microversion: 2.1 time: 0.634552 Oct 26 13:20:10.194270 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2112/4231] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:09 2022] GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745 => generated 1522 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:10.402441 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3c870b8c-caf2-4f5d-ac0b-5b92e1e1cc62 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:10.420156 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3c870b8c-caf2-4f5d-ac0b-5b92e1e1cc62 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:10.423232 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3c870b8c-caf2-4f5d-ac0b-5b92e1e1cc62 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:10.455030 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3c870b8c-caf2-4f5d-ac0b-5b92e1e1cc62 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1546 microversion: 2.91 time: 0.532284 Oct 26 13:20:10.456388 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2120/4232] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:20:09 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1546 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:20:11.210643 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-150ec4a7-ea4c-4a88-8248-9b9b687d9b0f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:11.211185 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-150ec4a7-ea4c-4a88-8248-9b9b687d9b0f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 53426b7d-0bba-46ce-ab7e-32451f413745] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:11.241977 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-150ec4a7-ea4c-4a88-8248-9b9b687d9b0f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:11.245015 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-150ec4a7-ea4c-4a88-8248-9b9b687d9b0f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:11.245733 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-150ec4a7-ea4c-4a88-8248-9b9b687d9b0f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:11.246745 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-150ec4a7-ea4c-4a88-8248-9b9b687d9b0f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:11.248548 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-150ec4a7-ea4c-4a88-8248-9b9b687d9b0f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:11.253933 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-150ec4a7-ea4c-4a88-8248-9b9b687d9b0f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:11.491717 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-100f208a-6564-4503-a729-6d429d9aa802 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:11.492892 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-100f208a-6564-4503-a729-6d429d9aa802 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:11.524208 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-100f208a-6564-4503-a729-6d429d9aa802 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:11.539368 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-100f208a-6564-4503-a729-6d429d9aa802 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:11.540262 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-100f208a-6564-4503-a729-6d429d9aa802 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:11.541178 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-100f208a-6564-4503-a729-6d429d9aa802 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:11.541821 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-100f208a-6564-4503-a729-6d429d9aa802 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:11.544176 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-100f208a-6564-4503-a729-6d429d9aa802 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:11.810928 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-100f208a-6564-4503-a729-6d429d9aa802 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:11.826903 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-100f208a-6564-4503-a729-6d429d9aa802 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:11.860751 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-100f208a-6564-4503-a729-6d429d9aa802 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:11.872606 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-100f208a-6564-4503-a729-6d429d9aa802 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1546 microversion: 2.91 time: 0.386073 Oct 26 13:20:11.894269 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2121/4233] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:20:11 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1546 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:20:12.915561 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-90243a9a-4261-4cce-a26a-491ef1961915 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:12.918189 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-90243a9a-4261-4cce-a26a-491ef1961915 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:12.949358 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90243a9a-4261-4cce-a26a-491ef1961915 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:12.950475 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90243a9a-4261-4cce-a26a-491ef1961915 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:12.951150 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90243a9a-4261-4cce-a26a-491ef1961915 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:12.952074 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90243a9a-4261-4cce-a26a-491ef1961915 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:12.969028 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90243a9a-4261-4cce-a26a-491ef1961915 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:12.973322 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90243a9a-4261-4cce-a26a-491ef1961915 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:13.109402 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-150ec4a7-ea4c-4a88-8248-9b9b687d9b0f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:13.133703 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-150ec4a7-ea4c-4a88-8248-9b9b687d9b0f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745" status: 200 len: 1522 microversion: 2.1 time: 1.921685 Oct 26 13:20:13.134707 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2113/4234] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:11 2022] GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745 => generated 1522 bytes in 1931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:13.251375 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-90243a9a-4261-4cce-a26a-491ef1961915 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:13.260791 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-90243a9a-4261-4cce-a26a-491ef1961915 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:13.270762 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-90243a9a-4261-4cce-a26a-491ef1961915 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:13.288963 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-90243a9a-4261-4cce-a26a-491ef1961915 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1546 microversion: 2.91 time: 0.384010 Oct 26 13:20:13.305523 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2122/4235] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:20:12 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1546 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:20:14.160977 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-88173d75-40c2-4587-bd38-dc1f06f1e575 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:14.162650 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-88173d75-40c2-4587-bd38-dc1f06f1e575 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 53426b7d-0bba-46ce-ab7e-32451f413745] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:14.172667 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:20:14.198429 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88173d75-40c2-4587-bd38-dc1f06f1e575 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:14.198892 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88173d75-40c2-4587-bd38-dc1f06f1e575 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:14.207872 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88173d75-40c2-4587-bd38-dc1f06f1e575 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:14.208909 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88173d75-40c2-4587-bd38-dc1f06f1e575 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:14.209476 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88173d75-40c2-4587-bd38-dc1f06f1e575 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:14.209949 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88173d75-40c2-4587-bd38-dc1f06f1e575 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:14.328042 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b9d08d9c-72ce-4361-890f-471f5cde0708 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:14.333678 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b9d08d9c-72ce-4361-890f-471f5cde0708 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:14.359665 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9d08d9c-72ce-4361-890f-471f5cde0708 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:14.366703 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9d08d9c-72ce-4361-890f-471f5cde0708 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:14.369476 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9d08d9c-72ce-4361-890f-471f5cde0708 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:14.371661 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9d08d9c-72ce-4361-890f-471f5cde0708 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:14.376162 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9d08d9c-72ce-4361-890f-471f5cde0708 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:14.379614 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9d08d9c-72ce-4361-890f-471f5cde0708 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:14.721535 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b9d08d9c-72ce-4361-890f-471f5cde0708 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:14.735051 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b9d08d9c-72ce-4361-890f-471f5cde0708 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:14.737677 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b9d08d9c-72ce-4361-890f-471f5cde0708 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:14.755771 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-88173d75-40c2-4587-bd38-dc1f06f1e575 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:14.766135 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b9d08d9c-72ce-4361-890f-471f5cde0708 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1546 microversion: 2.91 time: 0.442314 Oct 26 13:20:14.766733 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2123/4236] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:20:14 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1546 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:20:14.800912 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-88173d75-40c2-4587-bd38-dc1f06f1e575 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745" status: 200 len: 1522 microversion: 2.1 time: 0.644153 Oct 26 13:20:14.807937 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2114/4237] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:14 2022] GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745 => generated 1522 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:15.801236 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-144b35b6-ea31-4cb2-ae68-e0b9f53ab148 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:15.802698 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-144b35b6-ea31-4cb2-ae68-e0b9f53ab148 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:15.817249 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-144b35b6-ea31-4cb2-ae68-e0b9f53ab148 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:15.819566 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-144b35b6-ea31-4cb2-ae68-e0b9f53ab148 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:15.820048 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-144b35b6-ea31-4cb2-ae68-e0b9f53ab148 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:15.820778 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-144b35b6-ea31-4cb2-ae68-e0b9f53ab148 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:15.821241 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-144b35b6-ea31-4cb2-ae68-e0b9f53ab148 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:15.821690 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-144b35b6-ea31-4cb2-ae68-e0b9f53ab148 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:15.839502 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-225e998b-1b44-463a-a7d5-5b0f7424c6e5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:15.840228 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-225e998b-1b44-463a-a7d5-5b0f7424c6e5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 53426b7d-0bba-46ce-ab7e-32451f413745] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:15.865544 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-225e998b-1b44-463a-a7d5-5b0f7424c6e5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:15.866435 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-225e998b-1b44-463a-a7d5-5b0f7424c6e5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:15.867054 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-225e998b-1b44-463a-a7d5-5b0f7424c6e5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:15.868039 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-225e998b-1b44-463a-a7d5-5b0f7424c6e5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:15.868721 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-225e998b-1b44-463a-a7d5-5b0f7424c6e5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:15.869434 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-225e998b-1b44-463a-a7d5-5b0f7424c6e5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:16.072649 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-144b35b6-ea31-4cb2-ae68-e0b9f53ab148 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:16.086194 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-144b35b6-ea31-4cb2-ae68-e0b9f53ab148 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:16.087818 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-144b35b6-ea31-4cb2-ae68-e0b9f53ab148 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:16.100390 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-144b35b6-ea31-4cb2-ae68-e0b9f53ab148 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1546 microversion: 2.91 time: 0.303658 Oct 26 13:20:16.104972 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2124/4238] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:20:15 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1546 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:20:16.265391 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-225e998b-1b44-463a-a7d5-5b0f7424c6e5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:16.279731 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-225e998b-1b44-463a-a7d5-5b0f7424c6e5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745" status: 200 len: 1522 microversion: 2.1 time: 0.446202 Oct 26 13:20:16.280348 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2115/4239] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:15 2022] GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745 => generated 1522 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:20:17.137469 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7fc2b233-ec6b-42bc-b9d1-cf9022fd1603 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:17.138176 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7fc2b233-ec6b-42bc-b9d1-cf9022fd1603 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:17.152814 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7fc2b233-ec6b-42bc-b9d1-cf9022fd1603 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:17.154812 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7fc2b233-ec6b-42bc-b9d1-cf9022fd1603 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:17.155502 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7fc2b233-ec6b-42bc-b9d1-cf9022fd1603 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:17.157528 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7fc2b233-ec6b-42bc-b9d1-cf9022fd1603 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:17.160087 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7fc2b233-ec6b-42bc-b9d1-cf9022fd1603 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:17.162075 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7fc2b233-ec6b-42bc-b9d1-cf9022fd1603 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:17.315521 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9941a307-ebf0-4b76-8d26-6a6d22a64158 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:17.316367 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9941a307-ebf0-4b76-8d26-6a6d22a64158 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 53426b7d-0bba-46ce-ab7e-32451f413745] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:17.351674 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9941a307-ebf0-4b76-8d26-6a6d22a64158 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:17.352818 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9941a307-ebf0-4b76-8d26-6a6d22a64158 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:17.353564 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9941a307-ebf0-4b76-8d26-6a6d22a64158 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:17.355017 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9941a307-ebf0-4b76-8d26-6a6d22a64158 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:17.355637 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9941a307-ebf0-4b76-8d26-6a6d22a64158 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:17.356218 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9941a307-ebf0-4b76-8d26-6a6d22a64158 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:17.579800 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9941a307-ebf0-4b76-8d26-6a6d22a64158 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:17.588501 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9941a307-ebf0-4b76-8d26-6a6d22a64158 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745" status: 200 len: 1522 microversion: 2.1 time: 0.282603 Oct 26 13:20:17.594933 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2116/4240] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:17 2022] GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745 => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:17.606135 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-70825c87-6055-447c-b4c3-2befa2ad13bd tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:20:17.621930 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-70825c87-6055-447c-b4c3-2befa2ad13bd tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:17.622826 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-70825c87-6055-447c-b4c3-2befa2ad13bd tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:17.623431 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-70825c87-6055-447c-b4c3-2befa2ad13bd tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:17.637975 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7fc2b233-ec6b-42bc-b9d1-cf9022fd1603 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:17.671075 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7fc2b233-ec6b-42bc-b9d1-cf9022fd1603 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:17.674189 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-70825c87-6055-447c-b4c3-2befa2ad13bd tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Going to try to stop instance {{(pid=120597) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 26 13:20:17.679871 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7fc2b233-ec6b-42bc-b9d1-cf9022fd1603 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:17.712128 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7fc2b233-ec6b-42bc-b9d1-cf9022fd1603 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1546 microversion: 2.91 time: 0.579609 Oct 26 13:20:17.718222 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2125/4241] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:20:17 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1546 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:20:17.831274 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-70825c87-6055-447c-b4c3-2befa2ad13bd tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "POST /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c/action" status: 202 len: 0 microversion: 2.1 time: 0.234770 Oct 26 13:20:17.832219 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2117/4242] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:20:17 2022] POST /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:20:17.846587 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-49081668-6732-4818-b958-c56a18e8b6e2 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:17.847794 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-49081668-6732-4818-b958-c56a18e8b6e2 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:17.873070 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-49081668-6732-4818-b958-c56a18e8b6e2 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:17.873925 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-49081668-6732-4818-b958-c56a18e8b6e2 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:17.874984 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-49081668-6732-4818-b958-c56a18e8b6e2 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:17.876269 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-49081668-6732-4818-b958-c56a18e8b6e2 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:17.877193 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-49081668-6732-4818-b958-c56a18e8b6e2 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:17.879547 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-49081668-6732-4818-b958-c56a18e8b6e2 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:18.443255 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-49081668-6732-4818-b958-c56a18e8b6e2 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:18.452342 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-49081668-6732-4818-b958-c56a18e8b6e2 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c" status: 200 len: 1677 microversion: 2.1 time: 0.614917 Oct 26 13:20:18.473511 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2126/4243] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:17 2022] GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c => generated 1677 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:18.634910 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fe4e7050-6df2-4ac6-a01b-f4f3a8ad3644 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:18.635738 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fe4e7050-6df2-4ac6-a01b-f4f3a8ad3644 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 53426b7d-0bba-46ce-ab7e-32451f413745] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:18.660403 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fe4e7050-6df2-4ac6-a01b-f4f3a8ad3644 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:18.661994 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fe4e7050-6df2-4ac6-a01b-f4f3a8ad3644 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:18.670924 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fe4e7050-6df2-4ac6-a01b-f4f3a8ad3644 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:18.671902 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fe4e7050-6df2-4ac6-a01b-f4f3a8ad3644 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:18.672504 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fe4e7050-6df2-4ac6-a01b-f4f3a8ad3644 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:18.674086 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fe4e7050-6df2-4ac6-a01b-f4f3a8ad3644 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:18.748823 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5cd916f4-ce95-4fd7-a4f0-fac2f4aa26cb tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:18.749719 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5cd916f4-ce95-4fd7-a4f0-fac2f4aa26cb tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:18.762298 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5cd916f4-ce95-4fd7-a4f0-fac2f4aa26cb tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:18.768818 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5cd916f4-ce95-4fd7-a4f0-fac2f4aa26cb tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:18.770647 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5cd916f4-ce95-4fd7-a4f0-fac2f4aa26cb tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:18.772128 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5cd916f4-ce95-4fd7-a4f0-fac2f4aa26cb tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:18.777244 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5cd916f4-ce95-4fd7-a4f0-fac2f4aa26cb tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:18.782870 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5cd916f4-ce95-4fd7-a4f0-fac2f4aa26cb tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:19.279676 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fe4e7050-6df2-4ac6-a01b-f4f3a8ad3644 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:19.294790 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fe4e7050-6df2-4ac6-a01b-f4f3a8ad3644 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745" status: 200 len: 1522 microversion: 2.1 time: 0.664872 Oct 26 13:20:19.295406 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2118/4244] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:18 2022] GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745 => generated 1522 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:19.485345 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-adcdaffd-fb51-4452-8806-ab97281e57d2 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:19.486670 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-adcdaffd-fb51-4452-8806-ab97281e57d2 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:19.502882 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-adcdaffd-fb51-4452-8806-ab97281e57d2 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:19.503859 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-adcdaffd-fb51-4452-8806-ab97281e57d2 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:19.504725 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-adcdaffd-fb51-4452-8806-ab97281e57d2 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:19.507010 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-adcdaffd-fb51-4452-8806-ab97281e57d2 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:19.507782 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-adcdaffd-fb51-4452-8806-ab97281e57d2 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:19.508495 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-adcdaffd-fb51-4452-8806-ab97281e57d2 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:19.906378 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5cd916f4-ce95-4fd7-a4f0-fac2f4aa26cb tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:19.925003 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5cd916f4-ce95-4fd7-a4f0-fac2f4aa26cb tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:19.928227 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5cd916f4-ce95-4fd7-a4f0-fac2f4aa26cb tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:19.955214 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5cd916f4-ce95-4fd7-a4f0-fac2f4aa26cb tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1546 microversion: 2.91 time: 1.210745 Oct 26 13:20:19.959000 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2127/4245] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:20:18 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1546 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:20:20.322501 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-736cc2ee-a9a5-45ee-b470-6c66115935a8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:20.323223 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-736cc2ee-a9a5-45ee-b470-6c66115935a8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 53426b7d-0bba-46ce-ab7e-32451f413745] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:20.351128 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-736cc2ee-a9a5-45ee-b470-6c66115935a8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:20.360897 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-736cc2ee-a9a5-45ee-b470-6c66115935a8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:20.361446 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-736cc2ee-a9a5-45ee-b470-6c66115935a8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:20.362234 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-736cc2ee-a9a5-45ee-b470-6c66115935a8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:20.362695 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-736cc2ee-a9a5-45ee-b470-6c66115935a8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:20.363118 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-736cc2ee-a9a5-45ee-b470-6c66115935a8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:20.391788 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-adcdaffd-fb51-4452-8806-ab97281e57d2 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:20.401859 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-adcdaffd-fb51-4452-8806-ab97281e57d2 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c" status: 200 len: 1677 microversion: 2.1 time: 0.921802 Oct 26 13:20:20.405320 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2119/4246] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:19 2022] GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c => generated 1677 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:20:20.415457 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-adcdaffd-fb51-4452-8806-ab97281e57d2 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:20.416830 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-adcdaffd-fb51-4452-8806-ab97281e57d2 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001688 Oct 26 13:20:20.417655 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2120/4247] 10.222.0.40 () {56 vars in 886 bytes} [Wed Oct 26 13:20:20 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 26 13:20:20.437067 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:20:20.706546 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-736cc2ee-a9a5-45ee-b470-6c66115935a8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:20.725187 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-736cc2ee-a9a5-45ee-b470-6c66115935a8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745" status: 200 len: 1522 microversion: 2.1 time: 0.407197 Oct 26 13:20:20.726624 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2128/4248] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:20 2022] GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745 => generated 1522 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:20:20.991563 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2e4becad-914b-452b-ae68-3ace6ff2d85e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:20.992415 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2e4becad-914b-452b-ae68-3ace6ff2d85e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:21.019099 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e4becad-914b-452b-ae68-3ace6ff2d85e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:21.020049 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e4becad-914b-452b-ae68-3ace6ff2d85e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:21.020671 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e4becad-914b-452b-ae68-3ace6ff2d85e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:21.021610 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e4becad-914b-452b-ae68-3ace6ff2d85e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:21.023148 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e4becad-914b-452b-ae68-3ace6ff2d85e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:21.025133 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e4becad-914b-452b-ae68-3ace6ff2d85e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:21.039164 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:20:21.208977 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2e4becad-914b-452b-ae68-3ace6ff2d85e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:21.220443 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2e4becad-914b-452b-ae68-3ace6ff2d85e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:21.226209 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2e4becad-914b-452b-ae68-3ace6ff2d85e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:21.244906 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2e4becad-914b-452b-ae68-3ace6ff2d85e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1546 microversion: 2.91 time: 0.258896 Oct 26 13:20:21.246133 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2121/4249] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:20:20 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1546 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:20:21.432878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c5a52fcd-d426-4be0-b22f-6a2bdea29ff1 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:21.434272 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c5a52fcd-d426-4be0-b22f-6a2bdea29ff1 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:21.449041 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c5a52fcd-d426-4be0-b22f-6a2bdea29ff1 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:21.449963 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c5a52fcd-d426-4be0-b22f-6a2bdea29ff1 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:21.450647 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c5a52fcd-d426-4be0-b22f-6a2bdea29ff1 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:21.452725 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c5a52fcd-d426-4be0-b22f-6a2bdea29ff1 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:21.454289 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c5a52fcd-d426-4be0-b22f-6a2bdea29ff1 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:21.456821 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c5a52fcd-d426-4be0-b22f-6a2bdea29ff1 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:21.762729 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6375b913-21cd-4047-9e2d-3803dee635f8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:21.763357 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6375b913-21cd-4047-9e2d-3803dee635f8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 53426b7d-0bba-46ce-ab7e-32451f413745] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:21.772567 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6375b913-21cd-4047-9e2d-3803dee635f8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:21.773321 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6375b913-21cd-4047-9e2d-3803dee635f8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:21.773784 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6375b913-21cd-4047-9e2d-3803dee635f8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:21.778434 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6375b913-21cd-4047-9e2d-3803dee635f8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:21.779831 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6375b913-21cd-4047-9e2d-3803dee635f8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:21.781198 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6375b913-21cd-4047-9e2d-3803dee635f8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:22.095296 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c5a52fcd-d426-4be0-b22f-6a2bdea29ff1 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:22.112541 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c5a52fcd-d426-4be0-b22f-6a2bdea29ff1 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c" status: 200 len: 1677 microversion: 2.1 time: 0.683501 Oct 26 13:20:22.113587 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2129/4250] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:21 2022] GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c => generated 1677 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:22.263473 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6375b913-21cd-4047-9e2d-3803dee635f8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:22.277541 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-df1905d5-1359-4354-bd87-462d84ea2bfc tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:22.278387 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-df1905d5-1359-4354-bd87-462d84ea2bfc tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:22.288152 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6375b913-21cd-4047-9e2d-3803dee635f8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745" status: 200 len: 1522 microversion: 2.1 time: 0.529222 Oct 26 13:20:22.291331 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2122/4251] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:21 2022] GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745 => generated 1522 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:22.296165 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:20:22.300594 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df1905d5-1359-4354-bd87-462d84ea2bfc tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:22.306289 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df1905d5-1359-4354-bd87-462d84ea2bfc tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:22.306863 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df1905d5-1359-4354-bd87-462d84ea2bfc tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:22.307721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df1905d5-1359-4354-bd87-462d84ea2bfc tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:22.309751 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df1905d5-1359-4354-bd87-462d84ea2bfc tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:22.311035 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df1905d5-1359-4354-bd87-462d84ea2bfc tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:22.472602 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-df1905d5-1359-4354-bd87-462d84ea2bfc tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:22.488164 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-df1905d5-1359-4354-bd87-462d84ea2bfc tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:22.490325 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-df1905d5-1359-4354-bd87-462d84ea2bfc tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:22.512633 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-df1905d5-1359-4354-bd87-462d84ea2bfc tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1546 microversion: 2.91 time: 0.239601 Oct 26 13:20:22.513255 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2130/4252] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:20:22 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1546 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:20:23.136710 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7d380322-ec8e-49db-b732-4a86a032418f tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:23.137723 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7d380322-ec8e-49db-b732-4a86a032418f tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:23.148730 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d380322-ec8e-49db-b732-4a86a032418f tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:23.164427 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d380322-ec8e-49db-b732-4a86a032418f tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:23.166330 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d380322-ec8e-49db-b732-4a86a032418f tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:23.172760 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d380322-ec8e-49db-b732-4a86a032418f tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:23.181338 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d380322-ec8e-49db-b732-4a86a032418f tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:23.182930 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d380322-ec8e-49db-b732-4a86a032418f tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:23.321708 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a786ed44-e39f-40fd-be32-c72158345ee5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:23.322451 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a786ed44-e39f-40fd-be32-c72158345ee5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 53426b7d-0bba-46ce-ab7e-32451f413745] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:23.337768 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a786ed44-e39f-40fd-be32-c72158345ee5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:23.341660 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a786ed44-e39f-40fd-be32-c72158345ee5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:23.344160 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a786ed44-e39f-40fd-be32-c72158345ee5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:23.345450 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a786ed44-e39f-40fd-be32-c72158345ee5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:23.350768 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a786ed44-e39f-40fd-be32-c72158345ee5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:23.351582 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a786ed44-e39f-40fd-be32-c72158345ee5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:23.627202 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7d380322-ec8e-49db-b732-4a86a032418f tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:23.636837 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7d380322-ec8e-49db-b732-4a86a032418f tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c" status: 200 len: 1677 microversion: 2.1 time: 0.504034 Oct 26 13:20:23.637423 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2123/4253] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:23 2022] GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c => generated 1677 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:23.656710 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-63404ffb-f1f1-4f4a-b325-b7aa14bf2788 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:23.672956 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-63404ffb-f1f1-4f4a-b325-b7aa14bf2788 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:23.695989 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-63404ffb-f1f1-4f4a-b325-b7aa14bf2788 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:23.696494 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-63404ffb-f1f1-4f4a-b325-b7aa14bf2788 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:23.696958 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-63404ffb-f1f1-4f4a-b325-b7aa14bf2788 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:23.697708 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-63404ffb-f1f1-4f4a-b325-b7aa14bf2788 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:23.698172 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-63404ffb-f1f1-4f4a-b325-b7aa14bf2788 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:23.698604 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-63404ffb-f1f1-4f4a-b325-b7aa14bf2788 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:23.884922 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a786ed44-e39f-40fd-be32-c72158345ee5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:23.899544 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a786ed44-e39f-40fd-be32-c72158345ee5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745" status: 200 len: 1522 microversion: 2.1 time: 0.584058 Oct 26 13:20:23.901997 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2131/4254] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:23 2022] GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745 => generated 1522 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:20:23.973012 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-63404ffb-f1f1-4f4a-b325-b7aa14bf2788 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:23.988592 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-63404ffb-f1f1-4f4a-b325-b7aa14bf2788 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:23.996841 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-63404ffb-f1f1-4f4a-b325-b7aa14bf2788 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:24.013296 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-63404ffb-f1f1-4f4a-b325-b7aa14bf2788 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1546 microversion: 2.91 time: 0.363945 Oct 26 13:20:24.013927 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2124/4255] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:20:23 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1546 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:20:24.664630 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-98a2602c-83d6-4e6c-abaf-00fc3502d3b2 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:24.665350 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-98a2602c-83d6-4e6c-abaf-00fc3502d3b2 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:24.693187 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-98a2602c-83d6-4e6c-abaf-00fc3502d3b2 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:24.695232 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-98a2602c-83d6-4e6c-abaf-00fc3502d3b2 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:24.696501 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-98a2602c-83d6-4e6c-abaf-00fc3502d3b2 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:24.699957 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-98a2602c-83d6-4e6c-abaf-00fc3502d3b2 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:24.701074 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-98a2602c-83d6-4e6c-abaf-00fc3502d3b2 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:24.702196 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-98a2602c-83d6-4e6c-abaf-00fc3502d3b2 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:24.929013 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b467b550-bf2a-4957-89c1-9a8876c4a23e tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:24.929799 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b467b550-bf2a-4957-89c1-9a8876c4a23e tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 53426b7d-0bba-46ce-ab7e-32451f413745] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:24.946157 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b467b550-bf2a-4957-89c1-9a8876c4a23e tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:24.950402 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b467b550-bf2a-4957-89c1-9a8876c4a23e tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:24.952251 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b467b550-bf2a-4957-89c1-9a8876c4a23e tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:24.954764 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b467b550-bf2a-4957-89c1-9a8876c4a23e tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:24.957634 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b467b550-bf2a-4957-89c1-9a8876c4a23e tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:24.959188 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b467b550-bf2a-4957-89c1-9a8876c4a23e tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:25.434685 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-98a2602c-83d6-4e6c-abaf-00fc3502d3b2 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:25.451361 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-98a2602c-83d6-4e6c-abaf-00fc3502d3b2 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c" status: 200 len: 1677 microversion: 2.1 time: 0.789109 Oct 26 13:20:25.469699 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2132/4256] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:24 2022] GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c => generated 1677 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:25.483923 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fd53e3cd-132d-4788-95dd-02b44b1700df tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:25.486081 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fd53e3cd-132d-4788-95dd-02b44b1700df tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:25.508488 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd53e3cd-132d-4788-95dd-02b44b1700df tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:25.509233 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd53e3cd-132d-4788-95dd-02b44b1700df tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:25.509857 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd53e3cd-132d-4788-95dd-02b44b1700df tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:25.510731 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd53e3cd-132d-4788-95dd-02b44b1700df tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:25.511392 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd53e3cd-132d-4788-95dd-02b44b1700df tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:25.511981 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd53e3cd-132d-4788-95dd-02b44b1700df tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:25.512352 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b467b550-bf2a-4957-89c1-9a8876c4a23e tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:25.524621 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b467b550-bf2a-4957-89c1-9a8876c4a23e tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745" status: 200 len: 1522 microversion: 2.1 time: 0.601184 Oct 26 13:20:25.532400 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2125/4257] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:24 2022] GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745 => generated 1522 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:20:25.644526 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fd53e3cd-132d-4788-95dd-02b44b1700df tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:25.657423 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fd53e3cd-132d-4788-95dd-02b44b1700df tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:25.661201 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fd53e3cd-132d-4788-95dd-02b44b1700df tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:25.709384 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fd53e3cd-132d-4788-95dd-02b44b1700df tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1533 microversion: 2.91 time: 0.234203 Oct 26 13:20:25.711893 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2133/4258] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:20:25 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1533 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:20:25.747804 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6432e276-c4a9-4037-8b2b-0bc9ef1cd694 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:25.748424 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6432e276-c4a9-4037-8b2b-0bc9ef1cd694 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:25.773805 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6432e276-c4a9-4037-8b2b-0bc9ef1cd694 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:25.774313 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6432e276-c4a9-4037-8b2b-0bc9ef1cd694 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:25.776857 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6432e276-c4a9-4037-8b2b-0bc9ef1cd694 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:25.776857 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6432e276-c4a9-4037-8b2b-0bc9ef1cd694 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:25.776857 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6432e276-c4a9-4037-8b2b-0bc9ef1cd694 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:25.776857 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6432e276-c4a9-4037-8b2b-0bc9ef1cd694 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:25.999764 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-6432e276-c4a9-4037-8b2b-0bc9ef1cd694 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Lazy-loading 'services' on Instance uuid f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:20:26.040945 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6432e276-c4a9-4037-8b2b-0bc9ef1cd694 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1938 microversion: 2.91 time: 0.297015 Oct 26 13:20:26.044728 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2126/4259] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:20:25 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1938 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:20:26.077635 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9c2f8ac7-f9e6-433a-8bfd-a5e28c77a893 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:20:26.078195 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9c2f8ac7-f9e6-433a-8bfd-a5e28c77a893 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:26.092779 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c2f8ac7-f9e6-433a-8bfd-a5e28c77a893 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:26.093282 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c2f8ac7-f9e6-433a-8bfd-a5e28c77a893 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:26.097399 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c2f8ac7-f9e6-433a-8bfd-a5e28c77a893 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:26.098345 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c2f8ac7-f9e6-433a-8bfd-a5e28c77a893 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:26.099547 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c2f8ac7-f9e6-433a-8bfd-a5e28c77a893 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:26.102630 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c2f8ac7-f9e6-433a-8bfd-a5e28c77a893 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:26.159291 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-9c2f8ac7-f9e6-433a-8bfd-a5e28c77a893 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lazy-loading 'flavor' on Instance uuid f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:20:26.475825 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7e507793-8a28-4041-98c7-52e433548268 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:26.476446 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7e507793-8a28-4041-98c7-52e433548268 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:26.497446 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e507793-8a28-4041-98c7-52e433548268 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:26.514709 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e507793-8a28-4041-98c7-52e433548268 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:26.515179 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e507793-8a28-4041-98c7-52e433548268 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:26.515937 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e507793-8a28-4041-98c7-52e433548268 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:26.516404 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e507793-8a28-4041-98c7-52e433548268 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:26.516831 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e507793-8a28-4041-98c7-52e433548268 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:26.669793 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9c2f8ac7-f9e6-433a-8bfd-a5e28c77a893 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "POST /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3/action" status: 202 len: 0 microversion: 2.91 time: 0.596090 Oct 26 13:20:26.671898 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2134/4260] 10.222.0.40 () {62 vars in 1319 bytes} [Wed Oct 26 13:20:26 2022] POST /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3/action => generated 0 bytes in 599 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:20:26.691117 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e47caef1-d65f-4aa1-aff1-4491416c6643 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:26.691837 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e47caef1-d65f-4aa1-aff1-4491416c6643 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 53426b7d-0bba-46ce-ab7e-32451f413745] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:26.711553 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e47caef1-d65f-4aa1-aff1-4491416c6643 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:26.712047 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e47caef1-d65f-4aa1-aff1-4491416c6643 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:26.712488 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e47caef1-d65f-4aa1-aff1-4491416c6643 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:26.713204 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e47caef1-d65f-4aa1-aff1-4491416c6643 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:26.723025 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e47caef1-d65f-4aa1-aff1-4491416c6643 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:26.726486 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e47caef1-d65f-4aa1-aff1-4491416c6643 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:27.009612 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e47caef1-d65f-4aa1-aff1-4491416c6643 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:27.019346 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e47caef1-d65f-4aa1-aff1-4491416c6643 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745" status: 200 len: 1522 microversion: 2.1 time: 0.345886 Oct 26 13:20:27.023470 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2135/4261] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:26 2022] GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745 => generated 1522 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:27.035212 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-84fe560e-95b5-4c43-9af3-d3757d5a9491 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:27.038247 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-84fe560e-95b5-4c43-9af3-d3757d5a9491 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:27.045932 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84fe560e-95b5-4c43-9af3-d3757d5a9491 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:27.046633 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84fe560e-95b5-4c43-9af3-d3757d5a9491 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:27.047351 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84fe560e-95b5-4c43-9af3-d3757d5a9491 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:27.048221 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84fe560e-95b5-4c43-9af3-d3757d5a9491 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:27.048869 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84fe560e-95b5-4c43-9af3-d3757d5a9491 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:27.049589 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84fe560e-95b5-4c43-9af3-d3757d5a9491 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:27.186263 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-84fe560e-95b5-4c43-9af3-d3757d5a9491 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:27.210806 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-84fe560e-95b5-4c43-9af3-d3757d5a9491 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:27.213626 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-84fe560e-95b5-4c43-9af3-d3757d5a9491 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:27.226244 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-84fe560e-95b5-4c43-9af3-d3757d5a9491 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1539 microversion: 2.91 time: 0.196146 Oct 26 13:20:27.227354 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2136/4262] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:20:27 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1539 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:20:27.523919 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7e507793-8a28-4041-98c7-52e433548268 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:27.535997 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7e507793-8a28-4041-98c7-52e433548268 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c" status: 200 len: 1677 microversion: 2.1 time: 1.064133 Oct 26 13:20:27.541314 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2127/4263] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:26 2022] GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c => generated 1677 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:28.059342 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a555d29d-ad4d-489c-a0cc-db9783bbf0e8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:28.060782 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a555d29d-ad4d-489c-a0cc-db9783bbf0e8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 53426b7d-0bba-46ce-ab7e-32451f413745] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:28.074872 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a555d29d-ad4d-489c-a0cc-db9783bbf0e8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:28.075326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a555d29d-ad4d-489c-a0cc-db9783bbf0e8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:28.075983 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a555d29d-ad4d-489c-a0cc-db9783bbf0e8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:28.076695 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a555d29d-ad4d-489c-a0cc-db9783bbf0e8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:28.077199 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a555d29d-ad4d-489c-a0cc-db9783bbf0e8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:28.078000 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a555d29d-ad4d-489c-a0cc-db9783bbf0e8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:28.297041 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a555d29d-ad4d-489c-a0cc-db9783bbf0e8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:28.307853 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a555d29d-ad4d-489c-a0cc-db9783bbf0e8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745" status: 200 len: 1502 microversion: 2.1 time: 0.256456 Oct 26 13:20:28.309025 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2137/4264] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:28 2022] GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745 => generated 1502 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:28.329989 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-46361645-1168-4f07-b97f-abeef7d86bfa tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:28.330926 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-46361645-1168-4f07-b97f-abeef7d86bfa tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:28.346001 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46361645-1168-4f07-b97f-abeef7d86bfa tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:28.351449 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46361645-1168-4f07-b97f-abeef7d86bfa tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:28.352095 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46361645-1168-4f07-b97f-abeef7d86bfa tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:28.353008 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46361645-1168-4f07-b97f-abeef7d86bfa tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:28.353655 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46361645-1168-4f07-b97f-abeef7d86bfa tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:28.354368 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46361645-1168-4f07-b97f-abeef7d86bfa tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:28.466139 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-46361645-1168-4f07-b97f-abeef7d86bfa tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:28.479444 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-46361645-1168-4f07-b97f-abeef7d86bfa tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:28.481334 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-46361645-1168-4f07-b97f-abeef7d86bfa tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:28.492381 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-46361645-1168-4f07-b97f-abeef7d86bfa tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1539 microversion: 2.91 time: 0.181748 Oct 26 13:20:28.493362 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2138/4265] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:20:28 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1539 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:20:28.499054 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1008636e-6144-49c6-9c71-38e3ccfe9767 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:28.499914 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1008636e-6144-49c6-9c71-38e3ccfe9767 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 97825703-89d9-457a-b6c3-b694f8eee97c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:28.508250 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1008636e-6144-49c6-9c71-38e3ccfe9767 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:28.509688 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1008636e-6144-49c6-9c71-38e3ccfe9767 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:28.510344 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1008636e-6144-49c6-9c71-38e3ccfe9767 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:28.511426 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1008636e-6144-49c6-9c71-38e3ccfe9767 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:28.513027 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1008636e-6144-49c6-9c71-38e3ccfe9767 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:28.514040 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1008636e-6144-49c6-9c71-38e3ccfe9767 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:28.750610 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1008636e-6144-49c6-9c71-38e3ccfe9767 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:28.760057 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1008636e-6144-49c6-9c71-38e3ccfe9767 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c" status: 200 len: 1516 microversion: 2.1 time: 0.265263 Oct 26 13:20:28.782072 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2139/4266] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:28 2022] GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c => generated 1516 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:28.796021 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6851ffb5-5d32-4f2d-a25d-30e37fc90590 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:28.796665 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6851ffb5-5d32-4f2d-a25d-30e37fc90590 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:28.805347 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6851ffb5-5d32-4f2d-a25d-30e37fc90590 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:28.805927 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6851ffb5-5d32-4f2d-a25d-30e37fc90590 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:28.806391 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6851ffb5-5d32-4f2d-a25d-30e37fc90590 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:28.807150 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6851ffb5-5d32-4f2d-a25d-30e37fc90590 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:28.807613 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6851ffb5-5d32-4f2d-a25d-30e37fc90590 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:28.808048 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6851ffb5-5d32-4f2d-a25d-30e37fc90590 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:28.858354 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-98f21968-bb37-4693-954b-7b41e73767c5 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-575695911", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "5bb0a266-1d69-4d49-a8e6-04684ea20f45"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:20:28.978547 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-98f21968-bb37-4693-954b-7b41e73767c5 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] validate_networks() for [('5bb0a266-1d69-4d49-a8e6-04684ea20f45', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:20:29.078187 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6851ffb5-5d32-4f2d-a25d-30e37fc90590 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:29.087481 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6851ffb5-5d32-4f2d-a25d-30e37fc90590 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c" status: 200 len: 1677 microversion: 2.1 time: 0.304085 Oct 26 13:20:29.101969 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2140/4267] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:28 2022] GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c => generated 1677 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:29.109322 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-07534310-d49b-41fa-8efc-956f4d465fdb tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:20:29.112178 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-07534310-d49b-41fa-8efc-956f4d465fdb tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 5d7c3335-971c-4066-9cf2-65caa8d350bb] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:29.120306 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-07534310-d49b-41fa-8efc-956f4d465fdb tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] HTTP exception thrown: Instance 5d7c3335-971c-4066-9cf2-65caa8d350bb could not be found. Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-07534310-d49b-41fa-8efc-956f4d465fdb tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Request method failure captured: Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/servers/5d7c3335-971c-4066-9cf2-65caa8d350bb/action HTTP/1.1 Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 14 Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTPjOuLV_n1DR58OZOmgbin2ud11sLWXOml70eL6_Yw9nM-eYNoCKOyZp3mck381-99yxZlLhlu2g6vQAmqZcUDv2ExrohfYX5ori3eOe3Uf6RO52e_TYIFS_DlKFRRKYqEp1KNMktjZRMuKeogboZRQrwA8baF1wLatF4_VyxhzXdo Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 9cdd45be745d4828b5a111472254156c Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1015154874 Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9cdd45be745d4828b5a111472254156c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9cdd45be745d4828b5a111472254156c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9cdd45be745d4828b5a111472254156c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9cdd45be745d4828b5a111472254156c"}]}] Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1015154874 Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 9cdd45be745d4828b5a111472254156c Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1015154874 Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServerRescueNegativeTestJSON-1015154874-project Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 363fc117da70484f9d8cf2040e8391e4 Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1015154874-project Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: {"rescue": {}} Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 5d7c3335-971c-4066-9cf2-65caa8d350bb could not be found. Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '5d7c3335-971c-4066-9cf2-65caa8d350bb', 'body': {'rescue': {}}} Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d7c3335-971c-4066-9cf2-65caa8d350bb could not be found. Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d7c3335-971c-4066-9cf2-65caa8d350bb could not be found. Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:20:29.129988 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:20:29.134708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:20:29.134708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:20:29.134708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:20:29.134708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:20:29.134708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d7c3335-971c-4066-9cf2-65caa8d350bb could not be found. Oct 26 13:20:29.134708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:20:29.135882 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-07534310-d49b-41fa-8efc-956f4d465fdb tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Returning 404 to user: Instance 5d7c3335-971c-4066-9cf2-65caa8d350bb could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:20:29.136985 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-07534310-d49b-41fa-8efc-956f4d465fdb tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "POST /compute/v2.1/servers/5d7c3335-971c-4066-9cf2-65caa8d350bb/action" status: 404 len: 111 microversion: 2.1 time: 0.033702 Oct 26 13:20:29.137767 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2141/4268] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:20:29 2022] POST /compute/v2.1/servers/5d7c3335-971c-4066-9cf2-65caa8d350bb/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:20:29.147201 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5c6d35c4-dedd-48b1-83cc-d11d6c76e429 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:20:29.148964 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5c6d35c4-dedd-48b1-83cc-d11d6c76e429 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 97825703-89d9-457a-b6c3-b694f8eee97c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:29.159417 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c6d35c4-dedd-48b1-83cc-d11d6c76e429 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:29.160139 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c6d35c4-dedd-48b1-83cc-d11d6c76e429 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:29.160809 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c6d35c4-dedd-48b1-83cc-d11d6c76e429 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:29.161800 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c6d35c4-dedd-48b1-83cc-d11d6c76e429 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:29.162476 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c6d35c4-dedd-48b1-83cc-d11d6c76e429 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:29.163116 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c6d35c4-dedd-48b1-83cc-d11d6c76e429 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:29.256551 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:20:29.267892 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5c6d35c4-dedd-48b1-83cc-d11d6c76e429 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "POST /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c/action" status: 202 len: 0 microversion: 2.1 time: 0.124265 Oct 26 13:20:29.269525 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2142/4269] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:20:29 2022] POST /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:20:29.298024 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3cf2c72d-9505-4203-82a1-c4ced5877f45 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:29.299984 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3cf2c72d-9505-4203-82a1-c4ced5877f45 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 97825703-89d9-457a-b6c3-b694f8eee97c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:29.308625 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cf2c72d-9505-4203-82a1-c4ced5877f45 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:29.309601 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cf2c72d-9505-4203-82a1-c4ced5877f45 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:29.310467 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cf2c72d-9505-4203-82a1-c4ced5877f45 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:29.311446 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cf2c72d-9505-4203-82a1-c4ced5877f45 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:29.312119 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cf2c72d-9505-4203-82a1-c4ced5877f45 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:29.312932 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cf2c72d-9505-4203-82a1-c4ced5877f45 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:29.609251 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3cf2c72d-9505-4203-82a1-c4ced5877f45 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:29.621014 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3cf2c72d-9505-4203-82a1-c4ced5877f45 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c" status: 200 len: 1521 microversion: 2.1 time: 0.337751 Oct 26 13:20:29.622925 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2143/4270] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:29 2022] GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:29.628866 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-20c7226f-efa8-4d36-b942-1cb2f641f877 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:29.629643 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-20c7226f-efa8-4d36-b942-1cb2f641f877 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:29.637331 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-20c7226f-efa8-4d36-b942-1cb2f641f877 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:29.637984 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-20c7226f-efa8-4d36-b942-1cb2f641f877 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:29.638414 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-20c7226f-efa8-4d36-b942-1cb2f641f877 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:29.639274 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-20c7226f-efa8-4d36-b942-1cb2f641f877 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:29.639871 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-20c7226f-efa8-4d36-b942-1cb2f641f877 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:29.640565 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-20c7226f-efa8-4d36-b942-1cb2f641f877 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:29.728292 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-20c7226f-efa8-4d36-b942-1cb2f641f877 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:29.738870 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-20c7226f-efa8-4d36-b942-1cb2f641f877 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:29.743336 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-20c7226f-efa8-4d36-b942-1cb2f641f877 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:29.749583 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-20c7226f-efa8-4d36-b942-1cb2f641f877 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1539 microversion: 2.91 time: 0.125352 Oct 26 13:20:29.750735 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2144/4271] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:20:29 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1539 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:20:29.766947 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-342b473c-6ddd-49b4-b1f3-f25d528cd1c7 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:29.767756 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-342b473c-6ddd-49b4-b1f3-f25d528cd1c7 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 42f50b1b-9531-43dd-bb5f-cbca3b7d306f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:29.787566 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-342b473c-6ddd-49b4-b1f3-f25d528cd1c7 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:29.789245 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-342b473c-6ddd-49b4-b1f3-f25d528cd1c7 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:29.792396 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-342b473c-6ddd-49b4-b1f3-f25d528cd1c7 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:29.794352 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-342b473c-6ddd-49b4-b1f3-f25d528cd1c7 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:29.794920 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-342b473c-6ddd-49b4-b1f3-f25d528cd1c7 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:29.795496 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-342b473c-6ddd-49b4-b1f3-f25d528cd1c7 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:29.839417 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-98f21968-bb37-4693-954b-7b41e73767c5 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:20:29.840038 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-98f21968-bb37-4693-954b-7b41e73767c5 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:20:29.840381 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-98f21968-bb37-4693-954b-7b41e73767c5 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:20:29.840801 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-98f21968-bb37-4693-954b-7b41e73767c5 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:20:29.841219 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-98f21968-bb37-4693-954b-7b41e73767c5 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:20:29.853801 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-342b473c-6ddd-49b4-b1f3-f25d528cd1c7 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f/ips" status: 200 len: 149 microversion: 2.1 time: 0.101727 Oct 26 13:20:29.862462 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2145/4272] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Oct 26 13:20:29 2022] GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f/ips => generated 149 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:20:29.864748 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-98f21968-bb37-4693-954b-7b41e73767c5 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:29.865611 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-98f21968-bb37-4693-954b-7b41e73767c5 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:29.866128 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-98f21968-bb37-4693-954b-7b41e73767c5 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:29.867573 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-98f21968-bb37-4693-954b-7b41e73767c5 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:29.868042 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-98f21968-bb37-4693-954b-7b41e73767c5 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:29.868541 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-98f21968-bb37-4693-954b-7b41e73767c5 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:29.899733 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-98f21968-bb37-4693-954b-7b41e73767c5 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Getting quotas for project ed18295b8b7e42d094c7a5b0f0ce2786. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:20:29.906358 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-98f21968-bb37-4693-954b-7b41e73767c5 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Getting quotas for user fc2ce55e939e46cfb66f24b4ee82b7ae and project ed18295b8b7e42d094c7a5b0f0ce2786. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:20:29.922063 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-98f21968-bb37-4693-954b-7b41e73767c5 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:20:29.924732 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-98f21968-bb37-4693-954b-7b41e73767c5 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] [instance: e83accea-4a1c-4e78-8cde-af4d398dc938] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:20:30.004984 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-98f21968-bb37-4693-954b-7b41e73767c5 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.747013 Oct 26 13:20:30.008641 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2128/4273] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:20:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:20:30.024733 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b81a7174-8668-455f-bc0f-caca99bae344 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:30.025371 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b81a7174-8668-455f-bc0f-caca99bae344 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] [instance: e83accea-4a1c-4e78-8cde-af4d398dc938] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:30.122989 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-21fe7e72-90c4-4f77-991e-7eef7178cf70 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:30.123991 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-21fe7e72-90c4-4f77-991e-7eef7178cf70 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:30.137821 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b81a7174-8668-455f-bc0f-caca99bae344 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2ce55e939e46cfb66f24b4ee82b7ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed18295b8b7e42d094c7a5b0f0ce2786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:30.143849 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-21fe7e72-90c4-4f77-991e-7eef7178cf70 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:30.144365 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-21fe7e72-90c4-4f77-991e-7eef7178cf70 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:30.148528 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b81a7174-8668-455f-bc0f-caca99bae344 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] 10.222.0.40 "GET /compute/v2.1/servers/e83accea-4a1c-4e78-8cde-af4d398dc938" status: 200 len: 1224 microversion: 2.1 time: 0.128700 Oct 26 13:20:30.150369 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2146/4274] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:30 2022] GET /compute/v2.1/servers/e83accea-4a1c-4e78-8cde-af4d398dc938 => generated 1224 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:30.171062 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-21fe7e72-90c4-4f77-991e-7eef7178cf70 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:30.172592 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-21fe7e72-90c4-4f77-991e-7eef7178cf70 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:30.173844 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-21fe7e72-90c4-4f77-991e-7eef7178cf70 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:30.177015 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-21fe7e72-90c4-4f77-991e-7eef7178cf70 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:30.544429 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-21fe7e72-90c4-4f77-991e-7eef7178cf70 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:30.558488 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-21fe7e72-90c4-4f77-991e-7eef7178cf70 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c" status: 200 len: 1654 microversion: 2.1 time: 0.447916 Oct 26 13:20:30.559285 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2129/4275] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:30 2022] GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c => generated 1654 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:20:30.587424 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7e7682a9-05fc-4eda-a4c0-8aaccfb66c03 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:20:30.597568 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e7682a9-05fc-4eda-a4c0-8aaccfb66c03 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:30.598735 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e7682a9-05fc-4eda-a4c0-8aaccfb66c03 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:30.599602 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e7682a9-05fc-4eda-a4c0-8aaccfb66c03 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:30.651873 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e96c156a-da81-4757-bbbb-6148a9ef5d03 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:30.652608 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e96c156a-da81-4757-bbbb-6148a9ef5d03 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 97825703-89d9-457a-b6c3-b694f8eee97c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:30.663652 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7e7682a9-05fc-4eda-a4c0-8aaccfb66c03 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Going to try to start instance {{(pid=120598) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 26 13:20:30.671045 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e96c156a-da81-4757-bbbb-6148a9ef5d03 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:30.671561 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e96c156a-da81-4757-bbbb-6148a9ef5d03 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:30.673592 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e96c156a-da81-4757-bbbb-6148a9ef5d03 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:30.674281 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e96c156a-da81-4757-bbbb-6148a9ef5d03 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:30.674756 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e96c156a-da81-4757-bbbb-6148a9ef5d03 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:30.675197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e96c156a-da81-4757-bbbb-6148a9ef5d03 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:30.749262 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7e7682a9-05fc-4eda-a4c0-8aaccfb66c03 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "POST /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c/action" status: 202 len: 0 microversion: 2.1 time: 0.168570 Oct 26 13:20:30.781185 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2147/4276] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:20:30 2022] POST /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:20:30.804682 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9e20ab08-ea37-4406-ac36-941a52b2c441 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:30.808134 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9e20ab08-ea37-4406-ac36-941a52b2c441 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:30.826292 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e20ab08-ea37-4406-ac36-941a52b2c441 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:30.830014 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e20ab08-ea37-4406-ac36-941a52b2c441 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:30.830716 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e20ab08-ea37-4406-ac36-941a52b2c441 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:30.837184 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e20ab08-ea37-4406-ac36-941a52b2c441 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:30.837184 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e20ab08-ea37-4406-ac36-941a52b2c441 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:30.839680 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e20ab08-ea37-4406-ac36-941a52b2c441 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:31.145376 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e96c156a-da81-4757-bbbb-6148a9ef5d03 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:31.162728 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e96c156a-da81-4757-bbbb-6148a9ef5d03 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c" status: 200 len: 1501 microversion: 2.1 time: 0.516241 Oct 26 13:20:31.174996 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2130/4277] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:30 2022] GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c => generated 1501 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:20:31.191064 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-62eb18b7-d0c8-46d4-9280-ad0fe911321f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:31.191719 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-62eb18b7-d0c8-46d4-9280-ad0fe911321f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:31.217613 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-62eb18b7-d0c8-46d4-9280-ad0fe911321f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:31.218468 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-62eb18b7-d0c8-46d4-9280-ad0fe911321f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:31.221024 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-62eb18b7-d0c8-46d4-9280-ad0fe911321f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:31.222062 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-62eb18b7-d0c8-46d4-9280-ad0fe911321f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:31.225615 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-62eb18b7-d0c8-46d4-9280-ad0fe911321f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:31.226525 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-62eb18b7-d0c8-46d4-9280-ad0fe911321f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:31.307208 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9e20ab08-ea37-4406-ac36-941a52b2c441 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:31.321755 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9e20ab08-ea37-4406-ac36-941a52b2c441 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c" status: 200 len: 1663 microversion: 2.1 time: 0.537774 Oct 26 13:20:31.323742 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2148/4278] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:30 2022] GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c => generated 1663 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:31.338144 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-db8b573d-4623-450a-999b-35deb758460f tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:31.340256 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-db8b573d-4623-450a-999b-35deb758460f tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] [instance: e83accea-4a1c-4e78-8cde-af4d398dc938] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:31.356960 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db8b573d-4623-450a-999b-35deb758460f tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:31.357917 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db8b573d-4623-450a-999b-35deb758460f tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:31.358356 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db8b573d-4623-450a-999b-35deb758460f tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:31.359091 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db8b573d-4623-450a-999b-35deb758460f tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:31.359544 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db8b573d-4623-450a-999b-35deb758460f tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:31.373943 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db8b573d-4623-450a-999b-35deb758460f tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:31.572796 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-62eb18b7-d0c8-46d4-9280-ad0fe911321f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:31.599524 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-62eb18b7-d0c8-46d4-9280-ad0fe911321f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:31.601507 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-62eb18b7-d0c8-46d4-9280-ad0fe911321f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:31.615268 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-62eb18b7-d0c8-46d4-9280-ad0fe911321f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1539 microversion: 2.91 time: 0.427390 Oct 26 13:20:31.618370 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2131/4279] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:20:31 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1539 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:20:31.635415 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f3d793e3-cdf2-47b9-b258-fc42ecb69f2d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:20:31.640855 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f3d793e3-cdf2-47b9-b258-fc42ecb69f2d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 97825703-89d9-457a-b6c3-b694f8eee97c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:31.659525 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3d793e3-cdf2-47b9-b258-fc42ecb69f2d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:31.664341 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3d793e3-cdf2-47b9-b258-fc42ecb69f2d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:31.665561 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3d793e3-cdf2-47b9-b258-fc42ecb69f2d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:31.666561 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3d793e3-cdf2-47b9-b258-fc42ecb69f2d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:31.667266 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3d793e3-cdf2-47b9-b258-fc42ecb69f2d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:31.667926 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3d793e3-cdf2-47b9-b258-fc42ecb69f2d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:31.719825 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-f3d793e3-cdf2-47b9-b258-fc42ecb69f2d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lazy-loading 'flavor' on Instance uuid 97825703-89d9-457a-b6c3-b694f8eee97c {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:20:31.766360 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-f3d793e3-cdf2-47b9-b258-fc42ecb69f2d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] HTTP exception thrown: Cannot 'rescue' instance 97825703-89d9-457a-b6c3-b694f8eee97c while it is in vm_state paused Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f3d793e3-cdf2-47b9-b258-fc42ecb69f2d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Request method failure captured: Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c/action HTTP/1.1 Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 14 Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTPjOuLV_n1DR58OZOmgbin2ud11sLWXOml70eL6_Yw9nM-eYNoCKOyZp3mck381-99yxZlLhlu2g6vQAmqZcUDv2ExrohfYX5ori3eOe3Uf6RO52e_TYIFS_DlKFRRKYqEp1KNMktjZRMuKeogboZRQrwA8baF1wLatF4_VyxhzXdo Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 9cdd45be745d4828b5a111472254156c Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1015154874 Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9cdd45be745d4828b5a111472254156c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9cdd45be745d4828b5a111472254156c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9cdd45be745d4828b5a111472254156c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9cdd45be745d4828b5a111472254156c"}]}] Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1015154874 Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 9cdd45be745d4828b5a111472254156c Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1015154874 Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServerRescueNegativeTestJSON-1015154874-project Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 363fc117da70484f9d8cf2040e8391e4 Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1015154874-project Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: {"rescue": {}} Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: exception: Cannot 'rescue' instance 97825703-89d9-457a-b6c3-b694f8eee97c while it is in vm_state paused Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '97825703-89d9-457a-b6c3-b694f8eee97c', 'body': {'rescue': {}}} Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 97825703-89d9-457a-b6c3-b694f8eee97c in vm_state paused. Cannot rescue while the instance is in this state. Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 97825703-89d9-457a-b6c3-b694f8eee97c while it is in vm_state paused Oct 26 13:20:31.768952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:20:31.773856 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:20:31.773856 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:20:31.773856 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:20:31.773856 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:20:31.773856 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:20:31.773856 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:20:31.773856 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:20:31.773856 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 97825703-89d9-457a-b6c3-b694f8eee97c while it is in vm_state paused Oct 26 13:20:31.773856 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:20:31.777794 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f3d793e3-cdf2-47b9-b258-fc42ecb69f2d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Returning 409 to user: Cannot 'rescue' instance 97825703-89d9-457a-b6c3-b694f8eee97c while it is in vm_state paused {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:20:31.779151 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f3d793e3-cdf2-47b9-b258-fc42ecb69f2d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "POST /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c/action" status: 409 len: 144 microversion: 2.1 time: 0.159554 Oct 26 13:20:31.783757 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2132/4280] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:20:31 2022] POST /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c/action => generated 144 bytes in 165 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:20:31.790931 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-39585130-3f45-4223-9e1b-efb5e681d218 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:20:31.791807 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-39585130-3f45-4223-9e1b-efb5e681d218 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 97825703-89d9-457a-b6c3-b694f8eee97c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:31.813291 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39585130-3f45-4223-9e1b-efb5e681d218 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:31.816504 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39585130-3f45-4223-9e1b-efb5e681d218 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:31.819018 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39585130-3f45-4223-9e1b-efb5e681d218 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:31.822448 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39585130-3f45-4223-9e1b-efb5e681d218 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:31.823161 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39585130-3f45-4223-9e1b-efb5e681d218 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:31.824872 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39585130-3f45-4223-9e1b-efb5e681d218 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:31.990728 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-39585130-3f45-4223-9e1b-efb5e681d218 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "POST /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c/action" status: 202 len: 0 microversion: 2.1 time: 0.202496 Oct 26 13:20:31.993196 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2133/4281] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:20:31 2022] POST /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:20:32.008778 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9be2421f-95f5-4d61-8a98-d1f12e5aa619 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:32.013116 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9be2421f-95f5-4d61-8a98-d1f12e5aa619 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 97825703-89d9-457a-b6c3-b694f8eee97c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:32.025043 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9be2421f-95f5-4d61-8a98-d1f12e5aa619 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:32.025948 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9be2421f-95f5-4d61-8a98-d1f12e5aa619 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:32.026806 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9be2421f-95f5-4d61-8a98-d1f12e5aa619 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:32.033719 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9be2421f-95f5-4d61-8a98-d1f12e5aa619 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:32.034370 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9be2421f-95f5-4d61-8a98-d1f12e5aa619 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:32.034833 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9be2421f-95f5-4d61-8a98-d1f12e5aa619 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:32.165234 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-db8b573d-4623-450a-999b-35deb758460f tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2ce55e939e46cfb66f24b4ee82b7ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed18295b8b7e42d094c7a5b0f0ce2786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:32.201021 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-db8b573d-4623-450a-999b-35deb758460f tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] 10.222.0.40 "GET /compute/v2.1/servers/e83accea-4a1c-4e78-8cde-af4d398dc938" status: 200 len: 1220 microversion: 2.1 time: 0.870008 Oct 26 13:20:32.202211 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2149/4282] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:31 2022] GET /compute/v2.1/servers/e83accea-4a1c-4e78-8cde-af4d398dc938 => generated 1220 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:32.355166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-209f0784-5aaa-4d86-a157-dc6f0877a9c7 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:32.357061 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-209f0784-5aaa-4d86-a157-dc6f0877a9c7 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:32.366361 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-209f0784-5aaa-4d86-a157-dc6f0877a9c7 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:32.367632 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-209f0784-5aaa-4d86-a157-dc6f0877a9c7 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:32.368318 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-209f0784-5aaa-4d86-a157-dc6f0877a9c7 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:32.369330 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-209f0784-5aaa-4d86-a157-dc6f0877a9c7 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:32.370049 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-209f0784-5aaa-4d86-a157-dc6f0877a9c7 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:32.370680 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-209f0784-5aaa-4d86-a157-dc6f0877a9c7 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:32.558026 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9be2421f-95f5-4d61-8a98-d1f12e5aa619 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:32.568679 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9be2421f-95f5-4d61-8a98-d1f12e5aa619 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c" status: 200 len: 1508 microversion: 2.1 time: 0.570877 Oct 26 13:20:32.574649 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2134/4283] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:31 2022] GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c => generated 1508 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:32.652152 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e2b81922-8a63-4de6-b462-c3456587053f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:32.652884 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e2b81922-8a63-4de6-b462-c3456587053f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:32.662772 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e2b81922-8a63-4de6-b462-c3456587053f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:32.684915 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e2b81922-8a63-4de6-b462-c3456587053f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:32.685747 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e2b81922-8a63-4de6-b462-c3456587053f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:32.689074 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e2b81922-8a63-4de6-b462-c3456587053f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:32.689819 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e2b81922-8a63-4de6-b462-c3456587053f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:32.690472 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e2b81922-8a63-4de6-b462-c3456587053f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:32.815118 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e2b81922-8a63-4de6-b462-c3456587053f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:32.828481 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e2b81922-8a63-4de6-b462-c3456587053f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:32.830631 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e2b81922-8a63-4de6-b462-c3456587053f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:32.838204 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e2b81922-8a63-4de6-b462-c3456587053f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1539 microversion: 2.91 time: 0.191713 Oct 26 13:20:32.854354 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2135/4284] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:20:32 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1539 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:20:32.864355 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8a1223c3-7a8b-4ea3-b026-b118184dd36c tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "79d03268-b36b-487a-857e-4d0cd110c22e"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:20:32.868504 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8a1223c3-7a8b-4ea3-b026-b118184dd36c tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 42f50b1b-9531-43dd-bb5f-cbca3b7d306f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:32.881443 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8a1223c3-7a8b-4ea3-b026-b118184dd36c tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:32.882190 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8a1223c3-7a8b-4ea3-b026-b118184dd36c tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:32.883064 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8a1223c3-7a8b-4ea3-b026-b118184dd36c tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:32.885789 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8a1223c3-7a8b-4ea3-b026-b118184dd36c tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:32.887545 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8a1223c3-7a8b-4ea3-b026-b118184dd36c tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:32.888571 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8a1223c3-7a8b-4ea3-b026-b118184dd36c tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:33.061525 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-209f0784-5aaa-4d86-a157-dc6f0877a9c7 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:33.074322 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-209f0784-5aaa-4d86-a157-dc6f0877a9c7 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c" status: 200 len: 1663 microversion: 2.1 time: 0.725350 Oct 26 13:20:33.075656 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2150/4285] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:32 2022] GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c => generated 1663 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:33.183705 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:20:33.227306 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-dfae948c-a1af-4c9b-bea9-61f18ae018b9 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:33.228256 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-dfae948c-a1af-4c9b-bea9-61f18ae018b9 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] [instance: e83accea-4a1c-4e78-8cde-af4d398dc938] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:33.243108 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dfae948c-a1af-4c9b-bea9-61f18ae018b9 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:33.243621 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dfae948c-a1af-4c9b-bea9-61f18ae018b9 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:33.244068 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dfae948c-a1af-4c9b-bea9-61f18ae018b9 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:33.246394 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dfae948c-a1af-4c9b-bea9-61f18ae018b9 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:33.246884 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dfae948c-a1af-4c9b-bea9-61f18ae018b9 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:33.247906 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dfae948c-a1af-4c9b-bea9-61f18ae018b9 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:33.384710 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8a1223c3-7a8b-4ea3-b026-b118184dd36c tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "POST /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.538263 Oct 26 13:20:33.386046 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2136/4286] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Oct 26 13:20:32 2022] POST /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f/os-volume_attachments => generated 194 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:20:33.481426 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-dfae948c-a1af-4c9b-bea9-61f18ae018b9 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2ce55e939e46cfb66f24b4ee82b7ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed18295b8b7e42d094c7a5b0f0ce2786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:33.495421 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-dfae948c-a1af-4c9b-bea9-61f18ae018b9 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] 10.222.0.40 "GET /compute/v2.1/servers/e83accea-4a1c-4e78-8cde-af4d398dc938" status: 200 len: 1282 microversion: 2.1 time: 0.272761 Oct 26 13:20:33.496437 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2151/4287] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:33 2022] GET /compute/v2.1/servers/e83accea-4a1c-4e78-8cde-af4d398dc938 => generated 1282 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:33.601529 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f076283c-74e7-4e0b-80dc-63385e6e668a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:33.603130 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f076283c-74e7-4e0b-80dc-63385e6e668a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 97825703-89d9-457a-b6c3-b694f8eee97c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:33.610528 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f076283c-74e7-4e0b-80dc-63385e6e668a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:33.611324 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f076283c-74e7-4e0b-80dc-63385e6e668a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:33.612097 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f076283c-74e7-4e0b-80dc-63385e6e668a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:33.612989 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f076283c-74e7-4e0b-80dc-63385e6e668a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:33.613695 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f076283c-74e7-4e0b-80dc-63385e6e668a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:33.614240 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f076283c-74e7-4e0b-80dc-63385e6e668a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:33.867570 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f076283c-74e7-4e0b-80dc-63385e6e668a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:33.867881 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1461cd30-10df-49c4-9bce-9e3ad93db1ea tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:33.868499 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1461cd30-10df-49c4-9bce-9e3ad93db1ea tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:33.876812 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f076283c-74e7-4e0b-80dc-63385e6e668a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c" status: 200 len: 1516 microversion: 2.1 time: 0.282139 Oct 26 13:20:33.881214 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1461cd30-10df-49c4-9bce-9e3ad93db1ea tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:33.881820 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1461cd30-10df-49c4-9bce-9e3ad93db1ea tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:33.882186 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2137/4288] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:33 2022] GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c => generated 1516 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:33.886231 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1461cd30-10df-49c4-9bce-9e3ad93db1ea tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:33.887206 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1461cd30-10df-49c4-9bce-9e3ad93db1ea tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:33.887823 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1461cd30-10df-49c4-9bce-9e3ad93db1ea tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:33.888496 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1461cd30-10df-49c4-9bce-9e3ad93db1ea tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:34.103875 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d8acc4d0-2efa-46c0-935d-78fe12778950 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:34.104786 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d8acc4d0-2efa-46c0-935d-78fe12778950 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:34.121042 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8acc4d0-2efa-46c0-935d-78fe12778950 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:34.121577 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8acc4d0-2efa-46c0-935d-78fe12778950 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:34.122023 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8acc4d0-2efa-46c0-935d-78fe12778950 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:34.122747 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8acc4d0-2efa-46c0-935d-78fe12778950 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:34.123210 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8acc4d0-2efa-46c0-935d-78fe12778950 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:34.123648 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8acc4d0-2efa-46c0-935d-78fe12778950 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:34.207364 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1461cd30-10df-49c4-9bce-9e3ad93db1ea tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:34.222186 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1461cd30-10df-49c4-9bce-9e3ad93db1ea tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:34.225187 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1461cd30-10df-49c4-9bce-9e3ad93db1ea tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:34.245951 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1461cd30-10df-49c4-9bce-9e3ad93db1ea tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1539 microversion: 2.91 time: 0.381787 Oct 26 13:20:34.250842 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2152/4289] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:20:33 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1539 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:20:34.466214 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d8acc4d0-2efa-46c0-935d-78fe12778950 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:34.476430 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d8acc4d0-2efa-46c0-935d-78fe12778950 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c" status: 200 len: 1667 microversion: 2.1 time: 0.376513 Oct 26 13:20:34.477537 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2138/4290] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:34 2022] GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c => generated 1667 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:20:34.524806 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-da29ad1b-0421-46d9-b7aa-833a971e6bdc tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:34.525443 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-da29ad1b-0421-46d9-b7aa-833a971e6bdc tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] [instance: e83accea-4a1c-4e78-8cde-af4d398dc938] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:34.543847 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da29ad1b-0421-46d9-b7aa-833a971e6bdc tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:34.544374 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da29ad1b-0421-46d9-b7aa-833a971e6bdc tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:34.548604 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da29ad1b-0421-46d9-b7aa-833a971e6bdc tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:34.549996 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da29ad1b-0421-46d9-b7aa-833a971e6bdc tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:34.593895 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da29ad1b-0421-46d9-b7aa-833a971e6bdc tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:34.594457 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da29ad1b-0421-46d9-b7aa-833a971e6bdc tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:35.187818 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-da29ad1b-0421-46d9-b7aa-833a971e6bdc tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2ce55e939e46cfb66f24b4ee82b7ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed18295b8b7e42d094c7a5b0f0ce2786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:35.210134 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-da29ad1b-0421-46d9-b7aa-833a971e6bdc tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] 10.222.0.40 "GET /compute/v2.1/servers/e83accea-4a1c-4e78-8cde-af4d398dc938" status: 200 len: 1324 microversion: 2.1 time: 0.694336 Oct 26 13:20:35.213365 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2153/4291] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:34 2022] GET /compute/v2.1/servers/e83accea-4a1c-4e78-8cde-af4d398dc938 => generated 1324 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:35.287346 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-40f8a48a-9b38-4b1c-8aac-7ffa442b960c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:35.288228 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-40f8a48a-9b38-4b1c-8aac-7ffa442b960c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:35.299867 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-40f8a48a-9b38-4b1c-8aac-7ffa442b960c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:35.300368 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-40f8a48a-9b38-4b1c-8aac-7ffa442b960c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:35.300814 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-40f8a48a-9b38-4b1c-8aac-7ffa442b960c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:35.303759 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-40f8a48a-9b38-4b1c-8aac-7ffa442b960c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:35.304268 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-40f8a48a-9b38-4b1c-8aac-7ffa442b960c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:35.304700 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-40f8a48a-9b38-4b1c-8aac-7ffa442b960c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:35.586539 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-40f8a48a-9b38-4b1c-8aac-7ffa442b960c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:35.602531 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-40f8a48a-9b38-4b1c-8aac-7ffa442b960c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:35.608396 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-40f8a48a-9b38-4b1c-8aac-7ffa442b960c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:35.640873 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-40f8a48a-9b38-4b1c-8aac-7ffa442b960c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1539 microversion: 2.91 time: 0.355793 Oct 26 13:20:35.641665 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2139/4292] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:20:35 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1539 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:20:36.237166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-554dda53-c7fc-4d25-a8b7-67f68ba3db77 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:36.237871 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-554dda53-c7fc-4d25-a8b7-67f68ba3db77 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] [instance: e83accea-4a1c-4e78-8cde-af4d398dc938] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:36.256560 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-554dda53-c7fc-4d25-a8b7-67f68ba3db77 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:36.259200 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-554dda53-c7fc-4d25-a8b7-67f68ba3db77 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:36.259751 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-554dda53-c7fc-4d25-a8b7-67f68ba3db77 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:36.262383 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-554dda53-c7fc-4d25-a8b7-67f68ba3db77 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:36.264703 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-554dda53-c7fc-4d25-a8b7-67f68ba3db77 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:36.265340 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-554dda53-c7fc-4d25-a8b7-67f68ba3db77 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:36.631102 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-554dda53-c7fc-4d25-a8b7-67f68ba3db77 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2ce55e939e46cfb66f24b4ee82b7ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed18295b8b7e42d094c7a5b0f0ce2786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:36.641647 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-554dda53-c7fc-4d25-a8b7-67f68ba3db77 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] 10.222.0.40 "GET /compute/v2.1/servers/e83accea-4a1c-4e78-8cde-af4d398dc938" status: 200 len: 1324 microversion: 2.1 time: 0.409027 Oct 26 13:20:36.645042 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2154/4293] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:36 2022] GET /compute/v2.1/servers/e83accea-4a1c-4e78-8cde-af4d398dc938 => generated 1324 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:36.678382 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1d7e2907-c171-46ec-bb19-dbed87e19685 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:36.679156 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1d7e2907-c171-46ec-bb19-dbed87e19685 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:36.694382 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d7e2907-c171-46ec-bb19-dbed87e19685 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:36.695197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d7e2907-c171-46ec-bb19-dbed87e19685 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:36.695905 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d7e2907-c171-46ec-bb19-dbed87e19685 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:36.696872 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d7e2907-c171-46ec-bb19-dbed87e19685 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:36.698020 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d7e2907-c171-46ec-bb19-dbed87e19685 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:36.700100 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d7e2907-c171-46ec-bb19-dbed87e19685 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:36.892802 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1d7e2907-c171-46ec-bb19-dbed87e19685 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:36.911060 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1d7e2907-c171-46ec-bb19-dbed87e19685 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:36.913269 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1d7e2907-c171-46ec-bb19-dbed87e19685 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:36.954460 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1d7e2907-c171-46ec-bb19-dbed87e19685 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1539 microversion: 2.91 time: 0.264283 Oct 26 13:20:36.954460 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2140/4294] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:20:36 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1539 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:20:37.078344 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-69a5f909-840a-4d2e-82bf-fcfc75bce147 req-08ff062f-c1ee-4a88-a5da-824fa4de5c59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e83accea-4a1c-4e78-8cde-af4d398dc938", "tag": "bff79e7d-fbe1-4be0-8afd-170dcef67d0c"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:20:37.080031 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6ee2454e-bf5f-4611-b5c6-397dd00b883e tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:20:37.082756 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6ee2454e-bf5f-4611-b5c6-397dd00b883e tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 97825703-89d9-457a-b6c3-b694f8eee97c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:37.092315 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ee2454e-bf5f-4611-b5c6-397dd00b883e tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:37.093182 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ee2454e-bf5f-4611-b5c6-397dd00b883e tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:37.094064 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ee2454e-bf5f-4611-b5c6-397dd00b883e tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:37.095289 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ee2454e-bf5f-4611-b5c6-397dd00b883e tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:37.096035 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ee2454e-bf5f-4611-b5c6-397dd00b883e tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:37.096675 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ee2454e-bf5f-4611-b5c6-397dd00b883e tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:37.096779 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-69a5f909-840a-4d2e-82bf-fcfc75bce147 req-08ff062f-c1ee-4a88-a5da-824fa4de5c59 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:37.098207 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-69a5f909-840a-4d2e-82bf-fcfc75bce147 req-08ff062f-c1ee-4a88-a5da-824fa4de5c59 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:37.099181 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-69a5f909-840a-4d2e-82bf-fcfc75bce147 req-08ff062f-c1ee-4a88-a5da-824fa4de5c59 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:37.113826 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-69a5f909-840a-4d2e-82bf-fcfc75bce147 req-08ff062f-c1ee-4a88-a5da-824fa4de5c59 service nova] Creating event network-changed:bff79e7d-fbe1-4be0-8afd-170dcef67d0c for instance e83accea-4a1c-4e78-8cde-af4d398dc938 on n-h1-862686-1 Oct 26 13:20:37.121731 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-69a5f909-840a-4d2e-82bf-fcfc75bce147 req-08ff062f-c1ee-4a88-a5da-824fa4de5c59 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057845 Oct 26 13:20:37.123528 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2155/4295] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:20:37.136313 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-6ee2454e-bf5f-4611-b5c6-397dd00b883e tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lazy-loading 'flavor' on Instance uuid 97825703-89d9-457a-b6c3-b694f8eee97c {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:20:37.257210 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6ee2454e-bf5f-4611-b5c6-397dd00b883e tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "POST /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c/action" status: 200 len: 32 microversion: 2.1 time: 0.182041 Oct 26 13:20:37.265841 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2141/4296] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:20:37 2022] POST /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c/action => generated 32 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:20:37.277576 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-55c87974-a102-4747-b5d5-783fb9774eff tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:37.278565 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-55c87974-a102-4747-b5d5-783fb9774eff tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 97825703-89d9-457a-b6c3-b694f8eee97c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:37.294649 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55c87974-a102-4747-b5d5-783fb9774eff tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:37.295147 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55c87974-a102-4747-b5d5-783fb9774eff tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:37.299819 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55c87974-a102-4747-b5d5-783fb9774eff tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:37.301277 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55c87974-a102-4747-b5d5-783fb9774eff tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:37.302385 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55c87974-a102-4747-b5d5-783fb9774eff tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:37.303195 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55c87974-a102-4747-b5d5-783fb9774eff tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:37.601843 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-55c87974-a102-4747-b5d5-783fb9774eff tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:37.610135 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-55c87974-a102-4747-b5d5-783fb9774eff tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c" status: 200 len: 1522 microversion: 2.1 time: 0.338216 Oct 26 13:20:37.610948 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2156/4297] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:37 2022] GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c => generated 1522 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:37.675463 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9e097e7b-bdaf-4e11-b48e-3042a1697706 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:37.677060 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9e097e7b-bdaf-4e11-b48e-3042a1697706 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] [instance: e83accea-4a1c-4e78-8cde-af4d398dc938] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:37.685419 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9e097e7b-bdaf-4e11-b48e-3042a1697706 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:37.686084 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9e097e7b-bdaf-4e11-b48e-3042a1697706 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:37.686762 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9e097e7b-bdaf-4e11-b48e-3042a1697706 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:37.687697 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9e097e7b-bdaf-4e11-b48e-3042a1697706 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:37.688716 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9e097e7b-bdaf-4e11-b48e-3042a1697706 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:37.689391 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9e097e7b-bdaf-4e11-b48e-3042a1697706 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:37.969052 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-22f74072-42db-4348-bc0e-6c5c6828a8d9 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:37.969854 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-22f74072-42db-4348-bc0e-6c5c6828a8d9 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:37.979051 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22f74072-42db-4348-bc0e-6c5c6828a8d9 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:37.979731 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22f74072-42db-4348-bc0e-6c5c6828a8d9 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:37.980935 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22f74072-42db-4348-bc0e-6c5c6828a8d9 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:37.981916 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22f74072-42db-4348-bc0e-6c5c6828a8d9 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:37.982526 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22f74072-42db-4348-bc0e-6c5c6828a8d9 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:37.984176 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22f74072-42db-4348-bc0e-6c5c6828a8d9 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:38.288714 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-22f74072-42db-4348-bc0e-6c5c6828a8d9 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:38.304120 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-22f74072-42db-4348-bc0e-6c5c6828a8d9 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:38.306364 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-22f74072-42db-4348-bc0e-6c5c6828a8d9 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:38.314301 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-22f74072-42db-4348-bc0e-6c5c6828a8d9 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1539 microversion: 2.91 time: 0.352798 Oct 26 13:20:38.315125 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2157/4298] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:20:37 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1539 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:20:38.428253 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9e097e7b-bdaf-4e11-b48e-3042a1697706 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2ce55e939e46cfb66f24b4ee82b7ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed18295b8b7e42d094c7a5b0f0ce2786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:38.441739 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9e097e7b-bdaf-4e11-b48e-3042a1697706 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] 10.222.0.40 "GET /compute/v2.1/servers/e83accea-4a1c-4e78-8cde-af4d398dc938" status: 200 len: 1324 microversion: 2.1 time: 0.776124 Oct 26 13:20:38.445556 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2142/4299] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:37 2022] GET /compute/v2.1/servers/e83accea-4a1c-4e78-8cde-af4d398dc938 => generated 1324 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:38.637889 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-083819df-98fe-4900-846f-fa354e863b2f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:38.638670 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-083819df-98fe-4900-846f-fa354e863b2f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 97825703-89d9-457a-b6c3-b694f8eee97c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:38.651723 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-083819df-98fe-4900-846f-fa354e863b2f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:38.652380 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-083819df-98fe-4900-846f-fa354e863b2f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:38.653997 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-083819df-98fe-4900-846f-fa354e863b2f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:38.665121 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-083819df-98fe-4900-846f-fa354e863b2f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:38.666057 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-083819df-98fe-4900-846f-fa354e863b2f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:38.666657 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-083819df-98fe-4900-846f-fa354e863b2f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:38.899735 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-083819df-98fe-4900-846f-fa354e863b2f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:38.908146 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-083819df-98fe-4900-846f-fa354e863b2f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c" status: 200 len: 1522 microversion: 2.1 time: 0.278641 Oct 26 13:20:38.925504 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2158/4300] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:38 2022] GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:39.342892 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5a9a142d-9492-4d5a-998f-f2ab5e770925 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:39.344236 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5a9a142d-9492-4d5a-998f-f2ab5e770925 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:39.353178 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5a9a142d-9492-4d5a-998f-f2ab5e770925 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:39.354074 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5a9a142d-9492-4d5a-998f-f2ab5e770925 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:39.354843 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5a9a142d-9492-4d5a-998f-f2ab5e770925 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:39.355670 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5a9a142d-9492-4d5a-998f-f2ab5e770925 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:39.356531 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5a9a142d-9492-4d5a-998f-f2ab5e770925 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:39.357867 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5a9a142d-9492-4d5a-998f-f2ab5e770925 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:39.450960 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5a9a142d-9492-4d5a-998f-f2ab5e770925 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:39.461550 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5a9a142d-9492-4d5a-998f-f2ab5e770925 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:39.463979 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5a9a142d-9492-4d5a-998f-f2ab5e770925 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:39.469605 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-36332c18-ecfa-4f0f-934a-248eaac2eb5a tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:39.470224 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-36332c18-ecfa-4f0f-934a-248eaac2eb5a tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] [instance: e83accea-4a1c-4e78-8cde-af4d398dc938] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:39.471075 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5a9a142d-9492-4d5a-998f-f2ab5e770925 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1539 microversion: 2.91 time: 0.132253 Oct 26 13:20:39.471832 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2143/4301] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:20:39 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1539 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:20:39.477171 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-36332c18-ecfa-4f0f-934a-248eaac2eb5a tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:39.482252 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-36332c18-ecfa-4f0f-934a-248eaac2eb5a tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:39.482944 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-36332c18-ecfa-4f0f-934a-248eaac2eb5a tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:39.485932 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-36332c18-ecfa-4f0f-934a-248eaac2eb5a tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:39.486644 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-36332c18-ecfa-4f0f-934a-248eaac2eb5a tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:39.494138 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-36332c18-ecfa-4f0f-934a-248eaac2eb5a tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:39.933639 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-da32388b-dbf9-476d-baa1-ba1b11834575 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:39.934643 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-da32388b-dbf9-476d-baa1-ba1b11834575 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 97825703-89d9-457a-b6c3-b694f8eee97c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:39.940747 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:20:39.941925 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:20:39.945382 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-da32388b-dbf9-476d-baa1-ba1b11834575 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:39.946475 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-da32388b-dbf9-476d-baa1-ba1b11834575 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:39.947156 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-da32388b-dbf9-476d-baa1-ba1b11834575 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:39.948142 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-da32388b-dbf9-476d-baa1-ba1b11834575 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:39.948933 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-da32388b-dbf9-476d-baa1-ba1b11834575 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:39.949704 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-da32388b-dbf9-476d-baa1-ba1b11834575 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:40.147517 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:20:40.165380 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-36332c18-ecfa-4f0f-934a-248eaac2eb5a tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2ce55e939e46cfb66f24b4ee82b7ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed18295b8b7e42d094c7a5b0f0ce2786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:40.178785 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-36332c18-ecfa-4f0f-934a-248eaac2eb5a tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] 10.222.0.40 "GET /compute/v2.1/servers/e83accea-4a1c-4e78-8cde-af4d398dc938" status: 200 len: 1324 microversion: 2.1 time: 0.712132 Oct 26 13:20:40.201686 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-da32388b-dbf9-476d-baa1-ba1b11834575 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:40.209998 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2159/4302] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:39 2022] GET /compute/v2.1/servers/e83accea-4a1c-4e78-8cde-af4d398dc938 => generated 1324 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:20:40.213220 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-da32388b-dbf9-476d-baa1-ba1b11834575 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c" status: 200 len: 1522 microversion: 2.1 time: 0.283986 Oct 26 13:20:40.213833 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2144/4303] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:39 2022] GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:20:40.502051 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ada50ec0-5377-4d09-a95f-a9991a35d480 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:40.503960 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ada50ec0-5377-4d09-a95f-a9991a35d480 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:40.517559 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ada50ec0-5377-4d09-a95f-a9991a35d480 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:40.519553 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ada50ec0-5377-4d09-a95f-a9991a35d480 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:40.520390 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ada50ec0-5377-4d09-a95f-a9991a35d480 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:40.521358 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ada50ec0-5377-4d09-a95f-a9991a35d480 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:40.521993 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ada50ec0-5377-4d09-a95f-a9991a35d480 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:40.522812 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ada50ec0-5377-4d09-a95f-a9991a35d480 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:40.560021 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:20:40.685138 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ada50ec0-5377-4d09-a95f-a9991a35d480 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:40.700832 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ada50ec0-5377-4d09-a95f-a9991a35d480 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:40.710758 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ada50ec0-5377-4d09-a95f-a9991a35d480 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:40.722448 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ada50ec0-5377-4d09-a95f-a9991a35d480 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1539 microversion: 2.91 time: 0.226032 Oct 26 13:20:40.723041 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2160/4304] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:20:40 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1539 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:20:41.203189 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9e77ed13-5c8b-490b-b39c-310df67c3d6c tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:41.205177 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9e77ed13-5c8b-490b-b39c-310df67c3d6c tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] [instance: e83accea-4a1c-4e78-8cde-af4d398dc938] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:41.218202 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9e77ed13-5c8b-490b-b39c-310df67c3d6c tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:41.226828 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9e77ed13-5c8b-490b-b39c-310df67c3d6c tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:41.227869 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9e77ed13-5c8b-490b-b39c-310df67c3d6c tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:41.229296 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9e77ed13-5c8b-490b-b39c-310df67c3d6c tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:41.230543 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9e77ed13-5c8b-490b-b39c-310df67c3d6c tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:41.232726 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9e77ed13-5c8b-490b-b39c-310df67c3d6c tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:41.239116 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fec8cdbe-6608-479d-81e7-0ff1e295d6a5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:41.240087 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fec8cdbe-6608-479d-81e7-0ff1e295d6a5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 97825703-89d9-457a-b6c3-b694f8eee97c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:41.260582 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fec8cdbe-6608-479d-81e7-0ff1e295d6a5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:41.261208 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fec8cdbe-6608-479d-81e7-0ff1e295d6a5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:41.261777 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fec8cdbe-6608-479d-81e7-0ff1e295d6a5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:41.262623 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fec8cdbe-6608-479d-81e7-0ff1e295d6a5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:41.263105 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fec8cdbe-6608-479d-81e7-0ff1e295d6a5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:41.263615 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fec8cdbe-6608-479d-81e7-0ff1e295d6a5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:41.553629 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9e77ed13-5c8b-490b-b39c-310df67c3d6c tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2ce55e939e46cfb66f24b4ee82b7ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed18295b8b7e42d094c7a5b0f0ce2786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:41.562112 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9e77ed13-5c8b-490b-b39c-310df67c3d6c tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] 10.222.0.40 "GET /compute/v2.1/servers/e83accea-4a1c-4e78-8cde-af4d398dc938" status: 200 len: 1324 microversion: 2.1 time: 0.362895 Oct 26 13:20:41.562904 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2145/4305] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:41 2022] GET /compute/v2.1/servers/e83accea-4a1c-4e78-8cde-af4d398dc938 => generated 1324 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:20:41.757007 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1f135355-51e4-41f7-ad69-923ca3c87607 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:41.757985 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1f135355-51e4-41f7-ad69-923ca3c87607 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:41.766735 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1f135355-51e4-41f7-ad69-923ca3c87607 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:41.767575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1f135355-51e4-41f7-ad69-923ca3c87607 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:41.768270 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1f135355-51e4-41f7-ad69-923ca3c87607 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:41.769169 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1f135355-51e4-41f7-ad69-923ca3c87607 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:41.769860 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1f135355-51e4-41f7-ad69-923ca3c87607 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:41.771093 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1f135355-51e4-41f7-ad69-923ca3c87607 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:41.820283 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fec8cdbe-6608-479d-81e7-0ff1e295d6a5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:41.828672 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fec8cdbe-6608-479d-81e7-0ff1e295d6a5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c" status: 200 len: 1522 microversion: 2.1 time: 0.594254 Oct 26 13:20:41.829968 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2161/4306] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:41 2022] GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c => generated 1522 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:41.877161 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1f135355-51e4-41f7-ad69-923ca3c87607 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:41.903098 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1f135355-51e4-41f7-ad69-923ca3c87607 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:41.905622 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1f135355-51e4-41f7-ad69-923ca3c87607 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:41.920528 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1f135355-51e4-41f7-ad69-923ca3c87607 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1539 microversion: 2.91 time: 0.168312 Oct 26 13:20:41.924819 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2146/4307] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:20:41 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1539 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:20:42.586275 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-dc09ac12-0996-41bc-97c3-509ffc52c52b tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:42.587091 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-dc09ac12-0996-41bc-97c3-509ffc52c52b tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] [instance: e83accea-4a1c-4e78-8cde-af4d398dc938] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:42.606502 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc09ac12-0996-41bc-97c3-509ffc52c52b tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:42.608317 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc09ac12-0996-41bc-97c3-509ffc52c52b tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:42.609667 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc09ac12-0996-41bc-97c3-509ffc52c52b tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:42.612516 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc09ac12-0996-41bc-97c3-509ffc52c52b tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:42.613186 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc09ac12-0996-41bc-97c3-509ffc52c52b tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:42.613855 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc09ac12-0996-41bc-97c3-509ffc52c52b tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:42.870348 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0a35184d-5f60-42ad-a1ca-e11da1ea70cc tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:42.879418 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0a35184d-5f60-42ad-a1ca-e11da1ea70cc tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 97825703-89d9-457a-b6c3-b694f8eee97c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:42.895576 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0a35184d-5f60-42ad-a1ca-e11da1ea70cc tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:42.896685 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0a35184d-5f60-42ad-a1ca-e11da1ea70cc tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:42.898658 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0a35184d-5f60-42ad-a1ca-e11da1ea70cc tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:42.899901 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0a35184d-5f60-42ad-a1ca-e11da1ea70cc tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:42.900588 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0a35184d-5f60-42ad-a1ca-e11da1ea70cc tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:42.901230 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0a35184d-5f60-42ad-a1ca-e11da1ea70cc tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:42.926980 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-dc09ac12-0996-41bc-97c3-509ffc52c52b tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2ce55e939e46cfb66f24b4ee82b7ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed18295b8b7e42d094c7a5b0f0ce2786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:42.935908 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-dc09ac12-0996-41bc-97c3-509ffc52c52b tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] 10.222.0.40 "GET /compute/v2.1/servers/e83accea-4a1c-4e78-8cde-af4d398dc938" status: 200 len: 1324 microversion: 2.1 time: 0.354316 Oct 26 13:20:42.936652 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2162/4308] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:42 2022] GET /compute/v2.1/servers/e83accea-4a1c-4e78-8cde-af4d398dc938 => generated 1324 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:42.963124 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3f3c2611-ad96-4ab8-bd80-01c569700d6a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:42.967025 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3f3c2611-ad96-4ab8-bd80-01c569700d6a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:42.981973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3f3c2611-ad96-4ab8-bd80-01c569700d6a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:42.983537 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3f3c2611-ad96-4ab8-bd80-01c569700d6a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:42.983985 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3f3c2611-ad96-4ab8-bd80-01c569700d6a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:42.984991 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3f3c2611-ad96-4ab8-bd80-01c569700d6a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:42.985702 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3f3c2611-ad96-4ab8-bd80-01c569700d6a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:42.986311 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3f3c2611-ad96-4ab8-bd80-01c569700d6a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:43.161865 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3f3c2611-ad96-4ab8-bd80-01c569700d6a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:43.172114 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3f3c2611-ad96-4ab8-bd80-01c569700d6a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:43.187655 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3f3c2611-ad96-4ab8-bd80-01c569700d6a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:43.199605 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3f3c2611-ad96-4ab8-bd80-01c569700d6a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1539 microversion: 2.91 time: 0.247250 Oct 26 13:20:43.226543 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2163/4309] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:20:42 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1539 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:20:43.581353 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-2d5e636f-867b-4251-865a-a351c3ae4cb6 req-cdc34aaf-2a55-4832-8e48-ee4da0efb772 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e83accea-4a1c-4e78-8cde-af4d398dc938", "name": "network-vif-plugged", "status": "completed", "tag": "bff79e7d-fbe1-4be0-8afd-170dcef67d0c"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:20:43.606316 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-2d5e636f-867b-4251-865a-a351c3ae4cb6 req-cdc34aaf-2a55-4832-8e48-ee4da0efb772 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:43.608457 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-2d5e636f-867b-4251-865a-a351c3ae4cb6 req-cdc34aaf-2a55-4832-8e48-ee4da0efb772 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:43.610158 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-2d5e636f-867b-4251-865a-a351c3ae4cb6 req-cdc34aaf-2a55-4832-8e48-ee4da0efb772 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:43.639144 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-2d5e636f-867b-4251-865a-a351c3ae4cb6 req-cdc34aaf-2a55-4832-8e48-ee4da0efb772 service nova] Creating event network-vif-plugged:bff79e7d-fbe1-4be0-8afd-170dcef67d0c for instance e83accea-4a1c-4e78-8cde-af4d398dc938 on n-h1-862686-1 Oct 26 13:20:43.646388 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-2d5e636f-867b-4251-865a-a351c3ae4cb6 req-cdc34aaf-2a55-4832-8e48-ee4da0efb772 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077025 Oct 26 13:20:43.647489 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2164/4310] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:20:43.714444 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0a35184d-5f60-42ad-a1ca-e11da1ea70cc tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:43.727929 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0a35184d-5f60-42ad-a1ca-e11da1ea70cc tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c" status: 200 len: 1522 microversion: 2.1 time: 0.873408 Oct 26 13:20:43.728850 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2147/4311] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:42 2022] GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c => generated 1522 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:43.964784 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e802ffe7-aec3-46d1-9785-ba7706c28306 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:43.965598 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e802ffe7-aec3-46d1-9785-ba7706c28306 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] [instance: e83accea-4a1c-4e78-8cde-af4d398dc938] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:43.976655 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e802ffe7-aec3-46d1-9785-ba7706c28306 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:43.979608 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e802ffe7-aec3-46d1-9785-ba7706c28306 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:43.981555 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e802ffe7-aec3-46d1-9785-ba7706c28306 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:43.982812 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e802ffe7-aec3-46d1-9785-ba7706c28306 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:43.983462 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e802ffe7-aec3-46d1-9785-ba7706c28306 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:43.984240 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e802ffe7-aec3-46d1-9785-ba7706c28306 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:44.236509 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4dfef25e-7752-4325-bc9f-1deb89b29354 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:44.237242 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4dfef25e-7752-4325-bc9f-1deb89b29354 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:44.254521 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:20:44.257870 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4dfef25e-7752-4325-bc9f-1deb89b29354 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:44.258419 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4dfef25e-7752-4325-bc9f-1deb89b29354 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:44.258955 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4dfef25e-7752-4325-bc9f-1deb89b29354 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:44.260101 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4dfef25e-7752-4325-bc9f-1deb89b29354 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:44.261265 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4dfef25e-7752-4325-bc9f-1deb89b29354 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:44.261788 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4dfef25e-7752-4325-bc9f-1deb89b29354 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:44.349081 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e802ffe7-aec3-46d1-9785-ba7706c28306 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2ce55e939e46cfb66f24b4ee82b7ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed18295b8b7e42d094c7a5b0f0ce2786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:44.364011 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e802ffe7-aec3-46d1-9785-ba7706c28306 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] 10.222.0.40 "GET /compute/v2.1/servers/e83accea-4a1c-4e78-8cde-af4d398dc938" status: 200 len: 1324 microversion: 2.1 time: 0.404291 Oct 26 13:20:44.365445 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2165/4312] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:43 2022] GET /compute/v2.1/servers/e83accea-4a1c-4e78-8cde-af4d398dc938 => generated 1324 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:44.431397 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4dfef25e-7752-4325-bc9f-1deb89b29354 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:44.443522 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4dfef25e-7752-4325-bc9f-1deb89b29354 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:44.445797 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4dfef25e-7752-4325-bc9f-1deb89b29354 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:44.453631 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4dfef25e-7752-4325-bc9f-1deb89b29354 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1539 microversion: 2.91 time: 0.223283 Oct 26 13:20:44.454571 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2148/4313] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:20:44 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1539 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:20:44.758546 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2d9cece2-6546-45d8-b3ec-cd1184338853 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:44.760475 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2d9cece2-6546-45d8-b3ec-cd1184338853 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 97825703-89d9-457a-b6c3-b694f8eee97c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:44.789612 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d9cece2-6546-45d8-b3ec-cd1184338853 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:44.792029 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d9cece2-6546-45d8-b3ec-cd1184338853 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:44.795973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d9cece2-6546-45d8-b3ec-cd1184338853 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:44.797338 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d9cece2-6546-45d8-b3ec-cd1184338853 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:44.802367 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d9cece2-6546-45d8-b3ec-cd1184338853 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:44.805509 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d9cece2-6546-45d8-b3ec-cd1184338853 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:45.221930 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2d9cece2-6546-45d8-b3ec-cd1184338853 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:45.233063 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2d9cece2-6546-45d8-b3ec-cd1184338853 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c" status: 200 len: 1522 microversion: 2.1 time: 0.480419 Oct 26 13:20:45.236035 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2166/4314] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:44 2022] GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c => generated 1522 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:45.392088 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-36e32f1c-3951-443e-83ea-25d4321d15ee tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:45.392879 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-36e32f1c-3951-443e-83ea-25d4321d15ee tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] [instance: e83accea-4a1c-4e78-8cde-af4d398dc938] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:45.403536 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-36e32f1c-3951-443e-83ea-25d4321d15ee tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:45.408083 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-36e32f1c-3951-443e-83ea-25d4321d15ee tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:45.409059 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-36e32f1c-3951-443e-83ea-25d4321d15ee tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:45.410249 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-36e32f1c-3951-443e-83ea-25d4321d15ee tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:45.412616 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-36e32f1c-3951-443e-83ea-25d4321d15ee tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:45.415633 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-36e32f1c-3951-443e-83ea-25d4321d15ee tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:45.488348 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b2b83987-09ac-4e69-b827-d65d90121948 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:45.489595 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b2b83987-09ac-4e69-b827-d65d90121948 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:45.500328 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b2b83987-09ac-4e69-b827-d65d90121948 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:45.502303 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b2b83987-09ac-4e69-b827-d65d90121948 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:45.504145 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b2b83987-09ac-4e69-b827-d65d90121948 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:45.505347 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b2b83987-09ac-4e69-b827-d65d90121948 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:45.505863 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b2b83987-09ac-4e69-b827-d65d90121948 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:45.506303 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b2b83987-09ac-4e69-b827-d65d90121948 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:45.636285 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-36e32f1c-3951-443e-83ea-25d4321d15ee tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2ce55e939e46cfb66f24b4ee82b7ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed18295b8b7e42d094c7a5b0f0ce2786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:45.644035 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b2b83987-09ac-4e69-b827-d65d90121948 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:45.650344 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-36e32f1c-3951-443e-83ea-25d4321d15ee tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] 10.222.0.40 "GET /compute/v2.1/servers/e83accea-4a1c-4e78-8cde-af4d398dc938" status: 200 len: 1521 microversion: 2.1 time: 0.262871 Oct 26 13:20:45.651324 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2149/4315] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:45 2022] GET /compute/v2.1/servers/e83accea-4a1c-4e78-8cde-af4d398dc938 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:45.675179 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b2b83987-09ac-4e69-b827-d65d90121948 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:45.677732 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b2b83987-09ac-4e69-b827-d65d90121948 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:45.680368 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0bfbb623-6aad-4ec3-b046-5102ba214234 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:45.681035 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0bfbb623-6aad-4ec3-b046-5102ba214234 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] [instance: e83accea-4a1c-4e78-8cde-af4d398dc938] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:45.689140 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0bfbb623-6aad-4ec3-b046-5102ba214234 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:45.689804 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0bfbb623-6aad-4ec3-b046-5102ba214234 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:45.690363 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0bfbb623-6aad-4ec3-b046-5102ba214234 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:45.691319 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0bfbb623-6aad-4ec3-b046-5102ba214234 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:45.692133 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0bfbb623-6aad-4ec3-b046-5102ba214234 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:45.693974 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0bfbb623-6aad-4ec3-b046-5102ba214234 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:45.695107 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b2b83987-09ac-4e69-b827-d65d90121948 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1539 microversion: 2.91 time: 0.212132 Oct 26 13:20:45.695708 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2167/4316] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:20:45 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1539 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:20:45.737304 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:20:45.756119 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-0bfbb623-6aad-4ec3-b046-5102ba214234 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] HTTP exception thrown: Action 999 not found Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0bfbb623-6aad-4ec3-b046-5102ba214234 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Request method failure captured: Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/e83accea-4a1c-4e78-8cde-af4d398dc938/os-instance-actions/999 HTTP/1.1 Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTQckgl6U8tWiFa6kHLTqXJZa-WFkOFPvM42ze_I8g0obkvFqbNM9lkU1OwxM4wlfasHg2k5Y3wTyvm2PmoX1FYb5_MrnXYU5LmXuaL4gg-UmfTrBh4dBvf7dtL8onz6jaF09qi44UTtAKVjZUYkQp2TCtdAWC7yNSXN6BC3qTWJE8w Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: ed18295b8b7e42d094c7a5b0f0ce2786 Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-905546589 Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ed18295b8b7e42d094c7a5b0f0ce2786"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ed18295b8b7e42d094c7a5b0f0ce2786"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ed18295b8b7e42d094c7a5b0f0ce2786"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ed18295b8b7e42d094c7a5b0f0ce2786"}]}] Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-905546589 Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: ed18295b8b7e42d094c7a5b0f0ce2786 Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-905546589 Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-InstanceActionsNegativeTestJSON-905546589-project Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: fc2ce55e939e46cfb66f24b4ee82b7ae Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-905546589-project Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: exception: Action 999 not found Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'server_id': 'e83accea-4a1c-4e78-8cde-af4d398dc938', 'id': '999'} Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 26 13:20:45.768222 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:20:45.774725 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0bfbb623-6aad-4ec3-b046-5102ba214234 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Returning 404 to user: Action 999 not found {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:20:45.775614 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0bfbb623-6aad-4ec3-b046-5102ba214234 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] 10.222.0.40 "GET /compute/v2.1/servers/e83accea-4a1c-4e78-8cde-af4d398dc938/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.100810 Oct 26 13:20:45.776590 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2150/4317] 10.222.0.40 () {58 vars in 1308 bytes} [Wed Oct 26 13:20:45 2022] GET /compute/v2.1/servers/e83accea-4a1c-4e78-8cde-af4d398dc938/os-instance-actions/999 => generated 66 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 26 13:20:45.788079 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-612570b2-fedd-4f0c-b55f-c9194906113f tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Calling method '.version_select at 0x7f67320a1d30>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:45.788617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-612570b2-fedd-4f0c-b55f-c9194906113f tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] [instance: 9e05e8a9-1969-4210-a3df-7695b402d02c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:45.795002 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-612570b2-fedd-4f0c-b55f-c9194906113f tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] HTTP exception thrown: Instance 9e05e8a9-1969-4210-a3df-7695b402d02c could not be found. Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-612570b2-fedd-4f0c-b55f-c9194906113f tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Request method failure captured: Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/9e05e8a9-1969-4210-a3df-7695b402d02c/os-instance-actions HTTP/1.1 Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTQckgl6U8tWiFa6kHLTqXJZa-WFkOFPvM42ze_I8g0obkvFqbNM9lkU1OwxM4wlfasHg2k5Y3wTyvm2PmoX1FYb5_MrnXYU5LmXuaL4gg-UmfTrBh4dBvf7dtL8onz6jaF09qi44UTtAKVjZUYkQp2TCtdAWC7yNSXN6BC3qTWJE8w Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: ed18295b8b7e42d094c7a5b0f0ce2786 Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-905546589 Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ed18295b8b7e42d094c7a5b0f0ce2786"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ed18295b8b7e42d094c7a5b0f0ce2786"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ed18295b8b7e42d094c7a5b0f0ce2786"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ed18295b8b7e42d094c7a5b0f0ce2786"}]}] Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-905546589 Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: ed18295b8b7e42d094c7a5b0f0ce2786 Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-905546589 Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-InstanceActionsNegativeTestJSON-905546589-project Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: fc2ce55e939e46cfb66f24b4ee82b7ae Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-905546589-project Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 9e05e8a9-1969-4210-a3df-7695b402d02c could not be found. Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'server_id': '9e05e8a9-1969-4210-a3df-7695b402d02c'} Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e05e8a9-1969-4210-a3df-7695b402d02c could not be found. Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:20:45.796963 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:20:45.800993 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e05e8a9-1969-4210-a3df-7695b402d02c could not be found. Oct 26 13:20:45.800993 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:20:45.800993 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:20:45.800993 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:20:45.800993 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:20:45.800993 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:20:45.800993 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:20:45.800993 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:20:45.800993 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:20:45.800993 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e05e8a9-1969-4210-a3df-7695b402d02c could not be found. Oct 26 13:20:45.800993 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:20:45.800993 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-612570b2-fedd-4f0c-b55f-c9194906113f tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Returning 404 to user: Instance 9e05e8a9-1969-4210-a3df-7695b402d02c could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:20:45.800993 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-612570b2-fedd-4f0c-b55f-c9194906113f tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] 10.222.0.40 "GET /compute/v2.1/servers/9e05e8a9-1969-4210-a3df-7695b402d02c/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.015141 Oct 26 13:20:45.809608 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a781bfd0-2de1-4c1c-aef5-c0063ff67e67 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:45.813837 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a781bfd0-2de1-4c1c-aef5-c0063ff67e67 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] [instance: e83accea-4a1c-4e78-8cde-af4d398dc938] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:45.825421 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2168/4318] 10.222.0.40 () {58 vars in 1296 bytes} [Wed Oct 26 13:20:45 2022] GET /compute/v2.1/servers/9e05e8a9-1969-4210-a3df-7695b402d02c/os-instance-actions => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:20:45.835479 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a781bfd0-2de1-4c1c-aef5-c0063ff67e67 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:45.835982 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a781bfd0-2de1-4c1c-aef5-c0063ff67e67 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:45.836427 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a781bfd0-2de1-4c1c-aef5-c0063ff67e67 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:45.837141 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a781bfd0-2de1-4c1c-aef5-c0063ff67e67 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:45.837654 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a781bfd0-2de1-4c1c-aef5-c0063ff67e67 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:45.838066 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a781bfd0-2de1-4c1c-aef5-c0063ff67e67 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:45.900838 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a781bfd0-2de1-4c1c-aef5-c0063ff67e67 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] [instance: e83accea-4a1c-4e78-8cde-af4d398dc938] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:20:46.037854 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a781bfd0-2de1-4c1c-aef5-c0063ff67e67 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e83accea-4a1c-4e78-8cde-af4d398dc938" status: 204 len: 0 microversion: 2.1 time: 0.231426 Oct 26 13:20:46.048515 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e47e1cc4-e3f1-479b-822f-e884c46034c3 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:46.049360 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e47e1cc4-e3f1-479b-822f-e884c46034c3 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] [instance: e83accea-4a1c-4e78-8cde-af4d398dc938] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:46.053638 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2151/4319] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:20:45 2022] DELETE /compute/v2.1/servers/e83accea-4a1c-4e78-8cde-af4d398dc938 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:20:46.064044 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:20:46.065941 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e47e1cc4-e3f1-479b-822f-e884c46034c3 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:46.070213 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e47e1cc4-e3f1-479b-822f-e884c46034c3 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:46.071151 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e47e1cc4-e3f1-479b-822f-e884c46034c3 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:46.075456 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e47e1cc4-e3f1-479b-822f-e884c46034c3 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:46.076230 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e47e1cc4-e3f1-479b-822f-e884c46034c3 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:46.076878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e47e1cc4-e3f1-479b-822f-e884c46034c3 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:46.262126 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e789e5cc-f9ba-49cc-9ba1-fc4c5d7e5e73 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:46.263263 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e789e5cc-f9ba-49cc-9ba1-fc4c5d7e5e73 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 97825703-89d9-457a-b6c3-b694f8eee97c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:46.270276 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e789e5cc-f9ba-49cc-9ba1-fc4c5d7e5e73 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:46.272100 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e789e5cc-f9ba-49cc-9ba1-fc4c5d7e5e73 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:46.272641 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e789e5cc-f9ba-49cc-9ba1-fc4c5d7e5e73 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:46.273927 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e789e5cc-f9ba-49cc-9ba1-fc4c5d7e5e73 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:46.274392 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e789e5cc-f9ba-49cc-9ba1-fc4c5d7e5e73 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:46.274817 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e789e5cc-f9ba-49cc-9ba1-fc4c5d7e5e73 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:46.517098 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e47e1cc4-e3f1-479b-822f-e884c46034c3 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2ce55e939e46cfb66f24b4ee82b7ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed18295b8b7e42d094c7a5b0f0ce2786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:46.527556 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e789e5cc-f9ba-49cc-9ba1-fc4c5d7e5e73 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:46.532394 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e47e1cc4-e3f1-479b-822f-e884c46034c3 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] 10.222.0.40 "GET /compute/v2.1/servers/e83accea-4a1c-4e78-8cde-af4d398dc938" status: 200 len: 1527 microversion: 2.1 time: 0.488613 Oct 26 13:20:46.540258 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e789e5cc-f9ba-49cc-9ba1-fc4c5d7e5e73 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c" status: 200 len: 1522 microversion: 2.1 time: 0.284012 Oct 26 13:20:46.540860 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2152/4320] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:46 2022] GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:20:46.546894 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2169/4321] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:46 2022] GET /compute/v2.1/servers/e83accea-4a1c-4e78-8cde-af4d398dc938 => generated 1527 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:46.732130 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-178d1d41-bd71-41bb-bafd-8f0de163505d tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:46.733670 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-178d1d41-bd71-41bb-bafd-8f0de163505d tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:46.747104 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-178d1d41-bd71-41bb-bafd-8f0de163505d tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:46.747610 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-178d1d41-bd71-41bb-bafd-8f0de163505d tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:46.748069 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-178d1d41-bd71-41bb-bafd-8f0de163505d tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:46.748785 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-178d1d41-bd71-41bb-bafd-8f0de163505d tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:46.749343 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-178d1d41-bd71-41bb-bafd-8f0de163505d tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:46.754786 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-178d1d41-bd71-41bb-bafd-8f0de163505d tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:46.848015 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-178d1d41-bd71-41bb-bafd-8f0de163505d tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:46.866101 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-178d1d41-bd71-41bb-bafd-8f0de163505d tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:46.867639 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-178d1d41-bd71-41bb-bafd-8f0de163505d tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:46.881798 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-178d1d41-bd71-41bb-bafd-8f0de163505d tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1539 microversion: 2.91 time: 0.150915 Oct 26 13:20:46.899632 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2153/4322] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:20:46 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1539 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:20:47.186801 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-eb069bf0-e56e-4293-9b3d-a7c897032c5c tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:47.187548 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-eb069bf0-e56e-4293-9b3d-a7c897032c5c tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 42f50b1b-9531-43dd-bb5f-cbca3b7d306f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:47.195575 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb069bf0-e56e-4293-9b3d-a7c897032c5c tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:47.196074 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb069bf0-e56e-4293-9b3d-a7c897032c5c tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:47.196515 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb069bf0-e56e-4293-9b3d-a7c897032c5c tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:47.197221 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb069bf0-e56e-4293-9b3d-a7c897032c5c tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:47.197714 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb069bf0-e56e-4293-9b3d-a7c897032c5c tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:47.198141 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb069bf0-e56e-4293-9b3d-a7c897032c5c tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:47.293197 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-eb069bf0-e56e-4293-9b3d-a7c897032c5c tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lazy-loading 'services' on Instance uuid 42f50b1b-9531-43dd-bb5f-cbca3b7d306f {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:20:47.385624 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-eb069bf0-e56e-4293-9b3d-a7c897032c5c tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "DELETE /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f/os-volume_attachments/79d03268-b36b-487a-857e-4d0cd110c22e" status: 202 len: 0 microversion: 2.1 time: 0.202579 Oct 26 13:20:47.386245 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2170/4323] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Oct 26 13:20:47 2022] DELETE /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f/os-volume_attachments/79d03268-b36b-487a-857e-4d0cd110c22e => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:20:47.397828 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-182bb027-8d2d-4a03-ba32-1b7684a6f57a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:47.401016 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-182bb027-8d2d-4a03-ba32-1b7684a6f57a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 42f50b1b-9531-43dd-bb5f-cbca3b7d306f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:47.412730 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-182bb027-8d2d-4a03-ba32-1b7684a6f57a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:47.413745 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-182bb027-8d2d-4a03-ba32-1b7684a6f57a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:47.414254 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-182bb027-8d2d-4a03-ba32-1b7684a6f57a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:47.415240 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-182bb027-8d2d-4a03-ba32-1b7684a6f57a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:47.415739 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-182bb027-8d2d-4a03-ba32-1b7684a6f57a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:47.416405 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-182bb027-8d2d-4a03-ba32-1b7684a6f57a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:47.470065 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-182bb027-8d2d-4a03-ba32-1b7684a6f57a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078930 Oct 26 13:20:47.470793 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2154/4324] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:20:47 2022] GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:20:47.561017 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7f39136a-6f30-4f8b-a86f-27b82133e0f0 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:47.562418 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7f39136a-6f30-4f8b-a86f-27b82133e0f0 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] [instance: e83accea-4a1c-4e78-8cde-af4d398dc938] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:47.563341 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9ed9e937-456b-4f21-9ed1-fbe09d59326b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:47.563963 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9ed9e937-456b-4f21-9ed1-fbe09d59326b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 97825703-89d9-457a-b6c3-b694f8eee97c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:47.575830 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9ed9e937-456b-4f21-9ed1-fbe09d59326b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:47.576335 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9ed9e937-456b-4f21-9ed1-fbe09d59326b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:47.576782 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9ed9e937-456b-4f21-9ed1-fbe09d59326b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:47.577518 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9ed9e937-456b-4f21-9ed1-fbe09d59326b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:47.580590 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f39136a-6f30-4f8b-a86f-27b82133e0f0 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:47.581322 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f39136a-6f30-4f8b-a86f-27b82133e0f0 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:47.582064 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f39136a-6f30-4f8b-a86f-27b82133e0f0 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:47.583846 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f39136a-6f30-4f8b-a86f-27b82133e0f0 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:47.584623 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f39136a-6f30-4f8b-a86f-27b82133e0f0 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:47.585277 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f39136a-6f30-4f8b-a86f-27b82133e0f0 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:47.586365 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9ed9e937-456b-4f21-9ed1-fbe09d59326b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:47.587078 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9ed9e937-456b-4f21-9ed1-fbe09d59326b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:47.801117 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9ed9e937-456b-4f21-9ed1-fbe09d59326b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:47.810692 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9ed9e937-456b-4f21-9ed1-fbe09d59326b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c" status: 200 len: 1522 microversion: 2.1 time: 0.251157 Oct 26 13:20:47.811589 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2155/4325] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:47 2022] GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:20:47.913963 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-028d47b5-8e33-404f-a1de-0d41ff220d1f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:47.914579 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-028d47b5-8e33-404f-a1de-0d41ff220d1f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:47.917741 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7f39136a-6f30-4f8b-a86f-27b82133e0f0 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2ce55e939e46cfb66f24b4ee82b7ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed18295b8b7e42d094c7a5b0f0ce2786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:47.925662 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7f39136a-6f30-4f8b-a86f-27b82133e0f0 tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] 10.222.0.40 "GET /compute/v2.1/servers/e83accea-4a1c-4e78-8cde-af4d398dc938" status: 200 len: 1527 microversion: 2.1 time: 0.371163 Oct 26 13:20:47.926264 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2171/4326] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:47 2022] GET /compute/v2.1/servers/e83accea-4a1c-4e78-8cde-af4d398dc938 => generated 1527 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:47.928295 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-028d47b5-8e33-404f-a1de-0d41ff220d1f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:47.928964 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-028d47b5-8e33-404f-a1de-0d41ff220d1f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:47.929608 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-028d47b5-8e33-404f-a1de-0d41ff220d1f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:47.930490 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-028d47b5-8e33-404f-a1de-0d41ff220d1f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:47.931128 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-028d47b5-8e33-404f-a1de-0d41ff220d1f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:47.931837 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-028d47b5-8e33-404f-a1de-0d41ff220d1f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:48.049923 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-028d47b5-8e33-404f-a1de-0d41ff220d1f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:48.060228 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-028d47b5-8e33-404f-a1de-0d41ff220d1f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:48.064285 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-028d47b5-8e33-404f-a1de-0d41ff220d1f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:48.072907 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-028d47b5-8e33-404f-a1de-0d41ff220d1f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1539 microversion: 2.91 time: 0.163353 Oct 26 13:20:48.073812 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2156/4327] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:20:47 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1539 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:20:48.483407 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-659e779c-a41a-46ec-a642-5d165b16496a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:48.485831 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-659e779c-a41a-46ec-a642-5d165b16496a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 42f50b1b-9531-43dd-bb5f-cbca3b7d306f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:48.502529 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-659e779c-a41a-46ec-a642-5d165b16496a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:48.503038 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-659e779c-a41a-46ec-a642-5d165b16496a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:48.503625 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-659e779c-a41a-46ec-a642-5d165b16496a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:48.504353 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-659e779c-a41a-46ec-a642-5d165b16496a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:48.505667 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-659e779c-a41a-46ec-a642-5d165b16496a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:48.506115 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-659e779c-a41a-46ec-a642-5d165b16496a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:48.559949 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-3fb1b91e-40dd-4088-95e9-693ad5f895b4 req-cb9a24d0-cd04-4d46-bf17-0c91922428af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e83accea-4a1c-4e78-8cde-af4d398dc938", "name": "network-vif-deleted", "tag": "bff79e7d-fbe1-4be0-8afd-170dcef67d0c"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:20:48.576155 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-659e779c-a41a-46ec-a642-5d165b16496a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096125 Oct 26 13:20:48.584897 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2172/4328] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:20:48 2022] GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:20:48.609317 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-3fb1b91e-40dd-4088-95e9-693ad5f895b4 req-cb9a24d0-cd04-4d46-bf17-0c91922428af service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:48.610891 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-3fb1b91e-40dd-4088-95e9-693ad5f895b4 req-cb9a24d0-cd04-4d46-bf17-0c91922428af service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:48.611349 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-3fb1b91e-40dd-4088-95e9-693ad5f895b4 req-cb9a24d0-cd04-4d46-bf17-0c91922428af service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:48.636885 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-3fb1b91e-40dd-4088-95e9-693ad5f895b4 req-cb9a24d0-cd04-4d46-bf17-0c91922428af service nova] Creating event network-vif-deleted:bff79e7d-fbe1-4be0-8afd-170dcef67d0c for instance e83accea-4a1c-4e78-8cde-af4d398dc938 on n-h1-862686-1 Oct 26 13:20:48.658059 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-3fb1b91e-40dd-4088-95e9-693ad5f895b4 req-cb9a24d0-cd04-4d46-bf17-0c91922428af service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103802 Oct 26 13:20:48.665224 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2157/4329] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:20:48.836068 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1a24788e-f2cc-4255-a337-e98379a1f537 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:48.837660 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1a24788e-f2cc-4255-a337-e98379a1f537 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 97825703-89d9-457a-b6c3-b694f8eee97c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:48.853435 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a24788e-f2cc-4255-a337-e98379a1f537 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:48.858440 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a24788e-f2cc-4255-a337-e98379a1f537 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:48.861719 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a24788e-f2cc-4255-a337-e98379a1f537 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:48.863666 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a24788e-f2cc-4255-a337-e98379a1f537 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:48.866322 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a24788e-f2cc-4255-a337-e98379a1f537 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:48.866833 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a24788e-f2cc-4255-a337-e98379a1f537 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:48.955539 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-afa18615-21d1-4a0e-8d1a-2bd9b35771fd tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:48.957671 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-afa18615-21d1-4a0e-8d1a-2bd9b35771fd tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] [instance: e83accea-4a1c-4e78-8cde-af4d398dc938] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:48.985219 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-afa18615-21d1-4a0e-8d1a-2bd9b35771fd tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:48.992757 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-afa18615-21d1-4a0e-8d1a-2bd9b35771fd tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:48.993283 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-afa18615-21d1-4a0e-8d1a-2bd9b35771fd tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:48.994074 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-afa18615-21d1-4a0e-8d1a-2bd9b35771fd tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:48.996331 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-afa18615-21d1-4a0e-8d1a-2bd9b35771fd tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:48.996775 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-afa18615-21d1-4a0e-8d1a-2bd9b35771fd tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:49.080821 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-afa18615-21d1-4a0e-8d1a-2bd9b35771fd tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:49.085157 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-afa18615-21d1-4a0e-8d1a-2bd9b35771fd tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:49.086093 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-afa18615-21d1-4a0e-8d1a-2bd9b35771fd tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:49.087331 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-afa18615-21d1-4a0e-8d1a-2bd9b35771fd tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lazy-loading 'fault' on Instance uuid e83accea-4a1c-4e78-8cde-af4d398dc938 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:20:49.121865 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1a24788e-f2cc-4255-a337-e98379a1f537 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:49.132626 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1a24788e-f2cc-4255-a337-e98379a1f537 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c" status: 200 len: 1522 microversion: 2.1 time: 0.301000 Oct 26 13:20:49.146626 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2173/4330] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:48 2022] GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:49.151840 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-444d0d81-23d1-436b-a29b-57d3d201da06 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:49.152652 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-444d0d81-23d1-436b-a29b-57d3d201da06 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:49.163864 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-444d0d81-23d1-436b-a29b-57d3d201da06 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:49.166826 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-444d0d81-23d1-436b-a29b-57d3d201da06 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:49.167470 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-444d0d81-23d1-436b-a29b-57d3d201da06 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:49.169112 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-444d0d81-23d1-436b-a29b-57d3d201da06 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:49.169850 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-444d0d81-23d1-436b-a29b-57d3d201da06 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:49.170294 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-444d0d81-23d1-436b-a29b-57d3d201da06 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:49.281737 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-444d0d81-23d1-436b-a29b-57d3d201da06 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:49.289001 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-afa18615-21d1-4a0e-8d1a-2bd9b35771fd tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2ce55e939e46cfb66f24b4ee82b7ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed18295b8b7e42d094c7a5b0f0ce2786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:49.291026 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-444d0d81-23d1-436b-a29b-57d3d201da06 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:49.293250 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-444d0d81-23d1-436b-a29b-57d3d201da06 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:49.299797 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-444d0d81-23d1-436b-a29b-57d3d201da06 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1539 microversion: 2.91 time: 0.163815 Oct 26 13:20:49.300965 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2174/4331] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:20:49 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1539 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:20:49.322232 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-afa18615-21d1-4a0e-8d1a-2bd9b35771fd tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] 10.222.0.40 "GET /compute/v2.1/servers/e83accea-4a1c-4e78-8cde-af4d398dc938" status: 200 len: 1314 microversion: 2.1 time: 0.371715 Oct 26 13:20:49.323773 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2158/4332] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:48 2022] GET /compute/v2.1/servers/e83accea-4a1c-4e78-8cde-af4d398dc938 => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:20:49.593341 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d8789deb-9486-40ca-a63c-406ca1daaa03 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:49.595988 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d8789deb-9486-40ca-a63c-406ca1daaa03 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 42f50b1b-9531-43dd-bb5f-cbca3b7d306f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:49.610832 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8789deb-9486-40ca-a63c-406ca1daaa03 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:49.612312 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8789deb-9486-40ca-a63c-406ca1daaa03 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:49.613530 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8789deb-9486-40ca-a63c-406ca1daaa03 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:49.615943 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8789deb-9486-40ca-a63c-406ca1daaa03 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:49.616644 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8789deb-9486-40ca-a63c-406ca1daaa03 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:49.617940 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8789deb-9486-40ca-a63c-406ca1daaa03 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:49.663855 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d8789deb-9486-40ca-a63c-406ca1daaa03 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074854 Oct 26 13:20:49.665585 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2175/4333] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:20:49 2022] GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:20:50.160848 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-03a572ae-c617-4ea9-aab7-5b8f7b659201 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:50.161667 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-03a572ae-c617-4ea9-aab7-5b8f7b659201 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 97825703-89d9-457a-b6c3-b694f8eee97c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:50.177342 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03a572ae-c617-4ea9-aab7-5b8f7b659201 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:50.177342 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03a572ae-c617-4ea9-aab7-5b8f7b659201 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:50.177342 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03a572ae-c617-4ea9-aab7-5b8f7b659201 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:50.177342 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03a572ae-c617-4ea9-aab7-5b8f7b659201 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:50.177342 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03a572ae-c617-4ea9-aab7-5b8f7b659201 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:50.177342 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03a572ae-c617-4ea9-aab7-5b8f7b659201 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:50.380827 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-03a572ae-c617-4ea9-aab7-5b8f7b659201 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:50.391267 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-03a572ae-c617-4ea9-aab7-5b8f7b659201 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c" status: 200 len: 1522 microversion: 2.1 time: 0.235801 Oct 26 13:20:50.394594 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2159/4334] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:50 2022] GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:50.409934 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6abb501f-46a2-4e93-a3dc-db4748f6174e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:50.411957 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6abb501f-46a2-4e93-a3dc-db4748f6174e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:50.422043 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6abb501f-46a2-4e93-a3dc-db4748f6174e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:50.422540 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6abb501f-46a2-4e93-a3dc-db4748f6174e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:50.428691 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6abb501f-46a2-4e93-a3dc-db4748f6174e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:50.429719 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6abb501f-46a2-4e93-a3dc-db4748f6174e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:50.430370 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6abb501f-46a2-4e93-a3dc-db4748f6174e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:50.430992 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6abb501f-46a2-4e93-a3dc-db4748f6174e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:50.524467 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6abb501f-46a2-4e93-a3dc-db4748f6174e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:50.534102 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6abb501f-46a2-4e93-a3dc-db4748f6174e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:50.535689 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6abb501f-46a2-4e93-a3dc-db4748f6174e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:50.541627 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6abb501f-46a2-4e93-a3dc-db4748f6174e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1539 microversion: 2.91 time: 0.145531 Oct 26 13:20:50.566716 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2160/4335] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:20:50 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1539 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:20:50.573870 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-54ab45ec-187e-470b-9d59-d442c0c80acd tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:50.574559 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-54ab45ec-187e-470b-9d59-d442c0c80acd tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] [instance: e83accea-4a1c-4e78-8cde-af4d398dc938] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:50.581574 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54ab45ec-187e-470b-9d59-d442c0c80acd tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:50.582119 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54ab45ec-187e-470b-9d59-d442c0c80acd tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:50.582919 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54ab45ec-187e-470b-9d59-d442c0c80acd tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:50.583970 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54ab45ec-187e-470b-9d59-d442c0c80acd tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:50.584642 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54ab45ec-187e-470b-9d59-d442c0c80acd tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:50.585539 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54ab45ec-187e-470b-9d59-d442c0c80acd tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:50.603591 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-54ab45ec-187e-470b-9d59-d442c0c80acd tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] HTTP exception thrown: Instance e83accea-4a1c-4e78-8cde-af4d398dc938 could not be found. Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-54ab45ec-187e-470b-9d59-d442c0c80acd tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Request method failure captured: Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/e83accea-4a1c-4e78-8cde-af4d398dc938 HTTP/1.1 Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTQckgl6U8tWiFa6kHLTqXJZa-WFkOFPvM42ze_I8g0obkvFqbNM9lkU1OwxM4wlfasHg2k5Y3wTyvm2PmoX1FYb5_MrnXYU5LmXuaL4gg-UmfTrBh4dBvf7dtL8onz6jaF09qi44UTtAKVjZUYkQp2TCtdAWC7yNSXN6BC3qTWJE8w Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: ed18295b8b7e42d094c7a5b0f0ce2786 Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-905546589 Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ed18295b8b7e42d094c7a5b0f0ce2786"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ed18295b8b7e42d094c7a5b0f0ce2786"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ed18295b8b7e42d094c7a5b0f0ce2786"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ed18295b8b7e42d094c7a5b0f0ce2786"}]}] Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-905546589 Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: ed18295b8b7e42d094c7a5b0f0ce2786 Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-905546589 Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-InstanceActionsNegativeTestJSON-905546589-project Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: fc2ce55e939e46cfb66f24b4ee82b7ae Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-905546589-project Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance e83accea-4a1c-4e78-8cde-af4d398dc938 could not be found. Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'e83accea-4a1c-4e78-8cde-af4d398dc938'} Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e83accea-4a1c-4e78-8cde-af4d398dc938 could not be found. Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e83accea-4a1c-4e78-8cde-af4d398dc938 could not be found. Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:20:50.609863 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:20:50.613343 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:20:50.613343 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:20:50.613343 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:20:50.613343 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:20:50.613343 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:20:50.613343 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:20:50.613343 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e83accea-4a1c-4e78-8cde-af4d398dc938 could not be found. Oct 26 13:20:50.613343 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:20:50.618323 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-54ab45ec-187e-470b-9d59-d442c0c80acd tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] Returning 404 to user: Instance e83accea-4a1c-4e78-8cde-af4d398dc938 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:20:50.619243 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-54ab45ec-187e-470b-9d59-d442c0c80acd tempest-InstanceActionsNegativeTestJSON-905546589 tempest-InstanceActionsNegativeTestJSON-905546589-project] 10.222.0.40 "GET /compute/v2.1/servers/e83accea-4a1c-4e78-8cde-af4d398dc938" status: 404 len: 111 microversion: 2.1 time: 0.050724 Oct 26 13:20:50.619825 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2161/4336] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:50 2022] GET /compute/v2.1/servers/e83accea-4a1c-4e78-8cde-af4d398dc938 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:20:50.663008 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9c508627-6180-45b5-bc9d-1594f0718198 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-55967892", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "02d80460-f865-45cf-882a-671d482bd35c"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:20:50.677169 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1b553aa1-7ba8-40c4-ae89-adf8e83106b0 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:50.680496 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1b553aa1-7ba8-40c4-ae89-adf8e83106b0 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 42f50b1b-9531-43dd-bb5f-cbca3b7d306f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:50.696231 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b553aa1-7ba8-40c4-ae89-adf8e83106b0 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:50.696741 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b553aa1-7ba8-40c4-ae89-adf8e83106b0 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:50.697195 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b553aa1-7ba8-40c4-ae89-adf8e83106b0 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:50.697995 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b553aa1-7ba8-40c4-ae89-adf8e83106b0 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:50.698465 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b553aa1-7ba8-40c4-ae89-adf8e83106b0 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:50.698901 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b553aa1-7ba8-40c4-ae89-adf8e83106b0 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:50.776599 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-9c508627-6180-45b5-bc9d-1594f0718198 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] validate_networks() for [('02d80460-f865-45cf-882a-671d482bd35c', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:20:50.790560 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1b553aa1-7ba8-40c4-ae89-adf8e83106b0 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117407 Oct 26 13:20:50.793899 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2162/4337] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:20:50 2022] GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:20:51.417723 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6f0a57b5-e272-474f-aeda-ae5df4b0f298 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:51.418590 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6f0a57b5-e272-474f-aeda-ae5df4b0f298 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 97825703-89d9-457a-b6c3-b694f8eee97c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:51.430343 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f0a57b5-e272-474f-aeda-ae5df4b0f298 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:51.435626 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f0a57b5-e272-474f-aeda-ae5df4b0f298 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:51.436438 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f0a57b5-e272-474f-aeda-ae5df4b0f298 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:51.439684 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f0a57b5-e272-474f-aeda-ae5df4b0f298 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:51.447380 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f0a57b5-e272-474f-aeda-ae5df4b0f298 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:51.448307 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f0a57b5-e272-474f-aeda-ae5df4b0f298 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:51.694520 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6f0a57b5-e272-474f-aeda-ae5df4b0f298 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:51.704676 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6f0a57b5-e272-474f-aeda-ae5df4b0f298 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c" status: 200 len: 1522 microversion: 2.1 time: 0.290883 Oct 26 13:20:51.705660 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2163/4338] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:51 2022] GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:20:51.711216 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-846a0e65-cef7-4546-8782-74778e944b7e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:51.711942 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-846a0e65-cef7-4546-8782-74778e944b7e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:51.720216 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-846a0e65-cef7-4546-8782-74778e944b7e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:51.721411 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-846a0e65-cef7-4546-8782-74778e944b7e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:51.722495 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-846a0e65-cef7-4546-8782-74778e944b7e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:51.723687 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-846a0e65-cef7-4546-8782-74778e944b7e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:51.724509 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-846a0e65-cef7-4546-8782-74778e944b7e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:51.725140 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-846a0e65-cef7-4546-8782-74778e944b7e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:51.759483 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-9c508627-6180-45b5-bc9d-1594f0718198 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:20:51.759877 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-9c508627-6180-45b5-bc9d-1594f0718198 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:20:51.761977 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-9c508627-6180-45b5-bc9d-1594f0718198 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:20:51.762665 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-9c508627-6180-45b5-bc9d-1594f0718198 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:20:51.763108 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-9c508627-6180-45b5-bc9d-1594f0718198 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:20:51.783157 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c508627-6180-45b5-bc9d-1594f0718198 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:51.784241 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c508627-6180-45b5-bc9d-1594f0718198 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:51.784910 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c508627-6180-45b5-bc9d-1594f0718198 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:51.791878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c508627-6180-45b5-bc9d-1594f0718198 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:51.793205 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c508627-6180-45b5-bc9d-1594f0718198 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:51.794449 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c508627-6180-45b5-bc9d-1594f0718198 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:51.834973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-9c508627-6180-45b5-bc9d-1594f0718198 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Getting quotas for project cf8d947764e045dfafa0a18ec2472e7b. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:20:51.842793 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-9c508627-6180-45b5-bc9d-1594f0718198 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Getting quotas for user 8b9017d8481844cd9266b86736982c92 and project cf8d947764e045dfafa0a18ec2472e7b. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:20:51.850911 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-846a0e65-cef7-4546-8782-74778e944b7e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:51.859973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9c508627-6180-45b5-bc9d-1594f0718198 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:20:51.865267 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9c508627-6180-45b5-bc9d-1594f0718198 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: d7cd631a-a439-481d-ab67-f5a0c9d0ef86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:20:51.868282 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-846a0e65-cef7-4546-8782-74778e944b7e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:51.870195 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-846a0e65-cef7-4546-8782-74778e944b7e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:51.876497 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-846a0e65-cef7-4546-8782-74778e944b7e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1539 microversion: 2.91 time: 0.169565 Oct 26 13:20:51.877268 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2164/4339] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:20:51 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1539 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:20:51.900268 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9634bd00-deeb-45fd-9e6e-25ff7a59f748 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:51.903878 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9634bd00-deeb-45fd-9e6e-25ff7a59f748 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 42f50b1b-9531-43dd-bb5f-cbca3b7d306f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:51.910668 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9634bd00-deeb-45fd-9e6e-25ff7a59f748 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:51.911968 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9634bd00-deeb-45fd-9e6e-25ff7a59f748 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:51.912701 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9634bd00-deeb-45fd-9e6e-25ff7a59f748 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:51.914231 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9634bd00-deeb-45fd-9e6e-25ff7a59f748 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:51.914896 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9634bd00-deeb-45fd-9e6e-25ff7a59f748 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:51.915515 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9634bd00-deeb-45fd-9e6e-25ff7a59f748 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:51.941345 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9c508627-6180-45b5-bc9d-1594f0718198 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.716920 Oct 26 13:20:51.943683 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2176/4340] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:20:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:20:51.980718 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9634bd00-deeb-45fd-9e6e-25ff7a59f748 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102039 Oct 26 13:20:51.981326 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2165/4341] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:20:51 2022] GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:20:52.205004 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fafee8b7-ed22-494d-a048-5d83eb449496 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-778031130", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "02d80460-f865-45cf-882a-671d482bd35c"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:20:52.317832 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-fafee8b7-ed22-494d-a048-5d83eb449496 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] validate_networks() for [('02d80460-f865-45cf-882a-671d482bd35c', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:20:52.731381 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b28e1088-e5a6-410b-b16c-628c97366c3a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:52.732653 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b28e1088-e5a6-410b-b16c-628c97366c3a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 97825703-89d9-457a-b6c3-b694f8eee97c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:52.744752 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b28e1088-e5a6-410b-b16c-628c97366c3a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:52.746638 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b28e1088-e5a6-410b-b16c-628c97366c3a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:52.747374 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b28e1088-e5a6-410b-b16c-628c97366c3a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:52.748551 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b28e1088-e5a6-410b-b16c-628c97366c3a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:52.750954 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b28e1088-e5a6-410b-b16c-628c97366c3a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:52.752801 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b28e1088-e5a6-410b-b16c-628c97366c3a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:52.811217 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:20:53.007177 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b28e1088-e5a6-410b-b16c-628c97366c3a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:53.026600 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b28e1088-e5a6-410b-b16c-628c97366c3a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c" status: 200 len: 1522 microversion: 2.1 time: 0.300318 Oct 26 13:20:53.028005 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2166/4342] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:52 2022] GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:20:53.035376 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-620b77ab-2d7e-44e9-b685-f407fd458e6a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:53.037849 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-620b77ab-2d7e-44e9-b685-f407fd458e6a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:53.045743 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-620b77ab-2d7e-44e9-b685-f407fd458e6a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:53.046547 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-620b77ab-2d7e-44e9-b685-f407fd458e6a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:53.047247 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-620b77ab-2d7e-44e9-b685-f407fd458e6a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:53.048339 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-620b77ab-2d7e-44e9-b685-f407fd458e6a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:53.049000 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-620b77ab-2d7e-44e9-b685-f407fd458e6a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:53.049666 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-620b77ab-2d7e-44e9-b685-f407fd458e6a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:53.130749 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-fafee8b7-ed22-494d-a048-5d83eb449496 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:20:53.131286 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-fafee8b7-ed22-494d-a048-5d83eb449496 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:20:53.131835 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-fafee8b7-ed22-494d-a048-5d83eb449496 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:20:53.132247 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-fafee8b7-ed22-494d-a048-5d83eb449496 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:20:53.132819 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-fafee8b7-ed22-494d-a048-5d83eb449496 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:20:53.165996 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fafee8b7-ed22-494d-a048-5d83eb449496 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:53.167331 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fafee8b7-ed22-494d-a048-5d83eb449496 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:53.169631 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fafee8b7-ed22-494d-a048-5d83eb449496 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:53.173413 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fafee8b7-ed22-494d-a048-5d83eb449496 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:53.173570 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-620b77ab-2d7e-44e9-b685-f407fd458e6a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:53.174515 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fafee8b7-ed22-494d-a048-5d83eb449496 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:53.176316 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fafee8b7-ed22-494d-a048-5d83eb449496 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:53.185946 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-620b77ab-2d7e-44e9-b685-f407fd458e6a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:53.187961 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-620b77ab-2d7e-44e9-b685-f407fd458e6a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:53.195517 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-620b77ab-2d7e-44e9-b685-f407fd458e6a tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1560 microversion: 2.91 time: 0.166134 Oct 26 13:20:53.196502 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2167/4343] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:20:53 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:20:53.209372 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4f11b796-a587-416b-b4f3-6b8514b582ad tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:53.222569 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4f11b796-a587-416b-b4f3-6b8514b582ad tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 42f50b1b-9531-43dd-bb5f-cbca3b7d306f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:53.242545 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f11b796-a587-416b-b4f3-6b8514b582ad tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:53.243208 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f11b796-a587-416b-b4f3-6b8514b582ad tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:53.249957 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f11b796-a587-416b-b4f3-6b8514b582ad tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:53.256801 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f11b796-a587-416b-b4f3-6b8514b582ad tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:53.258172 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f11b796-a587-416b-b4f3-6b8514b582ad tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:53.258776 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f11b796-a587-416b-b4f3-6b8514b582ad tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:53.267740 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-fafee8b7-ed22-494d-a048-5d83eb449496 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Getting quotas for project cf8d947764e045dfafa0a18ec2472e7b. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:20:53.283804 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-fafee8b7-ed22-494d-a048-5d83eb449496 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Getting quotas for user 8b9017d8481844cd9266b86736982c92 and project cf8d947764e045dfafa0a18ec2472e7b. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:20:53.330879 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fafee8b7-ed22-494d-a048-5d83eb449496 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:20:53.339855 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fafee8b7-ed22-494d-a048-5d83eb449496 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: f9df48e5-9204-46d5-b2a9-2154dbdcf167] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:20:53.362601 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4f11b796-a587-416b-b4f3-6b8514b582ad tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.164184 Oct 26 13:20:53.366589 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2168/4344] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:20:53 2022] GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f/os-volume_attachments => generated 197 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:20:53.425867 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fafee8b7-ed22-494d-a048-5d83eb449496 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.235107 Oct 26 13:20:53.428321 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2177/4345] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:20:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1239 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:20:53.750487 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f4fe4c24-15ae-47bd-9a97-0310a2549e14 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1222508095", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "451", "networks": [{"uuid": "02d80460-f865-45cf-882a-671d482bd35c"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:20:53.938830 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-f4fe4c24-15ae-47bd-9a97-0310a2549e14 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] validate_networks() for [('02d80460-f865-45cf-882a-671d482bd35c', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:20:54.054988 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-34437b6c-ac59-4028-8d6e-a0d08719833c tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:54.055895 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-34437b6c-ac59-4028-8d6e-a0d08719833c tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 97825703-89d9-457a-b6c3-b694f8eee97c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:54.071800 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-34437b6c-ac59-4028-8d6e-a0d08719833c tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:54.072827 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-34437b6c-ac59-4028-8d6e-a0d08719833c tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:54.073443 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-34437b6c-ac59-4028-8d6e-a0d08719833c tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:54.075801 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-34437b6c-ac59-4028-8d6e-a0d08719833c tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:54.076442 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-34437b6c-ac59-4028-8d6e-a0d08719833c tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:54.079187 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-34437b6c-ac59-4028-8d6e-a0d08719833c tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:54.655292 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-f4fe4c24-15ae-47bd-9a97-0310a2549e14 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:20:54.655968 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-f4fe4c24-15ae-47bd-9a97-0310a2549e14 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:20:54.657597 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-f4fe4c24-15ae-47bd-9a97-0310a2549e14 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:20:54.660046 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-f4fe4c24-15ae-47bd-9a97-0310a2549e14 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:20:54.660771 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-f4fe4c24-15ae-47bd-9a97-0310a2549e14 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:20:54.684306 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f4fe4c24-15ae-47bd-9a97-0310a2549e14 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:54.689587 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f4fe4c24-15ae-47bd-9a97-0310a2549e14 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:54.691276 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f4fe4c24-15ae-47bd-9a97-0310a2549e14 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:54.694266 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f4fe4c24-15ae-47bd-9a97-0310a2549e14 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:54.694949 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f4fe4c24-15ae-47bd-9a97-0310a2549e14 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:54.695762 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f4fe4c24-15ae-47bd-9a97-0310a2549e14 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:54.768949 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-f4fe4c24-15ae-47bd-9a97-0310a2549e14 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Getting quotas for project cf8d947764e045dfafa0a18ec2472e7b. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:20:54.781945 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-f4fe4c24-15ae-47bd-9a97-0310a2549e14 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Getting quotas for user 8b9017d8481844cd9266b86736982c92 and project cf8d947764e045dfafa0a18ec2472e7b. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:20:54.810897 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f4fe4c24-15ae-47bd-9a97-0310a2549e14 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:20:54.815334 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f4fe4c24-15ae-47bd-9a97-0310a2549e14 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: 800fb374-b811-40a1-9843-8577e3a6d88a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:20:54.894302 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f4fe4c24-15ae-47bd-9a97-0310a2549e14 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.149170 Oct 26 13:20:54.895837 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2169/4346] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:20:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1151 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:20:54.902158 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ad3d3460-6ba3-462e-9ffc-c0d058693aa8 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:54.902969 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ad3d3460-6ba3-462e-9ffc-c0d058693aa8 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:54.910391 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad3d3460-6ba3-462e-9ffc-c0d058693aa8 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:54.911432 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad3d3460-6ba3-462e-9ffc-c0d058693aa8 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:54.911878 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad3d3460-6ba3-462e-9ffc-c0d058693aa8 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:54.912754 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad3d3460-6ba3-462e-9ffc-c0d058693aa8 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:54.913413 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad3d3460-6ba3-462e-9ffc-c0d058693aa8 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:54.914040 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad3d3460-6ba3-462e-9ffc-c0d058693aa8 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:55.074916 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ad3d3460-6ba3-462e-9ffc-c0d058693aa8 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:55.085107 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ad3d3460-6ba3-462e-9ffc-c0d058693aa8 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:55.101764 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ad3d3460-6ba3-462e-9ffc-c0d058693aa8 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:55.118378 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ad3d3460-6ba3-462e-9ffc-c0d058693aa8 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1555 microversion: 2.91 time: 0.220973 Oct 26 13:20:55.142258 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2170/4347] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:20:54 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1555 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:20:55.156627 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-61bfd4c6-6934-4ae0-a4b1-59cbfefb4950 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:55.163328 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-61bfd4c6-6934-4ae0-a4b1-59cbfefb4950 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 42f50b1b-9531-43dd-bb5f-cbca3b7d306f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:55.170269 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-61bfd4c6-6934-4ae0-a4b1-59cbfefb4950 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:55.171404 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-61bfd4c6-6934-4ae0-a4b1-59cbfefb4950 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:55.171891 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-61bfd4c6-6934-4ae0-a4b1-59cbfefb4950 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:55.172658 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-61bfd4c6-6934-4ae0-a4b1-59cbfefb4950 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:55.173123 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-61bfd4c6-6934-4ae0-a4b1-59cbfefb4950 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:55.173669 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-61bfd4c6-6934-4ae0-a4b1-59cbfefb4950 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:55.277417 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-61bfd4c6-6934-4ae0-a4b1-59cbfefb4950 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131559 Oct 26 13:20:55.278476 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2171/4348] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:20:55 2022] GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:20:55.289683 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8aa221a2-7ccd-456f-b6f3-89d2a2209a83 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:55.290466 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8aa221a2-7ccd-456f-b6f3-89d2a2209a83 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: 800fb374-b811-40a1-9843-8577e3a6d88a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:55.381302 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8aa221a2-7ccd-456f-b6f3-89d2a2209a83 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:55.404444 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8aa221a2-7ccd-456f-b6f3-89d2a2209a83 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/800fb374-b811-40a1-9843-8577e3a6d88a" status: 200 len: 1221 microversion: 2.1 time: 0.123028 Oct 26 13:20:55.411699 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2172/4349] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:55 2022] GET /compute/v2.1/servers/800fb374-b811-40a1-9843-8577e3a6d88a => generated 1221 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:55.495331 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-34437b6c-ac59-4028-8d6e-a0d08719833c tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:55.507207 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-34437b6c-ac59-4028-8d6e-a0d08719833c tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c" status: 200 len: 1522 microversion: 2.1 time: 1.459134 Oct 26 13:20:55.510502 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2178/4350] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:54 2022] GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c => generated 1522 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:56.161070 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cc7197af-7b10-4187-a666-662788aaf81f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:56.162490 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cc7197af-7b10-4187-a666-662788aaf81f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:56.183137 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc7197af-7b10-4187-a666-662788aaf81f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:56.185033 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc7197af-7b10-4187-a666-662788aaf81f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:56.187012 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc7197af-7b10-4187-a666-662788aaf81f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:56.188024 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc7197af-7b10-4187-a666-662788aaf81f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:56.189797 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc7197af-7b10-4187-a666-662788aaf81f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:56.192890 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc7197af-7b10-4187-a666-662788aaf81f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:56.294571 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-43eff3dd-048e-4611-840d-1e60c43da85d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:56.297834 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-43eff3dd-048e-4611-840d-1e60c43da85d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 42f50b1b-9531-43dd-bb5f-cbca3b7d306f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:56.329177 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-43eff3dd-048e-4611-840d-1e60c43da85d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:56.330058 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-43eff3dd-048e-4611-840d-1e60c43da85d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:56.330685 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-43eff3dd-048e-4611-840d-1e60c43da85d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:56.335208 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-43eff3dd-048e-4611-840d-1e60c43da85d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:56.339614 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-43eff3dd-048e-4611-840d-1e60c43da85d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:56.340613 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-43eff3dd-048e-4611-840d-1e60c43da85d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:56.390867 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:20:56.404861 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cc7197af-7b10-4187-a666-662788aaf81f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:56.416889 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cc7197af-7b10-4187-a666-662788aaf81f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:56.423265 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cc7197af-7b10-4187-a666-662788aaf81f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:56.437319 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cc7197af-7b10-4187-a666-662788aaf81f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1555 microversion: 2.91 time: 0.280480 Oct 26 13:20:56.453527 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2173/4351] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:20:56 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1555 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:20:56.465996 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-40cec4ef-8956-4425-97e0-726c8296e191 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:56.466624 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-40cec4ef-8956-4425-97e0-726c8296e191 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: 800fb374-b811-40a1-9843-8577e3a6d88a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:56.468272 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-43eff3dd-048e-4611-840d-1e60c43da85d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.181300 Oct 26 13:20:56.468878 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2179/4352] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:20:56 2022] GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f/os-volume_attachments => generated 25 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:20:56.487798 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-40cec4ef-8956-4425-97e0-726c8296e191 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:56.488660 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-40cec4ef-8956-4425-97e0-726c8296e191 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:56.489353 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-40cec4ef-8956-4425-97e0-726c8296e191 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:56.490813 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-40cec4ef-8956-4425-97e0-726c8296e191 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:56.491450 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-40cec4ef-8956-4425-97e0-726c8296e191 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:56.492226 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-40cec4ef-8956-4425-97e0-726c8296e191 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:56.536208 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0f69caa7-c19b-474d-a572-30058f481cdb tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:56.537346 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0f69caa7-c19b-474d-a572-30058f481cdb tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 97825703-89d9-457a-b6c3-b694f8eee97c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:56.553923 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f69caa7-c19b-474d-a572-30058f481cdb tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:56.554725 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f69caa7-c19b-474d-a572-30058f481cdb tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:56.558740 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f69caa7-c19b-474d-a572-30058f481cdb tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:56.559718 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f69caa7-c19b-474d-a572-30058f481cdb tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:56.562326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f69caa7-c19b-474d-a572-30058f481cdb tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:56.563399 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f69caa7-c19b-474d-a572-30058f481cdb tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:56.743859 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-40cec4ef-8956-4425-97e0-726c8296e191 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:56.754576 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-40cec4ef-8956-4425-97e0-726c8296e191 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/800fb374-b811-40a1-9843-8577e3a6d88a" status: 200 len: 1217 microversion: 2.1 time: 0.298991 Oct 26 13:20:56.757988 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2174/4353] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:56 2022] GET /compute/v2.1/servers/800fb374-b811-40a1-9843-8577e3a6d88a => generated 1217 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:56.765998 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4a181e9d-fb0e-460d-98b4-0efb1ea1fb35 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:56.787395 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4a181e9d-fb0e-460d-98b4-0efb1ea1fb35 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 42f50b1b-9531-43dd-bb5f-cbca3b7d306f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:56.812568 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4a181e9d-fb0e-460d-98b4-0efb1ea1fb35 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:56.814085 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4a181e9d-fb0e-460d-98b4-0efb1ea1fb35 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:56.819020 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4a181e9d-fb0e-460d-98b4-0efb1ea1fb35 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:56.832042 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4a181e9d-fb0e-460d-98b4-0efb1ea1fb35 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:56.835323 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4a181e9d-fb0e-460d-98b4-0efb1ea1fb35 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:56.837544 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4a181e9d-fb0e-460d-98b4-0efb1ea1fb35 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:56.949158 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4a181e9d-fb0e-460d-98b4-0efb1ea1fb35 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 42f50b1b-9531-43dd-bb5f-cbca3b7d306f] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:20:57.092352 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0f69caa7-c19b-474d-a572-30058f481cdb tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:57.106561 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0f69caa7-c19b-474d-a572-30058f481cdb tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c" status: 200 len: 1522 microversion: 2.1 time: 0.574506 Oct 26 13:20:57.111121 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2180/4354] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:56 2022] GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c => generated 1522 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:20:57.184826 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:20:57.195838 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4a181e9d-fb0e-460d-98b4-0efb1ea1fb35 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "DELETE /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f" status: 204 len: 0 microversion: 2.1 time: 0.433551 Oct 26 13:20:57.196502 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2175/4355] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:20:56 2022] DELETE /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:20:57.206116 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d4db1aee-89f5-44f6-badc-f857e64a4995 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:57.206978 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d4db1aee-89f5-44f6-badc-f857e64a4995 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 42f50b1b-9531-43dd-bb5f-cbca3b7d306f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:57.215392 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4db1aee-89f5-44f6-badc-f857e64a4995 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:57.216127 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4db1aee-89f5-44f6-badc-f857e64a4995 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:57.216723 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4db1aee-89f5-44f6-badc-f857e64a4995 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:57.218395 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4db1aee-89f5-44f6-badc-f857e64a4995 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:57.219090 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4db1aee-89f5-44f6-badc-f857e64a4995 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:57.219674 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4db1aee-89f5-44f6-badc-f857e64a4995 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:57.476675 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a8bd5237-9425-43da-be2f-265a21991da4 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:57.477773 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a8bd5237-9425-43da-be2f-265a21991da4 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:57.494847 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8bd5237-9425-43da-be2f-265a21991da4 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:57.495660 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8bd5237-9425-43da-be2f-265a21991da4 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:57.500313 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8bd5237-9425-43da-be2f-265a21991da4 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:57.501326 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8bd5237-9425-43da-be2f-265a21991da4 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:57.501990 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8bd5237-9425-43da-be2f-265a21991da4 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:57.503404 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8bd5237-9425-43da-be2f-265a21991da4 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:57.665611 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a8bd5237-9425-43da-be2f-265a21991da4 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:57.682748 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a8bd5237-9425-43da-be2f-265a21991da4 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:57.687269 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a8bd5237-9425-43da-be2f-265a21991da4 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:57.710125 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d4db1aee-89f5-44f6-badc-f857e64a4995 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:57.713590 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a8bd5237-9425-43da-be2f-265a21991da4 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1555 microversion: 2.91 time: 0.245912 Oct 26 13:20:57.715574 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2176/4356] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:20:57 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1555 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:20:57.719783 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d4db1aee-89f5-44f6-badc-f857e64a4995 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f" status: 200 len: 1681 microversion: 2.1 time: 0.518450 Oct 26 13:20:57.724372 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2181/4357] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:57 2022] GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f => generated 1681 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:57.787270 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7b427116-a909-457d-b38d-a8b8f3a58c84 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:57.788026 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7b427116-a909-457d-b38d-a8b8f3a58c84 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: 800fb374-b811-40a1-9843-8577e3a6d88a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:57.802014 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b427116-a909-457d-b38d-a8b8f3a58c84 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:57.802904 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b427116-a909-457d-b38d-a8b8f3a58c84 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:57.803534 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b427116-a909-457d-b38d-a8b8f3a58c84 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:57.804657 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b427116-a909-457d-b38d-a8b8f3a58c84 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:57.805247 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b427116-a909-457d-b38d-a8b8f3a58c84 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:57.805825 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b427116-a909-457d-b38d-a8b8f3a58c84 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:57.913636 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7b427116-a909-457d-b38d-a8b8f3a58c84 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:57.926422 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7b427116-a909-457d-b38d-a8b8f3a58c84 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/800fb374-b811-40a1-9843-8577e3a6d88a" status: 200 len: 1281 microversion: 2.1 time: 0.143993 Oct 26 13:20:57.927818 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2177/4358] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:57 2022] GET /compute/v2.1/servers/800fb374-b811-40a1-9843-8577e3a6d88a => generated 1281 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:58.139804 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-524eecbf-edc7-4a3b-bc32-5cf33e9f9701 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:58.140834 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-524eecbf-edc7-4a3b-bc32-5cf33e9f9701 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 97825703-89d9-457a-b6c3-b694f8eee97c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:58.155991 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-524eecbf-edc7-4a3b-bc32-5cf33e9f9701 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:58.169299 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-524eecbf-edc7-4a3b-bc32-5cf33e9f9701 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:58.169939 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-524eecbf-edc7-4a3b-bc32-5cf33e9f9701 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:58.171379 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-524eecbf-edc7-4a3b-bc32-5cf33e9f9701 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:58.175532 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-524eecbf-edc7-4a3b-bc32-5cf33e9f9701 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:58.176003 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-524eecbf-edc7-4a3b-bc32-5cf33e9f9701 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:58.743293 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c11093a8-27c8-40a0-ac0c-7d05bf269eb9 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:58.744017 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c11093a8-27c8-40a0-ac0c-7d05bf269eb9 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:58.763414 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c11093a8-27c8-40a0-ac0c-7d05bf269eb9 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:58.764016 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c11093a8-27c8-40a0-ac0c-7d05bf269eb9 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:58.764536 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c11093a8-27c8-40a0-ac0c-7d05bf269eb9 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:58.765331 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c11093a8-27c8-40a0-ac0c-7d05bf269eb9 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:58.765901 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c11093a8-27c8-40a0-ac0c-7d05bf269eb9 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:58.766404 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c11093a8-27c8-40a0-ac0c-7d05bf269eb9 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:58.862151 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-524eecbf-edc7-4a3b-bc32-5cf33e9f9701 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:58.881344 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-524eecbf-edc7-4a3b-bc32-5cf33e9f9701 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c" status: 200 len: 1502 microversion: 2.1 time: 0.748881 Oct 26 13:20:58.882618 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2182/4359] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:58 2022] GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c => generated 1502 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:58.890757 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8a1d507c-7585-47ec-b356-2c104ab6ba65 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:58.895853 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8a1d507c-7585-47ec-b356-2c104ab6ba65 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 42f50b1b-9531-43dd-bb5f-cbca3b7d306f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:58.920590 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8a1d507c-7585-47ec-b356-2c104ab6ba65 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:58.921104 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8a1d507c-7585-47ec-b356-2c104ab6ba65 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:58.925808 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8a1d507c-7585-47ec-b356-2c104ab6ba65 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:58.927289 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8a1d507c-7585-47ec-b356-2c104ab6ba65 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:58.927783 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8a1d507c-7585-47ec-b356-2c104ab6ba65 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:58.928226 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8a1d507c-7585-47ec-b356-2c104ab6ba65 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:59.159820 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c11093a8-27c8-40a0-ac0c-7d05bf269eb9 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:59.169663 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c11093a8-27c8-40a0-ac0c-7d05bf269eb9 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:59.178789 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c11093a8-27c8-40a0-ac0c-7d05bf269eb9 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:59.194006 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c11093a8-27c8-40a0-ac0c-7d05bf269eb9 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1555 microversion: 2.91 time: 0.455147 Oct 26 13:20:59.195378 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2178/4360] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:20:58 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1555 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:20:59.206011 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-49b79d77-792a-48bb-a6df-9f9df2435286 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "798c434c-e6b9-4509-ba88-a7ba38ece97a"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:20:59.212808 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-49b79d77-792a-48bb-a6df-9f9df2435286 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 97825703-89d9-457a-b6c3-b694f8eee97c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:59.226797 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49b79d77-792a-48bb-a6df-9f9df2435286 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:59.228459 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49b79d77-792a-48bb-a6df-9f9df2435286 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:59.230410 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49b79d77-792a-48bb-a6df-9f9df2435286 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:59.232054 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49b79d77-792a-48bb-a6df-9f9df2435286 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:59.235958 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49b79d77-792a-48bb-a6df-9f9df2435286 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:59.236665 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49b79d77-792a-48bb-a6df-9f9df2435286 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:59.291603 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-49b79d77-792a-48bb-a6df-9f9df2435286 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] HTTP exception thrown: Cannot 'attach_volume' instance 97825703-89d9-457a-b6c3-b694f8eee97c while it is in vm_state rescued Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-49b79d77-792a-48bb-a6df-9f9df2435286 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Request method failure captured: Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c/os-volume_attachments HTTP/1.1 Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 74 Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTPjOuLV_n1DR58OZOmgbin2ud11sLWXOml70eL6_Yw9nM-eYNoCKOyZp3mck381-99yxZlLhlu2g6vQAmqZcUDv2ExrohfYX5ori3eOe3Uf6RO52e_TYIFS_DlKFRRKYqEp1KNMktjZRMuKeogboZRQrwA8baF1wLatF4_VyxhzXdo Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 9cdd45be745d4828b5a111472254156c Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1015154874 Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9cdd45be745d4828b5a111472254156c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9cdd45be745d4828b5a111472254156c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9cdd45be745d4828b5a111472254156c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9cdd45be745d4828b5a111472254156c"}]}] Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1015154874 Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 9cdd45be745d4828b5a111472254156c Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1015154874 Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServerRescueNegativeTestJSON-1015154874-project Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 363fc117da70484f9d8cf2040e8391e4 Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1015154874-project Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: {"volumeAttachment": {"volumeId": "798c434c-e6b9-4509-ba88-a7ba38ece97a"}} Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: exception: Cannot 'attach_volume' instance 97825703-89d9-457a-b6c3-b694f8eee97c while it is in vm_state rescued Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'server_id': '97825703-89d9-457a-b6c3-b694f8eee97c', 'body': {'volumeAttachment': {'volumeId': '798c434c-e6b9-4509-ba88-a7ba38ece97a'}}} Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 97825703-89d9-457a-b6c3-b694f8eee97c in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 26 13:20:59.298406 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 26 13:20:59.303156 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 26 13:20:59.303156 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 26 13:20:59.303156 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 97825703-89d9-457a-b6c3-b694f8eee97c while it is in vm_state rescued Oct 26 13:20:59.303156 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:20:59.303156 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:20:59.303156 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:20:59.303156 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:20:59.303156 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:20:59.303156 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:20:59.303156 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:20:59.303156 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:20:59.303156 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 97825703-89d9-457a-b6c3-b694f8eee97c while it is in vm_state rescued Oct 26 13:20:59.303156 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:20:59.306174 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-49b79d77-792a-48bb-a6df-9f9df2435286 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Returning 409 to user: Cannot 'attach_volume' instance 97825703-89d9-457a-b6c3-b694f8eee97c while it is in vm_state rescued {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:20:59.308504 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-49b79d77-792a-48bb-a6df-9f9df2435286 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "POST /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.111897 Oct 26 13:20:59.313107 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2179/4361] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Oct 26 13:20:59 2022] POST /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c/os-volume_attachments => generated 152 bytes in 117 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:20:59.324341 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1c1c3f2d-d623-44c1-86ec-84ef65553c00 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:59.325431 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1c1c3f2d-d623-44c1-86ec-84ef65553c00 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: 800fb374-b811-40a1-9843-8577e3a6d88a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:59.349213 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1c1c3f2d-d623-44c1-86ec-84ef65553c00 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:59.355033 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1c1c3f2d-d623-44c1-86ec-84ef65553c00 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:59.355830 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1c1c3f2d-d623-44c1-86ec-84ef65553c00 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:59.356394 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1c1c3f2d-d623-44c1-86ec-84ef65553c00 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:59.356964 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1c1c3f2d-d623-44c1-86ec-84ef65553c00 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:59.362357 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1c1c3f2d-d623-44c1-86ec-84ef65553c00 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:59.597056 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1c1c3f2d-d623-44c1-86ec-84ef65553c00 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:59.610478 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1c1c3f2d-d623-44c1-86ec-84ef65553c00 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/800fb374-b811-40a1-9843-8577e3a6d88a" status: 200 len: 1279 microversion: 2.1 time: 0.293328 Oct 26 13:20:59.611516 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2180/4362] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:59 2022] GET /compute/v2.1/servers/800fb374-b811-40a1-9843-8577e3a6d88a => generated 1279 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:20:59.636603 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0ea613d0-289b-4432-a92b-e4c9bbebae16 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:20:59.637237 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0ea613d0-289b-4432-a92b-e4c9bbebae16 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 97825703-89d9-457a-b6c3-b694f8eee97c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:59.643560 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ea613d0-289b-4432-a92b-e4c9bbebae16 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:59.644142 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ea613d0-289b-4432-a92b-e4c9bbebae16 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:59.644679 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ea613d0-289b-4432-a92b-e4c9bbebae16 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:59.645679 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ea613d0-289b-4432-a92b-e4c9bbebae16 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:59.646464 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ea613d0-289b-4432-a92b-e4c9bbebae16 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:59.647060 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ea613d0-289b-4432-a92b-e4c9bbebae16 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:59.757664 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0ea613d0-289b-4432-a92b-e4c9bbebae16 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "POST /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c/action" status: 202 len: 0 microversion: 2.1 time: 0.129343 Oct 26 13:20:59.767764 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2181/4363] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:20:59 2022] POST /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:20:59.783637 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d561cfbe-9e69-4a56-98e1-18eefbff8a0c tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:20:59.784904 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d561cfbe-9e69-4a56-98e1-18eefbff8a0c tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 97825703-89d9-457a-b6c3-b694f8eee97c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:20:59.814727 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d561cfbe-9e69-4a56-98e1-18eefbff8a0c tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:59.815470 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d561cfbe-9e69-4a56-98e1-18eefbff8a0c tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:59.816079 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d561cfbe-9e69-4a56-98e1-18eefbff8a0c tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:59.817871 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d561cfbe-9e69-4a56-98e1-18eefbff8a0c tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:20:59.818580 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d561cfbe-9e69-4a56-98e1-18eefbff8a0c tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:20:59.819177 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d561cfbe-9e69-4a56-98e1-18eefbff8a0c tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:20:59.835959 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8a1d507c-7585-47ec-b356-2c104ab6ba65 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:20:59.852090 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8a1d507c-7585-47ec-b356-2c104ab6ba65 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f" status: 200 len: 1681 microversion: 2.1 time: 0.967945 Oct 26 13:20:59.859967 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:20:59.876036 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2183/4364] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:58 2022] GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f => generated 1681 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:00.228633 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-626236c6-59db-41e1-87b3-05c9ef3d7eac tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:00.229548 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-626236c6-59db-41e1-87b3-05c9ef3d7eac tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:00.241332 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-626236c6-59db-41e1-87b3-05c9ef3d7eac tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:00.242193 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-626236c6-59db-41e1-87b3-05c9ef3d7eac tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:00.243468 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-626236c6-59db-41e1-87b3-05c9ef3d7eac tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:00.250579 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-626236c6-59db-41e1-87b3-05c9ef3d7eac tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:00.251306 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-626236c6-59db-41e1-87b3-05c9ef3d7eac tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:00.251886 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-626236c6-59db-41e1-87b3-05c9ef3d7eac tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:00.429697 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-626236c6-59db-41e1-87b3-05c9ef3d7eac tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:00.438181 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-626236c6-59db-41e1-87b3-05c9ef3d7eac tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:00.449153 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-626236c6-59db-41e1-87b3-05c9ef3d7eac tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:00.459647 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-626236c6-59db-41e1-87b3-05c9ef3d7eac tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1555 microversion: 2.91 time: 0.239371 Oct 26 13:21:00.470672 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2184/4365] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:00 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1555 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:21:00.478360 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-c40f59ab-9f7c-41f3-913d-21683b93314a req-10c7a10d-786e-4185-ba3f-139561424784 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7cd631a-a439-481d-ab67-f5a0c9d0ef86", "tag": "d286e014-2811-4f2e-8a1f-9f097f030fa7"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:21:00.500230 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-c40f59ab-9f7c-41f3-913d-21683b93314a req-10c7a10d-786e-4185-ba3f-139561424784 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:00.500712 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-c40f59ab-9f7c-41f3-913d-21683b93314a req-10c7a10d-786e-4185-ba3f-139561424784 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:00.501167 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-c40f59ab-9f7c-41f3-913d-21683b93314a req-10c7a10d-786e-4185-ba3f-139561424784 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:00.525215 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-c40f59ab-9f7c-41f3-913d-21683b93314a req-10c7a10d-786e-4185-ba3f-139561424784 service nova] Creating event network-changed:d286e014-2811-4f2e-8a1f-9f097f030fa7 for instance d7cd631a-a439-481d-ab67-f5a0c9d0ef86 on n-h1-862686-1 Oct 26 13:21:00.539291 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-c40f59ab-9f7c-41f3-913d-21683b93314a req-10c7a10d-786e-4185-ba3f-139561424784 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066738 Oct 26 13:21:00.539909 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2185/4366] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:21:00.640362 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a354d0b2-b9e8-49a7-80d8-18b8593de447 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:00.641327 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a354d0b2-b9e8-49a7-80d8-18b8593de447 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: 800fb374-b811-40a1-9843-8577e3a6d88a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:00.655424 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a354d0b2-b9e8-49a7-80d8-18b8593de447 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:00.656520 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a354d0b2-b9e8-49a7-80d8-18b8593de447 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:00.657647 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a354d0b2-b9e8-49a7-80d8-18b8593de447 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:00.660356 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a354d0b2-b9e8-49a7-80d8-18b8593de447 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:00.663368 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a354d0b2-b9e8-49a7-80d8-18b8593de447 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:00.664046 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a354d0b2-b9e8-49a7-80d8-18b8593de447 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:00.792757 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a354d0b2-b9e8-49a7-80d8-18b8593de447 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:00.810636 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a354d0b2-b9e8-49a7-80d8-18b8593de447 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/800fb374-b811-40a1-9843-8577e3a6d88a" status: 200 len: 1279 microversion: 2.1 time: 0.174090 Oct 26 13:21:00.815619 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2186/4367] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:00 2022] GET /compute/v2.1/servers/800fb374-b811-40a1-9843-8577e3a6d88a => generated 1279 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:21:00.885206 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2d388253-7c4c-42c3-9dea-ea371aee416d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:00.889668 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2d388253-7c4c-42c3-9dea-ea371aee416d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 42f50b1b-9531-43dd-bb5f-cbca3b7d306f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:00.921012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d388253-7c4c-42c3-9dea-ea371aee416d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:00.924821 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d388253-7c4c-42c3-9dea-ea371aee416d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:00.925761 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d388253-7c4c-42c3-9dea-ea371aee416d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:00.930875 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d388253-7c4c-42c3-9dea-ea371aee416d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:00.933762 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d388253-7c4c-42c3-9dea-ea371aee416d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:00.938715 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d388253-7c4c-42c3-9dea-ea371aee416d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:01.373547 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d561cfbe-9e69-4a56-98e1-18eefbff8a0c tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:01.383044 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d561cfbe-9e69-4a56-98e1-18eefbff8a0c tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c" status: 200 len: 1510 microversion: 2.1 time: 1.610698 Oct 26 13:21:01.386766 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2182/4368] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:20:59 2022] GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c => generated 1510 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:01.499082 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c60a7ea3-c25a-406b-bb30-94bbbb9f7f2c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:01.500176 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c60a7ea3-c25a-406b-bb30-94bbbb9f7f2c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:01.513376 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c60a7ea3-c25a-406b-bb30-94bbbb9f7f2c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:01.514215 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c60a7ea3-c25a-406b-bb30-94bbbb9f7f2c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:01.514827 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c60a7ea3-c25a-406b-bb30-94bbbb9f7f2c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:01.518786 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c60a7ea3-c25a-406b-bb30-94bbbb9f7f2c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:01.521198 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c60a7ea3-c25a-406b-bb30-94bbbb9f7f2c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:01.521959 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c60a7ea3-c25a-406b-bb30-94bbbb9f7f2c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:01.669378 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2d388253-7c4c-42c3-9dea-ea371aee416d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:01.689244 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2d388253-7c4c-42c3-9dea-ea371aee416d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f" status: 200 len: 1681 microversion: 2.1 time: 0.806551 Oct 26 13:21:01.690535 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2187/4369] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:00 2022] GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f => generated 1681 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:01.693793 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c60a7ea3-c25a-406b-bb30-94bbbb9f7f2c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:01.706323 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c60a7ea3-c25a-406b-bb30-94bbbb9f7f2c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:01.712373 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c60a7ea3-c25a-406b-bb30-94bbbb9f7f2c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:01.725261 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c60a7ea3-c25a-406b-bb30-94bbbb9f7f2c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1555 microversion: 2.91 time: 0.230845 Oct 26 13:21:01.725970 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2183/4370] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:01 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1555 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:01.843067 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-30912d86-ce56-4a7a-bf7f-7d3b523fb4ca tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:01.843685 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-30912d86-ce56-4a7a-bf7f-7d3b523fb4ca tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: 800fb374-b811-40a1-9843-8577e3a6d88a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:01.861027 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30912d86-ce56-4a7a-bf7f-7d3b523fb4ca tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:01.861571 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30912d86-ce56-4a7a-bf7f-7d3b523fb4ca tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:01.862056 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30912d86-ce56-4a7a-bf7f-7d3b523fb4ca tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:01.862805 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30912d86-ce56-4a7a-bf7f-7d3b523fb4ca tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:01.863286 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30912d86-ce56-4a7a-bf7f-7d3b523fb4ca tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:01.863794 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30912d86-ce56-4a7a-bf7f-7d3b523fb4ca tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:01.987087 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-30912d86-ce56-4a7a-bf7f-7d3b523fb4ca tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:01.999576 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-30912d86-ce56-4a7a-bf7f-7d3b523fb4ca tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/800fb374-b811-40a1-9843-8577e3a6d88a" status: 200 len: 1279 microversion: 2.1 time: 0.160720 Oct 26 13:21:02.002646 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2188/4371] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:01 2022] GET /compute/v2.1/servers/800fb374-b811-40a1-9843-8577e3a6d88a => generated 1279 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:02.419454 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c338ea46-56d5-4e7a-b44c-d7676a7357db tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:02.420811 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c338ea46-56d5-4e7a-b44c-d7676a7357db tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 97825703-89d9-457a-b6c3-b694f8eee97c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:02.440206 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c338ea46-56d5-4e7a-b44c-d7676a7357db tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:02.441285 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c338ea46-56d5-4e7a-b44c-d7676a7357db tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:02.443114 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c338ea46-56d5-4e7a-b44c-d7676a7357db tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:02.444231 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c338ea46-56d5-4e7a-b44c-d7676a7357db tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:02.445331 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c338ea46-56d5-4e7a-b44c-d7676a7357db tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:02.446041 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c338ea46-56d5-4e7a-b44c-d7676a7357db tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:02.563357 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-33d24ed9-517a-4dad-848f-ab81c036a3b6 req-68cd9fe1-6d9a-4788-8bd8-8b0cbd5bcb21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9df48e5-9204-46d5-b2a9-2154dbdcf167", "tag": "0d3accda-92e7-4a3b-a42e-1cd62bc1324a"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:21:02.586410 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-33d24ed9-517a-4dad-848f-ab81c036a3b6 req-68cd9fe1-6d9a-4788-8bd8-8b0cbd5bcb21 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:02.589221 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-33d24ed9-517a-4dad-848f-ab81c036a3b6 req-68cd9fe1-6d9a-4788-8bd8-8b0cbd5bcb21 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:02.590621 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-33d24ed9-517a-4dad-848f-ab81c036a3b6 req-68cd9fe1-6d9a-4788-8bd8-8b0cbd5bcb21 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:02.630715 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-33d24ed9-517a-4dad-848f-ab81c036a3b6 req-68cd9fe1-6d9a-4788-8bd8-8b0cbd5bcb21 service nova] Creating event network-changed:0d3accda-92e7-4a3b-a42e-1cd62bc1324a for instance f9df48e5-9204-46d5-b2a9-2154dbdcf167 on n-h1-862686-1 Oct 26 13:21:02.644567 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-33d24ed9-517a-4dad-848f-ab81c036a3b6 req-68cd9fe1-6d9a-4788-8bd8-8b0cbd5bcb21 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084826 Oct 26 13:21:02.658657 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2189/4372] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:21:02.716502 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-18ecb87c-f9cb-466f-af74-1392f4a9afbc tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:02.717654 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-18ecb87c-f9cb-466f-af74-1392f4a9afbc tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 42f50b1b-9531-43dd-bb5f-cbca3b7d306f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:02.740557 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18ecb87c-f9cb-466f-af74-1392f4a9afbc tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:02.741420 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18ecb87c-f9cb-466f-af74-1392f4a9afbc tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:02.742054 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18ecb87c-f9cb-466f-af74-1392f4a9afbc tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:02.742957 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18ecb87c-f9cb-466f-af74-1392f4a9afbc tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:02.743577 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18ecb87c-f9cb-466f-af74-1392f4a9afbc tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:02.744164 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18ecb87c-f9cb-466f-af74-1392f4a9afbc tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:02.971893 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-18ecb87c-f9cb-466f-af74-1392f4a9afbc tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:02.983927 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-18ecb87c-f9cb-466f-af74-1392f4a9afbc tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f" status: 200 len: 1613 microversion: 2.1 time: 0.272626 Oct 26 13:21:02.985141 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2190/4373] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:02 2022] GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f => generated 1613 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:21:03.004053 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4beda513-2a5f-4ad4-8815-e2c9b8c48235 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:03.007087 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4beda513-2a5f-4ad4-8815-e2c9b8c48235 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:03.022002 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4beda513-2a5f-4ad4-8815-e2c9b8c48235 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:03.022850 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4beda513-2a5f-4ad4-8815-e2c9b8c48235 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:03.026100 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4beda513-2a5f-4ad4-8815-e2c9b8c48235 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:03.027580 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4beda513-2a5f-4ad4-8815-e2c9b8c48235 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:03.028301 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4beda513-2a5f-4ad4-8815-e2c9b8c48235 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:03.029789 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4beda513-2a5f-4ad4-8815-e2c9b8c48235 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:03.232585 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=4 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:21:03.300854 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=12 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:21:03.356846 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c338ea46-56d5-4e7a-b44c-d7676a7357db tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:03.364867 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c338ea46-56d5-4e7a-b44c-d7676a7357db tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c" status: 200 len: 1510 microversion: 2.1 time: 0.953017 Oct 26 13:21:03.370149 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2184/4374] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:02 2022] GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c => generated 1510 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:03.377073 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e7965e01-b9b7-477f-ae9d-f1f3a04a9dbd tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:03.381125 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e7965e01-b9b7-477f-ae9d-f1f3a04a9dbd tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: 800fb374-b811-40a1-9843-8577e3a6d88a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:03.407874 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e7965e01-b9b7-477f-ae9d-f1f3a04a9dbd tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:03.408677 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e7965e01-b9b7-477f-ae9d-f1f3a04a9dbd tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:03.410532 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e7965e01-b9b7-477f-ae9d-f1f3a04a9dbd tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:03.413197 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4beda513-2a5f-4ad4-8815-e2c9b8c48235 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:03.415461 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e7965e01-b9b7-477f-ae9d-f1f3a04a9dbd tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:03.419746 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e7965e01-b9b7-477f-ae9d-f1f3a04a9dbd tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:03.421162 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e7965e01-b9b7-477f-ae9d-f1f3a04a9dbd tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:03.445125 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4beda513-2a5f-4ad4-8815-e2c9b8c48235 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:03.446899 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4beda513-2a5f-4ad4-8815-e2c9b8c48235 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:03.487301 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4beda513-2a5f-4ad4-8815-e2c9b8c48235 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1555 microversion: 2.91 time: 0.500757 Oct 26 13:21:03.488743 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2191/4375] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:02 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1555 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:03.977764 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e7965e01-b9b7-477f-ae9d-f1f3a04a9dbd tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:03.990624 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e7965e01-b9b7-477f-ae9d-f1f3a04a9dbd tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/800fb374-b811-40a1-9843-8577e3a6d88a" status: 200 len: 1321 microversion: 2.1 time: 0.617867 Oct 26 13:21:03.996844 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2185/4376] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:03 2022] GET /compute/v2.1/servers/800fb374-b811-40a1-9843-8577e3a6d88a => generated 1321 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:04.044028 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bf31a080-dc25-4062-a086-92da30d7984d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:04.046482 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bf31a080-dc25-4062-a086-92da30d7984d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 42f50b1b-9531-43dd-bb5f-cbca3b7d306f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:04.068548 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf31a080-dc25-4062-a086-92da30d7984d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:04.076224 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf31a080-dc25-4062-a086-92da30d7984d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:04.077612 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf31a080-dc25-4062-a086-92da30d7984d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:04.079624 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf31a080-dc25-4062-a086-92da30d7984d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:04.086227 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf31a080-dc25-4062-a086-92da30d7984d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:04.086957 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf31a080-dc25-4062-a086-92da30d7984d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:04.330749 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-23673bcc-b517-4df7-ab9a-1b8e31e9e21f tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1243950608", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": "none"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:21:04.370668 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bf31a080-dc25-4062-a086-92da30d7984d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c83cd1b014f82945f4915e3ece079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174da5e5c60449b7a04e9cf2aa3b9fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:04.385034 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bf31a080-dc25-4062-a086-92da30d7984d tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f" status: 200 len: 1613 microversion: 2.1 time: 0.364314 Oct 26 13:21:04.386200 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2186/4377] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:04 2022] GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f => generated 1613 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:04.448622 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9dd62d19-f5af-44fc-bed4-483e7199b9ce tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:04.451846 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9dd62d19-f5af-44fc-bed4-483e7199b9ce tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 97825703-89d9-457a-b6c3-b694f8eee97c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:04.470333 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9dd62d19-f5af-44fc-bed4-483e7199b9ce tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:04.473322 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9dd62d19-f5af-44fc-bed4-483e7199b9ce tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:04.473832 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9dd62d19-f5af-44fc-bed4-483e7199b9ce tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:04.475797 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9dd62d19-f5af-44fc-bed4-483e7199b9ce tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:04.476282 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9dd62d19-f5af-44fc-bed4-483e7199b9ce tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:04.478137 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-23673bcc-b517-4df7-ab9a-1b8e31e9e21f tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:21:04.479146 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-23673bcc-b517-4df7-ab9a-1b8e31e9e21f tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:21:04.479349 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9dd62d19-f5af-44fc-bed4-483e7199b9ce tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:04.482799 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-23673bcc-b517-4df7-ab9a-1b8e31e9e21f tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:21:04.486481 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-23673bcc-b517-4df7-ab9a-1b8e31e9e21f tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:21:04.487728 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-23673bcc-b517-4df7-ab9a-1b8e31e9e21f tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:21:04.542179 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-23673bcc-b517-4df7-ab9a-1b8e31e9e21f tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:04.545977 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-23673bcc-b517-4df7-ab9a-1b8e31e9e21f tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:04.549199 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-23673bcc-b517-4df7-ab9a-1b8e31e9e21f tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:04.550298 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-23673bcc-b517-4df7-ab9a-1b8e31e9e21f tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:04.554305 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-23673bcc-b517-4df7-ab9a-1b8e31e9e21f tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:04.556750 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-23673bcc-b517-4df7-ab9a-1b8e31e9e21f tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:04.642828 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-23673bcc-b517-4df7-ab9a-1b8e31e9e21f tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Getting quotas for project 9a378a658347414fbea6f4c90e31cc16. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:21:04.655598 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-23673bcc-b517-4df7-ab9a-1b8e31e9e21f tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Getting quotas for user 73a9c409bb7448af896f57aaa7a7eed4 and project 9a378a658347414fbea6f4c90e31cc16. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:21:04.673838 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-23673bcc-b517-4df7-ab9a-1b8e31e9e21f tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:21:04.676928 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-23673bcc-b517-4df7-ab9a-1b8e31e9e21f tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 999489d9-f069-461b-b5ad-6134e156ccc9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:21:04.744378 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:21:04.881319 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-23673bcc-b517-4df7-ab9a-1b8e31e9e21f tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.927099 Oct 26 13:21:04.886897 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2192/4378] 10.222.0.40 () {62 vars in 1188 bytes} [Wed Oct 26 13:21:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 942 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 26 13:21:04.901774 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-ff46ba9a-b747-4dbb-9c3f-7f214e336642 req-c8370cd2-e3b2-4586-9f14-42b94d4f1063 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42f50b1b-9531-43dd-bb5f-cbca3b7d306f", "name": "network-vif-deleted", "tag": "50a0dadf-b074-4b74-ba98-54c14d6828bb"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:21:05.001876 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ff46ba9a-b747-4dbb-9c3f-7f214e336642 req-c8370cd2-e3b2-4586-9f14-42b94d4f1063 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:05.002340 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ff46ba9a-b747-4dbb-9c3f-7f214e336642 req-c8370cd2-e3b2-4586-9f14-42b94d4f1063 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:05.009850 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ff46ba9a-b747-4dbb-9c3f-7f214e336642 req-c8370cd2-e3b2-4586-9f14-42b94d4f1063 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:05.050512 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-ff46ba9a-b747-4dbb-9c3f-7f214e336642 req-c8370cd2-e3b2-4586-9f14-42b94d4f1063 service nova] Creating event network-vif-deleted:50a0dadf-b074-4b74-ba98-54c14d6828bb for instance 42f50b1b-9531-43dd-bb5f-cbca3b7d306f on n-h2-862686-1 Oct 26 13:21:05.090606 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-ff46ba9a-b747-4dbb-9c3f-7f214e336642 req-c8370cd2-e3b2-4586-9f14-42b94d4f1063 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.200902 Oct 26 13:21:05.091727 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2193/4379] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:21:05.400039 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=8 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:21:05.524718 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9dd62d19-f5af-44fc-bed4-483e7199b9ce tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:05.548126 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9dd62d19-f5af-44fc-bed4-483e7199b9ce tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c" status: 200 len: 1510 microversion: 2.1 time: 1.154129 Oct 26 13:21:05.551734 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2187/4380] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:04 2022] GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c => generated 1510 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:05.557325 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-aa01b9ff-f89a-4951-b7c4-2a959d5366f8 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:05.558163 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-aa01b9ff-f89a-4951-b7c4-2a959d5366f8 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:05.573188 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aa01b9ff-f89a-4951-b7c4-2a959d5366f8 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:05.586031 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aa01b9ff-f89a-4951-b7c4-2a959d5366f8 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:05.586537 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aa01b9ff-f89a-4951-b7c4-2a959d5366f8 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:05.587463 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aa01b9ff-f89a-4951-b7c4-2a959d5366f8 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:05.588010 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aa01b9ff-f89a-4951-b7c4-2a959d5366f8 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:05.588476 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aa01b9ff-f89a-4951-b7c4-2a959d5366f8 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:05.686941 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-11d5029e-225a-4e21-949a-6916e9257630 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:05.687661 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-11d5029e-225a-4e21-949a-6916e9257630 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:05.719790 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11d5029e-225a-4e21-949a-6916e9257630 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:05.727161 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11d5029e-225a-4e21-949a-6916e9257630 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:05.734830 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11d5029e-225a-4e21-949a-6916e9257630 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:05.736360 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11d5029e-225a-4e21-949a-6916e9257630 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:05.737565 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11d5029e-225a-4e21-949a-6916e9257630 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:05.738543 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11d5029e-225a-4e21-949a-6916e9257630 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:05.828425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-11d5029e-225a-4e21-949a-6916e9257630 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:21:05.833391 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-aa01b9ff-f89a-4951-b7c4-2a959d5366f8 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:05.853398 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-aa01b9ff-f89a-4951-b7c4-2a959d5366f8 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:05.878551 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-aa01b9ff-f89a-4951-b7c4-2a959d5366f8 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:05.886745 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-aa01b9ff-f89a-4951-b7c4-2a959d5366f8 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1555 microversion: 2.91 time: 0.332957 Oct 26 13:21:05.902029 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2188/4381] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:05 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1555 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:05.908326 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1a32557e-ad53-4b59-8a3f-2cea0efd67b7 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:05.909257 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1a32557e-ad53-4b59-8a3f-2cea0efd67b7 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 999489d9-f069-461b-b5ad-6134e156ccc9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:06.036644 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:21:06.112212 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-11d5029e-225a-4e21-949a-6916e9257630 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "DELETE /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 204 len: 0 microversion: 2.32 time: 1.018595 Oct 26 13:21:06.118553 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2194/4382] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 26 13:21:05 2022] DELETE /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 0 bytes in 1026 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 13:21:06.137162 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9d213329-eb95-4d76-88e1-fd039e6bac6c tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:06.144879 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9d213329-eb95-4d76-88e1-fd039e6bac6c tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: 800fb374-b811-40a1-9843-8577e3a6d88a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:06.184140 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d213329-eb95-4d76-88e1-fd039e6bac6c tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:06.187229 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d213329-eb95-4d76-88e1-fd039e6bac6c tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:06.188788 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d213329-eb95-4d76-88e1-fd039e6bac6c tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:06.192720 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d213329-eb95-4d76-88e1-fd039e6bac6c tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:06.196740 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d213329-eb95-4d76-88e1-fd039e6bac6c tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:06.201784 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d213329-eb95-4d76-88e1-fd039e6bac6c tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:06.206992 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1a32557e-ad53-4b59-8a3f-2cea0efd67b7 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:06.222471 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1a32557e-ad53-4b59-8a3f-2cea0efd67b7 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:06.224854 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1a32557e-ad53-4b59-8a3f-2cea0efd67b7 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:06.226270 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1a32557e-ad53-4b59-8a3f-2cea0efd67b7 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "GET /compute/v2.1/servers/999489d9-f069-461b-b5ad-6134e156ccc9" status: 200 len: 1278 microversion: 2.47 time: 0.322724 Oct 26 13:21:06.227015 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2189/4383] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:05 2022] GET /compute/v2.1/servers/999489d9-f069-461b-b5ad-6134e156ccc9 => generated 1278 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:06.249817 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e21dfec7-889c-44c4-8f27-4a0fe2e5dda8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:06.250715 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e21dfec7-889c-44c4-8f27-4a0fe2e5dda8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 42f50b1b-9531-43dd-bb5f-cbca3b7d306f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:06.271774 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e21dfec7-889c-44c4-8f27-4a0fe2e5dda8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:06.272733 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e21dfec7-889c-44c4-8f27-4a0fe2e5dda8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:06.273637 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e21dfec7-889c-44c4-8f27-4a0fe2e5dda8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:06.274529 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e21dfec7-889c-44c4-8f27-4a0fe2e5dda8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:06.275157 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e21dfec7-889c-44c4-8f27-4a0fe2e5dda8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:06.275741 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e21dfec7-889c-44c4-8f27-4a0fe2e5dda8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:06.316614 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-e21dfec7-889c-44c4-8f27-4a0fe2e5dda8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] HTTP exception thrown: Instance 42f50b1b-9531-43dd-bb5f-cbca3b7d306f could not be found. Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e21dfec7-889c-44c4-8f27-4a0fe2e5dda8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Request method failure captured: Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f HTTP/1.1 Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTK8yiFaYn6FsK4kYH1E6E6NSE9_hIaDskjf1tRy-XgeLhCgjcaBIDqmW8VSjfB2Cmb6DMkQzh-y_Wh40jTHlXsuv7XA0N3K6RDEzKD5nf9Z6iWWIgYAqlJtxWSsEOqwe1NAtEPEvPHN4gJ5RH5unfT6e5xSWJOJigX6JmjW0X-SjQA Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 174da5e5c60449b7a04e9cf2aa3b9fda Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-AttachVolumeNegativeTest-770748596 Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/174da5e5c60449b7a04e9cf2aa3b9fda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/174da5e5c60449b7a04e9cf2aa3b9fda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_174da5e5c60449b7a04e9cf2aa3b9fda"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/174da5e5c60449b7a04e9cf2aa3b9fda"}]}] Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-AttachVolumeNegativeTest-770748596 Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 174da5e5c60449b7a04e9cf2aa3b9fda Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-770748596 Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-AttachVolumeNegativeTest-770748596-project Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 168c83cd1b014f82945f4915e3ece079 Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-AttachVolumeNegativeTest-770748596-project Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 42f50b1b-9531-43dd-bb5f-cbca3b7d306f could not be found. Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '42f50b1b-9531-43dd-bb5f-cbca3b7d306f'} Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42f50b1b-9531-43dd-bb5f-cbca3b7d306f could not be found. Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42f50b1b-9531-43dd-bb5f-cbca3b7d306f could not be found. Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:21:06.319642 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:06.324049 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:06.324049 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:21:06.324049 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:21:06.324049 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:21:06.324049 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:21:06.324049 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42f50b1b-9531-43dd-bb5f-cbca3b7d306f could not be found. Oct 26 13:21:06.324049 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:06.334643 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e21dfec7-889c-44c4-8f27-4a0fe2e5dda8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Returning 404 to user: Instance 42f50b1b-9531-43dd-bb5f-cbca3b7d306f could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:21:06.336727 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e21dfec7-889c-44c4-8f27-4a0fe2e5dda8 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f" status: 404 len: 111 microversion: 2.1 time: 0.107348 Oct 26 13:21:06.337561 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2190/4384] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:06 2022] GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:21:06.347736 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-0359c0ce-8905-4e74-b3cb-4b1e49ae3a87 req-955d7cf5-e88d-4be7-a95d-a18b73e4a1dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7cd631a-a439-481d-ab67-f5a0c9d0ef86", "name": "network-vif-plugged", "status": "completed", "tag": "d286e014-2811-4f2e-8a1f-9f097f030fa7"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:21:06.380514 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-0359c0ce-8905-4e74-b3cb-4b1e49ae3a87 req-955d7cf5-e88d-4be7-a95d-a18b73e4a1dc service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:06.382159 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-0359c0ce-8905-4e74-b3cb-4b1e49ae3a87 req-955d7cf5-e88d-4be7-a95d-a18b73e4a1dc service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:06.385617 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-0359c0ce-8905-4e74-b3cb-4b1e49ae3a87 req-955d7cf5-e88d-4be7-a95d-a18b73e4a1dc service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:06.414805 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-0359c0ce-8905-4e74-b3cb-4b1e49ae3a87 req-955d7cf5-e88d-4be7-a95d-a18b73e4a1dc service nova] Creating event network-vif-plugged:d286e014-2811-4f2e-8a1f-9f097f030fa7 for instance d7cd631a-a439-481d-ab67-f5a0c9d0ef86 on n-h1-862686-1 Oct 26 13:21:06.431057 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-0359c0ce-8905-4e74-b3cb-4b1e49ae3a87 req-955d7cf5-e88d-4be7-a95d-a18b73e4a1dc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092342 Oct 26 13:21:06.437555 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2191/4385] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:21:06.451042 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-311163c3-eddd-45d3-984f-8a59811aece1 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:06.451950 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-311163c3-eddd-45d3-984f-8a59811aece1 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:06.470915 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-311163c3-eddd-45d3-984f-8a59811aece1 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:06.471522 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-311163c3-eddd-45d3-984f-8a59811aece1 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:06.471988 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-311163c3-eddd-45d3-984f-8a59811aece1 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:06.477225 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-311163c3-eddd-45d3-984f-8a59811aece1 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:06.479157 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-311163c3-eddd-45d3-984f-8a59811aece1 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:06.479840 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-311163c3-eddd-45d3-984f-8a59811aece1 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:06.598023 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9d213329-eb95-4d76-88e1-fd039e6bac6c tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:06.608969 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9d213329-eb95-4d76-88e1-fd039e6bac6c tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/800fb374-b811-40a1-9843-8577e3a6d88a" status: 200 len: 1321 microversion: 2.1 time: 0.481474 Oct 26 13:21:06.610008 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2195/4386] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:06 2022] GET /compute/v2.1/servers/800fb374-b811-40a1-9843-8577e3a6d88a => generated 1321 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:06.616125 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c5a1ce43-5145-4e59-8d97-33158829615a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '.version_select at 0x7f67329f1820>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:06.668076 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c5a1ce43-5145-4e59-8d97-33158829615a tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-634851606" status: 202 len: 0 microversion: 2.1 time: 0.056402 Oct 26 13:21:06.669073 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2196/4387] 10.222.0.40 () {58 vars in 1218 bytes} [Wed Oct 26 13:21:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-634851606 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:21:06.704129 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7f3fe12c-dec5-46f9-a241-69522bd8a1cf tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1072307577", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": "none"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:21:06.791144 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-7f3fe12c-dec5-46f9-a241-69522bd8a1cf tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:21:06.791582 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-7f3fe12c-dec5-46f9-a241-69522bd8a1cf tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:21:06.792259 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-7f3fe12c-dec5-46f9-a241-69522bd8a1cf tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:21:06.792721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-7f3fe12c-dec5-46f9-a241-69522bd8a1cf tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:21:06.793082 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-7f3fe12c-dec5-46f9-a241-69522bd8a1cf tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:21:06.815211 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f3fe12c-dec5-46f9-a241-69522bd8a1cf tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:06.815923 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f3fe12c-dec5-46f9-a241-69522bd8a1cf tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:06.816589 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f3fe12c-dec5-46f9-a241-69522bd8a1cf tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:06.818863 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f3fe12c-dec5-46f9-a241-69522bd8a1cf tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:06.819510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f3fe12c-dec5-46f9-a241-69522bd8a1cf tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:06.820111 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f3fe12c-dec5-46f9-a241-69522bd8a1cf tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:06.855866 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-7f3fe12c-dec5-46f9-a241-69522bd8a1cf tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Getting quotas for project 9a378a658347414fbea6f4c90e31cc16. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:21:06.879033 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-7f3fe12c-dec5-46f9-a241-69522bd8a1cf tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Getting quotas for user 73a9c409bb7448af896f57aaa7a7eed4 and project 9a378a658347414fbea6f4c90e31cc16. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:21:06.922783 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7f3fe12c-dec5-46f9-a241-69522bd8a1cf tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:21:06.926948 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7f3fe12c-dec5-46f9-a241-69522bd8a1cf tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 8ec8dff5-3985-4f1c-9d2e-ddd28d538476] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:21:06.928497 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-311163c3-eddd-45d3-984f-8a59811aece1 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:06.939620 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-311163c3-eddd-45d3-984f-8a59811aece1 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:06.948861 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-311163c3-eddd-45d3-984f-8a59811aece1 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:06.954834 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-311163c3-eddd-45d3-984f-8a59811aece1 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 2949 microversion: 2.32 time: 0.515813 Oct 26 13:21:06.955899 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2192/4388] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:06 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 2949 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:06.967667 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-54bb8c3b-3f36-40d4-970a-867f8a143975 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:06.970130 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-54bb8c3b-3f36-40d4-970a-867f8a143975 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 97825703-89d9-457a-b6c3-b694f8eee97c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:06.987253 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54bb8c3b-3f36-40d4-970a-867f8a143975 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:06.996441 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54bb8c3b-3f36-40d4-970a-867f8a143975 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:06.997289 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54bb8c3b-3f36-40d4-970a-867f8a143975 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:06.998779 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54bb8c3b-3f36-40d4-970a-867f8a143975 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:07.000870 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54bb8c3b-3f36-40d4-970a-867f8a143975 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:07.001574 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54bb8c3b-3f36-40d4-970a-867f8a143975 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:07.037697 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7f3fe12c-dec5-46f9-a241-69522bd8a1cf tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.367119 Oct 26 13:21:07.042775 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2197/4389] 10.222.0.40 () {62 vars in 1188 bytes} [Wed Oct 26 13:21:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 373 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 26 13:21:07.051300 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8184e046-19fa-40b9-bde2-55e8408a4f72 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:07.052709 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8184e046-19fa-40b9-bde2-55e8408a4f72 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:07.062147 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8184e046-19fa-40b9-bde2-55e8408a4f72 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:07.062961 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8184e046-19fa-40b9-bde2-55e8408a4f72 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:07.063567 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8184e046-19fa-40b9-bde2-55e8408a4f72 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:07.064525 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8184e046-19fa-40b9-bde2-55e8408a4f72 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:07.065285 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8184e046-19fa-40b9-bde2-55e8408a4f72 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:07.065762 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8184e046-19fa-40b9-bde2-55e8408a4f72 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:07.345278 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-54bb8c3b-3f36-40d4-970a-867f8a143975 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:07.353974 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-54bb8c3b-3f36-40d4-970a-867f8a143975 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c" status: 200 len: 1516 microversion: 2.1 time: 0.393333 Oct 26 13:21:07.369720 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2193/4390] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:06 2022] GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c => generated 1516 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:07.371371 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4e891cd4-959a-4872-900f-49144e42da0c tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:21:07.387400 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4e891cd4-959a-4872-900f-49144e42da0c tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 8ec8dff5-3985-4f1c-9d2e-ddd28d538476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:07.532964 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4e891cd4-959a-4872-900f-49144e42da0c tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "PUT /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476" status: 200 len: 992 microversion: 2.47 time: 0.165465 Oct 26 13:21:07.537347 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2194/4391] 10.222.0.40 () {62 vars in 1297 bytes} [Wed Oct 26 13:21:07 2022] PUT /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476 => generated 992 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:21:07.557788 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-00ff1a9d-c7ba-4b35-835a-63c22241a500 req-474f5ad5-6123-4949-b155-eb31cb8ee6b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "800fb374-b811-40a1-9843-8577e3a6d88a", "tag": "3a920a09-d5e1-4e4b-b069-8e68e06d60e1"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:21:07.596464 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-00ff1a9d-c7ba-4b35-835a-63c22241a500 req-474f5ad5-6123-4949-b155-eb31cb8ee6b1 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:07.597250 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-00ff1a9d-c7ba-4b35-835a-63c22241a500 req-474f5ad5-6123-4949-b155-eb31cb8ee6b1 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:07.606886 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-00ff1a9d-c7ba-4b35-835a-63c22241a500 req-474f5ad5-6123-4949-b155-eb31cb8ee6b1 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:07.632635 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-00ff1a9d-c7ba-4b35-835a-63c22241a500 req-474f5ad5-6123-4949-b155-eb31cb8ee6b1 service nova] Creating event network-changed:3a920a09-d5e1-4e4b-b069-8e68e06d60e1 for instance 800fb374-b811-40a1-9843-8577e3a6d88a on n-h2-862686-1 Oct 26 13:21:07.649865 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-00ff1a9d-c7ba-4b35-835a-63c22241a500 req-474f5ad5-6123-4949-b155-eb31cb8ee6b1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110862 Oct 26 13:21:07.650751 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2195/4392] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:21:07.660240 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9370a567-c4a2-4db6-bb0f-72a925fe0f87 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:07.666879 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9370a567-c4a2-4db6-bb0f-72a925fe0f87 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 8ec8dff5-3985-4f1c-9d2e-ddd28d538476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:07.839245 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9370a567-c4a2-4db6-bb0f-72a925fe0f87 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:07.849095 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9370a567-c4a2-4db6-bb0f-72a925fe0f87 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:07.850640 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9370a567-c4a2-4db6-bb0f-72a925fe0f87 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:07.851810 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9370a567-c4a2-4db6-bb0f-72a925fe0f87 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476" status: 200 len: 1278 microversion: 2.47 time: 0.195976 Oct 26 13:21:07.885912 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2196/4393] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:07 2022] GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476 => generated 1278 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:07.891757 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b139d033-0904-406f-9dce-c44108d3bc18 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:07.892420 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b139d033-0904-406f-9dce-c44108d3bc18 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: 800fb374-b811-40a1-9843-8577e3a6d88a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:07.917496 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b139d033-0904-406f-9dce-c44108d3bc18 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:07.918015 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b139d033-0904-406f-9dce-c44108d3bc18 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:07.918463 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b139d033-0904-406f-9dce-c44108d3bc18 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:07.922108 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b139d033-0904-406f-9dce-c44108d3bc18 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:07.932693 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b139d033-0904-406f-9dce-c44108d3bc18 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:07.933959 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b139d033-0904-406f-9dce-c44108d3bc18 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:08.203540 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8184e046-19fa-40b9-bde2-55e8408a4f72 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:08.206863 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:21:08.234045 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8184e046-19fa-40b9-bde2-55e8408a4f72 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:08.242225 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8184e046-19fa-40b9-bde2-55e8408a4f72 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:08.273176 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8184e046-19fa-40b9-bde2-55e8408a4f72 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1555 microversion: 2.91 time: 1.228351 Oct 26 13:21:08.290825 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2198/4394] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:07 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1555 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:08.329523 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f2b42f8e-355f-4c3b-a24b-0a7a5e507767 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:08.337664 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f2b42f8e-355f-4c3b-a24b-0a7a5e507767 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:08.406290 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f2b42f8e-355f-4c3b-a24b-0a7a5e507767 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:08.415381 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f2b42f8e-355f-4c3b-a24b-0a7a5e507767 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:08.420168 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f2b42f8e-355f-4c3b-a24b-0a7a5e507767 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:08.434539 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f2b42f8e-355f-4c3b-a24b-0a7a5e507767 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:08.435042 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f2b42f8e-355f-4c3b-a24b-0a7a5e507767 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:08.435492 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f2b42f8e-355f-4c3b-a24b-0a7a5e507767 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:09.028872 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b139d033-0904-406f-9dce-c44108d3bc18 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:09.044275 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b139d033-0904-406f-9dce-c44108d3bc18 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/800fb374-b811-40a1-9843-8577e3a6d88a" status: 200 len: 1321 microversion: 2.1 time: 1.156246 Oct 26 13:21:09.047211 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2197/4395] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:07 2022] GET /compute/v2.1/servers/800fb374-b811-40a1-9843-8577e3a6d88a => generated 1321 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:09.059275 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2d73b567-7cfa-48de-b115-7c0fec017136 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:09.064347 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2d73b567-7cfa-48de-b115-7c0fec017136 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 8ec8dff5-3985-4f1c-9d2e-ddd28d538476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:09.087865 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2d73b567-7cfa-48de-b115-7c0fec017136 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:09.090603 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2d73b567-7cfa-48de-b115-7c0fec017136 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:09.091405 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2d73b567-7cfa-48de-b115-7c0fec017136 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:09.094400 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2d73b567-7cfa-48de-b115-7c0fec017136 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:09.095125 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2d73b567-7cfa-48de-b115-7c0fec017136 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:09.097719 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2d73b567-7cfa-48de-b115-7c0fec017136 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:09.259685 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f2b42f8e-355f-4c3b-a24b-0a7a5e507767 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:09.275149 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f2b42f8e-355f-4c3b-a24b-0a7a5e507767 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:09.284062 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f2b42f8e-355f-4c3b-a24b-0a7a5e507767 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:09.286445 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f2b42f8e-355f-4c3b-a24b-0a7a5e507767 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 2949 microversion: 2.32 time: 0.993561 Oct 26 13:21:09.287260 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2199/4396] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:08 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 2949 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:09.289242 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2d73b567-7cfa-48de-b115-7c0fec017136 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:09.312065 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bc11f2a3-eecd-4410-9597-b2cced644975 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:09.313525 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bc11f2a3-eecd-4410-9597-b2cced644975 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:09.318906 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2d73b567-7cfa-48de-b115-7c0fec017136 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:09.321368 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2d73b567-7cfa-48de-b115-7c0fec017136 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:09.322851 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2d73b567-7cfa-48de-b115-7c0fec017136 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476" status: 200 len: 1330 microversion: 2.47 time: 0.273716 Oct 26 13:21:09.323742 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2198/4397] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:09 2022] GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476 => generated 1330 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:09.328741 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc11f2a3-eecd-4410-9597-b2cced644975 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:09.334739 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc11f2a3-eecd-4410-9597-b2cced644975 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:09.336957 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc11f2a3-eecd-4410-9597-b2cced644975 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:09.339079 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc11f2a3-eecd-4410-9597-b2cced644975 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:09.342262 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc11f2a3-eecd-4410-9597-b2cced644975 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:09.343198 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc11f2a3-eecd-4410-9597-b2cced644975 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:09.551600 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bc11f2a3-eecd-4410-9597-b2cced644975 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:09.569740 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bc11f2a3-eecd-4410-9597-b2cced644975 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:09.571725 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bc11f2a3-eecd-4410-9597-b2cced644975 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:09.594811 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bc11f2a3-eecd-4410-9597-b2cced644975 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1555 microversion: 2.91 time: 0.281596 Oct 26 13:21:09.595431 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2200/4398] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:09 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1555 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:21:10.077776 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-de7c5086-4e49-4d5d-bf7d-1e528138181d tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:10.081837 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-de7c5086-4e49-4d5d-bf7d-1e528138181d tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: 800fb374-b811-40a1-9843-8577e3a6d88a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:10.113271 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-de7c5086-4e49-4d5d-bf7d-1e528138181d tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:10.116526 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-de7c5086-4e49-4d5d-bf7d-1e528138181d tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:10.117619 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-de7c5086-4e49-4d5d-bf7d-1e528138181d tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:10.120076 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-de7c5086-4e49-4d5d-bf7d-1e528138181d tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:10.120777 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-de7c5086-4e49-4d5d-bf7d-1e528138181d tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:10.122050 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-de7c5086-4e49-4d5d-bf7d-1e528138181d tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:10.127940 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-24f6c34a-8278-451a-97e1-174a756e1949 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:10.132932 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-24f6c34a-8278-451a-97e1-174a756e1949 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:10.161580 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24f6c34a-8278-451a-97e1-174a756e1949 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:10.164158 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24f6c34a-8278-451a-97e1-174a756e1949 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:10.166015 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24f6c34a-8278-451a-97e1-174a756e1949 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:10.168540 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24f6c34a-8278-451a-97e1-174a756e1949 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:10.176621 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24f6c34a-8278-451a-97e1-174a756e1949 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:10.177632 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24f6c34a-8278-451a-97e1-174a756e1949 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:10.298546 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-24f6c34a-8278-451a-97e1-174a756e1949 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.170383 Oct 26 13:21:10.306250 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2201/4399] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:21:10 2022] GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c/os-volume_attachments => generated 25 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:21:10.323572 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1893f83f-cc0e-44f9-8eec-a666040ebe8d tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:10.341931 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1893f83f-cc0e-44f9-8eec-a666040ebe8d tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:10.361069 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1893f83f-cc0e-44f9-8eec-a666040ebe8d tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:10.365185 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1893f83f-cc0e-44f9-8eec-a666040ebe8d tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:10.368075 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1893f83f-cc0e-44f9-8eec-a666040ebe8d tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:10.372782 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1893f83f-cc0e-44f9-8eec-a666040ebe8d tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:10.373618 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1893f83f-cc0e-44f9-8eec-a666040ebe8d tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:10.375469 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1893f83f-cc0e-44f9-8eec-a666040ebe8d tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:10.486359 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-de7c5086-4e49-4d5d-bf7d-1e528138181d tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:10.498788 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-de7c5086-4e49-4d5d-bf7d-1e528138181d tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/800fb374-b811-40a1-9843-8577e3a6d88a" status: 200 len: 1321 microversion: 2.1 time: 0.430853 Oct 26 13:21:10.501073 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2199/4400] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:10 2022] GET /compute/v2.1/servers/800fb374-b811-40a1-9843-8577e3a6d88a => generated 1321 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:10.512717 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-67e74d32-48f2-46ff-bdae-9f1710c437bc tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:10.513735 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-67e74d32-48f2-46ff-bdae-9f1710c437bc tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 8ec8dff5-3985-4f1c-9d2e-ddd28d538476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:10.534955 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-67e74d32-48f2-46ff-bdae-9f1710c437bc tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:10.535759 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-67e74d32-48f2-46ff-bdae-9f1710c437bc tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:10.537029 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-67e74d32-48f2-46ff-bdae-9f1710c437bc tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:10.538053 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-67e74d32-48f2-46ff-bdae-9f1710c437bc tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:10.538519 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-67e74d32-48f2-46ff-bdae-9f1710c437bc tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:10.538985 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-67e74d32-48f2-46ff-bdae-9f1710c437bc tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:10.681712 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-67e74d32-48f2-46ff-bdae-9f1710c437bc tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:10.702457 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-67e74d32-48f2-46ff-bdae-9f1710c437bc tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:10.705288 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-67e74d32-48f2-46ff-bdae-9f1710c437bc tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:10.709634 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-67e74d32-48f2-46ff-bdae-9f1710c437bc tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476" status: 200 len: 1330 microversion: 2.47 time: 0.206498 Oct 26 13:21:10.714878 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2200/4401] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:10 2022] GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476 => generated 1330 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:10.730583 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-51a8fabc-ad0d-42fc-a7ae-163aa705e6f8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Action: 'create', calling method: .version_select at 0x7f6732237af0>, body: {"keypair": {"name": "tempest-keypair-442852260", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVyRaK6lLeV6njEHXOwVMN243tw072k+f6lmb4FTqCf0axuTgXw2DaFNvBZHN9zyzQ9gDGIJGMEvFpzuQ0vMPI3umC8/095kqhMZ7PzEwqc37JKahCM6KfqZl8/i38cfA=="}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:21:10.781112 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-51a8fabc-ad0d-42fc-a7ae-163aa705e6f8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Getting quotas for project 9cdd45be745d4828b5a111472254156c. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:21:10.795219 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-51a8fabc-ad0d-42fc-a7ae-163aa705e6f8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Getting quotas for user 363fc117da70484f9d8cf2040e8391e4 and project 9cdd45be745d4828b5a111472254156c. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:21:11.022292 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-51a8fabc-ad0d-42fc-a7ae-163aa705e6f8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.305471 Oct 26 13:21:11.023475 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2201/4402] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 13:21:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:21:11.073830 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-b2cc7134-6878-4a1c-969a-fa8e4d14c7e7 req-0cab02e9-1601-41f8-b2b4-0beb182aff15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9df48e5-9204-46d5-b2a9-2154dbdcf167", "name": "network-vif-plugged", "status": "completed", "tag": "0d3accda-92e7-4a3b-a42e-1cd62bc1324a"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:21:11.156649 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-b2cc7134-6878-4a1c-969a-fa8e4d14c7e7 req-0cab02e9-1601-41f8-b2b4-0beb182aff15 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:11.157904 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-b2cc7134-6878-4a1c-969a-fa8e4d14c7e7 req-0cab02e9-1601-41f8-b2b4-0beb182aff15 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:11.158487 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-b2cc7134-6878-4a1c-969a-fa8e4d14c7e7 req-0cab02e9-1601-41f8-b2b4-0beb182aff15 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:11.183463 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-b2cc7134-6878-4a1c-969a-fa8e4d14c7e7 req-0cab02e9-1601-41f8-b2b4-0beb182aff15 service nova] Creating event network-vif-plugged:0d3accda-92e7-4a3b-a42e-1cd62bc1324a for instance f9df48e5-9204-46d5-b2a9-2154dbdcf167 on n-h1-862686-1 Oct 26 13:21:11.187469 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1893f83f-cc0e-44f9-8eec-a666040ebe8d tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:11.209720 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1893f83f-cc0e-44f9-8eec-a666040ebe8d tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:11.211853 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-b2cc7134-6878-4a1c-969a-fa8e4d14c7e7 req-0cab02e9-1601-41f8-b2b4-0beb182aff15 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185396 Oct 26 13:21:11.212924 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2202/4403] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:21:11.215467 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1893f83f-cc0e-44f9-8eec-a666040ebe8d tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:11.221299 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e21254fa-ec1a-4735-b577-5755bcf89519 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:11.223389 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1893f83f-cc0e-44f9-8eec-a666040ebe8d tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 2949 microversion: 2.32 time: 0.903726 Oct 26 13:21:11.231358 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2202/4404] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:10 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 2949 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:11.241004 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e21254fa-ec1a-4735-b577-5755bcf89519 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:11.245006 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6145fe2e-0c23-4d6c-9bca-af5ff8f1ebbd tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:11.245849 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6145fe2e-0c23-4d6c-9bca-af5ff8f1ebbd tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:11.263171 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e21254fa-ec1a-4735-b577-5755bcf89519 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:11.266256 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e21254fa-ec1a-4735-b577-5755bcf89519 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:11.266513 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6145fe2e-0c23-4d6c-9bca-af5ff8f1ebbd tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:11.267292 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e21254fa-ec1a-4735-b577-5755bcf89519 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:11.268248 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e21254fa-ec1a-4735-b577-5755bcf89519 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:11.269003 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6145fe2e-0c23-4d6c-9bca-af5ff8f1ebbd tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:11.269460 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6145fe2e-0c23-4d6c-9bca-af5ff8f1ebbd tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:11.273894 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6145fe2e-0c23-4d6c-9bca-af5ff8f1ebbd tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:11.273894 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6145fe2e-0c23-4d6c-9bca-af5ff8f1ebbd tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:11.276409 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e21254fa-ec1a-4735-b577-5755bcf89519 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:11.277383 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e21254fa-ec1a-4735-b577-5755bcf89519 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:11.279129 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6145fe2e-0c23-4d6c-9bca-af5ff8f1ebbd tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:11.307240 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e21254fa-ec1a-4735-b577-5755bcf89519 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:21:11.487456 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e21254fa-ec1a-4735-b577-5755bcf89519 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c" status: 204 len: 0 microversion: 2.1 time: 0.266272 Oct 26 13:21:11.496082 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2203/4405] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:21:11 2022] DELETE /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:21:11.510071 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6145fe2e-0c23-4d6c-9bca-af5ff8f1ebbd tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:11.528461 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6145fe2e-0c23-4d6c-9bca-af5ff8f1ebbd tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:11.531630 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-350bc8eb-5216-465b-b075-c6ceb773a600 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:11.539453 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-350bc8eb-5216-465b-b075-c6ceb773a600 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:11.541421 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6145fe2e-0c23-4d6c-9bca-af5ff8f1ebbd tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:11.573365 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-350bc8eb-5216-465b-b075-c6ceb773a600 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:11.573632 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6145fe2e-0c23-4d6c-9bca-af5ff8f1ebbd tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1555 microversion: 2.91 time: 0.337563 Oct 26 13:21:11.574961 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-350bc8eb-5216-465b-b075-c6ceb773a600 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:11.575425 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-350bc8eb-5216-465b-b075-c6ceb773a600 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:11.576367 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2203/4406] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:11 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1555 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:11.582441 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-350bc8eb-5216-465b-b075-c6ceb773a600 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:11.583186 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-350bc8eb-5216-465b-b075-c6ceb773a600 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:11.585270 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-350bc8eb-5216-465b-b075-c6ceb773a600 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:11.598597 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1959887b-ebb2-4031-aefb-48c84d716d1f tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:11.599666 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1959887b-ebb2-4031-aefb-48c84d716d1f tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: 800fb374-b811-40a1-9843-8577e3a6d88a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:11.612624 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:21:11.628518 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1959887b-ebb2-4031-aefb-48c84d716d1f tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:11.630650 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1959887b-ebb2-4031-aefb-48c84d716d1f tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:11.632908 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1959887b-ebb2-4031-aefb-48c84d716d1f tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:11.635307 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1959887b-ebb2-4031-aefb-48c84d716d1f tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:11.637376 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1959887b-ebb2-4031-aefb-48c84d716d1f tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:11.640171 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1959887b-ebb2-4031-aefb-48c84d716d1f tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:12.292209 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-350bc8eb-5216-465b-b075-c6ceb773a600 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:12.314087 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-350bc8eb-5216-465b-b075-c6ceb773a600 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c" status: 200 len: 1673 microversion: 2.1 time: 0.814950 Oct 26 13:21:12.315447 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2204/4407] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:11 2022] GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c => generated 1673 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:12.321230 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dd735718-feec-45eb-9fbf-016e723489f0 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:12.322232 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-dd735718-feec-45eb-9fbf-016e723489f0 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 8ec8dff5-3985-4f1c-9d2e-ddd28d538476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:12.329986 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd735718-feec-45eb-9fbf-016e723489f0 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:12.331021 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd735718-feec-45eb-9fbf-016e723489f0 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:12.331672 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd735718-feec-45eb-9fbf-016e723489f0 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:12.333643 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd735718-feec-45eb-9fbf-016e723489f0 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:12.334413 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd735718-feec-45eb-9fbf-016e723489f0 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:12.335115 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd735718-feec-45eb-9fbf-016e723489f0 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:12.455416 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1959887b-ebb2-4031-aefb-48c84d716d1f tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:12.478508 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1959887b-ebb2-4031-aefb-48c84d716d1f tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/800fb374-b811-40a1-9843-8577e3a6d88a" status: 200 len: 1321 microversion: 2.1 time: 0.900768 Oct 26 13:21:12.499748 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2204/4408] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:11 2022] GET /compute/v2.1/servers/800fb374-b811-40a1-9843-8577e3a6d88a => generated 1321 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:12.508439 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3b692884-1d25-49be-9e80-19e25d98a416 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:12.511141 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3b692884-1d25-49be-9e80-19e25d98a416 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:12.533709 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b692884-1d25-49be-9e80-19e25d98a416 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:12.535390 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b692884-1d25-49be-9e80-19e25d98a416 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:12.536177 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b692884-1d25-49be-9e80-19e25d98a416 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:12.538948 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b692884-1d25-49be-9e80-19e25d98a416 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:12.539724 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b692884-1d25-49be-9e80-19e25d98a416 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:12.540663 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b692884-1d25-49be-9e80-19e25d98a416 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:12.687496 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-dd735718-feec-45eb-9fbf-016e723489f0 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:12.701935 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-dd735718-feec-45eb-9fbf-016e723489f0 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:12.713682 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-dd735718-feec-45eb-9fbf-016e723489f0 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:12.715194 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-dd735718-feec-45eb-9fbf-016e723489f0 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476" status: 200 len: 1336 microversion: 2.47 time: 0.398529 Oct 26 13:21:12.720459 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2205/4409] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:12 2022] GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476 => generated 1336 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:12.761160 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-678411e3-f241-4f4a-95c5-04f916bdc58e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:12.762342 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-678411e3-f241-4f4a-95c5-04f916bdc58e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:12.795368 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-678411e3-f241-4f4a-95c5-04f916bdc58e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:12.799361 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-678411e3-f241-4f4a-95c5-04f916bdc58e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:12.824315 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-678411e3-f241-4f4a-95c5-04f916bdc58e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:12.829543 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-678411e3-f241-4f4a-95c5-04f916bdc58e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:12.830946 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-678411e3-f241-4f4a-95c5-04f916bdc58e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:12.831410 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-678411e3-f241-4f4a-95c5-04f916bdc58e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:12.911126 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3b692884-1d25-49be-9e80-19e25d98a416 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:12.927464 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3b692884-1d25-49be-9e80-19e25d98a416 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:12.943629 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3b692884-1d25-49be-9e80-19e25d98a416 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:12.946506 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3b692884-1d25-49be-9e80-19e25d98a416 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 2949 microversion: 2.32 time: 0.445597 Oct 26 13:21:12.951337 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2205/4410] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:12 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 2949 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:13.038873 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-678411e3-f241-4f4a-95c5-04f916bdc58e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:13.058909 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-678411e3-f241-4f4a-95c5-04f916bdc58e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:13.079992 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-678411e3-f241-4f4a-95c5-04f916bdc58e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:13.095256 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-678411e3-f241-4f4a-95c5-04f916bdc58e tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1555 microversion: 2.91 time: 0.372038 Oct 26 13:21:13.099591 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2206/4411] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:12 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1555 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:13.253598 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-7e96aec3-0116-49a8-b24d-c18c0580a96b req-cb53732c-be6a-4de0-b828-da73faee3954 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "893420b7-27d9-4240-8182-87dd3231cbe2", "name": "network-vif-unplugged", "status": "completed", "tag": "5767d9fc-18c2-418f-b31e-29c55d94a15e"}, {"server_uuid": "893420b7-27d9-4240-8182-87dd3231cbe2", "name": "network-vif-unplugged", "status": "completed", "tag": "ba719c25-4dde-4810-8e01-3a65db1889d6"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:21:13.281275 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-7e96aec3-0116-49a8-b24d-c18c0580a96b req-cb53732c-be6a-4de0-b828-da73faee3954 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:13.281980 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-7e96aec3-0116-49a8-b24d-c18c0580a96b req-cb53732c-be6a-4de0-b828-da73faee3954 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:13.282521 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-7e96aec3-0116-49a8-b24d-c18c0580a96b req-cb53732c-be6a-4de0-b828-da73faee3954 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:13.345181 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-37380a3f-e1bc-4ba7-b2db-0149e184a170 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:13.345674 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-7e96aec3-0116-49a8-b24d-c18c0580a96b req-cb53732c-be6a-4de0-b828-da73faee3954 service nova] Creating event network-vif-unplugged:5767d9fc-18c2-418f-b31e-29c55d94a15e for instance 893420b7-27d9-4240-8182-87dd3231cbe2 on n-h1-862686-1 Oct 26 13:21:13.346375 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-7e96aec3-0116-49a8-b24d-c18c0580a96b req-cb53732c-be6a-4de0-b828-da73faee3954 service nova] Creating event network-vif-unplugged:ba719c25-4dde-4810-8e01-3a65db1889d6 for instance 893420b7-27d9-4240-8182-87dd3231cbe2 on n-h1-862686-1 Oct 26 13:21:13.350937 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-37380a3f-e1bc-4ba7-b2db-0149e184a170 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:13.359176 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:21:13.364617 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-7e96aec3-0116-49a8-b24d-c18c0580a96b req-cb53732c-be6a-4de0-b828-da73faee3954 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.115230 Oct 26 13:21:13.367654 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2206/4412] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:21:13.374229 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37380a3f-e1bc-4ba7-b2db-0149e184a170 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:13.380643 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37380a3f-e1bc-4ba7-b2db-0149e184a170 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:13.383826 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37380a3f-e1bc-4ba7-b2db-0149e184a170 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:13.384626 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37380a3f-e1bc-4ba7-b2db-0149e184a170 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:13.385115 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37380a3f-e1bc-4ba7-b2db-0149e184a170 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:13.386802 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37380a3f-e1bc-4ba7-b2db-0149e184a170 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:13.508541 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f6f6df0f-7cc6-4e34-a930-2a44d6c5e01f tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:13.510973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f6f6df0f-7cc6-4e34-a930-2a44d6c5e01f tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: 800fb374-b811-40a1-9843-8577e3a6d88a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:13.522759 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6f6df0f-7cc6-4e34-a930-2a44d6c5e01f tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:13.523622 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6f6df0f-7cc6-4e34-a930-2a44d6c5e01f tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:13.523941 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6f6df0f-7cc6-4e34-a930-2a44d6c5e01f tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:13.526979 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6f6df0f-7cc6-4e34-a930-2a44d6c5e01f tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:13.527882 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6f6df0f-7cc6-4e34-a930-2a44d6c5e01f tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:13.528325 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6f6df0f-7cc6-4e34-a930-2a44d6c5e01f tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:13.850686 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f6f6df0f-7cc6-4e34-a930-2a44d6c5e01f tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:13.861843 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f6f6df0f-7cc6-4e34-a930-2a44d6c5e01f tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/800fb374-b811-40a1-9843-8577e3a6d88a" status: 200 len: 1321 microversion: 2.1 time: 0.358523 Oct 26 13:21:13.865319 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2207/4413] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:13 2022] GET /compute/v2.1/servers/800fb374-b811-40a1-9843-8577e3a6d88a => generated 1321 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:21:13.893413 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2e9b0168-b093-485e-b141-00f70a8f8a03 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:13.899643 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2e9b0168-b093-485e-b141-00f70a8f8a03 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 8ec8dff5-3985-4f1c-9d2e-ddd28d538476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:13.936861 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e9b0168-b093-485e-b141-00f70a8f8a03 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:13.937528 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e9b0168-b093-485e-b141-00f70a8f8a03 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:13.940197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-37380a3f-e1bc-4ba7-b2db-0149e184a170 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:13.940759 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e9b0168-b093-485e-b141-00f70a8f8a03 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:13.941724 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e9b0168-b093-485e-b141-00f70a8f8a03 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:13.949401 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e9b0168-b093-485e-b141-00f70a8f8a03 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:13.952284 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-37380a3f-e1bc-4ba7-b2db-0149e184a170 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c" status: 200 len: 1673 microversion: 2.1 time: 0.610289 Oct 26 13:21:13.952434 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e9b0168-b093-485e-b141-00f70a8f8a03 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:13.954887 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2207/4414] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:13 2022] GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c => generated 1673 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:13.981107 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-efee885f-969d-4342-a956-a8b50ab17e94 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:13.981720 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-efee885f-969d-4342-a956-a8b50ab17e94 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:14.008396 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-efee885f-969d-4342-a956-a8b50ab17e94 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:14.008894 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-efee885f-969d-4342-a956-a8b50ab17e94 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:14.009344 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-efee885f-969d-4342-a956-a8b50ab17e94 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:14.026392 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-efee885f-969d-4342-a956-a8b50ab17e94 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:14.027219 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-efee885f-969d-4342-a956-a8b50ab17e94 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:14.027332 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-efee885f-969d-4342-a956-a8b50ab17e94 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:14.258821 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2e9b0168-b093-485e-b141-00f70a8f8a03 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:14.292983 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2e9b0168-b093-485e-b141-00f70a8f8a03 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:14.294704 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2e9b0168-b093-485e-b141-00f70a8f8a03 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:14.299020 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2e9b0168-b093-485e-b141-00f70a8f8a03 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476" status: 200 len: 1336 microversion: 2.47 time: 0.413886 Oct 26 13:21:14.317461 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2208/4415] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:13 2022] GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476 => generated 1336 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:14.326118 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9a84bde3-06b7-40fd-8d91-327121295c31 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:14.329265 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9a84bde3-06b7-40fd-8d91-327121295c31 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:14.344146 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a84bde3-06b7-40fd-8d91-327121295c31 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:14.345107 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a84bde3-06b7-40fd-8d91-327121295c31 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:14.359563 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a84bde3-06b7-40fd-8d91-327121295c31 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:14.367132 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a84bde3-06b7-40fd-8d91-327121295c31 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:14.370882 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a84bde3-06b7-40fd-8d91-327121295c31 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:14.371675 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a84bde3-06b7-40fd-8d91-327121295c31 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:14.555367 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9a84bde3-06b7-40fd-8d91-327121295c31 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:14.604291 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9a84bde3-06b7-40fd-8d91-327121295c31 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:14.612098 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9a84bde3-06b7-40fd-8d91-327121295c31 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:14.648927 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9a84bde3-06b7-40fd-8d91-327121295c31 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1555 microversion: 2.91 time: 0.335837 Oct 26 13:21:14.654039 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2209/4416] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:14 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1555 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:14.891873 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6dc20056-404e-46ae-9bc3-8b461a0ead1a tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:14.892763 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6dc20056-404e-46ae-9bc3-8b461a0ead1a tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: 800fb374-b811-40a1-9843-8577e3a6d88a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:14.906295 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6dc20056-404e-46ae-9bc3-8b461a0ead1a tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:14.907080 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6dc20056-404e-46ae-9bc3-8b461a0ead1a tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:14.907687 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6dc20056-404e-46ae-9bc3-8b461a0ead1a tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:14.908665 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6dc20056-404e-46ae-9bc3-8b461a0ead1a tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:14.922279 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6dc20056-404e-46ae-9bc3-8b461a0ead1a tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:14.927308 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6dc20056-404e-46ae-9bc3-8b461a0ead1a tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:15.408302 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6dc20056-404e-46ae-9bc3-8b461a0ead1a tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:15.418658 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6dc20056-404e-46ae-9bc3-8b461a0ead1a tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/800fb374-b811-40a1-9843-8577e3a6d88a" status: 200 len: 1321 microversion: 2.1 time: 0.530977 Oct 26 13:21:15.430624 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2210/4417] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:14 2022] GET /compute/v2.1/servers/800fb374-b811-40a1-9843-8577e3a6d88a => generated 1321 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:21:15.435602 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2b5edff4-3229-4b25-897b-a998eab8a978 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:15.436210 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2b5edff4-3229-4b25-897b-a998eab8a978 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:15.438022 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-efee885f-969d-4342-a956-a8b50ab17e94 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:15.453869 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-efee885f-969d-4342-a956-a8b50ab17e94 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:15.460400 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-efee885f-969d-4342-a956-a8b50ab17e94 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:15.464146 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-efee885f-969d-4342-a956-a8b50ab17e94 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 2928 microversion: 2.32 time: 1.487885 Oct 26 13:21:15.465818 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2208/4418] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:13 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 2928 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:15.470881 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ed8eb368-cda5-4582-9df9-6673dc31bc20 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:15.471688 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ed8eb368-cda5-4582-9df9-6673dc31bc20 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 8ec8dff5-3985-4f1c-9d2e-ddd28d538476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:15.479190 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed8eb368-cda5-4582-9df9-6673dc31bc20 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:15.479538 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2b5edff4-3229-4b25-897b-a998eab8a978 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:15.480045 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2b5edff4-3229-4b25-897b-a998eab8a978 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:15.480293 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed8eb368-cda5-4582-9df9-6673dc31bc20 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:15.480484 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2b5edff4-3229-4b25-897b-a998eab8a978 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:15.481046 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed8eb368-cda5-4582-9df9-6673dc31bc20 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:15.481175 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2b5edff4-3229-4b25-897b-a998eab8a978 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:15.482049 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed8eb368-cda5-4582-9df9-6673dc31bc20 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:15.482661 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed8eb368-cda5-4582-9df9-6673dc31bc20 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:15.483255 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed8eb368-cda5-4582-9df9-6673dc31bc20 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:15.498746 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2b5edff4-3229-4b25-897b-a998eab8a978 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:15.499588 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2b5edff4-3229-4b25-897b-a998eab8a978 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:15.608158 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ed8eb368-cda5-4582-9df9-6673dc31bc20 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:15.631186 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ed8eb368-cda5-4582-9df9-6673dc31bc20 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:15.636925 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ed8eb368-cda5-4582-9df9-6673dc31bc20 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:15.641269 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ed8eb368-cda5-4582-9df9-6673dc31bc20 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476" status: 200 len: 1357 microversion: 2.47 time: 0.171798 Oct 26 13:21:15.643085 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2209/4419] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:15 2022] GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476 => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:15.651873 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-ebaa3828-627b-4ddc-9258-861ba7eb1e8f req-5ad62ad0-3b4c-48aa-a2e3-9b148dc3192a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "893420b7-27d9-4240-8182-87dd3231cbe2", "name": "network-vif-unplugged", "status": "completed", "tag": "01969fd5-4e79-4f2e-9b74-9329ffa7cebd"}, {"server_uuid": "800fb374-b811-40a1-9843-8577e3a6d88a", "name": "network-vif-plugged", "status": "completed", "tag": "3a920a09-d5e1-4e4b-b069-8e68e06d60e1"}, {"server_uuid": "893420b7-27d9-4240-8182-87dd3231cbe2", "name": "network-vif-unplugged", "status": "completed", "tag": "fdc12d04-26b7-4153-91a7-171ed0f8798d"}, {"server_uuid": "893420b7-27d9-4240-8182-87dd3231cbe2", "name": "network-vif-unplugged", "status": "completed", "tag": "4f406596-ab15-464c-88f4-1a3c9b70369c"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:21:15.679934 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ebaa3828-627b-4ddc-9258-861ba7eb1e8f req-5ad62ad0-3b4c-48aa-a2e3-9b148dc3192a service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:15.680657 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ebaa3828-627b-4ddc-9258-861ba7eb1e8f req-5ad62ad0-3b4c-48aa-a2e3-9b148dc3192a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:15.681426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ebaa3828-627b-4ddc-9258-861ba7eb1e8f req-5ad62ad0-3b4c-48aa-a2e3-9b148dc3192a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:15.714931 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-ebaa3828-627b-4ddc-9258-861ba7eb1e8f req-5ad62ad0-3b4c-48aa-a2e3-9b148dc3192a service nova] Creating event network-vif-unplugged:01969fd5-4e79-4f2e-9b74-9329ffa7cebd for instance 893420b7-27d9-4240-8182-87dd3231cbe2 on n-h1-862686-1 Oct 26 13:21:15.718724 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-ebaa3828-627b-4ddc-9258-861ba7eb1e8f req-5ad62ad0-3b4c-48aa-a2e3-9b148dc3192a service nova] Creating event network-vif-plugged:3a920a09-d5e1-4e4b-b069-8e68e06d60e1 for instance 800fb374-b811-40a1-9843-8577e3a6d88a on n-h2-862686-1 Oct 26 13:21:15.721811 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-ebaa3828-627b-4ddc-9258-861ba7eb1e8f req-5ad62ad0-3b4c-48aa-a2e3-9b148dc3192a service nova] Creating event network-vif-unplugged:fdc12d04-26b7-4153-91a7-171ed0f8798d for instance 893420b7-27d9-4240-8182-87dd3231cbe2 on n-h1-862686-1 Oct 26 13:21:15.723127 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-ebaa3828-627b-4ddc-9258-861ba7eb1e8f req-5ad62ad0-3b4c-48aa-a2e3-9b148dc3192a service nova] Creating event network-vif-unplugged:4f406596-ab15-464c-88f4-1a3c9b70369c for instance 893420b7-27d9-4240-8182-87dd3231cbe2 on n-h1-862686-1 Oct 26 13:21:15.747075 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-ebaa3828-627b-4ddc-9258-861ba7eb1e8f req-5ad62ad0-3b4c-48aa-a2e3-9b148dc3192a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 702 microversion: 2.1 time: 0.100944 Oct 26 13:21:15.748324 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2210/4420] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 702 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:21:15.754317 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bd84efd0-78da-471a-a7e0-c66f4e1e2730 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:21:15.762086 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bd84efd0-78da-471a-a7e0-c66f4e1e2730 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 8ec8dff5-3985-4f1c-9d2e-ddd28d538476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:15.781907 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd84efd0-78da-471a-a7e0-c66f4e1e2730 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:15.782655 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd84efd0-78da-471a-a7e0-c66f4e1e2730 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:15.786402 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd84efd0-78da-471a-a7e0-c66f4e1e2730 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:15.787457 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd84efd0-78da-471a-a7e0-c66f4e1e2730 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:15.788995 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd84efd0-78da-471a-a7e0-c66f4e1e2730 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:15.789904 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd84efd0-78da-471a-a7e0-c66f4e1e2730 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:15.967746 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-bd84efd0-78da-471a-a7e0-c66f4e1e2730 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:21:15.968574 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-bd84efd0-78da-471a-a7e0-c66f4e1e2730 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:21:15.969896 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-bd84efd0-78da-471a-a7e0-c66f4e1e2730 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:21:15.970531 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-bd84efd0-78da-471a-a7e0-c66f4e1e2730 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:21:15.971874 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-bd84efd0-78da-471a-a7e0-c66f4e1e2730 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:21:16.082477 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bd84efd0-78da-471a-a7e0-c66f4e1e2730 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 8ec8dff5-3985-4f1c-9d2e-ddd28d538476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:16.096828 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2b5edff4-3229-4b25-897b-a998eab8a978 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:16.102358 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd84efd0-78da-471a-a7e0-c66f4e1e2730 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:16.104819 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd84efd0-78da-471a-a7e0-c66f4e1e2730 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:16.106945 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd84efd0-78da-471a-a7e0-c66f4e1e2730 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:16.107939 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd84efd0-78da-471a-a7e0-c66f4e1e2730 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:16.110348 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd84efd0-78da-471a-a7e0-c66f4e1e2730 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:16.113729 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2b5edff4-3229-4b25-897b-a998eab8a978 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c" status: 200 len: 1673 microversion: 2.1 time: 0.681813 Oct 26 13:21:16.113938 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd84efd0-78da-471a-a7e0-c66f4e1e2730 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:16.123036 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2211/4421] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:15 2022] GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c => generated 1673 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:16.138110 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-77783b77-5815-4c97-b30c-32daee8b01dc tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:16.142483 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-77783b77-5815-4c97-b30c-32daee8b01dc tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:16.165507 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77783b77-5815-4c97-b30c-32daee8b01dc tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:16.172238 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77783b77-5815-4c97-b30c-32daee8b01dc tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:16.175207 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77783b77-5815-4c97-b30c-32daee8b01dc tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:16.178393 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77783b77-5815-4c97-b30c-32daee8b01dc tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:16.181420 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77783b77-5815-4c97-b30c-32daee8b01dc tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:16.181993 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77783b77-5815-4c97-b30c-32daee8b01dc tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:16.274025 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bd84efd0-78da-471a-a7e0-c66f4e1e2730 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "POST /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476/action" status: 202 len: 1079 microversion: 2.47 time: 0.513282 Oct 26 13:21:16.276767 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2211/4422] 10.222.0.40 () {62 vars in 1319 bytes} [Wed Oct 26 13:21:15 2022] POST /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476/action => generated 1079 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 26 13:21:16.299184 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-261f8cd5-7503-446a-87cc-fed55c68d992 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:16.300234 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-261f8cd5-7503-446a-87cc-fed55c68d992 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 8ec8dff5-3985-4f1c-9d2e-ddd28d538476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:16.309590 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-261f8cd5-7503-446a-87cc-fed55c68d992 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:16.310318 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-261f8cd5-7503-446a-87cc-fed55c68d992 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:16.310898 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-261f8cd5-7503-446a-87cc-fed55c68d992 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:16.311904 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-261f8cd5-7503-446a-87cc-fed55c68d992 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:16.312607 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-261f8cd5-7503-446a-87cc-fed55c68d992 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:16.313192 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-261f8cd5-7503-446a-87cc-fed55c68d992 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:16.513816 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-261f8cd5-7503-446a-87cc-fed55c68d992 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:16.515718 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-77783b77-5815-4c97-b30c-32daee8b01dc tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:16.529873 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-261f8cd5-7503-446a-87cc-fed55c68d992 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:16.534759 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-77783b77-5815-4c97-b30c-32daee8b01dc tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:16.535268 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-261f8cd5-7503-446a-87cc-fed55c68d992 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:16.540274 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-77783b77-5815-4c97-b30c-32daee8b01dc tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:16.540678 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-261f8cd5-7503-446a-87cc-fed55c68d992 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476" status: 200 len: 1366 microversion: 2.47 time: 0.242045 Oct 26 13:21:16.542615 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2212/4423] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:16 2022] GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476 => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:16.554339 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0f904aa4-fda9-4304-a2c5-7d6a5827de18 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:16.555243 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0f904aa4-fda9-4304-a2c5-7d6a5827de18 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: 800fb374-b811-40a1-9843-8577e3a6d88a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:16.571425 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0f904aa4-fda9-4304-a2c5-7d6a5827de18 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:16.574208 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-77783b77-5815-4c97-b30c-32daee8b01dc tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1555 microversion: 2.91 time: 0.447968 Oct 26 13:21:16.574808 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2212/4424] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:16 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1555 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:16.575500 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0f904aa4-fda9-4304-a2c5-7d6a5827de18 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:16.577407 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0f904aa4-fda9-4304-a2c5-7d6a5827de18 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:16.578565 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0f904aa4-fda9-4304-a2c5-7d6a5827de18 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:16.580438 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0f904aa4-fda9-4304-a2c5-7d6a5827de18 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:16.581086 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0f904aa4-fda9-4304-a2c5-7d6a5827de18 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:16.587261 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-39ce632c-97d6-4b6a-aa24-191d7f84dec3 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:16.587877 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-39ce632c-97d6-4b6a-aa24-191d7f84dec3 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:16.615101 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39ce632c-97d6-4b6a-aa24-191d7f84dec3 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:16.625963 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39ce632c-97d6-4b6a-aa24-191d7f84dec3 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:16.626859 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39ce632c-97d6-4b6a-aa24-191d7f84dec3 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:16.627800 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39ce632c-97d6-4b6a-aa24-191d7f84dec3 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:16.631450 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39ce632c-97d6-4b6a-aa24-191d7f84dec3 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:16.632215 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39ce632c-97d6-4b6a-aa24-191d7f84dec3 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:16.833623 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=4 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:21:16.903428 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=12 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:21:17.378797 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-39ce632c-97d6-4b6a-aa24-191d7f84dec3 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:17.398258 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-39ce632c-97d6-4b6a-aa24-191d7f84dec3 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:17.408362 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-39ce632c-97d6-4b6a-aa24-191d7f84dec3 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:17.412703 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-39ce632c-97d6-4b6a-aa24-191d7f84dec3 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 2907 microversion: 2.32 time: 0.827944 Oct 26 13:21:17.413357 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2213/4425] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:16 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 2907 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:17.458094 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ddcfd1e1-c635-4ebb-831f-31aae4b62a02 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:17.466133 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ddcfd1e1-c635-4ebb-831f-31aae4b62a02 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:17.487394 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ddcfd1e1-c635-4ebb-831f-31aae4b62a02 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:17.507561 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ddcfd1e1-c635-4ebb-831f-31aae4b62a02 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:17.508265 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ddcfd1e1-c635-4ebb-831f-31aae4b62a02 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:17.510622 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ddcfd1e1-c635-4ebb-831f-31aae4b62a02 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:17.517953 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ddcfd1e1-c635-4ebb-831f-31aae4b62a02 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:17.520818 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ddcfd1e1-c635-4ebb-831f-31aae4b62a02 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:17.748450 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0f904aa4-fda9-4304-a2c5-7d6a5827de18 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:17.763441 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0f904aa4-fda9-4304-a2c5-7d6a5827de18 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/800fb374-b811-40a1-9843-8577e3a6d88a" status: 200 len: 1321 microversion: 2.1 time: 1.218311 Oct 26 13:21:17.765021 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2213/4426] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:16 2022] GET /compute/v2.1/servers/800fb374-b811-40a1-9843-8577e3a6d88a => generated 1321 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:17.776517 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-06bb816a-d222-4400-ba23-fb0630a34c71 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:17.778327 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-06bb816a-d222-4400-ba23-fb0630a34c71 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 8ec8dff5-3985-4f1c-9d2e-ddd28d538476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:17.799189 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-06bb816a-d222-4400-ba23-fb0630a34c71 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:17.799755 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-06bb816a-d222-4400-ba23-fb0630a34c71 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:17.803699 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-06bb816a-d222-4400-ba23-fb0630a34c71 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:17.804732 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-06bb816a-d222-4400-ba23-fb0630a34c71 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:17.805036 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-06bb816a-d222-4400-ba23-fb0630a34c71 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:17.805424 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-06bb816a-d222-4400-ba23-fb0630a34c71 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:17.958195 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-06bb816a-d222-4400-ba23-fb0630a34c71 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:17.968929 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-06bb816a-d222-4400-ba23-fb0630a34c71 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:17.971302 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-06bb816a-d222-4400-ba23-fb0630a34c71 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:17.974585 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-06bb816a-d222-4400-ba23-fb0630a34c71 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476" status: 200 len: 1366 microversion: 2.47 time: 0.206407 Oct 26 13:21:17.975684 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2214/4427] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:17 2022] GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476 => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:17.993796 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ddcfd1e1-c635-4ebb-831f-31aae4b62a02 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:18.001110 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ddcfd1e1-c635-4ebb-831f-31aae4b62a02 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c" status: 200 len: 1606 microversion: 2.1 time: 0.552157 Oct 26 13:21:18.001954 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2214/4428] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:17 2022] GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c => generated 1606 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:18.008745 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-46ddb6e4-31aa-4a0c-ad29-9103bb809477 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:18.009361 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-46ddb6e4-31aa-4a0c-ad29-9103bb809477 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:18.017759 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-371ef90a-106a-4645-a74f-858ce0a7775a req-8ccce224-b211-4007-a049-f9b5362d2af3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c1ed300-eac2-4e60-a903-2f17e7df792c", "name": "network-vif-deleted", "tag": "3bb2a1a3-90e2-4559-a739-93834bf16890"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:21:18.047798 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-371ef90a-106a-4645-a74f-858ce0a7775a req-8ccce224-b211-4007-a049-f9b5362d2af3 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:18.050577 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-46ddb6e4-31aa-4a0c-ad29-9103bb809477 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:18.051669 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-46ddb6e4-31aa-4a0c-ad29-9103bb809477 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:18.052009 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-371ef90a-106a-4645-a74f-858ce0a7775a req-8ccce224-b211-4007-a049-f9b5362d2af3 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:18.052614 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-371ef90a-106a-4645-a74f-858ce0a7775a req-8ccce224-b211-4007-a049-f9b5362d2af3 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:18.055168 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-46ddb6e4-31aa-4a0c-ad29-9103bb809477 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:18.058647 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-46ddb6e4-31aa-4a0c-ad29-9103bb809477 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:18.059141 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-46ddb6e4-31aa-4a0c-ad29-9103bb809477 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:18.066200 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-46ddb6e4-31aa-4a0c-ad29-9103bb809477 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:18.087158 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-371ef90a-106a-4645-a74f-858ce0a7775a req-8ccce224-b211-4007-a049-f9b5362d2af3 service nova] Creating event network-vif-deleted:3bb2a1a3-90e2-4559-a739-93834bf16890 for instance 9c1ed300-eac2-4e60-a903-2f17e7df792c on n-h2-862686-1 Oct 26 13:21:18.098913 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-371ef90a-106a-4645-a74f-858ce0a7775a req-8ccce224-b211-4007-a049-f9b5362d2af3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088876 Oct 26 13:21:18.102085 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2215/4429] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:21:18.112007 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3b752ab8-6758-4238-945b-1669ff7de88e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:18.120546 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3b752ab8-6758-4238-945b-1669ff7de88e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 42f50b1b-9531-43dd-bb5f-cbca3b7d306f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:18.169928 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b752ab8-6758-4238-945b-1669ff7de88e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:18.170533 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b752ab8-6758-4238-945b-1669ff7de88e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:18.177639 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b752ab8-6758-4238-945b-1669ff7de88e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:18.178641 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b752ab8-6758-4238-945b-1669ff7de88e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:18.179366 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b752ab8-6758-4238-945b-1669ff7de88e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:18.181042 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b752ab8-6758-4238-945b-1669ff7de88e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:18.228060 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-3b752ab8-6758-4238-945b-1669ff7de88e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] HTTP exception thrown: Instance 42f50b1b-9531-43dd-bb5f-cbca3b7d306f could not be found. Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3b752ab8-6758-4238-945b-1669ff7de88e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Request method failure captured: Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: request: DELETE /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f HTTP/1.1 Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTK8yiFaYn6FsK4kYH1E6E6NSE9_hIaDskjf1tRy-XgeLhCgjcaBIDqmW8VSjfB2Cmb6DMkQzh-y_Wh40jTHlXsuv7XA0N3K6RDEzKD5nf9Z6iWWIgYAqlJtxWSsEOqwe1NAtEPEvPHN4gJ5RH5unfT6e5xSWJOJigX6JmjW0X-SjQA Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 174da5e5c60449b7a04e9cf2aa3b9fda Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-AttachVolumeNegativeTest-770748596 Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/174da5e5c60449b7a04e9cf2aa3b9fda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/174da5e5c60449b7a04e9cf2aa3b9fda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_174da5e5c60449b7a04e9cf2aa3b9fda"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/174da5e5c60449b7a04e9cf2aa3b9fda"}]}] Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-AttachVolumeNegativeTest-770748596 Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 174da5e5c60449b7a04e9cf2aa3b9fda Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-770748596 Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-AttachVolumeNegativeTest-770748596-project Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 168c83cd1b014f82945f4915e3ece079 Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-AttachVolumeNegativeTest-770748596-project Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 42f50b1b-9531-43dd-bb5f-cbca3b7d306f could not be found. Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '42f50b1b-9531-43dd-bb5f-cbca3b7d306f'} Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42f50b1b-9531-43dd-bb5f-cbca3b7d306f could not be found. Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:21:18.232570 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:21:18.240350 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42f50b1b-9531-43dd-bb5f-cbca3b7d306f could not be found. Oct 26 13:21:18.240350 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:21:18.240350 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:21:18.240350 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:21:18.240350 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:18.240350 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:21:18.240350 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:21:18.240350 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:21:18.240350 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:21:18.240350 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42f50b1b-9531-43dd-bb5f-cbca3b7d306f could not be found. Oct 26 13:21:18.240350 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:21:18.244402 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3b752ab8-6758-4238-945b-1669ff7de88e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Returning 404 to user: Instance 42f50b1b-9531-43dd-bb5f-cbca3b7d306f could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:21:18.252687 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3b752ab8-6758-4238-945b-1669ff7de88e tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "DELETE /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f" status: 404 len: 111 microversion: 2.1 time: 0.146982 Oct 26 13:21:18.255529 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2216/4430] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:21:18 2022] DELETE /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:21:18.264473 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-c924195b-b075-4c9e-aaa2-d4a46f32dd09 req-8f071cb1-5f30-43f7-94a1-203696e65c79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "893420b7-27d9-4240-8182-87dd3231cbe2", "name": "network-vif-unplugged", "status": "completed", "tag": "82a2023f-2039-4f62-94a6-f0654d4f4db3"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:21:18.298904 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-c924195b-b075-4c9e-aaa2-d4a46f32dd09 req-8f071cb1-5f30-43f7-94a1-203696e65c79 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:18.299399 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-c924195b-b075-4c9e-aaa2-d4a46f32dd09 req-8f071cb1-5f30-43f7-94a1-203696e65c79 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:18.299842 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-c924195b-b075-4c9e-aaa2-d4a46f32dd09 req-8f071cb1-5f30-43f7-94a1-203696e65c79 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:18.340785 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-46ddb6e4-31aa-4a0c-ad29-9103bb809477 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:18.350485 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-c924195b-b075-4c9e-aaa2-d4a46f32dd09 req-8f071cb1-5f30-43f7-94a1-203696e65c79 service nova] Creating event network-vif-unplugged:82a2023f-2039-4f62-94a6-f0654d4f4db3 for instance 893420b7-27d9-4240-8182-87dd3231cbe2 on n-h1-862686-1 Oct 26 13:21:18.362356 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-46ddb6e4-31aa-4a0c-ad29-9103bb809477 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:18.366730 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-46ddb6e4-31aa-4a0c-ad29-9103bb809477 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:18.367101 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-c924195b-b075-4c9e-aaa2-d4a46f32dd09 req-8f071cb1-5f30-43f7-94a1-203696e65c79 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110132 Oct 26 13:21:18.367736 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2217/4431] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:21:18.392130 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0a65c930-2ab1-4ea2-b3e1-6831275039cb tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-107784925", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8122bd35-175c-4158-bd9f-4d231f20a1e9"}], "security_groups": [{"name": "tempest-securitygroup--684393737"}], "key_name": "tempest-keypair-442852260", "user_data": "}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:21:18.407052 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-46ddb6e4-31aa-4a0c-ad29-9103bb809477 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1555 microversion: 2.91 time: 0.417927 Oct 26 13:21:18.411177 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2215/4432] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:17 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1555 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:18.431965 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5d44222f-8809-49de-86ea-eec8334070f2 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:18.433591 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5d44222f-8809-49de-86ea-eec8334070f2 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 42f50b1b-9531-43dd-bb5f-cbca3b7d306f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:18.478495 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d44222f-8809-49de-86ea-eec8334070f2 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:18.480279 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d44222f-8809-49de-86ea-eec8334070f2 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:18.481551 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d44222f-8809-49de-86ea-eec8334070f2 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:18.485564 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d44222f-8809-49de-86ea-eec8334070f2 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:18.486589 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d44222f-8809-49de-86ea-eec8334070f2 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:18.487269 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d44222f-8809-49de-86ea-eec8334070f2 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:18.535961 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-5d44222f-8809-49de-86ea-eec8334070f2 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] HTTP exception thrown: Instance 42f50b1b-9531-43dd-bb5f-cbca3b7d306f could not be found. Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5d44222f-8809-49de-86ea-eec8334070f2 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Request method failure captured: Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f HTTP/1.1 Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTK8yiFaYn6FsK4kYH1E6E6NSE9_hIaDskjf1tRy-XgeLhCgjcaBIDqmW8VSjfB2Cmb6DMkQzh-y_Wh40jTHlXsuv7XA0N3K6RDEzKD5nf9Z6iWWIgYAqlJtxWSsEOqwe1NAtEPEvPHN4gJ5RH5unfT6e5xSWJOJigX6JmjW0X-SjQA Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 174da5e5c60449b7a04e9cf2aa3b9fda Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-AttachVolumeNegativeTest-770748596 Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/174da5e5c60449b7a04e9cf2aa3b9fda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/174da5e5c60449b7a04e9cf2aa3b9fda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_174da5e5c60449b7a04e9cf2aa3b9fda"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/174da5e5c60449b7a04e9cf2aa3b9fda"}]}] Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-AttachVolumeNegativeTest-770748596 Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 174da5e5c60449b7a04e9cf2aa3b9fda Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-770748596 Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-AttachVolumeNegativeTest-770748596-project Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 168c83cd1b014f82945f4915e3ece079 Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-AttachVolumeNegativeTest-770748596-project Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 42f50b1b-9531-43dd-bb5f-cbca3b7d306f could not be found. Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '42f50b1b-9531-43dd-bb5f-cbca3b7d306f'} Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42f50b1b-9531-43dd-bb5f-cbca3b7d306f could not be found. Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42f50b1b-9531-43dd-bb5f-cbca3b7d306f could not be found. Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:21:18.543382 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:18.548720 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:18.548720 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:21:18.548720 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:21:18.548720 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:21:18.548720 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:21:18.548720 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42f50b1b-9531-43dd-bb5f-cbca3b7d306f could not be found. Oct 26 13:21:18.548720 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:18.549974 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5d44222f-8809-49de-86ea-eec8334070f2 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Returning 404 to user: Instance 42f50b1b-9531-43dd-bb5f-cbca3b7d306f could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:21:18.551505 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5d44222f-8809-49de-86ea-eec8334070f2 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f" status: 404 len: 111 microversion: 2.1 time: 0.138643 Oct 26 13:21:18.556319 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2216/4433] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:18 2022] GET /compute/v2.1/servers/42f50b1b-9531-43dd-bb5f-cbca3b7d306f => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:21:18.572729 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b9ab63bd-4a27-432d-90cf-e976605cd6a5 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:18.575182 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b9ab63bd-4a27-432d-90cf-e976605cd6a5 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:18.611597 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b9ab63bd-4a27-432d-90cf-e976605cd6a5 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:18.614736 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b9ab63bd-4a27-432d-90cf-e976605cd6a5 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:18.618937 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b9ab63bd-4a27-432d-90cf-e976605cd6a5 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:18.619954 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b9ab63bd-4a27-432d-90cf-e976605cd6a5 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:18.623017 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b9ab63bd-4a27-432d-90cf-e976605cd6a5 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:18.623875 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b9ab63bd-4a27-432d-90cf-e976605cd6a5 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:19.192955 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b9ab63bd-4a27-432d-90cf-e976605cd6a5 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:19.219423 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b9ab63bd-4a27-432d-90cf-e976605cd6a5 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:19.227338 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b9ab63bd-4a27-432d-90cf-e976605cd6a5 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:19.230152 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b9ab63bd-4a27-432d-90cf-e976605cd6a5 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 2861 microversion: 2.32 time: 0.672411 Oct 26 13:21:19.231897 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-0a65c930-2ab1-4ea2-b3e1-6831275039cb tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] validate_networks() for [('8122bd35-175c-4158-bd9f-4d231f20a1e9', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:21:19.260047 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2217/4434] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:18 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 2861 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:19.267418 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8cde0bd9-f0ff-4aec-a713-65d314595e51 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:19.269998 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8cde0bd9-f0ff-4aec-a713-65d314595e51 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: 800fb374-b811-40a1-9843-8577e3a6d88a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:19.279710 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8cde0bd9-f0ff-4aec-a713-65d314595e51 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:19.280437 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8cde0bd9-f0ff-4aec-a713-65d314595e51 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:19.281277 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8cde0bd9-f0ff-4aec-a713-65d314595e51 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:19.282565 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8cde0bd9-f0ff-4aec-a713-65d314595e51 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:19.283177 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8cde0bd9-f0ff-4aec-a713-65d314595e51 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:19.283752 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8cde0bd9-f0ff-4aec-a713-65d314595e51 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:19.494267 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8cde0bd9-f0ff-4aec-a713-65d314595e51 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:19.506725 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8cde0bd9-f0ff-4aec-a713-65d314595e51 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/800fb374-b811-40a1-9843-8577e3a6d88a" status: 200 len: 1513 microversion: 2.1 time: 0.243292 Oct 26 13:21:19.510044 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2218/4435] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:19 2022] GET /compute/v2.1/servers/800fb374-b811-40a1-9843-8577e3a6d88a => generated 1513 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:19.516818 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8b3875fb-d5ad-4ac2-b482-032c0c827368 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:19.520693 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8b3875fb-d5ad-4ac2-b482-032c0c827368 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 8ec8dff5-3985-4f1c-9d2e-ddd28d538476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:19.532766 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8b3875fb-d5ad-4ac2-b482-032c0c827368 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:19.533255 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8b3875fb-d5ad-4ac2-b482-032c0c827368 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:19.543570 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8b3875fb-d5ad-4ac2-b482-032c0c827368 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:19.548388 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8b3875fb-d5ad-4ac2-b482-032c0c827368 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:19.550169 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8b3875fb-d5ad-4ac2-b482-032c0c827368 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:19.551473 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8b3875fb-d5ad-4ac2-b482-032c0c827368 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:19.788681 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8b3875fb-d5ad-4ac2-b482-032c0c827368 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:19.801032 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8b3875fb-d5ad-4ac2-b482-032c0c827368 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:19.805992 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8b3875fb-d5ad-4ac2-b482-032c0c827368 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:19.810793 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8b3875fb-d5ad-4ac2-b482-032c0c827368 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476" status: 200 len: 1366 microversion: 2.47 time: 0.299075 Oct 26 13:21:19.811797 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2219/4436] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:19 2022] GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476 => generated 1366 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:19.821720 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-978b6279-dbd5-43eb-bdb4-aca692bcd258 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:19.826785 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-978b6279-dbd5-43eb-bdb4-aca692bcd258 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:19.835481 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-978b6279-dbd5-43eb-bdb4-aca692bcd258 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:19.838563 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-978b6279-dbd5-43eb-bdb4-aca692bcd258 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:19.839233 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-978b6279-dbd5-43eb-bdb4-aca692bcd258 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:19.840321 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-978b6279-dbd5-43eb-bdb4-aca692bcd258 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:19.841426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-978b6279-dbd5-43eb-bdb4-aca692bcd258 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:19.842135 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-978b6279-dbd5-43eb-bdb4-aca692bcd258 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:19.846961 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:21:19.883603 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-978b6279-dbd5-43eb-bdb4-aca692bcd258 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] HTTP exception thrown: Instance 9c1ed300-eac2-4e60-a903-2f17e7df792c could not be found. Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-978b6279-dbd5-43eb-bdb4-aca692bcd258 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Request method failure captured: Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c HTTP/1.1 Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTN7hbeapRmCcJ7igmy85vPoyVUVlZs2lSyAhZOIYOdPPfznAhHwx6i5N6See2TtMCVfoGB5ZRVOrV-z1bLtOTx-4VqQeaegU1xtipleMye9s0u-EdRknvwJp_xukT9e7b9VNOVvc51B0c1CP47_BIErFpV-aKSN5cSTtBHmEVuwcek Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: e1f158446a544e5680969f4ef7512e49 Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-AttachVolumeTestJSON-1520608711 Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e1f158446a544e5680969f4ef7512e49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e1f158446a544e5680969f4ef7512e49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e1f158446a544e5680969f4ef7512e49"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e1f158446a544e5680969f4ef7512e49"}]}] Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-AttachVolumeTestJSON-1520608711 Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: e1f158446a544e5680969f4ef7512e49 Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1520608711 Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-AttachVolumeTestJSON-1520608711-project Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 0b457ab0af5e41b1a1e10290b67656a7 Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-AttachVolumeTestJSON-1520608711-project Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 9c1ed300-eac2-4e60-a903-2f17e7df792c could not be found. Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '9c1ed300-eac2-4e60-a903-2f17e7df792c'} Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c1ed300-eac2-4e60-a903-2f17e7df792c could not be found. Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c1ed300-eac2-4e60-a903-2f17e7df792c could not be found. Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:21:19.885446 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:19.889021 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:19.889021 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:21:19.889021 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:21:19.889021 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:21:19.889021 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:21:19.889021 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c1ed300-eac2-4e60-a903-2f17e7df792c could not be found. Oct 26 13:21:19.889021 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:19.891970 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-978b6279-dbd5-43eb-bdb4-aca692bcd258 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Returning 404 to user: Instance 9c1ed300-eac2-4e60-a903-2f17e7df792c could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:21:19.893100 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-978b6279-dbd5-43eb-bdb4-aca692bcd258 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c" status: 404 len: 111 microversion: 2.1 time: 0.079993 Oct 26 13:21:19.897514 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2220/4437] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:19 2022] GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:21:19.915484 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-52205da2-8547-45f8-851a-a4d2970fa0b2 req-1ba2f027-8d3d-4831-b0ed-7da88e81f1af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "893420b7-27d9-4240-8182-87dd3231cbe2", "name": "network-vif-deleted", "tag": "fdc12d04-26b7-4153-91a7-171ed0f8798d"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:21:19.949096 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-52205da2-8547-45f8-851a-a4d2970fa0b2 req-1ba2f027-8d3d-4831-b0ed-7da88e81f1af service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:19.950737 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-52205da2-8547-45f8-851a-a4d2970fa0b2 req-1ba2f027-8d3d-4831-b0ed-7da88e81f1af service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:19.951202 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-52205da2-8547-45f8-851a-a4d2970fa0b2 req-1ba2f027-8d3d-4831-b0ed-7da88e81f1af service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:19.971464 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-52205da2-8547-45f8-851a-a4d2970fa0b2 req-1ba2f027-8d3d-4831-b0ed-7da88e81f1af service nova] Creating event network-vif-deleted:fdc12d04-26b7-4153-91a7-171ed0f8798d for instance 893420b7-27d9-4240-8182-87dd3231cbe2 on n-h1-862686-1 Oct 26 13:21:20.003687 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-52205da2-8547-45f8-851a-a4d2970fa0b2 req-1ba2f027-8d3d-4831-b0ed-7da88e81f1af service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101046 Oct 26 13:21:20.005643 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2221/4438] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:21:20.011146 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a7cd3282-e447-4911-887a-176b2692bb87 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:20.030556 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a7cd3282-e447-4911-887a-176b2692bb87 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:20.062611 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7cd3282-e447-4911-887a-176b2692bb87 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:20.063135 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7cd3282-e447-4911-887a-176b2692bb87 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:20.063611 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7cd3282-e447-4911-887a-176b2692bb87 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:20.067263 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7cd3282-e447-4911-887a-176b2692bb87 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:20.067809 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7cd3282-e447-4911-887a-176b2692bb87 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:20.068257 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7cd3282-e447-4911-887a-176b2692bb87 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:20.282111 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a7cd3282-e447-4911-887a-176b2692bb87 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:20.294944 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a7cd3282-e447-4911-887a-176b2692bb87 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:20.303182 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a7cd3282-e447-4911-887a-176b2692bb87 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:20.314920 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a7cd3282-e447-4911-887a-176b2692bb87 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1555 microversion: 2.91 time: 0.307829 Oct 26 13:21:20.317147 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2222/4439] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:20 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1555 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:20.325304 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a4de737a-1051-4053-9f76-50a476a32fa4 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:20.328149 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a4de737a-1051-4053-9f76-50a476a32fa4 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: d7cd631a-a439-481d-ab67-f5a0c9d0ef86] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:20.338635 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4de737a-1051-4053-9f76-50a476a32fa4 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:20.339475 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4de737a-1051-4053-9f76-50a476a32fa4 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:20.340024 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4de737a-1051-4053-9f76-50a476a32fa4 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:20.342255 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4de737a-1051-4053-9f76-50a476a32fa4 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:20.344393 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4de737a-1051-4053-9f76-50a476a32fa4 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:20.345700 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4de737a-1051-4053-9f76-50a476a32fa4 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:20.654967 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a4de737a-1051-4053-9f76-50a476a32fa4 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:20.672173 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a4de737a-1051-4053-9f76-50a476a32fa4 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/d7cd631a-a439-481d-ab67-f5a0c9d0ef86" status: 200 len: 1510 microversion: 2.1 time: 0.353321 Oct 26 13:21:20.675626 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2223/4440] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:20 2022] GET /compute/v2.1/servers/d7cd631a-a439-481d-ab67-f5a0c9d0ef86 => generated 1510 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:20.683323 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6fca123d-8350-4759-8851-614d3affc1cb tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '.version_select at 0x7f673232e310>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:20.737851 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6fca123d-8350-4759-8851-614d3affc1cb tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-319333818" status: 202 len: 0 microversion: 2.1 time: 0.062152 Oct 26 13:21:20.744564 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2224/4441] 10.222.0.40 () {58 vars in 1218 bytes} [Wed Oct 26 13:21:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-319333818 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:21:20.792939 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d7dbce86-5ab5-4f6f-a33d-89f91424f49f tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:20.808310 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d7dbce86-5ab5-4f6f-a33d-89f91424f49f tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:20.814521 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=8 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:21:20.817907 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7dbce86-5ab5-4f6f-a33d-89f91424f49f tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:20.818969 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7dbce86-5ab5-4f6f-a33d-89f91424f49f tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:20.819939 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7dbce86-5ab5-4f6f-a33d-89f91424f49f tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:20.821008 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7dbce86-5ab5-4f6f-a33d-89f91424f49f tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:20.821814 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7dbce86-5ab5-4f6f-a33d-89f91424f49f tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:20.822402 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7dbce86-5ab5-4f6f-a33d-89f91424f49f tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:21.170977 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d7dbce86-5ab5-4f6f-a33d-89f91424f49f tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:21.186585 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d7dbce86-5ab5-4f6f-a33d-89f91424f49f tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:21.190339 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d7dbce86-5ab5-4f6f-a33d-89f91424f49f tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:21.196102 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d7dbce86-5ab5-4f6f-a33d-89f91424f49f tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 2531 microversion: 2.32 time: 0.453798 Oct 26 13:21:21.198448 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2225/4442] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:20 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 2531 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:21.207073 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6b0c2a88-05e1-4e4a-b8b5-52ecfe01abb9 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:21.208435 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6b0c2a88-05e1-4e4a-b8b5-52ecfe01abb9 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: f9df48e5-9204-46d5-b2a9-2154dbdcf167] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:21.217390 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b0c2a88-05e1-4e4a-b8b5-52ecfe01abb9 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:21.221160 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b0c2a88-05e1-4e4a-b8b5-52ecfe01abb9 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:21.222022 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b0c2a88-05e1-4e4a-b8b5-52ecfe01abb9 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:21.224641 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b0c2a88-05e1-4e4a-b8b5-52ecfe01abb9 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:21.225851 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b0c2a88-05e1-4e4a-b8b5-52ecfe01abb9 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:21.226854 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b0c2a88-05e1-4e4a-b8b5-52ecfe01abb9 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:21.588279 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6b0c2a88-05e1-4e4a-b8b5-52ecfe01abb9 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:21.602928 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6b0c2a88-05e1-4e4a-b8b5-52ecfe01abb9 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/f9df48e5-9204-46d5-b2a9-2154dbdcf167" status: 200 len: 1512 microversion: 2.1 time: 0.401922 Oct 26 13:21:21.618294 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2226/4443] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:21 2022] GET /compute/v2.1/servers/f9df48e5-9204-46d5-b2a9-2154dbdcf167 => generated 1512 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:21.632343 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-af4e900d-2d7a-4797-aefc-5c1f3476f161 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:21.632838 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-af4e900d-2d7a-4797-aefc-5c1f3476f161 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 8ec8dff5-3985-4f1c-9d2e-ddd28d538476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:21.639999 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af4e900d-2d7a-4797-aefc-5c1f3476f161 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:21.640608 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-0a65c930-2ab1-4ea2-b3e1-6831275039cb tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:21:21.641103 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af4e900d-2d7a-4797-aefc-5c1f3476f161 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:21.641197 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-0a65c930-2ab1-4ea2-b3e1-6831275039cb tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:21:21.641295 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af4e900d-2d7a-4797-aefc-5c1f3476f161 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:21.641515 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-0a65c930-2ab1-4ea2-b3e1-6831275039cb tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:21:21.641941 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-0a65c930-2ab1-4ea2-b3e1-6831275039cb tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:21:21.642328 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af4e900d-2d7a-4797-aefc-5c1f3476f161 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:21.642508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-0a65c930-2ab1-4ea2-b3e1-6831275039cb tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:21:21.642992 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af4e900d-2d7a-4797-aefc-5c1f3476f161 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:21.643529 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af4e900d-2d7a-4797-aefc-5c1f3476f161 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:21.667066 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0a65c930-2ab1-4ea2-b3e1-6831275039cb tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:21.673353 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0a65c930-2ab1-4ea2-b3e1-6831275039cb tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:21.674237 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0a65c930-2ab1-4ea2-b3e1-6831275039cb tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:21.675238 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0a65c930-2ab1-4ea2-b3e1-6831275039cb tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:21.675860 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0a65c930-2ab1-4ea2-b3e1-6831275039cb tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:21.677462 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0a65c930-2ab1-4ea2-b3e1-6831275039cb tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:21.724636 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:21:21.746208 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-af4e900d-2d7a-4797-aefc-5c1f3476f161 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:21.766360 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-0a65c930-2ab1-4ea2-b3e1-6831275039cb tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Getting quotas for project 9cdd45be745d4828b5a111472254156c. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:21:21.776490 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-af4e900d-2d7a-4797-aefc-5c1f3476f161 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:21.778630 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-af4e900d-2d7a-4797-aefc-5c1f3476f161 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:21.779995 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-af4e900d-2d7a-4797-aefc-5c1f3476f161 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476" status: 200 len: 1366 microversion: 2.47 time: 0.160479 Oct 26 13:21:21.794466 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2227/4444] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:21 2022] GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:21.794677 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-0a65c930-2ab1-4ea2-b3e1-6831275039cb tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Getting quotas for user 363fc117da70484f9d8cf2040e8391e4 and project 9cdd45be745d4828b5a111472254156c. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:21:21.794774 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7146a70c-3fcd-497f-827d-eb374238c967 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:21.794774 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7146a70c-3fcd-497f-827d-eb374238c967 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:21.796555 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7146a70c-3fcd-497f-827d-eb374238c967 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:21.797568 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7146a70c-3fcd-497f-827d-eb374238c967 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:21.799173 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7146a70c-3fcd-497f-827d-eb374238c967 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:21.800594 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7146a70c-3fcd-497f-827d-eb374238c967 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:21.802552 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7146a70c-3fcd-497f-827d-eb374238c967 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:21.805911 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7146a70c-3fcd-497f-827d-eb374238c967 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:21.831411 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0a65c930-2ab1-4ea2-b3e1-6831275039cb tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:21:21.851048 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0a65c930-2ab1-4ea2-b3e1-6831275039cb tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:21:21.991052 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0a65c930-2ab1-4ea2-b3e1-6831275039cb tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.616169 Oct 26 13:21:22.010718 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2218/4445] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:21:18 2022] POST /compute/v2.1/servers => generated 408 bytes in 3642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:21:22.015859 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-dbf859fc-e957-498d-b3e8-130606f3e59f tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:22.021889 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-dbf859fc-e957-498d-b3e8-130606f3e59f tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:22.023835 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-dbf859fc-e957-498d-b3e8-130606f3e59f tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b'} {{(pid=120598) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:21:22.039230 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dbf859fc-e957-498d-b3e8-130606f3e59f tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:22.039894 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dbf859fc-e957-498d-b3e8-130606f3e59f tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:22.040497 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dbf859fc-e957-498d-b3e8-130606f3e59f tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:22.041699 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dbf859fc-e957-498d-b3e8-130606f3e59f tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:22.042403 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dbf859fc-e957-498d-b3e8-130606f3e59f tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:22.042992 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dbf859fc-e957-498d-b3e8-130606f3e59f tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:22.121199 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7146a70c-3fcd-497f-827d-eb374238c967 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:22.140500 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7146a70c-3fcd-497f-827d-eb374238c967 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:22.148978 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7146a70c-3fcd-497f-827d-eb374238c967 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:22.168889 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7146a70c-3fcd-497f-827d-eb374238c967 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1555 microversion: 2.91 time: 0.381272 Oct 26 13:21:22.206527 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2228/4446] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:21 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1555 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:22.225689 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a4789db6-44d2-445c-ab56-d247686ce02a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:22.227036 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a4789db6-44d2-445c-ab56-d247686ce02a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:22.376731 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.multi_cell_list [None req-dbf859fc-e957-498d-b3e8-130606f3e59f tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120598) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 13:21:22.406645 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a4789db6-44d2-445c-ab56-d247686ce02a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:22.423945 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a4789db6-44d2-445c-ab56-d247686ce02a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245" status: 200 len: 1244 microversion: 2.1 time: 0.205327 Oct 26 13:21:22.424736 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2229/4447] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:22 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245 => generated 1244 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:22.432843 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-73d94623-cb1c-4294-82b7-4fa32e917d35 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:22.433465 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-73d94623-cb1c-4294-82b7-4fa32e917d35 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:22.465695 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73d94623-cb1c-4294-82b7-4fa32e917d35 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:22.466692 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73d94623-cb1c-4294-82b7-4fa32e917d35 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:22.467347 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73d94623-cb1c-4294-82b7-4fa32e917d35 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:22.468207 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73d94623-cb1c-4294-82b7-4fa32e917d35 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:22.468707 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73d94623-cb1c-4294-82b7-4fa32e917d35 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:22.469335 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73d94623-cb1c-4294-82b7-4fa32e917d35 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:22.569368 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-dbf859fc-e957-498d-b3e8-130606f3e59f tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:22.575388 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:21:22.578354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dbf859fc-e957-498d-b3e8-130606f3e59f tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:22.579301 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dbf859fc-e957-498d-b3e8-130606f3e59f tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:22.579982 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dbf859fc-e957-498d-b3e8-130606f3e59f tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:22.874313 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-dbf859fc-e957-498d-b3e8-130606f3e59f tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1516 microversion: 2.1 time: 0.862142 Oct 26 13:21:22.875355 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2219/4448] 10.222.0.40 () {58 vars in 1167 bytes} [Wed Oct 26 13:21:22 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1516 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:22.880740 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-ffceb17d-aeb9-4278-a277-31f3e4c2260c req-4e9061f9-2f0a-4355-b3b3-15668a6631c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "893420b7-27d9-4240-8182-87dd3231cbe2", "name": "network-vif-deleted", "tag": "01969fd5-4e79-4f2e-9b74-9329ffa7cebd"}, {"server_uuid": "893420b7-27d9-4240-8182-87dd3231cbe2", "name": "network-vif-deleted", "tag": "5767d9fc-18c2-418f-b31e-29c55d94a15e"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:21:22.896184 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ffceb17d-aeb9-4278-a277-31f3e4c2260c req-4e9061f9-2f0a-4355-b3b3-15668a6631c7 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:22.902431 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ffceb17d-aeb9-4278-a277-31f3e4c2260c req-4e9061f9-2f0a-4355-b3b3-15668a6631c7 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:22.904549 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ffceb17d-aeb9-4278-a277-31f3e4c2260c req-4e9061f9-2f0a-4355-b3b3-15668a6631c7 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:22.931595 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-ffceb17d-aeb9-4278-a277-31f3e4c2260c req-4e9061f9-2f0a-4355-b3b3-15668a6631c7 service nova] Creating event network-vif-deleted:01969fd5-4e79-4f2e-9b74-9329ffa7cebd for instance 893420b7-27d9-4240-8182-87dd3231cbe2 on n-h1-862686-1 Oct 26 13:21:22.933592 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-ffceb17d-aeb9-4278-a277-31f3e4c2260c req-4e9061f9-2f0a-4355-b3b3-15668a6631c7 service nova] Creating event network-vif-deleted:5767d9fc-18c2-418f-b31e-29c55d94a15e for instance 893420b7-27d9-4240-8182-87dd3231cbe2 on n-h1-862686-1 Oct 26 13:21:22.946700 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-ffceb17d-aeb9-4278-a277-31f3e4c2260c req-4e9061f9-2f0a-4355-b3b3-15668a6631c7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.069991 Oct 26 13:21:22.947717 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2220/4449] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:21:22.953142 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-33869019-91ed-47d6-991a-b163ebed5039 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:22.958713 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-33869019-91ed-47d6-991a-b163ebed5039 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 8ec8dff5-3985-4f1c-9d2e-ddd28d538476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:22.969882 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33869019-91ed-47d6-991a-b163ebed5039 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:22.972597 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33869019-91ed-47d6-991a-b163ebed5039 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:22.977699 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33869019-91ed-47d6-991a-b163ebed5039 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:22.979072 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33869019-91ed-47d6-991a-b163ebed5039 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:22.979561 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33869019-91ed-47d6-991a-b163ebed5039 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:22.980095 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33869019-91ed-47d6-991a-b163ebed5039 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:23.025016 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-73d94623-cb1c-4294-82b7-4fa32e917d35 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:23.041163 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-73d94623-cb1c-4294-82b7-4fa32e917d35 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:23.045253 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-73d94623-cb1c-4294-82b7-4fa32e917d35 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:23.050448 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-73d94623-cb1c-4294-82b7-4fa32e917d35 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 2485 microversion: 2.32 time: 0.624387 Oct 26 13:21:23.069508 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2230/4450] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:22 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 2485 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:23.069508 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8364ea9c-cf04-4c2c-bdf0-e9c09d7d4385 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:23.103090 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8364ea9c-cf04-4c2c-bdf0-e9c09d7d4385 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:23.103090 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8364ea9c-cf04-4c2c-bdf0-e9c09d7d4385 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-55967892', 'deleted': False, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b'} {{(pid=120597) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:21:23.103292 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-33869019-91ed-47d6-991a-b163ebed5039 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:23.108384 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8364ea9c-cf04-4c2c-bdf0-e9c09d7d4385 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:23.109016 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8364ea9c-cf04-4c2c-bdf0-e9c09d7d4385 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:23.109518 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8364ea9c-cf04-4c2c-bdf0-e9c09d7d4385 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:23.114034 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8364ea9c-cf04-4c2c-bdf0-e9c09d7d4385 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:23.120177 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8364ea9c-cf04-4c2c-bdf0-e9c09d7d4385 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:23.120532 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-33869019-91ed-47d6-991a-b163ebed5039 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:23.120972 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8364ea9c-cf04-4c2c-bdf0-e9c09d7d4385 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:23.122045 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-33869019-91ed-47d6-991a-b163ebed5039 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:23.123249 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-33869019-91ed-47d6-991a-b163ebed5039 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476" status: 200 len: 1366 microversion: 2.47 time: 0.174361 Oct 26 13:21:23.123806 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2221/4451] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:22 2022] GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:23.140149 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7d71e951-316a-4d0c-bcd6-bf8b01e969fc tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Action: 'create', calling method: .version_select at 0x7f67319910d0>, body: {"keypair": {"name": "tempest-keypair-30575218", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9uwBIW4L13Pcu8/bvU4Z7MQvimPcTGADVvGZZ1KWM9zINeo8xE8ygpbeMFqbE8GgdHwWqZzM+KR8S+wBSoSGemIJo6akGI2ihWiYZB0ViiwUcsfxIbLJAaqOZGlPv0gA=="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:21:23.163318 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-7d71e951-316a-4d0c-bcd6-bf8b01e969fc tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Getting quotas for project e1f158446a544e5680969f4ef7512e49. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:21:23.172145 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-7d71e951-316a-4d0c-bcd6-bf8b01e969fc tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Getting quotas for user 0b457ab0af5e41b1a1e10290b67656a7 and project e1f158446a544e5680969f4ef7512e49. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:21:23.237771 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7d71e951-316a-4d0c-bcd6-bf8b01e969fc tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.103764 Oct 26 13:21:23.238742 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2222/4452] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 13:21:23 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:21:23.247576 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8841a466-6254-4c22-9998-d03e57d0397c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:23.248201 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8841a466-6254-4c22-9998-d03e57d0397c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:23.262850 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8841a466-6254-4c22-9998-d03e57d0397c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:23.267792 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8841a466-6254-4c22-9998-d03e57d0397c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:23.268475 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8841a466-6254-4c22-9998-d03e57d0397c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:23.269398 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8841a466-6254-4c22-9998-d03e57d0397c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:23.272580 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8841a466-6254-4c22-9998-d03e57d0397c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:23.273204 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8841a466-6254-4c22-9998-d03e57d0397c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:23.353439 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.multi_cell_list [None req-8364ea9c-cf04-4c2c-bdf0-e9c09d7d4385 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120597) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 13:21:23.433512 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8841a466-6254-4c22-9998-d03e57d0397c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:23.444681 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8841a466-6254-4c22-9998-d03e57d0397c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:23.446709 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8841a466-6254-4c22-9998-d03e57d0397c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:23.454370 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8841a466-6254-4c22-9998-d03e57d0397c tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1555 microversion: 2.91 time: 0.213094 Oct 26 13:21:23.456184 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2223/4453] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:23 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1555 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:23.464862 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b7d02bf6-3717-42cd-bf1a-6d2f2f3799b9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:23.464862 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b7d02bf6-3717-42cd-bf1a-6d2f2f3799b9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:23.476707 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8364ea9c-cf04-4c2c-bdf0-e9c09d7d4385 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:23.485315 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8364ea9c-cf04-4c2c-bdf0-e9c09d7d4385 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:23.485894 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8364ea9c-cf04-4c2c-bdf0-e9c09d7d4385 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:23.486342 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8364ea9c-cf04-4c2c-bdf0-e9c09d7d4385 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:23.488321 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b7d02bf6-3717-42cd-bf1a-6d2f2f3799b9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:23.492721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b7d02bf6-3717-42cd-bf1a-6d2f2f3799b9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:23.500487 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b7d02bf6-3717-42cd-bf1a-6d2f2f3799b9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:23.504013 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b7d02bf6-3717-42cd-bf1a-6d2f2f3799b9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:23.509164 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b7d02bf6-3717-42cd-bf1a-6d2f2f3799b9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:23.510878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b7d02bf6-3717-42cd-bf1a-6d2f2f3799b9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:23.665796 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b7d02bf6-3717-42cd-bf1a-6d2f2f3799b9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:23.675923 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b7d02bf6-3717-42cd-bf1a-6d2f2f3799b9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245" status: 200 len: 1240 microversion: 2.1 time: 0.218345 Oct 26 13:21:23.679918 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2224/4454] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:23 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245 => generated 1240 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:23.700120 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8364ea9c-cf04-4c2c-bdf0-e9c09d7d4385 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-55967892" status: 200 len: 1513 microversion: 2.1 time: 0.643508 Oct 26 13:21:23.700765 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2231/4455] 10.222.0.40 () {58 vars in 1259 bytes} [Wed Oct 26 13:21:23 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-55967892 => generated 1513 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:23.727987 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4bf5d0d1-e663-402f-b271-871f114c243e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:23.737229 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4bf5d0d1-e663-402f-b271-871f114c243e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:23.738231 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4bf5d0d1-e663-402f-b271-871f114c243e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b'} {{(pid=120598) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:21:23.747870 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4bf5d0d1-e663-402f-b271-871f114c243e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:23.748364 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4bf5d0d1-e663-402f-b271-871f114c243e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:23.748920 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4bf5d0d1-e663-402f-b271-871f114c243e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:23.750777 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4bf5d0d1-e663-402f-b271-871f114c243e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:23.750777 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4bf5d0d1-e663-402f-b271-871f114c243e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:23.750777 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4bf5d0d1-e663-402f-b271-871f114c243e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:23.880798 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.multi_cell_list [None req-4bf5d0d1-e663-402f-b271-871f114c243e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120598) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 13:21:23.987948 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4bf5d0d1-e663-402f-b271-871f114c243e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:23.999566 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4bf5d0d1-e663-402f-b271-871f114c243e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:24.000208 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4bf5d0d1-e663-402f-b271-871f114c243e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:24.000659 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4bf5d0d1-e663-402f-b271-871f114c243e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:24.083567 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7ca1c2e9-98c6-46ae-a7d3-8102a2edf458 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:24.084464 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7ca1c2e9-98c6-46ae-a7d3-8102a2edf458 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:24.095252 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ca1c2e9-98c6-46ae-a7d3-8102a2edf458 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:24.096046 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ca1c2e9-98c6-46ae-a7d3-8102a2edf458 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:24.096680 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ca1c2e9-98c6-46ae-a7d3-8102a2edf458 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:24.098834 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ca1c2e9-98c6-46ae-a7d3-8102a2edf458 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:24.099481 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ca1c2e9-98c6-46ae-a7d3-8102a2edf458 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:24.101940 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ca1c2e9-98c6-46ae-a7d3-8102a2edf458 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:24.326415 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7ca1c2e9-98c6-46ae-a7d3-8102a2edf458 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:24.341442 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4bf5d0d1-e663-402f-b271-871f114c243e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4518 microversion: 2.1 time: 0.615630 Oct 26 13:21:24.342638 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2225/4456] 10.222.0.40 () {58 vars in 1173 bytes} [Wed Oct 26 13:21:23 2022] GET /compute/v2.1/servers/detail?status=active => generated 4518 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:24.343126 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7ca1c2e9-98c6-46ae-a7d3-8102a2edf458 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:24.345512 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7ca1c2e9-98c6-46ae-a7d3-8102a2edf458 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:24.346755 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7ca1c2e9-98c6-46ae-a7d3-8102a2edf458 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 2212 microversion: 2.32 time: 0.269361 Oct 26 13:21:24.347551 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2232/4457] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:24 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 2212 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:21:24.354710 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3ecd16ee-b784-4245-bbc8-3f7be2b388b2 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:24.355469 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3ecd16ee-b784-4245-bbc8-3f7be2b388b2 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 8ec8dff5-3985-4f1c-9d2e-ddd28d538476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:24.376042 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e8fe6e21-0172-4bf4-aaa0-93662200b84b tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:24.381649 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e8fe6e21-0172-4bf4-aaa0-93662200b84b tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:24.381835 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3ecd16ee-b784-4245-bbc8-3f7be2b388b2 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:24.382164 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3ecd16ee-b784-4245-bbc8-3f7be2b388b2 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:24.382390 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.compute.servers [None req-e8fe6e21-0172-4bf4-aaa0-93662200b84b tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Removing options 'limit' from query {{(pid=120597) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 26 13:21:24.382618 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3ecd16ee-b784-4245-bbc8-3f7be2b388b2 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:24.383304 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e8fe6e21-0172-4bf4-aaa0-93662200b84b tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Searching by: {'deleted': False, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b'} {{(pid=120597) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:21:24.383939 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3ecd16ee-b784-4245-bbc8-3f7be2b388b2 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:24.388712 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e8fe6e21-0172-4bf4-aaa0-93662200b84b tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:24.389286 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e8fe6e21-0172-4bf4-aaa0-93662200b84b tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:24.389815 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e8fe6e21-0172-4bf4-aaa0-93662200b84b tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:24.390658 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e8fe6e21-0172-4bf4-aaa0-93662200b84b tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:24.391162 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e8fe6e21-0172-4bf4-aaa0-93662200b84b tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:24.391651 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e8fe6e21-0172-4bf4-aaa0-93662200b84b tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:24.391927 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3ecd16ee-b784-4245-bbc8-3f7be2b388b2 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:24.392481 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3ecd16ee-b784-4245-bbc8-3f7be2b388b2 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:24.474884 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e8fe6e21-0172-4bf4-aaa0-93662200b84b tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:24.485256 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e8fe6e21-0172-4bf4-aaa0-93662200b84b tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:24.485851 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e8fe6e21-0172-4bf4-aaa0-93662200b84b tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:24.486288 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e8fe6e21-0172-4bf4-aaa0-93662200b84b tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:24.582946 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3ecd16ee-b784-4245-bbc8-3f7be2b388b2 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:24.609275 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3ecd16ee-b784-4245-bbc8-3f7be2b388b2 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:24.611113 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3ecd16ee-b784-4245-bbc8-3f7be2b388b2 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:24.612309 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3ecd16ee-b784-4245-bbc8-3f7be2b388b2 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476" status: 200 len: 1366 microversion: 2.47 time: 0.268775 Oct 26 13:21:24.613064 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2226/4458] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:24 2022] GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476 => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:24.625394 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5d8cfb98-273a-45ed-ad40-1991531e2c7f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:24.627429 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5d8cfb98-273a-45ed-ad40-1991531e2c7f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:24.637339 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5d8cfb98-273a-45ed-ad40-1991531e2c7f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:24.638507 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5d8cfb98-273a-45ed-ad40-1991531e2c7f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:24.640913 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5d8cfb98-273a-45ed-ad40-1991531e2c7f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:24.641929 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5d8cfb98-273a-45ed-ad40-1991531e2c7f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:24.642632 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5d8cfb98-273a-45ed-ad40-1991531e2c7f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:24.644230 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5d8cfb98-273a-45ed-ad40-1991531e2c7f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:24.750327 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5d8cfb98-273a-45ed-ad40-1991531e2c7f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:24.760490 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5d8cfb98-273a-45ed-ad40-1991531e2c7f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:24.762203 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5d8cfb98-273a-45ed-ad40-1991531e2c7f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:24.770107 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5d8cfb98-273a-45ed-ad40-1991531e2c7f tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1537 microversion: 2.91 time: 0.151179 Oct 26 13:21:24.781509 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2227/4459] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:24 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1537 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:24.781509 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-401e7127-3d7b-44e8-a17d-649d0c9d16a2 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:24.781509 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-401e7127-3d7b-44e8-a17d-649d0c9d16a2 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:24.795415 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-401e7127-3d7b-44e8-a17d-649d0c9d16a2 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:24.797782 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-401e7127-3d7b-44e8-a17d-649d0c9d16a2 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:24.801364 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-401e7127-3d7b-44e8-a17d-649d0c9d16a2 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:24.802457 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-401e7127-3d7b-44e8-a17d-649d0c9d16a2 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:24.803110 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-401e7127-3d7b-44e8-a17d-649d0c9d16a2 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:24.803450 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-401e7127-3d7b-44e8-a17d-649d0c9d16a2 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:24.857515 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e8fe6e21-0172-4bf4-aaa0-93662200b84b tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1662 microversion: 2.1 time: 0.485395 Oct 26 13:21:24.858708 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2233/4460] 10.222.0.40 () {58 vars in 1161 bytes} [Wed Oct 26 13:21:24 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1662 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:24.892767 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a06b5c94-5dd5-4d0f-a730-88eda53fcd2a tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:24.903030 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a06b5c94-5dd5-4d0f-a730-88eda53fcd2a tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:24.904773 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a06b5c94-5dd5-4d0f-a730-88eda53fcd2a tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b'} {{(pid=120597) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:21:24.914266 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a06b5c94-5dd5-4d0f-a730-88eda53fcd2a tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:24.914857 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a06b5c94-5dd5-4d0f-a730-88eda53fcd2a tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:24.915412 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a06b5c94-5dd5-4d0f-a730-88eda53fcd2a tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:24.918519 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a06b5c94-5dd5-4d0f-a730-88eda53fcd2a tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:24.919044 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a06b5c94-5dd5-4d0f-a730-88eda53fcd2a tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:24.919926 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a06b5c94-5dd5-4d0f-a730-88eda53fcd2a tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:24.961445 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.multi_cell_list [None req-a06b5c94-5dd5-4d0f-a730-88eda53fcd2a tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120597) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 13:21:25.002746 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-401e7127-3d7b-44e8-a17d-649d0c9d16a2 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:25.017389 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a06b5c94-5dd5-4d0f-a730-88eda53fcd2a tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers?status=active" status: 200 len: 1009 microversion: 2.1 time: 0.128968 Oct 26 13:21:25.019034 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-401e7127-3d7b-44e8-a17d-649d0c9d16a2 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245" status: 200 len: 1296 microversion: 2.1 time: 0.246676 Oct 26 13:21:25.019681 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2228/4461] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:24 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245 => generated 1296 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:25.026177 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2234/4462] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 26 13:21:24 2022] GET /compute/v2.1/servers?status=active => generated 1009 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:25.039033 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4b3eaf9f-f9cb-4d7a-8b65-9ad0f232e3f3 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:25.048008 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-dac82be0-9775-4923-8f2a-01b8c0b0d749 req-29330c55-8bbd-4bb8-b8d5-ebe180214b5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "893420b7-27d9-4240-8182-87dd3231cbe2", "name": "network-vif-deleted", "tag": "4f406596-ab15-464c-88f4-1a3c9b70369c"}, {"server_uuid": "893420b7-27d9-4240-8182-87dd3231cbe2", "name": "network-vif-deleted", "tag": "82a2023f-2039-4f62-94a6-f0654d4f4db3"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:21:25.062422 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4b3eaf9f-f9cb-4d7a-8b65-9ad0f232e3f3 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:25.064435 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.compute.servers [None req-4b3eaf9f-f9cb-4d7a-8b65-9ad0f232e3f3 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Removing options 'limit' from query {{(pid=120597) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 26 13:21:25.064906 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4b3eaf9f-f9cb-4d7a-8b65-9ad0f232e3f3 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Searching by: {'deleted': False, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b'} {{(pid=120597) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:21:25.069453 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-dac82be0-9775-4923-8f2a-01b8c0b0d749 req-29330c55-8bbd-4bb8-b8d5-ebe180214b5b service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:25.074093 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-dac82be0-9775-4923-8f2a-01b8c0b0d749 req-29330c55-8bbd-4bb8-b8d5-ebe180214b5b service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:25.074730 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-dac82be0-9775-4923-8f2a-01b8c0b0d749 req-29330c55-8bbd-4bb8-b8d5-ebe180214b5b service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:25.076183 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4b3eaf9f-f9cb-4d7a-8b65-9ad0f232e3f3 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:25.076707 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4b3eaf9f-f9cb-4d7a-8b65-9ad0f232e3f3 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:25.077181 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4b3eaf9f-f9cb-4d7a-8b65-9ad0f232e3f3 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:25.077931 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4b3eaf9f-f9cb-4d7a-8b65-9ad0f232e3f3 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:25.078384 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4b3eaf9f-f9cb-4d7a-8b65-9ad0f232e3f3 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:25.078813 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4b3eaf9f-f9cb-4d7a-8b65-9ad0f232e3f3 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:25.111561 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-dac82be0-9775-4923-8f2a-01b8c0b0d749 req-29330c55-8bbd-4bb8-b8d5-ebe180214b5b service nova] Creating event network-vif-deleted:4f406596-ab15-464c-88f4-1a3c9b70369c for instance 893420b7-27d9-4240-8182-87dd3231cbe2 on n-h1-862686-1 Oct 26 13:21:25.112108 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-dac82be0-9775-4923-8f2a-01b8c0b0d749 req-29330c55-8bbd-4bb8-b8d5-ebe180214b5b service nova] Creating event network-vif-deleted:82a2023f-2039-4f62-94a6-f0654d4f4db3 for instance 893420b7-27d9-4240-8182-87dd3231cbe2 on n-h1-862686-1 Oct 26 13:21:25.125503 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-dac82be0-9775-4923-8f2a-01b8c0b0d749 req-29330c55-8bbd-4bb8-b8d5-ebe180214b5b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.081455 Oct 26 13:21:25.126852 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2229/4463] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:21:25.149371 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.multi_cell_list [None req-4b3eaf9f-f9cb-4d7a-8b65-9ad0f232e3f3 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120597) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 13:21:25.202213 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4b3eaf9f-f9cb-4d7a-8b65-9ad0f232e3f3 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1009 microversion: 2.1 time: 0.171361 Oct 26 13:21:25.202803 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2235/4464] 10.222.0.40 () {58 vars in 1150 bytes} [Wed Oct 26 13:21:25 2022] GET /compute/v2.1/servers?limit=100000 => generated 1009 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:25.215821 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-66fb101f-7886-42ad-9922-57e300dcdeed tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:25.227939 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-66fb101f-7886-42ad-9922-57e300dcdeed tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:25.229088 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-66fb101f-7886-42ad-9922-57e300dcdeed tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Searching by: {'deleted': False, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b'} {{(pid=120598) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:21:25.240592 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-66fb101f-7886-42ad-9922-57e300dcdeed tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:25.241077 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-66fb101f-7886-42ad-9922-57e300dcdeed tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:25.241555 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-66fb101f-7886-42ad-9922-57e300dcdeed tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:25.242318 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-66fb101f-7886-42ad-9922-57e300dcdeed tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:25.244464 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-66fb101f-7886-42ad-9922-57e300dcdeed tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:25.244907 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-66fb101f-7886-42ad-9922-57e300dcdeed tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:25.295567 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.multi_cell_list [None req-66fb101f-7886-42ad-9922-57e300dcdeed tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120598) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 13:21:25.337311 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-66fb101f-7886-42ad-9922-57e300dcdeed tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 1009 microversion: 2.1 time: 0.125173 Oct 26 13:21:25.348722 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2230/4465] 10.222.0.40 () {58 vars in 1125 bytes} [Wed Oct 26 13:21:25 2022] GET /compute/v2.1/servers => generated 1009 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:25.357593 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e93828e6-d1da-4586-94d8-8eeaa783e7e8 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:25.364883 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e93828e6-d1da-4586-94d8-8eeaa783e7e8 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:25.365840 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e93828e6-d1da-4586-94d8-8eeaa783e7e8 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b'} {{(pid=120597) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:21:25.377323 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c0e081ce-5c41-4552-9c58-4293c77b2280 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:25.378103 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c0e081ce-5c41-4552-9c58-4293c77b2280 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:25.380413 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e93828e6-d1da-4586-94d8-8eeaa783e7e8 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:25.381850 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e93828e6-d1da-4586-94d8-8eeaa783e7e8 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:25.382440 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e93828e6-d1da-4586-94d8-8eeaa783e7e8 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:25.383375 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e93828e6-d1da-4586-94d8-8eeaa783e7e8 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:25.384162 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e93828e6-d1da-4586-94d8-8eeaa783e7e8 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:25.384826 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e93828e6-d1da-4586-94d8-8eeaa783e7e8 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:25.392115 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0e081ce-5c41-4552-9c58-4293c77b2280 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:25.396265 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0e081ce-5c41-4552-9c58-4293c77b2280 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:25.396754 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0e081ce-5c41-4552-9c58-4293c77b2280 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:25.397778 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0e081ce-5c41-4552-9c58-4293c77b2280 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:25.398258 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0e081ce-5c41-4552-9c58-4293c77b2280 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:25.399977 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0e081ce-5c41-4552-9c58-4293c77b2280 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:25.533817 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c0e081ce-5c41-4552-9c58-4293c77b2280 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:25.548449 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c0e081ce-5c41-4552-9c58-4293c77b2280 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:25.549945 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c0e081ce-5c41-4552-9c58-4293c77b2280 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:25.551186 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c0e081ce-5c41-4552-9c58-4293c77b2280 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1603 microversion: 2.32 time: 0.180009 Oct 26 13:21:25.564339 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2231/4466] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:25 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1603 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:25.570317 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.multi_cell_list [None req-e93828e6-d1da-4586-94d8-8eeaa783e7e8 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120597) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 13:21:25.577515 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-da824298-9941-423e-96bb-c62d5e6bdf01 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:25.578022 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-da824298-9941-423e-96bb-c62d5e6bdf01 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:25.593256 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da824298-9941-423e-96bb-c62d5e6bdf01 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:25.593840 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da824298-9941-423e-96bb-c62d5e6bdf01 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:25.594209 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da824298-9941-423e-96bb-c62d5e6bdf01 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:25.603291 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da824298-9941-423e-96bb-c62d5e6bdf01 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:25.603923 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da824298-9941-423e-96bb-c62d5e6bdf01 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:25.604375 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da824298-9941-423e-96bb-c62d5e6bdf01 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:25.646683 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-da824298-9941-423e-96bb-c62d5e6bdf01 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] HTTP exception thrown: Instance bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 could not be found. Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-da824298-9941-423e-96bb-c62d5e6bdf01 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Request method failure captured: Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: request: DELETE /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 HTTP/1.1 Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTK8yiFaYn6FsK4kYH1E6E6NSE9_hIaDskjf1tRy-XgeLhCgjcaBIDqmW8VSjfB2Cmb6DMkQzh-y_Wh40jTHlXsuv7XA0N3K6RDEzKD5nf9Z6iWWIgYAqlJtxWSsEOqwe1NAtEPEvPHN4gJ5RH5unfT6e5xSWJOJigX6JmjW0X-SjQA Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 174da5e5c60449b7a04e9cf2aa3b9fda Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-AttachVolumeNegativeTest-770748596 Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/174da5e5c60449b7a04e9cf2aa3b9fda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/174da5e5c60449b7a04e9cf2aa3b9fda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_174da5e5c60449b7a04e9cf2aa3b9fda"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/174da5e5c60449b7a04e9cf2aa3b9fda"}]}] Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-AttachVolumeNegativeTest-770748596 Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 174da5e5c60449b7a04e9cf2aa3b9fda Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-770748596 Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-AttachVolumeNegativeTest-770748596-project Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 168c83cd1b014f82945f4915e3ece079 Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-AttachVolumeNegativeTest-770748596-project Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 could not be found. Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9'} Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 could not be found. Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:21:25.648650 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:21:25.652273 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 could not be found. Oct 26 13:21:25.652273 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:21:25.652273 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:21:25.652273 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:21:25.652273 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:25.652273 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:21:25.652273 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:21:25.652273 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:21:25.652273 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:21:25.652273 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 could not be found. Oct 26 13:21:25.652273 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:21:25.656423 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-da824298-9941-423e-96bb-c62d5e6bdf01 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Returning 404 to user: Instance bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:21:25.657475 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-da824298-9941-423e-96bb-c62d5e6bdf01 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "DELETE /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9" status: 404 len: 111 microversion: 2.1 time: 0.083896 Oct 26 13:21:25.665802 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2232/4467] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:21:25 2022] DELETE /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:21:25.670934 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b89d0717-98de-4c1d-a743-6ce877ca299d tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:25.677281 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e93828e6-d1da-4586-94d8-8eeaa783e7e8 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.324620 Oct 26 13:21:25.678526 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b89d0717-98de-4c1d-a743-6ce877ca299d tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 8ec8dff5-3985-4f1c-9d2e-ddd28d538476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:25.680092 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2236/4468] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:21:25 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:21:25.695972 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b89d0717-98de-4c1d-a743-6ce877ca299d tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:25.696766 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b89d0717-98de-4c1d-a743-6ce877ca299d tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:25.697393 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b89d0717-98de-4c1d-a743-6ce877ca299d tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:25.698480 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b89d0717-98de-4c1d-a743-6ce877ca299d tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:25.699137 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b89d0717-98de-4c1d-a743-6ce877ca299d tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:25.699751 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b89d0717-98de-4c1d-a743-6ce877ca299d tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:25.702222 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-101deb41-f58f-4506-98e3-21f5b228d4c7 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:25.706835 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-101deb41-f58f-4506-98e3-21f5b228d4c7 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:25.732284 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-101deb41-f58f-4506-98e3-21f5b228d4c7 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:25.733283 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-101deb41-f58f-4506-98e3-21f5b228d4c7 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:25.734384 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-101deb41-f58f-4506-98e3-21f5b228d4c7 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:25.736929 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-101deb41-f58f-4506-98e3-21f5b228d4c7 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:25.737734 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-101deb41-f58f-4506-98e3-21f5b228d4c7 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:25.741746 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-101deb41-f58f-4506-98e3-21f5b228d4c7 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:25.792142 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-101deb41-f58f-4506-98e3-21f5b228d4c7 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] HTTP exception thrown: Instance bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 could not be found. Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-101deb41-f58f-4506-98e3-21f5b228d4c7 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Request method failure captured: Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 HTTP/1.1 Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTK8yiFaYn6FsK4kYH1E6E6NSE9_hIaDskjf1tRy-XgeLhCgjcaBIDqmW8VSjfB2Cmb6DMkQzh-y_Wh40jTHlXsuv7XA0N3K6RDEzKD5nf9Z6iWWIgYAqlJtxWSsEOqwe1NAtEPEvPHN4gJ5RH5unfT6e5xSWJOJigX6JmjW0X-SjQA Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 174da5e5c60449b7a04e9cf2aa3b9fda Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-AttachVolumeNegativeTest-770748596 Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/174da5e5c60449b7a04e9cf2aa3b9fda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/174da5e5c60449b7a04e9cf2aa3b9fda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_174da5e5c60449b7a04e9cf2aa3b9fda"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/174da5e5c60449b7a04e9cf2aa3b9fda"}]}] Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-AttachVolumeNegativeTest-770748596 Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 174da5e5c60449b7a04e9cf2aa3b9fda Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-770748596 Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-AttachVolumeNegativeTest-770748596-project Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 168c83cd1b014f82945f4915e3ece079 Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-AttachVolumeNegativeTest-770748596-project Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 could not be found. Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9'} Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 could not be found. Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 could not be found. Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:21:25.797590 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:25.802369 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:25.802369 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:21:25.802369 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:21:25.802369 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:21:25.802369 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:21:25.802369 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 could not be found. Oct 26 13:21:25.802369 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:25.802369 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-101deb41-f58f-4506-98e3-21f5b228d4c7 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Returning 404 to user: Instance bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:21:25.802369 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-101deb41-f58f-4506-98e3-21f5b228d4c7 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9" status: 404 len: 111 microversion: 2.1 time: 0.117745 Oct 26 13:21:25.808027 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2237/4469] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:25 2022] GET /compute/v2.1/servers/bcec7d7a-33fd-4b0c-98c8-bc59c49c79f9 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:21:25.812607 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f2e8a3fa-4490-460a-bf2b-0565aad7a84a tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:25.826871 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f2e8a3fa-4490-460a-bf2b-0565aad7a84a tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:25.827241 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.compute.servers [None req-f2e8a3fa-4490-460a-bf2b-0565aad7a84a tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Removing options 'limit' from query {{(pid=120597) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 26 13:21:25.827922 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f2e8a3fa-4490-460a-bf2b-0565aad7a84a tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Searching by: {'deleted': False, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b'} {{(pid=120597) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:21:25.834309 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b89d0717-98de-4c1d-a743-6ce877ca299d tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:25.838025 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2e8a3fa-4490-460a-bf2b-0565aad7a84a tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:25.838311 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2e8a3fa-4490-460a-bf2b-0565aad7a84a tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:25.838800 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2e8a3fa-4490-460a-bf2b-0565aad7a84a tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:25.839801 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2e8a3fa-4490-460a-bf2b-0565aad7a84a tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:25.840134 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2e8a3fa-4490-460a-bf2b-0565aad7a84a tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:25.840710 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2e8a3fa-4490-460a-bf2b-0565aad7a84a tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:25.856513 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b89d0717-98de-4c1d-a743-6ce877ca299d tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:25.858572 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b89d0717-98de-4c1d-a743-6ce877ca299d tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:25.867033 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b89d0717-98de-4c1d-a743-6ce877ca299d tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476" status: 200 len: 1366 microversion: 2.47 time: 0.199885 Oct 26 13:21:25.867622 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2233/4470] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:25 2022] GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476 => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:25.884086 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-43e322bb-aab1-45df-8391-298b582ecece tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:25.886754 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-43e322bb-aab1-45df-8391-298b582ecece tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:25.888412 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f2e8a3fa-4490-460a-bf2b-0565aad7a84a tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.081261 Oct 26 13:21:25.889353 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2238/4471] 10.222.0.40 () {58 vars in 1140 bytes} [Wed Oct 26 13:21:25 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:21:25.900611 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-43e322bb-aab1-45df-8391-298b582ecece tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:25.901431 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-43e322bb-aab1-45df-8391-298b582ecece tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:25.902088 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-43e322bb-aab1-45df-8391-298b582ecece tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:25.902991 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-43e322bb-aab1-45df-8391-298b582ecece tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:25.903631 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-43e322bb-aab1-45df-8391-298b582ecece tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:25.904247 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-43e322bb-aab1-45df-8391-298b582ecece tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:25.906972 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-96629cf3-23a2-4db3-ba9d-0da4603c15fc tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:25.911447 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-96629cf3-23a2-4db3-ba9d-0da4603c15fc tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 2c859d43-c102-4189-9e7a-6c88ff38f311] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:25.927687 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96629cf3-23a2-4db3-ba9d-0da4603c15fc tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:25.929240 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96629cf3-23a2-4db3-ba9d-0da4603c15fc tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:25.929802 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96629cf3-23a2-4db3-ba9d-0da4603c15fc tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:25.932141 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96629cf3-23a2-4db3-ba9d-0da4603c15fc tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:25.932617 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96629cf3-23a2-4db3-ba9d-0da4603c15fc tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:25.935373 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96629cf3-23a2-4db3-ba9d-0da4603c15fc tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:25.974946 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-96629cf3-23a2-4db3-ba9d-0da4603c15fc tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] HTTP exception thrown: Instance 2c859d43-c102-4189-9e7a-6c88ff38f311 could not be found. Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-96629cf3-23a2-4db3-ba9d-0da4603c15fc tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Request method failure captured: Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311 HTTP/1.1 Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTK8yiFaYn6FsK4kYH1E6E6NSE9_hIaDskjf1tRy-XgeLhCgjcaBIDqmW8VSjfB2Cmb6DMkQzh-y_Wh40jTHlXsuv7XA0N3K6RDEzKD5nf9Z6iWWIgYAqlJtxWSsEOqwe1NAtEPEvPHN4gJ5RH5unfT6e5xSWJOJigX6JmjW0X-SjQA Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 174da5e5c60449b7a04e9cf2aa3b9fda Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-AttachVolumeNegativeTest-770748596 Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/174da5e5c60449b7a04e9cf2aa3b9fda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/174da5e5c60449b7a04e9cf2aa3b9fda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_174da5e5c60449b7a04e9cf2aa3b9fda"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/174da5e5c60449b7a04e9cf2aa3b9fda"}]}] Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-AttachVolumeNegativeTest-770748596 Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 174da5e5c60449b7a04e9cf2aa3b9fda Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-770748596 Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-AttachVolumeNegativeTest-770748596-project Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 168c83cd1b014f82945f4915e3ece079 Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-AttachVolumeNegativeTest-770748596-project Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 2c859d43-c102-4189-9e7a-6c88ff38f311 could not be found. Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '2c859d43-c102-4189-9e7a-6c88ff38f311'} Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c859d43-c102-4189-9e7a-6c88ff38f311 could not be found. Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:21:25.981144 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:21:25.984567 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c859d43-c102-4189-9e7a-6c88ff38f311 could not be found. Oct 26 13:21:25.984567 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:25.984567 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:21:25.984567 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:25.984567 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:25.984567 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:21:25.984567 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:21:25.984567 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:21:25.984567 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:21:25.984567 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c859d43-c102-4189-9e7a-6c88ff38f311 could not be found. Oct 26 13:21:25.984567 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:25.991733 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-96629cf3-23a2-4db3-ba9d-0da4603c15fc tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Returning 404 to user: Instance 2c859d43-c102-4189-9e7a-6c88ff38f311 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:21:25.992891 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-96629cf3-23a2-4db3-ba9d-0da4603c15fc tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311" status: 404 len: 111 microversion: 2.1 time: 0.102365 Oct 26 13:21:25.996862 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2239/4472] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:21:25 2022] DELETE /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:21:26.004930 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c38f5247-0906-4c93-921c-4a92cd9d726b tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:26.014938 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c38f5247-0906-4c93-921c-4a92cd9d726b tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:26.017147 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c38f5247-0906-4c93-921c-4a92cd9d726b tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-55967892', 'deleted': False, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b'} {{(pid=120597) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:21:26.033850 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c38f5247-0906-4c93-921c-4a92cd9d726b tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:26.034548 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c38f5247-0906-4c93-921c-4a92cd9d726b tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:26.035129 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c38f5247-0906-4c93-921c-4a92cd9d726b tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:26.036078 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c38f5247-0906-4c93-921c-4a92cd9d726b tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:26.036685 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c38f5247-0906-4c93-921c-4a92cd9d726b tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:26.037259 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c38f5247-0906-4c93-921c-4a92cd9d726b tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:26.048791 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-43e322bb-aab1-45df-8391-298b582ecece tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:26.073169 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-43e322bb-aab1-45df-8391-298b582ecece tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:26.076943 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-43e322bb-aab1-45df-8391-298b582ecece tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:26.090358 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-43e322bb-aab1-45df-8391-298b582ecece tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1540 microversion: 2.91 time: 0.221344 Oct 26 13:21:26.091597 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2234/4473] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:25 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1540 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:26.115401 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f8567a3d-5996-4ac7-bbca-c0f8fa264cdb tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:26.117040 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f8567a3d-5996-4ac7-bbca-c0f8fa264cdb tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 2c859d43-c102-4189-9e7a-6c88ff38f311] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:26.139000 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8567a3d-5996-4ac7-bbca-c0f8fa264cdb tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:26.154884 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8567a3d-5996-4ac7-bbca-c0f8fa264cdb tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:26.157034 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8567a3d-5996-4ac7-bbca-c0f8fa264cdb tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:26.159326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8567a3d-5996-4ac7-bbca-c0f8fa264cdb tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:26.160157 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8567a3d-5996-4ac7-bbca-c0f8fa264cdb tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:26.162469 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8567a3d-5996-4ac7-bbca-c0f8fa264cdb tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:26.197055 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-f8567a3d-5996-4ac7-bbca-c0f8fa264cdb tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] HTTP exception thrown: Instance 2c859d43-c102-4189-9e7a-6c88ff38f311 could not be found. Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f8567a3d-5996-4ac7-bbca-c0f8fa264cdb tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Request method failure captured: Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311 HTTP/1.1 Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTK8yiFaYn6FsK4kYH1E6E6NSE9_hIaDskjf1tRy-XgeLhCgjcaBIDqmW8VSjfB2Cmb6DMkQzh-y_Wh40jTHlXsuv7XA0N3K6RDEzKD5nf9Z6iWWIgYAqlJtxWSsEOqwe1NAtEPEvPHN4gJ5RH5unfT6e5xSWJOJigX6JmjW0X-SjQA Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 174da5e5c60449b7a04e9cf2aa3b9fda Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-AttachVolumeNegativeTest-770748596 Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/174da5e5c60449b7a04e9cf2aa3b9fda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/174da5e5c60449b7a04e9cf2aa3b9fda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_174da5e5c60449b7a04e9cf2aa3b9fda"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/174da5e5c60449b7a04e9cf2aa3b9fda"}]}] Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-AttachVolumeNegativeTest-770748596 Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 174da5e5c60449b7a04e9cf2aa3b9fda Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-770748596 Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-AttachVolumeNegativeTest-770748596-project Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 168c83cd1b014f82945f4915e3ece079 Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-AttachVolumeNegativeTest-770748596-project Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 2c859d43-c102-4189-9e7a-6c88ff38f311 could not be found. Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '2c859d43-c102-4189-9e7a-6c88ff38f311'} Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c859d43-c102-4189-9e7a-6c88ff38f311 could not be found. Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c859d43-c102-4189-9e7a-6c88ff38f311 could not be found. Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:21:26.198890 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:21:26.203186 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:26.203186 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:21:26.203186 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:21:26.203186 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:21:26.203186 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:21:26.203186 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c859d43-c102-4189-9e7a-6c88ff38f311 could not be found. Oct 26 13:21:26.203186 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:21:26.204280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f8567a3d-5996-4ac7-bbca-c0f8fa264cdb tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Returning 404 to user: Instance 2c859d43-c102-4189-9e7a-6c88ff38f311 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:21:26.206912 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f8567a3d-5996-4ac7-bbca-c0f8fa264cdb tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311" status: 404 len: 111 microversion: 2.1 time: 0.113553 Oct 26 13:21:26.209596 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2235/4474] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:26 2022] GET /compute/v2.1/servers/2c859d43-c102-4189-9e7a-6c88ff38f311 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:21:26.221794 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d76822f6-ddfb-450c-a520-3cddc6ab8236 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:26.222556 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d76822f6-ddfb-450c-a520-3cddc6ab8236 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:26.234993 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d76822f6-ddfb-450c-a520-3cddc6ab8236 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:26.238082 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d76822f6-ddfb-450c-a520-3cddc6ab8236 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:26.239155 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d76822f6-ddfb-450c-a520-3cddc6ab8236 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:26.242271 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d76822f6-ddfb-450c-a520-3cddc6ab8236 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:26.242904 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d76822f6-ddfb-450c-a520-3cddc6ab8236 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:26.243606 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d76822f6-ddfb-450c-a520-3cddc6ab8236 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:26.298447 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.multi_cell_list [None req-c38f5247-0906-4c93-921c-4a92cd9d726b tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120597) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 13:21:26.303745 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:21:26.363063 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d76822f6-ddfb-450c-a520-3cddc6ab8236 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:26.377656 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d76822f6-ddfb-450c-a520-3cddc6ab8236 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245" status: 200 len: 1302 microversion: 2.1 time: 0.166513 Oct 26 13:21:26.395315 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2236/4475] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:26 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245 => generated 1302 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:26.407182 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ab7f1da6-cdec-4fbb-a208-ec3c276ce6c3 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-862686-1"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:21:26.414284 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ab7f1da6-cdec-4fbb-a208-ec3c276ce6c3 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:26.429557 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab7f1da6-cdec-4fbb-a208-ec3c276ce6c3 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:26.430837 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c38f5247-0906-4c93-921c-4a92cd9d726b tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-55967892" status: 200 len: 344 microversion: 2.1 time: 0.432591 Oct 26 13:21:26.431287 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab7f1da6-cdec-4fbb-a208-ec3c276ce6c3 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:26.431892 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab7f1da6-cdec-4fbb-a208-ec3c276ce6c3 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:26.433792 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab7f1da6-cdec-4fbb-a208-ec3c276ce6c3 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:26.435649 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab7f1da6-cdec-4fbb-a208-ec3c276ce6c3 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:26.436256 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab7f1da6-cdec-4fbb-a208-ec3c276ce6c3 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:26.441968 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2240/4476] 10.222.0.40 () {58 vars in 1238 bytes} [Wed Oct 26 13:21:25 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-55967892 => generated 344 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:21:26.469806 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-25d7f736-d15a-436c-9c8b-3c86e52d5e4f tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:21:26.493516 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-25d7f736-d15a-436c-9c8b-3c86e52d5e4f tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:26.493516 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-25d7f736-d15a-436c-9c8b-3c86e52d5e4f tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:26.493516 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-25d7f736-d15a-436c-9c8b-3c86e52d5e4f tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:26.510696 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:21:26.563815 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-25d7f736-d15a-436c-9c8b-3c86e52d5e4f tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: d7cd631a-a439-481d-ab67-f5a0c9d0ef86] Going to try to stop instance {{(pid=120597) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 26 13:21:26.581853 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ab7f1da6-cdec-4fbb-a208-ec3c276ce6c3 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-862686-1". {{(pid=120598) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 26 13:21:26.665252 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-25d7f736-d15a-436c-9c8b-3c86e52d5e4f tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "POST /compute/v2.1/servers/d7cd631a-a439-481d-ab67-f5a0c9d0ef86/action" status: 202 len: 0 microversion: 2.1 time: 0.221027 Oct 26 13:21:26.665901 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2241/4477] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:21:26 2022] POST /compute/v2.1/servers/d7cd631a-a439-481d-ab67-f5a0c9d0ef86/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 13:21:26.682728 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-74c2d49f-2e71-455d-b3e9-7177c62e97b0 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:26.683429 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-74c2d49f-2e71-455d-b3e9-7177c62e97b0 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:26.691377 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-74c2d49f-2e71-455d-b3e9-7177c62e97b0 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:26.692667 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-74c2d49f-2e71-455d-b3e9-7177c62e97b0 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:26.693145 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-74c2d49f-2e71-455d-b3e9-7177c62e97b0 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:26.693877 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-74c2d49f-2e71-455d-b3e9-7177c62e97b0 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:26.694385 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-74c2d49f-2e71-455d-b3e9-7177c62e97b0 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:26.694812 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-74c2d49f-2e71-455d-b3e9-7177c62e97b0 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:26.713274 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ab7f1da6-cdec-4fbb-a208-ec3c276ce6c3 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3/action" status: 202 len: 0 microversion: 2.91 time: 0.313338 Oct 26 13:21:26.717768 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2237/4478] 10.222.0.40 () {62 vars in 1319 bytes} [Wed Oct 26 13:21:26 2022] POST /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:21:26.728061 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a644f495-9eaa-41eb-9056-fcb267b7cf81 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:26.728545 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a644f495-9eaa-41eb-9056-fcb267b7cf81 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: d7cd631a-a439-481d-ab67-f5a0c9d0ef86] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:26.745887 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a644f495-9eaa-41eb-9056-fcb267b7cf81 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:26.747015 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a644f495-9eaa-41eb-9056-fcb267b7cf81 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:26.747686 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a644f495-9eaa-41eb-9056-fcb267b7cf81 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:26.749414 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a644f495-9eaa-41eb-9056-fcb267b7cf81 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:26.750150 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a644f495-9eaa-41eb-9056-fcb267b7cf81 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:26.751857 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a644f495-9eaa-41eb-9056-fcb267b7cf81 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:26.924398 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-74c2d49f-2e71-455d-b3e9-7177c62e97b0 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:26.959106 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-74c2d49f-2e71-455d-b3e9-7177c62e97b0 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:26.960873 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-74c2d49f-2e71-455d-b3e9-7177c62e97b0 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:26.962132 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-74c2d49f-2e71-455d-b3e9-7177c62e97b0 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1603 microversion: 2.32 time: 0.284504 Oct 26 13:21:26.978535 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2242/4479] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:26 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1603 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:26.987362 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e5b45848-e09b-4b86-87c0-3bdd981f23ca tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:26.989265 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e5b45848-e09b-4b86-87c0-3bdd981f23ca tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:26.995755 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a644f495-9eaa-41eb-9056-fcb267b7cf81 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:27.008334 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a644f495-9eaa-41eb-9056-fcb267b7cf81 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/d7cd631a-a439-481d-ab67-f5a0c9d0ef86" status: 200 len: 1520 microversion: 2.1 time: 0.286911 Oct 26 13:21:27.010409 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2238/4480] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:26 2022] GET /compute/v2.1/servers/d7cd631a-a439-481d-ab67-f5a0c9d0ef86 => generated 1520 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:27.026598 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e5b45848-e09b-4b86-87c0-3bdd981f23ca tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:27.027288 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e5b45848-e09b-4b86-87c0-3bdd981f23ca tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:27.027930 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e5b45848-e09b-4b86-87c0-3bdd981f23ca tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:27.028639 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e5b45848-e09b-4b86-87c0-3bdd981f23ca tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:27.029096 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e5b45848-e09b-4b86-87c0-3bdd981f23ca tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:27.029667 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e5b45848-e09b-4b86-87c0-3bdd981f23ca tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:27.032602 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6bb8a494-985a-49d4-8553-82cd7f70d051 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:27.033281 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6bb8a494-985a-49d4-8553-82cd7f70d051 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 8ec8dff5-3985-4f1c-9d2e-ddd28d538476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:27.045820 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6bb8a494-985a-49d4-8553-82cd7f70d051 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:27.050090 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6bb8a494-985a-49d4-8553-82cd7f70d051 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:27.053358 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6bb8a494-985a-49d4-8553-82cd7f70d051 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:27.054551 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6bb8a494-985a-49d4-8553-82cd7f70d051 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:27.055176 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6bb8a494-985a-49d4-8553-82cd7f70d051 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:27.056932 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6bb8a494-985a-49d4-8553-82cd7f70d051 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:27.187419 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6bb8a494-985a-49d4-8553-82cd7f70d051 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:27.202615 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6bb8a494-985a-49d4-8553-82cd7f70d051 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:27.204081 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6bb8a494-985a-49d4-8553-82cd7f70d051 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:27.205273 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6bb8a494-985a-49d4-8553-82cd7f70d051 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476" status: 200 len: 1366 microversion: 2.47 time: 0.193663 Oct 26 13:21:27.206719 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2239/4481] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:27 2022] GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476 => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:27.270041 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e5b45848-e09b-4b86-87c0-3bdd981f23ca tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:27.283288 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e5b45848-e09b-4b86-87c0-3bdd981f23ca tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:27.288768 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e5b45848-e09b-4b86-87c0-3bdd981f23ca tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:27.301668 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e5b45848-e09b-4b86-87c0-3bdd981f23ca tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1488 microversion: 2.91 time: 0.337266 Oct 26 13:21:27.303266 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2243/4482] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:26 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1488 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:27.402189 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-12c4c063-09fc-4dd8-8091-b94e24bb93ba tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:27.402405 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-12c4c063-09fc-4dd8-8091-b94e24bb93ba tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:27.413931 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-12c4c063-09fc-4dd8-8091-b94e24bb93ba tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:27.414553 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-12c4c063-09fc-4dd8-8091-b94e24bb93ba tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:27.414899 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-12c4c063-09fc-4dd8-8091-b94e24bb93ba tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:27.415682 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-12c4c063-09fc-4dd8-8091-b94e24bb93ba tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:27.416078 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-12c4c063-09fc-4dd8-8091-b94e24bb93ba tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:27.416526 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-12c4c063-09fc-4dd8-8091-b94e24bb93ba tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:27.500380 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-12c4c063-09fc-4dd8-8091-b94e24bb93ba tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:27.540022 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-12c4c063-09fc-4dd8-8091-b94e24bb93ba tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245" status: 200 len: 1302 microversion: 2.1 time: 0.135990 Oct 26 13:21:27.546440 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2240/4483] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:27 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245 => generated 1302 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:27.869035 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-38889fa1-293b-4c4d-b569-3a8918c00ad3 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-589913844", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6564d3ba-587e-4d4c-8bc6-474830ea64a0"}], "security_groups": [{"name": "tempest-securitygroup--590491038"}], "key_name": "tempest-keypair-30575218", "user_data": "}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:21:27.995542 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ad67650a-bd53-4200-b885-92d3aac16cb5 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:27.996155 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ad67650a-bd53-4200-b885-92d3aac16cb5 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:28.006356 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ad67650a-bd53-4200-b885-92d3aac16cb5 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:28.007031 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ad67650a-bd53-4200-b885-92d3aac16cb5 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:28.007432 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ad67650a-bd53-4200-b885-92d3aac16cb5 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:28.008145 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ad67650a-bd53-4200-b885-92d3aac16cb5 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:28.008614 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ad67650a-bd53-4200-b885-92d3aac16cb5 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:28.009076 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ad67650a-bd53-4200-b885-92d3aac16cb5 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:28.106850 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ad67650a-bd53-4200-b885-92d3aac16cb5 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:28.119962 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ad67650a-bd53-4200-b885-92d3aac16cb5 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:28.121810 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ad67650a-bd53-4200-b885-92d3aac16cb5 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:28.123266 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ad67650a-bd53-4200-b885-92d3aac16cb5 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1603 microversion: 2.32 time: 0.132042 Oct 26 13:21:28.124447 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2241/4484] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:27 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1603 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:28.138529 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-118534c2-e9a7-4414-af25-2706cabe9c7e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:28.141898 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-118534c2-e9a7-4414-af25-2706cabe9c7e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: d7cd631a-a439-481d-ab67-f5a0c9d0ef86] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:28.159757 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-118534c2-e9a7-4414-af25-2706cabe9c7e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:28.161117 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-118534c2-e9a7-4414-af25-2706cabe9c7e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:28.161817 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-118534c2-e9a7-4414-af25-2706cabe9c7e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:28.162745 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-118534c2-e9a7-4414-af25-2706cabe9c7e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:28.163422 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-118534c2-e9a7-4414-af25-2706cabe9c7e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:28.164057 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-118534c2-e9a7-4414-af25-2706cabe9c7e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:28.206039 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-38889fa1-293b-4c4d-b569-3a8918c00ad3 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] validate_networks() for [('6564d3ba-587e-4d4c-8bc6-474830ea64a0', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:21:28.424924 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-118534c2-e9a7-4414-af25-2706cabe9c7e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:28.434757 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-118534c2-e9a7-4414-af25-2706cabe9c7e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/d7cd631a-a439-481d-ab67-f5a0c9d0ef86" status: 200 len: 1520 microversion: 2.1 time: 0.308935 Oct 26 13:21:28.435708 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2242/4485] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:28 2022] GET /compute/v2.1/servers/d7cd631a-a439-481d-ab67-f5a0c9d0ef86 => generated 1520 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:28.440736 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7101d923-f0f0-4a69-afcd-075c77b13b31 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:28.441524 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7101d923-f0f0-4a69-afcd-075c77b13b31 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 8ec8dff5-3985-4f1c-9d2e-ddd28d538476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:28.449510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7101d923-f0f0-4a69-afcd-075c77b13b31 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:28.450214 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7101d923-f0f0-4a69-afcd-075c77b13b31 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:28.450917 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7101d923-f0f0-4a69-afcd-075c77b13b31 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:28.451701 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7101d923-f0f0-4a69-afcd-075c77b13b31 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:28.452227 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7101d923-f0f0-4a69-afcd-075c77b13b31 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:28.452715 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7101d923-f0f0-4a69-afcd-075c77b13b31 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:28.553415 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7101d923-f0f0-4a69-afcd-075c77b13b31 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:28.566034 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7101d923-f0f0-4a69-afcd-075c77b13b31 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:28.567737 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7101d923-f0f0-4a69-afcd-075c77b13b31 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:28.568926 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7101d923-f0f0-4a69-afcd-075c77b13b31 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476" status: 200 len: 1366 microversion: 2.47 time: 0.132220 Oct 26 13:21:28.569710 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2243/4486] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:28 2022] GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476 => generated 1366 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:28.574484 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-dd241d21-679e-45e9-8c9c-7486e3a95fb4 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:28.575086 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-dd241d21-679e-45e9-8c9c-7486e3a95fb4 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:28.581710 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dd241d21-679e-45e9-8c9c-7486e3a95fb4 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:28.582469 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dd241d21-679e-45e9-8c9c-7486e3a95fb4 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:28.583099 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dd241d21-679e-45e9-8c9c-7486e3a95fb4 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:28.584031 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dd241d21-679e-45e9-8c9c-7486e3a95fb4 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:28.584565 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dd241d21-679e-45e9-8c9c-7486e3a95fb4 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:28.585404 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dd241d21-679e-45e9-8c9c-7486e3a95fb4 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:28.732913 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-dd241d21-679e-45e9-8c9c-7486e3a95fb4 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:28.750764 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-dd241d21-679e-45e9-8c9c-7486e3a95fb4 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:28.760839 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-dd241d21-679e-45e9-8c9c-7486e3a95fb4 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:28.772799 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-dd241d21-679e-45e9-8c9c-7486e3a95fb4 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1546 microversion: 2.91 time: 0.202173 Oct 26 13:21:28.786121 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2244/4487] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:28 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1546 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:28.801737 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fb646bfb-4656-49cf-8378-41152d77dfb4 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:28.802503 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fb646bfb-4656-49cf-8378-41152d77dfb4 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:28.817106 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fb646bfb-4656-49cf-8378-41152d77dfb4 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:28.817972 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fb646bfb-4656-49cf-8378-41152d77dfb4 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:28.818782 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fb646bfb-4656-49cf-8378-41152d77dfb4 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:28.820125 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fb646bfb-4656-49cf-8378-41152d77dfb4 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:28.820615 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fb646bfb-4656-49cf-8378-41152d77dfb4 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:28.821313 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fb646bfb-4656-49cf-8378-41152d77dfb4 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:29.083606 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fb646bfb-4656-49cf-8378-41152d77dfb4 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:29.098102 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fb646bfb-4656-49cf-8378-41152d77dfb4 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245" status: 200 len: 1369 microversion: 2.1 time: 0.323173 Oct 26 13:21:29.099166 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2245/4488] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:28 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245 => generated 1369 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:29.108085 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-38889fa1-293b-4c4d-b569-3a8918c00ad3 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:21:29.109803 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-38889fa1-293b-4c4d-b569-3a8918c00ad3 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:21:29.110782 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-38889fa1-293b-4c4d-b569-3a8918c00ad3 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:21:29.111611 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-38889fa1-293b-4c4d-b569-3a8918c00ad3 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:21:29.111998 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-38889fa1-293b-4c4d-b569-3a8918c00ad3 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:21:29.116102 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:21:29.133978 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38889fa1-293b-4c4d-b569-3a8918c00ad3 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:29.136304 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38889fa1-293b-4c4d-b569-3a8918c00ad3 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:29.137609 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38889fa1-293b-4c4d-b569-3a8918c00ad3 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:29.138474 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38889fa1-293b-4c4d-b569-3a8918c00ad3 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:29.139011 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38889fa1-293b-4c4d-b569-3a8918c00ad3 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:29.139539 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38889fa1-293b-4c4d-b569-3a8918c00ad3 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:29.154815 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bd8320b0-ddbe-4bc7-8e49-4d61ccc5af2e tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:29.155724 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bd8320b0-ddbe-4bc7-8e49-4d61ccc5af2e tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:29.162488 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd8320b0-ddbe-4bc7-8e49-4d61ccc5af2e tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:29.162974 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd8320b0-ddbe-4bc7-8e49-4d61ccc5af2e tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:29.163411 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd8320b0-ddbe-4bc7-8e49-4d61ccc5af2e tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:29.164116 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd8320b0-ddbe-4bc7-8e49-4d61ccc5af2e tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:29.165171 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd8320b0-ddbe-4bc7-8e49-4d61ccc5af2e tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:29.165711 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd8320b0-ddbe-4bc7-8e49-4d61ccc5af2e tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:29.168603 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-38889fa1-293b-4c4d-b569-3a8918c00ad3 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Getting quotas for project e1f158446a544e5680969f4ef7512e49. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:21:29.174489 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-38889fa1-293b-4c4d-b569-3a8918c00ad3 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Getting quotas for user 0b457ab0af5e41b1a1e10290b67656a7 and project e1f158446a544e5680969f4ef7512e49. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:21:29.190872 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-38889fa1-293b-4c4d-b569-3a8918c00ad3 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:21:29.194141 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-38889fa1-293b-4c4d-b569-3a8918c00ad3 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:21:29.260399 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-38889fa1-293b-4c4d-b569-3a8918c00ad3 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.406453 Oct 26 13:21:29.261391 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2244/4489] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:21:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 1408 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:21:29.271116 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bd8320b0-ddbe-4bc7-8e49-4d61ccc5af2e tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:29.291636 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-453dd11f-d72d-49d1-b3ab-81ae4b3ed3b3 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:29.292221 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-453dd11f-d72d-49d1-b3ab-81ae4b3ed3b3 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:29.297979 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bd8320b0-ddbe-4bc7-8e49-4d61ccc5af2e tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:29.300489 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bd8320b0-ddbe-4bc7-8e49-4d61ccc5af2e tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:29.302912 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bd8320b0-ddbe-4bc7-8e49-4d61ccc5af2e tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1603 microversion: 2.32 time: 0.154416 Oct 26 13:21:29.304598 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2246/4490] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:29 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1603 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:29.455631 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-453dd11f-d72d-49d1-b3ab-81ae4b3ed3b3 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:29.464202 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-453dd11f-d72d-49d1-b3ab-81ae4b3ed3b3 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6" status: 200 len: 1235 microversion: 2.1 time: 0.183914 Oct 26 13:21:29.464611 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9468a2d5-6b9e-455e-8ded-bd36586f5f6e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:29.466137 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9468a2d5-6b9e-455e-8ded-bd36586f5f6e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: d7cd631a-a439-481d-ab67-f5a0c9d0ef86] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:29.468507 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2245/4491] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:29 2022] GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6 => generated 1235 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:29.484923 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9468a2d5-6b9e-455e-8ded-bd36586f5f6e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:29.485415 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9468a2d5-6b9e-455e-8ded-bd36586f5f6e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:29.486133 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9468a2d5-6b9e-455e-8ded-bd36586f5f6e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:29.486647 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9468a2d5-6b9e-455e-8ded-bd36586f5f6e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:29.487065 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9468a2d5-6b9e-455e-8ded-bd36586f5f6e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:29.487488 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9468a2d5-6b9e-455e-8ded-bd36586f5f6e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:29.596578 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-748af317-2666-4fc7-8efc-68172d64f7a8 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:29.597196 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-748af317-2666-4fc7-8efc-68172d64f7a8 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 8ec8dff5-3985-4f1c-9d2e-ddd28d538476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:29.606996 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-748af317-2666-4fc7-8efc-68172d64f7a8 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:29.607500 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-748af317-2666-4fc7-8efc-68172d64f7a8 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:29.607943 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-748af317-2666-4fc7-8efc-68172d64f7a8 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:29.608652 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-748af317-2666-4fc7-8efc-68172d64f7a8 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:29.609125 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-748af317-2666-4fc7-8efc-68172d64f7a8 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:29.610990 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-748af317-2666-4fc7-8efc-68172d64f7a8 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:29.842185 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9468a2d5-6b9e-455e-8ded-bd36586f5f6e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:29.852300 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9468a2d5-6b9e-455e-8ded-bd36586f5f6e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/d7cd631a-a439-481d-ab67-f5a0c9d0ef86" status: 200 len: 1520 microversion: 2.1 time: 0.393188 Oct 26 13:21:29.852972 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2247/4492] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:29 2022] GET /compute/v2.1/servers/d7cd631a-a439-481d-ab67-f5a0c9d0ef86 => generated 1520 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:21:29.858299 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-447a8407-89b9-4a79-b924-e2820ff7cedc tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:29.859162 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-447a8407-89b9-4a79-b924-e2820ff7cedc tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:29.863342 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-748af317-2666-4fc7-8efc-68172d64f7a8 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:29.867297 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-447a8407-89b9-4a79-b924-e2820ff7cedc tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:29.868006 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-447a8407-89b9-4a79-b924-e2820ff7cedc tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:29.869373 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-447a8407-89b9-4a79-b924-e2820ff7cedc tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:29.870921 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-447a8407-89b9-4a79-b924-e2820ff7cedc tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:29.872088 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-447a8407-89b9-4a79-b924-e2820ff7cedc tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:29.873149 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-447a8407-89b9-4a79-b924-e2820ff7cedc tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:29.894127 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-748af317-2666-4fc7-8efc-68172d64f7a8 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:29.896379 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-748af317-2666-4fc7-8efc-68172d64f7a8 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:29.900429 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-748af317-2666-4fc7-8efc-68172d64f7a8 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476" status: 200 len: 1366 microversion: 2.47 time: 0.308157 Oct 26 13:21:29.902697 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2246/4493] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:29 2022] GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476 => generated 1366 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:21:30.016396 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-447a8407-89b9-4a79-b924-e2820ff7cedc tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:30.036165 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-447a8407-89b9-4a79-b924-e2820ff7cedc tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:30.037939 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-447a8407-89b9-4a79-b924-e2820ff7cedc tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:30.049507 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-447a8407-89b9-4a79-b924-e2820ff7cedc tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1546 microversion: 2.91 time: 0.195017 Oct 26 13:21:30.050381 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2248/4494] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:29 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1546 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:30.123996 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d510e807-c1e4-4fd2-aa61-c907c2950edf tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:30.124840 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d510e807-c1e4-4fd2-aa61-c907c2950edf tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:30.138783 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d510e807-c1e4-4fd2-aa61-c907c2950edf tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:30.139420 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d510e807-c1e4-4fd2-aa61-c907c2950edf tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:30.139875 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d510e807-c1e4-4fd2-aa61-c907c2950edf tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:30.140593 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d510e807-c1e4-4fd2-aa61-c907c2950edf tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:30.141184 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d510e807-c1e4-4fd2-aa61-c907c2950edf tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:30.141467 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d510e807-c1e4-4fd2-aa61-c907c2950edf tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:30.341682 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-54d7fb9e-ca69-4260-962c-557f7031a0b1 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:30.342475 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-54d7fb9e-ca69-4260-962c-557f7031a0b1 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:30.364561 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54d7fb9e-ca69-4260-962c-557f7031a0b1 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:30.366559 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54d7fb9e-ca69-4260-962c-557f7031a0b1 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:30.370148 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54d7fb9e-ca69-4260-962c-557f7031a0b1 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:30.374729 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54d7fb9e-ca69-4260-962c-557f7031a0b1 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:30.377183 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54d7fb9e-ca69-4260-962c-557f7031a0b1 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:30.381624 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54d7fb9e-ca69-4260-962c-557f7031a0b1 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:30.531533 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-54d7fb9e-ca69-4260-962c-557f7031a0b1 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:30.546375 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-54d7fb9e-ca69-4260-962c-557f7031a0b1 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:30.548133 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-54d7fb9e-ca69-4260-962c-557f7031a0b1 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:30.549766 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-54d7fb9e-ca69-4260-962c-557f7031a0b1 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1603 microversion: 2.32 time: 0.219543 Oct 26 13:21:30.551244 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2249/4495] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:30 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1603 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:30.558595 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-fb2a96dc-bb96-471b-aab8-603184bc8371 req-9ba4ee47-2917-4350-b8de-f04ac93a8b97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b93fff60-64e6-436d-9390-03d80438b245", "tag": "85286063-c895-4327-af58-6433dca2108f"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:21:30.570931 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-fb2a96dc-bb96-471b-aab8-603184bc8371 req-9ba4ee47-2917-4350-b8de-f04ac93a8b97 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:30.571488 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-fb2a96dc-bb96-471b-aab8-603184bc8371 req-9ba4ee47-2917-4350-b8de-f04ac93a8b97 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:30.572156 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-fb2a96dc-bb96-471b-aab8-603184bc8371 req-9ba4ee47-2917-4350-b8de-f04ac93a8b97 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:30.589583 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-fb2a96dc-bb96-471b-aab8-603184bc8371 req-9ba4ee47-2917-4350-b8de-f04ac93a8b97 service nova] Creating event network-changed:85286063-c895-4327-af58-6433dca2108f for instance b93fff60-64e6-436d-9390-03d80438b245 on n-h2-862686-1 Oct 26 13:21:30.596683 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-fb2a96dc-bb96-471b-aab8-603184bc8371 req-9ba4ee47-2917-4350-b8de-f04ac93a8b97 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042310 Oct 26 13:21:30.598464 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2250/4496] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:21:30.607256 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-20995eeb-792e-4370-b56c-b6edec7fbc29 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:30.608310 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-20995eeb-792e-4370-b56c-b6edec7fbc29 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:30.617117 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-20995eeb-792e-4370-b56c-b6edec7fbc29 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:30.617687 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-20995eeb-792e-4370-b56c-b6edec7fbc29 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:30.618259 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-20995eeb-792e-4370-b56c-b6edec7fbc29 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:30.619087 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-20995eeb-792e-4370-b56c-b6edec7fbc29 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:30.619771 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-20995eeb-792e-4370-b56c-b6edec7fbc29 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:30.620393 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-20995eeb-792e-4370-b56c-b6edec7fbc29 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:30.717342 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-20995eeb-792e-4370-b56c-b6edec7fbc29 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:30.729853 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-20995eeb-792e-4370-b56c-b6edec7fbc29 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6" status: 200 len: 1287 microversion: 2.1 time: 0.129530 Oct 26 13:21:30.732236 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2251/4497] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:30 2022] GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6 => generated 1287 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:30.747187 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d510e807-c1e4-4fd2-aa61-c907c2950edf tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:30.761839 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d510e807-c1e4-4fd2-aa61-c907c2950edf tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245" status: 200 len: 1369 microversion: 2.1 time: 0.642834 Oct 26 13:21:30.763475 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2247/4498] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:30 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245 => generated 1369 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:30.876729 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-23137c23-5a50-4f28-98e1-36e88acae4c3 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:30.877755 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-23137c23-5a50-4f28-98e1-36e88acae4c3 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: d7cd631a-a439-481d-ab67-f5a0c9d0ef86] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:30.893273 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-23137c23-5a50-4f28-98e1-36e88acae4c3 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:30.898256 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-23137c23-5a50-4f28-98e1-36e88acae4c3 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:30.899319 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-23137c23-5a50-4f28-98e1-36e88acae4c3 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:30.902273 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-23137c23-5a50-4f28-98e1-36e88acae4c3 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:30.903822 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-23137c23-5a50-4f28-98e1-36e88acae4c3 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:30.905410 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-23137c23-5a50-4f28-98e1-36e88acae4c3 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:30.933597 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6ba27276-d71f-41a4-9bac-8a2c4700f754 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:30.934415 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6ba27276-d71f-41a4-9bac-8a2c4700f754 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 8ec8dff5-3985-4f1c-9d2e-ddd28d538476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:30.949030 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ba27276-d71f-41a4-9bac-8a2c4700f754 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:30.949578 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ba27276-d71f-41a4-9bac-8a2c4700f754 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:30.950023 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ba27276-d71f-41a4-9bac-8a2c4700f754 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:30.950730 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ba27276-d71f-41a4-9bac-8a2c4700f754 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:30.951188 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ba27276-d71f-41a4-9bac-8a2c4700f754 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:30.951612 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ba27276-d71f-41a4-9bac-8a2c4700f754 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:31.099737 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6ba27276-d71f-41a4-9bac-8a2c4700f754 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:31.116486 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6ba27276-d71f-41a4-9bac-8a2c4700f754 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:31.119579 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6ba27276-d71f-41a4-9bac-8a2c4700f754 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:31.124907 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6ba27276-d71f-41a4-9bac-8a2c4700f754 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476" status: 200 len: 1366 microversion: 2.47 time: 0.193244 Oct 26 13:21:31.126407 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2248/4499] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:30 2022] GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:31.135783 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c5f48766-4002-473d-97b1-d10bf1835b3b tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:31.136654 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c5f48766-4002-473d-97b1-d10bf1835b3b tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:31.144262 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c5f48766-4002-473d-97b1-d10bf1835b3b tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:31.145089 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c5f48766-4002-473d-97b1-d10bf1835b3b tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:31.145676 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c5f48766-4002-473d-97b1-d10bf1835b3b tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:31.146694 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c5f48766-4002-473d-97b1-d10bf1835b3b tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:31.147403 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c5f48766-4002-473d-97b1-d10bf1835b3b tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:31.148422 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c5f48766-4002-473d-97b1-d10bf1835b3b tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:31.240850 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c5f48766-4002-473d-97b1-d10bf1835b3b tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:31.241777 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-23137c23-5a50-4f28-98e1-36e88acae4c3 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:31.256352 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c5f48766-4002-473d-97b1-d10bf1835b3b tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:31.258247 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c5f48766-4002-473d-97b1-d10bf1835b3b tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:31.259811 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-23137c23-5a50-4f28-98e1-36e88acae4c3 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/d7cd631a-a439-481d-ab67-f5a0c9d0ef86" status: 200 len: 1520 microversion: 2.1 time: 0.387137 Oct 26 13:21:31.260876 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2252/4500] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:30 2022] GET /compute/v2.1/servers/d7cd631a-a439-481d-ab67-f5a0c9d0ef86 => generated 1520 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:31.321808 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c5f48766-4002-473d-97b1-d10bf1835b3b tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1546 microversion: 2.91 time: 0.191918 Oct 26 13:21:31.327544 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2249/4501] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:31 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1546 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:31.579205 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6e515622-fe6a-468c-8160-89386af43a6a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:31.579922 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6e515622-fe6a-468c-8160-89386af43a6a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:31.592901 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e515622-fe6a-468c-8160-89386af43a6a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:31.593401 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e515622-fe6a-468c-8160-89386af43a6a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:31.593861 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e515622-fe6a-468c-8160-89386af43a6a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:31.594574 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e515622-fe6a-468c-8160-89386af43a6a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:31.595042 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e515622-fe6a-468c-8160-89386af43a6a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:31.595577 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e515622-fe6a-468c-8160-89386af43a6a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:31.627455 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:21:31.726748 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6e515622-fe6a-468c-8160-89386af43a6a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:31.740613 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6e515622-fe6a-468c-8160-89386af43a6a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:31.742535 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6e515622-fe6a-468c-8160-89386af43a6a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:31.745633 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6e515622-fe6a-468c-8160-89386af43a6a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1603 microversion: 2.32 time: 0.171059 Oct 26 13:21:31.747277 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2253/4502] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:31 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1603 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:31.771881 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4da5334a-5b48-42c0-8cb4-ba2868f0fb21 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:31.772555 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4da5334a-5b48-42c0-8cb4-ba2868f0fb21 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:31.790784 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ce5f87a8-7cb5-4a69-bbad-5aeb4085b79a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:31.791395 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ce5f87a8-7cb5-4a69-bbad-5aeb4085b79a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:31.803112 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4da5334a-5b48-42c0-8cb4-ba2868f0fb21 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:31.805719 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4da5334a-5b48-42c0-8cb4-ba2868f0fb21 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:31.807686 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4da5334a-5b48-42c0-8cb4-ba2868f0fb21 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:31.814080 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4da5334a-5b48-42c0-8cb4-ba2868f0fb21 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:31.814591 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4da5334a-5b48-42c0-8cb4-ba2868f0fb21 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:31.815044 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4da5334a-5b48-42c0-8cb4-ba2868f0fb21 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:31.825744 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ce5f87a8-7cb5-4a69-bbad-5aeb4085b79a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:31.826249 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ce5f87a8-7cb5-4a69-bbad-5aeb4085b79a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:31.826694 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ce5f87a8-7cb5-4a69-bbad-5aeb4085b79a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:31.827418 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ce5f87a8-7cb5-4a69-bbad-5aeb4085b79a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:31.827879 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ce5f87a8-7cb5-4a69-bbad-5aeb4085b79a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:31.828309 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ce5f87a8-7cb5-4a69-bbad-5aeb4085b79a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:32.152495 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4da5334a-5b48-42c0-8cb4-ba2868f0fb21 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:32.168951 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4da5334a-5b48-42c0-8cb4-ba2868f0fb21 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6" status: 200 len: 1305 microversion: 2.1 time: 0.408867 Oct 26 13:21:32.170732 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2250/4503] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:31 2022] GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6 => generated 1305 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:32.180856 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-298c213b-1eea-4dfe-bc31-fdfe11ab1334 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:32.186405 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-298c213b-1eea-4dfe-bc31-fdfe11ab1334 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 8ec8dff5-3985-4f1c-9d2e-ddd28d538476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:32.203201 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-298c213b-1eea-4dfe-bc31-fdfe11ab1334 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:32.203939 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-298c213b-1eea-4dfe-bc31-fdfe11ab1334 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:32.205171 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-298c213b-1eea-4dfe-bc31-fdfe11ab1334 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:32.206218 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-298c213b-1eea-4dfe-bc31-fdfe11ab1334 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:32.208950 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-298c213b-1eea-4dfe-bc31-fdfe11ab1334 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:32.209539 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-298c213b-1eea-4dfe-bc31-fdfe11ab1334 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:32.305577 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ce5f87a8-7cb5-4a69-bbad-5aeb4085b79a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:32.329883 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ce5f87a8-7cb5-4a69-bbad-5aeb4085b79a tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245" status: 200 len: 1369 microversion: 2.1 time: 0.541143 Oct 26 13:21:32.337308 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2254/4504] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:31 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245 => generated 1369 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:32.356857 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0b6dad65-9371-4ea2-8947-3f323e473854 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:32.358534 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0b6dad65-9371-4ea2-8947-3f323e473854 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: d7cd631a-a439-481d-ab67-f5a0c9d0ef86] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:32.374430 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0b6dad65-9371-4ea2-8947-3f323e473854 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:32.376376 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0b6dad65-9371-4ea2-8947-3f323e473854 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:32.383485 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0b6dad65-9371-4ea2-8947-3f323e473854 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:32.384912 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0b6dad65-9371-4ea2-8947-3f323e473854 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:32.389151 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0b6dad65-9371-4ea2-8947-3f323e473854 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:32.390339 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0b6dad65-9371-4ea2-8947-3f323e473854 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:32.473681 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-298c213b-1eea-4dfe-bc31-fdfe11ab1334 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:32.497086 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-298c213b-1eea-4dfe-bc31-fdfe11ab1334 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:32.507411 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-298c213b-1eea-4dfe-bc31-fdfe11ab1334 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:32.511853 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-298c213b-1eea-4dfe-bc31-fdfe11ab1334 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476" status: 200 len: 1366 microversion: 2.47 time: 0.339726 Oct 26 13:21:32.537034 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2251/4505] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:32 2022] GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476 => generated 1366 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:32.555862 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1d96804c-de95-4462-b687-61affb882ee7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:32.558703 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1d96804c-de95-4462-b687-61affb882ee7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:32.584955 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d96804c-de95-4462-b687-61affb882ee7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:32.595375 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d96804c-de95-4462-b687-61affb882ee7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:32.595953 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d96804c-de95-4462-b687-61affb882ee7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:32.596718 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d96804c-de95-4462-b687-61affb882ee7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:32.597201 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d96804c-de95-4462-b687-61affb882ee7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:32.598207 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d96804c-de95-4462-b687-61affb882ee7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:32.703277 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0b6dad65-9371-4ea2-8947-3f323e473854 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:32.715359 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0b6dad65-9371-4ea2-8947-3f323e473854 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/d7cd631a-a439-481d-ab67-f5a0c9d0ef86" status: 200 len: 1497 microversion: 2.1 time: 0.374137 Oct 26 13:21:32.716220 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2255/4506] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:32 2022] GET /compute/v2.1/servers/d7cd631a-a439-481d-ab67-f5a0c9d0ef86 => generated 1497 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:32.747222 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-526bfa28-9cf2-4dc6-a591-71faea6faa00 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:32.757077 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-526bfa28-9cf2-4dc6-a591-71faea6faa00 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:32.760142 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-526bfa28-9cf2-4dc6-a591-71faea6faa00 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b'} {{(pid=120598) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:21:32.767199 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:21:32.784810 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1d96804c-de95-4462-b687-61affb882ee7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:32.789179 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-526bfa28-9cf2-4dc6-a591-71faea6faa00 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:32.789646 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-526bfa28-9cf2-4dc6-a591-71faea6faa00 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:32.792576 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-526bfa28-9cf2-4dc6-a591-71faea6faa00 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:32.793695 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-526bfa28-9cf2-4dc6-a591-71faea6faa00 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:32.796606 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-526bfa28-9cf2-4dc6-a591-71faea6faa00 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:32.797172 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1d96804c-de95-4462-b687-61affb882ee7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:32.797589 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-526bfa28-9cf2-4dc6-a591-71faea6faa00 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:32.800737 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1d96804c-de95-4462-b687-61affb882ee7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:32.830524 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1d96804c-de95-4462-b687-61affb882ee7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1546 microversion: 2.91 time: 0.292001 Oct 26 13:21:32.831120 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2252/4507] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:32 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1546 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:32.840942 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9dc2f13e-7e77-4d7b-b0e9-d87aba1dcdb0 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:32.848827 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9dc2f13e-7e77-4d7b-b0e9-d87aba1dcdb0 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:32.896942 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9dc2f13e-7e77-4d7b-b0e9-d87aba1dcdb0 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:32.907086 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9dc2f13e-7e77-4d7b-b0e9-d87aba1dcdb0 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:32.908540 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9dc2f13e-7e77-4d7b-b0e9-d87aba1dcdb0 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:32.910437 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9dc2f13e-7e77-4d7b-b0e9-d87aba1dcdb0 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:32.912517 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9dc2f13e-7e77-4d7b-b0e9-d87aba1dcdb0 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:32.917025 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9dc2f13e-7e77-4d7b-b0e9-d87aba1dcdb0 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:33.029897 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.multi_cell_list [None req-526bfa28-9cf2-4dc6-a591-71faea6faa00 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120598) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 13:21:33.169244 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9dc2f13e-7e77-4d7b-b0e9-d87aba1dcdb0 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:33.171759 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-526bfa28-9cf2-4dc6-a591-71faea6faa00 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 344 microversion: 2.1 time: 0.430809 Oct 26 13:21:33.174247 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2256/4508] 10.222.0.40 () {58 vars in 1154 bytes} [Wed Oct 26 13:21:32 2022] GET /compute/v2.1/servers?status=shutoff => generated 344 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:21:33.203863 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-33c421d1-785a-4ca1-845b-fffa2fe35c05 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:21:33.207805 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9dc2f13e-7e77-4d7b-b0e9-d87aba1dcdb0 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:33.218500 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9dc2f13e-7e77-4d7b-b0e9-d87aba1dcdb0 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:33.219870 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9dc2f13e-7e77-4d7b-b0e9-d87aba1dcdb0 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1603 microversion: 2.32 time: 0.382653 Oct 26 13:21:33.220464 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2253/4509] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:32 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1603 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:33.234667 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33c421d1-785a-4ca1-845b-fffa2fe35c05 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:33.234667 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33c421d1-785a-4ca1-845b-fffa2fe35c05 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:33.234667 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33c421d1-785a-4ca1-845b-fffa2fe35c05 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:33.240135 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0ec7df61-7ba4-4c0a-9dc3-5ce8ce203d59 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:33.240709 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0ec7df61-7ba4-4c0a-9dc3-5ce8ce203d59 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:33.270882 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ec7df61-7ba4-4c0a-9dc3-5ce8ce203d59 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:33.272745 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ec7df61-7ba4-4c0a-9dc3-5ce8ce203d59 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:33.274300 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ec7df61-7ba4-4c0a-9dc3-5ce8ce203d59 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:33.276595 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ec7df61-7ba4-4c0a-9dc3-5ce8ce203d59 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:33.278084 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ec7df61-7ba4-4c0a-9dc3-5ce8ce203d59 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:33.279871 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ec7df61-7ba4-4c0a-9dc3-5ce8ce203d59 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:33.311804 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-33c421d1-785a-4ca1-845b-fffa2fe35c05 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: d7cd631a-a439-481d-ab67-f5a0c9d0ef86] Going to try to start instance {{(pid=120598) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 26 13:21:33.487221 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-33c421d1-785a-4ca1-845b-fffa2fe35c05 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "POST /compute/v2.1/servers/d7cd631a-a439-481d-ab67-f5a0c9d0ef86/action" status: 202 len: 0 microversion: 2.1 time: 0.299318 Oct 26 13:21:33.489988 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2257/4510] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:21:33 2022] POST /compute/v2.1/servers/d7cd631a-a439-481d-ab67-f5a0c9d0ef86/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:21:33.502986 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-58ff6c9d-43f9-46f1-b431-416933c268fd tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:33.510120 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-58ff6c9d-43f9-46f1-b431-416933c268fd tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:33.539432 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-58ff6c9d-43f9-46f1-b431-416933c268fd tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:33.543139 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-58ff6c9d-43f9-46f1-b431-416933c268fd tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:33.543794 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-58ff6c9d-43f9-46f1-b431-416933c268fd tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:33.547456 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-58ff6c9d-43f9-46f1-b431-416933c268fd tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:33.548041 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-58ff6c9d-43f9-46f1-b431-416933c268fd tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:33.550306 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-58ff6c9d-43f9-46f1-b431-416933c268fd tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:33.908858 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-58ff6c9d-43f9-46f1-b431-416933c268fd tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:33.924225 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-58ff6c9d-43f9-46f1-b431-416933c268fd tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245" status: 200 len: 1369 microversion: 2.1 time: 0.429456 Oct 26 13:21:33.937509 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2258/4511] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:33 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245 => generated 1369 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:33.938450 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-987306d6-509a-45d5-8459-11ceb65ffc76 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:33.938759 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-987306d6-509a-45d5-8459-11ceb65ffc76 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: d7cd631a-a439-481d-ab67-f5a0c9d0ef86] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:33.953521 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-987306d6-509a-45d5-8459-11ceb65ffc76 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:33.954015 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-987306d6-509a-45d5-8459-11ceb65ffc76 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:33.963001 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-987306d6-509a-45d5-8459-11ceb65ffc76 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:33.964176 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-987306d6-509a-45d5-8459-11ceb65ffc76 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:33.964419 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-987306d6-509a-45d5-8459-11ceb65ffc76 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:33.965009 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-987306d6-509a-45d5-8459-11ceb65ffc76 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:34.022640 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=14 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:21:34.055280 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0ec7df61-7ba4-4c0a-9dc3-5ce8ce203d59 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:34.068431 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0ec7df61-7ba4-4c0a-9dc3-5ce8ce203d59 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6" status: 200 len: 1360 microversion: 2.1 time: 0.843820 Oct 26 13:21:34.073198 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2254/4512] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:33 2022] GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6 => generated 1360 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:34.101732 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7e27c652-a13b-4ed9-bde9-3a9e89e3ad5b tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:34.105229 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7e27c652-a13b-4ed9-bde9-3a9e89e3ad5b tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 8ec8dff5-3985-4f1c-9d2e-ddd28d538476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:34.132597 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e27c652-a13b-4ed9-bde9-3a9e89e3ad5b tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:34.141225 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e27c652-a13b-4ed9-bde9-3a9e89e3ad5b tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:34.142535 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e27c652-a13b-4ed9-bde9-3a9e89e3ad5b tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:34.144648 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e27c652-a13b-4ed9-bde9-3a9e89e3ad5b tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:34.145859 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e27c652-a13b-4ed9-bde9-3a9e89e3ad5b tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:34.146298 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e27c652-a13b-4ed9-bde9-3a9e89e3ad5b tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:34.356762 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-987306d6-509a-45d5-8459-11ceb65ffc76 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:34.372564 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-987306d6-509a-45d5-8459-11ceb65ffc76 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/d7cd631a-a439-481d-ab67-f5a0c9d0ef86" status: 200 len: 1506 microversion: 2.1 time: 0.437764 Oct 26 13:21:34.375241 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2259/4513] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:33 2022] GET /compute/v2.1/servers/d7cd631a-a439-481d-ab67-f5a0c9d0ef86 => generated 1506 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:34.386787 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-42d39447-b288-4a13-a4af-4aa192a9e6e6 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:34.391191 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-42d39447-b288-4a13-a4af-4aa192a9e6e6 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:34.406699 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42d39447-b288-4a13-a4af-4aa192a9e6e6 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:34.410382 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42d39447-b288-4a13-a4af-4aa192a9e6e6 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:34.412142 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42d39447-b288-4a13-a4af-4aa192a9e6e6 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:34.414949 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42d39447-b288-4a13-a4af-4aa192a9e6e6 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:34.416363 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42d39447-b288-4a13-a4af-4aa192a9e6e6 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:34.417436 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42d39447-b288-4a13-a4af-4aa192a9e6e6 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:34.442908 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7e27c652-a13b-4ed9-bde9-3a9e89e3ad5b tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:34.453407 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7e27c652-a13b-4ed9-bde9-3a9e89e3ad5b tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:34.473236 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7e27c652-a13b-4ed9-bde9-3a9e89e3ad5b tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:34.483613 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7e27c652-a13b-4ed9-bde9-3a9e89e3ad5b tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476" status: 200 len: 1366 microversion: 2.47 time: 0.400704 Oct 26 13:21:34.498230 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2255/4514] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:34 2022] GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476 => generated 1366 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:34.507288 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-76d32135-55c5-4691-8f73-a13bb37606c5 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:34.507288 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-76d32135-55c5-4691-8f73-a13bb37606c5 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:34.520103 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-76d32135-55c5-4691-8f73-a13bb37606c5 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:34.520828 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-76d32135-55c5-4691-8f73-a13bb37606c5 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:34.521350 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-76d32135-55c5-4691-8f73-a13bb37606c5 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:34.524223 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-76d32135-55c5-4691-8f73-a13bb37606c5 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:34.525350 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-76d32135-55c5-4691-8f73-a13bb37606c5 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:34.526506 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-76d32135-55c5-4691-8f73-a13bb37606c5 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:34.641798 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-42d39447-b288-4a13-a4af-4aa192a9e6e6 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:34.659597 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-42d39447-b288-4a13-a4af-4aa192a9e6e6 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:34.668761 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-42d39447-b288-4a13-a4af-4aa192a9e6e6 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:34.690984 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-42d39447-b288-4a13-a4af-4aa192a9e6e6 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1546 microversion: 2.91 time: 0.314478 Oct 26 13:21:34.705236 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2260/4515] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:34 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1546 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:34.828561 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-76d32135-55c5-4691-8f73-a13bb37606c5 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:34.845026 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-76d32135-55c5-4691-8f73-a13bb37606c5 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:34.859931 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-76d32135-55c5-4691-8f73-a13bb37606c5 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:34.863022 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-76d32135-55c5-4691-8f73-a13bb37606c5 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1603 microversion: 2.32 time: 0.371991 Oct 26 13:21:34.870359 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2256/4516] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:34 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1603 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:34.952903 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7e081653-f7a7-447a-9688-c3bcd054f529 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:34.954319 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7e081653-f7a7-447a-9688-c3bcd054f529 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:34.967995 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e081653-f7a7-447a-9688-c3bcd054f529 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:34.970587 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e081653-f7a7-447a-9688-c3bcd054f529 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:34.971990 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e081653-f7a7-447a-9688-c3bcd054f529 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:34.973520 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e081653-f7a7-447a-9688-c3bcd054f529 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:34.976316 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e081653-f7a7-447a-9688-c3bcd054f529 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:34.976968 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e081653-f7a7-447a-9688-c3bcd054f529 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:35.101300 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4a01a6d2-35fb-44d2-8c00-04842ea35eeb tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:35.101955 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4a01a6d2-35fb-44d2-8c00-04842ea35eeb tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:35.127609 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4a01a6d2-35fb-44d2-8c00-04842ea35eeb tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:35.128115 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4a01a6d2-35fb-44d2-8c00-04842ea35eeb tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:35.128580 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4a01a6d2-35fb-44d2-8c00-04842ea35eeb tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:35.129434 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4a01a6d2-35fb-44d2-8c00-04842ea35eeb tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:35.134995 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4a01a6d2-35fb-44d2-8c00-04842ea35eeb tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:35.135468 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4a01a6d2-35fb-44d2-8c00-04842ea35eeb tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:35.210081 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:21:35.504392 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7e081653-f7a7-447a-9688-c3bcd054f529 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:35.531821 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7e081653-f7a7-447a-9688-c3bcd054f529 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245" status: 200 len: 1369 microversion: 2.1 time: 0.583428 Oct 26 13:21:35.532602 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2261/4517] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:34 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245 => generated 1369 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:35.551991 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9653e9ff-ef81-4c45-acb2-7f2048414a05 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:35.552612 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9653e9ff-ef81-4c45-acb2-7f2048414a05 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: d7cd631a-a439-481d-ab67-f5a0c9d0ef86] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:35.571219 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9653e9ff-ef81-4c45-acb2-7f2048414a05 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:35.571717 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9653e9ff-ef81-4c45-acb2-7f2048414a05 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:35.572152 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9653e9ff-ef81-4c45-acb2-7f2048414a05 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:35.572862 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9653e9ff-ef81-4c45-acb2-7f2048414a05 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:35.573315 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9653e9ff-ef81-4c45-acb2-7f2048414a05 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:35.573770 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9653e9ff-ef81-4c45-acb2-7f2048414a05 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:36.075141 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9653e9ff-ef81-4c45-acb2-7f2048414a05 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:36.091811 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9653e9ff-ef81-4c45-acb2-7f2048414a05 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/d7cd631a-a439-481d-ab67-f5a0c9d0ef86" status: 200 len: 1506 microversion: 2.1 time: 0.541405 Oct 26 13:21:36.143240 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2262/4518] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:35 2022] GET /compute/v2.1/servers/d7cd631a-a439-481d-ab67-f5a0c9d0ef86 => generated 1506 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:36.164457 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a1b72f31-4933-49f2-ab4f-361cbb44d5d2 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:36.167982 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a1b72f31-4933-49f2-ab4f-361cbb44d5d2 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 8ec8dff5-3985-4f1c-9d2e-ddd28d538476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:36.178255 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a1b72f31-4933-49f2-ab4f-361cbb44d5d2 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:36.179067 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a1b72f31-4933-49f2-ab4f-361cbb44d5d2 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:36.179706 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a1b72f31-4933-49f2-ab4f-361cbb44d5d2 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:36.181231 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a1b72f31-4933-49f2-ab4f-361cbb44d5d2 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:36.181864 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a1b72f31-4933-49f2-ab4f-361cbb44d5d2 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:36.182432 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a1b72f31-4933-49f2-ab4f-361cbb44d5d2 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:36.353853 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a1b72f31-4933-49f2-ab4f-361cbb44d5d2 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:36.365500 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a1b72f31-4933-49f2-ab4f-361cbb44d5d2 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:36.382042 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a1b72f31-4933-49f2-ab4f-361cbb44d5d2 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:36.387511 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a1b72f31-4933-49f2-ab4f-361cbb44d5d2 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476" status: 200 len: 1366 microversion: 2.47 time: 0.242881 Oct 26 13:21:36.397528 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2263/4519] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:36 2022] GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476 => generated 1366 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:36.419786 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-59af0e11-b66c-4b05-9cdc-947b60da47e1 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:36.420894 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-59af0e11-b66c-4b05-9cdc-947b60da47e1 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:36.432283 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-59af0e11-b66c-4b05-9cdc-947b60da47e1 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:36.433039 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-59af0e11-b66c-4b05-9cdc-947b60da47e1 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:36.446550 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-59af0e11-b66c-4b05-9cdc-947b60da47e1 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:36.447702 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-59af0e11-b66c-4b05-9cdc-947b60da47e1 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:36.448391 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-59af0e11-b66c-4b05-9cdc-947b60da47e1 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:36.449031 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-59af0e11-b66c-4b05-9cdc-947b60da47e1 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:36.655110 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-59af0e11-b66c-4b05-9cdc-947b60da47e1 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:36.672055 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-59af0e11-b66c-4b05-9cdc-947b60da47e1 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:36.680499 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-59af0e11-b66c-4b05-9cdc-947b60da47e1 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:36.690932 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-59af0e11-b66c-4b05-9cdc-947b60da47e1 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1546 microversion: 2.91 time: 0.292120 Oct 26 13:21:36.696386 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2264/4520] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:36 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1546 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:36.701353 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5dc760dc-7d86-4309-b0eb-bd3667365b13 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:36.710848 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5dc760dc-7d86-4309-b0eb-bd3667365b13 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:36.739760 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5dc760dc-7d86-4309-b0eb-bd3667365b13 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:36.750448 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5dc760dc-7d86-4309-b0eb-bd3667365b13 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:36.758738 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5dc760dc-7d86-4309-b0eb-bd3667365b13 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:36.759618 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5dc760dc-7d86-4309-b0eb-bd3667365b13 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:36.760213 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5dc760dc-7d86-4309-b0eb-bd3667365b13 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:36.762448 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5dc760dc-7d86-4309-b0eb-bd3667365b13 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:36.829092 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4a01a6d2-35fb-44d2-8c00-04842ea35eeb tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:36.864518 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4a01a6d2-35fb-44d2-8c00-04842ea35eeb tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6" status: 200 len: 1360 microversion: 2.1 time: 1.767964 Oct 26 13:21:36.875390 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2257/4521] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:35 2022] GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6 => generated 1360 bytes in 1780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:36.905630 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-bc8a53f8-a215-4190-9737-d41e17878a6f req-c22c8240-2f37-4737-ae3b-51f4727a8cb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b93fff60-64e6-436d-9390-03d80438b245", "name": "network-vif-plugged", "status": "completed", "tag": "85286063-c895-4327-af58-6433dca2108f"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:21:36.912574 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5dc760dc-7d86-4309-b0eb-bd3667365b13 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:36.932304 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-bc8a53f8-a215-4190-9737-d41e17878a6f req-c22c8240-2f37-4737-ae3b-51f4727a8cb4 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:36.933787 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-bc8a53f8-a215-4190-9737-d41e17878a6f req-c22c8240-2f37-4737-ae3b-51f4727a8cb4 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:36.936506 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-bc8a53f8-a215-4190-9737-d41e17878a6f req-c22c8240-2f37-4737-ae3b-51f4727a8cb4 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:36.939707 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5dc760dc-7d86-4309-b0eb-bd3667365b13 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:36.945723 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5dc760dc-7d86-4309-b0eb-bd3667365b13 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:36.947490 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5dc760dc-7d86-4309-b0eb-bd3667365b13 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1603 microversion: 2.32 time: 0.249389 Oct 26 13:21:36.947623 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2265/4522] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:36 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1603 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:36.966710 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9f30ef4f-bfc2-4412-a77b-adba004c6204 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:36.967344 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9f30ef4f-bfc2-4412-a77b-adba004c6204 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:36.968740 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-bc8a53f8-a215-4190-9737-d41e17878a6f req-c22c8240-2f37-4737-ae3b-51f4727a8cb4 service nova] Creating event network-vif-plugged:85286063-c895-4327-af58-6433dca2108f for instance b93fff60-64e6-436d-9390-03d80438b245 on n-h2-862686-1 Oct 26 13:21:36.980516 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9f30ef4f-bfc2-4412-a77b-adba004c6204 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:36.982269 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-bc8a53f8-a215-4190-9737-d41e17878a6f req-c22c8240-2f37-4737-ae3b-51f4727a8cb4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099478 Oct 26 13:21:36.983845 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9f30ef4f-bfc2-4412-a77b-adba004c6204 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:36.984511 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2258/4523] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:21:36.985722 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9f30ef4f-bfc2-4412-a77b-adba004c6204 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:36.987004 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9f30ef4f-bfc2-4412-a77b-adba004c6204 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:36.989574 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9f30ef4f-bfc2-4412-a77b-adba004c6204 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:36.990462 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9f30ef4f-bfc2-4412-a77b-adba004c6204 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:37.125100 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9f92e1a3-a56f-431b-ad20-650f0e6fb25b tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:37.126171 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9f92e1a3-a56f-431b-ad20-650f0e6fb25b tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: d7cd631a-a439-481d-ab67-f5a0c9d0ef86] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:37.153038 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f92e1a3-a56f-431b-ad20-650f0e6fb25b tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:37.153981 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f92e1a3-a56f-431b-ad20-650f0e6fb25b tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:37.154796 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f92e1a3-a56f-431b-ad20-650f0e6fb25b tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:37.158464 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f92e1a3-a56f-431b-ad20-650f0e6fb25b tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:37.159318 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f92e1a3-a56f-431b-ad20-650f0e6fb25b tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:37.165708 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f92e1a3-a56f-431b-ad20-650f0e6fb25b tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:37.377530 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9f30ef4f-bfc2-4412-a77b-adba004c6204 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:37.389227 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9f30ef4f-bfc2-4412-a77b-adba004c6204 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245" status: 200 len: 1369 microversion: 2.1 time: 0.431929 Oct 26 13:21:37.410106 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2266/4524] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:36 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245 => generated 1369 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:37.423227 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-852889e2-5582-4d94-a609-0ca3e2e0bbb7 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:37.425450 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-852889e2-5582-4d94-a609-0ca3e2e0bbb7 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 8ec8dff5-3985-4f1c-9d2e-ddd28d538476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:37.440608 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-852889e2-5582-4d94-a609-0ca3e2e0bbb7 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:37.443132 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-852889e2-5582-4d94-a609-0ca3e2e0bbb7 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:37.446184 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-852889e2-5582-4d94-a609-0ca3e2e0bbb7 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:37.449362 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-852889e2-5582-4d94-a609-0ca3e2e0bbb7 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:37.450101 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-852889e2-5582-4d94-a609-0ca3e2e0bbb7 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:37.450914 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-852889e2-5582-4d94-a609-0ca3e2e0bbb7 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:37.640572 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-852889e2-5582-4d94-a609-0ca3e2e0bbb7 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:37.654576 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-852889e2-5582-4d94-a609-0ca3e2e0bbb7 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:37.656050 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-852889e2-5582-4d94-a609-0ca3e2e0bbb7 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:37.657330 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-852889e2-5582-4d94-a609-0ca3e2e0bbb7 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476" status: 200 len: 1366 microversion: 2.47 time: 0.238631 Oct 26 13:21:37.677180 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2267/4525] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:37 2022] GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476 => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:21:37.729707 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-39952a4c-74d8-4460-add3-e6079ed20802 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:37.730365 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-39952a4c-74d8-4460-add3-e6079ed20802 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:37.740747 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39952a4c-74d8-4460-add3-e6079ed20802 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:37.741230 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39952a4c-74d8-4460-add3-e6079ed20802 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:37.749954 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39952a4c-74d8-4460-add3-e6079ed20802 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:37.750966 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39952a4c-74d8-4460-add3-e6079ed20802 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:37.751677 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39952a4c-74d8-4460-add3-e6079ed20802 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:37.752298 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39952a4c-74d8-4460-add3-e6079ed20802 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:38.065046 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-39952a4c-74d8-4460-add3-e6079ed20802 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:38.067992 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:21:38.103181 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-39952a4c-74d8-4460-add3-e6079ed20802 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:38.105893 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-39952a4c-74d8-4460-add3-e6079ed20802 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:38.116377 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9f92e1a3-a56f-431b-ad20-650f0e6fb25b tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:38.128753 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9f92e1a3-a56f-431b-ad20-650f0e6fb25b tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/d7cd631a-a439-481d-ab67-f5a0c9d0ef86" status: 200 len: 1510 microversion: 2.1 time: 1.006604 Oct 26 13:21:38.130052 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2259/4526] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:37 2022] GET /compute/v2.1/servers/d7cd631a-a439-481d-ab67-f5a0c9d0ef86 => generated 1510 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:38.140640 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-39952a4c-74d8-4460-add3-e6079ed20802 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1546 microversion: 2.91 time: 0.403128 Oct 26 13:21:38.147487 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-626045b3-7f7f-4998-abea-f2cc829c14c6 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:38.149849 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-626045b3-7f7f-4998-abea-f2cc829c14c6 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:38.158122 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2268/4527] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:37 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1546 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:21:38.171453 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-626045b3-7f7f-4998-abea-f2cc829c14c6 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:38.174921 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-626045b3-7f7f-4998-abea-f2cc829c14c6 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:38.177310 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-626045b3-7f7f-4998-abea-f2cc829c14c6 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:38.181799 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-626045b3-7f7f-4998-abea-f2cc829c14c6 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:38.185203 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-626045b3-7f7f-4998-abea-f2cc829c14c6 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:38.187018 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-626045b3-7f7f-4998-abea-f2cc829c14c6 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:38.191123 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3cf61a3c-9a7a-4beb-afab-5649b473e1c7 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:38.194973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3cf61a3c-9a7a-4beb-afab-5649b473e1c7 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:38.219076 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cf61a3c-9a7a-4beb-afab-5649b473e1c7 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:38.219582 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cf61a3c-9a7a-4beb-afab-5649b473e1c7 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:38.220044 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cf61a3c-9a7a-4beb-afab-5649b473e1c7 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:38.220819 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cf61a3c-9a7a-4beb-afab-5649b473e1c7 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:38.221338 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cf61a3c-9a7a-4beb-afab-5649b473e1c7 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:38.221882 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cf61a3c-9a7a-4beb-afab-5649b473e1c7 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:38.407647 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3cf61a3c-9a7a-4beb-afab-5649b473e1c7 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:38.425176 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3cf61a3c-9a7a-4beb-afab-5649b473e1c7 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:38.428300 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3cf61a3c-9a7a-4beb-afab-5649b473e1c7 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:38.432089 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3cf61a3c-9a7a-4beb-afab-5649b473e1c7 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1603 microversion: 2.32 time: 0.272862 Oct 26 13:21:38.435707 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2269/4528] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:38 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1603 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:38.444481 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-d54a2ab3-b6dd-45ef-9871-036ea54bd663 req-6e6af471-579c-4b13-a478-c05bf40cc684 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30dcd11b-b8ec-4095-a7d8-73ce795aeaa6", "tag": "413c2089-e162-4ff6-ae1f-b4d6cf728b5f"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:21:38.484814 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-d54a2ab3-b6dd-45ef-9871-036ea54bd663 req-6e6af471-579c-4b13-a478-c05bf40cc684 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:38.486626 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-d54a2ab3-b6dd-45ef-9871-036ea54bd663 req-6e6af471-579c-4b13-a478-c05bf40cc684 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:38.487149 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-d54a2ab3-b6dd-45ef-9871-036ea54bd663 req-6e6af471-579c-4b13-a478-c05bf40cc684 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:38.529790 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-d54a2ab3-b6dd-45ef-9871-036ea54bd663 req-6e6af471-579c-4b13-a478-c05bf40cc684 service nova] Creating event network-changed:413c2089-e162-4ff6-ae1f-b4d6cf728b5f for instance 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6 on n-h2-862686-1 Oct 26 13:21:38.549340 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-d54a2ab3-b6dd-45ef-9871-036ea54bd663 req-6e6af471-579c-4b13-a478-c05bf40cc684 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110876 Oct 26 13:21:38.552824 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2270/4529] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:21:38.567106 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ed2b1367-d0c6-487b-8817-497bdac0cb32 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:38.577820 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ed2b1367-d0c6-487b-8817-497bdac0cb32 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:38.580193 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.compute.servers [None req-ed2b1367-d0c6-487b-8817-497bdac0cb32 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Removing options 'limit' from query {{(pid=120598) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 26 13:21:38.584895 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ed2b1367-d0c6-487b-8817-497bdac0cb32 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Searching by: {'deleted': False, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b'} {{(pid=120598) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:21:38.588633 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ed2b1367-d0c6-487b-8817-497bdac0cb32 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:38.590704 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ed2b1367-d0c6-487b-8817-497bdac0cb32 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:38.593852 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ed2b1367-d0c6-487b-8817-497bdac0cb32 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:38.597107 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ed2b1367-d0c6-487b-8817-497bdac0cb32 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:38.599218 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ed2b1367-d0c6-487b-8817-497bdac0cb32 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:38.601170 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ed2b1367-d0c6-487b-8817-497bdac0cb32 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:38.604475 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ed2b1367-d0c6-487b-8817-497bdac0cb32 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.050105 Oct 26 13:21:38.611610 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2271/4530] 10.222.0.40 () {58 vars in 1140 bytes} [Wed Oct 26 13:21:38 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:21:38.618537 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-aadf953f-a527-4c58-926d-23a86a087ef1 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:38.629232 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-aadf953f-a527-4c58-926d-23a86a087ef1 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:38.661838 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aadf953f-a527-4c58-926d-23a86a087ef1 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:38.662586 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aadf953f-a527-4c58-926d-23a86a087ef1 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:38.663242 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aadf953f-a527-4c58-926d-23a86a087ef1 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:38.664148 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aadf953f-a527-4c58-926d-23a86a087ef1 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:38.664820 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aadf953f-a527-4c58-926d-23a86a087ef1 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:38.665516 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aadf953f-a527-4c58-926d-23a86a087ef1 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:38.860731 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-626045b3-7f7f-4998-abea-f2cc829c14c6 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:38.876589 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-626045b3-7f7f-4998-abea-f2cc829c14c6 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6" status: 200 len: 1360 microversion: 2.1 time: 0.741680 Oct 26 13:21:38.877263 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2260/4531] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:38 2022] GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6 => generated 1360 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:38.899446 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f8ccee2f-4cf2-4ecb-8c77-9268672f0362 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:38.901875 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f8ccee2f-4cf2-4ecb-8c77-9268672f0362 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: d7cd631a-a439-481d-ab67-f5a0c9d0ef86] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:38.929270 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f8ccee2f-4cf2-4ecb-8c77-9268672f0362 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:38.929793 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f8ccee2f-4cf2-4ecb-8c77-9268672f0362 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:38.930241 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f8ccee2f-4cf2-4ecb-8c77-9268672f0362 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:38.931014 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f8ccee2f-4cf2-4ecb-8c77-9268672f0362 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:38.944596 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f8ccee2f-4cf2-4ecb-8c77-9268672f0362 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:38.951985 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f8ccee2f-4cf2-4ecb-8c77-9268672f0362 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:39.144314 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-aadf953f-a527-4c58-926d-23a86a087ef1 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:39.152058 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=16 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:21:39.165832 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-aadf953f-a527-4c58-926d-23a86a087ef1 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245" status: 200 len: 1369 microversion: 2.1 time: 0.550591 Oct 26 13:21:39.166700 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2272/4532] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:38 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245 => generated 1369 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:39.201743 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-969e53fd-7c9e-40aa-b0b5-de447438798e tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:39.203279 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-969e53fd-7c9e-40aa-b0b5-de447438798e tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 8ec8dff5-3985-4f1c-9d2e-ddd28d538476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:39.220214 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-969e53fd-7c9e-40aa-b0b5-de447438798e tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:39.222218 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-969e53fd-7c9e-40aa-b0b5-de447438798e tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:39.224290 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-969e53fd-7c9e-40aa-b0b5-de447438798e tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:39.225989 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-969e53fd-7c9e-40aa-b0b5-de447438798e tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:39.229762 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-969e53fd-7c9e-40aa-b0b5-de447438798e tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:39.232772 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-969e53fd-7c9e-40aa-b0b5-de447438798e tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:39.375165 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-969e53fd-7c9e-40aa-b0b5-de447438798e tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:39.392800 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-969e53fd-7c9e-40aa-b0b5-de447438798e tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:39.405380 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-969e53fd-7c9e-40aa-b0b5-de447438798e tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:39.409684 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-969e53fd-7c9e-40aa-b0b5-de447438798e tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476" status: 200 len: 1366 microversion: 2.47 time: 0.229224 Oct 26 13:21:39.417351 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2273/4533] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:39 2022] GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476 => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:39.441180 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4a471d66-eb96-4c58-8403-804b58bfefb2 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:39.442132 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4a471d66-eb96-4c58-8403-804b58bfefb2 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:39.460446 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=14 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:21:39.468022 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a471d66-eb96-4c58-8403-804b58bfefb2 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:39.471234 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a471d66-eb96-4c58-8403-804b58bfefb2 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:39.471690 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a471d66-eb96-4c58-8403-804b58bfefb2 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:39.472463 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a471d66-eb96-4c58-8403-804b58bfefb2 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:39.473000 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a471d66-eb96-4c58-8403-804b58bfefb2 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:39.473708 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a471d66-eb96-4c58-8403-804b58bfefb2 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:39.476698 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f8ccee2f-4cf2-4ecb-8c77-9268672f0362 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:39.490096 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f8ccee2f-4cf2-4ecb-8c77-9268672f0362 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/d7cd631a-a439-481d-ab67-f5a0c9d0ef86" status: 200 len: 1510 microversion: 2.1 time: 0.608376 Oct 26 13:21:39.498917 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2261/4534] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:38 2022] GET /compute/v2.1/servers/d7cd631a-a439-481d-ab67-f5a0c9d0ef86 => generated 1510 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:39.526922 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0c116632-d5f5-4839-8b97-c4162087e51a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:39.527923 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0c116632-d5f5-4839-8b97-c4162087e51a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:39.561133 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c116632-d5f5-4839-8b97-c4162087e51a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:39.565046 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c116632-d5f5-4839-8b97-c4162087e51a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:39.570621 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c116632-d5f5-4839-8b97-c4162087e51a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:39.573877 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c116632-d5f5-4839-8b97-c4162087e51a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:39.574495 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c116632-d5f5-4839-8b97-c4162087e51a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:39.580891 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c116632-d5f5-4839-8b97-c4162087e51a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:39.664370 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4a471d66-eb96-4c58-8403-804b58bfefb2 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:39.687611 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4a471d66-eb96-4c58-8403-804b58bfefb2 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:39.689171 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4a471d66-eb96-4c58-8403-804b58bfefb2 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:39.711919 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4a471d66-eb96-4c58-8403-804b58bfefb2 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1546 microversion: 2.91 time: 0.287977 Oct 26 13:21:39.714142 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2274/4535] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:39 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1546 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:39.724138 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2117da9e-efd5-44c9-b36f-5e8fe48193aa tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:39.724822 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2117da9e-efd5-44c9-b36f-5e8fe48193aa tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: f9df48e5-9204-46d5-b2a9-2154dbdcf167] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:39.746574 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2117da9e-efd5-44c9-b36f-5e8fe48193aa tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:39.747085 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2117da9e-efd5-44c9-b36f-5e8fe48193aa tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:39.747535 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2117da9e-efd5-44c9-b36f-5e8fe48193aa tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:39.748302 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2117da9e-efd5-44c9-b36f-5e8fe48193aa tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:39.748825 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2117da9e-efd5-44c9-b36f-5e8fe48193aa tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:39.749317 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2117da9e-efd5-44c9-b36f-5e8fe48193aa tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:39.833506 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0c116632-d5f5-4839-8b97-c4162087e51a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:39.848932 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0c116632-d5f5-4839-8b97-c4162087e51a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:39.854986 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0c116632-d5f5-4839-8b97-c4162087e51a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:39.856729 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0c116632-d5f5-4839-8b97-c4162087e51a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1603 microversion: 2.32 time: 0.356288 Oct 26 13:21:39.865828 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2262/4536] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:39 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1603 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:39.904560 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4fdbeba8-a1b2-4aa2-998d-1b112a42149d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:39.905544 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4fdbeba8-a1b2-4aa2-998d-1b112a42149d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:39.919491 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4fdbeba8-a1b2-4aa2-998d-1b112a42149d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:39.928309 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4fdbeba8-a1b2-4aa2-998d-1b112a42149d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:39.931683 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4fdbeba8-a1b2-4aa2-998d-1b112a42149d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:39.932730 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4fdbeba8-a1b2-4aa2-998d-1b112a42149d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:39.933418 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4fdbeba8-a1b2-4aa2-998d-1b112a42149d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:39.935688 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4fdbeba8-a1b2-4aa2-998d-1b112a42149d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:40.226446 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2117da9e-efd5-44c9-b36f-5e8fe48193aa tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:40.239204 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2117da9e-efd5-44c9-b36f-5e8fe48193aa tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/f9df48e5-9204-46d5-b2a9-2154dbdcf167" status: 200 len: 1512 microversion: 2.1 time: 0.523873 Oct 26 13:21:40.242193 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2275/4537] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:39 2022] GET /compute/v2.1/servers/f9df48e5-9204-46d5-b2a9-2154dbdcf167 => generated 1512 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:40.259080 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a3cc6a03-7cd5-4ed4-9901-433818e5a253 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:40.261249 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a3cc6a03-7cd5-4ed4-9901-433818e5a253 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 789a55e0-21ba-4b2e-b8d4-c95999955e2b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:40.277775 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a3cc6a03-7cd5-4ed4-9901-433818e5a253 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:40.278682 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a3cc6a03-7cd5-4ed4-9901-433818e5a253 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:40.279534 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a3cc6a03-7cd5-4ed4-9901-433818e5a253 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:40.280570 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a3cc6a03-7cd5-4ed4-9901-433818e5a253 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:40.282146 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a3cc6a03-7cd5-4ed4-9901-433818e5a253 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:40.282687 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a3cc6a03-7cd5-4ed4-9901-433818e5a253 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:40.308415 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4fdbeba8-a1b2-4aa2-998d-1b112a42149d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:40.322524 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4fdbeba8-a1b2-4aa2-998d-1b112a42149d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6" status: 200 len: 1360 microversion: 2.1 time: 0.417675 Oct 26 13:21:40.324231 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2263/4538] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:39 2022] GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6 => generated 1360 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:21:40.324897 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-a3cc6a03-7cd5-4ed4-9901-433818e5a253 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] HTTP exception thrown: Instance 789a55e0-21ba-4b2e-b8d4-c95999955e2b could not be found. Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a3cc6a03-7cd5-4ed4-9901-433818e5a253 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Request method failure captured: Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: request: DELETE /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b HTTP/1.1 Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTK8yiFaYn6FsK4kYH1E6E6NSE9_hIaDskjf1tRy-XgeLhCgjcaBIDqmW8VSjfB2Cmb6DMkQzh-y_Wh40jTHlXsuv7XA0N3K6RDEzKD5nf9Z6iWWIgYAqlJtxWSsEOqwe1NAtEPEvPHN4gJ5RH5unfT6e5xSWJOJigX6JmjW0X-SjQA Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 174da5e5c60449b7a04e9cf2aa3b9fda Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-AttachVolumeNegativeTest-770748596 Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/174da5e5c60449b7a04e9cf2aa3b9fda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/174da5e5c60449b7a04e9cf2aa3b9fda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_174da5e5c60449b7a04e9cf2aa3b9fda"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/174da5e5c60449b7a04e9cf2aa3b9fda"}]}] Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-AttachVolumeNegativeTest-770748596 Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 174da5e5c60449b7a04e9cf2aa3b9fda Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-770748596 Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-AttachVolumeNegativeTest-770748596-project Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 168c83cd1b014f82945f4915e3ece079 Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-AttachVolumeNegativeTest-770748596-project Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 789a55e0-21ba-4b2e-b8d4-c95999955e2b could not be found. Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '789a55e0-21ba-4b2e-b8d4-c95999955e2b'} Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 789a55e0-21ba-4b2e-b8d4-c95999955e2b could not be found. Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:21:40.326889 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:21:40.330516 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 789a55e0-21ba-4b2e-b8d4-c95999955e2b could not be found. Oct 26 13:21:40.330516 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:21:40.330516 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:21:40.330516 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:21:40.330516 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:40.330516 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:21:40.330516 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:21:40.330516 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:21:40.330516 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:21:40.330516 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 789a55e0-21ba-4b2e-b8d4-c95999955e2b could not be found. Oct 26 13:21:40.330516 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:21:40.330516 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a3cc6a03-7cd5-4ed4-9901-433818e5a253 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Returning 404 to user: Instance 789a55e0-21ba-4b2e-b8d4-c95999955e2b could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:21:40.330516 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a3cc6a03-7cd5-4ed4-9901-433818e5a253 tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "DELETE /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b" status: 404 len: 111 microversion: 2.1 time: 0.080036 Oct 26 13:21:40.333647 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2276/4539] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:21:40 2022] DELETE /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:21:40.338695 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-145fa90b-beaa-47f3-ac67-fdbc955067a0 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:40.339497 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-145fa90b-beaa-47f3-ac67-fdbc955067a0 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: 800fb374-b811-40a1-9843-8577e3a6d88a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:40.349169 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-145fa90b-beaa-47f3-ac67-fdbc955067a0 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:40.349686 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7c2a2036-8cb7-410e-86df-47ad76fb8a4d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:40.349830 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-145fa90b-beaa-47f3-ac67-fdbc955067a0 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:40.350128 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-145fa90b-beaa-47f3-ac67-fdbc955067a0 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:40.350832 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-145fa90b-beaa-47f3-ac67-fdbc955067a0 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:40.351717 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7c2a2036-8cb7-410e-86df-47ad76fb8a4d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:40.361264 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-145fa90b-beaa-47f3-ac67-fdbc955067a0 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:40.362588 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-145fa90b-beaa-47f3-ac67-fdbc955067a0 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:40.379026 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7c2a2036-8cb7-410e-86df-47ad76fb8a4d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:40.380187 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7c2a2036-8cb7-410e-86df-47ad76fb8a4d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:40.381193 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7c2a2036-8cb7-410e-86df-47ad76fb8a4d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:40.386224 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7c2a2036-8cb7-410e-86df-47ad76fb8a4d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:40.386960 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7c2a2036-8cb7-410e-86df-47ad76fb8a4d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:40.387680 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7c2a2036-8cb7-410e-86df-47ad76fb8a4d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:40.716342 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-145fa90b-beaa-47f3-ac67-fdbc955067a0 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:40.730906 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-145fa90b-beaa-47f3-ac67-fdbc955067a0 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/800fb374-b811-40a1-9843-8577e3a6d88a" status: 200 len: 1513 microversion: 2.1 time: 0.395175 Oct 26 13:21:40.732252 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2277/4540] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:40 2022] GET /compute/v2.1/servers/800fb374-b811-40a1-9843-8577e3a6d88a => generated 1513 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:40.766325 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f3bc673d-8068-4e6e-8a06-8a6b24ba84bc tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:40.767126 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f3bc673d-8068-4e6e-8a06-8a6b24ba84bc tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] [instance: 789a55e0-21ba-4b2e-b8d4-c95999955e2b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:40.770439 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7c2a2036-8cb7-410e-86df-47ad76fb8a4d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:40.779833 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7c2a2036-8cb7-410e-86df-47ad76fb8a4d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245" status: 200 len: 1563 microversion: 2.1 time: 0.454102 Oct 26 13:21:40.781256 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2264/4541] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:40 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245 => generated 1563 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:40.786662 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a3745699-846c-41c7-bc60-7827458e0082 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:40.787504 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a3745699-846c-41c7-bc60-7827458e0082 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 8ec8dff5-3985-4f1c-9d2e-ddd28d538476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:40.795714 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a3745699-846c-41c7-bc60-7827458e0082 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:40.796486 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a3745699-846c-41c7-bc60-7827458e0082 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:40.797079 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a3745699-846c-41c7-bc60-7827458e0082 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:40.797970 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a3745699-846c-41c7-bc60-7827458e0082 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:40.798643 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a3745699-846c-41c7-bc60-7827458e0082 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:40.799208 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a3745699-846c-41c7-bc60-7827458e0082 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:40.810961 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f3bc673d-8068-4e6e-8a06-8a6b24ba84bc tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:40.814218 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f3bc673d-8068-4e6e-8a06-8a6b24ba84bc tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:40.814803 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f3bc673d-8068-4e6e-8a06-8a6b24ba84bc tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:40.817900 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f3bc673d-8068-4e6e-8a06-8a6b24ba84bc tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:40.818597 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f3bc673d-8068-4e6e-8a06-8a6b24ba84bc tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:40.819170 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f3bc673d-8068-4e6e-8a06-8a6b24ba84bc tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:40.850556 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-f3bc673d-8068-4e6e-8a06-8a6b24ba84bc tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] HTTP exception thrown: Instance 789a55e0-21ba-4b2e-b8d4-c95999955e2b could not be found. Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f3bc673d-8068-4e6e-8a06-8a6b24ba84bc tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Request method failure captured: Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b HTTP/1.1 Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTK8yiFaYn6FsK4kYH1E6E6NSE9_hIaDskjf1tRy-XgeLhCgjcaBIDqmW8VSjfB2Cmb6DMkQzh-y_Wh40jTHlXsuv7XA0N3K6RDEzKD5nf9Z6iWWIgYAqlJtxWSsEOqwe1NAtEPEvPHN4gJ5RH5unfT6e5xSWJOJigX6JmjW0X-SjQA Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 174da5e5c60449b7a04e9cf2aa3b9fda Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-AttachVolumeNegativeTest-770748596 Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/174da5e5c60449b7a04e9cf2aa3b9fda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/174da5e5c60449b7a04e9cf2aa3b9fda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_174da5e5c60449b7a04e9cf2aa3b9fda"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/174da5e5c60449b7a04e9cf2aa3b9fda"}]}] Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-AttachVolumeNegativeTest-770748596 Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 174da5e5c60449b7a04e9cf2aa3b9fda Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-770748596 Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-AttachVolumeNegativeTest-770748596-project Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 168c83cd1b014f82945f4915e3ece079 Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-AttachVolumeNegativeTest-770748596-project Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 789a55e0-21ba-4b2e-b8d4-c95999955e2b could not be found. Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '789a55e0-21ba-4b2e-b8d4-c95999955e2b'} Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 789a55e0-21ba-4b2e-b8d4-c95999955e2b could not be found. Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 789a55e0-21ba-4b2e-b8d4-c95999955e2b could not be found. Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:21:40.855314 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:21:40.859462 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:40.859462 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:21:40.859462 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:21:40.859462 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:21:40.859462 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:21:40.859462 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 789a55e0-21ba-4b2e-b8d4-c95999955e2b could not be found. Oct 26 13:21:40.859462 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:21:40.860573 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f3bc673d-8068-4e6e-8a06-8a6b24ba84bc tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] Returning 404 to user: Instance 789a55e0-21ba-4b2e-b8d4-c95999955e2b could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:21:40.861593 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f3bc673d-8068-4e6e-8a06-8a6b24ba84bc tempest-AttachVolumeNegativeTest-770748596 tempest-AttachVolumeNegativeTest-770748596-project] 10.222.0.40 "GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b" status: 404 len: 111 microversion: 2.1 time: 0.128186 Oct 26 13:21:40.866553 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2278/4542] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:40 2022] GET /compute/v2.1/servers/789a55e0-21ba-4b2e-b8d4-c95999955e2b => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:21:40.874750 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f392b5bc-17fd-4101-97af-3f38d773caaa tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:40.878379 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f392b5bc-17fd-4101-97af-3f38d773caaa tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:40.896136 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f392b5bc-17fd-4101-97af-3f38d773caaa tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:40.898376 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f392b5bc-17fd-4101-97af-3f38d773caaa tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:40.900022 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f392b5bc-17fd-4101-97af-3f38d773caaa tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:40.901725 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f392b5bc-17fd-4101-97af-3f38d773caaa tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:40.903884 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f392b5bc-17fd-4101-97af-3f38d773caaa tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:40.905930 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f392b5bc-17fd-4101-97af-3f38d773caaa tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:40.968574 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a3745699-846c-41c7-bc60-7827458e0082 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:41.013274 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a3745699-846c-41c7-bc60-7827458e0082 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:41.019816 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a3745699-846c-41c7-bc60-7827458e0082 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:41.033829 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a3745699-846c-41c7-bc60-7827458e0082 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476" status: 200 len: 1366 microversion: 2.47 time: 0.251249 Oct 26 13:21:41.038145 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2265/4543] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:40 2022] GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476 => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:41.064800 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-88c6e21b-f283-44c9-b245-2b099ae27327 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:41.103272 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-88c6e21b-f283-44c9-b245-2b099ae27327 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:41.105900 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-88c6e21b-f283-44c9-b245-2b099ae27327 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Searching by: {'ip': '172.20.0.12', 'deleted': False, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b'} {{(pid=120597) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:21:41.111595 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f392b5bc-17fd-4101-97af-3f38d773caaa tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:41.128306 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f392b5bc-17fd-4101-97af-3f38d773caaa tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:41.129896 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f392b5bc-17fd-4101-97af-3f38d773caaa tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:41.158294 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f392b5bc-17fd-4101-97af-3f38d773caaa tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1546 microversion: 2.91 time: 0.290088 Oct 26 13:21:41.166219 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2279/4544] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:40 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1546 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:41.190557 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c4f9b19b-452e-4dce-9359-d995d0844c4f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:41.193800 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c4f9b19b-452e-4dce-9359-d995d0844c4f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:41.212510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4f9b19b-452e-4dce-9359-d995d0844c4f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:41.213276 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4f9b19b-452e-4dce-9359-d995d0844c4f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:41.213927 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4f9b19b-452e-4dce-9359-d995d0844c4f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:41.219098 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4f9b19b-452e-4dce-9359-d995d0844c4f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:41.219560 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4f9b19b-452e-4dce-9359-d995d0844c4f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:41.220030 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4f9b19b-452e-4dce-9359-d995d0844c4f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:41.434011 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c4f9b19b-452e-4dce-9359-d995d0844c4f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.265525 Oct 26 13:21:41.442328 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2280/4545] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 26 13:21:41 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245/os-interface => generated 284 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:21:41.443177 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-286e009d-cb16-440e-a878-539536d31bd3 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:41.444526 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-286e009d-cb16-440e-a878-539536d31bd3 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:41.471722 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-286e009d-cb16-440e-a878-539536d31bd3 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:41.476905 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-286e009d-cb16-440e-a878-539536d31bd3 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:41.478524 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-286e009d-cb16-440e-a878-539536d31bd3 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:41.483467 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-286e009d-cb16-440e-a878-539536d31bd3 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:41.484024 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-286e009d-cb16-440e-a878-539536d31bd3 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:41.484478 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-286e009d-cb16-440e-a878-539536d31bd3 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:41.654724 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-286e009d-cb16-440e-a878-539536d31bd3 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:41.671993 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-286e009d-cb16-440e-a878-539536d31bd3 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:41.675002 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-286e009d-cb16-440e-a878-539536d31bd3 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:41.681113 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-286e009d-cb16-440e-a878-539536d31bd3 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1603 microversion: 2.32 time: 0.244432 Oct 26 13:21:41.693513 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2281/4546] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:41 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1603 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:41.706386 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b43dfa97-8850-4105-b1d5-ceaf7c970b42 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:41.706386 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b43dfa97-8850-4105-b1d5-ceaf7c970b42 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:41.719452 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b43dfa97-8850-4105-b1d5-ceaf7c970b42 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:41.720516 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b43dfa97-8850-4105-b1d5-ceaf7c970b42 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:41.743822 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b43dfa97-8850-4105-b1d5-ceaf7c970b42 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:41.744528 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b43dfa97-8850-4105-b1d5-ceaf7c970b42 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:41.745011 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b43dfa97-8850-4105-b1d5-ceaf7c970b42 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:41.745449 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b43dfa97-8850-4105-b1d5-ceaf7c970b42 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:41.952747 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88c6e21b-f283-44c9-b245-2b099ae27327 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:41.953256 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88c6e21b-f283-44c9-b245-2b099ae27327 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:41.954122 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88c6e21b-f283-44c9-b245-2b099ae27327 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:41.954868 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88c6e21b-f283-44c9-b245-2b099ae27327 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:41.955325 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88c6e21b-f283-44c9-b245-2b099ae27327 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:41.955757 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88c6e21b-f283-44c9-b245-2b099ae27327 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:42.057693 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b43dfa97-8850-4105-b1d5-ceaf7c970b42 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:42.073783 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b43dfa97-8850-4105-b1d5-ceaf7c970b42 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6" status: 200 len: 1360 microversion: 2.1 time: 0.386374 Oct 26 13:21:42.093409 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2282/4547] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:41 2022] GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6 => generated 1360 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:42.108852 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5cb2a1a1-88d2-4f28-aad6-cf7f5ca66bae tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:42.112072 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5cb2a1a1-88d2-4f28-aad6-cf7f5ca66bae tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 8ec8dff5-3985-4f1c-9d2e-ddd28d538476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:42.122202 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5cb2a1a1-88d2-4f28-aad6-cf7f5ca66bae tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:42.126218 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5cb2a1a1-88d2-4f28-aad6-cf7f5ca66bae tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:42.128134 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5cb2a1a1-88d2-4f28-aad6-cf7f5ca66bae tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:42.130066 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5cb2a1a1-88d2-4f28-aad6-cf7f5ca66bae tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:42.131999 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5cb2a1a1-88d2-4f28-aad6-cf7f5ca66bae tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:42.132798 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5cb2a1a1-88d2-4f28-aad6-cf7f5ca66bae tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:42.187960 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.multi_cell_list [None req-88c6e21b-f283-44c9-b245-2b099ae27327 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120597) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 13:21:42.284974 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5cb2a1a1-88d2-4f28-aad6-cf7f5ca66bae tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:42.308402 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5cb2a1a1-88d2-4f28-aad6-cf7f5ca66bae tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:42.313302 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5cb2a1a1-88d2-4f28-aad6-cf7f5ca66bae tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:42.318116 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5cb2a1a1-88d2-4f28-aad6-cf7f5ca66bae tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476" status: 200 len: 1366 microversion: 2.47 time: 0.222545 Oct 26 13:21:42.319080 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2283/4548] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:42 2022] GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:42.330829 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f0e298fe-05fe-4d2e-9d5c-d691248b33ff tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:42.333932 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f0e298fe-05fe-4d2e-9d5c-d691248b33ff tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:42.352272 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0e298fe-05fe-4d2e-9d5c-d691248b33ff tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:42.353172 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0e298fe-05fe-4d2e-9d5c-d691248b33ff tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:42.355825 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0e298fe-05fe-4d2e-9d5c-d691248b33ff tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:42.360611 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0e298fe-05fe-4d2e-9d5c-d691248b33ff tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:42.361689 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0e298fe-05fe-4d2e-9d5c-d691248b33ff tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:42.361974 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-88c6e21b-f283-44c9-b245-2b099ae27327 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers?ip=172.20.0.12" status: 200 len: 345 microversion: 2.1 time: 1.315065 Oct 26 13:21:42.362570 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2266/4549] 10.222.0.40 () {58 vars in 1154 bytes} [Wed Oct 26 13:21:41 2022] GET /compute/v2.1/servers?ip=172.20.0.12 => generated 345 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:21:42.362942 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0e298fe-05fe-4d2e-9d5c-d691248b33ff tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:42.378223 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-472b8ce1-3547-4a0c-89f8-7e7779246475 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:42.379055 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-472b8ce1-3547-4a0c-89f8-7e7779246475 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: d7cd631a-a439-481d-ab67-f5a0c9d0ef86] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:42.408065 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-472b8ce1-3547-4a0c-89f8-7e7779246475 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:42.408789 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-472b8ce1-3547-4a0c-89f8-7e7779246475 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:42.409422 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-472b8ce1-3547-4a0c-89f8-7e7779246475 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:42.410863 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-472b8ce1-3547-4a0c-89f8-7e7779246475 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:42.411473 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-472b8ce1-3547-4a0c-89f8-7e7779246475 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:42.413642 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-472b8ce1-3547-4a0c-89f8-7e7779246475 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:42.506003 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f0e298fe-05fe-4d2e-9d5c-d691248b33ff tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:42.516158 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f0e298fe-05fe-4d2e-9d5c-d691248b33ff tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:42.522820 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f0e298fe-05fe-4d2e-9d5c-d691248b33ff tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:42.539605 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f0e298fe-05fe-4d2e-9d5c-d691248b33ff tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1546 microversion: 2.91 time: 0.216852 Oct 26 13:21:42.541642 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2284/4550] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:42 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1546 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:42.713739 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2171efa2-a747-4c8f-9d5e-9b29d0d50a22 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:42.715486 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2171efa2-a747-4c8f-9d5e-9b29d0d50a22 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:42.732718 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2171efa2-a747-4c8f-9d5e-9b29d0d50a22 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:42.736887 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2171efa2-a747-4c8f-9d5e-9b29d0d50a22 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:42.739138 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2171efa2-a747-4c8f-9d5e-9b29d0d50a22 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:42.741669 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2171efa2-a747-4c8f-9d5e-9b29d0d50a22 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:42.743769 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2171efa2-a747-4c8f-9d5e-9b29d0d50a22 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:42.745422 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2171efa2-a747-4c8f-9d5e-9b29d0d50a22 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:42.915324 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=10 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:21:43.033520 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-472b8ce1-3547-4a0c-89f8-7e7779246475 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:43.043218 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-472b8ce1-3547-4a0c-89f8-7e7779246475 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/d7cd631a-a439-481d-ab67-f5a0c9d0ef86" status: 200 len: 1510 microversion: 2.1 time: 0.668617 Oct 26 13:21:43.081913 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2267/4551] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:42 2022] GET /compute/v2.1/servers/d7cd631a-a439-481d-ab67-f5a0c9d0ef86 => generated 1510 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:21:43.089959 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5dab7eff-200c-4c78-945c-4d9cbc8a7a42 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:43.091901 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5dab7eff-200c-4c78-945c-4d9cbc8a7a42 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: f9df48e5-9204-46d5-b2a9-2154dbdcf167] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:43.119883 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5dab7eff-200c-4c78-945c-4d9cbc8a7a42 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:43.128250 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5dab7eff-200c-4c78-945c-4d9cbc8a7a42 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:43.129080 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5dab7eff-200c-4c78-945c-4d9cbc8a7a42 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:43.130024 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5dab7eff-200c-4c78-945c-4d9cbc8a7a42 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:43.130632 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5dab7eff-200c-4c78-945c-4d9cbc8a7a42 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:43.131232 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5dab7eff-200c-4c78-945c-4d9cbc8a7a42 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:43.231187 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2171efa2-a747-4c8f-9d5e-9b29d0d50a22 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:43.251679 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2171efa2-a747-4c8f-9d5e-9b29d0d50a22 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:43.259436 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2171efa2-a747-4c8f-9d5e-9b29d0d50a22 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:43.260672 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2171efa2-a747-4c8f-9d5e-9b29d0d50a22 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1603 microversion: 2.32 time: 0.551221 Oct 26 13:21:43.278077 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2285/4552] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:42 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1603 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:43.278077 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6edfe200-5cf1-43ae-9c39-62f5c1617804 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:43.287914 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6edfe200-5cf1-43ae-9c39-62f5c1617804 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:43.308024 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6edfe200-5cf1-43ae-9c39-62f5c1617804 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:43.308522 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6edfe200-5cf1-43ae-9c39-62f5c1617804 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:43.308964 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6edfe200-5cf1-43ae-9c39-62f5c1617804 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:43.309704 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6edfe200-5cf1-43ae-9c39-62f5c1617804 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:43.310165 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6edfe200-5cf1-43ae-9c39-62f5c1617804 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:43.310594 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6edfe200-5cf1-43ae-9c39-62f5c1617804 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:43.774130 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5dab7eff-200c-4c78-945c-4d9cbc8a7a42 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:43.786538 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5dab7eff-200c-4c78-945c-4d9cbc8a7a42 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/f9df48e5-9204-46d5-b2a9-2154dbdcf167" status: 200 len: 1512 microversion: 2.1 time: 0.701179 Oct 26 13:21:43.788464 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2268/4553] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:43 2022] GET /compute/v2.1/servers/f9df48e5-9204-46d5-b2a9-2154dbdcf167 => generated 1512 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:43.795596 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a5a51e6a-a11f-4a67-8fe7-05e6cc1740ee tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:43.797061 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a5a51e6a-a11f-4a67-8fe7-05e6cc1740ee tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 8ec8dff5-3985-4f1c-9d2e-ddd28d538476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:43.807533 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5a51e6a-a11f-4a67-8fe7-05e6cc1740ee tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:43.808533 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5a51e6a-a11f-4a67-8fe7-05e6cc1740ee tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:43.809216 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5a51e6a-a11f-4a67-8fe7-05e6cc1740ee tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:43.810212 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5a51e6a-a11f-4a67-8fe7-05e6cc1740ee tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:43.810879 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5a51e6a-a11f-4a67-8fe7-05e6cc1740ee tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:43.811561 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5a51e6a-a11f-4a67-8fe7-05e6cc1740ee tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:43.994316 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a5a51e6a-a11f-4a67-8fe7-05e6cc1740ee tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:44.004522 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a5a51e6a-a11f-4a67-8fe7-05e6cc1740ee tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:44.015880 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a5a51e6a-a11f-4a67-8fe7-05e6cc1740ee tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:44.017463 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a5a51e6a-a11f-4a67-8fe7-05e6cc1740ee tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476" status: 200 len: 1366 microversion: 2.47 time: 0.227708 Oct 26 13:21:44.018292 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2269/4554] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:43 2022] GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:44.030613 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-91e5d231-1877-4e83-b43b-485007f234af tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:44.031659 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-91e5d231-1877-4e83-b43b-485007f234af tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:44.039978 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91e5d231-1877-4e83-b43b-485007f234af tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:44.041991 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91e5d231-1877-4e83-b43b-485007f234af tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:44.042708 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91e5d231-1877-4e83-b43b-485007f234af tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:44.043694 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91e5d231-1877-4e83-b43b-485007f234af tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:44.044382 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91e5d231-1877-4e83-b43b-485007f234af tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:44.045662 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91e5d231-1877-4e83-b43b-485007f234af tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:44.170770 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-91e5d231-1877-4e83-b43b-485007f234af tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:44.179717 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-91e5d231-1877-4e83-b43b-485007f234af tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:44.186276 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-91e5d231-1877-4e83-b43b-485007f234af tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:44.200130 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-91e5d231-1877-4e83-b43b-485007f234af tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1546 microversion: 2.91 time: 0.180453 Oct 26 13:21:44.217516 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2270/4555] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:44 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1546 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:44.217516 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-97cd6812-5ed6-490d-89ad-2919a9ed11c2 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:44.217516 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-97cd6812-5ed6-490d-89ad-2919a9ed11c2 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: 800fb374-b811-40a1-9843-8577e3a6d88a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:44.229795 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-97cd6812-5ed6-490d-89ad-2919a9ed11c2 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:44.230298 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-97cd6812-5ed6-490d-89ad-2919a9ed11c2 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:44.230741 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-97cd6812-5ed6-490d-89ad-2919a9ed11c2 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:44.234152 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-97cd6812-5ed6-490d-89ad-2919a9ed11c2 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:44.234961 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-97cd6812-5ed6-490d-89ad-2919a9ed11c2 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:44.235403 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-97cd6812-5ed6-490d-89ad-2919a9ed11c2 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:44.271387 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6edfe200-5cf1-43ae-9c39-62f5c1617804 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:44.283507 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6edfe200-5cf1-43ae-9c39-62f5c1617804 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6" status: 200 len: 1360 microversion: 2.1 time: 1.014929 Oct 26 13:21:44.285123 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2286/4556] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:43 2022] GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6 => generated 1360 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:44.290210 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-821f9ec9-6126-4bd8-a62d-79b189aea54d req-4efeffda-62e8-4fc7-9487-a7ac7657fa36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30dcd11b-b8ec-4095-a7d8-73ce795aeaa6", "name": "network-vif-plugged", "status": "completed", "tag": "413c2089-e162-4ff6-ae1f-b4d6cf728b5f"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:21:44.315476 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-821f9ec9-6126-4bd8-a62d-79b189aea54d req-4efeffda-62e8-4fc7-9487-a7ac7657fa36 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:44.315957 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-821f9ec9-6126-4bd8-a62d-79b189aea54d req-4efeffda-62e8-4fc7-9487-a7ac7657fa36 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:44.316952 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-821f9ec9-6126-4bd8-a62d-79b189aea54d req-4efeffda-62e8-4fc7-9487-a7ac7657fa36 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:44.341849 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-821f9ec9-6126-4bd8-a62d-79b189aea54d req-4efeffda-62e8-4fc7-9487-a7ac7657fa36 service nova] Creating event network-vif-plugged:413c2089-e162-4ff6-ae1f-b4d6cf728b5f for instance 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6 on n-h2-862686-1 Oct 26 13:21:44.348577 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-821f9ec9-6126-4bd8-a62d-79b189aea54d req-4efeffda-62e8-4fc7-9487-a7ac7657fa36 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060956 Oct 26 13:21:44.353502 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2287/4557] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:21:44.360285 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0b585c00-4906-4c36-8f6b-8360d496f9a0 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:44.361257 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0b585c00-4906-4c36-8f6b-8360d496f9a0 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:44.369547 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0b585c00-4906-4c36-8f6b-8360d496f9a0 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:44.370376 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0b585c00-4906-4c36-8f6b-8360d496f9a0 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:44.371579 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0b585c00-4906-4c36-8f6b-8360d496f9a0 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:44.372460 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0b585c00-4906-4c36-8f6b-8360d496f9a0 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:44.373123 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0b585c00-4906-4c36-8f6b-8360d496f9a0 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:44.373718 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0b585c00-4906-4c36-8f6b-8360d496f9a0 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:44.468592 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0b585c00-4906-4c36-8f6b-8360d496f9a0 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:44.479870 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0b585c00-4906-4c36-8f6b-8360d496f9a0 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:44.481211 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0b585c00-4906-4c36-8f6b-8360d496f9a0 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:44.482491 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0b585c00-4906-4c36-8f6b-8360d496f9a0 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1603 microversion: 2.32 time: 0.127664 Oct 26 13:21:44.483070 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2288/4558] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:44 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1603 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:44.579934 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-97cd6812-5ed6-490d-89ad-2919a9ed11c2 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:44.595926 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-97cd6812-5ed6-490d-89ad-2919a9ed11c2 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/800fb374-b811-40a1-9843-8577e3a6d88a" status: 200 len: 1513 microversion: 2.1 time: 0.390471 Oct 26 13:21:44.609547 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2271/4559] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:44 2022] GET /compute/v2.1/servers/800fb374-b811-40a1-9843-8577e3a6d88a => generated 1513 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:44.623636 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4c004d94-37cd-4446-aa1a-89fe38312027 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:44.628481 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4c004d94-37cd-4446-aa1a-89fe38312027 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:44.629385 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4c004d94-37cd-4446-aa1a-89fe38312027 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Searching by: {'deleted': False, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b'} {{(pid=120598) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:21:44.641053 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c004d94-37cd-4446-aa1a-89fe38312027 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:44.641607 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c004d94-37cd-4446-aa1a-89fe38312027 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:44.642477 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c004d94-37cd-4446-aa1a-89fe38312027 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:44.643270 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c004d94-37cd-4446-aa1a-89fe38312027 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:44.643731 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c004d94-37cd-4446-aa1a-89fe38312027 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:44.645082 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c004d94-37cd-4446-aa1a-89fe38312027 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:44.705232 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:21:44.719135 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.multi_cell_list [None req-4c004d94-37cd-4446-aa1a-89fe38312027 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120598) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 13:21:44.787479 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4c004d94-37cd-4446-aa1a-89fe38312027 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:44.799913 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c004d94-37cd-4446-aa1a-89fe38312027 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:44.800919 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c004d94-37cd-4446-aa1a-89fe38312027 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:44.801609 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c004d94-37cd-4446-aa1a-89fe38312027 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:44.849102 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-536a2351-b8ed-4cbd-9ea0-66de3a1a9ff8 req-2177b071-9af7-404c-8ad8-9cdcb377c053 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b93fff60-64e6-436d-9390-03d80438b245", "tag": "85286063-c895-4327-af58-6433dca2108f"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:21:44.863358 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-536a2351-b8ed-4cbd-9ea0-66de3a1a9ff8 req-2177b071-9af7-404c-8ad8-9cdcb377c053 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:44.864760 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-536a2351-b8ed-4cbd-9ea0-66de3a1a9ff8 req-2177b071-9af7-404c-8ad8-9cdcb377c053 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:44.865386 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-536a2351-b8ed-4cbd-9ea0-66de3a1a9ff8 req-2177b071-9af7-404c-8ad8-9cdcb377c053 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:44.881168 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-536a2351-b8ed-4cbd-9ea0-66de3a1a9ff8 req-2177b071-9af7-404c-8ad8-9cdcb377c053 service nova] Creating event network-changed:85286063-c895-4327-af58-6433dca2108f for instance b93fff60-64e6-436d-9390-03d80438b245 on n-h2-862686-1 Oct 26 13:21:44.888551 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-536a2351-b8ed-4cbd-9ea0-66de3a1a9ff8 req-2177b071-9af7-404c-8ad8-9cdcb377c053 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043680 Oct 26 13:21:44.889782 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2272/4560] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:21:45.058453 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e221a94d-9f24-4ac8-888b-64ccc9a1a808 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:45.069619 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e221a94d-9f24-4ac8-888b-64ccc9a1a808 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 8ec8dff5-3985-4f1c-9d2e-ddd28d538476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:45.120141 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e221a94d-9f24-4ac8-888b-64ccc9a1a808 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:45.126480 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e221a94d-9f24-4ac8-888b-64ccc9a1a808 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:45.129732 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e221a94d-9f24-4ac8-888b-64ccc9a1a808 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:45.130665 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e221a94d-9f24-4ac8-888b-64ccc9a1a808 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:45.136568 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e221a94d-9f24-4ac8-888b-64ccc9a1a808 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:45.137144 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e221a94d-9f24-4ac8-888b-64ccc9a1a808 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:45.181327 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4c004d94-37cd-4446-aa1a-89fe38312027 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/detail" status: 200 len: 4518 microversion: 2.1 time: 0.561649 Oct 26 13:21:45.182561 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2289/4561] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:21:44 2022] GET /compute/v2.1/servers/detail => generated 4518 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:45.215653 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-03039267-61c0-43cb-9620-447048c187ba tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:45.221017 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-03039267-61c0-43cb-9620-447048c187ba tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:45.237724 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-03039267-61c0-43cb-9620-447048c187ba tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b'} {{(pid=120598) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:21:45.595358 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03039267-61c0-43cb-9620-447048c187ba tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:45.596022 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03039267-61c0-43cb-9620-447048c187ba tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:45.596260 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03039267-61c0-43cb-9620-447048c187ba tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:45.597188 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03039267-61c0-43cb-9620-447048c187ba tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:45.598339 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03039267-61c0-43cb-9620-447048c187ba tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:45.599436 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03039267-61c0-43cb-9620-447048c187ba tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:45.902566 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.multi_cell_list [None req-03039267-61c0-43cb-9620-447048c187ba tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120598) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 13:21:46.025087 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-03039267-61c0-43cb-9620-447048c187ba tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1009 microversion: 2.1 time: 0.813628 Oct 26 13:21:46.025762 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2290/4562] 10.222.0.40 () {58 vars in 1150 bytes} [Wed Oct 26 13:21:45 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1009 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:46.036779 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6e64021f-c995-4dcb-b9bd-f61121749859 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:46.037343 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6e64021f-c995-4dcb-b9bd-f61121749859 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:46.045312 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e64021f-c995-4dcb-b9bd-f61121749859 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:46.045839 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e64021f-c995-4dcb-b9bd-f61121749859 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:46.046287 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e64021f-c995-4dcb-b9bd-f61121749859 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:46.047029 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e64021f-c995-4dcb-b9bd-f61121749859 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:46.047492 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e64021f-c995-4dcb-b9bd-f61121749859 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:46.047945 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e64021f-c995-4dcb-b9bd-f61121749859 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:46.099083 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e221a94d-9f24-4ac8-888b-64ccc9a1a808 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:46.118879 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e221a94d-9f24-4ac8-888b-64ccc9a1a808 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:46.128334 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e221a94d-9f24-4ac8-888b-64ccc9a1a808 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:46.132285 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e221a94d-9f24-4ac8-888b-64ccc9a1a808 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476" status: 200 len: 1366 microversion: 2.47 time: 1.086984 Oct 26 13:21:46.137379 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2273/4563] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:45 2022] GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476 => generated 1366 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:46.153874 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7677c601-e302-471d-b99e-ce3706ea2d83 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:46.154490 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7677c601-e302-471d-b99e-ce3706ea2d83 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:46.173114 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7677c601-e302-471d-b99e-ce3706ea2d83 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:46.173864 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7677c601-e302-471d-b99e-ce3706ea2d83 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:46.174574 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7677c601-e302-471d-b99e-ce3706ea2d83 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:46.176120 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7677c601-e302-471d-b99e-ce3706ea2d83 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:46.176770 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7677c601-e302-471d-b99e-ce3706ea2d83 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:46.177445 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7677c601-e302-471d-b99e-ce3706ea2d83 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:46.261334 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6e64021f-c995-4dcb-b9bd-f61121749859 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:46.276007 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6e64021f-c995-4dcb-b9bd-f61121749859 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:46.278339 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6e64021f-c995-4dcb-b9bd-f61121749859 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:46.292639 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6e64021f-c995-4dcb-b9bd-f61121749859 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1546 microversion: 2.91 time: 0.265682 Oct 26 13:21:46.297774 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2291/4564] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:46 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1546 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:46.310209 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ee1e81a7-8fd4-4419-a2f7-d26292f186cf tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:46.310838 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ee1e81a7-8fd4-4419-a2f7-d26292f186cf tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:46.329285 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee1e81a7-8fd4-4419-a2f7-d26292f186cf tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:46.329801 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee1e81a7-8fd4-4419-a2f7-d26292f186cf tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:46.330566 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee1e81a7-8fd4-4419-a2f7-d26292f186cf tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:46.330942 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee1e81a7-8fd4-4419-a2f7-d26292f186cf tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:46.331394 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee1e81a7-8fd4-4419-a2f7-d26292f186cf tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:46.332348 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee1e81a7-8fd4-4419-a2f7-d26292f186cf tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:46.481412 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ee1e81a7-8fd4-4419-a2f7-d26292f186cf tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:46.505186 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ee1e81a7-8fd4-4419-a2f7-d26292f186cf tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:46.507014 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ee1e81a7-8fd4-4419-a2f7-d26292f186cf tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:46.508334 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ee1e81a7-8fd4-4419-a2f7-d26292f186cf tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1603 microversion: 2.32 time: 0.209263 Oct 26 13:21:46.509378 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2292/4565] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:46 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1603 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:46.531020 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c95bae72-7942-482a-8538-9f2c77c0de00 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:46.551220 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c95bae72-7942-482a-8538-9f2c77c0de00 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:46.558151 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c95bae72-7942-482a-8538-9f2c77c0de00 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b'} {{(pid=120598) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:21:46.576009 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c95bae72-7942-482a-8538-9f2c77c0de00 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:46.579714 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c95bae72-7942-482a-8538-9f2c77c0de00 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:46.582674 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c95bae72-7942-482a-8538-9f2c77c0de00 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:46.584833 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c95bae72-7942-482a-8538-9f2c77c0de00 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:46.595385 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c95bae72-7942-482a-8538-9f2c77c0de00 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:46.596530 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c95bae72-7942-482a-8538-9f2c77c0de00 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:46.942941 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.multi_cell_list [None req-c95bae72-7942-482a-8538-9f2c77c0de00 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120598) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 13:21:47.119892 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c95bae72-7942-482a-8538-9f2c77c0de00 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1009 microversion: 2.1 time: 0.609479 Oct 26 13:21:47.123204 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2293/4566] 10.222.0.40 () {58 vars in 1212 bytes} [Wed Oct 26 13:21:46 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1009 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:47.145526 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1684b507-573a-4549-a2e0-c083f2c399f3 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:47.159870 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1684b507-573a-4549-a2e0-c083f2c399f3 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:47.161306 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1684b507-573a-4549-a2e0-c083f2c399f3 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b'} {{(pid=120598) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:21:47.168618 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7677c601-e302-471d-b99e-ce3706ea2d83 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:47.175451 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1684b507-573a-4549-a2e0-c083f2c399f3 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:47.178128 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1684b507-573a-4549-a2e0-c083f2c399f3 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:47.178473 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7677c601-e302-471d-b99e-ce3706ea2d83 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6" status: 200 len: 1546 microversion: 2.1 time: 1.039978 Oct 26 13:21:47.178591 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1684b507-573a-4549-a2e0-c083f2c399f3 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:47.179363 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1684b507-573a-4549-a2e0-c083f2c399f3 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:47.179864 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1684b507-573a-4549-a2e0-c083f2c399f3 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:47.180223 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1684b507-573a-4549-a2e0-c083f2c399f3 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:47.195536 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2274/4567] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:46 2022] GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6 => generated 1546 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:47.205922 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6773cd72-b799-4b3d-aa24-1e3c1ce5a331 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:47.207934 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6773cd72-b799-4b3d-aa24-1e3c1ce5a331 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 8ec8dff5-3985-4f1c-9d2e-ddd28d538476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:47.226621 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6773cd72-b799-4b3d-aa24-1e3c1ce5a331 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:47.228482 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6773cd72-b799-4b3d-aa24-1e3c1ce5a331 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:47.234127 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6773cd72-b799-4b3d-aa24-1e3c1ce5a331 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:47.235298 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6773cd72-b799-4b3d-aa24-1e3c1ce5a331 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:47.236103 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6773cd72-b799-4b3d-aa24-1e3c1ce5a331 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:47.236745 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6773cd72-b799-4b3d-aa24-1e3c1ce5a331 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:47.288323 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:21:47.461913 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.multi_cell_list [None req-1684b507-573a-4549-a2e0-c083f2c399f3 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120598) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 13:21:47.563155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6773cd72-b799-4b3d-aa24-1e3c1ce5a331 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:47.575656 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6773cd72-b799-4b3d-aa24-1e3c1ce5a331 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:47.583949 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6773cd72-b799-4b3d-aa24-1e3c1ce5a331 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:47.588917 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6773cd72-b799-4b3d-aa24-1e3c1ce5a331 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476" status: 200 len: 1366 microversion: 2.47 time: 0.392040 Oct 26 13:21:47.589538 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2275/4568] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:47 2022] GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476 => generated 1366 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:47.601943 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1684b507-573a-4549-a2e0-c083f2c399f3 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1009 microversion: 2.1 time: 0.466234 Oct 26 13:21:47.610943 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2294/4569] 10.222.0.40 () {58 vars in 1196 bytes} [Wed Oct 26 13:21:47 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1009 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:47.616321 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a68a0d49-4621-4813-950e-87dd5a211d3d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:47.616821 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a68a0d49-4621-4813-950e-87dd5a211d3d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:47.624556 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-891a126e-38ac-4b0f-9f1a-fb0a18464648 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:47.625271 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a68a0d49-4621-4813-950e-87dd5a211d3d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:47.625423 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-891a126e-38ac-4b0f-9f1a-fb0a18464648 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:47.626282 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a68a0d49-4621-4813-950e-87dd5a211d3d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:47.627929 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a68a0d49-4621-4813-950e-87dd5a211d3d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:47.630175 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a68a0d49-4621-4813-950e-87dd5a211d3d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:47.631370 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a68a0d49-4621-4813-950e-87dd5a211d3d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:47.632067 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a68a0d49-4621-4813-950e-87dd5a211d3d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:47.637858 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-891a126e-38ac-4b0f-9f1a-fb0a18464648 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:47.640654 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-891a126e-38ac-4b0f-9f1a-fb0a18464648 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:47.642361 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-891a126e-38ac-4b0f-9f1a-fb0a18464648 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:47.643385 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-891a126e-38ac-4b0f-9f1a-fb0a18464648 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:47.644064 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-891a126e-38ac-4b0f-9f1a-fb0a18464648 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:47.644710 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-891a126e-38ac-4b0f-9f1a-fb0a18464648 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:47.815017 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-891a126e-38ac-4b0f-9f1a-fb0a18464648 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:47.826265 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-891a126e-38ac-4b0f-9f1a-fb0a18464648 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:47.827041 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-891a126e-38ac-4b0f-9f1a-fb0a18464648 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:47.833448 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-891a126e-38ac-4b0f-9f1a-fb0a18464648 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1546 microversion: 2.91 time: 0.220839 Oct 26 13:21:47.846160 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2295/4570] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:47 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1546 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:47.860520 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-10115a33-5d56-4e94-9d5c-9550f76ecad8 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:47.861203 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-10115a33-5d56-4e94-9d5c-9550f76ecad8 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:47.868560 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10115a33-5d56-4e94-9d5c-9550f76ecad8 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:47.869365 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10115a33-5d56-4e94-9d5c-9550f76ecad8 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:47.869984 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10115a33-5d56-4e94-9d5c-9550f76ecad8 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:47.870853 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10115a33-5d56-4e94-9d5c-9550f76ecad8 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:47.871330 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10115a33-5d56-4e94-9d5c-9550f76ecad8 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:47.871740 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10115a33-5d56-4e94-9d5c-9550f76ecad8 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:47.901664 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a68a0d49-4621-4813-950e-87dd5a211d3d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.298112 Oct 26 13:21:47.912406 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2276/4571] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 26 13:21:47 2022] GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6/os-interface => generated 285 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:21:47.918197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2295c0db-5869-4d74-839e-3c785a9e47a2 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:47.931747 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2295c0db-5869-4d74-839e-3c785a9e47a2 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:47.932542 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2295c0db-5869-4d74-839e-3c785a9e47a2 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Searching by: {'name': 'e-55967892', 'deleted': False, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b'} {{(pid=120597) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:21:47.963312 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2295c0db-5869-4d74-839e-3c785a9e47a2 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:47.963656 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2295c0db-5869-4d74-839e-3c785a9e47a2 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:47.964589 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2295c0db-5869-4d74-839e-3c785a9e47a2 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:47.965340 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2295c0db-5869-4d74-839e-3c785a9e47a2 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:47.965843 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2295c0db-5869-4d74-839e-3c785a9e47a2 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:47.966279 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2295c0db-5869-4d74-839e-3c785a9e47a2 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:48.004693 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-10115a33-5d56-4e94-9d5c-9550f76ecad8 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:48.019200 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-10115a33-5d56-4e94-9d5c-9550f76ecad8 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:48.020673 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-10115a33-5d56-4e94-9d5c-9550f76ecad8 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:48.021901 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-10115a33-5d56-4e94-9d5c-9550f76ecad8 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1603 microversion: 2.32 time: 0.174756 Oct 26 13:21:48.034616 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2296/4572] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:47 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1603 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:48.179181 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.multi_cell_list [None req-2295c0db-5869-4d74-839e-3c785a9e47a2 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120597) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 13:21:48.297929 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2295c0db-5869-4d74-839e-3c785a9e47a2 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers?name=e-55967892" status: 200 len: 344 microversion: 2.1 time: 0.383881 Oct 26 13:21:48.298336 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2277/4573] 10.222.0.40 () {58 vars in 1156 bytes} [Wed Oct 26 13:21:47 2022] GET /compute/v2.1/servers?name=e-55967892 => generated 344 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:21:48.311244 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5aaac701-e2e4-48a9-9ce3-481ec83b7196 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:48.317070 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5aaac701-e2e4-48a9-9ce3-481ec83b7196 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:48.317842 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5aaac701-e2e4-48a9-9ce3-481ec83b7196 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b'} {{(pid=120598) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:21:48.323228 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5aaac701-e2e4-48a9-9ce3-481ec83b7196 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:48.323709 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5aaac701-e2e4-48a9-9ce3-481ec83b7196 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:48.324139 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5aaac701-e2e4-48a9-9ce3-481ec83b7196 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:48.324965 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5aaac701-e2e4-48a9-9ce3-481ec83b7196 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:48.325289 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5aaac701-e2e4-48a9-9ce3-481ec83b7196 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:48.325740 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5aaac701-e2e4-48a9-9ce3-481ec83b7196 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:48.468706 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.multi_cell_list [None req-5aaac701-e2e4-48a9-9ce3-481ec83b7196 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120598) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 13:21:48.619467 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3a72f671-65ec-4ec9-aa0a-25282c21854d tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:48.620090 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3a72f671-65ec-4ec9-aa0a-25282c21854d tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 8ec8dff5-3985-4f1c-9d2e-ddd28d538476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:48.628098 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a72f671-65ec-4ec9-aa0a-25282c21854d tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:48.631226 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a72f671-65ec-4ec9-aa0a-25282c21854d tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:48.632765 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a72f671-65ec-4ec9-aa0a-25282c21854d tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:48.633724 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a72f671-65ec-4ec9-aa0a-25282c21854d tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:48.636564 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a72f671-65ec-4ec9-aa0a-25282c21854d tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:48.637185 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a72f671-65ec-4ec9-aa0a-25282c21854d tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:49.132850 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3a72f671-65ec-4ec9-aa0a-25282c21854d tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:49.147611 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3a72f671-65ec-4ec9-aa0a-25282c21854d tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:49.154980 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3a72f671-65ec-4ec9-aa0a-25282c21854d tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:49.163418 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3a72f671-65ec-4ec9-aa0a-25282c21854d tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476" status: 200 len: 1366 microversion: 2.47 time: 0.541410 Oct 26 13:21:49.164338 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2278/4574] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:48 2022] GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476 => generated 1366 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:49.169699 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ea380f91-d162-453a-a798-dcec5eb5eadd tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:49.172248 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ea380f91-d162-453a-a798-dcec5eb5eadd tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:49.190334 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ea380f91-d162-453a-a798-dcec5eb5eadd tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:49.194251 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ea380f91-d162-453a-a798-dcec5eb5eadd tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:49.194940 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ea380f91-d162-453a-a798-dcec5eb5eadd tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:49.195900 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ea380f91-d162-453a-a798-dcec5eb5eadd tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:49.196541 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ea380f91-d162-453a-a798-dcec5eb5eadd tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:49.198472 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ea380f91-d162-453a-a798-dcec5eb5eadd tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:49.388631 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5aaac701-e2e4-48a9-9ce3-481ec83b7196 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1009 microversion: 2.1 time: 1.080375 Oct 26 13:21:49.390527 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2297/4575] 10.222.0.40 () {58 vars in 1154 bytes} [Wed Oct 26 13:21:48 2022] GET /compute/v2.1/servers?name=-instance => generated 1009 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:49.406113 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c2c96651-4a32-4d80-802a-e13264703c01 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:49.406953 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c2c96651-4a32-4d80-802a-e13264703c01 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:49.412989 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ea380f91-d162-453a-a798-dcec5eb5eadd tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:49.416268 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2c96651-4a32-4d80-802a-e13264703c01 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:49.417074 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2c96651-4a32-4d80-802a-e13264703c01 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:49.417719 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2c96651-4a32-4d80-802a-e13264703c01 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:49.418715 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2c96651-4a32-4d80-802a-e13264703c01 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:49.419390 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2c96651-4a32-4d80-802a-e13264703c01 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:49.420122 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2c96651-4a32-4d80-802a-e13264703c01 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:49.431883 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ea380f91-d162-453a-a798-dcec5eb5eadd tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:49.439415 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ea380f91-d162-453a-a798-dcec5eb5eadd tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:49.456477 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ea380f91-d162-453a-a798-dcec5eb5eadd tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1533 microversion: 2.91 time: 0.290494 Oct 26 13:21:49.466327 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2279/4576] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:49 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1533 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:49.480889 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9dcd4cbb-1fdf-439e-bc70-3bfe7c5dd1f3 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:49.498819 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9dcd4cbb-1fdf-439e-bc70-3bfe7c5dd1f3 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:49.506087 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9dcd4cbb-1fdf-439e-bc70-3bfe7c5dd1f3 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-5596789', 'deleted': False, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b'} {{(pid=120597) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:21:49.527643 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9dcd4cbb-1fdf-439e-bc70-3bfe7c5dd1f3 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:49.531855 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9dcd4cbb-1fdf-439e-bc70-3bfe7c5dd1f3 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:49.534610 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9dcd4cbb-1fdf-439e-bc70-3bfe7c5dd1f3 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:49.536923 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9dcd4cbb-1fdf-439e-bc70-3bfe7c5dd1f3 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:49.538075 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9dcd4cbb-1fdf-439e-bc70-3bfe7c5dd1f3 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:49.540072 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9dcd4cbb-1fdf-439e-bc70-3bfe7c5dd1f3 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:49.595498 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c2c96651-4a32-4d80-802a-e13264703c01 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:49.615456 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c2c96651-4a32-4d80-802a-e13264703c01 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:49.622374 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c2c96651-4a32-4d80-802a-e13264703c01 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:49.624148 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c2c96651-4a32-4d80-802a-e13264703c01 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1603 microversion: 2.32 time: 0.222947 Oct 26 13:21:49.625205 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2298/4577] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:49 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1603 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:49.635371 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c6aa2468-c429-42eb-a1df-49b83ed3c926 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:49.638171 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c6aa2468-c429-42eb-a1df-49b83ed3c926 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:49.653598 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:21:49.655859 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c6aa2468-c429-42eb-a1df-49b83ed3c926 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:49.661143 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c6aa2468-c429-42eb-a1df-49b83ed3c926 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:49.661939 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c6aa2468-c429-42eb-a1df-49b83ed3c926 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:49.662877 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c6aa2468-c429-42eb-a1df-49b83ed3c926 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:49.663505 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c6aa2468-c429-42eb-a1df-49b83ed3c926 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:49.663950 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c6aa2468-c429-42eb-a1df-49b83ed3c926 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:49.762083 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.multi_cell_list [None req-9dcd4cbb-1fdf-439e-bc70-3bfe7c5dd1f3 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120597) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 13:21:49.843121 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-c6aa2468-c429-42eb-a1df-49b83ed3c926 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] Lazy-loading 'services' on Instance uuid f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:21:49.848491 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9dcd4cbb-1fdf-439e-bc70-3bfe7c5dd1f3 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-5596789" status: 200 len: 344 microversion: 2.1 time: 0.378545 Oct 26 13:21:49.851974 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2280/4578] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Oct 26 13:21:49 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-5596789 => generated 344 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:21:49.865755 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8a460263-23f3-4962-8aac-1691b4cdbbb2 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:49.866256 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8a460263-23f3-4962-8aac-1691b4cdbbb2 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: 800fb374-b811-40a1-9843-8577e3a6d88a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:49.873800 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8a460263-23f3-4962-8aac-1691b4cdbbb2 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:49.874352 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8a460263-23f3-4962-8aac-1691b4cdbbb2 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:49.874860 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8a460263-23f3-4962-8aac-1691b4cdbbb2 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:49.875565 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8a460263-23f3-4962-8aac-1691b4cdbbb2 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:49.876076 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8a460263-23f3-4962-8aac-1691b4cdbbb2 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:49.876550 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8a460263-23f3-4962-8aac-1691b4cdbbb2 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:49.891003 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c6aa2468-c429-42eb-a1df-49b83ed3c926 tempest-UnshelveToHostMultiNodesTest-410273278 tempest-UnshelveToHostMultiNodesTest-410273278-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1938 microversion: 2.91 time: 0.264532 Oct 26 13:21:49.899634 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2299/4579] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:49 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1938 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:49.944370 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8a460263-23f3-4962-8aac-1691b4cdbbb2 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: 800fb374-b811-40a1-9843-8577e3a6d88a] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:21:49.962897 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d10796ef-43f3-410b-9559-db2fe33803e7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:49.963660 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d10796ef-43f3-410b-9559-db2fe33803e7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:49.977304 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d10796ef-43f3-410b-9559-db2fe33803e7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:49.977983 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d10796ef-43f3-410b-9559-db2fe33803e7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:49.980468 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d10796ef-43f3-410b-9559-db2fe33803e7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:49.981559 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d10796ef-43f3-410b-9559-db2fe33803e7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:49.984227 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d10796ef-43f3-410b-9559-db2fe33803e7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:49.984967 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d10796ef-43f3-410b-9559-db2fe33803e7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:50.038155 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d10796ef-43f3-410b-9559-db2fe33803e7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:21:50.201237 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:21:50.208041 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8a460263-23f3-4962-8aac-1691b4cdbbb2 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "DELETE /compute/v2.1/servers/800fb374-b811-40a1-9843-8577e3a6d88a" status: 204 len: 0 microversion: 2.1 time: 0.346426 Oct 26 13:21:50.214534 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2281/4580] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:21:49 2022] DELETE /compute/v2.1/servers/800fb374-b811-40a1-9843-8577e3a6d88a => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:21:50.231864 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-92c17dee-2017-477b-8005-8925ae5d7d29 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:50.234128 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-92c17dee-2017-477b-8005-8925ae5d7d29 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 8ec8dff5-3985-4f1c-9d2e-ddd28d538476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:50.239775 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d10796ef-43f3-410b-9559-db2fe33803e7 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 204 len: 0 microversion: 2.91 time: 0.274339 Oct 26 13:21:50.241286 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2300/4581] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 26 13:21:49 2022] DELETE /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 13:21:50.264560 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-06299277-0775-4802-a92f-6dbfba2507b6 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:50.268379 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-92c17dee-2017-477b-8005-8925ae5d7d29 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:50.268949 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-92c17dee-2017-477b-8005-8925ae5d7d29 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:50.270922 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-92c17dee-2017-477b-8005-8925ae5d7d29 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:50.274056 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-92c17dee-2017-477b-8005-8925ae5d7d29 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:50.274853 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-92c17dee-2017-477b-8005-8925ae5d7d29 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:50.275563 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-92c17dee-2017-477b-8005-8925ae5d7d29 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:50.277668 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-06299277-0775-4802-a92f-6dbfba2507b6 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: 800fb374-b811-40a1-9843-8577e3a6d88a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:50.294754 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06299277-0775-4802-a92f-6dbfba2507b6 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:50.295537 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06299277-0775-4802-a92f-6dbfba2507b6 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:50.295717 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06299277-0775-4802-a92f-6dbfba2507b6 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:50.297003 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06299277-0775-4802-a92f-6dbfba2507b6 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:50.297540 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06299277-0775-4802-a92f-6dbfba2507b6 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:50.297986 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06299277-0775-4802-a92f-6dbfba2507b6 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:50.854783 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-06299277-0775-4802-a92f-6dbfba2507b6 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:50.874441 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-06299277-0775-4802-a92f-6dbfba2507b6 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/800fb374-b811-40a1-9843-8577e3a6d88a" status: 200 len: 1519 microversion: 2.1 time: 0.631324 Oct 26 13:21:50.891206 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2301/4582] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:50 2022] GET /compute/v2.1/servers/800fb374-b811-40a1-9843-8577e3a6d88a => generated 1519 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:50.908829 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ee29e86c-f224-4eb2-85db-b9e35557870d tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:50.910003 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ee29e86c-f224-4eb2-85db-b9e35557870d tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:50.916002 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee29e86c-f224-4eb2-85db-b9e35557870d tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:50.916513 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee29e86c-f224-4eb2-85db-b9e35557870d tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:50.916953 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee29e86c-f224-4eb2-85db-b9e35557870d tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:50.917742 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee29e86c-f224-4eb2-85db-b9e35557870d tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:50.918208 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee29e86c-f224-4eb2-85db-b9e35557870d tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:50.918639 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee29e86c-f224-4eb2-85db-b9e35557870d tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:50.936976 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:21:51.119145 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-92c17dee-2017-477b-8005-8925ae5d7d29 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:51.138726 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-92c17dee-2017-477b-8005-8925ae5d7d29 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:51.146006 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-92c17dee-2017-477b-8005-8925ae5d7d29 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:51.147290 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-92c17dee-2017-477b-8005-8925ae5d7d29 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476" status: 200 len: 1372 microversion: 2.47 time: 0.929900 Oct 26 13:21:51.148077 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2282/4583] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:50 2022] GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476 => generated 1372 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:51.177532 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f4670939-8062-41b7-9fe2-16cb9c0ff32a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:51.177758 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f4670939-8062-41b7-9fe2-16cb9c0ff32a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:51.185942 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f4670939-8062-41b7-9fe2-16cb9c0ff32a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:51.186202 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f4670939-8062-41b7-9fe2-16cb9c0ff32a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:51.186628 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f4670939-8062-41b7-9fe2-16cb9c0ff32a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:51.187349 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f4670939-8062-41b7-9fe2-16cb9c0ff32a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:51.187801 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f4670939-8062-41b7-9fe2-16cb9c0ff32a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:51.188220 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f4670939-8062-41b7-9fe2-16cb9c0ff32a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:51.200048 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ee29e86c-f224-4eb2-85db-b9e35557870d tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:51.210846 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ee29e86c-f224-4eb2-85db-b9e35557870d tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:51.215964 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ee29e86c-f224-4eb2-85db-b9e35557870d tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:51.231716 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ee29e86c-f224-4eb2-85db-b9e35557870d tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1539 microversion: 2.91 time: 0.337887 Oct 26 13:21:51.232829 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2302/4584] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:50 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1539 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:51.449288 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f4670939-8062-41b7-9fe2-16cb9c0ff32a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:51.468477 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f4670939-8062-41b7-9fe2-16cb9c0ff32a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:51.473765 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f4670939-8062-41b7-9fe2-16cb9c0ff32a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:51.476323 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f4670939-8062-41b7-9fe2-16cb9c0ff32a tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1603 microversion: 2.32 time: 0.312744 Oct 26 13:21:51.479837 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2283/4585] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:51 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1603 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:51.621855 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-421441b7-afc3-4ee5-bf9a-b26bb0125def req-4639c5fb-eccc-4e4d-9b62-220c4ec6f094 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30dcd11b-b8ec-4095-a7d8-73ce795aeaa6", "tag": "413c2089-e162-4ff6-ae1f-b4d6cf728b5f"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:21:51.642796 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-421441b7-afc3-4ee5-bf9a-b26bb0125def req-4639c5fb-eccc-4e4d-9b62-220c4ec6f094 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:51.643293 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-421441b7-afc3-4ee5-bf9a-b26bb0125def req-4639c5fb-eccc-4e4d-9b62-220c4ec6f094 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:51.643739 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-421441b7-afc3-4ee5-bf9a-b26bb0125def req-4639c5fb-eccc-4e4d-9b62-220c4ec6f094 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:51.687995 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-421441b7-afc3-4ee5-bf9a-b26bb0125def req-4639c5fb-eccc-4e4d-9b62-220c4ec6f094 service nova] Creating event network-changed:413c2089-e162-4ff6-ae1f-b4d6cf728b5f for instance 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6 on n-h2-862686-1 Oct 26 13:21:51.703912 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-421441b7-afc3-4ee5-bf9a-b26bb0125def req-4639c5fb-eccc-4e4d-9b62-220c4ec6f094 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089322 Oct 26 13:21:51.710159 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2303/4586] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:21:51.903469 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-98c8724d-8fcf-4e95-bbcc-90d0158a2a93 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:51.904694 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-98c8724d-8fcf-4e95-bbcc-90d0158a2a93 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: 800fb374-b811-40a1-9843-8577e3a6d88a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:51.916334 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-98c8724d-8fcf-4e95-bbcc-90d0158a2a93 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:51.918554 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-98c8724d-8fcf-4e95-bbcc-90d0158a2a93 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:51.920119 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-98c8724d-8fcf-4e95-bbcc-90d0158a2a93 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:51.921268 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-98c8724d-8fcf-4e95-bbcc-90d0158a2a93 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:51.926781 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-98c8724d-8fcf-4e95-bbcc-90d0158a2a93 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:51.927739 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-98c8724d-8fcf-4e95-bbcc-90d0158a2a93 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:52.182203 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8b8426d3-0e91-474b-809d-d5b36cb5d0f9 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:52.184085 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8b8426d3-0e91-474b-809d-d5b36cb5d0f9 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 8ec8dff5-3985-4f1c-9d2e-ddd28d538476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:52.198061 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b8426d3-0e91-474b-809d-d5b36cb5d0f9 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:52.198938 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b8426d3-0e91-474b-809d-d5b36cb5d0f9 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:52.199592 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b8426d3-0e91-474b-809d-d5b36cb5d0f9 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:52.200529 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b8426d3-0e91-474b-809d-d5b36cb5d0f9 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:52.202750 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b8426d3-0e91-474b-809d-d5b36cb5d0f9 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:52.203697 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b8426d3-0e91-474b-809d-d5b36cb5d0f9 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:52.373100 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8b8426d3-0e91-474b-809d-d5b36cb5d0f9 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:52.386103 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8b8426d3-0e91-474b-809d-d5b36cb5d0f9 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:52.387999 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8b8426d3-0e91-474b-809d-d5b36cb5d0f9 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:52.389824 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8b8426d3-0e91-474b-809d-d5b36cb5d0f9 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476" status: 200 len: 1372 microversion: 2.47 time: 0.214456 Oct 26 13:21:52.391184 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2304/4587] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:52 2022] GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476 => generated 1372 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:52.410343 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d6c11f2c-f043-4c6b-8992-4ef928556297 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:52.411391 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d6c11f2c-f043-4c6b-8992-4ef928556297 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:52.419668 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6c11f2c-f043-4c6b-8992-4ef928556297 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:52.420244 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6c11f2c-f043-4c6b-8992-4ef928556297 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:52.420693 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6c11f2c-f043-4c6b-8992-4ef928556297 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:52.421424 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6c11f2c-f043-4c6b-8992-4ef928556297 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:52.421980 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6c11f2c-f043-4c6b-8992-4ef928556297 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:52.422437 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6c11f2c-f043-4c6b-8992-4ef928556297 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:52.501961 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d6c11f2c-f043-4c6b-8992-4ef928556297 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:52.512540 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d6c11f2c-f043-4c6b-8992-4ef928556297 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:52.514229 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d6c11f2c-f043-4c6b-8992-4ef928556297 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea7f38defef74d38a63f467b56bd411b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f4e071a15d44e2ab931387494bbd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:52.520083 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d6c11f2c-f043-4c6b-8992-4ef928556297 tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 200 len: 1539 microversion: 2.91 time: 0.127742 Oct 26 13:21:52.521217 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2305/4588] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:52 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 1539 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:52.547352 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ac8c5e66-4598-44cd-81e7-5062e537cf4b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:52.548144 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ac8c5e66-4598-44cd-81e7-5062e537cf4b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:52.556905 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac8c5e66-4598-44cd-81e7-5062e537cf4b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:52.557839 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac8c5e66-4598-44cd-81e7-5062e537cf4b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:52.558554 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac8c5e66-4598-44cd-81e7-5062e537cf4b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:52.559480 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac8c5e66-4598-44cd-81e7-5062e537cf4b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:52.560098 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac8c5e66-4598-44cd-81e7-5062e537cf4b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:52.560675 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac8c5e66-4598-44cd-81e7-5062e537cf4b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:52.634369 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-98c8724d-8fcf-4e95-bbcc-90d0158a2a93 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:52.642767 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ac8c5e66-4598-44cd-81e7-5062e537cf4b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:52.645703 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-98c8724d-8fcf-4e95-bbcc-90d0158a2a93 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/800fb374-b811-40a1-9843-8577e3a6d88a" status: 200 len: 1519 microversion: 2.1 time: 0.744889 Oct 26 13:21:52.650092 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2284/4589] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:51 2022] GET /compute/v2.1/servers/800fb374-b811-40a1-9843-8577e3a6d88a => generated 1519 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:52.656309 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ac8c5e66-4598-44cd-81e7-5062e537cf4b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:52.658839 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ac8c5e66-4598-44cd-81e7-5062e537cf4b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:52.660755 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ac8c5e66-4598-44cd-81e7-5062e537cf4b tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1603 microversion: 2.32 time: 0.138349 Oct 26 13:21:52.661674 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2306/4590] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:52 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1603 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:53.418330 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9b0ead6a-7034-4cf7-9722-ee1f199fd18a tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:53.418947 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9b0ead6a-7034-4cf7-9722-ee1f199fd18a tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 8ec8dff5-3985-4f1c-9d2e-ddd28d538476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:53.450937 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9b0ead6a-7034-4cf7-9722-ee1f199fd18a tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:53.462048 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9b0ead6a-7034-4cf7-9722-ee1f199fd18a tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:53.462709 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9b0ead6a-7034-4cf7-9722-ee1f199fd18a tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:53.463473 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9b0ead6a-7034-4cf7-9722-ee1f199fd18a tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:53.463952 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9b0ead6a-7034-4cf7-9722-ee1f199fd18a tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:53.464375 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9b0ead6a-7034-4cf7-9722-ee1f199fd18a tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:53.559295 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d65284b8-a757-4ca1-81b5-42540ba18cbe tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:53.560347 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d65284b8-a757-4ca1-81b5-42540ba18cbe tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] [instance: f74af3db-cbd2-49f9-af3f-cf32d4d54cd3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:53.577191 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d65284b8-a757-4ca1-81b5-42540ba18cbe tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:53.579245 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d65284b8-a757-4ca1-81b5-42540ba18cbe tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:53.579892 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d65284b8-a757-4ca1-81b5-42540ba18cbe tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:53.580802 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d65284b8-a757-4ca1-81b5-42540ba18cbe tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:53.582195 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d65284b8-a757-4ca1-81b5-42540ba18cbe tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:53.582856 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d65284b8-a757-4ca1-81b5-42540ba18cbe tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:53.636056 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-d65284b8-a757-4ca1-81b5-42540ba18cbe tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] HTTP exception thrown: Instance f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 could not be found. Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d65284b8-a757-4ca1-81b5-42540ba18cbe tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Request method failure captured: Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 HTTP/1.1 Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTPG2nDEKUBgsunu3mEbxAStRn5aBdXgqs_elx27hPmMNcLlpeYk06_zKepLsbxRsb0v2BO_pNudoEl4KrID9KqTcOl3gpPD0YN_rS5DnuaIyTi6wEk4Qab0ljurJBMH31gezfOsfZQs4KdAfwZTPhx6s1QVOTtUgO6Bgb7bqC-Lbg8 Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: X-Openstack-Nova-Api-Version: 2.91 Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: f5f4e071a15d44e2ab931387494bbd13 Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-2055035379 Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f5f4e071a15d44e2ab931387494bbd13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f5f4e071a15d44e2ab931387494bbd13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f5f4e071a15d44e2ab931387494bbd13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f5f4e071a15d44e2ab931387494bbd13"}]}] Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-2055035379 Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: f5f4e071a15d44e2ab931387494bbd13 Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-2055035379 Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-UnshelveToHostMultiNodesTest-2055035379-project Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: ea7f38defef74d38a63f467b56bd411b Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-2055035379-project Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 could not be found. Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'f74af3db-cbd2-49f9-af3f-cf32d4d54cd3'} Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 could not be found. Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 could not be found. Oct 26 13:21:53.638265 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:21:53.643899 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:21:53.643899 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:21:53.643899 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:53.643899 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:21:53.643899 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:21:53.643899 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:21:53.643899 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:21:53.643899 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 could not be found. Oct 26 13:21:53.643899 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:21:53.653723 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d65284b8-a757-4ca1-81b5-42540ba18cbe tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] Returning 404 to user: Instance f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:21:53.658123 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d65284b8-a757-4ca1-81b5-42540ba18cbe tempest-UnshelveToHostMultiNodesTest-2055035379 tempest-UnshelveToHostMultiNodesTest-2055035379-project] 10.222.0.40 "GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3" status: 404 len: 111 microversion: 2.91 time: 0.110571 Oct 26 13:21:53.670636 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2307/4591] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:53 2022] GET /compute/v2.1/servers/f74af3db-cbd2-49f9-af3f-cf32d4d54cd3 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:21:53.690066 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f36d3bd7-c7e9-406a-bdb7-259d21ac5ce4 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:53.692254 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f36d3bd7-c7e9-406a-bdb7-259d21ac5ce4 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: 800fb374-b811-40a1-9843-8577e3a6d88a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:53.698379 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9b0ead6a-7034-4cf7-9722-ee1f199fd18a tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:53.708450 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f36d3bd7-c7e9-406a-bdb7-259d21ac5ce4 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:53.708809 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9b0ead6a-7034-4cf7-9722-ee1f199fd18a tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:53.710268 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9b0ead6a-7034-4cf7-9722-ee1f199fd18a tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:53.711502 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f36d3bd7-c7e9-406a-bdb7-259d21ac5ce4 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:53.713027 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f36d3bd7-c7e9-406a-bdb7-259d21ac5ce4 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:53.714958 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f36d3bd7-c7e9-406a-bdb7-259d21ac5ce4 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:53.715795 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f36d3bd7-c7e9-406a-bdb7-259d21ac5ce4 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:53.716439 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f36d3bd7-c7e9-406a-bdb7-259d21ac5ce4 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:53.724306 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9b0ead6a-7034-4cf7-9722-ee1f199fd18a tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476" status: 200 len: 1357 microversion: 2.47 time: 0.306448 Oct 26 13:21:53.740980 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2285/4592] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:53 2022] GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476 => generated 1357 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:53.762898 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-465166f8-1e1f-45b1-a598-7da05d454f54 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:53.763520 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-465166f8-1e1f-45b1-a598-7da05d454f54 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:53.776664 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-465166f8-1e1f-45b1-a598-7da05d454f54 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:53.777519 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-465166f8-1e1f-45b1-a598-7da05d454f54 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:53.778136 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-465166f8-1e1f-45b1-a598-7da05d454f54 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:53.778987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-465166f8-1e1f-45b1-a598-7da05d454f54 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:53.779440 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-465166f8-1e1f-45b1-a598-7da05d454f54 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:53.779911 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-465166f8-1e1f-45b1-a598-7da05d454f54 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:53.837320 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-465166f8-1e1f-45b1-a598-7da05d454f54 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:53.837891 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-465166f8-1e1f-45b1-a598-7da05d454f54 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:53.838541 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-465166f8-1e1f-45b1-a598-7da05d454f54 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:53.839087 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-465166f8-1e1f-45b1-a598-7da05d454f54 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lazy-loading 'fault' on Instance uuid 893420b7-27d9-4240-8182-87dd3231cbe2 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:21:53.842993 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f36d3bd7-c7e9-406a-bdb7-259d21ac5ce4 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:53.843482 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f36d3bd7-c7e9-406a-bdb7-259d21ac5ce4 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:53.843911 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f36d3bd7-c7e9-406a-bdb7-259d21ac5ce4 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:53.844356 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-f36d3bd7-c7e9-406a-bdb7-259d21ac5ce4 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lazy-loading 'fault' on Instance uuid 800fb374-b811-40a1-9843-8577e3a6d88a {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:21:53.907108 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-465166f8-1e1f-45b1-a598-7da05d454f54 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:53.917155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-465166f8-1e1f-45b1-a598-7da05d454f54 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:53.919102 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-465166f8-1e1f-45b1-a598-7da05d454f54 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6097043a9a7d455bb4a8e2146a14dbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8020c4d2858a4c6cbd194758e958dad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:53.920748 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-465166f8-1e1f-45b1-a598-7da05d454f54 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 200 len: 1608 microversion: 2.32 time: 0.178031 Oct 26 13:21:53.921464 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2286/4593] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:53 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 1608 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:53.929022 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f36d3bd7-c7e9-406a-bdb7-259d21ac5ce4 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:53.947009 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f36d3bd7-c7e9-406a-bdb7-259d21ac5ce4 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/800fb374-b811-40a1-9843-8577e3a6d88a" status: 200 len: 1311 microversion: 2.1 time: 0.273422 Oct 26 13:21:53.956752 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4eb88254-a226-41e7-a345-813ce34f5f17 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:53.957278 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2308/4594] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:53 2022] GET /compute/v2.1/servers/800fb374-b811-40a1-9843-8577e3a6d88a => generated 1311 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:53.959576 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4eb88254-a226-41e7-a345-813ce34f5f17 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:53.960596 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4eb88254-a226-41e7-a345-813ce34f5f17 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Searching by: {'deleted': False, 'project_id': '9a378a658347414fbea6f4c90e31cc16'} {{(pid=120597) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 13:21:53.967951 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4eb88254-a226-41e7-a345-813ce34f5f17 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:53.968872 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4eb88254-a226-41e7-a345-813ce34f5f17 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:53.969438 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4eb88254-a226-41e7-a345-813ce34f5f17 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:53.970802 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-47cfe4a8-654e-4ba4-a4d0-5da501c9a389 req-90c7de55-9693-4fe4-84a6-53a76ad3e782 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "800fb374-b811-40a1-9843-8577e3a6d88a", "name": "network-vif-deleted", "tag": "3a920a09-d5e1-4e4b-b069-8e68e06d60e1"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:21:53.971930 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4eb88254-a226-41e7-a345-813ce34f5f17 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:53.972904 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4eb88254-a226-41e7-a345-813ce34f5f17 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:53.973455 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4eb88254-a226-41e7-a345-813ce34f5f17 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:53.992617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-47cfe4a8-654e-4ba4-a4d0-5da501c9a389 req-90c7de55-9693-4fe4-84a6-53a76ad3e782 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:53.995660 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-47cfe4a8-654e-4ba4-a4d0-5da501c9a389 req-90c7de55-9693-4fe4-84a6-53a76ad3e782 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:54.007945 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-47cfe4a8-654e-4ba4-a4d0-5da501c9a389 req-90c7de55-9693-4fe4-84a6-53a76ad3e782 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:54.048643 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-47cfe4a8-654e-4ba4-a4d0-5da501c9a389 req-90c7de55-9693-4fe4-84a6-53a76ad3e782 service nova] Creating event network-vif-deleted:3a920a09-d5e1-4e4b-b069-8e68e06d60e1 for instance 800fb374-b811-40a1-9843-8577e3a6d88a on n-h2-862686-1 Oct 26 13:21:54.068134 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-47cfe4a8-654e-4ba4-a4d0-5da501c9a389 req-90c7de55-9693-4fe4-84a6-53a76ad3e782 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104659 Oct 26 13:21:54.069031 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2309/4595] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:21:54.124464 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.multi_cell_list [None req-4eb88254-a226-41e7-a345-813ce34f5f17 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120597) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 13:21:54.550731 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4eb88254-a226-41e7-a345-813ce34f5f17 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:54.558368 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4eb88254-a226-41e7-a345-813ce34f5f17 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:54.558862 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4eb88254-a226-41e7-a345-813ce34f5f17 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:54.559306 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4eb88254-a226-41e7-a345-813ce34f5f17 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:54.571910 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4eb88254-a226-41e7-a345-813ce34f5f17 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:54.573374 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4eb88254-a226-41e7-a345-813ce34f5f17 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:54.616545 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4eb88254-a226-41e7-a345-813ce34f5f17 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 0.681774 Oct 26 13:21:54.630204 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2287/4596] 10.222.0.40 () {60 vars in 1187 bytes} [Wed Oct 26 13:21:53 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:54.652980 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5ed9a473-f3fd-47fc-9d2a-42af943930c1 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:54.653595 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5ed9a473-f3fd-47fc-9d2a-42af943930c1 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 8ec8dff5-3985-4f1c-9d2e-ddd28d538476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:54.660083 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5ed9a473-f3fd-47fc-9d2a-42af943930c1 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:54.660625 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5ed9a473-f3fd-47fc-9d2a-42af943930c1 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:54.661104 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5ed9a473-f3fd-47fc-9d2a-42af943930c1 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:54.661823 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5ed9a473-f3fd-47fc-9d2a-42af943930c1 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:54.662288 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5ed9a473-f3fd-47fc-9d2a-42af943930c1 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:54.662717 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5ed9a473-f3fd-47fc-9d2a-42af943930c1 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:54.689000 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5ed9a473-f3fd-47fc-9d2a-42af943930c1 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 8ec8dff5-3985-4f1c-9d2e-ddd28d538476] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:21:54.774788 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5ed9a473-f3fd-47fc-9d2a-42af943930c1 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476" status: 204 len: 0 microversion: 2.47 time: 0.125784 Oct 26 13:21:54.778438 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2310/4597] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 26 13:21:54 2022] DELETE /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 13:21:54.784526 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bcc71ffd-293e-41b1-87cb-c06b0ea7e054 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:54.785702 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bcc71ffd-293e-41b1-87cb-c06b0ea7e054 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 8ec8dff5-3985-4f1c-9d2e-ddd28d538476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:54.792209 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bcc71ffd-293e-41b1-87cb-c06b0ea7e054 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:54.792633 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bcc71ffd-293e-41b1-87cb-c06b0ea7e054 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:54.793186 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bcc71ffd-293e-41b1-87cb-c06b0ea7e054 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:54.793997 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bcc71ffd-293e-41b1-87cb-c06b0ea7e054 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:54.794463 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bcc71ffd-293e-41b1-87cb-c06b0ea7e054 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:54.795551 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bcc71ffd-293e-41b1-87cb-c06b0ea7e054 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:54.889392 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bcc71ffd-293e-41b1-87cb-c06b0ea7e054 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:54.896250 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:21:54.906355 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bcc71ffd-293e-41b1-87cb-c06b0ea7e054 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:54.908563 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bcc71ffd-293e-41b1-87cb-c06b0ea7e054 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:54.910755 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bcc71ffd-293e-41b1-87cb-c06b0ea7e054 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476" status: 200 len: 1363 microversion: 2.47 time: 0.131075 Oct 26 13:21:54.911717 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2288/4598] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:54 2022] GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476 => generated 1363 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:21:54.951264 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b639e897-9837-4efc-84ac-8a652e7bdf4e tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:54.951965 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b639e897-9837-4efc-84ac-8a652e7bdf4e tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:54.957449 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:21:54.959436 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b639e897-9837-4efc-84ac-8a652e7bdf4e tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:54.959920 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b639e897-9837-4efc-84ac-8a652e7bdf4e tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:54.960699 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b639e897-9837-4efc-84ac-8a652e7bdf4e tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:54.961594 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b639e897-9837-4efc-84ac-8a652e7bdf4e tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:54.962204 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b639e897-9837-4efc-84ac-8a652e7bdf4e tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:54.962801 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b639e897-9837-4efc-84ac-8a652e7bdf4e tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:54.982287 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7b119fdd-9775-43de-bdb5-074db569469d tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:54.983188 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7b119fdd-9775-43de-bdb5-074db569469d tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: 800fb374-b811-40a1-9843-8577e3a6d88a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:54.992092 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-b639e897-9837-4efc-84ac-8a652e7bdf4e tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] HTTP exception thrown: Instance 893420b7-27d9-4240-8182-87dd3231cbe2 could not be found. Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b639e897-9837-4efc-84ac-8a652e7bdf4e tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Request method failure captured: Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 HTTP/1.1 Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTLwMRqFXjEm1YtGKBMtzqfrqKcHzQ3yG0uplU3MaGAYmHHNuk8MQkq0wNL5a4sMxMtgmRzZABVZ45JDUMkNkPujXrfOIEqxyEGkEaR5cF47X4u9L7H2fOBwByG_wlEl2e_yDZi-D6fTcdFCB24Qtb-V8VqE7vs3fYQnyc9z72oyrVc Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: X-Openstack-Nova-Api-Version: 2.32 Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 8020c4d2858a4c6cbd194758e958dad0 Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-TaggedBootDevicesTest-215566972 Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8020c4d2858a4c6cbd194758e958dad0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8020c4d2858a4c6cbd194758e958dad0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8020c4d2858a4c6cbd194758e958dad0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8020c4d2858a4c6cbd194758e958dad0"}]}] Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-TaggedBootDevicesTest-215566972 Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 8020c4d2858a4c6cbd194758e958dad0 Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-TaggedBootDevicesTest-215566972 Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-TaggedBootDevicesTest-215566972-project Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 6097043a9a7d455bb4a8e2146a14dbdd Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-TaggedBootDevicesTest-215566972-project Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 893420b7-27d9-4240-8182-87dd3231cbe2 could not be found. Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '893420b7-27d9-4240-8182-87dd3231cbe2'} Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 893420b7-27d9-4240-8182-87dd3231cbe2 could not be found. Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 893420b7-27d9-4240-8182-87dd3231cbe2 could not be found. Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:21:54.994045 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:21:54.998477 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:54.998477 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:21:54.998477 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:21:54.998477 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:21:54.998477 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:21:54.998477 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 893420b7-27d9-4240-8182-87dd3231cbe2 could not be found. Oct 26 13:21:54.998477 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:21:54.998954 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b119fdd-9775-43de-bdb5-074db569469d tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:54.999857 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b639e897-9837-4efc-84ac-8a652e7bdf4e tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Returning 404 to user: Instance 893420b7-27d9-4240-8182-87dd3231cbe2 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:21:55.000452 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b119fdd-9775-43de-bdb5-074db569469d tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:55.000927 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b119fdd-9775-43de-bdb5-074db569469d tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:55.001243 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b639e897-9837-4efc-84ac-8a652e7bdf4e tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 404 len: 111 microversion: 2.32 time: 0.054489 Oct 26 13:21:55.001875 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2311/4599] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:54 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:21:55.002336 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b119fdd-9775-43de-bdb5-074db569469d tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:55.002819 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b119fdd-9775-43de-bdb5-074db569469d tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:55.003261 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b119fdd-9775-43de-bdb5-074db569469d tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:55.010616 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7406ce0e-9c4d-4269-b5ce-e8e7b406add8 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '.version_select at 0x7f6732463430>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:55.032322 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7406ce0e-9c4d-4269-b5ce-e8e7b406add8 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-459688330" status: 204 len: 0 microversion: 2.32 time: 0.024973 Oct 26 13:21:55.033412 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2312/4600] 10.222.0.40 () {60 vars in 1259 bytes} [Wed Oct 26 13:21:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-459688330 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 13:21:55.058909 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-7b119fdd-9775-43de-bdb5-074db569469d tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] HTTP exception thrown: Instance 800fb374-b811-40a1-9843-8577e3a6d88a could not be found. Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7b119fdd-9775-43de-bdb5-074db569469d tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Request method failure captured: Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/800fb374-b811-40a1-9843-8577e3a6d88a HTTP/1.1 Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTQyUkWTEWbYQoZmHr_U7kplZYqWQRwOJeuTv_tcfOPje80gEX4g9SVM0rLpflAgmkrOW6WrhGn6RQP55tW8153E1Un1Teh9P0Q2AJ-dpt59wT2GHnk8oJ9kiu11mv1lGBdweD53tXyqi8VnxXv7nv8NQPtSSzfqC_lVNtgpBHuTE40 Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: cf8d947764e045dfafa0a18ec2472e7b Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ListServerFiltersTestJSON-563653154 Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cf8d947764e045dfafa0a18ec2472e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cf8d947764e045dfafa0a18ec2472e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cf8d947764e045dfafa0a18ec2472e7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cf8d947764e045dfafa0a18ec2472e7b"}]}] Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ListServerFiltersTestJSON-563653154 Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: cf8d947764e045dfafa0a18ec2472e7b Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-563653154 Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ListServerFiltersTestJSON-563653154-project Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 8b9017d8481844cd9266b86736982c92 Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ListServerFiltersTestJSON-563653154-project Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 800fb374-b811-40a1-9843-8577e3a6d88a could not be found. Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '800fb374-b811-40a1-9843-8577e3a6d88a'} Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 800fb374-b811-40a1-9843-8577e3a6d88a could not be found. Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 800fb374-b811-40a1-9843-8577e3a6d88a could not be found. Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:21:55.063088 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:55.067597 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:55.067597 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:21:55.067597 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:21:55.067597 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:21:55.067597 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:21:55.067597 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 800fb374-b811-40a1-9843-8577e3a6d88a could not be found. Oct 26 13:21:55.067597 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:55.068524 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7b119fdd-9775-43de-bdb5-074db569469d tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Returning 404 to user: Instance 800fb374-b811-40a1-9843-8577e3a6d88a could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:21:55.072116 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7b119fdd-9775-43de-bdb5-074db569469d tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/800fb374-b811-40a1-9843-8577e3a6d88a" status: 404 len: 111 microversion: 2.1 time: 0.094843 Oct 26 13:21:55.073114 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2289/4601] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:54 2022] GET /compute/v2.1/servers/800fb374-b811-40a1-9843-8577e3a6d88a => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:21:55.082464 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a40e21d3-ad9f-410b-adb0-d6e3c1bf61d1 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:55.083496 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a40e21d3-ad9f-410b-adb0-d6e3c1bf61d1 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: f9df48e5-9204-46d5-b2a9-2154dbdcf167] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:55.091395 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a40e21d3-ad9f-410b-adb0-d6e3c1bf61d1 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:55.091901 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a40e21d3-ad9f-410b-adb0-d6e3c1bf61d1 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:55.099696 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a40e21d3-ad9f-410b-adb0-d6e3c1bf61d1 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:55.100297 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a40e21d3-ad9f-410b-adb0-d6e3c1bf61d1 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:55.100794 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a40e21d3-ad9f-410b-adb0-d6e3c1bf61d1 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:55.101237 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a40e21d3-ad9f-410b-adb0-d6e3c1bf61d1 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:55.165310 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a40e21d3-ad9f-410b-adb0-d6e3c1bf61d1 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: f9df48e5-9204-46d5-b2a9-2154dbdcf167] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:21:55.338210 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a40e21d3-ad9f-410b-adb0-d6e3c1bf61d1 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f9df48e5-9204-46d5-b2a9-2154dbdcf167" status: 204 len: 0 microversion: 2.1 time: 0.260549 Oct 26 13:21:55.339984 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2313/4602] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:21:55 2022] DELETE /compute/v2.1/servers/f9df48e5-9204-46d5-b2a9-2154dbdcf167 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:21:55.358145 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-888cea38-dce5-4bf8-8c7d-cf4b3277bd91 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:55.358880 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-888cea38-dce5-4bf8-8c7d-cf4b3277bd91 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: f9df48e5-9204-46d5-b2a9-2154dbdcf167] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:55.378916 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-888cea38-dce5-4bf8-8c7d-cf4b3277bd91 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:55.379238 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-888cea38-dce5-4bf8-8c7d-cf4b3277bd91 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:55.381306 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-888cea38-dce5-4bf8-8c7d-cf4b3277bd91 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:55.382598 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-888cea38-dce5-4bf8-8c7d-cf4b3277bd91 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:55.390531 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-888cea38-dce5-4bf8-8c7d-cf4b3277bd91 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:55.391233 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-888cea38-dce5-4bf8-8c7d-cf4b3277bd91 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:55.477165 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3e1311fc-c1fd-4966-9dae-3cfedb4c019f tempest-VolumesNegativeTest-35807634 tempest-VolumesNegativeTest-35807634-project] Action: 'create', calling method: .version_select at 0x7f67326edee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1000073733", "metadata": {"Type": "work"}}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3e1311fc-c1fd-4966-9dae-3cfedb4c019f tempest-VolumesNegativeTest-35807634 tempest-VolumesNegativeTest-35807634-project] Request method failure captured: Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 122 Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTRzhFVhaXAyvwhvrnC_jC1ekDh93wXuwUZYE8nk1_oAxuwtk1L2VVi1-mPMffA0EkAcV0fiUdaQjvtVJ51tRr2ywvRvj6Ta0ULHfOKumcL22SnRmfLbANEheL-uxQBR2ZTYazDuAWz7ycNF_W9yACCSwLW-KDe0_9APzfQHxidn4aw Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 0865f2a8503a42eab4d3ccc221f38c61 Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-VolumesNegativeTest-35807634 Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0865f2a8503a42eab4d3ccc221f38c61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0865f2a8503a42eab4d3ccc221f38c61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0865f2a8503a42eab4d3ccc221f38c61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0865f2a8503a42eab4d3ccc221f38c61"}]}] Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-VolumesNegativeTest-35807634 Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 0865f2a8503a42eab4d3ccc221f38c61 Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-VolumesNegativeTest-35807634 Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-VolumesNegativeTest-35807634-project Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: e385bcfd851e4529962b1803e6225253 Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-VolumesNegativeTest-35807634-project Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1000073733", "metadata": {"Type": "work"}}} Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: method: Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1000073733', 'metadata': {'Type': 'work'}}}} Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise error Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi '#$%' Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 13:21:55.482904 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 13:21:55.487375 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 26 13:21:55.487375 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:55.487375 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:21:55.487375 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:55.487375 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:55.487375 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:21:55.487375 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:21:55.487375 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 13:21:55.487375 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 13:21:55.487375 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 26 13:21:55.487375 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:55.487375 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3e1311fc-c1fd-4966-9dae-3cfedb4c019f tempest-VolumesNegativeTest-35807634 tempest-VolumesNegativeTest-35807634-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:21:55.487375 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3e1311fc-c1fd-4966-9dae-3cfedb4c019f tempest-VolumesNegativeTest-35807634 tempest-VolumesNegativeTest-35807634-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.318990 Oct 26 13:21:55.487375 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2290/4603] 10.222.0.40 () {60 vars in 1156 bytes} [Wed Oct 26 13:21:55 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 320 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:21:55.499564 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6f3c9a9a-9679-4af1-bd7d-d21a61b7f2e1 tempest-VolumesNegativeTest-35807634 tempest-VolumesNegativeTest-35807634-project] Action: 'create', calling method: .version_select at 0x7f6732692f70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2501027", "metadata": {"Type": "work"}}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6f3c9a9a-9679-4af1-bd7d-d21a61b7f2e1 tempest-VolumesNegativeTest-35807634 tempest-VolumesNegativeTest-35807634-project] Request method failure captured: Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 117 Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTRzhFVhaXAyvwhvrnC_jC1ekDh93wXuwUZYE8nk1_oAxuwtk1L2VVi1-mPMffA0EkAcV0fiUdaQjvtVJ51tRr2ywvRvj6Ta0ULHfOKumcL22SnRmfLbANEheL-uxQBR2ZTYazDuAWz7ycNF_W9yACCSwLW-KDe0_9APzfQHxidn4aw Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 0865f2a8503a42eab4d3ccc221f38c61 Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-VolumesNegativeTest-35807634 Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0865f2a8503a42eab4d3ccc221f38c61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0865f2a8503a42eab4d3ccc221f38c61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0865f2a8503a42eab4d3ccc221f38c61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0865f2a8503a42eab4d3ccc221f38c61"}]}] Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-VolumesNegativeTest-35807634 Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 0865f2a8503a42eab4d3ccc221f38c61 Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-VolumesNegativeTest-35807634 Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-VolumesNegativeTest-35807634-project Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: e385bcfd851e4529962b1803e6225253 Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-VolumesNegativeTest-35807634-project Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2501027", "metadata": {"Type": "work"}}} Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: method: Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2501027', 'metadata': {'Type': 'work'}}}} Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise error Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi '0' Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 13:21:55.503553 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 13:21:55.508386 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 26 13:21:55.508386 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:55.508386 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:21:55.508386 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:55.508386 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:55.508386 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:21:55.508386 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:21:55.508386 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 13:21:55.508386 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 13:21:55.508386 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 26 13:21:55.508386 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:55.508386 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6f3c9a9a-9679-4af1-bd7d-d21a61b7f2e1 tempest-VolumesNegativeTest-35807634 tempest-VolumesNegativeTest-35807634-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:21:55.508386 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6f3c9a9a-9679-4af1-bd7d-d21a61b7f2e1 tempest-VolumesNegativeTest-35807634 tempest-VolumesNegativeTest-35807634-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010816 Oct 26 13:21:55.512506 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2291/4604] 10.222.0.40 () {60 vars in 1156 bytes} [Wed Oct 26 13:21:55 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:21:55.520482 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f5c7e790-56d8-4342-9bb6-f9fa76a1053d tempest-VolumesNegativeTest-35807634 tempest-VolumesNegativeTest-35807634-project] Action: 'create', calling method: .version_select at 0x7f67326edb80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2068154304", "metadata": {"Type": "work"}}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f5c7e790-56d8-4342-9bb6-f9fa76a1053d tempest-VolumesNegativeTest-35807634 tempest-VolumesNegativeTest-35807634-project] Request method failure captured: Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 119 Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTRzhFVhaXAyvwhvrnC_jC1ekDh93wXuwUZYE8nk1_oAxuwtk1L2VVi1-mPMffA0EkAcV0fiUdaQjvtVJ51tRr2ywvRvj6Ta0ULHfOKumcL22SnRmfLbANEheL-uxQBR2ZTYazDuAWz7ycNF_W9yACCSwLW-KDe0_9APzfQHxidn4aw Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 0865f2a8503a42eab4d3ccc221f38c61 Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-VolumesNegativeTest-35807634 Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0865f2a8503a42eab4d3ccc221f38c61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0865f2a8503a42eab4d3ccc221f38c61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0865f2a8503a42eab4d3ccc221f38c61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0865f2a8503a42eab4d3ccc221f38c61"}]}] Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-VolumesNegativeTest-35807634 Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 0865f2a8503a42eab4d3ccc221f38c61 Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-VolumesNegativeTest-35807634 Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-VolumesNegativeTest-35807634-project Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: e385bcfd851e4529962b1803e6225253 Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-VolumesNegativeTest-35807634-project Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2068154304", "metadata": {"Type": "work"}}} Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: method: Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2068154304', 'metadata': {'Type': 'work'}}}} Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise error Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi '' Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 13:21:55.526337 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 13:21:55.529943 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 26 13:21:55.529943 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:55.529943 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:21:55.529943 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:55.529943 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:55.529943 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:21:55.529943 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:21:55.529943 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 13:21:55.529943 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 13:21:55.529943 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 26 13:21:55.529943 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:55.531224 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f5c7e790-56d8-4342-9bb6-f9fa76a1053d tempest-VolumesNegativeTest-35807634 tempest-VolumesNegativeTest-35807634-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:21:55.532129 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f5c7e790-56d8-4342-9bb6-f9fa76a1053d tempest-VolumesNegativeTest-35807634 tempest-VolumesNegativeTest-35807634-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.018387 Oct 26 13:21:55.532710 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2292/4605] 10.222.0.40 () {60 vars in 1156 bytes} [Wed Oct 26 13:21:55 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:21:55.546694 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f4be9472-4ffc-4a9a-8816-84c79ac5a41a tempest-VolumesNegativeTest-35807634 tempest-VolumesNegativeTest-35807634-project] Calling method '.version_select at 0x7f6732ea8940>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:55.591046 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-f4be9472-4ffc-4a9a-8816-84c79ac5a41a tempest-VolumesNegativeTest-35807634 tempest-VolumesNegativeTest-35807634-project] HTTP exception thrown: Volume tempest-invalid-1300668641 could not be found. Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f4be9472-4ffc-4a9a-8816-84c79ac5a41a tempest-VolumesNegativeTest-35807634 tempest-VolumesNegativeTest-35807634-project] Request method failure captured: Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1300668641 HTTP/1.1 Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTRzhFVhaXAyvwhvrnC_jC1ekDh93wXuwUZYE8nk1_oAxuwtk1L2VVi1-mPMffA0EkAcV0fiUdaQjvtVJ51tRr2ywvRvj6Ta0ULHfOKumcL22SnRmfLbANEheL-uxQBR2ZTYazDuAWz7ycNF_W9yACCSwLW-KDe0_9APzfQHxidn4aw Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 0865f2a8503a42eab4d3ccc221f38c61 Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-VolumesNegativeTest-35807634 Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0865f2a8503a42eab4d3ccc221f38c61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0865f2a8503a42eab4d3ccc221f38c61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0865f2a8503a42eab4d3ccc221f38c61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0865f2a8503a42eab4d3ccc221f38c61"}]}] Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-VolumesNegativeTest-35807634 Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 0865f2a8503a42eab4d3ccc221f38c61 Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-VolumesNegativeTest-35807634 Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-VolumesNegativeTest-35807634-project Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: e385bcfd851e4529962b1803e6225253 Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-VolumesNegativeTest-35807634-project Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: method: Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: exception: Volume tempest-invalid-1300668641 could not be found. Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'tempest-invalid-1300668641'} Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1300668641 could not be found. (HTTP 404) (Request-ID: req-461baade-1da2-4988-8354-6b610a9b9ee8) Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 13:21:55.593776 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 13:21:55.597783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 26 13:21:55.597783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 26 13:21:55.597783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 26 13:21:55.597783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 26 13:21:55.597783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 26 13:21:55.597783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 26 13:21:55.597783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 26 13:21:55.597783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 26 13:21:55.597783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 13:21:55.597783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 13:21:55.597783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 13:21:55.597783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 13:21:55.597783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1300668641 could not be found. Oct 26 13:21:55.597783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:55.597783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:21:55.597783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:55.597783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:55.597783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:21:55.597783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:21:55.597783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:21:55.597783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:21:55.597783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:21:55.597783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:21:55.597783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:21:55.597783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:21:55.597783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 26 13:21:55.597783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:21:55.597783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1300668641 could not be found. Oct 26 13:21:55.597783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:55.597783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:21:55.597783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:55.597783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:55.597783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:21:55.597783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:21:55.597783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:21:55.597783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:21:55.597783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1300668641 could not be found. Oct 26 13:21:55.597783 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:55.597783 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f4be9472-4ffc-4a9a-8816-84c79ac5a41a tempest-VolumesNegativeTest-35807634 tempest-VolumesNegativeTest-35807634-project] Returning 404 to user: Volume tempest-invalid-1300668641 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:21:55.597783 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f4be9472-4ffc-4a9a-8816-84c79ac5a41a tempest-VolumesNegativeTest-35807634 tempest-VolumesNegativeTest-35807634-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1300668641" status: 404 len: 99 microversion: 2.1 time: 0.054254 Oct 26 13:21:55.601945 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2293/4606] 10.222.0.40 () {58 vars in 1218 bytes} [Wed Oct 26 13:21:55 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1300668641 => generated 99 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 26 13:21:55.605418 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-89988369-7b19-4723-b1f6-1f65ffea22d9 tempest-VolumesNegativeTest-35807634 tempest-VolumesNegativeTest-35807634-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004101 Oct 26 13:21:55.606089 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2294/4607] 10.222.0.40 () {58 vars in 1140 bytes} [Wed Oct 26 13:21:55 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 26 13:21:55.614860 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bfb1985f-7493-4525-b03e-b529b4683534 tempest-VolumesNegativeTest-35807634 tempest-VolumesNegativeTest-35807634-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003718 Oct 26 13:21:55.615360 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2295/4608] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 26 13:21:55 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 26 13:21:55.624320 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c97d58e4-254b-4690-ada2-10934e155ae0 tempest-VolumesNegativeTest-35807634 tempest-VolumesNegativeTest-35807634-project] Calling method '.version_select at 0x7f67326ed670>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:55.658589 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-c97d58e4-254b-4690-ada2-10934e155ae0 tempest-VolumesNegativeTest-35807634 tempest-VolumesNegativeTest-35807634-project] HTTP exception thrown: Volume 30f6216e-0fba-4965-9a58-f788cc6dc0dc could not be found. Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c97d58e4-254b-4690-ada2-10934e155ae0 tempest-VolumesNegativeTest-35807634 tempest-VolumesNegativeTest-35807634-project] Request method failure captured: Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/os-volumes/30f6216e-0fba-4965-9a58-f788cc6dc0dc HTTP/1.1 Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTRzhFVhaXAyvwhvrnC_jC1ekDh93wXuwUZYE8nk1_oAxuwtk1L2VVi1-mPMffA0EkAcV0fiUdaQjvtVJ51tRr2ywvRvj6Ta0ULHfOKumcL22SnRmfLbANEheL-uxQBR2ZTYazDuAWz7ycNF_W9yACCSwLW-KDe0_9APzfQHxidn4aw Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 0865f2a8503a42eab4d3ccc221f38c61 Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-VolumesNegativeTest-35807634 Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0865f2a8503a42eab4d3ccc221f38c61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0865f2a8503a42eab4d3ccc221f38c61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0865f2a8503a42eab4d3ccc221f38c61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0865f2a8503a42eab4d3ccc221f38c61"}]}] Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-VolumesNegativeTest-35807634 Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 0865f2a8503a42eab4d3ccc221f38c61 Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-VolumesNegativeTest-35807634 Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-VolumesNegativeTest-35807634-project Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: e385bcfd851e4529962b1803e6225253 Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-VolumesNegativeTest-35807634-project Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: method: Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: exception: Volume 30f6216e-0fba-4965-9a58-f788cc6dc0dc could not be found. Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '30f6216e-0fba-4965-9a58-f788cc6dc0dc'} Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 30f6216e-0fba-4965-9a58-f788cc6dc0dc could not be found. (HTTP 404) (Request-ID: req-88ad44d0-59cc-4cd8-926a-44313881fd27) Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 26 13:21:55.660878 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 13:21:55.668932 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 13:21:55.668932 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 26 13:21:55.668932 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 26 13:21:55.668932 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 26 13:21:55.668932 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 26 13:21:55.668932 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 26 13:21:55.668932 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 26 13:21:55.668932 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 26 13:21:55.668932 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 26 13:21:55.668932 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 13:21:55.668932 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 13:21:55.668932 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 13:21:55.668932 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 13:21:55.668932 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 30f6216e-0fba-4965-9a58-f788cc6dc0dc could not be found. Oct 26 13:21:55.668932 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:55.668932 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:21:55.668932 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:55.668932 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:55.668932 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:21:55.668932 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:21:55.668932 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:21:55.668932 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:21:55.668932 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:21:55.668932 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:21:55.668932 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:21:55.668932 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:21:55.668932 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 26 13:21:55.668932 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:21:55.668932 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 30f6216e-0fba-4965-9a58-f788cc6dc0dc could not be found. Oct 26 13:21:55.668932 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:55.668932 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:21:55.668932 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:55.668932 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:55.668932 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:21:55.668932 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:21:55.668932 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:21:55.668932 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:21:55.668932 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 30f6216e-0fba-4965-9a58-f788cc6dc0dc could not be found. Oct 26 13:21:55.668932 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:55.668932 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c97d58e4-254b-4690-ada2-10934e155ae0 tempest-VolumesNegativeTest-35807634 tempest-VolumesNegativeTest-35807634-project] Returning 404 to user: Volume 30f6216e-0fba-4965-9a58-f788cc6dc0dc could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:21:55.668932 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c97d58e4-254b-4690-ada2-10934e155ae0 tempest-VolumesNegativeTest-35807634 tempest-VolumesNegativeTest-35807634-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/30f6216e-0fba-4965-9a58-f788cc6dc0dc" status: 404 len: 109 microversion: 2.1 time: 0.041837 Oct 26 13:21:55.668932 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2296/4609] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Oct 26 13:21:55 2022] DELETE /compute/v2.1/os-volumes/30f6216e-0fba-4965-9a58-f788cc6dc0dc => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:21:55.675367 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-46252f83-364b-4b56-833c-5e9398782036 tempest-VolumesNegativeTest-35807634 tempest-VolumesNegativeTest-35807634-project] Calling method '.version_select at 0x7f67326eda60>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:55.703498 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-888cea38-dce5-4bf8-8c7d-cf4b3277bd91 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:55.713446 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-46252f83-364b-4b56-833c-5e9398782036 tempest-VolumesNegativeTest-35807634 tempest-VolumesNegativeTest-35807634-project] HTTP exception thrown: Volume 0f54d0c9-4fbb-4353-9f88-fad2a72d6bbc could not be found. Oct 26 13:21:55.714615 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-888cea38-dce5-4bf8-8c7d-cf4b3277bd91 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/f9df48e5-9204-46d5-b2a9-2154dbdcf167" status: 200 len: 1518 microversion: 2.1 time: 0.370057 Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-46252f83-364b-4b56-833c-5e9398782036 tempest-VolumesNegativeTest-35807634 tempest-VolumesNegativeTest-35807634-project] Request method failure captured: Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/os-volumes/0f54d0c9-4fbb-4353-9f88-fad2a72d6bbc HTTP/1.1 Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTRzhFVhaXAyvwhvrnC_jC1ekDh93wXuwUZYE8nk1_oAxuwtk1L2VVi1-mPMffA0EkAcV0fiUdaQjvtVJ51tRr2ywvRvj6Ta0ULHfOKumcL22SnRmfLbANEheL-uxQBR2ZTYazDuAWz7ycNF_W9yACCSwLW-KDe0_9APzfQHxidn4aw Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 0865f2a8503a42eab4d3ccc221f38c61 Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-VolumesNegativeTest-35807634 Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0865f2a8503a42eab4d3ccc221f38c61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0865f2a8503a42eab4d3ccc221f38c61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0865f2a8503a42eab4d3ccc221f38c61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0865f2a8503a42eab4d3ccc221f38c61"}]}] Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-VolumesNegativeTest-35807634 Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 0865f2a8503a42eab4d3ccc221f38c61 Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-VolumesNegativeTest-35807634 Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-VolumesNegativeTest-35807634-project Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: e385bcfd851e4529962b1803e6225253 Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-VolumesNegativeTest-35807634-project Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: method: Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: exception: Volume 0f54d0c9-4fbb-4353-9f88-fad2a72d6bbc could not be found. Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '0f54d0c9-4fbb-4353-9f88-fad2a72d6bbc'} Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0f54d0c9-4fbb-4353-9f88-fad2a72d6bbc could not be found. (HTTP 404) (Request-ID: req-63bce451-dc34-45d4-888a-f1da21a17f3d) Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 26 13:21:55.725795 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 13:21:55.729355 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 13:21:55.729355 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 26 13:21:55.729355 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 26 13:21:55.729355 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 26 13:21:55.729355 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 26 13:21:55.729355 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 26 13:21:55.729355 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 26 13:21:55.729355 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 26 13:21:55.729355 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 26 13:21:55.729355 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 13:21:55.729355 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 13:21:55.729355 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 13:21:55.729355 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 13:21:55.729355 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0f54d0c9-4fbb-4353-9f88-fad2a72d6bbc could not be found. Oct 26 13:21:55.729355 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:55.729355 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:21:55.729355 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:55.729355 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:55.729355 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:21:55.729355 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:21:55.729355 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:21:55.729355 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:21:55.729355 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:21:55.729355 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:21:55.729355 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:21:55.729355 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:21:55.729355 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 26 13:21:55.729355 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:21:55.729355 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0f54d0c9-4fbb-4353-9f88-fad2a72d6bbc could not be found. Oct 26 13:21:55.729355 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:55.729355 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:21:55.729355 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:55.729355 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:55.729355 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:21:55.729355 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:21:55.729355 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:21:55.729355 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:21:55.729355 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0f54d0c9-4fbb-4353-9f88-fad2a72d6bbc could not be found. Oct 26 13:21:55.729355 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:55.731629 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2314/4610] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:55 2022] GET /compute/v2.1/servers/f9df48e5-9204-46d5-b2a9-2154dbdcf167 => generated 1518 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:55.731708 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-46252f83-364b-4b56-833c-5e9398782036 tempest-VolumesNegativeTest-35807634 tempest-VolumesNegativeTest-35807634-project] Returning 404 to user: Volume 0f54d0c9-4fbb-4353-9f88-fad2a72d6bbc could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:21:55.731708 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-46252f83-364b-4b56-833c-5e9398782036 tempest-VolumesNegativeTest-35807634 tempest-VolumesNegativeTest-35807634-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/0f54d0c9-4fbb-4353-9f88-fad2a72d6bbc" status: 404 len: 109 microversion: 2.1 time: 0.048828 Oct 26 13:21:55.731708 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2297/4611] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Oct 26 13:21:55 2022] GET /compute/v2.1/os-volumes/0f54d0c9-4fbb-4353-9f88-fad2a72d6bbc => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 13:21:55.941800 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0c9ed0df-acd4-4851-8102-c659c7c34d79 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:55.942425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0c9ed0df-acd4-4851-8102-c659c7c34d79 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 8ec8dff5-3985-4f1c-9d2e-ddd28d538476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:55.951131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0c9ed0df-acd4-4851-8102-c659c7c34d79 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:55.951967 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0c9ed0df-acd4-4851-8102-c659c7c34d79 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:55.952836 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0c9ed0df-acd4-4851-8102-c659c7c34d79 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:55.958539 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0c9ed0df-acd4-4851-8102-c659c7c34d79 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:55.959436 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0c9ed0df-acd4-4851-8102-c659c7c34d79 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:55.959999 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0c9ed0df-acd4-4851-8102-c659c7c34d79 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:56.061501 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0c9ed0df-acd4-4851-8102-c659c7c34d79 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:56.078522 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0c9ed0df-acd4-4851-8102-c659c7c34d79 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:56.082131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0c9ed0df-acd4-4851-8102-c659c7c34d79 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:56.083504 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0c9ed0df-acd4-4851-8102-c659c7c34d79 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476" status: 200 len: 1363 microversion: 2.47 time: 0.147872 Oct 26 13:21:56.084223 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2315/4612] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:55 2022] GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:56.741964 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f36bc4ae-2d90-471b-84d1-521fccaf4e74 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:56.743313 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f36bc4ae-2d90-471b-84d1-521fccaf4e74 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: f9df48e5-9204-46d5-b2a9-2154dbdcf167] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:56.772632 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f36bc4ae-2d90-471b-84d1-521fccaf4e74 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:56.774530 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f36bc4ae-2d90-471b-84d1-521fccaf4e74 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:56.775090 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f36bc4ae-2d90-471b-84d1-521fccaf4e74 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:56.775907 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f36bc4ae-2d90-471b-84d1-521fccaf4e74 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:56.776601 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f36bc4ae-2d90-471b-84d1-521fccaf4e74 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:56.777260 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f36bc4ae-2d90-471b-84d1-521fccaf4e74 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:57.111978 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9f015b0b-035b-49d5-b9f2-9a9467336a6e tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:57.112611 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9f015b0b-035b-49d5-b9f2-9a9467336a6e tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 8ec8dff5-3985-4f1c-9d2e-ddd28d538476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:57.122955 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9f015b0b-035b-49d5-b9f2-9a9467336a6e tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:57.123844 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9f015b0b-035b-49d5-b9f2-9a9467336a6e tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:57.124390 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9f015b0b-035b-49d5-b9f2-9a9467336a6e tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:57.125213 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9f015b0b-035b-49d5-b9f2-9a9467336a6e tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:57.125755 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9f015b0b-035b-49d5-b9f2-9a9467336a6e tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:57.126237 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9f015b0b-035b-49d5-b9f2-9a9467336a6e tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:57.156765 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f36bc4ae-2d90-471b-84d1-521fccaf4e74 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:57.168433 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f36bc4ae-2d90-471b-84d1-521fccaf4e74 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/f9df48e5-9204-46d5-b2a9-2154dbdcf167" status: 200 len: 1518 microversion: 2.1 time: 0.431748 Oct 26 13:21:57.189405 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2298/4613] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:56 2022] GET /compute/v2.1/servers/f9df48e5-9204-46d5-b2a9-2154dbdcf167 => generated 1518 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:57.275767 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9f015b0b-035b-49d5-b9f2-9a9467336a6e tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:57.290481 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9f015b0b-035b-49d5-b9f2-9a9467336a6e tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:57.295552 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9f015b0b-035b-49d5-b9f2-9a9467336a6e tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:57.300991 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9f015b0b-035b-49d5-b9f2-9a9467336a6e tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476" status: 200 len: 1363 microversion: 2.47 time: 0.192355 Oct 26 13:21:57.303751 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2316/4614] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:57 2022] GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476 => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:21:58.195824 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0ec847e4-bed0-4737-92cb-f7847d419994 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:58.196996 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0ec847e4-bed0-4737-92cb-f7847d419994 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: f9df48e5-9204-46d5-b2a9-2154dbdcf167] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:58.213143 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ec847e4-bed0-4737-92cb-f7847d419994 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:58.214084 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ec847e4-bed0-4737-92cb-f7847d419994 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:58.215002 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ec847e4-bed0-4737-92cb-f7847d419994 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:58.216064 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ec847e4-bed0-4737-92cb-f7847d419994 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:58.216725 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ec847e4-bed0-4737-92cb-f7847d419994 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:58.217326 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ec847e4-bed0-4737-92cb-f7847d419994 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:58.333807 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ffce7ae8-3255-4c8a-b615-fb37ef29e104 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:58.334435 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ffce7ae8-3255-4c8a-b615-fb37ef29e104 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 8ec8dff5-3985-4f1c-9d2e-ddd28d538476] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:58.353357 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ffce7ae8-3255-4c8a-b615-fb37ef29e104 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:58.355442 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ffce7ae8-3255-4c8a-b615-fb37ef29e104 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:58.358063 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ffce7ae8-3255-4c8a-b615-fb37ef29e104 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:58.358863 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ffce7ae8-3255-4c8a-b615-fb37ef29e104 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:58.359343 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ffce7ae8-3255-4c8a-b615-fb37ef29e104 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:58.363538 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ffce7ae8-3255-4c8a-b615-fb37ef29e104 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:58.370237 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=10 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:21:58.442227 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ffce7ae8-3255-4c8a-b615-fb37ef29e104 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:58.445536 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ffce7ae8-3255-4c8a-b615-fb37ef29e104 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:58.449696 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ffce7ae8-3255-4c8a-b615-fb37ef29e104 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:58.451374 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-ffce7ae8-3255-4c8a-b615-fb37ef29e104 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lazy-loading 'fault' on Instance uuid 8ec8dff5-3985-4f1c-9d2e-ddd28d538476 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:21:58.553449 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ffce7ae8-3255-4c8a-b615-fb37ef29e104 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:58.570212 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ffce7ae8-3255-4c8a-b615-fb37ef29e104 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:58.575015 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ffce7ae8-3255-4c8a-b615-fb37ef29e104 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:58.580508 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ffce7ae8-3255-4c8a-b615-fb37ef29e104 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476" status: 200 len: 1368 microversion: 2.47 time: 0.252095 Oct 26 13:21:58.581103 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2317/4615] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:58 2022] GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476 => generated 1368 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:21:58.737050 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0ec847e4-bed0-4737-92cb-f7847d419994 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:21:58.753704 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0ec847e4-bed0-4737-92cb-f7847d419994 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/f9df48e5-9204-46d5-b2a9-2154dbdcf167" status: 200 len: 1518 microversion: 2.1 time: 0.562031 Oct 26 13:21:58.757242 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2299/4616] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:58 2022] GET /compute/v2.1/servers/f9df48e5-9204-46d5-b2a9-2154dbdcf167 => generated 1518 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:21:59.037084 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-60eacf69-0236-49c7-bf87-27350b0abf8e req-ab0aeaee-92f0-45be-b307-ea47b417dc47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9df48e5-9204-46d5-b2a9-2154dbdcf167", "name": "network-vif-deleted", "tag": "0d3accda-92e7-4a3b-a42e-1cd62bc1324a"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:21:59.076683 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-60eacf69-0236-49c7-bf87-27350b0abf8e req-ab0aeaee-92f0-45be-b307-ea47b417dc47 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:59.080015 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-60eacf69-0236-49c7-bf87-27350b0abf8e req-ab0aeaee-92f0-45be-b307-ea47b417dc47 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:59.084632 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-60eacf69-0236-49c7-bf87-27350b0abf8e req-ab0aeaee-92f0-45be-b307-ea47b417dc47 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:59.124027 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-60eacf69-0236-49c7-bf87-27350b0abf8e req-ab0aeaee-92f0-45be-b307-ea47b417dc47 service nova] Creating event network-vif-deleted:0d3accda-92e7-4a3b-a42e-1cd62bc1324a for instance f9df48e5-9204-46d5-b2a9-2154dbdcf167 on n-h1-862686-1 Oct 26 13:21:59.139785 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-60eacf69-0236-49c7-bf87-27350b0abf8e req-ab0aeaee-92f0-45be-b307-ea47b417dc47 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118726 Oct 26 13:21:59.140477 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2318/4617] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:21:59.611736 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-52afc13a-75b4-4134-8554-c4f71ab1f4a1 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:59.612357 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-52afc13a-75b4-4134-8554-c4f71ab1f4a1 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 8ec8dff5-3985-4f1c-9d2e-ddd28d538476] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:59.634317 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52afc13a-75b4-4134-8554-c4f71ab1f4a1 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:59.634830 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52afc13a-75b4-4134-8554-c4f71ab1f4a1 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:59.635281 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52afc13a-75b4-4134-8554-c4f71ab1f4a1 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:59.636011 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52afc13a-75b4-4134-8554-c4f71ab1f4a1 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:59.636476 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52afc13a-75b4-4134-8554-c4f71ab1f4a1 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:59.636911 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52afc13a-75b4-4134-8554-c4f71ab1f4a1 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:59.692713 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-52afc13a-75b4-4134-8554-c4f71ab1f4a1 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] HTTP exception thrown: Instance 8ec8dff5-3985-4f1c-9d2e-ddd28d538476 could not be found. Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-52afc13a-75b4-4134-8554-c4f71ab1f4a1 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Request method failure captured: Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476 HTTP/1.1 Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTQ_1Ki3B55QogJcvCGj6PVQxS1bgY9JvRhrJX2ZnqOj_QNIz5eHQ8aBzwLdnocXYMp_Z_3ipRr0mcWBN99ffZeTxX4OBGEEErXm8ql25YGlLlIHTgxyNW_hyJgvZIdrnL_w5mmhy7TgN0jhNLQO7RQooOkQP0NmVVXWma1Cd0CoGiY Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: X-Openstack-Nova-Api-Version: 2.47 Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 9a378a658347414fbea6f4c90e31cc16 Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServerShowV247Test-1150871184 Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9a378a658347414fbea6f4c90e31cc16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9a378a658347414fbea6f4c90e31cc16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9a378a658347414fbea6f4c90e31cc16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9a378a658347414fbea6f4c90e31cc16"}]}] Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServerShowV247Test-1150871184 Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 9a378a658347414fbea6f4c90e31cc16 Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServerShowV247Test-1150871184 Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServerShowV247Test-1150871184-project Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 73a9c409bb7448af896f57aaa7a7eed4 Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServerShowV247Test-1150871184-project Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 8ec8dff5-3985-4f1c-9d2e-ddd28d538476 could not be found. Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '8ec8dff5-3985-4f1c-9d2e-ddd28d538476'} Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ec8dff5-3985-4f1c-9d2e-ddd28d538476 could not be found. Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ec8dff5-3985-4f1c-9d2e-ddd28d538476 could not be found. Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:21:59.698152 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:59.703286 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:21:59.703286 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:21:59.703286 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:21:59.703286 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:21:59.703286 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:21:59.703286 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ec8dff5-3985-4f1c-9d2e-ddd28d538476 could not be found. Oct 26 13:21:59.703286 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:21:59.703286 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-52afc13a-75b4-4134-8554-c4f71ab1f4a1 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Returning 404 to user: Instance 8ec8dff5-3985-4f1c-9d2e-ddd28d538476 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:21:59.703286 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-52afc13a-75b4-4134-8554-c4f71ab1f4a1 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476" status: 404 len: 111 microversion: 2.47 time: 0.094082 Oct 26 13:21:59.703859 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2300/4618] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:21:59 2022] GET /compute/v2.1/servers/8ec8dff5-3985-4f1c-9d2e-ddd28d538476 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:21:59.712578 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b1444a23-471e-478e-82fe-04522061abf0 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:59.713697 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b1444a23-471e-478e-82fe-04522061abf0 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 999489d9-f069-461b-b5ad-6134e156ccc9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:59.735510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1444a23-471e-478e-82fe-04522061abf0 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:59.735510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1444a23-471e-478e-82fe-04522061abf0 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:59.735510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1444a23-471e-478e-82fe-04522061abf0 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:59.735510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1444a23-471e-478e-82fe-04522061abf0 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:59.736509 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1444a23-471e-478e-82fe-04522061abf0 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:59.737377 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1444a23-471e-478e-82fe-04522061abf0 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:59.762965 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:21:59.781683 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ed7328bc-fe57-4837-8c02-e88cd177bb03 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:21:59.787275 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ed7328bc-fe57-4837-8c02-e88cd177bb03 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: f9df48e5-9204-46d5-b2a9-2154dbdcf167] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:21:59.803739 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed7328bc-fe57-4837-8c02-e88cd177bb03 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:59.806067 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed7328bc-fe57-4837-8c02-e88cd177bb03 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:59.807092 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed7328bc-fe57-4837-8c02-e88cd177bb03 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:59.810442 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed7328bc-fe57-4837-8c02-e88cd177bb03 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:59.814596 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed7328bc-fe57-4837-8c02-e88cd177bb03 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:59.816836 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed7328bc-fe57-4837-8c02-e88cd177bb03 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:59.832213 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b1444a23-471e-478e-82fe-04522061abf0 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 999489d9-f069-461b-b5ad-6134e156ccc9] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:21:59.916285 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed7328bc-fe57-4837-8c02-e88cd177bb03 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:21:59.916777 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed7328bc-fe57-4837-8c02-e88cd177bb03 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:21:59.917219 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed7328bc-fe57-4837-8c02-e88cd177bb03 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:21:59.921847 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-ed7328bc-fe57-4837-8c02-e88cd177bb03 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lazy-loading 'fault' on Instance uuid f9df48e5-9204-46d5-b2a9-2154dbdcf167 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:22:00.052824 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ed7328bc-fe57-4837-8c02-e88cd177bb03 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:22:00.063251 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ed7328bc-fe57-4837-8c02-e88cd177bb03 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/f9df48e5-9204-46d5-b2a9-2154dbdcf167" status: 200 len: 1310 microversion: 2.1 time: 0.286610 Oct 26 13:22:00.067321 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2301/4619] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:21:59 2022] GET /compute/v2.1/servers/f9df48e5-9204-46d5-b2a9-2154dbdcf167 => generated 1310 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:22:00.129371 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b1444a23-471e-478e-82fe-04522061abf0 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "DELETE /compute/v2.1/servers/999489d9-f069-461b-b5ad-6134e156ccc9" status: 204 len: 0 microversion: 2.47 time: 0.420250 Oct 26 13:22:00.132722 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2319/4620] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 26 13:21:59 2022] DELETE /compute/v2.1/servers/999489d9-f069-461b-b5ad-6134e156ccc9 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 13:22:00.142532 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7c58de77-205a-41a3-b924-8e19a59e8b26 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:00.145245 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7c58de77-205a-41a3-b924-8e19a59e8b26 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 999489d9-f069-461b-b5ad-6134e156ccc9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:22:00.163144 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7c58de77-205a-41a3-b924-8e19a59e8b26 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:00.164398 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7c58de77-205a-41a3-b924-8e19a59e8b26 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:00.165182 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7c58de77-205a-41a3-b924-8e19a59e8b26 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:00.166518 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7c58de77-205a-41a3-b924-8e19a59e8b26 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:00.167153 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7c58de77-205a-41a3-b924-8e19a59e8b26 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:00.167786 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7c58de77-205a-41a3-b924-8e19a59e8b26 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:00.333240 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7c58de77-205a-41a3-b924-8e19a59e8b26 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:22:00.358321 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7c58de77-205a-41a3-b924-8e19a59e8b26 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:22:00.360700 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7c58de77-205a-41a3-b924-8e19a59e8b26 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:22:00.362117 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7c58de77-205a-41a3-b924-8e19a59e8b26 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "GET /compute/v2.1/servers/999489d9-f069-461b-b5ad-6134e156ccc9" status: 200 len: 1363 microversion: 2.47 time: 0.226373 Oct 26 13:22:00.362892 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2320/4621] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:22:00 2022] GET /compute/v2.1/servers/999489d9-f069-461b-b5ad-6134e156ccc9 => generated 1363 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:22:00.563546 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4588d507-28bf-4cf6-abab-9771a26cfbb6 tempest-ServicesAdminTestJSON-773241976 tempest-ServicesAdminTestJSON-773241976-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:00.567255 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4588d507-28bf-4cf6-abab-9771a26cfbb6 tempest-ServicesAdminTestJSON-773241976 tempest-ServicesAdminTestJSON-773241976-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:00.567944 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4588d507-28bf-4cf6-abab-9771a26cfbb6 tempest-ServicesAdminTestJSON-773241976 tempest-ServicesAdminTestJSON-773241976-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:00.568542 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4588d507-28bf-4cf6-abab-9771a26cfbb6 tempest-ServicesAdminTestJSON-773241976 tempest-ServicesAdminTestJSON-773241976-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:00.569431 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4588d507-28bf-4cf6-abab-9771a26cfbb6 tempest-ServicesAdminTestJSON-773241976 tempest-ServicesAdminTestJSON-773241976-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:00.570063 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4588d507-28bf-4cf6-abab-9771a26cfbb6 tempest-ServicesAdminTestJSON-773241976 tempest-ServicesAdminTestJSON-773241976-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:00.570665 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4588d507-28bf-4cf6-abab-9771a26cfbb6 tempest-ServicesAdminTestJSON-773241976 tempest-ServicesAdminTestJSON-773241976-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:00.598611 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4588d507-28bf-4cf6-abab-9771a26cfbb6 tempest-ServicesAdminTestJSON-773241976 tempest-ServicesAdminTestJSON-773241976-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.528270 Oct 26 13:22:00.599783 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2302/4622] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 26 13:22:00 2022] GET /compute/v2.1/os-services => generated 944 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:22:00.618571 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9597c1f6-c0f6-4e68-b0ce-e7ed18c2fc58 tempest-ServicesAdminTestJSON-773241976 tempest-ServicesAdminTestJSON-773241976-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:00.626607 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9597c1f6-c0f6-4e68-b0ce-e7ed18c2fc58 tempest-ServicesAdminTestJSON-773241976 tempest-ServicesAdminTestJSON-773241976-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:00.631139 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9597c1f6-c0f6-4e68-b0ce-e7ed18c2fc58 tempest-ServicesAdminTestJSON-773241976 tempest-ServicesAdminTestJSON-773241976-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:00.633628 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9597c1f6-c0f6-4e68-b0ce-e7ed18c2fc58 tempest-ServicesAdminTestJSON-773241976 tempest-ServicesAdminTestJSON-773241976-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:00.637014 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9597c1f6-c0f6-4e68-b0ce-e7ed18c2fc58 tempest-ServicesAdminTestJSON-773241976 tempest-ServicesAdminTestJSON-773241976-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:00.637756 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9597c1f6-c0f6-4e68-b0ce-e7ed18c2fc58 tempest-ServicesAdminTestJSON-773241976 tempest-ServicesAdminTestJSON-773241976-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:00.639007 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9597c1f6-c0f6-4e68-b0ce-e7ed18c2fc58 tempest-ServicesAdminTestJSON-773241976 tempest-ServicesAdminTestJSON-773241976-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:00.680817 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9597c1f6-c0f6-4e68-b0ce-e7ed18c2fc58 tempest-ServicesAdminTestJSON-773241976 tempest-ServicesAdminTestJSON-773241976-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?host=n-d-862686-1" status: 200 len: 578 microversion: 2.1 time: 0.072067 Oct 26 13:22:00.682060 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2321/4623] 10.222.0.40 () {58 vars in 1172 bytes} [Wed Oct 26 13:22:00 2022] GET /compute/v2.1/os-services?host=n-d-862686-1 => generated 578 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:22:00.696132 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3e7d79b1-03f8-4e60-bc94-6df15720ad41 tempest-ServicesAdminTestJSON-773241976 tempest-ServicesAdminTestJSON-773241976-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:00.700071 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3e7d79b1-03f8-4e60-bc94-6df15720ad41 tempest-ServicesAdminTestJSON-773241976 tempest-ServicesAdminTestJSON-773241976-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:00.700881 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3e7d79b1-03f8-4e60-bc94-6df15720ad41 tempest-ServicesAdminTestJSON-773241976 tempest-ServicesAdminTestJSON-773241976-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:00.701450 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3e7d79b1-03f8-4e60-bc94-6df15720ad41 tempest-ServicesAdminTestJSON-773241976 tempest-ServicesAdminTestJSON-773241976-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:00.702447 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3e7d79b1-03f8-4e60-bc94-6df15720ad41 tempest-ServicesAdminTestJSON-773241976 tempest-ServicesAdminTestJSON-773241976-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:00.703154 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3e7d79b1-03f8-4e60-bc94-6df15720ad41 tempest-ServicesAdminTestJSON-773241976 tempest-ServicesAdminTestJSON-773241976-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:00.703824 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3e7d79b1-03f8-4e60-bc94-6df15720ad41 tempest-ServicesAdminTestJSON-773241976 tempest-ServicesAdminTestJSON-773241976-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:00.735733 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3e7d79b1-03f8-4e60-bc94-6df15720ad41 tempest-ServicesAdminTestJSON-773241976 tempest-ServicesAdminTestJSON-773241976-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.043764 Oct 26 13:22:00.746011 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2303/4624] 10.222.0.40 () {58 vars in 1176 bytes} [Wed Oct 26 13:22:00 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:22:00.750813 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-699105a7-14ff-4594-b83d-3e38ab09b741 tempest-ServicesAdminTestJSON-773241976 tempest-ServicesAdminTestJSON-773241976-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:00.755571 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-699105a7-14ff-4594-b83d-3e38ab09b741 tempest-ServicesAdminTestJSON-773241976 tempest-ServicesAdminTestJSON-773241976-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:00.756353 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-699105a7-14ff-4594-b83d-3e38ab09b741 tempest-ServicesAdminTestJSON-773241976 tempest-ServicesAdminTestJSON-773241976-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:00.756987 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-699105a7-14ff-4594-b83d-3e38ab09b741 tempest-ServicesAdminTestJSON-773241976 tempest-ServicesAdminTestJSON-773241976-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:00.757999 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-699105a7-14ff-4594-b83d-3e38ab09b741 tempest-ServicesAdminTestJSON-773241976 tempest-ServicesAdminTestJSON-773241976-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:00.758668 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-699105a7-14ff-4594-b83d-3e38ab09b741 tempest-ServicesAdminTestJSON-773241976 tempest-ServicesAdminTestJSON-773241976-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:00.759162 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-699105a7-14ff-4594-b83d-3e38ab09b741 tempest-ServicesAdminTestJSON-773241976 tempest-ServicesAdminTestJSON-773241976-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:00.796885 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-699105a7-14ff-4594-b83d-3e38ab09b741 tempest-ServicesAdminTestJSON-773241976 tempest-ServicesAdminTestJSON-773241976-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.049268 Oct 26 13:22:00.798255 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2322/4625] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 26 13:22:00 2022] GET /compute/v2.1/os-services => generated 944 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:22:01.046174 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b0d4caf3-db6a-4b67-9f5b-0fffcd1f8c24 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:01.046819 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b0d4caf3-db6a-4b67-9f5b-0fffcd1f8c24 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:22:01.053897 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b0d4caf3-db6a-4b67-9f5b-0fffcd1f8c24 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:01.054609 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b0d4caf3-db6a-4b67-9f5b-0fffcd1f8c24 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:01.055156 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b0d4caf3-db6a-4b67-9f5b-0fffcd1f8c24 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:01.056100 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b0d4caf3-db6a-4b67-9f5b-0fffcd1f8c24 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:01.056654 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b0d4caf3-db6a-4b67-9f5b-0fffcd1f8c24 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:01.057164 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b0d4caf3-db6a-4b67-9f5b-0fffcd1f8c24 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:01.074028 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-b0d4caf3-db6a-4b67-9f5b-0fffcd1f8c24 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] HTTP exception thrown: Instance 893420b7-27d9-4240-8182-87dd3231cbe2 could not be found. Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b0d4caf3-db6a-4b67-9f5b-0fffcd1f8c24 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Request method failure captured: Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 HTTP/1.1 Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTLwMRqFXjEm1YtGKBMtzqfrqKcHzQ3yG0uplU3MaGAYmHHNuk8MQkq0wNL5a4sMxMtgmRzZABVZ45JDUMkNkPujXrfOIEqxyEGkEaR5cF47X4u9L7H2fOBwByG_wlEl2e_yDZi-D6fTcdFCB24Qtb-V8VqE7vs3fYQnyc9z72oyrVc Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: X-Openstack-Nova-Api-Version: 2.32 Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 8020c4d2858a4c6cbd194758e958dad0 Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-TaggedBootDevicesTest-215566972 Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8020c4d2858a4c6cbd194758e958dad0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8020c4d2858a4c6cbd194758e958dad0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8020c4d2858a4c6cbd194758e958dad0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8020c4d2858a4c6cbd194758e958dad0"}]}] Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-TaggedBootDevicesTest-215566972 Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 8020c4d2858a4c6cbd194758e958dad0 Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-TaggedBootDevicesTest-215566972 Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-TaggedBootDevicesTest-215566972-project Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 6097043a9a7d455bb4a8e2146a14dbdd Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-TaggedBootDevicesTest-215566972-project Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 893420b7-27d9-4240-8182-87dd3231cbe2 could not be found. Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '893420b7-27d9-4240-8182-87dd3231cbe2'} Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 893420b7-27d9-4240-8182-87dd3231cbe2 could not be found. Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:22:01.076262 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:22:01.081005 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 893420b7-27d9-4240-8182-87dd3231cbe2 could not be found. Oct 26 13:22:01.081005 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:22:01.081005 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:22:01.081005 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:22:01.081005 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:22:01.081005 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:22:01.081005 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:22:01.081005 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:22:01.081005 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:22:01.081005 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 893420b7-27d9-4240-8182-87dd3231cbe2 could not be found. Oct 26 13:22:01.081005 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:22:01.084599 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b0d4caf3-db6a-4b67-9f5b-0fffcd1f8c24 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Returning 404 to user: Instance 893420b7-27d9-4240-8182-87dd3231cbe2 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:22:01.085961 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b0d4caf3-db6a-4b67-9f5b-0fffcd1f8c24 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "DELETE /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 404 len: 111 microversion: 2.32 time: 0.044984 Oct 26 13:22:01.089426 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2304/4626] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 26 13:22:01 2022] DELETE /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:22:01.095140 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-374b92d5-46db-4da8-ae6e-2e5dce670ce8 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:01.095813 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-374b92d5-46db-4da8-ae6e-2e5dce670ce8 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] [instance: 893420b7-27d9-4240-8182-87dd3231cbe2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:22:01.106931 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-374b92d5-46db-4da8-ae6e-2e5dce670ce8 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:01.107444 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-374b92d5-46db-4da8-ae6e-2e5dce670ce8 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:01.107878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-374b92d5-46db-4da8-ae6e-2e5dce670ce8 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:01.109582 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4a882343-4911-4f22-8965-2f73f949251e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:01.110211 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4a882343-4911-4f22-8965-2f73f949251e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: f9df48e5-9204-46d5-b2a9-2154dbdcf167] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:22:01.111161 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-374b92d5-46db-4da8-ae6e-2e5dce670ce8 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:01.111629 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-374b92d5-46db-4da8-ae6e-2e5dce670ce8 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:01.112061 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-374b92d5-46db-4da8-ae6e-2e5dce670ce8 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:01.124691 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4a882343-4911-4f22-8965-2f73f949251e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:01.125193 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4a882343-4911-4f22-8965-2f73f949251e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:01.125674 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4a882343-4911-4f22-8965-2f73f949251e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:01.126385 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4a882343-4911-4f22-8965-2f73f949251e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:01.126844 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4a882343-4911-4f22-8965-2f73f949251e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:01.127283 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4a882343-4911-4f22-8965-2f73f949251e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:01.139341 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-374b92d5-46db-4da8-ae6e-2e5dce670ce8 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] HTTP exception thrown: Instance 893420b7-27d9-4240-8182-87dd3231cbe2 could not be found. Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-374b92d5-46db-4da8-ae6e-2e5dce670ce8 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Request method failure captured: Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 HTTP/1.1 Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTLwMRqFXjEm1YtGKBMtzqfrqKcHzQ3yG0uplU3MaGAYmHHNuk8MQkq0wNL5a4sMxMtgmRzZABVZ45JDUMkNkPujXrfOIEqxyEGkEaR5cF47X4u9L7H2fOBwByG_wlEl2e_yDZi-D6fTcdFCB24Qtb-V8VqE7vs3fYQnyc9z72oyrVc Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: X-Openstack-Nova-Api-Version: 2.32 Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 8020c4d2858a4c6cbd194758e958dad0 Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-TaggedBootDevicesTest-215566972 Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8020c4d2858a4c6cbd194758e958dad0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8020c4d2858a4c6cbd194758e958dad0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8020c4d2858a4c6cbd194758e958dad0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8020c4d2858a4c6cbd194758e958dad0"}]}] Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-TaggedBootDevicesTest-215566972 Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 8020c4d2858a4c6cbd194758e958dad0 Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-TaggedBootDevicesTest-215566972 Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-TaggedBootDevicesTest-215566972-project Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 6097043a9a7d455bb4a8e2146a14dbdd Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-TaggedBootDevicesTest-215566972-project Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 893420b7-27d9-4240-8182-87dd3231cbe2 could not be found. Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '893420b7-27d9-4240-8182-87dd3231cbe2'} Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 893420b7-27d9-4240-8182-87dd3231cbe2 could not be found. Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 893420b7-27d9-4240-8182-87dd3231cbe2 could not be found. Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:22:01.141422 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:22:01.147359 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:22:01.147359 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:22:01.147359 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:22:01.147359 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:22:01.147359 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:22:01.147359 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 893420b7-27d9-4240-8182-87dd3231cbe2 could not be found. Oct 26 13:22:01.147359 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:22:01.147359 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-374b92d5-46db-4da8-ae6e-2e5dce670ce8 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] Returning 404 to user: Instance 893420b7-27d9-4240-8182-87dd3231cbe2 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:22:01.147359 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-374b92d5-46db-4da8-ae6e-2e5dce670ce8 tempest-TaggedBootDevicesTest-215566972 tempest-TaggedBootDevicesTest-215566972-project] 10.222.0.40 "GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2" status: 404 len: 111 microversion: 2.32 time: 0.052194 Oct 26 13:22:01.147359 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2323/4627] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:22:01 2022] GET /compute/v2.1/servers/893420b7-27d9-4240-8182-87dd3231cbe2 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:22:01.159127 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-4a882343-4911-4f22-8965-2f73f949251e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] HTTP exception thrown: Instance f9df48e5-9204-46d5-b2a9-2154dbdcf167 could not be found. Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4a882343-4911-4f22-8965-2f73f949251e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Request method failure captured: Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/f9df48e5-9204-46d5-b2a9-2154dbdcf167 HTTP/1.1 Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTQyUkWTEWbYQoZmHr_U7kplZYqWQRwOJeuTv_tcfOPje80gEX4g9SVM0rLpflAgmkrOW6WrhGn6RQP55tW8153E1Un1Teh9P0Q2AJ-dpt59wT2GHnk8oJ9kiu11mv1lGBdweD53tXyqi8VnxXv7nv8NQPtSSzfqC_lVNtgpBHuTE40 Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: cf8d947764e045dfafa0a18ec2472e7b Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ListServerFiltersTestJSON-563653154 Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cf8d947764e045dfafa0a18ec2472e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cf8d947764e045dfafa0a18ec2472e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cf8d947764e045dfafa0a18ec2472e7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cf8d947764e045dfafa0a18ec2472e7b"}]}] Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ListServerFiltersTestJSON-563653154 Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: cf8d947764e045dfafa0a18ec2472e7b Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-563653154 Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ListServerFiltersTestJSON-563653154-project Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 8b9017d8481844cd9266b86736982c92 Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ListServerFiltersTestJSON-563653154-project Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance f9df48e5-9204-46d5-b2a9-2154dbdcf167 could not be found. Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'f9df48e5-9204-46d5-b2a9-2154dbdcf167'} Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9df48e5-9204-46d5-b2a9-2154dbdcf167 could not be found. Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9df48e5-9204-46d5-b2a9-2154dbdcf167 could not be found. Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:22:01.161187 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:22:01.165411 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:22:01.165411 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:22:01.165411 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:22:01.165411 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:22:01.165411 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:22:01.165411 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9df48e5-9204-46d5-b2a9-2154dbdcf167 could not be found. Oct 26 13:22:01.165411 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:22:01.165411 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4a882343-4911-4f22-8965-2f73f949251e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Returning 404 to user: Instance f9df48e5-9204-46d5-b2a9-2154dbdcf167 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:22:01.165411 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4a882343-4911-4f22-8965-2f73f949251e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/f9df48e5-9204-46d5-b2a9-2154dbdcf167" status: 404 len: 111 microversion: 2.1 time: 0.063402 Oct 26 13:22:01.165411 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2305/4628] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:22:01 2022] GET /compute/v2.1/servers/f9df48e5-9204-46d5-b2a9-2154dbdcf167 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:22:01.178048 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a5041fdf-a8ab-4973-882e-68baefd6887e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:01.178645 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a5041fdf-a8ab-4973-882e-68baefd6887e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: d7cd631a-a439-481d-ab67-f5a0c9d0ef86] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:22:01.185904 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5041fdf-a8ab-4973-882e-68baefd6887e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:01.186505 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5041fdf-a8ab-4973-882e-68baefd6887e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:01.187182 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5041fdf-a8ab-4973-882e-68baefd6887e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:01.187971 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5041fdf-a8ab-4973-882e-68baefd6887e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:01.188505 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5041fdf-a8ab-4973-882e-68baefd6887e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:01.189014 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5041fdf-a8ab-4973-882e-68baefd6887e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:01.220359 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a5041fdf-a8ab-4973-882e-68baefd6887e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: d7cd631a-a439-481d-ab67-f5a0c9d0ef86] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:22:01.341138 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a5041fdf-a8ab-4973-882e-68baefd6887e tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d7cd631a-a439-481d-ab67-f5a0c9d0ef86" status: 204 len: 0 microversion: 2.1 time: 0.169396 Oct 26 13:22:01.342662 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2324/4629] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:22:01 2022] DELETE /compute/v2.1/servers/d7cd631a-a439-481d-ab67-f5a0c9d0ef86 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:22:01.351706 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fec97e8b-0ea3-4e9f-ae78-5cdf2ecbb9fe tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:01.352332 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fec97e8b-0ea3-4e9f-ae78-5cdf2ecbb9fe tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: d7cd631a-a439-481d-ab67-f5a0c9d0ef86] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:22:01.359331 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fec97e8b-0ea3-4e9f-ae78-5cdf2ecbb9fe tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:01.360871 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fec97e8b-0ea3-4e9f-ae78-5cdf2ecbb9fe tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:01.361584 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fec97e8b-0ea3-4e9f-ae78-5cdf2ecbb9fe tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:01.364108 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fec97e8b-0ea3-4e9f-ae78-5cdf2ecbb9fe tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:01.365251 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fec97e8b-0ea3-4e9f-ae78-5cdf2ecbb9fe tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:01.366247 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fec97e8b-0ea3-4e9f-ae78-5cdf2ecbb9fe tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:01.396585 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fccbc1ad-c36b-4c29-9d04-e4d33f352789 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:01.397291 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fccbc1ad-c36b-4c29-9d04-e4d33f352789 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 999489d9-f069-461b-b5ad-6134e156ccc9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:22:01.405079 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fccbc1ad-c36b-4c29-9d04-e4d33f352789 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:01.405628 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fccbc1ad-c36b-4c29-9d04-e4d33f352789 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:01.407176 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fccbc1ad-c36b-4c29-9d04-e4d33f352789 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:01.408063 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fccbc1ad-c36b-4c29-9d04-e4d33f352789 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:01.408911 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fccbc1ad-c36b-4c29-9d04-e4d33f352789 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:01.409462 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fccbc1ad-c36b-4c29-9d04-e4d33f352789 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:01.501009 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fccbc1ad-c36b-4c29-9d04-e4d33f352789 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:22:01.512242 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fccbc1ad-c36b-4c29-9d04-e4d33f352789 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:22:01.514487 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fccbc1ad-c36b-4c29-9d04-e4d33f352789 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:22:01.516120 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fccbc1ad-c36b-4c29-9d04-e4d33f352789 tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "GET /compute/v2.1/servers/999489d9-f069-461b-b5ad-6134e156ccc9" status: 200 len: 1363 microversion: 2.47 time: 0.124279 Oct 26 13:22:01.530274 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2325/4630] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:22:01 2022] GET /compute/v2.1/servers/999489d9-f069-461b-b5ad-6134e156ccc9 => generated 1363 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:22:01.562084 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fec97e8b-0ea3-4e9f-ae78-5cdf2ecbb9fe tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:22:01.571382 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fec97e8b-0ea3-4e9f-ae78-5cdf2ecbb9fe tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/d7cd631a-a439-481d-ab67-f5a0c9d0ef86" status: 200 len: 1516 microversion: 2.1 time: 0.223915 Oct 26 13:22:01.582306 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2306/4631] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:22:01 2022] GET /compute/v2.1/servers/d7cd631a-a439-481d-ab67-f5a0c9d0ef86 => generated 1516 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:22:02.546564 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-25346e5e-0958-4079-93a6-5e2d4d764b5b tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:02.547274 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-25346e5e-0958-4079-93a6-5e2d4d764b5b tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 999489d9-f069-461b-b5ad-6134e156ccc9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:22:02.554131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=5,nova_api:DELETE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:22:02.560058 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25346e5e-0958-4079-93a6-5e2d4d764b5b tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:02.560960 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25346e5e-0958-4079-93a6-5e2d4d764b5b tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:02.561470 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25346e5e-0958-4079-93a6-5e2d4d764b5b tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:02.562529 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25346e5e-0958-4079-93a6-5e2d4d764b5b tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:02.563181 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25346e5e-0958-4079-93a6-5e2d4d764b5b tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:02.563860 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25346e5e-0958-4079-93a6-5e2d4d764b5b tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:02.599282 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-407235eb-8d47-47ff-80e4-f005a0ee180d tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:02.601573 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-407235eb-8d47-47ff-80e4-f005a0ee180d tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: d7cd631a-a439-481d-ab67-f5a0c9d0ef86] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:22:02.614333 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-407235eb-8d47-47ff-80e4-f005a0ee180d tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:02.615172 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-407235eb-8d47-47ff-80e4-f005a0ee180d tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:02.615781 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-407235eb-8d47-47ff-80e4-f005a0ee180d tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:02.617104 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-407235eb-8d47-47ff-80e4-f005a0ee180d tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:02.617766 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-407235eb-8d47-47ff-80e4-f005a0ee180d tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:02.618455 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-407235eb-8d47-47ff-80e4-f005a0ee180d tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:02.685944 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-25346e5e-0958-4079-93a6-5e2d4d764b5b tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:22:02.702701 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-25346e5e-0958-4079-93a6-5e2d4d764b5b tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:22:02.706452 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-25346e5e-0958-4079-93a6-5e2d4d764b5b tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:22:02.711867 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-25346e5e-0958-4079-93a6-5e2d4d764b5b tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "GET /compute/v2.1/servers/999489d9-f069-461b-b5ad-6134e156ccc9" status: 200 len: 1363 microversion: 2.47 time: 0.169156 Oct 26 13:22:02.712781 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2326/4632] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:22:02 2022] GET /compute/v2.1/servers/999489d9-f069-461b-b5ad-6134e156ccc9 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:22:02.973091 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-407235eb-8d47-47ff-80e4-f005a0ee180d tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:22:02.985451 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-407235eb-8d47-47ff-80e4-f005a0ee180d tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/d7cd631a-a439-481d-ab67-f5a0c9d0ef86" status: 200 len: 1516 microversion: 2.1 time: 0.391050 Oct 26 13:22:03.004923 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2307/4633] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:22:02 2022] GET /compute/v2.1/servers/d7cd631a-a439-481d-ab67-f5a0c9d0ef86 => generated 1516 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:22:03.739560 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-936fb850-8243-444f-a20f-f2aaa9df735e tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:03.740996 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-936fb850-8243-444f-a20f-f2aaa9df735e tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 999489d9-f069-461b-b5ad-6134e156ccc9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:22:03.762938 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-936fb850-8243-444f-a20f-f2aaa9df735e tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:03.763479 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-936fb850-8243-444f-a20f-f2aaa9df735e tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:03.763959 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-936fb850-8243-444f-a20f-f2aaa9df735e tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:03.769762 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-936fb850-8243-444f-a20f-f2aaa9df735e tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:03.770276 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-936fb850-8243-444f-a20f-f2aaa9df735e tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:03.770748 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-936fb850-8243-444f-a20f-f2aaa9df735e tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:03.851761 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-936fb850-8243-444f-a20f-f2aaa9df735e tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:03.852130 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-936fb850-8243-444f-a20f-f2aaa9df735e tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:03.852554 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-936fb850-8243-444f-a20f-f2aaa9df735e tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:03.853818 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-936fb850-8243-444f-a20f-f2aaa9df735e tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lazy-loading 'fault' on Instance uuid 999489d9-f069-461b-b5ad-6134e156ccc9 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:22:03.963672 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-936fb850-8243-444f-a20f-f2aaa9df735e tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:22:03.979062 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-936fb850-8243-444f-a20f-f2aaa9df735e tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:22:03.981680 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-936fb850-8243-444f-a20f-f2aaa9df735e tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73a9c409bb7448af896f57aaa7a7eed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a378a658347414fbea6f4c90e31cc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:22:03.984619 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-936fb850-8243-444f-a20f-f2aaa9df735e tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "GET /compute/v2.1/servers/999489d9-f069-461b-b5ad-6134e156ccc9" status: 200 len: 1368 microversion: 2.47 time: 0.247983 Oct 26 13:22:03.985224 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2327/4634] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:22:03 2022] GET /compute/v2.1/servers/999489d9-f069-461b-b5ad-6134e156ccc9 => generated 1368 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:22:04.015738 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b5a865b7-91ee-4e69-bdd4-ff6bff150073 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:04.017413 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b5a865b7-91ee-4e69-bdd4-ff6bff150073 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: d7cd631a-a439-481d-ab67-f5a0c9d0ef86] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:22:04.031898 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b5a865b7-91ee-4e69-bdd4-ff6bff150073 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:04.032377 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b5a865b7-91ee-4e69-bdd4-ff6bff150073 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:04.032807 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b5a865b7-91ee-4e69-bdd4-ff6bff150073 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:04.035956 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b5a865b7-91ee-4e69-bdd4-ff6bff150073 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:04.036468 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b5a865b7-91ee-4e69-bdd4-ff6bff150073 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:04.036918 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b5a865b7-91ee-4e69-bdd4-ff6bff150073 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:04.266345 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b5a865b7-91ee-4e69-bdd4-ff6bff150073 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9017d8481844cd9266b86736982c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d947764e045dfafa0a18ec2472e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:22:04.278468 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b5a865b7-91ee-4e69-bdd4-ff6bff150073 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/d7cd631a-a439-481d-ab67-f5a0c9d0ef86" status: 200 len: 1474 microversion: 2.1 time: 0.268675 Oct 26 13:22:04.280912 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2308/4635] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:22:04 2022] GET /compute/v2.1/servers/d7cd631a-a439-481d-ab67-f5a0c9d0ef86 => generated 1474 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:22:04.357474 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-8d0ae135-c75d-444b-a736-5b2becffa3f6 req-bda7e3c3-3fe1-4b07-bf79-72098a6df399 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7cd631a-a439-481d-ab67-f5a0c9d0ef86", "name": "network-vif-deleted", "tag": "d286e014-2811-4f2e-8a1f-9f097f030fa7"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:22:04.391331 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8d0ae135-c75d-444b-a736-5b2becffa3f6 req-bda7e3c3-3fe1-4b07-bf79-72098a6df399 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:04.392010 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8d0ae135-c75d-444b-a736-5b2becffa3f6 req-bda7e3c3-3fe1-4b07-bf79-72098a6df399 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:04.397605 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8d0ae135-c75d-444b-a736-5b2becffa3f6 req-bda7e3c3-3fe1-4b07-bf79-72098a6df399 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:04.436924 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-8d0ae135-c75d-444b-a736-5b2becffa3f6 req-bda7e3c3-3fe1-4b07-bf79-72098a6df399 service nova] Creating event network-vif-deleted:d286e014-2811-4f2e-8a1f-9f097f030fa7 for instance d7cd631a-a439-481d-ab67-f5a0c9d0ef86 on n-h1-862686-1 Oct 26 13:22:04.446948 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-8d0ae135-c75d-444b-a736-5b2becffa3f6 req-bda7e3c3-3fe1-4b07-bf79-72098a6df399 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093482 Oct 26 13:22:04.447895 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2328/4636] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:22:05.024793 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f6cbea8f-c44a-43ea-a2f7-39597fad5edd tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:05.026210 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f6cbea8f-c44a-43ea-a2f7-39597fad5edd tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] [instance: 999489d9-f069-461b-b5ad-6134e156ccc9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:22:05.032625 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:22:05.037412 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f6cbea8f-c44a-43ea-a2f7-39597fad5edd tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:05.038762 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f6cbea8f-c44a-43ea-a2f7-39597fad5edd tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:05.039420 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f6cbea8f-c44a-43ea-a2f7-39597fad5edd tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:05.040379 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f6cbea8f-c44a-43ea-a2f7-39597fad5edd tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:05.041073 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f6cbea8f-c44a-43ea-a2f7-39597fad5edd tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:05.041759 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f6cbea8f-c44a-43ea-a2f7-39597fad5edd tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:05.061740 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-f6cbea8f-c44a-43ea-a2f7-39597fad5edd tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] HTTP exception thrown: Instance 999489d9-f069-461b-b5ad-6134e156ccc9 could not be found. Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f6cbea8f-c44a-43ea-a2f7-39597fad5edd tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Request method failure captured: Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/999489d9-f069-461b-b5ad-6134e156ccc9 HTTP/1.1 Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTQ_1Ki3B55QogJcvCGj6PVQxS1bgY9JvRhrJX2ZnqOj_QNIz5eHQ8aBzwLdnocXYMp_Z_3ipRr0mcWBN99ffZeTxX4OBGEEErXm8ql25YGlLlIHTgxyNW_hyJgvZIdrnL_w5mmhy7TgN0jhNLQO7RQooOkQP0NmVVXWma1Cd0CoGiY Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: X-Openstack-Nova-Api-Version: 2.47 Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 9a378a658347414fbea6f4c90e31cc16 Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServerShowV247Test-1150871184 Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9a378a658347414fbea6f4c90e31cc16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9a378a658347414fbea6f4c90e31cc16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9a378a658347414fbea6f4c90e31cc16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9a378a658347414fbea6f4c90e31cc16"}]}] Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServerShowV247Test-1150871184 Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 9a378a658347414fbea6f4c90e31cc16 Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServerShowV247Test-1150871184 Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServerShowV247Test-1150871184-project Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 73a9c409bb7448af896f57aaa7a7eed4 Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServerShowV247Test-1150871184-project Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 999489d9-f069-461b-b5ad-6134e156ccc9 could not be found. Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '999489d9-f069-461b-b5ad-6134e156ccc9'} Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999489d9-f069-461b-b5ad-6134e156ccc9 could not be found. Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999489d9-f069-461b-b5ad-6134e156ccc9 could not be found. Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:22:05.064290 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:22:05.068892 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:22:05.068892 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:22:05.068892 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:22:05.068892 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:22:05.068892 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:22:05.068892 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999489d9-f069-461b-b5ad-6134e156ccc9 could not be found. Oct 26 13:22:05.068892 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:22:05.071813 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f6cbea8f-c44a-43ea-a2f7-39597fad5edd tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] Returning 404 to user: Instance 999489d9-f069-461b-b5ad-6134e156ccc9 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:22:05.073404 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f6cbea8f-c44a-43ea-a2f7-39597fad5edd tempest-ServerShowV247Test-1150871184 tempest-ServerShowV247Test-1150871184-project] 10.222.0.40 "GET /compute/v2.1/servers/999489d9-f069-461b-b5ad-6134e156ccc9" status: 404 len: 111 microversion: 2.47 time: 0.052897 Oct 26 13:22:05.077856 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2309/4637] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:22:05 2022] GET /compute/v2.1/servers/999489d9-f069-461b-b5ad-6134e156ccc9 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:22:05.311775 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cc18c30d-7541-4509-93bc-c700c65b7c19 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:05.313224 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cc18c30d-7541-4509-93bc-c700c65b7c19 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] [instance: d7cd631a-a439-481d-ab67-f5a0c9d0ef86] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:22:05.334277 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cc18c30d-7541-4509-93bc-c700c65b7c19 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:05.335339 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cc18c30d-7541-4509-93bc-c700c65b7c19 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:05.336051 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cc18c30d-7541-4509-93bc-c700c65b7c19 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:05.337193 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cc18c30d-7541-4509-93bc-c700c65b7c19 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:05.338084 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cc18c30d-7541-4509-93bc-c700c65b7c19 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:05.338697 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cc18c30d-7541-4509-93bc-c700c65b7c19 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:05.365812 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-cc18c30d-7541-4509-93bc-c700c65b7c19 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] HTTP exception thrown: Instance d7cd631a-a439-481d-ab67-f5a0c9d0ef86 could not be found. Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cc18c30d-7541-4509-93bc-c700c65b7c19 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Request method failure captured: Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/d7cd631a-a439-481d-ab67-f5a0c9d0ef86 HTTP/1.1 Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTQyUkWTEWbYQoZmHr_U7kplZYqWQRwOJeuTv_tcfOPje80gEX4g9SVM0rLpflAgmkrOW6WrhGn6RQP55tW8153E1Un1Teh9P0Q2AJ-dpt59wT2GHnk8oJ9kiu11mv1lGBdweD53tXyqi8VnxXv7nv8NQPtSSzfqC_lVNtgpBHuTE40 Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: cf8d947764e045dfafa0a18ec2472e7b Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ListServerFiltersTestJSON-563653154 Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cf8d947764e045dfafa0a18ec2472e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cf8d947764e045dfafa0a18ec2472e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cf8d947764e045dfafa0a18ec2472e7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cf8d947764e045dfafa0a18ec2472e7b"}]}] Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ListServerFiltersTestJSON-563653154 Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: cf8d947764e045dfafa0a18ec2472e7b Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-563653154 Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ListServerFiltersTestJSON-563653154-project Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 8b9017d8481844cd9266b86736982c92 Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ListServerFiltersTestJSON-563653154-project Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance d7cd631a-a439-481d-ab67-f5a0c9d0ef86 could not be found. Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'd7cd631a-a439-481d-ab67-f5a0c9d0ef86'} Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7cd631a-a439-481d-ab67-f5a0c9d0ef86 could not be found. Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7cd631a-a439-481d-ab67-f5a0c9d0ef86 could not be found. Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:22:05.368427 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:22:05.372866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:22:05.372866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:22:05.372866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:22:05.372866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:22:05.372866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:22:05.372866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7cd631a-a439-481d-ab67-f5a0c9d0ef86 could not be found. Oct 26 13:22:05.372866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:22:05.375792 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cc18c30d-7541-4509-93bc-c700c65b7c19 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] Returning 404 to user: Instance d7cd631a-a439-481d-ab67-f5a0c9d0ef86 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:22:05.377313 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cc18c30d-7541-4509-93bc-c700c65b7c19 tempest-ListServerFiltersTestJSON-563653154 tempest-ListServerFiltersTestJSON-563653154-project] 10.222.0.40 "GET /compute/v2.1/servers/d7cd631a-a439-481d-ab67-f5a0c9d0ef86" status: 404 len: 111 microversion: 2.1 time: 0.073081 Oct 26 13:22:05.383301 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2329/4638] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:22:05 2022] GET /compute/v2.1/servers/d7cd631a-a439-481d-ab67-f5a0c9d0ef86 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:22:09.567517 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2fbf9e75-3f85-432a-a52e-bbdae51cbe5e tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] Action: 'create', calling method: .version_select at 0x7f673274d040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1027159689"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:22:10.329505 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2fbf9e75-3f85-432a-a52e-bbdae51cbe5e tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.375487 Oct 26 13:22:10.338709 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2310/4639] 10.222.0.40 () {60 vars in 1155 bytes} [Wed Oct 26 13:22:08 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1381 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 26 13:22:10.345429 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d4fb9627-8844-4c64-8cc4-d2455791ee29 tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] Calling method '.version_select at 0x7f6732759c10>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:10.522524 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d4fb9627-8844-4c64-8cc4-d2455791ee29 tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/c30309e0-40ae-436c-8cba-004af2fecbf6" status: 200 len: 345 microversion: 2.1 time: 0.182770 Oct 26 13:22:10.531633 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2330/4640] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Oct 26 13:22:10 2022] GET /compute/v2.1/os-volumes/c30309e0-40ae-436c-8cba-004af2fecbf6 => generated 345 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:22:11.541842 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-661219f1-b9a3-4e6d-bc65-9f1ef59cd7ea tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] Calling method '.version_select at 0x7f67326ed670>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:11.562303 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=12 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:22:11.680472 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-661219f1-b9a3-4e6d-bc65-9f1ef59cd7ea tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/c30309e0-40ae-436c-8cba-004af2fecbf6" status: 200 len: 345 microversion: 2.1 time: 0.146527 Oct 26 13:22:11.688677 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2311/4641] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Oct 26 13:22:11 2022] GET /compute/v2.1/os-volumes/c30309e0-40ae-436c-8cba-004af2fecbf6 => generated 345 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:22:12.696966 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-41b0386f-184c-42d2-9a7b-c60746c36ff7 tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] Calling method '.version_select at 0x7f67325844c0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:12.712661 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=4 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:22:12.900098 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-41b0386f-184c-42d2-9a7b-c60746c36ff7 tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/c30309e0-40ae-436c-8cba-004af2fecbf6" status: 200 len: 346 microversion: 2.1 time: 0.207513 Oct 26 13:22:12.910433 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2331/4642] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Oct 26 13:22:12 2022] GET /compute/v2.1/os-volumes/c30309e0-40ae-436c-8cba-004af2fecbf6 => generated 346 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:22:12.915673 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d5160944-2dc2-48b1-ae9d-3d4e88341375 tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] Action: 'create', calling method: .version_select at 0x7f6732e479d0>, body: {"snapshot": {"volume_id": "c30309e0-40ae-436c-8cba-004af2fecbf6", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1340582054"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:22:13.451559 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d5160944-2dc2-48b1-ae9d-3d4e88341375 tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] 10.222.0.40 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.540618 Oct 26 13:22:13.452529 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2312/4643] 10.222.0.40 () {60 vars in 1162 bytes} [Wed Oct 26 13:22:12 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:22:13.465661 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9235670e-0b78-4186-ab31-c610674c9e3b tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] Calling method '.version_select at 0x7f67327cc5e0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:13.724301 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9235670e-0b78-4186-ab31-c610674c9e3b tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/8b70c265-c223-447b-bbab-405ad2ece82c" status: 200 len: 287 microversion: 2.1 time: 0.263290 Oct 26 13:22:13.732877 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2332/4644] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Oct 26 13:22:13 2022] GET /compute/v2.1/os-snapshots/8b70c265-c223-447b-bbab-405ad2ece82c => generated 287 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:22:13.736810 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7cb0d950-985c-4302-a16e-41615e0ce05d tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] Calling method '.version_select at 0x7f67326edaf0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:13.918199 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7cb0d950-985c-4302-a16e-41615e0ce05d tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.184675 Oct 26 13:22:13.919332 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2313/4645] 10.222.0.40 () {58 vars in 1140 bytes} [Wed Oct 26 13:22:13 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:22:13.931676 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-434701ff-2808-4002-9b5f-05bad2fcd312 tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] Calling method '.version_select at 0x7f6732463e50>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:13.999259 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-434701ff-2808-4002-9b5f-05bad2fcd312 tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/8b70c265-c223-447b-bbab-405ad2ece82c" status: 200 len: 287 microversion: 2.1 time: 0.072128 Oct 26 13:22:13.999870 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2333/4646] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Oct 26 13:22:13 2022] GET /compute/v2.1/os-snapshots/8b70c265-c223-447b-bbab-405ad2ece82c => generated 287 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:22:15.017919 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9a869c49-ca65-4a66-b9ac-892a02655f88 tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] Calling method '.version_select at 0x7f67322701f0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:15.052478 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=50 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:22:15.061515 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=52 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:22:15.141151 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9a869c49-ca65-4a66-b9ac-892a02655f88 tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/8b70c265-c223-447b-bbab-405ad2ece82c" status: 200 len: 287 microversion: 2.1 time: 0.130440 Oct 26 13:22:15.141775 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2314/4647] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Oct 26 13:22:15 2022] GET /compute/v2.1/os-snapshots/8b70c265-c223-447b-bbab-405ad2ece82c => generated 287 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:22:16.152980 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=8 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:22:16.154296 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:22:16.161109 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7f8578ab-3a2e-4b2c-a85f-76d0bf5a0f4d tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] Calling method '.version_select at 0x7f6732807af0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:16.231230 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7f8578ab-3a2e-4b2c-a85f-76d0bf5a0f4d tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/8b70c265-c223-447b-bbab-405ad2ece82c" status: 200 len: 287 microversion: 2.1 time: 0.079759 Oct 26 13:22:16.232007 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2334/4648] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Oct 26 13:22:16 2022] GET /compute/v2.1/os-snapshots/8b70c265-c223-447b-bbab-405ad2ece82c => generated 287 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:22:17.245782 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9f8b2395-3d6a-4bf1-a08c-384a477d358b tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] Calling method '.version_select at 0x7f6732879f70>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:17.297412 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9f8b2395-3d6a-4bf1-a08c-384a477d358b tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/8b70c265-c223-447b-bbab-405ad2ece82c" status: 200 len: 288 microversion: 2.1 time: 0.056391 Oct 26 13:22:17.298431 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2315/4649] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Oct 26 13:22:17 2022] GET /compute/v2.1/os-snapshots/8b70c265-c223-447b-bbab-405ad2ece82c => generated 288 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:22:17.311610 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-612b939d-edcb-41af-bcdc-1818268358ce tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] Calling method '.version_select at 0x7f67327bdd30>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:17.539609 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-612b939d-edcb-41af-bcdc-1818268358ce tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] 10.222.0.40 "DELETE /compute/v2.1/os-snapshots/8b70c265-c223-447b-bbab-405ad2ece82c" status: 202 len: 0 microversion: 2.1 time: 0.232819 Oct 26 13:22:17.540963 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2335/4650] 10.222.0.40 () {58 vars in 1254 bytes} [Wed Oct 26 13:22:17 2022] DELETE /compute/v2.1/os-snapshots/8b70c265-c223-447b-bbab-405ad2ece82c => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:22:17.551663 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ce8029a1-9dc1-4a9f-bef8-33107768646f tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] Calling method '.version_select at 0x7f6732ea8d30>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:17.616674 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ce8029a1-9dc1-4a9f-bef8-33107768646f tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/8b70c265-c223-447b-bbab-405ad2ece82c" status: 200 len: 287 microversion: 2.1 time: 0.071664 Oct 26 13:22:17.617599 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2316/4651] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Oct 26 13:22:17 2022] GET /compute/v2.1/os-snapshots/8b70c265-c223-447b-bbab-405ad2ece82c => generated 287 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:22:18.280827 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b079c226-2b89-4aae-9d50-45ab4c743fb2 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f482485-b484-48ff-a775-3f47e4aad476"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:22:18.286091 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b079c226-2b89-4aae-9d50-45ab4c743fb2 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:22:18.332727 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b079c226-2b89-4aae-9d50-45ab4c743fb2 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:18.333382 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b079c226-2b89-4aae-9d50-45ab4c743fb2 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:18.354592 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b079c226-2b89-4aae-9d50-45ab4c743fb2 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:18.355771 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b079c226-2b89-4aae-9d50-45ab4c743fb2 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:18.358069 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b079c226-2b89-4aae-9d50-45ab4c743fb2 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:18.368232 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b079c226-2b89-4aae-9d50-45ab4c743fb2 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:18.632021 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-97a4dd6f-a17a-44c3-a643-8e9f914e672c tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] Calling method '.version_select at 0x7f673231c5e0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:18.710322 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-97a4dd6f-a17a-44c3-a643-8e9f914e672c tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/8b70c265-c223-447b-bbab-405ad2ece82c" status: 200 len: 287 microversion: 2.1 time: 0.083879 Oct 26 13:22:18.711393 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2317/4652] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Oct 26 13:22:18 2022] GET /compute/v2.1/os-snapshots/8b70c265-c223-447b-bbab-405ad2ece82c => generated 287 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:22:19.138564 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b079c226-2b89-4aae-9d50-45ab4c743fb2 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "POST /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.862917 Oct 26 13:22:19.144255 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2336/4653] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Oct 26 13:22:18 2022] POST /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245/os-volume_attachments => generated 194 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:22:19.724059 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d667e11d-aef8-4775-9be2-2495c973c1bd tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] Calling method '.version_select at 0x7f673231cb80>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:19.913003 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d667e11d-aef8-4775-9be2-2495c973c1bd tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/8b70c265-c223-447b-bbab-405ad2ece82c" status: 200 len: 287 microversion: 2.1 time: 0.193093 Oct 26 13:22:19.913920 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2318/4654] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Oct 26 13:22:19 2022] GET /compute/v2.1/os-snapshots/8b70c265-c223-447b-bbab-405ad2ece82c => generated 287 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:22:20.928702 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-59a622ec-7716-4fd8-95ec-91dfcb798fe5 tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] Calling method '.version_select at 0x7f67328b4b80>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:21.001595 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-59a622ec-7716-4fd8-95ec-91dfcb798fe5 tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] HTTP exception thrown: Snapshot 8b70c265-c223-447b-bbab-405ad2ece82c could not be found. Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-59a622ec-7716-4fd8-95ec-91dfcb798fe5 tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] Request method failure captured: Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/os-snapshots/8b70c265-c223-447b-bbab-405ad2ece82c HTTP/1.1 Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTSAmBQgRu2xpDYP7ZoQ-w-MBBZLJ8PDxV4okQYN0QowE-y2VNJCJbCAERBHYNaHfoO0AVgNBmsuuBJ3ttSIW7LLCghyCPPmKwoGhoxhc1VbybAbzlndv25FuDkf-Igy8GOWB-5C3imtblmps-rQNALeSZJjgb_wDG5r1cOCunudu9Q Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: f9bae233c8d44f9ba59872e41ef00fe2 Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-52767922 Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f9bae233c8d44f9ba59872e41ef00fe2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f9bae233c8d44f9ba59872e41ef00fe2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f9bae233c8d44f9ba59872e41ef00fe2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f9bae233c8d44f9ba59872e41ef00fe2"}]}] Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-VolumesSnapshotsTestJSON-52767922 Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: f9bae233c8d44f9ba59872e41ef00fe2 Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-52767922 Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-VolumesSnapshotsTestJSON-52767922-project Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 668f4e5b850948da9b49a273019581d8 Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-VolumesSnapshotsTestJSON-52767922-project Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: exception: Snapshot 8b70c265-c223-447b-bbab-405ad2ece82c could not be found. Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '8b70c265-c223-447b-bbab-405ad2ece82c'} Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 8b70c265-c223-447b-bbab-405ad2ece82c could not be found. (HTTP 404) (Request-ID: req-aa5a4f2c-e860-4d13-b506-a47ac1bf308e) Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 26 13:22:21.008883 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 26 13:22:21.016672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 26 13:22:21.016672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 26 13:22:21.016672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 26 13:22:21.016672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 26 13:22:21.016672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 26 13:22:21.016672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 26 13:22:21.016672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 26 13:22:21.016672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 26 13:22:21.016672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 26 13:22:21.016672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 26 13:22:21.016672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 13:22:21.016672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 13:22:21.016672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 13:22:21.016672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 13:22:21.016672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 8b70c265-c223-447b-bbab-405ad2ece82c could not be found. Oct 26 13:22:21.016672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:22:21.016672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:22:21.016672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:22:21.016672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:22:21.016672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:22:21.016672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:22:21.016672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:22:21.016672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:22:21.016672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:22:21.016672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:22:21.016672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:22:21.016672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:22:21.016672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 26 13:22:21.016672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:22:21.016672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 8b70c265-c223-447b-bbab-405ad2ece82c could not be found. Oct 26 13:22:21.016672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:22:21.016672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:22:21.016672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:22:21.016672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:22:21.016672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:22:21.016672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:22:21.016672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:22:21.016672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:22:21.016672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 8b70c265-c223-447b-bbab-405ad2ece82c could not be found. Oct 26 13:22:21.016672 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:22:21.016672 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-59a622ec-7716-4fd8-95ec-91dfcb798fe5 tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] Returning 404 to user: Snapshot 8b70c265-c223-447b-bbab-405ad2ece82c could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:22:21.016672 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-59a622ec-7716-4fd8-95ec-91dfcb798fe5 tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/8b70c265-c223-447b-bbab-405ad2ece82c" status: 404 len: 111 microversion: 2.1 time: 0.088018 Oct 26 13:22:21.016672 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2337/4655] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Oct 26 13:22:20 2022] GET /compute/v2.1/os-snapshots/8b70c265-c223-447b-bbab-405ad2ece82c => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:22:21.021761 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b467bc28-0ad2-4872-a99a-f06a44492270 tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] Calling method '.version_select at 0x7f67322c98b0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:21.204061 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b467bc28-0ad2-4872-a99a-f06a44492270 tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/c30309e0-40ae-436c-8cba-004af2fecbf6" status: 202 len: 0 microversion: 2.1 time: 0.188582 Oct 26 13:22:21.207838 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2319/4656] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Oct 26 13:22:21 2022] DELETE /compute/v2.1/os-volumes/c30309e0-40ae-436c-8cba-004af2fecbf6 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:22:21.222280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c989c2d5-52ab-48a7-8159-dff850cd26e6 tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] Calling method '.version_select at 0x7f6732b32790>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:21.381409 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c989c2d5-52ab-48a7-8159-dff850cd26e6 tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/c30309e0-40ae-436c-8cba-004af2fecbf6" status: 200 len: 345 microversion: 2.1 time: 0.171751 Oct 26 13:22:21.383126 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2338/4657] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Oct 26 13:22:21 2022] GET /compute/v2.1/os-volumes/c30309e0-40ae-436c-8cba-004af2fecbf6 => generated 345 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:22:22.400426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-39e2dd19-e7a4-4b51-aec6-708f58ae1852 tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] Calling method '.version_select at 0x7f6732270e50>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:22.531492 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-39e2dd19-e7a4-4b51-aec6-708f58ae1852 tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/c30309e0-40ae-436c-8cba-004af2fecbf6" status: 200 len: 345 microversion: 2.1 time: 0.138202 Oct 26 13:22:22.532425 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2320/4658] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Oct 26 13:22:22 2022] GET /compute/v2.1/os-volumes/c30309e0-40ae-436c-8cba-004af2fecbf6 => generated 345 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:22:23.547004 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0a44114f-e2f1-49e3-a55b-a7bf9405c27a tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] Calling method '.version_select at 0x7f673245d8b0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:23.659617 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0a44114f-e2f1-49e3-a55b-a7bf9405c27a tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/c30309e0-40ae-436c-8cba-004af2fecbf6" status: 200 len: 345 microversion: 2.1 time: 0.117069 Oct 26 13:22:23.661062 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2339/4659] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Oct 26 13:22:23 2022] GET /compute/v2.1/os-volumes/c30309e0-40ae-436c-8cba-004af2fecbf6 => generated 345 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:22:24.676064 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7c4f278a-933d-4172-a8ee-1a5ff5141b2b tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] Calling method '.version_select at 0x7f6732879040>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:24.815652 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7c4f278a-933d-4172-a8ee-1a5ff5141b2b tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/c30309e0-40ae-436c-8cba-004af2fecbf6" status: 200 len: 345 microversion: 2.1 time: 0.145058 Oct 26 13:22:24.816528 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2321/4660] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Oct 26 13:22:24 2022] GET /compute/v2.1/os-volumes/c30309e0-40ae-436c-8cba-004af2fecbf6 => generated 345 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:22:25.832511 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8f3d3beb-7e5a-4984-9993-2d75a0385430 tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] Calling method '.version_select at 0x7f6732fe74c0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:25.845670 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-749c4d03-9d56-4e8f-9be1-08ebefa82db1 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:25.846412 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-749c4d03-9d56-4e8f-9be1-08ebefa82db1 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:22:25.872017 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-749c4d03-9d56-4e8f-9be1-08ebefa82db1 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:25.882214 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-749c4d03-9d56-4e8f-9be1-08ebefa82db1 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:25.882925 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-749c4d03-9d56-4e8f-9be1-08ebefa82db1 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:25.887597 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-749c4d03-9d56-4e8f-9be1-08ebefa82db1 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:25.894568 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-749c4d03-9d56-4e8f-9be1-08ebefa82db1 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:25.898409 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-749c4d03-9d56-4e8f-9be1-08ebefa82db1 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:26.028984 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8f3d3beb-7e5a-4984-9993-2d75a0385430 tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/c30309e0-40ae-436c-8cba-004af2fecbf6" status: 200 len: 345 microversion: 2.1 time: 0.202659 Oct 26 13:22:26.029575 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2340/4661] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Oct 26 13:22:25 2022] GET /compute/v2.1/os-volumes/c30309e0-40ae-436c-8cba-004af2fecbf6 => generated 345 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:22:26.030777 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-749c4d03-9d56-4e8f-9be1-08ebefa82db1 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6/ips" status: 200 len: 146 microversion: 2.1 time: 0.182775 Oct 26 13:22:26.031486 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2322/4662] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Oct 26 13:22:25 2022] GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6/ips => generated 146 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:22:27.048978 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bccd8213-591e-439f-b2c1-da3ac353a3ad tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] Calling method '.version_select at 0x7f6732759e50>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:27.180461 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-bccd8213-591e-439f-b2c1-da3ac353a3ad tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] HTTP exception thrown: Volume c30309e0-40ae-436c-8cba-004af2fecbf6 could not be found. Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bccd8213-591e-439f-b2c1-da3ac353a3ad tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] Request method failure captured: Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/os-volumes/c30309e0-40ae-436c-8cba-004af2fecbf6 HTTP/1.1 Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTSAmBQgRu2xpDYP7ZoQ-w-MBBZLJ8PDxV4okQYN0QowE-y2VNJCJbCAERBHYNaHfoO0AVgNBmsuuBJ3ttSIW7LLCghyCPPmKwoGhoxhc1VbybAbzlndv25FuDkf-Igy8GOWB-5C3imtblmps-rQNALeSZJjgb_wDG5r1cOCunudu9Q Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: f9bae233c8d44f9ba59872e41ef00fe2 Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-52767922 Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f9bae233c8d44f9ba59872e41ef00fe2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f9bae233c8d44f9ba59872e41ef00fe2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f9bae233c8d44f9ba59872e41ef00fe2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f9bae233c8d44f9ba59872e41ef00fe2"}]}] Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-VolumesSnapshotsTestJSON-52767922 Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: f9bae233c8d44f9ba59872e41ef00fe2 Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-52767922 Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-VolumesSnapshotsTestJSON-52767922-project Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 668f4e5b850948da9b49a273019581d8 Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-VolumesSnapshotsTestJSON-52767922-project Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: exception: Volume c30309e0-40ae-436c-8cba-004af2fecbf6 could not be found. Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'c30309e0-40ae-436c-8cba-004af2fecbf6'} Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c30309e0-40ae-436c-8cba-004af2fecbf6 could not be found. (HTTP 404) (Request-ID: req-d260df3e-996b-4296-b918-ae7e62c52110) Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 26 13:22:27.183079 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 13:22:27.188357 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 13:22:27.188357 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 26 13:22:27.188357 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 26 13:22:27.188357 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 26 13:22:27.188357 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 26 13:22:27.188357 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 26 13:22:27.188357 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 26 13:22:27.188357 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 26 13:22:27.188357 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 26 13:22:27.188357 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 13:22:27.188357 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 13:22:27.188357 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 13:22:27.188357 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 13:22:27.188357 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c30309e0-40ae-436c-8cba-004af2fecbf6 could not be found. Oct 26 13:22:27.188357 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:22:27.188357 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:22:27.188357 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:22:27.188357 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:22:27.188357 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:22:27.188357 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:22:27.188357 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:22:27.188357 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:22:27.188357 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:22:27.188357 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:22:27.188357 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:22:27.188357 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:22:27.188357 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 26 13:22:27.188357 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:22:27.188357 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c30309e0-40ae-436c-8cba-004af2fecbf6 could not be found. Oct 26 13:22:27.188357 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:22:27.188357 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:22:27.188357 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:22:27.188357 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:22:27.188357 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:22:27.188357 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:22:27.188357 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:22:27.188357 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:22:27.188357 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c30309e0-40ae-436c-8cba-004af2fecbf6 could not be found. Oct 26 13:22:27.188357 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:22:27.188357 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bccd8213-591e-439f-b2c1-da3ac353a3ad tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] Returning 404 to user: Volume c30309e0-40ae-436c-8cba-004af2fecbf6 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:22:27.191612 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bccd8213-591e-439f-b2c1-da3ac353a3ad tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/c30309e0-40ae-436c-8cba-004af2fecbf6" status: 404 len: 109 microversion: 2.1 time: 0.146658 Oct 26 13:22:27.192344 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2341/4663] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Oct 26 13:22:27 2022] GET /compute/v2.1/os-volumes/c30309e0-40ae-436c-8cba-004af2fecbf6 => generated 109 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:22:27.208460 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e43fa453-de1a-4579-9eaf-aa37ae9fdb42 tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] Calling method '.version_select at 0x7f673232ea60>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:27.384047 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-e43fa453-de1a-4579-9eaf-aa37ae9fdb42 tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] HTTP exception thrown: Volume c30309e0-40ae-436c-8cba-004af2fecbf6 could not be found. Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e43fa453-de1a-4579-9eaf-aa37ae9fdb42 tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] Request method failure captured: Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/os-volumes/c30309e0-40ae-436c-8cba-004af2fecbf6 HTTP/1.1 Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTSAmBQgRu2xpDYP7ZoQ-w-MBBZLJ8PDxV4okQYN0QowE-y2VNJCJbCAERBHYNaHfoO0AVgNBmsuuBJ3ttSIW7LLCghyCPPmKwoGhoxhc1VbybAbzlndv25FuDkf-Igy8GOWB-5C3imtblmps-rQNALeSZJjgb_wDG5r1cOCunudu9Q Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: f9bae233c8d44f9ba59872e41ef00fe2 Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-52767922 Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f9bae233c8d44f9ba59872e41ef00fe2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f9bae233c8d44f9ba59872e41ef00fe2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f9bae233c8d44f9ba59872e41ef00fe2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f9bae233c8d44f9ba59872e41ef00fe2"}]}] Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-VolumesSnapshotsTestJSON-52767922 Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: f9bae233c8d44f9ba59872e41ef00fe2 Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-52767922 Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-VolumesSnapshotsTestJSON-52767922-project Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 668f4e5b850948da9b49a273019581d8 Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-VolumesSnapshotsTestJSON-52767922-project Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: method: Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: exception: Volume c30309e0-40ae-436c-8cba-004af2fecbf6 could not be found. Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'c30309e0-40ae-436c-8cba-004af2fecbf6'} Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c30309e0-40ae-436c-8cba-004af2fecbf6 could not be found. (HTTP 404) (Request-ID: req-ec97a523-5c5d-4369-a92e-497eae7f2afe) Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 26 13:22:27.386523 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 13:22:27.391212 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 13:22:27.391212 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 26 13:22:27.391212 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 26 13:22:27.391212 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 26 13:22:27.391212 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 26 13:22:27.391212 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 26 13:22:27.391212 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 26 13:22:27.391212 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 26 13:22:27.391212 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 26 13:22:27.391212 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 13:22:27.391212 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 13:22:27.391212 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 13:22:27.391212 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 13:22:27.391212 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c30309e0-40ae-436c-8cba-004af2fecbf6 could not be found. Oct 26 13:22:27.391212 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:22:27.391212 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:22:27.391212 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:22:27.391212 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:22:27.391212 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:22:27.391212 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:22:27.391212 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:22:27.391212 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:22:27.391212 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:22:27.391212 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:22:27.391212 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:22:27.391212 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:22:27.391212 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 26 13:22:27.391212 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:22:27.391212 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c30309e0-40ae-436c-8cba-004af2fecbf6 could not be found. Oct 26 13:22:27.391212 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:22:27.391212 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:22:27.391212 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:22:27.391212 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:22:27.391212 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:22:27.391212 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:22:27.391212 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:22:27.391212 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:22:27.391212 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c30309e0-40ae-436c-8cba-004af2fecbf6 could not be found. Oct 26 13:22:27.391212 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:22:27.391212 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e43fa453-de1a-4579-9eaf-aa37ae9fdb42 tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] Returning 404 to user: Volume c30309e0-40ae-436c-8cba-004af2fecbf6 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:22:27.391212 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e43fa453-de1a-4579-9eaf-aa37ae9fdb42 tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/c30309e0-40ae-436c-8cba-004af2fecbf6" status: 404 len: 109 microversion: 2.1 time: 0.184833 Oct 26 13:22:27.391212 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2323/4664] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Oct 26 13:22:27 2022] DELETE /compute/v2.1/os-volumes/c30309e0-40ae-436c-8cba-004af2fecbf6 => generated 109 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:22:27.398262 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2a13710e-7745-49f0-9273-8c5fd7290389 tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] Calling method '.version_select at 0x7f6732b32790>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:27.467359 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-2a13710e-7745-49f0-9273-8c5fd7290389 tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] HTTP exception thrown: Volume c30309e0-40ae-436c-8cba-004af2fecbf6 could not be found. Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2a13710e-7745-49f0-9273-8c5fd7290389 tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] Request method failure captured: Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/os-volumes/c30309e0-40ae-436c-8cba-004af2fecbf6 HTTP/1.1 Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTSAmBQgRu2xpDYP7ZoQ-w-MBBZLJ8PDxV4okQYN0QowE-y2VNJCJbCAERBHYNaHfoO0AVgNBmsuuBJ3ttSIW7LLCghyCPPmKwoGhoxhc1VbybAbzlndv25FuDkf-Igy8GOWB-5C3imtblmps-rQNALeSZJjgb_wDG5r1cOCunudu9Q Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: f9bae233c8d44f9ba59872e41ef00fe2 Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-52767922 Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f9bae233c8d44f9ba59872e41ef00fe2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f9bae233c8d44f9ba59872e41ef00fe2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f9bae233c8d44f9ba59872e41ef00fe2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f9bae233c8d44f9ba59872e41ef00fe2"}]}] Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-VolumesSnapshotsTestJSON-52767922 Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: f9bae233c8d44f9ba59872e41ef00fe2 Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-52767922 Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-VolumesSnapshotsTestJSON-52767922-project Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 668f4e5b850948da9b49a273019581d8 Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-VolumesSnapshotsTestJSON-52767922-project Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: method: Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: exception: Volume c30309e0-40ae-436c-8cba-004af2fecbf6 could not be found. Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'c30309e0-40ae-436c-8cba-004af2fecbf6'} Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c30309e0-40ae-436c-8cba-004af2fecbf6 could not be found. (HTTP 404) (Request-ID: req-cfdb42a0-95a3-4035-9d8c-a51ebbfee917) Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 26 13:22:27.469845 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 13:22:27.474784 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 13:22:27.474784 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 26 13:22:27.474784 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 26 13:22:27.474784 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 26 13:22:27.474784 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 26 13:22:27.474784 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 26 13:22:27.474784 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 26 13:22:27.474784 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 26 13:22:27.474784 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 26 13:22:27.474784 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 13:22:27.474784 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 13:22:27.474784 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 13:22:27.474784 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 13:22:27.474784 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c30309e0-40ae-436c-8cba-004af2fecbf6 could not be found. Oct 26 13:22:27.474784 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:22:27.474784 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:22:27.474784 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:22:27.474784 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:22:27.474784 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:22:27.474784 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:22:27.474784 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:22:27.474784 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:22:27.474784 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:22:27.474784 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:22:27.474784 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:22:27.474784 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:22:27.474784 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 26 13:22:27.474784 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:22:27.474784 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c30309e0-40ae-436c-8cba-004af2fecbf6 could not be found. Oct 26 13:22:27.474784 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:22:27.474784 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:22:27.474784 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:22:27.474784 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:22:27.474784 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:22:27.474784 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:22:27.474784 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:22:27.474784 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:22:27.474784 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c30309e0-40ae-436c-8cba-004af2fecbf6 could not be found. Oct 26 13:22:27.474784 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:22:27.474784 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2a13710e-7745-49f0-9273-8c5fd7290389 tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] Returning 404 to user: Volume c30309e0-40ae-436c-8cba-004af2fecbf6 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:22:27.474784 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2a13710e-7745-49f0-9273-8c5fd7290389 tempest-VolumesSnapshotsTestJSON-52767922 tempest-VolumesSnapshotsTestJSON-52767922-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/c30309e0-40ae-436c-8cba-004af2fecbf6" status: 404 len: 109 microversion: 2.1 time: 0.078659 Oct 26 13:22:27.474784 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2342/4665] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Oct 26 13:22:27 2022] GET /compute/v2.1/os-volumes/c30309e0-40ae-436c-8cba-004af2fecbf6 => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:22:30.318540 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-54a0d5a0-329b-4243-bbfd-25d668da9269 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d96aeed7-23b5-4410-ac30-1edb45413387"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:22:30.354320 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-54a0d5a0-329b-4243-bbfd-25d668da9269 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:22:30.400275 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54a0d5a0-329b-4243-bbfd-25d668da9269 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:30.407841 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54a0d5a0-329b-4243-bbfd-25d668da9269 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:30.409600 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54a0d5a0-329b-4243-bbfd-25d668da9269 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:30.414995 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54a0d5a0-329b-4243-bbfd-25d668da9269 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:30.418296 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54a0d5a0-329b-4243-bbfd-25d668da9269 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:30.424508 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54a0d5a0-329b-4243-bbfd-25d668da9269 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:31.299612 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-54a0d5a0-329b-4243-bbfd-25d668da9269 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "POST /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.991188 Oct 26 13:22:31.321094 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2324/4666] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Oct 26 13:22:30 2022] POST /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6/os-volume_attachments => generated 194 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:22:33.584765 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:22:33.586936 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:22:33.943337 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-92f7b0c1-2188-4a3a-bb93-079a110784e7 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-193921280", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "48d01af5-f80c-487b-aad7-f225b384104f"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:22:34.092688 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-92f7b0c1-2188-4a3a-bb93-079a110784e7 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] validate_networks() for [('48d01af5-f80c-487b-aad7-f225b384104f', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:22:35.216972 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-92f7b0c1-2188-4a3a-bb93-079a110784e7 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:22:35.218268 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-92f7b0c1-2188-4a3a-bb93-079a110784e7 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:22:35.218759 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-92f7b0c1-2188-4a3a-bb93-079a110784e7 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:22:35.219178 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-92f7b0c1-2188-4a3a-bb93-079a110784e7 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:22:35.219594 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-92f7b0c1-2188-4a3a-bb93-079a110784e7 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:22:35.241474 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-92f7b0c1-2188-4a3a-bb93-079a110784e7 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:35.242576 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-92f7b0c1-2188-4a3a-bb93-079a110784e7 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:35.243569 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-92f7b0c1-2188-4a3a-bb93-079a110784e7 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:35.244839 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-92f7b0c1-2188-4a3a-bb93-079a110784e7 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:35.245471 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-92f7b0c1-2188-4a3a-bb93-079a110784e7 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:35.246213 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-92f7b0c1-2188-4a3a-bb93-079a110784e7 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:35.274613 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-92f7b0c1-2188-4a3a-bb93-079a110784e7 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Getting quotas for project 75060adb546045de9116a81b28b62aaa. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:22:35.282206 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-92f7b0c1-2188-4a3a-bb93-079a110784e7 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Getting quotas for user 7919304c6da84ce6b86fb6893e72be7e and project 75060adb546045de9116a81b28b62aaa. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:22:35.302312 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-92f7b0c1-2188-4a3a-bb93-079a110784e7 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:22:35.308861 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-92f7b0c1-2188-4a3a-bb93-079a110784e7 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] [instance: 776ba545-27d5-41e9-84c9-6c9cfe4ad057] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:22:35.394504 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-92f7b0c1-2188-4a3a-bb93-079a110784e7 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.809936 Oct 26 13:22:35.396533 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2343/4667] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:22:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:22:35.408599 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5e38b3a2-501b-45da-8a57-9cd56dbf13f6 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:35.409280 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5e38b3a2-501b-45da-8a57-9cd56dbf13f6 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] [instance: 776ba545-27d5-41e9-84c9-6c9cfe4ad057] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:22:35.651205 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5e38b3a2-501b-45da-8a57-9cd56dbf13f6 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7919304c6da84ce6b86fb6893e72be7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75060adb546045de9116a81b28b62aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:22:35.676683 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5e38b3a2-501b-45da-8a57-9cd56dbf13f6 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] 10.222.0.40 "GET /compute/v2.1/servers/776ba545-27d5-41e9-84c9-6c9cfe4ad057" status: 200 len: 1216 microversion: 2.1 time: 0.269234 Oct 26 13:22:35.678025 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2325/4668] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:22:35 2022] GET /compute/v2.1/servers/776ba545-27d5-41e9-84c9-6c9cfe4ad057 => generated 1216 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:22:36.712392 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-99f9b48c-a5c1-414b-af64-bf4dd4312cae tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:36.713581 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-99f9b48c-a5c1-414b-af64-bf4dd4312cae tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] [instance: 776ba545-27d5-41e9-84c9-6c9cfe4ad057] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:22:36.981803 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-99f9b48c-a5c1-414b-af64-bf4dd4312cae tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7919304c6da84ce6b86fb6893e72be7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75060adb546045de9116a81b28b62aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:22:37.019776 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-99f9b48c-a5c1-414b-af64-bf4dd4312cae tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] 10.222.0.40 "GET /compute/v2.1/servers/776ba545-27d5-41e9-84c9-6c9cfe4ad057" status: 200 len: 1216 microversion: 2.1 time: 0.320384 Oct 26 13:22:37.026281 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2344/4669] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:22:36 2022] GET /compute/v2.1/servers/776ba545-27d5-41e9-84c9-6c9cfe4ad057 => generated 1216 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:22:38.062768 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b93cc1b3-b13d-4727-b756-cd2eda6586ab tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:38.139925 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b93cc1b3-b13d-4727-b756-cd2eda6586ab tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] [instance: 776ba545-27d5-41e9-84c9-6c9cfe4ad057] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:22:38.168506 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b93cc1b3-b13d-4727-b756-cd2eda6586ab tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:38.172809 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b93cc1b3-b13d-4727-b756-cd2eda6586ab tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:38.173675 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b93cc1b3-b13d-4727-b756-cd2eda6586ab tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:38.178969 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b93cc1b3-b13d-4727-b756-cd2eda6586ab tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:38.179494 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b93cc1b3-b13d-4727-b756-cd2eda6586ab tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:38.179947 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b93cc1b3-b13d-4727-b756-cd2eda6586ab tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:39.126617 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b93cc1b3-b13d-4727-b756-cd2eda6586ab tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7919304c6da84ce6b86fb6893e72be7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75060adb546045de9116a81b28b62aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:22:39.136970 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b93cc1b3-b13d-4727-b756-cd2eda6586ab tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] 10.222.0.40 "GET /compute/v2.1/servers/776ba545-27d5-41e9-84c9-6c9cfe4ad057" status: 200 len: 1276 microversion: 2.1 time: 1.090388 Oct 26 13:22:39.137576 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2326/4670] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:22:38 2022] GET /compute/v2.1/servers/776ba545-27d5-41e9-84c9-6c9cfe4ad057 => generated 1276 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:22:40.177232 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f688d900-18e2-4466-86c4-5ff215e716c6 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:40.182195 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f688d900-18e2-4466-86c4-5ff215e716c6 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] [instance: 776ba545-27d5-41e9-84c9-6c9cfe4ad057] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:22:40.232698 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f688d900-18e2-4466-86c4-5ff215e716c6 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:40.235144 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f688d900-18e2-4466-86c4-5ff215e716c6 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:40.244400 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f688d900-18e2-4466-86c4-5ff215e716c6 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:40.248559 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f688d900-18e2-4466-86c4-5ff215e716c6 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:40.253449 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f688d900-18e2-4466-86c4-5ff215e716c6 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:40.258770 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f688d900-18e2-4466-86c4-5ff215e716c6 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:40.647652 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f688d900-18e2-4466-86c4-5ff215e716c6 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7919304c6da84ce6b86fb6893e72be7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75060adb546045de9116a81b28b62aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:22:40.662448 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f688d900-18e2-4466-86c4-5ff215e716c6 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] 10.222.0.40 "GET /compute/v2.1/servers/776ba545-27d5-41e9-84c9-6c9cfe4ad057" status: 200 len: 1274 microversion: 2.1 time: 0.489863 Oct 26 13:22:40.665762 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2345/4671] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:22:40 2022] GET /compute/v2.1/servers/776ba545-27d5-41e9-84c9-6c9cfe4ad057 => generated 1274 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:22:40.794104 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f91a8c95-dadb-4d71-b2c8-775e90ba2612 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:22:40.797028 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f91a8c95-dadb-4d71-b2c8-775e90ba2612 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:22:40.810766 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f91a8c95-dadb-4d71-b2c8-775e90ba2612 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:40.816902 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f91a8c95-dadb-4d71-b2c8-775e90ba2612 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:40.817634 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f91a8c95-dadb-4d71-b2c8-775e90ba2612 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:40.818585 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f91a8c95-dadb-4d71-b2c8-775e90ba2612 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:40.824957 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f91a8c95-dadb-4d71-b2c8-775e90ba2612 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:40.826220 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f91a8c95-dadb-4d71-b2c8-775e90ba2612 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:40.897165 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-f91a8c95-dadb-4d71-b2c8-775e90ba2612 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lazy-loading 'flavor' on Instance uuid b93fff60-64e6-436d-9390-03d80438b245 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:22:41.228786 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f91a8c95-dadb-4d71-b2c8-775e90ba2612 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "POST /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245/action" status: 200 len: 32 microversion: 2.1 time: 0.437880 Oct 26 13:22:41.230587 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2327/4672] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:22:40 2022] POST /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245/action => generated 32 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:22:41.243988 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6e03c7ec-7d47-4f95-afca-72f5ade62984 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:41.244775 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6e03c7ec-7d47-4f95-afca-72f5ade62984 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:22:41.275443 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e03c7ec-7d47-4f95-afca-72f5ade62984 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:41.278710 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e03c7ec-7d47-4f95-afca-72f5ade62984 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:41.279347 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e03c7ec-7d47-4f95-afca-72f5ade62984 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:41.284433 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e03c7ec-7d47-4f95-afca-72f5ade62984 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:41.293409 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e03c7ec-7d47-4f95-afca-72f5ade62984 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:41.294013 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e03c7ec-7d47-4f95-afca-72f5ade62984 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:41.696606 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1e1a63f6-01d2-4c89-b9c3-a9386ee48a56 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:41.697568 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1e1a63f6-01d2-4c89-b9c3-a9386ee48a56 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] [instance: 776ba545-27d5-41e9-84c9-6c9cfe4ad057] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:22:41.716235 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1e1a63f6-01d2-4c89-b9c3-a9386ee48a56 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:41.725322 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1e1a63f6-01d2-4c89-b9c3-a9386ee48a56 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:41.728772 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1e1a63f6-01d2-4c89-b9c3-a9386ee48a56 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:41.734400 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1e1a63f6-01d2-4c89-b9c3-a9386ee48a56 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:41.740283 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1e1a63f6-01d2-4c89-b9c3-a9386ee48a56 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:41.743289 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1e1a63f6-01d2-4c89-b9c3-a9386ee48a56 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:41.975133 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6e03c7ec-7d47-4f95-afca-72f5ade62984 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:22:42.007981 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6e03c7ec-7d47-4f95-afca-72f5ade62984 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245" status: 200 len: 1734 microversion: 2.1 time: 0.771134 Oct 26 13:22:42.013551 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2346/4673] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:22:41 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245 => generated 1734 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:22:43.044668 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5d3fada1-02d6-4661-9c0a-c8f42d5e3976 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:43.045506 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5d3fada1-02d6-4661-9c0a-c8f42d5e3976 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:22:43.059789 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5d3fada1-02d6-4661-9c0a-c8f42d5e3976 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:43.060288 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5d3fada1-02d6-4661-9c0a-c8f42d5e3976 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:43.060731 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5d3fada1-02d6-4661-9c0a-c8f42d5e3976 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:43.061448 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5d3fada1-02d6-4661-9c0a-c8f42d5e3976 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:43.061939 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5d3fada1-02d6-4661-9c0a-c8f42d5e3976 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:43.062373 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5d3fada1-02d6-4661-9c0a-c8f42d5e3976 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:43.631224 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1e1a63f6-01d2-4c89-b9c3-a9386ee48a56 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7919304c6da84ce6b86fb6893e72be7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75060adb546045de9116a81b28b62aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:22:43.646785 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1e1a63f6-01d2-4c89-b9c3-a9386ee48a56 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] 10.222.0.40 "GET /compute/v2.1/servers/776ba545-27d5-41e9-84c9-6c9cfe4ad057" status: 200 len: 1316 microversion: 2.1 time: 1.952494 Oct 26 13:22:43.663170 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2328/4674] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:22:41 2022] GET /compute/v2.1/servers/776ba545-27d5-41e9-84c9-6c9cfe4ad057 => generated 1316 bytes in 1974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:22:43.912061 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5d3fada1-02d6-4661-9c0a-c8f42d5e3976 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:22:43.931947 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5d3fada1-02d6-4661-9c0a-c8f42d5e3976 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245" status: 200 len: 1734 microversion: 2.1 time: 0.891474 Oct 26 13:22:43.956590 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2347/4675] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:22:43 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245 => generated 1734 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:22:44.687084 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f11d5ede-c0af-42c7-89e0-fda11711b6e4 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:44.689912 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f11d5ede-c0af-42c7-89e0-fda11711b6e4 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] [instance: 776ba545-27d5-41e9-84c9-6c9cfe4ad057] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:22:44.709636 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f11d5ede-c0af-42c7-89e0-fda11711b6e4 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:44.711133 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f11d5ede-c0af-42c7-89e0-fda11711b6e4 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:44.712502 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f11d5ede-c0af-42c7-89e0-fda11711b6e4 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:44.713408 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f11d5ede-c0af-42c7-89e0-fda11711b6e4 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:44.714087 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f11d5ede-c0af-42c7-89e0-fda11711b6e4 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:44.714734 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f11d5ede-c0af-42c7-89e0-fda11711b6e4 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:44.974683 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f5e83533-75a4-4387-af09-b68b806cc87b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:44.976070 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f5e83533-75a4-4387-af09-b68b806cc87b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:22:44.996837 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5e83533-75a4-4387-af09-b68b806cc87b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:44.997573 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5e83533-75a4-4387-af09-b68b806cc87b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:45.001819 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5e83533-75a4-4387-af09-b68b806cc87b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:45.004932 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5e83533-75a4-4387-af09-b68b806cc87b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:45.007041 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5e83533-75a4-4387-af09-b68b806cc87b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:45.007765 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5e83533-75a4-4387-af09-b68b806cc87b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:45.263510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:22:45.464946 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f11d5ede-c0af-42c7-89e0-fda11711b6e4 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7919304c6da84ce6b86fb6893e72be7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75060adb546045de9116a81b28b62aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:22:45.516757 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f11d5ede-c0af-42c7-89e0-fda11711b6e4 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] 10.222.0.40 "GET /compute/v2.1/servers/776ba545-27d5-41e9-84c9-6c9cfe4ad057" status: 200 len: 1316 microversion: 2.1 time: 0.821152 Oct 26 13:22:45.522912 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2329/4676] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:22:44 2022] GET /compute/v2.1/servers/776ba545-27d5-41e9-84c9-6c9cfe4ad057 => generated 1316 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:22:46.567671 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0de513ba-dfe3-436b-a30d-9d831fc4ef35 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:46.570183 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0de513ba-dfe3-436b-a30d-9d831fc4ef35 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] [instance: 776ba545-27d5-41e9-84c9-6c9cfe4ad057] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:22:46.619398 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:22:46.626101 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0de513ba-dfe3-436b-a30d-9d831fc4ef35 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:46.631826 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0de513ba-dfe3-436b-a30d-9d831fc4ef35 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:46.632928 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0de513ba-dfe3-436b-a30d-9d831fc4ef35 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:46.634199 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0de513ba-dfe3-436b-a30d-9d831fc4ef35 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:46.634905 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0de513ba-dfe3-436b-a30d-9d831fc4ef35 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:46.635704 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0de513ba-dfe3-436b-a30d-9d831fc4ef35 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:47.013817 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=8 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:22:48.094776 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f5e83533-75a4-4387-af09-b68b806cc87b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:22:48.132651 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f5e83533-75a4-4387-af09-b68b806cc87b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245" status: 200 len: 1734 microversion: 2.1 time: 3.142201 Oct 26 13:22:48.147084 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2348/4677] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:22:44 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245 => generated 1734 bytes in 3179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:22:48.950294 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0de513ba-dfe3-436b-a30d-9d831fc4ef35 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7919304c6da84ce6b86fb6893e72be7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75060adb546045de9116a81b28b62aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:22:48.959616 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0de513ba-dfe3-436b-a30d-9d831fc4ef35 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] 10.222.0.40 "GET /compute/v2.1/servers/776ba545-27d5-41e9-84c9-6c9cfe4ad057" status: 200 len: 1316 microversion: 2.1 time: 2.406696 Oct 26 13:22:48.961251 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2330/4678] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:22:46 2022] GET /compute/v2.1/servers/776ba545-27d5-41e9-84c9-6c9cfe4ad057 => generated 1316 bytes in 2409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:22:49.177219 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1fa7d4b7-8b7c-4b96-8288-4b4d3f68af9f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:49.178651 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1fa7d4b7-8b7c-4b96-8288-4b4d3f68af9f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:22:49.225813 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1fa7d4b7-8b7c-4b96-8288-4b4d3f68af9f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:49.237133 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1fa7d4b7-8b7c-4b96-8288-4b4d3f68af9f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:49.242416 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1fa7d4b7-8b7c-4b96-8288-4b4d3f68af9f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:49.243694 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1fa7d4b7-8b7c-4b96-8288-4b4d3f68af9f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:49.244980 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1fa7d4b7-8b7c-4b96-8288-4b4d3f68af9f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:49.248333 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1fa7d4b7-8b7c-4b96-8288-4b4d3f68af9f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:49.997193 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-353a3ba8-6991-430d-89df-825eb3b049be tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:49.998425 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-353a3ba8-6991-430d-89df-825eb3b049be tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] [instance: 776ba545-27d5-41e9-84c9-6c9cfe4ad057] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:22:50.009330 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-353a3ba8-6991-430d-89df-825eb3b049be tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:50.020299 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-353a3ba8-6991-430d-89df-825eb3b049be tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:50.021663 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-353a3ba8-6991-430d-89df-825eb3b049be tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:50.023919 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-353a3ba8-6991-430d-89df-825eb3b049be tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:50.026632 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-353a3ba8-6991-430d-89df-825eb3b049be tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:50.027672 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-353a3ba8-6991-430d-89df-825eb3b049be tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:50.758249 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1fa7d4b7-8b7c-4b96-8288-4b4d3f68af9f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:22:50.779644 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1fa7d4b7-8b7c-4b96-8288-4b4d3f68af9f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245" status: 200 len: 1734 microversion: 2.1 time: 1.602202 Oct 26 13:22:50.782116 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2349/4679] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:22:49 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245 => generated 1734 bytes in 1611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:22:50.787969 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-353a3ba8-6991-430d-89df-825eb3b049be tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7919304c6da84ce6b86fb6893e72be7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75060adb546045de9116a81b28b62aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:22:50.797748 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-4deffccc-85ee-4f54-b007-7bb783d62c03 req-3f692863-11a4-40a5-91b7-054ab52e5e32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "776ba545-27d5-41e9-84c9-6c9cfe4ad057", "tag": "fbefbd79-84a7-4386-8c11-f0f236ce29d2"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:22:50.802584 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-353a3ba8-6991-430d-89df-825eb3b049be tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] 10.222.0.40 "GET /compute/v2.1/servers/776ba545-27d5-41e9-84c9-6c9cfe4ad057" status: 200 len: 1316 microversion: 2.1 time: 0.810387 Oct 26 13:22:50.823698 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2331/4680] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:22:49 2022] GET /compute/v2.1/servers/776ba545-27d5-41e9-84c9-6c9cfe4ad057 => generated 1316 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:22:50.848630 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-4deffccc-85ee-4f54-b007-7bb783d62c03 req-3f692863-11a4-40a5-91b7-054ab52e5e32 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:50.851882 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-4deffccc-85ee-4f54-b007-7bb783d62c03 req-3f692863-11a4-40a5-91b7-054ab52e5e32 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:50.854740 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-4deffccc-85ee-4f54-b007-7bb783d62c03 req-3f692863-11a4-40a5-91b7-054ab52e5e32 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:50.924347 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-4deffccc-85ee-4f54-b007-7bb783d62c03 req-3f692863-11a4-40a5-91b7-054ab52e5e32 service nova] Creating event network-changed:fbefbd79-84a7-4386-8c11-f0f236ce29d2 for instance 776ba545-27d5-41e9-84c9-6c9cfe4ad057 on n-h1-862686-1 Oct 26 13:22:50.942109 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-4deffccc-85ee-4f54-b007-7bb783d62c03 req-3f692863-11a4-40a5-91b7-054ab52e5e32 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158262 Oct 26 13:22:50.956538 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2350/4681] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:22:51.819525 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9e25e65c-45d0-4b23-a50b-1b26b073d767 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:51.820181 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9e25e65c-45d0-4b23-a50b-1b26b073d767 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:22:51.837764 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1fd55482-ecd4-430d-b8ab-50f45f77428a tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:51.838375 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1fd55482-ecd4-430d-b8ab-50f45f77428a tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] [instance: 776ba545-27d5-41e9-84c9-6c9cfe4ad057] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:22:51.865683 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9e25e65c-45d0-4b23-a50b-1b26b073d767 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:51.866769 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9e25e65c-45d0-4b23-a50b-1b26b073d767 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:51.867236 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9e25e65c-45d0-4b23-a50b-1b26b073d767 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:51.868265 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9e25e65c-45d0-4b23-a50b-1b26b073d767 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:51.874168 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9e25e65c-45d0-4b23-a50b-1b26b073d767 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:51.878367 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9e25e65c-45d0-4b23-a50b-1b26b073d767 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:51.900122 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1fd55482-ecd4-430d-b8ab-50f45f77428a tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:51.905180 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1fd55482-ecd4-430d-b8ab-50f45f77428a tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:51.905883 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1fd55482-ecd4-430d-b8ab-50f45f77428a tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:51.906627 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1fd55482-ecd4-430d-b8ab-50f45f77428a tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:51.907104 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1fd55482-ecd4-430d-b8ab-50f45f77428a tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:51.907535 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1fd55482-ecd4-430d-b8ab-50f45f77428a tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:52.479361 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9e25e65c-45d0-4b23-a50b-1b26b073d767 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:22:52.541669 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9e25e65c-45d0-4b23-a50b-1b26b073d767 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245" status: 200 len: 1734 microversion: 2.1 time: 0.723072 Oct 26 13:22:52.545675 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2332/4682] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:22:51 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245 => generated 1734 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:22:52.926036 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1fd55482-ecd4-430d-b8ab-50f45f77428a tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7919304c6da84ce6b86fb6893e72be7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75060adb546045de9116a81b28b62aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:22:52.938508 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1fd55482-ecd4-430d-b8ab-50f45f77428a tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] 10.222.0.40 "GET /compute/v2.1/servers/776ba545-27d5-41e9-84c9-6c9cfe4ad057" status: 200 len: 1316 microversion: 2.1 time: 1.108204 Oct 26 13:22:52.942388 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2351/4683] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:22:51 2022] GET /compute/v2.1/servers/776ba545-27d5-41e9-84c9-6c9cfe4ad057 => generated 1316 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:22:53.569276 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-23a4ea83-0557-4ed1-bdd6-1332ffcfa9f8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:53.573774 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-23a4ea83-0557-4ed1-bdd6-1332ffcfa9f8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:22:53.612243 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-23a4ea83-0557-4ed1-bdd6-1332ffcfa9f8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:53.613011 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-23a4ea83-0557-4ed1-bdd6-1332ffcfa9f8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:53.613705 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-23a4ea83-0557-4ed1-bdd6-1332ffcfa9f8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:53.614649 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-23a4ea83-0557-4ed1-bdd6-1332ffcfa9f8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:53.615279 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-23a4ea83-0557-4ed1-bdd6-1332ffcfa9f8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:53.615892 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-23a4ea83-0557-4ed1-bdd6-1332ffcfa9f8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:53.963252 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7bad9c3c-28c8-406f-a530-6e6c7c4f5276 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:53.966990 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7bad9c3c-28c8-406f-a530-6e6c7c4f5276 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] [instance: 776ba545-27d5-41e9-84c9-6c9cfe4ad057] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:22:53.982306 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7bad9c3c-28c8-406f-a530-6e6c7c4f5276 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:53.985281 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7bad9c3c-28c8-406f-a530-6e6c7c4f5276 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:53.987130 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7bad9c3c-28c8-406f-a530-6e6c7c4f5276 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:53.989402 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7bad9c3c-28c8-406f-a530-6e6c7c4f5276 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:53.990075 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7bad9c3c-28c8-406f-a530-6e6c7c4f5276 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:53.994286 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7bad9c3c-28c8-406f-a530-6e6c7c4f5276 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:54.508375 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-23a4ea83-0557-4ed1-bdd6-1332ffcfa9f8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:22:54.519147 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-23a4ea83-0557-4ed1-bdd6-1332ffcfa9f8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245" status: 200 len: 1734 microversion: 2.1 time: 0.954237 Oct 26 13:22:54.550607 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2333/4684] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:22:53 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245 => generated 1734 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:22:55.120299 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7bad9c3c-28c8-406f-a530-6e6c7c4f5276 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7919304c6da84ce6b86fb6893e72be7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75060adb546045de9116a81b28b62aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:22:55.129775 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7bad9c3c-28c8-406f-a530-6e6c7c4f5276 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] 10.222.0.40 "GET /compute/v2.1/servers/776ba545-27d5-41e9-84c9-6c9cfe4ad057" status: 200 len: 1316 microversion: 2.1 time: 1.170747 Oct 26 13:22:55.130376 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2352/4685] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:22:53 2022] GET /compute/v2.1/servers/776ba545-27d5-41e9-84c9-6c9cfe4ad057 => generated 1316 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:22:55.547430 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-310b341d-1bd0-4e3f-a68e-c22eb8828669 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:55.548375 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-310b341d-1bd0-4e3f-a68e-c22eb8828669 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:22:55.581213 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-310b341d-1bd0-4e3f-a68e-c22eb8828669 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:55.585466 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-310b341d-1bd0-4e3f-a68e-c22eb8828669 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:55.586265 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-310b341d-1bd0-4e3f-a68e-c22eb8828669 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:55.587225 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-310b341d-1bd0-4e3f-a68e-c22eb8828669 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:55.588725 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-310b341d-1bd0-4e3f-a68e-c22eb8828669 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:55.589380 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-310b341d-1bd0-4e3f-a68e-c22eb8828669 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:55.922213 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3cdd4c9d-e789-400f-a063-2a86c82fc3d1 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:55.924988 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3cdd4c9d-e789-400f-a063-2a86c82fc3d1 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:22:55.947550 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cdd4c9d-e789-400f-a063-2a86c82fc3d1 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:55.950135 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cdd4c9d-e789-400f-a063-2a86c82fc3d1 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:55.950726 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cdd4c9d-e789-400f-a063-2a86c82fc3d1 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:55.951580 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cdd4c9d-e789-400f-a063-2a86c82fc3d1 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:55.954140 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cdd4c9d-e789-400f-a063-2a86c82fc3d1 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:55.958186 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cdd4c9d-e789-400f-a063-2a86c82fc3d1 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:56.088179 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3cdd4c9d-e789-400f-a063-2a86c82fc3d1 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.162140 Oct 26 13:22:56.094685 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2353/4686] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:22:55 2022] GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6/os-volume_attachments => generated 197 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:22:56.120229 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-46711201-6c98-4978-8cb2-eb48ec101943 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:56.125143 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-46711201-6c98-4978-8cb2-eb48ec101943 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:22:56.166274 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46711201-6c98-4978-8cb2-eb48ec101943 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:56.171247 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46711201-6c98-4978-8cb2-eb48ec101943 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:56.176533 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46711201-6c98-4978-8cb2-eb48ec101943 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:56.184691 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46711201-6c98-4978-8cb2-eb48ec101943 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:56.186164 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46711201-6c98-4978-8cb2-eb48ec101943 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:56.186798 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46711201-6c98-4978-8cb2-eb48ec101943 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:56.221170 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-310b341d-1bd0-4e3f-a68e-c22eb8828669 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:22:56.223818 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:22:56.235328 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-310b341d-1bd0-4e3f-a68e-c22eb8828669 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245" status: 200 len: 1734 microversion: 2.1 time: 0.690137 Oct 26 13:22:56.258151 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2334/4687] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:22:55 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245 => generated 1734 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:22:56.267645 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-145316d4-6ea1-47ba-a0b9-2fc8d23a96e5 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:56.268897 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-145316d4-6ea1-47ba-a0b9-2fc8d23a96e5 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] [instance: 776ba545-27d5-41e9-84c9-6c9cfe4ad057] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:22:56.291002 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=27 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:22:56.292875 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-145316d4-6ea1-47ba-a0b9-2fc8d23a96e5 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:56.294058 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-145316d4-6ea1-47ba-a0b9-2fc8d23a96e5 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:56.303151 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-145316d4-6ea1-47ba-a0b9-2fc8d23a96e5 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:56.305814 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-145316d4-6ea1-47ba-a0b9-2fc8d23a96e5 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:56.306520 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-145316d4-6ea1-47ba-a0b9-2fc8d23a96e5 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:56.309705 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-145316d4-6ea1-47ba-a0b9-2fc8d23a96e5 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:56.385326 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-46711201-6c98-4978-8cb2-eb48ec101943 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6/os-volume_attachments/d96aeed7-23b5-4410-ac30-1edb45413387" status: 200 len: 194 microversion: 2.1 time: 0.288203 Oct 26 13:22:56.391372 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2354/4688] 10.222.0.40 () {58 vars in 1413 bytes} [Wed Oct 26 13:22:56 2022] GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6/os-volume_attachments/d96aeed7-23b5-4410-ac30-1edb45413387 => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:22:57.262377 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d1f3e58d-ef9b-4b5c-bfb7-f60140f76dc9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:57.263807 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d1f3e58d-ef9b-4b5c-bfb7-f60140f76dc9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:22:57.279455 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d1f3e58d-ef9b-4b5c-bfb7-f60140f76dc9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:57.288542 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d1f3e58d-ef9b-4b5c-bfb7-f60140f76dc9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:57.292236 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d1f3e58d-ef9b-4b5c-bfb7-f60140f76dc9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:57.296741 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d1f3e58d-ef9b-4b5c-bfb7-f60140f76dc9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:57.305520 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d1f3e58d-ef9b-4b5c-bfb7-f60140f76dc9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:57.308556 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d1f3e58d-ef9b-4b5c-bfb7-f60140f76dc9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:57.663501 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-145316d4-6ea1-47ba-a0b9-2fc8d23a96e5 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7919304c6da84ce6b86fb6893e72be7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75060adb546045de9116a81b28b62aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:22:57.675763 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-145316d4-6ea1-47ba-a0b9-2fc8d23a96e5 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] 10.222.0.40 "GET /compute/v2.1/servers/776ba545-27d5-41e9-84c9-6c9cfe4ad057" status: 200 len: 1316 microversion: 2.1 time: 1.416392 Oct 26 13:22:57.677380 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2335/4689] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:22:56 2022] GET /compute/v2.1/servers/776ba545-27d5-41e9-84c9-6c9cfe4ad057 => generated 1316 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:22:57.953401 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d1f3e58d-ef9b-4b5c-bfb7-f60140f76dc9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:22:57.964480 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d1f3e58d-ef9b-4b5c-bfb7-f60140f76dc9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245" status: 200 len: 1734 microversion: 2.1 time: 0.706705 Oct 26 13:22:57.965060 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2355/4690] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:22:57 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245 => generated 1734 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:22:58.703540 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-126db7cf-5e1e-4656-95aa-3d2511774fcf tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:58.704153 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-126db7cf-5e1e-4656-95aa-3d2511774fcf tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] [instance: 776ba545-27d5-41e9-84c9-6c9cfe4ad057] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:22:58.715935 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-126db7cf-5e1e-4656-95aa-3d2511774fcf tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:58.716430 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-126db7cf-5e1e-4656-95aa-3d2511774fcf tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:58.722351 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-126db7cf-5e1e-4656-95aa-3d2511774fcf tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:58.723390 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-126db7cf-5e1e-4656-95aa-3d2511774fcf tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:58.724025 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-126db7cf-5e1e-4656-95aa-3d2511774fcf tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:58.724612 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-126db7cf-5e1e-4656-95aa-3d2511774fcf tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:58.994781 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bf8d1d30-5f87-4221-ad4b-bcc5d23243c6 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:22:58.996361 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bf8d1d30-5f87-4221-ad4b-bcc5d23243c6 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:22:59.016979 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bf8d1d30-5f87-4221-ad4b-bcc5d23243c6 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:59.017560 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bf8d1d30-5f87-4221-ad4b-bcc5d23243c6 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:59.018300 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bf8d1d30-5f87-4221-ad4b-bcc5d23243c6 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:59.019091 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bf8d1d30-5f87-4221-ad4b-bcc5d23243c6 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:59.019576 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bf8d1d30-5f87-4221-ad4b-bcc5d23243c6 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:59.019991 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bf8d1d30-5f87-4221-ad4b-bcc5d23243c6 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:59.066835 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-126db7cf-5e1e-4656-95aa-3d2511774fcf tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7919304c6da84ce6b86fb6893e72be7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75060adb546045de9116a81b28b62aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:22:59.088756 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-126db7cf-5e1e-4656-95aa-3d2511774fcf tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] 10.222.0.40 "GET /compute/v2.1/servers/776ba545-27d5-41e9-84c9-6c9cfe4ad057" status: 200 len: 1316 microversion: 2.1 time: 0.389101 Oct 26 13:22:59.108741 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2336/4691] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:22:58 2022] GET /compute/v2.1/servers/776ba545-27d5-41e9-84c9-6c9cfe4ad057 => generated 1316 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:22:59.543407 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bf8d1d30-5f87-4221-ad4b-bcc5d23243c6 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:22:59.557539 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bf8d1d30-5f87-4221-ad4b-bcc5d23243c6 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245" status: 200 len: 1734 microversion: 2.1 time: 0.568576 Oct 26 13:22:59.584008 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2356/4692] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:22:58 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245 => generated 1734 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:22:59.915242 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-dc592c85-9666-43b1-80e9-e15c6ab884d1 req-51111753-dc01-4da3-968b-1be8eaa04cc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "776ba545-27d5-41e9-84c9-6c9cfe4ad057", "name": "network-vif-plugged", "status": "completed", "tag": "fbefbd79-84a7-4386-8c11-f0f236ce29d2"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:22:59.937475 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-dc592c85-9666-43b1-80e9-e15c6ab884d1 req-51111753-dc01-4da3-968b-1be8eaa04cc6 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:22:59.943186 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-dc592c85-9666-43b1-80e9-e15c6ab884d1 req-51111753-dc01-4da3-968b-1be8eaa04cc6 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:22:59.943982 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-dc592c85-9666-43b1-80e9-e15c6ab884d1 req-51111753-dc01-4da3-968b-1be8eaa04cc6 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:22:59.976203 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-dc592c85-9666-43b1-80e9-e15c6ab884d1 req-51111753-dc01-4da3-968b-1be8eaa04cc6 service nova] Creating event network-vif-plugged:fbefbd79-84a7-4386-8c11-f0f236ce29d2 for instance 776ba545-27d5-41e9-84c9-6c9cfe4ad057 on n-h1-862686-1 Oct 26 13:22:59.982445 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-dc592c85-9666-43b1-80e9-e15c6ab884d1 req-51111753-dc01-4da3-968b-1be8eaa04cc6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074096 Oct 26 13:22:59.984544 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2337/4693] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:23:00.114246 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-45d10faf-3b19-429a-9bfa-c1afbdc9298d tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:00.115770 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-45d10faf-3b19-429a-9bfa-c1afbdc9298d tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] [instance: 776ba545-27d5-41e9-84c9-6c9cfe4ad057] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:00.133156 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45d10faf-3b19-429a-9bfa-c1afbdc9298d tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:00.136064 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45d10faf-3b19-429a-9bfa-c1afbdc9298d tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:00.137692 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45d10faf-3b19-429a-9bfa-c1afbdc9298d tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:00.139185 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45d10faf-3b19-429a-9bfa-c1afbdc9298d tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:00.140053 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45d10faf-3b19-429a-9bfa-c1afbdc9298d tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:00.140701 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45d10faf-3b19-429a-9bfa-c1afbdc9298d tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:00.533637 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-017b5aa7-a1bd-48da-8293-a2bb3330f48d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f77eef2e-3520-40c9-8cbc-ed298ce31b9c"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:23:00.539988 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-45d10faf-3b19-429a-9bfa-c1afbdc9298d tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7919304c6da84ce6b86fb6893e72be7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75060adb546045de9116a81b28b62aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:00.551179 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-017b5aa7-a1bd-48da-8293-a2bb3330f48d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:00.558010 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-45d10faf-3b19-429a-9bfa-c1afbdc9298d tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] 10.222.0.40 "GET /compute/v2.1/servers/776ba545-27d5-41e9-84c9-6c9cfe4ad057" status: 200 len: 1316 microversion: 2.1 time: 0.447004 Oct 26 13:23:00.558682 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2357/4694] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:00 2022] GET /compute/v2.1/servers/776ba545-27d5-41e9-84c9-6c9cfe4ad057 => generated 1316 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:23:00.589510 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-017b5aa7-a1bd-48da-8293-a2bb3330f48d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:00.589964 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-017b5aa7-a1bd-48da-8293-a2bb3330f48d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:00.594062 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-017b5aa7-a1bd-48da-8293-a2bb3330f48d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:00.595304 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-017b5aa7-a1bd-48da-8293-a2bb3330f48d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:00.596056 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-017b5aa7-a1bd-48da-8293-a2bb3330f48d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:00.596658 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-017b5aa7-a1bd-48da-8293-a2bb3330f48d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:00.609320 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-18ea8b12-3f88-42a9-b9a0-bf01d6dc351f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:00.610080 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-18ea8b12-3f88-42a9-b9a0-bf01d6dc351f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:00.636998 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18ea8b12-3f88-42a9-b9a0-bf01d6dc351f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:00.637538 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18ea8b12-3f88-42a9-b9a0-bf01d6dc351f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:00.637996 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18ea8b12-3f88-42a9-b9a0-bf01d6dc351f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:00.644064 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18ea8b12-3f88-42a9-b9a0-bf01d6dc351f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:00.648665 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18ea8b12-3f88-42a9-b9a0-bf01d6dc351f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:00.650438 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18ea8b12-3f88-42a9-b9a0-bf01d6dc351f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:01.125759 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-18ea8b12-3f88-42a9-b9a0-bf01d6dc351f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:01.144631 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-18ea8b12-3f88-42a9-b9a0-bf01d6dc351f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245" status: 200 len: 1734 microversion: 2.1 time: 0.539599 Oct 26 13:23:01.151914 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2358/4695] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:00 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245 => generated 1734 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:23:01.247907 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-017b5aa7-a1bd-48da-8293-a2bb3330f48d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "POST /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.721382 Oct 26 13:23:01.263964 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2338/4696] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Oct 26 13:23:00 2022] POST /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6/os-volume_attachments => generated 194 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:23:01.588927 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c69c5a5c-79a7-4f8f-b13d-c24723a43b2a tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:01.589831 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c69c5a5c-79a7-4f8f-b13d-c24723a43b2a tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] [instance: 776ba545-27d5-41e9-84c9-6c9cfe4ad057] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:01.600828 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c69c5a5c-79a7-4f8f-b13d-c24723a43b2a tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:01.604447 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c69c5a5c-79a7-4f8f-b13d-c24723a43b2a tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:01.605231 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c69c5a5c-79a7-4f8f-b13d-c24723a43b2a tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:01.607057 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c69c5a5c-79a7-4f8f-b13d-c24723a43b2a tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:01.607826 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c69c5a5c-79a7-4f8f-b13d-c24723a43b2a tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:01.608600 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c69c5a5c-79a7-4f8f-b13d-c24723a43b2a tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:01.947431 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c69c5a5c-79a7-4f8f-b13d-c24723a43b2a tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7919304c6da84ce6b86fb6893e72be7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75060adb546045de9116a81b28b62aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:01.962216 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c69c5a5c-79a7-4f8f-b13d-c24723a43b2a tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] 10.222.0.40 "GET /compute/v2.1/servers/776ba545-27d5-41e9-84c9-6c9cfe4ad057" status: 200 len: 1505 microversion: 2.1 time: 0.379419 Oct 26 13:23:01.963537 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2359/4697] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:01 2022] GET /compute/v2.1/servers/776ba545-27d5-41e9-84c9-6c9cfe4ad057 => generated 1505 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:23:01.990575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5228f0e2-62de-41e2-86fc-bef04c80cf01 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:01.991403 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5228f0e2-62de-41e2-86fc-bef04c80cf01 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] [instance: 776ba545-27d5-41e9-84c9-6c9cfe4ad057] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:02.015742 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5228f0e2-62de-41e2-86fc-bef04c80cf01 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:02.021463 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5228f0e2-62de-41e2-86fc-bef04c80cf01 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:02.022514 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5228f0e2-62de-41e2-86fc-bef04c80cf01 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:02.023623 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5228f0e2-62de-41e2-86fc-bef04c80cf01 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:02.024234 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5228f0e2-62de-41e2-86fc-bef04c80cf01 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:02.025236 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5228f0e2-62de-41e2-86fc-bef04c80cf01 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:02.088471 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5228f0e2-62de-41e2-86fc-bef04c80cf01 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] 10.222.0.40 "GET /compute/v2.1/servers/776ba545-27d5-41e9-84c9-6c9cfe4ad057/ips" status: 200 len: 109 microversion: 2.1 time: 0.102914 Oct 26 13:23:02.091477 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2339/4698] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Oct 26 13:23:01 2022] GET /compute/v2.1/servers/776ba545-27d5-41e9-84c9-6c9cfe4ad057/ips => generated 109 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:23:02.104778 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5c02bb86-fee2-4da0-84da-eaae811f333a tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:02.105280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5c02bb86-fee2-4da0-84da-eaae811f333a tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] [instance: 776ba545-27d5-41e9-84c9-6c9cfe4ad057] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:02.118958 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c02bb86-fee2-4da0-84da-eaae811f333a tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:02.119460 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c02bb86-fee2-4da0-84da-eaae811f333a tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:02.121938 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c02bb86-fee2-4da0-84da-eaae811f333a tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:02.122890 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c02bb86-fee2-4da0-84da-eaae811f333a tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:02.124406 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c02bb86-fee2-4da0-84da-eaae811f333a tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:02.126092 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c02bb86-fee2-4da0-84da-eaae811f333a tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:02.180557 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1d587120-b873-45df-8125-4cc83e11736f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:02.181753 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1d587120-b873-45df-8125-4cc83e11736f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:02.197838 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d587120-b873-45df-8125-4cc83e11736f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:02.199578 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d587120-b873-45df-8125-4cc83e11736f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:02.200214 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d587120-b873-45df-8125-4cc83e11736f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:02.202339 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d587120-b873-45df-8125-4cc83e11736f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:02.202976 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d587120-b873-45df-8125-4cc83e11736f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:02.204148 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d587120-b873-45df-8125-4cc83e11736f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:02.207839 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5c02bb86-fee2-4da0-84da-eaae811f333a tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] 10.222.0.40 "GET /compute/v2.1/servers/776ba545-27d5-41e9-84c9-6c9cfe4ad057/ips" status: 200 len: 109 microversion: 2.1 time: 0.108249 Oct 26 13:23:02.211743 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2360/4699] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Oct 26 13:23:02 2022] GET /compute/v2.1/servers/776ba545-27d5-41e9-84c9-6c9cfe4ad057/ips => generated 109 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:23:02.226564 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9867bec4-770b-413b-b1c1-eeb37cd58c6e tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:02.227752 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9867bec4-770b-413b-b1c1-eeb37cd58c6e tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] [instance: 776ba545-27d5-41e9-84c9-6c9cfe4ad057] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:02.239503 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9867bec4-770b-413b-b1c1-eeb37cd58c6e tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:02.240671 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9867bec4-770b-413b-b1c1-eeb37cd58c6e tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:02.242328 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9867bec4-770b-413b-b1c1-eeb37cd58c6e tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:02.244254 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9867bec4-770b-413b-b1c1-eeb37cd58c6e tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:02.245090 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9867bec4-770b-413b-b1c1-eeb37cd58c6e tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:02.245966 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9867bec4-770b-413b-b1c1-eeb37cd58c6e tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:02.291825 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9867bec4-770b-413b-b1c1-eeb37cd58c6e tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] 10.222.0.40 "GET /compute/v2.1/servers/776ba545-27d5-41e9-84c9-6c9cfe4ad057/ips/tempest-ServerAddressesTestJSON-2059251050-network" status: 200 len: 94 microversion: 2.1 time: 0.072935 Oct 26 13:23:02.293091 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2361/4700] 10.222.0.40 () {58 vars in 1401 bytes} [Wed Oct 26 13:23:02 2022] GET /compute/v2.1/servers/776ba545-27d5-41e9-84c9-6c9cfe4ad057/ips/tempest-ServerAddressesTestJSON-2059251050-network => generated 94 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:23:02.306100 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-922e8782-87dd-489f-a855-f06bb4c3900c tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:02.307038 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-922e8782-87dd-489f-a855-f06bb4c3900c tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] [instance: 776ba545-27d5-41e9-84c9-6c9cfe4ad057] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:02.318635 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-922e8782-87dd-489f-a855-f06bb4c3900c tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:02.319677 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-922e8782-87dd-489f-a855-f06bb4c3900c tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:02.320723 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-922e8782-87dd-489f-a855-f06bb4c3900c tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:02.322067 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-922e8782-87dd-489f-a855-f06bb4c3900c tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:02.323222 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-922e8782-87dd-489f-a855-f06bb4c3900c tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:02.324033 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-922e8782-87dd-489f-a855-f06bb4c3900c tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:02.372033 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:23:02.383231 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-922e8782-87dd-489f-a855-f06bb4c3900c tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] [instance: 776ba545-27d5-41e9-84c9-6c9cfe4ad057] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:23:02.592012 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-922e8782-87dd-489f-a855-f06bb4c3900c tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] 10.222.0.40 "DELETE /compute/v2.1/servers/776ba545-27d5-41e9-84c9-6c9cfe4ad057" status: 204 len: 0 microversion: 2.1 time: 0.290863 Oct 26 13:23:02.593519 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2362/4701] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:23:02 2022] DELETE /compute/v2.1/servers/776ba545-27d5-41e9-84c9-6c9cfe4ad057 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:23:02.604587 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d32b0c47-b381-43f1-870f-8081f5837bda tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:02.606152 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d32b0c47-b381-43f1-870f-8081f5837bda tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] [instance: 776ba545-27d5-41e9-84c9-6c9cfe4ad057] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:02.622561 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d32b0c47-b381-43f1-870f-8081f5837bda tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:02.624069 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d32b0c47-b381-43f1-870f-8081f5837bda tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:02.625144 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d32b0c47-b381-43f1-870f-8081f5837bda tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:02.644436 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d32b0c47-b381-43f1-870f-8081f5837bda tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:02.646936 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d32b0c47-b381-43f1-870f-8081f5837bda tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:02.649981 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d32b0c47-b381-43f1-870f-8081f5837bda tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:02.659631 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1d587120-b873-45df-8125-4cc83e11736f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:02.677878 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1d587120-b873-45df-8125-4cc83e11736f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245" status: 200 len: 1734 microversion: 2.1 time: 0.499285 Oct 26 13:23:02.680313 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2340/4702] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:02 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245 => generated 1734 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:23:03.232373 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d32b0c47-b381-43f1-870f-8081f5837bda tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7919304c6da84ce6b86fb6893e72be7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75060adb546045de9116a81b28b62aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:03.243694 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d32b0c47-b381-43f1-870f-8081f5837bda tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] 10.222.0.40 "GET /compute/v2.1/servers/776ba545-27d5-41e9-84c9-6c9cfe4ad057" status: 200 len: 1511 microversion: 2.1 time: 0.645056 Oct 26 13:23:03.244288 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2363/4703] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:02 2022] GET /compute/v2.1/servers/776ba545-27d5-41e9-84c9-6c9cfe4ad057 => generated 1511 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:23:03.705080 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b6cb6980-c552-4d06-b7e0-623c5e448756 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:03.706560 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b6cb6980-c552-4d06-b7e0-623c5e448756 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:03.721809 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6cb6980-c552-4d06-b7e0-623c5e448756 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:03.722683 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6cb6980-c552-4d06-b7e0-623c5e448756 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:03.724415 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6cb6980-c552-4d06-b7e0-623c5e448756 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:03.726207 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6cb6980-c552-4d06-b7e0-623c5e448756 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:03.729227 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6cb6980-c552-4d06-b7e0-623c5e448756 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:03.730674 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6cb6980-c552-4d06-b7e0-623c5e448756 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:04.236050 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b6cb6980-c552-4d06-b7e0-623c5e448756 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:04.249179 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b6cb6980-c552-4d06-b7e0-623c5e448756 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245" status: 200 len: 1734 microversion: 2.1 time: 0.549706 Oct 26 13:23:04.251752 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2341/4704] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:03 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245 => generated 1734 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:23:04.268872 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-22818600-6916-4e52-a3fd-f2aa3d336bb6 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:04.270303 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-22818600-6916-4e52-a3fd-f2aa3d336bb6 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] [instance: 776ba545-27d5-41e9-84c9-6c9cfe4ad057] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:04.275109 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:23:04.308475 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22818600-6916-4e52-a3fd-f2aa3d336bb6 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:04.309099 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22818600-6916-4e52-a3fd-f2aa3d336bb6 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:04.311857 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22818600-6916-4e52-a3fd-f2aa3d336bb6 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:04.314169 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22818600-6916-4e52-a3fd-f2aa3d336bb6 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:04.318833 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22818600-6916-4e52-a3fd-f2aa3d336bb6 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:04.319384 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22818600-6916-4e52-a3fd-f2aa3d336bb6 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:04.913195 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-22818600-6916-4e52-a3fd-f2aa3d336bb6 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7919304c6da84ce6b86fb6893e72be7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75060adb546045de9116a81b28b62aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:04.929686 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-22818600-6916-4e52-a3fd-f2aa3d336bb6 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] 10.222.0.40 "GET /compute/v2.1/servers/776ba545-27d5-41e9-84c9-6c9cfe4ad057" status: 200 len: 1511 microversion: 2.1 time: 0.657992 Oct 26 13:23:04.930608 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2364/4705] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:04 2022] GET /compute/v2.1/servers/776ba545-27d5-41e9-84c9-6c9cfe4ad057 => generated 1511 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:23:05.280120 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7b0dea0c-7ece-4bb2-9867-bda7a1112084 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:05.280742 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7b0dea0c-7ece-4bb2-9867-bda7a1112084 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:05.295725 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b0dea0c-7ece-4bb2-9867-bda7a1112084 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:05.298079 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b0dea0c-7ece-4bb2-9867-bda7a1112084 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:05.298752 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b0dea0c-7ece-4bb2-9867-bda7a1112084 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:05.305281 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b0dea0c-7ece-4bb2-9867-bda7a1112084 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:05.306836 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b0dea0c-7ece-4bb2-9867-bda7a1112084 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:05.308772 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b0dea0c-7ece-4bb2-9867-bda7a1112084 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:05.552347 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-f51a43bf-3a9f-4530-9beb-1315d2613249 req-183d58bf-2724-4a4d-ba3e-18c38587f2bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "776ba545-27d5-41e9-84c9-6c9cfe4ad057", "name": "network-vif-deleted", "tag": "fbefbd79-84a7-4386-8c11-f0f236ce29d2"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:23:05.583928 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f51a43bf-3a9f-4530-9beb-1315d2613249 req-183d58bf-2724-4a4d-ba3e-18c38587f2bd service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:05.584519 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f51a43bf-3a9f-4530-9beb-1315d2613249 req-183d58bf-2724-4a4d-ba3e-18c38587f2bd service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:05.584970 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f51a43bf-3a9f-4530-9beb-1315d2613249 req-183d58bf-2724-4a4d-ba3e-18c38587f2bd service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:05.627253 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-f51a43bf-3a9f-4530-9beb-1315d2613249 req-183d58bf-2724-4a4d-ba3e-18c38587f2bd service nova] Creating event network-vif-deleted:fbefbd79-84a7-4386-8c11-f0f236ce29d2 for instance 776ba545-27d5-41e9-84c9-6c9cfe4ad057 on n-h1-862686-1 Oct 26 13:23:05.640604 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-f51a43bf-3a9f-4530-9beb-1315d2613249 req-183d58bf-2724-4a4d-ba3e-18c38587f2bd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095253 Oct 26 13:23:05.641224 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2365/4706] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:23:05.878414 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7b0dea0c-7ece-4bb2-9867-bda7a1112084 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:05.892875 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7b0dea0c-7ece-4bb2-9867-bda7a1112084 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245" status: 200 len: 1734 microversion: 2.1 time: 0.617760 Oct 26 13:23:05.896008 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2342/4707] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:05 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245 => generated 1734 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:23:05.963443 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-18e22c51-824a-49f3-9807-c42af3adab43 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:05.968286 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-18e22c51-824a-49f3-9807-c42af3adab43 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] [instance: 776ba545-27d5-41e9-84c9-6c9cfe4ad057] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:05.985593 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18e22c51-824a-49f3-9807-c42af3adab43 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:05.989184 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18e22c51-824a-49f3-9807-c42af3adab43 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:05.990199 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18e22c51-824a-49f3-9807-c42af3adab43 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:05.993360 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18e22c51-824a-49f3-9807-c42af3adab43 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:05.994958 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18e22c51-824a-49f3-9807-c42af3adab43 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:05.996471 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18e22c51-824a-49f3-9807-c42af3adab43 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:06.095226 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18e22c51-824a-49f3-9807-c42af3adab43 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:06.096608 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18e22c51-824a-49f3-9807-c42af3adab43 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:06.097454 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18e22c51-824a-49f3-9807-c42af3adab43 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:06.101586 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-18e22c51-824a-49f3-9807-c42af3adab43 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lazy-loading 'fault' on Instance uuid 776ba545-27d5-41e9-84c9-6c9cfe4ad057 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:23:06.375059 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-18e22c51-824a-49f3-9807-c42af3adab43 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7919304c6da84ce6b86fb6893e72be7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75060adb546045de9116a81b28b62aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:06.385191 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-18e22c51-824a-49f3-9807-c42af3adab43 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] 10.222.0.40 "GET /compute/v2.1/servers/776ba545-27d5-41e9-84c9-6c9cfe4ad057" status: 200 len: 1306 microversion: 2.1 time: 0.428810 Oct 26 13:23:06.385837 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2366/4708] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:05 2022] GET /compute/v2.1/servers/776ba545-27d5-41e9-84c9-6c9cfe4ad057 => generated 1306 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:23:06.919335 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6afdd749-836c-4770-9566-a71dc9f6b1fd tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:06.920082 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6afdd749-836c-4770-9566-a71dc9f6b1fd tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:06.942223 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6afdd749-836c-4770-9566-a71dc9f6b1fd tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:06.943573 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6afdd749-836c-4770-9566-a71dc9f6b1fd tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:06.944907 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6afdd749-836c-4770-9566-a71dc9f6b1fd tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:06.946660 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6afdd749-836c-4770-9566-a71dc9f6b1fd tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:06.948556 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6afdd749-836c-4770-9566-a71dc9f6b1fd tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:06.952394 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6afdd749-836c-4770-9566-a71dc9f6b1fd tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:07.414539 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-48ff39b9-69b3-4bd7-aaad-64a392bc71a9 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:07.415821 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-48ff39b9-69b3-4bd7-aaad-64a392bc71a9 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] [instance: 776ba545-27d5-41e9-84c9-6c9cfe4ad057] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:07.429172 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48ff39b9-69b3-4bd7-aaad-64a392bc71a9 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:07.429714 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48ff39b9-69b3-4bd7-aaad-64a392bc71a9 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:07.430167 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48ff39b9-69b3-4bd7-aaad-64a392bc71a9 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:07.430886 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48ff39b9-69b3-4bd7-aaad-64a392bc71a9 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:07.444777 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48ff39b9-69b3-4bd7-aaad-64a392bc71a9 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:07.446111 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48ff39b9-69b3-4bd7-aaad-64a392bc71a9 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:07.488857 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-48ff39b9-69b3-4bd7-aaad-64a392bc71a9 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] HTTP exception thrown: Instance 776ba545-27d5-41e9-84c9-6c9cfe4ad057 could not be found. Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-48ff39b9-69b3-4bd7-aaad-64a392bc71a9 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Request method failure captured: Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/776ba545-27d5-41e9-84c9-6c9cfe4ad057 HTTP/1.1 Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTSZOnvdQCEm9T2eZ7vVmv5tHLNkd1TGQnQoghTH4Fk4Q-wTLxq49mcTiS0YTreSqa2wopNqinTchNqlml1hOez9dIAFFdMKnhdCa9vIQVwUTVhyapcR9-oT4WGo9lM6fepZin3E4P-dvD4O6DE0jXeowfIgPE-_GgR3L4fAv-R3BZQ Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 75060adb546045de9116a81b28b62aaa Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServerAddressesTestJSON-437684473 Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/75060adb546045de9116a81b28b62aaa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/75060adb546045de9116a81b28b62aaa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_75060adb546045de9116a81b28b62aaa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/75060adb546045de9116a81b28b62aaa"}]}] Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServerAddressesTestJSON-437684473 Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 75060adb546045de9116a81b28b62aaa Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServerAddressesTestJSON-437684473 Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServerAddressesTestJSON-437684473-project Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 7919304c6da84ce6b86fb6893e72be7e Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServerAddressesTestJSON-437684473-project Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 776ba545-27d5-41e9-84c9-6c9cfe4ad057 could not be found. Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '776ba545-27d5-41e9-84c9-6c9cfe4ad057'} Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 776ba545-27d5-41e9-84c9-6c9cfe4ad057 could not be found. Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 776ba545-27d5-41e9-84c9-6c9cfe4ad057 could not be found. Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:23:07.494905 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:23:07.500100 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:23:07.500100 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:23:07.500100 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:23:07.500100 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:23:07.500100 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:23:07.500100 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 776ba545-27d5-41e9-84c9-6c9cfe4ad057 could not be found. Oct 26 13:23:07.500100 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:23:07.500100 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-48ff39b9-69b3-4bd7-aaad-64a392bc71a9 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] Returning 404 to user: Instance 776ba545-27d5-41e9-84c9-6c9cfe4ad057 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:23:07.500100 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-48ff39b9-69b3-4bd7-aaad-64a392bc71a9 tempest-ServerAddressesTestJSON-437684473 tempest-ServerAddressesTestJSON-437684473-project] 10.222.0.40 "GET /compute/v2.1/servers/776ba545-27d5-41e9-84c9-6c9cfe4ad057" status: 404 len: 111 microversion: 2.1 time: 0.086126 Oct 26 13:23:07.503065 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2367/4709] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:07 2022] GET /compute/v2.1/servers/776ba545-27d5-41e9-84c9-6c9cfe4ad057 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:23:07.880216 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6afdd749-836c-4770-9566-a71dc9f6b1fd tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:07.890442 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6afdd749-836c-4770-9566-a71dc9f6b1fd tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245" status: 200 len: 1734 microversion: 2.1 time: 0.975099 Oct 26 13:23:07.903800 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2343/4710] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:06 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245 => generated 1734 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:23:08.932697 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e626feec-4a5b-43cb-93cf-8bc4a285f9c4 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:08.934286 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e626feec-4a5b-43cb-93cf-8bc4a285f9c4 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:08.947104 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e626feec-4a5b-43cb-93cf-8bc4a285f9c4 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:08.951260 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e626feec-4a5b-43cb-93cf-8bc4a285f9c4 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:08.952611 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e626feec-4a5b-43cb-93cf-8bc4a285f9c4 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:08.954111 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e626feec-4a5b-43cb-93cf-8bc4a285f9c4 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:08.957911 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e626feec-4a5b-43cb-93cf-8bc4a285f9c4 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:08.959078 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e626feec-4a5b-43cb-93cf-8bc4a285f9c4 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:09.363130 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e626feec-4a5b-43cb-93cf-8bc4a285f9c4 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:09.386266 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e626feec-4a5b-43cb-93cf-8bc4a285f9c4 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245" status: 200 len: 1734 microversion: 2.1 time: 0.446199 Oct 26 13:23:09.388875 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2368/4711] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:08 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245 => generated 1734 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:23:10.415009 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a7ddc553-637d-413b-97d8-462f6d0280d3 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:10.415009 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a7ddc553-637d-413b-97d8-462f6d0280d3 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:10.428360 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7ddc553-637d-413b-97d8-462f6d0280d3 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:10.428866 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7ddc553-637d-413b-97d8-462f6d0280d3 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:10.429314 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7ddc553-637d-413b-97d8-462f6d0280d3 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:10.431953 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7ddc553-637d-413b-97d8-462f6d0280d3 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:10.432603 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7ddc553-637d-413b-97d8-462f6d0280d3 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:10.433197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7ddc553-637d-413b-97d8-462f6d0280d3 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:10.869717 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a7ddc553-637d-413b-97d8-462f6d0280d3 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:10.901930 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a7ddc553-637d-413b-97d8-462f6d0280d3 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245" status: 200 len: 1734 microversion: 2.1 time: 0.491765 Oct 26 13:23:10.902879 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2344/4712] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:10 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245 => generated 1734 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:23:11.932658 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-82f034e6-0075-4e98-96f2-8885b979b973 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:11.933396 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-82f034e6-0075-4e98-96f2-8885b979b973 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:11.943711 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-82f034e6-0075-4e98-96f2-8885b979b973 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:11.955240 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-82f034e6-0075-4e98-96f2-8885b979b973 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:11.956947 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-82f034e6-0075-4e98-96f2-8885b979b973 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:11.957812 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-82f034e6-0075-4e98-96f2-8885b979b973 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:11.958459 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-82f034e6-0075-4e98-96f2-8885b979b973 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:11.959021 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-82f034e6-0075-4e98-96f2-8885b979b973 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:13.638926 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-82f034e6-0075-4e98-96f2-8885b979b973 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:13.656587 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-82f034e6-0075-4e98-96f2-8885b979b973 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245" status: 200 len: 1714 microversion: 2.1 time: 1.727969 Oct 26 13:23:13.663019 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2369/4713] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:11 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245 => generated 1714 bytes in 1735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:23:13.964661 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-432ba290-68e2-4d74-8f11-2e6984024f7e tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:13.965923 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-432ba290-68e2-4d74-8f11-2e6984024f7e tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:13.977738 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-432ba290-68e2-4d74-8f11-2e6984024f7e tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:13.995244 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-432ba290-68e2-4d74-8f11-2e6984024f7e tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:13.996987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-432ba290-68e2-4d74-8f11-2e6984024f7e tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:13.999844 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-432ba290-68e2-4d74-8f11-2e6984024f7e tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:14.005331 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-432ba290-68e2-4d74-8f11-2e6984024f7e tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:14.011200 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-432ba290-68e2-4d74-8f11-2e6984024f7e tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:14.280200 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-432ba290-68e2-4d74-8f11-2e6984024f7e tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] HTTP exception thrown: Cannot 'detach_volume' instance b93fff60-64e6-436d-9390-03d80438b245 while it is in vm_state rescued Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-432ba290-68e2-4d74-8f11-2e6984024f7e tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Request method failure captured: Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245/os-volume_attachments/5f482485-b484-48ff-a775-3f47e4aad476 HTTP/1.1 Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTPjOuLV_n1DR58OZOmgbin2ud11sLWXOml70eL6_Yw9nM-eYNoCKOyZp3mck381-99yxZlLhlu2g6vQAmqZcUDv2ExrohfYX5ori3eOe3Uf6RO52e_TYIFS_DlKFRRKYqEp1KNMktjZRMuKeogboZRQrwA8baF1wLatF4_VyxhzXdo Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 9cdd45be745d4828b5a111472254156c Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1015154874 Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9cdd45be745d4828b5a111472254156c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9cdd45be745d4828b5a111472254156c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9cdd45be745d4828b5a111472254156c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9cdd45be745d4828b5a111472254156c"}]}] Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1015154874 Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 9cdd45be745d4828b5a111472254156c Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1015154874 Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServerRescueNegativeTestJSON-1015154874-project Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 363fc117da70484f9d8cf2040e8391e4 Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1015154874-project Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: exception: Cannot 'detach_volume' instance b93fff60-64e6-436d-9390-03d80438b245 while it is in vm_state rescued Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'server_id': 'b93fff60-64e6-436d-9390-03d80438b245', 'id': '5f482485-b484-48ff-a775-3f47e4aad476'} Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b93fff60-64e6-436d-9390-03d80438b245 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance b93fff60-64e6-436d-9390-03d80438b245 while it is in vm_state rescued Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:23:14.287182 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:23:14.291751 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:23:14.291751 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:23:14.291751 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:23:14.291751 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:23:14.291751 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance b93fff60-64e6-436d-9390-03d80438b245 while it is in vm_state rescued Oct 26 13:23:14.291751 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:23:14.297789 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-432ba290-68e2-4d74-8f11-2e6984024f7e tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Returning 409 to user: Cannot 'detach_volume' instance b93fff60-64e6-436d-9390-03d80438b245 while it is in vm_state rescued {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:23:14.300995 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-432ba290-68e2-4d74-8f11-2e6984024f7e tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245/os-volume_attachments/5f482485-b484-48ff-a775-3f47e4aad476" status: 409 len: 152 microversion: 2.1 time: 0.340690 Oct 26 13:23:14.303310 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2345/4714] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Oct 26 13:23:13 2022] DELETE /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245/os-volume_attachments/5f482485-b484-48ff-a775-3f47e4aad476 => generated 152 bytes in 344 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:23:14.314135 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2e92344a-55cd-4a55-bb82-8d243d6d3e2b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:23:14.317393 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2e92344a-55cd-4a55-bb82-8d243d6d3e2b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:14.338067 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e92344a-55cd-4a55-bb82-8d243d6d3e2b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:14.339544 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e92344a-55cd-4a55-bb82-8d243d6d3e2b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:14.342079 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e92344a-55cd-4a55-bb82-8d243d6d3e2b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:14.344358 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e92344a-55cd-4a55-bb82-8d243d6d3e2b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:14.345301 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e92344a-55cd-4a55-bb82-8d243d6d3e2b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:14.348224 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e92344a-55cd-4a55-bb82-8d243d6d3e2b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:14.497731 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2e92344a-55cd-4a55-bb82-8d243d6d3e2b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "POST /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245/action" status: 202 len: 0 microversion: 2.1 time: 0.188334 Oct 26 13:23:14.498742 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2370/4715] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:23:14 2022] POST /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:23:14.508447 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e58c9286-898b-49b5-8686-7487a1c8613c tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:14.509622 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e58c9286-898b-49b5-8686-7487a1c8613c tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:14.520453 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e58c9286-898b-49b5-8686-7487a1c8613c tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:14.522776 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e58c9286-898b-49b5-8686-7487a1c8613c tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:14.527348 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e58c9286-898b-49b5-8686-7487a1c8613c tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:14.528383 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e58c9286-898b-49b5-8686-7487a1c8613c tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:14.529046 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e58c9286-898b-49b5-8686-7487a1c8613c tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:14.529758 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e58c9286-898b-49b5-8686-7487a1c8613c tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:15.681800 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e58c9286-898b-49b5-8686-7487a1c8613c tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:15.701228 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e58c9286-898b-49b5-8686-7487a1c8613c tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245" status: 200 len: 1722 microversion: 2.1 time: 1.197886 Oct 26 13:23:15.715699 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2346/4716] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:14 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245 => generated 1722 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:23:16.745010 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8d9ec9de-b1d6-4b9e-84fc-77cf00634a49 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:16.746421 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8d9ec9de-b1d6-4b9e-84fc-77cf00634a49 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:16.762131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d9ec9de-b1d6-4b9e-84fc-77cf00634a49 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:16.763078 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d9ec9de-b1d6-4b9e-84fc-77cf00634a49 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:16.763433 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d9ec9de-b1d6-4b9e-84fc-77cf00634a49 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:16.764288 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d9ec9de-b1d6-4b9e-84fc-77cf00634a49 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:16.767009 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d9ec9de-b1d6-4b9e-84fc-77cf00634a49 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:16.768713 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d9ec9de-b1d6-4b9e-84fc-77cf00634a49 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:18.001801 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8d9ec9de-b1d6-4b9e-84fc-77cf00634a49 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:18.014282 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8d9ec9de-b1d6-4b9e-84fc-77cf00634a49 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245" status: 200 len: 1722 microversion: 2.1 time: 1.273526 Oct 26 13:23:18.017962 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2371/4717] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:16 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245 => generated 1722 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:23:19.042704 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4bb0e5ab-37f5-401e-ba1e-9fcbcd60373d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:19.044537 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4bb0e5ab-37f5-401e-ba1e-9fcbcd60373d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:19.052682 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4bb0e5ab-37f5-401e-ba1e-9fcbcd60373d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:19.053538 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4bb0e5ab-37f5-401e-ba1e-9fcbcd60373d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:19.054217 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4bb0e5ab-37f5-401e-ba1e-9fcbcd60373d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:19.055169 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4bb0e5ab-37f5-401e-ba1e-9fcbcd60373d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:19.055851 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4bb0e5ab-37f5-401e-ba1e-9fcbcd60373d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:19.056504 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4bb0e5ab-37f5-401e-ba1e-9fcbcd60373d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:19.354571 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4bb0e5ab-37f5-401e-ba1e-9fcbcd60373d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:19.365934 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4bb0e5ab-37f5-401e-ba1e-9fcbcd60373d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245" status: 200 len: 1722 microversion: 2.1 time: 0.327579 Oct 26 13:23:19.383962 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2347/4718] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:19 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245 => generated 1722 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:23:20.404621 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e790efd3-2962-4456-b473-c3b0d1353822 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:20.406850 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e790efd3-2962-4456-b473-c3b0d1353822 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:20.417683 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e790efd3-2962-4456-b473-c3b0d1353822 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:20.418759 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e790efd3-2962-4456-b473-c3b0d1353822 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:20.419433 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e790efd3-2962-4456-b473-c3b0d1353822 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:20.424750 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e790efd3-2962-4456-b473-c3b0d1353822 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:20.426757 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e790efd3-2962-4456-b473-c3b0d1353822 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:20.428227 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e790efd3-2962-4456-b473-c3b0d1353822 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:21.167046 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-676808ff-39e4-4355-8cd2-e0fba5f73c08 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:21.170616 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-676808ff-39e4-4355-8cd2-e0fba5f73c08 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:21.196205 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-676808ff-39e4-4355-8cd2-e0fba5f73c08 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:21.196873 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-676808ff-39e4-4355-8cd2-e0fba5f73c08 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:21.197611 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-676808ff-39e4-4355-8cd2-e0fba5f73c08 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:21.199002 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-676808ff-39e4-4355-8cd2-e0fba5f73c08 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:21.202168 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-676808ff-39e4-4355-8cd2-e0fba5f73c08 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:21.202739 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-676808ff-39e4-4355-8cd2-e0fba5f73c08 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:21.356064 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-676808ff-39e4-4355-8cd2-e0fba5f73c08 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.192914 Oct 26 13:23:21.361695 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2348/4719] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:23:21 2022] GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6/os-volume_attachments => generated 371 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:23:21.501188 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7e1b53ec-08ff-43d0-8fe7-5f8a680a7c77 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:21.502593 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7e1b53ec-08ff-43d0-8fe7-5f8a680a7c77 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:21.513565 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e1b53ec-08ff-43d0-8fe7-5f8a680a7c77 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:21.520429 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e1b53ec-08ff-43d0-8fe7-5f8a680a7c77 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:21.523737 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e1b53ec-08ff-43d0-8fe7-5f8a680a7c77 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:21.528186 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e1b53ec-08ff-43d0-8fe7-5f8a680a7c77 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:21.531881 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e1b53ec-08ff-43d0-8fe7-5f8a680a7c77 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:21.535221 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e1b53ec-08ff-43d0-8fe7-5f8a680a7c77 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:21.650307 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e790efd3-2962-4456-b473-c3b0d1353822 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:21.676317 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e790efd3-2962-4456-b473-c3b0d1353822 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245" status: 200 len: 1728 microversion: 2.1 time: 1.275410 Oct 26 13:23:21.681707 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2372/4720] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:20 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245 => generated 1728 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:23:21.686837 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7e1b53ec-08ff-43d0-8fe7-5f8a680a7c77 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6/os-volume_attachments/d96aeed7-23b5-4410-ac30-1edb45413387" status: 200 len: 194 microversion: 2.1 time: 0.189666 Oct 26 13:23:21.695689 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2349/4721] 10.222.0.40 () {58 vars in 1413 bytes} [Wed Oct 26 13:23:21 2022] GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6/os-volume_attachments/d96aeed7-23b5-4410-ac30-1edb45413387 => generated 194 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:23:21.703509 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4f997612-371e-4cfa-acae-9c5e0bfb577e tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:21.714376 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9997a4da-0465-4e10-bdbb-66525da2ccfd tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:21.716502 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4f997612-371e-4cfa-acae-9c5e0bfb577e tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:21.738538 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9997a4da-0465-4e10-bdbb-66525da2ccfd tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:21.750959 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f997612-371e-4cfa-acae-9c5e0bfb577e tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:21.751908 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f997612-371e-4cfa-acae-9c5e0bfb577e tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:21.752589 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f997612-371e-4cfa-acae-9c5e0bfb577e tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:21.758360 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f997612-371e-4cfa-acae-9c5e0bfb577e tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:21.760664 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f997612-371e-4cfa-acae-9c5e0bfb577e tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:21.764987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9997a4da-0465-4e10-bdbb-66525da2ccfd tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:21.767252 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f997612-371e-4cfa-acae-9c5e0bfb577e tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:21.788249 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9997a4da-0465-4e10-bdbb-66525da2ccfd tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:21.788899 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9997a4da-0465-4e10-bdbb-66525da2ccfd tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:21.792683 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9997a4da-0465-4e10-bdbb-66525da2ccfd tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:21.798935 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9997a4da-0465-4e10-bdbb-66525da2ccfd tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:21.807195 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9997a4da-0465-4e10-bdbb-66525da2ccfd tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:22.090935 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-4f997612-371e-4cfa-acae-9c5e0bfb577e tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lazy-loading 'services' on Instance uuid 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:23:22.441430 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9997a4da-0465-4e10-bdbb-66525da2ccfd tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.735580 Oct 26 13:23:22.443368 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2350/4722] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 26 13:23:21 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245/os-interface => generated 284 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:23:22.476104 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4f997612-371e-4cfa-acae-9c5e0bfb577e tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "DELETE /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6/os-volume_attachments/d96aeed7-23b5-4410-ac30-1edb45413387" status: 202 len: 0 microversion: 2.1 time: 0.776415 Oct 26 13:23:22.476719 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2373/4723] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Oct 26 13:23:21 2022] DELETE /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6/os-volume_attachments/d96aeed7-23b5-4410-ac30-1edb45413387 => generated 0 bytes in 778 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:23:24.961200 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-66aeb59c-3a60-4445-970f-42533453d9f4 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Action: 'create', calling method: .version_select at 0x7f67322c9e50>, body: {"keypair": {"name": "tempest-keypair-1431975419", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNE0Bj+zIoEgeHKZps2hwJVGD7ghuHmtciyk6a5egoBdF4ZCTUhG/n+lC+rHxJG9hBTSam7baPx6IOvyCdRksYTNCoE13EmEa3TqigsN2kE4e2kHFe0S8hlNlz/eG8QNPA=="}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:23:25.010795 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-66aeb59c-3a60-4445-970f-42533453d9f4 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Getting quotas for project d450288d3d6249b385056f524c1e5bdc. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:23:25.023358 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-66aeb59c-3a60-4445-970f-42533453d9f4 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Getting quotas for user d20f4b72866e4fce93253f71822830d2 and project d450288d3d6249b385056f524c1e5bdc. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:23:25.098924 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-66aeb59c-3a60-4445-970f-42533453d9f4 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.691728 Oct 26 13:23:25.099880 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2351/4724] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 13:23:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:23:26.219268 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-fcd7fe26-f767-468c-825e-189945000996 req-e0bb6a9f-d36b-4a6b-86bf-325c9a4cd2af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b93fff60-64e6-436d-9390-03d80438b245", "tag": "85286063-c895-4327-af58-6433dca2108f"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:23:26.249021 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-fcd7fe26-f767-468c-825e-189945000996 req-e0bb6a9f-d36b-4a6b-86bf-325c9a4cd2af service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:26.249531 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-fcd7fe26-f767-468c-825e-189945000996 req-e0bb6a9f-d36b-4a6b-86bf-325c9a4cd2af service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:26.249976 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-fcd7fe26-f767-468c-825e-189945000996 req-e0bb6a9f-d36b-4a6b-86bf-325c9a4cd2af service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:26.275685 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-fcd7fe26-f767-468c-825e-189945000996 req-e0bb6a9f-d36b-4a6b-86bf-325c9a4cd2af service nova] Creating event network-changed:85286063-c895-4327-af58-6433dca2108f for instance b93fff60-64e6-436d-9390-03d80438b245 on n-h2-862686-1 Oct 26 13:23:26.289786 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-fcd7fe26-f767-468c-825e-189945000996 req-e0bb6a9f-d36b-4a6b-86bf-325c9a4cd2af service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074862 Oct 26 13:23:26.291273 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2374/4725] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:23:28.334512 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-2b7c703b-4d11-4f40-b396-aa7018790213 req-5a5cf29d-b00e-4f43-968c-24bc457a4cf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b93fff60-64e6-436d-9390-03d80438b245", "tag": "85286063-c895-4327-af58-6433dca2108f"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:23:28.358476 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:23:28.367142 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2b7c703b-4d11-4f40-b396-aa7018790213 req-5a5cf29d-b00e-4f43-968c-24bc457a4cf4 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:28.368021 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2b7c703b-4d11-4f40-b396-aa7018790213 req-5a5cf29d-b00e-4f43-968c-24bc457a4cf4 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:28.369255 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2b7c703b-4d11-4f40-b396-aa7018790213 req-5a5cf29d-b00e-4f43-968c-24bc457a4cf4 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:28.385306 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:23:28.408915 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-2b7c703b-4d11-4f40-b396-aa7018790213 req-5a5cf29d-b00e-4f43-968c-24bc457a4cf4 service nova] Creating event network-changed:85286063-c895-4327-af58-6433dca2108f for instance b93fff60-64e6-436d-9390-03d80438b245 on n-h2-862686-1 Oct 26 13:23:28.423296 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-2b7c703b-4d11-4f40-b396-aa7018790213 req-5a5cf29d-b00e-4f43-968c-24bc457a4cf4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095066 Oct 26 13:23:28.423422 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2352/4726] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:23:29.616930 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f9cff55c-9a88-45fb-b33a-0533261921ce tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Action: 'create', calling method: .version_select at 0x7f6736922040>, body: {"keypair": {"name": "tempest-keypair-68516749", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfMoRh8yPD/3GpEq2rjDvXr/UQ25aPQhJEOki3AhMXOTiUCJOgMeKaIoCbqbDUsJQcmHCFcPRztXoMGf02EYHSoFsRG3+TQ7OHRBMzOCFjsTTbLP1LFQut3AIVdsG+AIw=="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:23:29.657980 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-f9cff55c-9a88-45fb-b33a-0533261921ce tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Getting quotas for project c0d1b1d2fe374ee5806eeee18712219f. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:23:29.696279 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-f9cff55c-9a88-45fb-b33a-0533261921ce tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Getting quotas for user 3e9ff5a884f1416886f26a80c5b87b18 and project c0d1b1d2fe374ee5806eeee18712219f. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:23:29.800733 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f9cff55c-9a88-45fb-b33a-0533261921ce tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.421793 Oct 26 13:23:29.801921 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2375/4727] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 13:23:29 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:23:32.771040 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-151e3953-2b40-4be6-bfd2-43325883e531 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:32.772150 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-151e3953-2b40-4be6-bfd2-43325883e531 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:32.807059 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-151e3953-2b40-4be6-bfd2-43325883e531 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:32.808151 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-151e3953-2b40-4be6-bfd2-43325883e531 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:32.808872 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-151e3953-2b40-4be6-bfd2-43325883e531 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:32.810005 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-151e3953-2b40-4be6-bfd2-43325883e531 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:32.810843 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-151e3953-2b40-4be6-bfd2-43325883e531 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:32.811626 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-151e3953-2b40-4be6-bfd2-43325883e531 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:32.938033 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-151e3953-2b40-4be6-bfd2-43325883e531 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6/os-volume_attachments/f77eef2e-3520-40c9-8cbc-ed298ce31b9c" status: 200 len: 194 microversion: 2.1 time: 0.174661 Oct 26 13:23:32.940328 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2353/4728] 10.222.0.40 () {58 vars in 1413 bytes} [Wed Oct 26 13:23:32 2022] GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6/os-volume_attachments/f77eef2e-3520-40c9-8cbc-ed298ce31b9c => generated 194 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:23:32.967326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f7436018-f1f0-4732-82e2-4cc4c0356923 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:32.972817 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f7436018-f1f0-4732-82e2-4cc4c0356923 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:32.982458 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7436018-f1f0-4732-82e2-4cc4c0356923 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:32.984510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7436018-f1f0-4732-82e2-4cc4c0356923 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:32.985129 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7436018-f1f0-4732-82e2-4cc4c0356923 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:32.987920 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7436018-f1f0-4732-82e2-4cc4c0356923 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:32.989879 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7436018-f1f0-4732-82e2-4cc4c0356923 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:32.991690 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7436018-f1f0-4732-82e2-4cc4c0356923 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:33.002123 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:23:33.027466 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-61134621-1263-41cb-9342-07170ebedf26 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-988554645", "imageRef": "75fd5634-5d65-4a85-b5be-d959ecda330e", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "7e6f5b40-f3aa-434d-bc39-fd24e3e44f8e"}], "security_groups": [{"name": "tempest-securitygroup--466892177"}], "key_name": "tempest-keypair-1431975419", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:23:33.186639 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-f7436018-f1f0-4732-82e2-4cc4c0356923 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lazy-loading 'services' on Instance uuid 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:23:33.388524 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f7436018-f1f0-4732-82e2-4cc4c0356923 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "DELETE /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6/os-volume_attachments/f77eef2e-3520-40c9-8cbc-ed298ce31b9c" status: 202 len: 0 microversion: 2.1 time: 0.441716 Oct 26 13:23:33.389988 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2376/4729] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Oct 26 13:23:32 2022] DELETE /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6/os-volume_attachments/f77eef2e-3520-40c9-8cbc-ed298ce31b9c => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:23:33.542695 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-61134621-1263-41cb-9342-07170ebedf26 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] validate_networks() for [('7e6f5b40-f3aa-434d-bc39-fd24e3e44f8e', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:23:35.051894 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=4 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:23:35.318301 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-61134621-1263-41cb-9342-07170ebedf26 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:23:35.319022 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-61134621-1263-41cb-9342-07170ebedf26 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:23:35.319765 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-61134621-1263-41cb-9342-07170ebedf26 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:23:35.320378 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-61134621-1263-41cb-9342-07170ebedf26 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:23:35.321207 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-61134621-1263-41cb-9342-07170ebedf26 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:23:35.337851 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-61134621-1263-41cb-9342-07170ebedf26 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:35.339525 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-61134621-1263-41cb-9342-07170ebedf26 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:35.341711 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-61134621-1263-41cb-9342-07170ebedf26 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:35.345775 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-61134621-1263-41cb-9342-07170ebedf26 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:35.348318 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-61134621-1263-41cb-9342-07170ebedf26 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:35.349343 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-61134621-1263-41cb-9342-07170ebedf26 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:35.403477 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-61134621-1263-41cb-9342-07170ebedf26 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Getting quotas for project d450288d3d6249b385056f524c1e5bdc. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:23:35.411167 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-61134621-1263-41cb-9342-07170ebedf26 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Getting quotas for user d20f4b72866e4fce93253f71822830d2 and project d450288d3d6249b385056f524c1e5bdc. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:23:35.430091 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-61134621-1263-41cb-9342-07170ebedf26 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:23:35.434632 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-61134621-1263-41cb-9342-07170ebedf26 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] [instance: c4a4c540-465f-4048-acde-837a8e37ccce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='75fd5634-5d65-4a85-b5be-d959ecda330e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:23:35.501019 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-61134621-1263-41cb-9342-07170ebedf26 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.478513 Oct 26 13:23:35.505515 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2354/4730] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:23:33 2022] POST /compute/v2.1/servers => generated 405 bytes in 2480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 26 13:23:35.518194 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d816dcca-d62b-4dec-af0f-10dc6ee1617a tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:35.520123 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d816dcca-d62b-4dec-af0f-10dc6ee1617a tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] [instance: c4a4c540-465f-4048-acde-837a8e37ccce] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:35.528129 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:23:35.732722 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d816dcca-d62b-4dec-af0f-10dc6ee1617a tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f4b72866e4fce93253f71822830d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd450288d3d6249b385056f524c1e5bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:35.754531 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d816dcca-d62b-4dec-af0f-10dc6ee1617a tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] 10.222.0.40 "GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce" status: 200 len: 1245 microversion: 2.1 time: 0.243539 Oct 26 13:23:35.769166 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2377/4731] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:35 2022] GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce => generated 1245 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:23:36.785771 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e97d7fdd-177b-4fcc-9a79-41f2c041e185 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:36.787143 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e97d7fdd-177b-4fcc-9a79-41f2c041e185 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] [instance: c4a4c540-465f-4048-acde-837a8e37ccce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:36.810021 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e97d7fdd-177b-4fcc-9a79-41f2c041e185 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:36.810529 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e97d7fdd-177b-4fcc-9a79-41f2c041e185 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:36.810978 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e97d7fdd-177b-4fcc-9a79-41f2c041e185 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:36.811704 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e97d7fdd-177b-4fcc-9a79-41f2c041e185 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:36.812167 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e97d7fdd-177b-4fcc-9a79-41f2c041e185 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:36.812609 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e97d7fdd-177b-4fcc-9a79-41f2c041e185 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:37.112869 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e97d7fdd-177b-4fcc-9a79-41f2c041e185 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f4b72866e4fce93253f71822830d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd450288d3d6249b385056f524c1e5bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:37.133463 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e97d7fdd-177b-4fcc-9a79-41f2c041e185 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] 10.222.0.40 "GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce" status: 200 len: 1249 microversion: 2.1 time: 0.356987 Oct 26 13:23:37.140092 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2355/4732] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:36 2022] GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce => generated 1249 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:23:37.289473 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0d9b87de-b733-404c-97af-3fdf8dd9a825 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-651887299", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "52e622a6-1003-4403-bde9-f622c42344c6"}], "security_groups": [{"name": "tempest-securitygroup--1497161338"}], "key_name": "tempest-keypair-68516749", "user_data": "}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:23:37.592282 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-0d9b87de-b733-404c-97af-3fdf8dd9a825 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] validate_networks() for [('52e622a6-1003-4403-bde9-f622c42344c6', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:23:38.163194 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9eee9f2e-4077-45f3-a6ee-fee60cb37da8 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:38.163663 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9eee9f2e-4077-45f3-a6ee-fee60cb37da8 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] [instance: c4a4c540-465f-4048-acde-837a8e37ccce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:38.176144 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9eee9f2e-4077-45f3-a6ee-fee60cb37da8 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:38.176647 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9eee9f2e-4077-45f3-a6ee-fee60cb37da8 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:38.193245 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9eee9f2e-4077-45f3-a6ee-fee60cb37da8 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:38.198866 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9eee9f2e-4077-45f3-a6ee-fee60cb37da8 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:38.199381 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9eee9f2e-4077-45f3-a6ee-fee60cb37da8 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:38.201735 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9eee9f2e-4077-45f3-a6ee-fee60cb37da8 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:38.665523 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9eee9f2e-4077-45f3-a6ee-fee60cb37da8 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f4b72866e4fce93253f71822830d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd450288d3d6249b385056f524c1e5bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:38.680024 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9eee9f2e-4077-45f3-a6ee-fee60cb37da8 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] 10.222.0.40 "GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce" status: 200 len: 1315 microversion: 2.1 time: 0.521003 Oct 26 13:23:38.709233 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2356/4733] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:38 2022] GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce => generated 1315 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:23:39.705617 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ed4e4023-eb4c-468b-9198-801ae177fab3 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:39.706306 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ed4e4023-eb4c-468b-9198-801ae177fab3 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] [instance: c4a4c540-465f-4048-acde-837a8e37ccce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:39.735534 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed4e4023-eb4c-468b-9198-801ae177fab3 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:39.741318 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed4e4023-eb4c-468b-9198-801ae177fab3 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:39.742955 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed4e4023-eb4c-468b-9198-801ae177fab3 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:39.754997 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed4e4023-eb4c-468b-9198-801ae177fab3 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:39.763787 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed4e4023-eb4c-468b-9198-801ae177fab3 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:39.767025 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed4e4023-eb4c-468b-9198-801ae177fab3 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:39.857410 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-0d9b87de-b733-404c-97af-3fdf8dd9a825 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:23:39.858390 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-0d9b87de-b733-404c-97af-3fdf8dd9a825 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:23:39.858888 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-0d9b87de-b733-404c-97af-3fdf8dd9a825 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:23:39.859307 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-0d9b87de-b733-404c-97af-3fdf8dd9a825 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:23:39.859725 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-0d9b87de-b733-404c-97af-3fdf8dd9a825 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:23:39.894460 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d9b87de-b733-404c-97af-3fdf8dd9a825 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:39.894962 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d9b87de-b733-404c-97af-3fdf8dd9a825 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:39.895410 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d9b87de-b733-404c-97af-3fdf8dd9a825 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:39.896160 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d9b87de-b733-404c-97af-3fdf8dd9a825 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:39.896619 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d9b87de-b733-404c-97af-3fdf8dd9a825 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:39.897057 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d9b87de-b733-404c-97af-3fdf8dd9a825 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:40.001342 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-0d9b87de-b733-404c-97af-3fdf8dd9a825 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Getting quotas for project c0d1b1d2fe374ee5806eeee18712219f. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:23:40.027357 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-0d9b87de-b733-404c-97af-3fdf8dd9a825 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Getting quotas for user 3e9ff5a884f1416886f26a80c5b87b18 and project c0d1b1d2fe374ee5806eeee18712219f. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:23:40.077943 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0d9b87de-b733-404c-97af-3fdf8dd9a825 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:23:40.088365 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0d9b87de-b733-404c-97af-3fdf8dd9a825 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:23:40.240806 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0d9b87de-b733-404c-97af-3fdf8dd9a825 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.955967 Oct 26 13:23:40.244585 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2378/4734] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:23:37 2022] POST /compute/v2.1/servers => generated 409 bytes in 2960 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:23:40.263545 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fbfbac94-0ea9-4cba-851e-1f96b7dd0e2d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:40.270465 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fbfbac94-0ea9-4cba-851e-1f96b7dd0e2d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:40.315285 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ed4e4023-eb4c-468b-9198-801ae177fab3 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f4b72866e4fce93253f71822830d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd450288d3d6249b385056f524c1e5bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:40.329470 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ed4e4023-eb4c-468b-9198-801ae177fab3 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] 10.222.0.40 "GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce" status: 200 len: 1303 microversion: 2.1 time: 0.628827 Oct 26 13:23:40.347166 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2357/4735] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:39 2022] GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce => generated 1303 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:23:41.312725 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fbfbac94-0ea9-4cba-851e-1f96b7dd0e2d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:41.334674 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fbfbac94-0ea9-4cba-851e-1f96b7dd0e2d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1236 microversion: 2.1 time: 1.074372 Oct 26 13:23:41.337619 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2379/4736] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:40 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1236 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:23:41.365719 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b41f8ef1-4046-47b0-b783-0a4eb15fe71c tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:41.366418 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b41f8ef1-4046-47b0-b783-0a4eb15fe71c tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] [instance: c4a4c540-465f-4048-acde-837a8e37ccce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:41.397341 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b41f8ef1-4046-47b0-b783-0a4eb15fe71c tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:41.397871 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b41f8ef1-4046-47b0-b783-0a4eb15fe71c tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:41.398375 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b41f8ef1-4046-47b0-b783-0a4eb15fe71c tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:41.399162 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b41f8ef1-4046-47b0-b783-0a4eb15fe71c tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:41.399679 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b41f8ef1-4046-47b0-b783-0a4eb15fe71c tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:41.400437 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b41f8ef1-4046-47b0-b783-0a4eb15fe71c tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:41.811519 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b41f8ef1-4046-47b0-b783-0a4eb15fe71c tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f4b72866e4fce93253f71822830d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd450288d3d6249b385056f524c1e5bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:41.835092 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b41f8ef1-4046-47b0-b783-0a4eb15fe71c tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] 10.222.0.40 "GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce" status: 200 len: 1303 microversion: 2.1 time: 0.473840 Oct 26 13:23:41.853512 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2358/4737] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:41 2022] GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce => generated 1303 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:23:42.361576 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4c797fe2-a0f8-44ab-9f04-43a76a215a73 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:42.362816 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4c797fe2-a0f8-44ab-9f04-43a76a215a73 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:42.388203 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c797fe2-a0f8-44ab-9f04-43a76a215a73 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:42.388949 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c797fe2-a0f8-44ab-9f04-43a76a215a73 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:42.389602 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c797fe2-a0f8-44ab-9f04-43a76a215a73 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:42.390618 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c797fe2-a0f8-44ab-9f04-43a76a215a73 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:42.392926 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c797fe2-a0f8-44ab-9f04-43a76a215a73 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:42.396544 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c797fe2-a0f8-44ab-9f04-43a76a215a73 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:42.647405 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4c797fe2-a0f8-44ab-9f04-43a76a215a73 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:42.660185 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4c797fe2-a0f8-44ab-9f04-43a76a215a73 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1288 microversion: 2.1 time: 0.302727 Oct 26 13:23:42.666835 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2380/4738] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:42 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1288 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:23:42.868062 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7a154be2-9aea-4115-903e-e92227de432c tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:42.869450 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7a154be2-9aea-4115-903e-e92227de432c tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] [instance: c4a4c540-465f-4048-acde-837a8e37ccce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:42.885706 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7a154be2-9aea-4115-903e-e92227de432c tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:42.886547 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7a154be2-9aea-4115-903e-e92227de432c tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:42.887186 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7a154be2-9aea-4115-903e-e92227de432c tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:42.888095 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7a154be2-9aea-4115-903e-e92227de432c tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:42.888718 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7a154be2-9aea-4115-903e-e92227de432c tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:42.889319 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7a154be2-9aea-4115-903e-e92227de432c tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:43.688549 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fd460577-444e-4f12-80e0-46438d26932b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:43.690526 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fd460577-444e-4f12-80e0-46438d26932b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:43.710551 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd460577-444e-4f12-80e0-46438d26932b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:43.711127 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd460577-444e-4f12-80e0-46438d26932b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:43.711612 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd460577-444e-4f12-80e0-46438d26932b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:43.714744 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd460577-444e-4f12-80e0-46438d26932b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:43.715410 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd460577-444e-4f12-80e0-46438d26932b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:43.716622 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd460577-444e-4f12-80e0-46438d26932b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:44.063365 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fd460577-444e-4f12-80e0-46438d26932b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:44.079341 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fd460577-444e-4f12-80e0-46438d26932b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1294 microversion: 2.1 time: 0.396991 Oct 26 13:23:44.080513 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2381/4739] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:43 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1294 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:23:44.114245 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7a154be2-9aea-4115-903e-e92227de432c tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f4b72866e4fce93253f71822830d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd450288d3d6249b385056f524c1e5bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:44.175427 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7a154be2-9aea-4115-903e-e92227de432c tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] 10.222.0.40 "GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce" status: 200 len: 1370 microversion: 2.1 time: 1.311061 Oct 26 13:23:44.176082 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2359/4740] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:42 2022] GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce => generated 1370 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:23:44.281934 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-605461da-e2c2-4526-958e-7290bbdac444 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:44.286623 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-605461da-e2c2-4526-958e-7290bbdac444 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:44.340989 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-605461da-e2c2-4526-958e-7290bbdac444 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:44.346933 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-605461da-e2c2-4526-958e-7290bbdac444 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:44.349256 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-605461da-e2c2-4526-958e-7290bbdac444 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:44.351914 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-605461da-e2c2-4526-958e-7290bbdac444 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:44.353383 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-605461da-e2c2-4526-958e-7290bbdac444 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:44.357124 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-605461da-e2c2-4526-958e-7290bbdac444 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:44.452992 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-605461da-e2c2-4526-958e-7290bbdac444 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.177245 Oct 26 13:23:44.457031 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2382/4741] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:23:44 2022] GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6/os-volume_attachments => generated 25 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:23:44.709155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d7b6c4a6-9eba-42f3-8b81-9ad0b992386d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:44.712122 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d7b6c4a6-9eba-42f3-8b81-9ad0b992386d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:44.721195 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7b6c4a6-9eba-42f3-8b81-9ad0b992386d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:44.721972 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7b6c4a6-9eba-42f3-8b81-9ad0b992386d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:44.722606 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7b6c4a6-9eba-42f3-8b81-9ad0b992386d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:44.723538 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7b6c4a6-9eba-42f3-8b81-9ad0b992386d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:44.724184 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7b6c4a6-9eba-42f3-8b81-9ad0b992386d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:44.724886 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7b6c4a6-9eba-42f3-8b81-9ad0b992386d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:44.772349 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d7b6c4a6-9eba-42f3-8b81-9ad0b992386d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067880 Oct 26 13:23:44.785941 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2360/4742] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:23:44 2022] GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:23:44.965085 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-95d7c530-72f0-413c-8a86-2c6f3617e50f tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:44.965898 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-95d7c530-72f0-413c-8a86-2c6f3617e50f tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:44.987130 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-95d7c530-72f0-413c-8a86-2c6f3617e50f tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:44.987870 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-95d7c530-72f0-413c-8a86-2c6f3617e50f tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:44.988494 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-95d7c530-72f0-413c-8a86-2c6f3617e50f tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:44.989601 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-95d7c530-72f0-413c-8a86-2c6f3617e50f tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:44.990305 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-95d7c530-72f0-413c-8a86-2c6f3617e50f tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:44.990949 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-95d7c530-72f0-413c-8a86-2c6f3617e50f tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:45.039647 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-95d7c530-72f0-413c-8a86-2c6f3617e50f tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:23:45.229870 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-95d7c530-72f0-413c-8a86-2c6f3617e50f tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "DELETE /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6" status: 204 len: 0 microversion: 2.1 time: 0.268281 Oct 26 13:23:45.234793 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2361/4743] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:23:44 2022] DELETE /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:23:45.243473 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-220e8b83-9ba0-4071-b144-92bd4eb7dc12 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:45.246818 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-220e8b83-9ba0-4071-b144-92bd4eb7dc12 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:45.247071 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-62c431dd-642a-420d-aae3-0e6eb5b83531 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-2079319323", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "67d4a507-95eb-4faa-86df-75ff6058da92"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:23:45.259714 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-220e8b83-9ba0-4071-b144-92bd4eb7dc12 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:45.263001 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-220e8b83-9ba0-4071-b144-92bd4eb7dc12 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:45.263682 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-220e8b83-9ba0-4071-b144-92bd4eb7dc12 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:45.264810 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-220e8b83-9ba0-4071-b144-92bd4eb7dc12 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:45.266061 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-220e8b83-9ba0-4071-b144-92bd4eb7dc12 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:45.271077 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-220e8b83-9ba0-4071-b144-92bd4eb7dc12 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:45.393298 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:23:45.402368 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-62c431dd-642a-420d-aae3-0e6eb5b83531 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] validate_networks() for [('67d4a507-95eb-4faa-86df-75ff6058da92', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:23:45.421886 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:23:45.561377 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-220e8b83-9ba0-4071-b144-92bd4eb7dc12 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:45.574566 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-220e8b83-9ba0-4071-b144-92bd4eb7dc12 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1294 microversion: 2.1 time: 0.337962 Oct 26 13:23:45.594981 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2362/4744] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:45 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1294 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:23:45.603919 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fdd6b5dc-ac3a-4189-bf90-8cca5c123e69 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:45.608355 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fdd6b5dc-ac3a-4189-bf90-8cca5c123e69 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] [instance: c4a4c540-465f-4048-acde-837a8e37ccce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:45.645379 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fdd6b5dc-ac3a-4189-bf90-8cca5c123e69 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:45.646467 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fdd6b5dc-ac3a-4189-bf90-8cca5c123e69 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:45.648178 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fdd6b5dc-ac3a-4189-bf90-8cca5c123e69 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:45.649255 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fdd6b5dc-ac3a-4189-bf90-8cca5c123e69 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:45.661508 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fdd6b5dc-ac3a-4189-bf90-8cca5c123e69 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:45.662186 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fdd6b5dc-ac3a-4189-bf90-8cca5c123e69 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:46.249197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fdd6b5dc-ac3a-4189-bf90-8cca5c123e69 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f4b72866e4fce93253f71822830d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd450288d3d6249b385056f524c1e5bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:46.263013 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fdd6b5dc-ac3a-4189-bf90-8cca5c123e69 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] 10.222.0.40 "GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce" status: 200 len: 1370 microversion: 2.1 time: 0.663154 Oct 26 13:23:46.264462 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2363/4745] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:45 2022] GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce => generated 1370 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:23:46.272403 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-db61ccb2-8d32-4798-bf6d-0ade2ff61f54 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:46.273266 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-db61ccb2-8d32-4798-bf6d-0ade2ff61f54 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:46.287451 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-db61ccb2-8d32-4798-bf6d-0ade2ff61f54 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:46.288279 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-db61ccb2-8d32-4798-bf6d-0ade2ff61f54 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:46.289077 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-db61ccb2-8d32-4798-bf6d-0ade2ff61f54 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:46.290119 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-db61ccb2-8d32-4798-bf6d-0ade2ff61f54 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:46.291198 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-db61ccb2-8d32-4798-bf6d-0ade2ff61f54 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:46.291837 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-db61ccb2-8d32-4798-bf6d-0ade2ff61f54 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:48.074987 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-62c431dd-642a-420d-aae3-0e6eb5b83531 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:23:48.076021 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-62c431dd-642a-420d-aae3-0e6eb5b83531 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:23:48.076680 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-62c431dd-642a-420d-aae3-0e6eb5b83531 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:23:48.077261 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-62c431dd-642a-420d-aae3-0e6eb5b83531 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:23:48.077936 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-62c431dd-642a-420d-aae3-0e6eb5b83531 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:23:48.100185 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-62c431dd-642a-420d-aae3-0e6eb5b83531 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:48.109814 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-62c431dd-642a-420d-aae3-0e6eb5b83531 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:48.110197 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-62c431dd-642a-420d-aae3-0e6eb5b83531 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:48.111165 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-62c431dd-642a-420d-aae3-0e6eb5b83531 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:48.111677 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-62c431dd-642a-420d-aae3-0e6eb5b83531 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:48.112177 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-62c431dd-642a-420d-aae3-0e6eb5b83531 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:48.181451 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-62c431dd-642a-420d-aae3-0e6eb5b83531 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Getting quotas for project 8f32124c6d5542db974ff96e2c68972e. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:23:48.198913 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-62c431dd-642a-420d-aae3-0e6eb5b83531 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Getting quotas for user d840518258f244a39e5f9187aecea309 and project 8f32124c6d5542db974ff96e2c68972e. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:23:48.233758 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-62c431dd-642a-420d-aae3-0e6eb5b83531 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:23:48.237155 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-62c431dd-642a-420d-aae3-0e6eb5b83531 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] [instance: 8d0efc10-ffb9-42b8-94a6-5f5b04afc62c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:23:48.377959 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-db61ccb2-8d32-4798-bf6d-0ade2ff61f54 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:48.387558 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-db61ccb2-8d32-4798-bf6d-0ade2ff61f54 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6" status: 200 len: 1671 microversion: 2.1 time: 2.121581 Oct 26 13:23:48.408401 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-62c431dd-642a-420d-aae3-0e6eb5b83531 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.485197 Oct 26 13:23:48.410106 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2364/4746] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:46 2022] GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6 => generated 1671 bytes in 2145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:23:48.414287 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2383/4747] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:23:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 3493 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:23:48.430465 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-941bf9fd-fdfa-4f79-8c87-c04c598ef700 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:48.433430 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-941bf9fd-fdfa-4f79-8c87-c04c598ef700 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] [instance: c4a4c540-465f-4048-acde-837a8e37ccce] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:48.438145 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-66801a49-2359-445c-a673-e707f94d1ad1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:48.438808 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-66801a49-2359-445c-a673-e707f94d1ad1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:48.461740 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-66801a49-2359-445c-a673-e707f94d1ad1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:48.462477 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-66801a49-2359-445c-a673-e707f94d1ad1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:48.463114 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-66801a49-2359-445c-a673-e707f94d1ad1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:48.464004 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-66801a49-2359-445c-a673-e707f94d1ad1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:48.464628 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-66801a49-2359-445c-a673-e707f94d1ad1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:48.465217 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-66801a49-2359-445c-a673-e707f94d1ad1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:48.479822 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-941bf9fd-fdfa-4f79-8c87-c04c598ef700 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:48.494346 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-941bf9fd-fdfa-4f79-8c87-c04c598ef700 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:48.495144 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-941bf9fd-fdfa-4f79-8c87-c04c598ef700 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:48.496095 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-941bf9fd-fdfa-4f79-8c87-c04c598ef700 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:48.496901 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-941bf9fd-fdfa-4f79-8c87-c04c598ef700 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:48.498867 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-941bf9fd-fdfa-4f79-8c87-c04c598ef700 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:48.912857 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-66801a49-2359-445c-a673-e707f94d1ad1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:48.921156 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-66801a49-2359-445c-a673-e707f94d1ad1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1294 microversion: 2.1 time: 0.509857 Oct 26 13:23:48.921806 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2365/4748] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:48 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1294 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:23:48.945410 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6db45535-823e-4651-8b9e-be5b453896b0 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:48.946374 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6db45535-823e-4651-8b9e-be5b453896b0 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] [instance: 8d0efc10-ffb9-42b8-94a6-5f5b04afc62c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:49.387576 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6db45535-823e-4651-8b9e-be5b453896b0 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd840518258f244a39e5f9187aecea309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f32124c6d5542db974ff96e2c68972e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:49.397147 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6db45535-823e-4651-8b9e-be5b453896b0 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] 10.222.0.40 "GET /compute/v2.1/servers/8d0efc10-ffb9-42b8-94a6-5f5b04afc62c" status: 200 len: 1225 microversion: 2.1 time: 0.460929 Oct 26 13:23:49.419253 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2366/4749] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:48 2022] GET /compute/v2.1/servers/8d0efc10-ffb9-42b8-94a6-5f5b04afc62c => generated 1225 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:23:49.436121 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b6cd4cd4-474f-4179-ad19-d0092426ab07 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:49.446465 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b6cd4cd4-474f-4179-ad19-d0092426ab07 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:49.476630 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6cd4cd4-474f-4179-ad19-d0092426ab07 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:49.477315 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6cd4cd4-474f-4179-ad19-d0092426ab07 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:49.478491 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6cd4cd4-474f-4179-ad19-d0092426ab07 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:49.479304 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6cd4cd4-474f-4179-ad19-d0092426ab07 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:49.479850 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6cd4cd4-474f-4179-ad19-d0092426ab07 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:49.480794 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6cd4cd4-474f-4179-ad19-d0092426ab07 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:50.331794 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-941bf9fd-fdfa-4f79-8c87-c04c598ef700 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f4b72866e4fce93253f71822830d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd450288d3d6249b385056f524c1e5bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:50.346345 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-941bf9fd-fdfa-4f79-8c87-c04c598ef700 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] 10.222.0.40 "GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce" status: 200 len: 1370 microversion: 2.1 time: 1.930122 Oct 26 13:23:50.348930 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2384/4750] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:48 2022] GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce => generated 1370 bytes in 1931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:23:50.397405 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bc6b094c-3448-4463-816d-ed38adaea8a3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:50.400025 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bc6b094c-3448-4463-816d-ed38adaea8a3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:50.406687 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc6b094c-3448-4463-816d-ed38adaea8a3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:50.407192 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc6b094c-3448-4463-816d-ed38adaea8a3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:50.408190 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc6b094c-3448-4463-816d-ed38adaea8a3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:50.408920 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc6b094c-3448-4463-816d-ed38adaea8a3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:50.409547 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc6b094c-3448-4463-816d-ed38adaea8a3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:50.410193 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc6b094c-3448-4463-816d-ed38adaea8a3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:50.668015 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b6cd4cd4-474f-4179-ad19-d0092426ab07 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:50.687303 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b6cd4cd4-474f-4179-ad19-d0092426ab07 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6" status: 200 len: 1671 microversion: 2.1 time: 1.252944 Oct 26 13:23:50.688675 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2367/4751] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:49 2022] GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6 => generated 1671 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:23:51.006974 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-93533eff-8b26-40cc-a670-74dbe767cde0 req-c1488f72-9138-4fbe-a95b-06d6ef81dd94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4a4c540-465f-4048-acde-837a8e37ccce", "tag": "7e73ce63-ac95-40f9-b1ad-563ef977f94e"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:23:51.028503 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-93533eff-8b26-40cc-a670-74dbe767cde0 req-c1488f72-9138-4fbe-a95b-06d6ef81dd94 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:51.029051 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-93533eff-8b26-40cc-a670-74dbe767cde0 req-c1488f72-9138-4fbe-a95b-06d6ef81dd94 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:51.029511 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-93533eff-8b26-40cc-a670-74dbe767cde0 req-c1488f72-9138-4fbe-a95b-06d6ef81dd94 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:51.070928 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-93533eff-8b26-40cc-a670-74dbe767cde0 req-c1488f72-9138-4fbe-a95b-06d6ef81dd94 service nova] Creating event network-changed:7e73ce63-ac95-40f9-b1ad-563ef977f94e for instance c4a4c540-465f-4048-acde-837a8e37ccce on n-h1-862686-1 Oct 26 13:23:51.089244 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-93533eff-8b26-40cc-a670-74dbe767cde0 req-c1488f72-9138-4fbe-a95b-06d6ef81dd94 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.398338 Oct 26 13:23:51.093653 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2368/4752] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:23:51.101983 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a03c419c-8b2d-4a7a-9a09-4e2686000f0c tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:51.103482 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a03c419c-8b2d-4a7a-9a09-4e2686000f0c tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] [instance: 8d0efc10-ffb9-42b8-94a6-5f5b04afc62c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:51.111083 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a03c419c-8b2d-4a7a-9a09-4e2686000f0c tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:51.112391 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a03c419c-8b2d-4a7a-9a09-4e2686000f0c tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:51.113051 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a03c419c-8b2d-4a7a-9a09-4e2686000f0c tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:51.114057 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a03c419c-8b2d-4a7a-9a09-4e2686000f0c tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:51.114712 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a03c419c-8b2d-4a7a-9a09-4e2686000f0c tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:51.115392 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a03c419c-8b2d-4a7a-9a09-4e2686000f0c tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:51.336448 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bc6b094c-3448-4463-816d-ed38adaea8a3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:51.350368 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bc6b094c-3448-4463-816d-ed38adaea8a3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1362 microversion: 2.1 time: 1.000714 Oct 26 13:23:51.352039 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2385/4753] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:50 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1362 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:23:51.484658 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a03c419c-8b2d-4a7a-9a09-4e2686000f0c tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd840518258f244a39e5f9187aecea309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f32124c6d5542db974ff96e2c68972e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:51.500162 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a03c419c-8b2d-4a7a-9a09-4e2686000f0c tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] 10.222.0.40 "GET /compute/v2.1/servers/8d0efc10-ffb9-42b8-94a6-5f5b04afc62c" status: 200 len: 1283 microversion: 2.1 time: 0.401675 Oct 26 13:23:51.501975 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2369/4754] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:51 2022] GET /compute/v2.1/servers/8d0efc10-ffb9-42b8-94a6-5f5b04afc62c => generated 1283 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:23:51.513315 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0d80f0d9-586b-469f-971e-7e79dd7b9538 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:51.515572 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0d80f0d9-586b-469f-971e-7e79dd7b9538 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] [instance: c4a4c540-465f-4048-acde-837a8e37ccce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:51.520360 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-9d59bade-2b45-485f-9d63-8a4a557a3fce req-0934463e-3ed9-48ff-9348-5bcfc69ce4f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30dcd11b-b8ec-4095-a7d8-73ce795aeaa6", "name": "network-vif-unplugged", "status": "completed", "tag": "413c2089-e162-4ff6-ae1f-b4d6cf728b5f"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:23:51.534294 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0d80f0d9-586b-469f-971e-7e79dd7b9538 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:51.537544 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0d80f0d9-586b-469f-971e-7e79dd7b9538 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:51.538445 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0d80f0d9-586b-469f-971e-7e79dd7b9538 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:51.539579 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0d80f0d9-586b-469f-971e-7e79dd7b9538 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:51.541289 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0d80f0d9-586b-469f-971e-7e79dd7b9538 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:51.545216 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9d59bade-2b45-485f-9d63-8a4a557a3fce req-0934463e-3ed9-48ff-9348-5bcfc69ce4f3 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:51.545829 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9d59bade-2b45-485f-9d63-8a4a557a3fce req-0934463e-3ed9-48ff-9348-5bcfc69ce4f3 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:51.546274 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9d59bade-2b45-485f-9d63-8a4a557a3fce req-0934463e-3ed9-48ff-9348-5bcfc69ce4f3 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:51.546565 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0d80f0d9-586b-469f-971e-7e79dd7b9538 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:51.550906 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:23:51.574610 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-9d59bade-2b45-485f-9d63-8a4a557a3fce req-0934463e-3ed9-48ff-9348-5bcfc69ce4f3 service nova] Creating event network-vif-unplugged:413c2089-e162-4ff6-ae1f-b4d6cf728b5f for instance 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6 on n-h2-862686-1 Oct 26 13:23:51.587495 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-9d59bade-2b45-485f-9d63-8a4a557a3fce req-0934463e-3ed9-48ff-9348-5bcfc69ce4f3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.232252 Oct 26 13:23:51.590700 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2386/4755] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:23:51.715067 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0bc62032-4044-4527-bc0d-00510364c84d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:51.715827 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0bc62032-4044-4527-bc0d-00510364c84d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:51.726899 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0bc62032-4044-4527-bc0d-00510364c84d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:51.727406 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0bc62032-4044-4527-bc0d-00510364c84d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:51.730889 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0bc62032-4044-4527-bc0d-00510364c84d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:51.731696 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0bc62032-4044-4527-bc0d-00510364c84d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:51.734926 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0bc62032-4044-4527-bc0d-00510364c84d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:51.735463 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0bc62032-4044-4527-bc0d-00510364c84d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:52.571033 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0d80f0d9-586b-469f-971e-7e79dd7b9538 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f4b72866e4fce93253f71822830d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd450288d3d6249b385056f524c1e5bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:52.585504 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0bc62032-4044-4527-bc0d-00510364c84d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:52.596595 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0bc62032-4044-4527-bc0d-00510364c84d tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6" status: 200 len: 1671 microversion: 2.1 time: 0.885512 Oct 26 13:23:52.597271 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2387/4756] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:51 2022] GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6 => generated 1671 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:23:52.601704 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0d80f0d9-586b-469f-971e-7e79dd7b9538 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] 10.222.0.40 "GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce" status: 200 len: 1370 microversion: 2.1 time: 1.096927 Oct 26 13:23:52.628648 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2370/4757] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:51 2022] GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce => generated 1370 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:23:52.673123 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-eb9e479c-b325-4c2f-9437-06460e2c210f tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:52.675068 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-71d8d36c-6e92-4839-8e2a-0a4f07a39b45 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:52.675634 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-71d8d36c-6e92-4839-8e2a-0a4f07a39b45 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:52.675909 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-eb9e479c-b325-4c2f-9437-06460e2c210f tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] [instance: 8d0efc10-ffb9-42b8-94a6-5f5b04afc62c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:52.698506 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-71d8d36c-6e92-4839-8e2a-0a4f07a39b45 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:52.699009 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-71d8d36c-6e92-4839-8e2a-0a4f07a39b45 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:52.699885 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eb9e479c-b325-4c2f-9437-06460e2c210f tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:52.700586 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eb9e479c-b325-4c2f-9437-06460e2c210f tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:52.701177 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-71d8d36c-6e92-4839-8e2a-0a4f07a39b45 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:52.702704 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eb9e479c-b325-4c2f-9437-06460e2c210f tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:52.703667 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eb9e479c-b325-4c2f-9437-06460e2c210f tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:52.704269 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-71d8d36c-6e92-4839-8e2a-0a4f07a39b45 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:52.706341 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eb9e479c-b325-4c2f-9437-06460e2c210f tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:52.706980 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-71d8d36c-6e92-4839-8e2a-0a4f07a39b45 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:52.709000 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eb9e479c-b325-4c2f-9437-06460e2c210f tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:52.709264 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-71d8d36c-6e92-4839-8e2a-0a4f07a39b45 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:53.208893 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-eb9e479c-b325-4c2f-9437-06460e2c210f tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd840518258f244a39e5f9187aecea309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f32124c6d5542db974ff96e2c68972e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:53.218165 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-eb9e479c-b325-4c2f-9437-06460e2c210f tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] 10.222.0.40 "GET /compute/v2.1/servers/8d0efc10-ffb9-42b8-94a6-5f5b04afc62c" status: 200 len: 1283 microversion: 2.1 time: 0.588284 Oct 26 13:23:53.225186 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2371/4758] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:52 2022] GET /compute/v2.1/servers/8d0efc10-ffb9-42b8-94a6-5f5b04afc62c => generated 1283 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:23:53.289002 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-71d8d36c-6e92-4839-8e2a-0a4f07a39b45 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:53.300083 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-71d8d36c-6e92-4839-8e2a-0a4f07a39b45 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1362 microversion: 2.1 time: 0.667464 Oct 26 13:23:53.308143 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2388/4759] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:52 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1362 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:23:53.624426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-16feac1c-c6be-4a4d-b976-93aec42eae97 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:53.625050 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-16feac1c-c6be-4a4d-b976-93aec42eae97 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:53.635427 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-df9f3fd3-e19c-470c-958d-3be8fdc57894 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:53.636776 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-df9f3fd3-e19c-470c-958d-3be8fdc57894 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] [instance: c4a4c540-465f-4048-acde-837a8e37ccce] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:53.642853 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-16feac1c-c6be-4a4d-b976-93aec42eae97 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:53.645298 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df9f3fd3-e19c-470c-958d-3be8fdc57894 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:53.646036 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-16feac1c-c6be-4a4d-b976-93aec42eae97 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:53.646823 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df9f3fd3-e19c-470c-958d-3be8fdc57894 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:53.647434 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-16feac1c-c6be-4a4d-b976-93aec42eae97 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:53.648338 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-16feac1c-c6be-4a4d-b976-93aec42eae97 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:53.648933 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df9f3fd3-e19c-470c-958d-3be8fdc57894 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:53.649841 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df9f3fd3-e19c-470c-958d-3be8fdc57894 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:53.650717 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-16feac1c-c6be-4a4d-b976-93aec42eae97 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:53.651345 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df9f3fd3-e19c-470c-958d-3be8fdc57894 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:53.651925 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-16feac1c-c6be-4a4d-b976-93aec42eae97 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:53.652505 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df9f3fd3-e19c-470c-958d-3be8fdc57894 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:53.881771 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-16feac1c-c6be-4a4d-b976-93aec42eae97 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:53.893350 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-16feac1c-c6be-4a4d-b976-93aec42eae97 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6" status: 200 len: 1604 microversion: 2.1 time: 0.272161 Oct 26 13:23:53.894797 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2372/4760] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:53 2022] GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6 => generated 1604 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:23:54.148201 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-df9f3fd3-e19c-470c-958d-3be8fdc57894 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f4b72866e4fce93253f71822830d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd450288d3d6249b385056f524c1e5bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:54.176151 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-df9f3fd3-e19c-470c-958d-3be8fdc57894 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] 10.222.0.40 "GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce" status: 200 len: 1370 microversion: 2.1 time: 0.538127 Oct 26 13:23:54.181890 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2389/4761] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:53 2022] GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce => generated 1370 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:23:54.212893 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-6e9d3c45-e852-461a-8f47-339823dac4b9 req-b4ac52df-4a2b-4bb0-92ce-f0b163b38c73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "341d8b3a-d684-4969-a5cf-a6aea1a055fa", "tag": "391606bb-b0ec-4759-b9bd-53c1cc5c2f7c"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:23:54.223807 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-6e9d3c45-e852-461a-8f47-339823dac4b9 req-b4ac52df-4a2b-4bb0-92ce-f0b163b38c73 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:54.224555 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-6e9d3c45-e852-461a-8f47-339823dac4b9 req-b4ac52df-4a2b-4bb0-92ce-f0b163b38c73 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:54.225347 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-6e9d3c45-e852-461a-8f47-339823dac4b9 req-b4ac52df-4a2b-4bb0-92ce-f0b163b38c73 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:54.240007 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-6e9d3c45-e852-461a-8f47-339823dac4b9 req-b4ac52df-4a2b-4bb0-92ce-f0b163b38c73 service nova] Creating event network-changed:391606bb-b0ec-4759-b9bd-53c1cc5c2f7c for instance 341d8b3a-d684-4969-a5cf-a6aea1a055fa on n-h1-862686-1 Oct 26 13:23:54.246105 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-6e9d3c45-e852-461a-8f47-339823dac4b9 req-b4ac52df-4a2b-4bb0-92ce-f0b163b38c73 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037002 Oct 26 13:23:54.247439 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2373/4762] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:23:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:23:54.252609 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3d27534a-474a-443c-b194-05d8c2a00aa8 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:54.253230 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3d27534a-474a-443c-b194-05d8c2a00aa8 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] [instance: 8d0efc10-ffb9-42b8-94a6-5f5b04afc62c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:54.263317 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3d27534a-474a-443c-b194-05d8c2a00aa8 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:54.263818 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3d27534a-474a-443c-b194-05d8c2a00aa8 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:54.266175 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3d27534a-474a-443c-b194-05d8c2a00aa8 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:54.267015 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3d27534a-474a-443c-b194-05d8c2a00aa8 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:54.270523 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3d27534a-474a-443c-b194-05d8c2a00aa8 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:54.270979 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3d27534a-474a-443c-b194-05d8c2a00aa8 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:54.605036 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-ace980bd-e34c-4ad2-9410-ca31c9c92b47 req-5b147609-19fa-4081-8573-55283914938f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30dcd11b-b8ec-4095-a7d8-73ce795aeaa6", "name": "network-vif-deleted", "tag": "413c2089-e162-4ff6-ae1f-b4d6cf728b5f"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:23:54.649806 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ace980bd-e34c-4ad2-9410-ca31c9c92b47 req-5b147609-19fa-4081-8573-55283914938f service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:54.651276 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ace980bd-e34c-4ad2-9410-ca31c9c92b47 req-5b147609-19fa-4081-8573-55283914938f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:54.652071 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ace980bd-e34c-4ad2-9410-ca31c9c92b47 req-5b147609-19fa-4081-8573-55283914938f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:54.669947 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-ace980bd-e34c-4ad2-9410-ca31c9c92b47 req-5b147609-19fa-4081-8573-55283914938f service nova] Creating event network-vif-deleted:413c2089-e162-4ff6-ae1f-b4d6cf728b5f for instance 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6 on n-h2-862686-1 Oct 26 13:23:54.679265 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-ace980bd-e34c-4ad2-9410-ca31c9c92b47 req-5b147609-19fa-4081-8573-55283914938f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.401043 Oct 26 13:23:54.680705 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2374/4763] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:23:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:23:54.688147 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c26f3d19-ffdd-4d04-9d3d-4d8d274535f8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:54.689547 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c26f3d19-ffdd-4d04-9d3d-4d8d274535f8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:54.699989 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c26f3d19-ffdd-4d04-9d3d-4d8d274535f8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:54.700943 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c26f3d19-ffdd-4d04-9d3d-4d8d274535f8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:54.701651 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c26f3d19-ffdd-4d04-9d3d-4d8d274535f8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:54.702862 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c26f3d19-ffdd-4d04-9d3d-4d8d274535f8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:54.703522 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c26f3d19-ffdd-4d04-9d3d-4d8d274535f8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:54.704145 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c26f3d19-ffdd-4d04-9d3d-4d8d274535f8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:54.715007 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3d27534a-474a-443c-b194-05d8c2a00aa8 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd840518258f244a39e5f9187aecea309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f32124c6d5542db974ff96e2c68972e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:54.740353 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3d27534a-474a-443c-b194-05d8c2a00aa8 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] 10.222.0.40 "GET /compute/v2.1/servers/8d0efc10-ffb9-42b8-94a6-5f5b04afc62c" status: 200 len: 1325 microversion: 2.1 time: 0.490585 Oct 26 13:23:54.743090 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2390/4764] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:54 2022] GET /compute/v2.1/servers/8d0efc10-ffb9-42b8-94a6-5f5b04afc62c => generated 1325 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:23:54.921617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-854d3d3c-200e-46f2-9a77-3d6220705ab5 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:54.922855 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-854d3d3c-200e-46f2-9a77-3d6220705ab5 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:54.932614 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-854d3d3c-200e-46f2-9a77-3d6220705ab5 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:54.936918 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-854d3d3c-200e-46f2-9a77-3d6220705ab5 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:54.939137 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-854d3d3c-200e-46f2-9a77-3d6220705ab5 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:54.940147 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-854d3d3c-200e-46f2-9a77-3d6220705ab5 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:54.942060 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-854d3d3c-200e-46f2-9a77-3d6220705ab5 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:54.943530 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-854d3d3c-200e-46f2-9a77-3d6220705ab5 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:55.021739 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-854d3d3c-200e-46f2-9a77-3d6220705ab5 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:55.022566 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-854d3d3c-200e-46f2-9a77-3d6220705ab5 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:55.023531 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-854d3d3c-200e-46f2-9a77-3d6220705ab5 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:55.024704 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-854d3d3c-200e-46f2-9a77-3d6220705ab5 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lazy-loading 'fault' on Instance uuid 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:23:55.205794 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-854d3d3c-200e-46f2-9a77-3d6220705ab5 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b457ab0af5e41b1a1e10290b67656a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f158446a544e5680969f4ef7512e49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:55.218806 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-854d3d3c-200e-46f2-9a77-3d6220705ab5 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6" status: 200 len: 1325 microversion: 2.1 time: 0.298831 Oct 26 13:23:55.221582 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2391/4765] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:54 2022] GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6 => generated 1325 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:23:55.234633 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-db65e575-b817-470f-b71f-625a964961c6 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:55.237267 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-db65e575-b817-470f-b71f-625a964961c6 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] [instance: c4a4c540-465f-4048-acde-837a8e37ccce] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:55.257735 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db65e575-b817-470f-b71f-625a964961c6 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:55.274638 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db65e575-b817-470f-b71f-625a964961c6 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:55.275897 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db65e575-b817-470f-b71f-625a964961c6 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:55.280066 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db65e575-b817-470f-b71f-625a964961c6 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:55.283721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db65e575-b817-470f-b71f-625a964961c6 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:55.285760 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db65e575-b817-470f-b71f-625a964961c6 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:55.493621 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c26f3d19-ffdd-4d04-9d3d-4d8d274535f8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:55.508747 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c26f3d19-ffdd-4d04-9d3d-4d8d274535f8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1362 microversion: 2.1 time: 0.826407 Oct 26 13:23:55.511495 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2375/4766] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:54 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1362 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:23:55.646879 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-448cb985-1e72-4967-87f6-5707d2d133a0 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:55.648125 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-448cb985-1e72-4967-87f6-5707d2d133a0 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:55.662493 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-448cb985-1e72-4967-87f6-5707d2d133a0 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:55.663707 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-448cb985-1e72-4967-87f6-5707d2d133a0 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:55.664330 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-448cb985-1e72-4967-87f6-5707d2d133a0 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:55.665209 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-448cb985-1e72-4967-87f6-5707d2d133a0 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:55.665854 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-448cb985-1e72-4967-87f6-5707d2d133a0 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:55.667897 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-448cb985-1e72-4967-87f6-5707d2d133a0 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:55.832907 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-448cb985-1e72-4967-87f6-5707d2d133a0 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lazy-loading 'services' on Instance uuid b93fff60-64e6-436d-9390-03d80438b245 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:23:55.916208 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-db65e575-b817-470f-b71f-625a964961c6 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f4b72866e4fce93253f71822830d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd450288d3d6249b385056f524c1e5bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:55.924697 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-db65e575-b817-470f-b71f-625a964961c6 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] 10.222.0.40 "GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce" status: 200 len: 1370 microversion: 2.1 time: 0.701740 Oct 26 13:23:55.949643 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2392/4767] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:55 2022] GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce => generated 1370 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:23:55.965338 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-448cb985-1e72-4967-87f6-5707d2d133a0 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245/os-volume_attachments/5f482485-b484-48ff-a775-3f47e4aad476" status: 202 len: 0 microversion: 2.1 time: 0.322098 Oct 26 13:23:55.966730 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2376/4768] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Oct 26 13:23:55 2022] DELETE /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245/os-volume_attachments/5f482485-b484-48ff-a775-3f47e4aad476 => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 13:23:55.967726 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5bd346ae-0622-4175-9341-108e93b71e4f tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:55.968516 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5bd346ae-0622-4175-9341-108e93b71e4f tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] [instance: 8d0efc10-ffb9-42b8-94a6-5f5b04afc62c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:55.977514 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-239a9af8-f4dc-480d-9361-ad7ccad53355 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:55.984662 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-239a9af8-f4dc-480d-9361-ad7ccad53355 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:55.990956 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5bd346ae-0622-4175-9341-108e93b71e4f tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:55.992976 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5bd346ae-0622-4175-9341-108e93b71e4f tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:55.994496 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5bd346ae-0622-4175-9341-108e93b71e4f tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:55.996835 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5bd346ae-0622-4175-9341-108e93b71e4f tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:55.998296 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5bd346ae-0622-4175-9341-108e93b71e4f tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:55.999481 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5bd346ae-0622-4175-9341-108e93b71e4f tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:56.003175 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-239a9af8-f4dc-480d-9361-ad7ccad53355 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:56.003727 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-239a9af8-f4dc-480d-9361-ad7ccad53355 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:56.004221 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-239a9af8-f4dc-480d-9361-ad7ccad53355 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:56.004984 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-239a9af8-f4dc-480d-9361-ad7ccad53355 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:56.005696 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-239a9af8-f4dc-480d-9361-ad7ccad53355 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:56.006188 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-239a9af8-f4dc-480d-9361-ad7ccad53355 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:56.061006 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-239a9af8-f4dc-480d-9361-ad7ccad53355 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089376 Oct 26 13:23:56.064335 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2377/4769] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:23:55 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:23:56.250148 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ebdcce43-0836-4c1c-aa77-b92cab5b136b tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:56.252042 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ebdcce43-0836-4c1c-aa77-b92cab5b136b tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:56.259787 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ebdcce43-0836-4c1c-aa77-b92cab5b136b tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:56.260482 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ebdcce43-0836-4c1c-aa77-b92cab5b136b tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:56.261476 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ebdcce43-0836-4c1c-aa77-b92cab5b136b tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:56.262555 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ebdcce43-0836-4c1c-aa77-b92cab5b136b tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:56.263323 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ebdcce43-0836-4c1c-aa77-b92cab5b136b tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:56.264192 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ebdcce43-0836-4c1c-aa77-b92cab5b136b tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:56.288086 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-ebdcce43-0836-4c1c-aa77-b92cab5b136b tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] HTTP exception thrown: Instance 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6 could not be found. Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ebdcce43-0836-4c1c-aa77-b92cab5b136b tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Request method failure captured: Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6 HTTP/1.1 Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTN7hbeapRmCcJ7igmy85vPoyVUVlZs2lSyAhZOIYOdPPfznAhHwx6i5N6See2TtMCVfoGB5ZRVOrV-z1bLtOTx-4VqQeaegU1xtipleMye9s0u-EdRknvwJp_xukT9e7b9VNOVvc51B0c1CP47_BIErFpV-aKSN5cSTtBHmEVuwcek Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: e1f158446a544e5680969f4ef7512e49 Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-AttachVolumeTestJSON-1520608711 Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e1f158446a544e5680969f4ef7512e49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e1f158446a544e5680969f4ef7512e49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e1f158446a544e5680969f4ef7512e49"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e1f158446a544e5680969f4ef7512e49"}]}] Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-AttachVolumeTestJSON-1520608711 Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: e1f158446a544e5680969f4ef7512e49 Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1520608711 Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-AttachVolumeTestJSON-1520608711-project Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 0b457ab0af5e41b1a1e10290b67656a7 Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-AttachVolumeTestJSON-1520608711-project Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6 could not be found. Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '30dcd11b-b8ec-4095-a7d8-73ce795aeaa6'} Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6 could not be found. Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6 could not be found. Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:23:56.292210 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:23:56.297519 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:23:56.297519 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:23:56.297519 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:23:56.297519 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:23:56.297519 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:23:56.297519 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6 could not be found. Oct 26 13:23:56.297519 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:23:56.299766 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ebdcce43-0836-4c1c-aa77-b92cab5b136b tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Returning 404 to user: Instance 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:23:56.302884 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ebdcce43-0836-4c1c-aa77-b92cab5b136b tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6" status: 404 len: 111 microversion: 2.1 time: 0.061027 Oct 26 13:23:56.309282 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2378/4770] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:56 2022] GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:23:56.315771 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-60e80932-4fee-470f-9c55-d5ae2d4aa39f tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '.version_select at 0x7f673232eee0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:56.361222 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-60e80932-4fee-470f-9c55-d5ae2d4aa39f tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-30575218" status: 202 len: 0 microversion: 2.1 time: 0.050171 Oct 26 13:23:56.362117 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2379/4771] 10.222.0.40 () {58 vars in 1215 bytes} [Wed Oct 26 13:23:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-30575218 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:23:56.543696 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6aadfed1-cbe7-44f9-8a55-031c24fb6f32 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:56.544928 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6aadfed1-cbe7-44f9-8a55-031c24fb6f32 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:56.555908 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6aadfed1-cbe7-44f9-8a55-031c24fb6f32 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:56.557969 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6aadfed1-cbe7-44f9-8a55-031c24fb6f32 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:56.559782 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6aadfed1-cbe7-44f9-8a55-031c24fb6f32 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:56.561416 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6aadfed1-cbe7-44f9-8a55-031c24fb6f32 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:56.562291 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6aadfed1-cbe7-44f9-8a55-031c24fb6f32 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:56.562971 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6aadfed1-cbe7-44f9-8a55-031c24fb6f32 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:56.894739 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5bd346ae-0622-4175-9341-108e93b71e4f tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd840518258f244a39e5f9187aecea309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f32124c6d5542db974ff96e2c68972e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:56.902175 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5bd346ae-0622-4175-9341-108e93b71e4f tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] 10.222.0.40 "GET /compute/v2.1/servers/8d0efc10-ffb9-42b8-94a6-5f5b04afc62c" status: 200 len: 1325 microversion: 2.1 time: 0.951065 Oct 26 13:23:56.913443 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6aadfed1-cbe7-44f9-8a55-031c24fb6f32 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:56.915948 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2393/4772] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:55 2022] GET /compute/v2.1/servers/8d0efc10-ffb9-42b8-94a6-5f5b04afc62c => generated 1325 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:23:56.921049 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-4636a5d3-7dc9-4858-a2d6-6b326151eda0 req-874c43b2-d164-40b8-8ce9-57a3b99868dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d0efc10-ffb9-42b8-94a6-5f5b04afc62c", "tag": "01e5c4db-518d-4118-92ee-decbc8e44521"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:23:56.933192 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-4636a5d3-7dc9-4858-a2d6-6b326151eda0 req-874c43b2-d164-40b8-8ce9-57a3b99868dc service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:56.933964 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-4636a5d3-7dc9-4858-a2d6-6b326151eda0 req-874c43b2-d164-40b8-8ce9-57a3b99868dc service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:56.934635 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-4636a5d3-7dc9-4858-a2d6-6b326151eda0 req-874c43b2-d164-40b8-8ce9-57a3b99868dc service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:56.936937 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6aadfed1-cbe7-44f9-8a55-031c24fb6f32 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1362 microversion: 2.1 time: 0.390052 Oct 26 13:23:56.942642 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2380/4773] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:56 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1362 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:23:56.963638 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b02fb2c5-f355-4a7f-9145-b042c2a5c848 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:56.967107 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-4636a5d3-7dc9-4858-a2d6-6b326151eda0 req-874c43b2-d164-40b8-8ce9-57a3b99868dc service nova] Creating event network-changed:01e5c4db-518d-4118-92ee-decbc8e44521 for instance 8d0efc10-ffb9-42b8-94a6-5f5b04afc62c on n-h2-862686-1 Oct 26 13:23:56.968647 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b02fb2c5-f355-4a7f-9145-b042c2a5c848 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] [instance: c4a4c540-465f-4048-acde-837a8e37ccce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:56.984468 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-4636a5d3-7dc9-4858-a2d6-6b326151eda0 req-874c43b2-d164-40b8-8ce9-57a3b99868dc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066989 Oct 26 13:23:56.987045 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b02fb2c5-f355-4a7f-9145-b042c2a5c848 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:56.987948 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2394/4774] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:23:56.991715 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b02fb2c5-f355-4a7f-9145-b042c2a5c848 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:56.993230 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b02fb2c5-f355-4a7f-9145-b042c2a5c848 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:56.994255 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b02fb2c5-f355-4a7f-9145-b042c2a5c848 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:56.995363 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b02fb2c5-f355-4a7f-9145-b042c2a5c848 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:56.997043 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b02fb2c5-f355-4a7f-9145-b042c2a5c848 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:57.077400 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-94f84bd1-43df-4cbe-a43a-1cf6c4ba4deb tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:57.080994 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-94f84bd1-43df-4cbe-a43a-1cf6c4ba4deb tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:57.095107 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-94f84bd1-43df-4cbe-a43a-1cf6c4ba4deb tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:57.097251 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-94f84bd1-43df-4cbe-a43a-1cf6c4ba4deb tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:57.099856 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-94f84bd1-43df-4cbe-a43a-1cf6c4ba4deb tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:57.101336 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-94f84bd1-43df-4cbe-a43a-1cf6c4ba4deb tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:57.103038 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-94f84bd1-43df-4cbe-a43a-1cf6c4ba4deb tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:57.105502 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-94f84bd1-43df-4cbe-a43a-1cf6c4ba4deb tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:57.163951 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-94f84bd1-43df-4cbe-a43a-1cf6c4ba4deb tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092439 Oct 26 13:23:57.171371 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2395/4775] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:23:57 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:23:57.549231 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b02fb2c5-f355-4a7f-9145-b042c2a5c848 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f4b72866e4fce93253f71822830d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd450288d3d6249b385056f524c1e5bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:57.563456 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b02fb2c5-f355-4a7f-9145-b042c2a5c848 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] 10.222.0.40 "GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce" status: 200 len: 1370 microversion: 2.1 time: 0.609115 Oct 26 13:23:57.569209 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2381/4776] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:56 2022] GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce => generated 1370 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:23:57.931361 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a87cdcbb-5181-49a5-9849-d11b2a91001c tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:57.932404 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a87cdcbb-5181-49a5-9849-d11b2a91001c tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] [instance: 8d0efc10-ffb9-42b8-94a6-5f5b04afc62c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:57.947273 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a87cdcbb-5181-49a5-9849-d11b2a91001c tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:57.948163 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a87cdcbb-5181-49a5-9849-d11b2a91001c tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:57.948985 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a87cdcbb-5181-49a5-9849-d11b2a91001c tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:57.950160 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a87cdcbb-5181-49a5-9849-d11b2a91001c tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:57.950918 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a87cdcbb-5181-49a5-9849-d11b2a91001c tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:57.951556 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a87cdcbb-5181-49a5-9849-d11b2a91001c tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:57.967547 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ab4119d4-0d59-4b97-9c0e-bdcbe5184b6f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:57.968923 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ab4119d4-0d59-4b97-9c0e-bdcbe5184b6f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:57.979429 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ab4119d4-0d59-4b97-9c0e-bdcbe5184b6f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:57.980269 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ab4119d4-0d59-4b97-9c0e-bdcbe5184b6f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:57.981170 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ab4119d4-0d59-4b97-9c0e-bdcbe5184b6f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:57.982237 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ab4119d4-0d59-4b97-9c0e-bdcbe5184b6f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:57.983443 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ab4119d4-0d59-4b97-9c0e-bdcbe5184b6f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:57.984164 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ab4119d4-0d59-4b97-9c0e-bdcbe5184b6f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:57.994240 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:23:58.151983 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=4 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:23:58.207419 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a87cdcbb-5181-49a5-9849-d11b2a91001c tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd840518258f244a39e5f9187aecea309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f32124c6d5542db974ff96e2c68972e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:58.217357 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a87cdcbb-5181-49a5-9849-d11b2a91001c tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] 10.222.0.40 "GET /compute/v2.1/servers/8d0efc10-ffb9-42b8-94a6-5f5b04afc62c" status: 200 len: 1325 microversion: 2.1 time: 0.294477 Oct 26 13:23:58.222820 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2396/4777] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:57 2022] GET /compute/v2.1/servers/8d0efc10-ffb9-42b8-94a6-5f5b04afc62c => generated 1325 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:23:58.228116 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8a625747-60a5-4efe-974e-80acd5f375f0 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:58.236714 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8a625747-60a5-4efe-974e-80acd5f375f0 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:58.246074 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=20 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:23:58.257519 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8a625747-60a5-4efe-974e-80acd5f375f0 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:58.259425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8a625747-60a5-4efe-974e-80acd5f375f0 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:58.260973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8a625747-60a5-4efe-974e-80acd5f375f0 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:58.264427 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8a625747-60a5-4efe-974e-80acd5f375f0 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:58.265223 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8a625747-60a5-4efe-974e-80acd5f375f0 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:58.267631 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8a625747-60a5-4efe-974e-80acd5f375f0 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:58.285351 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ab4119d4-0d59-4b97-9c0e-bdcbe5184b6f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:58.295932 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ab4119d4-0d59-4b97-9c0e-bdcbe5184b6f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1362 microversion: 2.1 time: 0.337413 Oct 26 13:23:58.296530 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2382/4778] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:57 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1362 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:23:58.326560 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8a625747-60a5-4efe-974e-80acd5f375f0 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102200 Oct 26 13:23:58.328102 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2397/4779] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:23:58 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:23:58.588566 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-74796975-72c1-40ed-b92d-573503d09d8a tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:58.591916 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-74796975-72c1-40ed-b92d-573503d09d8a tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] [instance: c4a4c540-465f-4048-acde-837a8e37ccce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:58.592264 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:23:58.602503 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-74796975-72c1-40ed-b92d-573503d09d8a tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:58.603923 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-74796975-72c1-40ed-b92d-573503d09d8a tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:58.605009 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-74796975-72c1-40ed-b92d-573503d09d8a tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:58.606221 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-74796975-72c1-40ed-b92d-573503d09d8a tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:58.607329 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-74796975-72c1-40ed-b92d-573503d09d8a tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:58.610207 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-74796975-72c1-40ed-b92d-573503d09d8a tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:58.905624 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-74796975-72c1-40ed-b92d-573503d09d8a tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f4b72866e4fce93253f71822830d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd450288d3d6249b385056f524c1e5bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:58.914632 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-74796975-72c1-40ed-b92d-573503d09d8a tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] 10.222.0.40 "GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce" status: 200 len: 1370 microversion: 2.1 time: 0.329942 Oct 26 13:23:58.918841 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2383/4780] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:58 2022] GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce => generated 1370 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:23:59.253249 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-017a5a93-38ab-4fb5-94d9-596e5db73834 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:59.253916 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-017a5a93-38ab-4fb5-94d9-596e5db73834 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] [instance: 8d0efc10-ffb9-42b8-94a6-5f5b04afc62c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:59.266369 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-017a5a93-38ab-4fb5-94d9-596e5db73834 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:59.268491 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-017a5a93-38ab-4fb5-94d9-596e5db73834 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:59.269239 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-017a5a93-38ab-4fb5-94d9-596e5db73834 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:59.270351 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-017a5a93-38ab-4fb5-94d9-596e5db73834 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:59.271351 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-017a5a93-38ab-4fb5-94d9-596e5db73834 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:59.272062 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-017a5a93-38ab-4fb5-94d9-596e5db73834 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:59.321040 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-503bcf80-d251-4113-9eb7-8a02130c05da tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:59.321696 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-503bcf80-d251-4113-9eb7-8a02130c05da tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:59.338623 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-503bcf80-d251-4113-9eb7-8a02130c05da tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:59.339306 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-503bcf80-d251-4113-9eb7-8a02130c05da tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:59.339888 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-503bcf80-d251-4113-9eb7-8a02130c05da tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:59.340777 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-503bcf80-d251-4113-9eb7-8a02130c05da tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:59.341245 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-503bcf80-d251-4113-9eb7-8a02130c05da tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:59.341703 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-503bcf80-d251-4113-9eb7-8a02130c05da tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:59.394053 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:23:59.589786 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-017a5a93-38ab-4fb5-94d9-596e5db73834 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd840518258f244a39e5f9187aecea309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f32124c6d5542db974ff96e2c68972e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:59.618605 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-017a5a93-38ab-4fb5-94d9-596e5db73834 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] 10.222.0.40 "GET /compute/v2.1/servers/8d0efc10-ffb9-42b8-94a6-5f5b04afc62c" status: 200 len: 1325 microversion: 2.1 time: 0.369055 Oct 26 13:23:59.620818 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2398/4781] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:59 2022] GET /compute/v2.1/servers/8d0efc10-ffb9-42b8-94a6-5f5b04afc62c => generated 1325 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:23:59.635563 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a180b24b-05e6-48c5-9476-77316dcfbf1b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:59.638325 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a180b24b-05e6-48c5-9476-77316dcfbf1b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:59.647506 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a180b24b-05e6-48c5-9476-77316dcfbf1b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:59.648352 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a180b24b-05e6-48c5-9476-77316dcfbf1b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:59.649213 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a180b24b-05e6-48c5-9476-77316dcfbf1b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:59.674660 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a180b24b-05e6-48c5-9476-77316dcfbf1b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:59.675340 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a180b24b-05e6-48c5-9476-77316dcfbf1b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:59.684673 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a180b24b-05e6-48c5-9476-77316dcfbf1b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:59.762867 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a180b24b-05e6-48c5-9476-77316dcfbf1b tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139515 Oct 26 13:23:59.763779 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2399/4782] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:23:59 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:23:59.882461 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-503bcf80-d251-4113-9eb7-8a02130c05da tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:23:59.894273 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-503bcf80-d251-4113-9eb7-8a02130c05da tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1362 microversion: 2.1 time: 0.577131 Oct 26 13:23:59.895464 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2384/4783] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:59 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1362 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:23:59.941632 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-54a63978-ebe9-4df6-bbd7-641b2068c2c8 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:23:59.942290 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-54a63978-ebe9-4df6-bbd7-641b2068c2c8 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] [instance: c4a4c540-465f-4048-acde-837a8e37ccce] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:23:59.950268 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54a63978-ebe9-4df6-bbd7-641b2068c2c8 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:59.951108 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54a63978-ebe9-4df6-bbd7-641b2068c2c8 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:59.951803 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54a63978-ebe9-4df6-bbd7-641b2068c2c8 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:23:59.953301 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54a63978-ebe9-4df6-bbd7-641b2068c2c8 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:23:59.954162 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54a63978-ebe9-4df6-bbd7-641b2068c2c8 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:23:59.955596 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54a63978-ebe9-4df6-bbd7-641b2068c2c8 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:00.260411 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-54a63978-ebe9-4df6-bbd7-641b2068c2c8 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f4b72866e4fce93253f71822830d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd450288d3d6249b385056f524c1e5bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:00.287952 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-54a63978-ebe9-4df6-bbd7-641b2068c2c8 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] 10.222.0.40 "GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce" status: 200 len: 1370 microversion: 2.1 time: 0.349851 Oct 26 13:24:00.288608 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2400/4784] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:23:59 2022] GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce => generated 1370 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:24:00.647752 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e39daf30-dabf-4b1f-8c31-50a1665fb9da tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:00.649810 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e39daf30-dabf-4b1f-8c31-50a1665fb9da tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] [instance: 8d0efc10-ffb9-42b8-94a6-5f5b04afc62c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:00.675460 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e39daf30-dabf-4b1f-8c31-50a1665fb9da tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:00.676368 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e39daf30-dabf-4b1f-8c31-50a1665fb9da tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:00.678233 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e39daf30-dabf-4b1f-8c31-50a1665fb9da tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:00.680536 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e39daf30-dabf-4b1f-8c31-50a1665fb9da tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:00.682480 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e39daf30-dabf-4b1f-8c31-50a1665fb9da tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:00.684282 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e39daf30-dabf-4b1f-8c31-50a1665fb9da tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:00.742994 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-9e0e9f31-e999-4d6a-b008-ee374507a234 req-92834ff8-1065-4ec2-97a8-4a785597cded service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4a4c540-465f-4048-acde-837a8e37ccce", "name": "network-vif-plugged", "status": "completed", "tag": "7e73ce63-ac95-40f9-b1ad-563ef977f94e"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:24:00.771534 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9e0e9f31-e999-4d6a-b008-ee374507a234 req-92834ff8-1065-4ec2-97a8-4a785597cded service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:00.773615 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9e0e9f31-e999-4d6a-b008-ee374507a234 req-92834ff8-1065-4ec2-97a8-4a785597cded service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:00.778954 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9e0e9f31-e999-4d6a-b008-ee374507a234 req-92834ff8-1065-4ec2-97a8-4a785597cded service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:00.811860 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-9e0e9f31-e999-4d6a-b008-ee374507a234 req-92834ff8-1065-4ec2-97a8-4a785597cded service nova] Creating event network-vif-plugged:7e73ce63-ac95-40f9-b1ad-563ef977f94e for instance c4a4c540-465f-4048-acde-837a8e37ccce on n-h1-862686-1 Oct 26 13:24:00.818997 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-9e0e9f31-e999-4d6a-b008-ee374507a234 req-92834ff8-1065-4ec2-97a8-4a785597cded service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082377 Oct 26 13:24:00.820135 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2401/4785] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:24:00.826218 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0e79e28c-5088-4692-a7bd-afa6836d122d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:00.828838 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0e79e28c-5088-4692-a7bd-afa6836d122d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:00.847948 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0e79e28c-5088-4692-a7bd-afa6836d122d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:00.848841 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0e79e28c-5088-4692-a7bd-afa6836d122d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:00.849536 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0e79e28c-5088-4692-a7bd-afa6836d122d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:00.850483 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0e79e28c-5088-4692-a7bd-afa6836d122d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:00.851213 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0e79e28c-5088-4692-a7bd-afa6836d122d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:00.851878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0e79e28c-5088-4692-a7bd-afa6836d122d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:00.948687 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0e79e28c-5088-4692-a7bd-afa6836d122d tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126936 Oct 26 13:24:00.959352 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2402/4786] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:24:00 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:24:00.971990 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c47bce1c-426d-4487-8813-73e801cc8b9f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:00.972973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c47bce1c-426d-4487-8813-73e801cc8b9f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:00.991581 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c47bce1c-426d-4487-8813-73e801cc8b9f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:00.994560 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c47bce1c-426d-4487-8813-73e801cc8b9f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:00.994806 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c47bce1c-426d-4487-8813-73e801cc8b9f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:00.999067 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c47bce1c-426d-4487-8813-73e801cc8b9f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:00.999622 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c47bce1c-426d-4487-8813-73e801cc8b9f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:01.000074 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c47bce1c-426d-4487-8813-73e801cc8b9f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:01.200713 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c47bce1c-426d-4487-8813-73e801cc8b9f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:01.211071 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c47bce1c-426d-4487-8813-73e801cc8b9f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1362 microversion: 2.1 time: 0.250249 Oct 26 13:24:01.211978 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2403/4787] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:24:00 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1362 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:24:01.316185 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4ad3ff33-fbac-44d8-a497-ae9d7d0ed525 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:01.318577 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4ad3ff33-fbac-44d8-a497-ae9d7d0ed525 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] [instance: c4a4c540-465f-4048-acde-837a8e37ccce] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:01.333001 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4ad3ff33-fbac-44d8-a497-ae9d7d0ed525 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:01.334504 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4ad3ff33-fbac-44d8-a497-ae9d7d0ed525 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:01.335309 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4ad3ff33-fbac-44d8-a497-ae9d7d0ed525 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:01.336236 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4ad3ff33-fbac-44d8-a497-ae9d7d0ed525 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:01.338168 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4ad3ff33-fbac-44d8-a497-ae9d7d0ed525 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:01.339298 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4ad3ff33-fbac-44d8-a497-ae9d7d0ed525 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:01.463969 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e39daf30-dabf-4b1f-8c31-50a1665fb9da tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd840518258f244a39e5f9187aecea309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f32124c6d5542db974ff96e2c68972e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:01.479052 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e39daf30-dabf-4b1f-8c31-50a1665fb9da tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] 10.222.0.40 "GET /compute/v2.1/servers/8d0efc10-ffb9-42b8-94a6-5f5b04afc62c" status: 200 len: 1325 microversion: 2.1 time: 0.836288 Oct 26 13:24:01.481122 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2385/4788] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:24:00 2022] GET /compute/v2.1/servers/8d0efc10-ffb9-42b8-94a6-5f5b04afc62c => generated 1325 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:24:01.636817 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4ad3ff33-fbac-44d8-a497-ae9d7d0ed525 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f4b72866e4fce93253f71822830d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd450288d3d6249b385056f524c1e5bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:01.649626 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4ad3ff33-fbac-44d8-a497-ae9d7d0ed525 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] 10.222.0.40 "GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce" status: 200 len: 1370 microversion: 2.1 time: 0.338340 Oct 26 13:24:01.650490 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2404/4789] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:24:01 2022] GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce => generated 1370 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:24:01.966993 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-38a9f332-301f-4cc2-9d7a-7c30ff0c02cd tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:01.971459 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-38a9f332-301f-4cc2-9d7a-7c30ff0c02cd tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:01.993579 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38a9f332-301f-4cc2-9d7a-7c30ff0c02cd tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:01.994286 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38a9f332-301f-4cc2-9d7a-7c30ff0c02cd tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:01.994900 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38a9f332-301f-4cc2-9d7a-7c30ff0c02cd tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:01.995806 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38a9f332-301f-4cc2-9d7a-7c30ff0c02cd tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:01.996436 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38a9f332-301f-4cc2-9d7a-7c30ff0c02cd tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:01.997040 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38a9f332-301f-4cc2-9d7a-7c30ff0c02cd tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:02.036860 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-38a9f332-301f-4cc2-9d7a-7c30ff0c02cd tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073672 Oct 26 13:24:02.041970 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2386/4790] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:24:01 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:24:02.234574 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cdf265e8-c2f2-4ab2-aaa8-d800513b2789 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:02.235191 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cdf265e8-c2f2-4ab2-aaa8-d800513b2789 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:02.248233 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cdf265e8-c2f2-4ab2-aaa8-d800513b2789 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:02.248745 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cdf265e8-c2f2-4ab2-aaa8-d800513b2789 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:02.249189 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cdf265e8-c2f2-4ab2-aaa8-d800513b2789 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:02.249943 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cdf265e8-c2f2-4ab2-aaa8-d800513b2789 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:02.250404 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cdf265e8-c2f2-4ab2-aaa8-d800513b2789 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:02.250834 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cdf265e8-c2f2-4ab2-aaa8-d800513b2789 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:02.510087 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a97eb327-99c7-42f3-a599-b45c89d12da0 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:02.510824 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a97eb327-99c7-42f3-a599-b45c89d12da0 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] [instance: 8d0efc10-ffb9-42b8-94a6-5f5b04afc62c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:02.528653 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a97eb327-99c7-42f3-a599-b45c89d12da0 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:02.529228 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a97eb327-99c7-42f3-a599-b45c89d12da0 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:02.530256 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a97eb327-99c7-42f3-a599-b45c89d12da0 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:02.531226 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a97eb327-99c7-42f3-a599-b45c89d12da0 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:02.531919 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a97eb327-99c7-42f3-a599-b45c89d12da0 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:02.533112 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a97eb327-99c7-42f3-a599-b45c89d12da0 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:02.555025 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-cdf265e8-c2f2-4ab2-aaa8-d800513b2789 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:02.570607 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cdf265e8-c2f2-4ab2-aaa8-d800513b2789 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1362 microversion: 2.1 time: 0.339522 Oct 26 13:24:02.571787 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2405/4791] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:24:02 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1362 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:24:02.672517 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d13c1f85-e213-46d1-93f0-96ca38d70677 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:02.673192 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d13c1f85-e213-46d1-93f0-96ca38d70677 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] [instance: c4a4c540-465f-4048-acde-837a8e37ccce] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:02.680111 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d13c1f85-e213-46d1-93f0-96ca38d70677 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:02.681123 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d13c1f85-e213-46d1-93f0-96ca38d70677 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:02.681781 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d13c1f85-e213-46d1-93f0-96ca38d70677 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:02.682717 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d13c1f85-e213-46d1-93f0-96ca38d70677 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:02.683399 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d13c1f85-e213-46d1-93f0-96ca38d70677 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:02.684084 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d13c1f85-e213-46d1-93f0-96ca38d70677 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:02.984260 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a97eb327-99c7-42f3-a599-b45c89d12da0 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd840518258f244a39e5f9187aecea309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f32124c6d5542db974ff96e2c68972e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:02.992825 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a97eb327-99c7-42f3-a599-b45c89d12da0 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] 10.222.0.40 "GET /compute/v2.1/servers/8d0efc10-ffb9-42b8-94a6-5f5b04afc62c" status: 200 len: 1325 microversion: 2.1 time: 0.488387 Oct 26 13:24:03.005889 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2387/4792] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:24:02 2022] GET /compute/v2.1/servers/8d0efc10-ffb9-42b8-94a6-5f5b04afc62c => generated 1325 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:24:03.050124 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1439ee5a-1790-4c3a-8ae7-682f5f6eee1e tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:03.052366 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1439ee5a-1790-4c3a-8ae7-682f5f6eee1e tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:03.067315 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1439ee5a-1790-4c3a-8ae7-682f5f6eee1e tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:03.067826 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1439ee5a-1790-4c3a-8ae7-682f5f6eee1e tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:03.068275 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1439ee5a-1790-4c3a-8ae7-682f5f6eee1e tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:03.069000 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1439ee5a-1790-4c3a-8ae7-682f5f6eee1e tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:03.069466 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1439ee5a-1790-4c3a-8ae7-682f5f6eee1e tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:03.074198 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1439ee5a-1790-4c3a-8ae7-682f5f6eee1e tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:03.162872 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1439ee5a-1790-4c3a-8ae7-682f5f6eee1e tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.116940 Oct 26 13:24:03.164617 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2388/4793] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:24:03 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245/os-volume_attachments => generated 25 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:24:03.185122 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d13c1f85-e213-46d1-93f0-96ca38d70677 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f4b72866e4fce93253f71822830d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd450288d3d6249b385056f524c1e5bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:03.198449 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d13c1f85-e213-46d1-93f0-96ca38d70677 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] 10.222.0.40 "GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce" status: 200 len: 1556 microversion: 2.1 time: 0.529323 Oct 26 13:24:03.229132 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-301d7b0b-ace7-41a7-9bb8-c400bfe48954 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:03.229690 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-301d7b0b-ace7-41a7-9bb8-c400bfe48954 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] [instance: c4a4c540-465f-4048-acde-837a8e37ccce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:03.230032 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2406/4794] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:24:02 2022] GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce => generated 1556 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:24:03.260344 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-301d7b0b-ace7-41a7-9bb8-c400bfe48954 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:03.262118 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-301d7b0b-ace7-41a7-9bb8-c400bfe48954 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:03.262720 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-301d7b0b-ace7-41a7-9bb8-c400bfe48954 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:03.263468 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-301d7b0b-ace7-41a7-9bb8-c400bfe48954 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:03.265619 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-301d7b0b-ace7-41a7-9bb8-c400bfe48954 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:03.266657 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-301d7b0b-ace7-41a7-9bb8-c400bfe48954 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:03.273285 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:24:03.307985 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e1a46a3e-1413-4b8c-9ff0-646b116f57e8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:24:03.311232 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e1a46a3e-1413-4b8c-9ff0-646b116f57e8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 53426b7d-0bba-46ce-ab7e-32451f413745] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:03.327162 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e1a46a3e-1413-4b8c-9ff0-646b116f57e8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:03.339251 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e1a46a3e-1413-4b8c-9ff0-646b116f57e8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:03.340728 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e1a46a3e-1413-4b8c-9ff0-646b116f57e8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:03.341696 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e1a46a3e-1413-4b8c-9ff0-646b116f57e8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:03.367484 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e1a46a3e-1413-4b8c-9ff0-646b116f57e8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:03.368195 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e1a46a3e-1413-4b8c-9ff0-646b116f57e8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:03.436106 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-e1a46a3e-1413-4b8c-9ff0-646b116f57e8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] HTTP exception thrown: Cannot 'reboot' instance 53426b7d-0bba-46ce-ab7e-32451f413745 while it is in vm_state rescued Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e1a46a3e-1413-4b8c-9ff0-646b116f57e8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Request method failure captured: Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745/action HTTP/1.1 Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 28 Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTPjOuLV_n1DR58OZOmgbin2ud11sLWXOml70eL6_Yw9nM-eYNoCKOyZp3mck381-99yxZlLhlu2g6vQAmqZcUDv2ExrohfYX5ori3eOe3Uf6RO52e_TYIFS_DlKFRRKYqEp1KNMktjZRMuKeogboZRQrwA8baF1wLatF4_VyxhzXdo Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 9cdd45be745d4828b5a111472254156c Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1015154874 Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9cdd45be745d4828b5a111472254156c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9cdd45be745d4828b5a111472254156c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9cdd45be745d4828b5a111472254156c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9cdd45be745d4828b5a111472254156c"}]}] Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1015154874 Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 9cdd45be745d4828b5a111472254156c Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1015154874 Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServerRescueNegativeTestJSON-1015154874-project Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 363fc117da70484f9d8cf2040e8391e4 Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1015154874-project Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: {"reboot": {"type": "HARD"}} Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: exception: Cannot 'reboot' instance 53426b7d-0bba-46ce-ab7e-32451f413745 while it is in vm_state rescued Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '53426b7d-0bba-46ce-ab7e-32451f413745', 'body': {'reboot': {'type': 'HARD'}}} Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 53426b7d-0bba-46ce-ab7e-32451f413745 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 26 13:24:03.438243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 26 13:24:03.443492 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 53426b7d-0bba-46ce-ab7e-32451f413745 while it is in vm_state rescued Oct 26 13:24:03.443492 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:24:03.443492 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:24:03.443492 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:24:03.443492 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:24:03.443492 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:24:03.443492 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:24:03.443492 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:24:03.443492 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:24:03.443492 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 53426b7d-0bba-46ce-ab7e-32451f413745 while it is in vm_state rescued Oct 26 13:24:03.443492 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:24:03.445827 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e1a46a3e-1413-4b8c-9ff0-646b116f57e8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Returning 409 to user: Cannot 'reboot' instance 53426b7d-0bba-46ce-ab7e-32451f413745 while it is in vm_state rescued {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:24:03.447003 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e1a46a3e-1413-4b8c-9ff0-646b116f57e8 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "POST /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745/action" status: 409 len: 145 microversion: 2.1 time: 0.143691 Oct 26 13:24:03.449270 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2407/4795] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:24:03 2022] POST /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745/action => generated 145 bytes in 146 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 26 13:24:03.458673 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0f12ae06-e522-49dc-b0ad-325c4af00f59 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:24:03.463050 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0f12ae06-e522-49dc-b0ad-325c4af00f59 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 53426b7d-0bba-46ce-ab7e-32451f413745] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:03.471166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f12ae06-e522-49dc-b0ad-325c4af00f59 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:03.471894 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f12ae06-e522-49dc-b0ad-325c4af00f59 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:03.472509 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f12ae06-e522-49dc-b0ad-325c4af00f59 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:03.474131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f12ae06-e522-49dc-b0ad-325c4af00f59 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:03.474947 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f12ae06-e522-49dc-b0ad-325c4af00f59 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:03.476313 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f12ae06-e522-49dc-b0ad-325c4af00f59 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:03.522593 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-301d7b0b-ace7-41a7-9bb8-c400bfe48954 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] 10.222.0.40 "GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.299264 Oct 26 13:24:03.523355 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2389/4796] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 26 13:24:03 2022] GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce/os-interface => generated 285 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:24:03.532093 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-0f12ae06-e522-49dc-b0ad-325c4af00f59 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] HTTP exception thrown: Cannot 'rebuild' instance 53426b7d-0bba-46ce-ab7e-32451f413745 while it is in vm_state rescued Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0f12ae06-e522-49dc-b0ad-325c4af00f59 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Request method failure captured: Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745/action HTTP/1.1 Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 65 Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTPjOuLV_n1DR58OZOmgbin2ud11sLWXOml70eL6_Yw9nM-eYNoCKOyZp3mck381-99yxZlLhlu2g6vQAmqZcUDv2ExrohfYX5ori3eOe3Uf6RO52e_TYIFS_DlKFRRKYqEp1KNMktjZRMuKeogboZRQrwA8baF1wLatF4_VyxhzXdo Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 9cdd45be745d4828b5a111472254156c Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1015154874 Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9cdd45be745d4828b5a111472254156c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9cdd45be745d4828b5a111472254156c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9cdd45be745d4828b5a111472254156c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9cdd45be745d4828b5a111472254156c"}]}] Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1015154874 Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 9cdd45be745d4828b5a111472254156c Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1015154874 Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServerRescueNegativeTestJSON-1015154874-project Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 363fc117da70484f9d8cf2040e8391e4 Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1015154874-project Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: {"rebuild": {"imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b"}} Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: exception: Cannot 'rebuild' instance 53426b7d-0bba-46ce-ab7e-32451f413745 while it is in vm_state rescued Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '53426b7d-0bba-46ce-ab7e-32451f413745', 'body': {'rebuild': {'imageRef': '762c20f4-0f9b-45cb-bd95-cf21a747b33b'}}} Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 53426b7d-0bba-46ce-ab7e-32451f413745 in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:24:03.537240 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:24:03.542533 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:24:03.542533 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 26 13:24:03.542533 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 26 13:24:03.542533 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 26 13:24:03.542533 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 26 13:24:03.542533 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 26 13:24:03.542533 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 53426b7d-0bba-46ce-ab7e-32451f413745 while it is in vm_state rescued Oct 26 13:24:03.542533 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:24:03.542533 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:24:03.542533 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:24:03.542533 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:24:03.542533 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:24:03.542533 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:24:03.542533 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:24:03.542533 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:24:03.542533 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 53426b7d-0bba-46ce-ab7e-32451f413745 while it is in vm_state rescued Oct 26 13:24:03.542533 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:24:03.545724 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0f12ae06-e522-49dc-b0ad-325c4af00f59 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Returning 409 to user: Cannot 'rebuild' instance 53426b7d-0bba-46ce-ab7e-32451f413745 while it is in vm_state rescued {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:24:03.549160 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0f12ae06-e522-49dc-b0ad-325c4af00f59 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "POST /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745/action" status: 409 len: 146 microversion: 2.1 time: 0.094473 Oct 26 13:24:03.550774 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2408/4797] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:24:03 2022] POST /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745/action => generated 146 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:24:03.559161 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c16871ed-7da6-4853-bfe6-873a396828db tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:03.559860 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c16871ed-7da6-4853-bfe6-873a396828db tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:03.570921 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c16871ed-7da6-4853-bfe6-873a396828db tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:03.572814 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c16871ed-7da6-4853-bfe6-873a396828db tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:03.574570 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c16871ed-7da6-4853-bfe6-873a396828db tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:03.575392 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c16871ed-7da6-4853-bfe6-873a396828db tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:03.578859 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c16871ed-7da6-4853-bfe6-873a396828db tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:03.580047 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c16871ed-7da6-4853-bfe6-873a396828db tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:03.595896 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-aacfb0a4-7aa2-4de3-9ae1-864ee7082426 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:03.597320 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-aacfb0a4-7aa2-4de3-9ae1-864ee7082426 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:03.600743 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:24:03.615593 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aacfb0a4-7aa2-4de3-9ae1-864ee7082426 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:03.616468 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aacfb0a4-7aa2-4de3-9ae1-864ee7082426 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:03.617378 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aacfb0a4-7aa2-4de3-9ae1-864ee7082426 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:03.618293 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aacfb0a4-7aa2-4de3-9ae1-864ee7082426 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:03.621701 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aacfb0a4-7aa2-4de3-9ae1-864ee7082426 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:03.622584 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aacfb0a4-7aa2-4de3-9ae1-864ee7082426 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:03.681673 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c16871ed-7da6-4853-bfe6-873a396828db tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:24:03.863020 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c16871ed-7da6-4853-bfe6-873a396828db tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245" status: 204 len: 0 microversion: 2.1 time: 0.307479 Oct 26 13:24:03.868651 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2390/4798] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:24:03 2022] DELETE /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:24:03.876442 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7c37fba5-8be5-4e38-989f-e8a06461fb82 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:03.883142 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7c37fba5-8be5-4e38-989f-e8a06461fb82 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:03.897534 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7c37fba5-8be5-4e38-989f-e8a06461fb82 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:03.898043 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7c37fba5-8be5-4e38-989f-e8a06461fb82 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:03.898491 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7c37fba5-8be5-4e38-989f-e8a06461fb82 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:03.899211 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7c37fba5-8be5-4e38-989f-e8a06461fb82 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:03.899674 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7c37fba5-8be5-4e38-989f-e8a06461fb82 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:03.900106 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7c37fba5-8be5-4e38-989f-e8a06461fb82 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:04.276206 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7c37fba5-8be5-4e38-989f-e8a06461fb82 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:04.289252 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7c37fba5-8be5-4e38-989f-e8a06461fb82 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245" status: 200 len: 1688 microversion: 2.1 time: 0.419173 Oct 26 13:24:04.302641 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2391/4799] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:24:03 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245 => generated 1688 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:24:04.314611 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-afe2a215-ce41-46a1-9c13-e7042b730584 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:04.315246 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-afe2a215-ce41-46a1-9c13-e7042b730584 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] [instance: 8d0efc10-ffb9-42b8-94a6-5f5b04afc62c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:04.339247 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-afe2a215-ce41-46a1-9c13-e7042b730584 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:04.340022 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-afe2a215-ce41-46a1-9c13-e7042b730584 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:04.340706 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-afe2a215-ce41-46a1-9c13-e7042b730584 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:04.341685 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-afe2a215-ce41-46a1-9c13-e7042b730584 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:04.342467 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-afe2a215-ce41-46a1-9c13-e7042b730584 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:04.343109 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-afe2a215-ce41-46a1-9c13-e7042b730584 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:04.827477 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-afe2a215-ce41-46a1-9c13-e7042b730584 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd840518258f244a39e5f9187aecea309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f32124c6d5542db974ff96e2c68972e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:04.842279 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-afe2a215-ce41-46a1-9c13-e7042b730584 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] 10.222.0.40 "GET /compute/v2.1/servers/8d0efc10-ffb9-42b8-94a6-5f5b04afc62c" status: 200 len: 1325 microversion: 2.1 time: 0.536637 Oct 26 13:24:04.843138 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2392/4800] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:24:04 2022] GET /compute/v2.1/servers/8d0efc10-ffb9-42b8-94a6-5f5b04afc62c => generated 1325 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:24:04.857759 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-eb50d814-837f-40c0-b077-7575d01093d4 req-6f94e28c-a99a-4a3b-84a2-d745bc9dc2c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d0efc10-ffb9-42b8-94a6-5f5b04afc62c", "name": "network-vif-plugged", "status": "completed", "tag": "01e5c4db-518d-4118-92ee-decbc8e44521"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:24:04.890098 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-eb50d814-837f-40c0-b077-7575d01093d4 req-6f94e28c-a99a-4a3b-84a2-d745bc9dc2c7 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:04.890590 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-eb50d814-837f-40c0-b077-7575d01093d4 req-6f94e28c-a99a-4a3b-84a2-d745bc9dc2c7 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:04.891035 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-eb50d814-837f-40c0-b077-7575d01093d4 req-6f94e28c-a99a-4a3b-84a2-d745bc9dc2c7 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:04.928182 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-eb50d814-837f-40c0-b077-7575d01093d4 req-6f94e28c-a99a-4a3b-84a2-d745bc9dc2c7 service nova] Creating event network-vif-plugged:01e5c4db-518d-4118-92ee-decbc8e44521 for instance 8d0efc10-ffb9-42b8-94a6-5f5b04afc62c on n-h2-862686-1 Oct 26 13:24:04.943375 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-eb50d814-837f-40c0-b077-7575d01093d4 req-6f94e28c-a99a-4a3b-84a2-d745bc9dc2c7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096291 Oct 26 13:24:04.950295 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2393/4801] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:24:05.054539 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-aacfb0a4-7aa2-4de3-9ae1-864ee7082426 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:05.066216 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-aacfb0a4-7aa2-4de3-9ae1-864ee7082426 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1362 microversion: 2.1 time: 1.474487 Oct 26 13:24:05.066812 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2409/4802] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:24:03 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1362 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:24:05.318731 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4a88dbaf-bac1-4173-b567-733f34589f26 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:05.319449 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4a88dbaf-bac1-4173-b567-733f34589f26 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:05.335552 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4a88dbaf-bac1-4173-b567-733f34589f26 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:05.336383 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4a88dbaf-bac1-4173-b567-733f34589f26 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:05.337990 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4a88dbaf-bac1-4173-b567-733f34589f26 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:05.338929 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4a88dbaf-bac1-4173-b567-733f34589f26 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:05.339399 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4a88dbaf-bac1-4173-b567-733f34589f26 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:05.350472 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4a88dbaf-bac1-4173-b567-733f34589f26 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:05.740630 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4a88dbaf-bac1-4173-b567-733f34589f26 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:05.756597 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4a88dbaf-bac1-4173-b567-733f34589f26 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245" status: 200 len: 1688 microversion: 2.1 time: 0.441146 Oct 26 13:24:05.759748 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2394/4803] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:24:05 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245 => generated 1688 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:24:05.887639 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9b2f0658-064e-4ccb-b152-9289a9a8a1ab tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:05.889179 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9b2f0658-064e-4ccb-b152-9289a9a8a1ab tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] [instance: 8d0efc10-ffb9-42b8-94a6-5f5b04afc62c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:05.902203 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b2f0658-064e-4ccb-b152-9289a9a8a1ab tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:05.904792 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b2f0658-064e-4ccb-b152-9289a9a8a1ab tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:05.905457 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b2f0658-064e-4ccb-b152-9289a9a8a1ab tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:05.906354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b2f0658-064e-4ccb-b152-9289a9a8a1ab tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:05.909945 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b2f0658-064e-4ccb-b152-9289a9a8a1ab tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:05.910676 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b2f0658-064e-4ccb-b152-9289a9a8a1ab tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:06.094449 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bf6ba4eb-78b7-47b6-b204-8956175c3b43 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:06.096585 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bf6ba4eb-78b7-47b6-b204-8956175c3b43 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:06.103812 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf6ba4eb-78b7-47b6-b204-8956175c3b43 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:06.109296 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf6ba4eb-78b7-47b6-b204-8956175c3b43 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:06.115091 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf6ba4eb-78b7-47b6-b204-8956175c3b43 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:06.116036 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf6ba4eb-78b7-47b6-b204-8956175c3b43 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:06.116730 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf6ba4eb-78b7-47b6-b204-8956175c3b43 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:06.117319 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf6ba4eb-78b7-47b6-b204-8956175c3b43 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:06.388036 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9b2f0658-064e-4ccb-b152-9289a9a8a1ab tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd840518258f244a39e5f9187aecea309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f32124c6d5542db974ff96e2c68972e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:06.397518 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9b2f0658-064e-4ccb-b152-9289a9a8a1ab tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] 10.222.0.40 "GET /compute/v2.1/servers/8d0efc10-ffb9-42b8-94a6-5f5b04afc62c" status: 200 len: 1325 microversion: 2.1 time: 0.516962 Oct 26 13:24:06.418880 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2410/4804] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:24:05 2022] GET /compute/v2.1/servers/8d0efc10-ffb9-42b8-94a6-5f5b04afc62c => generated 1325 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:24:06.481319 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-3b408b26-d843-4457-812d-5e406b78907a req-c4096259-a2ad-4167-accf-066cc7d1e21e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4a4c540-465f-4048-acde-837a8e37ccce", "tag": "7e73ce63-ac95-40f9-b1ad-563ef977f94e"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:24:06.505668 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-3b408b26-d843-4457-812d-5e406b78907a req-c4096259-a2ad-4167-accf-066cc7d1e21e service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:06.506199 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-3b408b26-d843-4457-812d-5e406b78907a req-c4096259-a2ad-4167-accf-066cc7d1e21e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:06.506593 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-3b408b26-d843-4457-812d-5e406b78907a req-c4096259-a2ad-4167-accf-066cc7d1e21e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:06.530034 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-3b408b26-d843-4457-812d-5e406b78907a req-c4096259-a2ad-4167-accf-066cc7d1e21e service nova] Creating event network-changed:7e73ce63-ac95-40f9-b1ad-563ef977f94e for instance c4a4c540-465f-4048-acde-837a8e37ccce on n-h1-862686-1 Oct 26 13:24:06.543388 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-3b408b26-d843-4457-812d-5e406b78907a req-c4096259-a2ad-4167-accf-066cc7d1e21e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065860 Oct 26 13:24:06.544375 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2411/4805] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:24:06.579942 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bf6ba4eb-78b7-47b6-b204-8956175c3b43 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:06.594040 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bf6ba4eb-78b7-47b6-b204-8956175c3b43 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1362 microversion: 2.1 time: 0.502001 Oct 26 13:24:06.596154 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2395/4806] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:24:06 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1362 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:24:06.785908 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-862bebaa-8ea9-4dda-b49b-6452452ea031 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:06.787088 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-862bebaa-8ea9-4dda-b49b-6452452ea031 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:06.801543 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-862bebaa-8ea9-4dda-b49b-6452452ea031 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:06.802415 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-862bebaa-8ea9-4dda-b49b-6452452ea031 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:06.803131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-862bebaa-8ea9-4dda-b49b-6452452ea031 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:06.804190 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-862bebaa-8ea9-4dda-b49b-6452452ea031 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:06.811335 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-862bebaa-8ea9-4dda-b49b-6452452ea031 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:06.812655 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-862bebaa-8ea9-4dda-b49b-6452452ea031 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:06.989322 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-7f3c5e1d-6273-4bc4-80db-12ac087b3f87 req-5d62450e-6645-4b5d-8e57-4706d01c63ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "341d8b3a-d684-4969-a5cf-a6aea1a055fa", "name": "network-vif-plugged", "status": "completed", "tag": "391606bb-b0ec-4759-b9bd-53c1cc5c2f7c"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:24:07.028911 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-7f3c5e1d-6273-4bc4-80db-12ac087b3f87 req-5d62450e-6645-4b5d-8e57-4706d01c63ce service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:07.032497 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-7f3c5e1d-6273-4bc4-80db-12ac087b3f87 req-5d62450e-6645-4b5d-8e57-4706d01c63ce service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:07.038271 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-7f3c5e1d-6273-4bc4-80db-12ac087b3f87 req-5d62450e-6645-4b5d-8e57-4706d01c63ce service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:07.065920 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-7f3c5e1d-6273-4bc4-80db-12ac087b3f87 req-5d62450e-6645-4b5d-8e57-4706d01c63ce service nova] Creating event network-vif-plugged:391606bb-b0ec-4759-b9bd-53c1cc5c2f7c for instance 341d8b3a-d684-4969-a5cf-a6aea1a055fa on n-h1-862686-1 Oct 26 13:24:07.071602 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-7f3c5e1d-6273-4bc4-80db-12ac087b3f87 req-5d62450e-6645-4b5d-8e57-4706d01c63ce service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086438 Oct 26 13:24:07.076813 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2396/4807] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:24:07.432454 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8283a192-48b1-4926-9312-e18fdb0e64ab tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:07.433217 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8283a192-48b1-4926-9312-e18fdb0e64ab tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] [instance: 8d0efc10-ffb9-42b8-94a6-5f5b04afc62c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:07.454114 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8283a192-48b1-4926-9312-e18fdb0e64ab tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:07.457230 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8283a192-48b1-4926-9312-e18fdb0e64ab tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:07.458774 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8283a192-48b1-4926-9312-e18fdb0e64ab tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:07.459566 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8283a192-48b1-4926-9312-e18fdb0e64ab tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:07.463646 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8283a192-48b1-4926-9312-e18fdb0e64ab tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:07.464131 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8283a192-48b1-4926-9312-e18fdb0e64ab tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:07.779898 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-862bebaa-8ea9-4dda-b49b-6452452ea031 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:07.795402 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-862bebaa-8ea9-4dda-b49b-6452452ea031 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245" status: 200 len: 1688 microversion: 2.1 time: 1.014690 Oct 26 13:24:07.797060 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2412/4808] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:24:06 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245 => generated 1688 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:24:07.811427 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-774d07d0-d75e-4874-ad6b-2d2bfe058e90 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:07.814087 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-774d07d0-d75e-4874-ad6b-2d2bfe058e90 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:07.840151 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-774d07d0-d75e-4874-ad6b-2d2bfe058e90 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:07.842287 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-774d07d0-d75e-4874-ad6b-2d2bfe058e90 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:07.844532 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-774d07d0-d75e-4874-ad6b-2d2bfe058e90 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:07.847103 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-774d07d0-d75e-4874-ad6b-2d2bfe058e90 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:07.848260 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-774d07d0-d75e-4874-ad6b-2d2bfe058e90 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:07.849449 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-774d07d0-d75e-4874-ad6b-2d2bfe058e90 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:08.227641 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8283a192-48b1-4926-9312-e18fdb0e64ab tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd840518258f244a39e5f9187aecea309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f32124c6d5542db974ff96e2c68972e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:08.244433 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8283a192-48b1-4926-9312-e18fdb0e64ab tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] 10.222.0.40 "GET /compute/v2.1/servers/8d0efc10-ffb9-42b8-94a6-5f5b04afc62c" status: 200 len: 1325 microversion: 2.1 time: 0.817641 Oct 26 13:24:08.249043 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-774d07d0-d75e-4874-ad6b-2d2bfe058e90 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:08.251744 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2397/4809] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:24:07 2022] GET /compute/v2.1/servers/8d0efc10-ffb9-42b8-94a6-5f5b04afc62c => generated 1325 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:24:08.284089 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-774d07d0-d75e-4874-ad6b-2d2bfe058e90 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1362 microversion: 2.1 time: 0.481862 Oct 26 13:24:08.286028 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2413/4810] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:24:07 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1362 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:24:08.820373 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-17dfa15e-2a25-4772-938a-01e125c8d981 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:08.821284 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-17dfa15e-2a25-4772-938a-01e125c8d981 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:08.832921 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17dfa15e-2a25-4772-938a-01e125c8d981 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:08.846413 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17dfa15e-2a25-4772-938a-01e125c8d981 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:08.847178 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17dfa15e-2a25-4772-938a-01e125c8d981 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:08.848143 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17dfa15e-2a25-4772-938a-01e125c8d981 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:08.848762 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17dfa15e-2a25-4772-938a-01e125c8d981 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:08.849355 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17dfa15e-2a25-4772-938a-01e125c8d981 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:09.174953 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-17dfa15e-2a25-4772-938a-01e125c8d981 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:09.192035 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-17dfa15e-2a25-4772-938a-01e125c8d981 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245" status: 200 len: 1688 microversion: 2.1 time: 0.372301 Oct 26 13:24:09.193242 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2398/4811] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:24:08 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245 => generated 1688 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:24:09.277865 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-49e81b0d-5209-4e14-be2b-00f40464d2bd tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:09.279081 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-49e81b0d-5209-4e14-be2b-00f40464d2bd tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] [instance: 8d0efc10-ffb9-42b8-94a6-5f5b04afc62c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:09.294061 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-49e81b0d-5209-4e14-be2b-00f40464d2bd tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:09.294579 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-49e81b0d-5209-4e14-be2b-00f40464d2bd tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:09.295008 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-49e81b0d-5209-4e14-be2b-00f40464d2bd tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:09.295902 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-49e81b0d-5209-4e14-be2b-00f40464d2bd tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:09.296512 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-49e81b0d-5209-4e14-be2b-00f40464d2bd tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:09.298146 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-49e81b0d-5209-4e14-be2b-00f40464d2bd tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:09.308084 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9757bca9-3347-404b-bb7b-982fab6eadc5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:09.309081 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9757bca9-3347-404b-bb7b-982fab6eadc5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:09.323044 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9757bca9-3347-404b-bb7b-982fab6eadc5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:09.323605 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9757bca9-3347-404b-bb7b-982fab6eadc5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:09.325022 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9757bca9-3347-404b-bb7b-982fab6eadc5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:09.325022 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9757bca9-3347-404b-bb7b-982fab6eadc5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:09.325371 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9757bca9-3347-404b-bb7b-982fab6eadc5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:09.325904 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9757bca9-3347-404b-bb7b-982fab6eadc5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:09.689645 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-49e81b0d-5209-4e14-be2b-00f40464d2bd tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd840518258f244a39e5f9187aecea309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f32124c6d5542db974ff96e2c68972e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:09.699558 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-49e81b0d-5209-4e14-be2b-00f40464d2bd tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] 10.222.0.40 "GET /compute/v2.1/servers/8d0efc10-ffb9-42b8-94a6-5f5b04afc62c" status: 200 len: 1325 microversion: 2.1 time: 0.425627 Oct 26 13:24:09.700445 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2414/4812] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:24:09 2022] GET /compute/v2.1/servers/8d0efc10-ffb9-42b8-94a6-5f5b04afc62c => generated 1325 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:24:09.771957 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9757bca9-3347-404b-bb7b-982fab6eadc5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:09.797591 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9757bca9-3347-404b-bb7b-982fab6eadc5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1548 microversion: 2.1 time: 0.492891 Oct 26 13:24:09.798415 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2399/4813] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:24:09 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1548 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:24:09.824504 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-886943d1-892e-4d39-8df4-9d20efbe074f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:09.824930 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-886943d1-892e-4d39-8df4-9d20efbe074f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:09.834163 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-886943d1-892e-4d39-8df4-9d20efbe074f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:09.834903 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-886943d1-892e-4d39-8df4-9d20efbe074f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:09.835351 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-886943d1-892e-4d39-8df4-9d20efbe074f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:09.836215 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-886943d1-892e-4d39-8df4-9d20efbe074f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:09.836917 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-886943d1-892e-4d39-8df4-9d20efbe074f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:09.837369 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-886943d1-892e-4d39-8df4-9d20efbe074f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:09.841993 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:24:10.221383 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-30bf99e0-b8ef-4621-b0f4-6afe5e04c0dc tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:10.222473 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-30bf99e0-b8ef-4621-b0f4-6afe5e04c0dc tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:10.237446 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-30bf99e0-b8ef-4621-b0f4-6afe5e04c0dc tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:10.238262 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-30bf99e0-b8ef-4621-b0f4-6afe5e04c0dc tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:10.238877 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-30bf99e0-b8ef-4621-b0f4-6afe5e04c0dc tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:10.241055 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-30bf99e0-b8ef-4621-b0f4-6afe5e04c0dc tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:10.243403 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-30bf99e0-b8ef-4621-b0f4-6afe5e04c0dc tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:10.244035 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-30bf99e0-b8ef-4621-b0f4-6afe5e04c0dc tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:10.432686 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-30bf99e0-b8ef-4621-b0f4-6afe5e04c0dc tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:10.462063 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-30bf99e0-b8ef-4621-b0f4-6afe5e04c0dc tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245" status: 200 len: 1621 microversion: 2.1 time: 0.245545 Oct 26 13:24:10.462676 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2400/4814] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:24:10 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245 => generated 1621 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:24:10.472376 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-29eef490-2e2b-49f1-8713-5a712eb4ebff req-4cf73e6e-bd18-41c1-a4d9-85abe0db7224 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b93fff60-64e6-436d-9390-03d80438b245", "name": "network-vif-deleted", "tag": "85286063-c895-4327-af58-6433dca2108f"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:24:10.496663 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-29eef490-2e2b-49f1-8713-5a712eb4ebff req-4cf73e6e-bd18-41c1-a4d9-85abe0db7224 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:10.497218 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-29eef490-2e2b-49f1-8713-5a712eb4ebff req-4cf73e6e-bd18-41c1-a4d9-85abe0db7224 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:10.497714 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-29eef490-2e2b-49f1-8713-5a712eb4ebff req-4cf73e6e-bd18-41c1-a4d9-85abe0db7224 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:10.523466 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-29eef490-2e2b-49f1-8713-5a712eb4ebff req-4cf73e6e-bd18-41c1-a4d9-85abe0db7224 service nova] Creating event network-vif-deleted:85286063-c895-4327-af58-6433dca2108f for instance b93fff60-64e6-436d-9390-03d80438b245 on n-h2-862686-1 Oct 26 13:24:10.537201 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-29eef490-2e2b-49f1-8713-5a712eb4ebff req-4cf73e6e-bd18-41c1-a4d9-85abe0db7224 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068802 Oct 26 13:24:10.537878 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2401/4815] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:24:10.573424 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-886943d1-892e-4d39-8df4-9d20efbe074f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.753863 Oct 26 13:24:10.574066 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2415/4816] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 26 13:24:09 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa/os-interface => generated 284 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:24:10.735376 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-192b6bff-8e31-4faa-bb23-bfa5c0de1367 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:10.736957 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-192b6bff-8e31-4faa-bb23-bfa5c0de1367 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] [instance: 8d0efc10-ffb9-42b8-94a6-5f5b04afc62c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:10.745243 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-192b6bff-8e31-4faa-bb23-bfa5c0de1367 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:10.753123 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-192b6bff-8e31-4faa-bb23-bfa5c0de1367 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:10.753898 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-192b6bff-8e31-4faa-bb23-bfa5c0de1367 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:10.754825 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-192b6bff-8e31-4faa-bb23-bfa5c0de1367 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:10.755450 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-192b6bff-8e31-4faa-bb23-bfa5c0de1367 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:10.756050 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-192b6bff-8e31-4faa-bb23-bfa5c0de1367 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:11.249013 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-192b6bff-8e31-4faa-bb23-bfa5c0de1367 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd840518258f244a39e5f9187aecea309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f32124c6d5542db974ff96e2c68972e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:11.257081 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-192b6bff-8e31-4faa-bb23-bfa5c0de1367 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] 10.222.0.40 "GET /compute/v2.1/servers/8d0efc10-ffb9-42b8-94a6-5f5b04afc62c" status: 200 len: 1522 microversion: 2.1 time: 0.525846 Oct 26 13:24:11.262950 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2402/4817] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:24:10 2022] GET /compute/v2.1/servers/8d0efc10-ffb9-42b8-94a6-5f5b04afc62c => generated 1522 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:24:11.283840 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-51bdf790-be7b-47cb-ae7e-eed214f9e7d2 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:11.284500 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-51bdf790-be7b-47cb-ae7e-eed214f9e7d2 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] [instance: 8d0efc10-ffb9-42b8-94a6-5f5b04afc62c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:11.298788 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-51bdf790-be7b-47cb-ae7e-eed214f9e7d2 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:11.300096 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-51bdf790-be7b-47cb-ae7e-eed214f9e7d2 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:11.300637 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-51bdf790-be7b-47cb-ae7e-eed214f9e7d2 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:11.301454 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-51bdf790-be7b-47cb-ae7e-eed214f9e7d2 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:11.304942 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-51bdf790-be7b-47cb-ae7e-eed214f9e7d2 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:11.305514 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-51bdf790-be7b-47cb-ae7e-eed214f9e7d2 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:11.359488 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-51bdf790-be7b-47cb-ae7e-eed214f9e7d2 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] HTTP exception thrown: Instance is not a member of specified network Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-51bdf790-be7b-47cb-ae7e-eed214f9e7d2 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Request method failure captured: Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/8d0efc10-ffb9-42b8-94a6-5f5b04afc62c/ips/invalid HTTP/1.1 Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTTguidxqlfSvG6Mld9btbTd4ldjKhOdgiFvuKr1SYMF2RVF1JTW7sGmy3TpjPDBtW_9a3e62JDRT29EDaVJJ7wFEecr_aid6xWCg62Rmj--_hbPQ-exqhVS7Loc2T0HDI7Vdpnedqxr7qk5MDjgMGz8aaZPUTpUt1dCBZ-pt28EtXM Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 8f32124c6d5542db974ff96e2c68972e Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2087581852 Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8f32124c6d5542db974ff96e2c68972e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8f32124c6d5542db974ff96e2c68972e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8f32124c6d5542db974ff96e2c68972e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8f32124c6d5542db974ff96e2c68972e"}]}] Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2087581852 Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 8f32124c6d5542db974ff96e2c68972e Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2087581852 Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServerAddressesNegativeTestJSON-2087581852-project Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: d840518258f244a39e5f9187aecea309 Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2087581852-project Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance is not a member of specified network Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'server_id': '8d0efc10-ffb9-42b8-94a6-5f5b04afc62c', 'id': 'invalid'} Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 26 13:24:11.376719 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:24:11.382664 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-51bdf790-be7b-47cb-ae7e-eed214f9e7d2 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Returning 404 to user: Instance is not a member of specified network {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:24:11.383726 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-51bdf790-be7b-47cb-ae7e-eed214f9e7d2 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] 10.222.0.40 "GET /compute/v2.1/servers/8d0efc10-ffb9-42b8-94a6-5f5b04afc62c/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.105287 Oct 26 13:24:11.384483 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2416/4818] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 26 13:24:11 2022] GET /compute/v2.1/servers/8d0efc10-ffb9-42b8-94a6-5f5b04afc62c/ips/invalid => generated 91 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:24:11.398690 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-703764fa-7427-484a-8f48-e9e659be2b7c tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:11.401226 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-703764fa-7427-484a-8f48-e9e659be2b7c tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Failed to fetch instance by id 999 {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 26 13:24:11.402024 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-703764fa-7427-484a-8f48-e9e659be2b7c tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] HTTP exception thrown: Instance 999 could not be found. Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-703764fa-7427-484a-8f48-e9e659be2b7c tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Request method failure captured: Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTTguidxqlfSvG6Mld9btbTd4ldjKhOdgiFvuKr1SYMF2RVF1JTW7sGmy3TpjPDBtW_9a3e62JDRT29EDaVJJ7wFEecr_aid6xWCg62Rmj--_hbPQ-exqhVS7Loc2T0HDI7Vdpnedqxr7qk5MDjgMGz8aaZPUTpUt1dCBZ-pt28EtXM Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 8f32124c6d5542db974ff96e2c68972e Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2087581852 Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8f32124c6d5542db974ff96e2c68972e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8f32124c6d5542db974ff96e2c68972e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8f32124c6d5542db974ff96e2c68972e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8f32124c6d5542db974ff96e2c68972e"}]}] Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2087581852 Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 8f32124c6d5542db974ff96e2c68972e Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2087581852 Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServerAddressesNegativeTestJSON-2087581852-project Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: d840518258f244a39e5f9187aecea309 Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2087581852-project Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 999 could not be found. Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'server_id': '999'} Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 26 13:24:11.404594 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:24:11.411645 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-703764fa-7427-484a-8f48-e9e659be2b7c tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Returning 404 to user: Instance 999 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:24:11.416963 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-703764fa-7427-484a-8f48-e9e659be2b7c tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] 10.222.0.40 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.027009 Oct 26 13:24:11.420318 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2403/4819] 10.222.0.40 () {58 vars in 1149 bytes} [Wed Oct 26 13:24:11 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:24:11.431796 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a83edcca-fe86-4acc-aa0a-74cbb8129c09 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:11.432302 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a83edcca-fe86-4acc-aa0a-74cbb8129c09 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] [instance: 8d0efc10-ffb9-42b8-94a6-5f5b04afc62c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:11.444208 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a83edcca-fe86-4acc-aa0a-74cbb8129c09 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:11.449287 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a83edcca-fe86-4acc-aa0a-74cbb8129c09 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:11.449972 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a83edcca-fe86-4acc-aa0a-74cbb8129c09 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:11.450964 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a83edcca-fe86-4acc-aa0a-74cbb8129c09 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:11.451585 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a83edcca-fe86-4acc-aa0a-74cbb8129c09 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:11.454699 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a83edcca-fe86-4acc-aa0a-74cbb8129c09 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:11.492799 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5d89ce0c-70fc-4a1c-ae52-1faeea850219 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:11.493776 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5d89ce0c-70fc-4a1c-ae52-1faeea850219 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: b93fff60-64e6-436d-9390-03d80438b245] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:11.506524 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d89ce0c-70fc-4a1c-ae52-1faeea850219 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:11.509832 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d89ce0c-70fc-4a1c-ae52-1faeea850219 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:11.511072 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d89ce0c-70fc-4a1c-ae52-1faeea850219 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:11.513844 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d89ce0c-70fc-4a1c-ae52-1faeea850219 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:11.514582 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d89ce0c-70fc-4a1c-ae52-1faeea850219 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:11.516792 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d89ce0c-70fc-4a1c-ae52-1faeea850219 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:11.518541 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a83edcca-fe86-4acc-aa0a-74cbb8129c09 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] [instance: 8d0efc10-ffb9-42b8-94a6-5f5b04afc62c] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:24:11.555754 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-5d89ce0c-70fc-4a1c-ae52-1faeea850219 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] HTTP exception thrown: Instance b93fff60-64e6-436d-9390-03d80438b245 could not be found. Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5d89ce0c-70fc-4a1c-ae52-1faeea850219 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Request method failure captured: Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245 HTTP/1.1 Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTPjOuLV_n1DR58OZOmgbin2ud11sLWXOml70eL6_Yw9nM-eYNoCKOyZp3mck381-99yxZlLhlu2g6vQAmqZcUDv2ExrohfYX5ori3eOe3Uf6RO52e_TYIFS_DlKFRRKYqEp1KNMktjZRMuKeogboZRQrwA8baF1wLatF4_VyxhzXdo Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 9cdd45be745d4828b5a111472254156c Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1015154874 Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9cdd45be745d4828b5a111472254156c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9cdd45be745d4828b5a111472254156c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9cdd45be745d4828b5a111472254156c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9cdd45be745d4828b5a111472254156c"}]}] Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1015154874 Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 9cdd45be745d4828b5a111472254156c Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1015154874 Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServerRescueNegativeTestJSON-1015154874-project Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 363fc117da70484f9d8cf2040e8391e4 Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1015154874-project Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance b93fff60-64e6-436d-9390-03d80438b245 could not be found. Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'b93fff60-64e6-436d-9390-03d80438b245'} Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b93fff60-64e6-436d-9390-03d80438b245 could not be found. Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b93fff60-64e6-436d-9390-03d80438b245 could not be found. Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:24:11.561785 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:24:11.566757 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:24:11.566757 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:24:11.566757 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:24:11.566757 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:24:11.566757 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:24:11.566757 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:24:11.566757 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b93fff60-64e6-436d-9390-03d80438b245 could not be found. Oct 26 13:24:11.566757 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:24:11.571150 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5d89ce0c-70fc-4a1c-ae52-1faeea850219 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Returning 404 to user: Instance b93fff60-64e6-436d-9390-03d80438b245 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:24:11.572461 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5d89ce0c-70fc-4a1c-ae52-1faeea850219 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245" status: 404 len: 111 microversion: 2.1 time: 0.090654 Oct 26 13:24:11.576501 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2404/4820] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:24:11 2022] GET /compute/v2.1/servers/b93fff60-64e6-436d-9390-03d80438b245 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:24:11.591978 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3dc4a5ec-e8cb-4e9f-95c6-ac46f0784c0f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '.version_select at 0x7f6732ea84c0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:11.630507 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3dc4a5ec-e8cb-4e9f-95c6-ac46f0784c0f tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-442852260" status: 202 len: 0 microversion: 2.1 time: 0.044426 Oct 26 13:24:11.630507 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2405/4821] 10.222.0.40 () {58 vars in 1218 bytes} [Wed Oct 26 13:24:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-442852260 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:24:11.711272 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a83edcca-fe86-4acc-aa0a-74cbb8129c09 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8d0efc10-ffb9-42b8-94a6-5f5b04afc62c" status: 204 len: 0 microversion: 2.1 time: 0.283742 Oct 26 13:24:11.713722 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2417/4822] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:24:11 2022] DELETE /compute/v2.1/servers/8d0efc10-ffb9-42b8-94a6-5f5b04afc62c => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:24:11.725670 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8bb2fd3d-9e2e-4ccf-a3e8-63d4c945bfba tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:11.726628 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8bb2fd3d-9e2e-4ccf-a3e8-63d4c945bfba tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] [instance: 8d0efc10-ffb9-42b8-94a6-5f5b04afc62c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:11.739562 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8bb2fd3d-9e2e-4ccf-a3e8-63d4c945bfba tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:11.742301 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8bb2fd3d-9e2e-4ccf-a3e8-63d4c945bfba tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:11.744007 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8bb2fd3d-9e2e-4ccf-a3e8-63d4c945bfba tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:11.744814 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8bb2fd3d-9e2e-4ccf-a3e8-63d4c945bfba tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:11.745304 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8bb2fd3d-9e2e-4ccf-a3e8-63d4c945bfba tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:11.747452 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8bb2fd3d-9e2e-4ccf-a3e8-63d4c945bfba tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:11.887921 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-292835d4-4886-4115-b879-e48d7a39a6bd tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:11.888898 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-292835d4-4886-4115-b879-e48d7a39a6bd tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:11.903358 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-292835d4-4886-4115-b879-e48d7a39a6bd tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:11.906946 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-292835d4-4886-4115-b879-e48d7a39a6bd tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:11.907678 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-292835d4-4886-4115-b879-e48d7a39a6bd tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:11.908848 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-292835d4-4886-4115-b879-e48d7a39a6bd tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:11.909828 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-292835d4-4886-4115-b879-e48d7a39a6bd tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:11.910547 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-292835d4-4886-4115-b879-e48d7a39a6bd tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:11.926251 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-292835d4-4886-4115-b879-e48d7a39a6bd tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] HTTP exception thrown: Instance 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6 could not be found. Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-292835d4-4886-4115-b879-e48d7a39a6bd tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Request method failure captured: Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: request: DELETE /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6 HTTP/1.1 Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTN7hbeapRmCcJ7igmy85vPoyVUVlZs2lSyAhZOIYOdPPfznAhHwx6i5N6See2TtMCVfoGB5ZRVOrV-z1bLtOTx-4VqQeaegU1xtipleMye9s0u-EdRknvwJp_xukT9e7b9VNOVvc51B0c1CP47_BIErFpV-aKSN5cSTtBHmEVuwcek Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: e1f158446a544e5680969f4ef7512e49 Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-AttachVolumeTestJSON-1520608711 Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e1f158446a544e5680969f4ef7512e49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e1f158446a544e5680969f4ef7512e49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e1f158446a544e5680969f4ef7512e49"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e1f158446a544e5680969f4ef7512e49"}]}] Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-AttachVolumeTestJSON-1520608711 Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: e1f158446a544e5680969f4ef7512e49 Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1520608711 Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-AttachVolumeTestJSON-1520608711-project Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 0b457ab0af5e41b1a1e10290b67656a7 Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-AttachVolumeTestJSON-1520608711-project Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6 could not be found. Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '30dcd11b-b8ec-4095-a7d8-73ce795aeaa6'} Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6 could not be found. Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:24:11.928184 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:24:11.932858 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6 could not be found. Oct 26 13:24:11.932858 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:24:11.932858 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:24:11.932858 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:24:11.932858 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:24:11.932858 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:24:11.932858 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:24:11.932858 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:24:11.932858 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:24:11.932858 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6 could not be found. Oct 26 13:24:11.932858 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:24:11.934476 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-292835d4-4886-4115-b879-e48d7a39a6bd tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Returning 404 to user: Instance 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:24:11.935508 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-292835d4-4886-4115-b879-e48d7a39a6bd tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "DELETE /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6" status: 404 len: 111 microversion: 2.1 time: 0.052416 Oct 26 13:24:11.936578 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2418/4823] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:24:11 2022] DELETE /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 13:24:11.945147 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9be920ff-a503-402b-9199-9d2becd57261 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:11.947027 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9be920ff-a503-402b-9199-9d2becd57261 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:11.957976 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9be920ff-a503-402b-9199-9d2becd57261 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:11.958485 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9be920ff-a503-402b-9199-9d2becd57261 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:11.958984 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9be920ff-a503-402b-9199-9d2becd57261 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:11.959982 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9be920ff-a503-402b-9199-9d2becd57261 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:11.962948 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9be920ff-a503-402b-9199-9d2becd57261 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:11.963653 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9be920ff-a503-402b-9199-9d2becd57261 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:11.981395 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-9be920ff-a503-402b-9199-9d2becd57261 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] HTTP exception thrown: Instance 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6 could not be found. Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9be920ff-a503-402b-9199-9d2becd57261 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Request method failure captured: Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6 HTTP/1.1 Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTN7hbeapRmCcJ7igmy85vPoyVUVlZs2lSyAhZOIYOdPPfznAhHwx6i5N6See2TtMCVfoGB5ZRVOrV-z1bLtOTx-4VqQeaegU1xtipleMye9s0u-EdRknvwJp_xukT9e7b9VNOVvc51B0c1CP47_BIErFpV-aKSN5cSTtBHmEVuwcek Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: e1f158446a544e5680969f4ef7512e49 Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-AttachVolumeTestJSON-1520608711 Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e1f158446a544e5680969f4ef7512e49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e1f158446a544e5680969f4ef7512e49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e1f158446a544e5680969f4ef7512e49"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e1f158446a544e5680969f4ef7512e49"}]}] Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-AttachVolumeTestJSON-1520608711 Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: e1f158446a544e5680969f4ef7512e49 Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1520608711 Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-AttachVolumeTestJSON-1520608711-project Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 0b457ab0af5e41b1a1e10290b67656a7 Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-AttachVolumeTestJSON-1520608711-project Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6 could not be found. Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '30dcd11b-b8ec-4095-a7d8-73ce795aeaa6'} Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6 could not be found. Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6 could not be found. Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:24:11.983057 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:24:11.991149 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:24:11.991149 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:24:11.991149 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:24:11.991149 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:24:11.991149 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:24:11.991149 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6 could not be found. Oct 26 13:24:11.991149 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:24:11.991149 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9be920ff-a503-402b-9199-9d2becd57261 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Returning 404 to user: Instance 30dcd11b-b8ec-4095-a7d8-73ce795aeaa6 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:24:11.991149 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9be920ff-a503-402b-9199-9d2becd57261 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6" status: 404 len: 111 microversion: 2.1 time: 0.043293 Oct 26 13:24:11.991149 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2419/4824] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:24:11 2022] GET /compute/v2.1/servers/30dcd11b-b8ec-4095-a7d8-73ce795aeaa6 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:24:12.533311 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8bb2fd3d-9e2e-4ccf-a3e8-63d4c945bfba tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd840518258f244a39e5f9187aecea309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f32124c6d5542db974ff96e2c68972e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:12.553774 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8bb2fd3d-9e2e-4ccf-a3e8-63d4c945bfba tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] 10.222.0.40 "GET /compute/v2.1/servers/8d0efc10-ffb9-42b8-94a6-5f5b04afc62c" status: 200 len: 1528 microversion: 2.1 time: 0.834567 Oct 26 13:24:12.558841 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2406/4825] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:24:11 2022] GET /compute/v2.1/servers/8d0efc10-ffb9-42b8-94a6-5f5b04afc62c => generated 1528 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:24:13.584930 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9af63047-38ec-4ae7-80e1-a8409cef0f53 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:13.586243 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9af63047-38ec-4ae7-80e1-a8409cef0f53 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] [instance: 8d0efc10-ffb9-42b8-94a6-5f5b04afc62c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:13.602147 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9af63047-38ec-4ae7-80e1-a8409cef0f53 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:13.602744 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9af63047-38ec-4ae7-80e1-a8409cef0f53 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:13.603424 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9af63047-38ec-4ae7-80e1-a8409cef0f53 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:13.605059 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9af63047-38ec-4ae7-80e1-a8409cef0f53 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:13.605817 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9af63047-38ec-4ae7-80e1-a8409cef0f53 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:13.612178 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9af63047-38ec-4ae7-80e1-a8409cef0f53 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:14.295770 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9af63047-38ec-4ae7-80e1-a8409cef0f53 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd840518258f244a39e5f9187aecea309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f32124c6d5542db974ff96e2c68972e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:14.304789 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9af63047-38ec-4ae7-80e1-a8409cef0f53 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] 10.222.0.40 "GET /compute/v2.1/servers/8d0efc10-ffb9-42b8-94a6-5f5b04afc62c" status: 200 len: 1528 microversion: 2.1 time: 0.725698 Oct 26 13:24:14.309169 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2420/4826] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:24:13 2022] GET /compute/v2.1/servers/8d0efc10-ffb9-42b8-94a6-5f5b04afc62c => generated 1528 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:24:14.595129 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-15198985-b485-46a0-bc37-cf4154f32601 req-505e5b0a-d59a-4239-bee4-72e641b86dd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "341d8b3a-d684-4969-a5cf-a6aea1a055fa", "tag": "391606bb-b0ec-4759-b9bd-53c1cc5c2f7c"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:24:14.616783 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-15198985-b485-46a0-bc37-cf4154f32601 req-505e5b0a-d59a-4239-bee4-72e641b86dd4 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:14.617562 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-15198985-b485-46a0-bc37-cf4154f32601 req-505e5b0a-d59a-4239-bee4-72e641b86dd4 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:14.618455 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-15198985-b485-46a0-bc37-cf4154f32601 req-505e5b0a-d59a-4239-bee4-72e641b86dd4 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:14.642086 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-15198985-b485-46a0-bc37-cf4154f32601 req-505e5b0a-d59a-4239-bee4-72e641b86dd4 service nova] Creating event network-changed:391606bb-b0ec-4759-b9bd-53c1cc5c2f7c for instance 341d8b3a-d684-4969-a5cf-a6aea1a055fa on n-h1-862686-1 Oct 26 13:24:14.660871 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-15198985-b485-46a0-bc37-cf4154f32601 req-505e5b0a-d59a-4239-bee4-72e641b86dd4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070708 Oct 26 13:24:14.661569 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2407/4827] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:24:15.335371 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-29c58f67-3190-4134-9824-16a6eed0c5dc tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:15.336008 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-29c58f67-3190-4134-9824-16a6eed0c5dc tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] [instance: 8d0efc10-ffb9-42b8-94a6-5f5b04afc62c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:15.342772 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29c58f67-3190-4134-9824-16a6eed0c5dc tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:15.349462 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29c58f67-3190-4134-9824-16a6eed0c5dc tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:15.349918 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29c58f67-3190-4134-9824-16a6eed0c5dc tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:15.350699 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29c58f67-3190-4134-9824-16a6eed0c5dc tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:15.351186 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29c58f67-3190-4134-9824-16a6eed0c5dc tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:15.351620 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29c58f67-3190-4134-9824-16a6eed0c5dc tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:15.526648 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-29c58f67-3190-4134-9824-16a6eed0c5dc tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd840518258f244a39e5f9187aecea309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f32124c6d5542db974ff96e2c68972e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:15.535458 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-29c58f67-3190-4134-9824-16a6eed0c5dc tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] 10.222.0.40 "GET /compute/v2.1/servers/8d0efc10-ffb9-42b8-94a6-5f5b04afc62c" status: 200 len: 1310 microversion: 2.1 time: 0.204241 Oct 26 13:24:15.542921 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2421/4828] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:24:15 2022] GET /compute/v2.1/servers/8d0efc10-ffb9-42b8-94a6-5f5b04afc62c => generated 1310 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:24:16.573840 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-eebf3182-bea4-4749-b03d-ec00fd7d9081 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:16.574552 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-eebf3182-bea4-4749-b03d-ec00fd7d9081 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] [instance: 8d0efc10-ffb9-42b8-94a6-5f5b04afc62c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:16.597337 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eebf3182-bea4-4749-b03d-ec00fd7d9081 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:16.597870 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eebf3182-bea4-4749-b03d-ec00fd7d9081 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:16.598712 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eebf3182-bea4-4749-b03d-ec00fd7d9081 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:16.600642 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eebf3182-bea4-4749-b03d-ec00fd7d9081 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:16.602079 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eebf3182-bea4-4749-b03d-ec00fd7d9081 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:16.604807 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eebf3182-bea4-4749-b03d-ec00fd7d9081 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:16.625442 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-eebf3182-bea4-4749-b03d-ec00fd7d9081 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] HTTP exception thrown: Instance 8d0efc10-ffb9-42b8-94a6-5f5b04afc62c could not be found. Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-eebf3182-bea4-4749-b03d-ec00fd7d9081 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Request method failure captured: Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/8d0efc10-ffb9-42b8-94a6-5f5b04afc62c HTTP/1.1 Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTTguidxqlfSvG6Mld9btbTd4ldjKhOdgiFvuKr1SYMF2RVF1JTW7sGmy3TpjPDBtW_9a3e62JDRT29EDaVJJ7wFEecr_aid6xWCg62Rmj--_hbPQ-exqhVS7Loc2T0HDI7Vdpnedqxr7qk5MDjgMGz8aaZPUTpUt1dCBZ-pt28EtXM Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 8f32124c6d5542db974ff96e2c68972e Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2087581852 Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8f32124c6d5542db974ff96e2c68972e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8f32124c6d5542db974ff96e2c68972e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8f32124c6d5542db974ff96e2c68972e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8f32124c6d5542db974ff96e2c68972e"}]}] Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2087581852 Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 8f32124c6d5542db974ff96e2c68972e Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2087581852 Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServerAddressesNegativeTestJSON-2087581852-project Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: d840518258f244a39e5f9187aecea309 Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2087581852-project Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 8d0efc10-ffb9-42b8-94a6-5f5b04afc62c could not be found. Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '8d0efc10-ffb9-42b8-94a6-5f5b04afc62c'} Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d0efc10-ffb9-42b8-94a6-5f5b04afc62c could not be found. Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d0efc10-ffb9-42b8-94a6-5f5b04afc62c could not be found. Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:24:16.627973 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:24:16.632843 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:24:16.632843 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:24:16.632843 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:24:16.632843 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:24:16.632843 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:24:16.632843 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:24:16.632843 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d0efc10-ffb9-42b8-94a6-5f5b04afc62c could not be found. Oct 26 13:24:16.632843 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:24:16.634611 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-eebf3182-bea4-4749-b03d-ec00fd7d9081 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] Returning 404 to user: Instance 8d0efc10-ffb9-42b8-94a6-5f5b04afc62c could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:24:16.635870 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-eebf3182-bea4-4749-b03d-ec00fd7d9081 tempest-ServerAddressesNegativeTestJSON-2087581852 tempest-ServerAddressesNegativeTestJSON-2087581852-project] 10.222.0.40 "GET /compute/v2.1/servers/8d0efc10-ffb9-42b8-94a6-5f5b04afc62c" status: 404 len: 111 microversion: 2.1 time: 0.068417 Oct 26 13:24:16.641937 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2408/4829] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:24:16 2022] GET /compute/v2.1/servers/8d0efc10-ffb9-42b8-94a6-5f5b04afc62c => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:24:16.709972 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-3b9a6184-bb6e-4d85-90ab-d3542311e19f req-4b878904-b15f-4feb-a586-89ce6e806a4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d0efc10-ffb9-42b8-94a6-5f5b04afc62c", "name": "network-vif-deleted", "tag": "01e5c4db-518d-4118-92ee-decbc8e44521"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:24:16.734748 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-3b9a6184-bb6e-4d85-90ab-d3542311e19f req-4b878904-b15f-4feb-a586-89ce6e806a4b service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:16.750085 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-3b9a6184-bb6e-4d85-90ab-d3542311e19f req-4b878904-b15f-4feb-a586-89ce6e806a4b service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:16.750679 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-3b9a6184-bb6e-4d85-90ab-d3542311e19f req-4b878904-b15f-4feb-a586-89ce6e806a4b service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:16.790469 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-3b9a6184-bb6e-4d85-90ab-d3542311e19f req-4b878904-b15f-4feb-a586-89ce6e806a4b service nova] Creating event network-vif-deleted:01e5c4db-518d-4118-92ee-decbc8e44521 for instance 8d0efc10-ffb9-42b8-94a6-5f5b04afc62c on n-h2-862686-1 Oct 26 13:24:16.817183 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-3b9a6184-bb6e-4d85-90ab-d3542311e19f req-4b878904-b15f-4feb-a586-89ce6e806a4b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111051 Oct 26 13:24:16.818082 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2422/4830] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:24:17.641519 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ecdb8e16-e819-47a5-a4e7-bd74fc895e29 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:17.642733 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ecdb8e16-e819-47a5-a4e7-bd74fc895e29 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:17.654367 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ecdb8e16-e819-47a5-a4e7-bd74fc895e29 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:17.655311 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ecdb8e16-e819-47a5-a4e7-bd74fc895e29 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:17.659766 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ecdb8e16-e819-47a5-a4e7-bd74fc895e29 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:17.660663 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ecdb8e16-e819-47a5-a4e7-bd74fc895e29 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:17.662793 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ecdb8e16-e819-47a5-a4e7-bd74fc895e29 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:17.663253 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ecdb8e16-e819-47a5-a4e7-bd74fc895e29 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:17.695446 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-ecdb8e16-e819-47a5-a4e7-bd74fc895e29 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] HTTP exception thrown: Instance 9c1ed300-eac2-4e60-a903-2f17e7df792c could not be found. Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ecdb8e16-e819-47a5-a4e7-bd74fc895e29 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Request method failure captured: Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c HTTP/1.1 Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTN7hbeapRmCcJ7igmy85vPoyVUVlZs2lSyAhZOIYOdPPfznAhHwx6i5N6See2TtMCVfoGB5ZRVOrV-z1bLtOTx-4VqQeaegU1xtipleMye9s0u-EdRknvwJp_xukT9e7b9VNOVvc51B0c1CP47_BIErFpV-aKSN5cSTtBHmEVuwcek Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: e1f158446a544e5680969f4ef7512e49 Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-AttachVolumeTestJSON-1520608711 Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e1f158446a544e5680969f4ef7512e49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e1f158446a544e5680969f4ef7512e49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e1f158446a544e5680969f4ef7512e49"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e1f158446a544e5680969f4ef7512e49"}]}] Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-AttachVolumeTestJSON-1520608711 Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: e1f158446a544e5680969f4ef7512e49 Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1520608711 Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-AttachVolumeTestJSON-1520608711-project Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 0b457ab0af5e41b1a1e10290b67656a7 Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-AttachVolumeTestJSON-1520608711-project Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 9c1ed300-eac2-4e60-a903-2f17e7df792c could not be found. Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '9c1ed300-eac2-4e60-a903-2f17e7df792c'} Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c1ed300-eac2-4e60-a903-2f17e7df792c could not be found. Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:24:17.697327 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:24:17.702123 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c1ed300-eac2-4e60-a903-2f17e7df792c could not be found. Oct 26 13:24:17.702123 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:24:17.702123 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:24:17.702123 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:24:17.702123 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:24:17.702123 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:24:17.702123 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:24:17.702123 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:24:17.702123 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:24:17.702123 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c1ed300-eac2-4e60-a903-2f17e7df792c could not be found. Oct 26 13:24:17.702123 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:24:17.706524 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ecdb8e16-e819-47a5-a4e7-bd74fc895e29 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Returning 404 to user: Instance 9c1ed300-eac2-4e60-a903-2f17e7df792c could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:24:17.707915 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ecdb8e16-e819-47a5-a4e7-bd74fc895e29 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c" status: 404 len: 111 microversion: 2.1 time: 0.070476 Oct 26 13:24:17.714302 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2409/4831] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:24:17 2022] DELETE /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:24:17.719733 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4962944c-98ca-4212-b75f-a8194fb10c41 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:17.720438 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4962944c-98ca-4212-b75f-a8194fb10c41 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] [instance: 9c1ed300-eac2-4e60-a903-2f17e7df792c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:17.728918 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4962944c-98ca-4212-b75f-a8194fb10c41 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:17.729409 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4962944c-98ca-4212-b75f-a8194fb10c41 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:17.729866 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4962944c-98ca-4212-b75f-a8194fb10c41 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:17.730572 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4962944c-98ca-4212-b75f-a8194fb10c41 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:17.731027 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4962944c-98ca-4212-b75f-a8194fb10c41 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:17.731449 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4962944c-98ca-4212-b75f-a8194fb10c41 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:17.770918 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-4962944c-98ca-4212-b75f-a8194fb10c41 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] HTTP exception thrown: Instance 9c1ed300-eac2-4e60-a903-2f17e7df792c could not be found. Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4962944c-98ca-4212-b75f-a8194fb10c41 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Request method failure captured: Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c HTTP/1.1 Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTN7hbeapRmCcJ7igmy85vPoyVUVlZs2lSyAhZOIYOdPPfznAhHwx6i5N6See2TtMCVfoGB5ZRVOrV-z1bLtOTx-4VqQeaegU1xtipleMye9s0u-EdRknvwJp_xukT9e7b9VNOVvc51B0c1CP47_BIErFpV-aKSN5cSTtBHmEVuwcek Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: e1f158446a544e5680969f4ef7512e49 Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-AttachVolumeTestJSON-1520608711 Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e1f158446a544e5680969f4ef7512e49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e1f158446a544e5680969f4ef7512e49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e1f158446a544e5680969f4ef7512e49"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e1f158446a544e5680969f4ef7512e49"}]}] Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-AttachVolumeTestJSON-1520608711 Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: e1f158446a544e5680969f4ef7512e49 Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1520608711 Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-AttachVolumeTestJSON-1520608711-project Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 0b457ab0af5e41b1a1e10290b67656a7 Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-AttachVolumeTestJSON-1520608711-project Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 9c1ed300-eac2-4e60-a903-2f17e7df792c could not be found. Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '9c1ed300-eac2-4e60-a903-2f17e7df792c'} Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c1ed300-eac2-4e60-a903-2f17e7df792c could not be found. Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c1ed300-eac2-4e60-a903-2f17e7df792c could not be found. Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:24:17.772596 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:24:17.777918 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:24:17.777918 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:24:17.777918 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:24:17.777918 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:24:17.777918 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:24:17.777918 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c1ed300-eac2-4e60-a903-2f17e7df792c could not be found. Oct 26 13:24:17.777918 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:24:17.777918 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4962944c-98ca-4212-b75f-a8194fb10c41 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] Returning 404 to user: Instance 9c1ed300-eac2-4e60-a903-2f17e7df792c could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:24:17.790431 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4962944c-98ca-4212-b75f-a8194fb10c41 tempest-AttachVolumeTestJSON-1520608711 tempest-AttachVolumeTestJSON-1520608711-project] 10.222.0.40 "GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c" status: 404 len: 111 microversion: 2.1 time: 0.074692 Oct 26 13:24:17.791507 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2423/4832] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:24:17 2022] GET /compute/v2.1/servers/9c1ed300-eac2-4e60-a903-2f17e7df792c => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:24:23.906329 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d8e2ee2f-e1c0-419f-977d-51d84b879fb9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:23.906958 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d8e2ee2f-e1c0-419f-977d-51d84b879fb9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 53426b7d-0bba-46ce-ab7e-32451f413745] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:23.920761 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8e2ee2f-e1c0-419f-977d-51d84b879fb9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:23.924884 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8e2ee2f-e1c0-419f-977d-51d84b879fb9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:23.925758 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8e2ee2f-e1c0-419f-977d-51d84b879fb9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:23.927979 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8e2ee2f-e1c0-419f-977d-51d84b879fb9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:23.932448 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8e2ee2f-e1c0-419f-977d-51d84b879fb9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:23.933059 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8e2ee2f-e1c0-419f-977d-51d84b879fb9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:24.005440 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d8e2ee2f-e1c0-419f-977d-51d84b879fb9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 53426b7d-0bba-46ce-ab7e-32451f413745] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:24:24.093460 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:24:24.228431 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d8e2ee2f-e1c0-419f-977d-51d84b879fb9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "DELETE /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745" status: 204 len: 0 microversion: 2.1 time: 0.323953 Oct 26 13:24:24.231746 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2410/4833] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:24:23 2022] DELETE /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:24:24.246531 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-84db253c-2a8d-4bf3-ae69-eacf8d05e9b3 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:24.247333 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-84db253c-2a8d-4bf3-ae69-eacf8d05e9b3 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 53426b7d-0bba-46ce-ab7e-32451f413745] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:24.259117 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84db253c-2a8d-4bf3-ae69-eacf8d05e9b3 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:24.261513 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84db253c-2a8d-4bf3-ae69-eacf8d05e9b3 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:24.262130 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84db253c-2a8d-4bf3-ae69-eacf8d05e9b3 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:24.263395 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84db253c-2a8d-4bf3-ae69-eacf8d05e9b3 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:24.263993 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84db253c-2a8d-4bf3-ae69-eacf8d05e9b3 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:24.264499 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84db253c-2a8d-4bf3-ae69-eacf8d05e9b3 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:24.859508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-84db253c-2a8d-4bf3-ae69-eacf8d05e9b3 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:24.886511 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-84db253c-2a8d-4bf3-ae69-eacf8d05e9b3 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745" status: 200 len: 1508 microversion: 2.1 time: 0.650161 Oct 26 13:24:24.890667 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2424/4834] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:24:24 2022] GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745 => generated 1508 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:24:25.913680 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ac8fe6fc-898c-4ffe-985a-030735c36da1 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:25.914444 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ac8fe6fc-898c-4ffe-985a-030735c36da1 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 53426b7d-0bba-46ce-ab7e-32451f413745] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:25.930325 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ac8fe6fc-898c-4ffe-985a-030735c36da1 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:25.933227 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ac8fe6fc-898c-4ffe-985a-030735c36da1 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:25.933846 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ac8fe6fc-898c-4ffe-985a-030735c36da1 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:25.942764 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ac8fe6fc-898c-4ffe-985a-030735c36da1 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:25.943254 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ac8fe6fc-898c-4ffe-985a-030735c36da1 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:25.943904 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ac8fe6fc-898c-4ffe-985a-030735c36da1 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:26.747296 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ac8fe6fc-898c-4ffe-985a-030735c36da1 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:26.758282 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ac8fe6fc-898c-4ffe-985a-030735c36da1 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745" status: 200 len: 1508 microversion: 2.1 time: 0.849316 Oct 26 13:24:26.762264 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2411/4835] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:24:25 2022] GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745 => generated 1508 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:24:27.788535 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5426e78d-2bb1-44a3-affc-cb270f181fec tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:27.789166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5426e78d-2bb1-44a3-affc-cb270f181fec tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 53426b7d-0bba-46ce-ab7e-32451f413745] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:27.797222 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5426e78d-2bb1-44a3-affc-cb270f181fec tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:27.798363 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5426e78d-2bb1-44a3-affc-cb270f181fec tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:27.799200 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5426e78d-2bb1-44a3-affc-cb270f181fec tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:27.800095 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5426e78d-2bb1-44a3-affc-cb270f181fec tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:27.800750 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5426e78d-2bb1-44a3-affc-cb270f181fec tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:27.801368 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5426e78d-2bb1-44a3-affc-cb270f181fec tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:28.309233 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5426e78d-2bb1-44a3-affc-cb270f181fec tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:28.331825 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5426e78d-2bb1-44a3-affc-cb270f181fec tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745" status: 200 len: 1466 microversion: 2.1 time: 0.545919 Oct 26 13:24:28.332836 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2425/4836] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:24:27 2022] GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745 => generated 1466 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:24:28.502583 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-af4d8d17-eae1-4fd1-beea-50d2600ddd65 req-c94425bc-ca00-4df6-9168-142ef6c148b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53426b7d-0bba-46ce-ab7e-32451f413745", "name": "network-vif-deleted", "tag": "db0d2628-762c-46cd-b5ff-d3ca7355ba01"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:24:28.549052 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-af4d8d17-eae1-4fd1-beea-50d2600ddd65 req-c94425bc-ca00-4df6-9168-142ef6c148b8 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:28.549991 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-af4d8d17-eae1-4fd1-beea-50d2600ddd65 req-c94425bc-ca00-4df6-9168-142ef6c148b8 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:28.560395 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-af4d8d17-eae1-4fd1-beea-50d2600ddd65 req-c94425bc-ca00-4df6-9168-142ef6c148b8 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:28.592837 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-af4d8d17-eae1-4fd1-beea-50d2600ddd65 req-c94425bc-ca00-4df6-9168-142ef6c148b8 service nova] Creating event network-vif-deleted:db0d2628-762c-46cd-b5ff-d3ca7355ba01 for instance 53426b7d-0bba-46ce-ab7e-32451f413745 on n-h1-862686-1 Oct 26 13:24:28.611090 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-af4d8d17-eae1-4fd1-beea-50d2600ddd65 req-c94425bc-ca00-4df6-9168-142ef6c148b8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118456 Oct 26 13:24:28.613279 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2412/4837] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:24:29.356303 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ddf4b1eb-f6b2-4893-992c-8bfa095232a7 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:29.358788 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ddf4b1eb-f6b2-4893-992c-8bfa095232a7 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 53426b7d-0bba-46ce-ab7e-32451f413745] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:29.362827 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:24:29.371903 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ddf4b1eb-f6b2-4893-992c-8bfa095232a7 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:29.372970 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ddf4b1eb-f6b2-4893-992c-8bfa095232a7 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:29.374436 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ddf4b1eb-f6b2-4893-992c-8bfa095232a7 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:29.376137 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ddf4b1eb-f6b2-4893-992c-8bfa095232a7 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:29.377312 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ddf4b1eb-f6b2-4893-992c-8bfa095232a7 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:29.378038 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ddf4b1eb-f6b2-4893-992c-8bfa095232a7 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:29.477519 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ddf4b1eb-f6b2-4893-992c-8bfa095232a7 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:29.479129 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ddf4b1eb-f6b2-4893-992c-8bfa095232a7 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:29.480605 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ddf4b1eb-f6b2-4893-992c-8bfa095232a7 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:29.481959 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-ddf4b1eb-f6b2-4893-992c-8bfa095232a7 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lazy-loading 'fault' on Instance uuid 53426b7d-0bba-46ce-ab7e-32451f413745 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:24:29.553305 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ddf4b1eb-f6b2-4893-992c-8bfa095232a7 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:29.571206 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ddf4b1eb-f6b2-4893-992c-8bfa095232a7 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745" status: 200 len: 1311 microversion: 2.1 time: 0.219563 Oct 26 13:24:29.573544 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2413/4838] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:24:29 2022] GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745 => generated 1311 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:24:29.793339 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9087887d-448a-4e49-902b-a37eba07cdac tempest-VolumesGetTestJSON-791088247 tempest-VolumesGetTestJSON-791088247-project] Action: 'create', calling method: .version_select at 0x7f67369848b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-23762232", "metadata": {"Type": "work"}}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:24:30.253543 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9087887d-448a-4e49-902b-a37eba07cdac tempest-VolumesGetTestJSON-791088247 tempest-VolumesGetTestJSON-791088247-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 0.948097 Oct 26 13:24:30.254489 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2426/4839] 10.222.0.40 () {60 vars in 1156 bytes} [Wed Oct 26 13:24:29 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 950 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 26 13:24:30.276028 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-863dd278-2195-44e2-bd38-18829dfadba2 tempest-VolumesGetTestJSON-791088247 tempest-VolumesGetTestJSON-791088247-project] Calling method '.version_select at 0x7f673213b430>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:30.355143 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-863dd278-2195-44e2-bd38-18829dfadba2 tempest-VolumesGetTestJSON-791088247 tempest-VolumesGetTestJSON-791088247-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/e868bb00-fd61-4845-8e15-0e3e3b9bd617" status: 200 len: 351 microversion: 2.1 time: 0.087638 Oct 26 13:24:30.357765 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2414/4840] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Oct 26 13:24:30 2022] GET /compute/v2.1/os-volumes/e868bb00-fd61-4845-8e15-0e3e3b9bd617 => generated 351 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:24:30.599196 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2ba156d8-1c62-4590-a91f-5496b64ec6ca tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:30.599916 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2ba156d8-1c62-4590-a91f-5496b64ec6ca tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 53426b7d-0bba-46ce-ab7e-32451f413745] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:30.612689 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ba156d8-1c62-4590-a91f-5496b64ec6ca tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:30.613887 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ba156d8-1c62-4590-a91f-5496b64ec6ca tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:30.615344 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ba156d8-1c62-4590-a91f-5496b64ec6ca tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:30.616623 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ba156d8-1c62-4590-a91f-5496b64ec6ca tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:30.617806 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ba156d8-1c62-4590-a91f-5496b64ec6ca tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:30.618460 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ba156d8-1c62-4590-a91f-5496b64ec6ca tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:30.640802 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-2ba156d8-1c62-4590-a91f-5496b64ec6ca tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] HTTP exception thrown: Instance 53426b7d-0bba-46ce-ab7e-32451f413745 could not be found. Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2ba156d8-1c62-4590-a91f-5496b64ec6ca tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Request method failure captured: Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745 HTTP/1.1 Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTPjOuLV_n1DR58OZOmgbin2ud11sLWXOml70eL6_Yw9nM-eYNoCKOyZp3mck381-99yxZlLhlu2g6vQAmqZcUDv2ExrohfYX5ori3eOe3Uf6RO52e_TYIFS_DlKFRRKYqEp1KNMktjZRMuKeogboZRQrwA8baF1wLatF4_VyxhzXdo Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 9cdd45be745d4828b5a111472254156c Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1015154874 Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9cdd45be745d4828b5a111472254156c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9cdd45be745d4828b5a111472254156c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9cdd45be745d4828b5a111472254156c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9cdd45be745d4828b5a111472254156c"}]}] Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1015154874 Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 9cdd45be745d4828b5a111472254156c Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1015154874 Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServerRescueNegativeTestJSON-1015154874-project Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 363fc117da70484f9d8cf2040e8391e4 Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1015154874-project Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 53426b7d-0bba-46ce-ab7e-32451f413745 could not be found. Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '53426b7d-0bba-46ce-ab7e-32451f413745'} Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53426b7d-0bba-46ce-ab7e-32451f413745 could not be found. Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53426b7d-0bba-46ce-ab7e-32451f413745 could not be found. Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:24:30.645245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:24:30.649700 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:24:30.649700 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:24:30.649700 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:24:30.649700 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:24:30.649700 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:24:30.649700 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:24:30.649700 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53426b7d-0bba-46ce-ab7e-32451f413745 could not be found. Oct 26 13:24:30.649700 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:24:30.651458 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2ba156d8-1c62-4590-a91f-5496b64ec6ca tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Returning 404 to user: Instance 53426b7d-0bba-46ce-ab7e-32451f413745 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:24:30.652485 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2ba156d8-1c62-4590-a91f-5496b64ec6ca tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745" status: 404 len: 111 microversion: 2.1 time: 0.060629 Oct 26 13:24:30.653964 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2427/4841] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:24:30 2022] GET /compute/v2.1/servers/53426b7d-0bba-46ce-ab7e-32451f413745 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 13:24:30.665111 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2e5d747d-3a88-4757-8683-1f1dfdfd8ff5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:30.666549 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2e5d747d-3a88-4757-8683-1f1dfdfd8ff5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 97825703-89d9-457a-b6c3-b694f8eee97c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:30.683239 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e5d747d-3a88-4757-8683-1f1dfdfd8ff5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:30.684004 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e5d747d-3a88-4757-8683-1f1dfdfd8ff5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:30.685022 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e5d747d-3a88-4757-8683-1f1dfdfd8ff5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:30.686010 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e5d747d-3a88-4757-8683-1f1dfdfd8ff5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:30.687066 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e5d747d-3a88-4757-8683-1f1dfdfd8ff5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:30.687672 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e5d747d-3a88-4757-8683-1f1dfdfd8ff5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:30.729285 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2e5d747d-3a88-4757-8683-1f1dfdfd8ff5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 97825703-89d9-457a-b6c3-b694f8eee97c] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:24:30.904432 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2e5d747d-3a88-4757-8683-1f1dfdfd8ff5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "DELETE /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c" status: 204 len: 0 microversion: 2.1 time: 0.245477 Oct 26 13:24:30.905535 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2415/4842] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:24:30 2022] DELETE /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 26 13:24:30.917059 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-03de76d3-51be-4a79-893e-69e8708dbee5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:30.917771 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-03de76d3-51be-4a79-893e-69e8708dbee5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 97825703-89d9-457a-b6c3-b694f8eee97c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:30.929818 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03de76d3-51be-4a79-893e-69e8708dbee5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:30.931913 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03de76d3-51be-4a79-893e-69e8708dbee5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:30.933502 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03de76d3-51be-4a79-893e-69e8708dbee5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:30.935060 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03de76d3-51be-4a79-893e-69e8708dbee5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:30.938653 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03de76d3-51be-4a79-893e-69e8708dbee5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:30.940779 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03de76d3-51be-4a79-893e-69e8708dbee5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:31.371816 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5e304bd7-546c-4ac7-8922-9fd416ee1dab tempest-VolumesGetTestJSON-791088247 tempest-VolumesGetTestJSON-791088247-project] Calling method '.version_select at 0x7f6736965b80>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:31.488112 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5e304bd7-546c-4ac7-8922-9fd416ee1dab tempest-VolumesGetTestJSON-791088247 tempest-VolumesGetTestJSON-791088247-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/e868bb00-fd61-4845-8e15-0e3e3b9bd617" status: 200 len: 351 microversion: 2.1 time: 0.120865 Oct 26 13:24:31.489160 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2416/4843] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Oct 26 13:24:31 2022] GET /compute/v2.1/os-volumes/e868bb00-fd61-4845-8e15-0e3e3b9bd617 => generated 351 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:24:31.698139 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-03de76d3-51be-4a79-893e-69e8708dbee5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:31.710741 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-03de76d3-51be-4a79-893e-69e8708dbee5 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c" status: 200 len: 1522 microversion: 2.1 time: 0.800435 Oct 26 13:24:31.712144 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2428/4844] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:24:30 2022] GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c => generated 1522 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:24:32.506919 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a9617713-6b7b-4b29-8654-812dee553858 tempest-VolumesGetTestJSON-791088247 tempest-VolumesGetTestJSON-791088247-project] Calling method '.version_select at 0x7f67322c9ee0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:32.623978 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a9617713-6b7b-4b29-8654-812dee553858 tempest-VolumesGetTestJSON-791088247 tempest-VolumesGetTestJSON-791088247-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/e868bb00-fd61-4845-8e15-0e3e3b9bd617" status: 200 len: 352 microversion: 2.1 time: 0.125266 Oct 26 13:24:32.624560 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2417/4845] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Oct 26 13:24:32 2022] GET /compute/v2.1/os-volumes/e868bb00-fd61-4845-8e15-0e3e3b9bd617 => generated 352 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:24:32.640059 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cdd32780-f593-4f31-810a-5d86968f2da6 tempest-VolumesGetTestJSON-791088247 tempest-VolumesGetTestJSON-791088247-project] Calling method '.version_select at 0x7f6731fb5c10>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:32.738823 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-74a2aa71-7375-4ac2-a666-02c020a87d19 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:32.739566 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-74a2aa71-7375-4ac2-a666-02c020a87d19 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 97825703-89d9-457a-b6c3-b694f8eee97c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:32.747764 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-74a2aa71-7375-4ac2-a666-02c020a87d19 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:32.748569 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-74a2aa71-7375-4ac2-a666-02c020a87d19 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:32.749180 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-74a2aa71-7375-4ac2-a666-02c020a87d19 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:32.750183 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-74a2aa71-7375-4ac2-a666-02c020a87d19 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:32.751566 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-74a2aa71-7375-4ac2-a666-02c020a87d19 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:32.752216 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-74a2aa71-7375-4ac2-a666-02c020a87d19 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:32.761750 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cdd32780-f593-4f31-810a-5d86968f2da6 tempest-VolumesGetTestJSON-791088247 tempest-VolumesGetTestJSON-791088247-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/e868bb00-fd61-4845-8e15-0e3e3b9bd617" status: 200 len: 352 microversion: 2.1 time: 0.127190 Oct 26 13:24:32.763383 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2429/4846] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Oct 26 13:24:32 2022] GET /compute/v2.1/os-volumes/e868bb00-fd61-4845-8e15-0e3e3b9bd617 => generated 352 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:24:32.778482 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-24989497-eeea-4563-b7d8-493cb0aa324e tempest-VolumesGetTestJSON-791088247 tempest-VolumesGetTestJSON-791088247-project] Calling method '.version_select at 0x7f67368f0670>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:32.901040 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-24989497-eeea-4563-b7d8-493cb0aa324e tempest-VolumesGetTestJSON-791088247 tempest-VolumesGetTestJSON-791088247-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/e868bb00-fd61-4845-8e15-0e3e3b9bd617" status: 202 len: 0 microversion: 2.1 time: 0.127081 Oct 26 13:24:32.901992 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2430/4847] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Oct 26 13:24:32 2022] DELETE /compute/v2.1/os-volumes/e868bb00-fd61-4845-8e15-0e3e3b9bd617 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:24:32.910839 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d7421c2b-ad49-4d2d-9a7d-b4b0631c27b9 tempest-VolumesGetTestJSON-791088247 tempest-VolumesGetTestJSON-791088247-project] Calling method '.version_select at 0x7f6731ff3670>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:33.014834 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d7421c2b-ad49-4d2d-9a7d-b4b0631c27b9 tempest-VolumesGetTestJSON-791088247 tempest-VolumesGetTestJSON-791088247-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/e868bb00-fd61-4845-8e15-0e3e3b9bd617" status: 200 len: 351 microversion: 2.1 time: 0.108792 Oct 26 13:24:33.015424 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2431/4848] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Oct 26 13:24:32 2022] GET /compute/v2.1/os-volumes/e868bb00-fd61-4845-8e15-0e3e3b9bd617 => generated 351 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:24:33.588501 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-74a2aa71-7375-4ac2-a666-02c020a87d19 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:33.610462 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-74a2aa71-7375-4ac2-a666-02c020a87d19 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c" status: 200 len: 1522 microversion: 2.1 time: 0.876799 Oct 26 13:24:33.617103 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2418/4849] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:24:32 2022] GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c => generated 1522 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:24:34.042446 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6a001ac1-f07d-4d2a-845f-5f7350ec99f9 tempest-VolumesGetTestJSON-791088247 tempest-VolumesGetTestJSON-791088247-project] Calling method '.version_select at 0x7f6731ff3040>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:34.156014 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6a001ac1-f07d-4d2a-845f-5f7350ec99f9 tempest-VolumesGetTestJSON-791088247 tempest-VolumesGetTestJSON-791088247-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/e868bb00-fd61-4845-8e15-0e3e3b9bd617" status: 200 len: 351 microversion: 2.1 time: 0.129726 Oct 26 13:24:34.156648 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2432/4850] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Oct 26 13:24:34 2022] GET /compute/v2.1/os-volumes/e868bb00-fd61-4845-8e15-0e3e3b9bd617 => generated 351 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:24:34.646544 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-90391758-e37a-44a1-bac2-147bff029cd6 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:34.647160 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-90391758-e37a-44a1-bac2-147bff029cd6 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 97825703-89d9-457a-b6c3-b694f8eee97c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:34.668256 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90391758-e37a-44a1-bac2-147bff029cd6 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:34.669133 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90391758-e37a-44a1-bac2-147bff029cd6 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:34.669865 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90391758-e37a-44a1-bac2-147bff029cd6 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:34.675837 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90391758-e37a-44a1-bac2-147bff029cd6 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:34.676607 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90391758-e37a-44a1-bac2-147bff029cd6 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:34.677249 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90391758-e37a-44a1-bac2-147bff029cd6 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:35.173876 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-09eaccd4-7460-4620-83b0-cf1a607aad33 tempest-VolumesGetTestJSON-791088247 tempest-VolumesGetTestJSON-791088247-project] Calling method '.version_select at 0x7f6731fb5040>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:35.269333 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-09eaccd4-7460-4620-83b0-cf1a607aad33 tempest-VolumesGetTestJSON-791088247 tempest-VolumesGetTestJSON-791088247-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/e868bb00-fd61-4845-8e15-0e3e3b9bd617" status: 200 len: 351 microversion: 2.1 time: 0.101160 Oct 26 13:24:35.270820 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2433/4851] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Oct 26 13:24:35 2022] GET /compute/v2.1/os-volumes/e868bb00-fd61-4845-8e15-0e3e3b9bd617 => generated 351 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:24:35.977912 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-90391758-e37a-44a1-bac2-147bff029cd6 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:35.991440 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-90391758-e37a-44a1-bac2-147bff029cd6 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c" status: 200 len: 1522 microversion: 2.1 time: 1.351430 Oct 26 13:24:35.992044 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2419/4852] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:24:34 2022] GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c => generated 1522 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:24:36.291950 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1882ea69-e49a-4fca-bc0c-e28dbbec542a tempest-VolumesGetTestJSON-791088247 tempest-VolumesGetTestJSON-791088247-project] Calling method '.version_select at 0x7f67369971f0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:36.409640 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1882ea69-e49a-4fca-bc0c-e28dbbec542a tempest-VolumesGetTestJSON-791088247 tempest-VolumesGetTestJSON-791088247-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/e868bb00-fd61-4845-8e15-0e3e3b9bd617" status: 200 len: 351 microversion: 2.1 time: 0.128765 Oct 26 13:24:36.410623 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2434/4853] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Oct 26 13:24:36 2022] GET /compute/v2.1/os-volumes/e868bb00-fd61-4845-8e15-0e3e3b9bd617 => generated 351 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:24:36.833543 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-36ea5e17-6d38-4bfc-af49-35cb227755c0 req-1f4092d2-0df6-48b2-9439-34911871a7c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97825703-89d9-457a-b6c3-b694f8eee97c", "name": "network-vif-deleted", "tag": "8e2f2c44-360b-45b6-aa25-4848c446d113"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:24:36.871619 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-36ea5e17-6d38-4bfc-af49-35cb227755c0 req-1f4092d2-0df6-48b2-9439-34911871a7c6 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:36.873607 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-36ea5e17-6d38-4bfc-af49-35cb227755c0 req-1f4092d2-0df6-48b2-9439-34911871a7c6 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:36.874241 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-36ea5e17-6d38-4bfc-af49-35cb227755c0 req-1f4092d2-0df6-48b2-9439-34911871a7c6 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:36.935514 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-36ea5e17-6d38-4bfc-af49-35cb227755c0 req-1f4092d2-0df6-48b2-9439-34911871a7c6 service nova] Creating event network-vif-deleted:8e2f2c44-360b-45b6-aa25-4848c446d113 for instance 97825703-89d9-457a-b6c3-b694f8eee97c on n-h2-862686-1 Oct 26 13:24:36.963414 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-36ea5e17-6d38-4bfc-af49-35cb227755c0 req-1f4092d2-0df6-48b2-9439-34911871a7c6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137205 Oct 26 13:24:36.964048 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2420/4854] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:24:37.016696 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-56cf6d60-bb5c-418b-9b19-e866310bdd80 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:37.017597 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-56cf6d60-bb5c-418b-9b19-e866310bdd80 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 97825703-89d9-457a-b6c3-b694f8eee97c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:37.047637 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:24:37.055038 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-56cf6d60-bb5c-418b-9b19-e866310bdd80 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:37.055985 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-56cf6d60-bb5c-418b-9b19-e866310bdd80 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:37.062219 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-56cf6d60-bb5c-418b-9b19-e866310bdd80 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:37.068998 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-56cf6d60-bb5c-418b-9b19-e866310bdd80 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:37.072989 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-56cf6d60-bb5c-418b-9b19-e866310bdd80 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:37.076206 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-56cf6d60-bb5c-418b-9b19-e866310bdd80 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:37.171421 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-56cf6d60-bb5c-418b-9b19-e866310bdd80 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:37.171930 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-56cf6d60-bb5c-418b-9b19-e866310bdd80 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:37.172915 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-56cf6d60-bb5c-418b-9b19-e866310bdd80 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:37.177969 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-56cf6d60-bb5c-418b-9b19-e866310bdd80 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lazy-loading 'fault' on Instance uuid 97825703-89d9-457a-b6c3-b694f8eee97c {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:24:37.328227 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-56cf6d60-bb5c-418b-9b19-e866310bdd80 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '363fc117da70484f9d8cf2040e8391e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdd45be745d4828b5a111472254156c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:37.345843 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-56cf6d60-bb5c-418b-9b19-e866310bdd80 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c" status: 200 len: 1311 microversion: 2.1 time: 0.332900 Oct 26 13:24:37.346553 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2435/4855] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:24:37 2022] GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c => generated 1311 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:24:37.435044 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-13aa4fd5-1aed-47d1-b28c-cd6c3e579a9e tempest-VolumesGetTestJSON-791088247 tempest-VolumesGetTestJSON-791088247-project] Calling method '.version_select at 0x7f6736965040>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:37.482122 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-13aa4fd5-1aed-47d1-b28c-cd6c3e579a9e tempest-VolumesGetTestJSON-791088247 tempest-VolumesGetTestJSON-791088247-project] HTTP exception thrown: Volume e868bb00-fd61-4845-8e15-0e3e3b9bd617 could not be found. Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-13aa4fd5-1aed-47d1-b28c-cd6c3e579a9e tempest-VolumesGetTestJSON-791088247 tempest-VolumesGetTestJSON-791088247-project] Request method failure captured: Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/os-volumes/e868bb00-fd61-4845-8e15-0e3e3b9bd617 HTTP/1.1 Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTUNB9EmVIDEIwWeO9bMR4Dz2O3c-lMX3iKB9MX_xyqAZjU-AMiCSAGa4hxqKQVw4KSJg7E-OBA0ehxk5khfX23M6QpQvZ6X8ZBCs3eXKiDAWs-m8Ygj0a0163B9Xq8kHPqT_ARZvOsq2gPTO-UX0z77mKq9FE50S5GK3buXY11hbHo Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 817289b58ff54ffbb37aa0d60ef200ba Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-VolumesGetTestJSON-791088247 Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/817289b58ff54ffbb37aa0d60ef200ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/817289b58ff54ffbb37aa0d60ef200ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_817289b58ff54ffbb37aa0d60ef200ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/817289b58ff54ffbb37aa0d60ef200ba"}]}] Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-VolumesGetTestJSON-791088247 Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 817289b58ff54ffbb37aa0d60ef200ba Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-VolumesGetTestJSON-791088247 Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-VolumesGetTestJSON-791088247-project Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 35db98bd9a9c454785e5e4ae3d2d72dd Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-VolumesGetTestJSON-791088247-project Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: method: Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: exception: Volume e868bb00-fd61-4845-8e15-0e3e3b9bd617 could not be found. Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'e868bb00-fd61-4845-8e15-0e3e3b9bd617'} Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e868bb00-fd61-4845-8e15-0e3e3b9bd617 could not be found. (HTTP 404) (Request-ID: req-f864275e-69b6-4ca0-aa6c-69d03d5e5fee) Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 26 13:24:37.486636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 13:24:37.491731 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 13:24:37.491731 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 26 13:24:37.491731 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 26 13:24:37.491731 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 26 13:24:37.491731 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 26 13:24:37.491731 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 26 13:24:37.491731 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 26 13:24:37.491731 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 26 13:24:37.491731 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 26 13:24:37.491731 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 13:24:37.491731 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 13:24:37.491731 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 13:24:37.491731 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 13:24:37.491731 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e868bb00-fd61-4845-8e15-0e3e3b9bd617 could not be found. Oct 26 13:24:37.491731 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:24:37.491731 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:24:37.491731 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:24:37.491731 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:24:37.491731 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:24:37.491731 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:24:37.491731 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:24:37.491731 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:24:37.491731 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 13:24:37.491731 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 13:24:37.491731 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:24:37.491731 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:24:37.491731 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 26 13:24:37.491731 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:24:37.491731 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e868bb00-fd61-4845-8e15-0e3e3b9bd617 could not be found. Oct 26 13:24:37.491731 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:24:37.491731 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:24:37.491731 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:24:37.491731 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:24:37.491731 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:24:37.491731 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:24:37.491731 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:24:37.491731 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:24:37.491731 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e868bb00-fd61-4845-8e15-0e3e3b9bd617 could not be found. Oct 26 13:24:37.491731 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:24:37.491731 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-13aa4fd5-1aed-47d1-b28c-cd6c3e579a9e tempest-VolumesGetTestJSON-791088247 tempest-VolumesGetTestJSON-791088247-project] Returning 404 to user: Volume e868bb00-fd61-4845-8e15-0e3e3b9bd617 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:24:37.491731 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-13aa4fd5-1aed-47d1-b28c-cd6c3e579a9e tempest-VolumesGetTestJSON-791088247 tempest-VolumesGetTestJSON-791088247-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/e868bb00-fd61-4845-8e15-0e3e3b9bd617" status: 404 len: 109 microversion: 2.1 time: 0.068542 Oct 26 13:24:37.491731 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2421/4856] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Oct 26 13:24:37 2022] GET /compute/v2.1/os-volumes/e868bb00-fd61-4845-8e15-0e3e3b9bd617 => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 13:24:38.374663 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7cc98e23-3f43-4904-bd51-4a8dfdc24de9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:38.375288 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7cc98e23-3f43-4904-bd51-4a8dfdc24de9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] [instance: 97825703-89d9-457a-b6c3-b694f8eee97c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:38.397147 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7cc98e23-3f43-4904-bd51-4a8dfdc24de9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:38.421634 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7cc98e23-3f43-4904-bd51-4a8dfdc24de9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:38.422154 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7cc98e23-3f43-4904-bd51-4a8dfdc24de9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:38.423245 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7cc98e23-3f43-4904-bd51-4a8dfdc24de9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:38.423732 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7cc98e23-3f43-4904-bd51-4a8dfdc24de9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:38.424484 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7cc98e23-3f43-4904-bd51-4a8dfdc24de9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:38.475720 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-7cc98e23-3f43-4904-bd51-4a8dfdc24de9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] HTTP exception thrown: Instance 97825703-89d9-457a-b6c3-b694f8eee97c could not be found. Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7cc98e23-3f43-4904-bd51-4a8dfdc24de9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Request method failure captured: Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c HTTP/1.1 Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTPjOuLV_n1DR58OZOmgbin2ud11sLWXOml70eL6_Yw9nM-eYNoCKOyZp3mck381-99yxZlLhlu2g6vQAmqZcUDv2ExrohfYX5ori3eOe3Uf6RO52e_TYIFS_DlKFRRKYqEp1KNMktjZRMuKeogboZRQrwA8baF1wLatF4_VyxhzXdo Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 9cdd45be745d4828b5a111472254156c Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1015154874 Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9cdd45be745d4828b5a111472254156c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9cdd45be745d4828b5a111472254156c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9cdd45be745d4828b5a111472254156c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9cdd45be745d4828b5a111472254156c"}]}] Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1015154874 Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 9cdd45be745d4828b5a111472254156c Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1015154874 Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServerRescueNegativeTestJSON-1015154874-project Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 363fc117da70484f9d8cf2040e8391e4 Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1015154874-project Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 97825703-89d9-457a-b6c3-b694f8eee97c could not be found. Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '97825703-89d9-457a-b6c3-b694f8eee97c'} Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97825703-89d9-457a-b6c3-b694f8eee97c could not be found. Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97825703-89d9-457a-b6c3-b694f8eee97c could not be found. Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:24:38.480671 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:24:38.484688 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:24:38.484688 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:24:38.484688 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:24:38.484688 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:24:38.484688 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:24:38.484688 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:24:38.484688 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97825703-89d9-457a-b6c3-b694f8eee97c could not be found. Oct 26 13:24:38.484688 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:24:38.484688 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7cc98e23-3f43-4904-bd51-4a8dfdc24de9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] Returning 404 to user: Instance 97825703-89d9-457a-b6c3-b694f8eee97c could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:24:38.484688 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7cc98e23-3f43-4904-bd51-4a8dfdc24de9 tempest-ServerRescueNegativeTestJSON-1015154874 tempest-ServerRescueNegativeTestJSON-1015154874-project] 10.222.0.40 "GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c" status: 404 len: 111 microversion: 2.1 time: 0.111413 Oct 26 13:24:38.490349 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2436/4857] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:24:38 2022] GET /compute/v2.1/servers/97825703-89d9-457a-b6c3-b694f8eee97c => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:24:43.066724 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-170b6212-d4d4-4fc6-8a8a-35c47b0b7a21 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6990e6f-a65d-4404-8115-6bd41f02217c"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:24:43.076188 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-170b6212-d4d4-4fc6-8a8a-35c47b0b7a21 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] [instance: c4a4c540-465f-4048-acde-837a8e37ccce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:43.098563 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-170b6212-d4d4-4fc6-8a8a-35c47b0b7a21 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:43.100884 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-170b6212-d4d4-4fc6-8a8a-35c47b0b7a21 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:43.104849 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-170b6212-d4d4-4fc6-8a8a-35c47b0b7a21 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:43.106714 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-170b6212-d4d4-4fc6-8a8a-35c47b0b7a21 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:43.119069 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-170b6212-d4d4-4fc6-8a8a-35c47b0b7a21 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:43.121367 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-170b6212-d4d4-4fc6-8a8a-35c47b0b7a21 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:43.549776 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a7b10ae3-a0ec-4e8b-8f49-ffb501311a0f tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1007985115", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "3615a225-acd0-4504-9116-380d172456d0"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:24:43.670359 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-a7b10ae3-a0ec-4e8b-8f49-ffb501311a0f tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] validate_networks() for [('3615a225-acd0-4504-9116-380d172456d0', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:24:43.740961 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-170b6212-d4d4-4fc6-8a8a-35c47b0b7a21 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] 10.222.0.40 "POST /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.684709 Oct 26 13:24:43.749025 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2422/4858] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Oct 26 13:24:43 2022] POST /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce/os-volume_attachments => generated 194 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:24:47.592998 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-a7b10ae3-a0ec-4e8b-8f49-ffb501311a0f tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:24:47.594212 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-a7b10ae3-a0ec-4e8b-8f49-ffb501311a0f tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:24:47.595485 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-a7b10ae3-a0ec-4e8b-8f49-ffb501311a0f tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:24:47.596044 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-a7b10ae3-a0ec-4e8b-8f49-ffb501311a0f tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:24:47.596469 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-a7b10ae3-a0ec-4e8b-8f49-ffb501311a0f tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:24:47.647297 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a7b10ae3-a0ec-4e8b-8f49-ffb501311a0f tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:47.647673 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a7b10ae3-a0ec-4e8b-8f49-ffb501311a0f tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:47.648116 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a7b10ae3-a0ec-4e8b-8f49-ffb501311a0f tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:47.649899 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a7b10ae3-a0ec-4e8b-8f49-ffb501311a0f tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:47.650379 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a7b10ae3-a0ec-4e8b-8f49-ffb501311a0f tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:47.651091 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a7b10ae3-a0ec-4e8b-8f49-ffb501311a0f tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:47.685802 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:24:47.738852 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-a7b10ae3-a0ec-4e8b-8f49-ffb501311a0f tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Getting quotas for project fb7d7c612e04475883e72d3d45676813. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:24:47.745562 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-a7b10ae3-a0ec-4e8b-8f49-ffb501311a0f tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Getting quotas for user af2a855d5e004878ad1b1e25763b47f3 and project fb7d7c612e04475883e72d3d45676813. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:24:47.786628 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a7b10ae3-a0ec-4e8b-8f49-ffb501311a0f tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:24:47.791409 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a7b10ae3-a0ec-4e8b-8f49-ffb501311a0f tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] [instance: e549e405-cbf9-47e2-a178-8d193b7dc4c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:24:47.881691 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a7b10ae3-a0ec-4e8b-8f49-ffb501311a0f tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.682971 Oct 26 13:24:47.884147 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2437/4859] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:24:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 4687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:24:47.896312 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0da372c7-9741-49a6-b87c-f483637d4e4a tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:47.897040 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0da372c7-9741-49a6-b87c-f483637d4e4a tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] [instance: e549e405-cbf9-47e2-a178-8d193b7dc4c9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:48.095740 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0da372c7-9741-49a6-b87c-f483637d4e4a tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2a855d5e004878ad1b1e25763b47f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7d7c612e04475883e72d3d45676813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:48.103561 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0da372c7-9741-49a6-b87c-f483637d4e4a tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] 10.222.0.40 "GET /compute/v2.1/servers/e549e405-cbf9-47e2-a178-8d193b7dc4c9" status: 200 len: 1216 microversion: 2.1 time: 0.211402 Oct 26 13:24:48.123725 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2423/4860] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:24:47 2022] GET /compute/v2.1/servers/e549e405-cbf9-47e2-a178-8d193b7dc4c9 => generated 1216 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:24:49.131967 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cea32338-fac1-4227-9cbd-c2f30d9e0ccc tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:49.133254 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cea32338-fac1-4227-9cbd-c2f30d9e0ccc tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] [instance: e549e405-cbf9-47e2-a178-8d193b7dc4c9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:49.161314 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cea32338-fac1-4227-9cbd-c2f30d9e0ccc tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:49.163836 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cea32338-fac1-4227-9cbd-c2f30d9e0ccc tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:49.164417 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cea32338-fac1-4227-9cbd-c2f30d9e0ccc tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:49.168125 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cea32338-fac1-4227-9cbd-c2f30d9e0ccc tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:49.169724 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cea32338-fac1-4227-9cbd-c2f30d9e0ccc tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:49.171112 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cea32338-fac1-4227-9cbd-c2f30d9e0ccc tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:49.503142 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-cea32338-fac1-4227-9cbd-c2f30d9e0ccc tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2a855d5e004878ad1b1e25763b47f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7d7c612e04475883e72d3d45676813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:49.527039 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cea32338-fac1-4227-9cbd-c2f30d9e0ccc tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] 10.222.0.40 "GET /compute/v2.1/servers/e549e405-cbf9-47e2-a178-8d193b7dc4c9" status: 200 len: 1220 microversion: 2.1 time: 0.397148 Oct 26 13:24:49.532345 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2438/4861] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:24:49 2022] GET /compute/v2.1/servers/e549e405-cbf9-47e2-a178-8d193b7dc4c9 => generated 1220 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:24:49.848387 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b2b47e1a-3576-42ff-8157-1863fcf3d073 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:49.849178 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b2b47e1a-3576-42ff-8157-1863fcf3d073 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:49.877180 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b2b47e1a-3576-42ff-8157-1863fcf3d073 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:49.878334 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b2b47e1a-3576-42ff-8157-1863fcf3d073 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:49.879353 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b2b47e1a-3576-42ff-8157-1863fcf3d073 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:49.881258 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b2b47e1a-3576-42ff-8157-1863fcf3d073 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:49.882114 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b2b47e1a-3576-42ff-8157-1863fcf3d073 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:49.882800 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b2b47e1a-3576-42ff-8157-1863fcf3d073 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:50.556983 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-baa9fae2-1e7f-4038-9f21-8fb318927e35 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:50.558564 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-baa9fae2-1e7f-4038-9f21-8fb318927e35 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] [instance: e549e405-cbf9-47e2-a178-8d193b7dc4c9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:50.575796 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-baa9fae2-1e7f-4038-9f21-8fb318927e35 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:50.580614 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-baa9fae2-1e7f-4038-9f21-8fb318927e35 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:50.581106 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-baa9fae2-1e7f-4038-9f21-8fb318927e35 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:50.582515 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-baa9fae2-1e7f-4038-9f21-8fb318927e35 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:50.584407 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-baa9fae2-1e7f-4038-9f21-8fb318927e35 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:50.586354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-baa9fae2-1e7f-4038-9f21-8fb318927e35 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:50.872321 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-baa9fae2-1e7f-4038-9f21-8fb318927e35 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2a855d5e004878ad1b1e25763b47f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7d7c612e04475883e72d3d45676813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:50.888384 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-baa9fae2-1e7f-4038-9f21-8fb318927e35 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] 10.222.0.40 "GET /compute/v2.1/servers/e549e405-cbf9-47e2-a178-8d193b7dc4c9" status: 200 len: 1274 microversion: 2.1 time: 0.334456 Oct 26 13:24:50.903632 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2439/4862] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:24:50 2022] GET /compute/v2.1/servers/e549e405-cbf9-47e2-a178-8d193b7dc4c9 => generated 1274 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:24:51.281214 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b2b47e1a-3576-42ff-8157-1863fcf3d073 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:51.300061 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b2b47e1a-3576-42ff-8157-1863fcf3d073 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 1.454642 Oct 26 13:24:51.323607 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2424/4863] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:24:49 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:24:51.337202 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-98c03920-a3a3-458f-a646-6e79bdbd99b9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:51.343049 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-98c03920-a3a3-458f-a646-6e79bdbd99b9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:51.362843 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-98c03920-a3a3-458f-a646-6e79bdbd99b9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:51.363361 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-98c03920-a3a3-458f-a646-6e79bdbd99b9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:51.364465 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-98c03920-a3a3-458f-a646-6e79bdbd99b9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:51.365970 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-98c03920-a3a3-458f-a646-6e79bdbd99b9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:51.367532 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-98c03920-a3a3-458f-a646-6e79bdbd99b9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:51.371723 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-98c03920-a3a3-458f-a646-6e79bdbd99b9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:51.758200 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-98c03920-a3a3-458f-a646-6e79bdbd99b9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:51.778858 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-98c03920-a3a3-458f-a646-6e79bdbd99b9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 0.436462 Oct 26 13:24:51.781230 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2440/4864] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:24:51 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:24:51.808202 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-80bf9a35-0f5b-4835-b698-60310e82a1ab tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:51.808823 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-80bf9a35-0f5b-4835-b698-60310e82a1ab tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:51.820576 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-80bf9a35-0f5b-4835-b698-60310e82a1ab tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:51.821335 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-80bf9a35-0f5b-4835-b698-60310e82a1ab tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:51.826802 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-80bf9a35-0f5b-4835-b698-60310e82a1ab tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:51.827778 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-80bf9a35-0f5b-4835-b698-60310e82a1ab tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:51.828972 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-80bf9a35-0f5b-4835-b698-60310e82a1ab tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:51.829614 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-80bf9a35-0f5b-4835-b698-60310e82a1ab tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:51.916388 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c38771fb-2165-4ad3-bbe5-41cc27de955d tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:51.917606 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c38771fb-2165-4ad3-bbe5-41cc27de955d tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] [instance: e549e405-cbf9-47e2-a178-8d193b7dc4c9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:51.930309 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c38771fb-2165-4ad3-bbe5-41cc27de955d tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:51.930997 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c38771fb-2165-4ad3-bbe5-41cc27de955d tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:51.932868 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c38771fb-2165-4ad3-bbe5-41cc27de955d tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:51.937510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c38771fb-2165-4ad3-bbe5-41cc27de955d tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:51.938210 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c38771fb-2165-4ad3-bbe5-41cc27de955d tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:51.938978 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c38771fb-2165-4ad3-bbe5-41cc27de955d tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:52.097772 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c38771fb-2165-4ad3-bbe5-41cc27de955d tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2a855d5e004878ad1b1e25763b47f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7d7c612e04475883e72d3d45676813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:52.106614 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c38771fb-2165-4ad3-bbe5-41cc27de955d tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] 10.222.0.40 "GET /compute/v2.1/servers/e549e405-cbf9-47e2-a178-8d193b7dc4c9" status: 200 len: 1274 microversion: 2.1 time: 0.194360 Oct 26 13:24:52.121520 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2441/4865] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:24:51 2022] GET /compute/v2.1/servers/e549e405-cbf9-47e2-a178-8d193b7dc4c9 => generated 1274 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:24:52.767127 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-80bf9a35-0f5b-4835-b698-60310e82a1ab tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:52.784884 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-80bf9a35-0f5b-4835-b698-60310e82a1ab tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 0.980871 Oct 26 13:24:52.787320 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2425/4866] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:24:51 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:24:52.811015 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f127794a-17b3-4d95-8d64-78633d6b96a6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1372262338"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:24:52.814624 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f127794a-17b3-4d95-8d64-78633d6b96a6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:52.832238 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f127794a-17b3-4d95-8d64-78633d6b96a6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:52.834410 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f127794a-17b3-4d95-8d64-78633d6b96a6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:52.834410 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f127794a-17b3-4d95-8d64-78633d6b96a6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:52.836773 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f127794a-17b3-4d95-8d64-78633d6b96a6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:52.838266 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f127794a-17b3-4d95-8d64-78633d6b96a6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:52.840666 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f127794a-17b3-4d95-8d64-78633d6b96a6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:53.137887 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0b2ace82-9c0a-412b-a4e8-d58679b3473c tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:53.139673 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0b2ace82-9c0a-412b-a4e8-d58679b3473c tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] [instance: e549e405-cbf9-47e2-a178-8d193b7dc4c9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:53.163222 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b2ace82-9c0a-412b-a4e8-d58679b3473c tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:53.163741 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b2ace82-9c0a-412b-a4e8-d58679b3473c tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:53.164655 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b2ace82-9c0a-412b-a4e8-d58679b3473c tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:53.166970 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b2ace82-9c0a-412b-a4e8-d58679b3473c tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:53.168723 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b2ace82-9c0a-412b-a4e8-d58679b3473c tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:53.171004 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b2ace82-9c0a-412b-a4e8-d58679b3473c tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:53.279012 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f127794a-17b3-4d95-8d64-78633d6b96a6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "POST /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa/action" status: 202 len: 0 microversion: 2.1 time: 0.472718 Oct 26 13:24:53.282980 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2442/4867] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:24:52 2022] POST /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa/action => generated 0 bytes in 477 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 26 13:24:54.072256 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0b2ace82-9c0a-412b-a4e8-d58679b3473c tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2a855d5e004878ad1b1e25763b47f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7d7c612e04475883e72d3d45676813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:54.090093 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0b2ace82-9c0a-412b-a4e8-d58679b3473c tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] 10.222.0.40 "GET /compute/v2.1/servers/e549e405-cbf9-47e2-a178-8d193b7dc4c9" status: 200 len: 1316 microversion: 2.1 time: 0.958130 Oct 26 13:24:54.091194 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2426/4868] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:24:53 2022] GET /compute/v2.1/servers/e549e405-cbf9-47e2-a178-8d193b7dc4c9 => generated 1316 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:24:55.001721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-75e488c8-4e71-4219-93df-9091c7c1cc2e req-29d4bfbd-794b-4c8d-886e-4b06a7384aab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e549e405-cbf9-47e2-a178-8d193b7dc4c9", "tag": "c7b861b4-0c77-4069-bc45-1b49519a593e"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:24:55.035291 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-75e488c8-4e71-4219-93df-9091c7c1cc2e req-29d4bfbd-794b-4c8d-886e-4b06a7384aab service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:55.036154 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-75e488c8-4e71-4219-93df-9091c7c1cc2e req-29d4bfbd-794b-4c8d-886e-4b06a7384aab service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:55.037863 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-75e488c8-4e71-4219-93df-9091c7c1cc2e req-29d4bfbd-794b-4c8d-886e-4b06a7384aab service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:55.055835 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-75e488c8-4e71-4219-93df-9091c7c1cc2e req-29d4bfbd-794b-4c8d-886e-4b06a7384aab service nova] Creating event network-changed:c7b861b4-0c77-4069-bc45-1b49519a593e for instance e549e405-cbf9-47e2-a178-8d193b7dc4c9 on n-h2-862686-1 Oct 26 13:24:55.063988 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-75e488c8-4e71-4219-93df-9091c7c1cc2e req-29d4bfbd-794b-4c8d-886e-4b06a7384aab service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067795 Oct 26 13:24:55.066278 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2443/4869] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:24:55.122708 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d636f251-9775-4e39-ba67-15ed12cda3df tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:55.125909 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d636f251-9775-4e39-ba67-15ed12cda3df tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] [instance: e549e405-cbf9-47e2-a178-8d193b7dc4c9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:55.141532 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d636f251-9775-4e39-ba67-15ed12cda3df tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:55.142286 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d636f251-9775-4e39-ba67-15ed12cda3df tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:55.142942 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d636f251-9775-4e39-ba67-15ed12cda3df tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:55.145501 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d636f251-9775-4e39-ba67-15ed12cda3df tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:55.146236 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d636f251-9775-4e39-ba67-15ed12cda3df tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:55.152043 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d636f251-9775-4e39-ba67-15ed12cda3df tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:55.164564 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:24:55.886497 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d636f251-9775-4e39-ba67-15ed12cda3df tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2a855d5e004878ad1b1e25763b47f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7d7c612e04475883e72d3d45676813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:55.898723 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d636f251-9775-4e39-ba67-15ed12cda3df tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] 10.222.0.40 "GET /compute/v2.1/servers/e549e405-cbf9-47e2-a178-8d193b7dc4c9" status: 200 len: 1316 microversion: 2.1 time: 0.783792 Oct 26 13:24:55.899321 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2427/4870] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:24:55 2022] GET /compute/v2.1/servers/e549e405-cbf9-47e2-a178-8d193b7dc4c9 => generated 1316 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:24:56.076452 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-aaf88420-8db4-4d77-b64f-e9367b96b797 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-274685241", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": "none"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:24:56.163223 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-aaf88420-8db4-4d77-b64f-e9367b96b797 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:24:56.163956 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-aaf88420-8db4-4d77-b64f-e9367b96b797 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:24:56.164437 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-aaf88420-8db4-4d77-b64f-e9367b96b797 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:24:56.164850 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-aaf88420-8db4-4d77-b64f-e9367b96b797 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:24:56.165296 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-aaf88420-8db4-4d77-b64f-e9367b96b797 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:24:56.175494 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aaf88420-8db4-4d77-b64f-e9367b96b797 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:56.176934 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aaf88420-8db4-4d77-b64f-e9367b96b797 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:56.177718 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aaf88420-8db4-4d77-b64f-e9367b96b797 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:56.178868 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aaf88420-8db4-4d77-b64f-e9367b96b797 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:56.179504 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aaf88420-8db4-4d77-b64f-e9367b96b797 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:56.180394 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aaf88420-8db4-4d77-b64f-e9367b96b797 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:56.225154 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-aaf88420-8db4-4d77-b64f-e9367b96b797 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Getting quotas for project 523d65153a4348f986024168091accc8. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:24:56.232395 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-aaf88420-8db4-4d77-b64f-e9367b96b797 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Getting quotas for user 7d2713aeb2dd4854aa9f8a260d3cc5b5 and project 523d65153a4348f986024168091accc8. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:24:56.250968 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-aaf88420-8db4-4d77-b64f-e9367b96b797 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:24:56.253824 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-aaf88420-8db4-4d77-b64f-e9367b96b797 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] [instance: a61995dd-7fb4-4173-adb9-3d0489fa6630] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:24:56.313952 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-aaf88420-8db4-4d77-b64f-e9367b96b797 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.499716 Oct 26 13:24:56.315478 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2444/4871] 10.222.0.40 () {62 vars in 1188 bytes} [Wed Oct 26 13:24:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 502 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 26 13:24:56.328479 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-45e7782a-1f8e-4e2a-83fe-9ff33c8e1da1 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:56.329065 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-45e7782a-1f8e-4e2a-83fe-9ff33c8e1da1 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] [instance: a61995dd-7fb4-4173-adb9-3d0489fa6630] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:56.442031 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-45e7782a-1f8e-4e2a-83fe-9ff33c8e1da1 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:56.450539 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-45e7782a-1f8e-4e2a-83fe-9ff33c8e1da1 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:56.459093 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-45e7782a-1f8e-4e2a-83fe-9ff33c8e1da1 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:56.461311 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-45e7782a-1f8e-4e2a-83fe-9ff33c8e1da1 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] 10.222.0.40 "GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630" status: 200 len: 1277 microversion: 2.54 time: 0.137113 Oct 26 13:24:56.494753 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2428/4872] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:24:56 2022] GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630 => generated 1277 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:24:56.924860 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-800ff547-6a88-4c4b-b383-bf42955edf05 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:56.925755 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-800ff547-6a88-4c4b-b383-bf42955edf05 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] [instance: e549e405-cbf9-47e2-a178-8d193b7dc4c9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:56.945880 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-800ff547-6a88-4c4b-b383-bf42955edf05 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:56.947954 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-800ff547-6a88-4c4b-b383-bf42955edf05 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:56.948702 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-800ff547-6a88-4c4b-b383-bf42955edf05 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:56.952693 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-800ff547-6a88-4c4b-b383-bf42955edf05 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:56.953209 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-800ff547-6a88-4c4b-b383-bf42955edf05 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:56.953740 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-800ff547-6a88-4c4b-b383-bf42955edf05 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:57.444478 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-800ff547-6a88-4c4b-b383-bf42955edf05 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2a855d5e004878ad1b1e25763b47f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7d7c612e04475883e72d3d45676813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:57.474853 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-800ff547-6a88-4c4b-b383-bf42955edf05 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] 10.222.0.40 "GET /compute/v2.1/servers/e549e405-cbf9-47e2-a178-8d193b7dc4c9" status: 200 len: 1316 microversion: 2.1 time: 0.555138 Oct 26 13:24:57.491313 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2445/4873] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:24:56 2022] GET /compute/v2.1/servers/e549e405-cbf9-47e2-a178-8d193b7dc4c9 => generated 1316 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:24:57.491773 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7e85f490-b07c-4775-bb0c-bfae64ce708d tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:57.492979 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7e85f490-b07c-4775-bb0c-bfae64ce708d tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] [instance: a61995dd-7fb4-4173-adb9-3d0489fa6630] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:57.516699 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e85f490-b07c-4775-bb0c-bfae64ce708d tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:57.519885 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e85f490-b07c-4775-bb0c-bfae64ce708d tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:57.520465 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e85f490-b07c-4775-bb0c-bfae64ce708d tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:57.521511 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e85f490-b07c-4775-bb0c-bfae64ce708d tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:57.526201 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e85f490-b07c-4775-bb0c-bfae64ce708d tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:57.527400 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e85f490-b07c-4775-bb0c-bfae64ce708d tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:57.763491 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7e85f490-b07c-4775-bb0c-bfae64ce708d tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:57.782262 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7e85f490-b07c-4775-bb0c-bfae64ce708d tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:57.794683 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7e85f490-b07c-4775-bb0c-bfae64ce708d tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:57.798400 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7e85f490-b07c-4775-bb0c-bfae64ce708d tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] 10.222.0.40 "GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630" status: 200 len: 1329 microversion: 2.54 time: 0.308877 Oct 26 13:24:57.800224 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2429/4874] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:24:57 2022] GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630 => generated 1329 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:24:58.501236 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5c6ebf48-34d3-4e2d-ada4-281e027f91bf tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:58.503055 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5c6ebf48-34d3-4e2d-ada4-281e027f91bf tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] [instance: e549e405-cbf9-47e2-a178-8d193b7dc4c9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:58.516744 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c6ebf48-34d3-4e2d-ada4-281e027f91bf tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:58.518895 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c6ebf48-34d3-4e2d-ada4-281e027f91bf tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:58.518895 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c6ebf48-34d3-4e2d-ada4-281e027f91bf tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:58.522103 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c6ebf48-34d3-4e2d-ada4-281e027f91bf tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:58.523115 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c6ebf48-34d3-4e2d-ada4-281e027f91bf tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:58.524105 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c6ebf48-34d3-4e2d-ada4-281e027f91bf tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:58.540270 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-e4f0241f-947d-4651-b494-d0566d743292 req-7817b925-8df3-43c0-b115-65f26aa56f2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "341d8b3a-d684-4969-a5cf-a6aea1a055fa", "name": "network-vif-plugged", "status": "completed", "tag": "391606bb-b0ec-4759-b9bd-53c1cc5c2f7c"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:24:58.596971 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-e4f0241f-947d-4651-b494-d0566d743292 req-7817b925-8df3-43c0-b115-65f26aa56f2c service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:58.597883 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-e4f0241f-947d-4651-b494-d0566d743292 req-7817b925-8df3-43c0-b115-65f26aa56f2c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:58.602065 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-e4f0241f-947d-4651-b494-d0566d743292 req-7817b925-8df3-43c0-b115-65f26aa56f2c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:58.639729 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-e4f0241f-947d-4651-b494-d0566d743292 req-7817b925-8df3-43c0-b115-65f26aa56f2c service nova] Creating event network-vif-plugged:391606bb-b0ec-4759-b9bd-53c1cc5c2f7c for instance 341d8b3a-d684-4969-a5cf-a6aea1a055fa on n-h1-862686-1 Oct 26 13:24:58.651120 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-e4f0241f-947d-4651-b494-d0566d743292 req-7817b925-8df3-43c0-b115-65f26aa56f2c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114236 Oct 26 13:24:58.652469 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2430/4875] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:24:58.837538 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8c5bcb53-a579-4bdd-8d57-f333c7ed7499 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:24:58.838708 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8c5bcb53-a579-4bdd-8d57-f333c7ed7499 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] [instance: a61995dd-7fb4-4173-adb9-3d0489fa6630] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:24:58.872159 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8c5bcb53-a579-4bdd-8d57-f333c7ed7499 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:58.877028 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8c5bcb53-a579-4bdd-8d57-f333c7ed7499 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:58.879851 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8c5bcb53-a579-4bdd-8d57-f333c7ed7499 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:58.880948 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8c5bcb53-a579-4bdd-8d57-f333c7ed7499 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:24:58.884536 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8c5bcb53-a579-4bdd-8d57-f333c7ed7499 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:24:58.887520 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8c5bcb53-a579-4bdd-8d57-f333c7ed7499 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:24:59.200567 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8c5bcb53-a579-4bdd-8d57-f333c7ed7499 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:59.220798 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8c5bcb53-a579-4bdd-8d57-f333c7ed7499 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:59.233146 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8c5bcb53-a579-4bdd-8d57-f333c7ed7499 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:59.236226 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8c5bcb53-a579-4bdd-8d57-f333c7ed7499 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] 10.222.0.40 "GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630" status: 200 len: 1335 microversion: 2.54 time: 0.403423 Oct 26 13:24:59.249172 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2431/4876] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:24:58 2022] GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630 => generated 1335 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:24:59.465964 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5c6ebf48-34d3-4e2d-ada4-281e027f91bf tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2a855d5e004878ad1b1e25763b47f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7d7c612e04475883e72d3d45676813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:24:59.502800 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5c6ebf48-34d3-4e2d-ada4-281e027f91bf tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] 10.222.0.40 "GET /compute/v2.1/servers/e549e405-cbf9-47e2-a178-8d193b7dc4c9" status: 200 len: 1316 microversion: 2.1 time: 1.004758 Oct 26 13:24:59.506527 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2446/4877] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:24:58 2022] GET /compute/v2.1/servers/e549e405-cbf9-47e2-a178-8d193b7dc4c9 => generated 1316 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:25:00.278347 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-20f47470-49ee-46c6-9232-1f6285f28525 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:00.279561 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-20f47470-49ee-46c6-9232-1f6285f28525 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] [instance: a61995dd-7fb4-4173-adb9-3d0489fa6630] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:00.285662 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:25:00.307756 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20f47470-49ee-46c6-9232-1f6285f28525 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:00.308833 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20f47470-49ee-46c6-9232-1f6285f28525 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:00.309542 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20f47470-49ee-46c6-9232-1f6285f28525 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:00.311909 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20f47470-49ee-46c6-9232-1f6285f28525 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:00.313185 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20f47470-49ee-46c6-9232-1f6285f28525 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:00.317237 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20f47470-49ee-46c6-9232-1f6285f28525 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:00.493352 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-20f47470-49ee-46c6-9232-1f6285f28525 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:00.516252 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-20f47470-49ee-46c6-9232-1f6285f28525 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:00.526607 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-20f47470-49ee-46c6-9232-1f6285f28525 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:00.529245 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-20f47470-49ee-46c6-9232-1f6285f28525 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] 10.222.0.40 "GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630" status: 200 len: 1335 microversion: 2.54 time: 0.256744 Oct 26 13:25:00.529643 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-db363ff6-ea90-4f72-9a92-c462c9d26768 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:00.530339 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-db363ff6-ea90-4f72-9a92-c462c9d26768 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] [instance: e549e405-cbf9-47e2-a178-8d193b7dc4c9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:00.531088 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2432/4878] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:25:00 2022] GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630 => generated 1335 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:25:00.566733 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db363ff6-ea90-4f72-9a92-c462c9d26768 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:00.567230 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db363ff6-ea90-4f72-9a92-c462c9d26768 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:00.567663 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db363ff6-ea90-4f72-9a92-c462c9d26768 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:00.568573 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db363ff6-ea90-4f72-9a92-c462c9d26768 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:00.569188 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db363ff6-ea90-4f72-9a92-c462c9d26768 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:00.569847 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db363ff6-ea90-4f72-9a92-c462c9d26768 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:01.216850 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-fb42c756-b0a1-4ce7-aabc-bd40f123c693 req-98aa2508-896c-45e3-9c00-76b6f318f951 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e549e405-cbf9-47e2-a178-8d193b7dc4c9", "name": "network-vif-plugged", "status": "completed", "tag": "c7b861b4-0c77-4069-bc45-1b49519a593e"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:25:01.273438 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-fb42c756-b0a1-4ce7-aabc-bd40f123c693 req-98aa2508-896c-45e3-9c00-76b6f318f951 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:01.273962 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-fb42c756-b0a1-4ce7-aabc-bd40f123c693 req-98aa2508-896c-45e3-9c00-76b6f318f951 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:01.274401 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-fb42c756-b0a1-4ce7-aabc-bd40f123c693 req-98aa2508-896c-45e3-9c00-76b6f318f951 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:01.344736 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-fb42c756-b0a1-4ce7-aabc-bd40f123c693 req-98aa2508-896c-45e3-9c00-76b6f318f951 service nova] Creating event network-vif-plugged:c7b861b4-0c77-4069-bc45-1b49519a593e for instance e549e405-cbf9-47e2-a178-8d193b7dc4c9 on n-h2-862686-1 Oct 26 13:25:01.356073 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-fb42c756-b0a1-4ce7-aabc-bd40f123c693 req-98aa2508-896c-45e3-9c00-76b6f318f951 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142718 Oct 26 13:25:01.357120 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2433/4879] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:25:01.522865 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-db363ff6-ea90-4f72-9a92-c462c9d26768 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2a855d5e004878ad1b1e25763b47f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7d7c612e04475883e72d3d45676813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:01.536285 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-db363ff6-ea90-4f72-9a92-c462c9d26768 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] 10.222.0.40 "GET /compute/v2.1/servers/e549e405-cbf9-47e2-a178-8d193b7dc4c9" status: 200 len: 1316 microversion: 2.1 time: 1.011921 Oct 26 13:25:01.554512 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2447/4880] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:25:00 2022] GET /compute/v2.1/servers/e549e405-cbf9-47e2-a178-8d193b7dc4c9 => generated 1316 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:25:01.564349 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f3a54e94-fc61-40ec-89d7-c9a1221b11c6 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:01.564988 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f3a54e94-fc61-40ec-89d7-c9a1221b11c6 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] [instance: a61995dd-7fb4-4173-adb9-3d0489fa6630] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:01.585599 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3a54e94-fc61-40ec-89d7-c9a1221b11c6 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:01.586444 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3a54e94-fc61-40ec-89d7-c9a1221b11c6 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:01.587305 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3a54e94-fc61-40ec-89d7-c9a1221b11c6 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:01.603490 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3a54e94-fc61-40ec-89d7-c9a1221b11c6 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:01.604990 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3a54e94-fc61-40ec-89d7-c9a1221b11c6 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:01.605998 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3a54e94-fc61-40ec-89d7-c9a1221b11c6 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:01.763512 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f3a54e94-fc61-40ec-89d7-c9a1221b11c6 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:01.786553 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f3a54e94-fc61-40ec-89d7-c9a1221b11c6 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:01.793233 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f3a54e94-fc61-40ec-89d7-c9a1221b11c6 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:01.797388 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f3a54e94-fc61-40ec-89d7-c9a1221b11c6 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] 10.222.0.40 "GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630" status: 200 len: 1356 microversion: 2.54 time: 0.238884 Oct 26 13:25:01.809622 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2434/4881] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:25:01 2022] GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630 => generated 1356 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:25:01.832667 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f2bd99d0-7fd5-4124-a2a6-139fb175a9c0 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Action: 'create', calling method: .version_select at 0x7f67368f0d30>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1552547759", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIgZ7oRhWfYBqASLTw7DpDkb07NzvFpJrFkH0avl+njIZVHgOOzd1sm8UnGJ1UDsqh+6ZjPANt9fIV7uo7NoUwfbHDwmMjVTrvaRpz2GzDV8h4pEsPZ0ZPJxYkaCBGU1A=="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:25:01.890633 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-f2bd99d0-7fd5-4124-a2a6-139fb175a9c0 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Getting quotas for project 523d65153a4348f986024168091accc8. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:25:01.903043 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-f2bd99d0-7fd5-4124-a2a6-139fb175a9c0 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Getting quotas for user 7d2713aeb2dd4854aa9f8a260d3cc5b5 and project 523d65153a4348f986024168091accc8. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:25:01.956379 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f2bd99d0-7fd5-4124-a2a6-139fb175a9c0 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.128023 Oct 26 13:25:01.957369 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2448/4882] 10.222.0.40 () {62 vars in 1200 bytes} [Wed Oct 26 13:25:01 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 130 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 26 13:25:01.969390 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d22f9132-deab-4f55-8c61-3a7e7f8562d5 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1552547759", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:25:01.975083 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d22f9132-deab-4f55-8c61-3a7e7f8562d5 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] [instance: a61995dd-7fb4-4173-adb9-3d0489fa6630] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:02.003522 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d22f9132-deab-4f55-8c61-3a7e7f8562d5 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:02.009370 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d22f9132-deab-4f55-8c61-3a7e7f8562d5 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:02.010093 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d22f9132-deab-4f55-8c61-3a7e7f8562d5 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:02.011279 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d22f9132-deab-4f55-8c61-3a7e7f8562d5 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:02.015224 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d22f9132-deab-4f55-8c61-3a7e7f8562d5 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:02.016471 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d22f9132-deab-4f55-8c61-3a7e7f8562d5 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:02.278235 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-d22f9132-deab-4f55-8c61-3a7e7f8562d5 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:25:02.278648 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-d22f9132-deab-4f55-8c61-3a7e7f8562d5 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:25:02.283592 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-d22f9132-deab-4f55-8c61-3a7e7f8562d5 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:25:02.284078 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-d22f9132-deab-4f55-8c61-3a7e7f8562d5 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:25:02.289404 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-d22f9132-deab-4f55-8c61-3a7e7f8562d5 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:25:02.421001 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d22f9132-deab-4f55-8c61-3a7e7f8562d5 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] [instance: a61995dd-7fb4-4173-adb9-3d0489fa6630] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:02.429035 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d22f9132-deab-4f55-8c61-3a7e7f8562d5 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:02.429761 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d22f9132-deab-4f55-8c61-3a7e7f8562d5 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:02.430434 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d22f9132-deab-4f55-8c61-3a7e7f8562d5 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:02.431491 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d22f9132-deab-4f55-8c61-3a7e7f8562d5 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:02.432109 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d22f9132-deab-4f55-8c61-3a7e7f8562d5 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:02.432691 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d22f9132-deab-4f55-8c61-3a7e7f8562d5 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:02.472489 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d22f9132-deab-4f55-8c61-3a7e7f8562d5 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] 10.222.0.40 "POST /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630/action" status: 202 len: 1139 microversion: 2.54 time: 0.508104 Oct 26 13:25:02.473458 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2435/4883] 10.222.0.40 () {62 vars in 1320 bytes} [Wed Oct 26 13:25:01 2022] POST /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630/action => generated 1139 bytes in 510 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 26 13:25:02.496660 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-96784d7f-a70d-4485-89aa-a4ceca98d439 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:02.497442 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-96784d7f-a70d-4485-89aa-a4ceca98d439 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] [instance: a61995dd-7fb4-4173-adb9-3d0489fa6630] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:02.518303 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-96784d7f-a70d-4485-89aa-a4ceca98d439 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:02.525454 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-96784d7f-a70d-4485-89aa-a4ceca98d439 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:02.528487 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-96784d7f-a70d-4485-89aa-a4ceca98d439 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:02.532909 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-96784d7f-a70d-4485-89aa-a4ceca98d439 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:02.534921 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-96784d7f-a70d-4485-89aa-a4ceca98d439 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:02.539672 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-96784d7f-a70d-4485-89aa-a4ceca98d439 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:02.572376 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-89e4a9e3-d88e-4761-ade8-cf5f5f781009 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:02.572986 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-89e4a9e3-d88e-4761-ade8-cf5f5f781009 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] [instance: e549e405-cbf9-47e2-a178-8d193b7dc4c9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:02.590725 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89e4a9e3-d88e-4761-ade8-cf5f5f781009 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:02.591698 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89e4a9e3-d88e-4761-ade8-cf5f5f781009 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:02.594203 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89e4a9e3-d88e-4761-ade8-cf5f5f781009 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:02.599749 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89e4a9e3-d88e-4761-ade8-cf5f5f781009 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:02.603137 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89e4a9e3-d88e-4761-ade8-cf5f5f781009 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:02.605819 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89e4a9e3-d88e-4761-ade8-cf5f5f781009 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:02.863138 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-96784d7f-a70d-4485-89aa-a4ceca98d439 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:02.876308 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-96784d7f-a70d-4485-89aa-a4ceca98d439 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:02.876308 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-96784d7f-a70d-4485-89aa-a4ceca98d439 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:02.877295 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-96784d7f-a70d-4485-89aa-a4ceca98d439 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] 10.222.0.40 "GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630" status: 200 len: 1408 microversion: 2.54 time: 0.386696 Oct 26 13:25:02.912561 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2449/4884] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:25:02 2022] GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630 => generated 1408 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:25:02.921425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0107c48e-f033-45ae-8e36-5343d9b7e43f tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:02.928107 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0107c48e-f033-45ae-8e36-5343d9b7e43f tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] [instance: c4a4c540-465f-4048-acde-837a8e37ccce] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:02.944993 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0107c48e-f033-45ae-8e36-5343d9b7e43f tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:02.956178 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0107c48e-f033-45ae-8e36-5343d9b7e43f tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:02.958003 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0107c48e-f033-45ae-8e36-5343d9b7e43f tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:02.961129 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0107c48e-f033-45ae-8e36-5343d9b7e43f tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:02.962411 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0107c48e-f033-45ae-8e36-5343d9b7e43f tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:02.964404 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0107c48e-f033-45ae-8e36-5343d9b7e43f tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:03.047896 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0107c48e-f033-45ae-8e36-5343d9b7e43f tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] 10.222.0.40 "GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120757 Oct 26 13:25:03.048963 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2450/4885] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:25:02 2022] GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:25:03.070845 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bc6aaf8d-3ca4-46d6-a26a-438f36c8cff2 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:03.071719 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bc6aaf8d-3ca4-46d6-a26a-438f36c8cff2 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] [instance: c4a4c540-465f-4048-acde-837a8e37ccce] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:03.079758 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc6aaf8d-3ca4-46d6-a26a-438f36c8cff2 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:03.080746 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc6aaf8d-3ca4-46d6-a26a-438f36c8cff2 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:03.081417 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc6aaf8d-3ca4-46d6-a26a-438f36c8cff2 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:03.082456 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc6aaf8d-3ca4-46d6-a26a-438f36c8cff2 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:03.083164 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc6aaf8d-3ca4-46d6-a26a-438f36c8cff2 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:03.083881 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc6aaf8d-3ca4-46d6-a26a-438f36c8cff2 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:03.255870 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-bc6aaf8d-3ca4-46d6-a26a-438f36c8cff2 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lazy-loading 'services' on Instance uuid c4a4c540-465f-4048-acde-837a8e37ccce {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:25:03.444491 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bc6aaf8d-3ca4-46d6-a26a-438f36c8cff2 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce/os-volume_attachments/f6990e6f-a65d-4404-8115-6bd41f02217c" status: 202 len: 0 microversion: 2.1 time: 0.386263 Oct 26 13:25:03.449916 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2451/4886] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Oct 26 13:25:03 2022] DELETE /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce/os-volume_attachments/f6990e6f-a65d-4404-8115-6bd41f02217c => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:25:03.706488 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-89e4a9e3-d88e-4761-ade8-cf5f5f781009 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2a855d5e004878ad1b1e25763b47f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7d7c612e04475883e72d3d45676813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:03.706488 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-89e4a9e3-d88e-4761-ade8-cf5f5f781009 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] 10.222.0.40 "GET /compute/v2.1/servers/e549e405-cbf9-47e2-a178-8d193b7dc4c9" status: 200 len: 1316 microversion: 2.1 time: 1.122468 Oct 26 13:25:03.706488 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2436/4887] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:25:02 2022] GET /compute/v2.1/servers/e549e405-cbf9-47e2-a178-8d193b7dc4c9 => generated 1316 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:25:03.911291 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-432c0166-111e-4029-9ade-1f35fb5932aa tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:03.915549 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-432c0166-111e-4029-9ade-1f35fb5932aa tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] [instance: a61995dd-7fb4-4173-adb9-3d0489fa6630] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:03.949651 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-432c0166-111e-4029-9ade-1f35fb5932aa tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:03.957085 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-432c0166-111e-4029-9ade-1f35fb5932aa tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:03.962044 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-432c0166-111e-4029-9ade-1f35fb5932aa tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:03.962883 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-432c0166-111e-4029-9ade-1f35fb5932aa tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:03.967629 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-432c0166-111e-4029-9ade-1f35fb5932aa tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:03.968357 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-432c0166-111e-4029-9ade-1f35fb5932aa tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:04.169369 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-432c0166-111e-4029-9ade-1f35fb5932aa tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:04.180906 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-432c0166-111e-4029-9ade-1f35fb5932aa tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:04.183000 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-432c0166-111e-4029-9ade-1f35fb5932aa tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:04.184589 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-432c0166-111e-4029-9ade-1f35fb5932aa tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] 10.222.0.40 "GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630" status: 200 len: 1408 microversion: 2.54 time: 0.280250 Oct 26 13:25:04.185703 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2452/4888] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:25:03 2022] GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630 => generated 1408 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:25:04.721815 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7278abed-87c7-43fc-a00c-e65a4e88a1ca tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:04.723780 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7278abed-87c7-43fc-a00c-e65a4e88a1ca tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] [instance: e549e405-cbf9-47e2-a178-8d193b7dc4c9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:04.742327 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7278abed-87c7-43fc-a00c-e65a4e88a1ca tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:04.744018 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7278abed-87c7-43fc-a00c-e65a4e88a1ca tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:04.744816 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7278abed-87c7-43fc-a00c-e65a4e88a1ca tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:04.754888 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7278abed-87c7-43fc-a00c-e65a4e88a1ca tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:04.755705 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7278abed-87c7-43fc-a00c-e65a4e88a1ca tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:04.756898 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7278abed-87c7-43fc-a00c-e65a4e88a1ca tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:05.215845 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-63b36637-5e80-44af-a751-f4fc2d938bed tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:05.216416 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-63b36637-5e80-44af-a751-f4fc2d938bed tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] [instance: a61995dd-7fb4-4173-adb9-3d0489fa6630] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:05.238955 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63b36637-5e80-44af-a751-f4fc2d938bed tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:05.240605 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63b36637-5e80-44af-a751-f4fc2d938bed tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:05.241234 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63b36637-5e80-44af-a751-f4fc2d938bed tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:05.242660 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63b36637-5e80-44af-a751-f4fc2d938bed tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:05.243318 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63b36637-5e80-44af-a751-f4fc2d938bed tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:05.243923 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63b36637-5e80-44af-a751-f4fc2d938bed tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:05.388777 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-63b36637-5e80-44af-a751-f4fc2d938bed tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:05.400260 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-63b36637-5e80-44af-a751-f4fc2d938bed tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:05.402296 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-63b36637-5e80-44af-a751-f4fc2d938bed tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:05.406957 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-63b36637-5e80-44af-a751-f4fc2d938bed tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] 10.222.0.40 "GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630" status: 200 len: 1408 microversion: 2.54 time: 0.197679 Oct 26 13:25:05.409889 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2453/4889] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:25:05 2022] GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630 => generated 1408 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:25:05.464040 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7278abed-87c7-43fc-a00c-e65a4e88a1ca tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2a855d5e004878ad1b1e25763b47f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7d7c612e04475883e72d3d45676813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:05.479273 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7278abed-87c7-43fc-a00c-e65a4e88a1ca tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] 10.222.0.40 "GET /compute/v2.1/servers/e549e405-cbf9-47e2-a178-8d193b7dc4c9" status: 200 len: 1502 microversion: 2.1 time: 0.761599 Oct 26 13:25:05.480914 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2437/4890] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:25:04 2022] GET /compute/v2.1/servers/e549e405-cbf9-47e2-a178-8d193b7dc4c9 => generated 1502 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:25:05.524822 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b9a491c8-63fe-4f89-82ae-61860388c463 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:05.525728 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b9a491c8-63fe-4f89-82ae-61860388c463 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] [instance: e549e405-cbf9-47e2-a178-8d193b7dc4c9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:05.539016 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9a491c8-63fe-4f89-82ae-61860388c463 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:05.540055 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9a491c8-63fe-4f89-82ae-61860388c463 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:05.541132 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9a491c8-63fe-4f89-82ae-61860388c463 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:05.542409 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9a491c8-63fe-4f89-82ae-61860388c463 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:05.543253 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9a491c8-63fe-4f89-82ae-61860388c463 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:05.544316 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9a491c8-63fe-4f89-82ae-61860388c463 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:05.703962 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:25:05.750392 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b9a491c8-63fe-4f89-82ae-61860388c463 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e549e405-cbf9-47e2-a178-8d193b7dc4c9/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.233535 Oct 26 13:25:05.751212 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2454/4891] 10.222.0.40 () {58 vars in 1296 bytes} [Wed Oct 26 13:25:05 2022] DELETE /compute/v2.1/servers/e549e405-cbf9-47e2-a178-8d193b7dc4c9/os-server-password => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:25:05.761080 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bd5a0b4e-678b-43dc-8b18-60dacca80a06 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:05.761834 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bd5a0b4e-678b-43dc-8b18-60dacca80a06 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] [instance: e549e405-cbf9-47e2-a178-8d193b7dc4c9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:05.782161 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd5a0b4e-678b-43dc-8b18-60dacca80a06 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:05.783296 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd5a0b4e-678b-43dc-8b18-60dacca80a06 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:05.784667 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd5a0b4e-678b-43dc-8b18-60dacca80a06 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:05.785975 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd5a0b4e-678b-43dc-8b18-60dacca80a06 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:05.788067 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd5a0b4e-678b-43dc-8b18-60dacca80a06 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:05.790904 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd5a0b4e-678b-43dc-8b18-60dacca80a06 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:05.862558 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bd5a0b4e-678b-43dc-8b18-60dacca80a06 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] 10.222.0.40 "GET /compute/v2.1/servers/e549e405-cbf9-47e2-a178-8d193b7dc4c9/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.105850 Oct 26 13:25:05.863773 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2438/4892] 10.222.0.40 () {58 vars in 1293 bytes} [Wed Oct 26 13:25:05 2022] GET /compute/v2.1/servers/e549e405-cbf9-47e2-a178-8d193b7dc4c9/os-server-password => generated 16 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:25:05.874491 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4cc75f46-8bba-4412-86d6-6c263469a5a4 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:05.876083 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4cc75f46-8bba-4412-86d6-6c263469a5a4 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] [instance: e549e405-cbf9-47e2-a178-8d193b7dc4c9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:05.883570 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cc75f46-8bba-4412-86d6-6c263469a5a4 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:05.884877 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cc75f46-8bba-4412-86d6-6c263469a5a4 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:05.886605 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cc75f46-8bba-4412-86d6-6c263469a5a4 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:05.888372 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cc75f46-8bba-4412-86d6-6c263469a5a4 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:05.890273 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cc75f46-8bba-4412-86d6-6c263469a5a4 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:05.891491 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cc75f46-8bba-4412-86d6-6c263469a5a4 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:05.933709 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4cc75f46-8bba-4412-86d6-6c263469a5a4 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] [instance: e549e405-cbf9-47e2-a178-8d193b7dc4c9] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:25:06.085861 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4cc75f46-8bba-4412-86d6-6c263469a5a4 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e549e405-cbf9-47e2-a178-8d193b7dc4c9" status: 204 len: 0 microversion: 2.1 time: 0.215629 Oct 26 13:25:06.098467 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2455/4893] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:25:05 2022] DELETE /compute/v2.1/servers/e549e405-cbf9-47e2-a178-8d193b7dc4c9 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 26 13:25:06.099582 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9829c9b9-6b11-4e75-a704-215b5d0ae4c0 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:06.100651 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9829c9b9-6b11-4e75-a704-215b5d0ae4c0 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] [instance: e549e405-cbf9-47e2-a178-8d193b7dc4c9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:06.119408 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9829c9b9-6b11-4e75-a704-215b5d0ae4c0 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:06.120753 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9829c9b9-6b11-4e75-a704-215b5d0ae4c0 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:06.123597 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9829c9b9-6b11-4e75-a704-215b5d0ae4c0 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:06.127409 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9829c9b9-6b11-4e75-a704-215b5d0ae4c0 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:06.128875 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9829c9b9-6b11-4e75-a704-215b5d0ae4c0 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:06.130679 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9829c9b9-6b11-4e75-a704-215b5d0ae4c0 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:06.444640 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-80e1af95-b386-4443-ba45-b93ca810ad2d tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:06.445237 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9829c9b9-6b11-4e75-a704-215b5d0ae4c0 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2a855d5e004878ad1b1e25763b47f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7d7c612e04475883e72d3d45676813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:06.446126 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-80e1af95-b386-4443-ba45-b93ca810ad2d tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] [instance: a61995dd-7fb4-4173-adb9-3d0489fa6630] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:06.447700 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=4 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:25:06.455816 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9829c9b9-6b11-4e75-a704-215b5d0ae4c0 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] 10.222.0.40 "GET /compute/v2.1/servers/e549e405-cbf9-47e2-a178-8d193b7dc4c9" status: 200 len: 1508 microversion: 2.1 time: 0.362620 Oct 26 13:25:06.464623 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2439/4894] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:25:06 2022] GET /compute/v2.1/servers/e549e405-cbf9-47e2-a178-8d193b7dc4c9 => generated 1508 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:25:06.478140 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=4 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:25:06.485900 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-80e1af95-b386-4443-ba45-b93ca810ad2d tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:06.486631 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-80e1af95-b386-4443-ba45-b93ca810ad2d tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:06.488966 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-80e1af95-b386-4443-ba45-b93ca810ad2d tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:06.491939 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-80e1af95-b386-4443-ba45-b93ca810ad2d tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:06.492584 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-80e1af95-b386-4443-ba45-b93ca810ad2d tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:06.495427 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-80e1af95-b386-4443-ba45-b93ca810ad2d tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:06.663882 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-80e1af95-b386-4443-ba45-b93ca810ad2d tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:06.677046 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-80e1af95-b386-4443-ba45-b93ca810ad2d tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:06.679125 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-80e1af95-b386-4443-ba45-b93ca810ad2d tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:06.685095 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-80e1af95-b386-4443-ba45-b93ca810ad2d tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] 10.222.0.40 "GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630" status: 200 len: 1408 microversion: 2.54 time: 0.250645 Oct 26 13:25:06.688402 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2456/4895] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:25:06 2022] GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630 => generated 1408 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:25:07.483002 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-392d6fee-c56c-40fc-8a14-d2fa9d7ee851 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:07.483632 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-392d6fee-c56c-40fc-8a14-d2fa9d7ee851 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] [instance: e549e405-cbf9-47e2-a178-8d193b7dc4c9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:07.511884 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-392d6fee-c56c-40fc-8a14-d2fa9d7ee851 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:07.512390 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-392d6fee-c56c-40fc-8a14-d2fa9d7ee851 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:07.512837 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-392d6fee-c56c-40fc-8a14-d2fa9d7ee851 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:07.513579 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-392d6fee-c56c-40fc-8a14-d2fa9d7ee851 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:07.518377 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-392d6fee-c56c-40fc-8a14-d2fa9d7ee851 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:07.520301 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-392d6fee-c56c-40fc-8a14-d2fa9d7ee851 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:07.715570 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8e2888ad-c2da-45a1-9c49-16495b0ebb47 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:07.716301 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8e2888ad-c2da-45a1-9c49-16495b0ebb47 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] [instance: a61995dd-7fb4-4173-adb9-3d0489fa6630] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:07.720930 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:25:07.730698 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e2888ad-c2da-45a1-9c49-16495b0ebb47 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:07.740665 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e2888ad-c2da-45a1-9c49-16495b0ebb47 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:07.741939 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e2888ad-c2da-45a1-9c49-16495b0ebb47 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:07.746103 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e2888ad-c2da-45a1-9c49-16495b0ebb47 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:07.746778 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e2888ad-c2da-45a1-9c49-16495b0ebb47 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:07.751471 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e2888ad-c2da-45a1-9c49-16495b0ebb47 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:07.984536 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8e2888ad-c2da-45a1-9c49-16495b0ebb47 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:08.000620 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8e2888ad-c2da-45a1-9c49-16495b0ebb47 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:08.005116 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8e2888ad-c2da-45a1-9c49-16495b0ebb47 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:08.022078 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8e2888ad-c2da-45a1-9c49-16495b0ebb47 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] 10.222.0.40 "GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630" status: 200 len: 1408 microversion: 2.54 time: 0.294706 Oct 26 13:25:08.022729 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2457/4896] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:25:07 2022] GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630 => generated 1408 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:25:08.156605 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-392d6fee-c56c-40fc-8a14-d2fa9d7ee851 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2a855d5e004878ad1b1e25763b47f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7d7c612e04475883e72d3d45676813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:08.166021 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-392d6fee-c56c-40fc-8a14-d2fa9d7ee851 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] 10.222.0.40 "GET /compute/v2.1/servers/e549e405-cbf9-47e2-a178-8d193b7dc4c9" status: 200 len: 1508 microversion: 2.1 time: 0.688438 Oct 26 13:25:08.168696 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2440/4897] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:25:07 2022] GET /compute/v2.1/servers/e549e405-cbf9-47e2-a178-8d193b7dc4c9 => generated 1508 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:25:09.057353 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3a591a65-73fa-47fb-a455-22594abc073b tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:09.059313 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3a591a65-73fa-47fb-a455-22594abc073b tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] [instance: a61995dd-7fb4-4173-adb9-3d0489fa6630] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:09.080077 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3a591a65-73fa-47fb-a455-22594abc073b tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:09.083678 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3a591a65-73fa-47fb-a455-22594abc073b tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:09.084538 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3a591a65-73fa-47fb-a455-22594abc073b tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:09.086608 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3a591a65-73fa-47fb-a455-22594abc073b tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:09.087896 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3a591a65-73fa-47fb-a455-22594abc073b tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:09.090483 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3a591a65-73fa-47fb-a455-22594abc073b tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:09.195867 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5bc8b35e-2802-4e5e-a5dd-27bca1ca2472 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:09.197078 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5bc8b35e-2802-4e5e-a5dd-27bca1ca2472 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] [instance: e549e405-cbf9-47e2-a178-8d193b7dc4c9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:09.208255 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bc8b35e-2802-4e5e-a5dd-27bca1ca2472 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:09.215585 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bc8b35e-2802-4e5e-a5dd-27bca1ca2472 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:09.216302 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bc8b35e-2802-4e5e-a5dd-27bca1ca2472 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:09.217230 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bc8b35e-2802-4e5e-a5dd-27bca1ca2472 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:09.217997 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bc8b35e-2802-4e5e-a5dd-27bca1ca2472 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:09.218760 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bc8b35e-2802-4e5e-a5dd-27bca1ca2472 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:09.429391 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3a591a65-73fa-47fb-a455-22594abc073b tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:09.438600 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3a591a65-73fa-47fb-a455-22594abc073b tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:09.447654 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3a591a65-73fa-47fb-a455-22594abc073b tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:09.455327 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3a591a65-73fa-47fb-a455-22594abc073b tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] 10.222.0.40 "GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630" status: 200 len: 1408 microversion: 2.54 time: 0.403362 Oct 26 13:25:09.465385 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2458/4898] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:25:09 2022] GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630 => generated 1408 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:25:09.998714 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5bc8b35e-2802-4e5e-a5dd-27bca1ca2472 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2a855d5e004878ad1b1e25763b47f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7d7c612e04475883e72d3d45676813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:10.010586 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5bc8b35e-2802-4e5e-a5dd-27bca1ca2472 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] 10.222.0.40 "GET /compute/v2.1/servers/e549e405-cbf9-47e2-a178-8d193b7dc4c9" status: 200 len: 1508 microversion: 2.1 time: 0.820099 Oct 26 13:25:10.018529 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2441/4899] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:25:09 2022] GET /compute/v2.1/servers/e549e405-cbf9-47e2-a178-8d193b7dc4c9 => generated 1508 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:25:10.130805 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-02379156-cedb-41ac-bcc8-9c0c8621e000 req-50aceb57-b19d-4282-938e-dcf2f166565f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e549e405-cbf9-47e2-a178-8d193b7dc4c9", "name": "network-vif-deleted", "tag": "c7b861b4-0c77-4069-bc45-1b49519a593e"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:25:10.171013 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-02379156-cedb-41ac-bcc8-9c0c8621e000 req-50aceb57-b19d-4282-938e-dcf2f166565f service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:10.171546 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-02379156-cedb-41ac-bcc8-9c0c8621e000 req-50aceb57-b19d-4282-938e-dcf2f166565f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:10.172158 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-02379156-cedb-41ac-bcc8-9c0c8621e000 req-50aceb57-b19d-4282-938e-dcf2f166565f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:10.222215 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-02379156-cedb-41ac-bcc8-9c0c8621e000 req-50aceb57-b19d-4282-938e-dcf2f166565f service nova] Creating event network-vif-deleted:c7b861b4-0c77-4069-bc45-1b49519a593e for instance e549e405-cbf9-47e2-a178-8d193b7dc4c9 on n-h2-862686-1 Oct 26 13:25:10.259819 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-02379156-cedb-41ac-bcc8-9c0c8621e000 req-50aceb57-b19d-4282-938e-dcf2f166565f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133112 Oct 26 13:25:10.274372 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2459/4900] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:25:10.494606 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-db309137-8de5-4ab8-a82f-bc52e4be01ac tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:10.495916 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-db309137-8de5-4ab8-a82f-bc52e4be01ac tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] [instance: a61995dd-7fb4-4173-adb9-3d0489fa6630] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:10.508562 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-db309137-8de5-4ab8-a82f-bc52e4be01ac tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:10.509433 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-db309137-8de5-4ab8-a82f-bc52e4be01ac tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:10.510242 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-db309137-8de5-4ab8-a82f-bc52e4be01ac tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:10.511440 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-db309137-8de5-4ab8-a82f-bc52e4be01ac tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:10.512120 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-db309137-8de5-4ab8-a82f-bc52e4be01ac tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:10.512770 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-db309137-8de5-4ab8-a82f-bc52e4be01ac tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:10.785542 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-db309137-8de5-4ab8-a82f-bc52e4be01ac tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:10.794990 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-db309137-8de5-4ab8-a82f-bc52e4be01ac tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:10.802303 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-db309137-8de5-4ab8-a82f-bc52e4be01ac tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:10.811046 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-db309137-8de5-4ab8-a82f-bc52e4be01ac tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] 10.222.0.40 "GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630" status: 200 len: 1408 microversion: 2.54 time: 0.320571 Oct 26 13:25:10.818507 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2442/4901] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:25:10 2022] GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630 => generated 1408 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:25:11.042217 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fc6cf853-1e69-4172-926a-2434c2210835 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:11.043162 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fc6cf853-1e69-4172-926a-2434c2210835 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] [instance: e549e405-cbf9-47e2-a178-8d193b7dc4c9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:11.059924 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fc6cf853-1e69-4172-926a-2434c2210835 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:11.078448 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fc6cf853-1e69-4172-926a-2434c2210835 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:11.081513 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fc6cf853-1e69-4172-926a-2434c2210835 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:11.084985 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fc6cf853-1e69-4172-926a-2434c2210835 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:11.091339 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fc6cf853-1e69-4172-926a-2434c2210835 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:11.093427 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fc6cf853-1e69-4172-926a-2434c2210835 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:11.223066 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fc6cf853-1e69-4172-926a-2434c2210835 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:11.224345 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fc6cf853-1e69-4172-926a-2434c2210835 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:11.225018 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fc6cf853-1e69-4172-926a-2434c2210835 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:11.225708 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-fc6cf853-1e69-4172-926a-2434c2210835 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lazy-loading 'fault' on Instance uuid e549e405-cbf9-47e2-a178-8d193b7dc4c9 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:25:11.414019 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fc6cf853-1e69-4172-926a-2434c2210835 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2a855d5e004878ad1b1e25763b47f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7d7c612e04475883e72d3d45676813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:11.423999 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fc6cf853-1e69-4172-926a-2434c2210835 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] 10.222.0.40 "GET /compute/v2.1/servers/e549e405-cbf9-47e2-a178-8d193b7dc4c9" status: 200 len: 1306 microversion: 2.1 time: 0.387784 Oct 26 13:25:11.428452 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2460/4902] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:25:11 2022] GET /compute/v2.1/servers/e549e405-cbf9-47e2-a178-8d193b7dc4c9 => generated 1306 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:25:11.847419 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4349f6c8-24fc-41c9-b4a4-b59f7d8c4382 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:11.848244 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4349f6c8-24fc-41c9-b4a4-b59f7d8c4382 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] [instance: a61995dd-7fb4-4173-adb9-3d0489fa6630] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:11.876591 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4349f6c8-24fc-41c9-b4a4-b59f7d8c4382 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:11.877303 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4349f6c8-24fc-41c9-b4a4-b59f7d8c4382 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:11.877781 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4349f6c8-24fc-41c9-b4a4-b59f7d8c4382 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:11.878509 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4349f6c8-24fc-41c9-b4a4-b59f7d8c4382 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:11.878977 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4349f6c8-24fc-41c9-b4a4-b59f7d8c4382 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:11.879403 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4349f6c8-24fc-41c9-b4a4-b59f7d8c4382 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:12.169587 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4349f6c8-24fc-41c9-b4a4-b59f7d8c4382 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:12.180562 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4349f6c8-24fc-41c9-b4a4-b59f7d8c4382 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:12.189054 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4349f6c8-24fc-41c9-b4a4-b59f7d8c4382 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:12.200308 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4349f6c8-24fc-41c9-b4a4-b59f7d8c4382 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] 10.222.0.40 "GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630" status: 200 len: 1408 microversion: 2.54 time: 0.357987 Oct 26 13:25:12.204794 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2443/4903] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:25:11 2022] GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630 => generated 1408 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:25:12.451400 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c9838cc2-c573-439a-a9dc-65454e62b138 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:12.451983 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c9838cc2-c573-439a-a9dc-65454e62b138 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] [instance: e549e405-cbf9-47e2-a178-8d193b7dc4c9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:12.458510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=16 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:25:12.463376 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9838cc2-c573-439a-a9dc-65454e62b138 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:12.463822 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9838cc2-c573-439a-a9dc-65454e62b138 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:12.464370 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9838cc2-c573-439a-a9dc-65454e62b138 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:12.465162 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9838cc2-c573-439a-a9dc-65454e62b138 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:12.475642 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9838cc2-c573-439a-a9dc-65454e62b138 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:12.476381 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9838cc2-c573-439a-a9dc-65454e62b138 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:12.546540 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-c9838cc2-c573-439a-a9dc-65454e62b138 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] HTTP exception thrown: Instance e549e405-cbf9-47e2-a178-8d193b7dc4c9 could not be found. Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c9838cc2-c573-439a-a9dc-65454e62b138 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Request method failure captured: Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/e549e405-cbf9-47e2-a178-8d193b7dc4c9 HTTP/1.1 Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTUa3TYwmiK2HbXW9FiXwgQxWNs8ahwP7KNUr5yt2iYVHJe4JpFOsX9lgd0VcTI3D5v06GyZMlifRyiwvAYPeA-MbYtNMJdlRK2t1-mmpnrYx96ySNnaVYIQ7cZepKDwBy-O-Z3Yr0jdpCwln-AuMGwY8wsmZnYK4o_Q4NJMkCPTCvc Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: fb7d7c612e04475883e72d3d45676813 Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServerPasswordTestJSON-591766277 Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fb7d7c612e04475883e72d3d45676813"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fb7d7c612e04475883e72d3d45676813"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fb7d7c612e04475883e72d3d45676813"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fb7d7c612e04475883e72d3d45676813"}]}] Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServerPasswordTestJSON-591766277 Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: fb7d7c612e04475883e72d3d45676813 Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServerPasswordTestJSON-591766277 Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServerPasswordTestJSON-591766277-project Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: af2a855d5e004878ad1b1e25763b47f3 Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServerPasswordTestJSON-591766277-project Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance e549e405-cbf9-47e2-a178-8d193b7dc4c9 could not be found. Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'e549e405-cbf9-47e2-a178-8d193b7dc4c9'} Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e549e405-cbf9-47e2-a178-8d193b7dc4c9 could not be found. Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e549e405-cbf9-47e2-a178-8d193b7dc4c9 could not be found. Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:25:12.548922 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:25:12.554060 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:25:12.554060 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:25:12.554060 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:25:12.554060 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:25:12.554060 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:25:12.554060 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e549e405-cbf9-47e2-a178-8d193b7dc4c9 could not be found. Oct 26 13:25:12.554060 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:25:12.560027 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c9838cc2-c573-439a-a9dc-65454e62b138 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] Returning 404 to user: Instance e549e405-cbf9-47e2-a178-8d193b7dc4c9 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:25:12.562053 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c9838cc2-c573-439a-a9dc-65454e62b138 tempest-ServerPasswordTestJSON-591766277 tempest-ServerPasswordTestJSON-591766277-project] 10.222.0.40 "GET /compute/v2.1/servers/e549e405-cbf9-47e2-a178-8d193b7dc4c9" status: 404 len: 111 microversion: 2.1 time: 0.113718 Oct 26 13:25:12.567718 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2461/4904] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:25:12 2022] GET /compute/v2.1/servers/e549e405-cbf9-47e2-a178-8d193b7dc4c9 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:25:12.657324 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d47ffcf5-83d2-4f9f-977c-88b4813c9866 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:12.663948 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d47ffcf5-83d2-4f9f-977c-88b4813c9866 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] [instance: c4a4c540-465f-4048-acde-837a8e37ccce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:12.675315 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d47ffcf5-83d2-4f9f-977c-88b4813c9866 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:12.677109 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d47ffcf5-83d2-4f9f-977c-88b4813c9866 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:12.679406 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d47ffcf5-83d2-4f9f-977c-88b4813c9866 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:12.682135 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d47ffcf5-83d2-4f9f-977c-88b4813c9866 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:12.682931 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d47ffcf5-83d2-4f9f-977c-88b4813c9866 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:12.684046 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d47ffcf5-83d2-4f9f-977c-88b4813c9866 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:12.691399 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:25:12.768084 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d47ffcf5-83d2-4f9f-977c-88b4813c9866 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] 10.222.0.40 "GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.113730 Oct 26 13:25:12.769608 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2444/4905] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:25:12 2022] GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce/os-volume_attachments => generated 25 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 26 13:25:12.916234 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-03fa26e5-fefa-41bf-bea6-8cf097f9d45d tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:12.918564 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-03fa26e5-fefa-41bf-bea6-8cf097f9d45d tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] [instance: c4a4c540-465f-4048-acde-837a8e37ccce] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:12.929312 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03fa26e5-fefa-41bf-bea6-8cf097f9d45d tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:12.942303 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03fa26e5-fefa-41bf-bea6-8cf097f9d45d tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:12.943046 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03fa26e5-fefa-41bf-bea6-8cf097f9d45d tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:12.943974 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03fa26e5-fefa-41bf-bea6-8cf097f9d45d tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:12.944437 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03fa26e5-fefa-41bf-bea6-8cf097f9d45d tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:12.944871 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03fa26e5-fefa-41bf-bea6-8cf097f9d45d tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:13.029205 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-03fa26e5-fefa-41bf-bea6-8cf097f9d45d tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] 10.222.0.40 "GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.116942 Oct 26 13:25:13.033775 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2462/4906] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 13:25:12 2022] GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce/os-volume_attachments => generated 25 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:25:13.124472 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-39c02c0f-6f46-47ec-9c23-2045d69c9055 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:13.125076 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-39c02c0f-6f46-47ec-9c23-2045d69c9055 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] [instance: c4a4c540-465f-4048-acde-837a8e37ccce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:13.165743 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39c02c0f-6f46-47ec-9c23-2045d69c9055 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:13.166352 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39c02c0f-6f46-47ec-9c23-2045d69c9055 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:13.167890 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39c02c0f-6f46-47ec-9c23-2045d69c9055 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:13.173930 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39c02c0f-6f46-47ec-9c23-2045d69c9055 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:13.174532 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39c02c0f-6f46-47ec-9c23-2045d69c9055 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:13.175772 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39c02c0f-6f46-47ec-9c23-2045d69c9055 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:13.235709 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-924fa6b4-ce91-4505-9e09-7ea490e30858 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:13.236779 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-924fa6b4-ce91-4505-9e09-7ea490e30858 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] [instance: a61995dd-7fb4-4173-adb9-3d0489fa6630] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:13.262962 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-924fa6b4-ce91-4505-9e09-7ea490e30858 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:13.284791 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-924fa6b4-ce91-4505-9e09-7ea490e30858 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:13.286145 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-924fa6b4-ce91-4505-9e09-7ea490e30858 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:13.293541 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-924fa6b4-ce91-4505-9e09-7ea490e30858 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:13.295271 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-924fa6b4-ce91-4505-9e09-7ea490e30858 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:13.299565 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-924fa6b4-ce91-4505-9e09-7ea490e30858 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:13.346974 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-39c02c0f-6f46-47ec-9c23-2045d69c9055 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] [instance: c4a4c540-465f-4048-acde-837a8e37ccce] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:25:13.675785 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-39c02c0f-6f46-47ec-9c23-2045d69c9055 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce" status: 204 len: 0 microversion: 2.1 time: 0.555551 Oct 26 13:25:13.677230 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2445/4907] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:25:13 2022] DELETE /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce => generated 0 bytes in 558 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:25:13.688177 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b6b6b682-b1ce-4572-bcc1-f8daa929efc6 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:13.689760 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b6b6b682-b1ce-4572-bcc1-f8daa929efc6 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] [instance: c4a4c540-465f-4048-acde-837a8e37ccce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:13.710083 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6b6b682-b1ce-4572-bcc1-f8daa929efc6 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:13.710754 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6b6b682-b1ce-4572-bcc1-f8daa929efc6 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:13.711431 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6b6b682-b1ce-4572-bcc1-f8daa929efc6 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:13.712378 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6b6b682-b1ce-4572-bcc1-f8daa929efc6 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:13.713050 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6b6b682-b1ce-4572-bcc1-f8daa929efc6 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:13.713732 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6b6b682-b1ce-4572-bcc1-f8daa929efc6 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:14.338085 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b6b6b682-b1ce-4572-bcc1-f8daa929efc6 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f4b72866e4fce93253f71822830d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd450288d3d6249b385056f524c1e5bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:14.357158 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b6b6b682-b1ce-4572-bcc1-f8daa929efc6 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] 10.222.0.40 "GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce" status: 200 len: 1681 microversion: 2.1 time: 0.671758 Oct 26 13:25:14.361220 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2446/4908] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:25:13 2022] GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce => generated 1681 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:25:14.460642 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-924fa6b4-ce91-4505-9e09-7ea490e30858 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:14.474343 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-924fa6b4-ce91-4505-9e09-7ea490e30858 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:14.480239 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-924fa6b4-ce91-4505-9e09-7ea490e30858 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:14.487614 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-924fa6b4-ce91-4505-9e09-7ea490e30858 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] 10.222.0.40 "GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630" status: 200 len: 1408 microversion: 2.54 time: 1.258204 Oct 26 13:25:14.506596 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2463/4909] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:25:13 2022] GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630 => generated 1408 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:25:15.383751 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-148642ed-5175-4795-ac41-54efbf10135a tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:15.384284 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-148642ed-5175-4795-ac41-54efbf10135a tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] [instance: c4a4c540-465f-4048-acde-837a8e37ccce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:15.393157 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-148642ed-5175-4795-ac41-54efbf10135a tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:15.396560 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-148642ed-5175-4795-ac41-54efbf10135a tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:15.400300 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-148642ed-5175-4795-ac41-54efbf10135a tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:15.404106 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-148642ed-5175-4795-ac41-54efbf10135a tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:15.404905 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-148642ed-5175-4795-ac41-54efbf10135a tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:15.406705 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-148642ed-5175-4795-ac41-54efbf10135a tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:15.523627 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d03f3761-bd15-46f1-af71-f9933bc9581e tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:15.525037 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d03f3761-bd15-46f1-af71-f9933bc9581e tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] [instance: a61995dd-7fb4-4173-adb9-3d0489fa6630] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:15.539955 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d03f3761-bd15-46f1-af71-f9933bc9581e tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:15.540451 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d03f3761-bd15-46f1-af71-f9933bc9581e tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:15.542768 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d03f3761-bd15-46f1-af71-f9933bc9581e tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:15.545798 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d03f3761-bd15-46f1-af71-f9933bc9581e tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:15.545959 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d03f3761-bd15-46f1-af71-f9933bc9581e tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:15.546357 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d03f3761-bd15-46f1-af71-f9933bc9581e tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:15.779418 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d03f3761-bd15-46f1-af71-f9933bc9581e tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:15.799669 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d03f3761-bd15-46f1-af71-f9933bc9581e tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:15.801171 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d03f3761-bd15-46f1-af71-f9933bc9581e tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:15.802650 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d03f3761-bd15-46f1-af71-f9933bc9581e tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] 10.222.0.40 "GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630" status: 200 len: 1408 microversion: 2.54 time: 0.283192 Oct 26 13:25:15.819600 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2464/4910] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:25:15 2022] GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630 => generated 1408 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:25:16.443063 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-148642ed-5175-4795-ac41-54efbf10135a tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f4b72866e4fce93253f71822830d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd450288d3d6249b385056f524c1e5bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:16.459113 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-148642ed-5175-4795-ac41-54efbf10135a tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] 10.222.0.40 "GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce" status: 200 len: 1681 microversion: 2.1 time: 1.079164 Oct 26 13:25:16.462364 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2447/4911] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:25:15 2022] GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce => generated 1681 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:25:16.834099 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-392265d5-a82c-4b63-a415-626734285759 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:16.837329 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-392265d5-a82c-4b63-a415-626734285759 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] [instance: a61995dd-7fb4-4173-adb9-3d0489fa6630] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:16.868377 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-392265d5-a82c-4b63-a415-626734285759 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:16.872236 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-392265d5-a82c-4b63-a415-626734285759 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:16.874341 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-392265d5-a82c-4b63-a415-626734285759 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:16.879047 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-392265d5-a82c-4b63-a415-626734285759 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:16.880982 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-392265d5-a82c-4b63-a415-626734285759 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:16.885887 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-392265d5-a82c-4b63-a415-626734285759 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:17.126243 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-392265d5-a82c-4b63-a415-626734285759 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:17.141992 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-392265d5-a82c-4b63-a415-626734285759 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:17.144211 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-392265d5-a82c-4b63-a415-626734285759 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:17.150424 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-392265d5-a82c-4b63-a415-626734285759 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] 10.222.0.40 "GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630" status: 200 len: 1408 microversion: 2.54 time: 0.323466 Oct 26 13:25:17.154590 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2465/4912] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:25:16 2022] GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630 => generated 1408 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:25:17.494147 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-39c42003-83ad-428a-9b17-cfeacce19b4d tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:17.494770 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-39c42003-83ad-428a-9b17-cfeacce19b4d tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] [instance: c4a4c540-465f-4048-acde-837a8e37ccce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:17.514870 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39c42003-83ad-428a-9b17-cfeacce19b4d tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:17.515438 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39c42003-83ad-428a-9b17-cfeacce19b4d tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:17.523646 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39c42003-83ad-428a-9b17-cfeacce19b4d tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:17.528282 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39c42003-83ad-428a-9b17-cfeacce19b4d tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:17.528844 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39c42003-83ad-428a-9b17-cfeacce19b4d tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:17.529297 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39c42003-83ad-428a-9b17-cfeacce19b4d tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:18.137465 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-39c42003-83ad-428a-9b17-cfeacce19b4d tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f4b72866e4fce93253f71822830d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd450288d3d6249b385056f524c1e5bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:18.146367 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-39c42003-83ad-428a-9b17-cfeacce19b4d tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] 10.222.0.40 "GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce" status: 200 len: 1614 microversion: 2.1 time: 0.660779 Oct 26 13:25:18.149460 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2448/4913] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:25:17 2022] GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce => generated 1614 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:25:18.184958 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4c5f5a50-a2a5-4028-8c48-fcce0f71e792 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:18.186811 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4c5f5a50-a2a5-4028-8c48-fcce0f71e792 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] [instance: a61995dd-7fb4-4173-adb9-3d0489fa6630] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:18.214713 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c5f5a50-a2a5-4028-8c48-fcce0f71e792 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:18.219811 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c5f5a50-a2a5-4028-8c48-fcce0f71e792 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:18.224882 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c5f5a50-a2a5-4028-8c48-fcce0f71e792 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:18.228033 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-e988dca0-e0ea-4048-a371-52a3ba73b358 req-fcad23e7-a0c6-4fae-be06-61c2d8a4d088 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4a4c540-465f-4048-acde-837a8e37ccce", "name": "network-vif-deleted", "tag": "7e73ce63-ac95-40f9-b1ad-563ef977f94e"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:25:18.242003 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c5f5a50-a2a5-4028-8c48-fcce0f71e792 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:18.247864 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c5f5a50-a2a5-4028-8c48-fcce0f71e792 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:18.250516 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c5f5a50-a2a5-4028-8c48-fcce0f71e792 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:18.253817 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-e988dca0-e0ea-4048-a371-52a3ba73b358 req-fcad23e7-a0c6-4fae-be06-61c2d8a4d088 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:18.255577 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-e988dca0-e0ea-4048-a371-52a3ba73b358 req-fcad23e7-a0c6-4fae-be06-61c2d8a4d088 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:18.257137 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-e988dca0-e0ea-4048-a371-52a3ba73b358 req-fcad23e7-a0c6-4fae-be06-61c2d8a4d088 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:18.295442 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-e988dca0-e0ea-4048-a371-52a3ba73b358 req-fcad23e7-a0c6-4fae-be06-61c2d8a4d088 service nova] Creating event network-vif-deleted:7e73ce63-ac95-40f9-b1ad-563ef977f94e for instance c4a4c540-465f-4048-acde-837a8e37ccce on n-h1-862686-1 Oct 26 13:25:18.305988 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-e988dca0-e0ea-4048-a371-52a3ba73b358 req-fcad23e7-a0c6-4fae-be06-61c2d8a4d088 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080932 Oct 26 13:25:18.307487 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2449/4914] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:25:18.587569 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4c5f5a50-a2a5-4028-8c48-fcce0f71e792 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:18.606141 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4c5f5a50-a2a5-4028-8c48-fcce0f71e792 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:18.624142 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4c5f5a50-a2a5-4028-8c48-fcce0f71e792 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:18.627159 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4c5f5a50-a2a5-4028-8c48-fcce0f71e792 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] 10.222.0.40 "GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630" status: 200 len: 1408 microversion: 2.54 time: 0.446180 Oct 26 13:25:18.631312 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2466/4915] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:25:18 2022] GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630 => generated 1408 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:25:19.174475 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7bae645c-3593-4e58-970a-81a7f1b8b291 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:19.175204 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7bae645c-3593-4e58-970a-81a7f1b8b291 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] [instance: c4a4c540-465f-4048-acde-837a8e37ccce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:19.200468 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7bae645c-3593-4e58-970a-81a7f1b8b291 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:19.201626 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7bae645c-3593-4e58-970a-81a7f1b8b291 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:19.202406 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7bae645c-3593-4e58-970a-81a7f1b8b291 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:19.204386 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7bae645c-3593-4e58-970a-81a7f1b8b291 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:19.206877 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7bae645c-3593-4e58-970a-81a7f1b8b291 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:19.208755 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7bae645c-3593-4e58-970a-81a7f1b8b291 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:19.265069 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-7bae645c-3593-4e58-970a-81a7f1b8b291 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] HTTP exception thrown: Instance c4a4c540-465f-4048-acde-837a8e37ccce could not be found. Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7bae645c-3593-4e58-970a-81a7f1b8b291 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Request method failure captured: Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce HTTP/1.1 Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTSItT0NrfCYNIYnwIjeko4v7MX8S-_Dmylmd-FZefyXcfYrsWhYiI4u9SZYAjQlYzLWAOZoRwKzugdCGFB6dOnyt4WmYVXF9-yZ7uXb95CtSazgKJd9H7F9t6CuqNeDJPTg0USCEPaWZoN5s9_l-MkeFM_jpmSSthYB9-2LCgnWyZ0 Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: d450288d3d6249b385056f524c1e5bdc Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1560711776 Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d450288d3d6249b385056f524c1e5bdc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d450288d3d6249b385056f524c1e5bdc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d450288d3d6249b385056f524c1e5bdc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d450288d3d6249b385056f524c1e5bdc"}]}] Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1560711776 Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: d450288d3d6249b385056f524c1e5bdc Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1560711776 Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-AttachSCSIVolumeTestJSON-1560711776-project Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: d20f4b72866e4fce93253f71822830d2 Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1560711776-project Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance c4a4c540-465f-4048-acde-837a8e37ccce could not be found. Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'c4a4c540-465f-4048-acde-837a8e37ccce'} Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4a4c540-465f-4048-acde-837a8e37ccce could not be found. Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4a4c540-465f-4048-acde-837a8e37ccce could not be found. Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:25:19.270101 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:25:19.275899 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:25:19.275899 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:25:19.275899 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:25:19.275899 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:25:19.275899 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:25:19.275899 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4a4c540-465f-4048-acde-837a8e37ccce could not be found. Oct 26 13:25:19.275899 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:25:19.275899 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7bae645c-3593-4e58-970a-81a7f1b8b291 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Returning 404 to user: Instance c4a4c540-465f-4048-acde-837a8e37ccce could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:25:19.275899 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7bae645c-3593-4e58-970a-81a7f1b8b291 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] 10.222.0.40 "GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce" status: 404 len: 111 microversion: 2.1 time: 0.102848 Oct 26 13:25:19.278148 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2450/4916] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:25:19 2022] GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:25:19.286505 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cc43a5ea-d497-4bc0-8a43-d0827eee64cb tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Calling method '.version_select at 0x7f67318c24c0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:19.326223 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cc43a5ea-d497-4bc0-8a43-d0827eee64cb tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1431975419" status: 202 len: 0 microversion: 2.1 time: 0.043640 Oct 26 13:25:19.328356 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2467/4917] 10.222.0.40 () {58 vars in 1221 bytes} [Wed Oct 26 13:25:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1431975419 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:25:19.661625 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-baa8c14c-3a42-4aca-8e14-982e6d333d24 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:19.662504 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-baa8c14c-3a42-4aca-8e14-982e6d333d24 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] [instance: a61995dd-7fb4-4173-adb9-3d0489fa6630] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:19.672794 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-baa8c14c-3a42-4aca-8e14-982e6d333d24 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:19.677205 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-baa8c14c-3a42-4aca-8e14-982e6d333d24 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:19.678017 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-baa8c14c-3a42-4aca-8e14-982e6d333d24 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:19.678955 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-baa8c14c-3a42-4aca-8e14-982e6d333d24 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:19.680630 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-baa8c14c-3a42-4aca-8e14-982e6d333d24 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:19.681232 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-baa8c14c-3a42-4aca-8e14-982e6d333d24 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:19.773148 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-baa8c14c-3a42-4aca-8e14-982e6d333d24 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:19.786183 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-baa8c14c-3a42-4aca-8e14-982e6d333d24 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:19.789518 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-baa8c14c-3a42-4aca-8e14-982e6d333d24 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:19.794915 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-baa8c14c-3a42-4aca-8e14-982e6d333d24 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] 10.222.0.40 "GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630" status: 200 len: 1408 microversion: 2.54 time: 0.138619 Oct 26 13:25:19.824736 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2451/4918] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:25:19 2022] GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630 => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:25:20.834697 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f33bdb80-863c-4d7c-88bc-b7c0bf310b73 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:20.836086 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f33bdb80-863c-4d7c-88bc-b7c0bf310b73 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] [instance: a61995dd-7fb4-4173-adb9-3d0489fa6630] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:20.857969 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f33bdb80-863c-4d7c-88bc-b7c0bf310b73 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:20.860576 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f33bdb80-863c-4d7c-88bc-b7c0bf310b73 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:20.864467 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f33bdb80-863c-4d7c-88bc-b7c0bf310b73 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:20.867534 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f33bdb80-863c-4d7c-88bc-b7c0bf310b73 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:20.868609 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f33bdb80-863c-4d7c-88bc-b7c0bf310b73 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:20.869354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f33bdb80-863c-4d7c-88bc-b7c0bf310b73 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:21.383940 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f33bdb80-863c-4d7c-88bc-b7c0bf310b73 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:21.405352 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f33bdb80-863c-4d7c-88bc-b7c0bf310b73 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:21.407861 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f33bdb80-863c-4d7c-88bc-b7c0bf310b73 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:21.415166 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f33bdb80-863c-4d7c-88bc-b7c0bf310b73 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] 10.222.0.40 "GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630" status: 200 len: 1408 microversion: 2.54 time: 0.586041 Oct 26 13:25:21.417755 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2468/4919] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:25:20 2022] GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630 => generated 1408 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:25:22.451416 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-25f11ae4-e840-46ce-9609-2596c9425eeb tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:22.453015 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-25f11ae4-e840-46ce-9609-2596c9425eeb tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] [instance: a61995dd-7fb4-4173-adb9-3d0489fa6630] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:22.462259 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-25f11ae4-e840-46ce-9609-2596c9425eeb tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:22.462999 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-25f11ae4-e840-46ce-9609-2596c9425eeb tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:22.463636 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-25f11ae4-e840-46ce-9609-2596c9425eeb tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:22.464572 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-25f11ae4-e840-46ce-9609-2596c9425eeb tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:22.465319 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-25f11ae4-e840-46ce-9609-2596c9425eeb tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:22.465952 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-25f11ae4-e840-46ce-9609-2596c9425eeb tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:22.668232 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-25f11ae4-e840-46ce-9609-2596c9425eeb tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:22.685997 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-25f11ae4-e840-46ce-9609-2596c9425eeb tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:22.686948 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-25f11ae4-e840-46ce-9609-2596c9425eeb tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:22.698217 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-25f11ae4-e840-46ce-9609-2596c9425eeb tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] 10.222.0.40 "GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630" status: 200 len: 1408 microversion: 2.54 time: 0.252656 Oct 26 13:25:22.703571 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2452/4920] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:25:22 2022] GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630 => generated 1408 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:25:23.730927 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e49e3d24-523f-47fb-bd81-839aae4bf55a tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:23.732524 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e49e3d24-523f-47fb-bd81-839aae4bf55a tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] [instance: a61995dd-7fb4-4173-adb9-3d0489fa6630] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:23.746350 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e49e3d24-523f-47fb-bd81-839aae4bf55a tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:23.758039 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e49e3d24-523f-47fb-bd81-839aae4bf55a tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:23.762780 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e49e3d24-523f-47fb-bd81-839aae4bf55a tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:23.763752 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e49e3d24-523f-47fb-bd81-839aae4bf55a tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:23.765745 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e49e3d24-523f-47fb-bd81-839aae4bf55a tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:23.767123 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e49e3d24-523f-47fb-bd81-839aae4bf55a tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:24.045708 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e49e3d24-523f-47fb-bd81-839aae4bf55a tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:24.057847 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e49e3d24-523f-47fb-bd81-839aae4bf55a tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:24.063647 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e49e3d24-523f-47fb-bd81-839aae4bf55a tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:24.067210 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e49e3d24-523f-47fb-bd81-839aae4bf55a tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] 10.222.0.40 "GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630" status: 200 len: 1408 microversion: 2.54 time: 0.340154 Oct 26 13:25:24.070422 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2469/4921] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:25:23 2022] GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630 => generated 1408 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:25:25.103224 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ea414c10-13d3-4f43-a8e0-f2990d81c50b tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:25.104760 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ea414c10-13d3-4f43-a8e0-f2990d81c50b tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] [instance: a61995dd-7fb4-4173-adb9-3d0489fa6630] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:25.122837 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ea414c10-13d3-4f43-a8e0-f2990d81c50b tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:25.126078 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ea414c10-13d3-4f43-a8e0-f2990d81c50b tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:25.126808 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ea414c10-13d3-4f43-a8e0-f2990d81c50b tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:25.127778 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ea414c10-13d3-4f43-a8e0-f2990d81c50b tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:25.129899 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ea414c10-13d3-4f43-a8e0-f2990d81c50b tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:25.130523 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ea414c10-13d3-4f43-a8e0-f2990d81c50b tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:25.410608 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ea414c10-13d3-4f43-a8e0-f2990d81c50b tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:25.427205 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ea414c10-13d3-4f43-a8e0-f2990d81c50b tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:25.438677 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ea414c10-13d3-4f43-a8e0-f2990d81c50b tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:25.440230 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ea414c10-13d3-4f43-a8e0-f2990d81c50b tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] 10.222.0.40 "GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630" status: 200 len: 1408 microversion: 2.54 time: 0.342782 Oct 26 13:25:25.447223 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2453/4922] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:25:25 2022] GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630 => generated 1408 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:25:26.472859 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-71cea0a3-9440-4a32-964f-18a5c0d7b985 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:26.473991 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-71cea0a3-9440-4a32-964f-18a5c0d7b985 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] [instance: a61995dd-7fb4-4173-adb9-3d0489fa6630] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:26.486420 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-71cea0a3-9440-4a32-964f-18a5c0d7b985 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:26.486920 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-71cea0a3-9440-4a32-964f-18a5c0d7b985 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:26.487366 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-71cea0a3-9440-4a32-964f-18a5c0d7b985 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:26.488082 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-71cea0a3-9440-4a32-964f-18a5c0d7b985 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:26.489718 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-71cea0a3-9440-4a32-964f-18a5c0d7b985 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:26.493783 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-71cea0a3-9440-4a32-964f-18a5c0d7b985 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:26.542380 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:25:26.641338 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-71cea0a3-9440-4a32-964f-18a5c0d7b985 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:26.652395 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-71cea0a3-9440-4a32-964f-18a5c0d7b985 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:26.654117 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-71cea0a3-9440-4a32-964f-18a5c0d7b985 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:26.655200 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-71cea0a3-9440-4a32-964f-18a5c0d7b985 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] 10.222.0.40 "GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630" status: 200 len: 1408 microversion: 2.54 time: 0.189078 Oct 26 13:25:26.668949 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2470/4923] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:25:26 2022] GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630 => generated 1408 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:25:27.336451 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cc9bd36f-9640-4048-93bf-13e493633efb tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:27.337078 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cc9bd36f-9640-4048-93bf-13e493633efb tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:27.354409 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc9bd36f-9640-4048-93bf-13e493633efb tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:27.356557 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc9bd36f-9640-4048-93bf-13e493633efb tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:27.359028 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc9bd36f-9640-4048-93bf-13e493633efb tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:27.362895 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc9bd36f-9640-4048-93bf-13e493633efb tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:27.364550 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc9bd36f-9640-4048-93bf-13e493633efb tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:27.366878 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc9bd36f-9640-4048-93bf-13e493633efb tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:27.586095 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cc9bd36f-9640-4048-93bf-13e493633efb tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:27.597134 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cc9bd36f-9640-4048-93bf-13e493633efb tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 0.264408 Oct 26 13:25:27.601902 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2454/4924] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:25:27 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:25:27.619502 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-17b01c00-1225-4d9a-b57f-c2b067bd7803 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-309278379"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:25:27.623488 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-17b01c00-1225-4d9a-b57f-c2b067bd7803 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:27.633031 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17b01c00-1225-4d9a-b57f-c2b067bd7803 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:27.633823 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17b01c00-1225-4d9a-b57f-c2b067bd7803 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:27.634503 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17b01c00-1225-4d9a-b57f-c2b067bd7803 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:27.635434 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17b01c00-1225-4d9a-b57f-c2b067bd7803 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:27.636280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17b01c00-1225-4d9a-b57f-c2b067bd7803 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:27.637736 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17b01c00-1225-4d9a-b57f-c2b067bd7803 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:27.690540 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a287c59a-576d-4fe3-bdd7-e529939eeb53 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:27.691252 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a287c59a-576d-4fe3-bdd7-e529939eeb53 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] [instance: a61995dd-7fb4-4173-adb9-3d0489fa6630] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:27.708634 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a287c59a-576d-4fe3-bdd7-e529939eeb53 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:27.709155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a287c59a-576d-4fe3-bdd7-e529939eeb53 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:27.709630 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a287c59a-576d-4fe3-bdd7-e529939eeb53 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:27.712831 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a287c59a-576d-4fe3-bdd7-e529939eeb53 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:27.714698 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a287c59a-576d-4fe3-bdd7-e529939eeb53 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:27.715177 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a287c59a-576d-4fe3-bdd7-e529939eeb53 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:27.885334 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a287c59a-576d-4fe3-bdd7-e529939eeb53 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:27.914007 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a287c59a-576d-4fe3-bdd7-e529939eeb53 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:27.915693 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a287c59a-576d-4fe3-bdd7-e529939eeb53 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:27.916939 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a287c59a-576d-4fe3-bdd7-e529939eeb53 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] 10.222.0.40 "GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630" status: 200 len: 1408 microversion: 2.54 time: 0.233080 Oct 26 13:25:27.926576 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2455/4925] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:25:27 2022] GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630 => generated 1408 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:25:27.997068 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-17b01c00-1225-4d9a-b57f-c2b067bd7803 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "POST /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa/action" status: 202 len: 0 microversion: 2.1 time: 0.379784 Oct 26 13:25:28.002029 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2471/4926] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:25:27 2022] POST /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa/action => generated 0 bytes in 384 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 26 13:25:28.954110 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5bd7feaa-44cc-49eb-84b8-dd2a8e61a7b7 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:28.954716 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5bd7feaa-44cc-49eb-84b8-dd2a8e61a7b7 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] [instance: a61995dd-7fb4-4173-adb9-3d0489fa6630] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:28.969549 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bd7feaa-44cc-49eb-84b8-dd2a8e61a7b7 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:28.971153 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bd7feaa-44cc-49eb-84b8-dd2a8e61a7b7 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:28.971793 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bd7feaa-44cc-49eb-84b8-dd2a8e61a7b7 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:28.976646 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bd7feaa-44cc-49eb-84b8-dd2a8e61a7b7 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:28.977306 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bd7feaa-44cc-49eb-84b8-dd2a8e61a7b7 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:28.977957 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bd7feaa-44cc-49eb-84b8-dd2a8e61a7b7 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:29.134240 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5bd7feaa-44cc-49eb-84b8-dd2a8e61a7b7 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:29.146067 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5bd7feaa-44cc-49eb-84b8-dd2a8e61a7b7 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:29.149096 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5bd7feaa-44cc-49eb-84b8-dd2a8e61a7b7 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:29.154465 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5bd7feaa-44cc-49eb-84b8-dd2a8e61a7b7 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] 10.222.0.40 "GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630" status: 200 len: 1408 microversion: 2.54 time: 0.205184 Oct 26 13:25:29.158381 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2456/4927] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:25:28 2022] GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630 => generated 1408 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:25:29.976864 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-84c4e366-5810-4ae0-978e-bb00e4314486 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:29.977528 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-84c4e366-5810-4ae0-978e-bb00e4314486 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] [instance: c4a4c540-465f-4048-acde-837a8e37ccce] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:29.997428 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5bd7feaa-44cc-49eb-84b8-dd2a8e61a7b7 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:29.999527 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5bd7feaa-44cc-49eb-84b8-dd2a8e61a7b7 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] 10.222.0.40 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002354 Oct 26 13:25:30.000232 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2457/4928] 10.222.0.40 () {56 vars in 886 bytes} [Wed Oct 26 13:25:29 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 26 13:25:30.010388 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84c4e366-5810-4ae0-978e-bb00e4314486 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:30.011683 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84c4e366-5810-4ae0-978e-bb00e4314486 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:30.012384 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84c4e366-5810-4ae0-978e-bb00e4314486 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:30.013280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84c4e366-5810-4ae0-978e-bb00e4314486 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:30.014861 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84c4e366-5810-4ae0-978e-bb00e4314486 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:30.016271 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84c4e366-5810-4ae0-978e-bb00e4314486 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:30.039517 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-84c4e366-5810-4ae0-978e-bb00e4314486 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] HTTP exception thrown: Instance c4a4c540-465f-4048-acde-837a8e37ccce could not be found. Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-84c4e366-5810-4ae0-978e-bb00e4314486 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Request method failure captured: Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: request: DELETE /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce HTTP/1.1 Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTSItT0NrfCYNIYnwIjeko4v7MX8S-_Dmylmd-FZefyXcfYrsWhYiI4u9SZYAjQlYzLWAOZoRwKzugdCGFB6dOnyt4WmYVXF9-yZ7uXb95CtSazgKJd9H7F9t6CuqNeDJPTg0USCEPaWZoN5s9_l-MkeFM_jpmSSthYB9-2LCgnWyZ0 Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: d450288d3d6249b385056f524c1e5bdc Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1560711776 Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d450288d3d6249b385056f524c1e5bdc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d450288d3d6249b385056f524c1e5bdc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d450288d3d6249b385056f524c1e5bdc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d450288d3d6249b385056f524c1e5bdc"}]}] Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1560711776 Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: d450288d3d6249b385056f524c1e5bdc Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1560711776 Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-AttachSCSIVolumeTestJSON-1560711776-project Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: d20f4b72866e4fce93253f71822830d2 Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1560711776-project Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance c4a4c540-465f-4048-acde-837a8e37ccce could not be found. Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'c4a4c540-465f-4048-acde-837a8e37ccce'} Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4a4c540-465f-4048-acde-837a8e37ccce could not be found. Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:25:30.041655 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:25:30.046621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4a4c540-465f-4048-acde-837a8e37ccce could not be found. Oct 26 13:25:30.046621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:25:30.046621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:25:30.046621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:25:30.046621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:25:30.046621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:25:30.046621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:25:30.046621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:25:30.046621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:25:30.046621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4a4c540-465f-4048-acde-837a8e37ccce could not be found. Oct 26 13:25:30.046621 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:25:30.049263 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-84c4e366-5810-4ae0-978e-bb00e4314486 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Returning 404 to user: Instance c4a4c540-465f-4048-acde-837a8e37ccce could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:25:30.050432 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-84c4e366-5810-4ae0-978e-bb00e4314486 tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce" status: 404 len: 111 microversion: 2.1 time: 0.081953 Oct 26 13:25:30.051807 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2472/4929] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:25:29 2022] DELETE /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:25:30.063931 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-415d53f7-7eb1-4785-b2e7-df8c2ffaf48b tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:30.064555 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-415d53f7-7eb1-4785-b2e7-df8c2ffaf48b tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] [instance: c4a4c540-465f-4048-acde-837a8e37ccce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:30.074275 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-415d53f7-7eb1-4785-b2e7-df8c2ffaf48b tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:30.074769 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-415d53f7-7eb1-4785-b2e7-df8c2ffaf48b tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:30.075210 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-415d53f7-7eb1-4785-b2e7-df8c2ffaf48b tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:30.075920 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-415d53f7-7eb1-4785-b2e7-df8c2ffaf48b tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:30.076464 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-415d53f7-7eb1-4785-b2e7-df8c2ffaf48b tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:30.076899 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-415d53f7-7eb1-4785-b2e7-df8c2ffaf48b tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:30.116296 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-415d53f7-7eb1-4785-b2e7-df8c2ffaf48b tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] HTTP exception thrown: Instance c4a4c540-465f-4048-acde-837a8e37ccce could not be found. Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-415d53f7-7eb1-4785-b2e7-df8c2ffaf48b tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Request method failure captured: Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce HTTP/1.1 Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTSItT0NrfCYNIYnwIjeko4v7MX8S-_Dmylmd-FZefyXcfYrsWhYiI4u9SZYAjQlYzLWAOZoRwKzugdCGFB6dOnyt4WmYVXF9-yZ7uXb95CtSazgKJd9H7F9t6CuqNeDJPTg0USCEPaWZoN5s9_l-MkeFM_jpmSSthYB9-2LCgnWyZ0 Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: d450288d3d6249b385056f524c1e5bdc Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1560711776 Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d450288d3d6249b385056f524c1e5bdc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d450288d3d6249b385056f524c1e5bdc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d450288d3d6249b385056f524c1e5bdc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d450288d3d6249b385056f524c1e5bdc"}]}] Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1560711776 Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: d450288d3d6249b385056f524c1e5bdc Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1560711776 Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-AttachSCSIVolumeTestJSON-1560711776-project Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: d20f4b72866e4fce93253f71822830d2 Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1560711776-project Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance c4a4c540-465f-4048-acde-837a8e37ccce could not be found. Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'c4a4c540-465f-4048-acde-837a8e37ccce'} Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4a4c540-465f-4048-acde-837a8e37ccce could not be found. Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4a4c540-465f-4048-acde-837a8e37ccce could not be found. Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:25:30.118990 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:25:30.124025 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:25:30.124025 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:25:30.124025 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:25:30.124025 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:25:30.124025 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:25:30.124025 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4a4c540-465f-4048-acde-837a8e37ccce could not be found. Oct 26 13:25:30.124025 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:25:30.126739 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-415d53f7-7eb1-4785-b2e7-df8c2ffaf48b tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] Returning 404 to user: Instance c4a4c540-465f-4048-acde-837a8e37ccce could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:25:30.127813 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-415d53f7-7eb1-4785-b2e7-df8c2ffaf48b tempest-AttachSCSIVolumeTestJSON-1560711776 tempest-AttachSCSIVolumeTestJSON-1560711776-project] 10.222.0.40 "GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce" status: 404 len: 111 microversion: 2.1 time: 0.072279 Oct 26 13:25:30.128908 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2458/4930] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:25:30 2022] GET /compute/v2.1/servers/c4a4c540-465f-4048-acde-837a8e37ccce => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:25:30.187968 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-53d0cecb-8b92-4fca-88aa-5aa5487f8dc0 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:30.188973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-53d0cecb-8b92-4fca-88aa-5aa5487f8dc0 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] [instance: a61995dd-7fb4-4173-adb9-3d0489fa6630] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:30.199672 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-53d0cecb-8b92-4fca-88aa-5aa5487f8dc0 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:30.200824 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-53d0cecb-8b92-4fca-88aa-5aa5487f8dc0 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:30.201547 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-53d0cecb-8b92-4fca-88aa-5aa5487f8dc0 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:30.203891 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-53d0cecb-8b92-4fca-88aa-5aa5487f8dc0 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:30.204499 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-53d0cecb-8b92-4fca-88aa-5aa5487f8dc0 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:30.205009 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-53d0cecb-8b92-4fca-88aa-5aa5487f8dc0 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:30.363354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-53d0cecb-8b92-4fca-88aa-5aa5487f8dc0 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:30.381643 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-53d0cecb-8b92-4fca-88aa-5aa5487f8dc0 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:30.389524 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-53d0cecb-8b92-4fca-88aa-5aa5487f8dc0 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:30.396403 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-53d0cecb-8b92-4fca-88aa-5aa5487f8dc0 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] 10.222.0.40 "GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630" status: 200 len: 1414 microversion: 2.54 time: 0.212315 Oct 26 13:25:30.397617 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2473/4931] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:25:30 2022] GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630 => generated 1414 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:25:30.739283 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-3ea8f211-b710-445b-842b-105cf9c904f4 req-c0f7e668-d094-4688-8845-3db23bb78699 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "341d8b3a-d684-4969-a5cf-a6aea1a055fa", "name": "network-vif-unplugged", "status": "completed", "tag": "391606bb-b0ec-4759-b9bd-53c1cc5c2f7c"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:25:30.752560 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:25:30.775969 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-3ea8f211-b710-445b-842b-105cf9c904f4 req-c0f7e668-d094-4688-8845-3db23bb78699 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:30.776717 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-3ea8f211-b710-445b-842b-105cf9c904f4 req-c0f7e668-d094-4688-8845-3db23bb78699 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:30.783180 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-3ea8f211-b710-445b-842b-105cf9c904f4 req-c0f7e668-d094-4688-8845-3db23bb78699 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:30.831441 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-3ea8f211-b710-445b-842b-105cf9c904f4 req-c0f7e668-d094-4688-8845-3db23bb78699 service nova] Creating event network-vif-unplugged:391606bb-b0ec-4759-b9bd-53c1cc5c2f7c for instance 341d8b3a-d684-4969-a5cf-a6aea1a055fa on n-h1-862686-1 Oct 26 13:25:30.863003 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-3ea8f211-b710-445b-842b-105cf9c904f4 req-c0f7e668-d094-4688-8845-3db23bb78699 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128793 Oct 26 13:25:30.870362 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2459/4932] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:25:31.425663 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-68117dfa-5018-4ff5-a1ca-5915123b913e tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:31.426228 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-68117dfa-5018-4ff5-a1ca-5915123b913e tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] [instance: a61995dd-7fb4-4173-adb9-3d0489fa6630] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:31.440545 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68117dfa-5018-4ff5-a1ca-5915123b913e tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:31.441047 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68117dfa-5018-4ff5-a1ca-5915123b913e tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:31.441523 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68117dfa-5018-4ff5-a1ca-5915123b913e tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:31.442303 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68117dfa-5018-4ff5-a1ca-5915123b913e tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:31.442808 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68117dfa-5018-4ff5-a1ca-5915123b913e tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:31.443188 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68117dfa-5018-4ff5-a1ca-5915123b913e tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:31.610259 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-68117dfa-5018-4ff5-a1ca-5915123b913e tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:31.619553 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-68117dfa-5018-4ff5-a1ca-5915123b913e tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:31.621544 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-68117dfa-5018-4ff5-a1ca-5915123b913e tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:31.623832 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-68117dfa-5018-4ff5-a1ca-5915123b913e tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] 10.222.0.40 "GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630" status: 200 len: 1414 microversion: 2.54 time: 0.204177 Oct 26 13:25:31.627019 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2474/4933] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:25:31 2022] GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630 => generated 1414 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:25:32.658947 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c2e64cc7-89c7-4c9f-a8fc-5b8a976da627 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:32.660458 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c2e64cc7-89c7-4c9f-a8fc-5b8a976da627 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] [instance: a61995dd-7fb4-4173-adb9-3d0489fa6630] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:32.676086 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c2e64cc7-89c7-4c9f-a8fc-5b8a976da627 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:32.676967 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c2e64cc7-89c7-4c9f-a8fc-5b8a976da627 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:32.677667 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c2e64cc7-89c7-4c9f-a8fc-5b8a976da627 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:32.682694 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c2e64cc7-89c7-4c9f-a8fc-5b8a976da627 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:32.683507 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c2e64cc7-89c7-4c9f-a8fc-5b8a976da627 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:32.684408 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c2e64cc7-89c7-4c9f-a8fc-5b8a976da627 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:32.880090 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c2e64cc7-89c7-4c9f-a8fc-5b8a976da627 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:32.907568 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c2e64cc7-89c7-4c9f-a8fc-5b8a976da627 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:32.912086 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c2e64cc7-89c7-4c9f-a8fc-5b8a976da627 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:32.921881 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c2e64cc7-89c7-4c9f-a8fc-5b8a976da627 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] 10.222.0.40 "GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630" status: 200 len: 1399 microversion: 2.54 time: 0.263332 Oct 26 13:25:32.923868 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2460/4934] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:25:32 2022] GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630 => generated 1399 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:25:32.950491 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-43863efd-e291-473f-abb8-fc93b38b3b86 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Calling method '.version_select at 0x7f67325c5310>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:32.993793 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-43863efd-e291-473f-abb8-fc93b38b3b86 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1552547759" status: 204 len: 0 microversion: 2.54 time: 0.047482 Oct 26 13:25:32.995107 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2475/4935] 10.222.0.40 () {60 vars in 1319 bytes} [Wed Oct 26 13:25:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1552547759 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 13:25:33.008845 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b1b75ee2-499c-43e5-a13f-de1520d9795b tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:33.009675 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b1b75ee2-499c-43e5-a13f-de1520d9795b tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] [instance: a61995dd-7fb4-4173-adb9-3d0489fa6630] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:33.023957 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b1b75ee2-499c-43e5-a13f-de1520d9795b tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:33.024461 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b1b75ee2-499c-43e5-a13f-de1520d9795b tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:33.024908 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b1b75ee2-499c-43e5-a13f-de1520d9795b tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:33.025664 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b1b75ee2-499c-43e5-a13f-de1520d9795b tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:33.026247 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b1b75ee2-499c-43e5-a13f-de1520d9795b tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:33.026937 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b1b75ee2-499c-43e5-a13f-de1520d9795b tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:33.082882 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b1b75ee2-499c-43e5-a13f-de1520d9795b tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] [instance: a61995dd-7fb4-4173-adb9-3d0489fa6630] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:25:33.130832 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:25:33.225686 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b1b75ee2-499c-43e5-a13f-de1520d9795b tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630" status: 204 len: 0 microversion: 2.54 time: 0.223011 Oct 26 13:25:33.233261 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2461/4936] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 26 13:25:33 2022] DELETE /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 13:25:33.244320 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-46310d25-15f4-40b8-ab9e-4ab71bf8594d tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:33.245870 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-46310d25-15f4-40b8-ab9e-4ab71bf8594d tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] [instance: a61995dd-7fb4-4173-adb9-3d0489fa6630] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:33.257915 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46310d25-15f4-40b8-ab9e-4ab71bf8594d tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:33.260286 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46310d25-15f4-40b8-ab9e-4ab71bf8594d tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:33.261322 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46310d25-15f4-40b8-ab9e-4ab71bf8594d tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:33.267613 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46310d25-15f4-40b8-ab9e-4ab71bf8594d tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:33.268197 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46310d25-15f4-40b8-ab9e-4ab71bf8594d tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:33.268718 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46310d25-15f4-40b8-ab9e-4ab71bf8594d tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:33.441498 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-46310d25-15f4-40b8-ab9e-4ab71bf8594d tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:33.454642 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-46310d25-15f4-40b8-ab9e-4ab71bf8594d tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:33.459336 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-46310d25-15f4-40b8-ab9e-4ab71bf8594d tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:33.460757 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-46310d25-15f4-40b8-ab9e-4ab71bf8594d tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] 10.222.0.40 "GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630" status: 200 len: 1405 microversion: 2.54 time: 0.223286 Oct 26 13:25:33.461857 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2476/4937] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:25:33 2022] GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630 => generated 1405 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:25:34.491803 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e3251304-9eb3-4a6d-91f6-038836f871c4 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:34.493254 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e3251304-9eb3-4a6d-91f6-038836f871c4 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] [instance: a61995dd-7fb4-4173-adb9-3d0489fa6630] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:34.512117 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3251304-9eb3-4a6d-91f6-038836f871c4 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:34.516376 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3251304-9eb3-4a6d-91f6-038836f871c4 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:34.517170 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3251304-9eb3-4a6d-91f6-038836f871c4 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:34.519576 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3251304-9eb3-4a6d-91f6-038836f871c4 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:34.523157 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3251304-9eb3-4a6d-91f6-038836f871c4 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:34.523933 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3251304-9eb3-4a6d-91f6-038836f871c4 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:34.878915 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-ab8e103f-24be-4715-a3ee-61625c48f83e req-04adc896-1bc1-42e1-918a-2e9ebc268e9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "341d8b3a-d684-4969-a5cf-a6aea1a055fa", "name": "network-vif-plugged", "status": "completed", "tag": "391606bb-b0ec-4759-b9bd-53c1cc5c2f7c"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:25:34.908291 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ab8e103f-24be-4715-a3ee-61625c48f83e req-04adc896-1bc1-42e1-918a-2e9ebc268e9f service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:34.913101 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ab8e103f-24be-4715-a3ee-61625c48f83e req-04adc896-1bc1-42e1-918a-2e9ebc268e9f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:34.916614 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ab8e103f-24be-4715-a3ee-61625c48f83e req-04adc896-1bc1-42e1-918a-2e9ebc268e9f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:34.959635 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-ab8e103f-24be-4715-a3ee-61625c48f83e req-04adc896-1bc1-42e1-918a-2e9ebc268e9f service nova] Creating event network-vif-plugged:391606bb-b0ec-4759-b9bd-53c1cc5c2f7c for instance 341d8b3a-d684-4969-a5cf-a6aea1a055fa on n-h1-862686-1 Oct 26 13:25:34.985146 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-ab8e103f-24be-4715-a3ee-61625c48f83e req-04adc896-1bc1-42e1-918a-2e9ebc268e9f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110395 Oct 26 13:25:34.993822 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2477/4938] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:25:35.137503 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e3251304-9eb3-4a6d-91f6-038836f871c4 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:35.156277 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e3251304-9eb3-4a6d-91f6-038836f871c4 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:35.166511 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e3251304-9eb3-4a6d-91f6-038836f871c4 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:35.167848 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e3251304-9eb3-4a6d-91f6-038836f871c4 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] 10.222.0.40 "GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630" status: 200 len: 1405 microversion: 2.54 time: 0.681138 Oct 26 13:25:35.177573 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2462/4939] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:25:34 2022] GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630 => generated 1405 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:25:36.205232 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-670f7356-ddfe-4b95-9aa0-324f7f8832c2 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:36.206274 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-670f7356-ddfe-4b95-9aa0-324f7f8832c2 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] [instance: a61995dd-7fb4-4173-adb9-3d0489fa6630] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:36.228125 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-670f7356-ddfe-4b95-9aa0-324f7f8832c2 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:36.228714 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-670f7356-ddfe-4b95-9aa0-324f7f8832c2 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:36.229168 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-670f7356-ddfe-4b95-9aa0-324f7f8832c2 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:36.231955 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-670f7356-ddfe-4b95-9aa0-324f7f8832c2 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:36.234399 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-670f7356-ddfe-4b95-9aa0-324f7f8832c2 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:36.239225 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-670f7356-ddfe-4b95-9aa0-324f7f8832c2 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:36.395352 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-670f7356-ddfe-4b95-9aa0-324f7f8832c2 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:36.397206 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-670f7356-ddfe-4b95-9aa0-324f7f8832c2 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:36.399183 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-670f7356-ddfe-4b95-9aa0-324f7f8832c2 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:36.400958 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-670f7356-ddfe-4b95-9aa0-324f7f8832c2 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lazy-loading 'fault' on Instance uuid a61995dd-7fb4-4173-adb9-3d0489fa6630 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:25:36.553443 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-670f7356-ddfe-4b95-9aa0-324f7f8832c2 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:36.571892 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-670f7356-ddfe-4b95-9aa0-324f7f8832c2 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:36.578798 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-670f7356-ddfe-4b95-9aa0-324f7f8832c2 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d2713aeb2dd4854aa9f8a260d3cc5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523d65153a4348f986024168091accc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:36.590419 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-670f7356-ddfe-4b95-9aa0-324f7f8832c2 tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] 10.222.0.40 "GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630" status: 200 len: 1410 microversion: 2.54 time: 0.389655 Oct 26 13:25:36.619293 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2478/4940] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:25:36 2022] GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630 => generated 1410 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:25:37.531530 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3692e9cc-493c-4bce-9c80-7e1b30cece57 tempest-ComputeTenantNetworksTest-236351865 tempest-ComputeTenantNetworksTest-236351865-project] Calling method '.version_select at 0x7f6732879040>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:37.625665 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0be60596-98ee-493c-aeb2-691feda21bcd tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:37.626508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0be60596-98ee-493c-aeb2-691feda21bcd tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] [instance: a61995dd-7fb4-4173-adb9-3d0489fa6630] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:37.668026 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0be60596-98ee-493c-aeb2-691feda21bcd tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:37.671509 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0be60596-98ee-493c-aeb2-691feda21bcd tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:37.674741 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0be60596-98ee-493c-aeb2-691feda21bcd tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:37.685326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0be60596-98ee-493c-aeb2-691feda21bcd tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:37.686183 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0be60596-98ee-493c-aeb2-691feda21bcd tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:37.692513 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0be60596-98ee-493c-aeb2-691feda21bcd tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:37.775801 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-0be60596-98ee-493c-aeb2-691feda21bcd tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] HTTP exception thrown: Instance a61995dd-7fb4-4173-adb9-3d0489fa6630 could not be found. Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0be60596-98ee-493c-aeb2-691feda21bcd tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Request method failure captured: Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630 HTTP/1.1 Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTUnk6UeXjNDs4SCte_K_NRu3854uA5VTTTiXXvRpSLVahKMPt9TI8jlMbm5pDG7lFn2Hf8EsO42ptZbqkl3UTeoTYH49qxMJmHXHUn0f2usZ4Sv3pxrpZior4nfvdQVkJvyQvhpTvMvXrmP1kP9bN5v7Ru26bjmEASifFsKx3e2dJM Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: X-Openstack-Nova-Api-Version: 2.54 Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 523d65153a4348f986024168091accc8 Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServerShowV254Test-1452312627 Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/523d65153a4348f986024168091accc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/523d65153a4348f986024168091accc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_523d65153a4348f986024168091accc8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/523d65153a4348f986024168091accc8"}]}] Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServerShowV254Test-1452312627 Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 523d65153a4348f986024168091accc8 Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServerShowV254Test-1452312627 Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServerShowV254Test-1452312627-project Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 7d2713aeb2dd4854aa9f8a260d3cc5b5 Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServerShowV254Test-1452312627-project Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance a61995dd-7fb4-4173-adb9-3d0489fa6630 could not be found. Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'a61995dd-7fb4-4173-adb9-3d0489fa6630'} Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a61995dd-7fb4-4173-adb9-3d0489fa6630 could not be found. Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a61995dd-7fb4-4173-adb9-3d0489fa6630 could not be found. Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:25:37.783833 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:25:37.789014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:25:37.789014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:25:37.789014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:25:37.789014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:25:37.789014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:25:37.789014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a61995dd-7fb4-4173-adb9-3d0489fa6630 could not be found. Oct 26 13:25:37.789014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:25:37.793625 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0be60596-98ee-493c-aeb2-691feda21bcd tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] Returning 404 to user: Instance a61995dd-7fb4-4173-adb9-3d0489fa6630 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:25:37.795924 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0be60596-98ee-493c-aeb2-691feda21bcd tempest-ServerShowV254Test-1452312627 tempest-ServerShowV254Test-1452312627-project] 10.222.0.40 "GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630" status: 404 len: 111 microversion: 2.54 time: 0.177379 Oct 26 13:25:37.798208 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2479/4941] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:25:37 2022] GET /compute/v2.1/servers/a61995dd-7fb4-4173-adb9-3d0489fa6630 => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:25:38.537944 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3692e9cc-493c-4bce-9c80-7e1b30cece57 tempest-ComputeTenantNetworksTest-236351865 tempest-ComputeTenantNetworksTest-236351865-project] 10.222.0.40 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 1.704804 Oct 26 13:25:38.539429 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2463/4942] 10.222.0.40 () {58 vars in 1158 bytes} [Wed Oct 26 13:25:36 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 1708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:25:38.552786 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e4225255-498d-4c30-acfb-ec31aeabfc58 tempest-ComputeTenantNetworksTest-236351865 tempest-ComputeTenantNetworksTest-236351865-project] Calling method '.version_select at 0x7f67318e0550>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:39.009855 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e4225255-498d-4c30-acfb-ec31aeabfc58 tempest-ComputeTenantNetworksTest-236351865 tempest-ComputeTenantNetworksTest-236351865-project] 10.222.0.40 "GET /compute/v2.1/os-tenant-networks/14d57cb3-b0d8-4d69-bbcb-1b9c71ce609a" status: 200 len: 140 microversion: 2.1 time: 0.462955 Oct 26 13:25:39.011619 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2480/4943] 10.222.0.40 () {58 vars in 1269 bytes} [Wed Oct 26 13:25:38 2022] GET /compute/v2.1/os-tenant-networks/14d57cb3-b0d8-4d69-bbcb-1b9c71ce609a => generated 140 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:25:44.507909 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:25:45.144532 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=10,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:25:45.371335 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-31c2381d-4ef5-4dfc-aec5-8c958cff115d tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1829329356", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": "none"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:25:45.871054 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-31c2381d-4ef5-4dfc-aec5-8c958cff115d tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:25:45.879867 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-31c2381d-4ef5-4dfc-aec5-8c958cff115d tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:25:45.880438 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-31c2381d-4ef5-4dfc-aec5-8c958cff115d tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:25:45.882601 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-31c2381d-4ef5-4dfc-aec5-8c958cff115d tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:25:45.884768 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-31c2381d-4ef5-4dfc-aec5-8c958cff115d tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:25:45.906931 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31c2381d-4ef5-4dfc-aec5-8c958cff115d tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:45.907747 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31c2381d-4ef5-4dfc-aec5-8c958cff115d tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:45.908419 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31c2381d-4ef5-4dfc-aec5-8c958cff115d tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:45.910955 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31c2381d-4ef5-4dfc-aec5-8c958cff115d tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:45.911718 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31c2381d-4ef5-4dfc-aec5-8c958cff115d tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:45.912350 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31c2381d-4ef5-4dfc-aec5-8c958cff115d tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:45.938003 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-31c2381d-4ef5-4dfc-aec5-8c958cff115d tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Getting quotas for project 20b9f7e2a122431c9e9668b98d81f87f. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:25:45.946105 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-31c2381d-4ef5-4dfc-aec5-8c958cff115d tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Getting quotas for user 613197291d1f489eb079ff757b3d577c and project 20b9f7e2a122431c9e9668b98d81f87f. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:25:45.964876 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-31c2381d-4ef5-4dfc-aec5-8c958cff115d tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:25:45.968158 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-31c2381d-4ef5-4dfc-aec5-8c958cff115d tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] [instance: c2768cde-3bad-44b4-b68c-ed16dbe802b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:25:46.060499 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-31c2381d-4ef5-4dfc-aec5-8c958cff115d tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 1.597542 Oct 26 13:25:46.062842 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2464/4944] 10.222.0.40 () {62 vars in 1188 bytes} [Wed Oct 26 13:25:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1602 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 26 13:25:46.075187 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-15f55c7d-99b6-432a-b29e-8189e41f3f77 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:46.075817 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-15f55c7d-99b6-432a-b29e-8189e41f3f77 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] [instance: c2768cde-3bad-44b4-b68c-ed16dbe802b6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:46.090404 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:25:46.438066 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-15f55c7d-99b6-432a-b29e-8189e41f3f77 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:46.447755 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-15f55c7d-99b6-432a-b29e-8189e41f3f77 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:46.449223 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-15f55c7d-99b6-432a-b29e-8189e41f3f77 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:46.465406 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-15f55c7d-99b6-432a-b29e-8189e41f3f77 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] 10.222.0.40 "GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6" status: 200 len: 1278 microversion: 2.57 time: 0.395495 Oct 26 13:25:46.468737 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2481/4945] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:25:46 2022] GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6 => generated 1278 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:25:47.493552 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bf7156a7-c0ed-4e55-8dd3-6bdc3daebde8 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:47.494493 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bf7156a7-c0ed-4e55-8dd3-6bdc3daebde8 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] [instance: c2768cde-3bad-44b4-b68c-ed16dbe802b6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:47.872748 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bf7156a7-c0ed-4e55-8dd3-6bdc3daebde8 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:47.899772 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bf7156a7-c0ed-4e55-8dd3-6bdc3daebde8 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:47.907757 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bf7156a7-c0ed-4e55-8dd3-6bdc3daebde8 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:47.914207 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bf7156a7-c0ed-4e55-8dd3-6bdc3daebde8 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] 10.222.0.40 "GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6" status: 200 len: 1278 microversion: 2.57 time: 0.424786 Oct 26 13:25:47.922672 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2465/4946] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:25:47 2022] GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6 => generated 1278 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:25:48.950887 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-af5dedc9-b7fe-4567-9970-a43b52feed49 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:48.952178 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-af5dedc9-b7fe-4567-9970-a43b52feed49 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] [instance: c2768cde-3bad-44b4-b68c-ed16dbe802b6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:48.955667 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:25:48.971847 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af5dedc9-b7fe-4567-9970-a43b52feed49 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:48.977867 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af5dedc9-b7fe-4567-9970-a43b52feed49 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:48.979215 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af5dedc9-b7fe-4567-9970-a43b52feed49 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:48.981043 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af5dedc9-b7fe-4567-9970-a43b52feed49 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:48.983580 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af5dedc9-b7fe-4567-9970-a43b52feed49 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:48.984572 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af5dedc9-b7fe-4567-9970-a43b52feed49 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:49.211483 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5f19fab8-9b17-4a50-a12e-e8417544ad43 tempest-VolumesTestJSON-915457876 tempest-VolumesTestJSON-915457876-project] Calling method '.version_select at 0x7f67320d4040>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:49.278314 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5f19fab8-9b17-4a50-a12e-e8417544ad43 tempest-VolumesTestJSON-915457876 tempest-VolumesTestJSON-915457876-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/e3f92b6b-4e5a-432f-99aa-deecdde78448" status: 200 len: 351 microversion: 2.1 time: 0.071532 Oct 26 13:25:49.280261 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2466/4947] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Oct 26 13:25:49 2022] GET /compute/v2.1/os-volumes/e3f92b6b-4e5a-432f-99aa-deecdde78448 => generated 351 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:25:49.327976 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-af5dedc9-b7fe-4567-9970-a43b52feed49 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:49.344612 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-af5dedc9-b7fe-4567-9970-a43b52feed49 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:49.352256 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-af5dedc9-b7fe-4567-9970-a43b52feed49 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:49.356358 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-af5dedc9-b7fe-4567-9970-a43b52feed49 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] 10.222.0.40 "GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6" status: 200 len: 1274 microversion: 2.57 time: 0.408429 Oct 26 13:25:49.361305 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2482/4948] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:25:48 2022] GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6 => generated 1274 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:25:50.389109 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-60698813-b002-4081-bffb-2d725c722f19 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:50.391236 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-60698813-b002-4081-bffb-2d725c722f19 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] [instance: c2768cde-3bad-44b4-b68c-ed16dbe802b6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:50.409987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-60698813-b002-4081-bffb-2d725c722f19 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:50.410865 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-60698813-b002-4081-bffb-2d725c722f19 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:50.418179 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-60698813-b002-4081-bffb-2d725c722f19 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:50.419310 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-60698813-b002-4081-bffb-2d725c722f19 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:50.420032 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-60698813-b002-4081-bffb-2d725c722f19 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:50.420732 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-60698813-b002-4081-bffb-2d725c722f19 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:50.996813 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-60698813-b002-4081-bffb-2d725c722f19 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:51.015723 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-60698813-b002-4081-bffb-2d725c722f19 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:51.028311 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-60698813-b002-4081-bffb-2d725c722f19 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:51.034533 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-60698813-b002-4081-bffb-2d725c722f19 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] 10.222.0.40 "GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6" status: 200 len: 1336 microversion: 2.57 time: 0.647148 Oct 26 13:25:51.037845 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2467/4949] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:25:50 2022] GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6 => generated 1336 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:25:52.089873 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-489f8d44-bed2-4b4c-9b14-2c77964b032f tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:52.090592 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-489f8d44-bed2-4b4c-9b14-2c77964b032f tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] [instance: c2768cde-3bad-44b4-b68c-ed16dbe802b6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:52.113332 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-489f8d44-bed2-4b4c-9b14-2c77964b032f tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:52.114929 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-489f8d44-bed2-4b4c-9b14-2c77964b032f tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:52.115391 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-489f8d44-bed2-4b4c-9b14-2c77964b032f tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:52.121283 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-489f8d44-bed2-4b4c-9b14-2c77964b032f tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:52.122536 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-489f8d44-bed2-4b4c-9b14-2c77964b032f tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:52.123077 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-489f8d44-bed2-4b4c-9b14-2c77964b032f tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:53.420740 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-489f8d44-bed2-4b4c-9b14-2c77964b032f tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:53.455594 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-345a5175-f179-4898-b81b-920531616909 tempest-VolumesTestJSON-915457876 tempest-VolumesTestJSON-915457876-project] Calling method '.version_select at 0x7f67326e6940>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:53.475172 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-489f8d44-bed2-4b4c-9b14-2c77964b032f tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:53.484399 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-489f8d44-bed2-4b4c-9b14-2c77964b032f tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:53.486699 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-489f8d44-bed2-4b4c-9b14-2c77964b032f tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] 10.222.0.40 "GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6" status: 200 len: 1336 microversion: 2.57 time: 1.401524 Oct 26 13:25:53.490453 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2483/4950] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:25:52 2022] GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6 => generated 1336 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:25:53.599333 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-345a5175-f179-4898-b81b-920531616909 tempest-VolumesTestJSON-915457876 tempest-VolumesTestJSON-915457876-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/5cf3664a-fd99-411b-ac21-5f315313f6b0" status: 200 len: 350 microversion: 2.1 time: 0.148472 Oct 26 13:25:53.600334 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2468/4951] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Oct 26 13:25:53 2022] GET /compute/v2.1/os-volumes/5cf3664a-fd99-411b-ac21-5f315313f6b0 => generated 350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:25:54.578847 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-33403206-a267-42e3-a037-1cdc30b810d4 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:54.578847 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-33403206-a267-42e3-a037-1cdc30b810d4 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] [instance: c2768cde-3bad-44b4-b68c-ed16dbe802b6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:54.583216 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33403206-a267-42e3-a037-1cdc30b810d4 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:54.586669 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33403206-a267-42e3-a037-1cdc30b810d4 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:54.593405 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33403206-a267-42e3-a037-1cdc30b810d4 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:54.606741 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33403206-a267-42e3-a037-1cdc30b810d4 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:54.606741 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33403206-a267-42e3-a037-1cdc30b810d4 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:54.606741 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33403206-a267-42e3-a037-1cdc30b810d4 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:55.400166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-33403206-a267-42e3-a037-1cdc30b810d4 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:55.435881 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-33403206-a267-42e3-a037-1cdc30b810d4 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:55.444398 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-33403206-a267-42e3-a037-1cdc30b810d4 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:55.457806 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-33403206-a267-42e3-a037-1cdc30b810d4 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] 10.222.0.40 "GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6" status: 200 len: 1357 microversion: 2.57 time: 0.930356 Oct 26 13:25:55.459963 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2484/4952] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:25:54 2022] GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6 => generated 1357 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:25:55.491463 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c7b588a9-fe79-4dba-b999-53ee2387cf25 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:25:55.498910 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c7b588a9-fe79-4dba-b999-53ee2387cf25 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] [instance: c2768cde-3bad-44b4-b68c-ed16dbe802b6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:55.529354 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c7b588a9-fe79-4dba-b999-53ee2387cf25 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:55.529893 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c7b588a9-fe79-4dba-b999-53ee2387cf25 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:55.547830 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c7b588a9-fe79-4dba-b999-53ee2387cf25 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:55.548868 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c7b588a9-fe79-4dba-b999-53ee2387cf25 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:55.549130 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c7b588a9-fe79-4dba-b999-53ee2387cf25 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:55.549625 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c7b588a9-fe79-4dba-b999-53ee2387cf25 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:55.861602 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-c7b588a9-fe79-4dba-b999-53ee2387cf25 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:25:55.868803 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-c7b588a9-fe79-4dba-b999-53ee2387cf25 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:25:55.872705 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-c7b588a9-fe79-4dba-b999-53ee2387cf25 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:25:55.874919 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-c7b588a9-fe79-4dba-b999-53ee2387cf25 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:25:55.878305 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-c7b588a9-fe79-4dba-b999-53ee2387cf25 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:25:55.947633 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:25:56.166341 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c7b588a9-fe79-4dba-b999-53ee2387cf25 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] [instance: c2768cde-3bad-44b4-b68c-ed16dbe802b6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:56.211766 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c7b588a9-fe79-4dba-b999-53ee2387cf25 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:56.213256 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c7b588a9-fe79-4dba-b999-53ee2387cf25 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:56.226211 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c7b588a9-fe79-4dba-b999-53ee2387cf25 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:56.230469 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c7b588a9-fe79-4dba-b999-53ee2387cf25 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:56.233461 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c7b588a9-fe79-4dba-b999-53ee2387cf25 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:56.235281 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c7b588a9-fe79-4dba-b999-53ee2387cf25 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:56.362303 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c7b588a9-fe79-4dba-b999-53ee2387cf25 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] 10.222.0.40 "POST /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6/action" status: 202 len: 1138 microversion: 2.57 time: 0.873581 Oct 26 13:25:56.379588 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2469/4953] 10.222.0.40 () {62 vars in 1320 bytes} [Wed Oct 26 13:25:55 2022] POST /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6/action => generated 1138 bytes in 893 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 26 13:25:56.389224 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-381becdc-88b0-491c-8b02-bb1f2fd8e63f tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:56.390054 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-381becdc-88b0-491c-8b02-bb1f2fd8e63f tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] [instance: c2768cde-3bad-44b4-b68c-ed16dbe802b6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:56.406140 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-381becdc-88b0-491c-8b02-bb1f2fd8e63f tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:56.411512 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-381becdc-88b0-491c-8b02-bb1f2fd8e63f tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:56.412215 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-381becdc-88b0-491c-8b02-bb1f2fd8e63f tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:56.414930 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-381becdc-88b0-491c-8b02-bb1f2fd8e63f tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:56.424778 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-381becdc-88b0-491c-8b02-bb1f2fd8e63f tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:56.425896 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-381becdc-88b0-491c-8b02-bb1f2fd8e63f tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:56.454041 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:25:56.754643 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-381becdc-88b0-491c-8b02-bb1f2fd8e63f tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:56.770796 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-381becdc-88b0-491c-8b02-bb1f2fd8e63f tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:56.779006 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-381becdc-88b0-491c-8b02-bb1f2fd8e63f tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:56.780283 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-381becdc-88b0-491c-8b02-bb1f2fd8e63f tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] 10.222.0.40 "GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6" status: 200 len: 1366 microversion: 2.57 time: 0.395272 Oct 26 13:25:56.784771 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2485/4954] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:25:56 2022] GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6 => generated 1366 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:25:56.945515 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3b4c0d3e-6b01-4313-932b-883bbb2d97fa tempest-VolumesTestJSON-915457876 tempest-VolumesTestJSON-915457876-project] Calling method '.version_select at 0x7f67326e6ca0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:57.071888 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3b4c0d3e-6b01-4313-932b-883bbb2d97fa tempest-VolumesTestJSON-915457876 tempest-VolumesTestJSON-915457876-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/5136356f-d9e4-431b-aa1d-35fb1e902984" status: 200 len: 351 microversion: 2.1 time: 0.139985 Oct 26 13:25:57.073192 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2470/4955] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Oct 26 13:25:56 2022] GET /compute/v2.1/os-volumes/5136356f-d9e4-431b-aa1d-35fb1e902984 => generated 351 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:25:57.086526 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a3e9b323-db9a-4193-9846-c72e7315089a tempest-VolumesTestJSON-915457876 tempest-VolumesTestJSON-915457876-project] Calling method '.version_select at 0x7f6731811d30>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:57.306287 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a3e9b323-db9a-4193-9846-c72e7315089a tempest-VolumesTestJSON-915457876 tempest-VolumesTestJSON-915457876-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.223778 Oct 26 13:25:57.306877 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2486/4956] 10.222.0.40 () {58 vars in 1134 bytes} [Wed Oct 26 13:25:57 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:25:57.322394 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-606e7470-3f47-4e6f-aa57-2a4c35236ab7 tempest-VolumesTestJSON-915457876 tempest-VolumesTestJSON-915457876-project] Calling method '.version_select at 0x7f6732186040>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:57.518629 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-606e7470-3f47-4e6f-aa57-2a4c35236ab7 tempest-VolumesTestJSON-915457876 tempest-VolumesTestJSON-915457876-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.200745 Oct 26 13:25:57.519294 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2471/4957] 10.222.0.40 () {58 vars in 1149 bytes} [Wed Oct 26 13:25:57 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:25:57.535216 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9ad82d44-ff81-4dd3-9969-b782a7ddf16c tempest-VolumesTestJSON-915457876 tempest-VolumesTestJSON-915457876-project] Calling method '.version_select at 0x7f673184ea60>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:57.789204 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9ad82d44-ff81-4dd3-9969-b782a7ddf16c tempest-VolumesTestJSON-915457876 tempest-VolumesTestJSON-915457876-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.259651 Oct 26 13:25:57.791504 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2487/4958] 10.222.0.40 () {58 vars in 1134 bytes} [Wed Oct 26 13:25:57 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:25:57.806565 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5cade158-2267-4a80-a582-1adefe24ee67 tempest-VolumesTestJSON-915457876 tempest-VolumesTestJSON-915457876-project] Calling method '.version_select at 0x7f673215c8b0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:57.817763 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a6541070-620f-4aa0-9f34-f00437cb559f tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:57.818379 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a6541070-620f-4aa0-9f34-f00437cb559f tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] [instance: c2768cde-3bad-44b4-b68c-ed16dbe802b6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:57.841120 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a6541070-620f-4aa0-9f34-f00437cb559f tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:57.857045 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a6541070-620f-4aa0-9f34-f00437cb559f tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:57.858193 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a6541070-620f-4aa0-9f34-f00437cb559f tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:57.862410 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a6541070-620f-4aa0-9f34-f00437cb559f tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:57.866706 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a6541070-620f-4aa0-9f34-f00437cb559f tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:57.869459 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a6541070-620f-4aa0-9f34-f00437cb559f tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:57.895227 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=8 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:25:58.052959 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5cade158-2267-4a80-a582-1adefe24ee67 tempest-VolumesTestJSON-915457876 tempest-VolumesTestJSON-915457876-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.251393 Oct 26 13:25:58.063817 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2472/4959] 10.222.0.40 () {58 vars in 1167 bytes} [Wed Oct 26 13:25:57 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:25:58.068596 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f6807b44-d910-41b8-9374-bcfd0f9b9905 tempest-VolumesTestJSON-915457876 tempest-VolumesTestJSON-915457876-project] Calling method '.version_select at 0x7f67320be5e0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:58.080457 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a6541070-620f-4aa0-9f34-f00437cb559f tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:58.098214 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a6541070-620f-4aa0-9f34-f00437cb559f tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:58.100271 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a6541070-620f-4aa0-9f34-f00437cb559f tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:58.102118 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a6541070-620f-4aa0-9f34-f00437cb559f tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] 10.222.0.40 "GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6" status: 200 len: 1366 microversion: 2.57 time: 0.289268 Oct 26 13:25:58.103816 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2488/4960] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:25:57 2022] GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6 => generated 1366 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:25:58.286032 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f6807b44-d910-41b8-9374-bcfd0f9b9905 tempest-VolumesTestJSON-915457876 tempest-VolumesTestJSON-915457876-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.221010 Oct 26 13:25:58.286822 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2473/4961] 10.222.0.40 () {58 vars in 1170 bytes} [Wed Oct 26 13:25:58 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:25:58.303094 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-39d69532-4dd1-4584-90ce-3703867930ae tempest-VolumesTestJSON-915457876 tempest-VolumesTestJSON-915457876-project] Calling method '.version_select at 0x7f6731947ca0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:58.569989 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-39d69532-4dd1-4584-90ce-3703867930ae tempest-VolumesTestJSON-915457876 tempest-VolumesTestJSON-915457876-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.272591 Oct 26 13:25:58.580360 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2489/4962] 10.222.0.40 () {58 vars in 1155 bytes} [Wed Oct 26 13:25:58 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:25:58.586426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c7668fe7-7aac-4e45-8aba-510f30521bde tempest-VolumesTestJSON-915457876 tempest-VolumesTestJSON-915457876-project] Calling method '.version_select at 0x7f673229a8b0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:58.837113 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c7668fe7-7aac-4e45-8aba-510f30521bde tempest-VolumesTestJSON-915457876 tempest-VolumesTestJSON-915457876-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.255325 Oct 26 13:25:58.838215 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2474/4963] 10.222.0.40 () {58 vars in 1188 bytes} [Wed Oct 26 13:25:58 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:25:58.853699 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cc1cbe0e-0cd0-4e2a-9785-825dcc907672 tempest-VolumesTestJSON-915457876 tempest-VolumesTestJSON-915457876-project] Calling method '.version_select at 0x7f67318e0820>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:59.043021 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cc1cbe0e-0cd0-4e2a-9785-825dcc907672 tempest-VolumesTestJSON-915457876 tempest-VolumesTestJSON-915457876-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.194057 Oct 26 13:25:59.043612 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2490/4964] 10.222.0.40 () {58 vars in 1155 bytes} [Wed Oct 26 13:25:58 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:25:59.134677 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a187c639-9671-4df1-8f30-41ab57798e87 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:25:59.135857 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a187c639-9671-4df1-8f30-41ab57798e87 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] [instance: c2768cde-3bad-44b4-b68c-ed16dbe802b6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:25:59.151146 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a187c639-9671-4df1-8f30-41ab57798e87 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:59.161072 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a187c639-9671-4df1-8f30-41ab57798e87 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:59.162078 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a187c639-9671-4df1-8f30-41ab57798e87 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:59.166374 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a187c639-9671-4df1-8f30-41ab57798e87 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:25:59.167181 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a187c639-9671-4df1-8f30-41ab57798e87 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:25:59.168608 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a187c639-9671-4df1-8f30-41ab57798e87 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:25:59.391388 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a187c639-9671-4df1-8f30-41ab57798e87 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:59.405373 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a187c639-9671-4df1-8f30-41ab57798e87 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:59.414790 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a187c639-9671-4df1-8f30-41ab57798e87 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:25:59.417327 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a187c639-9671-4df1-8f30-41ab57798e87 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] 10.222.0.40 "GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6" status: 200 len: 1366 microversion: 2.57 time: 0.285831 Oct 26 13:25:59.417957 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2475/4965] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:25:59 2022] GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6 => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:26:00.450514 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a75913e0-0c56-4506-b8ff-47d787a6821c tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:00.451799 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a75913e0-0c56-4506-b8ff-47d787a6821c tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] [instance: c2768cde-3bad-44b4-b68c-ed16dbe802b6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:00.472318 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a75913e0-0c56-4506-b8ff-47d787a6821c tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:00.472858 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a75913e0-0c56-4506-b8ff-47d787a6821c tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:00.473312 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a75913e0-0c56-4506-b8ff-47d787a6821c tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:00.474637 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a75913e0-0c56-4506-b8ff-47d787a6821c tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:00.478715 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a75913e0-0c56-4506-b8ff-47d787a6821c tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:00.482065 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a75913e0-0c56-4506-b8ff-47d787a6821c tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:00.734910 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a75913e0-0c56-4506-b8ff-47d787a6821c tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:00.753884 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a75913e0-0c56-4506-b8ff-47d787a6821c tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:00.755614 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a75913e0-0c56-4506-b8ff-47d787a6821c tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:00.762126 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a75913e0-0c56-4506-b8ff-47d787a6821c tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] 10.222.0.40 "GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6" status: 200 len: 1366 microversion: 2.57 time: 0.317864 Oct 26 13:26:00.767718 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2491/4966] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:26:00 2022] GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6 => generated 1366 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:26:01.791185 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-56f672a4-fd2b-41a4-bffc-8e1385f3ba53 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:01.791808 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-56f672a4-fd2b-41a4-bffc-8e1385f3ba53 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] [instance: c2768cde-3bad-44b4-b68c-ed16dbe802b6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:01.804019 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-56f672a4-fd2b-41a4-bffc-8e1385f3ba53 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:01.804520 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-56f672a4-fd2b-41a4-bffc-8e1385f3ba53 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:01.804974 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-56f672a4-fd2b-41a4-bffc-8e1385f3ba53 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:01.817837 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-56f672a4-fd2b-41a4-bffc-8e1385f3ba53 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:01.819670 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-56f672a4-fd2b-41a4-bffc-8e1385f3ba53 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:01.824286 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-56f672a4-fd2b-41a4-bffc-8e1385f3ba53 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:02.101231 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-56f672a4-fd2b-41a4-bffc-8e1385f3ba53 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:02.117417 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-56f672a4-fd2b-41a4-bffc-8e1385f3ba53 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:02.130316 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-56f672a4-fd2b-41a4-bffc-8e1385f3ba53 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:02.132729 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-56f672a4-fd2b-41a4-bffc-8e1385f3ba53 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] 10.222.0.40 "GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6" status: 200 len: 1366 microversion: 2.57 time: 0.345336 Oct 26 13:26:02.133851 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2476/4967] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:26:01 2022] GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6 => generated 1366 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:26:03.168831 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0b9dc273-3155-43df-b877-cd8be125cafd tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:03.169617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0b9dc273-3155-43df-b877-cd8be125cafd tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] [instance: c2768cde-3bad-44b4-b68c-ed16dbe802b6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:03.183322 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0b9dc273-3155-43df-b877-cd8be125cafd tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:03.190250 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0b9dc273-3155-43df-b877-cd8be125cafd tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:03.192597 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0b9dc273-3155-43df-b877-cd8be125cafd tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:03.197212 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0b9dc273-3155-43df-b877-cd8be125cafd tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:03.197927 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0b9dc273-3155-43df-b877-cd8be125cafd tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:03.199816 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0b9dc273-3155-43df-b877-cd8be125cafd tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:03.491907 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0b9dc273-3155-43df-b877-cd8be125cafd tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:03.503211 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0b9dc273-3155-43df-b877-cd8be125cafd tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:03.504767 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0b9dc273-3155-43df-b877-cd8be125cafd tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:03.525686 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0b9dc273-3155-43df-b877-cd8be125cafd tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] 10.222.0.40 "GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6" status: 200 len: 1366 microversion: 2.57 time: 0.365041 Oct 26 13:26:03.541690 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2492/4968] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:26:03 2022] GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6 => generated 1366 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:26:04.557986 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-000696ed-c3f0-40e8-b4c5-deb08dabb300 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:04.558715 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-000696ed-c3f0-40e8-b4c5-deb08dabb300 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] [instance: c2768cde-3bad-44b4-b68c-ed16dbe802b6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:04.572971 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-000696ed-c3f0-40e8-b4c5-deb08dabb300 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:04.574244 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-000696ed-c3f0-40e8-b4c5-deb08dabb300 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:04.574693 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-000696ed-c3f0-40e8-b4c5-deb08dabb300 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:04.579381 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-000696ed-c3f0-40e8-b4c5-deb08dabb300 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:04.579880 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-000696ed-c3f0-40e8-b4c5-deb08dabb300 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:04.580325 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-000696ed-c3f0-40e8-b4c5-deb08dabb300 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:05.174368 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-000696ed-c3f0-40e8-b4c5-deb08dabb300 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:05.188231 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-000696ed-c3f0-40e8-b4c5-deb08dabb300 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:05.206852 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-000696ed-c3f0-40e8-b4c5-deb08dabb300 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:05.206852 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-000696ed-c3f0-40e8-b4c5-deb08dabb300 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] 10.222.0.40 "GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6" status: 200 len: 1366 microversion: 2.57 time: 0.649473 Oct 26 13:26:05.206852 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2477/4969] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:26:04 2022] GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6 => generated 1366 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:26:05.919893 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b5782e5d-6de1-4a50-a712-2747ae5cb2ec tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f6731f571f0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:06.072753 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b5782e5d-6de1-4a50-a712-2747ae5cb2ec tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/a7ad1577-cb1f-4551-81d0-bce141d7078e" status: 200 len: 661 microversion: 2.1 time: 0.156594 Oct 26 13:26:06.075190 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2493/4970] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:26:05 2022] GET /compute/v2.1/images/a7ad1577-cb1f-4551-81d0-bce141d7078e => generated 661 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:26:06.090109 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-894b2980-d2d3-4cf8-babf-0e6ba2a94e81 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f6732134280>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:06.177392 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-894b2980-d2d3-4cf8-babf-0e6ba2a94e81 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/a7ad1577-cb1f-4551-81d0-bce141d7078e" status: 200 len: 661 microversion: 2.1 time: 0.091256 Oct 26 13:26:06.178416 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2478/4971] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:26:06 2022] GET /compute/v2.1/images/a7ad1577-cb1f-4551-81d0-bce141d7078e => generated 661 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:26:06.238443 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-77be14f5-0adf-4568-b136-1ab603826f67 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:06.240125 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-77be14f5-0adf-4568-b136-1ab603826f67 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] [instance: c2768cde-3bad-44b4-b68c-ed16dbe802b6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:06.250179 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77be14f5-0adf-4568-b136-1ab603826f67 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:06.251102 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77be14f5-0adf-4568-b136-1ab603826f67 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:06.251758 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77be14f5-0adf-4568-b136-1ab603826f67 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:06.253671 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77be14f5-0adf-4568-b136-1ab603826f67 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:06.254343 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77be14f5-0adf-4568-b136-1ab603826f67 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:06.254977 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77be14f5-0adf-4568-b136-1ab603826f67 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:06.644586 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-77be14f5-0adf-4568-b136-1ab603826f67 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:06.659582 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-77be14f5-0adf-4568-b136-1ab603826f67 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:06.669315 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-77be14f5-0adf-4568-b136-1ab603826f67 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:06.672006 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-77be14f5-0adf-4568-b136-1ab603826f67 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] 10.222.0.40 "GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6" status: 200 len: 1366 microversion: 2.57 time: 0.444984 Oct 26 13:26:06.677718 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2494/4972] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:26:06 2022] GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6 => generated 1366 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:26:07.707582 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-19de5023-bd99-4507-93e1-f8789482ba31 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:07.708482 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-19de5023-bd99-4507-93e1-f8789482ba31 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] [instance: c2768cde-3bad-44b4-b68c-ed16dbe802b6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:07.724100 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-19de5023-bd99-4507-93e1-f8789482ba31 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:07.726261 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-19de5023-bd99-4507-93e1-f8789482ba31 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:07.727038 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-19de5023-bd99-4507-93e1-f8789482ba31 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:07.730713 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-19de5023-bd99-4507-93e1-f8789482ba31 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:07.731371 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-19de5023-bd99-4507-93e1-f8789482ba31 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:07.732339 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-19de5023-bd99-4507-93e1-f8789482ba31 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:07.901725 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-19de5023-bd99-4507-93e1-f8789482ba31 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:07.925540 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-19de5023-bd99-4507-93e1-f8789482ba31 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:07.927061 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-19de5023-bd99-4507-93e1-f8789482ba31 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:07.928280 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-19de5023-bd99-4507-93e1-f8789482ba31 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] 10.222.0.40 "GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6" status: 200 len: 1366 microversion: 2.57 time: 0.227016 Oct 26 13:26:07.928842 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2479/4973] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:26:07 2022] GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:26:08.312296 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4cc8c580-b7b8-47a1-b011-f77ec5d298c6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:08.313860 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4cc8c580-b7b8-47a1-b011-f77ec5d298c6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:08.327950 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cc8c580-b7b8-47a1-b011-f77ec5d298c6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:08.331777 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cc8c580-b7b8-47a1-b011-f77ec5d298c6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:08.333015 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cc8c580-b7b8-47a1-b011-f77ec5d298c6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:08.336100 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cc8c580-b7b8-47a1-b011-f77ec5d298c6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:08.338204 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cc8c580-b7b8-47a1-b011-f77ec5d298c6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:08.340008 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cc8c580-b7b8-47a1-b011-f77ec5d298c6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:08.662365 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bf934a37-213b-4799-afa7-143083f25e5d tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67369654c0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:08.781094 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4cc8c580-b7b8-47a1-b011-f77ec5d298c6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:08.786248 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bf934a37-213b-4799-afa7-143083f25e5d tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/06bf5ca3-9d54-442e-bad3-9dc61fdb1333" status: 200 len: 662 microversion: 2.1 time: 0.129735 Oct 26 13:26:08.789167 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4cc8c580-b7b8-47a1-b011-f77ec5d298c6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 0.484490 Oct 26 13:26:08.790357 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2480/4974] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:26:08 2022] GET /compute/v2.1/images/06bf5ca3-9d54-442e-bad3-9dc61fdb1333 => generated 662 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:26:08.805666 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2495/4975] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:26:08 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:26:08.807207 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0ad9421e-b984-4ee1-923c-5693077a04a8 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f673215cca0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:08.820099 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9b2ca401-bdd2-43f7-a2c4-b59867968b94 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1897906782"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:26:08.833170 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9b2ca401-bdd2-43f7-a2c4-b59867968b94 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:08.841349 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b2ca401-bdd2-43f7-a2c4-b59867968b94 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:08.841877 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b2ca401-bdd2-43f7-a2c4-b59867968b94 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:08.842318 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b2ca401-bdd2-43f7-a2c4-b59867968b94 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:08.849017 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b2ca401-bdd2-43f7-a2c4-b59867968b94 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:08.849518 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b2ca401-bdd2-43f7-a2c4-b59867968b94 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:08.850083 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b2ca401-bdd2-43f7-a2c4-b59867968b94 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:08.934821 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0ad9421e-b984-4ee1-923c-5693077a04a8 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/06bf5ca3-9d54-442e-bad3-9dc61fdb1333" status: 200 len: 662 microversion: 2.1 time: 0.133508 Oct 26 13:26:08.946038 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2481/4976] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:26:08 2022] GET /compute/v2.1/images/06bf5ca3-9d54-442e-bad3-9dc61fdb1333 => generated 662 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:26:08.960909 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9fcc37eb-3c42-4f97-a6ce-9c7254548cb0 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:08.961425 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9fcc37eb-3c42-4f97-a6ce-9c7254548cb0 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] [instance: c2768cde-3bad-44b4-b68c-ed16dbe802b6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:08.976389 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9fcc37eb-3c42-4f97-a6ce-9c7254548cb0 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:08.979365 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9fcc37eb-3c42-4f97-a6ce-9c7254548cb0 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:08.980062 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9fcc37eb-3c42-4f97-a6ce-9c7254548cb0 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:08.981050 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9fcc37eb-3c42-4f97-a6ce-9c7254548cb0 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:08.982208 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9fcc37eb-3c42-4f97-a6ce-9c7254548cb0 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:08.985562 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9fcc37eb-3c42-4f97-a6ce-9c7254548cb0 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:09.175223 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9fcc37eb-3c42-4f97-a6ce-9c7254548cb0 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:09.187556 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9fcc37eb-3c42-4f97-a6ce-9c7254548cb0 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:09.197296 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9fcc37eb-3c42-4f97-a6ce-9c7254548cb0 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:09.203753 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9fcc37eb-3c42-4f97-a6ce-9c7254548cb0 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] 10.222.0.40 "GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6" status: 200 len: 1366 microversion: 2.57 time: 0.246133 Oct 26 13:26:09.206025 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2482/4977] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:26:08 2022] GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6 => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:26:09.356455 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9b2ca401-bdd2-43f7-a2c4-b59867968b94 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "POST /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa/action" status: 202 len: 0 microversion: 2.1 time: 0.543188 Oct 26 13:26:09.362189 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2496/4978] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:26:08 2022] POST /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa/action => generated 0 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 26 13:26:09.370615 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-22283f1b-9838-4ebb-841e-c51293402b08 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:09.371541 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-22283f1b-9838-4ebb-841e-c51293402b08 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:09.399249 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22283f1b-9838-4ebb-841e-c51293402b08 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:09.400055 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22283f1b-9838-4ebb-841e-c51293402b08 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:09.400847 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22283f1b-9838-4ebb-841e-c51293402b08 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:09.402068 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22283f1b-9838-4ebb-841e-c51293402b08 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:09.402727 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22283f1b-9838-4ebb-841e-c51293402b08 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:09.403354 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22283f1b-9838-4ebb-841e-c51293402b08 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:09.700630 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-22283f1b-9838-4ebb-841e-c51293402b08 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:09.710788 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-22283f1b-9838-4ebb-841e-c51293402b08 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1676 microversion: 2.1 time: 0.345072 Oct 26 13:26:09.729688 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2483/4979] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:26:09 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1676 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:26:10.239108 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e24e5284-b724-4d44-87a7-da247da7eb16 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:10.240076 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e24e5284-b724-4d44-87a7-da247da7eb16 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] [instance: c2768cde-3bad-44b4-b68c-ed16dbe802b6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:10.286316 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e24e5284-b724-4d44-87a7-da247da7eb16 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:10.288158 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e24e5284-b724-4d44-87a7-da247da7eb16 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:10.292616 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e24e5284-b724-4d44-87a7-da247da7eb16 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:10.293619 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e24e5284-b724-4d44-87a7-da247da7eb16 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:10.294478 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e24e5284-b724-4d44-87a7-da247da7eb16 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:10.295080 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e24e5284-b724-4d44-87a7-da247da7eb16 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:10.413558 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e24e5284-b724-4d44-87a7-da247da7eb16 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:10.434735 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e24e5284-b724-4d44-87a7-da247da7eb16 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:10.438910 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e24e5284-b724-4d44-87a7-da247da7eb16 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:10.446205 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e24e5284-b724-4d44-87a7-da247da7eb16 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] 10.222.0.40 "GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6" status: 200 len: 1366 microversion: 2.57 time: 0.207366 Oct 26 13:26:10.453608 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2497/4980] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:26:10 2022] GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:26:10.740845 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-93bffb3d-6041-43a6-9566-f94c1321e3e6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:10.742176 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-93bffb3d-6041-43a6-9566-f94c1321e3e6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:10.754477 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-93bffb3d-6041-43a6-9566-f94c1321e3e6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:10.755022 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-93bffb3d-6041-43a6-9566-f94c1321e3e6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:10.755564 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-93bffb3d-6041-43a6-9566-f94c1321e3e6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:10.758894 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-93bffb3d-6041-43a6-9566-f94c1321e3e6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:10.759528 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-93bffb3d-6041-43a6-9566-f94c1321e3e6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:10.759979 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-93bffb3d-6041-43a6-9566-f94c1321e3e6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:11.271029 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-feefbf86-ff22-4781-b01d-c774d8105e88 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67367f4b80>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:11.331271 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-feefbf86-ff22-4781-b01d-c774d8105e88 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/0f12f3a1-9af4-4edb-b314-9007eb32ceb8" status: 200 len: 661 microversion: 2.1 time: 0.062878 Oct 26 13:26:11.333319 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2498/4981] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:26:11 2022] GET /compute/v2.1/images/0f12f3a1-9af4-4edb-b314-9007eb32ceb8 => generated 661 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:26:11.349700 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e095a10d-4e17-44c4-950c-56dabca510ce tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67317f1e50>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:11.419523 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-93bffb3d-6041-43a6-9566-f94c1321e3e6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:11.425609 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e095a10d-4e17-44c4-950c-56dabca510ce tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/0f12f3a1-9af4-4edb-b314-9007eb32ceb8" status: 200 len: 661 microversion: 2.1 time: 0.083374 Oct 26 13:26:11.427963 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2499/4982] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:26:11 2022] GET /compute/v2.1/images/0f12f3a1-9af4-4edb-b314-9007eb32ceb8 => generated 661 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:26:11.432907 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-93bffb3d-6041-43a6-9566-f94c1321e3e6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1676 microversion: 2.1 time: 0.695950 Oct 26 13:26:11.464072 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2484/4983] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:26:10 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1676 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:26:11.484699 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a3170eb4-658a-46d9-860d-63b9c8697b3f tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:11.485693 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a3170eb4-658a-46d9-860d-63b9c8697b3f tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] [instance: c2768cde-3bad-44b4-b68c-ed16dbe802b6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:11.496322 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a3170eb4-658a-46d9-860d-63b9c8697b3f tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:11.498309 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a3170eb4-658a-46d9-860d-63b9c8697b3f tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:11.500591 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a3170eb4-658a-46d9-860d-63b9c8697b3f tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:11.501657 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a3170eb4-658a-46d9-860d-63b9c8697b3f tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:11.503016 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a3170eb4-658a-46d9-860d-63b9c8697b3f tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:11.503610 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a3170eb4-658a-46d9-860d-63b9c8697b3f tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:11.692061 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d13a0311-289e-4078-a737-5e6fc796fc18 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-524699506", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:26:11.808925 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-d13a0311-289e-4078-a737-5e6fc796fc18 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] validate_networks() for None {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:26:11.872462 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a3170eb4-658a-46d9-860d-63b9c8697b3f tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:11.917502 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a3170eb4-658a-46d9-860d-63b9c8697b3f tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:11.919516 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a3170eb4-658a-46d9-860d-63b9c8697b3f tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:11.925514 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a3170eb4-658a-46d9-860d-63b9c8697b3f tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] 10.222.0.40 "GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6" status: 200 len: 1366 microversion: 2.57 time: 0.446053 Oct 26 13:26:11.929613 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2500/4984] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:26:11 2022] GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6 => generated 1366 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:26:12.391922 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-d13a0311-289e-4078-a737-5e6fc796fc18 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:26:12.397881 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-d13a0311-289e-4078-a737-5e6fc796fc18 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:26:12.398413 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-d13a0311-289e-4078-a737-5e6fc796fc18 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:26:12.398809 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-d13a0311-289e-4078-a737-5e6fc796fc18 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:26:12.399225 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-d13a0311-289e-4078-a737-5e6fc796fc18 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:26:12.431997 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d13a0311-289e-4078-a737-5e6fc796fc18 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:12.432711 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d13a0311-289e-4078-a737-5e6fc796fc18 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:12.433324 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d13a0311-289e-4078-a737-5e6fc796fc18 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:12.434087 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d13a0311-289e-4078-a737-5e6fc796fc18 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:12.434548 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d13a0311-289e-4078-a737-5e6fc796fc18 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:12.434979 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d13a0311-289e-4078-a737-5e6fc796fc18 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:12.462824 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-87968d7d-95d3-4b49-b51c-4780c0519ac8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:12.463991 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-87968d7d-95d3-4b49-b51c-4780c0519ac8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:12.472690 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87968d7d-95d3-4b49-b51c-4780c0519ac8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:12.478874 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87968d7d-95d3-4b49-b51c-4780c0519ac8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:12.479316 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87968d7d-95d3-4b49-b51c-4780c0519ac8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:12.480064 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87968d7d-95d3-4b49-b51c-4780c0519ac8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:12.480530 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87968d7d-95d3-4b49-b51c-4780c0519ac8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:12.480963 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87968d7d-95d3-4b49-b51c-4780c0519ac8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:12.498392 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-d13a0311-289e-4078-a737-5e6fc796fc18 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Getting quotas for project db66f4a941524e30b05360a3ccb2e449. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:26:12.540478 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-d13a0311-289e-4078-a737-5e6fc796fc18 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Getting quotas for user 674435111c05455fb1eb5b213d1373c4 and project db66f4a941524e30b05360a3ccb2e449. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:26:12.578250 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d13a0311-289e-4078-a737-5e6fc796fc18 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:26:12.581288 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d13a0311-289e-4078-a737-5e6fc796fc18 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] [instance: 56c29b20-837e-4f90-9213-99699295a6af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:26:12.652394 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d13a0311-289e-4078-a737-5e6fc796fc18 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.966687 Oct 26 13:26:12.654567 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2485/4985] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:26:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 970 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 26 13:26:12.914485 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-26058d11-6afc-48bb-9829-5d6a328499b4 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1183681281", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:26:13.031750 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-26058d11-6afc-48bb-9829-5d6a328499b4 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] validate_networks() for None {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:26:13.306901 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-87968d7d-95d3-4b49-b51c-4780c0519ac8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:13.342091 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-87968d7d-95d3-4b49-b51c-4780c0519ac8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1684 microversion: 2.1 time: 0.880754 Oct 26 13:26:13.347320 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2501/4986] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:26:12 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1684 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:26:13.368136 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6861290a-7cdb-4ea4-aad1-38dd4ccc21c6 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:13.371941 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6861290a-7cdb-4ea4-aad1-38dd4ccc21c6 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] [instance: c2768cde-3bad-44b4-b68c-ed16dbe802b6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:13.452978 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6861290a-7cdb-4ea4-aad1-38dd4ccc21c6 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:13.453642 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6861290a-7cdb-4ea4-aad1-38dd4ccc21c6 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:13.454096 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6861290a-7cdb-4ea4-aad1-38dd4ccc21c6 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:13.461122 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6861290a-7cdb-4ea4-aad1-38dd4ccc21c6 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:13.464407 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6861290a-7cdb-4ea4-aad1-38dd4ccc21c6 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:13.464988 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6861290a-7cdb-4ea4-aad1-38dd4ccc21c6 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:13.862159 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6861290a-7cdb-4ea4-aad1-38dd4ccc21c6 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:13.883977 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6861290a-7cdb-4ea4-aad1-38dd4ccc21c6 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:13.897072 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6861290a-7cdb-4ea4-aad1-38dd4ccc21c6 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:13.898360 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6861290a-7cdb-4ea4-aad1-38dd4ccc21c6 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] 10.222.0.40 "GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6" status: 200 len: 1366 microversion: 2.57 time: 0.549435 Oct 26 13:26:13.933991 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2502/4987] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:26:13 2022] GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6 => generated 1366 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:26:14.371656 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-64e3a014-c203-40a7-9e17-a4e111bfa49f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:14.372405 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-64e3a014-c203-40a7-9e17-a4e111bfa49f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:14.389260 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64e3a014-c203-40a7-9e17-a4e111bfa49f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:14.395592 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64e3a014-c203-40a7-9e17-a4e111bfa49f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:14.396828 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64e3a014-c203-40a7-9e17-a4e111bfa49f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:14.398696 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64e3a014-c203-40a7-9e17-a4e111bfa49f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:14.399519 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64e3a014-c203-40a7-9e17-a4e111bfa49f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:14.401060 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64e3a014-c203-40a7-9e17-a4e111bfa49f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:14.488864 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-26058d11-6afc-48bb-9829-5d6a328499b4 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:26:14.489292 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-26058d11-6afc-48bb-9829-5d6a328499b4 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:26:14.489826 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-26058d11-6afc-48bb-9829-5d6a328499b4 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:26:14.490256 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-26058d11-6afc-48bb-9829-5d6a328499b4 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:26:14.490808 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-26058d11-6afc-48bb-9829-5d6a328499b4 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:26:14.511246 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26058d11-6afc-48bb-9829-5d6a328499b4 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:14.512016 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26058d11-6afc-48bb-9829-5d6a328499b4 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:14.512528 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26058d11-6afc-48bb-9829-5d6a328499b4 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:14.513336 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26058d11-6afc-48bb-9829-5d6a328499b4 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:14.514133 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26058d11-6afc-48bb-9829-5d6a328499b4 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:14.515344 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26058d11-6afc-48bb-9829-5d6a328499b4 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:14.567085 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:26:14.579678 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-26058d11-6afc-48bb-9829-5d6a328499b4 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Getting quotas for project db66f4a941524e30b05360a3ccb2e449. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:26:14.594437 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-26058d11-6afc-48bb-9829-5d6a328499b4 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Getting quotas for user 674435111c05455fb1eb5b213d1373c4 and project db66f4a941524e30b05360a3ccb2e449. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:26:14.626664 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-26058d11-6afc-48bb-9829-5d6a328499b4 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:26:14.636014 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-26058d11-6afc-48bb-9829-5d6a328499b4 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] [instance: 8536123b-d626-498f-bfc7-9b76553e3d04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:26:14.745272 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-26058d11-6afc-48bb-9829-5d6a328499b4 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.836786 Oct 26 13:26:14.752457 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2486/4988] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:26:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:26:14.784790 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-00fd087c-935f-4466-9fe9-db254c3a2da6 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:14.785852 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-00fd087c-935f-4466-9fe9-db254c3a2da6 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] [instance: 8536123b-d626-498f-bfc7-9b76553e3d04] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:15.016284 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-00fd087c-935f-4466-9fe9-db254c3a2da6 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674435111c05455fb1eb5b213d1373c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66f4a941524e30b05360a3ccb2e449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:15.028537 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-00fd087c-935f-4466-9fe9-db254c3a2da6 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04" status: 200 len: 1218 microversion: 2.1 time: 0.267935 Oct 26 13:26:15.034591 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2487/4989] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:26:14 2022] GET /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04 => generated 1218 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:26:15.042893 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-19052279-df5d-48c5-80c4-d21dabbccd02 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:15.048348 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-19052279-df5d-48c5-80c4-d21dabbccd02 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] [instance: c2768cde-3bad-44b4-b68c-ed16dbe802b6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:15.060908 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-19052279-df5d-48c5-80c4-d21dabbccd02 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:15.066441 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-19052279-df5d-48c5-80c4-d21dabbccd02 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:15.067139 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-19052279-df5d-48c5-80c4-d21dabbccd02 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:15.068250 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-19052279-df5d-48c5-80c4-d21dabbccd02 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:15.068937 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-19052279-df5d-48c5-80c4-d21dabbccd02 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:15.069784 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-19052279-df5d-48c5-80c4-d21dabbccd02 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:15.658167 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-64e3a014-c203-40a7-9e17-a4e111bfa49f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:15.674661 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-64e3a014-c203-40a7-9e17-a4e111bfa49f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1679 microversion: 2.1 time: 1.306966 Oct 26 13:26:15.680206 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2503/4990] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:26:14 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1679 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:26:15.894190 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-19052279-df5d-48c5-80c4-d21dabbccd02 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:15.896517 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:26:15.917876 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-19052279-df5d-48c5-80c4-d21dabbccd02 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:15.922001 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-19052279-df5d-48c5-80c4-d21dabbccd02 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:15.924717 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-19052279-df5d-48c5-80c4-d21dabbccd02 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] 10.222.0.40 "GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6" status: 200 len: 1366 microversion: 2.57 time: 0.888022 Oct 26 13:26:15.926678 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2488/4991] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:26:15 2022] GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6 => generated 1366 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:26:16.076690 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c6e8dbd6-0022-47ea-90ec-45e896446f5e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:16.078265 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c6e8dbd6-0022-47ea-90ec-45e896446f5e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] [instance: 8536123b-d626-498f-bfc7-9b76553e3d04] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:16.103008 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c6e8dbd6-0022-47ea-90ec-45e896446f5e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:16.104702 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c6e8dbd6-0022-47ea-90ec-45e896446f5e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:16.105398 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c6e8dbd6-0022-47ea-90ec-45e896446f5e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:16.106402 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c6e8dbd6-0022-47ea-90ec-45e896446f5e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:16.107082 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c6e8dbd6-0022-47ea-90ec-45e896446f5e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:16.107875 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c6e8dbd6-0022-47ea-90ec-45e896446f5e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:16.133113 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:26:16.507085 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c6e8dbd6-0022-47ea-90ec-45e896446f5e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674435111c05455fb1eb5b213d1373c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66f4a941524e30b05360a3ccb2e449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:16.528910 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c6e8dbd6-0022-47ea-90ec-45e896446f5e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04" status: 200 len: 1222 microversion: 2.1 time: 0.467184 Oct 26 13:26:16.540217 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2504/4992] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:26:16 2022] GET /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04 => generated 1222 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:26:16.704511 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-598c4f96-1021-4314-b594-51e012e2fdf3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:16.705200 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-598c4f96-1021-4314-b594-51e012e2fdf3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:16.728927 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-598c4f96-1021-4314-b594-51e012e2fdf3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:16.732176 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-598c4f96-1021-4314-b594-51e012e2fdf3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:16.735005 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-598c4f96-1021-4314-b594-51e012e2fdf3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:16.738594 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-598c4f96-1021-4314-b594-51e012e2fdf3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:16.743216 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-598c4f96-1021-4314-b594-51e012e2fdf3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:16.746002 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-598c4f96-1021-4314-b594-51e012e2fdf3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:16.955462 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-84f22916-9304-4814-89a8-479206c6848d tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:16.956075 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-84f22916-9304-4814-89a8-479206c6848d tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] [instance: c2768cde-3bad-44b4-b68c-ed16dbe802b6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:16.958279 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=36 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:26:16.994067 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84f22916-9304-4814-89a8-479206c6848d tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:16.994716 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84f22916-9304-4814-89a8-479206c6848d tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:17.005526 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84f22916-9304-4814-89a8-479206c6848d tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:17.006744 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84f22916-9304-4814-89a8-479206c6848d tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:17.011959 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84f22916-9304-4814-89a8-479206c6848d tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:17.018108 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84f22916-9304-4814-89a8-479206c6848d tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:17.351698 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-84f22916-9304-4814-89a8-479206c6848d tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:17.368756 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-84f22916-9304-4814-89a8-479206c6848d tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:17.370304 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-84f22916-9304-4814-89a8-479206c6848d tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:17.371527 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-84f22916-9304-4814-89a8-479206c6848d tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] 10.222.0.40 "GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6" status: 200 len: 1366 microversion: 2.57 time: 0.421109 Oct 26 13:26:17.372100 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2505/4993] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:26:16 2022] GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6 => generated 1366 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:26:17.388363 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-b1ce14b7-5c07-4cf5-bc17-1ad8cd9d7043 req-3336129c-2923-44cf-9632-4970f5dda921 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "341d8b3a-d684-4969-a5cf-a6aea1a055fa", "name": "network-vif-plugged", "status": "completed", "tag": "391606bb-b0ec-4759-b9bd-53c1cc5c2f7c"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:26:17.414867 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b1ce14b7-5c07-4cf5-bc17-1ad8cd9d7043 req-3336129c-2923-44cf-9632-4970f5dda921 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:17.426187 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b1ce14b7-5c07-4cf5-bc17-1ad8cd9d7043 req-3336129c-2923-44cf-9632-4970f5dda921 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:17.426668 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b1ce14b7-5c07-4cf5-bc17-1ad8cd9d7043 req-3336129c-2923-44cf-9632-4970f5dda921 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:17.469380 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-b1ce14b7-5c07-4cf5-bc17-1ad8cd9d7043 req-3336129c-2923-44cf-9632-4970f5dda921 service nova] Creating event network-vif-plugged:391606bb-b0ec-4759-b9bd-53c1cc5c2f7c for instance 341d8b3a-d684-4969-a5cf-a6aea1a055fa on n-h1-862686-1 Oct 26 13:26:17.505597 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-b1ce14b7-5c07-4cf5-bc17-1ad8cd9d7043 req-3336129c-2923-44cf-9632-4970f5dda921 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127703 Oct 26 13:26:17.506254 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2506/4994] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:26:17.568584 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b4ea699d-cf10-4bd8-82e2-de32839a3cb1 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:17.569376 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b4ea699d-cf10-4bd8-82e2-de32839a3cb1 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] [instance: 8536123b-d626-498f-bfc7-9b76553e3d04] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:17.590976 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b4ea699d-cf10-4bd8-82e2-de32839a3cb1 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:17.591565 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b4ea699d-cf10-4bd8-82e2-de32839a3cb1 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:17.595928 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b4ea699d-cf10-4bd8-82e2-de32839a3cb1 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:17.596695 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b4ea699d-cf10-4bd8-82e2-de32839a3cb1 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:17.597178 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b4ea699d-cf10-4bd8-82e2-de32839a3cb1 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:17.597828 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b4ea699d-cf10-4bd8-82e2-de32839a3cb1 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:17.632200 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-598c4f96-1021-4314-b594-51e012e2fdf3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:17.642089 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-598c4f96-1021-4314-b594-51e012e2fdf3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1679 microversion: 2.1 time: 0.942347 Oct 26 13:26:17.663497 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2489/4995] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:26:16 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1679 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:26:18.102983 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b4ea699d-cf10-4bd8-82e2-de32839a3cb1 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674435111c05455fb1eb5b213d1373c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66f4a941524e30b05360a3ccb2e449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:18.115890 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b4ea699d-cf10-4bd8-82e2-de32839a3cb1 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04" status: 200 len: 1278 microversion: 2.1 time: 0.552274 Oct 26 13:26:18.119476 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2507/4996] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:26:17 2022] GET /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04 => generated 1278 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:26:18.402481 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-07e23c2b-7eea-41d2-a8ba-6702fa2b2c1d tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:18.403337 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-07e23c2b-7eea-41d2-a8ba-6702fa2b2c1d tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] [instance: c2768cde-3bad-44b4-b68c-ed16dbe802b6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:18.412581 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-07e23c2b-7eea-41d2-a8ba-6702fa2b2c1d tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:18.422363 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-07e23c2b-7eea-41d2-a8ba-6702fa2b2c1d tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:18.429976 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-07e23c2b-7eea-41d2-a8ba-6702fa2b2c1d tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:18.432960 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-07e23c2b-7eea-41d2-a8ba-6702fa2b2c1d tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:18.433604 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-07e23c2b-7eea-41d2-a8ba-6702fa2b2c1d tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:18.434415 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-07e23c2b-7eea-41d2-a8ba-6702fa2b2c1d tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:18.670866 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-90c0bd44-3092-4775-99e3-662e0b997e4e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:18.671912 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-90c0bd44-3092-4775-99e3-662e0b997e4e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:18.693003 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90c0bd44-3092-4775-99e3-662e0b997e4e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:18.693895 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90c0bd44-3092-4775-99e3-662e0b997e4e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:18.694773 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90c0bd44-3092-4775-99e3-662e0b997e4e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:18.695767 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90c0bd44-3092-4775-99e3-662e0b997e4e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:18.697223 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90c0bd44-3092-4775-99e3-662e0b997e4e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:18.697802 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90c0bd44-3092-4775-99e3-662e0b997e4e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:18.705338 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-07e23c2b-7eea-41d2-a8ba-6702fa2b2c1d tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:18.756488 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-07e23c2b-7eea-41d2-a8ba-6702fa2b2c1d tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:18.762092 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-07e23c2b-7eea-41d2-a8ba-6702fa2b2c1d tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:18.768422 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-07e23c2b-7eea-41d2-a8ba-6702fa2b2c1d tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] 10.222.0.40 "GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6" status: 200 len: 1366 microversion: 2.57 time: 0.367799 Oct 26 13:26:18.788981 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2490/4997] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:26:18 2022] GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6 => generated 1366 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:26:19.142419 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-af02f1c4-c6d8-4bfe-83d6-9647f0134d02 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:19.143549 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-af02f1c4-c6d8-4bfe-83d6-9647f0134d02 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] [instance: 8536123b-d626-498f-bfc7-9b76553e3d04] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:19.157900 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af02f1c4-c6d8-4bfe-83d6-9647f0134d02 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:19.158641 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af02f1c4-c6d8-4bfe-83d6-9647f0134d02 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:19.159272 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af02f1c4-c6d8-4bfe-83d6-9647f0134d02 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:19.160275 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af02f1c4-c6d8-4bfe-83d6-9647f0134d02 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:19.160954 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af02f1c4-c6d8-4bfe-83d6-9647f0134d02 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:19.161617 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af02f1c4-c6d8-4bfe-83d6-9647f0134d02 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:19.288181 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-af02f1c4-c6d8-4bfe-83d6-9647f0134d02 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674435111c05455fb1eb5b213d1373c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66f4a941524e30b05360a3ccb2e449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:19.308882 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-af02f1c4-c6d8-4bfe-83d6-9647f0134d02 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04" status: 200 len: 1276 microversion: 2.1 time: 0.172368 Oct 26 13:26:19.315164 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2491/4998] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:26:19 2022] GET /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04 => generated 1276 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:26:19.361926 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-90c0bd44-3092-4775-99e3-662e0b997e4e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:19.371610 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-90c0bd44-3092-4775-99e3-662e0b997e4e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1679 microversion: 2.1 time: 0.704927 Oct 26 13:26:19.377696 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2508/4999] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:26:18 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1679 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:26:19.797401 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4fd560e1-7de0-4b72-ae15-47ff1454e138 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:19.798418 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4fd560e1-7de0-4b72-ae15-47ff1454e138 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] [instance: c2768cde-3bad-44b4-b68c-ed16dbe802b6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:19.816677 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4fd560e1-7de0-4b72-ae15-47ff1454e138 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:19.817220 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4fd560e1-7de0-4b72-ae15-47ff1454e138 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:19.817698 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4fd560e1-7de0-4b72-ae15-47ff1454e138 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:19.828689 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4fd560e1-7de0-4b72-ae15-47ff1454e138 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:19.829747 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4fd560e1-7de0-4b72-ae15-47ff1454e138 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:19.832400 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4fd560e1-7de0-4b72-ae15-47ff1454e138 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:20.341366 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-80f599c1-85a4-454d-b1aa-f77fcf45b370 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:20.342334 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-80f599c1-85a4-454d-b1aa-f77fcf45b370 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] [instance: 8536123b-d626-498f-bfc7-9b76553e3d04] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:20.350795 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4fd560e1-7de0-4b72-ae15-47ff1454e138 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:20.357582 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-80f599c1-85a4-454d-b1aa-f77fcf45b370 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:20.360340 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-80f599c1-85a4-454d-b1aa-f77fcf45b370 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:20.368083 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-80f599c1-85a4-454d-b1aa-f77fcf45b370 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:20.373246 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-80f599c1-85a4-454d-b1aa-f77fcf45b370 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:20.374710 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-80f599c1-85a4-454d-b1aa-f77fcf45b370 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:20.376304 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4fd560e1-7de0-4b72-ae15-47ff1454e138 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:20.377128 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-80f599c1-85a4-454d-b1aa-f77fcf45b370 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:20.378861 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4fd560e1-7de0-4b72-ae15-47ff1454e138 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:20.380314 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4fd560e1-7de0-4b72-ae15-47ff1454e138 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] 10.222.0.40 "GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6" status: 200 len: 1366 microversion: 2.57 time: 0.587654 Oct 26 13:26:20.381394 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2492/5000] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:26:19 2022] GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6 => generated 1366 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:26:20.400236 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-65137866-c53c-41c8-8db2-731cc79d9f99 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:20.401446 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-65137866-c53c-41c8-8db2-731cc79d9f99 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:20.413759 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-65137866-c53c-41c8-8db2-731cc79d9f99 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:20.417769 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-65137866-c53c-41c8-8db2-731cc79d9f99 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:20.418471 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-65137866-c53c-41c8-8db2-731cc79d9f99 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:20.420856 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-65137866-c53c-41c8-8db2-731cc79d9f99 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:20.422803 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-65137866-c53c-41c8-8db2-731cc79d9f99 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:20.423444 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-65137866-c53c-41c8-8db2-731cc79d9f99 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:20.757414 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-80f599c1-85a4-454d-b1aa-f77fcf45b370 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674435111c05455fb1eb5b213d1373c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66f4a941524e30b05360a3ccb2e449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:20.771794 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-80f599c1-85a4-454d-b1aa-f77fcf45b370 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04" status: 200 len: 1276 microversion: 2.1 time: 0.434730 Oct 26 13:26:20.794166 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2509/5001] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:26:20 2022] GET /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04 => generated 1276 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:26:21.106211 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-65137866-c53c-41c8-8db2-731cc79d9f99 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:21.118166 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-65137866-c53c-41c8-8db2-731cc79d9f99 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1679 microversion: 2.1 time: 0.721859 Oct 26 13:26:21.120584 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2493/5002] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:26:20 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1679 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:26:21.411554 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-73c237f5-8052-42bd-82bb-9563aeafb799 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:21.412804 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-73c237f5-8052-42bd-82bb-9563aeafb799 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] [instance: c2768cde-3bad-44b4-b68c-ed16dbe802b6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:21.439185 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73c237f5-8052-42bd-82bb-9563aeafb799 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:21.440007 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73c237f5-8052-42bd-82bb-9563aeafb799 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:21.442175 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73c237f5-8052-42bd-82bb-9563aeafb799 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:21.444289 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73c237f5-8052-42bd-82bb-9563aeafb799 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:21.446718 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73c237f5-8052-42bd-82bb-9563aeafb799 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:21.447334 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73c237f5-8052-42bd-82bb-9563aeafb799 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:21.739423 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-73c237f5-8052-42bd-82bb-9563aeafb799 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:21.753165 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-73c237f5-8052-42bd-82bb-9563aeafb799 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:21.757973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-73c237f5-8052-42bd-82bb-9563aeafb799 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:21.763165 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-73c237f5-8052-42bd-82bb-9563aeafb799 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] 10.222.0.40 "GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6" status: 200 len: 1366 microversion: 2.57 time: 0.356400 Oct 26 13:26:21.763966 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2510/5003] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:26:21 2022] GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6 => generated 1366 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:26:21.806512 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9d8107ee-eb7b-49ce-95cb-3d4f94b655ee tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:21.807417 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9d8107ee-eb7b-49ce-95cb-3d4f94b655ee tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] [instance: 8536123b-d626-498f-bfc7-9b76553e3d04] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:21.821711 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9d8107ee-eb7b-49ce-95cb-3d4f94b655ee tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:21.825894 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9d8107ee-eb7b-49ce-95cb-3d4f94b655ee tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:21.827548 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9d8107ee-eb7b-49ce-95cb-3d4f94b655ee tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:21.828522 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9d8107ee-eb7b-49ce-95cb-3d4f94b655ee tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:21.829009 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9d8107ee-eb7b-49ce-95cb-3d4f94b655ee tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:21.829454 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9d8107ee-eb7b-49ce-95cb-3d4f94b655ee tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:22.145385 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ea395a5e-d689-43f9-aee5-944660cfd307 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:22.146521 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ea395a5e-d689-43f9-aee5-944660cfd307 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:22.177807 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ea395a5e-d689-43f9-aee5-944660cfd307 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:22.193889 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ea395a5e-d689-43f9-aee5-944660cfd307 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:22.194355 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ea395a5e-d689-43f9-aee5-944660cfd307 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:22.195132 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ea395a5e-d689-43f9-aee5-944660cfd307 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:22.195590 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ea395a5e-d689-43f9-aee5-944660cfd307 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:22.196025 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ea395a5e-d689-43f9-aee5-944660cfd307 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:22.358530 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9d8107ee-eb7b-49ce-95cb-3d4f94b655ee tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674435111c05455fb1eb5b213d1373c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66f4a941524e30b05360a3ccb2e449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:22.373453 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9d8107ee-eb7b-49ce-95cb-3d4f94b655ee tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04" status: 200 len: 1318 microversion: 2.1 time: 0.571529 Oct 26 13:26:22.381109 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2494/5004] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:26:21 2022] GET /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04 => generated 1318 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:26:22.794893 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6268a8c2-3f8e-4a80-9089-99ef22764923 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:22.795994 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6268a8c2-3f8e-4a80-9089-99ef22764923 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] [instance: c2768cde-3bad-44b4-b68c-ed16dbe802b6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:22.803994 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6268a8c2-3f8e-4a80-9089-99ef22764923 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:22.813740 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6268a8c2-3f8e-4a80-9089-99ef22764923 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:22.814385 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6268a8c2-3f8e-4a80-9089-99ef22764923 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:22.815338 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6268a8c2-3f8e-4a80-9089-99ef22764923 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:22.815976 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6268a8c2-3f8e-4a80-9089-99ef22764923 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:22.816581 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6268a8c2-3f8e-4a80-9089-99ef22764923 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:23.007636 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6268a8c2-3f8e-4a80-9089-99ef22764923 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:23.043106 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6268a8c2-3f8e-4a80-9089-99ef22764923 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:23.046774 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6268a8c2-3f8e-4a80-9089-99ef22764923 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:23.054991 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6268a8c2-3f8e-4a80-9089-99ef22764923 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] 10.222.0.40 "GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6" status: 200 len: 1366 microversion: 2.57 time: 0.264410 Oct 26 13:26:23.079048 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2495/5005] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:26:22 2022] GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6 => generated 1366 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:26:23.406384 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d3cd1b62-f7db-4cf8-b736-f8ea3401519f tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:23.407907 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d3cd1b62-f7db-4cf8-b736-f8ea3401519f tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] [instance: 8536123b-d626-498f-bfc7-9b76553e3d04] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:23.437200 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d3cd1b62-f7db-4cf8-b736-f8ea3401519f tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:23.438890 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d3cd1b62-f7db-4cf8-b736-f8ea3401519f tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:23.442841 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d3cd1b62-f7db-4cf8-b736-f8ea3401519f tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:23.447924 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d3cd1b62-f7db-4cf8-b736-f8ea3401519f tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:23.454127 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d3cd1b62-f7db-4cf8-b736-f8ea3401519f tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:23.463377 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d3cd1b62-f7db-4cf8-b736-f8ea3401519f tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:23.874500 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ea395a5e-d689-43f9-aee5-944660cfd307 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:23.885810 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ea395a5e-d689-43f9-aee5-944660cfd307 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1679 microversion: 2.1 time: 1.744865 Oct 26 13:26:23.891408 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2511/5006] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:26:22 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1679 bytes in 1752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:26:24.087875 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-65e46177-8b6f-4b1d-afed-e9fbfca7b8e4 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:24.088790 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-65e46177-8b6f-4b1d-afed-e9fbfca7b8e4 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] [instance: c2768cde-3bad-44b4-b68c-ed16dbe802b6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:24.098945 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65e46177-8b6f-4b1d-afed-e9fbfca7b8e4 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:24.100541 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65e46177-8b6f-4b1d-afed-e9fbfca7b8e4 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:24.103908 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65e46177-8b6f-4b1d-afed-e9fbfca7b8e4 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:24.106276 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65e46177-8b6f-4b1d-afed-e9fbfca7b8e4 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:24.107366 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65e46177-8b6f-4b1d-afed-e9fbfca7b8e4 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:24.110625 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65e46177-8b6f-4b1d-afed-e9fbfca7b8e4 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:24.155222 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d3cd1b62-f7db-4cf8-b736-f8ea3401519f tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674435111c05455fb1eb5b213d1373c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66f4a941524e30b05360a3ccb2e449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:24.164730 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d3cd1b62-f7db-4cf8-b736-f8ea3401519f tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04" status: 200 len: 1318 microversion: 2.1 time: 0.766331 Oct 26 13:26:24.181543 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2496/5007] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:26:23 2022] GET /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04 => generated 1318 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:26:24.925827 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d896977a-2653-4b46-9275-9cc9c1ef792a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:24.926501 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d896977a-2653-4b46-9275-9cc9c1ef792a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:24.930316 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=4 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:26:24.939282 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d896977a-2653-4b46-9275-9cc9c1ef792a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:24.947996 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d896977a-2653-4b46-9275-9cc9c1ef792a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:24.948690 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d896977a-2653-4b46-9275-9cc9c1ef792a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:24.950368 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d896977a-2653-4b46-9275-9cc9c1ef792a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:24.951025 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d896977a-2653-4b46-9275-9cc9c1ef792a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:24.952517 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d896977a-2653-4b46-9275-9cc9c1ef792a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:25.026154 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=14 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:26:25.307805 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-65e46177-8b6f-4b1d-afed-e9fbfca7b8e4 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:25.318122 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-65e46177-8b6f-4b1d-afed-e9fbfca7b8e4 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:25.319575 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-65e46177-8b6f-4b1d-afed-e9fbfca7b8e4 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:25.323627 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d896977a-2653-4b46-9275-9cc9c1ef792a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:25.327489 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-65e46177-8b6f-4b1d-afed-e9fbfca7b8e4 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] 10.222.0.40 "GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6" status: 200 len: 1372 microversion: 2.57 time: 1.238678 Oct 26 13:26:25.336682 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d896977a-2653-4b46-9275-9cc9c1ef792a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1679 microversion: 2.1 time: 0.422305 Oct 26 13:26:25.350022 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2512/5008] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:26:24 2022] GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6 => generated 1372 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:26:25.367071 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2497/5009] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:26:24 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1679 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:26:25.371959 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-764b8e1b-e63e-4cd1-a51e-3edefdf65808 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:25.372837 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-764b8e1b-e63e-4cd1-a51e-3edefdf65808 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] [instance: 8536123b-d626-498f-bfc7-9b76553e3d04] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:25.406915 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-764b8e1b-e63e-4cd1-a51e-3edefdf65808 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:25.407687 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-764b8e1b-e63e-4cd1-a51e-3edefdf65808 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:25.409853 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-764b8e1b-e63e-4cd1-a51e-3edefdf65808 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:25.418182 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-764b8e1b-e63e-4cd1-a51e-3edefdf65808 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:25.419237 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-764b8e1b-e63e-4cd1-a51e-3edefdf65808 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:25.420152 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-764b8e1b-e63e-4cd1-a51e-3edefdf65808 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:26.374306 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d975b1ff-7e46-4762-b638-0c176657fae4 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:26.375555 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d975b1ff-7e46-4762-b638-0c176657fae4 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] [instance: c2768cde-3bad-44b4-b68c-ed16dbe802b6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:26.408014 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d975b1ff-7e46-4762-b638-0c176657fae4 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:26.431268 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d975b1ff-7e46-4762-b638-0c176657fae4 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:26.432100 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d975b1ff-7e46-4762-b638-0c176657fae4 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:26.434812 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d975b1ff-7e46-4762-b638-0c176657fae4 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:26.440238 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d975b1ff-7e46-4762-b638-0c176657fae4 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:26.441071 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d975b1ff-7e46-4762-b638-0c176657fae4 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:26.761357 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d975b1ff-7e46-4762-b638-0c176657fae4 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:26.776055 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d975b1ff-7e46-4762-b638-0c176657fae4 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:26.787976 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d975b1ff-7e46-4762-b638-0c176657fae4 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:26.791712 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d975b1ff-7e46-4762-b638-0c176657fae4 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] 10.222.0.40 "GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6" status: 200 len: 1357 microversion: 2.57 time: 0.432125 Oct 26 13:26:26.795139 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2498/5010] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:26:26 2022] GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6 => generated 1357 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:26:26.819018 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c0693061-3923-43d1-8f7c-539044c83953 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:26.819956 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c0693061-3923-43d1-8f7c-539044c83953 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:26.865797 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0693061-3923-43d1-8f7c-539044c83953 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:26.866362 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0693061-3923-43d1-8f7c-539044c83953 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:26.867009 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0693061-3923-43d1-8f7c-539044c83953 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:26.868700 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0693061-3923-43d1-8f7c-539044c83953 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:26.888267 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0693061-3923-43d1-8f7c-539044c83953 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:26.891327 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0693061-3923-43d1-8f7c-539044c83953 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:27.883152 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c0693061-3923-43d1-8f7c-539044c83953 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:27.894024 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c0693061-3923-43d1-8f7c-539044c83953 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1679 microversion: 2.1 time: 1.094851 Oct 26 13:26:27.894984 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2499/5011] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:26:26 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1679 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:26:27.907131 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-40f5f3a5-dba3-483a-876b-55eff1b7ecba tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:27.907905 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-40f5f3a5-dba3-483a-876b-55eff1b7ecba tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] [instance: c2768cde-3bad-44b4-b68c-ed16dbe802b6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:27.929018 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-40f5f3a5-dba3-483a-876b-55eff1b7ecba tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:27.929648 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-40f5f3a5-dba3-483a-876b-55eff1b7ecba tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:27.930196 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-40f5f3a5-dba3-483a-876b-55eff1b7ecba tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:27.931622 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-40f5f3a5-dba3-483a-876b-55eff1b7ecba tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:27.932336 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-40f5f3a5-dba3-483a-876b-55eff1b7ecba tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:27.933001 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-40f5f3a5-dba3-483a-876b-55eff1b7ecba tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:28.032177 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-40f5f3a5-dba3-483a-876b-55eff1b7ecba tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] [instance: c2768cde-3bad-44b4-b68c-ed16dbe802b6] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:26:28.353151 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-40f5f3a5-dba3-483a-876b-55eff1b7ecba tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6" status: 204 len: 0 microversion: 2.57 time: 0.455796 Oct 26 13:26:28.354147 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2500/5012] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 26 13:26:27 2022] DELETE /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 13:26:28.377820 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0babf86f-1ae5-4765-ac0f-b1184d08cba8 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:28.378971 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0babf86f-1ae5-4765-ac0f-b1184d08cba8 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] [instance: c2768cde-3bad-44b4-b68c-ed16dbe802b6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:28.398438 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0babf86f-1ae5-4765-ac0f-b1184d08cba8 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:28.399556 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0babf86f-1ae5-4765-ac0f-b1184d08cba8 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:28.401170 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0babf86f-1ae5-4765-ac0f-b1184d08cba8 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:28.404165 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0babf86f-1ae5-4765-ac0f-b1184d08cba8 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:28.406574 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0babf86f-1ae5-4765-ac0f-b1184d08cba8 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:28.407267 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0babf86f-1ae5-4765-ac0f-b1184d08cba8 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:28.484963 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-764b8e1b-e63e-4cd1-a51e-3edefdf65808 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674435111c05455fb1eb5b213d1373c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66f4a941524e30b05360a3ccb2e449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:28.501141 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-764b8e1b-e63e-4cd1-a51e-3edefdf65808 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04" status: 200 len: 1318 microversion: 2.1 time: 3.149655 Oct 26 13:26:28.501781 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2513/5013] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:26:25 2022] GET /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04 => generated 1318 bytes in 3151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:26:28.667427 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0babf86f-1ae5-4765-ac0f-b1184d08cba8 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:28.682166 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0babf86f-1ae5-4765-ac0f-b1184d08cba8 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:28.685953 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0babf86f-1ae5-4765-ac0f-b1184d08cba8 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:28.690145 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0babf86f-1ae5-4765-ac0f-b1184d08cba8 tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] 10.222.0.40 "GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6" status: 200 len: 1363 microversion: 2.57 time: 0.329251 Oct 26 13:26:28.694506 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2501/5014] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:26:28 2022] GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6 => generated 1363 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:26:28.923416 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8e36462b-e347-4fe4-b68d-d43d1de54233 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:28.924143 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8e36462b-e347-4fe4-b68d-d43d1de54233 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:28.937742 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e36462b-e347-4fe4-b68d-d43d1de54233 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:28.938251 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e36462b-e347-4fe4-b68d-d43d1de54233 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:28.938710 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e36462b-e347-4fe4-b68d-d43d1de54233 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:28.939433 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e36462b-e347-4fe4-b68d-d43d1de54233 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:28.939898 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e36462b-e347-4fe4-b68d-d43d1de54233 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:28.950165 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e36462b-e347-4fe4-b68d-d43d1de54233 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:29.531131 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dce1a7cd-eaf4-4d83-893d-dd1f72e3f0ef tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:29.532469 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-dce1a7cd-eaf4-4d83-893d-dd1f72e3f0ef tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] [instance: 8536123b-d626-498f-bfc7-9b76553e3d04] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:29.547117 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dce1a7cd-eaf4-4d83-893d-dd1f72e3f0ef tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:29.547893 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dce1a7cd-eaf4-4d83-893d-dd1f72e3f0ef tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:29.548524 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dce1a7cd-eaf4-4d83-893d-dd1f72e3f0ef tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:29.550669 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dce1a7cd-eaf4-4d83-893d-dd1f72e3f0ef tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:29.552483 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dce1a7cd-eaf4-4d83-893d-dd1f72e3f0ef tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:29.553219 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dce1a7cd-eaf4-4d83-893d-dd1f72e3f0ef tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:30.091162 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8e36462b-e347-4fe4-b68d-d43d1de54233 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:30.118805 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8e36462b-e347-4fe4-b68d-d43d1de54233 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1679 microversion: 2.1 time: 1.201469 Oct 26 13:26:30.120706 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2514/5015] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:26:28 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1679 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:26:30.145240 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-83ac7372-61be-435c-81de-d7ac3e9d20ab tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:30.145240 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-83ac7372-61be-435c-81de-d7ac3e9d20ab tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] [instance: c2768cde-3bad-44b4-b68c-ed16dbe802b6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:30.181200 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83ac7372-61be-435c-81de-d7ac3e9d20ab tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:30.182165 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83ac7372-61be-435c-81de-d7ac3e9d20ab tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:30.191111 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83ac7372-61be-435c-81de-d7ac3e9d20ab tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:30.194297 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83ac7372-61be-435c-81de-d7ac3e9d20ab tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:30.194984 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83ac7372-61be-435c-81de-d7ac3e9d20ab tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:30.195625 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83ac7372-61be-435c-81de-d7ac3e9d20ab tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:30.532503 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-dce1a7cd-eaf4-4d83-893d-dd1f72e3f0ef tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674435111c05455fb1eb5b213d1373c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66f4a941524e30b05360a3ccb2e449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:30.550547 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-dce1a7cd-eaf4-4d83-893d-dd1f72e3f0ef tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04" status: 200 len: 1318 microversion: 2.1 time: 1.026364 Oct 26 13:26:30.551167 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2502/5016] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:26:29 2022] GET /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04 => generated 1318 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:26:30.698272 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-83ac7372-61be-435c-81de-d7ac3e9d20ab tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:30.721446 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-83ac7372-61be-435c-81de-d7ac3e9d20ab tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:30.724264 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-83ac7372-61be-435c-81de-d7ac3e9d20ab tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:30.726774 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-83ac7372-61be-435c-81de-d7ac3e9d20ab tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] 10.222.0.40 "GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6" status: 200 len: 1363 microversion: 2.57 time: 0.605065 Oct 26 13:26:30.728465 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2515/5017] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:26:30 2022] GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6 => generated 1363 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:26:31.151384 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f12af940-affc-4070-a43c-38e1e431b9b7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:31.152319 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f12af940-affc-4070-a43c-38e1e431b9b7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:31.171634 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f12af940-affc-4070-a43c-38e1e431b9b7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:31.179288 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f12af940-affc-4070-a43c-38e1e431b9b7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:31.183975 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f12af940-affc-4070-a43c-38e1e431b9b7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:31.184946 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f12af940-affc-4070-a43c-38e1e431b9b7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:31.185644 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f12af940-affc-4070-a43c-38e1e431b9b7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:31.186820 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f12af940-affc-4070-a43c-38e1e431b9b7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:31.520968 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f12af940-affc-4070-a43c-38e1e431b9b7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:31.523859 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:26:31.549250 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f12af940-affc-4070-a43c-38e1e431b9b7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1679 microversion: 2.1 time: 0.402748 Oct 26 13:26:31.552447 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2503/5018] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:26:31 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1679 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:26:31.574022 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e2b30f83-9438-416d-bcd4-bbac021c3d32 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:31.574640 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e2b30f83-9438-416d-bcd4-bbac021c3d32 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] [instance: 8536123b-d626-498f-bfc7-9b76553e3d04] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:31.588843 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e2b30f83-9438-416d-bcd4-bbac021c3d32 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:31.589674 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e2b30f83-9438-416d-bcd4-bbac021c3d32 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:31.590814 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e2b30f83-9438-416d-bcd4-bbac021c3d32 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:31.591749 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e2b30f83-9438-416d-bcd4-bbac021c3d32 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:31.592947 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e2b30f83-9438-416d-bcd4-bbac021c3d32 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:31.594623 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e2b30f83-9438-416d-bcd4-bbac021c3d32 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:31.763935 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d71d18ca-7b7f-42c0-beec-86ad07d3177b tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:31.764639 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d71d18ca-7b7f-42c0-beec-86ad07d3177b tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] [instance: c2768cde-3bad-44b4-b68c-ed16dbe802b6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:31.788191 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d71d18ca-7b7f-42c0-beec-86ad07d3177b tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:31.790905 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d71d18ca-7b7f-42c0-beec-86ad07d3177b tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:31.791487 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d71d18ca-7b7f-42c0-beec-86ad07d3177b tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:31.792254 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d71d18ca-7b7f-42c0-beec-86ad07d3177b tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:31.794360 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d71d18ca-7b7f-42c0-beec-86ad07d3177b tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:31.796371 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d71d18ca-7b7f-42c0-beec-86ad07d3177b tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:31.900666 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d71d18ca-7b7f-42c0-beec-86ad07d3177b tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:31.901159 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d71d18ca-7b7f-42c0-beec-86ad07d3177b tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:31.908015 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d71d18ca-7b7f-42c0-beec-86ad07d3177b tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:31.908754 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-d71d18ca-7b7f-42c0-beec-86ad07d3177b tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lazy-loading 'fault' on Instance uuid c2768cde-3bad-44b4-b68c-ed16dbe802b6 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:26:32.911305 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d71d18ca-7b7f-42c0-beec-86ad07d3177b tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:32.919946 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d71d18ca-7b7f-42c0-beec-86ad07d3177b tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:32.924550 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d71d18ca-7b7f-42c0-beec-86ad07d3177b tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '613197291d1f489eb079ff757b3d577c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9f7e2a122431c9e9668b98d81f87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:32.934912 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d71d18ca-7b7f-42c0-beec-86ad07d3177b tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] 10.222.0.40 "GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6" status: 200 len: 1368 microversion: 2.57 time: 1.176372 Oct 26 13:26:32.940273 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2504/5019] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:26:31 2022] GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6 => generated 1368 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:26:32.945391 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-29a863c0-7b68-4873-a034-fa24d7f77179 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:32.949120 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-29a863c0-7b68-4873-a034-fa24d7f77179 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:32.970074 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-29a863c0-7b68-4873-a034-fa24d7f77179 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:32.970978 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-29a863c0-7b68-4873-a034-fa24d7f77179 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:32.973752 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-29a863c0-7b68-4873-a034-fa24d7f77179 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:32.974740 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-29a863c0-7b68-4873-a034-fa24d7f77179 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:32.975576 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-29a863c0-7b68-4873-a034-fa24d7f77179 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:32.980235 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-29a863c0-7b68-4873-a034-fa24d7f77179 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:33.389954 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e2b30f83-9438-416d-bcd4-bbac021c3d32 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674435111c05455fb1eb5b213d1373c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66f4a941524e30b05360a3ccb2e449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:33.402631 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e2b30f83-9438-416d-bcd4-bbac021c3d32 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04" status: 200 len: 1318 microversion: 2.1 time: 1.832176 Oct 26 13:26:33.426641 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2516/5020] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:26:31 2022] GET /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04 => generated 1318 bytes in 1857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:26:33.437861 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-21013b91-72a9-4677-995a-a221eda1e5a5 req-3c422d4d-e601-4739-82e1-f0118f3ea258 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8536123b-d626-498f-bfc7-9b76553e3d04", "tag": "426db0e6-96c1-46f4-a233-8b1dafdaebaf"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:26:33.509156 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-21013b91-72a9-4677-995a-a221eda1e5a5 req-3c422d4d-e601-4739-82e1-f0118f3ea258 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:33.519878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-21013b91-72a9-4677-995a-a221eda1e5a5 req-3c422d4d-e601-4739-82e1-f0118f3ea258 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:33.520625 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-21013b91-72a9-4677-995a-a221eda1e5a5 req-3c422d4d-e601-4739-82e1-f0118f3ea258 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:33.587793 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-21013b91-72a9-4677-995a-a221eda1e5a5 req-3c422d4d-e601-4739-82e1-f0118f3ea258 service nova] Creating event network-changed:426db0e6-96c1-46f4-a233-8b1dafdaebaf for instance 8536123b-d626-498f-bfc7-9b76553e3d04 on n-h1-862686-1 Oct 26 13:26:33.636357 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-21013b91-72a9-4677-995a-a221eda1e5a5 req-3c422d4d-e601-4739-82e1-f0118f3ea258 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.206853 Oct 26 13:26:33.651675 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2517/5021] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:26:33.972359 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b4105890-2ec0-4a08-9a60-a863b0f6a96e tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:33.973373 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b4105890-2ec0-4a08-9a60-a863b0f6a96e tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] [instance: c2768cde-3bad-44b4-b68c-ed16dbe802b6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:33.988548 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b4105890-2ec0-4a08-9a60-a863b0f6a96e tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:33.989107 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b4105890-2ec0-4a08-9a60-a863b0f6a96e tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:33.990753 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b4105890-2ec0-4a08-9a60-a863b0f6a96e tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:33.991856 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b4105890-2ec0-4a08-9a60-a863b0f6a96e tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:33.994501 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b4105890-2ec0-4a08-9a60-a863b0f6a96e tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:33.995178 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b4105890-2ec0-4a08-9a60-a863b0f6a96e tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:34.048305 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-b4105890-2ec0-4a08-9a60-a863b0f6a96e tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] HTTP exception thrown: Instance c2768cde-3bad-44b4-b68c-ed16dbe802b6 could not be found. Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b4105890-2ec0-4a08-9a60-a863b0f6a96e tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Request method failure captured: Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6 HTTP/1.1 Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTVYnc8vON2s_RRszR8QeRYkhF9r6LA-VllN0i2pqS0UarBTECVSHKT7D3dUWX5yy8FyNRldXy1CyE50zlqN72hyyJEkEmMrXxp0qGmix-ufBULqH2Vmihav1Y06zrZ5OWnLNG2OlnYjIS_dNV02FtLZNTr-vkNAphJXsYOOUFirByU Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: X-Openstack-Nova-Api-Version: 2.57 Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 20b9f7e2a122431c9e9668b98d81f87f Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServerShowV257Test-50919564 Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/20b9f7e2a122431c9e9668b98d81f87f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/20b9f7e2a122431c9e9668b98d81f87f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_20b9f7e2a122431c9e9668b98d81f87f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/20b9f7e2a122431c9e9668b98d81f87f"}]}] Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServerShowV257Test-50919564 Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 20b9f7e2a122431c9e9668b98d81f87f Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServerShowV257Test-50919564 Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServerShowV257Test-50919564-project Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 613197291d1f489eb079ff757b3d577c Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServerShowV257Test-50919564-project Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance c2768cde-3bad-44b4-b68c-ed16dbe802b6 could not be found. Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'c2768cde-3bad-44b4-b68c-ed16dbe802b6'} Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2768cde-3bad-44b4-b68c-ed16dbe802b6 could not be found. Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2768cde-3bad-44b4-b68c-ed16dbe802b6 could not be found. Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:26:34.066426 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:26:34.073586 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:26:34.073586 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:26:34.073586 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:26:34.073586 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:26:34.073586 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:26:34.073586 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2768cde-3bad-44b4-b68c-ed16dbe802b6 could not be found. Oct 26 13:26:34.073586 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:26:34.084114 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b4105890-2ec0-4a08-9a60-a863b0f6a96e tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] Returning 404 to user: Instance c2768cde-3bad-44b4-b68c-ed16dbe802b6 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:26:34.086326 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b4105890-2ec0-4a08-9a60-a863b0f6a96e tempest-ServerShowV257Test-50919564 tempest-ServerShowV257Test-50919564-project] 10.222.0.40 "GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6" status: 404 len: 111 microversion: 2.57 time: 0.119360 Oct 26 13:26:34.087530 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2518/5022] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:26:33 2022] GET /compute/v2.1/servers/c2768cde-3bad-44b4-b68c-ed16dbe802b6 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:26:34.228460 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-29a863c0-7b68-4873-a034-fa24d7f77179 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:34.258797 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-29a863c0-7b68-4873-a034-fa24d7f77179 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1679 microversion: 2.1 time: 1.315502 Oct 26 13:26:34.264726 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2505/5023] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:26:32 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1679 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:26:34.433172 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1d1e2531-6d02-44c5-9774-f003aecbe162 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:34.434331 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1d1e2531-6d02-44c5-9774-f003aecbe162 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] [instance: 8536123b-d626-498f-bfc7-9b76553e3d04] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:34.463222 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1d1e2531-6d02-44c5-9774-f003aecbe162 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:34.467094 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1d1e2531-6d02-44c5-9774-f003aecbe162 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:34.470610 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1d1e2531-6d02-44c5-9774-f003aecbe162 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:34.471680 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1d1e2531-6d02-44c5-9774-f003aecbe162 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:34.474875 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1d1e2531-6d02-44c5-9774-f003aecbe162 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:34.478485 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1d1e2531-6d02-44c5-9774-f003aecbe162 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:35.286979 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b9e60802-4f18-4922-a1a2-8ecf7ff05a29 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:35.288333 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b9e60802-4f18-4922-a1a2-8ecf7ff05a29 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:35.302187 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b9e60802-4f18-4922-a1a2-8ecf7ff05a29 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:35.311615 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b9e60802-4f18-4922-a1a2-8ecf7ff05a29 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:35.312259 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b9e60802-4f18-4922-a1a2-8ecf7ff05a29 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:35.315864 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b9e60802-4f18-4922-a1a2-8ecf7ff05a29 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:35.317054 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b9e60802-4f18-4922-a1a2-8ecf7ff05a29 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:35.324215 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b9e60802-4f18-4922-a1a2-8ecf7ff05a29 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:36.219141 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1d1e2531-6d02-44c5-9774-f003aecbe162 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674435111c05455fb1eb5b213d1373c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66f4a941524e30b05360a3ccb2e449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:36.245248 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1d1e2531-6d02-44c5-9774-f003aecbe162 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04" status: 200 len: 1318 microversion: 2.1 time: 1.815979 Oct 26 13:26:36.258337 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2519/5024] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:26:34 2022] GET /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04 => generated 1318 bytes in 1818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:26:36.259567 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-66fea668-72d9-46c8-8f6e-a27a6440360e req-798b766b-1aba-4520-a67a-850e699a960d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56c29b20-837e-4f90-9213-99699295a6af", "tag": "38eb9476-6dba-4c83-886a-1e2f98837aa4"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:26:36.309667 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-66fea668-72d9-46c8-8f6e-a27a6440360e req-798b766b-1aba-4520-a67a-850e699a960d service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:36.311869 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-66fea668-72d9-46c8-8f6e-a27a6440360e req-798b766b-1aba-4520-a67a-850e699a960d service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:36.312701 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-66fea668-72d9-46c8-8f6e-a27a6440360e req-798b766b-1aba-4520-a67a-850e699a960d service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:36.330745 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-66fea668-72d9-46c8-8f6e-a27a6440360e req-798b766b-1aba-4520-a67a-850e699a960d service nova] Creating event network-changed:38eb9476-6dba-4c83-886a-1e2f98837aa4 for instance 56c29b20-837e-4f90-9213-99699295a6af on n-h1-862686-1 Oct 26 13:26:36.348041 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-66fea668-72d9-46c8-8f6e-a27a6440360e req-798b766b-1aba-4520-a67a-850e699a960d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098118 Oct 26 13:26:36.358482 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2520/5025] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:26:36.990411 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b9e60802-4f18-4922-a1a2-8ecf7ff05a29 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:37.008122 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b9e60802-4f18-4922-a1a2-8ecf7ff05a29 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1679 microversion: 2.1 time: 1.718701 Oct 26 13:26:37.038272 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2506/5026] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:26:35 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1679 bytes in 1756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:26:37.277346 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b2ff1e1f-0559-49b3-af5b-7d186a9ed012 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:37.279126 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b2ff1e1f-0559-49b3-af5b-7d186a9ed012 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] [instance: 8536123b-d626-498f-bfc7-9b76553e3d04] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:37.302265 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b2ff1e1f-0559-49b3-af5b-7d186a9ed012 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:37.303163 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b2ff1e1f-0559-49b3-af5b-7d186a9ed012 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:37.303833 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b2ff1e1f-0559-49b3-af5b-7d186a9ed012 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:37.305288 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b2ff1e1f-0559-49b3-af5b-7d186a9ed012 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:37.306029 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b2ff1e1f-0559-49b3-af5b-7d186a9ed012 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:37.306708 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b2ff1e1f-0559-49b3-af5b-7d186a9ed012 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:38.037287 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0e5f228c-4104-4ba1-90a5-473b60346695 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:38.038961 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0e5f228c-4104-4ba1-90a5-473b60346695 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:38.049122 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0e5f228c-4104-4ba1-90a5-473b60346695 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:38.049928 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0e5f228c-4104-4ba1-90a5-473b60346695 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:38.050679 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0e5f228c-4104-4ba1-90a5-473b60346695 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:38.051963 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0e5f228c-4104-4ba1-90a5-473b60346695 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:38.052688 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0e5f228c-4104-4ba1-90a5-473b60346695 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:38.053418 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0e5f228c-4104-4ba1-90a5-473b60346695 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:38.275866 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b2ff1e1f-0559-49b3-af5b-7d186a9ed012 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674435111c05455fb1eb5b213d1373c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66f4a941524e30b05360a3ccb2e449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:38.284898 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b2ff1e1f-0559-49b3-af5b-7d186a9ed012 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04" status: 200 len: 1318 microversion: 2.1 time: 1.017800 Oct 26 13:26:38.308566 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2521/5027] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:26:37 2022] GET /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04 => generated 1318 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:26:38.714913 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0e5f228c-4104-4ba1-90a5-473b60346695 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:38.733290 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0e5f228c-4104-4ba1-90a5-473b60346695 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1679 microversion: 2.1 time: 0.696394 Oct 26 13:26:38.738625 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2507/5028] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:26:38 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1679 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:26:39.320903 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c34a0e38-0184-4a89-96dc-f890e6a2390c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:39.322244 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c34a0e38-0184-4a89-96dc-f890e6a2390c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] [instance: 8536123b-d626-498f-bfc7-9b76553e3d04] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:39.343487 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c34a0e38-0184-4a89-96dc-f890e6a2390c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:39.347857 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c34a0e38-0184-4a89-96dc-f890e6a2390c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:39.349814 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c34a0e38-0184-4a89-96dc-f890e6a2390c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:39.350781 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c34a0e38-0184-4a89-96dc-f890e6a2390c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:39.356955 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c34a0e38-0184-4a89-96dc-f890e6a2390c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:39.359947 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c34a0e38-0184-4a89-96dc-f890e6a2390c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:39.760522 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f75cc7db-8f27-4a07-8dd0-7501e9dfc9e3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:39.761874 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f75cc7db-8f27-4a07-8dd0-7501e9dfc9e3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:39.777028 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f75cc7db-8f27-4a07-8dd0-7501e9dfc9e3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:39.787095 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f75cc7db-8f27-4a07-8dd0-7501e9dfc9e3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:39.787734 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f75cc7db-8f27-4a07-8dd0-7501e9dfc9e3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:39.791368 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f75cc7db-8f27-4a07-8dd0-7501e9dfc9e3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:39.792062 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f75cc7db-8f27-4a07-8dd0-7501e9dfc9e3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:39.797278 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f75cc7db-8f27-4a07-8dd0-7501e9dfc9e3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:40.612957 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f75cc7db-8f27-4a07-8dd0-7501e9dfc9e3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:40.632127 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f75cc7db-8f27-4a07-8dd0-7501e9dfc9e3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1679 microversion: 2.1 time: 0.873436 Oct 26 13:26:40.632958 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2508/5029] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:26:39 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1679 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:26:41.140038 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c34a0e38-0184-4a89-96dc-f890e6a2390c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674435111c05455fb1eb5b213d1373c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66f4a941524e30b05360a3ccb2e449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:41.148229 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c34a0e38-0184-4a89-96dc-f890e6a2390c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04" status: 200 len: 1318 microversion: 2.1 time: 1.832249 Oct 26 13:26:41.161904 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2522/5030] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:26:39 2022] GET /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04 => generated 1318 bytes in 1846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:26:41.666562 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e5f9ee6c-790c-4396-8d22-45cfaa299bd1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:41.667650 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e5f9ee6c-790c-4396-8d22-45cfaa299bd1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:41.681107 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e5f9ee6c-790c-4396-8d22-45cfaa299bd1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:41.683272 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e5f9ee6c-790c-4396-8d22-45cfaa299bd1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:41.686771 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e5f9ee6c-790c-4396-8d22-45cfaa299bd1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:41.690338 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e5f9ee6c-790c-4396-8d22-45cfaa299bd1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:41.691108 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e5f9ee6c-790c-4396-8d22-45cfaa299bd1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:41.691819 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e5f9ee6c-790c-4396-8d22-45cfaa299bd1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:42.178189 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e888453e-8f70-4a6c-b390-f821ebaf6c4a tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:42.179560 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e888453e-8f70-4a6c-b390-f821ebaf6c4a tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] [instance: 8536123b-d626-498f-bfc7-9b76553e3d04] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:42.196939 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e888453e-8f70-4a6c-b390-f821ebaf6c4a tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:42.199434 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e888453e-8f70-4a6c-b390-f821ebaf6c4a tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:42.201578 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e888453e-8f70-4a6c-b390-f821ebaf6c4a tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:42.204817 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e888453e-8f70-4a6c-b390-f821ebaf6c4a tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:42.205620 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e888453e-8f70-4a6c-b390-f821ebaf6c4a tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:42.208247 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e888453e-8f70-4a6c-b390-f821ebaf6c4a tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:42.285707 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:26:42.524159 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e5f9ee6c-790c-4396-8d22-45cfaa299bd1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:42.558438 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e5f9ee6c-790c-4396-8d22-45cfaa299bd1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1679 microversion: 2.1 time: 0.897538 Oct 26 13:26:42.561290 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2509/5031] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:26:41 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1679 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:26:42.994452 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e888453e-8f70-4a6c-b390-f821ebaf6c4a tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674435111c05455fb1eb5b213d1373c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66f4a941524e30b05360a3ccb2e449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:43.010488 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e888453e-8f70-4a6c-b390-f821ebaf6c4a tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04" status: 200 len: 1318 microversion: 2.1 time: 0.837076 Oct 26 13:26:43.015461 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2523/5032] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:26:42 2022] GET /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04 => generated 1318 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:26:43.390042 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-26570af5-e4ee-40ba-b5a8-f7a534497f0e req-3987179c-82c2-4bf8-98c6-b4819d967419 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8536123b-d626-498f-bfc7-9b76553e3d04", "name": "network-vif-plugged", "status": "completed", "tag": "426db0e6-96c1-46f4-a233-8b1dafdaebaf"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:26:43.414703 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-26570af5-e4ee-40ba-b5a8-f7a534497f0e req-3987179c-82c2-4bf8-98c6-b4819d967419 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:43.417353 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-26570af5-e4ee-40ba-b5a8-f7a534497f0e req-3987179c-82c2-4bf8-98c6-b4819d967419 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:43.417879 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-26570af5-e4ee-40ba-b5a8-f7a534497f0e req-3987179c-82c2-4bf8-98c6-b4819d967419 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:43.460403 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-26570af5-e4ee-40ba-b5a8-f7a534497f0e req-3987179c-82c2-4bf8-98c6-b4819d967419 service nova] Creating event network-vif-plugged:426db0e6-96c1-46f4-a233-8b1dafdaebaf for instance 8536123b-d626-498f-bfc7-9b76553e3d04 on n-h1-862686-1 Oct 26 13:26:43.474280 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-26570af5-e4ee-40ba-b5a8-f7a534497f0e req-3987179c-82c2-4bf8-98c6-b4819d967419 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086991 Oct 26 13:26:43.478109 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2510/5033] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:26:43.588801 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-caeadca0-e4bb-4520-b013-6a276e7f38c6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:43.590056 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-caeadca0-e4bb-4520-b013-6a276e7f38c6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:43.617012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-caeadca0-e4bb-4520-b013-6a276e7f38c6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:43.617756 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-caeadca0-e4bb-4520-b013-6a276e7f38c6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:43.620819 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-caeadca0-e4bb-4520-b013-6a276e7f38c6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:43.622415 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-caeadca0-e4bb-4520-b013-6a276e7f38c6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:43.624463 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-caeadca0-e4bb-4520-b013-6a276e7f38c6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:43.625090 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-caeadca0-e4bb-4520-b013-6a276e7f38c6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:44.049441 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6ce25230-676e-4593-882e-39500e9401f9 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:44.054895 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6ce25230-676e-4593-882e-39500e9401f9 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] [instance: 8536123b-d626-498f-bfc7-9b76553e3d04] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:44.069218 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ce25230-676e-4593-882e-39500e9401f9 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:44.070156 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ce25230-676e-4593-882e-39500e9401f9 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:44.071860 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ce25230-676e-4593-882e-39500e9401f9 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:44.074029 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ce25230-676e-4593-882e-39500e9401f9 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:44.075413 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ce25230-676e-4593-882e-39500e9401f9 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:44.077361 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ce25230-676e-4593-882e-39500e9401f9 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:44.717974 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-caeadca0-e4bb-4520-b013-6a276e7f38c6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:44.727628 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-caeadca0-e4bb-4520-b013-6a276e7f38c6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1679 microversion: 2.1 time: 1.144349 Oct 26 13:26:44.743730 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2524/5034] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:26:43 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1679 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:26:45.070002 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6ce25230-676e-4593-882e-39500e9401f9 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674435111c05455fb1eb5b213d1373c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66f4a941524e30b05360a3ccb2e449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:45.087286 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6ce25230-676e-4593-882e-39500e9401f9 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04" status: 200 len: 1318 microversion: 2.1 time: 1.042619 Oct 26 13:26:45.089853 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2511/5035] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:26:44 2022] GET /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04 => generated 1318 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:26:45.772376 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7ca3022a-6b94-4914-b637-85c7dc4215fb tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:45.778253 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7ca3022a-6b94-4914-b637-85c7dc4215fb tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:45.800690 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ca3022a-6b94-4914-b637-85c7dc4215fb tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:45.804049 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ca3022a-6b94-4914-b637-85c7dc4215fb tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:45.813678 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ca3022a-6b94-4914-b637-85c7dc4215fb tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:45.814553 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ca3022a-6b94-4914-b637-85c7dc4215fb tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:45.815167 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ca3022a-6b94-4914-b637-85c7dc4215fb tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:45.815613 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ca3022a-6b94-4914-b637-85c7dc4215fb tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:46.117643 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-66ecd3c6-12dd-40d4-901f-0103b3d5b45c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:46.118358 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-66ecd3c6-12dd-40d4-901f-0103b3d5b45c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] [instance: 8536123b-d626-498f-bfc7-9b76553e3d04] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:46.126307 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:26:46.146512 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-66ecd3c6-12dd-40d4-901f-0103b3d5b45c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:46.147294 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-66ecd3c6-12dd-40d4-901f-0103b3d5b45c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:46.147987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-66ecd3c6-12dd-40d4-901f-0103b3d5b45c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:46.148957 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-66ecd3c6-12dd-40d4-901f-0103b3d5b45c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:46.151760 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-66ecd3c6-12dd-40d4-901f-0103b3d5b45c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:46.152703 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-66ecd3c6-12dd-40d4-901f-0103b3d5b45c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:46.463260 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7ca3022a-6b94-4914-b637-85c7dc4215fb tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:46.480581 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7ca3022a-6b94-4914-b637-85c7dc4215fb tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1679 microversion: 2.1 time: 0.710780 Oct 26 13:26:46.486684 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2525/5036] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:26:45 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1679 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:26:47.510663 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8534234f-4ab4-4e99-9333-d9bafc5f9a13 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:47.512059 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8534234f-4ab4-4e99-9333-d9bafc5f9a13 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:47.528020 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=42 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:26:47.532183 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8534234f-4ab4-4e99-9333-d9bafc5f9a13 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:47.532908 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8534234f-4ab4-4e99-9333-d9bafc5f9a13 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:47.534281 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8534234f-4ab4-4e99-9333-d9bafc5f9a13 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:47.535645 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8534234f-4ab4-4e99-9333-d9bafc5f9a13 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:47.536273 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8534234f-4ab4-4e99-9333-d9bafc5f9a13 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:47.536861 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8534234f-4ab4-4e99-9333-d9bafc5f9a13 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:48.375692 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-66ecd3c6-12dd-40d4-901f-0103b3d5b45c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674435111c05455fb1eb5b213d1373c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66f4a941524e30b05360a3ccb2e449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:48.387464 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-66ecd3c6-12dd-40d4-901f-0103b3d5b45c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04" status: 200 len: 1468 microversion: 2.1 time: 2.275662 Oct 26 13:26:48.396695 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2512/5037] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:26:46 2022] GET /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04 => generated 1468 bytes in 2285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:26:48.430126 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f8a8f3e5-c4fa-461c-8027-2fa48a8721eb tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:48.431538 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f8a8f3e5-c4fa-461c-8027-2fa48a8721eb tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] [instance: 56c29b20-837e-4f90-9213-99699295a6af] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:48.451543 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f8a8f3e5-c4fa-461c-8027-2fa48a8721eb tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:48.455375 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f8a8f3e5-c4fa-461c-8027-2fa48a8721eb tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:48.457442 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f8a8f3e5-c4fa-461c-8027-2fa48a8721eb tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:48.463741 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f8a8f3e5-c4fa-461c-8027-2fa48a8721eb tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:48.464619 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f8a8f3e5-c4fa-461c-8027-2fa48a8721eb tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:48.465515 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f8a8f3e5-c4fa-461c-8027-2fa48a8721eb tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:49.676243 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f8a8f3e5-c4fa-461c-8027-2fa48a8721eb tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674435111c05455fb1eb5b213d1373c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66f4a941524e30b05360a3ccb2e449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:49.687536 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f8a8f3e5-c4fa-461c-8027-2fa48a8721eb tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/servers/56c29b20-837e-4f90-9213-99699295a6af" status: 200 len: 1317 microversion: 2.1 time: 1.269554 Oct 26 13:26:49.691442 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2513/5038] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:26:48 2022] GET /compute/v2.1/servers/56c29b20-837e-4f90-9213-99699295a6af => generated 1317 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:26:49.711804 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8534234f-4ab4-4e99-9333-d9bafc5f9a13 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:49.721833 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8534234f-4ab4-4e99-9333-d9bafc5f9a13 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1679 microversion: 2.1 time: 2.214893 Oct 26 13:26:49.735389 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2526/5039] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:26:47 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1679 bytes in 2228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:26:50.731229 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-99259bba-6201-4a0f-bfd8-e9274927eb2e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:50.733420 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-99259bba-6201-4a0f-bfd8-e9274927eb2e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] [instance: 56c29b20-837e-4f90-9213-99699295a6af] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:50.761542 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bb99aadb-1bd3-487c-9187-05ad48f2c498 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:50.764646 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bb99aadb-1bd3-487c-9187-05ad48f2c498 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:50.796031 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb99aadb-1bd3-487c-9187-05ad48f2c498 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:50.796806 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb99aadb-1bd3-487c-9187-05ad48f2c498 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:50.797417 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb99aadb-1bd3-487c-9187-05ad48f2c498 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:50.798636 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb99aadb-1bd3-487c-9187-05ad48f2c498 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:50.801268 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb99aadb-1bd3-487c-9187-05ad48f2c498 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:50.801993 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb99aadb-1bd3-487c-9187-05ad48f2c498 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:50.808046 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-99259bba-6201-4a0f-bfd8-e9274927eb2e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:50.814080 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-99259bba-6201-4a0f-bfd8-e9274927eb2e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:50.815260 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-99259bba-6201-4a0f-bfd8-e9274927eb2e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:50.817908 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-99259bba-6201-4a0f-bfd8-e9274927eb2e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:50.820690 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-99259bba-6201-4a0f-bfd8-e9274927eb2e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:50.821177 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-99259bba-6201-4a0f-bfd8-e9274927eb2e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:51.575813 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bb99aadb-1bd3-487c-9187-05ad48f2c498 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:51.602065 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bb99aadb-1bd3-487c-9187-05ad48f2c498 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1679 microversion: 2.1 time: 0.845284 Oct 26 13:26:51.632417 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2527/5040] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:26:50 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1679 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:26:51.708725 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-99259bba-6201-4a0f-bfd8-e9274927eb2e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674435111c05455fb1eb5b213d1373c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66f4a941524e30b05360a3ccb2e449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:51.742558 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-99259bba-6201-4a0f-bfd8-e9274927eb2e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/servers/56c29b20-837e-4f90-9213-99699295a6af" status: 200 len: 1317 microversion: 2.1 time: 1.034156 Oct 26 13:26:51.782650 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2514/5041] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:26:50 2022] GET /compute/v2.1/servers/56c29b20-837e-4f90-9213-99699295a6af => generated 1317 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:26:52.349304 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-624529f4-9a8b-4c97-87cc-b0f67a752dab req-87caacba-62a1-4025-aad0-e10d61bbafae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56c29b20-837e-4f90-9213-99699295a6af", "name": "network-vif-plugged", "status": "completed", "tag": "38eb9476-6dba-4c83-886a-1e2f98837aa4"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:26:52.376465 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-624529f4-9a8b-4c97-87cc-b0f67a752dab req-87caacba-62a1-4025-aad0-e10d61bbafae service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:52.376954 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-624529f4-9a8b-4c97-87cc-b0f67a752dab req-87caacba-62a1-4025-aad0-e10d61bbafae service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:52.377385 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-624529f4-9a8b-4c97-87cc-b0f67a752dab req-87caacba-62a1-4025-aad0-e10d61bbafae service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:52.412376 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-624529f4-9a8b-4c97-87cc-b0f67a752dab req-87caacba-62a1-4025-aad0-e10d61bbafae service nova] Creating event network-vif-plugged:38eb9476-6dba-4c83-886a-1e2f98837aa4 for instance 56c29b20-837e-4f90-9213-99699295a6af on n-h1-862686-1 Oct 26 13:26:52.426879 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-624529f4-9a8b-4c97-87cc-b0f67a752dab req-87caacba-62a1-4025-aad0-e10d61bbafae service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080500 Oct 26 13:26:52.432076 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2528/5042] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:26:52.639484 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0abb3730-7e79-4e0c-9f7d-094d35922c5c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:52.640114 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0abb3730-7e79-4e0c-9f7d-094d35922c5c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:52.657684 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0abb3730-7e79-4e0c-9f7d-094d35922c5c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:52.658209 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0abb3730-7e79-4e0c-9f7d-094d35922c5c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:52.658677 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0abb3730-7e79-4e0c-9f7d-094d35922c5c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:52.659425 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0abb3730-7e79-4e0c-9f7d-094d35922c5c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:52.662852 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0abb3730-7e79-4e0c-9f7d-094d35922c5c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:52.663306 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0abb3730-7e79-4e0c-9f7d-094d35922c5c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:52.783947 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-450fd544-cb85-4dac-b449-4c1aa11b4d7c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:52.784642 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-450fd544-cb85-4dac-b449-4c1aa11b4d7c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] [instance: 56c29b20-837e-4f90-9213-99699295a6af] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:52.799284 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-450fd544-cb85-4dac-b449-4c1aa11b4d7c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:52.802026 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-450fd544-cb85-4dac-b449-4c1aa11b4d7c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:52.802501 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-450fd544-cb85-4dac-b449-4c1aa11b4d7c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:52.803233 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-450fd544-cb85-4dac-b449-4c1aa11b4d7c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:52.803697 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-450fd544-cb85-4dac-b449-4c1aa11b4d7c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:52.804119 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-450fd544-cb85-4dac-b449-4c1aa11b4d7c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:53.515655 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0abb3730-7e79-4e0c-9f7d-094d35922c5c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:53.529528 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0abb3730-7e79-4e0c-9f7d-094d35922c5c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 0.894862 Oct 26 13:26:53.533717 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2515/5043] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:26:52 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:26:53.702954 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-450fd544-cb85-4dac-b449-4c1aa11b4d7c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674435111c05455fb1eb5b213d1373c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66f4a941524e30b05360a3ccb2e449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:53.724674 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-450fd544-cb85-4dac-b449-4c1aa11b4d7c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/servers/56c29b20-837e-4f90-9213-99699295a6af" status: 200 len: 1317 microversion: 2.1 time: 0.945543 Oct 26 13:26:53.726592 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2529/5044] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:26:52 2022] GET /compute/v2.1/servers/56c29b20-837e-4f90-9213-99699295a6af => generated 1317 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:26:54.753642 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7d9290ef-1bd4-4008-b91b-b63256480c95 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:54.754937 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7d9290ef-1bd4-4008-b91b-b63256480c95 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] [instance: 56c29b20-837e-4f90-9213-99699295a6af] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:54.766503 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d9290ef-1bd4-4008-b91b-b63256480c95 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:54.768498 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d9290ef-1bd4-4008-b91b-b63256480c95 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:54.770054 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d9290ef-1bd4-4008-b91b-b63256480c95 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:54.770973 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d9290ef-1bd4-4008-b91b-b63256480c95 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:54.783134 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d9290ef-1bd4-4008-b91b-b63256480c95 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:54.784092 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d9290ef-1bd4-4008-b91b-b63256480c95 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:54.961465 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2cd37a45-afcf-431e-88f5-08d9bc9ee826 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:54.962075 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2cd37a45-afcf-431e-88f5-08d9bc9ee826 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:54.972139 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2cd37a45-afcf-431e-88f5-08d9bc9ee826 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:54.972642 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2cd37a45-afcf-431e-88f5-08d9bc9ee826 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:54.973085 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2cd37a45-afcf-431e-88f5-08d9bc9ee826 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:54.973826 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2cd37a45-afcf-431e-88f5-08d9bc9ee826 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:54.974286 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2cd37a45-afcf-431e-88f5-08d9bc9ee826 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:54.974714 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2cd37a45-afcf-431e-88f5-08d9bc9ee826 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:55.429008 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2cd37a45-afcf-431e-88f5-08d9bc9ee826 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:55.452382 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2cd37a45-afcf-431e-88f5-08d9bc9ee826 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 0.495146 Oct 26 13:26:55.457089 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2530/5045] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:26:54 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:26:55.936467 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7d9290ef-1bd4-4008-b91b-b63256480c95 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674435111c05455fb1eb5b213d1373c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66f4a941524e30b05360a3ccb2e449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:55.945396 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7d9290ef-1bd4-4008-b91b-b63256480c95 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/servers/56c29b20-837e-4f90-9213-99699295a6af" status: 200 len: 1467 microversion: 2.1 time: 1.196593 Oct 26 13:26:55.953184 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2516/5046] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:26:54 2022] GET /compute/v2.1/servers/56c29b20-837e-4f90-9213-99699295a6af => generated 1467 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:26:55.984735 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-70e7b6b8-94ca-4f87-893f-819953b76e59 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1593680950"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:26:55.991754 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-70e7b6b8-94ca-4f87-893f-819953b76e59 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] [instance: 56c29b20-837e-4f90-9213-99699295a6af] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:56.021958 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70e7b6b8-94ca-4f87-893f-819953b76e59 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:56.023769 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70e7b6b8-94ca-4f87-893f-819953b76e59 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:56.024218 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70e7b6b8-94ca-4f87-893f-819953b76e59 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:56.024946 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70e7b6b8-94ca-4f87-893f-819953b76e59 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:56.028267 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70e7b6b8-94ca-4f87-893f-819953b76e59 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:56.028771 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70e7b6b8-94ca-4f87-893f-819953b76e59 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:56.700110 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-70e7b6b8-94ca-4f87-893f-819953b76e59 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "POST /compute/v2.1/servers/56c29b20-837e-4f90-9213-99699295a6af/action" status: 202 len: 0 microversion: 2.1 time: 0.719166 Oct 26 13:26:56.703743 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2531/5047] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:26:55 2022] POST /compute/v2.1/servers/56c29b20-837e-4f90-9213-99699295a6af/action => generated 0 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 26 13:26:56.718738 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a2507fd0-ba5b-4526-b725-0949de3c5d6b tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f673213b160>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:56.859508 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a2507fd0-ba5b-4526-b725-0949de3c5d6b tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082" status: 200 len: 1455 microversion: 2.1 time: 0.149973 Oct 26 13:26:56.862254 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2517/5048] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:26:56 2022] GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082 => generated 1455 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:26:57.879983 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-52904498-c1b2-4391-8ada-2942e93dd7ed tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67319113a0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:58.025943 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-52904498-c1b2-4391-8ada-2942e93dd7ed tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082" status: 200 len: 1455 microversion: 2.1 time: 0.153192 Oct 26 13:26:58.037585 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2532/5049] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:26:57 2022] GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082 => generated 1455 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:26:58.906650 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-de50c563-f684-4fcc-83fd-1878a5e5c69d req-cc820e6c-115f-4fb2-be21-8ca6320e51e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "341d8b3a-d684-4969-a5cf-a6aea1a055fa", "name": "network-vif-unplugged", "status": "completed", "tag": "391606bb-b0ec-4759-b9bd-53c1cc5c2f7c"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:26:59.012999 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ba22d256-199a-46c8-bec9-fed3bcb17523 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:59.014924 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ba22d256-199a-46c8-bec9-fed3bcb17523 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:26:59.015639 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-de50c563-f684-4fcc-83fd-1878a5e5c69d req-cc820e6c-115f-4fb2-be21-8ca6320e51e5 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:59.016165 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-de50c563-f684-4fcc-83fd-1878a5e5c69d req-cc820e6c-115f-4fb2-be21-8ca6320e51e5 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:59.016591 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-de50c563-f684-4fcc-83fd-1878a5e5c69d req-cc820e6c-115f-4fb2-be21-8ca6320e51e5 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:59.030576 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ba22d256-199a-46c8-bec9-fed3bcb17523 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:59.031424 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ba22d256-199a-46c8-bec9-fed3bcb17523 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:59.032650 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ba22d256-199a-46c8-bec9-fed3bcb17523 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:59.034585 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ba22d256-199a-46c8-bec9-fed3bcb17523 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:26:59.038071 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ba22d256-199a-46c8-bec9-fed3bcb17523 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:26:59.039047 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ba22d256-199a-46c8-bec9-fed3bcb17523 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:26:59.086334 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-de50c563-f684-4fcc-83fd-1878a5e5c69d req-cc820e6c-115f-4fb2-be21-8ca6320e51e5 service nova] Creating event network-vif-unplugged:391606bb-b0ec-4759-b9bd-53c1cc5c2f7c for instance 341d8b3a-d684-4969-a5cf-a6aea1a055fa on n-h1-862686-1 Oct 26 13:26:59.104732 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-de50c563-f684-4fcc-83fd-1878a5e5c69d req-cc820e6c-115f-4fb2-be21-8ca6320e51e5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.209906 Oct 26 13:26:59.106850 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2518/5050] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:26:59.126720 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-02c1bf01-3c4a-4893-81cb-8cfa6bb58225 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f673196e550>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:59.217847 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-02c1bf01-3c4a-4893-81cb-8cfa6bb58225 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082" status: 200 len: 1455 microversion: 2.1 time: 0.107811 Oct 26 13:26:59.220389 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2519/5051] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:26:59 2022] GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082 => generated 1455 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:26:59.945936 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ba22d256-199a-46c8-bec9-fed3bcb17523 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:26:59.957594 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ba22d256-199a-46c8-bec9-fed3bcb17523 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 0.950270 Oct 26 13:26:59.972725 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2533/5052] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:26:59 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:26:59.990465 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4f5e7d25-0223-48a1-afec-566c35908be1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:26:59.993248 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4f5e7d25-0223-48a1-afec-566c35908be1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:00.009329 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f5e7d25-0223-48a1-afec-566c35908be1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:00.010202 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f5e7d25-0223-48a1-afec-566c35908be1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:00.010880 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f5e7d25-0223-48a1-afec-566c35908be1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:00.011859 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f5e7d25-0223-48a1-afec-566c35908be1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:00.012572 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f5e7d25-0223-48a1-afec-566c35908be1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:00.014737 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f5e7d25-0223-48a1-afec-566c35908be1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:00.238843 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6d5b8f97-d9c2-47f5-9b67-a20191402524 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67317168b0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:00.352774 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6d5b8f97-d9c2-47f5-9b67-a20191402524 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082" status: 200 len: 1455 microversion: 2.1 time: 0.121137 Oct 26 13:27:00.356443 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2534/5053] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:00 2022] GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082 => generated 1455 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:27:01.170680 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4f5e7d25-0223-48a1-afec-566c35908be1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:01.182498 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4f5e7d25-0223-48a1-afec-566c35908be1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 1.198268 Oct 26 13:27:01.183121 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2520/5054] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:26:59 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:01.209861 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c4f5af79-5aef-40fa-a5a1-910017af708b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:01.210964 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c4f5af79-5aef-40fa-a5a1-910017af708b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:01.220744 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4f5af79-5aef-40fa-a5a1-910017af708b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:01.221564 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4f5af79-5aef-40fa-a5a1-910017af708b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:01.222355 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4f5af79-5aef-40fa-a5a1-910017af708b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:01.223352 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4f5af79-5aef-40fa-a5a1-910017af708b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:01.224033 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4f5af79-5aef-40fa-a5a1-910017af708b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:01.224723 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4f5af79-5aef-40fa-a5a1-910017af708b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:01.384582 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-49cb0932-4c6c-45fa-ab23-2c723f662a52 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f6733101310>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:01.484290 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-49cb0932-4c6c-45fa-ab23-2c723f662a52 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082" status: 200 len: 1455 microversion: 2.1 time: 0.104435 Oct 26 13:27:01.485393 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2521/5055] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:01 2022] GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082 => generated 1455 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:27:02.148989 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c4f5af79-5aef-40fa-a5a1-910017af708b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:02.177588 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c4f5af79-5aef-40fa-a5a1-910017af708b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 0.971056 Oct 26 13:27:02.198559 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2535/5056] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:01 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:27:02.215593 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b20e7cbe-138f-46bc-bf33-a806939ee1a0 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:27:02.223347 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b20e7cbe-138f-46bc-bf33-a806939ee1a0 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:02.247434 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b20e7cbe-138f-46bc-bf33-a806939ee1a0 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:02.253578 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b20e7cbe-138f-46bc-bf33-a806939ee1a0 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:02.254870 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b20e7cbe-138f-46bc-bf33-a806939ee1a0 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:02.257022 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b20e7cbe-138f-46bc-bf33-a806939ee1a0 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:02.258480 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b20e7cbe-138f-46bc-bf33-a806939ee1a0 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:02.260467 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b20e7cbe-138f-46bc-bf33-a806939ee1a0 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:02.321147 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=86 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:27:02.478114 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b20e7cbe-138f-46bc-bf33-a806939ee1a0 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "POST /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa/action" status: 202 len: 0 microversion: 2.1 time: 0.271220 Oct 26 13:27:02.483445 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2522/5057] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:27:02 2022] POST /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:27:02.491603 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f8522486-e82d-46bc-8095-9d0f33400bfa tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:02.492214 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f8522486-e82d-46bc-8095-9d0f33400bfa tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:02.518320 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-15abcb72-3555-4900-845c-a8372a77b879 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67319d6d30>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:02.521232 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8522486-e82d-46bc-8095-9d0f33400bfa tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:02.526204 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8522486-e82d-46bc-8095-9d0f33400bfa tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:02.528023 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8522486-e82d-46bc-8095-9d0f33400bfa tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:02.532523 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8522486-e82d-46bc-8095-9d0f33400bfa tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:02.536474 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8522486-e82d-46bc-8095-9d0f33400bfa tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:02.540533 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8522486-e82d-46bc-8095-9d0f33400bfa tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:02.653403 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-15abcb72-3555-4900-845c-a8372a77b879 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082" status: 200 len: 1455 microversion: 2.1 time: 0.156117 Oct 26 13:27:02.654410 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2523/5058] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:02 2022] GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082 => generated 1455 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:03.669665 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9357016d-9c56-4512-a419-a1c826381c30 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67319859d0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:03.789297 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9357016d-9c56-4512-a419-a1c826381c30 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082" status: 200 len: 1455 microversion: 2.1 time: 0.124179 Oct 26 13:27:03.798052 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2524/5059] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:03 2022] GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082 => generated 1455 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:27:03.868672 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f8522486-e82d-46bc-8095-9d0f33400bfa tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:03.883868 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f8522486-e82d-46bc-8095-9d0f33400bfa tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1668 microversion: 2.1 time: 1.396311 Oct 26 13:27:03.885069 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2536/5060] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:02 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1668 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:04.350450 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-9d02ceca-a73b-45ad-83f8-c112cefa1c08 req-a444e69d-732d-42cf-8075-cbe09ff3ca1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56c29b20-837e-4f90-9213-99699295a6af", "name": "network-vif-plugged", "status": "completed", "tag": "38eb9476-6dba-4c83-886a-1e2f98837aa4"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:27:04.375677 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9d02ceca-a73b-45ad-83f8-c112cefa1c08 req-a444e69d-732d-42cf-8075-cbe09ff3ca1d service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:04.376993 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9d02ceca-a73b-45ad-83f8-c112cefa1c08 req-a444e69d-732d-42cf-8075-cbe09ff3ca1d service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:04.377727 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9d02ceca-a73b-45ad-83f8-c112cefa1c08 req-a444e69d-732d-42cf-8075-cbe09ff3ca1d service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:04.397544 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-9d02ceca-a73b-45ad-83f8-c112cefa1c08 req-a444e69d-732d-42cf-8075-cbe09ff3ca1d service nova] Creating event network-vif-plugged:38eb9476-6dba-4c83-886a-1e2f98837aa4 for instance 56c29b20-837e-4f90-9213-99699295a6af on n-h1-862686-1 Oct 26 13:27:04.406752 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-9d02ceca-a73b-45ad-83f8-c112cefa1c08 req-a444e69d-732d-42cf-8075-cbe09ff3ca1d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061275 Oct 26 13:27:04.408920 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2525/5061] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:27:04.812620 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-00ecc73c-196c-4fa7-9b1f-c83891f6f763 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f6731711790>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:04.918070 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f2d58a63-3b7e-4212-af19-47c3c0d1ab9c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:04.919391 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f2d58a63-3b7e-4212-af19-47c3c0d1ab9c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:04.929169 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-00ecc73c-196c-4fa7-9b1f-c83891f6f763 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082" status: 200 len: 1455 microversion: 2.1 time: 0.120378 Oct 26 13:27:04.940380 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2537/5062] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:04 2022] GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082 => generated 1455 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:04.973176 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2d58a63-3b7e-4212-af19-47c3c0d1ab9c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:04.976528 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2d58a63-3b7e-4212-af19-47c3c0d1ab9c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:04.979015 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2d58a63-3b7e-4212-af19-47c3c0d1ab9c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:04.980919 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2d58a63-3b7e-4212-af19-47c3c0d1ab9c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:04.983451 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2d58a63-3b7e-4212-af19-47c3c0d1ab9c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:04.986142 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2d58a63-3b7e-4212-af19-47c3c0d1ab9c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:05.727112 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f2d58a63-3b7e-4212-af19-47c3c0d1ab9c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:05.737293 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f2d58a63-3b7e-4212-af19-47c3c0d1ab9c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1668 microversion: 2.1 time: 0.829523 Oct 26 13:27:05.759576 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2526/5063] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:04 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1668 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:27:05.945161 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f3b4506c-0c29-4d10-9c7a-1a2581d868ca tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f6731716c10>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:06.043937 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f3b4506c-0c29-4d10-9c7a-1a2581d868ca tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082" status: 200 len: 1455 microversion: 2.1 time: 0.097177 Oct 26 13:27:06.052440 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2538/5064] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:05 2022] GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082 => generated 1455 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:06.775579 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-79972982-b8a7-4e12-9726-4d4e043ac9a6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:06.776367 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-79972982-b8a7-4e12-9726-4d4e043ac9a6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:06.790968 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-79972982-b8a7-4e12-9726-4d4e043ac9a6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:06.800537 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-79972982-b8a7-4e12-9726-4d4e043ac9a6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:06.801192 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-79972982-b8a7-4e12-9726-4d4e043ac9a6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:06.807190 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-79972982-b8a7-4e12-9726-4d4e043ac9a6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:06.808122 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-79972982-b8a7-4e12-9726-4d4e043ac9a6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:06.810199 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-79972982-b8a7-4e12-9726-4d4e043ac9a6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:06.963740 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fb932da8-147b-4be0-842e-413a55346bd7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-525425328", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "56363c00-6608-4ad0-9892-d3ecfbb7f0c5"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:27:07.121666 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-fb932da8-147b-4be0-842e-413a55346bd7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] validate_networks() for [('56363c00-6608-4ad0-9892-d3ecfbb7f0c5', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:27:07.705717 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-79972982-b8a7-4e12-9726-4d4e043ac9a6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:07.722796 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-79972982-b8a7-4e12-9726-4d4e043ac9a6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 0.950967 Oct 26 13:27:07.729375 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2539/5065] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:06 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:07.737945 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4036be92-d9ed-4068-bae6-e0fecba2f377 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f673680c700>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:07.838882 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4036be92-d9ed-4068-bae6-e0fecba2f377 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082" status: 200 len: 1455 microversion: 2.1 time: 0.108020 Oct 26 13:27:07.839575 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2540/5066] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:07 2022] GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082 => generated 1455 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:07.846163 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7e66f21d-7d87-41d9-b12c-8dfe426da965 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:27:07.858699 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7e66f21d-7d87-41d9-b12c-8dfe426da965 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:07.895477 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e66f21d-7d87-41d9-b12c-8dfe426da965 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:07.896152 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e66f21d-7d87-41d9-b12c-8dfe426da965 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:07.896707 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e66f21d-7d87-41d9-b12c-8dfe426da965 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:07.898283 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e66f21d-7d87-41d9-b12c-8dfe426da965 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:07.900225 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e66f21d-7d87-41d9-b12c-8dfe426da965 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:07.900806 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e66f21d-7d87-41d9-b12c-8dfe426da965 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:08.050819 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7e66f21d-7d87-41d9-b12c-8dfe426da965 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "POST /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa/action" status: 200 len: 321 microversion: 2.1 time: 0.198816 Oct 26 13:27:08.073782 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2541/5067] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:27:07 2022] POST /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa/action => generated 321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:27:08.092528 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-78f14f3d-971b-4511-849e-2cf5c051d2ff tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:08.094041 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-78f14f3d-971b-4511-849e-2cf5c051d2ff tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:08.123636 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78f14f3d-971b-4511-849e-2cf5c051d2ff tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:08.124443 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78f14f3d-971b-4511-849e-2cf5c051d2ff tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:08.127525 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78f14f3d-971b-4511-849e-2cf5c051d2ff tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:08.131554 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78f14f3d-971b-4511-849e-2cf5c051d2ff tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:08.133985 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78f14f3d-971b-4511-849e-2cf5c051d2ff tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:08.137391 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78f14f3d-971b-4511-849e-2cf5c051d2ff tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:08.786464 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-78f14f3d-971b-4511-849e-2cf5c051d2ff tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:08.798004 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-78f14f3d-971b-4511-849e-2cf5c051d2ff tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 0.715563 Oct 26 13:27:08.799267 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2542/5068] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:08 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:08.827191 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-59c91992-8d89-4e14-acff-46d7095ab4b8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:08.831875 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-59c91992-8d89-4e14-acff-46d7095ab4b8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:08.852830 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-59c91992-8d89-4e14-acff-46d7095ab4b8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:08.859234 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-59c91992-8d89-4e14-acff-46d7095ab4b8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:08.860047 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-59c91992-8d89-4e14-acff-46d7095ab4b8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:08.863161 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-59c91992-8d89-4e14-acff-46d7095ab4b8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:08.864424 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-59c91992-8d89-4e14-acff-46d7095ab4b8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:08.865248 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-59c91992-8d89-4e14-acff-46d7095ab4b8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:09.406276 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-59c91992-8d89-4e14-acff-46d7095ab4b8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:09.422329 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-59c91992-8d89-4e14-acff-46d7095ab4b8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 0.600039 Oct 26 13:27:09.425625 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2543/5069] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:08 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:27:09.441730 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0f013bff-e3aa-4c6c-b89a-9fe5f257de5e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67318e0ee0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:09.540688 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0f013bff-e3aa-4c6c-b89a-9fe5f257de5e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082" status: 200 len: 1455 microversion: 2.1 time: 0.113415 Oct 26 13:27:09.541283 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2544/5070] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:09 2022] GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082 => generated 1455 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:09.566601 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-05adcc21-79fb-4ee6-b755-105e283cdc0e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:09.567428 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-05adcc21-79fb-4ee6-b755-105e283cdc0e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:09.590192 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05adcc21-79fb-4ee6-b755-105e283cdc0e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:09.594412 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05adcc21-79fb-4ee6-b755-105e283cdc0e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:09.596152 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05adcc21-79fb-4ee6-b755-105e283cdc0e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:09.597952 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05adcc21-79fb-4ee6-b755-105e283cdc0e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:09.604642 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05adcc21-79fb-4ee6-b755-105e283cdc0e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:09.606247 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05adcc21-79fb-4ee6-b755-105e283cdc0e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:09.863856 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-fb932da8-147b-4be0-842e-413a55346bd7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:27:09.865055 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-fb932da8-147b-4be0-842e-413a55346bd7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:27:09.865735 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-fb932da8-147b-4be0-842e-413a55346bd7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:27:09.866335 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-fb932da8-147b-4be0-842e-413a55346bd7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:27:09.866937 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-fb932da8-147b-4be0-842e-413a55346bd7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:27:09.897743 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fb932da8-147b-4be0-842e-413a55346bd7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:09.898236 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fb932da8-147b-4be0-842e-413a55346bd7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:09.898677 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fb932da8-147b-4be0-842e-413a55346bd7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:09.899406 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fb932da8-147b-4be0-842e-413a55346bd7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:09.899864 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fb932da8-147b-4be0-842e-413a55346bd7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:09.900292 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fb932da8-147b-4be0-842e-413a55346bd7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:09.947290 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-fb932da8-147b-4be0-842e-413a55346bd7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Getting quotas for project 088eb22706844984b58fe118d5421cbb. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:27:09.961142 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-fb932da8-147b-4be0-842e-413a55346bd7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Getting quotas for user 9b8db27e3baf4b6a948f6d23c04cf680 and project 088eb22706844984b58fe118d5421cbb. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:27:10.005554 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fb932da8-147b-4be0-842e-413a55346bd7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:27:10.019292 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fb932da8-147b-4be0-842e-413a55346bd7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:27:10.224942 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-05adcc21-79fb-4ee6-b755-105e283cdc0e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:10.230249 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:27:10.250471 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-05adcc21-79fb-4ee6-b755-105e283cdc0e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 0.703258 Oct 26 13:27:10.258303 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2545/5071] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:09 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:10.282122 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fb932da8-147b-4be0-842e-413a55346bd7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.975831 Oct 26 13:27:10.285934 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2d192e51-d6c3-463d-972f-b4627ab0d7f6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:10.289111 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2527/5072] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:27:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 3984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:27:10.289596 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2d192e51-d6c3-463d-972f-b4627ab0d7f6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:10.306771 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d192e51-d6c3-463d-972f-b4627ab0d7f6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:10.310094 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d192e51-d6c3-463d-972f-b4627ab0d7f6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:10.313211 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d192e51-d6c3-463d-972f-b4627ab0d7f6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:10.318061 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-75e9c1ec-69e9-4996-85e5-ef58f392d381 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:10.318885 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-75e9c1ec-69e9-4996-85e5-ef58f392d381 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:10.319891 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d192e51-d6c3-463d-972f-b4627ab0d7f6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:10.320682 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d192e51-d6c3-463d-972f-b4627ab0d7f6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:10.325718 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d192e51-d6c3-463d-972f-b4627ab0d7f6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:10.572618 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-75e9c1ec-69e9-4996-85e5-ef58f392d381 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:10.587362 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-75e9c1ec-69e9-4996-85e5-ef58f392d381 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1216 microversion: 2.1 time: 0.289548 Oct 26 13:27:10.597056 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2528/5073] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:10 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1216 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:10.609623 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4dcc0dda-796e-4c68-b421-eda74c19ebd5 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f673278eb80>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:10.716199 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4dcc0dda-796e-4c68-b421-eda74c19ebd5 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082" status: 200 len: 1455 microversion: 2.1 time: 0.117878 Oct 26 13:27:10.728827 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2529/5074] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:10 2022] GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082 => generated 1455 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:11.614985 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-eb6ba76c-6040-40b2-b590-9885292847ab tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:11.615870 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-eb6ba76c-6040-40b2-b590-9885292847ab tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:11.770276 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2d192e51-d6c3-463d-972f-b4627ab0d7f6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:11.783139 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2d192e51-d6c3-463d-972f-b4627ab0d7f6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 1.506310 Oct 26 13:27:11.783742 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2546/5075] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:10 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:11.888903 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-eaf8c07a-e224-4c00-a117-2f41b944501d tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f6732a8f280>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:12.106413 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-eaf8c07a-e224-4c00-a117-2f41b944501d tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082" status: 200 len: 1455 microversion: 2.1 time: 0.253630 Oct 26 13:27:12.126456 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2547/5076] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:11 2022] GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082 => generated 1455 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:12.184528 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-eb6ba76c-6040-40b2-b590-9885292847ab tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:12.202214 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-eb6ba76c-6040-40b2-b590-9885292847ab tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1216 microversion: 2.1 time: 0.593265 Oct 26 13:27:12.219836 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2530/5077] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:11 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1216 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:27:12.697277 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4c331aa1-00be-43be-bbba-08e227e478b7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-670253597", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "52e622a6-1003-4403-bde9-f622c42344c6"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:27:12.831236 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-4c331aa1-00be-43be-bbba-08e227e478b7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] validate_networks() for [('52e622a6-1003-4403-bde9-f622c42344c6', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:27:13.143290 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a05a0933-19a2-4161-b5c6-3cf08307a6af tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f673274d310>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:13.274804 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a05a0933-19a2-4161-b5c6-3cf08307a6af tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082" status: 200 len: 1455 microversion: 2.1 time: 0.137185 Oct 26 13:27:13.275389 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2531/5078] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:13 2022] GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082 => generated 1455 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:13.281689 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ea722032-79b6-44e2-8c4d-3c214772b7ea tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:13.282158 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ea722032-79b6-44e2-8c4d-3c214772b7ea tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:13.310010 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ea722032-79b6-44e2-8c4d-3c214772b7ea tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:13.316871 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ea722032-79b6-44e2-8c4d-3c214772b7ea tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:13.317415 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ea722032-79b6-44e2-8c4d-3c214772b7ea tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:13.318211 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ea722032-79b6-44e2-8c4d-3c214772b7ea tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:13.318801 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ea722032-79b6-44e2-8c4d-3c214772b7ea tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:13.326766 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ea722032-79b6-44e2-8c4d-3c214772b7ea tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:13.926892 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ea722032-79b6-44e2-8c4d-3c214772b7ea tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:13.936470 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ea722032-79b6-44e2-8c4d-3c214772b7ea tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1268 microversion: 2.1 time: 0.659666 Oct 26 13:27:13.944286 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2532/5079] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:13 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1268 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:14.290579 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7b3cd48f-cfe7-4c2f-b7cc-4254ce181170 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f6731b1fe50>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:14.367958 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-4c331aa1-00be-43be-bbba-08e227e478b7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:27:14.368897 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-4c331aa1-00be-43be-bbba-08e227e478b7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:27:14.369644 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-4c331aa1-00be-43be-bbba-08e227e478b7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:27:14.370215 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-4c331aa1-00be-43be-bbba-08e227e478b7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:27:14.370786 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-4c331aa1-00be-43be-bbba-08e227e478b7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:27:14.389357 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7b3cd48f-cfe7-4c2f-b7cc-4254ce181170 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082" status: 200 len: 1455 microversion: 2.1 time: 0.102235 Oct 26 13:27:14.393036 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2533/5080] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:14 2022] GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082 => generated 1455 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:27:14.395622 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c331aa1-00be-43be-bbba-08e227e478b7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:14.398040 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c331aa1-00be-43be-bbba-08e227e478b7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:14.400200 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c331aa1-00be-43be-bbba-08e227e478b7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:14.401300 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c331aa1-00be-43be-bbba-08e227e478b7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:14.403023 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c331aa1-00be-43be-bbba-08e227e478b7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:14.404546 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c331aa1-00be-43be-bbba-08e227e478b7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:14.479885 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-4c331aa1-00be-43be-bbba-08e227e478b7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Getting quotas for project c0d1b1d2fe374ee5806eeee18712219f. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:27:14.525817 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-4c331aa1-00be-43be-bbba-08e227e478b7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Getting quotas for user 3e9ff5a884f1416886f26a80c5b87b18 and project c0d1b1d2fe374ee5806eeee18712219f. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:27:14.629932 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4c331aa1-00be-43be-bbba-08e227e478b7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:27:14.632689 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4c331aa1-00be-43be-bbba-08e227e478b7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: af89aa4e-9f0c-48c6-adc7-6b2f72601f8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:27:14.930421 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4c331aa1-00be-43be-bbba-08e227e478b7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.238171 Oct 26 13:27:14.934769 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2548/5081] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:27:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2242 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:27:14.956764 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f963d7fe-bc66-4b5b-ae72-6428ad634c52 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:14.957291 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f963d7fe-bc66-4b5b-ae72-6428ad634c52 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: af89aa4e-9f0c-48c6-adc7-6b2f72601f8f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:14.963372 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c07ee195-d94f-4b3f-abb3-2e963b14a4a4 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:14.964413 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c07ee195-d94f-4b3f-abb3-2e963b14a4a4 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:14.979712 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c07ee195-d94f-4b3f-abb3-2e963b14a4a4 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:14.985410 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c07ee195-d94f-4b3f-abb3-2e963b14a4a4 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:14.988183 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c07ee195-d94f-4b3f-abb3-2e963b14a4a4 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:14.990116 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c07ee195-d94f-4b3f-abb3-2e963b14a4a4 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:14.990854 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c07ee195-d94f-4b3f-abb3-2e963b14a4a4 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:14.993571 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c07ee195-d94f-4b3f-abb3-2e963b14a4a4 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:15.209217 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c07ee195-d94f-4b3f-abb3-2e963b14a4a4 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:15.227042 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c07ee195-d94f-4b3f-abb3-2e963b14a4a4 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1274 microversion: 2.1 time: 0.263639 Oct 26 13:27:15.227976 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2549/5082] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:14 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1274 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:15.335161 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f963d7fe-bc66-4b5b-ae72-6428ad634c52 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:15.349621 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f963d7fe-bc66-4b5b-ae72-6428ad634c52 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f" status: 200 len: 1214 microversion: 2.1 time: 0.407453 Oct 26 13:27:15.352450 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2534/5083] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:14 2022] GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f => generated 1214 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:15.410515 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f19d81e9-f07f-4ce0-b04d-000404a484d2 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f673680c700>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:15.499649 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f19d81e9-f07f-4ce0-b04d-000404a484d2 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082" status: 200 len: 1455 microversion: 2.1 time: 0.095312 Oct 26 13:27:15.512059 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2550/5084] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:15 2022] GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082 => generated 1455 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:16.258644 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-05b08963-e8c8-478e-84d4-feb09a3b4af3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:16.259251 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-05b08963-e8c8-478e-84d4-feb09a3b4af3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:16.261261 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:27:16.299541 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05b08963-e8c8-478e-84d4-feb09a3b4af3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:16.311068 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05b08963-e8c8-478e-84d4-feb09a3b4af3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:16.316819 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05b08963-e8c8-478e-84d4-feb09a3b4af3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:16.322900 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05b08963-e8c8-478e-84d4-feb09a3b4af3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:16.323403 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05b08963-e8c8-478e-84d4-feb09a3b4af3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:16.323849 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05b08963-e8c8-478e-84d4-feb09a3b4af3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:16.379704 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f4a1f459-6fe6-4cd1-9169-0f803bb94dc6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:16.380230 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f4a1f459-6fe6-4cd1-9169-0f803bb94dc6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: af89aa4e-9f0c-48c6-adc7-6b2f72601f8f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:16.411933 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4a1f459-6fe6-4cd1-9169-0f803bb94dc6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:16.412625 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4a1f459-6fe6-4cd1-9169-0f803bb94dc6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:16.412921 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4a1f459-6fe6-4cd1-9169-0f803bb94dc6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:16.413716 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4a1f459-6fe6-4cd1-9169-0f803bb94dc6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:16.414175 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4a1f459-6fe6-4cd1-9169-0f803bb94dc6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:16.414599 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4a1f459-6fe6-4cd1-9169-0f803bb94dc6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:16.618668 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f4a1f459-6fe6-4cd1-9169-0f803bb94dc6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:16.627780 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f4a1f459-6fe6-4cd1-9169-0f803bb94dc6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f" status: 200 len: 1210 microversion: 2.1 time: 0.252885 Oct 26 13:27:16.634762 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2551/5085] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:16 2022] GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f => generated 1210 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:27:16.649048 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5f4a59cf-86d1-4bf8-9020-50e2e2f5a4a7 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67367f4790>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:16.784102 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5f4a59cf-86d1-4bf8-9020-50e2e2f5a4a7 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082" status: 200 len: 1455 microversion: 2.1 time: 0.147717 Oct 26 13:27:16.784702 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2552/5086] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:16 2022] GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082 => generated 1455 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:16.803683 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-05b08963-e8c8-478e-84d4-feb09a3b4af3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:16.814578 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-05b08963-e8c8-478e-84d4-feb09a3b4af3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1274 microversion: 2.1 time: 0.562648 Oct 26 13:27:16.832994 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2535/5087] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:16 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1274 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:17.663475 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ea68c86c-32ad-440a-ae1f-3f99c80e83c3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:17.665067 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ea68c86c-32ad-440a-ae1f-3f99c80e83c3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: af89aa4e-9f0c-48c6-adc7-6b2f72601f8f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:17.679537 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:27:17.681222 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ea68c86c-32ad-440a-ae1f-3f99c80e83c3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:17.698312 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ea68c86c-32ad-440a-ae1f-3f99c80e83c3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:17.698848 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ea68c86c-32ad-440a-ae1f-3f99c80e83c3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:17.708857 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ea68c86c-32ad-440a-ae1f-3f99c80e83c3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:17.709368 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ea68c86c-32ad-440a-ae1f-3f99c80e83c3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:17.709874 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ea68c86c-32ad-440a-ae1f-3f99c80e83c3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:17.799669 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ce0d09f2-9444-42cc-a81f-179b73dcaba9 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f673197d3a0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:17.896258 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ce0d09f2-9444-42cc-a81f-179b73dcaba9 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082" status: 200 len: 1455 microversion: 2.1 time: 0.101290 Oct 26 13:27:17.896867 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2536/5088] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:17 2022] GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082 => generated 1455 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:17.927804 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bfc950f7-aead-4280-9299-d1be78518446 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:17.938543 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bfc950f7-aead-4280-9299-d1be78518446 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:17.991121 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bfc950f7-aead-4280-9299-d1be78518446 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:17.991629 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bfc950f7-aead-4280-9299-d1be78518446 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:17.992079 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bfc950f7-aead-4280-9299-d1be78518446 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:18.007042 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bfc950f7-aead-4280-9299-d1be78518446 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:18.007599 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bfc950f7-aead-4280-9299-d1be78518446 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:18.011351 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bfc950f7-aead-4280-9299-d1be78518446 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:18.112148 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ea68c86c-32ad-440a-ae1f-3f99c80e83c3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:18.129879 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ea68c86c-32ad-440a-ae1f-3f99c80e83c3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f" status: 200 len: 1274 microversion: 2.1 time: 0.463256 Oct 26 13:27:18.130569 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2553/5089] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:17 2022] GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f => generated 1274 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:18.916167 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2ad3d314-b99d-46a2-8d27-08aa64e8efc6 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67367f4a60>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:19.040886 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2ad3d314-b99d-46a2-8d27-08aa64e8efc6 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082" status: 200 len: 1455 microversion: 2.1 time: 0.130747 Oct 26 13:27:19.045761 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2554/5090] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:18 2022] GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082 => generated 1455 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:19.158011 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3090f791-541a-4b6c-917a-ba90829bee03 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:19.160460 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3090f791-541a-4b6c-917a-ba90829bee03 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: af89aa4e-9f0c-48c6-adc7-6b2f72601f8f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:19.183451 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3090f791-541a-4b6c-917a-ba90829bee03 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:19.183789 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3090f791-541a-4b6c-917a-ba90829bee03 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:19.184260 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3090f791-541a-4b6c-917a-ba90829bee03 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:19.188009 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3090f791-541a-4b6c-917a-ba90829bee03 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:19.189277 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3090f791-541a-4b6c-917a-ba90829bee03 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:19.190441 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3090f791-541a-4b6c-917a-ba90829bee03 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:19.433462 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bfc950f7-aead-4280-9299-d1be78518446 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:19.448622 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bfc950f7-aead-4280-9299-d1be78518446 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1316 microversion: 2.1 time: 1.550626 Oct 26 13:27:19.449226 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2537/5091] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:17 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1316 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:20.056555 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-14ead296-05d5-4796-aa54-a1d8e6f4c63a tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f673275c550>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:20.096303 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:27:20.131220 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-14ead296-05d5-4796-aa54-a1d8e6f4c63a tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082" status: 200 len: 1455 microversion: 2.1 time: 0.078714 Oct 26 13:27:20.141204 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2538/5092] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:20 2022] GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082 => generated 1455 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:20.207365 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3090f791-541a-4b6c-917a-ba90829bee03 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:20.224871 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3090f791-541a-4b6c-917a-ba90829bee03 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f" status: 200 len: 1272 microversion: 2.1 time: 1.071144 Oct 26 13:27:20.228222 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2555/5093] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:19 2022] GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f => generated 1272 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:27:20.479245 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e9789acb-c36d-41dd-9402-1a1fc45f17d0 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:20.480569 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e9789acb-c36d-41dd-9402-1a1fc45f17d0 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:20.503102 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e9789acb-c36d-41dd-9402-1a1fc45f17d0 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:20.504987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e9789acb-c36d-41dd-9402-1a1fc45f17d0 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:20.505756 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e9789acb-c36d-41dd-9402-1a1fc45f17d0 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:20.514957 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e9789acb-c36d-41dd-9402-1a1fc45f17d0 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:20.515794 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e9789acb-c36d-41dd-9402-1a1fc45f17d0 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:20.516550 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e9789acb-c36d-41dd-9402-1a1fc45f17d0 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:21.148918 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5ed22893-5cd4-4c2c-b4e3-953ff2af73d6 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67317ec790>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:21.239392 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5ed22893-5cd4-4c2c-b4e3-953ff2af73d6 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082" status: 200 len: 1455 microversion: 2.1 time: 0.094950 Oct 26 13:27:21.246689 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2556/5094] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:21 2022] GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082 => generated 1455 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:27:21.261794 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-12a9264e-0757-46cd-8487-1451b4776c8d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:21.262852 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-12a9264e-0757-46cd-8487-1451b4776c8d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: af89aa4e-9f0c-48c6-adc7-6b2f72601f8f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:21.274122 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-12a9264e-0757-46cd-8487-1451b4776c8d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:21.276775 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-12a9264e-0757-46cd-8487-1451b4776c8d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:21.277586 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-12a9264e-0757-46cd-8487-1451b4776c8d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:21.280061 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-12a9264e-0757-46cd-8487-1451b4776c8d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:21.283176 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-12a9264e-0757-46cd-8487-1451b4776c8d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:21.283638 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-12a9264e-0757-46cd-8487-1451b4776c8d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:21.537627 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-12a9264e-0757-46cd-8487-1451b4776c8d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:21.557000 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-12a9264e-0757-46cd-8487-1451b4776c8d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f" status: 200 len: 1272 microversion: 2.1 time: 0.293301 Oct 26 13:27:21.562622 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2557/5095] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:21 2022] GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f => generated 1272 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:27:21.976644 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e9789acb-c36d-41dd-9402-1a1fc45f17d0 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:21.988660 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e9789acb-c36d-41dd-9402-1a1fc45f17d0 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1316 microversion: 2.1 time: 1.511278 Oct 26 13:27:21.989708 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2539/5096] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:20 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1316 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:22.260901 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8ad921e9-30e6-4d5e-8e7e-aa26f4cd33b6 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f6732442dc0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:22.347408 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8ad921e9-30e6-4d5e-8e7e-aa26f4cd33b6 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082" status: 200 len: 1455 microversion: 2.1 time: 0.090263 Oct 26 13:27:22.348299 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2558/5097] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:22 2022] GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082 => generated 1455 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:22.584695 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-38ba0273-47e5-461c-8a47-fcb7b27cf349 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:22.585913 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-38ba0273-47e5-461c-8a47-fcb7b27cf349 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: af89aa4e-9f0c-48c6-adc7-6b2f72601f8f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:22.611882 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38ba0273-47e5-461c-8a47-fcb7b27cf349 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:22.615174 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38ba0273-47e5-461c-8a47-fcb7b27cf349 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:22.642762 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38ba0273-47e5-461c-8a47-fcb7b27cf349 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:22.642762 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38ba0273-47e5-461c-8a47-fcb7b27cf349 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:22.643404 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38ba0273-47e5-461c-8a47-fcb7b27cf349 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:22.646830 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38ba0273-47e5-461c-8a47-fcb7b27cf349 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:22.886793 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-38ba0273-47e5-461c-8a47-fcb7b27cf349 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:22.907122 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-38ba0273-47e5-461c-8a47-fcb7b27cf349 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f" status: 200 len: 1272 microversion: 2.1 time: 0.326477 Oct 26 13:27:22.931141 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2540/5098] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:22 2022] GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f => generated 1272 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:23.019124 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f0b350dc-7cc1-4d5c-8861-c7e3dabcd0b1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:23.019742 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f0b350dc-7cc1-4d5c-8861-c7e3dabcd0b1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:23.037908 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0b350dc-7cc1-4d5c-8861-c7e3dabcd0b1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:23.039220 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0b350dc-7cc1-4d5c-8861-c7e3dabcd0b1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:23.039619 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0b350dc-7cc1-4d5c-8861-c7e3dabcd0b1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:23.040347 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0b350dc-7cc1-4d5c-8861-c7e3dabcd0b1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:23.040816 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0b350dc-7cc1-4d5c-8861-c7e3dabcd0b1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:23.041264 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f0b350dc-7cc1-4d5c-8861-c7e3dabcd0b1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:23.368435 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-80ca750d-e470-415d-baaf-5fa8ff84fa8a tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f6732262a60>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:23.465434 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-80ca750d-e470-415d-baaf-5fa8ff84fa8a tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082" status: 200 len: 1455 microversion: 2.1 time: 0.102843 Oct 26 13:27:23.484866 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2541/5099] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:23 2022] GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082 => generated 1455 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:27:23.723671 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-2798cedb-9f03-421f-9d8a-a02706754fee req-8600ead6-3746-4b39-a232-1af33228ecc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f573d46e-77d2-4405-baef-2bb447d4b5e7", "tag": "1a81eb96-6bc8-4bfb-8326-14785f0a363d"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:27:23.756180 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2798cedb-9f03-421f-9d8a-a02706754fee req-8600ead6-3746-4b39-a232-1af33228ecc8 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:23.759515 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2798cedb-9f03-421f-9d8a-a02706754fee req-8600ead6-3746-4b39-a232-1af33228ecc8 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:23.761787 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2798cedb-9f03-421f-9d8a-a02706754fee req-8600ead6-3746-4b39-a232-1af33228ecc8 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:23.808394 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f0b350dc-7cc1-4d5c-8861-c7e3dabcd0b1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:23.814601 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-2798cedb-9f03-421f-9d8a-a02706754fee req-8600ead6-3746-4b39-a232-1af33228ecc8 service nova] Creating event network-changed:1a81eb96-6bc8-4bfb-8326-14785f0a363d for instance f573d46e-77d2-4405-baef-2bb447d4b5e7 on n-h2-862686-1 Oct 26 13:27:23.826762 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f0b350dc-7cc1-4d5c-8861-c7e3dabcd0b1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1316 microversion: 2.1 time: 0.808692 Oct 26 13:27:23.829719 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2559/5100] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:23 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1316 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:23.852420 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-2798cedb-9f03-421f-9d8a-a02706754fee req-8600ead6-3746-4b39-a232-1af33228ecc8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132800 Oct 26 13:27:23.859023 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2542/5101] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:27:23.939294 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fdda464e-d64e-4a82-894b-6d99a99b0fb5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:23.940085 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fdda464e-d64e-4a82-894b-6d99a99b0fb5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: af89aa4e-9f0c-48c6-adc7-6b2f72601f8f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:23.954446 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fdda464e-d64e-4a82-894b-6d99a99b0fb5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:23.956499 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fdda464e-d64e-4a82-894b-6d99a99b0fb5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:23.960603 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fdda464e-d64e-4a82-894b-6d99a99b0fb5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:23.962689 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fdda464e-d64e-4a82-894b-6d99a99b0fb5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:23.967778 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fdda464e-d64e-4a82-894b-6d99a99b0fb5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:23.968511 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fdda464e-d64e-4a82-894b-6d99a99b0fb5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:24.428174 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:27:24.483711 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f3322db7-7e34-44b5-9fcd-62109cc429fb tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67319d6040>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:24.571450 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:27:24.604291 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f3322db7-7e34-44b5-9fcd-62109cc429fb tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082" status: 200 len: 1455 microversion: 2.1 time: 0.125543 Oct 26 13:27:24.605347 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2543/5102] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:24 2022] GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082 => generated 1455 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:24.811193 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fdda464e-d64e-4a82-894b-6d99a99b0fb5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:24.820896 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fdda464e-d64e-4a82-894b-6d99a99b0fb5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f" status: 200 len: 1314 microversion: 2.1 time: 0.886205 Oct 26 13:27:24.827827 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2560/5103] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:23 2022] GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f => generated 1314 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:24.858507 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dd39ec44-713f-4f63-a2b2-8ac865294674 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:24.859426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-dd39ec44-713f-4f63-a2b2-8ac865294674 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:24.884233 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd39ec44-713f-4f63-a2b2-8ac865294674 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:24.895190 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd39ec44-713f-4f63-a2b2-8ac865294674 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:24.898559 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd39ec44-713f-4f63-a2b2-8ac865294674 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:24.900110 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd39ec44-713f-4f63-a2b2-8ac865294674 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:24.903233 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd39ec44-713f-4f63-a2b2-8ac865294674 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:24.908418 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd39ec44-713f-4f63-a2b2-8ac865294674 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:25.340577 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=12 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:27:25.620101 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3ce2a5f3-5b61-4906-8c3f-6307c17fe47d tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67317ec790>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:25.757764 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3ce2a5f3-5b61-4906-8c3f-6307c17fe47d tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082" status: 200 len: 1455 microversion: 2.1 time: 0.141423 Oct 26 13:27:25.758924 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2561/5104] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:25 2022] GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082 => generated 1455 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:27:25.860586 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a1619185-5022-4147-abfd-792a27a17202 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:25.861242 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a1619185-5022-4147-abfd-792a27a17202 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: af89aa4e-9f0c-48c6-adc7-6b2f72601f8f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:25.880839 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a1619185-5022-4147-abfd-792a27a17202 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:25.883431 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a1619185-5022-4147-abfd-792a27a17202 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:25.884081 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a1619185-5022-4147-abfd-792a27a17202 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:25.887397 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a1619185-5022-4147-abfd-792a27a17202 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:25.888647 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a1619185-5022-4147-abfd-792a27a17202 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:25.889521 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a1619185-5022-4147-abfd-792a27a17202 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:26.298526 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a1619185-5022-4147-abfd-792a27a17202 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:26.315120 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a1619185-5022-4147-abfd-792a27a17202 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f" status: 200 len: 1314 microversion: 2.1 time: 0.454114 Oct 26 13:27:26.315961 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2562/5105] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:25 2022] GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f => generated 1314 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:27:26.773895 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1e692da3-436e-42cd-91e7-8b15332fe34e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f673241b310>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:26.885049 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1e692da3-436e-42cd-91e7-8b15332fe34e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082" status: 200 len: 1455 microversion: 2.1 time: 0.115130 Oct 26 13:27:26.885676 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2563/5106] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:26 2022] GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082 => generated 1455 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:27:27.344725 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-70ad52ae-bb7d-4bef-991a-89cbcb6aef7e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:27.345769 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-70ad52ae-bb7d-4bef-991a-89cbcb6aef7e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: af89aa4e-9f0c-48c6-adc7-6b2f72601f8f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:27.370081 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70ad52ae-bb7d-4bef-991a-89cbcb6aef7e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:27.376836 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70ad52ae-bb7d-4bef-991a-89cbcb6aef7e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:27.379488 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70ad52ae-bb7d-4bef-991a-89cbcb6aef7e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:27.381356 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70ad52ae-bb7d-4bef-991a-89cbcb6aef7e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:27.384254 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70ad52ae-bb7d-4bef-991a-89cbcb6aef7e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:27.385054 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70ad52ae-bb7d-4bef-991a-89cbcb6aef7e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:27.573025 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-dd39ec44-713f-4f63-a2b2-8ac865294674 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:27.582056 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-dd39ec44-713f-4f63-a2b2-8ac865294674 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1316 microversion: 2.1 time: 2.729887 Oct 26 13:27:27.613361 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2544/5107] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:24 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1316 bytes in 2762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:27.790970 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-70ad52ae-bb7d-4bef-991a-89cbcb6aef7e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:27.805895 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-70ad52ae-bb7d-4bef-991a-89cbcb6aef7e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f" status: 200 len: 1314 microversion: 2.1 time: 0.462733 Oct 26 13:27:27.823080 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2564/5108] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:27 2022] GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f => generated 1314 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:27.902319 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1a7c8245-7bb0-4526-80c9-46b475f7c2bd tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f6731a6c040>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:28.047013 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1a7c8245-7bb0-4526-80c9-46b475f7c2bd tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082" status: 200 len: 1455 microversion: 2.1 time: 0.137281 Oct 26 13:27:28.058558 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2545/5109] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:27 2022] GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082 => generated 1455 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:28.550654 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-58409f1b-e7b2-474f-ba06-39387a3cad71 req-310d5e88-a9ee-4a01-9030-0136b59f895d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af89aa4e-9f0c-48c6-adc7-6b2f72601f8f", "tag": "b80d7d4b-25f1-411b-9943-c31beebd5488"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:27:28.574629 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-58409f1b-e7b2-474f-ba06-39387a3cad71 req-310d5e88-a9ee-4a01-9030-0136b59f895d service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:28.581256 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-58409f1b-e7b2-474f-ba06-39387a3cad71 req-310d5e88-a9ee-4a01-9030-0136b59f895d service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:28.583286 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-58409f1b-e7b2-474f-ba06-39387a3cad71 req-310d5e88-a9ee-4a01-9030-0136b59f895d service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:28.610811 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-856b121b-af93-4c56-8120-cc9e371e98ae tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:28.611417 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-856b121b-af93-4c56-8120-cc9e371e98ae tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:28.620462 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-856b121b-af93-4c56-8120-cc9e371e98ae tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:28.630244 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-856b121b-af93-4c56-8120-cc9e371e98ae tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:28.633880 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-856b121b-af93-4c56-8120-cc9e371e98ae tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:28.643504 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-856b121b-af93-4c56-8120-cc9e371e98ae tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:28.645681 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-856b121b-af93-4c56-8120-cc9e371e98ae tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:28.647631 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-856b121b-af93-4c56-8120-cc9e371e98ae tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:28.662090 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-58409f1b-e7b2-474f-ba06-39387a3cad71 req-310d5e88-a9ee-4a01-9030-0136b59f895d service nova] Creating event network-changed:b80d7d4b-25f1-411b-9943-c31beebd5488 for instance af89aa4e-9f0c-48c6-adc7-6b2f72601f8f on n-h2-862686-1 Oct 26 13:27:28.691851 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-58409f1b-e7b2-474f-ba06-39387a3cad71 req-310d5e88-a9ee-4a01-9030-0136b59f895d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142478 Oct 26 13:27:28.698003 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2565/5110] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 26 13:27:28.839302 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1275cd56-ef64-4fc4-bd46-7da20c23d244 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:28.840926 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1275cd56-ef64-4fc4-bd46-7da20c23d244 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: af89aa4e-9f0c-48c6-adc7-6b2f72601f8f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:28.870647 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1275cd56-ef64-4fc4-bd46-7da20c23d244 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:28.872282 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1275cd56-ef64-4fc4-bd46-7da20c23d244 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:28.876812 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1275cd56-ef64-4fc4-bd46-7da20c23d244 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:28.879243 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1275cd56-ef64-4fc4-bd46-7da20c23d244 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:28.882414 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1275cd56-ef64-4fc4-bd46-7da20c23d244 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:28.893790 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1275cd56-ef64-4fc4-bd46-7da20c23d244 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:29.371859 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1275cd56-ef64-4fc4-bd46-7da20c23d244 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:29.381230 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1275cd56-ef64-4fc4-bd46-7da20c23d244 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f" status: 200 len: 1314 microversion: 2.1 time: 0.548792 Oct 26 13:27:29.391934 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2566/5111] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:28 2022] GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f => generated 1314 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:27:29.422481 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-001e5177-6ffc-49b9-9e28-13d9d19f108e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67316d4a60>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:29.529875 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-001e5177-6ffc-49b9-9e28-13d9d19f108e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082" status: 200 len: 1455 microversion: 2.1 time: 0.133193 Oct 26 13:27:29.530401 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2567/5112] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:29 2022] GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082 => generated 1455 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:29.772524 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-856b121b-af93-4c56-8120-cc9e371e98ae tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:29.788181 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-856b121b-af93-4c56-8120-cc9e371e98ae tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1316 microversion: 2.1 time: 1.178002 Oct 26 13:27:29.792213 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2546/5113] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:28 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1316 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:27:30.416289 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-275e16c7-1a59-43b6-874f-5b90ac264c36 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:30.417748 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-275e16c7-1a59-43b6-874f-5b90ac264c36 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: af89aa4e-9f0c-48c6-adc7-6b2f72601f8f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:30.453729 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-275e16c7-1a59-43b6-874f-5b90ac264c36 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:30.454653 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-275e16c7-1a59-43b6-874f-5b90ac264c36 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:30.457647 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-275e16c7-1a59-43b6-874f-5b90ac264c36 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:30.462134 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-275e16c7-1a59-43b6-874f-5b90ac264c36 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:30.464180 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-275e16c7-1a59-43b6-874f-5b90ac264c36 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:30.464848 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-275e16c7-1a59-43b6-874f-5b90ac264c36 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:30.549854 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f9b10e83-28a7-4ce6-ac1f-c3cf36b269c9 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f673196e430>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:30.703184 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f9b10e83-28a7-4ce6-ac1f-c3cf36b269c9 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082" status: 200 len: 1455 microversion: 2.1 time: 0.159358 Oct 26 13:27:30.711229 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2547/5114] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:30 2022] GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082 => generated 1455 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:27:30.822061 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fd69a346-6cff-4d33-93ae-99b1aadd5b25 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:30.822705 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fd69a346-6cff-4d33-93ae-99b1aadd5b25 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:30.848603 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd69a346-6cff-4d33-93ae-99b1aadd5b25 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:30.858065 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd69a346-6cff-4d33-93ae-99b1aadd5b25 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:30.858551 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd69a346-6cff-4d33-93ae-99b1aadd5b25 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:30.862158 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd69a346-6cff-4d33-93ae-99b1aadd5b25 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:30.862661 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd69a346-6cff-4d33-93ae-99b1aadd5b25 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:30.869462 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd69a346-6cff-4d33-93ae-99b1aadd5b25 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:31.080389 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-275e16c7-1a59-43b6-874f-5b90ac264c36 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:31.120676 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-275e16c7-1a59-43b6-874f-5b90ac264c36 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f" status: 200 len: 1314 microversion: 2.1 time: 0.706387 Oct 26 13:27:31.129519 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2568/5115] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:30 2022] GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f => generated 1314 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:31.721628 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0113a7fc-96c4-4a4c-8a79-afccc8f7abb1 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67316d40d0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:31.826888 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0113a7fc-96c4-4a4c-8a79-afccc8f7abb1 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082" status: 200 len: 1455 microversion: 2.1 time: 0.109171 Oct 26 13:27:31.841663 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2569/5116] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:31 2022] GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082 => generated 1455 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:32.145090 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-30d2a306-ded6-4593-8ed2-709bfdcc6bbc tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:32.146013 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-30d2a306-ded6-4593-8ed2-709bfdcc6bbc tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: af89aa4e-9f0c-48c6-adc7-6b2f72601f8f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:32.160187 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30d2a306-ded6-4593-8ed2-709bfdcc6bbc tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:32.160677 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30d2a306-ded6-4593-8ed2-709bfdcc6bbc tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:32.171021 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30d2a306-ded6-4593-8ed2-709bfdcc6bbc tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:32.172045 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30d2a306-ded6-4593-8ed2-709bfdcc6bbc tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:32.172535 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30d2a306-ded6-4593-8ed2-709bfdcc6bbc tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:32.172976 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30d2a306-ded6-4593-8ed2-709bfdcc6bbc tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:32.556829 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-30d2a306-ded6-4593-8ed2-709bfdcc6bbc tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:32.571199 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-30d2a306-ded6-4593-8ed2-709bfdcc6bbc tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f" status: 200 len: 1314 microversion: 2.1 time: 0.429924 Oct 26 13:27:32.580167 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2570/5117] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:32 2022] GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:27:32.843155 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-eb204036-142c-40f1-a535-df37e64beee5 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67318c2af0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:32.987407 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-eb204036-142c-40f1-a535-df37e64beee5 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082" status: 200 len: 1455 microversion: 2.1 time: 0.149220 Oct 26 13:27:32.998086 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2571/5118] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:32 2022] GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082 => generated 1455 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:33.099053 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fd69a346-6cff-4d33-93ae-99b1aadd5b25 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:33.102002 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:27:33.114154 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fd69a346-6cff-4d33-93ae-99b1aadd5b25 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1316 microversion: 2.1 time: 2.300110 Oct 26 13:27:33.118370 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2548/5119] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:30 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1316 bytes in 2305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:33.596868 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6e63cbde-b9ae-4b2e-8d85-8c09fd8af23e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:33.601272 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6e63cbde-b9ae-4b2e-8d85-8c09fd8af23e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: af89aa4e-9f0c-48c6-adc7-6b2f72601f8f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:33.619500 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e63cbde-b9ae-4b2e-8d85-8c09fd8af23e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:33.620316 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e63cbde-b9ae-4b2e-8d85-8c09fd8af23e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:33.620927 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e63cbde-b9ae-4b2e-8d85-8c09fd8af23e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:33.621458 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e63cbde-b9ae-4b2e-8d85-8c09fd8af23e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:33.621933 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e63cbde-b9ae-4b2e-8d85-8c09fd8af23e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:33.625541 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e63cbde-b9ae-4b2e-8d85-8c09fd8af23e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:34.003854 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-17f3f35a-c2a2-4674-a200-1a59af3d8118 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f6731a25af0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:34.111627 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-17f3f35a-c2a2-4674-a200-1a59af3d8118 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082" status: 200 len: 1455 microversion: 2.1 time: 0.108211 Oct 26 13:27:34.113452 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2549/5120] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:33 2022] GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082 => generated 1455 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:34.142847 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1f60a179-a88d-4947-b8aa-a1a8b0d9fc7a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:34.143867 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1f60a179-a88d-4947-b8aa-a1a8b0d9fc7a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:34.160196 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1f60a179-a88d-4947-b8aa-a1a8b0d9fc7a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:34.162117 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1f60a179-a88d-4947-b8aa-a1a8b0d9fc7a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:34.162962 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1f60a179-a88d-4947-b8aa-a1a8b0d9fc7a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:34.164025 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1f60a179-a88d-4947-b8aa-a1a8b0d9fc7a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:34.167202 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1f60a179-a88d-4947-b8aa-a1a8b0d9fc7a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:34.168276 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1f60a179-a88d-4947-b8aa-a1a8b0d9fc7a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:34.282027 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6e63cbde-b9ae-4b2e-8d85-8c09fd8af23e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:34.290425 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6e63cbde-b9ae-4b2e-8d85-8c09fd8af23e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f" status: 200 len: 1314 microversion: 2.1 time: 0.697396 Oct 26 13:27:34.291014 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2572/5121] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:33 2022] GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f => generated 1314 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:34.798870 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1f60a179-a88d-4947-b8aa-a1a8b0d9fc7a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:34.812395 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1f60a179-a88d-4947-b8aa-a1a8b0d9fc7a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1316 microversion: 2.1 time: 0.675766 Oct 26 13:27:34.814490 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2550/5122] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:34 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1316 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:35.128973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0937dce5-a701-4b0b-8e02-4dcc50777bd5 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67329f1a60>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:35.215438 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0937dce5-a701-4b0b-8e02-4dcc50777bd5 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082" status: 200 len: 1455 microversion: 2.1 time: 0.090199 Oct 26 13:27:35.216033 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2573/5123] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:35 2022] GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082 => generated 1455 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:35.329076 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6e29645e-d9cb-4da3-9e13-3e595f7313aa tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:35.332875 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6e29645e-d9cb-4da3-9e13-3e595f7313aa tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: af89aa4e-9f0c-48c6-adc7-6b2f72601f8f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:35.356703 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e29645e-d9cb-4da3-9e13-3e595f7313aa tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:35.360139 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e29645e-d9cb-4da3-9e13-3e595f7313aa tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:35.363375 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e29645e-d9cb-4da3-9e13-3e595f7313aa tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:35.364718 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e29645e-d9cb-4da3-9e13-3e595f7313aa tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:35.365466 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e29645e-d9cb-4da3-9e13-3e595f7313aa tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:35.379989 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e29645e-d9cb-4da3-9e13-3e595f7313aa tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:35.660040 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6e29645e-d9cb-4da3-9e13-3e595f7313aa tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:35.682823 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6e29645e-d9cb-4da3-9e13-3e595f7313aa tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f" status: 200 len: 1314 microversion: 2.1 time: 0.372352 Oct 26 13:27:35.683761 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2551/5124] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:35 2022] GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:35.836254 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-772c8799-e12a-4c80-a849-cf76df274093 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:35.836857 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-772c8799-e12a-4c80-a849-cf76df274093 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:35.850735 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-772c8799-e12a-4c80-a849-cf76df274093 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:35.853413 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-772c8799-e12a-4c80-a849-cf76df274093 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:35.854075 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-772c8799-e12a-4c80-a849-cf76df274093 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:35.859898 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-772c8799-e12a-4c80-a849-cf76df274093 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:35.860630 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-772c8799-e12a-4c80-a849-cf76df274093 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:35.861584 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-772c8799-e12a-4c80-a849-cf76df274093 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:36.034912 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-964314d7-2814-42ff-a117-08bf2e3c9995 req-443d1f55-1464-4f93-9bc8-b14c91c7cfc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f573d46e-77d2-4405-baef-2bb447d4b5e7", "name": "network-vif-plugged", "status": "completed", "tag": "1a81eb96-6bc8-4bfb-8326-14785f0a363d"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:27:36.057008 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-964314d7-2814-42ff-a117-08bf2e3c9995 req-443d1f55-1464-4f93-9bc8-b14c91c7cfc8 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:36.057443 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-964314d7-2814-42ff-a117-08bf2e3c9995 req-443d1f55-1464-4f93-9bc8-b14c91c7cfc8 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:36.057981 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-964314d7-2814-42ff-a117-08bf2e3c9995 req-443d1f55-1464-4f93-9bc8-b14c91c7cfc8 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:36.090365 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-964314d7-2814-42ff-a117-08bf2e3c9995 req-443d1f55-1464-4f93-9bc8-b14c91c7cfc8 service nova] Creating event network-vif-plugged:1a81eb96-6bc8-4bfb-8326-14785f0a363d for instance f573d46e-77d2-4405-baef-2bb447d4b5e7 on n-h2-862686-1 Oct 26 13:27:36.110585 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-964314d7-2814-42ff-a117-08bf2e3c9995 req-443d1f55-1464-4f93-9bc8-b14c91c7cfc8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079824 Oct 26 13:27:36.111548 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2552/5125] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:27:36.237957 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6e584fc8-1f88-493b-9546-b3dab7d6c34f tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67320f0c10>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:36.296189 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-772c8799-e12a-4c80-a849-cf76df274093 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:36.308549 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-772c8799-e12a-4c80-a849-cf76df274093 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1316 microversion: 2.1 time: 0.476339 Oct 26 13:27:36.309337 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2574/5126] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:35 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1316 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:36.360559 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6e584fc8-1f88-493b-9546-b3dab7d6c34f tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082" status: 200 len: 1464 microversion: 2.1 time: 0.128778 Oct 26 13:27:36.364901 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2553/5127] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:36 2022] GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082 => generated 1464 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:36.380462 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a4c24da6-9dcd-40ed-80fe-4e22cc4a18f6 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67367f4b80>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:36.480124 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a4c24da6-9dcd-40ed-80fe-4e22cc4a18f6 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082" status: 200 len: 1464 microversion: 2.1 time: 0.104425 Oct 26 13:27:36.482932 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2575/5128] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:36 2022] GET /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082 => generated 1464 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:36.498673 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c2db372e-4953-4788-a33b-7bb642ac008a tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:36.499443 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c2db372e-4953-4788-a33b-7bb642ac008a tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] [instance: 56c29b20-837e-4f90-9213-99699295a6af] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:36.520762 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c2db372e-4953-4788-a33b-7bb642ac008a tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:36.531046 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c2db372e-4953-4788-a33b-7bb642ac008a tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:36.531496 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c2db372e-4953-4788-a33b-7bb642ac008a tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:36.532955 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c2db372e-4953-4788-a33b-7bb642ac008a tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:36.535058 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c2db372e-4953-4788-a33b-7bb642ac008a tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:36.536547 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c2db372e-4953-4788-a33b-7bb642ac008a tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:36.710342 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-56e62080-41d9-493e-ad41-7c69aaebbf47 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:36.710962 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-56e62080-41d9-493e-ad41-7c69aaebbf47 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: af89aa4e-9f0c-48c6-adc7-6b2f72601f8f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:36.734406 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-56e62080-41d9-493e-ad41-7c69aaebbf47 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:36.734910 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-56e62080-41d9-493e-ad41-7c69aaebbf47 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:36.735350 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-56e62080-41d9-493e-ad41-7c69aaebbf47 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:36.742752 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-56e62080-41d9-493e-ad41-7c69aaebbf47 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:36.743426 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-56e62080-41d9-493e-ad41-7c69aaebbf47 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:36.743871 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-56e62080-41d9-493e-ad41-7c69aaebbf47 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:37.135453 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c2db372e-4953-4788-a33b-7bb642ac008a tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674435111c05455fb1eb5b213d1373c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66f4a941524e30b05360a3ccb2e449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:37.160495 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c2db372e-4953-4788-a33b-7bb642ac008a tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/servers/56c29b20-837e-4f90-9213-99699295a6af" status: 200 len: 1467 microversion: 2.1 time: 0.668799 Oct 26 13:27:37.162800 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2554/5129] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:36 2022] GET /compute/v2.1/servers/56c29b20-837e-4f90-9213-99699295a6af => generated 1467 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:37.199842 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d26c5b2a-a5eb-4d5d-a094-768281e5efa2 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-944197453"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:27:37.218979 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d26c5b2a-a5eb-4d5d-a094-768281e5efa2 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] [instance: 8536123b-d626-498f-bfc7-9b76553e3d04] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:37.243377 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d26c5b2a-a5eb-4d5d-a094-768281e5efa2 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:37.254518 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d26c5b2a-a5eb-4d5d-a094-768281e5efa2 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:37.255445 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d26c5b2a-a5eb-4d5d-a094-768281e5efa2 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:37.257772 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d26c5b2a-a5eb-4d5d-a094-768281e5efa2 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:37.259696 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d26c5b2a-a5eb-4d5d-a094-768281e5efa2 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:37.260262 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d26c5b2a-a5eb-4d5d-a094-768281e5efa2 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:37.746314 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d26c5b2a-a5eb-4d5d-a094-768281e5efa2 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "POST /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04/action" status: 202 len: 0 microversion: 2.1 time: 0.555062 Oct 26 13:27:37.753371 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2555/5130] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:27:37 2022] POST /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04/action => generated 0 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 26 13:27:37.763573 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-09be263d-ccd5-4182-b32b-58ddb6c5bcc1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:37.764442 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-09be263d-ccd5-4182-b32b-58ddb6c5bcc1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:37.782403 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09be263d-ccd5-4182-b32b-58ddb6c5bcc1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:37.783205 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09be263d-ccd5-4182-b32b-58ddb6c5bcc1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:37.783824 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09be263d-ccd5-4182-b32b-58ddb6c5bcc1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:37.786998 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09be263d-ccd5-4182-b32b-58ddb6c5bcc1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:37.787754 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09be263d-ccd5-4182-b32b-58ddb6c5bcc1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:37.788433 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09be263d-ccd5-4182-b32b-58ddb6c5bcc1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:38.042278 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-56e62080-41d9-493e-ad41-7c69aaebbf47 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:38.047500 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:27:38.066768 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-56e62080-41d9-493e-ad41-7c69aaebbf47 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f" status: 200 len: 1314 microversion: 2.1 time: 1.361883 Oct 26 13:27:38.068908 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2576/5131] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:36 2022] GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f => generated 1314 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:38.079241 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-09be263d-ccd5-4182-b32b-58ddb6c5bcc1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:38.087595 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-53120770-bbab-4e78-bb3d-23373ae8ae85 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f6732003160>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:38.097973 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-09be263d-ccd5-4182-b32b-58ddb6c5bcc1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1316 microversion: 2.1 time: 0.341515 Oct 26 13:27:38.101442 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2556/5132] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:37 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1316 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:38.184356 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-53120770-bbab-4e78-bb3d-23373ae8ae85 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f" status: 200 len: 1454 microversion: 2.1 time: 0.110562 Oct 26 13:27:38.188781 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2577/5133] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:38 2022] GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f => generated 1454 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:38.543067 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-8c190eaa-7ccc-481b-8f4c-830738fa41e6 req-41808aec-eafb-433b-94dc-51117e1f3d09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af89aa4e-9f0c-48c6-adc7-6b2f72601f8f", "name": "network-vif-plugged", "status": "completed", "tag": "b80d7d4b-25f1-411b-9943-c31beebd5488"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:27:38.584431 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-8c190eaa-7ccc-481b-8f4c-830738fa41e6 req-41808aec-eafb-433b-94dc-51117e1f3d09 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:38.588275 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-8c190eaa-7ccc-481b-8f4c-830738fa41e6 req-41808aec-eafb-433b-94dc-51117e1f3d09 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:38.588925 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-8c190eaa-7ccc-481b-8f4c-830738fa41e6 req-41808aec-eafb-433b-94dc-51117e1f3d09 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:38.620892 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-8c190eaa-7ccc-481b-8f4c-830738fa41e6 req-41808aec-eafb-433b-94dc-51117e1f3d09 service nova] Creating event network-vif-plugged:b80d7d4b-25f1-411b-9943-c31beebd5488 for instance af89aa4e-9f0c-48c6-adc7-6b2f72601f8f on n-h2-862686-1 Oct 26 13:27:38.636678 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-8c190eaa-7ccc-481b-8f4c-830738fa41e6 req-41808aec-eafb-433b-94dc-51117e1f3d09 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094858 Oct 26 13:27:38.640660 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2557/5134] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:27:39.101918 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9eba7a11-8183-4571-bbc3-cd9f4c5a52a6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:39.103154 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9eba7a11-8183-4571-bbc3-cd9f4c5a52a6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: af89aa4e-9f0c-48c6-adc7-6b2f72601f8f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:39.118485 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9eba7a11-8183-4571-bbc3-cd9f4c5a52a6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:39.118999 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9eba7a11-8183-4571-bbc3-cd9f4c5a52a6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:39.119446 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9eba7a11-8183-4571-bbc3-cd9f4c5a52a6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:39.120170 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9eba7a11-8183-4571-bbc3-cd9f4c5a52a6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:39.120633 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9eba7a11-8183-4571-bbc3-cd9f4c5a52a6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:39.121063 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9eba7a11-8183-4571-bbc3-cd9f4c5a52a6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:39.128132 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-60b24510-fa5e-403a-b7b8-bdf6c2336e41 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:39.129636 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-60b24510-fa5e-403a-b7b8-bdf6c2336e41 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:39.144124 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-60b24510-fa5e-403a-b7b8-bdf6c2336e41 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:39.148023 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-60b24510-fa5e-403a-b7b8-bdf6c2336e41 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:39.154309 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-60b24510-fa5e-403a-b7b8-bdf6c2336e41 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:39.155461 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-60b24510-fa5e-403a-b7b8-bdf6c2336e41 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:39.159098 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-60b24510-fa5e-403a-b7b8-bdf6c2336e41 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:39.160130 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-60b24510-fa5e-403a-b7b8-bdf6c2336e41 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:39.480744 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9eba7a11-8183-4571-bbc3-cd9f4c5a52a6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:39.490449 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9eba7a11-8183-4571-bbc3-cd9f4c5a52a6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f" status: 200 len: 1314 microversion: 2.1 time: 0.397403 Oct 26 13:27:39.491415 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2578/5135] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:39 2022] GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:39.501318 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-044f26f1-5167-477c-9ef9-06db6a739259 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67368f0280>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:39.579281 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-044f26f1-5167-477c-9ef9-06db6a739259 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f" status: 200 len: 1454 microversion: 2.1 time: 0.086356 Oct 26 13:27:39.580381 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2579/5136] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:39 2022] GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f => generated 1454 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:39.884367 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-60b24510-fa5e-403a-b7b8-bdf6c2336e41 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:39.923833 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-60b24510-fa5e-403a-b7b8-bdf6c2336e41 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.800850 Oct 26 13:27:39.952863 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2558/5137] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:39 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:27:40.412428 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-93d27d8b-47df-4382-a902-d152cd7bcdfb tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-615685960", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "56363c00-6608-4ad0-9892-d3ecfbb7f0c5"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:27:40.512678 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b040fe3a-b9e0-488a-8a97-079769c94f0c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:40.513970 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b040fe3a-b9e0-488a-8a97-079769c94f0c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: af89aa4e-9f0c-48c6-adc7-6b2f72601f8f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:40.523558 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-93d27d8b-47df-4382-a902-d152cd7bcdfb tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] validate_networks() for [('56363c00-6608-4ad0-9892-d3ecfbb7f0c5', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:27:40.527892 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b040fe3a-b9e0-488a-8a97-079769c94f0c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:40.529227 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b040fe3a-b9e0-488a-8a97-079769c94f0c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:40.529728 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b040fe3a-b9e0-488a-8a97-079769c94f0c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:40.530411 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b040fe3a-b9e0-488a-8a97-079769c94f0c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:40.530865 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b040fe3a-b9e0-488a-8a97-079769c94f0c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:40.531288 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b040fe3a-b9e0-488a-8a97-079769c94f0c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:40.959011 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b040fe3a-b9e0-488a-8a97-079769c94f0c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:40.991152 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b040fe3a-b9e0-488a-8a97-079769c94f0c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f" status: 200 len: 1314 microversion: 2.1 time: 0.482304 Oct 26 13:27:40.995461 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2559/5138] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:40 2022] GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f => generated 1314 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:27:41.005948 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-67e7d59e-1849-4ffd-8f84-97bb1ff6872f tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67320f0e50>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:41.096478 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-67e7d59e-1849-4ffd-8f84-97bb1ff6872f tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f" status: 200 len: 1454 microversion: 2.1 time: 0.099473 Oct 26 13:27:41.110138 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2560/5139] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:40 2022] GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f => generated 1454 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:41.126949 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-be224899-e775-4946-ba1e-ed401b487dd2 req-9dfcb4e4-14b9-4e64-bcf6-fad10ac949a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56c29b20-837e-4f90-9213-99699295a6af", "name": "network-vif-unplugged", "status": "completed", "tag": "38eb9476-6dba-4c83-886a-1e2f98837aa4"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:27:41.167795 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-be224899-e775-4946-ba1e-ed401b487dd2 req-9dfcb4e4-14b9-4e64-bcf6-fad10ac949a7 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:41.168298 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-be224899-e775-4946-ba1e-ed401b487dd2 req-9dfcb4e4-14b9-4e64-bcf6-fad10ac949a7 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:41.171223 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-be224899-e775-4946-ba1e-ed401b487dd2 req-9dfcb4e4-14b9-4e64-bcf6-fad10ac949a7 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:41.197758 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-be224899-e775-4946-ba1e-ed401b487dd2 req-9dfcb4e4-14b9-4e64-bcf6-fad10ac949a7 service nova] Creating event network-vif-unplugged:38eb9476-6dba-4c83-886a-1e2f98837aa4 for instance 56c29b20-837e-4f90-9213-99699295a6af on n-h1-862686-1 Oct 26 13:27:41.205352 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-be224899-e775-4946-ba1e-ed401b487dd2 req-9dfcb4e4-14b9-4e64-bcf6-fad10ac949a7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093023 Oct 26 13:27:41.206537 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2561/5140] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:27:41.472826 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-93d27d8b-47df-4382-a902-d152cd7bcdfb tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:27:41.473383 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-93d27d8b-47df-4382-a902-d152cd7bcdfb tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:27:41.473817 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-93d27d8b-47df-4382-a902-d152cd7bcdfb tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:27:41.474364 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-93d27d8b-47df-4382-a902-d152cd7bcdfb tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:27:41.474769 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-93d27d8b-47df-4382-a902-d152cd7bcdfb tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:27:41.489147 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-93d27d8b-47df-4382-a902-d152cd7bcdfb tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:41.489801 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-93d27d8b-47df-4382-a902-d152cd7bcdfb tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:41.498324 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-93d27d8b-47df-4382-a902-d152cd7bcdfb tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:41.499593 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-93d27d8b-47df-4382-a902-d152cd7bcdfb tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:41.500097 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-93d27d8b-47df-4382-a902-d152cd7bcdfb tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:41.500535 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-93d27d8b-47df-4382-a902-d152cd7bcdfb tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:41.547761 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-93d27d8b-47df-4382-a902-d152cd7bcdfb tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Getting quotas for project 088eb22706844984b58fe118d5421cbb. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:27:41.554234 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-93d27d8b-47df-4382-a902-d152cd7bcdfb tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Getting quotas for user 9b8db27e3baf4b6a948f6d23c04cf680 and project 088eb22706844984b58fe118d5421cbb. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:27:41.572055 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-93d27d8b-47df-4382-a902-d152cd7bcdfb tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:27:41.575117 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-93d27d8b-47df-4382-a902-d152cd7bcdfb tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f791ecb5-63e6-41fc-b2dc-d73701c5773e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:27:41.707375 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-93d27d8b-47df-4382-a902-d152cd7bcdfb tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.298220 Oct 26 13:27:41.725082 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2580/5141] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:27:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1318 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:27:41.736645 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1c3f12e4-8984-4119-893e-73892df97b53 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:41.737355 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1c3f12e4-8984-4119-893e-73892df97b53 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f791ecb5-63e6-41fc-b2dc-d73701c5773e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:42.020808 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-eeea7bc7-361d-497b-b952-3146a19f5b8c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:42.021774 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-eeea7bc7-361d-497b-b952-3146a19f5b8c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: af89aa4e-9f0c-48c6-adc7-6b2f72601f8f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:42.050388 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1c3f12e4-8984-4119-893e-73892df97b53 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:42.057323 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eeea7bc7-361d-497b-b952-3146a19f5b8c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:42.059062 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eeea7bc7-361d-497b-b952-3146a19f5b8c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:42.063157 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1c3f12e4-8984-4119-893e-73892df97b53 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e" status: 200 len: 1216 microversion: 2.1 time: 0.332036 Oct 26 13:27:42.064406 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eeea7bc7-361d-497b-b952-3146a19f5b8c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:42.066510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eeea7bc7-361d-497b-b952-3146a19f5b8c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:42.067185 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eeea7bc7-361d-497b-b952-3146a19f5b8c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:42.072993 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eeea7bc7-361d-497b-b952-3146a19f5b8c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:42.082137 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2562/5142] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:41 2022] GET /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e => generated 1216 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:42.112437 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-95f75037-7897-4b56-91f5-cedd3b53389f tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67319d65e0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:42.255886 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-95f75037-7897-4b56-91f5-cedd3b53389f tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f" status: 200 len: 1454 microversion: 2.1 time: 0.147535 Oct 26 13:27:42.259802 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2563/5143] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:42 2022] GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f => generated 1454 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:42.753359 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-eeea7bc7-361d-497b-b952-3146a19f5b8c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:42.773048 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-eeea7bc7-361d-497b-b952-3146a19f5b8c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f" status: 200 len: 1500 microversion: 2.1 time: 0.756413 Oct 26 13:27:42.792405 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2581/5144] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:42 2022] GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f => generated 1500 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:42.804123 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-159e4159-bf43-4204-b7db-34c0d654ef23 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:27:42.827641 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-159e4159-bf43-4204-b7db-34c0d654ef23 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:42.831030 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-159e4159-bf43-4204-b7db-34c0d654ef23 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:42.831520 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-159e4159-bf43-4204-b7db-34c0d654ef23 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:42.915341 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-159e4159-bf43-4204-b7db-34c0d654ef23 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: af89aa4e-9f0c-48c6-adc7-6b2f72601f8f] Going to try to stop instance {{(pid=120597) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 26 13:27:43.064618 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-159e4159-bf43-4204-b7db-34c0d654ef23 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "POST /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f/action" status: 202 len: 0 microversion: 2.1 time: 0.266051 Oct 26 13:27:43.065237 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2564/5145] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:27:42 2022] POST /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:27:43.081864 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-42a2de1e-5b88-4e3e-9cb2-253830988218 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:43.082648 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-42a2de1e-5b88-4e3e-9cb2-253830988218 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: af89aa4e-9f0c-48c6-adc7-6b2f72601f8f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:43.093833 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-215b4db4-aabf-4b57-9896-21d439169960 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:43.094466 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-215b4db4-aabf-4b57-9896-21d439169960 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f791ecb5-63e6-41fc-b2dc-d73701c5773e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:43.107924 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42a2de1e-5b88-4e3e-9cb2-253830988218 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:43.108429 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42a2de1e-5b88-4e3e-9cb2-253830988218 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:43.108874 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42a2de1e-5b88-4e3e-9cb2-253830988218 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:43.110955 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-215b4db4-aabf-4b57-9896-21d439169960 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:43.111451 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-215b4db4-aabf-4b57-9896-21d439169960 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:43.111887 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-215b4db4-aabf-4b57-9896-21d439169960 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:43.112591 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-215b4db4-aabf-4b57-9896-21d439169960 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:43.113045 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-215b4db4-aabf-4b57-9896-21d439169960 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:43.113466 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-215b4db4-aabf-4b57-9896-21d439169960 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:43.113771 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42a2de1e-5b88-4e3e-9cb2-253830988218 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:43.115761 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42a2de1e-5b88-4e3e-9cb2-253830988218 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:43.116231 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42a2de1e-5b88-4e3e-9cb2-253830988218 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:43.409563 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-42a2de1e-5b88-4e3e-9cb2-253830988218 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:43.422732 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-42a2de1e-5b88-4e3e-9cb2-253830988218 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f" status: 200 len: 1510 microversion: 2.1 time: 0.352558 Oct 26 13:27:43.423613 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2582/5146] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:43 2022] GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f => generated 1510 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:43.442641 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-32c63de7-3aa9-409f-8a27-2ef46b033a17 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67317168b0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:43.525286 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-32c63de7-3aa9-409f-8a27-2ef46b033a17 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f" status: 200 len: 1454 microversion: 2.1 time: 0.100618 Oct 26 13:27:43.525912 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2583/5147] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:43 2022] GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f => generated 1454 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:43.751246 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-215b4db4-aabf-4b57-9896-21d439169960 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:43.759364 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-215b4db4-aabf-4b57-9896-21d439169960 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e" status: 200 len: 1220 microversion: 2.1 time: 0.670877 Oct 26 13:27:43.774900 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2565/5148] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:43 2022] GET /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e => generated 1220 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:44.454370 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a168b188-19e9-4769-ae44-a0a11c14c318 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:44.455773 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a168b188-19e9-4769-ae44-a0a11c14c318 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: af89aa4e-9f0c-48c6-adc7-6b2f72601f8f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:44.471201 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a168b188-19e9-4769-ae44-a0a11c14c318 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:44.473565 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a168b188-19e9-4769-ae44-a0a11c14c318 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:44.479536 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a168b188-19e9-4769-ae44-a0a11c14c318 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:44.486005 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a168b188-19e9-4769-ae44-a0a11c14c318 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:44.487576 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a168b188-19e9-4769-ae44-a0a11c14c318 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:44.489821 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a168b188-19e9-4769-ae44-a0a11c14c318 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:44.547063 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e38cba9f-278f-4f7b-9219-ad9c2f2ae890 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f6736965ca0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:44.664431 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e38cba9f-278f-4f7b-9219-ad9c2f2ae890 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f" status: 200 len: 1454 microversion: 2.1 time: 0.126470 Oct 26 13:27:44.665310 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2566/5149] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:44 2022] GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f => generated 1454 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:27:44.789746 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-61f547dd-1ed8-4871-b2e3-0383869fddc8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:44.790546 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-61f547dd-1ed8-4871-b2e3-0383869fddc8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f791ecb5-63e6-41fc-b2dc-d73701c5773e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:44.816828 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-61f547dd-1ed8-4871-b2e3-0383869fddc8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:44.838265 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-61f547dd-1ed8-4871-b2e3-0383869fddc8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:44.839100 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-61f547dd-1ed8-4871-b2e3-0383869fddc8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:44.840332 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-61f547dd-1ed8-4871-b2e3-0383869fddc8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:44.845066 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-61f547dd-1ed8-4871-b2e3-0383869fddc8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:44.845993 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-61f547dd-1ed8-4871-b2e3-0383869fddc8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:45.046621 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-61f547dd-1ed8-4871-b2e3-0383869fddc8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:45.055701 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-61f547dd-1ed8-4871-b2e3-0383869fddc8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e" status: 200 len: 1274 microversion: 2.1 time: 0.270020 Oct 26 13:27:45.068579 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2567/5150] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:44 2022] GET /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e => generated 1274 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:45.166014 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a168b188-19e9-4769-ae44-a0a11c14c318 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:45.194458 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a168b188-19e9-4769-ae44-a0a11c14c318 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f" status: 200 len: 1510 microversion: 2.1 time: 0.740338 Oct 26 13:27:45.200456 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2584/5151] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:44 2022] GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f => generated 1510 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:45.680326 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-56969e06-b18f-4a31-bc01-b3ff070365dc tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67369ba820>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:45.785924 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-56969e06-b18f-4a31-bc01-b3ff070365dc tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f" status: 200 len: 1454 microversion: 2.1 time: 0.109391 Oct 26 13:27:45.790805 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2568/5152] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:45 2022] GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f => generated 1454 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:45.900322 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-460908b4-b099-42eb-9d9f-b61c1214be05 req-f6bc9811-556c-424b-8fab-659ad03d64a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8536123b-d626-498f-bfc7-9b76553e3d04", "name": "network-vif-plugged", "status": "completed", "tag": "426db0e6-96c1-46f4-a233-8b1dafdaebaf"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:27:45.932754 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-460908b4-b099-42eb-9d9f-b61c1214be05 req-f6bc9811-556c-424b-8fab-659ad03d64a2 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:45.939087 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-460908b4-b099-42eb-9d9f-b61c1214be05 req-f6bc9811-556c-424b-8fab-659ad03d64a2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:45.941742 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-460908b4-b099-42eb-9d9f-b61c1214be05 req-f6bc9811-556c-424b-8fab-659ad03d64a2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:46.002707 n-d-862686-1 devstack@n-api.service[120598]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 13:27:46.002893 n-d-862686-1 devstack@n-api.service[120598]: Wed Oct 26 13:27:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.40) !!! Oct 26 13:27:46.089928 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1b8cfaa4-347b-4c8c-b6ff-f09dcad6ea91 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:46.090100 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-460908b4-b099-42eb-9d9f-b61c1214be05 req-f6bc9811-556c-424b-8fab-659ad03d64a2 service nova] Creating event network-vif-plugged:426db0e6-96c1-46f4-a233-8b1dafdaebaf for instance 8536123b-d626-498f-bfc7-9b76553e3d04 on n-h1-862686-1 Oct 26 13:27:46.093150 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1b8cfaa4-347b-4c8c-b6ff-f09dcad6ea91 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f791ecb5-63e6-41fc-b2dc-d73701c5773e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:46.101600 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b8cfaa4-347b-4c8c-b6ff-f09dcad6ea91 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:46.102350 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b8cfaa4-347b-4c8c-b6ff-f09dcad6ea91 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:46.103003 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b8cfaa4-347b-4c8c-b6ff-f09dcad6ea91 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:46.103905 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b8cfaa4-347b-4c8c-b6ff-f09dcad6ea91 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:46.109170 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b8cfaa4-347b-4c8c-b6ff-f09dcad6ea91 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:46.109873 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b8cfaa4-347b-4c8c-b6ff-f09dcad6ea91 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:46.111354 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-460908b4-b099-42eb-9d9f-b61c1214be05 req-f6bc9811-556c-424b-8fab-659ad03d64a2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.215678 Oct 26 13:27:46.118714 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2585/5153] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:27:46.252051 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cdf08d49-e658-40d7-9425-7f719ff5d976 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:46.252905 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cdf08d49-e658-40d7-9425-7f719ff5d976 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: af89aa4e-9f0c-48c6-adc7-6b2f72601f8f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:46.275689 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cdf08d49-e658-40d7-9425-7f719ff5d976 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:46.276168 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cdf08d49-e658-40d7-9425-7f719ff5d976 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:46.279712 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cdf08d49-e658-40d7-9425-7f719ff5d976 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:46.285752 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cdf08d49-e658-40d7-9425-7f719ff5d976 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:46.288459 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cdf08d49-e658-40d7-9425-7f719ff5d976 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:46.291890 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cdf08d49-e658-40d7-9425-7f719ff5d976 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:46.468923 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1b8cfaa4-347b-4c8c-b6ff-f09dcad6ea91 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:46.476989 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1b8cfaa4-347b-4c8c-b6ff-f09dcad6ea91 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e" status: 200 len: 1274 microversion: 2.1 time: 0.392679 Oct 26 13:27:46.477837 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2569/5154] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:46 2022] GET /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e => generated 1274 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:46.802993 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f8352607-4480-4b1c-b418-9c18c5d3540e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f6731a258b0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:46.923684 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f8352607-4480-4b1c-b418-9c18c5d3540e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f" status: 200 len: 1454 microversion: 2.1 time: 0.124658 Oct 26 13:27:46.924269 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2570/5155] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:46 2022] GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f => generated 1454 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:27:47.506757 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8beea219-3612-4d4a-a210-39ee951824fb tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:47.507350 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8beea219-3612-4d4a-a210-39ee951824fb tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f791ecb5-63e6-41fc-b2dc-d73701c5773e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:47.509814 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=48 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:27:47.533505 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8beea219-3612-4d4a-a210-39ee951824fb tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:47.534289 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8beea219-3612-4d4a-a210-39ee951824fb tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:47.535648 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8beea219-3612-4d4a-a210-39ee951824fb tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:47.542727 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8beea219-3612-4d4a-a210-39ee951824fb tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:47.543513 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8beea219-3612-4d4a-a210-39ee951824fb tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:47.544731 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8beea219-3612-4d4a-a210-39ee951824fb tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:47.715807 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-cdf08d49-e658-40d7-9425-7f719ff5d976 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:47.729840 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cdf08d49-e658-40d7-9425-7f719ff5d976 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f" status: 200 len: 1510 microversion: 2.1 time: 1.483262 Oct 26 13:27:47.743584 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2586/5156] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:46 2022] GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f => generated 1510 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:27:47.941284 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f5c6a35d-1e1e-4dcf-bc76-14df57343719 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f673180be50>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:48.049317 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f5c6a35d-1e1e-4dcf-bc76-14df57343719 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f" status: 200 len: 1454 microversion: 2.1 time: 0.112939 Oct 26 13:27:48.060762 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2587/5157] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:47 2022] GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f => generated 1454 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:27:48.770683 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3aac4021-2e2b-4558-aa56-1d3bf0fa83e7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:48.771352 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3aac4021-2e2b-4558-aa56-1d3bf0fa83e7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: af89aa4e-9f0c-48c6-adc7-6b2f72601f8f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:48.773663 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:27:48.807128 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3aac4021-2e2b-4558-aa56-1d3bf0fa83e7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:48.811536 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3aac4021-2e2b-4558-aa56-1d3bf0fa83e7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:48.811876 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3aac4021-2e2b-4558-aa56-1d3bf0fa83e7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:48.812630 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3aac4021-2e2b-4558-aa56-1d3bf0fa83e7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:48.813083 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3aac4021-2e2b-4558-aa56-1d3bf0fa83e7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:48.815862 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3aac4021-2e2b-4558-aa56-1d3bf0fa83e7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:49.113765 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3aac4021-2e2b-4558-aa56-1d3bf0fa83e7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:49.124872 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3aac4021-2e2b-4558-aa56-1d3bf0fa83e7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f" status: 200 len: 1510 microversion: 2.1 time: 0.362087 Oct 26 13:27:49.144090 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2588/5158] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:48 2022] GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f => generated 1510 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:27:49.150517 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5fa2550f-bf71-4a62-ae7d-596200fa0956 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67368f0af0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:49.229444 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5fa2550f-bf71-4a62-ae7d-596200fa0956 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f" status: 200 len: 1454 microversion: 2.1 time: 0.083686 Oct 26 13:27:49.230733 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2589/5159] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:49 2022] GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f => generated 1454 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:50.150613 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c759d59b-bc87-49d8-b488-8453b52a6c3a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:50.152060 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c759d59b-bc87-49d8-b488-8453b52a6c3a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: af89aa4e-9f0c-48c6-adc7-6b2f72601f8f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:50.176094 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c759d59b-bc87-49d8-b488-8453b52a6c3a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:50.176620 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c759d59b-bc87-49d8-b488-8453b52a6c3a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:50.177075 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c759d59b-bc87-49d8-b488-8453b52a6c3a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:50.177844 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c759d59b-bc87-49d8-b488-8453b52a6c3a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:50.178302 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c759d59b-bc87-49d8-b488-8453b52a6c3a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:50.178737 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c759d59b-bc87-49d8-b488-8453b52a6c3a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:50.832371 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c759d59b-bc87-49d8-b488-8453b52a6c3a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:50.840831 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c759d59b-bc87-49d8-b488-8453b52a6c3a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f" status: 200 len: 1510 microversion: 2.1 time: 0.695061 Oct 26 13:27:50.847061 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2590/5160] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:50 2022] GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f => generated 1510 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:27:50.873410 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f62dfa5b-8841-4757-be71-720c055e1d7a tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67368f0670>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:50.976776 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f62dfa5b-8841-4757-be71-720c055e1d7a tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f" status: 200 len: 1454 microversion: 2.1 time: 0.128352 Oct 26 13:27:50.977365 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2591/5161] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:50 2022] GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f => generated 1454 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:51.621569 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8beea219-3612-4d4a-a210-39ee951824fb tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:51.645839 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8beea219-3612-4d4a-a210-39ee951824fb tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e" status: 200 len: 1316 microversion: 2.1 time: 4.128888 Oct 26 13:27:51.646533 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2571/5162] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:47 2022] GET /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e => generated 1316 bytes in 4146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:51.873422 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-31054a02-7eee-448d-b206-3c94a1869afb tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:51.874806 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-31054a02-7eee-448d-b206-3c94a1869afb tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: af89aa4e-9f0c-48c6-adc7-6b2f72601f8f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:51.902951 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:27:51.910904 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:27:51.923620 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31054a02-7eee-448d-b206-3c94a1869afb tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:51.924143 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31054a02-7eee-448d-b206-3c94a1869afb tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:51.924591 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31054a02-7eee-448d-b206-3c94a1869afb tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:51.925312 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31054a02-7eee-448d-b206-3c94a1869afb tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:51.938501 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31054a02-7eee-448d-b206-3c94a1869afb tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:51.946142 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31054a02-7eee-448d-b206-3c94a1869afb tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:51.995422 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a94340e2-2385-46f6-bac4-e28333cc71da tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f673215cd30>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:52.057211 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:27:52.114728 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a94340e2-2385-46f6-bac4-e28333cc71da tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f" status: 200 len: 1454 microversion: 2.1 time: 0.124003 Oct 26 13:27:52.118405 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2572/5163] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:51 2022] GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f => generated 1454 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:52.585826 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-31054a02-7eee-448d-b206-3c94a1869afb tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:52.611519 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-31054a02-7eee-448d-b206-3c94a1869afb tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f" status: 200 len: 1510 microversion: 2.1 time: 0.748275 Oct 26 13:27:52.619323 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2592/5164] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:51 2022] GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f => generated 1510 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:52.686361 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5a98fe98-64b4-4c3d-abf2-ec461ac2e1c7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:52.687024 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5a98fe98-64b4-4c3d-abf2-ec461ac2e1c7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f791ecb5-63e6-41fc-b2dc-d73701c5773e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:52.694538 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5a98fe98-64b4-4c3d-abf2-ec461ac2e1c7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:52.695060 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5a98fe98-64b4-4c3d-abf2-ec461ac2e1c7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:52.695597 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5a98fe98-64b4-4c3d-abf2-ec461ac2e1c7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:52.696403 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5a98fe98-64b4-4c3d-abf2-ec461ac2e1c7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:52.696864 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5a98fe98-64b4-4c3d-abf2-ec461ac2e1c7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:52.697309 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5a98fe98-64b4-4c3d-abf2-ec461ac2e1c7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:53.137339 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cf445230-a100-4ff8-8798-7ca757535d69 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67317d6af0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:53.178221 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5a98fe98-64b4-4c3d-abf2-ec461ac2e1c7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:53.216299 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5a98fe98-64b4-4c3d-abf2-ec461ac2e1c7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e" status: 200 len: 1316 microversion: 2.1 time: 0.548629 Oct 26 13:27:53.222614 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2573/5165] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:52 2022] GET /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e => generated 1316 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:53.285520 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cf445230-a100-4ff8-8798-7ca757535d69 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f" status: 200 len: 1454 microversion: 2.1 time: 0.155950 Oct 26 13:27:53.289068 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2593/5166] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:53 2022] GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f => generated 1454 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:53.664043 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-09977744-86cd-4355-a411-adba3d52e5b2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:53.669715 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-09977744-86cd-4355-a411-adba3d52e5b2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: af89aa4e-9f0c-48c6-adc7-6b2f72601f8f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:53.695743 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09977744-86cd-4355-a411-adba3d52e5b2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:53.696415 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09977744-86cd-4355-a411-adba3d52e5b2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:53.696665 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09977744-86cd-4355-a411-adba3d52e5b2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:53.699690 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09977744-86cd-4355-a411-adba3d52e5b2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:53.709909 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09977744-86cd-4355-a411-adba3d52e5b2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:53.710372 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09977744-86cd-4355-a411-adba3d52e5b2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:53.715437 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:27:54.244923 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6ff85b36-279e-4dd9-83d1-5fd8981fc6f3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:54.245647 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6ff85b36-279e-4dd9-83d1-5fd8981fc6f3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f791ecb5-63e6-41fc-b2dc-d73701c5773e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:54.272001 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ff85b36-279e-4dd9-83d1-5fd8981fc6f3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:54.272601 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ff85b36-279e-4dd9-83d1-5fd8981fc6f3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:54.273501 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ff85b36-279e-4dd9-83d1-5fd8981fc6f3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:54.274461 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ff85b36-279e-4dd9-83d1-5fd8981fc6f3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:54.275401 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ff85b36-279e-4dd9-83d1-5fd8981fc6f3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:54.277192 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ff85b36-279e-4dd9-83d1-5fd8981fc6f3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:55.018541 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6ff85b36-279e-4dd9-83d1-5fd8981fc6f3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:55.097559 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6ff85b36-279e-4dd9-83d1-5fd8981fc6f3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e" status: 200 len: 1316 microversion: 2.1 time: 0.858352 Oct 26 13:27:55.109113 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2594/5167] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:54 2022] GET /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e => generated 1316 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:55.120493 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f6153951-4175-4196-99e2-633cfa3feffc tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67368f0310>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:55.235176 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f6153951-4175-4196-99e2-633cfa3feffc tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f" status: 200 len: 1454 microversion: 2.1 time: 0.120901 Oct 26 13:27:55.235803 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2595/5168] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:55 2022] GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f => generated 1454 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:55.540180 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-09977744-86cd-4355-a411-adba3d52e5b2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:55.545234 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-9a066902-f0d1-4882-ab2b-cd6fe4da078d req-d6296c1a-db86-425f-8c1c-2885e48e5468 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f791ecb5-63e6-41fc-b2dc-d73701c5773e", "tag": "58aca507-3c74-4e5d-8e68-072d94821cc9"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:27:55.560227 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9a066902-f0d1-4882-ab2b-cd6fe4da078d req-d6296c1a-db86-425f-8c1c-2885e48e5468 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:55.561061 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9a066902-f0d1-4882-ab2b-cd6fe4da078d req-d6296c1a-db86-425f-8c1c-2885e48e5468 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:55.561769 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9a066902-f0d1-4882-ab2b-cd6fe4da078d req-d6296c1a-db86-425f-8c1c-2885e48e5468 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:55.573918 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-09977744-86cd-4355-a411-adba3d52e5b2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f" status: 200 len: 1510 microversion: 2.1 time: 1.923854 Oct 26 13:27:55.583643 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2574/5169] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:53 2022] GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f => generated 1510 bytes in 1935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:55.624605 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-9a066902-f0d1-4882-ab2b-cd6fe4da078d req-d6296c1a-db86-425f-8c1c-2885e48e5468 service nova] Creating event network-changed:58aca507-3c74-4e5d-8e68-072d94821cc9 for instance f791ecb5-63e6-41fc-b2dc-d73701c5773e on n-h2-862686-1 Oct 26 13:27:55.634274 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-9a066902-f0d1-4882-ab2b-cd6fe4da078d req-d6296c1a-db86-425f-8c1c-2885e48e5468 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094297 Oct 26 13:27:55.635466 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2596/5170] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:27:56.139355 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e49d190d-fc24-402b-ad13-81b1df3468c1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:56.139355 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e49d190d-fc24-402b-ad13-81b1df3468c1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f791ecb5-63e6-41fc-b2dc-d73701c5773e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:56.179634 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e49d190d-fc24-402b-ad13-81b1df3468c1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:56.183552 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e49d190d-fc24-402b-ad13-81b1df3468c1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:56.185522 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e49d190d-fc24-402b-ad13-81b1df3468c1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:56.190978 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e49d190d-fc24-402b-ad13-81b1df3468c1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:56.193664 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e49d190d-fc24-402b-ad13-81b1df3468c1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:56.195669 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e49d190d-fc24-402b-ad13-81b1df3468c1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:56.254937 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-738f4e3e-de91-4da3-8ca0-221afac34e3a tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67368f0af0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:56.318995 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-738f4e3e-de91-4da3-8ca0-221afac34e3a tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f" status: 200 len: 1454 microversion: 2.1 time: 0.068869 Oct 26 13:27:56.320076 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2597/5171] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:56 2022] GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f => generated 1454 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:27:56.608419 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e83b9388-c5d1-4fc3-a900-adb2726b2397 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:56.609676 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e83b9388-c5d1-4fc3-a900-adb2726b2397 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: af89aa4e-9f0c-48c6-adc7-6b2f72601f8f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:56.641838 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e49d190d-fc24-402b-ad13-81b1df3468c1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:56.661670 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e83b9388-c5d1-4fc3-a900-adb2726b2397 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:56.662187 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e83b9388-c5d1-4fc3-a900-adb2726b2397 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:56.662638 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e83b9388-c5d1-4fc3-a900-adb2726b2397 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:56.663354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e83b9388-c5d1-4fc3-a900-adb2726b2397 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:56.667496 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e49d190d-fc24-402b-ad13-81b1df3468c1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e" status: 200 len: 1316 microversion: 2.1 time: 0.534733 Oct 26 13:27:56.671009 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e83b9388-c5d1-4fc3-a900-adb2726b2397 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:56.673121 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e83b9388-c5d1-4fc3-a900-adb2726b2397 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:56.690383 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2575/5172] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:56 2022] GET /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e => generated 1316 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:57.042928 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e83b9388-c5d1-4fc3-a900-adb2726b2397 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:57.064745 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e83b9388-c5d1-4fc3-a900-adb2726b2397 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f" status: 200 len: 1510 microversion: 2.1 time: 0.460586 Oct 26 13:27:57.065885 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2598/5173] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:56 2022] GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f => generated 1510 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:57.336640 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0cb1efc2-5a13-4be0-8e7b-a3d90eda1c67 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67319d6550>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:57.449150 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0cb1efc2-5a13-4be0-8e7b-a3d90eda1c67 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f" status: 200 len: 1454 microversion: 2.1 time: 0.116987 Oct 26 13:27:57.449637 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2576/5174] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:57 2022] GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f => generated 1454 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:57.709067 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ae1eaf38-ab08-4834-8c96-98f9e2ff2d07 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:57.709602 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ae1eaf38-ab08-4834-8c96-98f9e2ff2d07 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f791ecb5-63e6-41fc-b2dc-d73701c5773e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:57.741214 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae1eaf38-ab08-4834-8c96-98f9e2ff2d07 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:57.754974 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae1eaf38-ab08-4834-8c96-98f9e2ff2d07 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:57.764288 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae1eaf38-ab08-4834-8c96-98f9e2ff2d07 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:57.767441 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae1eaf38-ab08-4834-8c96-98f9e2ff2d07 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:57.767992 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae1eaf38-ab08-4834-8c96-98f9e2ff2d07 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:57.771687 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae1eaf38-ab08-4834-8c96-98f9e2ff2d07 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:58.090158 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5c9b35f0-c222-4db9-a35e-60528d3e7273 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:58.091431 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5c9b35f0-c222-4db9-a35e-60528d3e7273 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: af89aa4e-9f0c-48c6-adc7-6b2f72601f8f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:58.098882 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c9b35f0-c222-4db9-a35e-60528d3e7273 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:58.099375 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c9b35f0-c222-4db9-a35e-60528d3e7273 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:58.099813 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c9b35f0-c222-4db9-a35e-60528d3e7273 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:58.100517 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c9b35f0-c222-4db9-a35e-60528d3e7273 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:58.118194 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c9b35f0-c222-4db9-a35e-60528d3e7273 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:58.119817 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c9b35f0-c222-4db9-a35e-60528d3e7273 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:58.242105 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ae1eaf38-ab08-4834-8c96-98f9e2ff2d07 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:58.265091 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ae1eaf38-ab08-4834-8c96-98f9e2ff2d07 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e" status: 200 len: 1316 microversion: 2.1 time: 0.570236 Oct 26 13:27:58.276407 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2599/5175] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:57 2022] GET /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e => generated 1316 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:58.465290 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b78ab462-f7e8-472d-8f25-e500269bcc26 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67317e7dc0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:58.585863 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b78ab462-f7e8-472d-8f25-e500269bcc26 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f" status: 200 len: 1454 microversion: 2.1 time: 0.124263 Oct 26 13:27:58.587279 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2600/5176] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:58 2022] GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f => generated 1454 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:27:59.316274 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-96b87d28-442e-4ed4-a2ea-c4cca4d1751b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:59.320362 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-96b87d28-442e-4ed4-a2ea-c4cca4d1751b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f791ecb5-63e6-41fc-b2dc-d73701c5773e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:27:59.342271 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-96b87d28-442e-4ed4-a2ea-c4cca4d1751b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:59.344657 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-96b87d28-442e-4ed4-a2ea-c4cca4d1751b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:59.345577 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-96b87d28-442e-4ed4-a2ea-c4cca4d1751b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:59.347230 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-96b87d28-442e-4ed4-a2ea-c4cca4d1751b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:27:59.352401 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-96b87d28-442e-4ed4-a2ea-c4cca4d1751b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:27:59.353922 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-96b87d28-442e-4ed4-a2ea-c4cca4d1751b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:27:59.678747 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-96b87d28-442e-4ed4-a2ea-c4cca4d1751b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:59.695308 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-96b87d28-442e-4ed4-a2ea-c4cca4d1751b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e" status: 200 len: 1316 microversion: 2.1 time: 0.391029 Oct 26 13:27:59.696116 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2601/5177] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:59 2022] GET /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e => generated 1316 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:27:59.706834 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-56125bad-86ef-42ac-a16e-d6db3602c2e4 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67317e7040>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:27:59.796604 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5c9b35f0-c222-4db9-a35e-60528d3e7273 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:27:59.830116 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5c9b35f0-c222-4db9-a35e-60528d3e7273 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f" status: 200 len: 1510 microversion: 2.1 time: 1.743848 Oct 26 13:27:59.835549 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-56125bad-86ef-42ac-a16e-d6db3602c2e4 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f" status: 200 len: 1454 microversion: 2.1 time: 0.137155 Oct 26 13:27:59.837056 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2577/5178] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:27:58 2022] GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f => generated 1510 bytes in 1751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:27:59.837932 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2602/5179] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:27:59 2022] GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f => generated 1454 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:00.725928 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ff619648-0ecb-4083-b155-58e9545c2ea7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:00.728466 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ff619648-0ecb-4083-b155-58e9545c2ea7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f791ecb5-63e6-41fc-b2dc-d73701c5773e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:00.748432 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff619648-0ecb-4083-b155-58e9545c2ea7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:00.749231 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff619648-0ecb-4083-b155-58e9545c2ea7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:00.749714 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff619648-0ecb-4083-b155-58e9545c2ea7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:00.752073 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff619648-0ecb-4083-b155-58e9545c2ea7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:00.752615 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff619648-0ecb-4083-b155-58e9545c2ea7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:00.761995 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff619648-0ecb-4083-b155-58e9545c2ea7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:00.854965 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7fde0fdb-b9f0-4a43-a9ca-da667d66439e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f6731774820>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:00.985689 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7fde0fdb-b9f0-4a43-a9ca-da667d66439e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f" status: 200 len: 1454 microversion: 2.1 time: 0.136417 Oct 26 13:28:00.987736 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2603/5180] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:00 2022] GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f => generated 1454 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:28:01.004747 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-90f83074-d151-4bcc-ad32-9fae0ee6491b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:01.006406 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-90f83074-d151-4bcc-ad32-9fae0ee6491b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: af89aa4e-9f0c-48c6-adc7-6b2f72601f8f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:01.037295 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90f83074-d151-4bcc-ad32-9fae0ee6491b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:01.039935 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90f83074-d151-4bcc-ad32-9fae0ee6491b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:01.040414 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90f83074-d151-4bcc-ad32-9fae0ee6491b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:01.041179 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90f83074-d151-4bcc-ad32-9fae0ee6491b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:01.041688 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90f83074-d151-4bcc-ad32-9fae0ee6491b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:01.042122 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90f83074-d151-4bcc-ad32-9fae0ee6491b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:01.558447 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-90f83074-d151-4bcc-ad32-9fae0ee6491b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:01.590404 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-90f83074-d151-4bcc-ad32-9fae0ee6491b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f" status: 200 len: 1510 microversion: 2.1 time: 0.601286 Oct 26 13:28:01.593403 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2604/5181] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:00 2022] GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f => generated 1510 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:02.003952 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1755fba8-a0c9-4dc0-ab6f-01da6c488634 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67319474c0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:02.139701 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1755fba8-a0c9-4dc0-ab6f-01da6c488634 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f" status: 200 len: 1454 microversion: 2.1 time: 0.139754 Oct 26 13:28:02.140561 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2605/5182] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:01 2022] GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f => generated 1454 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:02.622229 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a0c12fad-5498-46dc-900d-1b2b7e04070b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:02.623482 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a0c12fad-5498-46dc-900d-1b2b7e04070b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: af89aa4e-9f0c-48c6-adc7-6b2f72601f8f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:02.639990 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0c12fad-5498-46dc-900d-1b2b7e04070b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:02.640484 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0c12fad-5498-46dc-900d-1b2b7e04070b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:02.640938 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0c12fad-5498-46dc-900d-1b2b7e04070b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:02.641717 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0c12fad-5498-46dc-900d-1b2b7e04070b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:02.642158 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0c12fad-5498-46dc-900d-1b2b7e04070b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:02.642639 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0c12fad-5498-46dc-900d-1b2b7e04070b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:02.971503 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ff619648-0ecb-4083-b155-58e9545c2ea7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:02.986634 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ff619648-0ecb-4083-b155-58e9545c2ea7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e" status: 200 len: 1316 microversion: 2.1 time: 2.264562 Oct 26 13:28:02.987242 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2578/5183] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:00 2022] GET /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e => generated 1316 bytes in 2266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:03.155409 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a3544e62-62c3-4353-931a-c3f6c49105e4 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f673251a9d0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:03.206713 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a0c12fad-5498-46dc-900d-1b2b7e04070b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:03.218446 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a0c12fad-5498-46dc-900d-1b2b7e04070b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f" status: 200 len: 1510 microversion: 2.1 time: 0.600662 Oct 26 13:28:03.234054 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2606/5184] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:02 2022] GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f => generated 1510 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:28:03.299750 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a3544e62-62c3-4353-931a-c3f6c49105e4 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f" status: 200 len: 1454 microversion: 2.1 time: 0.147271 Oct 26 13:28:03.311373 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2579/5185] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:03 2022] GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:28:04.015394 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e1ce7c0a-68ed-4465-9f47-f89ddf3163ad tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:04.016123 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e1ce7c0a-68ed-4465-9f47-f89ddf3163ad tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f791ecb5-63e6-41fc-b2dc-d73701c5773e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:04.046385 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e1ce7c0a-68ed-4465-9f47-f89ddf3163ad tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:04.047869 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e1ce7c0a-68ed-4465-9f47-f89ddf3163ad tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:04.049945 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e1ce7c0a-68ed-4465-9f47-f89ddf3163ad tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:04.055004 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e1ce7c0a-68ed-4465-9f47-f89ddf3163ad tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:04.056675 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e1ce7c0a-68ed-4465-9f47-f89ddf3163ad tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:04.058237 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e1ce7c0a-68ed-4465-9f47-f89ddf3163ad tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:04.250499 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dd26de79-38af-43c0-ab19-24e37f2247d4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:04.251340 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-dd26de79-38af-43c0-ab19-24e37f2247d4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: af89aa4e-9f0c-48c6-adc7-6b2f72601f8f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:04.268209 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd26de79-38af-43c0-ab19-24e37f2247d4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:04.268735 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd26de79-38af-43c0-ab19-24e37f2247d4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:04.274189 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd26de79-38af-43c0-ab19-24e37f2247d4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:04.274877 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd26de79-38af-43c0-ab19-24e37f2247d4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:04.275367 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd26de79-38af-43c0-ab19-24e37f2247d4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:04.275810 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd26de79-38af-43c0-ab19-24e37f2247d4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:04.495362 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e1ce7c0a-68ed-4465-9f47-f89ddf3163ad tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:04.510297 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e1ce7c0a-68ed-4465-9f47-f89ddf3163ad tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e" status: 200 len: 1316 microversion: 2.1 time: 0.499767 Oct 26 13:28:04.511316 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2607/5186] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:04 2022] GET /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e => generated 1316 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:04.521231 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-eb068f02-f169-412e-a2f2-fc5e33c107ae tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f6736922790>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:04.592786 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-eb068f02-f169-412e-a2f2-fc5e33c107ae tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f" status: 200 len: 1454 microversion: 2.1 time: 0.080205 Oct 26 13:28:04.593382 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2608/5187] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:04 2022] GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f => generated 1454 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:04.876485 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-dd26de79-38af-43c0-ab19-24e37f2247d4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:04.886284 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-dd26de79-38af-43c0-ab19-24e37f2247d4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f" status: 200 len: 1510 microversion: 2.1 time: 0.639793 Oct 26 13:28:04.898945 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2580/5188] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:04 2022] GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f => generated 1510 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:05.534058 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b1d90ee7-bc2c-4629-a074-ca37dc9ac432 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:05.535157 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b1d90ee7-bc2c-4629-a074-ca37dc9ac432 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f791ecb5-63e6-41fc-b2dc-d73701c5773e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:05.552995 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1d90ee7-bc2c-4629-a074-ca37dc9ac432 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:05.556549 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1d90ee7-bc2c-4629-a074-ca37dc9ac432 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:05.557164 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1d90ee7-bc2c-4629-a074-ca37dc9ac432 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:05.565022 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1d90ee7-bc2c-4629-a074-ca37dc9ac432 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:05.574321 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1d90ee7-bc2c-4629-a074-ca37dc9ac432 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:05.575846 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1d90ee7-bc2c-4629-a074-ca37dc9ac432 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:05.609752 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f968077b-a40f-4b02-92f7-825aaad69f21 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f6732647280>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:05.640497 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:28:05.718447 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f968077b-a40f-4b02-92f7-825aaad69f21 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f" status: 200 len: 1454 microversion: 2.1 time: 0.113722 Oct 26 13:28:05.719414 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2581/5189] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:05 2022] GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f => generated 1454 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:05.926958 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c9835f22-ca77-4a62-a8a6-5fd520019570 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:05.927624 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c9835f22-ca77-4a62-a8a6-5fd520019570 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: af89aa4e-9f0c-48c6-adc7-6b2f72601f8f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:05.979033 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c9835f22-ca77-4a62-a8a6-5fd520019570 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:05.982085 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c9835f22-ca77-4a62-a8a6-5fd520019570 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:05.985419 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c9835f22-ca77-4a62-a8a6-5fd520019570 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:05.987097 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c9835f22-ca77-4a62-a8a6-5fd520019570 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:05.990739 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c9835f22-ca77-4a62-a8a6-5fd520019570 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:05.995492 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c9835f22-ca77-4a62-a8a6-5fd520019570 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:06.053237 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b1d90ee7-bc2c-4629-a074-ca37dc9ac432 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:06.063326 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b1d90ee7-bc2c-4629-a074-ca37dc9ac432 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e" status: 200 len: 1316 microversion: 2.1 time: 0.534928 Oct 26 13:28:06.100291 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2609/5190] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:05 2022] GET /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e => generated 1316 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:06.734663 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a6444056-2a74-4e9e-b2e1-725c853e1611 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67317e75e0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:06.840919 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a6444056-2a74-4e9e-b2e1-725c853e1611 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f" status: 200 len: 1454 microversion: 2.1 time: 0.111077 Oct 26 13:28:06.849215 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2610/5191] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:06 2022] GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f => generated 1454 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:07.101158 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8ef9f768-8511-48f3-9b3c-98453044d5d8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:07.102188 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8ef9f768-8511-48f3-9b3c-98453044d5d8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f791ecb5-63e6-41fc-b2dc-d73701c5773e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:07.111249 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8ef9f768-8511-48f3-9b3c-98453044d5d8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:07.112131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8ef9f768-8511-48f3-9b3c-98453044d5d8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:07.112836 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8ef9f768-8511-48f3-9b3c-98453044d5d8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:07.113836 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8ef9f768-8511-48f3-9b3c-98453044d5d8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:07.114852 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8ef9f768-8511-48f3-9b3c-98453044d5d8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:07.117763 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8ef9f768-8511-48f3-9b3c-98453044d5d8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:07.127184 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c9835f22-ca77-4a62-a8a6-5fd520019570 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:07.138237 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c9835f22-ca77-4a62-a8a6-5fd520019570 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f" status: 200 len: 1510 microversion: 2.1 time: 1.220124 Oct 26 13:28:07.162914 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2582/5192] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:05 2022] GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f => generated 1510 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:07.758355 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8ef9f768-8511-48f3-9b3c-98453044d5d8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:07.769094 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8ef9f768-8511-48f3-9b3c-98453044d5d8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e" status: 200 len: 1316 microversion: 2.1 time: 0.670548 Oct 26 13:28:07.771775 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2611/5193] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:07 2022] GET /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e => generated 1316 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:07.858150 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-605bbb2d-f949-4239-94cc-6fb8bc3427da tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f6732262b80>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:07.958387 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-605bbb2d-f949-4239-94cc-6fb8bc3427da tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f" status: 200 len: 1454 microversion: 2.1 time: 0.105438 Oct 26 13:28:07.969569 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2583/5194] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:07 2022] GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f => generated 1454 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:08.189526 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d12b6b39-ce7f-4b6e-9100-98d6487c6760 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:08.190213 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d12b6b39-ce7f-4b6e-9100-98d6487c6760 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: af89aa4e-9f0c-48c6-adc7-6b2f72601f8f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:08.208184 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d12b6b39-ce7f-4b6e-9100-98d6487c6760 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:08.208723 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d12b6b39-ce7f-4b6e-9100-98d6487c6760 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:08.215199 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d12b6b39-ce7f-4b6e-9100-98d6487c6760 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:08.216967 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d12b6b39-ce7f-4b6e-9100-98d6487c6760 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:08.220609 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d12b6b39-ce7f-4b6e-9100-98d6487c6760 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:08.222906 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d12b6b39-ce7f-4b6e-9100-98d6487c6760 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:08.464226 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-931acda0-023d-484b-889e-c0369d7e2f96 req-744856a0-84c1-45e7-99f0-649cc4fae128 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f791ecb5-63e6-41fc-b2dc-d73701c5773e", "name": "network-vif-plugged", "status": "completed", "tag": "58aca507-3c74-4e5d-8e68-072d94821cc9"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:28:08.501215 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-931acda0-023d-484b-889e-c0369d7e2f96 req-744856a0-84c1-45e7-99f0-649cc4fae128 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:08.508239 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-931acda0-023d-484b-889e-c0369d7e2f96 req-744856a0-84c1-45e7-99f0-649cc4fae128 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:08.508985 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-931acda0-023d-484b-889e-c0369d7e2f96 req-744856a0-84c1-45e7-99f0-649cc4fae128 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:08.590815 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-931acda0-023d-484b-889e-c0369d7e2f96 req-744856a0-84c1-45e7-99f0-649cc4fae128 service nova] Creating event network-vif-plugged:58aca507-3c74-4e5d-8e68-072d94821cc9 for instance f791ecb5-63e6-41fc-b2dc-d73701c5773e on n-h2-862686-1 Oct 26 13:28:08.621656 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-931acda0-023d-484b-889e-c0369d7e2f96 req-744856a0-84c1-45e7-99f0-649cc4fae128 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161216 Oct 26 13:28:08.622989 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2584/5195] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:28:08.799022 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dd930b96-2997-4af6-8633-4c8cb372c464 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:08.800005 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-dd930b96-2997-4af6-8633-4c8cb372c464 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f791ecb5-63e6-41fc-b2dc-d73701c5773e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:08.819086 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd930b96-2997-4af6-8633-4c8cb372c464 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:08.823404 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd930b96-2997-4af6-8633-4c8cb372c464 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:08.826355 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd930b96-2997-4af6-8633-4c8cb372c464 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:08.827440 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd930b96-2997-4af6-8633-4c8cb372c464 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:08.829438 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd930b96-2997-4af6-8633-4c8cb372c464 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:08.831273 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd930b96-2997-4af6-8633-4c8cb372c464 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:08.916360 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d12b6b39-ce7f-4b6e-9100-98d6487c6760 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:08.930471 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d12b6b39-ce7f-4b6e-9100-98d6487c6760 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f" status: 200 len: 1510 microversion: 2.1 time: 0.744822 Oct 26 13:28:08.950880 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2612/5196] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:08 2022] GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f => generated 1510 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:28:08.974463 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-08f2eded-199b-48ac-baaa-a833387ddacf tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67317c4ca0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:09.077649 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-08f2eded-199b-48ac-baaa-a833387ddacf tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f" status: 200 len: 1454 microversion: 2.1 time: 0.106910 Oct 26 13:28:09.085418 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2613/5197] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:08 2022] GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f => generated 1454 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:09.526215 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-dd930b96-2997-4af6-8633-4c8cb372c464 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:09.561647 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-dd930b96-2997-4af6-8633-4c8cb372c464 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e" status: 200 len: 1316 microversion: 2.1 time: 0.765473 Oct 26 13:28:09.562297 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2585/5198] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:08 2022] GET /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e => generated 1316 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:28:09.958901 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-30737c4a-a6ee-4cb6-975a-e94e0313941f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:09.958901 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-30737c4a-a6ee-4cb6-975a-e94e0313941f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: af89aa4e-9f0c-48c6-adc7-6b2f72601f8f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:09.971766 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30737c4a-a6ee-4cb6-975a-e94e0313941f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:09.972268 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30737c4a-a6ee-4cb6-975a-e94e0313941f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:09.972708 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30737c4a-a6ee-4cb6-975a-e94e0313941f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:09.973428 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30737c4a-a6ee-4cb6-975a-e94e0313941f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:09.986701 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30737c4a-a6ee-4cb6-975a-e94e0313941f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:09.987173 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30737c4a-a6ee-4cb6-975a-e94e0313941f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:10.092025 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-74a4774e-f439-42a6-b47b-294c2a50ac7e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67320be5e0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:10.220954 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-74a4774e-f439-42a6-b47b-294c2a50ac7e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f" status: 200 len: 1454 microversion: 2.1 time: 0.132432 Oct 26 13:28:10.230995 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2586/5199] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:10 2022] GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f => generated 1454 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:28:10.496711 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-30737c4a-a6ee-4cb6-975a-e94e0313941f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:10.512054 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-30737c4a-a6ee-4cb6-975a-e94e0313941f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f" status: 200 len: 1510 microversion: 2.1 time: 0.558291 Oct 26 13:28:10.516387 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2614/5200] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:09 2022] GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f => generated 1510 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:10.584325 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-334dfc25-cd6f-4c84-b918-c5064851fec5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:10.585896 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-334dfc25-cd6f-4c84-b918-c5064851fec5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f791ecb5-63e6-41fc-b2dc-d73701c5773e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:10.605233 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-334dfc25-cd6f-4c84-b918-c5064851fec5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:10.616653 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-334dfc25-cd6f-4c84-b918-c5064851fec5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:10.617404 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-334dfc25-cd6f-4c84-b918-c5064851fec5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:10.618400 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-334dfc25-cd6f-4c84-b918-c5064851fec5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:10.623180 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-334dfc25-cd6f-4c84-b918-c5064851fec5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:10.626596 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-334dfc25-cd6f-4c84-b918-c5064851fec5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:11.164561 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-334dfc25-cd6f-4c84-b918-c5064851fec5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:11.185417 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-334dfc25-cd6f-4c84-b918-c5064851fec5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e" status: 200 len: 1505 microversion: 2.1 time: 0.601197 Oct 26 13:28:11.190259 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2587/5201] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:10 2022] GET /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e => generated 1505 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:11.214510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c086e908-0f84-47e9-b0b9-3263954b61e6 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:11.215047 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c086e908-0f84-47e9-b0b9-3263954b61e6 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f791ecb5-63e6-41fc-b2dc-d73701c5773e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:11.240267 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-51991726-651a-4229-97c1-7769cad99cb0 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f6733101310>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:11.241406 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c086e908-0f84-47e9-b0b9-3263954b61e6 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:11.254652 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c086e908-0f84-47e9-b0b9-3263954b61e6 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:11.255126 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c086e908-0f84-47e9-b0b9-3263954b61e6 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:11.263090 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c086e908-0f84-47e9-b0b9-3263954b61e6 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:11.271800 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c086e908-0f84-47e9-b0b9-3263954b61e6 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:11.273040 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c086e908-0f84-47e9-b0b9-3263954b61e6 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:11.358667 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-51991726-651a-4229-97c1-7769cad99cb0 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f" status: 200 len: 1454 microversion: 2.1 time: 0.125696 Oct 26 13:28:11.366604 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2588/5202] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:11 2022] GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f => generated 1454 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:11.408100 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c086e908-0f84-47e9-b0b9-3263954b61e6 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f791ecb5-63e6-41fc-b2dc-d73701c5773e] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:28:11.539815 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1d5fcf12-c565-4fba-95d9-8bc3cee49262 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:11.540574 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1d5fcf12-c565-4fba-95d9-8bc3cee49262 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: af89aa4e-9f0c-48c6-adc7-6b2f72601f8f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:11.551756 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d5fcf12-c565-4fba-95d9-8bc3cee49262 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:11.556381 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d5fcf12-c565-4fba-95d9-8bc3cee49262 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:11.564053 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d5fcf12-c565-4fba-95d9-8bc3cee49262 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:11.565076 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d5fcf12-c565-4fba-95d9-8bc3cee49262 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:11.566553 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d5fcf12-c565-4fba-95d9-8bc3cee49262 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:11.568406 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d5fcf12-c565-4fba-95d9-8bc3cee49262 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:11.675674 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c086e908-0f84-47e9-b0b9-3263954b61e6 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e" status: 204 len: 0 microversion: 2.1 time: 0.465031 Oct 26 13:28:11.676905 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2615/5203] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:28:11 2022] DELETE /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:28:11.698914 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2240a7e6-c17b-4d45-aa2a-9fdc67fb8ec7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:11.706538 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2240a7e6-c17b-4d45-aa2a-9fdc67fb8ec7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f791ecb5-63e6-41fc-b2dc-d73701c5773e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:11.728749 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2240a7e6-c17b-4d45-aa2a-9fdc67fb8ec7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:11.729254 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2240a7e6-c17b-4d45-aa2a-9fdc67fb8ec7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:11.729723 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2240a7e6-c17b-4d45-aa2a-9fdc67fb8ec7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:11.730446 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2240a7e6-c17b-4d45-aa2a-9fdc67fb8ec7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:11.730888 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2240a7e6-c17b-4d45-aa2a-9fdc67fb8ec7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:11.731351 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2240a7e6-c17b-4d45-aa2a-9fdc67fb8ec7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:11.927932 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1d5fcf12-c565-4fba-95d9-8bc3cee49262 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:11.938277 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1d5fcf12-c565-4fba-95d9-8bc3cee49262 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f" status: 200 len: 1510 microversion: 2.1 time: 0.402205 Oct 26 13:28:11.939644 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2589/5204] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:11 2022] GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f => generated 1510 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:28:12.183341 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2240a7e6-c17b-4d45-aa2a-9fdc67fb8ec7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:12.194791 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2240a7e6-c17b-4d45-aa2a-9fdc67fb8ec7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e" status: 200 len: 1511 microversion: 2.1 time: 0.502464 Oct 26 13:28:12.197987 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2616/5205] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:11 2022] GET /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e => generated 1511 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:12.395171 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-07c1c473-2ffd-4e2c-b792-1fb6ed0accba tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67322709d0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:12.548178 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-07c1c473-2ffd-4e2c-b792-1fb6ed0accba tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f" status: 200 len: 1454 microversion: 2.1 time: 0.177124 Oct 26 13:28:12.556073 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2590/5206] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:12 2022] GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f => generated 1454 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:12.974261 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2beb65b2-cf0b-4f33-a6e4-faa8df100fb1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:12.978117 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2beb65b2-cf0b-4f33-a6e4-faa8df100fb1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: af89aa4e-9f0c-48c6-adc7-6b2f72601f8f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:13.019381 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2beb65b2-cf0b-4f33-a6e4-faa8df100fb1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:13.021988 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2beb65b2-cf0b-4f33-a6e4-faa8df100fb1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:13.025420 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2beb65b2-cf0b-4f33-a6e4-faa8df100fb1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:13.030873 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2beb65b2-cf0b-4f33-a6e4-faa8df100fb1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:13.034782 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2beb65b2-cf0b-4f33-a6e4-faa8df100fb1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:13.035730 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2beb65b2-cf0b-4f33-a6e4-faa8df100fb1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:13.227137 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2ec533d7-372c-49aa-be17-89d540ea2626 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:13.228971 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2ec533d7-372c-49aa-be17-89d540ea2626 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f791ecb5-63e6-41fc-b2dc-d73701c5773e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:13.238295 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ec533d7-372c-49aa-be17-89d540ea2626 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:13.239089 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ec533d7-372c-49aa-be17-89d540ea2626 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:13.239729 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ec533d7-372c-49aa-be17-89d540ea2626 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:13.240731 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ec533d7-372c-49aa-be17-89d540ea2626 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:13.241458 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ec533d7-372c-49aa-be17-89d540ea2626 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:13.242293 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ec533d7-372c-49aa-be17-89d540ea2626 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:13.436765 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2beb65b2-cf0b-4f33-a6e4-faa8df100fb1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:13.446272 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2beb65b2-cf0b-4f33-a6e4-faa8df100fb1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f" status: 200 len: 1510 microversion: 2.1 time: 0.483056 Oct 26 13:28:13.453092 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2617/5207] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:12 2022] GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f => generated 1510 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:13.564720 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-383450a2-3b63-48ae-a633-054af447772c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67317f63a0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:13.733467 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-383450a2-3b63-48ae-a633-054af447772c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f" status: 200 len: 1454 microversion: 2.1 time: 0.173091 Oct 26 13:28:13.736030 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2618/5208] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:13 2022] GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f => generated 1454 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:14.319738 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2ec533d7-372c-49aa-be17-89d540ea2626 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:14.355909 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2ec533d7-372c-49aa-be17-89d540ea2626 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e" status: 200 len: 1511 microversion: 2.1 time: 1.134858 Oct 26 13:28:14.369835 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2591/5209] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:13 2022] GET /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e => generated 1511 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:14.486390 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3e687b38-46cb-4140-9897-d5a523711fc8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:14.487697 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3e687b38-46cb-4140-9897-d5a523711fc8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: af89aa4e-9f0c-48c6-adc7-6b2f72601f8f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:14.504615 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3e687b38-46cb-4140-9897-d5a523711fc8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:14.505126 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3e687b38-46cb-4140-9897-d5a523711fc8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:14.505603 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3e687b38-46cb-4140-9897-d5a523711fc8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:14.506416 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3e687b38-46cb-4140-9897-d5a523711fc8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:14.506769 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3e687b38-46cb-4140-9897-d5a523711fc8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:14.507261 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3e687b38-46cb-4140-9897-d5a523711fc8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:14.752363 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bde28db2-0966-419c-8460-1222ff3e8a8c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f6731b29280>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:14.948754 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bde28db2-0966-419c-8460-1222ff3e8a8c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f" status: 200 len: 1454 microversion: 2.1 time: 0.200423 Oct 26 13:28:14.963626 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2592/5210] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:14 2022] GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f => generated 1454 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:15.071903 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3e687b38-46cb-4140-9897-d5a523711fc8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:15.124328 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3e687b38-46cb-4140-9897-d5a523711fc8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f" status: 200 len: 1487 microversion: 2.1 time: 0.647823 Oct 26 13:28:15.190545 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2619/5211] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:14 2022] GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f => generated 1487 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:15.219883 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-23d5b325-a2c0-4706-92de-45a683062682 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:28:15.232740 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-23d5b325-a2c0-4706-92de-45a683062682 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:15.294321 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-23d5b325-a2c0-4706-92de-45a683062682 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:15.296731 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-23d5b325-a2c0-4706-92de-45a683062682 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:15.299542 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-23d5b325-a2c0-4706-92de-45a683062682 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:15.300600 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-23d5b325-a2c0-4706-92de-45a683062682 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:15.301326 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-23d5b325-a2c0-4706-92de-45a683062682 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:15.319608 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-23d5b325-a2c0-4706-92de-45a683062682 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:15.332676 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-f34ec22d-a236-47c7-bc3f-f209003a1890 req-11a68f24-985b-46d7-b26b-ae3ea08188d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f791ecb5-63e6-41fc-b2dc-d73701c5773e", "name": "network-vif-deleted", "tag": "58aca507-3c74-4e5d-8e68-072d94821cc9"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:28:15.436027 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f34ec22d-a236-47c7-bc3f-f209003a1890 req-11a68f24-985b-46d7-b26b-ae3ea08188d7 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:15.439116 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f34ec22d-a236-47c7-bc3f-f209003a1890 req-11a68f24-985b-46d7-b26b-ae3ea08188d7 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:15.439897 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f34ec22d-a236-47c7-bc3f-f209003a1890 req-11a68f24-985b-46d7-b26b-ae3ea08188d7 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:15.495530 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-f34ec22d-a236-47c7-bc3f-f209003a1890 req-11a68f24-985b-46d7-b26b-ae3ea08188d7 service nova] Creating event network-vif-deleted:58aca507-3c74-4e5d-8e68-072d94821cc9 for instance f791ecb5-63e6-41fc-b2dc-d73701c5773e on n-h2-862686-1 Oct 26 13:28:15.520075 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-f34ec22d-a236-47c7-bc3f-f209003a1890 req-11a68f24-985b-46d7-b26b-ae3ea08188d7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190958 Oct 26 13:28:15.521651 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2620/5212] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:28:15.537682 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-99f967ed-3fb0-4110-a536-43a208ad2d5e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:15.544377 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-23d5b325-a2c0-4706-92de-45a683062682 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "POST /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa/action" status: 200 len: 145 microversion: 2.1 time: 0.335069 Oct 26 13:28:15.545157 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2593/5213] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:28:15 2022] POST /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa/action => generated 145 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:28:15.549566 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-99f967ed-3fb0-4110-a536-43a208ad2d5e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f791ecb5-63e6-41fc-b2dc-d73701c5773e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:15.555293 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-aad35a61-a50c-4b07-b118-03d1f4c9d969 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:15.556008 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-aad35a61-a50c-4b07-b118-03d1f4c9d969 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:15.571512 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99f967ed-3fb0-4110-a536-43a208ad2d5e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:15.575759 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99f967ed-3fb0-4110-a536-43a208ad2d5e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:15.576580 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99f967ed-3fb0-4110-a536-43a208ad2d5e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:15.578312 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99f967ed-3fb0-4110-a536-43a208ad2d5e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:15.580439 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99f967ed-3fb0-4110-a536-43a208ad2d5e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:15.581084 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99f967ed-3fb0-4110-a536-43a208ad2d5e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:15.588571 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aad35a61-a50c-4b07-b118-03d1f4c9d969 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:15.589054 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aad35a61-a50c-4b07-b118-03d1f4c9d969 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:15.589518 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aad35a61-a50c-4b07-b118-03d1f4c9d969 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:15.590244 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aad35a61-a50c-4b07-b118-03d1f4c9d969 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:15.591600 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aad35a61-a50c-4b07-b118-03d1f4c9d969 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:15.591989 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aad35a61-a50c-4b07-b118-03d1f4c9d969 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:15.706666 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99f967ed-3fb0-4110-a536-43a208ad2d5e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:15.707153 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99f967ed-3fb0-4110-a536-43a208ad2d5e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:15.726256 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99f967ed-3fb0-4110-a536-43a208ad2d5e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:15.727030 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-99f967ed-3fb0-4110-a536-43a208ad2d5e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lazy-loading 'fault' on Instance uuid f791ecb5-63e6-41fc-b2dc-d73701c5773e {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:28:15.986850 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-aad35a61-a50c-4b07-b118-03d1f4c9d969 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:16.013541 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-aad35a61-a50c-4b07-b118-03d1f4c9d969 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 0.462128 Oct 26 13:28:16.038156 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2594/5214] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:15 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:16.055465 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b9293811-80d0-48ee-ae53-18c6c454220f tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67320ca1f0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:16.085740 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-99f967ed-3fb0-4110-a536-43a208ad2d5e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:16.099539 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-99f967ed-3fb0-4110-a536-43a208ad2d5e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e" status: 200 len: 1306 microversion: 2.1 time: 0.576486 Oct 26 13:28:16.115025 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2621/5215] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:15 2022] GET /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e => generated 1306 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:16.143321 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-16fd2c1a-9006-461b-a36f-06744d3bb37b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:16.144156 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-16fd2c1a-9006-461b-a36f-06744d3bb37b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:16.176575 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-16fd2c1a-9006-461b-a36f-06744d3bb37b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:16.179836 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-16fd2c1a-9006-461b-a36f-06744d3bb37b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:16.182626 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-16fd2c1a-9006-461b-a36f-06744d3bb37b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:16.186309 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-16fd2c1a-9006-461b-a36f-06744d3bb37b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:16.189340 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-16fd2c1a-9006-461b-a36f-06744d3bb37b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:16.189842 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-16fd2c1a-9006-461b-a36f-06744d3bb37b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:16.282514 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b9293811-80d0-48ee-ae53-18c6c454220f tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f" status: 200 len: 1454 microversion: 2.1 time: 0.239982 Oct 26 13:28:16.283520 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2595/5216] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:16 2022] GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f => generated 1454 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:16.743116 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-16fd2c1a-9006-461b-a36f-06744d3bb37b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:16.754639 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-16fd2c1a-9006-461b-a36f-06744d3bb37b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 0.634856 Oct 26 13:28:16.756282 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2622/5217] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:16 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:16.783313 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-638cd312-7001-4a0f-97d6-2e7b75d1741b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:16.783947 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-638cd312-7001-4a0f-97d6-2e7b75d1741b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:16.817822 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-638cd312-7001-4a0f-97d6-2e7b75d1741b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:16.818418 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-638cd312-7001-4a0f-97d6-2e7b75d1741b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:16.818889 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-638cd312-7001-4a0f-97d6-2e7b75d1741b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:16.819658 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-638cd312-7001-4a0f-97d6-2e7b75d1741b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:16.820131 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-638cd312-7001-4a0f-97d6-2e7b75d1741b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:16.820572 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-638cd312-7001-4a0f-97d6-2e7b75d1741b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:17.149408 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-28d63b7a-a08c-44ce-9af7-e852300080a7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:17.150522 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-28d63b7a-a08c-44ce-9af7-e852300080a7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f791ecb5-63e6-41fc-b2dc-d73701c5773e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:17.187407 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28d63b7a-a08c-44ce-9af7-e852300080a7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:17.187910 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28d63b7a-a08c-44ce-9af7-e852300080a7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:17.188356 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28d63b7a-a08c-44ce-9af7-e852300080a7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:17.189077 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28d63b7a-a08c-44ce-9af7-e852300080a7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:17.189557 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28d63b7a-a08c-44ce-9af7-e852300080a7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:17.189990 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28d63b7a-a08c-44ce-9af7-e852300080a7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:17.237765 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-28d63b7a-a08c-44ce-9af7-e852300080a7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] HTTP exception thrown: Instance f791ecb5-63e6-41fc-b2dc-d73701c5773e could not be found. Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-28d63b7a-a08c-44ce-9af7-e852300080a7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Request method failure captured: Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e HTTP/1.1 Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTWpf9Job1by08RPlBi4BK3ZRus12IuUwpixxL0U8NmqouWwnfDFM_ku9arLt0Dfw_g2zljJol9iSiPHbr2OBJI9bA6xxReUYgF5HT4trI936uilzQCNXRfNWHD8SC65BfL8JHiNMAmXVHxHedc9hkhsO-eHURoIHHJwTTh6ig9qSq0 Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/088eb22706844984b58fe118d5421cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_088eb22706844984b58fe118d5421cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}] Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 9b8db27e3baf4b6a948f6d23c04cf680 Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance f791ecb5-63e6-41fc-b2dc-d73701c5773e could not be found. Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'f791ecb5-63e6-41fc-b2dc-d73701c5773e'} Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f791ecb5-63e6-41fc-b2dc-d73701c5773e could not be found. Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f791ecb5-63e6-41fc-b2dc-d73701c5773e could not be found. Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:28:17.249310 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:17.255070 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:17.255070 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:28:17.255070 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:28:17.255070 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:28:17.255070 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:28:17.255070 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f791ecb5-63e6-41fc-b2dc-d73701c5773e could not be found. Oct 26 13:28:17.255070 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:17.255070 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-28d63b7a-a08c-44ce-9af7-e852300080a7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Returning 404 to user: Instance f791ecb5-63e6-41fc-b2dc-d73701c5773e could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:28:17.255070 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-28d63b7a-a08c-44ce-9af7-e852300080a7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e" status: 404 len: 111 microversion: 2.1 time: 0.106820 Oct 26 13:28:17.258000 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2623/5218] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:17 2022] GET /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:28:17.279730 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2a7790e2-06bd-4b2f-ae79-a4463893d0e6 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:17.280330 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2a7790e2-06bd-4b2f-ae79-a4463893d0e6 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:17.304567 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2a7790e2-06bd-4b2f-ae79-a4463893d0e6 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:17.313107 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2a7790e2-06bd-4b2f-ae79-a4463893d0e6 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:17.315012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2a7790e2-06bd-4b2f-ae79-a4463893d0e6 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:17.315799 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2a7790e2-06bd-4b2f-ae79-a4463893d0e6 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:17.316413 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2a7790e2-06bd-4b2f-ae79-a4463893d0e6 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:17.321961 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2a7790e2-06bd-4b2f-ae79-a4463893d0e6 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:17.519301 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-638cd312-7001-4a0f-97d6-2e7b75d1741b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:17.535856 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-638cd312-7001-4a0f-97d6-2e7b75d1741b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 0.757517 Oct 26 13:28:17.545024 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2596/5219] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:16 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:17.560995 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-be5ca8aa-e5e4-42a0-8a12-93bd64fa6585 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f673197da60>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:17.626616 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2a7790e2-06bd-4b2f-ae79-a4463893d0e6 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:17.634895 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2a7790e2-06bd-4b2f-ae79-a4463893d0e6 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.372521 Oct 26 13:28:17.646984 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-be5ca8aa-e5e4-42a0-8a12-93bd64fa6585 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f" status: 200 len: 1454 microversion: 2.1 time: 0.100789 Oct 26 13:28:17.652964 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2597/5220] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:17 2022] GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f => generated 1454 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:17.661031 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2624/5221] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:17 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:17.665704 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ed711092-4e81-4695-a8a9-27c2ecb5a41a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:17.666990 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ed711092-4e81-4695-a8a9-27c2ecb5a41a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:17.675621 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=32 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:28:17.677595 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed711092-4e81-4695-a8a9-27c2ecb5a41a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:17.678299 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed711092-4e81-4695-a8a9-27c2ecb5a41a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:17.678991 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed711092-4e81-4695-a8a9-27c2ecb5a41a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:17.680067 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed711092-4e81-4695-a8a9-27c2ecb5a41a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:17.680706 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed711092-4e81-4695-a8a9-27c2ecb5a41a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:17.681461 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed711092-4e81-4695-a8a9-27c2ecb5a41a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:17.882952 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2f546607-a87b-4497-993a-904f6e438616 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "56363c00-6608-4ad0-9892-d3ecfbb7f0c5"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2f546607-a87b-4497-993a-904f6e438616 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Request method failure captured: Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 163 Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTWpf9Job1by08RPlBi4BK3ZRus12IuUwpixxL0U8NmqouWwnfDFM_ku9arLt0Dfw_g2zljJol9iSiPHbr2OBJI9bA6xxReUYgF5HT4trI936uilzQCNXRfNWHD8SC65BfL8JHiNMAmXVHxHedc9hkhsO-eHURoIHHJwTTh6ig9qSq0 Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/088eb22706844984b58fe118d5421cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_088eb22706844984b58fe118d5421cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}] Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 9b8db27e3baf4b6a948f6d23c04cf680 Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: {"server": {"name": 12345, "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "56363c00-6608-4ad0-9892-d3ecfbb7f0c5"}]}} Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '762c20f4-0f9b-45cb-bd95-cf21a747b33b', 'flavorRef': '452', 'networks': [{'uuid': '56363c00-6608-4ad0-9892-d3ecfbb7f0c5'}]}}} Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise error Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi 12345 Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 13:28:17.941837 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 13:28:17.975832 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 13:28:17.975832 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 26 13:28:17.975832 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:17.975832 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:28:17.975832 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:17.975832 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:17.975832 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:28:17.975832 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:28:17.975832 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 13:28:17.975832 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 13:28:17.975832 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 26 13:28:17.975832 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:17.975832 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2f546607-a87b-4497-993a-904f6e438616 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:28:17.975832 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2f546607-a87b-4497-993a-904f6e438616 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.068835 Oct 26 13:28:17.975832 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2625/5222] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:28:17 2022] POST /compute/v2.1/servers => generated 127 bytes in 70 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:28:17.993035 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f7155023-28de-4496-a9a7-a5a2f1b6f18e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:17.995061 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f7155023-28de-4496-a9a7-a5a2f1b6f18e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:18.013296 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7155023-28de-4496-a9a7-a5a2f1b6f18e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:18.014218 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7155023-28de-4496-a9a7-a5a2f1b6f18e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:18.024905 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7155023-28de-4496-a9a7-a5a2f1b6f18e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:18.025795 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7155023-28de-4496-a9a7-a5a2f1b6f18e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:18.026510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7155023-28de-4496-a9a7-a5a2f1b6f18e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:18.027302 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7155023-28de-4496-a9a7-a5a2f1b6f18e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:18.376159 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f7155023-28de-4496-a9a7-a5a2f1b6f18e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:18.395404 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f7155023-28de-4496-a9a7-a5a2f1b6f18e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.412580 Oct 26 13:28:18.400434 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2626/5223] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:17 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:18.432246 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cd9d0e1f-8408-4581-8ed1-fa92c176cf93 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:18.433098 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cd9d0e1f-8408-4581-8ed1-fa92c176cf93 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:18.443325 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cd9d0e1f-8408-4581-8ed1-fa92c176cf93 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:18.444280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cd9d0e1f-8408-4581-8ed1-fa92c176cf93 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:18.445063 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cd9d0e1f-8408-4581-8ed1-fa92c176cf93 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:18.446205 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cd9d0e1f-8408-4581-8ed1-fa92c176cf93 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:18.446887 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cd9d0e1f-8408-4581-8ed1-fa92c176cf93 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:18.447551 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cd9d0e1f-8408-4581-8ed1-fa92c176cf93 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:18.714202 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-cd9d0e1f-8408-4581-8ed1-fa92c176cf93 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:18.727942 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cd9d0e1f-8408-4581-8ed1-fa92c176cf93 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.300860 Oct 26 13:28:18.729207 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2627/5224] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:18 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:18.734523 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-214b4a2c-1637-41d1-80a0-f1b8ef198ffb tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67367f4d30>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:18.797744 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-214b4a2c-1637-41d1-80a0-f1b8ef198ffb tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f" status: 200 len: 1463 microversion: 2.1 time: 0.067080 Oct 26 13:28:18.799345 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2628/5225] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:18 2022] GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f => generated 1463 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:18.815298 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9c72593d-0b74-4d5d-ab1e-17fb1e44cdc7 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67317f61f0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:18.891926 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9c72593d-0b74-4d5d-ab1e-17fb1e44cdc7 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f" status: 200 len: 1463 microversion: 2.1 time: 0.082266 Oct 26 13:28:18.893927 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2629/5226] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:18 2022] GET /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f => generated 1463 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:18.916196 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b78674ec-c9e7-4f78-886f-77d850b788e6 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:18.920560 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b78674ec-c9e7-4f78-886f-77d850b788e6 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] [instance: 8536123b-d626-498f-bfc7-9b76553e3d04] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:18.933223 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:28:18.947477 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b78674ec-c9e7-4f78-886f-77d850b788e6 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:18.950800 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b78674ec-c9e7-4f78-886f-77d850b788e6 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:18.953131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b78674ec-c9e7-4f78-886f-77d850b788e6 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:18.954491 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b78674ec-c9e7-4f78-886f-77d850b788e6 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:18.956597 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b78674ec-c9e7-4f78-886f-77d850b788e6 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:18.958336 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b78674ec-c9e7-4f78-886f-77d850b788e6 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:19.260469 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ed711092-4e81-4695-a8a9-27c2ecb5a41a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:19.277082 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ed711092-4e81-4695-a8a9-27c2ecb5a41a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 1.619534 Oct 26 13:28:19.306384 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2598/5227] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:17 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 1644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:19.404321 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b78674ec-c9e7-4f78-886f-77d850b788e6 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674435111c05455fb1eb5b213d1373c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66f4a941524e30b05360a3ccb2e449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:19.428275 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b78674ec-c9e7-4f78-886f-77d850b788e6 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04" status: 200 len: 1468 microversion: 2.1 time: 0.523434 Oct 26 13:28:19.428913 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2630/5228] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:18 2022] GET /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04 => generated 1468 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:19.455499 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a20b8e2b-cda3-4d3b-a006-3bedfec4417f tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-947514506"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:28:19.458269 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a20b8e2b-cda3-4d3b-a006-3bedfec4417f tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] [instance: 56c29b20-837e-4f90-9213-99699295a6af] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:19.469442 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a20b8e2b-cda3-4d3b-a006-3bedfec4417f tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:19.472591 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a20b8e2b-cda3-4d3b-a006-3bedfec4417f tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:19.473106 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a20b8e2b-cda3-4d3b-a006-3bedfec4417f tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:19.473874 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a20b8e2b-cda3-4d3b-a006-3bedfec4417f tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:19.474347 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a20b8e2b-cda3-4d3b-a006-3bedfec4417f tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:19.474783 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a20b8e2b-cda3-4d3b-a006-3bedfec4417f tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:19.537941 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f3a4d05b-3a27-4388-a1d0-91fd8ccf72ba tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1718930253", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "52e622a6-1003-4403-bde9-f622c42344c6"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:28:19.655727 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-f3a4d05b-3a27-4388-a1d0-91fd8ccf72ba tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] validate_networks() for [('52e622a6-1003-4403-bde9-f622c42344c6', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:28:20.069172 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a20b8e2b-cda3-4d3b-a006-3bedfec4417f tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "POST /compute/v2.1/servers/56c29b20-837e-4f90-9213-99699295a6af/action" status: 202 len: 0 microversion: 2.1 time: 0.617734 Oct 26 13:28:20.078349 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2599/5229] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:28:19 2022] POST /compute/v2.1/servers/56c29b20-837e-4f90-9213-99699295a6af/action => generated 0 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 26 13:28:20.094137 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d07b5858-266a-4c42-ad17-bf2f139eee01 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67320caa60>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:20.173749 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d07b5858-266a-4c42-ad17-bf2f139eee01 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc" status: 200 len: 1454 microversion: 2.1 time: 0.088548 Oct 26 13:28:20.185325 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2600/5230] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:20 2022] GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc => generated 1454 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:21.189856 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9d7bc2fb-d501-4109-b55d-7b501c3de17f tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f673197da60>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:21.293243 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9d7bc2fb-d501-4109-b55d-7b501c3de17f tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc" status: 200 len: 1454 microversion: 2.1 time: 0.107122 Oct 26 13:28:21.302124 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2601/5231] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:21 2022] GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc => generated 1454 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:21.741269 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-f3a4d05b-3a27-4388-a1d0-91fd8ccf72ba tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:28:21.741873 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-f3a4d05b-3a27-4388-a1d0-91fd8ccf72ba tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:28:21.742105 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-f3a4d05b-3a27-4388-a1d0-91fd8ccf72ba tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:28:21.742507 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-f3a4d05b-3a27-4388-a1d0-91fd8ccf72ba tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:28:21.742915 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-f3a4d05b-3a27-4388-a1d0-91fd8ccf72ba tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:28:21.768971 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f3a4d05b-3a27-4388-a1d0-91fd8ccf72ba tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:21.769471 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f3a4d05b-3a27-4388-a1d0-91fd8ccf72ba tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:21.776567 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f3a4d05b-3a27-4388-a1d0-91fd8ccf72ba tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:21.777398 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f3a4d05b-3a27-4388-a1d0-91fd8ccf72ba tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:21.779982 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f3a4d05b-3a27-4388-a1d0-91fd8ccf72ba tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:21.780463 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f3a4d05b-3a27-4388-a1d0-91fd8ccf72ba tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:21.830182 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-f3a4d05b-3a27-4388-a1d0-91fd8ccf72ba tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Getting quotas for project c0d1b1d2fe374ee5806eeee18712219f. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:28:21.836591 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-f3a4d05b-3a27-4388-a1d0-91fd8ccf72ba tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Getting quotas for user 3e9ff5a884f1416886f26a80c5b87b18 and project c0d1b1d2fe374ee5806eeee18712219f. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:28:21.888394 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f3a4d05b-3a27-4388-a1d0-91fd8ccf72ba tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:28:21.896530 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f3a4d05b-3a27-4388-a1d0-91fd8ccf72ba tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 3513f7b0-b7d1-4b0f-963e-709a892a275d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:28:21.992613 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f3a4d05b-3a27-4388-a1d0-91fd8ccf72ba tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.458945 Oct 26 13:28:21.993868 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2631/5232] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:28:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2461 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:28:22.007264 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5b3c011e-be56-42a7-ba52-27af334e8a41 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:22.008262 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5b3c011e-be56-42a7-ba52-27af334e8a41 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 3513f7b0-b7d1-4b0f-963e-709a892a275d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:22.214329 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-eff8d451-2bc9-4415-8e92-fae8e71dcc58 req-f015bb9f-a8b5-4561-a69e-5363f8fd0e76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8536123b-d626-498f-bfc7-9b76553e3d04", "name": "network-vif-unplugged", "status": "completed", "tag": "426db0e6-96c1-46f4-a233-8b1dafdaebaf"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:28:22.256721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-eff8d451-2bc9-4415-8e92-fae8e71dcc58 req-f015bb9f-a8b5-4561-a69e-5363f8fd0e76 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:22.262163 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-eff8d451-2bc9-4415-8e92-fae8e71dcc58 req-f015bb9f-a8b5-4561-a69e-5363f8fd0e76 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:22.264227 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-eff8d451-2bc9-4415-8e92-fae8e71dcc58 req-f015bb9f-a8b5-4561-a69e-5363f8fd0e76 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:22.285086 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:28:22.331897 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-eff8d451-2bc9-4415-8e92-fae8e71dcc58 req-f015bb9f-a8b5-4561-a69e-5363f8fd0e76 service nova] Creating event network-vif-unplugged:426db0e6-96c1-46f4-a233-8b1dafdaebaf for instance 8536123b-d626-498f-bfc7-9b76553e3d04 on n-h1-862686-1 Oct 26 13:28:22.345256 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-eff8d451-2bc9-4415-8e92-fae8e71dcc58 req-f015bb9f-a8b5-4561-a69e-5363f8fd0e76 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.130753 Oct 26 13:28:22.345827 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2632/5233] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:28:22.361595 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b1e3c976-f2f5-49b0-8aa1-d65c7c37c9af tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f6731716f70>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:22.364870 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5b3c011e-be56-42a7-ba52-27af334e8a41 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:22.400760 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5b3c011e-be56-42a7-ba52-27af334e8a41 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d" status: 200 len: 1215 microversion: 2.1 time: 0.398162 Oct 26 13:28:22.426743 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2602/5234] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:22 2022] GET /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d => generated 1215 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:28:22.469907 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b1e3c976-f2f5-49b0-8aa1-d65c7c37c9af tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc" status: 200 len: 1454 microversion: 2.1 time: 0.122252 Oct 26 13:28:22.488324 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2633/5235] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:22 2022] GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc => generated 1454 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:23.378921 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c10e8624-9418-4237-8bb8-f2cbeb2c9f3f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-342899589", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "a4f9d831-73ef-45db-b479-446aebe5cf22", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "56363c00-6608-4ad0-9892-d3ecfbb7f0c5"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:28:23.429273 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fd32215e-3fd9-4363-b51d-4855e9562736 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:23.430186 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fd32215e-3fd9-4363-b51d-4855e9562736 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 3513f7b0-b7d1-4b0f-963e-709a892a275d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:23.444311 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd32215e-3fd9-4363-b51d-4855e9562736 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:23.446010 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd32215e-3fd9-4363-b51d-4855e9562736 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:23.449387 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd32215e-3fd9-4363-b51d-4855e9562736 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:23.450335 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd32215e-3fd9-4363-b51d-4855e9562736 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:23.450930 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd32215e-3fd9-4363-b51d-4855e9562736 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:23.451505 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd32215e-3fd9-4363-b51d-4855e9562736 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:23.568634 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-c10e8624-9418-4237-8bb8-f2cbeb2c9f3f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] HTTP exception thrown: Block Device a4f9d831-73ef-45db-b479-446aebe5cf22 is not bootable. Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c10e8624-9418-4237-8bb8-f2cbeb2c9f3f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Request method failure captured: Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 357 Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTWpf9Job1by08RPlBi4BK3ZRus12IuUwpixxL0U8NmqouWwnfDFM_ku9arLt0Dfw_g2zljJol9iSiPHbr2OBJI9bA6xxReUYgF5HT4trI936uilzQCNXRfNWHD8SC65BfL8JHiNMAmXVHxHedc9hkhsO-eHURoIHHJwTTh6ig9qSq0 Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/088eb22706844984b58fe118d5421cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_088eb22706844984b58fe118d5421cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}] Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 9b8db27e3baf4b6a948f6d23c04cf680 Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-342899589", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "a4f9d831-73ef-45db-b479-446aebe5cf22", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "56363c00-6608-4ad0-9892-d3ecfbb7f0c5"}]}} Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: exception: Block Device a4f9d831-73ef-45db-b479-446aebe5cf22 is not bootable. Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-342899589', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'a4f9d831-73ef-45db-b479-446aebe5cf22'}], 'networks': [{'uuid': '56363c00-6608-4ad0-9892-d3ecfbb7f0c5'}]}}} Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device a4f9d831-73ef-45db-b479-446aebe5cf22 is not bootable. Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:28:23.582566 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:28:23.588850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:28:23.588850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:28:23.588850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:28:23.588850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 26 13:28:23.588850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 26 13:28:23.588850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 26 13:28:23.588850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device a4f9d831-73ef-45db-b479-446aebe5cf22 is not bootable. Oct 26 13:28:23.588850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:23.588850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:28:23.588850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:23.588850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:23.588850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:28:23.588850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:28:23.588850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:28:23.588850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:28:23.588850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device a4f9d831-73ef-45db-b479-446aebe5cf22 is not bootable. Oct 26 13:28:23.588850 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:23.588850 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c10e8624-9418-4237-8bb8-f2cbeb2c9f3f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Returning 400 to user: Block Device a4f9d831-73ef-45db-b479-446aebe5cf22 is not bootable. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:28:23.588850 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c10e8624-9418-4237-8bb8-f2cbeb2c9f3f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.210743 Oct 26 13:28:23.588850 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2603/5236] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:28:23 2022] POST /compute/v2.1/servers => generated 110 bytes in 212 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:28:23.593871 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1b10d684-8569-4c02-8b62-2d2e1aff2ee1 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67320cadc0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:23.700798 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1b10d684-8569-4c02-8b62-2d2e1aff2ee1 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc" status: 200 len: 1454 microversion: 2.1 time: 0.111936 Oct 26 13:28:23.703073 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2604/5237] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:23 2022] GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc => generated 1454 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:23.719221 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0068d251-f4a9-49fd-be00-7b05f6170f99 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:23.719855 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0068d251-f4a9-49fd-be00-7b05f6170f99 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:23.729710 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fd32215e-3fd9-4363-b51d-4855e9562736 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:23.745285 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0068d251-f4a9-49fd-be00-7b05f6170f99 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:23.748486 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fd32215e-3fd9-4363-b51d-4855e9562736 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d" status: 200 len: 1219 microversion: 2.1 time: 0.324178 Oct 26 13:28:23.755546 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0068d251-f4a9-49fd-be00-7b05f6170f99 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:23.756063 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0068d251-f4a9-49fd-be00-7b05f6170f99 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:23.756834 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0068d251-f4a9-49fd-be00-7b05f6170f99 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:23.757374 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0068d251-f4a9-49fd-be00-7b05f6170f99 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:23.757780 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0068d251-f4a9-49fd-be00-7b05f6170f99 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:23.758569 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2634/5238] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:23 2022] GET /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d => generated 1219 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:28:23.846858 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:28:24.334364 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0068d251-f4a9-49fd-be00-7b05f6170f99 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:24.347001 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0068d251-f4a9-49fd-be00-7b05f6170f99 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.642838 Oct 26 13:28:24.351526 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2605/5239] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:23 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:24.384275 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2fcb692d-59d6-49a7-b8e1-076e1f945eb8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:24.384896 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2fcb692d-59d6-49a7-b8e1-076e1f945eb8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:24.422642 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2fcb692d-59d6-49a7-b8e1-076e1f945eb8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:24.431907 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2fcb692d-59d6-49a7-b8e1-076e1f945eb8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:24.432894 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2fcb692d-59d6-49a7-b8e1-076e1f945eb8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:24.435070 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2fcb692d-59d6-49a7-b8e1-076e1f945eb8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:24.436052 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2fcb692d-59d6-49a7-b8e1-076e1f945eb8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:24.437145 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2fcb692d-59d6-49a7-b8e1-076e1f945eb8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:24.728785 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8c494142-b005-42ed-8981-3d46c2b1094b tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f673198f9d0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:24.845047 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8c494142-b005-42ed-8981-3d46c2b1094b tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc" status: 200 len: 1454 microversion: 2.1 time: 0.130527 Oct 26 13:28:24.852729 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2606/5240] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:24 2022] GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc => generated 1454 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:24.858657 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5c0af80c-f5ef-4e23-9cc1-12ed55659f90 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:24.859258 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5c0af80c-f5ef-4e23-9cc1-12ed55659f90 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 3513f7b0-b7d1-4b0f-963e-709a892a275d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:24.909936 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c0af80c-f5ef-4e23-9cc1-12ed55659f90 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:24.910791 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c0af80c-f5ef-4e23-9cc1-12ed55659f90 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:24.911412 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c0af80c-f5ef-4e23-9cc1-12ed55659f90 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:24.913185 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c0af80c-f5ef-4e23-9cc1-12ed55659f90 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:24.914913 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c0af80c-f5ef-4e23-9cc1-12ed55659f90 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:24.915739 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c0af80c-f5ef-4e23-9cc1-12ed55659f90 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:25.455708 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2fcb692d-59d6-49a7-b8e1-076e1f945eb8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:25.478617 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2fcb692d-59d6-49a7-b8e1-076e1f945eb8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 1.098137 Oct 26 13:28:25.510086 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2635/5241] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:24 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:25.533679 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5c0af80c-f5ef-4e23-9cc1-12ed55659f90 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:25.543209 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5c0af80c-f5ef-4e23-9cc1-12ed55659f90 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d" status: 200 len: 1285 microversion: 2.1 time: 0.694287 Oct 26 13:28:25.546477 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2607/5242] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:24 2022] GET /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d => generated 1285 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:25.884636 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f22ec015-fc88-46cb-a135-61817c468bc1 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67317745e0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:25.983691 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f22ec015-fc88-46cb-a135-61817c468bc1 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc" status: 200 len: 1454 microversion: 2.1 time: 0.115629 Oct 26 13:28:25.984284 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2636/5243] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:25 2022] GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc => generated 1454 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:26.572738 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9ef13851-6844-4a2e-b5e2-90268f7479ea tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:26.573353 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9ef13851-6844-4a2e-b5e2-90268f7479ea tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 3513f7b0-b7d1-4b0f-963e-709a892a275d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:26.605124 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9ef13851-6844-4a2e-b5e2-90268f7479ea tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:26.608002 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9ef13851-6844-4a2e-b5e2-90268f7479ea tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:26.608582 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9ef13851-6844-4a2e-b5e2-90268f7479ea tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:26.609395 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9ef13851-6844-4a2e-b5e2-90268f7479ea tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:26.615285 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9ef13851-6844-4a2e-b5e2-90268f7479ea tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:26.618211 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9ef13851-6844-4a2e-b5e2-90268f7479ea tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:27.002718 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5bbe8037-0054-4177-a2a0-28419351374a tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67317f65e0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:27.105164 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5bbe8037-0054-4177-a2a0-28419351374a tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc" status: 200 len: 1454 microversion: 2.1 time: 0.109925 Oct 26 13:28:27.109255 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2637/5244] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:26 2022] GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc => generated 1454 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:28:27.290921 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9ef13851-6844-4a2e-b5e2-90268f7479ea tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:27.308855 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9ef13851-6844-4a2e-b5e2-90268f7479ea tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d" status: 200 len: 1273 microversion: 2.1 time: 0.739904 Oct 26 13:28:27.312544 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2608/5245] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:26 2022] GET /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d => generated 1273 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:28.127386 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-42f5f698-9188-4ff1-9cd2-34ca5fcd4596 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67319ad430>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:28.243444 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-42f5f698-9188-4ff1-9cd2-34ca5fcd4596 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc" status: 200 len: 1454 microversion: 2.1 time: 0.122448 Oct 26 13:28:28.244933 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2638/5246] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:28 2022] GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc => generated 1454 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:28.969071 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fa3a9ad5-e643-4191-8985-528077a67133 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:28.971735 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fa3a9ad5-e643-4191-8985-528077a67133 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 3513f7b0-b7d1-4b0f-963e-709a892a275d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:28.992275 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-28b9bcf5-2862-4a1e-b187-f202008a8360 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-934397861", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "destination_type": "local"}, {"source_type": "volume", "uuid": "e2d35a29-45c0-4f48-b32e-6568502d50c5", "destination_type": "invalid"}], "networks": [{"uuid": "56363c00-6608-4ad0-9892-d3ecfbb7f0c5"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-28b9bcf5-2862-4a1e-b187-f202008a8360 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Request method failure captured: Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 494 Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTWpf9Job1by08RPlBi4BK3ZRus12IuUwpixxL0U8NmqouWwnfDFM_ku9arLt0Dfw_g2zljJol9iSiPHbr2OBJI9bA6xxReUYgF5HT4trI936uilzQCNXRfNWHD8SC65BfL8JHiNMAmXVHxHedc9hkhsO-eHURoIHHJwTTh6ig9qSq0 Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/088eb22706844984b58fe118d5421cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_088eb22706844984b58fe118d5421cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}] Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 9b8db27e3baf4b6a948f6d23c04cf680 Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-934397861", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "destination_type": "local"}, {"source_type": "volume", "uuid": "e2d35a29-45c0-4f48-b32e-6568502d50c5", "destination_type": "invalid"}], "networks": [{"uuid": "56363c00-6608-4ad0-9892-d3ecfbb7f0c5"}]}} Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-934397861', 'imageRef': '762c20f4-0f9b-45cb-bd95-cf21a747b33b', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '762c20f4-0f9b-45cb-bd95-cf21a747b33b', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'e2d35a29-45c0-4f48-b32e-6568502d50c5', 'destination_type': 'invalid'}], 'networks': [{'uuid': '56363c00-6608-4ad0-9892-d3ecfbb7f0c5'}]}}} Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise error Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi 'invalid' Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:28:29.000901 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:28:29.008008 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:28:29.008008 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:28:29.008008 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 13:28:29.008008 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 13:28:29.008008 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 13:28:29.008008 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 13:28:29.008008 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 13:28:29.008008 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 13:28:29.008008 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 26 13:28:29.008008 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:29.008008 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:28:29.008008 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:29.008008 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:29.008008 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:28:29.008008 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:28:29.008008 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 13:28:29.008008 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 13:28:29.008008 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 26 13:28:29.008008 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:29.017297 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-28b9bcf5-2862-4a1e-b187-f202008a8360 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:28:29.026634 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa3a9ad5-e643-4191-8985-528077a67133 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:29.029263 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-28b9bcf5-2862-4a1e-b187-f202008a8360 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.034209 Oct 26 13:28:29.030542 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2639/5247] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:28:28 2022] POST /compute/v2.1/servers => generated 155 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:28:29.032553 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa3a9ad5-e643-4191-8985-528077a67133 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:29.034161 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa3a9ad5-e643-4191-8985-528077a67133 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:29.036289 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa3a9ad5-e643-4191-8985-528077a67133 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:29.046289 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa3a9ad5-e643-4191-8985-528077a67133 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:29.050631 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-efecd745-71d3-4c65-8e85-19b1a698ed81 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:29.051463 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa3a9ad5-e643-4191-8985-528077a67133 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:29.066705 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-efecd745-71d3-4c65-8e85-19b1a698ed81 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:29.097343 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-efecd745-71d3-4c65-8e85-19b1a698ed81 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:29.097895 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-efecd745-71d3-4c65-8e85-19b1a698ed81 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:29.098340 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-efecd745-71d3-4c65-8e85-19b1a698ed81 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:29.099075 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-efecd745-71d3-4c65-8e85-19b1a698ed81 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:29.099547 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-efecd745-71d3-4c65-8e85-19b1a698ed81 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:29.099989 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-efecd745-71d3-4c65-8e85-19b1a698ed81 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:29.565607 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fa3a9ad5-e643-4191-8985-528077a67133 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:29.578389 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fa3a9ad5-e643-4191-8985-528077a67133 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d" status: 200 len: 1315 microversion: 2.1 time: 1.245161 Oct 26 13:28:29.582199 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2609/5248] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:28 2022] GET /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d => generated 1315 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:29.598511 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ff3d8e60-daa8-4ea9-88d4-af87613e0bbb tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f673231c1f0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:29.705743 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ff3d8e60-daa8-4ea9-88d4-af87613e0bbb tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc" status: 200 len: 1454 microversion: 2.1 time: 0.120067 Oct 26 13:28:29.707518 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2610/5249] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:29 2022] GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc => generated 1454 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:30.065509 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-efecd745-71d3-4c65-8e85-19b1a698ed81 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:30.075939 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-efecd745-71d3-4c65-8e85-19b1a698ed81 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 1.040203 Oct 26 13:28:30.087050 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2640/5250] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:29 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:30.112314 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5246777d-2a77-4160-b156-431df3a8ce0d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:30.113705 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5246777d-2a77-4160-b156-431df3a8ce0d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:30.126931 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5246777d-2a77-4160-b156-431df3a8ce0d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:30.130662 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5246777d-2a77-4160-b156-431df3a8ce0d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:30.133134 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5246777d-2a77-4160-b156-431df3a8ce0d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:30.138208 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5246777d-2a77-4160-b156-431df3a8ce0d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:30.138890 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5246777d-2a77-4160-b156-431df3a8ce0d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:30.139877 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5246777d-2a77-4160-b156-431df3a8ce0d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:30.371336 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-dc016bda-aaf0-4e84-ac37-d71869203d2a req-ac447d47-5a7d-4502-aa35-d9a952289f99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3513f7b0-b7d1-4b0f-963e-709a892a275d", "tag": "3a852438-a4fa-48a5-9409-c33ffc92d395"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:28:30.404413 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-dc016bda-aaf0-4e84-ac37-d71869203d2a req-ac447d47-5a7d-4502-aa35-d9a952289f99 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:30.410399 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-dc016bda-aaf0-4e84-ac37-d71869203d2a req-ac447d47-5a7d-4502-aa35-d9a952289f99 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:30.410859 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-dc016bda-aaf0-4e84-ac37-d71869203d2a req-ac447d47-5a7d-4502-aa35-d9a952289f99 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:30.463667 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-dc016bda-aaf0-4e84-ac37-d71869203d2a req-ac447d47-5a7d-4502-aa35-d9a952289f99 service nova] Creating event network-changed:3a852438-a4fa-48a5-9409-c33ffc92d395 for instance 3513f7b0-b7d1-4b0f-963e-709a892a275d on n-h2-862686-1 Oct 26 13:28:30.480201 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-dc016bda-aaf0-4e84-ac37-d71869203d2a req-ac447d47-5a7d-4502-aa35-d9a952289f99 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113838 Oct 26 13:28:30.484027 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2641/5251] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 26 13:28:30.604162 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-13e40394-a85e-4f1e-abb4-8c9b8434a0c9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:30.604951 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-13e40394-a85e-4f1e-abb4-8c9b8434a0c9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 3513f7b0-b7d1-4b0f-963e-709a892a275d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:30.620942 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-13e40394-a85e-4f1e-abb4-8c9b8434a0c9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:30.620942 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-13e40394-a85e-4f1e-abb4-8c9b8434a0c9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:30.620942 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-13e40394-a85e-4f1e-abb4-8c9b8434a0c9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:30.620942 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-13e40394-a85e-4f1e-abb4-8c9b8434a0c9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:30.620942 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-13e40394-a85e-4f1e-abb4-8c9b8434a0c9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:30.620942 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-13e40394-a85e-4f1e-abb4-8c9b8434a0c9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:30.908130 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5246777d-2a77-4160-b156-431df3a8ce0d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:30.920572 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5246777d-2a77-4160-b156-431df3a8ce0d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.812974 Oct 26 13:28:30.928058 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2611/5252] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:30 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:30.944331 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9a40f6b3-98e2-4e9b-9ced-ae4d161d0bab tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f673197d5e0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:31.058782 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9a40f6b3-98e2-4e9b-9ced-ae4d161d0bab tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc" status: 200 len: 1454 microversion: 2.1 time: 0.129545 Oct 26 13:28:31.066783 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2612/5253] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:30 2022] GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc => generated 1454 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:31.077557 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e7550d0a-21c6-41fd-b587-cff7b26d03d3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1639270397", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "56363c00-6608-4ad0-9892-d3ecfbb7f0c5"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:28:31.096244 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e7550d0a-21c6-41fd-b587-cff7b26d03d3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Request method failure captured: Oct 26 13:28:31.096244 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 13:28:31.096244 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:28:31.096244 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:28:31.096244 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:28:31.096244 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 492 Oct 26 13:28:31.096244 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:28:31.096244 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:28:31.096244 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:28:31.096244 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:28:31.096244 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTWpf9Job1by08RPlBi4BK3ZRus12IuUwpixxL0U8NmqouWwnfDFM_ku9arLt0Dfw_g2zljJol9iSiPHbr2OBJI9bA6xxReUYgF5HT4trI936uilzQCNXRfNWHD8SC65BfL8JHiNMAmXVHxHedc9hkhsO-eHURoIHHJwTTh6ig9qSq0 Oct 26 13:28:31.096244 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:28:31.096244 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:28:31.096244 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:28:31.096244 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:28:31.096244 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:28:31.096244 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:28:31.096244 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:28:31.096244 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:31.096244 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:28:31.096244 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:28:31.096244 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/088eb22706844984b58fe118d5421cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_088eb22706844984b58fe118d5421cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}] Oct 26 13:28:31.096244 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:31.096244 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:28:31.096244 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:31.096244 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:28:31.096244 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:28:31.096244 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:28:31.096244 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 9b8db27e3baf4b6a948f6d23c04cf680 Oct 26 13:28:31.096244 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:28:31.096244 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:28:31.096244 n-d-862686-1 devstack@n-api.service[120597]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1639270397", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "56363c00-6608-4ad0-9892-d3ecfbb7f0c5"}]}} Oct 26 13:28:31.096244 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:28:31.096244 n-d-862686-1 devstack@n-api.service[120597]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 26 13:28:31.096244 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1639270397', 'imageRef': '762c20f4-0f9b-45cb-bd95-cf21a747b33b', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '56363c00-6608-4ad0-9892-d3ecfbb7f0c5'}]}}} Oct 26 13:28:31.096244 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:28:31.096244 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:31.096244 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 13:28:31.096244 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 13:28:31.096244 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 13:28:31.096244 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise error Oct 26 13:28:31.096244 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 26 13:28:31.096244 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:31.096244 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 26 13:28:31.096244 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 26 13:28:31.096244 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:31.096244 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 26 13:28:31.100307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 26 13:28:31.100307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:31.100307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:28:31.100307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:31.100307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:31.100307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:28:31.100307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:28:31.100307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:28:31.100307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:28:31.100307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:28:31.100307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:28:31.100307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:28:31.100307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:28:31.100307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 13:28:31.100307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 13:28:31.100307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 13:28:31.100307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 13:28:31.100307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 13:28:31.100307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 13:28:31.100307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 26 13:28:31.100307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:31.100307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:28:31.100307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:31.100307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:31.100307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:28:31.100307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:28:31.100307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 13:28:31.100307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 13:28:31.100307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 26 13:28:31.100307 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:31.100307 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e7550d0a-21c6-41fd-b587-cff7b26d03d3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:28:31.100307 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e7550d0a-21c6-41fd-b587-cff7b26d03d3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.035754 Oct 26 13:28:31.104077 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2613/5254] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:28:31 2022] POST /compute/v2.1/servers => generated 624 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:28:31.124556 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-da2e9bee-3229-4513-a679-750d5facf290 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:31.129789 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-da2e9bee-3229-4513-a679-750d5facf290 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:31.154235 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-da2e9bee-3229-4513-a679-750d5facf290 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:31.154762 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-da2e9bee-3229-4513-a679-750d5facf290 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:31.163720 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-da2e9bee-3229-4513-a679-750d5facf290 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:31.164586 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-da2e9bee-3229-4513-a679-750d5facf290 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:31.170991 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-da2e9bee-3229-4513-a679-750d5facf290 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:31.171531 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-da2e9bee-3229-4513-a679-750d5facf290 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:31.366089 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-13e40394-a85e-4f1e-abb4-8c9b8434a0c9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:31.375190 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-13e40394-a85e-4f1e-abb4-8c9b8434a0c9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d" status: 200 len: 1315 microversion: 2.1 time: 0.776169 Oct 26 13:28:31.382138 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2642/5255] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:30 2022] GET /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d => generated 1315 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:31.870132 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-da2e9bee-3229-4513-a679-750d5facf290 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:31.908735 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-da2e9bee-3229-4513-a679-750d5facf290 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.786741 Oct 26 13:28:31.918106 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2614/5256] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:31 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:31.971328 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e342b252-4a13-4ab2-8873-059866fc6e27 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:31.972490 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e342b252-4a13-4ab2-8873-059866fc6e27 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:32.005609 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:28:32.010620 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:28:32.024955 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e342b252-4a13-4ab2-8873-059866fc6e27 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:32.025973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e342b252-4a13-4ab2-8873-059866fc6e27 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:32.029339 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e342b252-4a13-4ab2-8873-059866fc6e27 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:32.053874 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e342b252-4a13-4ab2-8873-059866fc6e27 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:32.054722 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e342b252-4a13-4ab2-8873-059866fc6e27 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:32.055456 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e342b252-4a13-4ab2-8873-059866fc6e27 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:32.084361 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f0f9f355-44ab-4e23-8afc-291727785a58 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f673196e9d0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:32.182036 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f0f9f355-44ab-4e23-8afc-291727785a58 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc" status: 200 len: 1454 microversion: 2.1 time: 0.111423 Oct 26 13:28:32.196087 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2615/5257] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:32 2022] GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc => generated 1454 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:28:32.215421 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-a0b61157-f77a-442f-ace6-f6789e920bc9 req-d3fea0ca-42ba-4400-a9dc-c32e2e69ea7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56c29b20-837e-4f90-9213-99699295a6af", "name": "network-vif-plugged", "status": "completed", "tag": "38eb9476-6dba-4c83-886a-1e2f98837aa4"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:28:32.268286 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a0b61157-f77a-442f-ace6-f6789e920bc9 req-d3fea0ca-42ba-4400-a9dc-c32e2e69ea7a service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:32.268789 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a0b61157-f77a-442f-ace6-f6789e920bc9 req-d3fea0ca-42ba-4400-a9dc-c32e2e69ea7a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:32.269228 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a0b61157-f77a-442f-ace6-f6789e920bc9 req-d3fea0ca-42ba-4400-a9dc-c32e2e69ea7a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:32.328052 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-a0b61157-f77a-442f-ace6-f6789e920bc9 req-d3fea0ca-42ba-4400-a9dc-c32e2e69ea7a service nova] Creating event network-vif-plugged:38eb9476-6dba-4c83-886a-1e2f98837aa4 for instance 56c29b20-837e-4f90-9213-99699295a6af on n-h1-862686-1 Oct 26 13:28:32.349588 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-a0b61157-f77a-442f-ace6-f6789e920bc9 req-d3fea0ca-42ba-4400-a9dc-c32e2e69ea7a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151784 Oct 26 13:28:32.361467 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2616/5258] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:28:32.406597 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7b0ee2e9-cc32-4f93-9b2d-fe1a31760f26 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:32.407622 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7b0ee2e9-cc32-4f93-9b2d-fe1a31760f26 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 3513f7b0-b7d1-4b0f-963e-709a892a275d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:32.410966 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:28:32.440654 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b0ee2e9-cc32-4f93-9b2d-fe1a31760f26 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:32.441166 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b0ee2e9-cc32-4f93-9b2d-fe1a31760f26 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:32.441668 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b0ee2e9-cc32-4f93-9b2d-fe1a31760f26 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:32.450357 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b0ee2e9-cc32-4f93-9b2d-fe1a31760f26 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:32.453908 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b0ee2e9-cc32-4f93-9b2d-fe1a31760f26 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:32.457797 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b0ee2e9-cc32-4f93-9b2d-fe1a31760f26 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:33.105801 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7b0ee2e9-cc32-4f93-9b2d-fe1a31760f26 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:33.119777 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7b0ee2e9-cc32-4f93-9b2d-fe1a31760f26 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d" status: 200 len: 1315 microversion: 2.1 time: 0.719024 Oct 26 13:28:33.125173 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2617/5259] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:32 2022] GET /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d => generated 1315 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:28:33.204178 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3526b898-dbb5-4d26-81f8-2c82f0d03cf2 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f673151b4c0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:33.316567 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3526b898-dbb5-4d26-81f8-2c82f0d03cf2 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc" status: 200 len: 1454 microversion: 2.1 time: 0.117965 Oct 26 13:28:33.325353 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2618/5260] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:33 2022] GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc => generated 1454 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:28:33.424346 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e342b252-4a13-4ab2-8873-059866fc6e27 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:33.435857 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e342b252-4a13-4ab2-8873-059866fc6e27 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 1.492233 Oct 26 13:28:33.437949 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2643/5261] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:31 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:33.780084 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b2b77383-12f8-4db6-8fc1-6924f50356d4 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "56363c00-6608-4ad0-9892-d3ecfbb7f0c5"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b2b77383-12f8-4db6-8fc1-6924f50356d4 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Request method failure captured: Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 416 Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTWpf9Job1by08RPlBi4BK3ZRus12IuUwpixxL0U8NmqouWwnfDFM_ku9arLt0Dfw_g2zljJol9iSiPHbr2OBJI9bA6xxReUYgF5HT4trI936uilzQCNXRfNWHD8SC65BfL8JHiNMAmXVHxHedc9hkhsO-eHURoIHHJwTTh6ig9qSq0 Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/088eb22706844984b58fe118d5421cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_088eb22706844984b58fe118d5421cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}] Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 9b8db27e3baf4b6a948f6d23c04cf680 Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "56363c00-6608-4ad0-9892-d3ecfbb7f0c5"}]}} Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '762c20f4-0f9b-45cb-bd95-cf21a747b33b', 'flavorRef': '452', 'networks': [{'uuid': '56363c00-6608-4ad0-9892-d3ecfbb7f0c5'}]}}} Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise error Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:33.790527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:28:33.798179 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:33.798179 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:33.798179 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:28:33.798179 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:28:33.798179 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:28:33.798179 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:28:33.798179 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:28:33.798179 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:28:33.798179 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:28:33.798179 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:28:33.798179 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 13:28:33.798179 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 13:28:33.798179 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 13:28:33.798179 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 13:28:33.798179 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 13:28:33.798179 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 13:28:33.798179 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 26 13:28:33.798179 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:33.798179 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:28:33.798179 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:33.798179 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:33.798179 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:28:33.798179 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:28:33.798179 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 13:28:33.798179 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 13:28:33.798179 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 26 13:28:33.798179 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:33.805245 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b2b77383-12f8-4db6-8fc1-6924f50356d4 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:28:33.806760 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b2b77383-12f8-4db6-8fc1-6924f50356d4 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.036564 Oct 26 13:28:33.808000 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2619/5262] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:28:33 2022] POST /compute/v2.1/servers => generated 619 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:28:33.819941 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ab9dca71-8342-4603-bbb7-cf2c6f2acb6f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:33.821780 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ab9dca71-8342-4603-bbb7-cf2c6f2acb6f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:33.832621 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab9dca71-8342-4603-bbb7-cf2c6f2acb6f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:33.833127 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab9dca71-8342-4603-bbb7-cf2c6f2acb6f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:33.833602 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab9dca71-8342-4603-bbb7-cf2c6f2acb6f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:33.834324 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab9dca71-8342-4603-bbb7-cf2c6f2acb6f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:33.834784 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab9dca71-8342-4603-bbb7-cf2c6f2acb6f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:33.835224 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ab9dca71-8342-4603-bbb7-cf2c6f2acb6f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:34.157930 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d05fa595-ed88-457f-9660-9a35a1ed7676 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:34.158962 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d05fa595-ed88-457f-9660-9a35a1ed7676 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 3513f7b0-b7d1-4b0f-963e-709a892a275d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:34.184312 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d05fa595-ed88-457f-9660-9a35a1ed7676 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:34.187347 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d05fa595-ed88-457f-9660-9a35a1ed7676 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:34.189064 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d05fa595-ed88-457f-9660-9a35a1ed7676 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:34.200321 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d05fa595-ed88-457f-9660-9a35a1ed7676 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:34.201713 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d05fa595-ed88-457f-9660-9a35a1ed7676 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:34.205931 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d05fa595-ed88-457f-9660-9a35a1ed7676 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:34.273411 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ab9dca71-8342-4603-bbb7-cf2c6f2acb6f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:34.284336 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ab9dca71-8342-4603-bbb7-cf2c6f2acb6f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.471426 Oct 26 13:28:34.284932 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2644/5263] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:33 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:28:34.329108 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bf16d404-284c-454a-9f97-9e579c6863ef tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:34.332874 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bf16d404-284c-454a-9f97-9e579c6863ef tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:34.373639 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bf16d404-284c-454a-9f97-9e579c6863ef tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:34.377951 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bf16d404-284c-454a-9f97-9e579c6863ef tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:34.383312 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bf16d404-284c-454a-9f97-9e579c6863ef tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:34.387835 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bf16d404-284c-454a-9f97-9e579c6863ef tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:34.395670 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bf16d404-284c-454a-9f97-9e579c6863ef tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:34.399200 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bf16d404-284c-454a-9f97-9e579c6863ef tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:34.735829 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bf16d404-284c-454a-9f97-9e579c6863ef tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:34.745410 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bf16d404-284c-454a-9f97-9e579c6863ef tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.433003 Oct 26 13:28:34.747354 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2645/5264] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:34 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:34.754873 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-28aff6f8-9615-4fd6-b912-4ac87d9093cf tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67319113a0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:34.877282 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-28aff6f8-9615-4fd6-b912-4ac87d9093cf tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc" status: 200 len: 1454 microversion: 2.1 time: 0.128273 Oct 26 13:28:34.882001 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2646/5265] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:34 2022] GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc => generated 1454 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:35.115877 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-64edec4c-7bb0-46e2-a6a4-ec17ed5ef282 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1146390392", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": -1, "networks": [{"uuid": "56363c00-6608-4ad0-9892-d3ecfbb7f0c5"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:28:35.152114 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-64edec4c-7bb0-46e2-a6a4-ec17ed5ef282 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] HTTP exception thrown: Flavor -1 could not be found. Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-64edec4c-7bb0-46e2-a6a4-ec17ed5ef282 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Request method failure captured: Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 206 Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTWpf9Job1by08RPlBi4BK3ZRus12IuUwpixxL0U8NmqouWwnfDFM_ku9arLt0Dfw_g2zljJol9iSiPHbr2OBJI9bA6xxReUYgF5HT4trI936uilzQCNXRfNWHD8SC65BfL8JHiNMAmXVHxHedc9hkhsO-eHURoIHHJwTTh6ig9qSq0 Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/088eb22706844984b58fe118d5421cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_088eb22706844984b58fe118d5421cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}] Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 9b8db27e3baf4b6a948f6d23c04cf680 Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1146390392", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": -1, "networks": [{"uuid": "56363c00-6608-4ad0-9892-d3ecfbb7f0c5"}]}} Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: exception: Flavor -1 could not be found. Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1146390392', 'imageRef': '762c20f4-0f9b-45cb-bd95-cf21a747b33b', 'flavorRef': -1, 'networks': [{'uuid': '56363c00-6608-4ad0-9892-d3ecfbb7f0c5'}]}}} Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:28:35.170245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:28:35.175230 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:28:35.175230 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:28:35.175230 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:28:35.175230 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:28:35.175230 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 26 13:28:35.175230 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 26 13:28:35.175230 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 26 13:28:35.175230 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 26 13:28:35.175230 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:35.175230 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:28:35.175230 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:35.175230 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:35.175230 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:28:35.175230 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:28:35.175230 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:28:35.175230 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:28:35.175230 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 26 13:28:35.175230 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:35.175230 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-64edec4c-7bb0-46e2-a6a4-ec17ed5ef282 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:28:35.175230 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-64edec4c-7bb0-46e2-a6a4-ec17ed5ef282 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.062814 Oct 26 13:28:35.182836 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2647/5266] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:28:35 2022] POST /compute/v2.1/servers => generated 73 bytes in 74 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 26 13:28:35.203275 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3b3cc214-e0e6-4559-8386-14dc86af35a3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:35.206121 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3b3cc214-e0e6-4559-8386-14dc86af35a3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:35.223892 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b3cc214-e0e6-4559-8386-14dc86af35a3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:35.224412 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b3cc214-e0e6-4559-8386-14dc86af35a3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:35.224864 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b3cc214-e0e6-4559-8386-14dc86af35a3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:35.225612 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b3cc214-e0e6-4559-8386-14dc86af35a3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:35.226077 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b3cc214-e0e6-4559-8386-14dc86af35a3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:35.231490 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b3cc214-e0e6-4559-8386-14dc86af35a3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:35.890485 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3b3cc214-e0e6-4559-8386-14dc86af35a3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:35.911866 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3b3cc214-e0e6-4559-8386-14dc86af35a3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.721255 Oct 26 13:28:35.912810 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2648/5267] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:35 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:35.931346 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0dc6cf80-7d39-457a-8193-5639f538ea75 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67325b6dc0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:36.024424 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0dc6cf80-7d39-457a-8193-5639f538ea75 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc" status: 200 len: 1454 microversion: 2.1 time: 0.107294 Oct 26 13:28:36.025950 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2649/5268] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:35 2022] GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc => generated 1454 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:36.054049 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-16e99f3a-4690-49bc-ad03-25add0116a4e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:36.055027 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-16e99f3a-4690-49bc-ad03-25add0116a4e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:36.081630 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-16e99f3a-4690-49bc-ad03-25add0116a4e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:36.086226 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-16e99f3a-4690-49bc-ad03-25add0116a4e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:36.086840 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-16e99f3a-4690-49bc-ad03-25add0116a4e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:36.087821 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-16e99f3a-4690-49bc-ad03-25add0116a4e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:36.088470 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-16e99f3a-4690-49bc-ad03-25add0116a4e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:36.089073 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-16e99f3a-4690-49bc-ad03-25add0116a4e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:36.538442 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-16e99f3a-4690-49bc-ad03-25add0116a4e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:36.551308 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-16e99f3a-4690-49bc-ad03-25add0116a4e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.521126 Oct 26 13:28:36.552889 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2650/5269] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:36 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:36.627995 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d05fa595-ed88-457f-9660-9a35a1ed7676 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:36.644221 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d05fa595-ed88-457f-9660-9a35a1ed7676 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d" status: 200 len: 1315 microversion: 2.1 time: 2.492424 Oct 26 13:28:36.646700 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2620/5270] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:34 2022] GET /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d => generated 1315 bytes in 2499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:36.679219 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6bd3ca6c-5756-4db9-afd8-df2e4e3b7c83 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2105935950", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "56363c00-6608-4ad0-9892-d3ecfbb7f0c5"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6bd3ca6c-5756-4db9-afd8-df2e4e3b7c83 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Request method failure captured: Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 173 Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTWpf9Job1by08RPlBi4BK3ZRus12IuUwpixxL0U8NmqouWwnfDFM_ku9arLt0Dfw_g2zljJol9iSiPHbr2OBJI9bA6xxReUYgF5HT4trI936uilzQCNXRfNWHD8SC65BfL8JHiNMAmXVHxHedc9hkhsO-eHURoIHHJwTTh6ig9qSq0 Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/088eb22706844984b58fe118d5421cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_088eb22706844984b58fe118d5421cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}] Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 9b8db27e3baf4b6a948f6d23c04cf680 Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2105935950", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "56363c00-6608-4ad0-9892-d3ecfbb7f0c5"}]}} Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2105935950', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '56363c00-6608-4ad0-9892-d3ecfbb7f0c5'}]}}} Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise error Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi -1 Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 13:28:36.695243 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 13:28:36.701473 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 13:28:36.701473 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 13:28:36.701473 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 26 13:28:36.701473 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:36.701473 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:28:36.701473 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:36.701473 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:36.701473 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:28:36.701473 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:28:36.701473 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 13:28:36.701473 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 13:28:36.701473 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 26 13:28:36.701473 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:36.715153 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6bd3ca6c-5756-4db9-afd8-df2e4e3b7c83 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:28:36.715153 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6bd3ca6c-5756-4db9-afd8-df2e4e3b7c83 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.065261 Oct 26 13:28:36.722427 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2651/5271] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:28:36 2022] POST /compute/v2.1/servers => generated 145 bytes in 72 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:28:36.759625 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d6e10d4b-ef25-42ab-96c1-74f75d696416 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:36.812746 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d6e10d4b-ef25-42ab-96c1-74f75d696416 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:36.867064 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6e10d4b-ef25-42ab-96c1-74f75d696416 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:36.876927 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6e10d4b-ef25-42ab-96c1-74f75d696416 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:36.877944 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6e10d4b-ef25-42ab-96c1-74f75d696416 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:36.879116 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6e10d4b-ef25-42ab-96c1-74f75d696416 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:36.879866 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6e10d4b-ef25-42ab-96c1-74f75d696416 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:36.883119 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6e10d4b-ef25-42ab-96c1-74f75d696416 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:37.045746 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ce64a1b2-b376-4676-a2ee-04b480345e8f tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f6731264940>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:37.190173 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ce64a1b2-b376-4676-a2ee-04b480345e8f tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc" status: 200 len: 1454 microversion: 2.1 time: 0.150028 Oct 26 13:28:37.199813 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2652/5272] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:37 2022] GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc => generated 1454 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:37.676666 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f49be245-9151-44e1-b233-fca25b4a4b1a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:37.678311 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f49be245-9151-44e1-b233-fca25b4a4b1a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 3513f7b0-b7d1-4b0f-963e-709a892a275d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:37.692006 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f49be245-9151-44e1-b233-fca25b4a4b1a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:37.693275 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f49be245-9151-44e1-b233-fca25b4a4b1a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:37.694040 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f49be245-9151-44e1-b233-fca25b4a4b1a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:37.697610 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f49be245-9151-44e1-b233-fca25b4a4b1a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:37.698433 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f49be245-9151-44e1-b233-fca25b4a4b1a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:37.699101 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f49be245-9151-44e1-b233-fca25b4a4b1a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:37.841938 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d6e10d4b-ef25-42ab-96c1-74f75d696416 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:37.854843 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d6e10d4b-ef25-42ab-96c1-74f75d696416 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 1.129510 Oct 26 13:28:37.857225 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2621/5273] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:36 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:37.885236 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fbe22f39-5d6f-4f21-ab03-90a96937b0ea tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:37.886408 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fbe22f39-5d6f-4f21-ab03-90a96937b0ea tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:37.901018 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fbe22f39-5d6f-4f21-ab03-90a96937b0ea tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:37.901780 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fbe22f39-5d6f-4f21-ab03-90a96937b0ea tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:37.902483 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fbe22f39-5d6f-4f21-ab03-90a96937b0ea tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:37.905347 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fbe22f39-5d6f-4f21-ab03-90a96937b0ea tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:37.907072 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fbe22f39-5d6f-4f21-ab03-90a96937b0ea tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:37.908229 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fbe22f39-5d6f-4f21-ab03-90a96937b0ea tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:38.962044 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fbe22f39-5d6f-4f21-ab03-90a96937b0ea tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:38.971519 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fbe22f39-5d6f-4f21-ab03-90a96937b0ea tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 1.091009 Oct 26 13:28:38.977915 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2622/5274] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:37 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:39.006882 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c7dd96cd-e340-489e-afb0-ecc4cdf80bee tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f673251a1f0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:39.108580 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c7dd96cd-e340-489e-afb0-ecc4cdf80bee tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc" status: 200 len: 1454 microversion: 2.1 time: 0.129264 Oct 26 13:28:39.109609 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2623/5275] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:38 2022] GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc => generated 1454 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:39.143479 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-278b5ea2-9ff3-4fa0-ba5c-6e545b0e2816 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-277993779", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:28:39.169427 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-278b5ea2-9ff3-4fa0-ba5c-6e545b0e2816 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-278b5ea2-9ff3-4fa0-ba5c-6e545b0e2816 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Request method failure captured: Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 215 Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTWpf9Job1by08RPlBi4BK3ZRus12IuUwpixxL0U8NmqouWwnfDFM_ku9arLt0Dfw_g2zljJol9iSiPHbr2OBJI9bA6xxReUYgF5HT4trI936uilzQCNXRfNWHD8SC65BfL8JHiNMAmXVHxHedc9hkhsO-eHURoIHHJwTTh6ig9qSq0 Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/088eb22706844984b58fe118d5421cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_088eb22706844984b58fe118d5421cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}] Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 9b8db27e3baf4b6a948f6d23c04cf680 Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-277993779", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-277993779', 'imageRef': '762c20f4-0f9b-45cb-bd95-cf21a747b33b', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:28:39.171998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:39.177079 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:39.177079 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:28:39.177079 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:28:39.177079 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:28:39.177079 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:28:39.177079 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 26 13:28:39.177079 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:39.180777 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-278b5ea2-9ff3-4fa0-ba5c-6e545b0e2816 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:28:39.194275 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-278b5ea2-9ff3-4fa0-ba5c-6e545b0e2816 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.081762 Oct 26 13:28:39.199355 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2624/5276] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:28:39 2022] POST /compute/v2.1/servers => generated 123 bytes in 89 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:28:39.224347 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-643d07df-f8fb-4869-a4f5-b2dbc0287827 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:39.225142 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-643d07df-f8fb-4869-a4f5-b2dbc0287827 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:39.253721 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-643d07df-f8fb-4869-a4f5-b2dbc0287827 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:39.254289 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-643d07df-f8fb-4869-a4f5-b2dbc0287827 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:39.254824 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-643d07df-f8fb-4869-a4f5-b2dbc0287827 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:39.255627 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-643d07df-f8fb-4869-a4f5-b2dbc0287827 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:39.269604 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f49be245-9151-44e1-b233-fca25b4a4b1a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:39.270765 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-643d07df-f8fb-4869-a4f5-b2dbc0287827 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:39.271875 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-643d07df-f8fb-4869-a4f5-b2dbc0287827 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:39.283687 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f49be245-9151-44e1-b233-fca25b4a4b1a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d" status: 200 len: 1315 microversion: 2.1 time: 1.615309 Oct 26 13:28:39.285201 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2653/5277] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:37 2022] GET /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d => generated 1315 bytes in 1618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:40.124575 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9ab27abb-d86a-457a-a0e8-d1f47f16f5b7 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f673121eaf0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:40.256181 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9ab27abb-d86a-457a-a0e8-d1f47f16f5b7 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc" status: 200 len: 1454 microversion: 2.1 time: 0.135910 Oct 26 13:28:40.256795 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2654/5278] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:40 2022] GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc => generated 1454 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:40.310467 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-41d47601-0fb3-4408-94df-4395ff78af7b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:40.311857 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-41d47601-0fb3-4408-94df-4395ff78af7b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 3513f7b0-b7d1-4b0f-963e-709a892a275d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:40.320323 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-41d47601-0fb3-4408-94df-4395ff78af7b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:40.338702 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-41d47601-0fb3-4408-94df-4395ff78af7b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:40.339164 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-41d47601-0fb3-4408-94df-4395ff78af7b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:40.342801 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-41d47601-0fb3-4408-94df-4395ff78af7b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:40.343291 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-41d47601-0fb3-4408-94df-4395ff78af7b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:40.343735 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-41d47601-0fb3-4408-94df-4395ff78af7b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:40.426318 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-643d07df-f8fb-4869-a4f5-b2dbc0287827 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:40.433465 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-643d07df-f8fb-4869-a4f5-b2dbc0287827 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 1.226333 Oct 26 13:28:40.434109 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2625/5279] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:39 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:28:40.462824 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-328dd5f4-b01b-4d7d-b9b8-e8f944b3f86f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:40.464455 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-328dd5f4-b01b-4d7d-b9b8-e8f944b3f86f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:40.490622 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-328dd5f4-b01b-4d7d-b9b8-e8f944b3f86f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:40.491119 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-328dd5f4-b01b-4d7d-b9b8-e8f944b3f86f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:40.491909 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-328dd5f4-b01b-4d7d-b9b8-e8f944b3f86f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:40.516715 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-328dd5f4-b01b-4d7d-b9b8-e8f944b3f86f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:40.517220 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-328dd5f4-b01b-4d7d-b9b8-e8f944b3f86f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:40.524980 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-328dd5f4-b01b-4d7d-b9b8-e8f944b3f86f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:41.059111 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-328dd5f4-b01b-4d7d-b9b8-e8f944b3f86f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:41.072709 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-328dd5f4-b01b-4d7d-b9b8-e8f944b3f86f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.613617 Oct 26 13:28:41.074255 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2626/5280] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:40 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:28:41.275730 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1d3a369d-da01-47a1-beb9-4224b0a70ebe tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f6736965430>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:41.385848 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1d3a369d-da01-47a1-beb9-4224b0a70ebe tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc" status: 200 len: 1454 microversion: 2.1 time: 0.114773 Oct 26 13:28:41.387563 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2627/5281] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:41 2022] GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc => generated 1454 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:41.412429 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a8b5dcb4-bc96-48b4-b542-657b19fb9ebe tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2002380383", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "key_name": "tempest-key-1138241179", "networks": [{"uuid": "56363c00-6608-4ad0-9892-d3ecfbb7f0c5"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:28:41.612797 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-a8b5dcb4-bc96-48b4-b542-657b19fb9ebe tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] validate_networks() for [('56363c00-6608-4ad0-9892-d3ecfbb7f0c5', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:28:41.748566 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-41d47601-0fb3-4408-94df-4395ff78af7b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:41.759664 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-41d47601-0fb3-4408-94df-4395ff78af7b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d" status: 200 len: 1315 microversion: 2.1 time: 1.453207 Oct 26 13:28:41.773803 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2655/5282] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:40 2022] GET /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d => generated 1315 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:28:42.365223 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-a8b5dcb4-bc96-48b4-b542-657b19fb9ebe tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] HTTP exception thrown: Invalid key_name provided. Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a8b5dcb4-bc96-48b4-b542-657b19fb9ebe tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Request method failure captured: Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 247 Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTWpf9Job1by08RPlBi4BK3ZRus12IuUwpixxL0U8NmqouWwnfDFM_ku9arLt0Dfw_g2zljJol9iSiPHbr2OBJI9bA6xxReUYgF5HT4trI936uilzQCNXRfNWHD8SC65BfL8JHiNMAmXVHxHedc9hkhsO-eHURoIHHJwTTh6ig9qSq0 Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/088eb22706844984b58fe118d5421cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_088eb22706844984b58fe118d5421cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}] Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 9b8db27e3baf4b6a948f6d23c04cf680 Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2002380383", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "key_name": "tempest-key-1138241179", "networks": [{"uuid": "56363c00-6608-4ad0-9892-d3ecfbb7f0c5"}]}} Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: exception: Invalid key_name provided. Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2002380383', 'imageRef': '762c20f4-0f9b-45cb-bd95-cf21a747b33b', 'flavorRef': '452', 'key_name': 'tempest-key-1138241179', 'networks': [{'uuid': '56363c00-6608-4ad0-9892-d3ecfbb7f0c5'}]}}} Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1138241179 not found for user 9b8db27e3baf4b6a948f6d23c04cf680 Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:42.368726 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:28:42.372222 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:28:42.372222 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:28:42.372222 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:28:42.372222 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:28:42.372222 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:28:42.372222 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:28:42.372222 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:28:42.372222 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:28:42.372222 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:28:42.372222 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:28:42.372222 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:28:42.372222 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 26 13:28:42.372222 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 26 13:28:42.372222 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 26 13:28:42.372222 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 26 13:28:42.372222 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:42.372222 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:28:42.372222 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:42.372222 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:42.372222 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:28:42.372222 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:28:42.372222 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:28:42.372222 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:28:42.372222 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 26 13:28:42.372222 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:42.372222 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a8b5dcb4-bc96-48b4-b542-657b19fb9ebe tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Returning 400 to user: Invalid key_name provided. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:28:42.372222 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a8b5dcb4-bc96-48b4-b542-657b19fb9ebe tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.967410 Oct 26 13:28:42.376875 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2628/5283] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:28:41 2022] POST /compute/v2.1/servers => generated 70 bytes in 974 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 26 13:28:42.383288 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b3107c3f-f2f3-4682-8165-2513613b9c1e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:42.384124 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b3107c3f-f2f3-4682-8165-2513613b9c1e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:42.407944 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d294d602-6bd8-4480-acb5-0831795cf8a2 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f6736965670>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:42.428881 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3107c3f-f2f3-4682-8165-2513613b9c1e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:42.430676 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3107c3f-f2f3-4682-8165-2513613b9c1e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:42.434442 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3107c3f-f2f3-4682-8165-2513613b9c1e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:42.440059 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3107c3f-f2f3-4682-8165-2513613b9c1e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:42.444880 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3107c3f-f2f3-4682-8165-2513613b9c1e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:42.445968 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3107c3f-f2f3-4682-8165-2513613b9c1e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:42.527208 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d294d602-6bd8-4480-acb5-0831795cf8a2 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc" status: 200 len: 1454 microversion: 2.1 time: 0.128406 Oct 26 13:28:42.543654 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2629/5284] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:42 2022] GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc => generated 1454 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:42.802825 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b38949ba-4853-4782-b1f1-62580f06b429 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:42.803457 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b38949ba-4853-4782-b1f1-62580f06b429 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 3513f7b0-b7d1-4b0f-963e-709a892a275d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:42.819213 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b38949ba-4853-4782-b1f1-62580f06b429 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:42.821762 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b38949ba-4853-4782-b1f1-62580f06b429 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:42.824765 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b38949ba-4853-4782-b1f1-62580f06b429 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:42.829536 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b38949ba-4853-4782-b1f1-62580f06b429 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:42.833645 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b38949ba-4853-4782-b1f1-62580f06b429 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:42.834291 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b38949ba-4853-4782-b1f1-62580f06b429 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:42.967031 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b3107c3f-f2f3-4682-8165-2513613b9c1e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:42.977266 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b3107c3f-f2f3-4682-8165-2513613b9c1e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.599283 Oct 26 13:28:42.978322 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2656/5285] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:42 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:28:43.030144 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-02c72f42-37f1-4c6b-9bdc-cd739adde872 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:43.034441 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-02c72f42-37f1-4c6b-9bdc-cd739adde872 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:43.089407 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02c72f42-37f1-4c6b-9bdc-cd739adde872 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:43.090158 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02c72f42-37f1-4c6b-9bdc-cd739adde872 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:43.098414 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02c72f42-37f1-4c6b-9bdc-cd739adde872 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:43.107198 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02c72f42-37f1-4c6b-9bdc-cd739adde872 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:43.107699 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02c72f42-37f1-4c6b-9bdc-cd739adde872 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:43.123415 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02c72f42-37f1-4c6b-9bdc-cd739adde872 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:43.638326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-02c72f42-37f1-4c6b-9bdc-cd739adde872 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:43.651800 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-02c72f42-37f1-4c6b-9bdc-cd739adde872 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.640014 Oct 26 13:28:43.655022 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2657/5286] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:43 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:43.660225 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d92d75b6-861e-4854-a62d-90b1f49d3d5d tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f6732b325e0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:43.677445 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b38949ba-4853-4782-b1f1-62580f06b429 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:43.695875 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b38949ba-4853-4782-b1f1-62580f06b429 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d" status: 200 len: 1315 microversion: 2.1 time: 0.906706 Oct 26 13:28:43.705224 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2630/5287] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:42 2022] GET /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d => generated 1315 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:43.730092 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d92d75b6-861e-4854-a62d-90b1f49d3d5d tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc" status: 200 len: 1454 microversion: 2.1 time: 0.073071 Oct 26 13:28:43.731048 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2658/5288] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:43 2022] GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc => generated 1454 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:44.195322 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ef42cebe-6654-4aee-8b5e-55874aac31ff tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-154968004", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "56363c00-6608-4ad0-9892-d3ecfbb7f0c5"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:28:44.651799 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-bf58fdc3-b6ea-42c7-9d46-039faaef8ae6 req-e75f8617-2919-4ce0-8440-ef06b3f8a8e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3513f7b0-b7d1-4b0f-963e-709a892a275d", "name": "network-vif-plugged", "status": "completed", "tag": "3a852438-a4fa-48a5-9409-c33ffc92d395"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:28:44.684761 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-bf58fdc3-b6ea-42c7-9d46-039faaef8ae6 req-e75f8617-2919-4ce0-8440-ef06b3f8a8e4 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:44.685639 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-bf58fdc3-b6ea-42c7-9d46-039faaef8ae6 req-e75f8617-2919-4ce0-8440-ef06b3f8a8e4 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:44.686307 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-bf58fdc3-b6ea-42c7-9d46-039faaef8ae6 req-e75f8617-2919-4ce0-8440-ef06b3f8a8e4 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:44.739760 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-bf58fdc3-b6ea-42c7-9d46-039faaef8ae6 req-e75f8617-2919-4ce0-8440-ef06b3f8a8e4 service nova] Creating event network-vif-plugged:3a852438-a4fa-48a5-9409-c33ffc92d395 for instance 3513f7b0-b7d1-4b0f-963e-709a892a275d on n-h2-862686-1 Oct 26 13:28:44.769256 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-bf58fdc3-b6ea-42c7-9d46-039faaef8ae6 req-e75f8617-2919-4ce0-8440-ef06b3f8a8e4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125543 Oct 26 13:28:44.775415 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2659/5289] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:28:44.807810 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3cf7d0c1-5aaa-4828-9ae2-8ccb77f00238 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:44.814094 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3cf7d0c1-5aaa-4828-9ae2-8ccb77f00238 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 3513f7b0-b7d1-4b0f-963e-709a892a275d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:44.851872 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cf7d0c1-5aaa-4828-9ae2-8ccb77f00238 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:44.852629 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cf7d0c1-5aaa-4828-9ae2-8ccb77f00238 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:44.853471 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cf7d0c1-5aaa-4828-9ae2-8ccb77f00238 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:44.866945 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cf7d0c1-5aaa-4828-9ae2-8ccb77f00238 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:44.873629 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cf7d0c1-5aaa-4828-9ae2-8ccb77f00238 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:44.874872 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cf7d0c1-5aaa-4828-9ae2-8ccb77f00238 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:45.316621 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3cf7d0c1-5aaa-4828-9ae2-8ccb77f00238 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:45.330408 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3cf7d0c1-5aaa-4828-9ae2-8ccb77f00238 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d" status: 200 len: 1315 microversion: 2.1 time: 0.553411 Oct 26 13:28:45.331067 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2660/5290] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:44 2022] GET /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d => generated 1315 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:45.336476 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d1242504-985a-422d-8cb7-5888afeed10c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67317e2700>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:45.427386 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d1242504-985a-422d-8cb7-5888afeed10c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc" status: 200 len: 1454 microversion: 2.1 time: 0.094964 Oct 26 13:28:45.427922 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2661/5291] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:45 2022] GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc => generated 1454 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:46.060923 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.security_group_api [None req-ef42cebe-6654-4aee-8b5e-55874aac31ff tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Neutron security group does_not_exist not found {{(pid=120597) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 26 13:28:46.061848 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-ef42cebe-6654-4aee-8b5e-55874aac31ff tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ef42cebe-6654-4aee-8b5e-55874aac31ff tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Request method failure captured: Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 257 Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTWpf9Job1by08RPlBi4BK3ZRus12IuUwpixxL0U8NmqouWwnfDFM_ku9arLt0Dfw_g2zljJol9iSiPHbr2OBJI9bA6xxReUYgF5HT4trI936uilzQCNXRfNWHD8SC65BfL8JHiNMAmXVHxHedc9hkhsO-eHURoIHHJwTTh6ig9qSq0 Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/088eb22706844984b58fe118d5421cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_088eb22706844984b58fe118d5421cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}] Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 9b8db27e3baf4b6a948f6d23c04cf680 Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-154968004", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "56363c00-6608-4ad0-9892-d3ecfbb7f0c5"}]}} Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-154968004', 'imageRef': '762c20f4-0f9b-45cb-bd95-cf21a747b33b', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '56363c00-6608-4ad0-9892-d3ecfbb7f0c5'}]}}} Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 26 13:28:46.070710 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:46.082543 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ef42cebe-6654-4aee-8b5e-55874aac31ff tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:28:46.090332 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ef42cebe-6654-4aee-8b5e-55874aac31ff tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 1.881176 Oct 26 13:28:46.090332 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2631/5292] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:28:44 2022] POST /compute/v2.1/servers => generated 106 bytes in 1882 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:28:46.090460 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e0d18bb7-a36f-41fc-85bf-af2e6c47c040 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:46.090460 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e0d18bb7-a36f-41fc-85bf-af2e6c47c040 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:46.107560 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0d18bb7-a36f-41fc-85bf-af2e6c47c040 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:46.115467 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0d18bb7-a36f-41fc-85bf-af2e6c47c040 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:46.115921 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0d18bb7-a36f-41fc-85bf-af2e6c47c040 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:46.116717 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0d18bb7-a36f-41fc-85bf-af2e6c47c040 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:46.117141 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0d18bb7-a36f-41fc-85bf-af2e6c47c040 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:46.117598 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0d18bb7-a36f-41fc-85bf-af2e6c47c040 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:46.368255 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-58a79947-2fb3-4a54-9bcd-40fb9a12a9c8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:46.368861 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-58a79947-2fb3-4a54-9bcd-40fb9a12a9c8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 3513f7b0-b7d1-4b0f-963e-709a892a275d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:46.387798 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-58a79947-2fb3-4a54-9bcd-40fb9a12a9c8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:46.388293 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-58a79947-2fb3-4a54-9bcd-40fb9a12a9c8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:46.388739 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-58a79947-2fb3-4a54-9bcd-40fb9a12a9c8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:46.389461 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-58a79947-2fb3-4a54-9bcd-40fb9a12a9c8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:46.389975 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-58a79947-2fb3-4a54-9bcd-40fb9a12a9c8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:46.390414 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-58a79947-2fb3-4a54-9bcd-40fb9a12a9c8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:46.570718 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e0d18bb7-a36f-41fc-85bf-af2e6c47c040 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:46.588093 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e0d18bb7-a36f-41fc-85bf-af2e6c47c040 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.509975 Oct 26 13:28:46.595514 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2662/5293] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:46 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:46.608118 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fff80be1-2919-49e3-9e58-8f469b43f29a tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f673680c700>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:46.724829 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fff80be1-2919-49e3-9e58-8f469b43f29a tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc" status: 200 len: 1454 microversion: 2.1 time: 0.127669 Oct 26 13:28:46.726189 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2663/5294] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:46 2022] GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc => generated 1454 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:46.739196 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-db55f16f-8d11-4abf-af7f-36fc502fbdc5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:46.744879 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-db55f16f-8d11-4abf-af7f-36fc502fbdc5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:46.752785 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db55f16f-8d11-4abf-af7f-36fc502fbdc5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:46.753930 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db55f16f-8d11-4abf-af7f-36fc502fbdc5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:46.754698 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db55f16f-8d11-4abf-af7f-36fc502fbdc5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:46.755658 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db55f16f-8d11-4abf-af7f-36fc502fbdc5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:46.756328 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db55f16f-8d11-4abf-af7f-36fc502fbdc5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:46.756971 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db55f16f-8d11-4abf-af7f-36fc502fbdc5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:47.330065 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-db55f16f-8d11-4abf-af7f-36fc502fbdc5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:47.333711 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:28:47.339691 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-db55f16f-8d11-4abf-af7f-36fc502fbdc5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.612161 Oct 26 13:28:47.358798 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2664/5295] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:46 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:47.379398 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-dbbafafd-9887-4215-bfce-0d789227b13e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:47.397333 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-dbbafafd-9887-4215-bfce-0d789227b13e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: 359d9062-37f6-48cd-b5cc-357d904aee74] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:47.427214 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-dbbafafd-9887-4215-bfce-0d789227b13e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] HTTP exception thrown: Instance 359d9062-37f6-48cd-b5cc-357d904aee74 could not be found. Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-dbbafafd-9887-4215-bfce-0d789227b13e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Request method failure captured: Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: request: DELETE /compute/v2.1/servers/359d9062-37f6-48cd-b5cc-357d904aee74 HTTP/1.1 Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTWpf9Job1by08RPlBi4BK3ZRus12IuUwpixxL0U8NmqouWwnfDFM_ku9arLt0Dfw_g2zljJol9iSiPHbr2OBJI9bA6xxReUYgF5HT4trI936uilzQCNXRfNWHD8SC65BfL8JHiNMAmXVHxHedc9hkhsO-eHURoIHHJwTTh6ig9qSq0 Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/088eb22706844984b58fe118d5421cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_088eb22706844984b58fe118d5421cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}] Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 9b8db27e3baf4b6a948f6d23c04cf680 Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 359d9062-37f6-48cd-b5cc-357d904aee74 could not be found. Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '359d9062-37f6-48cd-b5cc-357d904aee74'} Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 359d9062-37f6-48cd-b5cc-357d904aee74 could not be found. Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 359d9062-37f6-48cd-b5cc-357d904aee74 could not be found. Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:47.430331 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:28:47.433620 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:47.433620 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:47.433620 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:28:47.433620 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:28:47.433620 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:28:47.433620 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:28:47.433620 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 359d9062-37f6-48cd-b5cc-357d904aee74 could not be found. Oct 26 13:28:47.433620 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:47.445926 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-dbbafafd-9887-4215-bfce-0d789227b13e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Returning 404 to user: Instance 359d9062-37f6-48cd-b5cc-357d904aee74 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:28:47.451358 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-dbbafafd-9887-4215-bfce-0d789227b13e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "DELETE /compute/v2.1/servers/359d9062-37f6-48cd-b5cc-357d904aee74" status: 404 len: 111 microversion: 2.1 time: 0.074579 Oct 26 13:28:47.454450 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2665/5296] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:28:47 2022] DELETE /compute/v2.1/servers/359d9062-37f6-48cd-b5cc-357d904aee74 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:28:47.468523 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2bfc7901-8664-4c5a-815c-bbf1a1e10035 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:47.469701 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2bfc7901-8664-4c5a-815c-bbf1a1e10035 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:47.523709 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2bfc7901-8664-4c5a-815c-bbf1a1e10035 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:47.529590 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2bfc7901-8664-4c5a-815c-bbf1a1e10035 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:47.532709 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2bfc7901-8664-4c5a-815c-bbf1a1e10035 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:47.533630 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2bfc7901-8664-4c5a-815c-bbf1a1e10035 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:47.535199 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-58a79947-2fb3-4a54-9bcd-40fb9a12a9c8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:47.538149 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2bfc7901-8664-4c5a-815c-bbf1a1e10035 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:47.544509 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2bfc7901-8664-4c5a-815c-bbf1a1e10035 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:47.549888 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-58a79947-2fb3-4a54-9bcd-40fb9a12a9c8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d" status: 200 len: 1315 microversion: 2.1 time: 1.180533 Oct 26 13:28:47.550553 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2632/5297] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:46 2022] GET /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d => generated 1315 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:47.748606 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-43a4f3ac-3f10-4f14-9158-57be70b1ad4d tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f6731ac9160>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:47.921737 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-43a4f3ac-3f10-4f14-9158-57be70b1ad4d tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc" status: 200 len: 1454 microversion: 2.1 time: 0.184687 Oct 26 13:28:47.924217 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2633/5298] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:47 2022] GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc => generated 1454 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:28:48.273066 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2bfc7901-8664-4c5a-815c-bbf1a1e10035 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:48.284517 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2bfc7901-8664-4c5a-815c-bbf1a1e10035 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.826045 Oct 26 13:28:48.306663 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2666/5299] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:47 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:48.339646 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7565c158-74ff-4d39-85f4-0a1871541615 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:48.345268 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7565c158-74ff-4d39-85f4-0a1871541615 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:48.354428 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=46 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:28:48.370163 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7565c158-74ff-4d39-85f4-0a1871541615 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:48.372809 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7565c158-74ff-4d39-85f4-0a1871541615 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:48.373606 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7565c158-74ff-4d39-85f4-0a1871541615 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:48.374552 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7565c158-74ff-4d39-85f4-0a1871541615 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:48.375231 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7565c158-74ff-4d39-85f4-0a1871541615 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:48.375804 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7565c158-74ff-4d39-85f4-0a1871541615 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:48.587538 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-dd2f3d1d-f5c9-4a12-91a6-53542006e8d6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:48.589236 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-dd2f3d1d-f5c9-4a12-91a6-53542006e8d6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 3513f7b0-b7d1-4b0f-963e-709a892a275d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:48.605743 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dd2f3d1d-f5c9-4a12-91a6-53542006e8d6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:48.606844 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dd2f3d1d-f5c9-4a12-91a6-53542006e8d6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:48.607855 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dd2f3d1d-f5c9-4a12-91a6-53542006e8d6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:48.608866 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dd2f3d1d-f5c9-4a12-91a6-53542006e8d6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:48.611861 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dd2f3d1d-f5c9-4a12-91a6-53542006e8d6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:48.613092 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dd2f3d1d-f5c9-4a12-91a6-53542006e8d6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:48.832501 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7565c158-74ff-4d39-85f4-0a1871541615 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:48.850943 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7565c158-74ff-4d39-85f4-0a1871541615 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.522031 Oct 26 13:28:48.872452 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2634/5300] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:48 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:48.883519 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-33486b20-23d0-4eb5-931c-45b687dbb4ff tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:48.887482 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-33486b20-23d0-4eb5-931c-45b687dbb4ff tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Failed to fetch instance by id 9223372036854775808 {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 26 13:28:48.888209 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-33486b20-23d0-4eb5-931c-45b687dbb4ff tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-33486b20-23d0-4eb5-931c-45b687dbb4ff tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Request method failure captured: Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTWpf9Job1by08RPlBi4BK3ZRus12IuUwpixxL0U8NmqouWwnfDFM_ku9arLt0Dfw_g2zljJol9iSiPHbr2OBJI9bA6xxReUYgF5HT4trI936uilzQCNXRfNWHD8SC65BfL8JHiNMAmXVHxHedc9hkhsO-eHURoIHHJwTTh6ig9qSq0 Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/088eb22706844984b58fe118d5421cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_088eb22706844984b58fe118d5421cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}] Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 9b8db27e3baf4b6a948f6d23c04cf680 Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 9223372036854775808 could not be found. Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '9223372036854775808'} Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:48.894183 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:28:48.899447 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:28:48.899447 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:28:48.899447 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:28:48.899447 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 26 13:28:48.899447 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:48.900855 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-33486b20-23d0-4eb5-931c-45b687dbb4ff tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:28:48.901982 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-33486b20-23d0-4eb5-931c-45b687dbb4ff tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.025419 Oct 26 13:28:48.907247 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2635/5301] 10.222.0.40 () {58 vars in 1188 bytes} [Wed Oct 26 13:28:48 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:28:48.912339 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e2dd88a3-e845-4234-869a-c3288149e81f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:48.913109 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e2dd88a3-e845-4234-869a-c3288149e81f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:48.920848 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e2dd88a3-e845-4234-869a-c3288149e81f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:48.921607 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e2dd88a3-e845-4234-869a-c3288149e81f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:48.926078 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e2dd88a3-e845-4234-869a-c3288149e81f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:48.927133 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e2dd88a3-e845-4234-869a-c3288149e81f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:48.927813 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e2dd88a3-e845-4234-869a-c3288149e81f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:48.928453 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e2dd88a3-e845-4234-869a-c3288149e81f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:49.427424 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e2dd88a3-e845-4234-869a-c3288149e81f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:49.442565 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e2dd88a3-e845-4234-869a-c3288149e81f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.534060 Oct 26 13:28:49.443168 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2636/5302] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:48 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:49.477839 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-dd2f3d1d-f5c9-4a12-91a6-53542006e8d6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:49.487570 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-83ac76fd-4e02-4ede-9c6f-1719347dce10 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f673213baf0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:49.490748 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-dd2f3d1d-f5c9-4a12-91a6-53542006e8d6 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d" status: 200 len: 1501 microversion: 2.1 time: 0.916113 Oct 26 13:28:49.495256 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2667/5303] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:48 2022] GET /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d => generated 1501 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:49.515263 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-de38c336-d0e6-4458-984a-1a053d459742 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:49.520077 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-de38c336-d0e6-4458-984a-1a053d459742 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:49.554599 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:28:49.560351 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de38c336-d0e6-4458-984a-1a053d459742 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:49.565614 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de38c336-d0e6-4458-984a-1a053d459742 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:49.566075 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de38c336-d0e6-4458-984a-1a053d459742 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:49.566828 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de38c336-d0e6-4458-984a-1a053d459742 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:49.567293 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de38c336-d0e6-4458-984a-1a053d459742 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:49.581000 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de38c336-d0e6-4458-984a-1a053d459742 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:49.730592 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-83ac76fd-4e02-4ede-9c6f-1719347dce10 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc" status: 200 len: 1454 microversion: 2.1 time: 0.261265 Oct 26 13:28:49.734397 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2637/5304] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:49 2022] GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc => generated 1454 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:49.758333 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1ecc8315-91ab-4fa8-8cc8-9f523614c4d5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:28:49.771680 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1ecc8315-91ab-4fa8-8cc8-9f523614c4d5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 3513f7b0-b7d1-4b0f-963e-709a892a275d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:49.791075 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1ecc8315-91ab-4fa8-8cc8-9f523614c4d5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:49.792381 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1ecc8315-91ab-4fa8-8cc8-9f523614c4d5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:49.793730 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1ecc8315-91ab-4fa8-8cc8-9f523614c4d5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:49.796033 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1ecc8315-91ab-4fa8-8cc8-9f523614c4d5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:49.796789 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1ecc8315-91ab-4fa8-8cc8-9f523614c4d5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:49.799540 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1ecc8315-91ab-4fa8-8cc8-9f523614c4d5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:49.844262 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:28:49.922899 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1ecc8315-91ab-4fa8-8cc8-9f523614c4d5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "POST /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d/action" status: 200 len: 14 microversion: 2.1 time: 0.186030 Oct 26 13:28:49.928372 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2638/5305] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:28:49 2022] POST /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d/action => generated 14 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:28:50.375893 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-de38c336-d0e6-4458-984a-1a053d459742 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:50.408635 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-de38c336-d0e6-4458-984a-1a053d459742 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.911803 Oct 26 13:28:50.420561 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2668/5306] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:49 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:50.448516 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2baa8ab2-adec-4b56-a0f4-3a9e29a4bcfd tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:50.449197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2baa8ab2-adec-4b56-a0f4-3a9e29a4bcfd tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Failed to fetch instance by id -1 {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 26 13:28:50.449972 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-2baa8ab2-adec-4b56-a0f4-3a9e29a4bcfd tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] HTTP exception thrown: Instance -1 could not be found. Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2baa8ab2-adec-4b56-a0f4-3a9e29a4bcfd tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Request method failure captured: Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTWpf9Job1by08RPlBi4BK3ZRus12IuUwpixxL0U8NmqouWwnfDFM_ku9arLt0Dfw_g2zljJol9iSiPHbr2OBJI9bA6xxReUYgF5HT4trI936uilzQCNXRfNWHD8SC65BfL8JHiNMAmXVHxHedc9hkhsO-eHURoIHHJwTTh6ig9qSq0 Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/088eb22706844984b58fe118d5421cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_088eb22706844984b58fe118d5421cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}] Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 9b8db27e3baf4b6a948f6d23c04cf680 Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance -1 could not be found. Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '-1'} Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:28:50.451750 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:28:50.455101 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:28:50.455101 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:28:50.455101 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 26 13:28:50.455101 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:50.456887 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2baa8ab2-adec-4b56-a0f4-3a9e29a4bcfd tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Returning 404 to user: Instance -1 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:28:50.459659 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2baa8ab2-adec-4b56-a0f4-3a9e29a4bcfd tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.015655 Oct 26 13:28:50.460414 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2639/5307] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 26 13:28:50 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:28:50.472415 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4088afe2-2398-41f9-9286-119984a5d01c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:50.474001 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4088afe2-2398-41f9-9286-119984a5d01c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:50.514110 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4088afe2-2398-41f9-9286-119984a5d01c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:50.521059 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4088afe2-2398-41f9-9286-119984a5d01c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:50.521756 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4088afe2-2398-41f9-9286-119984a5d01c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:50.525534 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4088afe2-2398-41f9-9286-119984a5d01c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:50.527335 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4088afe2-2398-41f9-9286-119984a5d01c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:50.529803 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4088afe2-2398-41f9-9286-119984a5d01c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:50.788977 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6f07f3d8-17ea-4c83-9a81-c0a8f9b37d33 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f6731528160>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:50.995826 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6f07f3d8-17ea-4c83-9a81-c0a8f9b37d33 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc" status: 200 len: 1454 microversion: 2.1 time: 0.232188 Oct 26 13:28:51.003349 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2640/5308] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:50 2022] GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc => generated 1454 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:51.030237 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d296e91d-4031-4f18-b78c-309453429e37 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:28:51.035744 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d296e91d-4031-4f18-b78c-309453429e37 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 3513f7b0-b7d1-4b0f-963e-709a892a275d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:51.052041 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d296e91d-4031-4f18-b78c-309453429e37 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:51.054141 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d296e91d-4031-4f18-b78c-309453429e37 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:51.055888 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d296e91d-4031-4f18-b78c-309453429e37 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:51.058051 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d296e91d-4031-4f18-b78c-309453429e37 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:51.059949 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d296e91d-4031-4f18-b78c-309453429e37 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:51.061133 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d296e91d-4031-4f18-b78c-309453429e37 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:51.074708 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4088afe2-2398-41f9-9286-119984a5d01c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:51.088686 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4088afe2-2398-41f9-9286-119984a5d01c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.623293 Oct 26 13:28:51.102535 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2669/5309] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:50 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:51.142617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3fcc03be-4a68-430b-9e12-14e66c990ea2 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:51.144737 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3fcc03be-4a68-430b-9e12-14e66c990ea2 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:51.169247 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3fcc03be-4a68-430b-9e12-14e66c990ea2 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:51.171288 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3fcc03be-4a68-430b-9e12-14e66c990ea2 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:51.174348 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3fcc03be-4a68-430b-9e12-14e66c990ea2 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:51.175697 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3fcc03be-4a68-430b-9e12-14e66c990ea2 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:51.178934 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3fcc03be-4a68-430b-9e12-14e66c990ea2 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:51.180402 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3fcc03be-4a68-430b-9e12-14e66c990ea2 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:51.206358 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d296e91d-4031-4f18-b78c-309453429e37 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "POST /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d/action" status: 200 len: 14 microversion: 2.1 time: 0.200076 Oct 26 13:28:51.207518 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2641/5310] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:28:51 2022] POST /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d/action => generated 14 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:28:51.443668 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3fcc03be-4a68-430b-9e12-14e66c990ea2 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:51.462621 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3fcc03be-4a68-430b-9e12-14e66c990ea2 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.345820 Oct 26 13:28:51.480609 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2670/5311] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:51 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:51.515960 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cb4d66b2-2841-42b1-a1db-f6c4716c9e92 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:28:51.523541 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cb4d66b2-2841-42b1-a1db-f6c4716c9e92 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: 1890c2f7-9025-4c08-80bd-a72216d471de] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:51.553394 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-cb4d66b2-2841-42b1-a1db-f6c4716c9e92 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] HTTP exception thrown: Instance 1890c2f7-9025-4c08-80bd-a72216d471de could not be found. Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cb4d66b2-2841-42b1-a1db-f6c4716c9e92 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Request method failure captured: Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/servers/1890c2f7-9025-4c08-80bd-a72216d471de/action HTTP/1.1 Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 19 Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTWpf9Job1by08RPlBi4BK3ZRus12IuUwpixxL0U8NmqouWwnfDFM_ku9arLt0Dfw_g2zljJol9iSiPHbr2OBJI9bA6xxReUYgF5HT4trI936uilzQCNXRfNWHD8SC65BfL8JHiNMAmXVHxHedc9hkhsO-eHURoIHHJwTTh6ig9qSq0 Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/088eb22706844984b58fe118d5421cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_088eb22706844984b58fe118d5421cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}] Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 9b8db27e3baf4b6a948f6d23c04cf680 Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: {"forceDelete": {}} Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 1890c2f7-9025-4c08-80bd-a72216d471de could not be found. Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '1890c2f7-9025-4c08-80bd-a72216d471de', 'body': {'forceDelete': {}}} Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1890c2f7-9025-4c08-80bd-a72216d471de could not be found. Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1890c2f7-9025-4c08-80bd-a72216d471de could not be found. Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:28:51.576677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:28:51.594750 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:28:51.594750 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:28:51.594750 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1890c2f7-9025-4c08-80bd-a72216d471de could not be found. Oct 26 13:28:51.594750 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:28:51.594750 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cb4d66b2-2841-42b1-a1db-f6c4716c9e92 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Returning 404 to user: Instance 1890c2f7-9025-4c08-80bd-a72216d471de could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:28:51.594750 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cb4d66b2-2841-42b1-a1db-f6c4716c9e92 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "POST /compute/v2.1/servers/1890c2f7-9025-4c08-80bd-a72216d471de/action" status: 404 len: 111 microversion: 2.1 time: 0.083072 Oct 26 13:28:51.594750 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2642/5312] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:28:51 2022] POST /compute/v2.1/servers/1890c2f7-9025-4c08-80bd-a72216d471de/action => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:28:51.618057 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-07f54bfa-8277-41df-88d1-8e4cfca3b2ee tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:51.618696 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-07f54bfa-8277-41df-88d1-8e4cfca3b2ee tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:51.661711 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07f54bfa-8277-41df-88d1-8e4cfca3b2ee tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:51.672802 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07f54bfa-8277-41df-88d1-8e4cfca3b2ee tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:51.674093 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07f54bfa-8277-41df-88d1-8e4cfca3b2ee tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:51.679959 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07f54bfa-8277-41df-88d1-8e4cfca3b2ee tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:51.680453 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07f54bfa-8277-41df-88d1-8e4cfca3b2ee tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:51.680903 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07f54bfa-8277-41df-88d1-8e4cfca3b2ee tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:52.019023 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-eeb58049-cede-499b-9420-e6b17f6bc35e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f673151eaf0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:52.147275 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-eeb58049-cede-499b-9420-e6b17f6bc35e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc" status: 200 len: 1454 microversion: 2.1 time: 0.132011 Oct 26 13:28:52.170762 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2643/5313] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:52 2022] GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc => generated 1454 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:28:52.221501 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e76fe21c-0473-4939-99bf-154781a1b99a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:28:52.224524 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e76fe21c-0473-4939-99bf-154781a1b99a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 3513f7b0-b7d1-4b0f-963e-709a892a275d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:52.233836 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e76fe21c-0473-4939-99bf-154781a1b99a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:52.234632 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e76fe21c-0473-4939-99bf-154781a1b99a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:52.237152 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e76fe21c-0473-4939-99bf-154781a1b99a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:52.238308 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e76fe21c-0473-4939-99bf-154781a1b99a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:52.239303 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e76fe21c-0473-4939-99bf-154781a1b99a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:52.240033 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e76fe21c-0473-4939-99bf-154781a1b99a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:52.301393 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e76fe21c-0473-4939-99bf-154781a1b99a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "POST /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d/action" status: 200 len: 14 microversion: 2.1 time: 0.086904 Oct 26 13:28:52.305532 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2644/5314] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:28:52 2022] POST /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 26 13:28:52.341365 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-07f54bfa-8277-41df-88d1-8e4cfca3b2ee tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:52.351135 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-07f54bfa-8277-41df-88d1-8e4cfca3b2ee tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.752017 Oct 26 13:28:52.351748 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2671/5315] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:51 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:52.381370 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-25b43020-2710-4106-ba82-1b8725bed8f8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:52.382302 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-25b43020-2710-4106-ba82-1b8725bed8f8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:52.405856 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-25b43020-2710-4106-ba82-1b8725bed8f8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:52.407273 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-25b43020-2710-4106-ba82-1b8725bed8f8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:52.408322 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-25b43020-2710-4106-ba82-1b8725bed8f8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:52.409728 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-25b43020-2710-4106-ba82-1b8725bed8f8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:52.415611 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-25b43020-2710-4106-ba82-1b8725bed8f8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:52.416402 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-25b43020-2710-4106-ba82-1b8725bed8f8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:53.078576 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-25b43020-2710-4106-ba82-1b8725bed8f8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:53.091243 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-25b43020-2710-4106-ba82-1b8725bed8f8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.714228 Oct 26 13:28:53.094861 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2645/5316] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:52 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:53.125290 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5d30ee56-58c4-43b5-abcd-40b7d7da978f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:28:53.129324 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5d30ee56-58c4-43b5-abcd-40b7d7da978f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: 64f8f991-9643-4906-be3a-75c889c299b3] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:53.157218 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-5d30ee56-58c4-43b5-abcd-40b7d7da978f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] HTTP exception thrown: Instance 64f8f991-9643-4906-be3a-75c889c299b3 could not be found. Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5d30ee56-58c4-43b5-abcd-40b7d7da978f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Request method failure captured: Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/servers/64f8f991-9643-4906-be3a-75c889c299b3/action HTTP/1.1 Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 39 Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTWpf9Job1by08RPlBi4BK3ZRus12IuUwpixxL0U8NmqouWwnfDFM_ku9arLt0Dfw_g2zljJol9iSiPHbr2OBJI9bA6xxReUYgF5HT4trI936uilzQCNXRfNWHD8SC65BfL8JHiNMAmXVHxHedc9hkhsO-eHURoIHHJwTTh6ig9qSq0 Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/088eb22706844984b58fe118d5421cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_088eb22706844984b58fe118d5421cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}] Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 9b8db27e3baf4b6a948f6d23c04cf680 Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: {"os-getConsoleOutput": {"length": 10}} Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 64f8f991-9643-4906-be3a-75c889c299b3 could not be found. Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '64f8f991-9643-4906-be3a-75c889c299b3', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64f8f991-9643-4906-be3a-75c889c299b3 could not be found. Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64f8f991-9643-4906-be3a-75c889c299b3 could not be found. Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:53.166036 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:53.169296 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:28:53.169296 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:28:53.169296 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:28:53.169296 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:28:53.169296 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64f8f991-9643-4906-be3a-75c889c299b3 could not be found. Oct 26 13:28:53.169296 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:53.169296 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5d30ee56-58c4-43b5-abcd-40b7d7da978f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Returning 404 to user: Instance 64f8f991-9643-4906-be3a-75c889c299b3 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:28:53.171559 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5d30ee56-58c4-43b5-abcd-40b7d7da978f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "POST /compute/v2.1/servers/64f8f991-9643-4906-be3a-75c889c299b3/action" status: 404 len: 111 microversion: 2.1 time: 0.049867 Oct 26 13:28:53.180411 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1362530f-7f6d-4134-8541-411314c64c03 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67320cad30>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:53.189140 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2672/5317] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:28:53 2022] POST /compute/v2.1/servers/64f8f991-9643-4906-be3a-75c889c299b3/action => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:28:53.213056 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3c15e65c-06d3-4c94-8f33-a0f9a95af682 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:53.213748 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3c15e65c-06d3-4c94-8f33-a0f9a95af682 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:53.239140 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c15e65c-06d3-4c94-8f33-a0f9a95af682 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:53.242473 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c15e65c-06d3-4c94-8f33-a0f9a95af682 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:53.243042 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c15e65c-06d3-4c94-8f33-a0f9a95af682 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:53.265001 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c15e65c-06d3-4c94-8f33-a0f9a95af682 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:53.267764 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c15e65c-06d3-4c94-8f33-a0f9a95af682 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:53.268177 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c15e65c-06d3-4c94-8f33-a0f9a95af682 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:53.294702 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1362530f-7f6d-4134-8541-411314c64c03 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc" status: 200 len: 1454 microversion: 2.1 time: 0.118183 Oct 26 13:28:53.301156 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2646/5318] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:53 2022] GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc => generated 1454 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:28:53.338337 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2f1ab4e0-c478-4d64-8271-14bdd035d4f2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:28:53.352581 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2f1ab4e0-c478-4d64-8271-14bdd035d4f2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 3513f7b0-b7d1-4b0f-963e-709a892a275d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:53.407661 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2f1ab4e0-c478-4d64-8271-14bdd035d4f2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:53.416311 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2f1ab4e0-c478-4d64-8271-14bdd035d4f2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:53.419599 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2f1ab4e0-c478-4d64-8271-14bdd035d4f2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:53.421813 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2f1ab4e0-c478-4d64-8271-14bdd035d4f2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:53.424827 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2f1ab4e0-c478-4d64-8271-14bdd035d4f2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:53.428589 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2f1ab4e0-c478-4d64-8271-14bdd035d4f2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:53.656969 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2f1ab4e0-c478-4d64-8271-14bdd035d4f2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "POST /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d/action" status: 200 len: 14 microversion: 2.1 time: 0.346612 Oct 26 13:28:53.658333 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2647/5319] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:28:53 2022] POST /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d/action => generated 14 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:28:54.317713 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d6d42a0a-aa78-46e8-a528-77430dc462b1 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f6732648790>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:54.414061 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d6d42a0a-aa78-46e8-a528-77430dc462b1 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc" status: 200 len: 1454 microversion: 2.1 time: 0.100731 Oct 26 13:28:54.421934 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2648/5320] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:54 2022] GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc => generated 1454 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:54.490205 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3c15e65c-06d3-4c94-8f33-a0f9a95af682 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:54.502192 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3c15e65c-06d3-4c94-8f33-a0f9a95af682 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 1.311221 Oct 26 13:28:54.503349 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2673/5321] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:53 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:54.531452 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7d257342-59c0-4b59-bf53-e83f063d3ea2 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:54.533038 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7d257342-59c0-4b59-bf53-e83f063d3ea2 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:54.566690 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d257342-59c0-4b59-bf53-e83f063d3ea2 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:54.567339 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d257342-59c0-4b59-bf53-e83f063d3ea2 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:54.567804 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d257342-59c0-4b59-bf53-e83f063d3ea2 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:54.579684 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d257342-59c0-4b59-bf53-e83f063d3ea2 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:54.580309 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d257342-59c0-4b59-bf53-e83f063d3ea2 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:54.599561 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d257342-59c0-4b59-bf53-e83f063d3ea2 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:54.669817 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-32d66136-58a3-4229-8a5c-4c3165d13665 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:28:54.672791 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-32d66136-58a3-4229-8a5c-4c3165d13665 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 3513f7b0-b7d1-4b0f-963e-709a892a275d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:54.728533 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32d66136-58a3-4229-8a5c-4c3165d13665 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:54.729072 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32d66136-58a3-4229-8a5c-4c3165d13665 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:54.729529 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32d66136-58a3-4229-8a5c-4c3165d13665 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:54.730257 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32d66136-58a3-4229-8a5c-4c3165d13665 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:54.732028 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32d66136-58a3-4229-8a5c-4c3165d13665 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:54.732480 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32d66136-58a3-4229-8a5c-4c3165d13665 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:54.921764 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-32d66136-58a3-4229-8a5c-4c3165d13665 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "POST /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d/action" status: 200 len: 14 microversion: 2.1 time: 0.257024 Oct 26 13:28:54.928283 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2674/5322] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:28:54 2022] POST /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d/action => generated 14 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 26 13:28:55.437980 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5e32261d-f0b9-4385-b6d5-326350d9ad6f tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67311b0af0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:55.552106 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5e32261d-f0b9-4385-b6d5-326350d9ad6f tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc" status: 200 len: 1454 microversion: 2.1 time: 0.119272 Oct 26 13:28:55.561472 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2675/5323] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:55 2022] GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc => generated 1454 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:28:55.932858 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ad8391b3-32f3-41ec-a1a3-c41ace7d6b45 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:28:55.935892 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ad8391b3-32f3-41ec-a1a3-c41ace7d6b45 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 3513f7b0-b7d1-4b0f-963e-709a892a275d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:55.962022 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ad8391b3-32f3-41ec-a1a3-c41ace7d6b45 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:55.962625 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ad8391b3-32f3-41ec-a1a3-c41ace7d6b45 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:55.963678 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ad8391b3-32f3-41ec-a1a3-c41ace7d6b45 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:55.975682 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ad8391b3-32f3-41ec-a1a3-c41ace7d6b45 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:55.977578 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ad8391b3-32f3-41ec-a1a3-c41ace7d6b45 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:55.979356 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ad8391b3-32f3-41ec-a1a3-c41ace7d6b45 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:56.093100 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ad8391b3-32f3-41ec-a1a3-c41ace7d6b45 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "POST /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d/action" status: 200 len: 14 microversion: 2.1 time: 0.164482 Oct 26 13:28:56.097848 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2676/5324] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:28:55 2022] POST /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d/action => generated 14 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 26 13:28:56.138160 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7d257342-59c0-4b59-bf53-e83f063d3ea2 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:56.179247 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7d257342-59c0-4b59-bf53-e83f063d3ea2 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 1.652646 Oct 26 13:28:56.193541 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2649/5325] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:54 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 1657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:56.212379 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7329e31e-d95b-474c-96c2-fe7c70afc12f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:56.213707 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7329e31e-d95b-474c-96c2-fe7c70afc12f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: 27a4f294-029a-4e78-b236-b070b04b0fd2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:56.256176 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-7329e31e-d95b-474c-96c2-fe7c70afc12f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] HTTP exception thrown: Instance 27a4f294-029a-4e78-b236-b070b04b0fd2 could not be found. Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7329e31e-d95b-474c-96c2-fe7c70afc12f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Request method failure captured: Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/27a4f294-029a-4e78-b236-b070b04b0fd2 HTTP/1.1 Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTWpf9Job1by08RPlBi4BK3ZRus12IuUwpixxL0U8NmqouWwnfDFM_ku9arLt0Dfw_g2zljJol9iSiPHbr2OBJI9bA6xxReUYgF5HT4trI936uilzQCNXRfNWHD8SC65BfL8JHiNMAmXVHxHedc9hkhsO-eHURoIHHJwTTh6ig9qSq0 Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/088eb22706844984b58fe118d5421cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_088eb22706844984b58fe118d5421cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}] Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 9b8db27e3baf4b6a948f6d23c04cf680 Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 27a4f294-029a-4e78-b236-b070b04b0fd2 could not be found. Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '27a4f294-029a-4e78-b236-b070b04b0fd2'} Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27a4f294-029a-4e78-b236-b070b04b0fd2 could not be found. Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27a4f294-029a-4e78-b236-b070b04b0fd2 could not be found. Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:56.271261 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:28:56.279637 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:28:56.279637 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:28:56.279637 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:28:56.279637 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27a4f294-029a-4e78-b236-b070b04b0fd2 could not be found. Oct 26 13:28:56.279637 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:56.279637 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7329e31e-d95b-474c-96c2-fe7c70afc12f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Returning 404 to user: Instance 27a4f294-029a-4e78-b236-b070b04b0fd2 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:28:56.279637 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7329e31e-d95b-474c-96c2-fe7c70afc12f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/27a4f294-029a-4e78-b236-b070b04b0fd2" status: 404 len: 111 microversion: 2.1 time: 0.065466 Oct 26 13:28:56.279637 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2677/5326] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:56 2022] GET /compute/v2.1/servers/27a4f294-029a-4e78-b236-b070b04b0fd2 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:28:56.285210 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-60f70748-5db7-44ee-9c29-5b937897669f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:56.285962 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-60f70748-5db7-44ee-9c29-5b937897669f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:56.318026 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-60f70748-5db7-44ee-9c29-5b937897669f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:56.325236 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-60f70748-5db7-44ee-9c29-5b937897669f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:56.325737 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-60f70748-5db7-44ee-9c29-5b937897669f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:56.333107 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-60f70748-5db7-44ee-9c29-5b937897669f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:56.341970 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-60f70748-5db7-44ee-9c29-5b937897669f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:56.343270 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-60f70748-5db7-44ee-9c29-5b937897669f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:56.568183 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b879257f-806f-44db-8d26-54d27b644df1 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f673241e940>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:56.667045 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b879257f-806f-44db-8d26-54d27b644df1 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc" status: 200 len: 1454 microversion: 2.1 time: 0.102651 Oct 26 13:28:56.667779 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2678/5327] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:56 2022] GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc => generated 1454 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:28:57.106274 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6669babc-399f-474c-997c-5c5cb3b2dc3f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:28:57.109101 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6669babc-399f-474c-997c-5c5cb3b2dc3f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 3513f7b0-b7d1-4b0f-963e-709a892a275d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:57.144384 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6669babc-399f-474c-997c-5c5cb3b2dc3f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:57.145056 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6669babc-399f-474c-997c-5c5cb3b2dc3f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:57.149719 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6669babc-399f-474c-997c-5c5cb3b2dc3f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:57.150651 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6669babc-399f-474c-997c-5c5cb3b2dc3f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:57.154528 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6669babc-399f-474c-997c-5c5cb3b2dc3f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:57.155490 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6669babc-399f-474c-997c-5c5cb3b2dc3f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:57.285660 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6669babc-399f-474c-997c-5c5cb3b2dc3f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "POST /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d/action" status: 200 len: 14 microversion: 2.1 time: 0.184363 Oct 26 13:28:57.294180 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2679/5328] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:28:57 2022] POST /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d/action => generated 14 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:28:57.400769 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-60f70748-5db7-44ee-9c29-5b937897669f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:57.425371 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-60f70748-5db7-44ee-9c29-5b937897669f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 1.146580 Oct 26 13:28:57.438652 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2650/5329] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:56 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:57.461635 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-904645a9-cc33-49cb-b855-1cf2b9b16b9f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:57.462350 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-904645a9-cc33-49cb-b855-1cf2b9b16b9f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:57.491896 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-904645a9-cc33-49cb-b855-1cf2b9b16b9f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:57.492630 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-904645a9-cc33-49cb-b855-1cf2b9b16b9f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:57.493219 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-904645a9-cc33-49cb-b855-1cf2b9b16b9f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:57.494164 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-904645a9-cc33-49cb-b855-1cf2b9b16b9f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:57.494778 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-904645a9-cc33-49cb-b855-1cf2b9b16b9f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:57.495378 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-904645a9-cc33-49cb-b855-1cf2b9b16b9f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:57.684307 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e42dfff6-db65-4e59-89b0-254d213293c7 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f6731ac91f0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:57.813428 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e42dfff6-db65-4e59-89b0-254d213293c7 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc" status: 200 len: 1454 microversion: 2.1 time: 0.133497 Oct 26 13:28:57.824694 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2651/5330] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:57 2022] GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc => generated 1454 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:28:57.995073 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-904645a9-cc33-49cb-b855-1cf2b9b16b9f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:58.026810 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-904645a9-cc33-49cb-b855-1cf2b9b16b9f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.568645 Oct 26 13:28:58.043823 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2680/5331] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:57 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:58.297832 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d6a9837f-4471-4036-ac2b-0f26af42f515 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:28:58.300132 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d6a9837f-4471-4036-ac2b-0f26af42f515 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 3513f7b0-b7d1-4b0f-963e-709a892a275d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:58.319318 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d548927e-3ac3-4fdc-9205-3dfe1f1de13f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2029311760", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "56363c00-6608-4ad0-9892-d3ecfbb7f0c5"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:28:58.346365 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6a9837f-4471-4036-ac2b-0f26af42f515 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:58.347528 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6a9837f-4471-4036-ac2b-0f26af42f515 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d548927e-3ac3-4fdc-9205-3dfe1f1de13f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Request method failure captured: Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 238 Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTWpf9Job1by08RPlBi4BK3ZRus12IuUwpixxL0U8NmqouWwnfDFM_ku9arLt0Dfw_g2zljJol9iSiPHbr2OBJI9bA6xxReUYgF5HT4trI936uilzQCNXRfNWHD8SC65BfL8JHiNMAmXVHxHedc9hkhsO-eHURoIHHJwTTh6ig9qSq0 Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/088eb22706844984b58fe118d5421cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_088eb22706844984b58fe118d5421cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}] Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 9b8db27e3baf4b6a948f6d23c04cf680 Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2029311760", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "56363c00-6608-4ad0-9892-d3ecfbb7f0c5"}]}} Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2029311760', 'imageRef': '762c20f4-0f9b-45cb-bd95-cf21a747b33b', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '56363c00-6608-4ad0-9892-d3ecfbb7f0c5'}]}}} Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise error Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:58.348835 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:58.352531 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:28:58.352531 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:28:58.352531 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:28:58.352531 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:28:58.352531 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:28:58.352531 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:28:58.352531 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:28:58.352531 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:28:58.352531 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 13:28:58.352531 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 13:28:58.352531 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 13:28:58.352531 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 13:28:58.352531 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 13:28:58.352531 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 13:28:58.352531 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 26 13:28:58.352531 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:58.352531 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:28:58.352531 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:58.352531 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:28:58.352531 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:28:58.352531 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:28:58.352531 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 13:28:58.352531 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 13:28:58.352531 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 26 13:28:58.352531 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:28:58.355154 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d548927e-3ac3-4fdc-9205-3dfe1f1de13f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:28:58.356396 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6a9837f-4471-4036-ac2b-0f26af42f515 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:58.357163 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6a9837f-4471-4036-ac2b-0f26af42f515 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:58.357371 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d548927e-3ac3-4fdc-9205-3dfe1f1de13f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.041106 Oct 26 13:28:58.357674 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6a9837f-4471-4036-ac2b-0f26af42f515 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:58.358113 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6a9837f-4471-4036-ac2b-0f26af42f515 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:58.374089 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2681/5332] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:28:58 2022] POST /compute/v2.1/servers => generated 139 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:28:58.406896 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ae379f01-28ec-44f3-be9f-e4844ece3e91 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:58.407668 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ae379f01-28ec-44f3-be9f-e4844ece3e91 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:58.422811 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae379f01-28ec-44f3-be9f-e4844ece3e91 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:58.427591 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae379f01-28ec-44f3-be9f-e4844ece3e91 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:58.428166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae379f01-28ec-44f3-be9f-e4844ece3e91 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:58.429036 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae379f01-28ec-44f3-be9f-e4844ece3e91 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:58.432453 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae379f01-28ec-44f3-be9f-e4844ece3e91 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:58.433026 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae379f01-28ec-44f3-be9f-e4844ece3e91 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:58.497433 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d6a9837f-4471-4036-ac2b-0f26af42f515 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "POST /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d/action" status: 200 len: 14 microversion: 2.1 time: 0.204198 Oct 26 13:28:58.503578 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2652/5333] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:28:58 2022] POST /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d/action => generated 14 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:28:58.831168 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2c422c82-1e0f-45de-bbfd-27ae21c128c8 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f6731ac9280>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:58.936558 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2c422c82-1e0f-45de-bbfd-27ae21c128c8 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc" status: 200 len: 1454 microversion: 2.1 time: 0.110223 Oct 26 13:28:58.946179 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2653/5334] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:58 2022] GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc => generated 1454 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:28:59.046290 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ae379f01-28ec-44f3-be9f-e4844ece3e91 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:28:59.054561 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ae379f01-28ec-44f3-be9f-e4844ece3e91 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.679157 Oct 26 13:28:59.062804 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2682/5335] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:58 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:28:59.090594 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-37458b23-4ad5-45d7-adc7-926b3fc01925 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:28:59.091878 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-37458b23-4ad5-45d7-adc7-926b3fc01925 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:59.114498 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37458b23-4ad5-45d7-adc7-926b3fc01925 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:59.118303 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37458b23-4ad5-45d7-adc7-926b3fc01925 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:59.119138 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37458b23-4ad5-45d7-adc7-926b3fc01925 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:59.120119 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37458b23-4ad5-45d7-adc7-926b3fc01925 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:59.127519 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37458b23-4ad5-45d7-adc7-926b3fc01925 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:59.128445 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37458b23-4ad5-45d7-adc7-926b3fc01925 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:59.512540 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9eb30298-caf6-490d-bc9e-626ca576c63d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:28:59.516412 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9eb30298-caf6-490d-bc9e-626ca576c63d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 3513f7b0-b7d1-4b0f-963e-709a892a275d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:28:59.538655 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9eb30298-caf6-490d-bc9e-626ca576c63d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:59.541024 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9eb30298-caf6-490d-bc9e-626ca576c63d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:59.545992 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9eb30298-caf6-490d-bc9e-626ca576c63d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:59.547373 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9eb30298-caf6-490d-bc9e-626ca576c63d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:28:59.548066 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9eb30298-caf6-490d-bc9e-626ca576c63d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:28:59.548730 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9eb30298-caf6-490d-bc9e-626ca576c63d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:28:59.655726 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9eb30298-caf6-490d-bc9e-626ca576c63d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "POST /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d/action" status: 200 len: 14 microversion: 2.1 time: 0.147829 Oct 26 13:28:59.661872 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2683/5336] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:28:59 2022] POST /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d/action => generated 14 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 26 13:28:59.966491 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4d28a619-58a0-4022-87de-312d798ee7b0 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67369e7310>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:00.056735 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-37458b23-4ad5-45d7-adc7-926b3fc01925 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:00.078243 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-37458b23-4ad5-45d7-adc7-926b3fc01925 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.992265 Oct 26 13:29:00.088598 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2654/5337] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:28:59 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:00.100959 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4d28a619-58a0-4022-87de-312d798ee7b0 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc" status: 200 len: 1454 microversion: 2.1 time: 0.140104 Oct 26 13:29:00.103041 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2684/5338] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:28:59 2022] GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc => generated 1454 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:29:00.222040 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b6e7fdd2-70a9-46c3-9e0d-fdce51f05511 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1694574244", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "56363c00-6608-4ad0-9892-d3ecfbb7f0c5"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b6e7fdd2-70a9-46c3-9e0d-fdce51f05511 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Request method failure captured: Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 235 Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTWpf9Job1by08RPlBi4BK3ZRus12IuUwpixxL0U8NmqouWwnfDFM_ku9arLt0Dfw_g2zljJol9iSiPHbr2OBJI9bA6xxReUYgF5HT4trI936uilzQCNXRfNWHD8SC65BfL8JHiNMAmXVHxHedc9hkhsO-eHURoIHHJwTTh6ig9qSq0 Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/088eb22706844984b58fe118d5421cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_088eb22706844984b58fe118d5421cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}] Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 9b8db27e3baf4b6a948f6d23c04cf680 Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1694574244", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "56363c00-6608-4ad0-9892-d3ecfbb7f0c5"}]}} Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1694574244', 'imageRef': '762c20f4-0f9b-45cb-bd95-cf21a747b33b', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '56363c00-6608-4ad0-9892-d3ecfbb7f0c5'}]}}} Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise error Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:00.228378 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:00.232764 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:29:00.232764 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:29:00.232764 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:29:00.232764 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:29:00.232764 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:29:00.232764 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:29:00.232764 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:29:00.232764 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:29:00.232764 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 13:29:00.232764 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 13:29:00.232764 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 13:29:00.232764 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 13:29:00.232764 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 13:29:00.232764 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 13:29:00.232764 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 26 13:29:00.232764 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:00.232764 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:29:00.232764 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:00.232764 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:00.232764 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:29:00.232764 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:29:00.232764 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 13:29:00.232764 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 13:29:00.232764 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 26 13:29:00.232764 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:00.242243 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b6e7fdd2-70a9-46c3-9e0d-fdce51f05511 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:29:00.243554 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b6e7fdd2-70a9-46c3-9e0d-fdce51f05511 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.025700 Oct 26 13:29:00.252178 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2655/5339] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:29:00 2022] POST /compute/v2.1/servers => generated 133 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:29:00.260281 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-106ebb0a-3d50-422e-bc41-887712cf7c07 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:00.261268 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-106ebb0a-3d50-422e-bc41-887712cf7c07 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:00.288166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-106ebb0a-3d50-422e-bc41-887712cf7c07 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:00.291982 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-106ebb0a-3d50-422e-bc41-887712cf7c07 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:00.296377 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-106ebb0a-3d50-422e-bc41-887712cf7c07 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:00.298038 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-106ebb0a-3d50-422e-bc41-887712cf7c07 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:00.302065 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-106ebb0a-3d50-422e-bc41-887712cf7c07 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:00.305897 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-106ebb0a-3d50-422e-bc41-887712cf7c07 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:00.671424 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8eb8d7f7-f715-4c1e-95c1-c2be8bf49e42 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:29:00.676896 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8eb8d7f7-f715-4c1e-95c1-c2be8bf49e42 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 3513f7b0-b7d1-4b0f-963e-709a892a275d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:00.693764 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8eb8d7f7-f715-4c1e-95c1-c2be8bf49e42 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:00.694825 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8eb8d7f7-f715-4c1e-95c1-c2be8bf49e42 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:00.696679 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8eb8d7f7-f715-4c1e-95c1-c2be8bf49e42 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:00.698401 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8eb8d7f7-f715-4c1e-95c1-c2be8bf49e42 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:00.701240 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8eb8d7f7-f715-4c1e-95c1-c2be8bf49e42 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:00.703843 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8eb8d7f7-f715-4c1e-95c1-c2be8bf49e42 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:00.835827 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8eb8d7f7-f715-4c1e-95c1-c2be8bf49e42 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "POST /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d/action" status: 200 len: 8207 microversion: 2.1 time: 0.172304 Oct 26 13:29:00.837012 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2656/5340] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:29:00 2022] POST /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d/action => generated 8207 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:29:00.850068 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-313baf3e-fd43-4ff4-b7aa-ff7626a3f69c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:00.853895 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-313baf3e-fd43-4ff4-b7aa-ff7626a3f69c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:00.897776 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-313baf3e-fd43-4ff4-b7aa-ff7626a3f69c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:00.898609 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-313baf3e-fd43-4ff4-b7aa-ff7626a3f69c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:00.899509 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-313baf3e-fd43-4ff4-b7aa-ff7626a3f69c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:00.900461 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-313baf3e-fd43-4ff4-b7aa-ff7626a3f69c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:00.901130 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-313baf3e-fd43-4ff4-b7aa-ff7626a3f69c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:00.901826 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-313baf3e-fd43-4ff4-b7aa-ff7626a3f69c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:01.214584 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-106ebb0a-3d50-422e-bc41-887712cf7c07 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:01.234333 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-106ebb0a-3d50-422e-bc41-887712cf7c07 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.979188 Oct 26 13:29:01.235306 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2685/5341] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:00 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:01.240825 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e3764f1f-e0e7-4d05-a6d2-02f3248f09c1 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67317f6d30>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:01.348583 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e3764f1f-e0e7-4d05-a6d2-02f3248f09c1 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc" status: 200 len: 1454 microversion: 2.1 time: 0.111480 Oct 26 13:29:01.349743 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2686/5342] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:29:01 2022] GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc => generated 1454 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:01.365722 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2a9f25f8-ba1a-4f3d-968e-eec0519f3f08 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:01.368782 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2a9f25f8-ba1a-4f3d-968e-eec0519f3f08 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:01.396517 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2a9f25f8-ba1a-4f3d-968e-eec0519f3f08 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:01.398656 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2a9f25f8-ba1a-4f3d-968e-eec0519f3f08 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:01.400445 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2a9f25f8-ba1a-4f3d-968e-eec0519f3f08 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:01.401352 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2a9f25f8-ba1a-4f3d-968e-eec0519f3f08 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:01.404400 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2a9f25f8-ba1a-4f3d-968e-eec0519f3f08 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:01.406017 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2a9f25f8-ba1a-4f3d-968e-eec0519f3f08 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:02.120301 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-313baf3e-fd43-4ff4-b7aa-ff7626a3f69c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:02.132370 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-313baf3e-fd43-4ff4-b7aa-ff7626a3f69c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 1.288299 Oct 26 13:29:02.132950 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2657/5343] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:00 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:02.165443 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1a0fc053-fab1-4fb4-a60d-2a195ead758d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:02.172178 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1a0fc053-fab1-4fb4-a60d-2a195ead758d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:02.195784 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a0fc053-fab1-4fb4-a60d-2a195ead758d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:02.197003 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a0fc053-fab1-4fb4-a60d-2a195ead758d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:02.199328 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a0fc053-fab1-4fb4-a60d-2a195ead758d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:02.201593 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a0fc053-fab1-4fb4-a60d-2a195ead758d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:02.203153 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a0fc053-fab1-4fb4-a60d-2a195ead758d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:02.204066 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a0fc053-fab1-4fb4-a60d-2a195ead758d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:02.382187 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2a9f25f8-ba1a-4f3d-968e-eec0519f3f08 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:02.398736 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2a9f25f8-ba1a-4f3d-968e-eec0519f3f08 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 1.047661 Oct 26 13:29:02.404452 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2687/5344] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:01 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:02.426364 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b77368f6-3787-468c-8586-18a59b04936c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67316d4430>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:02.551181 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b77368f6-3787-468c-8586-18a59b04936c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc" status: 200 len: 1463 microversion: 2.1 time: 0.144990 Oct 26 13:29:02.554125 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2688/5345] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:29:02 2022] GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc => generated 1463 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:02.580615 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-837bb51f-fd54-4bb4-a1c7-8d7501115efc tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:29:02.582819 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-837bb51f-fd54-4bb4-a1c7-8d7501115efc tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: 16ebe89c-10a0-4e7c-b922-0b5a3d47804d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:02.598175 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-837bb51f-fd54-4bb4-a1c7-8d7501115efc tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] HTTP exception thrown: Instance 16ebe89c-10a0-4e7c-b922-0b5a3d47804d could not be found. Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-837bb51f-fd54-4bb4-a1c7-8d7501115efc tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Request method failure captured: Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/servers/16ebe89c-10a0-4e7c-b922-0b5a3d47804d/action HTTP/1.1 Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 13 Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTWpf9Job1by08RPlBi4BK3ZRus12IuUwpixxL0U8NmqouWwnfDFM_ku9arLt0Dfw_g2zljJol9iSiPHbr2OBJI9bA6xxReUYgF5HT4trI936uilzQCNXRfNWHD8SC65BfL8JHiNMAmXVHxHedc9hkhsO-eHURoIHHJwTTh6ig9qSq0 Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/088eb22706844984b58fe118d5421cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_088eb22706844984b58fe118d5421cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}] Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 9b8db27e3baf4b6a948f6d23c04cf680 Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: {"pause": {}} Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 16ebe89c-10a0-4e7c-b922-0b5a3d47804d could not be found. Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '16ebe89c-10a0-4e7c-b922-0b5a3d47804d', 'body': {'pause': {}}} Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16ebe89c-10a0-4e7c-b922-0b5a3d47804d could not be found. Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16ebe89c-10a0-4e7c-b922-0b5a3d47804d could not be found. Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:29:02.613525 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:29:02.616877 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:29:02.616877 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:29:02.616877 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16ebe89c-10a0-4e7c-b922-0b5a3d47804d could not be found. Oct 26 13:29:02.616877 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:29:02.620799 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-837bb51f-fd54-4bb4-a1c7-8d7501115efc tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Returning 404 to user: Instance 16ebe89c-10a0-4e7c-b922-0b5a3d47804d could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:29:02.621928 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-837bb51f-fd54-4bb4-a1c7-8d7501115efc tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "POST /compute/v2.1/servers/16ebe89c-10a0-4e7c-b922-0b5a3d47804d/action" status: 404 len: 111 microversion: 2.1 time: 0.066386 Oct 26 13:29:02.622815 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2689/5346] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:29:02 2022] POST /compute/v2.1/servers/16ebe89c-10a0-4e7c-b922-0b5a3d47804d/action => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:29:02.631176 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-10cef579-38ab-47b1-9373-1018e18b2db6 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67311db4c0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:02.724918 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-10cef579-38ab-47b1-9373-1018e18b2db6 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc" status: 200 len: 1463 microversion: 2.1 time: 0.097560 Oct 26 13:29:02.738872 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2690/5347] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:29:02 2022] GET /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc => generated 1463 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:02.752633 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-33db510c-3d3f-4583-aaa4-d21b69fab465 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:02.753269 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-33db510c-3d3f-4583-aaa4-d21b69fab465 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:02.770756 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33db510c-3d3f-4583-aaa4-d21b69fab465 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:02.771601 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33db510c-3d3f-4583-aaa4-d21b69fab465 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:02.772224 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33db510c-3d3f-4583-aaa4-d21b69fab465 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:02.773138 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33db510c-3d3f-4583-aaa4-d21b69fab465 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:02.774175 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33db510c-3d3f-4583-aaa4-d21b69fab465 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:02.775305 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33db510c-3d3f-4583-aaa4-d21b69fab465 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:03.096055 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-33db510c-3d3f-4583-aaa4-d21b69fab465 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:03.104993 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-33db510c-3d3f-4583-aaa4-d21b69fab465 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.362713 Oct 26 13:29:03.111153 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2691/5348] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:02 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:03.117388 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7d892996-e4d1-4c72-a478-89dc6b1f46f8 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:03.119883 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7d892996-e4d1-4c72-a478-89dc6b1f46f8 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] [instance: 56c29b20-837e-4f90-9213-99699295a6af] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:03.139675 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7d892996-e4d1-4c72-a478-89dc6b1f46f8 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:03.143045 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7d892996-e4d1-4c72-a478-89dc6b1f46f8 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:03.144524 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7d892996-e4d1-4c72-a478-89dc6b1f46f8 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:03.145750 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7d892996-e4d1-4c72-a478-89dc6b1f46f8 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:03.146401 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7d892996-e4d1-4c72-a478-89dc6b1f46f8 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:03.148056 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7d892996-e4d1-4c72-a478-89dc6b1f46f8 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:03.288434 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1a0fc053-fab1-4fb4-a60d-2a195ead758d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:03.300322 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1a0fc053-fab1-4fb4-a60d-2a195ead758d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 1.138603 Oct 26 13:29:03.319891 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2658/5349] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:02 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:29:03.339599 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3ae70386-6364-4f79-a57e-be0862810548 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:03.340860 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3ae70386-6364-4f79-a57e-be0862810548 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:03.352912 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3ae70386-6364-4f79-a57e-be0862810548 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:03.354004 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3ae70386-6364-4f79-a57e-be0862810548 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:03.354989 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3ae70386-6364-4f79-a57e-be0862810548 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:03.356634 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3ae70386-6364-4f79-a57e-be0862810548 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:03.357324 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3ae70386-6364-4f79-a57e-be0862810548 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:03.358929 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3ae70386-6364-4f79-a57e-be0862810548 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:03.475343 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7d892996-e4d1-4c72-a478-89dc6b1f46f8 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674435111c05455fb1eb5b213d1373c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66f4a941524e30b05360a3ccb2e449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:03.488366 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7d892996-e4d1-4c72-a478-89dc6b1f46f8 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/servers/56c29b20-837e-4f90-9213-99699295a6af" status: 200 len: 1467 microversion: 2.1 time: 0.374853 Oct 26 13:29:03.488986 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2692/5350] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:03 2022] GET /compute/v2.1/servers/56c29b20-837e-4f90-9213-99699295a6af => generated 1467 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:03.499921 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b6d95ac9-a239-40d2-99e2-f5b92668f99c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:03.500767 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b6d95ac9-a239-40d2-99e2-f5b92668f99c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:03.520041 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b6d95ac9-a239-40d2-99e2-f5b92668f99c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:03.520722 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b6d95ac9-a239-40d2-99e2-f5b92668f99c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:03.521321 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b6d95ac9-a239-40d2-99e2-f5b92668f99c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:03.523224 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b6d95ac9-a239-40d2-99e2-f5b92668f99c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:03.523871 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b6d95ac9-a239-40d2-99e2-f5b92668f99c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:03.524450 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b6d95ac9-a239-40d2-99e2-f5b92668f99c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:03.870449 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3ae70386-6364-4f79-a57e-be0862810548 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:03.886801 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3ae70386-6364-4f79-a57e-be0862810548 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.563696 Oct 26 13:29:03.898505 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2659/5351] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:03 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:03.912935 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3e6c3e30-b0bd-4642-9aea-ace86ccfc930 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f673196e3a0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:03.986778 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b6d95ac9-a239-40d2-99e2-f5b92668f99c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:04.000409 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:29:04.010323 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b6d95ac9-a239-40d2-99e2-f5b92668f99c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 0.520052 Oct 26 13:29:04.018494 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2693/5352] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:03 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:04.029920 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c0c72168-7b5d-44d2-b1a8-0739433526fa tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:29:04.030470 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c0c72168-7b5d-44d2-b1a8-0739433526fa tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:04.049327 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0c72168-7b5d-44d2-b1a8-0739433526fa tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:04.052145 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0c72168-7b5d-44d2-b1a8-0739433526fa tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:04.052623 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0c72168-7b5d-44d2-b1a8-0739433526fa tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:04.053369 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0c72168-7b5d-44d2-b1a8-0739433526fa tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:04.053870 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0c72168-7b5d-44d2-b1a8-0739433526fa tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:04.060555 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0c72168-7b5d-44d2-b1a8-0739433526fa tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:04.201379 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3e6c3e30-b0bd-4642-9aea-ace86ccfc930 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images?changes-since=2022-10-26T13%3A26%3A09Z" status: 200 len: 2374 microversion: 2.1 time: 0.292719 Oct 26 13:29:04.201379 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2660/5353] 10.222.0.40 () {58 vars in 1199 bytes} [Wed Oct 26 13:29:03 2022] GET /compute/v2.1/images?changes-since=2022-10-26T13%3A26%3A09Z => generated 2374 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:04.201379 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-414c2922-dd4e-4816-be46-54edf2cb6b45 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:04.201379 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-414c2922-dd4e-4816-be46-54edf2cb6b45 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:04.224122 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-414c2922-dd4e-4816-be46-54edf2cb6b45 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:04.224910 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-414c2922-dd4e-4816-be46-54edf2cb6b45 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:04.227016 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-414c2922-dd4e-4816-be46-54edf2cb6b45 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:04.227975 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-414c2922-dd4e-4816-be46-54edf2cb6b45 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:04.230100 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-414c2922-dd4e-4816-be46-54edf2cb6b45 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:04.232046 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-414c2922-dd4e-4816-be46-54edf2cb6b45 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:04.308459 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c0c72168-7b5d-44d2-b1a8-0739433526fa tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "POST /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7/action" status: 202 len: 0 microversion: 2.1 time: 0.288294 Oct 26 13:29:04.310706 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2694/5354] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:29:04 2022] POST /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:29:04.326377 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0274a224-2006-406a-ae96-18fff986132c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67311db8b0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:04.421684 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0274a224-2006-406a-ae96-18fff986132c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-542508536" status: 200 len: 484 microversion: 2.1 time: 0.106850 Oct 26 13:29:04.424034 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2695/5355] 10.222.0.40 () {58 vars in 1229 bytes} [Wed Oct 26 13:29:04 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-542508536 => generated 484 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:29:04.429550 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-24e9c58d-c62b-4714-b521-c34557db00f1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:04.430569 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-24e9c58d-c62b-4714-b521-c34557db00f1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:04.451393 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24e9c58d-c62b-4714-b521-c34557db00f1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:04.452492 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24e9c58d-c62b-4714-b521-c34557db00f1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:04.453566 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24e9c58d-c62b-4714-b521-c34557db00f1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:04.454978 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24e9c58d-c62b-4714-b521-c34557db00f1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:04.456329 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24e9c58d-c62b-4714-b521-c34557db00f1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:04.458381 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24e9c58d-c62b-4714-b521-c34557db00f1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:04.742000 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-414c2922-dd4e-4816-be46-54edf2cb6b45 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:04.773416 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-414c2922-dd4e-4816-be46-54edf2cb6b45 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 0.578766 Oct 26 13:29:04.776826 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2661/5356] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:04 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:04.804416 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-71e35368-ee8b-43f4-b11d-dfd06b86e864 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67314e8310>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:04.818444 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-24e9c58d-c62b-4714-b521-c34557db00f1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:04.831988 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-24e9c58d-c62b-4714-b521-c34557db00f1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1511 microversion: 2.1 time: 0.406602 Oct 26 13:29:04.832667 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2696/5357] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:04 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1511 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:04.854819 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0097995c-99fe-4043-b8e7-581be0420465 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:29:04.855969 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0097995c-99fe-4043-b8e7-581be0420465 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:04.878733 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0097995c-99fe-4043-b8e7-581be0420465 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:04.879236 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0097995c-99fe-4043-b8e7-581be0420465 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:04.879679 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0097995c-99fe-4043-b8e7-581be0420465 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:04.883154 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0097995c-99fe-4043-b8e7-581be0420465 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:04.883636 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0097995c-99fe-4043-b8e7-581be0420465 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:04.884080 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0097995c-99fe-4043-b8e7-581be0420465 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:04.957020 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-71e35368-ee8b-43f4-b11d-dfd06b86e864 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images?server=56c29b20-837e-4f90-9213-99699295a6af" status: 200 len: 957 microversion: 2.1 time: 0.174891 Oct 26 13:29:04.985181 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2662/5358] 10.222.0.40 () {58 vars in 1209 bytes} [Wed Oct 26 13:29:04 2022] GET /compute/v2.1/images?server=56c29b20-837e-4f90-9213-99699295a6af => generated 957 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:29:05.011764 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fd28a1db-3809-498b-a329-1bde1155954e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67324ab790>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:05.029589 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0097995c-99fe-4043-b8e7-581be0420465 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Locking {{(pid=120598) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 26 13:29:05.124823 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fd28a1db-3809-498b-a329-1bde1155954e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.40%2Fcompute%2Fv2.1%2Fservers%2F8536123b-d626-498f-bfc7-9b76553e3d04" status: 200 len: 484 microversion: 2.1 time: 0.132113 Oct 26 13:29:05.126231 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2663/5359] 10.222.0.40 () {58 vars in 1317 bytes} [Wed Oct 26 13:29:04 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.40%2Fcompute%2Fv2.1%2Fservers%2F8536123b-d626-498f-bfc7-9b76553e3d04 => generated 484 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:29:05.150478 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7344169c-aabd-4a61-8de5-ac5bdcfd3f53 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f673151bee0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:05.198531 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0097995c-99fe-4043-b8e7-581be0420465 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "POST /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa/action" status: 202 len: 0 microversion: 2.1 time: 0.358321 Oct 26 13:29:05.202033 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2697/5360] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:29:04 2022] POST /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:29:05.215627 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7a8d77e9-fb4d-4f5b-b80a-5cb422a27f7d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:05.220009 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7a8d77e9-fb4d-4f5b-b80a-5cb422a27f7d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:05.235088 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a8d77e9-fb4d-4f5b-b80a-5cb422a27f7d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:05.236185 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a8d77e9-fb4d-4f5b-b80a-5cb422a27f7d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:05.236792 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a8d77e9-fb4d-4f5b-b80a-5cb422a27f7d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:05.239610 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a8d77e9-fb4d-4f5b-b80a-5cb422a27f7d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:05.241583 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a8d77e9-fb4d-4f5b-b80a-5cb422a27f7d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:05.242358 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a8d77e9-fb4d-4f5b-b80a-5cb422a27f7d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:05.280950 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7344169c-aabd-4a61-8de5-ac5bdcfd3f53 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.40%2Fcompute%2Fservers%2F8536123b-d626-498f-bfc7-9b76553e3d04" status: 200 len: 484 microversion: 2.1 time: 0.146568 Oct 26 13:29:05.283782 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2664/5361] 10.222.0.40 () {58 vars in 1303 bytes} [Wed Oct 26 13:29:05 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.40%2Fcompute%2Fservers%2F8536123b-d626-498f-bfc7-9b76553e3d04 => generated 484 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:29:05.305428 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8f05c052-a449-4f88-a1a7-bb6b46182a49 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f6732647310>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:05.733283 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7a8d77e9-fb4d-4f5b-b80a-5cb422a27f7d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:05.755625 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7a8d77e9-fb4d-4f5b-b80a-5cb422a27f7d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 0.546225 Oct 26 13:29:05.761050 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2698/5362] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:05 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:05.789245 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ceddcd47-2330-4f3e-b8a2-0bb0d0e23d55 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:29:05.807013 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ceddcd47-2330-4f3e-b8a2-0bb0d0e23d55 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:05.813106 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ceddcd47-2330-4f3e-b8a2-0bb0d0e23d55 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:05.813897 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ceddcd47-2330-4f3e-b8a2-0bb0d0e23d55 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:05.905230 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-ceddcd47-2330-4f3e-b8a2-0bb0d0e23d55 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] HTTP exception thrown: Instance 341d8b3a-d684-4969-a5cf-a6aea1a055fa is locked Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ceddcd47-2330-4f3e-b8a2-0bb0d0e23d55 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Request method failure captured: Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa/action HTTP/1.1 Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 15 Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTTRuTNKOQB-nrFVO4ZQOSUPJw_t87hSQG4X0NnCZ-NkeLQePXfE28jjlOlL7XoeNcReKFB3n9XBYRIE9HcyLgGEDDp5gX1x_vTjrqFvjU0FYibg_1MyRrL2Ht61uOMaLpkZivAymUmDmap2-8WoM-6AmJL7TAW0hXVB6neLWiOUzoY Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: c0d1b1d2fe374ee5806eeee18712219f Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServerActionsTestJSON-871807092 Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c0d1b1d2fe374ee5806eeee18712219f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c0d1b1d2fe374ee5806eeee18712219f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c0d1b1d2fe374ee5806eeee18712219f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c0d1b1d2fe374ee5806eeee18712219f"}]}] Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServerActionsTestJSON-871807092 Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: c0d1b1d2fe374ee5806eeee18712219f Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServerActionsTestJSON-871807092 Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServerActionsTestJSON-871807092-project Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 3e9ff5a884f1416886f26a80c5b87b18 Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServerActionsTestJSON-871807092-project Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: {"os-stop": {}} Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 341d8b3a-d684-4969-a5cf-a6aea1a055fa is locked Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '341d8b3a-d684-4969-a5cf-a6aea1a055fa', 'body': {'os-stop': {}}} Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 341d8b3a-d684-4969-a5cf-a6aea1a055fa is locked Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 341d8b3a-d684-4969-a5cf-a6aea1a055fa is locked Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 341d8b3a-d684-4969-a5cf-a6aea1a055fa is locked Oct 26 13:29:05.910608 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:29:05.920635 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ceddcd47-2330-4f3e-b8a2-0bb0d0e23d55 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Returning 409 to user: Instance 341d8b3a-d684-4969-a5cf-a6aea1a055fa is locked {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:29:05.930758 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ceddcd47-2330-4f3e-b8a2-0bb0d0e23d55 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "POST /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa/action" status: 409 len: 107 microversion: 2.1 time: 0.150398 Oct 26 13:29:05.935158 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2699/5363] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:29:05 2022] POST /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa/action => generated 107 bytes in 156 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 26 13:29:05.957151 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-afe6c2c5-803e-41cd-ac72-481e607e41db tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:05.959212 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-afe6c2c5-803e-41cd-ac72-481e607e41db tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:05.972594 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afe6c2c5-803e-41cd-ac72-481e607e41db tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:05.975472 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afe6c2c5-803e-41cd-ac72-481e607e41db tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:05.975786 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8f05c052-a449-4f88-a1a7-bb6b46182a49 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3279 microversion: 2.1 time: 0.682311 Oct 26 13:29:05.976884 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afe6c2c5-803e-41cd-ac72-481e607e41db tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:05.980064 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afe6c2c5-803e-41cd-ac72-481e607e41db tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:05.981446 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afe6c2c5-803e-41cd-ac72-481e607e41db tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:05.983468 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afe6c2c5-803e-41cd-ac72-481e607e41db tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:05.992053 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2665/5364] 10.222.0.40 () {58 vars in 1149 bytes} [Wed Oct 26 13:29:05 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3279 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:06.005070 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-24f98ba8-ff82-4dcc-8159-21ea8b1bd129 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:29:06.008890 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-24f98ba8-ff82-4dcc-8159-21ea8b1bd129 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:06.024031 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-24f98ba8-ff82-4dcc-8159-21ea8b1bd129 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:06.032422 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-24f98ba8-ff82-4dcc-8159-21ea8b1bd129 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:06.033063 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-24f98ba8-ff82-4dcc-8159-21ea8b1bd129 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:06.036065 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-24f98ba8-ff82-4dcc-8159-21ea8b1bd129 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:06.038352 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-24f98ba8-ff82-4dcc-8159-21ea8b1bd129 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:06.040238 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-24f98ba8-ff82-4dcc-8159-21ea8b1bd129 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:06.242454 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-24f98ba8-ff82-4dcc-8159-21ea8b1bd129 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Unlocking {{(pid=120597) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 26 13:29:06.372472 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-24f98ba8-ff82-4dcc-8159-21ea8b1bd129 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "POST /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa/action" status: 202 len: 0 microversion: 2.1 time: 0.378908 Oct 26 13:29:06.373703 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2666/5365] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:29:05 2022] POST /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa/action => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:29:06.380403 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6fd74eb9-3797-4158-beb5-7da423101469 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f6732556dc0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:06.428255 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-afe6c2c5-803e-41cd-ac72-481e607e41db tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:06.456071 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-afe6c2c5-803e-41cd-ac72-481e607e41db tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1491 microversion: 2.1 time: 0.519492 Oct 26 13:29:06.462539 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2700/5366] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:05 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1491 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:06.481748 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b49bcc6e-b125-47bc-869e-0dcd31528be8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:29:06.505737 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b49bcc6e-b125-47bc-869e-0dcd31528be8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:06.507410 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b49bcc6e-b125-47bc-869e-0dcd31528be8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:06.510738 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b49bcc6e-b125-47bc-869e-0dcd31528be8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:06.574958 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6fd74eb9-3797-4158-beb5-7da423101469 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.198920 Oct 26 13:29:06.576316 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2667/5367] 10.222.0.40 () {58 vars in 1149 bytes} [Wed Oct 26 13:29:06 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:06.618640 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b49bcc6e-b125-47bc-869e-0dcd31528be8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Going to try to stop instance {{(pid=120598) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 26 13:29:06.854437 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b49bcc6e-b125-47bc-869e-0dcd31528be8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "POST /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa/action" status: 202 len: 0 microversion: 2.1 time: 0.374854 Oct 26 13:29:06.862679 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2701/5368] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:29:06 2022] POST /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa/action => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:29:06.896521 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9b6304cf-2313-495e-acdb-9ff9f0c7a87f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:29:06.897149 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9b6304cf-2313-495e-acdb-9ff9f0c7a87f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:06.926417 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b6304cf-2313-495e-acdb-9ff9f0c7a87f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:06.927411 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b6304cf-2313-495e-acdb-9ff9f0c7a87f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:06.929168 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b6304cf-2313-495e-acdb-9ff9f0c7a87f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:06.930034 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b6304cf-2313-495e-acdb-9ff9f0c7a87f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:06.930413 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b6304cf-2313-495e-acdb-9ff9f0c7a87f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:06.930853 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b6304cf-2313-495e-acdb-9ff9f0c7a87f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:06.985512 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-7b8ccd05-4258-4223-b29f-4c8c2195c23f req-2781607a-7828-45cc-afa4-56f18e069a5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56c29b20-837e-4f90-9213-99699295a6af", "name": "network-vif-unplugged", "status": "completed", "tag": "38eb9476-6dba-4c83-886a-1e2f98837aa4"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:29:07.010729 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-9b6304cf-2313-495e-acdb-9ff9f0c7a87f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] HTTP exception thrown: Cannot 'pause' instance f573d46e-77d2-4405-baef-2bb447d4b5e7 while it is in vm_state paused Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9b6304cf-2313-495e-acdb-9ff9f0c7a87f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Request method failure captured: Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7/action HTTP/1.1 Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 13 Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTWpf9Job1by08RPlBi4BK3ZRus12IuUwpixxL0U8NmqouWwnfDFM_ku9arLt0Dfw_g2zljJol9iSiPHbr2OBJI9bA6xxReUYgF5HT4trI936uilzQCNXRfNWHD8SC65BfL8JHiNMAmXVHxHedc9hkhsO-eHURoIHHJwTTh6ig9qSq0 Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/088eb22706844984b58fe118d5421cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_088eb22706844984b58fe118d5421cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}] Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 9b8db27e3baf4b6a948f6d23c04cf680 Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: {"pause": {}} Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: exception: Cannot 'pause' instance f573d46e-77d2-4405-baef-2bb447d4b5e7 while it is in vm_state paused Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'f573d46e-77d2-4405-baef-2bb447d4b5e7', 'body': {'pause': {}}} Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f573d46e-77d2-4405-baef-2bb447d4b5e7 in vm_state paused. Cannot pause while the instance is in this state. Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance f573d46e-77d2-4405-baef-2bb447d4b5e7 while it is in vm_state paused Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:07.016919 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:29:07.023519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:29:07.023519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:29:07.023519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:29:07.023519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance f573d46e-77d2-4405-baef-2bb447d4b5e7 while it is in vm_state paused Oct 26 13:29:07.023519 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:29:07.023519 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9b6304cf-2313-495e-acdb-9ff9f0c7a87f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Returning 409 to user: Cannot 'pause' instance f573d46e-77d2-4405-baef-2bb447d4b5e7 while it is in vm_state paused {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:29:07.023519 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9b6304cf-2313-495e-acdb-9ff9f0c7a87f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "POST /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7/action" status: 409 len: 143 microversion: 2.1 time: 0.144811 Oct 26 13:29:07.025724 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-7b8ccd05-4258-4223-b29f-4c8c2195c23f req-2781607a-7828-45cc-afa4-56f18e069a5a service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:07.025848 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2702/5369] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:29:06 2022] POST /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7/action => generated 143 bytes in 162 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:29:07.028925 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-7b8ccd05-4258-4223-b29f-4c8c2195c23f req-2781607a-7828-45cc-afa4-56f18e069a5a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:07.029739 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-7b8ccd05-4258-4223-b29f-4c8c2195c23f req-2781607a-7828-45cc-afa4-56f18e069a5a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:07.040258 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2bb7f05d-ea42-4c35-b3ac-5e83771783b2 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f6731264040>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:07.080297 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-7b8ccd05-4258-4223-b29f-4c8c2195c23f req-2781607a-7828-45cc-afa4-56f18e069a5a service nova] Creating event network-vif-unplugged:38eb9476-6dba-4c83-886a-1e2f98837aa4 for instance 56c29b20-837e-4f90-9213-99699295a6af on n-h1-862686-1 Oct 26 13:29:07.099245 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-7b8ccd05-4258-4223-b29f-4c8c2195c23f req-2781607a-7828-45cc-afa4-56f18e069a5a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.519732 Oct 26 13:29:07.099884 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2668/5370] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:29:07.145243 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2bb7f05d-ea42-4c35-b3ac-5e83771783b2 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.115860 Oct 26 13:29:07.147479 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2703/5371] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 26 13:29:07 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:29:07.157102 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e6e9db03-65c4-4d69-8281-765fe1331ca9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:07.157102 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e6e9db03-65c4-4d69-8281-765fe1331ca9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:07.165087 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b5c1e640-7f89-4f39-9356-1ea682906447 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:29:07.165671 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b5c1e640-7f89-4f39-9356-1ea682906447 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:07.174023 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e6e9db03-65c4-4d69-8281-765fe1331ca9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:07.174800 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e6e9db03-65c4-4d69-8281-765fe1331ca9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:07.175386 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e6e9db03-65c4-4d69-8281-765fe1331ca9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:07.176255 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e6e9db03-65c4-4d69-8281-765fe1331ca9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:07.176868 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e6e9db03-65c4-4d69-8281-765fe1331ca9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:07.177445 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e6e9db03-65c4-4d69-8281-765fe1331ca9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:07.212360 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5c1e640-7f89-4f39-9356-1ea682906447 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:07.212862 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5c1e640-7f89-4f39-9356-1ea682906447 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:07.213306 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5c1e640-7f89-4f39-9356-1ea682906447 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:07.224321 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5c1e640-7f89-4f39-9356-1ea682906447 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:07.224851 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5c1e640-7f89-4f39-9356-1ea682906447 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:07.225327 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5c1e640-7f89-4f39-9356-1ea682906447 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:07.348750 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b5c1e640-7f89-4f39-9356-1ea682906447 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "POST /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7/action" status: 202 len: 0 microversion: 2.1 time: 0.197577 Oct 26 13:29:07.351611 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2704/5372] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:29:07 2022] POST /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:29:07.366303 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ac149dfc-9751-42b1-9662-5871f9358302 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67311b05e0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:07.697753 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ac149dfc-9751-42b1-9662-5871f9358302 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/detail?changes-since=2022-10-26T13%3A26%3A04Z" status: 200 len: 6332 microversion: 2.1 time: 0.344694 Oct 26 13:29:07.704597 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2705/5373] 10.222.0.40 () {58 vars in 1220 bytes} [Wed Oct 26 13:29:07 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-26T13%3A26%3A04Z => generated 6332 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:07.722987 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e0180afe-178a-496e-ac94-2a1d6f278d6b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:07.724387 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e0180afe-178a-496e-ac94-2a1d6f278d6b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:07.738318 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0180afe-178a-496e-ac94-2a1d6f278d6b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:07.739852 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0180afe-178a-496e-ac94-2a1d6f278d6b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:07.740725 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0180afe-178a-496e-ac94-2a1d6f278d6b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:07.741756 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0180afe-178a-496e-ac94-2a1d6f278d6b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:07.745277 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0180afe-178a-496e-ac94-2a1d6f278d6b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:07.747184 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0180afe-178a-496e-ac94-2a1d6f278d6b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:07.842926 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e6e9db03-65c4-4d69-8281-765fe1331ca9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:07.856711 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e6e9db03-65c4-4d69-8281-765fe1331ca9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1676 microversion: 2.1 time: 0.748379 Oct 26 13:29:07.864942 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2669/5374] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:07 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1676 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:07.874184 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7982bb86-348c-4cdb-b0ed-331b45d6f012 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67321f8820>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:08.018103 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7982bb86-348c-4cdb-b0ed-331b45d6f012 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-542508536" status: 200 len: 664 microversion: 2.1 time: 0.151635 Oct 26 13:29:08.020184 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2670/5375] 10.222.0.40 () {58 vars in 1250 bytes} [Wed Oct 26 13:29:07 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-542508536 => generated 664 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:29:08.039714 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d45b37ef-b482-46a6-9824-e4c6fea3171f tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f673149d940>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:08.205810 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d45b37ef-b482-46a6-9824-e4c6fea3171f tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.40%2Fcompute%2Fv2.1%2Fservers%2F8536123b-d626-498f-bfc7-9b76553e3d04" status: 200 len: 1466 microversion: 2.1 time: 0.171160 Oct 26 13:29:08.206408 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2671/5376] 10.222.0.40 () {58 vars in 1338 bytes} [Wed Oct 26 13:29:08 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.40%2Fcompute%2Fv2.1%2Fservers%2F8536123b-d626-498f-bfc7-9b76553e3d04 => generated 1466 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:29:08.225861 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e063c0cb-1ee5-4ad7-a5c7-0d1cbe0cad0d tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f673146f3a0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:08.332239 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e063c0cb-1ee5-4ad7-a5c7-0d1cbe0cad0d tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.40%2Fcompute%2Fservers%2F8536123b-d626-498f-bfc7-9b76553e3d04" status: 200 len: 1466 microversion: 2.1 time: 0.111260 Oct 26 13:29:08.333916 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2672/5377] 10.222.0.40 () {58 vars in 1324 bytes} [Wed Oct 26 13:29:08 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.40%2Fcompute%2Fservers%2F8536123b-d626-498f-bfc7-9b76553e3d04 => generated 1466 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:29:08.350620 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f99e033b-d8b0-4e4c-b9e9-a205aa470ce4 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f673278e550>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:08.535823 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f99e033b-d8b0-4e4c-b9e9-a205aa470ce4 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7107 microversion: 2.1 time: 0.186080 Oct 26 13:29:08.557387 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2673/5378] 10.222.0.40 () {58 vars in 1170 bytes} [Wed Oct 26 13:29:08 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7107 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:29:08.570271 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-64b04af5-f7d8-4d9e-9621-8fa37643ee01 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f6736965ca0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:08.697228 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-64b04af5-f7d8-4d9e-9621-8fa37643ee01 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4375 microversion: 2.1 time: 0.132786 Oct 26 13:29:08.703138 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2674/5379] 10.222.0.40 () {58 vars in 1170 bytes} [Wed Oct 26 13:29:08 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4375 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:08.723094 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b47b46a8-f056-44f4-9528-c06e3ad58ae0 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f6731b1fd30>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:08.791614 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b47b46a8-f056-44f4-9528-c06e3ad58ae0 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/762c20f4-0f9b-45cb-bd95-cf21a747b33b" status: 200 len: 784 microversion: 2.1 time: 0.073112 Oct 26 13:29:08.792494 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2675/5380] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 26 13:29:08 2022] GET /compute/v2.1/images/762c20f4-0f9b-45cb-bd95-cf21a747b33b => generated 784 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:29:08.811720 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0831c62f-a6cc-47b6-b70d-fa3eba75674b tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f673146f430>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:08.887000 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0831c62f-a6cc-47b6-b70d-fa3eba75674b tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.079162 Oct 26 13:29:08.890313 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2676/5381] 10.222.0.40 () {58 vars in 1158 bytes} [Wed Oct 26 13:29:08 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:08.906852 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ff885e56-bc4d-44e7-92b1-2b38b3577f5a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:08.910739 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ff885e56-bc4d-44e7-92b1-2b38b3577f5a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:08.927267 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff885e56-bc4d-44e7-92b1-2b38b3577f5a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:08.939425 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff885e56-bc4d-44e7-92b1-2b38b3577f5a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:08.940702 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff885e56-bc4d-44e7-92b1-2b38b3577f5a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:08.942970 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff885e56-bc4d-44e7-92b1-2b38b3577f5a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:08.959561 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff885e56-bc4d-44e7-92b1-2b38b3577f5a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:08.962227 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff885e56-bc4d-44e7-92b1-2b38b3577f5a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:09.072025 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:29:09.146758 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e0180afe-178a-496e-ac94-2a1d6f278d6b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:09.162082 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e0180afe-178a-496e-ac94-2a1d6f278d6b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 1.451286 Oct 26 13:29:09.163373 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2706/5382] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:07 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:09.182758 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8cd860c4-1180-4d01-bcca-7f5a53e20569 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67325b6dc0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:09.628445 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ff885e56-bc4d-44e7-92b1-2b38b3577f5a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:09.650116 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ff885e56-bc4d-44e7-92b1-2b38b3577f5a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1676 microversion: 2.1 time: 0.756916 Oct 26 13:29:09.656210 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2677/5383] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:08 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1676 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:09.677466 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f6578812-efba-44ac-a814-fb8e61fa8884 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:09.681000 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f6578812-efba-44ac-a814-fb8e61fa8884 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:09.706058 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f6578812-efba-44ac-a814-fb8e61fa8884 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:09.712347 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f6578812-efba-44ac-a814-fb8e61fa8884 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:09.713205 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f6578812-efba-44ac-a814-fb8e61fa8884 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:09.719365 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f6578812-efba-44ac-a814-fb8e61fa8884 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:09.720307 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f6578812-efba-44ac-a814-fb8e61fa8884 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:09.721094 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f6578812-efba-44ac-a814-fb8e61fa8884 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:10.488903 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8cd860c4-1180-4d01-bcca-7f5a53e20569 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "DELETE /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc" status: 204 len: 0 microversion: 2.1 time: 1.323907 Oct 26 13:29:10.489778 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2707/5384] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:09 2022] DELETE /compute/v2.1/images/76177334-37c8-4d3c-ba32-e4c0bd3b09dc => generated 0 bytes in 1326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:29:10.498144 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-94d02089-5a94-4dff-aba2-9a89a12958ff tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67317d6af0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:10.723573 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f6578812-efba-44ac-a814-fb8e61fa8884 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:10.737727 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f6578812-efba-44ac-a814-fb8e61fa8884 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 1.080150 Oct 26 13:29:10.743446 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2678/5385] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:09 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:10.757751 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a72a2d25-6be1-4de3-9125-86545e0c2e64 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:10.759550 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a72a2d25-6be1-4de3-9125-86545e0c2e64 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:10.778160 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a72a2d25-6be1-4de3-9125-86545e0c2e64 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:10.783780 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a72a2d25-6be1-4de3-9125-86545e0c2e64 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:10.783780 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a72a2d25-6be1-4de3-9125-86545e0c2e64 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:10.784609 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a72a2d25-6be1-4de3-9125-86545e0c2e64 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:10.786166 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a72a2d25-6be1-4de3-9125-86545e0c2e64 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:10.787393 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a72a2d25-6be1-4de3-9125-86545e0c2e64 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:11.196446 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a72a2d25-6be1-4de3-9125-86545e0c2e64 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:11.215255 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a72a2d25-6be1-4de3-9125-86545e0c2e64 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1676 microversion: 2.1 time: 0.469930 Oct 26 13:29:11.216839 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2679/5386] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:10 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1676 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:11.248353 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c9bed30a-173f-4572-8389-35d3ad06e579 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:29:11.253057 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c9bed30a-173f-4572-8389-35d3ad06e579 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f791ecb5-63e6-41fc-b2dc-d73701c5773e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:11.261343 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c9bed30a-173f-4572-8389-35d3ad06e579 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:11.264595 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c9bed30a-173f-4572-8389-35d3ad06e579 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:11.265238 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c9bed30a-173f-4572-8389-35d3ad06e579 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:11.266167 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c9bed30a-173f-4572-8389-35d3ad06e579 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:11.266829 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c9bed30a-173f-4572-8389-35d3ad06e579 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:11.267568 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c9bed30a-173f-4572-8389-35d3ad06e579 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:11.289181 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-c9bed30a-173f-4572-8389-35d3ad06e579 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] HTTP exception thrown: Instance f791ecb5-63e6-41fc-b2dc-d73701c5773e could not be found. Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c9bed30a-173f-4572-8389-35d3ad06e579 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Request method failure captured: Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e/action HTTP/1.1 Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 28 Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTWpf9Job1by08RPlBi4BK3ZRus12IuUwpixxL0U8NmqouWwnfDFM_ku9arLt0Dfw_g2zljJol9iSiPHbr2OBJI9bA6xxReUYgF5HT4trI936uilzQCNXRfNWHD8SC65BfL8JHiNMAmXVHxHedc9hkhsO-eHURoIHHJwTTh6ig9qSq0 Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/088eb22706844984b58fe118d5421cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_088eb22706844984b58fe118d5421cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}] Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 9b8db27e3baf4b6a948f6d23c04cf680 Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: {"reboot": {"type": "SOFT"}} Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance f791ecb5-63e6-41fc-b2dc-d73701c5773e could not be found. Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'f791ecb5-63e6-41fc-b2dc-d73701c5773e', 'body': {'reboot': {'type': 'SOFT'}}} Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f791ecb5-63e6-41fc-b2dc-d73701c5773e could not be found. Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:29:11.291669 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:29:11.296602 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f791ecb5-63e6-41fc-b2dc-d73701c5773e could not be found. Oct 26 13:29:11.296602 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:11.296602 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:29:11.296602 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:11.296602 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:11.296602 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:29:11.296602 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:29:11.296602 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:29:11.296602 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:29:11.296602 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f791ecb5-63e6-41fc-b2dc-d73701c5773e could not be found. Oct 26 13:29:11.296602 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:11.299969 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c9bed30a-173f-4572-8389-35d3ad06e579 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Returning 404 to user: Instance f791ecb5-63e6-41fc-b2dc-d73701c5773e could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:29:11.301432 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c9bed30a-173f-4572-8389-35d3ad06e579 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "POST /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e/action" status: 404 len: 111 microversion: 2.1 time: 0.080770 Oct 26 13:29:11.302613 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2680/5387] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:29:11 2022] POST /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e/action => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:29:11.334337 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d6387200-f2bb-4548-b46d-477794259716 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:11.336975 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d6387200-f2bb-4548-b46d-477794259716 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:11.375534 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6387200-f2bb-4548-b46d-477794259716 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:11.387983 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6387200-f2bb-4548-b46d-477794259716 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:11.388655 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6387200-f2bb-4548-b46d-477794259716 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:11.389658 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6387200-f2bb-4548-b46d-477794259716 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:11.390389 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6387200-f2bb-4548-b46d-477794259716 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:11.391265 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6387200-f2bb-4548-b46d-477794259716 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:11.447068 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-94d02089-5a94-4dff-aba2-9a89a12958ff tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "DELETE /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f" status: 204 len: 0 microversion: 2.1 time: 0.953291 Oct 26 13:29:11.448028 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2708/5388] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:10 2022] DELETE /compute/v2.1/images/34551de9-b495-4266-aff5-aee652d9599f => generated 0 bytes in 955 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 26 13:29:11.458410 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-506aab88-4b3c-4c62-be05-7927b2f6a93e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f6731ffaf70>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:12.381844 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d6387200-f2bb-4548-b46d-477794259716 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:12.397731 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d6387200-f2bb-4548-b46d-477794259716 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 1.089683 Oct 26 13:29:12.405640 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2681/5389] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:11 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:29:12.405640 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7f21d6e9-421c-46b8-af8a-69f2f6a45c9c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:12.405640 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7f21d6e9-421c-46b8-af8a-69f2f6a45c9c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:12.465877 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f21d6e9-421c-46b8-af8a-69f2f6a45c9c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:12.466384 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f21d6e9-421c-46b8-af8a-69f2f6a45c9c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:12.466834 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f21d6e9-421c-46b8-af8a-69f2f6a45c9c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:12.467556 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f21d6e9-421c-46b8-af8a-69f2f6a45c9c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:12.488845 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f21d6e9-421c-46b8-af8a-69f2f6a45c9c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:12.489424 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f21d6e9-421c-46b8-af8a-69f2f6a45c9c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:12.801631 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-506aab88-4b3c-4c62-be05-7927b2f6a93e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "DELETE /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082" status: 204 len: 0 microversion: 2.1 time: 1.348195 Oct 26 13:29:12.802691 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2709/5390] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:11 2022] DELETE /compute/v2.1/images/490bbfa9-9939-402f-ac0c-fb616995b082 => generated 0 bytes in 1351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:29:12.809872 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-661dbd4a-6f5d-4fcb-9510-f33059a57df5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:12.811872 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-661dbd4a-6f5d-4fcb-9510-f33059a57df5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:12.818384 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7f21d6e9-421c-46b8-af8a-69f2f6a45c9c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:12.827997 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-661dbd4a-6f5d-4fcb-9510-f33059a57df5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:12.828398 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-661dbd4a-6f5d-4fcb-9510-f33059a57df5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:12.828839 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-661dbd4a-6f5d-4fcb-9510-f33059a57df5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:12.830472 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7f21d6e9-421c-46b8-af8a-69f2f6a45c9c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1676 microversion: 2.1 time: 0.430133 Oct 26 13:29:12.831304 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2682/5391] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:12 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1676 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:12.846693 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-661dbd4a-6f5d-4fcb-9510-f33059a57df5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:12.846693 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-661dbd4a-6f5d-4fcb-9510-f33059a57df5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:12.846693 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-661dbd4a-6f5d-4fcb-9510-f33059a57df5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:12.865979 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b524184f-c970-49d8-b210-4b1962627db3 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:12.870197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b524184f-c970-49d8-b210-4b1962627db3 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] [instance: 8536123b-d626-498f-bfc7-9b76553e3d04] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:12.878136 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b524184f-c970-49d8-b210-4b1962627db3 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:12.878886 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b524184f-c970-49d8-b210-4b1962627db3 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:12.879525 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b524184f-c970-49d8-b210-4b1962627db3 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:12.880688 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b524184f-c970-49d8-b210-4b1962627db3 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:12.881467 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b524184f-c970-49d8-b210-4b1962627db3 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:12.882144 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b524184f-c970-49d8-b210-4b1962627db3 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:12.924210 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b524184f-c970-49d8-b210-4b1962627db3 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] [instance: 8536123b-d626-498f-bfc7-9b76553e3d04] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:29:13.166069 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b524184f-c970-49d8-b210-4b1962627db3 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04" status: 204 len: 0 microversion: 2.1 time: 0.312856 Oct 26 13:29:13.172225 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2683/5392] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:29:12 2022] DELETE /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:29:13.184535 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ae772314-1e8a-4e0d-9bc8-eff19b8745bd tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:13.185735 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ae772314-1e8a-4e0d-9bc8-eff19b8745bd tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] [instance: 8536123b-d626-498f-bfc7-9b76553e3d04] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:13.244788 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae772314-1e8a-4e0d-9bc8-eff19b8745bd tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:13.250235 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae772314-1e8a-4e0d-9bc8-eff19b8745bd tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:13.251214 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae772314-1e8a-4e0d-9bc8-eff19b8745bd tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:13.252247 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae772314-1e8a-4e0d-9bc8-eff19b8745bd tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:13.259790 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae772314-1e8a-4e0d-9bc8-eff19b8745bd tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:13.260602 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae772314-1e8a-4e0d-9bc8-eff19b8745bd tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:13.510950 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-661dbd4a-6f5d-4fcb-9510-f33059a57df5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:13.528759 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-661dbd4a-6f5d-4fcb-9510-f33059a57df5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.721512 Oct 26 13:29:13.529950 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2710/5393] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:12 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:13.567013 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d0357f83-0dfc-4c18-87b2-d3e96e0b16a3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:29:13.572749 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d0357f83-0dfc-4c18-87b2-d3e96e0b16a3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: 28e6f229-b74d-4423-849c-f77f488500c0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:13.591617 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-d0357f83-0dfc-4c18-87b2-d3e96e0b16a3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] HTTP exception thrown: Instance 28e6f229-b74d-4423-849c-f77f488500c0 could not be found. Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d0357f83-0dfc-4c18-87b2-d3e96e0b16a3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Request method failure captured: Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/servers/28e6f229-b74d-4423-849c-f77f488500c0/action HTTP/1.1 Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 28 Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTWpf9Job1by08RPlBi4BK3ZRus12IuUwpixxL0U8NmqouWwnfDFM_ku9arLt0Dfw_g2zljJol9iSiPHbr2OBJI9bA6xxReUYgF5HT4trI936uilzQCNXRfNWHD8SC65BfL8JHiNMAmXVHxHedc9hkhsO-eHURoIHHJwTTh6ig9qSq0 Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/088eb22706844984b58fe118d5421cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_088eb22706844984b58fe118d5421cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}] Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 9b8db27e3baf4b6a948f6d23c04cf680 Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: {"reboot": {"type": "SOFT"}} Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 28e6f229-b74d-4423-849c-f77f488500c0 could not be found. Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '28e6f229-b74d-4423-849c-f77f488500c0', 'body': {'reboot': {'type': 'SOFT'}}} Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28e6f229-b74d-4423-849c-f77f488500c0 could not be found. Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28e6f229-b74d-4423-849c-f77f488500c0 could not be found. Oct 26 13:29:13.594508 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:29:13.598572 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:29:13.598572 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:29:13.598572 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:13.598572 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:29:13.598572 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:29:13.598572 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:29:13.598572 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:29:13.598572 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28e6f229-b74d-4423-849c-f77f488500c0 could not be found. Oct 26 13:29:13.598572 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:29:13.598572 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d0357f83-0dfc-4c18-87b2-d3e96e0b16a3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Returning 404 to user: Instance 28e6f229-b74d-4423-849c-f77f488500c0 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:29:13.598572 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d0357f83-0dfc-4c18-87b2-d3e96e0b16a3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "POST /compute/v2.1/servers/28e6f229-b74d-4423-849c-f77f488500c0/action" status: 404 len: 111 microversion: 2.1 time: 0.047017 Oct 26 13:29:13.602678 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2711/5394] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:29:13 2022] POST /compute/v2.1/servers/28e6f229-b74d-4423-849c-f77f488500c0/action => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:29:13.609531 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-af20dd1e-34e0-486a-87b0-d07627af74c6 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:13.610157 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-af20dd1e-34e0-486a-87b0-d07627af74c6 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:13.628779 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af20dd1e-34e0-486a-87b0-d07627af74c6 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:13.629768 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af20dd1e-34e0-486a-87b0-d07627af74c6 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:13.630212 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af20dd1e-34e0-486a-87b0-d07627af74c6 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:13.632400 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af20dd1e-34e0-486a-87b0-d07627af74c6 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:13.635080 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af20dd1e-34e0-486a-87b0-d07627af74c6 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:13.635727 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af20dd1e-34e0-486a-87b0-d07627af74c6 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:13.889911 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ae772314-1e8a-4e0d-9bc8-eff19b8745bd tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674435111c05455fb1eb5b213d1373c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66f4a941524e30b05360a3ccb2e449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:13.905514 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ae772314-1e8a-4e0d-9bc8-eff19b8745bd tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04" status: 200 len: 1474 microversion: 2.1 time: 0.730129 Oct 26 13:29:13.908527 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2684/5395] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:13 2022] GET /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04 => generated 1474 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:29:13.919446 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-af78df9a-d48f-4255-9466-79be45bfa531 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:13.921034 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-af78df9a-d48f-4255-9466-79be45bfa531 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:13.938833 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af78df9a-d48f-4255-9466-79be45bfa531 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:13.939527 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af78df9a-d48f-4255-9466-79be45bfa531 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:13.940165 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af78df9a-d48f-4255-9466-79be45bfa531 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:13.944641 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af78df9a-d48f-4255-9466-79be45bfa531 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:13.945370 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af78df9a-d48f-4255-9466-79be45bfa531 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:13.946188 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af78df9a-d48f-4255-9466-79be45bfa531 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:14.212835 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-af20dd1e-34e0-486a-87b0-d07627af74c6 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:14.216222 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=7,nova_cell1:INSERT=5 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:29:14.233681 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-af20dd1e-34e0-486a-87b0-d07627af74c6 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.626094 Oct 26 13:29:14.237576 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2712/5396] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:13 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:14.272990 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-30b3fede-e895-49f5-92cb-2279fa19fc08 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:14.274719 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-30b3fede-e895-49f5-92cb-2279fa19fc08 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:14.295912 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30b3fede-e895-49f5-92cb-2279fa19fc08 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:14.296486 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30b3fede-e895-49f5-92cb-2279fa19fc08 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:14.299794 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30b3fede-e895-49f5-92cb-2279fa19fc08 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:14.300935 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30b3fede-e895-49f5-92cb-2279fa19fc08 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:14.301476 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30b3fede-e895-49f5-92cb-2279fa19fc08 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:14.302966 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30b3fede-e895-49f5-92cb-2279fa19fc08 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:14.625301 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-30b3fede-e895-49f5-92cb-2279fa19fc08 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:14.638342 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-30b3fede-e895-49f5-92cb-2279fa19fc08 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.374259 Oct 26 13:29:14.639533 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2713/5397] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:14 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:14.680039 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-31ad8dc2-6d04-4ad9-b91e-178f4187853f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:29:14.687266 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-31ad8dc2-6d04-4ad9-b91e-178f4187853f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f791ecb5-63e6-41fc-b2dc-d73701c5773e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:14.694269 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31ad8dc2-6d04-4ad9-b91e-178f4187853f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:14.694760 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31ad8dc2-6d04-4ad9-b91e-178f4187853f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:14.695196 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31ad8dc2-6d04-4ad9-b91e-178f4187853f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:14.695898 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31ad8dc2-6d04-4ad9-b91e-178f4187853f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:14.696381 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31ad8dc2-6d04-4ad9-b91e-178f4187853f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:14.697424 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31ad8dc2-6d04-4ad9-b91e-178f4187853f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:14.717792 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-31ad8dc2-6d04-4ad9-b91e-178f4187853f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] HTTP exception thrown: Instance f791ecb5-63e6-41fc-b2dc-d73701c5773e could not be found. Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-31ad8dc2-6d04-4ad9-b91e-178f4187853f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Request method failure captured: Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e/action HTTP/1.1 Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 65 Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTWpf9Job1by08RPlBi4BK3ZRus12IuUwpixxL0U8NmqouWwnfDFM_ku9arLt0Dfw_g2zljJol9iSiPHbr2OBJI9bA6xxReUYgF5HT4trI936uilzQCNXRfNWHD8SC65BfL8JHiNMAmXVHxHedc9hkhsO-eHURoIHHJwTTh6ig9qSq0 Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/088eb22706844984b58fe118d5421cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_088eb22706844984b58fe118d5421cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}] Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 9b8db27e3baf4b6a948f6d23c04cf680 Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: {"rebuild": {"imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b"}} Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance f791ecb5-63e6-41fc-b2dc-d73701c5773e could not be found. Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'f791ecb5-63e6-41fc-b2dc-d73701c5773e', 'body': {'rebuild': {'imageRef': '762c20f4-0f9b-45cb-bd95-cf21a747b33b'}}} Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f791ecb5-63e6-41fc-b2dc-d73701c5773e could not be found. Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 26 13:29:14.719866 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 26 13:29:14.724121 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 26 13:29:14.724121 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:29:14.724121 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:29:14.724121 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:29:14.724121 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:29:14.724121 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f791ecb5-63e6-41fc-b2dc-d73701c5773e could not be found. Oct 26 13:29:14.724121 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:29:14.724121 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:29:14.724121 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:29:14.724121 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:14.724121 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:29:14.724121 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:29:14.724121 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:29:14.724121 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:29:14.724121 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f791ecb5-63e6-41fc-b2dc-d73701c5773e could not be found. Oct 26 13:29:14.724121 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:29:14.726050 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-31ad8dc2-6d04-4ad9-b91e-178f4187853f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Returning 404 to user: Instance f791ecb5-63e6-41fc-b2dc-d73701c5773e could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:29:14.727083 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-31ad8dc2-6d04-4ad9-b91e-178f4187853f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "POST /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e/action" status: 404 len: 111 microversion: 2.1 time: 0.056977 Oct 26 13:29:14.727928 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2714/5398] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:29:14 2022] POST /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e/action => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:29:14.738410 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e64de1b5-c36d-4e6a-947b-b4eb34686c52 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:14.739031 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e64de1b5-c36d-4e6a-947b-b4eb34686c52 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:14.747419 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e64de1b5-c36d-4e6a-947b-b4eb34686c52 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:14.747922 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e64de1b5-c36d-4e6a-947b-b4eb34686c52 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:14.748584 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e64de1b5-c36d-4e6a-947b-b4eb34686c52 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:14.749757 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e64de1b5-c36d-4e6a-947b-b4eb34686c52 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:14.750409 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e64de1b5-c36d-4e6a-947b-b4eb34686c52 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:14.751234 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e64de1b5-c36d-4e6a-947b-b4eb34686c52 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:15.156505 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e64de1b5-c36d-4e6a-947b-b4eb34686c52 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:15.173149 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e64de1b5-c36d-4e6a-947b-b4eb34686c52 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.439805 Oct 26 13:29:15.173812 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2715/5399] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:14 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:29:15.207512 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5bbd129f-7647-4be9-9aa7-97e194731287 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:15.210847 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5bbd129f-7647-4be9-9aa7-97e194731287 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] [instance: 8536123b-d626-498f-bfc7-9b76553e3d04] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:15.227822 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-af78df9a-d48f-4255-9466-79be45bfa531 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:15.228934 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5bbd129f-7647-4be9-9aa7-97e194731287 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:15.229434 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5bbd129f-7647-4be9-9aa7-97e194731287 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:15.232454 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5bbd129f-7647-4be9-9aa7-97e194731287 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:15.235067 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5bbd129f-7647-4be9-9aa7-97e194731287 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:15.235603 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5bbd129f-7647-4be9-9aa7-97e194731287 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:15.236046 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5bbd129f-7647-4be9-9aa7-97e194731287 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:15.245192 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-af78df9a-d48f-4255-9466-79be45bfa531 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1676 microversion: 2.1 time: 1.331632 Oct 26 13:29:15.248010 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2685/5400] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:13 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1676 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:15.263091 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-94d5e176-d773-4f3e-a961-1251fb93b89d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:15.264338 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-94d5e176-d773-4f3e-a961-1251fb93b89d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:15.272441 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-94d5e176-d773-4f3e-a961-1251fb93b89d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:15.273293 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-94d5e176-d773-4f3e-a961-1251fb93b89d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:15.273952 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-94d5e176-d773-4f3e-a961-1251fb93b89d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:15.274889 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-94d5e176-d773-4f3e-a961-1251fb93b89d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:15.275800 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-94d5e176-d773-4f3e-a961-1251fb93b89d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:15.276443 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-94d5e176-d773-4f3e-a961-1251fb93b89d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:15.894257 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5bbd129f-7647-4be9-9aa7-97e194731287 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674435111c05455fb1eb5b213d1373c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66f4a941524e30b05360a3ccb2e449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:15.916278 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5bbd129f-7647-4be9-9aa7-97e194731287 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04" status: 200 len: 1474 microversion: 2.1 time: 0.726432 Oct 26 13:29:15.917214 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2716/5401] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:15 2022] GET /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04 => generated 1474 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:15.947463 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-94d5e176-d773-4f3e-a961-1251fb93b89d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:15.961791 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-94d5e176-d773-4f3e-a961-1251fb93b89d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.710137 Oct 26 13:29:15.963210 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2686/5402] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:15 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:15.991847 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f49a916e-1ac3-4843-9866-abccd2f7b4c2 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:29:15.995018 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f49a916e-1ac3-4843-9866-abccd2f7b4c2 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: 0615d93e-a50f-4e0f-8c67-a6ac615caf8c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:16.007238 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-f49a916e-1ac3-4843-9866-abccd2f7b4c2 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] HTTP exception thrown: Instance 0615d93e-a50f-4e0f-8c67-a6ac615caf8c could not be found. Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f49a916e-1ac3-4843-9866-abccd2f7b4c2 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Request method failure captured: Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/servers/0615d93e-a50f-4e0f-8c67-a6ac615caf8c/action HTTP/1.1 Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 65 Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTWpf9Job1by08RPlBi4BK3ZRus12IuUwpixxL0U8NmqouWwnfDFM_ku9arLt0Dfw_g2zljJol9iSiPHbr2OBJI9bA6xxReUYgF5HT4trI936uilzQCNXRfNWHD8SC65BfL8JHiNMAmXVHxHedc9hkhsO-eHURoIHHJwTTh6ig9qSq0 Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/088eb22706844984b58fe118d5421cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_088eb22706844984b58fe118d5421cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}] Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 9b8db27e3baf4b6a948f6d23c04cf680 Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: {"rebuild": {"imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b"}} Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 0615d93e-a50f-4e0f-8c67-a6ac615caf8c could not be found. Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '0615d93e-a50f-4e0f-8c67-a6ac615caf8c', 'body': {'rebuild': {'imageRef': '762c20f4-0f9b-45cb-bd95-cf21a747b33b'}}} Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0615d93e-a50f-4e0f-8c67-a6ac615caf8c could not be found. Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 26 13:29:16.008957 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:29:16.013457 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:29:16.013457 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:29:16.013457 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:29:16.013457 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0615d93e-a50f-4e0f-8c67-a6ac615caf8c could not be found. Oct 26 13:29:16.013457 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:29:16.013457 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:29:16.013457 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:29:16.013457 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:16.013457 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:29:16.013457 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:29:16.013457 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:29:16.013457 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:29:16.013457 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0615d93e-a50f-4e0f-8c67-a6ac615caf8c could not be found. Oct 26 13:29:16.013457 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:29:16.013457 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f49a916e-1ac3-4843-9866-abccd2f7b4c2 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Returning 404 to user: Instance 0615d93e-a50f-4e0f-8c67-a6ac615caf8c could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:29:16.013457 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f49a916e-1ac3-4843-9866-abccd2f7b4c2 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "POST /compute/v2.1/servers/0615d93e-a50f-4e0f-8c67-a6ac615caf8c/action" status: 404 len: 111 microversion: 2.1 time: 0.024559 Oct 26 13:29:16.013457 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2717/5403] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:29:15 2022] POST /compute/v2.1/servers/0615d93e-a50f-4e0f-8c67-a6ac615caf8c/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:29:16.027606 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d71004c3-7501-4d6a-b22b-c3d637ec5997 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:16.028235 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d71004c3-7501-4d6a-b22b-c3d637ec5997 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:16.044786 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d71004c3-7501-4d6a-b22b-c3d637ec5997 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:16.050435 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d71004c3-7501-4d6a-b22b-c3d637ec5997 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:16.051184 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d71004c3-7501-4d6a-b22b-c3d637ec5997 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:16.052154 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d71004c3-7501-4d6a-b22b-c3d637ec5997 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:16.053669 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d71004c3-7501-4d6a-b22b-c3d637ec5997 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:16.055524 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d71004c3-7501-4d6a-b22b-c3d637ec5997 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:16.309437 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-015227e8-b21a-4c1c-8bd1-7d6627120c6c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:16.313065 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-015227e8-b21a-4c1c-8bd1-7d6627120c6c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:16.353269 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-015227e8-b21a-4c1c-8bd1-7d6627120c6c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:16.354631 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-015227e8-b21a-4c1c-8bd1-7d6627120c6c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:16.356190 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-015227e8-b21a-4c1c-8bd1-7d6627120c6c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:16.357429 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-015227e8-b21a-4c1c-8bd1-7d6627120c6c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:16.362909 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-015227e8-b21a-4c1c-8bd1-7d6627120c6c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:16.364399 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-015227e8-b21a-4c1c-8bd1-7d6627120c6c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:17.020474 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d71004c3-7501-4d6a-b22b-c3d637ec5997 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:17.035678 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d71004c3-7501-4d6a-b22b-c3d637ec5997 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 1.018935 Oct 26 13:29:17.040154 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2687/5404] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:16 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:17.068105 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d07f73a2-8172-47d7-9ce7-978479ceb833 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:17.071446 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d07f73a2-8172-47d7-9ce7-978479ceb833 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] [instance: 8536123b-d626-498f-bfc7-9b76553e3d04] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:17.098795 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d07f73a2-8172-47d7-9ce7-978479ceb833 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:17.099316 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d07f73a2-8172-47d7-9ce7-978479ceb833 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:17.099744 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d07f73a2-8172-47d7-9ce7-978479ceb833 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:17.100457 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d07f73a2-8172-47d7-9ce7-978479ceb833 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:17.100913 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d07f73a2-8172-47d7-9ce7-978479ceb833 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:17.111075 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d07f73a2-8172-47d7-9ce7-978479ceb833 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:17.339511 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-015227e8-b21a-4c1c-8bd1-7d6627120c6c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:17.340972 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d07f73a2-8172-47d7-9ce7-978479ceb833 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674435111c05455fb1eb5b213d1373c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66f4a941524e30b05360a3ccb2e449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:17.353570 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d07f73a2-8172-47d7-9ce7-978479ceb833 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04" status: 200 len: 1432 microversion: 2.1 time: 0.312081 Oct 26 13:29:17.354404 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2688/5405] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:17 2022] GET /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04 => generated 1432 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:17.360766 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bc0ce532-9e8b-4ca6-9bfb-cd193ef09f96 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:17.361836 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bc0ce532-9e8b-4ca6-9bfb-cd193ef09f96 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:17.372874 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-015227e8-b21a-4c1c-8bd1-7d6627120c6c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1676 microversion: 2.1 time: 1.100725 Oct 26 13:29:17.373988 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2718/5406] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:16 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1676 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:29:17.375171 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc0ce532-9e8b-4ca6-9bfb-cd193ef09f96 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:17.375889 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc0ce532-9e8b-4ca6-9bfb-cd193ef09f96 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:17.376459 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc0ce532-9e8b-4ca6-9bfb-cd193ef09f96 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:17.377468 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc0ce532-9e8b-4ca6-9bfb-cd193ef09f96 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:17.378131 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc0ce532-9e8b-4ca6-9bfb-cd193ef09f96 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:17.378686 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc0ce532-9e8b-4ca6-9bfb-cd193ef09f96 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:17.962229 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bc0ce532-9e8b-4ca6-9bfb-cd193ef09f96 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:17.980121 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bc0ce532-9e8b-4ca6-9bfb-cd193ef09f96 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.622935 Oct 26 13:29:18.003647 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2689/5407] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:17 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:18.012287 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-505f66d6-0ea3-4a08-9647-5db612b4d505 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:29:18.022601 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-505f66d6-0ea3-4a08-9647-5db612b4d505 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: 8d734449-5e76-4f80-bc98-97d94d03df56] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:18.031489 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-af09acf5-66a3-4886-bb87-e6c459100114 req-df640273-9ecc-4ecb-920d-60314e341622 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8536123b-d626-498f-bfc7-9b76553e3d04", "name": "network-vif-deleted", "tag": "426db0e6-96c1-46f4-a233-8b1dafdaebaf"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:29:18.040334 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-505f66d6-0ea3-4a08-9647-5db612b4d505 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] HTTP exception thrown: Instance 8d734449-5e76-4f80-bc98-97d94d03df56 could not be found. Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-505f66d6-0ea3-4a08-9647-5db612b4d505 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Request method failure captured: Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/servers/8d734449-5e76-4f80-bc98-97d94d03df56/action HTTP/1.1 Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 15 Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTWpf9Job1by08RPlBi4BK3ZRus12IuUwpixxL0U8NmqouWwnfDFM_ku9arLt0Dfw_g2zljJol9iSiPHbr2OBJI9bA6xxReUYgF5HT4trI936uilzQCNXRfNWHD8SC65BfL8JHiNMAmXVHxHedc9hkhsO-eHURoIHHJwTTh6ig9qSq0 Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/088eb22706844984b58fe118d5421cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_088eb22706844984b58fe118d5421cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}] Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 9b8db27e3baf4b6a948f6d23c04cf680 Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: {"restore": {}} Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 8d734449-5e76-4f80-bc98-97d94d03df56 could not be found. Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '8d734449-5e76-4f80-bc98-97d94d03df56', 'body': {'restore': {}}} Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d734449-5e76-4f80-bc98-97d94d03df56 could not be found. Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d734449-5e76-4f80-bc98-97d94d03df56 could not be found. Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:29:18.047207 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:29:18.053059 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:29:18.053059 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:29:18.053059 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d734449-5e76-4f80-bc98-97d94d03df56 could not be found. Oct 26 13:29:18.053059 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:18.054425 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-505f66d6-0ea3-4a08-9647-5db612b4d505 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Returning 404 to user: Instance 8d734449-5e76-4f80-bc98-97d94d03df56 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:29:18.058702 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-505f66d6-0ea3-4a08-9647-5db612b4d505 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "POST /compute/v2.1/servers/8d734449-5e76-4f80-bc98-97d94d03df56/action" status: 404 len: 111 microversion: 2.1 time: 0.052261 Oct 26 13:29:18.059563 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-af09acf5-66a3-4886-bb87-e6c459100114 req-df640273-9ecc-4ecb-920d-60314e341622 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:18.060009 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-af09acf5-66a3-4886-bb87-e6c459100114 req-df640273-9ecc-4ecb-920d-60314e341622 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:18.060413 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-af09acf5-66a3-4886-bb87-e6c459100114 req-df640273-9ecc-4ecb-920d-60314e341622 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:18.065662 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2690/5408] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:29:18 2022] POST /compute/v2.1/servers/8d734449-5e76-4f80-bc98-97d94d03df56/action => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:29:18.087156 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2e2b90a6-8f24-4243-bcbd-c032371b4922 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:18.088895 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2e2b90a6-8f24-4243-bcbd-c032371b4922 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:18.100696 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-af09acf5-66a3-4886-bb87-e6c459100114 req-df640273-9ecc-4ecb-920d-60314e341622 service nova] Creating event network-vif-deleted:426db0e6-96c1-46f4-a233-8b1dafdaebaf for instance 8536123b-d626-498f-bfc7-9b76553e3d04 on n-h1-862686-1 Oct 26 13:29:18.116388 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e2b90a6-8f24-4243-bcbd-c032371b4922 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:18.128453 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e2b90a6-8f24-4243-bcbd-c032371b4922 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:18.132419 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e2b90a6-8f24-4243-bcbd-c032371b4922 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:18.133321 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e2b90a6-8f24-4243-bcbd-c032371b4922 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:18.136250 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e2b90a6-8f24-4243-bcbd-c032371b4922 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:18.146120 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e2b90a6-8f24-4243-bcbd-c032371b4922 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:18.147312 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-af09acf5-66a3-4886-bb87-e6c459100114 req-df640273-9ecc-4ecb-920d-60314e341622 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.687173 Oct 26 13:29:18.147932 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2719/5409] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:29:18.384906 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-109b04a2-4436-41ed-b998-59e26ffe072e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:18.385897 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-109b04a2-4436-41ed-b998-59e26ffe072e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] [instance: 8536123b-d626-498f-bfc7-9b76553e3d04] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:18.422802 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-109b04a2-4436-41ed-b998-59e26ffe072e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:18.423564 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-109b04a2-4436-41ed-b998-59e26ffe072e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:18.424260 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-109b04a2-4436-41ed-b998-59e26ffe072e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:18.426910 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-109b04a2-4436-41ed-b998-59e26ffe072e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:18.435776 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-109b04a2-4436-41ed-b998-59e26ffe072e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:18.436589 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-109b04a2-4436-41ed-b998-59e26ffe072e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:18.623181 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-109b04a2-4436-41ed-b998-59e26ffe072e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:18.623835 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-109b04a2-4436-41ed-b998-59e26ffe072e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:18.625370 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-109b04a2-4436-41ed-b998-59e26ffe072e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:18.626599 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-109b04a2-4436-41ed-b998-59e26ffe072e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lazy-loading 'fault' on Instance uuid 8536123b-d626-498f-bfc7-9b76553e3d04 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:29:18.752677 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-109b04a2-4436-41ed-b998-59e26ffe072e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674435111c05455fb1eb5b213d1373c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66f4a941524e30b05360a3ccb2e449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:18.764299 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-109b04a2-4436-41ed-b998-59e26ffe072e tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04" status: 200 len: 1308 microversion: 2.1 time: 0.391551 Oct 26 13:29:18.764932 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2720/5410] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:18 2022] GET /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04 => generated 1308 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:18.810120 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5e734fa1-f1c0-4622-b925-2d147e636a9a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:18.810742 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5e734fa1-f1c0-4622-b925-2d147e636a9a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:18.829950 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5e734fa1-f1c0-4622-b925-2d147e636a9a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:18.829950 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5e734fa1-f1c0-4622-b925-2d147e636a9a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:18.829950 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5e734fa1-f1c0-4622-b925-2d147e636a9a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:18.842148 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5e734fa1-f1c0-4622-b925-2d147e636a9a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:18.842625 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5e734fa1-f1c0-4622-b925-2d147e636a9a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:18.842978 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5e734fa1-f1c0-4622-b925-2d147e636a9a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:18.948470 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2e2b90a6-8f24-4243-bcbd-c032371b4922 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:18.958983 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2e2b90a6-8f24-4243-bcbd-c032371b4922 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.892061 Oct 26 13:29:18.965967 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2691/5411] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:18 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:18.998904 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ff14e231-fb8b-4e52-9781-e326dd210d33 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:19.000088 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ff14e231-fb8b-4e52-9781-e326dd210d33 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:19.018758 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:29:19.026758 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff14e231-fb8b-4e52-9781-e326dd210d33 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:19.031439 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff14e231-fb8b-4e52-9781-e326dd210d33 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:19.033251 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff14e231-fb8b-4e52-9781-e326dd210d33 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:19.037856 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff14e231-fb8b-4e52-9781-e326dd210d33 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:19.039712 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff14e231-fb8b-4e52-9781-e326dd210d33 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:19.041986 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff14e231-fb8b-4e52-9781-e326dd210d33 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:19.287043 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5e734fa1-f1c0-4622-b925-2d147e636a9a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:19.300560 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5e734fa1-f1c0-4622-b925-2d147e636a9a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1653 microversion: 2.1 time: 0.510489 Oct 26 13:29:19.305412 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2721/5412] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:18 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1653 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:19.329870 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-40f0596c-b89f-48ac-9871-b980614d4baf tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:29:19.343814 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-40f0596c-b89f-48ac-9871-b980614d4baf tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:19.344316 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-40f0596c-b89f-48ac-9871-b980614d4baf tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:19.344758 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-40f0596c-b89f-48ac-9871-b980614d4baf tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:19.395326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-40f0596c-b89f-48ac-9871-b980614d4baf tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Going to try to start instance {{(pid=120598) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 26 13:29:19.477603 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-40f0596c-b89f-48ac-9871-b980614d4baf tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "POST /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa/action" status: 202 len: 0 microversion: 2.1 time: 0.151555 Oct 26 13:29:19.478520 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2722/5413] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:29:19 2022] POST /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 13:29:19.487885 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7ed5ee2f-0f55-4fb6-8a90-0f94cb9a5faf tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:19.490374 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7ed5ee2f-0f55-4fb6-8a90-0f94cb9a5faf tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:19.498057 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ed5ee2f-0f55-4fb6-8a90-0f94cb9a5faf tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:19.498714 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ed5ee2f-0f55-4fb6-8a90-0f94cb9a5faf tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:19.499326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ed5ee2f-0f55-4fb6-8a90-0f94cb9a5faf tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:19.500180 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ed5ee2f-0f55-4fb6-8a90-0f94cb9a5faf tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:19.500783 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ed5ee2f-0f55-4fb6-8a90-0f94cb9a5faf tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:19.501358 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ed5ee2f-0f55-4fb6-8a90-0f94cb9a5faf tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:19.715912 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ff14e231-fb8b-4e52-9781-e326dd210d33 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:19.725520 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ff14e231-fb8b-4e52-9781-e326dd210d33 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.734468 Oct 26 13:29:19.733818 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2692/5414] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:18 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:29:19.755606 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b112570d-4934-4776-a94c-5b09dbd17637 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:29:19.756387 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b112570d-4934-4776-a94c-5b09dbd17637 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:19.764095 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b112570d-4934-4776-a94c-5b09dbd17637 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:19.764791 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b112570d-4934-4776-a94c-5b09dbd17637 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:19.765379 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b112570d-4934-4776-a94c-5b09dbd17637 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:19.766251 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b112570d-4934-4776-a94c-5b09dbd17637 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:19.767025 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b112570d-4934-4776-a94c-5b09dbd17637 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:19.767593 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b112570d-4934-4776-a94c-5b09dbd17637 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:19.796379 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-b112570d-4934-4776-a94c-5b09dbd17637 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] HTTP exception thrown: Cannot 'restore' instance f573d46e-77d2-4405-baef-2bb447d4b5e7 while it is in vm_state active Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b112570d-4934-4776-a94c-5b09dbd17637 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Request method failure captured: Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7/action HTTP/1.1 Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 15 Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTWpf9Job1by08RPlBi4BK3ZRus12IuUwpixxL0U8NmqouWwnfDFM_ku9arLt0Dfw_g2zljJol9iSiPHbr2OBJI9bA6xxReUYgF5HT4trI936uilzQCNXRfNWHD8SC65BfL8JHiNMAmXVHxHedc9hkhsO-eHURoIHHJwTTh6ig9qSq0 Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/088eb22706844984b58fe118d5421cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_088eb22706844984b58fe118d5421cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}] Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 9b8db27e3baf4b6a948f6d23c04cf680 Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: {"restore": {}} Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: exception: Cannot 'restore' instance f573d46e-77d2-4405-baef-2bb447d4b5e7 while it is in vm_state active Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'f573d46e-77d2-4405-baef-2bb447d4b5e7', 'body': {'restore': {}}} Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f573d46e-77d2-4405-baef-2bb447d4b5e7 in vm_state active. Cannot restore while the instance is in this state. Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance f573d46e-77d2-4405-baef-2bb447d4b5e7 while it is in vm_state active Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:19.798117 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:29:19.802394 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:29:19.802394 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:29:19.802394 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:29:19.802394 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance f573d46e-77d2-4405-baef-2bb447d4b5e7 while it is in vm_state active Oct 26 13:29:19.802394 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:19.803577 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b112570d-4934-4776-a94c-5b09dbd17637 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Returning 409 to user: Cannot 'restore' instance f573d46e-77d2-4405-baef-2bb447d4b5e7 while it is in vm_state active {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:29:19.804710 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b112570d-4934-4776-a94c-5b09dbd17637 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "POST /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7/action" status: 409 len: 145 microversion: 2.1 time: 0.053288 Oct 26 13:29:19.805782 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2693/5415] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:29:19 2022] POST /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7/action => generated 145 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:29:19.818867 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d76a86dc-ac9c-4d8a-bfe5-38dd581ae38d tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:19.819660 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d76a86dc-ac9c-4d8a-bfe5-38dd581ae38d tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] [instance: 8536123b-d626-498f-bfc7-9b76553e3d04] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:19.826768 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d76a86dc-ac9c-4d8a-bfe5-38dd581ae38d tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:19.827492 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d76a86dc-ac9c-4d8a-bfe5-38dd581ae38d tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:19.828083 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d76a86dc-ac9c-4d8a-bfe5-38dd581ae38d tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:19.828961 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d76a86dc-ac9c-4d8a-bfe5-38dd581ae38d tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:19.829623 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d76a86dc-ac9c-4d8a-bfe5-38dd581ae38d tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:19.830195 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d76a86dc-ac9c-4d8a-bfe5-38dd581ae38d tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:19.853046 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:29:19.896454 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-d76a86dc-ac9c-4d8a-bfe5-38dd581ae38d tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] HTTP exception thrown: Instance 8536123b-d626-498f-bfc7-9b76553e3d04 could not be found. Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d76a86dc-ac9c-4d8a-bfe5-38dd581ae38d tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Request method failure captured: Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04 HTTP/1.1 Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTVr34rGVDOt-GT49rtalG-afweRYAOPU1aXQHZHd_3WaRSWWmT_8epd57EEwflkrpjEbs5fuQN5-biJ9-eR4d29nTSPbacDIG12KDPUXcKOoChy6ACXfEk-8Iacb39uwJZPW5moyEIIQKOG13Iy8o03_tjPNUfhDtXeZl63MSgM_xg Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: db66f4a941524e30b05360a3ccb2e449 Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ListImageFiltersTestJSON-1608051074 Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/db66f4a941524e30b05360a3ccb2e449"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/db66f4a941524e30b05360a3ccb2e449"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_db66f4a941524e30b05360a3ccb2e449"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/db66f4a941524e30b05360a3ccb2e449"}]}] Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ListImageFiltersTestJSON-1608051074 Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: db66f4a941524e30b05360a3ccb2e449 Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1608051074 Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ListImageFiltersTestJSON-1608051074-project Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 674435111c05455fb1eb5b213d1373c4 Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ListImageFiltersTestJSON-1608051074-project Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 8536123b-d626-498f-bfc7-9b76553e3d04 could not be found. Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '8536123b-d626-498f-bfc7-9b76553e3d04'} Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8536123b-d626-498f-bfc7-9b76553e3d04 could not be found. Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8536123b-d626-498f-bfc7-9b76553e3d04 could not be found. Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:29:19.898734 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:19.905139 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:19.905139 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:29:19.905139 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:29:19.905139 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:29:19.905139 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:29:19.905139 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8536123b-d626-498f-bfc7-9b76553e3d04 could not be found. Oct 26 13:29:19.905139 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:19.908575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d76a86dc-ac9c-4d8a-bfe5-38dd581ae38d tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Returning 404 to user: Instance 8536123b-d626-498f-bfc7-9b76553e3d04 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:29:19.909739 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d76a86dc-ac9c-4d8a-bfe5-38dd581ae38d tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04" status: 404 len: 111 microversion: 2.1 time: 0.102755 Oct 26 13:29:19.913719 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2694/5416] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:19 2022] GET /compute/v2.1/servers/8536123b-d626-498f-bfc7-9b76553e3d04 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:29:19.919687 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4bb31d0b-904e-48d2-8b04-8483df84412f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:19.920628 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4bb31d0b-904e-48d2-8b04-8483df84412f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:19.928296 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4bb31d0b-904e-48d2-8b04-8483df84412f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:19.929573 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4bb31d0b-904e-48d2-8b04-8483df84412f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:19.930243 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4bb31d0b-904e-48d2-8b04-8483df84412f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:19.932808 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4bb31d0b-904e-48d2-8b04-8483df84412f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:19.934059 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4bb31d0b-904e-48d2-8b04-8483df84412f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:19.934759 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4bb31d0b-904e-48d2-8b04-8483df84412f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:20.240790 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7ed5ee2f-0f55-4fb6-8a90-0f94cb9a5faf tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:20.260286 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7ed5ee2f-0f55-4fb6-8a90-0f94cb9a5faf tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1662 microversion: 2.1 time: 0.775187 Oct 26 13:29:20.261356 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2723/5417] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:19 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1662 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:29:20.272610 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2b12009c-aeca-4e9f-8cac-4bc530ab8d4c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:20.273453 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2b12009c-aeca-4e9f-8cac-4bc530ab8d4c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] [instance: 56c29b20-837e-4f90-9213-99699295a6af] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:20.285156 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=88 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:29:20.290566 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2b12009c-aeca-4e9f-8cac-4bc530ab8d4c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:20.293924 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2b12009c-aeca-4e9f-8cac-4bc530ab8d4c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:20.294875 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2b12009c-aeca-4e9f-8cac-4bc530ab8d4c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:20.295842 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2b12009c-aeca-4e9f-8cac-4bc530ab8d4c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:20.298307 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2b12009c-aeca-4e9f-8cac-4bc530ab8d4c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:20.299041 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2b12009c-aeca-4e9f-8cac-4bc530ab8d4c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:20.365552 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2b12009c-aeca-4e9f-8cac-4bc530ab8d4c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] [instance: 56c29b20-837e-4f90-9213-99699295a6af] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:29:20.528962 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2b12009c-aeca-4e9f-8cac-4bc530ab8d4c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "DELETE /compute/v2.1/servers/56c29b20-837e-4f90-9213-99699295a6af" status: 204 len: 0 microversion: 2.1 time: 0.263361 Oct 26 13:29:20.534427 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2724/5418] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:29:20 2022] DELETE /compute/v2.1/servers/56c29b20-837e-4f90-9213-99699295a6af => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:29:20.548360 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8eeb3e9d-ff90-4fcd-9587-55414ed5a551 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:20.550222 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8eeb3e9d-ff90-4fcd-9587-55414ed5a551 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] [instance: 56c29b20-837e-4f90-9213-99699295a6af] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:20.564707 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8eeb3e9d-ff90-4fcd-9587-55414ed5a551 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:20.565441 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8eeb3e9d-ff90-4fcd-9587-55414ed5a551 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:20.567416 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8eeb3e9d-ff90-4fcd-9587-55414ed5a551 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:20.568320 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8eeb3e9d-ff90-4fcd-9587-55414ed5a551 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:20.571578 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8eeb3e9d-ff90-4fcd-9587-55414ed5a551 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:20.572206 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8eeb3e9d-ff90-4fcd-9587-55414ed5a551 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:20.634288 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4bb31d0b-904e-48d2-8b04-8483df84412f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:20.658834 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4bb31d0b-904e-48d2-8b04-8483df84412f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.729558 Oct 26 13:29:20.659584 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2695/5419] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:19 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:20.704752 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ce7186d6-2525-4c01-829a-0e6db5fd2730 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:20.705806 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ce7186d6-2525-4c01-829a-0e6db5fd2730 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:20.723312 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce7186d6-2525-4c01-829a-0e6db5fd2730 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:20.729754 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce7186d6-2525-4c01-829a-0e6db5fd2730 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:20.731227 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce7186d6-2525-4c01-829a-0e6db5fd2730 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:20.736582 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce7186d6-2525-4c01-829a-0e6db5fd2730 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:20.737114 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce7186d6-2525-4c01-829a-0e6db5fd2730 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:20.739066 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce7186d6-2525-4c01-829a-0e6db5fd2730 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:21.022050 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8eeb3e9d-ff90-4fcd-9587-55414ed5a551 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674435111c05455fb1eb5b213d1373c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66f4a941524e30b05360a3ccb2e449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:21.045634 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8eeb3e9d-ff90-4fcd-9587-55414ed5a551 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/servers/56c29b20-837e-4f90-9213-99699295a6af" status: 200 len: 1473 microversion: 2.1 time: 0.508403 Oct 26 13:29:21.046253 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2725/5420] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:20 2022] GET /compute/v2.1/servers/56c29b20-837e-4f90-9213-99699295a6af => generated 1473 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:29:21.226254 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ce7186d6-2525-4c01-829a-0e6db5fd2730 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:21.266894 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ce7186d6-2525-4c01-829a-0e6db5fd2730 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.580144 Oct 26 13:29:21.287752 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2696/5421] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:20 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:21.293750 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d9a7356b-062b-4636-b94c-8c232ede35e5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:21.294407 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d9a7356b-062b-4636-b94c-8c232ede35e5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:21.313013 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9a7356b-062b-4636-b94c-8c232ede35e5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:21.313577 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9a7356b-062b-4636-b94c-8c232ede35e5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:21.314045 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9a7356b-062b-4636-b94c-8c232ede35e5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:21.330585 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-998dcadd-30d6-43fd-b860-75059b65e406 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:29:21.330856 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9a7356b-062b-4636-b94c-8c232ede35e5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:21.331536 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9a7356b-062b-4636-b94c-8c232ede35e5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:21.332194 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9a7356b-062b-4636-b94c-8c232ede35e5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:21.332878 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-998dcadd-30d6-43fd-b860-75059b65e406 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: e9dd2ed6-0c30-414b-a066-6284b0f2d73e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:21.351746 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-998dcadd-30d6-43fd-b860-75059b65e406 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] HTTP exception thrown: Instance e9dd2ed6-0c30-414b-a066-6284b0f2d73e could not be found. Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-998dcadd-30d6-43fd-b860-75059b65e406 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Request method failure captured: Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/servers/e9dd2ed6-0c30-414b-a066-6284b0f2d73e/action HTTP/1.1 Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 14 Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTWpf9Job1by08RPlBi4BK3ZRus12IuUwpixxL0U8NmqouWwnfDFM_ku9arLt0Dfw_g2zljJol9iSiPHbr2OBJI9bA6xxReUYgF5HT4trI936uilzQCNXRfNWHD8SC65BfL8JHiNMAmXVHxHedc9hkhsO-eHURoIHHJwTTh6ig9qSq0 Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/088eb22706844984b58fe118d5421cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_088eb22706844984b58fe118d5421cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}] Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 9b8db27e3baf4b6a948f6d23c04cf680 Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: {"resume": {}} Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance e9dd2ed6-0c30-414b-a066-6284b0f2d73e could not be found. Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'e9dd2ed6-0c30-414b-a066-6284b0f2d73e', 'body': {'resume': {}}} Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9dd2ed6-0c30-414b-a066-6284b0f2d73e could not be found. Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9dd2ed6-0c30-414b-a066-6284b0f2d73e could not be found. Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:29:21.362854 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:29:21.368242 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:29:21.368242 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:29:21.368242 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9dd2ed6-0c30-414b-a066-6284b0f2d73e could not be found. Oct 26 13:29:21.368242 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:21.372144 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-998dcadd-30d6-43fd-b860-75059b65e406 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Returning 404 to user: Instance e9dd2ed6-0c30-414b-a066-6284b0f2d73e could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:29:21.373315 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-998dcadd-30d6-43fd-b860-75059b65e406 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "POST /compute/v2.1/servers/e9dd2ed6-0c30-414b-a066-6284b0f2d73e/action" status: 404 len: 111 microversion: 2.1 time: 0.052460 Oct 26 13:29:21.377298 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2697/5422] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:29:21 2022] POST /compute/v2.1/servers/e9dd2ed6-0c30-414b-a066-6284b0f2d73e/action => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:29:21.445889 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3fec3c3e-39d2-4b7e-a15d-0ae1f2e643e7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:21.446935 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3fec3c3e-39d2-4b7e-a15d-0ae1f2e643e7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:21.476925 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3fec3c3e-39d2-4b7e-a15d-0ae1f2e643e7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:21.477427 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3fec3c3e-39d2-4b7e-a15d-0ae1f2e643e7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:21.477894 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3fec3c3e-39d2-4b7e-a15d-0ae1f2e643e7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:21.478602 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3fec3c3e-39d2-4b7e-a15d-0ae1f2e643e7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:21.479060 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3fec3c3e-39d2-4b7e-a15d-0ae1f2e643e7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:21.479487 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3fec3c3e-39d2-4b7e-a15d-0ae1f2e643e7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:21.841077 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d9a7356b-062b-4636-b94c-8c232ede35e5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:21.855462 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d9a7356b-062b-4636-b94c-8c232ede35e5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1662 microversion: 2.1 time: 0.572861 Oct 26 13:29:21.876553 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2726/5423] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:21 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1662 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:29:22.071378 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bcad10c1-6424-4e2b-8a8f-3f8d74a3c544 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:22.072117 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bcad10c1-6424-4e2b-8a8f-3f8d74a3c544 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] [instance: 56c29b20-837e-4f90-9213-99699295a6af] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:22.085888 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bcad10c1-6424-4e2b-8a8f-3f8d74a3c544 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:22.086741 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bcad10c1-6424-4e2b-8a8f-3f8d74a3c544 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:22.090052 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bcad10c1-6424-4e2b-8a8f-3f8d74a3c544 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:22.091609 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bcad10c1-6424-4e2b-8a8f-3f8d74a3c544 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:22.102610 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bcad10c1-6424-4e2b-8a8f-3f8d74a3c544 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:22.106754 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bcad10c1-6424-4e2b-8a8f-3f8d74a3c544 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:22.114963 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3fec3c3e-39d2-4b7e-a15d-0ae1f2e643e7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:22.133252 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3fec3c3e-39d2-4b7e-a15d-0ae1f2e643e7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.753036 Oct 26 13:29:22.135315 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2698/5424] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:21 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:22.166016 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-934035ce-986a-4723-b08b-74fd09b345a0 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:22.167015 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-934035ce-986a-4723-b08b-74fd09b345a0 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:22.176442 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-934035ce-986a-4723-b08b-74fd09b345a0 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:22.177399 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-934035ce-986a-4723-b08b-74fd09b345a0 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:22.178436 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-934035ce-986a-4723-b08b-74fd09b345a0 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:22.179551 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-934035ce-986a-4723-b08b-74fd09b345a0 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:22.180312 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-934035ce-986a-4723-b08b-74fd09b345a0 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:22.180960 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-934035ce-986a-4723-b08b-74fd09b345a0 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:22.428008 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-934035ce-986a-4723-b08b-74fd09b345a0 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:22.440996 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-934035ce-986a-4723-b08b-74fd09b345a0 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.279619 Oct 26 13:29:22.443685 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2699/5425] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:22 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:29:22.477300 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0a5ba72a-21e7-40d2-a54e-7c023e404678 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:29:22.477960 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0a5ba72a-21e7-40d2-a54e-7c023e404678 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:22.494966 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0a5ba72a-21e7-40d2-a54e-7c023e404678 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:22.498624 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0a5ba72a-21e7-40d2-a54e-7c023e404678 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:22.499279 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0a5ba72a-21e7-40d2-a54e-7c023e404678 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:22.500210 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0a5ba72a-21e7-40d2-a54e-7c023e404678 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:22.505445 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0a5ba72a-21e7-40d2-a54e-7c023e404678 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:22.506185 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0a5ba72a-21e7-40d2-a54e-7c023e404678 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:22.572779 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-0a5ba72a-21e7-40d2-a54e-7c023e404678 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] HTTP exception thrown: Cannot 'resume' instance f573d46e-77d2-4405-baef-2bb447d4b5e7 while it is in vm_state active Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0a5ba72a-21e7-40d2-a54e-7c023e404678 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Request method failure captured: Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7/action HTTP/1.1 Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 14 Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTWpf9Job1by08RPlBi4BK3ZRus12IuUwpixxL0U8NmqouWwnfDFM_ku9arLt0Dfw_g2zljJol9iSiPHbr2OBJI9bA6xxReUYgF5HT4trI936uilzQCNXRfNWHD8SC65BfL8JHiNMAmXVHxHedc9hkhsO-eHURoIHHJwTTh6ig9qSq0 Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/088eb22706844984b58fe118d5421cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_088eb22706844984b58fe118d5421cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}] Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 9b8db27e3baf4b6a948f6d23c04cf680 Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: {"resume": {}} Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: exception: Cannot 'resume' instance f573d46e-77d2-4405-baef-2bb447d4b5e7 while it is in vm_state active Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'f573d46e-77d2-4405-baef-2bb447d4b5e7', 'body': {'resume': {}}} Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f573d46e-77d2-4405-baef-2bb447d4b5e7 in vm_state active. Cannot resume while the instance is in this state. Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance f573d46e-77d2-4405-baef-2bb447d4b5e7 while it is in vm_state active Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:29:22.581296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:22.584998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:22.584998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:29:22.584998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:29:22.584998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:29:22.584998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:29:22.584998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance f573d46e-77d2-4405-baef-2bb447d4b5e7 while it is in vm_state active Oct 26 13:29:22.584998 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:22.587434 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0a5ba72a-21e7-40d2-a54e-7c023e404678 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Returning 409 to user: Cannot 'resume' instance f573d46e-77d2-4405-baef-2bb447d4b5e7 while it is in vm_state active {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:29:22.592857 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bcad10c1-6424-4e2b-8a8f-3f8d74a3c544 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674435111c05455fb1eb5b213d1373c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66f4a941524e30b05360a3ccb2e449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:22.601258 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bcad10c1-6424-4e2b-8a8f-3f8d74a3c544 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/servers/56c29b20-837e-4f90-9213-99699295a6af" status: 200 len: 1473 microversion: 2.1 time: 0.535094 Oct 26 13:29:22.602841 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0a5ba72a-21e7-40d2-a54e-7c023e404678 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "POST /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7/action" status: 409 len: 144 microversion: 2.1 time: 0.136841 Oct 26 13:29:22.607239 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2700/5426] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:29:22 2022] POST /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7/action => generated 144 bytes in 142 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 26 13:29:22.607832 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2727/5427] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:22 2022] GET /compute/v2.1/servers/56c29b20-837e-4f90-9213-99699295a6af => generated 1473 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:29:22.617855 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-65942f81-6381-4946-8e05-3284a7c7a1be tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:22.621791 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-65942f81-6381-4946-8e05-3284a7c7a1be tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:22.628982 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-65942f81-6381-4946-8e05-3284a7c7a1be tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:22.630114 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-65942f81-6381-4946-8e05-3284a7c7a1be tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:22.630773 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-65942f81-6381-4946-8e05-3284a7c7a1be tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:22.631706 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-65942f81-6381-4946-8e05-3284a7c7a1be tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:22.632381 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-65942f81-6381-4946-8e05-3284a7c7a1be tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:22.633075 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-65942f81-6381-4946-8e05-3284a7c7a1be tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:22.885555 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8b7d5528-412a-4806-bc5c-816babfce22d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:22.888708 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8b7d5528-412a-4806-bc5c-816babfce22d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:22.915844 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b7d5528-412a-4806-bc5c-816babfce22d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:22.917245 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b7d5528-412a-4806-bc5c-816babfce22d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:22.919386 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b7d5528-412a-4806-bc5c-816babfce22d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:22.921246 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b7d5528-412a-4806-bc5c-816babfce22d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:22.925007 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b7d5528-412a-4806-bc5c-816babfce22d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:22.925927 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b7d5528-412a-4806-bc5c-816babfce22d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:23.156297 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-65942f81-6381-4946-8e05-3284a7c7a1be tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:23.166744 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-65942f81-6381-4946-8e05-3284a7c7a1be tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.556282 Oct 26 13:29:23.174510 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2701/5428] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:22 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:23.192400 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7a775db8-1514-47b3-b3ca-ec378108c2a0 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:23.193024 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7a775db8-1514-47b3-b3ca-ec378108c2a0 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:23.215334 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7a775db8-1514-47b3-b3ca-ec378108c2a0 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:23.215529 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7a775db8-1514-47b3-b3ca-ec378108c2a0 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:23.215889 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7a775db8-1514-47b3-b3ca-ec378108c2a0 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:23.218365 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7a775db8-1514-47b3-b3ca-ec378108c2a0 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:23.225147 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7a775db8-1514-47b3-b3ca-ec378108c2a0 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:23.225786 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7a775db8-1514-47b3-b3ca-ec378108c2a0 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:23.725627 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8b7d5528-412a-4806-bc5c-816babfce22d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:23.728488 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:29:23.744369 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8b7d5528-412a-4806-bc5c-816babfce22d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1662 microversion: 2.1 time: 0.865277 Oct 26 13:29:23.751453 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2728/5429] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:22 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1662 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:29:23.776306 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-30a8a707-d101-4e36-b5af-d6712ae763f1 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:23.777062 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-30a8a707-d101-4e36-b5af-d6712ae763f1 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] [instance: 56c29b20-837e-4f90-9213-99699295a6af] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:23.816271 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30a8a707-d101-4e36-b5af-d6712ae763f1 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:23.821323 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30a8a707-d101-4e36-b5af-d6712ae763f1 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:23.822458 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30a8a707-d101-4e36-b5af-d6712ae763f1 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:23.829379 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30a8a707-d101-4e36-b5af-d6712ae763f1 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:23.829916 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30a8a707-d101-4e36-b5af-d6712ae763f1 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:23.830369 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30a8a707-d101-4e36-b5af-d6712ae763f1 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:23.833766 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7a775db8-1514-47b3-b3ca-ec378108c2a0 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:23.849369 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7a775db8-1514-47b3-b3ca-ec378108c2a0 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.658710 Oct 26 13:29:23.865384 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2702/5430] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:23 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:29:24.263781 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e7ff26b4-cbc8-4107-8c0f-53564c50ac69 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "56363c00-6608-4ad0-9892-d3ecfbb7f0c5"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e7ff26b4-cbc8-4107-8c0f-53564c50ac69 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Request method failure captured: Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 160 Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTWpf9Job1by08RPlBi4BK3ZRus12IuUwpixxL0U8NmqouWwnfDFM_ku9arLt0Dfw_g2zljJol9iSiPHbr2OBJI9bA6xxReUYgF5HT4trI936uilzQCNXRfNWHD8SC65BfL8JHiNMAmXVHxHedc9hkhsO-eHURoIHHJwTTh6ig9qSq0 Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/088eb22706844984b58fe118d5421cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_088eb22706844984b58fe118d5421cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}] Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 9b8db27e3baf4b6a948f6d23c04cf680 Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: {"server": {"name": "", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "56363c00-6608-4ad0-9892-d3ecfbb7f0c5"}]}} Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'body': {'server': {'name': '', 'imageRef': '762c20f4-0f9b-45cb-bd95-cf21a747b33b', 'flavorRef': '452', 'networks': [{'uuid': '56363c00-6608-4ad0-9892-d3ecfbb7f0c5'}]}}} Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise error Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi '' Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 13:29:24.268720 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 13:29:24.272968 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 13:29:24.272968 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 26 13:29:24.272968 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:24.272968 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:29:24.272968 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:24.272968 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:24.272968 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:29:24.272968 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:29:24.272968 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 13:29:24.272968 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 13:29:24.272968 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 26 13:29:24.272968 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:24.279205 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e7ff26b4-cbc8-4107-8c0f-53564c50ac69 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:29:24.282331 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e7ff26b4-cbc8-4107-8c0f-53564c50ac69 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.024417 Oct 26 13:29:24.291058 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2703/5431] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:29:24 2022] POST /compute/v2.1/servers => generated 108 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:29:24.307525 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9bd5ac2d-9335-42d3-a28b-168f7e1d2050 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:24.308212 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9bd5ac2d-9335-42d3-a28b-168f7e1d2050 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:24.323549 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9bd5ac2d-9335-42d3-a28b-168f7e1d2050 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:24.324463 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9bd5ac2d-9335-42d3-a28b-168f7e1d2050 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:24.328221 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9bd5ac2d-9335-42d3-a28b-168f7e1d2050 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:24.332461 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9bd5ac2d-9335-42d3-a28b-168f7e1d2050 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:24.333917 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9bd5ac2d-9335-42d3-a28b-168f7e1d2050 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:24.334361 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9bd5ac2d-9335-42d3-a28b-168f7e1d2050 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:24.591561 n-d-862686-1 devstack@n-api.service[120597]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 13:29:24.591997 n-d-862686-1 devstack@n-api.service[120597]: Wed Oct 26 13:29:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 (ip 10.222.0.40) !!! Oct 26 13:29:24.612878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-30a8a707-d101-4e36-b5af-d6712ae763f1 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674435111c05455fb1eb5b213d1373c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66f4a941524e30b05360a3ccb2e449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:24.628211 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-30a8a707-d101-4e36-b5af-d6712ae763f1 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/servers/56c29b20-837e-4f90-9213-99699295a6af" status: 200 len: 1473 microversion: 2.1 time: 0.875079 Oct 26 13:29:24.629379 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2729/5432] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:23 2022] GET /compute/v2.1/servers/56c29b20-837e-4f90-9213-99699295a6af => generated 1473 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:24.639045 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-047b75c4-11fd-42ef-9bb6-602234a38101 req-6ff8f7e1-f976-4c04-adf5-f639756198d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56c29b20-837e-4f90-9213-99699295a6af", "name": "network-vif-deleted", "tag": "38eb9476-6dba-4c83-886a-1e2f98837aa4"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:29:24.654049 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-047b75c4-11fd-42ef-9bb6-602234a38101 req-6ff8f7e1-f976-4c04-adf5-f639756198d7 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:24.655121 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-047b75c4-11fd-42ef-9bb6-602234a38101 req-6ff8f7e1-f976-4c04-adf5-f639756198d7 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:24.655768 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-047b75c4-11fd-42ef-9bb6-602234a38101 req-6ff8f7e1-f976-4c04-adf5-f639756198d7 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:24.672675 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-047b75c4-11fd-42ef-9bb6-602234a38101 req-6ff8f7e1-f976-4c04-adf5-f639756198d7 service nova] Creating event network-vif-deleted:38eb9476-6dba-4c83-886a-1e2f98837aa4 for instance 56c29b20-837e-4f90-9213-99699295a6af on n-h1-862686-1 Oct 26 13:29:24.678340 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-047b75c4-11fd-42ef-9bb6-602234a38101 req-6ff8f7e1-f976-4c04-adf5-f639756198d7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047105 Oct 26 13:29:24.679759 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2730/5433] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:29:24.788228 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a4edf8d6-e512-43a2-9cf9-b7e66da77960 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:24.790293 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a4edf8d6-e512-43a2-9cf9-b7e66da77960 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:24.815166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4edf8d6-e512-43a2-9cf9-b7e66da77960 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:24.820222 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4edf8d6-e512-43a2-9cf9-b7e66da77960 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:24.823870 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4edf8d6-e512-43a2-9cf9-b7e66da77960 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:24.824805 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4edf8d6-e512-43a2-9cf9-b7e66da77960 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:24.826451 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4edf8d6-e512-43a2-9cf9-b7e66da77960 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:24.828010 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4edf8d6-e512-43a2-9cf9-b7e66da77960 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:24.862887 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9bd5ac2d-9335-42d3-a28b-168f7e1d2050 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:24.894378 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9bd5ac2d-9335-42d3-a28b-168f7e1d2050 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.601040 Oct 26 13:29:24.905737 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2704/5434] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:24 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:24.921889 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-675cba5b-a96c-4114-93b3-e2ea43002ab3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:24.922951 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-675cba5b-a96c-4114-93b3-e2ea43002ab3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:24.929644 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-675cba5b-a96c-4114-93b3-e2ea43002ab3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:24.930681 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-675cba5b-a96c-4114-93b3-e2ea43002ab3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:24.931351 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-675cba5b-a96c-4114-93b3-e2ea43002ab3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:24.933054 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-675cba5b-a96c-4114-93b3-e2ea43002ab3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:24.933768 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-675cba5b-a96c-4114-93b3-e2ea43002ab3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:24.934411 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-675cba5b-a96c-4114-93b3-e2ea43002ab3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:25.336047 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a4edf8d6-e512-43a2-9cf9-b7e66da77960 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:25.359560 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a4edf8d6-e512-43a2-9cf9-b7e66da77960 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1662 microversion: 2.1 time: 0.587692 Oct 26 13:29:25.362052 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2731/5435] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:24 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1662 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:25.419472 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-675cba5b-a96c-4114-93b3-e2ea43002ab3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:25.444166 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-675cba5b-a96c-4114-93b3-e2ea43002ab3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.528947 Oct 26 13:29:25.453816 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2705/5436] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:24 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:29:25.474051 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d6537188-db5d-4781-b4c8-f98908180935 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:29:25.475919 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d6537188-db5d-4781-b4c8-f98908180935 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: 2bd2bd15-f10a-44f0-a850-11f5584bd6db] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:25.493129 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-d6537188-db5d-4781-b4c8-f98908180935 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] HTTP exception thrown: Instance 2bd2bd15-f10a-44f0-a850-11f5584bd6db could not be found. Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d6537188-db5d-4781-b4c8-f98908180935 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Request method failure captured: Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/servers/2bd2bd15-f10a-44f0-a850-11f5584bd6db/action HTTP/1.1 Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 14 Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTWpf9Job1by08RPlBi4BK3ZRus12IuUwpixxL0U8NmqouWwnfDFM_ku9arLt0Dfw_g2zljJol9iSiPHbr2OBJI9bA6xxReUYgF5HT4trI936uilzQCNXRfNWHD8SC65BfL8JHiNMAmXVHxHedc9hkhsO-eHURoIHHJwTTh6ig9qSq0 Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/088eb22706844984b58fe118d5421cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_088eb22706844984b58fe118d5421cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}] Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 9b8db27e3baf4b6a948f6d23c04cf680 Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: {"shelve": {}} Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 2bd2bd15-f10a-44f0-a850-11f5584bd6db could not be found. Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '2bd2bd15-f10a-44f0-a850-11f5584bd6db', 'body': {'shelve': {}}} Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bd2bd15-f10a-44f0-a850-11f5584bd6db could not be found. Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bd2bd15-f10a-44f0-a850-11f5584bd6db could not be found. Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:29:25.509994 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:29:25.514480 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:29:25.514480 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:29:25.514480 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bd2bd15-f10a-44f0-a850-11f5584bd6db could not be found. Oct 26 13:29:25.514480 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:29:25.515223 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d6537188-db5d-4781-b4c8-f98908180935 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Returning 404 to user: Instance 2bd2bd15-f10a-44f0-a850-11f5584bd6db could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:29:25.516206 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d6537188-db5d-4781-b4c8-f98908180935 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "POST /compute/v2.1/servers/2bd2bd15-f10a-44f0-a850-11f5584bd6db/action" status: 404 len: 111 microversion: 2.1 time: 0.046399 Oct 26 13:29:25.517064 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2732/5437] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:29:25 2022] POST /compute/v2.1/servers/2bd2bd15-f10a-44f0-a850-11f5584bd6db/action => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:29:25.525655 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a7eb0f04-ea38-4f71-bbd8-9cd39b55b543 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:25.526467 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a7eb0f04-ea38-4f71-bbd8-9cd39b55b543 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:25.548856 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7eb0f04-ea38-4f71-bbd8-9cd39b55b543 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:25.549351 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7eb0f04-ea38-4f71-bbd8-9cd39b55b543 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:25.554235 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7eb0f04-ea38-4f71-bbd8-9cd39b55b543 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:25.555656 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7eb0f04-ea38-4f71-bbd8-9cd39b55b543 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:25.556420 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7eb0f04-ea38-4f71-bbd8-9cd39b55b543 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:25.557033 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7eb0f04-ea38-4f71-bbd8-9cd39b55b543 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:25.658160 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c1af5c76-ea5d-4dd3-a087-e6161e758a50 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:25.665994 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c1af5c76-ea5d-4dd3-a087-e6161e758a50 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] [instance: 56c29b20-837e-4f90-9213-99699295a6af] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:25.693759 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c1af5c76-ea5d-4dd3-a087-e6161e758a50 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:25.695906 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c1af5c76-ea5d-4dd3-a087-e6161e758a50 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:25.696490 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c1af5c76-ea5d-4dd3-a087-e6161e758a50 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:25.697998 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c1af5c76-ea5d-4dd3-a087-e6161e758a50 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:25.701824 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c1af5c76-ea5d-4dd3-a087-e6161e758a50 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:25.702620 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c1af5c76-ea5d-4dd3-a087-e6161e758a50 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:25.827587 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c1af5c76-ea5d-4dd3-a087-e6161e758a50 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:25.828848 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c1af5c76-ea5d-4dd3-a087-e6161e758a50 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:25.830240 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c1af5c76-ea5d-4dd3-a087-e6161e758a50 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:25.831831 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-c1af5c76-ea5d-4dd3-a087-e6161e758a50 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lazy-loading 'fault' on Instance uuid 56c29b20-837e-4f90-9213-99699295a6af {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:29:25.902156 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a7eb0f04-ea38-4f71-bbd8-9cd39b55b543 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:25.922345 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a7eb0f04-ea38-4f71-bbd8-9cd39b55b543 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.400509 Oct 26 13:29:25.925918 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2706/5438] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:25 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:25.942211 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c1af5c76-ea5d-4dd3-a087-e6161e758a50 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674435111c05455fb1eb5b213d1373c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66f4a941524e30b05360a3ccb2e449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:25.954658 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8ea33cbe-9518-4939-a7ef-48260257c839 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:25.955617 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8ea33cbe-9518-4939-a7ef-48260257c839 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:25.957601 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c1af5c76-ea5d-4dd3-a087-e6161e758a50 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/servers/56c29b20-837e-4f90-9213-99699295a6af" status: 200 len: 1307 microversion: 2.1 time: 0.301295 Oct 26 13:29:25.970102 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8ea33cbe-9518-4939-a7ef-48260257c839 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:25.970827 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8ea33cbe-9518-4939-a7ef-48260257c839 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:25.971979 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8ea33cbe-9518-4939-a7ef-48260257c839 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:25.973107 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8ea33cbe-9518-4939-a7ef-48260257c839 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:25.973844 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8ea33cbe-9518-4939-a7ef-48260257c839 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:25.974965 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2733/5439] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:25 2022] GET /compute/v2.1/servers/56c29b20-837e-4f90-9213-99699295a6af => generated 1307 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:25.977061 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8ea33cbe-9518-4939-a7ef-48260257c839 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:26.399318 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9d2a401b-ab38-449a-b1f2-9300d6b6cdf5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:26.400261 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9d2a401b-ab38-449a-b1f2-9300d6b6cdf5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:26.416100 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d2a401b-ab38-449a-b1f2-9300d6b6cdf5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:26.417342 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d2a401b-ab38-449a-b1f2-9300d6b6cdf5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:26.420874 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d2a401b-ab38-449a-b1f2-9300d6b6cdf5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:26.422047 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d2a401b-ab38-449a-b1f2-9300d6b6cdf5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:26.422745 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d2a401b-ab38-449a-b1f2-9300d6b6cdf5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:26.423820 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d2a401b-ab38-449a-b1f2-9300d6b6cdf5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:27.345629 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8ea33cbe-9518-4939-a7ef-48260257c839 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:27.360174 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8ea33cbe-9518-4939-a7ef-48260257c839 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 1.408691 Oct 26 13:29:27.364956 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2707/5440] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:25 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:27.377163 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3f5f5dfe-c0ca-4876-bb2d-c0770ce54888 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:27.380913 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3f5f5dfe-c0ca-4876-bb2d-c0770ce54888 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] [instance: 56c29b20-837e-4f90-9213-99699295a6af] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:27.406125 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3f5f5dfe-c0ca-4876-bb2d-c0770ce54888 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:27.408162 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3f5f5dfe-c0ca-4876-bb2d-c0770ce54888 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:27.410224 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3f5f5dfe-c0ca-4876-bb2d-c0770ce54888 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:27.411161 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3f5f5dfe-c0ca-4876-bb2d-c0770ce54888 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:27.418539 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3f5f5dfe-c0ca-4876-bb2d-c0770ce54888 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:27.419192 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3f5f5dfe-c0ca-4876-bb2d-c0770ce54888 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:27.447103 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-3f5f5dfe-c0ca-4876-bb2d-c0770ce54888 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] HTTP exception thrown: Instance 56c29b20-837e-4f90-9213-99699295a6af could not be found. Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3f5f5dfe-c0ca-4876-bb2d-c0770ce54888 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Request method failure captured: Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/56c29b20-837e-4f90-9213-99699295a6af HTTP/1.1 Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTVr34rGVDOt-GT49rtalG-afweRYAOPU1aXQHZHd_3WaRSWWmT_8epd57EEwflkrpjEbs5fuQN5-biJ9-eR4d29nTSPbacDIG12KDPUXcKOoChy6ACXfEk-8Iacb39uwJZPW5moyEIIQKOG13Iy8o03_tjPNUfhDtXeZl63MSgM_xg Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: db66f4a941524e30b05360a3ccb2e449 Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ListImageFiltersTestJSON-1608051074 Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/db66f4a941524e30b05360a3ccb2e449"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/db66f4a941524e30b05360a3ccb2e449"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_db66f4a941524e30b05360a3ccb2e449"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/db66f4a941524e30b05360a3ccb2e449"}]}] Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ListImageFiltersTestJSON-1608051074 Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: db66f4a941524e30b05360a3ccb2e449 Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1608051074 Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ListImageFiltersTestJSON-1608051074-project Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 674435111c05455fb1eb5b213d1373c4 Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ListImageFiltersTestJSON-1608051074-project Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 56c29b20-837e-4f90-9213-99699295a6af could not be found. Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '56c29b20-837e-4f90-9213-99699295a6af'} Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56c29b20-837e-4f90-9213-99699295a6af could not be found. Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56c29b20-837e-4f90-9213-99699295a6af could not be found. Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:29:27.449759 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:27.453829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:29:27.453829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:29:27.453829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:29:27.453829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:29:27.453829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:29:27.453829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56c29b20-837e-4f90-9213-99699295a6af could not be found. Oct 26 13:29:27.453829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:29:27.455210 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3f5f5dfe-c0ca-4876-bb2d-c0770ce54888 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Returning 404 to user: Instance 56c29b20-837e-4f90-9213-99699295a6af could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:29:27.456416 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3f5f5dfe-c0ca-4876-bb2d-c0770ce54888 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "GET /compute/v2.1/servers/56c29b20-837e-4f90-9213-99699295a6af" status: 404 len: 111 microversion: 2.1 time: 0.090093 Oct 26 13:29:27.457145 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2708/5441] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:27 2022] GET /compute/v2.1/servers/56c29b20-837e-4f90-9213-99699295a6af => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:29:27.468691 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-eda02a70-eb8f-4b6a-abb0-62fd29be1a9d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:29:27.473898 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-eda02a70-eb8f-4b6a-abb0-62fd29be1a9d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:27.478947 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9d2a401b-ab38-449a-b1f2-9300d6b6cdf5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:27.483094 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eda02a70-eb8f-4b6a-abb0-62fd29be1a9d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:27.490351 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eda02a70-eb8f-4b6a-abb0-62fd29be1a9d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:27.490968 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eda02a70-eb8f-4b6a-abb0-62fd29be1a9d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:27.492944 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eda02a70-eb8f-4b6a-abb0-62fd29be1a9d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:27.493649 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eda02a70-eb8f-4b6a-abb0-62fd29be1a9d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:27.494237 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eda02a70-eb8f-4b6a-abb0-62fd29be1a9d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:27.502774 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9d2a401b-ab38-449a-b1f2-9300d6b6cdf5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 1.111252 Oct 26 13:29:27.503384 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2734/5442] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:26 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:27.507962 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3944d009-b6a4-4564-bb63-bec4d05a452c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f67311a2af0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:27.545470 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-eda02a70-eb8f-4b6a-abb0-62fd29be1a9d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lazy-loading 'flavor' on Instance uuid f573d46e-77d2-4405-baef-2bb447d4b5e7 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:29:28.085020 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-eda02a70-eb8f-4b6a-abb0-62fd29be1a9d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "POST /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7/action" status: 202 len: 0 microversion: 2.1 time: 0.625809 Oct 26 13:29:28.086031 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2709/5443] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:29:27 2022] POST /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7/action => generated 0 bytes in 628 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:29:28.110145 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-968b1533-bd9c-4de1-ad11-3e9335639ddd tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:28.115121 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-968b1533-bd9c-4de1-ad11-3e9335639ddd tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:28.139622 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-968b1533-bd9c-4de1-ad11-3e9335639ddd tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:28.140128 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-968b1533-bd9c-4de1-ad11-3e9335639ddd tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:28.140585 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-968b1533-bd9c-4de1-ad11-3e9335639ddd tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:28.141298 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-968b1533-bd9c-4de1-ad11-3e9335639ddd tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:28.153910 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-968b1533-bd9c-4de1-ad11-3e9335639ddd tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:28.155213 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-968b1533-bd9c-4de1-ad11-3e9335639ddd tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:28.458373 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3944d009-b6a4-4564-bb63-bec4d05a452c tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "DELETE /compute/v2.1/images/0f12f3a1-9af4-4edb-b314-9007eb32ceb8" status: 204 len: 0 microversion: 2.1 time: 0.953848 Oct 26 13:29:28.459022 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2735/5444] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:27 2022] DELETE /compute/v2.1/images/0f12f3a1-9af4-4edb-b314-9007eb32ceb8 => generated 0 bytes in 955 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:29:28.466097 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-18770d1e-8fc9-4356-92c6-91b3486f59fc tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:28.466953 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-18770d1e-8fc9-4356-92c6-91b3486f59fc tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:28.480667 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18770d1e-8fc9-4356-92c6-91b3486f59fc tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:28.481232 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18770d1e-8fc9-4356-92c6-91b3486f59fc tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:28.488765 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18770d1e-8fc9-4356-92c6-91b3486f59fc tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:28.489634 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18770d1e-8fc9-4356-92c6-91b3486f59fc tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:28.490124 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18770d1e-8fc9-4356-92c6-91b3486f59fc tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:28.490704 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18770d1e-8fc9-4356-92c6-91b3486f59fc tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:28.946410 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-968b1533-bd9c-4de1-ad11-3e9335639ddd tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:28.962408 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-968b1533-bd9c-4de1-ad11-3e9335639ddd tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 0.874957 Oct 26 13:29:28.968539 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2710/5445] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:28 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:28.983206 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b29e4ee4-1312-49ad-9401-01cdc4606816 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f6731528310>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:29.133176 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-18770d1e-8fc9-4356-92c6-91b3486f59fc tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:29.149336 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-18770d1e-8fc9-4356-92c6-91b3486f59fc tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1512 microversion: 2.1 time: 0.683598 Oct 26 13:29:29.153426 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2736/5446] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:28 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1512 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:29.170292 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-24ce5fe4-4ee4-4ef5-aebc-b913eb2fe4c8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:29:29.175579 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-24ce5fe4-4ee4-4ef5-aebc-b913eb2fe4c8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:29.198387 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24ce5fe4-4ee4-4ef5-aebc-b913eb2fe4c8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:29.199876 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24ce5fe4-4ee4-4ef5-aebc-b913eb2fe4c8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:29.206207 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24ce5fe4-4ee4-4ef5-aebc-b913eb2fe4c8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:29.206998 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24ce5fe4-4ee4-4ef5-aebc-b913eb2fe4c8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:29.208251 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24ce5fe4-4ee4-4ef5-aebc-b913eb2fe4c8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:29.208624 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24ce5fe4-4ee4-4ef5-aebc-b913eb2fe4c8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:29.360070 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-24ce5fe4-4ee4-4ef5-aebc-b913eb2fe4c8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Unlocking {{(pid=120598) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 26 13:29:29.505023 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-24ce5fe4-4ee4-4ef5-aebc-b913eb2fe4c8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "POST /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa/action" status: 202 len: 0 microversion: 2.1 time: 0.347252 Oct 26 13:29:29.505736 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2737/5447] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:29:29 2022] POST /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:29:29.516283 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-717f1141-fbde-407d-af21-ee586fa2b623 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:29.516911 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-717f1141-fbde-407d-af21-ee586fa2b623 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:29.526597 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-717f1141-fbde-407d-af21-ee586fa2b623 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:29.527900 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-717f1141-fbde-407d-af21-ee586fa2b623 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:29.528362 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-717f1141-fbde-407d-af21-ee586fa2b623 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:29.537382 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-717f1141-fbde-407d-af21-ee586fa2b623 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:29.538035 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-717f1141-fbde-407d-af21-ee586fa2b623 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:29.538490 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-717f1141-fbde-407d-af21-ee586fa2b623 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:29.635493 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b29e4ee4-1312-49ad-9401-01cdc4606816 tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "DELETE /compute/v2.1/images/06bf5ca3-9d54-442e-bad3-9dc61fdb1333" status: 204 len: 0 microversion: 2.1 time: 0.665516 Oct 26 13:29:29.636117 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2711/5448] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:28 2022] DELETE /compute/v2.1/images/06bf5ca3-9d54-442e-bad3-9dc61fdb1333 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:29:29.645246 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-828ca065-43f9-41d0-9bc3-8e12a867d81d tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] Calling method '.version_select at 0x7f6731496940>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:29.946033 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-717f1141-fbde-407d-af21-ee586fa2b623 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:29.965235 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-717f1141-fbde-407d-af21-ee586fa2b623 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 0.450619 Oct 26 13:29:29.968924 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2738/5449] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:29 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:29:29.994050 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-72456be2-8892-4135-ac04-7da74e969761 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:29.995184 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-72456be2-8892-4135-ac04-7da74e969761 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:30.007145 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72456be2-8892-4135-ac04-7da74e969761 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:30.009245 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72456be2-8892-4135-ac04-7da74e969761 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:30.010578 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72456be2-8892-4135-ac04-7da74e969761 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:30.017337 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72456be2-8892-4135-ac04-7da74e969761 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:30.018243 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72456be2-8892-4135-ac04-7da74e969761 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:30.018831 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72456be2-8892-4135-ac04-7da74e969761 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:30.411635 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-828ca065-43f9-41d0-9bc3-8e12a867d81d tempest-ListImageFiltersTestJSON-1608051074 tempest-ListImageFiltersTestJSON-1608051074-project] 10.222.0.40 "DELETE /compute/v2.1/images/a7ad1577-cb1f-4551-81d0-bce141d7078e" status: 204 len: 0 microversion: 2.1 time: 0.770509 Oct 26 13:29:30.419573 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2712/5450] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:29 2022] DELETE /compute/v2.1/images/a7ad1577-cb1f-4551-81d0-bce141d7078e => generated 0 bytes in 773 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:29:30.439285 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-87c0cf6b-68c2-4592-83a8-fe80a01b91de tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:30.442603 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-87c0cf6b-68c2-4592-83a8-fe80a01b91de tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:30.483506 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-87c0cf6b-68c2-4592-83a8-fe80a01b91de tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:30.484520 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-87c0cf6b-68c2-4592-83a8-fe80a01b91de tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:30.485666 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-87c0cf6b-68c2-4592-83a8-fe80a01b91de tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:30.488047 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-87c0cf6b-68c2-4592-83a8-fe80a01b91de tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:30.498471 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-87c0cf6b-68c2-4592-83a8-fe80a01b91de tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:30.501127 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-87c0cf6b-68c2-4592-83a8-fe80a01b91de tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:30.619285 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-72456be2-8892-4135-ac04-7da74e969761 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:30.635053 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-72456be2-8892-4135-ac04-7da74e969761 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 0.641183 Oct 26 13:29:30.635762 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2739/5451] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:29 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:29:30.674243 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c21e90f3-e5ff-4bc9-a643-161ece214e8f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:30.681181 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c21e90f3-e5ff-4bc9-a643-161ece214e8f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:30.708969 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c21e90f3-e5ff-4bc9-a643-161ece214e8f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:30.710681 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c21e90f3-e5ff-4bc9-a643-161ece214e8f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:30.712541 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c21e90f3-e5ff-4bc9-a643-161ece214e8f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:30.720400 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c21e90f3-e5ff-4bc9-a643-161ece214e8f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:30.721247 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c21e90f3-e5ff-4bc9-a643-161ece214e8f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:30.724136 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c21e90f3-e5ff-4bc9-a643-161ece214e8f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:31.185067 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c21e90f3-e5ff-4bc9-a643-161ece214e8f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:31.198669 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c21e90f3-e5ff-4bc9-a643-161ece214e8f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 0.540019 Oct 26 13:29:31.200890 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2740/5452] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:30 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:31.228399 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-89a2f937-ff87-4646-8887-23803ba5df5c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:29:31.231056 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-89a2f937-ff87-4646-8887-23803ba5df5c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:31.246897 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-89a2f937-ff87-4646-8887-23803ba5df5c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:31.248370 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-89a2f937-ff87-4646-8887-23803ba5df5c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:31.250354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-89a2f937-ff87-4646-8887-23803ba5df5c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:31.252290 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-89a2f937-ff87-4646-8887-23803ba5df5c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:31.255187 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-89a2f937-ff87-4646-8887-23803ba5df5c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:31.260388 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-89a2f937-ff87-4646-8887-23803ba5df5c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:31.478721 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-89a2f937-ff87-4646-8887-23803ba5df5c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "POST /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa/action" status: 202 len: 0 microversion: 2.1 time: 0.258168 Oct 26 13:29:31.481602 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2741/5453] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:29:31 2022] POST /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 13:29:31.514102 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-72b38a33-cddd-45ff-b022-8e93d7cc7064 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:31.514748 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-72b38a33-cddd-45ff-b022-8e93d7cc7064 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:31.541216 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72b38a33-cddd-45ff-b022-8e93d7cc7064 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:31.546181 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72b38a33-cddd-45ff-b022-8e93d7cc7064 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:31.552455 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72b38a33-cddd-45ff-b022-8e93d7cc7064 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:31.553427 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72b38a33-cddd-45ff-b022-8e93d7cc7064 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:31.553982 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72b38a33-cddd-45ff-b022-8e93d7cc7064 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:31.554425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72b38a33-cddd-45ff-b022-8e93d7cc7064 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:32.094266 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-87c0cf6b-68c2-4592-83a8-fe80a01b91de tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:32.113644 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-87c0cf6b-68c2-4592-83a8-fe80a01b91de tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1512 microversion: 2.1 time: 1.692452 Oct 26 13:29:32.134787 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2713/5454] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:30 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1512 bytes in 1714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:32.250052 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-72b38a33-cddd-45ff-b022-8e93d7cc7064 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:32.262575 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-72b38a33-cddd-45ff-b022-8e93d7cc7064 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1671 microversion: 2.1 time: 0.768014 Oct 26 13:29:32.287604 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2742/5455] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:31 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1671 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:33.140298 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-317ba1ff-6d5b-4353-9931-b9961deb4ff8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:33.141248 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-317ba1ff-6d5b-4353-9931-b9961deb4ff8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:33.168986 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-317ba1ff-6d5b-4353-9931-b9961deb4ff8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:33.169707 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-317ba1ff-6d5b-4353-9931-b9961deb4ff8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:33.170762 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-317ba1ff-6d5b-4353-9931-b9961deb4ff8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:33.172282 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-317ba1ff-6d5b-4353-9931-b9961deb4ff8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:33.174487 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-317ba1ff-6d5b-4353-9931-b9961deb4ff8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:33.175687 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-317ba1ff-6d5b-4353-9931-b9961deb4ff8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:33.227502 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:29:33.291266 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2f3dc545-71dd-4681-b216-9602af626dda tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:33.291998 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2f3dc545-71dd-4681-b216-9602af626dda tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:33.300702 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f3dc545-71dd-4681-b216-9602af626dda tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:33.301798 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f3dc545-71dd-4681-b216-9602af626dda tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:33.305029 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f3dc545-71dd-4681-b216-9602af626dda tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:33.316846 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f3dc545-71dd-4681-b216-9602af626dda tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:33.319195 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f3dc545-71dd-4681-b216-9602af626dda tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:33.320795 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f3dc545-71dd-4681-b216-9602af626dda tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:33.737780 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2f3dc545-71dd-4681-b216-9602af626dda tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:33.745985 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2f3dc545-71dd-4681-b216-9602af626dda tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1651 microversion: 2.1 time: 0.459789 Oct 26 13:29:33.748118 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2743/5456] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:33 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1651 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:33.784333 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6c3a14f8-e6ed-44a0-a30a-e947cc84d79d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:29:33.785282 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6c3a14f8-e6ed-44a0-a30a-e947cc84d79d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:33.792124 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c3a14f8-e6ed-44a0-a30a-e947cc84d79d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:33.795889 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c3a14f8-e6ed-44a0-a30a-e947cc84d79d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:33.796540 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c3a14f8-e6ed-44a0-a30a-e947cc84d79d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:33.797424 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c3a14f8-e6ed-44a0-a30a-e947cc84d79d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:33.799121 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c3a14f8-e6ed-44a0-a30a-e947cc84d79d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:33.799717 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c3a14f8-e6ed-44a0-a30a-e947cc84d79d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:33.815371 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:29:33.951962 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6c3a14f8-e6ed-44a0-a30a-e947cc84d79d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "POST /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa/action" status: 202 len: 0 microversion: 2.1 time: 0.174545 Oct 26 13:29:33.954719 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2744/5457] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:29:33 2022] POST /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:29:33.972491 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6a826100-ac55-46d0-9404-2f9a724a0364 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:33.974751 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6a826100-ac55-46d0-9404-2f9a724a0364 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:33.993588 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a826100-ac55-46d0-9404-2f9a724a0364 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:33.994107 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a826100-ac55-46d0-9404-2f9a724a0364 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:33.994632 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a826100-ac55-46d0-9404-2f9a724a0364 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:33.999105 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a826100-ac55-46d0-9404-2f9a724a0364 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:33.999274 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a826100-ac55-46d0-9404-2f9a724a0364 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:33.999793 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a826100-ac55-46d0-9404-2f9a724a0364 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:34.393668 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6a826100-ac55-46d0-9404-2f9a724a0364 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:34.407542 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6a826100-ac55-46d0-9404-2f9a724a0364 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1658 microversion: 2.1 time: 0.445830 Oct 26 13:29:34.410794 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2745/5458] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:33 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1658 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:34.435903 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-317ba1ff-6d5b-4353-9931-b9961deb4ff8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:34.452622 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-317ba1ff-6d5b-4353-9931-b9961deb4ff8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1512 microversion: 2.1 time: 1.316908 Oct 26 13:29:34.454670 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2714/5459] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:33 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1512 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:35.346817 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-dd93f5e8-3974-4f0f-9ee9-914f3fcab11c tempest-AZV2TestJSON-1472818232 tempest-AZV2TestJSON-1472818232-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:35.352672 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dd93f5e8-3974-4f0f-9ee9-914f3fcab11c tempest-AZV2TestJSON-1472818232 tempest-AZV2TestJSON-1472818232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:35.354627 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dd93f5e8-3974-4f0f-9ee9-914f3fcab11c tempest-AZV2TestJSON-1472818232 tempest-AZV2TestJSON-1472818232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:35.356665 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dd93f5e8-3974-4f0f-9ee9-914f3fcab11c tempest-AZV2TestJSON-1472818232 tempest-AZV2TestJSON-1472818232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:35.360868 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dd93f5e8-3974-4f0f-9ee9-914f3fcab11c tempest-AZV2TestJSON-1472818232 tempest-AZV2TestJSON-1472818232-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:35.367232 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dd93f5e8-3974-4f0f-9ee9-914f3fcab11c tempest-AZV2TestJSON-1472818232 tempest-AZV2TestJSON-1472818232-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:35.368489 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dd93f5e8-3974-4f0f-9ee9-914f3fcab11c tempest-AZV2TestJSON-1472818232 tempest-AZV2TestJSON-1472818232-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:35.435062 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7aadff9a-b12d-4f25-90a6-f2b9d115b884 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:35.436043 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7aadff9a-b12d-4f25-90a6-f2b9d115b884 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:35.468748 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7aadff9a-b12d-4f25-90a6-f2b9d115b884 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:35.471422 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7aadff9a-b12d-4f25-90a6-f2b9d115b884 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:35.475982 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7aadff9a-b12d-4f25-90a6-f2b9d115b884 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:35.476951 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7aadff9a-b12d-4f25-90a6-f2b9d115b884 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:35.478003 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-dd93f5e8-3974-4f0f-9ee9-914f3fcab11c tempest-AZV2TestJSON-1472818232 tempest-AZV2TestJSON-1472818232-project] 10.222.0.40 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.951290 Oct 26 13:29:35.479549 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2746/5460] 10.222.0.40 () {58 vars in 1164 bytes} [Wed Oct 26 13:29:34 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 13:29:35.493571 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4e030d92-103f-48de-8eb2-ddcd6d170f05 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:35.496626 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4e030d92-103f-48de-8eb2-ddcd6d170f05 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:35.504449 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7aadff9a-b12d-4f25-90a6-f2b9d115b884 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:35.505262 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7aadff9a-b12d-4f25-90a6-f2b9d115b884 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:35.510388 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e030d92-103f-48de-8eb2-ddcd6d170f05 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:35.513829 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e030d92-103f-48de-8eb2-ddcd6d170f05 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:35.514504 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e030d92-103f-48de-8eb2-ddcd6d170f05 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:35.515458 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e030d92-103f-48de-8eb2-ddcd6d170f05 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:35.516500 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e030d92-103f-48de-8eb2-ddcd6d170f05 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:35.518058 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e030d92-103f-48de-8eb2-ddcd6d170f05 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:35.922316 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4e030d92-103f-48de-8eb2-ddcd6d170f05 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:35.950398 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4e030d92-103f-48de-8eb2-ddcd6d170f05 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1512 microversion: 2.1 time: 0.469298 Oct 26 13:29:35.953700 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2747/5461] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:35 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1512 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:36.118508 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7aadff9a-b12d-4f25-90a6-f2b9d115b884 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:36.132680 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7aadff9a-b12d-4f25-90a6-f2b9d115b884 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 0.703137 Oct 26 13:29:36.140958 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2715/5462] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:35 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:36.173959 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c8f95093-9da7-493f-8984-4ba0be328bb1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:36.174593 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c8f95093-9da7-493f-8984-4ba0be328bb1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:36.183437 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c8f95093-9da7-493f-8984-4ba0be328bb1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:36.185466 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c8f95093-9da7-493f-8984-4ba0be328bb1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:36.189803 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c8f95093-9da7-493f-8984-4ba0be328bb1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:36.190786 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c8f95093-9da7-493f-8984-4ba0be328bb1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:36.191417 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c8f95093-9da7-493f-8984-4ba0be328bb1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:36.192007 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c8f95093-9da7-493f-8984-4ba0be328bb1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:36.524473 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c8f95093-9da7-493f-8984-4ba0be328bb1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:36.535195 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c8f95093-9da7-493f-8984-4ba0be328bb1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 0.373452 Oct 26 13:29:36.543105 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2748/5463] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:36 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:36.572599 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b9d5495c-f1c4-4d12-8e59-726a8258b84e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:36.574034 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b9d5495c-f1c4-4d12-8e59-726a8258b84e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:36.592738 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b9d5495c-f1c4-4d12-8e59-726a8258b84e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:36.594897 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b9d5495c-f1c4-4d12-8e59-726a8258b84e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:36.595632 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b9d5495c-f1c4-4d12-8e59-726a8258b84e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:36.596977 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b9d5495c-f1c4-4d12-8e59-726a8258b84e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:36.601220 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b9d5495c-f1c4-4d12-8e59-726a8258b84e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:36.601957 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b9d5495c-f1c4-4d12-8e59-726a8258b84e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:36.980197 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-61cd23a3-4db4-4a0c-aaf6-49121fc72f6b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:36.981063 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-61cd23a3-4db4-4a0c-aaf6-49121fc72f6b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:36.995296 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-61cd23a3-4db4-4a0c-aaf6-49121fc72f6b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:37.010752 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-61cd23a3-4db4-4a0c-aaf6-49121fc72f6b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:37.014352 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-61cd23a3-4db4-4a0c-aaf6-49121fc72f6b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:37.015316 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-61cd23a3-4db4-4a0c-aaf6-49121fc72f6b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:37.016701 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-61cd23a3-4db4-4a0c-aaf6-49121fc72f6b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:37.018450 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-61cd23a3-4db4-4a0c-aaf6-49121fc72f6b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:37.076656 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b9d5495c-f1c4-4d12-8e59-726a8258b84e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:37.096195 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b9d5495c-f1c4-4d12-8e59-726a8258b84e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 0.529219 Oct 26 13:29:37.097382 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2716/5464] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:36 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:37.122368 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a13c1ffe-4e07-4523-b5e2-2b3389c205a2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:37.123266 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a13c1ffe-4e07-4523-b5e2-2b3389c205a2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:37.141442 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a13c1ffe-4e07-4523-b5e2-2b3389c205a2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:37.143169 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a13c1ffe-4e07-4523-b5e2-2b3389c205a2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:37.145383 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a13c1ffe-4e07-4523-b5e2-2b3389c205a2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:37.146674 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a13c1ffe-4e07-4523-b5e2-2b3389c205a2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:37.147009 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a13c1ffe-4e07-4523-b5e2-2b3389c205a2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:37.148462 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a13c1ffe-4e07-4523-b5e2-2b3389c205a2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:37.500531 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a13c1ffe-4e07-4523-b5e2-2b3389c205a2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:37.512320 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a13c1ffe-4e07-4523-b5e2-2b3389c205a2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 0.393131 Oct 26 13:29:37.528353 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2717/5465] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:37 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:29:37.539677 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7208d71a-1901-489e-82d4-13bd74ae8e3b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:37.541868 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7208d71a-1901-489e-82d4-13bd74ae8e3b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:37.550217 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7208d71a-1901-489e-82d4-13bd74ae8e3b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:37.550892 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7208d71a-1901-489e-82d4-13bd74ae8e3b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:37.551540 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7208d71a-1901-489e-82d4-13bd74ae8e3b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:37.552418 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7208d71a-1901-489e-82d4-13bd74ae8e3b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:37.553025 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7208d71a-1901-489e-82d4-13bd74ae8e3b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:37.553693 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7208d71a-1901-489e-82d4-13bd74ae8e3b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:37.587985 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-61cd23a3-4db4-4a0c-aaf6-49121fc72f6b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:37.598883 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-61cd23a3-4db4-4a0c-aaf6-49121fc72f6b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1512 microversion: 2.1 time: 0.624249 Oct 26 13:29:37.599483 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2749/5466] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:36 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1512 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:37.912171 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7208d71a-1901-489e-82d4-13bd74ae8e3b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:37.925772 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7208d71a-1901-489e-82d4-13bd74ae8e3b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 0.389086 Oct 26 13:29:37.928965 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2718/5467] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:37 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:29:37.952853 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b8950e71-b63f-4744-b4ff-7ac25914475c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:37.954235 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b8950e71-b63f-4744-b4ff-7ac25914475c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:37.961710 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b8950e71-b63f-4744-b4ff-7ac25914475c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:37.971971 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b8950e71-b63f-4744-b4ff-7ac25914475c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:37.972683 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b8950e71-b63f-4744-b4ff-7ac25914475c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:37.974949 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b8950e71-b63f-4744-b4ff-7ac25914475c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:37.978435 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b8950e71-b63f-4744-b4ff-7ac25914475c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:37.979446 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b8950e71-b63f-4744-b4ff-7ac25914475c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:38.540082 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b8950e71-b63f-4744-b4ff-7ac25914475c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:38.577790 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b8950e71-b63f-4744-b4ff-7ac25914475c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 0.611981 Oct 26 13:29:38.582923 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2750/5468] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:37 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:38.624768 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ffbdee5c-6be2-4e9b-8751-a337819005c7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:38.625458 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ffbdee5c-6be2-4e9b-8751-a337819005c7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:38.653475 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ffbdee5c-6be2-4e9b-8751-a337819005c7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:38.654009 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ffbdee5c-6be2-4e9b-8751-a337819005c7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:38.654463 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ffbdee5c-6be2-4e9b-8751-a337819005c7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:38.674579 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ffbdee5c-6be2-4e9b-8751-a337819005c7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:38.675194 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ffbdee5c-6be2-4e9b-8751-a337819005c7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:38.675658 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ffbdee5c-6be2-4e9b-8751-a337819005c7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:39.174208 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ffbdee5c-6be2-4e9b-8751-a337819005c7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:39.192291 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ffbdee5c-6be2-4e9b-8751-a337819005c7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1533 microversion: 2.1 time: 0.572023 Oct 26 13:29:39.193316 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2719/5469] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:38 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1533 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:40.217020 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fa0ed21a-84dd-4b3b-b9a9-7e17391da89e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:40.218282 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fa0ed21a-84dd-4b3b-b9a9-7e17391da89e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:40.232550 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa0ed21a-84dd-4b3b-b9a9-7e17391da89e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:40.233427 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa0ed21a-84dd-4b3b-b9a9-7e17391da89e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:40.234060 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa0ed21a-84dd-4b3b-b9a9-7e17391da89e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:40.236444 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa0ed21a-84dd-4b3b-b9a9-7e17391da89e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:40.237105 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa0ed21a-84dd-4b3b-b9a9-7e17391da89e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:40.239801 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa0ed21a-84dd-4b3b-b9a9-7e17391da89e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:40.898357 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fa0ed21a-84dd-4b3b-b9a9-7e17391da89e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:40.916248 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fa0ed21a-84dd-4b3b-b9a9-7e17391da89e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1533 microversion: 2.1 time: 0.701907 Oct 26 13:29:40.921271 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2751/5470] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:40 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1533 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:41.946105 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d7a1bf53-1ca3-4d66-9c0f-f27120f74ef7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:41.947956 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d7a1bf53-1ca3-4d66-9c0f-f27120f74ef7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:41.972658 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7a1bf53-1ca3-4d66-9c0f-f27120f74ef7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:41.973687 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7a1bf53-1ca3-4d66-9c0f-f27120f74ef7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:41.974317 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7a1bf53-1ca3-4d66-9c0f-f27120f74ef7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:41.975480 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7a1bf53-1ca3-4d66-9c0f-f27120f74ef7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:41.978182 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7a1bf53-1ca3-4d66-9c0f-f27120f74ef7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:41.979600 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7a1bf53-1ca3-4d66-9c0f-f27120f74ef7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:42.672148 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d7a1bf53-1ca3-4d66-9c0f-f27120f74ef7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:42.684729 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d7a1bf53-1ca3-4d66-9c0f-f27120f74ef7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1528 microversion: 2.1 time: 0.747001 Oct 26 13:29:42.689646 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2720/5471] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:41 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1528 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:43.217718 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-eb38c714-101e-4ccf-a9b5-59354c8b8517 tempest-PortsAdminExtendedAttrsIpV6TestJSON-849685357 tempest-PortsAdminExtendedAttrsIpV6TestJSON-849685357-project-admin] Calling method '.version_select at 0x7f673120cd30>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:43.220924 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb38c714-101e-4ccf-a9b5-59354c8b8517 tempest-PortsAdminExtendedAttrsIpV6TestJSON-849685357 tempest-PortsAdminExtendedAttrsIpV6TestJSON-849685357-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:43.221726 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb38c714-101e-4ccf-a9b5-59354c8b8517 tempest-PortsAdminExtendedAttrsIpV6TestJSON-849685357 tempest-PortsAdminExtendedAttrsIpV6TestJSON-849685357-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:43.222179 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb38c714-101e-4ccf-a9b5-59354c8b8517 tempest-PortsAdminExtendedAttrsIpV6TestJSON-849685357 tempest-PortsAdminExtendedAttrsIpV6TestJSON-849685357-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:43.272632 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb38c714-101e-4ccf-a9b5-59354c8b8517 tempest-PortsAdminExtendedAttrsIpV6TestJSON-849685357 tempest-PortsAdminExtendedAttrsIpV6TestJSON-849685357-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:43.278469 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb38c714-101e-4ccf-a9b5-59354c8b8517 tempest-PortsAdminExtendedAttrsIpV6TestJSON-849685357 tempest-PortsAdminExtendedAttrsIpV6TestJSON-849685357-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:43.281325 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb38c714-101e-4ccf-a9b5-59354c8b8517 tempest-PortsAdminExtendedAttrsIpV6TestJSON-849685357 tempest-PortsAdminExtendedAttrsIpV6TestJSON-849685357-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:43.324912 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb38c714-101e-4ccf-a9b5-59354c8b8517 tempest-PortsAdminExtendedAttrsIpV6TestJSON-849685357 tempest-PortsAdminExtendedAttrsIpV6TestJSON-849685357-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:43.328656 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb38c714-101e-4ccf-a9b5-59354c8b8517 tempest-PortsAdminExtendedAttrsIpV6TestJSON-849685357 tempest-PortsAdminExtendedAttrsIpV6TestJSON-849685357-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:43.329736 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb38c714-101e-4ccf-a9b5-59354c8b8517 tempest-PortsAdminExtendedAttrsIpV6TestJSON-849685357 tempest-PortsAdminExtendedAttrsIpV6TestJSON-849685357-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:43.354158 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-eb38c714-101e-4ccf-a9b5-59354c8b8517 tempest-PortsAdminExtendedAttrsIpV6TestJSON-849685357 tempest-PortsAdminExtendedAttrsIpV6TestJSON-849685357-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.715013 Oct 26 13:29:43.358702 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2752/5472] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:29:42 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:29:43.724370 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-324749be-26b1-447f-85c9-ba59c4360e5a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:43.726316 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-324749be-26b1-447f-85c9-ba59c4360e5a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:43.746450 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-324749be-26b1-447f-85c9-ba59c4360e5a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:43.747024 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-324749be-26b1-447f-85c9-ba59c4360e5a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:43.747891 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-324749be-26b1-447f-85c9-ba59c4360e5a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:43.748800 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-324749be-26b1-447f-85c9-ba59c4360e5a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:43.749451 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-324749be-26b1-447f-85c9-ba59c4360e5a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:43.750515 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-324749be-26b1-447f-85c9-ba59c4360e5a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:43.766381 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-23f80901-5e9d-40dc-9aa7-f955618c077b req-731535c5-8755-4ba1-9fdf-dd1d798ce0ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f573d46e-77d2-4405-baef-2bb447d4b5e7", "name": "network-vif-plugged", "status": "completed", "tag": "1a81eb96-6bc8-4bfb-8326-14785f0a363d"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:29:43.794168 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-23f80901-5e9d-40dc-9aa7-f955618c077b req-731535c5-8755-4ba1-9fdf-dd1d798ce0ad service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:43.794663 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-23f80901-5e9d-40dc-9aa7-f955618c077b req-731535c5-8755-4ba1-9fdf-dd1d798ce0ad service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:43.795106 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-23f80901-5e9d-40dc-9aa7-f955618c077b req-731535c5-8755-4ba1-9fdf-dd1d798ce0ad service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:43.856515 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-23f80901-5e9d-40dc-9aa7-f955618c077b req-731535c5-8755-4ba1-9fdf-dd1d798ce0ad service nova] Creating event network-vif-plugged:1a81eb96-6bc8-4bfb-8326-14785f0a363d for instance f573d46e-77d2-4405-baef-2bb447d4b5e7 on n-h2-862686-1 Oct 26 13:29:43.881102 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-23f80901-5e9d-40dc-9aa7-f955618c077b req-731535c5-8755-4ba1-9fdf-dd1d798ce0ad service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118724 Oct 26 13:29:43.887758 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2753/5473] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:29:44.723823 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-324749be-26b1-447f-85c9-ba59c4360e5a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:44.739425 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-324749be-26b1-447f-85c9-ba59c4360e5a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1528 microversion: 2.1 time: 1.021500 Oct 26 13:29:44.740854 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2721/5474] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:43 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1528 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:45.766070 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:29:45.772196 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-da435b68-5ccb-43f3-ac92-532d2078c089 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:45.773294 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-da435b68-5ccb-43f3-ac92-532d2078c089 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:45.804122 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da435b68-5ccb-43f3-ac92-532d2078c089 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:45.804657 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da435b68-5ccb-43f3-ac92-532d2078c089 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:45.808625 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da435b68-5ccb-43f3-ac92-532d2078c089 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:45.810017 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da435b68-5ccb-43f3-ac92-532d2078c089 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:45.812171 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da435b68-5ccb-43f3-ac92-532d2078c089 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:45.812772 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da435b68-5ccb-43f3-ac92-532d2078c089 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:46.394220 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-da435b68-5ccb-43f3-ac92-532d2078c089 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:46.404967 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-da435b68-5ccb-43f3-ac92-532d2078c089 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1528 microversion: 2.1 time: 0.640341 Oct 26 13:29:46.409834 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2754/5475] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:45 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1528 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:47.440048 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f24156ea-b1f9-4419-8025-93630f1a2a2d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:47.441327 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f24156ea-b1f9-4419-8025-93630f1a2a2d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:47.470876 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f24156ea-b1f9-4419-8025-93630f1a2a2d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:47.473470 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f24156ea-b1f9-4419-8025-93630f1a2a2d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:47.474084 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f24156ea-b1f9-4419-8025-93630f1a2a2d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:47.479916 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f24156ea-b1f9-4419-8025-93630f1a2a2d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:47.482125 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f24156ea-b1f9-4419-8025-93630f1a2a2d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:47.483771 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f24156ea-b1f9-4419-8025-93630f1a2a2d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:48.272922 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f24156ea-b1f9-4419-8025-93630f1a2a2d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:48.294439 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f24156ea-b1f9-4419-8025-93630f1a2a2d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1528 microversion: 2.1 time: 0.858533 Oct 26 13:29:48.295527 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2722/5476] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:47 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1528 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:49.333171 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-30198439-a1b1-4ebc-b46b-6409bb2c4aae tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:49.333850 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-30198439-a1b1-4ebc-b46b-6409bb2c4aae tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:49.368987 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30198439-a1b1-4ebc-b46b-6409bb2c4aae tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:49.369830 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30198439-a1b1-4ebc-b46b-6409bb2c4aae tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:49.371014 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30198439-a1b1-4ebc-b46b-6409bb2c4aae tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:49.371921 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30198439-a1b1-4ebc-b46b-6409bb2c4aae tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:49.374280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30198439-a1b1-4ebc-b46b-6409bb2c4aae tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:49.380081 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30198439-a1b1-4ebc-b46b-6409bb2c4aae tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:50.128032 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-30198439-a1b1-4ebc-b46b-6409bb2c4aae tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:50.146588 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-30198439-a1b1-4ebc-b46b-6409bb2c4aae tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1528 microversion: 2.1 time: 0.818307 Oct 26 13:29:50.154186 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2755/5477] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:49 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1528 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:51.187535 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c8def077-7437-4583-9019-f7e226cfa05e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:51.190314 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c8def077-7437-4583-9019-f7e226cfa05e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:51.201983 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=56 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:29:51.212163 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c8def077-7437-4583-9019-f7e226cfa05e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:51.223463 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c8def077-7437-4583-9019-f7e226cfa05e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:51.227186 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c8def077-7437-4583-9019-f7e226cfa05e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:51.228110 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c8def077-7437-4583-9019-f7e226cfa05e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:51.228724 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c8def077-7437-4583-9019-f7e226cfa05e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:51.229368 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c8def077-7437-4583-9019-f7e226cfa05e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:52.774582 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c8def077-7437-4583-9019-f7e226cfa05e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:52.790263 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c8def077-7437-4583-9019-f7e226cfa05e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1528 microversion: 2.1 time: 1.607218 Oct 26 13:29:52.805200 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2723/5478] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:51 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1528 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:53.822717 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-861e0e04-6415-49b4-90a6-e98efb3d1599 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:53.824762 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-861e0e04-6415-49b4-90a6-e98efb3d1599 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:53.837846 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:29:53.849460 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-861e0e04-6415-49b4-90a6-e98efb3d1599 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:53.851328 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-861e0e04-6415-49b4-90a6-e98efb3d1599 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:53.852814 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-861e0e04-6415-49b4-90a6-e98efb3d1599 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:53.865460 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-861e0e04-6415-49b4-90a6-e98efb3d1599 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:53.866332 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-861e0e04-6415-49b4-90a6-e98efb3d1599 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:53.869116 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-861e0e04-6415-49b4-90a6-e98efb3d1599 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:55.102516 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-861e0e04-6415-49b4-90a6-e98efb3d1599 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:55.114012 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-861e0e04-6415-49b4-90a6-e98efb3d1599 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1528 microversion: 2.1 time: 1.297250 Oct 26 13:29:55.127458 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2756/5479] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:53 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1528 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:56.139127 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8a790308-193f-4868-b85f-68870172526c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:56.139834 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8a790308-193f-4868-b85f-68870172526c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:56.154539 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8a790308-193f-4868-b85f-68870172526c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:56.155333 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8a790308-193f-4868-b85f-68870172526c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:56.156073 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8a790308-193f-4868-b85f-68870172526c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:56.157244 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8a790308-193f-4868-b85f-68870172526c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:56.160352 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8a790308-193f-4868-b85f-68870172526c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:56.161124 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8a790308-193f-4868-b85f-68870172526c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:57.704695 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8a790308-193f-4868-b85f-68870172526c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:29:57.723078 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8a790308-193f-4868-b85f-68870172526c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1528 microversion: 2.1 time: 1.588597 Oct 26 13:29:57.727057 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2724/5480] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:56 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1528 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:29:58.764793 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7d5a80b5-9905-45ef-876a-8c82ae5e5734 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:29:58.766107 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7d5a80b5-9905-45ef-876a-8c82ae5e5734 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:29:58.785453 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7d5a80b5-9905-45ef-876a-8c82ae5e5734 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:58.786916 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7d5a80b5-9905-45ef-876a-8c82ae5e5734 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:58.787965 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7d5a80b5-9905-45ef-876a-8c82ae5e5734 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:58.791339 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7d5a80b5-9905-45ef-876a-8c82ae5e5734 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:29:58.795804 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7d5a80b5-9905-45ef-876a-8c82ae5e5734 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:29:58.796617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7d5a80b5-9905-45ef-876a-8c82ae5e5734 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:29:59.960891 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7d5a80b5-9905-45ef-876a-8c82ae5e5734 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:30:00.048180 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7d5a80b5-9905-45ef-876a-8c82ae5e5734 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1528 microversion: 2.1 time: 1.289494 Oct 26 13:30:00.048783 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2757/5481] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:29:58 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1528 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:30:01.004542 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6b8ee233-a16b-4bf1-a827-2246edcc15bb tempest-ServerGroup264TestJSON-238896849 tempest-ServerGroup264TestJSON-238896849-project] Action: 'create', calling method: .version_select at 0x7f67314220d0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:30:01.038706 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-6b8ee233-a16b-4bf1-a827-2246edcc15bb tempest-ServerGroup264TestJSON-238896849 tempest-ServerGroup264TestJSON-238896849-project] Getting quotas for project a860f5ffff0e4c36aa84a4bd9535e9b0. Resources: {'server_groups'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:30:01.046456 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-6b8ee233-a16b-4bf1-a827-2246edcc15bb tempest-ServerGroup264TestJSON-238896849 tempest-ServerGroup264TestJSON-238896849-project] Getting quotas for user 3b3febe5a860463584b0ce4ec5840f2d and project a860f5ffff0e4c36aa84a4bd9535e9b0. Resources: {'server_groups'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:30:01.081868 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-92a4f711-15a2-4853-81c4-90f33038282c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:01.083273 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-92a4f711-15a2-4853-81c4-90f33038282c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:30:01.100013 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-92a4f711-15a2-4853-81c4-90f33038282c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:01.101439 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-92a4f711-15a2-4853-81c4-90f33038282c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:01.103247 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-92a4f711-15a2-4853-81c4-90f33038282c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:01.106735 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-92a4f711-15a2-4853-81c4-90f33038282c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:01.107651 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-92a4f711-15a2-4853-81c4-90f33038282c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:01.109866 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-92a4f711-15a2-4853-81c4-90f33038282c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:01.145222 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-6b8ee233-a16b-4bf1-a827-2246edcc15bb tempest-ServerGroup264TestJSON-238896849 tempest-ServerGroup264TestJSON-238896849-project] Getting quotas for project a860f5ffff0e4c36aa84a4bd9535e9b0. Resources: {'server_groups'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:30:01.159452 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-6b8ee233-a16b-4bf1-a827-2246edcc15bb tempest-ServerGroup264TestJSON-238896849 tempest-ServerGroup264TestJSON-238896849-project] Getting quotas for user 3b3febe5a860463584b0ce4ec5840f2d and project a860f5ffff0e4c36aa84a4bd9535e9b0. Resources: {'server_groups'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:30:01.188701 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6b8ee233-a16b-4bf1-a827-2246edcc15bb tempest-ServerGroup264TestJSON-238896849 tempest-ServerGroup264TestJSON-238896849-project] 10.222.0.40 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.510487 Oct 26 13:30:01.191733 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2725/5482] 10.222.0.40 () {62 vars in 1214 bytes} [Wed Oct 26 13:30:00 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:30:01.208145 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e3ad377a-63e6-4d64-8c4e-995c982290a6 tempest-ServerGroup264TestJSON-238896849 tempest-ServerGroup264TestJSON-238896849-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:01.232384 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e3ad377a-63e6-4d64-8c4e-995c982290a6 tempest-ServerGroup264TestJSON-238896849 tempest-ServerGroup264TestJSON-238896849-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.032784 Oct 26 13:30:01.236226 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2726/5483] 10.222.0.40 () {60 vars in 1193 bytes} [Wed Oct 26 13:30:01 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 26 13:30:01.247552 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2272e311-2da3-40da-95a4-6da66d99dfb7 tempest-ServerGroup264TestJSON-238896849 tempest-ServerGroup264TestJSON-238896849-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:01.271427 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2272e311-2da3-40da-95a4-6da66d99dfb7 tempest-ServerGroup264TestJSON-238896849 tempest-ServerGroup264TestJSON-238896849-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups/c87ec0dc-7379-437c-b2ba-fed505f5c656" status: 200 len: 235 microversion: 2.64 time: 0.029182 Oct 26 13:30:01.273333 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2727/5484] 10.222.0.40 () {60 vars in 1304 bytes} [Wed Oct 26 13:30:01 2022] GET /compute/v2.1/os-server-groups/c87ec0dc-7379-437c-b2ba-fed505f5c656 => generated 235 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:30:01.285335 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b9cc6760-9153-4e7b-a942-e6529d8487f2 tempest-ServerGroup264TestJSON-238896849 tempest-ServerGroup264TestJSON-238896849-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:01.351460 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b9cc6760-9153-4e7b-a942-e6529d8487f2 tempest-ServerGroup264TestJSON-238896849 tempest-ServerGroup264TestJSON-238896849-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/c87ec0dc-7379-437c-b2ba-fed505f5c656" status: 204 len: 0 microversion: 2.64 time: 0.070787 Oct 26 13:30:01.352267 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2728/5485] 10.222.0.40 () {60 vars in 1307 bytes} [Wed Oct 26 13:30:01 2022] DELETE /compute/v2.1/os-server-groups/c87ec0dc-7379-437c-b2ba-fed505f5c656 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 26 13:30:01.369230 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6209cfb4-fd9f-4514-b0f5-42bdc668db53 tempest-ServerGroup264TestJSON-238896849 tempest-ServerGroup264TestJSON-238896849-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:01.386586 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-6209cfb4-fd9f-4514-b0f5-42bdc668db53 tempest-ServerGroup264TestJSON-238896849 tempest-ServerGroup264TestJSON-238896849-project] HTTP exception thrown: Instance group c87ec0dc-7379-437c-b2ba-fed505f5c656 could not be found. Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6209cfb4-fd9f-4514-b0f5-42bdc668db53 tempest-ServerGroup264TestJSON-238896849 tempest-ServerGroup264TestJSON-238896849-project] Request method failure captured: Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/os-server-groups/c87ec0dc-7379-437c-b2ba-fed505f5c656 HTTP/1.1 Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTZYR771tsCa0f_i3bn_RU4bRpkTu6KC1rDsrhJJ1yqhs6G09D0G8XYUJH7Uq2uJmm1_-8bfIEjRMB8P51SHfN2C_eHgor-2_xO4tqGVq9cafI-9RjUA96ab9CxUWp1hYbzm0ZXfwzYt9B7TVRTOpexVHguxCLhlfsbPqjkhJZIkpUE Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: X-Openstack-Nova-Api-Version: 2.64 Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: a860f5ffff0e4c36aa84a4bd9535e9b0 Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServerGroup264TestJSON-238896849 Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a860f5ffff0e4c36aa84a4bd9535e9b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a860f5ffff0e4c36aa84a4bd9535e9b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a860f5ffff0e4c36aa84a4bd9535e9b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a860f5ffff0e4c36aa84a4bd9535e9b0"}]}] Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServerGroup264TestJSON-238896849 Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: a860f5ffff0e4c36aa84a4bd9535e9b0 Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServerGroup264TestJSON-238896849 Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServerGroup264TestJSON-238896849-project Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 3b3febe5a860463584b0ce4ec5840f2d Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServerGroup264TestJSON-238896849-project Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance group c87ec0dc-7379-437c-b2ba-fed505f5c656 could not be found. Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'c87ec0dc-7379-437c-b2ba-fed505f5c656'} Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group c87ec0dc-7379-437c-b2ba-fed505f5c656 could not be found. Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group c87ec0dc-7379-437c-b2ba-fed505f5c656 could not be found. Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:30:01.393014 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:30:01.402776 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:30:01.402776 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:30:01.402776 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:30:01.402776 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:30:01.402776 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group c87ec0dc-7379-437c-b2ba-fed505f5c656 could not be found. Oct 26 13:30:01.402776 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:30:01.402776 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6209cfb4-fd9f-4514-b0f5-42bdc668db53 tempest-ServerGroup264TestJSON-238896849 tempest-ServerGroup264TestJSON-238896849-project] Returning 404 to user: Instance group c87ec0dc-7379-437c-b2ba-fed505f5c656 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:30:01.402776 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6209cfb4-fd9f-4514-b0f5-42bdc668db53 tempest-ServerGroup264TestJSON-238896849 tempest-ServerGroup264TestJSON-238896849-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/c87ec0dc-7379-437c-b2ba-fed505f5c656" status: 404 len: 117 microversion: 2.64 time: 0.036880 Oct 26 13:30:01.402776 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2729/5486] 10.222.0.40 () {60 vars in 1307 bytes} [Wed Oct 26 13:30:01 2022] DELETE /compute/v2.1/os-server-groups/c87ec0dc-7379-437c-b2ba-fed505f5c656 => generated 117 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:30:01.687606 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-92a4f711-15a2-4853-81c4-90f33038282c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:30:01.704002 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-92a4f711-15a2-4853-81c4-90f33038282c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1528 microversion: 2.1 time: 0.626891 Oct 26 13:30:01.706264 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2758/5487] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:30:01 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1528 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:30:01.733619 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6194eaff-1bfc-45d1-a614-a4d3b5f4a052 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:30:01.736235 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6194eaff-1bfc-45d1-a614-a4d3b5f4a052 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:30:01.764105 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6194eaff-1bfc-45d1-a614-a4d3b5f4a052 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:01.767756 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6194eaff-1bfc-45d1-a614-a4d3b5f4a052 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:01.768269 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6194eaff-1bfc-45d1-a614-a4d3b5f4a052 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:01.772298 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6194eaff-1bfc-45d1-a614-a4d3b5f4a052 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:01.772871 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6194eaff-1bfc-45d1-a614-a4d3b5f4a052 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:01.775973 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6194eaff-1bfc-45d1-a614-a4d3b5f4a052 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:02.039392 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6194eaff-1bfc-45d1-a614-a4d3b5f4a052 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "POST /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa/action" status: 202 len: 0 microversion: 2.1 time: 0.310037 Oct 26 13:30:02.049807 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b1dc556c-2975-4d02-9293-b2753cf67aa9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:02.051589 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b1dc556c-2975-4d02-9293-b2753cf67aa9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:30:02.056689 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2730/5488] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:30:01 2022] POST /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:30:02.059726 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1dc556c-2975-4d02-9293-b2753cf67aa9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:02.063673 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1dc556c-2975-4d02-9293-b2753cf67aa9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:02.064346 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1dc556c-2975-4d02-9293-b2753cf67aa9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:02.066301 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1dc556c-2975-4d02-9293-b2753cf67aa9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:02.068236 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1dc556c-2975-4d02-9293-b2753cf67aa9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:02.069259 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1dc556c-2975-4d02-9293-b2753cf67aa9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:02.737257 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-32815285-bfa1-49e1-a4a7-8e61ab0011e1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:02.738394 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-32815285-bfa1-49e1-a4a7-8e61ab0011e1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:30:02.762629 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32815285-bfa1-49e1-a4a7-8e61ab0011e1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:02.765427 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32815285-bfa1-49e1-a4a7-8e61ab0011e1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:02.767706 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32815285-bfa1-49e1-a4a7-8e61ab0011e1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:02.769973 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32815285-bfa1-49e1-a4a7-8e61ab0011e1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:02.772868 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32815285-bfa1-49e1-a4a7-8e61ab0011e1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:02.775575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32815285-bfa1-49e1-a4a7-8e61ab0011e1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:03.378350 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-32815285-bfa1-49e1-a4a7-8e61ab0011e1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:30:03.380712 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:30:03.393008 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-32815285-bfa1-49e1-a4a7-8e61ab0011e1 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1528 microversion: 2.1 time: 0.660449 Oct 26 13:30:03.409403 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2731/5489] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:30:02 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1528 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:30:03.894416 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b1dc556c-2975-4d02-9293-b2753cf67aa9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:30:03.897171 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:30:03.930790 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b1dc556c-2975-4d02-9293-b2753cf67aa9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1668 microversion: 2.1 time: 1.885626 Oct 26 13:30:03.978184 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2759/5490] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:30:02 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1668 bytes in 1928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:30:04.426936 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-38abe17f-cd36-4d91-b26a-6aa779ea626b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:04.428134 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-38abe17f-cd36-4d91-b26a-6aa779ea626b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:30:04.460300 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38abe17f-cd36-4d91-b26a-6aa779ea626b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:04.461118 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38abe17f-cd36-4d91-b26a-6aa779ea626b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:04.461773 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38abe17f-cd36-4d91-b26a-6aa779ea626b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:04.462665 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38abe17f-cd36-4d91-b26a-6aa779ea626b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:04.466197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38abe17f-cd36-4d91-b26a-6aa779ea626b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:04.468285 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38abe17f-cd36-4d91-b26a-6aa779ea626b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:04.744505 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-38abe17f-cd36-4d91-b26a-6aa779ea626b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:30:04.755228 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-38abe17f-cd36-4d91-b26a-6aa779ea626b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1528 microversion: 2.1 time: 0.332317 Oct 26 13:30:04.768106 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2732/5491] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:30:04 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1528 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:30:05.005673 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-97aa93fb-4335-4b97-b4fe-61c5a45ab880 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:05.005673 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-97aa93fb-4335-4b97-b4fe-61c5a45ab880 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:30:05.016617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97aa93fb-4335-4b97-b4fe-61c5a45ab880 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:05.026919 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97aa93fb-4335-4b97-b4fe-61c5a45ab880 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:05.031519 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97aa93fb-4335-4b97-b4fe-61c5a45ab880 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:05.032517 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97aa93fb-4335-4b97-b4fe-61c5a45ab880 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:05.035441 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97aa93fb-4335-4b97-b4fe-61c5a45ab880 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:05.036060 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97aa93fb-4335-4b97-b4fe-61c5a45ab880 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:05.792944 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b3185a3a-1161-4168-83ba-74b8b04bd219 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:05.794426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b3185a3a-1161-4168-83ba-74b8b04bd219 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:30:05.815412 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b3185a3a-1161-4168-83ba-74b8b04bd219 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:05.816217 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b3185a3a-1161-4168-83ba-74b8b04bd219 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:05.816866 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b3185a3a-1161-4168-83ba-74b8b04bd219 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:05.818397 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b3185a3a-1161-4168-83ba-74b8b04bd219 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:05.819077 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b3185a3a-1161-4168-83ba-74b8b04bd219 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:05.819707 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b3185a3a-1161-4168-83ba-74b8b04bd219 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:05.900422 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-97aa93fb-4335-4b97-b4fe-61c5a45ab880 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:30:05.916251 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-97aa93fb-4335-4b97-b4fe-61c5a45ab880 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1668 microversion: 2.1 time: 0.924071 Oct 26 13:30:05.930363 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2760/5492] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:30:04 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1668 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:30:06.152699 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b3185a3a-1161-4168-83ba-74b8b04bd219 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:30:06.238960 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b3185a3a-1161-4168-83ba-74b8b04bd219 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1528 microversion: 2.1 time: 0.449701 Oct 26 13:30:06.264486 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2733/5493] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:30:05 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1528 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:30:06.949713 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-31ad5c26-b49a-4ca7-94cd-776d2a73c92b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:06.956342 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-31ad5c26-b49a-4ca7-94cd-776d2a73c92b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:30:06.988745 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31ad5c26-b49a-4ca7-94cd-776d2a73c92b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:06.992201 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31ad5c26-b49a-4ca7-94cd-776d2a73c92b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:06.992853 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31ad5c26-b49a-4ca7-94cd-776d2a73c92b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:06.998774 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31ad5c26-b49a-4ca7-94cd-776d2a73c92b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:06.999325 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31ad5c26-b49a-4ca7-94cd-776d2a73c92b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:07.015945 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31ad5c26-b49a-4ca7-94cd-776d2a73c92b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:07.274891 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-758d2fa9-e85e-40e7-a33e-cba76cfcc1c5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:07.275688 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-758d2fa9-e85e-40e7-a33e-cba76cfcc1c5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:30:07.295658 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-758d2fa9-e85e-40e7-a33e-cba76cfcc1c5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:07.296482 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-758d2fa9-e85e-40e7-a33e-cba76cfcc1c5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:07.297149 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-758d2fa9-e85e-40e7-a33e-cba76cfcc1c5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:07.298254 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-758d2fa9-e85e-40e7-a33e-cba76cfcc1c5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:07.298920 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-758d2fa9-e85e-40e7-a33e-cba76cfcc1c5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:07.300014 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-758d2fa9-e85e-40e7-a33e-cba76cfcc1c5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:07.762823 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-31ad5c26-b49a-4ca7-94cd-776d2a73c92b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:30:07.794759 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-31ad5c26-b49a-4ca7-94cd-776d2a73c92b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1673 microversion: 2.1 time: 0.853471 Oct 26 13:30:07.795860 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2761/5494] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:30:06 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1673 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:30:07.805623 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-758d2fa9-e85e-40e7-a33e-cba76cfcc1c5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:30:07.829044 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-758d2fa9-e85e-40e7-a33e-cba76cfcc1c5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1528 microversion: 2.1 time: 0.562263 Oct 26 13:30:07.832353 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2734/5495] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:30:07 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1528 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:30:08.819912 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-904a4dc5-cb67-47a0-98eb-e6cb02d240d9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:08.820579 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-904a4dc5-cb67-47a0-98eb-e6cb02d240d9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:30:08.842216 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-904a4dc5-cb67-47a0-98eb-e6cb02d240d9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:08.843014 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-904a4dc5-cb67-47a0-98eb-e6cb02d240d9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:08.845003 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-904a4dc5-cb67-47a0-98eb-e6cb02d240d9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:08.847396 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-904a4dc5-cb67-47a0-98eb-e6cb02d240d9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:08.849251 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-904a4dc5-cb67-47a0-98eb-e6cb02d240d9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:08.850845 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-904a4dc5-cb67-47a0-98eb-e6cb02d240d9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:08.896160 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-32f09b6a-7fd3-4b84-9703-0a5b166d1c9c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:08.896822 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-32f09b6a-7fd3-4b84-9703-0a5b166d1c9c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:30:08.926446 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32f09b6a-7fd3-4b84-9703-0a5b166d1c9c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:08.926948 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32f09b6a-7fd3-4b84-9703-0a5b166d1c9c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:08.927387 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32f09b6a-7fd3-4b84-9703-0a5b166d1c9c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:08.928102 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32f09b6a-7fd3-4b84-9703-0a5b166d1c9c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:08.928554 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32f09b6a-7fd3-4b84-9703-0a5b166d1c9c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:08.928973 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32f09b6a-7fd3-4b84-9703-0a5b166d1c9c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:09.233071 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-32f09b6a-7fd3-4b84-9703-0a5b166d1c9c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:30:09.242934 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-32f09b6a-7fd3-4b84-9703-0a5b166d1c9c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1528 microversion: 2.1 time: 0.389295 Oct 26 13:30:09.243705 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2735/5496] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:30:08 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1528 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:30:10.005805 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-904a4dc5-cb67-47a0-98eb-e6cb02d240d9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:30:10.017413 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-904a4dc5-cb67-47a0-98eb-e6cb02d240d9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 1.201321 Oct 26 13:30:10.018048 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2762/5497] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:30:08 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:30:10.268188 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0132b6df-f9d4-44a6-ad84-1d8568e44818 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:10.268794 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0132b6df-f9d4-44a6-ad84-1d8568e44818 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:30:10.276522 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0132b6df-f9d4-44a6-ad84-1d8568e44818 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:10.277241 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0132b6df-f9d4-44a6-ad84-1d8568e44818 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:10.278117 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0132b6df-f9d4-44a6-ad84-1d8568e44818 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:10.278990 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0132b6df-f9d4-44a6-ad84-1d8568e44818 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:10.280203 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0132b6df-f9d4-44a6-ad84-1d8568e44818 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:10.280891 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0132b6df-f9d4-44a6-ad84-1d8568e44818 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:10.660920 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0132b6df-f9d4-44a6-ad84-1d8568e44818 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:30:10.679633 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0132b6df-f9d4-44a6-ad84-1d8568e44818 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1528 microversion: 2.1 time: 0.415271 Oct 26 13:30:10.698112 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2736/5498] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:30:10 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1528 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:30:11.709178 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6e807572-059f-47b3-8ad8-a1c9f1a9f6b3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:11.710750 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6e807572-059f-47b3-8ad8-a1c9f1a9f6b3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:30:11.734517 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e807572-059f-47b3-8ad8-a1c9f1a9f6b3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:11.735740 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e807572-059f-47b3-8ad8-a1c9f1a9f6b3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:11.736565 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e807572-059f-47b3-8ad8-a1c9f1a9f6b3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:11.739008 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e807572-059f-47b3-8ad8-a1c9f1a9f6b3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:11.739762 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e807572-059f-47b3-8ad8-a1c9f1a9f6b3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:11.740377 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e807572-059f-47b3-8ad8-a1c9f1a9f6b3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:13.033152 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6e807572-059f-47b3-8ad8-a1c9f1a9f6b3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:30:13.048436 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6e807572-059f-47b3-8ad8-a1c9f1a9f6b3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1528 microversion: 2.1 time: 1.343778 Oct 26 13:30:13.049125 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2763/5499] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:30:11 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1528 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:30:14.074136 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-37a5cada-3dc2-4530-97b0-30ec1b81576d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:14.075404 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-37a5cada-3dc2-4530-97b0-30ec1b81576d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:30:14.083403 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=8 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:30:14.099575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37a5cada-3dc2-4530-97b0-30ec1b81576d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:14.101658 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37a5cada-3dc2-4530-97b0-30ec1b81576d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:14.109027 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37a5cada-3dc2-4530-97b0-30ec1b81576d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:14.110068 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37a5cada-3dc2-4530-97b0-30ec1b81576d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:14.113121 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37a5cada-3dc2-4530-97b0-30ec1b81576d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:14.114124 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-37a5cada-3dc2-4530-97b0-30ec1b81576d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:15.144246 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-37a5cada-3dc2-4530-97b0-30ec1b81576d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:30:15.157937 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-37a5cada-3dc2-4530-97b0-30ec1b81576d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1528 microversion: 2.1 time: 1.089070 Oct 26 13:30:15.159071 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2737/5500] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:30:14 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1528 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:30:16.188327 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7fac0201-e323-4c53-8995-0e788d73263e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:16.188958 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7fac0201-e323-4c53-8995-0e788d73263e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:30:16.210506 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7fac0201-e323-4c53-8995-0e788d73263e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:16.217869 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7fac0201-e323-4c53-8995-0e788d73263e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:16.218453 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7fac0201-e323-4c53-8995-0e788d73263e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:16.222147 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7fac0201-e323-4c53-8995-0e788d73263e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:16.222692 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7fac0201-e323-4c53-8995-0e788d73263e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:16.223147 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7fac0201-e323-4c53-8995-0e788d73263e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:17.658230 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7fac0201-e323-4c53-8995-0e788d73263e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:30:17.677267 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7fac0201-e323-4c53-8995-0e788d73263e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1528 microversion: 2.1 time: 1.495249 Oct 26 13:30:17.693071 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2764/5501] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:30:16 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1528 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:30:18.709593 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-563988f8-d962-4245-a74c-4e19ec72f4ac tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:18.710191 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-563988f8-d962-4245-a74c-4e19ec72f4ac tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:30:18.735005 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-563988f8-d962-4245-a74c-4e19ec72f4ac tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:18.735970 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-563988f8-d962-4245-a74c-4e19ec72f4ac tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:18.738963 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-563988f8-d962-4245-a74c-4e19ec72f4ac tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:18.739704 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-563988f8-d962-4245-a74c-4e19ec72f4ac tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:18.740197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-563988f8-d962-4245-a74c-4e19ec72f4ac tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:18.740662 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-563988f8-d962-4245-a74c-4e19ec72f4ac tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:20.651926 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-563988f8-d962-4245-a74c-4e19ec72f4ac tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:30:20.679620 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-563988f8-d962-4245-a74c-4e19ec72f4ac tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1528 microversion: 2.1 time: 1.969542 Oct 26 13:30:20.683105 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2738/5502] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:30:18 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1528 bytes in 1978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:30:21.703742 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6396d9fa-e1bd-4ece-923a-0f3ba390c84c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:21.710495 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6396d9fa-e1bd-4ece-923a-0f3ba390c84c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:30:21.733342 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6396d9fa-e1bd-4ece-923a-0f3ba390c84c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:21.739306 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6396d9fa-e1bd-4ece-923a-0f3ba390c84c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:21.740803 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6396d9fa-e1bd-4ece-923a-0f3ba390c84c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:21.747629 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6396d9fa-e1bd-4ece-923a-0f3ba390c84c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:21.748572 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6396d9fa-e1bd-4ece-923a-0f3ba390c84c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:21.749224 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6396d9fa-e1bd-4ece-923a-0f3ba390c84c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:22.251391 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6396d9fa-e1bd-4ece-923a-0f3ba390c84c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:30:22.279209 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6396d9fa-e1bd-4ece-923a-0f3ba390c84c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1510 microversion: 2.1 time: 0.579533 Oct 26 13:30:22.283703 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2765/5503] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:30:21 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1510 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:30:23.146570 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0e181b0d-f595-4f89-8156-2ca9a44bc3f5 tempest-QuotasTestJSON-1115395665 tempest-QuotasTestJSON-1115395665-project] Calling method '.version_select at 0x7f67313b5040>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:23.235910 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:30:23.244196 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0e181b0d-f595-4f89-8156-2ca9a44bc3f5 tempest-QuotasTestJSON-1115395665 tempest-QuotasTestJSON-1115395665-project] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/4365785d455345f8acee467bb865fc7f/defaults" status: 200 len: 371 microversion: 2.1 time: 0.354171 Oct 26 13:30:23.247692 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2739/5504] 10.222.0.40 () {58 vars in 1269 bytes} [Wed Oct 26 13:30:22 2022] GET /compute/v2.1/os-quota-sets/4365785d455345f8acee467bb865fc7f/defaults => generated 371 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:30:23.260382 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-daa31722-d9fe-42e4-aff1-4a386805ed13 tempest-QuotasTestJSON-1115395665 tempest-QuotasTestJSON-1115395665-project] Calling method '.version_select at 0x7f67311a2310>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:23.304376 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-11218256-9931-4256-a774-de26ac60e64a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:23.305001 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-11218256-9931-4256-a774-de26ac60e64a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:30:23.319765 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-11218256-9931-4256-a774-de26ac60e64a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:23.320361 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-11218256-9931-4256-a774-de26ac60e64a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:23.320723 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-11218256-9931-4256-a774-de26ac60e64a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:23.321443 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-11218256-9931-4256-a774-de26ac60e64a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:23.324268 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-11218256-9931-4256-a774-de26ac60e64a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:23.324981 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-11218256-9931-4256-a774-de26ac60e64a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:23.410044 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-daa31722-d9fe-42e4-aff1-4a386805ed13 tempest-QuotasTestJSON-1115395665 tempest-QuotasTestJSON-1115395665-project] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/4365785d455345f8acee467bb865fc7f" status: 200 len: 371 microversion: 2.1 time: 0.153333 Oct 26 13:30:23.422170 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2766/5505] 10.222.0.40 () {58 vars in 1242 bytes} [Wed Oct 26 13:30:23 2022] GET /compute/v2.1/os-quota-sets/4365785d455345f8acee467bb865fc7f => generated 371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:30:23.436161 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b82cb3a6-917b-4745-8a5e-1762c7d8c3ce tempest-QuotasTestJSON-1115395665 tempest-QuotasTestJSON-1115395665-project] Calling method '.version_select at 0x7f67310f64c0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:23.562515 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b82cb3a6-917b-4745-8a5e-1762c7d8c3ce tempest-QuotasTestJSON-1115395665 tempest-QuotasTestJSON-1115395665-project] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/4365785d455345f8acee467bb865fc7f/defaults" status: 200 len: 371 microversion: 2.1 time: 0.131425 Oct 26 13:30:23.563748 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2767/5506] 10.222.0.40 () {58 vars in 1269 bytes} [Wed Oct 26 13:30:23 2022] GET /compute/v2.1/os-quota-sets/4365785d455345f8acee467bb865fc7f/defaults => generated 371 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:30:23.579359 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1ba57744-4c3f-424d-a900-3ecac808bf52 tempest-QuotasTestJSON-1115395665 tempest-QuotasTestJSON-1115395665-project] Calling method '.version_select at 0x7f67311a2c10>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:23.788551 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1ba57744-4c3f-424d-a900-3ecac808bf52 tempest-QuotasTestJSON-1115395665 tempest-QuotasTestJSON-1115395665-project] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/4365785d455345f8acee467bb865fc7f" status: 200 len: 371 microversion: 2.1 time: 0.213167 Oct 26 13:30:23.790402 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2768/5507] 10.222.0.40 () {58 vars in 1242 bytes} [Wed Oct 26 13:30:23 2022] GET /compute/v2.1/os-quota-sets/4365785d455345f8acee467bb865fc7f => generated 371 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:30:23.807619 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-19a725f4-7e78-4809-82a2-eae85f7b6705 tempest-QuotasTestJSON-1115395665 tempest-QuotasTestJSON-1115395665-project] Calling method '.version_select at 0x7f673115b430>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:23.826155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-11218256-9931-4256-a774-de26ac60e64a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:30:23.842344 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-11218256-9931-4256-a774-de26ac60e64a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1510 microversion: 2.1 time: 0.540641 Oct 26 13:30:23.843317 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2740/5508] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:30:23 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1510 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:30:23.930738 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=32 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:30:23.947413 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-19a725f4-7e78-4809-82a2-eae85f7b6705 tempest-QuotasTestJSON-1115395665 tempest-QuotasTestJSON-1115395665-project] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/4365785d455345f8acee467bb865fc7f?user_id=7eefed17f4014f4cbbafb79d53917e2c" status: 200 len: 371 microversion: 2.1 time: 0.147556 Oct 26 13:30:23.948816 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2769/5509] 10.222.0.40 () {58 vars in 1323 bytes} [Wed Oct 26 13:30:23 2022] GET /compute/v2.1/os-quota-sets/4365785d455345f8acee467bb865fc7f?user_id=7eefed17f4014f4cbbafb79d53917e2c => generated 371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:30:24.369136 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-51e473a5-94e8-4c01-95b1-4ba44eb49bb3 req-0217d401-bf23-4867-a59a-428c03828f00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f573d46e-77d2-4405-baef-2bb447d4b5e7", "name": "network-vif-unplugged", "status": "completed", "tag": "1a81eb96-6bc8-4bfb-8326-14785f0a363d"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:30:24.393325 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-51e473a5-94e8-4c01-95b1-4ba44eb49bb3 req-0217d401-bf23-4867-a59a-428c03828f00 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:24.393866 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-51e473a5-94e8-4c01-95b1-4ba44eb49bb3 req-0217d401-bf23-4867-a59a-428c03828f00 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:24.395922 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-51e473a5-94e8-4c01-95b1-4ba44eb49bb3 req-0217d401-bf23-4867-a59a-428c03828f00 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:24.429378 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-51e473a5-94e8-4c01-95b1-4ba44eb49bb3 req-0217d401-bf23-4867-a59a-428c03828f00 service nova] Creating event network-vif-unplugged:1a81eb96-6bc8-4bfb-8326-14785f0a363d for instance f573d46e-77d2-4405-baef-2bb447d4b5e7 on n-h2-862686-1 Oct 26 13:30:24.441776 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-51e473a5-94e8-4c01-95b1-4ba44eb49bb3 req-0217d401-bf23-4867-a59a-428c03828f00 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078294 Oct 26 13:30:24.443009 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2741/5510] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:30:24.874534 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d8d543fa-c3ff-4b63-837d-3ea7a835088d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:24.875194 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d8d543fa-c3ff-4b63-837d-3ea7a835088d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:30:24.890865 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8d543fa-c3ff-4b63-837d-3ea7a835088d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:24.893977 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8d543fa-c3ff-4b63-837d-3ea7a835088d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:24.894617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8d543fa-c3ff-4b63-837d-3ea7a835088d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:24.895993 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8d543fa-c3ff-4b63-837d-3ea7a835088d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:24.897960 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8d543fa-c3ff-4b63-837d-3ea7a835088d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:24.898578 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8d543fa-c3ff-4b63-837d-3ea7a835088d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:25.514541 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d8d543fa-c3ff-4b63-837d-3ea7a835088d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:30:25.523182 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d8d543fa-c3ff-4b63-837d-3ea7a835088d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1510 microversion: 2.1 time: 0.657270 Oct 26 13:30:25.523786 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2770/5511] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:30:24 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1510 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:30:26.561187 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7e25fb61-a79d-4a89-b8f8-b970011c66d7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:26.562339 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7e25fb61-a79d-4a89-b8f8-b970011c66d7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:30:26.581205 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e25fb61-a79d-4a89-b8f8-b970011c66d7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:26.581608 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e25fb61-a79d-4a89-b8f8-b970011c66d7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:26.584193 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e25fb61-a79d-4a89-b8f8-b970011c66d7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:26.588177 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e25fb61-a79d-4a89-b8f8-b970011c66d7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:26.589505 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e25fb61-a79d-4a89-b8f8-b970011c66d7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:26.592431 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e25fb61-a79d-4a89-b8f8-b970011c66d7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:27.285999 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7e25fb61-a79d-4a89-b8f8-b970011c66d7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:30:27.307995 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7e25fb61-a79d-4a89-b8f8-b970011c66d7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1453 microversion: 2.1 time: 0.755039 Oct 26 13:30:27.322254 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2742/5512] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:30:26 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1453 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:30:27.342589 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e8dfa21e-59d1-4799-815d-b81e2e72bab4 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:27.343924 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e8dfa21e-59d1-4799-815d-b81e2e72bab4 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:30:27.370645 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e8dfa21e-59d1-4799-815d-b81e2e72bab4 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:27.371546 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e8dfa21e-59d1-4799-815d-b81e2e72bab4 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:27.374181 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e8dfa21e-59d1-4799-815d-b81e2e72bab4 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:27.375846 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e8dfa21e-59d1-4799-815d-b81e2e72bab4 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:27.379174 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e8dfa21e-59d1-4799-815d-b81e2e72bab4 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:27.379778 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e8dfa21e-59d1-4799-815d-b81e2e72bab4 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:28.467844 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e8dfa21e-59d1-4799-815d-b81e2e72bab4 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:30:28.486715 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e8dfa21e-59d1-4799-815d-b81e2e72bab4 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1453 microversion: 2.1 time: 1.150752 Oct 26 13:30:28.488226 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2771/5513] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:30:27 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1453 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:30:28.623611 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-63478dbb-1e9f-40e5-9c6b-d56ad4b93f4d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:30:28.624579 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-63478dbb-1e9f-40e5-9c6b-d56ad4b93f4d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:30:28.646613 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-63478dbb-1e9f-40e5-9c6b-d56ad4b93f4d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:28.648003 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-63478dbb-1e9f-40e5-9c6b-d56ad4b93f4d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:28.650590 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-63478dbb-1e9f-40e5-9c6b-d56ad4b93f4d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:28.652357 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-63478dbb-1e9f-40e5-9c6b-d56ad4b93f4d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:28.653870 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-63478dbb-1e9f-40e5-9c6b-d56ad4b93f4d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:28.659060 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-63478dbb-1e9f-40e5-9c6b-d56ad4b93f4d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:28.814539 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-63478dbb-1e9f-40e5-9c6b-d56ad4b93f4d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lazy-loading 'flavor' on Instance uuid f573d46e-77d2-4405-baef-2bb447d4b5e7 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:30:28.895053 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-63478dbb-1e9f-40e5-9c6b-d56ad4b93f4d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] HTTP exception thrown: Cannot 'shelve' instance f573d46e-77d2-4405-baef-2bb447d4b5e7 while it is in vm_state shelved_offloaded Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-63478dbb-1e9f-40e5-9c6b-d56ad4b93f4d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Request method failure captured: Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7/action HTTP/1.1 Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 14 Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTWpf9Job1by08RPlBi4BK3ZRus12IuUwpixxL0U8NmqouWwnfDFM_ku9arLt0Dfw_g2zljJol9iSiPHbr2OBJI9bA6xxReUYgF5HT4trI936uilzQCNXRfNWHD8SC65BfL8JHiNMAmXVHxHedc9hkhsO-eHURoIHHJwTTh6ig9qSq0 Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/088eb22706844984b58fe118d5421cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_088eb22706844984b58fe118d5421cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}] Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 9b8db27e3baf4b6a948f6d23c04cf680 Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: {"shelve": {}} Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: exception: Cannot 'shelve' instance f573d46e-77d2-4405-baef-2bb447d4b5e7 while it is in vm_state shelved_offloaded Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'f573d46e-77d2-4405-baef-2bb447d4b5e7', 'body': {'shelve': {}}} Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f573d46e-77d2-4405-baef-2bb447d4b5e7 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 26 13:30:28.897295 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 26 13:30:28.902603 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance f573d46e-77d2-4405-baef-2bb447d4b5e7 while it is in vm_state shelved_offloaded Oct 26 13:30:28.902603 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:30:28.902603 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:30:28.902603 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:30:28.902603 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:30:28.902603 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:30:28.902603 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:30:28.902603 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:30:28.902603 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:30:28.902603 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance f573d46e-77d2-4405-baef-2bb447d4b5e7 while it is in vm_state shelved_offloaded Oct 26 13:30:28.902603 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:30:28.911317 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-63478dbb-1e9f-40e5-9c6b-d56ad4b93f4d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Returning 409 to user: Cannot 'shelve' instance f573d46e-77d2-4405-baef-2bb447d4b5e7 while it is in vm_state shelved_offloaded {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:30:28.912472 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-63478dbb-1e9f-40e5-9c6b-d56ad4b93f4d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "POST /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7/action" status: 409 len: 155 microversion: 2.1 time: 0.293993 Oct 26 13:30:28.917055 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2743/5514] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:30:28 2022] POST /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7/action => generated 155 bytes in 296 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:30:28.925643 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4ed5fe60-3ca3-4451-8248-21ed35f1709d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:30:28.926482 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4ed5fe60-3ca3-4451-8248-21ed35f1709d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:30:28.945077 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4ed5fe60-3ca3-4451-8248-21ed35f1709d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:28.945596 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4ed5fe60-3ca3-4451-8248-21ed35f1709d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:28.946045 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4ed5fe60-3ca3-4451-8248-21ed35f1709d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:28.947015 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4ed5fe60-3ca3-4451-8248-21ed35f1709d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:28.947492 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4ed5fe60-3ca3-4451-8248-21ed35f1709d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:28.960684 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4ed5fe60-3ca3-4451-8248-21ed35f1709d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:30.023798 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4ed5fe60-3ca3-4451-8248-21ed35f1709d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120598) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 26 13:30:30.241011 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4ed5fe60-3ca3-4451-8248-21ed35f1709d tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "POST /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7/action" status: 202 len: 0 microversion: 2.1 time: 1.318670 Oct 26 13:30:30.242908 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2772/5515] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:30:28 2022] POST /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7/action => generated 0 bytes in 1324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:30:30.251971 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5c4eb88e-8d3e-420a-a9d1-9bdfb405d240 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:30.252796 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5c4eb88e-8d3e-420a-a9d1-9bdfb405d240 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:30:30.266739 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c4eb88e-8d3e-420a-a9d1-9bdfb405d240 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:30.274888 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c4eb88e-8d3e-420a-a9d1-9bdfb405d240 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:30.276917 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c4eb88e-8d3e-420a-a9d1-9bdfb405d240 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:30.278480 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c4eb88e-8d3e-420a-a9d1-9bdfb405d240 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:30.285687 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c4eb88e-8d3e-420a-a9d1-9bdfb405d240 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:30.286520 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c4eb88e-8d3e-420a-a9d1-9bdfb405d240 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:30.876958 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5c4eb88e-8d3e-420a-a9d1-9bdfb405d240 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:30:30.892280 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5c4eb88e-8d3e-420a-a9d1-9bdfb405d240 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1461 microversion: 2.1 time: 0.644635 Oct 26 13:30:30.897911 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2744/5516] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:30:30 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1461 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:30:31.944436 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-871ec357-66a2-4fe9-9210-ea04ca1e121e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:31.950909 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-871ec357-66a2-4fe9-9210-ea04ca1e121e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:30:31.983692 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-871ec357-66a2-4fe9-9210-ea04ca1e121e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:31.984272 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-871ec357-66a2-4fe9-9210-ea04ca1e121e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:31.984731 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-871ec357-66a2-4fe9-9210-ea04ca1e121e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:31.985555 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-871ec357-66a2-4fe9-9210-ea04ca1e121e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:31.989471 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-871ec357-66a2-4fe9-9210-ea04ca1e121e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:31.990210 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-871ec357-66a2-4fe9-9210-ea04ca1e121e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:33.115374 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-871ec357-66a2-4fe9-9210-ea04ca1e121e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:30:33.133388 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-871ec357-66a2-4fe9-9210-ea04ca1e121e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1461 microversion: 2.1 time: 1.213327 Oct 26 13:30:33.134260 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2773/5517] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:30:31 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1461 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:30:34.165695 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-db22b956-43e1-499e-b16c-5842dd04bbe3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:34.167053 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-db22b956-43e1-499e-b16c-5842dd04bbe3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:30:34.214590 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-db22b956-43e1-499e-b16c-5842dd04bbe3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:34.215118 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-db22b956-43e1-499e-b16c-5842dd04bbe3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:34.215577 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-db22b956-43e1-499e-b16c-5842dd04bbe3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:34.216311 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-db22b956-43e1-499e-b16c-5842dd04bbe3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:34.216775 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-db22b956-43e1-499e-b16c-5842dd04bbe3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:34.223317 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-db22b956-43e1-499e-b16c-5842dd04bbe3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:35.095500 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-db22b956-43e1-499e-b16c-5842dd04bbe3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:30:35.112090 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=74 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:30:35.146979 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-db22b956-43e1-499e-b16c-5842dd04bbe3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1461 microversion: 2.1 time: 0.986559 Oct 26 13:30:35.151605 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2745/5518] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:30:34 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1461 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:30:36.180643 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-65447847-e2e6-4b25-9597-0f9b872d4b8a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:36.183277 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-65447847-e2e6-4b25-9597-0f9b872d4b8a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:30:36.212013 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=8 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:30:36.221533 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65447847-e2e6-4b25-9597-0f9b872d4b8a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:36.222457 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65447847-e2e6-4b25-9597-0f9b872d4b8a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:36.223215 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65447847-e2e6-4b25-9597-0f9b872d4b8a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:36.225224 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65447847-e2e6-4b25-9597-0f9b872d4b8a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:36.226995 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65447847-e2e6-4b25-9597-0f9b872d4b8a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:36.228161 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65447847-e2e6-4b25-9597-0f9b872d4b8a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:36.247198 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:30:37.860970 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-65447847-e2e6-4b25-9597-0f9b872d4b8a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:30:37.878091 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-65447847-e2e6-4b25-9597-0f9b872d4b8a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1519 microversion: 2.1 time: 1.702968 Oct 26 13:30:37.880909 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2774/5519] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:30:36 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1519 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:30:38.909358 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ce09b80e-6038-4c09-9edd-bf336ea58023 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:38.910766 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ce09b80e-6038-4c09-9edd-bf336ea58023 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:30:38.931397 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce09b80e-6038-4c09-9edd-bf336ea58023 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:38.933192 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce09b80e-6038-4c09-9edd-bf336ea58023 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:38.933932 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce09b80e-6038-4c09-9edd-bf336ea58023 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:38.934952 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce09b80e-6038-4c09-9edd-bf336ea58023 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:38.935794 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce09b80e-6038-4c09-9edd-bf336ea58023 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:38.941551 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce09b80e-6038-4c09-9edd-bf336ea58023 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:39.627389 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ce09b80e-6038-4c09-9edd-bf336ea58023 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:30:39.643521 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ce09b80e-6038-4c09-9edd-bf336ea58023 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1519 microversion: 2.1 time: 0.739886 Oct 26 13:30:39.664176 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2746/5520] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:30:38 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1519 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:30:40.674310 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-64f8a190-6f02-4744-827d-1bcc3312ae93 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:40.676676 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-64f8a190-6f02-4744-827d-1bcc3312ae93 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:30:40.717849 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64f8a190-6f02-4744-827d-1bcc3312ae93 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:40.722567 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64f8a190-6f02-4744-827d-1bcc3312ae93 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:40.724617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64f8a190-6f02-4744-827d-1bcc3312ae93 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:40.730241 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64f8a190-6f02-4744-827d-1bcc3312ae93 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:40.732154 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64f8a190-6f02-4744-827d-1bcc3312ae93 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:40.733174 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64f8a190-6f02-4744-827d-1bcc3312ae93 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:41.146139 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-a8d3eae5-4be8-44a4-910f-8f5e54db8f6a req-d0e73ca0-c9a5-42f3-b06e-8a2142d63582 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f573d46e-77d2-4405-baef-2bb447d4b5e7", "tag": "1a81eb96-6bc8-4bfb-8326-14785f0a363d"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:30:41.176802 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a8d3eae5-4be8-44a4-910f-8f5e54db8f6a req-d0e73ca0-c9a5-42f3-b06e-8a2142d63582 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:41.177699 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a8d3eae5-4be8-44a4-910f-8f5e54db8f6a req-d0e73ca0-c9a5-42f3-b06e-8a2142d63582 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:41.178376 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a8d3eae5-4be8-44a4-910f-8f5e54db8f6a req-d0e73ca0-c9a5-42f3-b06e-8a2142d63582 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:41.198561 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-a8d3eae5-4be8-44a4-910f-8f5e54db8f6a req-d0e73ca0-c9a5-42f3-b06e-8a2142d63582 service nova] Creating event network-changed:1a81eb96-6bc8-4bfb-8326-14785f0a363d for instance f573d46e-77d2-4405-baef-2bb447d4b5e7 on n-h1-862686-1 Oct 26 13:30:41.204839 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-a8d3eae5-4be8-44a4-910f-8f5e54db8f6a req-d0e73ca0-c9a5-42f3-b06e-8a2142d63582 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062495 Oct 26 13:30:41.206385 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2747/5521] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:30:41.413760 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-64f8a190-6f02-4744-827d-1bcc3312ae93 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:30:41.424585 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-64f8a190-6f02-4744-827d-1bcc3312ae93 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1519 microversion: 2.1 time: 0.756740 Oct 26 13:30:41.429352 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2775/5522] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:30:40 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1519 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:30:42.026879 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7740bcea-0a22-436f-b571-e571a1c6ab03 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:42.027961 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7740bcea-0a22-436f-b571-e571a1c6ab03 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:30:42.051754 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7740bcea-0a22-436f-b571-e571a1c6ab03 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:42.052272 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7740bcea-0a22-436f-b571-e571a1c6ab03 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:42.052723 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7740bcea-0a22-436f-b571-e571a1c6ab03 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:42.053444 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7740bcea-0a22-436f-b571-e571a1c6ab03 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:42.064104 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7740bcea-0a22-436f-b571-e571a1c6ab03 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:42.069595 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7740bcea-0a22-436f-b571-e571a1c6ab03 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:42.450918 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-73d38292-0766-4769-bd31-6c24784c3d4f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:42.452258 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-73d38292-0766-4769-bd31-6c24784c3d4f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:30:42.469049 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73d38292-0766-4769-bd31-6c24784c3d4f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:42.469777 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73d38292-0766-4769-bd31-6c24784c3d4f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:42.470378 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73d38292-0766-4769-bd31-6c24784c3d4f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:42.475927 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73d38292-0766-4769-bd31-6c24784c3d4f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:42.481859 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73d38292-0766-4769-bd31-6c24784c3d4f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:42.482565 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73d38292-0766-4769-bd31-6c24784c3d4f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:43.147961 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-73d38292-0766-4769-bd31-6c24784c3d4f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:30:43.162233 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-73d38292-0766-4769-bd31-6c24784c3d4f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1519 microversion: 2.1 time: 0.715485 Oct 26 13:30:43.164828 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2776/5523] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:30:42 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1519 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:30:43.249595 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7740bcea-0a22-436f-b571-e571a1c6ab03 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:30:43.258894 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7740bcea-0a22-436f-b571-e571a1c6ab03 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 1.237455 Oct 26 13:30:43.259490 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2748/5524] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:30:42 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:30:43.288942 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-39f34011-3a7a-47e2-8a76-f0ea0666c5a3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:43.291828 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-39f34011-3a7a-47e2-8a76-f0ea0666c5a3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:30:43.312293 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39f34011-3a7a-47e2-8a76-f0ea0666c5a3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:43.314042 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39f34011-3a7a-47e2-8a76-f0ea0666c5a3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:43.317111 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39f34011-3a7a-47e2-8a76-f0ea0666c5a3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:43.322253 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39f34011-3a7a-47e2-8a76-f0ea0666c5a3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:43.325833 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39f34011-3a7a-47e2-8a76-f0ea0666c5a3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:43.326445 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39f34011-3a7a-47e2-8a76-f0ea0666c5a3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:44.032928 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c1842d0b-d189-4d79-acd7-30552e0e9c0f tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Action: 'create', calling method: .version_select at 0x7f67314e8310>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-697462233", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcwIdNs3uF0Be/zF9fd8NXtM3dWH6vj3WiCFFb4eYb/jfEtTNiMjp97lUGbChvEyemrZaSm4VPa6uFjgavY9QFabUCzXoa6s7rgYOhFtnkW/gvQZuJTBhO+M9bcWKTcQA=="}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:30:44.104149 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-c1842d0b-d189-4d79-acd7-30552e0e9c0f tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Getting quotas for project b6d89db2ac0141d694e64f474244e527. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:30:44.115091 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-c1842d0b-d189-4d79-acd7-30552e0e9c0f tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Getting quotas for user 8f745ae4d44f4cdebb40e233b0deed7a and project b6d89db2ac0141d694e64f474244e527. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:30:44.129069 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-39f34011-3a7a-47e2-8a76-f0ea0666c5a3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:30:44.138033 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-39f34011-3a7a-47e2-8a76-f0ea0666c5a3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 0.853157 Oct 26 13:30:44.138632 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2777/5525] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:30:43 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:30:44.172271 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5db07a37-1569-4d26-874e-4a322b7104a5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:44.178308 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5db07a37-1569-4d26-874e-4a322b7104a5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:30:44.178494 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c1842d0b-d189-4d79-acd7-30552e0e9c0f tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.783801 Oct 26 13:30:44.184144 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2749/5526] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 13:30:43 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:30:44.205144 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5db07a37-1569-4d26-874e-4a322b7104a5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:44.205679 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5db07a37-1569-4d26-874e-4a322b7104a5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:44.206118 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5db07a37-1569-4d26-874e-4a322b7104a5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:44.207581 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9d4696b3-fd46-46f3-b048-56d0d11a2424 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:44.215938 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5db07a37-1569-4d26-874e-4a322b7104a5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:44.216440 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5db07a37-1569-4d26-874e-4a322b7104a5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:44.216631 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9d4696b3-fd46-46f3-b048-56d0d11a2424 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:30:44.216882 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5db07a37-1569-4d26-874e-4a322b7104a5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:44.251404 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9d4696b3-fd46-46f3-b048-56d0d11a2424 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:44.255167 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9d4696b3-fd46-46f3-b048-56d0d11a2424 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:44.257753 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9d4696b3-fd46-46f3-b048-56d0d11a2424 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:44.262279 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9d4696b3-fd46-46f3-b048-56d0d11a2424 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:44.262956 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9d4696b3-fd46-46f3-b048-56d0d11a2424 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:44.264364 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9d4696b3-fd46-46f3-b048-56d0d11a2424 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:45.130375 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9d4696b3-fd46-46f3-b048-56d0d11a2424 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:30:45.151579 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5db07a37-1569-4d26-874e-4a322b7104a5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:30:45.155402 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9d4696b3-fd46-46f3-b048-56d0d11a2424 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1519 microversion: 2.1 time: 0.956299 Oct 26 13:30:45.164588 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2750/5527] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:30:44 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1519 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:30:45.187254 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5db07a37-1569-4d26-874e-4a322b7104a5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 1.018866 Oct 26 13:30:45.189816 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2778/5528] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:30:44 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:30:45.218155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-36cb7ee2-d9b9-4393-9850-7a3d345f8399 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:45.219714 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-36cb7ee2-d9b9-4393-9850-7a3d345f8399 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:30:45.252330 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-36cb7ee2-d9b9-4393-9850-7a3d345f8399 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:45.261680 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-36cb7ee2-d9b9-4393-9850-7a3d345f8399 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:45.264932 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-36cb7ee2-d9b9-4393-9850-7a3d345f8399 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:45.266247 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-36cb7ee2-d9b9-4393-9850-7a3d345f8399 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:45.271121 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-36cb7ee2-d9b9-4393-9850-7a3d345f8399 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:45.271837 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-36cb7ee2-d9b9-4393-9850-7a3d345f8399 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:46.212509 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0068f80e-703f-43c9-8a51-1ab258996d47 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:46.216762 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0068f80e-703f-43c9-8a51-1ab258996d47 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:30:46.268704 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0068f80e-703f-43c9-8a51-1ab258996d47 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:46.268704 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0068f80e-703f-43c9-8a51-1ab258996d47 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:46.269401 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0068f80e-703f-43c9-8a51-1ab258996d47 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:46.273312 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0068f80e-703f-43c9-8a51-1ab258996d47 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:46.275897 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0068f80e-703f-43c9-8a51-1ab258996d47 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:46.279028 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0068f80e-703f-43c9-8a51-1ab258996d47 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:46.321154 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-36cb7ee2-d9b9-4393-9850-7a3d345f8399 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:30:46.334727 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-36cb7ee2-d9b9-4393-9850-7a3d345f8399 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 1.120453 Oct 26 13:30:46.338873 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2751/5529] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:30:45 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:30:46.786517 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-185524f6-b962-46ad-a5c8-bbbae08a675f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-665733187", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "52e622a6-1003-4403-bde9-f622c42344c6"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:30:47.226085 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-185524f6-b962-46ad-a5c8-bbbae08a675f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] validate_networks() for [('52e622a6-1003-4403-bde9-f622c42344c6', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:30:48.027913 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0068f80e-703f-43c9-8a51-1ab258996d47 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:30:48.062570 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0068f80e-703f-43c9-8a51-1ab258996d47 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1519 microversion: 2.1 time: 1.877091 Oct 26 13:30:48.068410 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2779/5530] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:30:46 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1519 bytes in 1885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:30:49.095119 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-83d83454-d6cb-4789-9e5b-c62a660b7db5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:49.096382 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-83d83454-d6cb-4789-9e5b-c62a660b7db5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:30:49.119727 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83d83454-d6cb-4789-9e5b-c62a660b7db5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:49.122351 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83d83454-d6cb-4789-9e5b-c62a660b7db5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:49.124204 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83d83454-d6cb-4789-9e5b-c62a660b7db5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:49.125465 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83d83454-d6cb-4789-9e5b-c62a660b7db5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:49.130370 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83d83454-d6cb-4789-9e5b-c62a660b7db5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:49.133162 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83d83454-d6cb-4789-9e5b-c62a660b7db5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:49.994109 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-83d83454-d6cb-4789-9e5b-c62a660b7db5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:30:50.008248 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-83d83454-d6cb-4789-9e5b-c62a660b7db5 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1519 microversion: 2.1 time: 0.918977 Oct 26 13:30:50.012253 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2780/5531] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:30:49 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1519 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:30:50.094962 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-185524f6-b962-46ad-a5c8-bbbae08a675f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:30:50.096455 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-185524f6-b962-46ad-a5c8-bbbae08a675f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:30:50.097236 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-185524f6-b962-46ad-a5c8-bbbae08a675f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:30:50.097950 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-185524f6-b962-46ad-a5c8-bbbae08a675f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:30:50.098671 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-185524f6-b962-46ad-a5c8-bbbae08a675f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:30:50.128226 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-185524f6-b962-46ad-a5c8-bbbae08a675f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:50.129120 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-185524f6-b962-46ad-a5c8-bbbae08a675f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:50.129982 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-185524f6-b962-46ad-a5c8-bbbae08a675f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:50.133346 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-185524f6-b962-46ad-a5c8-bbbae08a675f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:50.142202 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-185524f6-b962-46ad-a5c8-bbbae08a675f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:50.142871 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-185524f6-b962-46ad-a5c8-bbbae08a675f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:50.218931 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-185524f6-b962-46ad-a5c8-bbbae08a675f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Getting quotas for project c0d1b1d2fe374ee5806eeee18712219f. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:30:50.238736 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-185524f6-b962-46ad-a5c8-bbbae08a675f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Getting quotas for user 3e9ff5a884f1416886f26a80c5b87b18 and project c0d1b1d2fe374ee5806eeee18712219f. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:30:50.296990 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-185524f6-b962-46ad-a5c8-bbbae08a675f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:30:50.299526 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-185524f6-b962-46ad-a5c8-bbbae08a675f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 6df56119-b567-427a-87c9-8f45f9e32700] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:30:50.451510 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-185524f6-b962-46ad-a5c8-bbbae08a675f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.664591 Oct 26 13:30:50.454909 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2752/5532] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:30:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 3673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:30:50.464717 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-67672f27-7452-4668-b3ff-f0521563a361 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:50.466232 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-67672f27-7452-4668-b3ff-f0521563a361 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 6df56119-b567-427a-87c9-8f45f9e32700] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:30:50.848890 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-67672f27-7452-4668-b3ff-f0521563a361 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:30:50.861731 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-67672f27-7452-4668-b3ff-f0521563a361 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700" status: 200 len: 1214 microversion: 2.1 time: 0.401408 Oct 26 13:30:50.876662 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2781/5533] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:30:50 2022] GET /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700 => generated 1214 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:30:51.037094 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d8919019-d357-457b-a4ea-80b700f69787 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:51.038859 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d8919019-d357-457b-a4ea-80b700f69787 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:30:51.055092 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8919019-d357-457b-a4ea-80b700f69787 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:51.056271 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8919019-d357-457b-a4ea-80b700f69787 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:51.057852 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8919019-d357-457b-a4ea-80b700f69787 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:51.058897 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8919019-d357-457b-a4ea-80b700f69787 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:51.059514 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8919019-d357-457b-a4ea-80b700f69787 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:51.060153 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8919019-d357-457b-a4ea-80b700f69787 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:51.906184 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d8919019-d357-457b-a4ea-80b700f69787 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:30:51.908465 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9a9612ee-f3ae-46d2-b6ea-8da93a841e62 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:51.910483 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9a9612ee-f3ae-46d2-b6ea-8da93a841e62 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 6df56119-b567-427a-87c9-8f45f9e32700] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:30:51.915744 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d8919019-d357-457b-a4ea-80b700f69787 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1519 microversion: 2.1 time: 0.882715 Oct 26 13:30:51.939175 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2753/5534] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:30:51 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1519 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:30:52.123588 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9a9612ee-f3ae-46d2-b6ea-8da93a841e62 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:30:52.144942 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9a9612ee-f3ae-46d2-b6ea-8da93a841e62 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700" status: 200 len: 1214 microversion: 2.1 time: 0.241353 Oct 26 13:30:52.147710 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2782/5535] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:30:51 2022] GET /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700 => generated 1214 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:30:52.948911 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-12ab6a03-8129-4918-8909-b6230cc880e8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:52.949608 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-12ab6a03-8129-4918-8909-b6230cc880e8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:30:52.966084 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-12ab6a03-8129-4918-8909-b6230cc880e8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:52.968895 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-12ab6a03-8129-4918-8909-b6230cc880e8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:52.969400 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-12ab6a03-8129-4918-8909-b6230cc880e8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:52.972648 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-12ab6a03-8129-4918-8909-b6230cc880e8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:52.973983 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-12ab6a03-8129-4918-8909-b6230cc880e8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:52.975668 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-12ab6a03-8129-4918-8909-b6230cc880e8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:53.180776 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ef67c0cd-5ad1-4495-a06e-1bd5551a4091 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:53.181818 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ef67c0cd-5ad1-4495-a06e-1bd5551a4091 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 6df56119-b567-427a-87c9-8f45f9e32700] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:30:53.207746 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef67c0cd-5ad1-4495-a06e-1bd5551a4091 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:53.216820 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef67c0cd-5ad1-4495-a06e-1bd5551a4091 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:53.218199 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef67c0cd-5ad1-4495-a06e-1bd5551a4091 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:53.221188 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef67c0cd-5ad1-4495-a06e-1bd5551a4091 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:53.227599 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef67c0cd-5ad1-4495-a06e-1bd5551a4091 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:53.230251 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef67c0cd-5ad1-4495-a06e-1bd5551a4091 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:53.604599 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ef67c0cd-5ad1-4495-a06e-1bd5551a4091 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:30:53.613619 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ef67c0cd-5ad1-4495-a06e-1bd5551a4091 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700" status: 200 len: 1218 microversion: 2.1 time: 0.440742 Oct 26 13:30:53.625859 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2783/5536] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:30:53 2022] GET /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700 => generated 1218 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:30:54.280536 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-12ab6a03-8129-4918-8909-b6230cc880e8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:30:54.290868 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-12ab6a03-8129-4918-8909-b6230cc880e8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1519 microversion: 2.1 time: 1.347379 Oct 26 13:30:54.305599 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2754/5537] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:30:52 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1519 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:30:54.645174 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-05f70eac-07b2-4a80-94b1-83967c19c587 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:54.645851 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-05f70eac-07b2-4a80-94b1-83967c19c587 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 6df56119-b567-427a-87c9-8f45f9e32700] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:30:54.649270 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:30:54.684064 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05f70eac-07b2-4a80-94b1-83967c19c587 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:54.685843 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05f70eac-07b2-4a80-94b1-83967c19c587 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:54.687052 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05f70eac-07b2-4a80-94b1-83967c19c587 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:54.693422 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05f70eac-07b2-4a80-94b1-83967c19c587 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:54.694376 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05f70eac-07b2-4a80-94b1-83967c19c587 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:54.697180 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05f70eac-07b2-4a80-94b1-83967c19c587 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:55.267888 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-05f70eac-07b2-4a80-94b1-83967c19c587 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:30:55.277500 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-05f70eac-07b2-4a80-94b1-83967c19c587 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700" status: 200 len: 1266 microversion: 2.1 time: 0.636901 Oct 26 13:30:55.285654 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2784/5538] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:30:54 2022] GET /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700 => generated 1266 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:30:55.325349 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9996b495-5315-467b-8f38-b6015628b4e3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:55.326786 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9996b495-5315-467b-8f38-b6015628b4e3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:30:55.330641 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=4 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:30:55.350143 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9996b495-5315-467b-8f38-b6015628b4e3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:55.351301 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9996b495-5315-467b-8f38-b6015628b4e3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:55.352105 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9996b495-5315-467b-8f38-b6015628b4e3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:55.358764 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9996b495-5315-467b-8f38-b6015628b4e3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:55.359858 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9996b495-5315-467b-8f38-b6015628b4e3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:55.361660 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9996b495-5315-467b-8f38-b6015628b4e3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:56.309913 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-025383c3-ca44-4d36-80d4-096b7c2847d0 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:56.327352 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-025383c3-ca44-4d36-80d4-096b7c2847d0 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 6df56119-b567-427a-87c9-8f45f9e32700] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:30:56.360547 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-025383c3-ca44-4d36-80d4-096b7c2847d0 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:56.362968 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-025383c3-ca44-4d36-80d4-096b7c2847d0 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:56.363645 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-025383c3-ca44-4d36-80d4-096b7c2847d0 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:56.366891 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-025383c3-ca44-4d36-80d4-096b7c2847d0 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:56.378499 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-025383c3-ca44-4d36-80d4-096b7c2847d0 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:56.386342 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-025383c3-ca44-4d36-80d4-096b7c2847d0 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:56.725183 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-025383c3-ca44-4d36-80d4-096b7c2847d0 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:30:56.740229 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-025383c3-ca44-4d36-80d4-096b7c2847d0 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700" status: 200 len: 1272 microversion: 2.1 time: 0.434199 Oct 26 13:30:56.744330 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2785/5539] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:30:56 2022] GET /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700 => generated 1272 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:30:57.333781 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9996b495-5315-467b-8f38-b6015628b4e3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:30:57.357292 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9996b495-5315-467b-8f38-b6015628b4e3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1519 microversion: 2.1 time: 2.035458 Oct 26 13:30:57.359792 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2755/5540] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:30:55 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1519 bytes in 2039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:30:57.773423 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-dd8f8092-241e-403e-8573-e086566ece63 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:57.774840 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-dd8f8092-241e-403e-8573-e086566ece63 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 6df56119-b567-427a-87c9-8f45f9e32700] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:30:57.789200 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dd8f8092-241e-403e-8573-e086566ece63 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:57.794066 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dd8f8092-241e-403e-8573-e086566ece63 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:57.797070 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dd8f8092-241e-403e-8573-e086566ece63 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:57.798526 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dd8f8092-241e-403e-8573-e086566ece63 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:57.799495 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dd8f8092-241e-403e-8573-e086566ece63 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:57.800584 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dd8f8092-241e-403e-8573-e086566ece63 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:58.062080 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-dd8f8092-241e-403e-8573-e086566ece63 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:30:58.090029 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-dd8f8092-241e-403e-8573-e086566ece63 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700" status: 200 len: 1272 microversion: 2.1 time: 0.321393 Oct 26 13:30:58.108238 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2786/5541] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:30:57 2022] GET /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700 => generated 1272 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:30:58.387415 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ff4b79f9-f1c3-46d0-9d6d-b2a587325cee tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:58.388420 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ff4b79f9-f1c3-46d0-9d6d-b2a587325cee tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:30:58.418267 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff4b79f9-f1c3-46d0-9d6d-b2a587325cee tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:58.418762 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff4b79f9-f1c3-46d0-9d6d-b2a587325cee tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:58.419403 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff4b79f9-f1c3-46d0-9d6d-b2a587325cee tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:58.420281 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff4b79f9-f1c3-46d0-9d6d-b2a587325cee tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:58.420890 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff4b79f9-f1c3-46d0-9d6d-b2a587325cee tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:58.424267 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff4b79f9-f1c3-46d0-9d6d-b2a587325cee tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:59.128547 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9f2eed34-7e0b-4a69-a479-ab1aba2fb50c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:30:59.129941 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9f2eed34-7e0b-4a69-a479-ab1aba2fb50c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 6df56119-b567-427a-87c9-8f45f9e32700] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:30:59.140509 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9f2eed34-7e0b-4a69-a479-ab1aba2fb50c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:59.148047 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9f2eed34-7e0b-4a69-a479-ab1aba2fb50c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:59.148904 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9f2eed34-7e0b-4a69-a479-ab1aba2fb50c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:59.150159 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9f2eed34-7e0b-4a69-a479-ab1aba2fb50c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:30:59.151633 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9f2eed34-7e0b-4a69-a479-ab1aba2fb50c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:30:59.152453 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9f2eed34-7e0b-4a69-a479-ab1aba2fb50c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:30:59.535018 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ff4b79f9-f1c3-46d0-9d6d-b2a587325cee tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:30:59.558060 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ff4b79f9-f1c3-46d0-9d6d-b2a587325cee tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1519 microversion: 2.1 time: 1.173418 Oct 26 13:30:59.561204 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2756/5542] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:30:58 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1519 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:30:59.582002 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9f2eed34-7e0b-4a69-a479-ab1aba2fb50c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:30:59.599632 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9f2eed34-7e0b-4a69-a479-ab1aba2fb50c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700" status: 200 len: 1272 microversion: 2.1 time: 0.467353 Oct 26 13:30:59.610574 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2787/5543] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:30:59 2022] GET /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700 => generated 1272 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:00.581164 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:31:00.583937 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=10 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:31:00.600308 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-73dfcc91-d2cb-4bd3-847e-4132e87cf004 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:00.605019 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-73dfcc91-d2cb-4bd3-847e-4132e87cf004 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:00.621188 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73dfcc91-d2cb-4bd3-847e-4132e87cf004 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:00.622068 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73dfcc91-d2cb-4bd3-847e-4132e87cf004 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:00.622510 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73dfcc91-d2cb-4bd3-847e-4132e87cf004 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:00.626246 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73dfcc91-d2cb-4bd3-847e-4132e87cf004 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:00.628747 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73dfcc91-d2cb-4bd3-847e-4132e87cf004 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:00.632403 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73dfcc91-d2cb-4bd3-847e-4132e87cf004 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:00.637904 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3c653dac-9d65-455f-aa0f-77a9a164df84 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:00.638794 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3c653dac-9d65-455f-aa0f-77a9a164df84 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 6df56119-b567-427a-87c9-8f45f9e32700] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:00.669181 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c653dac-9d65-455f-aa0f-77a9a164df84 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:00.676230 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c653dac-9d65-455f-aa0f-77a9a164df84 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:00.682687 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c653dac-9d65-455f-aa0f-77a9a164df84 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:00.684066 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c653dac-9d65-455f-aa0f-77a9a164df84 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:00.688847 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c653dac-9d65-455f-aa0f-77a9a164df84 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:00.689639 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c653dac-9d65-455f-aa0f-77a9a164df84 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:01.131428 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3c653dac-9d65-455f-aa0f-77a9a164df84 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:01.140485 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3c653dac-9d65-455f-aa0f-77a9a164df84 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700" status: 200 len: 1314 microversion: 2.1 time: 0.507805 Oct 26 13:31:01.145207 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2788/5544] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:00 2022] GET /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700 => generated 1314 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:01.289886 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-73dfcc91-d2cb-4bd3-847e-4132e87cf004 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:01.302930 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-73dfcc91-d2cb-4bd3-847e-4132e87cf004 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1519 microversion: 2.1 time: 0.722371 Oct 26 13:31:01.303903 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2757/5545] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:00 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1519 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:02.165571 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f8fd8a84-9aa1-4207-aace-041abbbf61ce tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:02.168982 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f8fd8a84-9aa1-4207-aace-041abbbf61ce tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 6df56119-b567-427a-87c9-8f45f9e32700] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:02.189343 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=4 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:31:02.195578 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8fd8a84-9aa1-4207-aace-041abbbf61ce tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:02.196126 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8fd8a84-9aa1-4207-aace-041abbbf61ce tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:02.204584 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8fd8a84-9aa1-4207-aace-041abbbf61ce tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:02.205472 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8fd8a84-9aa1-4207-aace-041abbbf61ce tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:02.205989 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8fd8a84-9aa1-4207-aace-041abbbf61ce tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:02.206429 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8fd8a84-9aa1-4207-aace-041abbbf61ce tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:02.327880 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ca13ee8f-b4b2-4d8f-ac6f-2717e64b7b8a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:02.328666 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ca13ee8f-b4b2-4d8f-ac6f-2717e64b7b8a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:02.350811 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ca13ee8f-b4b2-4d8f-ac6f-2717e64b7b8a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:02.352422 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ca13ee8f-b4b2-4d8f-ac6f-2717e64b7b8a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:02.354765 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ca13ee8f-b4b2-4d8f-ac6f-2717e64b7b8a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:02.357746 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ca13ee8f-b4b2-4d8f-ac6f-2717e64b7b8a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:02.358849 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ca13ee8f-b4b2-4d8f-ac6f-2717e64b7b8a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:02.363548 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ca13ee8f-b4b2-4d8f-ac6f-2717e64b7b8a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:02.802383 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f8fd8a84-9aa1-4207-aace-041abbbf61ce tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:02.833338 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f8fd8a84-9aa1-4207-aace-041abbbf61ce tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700" status: 200 len: 1314 microversion: 2.1 time: 0.667884 Oct 26 13:31:02.835900 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2789/5546] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:02 2022] GET /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700 => generated 1314 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:03.577790 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ca13ee8f-b4b2-4d8f-ac6f-2717e64b7b8a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:03.589650 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ca13ee8f-b4b2-4d8f-ac6f-2717e64b7b8a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1519 microversion: 2.1 time: 1.266202 Oct 26 13:31:03.598952 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2758/5547] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:02 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1519 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:31:03.818458 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-3d15d6c1-a22f-4977-8951-8f962da75801 req-f8b71ec4-3531-413e-814a-63a4c57befea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6df56119-b567-427a-87c9-8f45f9e32700", "tag": "57bfad88-da94-4b1c-a21b-23e9d4ee8b85"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:31:03.841741 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-3d15d6c1-a22f-4977-8951-8f962da75801 req-f8b71ec4-3531-413e-814a-63a4c57befea service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:03.842220 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-3d15d6c1-a22f-4977-8951-8f962da75801 req-f8b71ec4-3531-413e-814a-63a4c57befea service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:03.845359 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-3d15d6c1-a22f-4977-8951-8f962da75801 req-f8b71ec4-3531-413e-814a-63a4c57befea service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:03.865811 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-702a44ed-e602-4a65-8d5f-198e1c674988 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:03.866443 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-702a44ed-e602-4a65-8d5f-198e1c674988 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 6df56119-b567-427a-87c9-8f45f9e32700] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:03.886717 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-702a44ed-e602-4a65-8d5f-198e1c674988 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:03.887569 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-702a44ed-e602-4a65-8d5f-198e1c674988 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:03.888025 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-702a44ed-e602-4a65-8d5f-198e1c674988 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:03.895580 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-702a44ed-e602-4a65-8d5f-198e1c674988 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:03.896075 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-702a44ed-e602-4a65-8d5f-198e1c674988 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:03.896761 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-702a44ed-e602-4a65-8d5f-198e1c674988 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:03.899248 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-3d15d6c1-a22f-4977-8951-8f962da75801 req-f8b71ec4-3531-413e-814a-63a4c57befea service nova] Creating event network-changed:57bfad88-da94-4b1c-a21b-23e9d4ee8b85 for instance 6df56119-b567-427a-87c9-8f45f9e32700 on n-h1-862686-1 Oct 26 13:31:03.923348 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-3d15d6c1-a22f-4977-8951-8f962da75801 req-f8b71ec4-3531-413e-814a-63a4c57befea service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110404 Oct 26 13:31:03.923973 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2790/5548] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:31:04.509265 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-702a44ed-e602-4a65-8d5f-198e1c674988 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:04.522124 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-702a44ed-e602-4a65-8d5f-198e1c674988 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700" status: 200 len: 1314 microversion: 2.1 time: 0.664701 Oct 26 13:31:04.526270 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2759/5549] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:03 2022] GET /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700 => generated 1314 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:04.626232 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ca1f71d5-23f3-4eb1-90a9-9b3383a7d89c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:04.627450 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ca1f71d5-23f3-4eb1-90a9-9b3383a7d89c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:04.650940 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca1f71d5-23f3-4eb1-90a9-9b3383a7d89c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:04.656652 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca1f71d5-23f3-4eb1-90a9-9b3383a7d89c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:04.657318 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca1f71d5-23f3-4eb1-90a9-9b3383a7d89c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:04.659394 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca1f71d5-23f3-4eb1-90a9-9b3383a7d89c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:04.660050 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca1f71d5-23f3-4eb1-90a9-9b3383a7d89c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:04.662096 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca1f71d5-23f3-4eb1-90a9-9b3383a7d89c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:05.309595 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ca1f71d5-23f3-4eb1-90a9-9b3383a7d89c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:05.320929 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ca1f71d5-23f3-4eb1-90a9-9b3383a7d89c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1519 microversion: 2.1 time: 0.699354 Oct 26 13:31:05.328937 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2791/5550] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:04 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1519 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:05.550991 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a7d6b826-37cb-47b6-b2fd-d14bfa9d12dd tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:05.552889 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a7d6b826-37cb-47b6-b2fd-d14bfa9d12dd tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 6df56119-b567-427a-87c9-8f45f9e32700] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:05.584303 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7d6b826-37cb-47b6-b2fd-d14bfa9d12dd tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:05.589546 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7d6b826-37cb-47b6-b2fd-d14bfa9d12dd tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:05.590112 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7d6b826-37cb-47b6-b2fd-d14bfa9d12dd tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:05.597122 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7d6b826-37cb-47b6-b2fd-d14bfa9d12dd tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:05.598272 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7d6b826-37cb-47b6-b2fd-d14bfa9d12dd tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:05.599861 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7d6b826-37cb-47b6-b2fd-d14bfa9d12dd tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:05.681010 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=72 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:31:05.908422 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a7d6b826-37cb-47b6-b2fd-d14bfa9d12dd tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:05.920205 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a7d6b826-37cb-47b6-b2fd-d14bfa9d12dd tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700" status: 200 len: 1314 microversion: 2.1 time: 0.374411 Oct 26 13:31:05.923144 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2760/5551] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:05 2022] GET /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700 => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:06.358471 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ee226be3-7712-4095-9dd2-7720e106309c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:06.358471 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ee226be3-7712-4095-9dd2-7720e106309c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:06.368786 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee226be3-7712-4095-9dd2-7720e106309c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:06.371562 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee226be3-7712-4095-9dd2-7720e106309c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:06.373393 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee226be3-7712-4095-9dd2-7720e106309c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:06.374319 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee226be3-7712-4095-9dd2-7720e106309c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:06.379963 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee226be3-7712-4095-9dd2-7720e106309c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:06.380607 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee226be3-7712-4095-9dd2-7720e106309c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:06.438293 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=92 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:31:06.446387 n-d-862686-1 devstack@n-api.service[120598]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 13:31:06.446924 n-d-862686-1 devstack@n-api.service[120598]: Wed Oct 26 13:31:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 (ip 10.222.0.40) !!! Oct 26 13:31:06.944022 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-929fe158-fb1d-4395-9099-896ffb7af081 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:06.944663 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-929fe158-fb1d-4395-9099-896ffb7af081 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 6df56119-b567-427a-87c9-8f45f9e32700] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:06.968411 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-929fe158-fb1d-4395-9099-896ffb7af081 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:06.972561 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-929fe158-fb1d-4395-9099-896ffb7af081 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:06.973303 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-929fe158-fb1d-4395-9099-896ffb7af081 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:06.975280 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-929fe158-fb1d-4395-9099-896ffb7af081 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:06.979590 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-929fe158-fb1d-4395-9099-896ffb7af081 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:07.001298 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-929fe158-fb1d-4395-9099-896ffb7af081 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:07.003100 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ee226be3-7712-4095-9dd2-7720e106309c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:07.016408 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ee226be3-7712-4095-9dd2-7720e106309c tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1519 microversion: 2.1 time: 0.660247 Oct 26 13:31:07.018770 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2792/5552] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:06 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1519 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:07.895820 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-929fe158-fb1d-4395-9099-896ffb7af081 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:07.914984 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-929fe158-fb1d-4395-9099-896ffb7af081 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700" status: 200 len: 1314 microversion: 2.1 time: 0.967894 Oct 26 13:31:07.916404 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2761/5553] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:06 2022] GET /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700 => generated 1314 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:08.046972 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-070b34a2-2b2e-4df0-a77b-567bef490e5b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:08.048453 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-070b34a2-2b2e-4df0-a77b-567bef490e5b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:08.067571 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-070b34a2-2b2e-4df0-a77b-567bef490e5b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:08.068275 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-070b34a2-2b2e-4df0-a77b-567bef490e5b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:08.068821 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-070b34a2-2b2e-4df0-a77b-567bef490e5b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:08.069844 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-070b34a2-2b2e-4df0-a77b-567bef490e5b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:08.070858 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-070b34a2-2b2e-4df0-a77b-567bef490e5b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:08.071413 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-070b34a2-2b2e-4df0-a77b-567bef490e5b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:08.699711 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-070b34a2-2b2e-4df0-a77b-567bef490e5b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:08.727099 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-070b34a2-2b2e-4df0-a77b-567bef490e5b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1519 microversion: 2.1 time: 0.675695 Oct 26 13:31:08.729183 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-ca3b17c7-f2f2-42d0-b7ad-e03133388097 req-4f8e70e6-732e-4f2e-9dea-a2413832e2ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f573d46e-77d2-4405-baef-2bb447d4b5e7", "name": "network-vif-plugged", "status": "completed", "tag": "1a81eb96-6bc8-4bfb-8326-14785f0a363d"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:31:08.748066 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2793/5554] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:08 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1519 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:08.761693 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ca3b17c7-f2f2-42d0-b7ad-e03133388097 req-4f8e70e6-732e-4f2e-9dea-a2413832e2ce service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:08.762238 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ca3b17c7-f2f2-42d0-b7ad-e03133388097 req-4f8e70e6-732e-4f2e-9dea-a2413832e2ce service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:08.767206 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ca3b17c7-f2f2-42d0-b7ad-e03133388097 req-4f8e70e6-732e-4f2e-9dea-a2413832e2ce service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:08.800180 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-ca3b17c7-f2f2-42d0-b7ad-e03133388097 req-4f8e70e6-732e-4f2e-9dea-a2413832e2ce service nova] Creating event network-vif-plugged:1a81eb96-6bc8-4bfb-8326-14785f0a363d for instance f573d46e-77d2-4405-baef-2bb447d4b5e7 on n-h1-862686-1 Oct 26 13:31:08.812013 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-ca3b17c7-f2f2-42d0-b7ad-e03133388097 req-4f8e70e6-732e-4f2e-9dea-a2413832e2ce service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087258 Oct 26 13:31:08.814755 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2762/5555] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:31:08.945229 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1b2d49d9-502c-4e7c-8c33-4412ae3fdb53 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:08.945820 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1b2d49d9-502c-4e7c-8c33-4412ae3fdb53 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 6df56119-b567-427a-87c9-8f45f9e32700] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:08.966026 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b2d49d9-502c-4e7c-8c33-4412ae3fdb53 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:08.966679 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b2d49d9-502c-4e7c-8c33-4412ae3fdb53 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:08.967153 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b2d49d9-502c-4e7c-8c33-4412ae3fdb53 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:08.967918 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b2d49d9-502c-4e7c-8c33-4412ae3fdb53 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:08.968386 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b2d49d9-502c-4e7c-8c33-4412ae3fdb53 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:08.984258 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b2d49d9-502c-4e7c-8c33-4412ae3fdb53 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:09.730713 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1b2d49d9-502c-4e7c-8c33-4412ae3fdb53 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:09.763911 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6c7db712-640e-40fe-9672-72f6e75ba45e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:09.765221 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6c7db712-640e-40fe-9672-72f6e75ba45e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:09.805559 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1b2d49d9-502c-4e7c-8c33-4412ae3fdb53 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700" status: 200 len: 1314 microversion: 2.1 time: 0.866277 Oct 26 13:31:09.806188 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2794/5556] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:08 2022] GET /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700 => generated 1314 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:09.812109 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6c7db712-640e-40fe-9672-72f6e75ba45e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:09.812621 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6c7db712-640e-40fe-9672-72f6e75ba45e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:09.813061 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6c7db712-640e-40fe-9672-72f6e75ba45e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:09.830439 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6c7db712-640e-40fe-9672-72f6e75ba45e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:09.830977 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6c7db712-640e-40fe-9672-72f6e75ba45e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:09.831438 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6c7db712-640e-40fe-9672-72f6e75ba45e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:10.626568 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6c7db712-640e-40fe-9672-72f6e75ba45e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:10.642053 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6c7db712-640e-40fe-9672-72f6e75ba45e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1519 microversion: 2.1 time: 0.890668 Oct 26 13:31:10.647375 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2763/5557] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:09 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1519 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:31:10.832216 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8d6675b3-d459-4234-b936-c417320b6061 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:10.834099 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8d6675b3-d459-4234-b936-c417320b6061 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 6df56119-b567-427a-87c9-8f45f9e32700] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:10.848394 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d6675b3-d459-4234-b936-c417320b6061 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:10.858475 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d6675b3-d459-4234-b936-c417320b6061 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:10.859658 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d6675b3-d459-4234-b936-c417320b6061 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:10.860806 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d6675b3-d459-4234-b936-c417320b6061 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:10.862553 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d6675b3-d459-4234-b936-c417320b6061 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:10.863245 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d6675b3-d459-4234-b936-c417320b6061 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:11.339671 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8d6675b3-d459-4234-b936-c417320b6061 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:11.349476 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8d6675b3-d459-4234-b936-c417320b6061 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700" status: 200 len: 1314 microversion: 2.1 time: 0.524221 Oct 26 13:31:11.357167 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2795/5558] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:10 2022] GET /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700 => generated 1314 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:31:11.672693 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-11ac4959-27d5-4214-a0eb-1baa8826dcfa tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:11.673430 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-11ac4959-27d5-4214-a0eb-1baa8826dcfa tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:11.702934 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-11ac4959-27d5-4214-a0eb-1baa8826dcfa tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:11.705225 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-11ac4959-27d5-4214-a0eb-1baa8826dcfa tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:11.706581 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-11ac4959-27d5-4214-a0eb-1baa8826dcfa tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:11.713614 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-11ac4959-27d5-4214-a0eb-1baa8826dcfa tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:11.722370 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-11ac4959-27d5-4214-a0eb-1baa8826dcfa tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:11.730296 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-11ac4959-27d5-4214-a0eb-1baa8826dcfa tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:11.851968 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-7f10d9d7-5682-4ab0-8d9d-d61001e6a196 req-8ce2a9b0-6265-4e0f-957c-e57dfb00bfd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6df56119-b567-427a-87c9-8f45f9e32700", "name": "network-vif-plugged", "status": "completed", "tag": "57bfad88-da94-4b1c-a21b-23e9d4ee8b85"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:31:11.886136 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-7f10d9d7-5682-4ab0-8d9d-d61001e6a196 req-8ce2a9b0-6265-4e0f-957c-e57dfb00bfd5 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:11.889471 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-7f10d9d7-5682-4ab0-8d9d-d61001e6a196 req-8ce2a9b0-6265-4e0f-957c-e57dfb00bfd5 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:11.890735 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-7f10d9d7-5682-4ab0-8d9d-d61001e6a196 req-8ce2a9b0-6265-4e0f-957c-e57dfb00bfd5 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:11.931634 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-7f10d9d7-5682-4ab0-8d9d-d61001e6a196 req-8ce2a9b0-6265-4e0f-957c-e57dfb00bfd5 service nova] Creating event network-vif-plugged:57bfad88-da94-4b1c-a21b-23e9d4ee8b85 for instance 6df56119-b567-427a-87c9-8f45f9e32700 on n-h1-862686-1 Oct 26 13:31:11.950183 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-7f10d9d7-5682-4ab0-8d9d-d61001e6a196 req-8ce2a9b0-6265-4e0f-957c-e57dfb00bfd5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106505 Oct 26 13:31:11.959374 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2796/5559] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:31:12.380956 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2321f9e7-9e68-4356-92ad-7748c686532d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:12.383908 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2321f9e7-9e68-4356-92ad-7748c686532d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 6df56119-b567-427a-87c9-8f45f9e32700] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:12.408214 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2321f9e7-9e68-4356-92ad-7748c686532d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:12.413799 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2321f9e7-9e68-4356-92ad-7748c686532d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:12.416657 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2321f9e7-9e68-4356-92ad-7748c686532d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:12.417653 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2321f9e7-9e68-4356-92ad-7748c686532d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:12.418329 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2321f9e7-9e68-4356-92ad-7748c686532d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:12.418916 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2321f9e7-9e68-4356-92ad-7748c686532d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:12.942637 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2321f9e7-9e68-4356-92ad-7748c686532d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:12.955546 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2321f9e7-9e68-4356-92ad-7748c686532d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700" status: 200 len: 1314 microversion: 2.1 time: 0.578619 Oct 26 13:31:12.963551 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2797/5560] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:12 2022] GET /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700 => generated 1314 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:12.995588 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-11ac4959-27d5-4214-a0eb-1baa8826dcfa tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:13.004282 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-11ac4959-27d5-4214-a0eb-1baa8826dcfa tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1519 microversion: 2.1 time: 1.336945 Oct 26 13:31:13.005287 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2764/5561] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:11 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1519 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:31:13.981547 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e8fd4c9d-83c4-4bed-a35b-5d4edfa63e88 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:13.982068 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e8fd4c9d-83c4-4bed-a35b-5d4edfa63e88 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 6df56119-b567-427a-87c9-8f45f9e32700] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:14.008718 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e8fd4c9d-83c4-4bed-a35b-5d4edfa63e88 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:14.012428 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e8fd4c9d-83c4-4bed-a35b-5d4edfa63e88 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:14.013123 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e8fd4c9d-83c4-4bed-a35b-5d4edfa63e88 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:14.015310 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e8fd4c9d-83c4-4bed-a35b-5d4edfa63e88 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:14.018072 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e8fd4c9d-83c4-4bed-a35b-5d4edfa63e88 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:14.018664 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e8fd4c9d-83c4-4bed-a35b-5d4edfa63e88 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:14.035536 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8f73582a-69b3-48c4-b816-894609f25e15 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:14.036319 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8f73582a-69b3-48c4-b816-894609f25e15 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:14.051443 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8f73582a-69b3-48c4-b816-894609f25e15 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:14.052156 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8f73582a-69b3-48c4-b816-894609f25e15 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:14.054504 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8f73582a-69b3-48c4-b816-894609f25e15 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:14.056906 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8f73582a-69b3-48c4-b816-894609f25e15 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:14.058177 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8f73582a-69b3-48c4-b816-894609f25e15 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:14.060305 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8f73582a-69b3-48c4-b816-894609f25e15 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:14.330261 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e8fd4c9d-83c4-4bed-a35b-5d4edfa63e88 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:14.341882 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e8fd4c9d-83c4-4bed-a35b-5d4edfa63e88 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700" status: 200 len: 1501 microversion: 2.1 time: 0.366310 Oct 26 13:31:14.342955 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2798/5562] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:13 2022] GET /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700 => generated 1501 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:14.368684 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6e4de40a-1154-4490-a43e-4d5a5e2e758c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:31:14.370448 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6e4de40a-1154-4490-a43e-4d5a5e2e758c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 6df56119-b567-427a-87c9-8f45f9e32700] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:14.377428 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e4de40a-1154-4490-a43e-4d5a5e2e758c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:14.378812 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e4de40a-1154-4490-a43e-4d5a5e2e758c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:14.379420 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e4de40a-1154-4490-a43e-4d5a5e2e758c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:14.380311 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e4de40a-1154-4490-a43e-4d5a5e2e758c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:14.381004 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e4de40a-1154-4490-a43e-4d5a5e2e758c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:14.381624 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e4de40a-1154-4490-a43e-4d5a5e2e758c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:14.655180 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8f73582a-69b3-48c4-b816-894609f25e15 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:14.664156 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8f73582a-69b3-48c4-b816-894609f25e15 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.632331 Oct 26 13:31:14.668028 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2765/5563] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:14 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:14.692932 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-98959d74-7fb5-4cc5-9ed1-53866b936cda tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:14.702022 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-98959d74-7fb5-4cc5-9ed1-53866b936cda tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:14.718391 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-98959d74-7fb5-4cc5-9ed1-53866b936cda tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:14.719142 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-98959d74-7fb5-4cc5-9ed1-53866b936cda tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:14.719736 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-98959d74-7fb5-4cc5-9ed1-53866b936cda tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:14.720689 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-98959d74-7fb5-4cc5-9ed1-53866b936cda tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:14.721296 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-98959d74-7fb5-4cc5-9ed1-53866b936cda tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:14.721963 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-98959d74-7fb5-4cc5-9ed1-53866b936cda tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:15.053147 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-98959d74-7fb5-4cc5-9ed1-53866b936cda tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:15.065009 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-98959d74-7fb5-4cc5-9ed1-53866b936cda tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.376051 Oct 26 13:31:15.082462 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2766/5564] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:14 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:15.099196 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-72c36677-9baa-40b4-b40a-28f7716ebee8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:15.100169 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-72c36677-9baa-40b4-b40a-28f7716ebee8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:15.111095 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-72c36677-9baa-40b4-b40a-28f7716ebee8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:15.112084 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-72c36677-9baa-40b4-b40a-28f7716ebee8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:15.113280 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-72c36677-9baa-40b4-b40a-28f7716ebee8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:15.114182 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-72c36677-9baa-40b4-b40a-28f7716ebee8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:15.114792 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-72c36677-9baa-40b4-b40a-28f7716ebee8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:15.115431 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-72c36677-9baa-40b4-b40a-28f7716ebee8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:15.204424 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.network.security_group_api [None req-6e4de40a-1154-4490-a43e-4d5a5e2e758c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Removing security group 1894ca35-4ad8-4dfb-8c4b-057770299a2b from port 57bfad88-da94-4b1c-a21b-23e9d4ee8b85 Oct 26 13:31:15.505720 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-72c36677-9baa-40b4-b40a-28f7716ebee8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:15.533294 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-72c36677-9baa-40b4-b40a-28f7716ebee8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.437692 Oct 26 13:31:15.533294 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2767/5565] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:15 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:15.579703 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-25dbea1d-5b9f-4ba8-a27c-cfaf608c98db tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:31:15.601641 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-25dbea1d-5b9f-4ba8-a27c-cfaf608c98db tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] HTTP exception thrown: Instance 2ab0f3f8-6e70-4ec4-883a-73135325bcf1 has no mapping to a cell. Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-25dbea1d-5b9f-4ba8-a27c-cfaf608c98db tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Request method failure captured: Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/servers/2ab0f3f8-6e70-4ec4-883a-73135325bcf1/action HTTP/1.1 Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 15 Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTWpf9Job1by08RPlBi4BK3ZRus12IuUwpixxL0U8NmqouWwnfDFM_ku9arLt0Dfw_g2zljJol9iSiPHbr2OBJI9bA6xxReUYgF5HT4trI936uilzQCNXRfNWHD8SC65BfL8JHiNMAmXVHxHedc9hkhsO-eHURoIHHJwTTh6ig9qSq0 Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/088eb22706844984b58fe118d5421cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_088eb22706844984b58fe118d5421cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}] Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 9b8db27e3baf4b6a948f6d23c04cf680 Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: {"os-stop": {}} Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 2ab0f3f8-6e70-4ec4-883a-73135325bcf1 has no mapping to a cell. Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '2ab0f3f8-6e70-4ec4-883a-73135325bcf1', 'body': {'os-stop': {}}} Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 2ab0f3f8-6e70-4ec4-883a-73135325bcf1 has no mapping to a cell. Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:31:15.611696 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ab0f3f8-6e70-4ec4-883a-73135325bcf1 has no mapping to a cell. Oct 26 13:31:15.616344 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:31:15.616344 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:31:15.616344 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:31:15.616344 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:31:15.616344 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:31:15.616344 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:31:15.616344 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:31:15.616344 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:31:15.616344 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ab0f3f8-6e70-4ec4-883a-73135325bcf1 has no mapping to a cell. Oct 26 13:31:15.616344 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:31:15.617370 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-25dbea1d-5b9f-4ba8-a27c-cfaf608c98db tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Returning 404 to user: Instance 2ab0f3f8-6e70-4ec4-883a-73135325bcf1 has no mapping to a cell. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:31:15.618340 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-25dbea1d-5b9f-4ba8-a27c-cfaf608c98db tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "POST /compute/v2.1/servers/2ab0f3f8-6e70-4ec4-883a-73135325bcf1/action" status: 404 len: 117 microversion: 2.1 time: 0.064619 Oct 26 13:31:15.624662 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2768/5566] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:31:15 2022] POST /compute/v2.1/servers/2ab0f3f8-6e70-4ec4-883a-73135325bcf1/action => generated 117 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:31:15.639269 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-78884f6a-797d-42bf-ad72-388943796bb7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:15.640483 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-78884f6a-797d-42bf-ad72-388943796bb7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:15.667629 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78884f6a-797d-42bf-ad72-388943796bb7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:15.670313 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78884f6a-797d-42bf-ad72-388943796bb7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:15.670890 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78884f6a-797d-42bf-ad72-388943796bb7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:15.673814 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78884f6a-797d-42bf-ad72-388943796bb7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:15.674766 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78884f6a-797d-42bf-ad72-388943796bb7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:15.675843 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78884f6a-797d-42bf-ad72-388943796bb7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:16.175970 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-78884f6a-797d-42bf-ad72-388943796bb7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:16.201783 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-78884f6a-797d-42bf-ad72-388943796bb7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.575556 Oct 26 13:31:16.206032 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2769/5567] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:15 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:16.253700 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-96d650f3-a923-4373-b601-fdfe0feb3436 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:16.256654 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6e4de40a-1154-4490-a43e-4d5a5e2e758c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "POST /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700/action" status: 202 len: 0 microversion: 2.1 time: 1.892132 Oct 26 13:31:16.257573 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2799/5568] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:31:14 2022] POST /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700/action => generated 0 bytes in 1894 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 13:31:16.265808 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-73bdb6f9-072c-41ef-822c-4ec74c6fc335 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:16.266904 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-73bdb6f9-072c-41ef-822c-4ec74c6fc335 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 6df56119-b567-427a-87c9-8f45f9e32700] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:16.270082 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-96d650f3-a923-4373-b601-fdfe0feb3436 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:16.292625 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73bdb6f9-072c-41ef-822c-4ec74c6fc335 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:16.297362 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73bdb6f9-072c-41ef-822c-4ec74c6fc335 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:16.298673 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73bdb6f9-072c-41ef-822c-4ec74c6fc335 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:16.300140 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96d650f3-a923-4373-b601-fdfe0feb3436 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:16.301784 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96d650f3-a923-4373-b601-fdfe0feb3436 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:16.304975 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73bdb6f9-072c-41ef-822c-4ec74c6fc335 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:16.305675 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73bdb6f9-072c-41ef-822c-4ec74c6fc335 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:16.306359 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73bdb6f9-072c-41ef-822c-4ec74c6fc335 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:16.312605 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96d650f3-a923-4373-b601-fdfe0feb3436 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:16.313703 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96d650f3-a923-4373-b601-fdfe0feb3436 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:16.314350 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96d650f3-a923-4373-b601-fdfe0feb3436 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:16.314920 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96d650f3-a923-4373-b601-fdfe0feb3436 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:16.689470 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-73bdb6f9-072c-41ef-822c-4ec74c6fc335 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:16.700407 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-73bdb6f9-072c-41ef-822c-4ec74c6fc335 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700" status: 200 len: 1459 microversion: 2.1 time: 0.438345 Oct 26 13:31:16.723931 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2800/5569] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:16 2022] GET /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700 => generated 1459 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:16.745651 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-5d5feeb0-3181-4032-93be-f61aa0eb88f6 req-03dc656b-f954-4b48-8f31-3f38d7f0489a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6df56119-b567-427a-87c9-8f45f9e32700", "tag": "57bfad88-da94-4b1c-a21b-23e9d4ee8b85"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:31:16.776481 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-5d5feeb0-3181-4032-93be-f61aa0eb88f6 req-03dc656b-f954-4b48-8f31-3f38d7f0489a service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:16.782370 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-5d5feeb0-3181-4032-93be-f61aa0eb88f6 req-03dc656b-f954-4b48-8f31-3f38d7f0489a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:16.783842 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-5d5feeb0-3181-4032-93be-f61aa0eb88f6 req-03dc656b-f954-4b48-8f31-3f38d7f0489a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:16.822740 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-5d5feeb0-3181-4032-93be-f61aa0eb88f6 req-03dc656b-f954-4b48-8f31-3f38d7f0489a service nova] Creating event network-changed:57bfad88-da94-4b1c-a21b-23e9d4ee8b85 for instance 6df56119-b567-427a-87c9-8f45f9e32700 on n-h1-862686-1 Oct 26 13:31:16.829420 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-5d5feeb0-3181-4032-93be-f61aa0eb88f6 req-03dc656b-f954-4b48-8f31-3f38d7f0489a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103785 Oct 26 13:31:16.834375 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2801/5570] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:31:16.881337 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4bc2413a-83a1-47ae-bac9-27ce8df6359e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:16.881337 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4bc2413a-83a1-47ae-bac9-27ce8df6359e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:16.902072 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4bc2413a-83a1-47ae-bac9-27ce8df6359e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:16.902576 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4bc2413a-83a1-47ae-bac9-27ce8df6359e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:16.903029 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4bc2413a-83a1-47ae-bac9-27ce8df6359e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:16.903757 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4bc2413a-83a1-47ae-bac9-27ce8df6359e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:16.904212 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4bc2413a-83a1-47ae-bac9-27ce8df6359e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:16.910800 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4bc2413a-83a1-47ae-bac9-27ce8df6359e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:17.330652 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-96d650f3-a923-4373-b601-fdfe0feb3436 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:17.350136 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-96d650f3-a923-4373-b601-fdfe0feb3436 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 1.111020 Oct 26 13:31:17.351328 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2770/5571] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:16 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:17.385944 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6a102a44-52b6-4f7e-9205-ebc658bf3a8a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:31:17.387310 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6a102a44-52b6-4f7e-9205-ebc658bf3a8a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: a85cf5d7-d232-4fb1-b4e2-8ba1b9d2ed2e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:17.394234 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-6a102a44-52b6-4f7e-9205-ebc658bf3a8a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] HTTP exception thrown: Instance a85cf5d7-d232-4fb1-b4e2-8ba1b9d2ed2e could not be found. Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6a102a44-52b6-4f7e-9205-ebc658bf3a8a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Request method failure captured: Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/servers/a85cf5d7-d232-4fb1-b4e2-8ba1b9d2ed2e/action HTTP/1.1 Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 15 Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTWpf9Job1by08RPlBi4BK3ZRus12IuUwpixxL0U8NmqouWwnfDFM_ku9arLt0Dfw_g2zljJol9iSiPHbr2OBJI9bA6xxReUYgF5HT4trI936uilzQCNXRfNWHD8SC65BfL8JHiNMAmXVHxHedc9hkhsO-eHURoIHHJwTTh6ig9qSq0 Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/088eb22706844984b58fe118d5421cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_088eb22706844984b58fe118d5421cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}] Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 9b8db27e3baf4b6a948f6d23c04cf680 Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: {"suspend": {}} Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance a85cf5d7-d232-4fb1-b4e2-8ba1b9d2ed2e could not be found. Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'a85cf5d7-d232-4fb1-b4e2-8ba1b9d2ed2e', 'body': {'suspend': {}}} Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a85cf5d7-d232-4fb1-b4e2-8ba1b9d2ed2e could not be found. Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a85cf5d7-d232-4fb1-b4e2-8ba1b9d2ed2e could not be found. Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:31:17.397670 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:31:17.402066 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:31:17.402066 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:31:17.402066 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a85cf5d7-d232-4fb1-b4e2-8ba1b9d2ed2e could not be found. Oct 26 13:31:17.402066 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:31:17.406425 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6a102a44-52b6-4f7e-9205-ebc658bf3a8a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Returning 404 to user: Instance a85cf5d7-d232-4fb1-b4e2-8ba1b9d2ed2e could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:31:17.407888 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6a102a44-52b6-4f7e-9205-ebc658bf3a8a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "POST /compute/v2.1/servers/a85cf5d7-d232-4fb1-b4e2-8ba1b9d2ed2e/action" status: 404 len: 111 microversion: 2.1 time: 0.035069 Oct 26 13:31:17.409101 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2771/5572] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:31:17 2022] POST /compute/v2.1/servers/a85cf5d7-d232-4fb1-b4e2-8ba1b9d2ed2e/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 13:31:17.434557 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cdf47a34-3b22-437b-9d1a-e4d38c48031e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:17.438317 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cdf47a34-3b22-437b-9d1a-e4d38c48031e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:17.458937 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cdf47a34-3b22-437b-9d1a-e4d38c48031e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:17.463987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cdf47a34-3b22-437b-9d1a-e4d38c48031e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:17.466842 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cdf47a34-3b22-437b-9d1a-e4d38c48031e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:17.469055 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cdf47a34-3b22-437b-9d1a-e4d38c48031e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:17.472784 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cdf47a34-3b22-437b-9d1a-e4d38c48031e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:17.473403 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cdf47a34-3b22-437b-9d1a-e4d38c48031e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:17.755968 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4bc2413a-83a1-47ae-bac9-27ce8df6359e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:17.772508 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4bc2413a-83a1-47ae-bac9-27ce8df6359e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 0.935496 Oct 26 13:31:17.777445 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2802/5573] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:16 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:17.818470 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-094eec40-f696-4912-a4e5-d68ab2b30920 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:17.819301 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-094eec40-f696-4912-a4e5-d68ab2b30920 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:17.834270 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-094eec40-f696-4912-a4e5-d68ab2b30920 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:17.840118 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-094eec40-f696-4912-a4e5-d68ab2b30920 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:17.841156 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-094eec40-f696-4912-a4e5-d68ab2b30920 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:17.850941 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-094eec40-f696-4912-a4e5-d68ab2b30920 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:17.852243 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-094eec40-f696-4912-a4e5-d68ab2b30920 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:17.853931 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-094eec40-f696-4912-a4e5-d68ab2b30920 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:17.927110 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cdf47a34-3b22-437b-9d1a-e4d38c48031e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:17.952954 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cdf47a34-3b22-437b-9d1a-e4d38c48031e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.535666 Oct 26 13:31:17.981738 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2772/5574] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:17 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:18.001242 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a0091c76-60fb-4c40-acba-8f69c1b3dead tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:18.016658 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a0091c76-60fb-4c40-acba-8f69c1b3dead tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:18.044711 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0091c76-60fb-4c40-acba-8f69c1b3dead tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:18.045230 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0091c76-60fb-4c40-acba-8f69c1b3dead tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:18.047570 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0091c76-60fb-4c40-acba-8f69c1b3dead tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:18.057854 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0091c76-60fb-4c40-acba-8f69c1b3dead tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:18.058428 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0091c76-60fb-4c40-acba-8f69c1b3dead tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:18.058928 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0091c76-60fb-4c40-acba-8f69c1b3dead tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:18.727647 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a0091c76-60fb-4c40-acba-8f69c1b3dead tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:18.743321 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a0091c76-60fb-4c40-acba-8f69c1b3dead tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.754503 Oct 26 13:31:18.746888 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2773/5575] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:17 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:18.770581 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-30ab9e53-7ab2-4549-9d5b-b1d6fb206011 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:31:18.771574 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-30ab9e53-7ab2-4549-9d5b-b1d6fb206011 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:18.783381 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-30ab9e53-7ab2-4549-9d5b-b1d6fb206011 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:18.786998 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-30ab9e53-7ab2-4549-9d5b-b1d6fb206011 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:18.787748 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-30ab9e53-7ab2-4549-9d5b-b1d6fb206011 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:18.788791 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-30ab9e53-7ab2-4549-9d5b-b1d6fb206011 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:18.789389 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-30ab9e53-7ab2-4549-9d5b-b1d6fb206011 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:18.790146 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-30ab9e53-7ab2-4549-9d5b-b1d6fb206011 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:18.829465 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-094eec40-f696-4912-a4e5-d68ab2b30920 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:18.840711 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-094eec40-f696-4912-a4e5-d68ab2b30920 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 1.026465 Oct 26 13:31:18.844872 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2803/5576] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:17 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:31:18.851479 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-30ab9e53-7ab2-4549-9d5b-b1d6fb206011 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lazy-loading 'flavor' on Instance uuid f573d46e-77d2-4405-baef-2bb447d4b5e7 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:31:18.852439 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6d03e7cb-1ae2-4991-9d5b-6d06fc662378 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1602733414-access_point-893003356", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "4d062691-38e6-4331-bbb1-b3c4c5af9c05"}], "key_name": "tempest-TestSecurityGroupsBasicOps-697462233", "security_groups": [{"name": "tempest-secgroup_access--338356002"}, {"name": "tempest-secgroup_general--810077696"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:31:19.045361 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-30ab9e53-7ab2-4549-9d5b-b1d6fb206011 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "POST /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7/action" status: 202 len: 0 microversion: 2.1 time: 0.269496 Oct 26 13:31:19.048105 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2774/5577] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:31:18 2022] POST /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 13:31:19.058147 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c2109ca4-6fa9-4e80-a97b-5de96fe721d1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:19.059106 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c2109ca4-6fa9-4e80-a97b-5de96fe721d1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:19.068219 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c2109ca4-6fa9-4e80-a97b-5de96fe721d1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:19.070277 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c2109ca4-6fa9-4e80-a97b-5de96fe721d1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:19.070915 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c2109ca4-6fa9-4e80-a97b-5de96fe721d1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:19.071779 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c2109ca4-6fa9-4e80-a97b-5de96fe721d1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:19.072901 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c2109ca4-6fa9-4e80-a97b-5de96fe721d1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:19.073503 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c2109ca4-6fa9-4e80-a97b-5de96fe721d1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:19.517064 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-6d03e7cb-1ae2-4991-9d5b-6d06fc662378 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] validate_networks() for [('4d062691-38e6-4331-bbb1-b3c4c5af9c05', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:31:19.754760 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c2109ca4-6fa9-4e80-a97b-5de96fe721d1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:19.766253 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c2109ca4-6fa9-4e80-a97b-5de96fe721d1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 0.716444 Oct 26 13:31:19.771814 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2775/5578] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:19 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:19.797359 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f574638b-4b92-43b0-81d6-8f2c747da055 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:19.800773 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f574638b-4b92-43b0-81d6-8f2c747da055 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:19.824011 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f574638b-4b92-43b0-81d6-8f2c747da055 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:19.824512 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f574638b-4b92-43b0-81d6-8f2c747da055 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:19.824945 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f574638b-4b92-43b0-81d6-8f2c747da055 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:19.828305 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f574638b-4b92-43b0-81d6-8f2c747da055 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:19.829175 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f574638b-4b92-43b0-81d6-8f2c747da055 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:19.832587 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f574638b-4b92-43b0-81d6-8f2c747da055 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:20.261295 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f574638b-4b92-43b0-81d6-8f2c747da055 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:20.280657 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f574638b-4b92-43b0-81d6-8f2c747da055 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1497 microversion: 2.1 time: 0.499816 Oct 26 13:31:20.285672 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2776/5579] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:19 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1497 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:20.300008 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-31cf4a53-3b46-449e-9201-2924f254ce4a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:20.308513 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-31cf4a53-3b46-449e-9201-2924f254ce4a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:20.324966 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31cf4a53-3b46-449e-9201-2924f254ce4a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:20.333575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31cf4a53-3b46-449e-9201-2924f254ce4a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:20.333575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31cf4a53-3b46-449e-9201-2924f254ce4a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:20.333575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31cf4a53-3b46-449e-9201-2924f254ce4a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:20.333575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31cf4a53-3b46-449e-9201-2924f254ce4a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:20.333575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31cf4a53-3b46-449e-9201-2924f254ce4a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:20.645298 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-31cf4a53-3b46-449e-9201-2924f254ce4a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:20.647547 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:31:20.664074 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-31cf4a53-3b46-449e-9201-2924f254ce4a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 0.376284 Oct 26 13:31:20.666269 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2777/5580] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:20 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:20.683885 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ae937120-e244-438d-bce4-3d7333c69111 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:31:20.685943 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ae937120-e244-438d-bce4-3d7333c69111 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:20.712137 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae937120-e244-438d-bce4-3d7333c69111 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:20.712684 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae937120-e244-438d-bce4-3d7333c69111 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:20.713128 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae937120-e244-438d-bce4-3d7333c69111 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:20.713870 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae937120-e244-438d-bce4-3d7333c69111 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:20.714330 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae937120-e244-438d-bce4-3d7333c69111 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:20.719327 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae937120-e244-438d-bce4-3d7333c69111 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:20.771295 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-ae937120-e244-438d-bce4-3d7333c69111 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lazy-loading 'flavor' on Instance uuid f573d46e-77d2-4405-baef-2bb447d4b5e7 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:31:20.794131 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-ae937120-e244-438d-bce4-3d7333c69111 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] HTTP exception thrown: Cannot 'suspend' instance f573d46e-77d2-4405-baef-2bb447d4b5e7 while it is in vm_state suspended Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ae937120-e244-438d-bce4-3d7333c69111 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Request method failure captured: Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7/action HTTP/1.1 Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 15 Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTWpf9Job1by08RPlBi4BK3ZRus12IuUwpixxL0U8NmqouWwnfDFM_ku9arLt0Dfw_g2zljJol9iSiPHbr2OBJI9bA6xxReUYgF5HT4trI936uilzQCNXRfNWHD8SC65BfL8JHiNMAmXVHxHedc9hkhsO-eHURoIHHJwTTh6ig9qSq0 Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/088eb22706844984b58fe118d5421cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_088eb22706844984b58fe118d5421cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}] Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 9b8db27e3baf4b6a948f6d23c04cf680 Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: {"suspend": {}} Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: exception: Cannot 'suspend' instance f573d46e-77d2-4405-baef-2bb447d4b5e7 while it is in vm_state suspended Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'f573d46e-77d2-4405-baef-2bb447d4b5e7', 'body': {'suspend': {}}} Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f573d46e-77d2-4405-baef-2bb447d4b5e7 in vm_state suspended. Cannot suspend while the instance is in this state. Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 26 13:31:20.806993 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 26 13:31:20.812246 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 26 13:31:20.812246 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 26 13:31:20.812246 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance f573d46e-77d2-4405-baef-2bb447d4b5e7 while it is in vm_state suspended Oct 26 13:31:20.812246 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:31:20.812246 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:31:20.812246 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:31:20.812246 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:31:20.812246 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:31:20.812246 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:31:20.812246 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:31:20.812246 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:31:20.812246 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance f573d46e-77d2-4405-baef-2bb447d4b5e7 while it is in vm_state suspended Oct 26 13:31:20.812246 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:31:20.815655 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ae937120-e244-438d-bce4-3d7333c69111 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Returning 409 to user: Cannot 'suspend' instance f573d46e-77d2-4405-baef-2bb447d4b5e7 while it is in vm_state suspended {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:31:20.819364 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ae937120-e244-438d-bce4-3d7333c69111 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "POST /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7/action" status: 409 len: 148 microversion: 2.1 time: 0.151936 Oct 26 13:31:20.822644 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2778/5581] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:31:20 2022] POST /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7/action => generated 148 bytes in 156 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:31:20.830956 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-750e5307-91d3-43f8-80de-76b3fa63852b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:31:20.835237 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-750e5307-91d3-43f8-80de-76b3fa63852b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:20.846414 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-750e5307-91d3-43f8-80de-76b3fa63852b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:20.848141 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-750e5307-91d3-43f8-80de-76b3fa63852b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:20.848590 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-750e5307-91d3-43f8-80de-76b3fa63852b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:20.849513 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-750e5307-91d3-43f8-80de-76b3fa63852b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:20.850130 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-750e5307-91d3-43f8-80de-76b3fa63852b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:20.850925 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-750e5307-91d3-43f8-80de-76b3fa63852b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:20.912023 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-6d03e7cb-1ae2-4991-9d5b-6d06fc662378 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:31:20.912909 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-6d03e7cb-1ae2-4991-9d5b-6d06fc662378 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:31:20.912909 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-6d03e7cb-1ae2-4991-9d5b-6d06fc662378 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:31:20.913354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-6d03e7cb-1ae2-4991-9d5b-6d06fc662378 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:31:20.913825 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-6d03e7cb-1ae2-4991-9d5b-6d06fc662378 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:31:20.956718 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d03e7cb-1ae2-4991-9d5b-6d06fc662378 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:20.961698 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d03e7cb-1ae2-4991-9d5b-6d06fc662378 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:20.966128 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d03e7cb-1ae2-4991-9d5b-6d06fc662378 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:20.967216 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d03e7cb-1ae2-4991-9d5b-6d06fc662378 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:20.970150 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d03e7cb-1ae2-4991-9d5b-6d06fc662378 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:20.970904 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d03e7cb-1ae2-4991-9d5b-6d06fc662378 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:21.001409 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-750e5307-91d3-43f8-80de-76b3fa63852b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "POST /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7/action" status: 202 len: 0 microversion: 2.1 time: 0.174081 Oct 26 13:31:21.005106 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2779/5582] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:31:20 2022] POST /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:31:21.013853 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-270e5002-4956-4ae3-b071-109d598c58b2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1254838779", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "52e622a6-1003-4403-bde9-f622c42344c6"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:31:21.066704 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-6d03e7cb-1ae2-4991-9d5b-6d06fc662378 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Getting quotas for project b6d89db2ac0141d694e64f474244e527. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:31:21.120509 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-6d03e7cb-1ae2-4991-9d5b-6d06fc662378 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Getting quotas for user 8f745ae4d44f4cdebb40e233b0deed7a and project b6d89db2ac0141d694e64f474244e527. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:31:21.163260 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6d03e7cb-1ae2-4991-9d5b-6d06fc662378 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:31:21.165285 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-270e5002-4956-4ae3-b071-109d598c58b2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] validate_networks() for [('52e622a6-1003-4403-bde9-f622c42344c6', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:31:21.183206 n-d-862686-1 devstack@n-api.service[120598]: WARNING nova.utils [None req-6d03e7cb-1ae2-4991-9d5b-6d06fc662378 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1602733414-access_point-893003356 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1602733414-ac Oct 26 13:31:21.189434 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6d03e7cb-1ae2-4991-9d5b-6d06fc662378 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] [instance: dc8d9140-3f8d-44ad-86f4-36d67fbe7d19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:31:21.331695 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6d03e7cb-1ae2-4991-9d5b-6d06fc662378 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 456 microversion: 2.1 time: 2.485235 Oct 26 13:31:21.332356 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2804/5583] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:31:18 2022] POST /compute/v2.1/servers => generated 456 bytes in 2487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:31:21.344372 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-be1b496b-8bf9-4f75-937a-c478336a72dc tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:21.359065 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-be1b496b-8bf9-4f75-937a-c478336a72dc tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:21.375929 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be1b496b-8bf9-4f75-937a-c478336a72dc tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:21.378170 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be1b496b-8bf9-4f75-937a-c478336a72dc tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:21.378354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be1b496b-8bf9-4f75-937a-c478336a72dc tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:21.379067 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be1b496b-8bf9-4f75-937a-c478336a72dc tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:21.379400 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be1b496b-8bf9-4f75-937a-c478336a72dc tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:21.379824 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be1b496b-8bf9-4f75-937a-c478336a72dc tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:21.882789 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-be1b496b-8bf9-4f75-937a-c478336a72dc tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:21.907251 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-be1b496b-8bf9-4f75-937a-c478336a72dc tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1503 microversion: 2.1 time: 0.562439 Oct 26 13:31:21.912163 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2805/5584] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:21 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1503 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:21.928972 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-96591376-e1b2-4a3f-9267-46560c05026d tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:21.931075 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-96591376-e1b2-4a3f-9267-46560c05026d tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] [instance: dc8d9140-3f8d-44ad-86f4-36d67fbe7d19] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:22.267760 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-96591376-e1b2-4a3f-9267-46560c05026d tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f745ae4d44f4cdebb40e233b0deed7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d89db2ac0141d694e64f474244e527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:22.279580 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-96591376-e1b2-4a3f-9267-46560c05026d tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] 10.222.0.40 "GET /compute/v2.1/servers/dc8d9140-3f8d-44ad-86f4-36d67fbe7d19" status: 200 len: 1293 microversion: 2.1 time: 0.362360 Oct 26 13:31:22.282970 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2806/5585] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:21 2022] GET /compute/v2.1/servers/dc8d9140-3f8d-44ad-86f4-36d67fbe7d19 => generated 1293 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:22.520440 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-270e5002-4956-4ae3-b071-109d598c58b2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:31:22.521735 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-270e5002-4956-4ae3-b071-109d598c58b2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:31:22.522229 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-270e5002-4956-4ae3-b071-109d598c58b2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:31:22.523818 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-270e5002-4956-4ae3-b071-109d598c58b2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:31:22.524246 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-270e5002-4956-4ae3-b071-109d598c58b2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:31:22.557395 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-270e5002-4956-4ae3-b071-109d598c58b2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:22.561132 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-270e5002-4956-4ae3-b071-109d598c58b2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:22.563471 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-270e5002-4956-4ae3-b071-109d598c58b2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:22.565730 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-270e5002-4956-4ae3-b071-109d598c58b2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:22.569533 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-270e5002-4956-4ae3-b071-109d598c58b2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:22.571476 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-270e5002-4956-4ae3-b071-109d598c58b2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:22.664053 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-270e5002-4956-4ae3-b071-109d598c58b2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Getting quotas for project c0d1b1d2fe374ee5806eeee18712219f. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:31:22.672531 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-270e5002-4956-4ae3-b071-109d598c58b2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Getting quotas for user 3e9ff5a884f1416886f26a80c5b87b18 and project c0d1b1d2fe374ee5806eeee18712219f. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:31:22.694659 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-270e5002-4956-4ae3-b071-109d598c58b2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:31:22.702856 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-270e5002-4956-4ae3-b071-109d598c58b2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:31:22.812940 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-270e5002-4956-4ae3-b071-109d598c58b2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.809201 Oct 26 13:31:22.817733 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2780/5586] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:31:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:31:22.828437 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b18886ca-cd37-4c69-98f4-891a5282d9b0 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:22.829297 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b18886ca-cd37-4c69-98f4-891a5282d9b0 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:22.939812 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f114c7b4-197d-44e7-b50b-53f5dd8a77e8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:22.940566 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f114c7b4-197d-44e7-b50b-53f5dd8a77e8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:22.960820 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f114c7b4-197d-44e7-b50b-53f5dd8a77e8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:22.963667 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f114c7b4-197d-44e7-b50b-53f5dd8a77e8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:22.966551 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f114c7b4-197d-44e7-b50b-53f5dd8a77e8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:22.972522 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f114c7b4-197d-44e7-b50b-53f5dd8a77e8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:22.973102 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f114c7b4-197d-44e7-b50b-53f5dd8a77e8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:22.974933 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f114c7b4-197d-44e7-b50b-53f5dd8a77e8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:23.686698 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f114c7b4-197d-44e7-b50b-53f5dd8a77e8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:23.722079 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f114c7b4-197d-44e7-b50b-53f5dd8a77e8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1503 microversion: 2.1 time: 0.785275 Oct 26 13:31:23.724824 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2781/5587] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:22 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1503 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:31:23.741670 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b18886ca-cd37-4c69-98f4-891a5282d9b0 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:23.741670 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b18886ca-cd37-4c69-98f4-891a5282d9b0 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190" status: 200 len: 1215 microversion: 2.1 time: 0.912941 Oct 26 13:31:23.743559 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2807/5588] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:22 2022] GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 => generated 1215 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:23.762132 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-97172170-93ac-4f38-a3b7-61fb4c446d95 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:23.770588 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-97172170-93ac-4f38-a3b7-61fb4c446d95 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] [instance: dc8d9140-3f8d-44ad-86f4-36d67fbe7d19] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:23.794496 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97172170-93ac-4f38-a3b7-61fb4c446d95 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:23.796464 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97172170-93ac-4f38-a3b7-61fb4c446d95 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:23.797026 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97172170-93ac-4f38-a3b7-61fb4c446d95 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:23.803095 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97172170-93ac-4f38-a3b7-61fb4c446d95 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:23.803716 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97172170-93ac-4f38-a3b7-61fb4c446d95 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:23.804276 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97172170-93ac-4f38-a3b7-61fb4c446d95 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:24.245273 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-97172170-93ac-4f38-a3b7-61fb4c446d95 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f745ae4d44f4cdebb40e233b0deed7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d89db2ac0141d694e64f474244e527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:24.258694 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-97172170-93ac-4f38-a3b7-61fb4c446d95 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] 10.222.0.40 "GET /compute/v2.1/servers/dc8d9140-3f8d-44ad-86f4-36d67fbe7d19" status: 200 len: 1353 microversion: 2.1 time: 0.513656 Oct 26 13:31:24.263409 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2808/5589] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:23 2022] GET /compute/v2.1/servers/dc8d9140-3f8d-44ad-86f4-36d67fbe7d19 => generated 1353 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:24.768600 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8d461132-346b-4896-b350-43831735fda6 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:24.769263 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8d461132-346b-4896-b350-43831735fda6 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:24.774618 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-093913bf-888f-4cd0-b606-fc2c177d7751 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:24.778586 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-093913bf-888f-4cd0-b606-fc2c177d7751 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:24.781812 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:31:24.797005 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-093913bf-888f-4cd0-b606-fc2c177d7751 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:24.797896 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-093913bf-888f-4cd0-b606-fc2c177d7751 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:24.799357 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-093913bf-888f-4cd0-b606-fc2c177d7751 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:24.801013 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-093913bf-888f-4cd0-b606-fc2c177d7751 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:24.802478 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-093913bf-888f-4cd0-b606-fc2c177d7751 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:24.806630 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d461132-346b-4896-b350-43831735fda6 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:24.811837 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d461132-346b-4896-b350-43831735fda6 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:24.812685 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d461132-346b-4896-b350-43831735fda6 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:24.816959 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-093913bf-888f-4cd0-b606-fc2c177d7751 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:24.818026 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d461132-346b-4896-b350-43831735fda6 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:24.827964 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d461132-346b-4896-b350-43831735fda6 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:24.828535 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d461132-346b-4896-b350-43831735fda6 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:25.161934 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-093913bf-888f-4cd0-b606-fc2c177d7751 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:25.222740 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-093913bf-888f-4cd0-b606-fc2c177d7751 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190" status: 200 len: 1267 microversion: 2.1 time: 0.448744 Oct 26 13:31:25.224141 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2809/5590] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:24 2022] GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 => generated 1267 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:31:25.297997 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ba5cacce-0718-4f08-ab4a-6b7ea4818369 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:25.299579 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ba5cacce-0718-4f08-ab4a-6b7ea4818369 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] [instance: dc8d9140-3f8d-44ad-86f4-36d67fbe7d19] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:25.321534 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ba5cacce-0718-4f08-ab4a-6b7ea4818369 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:25.325906 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ba5cacce-0718-4f08-ab4a-6b7ea4818369 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:25.327166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ba5cacce-0718-4f08-ab4a-6b7ea4818369 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:25.330111 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ba5cacce-0718-4f08-ab4a-6b7ea4818369 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:25.331662 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ba5cacce-0718-4f08-ab4a-6b7ea4818369 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:25.335955 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ba5cacce-0718-4f08-ab4a-6b7ea4818369 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:25.683396 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ba5cacce-0718-4f08-ab4a-6b7ea4818369 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f745ae4d44f4cdebb40e233b0deed7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d89db2ac0141d694e64f474244e527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:25.694504 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ba5cacce-0718-4f08-ab4a-6b7ea4818369 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] 10.222.0.40 "GET /compute/v2.1/servers/dc8d9140-3f8d-44ad-86f4-36d67fbe7d19" status: 200 len: 1351 microversion: 2.1 time: 0.405266 Oct 26 13:31:25.715367 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2810/5591] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:25 2022] GET /compute/v2.1/servers/dc8d9140-3f8d-44ad-86f4-36d67fbe7d19 => generated 1351 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:31:25.842854 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8d461132-346b-4896-b350-43831735fda6 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:25.858146 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8d461132-346b-4896-b350-43831735fda6 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1503 microversion: 2.1 time: 1.099104 Oct 26 13:31:25.858741 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2782/5592] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:24 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1503 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:26.258949 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-44f45455-cbf2-4e2b-aad5-38628ef5d84a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:26.260219 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-44f45455-cbf2-4e2b-aad5-38628ef5d84a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:26.274330 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-44f45455-cbf2-4e2b-aad5-38628ef5d84a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:26.275205 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-44f45455-cbf2-4e2b-aad5-38628ef5d84a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:26.275714 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-44f45455-cbf2-4e2b-aad5-38628ef5d84a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:26.283087 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-44f45455-cbf2-4e2b-aad5-38628ef5d84a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:26.284184 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-44f45455-cbf2-4e2b-aad5-38628ef5d84a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:26.284642 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-44f45455-cbf2-4e2b-aad5-38628ef5d84a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:26.514218 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-44f45455-cbf2-4e2b-aad5-38628ef5d84a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:26.527914 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-44f45455-cbf2-4e2b-aad5-38628ef5d84a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190" status: 200 len: 1275 microversion: 2.1 time: 0.275465 Oct 26 13:31:26.528520 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2811/5593] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:26 2022] GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 => generated 1275 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:26.721763 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f9d8ffe0-3b60-4265-8660-7690385d79d1 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:26.722561 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f9d8ffe0-3b60-4265-8660-7690385d79d1 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] [instance: dc8d9140-3f8d-44ad-86f4-36d67fbe7d19] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:26.724754 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:31:26.740974 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f9d8ffe0-3b60-4265-8660-7690385d79d1 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:26.741497 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f9d8ffe0-3b60-4265-8660-7690385d79d1 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:26.741944 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f9d8ffe0-3b60-4265-8660-7690385d79d1 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:26.751530 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f9d8ffe0-3b60-4265-8660-7690385d79d1 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:26.753396 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f9d8ffe0-3b60-4265-8660-7690385d79d1 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:26.757798 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f9d8ffe0-3b60-4265-8660-7690385d79d1 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:26.891724 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3bb5965d-50bc-40ea-bb05-cd88d9189042 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:26.892801 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3bb5965d-50bc-40ea-bb05-cd88d9189042 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:26.901445 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bb5965d-50bc-40ea-bb05-cd88d9189042 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:26.902131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bb5965d-50bc-40ea-bb05-cd88d9189042 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:26.902742 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bb5965d-50bc-40ea-bb05-cd88d9189042 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:26.903601 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bb5965d-50bc-40ea-bb05-cd88d9189042 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:26.904671 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bb5965d-50bc-40ea-bb05-cd88d9189042 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:26.905864 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bb5965d-50bc-40ea-bb05-cd88d9189042 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:27.167606 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f9d8ffe0-3b60-4265-8660-7690385d79d1 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f745ae4d44f4cdebb40e233b0deed7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d89db2ac0141d694e64f474244e527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:27.195898 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f9d8ffe0-3b60-4265-8660-7690385d79d1 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] 10.222.0.40 "GET /compute/v2.1/servers/dc8d9140-3f8d-44ad-86f4-36d67fbe7d19" status: 200 len: 1351 microversion: 2.1 time: 0.473730 Oct 26 13:31:27.202936 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2783/5594] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:26 2022] GET /compute/v2.1/servers/dc8d9140-3f8d-44ad-86f4-36d67fbe7d19 => generated 1351 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:27.555035 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ad9e70a6-9d47-4d91-a13f-3bb36283639c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:27.555661 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ad9e70a6-9d47-4d91-a13f-3bb36283639c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:27.580281 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad9e70a6-9d47-4d91-a13f-3bb36283639c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:27.584503 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad9e70a6-9d47-4d91-a13f-3bb36283639c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:27.585016 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad9e70a6-9d47-4d91-a13f-3bb36283639c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:27.589167 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad9e70a6-9d47-4d91-a13f-3bb36283639c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:27.591810 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad9e70a6-9d47-4d91-a13f-3bb36283639c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:27.593325 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad9e70a6-9d47-4d91-a13f-3bb36283639c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:27.772171 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ad9e70a6-9d47-4d91-a13f-3bb36283639c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:27.782421 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ad9e70a6-9d47-4d91-a13f-3bb36283639c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190" status: 200 len: 1273 microversion: 2.1 time: 0.233042 Oct 26 13:31:27.787295 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2784/5595] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:27 2022] GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 => generated 1273 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:28.144026 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3bb5965d-50bc-40ea-bb05-cd88d9189042 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:28.158463 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3bb5965d-50bc-40ea-bb05-cd88d9189042 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 1.278085 Oct 26 13:31:28.164361 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2812/5596] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:26 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:28.193391 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f71dd9c1-48ce-46f3-8dea-56d5745a753f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:28.196674 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f71dd9c1-48ce-46f3-8dea-56d5745a753f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:28.233375 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f71dd9c1-48ce-46f3-8dea-56d5745a753f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:28.234025 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1edd4b63-ec07-4702-a674-d9d3dbdd6f1a tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:28.234904 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1edd4b63-ec07-4702-a674-d9d3dbdd6f1a tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] [instance: dc8d9140-3f8d-44ad-86f4-36d67fbe7d19] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:28.237268 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f71dd9c1-48ce-46f3-8dea-56d5745a753f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:28.243123 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f71dd9c1-48ce-46f3-8dea-56d5745a753f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:28.244129 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f71dd9c1-48ce-46f3-8dea-56d5745a753f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:28.248354 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f71dd9c1-48ce-46f3-8dea-56d5745a753f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:28.250362 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f71dd9c1-48ce-46f3-8dea-56d5745a753f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:28.252343 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1edd4b63-ec07-4702-a674-d9d3dbdd6f1a tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:28.253027 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1edd4b63-ec07-4702-a674-d9d3dbdd6f1a tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:28.254856 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1edd4b63-ec07-4702-a674-d9d3dbdd6f1a tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:28.255752 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1edd4b63-ec07-4702-a674-d9d3dbdd6f1a tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:28.258605 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1edd4b63-ec07-4702-a674-d9d3dbdd6f1a tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:28.259753 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1edd4b63-ec07-4702-a674-d9d3dbdd6f1a tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:28.275227 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:31:28.601467 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1edd4b63-ec07-4702-a674-d9d3dbdd6f1a tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f745ae4d44f4cdebb40e233b0deed7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d89db2ac0141d694e64f474244e527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:28.615329 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1edd4b63-ec07-4702-a674-d9d3dbdd6f1a tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] 10.222.0.40 "GET /compute/v2.1/servers/dc8d9140-3f8d-44ad-86f4-36d67fbe7d19" status: 200 len: 1351 microversion: 2.1 time: 0.391305 Oct 26 13:31:28.620251 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2813/5597] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:28 2022] GET /compute/v2.1/servers/dc8d9140-3f8d-44ad-86f4-36d67fbe7d19 => generated 1351 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:31:28.819615 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c9103d75-06ca-457b-85d8-b301c68fe1c7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:28.820241 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c9103d75-06ca-457b-85d8-b301c68fe1c7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:28.832218 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9103d75-06ca-457b-85d8-b301c68fe1c7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:28.838133 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9103d75-06ca-457b-85d8-b301c68fe1c7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:28.838948 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9103d75-06ca-457b-85d8-b301c68fe1c7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:28.839854 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9103d75-06ca-457b-85d8-b301c68fe1c7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:28.840801 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9103d75-06ca-457b-85d8-b301c68fe1c7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:28.842311 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9103d75-06ca-457b-85d8-b301c68fe1c7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:29.119620 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f71dd9c1-48ce-46f3-8dea-56d5745a753f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:29.131933 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f71dd9c1-48ce-46f3-8dea-56d5745a753f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.943685 Oct 26 13:31:29.134774 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2785/5598] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:28 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:29.162595 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e9f0378d-2c0d-4da7-8fe9-b6586b1f41fe tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:31:29.163451 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e9f0378d-2c0d-4da7-8fe9-b6586b1f41fe tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: 3db91e9d-f1a1-40d2-817c-da2bd91a398f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:29.174295 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-e9f0378d-2c0d-4da7-8fe9-b6586b1f41fe tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] HTTP exception thrown: Instance 3db91e9d-f1a1-40d2-817c-da2bd91a398f could not be found. Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e9f0378d-2c0d-4da7-8fe9-b6586b1f41fe tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Request method failure captured: Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/servers/3db91e9d-f1a1-40d2-817c-da2bd91a398f/action HTTP/1.1 Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 15 Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTWpf9Job1by08RPlBi4BK3ZRus12IuUwpixxL0U8NmqouWwnfDFM_ku9arLt0Dfw_g2zljJol9iSiPHbr2OBJI9bA6xxReUYgF5HT4trI936uilzQCNXRfNWHD8SC65BfL8JHiNMAmXVHxHedc9hkhsO-eHURoIHHJwTTh6ig9qSq0 Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/088eb22706844984b58fe118d5421cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_088eb22706844984b58fe118d5421cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}] Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 9b8db27e3baf4b6a948f6d23c04cf680 Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: {"unpause": {}} Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 3db91e9d-f1a1-40d2-817c-da2bd91a398f could not be found. Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '3db91e9d-f1a1-40d2-817c-da2bd91a398f', 'body': {'unpause': {}}} Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3db91e9d-f1a1-40d2-817c-da2bd91a398f could not be found. Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3db91e9d-f1a1-40d2-817c-da2bd91a398f could not be found. Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:31:29.178918 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:31:29.183794 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:31:29.183794 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:31:29.183794 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3db91e9d-f1a1-40d2-817c-da2bd91a398f could not be found. Oct 26 13:31:29.183794 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:31:29.186884 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e9f0378d-2c0d-4da7-8fe9-b6586b1f41fe tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Returning 404 to user: Instance 3db91e9d-f1a1-40d2-817c-da2bd91a398f could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:31:29.192338 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e9f0378d-2c0d-4da7-8fe9-b6586b1f41fe tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "POST /compute/v2.1/servers/3db91e9d-f1a1-40d2-817c-da2bd91a398f/action" status: 404 len: 111 microversion: 2.1 time: 0.036469 Oct 26 13:31:29.196463 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2786/5599] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:31:29 2022] POST /compute/v2.1/servers/3db91e9d-f1a1-40d2-817c-da2bd91a398f/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:31:29.208572 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0afd3181-2111-4e08-9cd3-a07e8a790928 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:29.210264 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0afd3181-2111-4e08-9cd3-a07e8a790928 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:29.234483 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0afd3181-2111-4e08-9cd3-a07e8a790928 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:29.235078 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0afd3181-2111-4e08-9cd3-a07e8a790928 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:29.236492 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0afd3181-2111-4e08-9cd3-a07e8a790928 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:29.237824 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0afd3181-2111-4e08-9cd3-a07e8a790928 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:29.238345 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0afd3181-2111-4e08-9cd3-a07e8a790928 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:29.240876 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0afd3181-2111-4e08-9cd3-a07e8a790928 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:29.438004 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c9103d75-06ca-457b-85d8-b301c68fe1c7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:29.448854 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c9103d75-06ca-457b-85d8-b301c68fe1c7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190" status: 200 len: 1273 microversion: 2.1 time: 0.642099 Oct 26 13:31:29.453410 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2814/5600] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:28 2022] GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 => generated 1273 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:29.640879 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d43b696d-dff1-4412-b37b-5c024da31532 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:29.641516 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d43b696d-dff1-4412-b37b-5c024da31532 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] [instance: dc8d9140-3f8d-44ad-86f4-36d67fbe7d19] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:29.655497 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d43b696d-dff1-4412-b37b-5c024da31532 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:29.655929 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d43b696d-dff1-4412-b37b-5c024da31532 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:29.656615 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d43b696d-dff1-4412-b37b-5c024da31532 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:29.657350 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d43b696d-dff1-4412-b37b-5c024da31532 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:29.657833 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d43b696d-dff1-4412-b37b-5c024da31532 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:29.658438 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d43b696d-dff1-4412-b37b-5c024da31532 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:29.766177 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0afd3181-2111-4e08-9cd3-a07e8a790928 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:29.782712 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0afd3181-2111-4e08-9cd3-a07e8a790928 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.583341 Oct 26 13:31:29.783447 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2787/5601] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:29 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:29.811015 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-04d98404-33ce-476d-a9a1-3c346f269db7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:29.811997 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-04d98404-33ce-476d-a9a1-3c346f269db7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:29.826086 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-04d98404-33ce-476d-a9a1-3c346f269db7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:29.826861 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-04d98404-33ce-476d-a9a1-3c346f269db7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:29.827557 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-04d98404-33ce-476d-a9a1-3c346f269db7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:29.828500 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-04d98404-33ce-476d-a9a1-3c346f269db7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:29.829212 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-04d98404-33ce-476d-a9a1-3c346f269db7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:29.829927 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-04d98404-33ce-476d-a9a1-3c346f269db7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:30.473833 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-04d98404-33ce-476d-a9a1-3c346f269db7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:30.486809 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-04d98404-33ce-476d-a9a1-3c346f269db7 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.680236 Oct 26 13:31:30.487398 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2788/5602] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:29 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:30.496153 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-49499bac-8bb0-4155-967c-aecb7a06b88c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:30.496865 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-49499bac-8bb0-4155-967c-aecb7a06b88c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:30.505616 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49499bac-8bb0-4155-967c-aecb7a06b88c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:30.506443 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49499bac-8bb0-4155-967c-aecb7a06b88c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:30.507133 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49499bac-8bb0-4155-967c-aecb7a06b88c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:30.509041 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49499bac-8bb0-4155-967c-aecb7a06b88c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:30.514902 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49499bac-8bb0-4155-967c-aecb7a06b88c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:30.516190 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49499bac-8bb0-4155-967c-aecb7a06b88c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:30.531578 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d43b696d-dff1-4412-b37b-5c024da31532 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f745ae4d44f4cdebb40e233b0deed7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d89db2ac0141d694e64f474244e527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:30.567484 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d43b696d-dff1-4412-b37b-5c024da31532 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] 10.222.0.40 "GET /compute/v2.1/servers/dc8d9140-3f8d-44ad-86f4-36d67fbe7d19" status: 200 len: 1469 microversion: 2.1 time: 0.922213 Oct 26 13:31:30.567484 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2815/5603] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:29 2022] GET /compute/v2.1/servers/dc8d9140-3f8d-44ad-86f4-36d67fbe7d19 => generated 1469 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:31:30.596214 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9facd902-f604-440f-9bbe-06134acebcdd tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:31:30.605820 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9facd902-f604-440f-9bbe-06134acebcdd tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:30.615739 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9facd902-f604-440f-9bbe-06134acebcdd tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:30.616240 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9facd902-f604-440f-9bbe-06134acebcdd tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:30.616932 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9facd902-f604-440f-9bbe-06134acebcdd tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:30.618149 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9facd902-f604-440f-9bbe-06134acebcdd tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:30.619461 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9facd902-f604-440f-9bbe-06134acebcdd tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:30.627675 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9facd902-f604-440f-9bbe-06134acebcdd tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:30.667398 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-9facd902-f604-440f-9bbe-06134acebcdd tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] HTTP exception thrown: Cannot 'unpause' instance f573d46e-77d2-4405-baef-2bb447d4b5e7 while it is in vm_state active Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9facd902-f604-440f-9bbe-06134acebcdd tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Request method failure captured: Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7/action HTTP/1.1 Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 15 Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTWpf9Job1by08RPlBi4BK3ZRus12IuUwpixxL0U8NmqouWwnfDFM_ku9arLt0Dfw_g2zljJol9iSiPHbr2OBJI9bA6xxReUYgF5HT4trI936uilzQCNXRfNWHD8SC65BfL8JHiNMAmXVHxHedc9hkhsO-eHURoIHHJwTTh6ig9qSq0 Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/088eb22706844984b58fe118d5421cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_088eb22706844984b58fe118d5421cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}] Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 9b8db27e3baf4b6a948f6d23c04cf680 Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: {"unpause": {}} Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: exception: Cannot 'unpause' instance f573d46e-77d2-4405-baef-2bb447d4b5e7 while it is in vm_state active Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'f573d46e-77d2-4405-baef-2bb447d4b5e7', 'body': {'unpause': {}}} Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f573d46e-77d2-4405-baef-2bb447d4b5e7 in vm_state active. Cannot unpause while the instance is in this state. Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance f573d46e-77d2-4405-baef-2bb447d4b5e7 while it is in vm_state active Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:31:30.669991 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:31:30.675346 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:31:30.675346 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:31:30.675346 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:31:30.675346 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance f573d46e-77d2-4405-baef-2bb447d4b5e7 while it is in vm_state active Oct 26 13:31:30.675346 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:31:30.676934 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9facd902-f604-440f-9bbe-06134acebcdd tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Returning 409 to user: Cannot 'unpause' instance f573d46e-77d2-4405-baef-2bb447d4b5e7 while it is in vm_state active {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:31:30.678043 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9facd902-f604-440f-9bbe-06134acebcdd tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "POST /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7/action" status: 409 len: 145 microversion: 2.1 time: 0.113053 Oct 26 13:31:30.679123 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2816/5604] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:31:30 2022] POST /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7/action => generated 145 bytes in 119 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:31:30.690513 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6e8c1426-6f86-4ada-a11f-fc12c5ef9976 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:30.697986 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6e8c1426-6f86-4ada-a11f-fc12c5ef9976 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:30.709331 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e8c1426-6f86-4ada-a11f-fc12c5ef9976 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:30.710438 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e8c1426-6f86-4ada-a11f-fc12c5ef9976 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:30.711216 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e8c1426-6f86-4ada-a11f-fc12c5ef9976 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:30.712133 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e8c1426-6f86-4ada-a11f-fc12c5ef9976 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:30.712864 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e8c1426-6f86-4ada-a11f-fc12c5ef9976 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:30.717358 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e8c1426-6f86-4ada-a11f-fc12c5ef9976 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:31.007197 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:31:31.125634 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-49499bac-8bb0-4155-967c-aecb7a06b88c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:31.151889 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-49499bac-8bb0-4155-967c-aecb7a06b88c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190" status: 200 len: 1315 microversion: 2.1 time: 0.658820 Oct 26 13:31:31.153471 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2789/5605] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:30 2022] GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 => generated 1315 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:31.591874 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-93115ebd-0934-4027-aaf5-6f0664840922 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:31.592674 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-93115ebd-0934-4027-aaf5-6f0664840922 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] [instance: dc8d9140-3f8d-44ad-86f4-36d67fbe7d19] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:31.628749 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-93115ebd-0934-4027-aaf5-6f0664840922 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:31.631143 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-93115ebd-0934-4027-aaf5-6f0664840922 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:31.631883 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-93115ebd-0934-4027-aaf5-6f0664840922 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:31.633044 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-93115ebd-0934-4027-aaf5-6f0664840922 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:31.633693 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-93115ebd-0934-4027-aaf5-6f0664840922 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:31.634596 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-93115ebd-0934-4027-aaf5-6f0664840922 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:31.936058 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-93115ebd-0934-4027-aaf5-6f0664840922 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f745ae4d44f4cdebb40e233b0deed7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d89db2ac0141d694e64f474244e527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:31.948733 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-93115ebd-0934-4027-aaf5-6f0664840922 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] 10.222.0.40 "GET /compute/v2.1/servers/dc8d9140-3f8d-44ad-86f4-36d67fbe7d19" status: 200 len: 1469 microversion: 2.1 time: 0.359310 Oct 26 13:31:31.962668 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2790/5606] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:31 2022] GET /compute/v2.1/servers/dc8d9140-3f8d-44ad-86f4-36d67fbe7d19 => generated 1469 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:32.178404 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4f454cce-e09a-444d-ba43-b4e1fa947ea1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:32.179174 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4f454cce-e09a-444d-ba43-b4e1fa947ea1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:32.189861 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f454cce-e09a-444d-ba43-b4e1fa947ea1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:32.191447 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f454cce-e09a-444d-ba43-b4e1fa947ea1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:32.192000 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f454cce-e09a-444d-ba43-b4e1fa947ea1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:32.193505 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f454cce-e09a-444d-ba43-b4e1fa947ea1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:32.195515 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f454cce-e09a-444d-ba43-b4e1fa947ea1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:32.198070 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f454cce-e09a-444d-ba43-b4e1fa947ea1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:32.578953 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6e8c1426-6f86-4ada-a11f-fc12c5ef9976 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:32.595657 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6e8c1426-6f86-4ada-a11f-fc12c5ef9976 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 1.909388 Oct 26 13:31:32.599214 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2817/5607] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:30 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 1915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:31:32.617138 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:31:32.682063 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:31:32.692259 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4f454cce-e09a-444d-ba43-b4e1fa947ea1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:32.708407 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4f454cce-e09a-444d-ba43-b4e1fa947ea1 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190" status: 200 len: 1315 microversion: 2.1 time: 0.534427 Oct 26 13:31:32.730970 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2791/5608] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:32 2022] GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 => generated 1315 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:31:32.757460 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ce4dbf20-5880-4e1a-adc6-7f8dc0e4ac23 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:32.763445 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ce4dbf20-5880-4e1a-adc6-7f8dc0e4ac23 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:32.804961 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce4dbf20-5880-4e1a-adc6-7f8dc0e4ac23 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:32.805755 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce4dbf20-5880-4e1a-adc6-7f8dc0e4ac23 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:32.808628 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce4dbf20-5880-4e1a-adc6-7f8dc0e4ac23 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:32.809854 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce4dbf20-5880-4e1a-adc6-7f8dc0e4ac23 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:32.811422 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce4dbf20-5880-4e1a-adc6-7f8dc0e4ac23 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:32.814736 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce4dbf20-5880-4e1a-adc6-7f8dc0e4ac23 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:33.036231 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-b771793e-0361-4440-a434-48442a65a388 req-97b8c77e-6367-489e-b7ad-75198f1b3727 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc8d9140-3f8d-44ad-86f4-36d67fbe7d19", "tag": "f7033ea2-06ce-4a5d-89e9-d5ec1bb05d04"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:31:33.049875 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b771793e-0361-4440-a434-48442a65a388 req-97b8c77e-6367-489e-b7ad-75198f1b3727 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:33.050971 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b771793e-0361-4440-a434-48442a65a388 req-97b8c77e-6367-489e-b7ad-75198f1b3727 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:33.051403 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b771793e-0361-4440-a434-48442a65a388 req-97b8c77e-6367-489e-b7ad-75198f1b3727 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:33.068393 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-b771793e-0361-4440-a434-48442a65a388 req-97b8c77e-6367-489e-b7ad-75198f1b3727 service nova] Creating event network-changed:f7033ea2-06ce-4a5d-89e9-d5ec1bb05d04 for instance dc8d9140-3f8d-44ad-86f4-36d67fbe7d19 on n-h2-862686-1 Oct 26 13:31:33.080179 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-b771793e-0361-4440-a434-48442a65a388 req-97b8c77e-6367-489e-b7ad-75198f1b3727 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.478424 Oct 26 13:31:33.083137 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2818/5609] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:31:33.100066 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-81c231f3-0a06-4607-808d-fbe5682f7188 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:33.103490 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-81c231f3-0a06-4607-808d-fbe5682f7188 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] [instance: dc8d9140-3f8d-44ad-86f4-36d67fbe7d19] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:33.120436 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81c231f3-0a06-4607-808d-fbe5682f7188 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:33.121576 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81c231f3-0a06-4607-808d-fbe5682f7188 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:33.124553 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81c231f3-0a06-4607-808d-fbe5682f7188 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:33.125937 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81c231f3-0a06-4607-808d-fbe5682f7188 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:33.128413 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81c231f3-0a06-4607-808d-fbe5682f7188 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:33.130296 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81c231f3-0a06-4607-808d-fbe5682f7188 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:33.734964 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=10 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:31:33.776943 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ce4dbf20-5880-4e1a-adc6-7f8dc0e4ac23 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:33.791949 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ce4dbf20-5880-4e1a-adc6-7f8dc0e4ac23 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 1.059553 Oct 26 13:31:33.799391 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2792/5610] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:32 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:33.811288 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-81c582d1-c9af-43e9-ba9e-c5889e4676ad tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:33.812728 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-81c582d1-c9af-43e9-ba9e-c5889e4676ad tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:33.827194 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81c582d1-c9af-43e9-ba9e-c5889e4676ad tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:33.827918 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81c582d1-c9af-43e9-ba9e-c5889e4676ad tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:33.828556 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81c582d1-c9af-43e9-ba9e-c5889e4676ad tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:33.831518 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81c582d1-c9af-43e9-ba9e-c5889e4676ad tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:33.832342 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81c582d1-c9af-43e9-ba9e-c5889e4676ad tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:33.832988 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81c582d1-c9af-43e9-ba9e-c5889e4676ad tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:34.166172 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-81c231f3-0a06-4607-808d-fbe5682f7188 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f745ae4d44f4cdebb40e233b0deed7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d89db2ac0141d694e64f474244e527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:34.175572 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-81c231f3-0a06-4607-808d-fbe5682f7188 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] 10.222.0.40 "GET /compute/v2.1/servers/dc8d9140-3f8d-44ad-86f4-36d67fbe7d19" status: 200 len: 1469 microversion: 2.1 time: 1.091059 Oct 26 13:31:34.180042 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2819/5611] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:33 2022] GET /compute/v2.1/servers/dc8d9140-3f8d-44ad-86f4-36d67fbe7d19 => generated 1469 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:34.194488 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f132d975-0133-4df5-bbdb-eb69bf58b17a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:31:34.195433 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f132d975-0133-4df5-bbdb-eb69bf58b17a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: ef70b441-27af-4c64-94d8-e8860eef4dbf] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:34.209372 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-f132d975-0133-4df5-bbdb-eb69bf58b17a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] HTTP exception thrown: Instance ef70b441-27af-4c64-94d8-e8860eef4dbf could not be found. Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f132d975-0133-4df5-bbdb-eb69bf58b17a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Request method failure captured: Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/servers/ef70b441-27af-4c64-94d8-e8860eef4dbf/action HTTP/1.1 Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 18 Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTWpf9Job1by08RPlBi4BK3ZRus12IuUwpixxL0U8NmqouWwnfDFM_ku9arLt0Dfw_g2zljJol9iSiPHbr2OBJI9bA6xxReUYgF5HT4trI936uilzQCNXRfNWHD8SC65BfL8JHiNMAmXVHxHedc9hkhsO-eHURoIHHJwTTh6ig9qSq0 Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/088eb22706844984b58fe118d5421cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_088eb22706844984b58fe118d5421cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}] Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 9b8db27e3baf4b6a948f6d23c04cf680 Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: {"unshelve": null} Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance ef70b441-27af-4c64-94d8-e8860eef4dbf could not be found. Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'ef70b441-27af-4c64-94d8-e8860eef4dbf', 'body': {'unshelve': None}} Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef70b441-27af-4c64-94d8-e8860eef4dbf could not be found. Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef70b441-27af-4c64-94d8-e8860eef4dbf could not be found. Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:31:34.214906 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:31:34.218816 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:31:34.218816 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:31:34.218816 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:31:34.218816 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:31:34.218816 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:31:34.218816 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:31:34.218816 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef70b441-27af-4c64-94d8-e8860eef4dbf could not be found. Oct 26 13:31:34.218816 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:31:34.224777 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f132d975-0133-4df5-bbdb-eb69bf58b17a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Returning 404 to user: Instance ef70b441-27af-4c64-94d8-e8860eef4dbf could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:31:34.227471 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f132d975-0133-4df5-bbdb-eb69bf58b17a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "POST /compute/v2.1/servers/ef70b441-27af-4c64-94d8-e8860eef4dbf/action" status: 404 len: 111 microversion: 2.1 time: 0.037014 Oct 26 13:31:34.228609 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2820/5612] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:31:34 2022] POST /compute/v2.1/servers/ef70b441-27af-4c64-94d8-e8860eef4dbf/action => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:31:34.248429 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7f1f58f4-4516-4303-a4a7-9565722f5b00 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:34.249002 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7f1f58f4-4516-4303-a4a7-9565722f5b00 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:34.267022 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f1f58f4-4516-4303-a4a7-9565722f5b00 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:34.267288 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f1f58f4-4516-4303-a4a7-9565722f5b00 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:34.268400 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f1f58f4-4516-4303-a4a7-9565722f5b00 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:34.269844 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f1f58f4-4516-4303-a4a7-9565722f5b00 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:34.270634 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f1f58f4-4516-4303-a4a7-9565722f5b00 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:34.271297 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f1f58f4-4516-4303-a4a7-9565722f5b00 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:35.111486 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7f1f58f4-4516-4303-a4a7-9565722f5b00 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:35.122785 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7f1f58f4-4516-4303-a4a7-9565722f5b00 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.889025 Oct 26 13:31:35.124274 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2821/5613] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:34 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:35.129199 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-e49e1300-cf0a-44c4-95ed-c225d6ec63c3 req-f6242d1e-7bbb-47f9-9a43-ad2c518763f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb1b8c75-80fa-4c58-acb0-0a38b1cb4190", "tag": "779c4ff9-aef3-47c6-bc9d-fb3332928fb3"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:31:35.140388 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e49e1300-cf0a-44c4-95ed-c225d6ec63c3 req-f6242d1e-7bbb-47f9-9a43-ad2c518763f9 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:35.142004 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e49e1300-cf0a-44c4-95ed-c225d6ec63c3 req-f6242d1e-7bbb-47f9-9a43-ad2c518763f9 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:35.142831 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e49e1300-cf0a-44c4-95ed-c225d6ec63c3 req-f6242d1e-7bbb-47f9-9a43-ad2c518763f9 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:35.158561 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-e49e1300-cf0a-44c4-95ed-c225d6ec63c3 req-f6242d1e-7bbb-47f9-9a43-ad2c518763f9 service nova] Creating event network-changed:779c4ff9-aef3-47c6-bc9d-fb3332928fb3 for instance cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 on n-h1-862686-1 Oct 26 13:31:35.169190 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-e49e1300-cf0a-44c4-95ed-c225d6ec63c3 req-f6242d1e-7bbb-47f9-9a43-ad2c518763f9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043063 Oct 26 13:31:35.170201 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2822/5614] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:31:35.177382 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9fe2cfe4-da1b-4b96-ad17-548a21e1c085 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:35.178364 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9fe2cfe4-da1b-4b96-ad17-548a21e1c085 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:35.186806 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9fe2cfe4-da1b-4b96-ad17-548a21e1c085 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:35.187490 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9fe2cfe4-da1b-4b96-ad17-548a21e1c085 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:35.188192 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9fe2cfe4-da1b-4b96-ad17-548a21e1c085 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:35.189097 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9fe2cfe4-da1b-4b96-ad17-548a21e1c085 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:35.189782 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9fe2cfe4-da1b-4b96-ad17-548a21e1c085 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:35.190452 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9fe2cfe4-da1b-4b96-ad17-548a21e1c085 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:35.299334 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-81c582d1-c9af-43e9-ba9e-c5889e4676ad tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:35.311499 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-81c582d1-c9af-43e9-ba9e-c5889e4676ad tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190" status: 200 len: 1315 microversion: 2.1 time: 1.509821 Oct 26 13:31:35.313465 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2793/5615] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:33 2022] GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 => generated 1315 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:35.332194 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a8fce20b-8190-4ed5-9805-57e9911e82eb tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:35.334124 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a8fce20b-8190-4ed5-9805-57e9911e82eb tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] [instance: dc8d9140-3f8d-44ad-86f4-36d67fbe7d19] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:35.343892 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8fce20b-8190-4ed5-9805-57e9911e82eb tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:35.344928 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8fce20b-8190-4ed5-9805-57e9911e82eb tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:35.346312 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8fce20b-8190-4ed5-9805-57e9911e82eb tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:35.347296 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8fce20b-8190-4ed5-9805-57e9911e82eb tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:35.347980 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8fce20b-8190-4ed5-9805-57e9911e82eb tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:35.348570 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8fce20b-8190-4ed5-9805-57e9911e82eb tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:35.605745 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a8fce20b-8190-4ed5-9805-57e9911e82eb tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f745ae4d44f4cdebb40e233b0deed7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d89db2ac0141d694e64f474244e527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:35.619866 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a8fce20b-8190-4ed5-9805-57e9911e82eb tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] 10.222.0.40 "GET /compute/v2.1/servers/dc8d9140-3f8d-44ad-86f4-36d67fbe7d19" status: 200 len: 1469 microversion: 2.1 time: 0.303601 Oct 26 13:31:35.620533 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2794/5616] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:35 2022] GET /compute/v2.1/servers/dc8d9140-3f8d-44ad-86f4-36d67fbe7d19 => generated 1469 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:35.678935 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9fe2cfe4-da1b-4b96-ad17-548a21e1c085 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:35.705879 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9fe2cfe4-da1b-4b96-ad17-548a21e1c085 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.534157 Oct 26 13:31:35.706583 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2823/5617] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:35 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:35.735039 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9d80d954-0d4c-4013-a1a2-04859061084a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:31:35.735684 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9d80d954-0d4c-4013-a1a2-04859061084a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:35.743259 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9d80d954-0d4c-4013-a1a2-04859061084a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:35.744309 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9d80d954-0d4c-4013-a1a2-04859061084a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:35.744748 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9d80d954-0d4c-4013-a1a2-04859061084a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:35.745456 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9d80d954-0d4c-4013-a1a2-04859061084a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:35.745938 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9d80d954-0d4c-4013-a1a2-04859061084a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:35.746366 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9d80d954-0d4c-4013-a1a2-04859061084a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:35.756569 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:31:35.843503 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-581b98f2-dc84-4c16-a16c-8ee9444d3fbd tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1510011682", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:31:35.844797 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-9d80d954-0d4c-4013-a1a2-04859061084a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] HTTP exception thrown: Cannot 'unshelve' instance f573d46e-77d2-4405-baef-2bb447d4b5e7 while it is in vm_state active Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9d80d954-0d4c-4013-a1a2-04859061084a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Request method failure captured: Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7/action HTTP/1.1 Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 18 Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTWpf9Job1by08RPlBi4BK3ZRus12IuUwpixxL0U8NmqouWwnfDFM_ku9arLt0Dfw_g2zljJol9iSiPHbr2OBJI9bA6xxReUYgF5HT4trI936uilzQCNXRfNWHD8SC65BfL8JHiNMAmXVHxHedc9hkhsO-eHURoIHHJwTTh6ig9qSq0 Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/088eb22706844984b58fe118d5421cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_088eb22706844984b58fe118d5421cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}] Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 9b8db27e3baf4b6a948f6d23c04cf680 Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: {"unshelve": null} Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: exception: Cannot 'unshelve' instance f573d46e-77d2-4405-baef-2bb447d4b5e7 while it is in vm_state active Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'f573d46e-77d2-4405-baef-2bb447d4b5e7', 'body': {'unshelve': None}} Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f573d46e-77d2-4405-baef-2bb447d4b5e7 in vm_state active. Cannot unshelve while the instance is in this state. Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 26 13:31:35.846839 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 26 13:31:35.851345 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance f573d46e-77d2-4405-baef-2bb447d4b5e7 while it is in vm_state active Oct 26 13:31:35.851345 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:31:35.851345 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:31:35.851345 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:31:35.851345 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:31:35.851345 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:31:35.851345 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:31:35.851345 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:31:35.851345 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:31:35.851345 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance f573d46e-77d2-4405-baef-2bb447d4b5e7 while it is in vm_state active Oct 26 13:31:35.851345 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:31:35.854692 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9d80d954-0d4c-4013-a1a2-04859061084a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Returning 409 to user: Cannot 'unshelve' instance f573d46e-77d2-4405-baef-2bb447d4b5e7 while it is in vm_state active {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:31:35.856418 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9d80d954-0d4c-4013-a1a2-04859061084a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "POST /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7/action" status: 409 len: 146 microversion: 2.1 time: 0.126116 Oct 26 13:31:35.857553 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2795/5618] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:31:35 2022] POST /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7/action => generated 146 bytes in 128 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 26 13:31:35.866751 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ed00a2a2-df0f-4924-be90-bfacebc469a8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:35.867643 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ed00a2a2-df0f-4924-be90-bfacebc469a8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:35.885727 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed00a2a2-df0f-4924-be90-bfacebc469a8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:35.886768 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed00a2a2-df0f-4924-be90-bfacebc469a8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:35.887706 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed00a2a2-df0f-4924-be90-bfacebc469a8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:35.888692 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed00a2a2-df0f-4924-be90-bfacebc469a8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:35.889318 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed00a2a2-df0f-4924-be90-bfacebc469a8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:35.890342 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed00a2a2-df0f-4924-be90-bfacebc469a8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:35.947983 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-581b98f2-dc84-4c16-a16c-8ee9444d3fbd tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] validate_networks() for None {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:31:36.267051 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ed00a2a2-df0f-4924-be90-bfacebc469a8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:36.279966 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ed00a2a2-df0f-4924-be90-bfacebc469a8 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.418380 Oct 26 13:31:36.282614 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2796/5619] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:35 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:31:36.307661 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e893b7bd-13d3-41be-a800-aef98a1647a3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:36.309068 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e893b7bd-13d3-41be-a800-aef98a1647a3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:36.333887 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e893b7bd-13d3-41be-a800-aef98a1647a3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:36.336900 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e893b7bd-13d3-41be-a800-aef98a1647a3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:36.338454 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e893b7bd-13d3-41be-a800-aef98a1647a3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:36.343238 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e893b7bd-13d3-41be-a800-aef98a1647a3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:36.343824 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e893b7bd-13d3-41be-a800-aef98a1647a3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:36.344346 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e893b7bd-13d3-41be-a800-aef98a1647a3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:36.612945 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e893b7bd-13d3-41be-a800-aef98a1647a3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:36.633937 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e893b7bd-13d3-41be-a800-aef98a1647a3 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.330215 Oct 26 13:31:36.635846 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2797/5620] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:36 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:31:36.657829 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-581b98f2-dc84-4c16-a16c-8ee9444d3fbd tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:31:36.658356 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-581b98f2-dc84-4c16-a16c-8ee9444d3fbd tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:31:36.658829 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-581b98f2-dc84-4c16-a16c-8ee9444d3fbd tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:31:36.659316 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-581b98f2-dc84-4c16-a16c-8ee9444d3fbd tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:31:36.659816 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-581b98f2-dc84-4c16-a16c-8ee9444d3fbd tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:31:36.666678 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cc6f97df-c99f-4740-b680-bad1961ca1b2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:36.669859 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cc6f97df-c99f-4740-b680-bad1961ca1b2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:36.678131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-581b98f2-dc84-4c16-a16c-8ee9444d3fbd tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:36.679432 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-581b98f2-dc84-4c16-a16c-8ee9444d3fbd tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:36.680000 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-581b98f2-dc84-4c16-a16c-8ee9444d3fbd tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:36.682813 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-581b98f2-dc84-4c16-a16c-8ee9444d3fbd tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:36.685579 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc6f97df-c99f-4740-b680-bad1961ca1b2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:36.686076 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-581b98f2-dc84-4c16-a16c-8ee9444d3fbd tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:36.686812 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-581b98f2-dc84-4c16-a16c-8ee9444d3fbd tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:36.687727 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc6f97df-c99f-4740-b680-bad1961ca1b2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:36.688380 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc6f97df-c99f-4740-b680-bad1961ca1b2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:36.690935 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc6f97df-c99f-4740-b680-bad1961ca1b2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:36.692271 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc6f97df-c99f-4740-b680-bad1961ca1b2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:36.694279 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc6f97df-c99f-4740-b680-bad1961ca1b2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:36.715425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-581b98f2-dc84-4c16-a16c-8ee9444d3fbd tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Getting quotas for project fb208abbe6784b7692cc1460fc60d7e7. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:31:36.749056 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-581b98f2-dc84-4c16-a16c-8ee9444d3fbd tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Getting quotas for user 2fe198b313144b0f9089de1d0b62e8e3 and project fb208abbe6784b7692cc1460fc60d7e7. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:31:36.794253 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-581b98f2-dc84-4c16-a16c-8ee9444d3fbd tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:31:36.799787 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-581b98f2-dc84-4c16-a16c-8ee9444d3fbd tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] [instance: 4d2e95a1-588c-43ff-9af0-4d52676793b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:31:36.925299 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-581b98f2-dc84-4c16-a16c-8ee9444d3fbd tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.085213 Oct 26 13:31:36.931168 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2824/5621] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:31:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1096 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:31:36.943314 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ffcdde4c-842e-4cc2-b102-83cfe18cc98a tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:36.944306 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ffcdde4c-842e-4cc2-b102-83cfe18cc98a tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] [instance: dc8d9140-3f8d-44ad-86f4-36d67fbe7d19] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:36.956458 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ffcdde4c-842e-4cc2-b102-83cfe18cc98a tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:36.957374 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ffcdde4c-842e-4cc2-b102-83cfe18cc98a tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:36.958096 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ffcdde4c-842e-4cc2-b102-83cfe18cc98a tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:36.959532 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ffcdde4c-842e-4cc2-b102-83cfe18cc98a tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:36.960214 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ffcdde4c-842e-4cc2-b102-83cfe18cc98a tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:36.960872 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ffcdde4c-842e-4cc2-b102-83cfe18cc98a tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:36.970898 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cc6f97df-c99f-4740-b680-bad1961ca1b2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:36.982554 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cc6f97df-c99f-4740-b680-bad1961ca1b2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190" status: 200 len: 1315 microversion: 2.1 time: 0.329276 Oct 26 13:31:36.983374 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2798/5622] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:36 2022] GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 => generated 1315 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:37.007880 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-93fa9aa7-ce37-4d5b-8dc3-02330c349566 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1100020886_updated"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:31:37.020298 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-93fa9aa7-ce37-4d5b-8dc3-02330c349566 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: b4844abf-4e7b-4b73-8b3a-d5ecd318c13b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:37.037879 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-93fa9aa7-ce37-4d5b-8dc3-02330c349566 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] HTTP exception thrown: Instance b4844abf-4e7b-4b73-8b3a-d5ecd318c13b could not be found. Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-93fa9aa7-ce37-4d5b-8dc3-02330c349566 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Request method failure captured: Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: request: PUT /compute/v2.1/servers/b4844abf-4e7b-4b73-8b3a-d5ecd318c13b HTTP/1.1 Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 81 Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTWpf9Job1by08RPlBi4BK3ZRus12IuUwpixxL0U8NmqouWwnfDFM_ku9arLt0Dfw_g2zljJol9iSiPHbr2OBJI9bA6xxReUYgF5HT4trI936uilzQCNXRfNWHD8SC65BfL8JHiNMAmXVHxHedc9hkhsO-eHURoIHHJwTTh6ig9qSq0 Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/088eb22706844984b58fe118d5421cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_088eb22706844984b58fe118d5421cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}] Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 9b8db27e3baf4b6a948f6d23c04cf680 Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1100020886_updated"}} Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance b4844abf-4e7b-4b73-8b3a-d5ecd318c13b could not be found. Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'b4844abf-4e7b-4b73-8b3a-d5ecd318c13b', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1100020886_updated'}}} Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4844abf-4e7b-4b73-8b3a-d5ecd318c13b could not be found. Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 26 13:31:37.040133 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:31:37.045084 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:31:37.045084 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:31:37.045084 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:31:37.045084 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4844abf-4e7b-4b73-8b3a-d5ecd318c13b could not be found. Oct 26 13:31:37.045084 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:31:37.045084 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:31:37.045084 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:31:37.045084 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:31:37.045084 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:31:37.045084 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:31:37.045084 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:31:37.045084 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:31:37.045084 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4844abf-4e7b-4b73-8b3a-d5ecd318c13b could not be found. Oct 26 13:31:37.045084 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:31:37.047435 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-93fa9aa7-ce37-4d5b-8dc3-02330c349566 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Returning 404 to user: Instance b4844abf-4e7b-4b73-8b3a-d5ecd318c13b could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:31:37.049983 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-93fa9aa7-ce37-4d5b-8dc3-02330c349566 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "PUT /compute/v2.1/servers/b4844abf-4e7b-4b73-8b3a-d5ecd318c13b" status: 404 len: 111 microversion: 2.1 time: 0.063343 Oct 26 13:31:37.053834 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2799/5623] 10.222.0.40 () {60 vars in 1256 bytes} [Wed Oct 26 13:31:36 2022] PUT /compute/v2.1/servers/b4844abf-4e7b-4b73-8b3a-d5ecd318c13b => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:31:37.071462 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-42925940-3ad7-4106-be80-018165bfb3bc tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:37.074210 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-42925940-3ad7-4106-be80-018165bfb3bc tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] [instance: 4d2e95a1-588c-43ff-9af0-4d52676793b1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:37.690871 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ffcdde4c-842e-4cc2-b102-83cfe18cc98a tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f745ae4d44f4cdebb40e233b0deed7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d89db2ac0141d694e64f474244e527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:37.692843 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-42925940-3ad7-4106-be80-018165bfb3bc tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe198b313144b0f9089de1d0b62e8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb208abbe6784b7692cc1460fc60d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:37.710228 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ffcdde4c-842e-4cc2-b102-83cfe18cc98a tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] 10.222.0.40 "GET /compute/v2.1/servers/dc8d9140-3f8d-44ad-86f4-36d67fbe7d19" status: 200 len: 1469 microversion: 2.1 time: 0.768876 Oct 26 13:31:37.725993 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-42925940-3ad7-4106-be80-018165bfb3bc tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] 10.222.0.40 "GET /compute/v2.1/servers/4d2e95a1-588c-43ff-9af0-4d52676793b1" status: 200 len: 1214 microversion: 2.1 time: 0.666733 Oct 26 13:31:37.741508 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2825/5624] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:36 2022] GET /compute/v2.1/servers/dc8d9140-3f8d-44ad-86f4-36d67fbe7d19 => generated 1469 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:37.741508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-14ddb60e-38d4-4ed3-9f1d-9908505e2901 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:37.741508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-14ddb60e-38d4-4ed3-9f1d-9908505e2901 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:37.748294 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2800/5625] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:37 2022] GET /compute/v2.1/servers/4d2e95a1-588c-43ff-9af0-4d52676793b1 => generated 1214 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:37.761048 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-14ddb60e-38d4-4ed3-9f1d-9908505e2901 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:37.782991 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-14ddb60e-38d4-4ed3-9f1d-9908505e2901 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:37.785015 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-14ddb60e-38d4-4ed3-9f1d-9908505e2901 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:37.787231 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-14ddb60e-38d4-4ed3-9f1d-9908505e2901 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:37.787874 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-14ddb60e-38d4-4ed3-9f1d-9908505e2901 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:37.788420 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-14ddb60e-38d4-4ed3-9f1d-9908505e2901 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:38.012126 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2b2aaf03-1f49-4fc8-adb0-d64f5ccddb79 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:38.013455 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2b2aaf03-1f49-4fc8-adb0-d64f5ccddb79 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:38.049098 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b2aaf03-1f49-4fc8-adb0-d64f5ccddb79 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:38.053319 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b2aaf03-1f49-4fc8-adb0-d64f5ccddb79 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:38.055673 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b2aaf03-1f49-4fc8-adb0-d64f5ccddb79 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:38.060753 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b2aaf03-1f49-4fc8-adb0-d64f5ccddb79 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:38.066735 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b2aaf03-1f49-4fc8-adb0-d64f5ccddb79 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:38.067765 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b2aaf03-1f49-4fc8-adb0-d64f5ccddb79 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:38.852623 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2b2aaf03-1f49-4fc8-adb0-d64f5ccddb79 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:38.894220 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2b2aaf03-1f49-4fc8-adb0-d64f5ccddb79 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190" status: 200 len: 1315 microversion: 2.1 time: 0.888542 Oct 26 13:31:38.913702 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2801/5626] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:38 2022] GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 => generated 1315 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:31:38.925222 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-714b89da-1ac8-46a9-bb40-97ac9508538b tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:38.932019 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-714b89da-1ac8-46a9-bb40-97ac9508538b tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] [instance: dc8d9140-3f8d-44ad-86f4-36d67fbe7d19] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:38.947832 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-714b89da-1ac8-46a9-bb40-97ac9508538b tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:38.948631 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-714b89da-1ac8-46a9-bb40-97ac9508538b tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:38.949239 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-714b89da-1ac8-46a9-bb40-97ac9508538b tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:38.950240 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-714b89da-1ac8-46a9-bb40-97ac9508538b tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:38.950848 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-714b89da-1ac8-46a9-bb40-97ac9508538b tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:38.951447 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-714b89da-1ac8-46a9-bb40-97ac9508538b tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:38.952383 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-14ddb60e-38d4-4ed3-9f1d-9908505e2901 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:38.989247 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-14ddb60e-38d4-4ed3-9f1d-9908505e2901 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 1.258027 Oct 26 13:31:39.002102 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2826/5627] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:37 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:39.011913 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5899020a-1ed3-4da8-acdb-861bcffc9de3 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:39.012545 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5899020a-1ed3-4da8-acdb-861bcffc9de3 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] [instance: 4d2e95a1-588c-43ff-9af0-4d52676793b1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:39.040023 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5899020a-1ed3-4da8-acdb-861bcffc9de3 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:39.042753 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5899020a-1ed3-4da8-acdb-861bcffc9de3 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:39.044221 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5899020a-1ed3-4da8-acdb-861bcffc9de3 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:39.047944 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5899020a-1ed3-4da8-acdb-861bcffc9de3 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:39.048950 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5899020a-1ed3-4da8-acdb-861bcffc9de3 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:39.051087 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5899020a-1ed3-4da8-acdb-861bcffc9de3 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:39.345498 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5899020a-1ed3-4da8-acdb-861bcffc9de3 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe198b313144b0f9089de1d0b62e8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb208abbe6784b7692cc1460fc60d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:39.397712 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5899020a-1ed3-4da8-acdb-861bcffc9de3 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] 10.222.0.40 "GET /compute/v2.1/servers/4d2e95a1-588c-43ff-9af0-4d52676793b1" status: 200 len: 1266 microversion: 2.1 time: 0.394254 Oct 26 13:31:39.420088 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2827/5628] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:39 2022] GET /compute/v2.1/servers/4d2e95a1-588c-43ff-9af0-4d52676793b1 => generated 1266 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:39.423641 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b81ab430-1f85-4b7c-b16e-55572ad96c16 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:39.428490 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b81ab430-1f85-4b7c-b16e-55572ad96c16 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:39.458720 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b81ab430-1f85-4b7c-b16e-55572ad96c16 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:39.459601 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b81ab430-1f85-4b7c-b16e-55572ad96c16 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:39.460273 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b81ab430-1f85-4b7c-b16e-55572ad96c16 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:39.464754 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b81ab430-1f85-4b7c-b16e-55572ad96c16 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:39.466937 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b81ab430-1f85-4b7c-b16e-55572ad96c16 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:39.478480 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b81ab430-1f85-4b7c-b16e-55572ad96c16 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:40.224206 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b81ab430-1f85-4b7c-b16e-55572ad96c16 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:40.238980 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b81ab430-1f85-4b7c-b16e-55572ad96c16 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.829725 Oct 26 13:31:40.243102 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2828/5629] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:39 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:40.262122 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a5cf1441-e886-48d8-ab0c-235cec74c9b8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:40.263090 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a5cf1441-e886-48d8-ab0c-235cec74c9b8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:40.283756 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5cf1441-e886-48d8-ab0c-235cec74c9b8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:40.285718 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5cf1441-e886-48d8-ab0c-235cec74c9b8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:40.287644 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5cf1441-e886-48d8-ab0c-235cec74c9b8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:40.288867 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5cf1441-e886-48d8-ab0c-235cec74c9b8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:40.295986 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5cf1441-e886-48d8-ab0c-235cec74c9b8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:40.297113 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5cf1441-e886-48d8-ab0c-235cec74c9b8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:40.620490 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-714b89da-1ac8-46a9-bb40-97ac9508538b tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f745ae4d44f4cdebb40e233b0deed7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d89db2ac0141d694e64f474244e527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:40.640292 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-714b89da-1ac8-46a9-bb40-97ac9508538b tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] 10.222.0.40 "GET /compute/v2.1/servers/dc8d9140-3f8d-44ad-86f4-36d67fbe7d19" status: 200 len: 1469 microversion: 2.1 time: 1.725338 Oct 26 13:31:40.645731 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2802/5630] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:38 2022] GET /compute/v2.1/servers/dc8d9140-3f8d-44ad-86f4-36d67fbe7d19 => generated 1469 bytes in 1731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:40.663581 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-90fdbe26-6af0-4d11-96e3-c9a9fdc75e9f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-90fdbe26-6af0-4d11-96e3-c9a9fdc75e9f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Request method failure captured: Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: request: PUT /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 HTTP/1.1 Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 280 Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTWpf9Job1by08RPlBi4BK3ZRus12IuUwpixxL0U8NmqouWwnfDFM_ku9arLt0Dfw_g2zljJol9iSiPHbr2OBJI9bA6xxReUYgF5HT4trI936uilzQCNXRfNWHD8SC65BfL8JHiNMAmXVHxHedc9hkhsO-eHURoIHHJwTTh6ig9qSq0 Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/088eb22706844984b58fe118d5421cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_088eb22706844984b58fe118d5421cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}] Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 9b8db27e3baf4b6a948f6d23c04cf680 Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'f573d46e-77d2-4405-baef-2bb447d4b5e7', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise error Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:31:40.683539 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:31:40.688747 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:31:40.688747 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:31:40.688747 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:31:40.688747 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:31:40.688747 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:31:40.688747 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:31:40.688747 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:31:40.688747 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:31:40.688747 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 13:31:40.688747 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 13:31:40.688747 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 13:31:40.688747 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 13:31:40.688747 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 13:31:40.688747 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 13:31:40.688747 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 26 13:31:40.688747 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:31:40.688747 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:31:40.688747 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:31:40.688747 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:31:40.688747 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:31:40.688747 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:31:40.688747 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 13:31:40.688747 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 13:31:40.688747 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 26 13:31:40.688747 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:31:40.693749 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-90fdbe26-6af0-4d11-96e3-c9a9fdc75e9f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:31:40.695525 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-90fdbe26-6af0-4d11-96e3-c9a9fdc75e9f tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "PUT /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 400 len: 619 microversion: 2.1 time: 0.047835 Oct 26 13:31:40.696427 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2803/5631] 10.222.0.40 () {60 vars in 1257 bytes} [Wed Oct 26 13:31:40 2022] PUT /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 619 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:31:40.708986 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6399b956-96b1-4ed6-b23c-2e3280b5081d tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:40.712678 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6399b956-96b1-4ed6-b23c-2e3280b5081d tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] [instance: 4d2e95a1-588c-43ff-9af0-4d52676793b1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:40.735349 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6399b956-96b1-4ed6-b23c-2e3280b5081d tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:40.736760 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6399b956-96b1-4ed6-b23c-2e3280b5081d tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:40.737970 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6399b956-96b1-4ed6-b23c-2e3280b5081d tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:40.739499 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6399b956-96b1-4ed6-b23c-2e3280b5081d tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:40.750520 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6399b956-96b1-4ed6-b23c-2e3280b5081d tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:40.751562 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6399b956-96b1-4ed6-b23c-2e3280b5081d tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:41.086519 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a5cf1441-e886-48d8-ab0c-235cec74c9b8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:41.097852 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a5cf1441-e886-48d8-ab0c-235cec74c9b8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190" status: 200 len: 1315 microversion: 2.1 time: 0.852361 Oct 26 13:31:41.099005 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2829/5632] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:40 2022] GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 => generated 1315 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:41.108767 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b5c051d0-24df-4642-9cdb-c3f5982516b2 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:41.110593 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b5c051d0-24df-4642-9cdb-c3f5982516b2 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:41.125349 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5c051d0-24df-4642-9cdb-c3f5982516b2 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:41.126433 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5c051d0-24df-4642-9cdb-c3f5982516b2 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:41.127081 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5c051d0-24df-4642-9cdb-c3f5982516b2 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:41.130609 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5c051d0-24df-4642-9cdb-c3f5982516b2 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:41.132010 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5c051d0-24df-4642-9cdb-c3f5982516b2 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:41.136549 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5c051d0-24df-4642-9cdb-c3f5982516b2 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:41.187469 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6399b956-96b1-4ed6-b23c-2e3280b5081d tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe198b313144b0f9089de1d0b62e8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb208abbe6784b7692cc1460fc60d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:41.210860 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6399b956-96b1-4ed6-b23c-2e3280b5081d tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] 10.222.0.40 "GET /compute/v2.1/servers/4d2e95a1-588c-43ff-9af0-4d52676793b1" status: 200 len: 1272 microversion: 2.1 time: 0.512017 Oct 26 13:31:41.211460 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2804/5633] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:40 2022] GET /compute/v2.1/servers/4d2e95a1-588c-43ff-9af0-4d52676793b1 => generated 1272 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:41.538932 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b5c051d0-24df-4642-9cdb-c3f5982516b2 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:41.554466 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b5c051d0-24df-4642-9cdb-c3f5982516b2 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.454120 Oct 26 13:31:41.560182 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2830/5634] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:41 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:41.583170 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ee8a3223-d876-4ae3-b96c-b705b4825a41 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:41.584201 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ee8a3223-d876-4ae3-b96c-b705b4825a41 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:41.593461 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ee8a3223-d876-4ae3-b96c-b705b4825a41 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:41.594435 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ee8a3223-d876-4ae3-b96c-b705b4825a41 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:41.595117 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ee8a3223-d876-4ae3-b96c-b705b4825a41 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:41.596058 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ee8a3223-d876-4ae3-b96c-b705b4825a41 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:41.597741 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ee8a3223-d876-4ae3-b96c-b705b4825a41 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:41.598630 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ee8a3223-d876-4ae3-b96c-b705b4825a41 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:41.670259 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7f948943-a754-4fa9-b047-78672ef906a0 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:41.670878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7f948943-a754-4fa9-b047-78672ef906a0 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] [instance: dc8d9140-3f8d-44ad-86f4-36d67fbe7d19] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:41.698281 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f948943-a754-4fa9-b047-78672ef906a0 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:41.698962 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f948943-a754-4fa9-b047-78672ef906a0 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:41.699517 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f948943-a754-4fa9-b047-78672ef906a0 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:41.701818 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f948943-a754-4fa9-b047-78672ef906a0 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:41.702516 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f948943-a754-4fa9-b047-78672ef906a0 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:41.703293 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f948943-a754-4fa9-b047-78672ef906a0 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:42.174868 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ee8a3223-d876-4ae3-b96c-b705b4825a41 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:42.247819 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ee8a3223-d876-4ae3-b96c-b705b4825a41 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.662601 Oct 26 13:31:42.287866 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2805/5635] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:41 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:42.287866 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3b79c0b5-29a3-49b0-935d-e576bf11891e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:42.287866 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3b79c0b5-29a3-49b0-935d-e576bf11891e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:42.287866 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3b79c0b5-29a3-49b0-935d-e576bf11891e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:42.287866 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3b79c0b5-29a3-49b0-935d-e576bf11891e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:42.287866 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3b79c0b5-29a3-49b0-935d-e576bf11891e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:42.287866 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3b79c0b5-29a3-49b0-935d-e576bf11891e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:42.287866 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3b79c0b5-29a3-49b0-935d-e576bf11891e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:42.287866 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3b79c0b5-29a3-49b0-935d-e576bf11891e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:42.304113 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7f948943-a754-4fa9-b047-78672ef906a0 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f745ae4d44f4cdebb40e233b0deed7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d89db2ac0141d694e64f474244e527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:42.318740 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7f948943-a754-4fa9-b047-78672ef906a0 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] 10.222.0.40 "GET /compute/v2.1/servers/dc8d9140-3f8d-44ad-86f4-36d67fbe7d19" status: 200 len: 1469 microversion: 2.1 time: 0.647800 Oct 26 13:31:42.319644 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2831/5636] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:41 2022] GET /compute/v2.1/servers/dc8d9140-3f8d-44ad-86f4-36d67fbe7d19 => generated 1469 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:31:42.330460 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-36d56195-fe27-403e-a0d7-ca1e93d783d0 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:42.332747 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-36d56195-fe27-403e-a0d7-ca1e93d783d0 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] [instance: 4d2e95a1-588c-43ff-9af0-4d52676793b1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:42.356506 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-36d56195-fe27-403e-a0d7-ca1e93d783d0 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:42.359861 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-36d56195-fe27-403e-a0d7-ca1e93d783d0 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:42.360317 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-36d56195-fe27-403e-a0d7-ca1e93d783d0 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:42.374456 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-36d56195-fe27-403e-a0d7-ca1e93d783d0 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:42.376975 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-36d56195-fe27-403e-a0d7-ca1e93d783d0 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:42.378548 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-36d56195-fe27-403e-a0d7-ca1e93d783d0 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:42.581499 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-36d56195-fe27-403e-a0d7-ca1e93d783d0 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe198b313144b0f9089de1d0b62e8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb208abbe6784b7692cc1460fc60d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:42.598642 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-36d56195-fe27-403e-a0d7-ca1e93d783d0 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] 10.222.0.40 "GET /compute/v2.1/servers/4d2e95a1-588c-43ff-9af0-4d52676793b1" status: 200 len: 1272 microversion: 2.1 time: 0.277648 Oct 26 13:31:42.599263 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2832/5637] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:42 2022] GET /compute/v2.1/servers/4d2e95a1-588c-43ff-9af0-4d52676793b1 => generated 1272 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:42.613611 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c4924683-9150-408f-9489-d5ecf51bfce2 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c4924683-9150-408f-9489-d5ecf51bfce2 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Request method failure captured: Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: request: PUT /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 HTTP/1.1 Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 24 Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTWpf9Job1by08RPlBi4BK3ZRus12IuUwpixxL0U8NmqouWwnfDFM_ku9arLt0Dfw_g2zljJol9iSiPHbr2OBJI9bA6xxReUYgF5HT4trI936uilzQCNXRfNWHD8SC65BfL8JHiNMAmXVHxHedc9hkhsO-eHURoIHHJwTTh6ig9qSq0 Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/088eb22706844984b58fe118d5421cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_088eb22706844984b58fe118d5421cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}] Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 9b8db27e3baf4b6a948f6d23c04cf680 Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: {"server": {"name": ""}} Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'f573d46e-77d2-4405-baef-2bb447d4b5e7', 'body': {'server': {'name': ''}}} Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise error Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi '' Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 13:31:42.625099 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 26 13:31:42.629128 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:31:42.629128 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:31:42.629128 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:31:42.629128 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:31:42.629128 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:31:42.629128 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:31:42.629128 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 13:31:42.629128 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 13:31:42.629128 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 26 13:31:42.629128 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:31:42.636875 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c4924683-9150-408f-9489-d5ecf51bfce2 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:31:42.638112 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c4924683-9150-408f-9489-d5ecf51bfce2 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "PUT /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 400 len: 108 microversion: 2.1 time: 0.037897 Oct 26 13:31:42.638953 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2833/5638] 10.222.0.40 () {60 vars in 1256 bytes} [Wed Oct 26 13:31:42 2022] PUT /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 108 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:31:42.646861 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-da88d80c-c988-40df-9e11-685f7ddc3f13 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:42.650890 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-da88d80c-c988-40df-9e11-685f7ddc3f13 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:42.668079 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da88d80c-c988-40df-9e11-685f7ddc3f13 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:42.670125 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da88d80c-c988-40df-9e11-685f7ddc3f13 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:42.675684 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da88d80c-c988-40df-9e11-685f7ddc3f13 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:42.677334 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da88d80c-c988-40df-9e11-685f7ddc3f13 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:42.677993 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da88d80c-c988-40df-9e11-685f7ddc3f13 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:42.678487 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da88d80c-c988-40df-9e11-685f7ddc3f13 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:42.682721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:31:43.256539 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-da88d80c-c988-40df-9e11-685f7ddc3f13 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:43.267177 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-da88d80c-c988-40df-9e11-685f7ddc3f13 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1506 microversion: 2.1 time: 0.623944 Oct 26 13:31:43.269107 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2834/5639] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:42 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1506 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:31:43.284211 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-df83aef6-8a3a-47c3-a70b-b9fde25458bd req-8b499b4c-9076-4127-828a-3b80c3d6f6ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc8d9140-3f8d-44ad-86f4-36d67fbe7d19", "name": "network-vif-plugged", "status": "completed", "tag": "f7033ea2-06ce-4a5d-89e9-d5ec1bb05d04"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:31:43.315549 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-df83aef6-8a3a-47c3-a70b-b9fde25458bd req-8b499b4c-9076-4127-828a-3b80c3d6f6ad service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:43.318845 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-df83aef6-8a3a-47c3-a70b-b9fde25458bd req-8b499b4c-9076-4127-828a-3b80c3d6f6ad service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:43.319302 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-df83aef6-8a3a-47c3-a70b-b9fde25458bd req-8b499b4c-9076-4127-828a-3b80c3d6f6ad service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:43.364053 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-df83aef6-8a3a-47c3-a70b-b9fde25458bd req-8b499b4c-9076-4127-828a-3b80c3d6f6ad service nova] Creating event network-vif-plugged:f7033ea2-06ce-4a5d-89e9-d5ec1bb05d04 for instance dc8d9140-3f8d-44ad-86f4-36d67fbe7d19 on n-h2-862686-1 Oct 26 13:31:43.364053 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-df83aef6-8a3a-47c3-a70b-b9fde25458bd req-8b499b4c-9076-4127-828a-3b80c3d6f6ad service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084970 Oct 26 13:31:43.364053 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2835/5640] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:31:43.365353 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8ebcf69b-ae6a-45e0-9ffc-2b9bd80351a0 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:43.366098 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8ebcf69b-ae6a-45e0-9ffc-2b9bd80351a0 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] [instance: dc8d9140-3f8d-44ad-86f4-36d67fbe7d19] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:43.420883 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8ebcf69b-ae6a-45e0-9ffc-2b9bd80351a0 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:43.429793 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8ebcf69b-ae6a-45e0-9ffc-2b9bd80351a0 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:43.432616 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8ebcf69b-ae6a-45e0-9ffc-2b9bd80351a0 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:43.435820 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8ebcf69b-ae6a-45e0-9ffc-2b9bd80351a0 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:43.436320 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8ebcf69b-ae6a-45e0-9ffc-2b9bd80351a0 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:43.436767 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8ebcf69b-ae6a-45e0-9ffc-2b9bd80351a0 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:43.479520 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3b79c0b5-29a3-49b0-935d-e576bf11891e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:43.528972 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3b79c0b5-29a3-49b0-935d-e576bf11891e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190" status: 200 len: 1315 microversion: 2.1 time: 1.279055 Oct 26 13:31:43.538578 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2806/5641] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:42 2022] GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 => generated 1315 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:43.627575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4adfdaf9-f8d0-4cfb-8fd8-f756d5cfc3ce tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:43.628322 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4adfdaf9-f8d0-4cfb-8fd8-f756d5cfc3ce tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] [instance: 4d2e95a1-588c-43ff-9af0-4d52676793b1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:43.646548 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4adfdaf9-f8d0-4cfb-8fd8-f756d5cfc3ce tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:43.646980 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4adfdaf9-f8d0-4cfb-8fd8-f756d5cfc3ce tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:43.647498 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4adfdaf9-f8d0-4cfb-8fd8-f756d5cfc3ce tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:43.648226 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4adfdaf9-f8d0-4cfb-8fd8-f756d5cfc3ce tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:43.661270 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4adfdaf9-f8d0-4cfb-8fd8-f756d5cfc3ce tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:43.664444 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4adfdaf9-f8d0-4cfb-8fd8-f756d5cfc3ce tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:44.528780 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8ebcf69b-ae6a-45e0-9ffc-2b9bd80351a0 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f745ae4d44f4cdebb40e233b0deed7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d89db2ac0141d694e64f474244e527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:44.548126 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8ebcf69b-ae6a-45e0-9ffc-2b9bd80351a0 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] 10.222.0.40 "GET /compute/v2.1/servers/dc8d9140-3f8d-44ad-86f4-36d67fbe7d19" status: 200 len: 1469 microversion: 2.1 time: 1.187775 Oct 26 13:31:44.557425 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2836/5642] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:43 2022] GET /compute/v2.1/servers/dc8d9140-3f8d-44ad-86f4-36d67fbe7d19 => generated 1469 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:44.576090 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c6a8a543-ef0c-4961-83da-559fdb3789c2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:44.581718 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c6a8a543-ef0c-4961-83da-559fdb3789c2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:44.602718 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c6a8a543-ef0c-4961-83da-559fdb3789c2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:44.607201 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c6a8a543-ef0c-4961-83da-559fdb3789c2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:44.609088 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c6a8a543-ef0c-4961-83da-559fdb3789c2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:44.609886 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c6a8a543-ef0c-4961-83da-559fdb3789c2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:44.610305 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c6a8a543-ef0c-4961-83da-559fdb3789c2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:44.610730 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c6a8a543-ef0c-4961-83da-559fdb3789c2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:45.046858 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4adfdaf9-f8d0-4cfb-8fd8-f756d5cfc3ce tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe198b313144b0f9089de1d0b62e8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb208abbe6784b7692cc1460fc60d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:45.047377 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c6a8a543-ef0c-4961-83da-559fdb3789c2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:45.060646 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4adfdaf9-f8d0-4cfb-8fd8-f756d5cfc3ce tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] 10.222.0.40 "GET /compute/v2.1/servers/4d2e95a1-588c-43ff-9af0-4d52676793b1" status: 200 len: 1314 microversion: 2.1 time: 1.438030 Oct 26 13:31:45.061892 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2807/5643] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:43 2022] GET /compute/v2.1/servers/4d2e95a1-588c-43ff-9af0-4d52676793b1 => generated 1314 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:45.063822 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c6a8a543-ef0c-4961-83da-559fdb3789c2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190" status: 200 len: 1315 microversion: 2.1 time: 0.492773 Oct 26 13:31:45.065837 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2837/5644] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:44 2022] GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 => generated 1315 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:45.396902 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-caa38b79-db10-4c6d-9317-1510fde26b52 req-4f40a546-f21d-4b0c-a6b3-24e3e2eeeb3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb1b8c75-80fa-4c58-acb0-0a38b1cb4190", "name": "network-vif-plugged", "status": "completed", "tag": "779c4ff9-aef3-47c6-bc9d-fb3332928fb3"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:31:45.423827 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-caa38b79-db10-4c6d-9317-1510fde26b52 req-4f40a546-f21d-4b0c-a6b3-24e3e2eeeb3a service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:45.424510 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-caa38b79-db10-4c6d-9317-1510fde26b52 req-4f40a546-f21d-4b0c-a6b3-24e3e2eeeb3a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:45.425111 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-caa38b79-db10-4c6d-9317-1510fde26b52 req-4f40a546-f21d-4b0c-a6b3-24e3e2eeeb3a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:45.449211 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-caa38b79-db10-4c6d-9317-1510fde26b52 req-4f40a546-f21d-4b0c-a6b3-24e3e2eeeb3a service nova] Creating event network-vif-plugged:779c4ff9-aef3-47c6-bc9d-fb3332928fb3 for instance cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 on n-h1-862686-1 Oct 26 13:31:45.479928 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-caa38b79-db10-4c6d-9317-1510fde26b52 req-4f40a546-f21d-4b0c-a6b3-24e3e2eeeb3a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086612 Oct 26 13:31:45.487034 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2808/5645] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:31:45.605191 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-da6d0542-2b05-47c2-b695-687cef960b76 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:45.605828 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-da6d0542-2b05-47c2-b695-687cef960b76 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] [instance: dc8d9140-3f8d-44ad-86f4-36d67fbe7d19] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:45.625366 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da6d0542-2b05-47c2-b695-687cef960b76 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:45.626151 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da6d0542-2b05-47c2-b695-687cef960b76 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:45.626968 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da6d0542-2b05-47c2-b695-687cef960b76 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:45.628585 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da6d0542-2b05-47c2-b695-687cef960b76 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:45.630314 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da6d0542-2b05-47c2-b695-687cef960b76 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:45.630911 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da6d0542-2b05-47c2-b695-687cef960b76 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:46.096980 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c02bbd5c-416c-492f-a1e7-28fe5291ca50 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:46.100589 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c02bbd5c-416c-492f-a1e7-28fe5291ca50 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] [instance: 4d2e95a1-588c-43ff-9af0-4d52676793b1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:46.125040 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-da6d0542-2b05-47c2-b695-687cef960b76 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f745ae4d44f4cdebb40e233b0deed7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d89db2ac0141d694e64f474244e527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:46.135159 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c02bbd5c-416c-492f-a1e7-28fe5291ca50 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:46.136227 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c02bbd5c-416c-492f-a1e7-28fe5291ca50 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:46.138844 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c02bbd5c-416c-492f-a1e7-28fe5291ca50 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:46.140625 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-da6d0542-2b05-47c2-b695-687cef960b76 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] 10.222.0.40 "GET /compute/v2.1/servers/dc8d9140-3f8d-44ad-86f4-36d67fbe7d19" status: 200 len: 1469 microversion: 2.1 time: 0.540290 Oct 26 13:31:46.143122 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c02bbd5c-416c-492f-a1e7-28fe5291ca50 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:46.143850 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c02bbd5c-416c-492f-a1e7-28fe5291ca50 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:46.146289 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2838/5646] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:45 2022] GET /compute/v2.1/servers/dc8d9140-3f8d-44ad-86f4-36d67fbe7d19 => generated 1469 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:46.146565 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c02bbd5c-416c-492f-a1e7-28fe5291ca50 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:46.170910 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1cce1e1e-4611-48dd-b5a8-6c2b43bca168 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:46.174025 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1cce1e1e-4611-48dd-b5a8-6c2b43bca168 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:46.198118 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1cce1e1e-4611-48dd-b5a8-6c2b43bca168 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:46.202011 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1cce1e1e-4611-48dd-b5a8-6c2b43bca168 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:46.202694 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1cce1e1e-4611-48dd-b5a8-6c2b43bca168 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:46.203754 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1cce1e1e-4611-48dd-b5a8-6c2b43bca168 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:46.207726 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1cce1e1e-4611-48dd-b5a8-6c2b43bca168 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:46.216155 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1cce1e1e-4611-48dd-b5a8-6c2b43bca168 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:46.633542 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1cce1e1e-4611-48dd-b5a8-6c2b43bca168 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:46.643101 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1cce1e1e-4611-48dd-b5a8-6c2b43bca168 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190" status: 200 len: 1315 microversion: 2.1 time: 0.493814 Oct 26 13:31:46.662911 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2839/5647] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:46 2022] GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 => generated 1315 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:46.977160 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c02bbd5c-416c-492f-a1e7-28fe5291ca50 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe198b313144b0f9089de1d0b62e8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb208abbe6784b7692cc1460fc60d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:46.990026 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c02bbd5c-416c-492f-a1e7-28fe5291ca50 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] 10.222.0.40 "GET /compute/v2.1/servers/4d2e95a1-588c-43ff-9af0-4d52676793b1" status: 200 len: 1314 microversion: 2.1 time: 0.906503 Oct 26 13:31:46.991574 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2809/5648] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:46 2022] GET /compute/v2.1/servers/4d2e95a1-588c-43ff-9af0-4d52676793b1 => generated 1314 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:47.177906 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d06754d8-c456-4577-bf72-9b52c1824275 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:47.178872 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d06754d8-c456-4577-bf72-9b52c1824275 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] [instance: dc8d9140-3f8d-44ad-86f4-36d67fbe7d19] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:47.181679 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:31:47.183420 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:31:47.223083 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d06754d8-c456-4577-bf72-9b52c1824275 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:47.225430 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d06754d8-c456-4577-bf72-9b52c1824275 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:47.226655 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d06754d8-c456-4577-bf72-9b52c1824275 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:47.230940 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d06754d8-c456-4577-bf72-9b52c1824275 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:47.231661 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d06754d8-c456-4577-bf72-9b52c1824275 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:47.236634 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d06754d8-c456-4577-bf72-9b52c1824275 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:47.271175 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-3da8b507-642b-4074-bc7a-65229bd20e4c req-9c2eba8b-18e8-48ee-a624-56426a9a3873 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d2e95a1-588c-43ff-9af0-4d52676793b1", "tag": "a07e5852-6157-4962-8e3f-70ecf12ef7ef"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:31:47.310658 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-3da8b507-642b-4074-bc7a-65229bd20e4c req-9c2eba8b-18e8-48ee-a624-56426a9a3873 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:47.314091 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-3da8b507-642b-4074-bc7a-65229bd20e4c req-9c2eba8b-18e8-48ee-a624-56426a9a3873 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:47.329770 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-3da8b507-642b-4074-bc7a-65229bd20e4c req-9c2eba8b-18e8-48ee-a624-56426a9a3873 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:47.387726 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-3da8b507-642b-4074-bc7a-65229bd20e4c req-9c2eba8b-18e8-48ee-a624-56426a9a3873 service nova] Creating event network-changed:a07e5852-6157-4962-8e3f-70ecf12ef7ef for instance 4d2e95a1-588c-43ff-9af0-4d52676793b1 on n-h2-862686-1 Oct 26 13:31:47.439522 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-3da8b507-642b-4074-bc7a-65229bd20e4c req-9c2eba8b-18e8-48ee-a624-56426a9a3873 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172163 Oct 26 13:31:47.440751 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2810/5649] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:31:47.669950 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-89018d75-b2d6-4c9e-b114-0a0309a60e44 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:47.671116 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-89018d75-b2d6-4c9e-b114-0a0309a60e44 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:47.687019 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89018d75-b2d6-4c9e-b114-0a0309a60e44 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:47.689367 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89018d75-b2d6-4c9e-b114-0a0309a60e44 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:47.694455 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89018d75-b2d6-4c9e-b114-0a0309a60e44 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:47.695538 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89018d75-b2d6-4c9e-b114-0a0309a60e44 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:47.698886 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89018d75-b2d6-4c9e-b114-0a0309a60e44 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:47.700858 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89018d75-b2d6-4c9e-b114-0a0309a60e44 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:47.703973 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:31:47.890564 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d06754d8-c456-4577-bf72-9b52c1824275 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f745ae4d44f4cdebb40e233b0deed7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d89db2ac0141d694e64f474244e527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:47.904328 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d06754d8-c456-4577-bf72-9b52c1824275 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] 10.222.0.40 "GET /compute/v2.1/servers/dc8d9140-3f8d-44ad-86f4-36d67fbe7d19" status: 200 len: 1641 microversion: 2.1 time: 0.731627 Oct 26 13:31:47.907905 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2840/5650] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:47 2022] GET /compute/v2.1/servers/dc8d9140-3f8d-44ad-86f4-36d67fbe7d19 => generated 1641 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:47.932122 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1aae832a-824e-4aa4-b9ae-994db82ae267 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:47.932746 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1aae832a-824e-4aa4-b9ae-994db82ae267 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] [instance: dc8d9140-3f8d-44ad-86f4-36d67fbe7d19] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:47.941744 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1aae832a-824e-4aa4-b9ae-994db82ae267 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:47.944498 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1aae832a-824e-4aa4-b9ae-994db82ae267 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:47.946033 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1aae832a-824e-4aa4-b9ae-994db82ae267 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:47.950167 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1aae832a-824e-4aa4-b9ae-994db82ae267 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:47.952232 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1aae832a-824e-4aa4-b9ae-994db82ae267 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:47.952973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1aae832a-824e-4aa4-b9ae-994db82ae267 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:48.357575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-89018d75-b2d6-4c9e-b114-0a0309a60e44 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:48.367374 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-89018d75-b2d6-4c9e-b114-0a0309a60e44 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190" status: 200 len: 1501 microversion: 2.1 time: 0.702739 Oct 26 13:31:48.373841 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2811/5651] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:47 2022] GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 => generated 1501 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:31:48.381854 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-577392ec-8324-4b9b-a826-7f6dd9bb4763 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:48.385336 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-577392ec-8324-4b9b-a826-7f6dd9bb4763 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] [instance: 4d2e95a1-588c-43ff-9af0-4d52676793b1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:48.400828 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-577392ec-8324-4b9b-a826-7f6dd9bb4763 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:48.401870 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-577392ec-8324-4b9b-a826-7f6dd9bb4763 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:48.404102 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-577392ec-8324-4b9b-a826-7f6dd9bb4763 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:48.405304 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-577392ec-8324-4b9b-a826-7f6dd9bb4763 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:48.412257 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-577392ec-8324-4b9b-a826-7f6dd9bb4763 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:48.414800 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-577392ec-8324-4b9b-a826-7f6dd9bb4763 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:48.452744 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1aae832a-824e-4aa4-b9ae-994db82ae267 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f745ae4d44f4cdebb40e233b0deed7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d89db2ac0141d694e64f474244e527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:48.468144 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1aae832a-824e-4aa4-b9ae-994db82ae267 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] 10.222.0.40 "GET /compute/v2.1/servers/dc8d9140-3f8d-44ad-86f4-36d67fbe7d19" status: 200 len: 1641 microversion: 2.1 time: 0.540605 Oct 26 13:31:48.485528 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2841/5652] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:47 2022] GET /compute/v2.1/servers/dc8d9140-3f8d-44ad-86f4-36d67fbe7d19 => generated 1641 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:48.495426 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2f3f5deb-4509-4191-91af-e42f96c2ee16 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:31:48.498269 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2f3f5deb-4509-4191-91af-e42f96c2ee16 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:48.512655 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f3f5deb-4509-4191-91af-e42f96c2ee16 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:48.514775 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f3f5deb-4509-4191-91af-e42f96c2ee16 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:48.515338 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f3f5deb-4509-4191-91af-e42f96c2ee16 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:48.516349 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f3f5deb-4509-4191-91af-e42f96c2ee16 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:48.516981 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f3f5deb-4509-4191-91af-e42f96c2ee16 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:48.517545 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f3f5deb-4509-4191-91af-e42f96c2ee16 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:48.629522 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2f3f5deb-4509-4191-91af-e42f96c2ee16 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "POST /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190/action" status: 202 len: 0 microversion: 2.1 time: 0.143943 Oct 26 13:31:48.632002 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2842/5653] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:31:48 2022] POST /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:31:48.669622 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7bb114b2-e7a1-4832-bfff-5be8f8f075e2 tempest-TestSecurityGroupsBasicOps-445283395 tempest-TestSecurityGroupsBasicOps-445283395-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:48.673167 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7bb114b2-e7a1-4832-bfff-5be8f8f075e2 tempest-TestSecurityGroupsBasicOps-445283395 tempest-TestSecurityGroupsBasicOps-445283395-project-admin] [instance: dc8d9140-3f8d-44ad-86f4-36d67fbe7d19] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:48.681881 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7bb114b2-e7a1-4832-bfff-5be8f8f075e2 tempest-TestSecurityGroupsBasicOps-445283395 tempest-TestSecurityGroupsBasicOps-445283395-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:48.683349 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7bb114b2-e7a1-4832-bfff-5be8f8f075e2 tempest-TestSecurityGroupsBasicOps-445283395 tempest-TestSecurityGroupsBasicOps-445283395-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:48.684073 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7bb114b2-e7a1-4832-bfff-5be8f8f075e2 tempest-TestSecurityGroupsBasicOps-445283395 tempest-TestSecurityGroupsBasicOps-445283395-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:48.685521 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7bb114b2-e7a1-4832-bfff-5be8f8f075e2 tempest-TestSecurityGroupsBasicOps-445283395 tempest-TestSecurityGroupsBasicOps-445283395-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:48.686237 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7bb114b2-e7a1-4832-bfff-5be8f8f075e2 tempest-TestSecurityGroupsBasicOps-445283395 tempest-TestSecurityGroupsBasicOps-445283395-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:48.687263 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7bb114b2-e7a1-4832-bfff-5be8f8f075e2 tempest-TestSecurityGroupsBasicOps-445283395 tempest-TestSecurityGroupsBasicOps-445283395-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:48.913090 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-577392ec-8324-4b9b-a826-7f6dd9bb4763 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe198b313144b0f9089de1d0b62e8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb208abbe6784b7692cc1460fc60d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:48.925839 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-577392ec-8324-4b9b-a826-7f6dd9bb4763 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] 10.222.0.40 "GET /compute/v2.1/servers/4d2e95a1-588c-43ff-9af0-4d52676793b1" status: 200 len: 1314 microversion: 2.1 time: 0.550482 Oct 26 13:31:48.926618 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2812/5654] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:48 2022] GET /compute/v2.1/servers/4d2e95a1-588c-43ff-9af0-4d52676793b1 => generated 1314 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:48.946683 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1fcad9ee-b552-4e98-ad82-1cd085bca375 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:48.947804 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1fcad9ee-b552-4e98-ad82-1cd085bca375 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:48.972340 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1fcad9ee-b552-4e98-ad82-1cd085bca375 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:48.973072 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1fcad9ee-b552-4e98-ad82-1cd085bca375 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:48.973705 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1fcad9ee-b552-4e98-ad82-1cd085bca375 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:48.974567 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1fcad9ee-b552-4e98-ad82-1cd085bca375 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:48.975244 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1fcad9ee-b552-4e98-ad82-1cd085bca375 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:48.975844 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1fcad9ee-b552-4e98-ad82-1cd085bca375 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:49.315016 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7bb114b2-e7a1-4832-bfff-5be8f8f075e2 tempest-TestSecurityGroupsBasicOps-445283395 tempest-TestSecurityGroupsBasicOps-445283395-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/dc8d9140-3f8d-44ad-86f4-36d67fbe7d19" status: 200 len: 1792 microversion: 2.1 time: 0.667904 Oct 26 13:31:49.315681 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2843/5655] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:48 2022] GET /compute/v2.1/servers/dc8d9140-3f8d-44ad-86f4-36d67fbe7d19 => generated 1792 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:49.545351 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1fcad9ee-b552-4e98-ad82-1cd085bca375 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:49.557564 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1fcad9ee-b552-4e98-ad82-1cd085bca375 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190" status: 200 len: 1486 microversion: 2.1 time: 0.629353 Oct 26 13:31:49.566383 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2813/5656] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:48 2022] GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 => generated 1486 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:49.587855 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1f13fcaa-7473-4248-b50d-517a8a2d1ded tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:31:49.588472 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1f13fcaa-7473-4248-b50d-517a8a2d1ded tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:49.607255 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f13fcaa-7473-4248-b50d-517a8a2d1ded tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:49.607756 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f13fcaa-7473-4248-b50d-517a8a2d1ded tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:49.608206 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f13fcaa-7473-4248-b50d-517a8a2d1ded tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:49.608936 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f13fcaa-7473-4248-b50d-517a8a2d1ded tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:49.609398 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f13fcaa-7473-4248-b50d-517a8a2d1ded tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:49.609869 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f13fcaa-7473-4248-b50d-517a8a2d1ded tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:49.690872 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-1f13fcaa-7473-4248-b50d-517a8a2d1ded tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lazy-loading 'flavor' on Instance uuid cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:31:49.958180 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-babcaa1c-c674-493d-92eb-2c780d13022b tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:49.958807 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-babcaa1c-c674-493d-92eb-2c780d13022b tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] [instance: 4d2e95a1-588c-43ff-9af0-4d52676793b1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:49.977721 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-babcaa1c-c674-493d-92eb-2c780d13022b tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:49.980016 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-babcaa1c-c674-493d-92eb-2c780d13022b tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:49.982459 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-babcaa1c-c674-493d-92eb-2c780d13022b tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:49.983556 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-babcaa1c-c674-493d-92eb-2c780d13022b tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:49.985348 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-babcaa1c-c674-493d-92eb-2c780d13022b tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:49.986585 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-babcaa1c-c674-493d-92eb-2c780d13022b tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:50.203836 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1f13fcaa-7473-4248-b50d-517a8a2d1ded tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "POST /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190/action" status: 202 len: 0 microversion: 2.1 time: 0.619308 Oct 26 13:31:50.207676 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2844/5657] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:31:49 2022] POST /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190/action => generated 0 bytes in 622 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:31:50.235227 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d95be306-34cc-4a5a-95ed-50a6b76420dc tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:50.237651 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d95be306-34cc-4a5a-95ed-50a6b76420dc tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:50.273320 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d95be306-34cc-4a5a-95ed-50a6b76420dc tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:50.273889 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d95be306-34cc-4a5a-95ed-50a6b76420dc tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:50.276860 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d95be306-34cc-4a5a-95ed-50a6b76420dc tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:50.278872 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d95be306-34cc-4a5a-95ed-50a6b76420dc tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:50.280791 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d95be306-34cc-4a5a-95ed-50a6b76420dc tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:50.281259 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d95be306-34cc-4a5a-95ed-50a6b76420dc tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:50.668490 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-babcaa1c-c674-493d-92eb-2c780d13022b tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe198b313144b0f9089de1d0b62e8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb208abbe6784b7692cc1460fc60d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:50.683182 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-babcaa1c-c674-493d-92eb-2c780d13022b tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] 10.222.0.40 "GET /compute/v2.1/servers/4d2e95a1-588c-43ff-9af0-4d52676793b1" status: 200 len: 1314 microversion: 2.1 time: 0.732307 Oct 26 13:31:50.686259 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2814/5658] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:49 2022] GET /compute/v2.1/servers/4d2e95a1-588c-43ff-9af0-4d52676793b1 => generated 1314 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:51.039078 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d95be306-34cc-4a5a-95ed-50a6b76420dc tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:51.053981 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d95be306-34cc-4a5a-95ed-50a6b76420dc tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190" status: 200 len: 1492 microversion: 2.1 time: 0.844673 Oct 26 13:31:51.061438 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2845/5659] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:50 2022] GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 => generated 1492 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:51.717290 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cd3e4db7-b284-4533-bc6f-2462ebab3933 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:51.719234 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cd3e4db7-b284-4533-bc6f-2462ebab3933 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] [instance: 4d2e95a1-588c-43ff-9af0-4d52676793b1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:51.759309 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cd3e4db7-b284-4533-bc6f-2462ebab3933 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:51.760308 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cd3e4db7-b284-4533-bc6f-2462ebab3933 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:51.760994 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cd3e4db7-b284-4533-bc6f-2462ebab3933 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:51.762875 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cd3e4db7-b284-4533-bc6f-2462ebab3933 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:51.765371 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cd3e4db7-b284-4533-bc6f-2462ebab3933 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:51.766063 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cd3e4db7-b284-4533-bc6f-2462ebab3933 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:52.089473 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e79cfa4d-6481-4ca4-a1da-003d9687a388 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:52.090809 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e79cfa4d-6481-4ca4-a1da-003d9687a388 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:52.104217 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e79cfa4d-6481-4ca4-a1da-003d9687a388 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:52.106072 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e79cfa4d-6481-4ca4-a1da-003d9687a388 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:52.107651 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e79cfa4d-6481-4ca4-a1da-003d9687a388 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:52.110041 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e79cfa4d-6481-4ca4-a1da-003d9687a388 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:52.111731 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e79cfa4d-6481-4ca4-a1da-003d9687a388 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:52.112411 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e79cfa4d-6481-4ca4-a1da-003d9687a388 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:52.599117 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cd3e4db7-b284-4533-bc6f-2462ebab3933 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe198b313144b0f9089de1d0b62e8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb208abbe6784b7692cc1460fc60d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:52.607993 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cd3e4db7-b284-4533-bc6f-2462ebab3933 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] 10.222.0.40 "GET /compute/v2.1/servers/4d2e95a1-588c-43ff-9af0-4d52676793b1" status: 200 len: 1314 microversion: 2.1 time: 0.896053 Oct 26 13:31:52.608597 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2815/5660] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:51 2022] GET /compute/v2.1/servers/4d2e95a1-588c-43ff-9af0-4d52676793b1 => generated 1314 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:52.779479 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e79cfa4d-6481-4ca4-a1da-003d9687a388 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:52.810691 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e79cfa4d-6481-4ca4-a1da-003d9687a388 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190" status: 200 len: 1513 microversion: 2.1 time: 0.726048 Oct 26 13:31:52.825512 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2846/5661] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:52 2022] GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 => generated 1513 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:31:53.632988 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e68bbc2f-fb5c-4606-99de-5d466b8d2ffc tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:53.633712 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e68bbc2f-fb5c-4606-99de-5d466b8d2ffc tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] [instance: 4d2e95a1-588c-43ff-9af0-4d52676793b1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:53.668954 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e68bbc2f-fb5c-4606-99de-5d466b8d2ffc tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:53.670411 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e68bbc2f-fb5c-4606-99de-5d466b8d2ffc tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:53.677723 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e68bbc2f-fb5c-4606-99de-5d466b8d2ffc tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:53.692999 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e68bbc2f-fb5c-4606-99de-5d466b8d2ffc tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:53.695069 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e68bbc2f-fb5c-4606-99de-5d466b8d2ffc tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:53.697347 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e68bbc2f-fb5c-4606-99de-5d466b8d2ffc tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:53.770134 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:31:53.846261 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-264d1032-f253-4486-90e4-c7f01e7a381f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:53.846894 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-264d1032-f253-4486-90e4-c7f01e7a381f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:53.885574 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-264d1032-f253-4486-90e4-c7f01e7a381f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:53.893689 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-264d1032-f253-4486-90e4-c7f01e7a381f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:53.894322 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-264d1032-f253-4486-90e4-c7f01e7a381f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:53.895095 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-264d1032-f253-4486-90e4-c7f01e7a381f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:53.895573 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-264d1032-f253-4486-90e4-c7f01e7a381f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:53.896004 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-264d1032-f253-4486-90e4-c7f01e7a381f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:54.153977 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e68bbc2f-fb5c-4606-99de-5d466b8d2ffc tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe198b313144b0f9089de1d0b62e8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb208abbe6784b7692cc1460fc60d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:54.166850 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e68bbc2f-fb5c-4606-99de-5d466b8d2ffc tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] 10.222.0.40 "GET /compute/v2.1/servers/4d2e95a1-588c-43ff-9af0-4d52676793b1" status: 200 len: 1314 microversion: 2.1 time: 0.538229 Oct 26 13:31:54.168189 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2816/5662] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:53 2022] GET /compute/v2.1/servers/4d2e95a1-588c-43ff-9af0-4d52676793b1 => generated 1314 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:54.177254 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a6c53859-d1c4-485d-a566-71a62f4e652a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:54.178961 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a6c53859-d1c4-485d-a566-71a62f4e652a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f791ecb5-63e6-41fc-b2dc-d73701c5773e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:54.199237 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a6c53859-d1c4-485d-a566-71a62f4e652a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:54.201356 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a6c53859-d1c4-485d-a566-71a62f4e652a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:54.202110 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a6c53859-d1c4-485d-a566-71a62f4e652a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:54.203335 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a6c53859-d1c4-485d-a566-71a62f4e652a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:54.204947 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a6c53859-d1c4-485d-a566-71a62f4e652a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:54.208237 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a6c53859-d1c4-485d-a566-71a62f4e652a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:54.243648 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-a6c53859-d1c4-485d-a566-71a62f4e652a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] HTTP exception thrown: Instance f791ecb5-63e6-41fc-b2dc-d73701c5773e could not be found. Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a6c53859-d1c4-485d-a566-71a62f4e652a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Request method failure captured: Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e HTTP/1.1 Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTWpf9Job1by08RPlBi4BK3ZRus12IuUwpixxL0U8NmqouWwnfDFM_ku9arLt0Dfw_g2zljJol9iSiPHbr2OBJI9bA6xxReUYgF5HT4trI936uilzQCNXRfNWHD8SC65BfL8JHiNMAmXVHxHedc9hkhsO-eHURoIHHJwTTh6ig9qSq0 Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/088eb22706844984b58fe118d5421cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_088eb22706844984b58fe118d5421cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}] Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 9b8db27e3baf4b6a948f6d23c04cf680 Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance f791ecb5-63e6-41fc-b2dc-d73701c5773e could not be found. Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'f791ecb5-63e6-41fc-b2dc-d73701c5773e'} Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f791ecb5-63e6-41fc-b2dc-d73701c5773e could not be found. Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:31:54.245737 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:31:54.249584 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f791ecb5-63e6-41fc-b2dc-d73701c5773e could not be found. Oct 26 13:31:54.249584 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:31:54.249584 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:31:54.249584 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:31:54.249584 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:31:54.249584 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:31:54.249584 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:31:54.249584 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:31:54.249584 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:31:54.249584 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f791ecb5-63e6-41fc-b2dc-d73701c5773e could not be found. Oct 26 13:31:54.249584 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:31:54.252925 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a6c53859-d1c4-485d-a566-71a62f4e652a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Returning 404 to user: Instance f791ecb5-63e6-41fc-b2dc-d73701c5773e could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:31:54.254051 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a6c53859-d1c4-485d-a566-71a62f4e652a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e" status: 404 len: 111 microversion: 2.1 time: 0.083090 Oct 26 13:31:54.259048 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2817/5663] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:31:54 2022] DELETE /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:31:54.289785 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fadaf637-2530-4134-aefe-65b73112dd4a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:54.295844 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fadaf637-2530-4134-aefe-65b73112dd4a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f791ecb5-63e6-41fc-b2dc-d73701c5773e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:54.314040 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fadaf637-2530-4134-aefe-65b73112dd4a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:54.319936 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fadaf637-2530-4134-aefe-65b73112dd4a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:54.323394 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fadaf637-2530-4134-aefe-65b73112dd4a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:54.324332 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fadaf637-2530-4134-aefe-65b73112dd4a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:54.326324 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fadaf637-2530-4134-aefe-65b73112dd4a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:54.329428 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fadaf637-2530-4134-aefe-65b73112dd4a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:54.392289 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-fadaf637-2530-4134-aefe-65b73112dd4a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] HTTP exception thrown: Instance f791ecb5-63e6-41fc-b2dc-d73701c5773e could not be found. Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fadaf637-2530-4134-aefe-65b73112dd4a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Request method failure captured: Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e HTTP/1.1 Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTWpf9Job1by08RPlBi4BK3ZRus12IuUwpixxL0U8NmqouWwnfDFM_ku9arLt0Dfw_g2zljJol9iSiPHbr2OBJI9bA6xxReUYgF5HT4trI936uilzQCNXRfNWHD8SC65BfL8JHiNMAmXVHxHedc9hkhsO-eHURoIHHJwTTh6ig9qSq0 Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/088eb22706844984b58fe118d5421cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_088eb22706844984b58fe118d5421cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}] Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 9b8db27e3baf4b6a948f6d23c04cf680 Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance f791ecb5-63e6-41fc-b2dc-d73701c5773e could not be found. Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'f791ecb5-63e6-41fc-b2dc-d73701c5773e'} Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f791ecb5-63e6-41fc-b2dc-d73701c5773e could not be found. Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f791ecb5-63e6-41fc-b2dc-d73701c5773e could not be found. Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:31:54.399470 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:31:54.404031 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:31:54.404031 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:31:54.404031 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:31:54.404031 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:31:54.404031 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:31:54.404031 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f791ecb5-63e6-41fc-b2dc-d73701c5773e could not be found. Oct 26 13:31:54.404031 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:31:54.408287 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fadaf637-2530-4134-aefe-65b73112dd4a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Returning 404 to user: Instance f791ecb5-63e6-41fc-b2dc-d73701c5773e could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:31:54.413230 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fadaf637-2530-4134-aefe-65b73112dd4a tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e" status: 404 len: 111 microversion: 2.1 time: 0.148763 Oct 26 13:31:54.414150 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2818/5664] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:54 2022] GET /compute/v2.1/servers/f791ecb5-63e6-41fc-b2dc-d73701c5773e => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:31:54.437034 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8bb93ad2-db2b-4d37-9835-3c0883de6377 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:54.438104 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8bb93ad2-db2b-4d37-9835-3c0883de6377 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:54.457151 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8bb93ad2-db2b-4d37-9835-3c0883de6377 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:54.460425 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8bb93ad2-db2b-4d37-9835-3c0883de6377 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:54.461284 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8bb93ad2-db2b-4d37-9835-3c0883de6377 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:54.464743 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8bb93ad2-db2b-4d37-9835-3c0883de6377 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:54.465586 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8bb93ad2-db2b-4d37-9835-3c0883de6377 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:54.466397 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8bb93ad2-db2b-4d37-9835-3c0883de6377 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:54.553781 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8bb93ad2-db2b-4d37-9835-3c0883de6377 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:31:54.797082 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8bb93ad2-db2b-4d37-9835-3c0883de6377 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 204 len: 0 microversion: 2.1 time: 0.376391 Oct 26 13:31:54.799787 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2819/5665] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:31:54 2022] DELETE /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:31:54.818990 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d892e784-4c83-4504-a5a9-4df5bc4c9873 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:54.825240 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d892e784-4c83-4504-a5a9-4df5bc4c9873 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:54.847197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d892e784-4c83-4504-a5a9-4df5bc4c9873 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:54.850375 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d892e784-4c83-4504-a5a9-4df5bc4c9873 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:54.851144 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d892e784-4c83-4504-a5a9-4df5bc4c9873 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:54.855573 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d892e784-4c83-4504-a5a9-4df5bc4c9873 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:54.857096 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d892e784-4c83-4504-a5a9-4df5bc4c9873 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:54.860058 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d892e784-4c83-4504-a5a9-4df5bc4c9873 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:55.322111 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d892e784-4c83-4504-a5a9-4df5bc4c9873 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:55.338364 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d892e784-4c83-4504-a5a9-4df5bc4c9873 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1512 microversion: 2.1 time: 0.533862 Oct 26 13:31:55.339358 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2820/5666] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:54 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1512 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:55.392335 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2db22f1c-c7fa-48b6-b185-7b66ac944141 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:55.393135 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2db22f1c-c7fa-48b6-b185-7b66ac944141 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] [instance: 4d2e95a1-588c-43ff-9af0-4d52676793b1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:55.443264 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2db22f1c-c7fa-48b6-b185-7b66ac944141 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:55.443788 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2db22f1c-c7fa-48b6-b185-7b66ac944141 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:55.444245 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2db22f1c-c7fa-48b6-b185-7b66ac944141 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:55.453156 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2db22f1c-c7fa-48b6-b185-7b66ac944141 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:55.455544 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2db22f1c-c7fa-48b6-b185-7b66ac944141 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:55.456193 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2db22f1c-c7fa-48b6-b185-7b66ac944141 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:55.736563 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2db22f1c-c7fa-48b6-b185-7b66ac944141 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe198b313144b0f9089de1d0b62e8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb208abbe6784b7692cc1460fc60d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:55.755219 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2db22f1c-c7fa-48b6-b185-7b66ac944141 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] 10.222.0.40 "GET /compute/v2.1/servers/4d2e95a1-588c-43ff-9af0-4d52676793b1" status: 200 len: 1314 microversion: 2.1 time: 0.414708 Oct 26 13:31:55.756822 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2821/5667] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:55 2022] GET /compute/v2.1/servers/4d2e95a1-588c-43ff-9af0-4d52676793b1 => generated 1314 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:55.767242 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-0c8cc4d3-dd91-4f4e-930b-13ec0a1a1bef req-f122aa12-5695-48f0-9e88-82430e916c4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d2e95a1-588c-43ff-9af0-4d52676793b1", "name": "network-vif-plugged", "status": "completed", "tag": "a07e5852-6157-4962-8e3f-70ecf12ef7ef"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:31:55.788461 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-0c8cc4d3-dd91-4f4e-930b-13ec0a1a1bef req-f122aa12-5695-48f0-9e88-82430e916c4b service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:55.789341 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-0c8cc4d3-dd91-4f4e-930b-13ec0a1a1bef req-f122aa12-5695-48f0-9e88-82430e916c4b service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:55.789970 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-0c8cc4d3-dd91-4f4e-930b-13ec0a1a1bef req-f122aa12-5695-48f0-9e88-82430e916c4b service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:55.813266 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-0c8cc4d3-dd91-4f4e-930b-13ec0a1a1bef req-f122aa12-5695-48f0-9e88-82430e916c4b service nova] Creating event network-vif-plugged:a07e5852-6157-4962-8e3f-70ecf12ef7ef for instance 4d2e95a1-588c-43ff-9af0-4d52676793b1 on n-h2-862686-1 Oct 26 13:31:55.828122 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-0c8cc4d3-dd91-4f4e-930b-13ec0a1a1bef req-f122aa12-5695-48f0-9e88-82430e916c4b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069664 Oct 26 13:31:55.833890 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2822/5668] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:31:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:31:56.295926 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-264d1032-f253-4486-90e4-c7f01e7a381f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:56.312581 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-264d1032-f253-4486-90e4-c7f01e7a381f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190" status: 200 len: 1508 microversion: 2.1 time: 2.470207 Oct 26 13:31:56.315544 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2847/5669] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:53 2022] GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 => generated 1508 bytes in 2474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:31:56.386715 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-64d226fa-00a3-44ba-998e-72cffb8023bc tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:56.387623 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-64d226fa-00a3-44ba-998e-72cffb8023bc tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:56.404765 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64d226fa-00a3-44ba-998e-72cffb8023bc tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:56.405575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64d226fa-00a3-44ba-998e-72cffb8023bc tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:56.407823 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64d226fa-00a3-44ba-998e-72cffb8023bc tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:56.408769 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64d226fa-00a3-44ba-998e-72cffb8023bc tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:56.411101 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64d226fa-00a3-44ba-998e-72cffb8023bc tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:56.411755 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64d226fa-00a3-44ba-998e-72cffb8023bc tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:56.785643 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-44da8d8c-63f8-419d-b9e8-6f35346da49c tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:56.787084 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-44da8d8c-63f8-419d-b9e8-6f35346da49c tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] [instance: 4d2e95a1-588c-43ff-9af0-4d52676793b1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:56.790745 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:31:56.825938 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-44da8d8c-63f8-419d-b9e8-6f35346da49c tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:56.828604 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-44da8d8c-63f8-419d-b9e8-6f35346da49c tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:56.836344 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-44da8d8c-63f8-419d-b9e8-6f35346da49c tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:56.838056 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-44da8d8c-63f8-419d-b9e8-6f35346da49c tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:56.839730 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-44da8d8c-63f8-419d-b9e8-6f35346da49c tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:56.844836 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-44da8d8c-63f8-419d-b9e8-6f35346da49c tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:56.930277 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:31:57.239439 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-64d226fa-00a3-44ba-998e-72cffb8023bc tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:57.257321 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-64d226fa-00a3-44ba-998e-72cffb8023bc tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1512 microversion: 2.1 time: 0.877033 Oct 26 13:31:57.257948 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2823/5670] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:56 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1512 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:57.345053 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4d750811-1000-4824-8d96-acd66af24d67 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:57.346182 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4d750811-1000-4824-8d96-acd66af24d67 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:57.348503 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:31:57.361967 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4d750811-1000-4824-8d96-acd66af24d67 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:57.366662 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4d750811-1000-4824-8d96-acd66af24d67 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:57.367363 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4d750811-1000-4824-8d96-acd66af24d67 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:57.368448 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4d750811-1000-4824-8d96-acd66af24d67 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:57.369137 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4d750811-1000-4824-8d96-acd66af24d67 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:57.371741 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4d750811-1000-4824-8d96-acd66af24d67 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:57.935826 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4d750811-1000-4824-8d96-acd66af24d67 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:57.954951 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4d750811-1000-4824-8d96-acd66af24d67 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190" status: 200 len: 1508 microversion: 2.1 time: 0.613463 Oct 26 13:31:57.966179 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2824/5671] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:57 2022] GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 => generated 1508 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:58.127048 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-44da8d8c-63f8-419d-b9e8-6f35346da49c tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe198b313144b0f9089de1d0b62e8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb208abbe6784b7692cc1460fc60d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:58.150857 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-44da8d8c-63f8-419d-b9e8-6f35346da49c tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] 10.222.0.40 "GET /compute/v2.1/servers/4d2e95a1-588c-43ff-9af0-4d52676793b1" status: 200 len: 1314 microversion: 2.1 time: 1.370565 Oct 26 13:31:58.155825 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2848/5672] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:56 2022] GET /compute/v2.1/servers/4d2e95a1-588c-43ff-9af0-4d52676793b1 => generated 1314 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:58.284660 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0913d337-775f-429a-aed3-1fe234f57c22 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:58.286775 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0913d337-775f-429a-aed3-1fe234f57c22 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:58.297587 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0913d337-775f-429a-aed3-1fe234f57c22 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:58.298472 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0913d337-775f-429a-aed3-1fe234f57c22 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:58.302620 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0913d337-775f-429a-aed3-1fe234f57c22 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:58.303595 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0913d337-775f-429a-aed3-1fe234f57c22 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:58.304408 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0913d337-775f-429a-aed3-1fe234f57c22 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:58.306873 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0913d337-775f-429a-aed3-1fe234f57c22 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:58.535413 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-f84453fa-d6c1-4c7d-b206-783d7c59591e req-ae54703b-e9ff-4a04-8052-2905d2aed395 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb1b8c75-80fa-4c58-acb0-0a38b1cb4190", "name": "network-vif-plugged", "status": "completed", "tag": "779c4ff9-aef3-47c6-bc9d-fb3332928fb3"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:31:58.579159 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f84453fa-d6c1-4c7d-b206-783d7c59591e req-ae54703b-e9ff-4a04-8052-2905d2aed395 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:58.590897 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f84453fa-d6c1-4c7d-b206-783d7c59591e req-ae54703b-e9ff-4a04-8052-2905d2aed395 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:58.596300 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f84453fa-d6c1-4c7d-b206-783d7c59591e req-ae54703b-e9ff-4a04-8052-2905d2aed395 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:58.658418 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-f84453fa-d6c1-4c7d-b206-783d7c59591e req-ae54703b-e9ff-4a04-8052-2905d2aed395 service nova] Creating event network-vif-plugged:779c4ff9-aef3-47c6-bc9d-fb3332928fb3 for instance cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 on n-h1-862686-1 Oct 26 13:31:58.699531 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-f84453fa-d6c1-4c7d-b206-783d7c59591e req-ae54703b-e9ff-4a04-8052-2905d2aed395 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170738 Oct 26 13:31:58.702838 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2849/5673] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:31:58.902534 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0913d337-775f-429a-aed3-1fe234f57c22 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:58.921348 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0913d337-775f-429a-aed3-1fe234f57c22 tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1512 microversion: 2.1 time: 0.639064 Oct 26 13:31:58.925092 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2825/5674] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:58 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1512 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:58.994172 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-24e68ad3-bd89-47d8-971b-5f765278ac48 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:58.995248 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-24e68ad3-bd89-47d8-971b-5f765278ac48 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:59.046005 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24e68ad3-bd89-47d8-971b-5f765278ac48 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:59.057688 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24e68ad3-bd89-47d8-971b-5f765278ac48 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:59.062086 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24e68ad3-bd89-47d8-971b-5f765278ac48 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:59.063916 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24e68ad3-bd89-47d8-971b-5f765278ac48 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:59.067746 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24e68ad3-bd89-47d8-971b-5f765278ac48 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:59.072010 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24e68ad3-bd89-47d8-971b-5f765278ac48 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:59.212467 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f3d21fc5-b29b-4b43-a062-e0bcdc92db09 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:31:59.218760 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f3d21fc5-b29b-4b43-a062-e0bcdc92db09 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] [instance: 4d2e95a1-588c-43ff-9af0-4d52676793b1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:31:59.268206 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3d21fc5-b29b-4b43-a062-e0bcdc92db09 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:59.280351 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3d21fc5-b29b-4b43-a062-e0bcdc92db09 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:59.281048 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3d21fc5-b29b-4b43-a062-e0bcdc92db09 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:59.283987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3d21fc5-b29b-4b43-a062-e0bcdc92db09 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:59.289386 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3d21fc5-b29b-4b43-a062-e0bcdc92db09 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:59.292557 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3d21fc5-b29b-4b43-a062-e0bcdc92db09 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:31:59.924513 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-24e68ad3-bd89-47d8-971b-5f765278ac48 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:31:59.937770 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-24e68ad3-bd89-47d8-971b-5f765278ac48 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190" status: 200 len: 1508 microversion: 2.1 time: 0.948559 Oct 26 13:31:59.941638 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2850/5675] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:58 2022] GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 => generated 1508 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:31:59.954496 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-4f5b7765-f2be-4dba-950f-5a556f462afe req-ad4d0b1e-caa7-4685-99ef-50caa9c4f2e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc8d9140-3f8d-44ad-86f4-36d67fbe7d19", "tag": "f7033ea2-06ce-4a5d-89e9-d5ec1bb05d04"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:31:59.978067 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-4f5b7765-f2be-4dba-950f-5a556f462afe req-ad4d0b1e-caa7-4685-99ef-50caa9c4f2e5 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:31:59.978804 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-4f5b7765-f2be-4dba-950f-5a556f462afe req-ad4d0b1e-caa7-4685-99ef-50caa9c4f2e5 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:31:59.979478 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-4f5b7765-f2be-4dba-950f-5a556f462afe req-ad4d0b1e-caa7-4685-99ef-50caa9c4f2e5 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:00.016100 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-4f5b7765-f2be-4dba-950f-5a556f462afe req-ad4d0b1e-caa7-4685-99ef-50caa9c4f2e5 service nova] Creating event network-changed:f7033ea2-06ce-4a5d-89e9-d5ec1bb05d04 for instance dc8d9140-3f8d-44ad-86f4-36d67fbe7d19 on n-h2-862686-1 Oct 26 13:32:00.030303 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-4f5b7765-f2be-4dba-950f-5a556f462afe req-ad4d0b1e-caa7-4685-99ef-50caa9c4f2e5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077572 Oct 26 13:32:00.031972 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2851/5676] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:32:00.042938 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fa681e98-cb7a-496f-b0f8-8bcbd10c0d7b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:32:00.044333 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fa681e98-cb7a-496f-b0f8-8bcbd10c0d7b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:32:00.066612 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa681e98-cb7a-496f-b0f8-8bcbd10c0d7b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:00.070329 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa681e98-cb7a-496f-b0f8-8bcbd10c0d7b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:00.074772 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa681e98-cb7a-496f-b0f8-8bcbd10c0d7b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:00.076476 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa681e98-cb7a-496f-b0f8-8bcbd10c0d7b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:00.078715 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa681e98-cb7a-496f-b0f8-8bcbd10c0d7b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:00.081921 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa681e98-cb7a-496f-b0f8-8bcbd10c0d7b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:00.307863 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f3d21fc5-b29b-4b43-a062-e0bcdc92db09 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe198b313144b0f9089de1d0b62e8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb208abbe6784b7692cc1460fc60d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:32:00.319706 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f3d21fc5-b29b-4b43-a062-e0bcdc92db09 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] 10.222.0.40 "GET /compute/v2.1/servers/4d2e95a1-588c-43ff-9af0-4d52676793b1" status: 200 len: 1464 microversion: 2.1 time: 1.135591 Oct 26 13:32:00.325699 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2826/5677] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:31:59 2022] GET /compute/v2.1/servers/4d2e95a1-588c-43ff-9af0-4d52676793b1 => generated 1464 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:32:00.352012 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cb752ba9-e3d5-406e-b613-c350ad064fdb tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "07acd45b-537c-48b9-b277-c22b71483083", "device": "/dev/sdb"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:32:00.356227 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cb752ba9-e3d5-406e-b613-c350ad064fdb tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] [instance: 4d2e95a1-588c-43ff-9af0-4d52676793b1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:32:00.390477 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb752ba9-e3d5-406e-b613-c350ad064fdb tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:00.391371 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb752ba9-e3d5-406e-b613-c350ad064fdb tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:00.394336 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb752ba9-e3d5-406e-b613-c350ad064fdb tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:00.398810 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb752ba9-e3d5-406e-b613-c350ad064fdb tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:00.400119 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb752ba9-e3d5-406e-b613-c350ad064fdb tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:00.400825 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb752ba9-e3d5-406e-b613-c350ad064fdb tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:00.919838 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cb752ba9-e3d5-406e-b613-c350ad064fdb tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] 10.222.0.40 "POST /compute/v2.1/servers/4d2e95a1-588c-43ff-9af0-4d52676793b1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.571566 Oct 26 13:32:00.921010 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2827/5678] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Oct 26 13:32:00 2022] POST /compute/v2.1/servers/4d2e95a1-588c-43ff-9af0-4d52676793b1/os-volume_attachments => generated 194 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:32:00.969311 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-69c6dac3-231e-406e-9380-0bbf63f4e86f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:32:00.970511 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-69c6dac3-231e-406e-9380-0bbf63f4e86f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:32:00.986864 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69c6dac3-231e-406e-9380-0bbf63f4e86f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:00.987777 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69c6dac3-231e-406e-9380-0bbf63f4e86f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:00.988470 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69c6dac3-231e-406e-9380-0bbf63f4e86f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:00.989411 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69c6dac3-231e-406e-9380-0bbf63f4e86f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:00.990116 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69c6dac3-231e-406e-9380-0bbf63f4e86f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:00.990763 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69c6dac3-231e-406e-9380-0bbf63f4e86f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:01.507090 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fa681e98-cb7a-496f-b0f8-8bcbd10c0d7b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:32:01.521061 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fa681e98-cb7a-496f-b0f8-8bcbd10c0d7b tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1470 microversion: 2.1 time: 1.486757 Oct 26 13:32:01.521707 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2852/5679] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:32:00 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1470 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:32:02.191443 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-8190a327-53a3-4d44-828b-2619d0343b7b req-a4f8e043-2b65-48aa-9488-48dec6189b0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f573d46e-77d2-4405-baef-2bb447d4b5e7", "name": "network-vif-deleted", "tag": "1a81eb96-6bc8-4bfb-8326-14785f0a363d"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:32:02.250156 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8190a327-53a3-4d44-828b-2619d0343b7b req-a4f8e043-2b65-48aa-9488-48dec6189b0f service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:02.250882 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8190a327-53a3-4d44-828b-2619d0343b7b req-a4f8e043-2b65-48aa-9488-48dec6189b0f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:02.251330 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8190a327-53a3-4d44-828b-2619d0343b7b req-a4f8e043-2b65-48aa-9488-48dec6189b0f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:02.339862 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-8190a327-53a3-4d44-828b-2619d0343b7b req-a4f8e043-2b65-48aa-9488-48dec6189b0f service nova] Creating event network-vif-deleted:1a81eb96-6bc8-4bfb-8326-14785f0a363d for instance f573d46e-77d2-4405-baef-2bb447d4b5e7 on n-h1-862686-1 Oct 26 13:32:02.390505 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-8190a327-53a3-4d44-828b-2619d0343b7b req-a4f8e043-2b65-48aa-9488-48dec6189b0f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204703 Oct 26 13:32:02.393549 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2853/5680] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:32:02.418320 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-69c6dac3-231e-406e-9380-0bbf63f4e86f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:32:02.428452 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-69c6dac3-231e-406e-9380-0bbf63f4e86f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190" status: 200 len: 1508 microversion: 2.1 time: 1.463191 Oct 26 13:32:02.429032 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2828/5681] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:32:00 2022] GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 => generated 1508 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:32:02.557556 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3cd945e3-e99c-493e-80b1-fd1c6b417a2e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:32:02.558929 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3cd945e3-e99c-493e-80b1-fd1c6b417a2e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:32:02.571755 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cd945e3-e99c-493e-80b1-fd1c6b417a2e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:02.574096 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cd945e3-e99c-493e-80b1-fd1c6b417a2e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:02.588205 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cd945e3-e99c-493e-80b1-fd1c6b417a2e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:02.590716 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cd945e3-e99c-493e-80b1-fd1c6b417a2e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:02.596813 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cd945e3-e99c-493e-80b1-fd1c6b417a2e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:02.600400 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cd945e3-e99c-493e-80b1-fd1c6b417a2e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:02.799721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cd945e3-e99c-493e-80b1-fd1c6b417a2e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:02.800287 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cd945e3-e99c-493e-80b1-fd1c6b417a2e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:02.800759 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3cd945e3-e99c-493e-80b1-fd1c6b417a2e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:02.801210 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-3cd945e3-e99c-493e-80b1-fd1c6b417a2e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lazy-loading 'fault' on Instance uuid f573d46e-77d2-4405-baef-2bb447d4b5e7 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:32:02.889679 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3cd945e3-e99c-493e-80b1-fd1c6b417a2e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8db27e3baf4b6a948f6d23c04cf680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eb22706844984b58fe118d5421cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:32:02.899530 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3cd945e3-e99c-493e-80b1-fd1c6b417a2e tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 200 len: 1306 microversion: 2.1 time: 0.350975 Oct 26 13:32:02.912074 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2854/5682] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:32:02 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 1306 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:32:03.458621 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-aed0ea77-348e-4ec4-94aa-b392af904c6c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:32:03.459356 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-aed0ea77-348e-4ec4-94aa-b392af904c6c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:32:03.505624 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aed0ea77-348e-4ec4-94aa-b392af904c6c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:03.506442 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aed0ea77-348e-4ec4-94aa-b392af904c6c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:03.511191 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aed0ea77-348e-4ec4-94aa-b392af904c6c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:03.516074 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aed0ea77-348e-4ec4-94aa-b392af904c6c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:03.516888 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aed0ea77-348e-4ec4-94aa-b392af904c6c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:03.521168 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aed0ea77-348e-4ec4-94aa-b392af904c6c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:03.924195 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-12e414ef-a07c-4cb1-ad08-3a7690a2abee tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:32:03.925540 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-12e414ef-a07c-4cb1-ad08-3a7690a2abee tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] [instance: f573d46e-77d2-4405-baef-2bb447d4b5e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:32:03.932695 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-12e414ef-a07c-4cb1-ad08-3a7690a2abee tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:03.945167 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-12e414ef-a07c-4cb1-ad08-3a7690a2abee tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:03.945904 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-12e414ef-a07c-4cb1-ad08-3a7690a2abee tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:03.946912 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-12e414ef-a07c-4cb1-ad08-3a7690a2abee tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:03.949994 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-12e414ef-a07c-4cb1-ad08-3a7690a2abee tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:03.955153 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-12e414ef-a07c-4cb1-ad08-3a7690a2abee tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:03.984593 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-12e414ef-a07c-4cb1-ad08-3a7690a2abee tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] HTTP exception thrown: Instance f573d46e-77d2-4405-baef-2bb447d4b5e7 could not be found. Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-12e414ef-a07c-4cb1-ad08-3a7690a2abee tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Request method failure captured: Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 HTTP/1.1 Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTWpf9Job1by08RPlBi4BK3ZRus12IuUwpixxL0U8NmqouWwnfDFM_ku9arLt0Dfw_g2zljJol9iSiPHbr2OBJI9bA6xxReUYgF5HT4trI936uilzQCNXRfNWHD8SC65BfL8JHiNMAmXVHxHedc9hkhsO-eHURoIHHJwTTh6ig9qSq0 Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/088eb22706844984b58fe118d5421cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_088eb22706844984b58fe118d5421cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/088eb22706844984b58fe118d5421cbb"}]}] Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 088eb22706844984b58fe118d5421cbb Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-255250406 Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 9b8db27e3baf4b6a948f6d23c04cf680 Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersNegativeTestJSON-255250406-project Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance f573d46e-77d2-4405-baef-2bb447d4b5e7 could not be found. Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'f573d46e-77d2-4405-baef-2bb447d4b5e7'} Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f573d46e-77d2-4405-baef-2bb447d4b5e7 could not be found. Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f573d46e-77d2-4405-baef-2bb447d4b5e7 could not be found. Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:32:04.006861 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:32:04.013125 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:32:04.013125 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:32:04.013125 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:32:04.013125 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:32:04.013125 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:32:04.013125 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f573d46e-77d2-4405-baef-2bb447d4b5e7 could not be found. Oct 26 13:32:04.013125 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:32:04.017924 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-12e414ef-a07c-4cb1-ad08-3a7690a2abee tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] Returning 404 to user: Instance f573d46e-77d2-4405-baef-2bb447d4b5e7 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:32:04.020944 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-12e414ef-a07c-4cb1-ad08-3a7690a2abee tempest-ServersNegativeTestJSON-255250406 tempest-ServersNegativeTestJSON-255250406-project] 10.222.0.40 "GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7" status: 404 len: 111 microversion: 2.1 time: 0.100755 Oct 26 13:32:04.021671 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2855/5683] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:32:03 2022] GET /compute/v2.1/servers/f573d46e-77d2-4405-baef-2bb447d4b5e7 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 13:32:04.764852 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-aed0ea77-348e-4ec4-94aa-b392af904c6c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:32:04.774499 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-aed0ea77-348e-4ec4-94aa-b392af904c6c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190" status: 200 len: 1508 microversion: 2.1 time: 1.319967 Oct 26 13:32:04.778991 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2829/5684] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:32:03 2022] GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 => generated 1508 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:32:05.806121 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e2fdcfae-a9d4-455d-b265-9128a8e887c5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:32:05.807658 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e2fdcfae-a9d4-455d-b265-9128a8e887c5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:32:05.828452 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e2fdcfae-a9d4-455d-b265-9128a8e887c5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:05.839992 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e2fdcfae-a9d4-455d-b265-9128a8e887c5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:05.840548 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e2fdcfae-a9d4-455d-b265-9128a8e887c5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:05.841358 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e2fdcfae-a9d4-455d-b265-9128a8e887c5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:05.841860 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e2fdcfae-a9d4-455d-b265-9128a8e887c5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:05.842298 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e2fdcfae-a9d4-455d-b265-9128a8e887c5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:07.462695 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e2fdcfae-a9d4-455d-b265-9128a8e887c5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:32:07.472078 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e2fdcfae-a9d4-455d-b265-9128a8e887c5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190" status: 200 len: 1508 microversion: 2.1 time: 1.672362 Oct 26 13:32:07.495456 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2856/5685] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:32:05 2022] GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 => generated 1508 bytes in 1696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:32:08.498136 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bc7ade5e-071b-492b-a615-b0ee12c16179 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:32:08.498750 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bc7ade5e-071b-492b-a615-b0ee12c16179 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:32:08.516649 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc7ade5e-071b-492b-a615-b0ee12c16179 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:08.518065 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc7ade5e-071b-492b-a615-b0ee12c16179 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:08.518979 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc7ade5e-071b-492b-a615-b0ee12c16179 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:08.523788 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc7ade5e-071b-492b-a615-b0ee12c16179 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:08.539074 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc7ade5e-071b-492b-a615-b0ee12c16179 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:08.539392 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc7ade5e-071b-492b-a615-b0ee12c16179 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:09.487962 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bc7ade5e-071b-492b-a615-b0ee12c16179 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:32:09.497027 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bc7ade5e-071b-492b-a615-b0ee12c16179 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190" status: 200 len: 1508 microversion: 2.1 time: 1.002800 Oct 26 13:32:09.513524 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2830/5686] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:32:08 2022] GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 => generated 1508 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:32:10.539239 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-81b13686-8db0-4e40-87a6-5e6c618e9b72 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:32:10.540831 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-81b13686-8db0-4e40-87a6-5e6c618e9b72 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:32:10.553074 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81b13686-8db0-4e40-87a6-5e6c618e9b72 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:10.566295 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81b13686-8db0-4e40-87a6-5e6c618e9b72 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:10.567008 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81b13686-8db0-4e40-87a6-5e6c618e9b72 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:10.567965 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81b13686-8db0-4e40-87a6-5e6c618e9b72 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:10.568767 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81b13686-8db0-4e40-87a6-5e6c618e9b72 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:10.569354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81b13686-8db0-4e40-87a6-5e6c618e9b72 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:11.313076 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-81b13686-8db0-4e40-87a6-5e6c618e9b72 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:32:11.324631 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-81b13686-8db0-4e40-87a6-5e6c618e9b72 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190" status: 200 len: 1508 microversion: 2.1 time: 0.789507 Oct 26 13:32:11.344670 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2857/5687] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:32:10 2022] GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 => generated 1508 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:32:12.361172 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d35d373d-dae9-499f-9d4a-65527af35f1e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:32:12.361826 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d35d373d-dae9-499f-9d4a-65527af35f1e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:32:12.372921 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d35d373d-dae9-499f-9d4a-65527af35f1e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:12.389118 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d35d373d-dae9-499f-9d4a-65527af35f1e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:12.389885 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d35d373d-dae9-499f-9d4a-65527af35f1e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:12.391733 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d35d373d-dae9-499f-9d4a-65527af35f1e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:12.395780 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d35d373d-dae9-499f-9d4a-65527af35f1e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:12.404569 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d35d373d-dae9-499f-9d4a-65527af35f1e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:13.034202 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d35d373d-dae9-499f-9d4a-65527af35f1e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:32:13.059929 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d35d373d-dae9-499f-9d4a-65527af35f1e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190" status: 200 len: 1508 microversion: 2.1 time: 0.702359 Oct 26 13:32:13.061135 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2831/5688] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:32:12 2022] GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 => generated 1508 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:32:14.083735 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d4cd8d34-ec20-4bd8-996b-dcb649f6f544 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:32:14.086660 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d4cd8d34-ec20-4bd8-996b-dcb649f6f544 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:32:14.122167 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4cd8d34-ec20-4bd8-996b-dcb649f6f544 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:14.122670 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4cd8d34-ec20-4bd8-996b-dcb649f6f544 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:14.123113 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4cd8d34-ec20-4bd8-996b-dcb649f6f544 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:14.123835 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4cd8d34-ec20-4bd8-996b-dcb649f6f544 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:14.124293 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4cd8d34-ec20-4bd8-996b-dcb649f6f544 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:14.124720 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4cd8d34-ec20-4bd8-996b-dcb649f6f544 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:15.074958 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d4cd8d34-ec20-4bd8-996b-dcb649f6f544 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:32:15.086957 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d4cd8d34-ec20-4bd8-996b-dcb649f6f544 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190" status: 200 len: 1508 microversion: 2.1 time: 1.007725 Oct 26 13:32:15.093074 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2858/5689] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:32:14 2022] GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 => generated 1508 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:32:16.172605 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d607df1a-11cd-4428-ab71-ee44811753f7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:32:16.173371 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d607df1a-11cd-4428-ab71-ee44811753f7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:32:16.198671 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d607df1a-11cd-4428-ab71-ee44811753f7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:16.199443 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d607df1a-11cd-4428-ab71-ee44811753f7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:16.200065 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d607df1a-11cd-4428-ab71-ee44811753f7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:16.202240 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d607df1a-11cd-4428-ab71-ee44811753f7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:16.202902 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d607df1a-11cd-4428-ab71-ee44811753f7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:16.204749 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d607df1a-11cd-4428-ab71-ee44811753f7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:16.316843 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:32:16.676511 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d607df1a-11cd-4428-ab71-ee44811753f7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:32:16.686597 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d607df1a-11cd-4428-ab71-ee44811753f7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190" status: 200 len: 1508 microversion: 2.1 time: 0.524350 Oct 26 13:32:16.692180 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2832/5690] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:32:16 2022] GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 => generated 1508 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:32:17.717564 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5e34a24b-04e0-47bb-b9a4-0ccc6c02ef8c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:32:17.718910 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5e34a24b-04e0-47bb-b9a4-0ccc6c02ef8c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:32:17.748934 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5e34a24b-04e0-47bb-b9a4-0ccc6c02ef8c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:17.749632 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5e34a24b-04e0-47bb-b9a4-0ccc6c02ef8c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:17.750194 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5e34a24b-04e0-47bb-b9a4-0ccc6c02ef8c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:17.751031 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5e34a24b-04e0-47bb-b9a4-0ccc6c02ef8c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:17.751607 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5e34a24b-04e0-47bb-b9a4-0ccc6c02ef8c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:17.752142 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5e34a24b-04e0-47bb-b9a4-0ccc6c02ef8c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:18.380538 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5e34a24b-04e0-47bb-b9a4-0ccc6c02ef8c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:32:18.395263 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5e34a24b-04e0-47bb-b9a4-0ccc6c02ef8c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190" status: 200 len: 1508 microversion: 2.1 time: 0.682036 Oct 26 13:32:18.396109 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2859/5691] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:32:17 2022] GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 => generated 1508 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:32:19.421468 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-25af70b0-a2e0-454d-8ac1-43d449bdb06f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:32:19.423001 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-25af70b0-a2e0-454d-8ac1-43d449bdb06f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:32:19.435643 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-25af70b0-a2e0-454d-8ac1-43d449bdb06f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:19.438540 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-25af70b0-a2e0-454d-8ac1-43d449bdb06f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:19.439397 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-25af70b0-a2e0-454d-8ac1-43d449bdb06f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:19.441562 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-25af70b0-a2e0-454d-8ac1-43d449bdb06f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:19.443158 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-25af70b0-a2e0-454d-8ac1-43d449bdb06f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:19.444168 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-25af70b0-a2e0-454d-8ac1-43d449bdb06f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:19.754592 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-25af70b0-a2e0-454d-8ac1-43d449bdb06f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:32:19.777679 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-25af70b0-a2e0-454d-8ac1-43d449bdb06f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190" status: 200 len: 1508 microversion: 2.1 time: 0.346461 Oct 26 13:32:19.778398 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2833/5692] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:32:19 2022] GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 => generated 1508 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:32:20.807036 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5a81b07c-338c-4cf1-9281-4ac5b6cd7ff3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:32:20.808583 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5a81b07c-338c-4cf1-9281-4ac5b6cd7ff3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:32:20.825454 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a81b07c-338c-4cf1-9281-4ac5b6cd7ff3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:20.828891 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a81b07c-338c-4cf1-9281-4ac5b6cd7ff3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:20.831004 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a81b07c-338c-4cf1-9281-4ac5b6cd7ff3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:20.832044 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a81b07c-338c-4cf1-9281-4ac5b6cd7ff3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:20.838285 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a81b07c-338c-4cf1-9281-4ac5b6cd7ff3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:20.843001 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a81b07c-338c-4cf1-9281-4ac5b6cd7ff3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:22.292924 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5a81b07c-338c-4cf1-9281-4ac5b6cd7ff3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:32:22.310489 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5a81b07c-338c-4cf1-9281-4ac5b6cd7ff3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190" status: 200 len: 1508 microversion: 2.1 time: 1.508653 Oct 26 13:32:22.314479 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2860/5693] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:32:20 2022] GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 => generated 1508 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:32:23.348187 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b63bc473-a826-48d1-a4ad-8a6045685ace tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:32:23.349683 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b63bc473-a826-48d1-a4ad-8a6045685ace tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:32:23.370826 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b63bc473-a826-48d1-a4ad-8a6045685ace tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:23.374549 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b63bc473-a826-48d1-a4ad-8a6045685ace tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:23.380738 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b63bc473-a826-48d1-a4ad-8a6045685ace tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:23.382488 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b63bc473-a826-48d1-a4ad-8a6045685ace tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:23.393920 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b63bc473-a826-48d1-a4ad-8a6045685ace tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:23.395436 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b63bc473-a826-48d1-a4ad-8a6045685ace tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:24.191814 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b63bc473-a826-48d1-a4ad-8a6045685ace tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:32:24.206789 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b63bc473-a826-48d1-a4ad-8a6045685ace tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190" status: 200 len: 1508 microversion: 2.1 time: 0.864422 Oct 26 13:32:24.220700 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2834/5694] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:32:23 2022] GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 => generated 1508 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:32:25.244699 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3dbc0106-6dbb-4436-a0f6-98e18d91918a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:32:25.245305 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3dbc0106-6dbb-4436-a0f6-98e18d91918a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:32:25.256796 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3dbc0106-6dbb-4436-a0f6-98e18d91918a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:25.257299 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3dbc0106-6dbb-4436-a0f6-98e18d91918a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:25.257765 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3dbc0106-6dbb-4436-a0f6-98e18d91918a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:25.271229 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3dbc0106-6dbb-4436-a0f6-98e18d91918a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:25.273833 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3dbc0106-6dbb-4436-a0f6-98e18d91918a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:25.274666 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3dbc0106-6dbb-4436-a0f6-98e18d91918a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:26.402502 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3dbc0106-6dbb-4436-a0f6-98e18d91918a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:32:26.418689 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3dbc0106-6dbb-4436-a0f6-98e18d91918a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190" status: 200 len: 1508 microversion: 2.1 time: 1.178057 Oct 26 13:32:26.420015 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2861/5695] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:32:25 2022] GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 => generated 1508 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:32:27.451467 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-81e34905-4946-467a-a5f7-9ed62b8ff034 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:32:27.452141 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-81e34905-4946-467a-a5f7-9ed62b8ff034 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:32:27.476513 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=22 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:32:27.482589 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81e34905-4946-467a-a5f7-9ed62b8ff034 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:27.488183 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81e34905-4946-467a-a5f7-9ed62b8ff034 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:27.493461 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81e34905-4946-467a-a5f7-9ed62b8ff034 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:27.497860 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81e34905-4946-467a-a5f7-9ed62b8ff034 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:27.511857 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81e34905-4946-467a-a5f7-9ed62b8ff034 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:27.518419 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81e34905-4946-467a-a5f7-9ed62b8ff034 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:28.839789 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-81e34905-4946-467a-a5f7-9ed62b8ff034 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:32:28.854590 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-81e34905-4946-467a-a5f7-9ed62b8ff034 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190" status: 200 len: 1505 microversion: 2.1 time: 1.410555 Oct 26 13:32:28.855933 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2835/5696] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:32:27 2022] GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 => generated 1505 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:32:29.882900 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e24467ea-575a-41cd-ba14-37e24fd8804f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:32:29.884815 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e24467ea-575a-41cd-ba14-37e24fd8804f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:32:29.889331 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=30 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:32:29.906848 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e24467ea-575a-41cd-ba14-37e24fd8804f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:29.908624 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e24467ea-575a-41cd-ba14-37e24fd8804f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:29.909101 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e24467ea-575a-41cd-ba14-37e24fd8804f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:29.911471 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e24467ea-575a-41cd-ba14-37e24fd8804f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:29.911961 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e24467ea-575a-41cd-ba14-37e24fd8804f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:29.912404 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e24467ea-575a-41cd-ba14-37e24fd8804f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:29.976819 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=68 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:32:30.388247 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e24467ea-575a-41cd-ba14-37e24fd8804f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:32:30.423566 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e24467ea-575a-41cd-ba14-37e24fd8804f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190" status: 200 len: 1505 microversion: 2.1 time: 0.546621 Oct 26 13:32:30.424193 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2862/5697] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:32:29 2022] GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 => generated 1505 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:32:31.452477 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0fb672da-a45d-4658-b239-118be441b877 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:32:31.453109 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0fb672da-a45d-4658-b239-118be441b877 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:32:31.466402 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0fb672da-a45d-4658-b239-118be441b877 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:31.467118 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0fb672da-a45d-4658-b239-118be441b877 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:31.470454 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0fb672da-a45d-4658-b239-118be441b877 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:31.471545 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0fb672da-a45d-4658-b239-118be441b877 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:31.472192 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0fb672da-a45d-4658-b239-118be441b877 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:31.472807 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0fb672da-a45d-4658-b239-118be441b877 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:32.062827 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-aca05fed-9253-48d1-82c7-d8c3daf72d34 req-1b18cc7a-ff89-4eb6-a43b-184586a85d7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb1b8c75-80fa-4c58-acb0-0a38b1cb4190", "name": "network-vif-unplugged", "status": "completed", "tag": "779c4ff9-aef3-47c6-bc9d-fb3332928fb3"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:32:32.075264 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-aca05fed-9253-48d1-82c7-d8c3daf72d34 req-1b18cc7a-ff89-4eb6-a43b-184586a85d7a service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:32.075957 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-aca05fed-9253-48d1-82c7-d8c3daf72d34 req-1b18cc7a-ff89-4eb6-a43b-184586a85d7a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:32.076547 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-aca05fed-9253-48d1-82c7-d8c3daf72d34 req-1b18cc7a-ff89-4eb6-a43b-184586a85d7a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:32.093288 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-aca05fed-9253-48d1-82c7-d8c3daf72d34 req-1b18cc7a-ff89-4eb6-a43b-184586a85d7a service nova] Creating event network-vif-unplugged:779c4ff9-aef3-47c6-bc9d-fb3332928fb3 for instance cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 on n-h1-862686-1 Oct 26 13:32:32.104783 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-aca05fed-9253-48d1-82c7-d8c3daf72d34 req-1b18cc7a-ff89-4eb6-a43b-184586a85d7a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045470 Oct 26 13:32:32.114400 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2863/5698] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:32:32.594175 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0fb672da-a45d-4658-b239-118be441b877 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:32:32.603752 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0fb672da-a45d-4658-b239-118be441b877 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190" status: 200 len: 1505 microversion: 2.1 time: 1.156505 Oct 26 13:32:32.614377 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2836/5699] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:32:31 2022] GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 => generated 1505 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:32:33.725807 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-33cd7b5d-52fb-4119-9b22-42cb9e57abbe tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:32:33.727220 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-33cd7b5d-52fb-4119-9b22-42cb9e57abbe tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:32:33.741624 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33cd7b5d-52fb-4119-9b22-42cb9e57abbe tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:33.743936 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33cd7b5d-52fb-4119-9b22-42cb9e57abbe tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:33.747323 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33cd7b5d-52fb-4119-9b22-42cb9e57abbe tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:33.749807 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33cd7b5d-52fb-4119-9b22-42cb9e57abbe tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:33.752253 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33cd7b5d-52fb-4119-9b22-42cb9e57abbe tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:33.753371 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33cd7b5d-52fb-4119-9b22-42cb9e57abbe tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:34.266176 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-33cd7b5d-52fb-4119-9b22-42cb9e57abbe tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:32:34.280113 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-33cd7b5d-52fb-4119-9b22-42cb9e57abbe tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190" status: 200 len: 1448 microversion: 2.1 time: 0.560253 Oct 26 13:32:34.281450 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2864/5700] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:32:33 2022] GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 => generated 1448 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:32:34.339345 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6ca61d8d-4c15-4280-9329-8d4ef7b7e467 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:32:34.340266 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6ca61d8d-4c15-4280-9329-8d4ef7b7e467 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:32:34.349906 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ca61d8d-4c15-4280-9329-8d4ef7b7e467 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:34.350564 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ca61d8d-4c15-4280-9329-8d4ef7b7e467 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:34.351102 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ca61d8d-4c15-4280-9329-8d4ef7b7e467 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:34.351849 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ca61d8d-4c15-4280-9329-8d4ef7b7e467 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:34.353147 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ca61d8d-4c15-4280-9329-8d4ef7b7e467 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:34.353650 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ca61d8d-4c15-4280-9329-8d4ef7b7e467 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:35.235787 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6ca61d8d-4c15-4280-9329-8d4ef7b7e467 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:32:35.244070 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6ca61d8d-4c15-4280-9329-8d4ef7b7e467 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 0.909869 Oct 26 13:32:35.261287 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2837/5701] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:32:34 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:32:35.283183 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e465324a-b639-428c-8eb5-7ce51d279a2b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:32:35.283800 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e465324a-b639-428c-8eb5-7ce51d279a2b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:32:35.319892 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e465324a-b639-428c-8eb5-7ce51d279a2b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:35.320131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e465324a-b639-428c-8eb5-7ce51d279a2b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:35.323241 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e465324a-b639-428c-8eb5-7ce51d279a2b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:35.330620 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e465324a-b639-428c-8eb5-7ce51d279a2b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:35.331628 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e465324a-b639-428c-8eb5-7ce51d279a2b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:35.332339 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e465324a-b639-428c-8eb5-7ce51d279a2b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:36.370265 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e465324a-b639-428c-8eb5-7ce51d279a2b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:32:36.389607 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e465324a-b639-428c-8eb5-7ce51d279a2b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 1.113286 Oct 26 13:32:36.396092 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2865/5702] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:32:35 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:32:36.418950 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-73add75b-7840-4906-8172-68a81fe89fea tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:32:36.419904 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-73add75b-7840-4906-8172-68a81fe89fea tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:32:36.438847 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73add75b-7840-4906-8172-68a81fe89fea tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:36.439675 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73add75b-7840-4906-8172-68a81fe89fea tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:36.440110 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73add75b-7840-4906-8172-68a81fe89fea tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:36.440896 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73add75b-7840-4906-8172-68a81fe89fea tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:36.441386 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73add75b-7840-4906-8172-68a81fe89fea tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:36.441936 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73add75b-7840-4906-8172-68a81fe89fea tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:36.964195 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-73add75b-7840-4906-8172-68a81fe89fea tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:32:36.972618 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-73add75b-7840-4906-8172-68a81fe89fea tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 0.558743 Oct 26 13:32:36.976530 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2838/5703] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:32:36 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:32:36.997147 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-782d4f47-1a7e-4ada-baa7-a5aeda716466 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:32:36.997921 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-782d4f47-1a7e-4ada-baa7-a5aeda716466 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:32:37.010578 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-782d4f47-1a7e-4ada-baa7-a5aeda716466 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:37.011079 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-782d4f47-1a7e-4ada-baa7-a5aeda716466 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:37.011529 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-782d4f47-1a7e-4ada-baa7-a5aeda716466 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:37.012246 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-782d4f47-1a7e-4ada-baa7-a5aeda716466 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:37.012708 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-782d4f47-1a7e-4ada-baa7-a5aeda716466 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:37.013136 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-782d4f47-1a7e-4ada-baa7-a5aeda716466 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:38.120472 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-782d4f47-1a7e-4ada-baa7-a5aeda716466 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:32:38.135286 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-782d4f47-1a7e-4ada-baa7-a5aeda716466 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 1.136682 Oct 26 13:32:38.136273 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2866/5704] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:32:36 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:32:38.168103 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-abaa8aa8-b002-4166-8ebd-beddcf37533d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:32:38.185349 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-abaa8aa8-b002-4166-8ebd-beddcf37533d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:38.185884 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-abaa8aa8-b002-4166-8ebd-beddcf37533d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:38.186321 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-abaa8aa8-b002-4166-8ebd-beddcf37533d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:38.257324 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-abaa8aa8-b002-4166-8ebd-beddcf37533d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Going to try to stop instance {{(pid=120597) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 26 13:32:38.346693 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-abaa8aa8-b002-4166-8ebd-beddcf37533d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "POST /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa/action" status: 202 len: 0 microversion: 2.1 time: 0.183081 Oct 26 13:32:38.348077 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2839/5705] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:32:38 2022] POST /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:32:38.358617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ede5e7da-cb4f-4b12-88ca-e2e33edef5dc tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:32:38.361680 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ede5e7da-cb4f-4b12-88ca-e2e33edef5dc tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:32:38.384765 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ede5e7da-cb4f-4b12-88ca-e2e33edef5dc tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:38.385689 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ede5e7da-cb4f-4b12-88ca-e2e33edef5dc tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:38.388597 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ede5e7da-cb4f-4b12-88ca-e2e33edef5dc tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:38.389666 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ede5e7da-cb4f-4b12-88ca-e2e33edef5dc tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:38.390358 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ede5e7da-cb4f-4b12-88ca-e2e33edef5dc tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:38.392663 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ede5e7da-cb4f-4b12-88ca-e2e33edef5dc tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:39.449925 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ede5e7da-cb4f-4b12-88ca-e2e33edef5dc tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:32:39.477590 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ede5e7da-cb4f-4b12-88ca-e2e33edef5dc tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1676 microversion: 2.1 time: 1.124501 Oct 26 13:32:39.478398 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2867/5706] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:32:38 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1676 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:32:40.511440 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a7d41fcf-e807-4852-87f2-835e94bf81a2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:32:40.516927 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a7d41fcf-e807-4852-87f2-835e94bf81a2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:32:40.536099 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7d41fcf-e807-4852-87f2-835e94bf81a2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:40.536919 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7d41fcf-e807-4852-87f2-835e94bf81a2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:40.540313 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7d41fcf-e807-4852-87f2-835e94bf81a2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:40.541357 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7d41fcf-e807-4852-87f2-835e94bf81a2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:40.542108 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7d41fcf-e807-4852-87f2-835e94bf81a2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:40.549599 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7d41fcf-e807-4852-87f2-835e94bf81a2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:41.422009 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a7d41fcf-e807-4852-87f2-835e94bf81a2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:32:41.438456 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a7d41fcf-e807-4852-87f2-835e94bf81a2 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1676 microversion: 2.1 time: 0.934647 Oct 26 13:32:41.442598 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2840/5707] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:32:40 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1676 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:32:42.470702 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d5010a4b-d830-415e-acb6-5fddd5ac79e8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:32:42.471902 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d5010a4b-d830-415e-acb6-5fddd5ac79e8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:32:42.481143 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5010a4b-d830-415e-acb6-5fddd5ac79e8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:42.490123 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5010a4b-d830-415e-acb6-5fddd5ac79e8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:42.490251 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5010a4b-d830-415e-acb6-5fddd5ac79e8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:42.490932 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5010a4b-d830-415e-acb6-5fddd5ac79e8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:42.491397 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5010a4b-d830-415e-acb6-5fddd5ac79e8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:42.491824 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5010a4b-d830-415e-acb6-5fddd5ac79e8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:42.999338 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d5010a4b-d830-415e-acb6-5fddd5ac79e8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:32:43.007949 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d5010a4b-d830-415e-acb6-5fddd5ac79e8 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1676 microversion: 2.1 time: 0.541037 Oct 26 13:32:43.010064 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2868/5708] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:32:42 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1676 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:32:44.035944 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f3265bd6-b027-4303-98ea-d3c3ffd27ece tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:32:44.037325 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f3265bd6-b027-4303-98ea-d3c3ffd27ece tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:32:44.058158 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3265bd6-b027-4303-98ea-d3c3ffd27ece tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:44.062502 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3265bd6-b027-4303-98ea-d3c3ffd27ece tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:44.063265 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3265bd6-b027-4303-98ea-d3c3ffd27ece tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:44.064269 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3265bd6-b027-4303-98ea-d3c3ffd27ece tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:44.065652 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3265bd6-b027-4303-98ea-d3c3ffd27ece tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:44.066323 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3265bd6-b027-4303-98ea-d3c3ffd27ece tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:45.127374 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f3265bd6-b027-4303-98ea-d3c3ffd27ece tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:32:45.137000 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f3265bd6-b027-4303-98ea-d3c3ffd27ece tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1676 microversion: 2.1 time: 1.105434 Oct 26 13:32:45.139652 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2841/5709] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:32:44 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1676 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:32:46.165143 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7290ba94-f92f-41e7-9b34-f5ea6edc813f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:32:46.165901 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7290ba94-f92f-41e7-9b34-f5ea6edc813f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:32:46.190933 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7290ba94-f92f-41e7-9b34-f5ea6edc813f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:46.192528 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7290ba94-f92f-41e7-9b34-f5ea6edc813f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:46.195255 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7290ba94-f92f-41e7-9b34-f5ea6edc813f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:46.203833 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7290ba94-f92f-41e7-9b34-f5ea6edc813f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:46.211436 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7290ba94-f92f-41e7-9b34-f5ea6edc813f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:46.212062 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7290ba94-f92f-41e7-9b34-f5ea6edc813f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:48.029845 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7290ba94-f92f-41e7-9b34-f5ea6edc813f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:32:48.049952 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7290ba94-f92f-41e7-9b34-f5ea6edc813f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1676 microversion: 2.1 time: 1.889378 Oct 26 13:32:48.065606 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2869/5710] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:32:46 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1676 bytes in 1902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:32:48.522982 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ee840b4d-4679-454b-b787-6cf74e5b1712 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Action: 'create', calling method: .version_select at 0x7f6731343ee0>, body: {"keypair": {"name": "tempest-keypair-1716804817", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuYJwad/mVevKE3rpWMJvwMpdiYt91Nwv2c2lJek+GrdWbFprBMJuGS+v2r+J9kj6qxdrKjcsbMbm8ztC/JM4rfCxx9MKU6ubE9pfc99eFYTq3wAjYpfRKwU+ZkdrSa8A=="}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:32:48.585965 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-ee840b4d-4679-454b-b787-6cf74e5b1712 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Getting quotas for project b383d6b193c64891ac63f3a26c996e20. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:32:48.609902 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-ee840b4d-4679-454b-b787-6cf74e5b1712 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Getting quotas for user ac38637c647f4ddc84566bc6896ebabb and project b383d6b193c64891ac63f3a26c996e20. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:32:48.663511 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ee840b4d-4679-454b-b787-6cf74e5b1712 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.490196 Oct 26 13:32:48.671728 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2842/5711] 10.222.0.40 () {62 vars in 1200 bytes} [Wed Oct 26 13:32:48 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 499 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 26 13:32:49.079449 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-115a8685-19f4-4c6a-93f3-c19ba3a41da0 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:32:49.080183 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-115a8685-19f4-4c6a-93f3-c19ba3a41da0 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:32:49.102601 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-115a8685-19f4-4c6a-93f3-c19ba3a41da0 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:49.112430 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-115a8685-19f4-4c6a-93f3-c19ba3a41da0 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:49.113386 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-115a8685-19f4-4c6a-93f3-c19ba3a41da0 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:49.114422 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-115a8685-19f4-4c6a-93f3-c19ba3a41da0 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:49.123625 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-115a8685-19f4-4c6a-93f3-c19ba3a41da0 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:49.124476 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-115a8685-19f4-4c6a-93f3-c19ba3a41da0 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:50.328931 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-115a8685-19f4-4c6a-93f3-c19ba3a41da0 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:32:50.342439 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-115a8685-19f4-4c6a-93f3-c19ba3a41da0 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1653 microversion: 2.1 time: 1.266515 Oct 26 13:32:50.366227 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2870/5712] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:32:49 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1653 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:32:50.375427 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c1eccd67-5e7e-4095-ac32-c14b8d922ce3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:32:50.393628 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c1eccd67-5e7e-4095-ac32-c14b8d922ce3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:50.405715 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c1eccd67-5e7e-4095-ac32-c14b8d922ce3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:50.406318 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c1eccd67-5e7e-4095-ac32-c14b8d922ce3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:50.418969 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:32:50.470415 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f03736bb-0dfa-495e-9d06-45e49b7bb8da tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1644822312", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "4058cd6c-5f3b-40e2-baf1-f66f0d85cdf3"}], "key_name": "tempest-TestSecurityGroupsBasicOps-697462233", "security_groups": []}, "os:scheduler_hints": {"different_host": ["dc8d9140-3f8d-44ad-86f4-36d67fbe7d19"]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:32:50.518316 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c1eccd67-5e7e-4095-ac32-c14b8d922ce3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Going to try to start instance {{(pid=120597) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 26 13:32:50.611893 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-f03736bb-0dfa-495e-9d06-45e49b7bb8da tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] validate_networks() for [('4058cd6c-5f3b-40e2-baf1-f66f0d85cdf3', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:32:50.639572 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c1eccd67-5e7e-4095-ac32-c14b8d922ce3 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "POST /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa/action" status: 202 len: 0 microversion: 2.1 time: 0.267024 Oct 26 13:32:50.642235 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2843/5713] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:32:50 2022] POST /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:32:50.655258 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9dbbde91-aac5-4433-82a7-d0c055a6431f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:32:50.656556 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9dbbde91-aac5-4433-82a7-d0c055a6431f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:32:50.672452 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9dbbde91-aac5-4433-82a7-d0c055a6431f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:50.677161 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9dbbde91-aac5-4433-82a7-d0c055a6431f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:50.678038 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9dbbde91-aac5-4433-82a7-d0c055a6431f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:50.679836 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9dbbde91-aac5-4433-82a7-d0c055a6431f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:50.681353 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9dbbde91-aac5-4433-82a7-d0c055a6431f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:50.682045 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9dbbde91-aac5-4433-82a7-d0c055a6431f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:51.920512 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9dbbde91-aac5-4433-82a7-d0c055a6431f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:32:51.947357 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9dbbde91-aac5-4433-82a7-d0c055a6431f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1662 microversion: 2.1 time: 1.298377 Oct 26 13:32:51.948085 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2844/5714] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:32:50 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1662 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:32:52.589914 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-f03736bb-0dfa-495e-9d06-45e49b7bb8da tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:32:52.590453 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-f03736bb-0dfa-495e-9d06-45e49b7bb8da tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:32:52.590935 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-f03736bb-0dfa-495e-9d06-45e49b7bb8da tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:32:52.591346 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-f03736bb-0dfa-495e-9d06-45e49b7bb8da tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:32:52.591823 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-f03736bb-0dfa-495e-9d06-45e49b7bb8da tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:32:52.618986 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f03736bb-0dfa-495e-9d06-45e49b7bb8da tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:52.619543 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f03736bb-0dfa-495e-9d06-45e49b7bb8da tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:52.620072 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f03736bb-0dfa-495e-9d06-45e49b7bb8da tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:52.620735 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f03736bb-0dfa-495e-9d06-45e49b7bb8da tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:52.621202 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f03736bb-0dfa-495e-9d06-45e49b7bb8da tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:52.632348 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f03736bb-0dfa-495e-9d06-45e49b7bb8da tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:52.689560 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-f03736bb-0dfa-495e-9d06-45e49b7bb8da tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Getting quotas for project b6d89db2ac0141d694e64f474244e527. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:32:52.703015 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-f03736bb-0dfa-495e-9d06-45e49b7bb8da tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Getting quotas for user 8f745ae4d44f4cdebb40e233b0deed7a and project b6d89db2ac0141d694e64f474244e527. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:32:52.720709 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f03736bb-0dfa-495e-9d06-45e49b7bb8da tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:32:52.725611 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f03736bb-0dfa-495e-9d06-45e49b7bb8da tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] [instance: a8a2fa49-55b9-411b-b024-16f27a3aa1b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:32:52.811467 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f03736bb-0dfa-495e-9d06-45e49b7bb8da tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 2.344856 Oct 26 13:32:52.822164 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2871/5715] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:32:50 2022] POST /compute/v2.1/servers => generated 361 bytes in 2356 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 26 13:32:52.828624 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-767c8099-2cad-4ce5-b3b4-48b20e0582a2 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:32:52.829776 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-767c8099-2cad-4ce5-b3b4-48b20e0582a2 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] [instance: a8a2fa49-55b9-411b-b024-16f27a3aa1b8] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:32:52.976551 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-eb9d1e8f-0109-444f-b719-7f6cdf7e530d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:32:52.978805 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-eb9d1e8f-0109-444f-b719-7f6cdf7e530d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:32:52.992982 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb9d1e8f-0109-444f-b719-7f6cdf7e530d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:52.993838 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb9d1e8f-0109-444f-b719-7f6cdf7e530d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:52.994439 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb9d1e8f-0109-444f-b719-7f6cdf7e530d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:52.995343 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb9d1e8f-0109-444f-b719-7f6cdf7e530d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:52.995976 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb9d1e8f-0109-444f-b719-7f6cdf7e530d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:52.996725 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb9d1e8f-0109-444f-b719-7f6cdf7e530d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:53.359919 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-eb9d1e8f-0109-444f-b719-7f6cdf7e530d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:32:53.377908 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-eb9d1e8f-0109-444f-b719-7f6cdf7e530d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1662 microversion: 2.1 time: 0.406204 Oct 26 13:32:53.382601 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2872/5716] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:32:52 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1662 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:32:53.507152 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-767c8099-2cad-4ce5-b3b4-48b20e0582a2 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f745ae4d44f4cdebb40e233b0deed7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d89db2ac0141d694e64f474244e527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:32:53.518585 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-767c8099-2cad-4ce5-b3b4-48b20e0582a2 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] 10.222.0.40 "GET /compute/v2.1/servers/a8a2fa49-55b9-411b-b024-16f27a3aa1b8" status: 200 len: 1241 microversion: 2.1 time: 0.695404 Oct 26 13:32:53.522133 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2845/5717] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:32:52 2022] GET /compute/v2.1/servers/a8a2fa49-55b9-411b-b024-16f27a3aa1b8 => generated 1241 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:32:54.409699 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3c94d50f-f0f8-4797-876d-406e0fe6361f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:32:54.410443 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3c94d50f-f0f8-4797-876d-406e0fe6361f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:32:54.424603 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c94d50f-f0f8-4797-876d-406e0fe6361f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:54.425111 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c94d50f-f0f8-4797-876d-406e0fe6361f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:54.425587 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c94d50f-f0f8-4797-876d-406e0fe6361f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:54.426315 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c94d50f-f0f8-4797-876d-406e0fe6361f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:54.428248 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c94d50f-f0f8-4797-876d-406e0fe6361f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:54.428912 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c94d50f-f0f8-4797-876d-406e0fe6361f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:54.552521 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b2bcd286-100c-4223-a0e2-3e4488b51e64 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:32:54.553145 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b2bcd286-100c-4223-a0e2-3e4488b51e64 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] [instance: a8a2fa49-55b9-411b-b024-16f27a3aa1b8] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:32:54.572638 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b2bcd286-100c-4223-a0e2-3e4488b51e64 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:54.573156 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b2bcd286-100c-4223-a0e2-3e4488b51e64 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:54.573636 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b2bcd286-100c-4223-a0e2-3e4488b51e64 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:54.574373 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b2bcd286-100c-4223-a0e2-3e4488b51e64 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:54.574838 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b2bcd286-100c-4223-a0e2-3e4488b51e64 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:54.575390 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b2bcd286-100c-4223-a0e2-3e4488b51e64 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:54.758668 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b2bcd286-100c-4223-a0e2-3e4488b51e64 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f745ae4d44f4cdebb40e233b0deed7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d89db2ac0141d694e64f474244e527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:32:54.771509 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b2bcd286-100c-4223-a0e2-3e4488b51e64 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] 10.222.0.40 "GET /compute/v2.1/servers/a8a2fa49-55b9-411b-b024-16f27a3aa1b8" status: 200 len: 1293 microversion: 2.1 time: 0.223280 Oct 26 13:32:54.771849 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2846/5718] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:32:54 2022] GET /compute/v2.1/servers/a8a2fa49-55b9-411b-b024-16f27a3aa1b8 => generated 1293 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:32:55.802245 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1b7ab547-8446-415d-b6b2-506563fc9880 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:32:55.803773 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1b7ab547-8446-415d-b6b2-506563fc9880 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] [instance: a8a2fa49-55b9-411b-b024-16f27a3aa1b8] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:32:55.817940 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b7ab547-8446-415d-b6b2-506563fc9880 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:55.819100 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b7ab547-8446-415d-b6b2-506563fc9880 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:55.819831 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b7ab547-8446-415d-b6b2-506563fc9880 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:55.824311 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b7ab547-8446-415d-b6b2-506563fc9880 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:55.825101 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b7ab547-8446-415d-b6b2-506563fc9880 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:55.825851 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b7ab547-8446-415d-b6b2-506563fc9880 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:56.085244 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1b7ab547-8446-415d-b6b2-506563fc9880 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f745ae4d44f4cdebb40e233b0deed7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d89db2ac0141d694e64f474244e527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:32:56.131441 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1b7ab547-8446-415d-b6b2-506563fc9880 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] 10.222.0.40 "GET /compute/v2.1/servers/a8a2fa49-55b9-411b-b024-16f27a3aa1b8" status: 200 len: 1299 microversion: 2.1 time: 0.333090 Oct 26 13:32:56.136546 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2847/5719] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:32:55 2022] GET /compute/v2.1/servers/a8a2fa49-55b9-411b-b024-16f27a3aa1b8 => generated 1299 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:32:56.674771 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3c94d50f-f0f8-4797-876d-406e0fe6361f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:32:56.686801 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3c94d50f-f0f8-4797-876d-406e0fe6361f tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 2.281403 Oct 26 13:32:56.690887 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2873/5720] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:32:54 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 2286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:32:56.719180 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3a279074-a1ce-43a9-a8e8-6dbf8bde0aa4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:32:56.719980 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3a279074-a1ce-43a9-a8e8-6dbf8bde0aa4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:32:56.731687 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a279074-a1ce-43a9-a8e8-6dbf8bde0aa4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:56.732193 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a279074-a1ce-43a9-a8e8-6dbf8bde0aa4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:56.732640 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a279074-a1ce-43a9-a8e8-6dbf8bde0aa4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:56.733370 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a279074-a1ce-43a9-a8e8-6dbf8bde0aa4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:56.733861 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a279074-a1ce-43a9-a8e8-6dbf8bde0aa4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:56.734290 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a279074-a1ce-43a9-a8e8-6dbf8bde0aa4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:57.167823 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-70740dfa-7873-4d99-84da-676d6fb43ea4 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:32:57.168549 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-70740dfa-7873-4d99-84da-676d6fb43ea4 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] [instance: a8a2fa49-55b9-411b-b024-16f27a3aa1b8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:32:57.186126 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70740dfa-7873-4d99-84da-676d6fb43ea4 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:57.187556 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70740dfa-7873-4d99-84da-676d6fb43ea4 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:57.189468 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70740dfa-7873-4d99-84da-676d6fb43ea4 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:57.193583 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70740dfa-7873-4d99-84da-676d6fb43ea4 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:57.194343 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70740dfa-7873-4d99-84da-676d6fb43ea4 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:57.197359 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70740dfa-7873-4d99-84da-676d6fb43ea4 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:57.552565 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-70740dfa-7873-4d99-84da-676d6fb43ea4 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f745ae4d44f4cdebb40e233b0deed7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d89db2ac0141d694e64f474244e527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:32:57.564082 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-70740dfa-7873-4d99-84da-676d6fb43ea4 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] 10.222.0.40 "GET /compute/v2.1/servers/a8a2fa49-55b9-411b-b024-16f27a3aa1b8" status: 200 len: 1299 microversion: 2.1 time: 0.403432 Oct 26 13:32:57.592148 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2874/5721] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:32:57 2022] GET /compute/v2.1/servers/a8a2fa49-55b9-411b-b024-16f27a3aa1b8 => generated 1299 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:32:57.783774 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3a279074-a1ce-43a9-a8e8-6dbf8bde0aa4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:32:57.814021 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3a279074-a1ce-43a9-a8e8-6dbf8bde0aa4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 1.083146 Oct 26 13:32:57.815625 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2848/5722] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:32:56 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:32:57.841115 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8863e36f-f187-4a1b-be43-69d8af84b095 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:32:57.842303 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8863e36f-f187-4a1b-be43-69d8af84b095 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:32:57.849342 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8863e36f-f187-4a1b-be43-69d8af84b095 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:57.850402 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8863e36f-f187-4a1b-be43-69d8af84b095 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:57.851012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8863e36f-f187-4a1b-be43-69d8af84b095 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:57.852704 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8863e36f-f187-4a1b-be43-69d8af84b095 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:57.853357 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8863e36f-f187-4a1b-be43-69d8af84b095 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:57.853958 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8863e36f-f187-4a1b-be43-69d8af84b095 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:58.459373 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8863e36f-f187-4a1b-be43-69d8af84b095 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:32:58.471357 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8863e36f-f187-4a1b-be43-69d8af84b095 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 0.635302 Oct 26 13:32:58.474111 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2875/5723] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:32:57 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:32:58.502354 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c36aab8c-11a8-456f-bf21-1ff971846a78 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:32:58.502987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c36aab8c-11a8-456f-bf21-1ff971846a78 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:32:58.505932 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:32:58.528130 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c36aab8c-11a8-456f-bf21-1ff971846a78 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:58.531354 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c36aab8c-11a8-456f-bf21-1ff971846a78 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:58.536959 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c36aab8c-11a8-456f-bf21-1ff971846a78 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:58.542409 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c36aab8c-11a8-456f-bf21-1ff971846a78 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:58.544313 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c36aab8c-11a8-456f-bf21-1ff971846a78 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:58.545005 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c36aab8c-11a8-456f-bf21-1ff971846a78 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:58.588949 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c7402ef5-81b5-4490-a2d8-885a49aa0678 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:32:58.589960 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c7402ef5-81b5-4490-a2d8-885a49aa0678 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] [instance: a8a2fa49-55b9-411b-b024-16f27a3aa1b8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:32:58.611588 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c7402ef5-81b5-4490-a2d8-885a49aa0678 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:58.612569 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c7402ef5-81b5-4490-a2d8-885a49aa0678 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:58.614468 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c7402ef5-81b5-4490-a2d8-885a49aa0678 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:58.617000 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c7402ef5-81b5-4490-a2d8-885a49aa0678 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:58.618252 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c7402ef5-81b5-4490-a2d8-885a49aa0678 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:58.619810 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c7402ef5-81b5-4490-a2d8-885a49aa0678 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:58.783030 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c7402ef5-81b5-4490-a2d8-885a49aa0678 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f745ae4d44f4cdebb40e233b0deed7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d89db2ac0141d694e64f474244e527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:32:58.791534 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c7402ef5-81b5-4490-a2d8-885a49aa0678 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] 10.222.0.40 "GET /compute/v2.1/servers/a8a2fa49-55b9-411b-b024-16f27a3aa1b8" status: 200 len: 1299 microversion: 2.1 time: 0.207285 Oct 26 13:32:58.793020 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2876/5724] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:32:58 2022] GET /compute/v2.1/servers/a8a2fa49-55b9-411b-b024-16f27a3aa1b8 => generated 1299 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:32:58.798576 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2ca8cf52-a339-4373-94d1-58abd2116ced tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1277240658", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "01e7b1be-b19e-4ce7-aa3b-91385c11c108"}], "security_groups": [{"name": "tempest-securitygroup--2017488202"}], "key_name": "tempest-keypair-1716804817", "user_data": "}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:32:59.091563 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-2ca8cf52-a339-4373-94d1-58abd2116ced tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] validate_networks() for [('01e7b1be-b19e-4ce7-aa3b-91385c11c108', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:32:59.136114 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c36aab8c-11a8-456f-bf21-1ff971846a78 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:32:59.146086 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c36aab8c-11a8-456f-bf21-1ff971846a78 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 0.647347 Oct 26 13:32:59.158018 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2849/5725] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:32:58 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:32:59.171238 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-89c5a401-e43c-4ca7-892f-b0731ee7b779 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:32:59.172223 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-89c5a401-e43c-4ca7-892f-b0731ee7b779 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:32:59.179266 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89c5a401-e43c-4ca7-892f-b0731ee7b779 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:59.180730 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89c5a401-e43c-4ca7-892f-b0731ee7b779 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:59.181424 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89c5a401-e43c-4ca7-892f-b0731ee7b779 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:59.182660 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89c5a401-e43c-4ca7-892f-b0731ee7b779 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:59.183120 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89c5a401-e43c-4ca7-892f-b0731ee7b779 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:59.183989 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89c5a401-e43c-4ca7-892f-b0731ee7b779 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:59.507798 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-89c5a401-e43c-4ca7-892f-b0731ee7b779 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:32:59.531451 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-89c5a401-e43c-4ca7-892f-b0731ee7b779 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 0.361118 Oct 26 13:32:59.556484 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2850/5726] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:32:59 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:32:59.569128 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7e205033-ea55-43dc-bef3-c1ad8ac23ddf tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:32:59.570039 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7e205033-ea55-43dc-bef3-c1ad8ac23ddf tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:32:59.579477 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e205033-ea55-43dc-bef3-c1ad8ac23ddf tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:59.580204 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e205033-ea55-43dc-bef3-c1ad8ac23ddf tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:59.581550 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e205033-ea55-43dc-bef3-c1ad8ac23ddf tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:59.583427 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e205033-ea55-43dc-bef3-c1ad8ac23ddf tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:59.584861 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e205033-ea55-43dc-bef3-c1ad8ac23ddf tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:59.585777 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e205033-ea55-43dc-bef3-c1ad8ac23ddf tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:59.624419 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-7e205033-ea55-43dc-bef3-c1ad8ac23ddf tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lazy-loading 'flavor' on Instance uuid 341d8b3a-d684-4969-a5cf-a6aea1a055fa {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:32:59.745576 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7e205033-ea55-43dc-bef3-c1ad8ac23ddf tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "POST /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa/action" status: 202 len: 0 microversion: 2.1 time: 0.185475 Oct 26 13:32:59.747804 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2851/5727] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:32:59 2022] POST /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:32:59.786049 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5c3ad022-b1f1-41b3-bcfb-4477aa505fe9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:32:59.789639 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5c3ad022-b1f1-41b3-bcfb-4477aa505fe9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:32:59.808968 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c3ad022-b1f1-41b3-bcfb-4477aa505fe9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:59.809961 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c3ad022-b1f1-41b3-bcfb-4477aa505fe9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:59.811712 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c3ad022-b1f1-41b3-bcfb-4477aa505fe9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:32:59.814536 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c3ad022-b1f1-41b3-bcfb-4477aa505fe9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:32:59.816717 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c3ad022-b1f1-41b3-bcfb-4477aa505fe9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:32:59.819100 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c3ad022-b1f1-41b3-bcfb-4477aa505fe9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:00.644180 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-2ca8cf52-a339-4373-94d1-58abd2116ced tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:33:00.645405 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-2ca8cf52-a339-4373-94d1-58abd2116ced tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:33:00.646675 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-2ca8cf52-a339-4373-94d1-58abd2116ced tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:33:00.647529 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-2ca8cf52-a339-4373-94d1-58abd2116ced tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:33:00.648228 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-2ca8cf52-a339-4373-94d1-58abd2116ced tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:33:00.651947 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:33:00.666304 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ca8cf52-a339-4373-94d1-58abd2116ced tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:00.667055 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ca8cf52-a339-4373-94d1-58abd2116ced tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:00.667652 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ca8cf52-a339-4373-94d1-58abd2116ced tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:00.669043 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ca8cf52-a339-4373-94d1-58abd2116ced tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:00.669703 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ca8cf52-a339-4373-94d1-58abd2116ced tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:00.670448 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ca8cf52-a339-4373-94d1-58abd2116ced tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:00.688651 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=82 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:33:00.733549 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-2ca8cf52-a339-4373-94d1-58abd2116ced tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Getting quotas for project b383d6b193c64891ac63f3a26c996e20. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:33:00.741111 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5c3ad022-b1f1-41b3-bcfb-4477aa505fe9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:00.742937 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-2ca8cf52-a339-4373-94d1-58abd2116ced tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Getting quotas for user ac38637c647f4ddc84566bc6896ebabb and project b383d6b193c64891ac63f3a26c996e20. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:33:00.754115 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5c3ad022-b1f1-41b3-bcfb-4477aa505fe9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1674 microversion: 2.1 time: 0.991379 Oct 26 13:33:00.754701 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2852/5728] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:32:59 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1674 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:33:00.761111 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8b4dbe96-1722-4591-a953-51cb4ce37e2e tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:00.765841 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2ca8cf52-a339-4373-94d1-58abd2116ced tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:33:00.767747 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8b4dbe96-1722-4591-a953-51cb4ce37e2e tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] [instance: a8a2fa49-55b9-411b-b024-16f27a3aa1b8] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:00.778563 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2ca8cf52-a339-4373-94d1-58abd2116ced tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:33:00.790474 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8b4dbe96-1722-4591-a953-51cb4ce37e2e tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:00.791399 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8b4dbe96-1722-4591-a953-51cb4ce37e2e tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:00.792063 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8b4dbe96-1722-4591-a953-51cb4ce37e2e tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:00.793132 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8b4dbe96-1722-4591-a953-51cb4ce37e2e tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:00.793857 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8b4dbe96-1722-4591-a953-51cb4ce37e2e tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:00.794524 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8b4dbe96-1722-4591-a953-51cb4ce37e2e tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:00.943212 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2ca8cf52-a339-4373-94d1-58abd2116ced tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.148799 Oct 26 13:33:00.944097 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2877/5729] 10.222.0.40 () {62 vars in 1188 bytes} [Wed Oct 26 13:32:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 2150 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 26 13:33:00.955759 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ed63009f-ce78-46e1-8540-62a4faa80152 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:00.956628 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ed63009f-ce78-46e1-8540-62a4faa80152 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:01.050418 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8b4dbe96-1722-4591-a953-51cb4ce37e2e tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f745ae4d44f4cdebb40e233b0deed7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d89db2ac0141d694e64f474244e527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:01.062144 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8b4dbe96-1722-4591-a953-51cb4ce37e2e tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] 10.222.0.40 "GET /compute/v2.1/servers/a8a2fa49-55b9-411b-b024-16f27a3aa1b8" status: 200 len: 1299 microversion: 2.1 time: 0.304362 Oct 26 13:33:01.064815 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2853/5730] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:33:00 2022] GET /compute/v2.1/servers/a8a2fa49-55b9-411b-b024-16f27a3aa1b8 => generated 1299 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:33:01.219957 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ed63009f-ce78-46e1-8540-62a4faa80152 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:01.231345 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ed63009f-ce78-46e1-8540-62a4faa80152 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:01.232885 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ed63009f-ce78-46e1-8540-62a4faa80152 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:01.233969 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ed63009f-ce78-46e1-8540-62a4faa80152 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1282 microversion: 2.20 time: 0.282178 Oct 26 13:33:01.238243 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2878/5731] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:33:00 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1282 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:33:01.388831 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-7a1c7bd9-fa9d-4870-9221-fa4b446e24c4 req-c461bf85-5e6c-4924-82ed-6cc973b5d4b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8a2fa49-55b9-411b-b024-16f27a3aa1b8", "tag": "6beb9dfc-6e5d-443d-bc16-257e312a2fd7"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:33:01.413773 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-7a1c7bd9-fa9d-4870-9221-fa4b446e24c4 req-c461bf85-5e6c-4924-82ed-6cc973b5d4b0 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:01.415064 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-7a1c7bd9-fa9d-4870-9221-fa4b446e24c4 req-c461bf85-5e6c-4924-82ed-6cc973b5d4b0 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:01.415838 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-7a1c7bd9-fa9d-4870-9221-fa4b446e24c4 req-c461bf85-5e6c-4924-82ed-6cc973b5d4b0 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:01.438216 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-7a1c7bd9-fa9d-4870-9221-fa4b446e24c4 req-c461bf85-5e6c-4924-82ed-6cc973b5d4b0 service nova] Creating event network-changed:6beb9dfc-6e5d-443d-bc16-257e312a2fd7 for instance a8a2fa49-55b9-411b-b024-16f27a3aa1b8 on n-h1-862686-1 Oct 26 13:33:01.452327 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-7a1c7bd9-fa9d-4870-9221-fa4b446e24c4 req-c461bf85-5e6c-4924-82ed-6cc973b5d4b0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070489 Oct 26 13:33:01.453437 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2854/5732] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:33:01.793133 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d5ff6e1c-db96-49ed-a920-8bc0eee0bbe9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:01.793842 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d5ff6e1c-db96-49ed-a920-8bc0eee0bbe9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:01.812872 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5ff6e1c-db96-49ed-a920-8bc0eee0bbe9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:01.817890 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5ff6e1c-db96-49ed-a920-8bc0eee0bbe9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:01.821751 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5ff6e1c-db96-49ed-a920-8bc0eee0bbe9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:01.825606 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5ff6e1c-db96-49ed-a920-8bc0eee0bbe9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:01.826129 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5ff6e1c-db96-49ed-a920-8bc0eee0bbe9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:01.826579 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5ff6e1c-db96-49ed-a920-8bc0eee0bbe9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:02.101084 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-64890d9b-1097-4f96-87bf-79dec1a90fb5 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:02.102993 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-64890d9b-1097-4f96-87bf-79dec1a90fb5 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] [instance: a8a2fa49-55b9-411b-b024-16f27a3aa1b8] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:02.131164 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64890d9b-1097-4f96-87bf-79dec1a90fb5 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:02.134784 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64890d9b-1097-4f96-87bf-79dec1a90fb5 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:02.137700 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64890d9b-1097-4f96-87bf-79dec1a90fb5 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:02.141744 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64890d9b-1097-4f96-87bf-79dec1a90fb5 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:02.142304 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64890d9b-1097-4f96-87bf-79dec1a90fb5 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:02.145013 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64890d9b-1097-4f96-87bf-79dec1a90fb5 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:02.545235 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-64890d9b-1097-4f96-87bf-79dec1a90fb5 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f745ae4d44f4cdebb40e233b0deed7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d89db2ac0141d694e64f474244e527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:02.580169 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-64890d9b-1097-4f96-87bf-79dec1a90fb5 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] 10.222.0.40 "GET /compute/v2.1/servers/a8a2fa49-55b9-411b-b024-16f27a3aa1b8" status: 200 len: 1299 microversion: 2.1 time: 0.493382 Oct 26 13:33:02.583933 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2855/5733] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:33:02 2022] GET /compute/v2.1/servers/a8a2fa49-55b9-411b-b024-16f27a3aa1b8 => generated 1299 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:33:02.604575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9646bbff-32f6-40a9-bbbf-37e9ce7a3732 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:02.605252 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9646bbff-32f6-40a9-bbbf-37e9ce7a3732 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:02.641408 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9646bbff-32f6-40a9-bbbf-37e9ce7a3732 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:02.644554 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9646bbff-32f6-40a9-bbbf-37e9ce7a3732 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:02.644974 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9646bbff-32f6-40a9-bbbf-37e9ce7a3732 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:02.662900 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9646bbff-32f6-40a9-bbbf-37e9ce7a3732 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:02.663516 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9646bbff-32f6-40a9-bbbf-37e9ce7a3732 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:02.664565 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9646bbff-32f6-40a9-bbbf-37e9ce7a3732 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:02.791234 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d5ff6e1c-db96-49ed-a920-8bc0eee0bbe9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:02.803828 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d5ff6e1c-db96-49ed-a920-8bc0eee0bbe9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1657 microversion: 2.1 time: 1.014463 Oct 26 13:33:02.810503 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2879/5734] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:33:01 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1657 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:33:02.836725 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-21e54fe7-43de-4d04-95df-d83e087304ce tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:33:02.837864 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-21e54fe7-43de-4d04-95df-d83e087304ce tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:02.854461 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-21e54fe7-43de-4d04-95df-d83e087304ce tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:02.857508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-21e54fe7-43de-4d04-95df-d83e087304ce tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:02.858349 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-21e54fe7-43de-4d04-95df-d83e087304ce tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:02.859658 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-21e54fe7-43de-4d04-95df-d83e087304ce tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:02.862536 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-21e54fe7-43de-4d04-95df-d83e087304ce tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:02.863430 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-21e54fe7-43de-4d04-95df-d83e087304ce tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:03.056897 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-21e54fe7-43de-4d04-95df-d83e087304ce tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "POST /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa/action" status: 202 len: 0 microversion: 2.1 time: 0.224748 Oct 26 13:33:03.058328 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2880/5735] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:33:02 2022] POST /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:33:03.078432 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9646bbff-32f6-40a9-bbbf-37e9ce7a3732 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:03.080964 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2096671b-d958-4c32-bcd3-70ef10958505 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:03.083563 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2096671b-d958-4c32-bcd3-70ef10958505 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:03.096529 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2096671b-d958-4c32-bcd3-70ef10958505 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:03.099469 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2096671b-d958-4c32-bcd3-70ef10958505 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:03.101045 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2096671b-d958-4c32-bcd3-70ef10958505 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:03.104485 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2096671b-d958-4c32-bcd3-70ef10958505 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:03.108081 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2096671b-d958-4c32-bcd3-70ef10958505 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:03.109748 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2096671b-d958-4c32-bcd3-70ef10958505 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:03.127703 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9646bbff-32f6-40a9-bbbf-37e9ce7a3732 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:03.132458 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9646bbff-32f6-40a9-bbbf-37e9ce7a3732 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:03.134668 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9646bbff-32f6-40a9-bbbf-37e9ce7a3732 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1334 microversion: 2.20 time: 0.549415 Oct 26 13:33:03.163478 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2856/5736] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:33:02 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1334 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:33:03.525901 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2096671b-d958-4c32-bcd3-70ef10958505 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:03.538508 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2096671b-d958-4c32-bcd3-70ef10958505 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1663 microversion: 2.1 time: 0.472695 Oct 26 13:33:03.540612 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2881/5737] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:33:03 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1663 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:33:03.610498 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:33:03.621504 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e545c02a-bf9b-46ba-b5ef-2e948760aeb2 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:03.622123 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e545c02a-bf9b-46ba-b5ef-2e948760aeb2 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] [instance: a8a2fa49-55b9-411b-b024-16f27a3aa1b8] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:03.644384 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e545c02a-bf9b-46ba-b5ef-2e948760aeb2 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:03.645080 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e545c02a-bf9b-46ba-b5ef-2e948760aeb2 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:03.645899 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e545c02a-bf9b-46ba-b5ef-2e948760aeb2 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:03.674529 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e545c02a-bf9b-46ba-b5ef-2e948760aeb2 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:03.684145 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e545c02a-bf9b-46ba-b5ef-2e948760aeb2 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:03.689887 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e545c02a-bf9b-46ba-b5ef-2e948760aeb2 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:04.170350 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b61c8a5a-7aee-4085-896d-06c65e8afdd7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:04.171196 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b61c8a5a-7aee-4085-896d-06c65e8afdd7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:04.191822 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b61c8a5a-7aee-4085-896d-06c65e8afdd7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:04.193976 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b61c8a5a-7aee-4085-896d-06c65e8afdd7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:04.194464 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b61c8a5a-7aee-4085-896d-06c65e8afdd7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:04.196993 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b61c8a5a-7aee-4085-896d-06c65e8afdd7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:04.199687 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b61c8a5a-7aee-4085-896d-06c65e8afdd7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:04.200215 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b61c8a5a-7aee-4085-896d-06c65e8afdd7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:04.458058 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b61c8a5a-7aee-4085-896d-06c65e8afdd7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:04.473125 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b61c8a5a-7aee-4085-896d-06c65e8afdd7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:04.474898 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b61c8a5a-7aee-4085-896d-06c65e8afdd7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:04.480896 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b61c8a5a-7aee-4085-896d-06c65e8afdd7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1340 microversion: 2.20 time: 0.314687 Oct 26 13:33:04.482157 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2882/5738] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:33:04 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1340 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:33:04.563342 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f1d56a5a-7244-4a9b-96b1-e00c9ce919d5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:04.564410 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f1d56a5a-7244-4a9b-96b1-e00c9ce919d5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:04.593713 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1d56a5a-7244-4a9b-96b1-e00c9ce919d5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:04.594652 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1d56a5a-7244-4a9b-96b1-e00c9ce919d5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:04.595281 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1d56a5a-7244-4a9b-96b1-e00c9ce919d5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:04.596184 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1d56a5a-7244-4a9b-96b1-e00c9ce919d5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:04.596891 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1d56a5a-7244-4a9b-96b1-e00c9ce919d5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:04.611870 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1d56a5a-7244-4a9b-96b1-e00c9ce919d5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:04.957964 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e545c02a-bf9b-46ba-b5ef-2e948760aeb2 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f745ae4d44f4cdebb40e233b0deed7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d89db2ac0141d694e64f474244e527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:04.968260 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e545c02a-bf9b-46ba-b5ef-2e948760aeb2 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] 10.222.0.40 "GET /compute/v2.1/servers/a8a2fa49-55b9-411b-b024-16f27a3aa1b8" status: 200 len: 1299 microversion: 2.1 time: 1.358702 Oct 26 13:33:04.977698 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2857/5739] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:33:03 2022] GET /compute/v2.1/servers/a8a2fa49-55b9-411b-b024-16f27a3aa1b8 => generated 1299 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:33:05.510506 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0bcbf4ea-8024-4a57-bb8f-6a603b497be8 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:05.511668 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0bcbf4ea-8024-4a57-bb8f-6a603b497be8 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:05.536894 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0bcbf4ea-8024-4a57-bb8f-6a603b497be8 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:05.538954 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0bcbf4ea-8024-4a57-bb8f-6a603b497be8 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:05.541728 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0bcbf4ea-8024-4a57-bb8f-6a603b497be8 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:05.543052 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0bcbf4ea-8024-4a57-bb8f-6a603b497be8 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:05.544834 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0bcbf4ea-8024-4a57-bb8f-6a603b497be8 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:05.549920 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0bcbf4ea-8024-4a57-bb8f-6a603b497be8 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:05.739652 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f1d56a5a-7244-4a9b-96b1-e00c9ce919d5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:05.766707 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f1d56a5a-7244-4a9b-96b1-e00c9ce919d5 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1663 microversion: 2.1 time: 1.207169 Oct 26 13:33:05.772604 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2883/5740] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:33:04 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1663 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:33:06.004606 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-963c183e-2be7-469a-bf83-9436d08c6aec tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:06.005361 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-963c183e-2be7-469a-bf83-9436d08c6aec tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] [instance: a8a2fa49-55b9-411b-b024-16f27a3aa1b8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:06.024563 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-963c183e-2be7-469a-bf83-9436d08c6aec tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:06.025232 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-963c183e-2be7-469a-bf83-9436d08c6aec tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:06.027717 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-963c183e-2be7-469a-bf83-9436d08c6aec tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:06.035919 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-963c183e-2be7-469a-bf83-9436d08c6aec tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:06.036676 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-963c183e-2be7-469a-bf83-9436d08c6aec tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:06.037284 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-963c183e-2be7-469a-bf83-9436d08c6aec tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:06.661095 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-963c183e-2be7-469a-bf83-9436d08c6aec tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f745ae4d44f4cdebb40e233b0deed7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d89db2ac0141d694e64f474244e527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:06.676769 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-963c183e-2be7-469a-bf83-9436d08c6aec tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] 10.222.0.40 "GET /compute/v2.1/servers/a8a2fa49-55b9-411b-b024-16f27a3aa1b8" status: 200 len: 1299 microversion: 2.1 time: 0.679677 Oct 26 13:33:06.677081 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2884/5741] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:33:05 2022] GET /compute/v2.1/servers/a8a2fa49-55b9-411b-b024-16f27a3aa1b8 => generated 1299 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:33:06.802648 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-800dc0d2-d1a8-4704-aca6-5aa9fde6d795 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:06.803276 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-800dc0d2-d1a8-4704-aca6-5aa9fde6d795 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:06.815775 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-800dc0d2-d1a8-4704-aca6-5aa9fde6d795 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:06.816224 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0bcbf4ea-8024-4a57-bb8f-6a603b497be8 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:06.819388 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:33:06.823697 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-800dc0d2-d1a8-4704-aca6-5aa9fde6d795 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:06.824219 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-800dc0d2-d1a8-4704-aca6-5aa9fde6d795 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:06.824921 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-800dc0d2-d1a8-4704-aca6-5aa9fde6d795 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:06.825382 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-800dc0d2-d1a8-4704-aca6-5aa9fde6d795 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:06.825840 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-800dc0d2-d1a8-4704-aca6-5aa9fde6d795 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:06.843347 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0bcbf4ea-8024-4a57-bb8f-6a603b497be8 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:06.844862 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0bcbf4ea-8024-4a57-bb8f-6a603b497be8 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:06.846052 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0bcbf4ea-8024-4a57-bb8f-6a603b497be8 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1340 microversion: 2.20 time: 1.341127 Oct 26 13:33:06.846722 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2858/5742] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:33:05 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1340 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:33:07.702046 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-24e86867-b0ab-48af-aa58-ef3bb277ebde tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:07.703055 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-24e86867-b0ab-48af-aa58-ef3bb277ebde tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] [instance: a8a2fa49-55b9-411b-b024-16f27a3aa1b8] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:07.741944 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-24e86867-b0ab-48af-aa58-ef3bb277ebde tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:07.744380 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-24e86867-b0ab-48af-aa58-ef3bb277ebde tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:07.744950 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-24e86867-b0ab-48af-aa58-ef3bb277ebde tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:07.747383 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-24e86867-b0ab-48af-aa58-ef3bb277ebde tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:07.749557 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-24e86867-b0ab-48af-aa58-ef3bb277ebde tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:07.750190 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-24e86867-b0ab-48af-aa58-ef3bb277ebde tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:07.891914 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-800dc0d2-d1a8-4704-aca6-5aa9fde6d795 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:07.907812 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-800dc0d2-d1a8-4704-aca6-5aa9fde6d795 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1663 microversion: 2.1 time: 1.108672 Oct 26 13:33:07.908815 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2885/5743] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:33:06 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1663 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:33:07.923188 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2a0329bc-b79f-4d1a-96f8-ac988acd9210 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:07.923871 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2a0329bc-b79f-4d1a-96f8-ac988acd9210 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:07.956841 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2a0329bc-b79f-4d1a-96f8-ac988acd9210 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:07.958520 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2a0329bc-b79f-4d1a-96f8-ac988acd9210 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:07.960351 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2a0329bc-b79f-4d1a-96f8-ac988acd9210 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:07.962561 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2a0329bc-b79f-4d1a-96f8-ac988acd9210 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:07.963055 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2a0329bc-b79f-4d1a-96f8-ac988acd9210 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:07.965979 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2a0329bc-b79f-4d1a-96f8-ac988acd9210 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:08.260225 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-24e86867-b0ab-48af-aa58-ef3bb277ebde tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f745ae4d44f4cdebb40e233b0deed7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d89db2ac0141d694e64f474244e527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:08.269541 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-24e86867-b0ab-48af-aa58-ef3bb277ebde tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] 10.222.0.40 "GET /compute/v2.1/servers/a8a2fa49-55b9-411b-b024-16f27a3aa1b8" status: 200 len: 1299 microversion: 2.1 time: 0.572742 Oct 26 13:33:08.286169 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2859/5744] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:33:07 2022] GET /compute/v2.1/servers/a8a2fa49-55b9-411b-b024-16f27a3aa1b8 => generated 1299 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:33:08.578730 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2a0329bc-b79f-4d1a-96f8-ac988acd9210 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:08.587904 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2a0329bc-b79f-4d1a-96f8-ac988acd9210 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:08.589291 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2a0329bc-b79f-4d1a-96f8-ac988acd9210 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:08.604342 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2a0329bc-b79f-4d1a-96f8-ac988acd9210 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1340 microversion: 2.20 time: 0.694108 Oct 26 13:33:08.604918 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2886/5745] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:33:07 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1340 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:33:08.941787 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c7395555-f4fe-4900-81be-13c8f914a8e4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:08.942428 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c7395555-f4fe-4900-81be-13c8f914a8e4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:08.982013 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c7395555-f4fe-4900-81be-13c8f914a8e4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:08.982955 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c7395555-f4fe-4900-81be-13c8f914a8e4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:08.983584 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c7395555-f4fe-4900-81be-13c8f914a8e4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:08.987120 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c7395555-f4fe-4900-81be-13c8f914a8e4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:08.987770 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c7395555-f4fe-4900-81be-13c8f914a8e4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:08.989084 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c7395555-f4fe-4900-81be-13c8f914a8e4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:09.294566 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d00ae88e-876a-4451-9aec-36b6eb764526 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:09.295840 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d00ae88e-876a-4451-9aec-36b6eb764526 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] [instance: a8a2fa49-55b9-411b-b024-16f27a3aa1b8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:09.309053 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d00ae88e-876a-4451-9aec-36b6eb764526 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:09.323180 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d00ae88e-876a-4451-9aec-36b6eb764526 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:09.323817 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d00ae88e-876a-4451-9aec-36b6eb764526 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:09.324771 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d00ae88e-876a-4451-9aec-36b6eb764526 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:09.325406 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d00ae88e-876a-4451-9aec-36b6eb764526 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:09.326024 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d00ae88e-876a-4451-9aec-36b6eb764526 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:09.919305 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c7395555-f4fe-4900-81be-13c8f914a8e4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:09.927213 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c7395555-f4fe-4900-81be-13c8f914a8e4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 0.991092 Oct 26 13:33:09.927801 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2860/5746] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:33:08 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:33:09.946863 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ec17c38b-1d92-453a-911b-890eda798130 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:09.947796 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ec17c38b-1d92-453a-911b-890eda798130 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:09.959941 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ec17c38b-1d92-453a-911b-890eda798130 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:09.960441 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ec17c38b-1d92-453a-911b-890eda798130 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:09.967710 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ec17c38b-1d92-453a-911b-890eda798130 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:09.968607 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ec17c38b-1d92-453a-911b-890eda798130 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:09.969096 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ec17c38b-1d92-453a-911b-890eda798130 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:09.969736 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ec17c38b-1d92-453a-911b-890eda798130 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:10.055341 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d00ae88e-876a-4451-9aec-36b6eb764526 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f745ae4d44f4cdebb40e233b0deed7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d89db2ac0141d694e64f474244e527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:10.077776 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d00ae88e-876a-4451-9aec-36b6eb764526 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] 10.222.0.40 "GET /compute/v2.1/servers/a8a2fa49-55b9-411b-b024-16f27a3aa1b8" status: 200 len: 1299 microversion: 2.1 time: 0.783066 Oct 26 13:33:10.080868 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2887/5747] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:33:09 2022] GET /compute/v2.1/servers/a8a2fa49-55b9-411b-b024-16f27a3aa1b8 => generated 1299 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:33:10.091330 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-27a2c299-74fd-4138-8bf6-539254dbbd1e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:10.093875 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-27a2c299-74fd-4138-8bf6-539254dbbd1e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:10.106270 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-27a2c299-74fd-4138-8bf6-539254dbbd1e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:10.106775 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-27a2c299-74fd-4138-8bf6-539254dbbd1e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:10.107220 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-27a2c299-74fd-4138-8bf6-539254dbbd1e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:10.107950 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-27a2c299-74fd-4138-8bf6-539254dbbd1e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:10.108414 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-27a2c299-74fd-4138-8bf6-539254dbbd1e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:10.113847 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-27a2c299-74fd-4138-8bf6-539254dbbd1e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:10.373978 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ec17c38b-1d92-453a-911b-890eda798130 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:10.389551 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ec17c38b-1d92-453a-911b-890eda798130 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:10.393166 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ec17c38b-1d92-453a-911b-890eda798130 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:10.394558 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ec17c38b-1d92-453a-911b-890eda798130 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1408 microversion: 2.20 time: 0.463183 Oct 26 13:33:10.396827 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2861/5748] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:33:09 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1408 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:33:10.460186 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-27a2c299-74fd-4138-8bf6-539254dbbd1e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:10.469325 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-27a2c299-74fd-4138-8bf6-539254dbbd1e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1666 microversion: 2.1 time: 0.387044 Oct 26 13:33:10.473027 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2888/5749] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:33:10 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1666 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:33:10.498167 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e07c52b9-68fb-49a7-bed8-10c0474d9913 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:10.498755 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e07c52b9-68fb-49a7-bed8-10c0474d9913 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:10.505555 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e07c52b9-68fb-49a7-bed8-10c0474d9913 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:10.506480 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e07c52b9-68fb-49a7-bed8-10c0474d9913 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:10.507233 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e07c52b9-68fb-49a7-bed8-10c0474d9913 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:10.509412 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e07c52b9-68fb-49a7-bed8-10c0474d9913 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:10.510209 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e07c52b9-68fb-49a7-bed8-10c0474d9913 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:10.510894 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e07c52b9-68fb-49a7-bed8-10c0474d9913 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:10.548426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e07c52b9-68fb-49a7-bed8-10c0474d9913 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:33:10.560640 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.compute.api [None req-e07c52b9-68fb-49a7-bed8-10c0474d9913 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] Working on deleting snapshot c50d74e8-7238-48de-a93f-6df97c3692de from shelved instance... Oct 26 13:33:10.737686 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-009f1eed-c8e5-473b-adff-e3ffffecd0b0 req-2c409456-c0ef-4483-952a-550efaab70e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8a2fa49-55b9-411b-b024-16f27a3aa1b8", "name": "network-vif-plugged", "status": "completed", "tag": "6beb9dfc-6e5d-443d-bc16-257e312a2fd7"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:33:10.750575 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=4 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:33:10.771558 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-009f1eed-c8e5-473b-adff-e3ffffecd0b0 req-2c409456-c0ef-4483-952a-550efaab70e1 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:10.772424 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-009f1eed-c8e5-473b-adff-e3ffffecd0b0 req-2c409456-c0ef-4483-952a-550efaab70e1 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:10.773055 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-009f1eed-c8e5-473b-adff-e3ffffecd0b0 req-2c409456-c0ef-4483-952a-550efaab70e1 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:10.809354 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-009f1eed-c8e5-473b-adff-e3ffffecd0b0 req-2c409456-c0ef-4483-952a-550efaab70e1 service nova] Creating event network-vif-plugged:6beb9dfc-6e5d-443d-bc16-257e312a2fd7 for instance a8a2fa49-55b9-411b-b024-16f27a3aa1b8 on n-h1-862686-1 Oct 26 13:33:10.824672 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-009f1eed-c8e5-473b-adff-e3ffffecd0b0 req-2c409456-c0ef-4483-952a-550efaab70e1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090954 Oct 26 13:33:10.835080 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2889/5750] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:33:11.119451 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2bf5089d-750d-4fe5-98d3-3d0ae6fc5664 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:11.120163 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2bf5089d-750d-4fe5-98d3-3d0ae6fc5664 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] [instance: a8a2fa49-55b9-411b-b024-16f27a3aa1b8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:11.129928 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2bf5089d-750d-4fe5-98d3-3d0ae6fc5664 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:11.130427 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2bf5089d-750d-4fe5-98d3-3d0ae6fc5664 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:11.130868 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2bf5089d-750d-4fe5-98d3-3d0ae6fc5664 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:11.148060 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2bf5089d-750d-4fe5-98d3-3d0ae6fc5664 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:11.159905 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2bf5089d-750d-4fe5-98d3-3d0ae6fc5664 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:11.160560 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2bf5089d-750d-4fe5-98d3-3d0ae6fc5664 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:11.231817 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=14 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:33:11.660584 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2bf5089d-750d-4fe5-98d3-3d0ae6fc5664 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f745ae4d44f4cdebb40e233b0deed7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d89db2ac0141d694e64f474244e527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:11.689702 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2bf5089d-750d-4fe5-98d3-3d0ae6fc5664 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] 10.222.0.40 "GET /compute/v2.1/servers/a8a2fa49-55b9-411b-b024-16f27a3aa1b8" status: 200 len: 1299 microversion: 2.1 time: 0.582897 Oct 26 13:33:11.709972 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2890/5751] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:33:11 2022] GET /compute/v2.1/servers/a8a2fa49-55b9-411b-b024-16f27a3aa1b8 => generated 1299 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:33:11.728810 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-15489a7a-7015-4245-99db-8a8285dffad6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:11.730002 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-15489a7a-7015-4245-99db-8a8285dffad6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:11.738402 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15489a7a-7015-4245-99db-8a8285dffad6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:11.739261 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15489a7a-7015-4245-99db-8a8285dffad6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:11.739920 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15489a7a-7015-4245-99db-8a8285dffad6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:11.740928 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15489a7a-7015-4245-99db-8a8285dffad6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:11.741735 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15489a7a-7015-4245-99db-8a8285dffad6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:11.743190 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15489a7a-7015-4245-99db-8a8285dffad6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:11.910607 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e07c52b9-68fb-49a7-bed8-10c0474d9913 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] Doing local delete in cell 2e5960f1-3c3d-401b-877c-fe82eb67bd3f(cell1) {{(pid=120597) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 26 13:33:11.916087 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e07c52b9-68fb-49a7-bed8-10c0474d9913 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:11.926289 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e07c52b9-68fb-49a7-bed8-10c0474d9913 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:11.926905 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e07c52b9-68fb-49a7-bed8-10c0474d9913 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:11.927487 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.compute.api [None req-e07c52b9-68fb-49a7-bed8-10c0474d9913 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 26 13:33:11.932480 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-e07c52b9-68fb-49a7-bed8-10c0474d9913 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] deallocate_for_instance() {{(pid=120597) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 26 13:33:12.316116 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-15489a7a-7015-4245-99db-8a8285dffad6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:12.347134 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-15489a7a-7015-4245-99db-8a8285dffad6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:12.349011 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-15489a7a-7015-4245-99db-8a8285dffad6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:12.357243 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-15489a7a-7015-4245-99db-8a8285dffad6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1408 microversion: 2.20 time: 0.640001 Oct 26 13:33:12.360214 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2891/5752] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:33:11 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1408 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:33:12.720416 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-92648f26-74b2-4bb9-9d8c-7efd5980973d tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:12.721034 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-92648f26-74b2-4bb9-9d8c-7efd5980973d tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] [instance: a8a2fa49-55b9-411b-b024-16f27a3aa1b8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:12.740649 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-92648f26-74b2-4bb9-9d8c-7efd5980973d tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:12.741170 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-92648f26-74b2-4bb9-9d8c-7efd5980973d tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:12.747878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-92648f26-74b2-4bb9-9d8c-7efd5980973d tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:12.748882 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-92648f26-74b2-4bb9-9d8c-7efd5980973d tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:12.749562 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-92648f26-74b2-4bb9-9d8c-7efd5980973d tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:12.752547 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-92648f26-74b2-4bb9-9d8c-7efd5980973d tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:12.998021 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-92648f26-74b2-4bb9-9d8c-7efd5980973d tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f745ae4d44f4cdebb40e233b0deed7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d89db2ac0141d694e64f474244e527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:13.011107 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-92648f26-74b2-4bb9-9d8c-7efd5980973d tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] 10.222.0.40 "GET /compute/v2.1/servers/a8a2fa49-55b9-411b-b024-16f27a3aa1b8" status: 200 len: 1471 microversion: 2.1 time: 0.294544 Oct 26 13:33:13.013961 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2892/5753] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:33:12 2022] GET /compute/v2.1/servers/a8a2fa49-55b9-411b-b024-16f27a3aa1b8 => generated 1471 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:33:13.044886 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1c98266d-6979-440b-8a5d-87e1f9c4581c tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:13.048325 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1c98266d-6979-440b-8a5d-87e1f9c4581c tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] [instance: a8a2fa49-55b9-411b-b024-16f27a3aa1b8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:13.073924 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c98266d-6979-440b-8a5d-87e1f9c4581c tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:13.074641 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c98266d-6979-440b-8a5d-87e1f9c4581c tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:13.081732 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c98266d-6979-440b-8a5d-87e1f9c4581c tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:13.082935 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c98266d-6979-440b-8a5d-87e1f9c4581c tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:13.083571 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c98266d-6979-440b-8a5d-87e1f9c4581c tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:13.085360 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c98266d-6979-440b-8a5d-87e1f9c4581c tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:13.536610 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1c98266d-6979-440b-8a5d-87e1f9c4581c tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f745ae4d44f4cdebb40e233b0deed7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d89db2ac0141d694e64f474244e527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:13.550548 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1c98266d-6979-440b-8a5d-87e1f9c4581c tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] 10.222.0.40 "GET /compute/v2.1/servers/a8a2fa49-55b9-411b-b024-16f27a3aa1b8" status: 200 len: 1471 microversion: 2.1 time: 0.510795 Oct 26 13:33:13.551796 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2893/5754] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:33:13 2022] GET /compute/v2.1/servers/a8a2fa49-55b9-411b-b024-16f27a3aa1b8 => generated 1471 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:33:13.565795 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e4db4fdd-2292-445b-8a48-bc2cd4260b9c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:13.571157 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e4db4fdd-2292-445b-8a48-bc2cd4260b9c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:13.592349 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4db4fdd-2292-445b-8a48-bc2cd4260b9c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:13.597492 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4db4fdd-2292-445b-8a48-bc2cd4260b9c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:13.597971 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4db4fdd-2292-445b-8a48-bc2cd4260b9c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:13.598844 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4db4fdd-2292-445b-8a48-bc2cd4260b9c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:13.602417 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4db4fdd-2292-445b-8a48-bc2cd4260b9c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:13.602962 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4db4fdd-2292-445b-8a48-bc2cd4260b9c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:13.786682 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-e07c52b9-68fb-49a7-bed8-10c0474d9913 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] Updating instance_info_cache with network_info: [] {{(pid=120597) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 26 13:33:14.462939 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e4db4fdd-2292-445b-8a48-bc2cd4260b9c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:14.474438 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e4db4fdd-2292-445b-8a48-bc2cd4260b9c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:14.475904 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e4db4fdd-2292-445b-8a48-bc2cd4260b9c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:14.489946 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e4db4fdd-2292-445b-8a48-bc2cd4260b9c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1408 microversion: 2.20 time: 0.936508 Oct 26 13:33:14.493084 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2894/5755] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:33:13 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1408 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:33:14.526870 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-745d5fd9-ef09-47a7-9226-bd45c6d6eb30 tempest-TestSecurityGroupsBasicOps-445283395 tempest-TestSecurityGroupsBasicOps-445283395-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:14.530296 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-745d5fd9-ef09-47a7-9226-bd45c6d6eb30 tempest-TestSecurityGroupsBasicOps-445283395 tempest-TestSecurityGroupsBasicOps-445283395-project-admin] [instance: a8a2fa49-55b9-411b-b024-16f27a3aa1b8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:14.551347 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-745d5fd9-ef09-47a7-9226-bd45c6d6eb30 tempest-TestSecurityGroupsBasicOps-445283395 tempest-TestSecurityGroupsBasicOps-445283395-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:14.551995 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-745d5fd9-ef09-47a7-9226-bd45c6d6eb30 tempest-TestSecurityGroupsBasicOps-445283395 tempest-TestSecurityGroupsBasicOps-445283395-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:14.552555 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-745d5fd9-ef09-47a7-9226-bd45c6d6eb30 tempest-TestSecurityGroupsBasicOps-445283395 tempest-TestSecurityGroupsBasicOps-445283395-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:14.553965 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-745d5fd9-ef09-47a7-9226-bd45c6d6eb30 tempest-TestSecurityGroupsBasicOps-445283395 tempest-TestSecurityGroupsBasicOps-445283395-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:14.555207 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-745d5fd9-ef09-47a7-9226-bd45c6d6eb30 tempest-TestSecurityGroupsBasicOps-445283395 tempest-TestSecurityGroupsBasicOps-445283395-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:14.559755 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-745d5fd9-ef09-47a7-9226-bd45c6d6eb30 tempest-TestSecurityGroupsBasicOps-445283395 tempest-TestSecurityGroupsBasicOps-445283395-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:14.575034 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:33:14.779227 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e07c52b9-68fb-49a7-bed8-10c0474d9913 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "DELETE /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190" status: 204 len: 0 microversion: 2.1 time: 4.284847 Oct 26 13:33:14.781451 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2862/5756] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:33:10 2022] DELETE /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 => generated 0 bytes in 4288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:33:14.787368 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-5aad4fbf-bd53-40a8-91a2-79bd7f7d7755 req-3fc8b2d9-1ae7-4c48-91c7-65a044d30ff6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb1b8c75-80fa-4c58-acb0-0a38b1cb4190", "name": "network-vif-deleted", "tag": "779c4ff9-aef3-47c6-bc9d-fb3332928fb3"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:33:14.809464 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-5aad4fbf-bd53-40a8-91a2-79bd7f7d7755 req-3fc8b2d9-1ae7-4c48-91c7-65a044d30ff6 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:14.810083 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-5aad4fbf-bd53-40a8-91a2-79bd7f7d7755 req-3fc8b2d9-1ae7-4c48-91c7-65a044d30ff6 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:14.810514 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-5aad4fbf-bd53-40a8-91a2-79bd7f7d7755 req-3fc8b2d9-1ae7-4c48-91c7-65a044d30ff6 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:14.823520 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.compute.server_external_events [req-5aad4fbf-bd53-40a8-91a2-79bd7f7d7755 req-3fc8b2d9-1ae7-4c48-91c7-65a044d30ff6 service nova] Unable to find a host for instance cb1b8c75-80fa-4c58-acb0-0a38b1cb4190. Dropping event network-vif-deleted {{(pid=120597) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 26 13:33:14.824429 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-5aad4fbf-bd53-40a8-91a2-79bd7f7d7755 req-3fc8b2d9-1ae7-4c48-91c7-65a044d30ff6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.041994 Oct 26 13:33:14.825359 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2863/5757] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 43 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 26 13:33:14.830203 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b8932ca9-3d22-48d4-8a8a-43fddab1a36a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:14.830815 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b8932ca9-3d22-48d4-8a8a-43fddab1a36a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: cb1b8c75-80fa-4c58-acb0-0a38b1cb4190] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:14.838346 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8932ca9-3d22-48d4-8a8a-43fddab1a36a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:14.838834 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8932ca9-3d22-48d4-8a8a-43fddab1a36a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:14.839271 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8932ca9-3d22-48d4-8a8a-43fddab1a36a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:14.839970 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8932ca9-3d22-48d4-8a8a-43fddab1a36a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:14.840601 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8932ca9-3d22-48d4-8a8a-43fddab1a36a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:14.841272 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8932ca9-3d22-48d4-8a8a-43fddab1a36a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:14.857119 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-b8932ca9-3d22-48d4-8a8a-43fddab1a36a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] HTTP exception thrown: Instance cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 could not be found. Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b8932ca9-3d22-48d4-8a8a-43fddab1a36a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Request method failure captured: Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 HTTP/1.1 Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTTRuTNKOQB-nrFVO4ZQOSUPJw_t87hSQG4X0NnCZ-NkeLQePXfE28jjlOlL7XoeNcReKFB3n9XBYRIE9HcyLgGEDDp5gX1x_vTjrqFvjU0FYibg_1MyRrL2Ht61uOMaLpkZivAymUmDmap2-8WoM-6AmJL7TAW0hXVB6neLWiOUzoY Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: c0d1b1d2fe374ee5806eeee18712219f Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServerActionsTestJSON-871807092 Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c0d1b1d2fe374ee5806eeee18712219f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c0d1b1d2fe374ee5806eeee18712219f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c0d1b1d2fe374ee5806eeee18712219f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c0d1b1d2fe374ee5806eeee18712219f"}]}] Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServerActionsTestJSON-871807092 Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: c0d1b1d2fe374ee5806eeee18712219f Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServerActionsTestJSON-871807092 Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServerActionsTestJSON-871807092-project Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 3e9ff5a884f1416886f26a80c5b87b18 Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServerActionsTestJSON-871807092-project Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 could not be found. Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'cb1b8c75-80fa-4c58-acb0-0a38b1cb4190'} Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 could not be found. Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 could not be found. Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:33:14.859240 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:33:14.864504 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:33:14.864504 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:33:14.864504 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:33:14.864504 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:33:14.864504 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:33:14.864504 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 could not be found. Oct 26 13:33:14.864504 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:33:14.865964 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b8932ca9-3d22-48d4-8a8a-43fddab1a36a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Returning 404 to user: Instance cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:33:14.867119 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b8932ca9-3d22-48d4-8a8a-43fddab1a36a tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190" status: 404 len: 111 microversion: 2.1 time: 0.040684 Oct 26 13:33:14.868303 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2864/5758] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:33:14 2022] GET /compute/v2.1/servers/cb1b8c75-80fa-4c58-acb0-0a38b1cb4190 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:33:14.876479 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-184e71c5-c09f-440b-89ef-d33f585cec10 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:14.880851 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-184e71c5-c09f-440b-89ef-d33f585cec10 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 6df56119-b567-427a-87c9-8f45f9e32700] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:14.892932 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-184e71c5-c09f-440b-89ef-d33f585cec10 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:14.893505 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-184e71c5-c09f-440b-89ef-d33f585cec10 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:14.894116 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-184e71c5-c09f-440b-89ef-d33f585cec10 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:14.895952 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-184e71c5-c09f-440b-89ef-d33f585cec10 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:14.896890 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-184e71c5-c09f-440b-89ef-d33f585cec10 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:14.897804 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-184e71c5-c09f-440b-89ef-d33f585cec10 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:14.919416 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-745d5fd9-ef09-47a7-9226-bd45c6d6eb30 tempest-TestSecurityGroupsBasicOps-445283395 tempest-TestSecurityGroupsBasicOps-445283395-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/a8a2fa49-55b9-411b-b024-16f27a3aa1b8" status: 200 len: 1622 microversion: 2.1 time: 0.424640 Oct 26 13:33:14.937531 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2895/5759] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:33:14 2022] GET /compute/v2.1/servers/a8a2fa49-55b9-411b-b024-16f27a3aa1b8 => generated 1622 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:33:14.953267 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7847deaa-102c-4fc1-a111-c9cc1ba8ca69 tempest-TestSecurityGroupsBasicOps-445283395 tempest-TestSecurityGroupsBasicOps-445283395-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:14.954239 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7847deaa-102c-4fc1-a111-c9cc1ba8ca69 tempest-TestSecurityGroupsBasicOps-445283395 tempest-TestSecurityGroupsBasicOps-445283395-project-admin] [instance: dc8d9140-3f8d-44ad-86f4-36d67fbe7d19] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:14.959005 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-184e71c5-c09f-440b-89ef-d33f585cec10 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 6df56119-b567-427a-87c9-8f45f9e32700] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:33:14.971096 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7847deaa-102c-4fc1-a111-c9cc1ba8ca69 tempest-TestSecurityGroupsBasicOps-445283395 tempest-TestSecurityGroupsBasicOps-445283395-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:14.971613 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7847deaa-102c-4fc1-a111-c9cc1ba8ca69 tempest-TestSecurityGroupsBasicOps-445283395 tempest-TestSecurityGroupsBasicOps-445283395-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:14.972062 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7847deaa-102c-4fc1-a111-c9cc1ba8ca69 tempest-TestSecurityGroupsBasicOps-445283395 tempest-TestSecurityGroupsBasicOps-445283395-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:14.972789 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7847deaa-102c-4fc1-a111-c9cc1ba8ca69 tempest-TestSecurityGroupsBasicOps-445283395 tempest-TestSecurityGroupsBasicOps-445283395-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:14.973255 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7847deaa-102c-4fc1-a111-c9cc1ba8ca69 tempest-TestSecurityGroupsBasicOps-445283395 tempest-TestSecurityGroupsBasicOps-445283395-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:14.973720 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7847deaa-102c-4fc1-a111-c9cc1ba8ca69 tempest-TestSecurityGroupsBasicOps-445283395 tempest-TestSecurityGroupsBasicOps-445283395-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:15.152589 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-184e71c5-c09f-440b-89ef-d33f585cec10 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700" status: 204 len: 0 microversion: 2.1 time: 0.278362 Oct 26 13:33:15.153565 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2865/5760] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:33:14 2022] DELETE /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 26 13:33:15.179169 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-05741cf3-03b9-4974-9048-3bd5db16c26b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:15.182157 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-05741cf3-03b9-4974-9048-3bd5db16c26b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 6df56119-b567-427a-87c9-8f45f9e32700] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:15.202267 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05741cf3-03b9-4974-9048-3bd5db16c26b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:15.202781 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05741cf3-03b9-4974-9048-3bd5db16c26b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:15.204653 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05741cf3-03b9-4974-9048-3bd5db16c26b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:15.206439 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05741cf3-03b9-4974-9048-3bd5db16c26b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:15.206921 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05741cf3-03b9-4974-9048-3bd5db16c26b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:15.207367 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05741cf3-03b9-4974-9048-3bd5db16c26b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:15.634733 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-05741cf3-03b9-4974-9048-3bd5db16c26b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:15.647243 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-05741cf3-03b9-4974-9048-3bd5db16c26b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700" status: 200 len: 1465 microversion: 2.1 time: 0.487696 Oct 26 13:33:15.655147 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2866/5761] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:33:15 2022] GET /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700 => generated 1465 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:33:15.663208 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c65b1454-a45b-4638-8933-607a28eef4ad tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:15.664582 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c65b1454-a45b-4638-8933-607a28eef4ad tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:15.678497 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c65b1454-a45b-4638-8933-607a28eef4ad tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:15.683562 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c65b1454-a45b-4638-8933-607a28eef4ad tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:15.685213 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c65b1454-a45b-4638-8933-607a28eef4ad tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:15.690550 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c65b1454-a45b-4638-8933-607a28eef4ad tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:15.691283 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c65b1454-a45b-4638-8933-607a28eef4ad tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:15.691909 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c65b1454-a45b-4638-8933-607a28eef4ad tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:15.708400 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7847deaa-102c-4fc1-a111-c9cc1ba8ca69 tempest-TestSecurityGroupsBasicOps-445283395 tempest-TestSecurityGroupsBasicOps-445283395-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/dc8d9140-3f8d-44ad-86f4-36d67fbe7d19" status: 200 len: 1910 microversion: 2.1 time: 0.757989 Oct 26 13:33:15.731563 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2896/5762] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:33:14 2022] GET /compute/v2.1/servers/dc8d9140-3f8d-44ad-86f4-36d67fbe7d19 => generated 1910 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:33:16.282532 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7f97430f-c3c1-4f24-8a53-099700aedf62 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:16.283279 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7f97430f-c3c1-4f24-8a53-099700aedf62 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] [instance: a8a2fa49-55b9-411b-b024-16f27a3aa1b8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:16.303249 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f97430f-c3c1-4f24-8a53-099700aedf62 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:16.306133 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f97430f-c3c1-4f24-8a53-099700aedf62 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:16.306651 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f97430f-c3c1-4f24-8a53-099700aedf62 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:16.307656 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f97430f-c3c1-4f24-8a53-099700aedf62 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:16.308754 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f97430f-c3c1-4f24-8a53-099700aedf62 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:16.313633 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f97430f-c3c1-4f24-8a53-099700aedf62 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:16.381296 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7f97430f-c3c1-4f24-8a53-099700aedf62 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] [instance: a8a2fa49-55b9-411b-b024-16f27a3aa1b8] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:33:16.443473 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c65b1454-a45b-4638-8933-607a28eef4ad tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:16.453371 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c65b1454-a45b-4638-8933-607a28eef4ad tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:16.460621 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c65b1454-a45b-4638-8933-607a28eef4ad tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:16.462647 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c65b1454-a45b-4638-8933-607a28eef4ad tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1408 microversion: 2.20 time: 0.806201 Oct 26 13:33:16.463448 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2867/5763] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:33:15 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1408 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:33:16.556380 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7f97430f-c3c1-4f24-8a53-099700aedf62 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a8a2fa49-55b9-411b-b024-16f27a3aa1b8" status: 204 len: 0 microversion: 2.1 time: 0.278427 Oct 26 13:33:16.571284 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2897/5764] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:33:16 2022] DELETE /compute/v2.1/servers/a8a2fa49-55b9-411b-b024-16f27a3aa1b8 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:33:16.580939 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c965b0c8-8df4-416b-8410-d77b01b653b9 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:16.581910 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c965b0c8-8df4-416b-8410-d77b01b653b9 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] [instance: a8a2fa49-55b9-411b-b024-16f27a3aa1b8] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:16.595034 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c965b0c8-8df4-416b-8410-d77b01b653b9 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:16.596708 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c965b0c8-8df4-416b-8410-d77b01b653b9 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:16.597185 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c965b0c8-8df4-416b-8410-d77b01b653b9 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:16.600747 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c965b0c8-8df4-416b-8410-d77b01b653b9 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:16.602599 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c965b0c8-8df4-416b-8410-d77b01b653b9 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:16.603263 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c965b0c8-8df4-416b-8410-d77b01b653b9 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:16.692627 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b857f2a2-d8d6-4d91-a05d-d136d11d3188 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:16.692627 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b857f2a2-d8d6-4d91-a05d-d136d11d3188 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 6df56119-b567-427a-87c9-8f45f9e32700] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:16.708510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b857f2a2-d8d6-4d91-a05d-d136d11d3188 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:16.710932 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b857f2a2-d8d6-4d91-a05d-d136d11d3188 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:16.713579 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b857f2a2-d8d6-4d91-a05d-d136d11d3188 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:16.714662 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b857f2a2-d8d6-4d91-a05d-d136d11d3188 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:16.716992 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b857f2a2-d8d6-4d91-a05d-d136d11d3188 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:16.717724 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b857f2a2-d8d6-4d91-a05d-d136d11d3188 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:16.965117 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c965b0c8-8df4-416b-8410-d77b01b653b9 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f745ae4d44f4cdebb40e233b0deed7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d89db2ac0141d694e64f474244e527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:16.968604 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:33:16.969926 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b857f2a2-d8d6-4d91-a05d-d136d11d3188 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:16.983767 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c965b0c8-8df4-416b-8410-d77b01b653b9 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] 10.222.0.40 "GET /compute/v2.1/servers/a8a2fa49-55b9-411b-b024-16f27a3aa1b8" status: 200 len: 1477 microversion: 2.1 time: 0.408165 Oct 26 13:33:16.995640 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b857f2a2-d8d6-4d91-a05d-d136d11d3188 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700" status: 200 len: 1465 microversion: 2.1 time: 0.313177 Oct 26 13:33:16.996253 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2898/5765] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:33:16 2022] GET /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700 => generated 1465 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:33:16.998144 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2868/5766] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:33:16 2022] GET /compute/v2.1/servers/a8a2fa49-55b9-411b-b024-16f27a3aa1b8 => generated 1477 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:33:17.018756 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-6338b292-fddf-4d27-8f6d-52c72132c2ed req-c360a733-7b2d-4b5d-859e-630d553fae03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c95d88e-349c-4594-b0a2-351b507f34f9", "tag": "f0e9fd1e-4a27-44e9-903e-5bbaaf376cb8"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:33:17.054782 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-6338b292-fddf-4d27-8f6d-52c72132c2ed req-c360a733-7b2d-4b5d-859e-630d553fae03 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:17.055299 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-6338b292-fddf-4d27-8f6d-52c72132c2ed req-c360a733-7b2d-4b5d-859e-630d553fae03 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:17.055729 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-6338b292-fddf-4d27-8f6d-52c72132c2ed req-c360a733-7b2d-4b5d-859e-630d553fae03 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:17.085645 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-6338b292-fddf-4d27-8f6d-52c72132c2ed req-c360a733-7b2d-4b5d-859e-630d553fae03 service nova] Creating event network-changed:f0e9fd1e-4a27-44e9-903e-5bbaaf376cb8 for instance 6c95d88e-349c-4594-b0a2-351b507f34f9 on n-h2-862686-1 Oct 26 13:33:17.097100 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-6338b292-fddf-4d27-8f6d-52c72132c2ed req-c360a733-7b2d-4b5d-859e-630d553fae03 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099576 Oct 26 13:33:17.098042 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2899/5767] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:33:17.493758 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a17e0672-970b-4371-b68a-0d3bb86db069 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:17.495020 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a17e0672-970b-4371-b68a-0d3bb86db069 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:17.505194 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a17e0672-970b-4371-b68a-0d3bb86db069 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:17.506166 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a17e0672-970b-4371-b68a-0d3bb86db069 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:17.507289 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a17e0672-970b-4371-b68a-0d3bb86db069 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:17.509755 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a17e0672-970b-4371-b68a-0d3bb86db069 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:17.510426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a17e0672-970b-4371-b68a-0d3bb86db069 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:17.511052 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a17e0672-970b-4371-b68a-0d3bb86db069 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:18.020366 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f872c4f3-8920-4879-8791-0d008f0e412e tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:18.021901 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f872c4f3-8920-4879-8791-0d008f0e412e tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] [instance: a8a2fa49-55b9-411b-b024-16f27a3aa1b8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:18.030519 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f872c4f3-8920-4879-8791-0d008f0e412e tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:18.031396 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f872c4f3-8920-4879-8791-0d008f0e412e tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:18.032118 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f872c4f3-8920-4879-8791-0d008f0e412e tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:18.033397 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f872c4f3-8920-4879-8791-0d008f0e412e tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:18.034128 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f872c4f3-8920-4879-8791-0d008f0e412e tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:18.035551 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f872c4f3-8920-4879-8791-0d008f0e412e tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:18.223004 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a17e0672-970b-4371-b68a-0d3bb86db069 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:18.235964 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a17e0672-970b-4371-b68a-0d3bb86db069 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:18.239450 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a17e0672-970b-4371-b68a-0d3bb86db069 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:18.240602 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a17e0672-970b-4371-b68a-0d3bb86db069 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1408 microversion: 2.20 time: 0.752054 Oct 26 13:33:18.241174 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2869/5768] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:33:17 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1408 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:33:18.246588 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2e179a51-67ae-4828-8a48-47e0085909c4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:18.247773 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2e179a51-67ae-4828-8a48-47e0085909c4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 6df56119-b567-427a-87c9-8f45f9e32700] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:18.270037 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e179a51-67ae-4828-8a48-47e0085909c4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:18.270544 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e179a51-67ae-4828-8a48-47e0085909c4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:18.270984 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e179a51-67ae-4828-8a48-47e0085909c4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:18.271690 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e179a51-67ae-4828-8a48-47e0085909c4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:18.272146 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e179a51-67ae-4828-8a48-47e0085909c4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:18.272570 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e179a51-67ae-4828-8a48-47e0085909c4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:18.395004 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f872c4f3-8920-4879-8791-0d008f0e412e tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f745ae4d44f4cdebb40e233b0deed7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d89db2ac0141d694e64f474244e527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:18.410836 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f872c4f3-8920-4879-8791-0d008f0e412e tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] 10.222.0.40 "GET /compute/v2.1/servers/a8a2fa49-55b9-411b-b024-16f27a3aa1b8" status: 200 len: 1477 microversion: 2.1 time: 0.398403 Oct 26 13:33:18.413863 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2900/5769] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:33:18 2022] GET /compute/v2.1/servers/a8a2fa49-55b9-411b-b024-16f27a3aa1b8 => generated 1477 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:33:18.498093 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2e179a51-67ae-4828-8a48-47e0085909c4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:18.512681 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2e179a51-67ae-4828-8a48-47e0085909c4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700" status: 200 len: 1465 microversion: 2.1 time: 0.270025 Oct 26 13:33:18.514390 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2870/5770] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:33:18 2022] GET /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700 => generated 1465 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:33:19.268855 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-91da737b-fef4-4b35-955b-0bf232dba94f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:19.270970 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-91da737b-fef4-4b35-955b-0bf232dba94f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:19.280253 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91da737b-fef4-4b35-955b-0bf232dba94f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:19.283795 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91da737b-fef4-4b35-955b-0bf232dba94f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:19.286406 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91da737b-fef4-4b35-955b-0bf232dba94f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:19.289644 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91da737b-fef4-4b35-955b-0bf232dba94f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:19.292072 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91da737b-fef4-4b35-955b-0bf232dba94f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:19.293167 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91da737b-fef4-4b35-955b-0bf232dba94f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:19.441999 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4175f1ec-454b-4109-b787-b92cde3cc9fe tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:19.443939 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4175f1ec-454b-4109-b787-b92cde3cc9fe tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] [instance: a8a2fa49-55b9-411b-b024-16f27a3aa1b8] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:19.451943 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4175f1ec-454b-4109-b787-b92cde3cc9fe tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:19.453157 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4175f1ec-454b-4109-b787-b92cde3cc9fe tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:19.455036 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4175f1ec-454b-4109-b787-b92cde3cc9fe tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:19.456237 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4175f1ec-454b-4109-b787-b92cde3cc9fe tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:19.456700 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4175f1ec-454b-4109-b787-b92cde3cc9fe tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:19.457127 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4175f1ec-454b-4109-b787-b92cde3cc9fe tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:19.656897 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4175f1ec-454b-4109-b787-b92cde3cc9fe tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f745ae4d44f4cdebb40e233b0deed7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d89db2ac0141d694e64f474244e527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:19.669869 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4175f1ec-454b-4109-b787-b92cde3cc9fe tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] 10.222.0.40 "GET /compute/v2.1/servers/a8a2fa49-55b9-411b-b024-16f27a3aa1b8" status: 200 len: 1477 microversion: 2.1 time: 0.234598 Oct 26 13:33:19.681508 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2871/5771] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:33:19 2022] GET /compute/v2.1/servers/a8a2fa49-55b9-411b-b024-16f27a3aa1b8 => generated 1477 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:33:19.690588 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cd4f7608-a6fa-4cdb-b137-e83d41578418 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:19.690588 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cd4f7608-a6fa-4cdb-b137-e83d41578418 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 6df56119-b567-427a-87c9-8f45f9e32700] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:19.696634 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cd4f7608-a6fa-4cdb-b137-e83d41578418 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:19.697144 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cd4f7608-a6fa-4cdb-b137-e83d41578418 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:19.697695 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cd4f7608-a6fa-4cdb-b137-e83d41578418 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:19.698423 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cd4f7608-a6fa-4cdb-b137-e83d41578418 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:19.698894 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cd4f7608-a6fa-4cdb-b137-e83d41578418 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:19.699372 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cd4f7608-a6fa-4cdb-b137-e83d41578418 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:19.735476 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-91da737b-fef4-4b35-955b-0bf232dba94f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:19.786068 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-91da737b-fef4-4b35-955b-0bf232dba94f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:19.791057 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-91da737b-fef4-4b35-955b-0bf232dba94f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:19.793770 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-91da737b-fef4-4b35-955b-0bf232dba94f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1408 microversion: 2.20 time: 0.530308 Oct 26 13:33:19.798327 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2901/5772] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:33:19 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1408 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:33:19.833466 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-88fd3ab6-620b-4b5f-9d3c-a5cf1f92080a req-2508f6b1-6138-4f75-8d93-c73982dfcad4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6df56119-b567-427a-87c9-8f45f9e32700", "name": "network-vif-deleted", "tag": "57bfad88-da94-4b1c-a21b-23e9d4ee8b85"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:33:19.883729 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-88fd3ab6-620b-4b5f-9d3c-a5cf1f92080a req-2508f6b1-6138-4f75-8d93-c73982dfcad4 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:19.890483 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-88fd3ab6-620b-4b5f-9d3c-a5cf1f92080a req-2508f6b1-6138-4f75-8d93-c73982dfcad4 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:19.894497 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-88fd3ab6-620b-4b5f-9d3c-a5cf1f92080a req-2508f6b1-6138-4f75-8d93-c73982dfcad4 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:19.938175 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-88fd3ab6-620b-4b5f-9d3c-a5cf1f92080a req-2508f6b1-6138-4f75-8d93-c73982dfcad4 service nova] Creating event network-vif-deleted:57bfad88-da94-4b1c-a21b-23e9d4ee8b85 for instance 6df56119-b567-427a-87c9-8f45f9e32700 on n-h1-862686-1 Oct 26 13:33:19.956191 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-88fd3ab6-620b-4b5f-9d3c-a5cf1f92080a req-2508f6b1-6138-4f75-8d93-c73982dfcad4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154757 Oct 26 13:33:19.957685 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2902/5773] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:33:20.060935 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cd4f7608-a6fa-4cdb-b137-e83d41578418 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:20.078305 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cd4f7608-a6fa-4cdb-b137-e83d41578418 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700" status: 200 len: 1465 microversion: 2.1 time: 0.405822 Oct 26 13:33:20.079209 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2872/5774] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:33:19 2022] GET /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700 => generated 1465 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:33:20.711454 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d61a8708-a0ed-4470-ae78-432a28a99d3b tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:20.713419 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d61a8708-a0ed-4470-ae78-432a28a99d3b tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] [instance: a8a2fa49-55b9-411b-b024-16f27a3aa1b8] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:20.723024 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d61a8708-a0ed-4470-ae78-432a28a99d3b tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:20.723980 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d61a8708-a0ed-4470-ae78-432a28a99d3b tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:20.724676 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d61a8708-a0ed-4470-ae78-432a28a99d3b tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:20.726925 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d61a8708-a0ed-4470-ae78-432a28a99d3b tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:20.727813 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d61a8708-a0ed-4470-ae78-432a28a99d3b tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:20.728619 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d61a8708-a0ed-4470-ae78-432a28a99d3b tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:20.830914 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-71c70767-15e0-451e-bdbc-68b67d839b79 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:20.831725 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-71c70767-15e0-451e-bdbc-68b67d839b79 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:20.866148 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71c70767-15e0-451e-bdbc-68b67d839b79 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:20.870091 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71c70767-15e0-451e-bdbc-68b67d839b79 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:20.870711 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71c70767-15e0-451e-bdbc-68b67d839b79 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:20.875620 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71c70767-15e0-451e-bdbc-68b67d839b79 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:20.877156 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71c70767-15e0-451e-bdbc-68b67d839b79 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:20.880564 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71c70767-15e0-451e-bdbc-68b67d839b79 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:21.160239 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d61a8708-a0ed-4470-ae78-432a28a99d3b tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f745ae4d44f4cdebb40e233b0deed7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d89db2ac0141d694e64f474244e527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:21.174329 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d61a8708-a0ed-4470-ae78-432a28a99d3b tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] 10.222.0.40 "GET /compute/v2.1/servers/a8a2fa49-55b9-411b-b024-16f27a3aa1b8" status: 200 len: 1477 microversion: 2.1 time: 0.479158 Oct 26 13:33:21.175699 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2903/5775] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:33:20 2022] GET /compute/v2.1/servers/a8a2fa49-55b9-411b-b024-16f27a3aa1b8 => generated 1477 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:33:21.181379 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b33768a4-77ec-43f3-8ff0-13d3c6587473 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:21.195596 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b33768a4-77ec-43f3-8ff0-13d3c6587473 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 6df56119-b567-427a-87c9-8f45f9e32700] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:21.205296 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b33768a4-77ec-43f3-8ff0-13d3c6587473 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:21.208201 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b33768a4-77ec-43f3-8ff0-13d3c6587473 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:21.209319 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b33768a4-77ec-43f3-8ff0-13d3c6587473 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:21.213944 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b33768a4-77ec-43f3-8ff0-13d3c6587473 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:21.216236 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b33768a4-77ec-43f3-8ff0-13d3c6587473 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:21.217383 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b33768a4-77ec-43f3-8ff0-13d3c6587473 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:21.244980 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-b33768a4-77ec-43f3-8ff0-13d3c6587473 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] HTTP exception thrown: Instance 6df56119-b567-427a-87c9-8f45f9e32700 could not be found. Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b33768a4-77ec-43f3-8ff0-13d3c6587473 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Request method failure captured: Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700 HTTP/1.1 Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTTRuTNKOQB-nrFVO4ZQOSUPJw_t87hSQG4X0NnCZ-NkeLQePXfE28jjlOlL7XoeNcReKFB3n9XBYRIE9HcyLgGEDDp5gX1x_vTjrqFvjU0FYibg_1MyRrL2Ht61uOMaLpkZivAymUmDmap2-8WoM-6AmJL7TAW0hXVB6neLWiOUzoY Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: c0d1b1d2fe374ee5806eeee18712219f Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServerActionsTestJSON-871807092 Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c0d1b1d2fe374ee5806eeee18712219f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c0d1b1d2fe374ee5806eeee18712219f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c0d1b1d2fe374ee5806eeee18712219f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c0d1b1d2fe374ee5806eeee18712219f"}]}] Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServerActionsTestJSON-871807092 Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: c0d1b1d2fe374ee5806eeee18712219f Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServerActionsTestJSON-871807092 Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServerActionsTestJSON-871807092-project Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 3e9ff5a884f1416886f26a80c5b87b18 Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServerActionsTestJSON-871807092-project Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 6df56119-b567-427a-87c9-8f45f9e32700 could not be found. Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '6df56119-b567-427a-87c9-8f45f9e32700'} Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6df56119-b567-427a-87c9-8f45f9e32700 could not be found. Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6df56119-b567-427a-87c9-8f45f9e32700 could not be found. Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:33:21.263337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:33:21.267779 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:33:21.267779 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:33:21.267779 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:33:21.267779 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:33:21.267779 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:33:21.267779 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6df56119-b567-427a-87c9-8f45f9e32700 could not be found. Oct 26 13:33:21.267779 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:33:21.270426 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b33768a4-77ec-43f3-8ff0-13d3c6587473 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Returning 404 to user: Instance 6df56119-b567-427a-87c9-8f45f9e32700 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:33:21.279147 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b33768a4-77ec-43f3-8ff0-13d3c6587473 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700" status: 404 len: 111 microversion: 2.1 time: 0.102049 Oct 26 13:33:21.283128 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2904/5776] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:33:21 2022] GET /compute/v2.1/servers/6df56119-b567-427a-87c9-8f45f9e32700 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:33:21.295272 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-07538375-e81e-4d1b-a775-2bfe1b76597e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:21.300611 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-07538375-e81e-4d1b-a775-2bfe1b76597e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 3513f7b0-b7d1-4b0f-963e-709a892a275d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:21.319492 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07538375-e81e-4d1b-a775-2bfe1b76597e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:21.330257 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07538375-e81e-4d1b-a775-2bfe1b76597e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:21.330721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07538375-e81e-4d1b-a775-2bfe1b76597e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:21.331469 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07538375-e81e-4d1b-a775-2bfe1b76597e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:21.337068 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07538375-e81e-4d1b-a775-2bfe1b76597e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:21.337807 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07538375-e81e-4d1b-a775-2bfe1b76597e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:21.394246 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-07538375-e81e-4d1b-a775-2bfe1b76597e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 3513f7b0-b7d1-4b0f-963e-709a892a275d] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:33:21.675881 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-07538375-e81e-4d1b-a775-2bfe1b76597e tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d" status: 204 len: 0 microversion: 2.1 time: 0.388462 Oct 26 13:33:21.679112 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2905/5777] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:33:21 2022] DELETE /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:33:21.693211 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-803b294d-7518-42b1-93b9-98094d22e672 req-087f533f-c238-4c58-b920-fd3666b7db01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c95d88e-349c-4594-b0a2-351b507f34f9", "name": "network-vif-plugged", "status": "completed", "tag": "f0e9fd1e-4a27-44e9-903e-5bbaaf376cb8"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:33:21.714411 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-803b294d-7518-42b1-93b9-98094d22e672 req-087f533f-c238-4c58-b920-fd3666b7db01 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:21.718899 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-803b294d-7518-42b1-93b9-98094d22e672 req-087f533f-c238-4c58-b920-fd3666b7db01 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:21.721100 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-803b294d-7518-42b1-93b9-98094d22e672 req-087f533f-c238-4c58-b920-fd3666b7db01 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:21.743906 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-803b294d-7518-42b1-93b9-98094d22e672 req-087f533f-c238-4c58-b920-fd3666b7db01 service nova] Creating event network-vif-plugged:f0e9fd1e-4a27-44e9-903e-5bbaaf376cb8 for instance 6c95d88e-349c-4594-b0a2-351b507f34f9 on n-h2-862686-1 Oct 26 13:33:21.764802 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-803b294d-7518-42b1-93b9-98094d22e672 req-087f533f-c238-4c58-b920-fd3666b7db01 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081879 Oct 26 13:33:21.765959 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2906/5778] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:33:21.782179 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6bbfafb8-925a-4b1c-ac93-6d977309994d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:21.787597 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6bbfafb8-925a-4b1c-ac93-6d977309994d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 3513f7b0-b7d1-4b0f-963e-709a892a275d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:21.801182 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6bbfafb8-925a-4b1c-ac93-6d977309994d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:21.802283 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6bbfafb8-925a-4b1c-ac93-6d977309994d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:21.803893 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6bbfafb8-925a-4b1c-ac93-6d977309994d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:21.806023 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6bbfafb8-925a-4b1c-ac93-6d977309994d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:21.806899 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6bbfafb8-925a-4b1c-ac93-6d977309994d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:21.809754 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6bbfafb8-925a-4b1c-ac93-6d977309994d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:21.912737 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-71c70767-15e0-451e-bdbc-68b67d839b79 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:21.936893 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-71c70767-15e0-451e-bdbc-68b67d839b79 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:21.950442 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-71c70767-15e0-451e-bdbc-68b67d839b79 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:21.956360 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-71c70767-15e0-451e-bdbc-68b67d839b79 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1408 microversion: 2.20 time: 1.132139 Oct 26 13:33:21.959841 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2873/5779] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:33:20 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1408 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:33:22.020334 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-80e2b81f-eab3-4ee5-85f6-ef28668c2d13 req-f97f2ddc-c61c-4f9b-9af5-e266cf163e8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8a2fa49-55b9-411b-b024-16f27a3aa1b8", "name": "network-vif-deleted", "tag": "6beb9dfc-6e5d-443d-bc16-257e312a2fd7"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:33:22.036800 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-80e2b81f-eab3-4ee5-85f6-ef28668c2d13 req-f97f2ddc-c61c-4f9b-9af5-e266cf163e8c service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:22.046495 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-80e2b81f-eab3-4ee5-85f6-ef28668c2d13 req-f97f2ddc-c61c-4f9b-9af5-e266cf163e8c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:22.047845 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-80e2b81f-eab3-4ee5-85f6-ef28668c2d13 req-f97f2ddc-c61c-4f9b-9af5-e266cf163e8c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:22.091625 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-80e2b81f-eab3-4ee5-85f6-ef28668c2d13 req-f97f2ddc-c61c-4f9b-9af5-e266cf163e8c service nova] Creating event network-vif-deleted:6beb9dfc-6e5d-443d-bc16-257e312a2fd7 for instance a8a2fa49-55b9-411b-b024-16f27a3aa1b8 on n-h1-862686-1 Oct 26 13:33:22.121525 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-80e2b81f-eab3-4ee5-85f6-ef28668c2d13 req-f97f2ddc-c61c-4f9b-9af5-e266cf163e8c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103790 Oct 26 13:33:22.124569 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2874/5780] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:33:22.203461 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-49214a9f-acb2-448d-9311-c9ad1a11f5d5 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:22.210211 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-49214a9f-acb2-448d-9311-c9ad1a11f5d5 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] [instance: a8a2fa49-55b9-411b-b024-16f27a3aa1b8] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:22.232591 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49214a9f-acb2-448d-9311-c9ad1a11f5d5 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:22.233816 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49214a9f-acb2-448d-9311-c9ad1a11f5d5 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:22.235347 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49214a9f-acb2-448d-9311-c9ad1a11f5d5 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:22.238438 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49214a9f-acb2-448d-9311-c9ad1a11f5d5 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:22.239226 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49214a9f-acb2-448d-9311-c9ad1a11f5d5 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:22.239820 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49214a9f-acb2-448d-9311-c9ad1a11f5d5 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:22.298169 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-49214a9f-acb2-448d-9311-c9ad1a11f5d5 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] HTTP exception thrown: Instance a8a2fa49-55b9-411b-b024-16f27a3aa1b8 could not be found. Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-49214a9f-acb2-448d-9311-c9ad1a11f5d5 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Request method failure captured: Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/a8a2fa49-55b9-411b-b024-16f27a3aa1b8 HTTP/1.1 Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTZ_DE6NEHvkScgbje_TtVqaY60xlPYPtDMs5rooh8nxncYeQnO8CThjNuC2ro2GkS1B7nrCcUL2P-JK-6bggnRViZKjKomjg2OS2bneDOA4S-Y2Z2yZgfHdlxf6rB4I_jrf9F2b_9Mp8YdyWbMoIT3_Xub_tFPRTf0Akhdh0l-JwpU Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: b6d89db2ac0141d694e64f474244e527 Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1602733414 Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b6d89db2ac0141d694e64f474244e527"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b6d89db2ac0141d694e64f474244e527"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b6d89db2ac0141d694e64f474244e527"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b6d89db2ac0141d694e64f474244e527"}]}] Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1602733414 Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: b6d89db2ac0141d694e64f474244e527 Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1602733414 Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-TestSecurityGroupsBasicOps-1602733414-project Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 8f745ae4d44f4cdebb40e233b0deed7a Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1602733414-project Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance a8a2fa49-55b9-411b-b024-16f27a3aa1b8 could not be found. Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'a8a2fa49-55b9-411b-b024-16f27a3aa1b8'} Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8a2fa49-55b9-411b-b024-16f27a3aa1b8 could not be found. Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8a2fa49-55b9-411b-b024-16f27a3aa1b8 could not be found. Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:33:22.303233 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:33:22.309663 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:33:22.309663 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:33:22.309663 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:33:22.309663 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:33:22.309663 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:33:22.309663 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:33:22.309663 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8a2fa49-55b9-411b-b024-16f27a3aa1b8 could not be found. Oct 26 13:33:22.309663 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:33:22.309663 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-49214a9f-acb2-448d-9311-c9ad1a11f5d5 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Returning 404 to user: Instance a8a2fa49-55b9-411b-b024-16f27a3aa1b8 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:33:22.309663 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-49214a9f-acb2-448d-9311-c9ad1a11f5d5 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] 10.222.0.40 "GET /compute/v2.1/servers/a8a2fa49-55b9-411b-b024-16f27a3aa1b8" status: 404 len: 111 microversion: 2.1 time: 0.110429 Oct 26 13:33:22.314212 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2875/5781] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:33:22 2022] GET /compute/v2.1/servers/a8a2fa49-55b9-411b-b024-16f27a3aa1b8 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 13:33:22.912648 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6bbfafb8-925a-4b1c-ac93-6d977309994d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:22.922124 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6bbfafb8-925a-4b1c-ac93-6d977309994d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d" status: 200 len: 1507 microversion: 2.1 time: 1.153151 Oct 26 13:33:22.922719 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2907/5782] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:33:21 2022] GET /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d => generated 1507 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:33:22.990567 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-704239d6-01c8-4203-997a-ffee2a457ab7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:22.991181 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-704239d6-01c8-4203-997a-ffee2a457ab7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:23.002944 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-704239d6-01c8-4203-997a-ffee2a457ab7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:23.003423 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-704239d6-01c8-4203-997a-ffee2a457ab7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:23.003928 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-704239d6-01c8-4203-997a-ffee2a457ab7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:23.004631 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-704239d6-01c8-4203-997a-ffee2a457ab7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:23.005093 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-704239d6-01c8-4203-997a-ffee2a457ab7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:23.011365 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-704239d6-01c8-4203-997a-ffee2a457ab7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:23.832506 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-704239d6-01c8-4203-997a-ffee2a457ab7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:23.849898 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-704239d6-01c8-4203-997a-ffee2a457ab7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:23.851958 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-704239d6-01c8-4203-997a-ffee2a457ab7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:23.867106 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-704239d6-01c8-4203-997a-ffee2a457ab7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1408 microversion: 2.20 time: 0.884061 Oct 26 13:33:23.885547 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2876/5783] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:33:22 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1408 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:33:23.947703 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6a37ef26-fd80-4ddb-94f2-6e290260039b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:23.949710 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6a37ef26-fd80-4ddb-94f2-6e290260039b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 3513f7b0-b7d1-4b0f-963e-709a892a275d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:23.967358 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a37ef26-fd80-4ddb-94f2-6e290260039b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:23.967858 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a37ef26-fd80-4ddb-94f2-6e290260039b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:23.976019 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a37ef26-fd80-4ddb-94f2-6e290260039b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:23.977261 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a37ef26-fd80-4ddb-94f2-6e290260039b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:23.977847 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a37ef26-fd80-4ddb-94f2-6e290260039b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:23.978464 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a37ef26-fd80-4ddb-94f2-6e290260039b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:24.800308 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6a37ef26-fd80-4ddb-94f2-6e290260039b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:24.818370 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6a37ef26-fd80-4ddb-94f2-6e290260039b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d" status: 200 len: 1507 microversion: 2.1 time: 0.875672 Oct 26 13:33:24.819238 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2908/5784] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:33:23 2022] GET /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d => generated 1507 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:33:24.892532 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c18383bd-fa19-496e-b0d8-f2252ba7099e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:24.894066 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c18383bd-fa19-496e-b0d8-f2252ba7099e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:24.904112 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c18383bd-fa19-496e-b0d8-f2252ba7099e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:24.916828 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c18383bd-fa19-496e-b0d8-f2252ba7099e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:24.919293 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c18383bd-fa19-496e-b0d8-f2252ba7099e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:24.922222 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c18383bd-fa19-496e-b0d8-f2252ba7099e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:24.930578 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c18383bd-fa19-496e-b0d8-f2252ba7099e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:24.931383 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c18383bd-fa19-496e-b0d8-f2252ba7099e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:25.237811 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c18383bd-fa19-496e-b0d8-f2252ba7099e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:25.249444 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c18383bd-fa19-496e-b0d8-f2252ba7099e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:25.251559 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c18383bd-fa19-496e-b0d8-f2252ba7099e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:25.253980 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c18383bd-fa19-496e-b0d8-f2252ba7099e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1408 microversion: 2.20 time: 0.365442 Oct 26 13:33:25.267632 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2877/5785] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:33:24 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1408 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:33:25.771621 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-e617d245-b5bd-48b2-b34e-ba2dfcb63673 req-70bc5a95-d3d7-4080-8b3c-7676f193ab16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3513f7b0-b7d1-4b0f-963e-709a892a275d", "name": "network-vif-deleted", "tag": "3a852438-a4fa-48a5-9409-c33ffc92d395"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:33:25.832216 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e617d245-b5bd-48b2-b34e-ba2dfcb63673 req-70bc5a95-d3d7-4080-8b3c-7676f193ab16 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:25.838477 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e617d245-b5bd-48b2-b34e-ba2dfcb63673 req-70bc5a95-d3d7-4080-8b3c-7676f193ab16 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:25.844738 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e617d245-b5bd-48b2-b34e-ba2dfcb63673 req-70bc5a95-d3d7-4080-8b3c-7676f193ab16 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:25.850819 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-71e42ba4-f3c7-4052-a15a-ae8673ab98c4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:25.852418 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-71e42ba4-f3c7-4052-a15a-ae8673ab98c4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 3513f7b0-b7d1-4b0f-963e-709a892a275d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:25.893225 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71e42ba4-f3c7-4052-a15a-ae8673ab98c4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:25.893899 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71e42ba4-f3c7-4052-a15a-ae8673ab98c4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:25.894565 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71e42ba4-f3c7-4052-a15a-ae8673ab98c4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:25.894693 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-e617d245-b5bd-48b2-b34e-ba2dfcb63673 req-70bc5a95-d3d7-4080-8b3c-7676f193ab16 service nova] Creating event network-vif-deleted:3a852438-a4fa-48a5-9409-c33ffc92d395 for instance 3513f7b0-b7d1-4b0f-963e-709a892a275d on n-h2-862686-1 Oct 26 13:33:25.895570 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71e42ba4-f3c7-4052-a15a-ae8673ab98c4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:25.897307 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71e42ba4-f3c7-4052-a15a-ae8673ab98c4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:25.900569 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71e42ba4-f3c7-4052-a15a-ae8673ab98c4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:25.933558 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-e617d245-b5bd-48b2-b34e-ba2dfcb63673 req-70bc5a95-d3d7-4080-8b3c-7676f193ab16 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166316 Oct 26 13:33:25.937043 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2909/5786] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:33:26.044103 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71e42ba4-f3c7-4052-a15a-ae8673ab98c4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:26.044992 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71e42ba4-f3c7-4052-a15a-ae8673ab98c4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:26.045457 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71e42ba4-f3c7-4052-a15a-ae8673ab98c4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:26.045947 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-71e42ba4-f3c7-4052-a15a-ae8673ab98c4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lazy-loading 'fault' on Instance uuid 3513f7b0-b7d1-4b0f-963e-709a892a275d {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:33:26.285986 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f03a28a5-7daf-4b92-b9f0-d5959cfa66b7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:26.287577 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f03a28a5-7daf-4b92-b9f0-d5959cfa66b7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:26.308657 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f03a28a5-7daf-4b92-b9f0-d5959cfa66b7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:26.309876 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f03a28a5-7daf-4b92-b9f0-d5959cfa66b7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:26.313297 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f03a28a5-7daf-4b92-b9f0-d5959cfa66b7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:26.316537 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f03a28a5-7daf-4b92-b9f0-d5959cfa66b7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:26.321892 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f03a28a5-7daf-4b92-b9f0-d5959cfa66b7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:26.323003 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f03a28a5-7daf-4b92-b9f0-d5959cfa66b7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:26.483846 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-71e42ba4-f3c7-4052-a15a-ae8673ab98c4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:26.496079 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-71e42ba4-f3c7-4052-a15a-ae8673ab98c4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d" status: 200 len: 1305 microversion: 2.1 time: 0.650037 Oct 26 13:33:26.499518 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2878/5787] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:33:25 2022] GET /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d => generated 1305 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:33:27.527785 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-99b22d51-4133-4e0d-bba7-1f475b5346af tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:27.528549 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-99b22d51-4133-4e0d-bba7-1f475b5346af tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 3513f7b0-b7d1-4b0f-963e-709a892a275d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:27.534079 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f03a28a5-7daf-4b92-b9f0-d5959cfa66b7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:27.553151 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-99b22d51-4133-4e0d-bba7-1f475b5346af tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:27.557248 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-99b22d51-4133-4e0d-bba7-1f475b5346af tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:27.558113 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-99b22d51-4133-4e0d-bba7-1f475b5346af tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:27.560322 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f03a28a5-7daf-4b92-b9f0-d5959cfa66b7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:27.565660 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-99b22d51-4133-4e0d-bba7-1f475b5346af tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:27.573625 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-99b22d51-4133-4e0d-bba7-1f475b5346af tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:27.573817 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f03a28a5-7daf-4b92-b9f0-d5959cfa66b7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:27.575337 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-99b22d51-4133-4e0d-bba7-1f475b5346af tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:27.577248 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f03a28a5-7daf-4b92-b9f0-d5959cfa66b7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1601 microversion: 2.20 time: 1.298821 Oct 26 13:33:27.589726 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2910/5788] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:33:26 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1601 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:33:27.622907 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8e552858-1b86-40b8-b794-5001911da595 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:27.623639 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8e552858-1b86-40b8-b794-5001911da595 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:27.644084 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e552858-1b86-40b8-b794-5001911da595 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:27.646869 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e552858-1b86-40b8-b794-5001911da595 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:27.650187 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e552858-1b86-40b8-b794-5001911da595 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:27.652604 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e552858-1b86-40b8-b794-5001911da595 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:27.662317 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e552858-1b86-40b8-b794-5001911da595 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:27.665880 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e552858-1b86-40b8-b794-5001911da595 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:28.253994 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-99b22d51-4133-4e0d-bba7-1f475b5346af tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] HTTP exception thrown: Instance 3513f7b0-b7d1-4b0f-963e-709a892a275d could not be found. Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-99b22d51-4133-4e0d-bba7-1f475b5346af tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Request method failure captured: Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d HTTP/1.1 Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTTRuTNKOQB-nrFVO4ZQOSUPJw_t87hSQG4X0NnCZ-NkeLQePXfE28jjlOlL7XoeNcReKFB3n9XBYRIE9HcyLgGEDDp5gX1x_vTjrqFvjU0FYibg_1MyRrL2Ht61uOMaLpkZivAymUmDmap2-8WoM-6AmJL7TAW0hXVB6neLWiOUzoY Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: c0d1b1d2fe374ee5806eeee18712219f Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServerActionsTestJSON-871807092 Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c0d1b1d2fe374ee5806eeee18712219f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c0d1b1d2fe374ee5806eeee18712219f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c0d1b1d2fe374ee5806eeee18712219f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c0d1b1d2fe374ee5806eeee18712219f"}]}] Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServerActionsTestJSON-871807092 Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: c0d1b1d2fe374ee5806eeee18712219f Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServerActionsTestJSON-871807092 Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServerActionsTestJSON-871807092-project Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 3e9ff5a884f1416886f26a80c5b87b18 Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServerActionsTestJSON-871807092-project Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 3513f7b0-b7d1-4b0f-963e-709a892a275d could not be found. Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '3513f7b0-b7d1-4b0f-963e-709a892a275d'} Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3513f7b0-b7d1-4b0f-963e-709a892a275d could not be found. Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3513f7b0-b7d1-4b0f-963e-709a892a275d could not be found. Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:33:28.258811 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:33:28.263507 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:33:28.263507 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:33:28.263507 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:33:28.263507 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:33:28.263507 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:33:28.263507 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3513f7b0-b7d1-4b0f-963e-709a892a275d could not be found. Oct 26 13:33:28.263507 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:33:28.263507 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-99b22d51-4133-4e0d-bba7-1f475b5346af tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Returning 404 to user: Instance 3513f7b0-b7d1-4b0f-963e-709a892a275d could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:33:28.263507 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-99b22d51-4133-4e0d-bba7-1f475b5346af tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d" status: 404 len: 111 microversion: 2.1 time: 0.737891 Oct 26 13:33:28.265950 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2879/5789] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:33:27 2022] GET /compute/v2.1/servers/3513f7b0-b7d1-4b0f-963e-709a892a275d => generated 111 bytes in 743 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:33:28.276502 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7b162c18-7cd8-40cd-85f8-cc2bacd21e75 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:28.277043 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7b162c18-7cd8-40cd-85f8-cc2bacd21e75 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: af89aa4e-9f0c-48c6-adc7-6b2f72601f8f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:28.296984 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b162c18-7cd8-40cd-85f8-cc2bacd21e75 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:28.297556 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b162c18-7cd8-40cd-85f8-cc2bacd21e75 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:28.299086 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b162c18-7cd8-40cd-85f8-cc2bacd21e75 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:28.301320 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b162c18-7cd8-40cd-85f8-cc2bacd21e75 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:28.303502 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b162c18-7cd8-40cd-85f8-cc2bacd21e75 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:28.304937 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b162c18-7cd8-40cd-85f8-cc2bacd21e75 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:28.380301 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7b162c18-7cd8-40cd-85f8-cc2bacd21e75 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: af89aa4e-9f0c-48c6-adc7-6b2f72601f8f] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:33:28.577762 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:33:28.635297 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7b162c18-7cd8-40cd-85f8-cc2bacd21e75 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "DELETE /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f" status: 204 len: 0 microversion: 2.1 time: 0.364922 Oct 26 13:33:28.635828 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2880/5790] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:33:28 2022] DELETE /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:33:28.979067 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8e552858-1b86-40b8-b794-5001911da595 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9/os-interface" status: 200 len: 285 microversion: 2.20 time: 1.365769 Oct 26 13:33:28.980779 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2911/5791] 10.222.0.40 () {60 vars in 1316 bytes} [Wed Oct 26 13:33:27 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9/os-interface => generated 285 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 26 13:33:29.269127 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f6e24b47-31f8-4489-881b-ff297493b1ab tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:29.269872 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f6e24b47-31f8-4489-881b-ff297493b1ab tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: af89aa4e-9f0c-48c6-adc7-6b2f72601f8f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:29.288285 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f6e24b47-31f8-4489-881b-ff297493b1ab tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:29.289049 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f6e24b47-31f8-4489-881b-ff297493b1ab tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:29.289652 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f6e24b47-31f8-4489-881b-ff297493b1ab tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:29.294733 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f6e24b47-31f8-4489-881b-ff297493b1ab tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:29.295222 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f6e24b47-31f8-4489-881b-ff297493b1ab tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:29.295664 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f6e24b47-31f8-4489-881b-ff297493b1ab tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:30.863287 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f6e24b47-31f8-4489-881b-ff297493b1ab tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:30.881809 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f6e24b47-31f8-4489-881b-ff297493b1ab tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f" status: 200 len: 1493 microversion: 2.1 time: 2.241606 Oct 26 13:33:30.882920 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2881/5792] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:33:28 2022] GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f => generated 1493 bytes in 2243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:33:31.904756 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6515523d-739f-4458-9126-c7b5d770846d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:31.905374 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6515523d-739f-4458-9126-c7b5d770846d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: af89aa4e-9f0c-48c6-adc7-6b2f72601f8f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:31.917133 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:33:31.923510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6515523d-739f-4458-9126-c7b5d770846d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:31.932244 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6515523d-739f-4458-9126-c7b5d770846d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:31.936018 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6515523d-739f-4458-9126-c7b5d770846d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:31.936798 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6515523d-739f-4458-9126-c7b5d770846d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:31.937278 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6515523d-739f-4458-9126-c7b5d770846d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:31.937741 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6515523d-739f-4458-9126-c7b5d770846d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:31.956557 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:33:32.539664 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6515523d-739f-4458-9126-c7b5d770846d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:32.554189 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6515523d-739f-4458-9126-c7b5d770846d tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f" status: 200 len: 1493 microversion: 2.1 time: 0.653394 Oct 26 13:33:32.556731 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2912/5793] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:33:31 2022] GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f => generated 1493 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:33:33.578766 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7614658b-d6a3-474f-9521-bbe197dd89b4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:33.580235 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7614658b-d6a3-474f-9521-bbe197dd89b4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: af89aa4e-9f0c-48c6-adc7-6b2f72601f8f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:33.600038 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7614658b-d6a3-474f-9521-bbe197dd89b4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:33.600538 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7614658b-d6a3-474f-9521-bbe197dd89b4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:33.601525 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7614658b-d6a3-474f-9521-bbe197dd89b4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:33.602560 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7614658b-d6a3-474f-9521-bbe197dd89b4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:33.603032 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7614658b-d6a3-474f-9521-bbe197dd89b4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:33.603468 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7614658b-d6a3-474f-9521-bbe197dd89b4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:34.126029 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7614658b-d6a3-474f-9521-bbe197dd89b4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:34.137121 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7614658b-d6a3-474f-9521-bbe197dd89b4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f" status: 200 len: 1451 microversion: 2.1 time: 0.562171 Oct 26 13:33:34.138767 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2882/5794] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:33:33 2022] GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f => generated 1451 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:33:34.583598 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-809a2927-8702-4eb9-808d-6f6a42a32a48 req-5363fbfb-e525-4294-8730-148bc1e27f03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af89aa4e-9f0c-48c6-adc7-6b2f72601f8f", "name": "network-vif-deleted", "tag": "b80d7d4b-25f1-411b-9943-c31beebd5488"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:33:34.613229 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-809a2927-8702-4eb9-808d-6f6a42a32a48 req-5363fbfb-e525-4294-8730-148bc1e27f03 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:34.618008 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-809a2927-8702-4eb9-808d-6f6a42a32a48 req-5363fbfb-e525-4294-8730-148bc1e27f03 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:34.618840 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-809a2927-8702-4eb9-808d-6f6a42a32a48 req-5363fbfb-e525-4294-8730-148bc1e27f03 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:34.652709 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-809a2927-8702-4eb9-808d-6f6a42a32a48 req-5363fbfb-e525-4294-8730-148bc1e27f03 service nova] Creating event network-vif-deleted:b80d7d4b-25f1-411b-9943-c31beebd5488 for instance af89aa4e-9f0c-48c6-adc7-6b2f72601f8f on n-h2-862686-1 Oct 26 13:33:34.667986 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-809a2927-8702-4eb9-808d-6f6a42a32a48 req-5363fbfb-e525-4294-8730-148bc1e27f03 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089651 Oct 26 13:33:34.669469 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2913/5795] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:33:35.165454 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-717b299c-58ac-4dab-960c-91c8871da467 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:35.166245 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-717b299c-58ac-4dab-960c-91c8871da467 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: af89aa4e-9f0c-48c6-adc7-6b2f72601f8f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:35.185551 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-717b299c-58ac-4dab-960c-91c8871da467 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:35.187789 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-717b299c-58ac-4dab-960c-91c8871da467 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:35.189077 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-717b299c-58ac-4dab-960c-91c8871da467 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:35.192057 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-717b299c-58ac-4dab-960c-91c8871da467 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:35.193002 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-717b299c-58ac-4dab-960c-91c8871da467 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:35.194000 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-717b299c-58ac-4dab-960c-91c8871da467 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:35.250239 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-717b299c-58ac-4dab-960c-91c8871da467 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:35.253245 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-717b299c-58ac-4dab-960c-91c8871da467 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:35.254232 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-717b299c-58ac-4dab-960c-91c8871da467 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:35.254889 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-717b299c-58ac-4dab-960c-91c8871da467 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lazy-loading 'fault' on Instance uuid af89aa4e-9f0c-48c6-adc7-6b2f72601f8f {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:33:35.698030 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-717b299c-58ac-4dab-960c-91c8871da467 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:35.713314 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-717b299c-58ac-4dab-960c-91c8871da467 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f" status: 200 len: 1304 microversion: 2.1 time: 0.553040 Oct 26 13:33:35.723805 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2883/5796] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:33:35 2022] GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f => generated 1304 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:33:36.741257 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5987c7aa-67e6-46ca-b38a-9a01a592ac4b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:36.742200 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5987c7aa-67e6-46ca-b38a-9a01a592ac4b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: af89aa4e-9f0c-48c6-adc7-6b2f72601f8f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:36.760253 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5987c7aa-67e6-46ca-b38a-9a01a592ac4b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:36.760823 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5987c7aa-67e6-46ca-b38a-9a01a592ac4b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:36.761286 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5987c7aa-67e6-46ca-b38a-9a01a592ac4b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:36.762067 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5987c7aa-67e6-46ca-b38a-9a01a592ac4b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:36.765606 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5987c7aa-67e6-46ca-b38a-9a01a592ac4b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:36.766107 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5987c7aa-67e6-46ca-b38a-9a01a592ac4b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:36.805116 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-5987c7aa-67e6-46ca-b38a-9a01a592ac4b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] HTTP exception thrown: Instance af89aa4e-9f0c-48c6-adc7-6b2f72601f8f could not be found. Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5987c7aa-67e6-46ca-b38a-9a01a592ac4b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Request method failure captured: Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f HTTP/1.1 Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTTRuTNKOQB-nrFVO4ZQOSUPJw_t87hSQG4X0NnCZ-NkeLQePXfE28jjlOlL7XoeNcReKFB3n9XBYRIE9HcyLgGEDDp5gX1x_vTjrqFvjU0FYibg_1MyRrL2Ht61uOMaLpkZivAymUmDmap2-8WoM-6AmJL7TAW0hXVB6neLWiOUzoY Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: c0d1b1d2fe374ee5806eeee18712219f Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServerActionsTestJSON-871807092 Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c0d1b1d2fe374ee5806eeee18712219f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c0d1b1d2fe374ee5806eeee18712219f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c0d1b1d2fe374ee5806eeee18712219f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c0d1b1d2fe374ee5806eeee18712219f"}]}] Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServerActionsTestJSON-871807092 Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: c0d1b1d2fe374ee5806eeee18712219f Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServerActionsTestJSON-871807092 Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServerActionsTestJSON-871807092-project Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 3e9ff5a884f1416886f26a80c5b87b18 Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServerActionsTestJSON-871807092-project Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance af89aa4e-9f0c-48c6-adc7-6b2f72601f8f could not be found. Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'af89aa4e-9f0c-48c6-adc7-6b2f72601f8f'} Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af89aa4e-9f0c-48c6-adc7-6b2f72601f8f could not be found. Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af89aa4e-9f0c-48c6-adc7-6b2f72601f8f could not be found. Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:33:36.806880 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:33:36.812318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:33:36.812318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:33:36.812318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:33:36.812318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:33:36.812318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:33:36.812318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af89aa4e-9f0c-48c6-adc7-6b2f72601f8f could not be found. Oct 26 13:33:36.812318 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:33:36.812318 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5987c7aa-67e6-46ca-b38a-9a01a592ac4b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Returning 404 to user: Instance af89aa4e-9f0c-48c6-adc7-6b2f72601f8f could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:33:36.812318 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5987c7aa-67e6-46ca-b38a-9a01a592ac4b tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f" status: 404 len: 111 microversion: 2.1 time: 0.072923 Oct 26 13:33:36.817741 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4b755f93-83f6-4620-af6f-158e7e2b4070 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:36.818261 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4b755f93-83f6-4620-af6f-158e7e2b4070 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:36.822898 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2914/5797] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:33:36 2022] GET /compute/v2.1/servers/af89aa4e-9f0c-48c6-adc7-6b2f72601f8f => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:33:36.834140 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4b755f93-83f6-4620-af6f-158e7e2b4070 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:36.834894 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4b755f93-83f6-4620-af6f-158e7e2b4070 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:36.836299 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4b755f93-83f6-4620-af6f-158e7e2b4070 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:36.844290 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-b8f63e30-c62e-4b7b-b92b-af527e59bc32 req-7173f48f-dbc7-4753-9a22-638e2cb56b1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c95d88e-349c-4594-b0a2-351b507f34f9", "tag": "f0e9fd1e-4a27-44e9-903e-5bbaaf376cb8"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:33:36.847998 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4b755f93-83f6-4620-af6f-158e7e2b4070 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:36.848668 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4b755f93-83f6-4620-af6f-158e7e2b4070 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:36.851212 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4b755f93-83f6-4620-af6f-158e7e2b4070 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:36.875491 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b8f63e30-c62e-4b7b-b92b-af527e59bc32 req-7173f48f-dbc7-4753-9a22-638e2cb56b1a service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:36.881891 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b8f63e30-c62e-4b7b-b92b-af527e59bc32 req-7173f48f-dbc7-4753-9a22-638e2cb56b1a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:36.884749 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b8f63e30-c62e-4b7b-b92b-af527e59bc32 req-7173f48f-dbc7-4753-9a22-638e2cb56b1a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:36.922639 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-b8f63e30-c62e-4b7b-b92b-af527e59bc32 req-7173f48f-dbc7-4753-9a22-638e2cb56b1a service nova] Creating event network-changed:f0e9fd1e-4a27-44e9-903e-5bbaaf376cb8 for instance 6c95d88e-349c-4594-b0a2-351b507f34f9 on n-h2-862686-1 Oct 26 13:33:36.940293 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4b755f93-83f6-4620-af6f-158e7e2b4070 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:33:36.944215 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-b8f63e30-c62e-4b7b-b92b-af527e59bc32 req-7173f48f-dbc7-4753-9a22-638e2cb56b1a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104099 Oct 26 13:33:36.945997 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2915/5798] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:33:36.970254 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:33:37.095023 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4b755f93-83f6-4620-af6f-158e7e2b4070 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "DELETE /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 204 len: 0 microversion: 2.1 time: 0.279813 Oct 26 13:33:37.097112 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2884/5799] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:33:36 2022] DELETE /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:33:37.109063 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-be8fe593-2900-4391-837a-8a4aae1caff7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:37.110073 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-be8fe593-2900-4391-837a-8a4aae1caff7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:37.118213 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be8fe593-2900-4391-837a-8a4aae1caff7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:37.118969 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be8fe593-2900-4391-837a-8a4aae1caff7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:37.119568 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be8fe593-2900-4391-837a-8a4aae1caff7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:37.120703 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be8fe593-2900-4391-837a-8a4aae1caff7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:37.121329 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be8fe593-2900-4391-837a-8a4aae1caff7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:37.121959 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be8fe593-2900-4391-837a-8a4aae1caff7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:37.851815 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-be8fe593-2900-4391-837a-8a4aae1caff7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:37.877019 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-be8fe593-2900-4391-837a-8a4aae1caff7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1672 microversion: 2.1 time: 0.774995 Oct 26 13:33:37.882092 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2916/5800] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:33:37 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1672 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:33:38.796407 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-52969a15-0b3f-45d5-82ff-13542cd277db tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:38.797668 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-52969a15-0b3f-45d5-82ff-13542cd277db tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] [instance: dc8d9140-3f8d-44ad-86f4-36d67fbe7d19] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:38.816995 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52969a15-0b3f-45d5-82ff-13542cd277db tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:38.821161 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52969a15-0b3f-45d5-82ff-13542cd277db tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:38.821882 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52969a15-0b3f-45d5-82ff-13542cd277db tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:38.822819 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52969a15-0b3f-45d5-82ff-13542cd277db tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:38.825146 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52969a15-0b3f-45d5-82ff-13542cd277db tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:38.830111 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52969a15-0b3f-45d5-82ff-13542cd277db tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:38.905442 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d4eb8866-efd2-4f93-87cd-aecd69495f2c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:38.906091 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d4eb8866-efd2-4f93-87cd-aecd69495f2c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:38.924212 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-52969a15-0b3f-45d5-82ff-13542cd277db tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] [instance: dc8d9140-3f8d-44ad-86f4-36d67fbe7d19] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:33:38.927273 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4eb8866-efd2-4f93-87cd-aecd69495f2c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:38.927802 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4eb8866-efd2-4f93-87cd-aecd69495f2c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:38.932571 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4eb8866-efd2-4f93-87cd-aecd69495f2c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:38.933507 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4eb8866-efd2-4f93-87cd-aecd69495f2c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:38.934009 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4eb8866-efd2-4f93-87cd-aecd69495f2c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:38.941723 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4eb8866-efd2-4f93-87cd-aecd69495f2c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:39.221989 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-52969a15-0b3f-45d5-82ff-13542cd277db tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] 10.222.0.40 "DELETE /compute/v2.1/servers/dc8d9140-3f8d-44ad-86f4-36d67fbe7d19" status: 204 len: 0 microversion: 2.1 time: 0.430874 Oct 26 13:33:39.226046 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2885/5801] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:33:38 2022] DELETE /compute/v2.1/servers/dc8d9140-3f8d-44ad-86f4-36d67fbe7d19 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:33:39.243892 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-aeff792a-788d-49c2-9275-1bd4f9f21f39 req-8d102fc0-28bb-4a0d-a6bc-f1fa26ba179d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc8d9140-3f8d-44ad-86f4-36d67fbe7d19", "tag": "f7033ea2-06ce-4a5d-89e9-d5ec1bb05d04"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:33:39.274940 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-aeff792a-788d-49c2-9275-1bd4f9f21f39 req-8d102fc0-28bb-4a0d-a6bc-f1fa26ba179d service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:39.275736 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-aeff792a-788d-49c2-9275-1bd4f9f21f39 req-8d102fc0-28bb-4a0d-a6bc-f1fa26ba179d service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:39.276350 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-aeff792a-788d-49c2-9275-1bd4f9f21f39 req-8d102fc0-28bb-4a0d-a6bc-f1fa26ba179d service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:39.314592 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-aeff792a-788d-49c2-9275-1bd4f9f21f39 req-8d102fc0-28bb-4a0d-a6bc-f1fa26ba179d service nova] Creating event network-changed:f7033ea2-06ce-4a5d-89e9-d5ec1bb05d04 for instance dc8d9140-3f8d-44ad-86f4-36d67fbe7d19 on n-h2-862686-1 Oct 26 13:33:39.334604 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-aeff792a-788d-49c2-9275-1bd4f9f21f39 req-8d102fc0-28bb-4a0d-a6bc-f1fa26ba179d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101110 Oct 26 13:33:39.338548 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2886/5802] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:33:39.350357 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5a172d81-245c-430d-abdb-851e760f56fb tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:39.355781 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5a172d81-245c-430d-abdb-851e760f56fb tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] [instance: dc8d9140-3f8d-44ad-86f4-36d67fbe7d19] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:39.373237 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5a172d81-245c-430d-abdb-851e760f56fb tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:39.377349 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5a172d81-245c-430d-abdb-851e760f56fb tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:39.378049 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5a172d81-245c-430d-abdb-851e760f56fb tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:39.379725 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5a172d81-245c-430d-abdb-851e760f56fb tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:39.383075 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5a172d81-245c-430d-abdb-851e760f56fb tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:39.383761 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5a172d81-245c-430d-abdb-851e760f56fb tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:39.665513 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5a172d81-245c-430d-abdb-851e760f56fb tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f745ae4d44f4cdebb40e233b0deed7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d89db2ac0141d694e64f474244e527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:39.674027 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5a172d81-245c-430d-abdb-851e760f56fb tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] 10.222.0.40 "GET /compute/v2.1/servers/dc8d9140-3f8d-44ad-86f4-36d67fbe7d19" status: 200 len: 1765 microversion: 2.1 time: 0.332153 Oct 26 13:33:39.679810 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2887/5803] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:33:39 2022] GET /compute/v2.1/servers/dc8d9140-3f8d-44ad-86f4-36d67fbe7d19 => generated 1765 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:33:40.410086 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d4eb8866-efd2-4f93-87cd-aecd69495f2c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:40.440004 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d4eb8866-efd2-4f93-87cd-aecd69495f2c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1672 microversion: 2.1 time: 1.538467 Oct 26 13:33:40.455947 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2917/5804] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:33:38 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1672 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:33:40.703529 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0991d324-c0b1-4a83-be7b-fd2afcae2179 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:40.704452 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0991d324-c0b1-4a83-be7b-fd2afcae2179 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] [instance: dc8d9140-3f8d-44ad-86f4-36d67fbe7d19] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:40.725329 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0991d324-c0b1-4a83-be7b-fd2afcae2179 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:40.730900 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0991d324-c0b1-4a83-be7b-fd2afcae2179 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:40.732206 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0991d324-c0b1-4a83-be7b-fd2afcae2179 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:40.734053 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0991d324-c0b1-4a83-be7b-fd2afcae2179 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:40.735499 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0991d324-c0b1-4a83-be7b-fd2afcae2179 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:40.741346 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0991d324-c0b1-4a83-be7b-fd2afcae2179 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:41.470451 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-eeb35339-c070-4094-9d13-4e5ed615e8b7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:41.471130 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-eeb35339-c070-4094-9d13-4e5ed615e8b7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:41.499384 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eeb35339-c070-4094-9d13-4e5ed615e8b7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:41.499888 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eeb35339-c070-4094-9d13-4e5ed615e8b7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:41.500334 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eeb35339-c070-4094-9d13-4e5ed615e8b7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:41.501113 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eeb35339-c070-4094-9d13-4e5ed615e8b7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:41.501532 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eeb35339-c070-4094-9d13-4e5ed615e8b7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:41.501964 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eeb35339-c070-4094-9d13-4e5ed615e8b7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:42.525424 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0991d324-c0b1-4a83-be7b-fd2afcae2179 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f745ae4d44f4cdebb40e233b0deed7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d89db2ac0141d694e64f474244e527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:42.538271 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0991d324-c0b1-4a83-be7b-fd2afcae2179 tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] 10.222.0.40 "GET /compute/v2.1/servers/dc8d9140-3f8d-44ad-86f4-36d67fbe7d19" status: 200 len: 1765 microversion: 2.1 time: 1.838973 Oct 26 13:33:42.546949 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2888/5805] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:33:40 2022] GET /compute/v2.1/servers/dc8d9140-3f8d-44ad-86f4-36d67fbe7d19 => generated 1765 bytes in 1848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:33:42.571713 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-eeb35339-c070-4094-9d13-4e5ed615e8b7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:42.607643 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-eeb35339-c070-4094-9d13-4e5ed615e8b7 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1672 microversion: 2.1 time: 1.140843 Oct 26 13:33:42.628667 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2918/5806] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:33:41 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1672 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:33:43.110704 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-03f2f623-0479-4386-aee2-21cece84d64f req-bb4f96d5-8a04-4bb0-881e-3fa4bff431ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc8d9140-3f8d-44ad-86f4-36d67fbe7d19", "name": "network-vif-deleted", "tag": "f7033ea2-06ce-4a5d-89e9-d5ec1bb05d04"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:33:43.136297 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-03f2f623-0479-4386-aee2-21cece84d64f req-bb4f96d5-8a04-4bb0-881e-3fa4bff431ba service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:43.138233 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-03f2f623-0479-4386-aee2-21cece84d64f req-bb4f96d5-8a04-4bb0-881e-3fa4bff431ba service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:43.139408 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-03f2f623-0479-4386-aee2-21cece84d64f req-bb4f96d5-8a04-4bb0-881e-3fa4bff431ba service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:43.165855 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-03f2f623-0479-4386-aee2-21cece84d64f req-bb4f96d5-8a04-4bb0-881e-3fa4bff431ba service nova] Creating event network-vif-deleted:f7033ea2-06ce-4a5d-89e9-d5ec1bb05d04 for instance dc8d9140-3f8d-44ad-86f4-36d67fbe7d19 on n-h2-862686-1 Oct 26 13:33:43.173319 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-03f2f623-0479-4386-aee2-21cece84d64f req-bb4f96d5-8a04-4bb0-881e-3fa4bff431ba service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069955 Oct 26 13:33:43.186938 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2889/5807] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:33:43.563434 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-011a1d71-970b-475f-bd6a-41fea614a68b tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:43.564073 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-011a1d71-970b-475f-bd6a-41fea614a68b tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] [instance: dc8d9140-3f8d-44ad-86f4-36d67fbe7d19] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:43.578495 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-011a1d71-970b-475f-bd6a-41fea614a68b tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:43.582081 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-011a1d71-970b-475f-bd6a-41fea614a68b tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:43.584080 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-011a1d71-970b-475f-bd6a-41fea614a68b tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:43.602670 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-011a1d71-970b-475f-bd6a-41fea614a68b tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:43.603691 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-011a1d71-970b-475f-bd6a-41fea614a68b tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:43.604885 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-011a1d71-970b-475f-bd6a-41fea614a68b tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:43.638468 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7fc57291-2a63-42dc-8bc8-641113b85c5c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:43.643798 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7fc57291-2a63-42dc-8bc8-641113b85c5c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:43.683961 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7fc57291-2a63-42dc-8bc8-641113b85c5c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:43.686367 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7fc57291-2a63-42dc-8bc8-641113b85c5c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:43.692606 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7fc57291-2a63-42dc-8bc8-641113b85c5c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:43.698361 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7fc57291-2a63-42dc-8bc8-641113b85c5c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:43.698945 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7fc57291-2a63-42dc-8bc8-641113b85c5c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:43.701406 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7fc57291-2a63-42dc-8bc8-641113b85c5c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:43.759394 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-011a1d71-970b-475f-bd6a-41fea614a68b tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:43.759394 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-011a1d71-970b-475f-bd6a-41fea614a68b tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:43.759394 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-011a1d71-970b-475f-bd6a-41fea614a68b tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:43.759394 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-011a1d71-970b-475f-bd6a-41fea614a68b tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lazy-loading 'fault' on Instance uuid dc8d9140-3f8d-44ad-86f4-36d67fbe7d19 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:33:44.007626 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7fc57291-2a63-42dc-8bc8-641113b85c5c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:44.028159 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7fc57291-2a63-42dc-8bc8-641113b85c5c tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1604 microversion: 2.1 time: 0.394067 Oct 26 13:33:44.030581 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2890/5808] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:33:43 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1604 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:33:44.328262 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-011a1d71-970b-475f-bd6a-41fea614a68b tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f745ae4d44f4cdebb40e233b0deed7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d89db2ac0141d694e64f474244e527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:44.344486 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-011a1d71-970b-475f-bd6a-41fea614a68b tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] 10.222.0.40 "GET /compute/v2.1/servers/dc8d9140-3f8d-44ad-86f4-36d67fbe7d19" status: 200 len: 1383 microversion: 2.1 time: 0.777703 Oct 26 13:33:44.345147 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2919/5809] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:33:43 2022] GET /compute/v2.1/servers/dc8d9140-3f8d-44ad-86f4-36d67fbe7d19 => generated 1383 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:33:45.055988 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b7107747-ff2f-4e41-8f02-082a2c73bed9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:45.056611 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b7107747-ff2f-4e41-8f02-082a2c73bed9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:45.077133 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b7107747-ff2f-4e41-8f02-082a2c73bed9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:45.078855 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b7107747-ff2f-4e41-8f02-082a2c73bed9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:45.081402 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b7107747-ff2f-4e41-8f02-082a2c73bed9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:45.087671 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b7107747-ff2f-4e41-8f02-082a2c73bed9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:45.097327 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b7107747-ff2f-4e41-8f02-082a2c73bed9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:45.105159 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-1cc896bb-18e7-4bf6-9fc0-0e3cc21993cd req-e897a0c9-96f8-43be-acce-474307474297 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "341d8b3a-d684-4969-a5cf-a6aea1a055fa", "name": "network-vif-deleted", "tag": "391606bb-b0ec-4759-b9bd-53c1cc5c2f7c"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:33:45.113727 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b7107747-ff2f-4e41-8f02-082a2c73bed9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:45.135709 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-1cc896bb-18e7-4bf6-9fc0-0e3cc21993cd req-e897a0c9-96f8-43be-acce-474307474297 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:45.139167 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-1cc896bb-18e7-4bf6-9fc0-0e3cc21993cd req-e897a0c9-96f8-43be-acce-474307474297 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:45.140434 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-1cc896bb-18e7-4bf6-9fc0-0e3cc21993cd req-e897a0c9-96f8-43be-acce-474307474297 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:45.189724 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-1cc896bb-18e7-4bf6-9fc0-0e3cc21993cd req-e897a0c9-96f8-43be-acce-474307474297 service nova] Creating event network-vif-deleted:391606bb-b0ec-4759-b9bd-53c1cc5c2f7c for instance 341d8b3a-d684-4969-a5cf-a6aea1a055fa on n-h1-862686-1 Oct 26 13:33:45.213771 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-1cc896bb-18e7-4bf6-9fc0-0e3cc21993cd req-e897a0c9-96f8-43be-acce-474307474297 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113606 Oct 26 13:33:45.220152 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2920/5810] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:33:45.373306 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1c7e96d1-94f4-4d25-924d-6dcdf8ca46dc tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:45.374044 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1c7e96d1-94f4-4d25-924d-6dcdf8ca46dc tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] [instance: dc8d9140-3f8d-44ad-86f4-36d67fbe7d19] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:45.385235 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c7e96d1-94f4-4d25-924d-6dcdf8ca46dc tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:45.386015 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c7e96d1-94f4-4d25-924d-6dcdf8ca46dc tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:45.388662 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c7e96d1-94f4-4d25-924d-6dcdf8ca46dc tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:45.389725 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c7e96d1-94f4-4d25-924d-6dcdf8ca46dc tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:45.390632 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c7e96d1-94f4-4d25-924d-6dcdf8ca46dc tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:45.391791 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c7e96d1-94f4-4d25-924d-6dcdf8ca46dc tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:45.426066 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-1c7e96d1-94f4-4d25-924d-6dcdf8ca46dc tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] HTTP exception thrown: Instance dc8d9140-3f8d-44ad-86f4-36d67fbe7d19 could not be found. Oct 26 13:33:45.431256 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b7107747-ff2f-4e41-8f02-082a2c73bed9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9ff5a884f1416886f26a80c5b87b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d1b1d2fe374ee5806eeee18712219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1c7e96d1-94f4-4d25-924d-6dcdf8ca46dc tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Request method failure captured: Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/dc8d9140-3f8d-44ad-86f4-36d67fbe7d19 HTTP/1.1 Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTZ_DE6NEHvkScgbje_TtVqaY60xlPYPtDMs5rooh8nxncYeQnO8CThjNuC2ro2GkS1B7nrCcUL2P-JK-6bggnRViZKjKomjg2OS2bneDOA4S-Y2Z2yZgfHdlxf6rB4I_jrf9F2b_9Mp8YdyWbMoIT3_Xub_tFPRTf0Akhdh0l-JwpU Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: b6d89db2ac0141d694e64f474244e527 Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1602733414 Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b6d89db2ac0141d694e64f474244e527"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b6d89db2ac0141d694e64f474244e527"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b6d89db2ac0141d694e64f474244e527"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b6d89db2ac0141d694e64f474244e527"}]}] Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1602733414 Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: b6d89db2ac0141d694e64f474244e527 Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1602733414 Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-TestSecurityGroupsBasicOps-1602733414-project Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 8f745ae4d44f4cdebb40e233b0deed7a Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1602733414-project Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance dc8d9140-3f8d-44ad-86f4-36d67fbe7d19 could not be found. Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'dc8d9140-3f8d-44ad-86f4-36d67fbe7d19'} Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc8d9140-3f8d-44ad-86f4-36d67fbe7d19 could not be found. Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc8d9140-3f8d-44ad-86f4-36d67fbe7d19 could not be found. Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:33:45.445857 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:33:45.450342 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:33:45.450342 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:33:45.450342 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:33:45.450342 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:33:45.450342 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:33:45.450342 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:33:45.450342 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc8d9140-3f8d-44ad-86f4-36d67fbe7d19 could not be found. Oct 26 13:33:45.450342 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:33:45.461954 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b7107747-ff2f-4e41-8f02-082a2c73bed9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 200 len: 1321 microversion: 2.1 time: 0.393923 Oct 26 13:33:45.466561 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1c7e96d1-94f4-4d25-924d-6dcdf8ca46dc tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Returning 404 to user: Instance dc8d9140-3f8d-44ad-86f4-36d67fbe7d19 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:33:45.467653 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1c7e96d1-94f4-4d25-924d-6dcdf8ca46dc tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] 10.222.0.40 "GET /compute/v2.1/servers/dc8d9140-3f8d-44ad-86f4-36d67fbe7d19" status: 404 len: 111 microversion: 2.1 time: 0.098909 Oct 26 13:33:45.486289 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2891/5811] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:33:45 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 1321 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:33:45.489913 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2921/5812] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:33:45 2022] GET /compute/v2.1/servers/dc8d9140-3f8d-44ad-86f4-36d67fbe7d19 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 13:33:46.499539 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2c137980-09f9-4733-84c0-9fc19157a6b9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:46.500300 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2c137980-09f9-4733-84c0-9fc19157a6b9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] [instance: 341d8b3a-d684-4969-a5cf-a6aea1a055fa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:33:46.511143 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2c137980-09f9-4733-84c0-9fc19157a6b9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:46.511633 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2c137980-09f9-4733-84c0-9fc19157a6b9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:46.512078 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2c137980-09f9-4733-84c0-9fc19157a6b9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:46.512789 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2c137980-09f9-4733-84c0-9fc19157a6b9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:33:46.513253 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2c137980-09f9-4733-84c0-9fc19157a6b9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:33:46.525731 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2c137980-09f9-4733-84c0-9fc19157a6b9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:33:46.583942 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-2c137980-09f9-4733-84c0-9fc19157a6b9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] HTTP exception thrown: Instance 341d8b3a-d684-4969-a5cf-a6aea1a055fa could not be found. Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2c137980-09f9-4733-84c0-9fc19157a6b9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Request method failure captured: Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa HTTP/1.1 Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTTRuTNKOQB-nrFVO4ZQOSUPJw_t87hSQG4X0NnCZ-NkeLQePXfE28jjlOlL7XoeNcReKFB3n9XBYRIE9HcyLgGEDDp5gX1x_vTjrqFvjU0FYibg_1MyRrL2Ht61uOMaLpkZivAymUmDmap2-8WoM-6AmJL7TAW0hXVB6neLWiOUzoY Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: c0d1b1d2fe374ee5806eeee18712219f Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServerActionsTestJSON-871807092 Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c0d1b1d2fe374ee5806eeee18712219f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c0d1b1d2fe374ee5806eeee18712219f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c0d1b1d2fe374ee5806eeee18712219f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c0d1b1d2fe374ee5806eeee18712219f"}]}] Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServerActionsTestJSON-871807092 Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: c0d1b1d2fe374ee5806eeee18712219f Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServerActionsTestJSON-871807092 Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServerActionsTestJSON-871807092-project Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 3e9ff5a884f1416886f26a80c5b87b18 Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServerActionsTestJSON-871807092-project Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 341d8b3a-d684-4969-a5cf-a6aea1a055fa could not be found. Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '341d8b3a-d684-4969-a5cf-a6aea1a055fa'} Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 341d8b3a-d684-4969-a5cf-a6aea1a055fa could not be found. Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 341d8b3a-d684-4969-a5cf-a6aea1a055fa could not be found. Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:33:46.588657 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:33:46.592859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:33:46.592859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:33:46.592859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:33:46.592859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:33:46.592859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:33:46.592859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 341d8b3a-d684-4969-a5cf-a6aea1a055fa could not be found. Oct 26 13:33:46.592859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:33:46.609184 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2c137980-09f9-4733-84c0-9fc19157a6b9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Returning 404 to user: Instance 341d8b3a-d684-4969-a5cf-a6aea1a055fa could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:33:46.610160 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2c137980-09f9-4733-84c0-9fc19157a6b9 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa" status: 404 len: 111 microversion: 2.1 time: 0.115759 Oct 26 13:33:46.610949 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2892/5813] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:33:46 2022] GET /compute/v2.1/servers/341d8b3a-d684-4969-a5cf-a6aea1a055fa => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:33:46.620494 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ca98a4ef-0744-44c6-886c-f53cdf9853d4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] Calling method '.version_select at 0x7f67317e2940>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:33:46.749272 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ca98a4ef-0744-44c6-886c-f53cdf9853d4 tempest-ServerActionsTestJSON-871807092 tempest-ServerActionsTestJSON-871807092-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-68516749" status: 202 len: 0 microversion: 2.1 time: 0.133020 Oct 26 13:33:46.757144 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2922/5814] 10.222.0.40 () {58 vars in 1215 bytes} [Wed Oct 26 13:33:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-68516749 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:34:01.820541 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:34:01.822830 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:34:01.827053 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4736c509-7743-43a6-a18a-605664d9abaa tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] Calling method '.version_select at 0x7f6731396d30>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:01.910328 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4736c509-7743-43a6-a18a-605664d9abaa tempest-TestSecurityGroupsBasicOps-1602733414 tempest-TestSecurityGroupsBasicOps-1602733414-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-697462233" status: 202 len: 0 microversion: 2.1 time: 0.087734 Oct 26 13:34:01.910328 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2893/5815] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 26 13:34:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-697462233 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:34:02.640187 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=41 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:34:02.641230 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:34:02.651839 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c0bba53c-5499-45e7-a688-ae4fa9d2baa7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:02.659440 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c0bba53c-5499-45e7-a688-ae4fa9d2baa7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:02.682629 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0bba53c-5499-45e7-a688-ae4fa9d2baa7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:02.683149 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0bba53c-5499-45e7-a688-ae4fa9d2baa7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:02.683604 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0bba53c-5499-45e7-a688-ae4fa9d2baa7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:02.684349 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0bba53c-5499-45e7-a688-ae4fa9d2baa7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:02.691565 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0bba53c-5499-45e7-a688-ae4fa9d2baa7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:02.692109 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0bba53c-5499-45e7-a688-ae4fa9d2baa7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:02.788590 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c0bba53c-5499-45e7-a688-ae4fa9d2baa7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9/ips" status: 200 len: 153 microversion: 2.20 time: 0.149673 Oct 26 13:34:02.798296 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2923/5816] 10.222.0.40 () {60 vars in 1289 bytes} [Wed Oct 26 13:34:02 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9/ips => generated 153 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:34:04.636271 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-46f516e8-2640-4d34-a507-1a835b39a194 tempest-PortsAdminExtendedAttrsTestJSON-626500830 tempest-PortsAdminExtendedAttrsTestJSON-626500830-project-admin] Calling method '.version_select at 0x7f673145e4c0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:04.641257 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-46f516e8-2640-4d34-a507-1a835b39a194 tempest-PortsAdminExtendedAttrsTestJSON-626500830 tempest-PortsAdminExtendedAttrsTestJSON-626500830-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:04.642023 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-46f516e8-2640-4d34-a507-1a835b39a194 tempest-PortsAdminExtendedAttrsTestJSON-626500830 tempest-PortsAdminExtendedAttrsTestJSON-626500830-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:04.642649 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-46f516e8-2640-4d34-a507-1a835b39a194 tempest-PortsAdminExtendedAttrsTestJSON-626500830 tempest-PortsAdminExtendedAttrsTestJSON-626500830-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:04.688043 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-46f516e8-2640-4d34-a507-1a835b39a194 tempest-PortsAdminExtendedAttrsTestJSON-626500830 tempest-PortsAdminExtendedAttrsTestJSON-626500830-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:04.688954 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-46f516e8-2640-4d34-a507-1a835b39a194 tempest-PortsAdminExtendedAttrsTestJSON-626500830 tempest-PortsAdminExtendedAttrsTestJSON-626500830-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:04.689731 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-46f516e8-2640-4d34-a507-1a835b39a194 tempest-PortsAdminExtendedAttrsTestJSON-626500830 tempest-PortsAdminExtendedAttrsTestJSON-626500830-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:04.716935 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-46f516e8-2640-4d34-a507-1a835b39a194 tempest-PortsAdminExtendedAttrsTestJSON-626500830 tempest-PortsAdminExtendedAttrsTestJSON-626500830-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:04.717672 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-46f516e8-2640-4d34-a507-1a835b39a194 tempest-PortsAdminExtendedAttrsTestJSON-626500830 tempest-PortsAdminExtendedAttrsTestJSON-626500830-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:04.718274 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-46f516e8-2640-4d34-a507-1a835b39a194 tempest-PortsAdminExtendedAttrsTestJSON-626500830 tempest-PortsAdminExtendedAttrsTestJSON-626500830-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:04.737039 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-46f516e8-2640-4d34-a507-1a835b39a194 tempest-PortsAdminExtendedAttrsTestJSON-626500830 tempest-PortsAdminExtendedAttrsTestJSON-626500830-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.738980 Oct 26 13:34:04.748139 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2894/5817] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:34:03 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:34:07.600314 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d4268a58-9f91-4376-b7e7-bcf7fca2cb02 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:34:07.603313 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d4268a58-9f91-4376-b7e7-bcf7fca2cb02 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:07.628548 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4268a58-9f91-4376-b7e7-bcf7fca2cb02 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:07.632567 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4268a58-9f91-4376-b7e7-bcf7fca2cb02 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:07.634000 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4268a58-9f91-4376-b7e7-bcf7fca2cb02 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:07.635551 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4268a58-9f91-4376-b7e7-bcf7fca2cb02 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:07.643560 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4268a58-9f91-4376-b7e7-bcf7fca2cb02 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:07.644503 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4268a58-9f91-4376-b7e7-bcf7fca2cb02 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:07.707430 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-d4268a58-9f91-4376-b7e7-bcf7fca2cb02 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lazy-loading 'flavor' on Instance uuid 6c95d88e-349c-4594-b0a2-351b507f34f9 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:34:08.156742 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d4268a58-9f91-4376-b7e7-bcf7fca2cb02 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "POST /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9/action" status: 202 len: 0 microversion: 2.20 time: 0.568148 Oct 26 13:34:08.160216 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2924/5818] 10.222.0.40 () {62 vars in 1319 bytes} [Wed Oct 26 13:34:07 2022] POST /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9/action => generated 0 bytes in 575 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:34:08.178672 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9b8fb967-4d5c-470e-8db0-4aecda6c1359 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:08.183771 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9b8fb967-4d5c-470e-8db0-4aecda6c1359 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:08.223834 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9b8fb967-4d5c-470e-8db0-4aecda6c1359 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:08.224422 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9b8fb967-4d5c-470e-8db0-4aecda6c1359 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:08.224873 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9b8fb967-4d5c-470e-8db0-4aecda6c1359 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:08.227781 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9b8fb967-4d5c-470e-8db0-4aecda6c1359 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:08.228301 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9b8fb967-4d5c-470e-8db0-4aecda6c1359 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:08.228755 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9b8fb967-4d5c-470e-8db0-4aecda6c1359 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:09.711801 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9b8fb967-4d5c-470e-8db0-4aecda6c1359 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:09.790816 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9b8fb967-4d5c-470e-8db0-4aecda6c1359 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:09.790816 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9b8fb967-4d5c-470e-8db0-4aecda6c1359 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:09.790816 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9b8fb967-4d5c-470e-8db0-4aecda6c1359 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1726 microversion: 2.20 time: 1.620542 Oct 26 13:34:09.810187 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2895/5819] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:34:08 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1726 bytes in 1646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:34:10.821332 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a59328b8-c9c1-471e-bc2b-515d049e7c41 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:10.822597 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a59328b8-c9c1-471e-bc2b-515d049e7c41 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:10.847676 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a59328b8-c9c1-471e-bc2b-515d049e7c41 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:10.848696 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a59328b8-c9c1-471e-bc2b-515d049e7c41 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:10.851345 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a59328b8-c9c1-471e-bc2b-515d049e7c41 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:10.852147 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a59328b8-c9c1-471e-bc2b-515d049e7c41 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:10.852633 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a59328b8-c9c1-471e-bc2b-515d049e7c41 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:10.853079 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a59328b8-c9c1-471e-bc2b-515d049e7c41 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:11.415616 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a59328b8-c9c1-471e-bc2b-515d049e7c41 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:11.427144 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a59328b8-c9c1-471e-bc2b-515d049e7c41 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:11.431149 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a59328b8-c9c1-471e-bc2b-515d049e7c41 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:11.433211 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a59328b8-c9c1-471e-bc2b-515d049e7c41 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1726 microversion: 2.20 time: 0.618498 Oct 26 13:34:11.435458 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2925/5820] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:34:10 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1726 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:34:12.461416 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f69dd5b0-4fd4-45f1-9494-b81dfeccd9ff tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:12.462232 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f69dd5b0-4fd4-45f1-9494-b81dfeccd9ff tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:12.504381 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f69dd5b0-4fd4-45f1-9494-b81dfeccd9ff tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:12.509776 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f69dd5b0-4fd4-45f1-9494-b81dfeccd9ff tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:12.510267 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f69dd5b0-4fd4-45f1-9494-b81dfeccd9ff tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:12.511034 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f69dd5b0-4fd4-45f1-9494-b81dfeccd9ff tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:12.511513 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f69dd5b0-4fd4-45f1-9494-b81dfeccd9ff tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:12.525107 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f69dd5b0-4fd4-45f1-9494-b81dfeccd9ff tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:13.070106 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f69dd5b0-4fd4-45f1-9494-b81dfeccd9ff tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:13.101107 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f69dd5b0-4fd4-45f1-9494-b81dfeccd9ff tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:13.102842 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f69dd5b0-4fd4-45f1-9494-b81dfeccd9ff tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:13.112229 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f69dd5b0-4fd4-45f1-9494-b81dfeccd9ff tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1726 microversion: 2.20 time: 0.655596 Oct 26 13:34:13.130012 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2896/5821] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:34:12 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1726 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:34:14.143982 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-90cbaaee-0ae0-4a5d-b629-3a3eca11873d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:14.145021 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-90cbaaee-0ae0-4a5d-b629-3a3eca11873d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:14.161736 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90cbaaee-0ae0-4a5d-b629-3a3eca11873d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:14.168503 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90cbaaee-0ae0-4a5d-b629-3a3eca11873d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:14.169814 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90cbaaee-0ae0-4a5d-b629-3a3eca11873d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:14.171365 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90cbaaee-0ae0-4a5d-b629-3a3eca11873d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:14.177873 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90cbaaee-0ae0-4a5d-b629-3a3eca11873d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:14.183488 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90cbaaee-0ae0-4a5d-b629-3a3eca11873d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:14.773457 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-90cbaaee-0ae0-4a5d-b629-3a3eca11873d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:14.789646 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-90cbaaee-0ae0-4a5d-b629-3a3eca11873d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:14.791678 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-90cbaaee-0ae0-4a5d-b629-3a3eca11873d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:14.794087 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-90cbaaee-0ae0-4a5d-b629-3a3eca11873d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1726 microversion: 2.20 time: 0.654419 Oct 26 13:34:14.807432 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2926/5822] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:34:14 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1726 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:34:15.474577 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5650f4c8-52d0-48f6-ab5a-788dabfecb9c tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:15.476301 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5650f4c8-52d0-48f6-ab5a-788dabfecb9c tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] [instance: 4d2e95a1-588c-43ff-9af0-4d52676793b1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:15.483574 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5650f4c8-52d0-48f6-ab5a-788dabfecb9c tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:15.494356 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5650f4c8-52d0-48f6-ab5a-788dabfecb9c tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:15.495064 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5650f4c8-52d0-48f6-ab5a-788dabfecb9c tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:15.496220 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5650f4c8-52d0-48f6-ab5a-788dabfecb9c tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:15.496869 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5650f4c8-52d0-48f6-ab5a-788dabfecb9c tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:15.497602 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5650f4c8-52d0-48f6-ab5a-788dabfecb9c tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:15.656526 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-5650f4c8-52d0-48f6-ab5a-788dabfecb9c tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lazy-loading 'services' on Instance uuid 4d2e95a1-588c-43ff-9af0-4d52676793b1 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:34:15.824591 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fd8ab64f-bec4-424f-b907-fb91353461a3 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:15.836756 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fd8ab64f-bec4-424f-b907-fb91353461a3 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:15.853036 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5650f4c8-52d0-48f6-ab5a-788dabfecb9c tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4d2e95a1-588c-43ff-9af0-4d52676793b1/os-volume_attachments/07acd45b-537c-48b9-b277-c22b71483083" status: 202 len: 0 microversion: 2.1 time: 0.381780 Oct 26 13:34:15.854705 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2897/5823] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Oct 26 13:34:15 2022] DELETE /compute/v2.1/servers/4d2e95a1-588c-43ff-9af0-4d52676793b1/os-volume_attachments/07acd45b-537c-48b9-b277-c22b71483083 => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:34:15.871148 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd8ab64f-bec4-424f-b907-fb91353461a3 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:15.875595 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd8ab64f-bec4-424f-b907-fb91353461a3 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:15.877414 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd8ab64f-bec4-424f-b907-fb91353461a3 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:15.886800 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd8ab64f-bec4-424f-b907-fb91353461a3 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:15.888687 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd8ab64f-bec4-424f-b907-fb91353461a3 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:15.889169 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fd8ab64f-bec4-424f-b907-fb91353461a3 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:16.452137 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fd8ab64f-bec4-424f-b907-fb91353461a3 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:16.468431 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fd8ab64f-bec4-424f-b907-fb91353461a3 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:16.475939 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fd8ab64f-bec4-424f-b907-fb91353461a3 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:16.477912 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fd8ab64f-bec4-424f-b907-fb91353461a3 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1726 microversion: 2.20 time: 0.659953 Oct 26 13:34:16.478527 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2927/5824] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:34:15 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1726 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:34:17.507850 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5b401bbe-f210-467c-9dee-6aa064117623 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:17.508528 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5b401bbe-f210-467c-9dee-6aa064117623 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:17.541088 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5b401bbe-f210-467c-9dee-6aa064117623 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:17.541729 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5b401bbe-f210-467c-9dee-6aa064117623 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:17.545924 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5b401bbe-f210-467c-9dee-6aa064117623 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:17.553306 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5b401bbe-f210-467c-9dee-6aa064117623 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:17.555165 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5b401bbe-f210-467c-9dee-6aa064117623 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:17.555638 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5b401bbe-f210-467c-9dee-6aa064117623 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:18.078667 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5b401bbe-f210-467c-9dee-6aa064117623 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:18.094483 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5b401bbe-f210-467c-9dee-6aa064117623 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:18.096572 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5b401bbe-f210-467c-9dee-6aa064117623 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:18.100208 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5b401bbe-f210-467c-9dee-6aa064117623 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1726 microversion: 2.20 time: 0.597320 Oct 26 13:34:18.114324 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2898/5825] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:34:17 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1726 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:34:19.138533 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fe172c9f-ee39-4af3-8f3a-5c86ee246c8c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:19.140321 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fe172c9f-ee39-4af3-8f3a-5c86ee246c8c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:19.161153 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe172c9f-ee39-4af3-8f3a-5c86ee246c8c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:19.163002 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe172c9f-ee39-4af3-8f3a-5c86ee246c8c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:19.165101 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe172c9f-ee39-4af3-8f3a-5c86ee246c8c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:19.170434 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe172c9f-ee39-4af3-8f3a-5c86ee246c8c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:19.171400 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe172c9f-ee39-4af3-8f3a-5c86ee246c8c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:19.172818 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe172c9f-ee39-4af3-8f3a-5c86ee246c8c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:19.628853 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fe172c9f-ee39-4af3-8f3a-5c86ee246c8c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:19.644152 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fe172c9f-ee39-4af3-8f3a-5c86ee246c8c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:19.645663 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fe172c9f-ee39-4af3-8f3a-5c86ee246c8c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:19.646897 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fe172c9f-ee39-4af3-8f3a-5c86ee246c8c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1726 microversion: 2.20 time: 0.513525 Oct 26 13:34:19.647699 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2928/5826] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:34:19 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1726 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:34:20.676479 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-30dd8951-dee4-4f34-9761-625d621ff076 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:20.677705 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-30dd8951-dee4-4f34-9761-625d621ff076 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:20.702711 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-30dd8951-dee4-4f34-9761-625d621ff076 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:20.703575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-30dd8951-dee4-4f34-9761-625d621ff076 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:20.704216 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-30dd8951-dee4-4f34-9761-625d621ff076 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:20.705132 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-30dd8951-dee4-4f34-9761-625d621ff076 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:20.706336 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-30dd8951-dee4-4f34-9761-625d621ff076 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:20.706978 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-30dd8951-dee4-4f34-9761-625d621ff076 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:22.021395 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-30dd8951-dee4-4f34-9761-625d621ff076 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:22.037845 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-30dd8951-dee4-4f34-9761-625d621ff076 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:22.049612 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-30dd8951-dee4-4f34-9761-625d621ff076 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:22.053990 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-30dd8951-dee4-4f34-9761-625d621ff076 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1726 microversion: 2.20 time: 1.379638 Oct 26 13:34:22.055229 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2899/5827] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:34:20 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1726 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:34:23.089309 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-034f0e86-2300-4415-b6e3-d340e6b1213a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:23.095317 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-034f0e86-2300-4415-b6e3-d340e6b1213a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:23.113338 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-034f0e86-2300-4415-b6e3-d340e6b1213a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:23.127512 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-034f0e86-2300-4415-b6e3-d340e6b1213a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:23.128306 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-034f0e86-2300-4415-b6e3-d340e6b1213a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:23.132994 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-034f0e86-2300-4415-b6e3-d340e6b1213a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:23.140182 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-034f0e86-2300-4415-b6e3-d340e6b1213a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:23.140945 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-034f0e86-2300-4415-b6e3-d340e6b1213a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:23.636225 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-034f0e86-2300-4415-b6e3-d340e6b1213a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:23.652527 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-034f0e86-2300-4415-b6e3-d340e6b1213a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:23.657290 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-034f0e86-2300-4415-b6e3-d340e6b1213a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:23.670599 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-034f0e86-2300-4415-b6e3-d340e6b1213a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1726 microversion: 2.20 time: 0.589397 Oct 26 13:34:23.675624 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2929/5828] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:34:23 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1726 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:34:24.580379 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-14bd7bac-103f-4197-a30f-5e59e4132cc5 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-399486474", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "6ef6bcd4-6b51-40a3-aaa8-fc41f6ccf6b5"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:34:24.707961 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8013be63-86ae-457e-b406-b4ef21cde905 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:24.708786 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8013be63-86ae-457e-b406-b4ef21cde905 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:24.711823 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-14bd7bac-103f-4197-a30f-5e59e4132cc5 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] validate_networks() for [('6ef6bcd4-6b51-40a3-aaa8-fc41f6ccf6b5', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:34:24.755186 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8013be63-86ae-457e-b406-b4ef21cde905 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:24.758787 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8013be63-86ae-457e-b406-b4ef21cde905 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:24.763156 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8013be63-86ae-457e-b406-b4ef21cde905 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:24.766721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8013be63-86ae-457e-b406-b4ef21cde905 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:24.768445 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8013be63-86ae-457e-b406-b4ef21cde905 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:24.769102 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8013be63-86ae-457e-b406-b4ef21cde905 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:25.538647 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8013be63-86ae-457e-b406-b4ef21cde905 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:25.552252 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8013be63-86ae-457e-b406-b4ef21cde905 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:25.565833 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8013be63-86ae-457e-b406-b4ef21cde905 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:25.567587 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8013be63-86ae-457e-b406-b4ef21cde905 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1747 microversion: 2.20 time: 0.869368 Oct 26 13:34:25.568446 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2930/5829] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:34:24 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1747 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:34:26.275918 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-14bd7bac-103f-4197-a30f-5e59e4132cc5 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:34:26.276441 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-14bd7bac-103f-4197-a30f-5e59e4132cc5 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:34:26.276810 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-14bd7bac-103f-4197-a30f-5e59e4132cc5 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:34:26.277219 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-14bd7bac-103f-4197-a30f-5e59e4132cc5 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:34:26.277936 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-14bd7bac-103f-4197-a30f-5e59e4132cc5 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:34:26.315045 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-010b432b-5672-4388-a785-486487b3393e tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:26.316196 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-010b432b-5672-4388-a785-486487b3393e tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] [instance: 4d2e95a1-588c-43ff-9af0-4d52676793b1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:26.317521 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-14bd7bac-103f-4197-a30f-5e59e4132cc5 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:26.318018 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-14bd7bac-103f-4197-a30f-5e59e4132cc5 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:26.318462 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-14bd7bac-103f-4197-a30f-5e59e4132cc5 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:26.325222 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-010b432b-5672-4388-a785-486487b3393e tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:26.326268 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-010b432b-5672-4388-a785-486487b3393e tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:26.327070 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-010b432b-5672-4388-a785-486487b3393e tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:26.328045 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-14bd7bac-103f-4197-a30f-5e59e4132cc5 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:26.328478 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-010b432b-5672-4388-a785-486487b3393e tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:26.329154 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-010b432b-5672-4388-a785-486487b3393e tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:26.329819 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-010b432b-5672-4388-a785-486487b3393e tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:26.334409 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-14bd7bac-103f-4197-a30f-5e59e4132cc5 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:26.334917 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-14bd7bac-103f-4197-a30f-5e59e4132cc5 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:26.395950 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-14bd7bac-103f-4197-a30f-5e59e4132cc5 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Getting quotas for project d761de7e6add4f08a0ffadc7b91a6a40. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:34:26.409553 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-14bd7bac-103f-4197-a30f-5e59e4132cc5 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Getting quotas for user 03173a2b60b7419491112e130ca58f37 and project d761de7e6add4f08a0ffadc7b91a6a40. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:34:26.418604 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-010b432b-5672-4388-a785-486487b3393e tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] [instance: 4d2e95a1-588c-43ff-9af0-4d52676793b1] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:34:26.454658 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-14bd7bac-103f-4197-a30f-5e59e4132cc5 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:34:26.461297 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-14bd7bac-103f-4197-a30f-5e59e4132cc5 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] [instance: 83f99269-100f-4df8-9434-7330a9b6402d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:34:26.628636 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-010b432b-5672-4388-a785-486487b3393e tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4d2e95a1-588c-43ff-9af0-4d52676793b1" status: 204 len: 0 microversion: 2.1 time: 0.319035 Oct 26 13:34:26.629551 n-d-862686-1 devstack@n-api.service[120597]: ERROR oslo.messaging._drivers.impl_rabbit [None req-14bd7bac-103f-4197-a30f-5e59e4132cc5 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] [0fcb579b-e1c4-4db3-ae3f-a0328141a39a] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 26 13:34:26.637753 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2931/5830] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:34:26 2022] DELETE /compute/v2.1/servers/4d2e95a1-588c-43ff-9af0-4d52676793b1 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 26 13:34:26.659810 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e180ca54-d916-4feb-879b-d0fa5a68414e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:26.660972 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e180ca54-d916-4feb-879b-d0fa5a68414e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:26.677001 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e180ca54-d916-4feb-879b-d0fa5a68414e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:26.681975 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e180ca54-d916-4feb-879b-d0fa5a68414e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:26.682667 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e180ca54-d916-4feb-879b-d0fa5a68414e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:26.684084 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e180ca54-d916-4feb-879b-d0fa5a68414e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:26.686411 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e180ca54-d916-4feb-879b-d0fa5a68414e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:26.687101 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e180ca54-d916-4feb-879b-d0fa5a68414e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:27.112334 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e180ca54-d916-4feb-879b-d0fa5a68414e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:27.126859 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e180ca54-d916-4feb-879b-d0fa5a68414e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:27.129527 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e180ca54-d916-4feb-879b-d0fa5a68414e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:27.131011 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e180ca54-d916-4feb-879b-d0fa5a68414e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1742 microversion: 2.20 time: 0.491323 Oct 26 13:34:27.132627 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2932/5831] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:34:26 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1742 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:34:27.138599 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-eac424ab-d22b-4370-9823-a4744493299a tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:27.139437 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-eac424ab-d22b-4370-9823-a4744493299a tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] [instance: 4d2e95a1-588c-43ff-9af0-4d52676793b1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:27.146728 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eac424ab-d22b-4370-9823-a4744493299a tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:27.147661 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eac424ab-d22b-4370-9823-a4744493299a tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:27.148634 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eac424ab-d22b-4370-9823-a4744493299a tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:27.149570 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eac424ab-d22b-4370-9823-a4744493299a tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:27.150221 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eac424ab-d22b-4370-9823-a4744493299a tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:27.150949 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eac424ab-d22b-4370-9823-a4744493299a tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:27.431022 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-eac424ab-d22b-4370-9823-a4744493299a tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe198b313144b0f9089de1d0b62e8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb208abbe6784b7692cc1460fc60d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:27.447105 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-eac424ab-d22b-4370-9823-a4744493299a tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] 10.222.0.40 "GET /compute/v2.1/servers/4d2e95a1-588c-43ff-9af0-4d52676793b1" status: 200 len: 1470 microversion: 2.1 time: 0.313047 Oct 26 13:34:27.447995 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2933/5832] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:34:27 2022] GET /compute/v2.1/servers/4d2e95a1-588c-43ff-9af0-4d52676793b1 => generated 1470 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:34:27.641632 n-d-862686-1 devstack@n-api.service[120597]: INFO oslo.messaging._drivers.impl_rabbit [None req-14bd7bac-103f-4197-a30f-5e59e4132cc5 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] [0fcb579b-e1c4-4db3-ae3f-a0328141a39a] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 40614. Oct 26 13:34:27.655644 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-14bd7bac-103f-4197-a30f-5e59e4132cc5 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.359133 Oct 26 13:34:27.658515 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2900/5833] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:34:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 3363 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:34:27.674027 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d32c251e-bf61-42ca-b779-f1521f9276a6 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:27.674817 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d32c251e-bf61-42ca-b779-f1521f9276a6 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] [instance: 83f99269-100f-4df8-9434-7330a9b6402d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:27.836355 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d32c251e-bf61-42ca-b779-f1521f9276a6 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03173a2b60b7419491112e130ca58f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd761de7e6add4f08a0ffadc7b91a6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:27.845277 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d32c251e-bf61-42ca-b779-f1521f9276a6 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] 10.222.0.40 "GET /compute/v2.1/servers/83f99269-100f-4df8-9434-7330a9b6402d" status: 200 len: 1223 microversion: 2.1 time: 0.178065 Oct 26 13:34:27.865941 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2934/5834] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:34:27 2022] GET /compute/v2.1/servers/83f99269-100f-4df8-9434-7330a9b6402d => generated 1223 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:34:28.162061 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-49efdf44-baa1-430d-8195-5035af19a920 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:28.163521 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-49efdf44-baa1-430d-8195-5035af19a920 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:28.186796 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49efdf44-baa1-430d-8195-5035af19a920 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:28.189955 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49efdf44-baa1-430d-8195-5035af19a920 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:28.190527 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49efdf44-baa1-430d-8195-5035af19a920 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:28.191283 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49efdf44-baa1-430d-8195-5035af19a920 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:28.191754 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49efdf44-baa1-430d-8195-5035af19a920 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:28.192177 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49efdf44-baa1-430d-8195-5035af19a920 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:28.487154 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-002bd474-ab02-48a4-9ae3-5df30340210c tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:28.488738 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-002bd474-ab02-48a4-9ae3-5df30340210c tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] [instance: 4d2e95a1-588c-43ff-9af0-4d52676793b1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:28.516926 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-002bd474-ab02-48a4-9ae3-5df30340210c tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:28.517797 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-002bd474-ab02-48a4-9ae3-5df30340210c tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:28.518425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-002bd474-ab02-48a4-9ae3-5df30340210c tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:28.521547 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-002bd474-ab02-48a4-9ae3-5df30340210c tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:28.522758 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-002bd474-ab02-48a4-9ae3-5df30340210c tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:28.524828 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-002bd474-ab02-48a4-9ae3-5df30340210c tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:28.789429 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-49efdf44-baa1-430d-8195-5035af19a920 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:28.802510 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-49efdf44-baa1-430d-8195-5035af19a920 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:28.805947 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-49efdf44-baa1-430d-8195-5035af19a920 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:28.811032 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-49efdf44-baa1-430d-8195-5035af19a920 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1742 microversion: 2.20 time: 0.653093 Oct 26 13:34:28.812220 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2901/5835] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:34:28 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1742 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:34:28.869583 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e3da0086-be99-418c-8c7f-399ee7ea0a9d tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:28.871187 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e3da0086-be99-418c-8c7f-399ee7ea0a9d tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] [instance: 83f99269-100f-4df8-9434-7330a9b6402d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:28.895769 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3da0086-be99-418c-8c7f-399ee7ea0a9d tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:28.899829 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3da0086-be99-418c-8c7f-399ee7ea0a9d tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:28.900577 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3da0086-be99-418c-8c7f-399ee7ea0a9d tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:28.901632 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3da0086-be99-418c-8c7f-399ee7ea0a9d tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:28.910371 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3da0086-be99-418c-8c7f-399ee7ea0a9d tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:28.911072 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3da0086-be99-418c-8c7f-399ee7ea0a9d tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:29.196479 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e3da0086-be99-418c-8c7f-399ee7ea0a9d tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03173a2b60b7419491112e130ca58f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd761de7e6add4f08a0ffadc7b91a6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:29.211899 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e3da0086-be99-418c-8c7f-399ee7ea0a9d tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] 10.222.0.40 "GET /compute/v2.1/servers/83f99269-100f-4df8-9434-7330a9b6402d" status: 200 len: 1227 microversion: 2.1 time: 0.347253 Oct 26 13:34:29.213183 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2902/5836] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:34:28 2022] GET /compute/v2.1/servers/83f99269-100f-4df8-9434-7330a9b6402d => generated 1227 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:34:29.276698 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-002bd474-ab02-48a4-9ae3-5df30340210c tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe198b313144b0f9089de1d0b62e8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb208abbe6784b7692cc1460fc60d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:29.296307 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-002bd474-ab02-48a4-9ae3-5df30340210c tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] 10.222.0.40 "GET /compute/v2.1/servers/4d2e95a1-588c-43ff-9af0-4d52676793b1" status: 200 len: 1470 microversion: 2.1 time: 0.818447 Oct 26 13:34:29.302981 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2935/5837] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:34:28 2022] GET /compute/v2.1/servers/4d2e95a1-588c-43ff-9af0-4d52676793b1 => generated 1470 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:34:29.740009 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-6fa5e5f6-d6ec-4e13-a74d-5b5ad89d3c10 req-a2cf8d6f-1eab-4344-895b-1b3ddbdda423 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d2e95a1-588c-43ff-9af0-4d52676793b1", "name": "network-vif-deleted", "tag": "a07e5852-6157-4962-8e3f-70ecf12ef7ef"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:34:29.756821 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-6fa5e5f6-d6ec-4e13-a74d-5b5ad89d3c10 req-a2cf8d6f-1eab-4344-895b-1b3ddbdda423 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:29.761616 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-6fa5e5f6-d6ec-4e13-a74d-5b5ad89d3c10 req-a2cf8d6f-1eab-4344-895b-1b3ddbdda423 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:29.762452 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-6fa5e5f6-d6ec-4e13-a74d-5b5ad89d3c10 req-a2cf8d6f-1eab-4344-895b-1b3ddbdda423 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:29.810971 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-6fa5e5f6-d6ec-4e13-a74d-5b5ad89d3c10 req-a2cf8d6f-1eab-4344-895b-1b3ddbdda423 service nova] Creating event network-vif-deleted:a07e5852-6157-4962-8e3f-70ecf12ef7ef for instance 4d2e95a1-588c-43ff-9af0-4d52676793b1 on n-h2-862686-1 Oct 26 13:34:29.838209 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-6fa5e5f6-d6ec-4e13-a74d-5b5ad89d3c10 req-a2cf8d6f-1eab-4344-895b-1b3ddbdda423 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109740 Oct 26 13:34:29.840889 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-423f3588-5dbd-4aeb-9f7b-1eb2ec48319b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:29.842099 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-423f3588-5dbd-4aeb-9f7b-1eb2ec48319b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:29.842306 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2903/5838] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:34:29.891759 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-423f3588-5dbd-4aeb-9f7b-1eb2ec48319b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:29.896726 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-423f3588-5dbd-4aeb-9f7b-1eb2ec48319b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:29.900974 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-423f3588-5dbd-4aeb-9f7b-1eb2ec48319b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:29.902317 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-423f3588-5dbd-4aeb-9f7b-1eb2ec48319b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:29.905862 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-423f3588-5dbd-4aeb-9f7b-1eb2ec48319b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:29.906331 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-423f3588-5dbd-4aeb-9f7b-1eb2ec48319b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:30.287547 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-fc71be75-5989-4d81-9527-08bdb056f6c6 req-ee194fd8-013a-4380-ad2b-3892f9b8734a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c95d88e-349c-4594-b0a2-351b507f34f9", "name": "network-vif-plugged", "status": "completed", "tag": "f0e9fd1e-4a27-44e9-903e-5bbaaf376cb8"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:34:30.331708 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-fc71be75-5989-4d81-9527-08bdb056f6c6 req-ee194fd8-013a-4380-ad2b-3892f9b8734a service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:30.332743 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-fc71be75-5989-4d81-9527-08bdb056f6c6 req-ee194fd8-013a-4380-ad2b-3892f9b8734a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:30.334000 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-fc71be75-5989-4d81-9527-08bdb056f6c6 req-ee194fd8-013a-4380-ad2b-3892f9b8734a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:30.375751 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-fc71be75-5989-4d81-9527-08bdb056f6c6 req-ee194fd8-013a-4380-ad2b-3892f9b8734a service nova] Creating event network-vif-plugged:f0e9fd1e-4a27-44e9-903e-5bbaaf376cb8 for instance 6c95d88e-349c-4594-b0a2-351b507f34f9 on n-h2-862686-1 Oct 26 13:34:30.403381 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-fc71be75-5989-4d81-9527-08bdb056f6c6 req-ee194fd8-013a-4380-ad2b-3892f9b8734a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.527708 Oct 26 13:34:30.408271 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2904/5839] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:34:30.423661 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-114039bc-0685-4b96-a449-db91ed2d487a tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:30.425748 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-114039bc-0685-4b96-a449-db91ed2d487a tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] [instance: 83f99269-100f-4df8-9434-7330a9b6402d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:30.449907 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-114039bc-0685-4b96-a449-db91ed2d487a tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:30.451201 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-114039bc-0685-4b96-a449-db91ed2d487a tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:30.452445 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-114039bc-0685-4b96-a449-db91ed2d487a tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:30.455821 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-114039bc-0685-4b96-a449-db91ed2d487a tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:30.464172 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-114039bc-0685-4b96-a449-db91ed2d487a tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:30.467235 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-114039bc-0685-4b96-a449-db91ed2d487a tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:30.743971 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-114039bc-0685-4b96-a449-db91ed2d487a tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03173a2b60b7419491112e130ca58f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd761de7e6add4f08a0ffadc7b91a6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:30.754505 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-114039bc-0685-4b96-a449-db91ed2d487a tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] 10.222.0.40 "GET /compute/v2.1/servers/83f99269-100f-4df8-9434-7330a9b6402d" status: 200 len: 1293 microversion: 2.1 time: 0.344491 Oct 26 13:34:30.758484 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2905/5840] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:34:30 2022] GET /compute/v2.1/servers/83f99269-100f-4df8-9434-7330a9b6402d => generated 1293 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:34:30.776548 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d0478270-1284-4a13-8202-0a67c8cec212 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:30.777674 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d0478270-1284-4a13-8202-0a67c8cec212 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] [instance: 4d2e95a1-588c-43ff-9af0-4d52676793b1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:30.802176 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d0478270-1284-4a13-8202-0a67c8cec212 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:30.802891 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d0478270-1284-4a13-8202-0a67c8cec212 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:30.805238 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d0478270-1284-4a13-8202-0a67c8cec212 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:30.806177 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d0478270-1284-4a13-8202-0a67c8cec212 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:30.812827 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d0478270-1284-4a13-8202-0a67c8cec212 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:30.814500 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d0478270-1284-4a13-8202-0a67c8cec212 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:30.891242 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d0478270-1284-4a13-8202-0a67c8cec212 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:30.893009 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d0478270-1284-4a13-8202-0a67c8cec212 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:30.897027 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d0478270-1284-4a13-8202-0a67c8cec212 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:30.897857 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-d0478270-1284-4a13-8202-0a67c8cec212 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lazy-loading 'fault' on Instance uuid 4d2e95a1-588c-43ff-9af0-4d52676793b1 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:34:30.984611 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d0478270-1284-4a13-8202-0a67c8cec212 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe198b313144b0f9089de1d0b62e8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb208abbe6784b7692cc1460fc60d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:30.993718 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d0478270-1284-4a13-8202-0a67c8cec212 tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] 10.222.0.40 "GET /compute/v2.1/servers/4d2e95a1-588c-43ff-9af0-4d52676793b1" status: 200 len: 1304 microversion: 2.1 time: 0.233732 Oct 26 13:34:30.996900 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2906/5841] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:34:30 2022] GET /compute/v2.1/servers/4d2e95a1-588c-43ff-9af0-4d52676793b1 => generated 1304 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:34:31.624931 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-423f3588-5dbd-4aeb-9f7b-1eb2ec48319b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:31.646030 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-423f3588-5dbd-4aeb-9f7b-1eb2ec48319b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:31.652291 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-423f3588-5dbd-4aeb-9f7b-1eb2ec48319b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:31.656741 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-423f3588-5dbd-4aeb-9f7b-1eb2ec48319b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1742 microversion: 2.20 time: 1.819383 Oct 26 13:34:31.671124 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2936/5842] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:34:29 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1742 bytes in 1835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:34:31.787480 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6e0dcbbd-70de-42ca-8719-e913d4414047 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:31.788820 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6e0dcbbd-70de-42ca-8719-e913d4414047 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] [instance: 83f99269-100f-4df8-9434-7330a9b6402d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:31.804593 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e0dcbbd-70de-42ca-8719-e913d4414047 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:31.806418 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e0dcbbd-70de-42ca-8719-e913d4414047 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:31.807111 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e0dcbbd-70de-42ca-8719-e913d4414047 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:31.808020 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e0dcbbd-70de-42ca-8719-e913d4414047 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:31.811979 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e0dcbbd-70de-42ca-8719-e913d4414047 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:31.814030 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e0dcbbd-70de-42ca-8719-e913d4414047 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:32.013794 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6e0dcbbd-70de-42ca-8719-e913d4414047 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03173a2b60b7419491112e130ca58f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd761de7e6add4f08a0ffadc7b91a6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:32.017368 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=76,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:34:32.024049 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c4276f7f-6d41-473e-9eae-ed5e8b99dbcc tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:32.025047 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c4276f7f-6d41-473e-9eae-ed5e8b99dbcc tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] [instance: 4d2e95a1-588c-43ff-9af0-4d52676793b1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:32.032043 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6e0dcbbd-70de-42ca-8719-e913d4414047 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] 10.222.0.40 "GET /compute/v2.1/servers/83f99269-100f-4df8-9434-7330a9b6402d" status: 200 len: 1281 microversion: 2.1 time: 0.249626 Oct 26 13:34:32.044177 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4276f7f-6d41-473e-9eae-ed5e8b99dbcc tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:32.045083 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4276f7f-6d41-473e-9eae-ed5e8b99dbcc tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:32.045787 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4276f7f-6d41-473e-9eae-ed5e8b99dbcc tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:32.046755 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4276f7f-6d41-473e-9eae-ed5e8b99dbcc tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:32.050029 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4276f7f-6d41-473e-9eae-ed5e8b99dbcc tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:32.050212 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2907/5843] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:34:31 2022] GET /compute/v2.1/servers/83f99269-100f-4df8-9434-7330a9b6402d => generated 1281 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:34:32.050953 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4276f7f-6d41-473e-9eae-ed5e8b99dbcc tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:32.062814 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:34:32.098178 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-c4276f7f-6d41-473e-9eae-ed5e8b99dbcc tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] HTTP exception thrown: Instance 4d2e95a1-588c-43ff-9af0-4d52676793b1 could not be found. Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c4276f7f-6d41-473e-9eae-ed5e8b99dbcc tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Request method failure captured: Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/4d2e95a1-588c-43ff-9af0-4d52676793b1 HTTP/1.1 Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTa0m1I8zdBevjkQARXnwOqoXZP-f9YZSkJT9Upa8ZxdhboLt4uIsTlLkIrpa5iorCHjApH0Fo5NsQQSriWAeOyVlgetEJ76ehcIreZiN43YUDRXS5_-PPno4VVapfZaECGzRftRQHlB1ebHmF9BYCcsKMnPSwwZ5Wm-anRTwJYi82c Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: fb208abbe6784b7692cc1460fc60d7e7 Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-VolumesBackupsTest-2079275577 Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fb208abbe6784b7692cc1460fc60d7e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fb208abbe6784b7692cc1460fc60d7e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fb208abbe6784b7692cc1460fc60d7e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fb208abbe6784b7692cc1460fc60d7e7"}]}] Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-VolumesBackupsTest-2079275577 Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: fb208abbe6784b7692cc1460fc60d7e7 Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-VolumesBackupsTest-2079275577 Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-VolumesBackupsTest-2079275577-project Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 2fe198b313144b0f9089de1d0b62e8e3 Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-VolumesBackupsTest-2079275577-project Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 4d2e95a1-588c-43ff-9af0-4d52676793b1 could not be found. Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '4d2e95a1-588c-43ff-9af0-4d52676793b1'} Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d2e95a1-588c-43ff-9af0-4d52676793b1 could not be found. Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d2e95a1-588c-43ff-9af0-4d52676793b1 could not be found. Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:34:32.103205 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:34:32.107701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:34:32.107701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:34:32.107701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:34:32.107701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:34:32.107701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:34:32.107701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d2e95a1-588c-43ff-9af0-4d52676793b1 could not be found. Oct 26 13:34:32.107701 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:34:32.111942 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c4276f7f-6d41-473e-9eae-ed5e8b99dbcc tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] Returning 404 to user: Instance 4d2e95a1-588c-43ff-9af0-4d52676793b1 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:34:32.113117 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c4276f7f-6d41-473e-9eae-ed5e8b99dbcc tempest-VolumesBackupsTest-2079275577 tempest-VolumesBackupsTest-2079275577-project] 10.222.0.40 "GET /compute/v2.1/servers/4d2e95a1-588c-43ff-9af0-4d52676793b1" status: 404 len: 111 microversion: 2.1 time: 0.094402 Oct 26 13:34:32.118418 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2937/5844] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:34:32 2022] GET /compute/v2.1/servers/4d2e95a1-588c-43ff-9af0-4d52676793b1 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:34:32.691216 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fa3229c0-9c4f-4113-89f1-3790abadad6e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:32.691755 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fa3229c0-9c4f-4113-89f1-3790abadad6e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:32.701205 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:34:32.707932 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa3229c0-9c4f-4113-89f1-3790abadad6e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:32.708458 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa3229c0-9c4f-4113-89f1-3790abadad6e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:32.708912 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa3229c0-9c4f-4113-89f1-3790abadad6e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:32.711636 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa3229c0-9c4f-4113-89f1-3790abadad6e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:32.714036 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa3229c0-9c4f-4113-89f1-3790abadad6e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:32.714529 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa3229c0-9c4f-4113-89f1-3790abadad6e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:33.064503 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9c7123b1-9077-49a9-a93b-8a3a8df73e3d tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:33.067459 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9c7123b1-9077-49a9-a93b-8a3a8df73e3d tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] [instance: 83f99269-100f-4df8-9434-7330a9b6402d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:33.078875 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:34:33.081840 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fa3229c0-9c4f-4113-89f1-3790abadad6e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:33.095555 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fa3229c0-9c4f-4113-89f1-3790abadad6e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:33.100153 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fa3229c0-9c4f-4113-89f1-3790abadad6e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:33.104925 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fa3229c0-9c4f-4113-89f1-3790abadad6e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1742 microversion: 2.20 time: 0.417923 Oct 26 13:34:33.106140 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2908/5845] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:34:32 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1742 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:34:33.121327 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c7123b1-9077-49a9-a93b-8a3a8df73e3d tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:33.140551 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c7123b1-9077-49a9-a93b-8a3a8df73e3d tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:33.141992 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c7123b1-9077-49a9-a93b-8a3a8df73e3d tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:33.144550 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c7123b1-9077-49a9-a93b-8a3a8df73e3d tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:33.147157 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c7123b1-9077-49a9-a93b-8a3a8df73e3d tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:33.148334 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c7123b1-9077-49a9-a93b-8a3a8df73e3d tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:33.362213 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9c7123b1-9077-49a9-a93b-8a3a8df73e3d tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03173a2b60b7419491112e130ca58f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd761de7e6add4f08a0ffadc7b91a6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:33.371816 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9c7123b1-9077-49a9-a93b-8a3a8df73e3d tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] 10.222.0.40 "GET /compute/v2.1/servers/83f99269-100f-4df8-9434-7330a9b6402d" status: 200 len: 1281 microversion: 2.1 time: 0.314934 Oct 26 13:34:33.376759 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2938/5846] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:34:33 2022] GET /compute/v2.1/servers/83f99269-100f-4df8-9434-7330a9b6402d => generated 1281 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:34:34.139131 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e027a0d9-f98f-4f79-8162-e1bd816f4542 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:34.139748 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e027a0d9-f98f-4f79-8162-e1bd816f4542 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:34.179449 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e027a0d9-f98f-4f79-8162-e1bd816f4542 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:34.184151 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e027a0d9-f98f-4f79-8162-e1bd816f4542 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:34.185002 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e027a0d9-f98f-4f79-8162-e1bd816f4542 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:34.193088 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e027a0d9-f98f-4f79-8162-e1bd816f4542 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:34.194643 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e027a0d9-f98f-4f79-8162-e1bd816f4542 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:34.197905 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e027a0d9-f98f-4f79-8162-e1bd816f4542 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:34.403717 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c0113030-d2c4-4b00-b34e-606c25449d9f tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:34.404541 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c0113030-d2c4-4b00-b34e-606c25449d9f tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] [instance: 83f99269-100f-4df8-9434-7330a9b6402d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:34.422354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0113030-d2c4-4b00-b34e-606c25449d9f tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:34.422738 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0113030-d2c4-4b00-b34e-606c25449d9f tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:34.423206 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0113030-d2c4-4b00-b34e-606c25449d9f tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:34.423930 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0113030-d2c4-4b00-b34e-606c25449d9f tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:34.424394 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0113030-d2c4-4b00-b34e-606c25449d9f tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:34.435309 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0113030-d2c4-4b00-b34e-606c25449d9f tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:35.300218 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e027a0d9-f98f-4f79-8162-e1bd816f4542 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:35.325804 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e027a0d9-f98f-4f79-8162-e1bd816f4542 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:35.327677 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e027a0d9-f98f-4f79-8162-e1bd816f4542 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:35.328927 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e027a0d9-f98f-4f79-8162-e1bd816f4542 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1742 microversion: 2.20 time: 1.193925 Oct 26 13:34:35.343306 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2909/5847] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:34:34 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1742 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:34:35.438535 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c0113030-d2c4-4b00-b34e-606c25449d9f tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03173a2b60b7419491112e130ca58f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd761de7e6add4f08a0ffadc7b91a6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:35.459011 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c0113030-d2c4-4b00-b34e-606c25449d9f tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] 10.222.0.40 "GET /compute/v2.1/servers/83f99269-100f-4df8-9434-7330a9b6402d" status: 200 len: 1323 microversion: 2.1 time: 1.057020 Oct 26 13:34:35.459773 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2939/5848] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:34:34 2022] GET /compute/v2.1/servers/83f99269-100f-4df8-9434-7330a9b6402d => generated 1323 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:34:36.359614 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a0a78b8d-4fd6-4119-8beb-1a68ea418887 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:36.360231 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a0a78b8d-4fd6-4119-8beb-1a68ea418887 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:36.364499 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:34:36.374763 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0a78b8d-4fd6-4119-8beb-1a68ea418887 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:36.386298 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0a78b8d-4fd6-4119-8beb-1a68ea418887 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:36.387023 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0a78b8d-4fd6-4119-8beb-1a68ea418887 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:36.387992 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0a78b8d-4fd6-4119-8beb-1a68ea418887 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:36.388625 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0a78b8d-4fd6-4119-8beb-1a68ea418887 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:36.389226 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0a78b8d-4fd6-4119-8beb-1a68ea418887 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:36.434090 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:34:36.490508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-55a3f450-d60a-4abc-8e44-47cf6ebf26d5 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:36.494022 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-55a3f450-d60a-4abc-8e44-47cf6ebf26d5 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] [instance: 83f99269-100f-4df8-9434-7330a9b6402d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:36.526918 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55a3f450-d60a-4abc-8e44-47cf6ebf26d5 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:36.527484 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55a3f450-d60a-4abc-8e44-47cf6ebf26d5 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:36.527945 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55a3f450-d60a-4abc-8e44-47cf6ebf26d5 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:36.528702 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55a3f450-d60a-4abc-8e44-47cf6ebf26d5 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:36.539975 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55a3f450-d60a-4abc-8e44-47cf6ebf26d5 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:36.542607 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55a3f450-d60a-4abc-8e44-47cf6ebf26d5 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:36.832211 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a0a78b8d-4fd6-4119-8beb-1a68ea418887 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:36.849507 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a0a78b8d-4fd6-4119-8beb-1a68ea418887 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:36.882369 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a0a78b8d-4fd6-4119-8beb-1a68ea418887 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:36.895688 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a0a78b8d-4fd6-4119-8beb-1a68ea418887 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1742 microversion: 2.20 time: 0.539862 Oct 26 13:34:36.896603 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2910/5849] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:34:36 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1742 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:34:37.619550 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-55a3f450-d60a-4abc-8e44-47cf6ebf26d5 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03173a2b60b7419491112e130ca58f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd761de7e6add4f08a0ffadc7b91a6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:37.633035 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-55a3f450-d60a-4abc-8e44-47cf6ebf26d5 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] 10.222.0.40 "GET /compute/v2.1/servers/83f99269-100f-4df8-9434-7330a9b6402d" status: 200 len: 1323 microversion: 2.1 time: 1.146005 Oct 26 13:34:37.633767 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2940/5850] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:34:36 2022] GET /compute/v2.1/servers/83f99269-100f-4df8-9434-7330a9b6402d => generated 1323 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:34:37.925942 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e41c9a8d-8c09-4b12-8916-aa0a3cafc36c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:37.926818 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e41c9a8d-8c09-4b12-8916-aa0a3cafc36c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:37.941121 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e41c9a8d-8c09-4b12-8916-aa0a3cafc36c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:37.942046 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e41c9a8d-8c09-4b12-8916-aa0a3cafc36c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:37.942763 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e41c9a8d-8c09-4b12-8916-aa0a3cafc36c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:37.944472 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e41c9a8d-8c09-4b12-8916-aa0a3cafc36c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:37.945308 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e41c9a8d-8c09-4b12-8916-aa0a3cafc36c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:37.946015 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e41c9a8d-8c09-4b12-8916-aa0a3cafc36c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:38.181261 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e41c9a8d-8c09-4b12-8916-aa0a3cafc36c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:38.196312 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e41c9a8d-8c09-4b12-8916-aa0a3cafc36c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:38.201230 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e41c9a8d-8c09-4b12-8916-aa0a3cafc36c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:38.204626 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e41c9a8d-8c09-4b12-8916-aa0a3cafc36c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1742 microversion: 2.20 time: 0.280946 Oct 26 13:34:38.209875 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2911/5851] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:34:37 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1742 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:34:38.549952 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:34:38.660468 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6626fef7-773b-4cde-9995-0ac8daa4213d tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:38.661014 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6626fef7-773b-4cde-9995-0ac8daa4213d tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] [instance: 83f99269-100f-4df8-9434-7330a9b6402d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:38.676296 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6626fef7-773b-4cde-9995-0ac8daa4213d tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:38.676808 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6626fef7-773b-4cde-9995-0ac8daa4213d tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:38.677261 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6626fef7-773b-4cde-9995-0ac8daa4213d tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:38.678014 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6626fef7-773b-4cde-9995-0ac8daa4213d tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:38.679045 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6626fef7-773b-4cde-9995-0ac8daa4213d tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:38.679485 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6626fef7-773b-4cde-9995-0ac8daa4213d tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:38.724646 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-b090c2cc-9bc4-40a7-9ed7-577b6cba69f8 req-ce19667c-c03e-4968-a872-67e9aa4289f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83f99269-100f-4df8-9434-7330a9b6402d", "tag": "d767b28f-8307-4142-a5e5-ae28db81549e"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:34:38.755666 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b090c2cc-9bc4-40a7-9ed7-577b6cba69f8 req-ce19667c-c03e-4968-a872-67e9aa4289f5 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:38.760050 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b090c2cc-9bc4-40a7-9ed7-577b6cba69f8 req-ce19667c-c03e-4968-a872-67e9aa4289f5 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:38.760527 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b090c2cc-9bc4-40a7-9ed7-577b6cba69f8 req-ce19667c-c03e-4968-a872-67e9aa4289f5 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:38.806552 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-b090c2cc-9bc4-40a7-9ed7-577b6cba69f8 req-ce19667c-c03e-4968-a872-67e9aa4289f5 service nova] Creating event network-changed:d767b28f-8307-4142-a5e5-ae28db81549e for instance 83f99269-100f-4df8-9434-7330a9b6402d on n-h1-862686-1 Oct 26 13:34:38.812638 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-b090c2cc-9bc4-40a7-9ed7-577b6cba69f8 req-ce19667c-c03e-4968-a872-67e9aa4289f5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.268359 Oct 26 13:34:38.816679 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2941/5852] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:34:39.234329 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-37fa07b3-e88d-41e1-8ddf-4b17a3ef4e9f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:39.236220 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-37fa07b3-e88d-41e1-8ddf-4b17a3ef4e9f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:39.284699 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-37fa07b3-e88d-41e1-8ddf-4b17a3ef4e9f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:39.285255 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-37fa07b3-e88d-41e1-8ddf-4b17a3ef4e9f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:39.288300 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-37fa07b3-e88d-41e1-8ddf-4b17a3ef4e9f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:39.294039 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-37fa07b3-e88d-41e1-8ddf-4b17a3ef4e9f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:39.297291 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-37fa07b3-e88d-41e1-8ddf-4b17a3ef4e9f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:39.302407 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-37fa07b3-e88d-41e1-8ddf-4b17a3ef4e9f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:39.660469 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6626fef7-773b-4cde-9995-0ac8daa4213d tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03173a2b60b7419491112e130ca58f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd761de7e6add4f08a0ffadc7b91a6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:39.675909 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6626fef7-773b-4cde-9995-0ac8daa4213d tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] 10.222.0.40 "GET /compute/v2.1/servers/83f99269-100f-4df8-9434-7330a9b6402d" status: 200 len: 1323 microversion: 2.1 time: 1.020642 Oct 26 13:34:39.707967 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2912/5853] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:34:38 2022] GET /compute/v2.1/servers/83f99269-100f-4df8-9434-7330a9b6402d => generated 1323 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:34:39.892400 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-37fa07b3-e88d-41e1-8ddf-4b17a3ef4e9f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:39.913715 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-37fa07b3-e88d-41e1-8ddf-4b17a3ef4e9f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:39.918422 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-37fa07b3-e88d-41e1-8ddf-4b17a3ef4e9f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:39.919939 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-37fa07b3-e88d-41e1-8ddf-4b17a3ef4e9f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1742 microversion: 2.20 time: 0.691671 Oct 26 13:34:39.922783 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2942/5854] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:34:39 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1742 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:34:40.732474 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-13039c1b-269e-4066-9961-0fa229038b0c tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:40.733088 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-13039c1b-269e-4066-9961-0fa229038b0c tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] [instance: 83f99269-100f-4df8-9434-7330a9b6402d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:40.754692 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-13039c1b-269e-4066-9961-0fa229038b0c tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:40.755480 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-13039c1b-269e-4066-9961-0fa229038b0c tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:40.757002 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-13039c1b-269e-4066-9961-0fa229038b0c tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:40.759777 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-13039c1b-269e-4066-9961-0fa229038b0c tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:40.770356 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-13039c1b-269e-4066-9961-0fa229038b0c tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:40.772804 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-13039c1b-269e-4066-9961-0fa229038b0c tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:40.953618 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6d22fe0f-462e-47c7-b028-694277434286 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:40.954489 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6d22fe0f-462e-47c7-b028-694277434286 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:40.974177 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d22fe0f-462e-47c7-b028-694277434286 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:40.974672 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d22fe0f-462e-47c7-b028-694277434286 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:40.975652 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d22fe0f-462e-47c7-b028-694277434286 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:40.976382 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d22fe0f-462e-47c7-b028-694277434286 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:40.976847 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d22fe0f-462e-47c7-b028-694277434286 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:40.977281 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d22fe0f-462e-47c7-b028-694277434286 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:41.401198 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6d22fe0f-462e-47c7-b028-694277434286 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:41.414594 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6d22fe0f-462e-47c7-b028-694277434286 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:41.417299 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6d22fe0f-462e-47c7-b028-694277434286 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:41.419537 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6d22fe0f-462e-47c7-b028-694277434286 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1742 microversion: 2.20 time: 0.469745 Oct 26 13:34:41.420692 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2943/5855] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:34:40 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1742 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:34:42.111607 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-13039c1b-269e-4066-9961-0fa229038b0c tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03173a2b60b7419491112e130ca58f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd761de7e6add4f08a0ffadc7b91a6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:42.121953 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-13039c1b-269e-4066-9961-0fa229038b0c tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] 10.222.0.40 "GET /compute/v2.1/servers/83f99269-100f-4df8-9434-7330a9b6402d" status: 200 len: 1323 microversion: 2.1 time: 1.393249 Oct 26 13:34:42.132395 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2913/5856] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:34:40 2022] GET /compute/v2.1/servers/83f99269-100f-4df8-9434-7330a9b6402d => generated 1323 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:34:42.453465 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-50ab4902-ff1b-44a1-8c5d-69f7f0b91c22 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:42.454165 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-50ab4902-ff1b-44a1-8c5d-69f7f0b91c22 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:42.468661 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50ab4902-ff1b-44a1-8c5d-69f7f0b91c22 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:42.469563 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50ab4902-ff1b-44a1-8c5d-69f7f0b91c22 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:42.472075 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50ab4902-ff1b-44a1-8c5d-69f7f0b91c22 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:42.473793 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50ab4902-ff1b-44a1-8c5d-69f7f0b91c22 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:42.475648 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50ab4902-ff1b-44a1-8c5d-69f7f0b91c22 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:42.476312 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50ab4902-ff1b-44a1-8c5d-69f7f0b91c22 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:43.158762 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-47f71900-faae-4874-b520-0fdc5f2adb52 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:43.159780 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-47f71900-faae-4874-b520-0fdc5f2adb52 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] [instance: 83f99269-100f-4df8-9434-7330a9b6402d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:43.171344 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-47f71900-faae-4874-b520-0fdc5f2adb52 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:43.173611 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-47f71900-faae-4874-b520-0fdc5f2adb52 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:43.174078 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-47f71900-faae-4874-b520-0fdc5f2adb52 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:43.174814 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-47f71900-faae-4874-b520-0fdc5f2adb52 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:43.175284 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-47f71900-faae-4874-b520-0fdc5f2adb52 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:43.175720 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-47f71900-faae-4874-b520-0fdc5f2adb52 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:43.308585 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-50ab4902-ff1b-44a1-8c5d-69f7f0b91c22 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:43.335341 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-50ab4902-ff1b-44a1-8c5d-69f7f0b91c22 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:43.337082 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-50ab4902-ff1b-44a1-8c5d-69f7f0b91c22 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:43.339049 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-50ab4902-ff1b-44a1-8c5d-69f7f0b91c22 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1742 microversion: 2.20 time: 0.891490 Oct 26 13:34:43.341897 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2944/5857] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:34:42 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1742 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:34:43.581204 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-47f71900-faae-4874-b520-0fdc5f2adb52 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03173a2b60b7419491112e130ca58f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd761de7e6add4f08a0ffadc7b91a6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:43.592656 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-47f71900-faae-4874-b520-0fdc5f2adb52 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] 10.222.0.40 "GET /compute/v2.1/servers/83f99269-100f-4df8-9434-7330a9b6402d" status: 200 len: 1323 microversion: 2.1 time: 0.437217 Oct 26 13:34:43.601964 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2914/5858] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:34:43 2022] GET /compute/v2.1/servers/83f99269-100f-4df8-9434-7330a9b6402d => generated 1323 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:34:44.372660 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6379cd2c-d012-4911-b5a1-b131cad11d9b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:44.373290 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6379cd2c-d012-4911-b5a1-b131cad11d9b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:44.401019 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6379cd2c-d012-4911-b5a1-b131cad11d9b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:44.401848 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6379cd2c-d012-4911-b5a1-b131cad11d9b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:44.402393 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6379cd2c-d012-4911-b5a1-b131cad11d9b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:44.405292 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6379cd2c-d012-4911-b5a1-b131cad11d9b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:44.406004 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6379cd2c-d012-4911-b5a1-b131cad11d9b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:44.406646 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6379cd2c-d012-4911-b5a1-b131cad11d9b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:44.619435 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-0c31473a-3458-45a9-b54b-2fd4e7804a16 req-9ae14d77-45ea-4d14-a1d9-f80d5e1aba45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83f99269-100f-4df8-9434-7330a9b6402d", "name": "network-vif-plugged", "status": "completed", "tag": "d767b28f-8307-4142-a5e5-ae28db81549e"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:34:44.656101 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-0c31473a-3458-45a9-b54b-2fd4e7804a16 req-9ae14d77-45ea-4d14-a1d9-f80d5e1aba45 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:44.656616 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-0c31473a-3458-45a9-b54b-2fd4e7804a16 req-9ae14d77-45ea-4d14-a1d9-f80d5e1aba45 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:44.660270 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-0c31473a-3458-45a9-b54b-2fd4e7804a16 req-9ae14d77-45ea-4d14-a1d9-f80d5e1aba45 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:44.705370 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-0c31473a-3458-45a9-b54b-2fd4e7804a16 req-9ae14d77-45ea-4d14-a1d9-f80d5e1aba45 service nova] Creating event network-vif-plugged:d767b28f-8307-4142-a5e5-ae28db81549e for instance 83f99269-100f-4df8-9434-7330a9b6402d on n-h1-862686-1 Oct 26 13:34:44.721469 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-0c31473a-3458-45a9-b54b-2fd4e7804a16 req-9ae14d77-45ea-4d14-a1d9-f80d5e1aba45 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104407 Oct 26 13:34:44.722169 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2915/5859] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:34:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:34:44.755255 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bf2383b0-1f6a-4bf4-bdc9-c852c9a7ff13 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:44.762526 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bf2383b0-1f6a-4bf4-bdc9-c852c9a7ff13 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] [instance: 83f99269-100f-4df8-9434-7330a9b6402d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:44.774567 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6379cd2c-d012-4911-b5a1-b131cad11d9b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:44.829609 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6379cd2c-d012-4911-b5a1-b131cad11d9b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:44.834396 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6379cd2c-d012-4911-b5a1-b131cad11d9b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:44.836186 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6379cd2c-d012-4911-b5a1-b131cad11d9b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1742 microversion: 2.20 time: 0.468109 Oct 26 13:34:44.836733 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2945/5860] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:34:44 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1742 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:34:44.839247 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf2383b0-1f6a-4bf4-bdc9-c852c9a7ff13 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:44.841375 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf2383b0-1f6a-4bf4-bdc9-c852c9a7ff13 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:44.842057 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf2383b0-1f6a-4bf4-bdc9-c852c9a7ff13 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:44.845931 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf2383b0-1f6a-4bf4-bdc9-c852c9a7ff13 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:44.847982 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf2383b0-1f6a-4bf4-bdc9-c852c9a7ff13 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:44.848596 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf2383b0-1f6a-4bf4-bdc9-c852c9a7ff13 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:45.698148 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bf2383b0-1f6a-4bf4-bdc9-c852c9a7ff13 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03173a2b60b7419491112e130ca58f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd761de7e6add4f08a0ffadc7b91a6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:45.714635 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bf2383b0-1f6a-4bf4-bdc9-c852c9a7ff13 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] 10.222.0.40 "GET /compute/v2.1/servers/83f99269-100f-4df8-9434-7330a9b6402d" status: 200 len: 1323 microversion: 2.1 time: 0.987746 Oct 26 13:34:45.715864 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2916/5861] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:34:44 2022] GET /compute/v2.1/servers/83f99269-100f-4df8-9434-7330a9b6402d => generated 1323 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:34:45.862991 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a855a8f9-7f1b-4773-96cf-6ccb50f8c7d4 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:45.863925 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a855a8f9-7f1b-4773-96cf-6ccb50f8c7d4 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:45.896404 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a855a8f9-7f1b-4773-96cf-6ccb50f8c7d4 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:45.897454 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a855a8f9-7f1b-4773-96cf-6ccb50f8c7d4 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:45.897935 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a855a8f9-7f1b-4773-96cf-6ccb50f8c7d4 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:45.898677 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a855a8f9-7f1b-4773-96cf-6ccb50f8c7d4 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:45.899148 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a855a8f9-7f1b-4773-96cf-6ccb50f8c7d4 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:45.916980 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a855a8f9-7f1b-4773-96cf-6ccb50f8c7d4 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:46.278824 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a855a8f9-7f1b-4773-96cf-6ccb50f8c7d4 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:46.292095 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a855a8f9-7f1b-4773-96cf-6ccb50f8c7d4 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:46.296851 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a855a8f9-7f1b-4773-96cf-6ccb50f8c7d4 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:46.302604 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a855a8f9-7f1b-4773-96cf-6ccb50f8c7d4 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1742 microversion: 2.20 time: 0.444383 Oct 26 13:34:46.311609 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2946/5862] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:34:45 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1742 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:34:46.743283 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5c12464f-8602-40d5-8b66-547d05bd724f tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:46.744568 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5c12464f-8602-40d5-8b66-547d05bd724f tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] [instance: 83f99269-100f-4df8-9434-7330a9b6402d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:46.756771 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c12464f-8602-40d5-8b66-547d05bd724f tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:46.766376 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c12464f-8602-40d5-8b66-547d05bd724f tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:46.772799 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c12464f-8602-40d5-8b66-547d05bd724f tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:46.776576 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c12464f-8602-40d5-8b66-547d05bd724f tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:46.777284 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c12464f-8602-40d5-8b66-547d05bd724f tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:46.777999 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c12464f-8602-40d5-8b66-547d05bd724f tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:47.336945 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f2dc0a1a-cd92-429a-a0ca-101c3fcfefda tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:47.340050 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f2dc0a1a-cd92-429a-a0ca-101c3fcfefda tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:47.358330 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f2dc0a1a-cd92-429a-a0ca-101c3fcfefda tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:47.359209 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f2dc0a1a-cd92-429a-a0ca-101c3fcfefda tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:47.361789 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f2dc0a1a-cd92-429a-a0ca-101c3fcfefda tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:47.364041 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f2dc0a1a-cd92-429a-a0ca-101c3fcfefda tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:47.364946 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f2dc0a1a-cd92-429a-a0ca-101c3fcfefda tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:47.367994 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f2dc0a1a-cd92-429a-a0ca-101c3fcfefda tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:47.962004 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f2dc0a1a-cd92-429a-a0ca-101c3fcfefda tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:47.989475 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f2dc0a1a-cd92-429a-a0ca-101c3fcfefda tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:48.002093 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f2dc0a1a-cd92-429a-a0ca-101c3fcfefda tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:48.009142 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f2dc0a1a-cd92-429a-a0ca-101c3fcfefda tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1742 microversion: 2.20 time: 0.676727 Oct 26 13:34:48.032966 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2947/5863] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:34:47 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1742 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:34:48.043352 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5c12464f-8602-40d5-8b66-547d05bd724f tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03173a2b60b7419491112e130ca58f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd761de7e6add4f08a0ffadc7b91a6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:48.052134 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5c12464f-8602-40d5-8b66-547d05bd724f tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] 10.222.0.40 "GET /compute/v2.1/servers/83f99269-100f-4df8-9434-7330a9b6402d" status: 200 len: 1323 microversion: 2.1 time: 1.313483 Oct 26 13:34:48.080167 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2917/5864] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:34:46 2022] GET /compute/v2.1/servers/83f99269-100f-4df8-9434-7330a9b6402d => generated 1323 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:34:49.071558 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8cb582ad-c218-4d4c-a4da-a3b11be859be tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:49.072908 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8cb582ad-c218-4d4c-a4da-a3b11be859be tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:49.108075 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9af6d4e8-48fd-42c4-b0fc-2313ee69b824 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:49.109451 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9af6d4e8-48fd-42c4-b0fc-2313ee69b824 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] [instance: 83f99269-100f-4df8-9434-7330a9b6402d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:49.124669 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8cb582ad-c218-4d4c-a4da-a3b11be859be tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:49.127265 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8cb582ad-c218-4d4c-a4da-a3b11be859be tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:49.129565 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9af6d4e8-48fd-42c4-b0fc-2313ee69b824 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:49.133209 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8cb582ad-c218-4d4c-a4da-a3b11be859be tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:49.136784 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9af6d4e8-48fd-42c4-b0fc-2313ee69b824 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:49.138292 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8cb582ad-c218-4d4c-a4da-a3b11be859be tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:49.141005 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8cb582ad-c218-4d4c-a4da-a3b11be859be tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:49.142020 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9af6d4e8-48fd-42c4-b0fc-2313ee69b824 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:49.143739 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9af6d4e8-48fd-42c4-b0fc-2313ee69b824 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:49.144410 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8cb582ad-c218-4d4c-a4da-a3b11be859be tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:49.148972 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9af6d4e8-48fd-42c4-b0fc-2313ee69b824 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:49.151105 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9af6d4e8-48fd-42c4-b0fc-2313ee69b824 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:49.903496 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8cb582ad-c218-4d4c-a4da-a3b11be859be tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:49.932637 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8cb582ad-c218-4d4c-a4da-a3b11be859be tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:49.936311 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8cb582ad-c218-4d4c-a4da-a3b11be859be tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:49.939316 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8cb582ad-c218-4d4c-a4da-a3b11be859be tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1742 microversion: 2.20 time: 0.892282 Oct 26 13:34:49.941319 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2948/5865] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:34:49 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1742 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:34:50.202652 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9af6d4e8-48fd-42c4-b0fc-2313ee69b824 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03173a2b60b7419491112e130ca58f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd761de7e6add4f08a0ffadc7b91a6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:50.214579 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9af6d4e8-48fd-42c4-b0fc-2313ee69b824 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] 10.222.0.40 "GET /compute/v2.1/servers/83f99269-100f-4df8-9434-7330a9b6402d" status: 200 len: 1519 microversion: 2.1 time: 1.111946 Oct 26 13:34:50.218851 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2918/5866] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:34:49 2022] GET /compute/v2.1/servers/83f99269-100f-4df8-9434-7330a9b6402d => generated 1519 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:34:50.550793 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ab069baa-fd3d-47bc-a15a-422c54151922 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-119386395", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "6ef6bcd4-6b51-40a3-aaa8-fc41f6ccf6b5"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ab069baa-fd3d-47bc-a15a-422c54151922 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Request method failure captured: Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 242 Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTdg72D4g2VDVLzSVbWXwJjrR4L1pXnJss6P21cduWzM00kDT7qyqmSqI388a7aylDEFw1eF3tpLIyySFkHHi4tW0GZ_ZCNzQcA-lbl-_lKzg3TNhLT3UI7cuDN_JUwEgGr0_gFzg2uUEjh0lInHFkjS8vHq9VsPxtwWuJKaifD4UxU Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: d761de7e6add4f08a0ffadc7b91a6a40 Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-425983124 Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d761de7e6add4f08a0ffadc7b91a6a40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d761de7e6add4f08a0ffadc7b91a6a40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d761de7e6add4f08a0ffadc7b91a6a40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d761de7e6add4f08a0ffadc7b91a6a40"}]}] Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-425983124 Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: d761de7e6add4f08a0ffadc7b91a6a40 Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-425983124 Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServerMetadataNegativeTestJSON-425983124-project Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 03173a2b60b7419491112e130ca58f37 Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-425983124-project Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-119386395", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "6ef6bcd4-6b51-40a3-aaa8-fc41f6ccf6b5"}]}} Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-119386395', 'imageRef': '762c20f4-0f9b-45cb-bd95-cf21a747b33b', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '6ef6bcd4-6b51-40a3-aaa8-fc41f6ccf6b5'}]}}} Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise error Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:34:50.557096 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:34:50.561872 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 13:34:50.561872 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 13:34:50.561872 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 13:34:50.561872 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 13:34:50.561872 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 13:34:50.561872 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 13:34:50.561872 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 13:34:50.561872 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:34:50.561872 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:34:50.561872 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:34:50.561872 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:34:50.561872 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:34:50.561872 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:34:50.561872 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 13:34:50.561872 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 13:34:50.561872 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 13:34:50.561872 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:34:50.575399 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ab069baa-fd3d-47bc-a15a-422c54151922 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:34:50.581431 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ab069baa-fd3d-47bc-a15a-422c54151922 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.032804 Oct 26 13:34:50.585544 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2949/5867] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:34:50 2022] POST /compute/v2.1/servers => generated 175 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:34:50.600944 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fe13f19c-c207-4a13-a616-5c3911e91f10 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:50.601750 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fe13f19c-c207-4a13-a616-5c3911e91f10 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] [instance: b446e1e4-0c0d-4a39-a31d-3171a14fcca8] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:50.609454 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-fe13f19c-c207-4a13-a616-5c3911e91f10 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] HTTP exception thrown: Instance b446e1e4-0c0d-4a39-a31d-3171a14fcca8 could not be found. Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fe13f19c-c207-4a13-a616-5c3911e91f10 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Request method failure captured: Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/b446e1e4-0c0d-4a39-a31d-3171a14fcca8/metadata HTTP/1.1 Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTdg72D4g2VDVLzSVbWXwJjrR4L1pXnJss6P21cduWzM00kDT7qyqmSqI388a7aylDEFw1eF3tpLIyySFkHHi4tW0GZ_ZCNzQcA-lbl-_lKzg3TNhLT3UI7cuDN_JUwEgGr0_gFzg2uUEjh0lInHFkjS8vHq9VsPxtwWuJKaifD4UxU Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: d761de7e6add4f08a0ffadc7b91a6a40 Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-425983124 Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d761de7e6add4f08a0ffadc7b91a6a40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d761de7e6add4f08a0ffadc7b91a6a40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d761de7e6add4f08a0ffadc7b91a6a40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d761de7e6add4f08a0ffadc7b91a6a40"}]}] Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-425983124 Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: d761de7e6add4f08a0ffadc7b91a6a40 Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-425983124 Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServerMetadataNegativeTestJSON-425983124-project Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 03173a2b60b7419491112e130ca58f37 Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-425983124-project Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance b446e1e4-0c0d-4a39-a31d-3171a14fcca8 could not be found. Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'server_id': 'b446e1e4-0c0d-4a39-a31d-3171a14fcca8'} Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b446e1e4-0c0d-4a39-a31d-3171a14fcca8 could not be found. Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b446e1e4-0c0d-4a39-a31d-3171a14fcca8 could not be found. Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:34:50.625154 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:34:50.629435 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:34:50.629435 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:34:50.629435 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b446e1e4-0c0d-4a39-a31d-3171a14fcca8 could not be found. Oct 26 13:34:50.629435 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:34:50.629435 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fe13f19c-c207-4a13-a616-5c3911e91f10 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Returning 404 to user: Instance b446e1e4-0c0d-4a39-a31d-3171a14fcca8 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:34:50.629435 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fe13f19c-c207-4a13-a616-5c3911e91f10 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] 10.222.0.40 "GET /compute/v2.1/servers/b446e1e4-0c0d-4a39-a31d-3171a14fcca8/metadata" status: 404 len: 111 microversion: 2.1 time: 0.031828 Oct 26 13:34:50.629435 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2919/5868] 10.222.0.40 () {58 vars in 1263 bytes} [Wed Oct 26 13:34:50 2022] GET /compute/v2.1/servers/b446e1e4-0c0d-4a39-a31d-3171a14fcca8/metadata => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:34:50.750857 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1cca5b06-3bd5-4306-8c28-6afb2dcbc102 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-336255691", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6ef6bcd4-6b51-40a3-aaa8-fc41f6ccf6b5"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:34:50.757734 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1cca5b06-3bd5-4306-8c28-6afb2dcbc102 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Request method failure captured: Oct 26 13:34:50.757734 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 13:34:50.757734 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:34:50.757734 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:34:50.757734 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:34:50.757734 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 498 Oct 26 13:34:50.757734 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:34:50.757734 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:34:50.757734 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:34:50.757734 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:34:50.757734 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTdg72D4g2VDVLzSVbWXwJjrR4L1pXnJss6P21cduWzM00kDT7qyqmSqI388a7aylDEFw1eF3tpLIyySFkHHi4tW0GZ_ZCNzQcA-lbl-_lKzg3TNhLT3UI7cuDN_JUwEgGr0_gFzg2uUEjh0lInHFkjS8vHq9VsPxtwWuJKaifD4UxU Oct 26 13:34:50.757734 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:34:50.757734 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:34:50.757734 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:34:50.757734 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:34:50.757734 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:34:50.757734 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:34:50.757734 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: d761de7e6add4f08a0ffadc7b91a6a40 Oct 26 13:34:50.757734 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-425983124 Oct 26 13:34:50.757734 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:34:50.757734 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:34:50.757734 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d761de7e6add4f08a0ffadc7b91a6a40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d761de7e6add4f08a0ffadc7b91a6a40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d761de7e6add4f08a0ffadc7b91a6a40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d761de7e6add4f08a0ffadc7b91a6a40"}]}] Oct 26 13:34:50.757734 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-425983124 Oct 26 13:34:50.757734 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: d761de7e6add4f08a0ffadc7b91a6a40 Oct 26 13:34:50.757734 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-425983124 Oct 26 13:34:50.757734 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServerMetadataNegativeTestJSON-425983124-project Oct 26 13:34:50.757734 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:34:50.757734 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:34:50.757734 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 03173a2b60b7419491112e130ca58f37 Oct 26 13:34:50.757734 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-425983124-project Oct 26 13:34:50.757734 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:34:50.757734 n-d-862686-1 devstack@n-api.service[120598]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-336255691", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6ef6bcd4-6b51-40a3-aaa8-fc41f6ccf6b5"}]}} Oct 26 13:34:50.757734 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:34:50.757734 n-d-862686-1 devstack@n-api.service[120598]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 13:34:50.757734 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-336255691', 'imageRef': '762c20f4-0f9b-45cb-bd95-cf21a747b33b', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '6ef6bcd4-6b51-40a3-aaa8-fc41f6ccf6b5'}]}}} Oct 26 13:34:50.757734 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:34:50.757734 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:34:50.757734 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 13:34:50.757734 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 13:34:50.757734 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 13:34:50.757734 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise error Oct 26 13:34:50.757734 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 13:34:50.757734 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:34:50.757734 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 26 13:34:50.757734 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 26 13:34:50.757734 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 26 13:34:50.757734 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 26 13:34:50.769465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 26 13:34:50.769465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:34:50.769465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 26 13:34:50.769465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 26 13:34:50.769465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:34:50.769465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:34:50.769465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:34:50.769465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:34:50.769465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:34:50.769465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:34:50.769465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:34:50.769465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:34:50.769465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:34:50.769465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:34:50.769465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:34:50.769465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:34:50.769465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 13:34:50.769465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 13:34:50.769465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 13:34:50.769465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 13:34:50.769465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 13:34:50.769465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 13:34:50.769465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 13:34:50.769465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:34:50.769465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:34:50.769465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:34:50.769465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:34:50.769465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:34:50.769465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:34:50.769465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 13:34:50.769465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 13:34:50.769465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 13:34:50.769465 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:34:50.769465 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1cca5b06-3bd5-4306-8c28-6afb2dcbc102 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:34:50.769465 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1cca5b06-3bd5-4306-8c28-6afb2dcbc102 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.012782 Oct 26 13:34:50.774773 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2950/5869] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:34:50 2022] POST /compute/v2.1/servers => generated 687 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:34:50.872554 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c55c6b88-1c56-49cc-9ba9-fd600dcdce1c tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1081914247", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6ef6bcd4-6b51-40a3-aaa8-fc41f6ccf6b5"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:34:50.877578 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c55c6b88-1c56-49cc-9ba9-fd600dcdce1c tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Request method failure captured: Oct 26 13:34:50.877578 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 13:34:50.877578 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:34:50.877578 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:34:50.877578 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:34:50.877578 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 500 Oct 26 13:34:50.877578 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:34:50.877578 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:34:50.877578 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:34:50.877578 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:34:50.877578 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTdg72D4g2VDVLzSVbWXwJjrR4L1pXnJss6P21cduWzM00kDT7qyqmSqI388a7aylDEFw1eF3tpLIyySFkHHi4tW0GZ_ZCNzQcA-lbl-_lKzg3TNhLT3UI7cuDN_JUwEgGr0_gFzg2uUEjh0lInHFkjS8vHq9VsPxtwWuJKaifD4UxU Oct 26 13:34:50.877578 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:34:50.877578 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:34:50.877578 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:34:50.877578 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:34:50.877578 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:34:50.877578 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:34:50.877578 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: d761de7e6add4f08a0ffadc7b91a6a40 Oct 26 13:34:50.877578 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-425983124 Oct 26 13:34:50.877578 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:34:50.877578 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:34:50.877578 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d761de7e6add4f08a0ffadc7b91a6a40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d761de7e6add4f08a0ffadc7b91a6a40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d761de7e6add4f08a0ffadc7b91a6a40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d761de7e6add4f08a0ffadc7b91a6a40"}]}] Oct 26 13:34:50.877578 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-425983124 Oct 26 13:34:50.877578 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: d761de7e6add4f08a0ffadc7b91a6a40 Oct 26 13:34:50.877578 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-425983124 Oct 26 13:34:50.877578 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServerMetadataNegativeTestJSON-425983124-project Oct 26 13:34:50.877578 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:34:50.877578 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:34:50.877578 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 03173a2b60b7419491112e130ca58f37 Oct 26 13:34:50.877578 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-425983124-project Oct 26 13:34:50.877578 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:34:50.877578 n-d-862686-1 devstack@n-api.service[120597]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1081914247", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6ef6bcd4-6b51-40a3-aaa8-fc41f6ccf6b5"}]}} Oct 26 13:34:50.877578 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:34:50.877578 n-d-862686-1 devstack@n-api.service[120597]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 13:34:50.877578 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1081914247', 'imageRef': '762c20f4-0f9b-45cb-bd95-cf21a747b33b', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '6ef6bcd4-6b51-40a3-aaa8-fc41f6ccf6b5'}]}}} Oct 26 13:34:50.877578 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:34:50.877578 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:34:50.877578 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 13:34:50.877578 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 13:34:50.877578 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 13:34:50.877578 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise error Oct 26 13:34:50.877578 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 13:34:50.877578 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:34:50.877578 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 26 13:34:50.877578 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 26 13:34:50.877578 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 26 13:34:50.877578 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 26 13:34:50.880656 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 26 13:34:50.880656 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:34:50.880656 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 26 13:34:50.880656 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 26 13:34:50.880656 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:34:50.880656 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:34:50.880656 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:34:50.880656 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:34:50.880656 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:34:50.880656 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:34:50.880656 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:34:50.880656 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:34:50.880656 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:34:50.880656 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:34:50.880656 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:34:50.880656 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:34:50.880656 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 13:34:50.880656 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 13:34:50.880656 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 13:34:50.880656 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 13:34:50.880656 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 13:34:50.880656 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 13:34:50.880656 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 13:34:50.880656 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:34:50.880656 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:34:50.880656 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:34:50.880656 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:34:50.880656 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:34:50.880656 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:34:50.880656 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 13:34:50.880656 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 13:34:50.880656 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 13:34:50.880656 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:34:50.886043 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c55c6b88-1c56-49cc-9ba9-fd600dcdce1c tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:34:50.886043 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c55c6b88-1c56-49cc-9ba9-fd600dcdce1c tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.016941 Oct 26 13:34:50.904782 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2920/5870] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:34:50 2022] POST /compute/v2.1/servers => generated 689 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:34:50.972472 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-678754f2-3faa-41b9-ba43-fb17e3258caf tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:50.975429 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-678754f2-3faa-41b9-ba43-fb17e3258caf tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:51.001697 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-678754f2-3faa-41b9-ba43-fb17e3258caf tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:51.002266 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-678754f2-3faa-41b9-ba43-fb17e3258caf tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:51.002721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-678754f2-3faa-41b9-ba43-fb17e3258caf tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:51.003773 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-678754f2-3faa-41b9-ba43-fb17e3258caf tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:51.009274 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-678754f2-3faa-41b9-ba43-fb17e3258caf tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:51.010281 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-678754f2-3faa-41b9-ba43-fb17e3258caf tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:51.027719 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a5b39aff-ba32-4d4c-9032-243fc7cc57e9 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-142587083", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6ef6bcd4-6b51-40a3-aaa8-fc41f6ccf6b5"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:34:51.042361 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a5b39aff-ba32-4d4c-9032-243fc7cc57e9 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Request method failure captured: Oct 26 13:34:51.042361 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 13:34:51.042361 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:34:51.042361 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:34:51.042361 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:34:51.042361 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 753 Oct 26 13:34:51.042361 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:34:51.042361 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:34:51.042361 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:34:51.042361 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:34:51.042361 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTdg72D4g2VDVLzSVbWXwJjrR4L1pXnJss6P21cduWzM00kDT7qyqmSqI388a7aylDEFw1eF3tpLIyySFkHHi4tW0GZ_ZCNzQcA-lbl-_lKzg3TNhLT3UI7cuDN_JUwEgGr0_gFzg2uUEjh0lInHFkjS8vHq9VsPxtwWuJKaifD4UxU Oct 26 13:34:51.042361 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:34:51.042361 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:34:51.042361 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:34:51.042361 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:34:51.042361 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:34:51.042361 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:34:51.042361 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: d761de7e6add4f08a0ffadc7b91a6a40 Oct 26 13:34:51.042361 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-425983124 Oct 26 13:34:51.042361 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:34:51.042361 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:34:51.042361 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d761de7e6add4f08a0ffadc7b91a6a40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d761de7e6add4f08a0ffadc7b91a6a40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d761de7e6add4f08a0ffadc7b91a6a40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d761de7e6add4f08a0ffadc7b91a6a40"}]}] Oct 26 13:34:51.042361 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-425983124 Oct 26 13:34:51.042361 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: d761de7e6add4f08a0ffadc7b91a6a40 Oct 26 13:34:51.042361 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-425983124 Oct 26 13:34:51.042361 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServerMetadataNegativeTestJSON-425983124-project Oct 26 13:34:51.042361 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:34:51.042361 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:34:51.042361 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 03173a2b60b7419491112e130ca58f37 Oct 26 13:34:51.042361 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-425983124-project Oct 26 13:34:51.042361 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:34:51.042361 n-d-862686-1 devstack@n-api.service[120597]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-142587083", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6ef6bcd4-6b51-40a3-aaa8-fc41f6ccf6b5"}]}} Oct 26 13:34:51.042361 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:34:51.042361 n-d-862686-1 devstack@n-api.service[120597]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 13:34:51.042361 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-142587083', 'imageRef': '762c20f4-0f9b-45cb-bd95-cf21a747b33b', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '6ef6bcd4-6b51-40a3-aaa8-fc41f6ccf6b5'}]}}} Oct 26 13:34:51.042361 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:34:51.042361 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:34:51.042361 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 13:34:51.042361 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 13:34:51.042361 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 13:34:51.045636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise error Oct 26 13:34:51.045636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 13:34:51.045636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:34:51.045636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 26 13:34:51.045636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 26 13:34:51.045636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 26 13:34:51.045636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 26 13:34:51.045636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 26 13:34:51.045636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:34:51.045636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 26 13:34:51.045636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 26 13:34:51.045636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:34:51.045636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:34:51.045636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:34:51.045636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:34:51.045636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:34:51.045636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:34:51.045636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:34:51.045636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:34:51.045636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:34:51.045636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:34:51.045636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:34:51.045636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:34:51.045636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 13:34:51.045636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 13:34:51.045636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 13:34:51.045636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 13:34:51.045636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 13:34:51.045636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 13:34:51.045636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 13:34:51.045636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:34:51.045636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:34:51.045636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:34:51.045636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:34:51.045636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:34:51.045636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:34:51.045636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 13:34:51.045636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 13:34:51.048546 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 13:34:51.048546 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:34:51.048546 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a5b39aff-ba32-4d4c-9032-243fc7cc57e9 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:34:51.063640 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a5b39aff-ba32-4d4c-9032-243fc7cc57e9 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.044596 Oct 26 13:34:51.072431 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2921/5871] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:34:51 2022] POST /compute/v2.1/servers => generated 1197 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 26 13:34:51.625956 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ca218736-5c79-448f-94e2-3a13c1a8462c tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-735311400", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6ef6bcd4-6b51-40a3-aaa8-fc41f6ccf6b5"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:34:51.630651 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ca218736-5c79-448f-94e2-3a13c1a8462c tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Request method failure captured: Oct 26 13:34:51.630651 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 13:34:51.630651 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:34:51.630651 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:34:51.630651 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:34:51.630651 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 1265 Oct 26 13:34:51.630651 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:34:51.630651 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:34:51.630651 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:34:51.630651 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:34:51.630651 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTdg72D4g2VDVLzSVbWXwJjrR4L1pXnJss6P21cduWzM00kDT7qyqmSqI388a7aylDEFw1eF3tpLIyySFkHHi4tW0GZ_ZCNzQcA-lbl-_lKzg3TNhLT3UI7cuDN_JUwEgGr0_gFzg2uUEjh0lInHFkjS8vHq9VsPxtwWuJKaifD4UxU Oct 26 13:34:51.630651 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:34:51.630651 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:34:51.630651 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:34:51.630651 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:34:51.630651 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:34:51.630651 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:34:51.630651 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: d761de7e6add4f08a0ffadc7b91a6a40 Oct 26 13:34:51.630651 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-425983124 Oct 26 13:34:51.630651 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:34:51.630651 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:34:51.630651 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d761de7e6add4f08a0ffadc7b91a6a40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d761de7e6add4f08a0ffadc7b91a6a40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d761de7e6add4f08a0ffadc7b91a6a40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d761de7e6add4f08a0ffadc7b91a6a40"}]}] Oct 26 13:34:51.630651 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-425983124 Oct 26 13:34:51.630651 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: d761de7e6add4f08a0ffadc7b91a6a40 Oct 26 13:34:51.630651 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-425983124 Oct 26 13:34:51.630651 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServerMetadataNegativeTestJSON-425983124-project Oct 26 13:34:51.630651 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:34:51.630651 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:34:51.630651 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 03173a2b60b7419491112e130ca58f37 Oct 26 13:34:51.630651 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-425983124-project Oct 26 13:34:51.630651 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:34:51.630651 n-d-862686-1 devstack@n-api.service[120597]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-735311400", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6ef6bcd4-6b51-40a3-aaa8-fc41f6ccf6b5"}]}} Oct 26 13:34:51.630651 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:34:51.633732 n-d-862686-1 devstack@n-api.service[120597]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 13:34:51.633732 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-735311400', 'imageRef': '762c20f4-0f9b-45cb-bd95-cf21a747b33b', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '6ef6bcd4-6b51-40a3-aaa8-fc41f6ccf6b5'}]}}} Oct 26 13:34:51.633732 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:34:51.633732 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:34:51.633732 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 13:34:51.633732 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 13:34:51.633732 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 13:34:51.633732 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise error Oct 26 13:34:51.633732 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 13:34:51.633732 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:34:51.633732 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 26 13:34:51.633732 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 26 13:34:51.633732 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 26 13:34:51.633732 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 26 13:34:51.633732 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 26 13:34:51.633732 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:34:51.633732 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 26 13:34:51.634858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 26 13:34:51.634858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:34:51.634858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:34:51.634858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:34:51.634858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:34:51.634858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:34:51.634858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:34:51.634858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:34:51.634858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:34:51.634858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:34:51.634858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:34:51.634858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:34:51.634858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:34:51.634858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 13:34:51.634858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 13:34:51.634858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 13:34:51.634858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 13:34:51.634858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 13:34:51.634858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 13:34:51.634858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 13:34:51.634858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:34:51.634858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:34:51.634858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:34:51.634858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:34:51.634858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:34:51.634858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:34:51.634858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 13:34:51.634858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 13:34:51.636626 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 13:34:51.636626 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:34:51.636626 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ca218736-5c79-448f-94e2-3a13c1a8462c tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:34:51.636938 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ca218736-5c79-448f-94e2-3a13c1a8462c tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.015550 Oct 26 13:34:51.644847 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2922/5872] 10.222.0.40 () {60 vars in 1148 bytes} [Wed Oct 26 13:34:51 2022] POST /compute/v2.1/servers => generated 2221 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 26 13:34:51.669864 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-becaaad7-ccb1-43b8-ad52-9b99a1a357d8 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:51.670461 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-becaaad7-ccb1-43b8-ad52-9b99a1a357d8 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] [instance: 7d2a1686-0093-4c4f-94e2-6653e7dc1033] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:51.718559 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-678754f2-3faa-41b9-ba43-fb17e3258caf tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:51.719141 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-becaaad7-ccb1-43b8-ad52-9b99a1a357d8 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] HTTP exception thrown: Instance 7d2a1686-0093-4c4f-94e2-6653e7dc1033 could not be found. Oct 26 13:34:51.727846 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-678754f2-3faa-41b9-ba43-fb17e3258caf tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:51.729326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-678754f2-3faa-41b9-ba43-fb17e3258caf tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-becaaad7-ccb1-43b8-ad52-9b99a1a357d8 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Request method failure captured: Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/7d2a1686-0093-4c4f-94e2-6653e7dc1033/metadata/test2 HTTP/1.1 Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTdg72D4g2VDVLzSVbWXwJjrR4L1pXnJss6P21cduWzM00kDT7qyqmSqI388a7aylDEFw1eF3tpLIyySFkHHi4tW0GZ_ZCNzQcA-lbl-_lKzg3TNhLT3UI7cuDN_JUwEgGr0_gFzg2uUEjh0lInHFkjS8vHq9VsPxtwWuJKaifD4UxU Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: d761de7e6add4f08a0ffadc7b91a6a40 Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-425983124 Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d761de7e6add4f08a0ffadc7b91a6a40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d761de7e6add4f08a0ffadc7b91a6a40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d761de7e6add4f08a0ffadc7b91a6a40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d761de7e6add4f08a0ffadc7b91a6a40"}]}] Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-425983124 Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: d761de7e6add4f08a0ffadc7b91a6a40 Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-425983124 Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServerMetadataNegativeTestJSON-425983124-project Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 03173a2b60b7419491112e130ca58f37 Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-425983124-project Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 7d2a1686-0093-4c4f-94e2-6653e7dc1033 could not be found. Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'server_id': '7d2a1686-0093-4c4f-94e2-6653e7dc1033', 'id': 'test2'} Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d2a1686-0093-4c4f-94e2-6653e7dc1033 could not be found. Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d2a1686-0093-4c4f-94e2-6653e7dc1033 could not be found. Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:34:51.731963 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:34:51.736814 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:34:51.736814 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:34:51.736814 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d2a1686-0093-4c4f-94e2-6653e7dc1033 could not be found. Oct 26 13:34:51.736814 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:34:51.737127 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-678754f2-3faa-41b9-ba43-fb17e3258caf tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1742 microversion: 2.20 time: 0.768187 Oct 26 13:34:51.738546 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-becaaad7-ccb1-43b8-ad52-9b99a1a357d8 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Returning 404 to user: Instance 7d2a1686-0093-4c4f-94e2-6653e7dc1033 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:34:51.749659 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-becaaad7-ccb1-43b8-ad52-9b99a1a357d8 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] 10.222.0.40 "GET /compute/v2.1/servers/7d2a1686-0093-4c4f-94e2-6653e7dc1033/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.089678 Oct 26 13:34:51.753243 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2923/5873] 10.222.0.40 () {58 vars in 1281 bytes} [Wed Oct 26 13:34:51 2022] GET /compute/v2.1/servers/7d2a1686-0093-4c4f-94e2-6653e7dc1033/metadata/test2 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:34:51.763432 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2951/5874] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:34:50 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1742 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:34:51.793284 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-61f99f33-6e95-4963-84c3-e87bb37b2aa9 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:51.793752 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-61f99f33-6e95-4963-84c3-e87bb37b2aa9 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] [instance: 83f99269-100f-4df8-9434-7330a9b6402d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:51.801195 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-61f99f33-6e95-4963-84c3-e87bb37b2aa9 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:51.802733 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-61f99f33-6e95-4963-84c3-e87bb37b2aa9 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:51.804757 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-61f99f33-6e95-4963-84c3-e87bb37b2aa9 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:51.808050 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-61f99f33-6e95-4963-84c3-e87bb37b2aa9 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:51.808702 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-61f99f33-6e95-4963-84c3-e87bb37b2aa9 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:51.809333 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-61f99f33-6e95-4963-84c3-e87bb37b2aa9 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:51.839282 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-61f99f33-6e95-4963-84c3-e87bb37b2aa9 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] [instance: 83f99269-100f-4df8-9434-7330a9b6402d] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:34:52.029558 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-61f99f33-6e95-4963-84c3-e87bb37b2aa9 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] 10.222.0.40 "DELETE /compute/v2.1/servers/83f99269-100f-4df8-9434-7330a9b6402d" status: 204 len: 0 microversion: 2.1 time: 0.238533 Oct 26 13:34:52.031223 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2924/5875] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:34:51 2022] DELETE /compute/v2.1/servers/83f99269-100f-4df8-9434-7330a9b6402d => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:34:52.040573 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-68fb80df-3c58-4c74-baa0-f666dc89f43b tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:52.042148 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-68fb80df-3c58-4c74-baa0-f666dc89f43b tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] [instance: 83f99269-100f-4df8-9434-7330a9b6402d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:52.059939 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68fb80df-3c58-4c74-baa0-f666dc89f43b tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:52.066696 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68fb80df-3c58-4c74-baa0-f666dc89f43b tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:52.068174 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68fb80df-3c58-4c74-baa0-f666dc89f43b tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:52.070105 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68fb80df-3c58-4c74-baa0-f666dc89f43b tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:52.071697 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68fb80df-3c58-4c74-baa0-f666dc89f43b tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:52.073000 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68fb80df-3c58-4c74-baa0-f666dc89f43b tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:52.493413 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-68fb80df-3c58-4c74-baa0-f666dc89f43b tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03173a2b60b7419491112e130ca58f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd761de7e6add4f08a0ffadc7b91a6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:52.504331 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-68fb80df-3c58-4c74-baa0-f666dc89f43b tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] 10.222.0.40 "GET /compute/v2.1/servers/83f99269-100f-4df8-9434-7330a9b6402d" status: 200 len: 1525 microversion: 2.1 time: 0.468151 Oct 26 13:34:52.505614 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2952/5876] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:34:52 2022] GET /compute/v2.1/servers/83f99269-100f-4df8-9434-7330a9b6402d => generated 1525 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:34:52.779775 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1bb2e0fb-5019-49aa-8ac5-4168561b1949 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:52.780638 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1bb2e0fb-5019-49aa-8ac5-4168561b1949 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:52.805032 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1bb2e0fb-5019-49aa-8ac5-4168561b1949 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:52.806465 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1bb2e0fb-5019-49aa-8ac5-4168561b1949 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:52.812791 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1bb2e0fb-5019-49aa-8ac5-4168561b1949 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:52.814152 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1bb2e0fb-5019-49aa-8ac5-4168561b1949 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:52.814152 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1bb2e0fb-5019-49aa-8ac5-4168561b1949 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:52.816573 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1bb2e0fb-5019-49aa-8ac5-4168561b1949 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:53.449641 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1bb2e0fb-5019-49aa-8ac5-4168561b1949 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:53.466097 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1bb2e0fb-5019-49aa-8ac5-4168561b1949 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:53.474493 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1bb2e0fb-5019-49aa-8ac5-4168561b1949 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:53.478304 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1bb2e0fb-5019-49aa-8ac5-4168561b1949 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1742 microversion: 2.20 time: 0.703131 Oct 26 13:34:53.501204 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2925/5877] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:34:52 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1742 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:34:53.538527 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a82f639c-3a83-4a20-8ed3-d8e3974b70b4 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:53.539877 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a82f639c-3a83-4a20-8ed3-d8e3974b70b4 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] [instance: 83f99269-100f-4df8-9434-7330a9b6402d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:53.571968 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a82f639c-3a83-4a20-8ed3-d8e3974b70b4 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:53.573394 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a82f639c-3a83-4a20-8ed3-d8e3974b70b4 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:53.583591 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a82f639c-3a83-4a20-8ed3-d8e3974b70b4 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:53.585757 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a82f639c-3a83-4a20-8ed3-d8e3974b70b4 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:53.587299 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a82f639c-3a83-4a20-8ed3-d8e3974b70b4 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:53.588037 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a82f639c-3a83-4a20-8ed3-d8e3974b70b4 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:54.215216 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a82f639c-3a83-4a20-8ed3-d8e3974b70b4 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03173a2b60b7419491112e130ca58f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd761de7e6add4f08a0ffadc7b91a6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:54.225712 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a82f639c-3a83-4a20-8ed3-d8e3974b70b4 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] 10.222.0.40 "GET /compute/v2.1/servers/83f99269-100f-4df8-9434-7330a9b6402d" status: 200 len: 1525 microversion: 2.1 time: 0.700845 Oct 26 13:34:54.229223 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2953/5878] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:34:53 2022] GET /compute/v2.1/servers/83f99269-100f-4df8-9434-7330a9b6402d => generated 1525 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:34:54.507645 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-65dd3ee6-b72e-41b0-ab40-b0288dc57cc5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:54.508885 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-65dd3ee6-b72e-41b0-ab40-b0288dc57cc5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:54.520108 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-65dd3ee6-b72e-41b0-ab40-b0288dc57cc5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:54.522129 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-65dd3ee6-b72e-41b0-ab40-b0288dc57cc5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:54.530292 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-65dd3ee6-b72e-41b0-ab40-b0288dc57cc5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:54.531329 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-65dd3ee6-b72e-41b0-ab40-b0288dc57cc5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:54.532280 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-65dd3ee6-b72e-41b0-ab40-b0288dc57cc5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:54.532899 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-65dd3ee6-b72e-41b0-ab40-b0288dc57cc5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:54.829151 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-65dd3ee6-b72e-41b0-ab40-b0288dc57cc5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:54.840505 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-65dd3ee6-b72e-41b0-ab40-b0288dc57cc5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:54.841992 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-65dd3ee6-b72e-41b0-ab40-b0288dc57cc5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:54.848243 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-65dd3ee6-b72e-41b0-ab40-b0288dc57cc5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1742 microversion: 2.20 time: 0.345492 Oct 26 13:34:54.871272 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2926/5879] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:34:54 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1742 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:34:55.251234 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a1db1495-61fa-4dd2-b500-3e6782350220 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:55.252998 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a1db1495-61fa-4dd2-b500-3e6782350220 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] [instance: 83f99269-100f-4df8-9434-7330a9b6402d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:55.278989 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a1db1495-61fa-4dd2-b500-3e6782350220 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:55.280428 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a1db1495-61fa-4dd2-b500-3e6782350220 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:55.282650 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a1db1495-61fa-4dd2-b500-3e6782350220 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:55.283431 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a1db1495-61fa-4dd2-b500-3e6782350220 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:55.283899 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a1db1495-61fa-4dd2-b500-3e6782350220 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:55.290019 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a1db1495-61fa-4dd2-b500-3e6782350220 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:55.885815 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cb9c96eb-a2a2-48bf-8825-a2d32181a942 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:55.892368 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cb9c96eb-a2a2-48bf-8825-a2d32181a942 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:55.912193 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb9c96eb-a2a2-48bf-8825-a2d32181a942 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:55.915829 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb9c96eb-a2a2-48bf-8825-a2d32181a942 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:55.916317 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb9c96eb-a2a2-48bf-8825-a2d32181a942 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:55.921522 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb9c96eb-a2a2-48bf-8825-a2d32181a942 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:55.925221 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb9c96eb-a2a2-48bf-8825-a2d32181a942 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:55.928680 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb9c96eb-a2a2-48bf-8825-a2d32181a942 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:56.069556 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a1db1495-61fa-4dd2-b500-3e6782350220 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03173a2b60b7419491112e130ca58f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd761de7e6add4f08a0ffadc7b91a6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:56.095165 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a1db1495-61fa-4dd2-b500-3e6782350220 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] 10.222.0.40 "GET /compute/v2.1/servers/83f99269-100f-4df8-9434-7330a9b6402d" status: 200 len: 1525 microversion: 2.1 time: 0.848184 Oct 26 13:34:56.099284 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2954/5880] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:34:55 2022] GET /compute/v2.1/servers/83f99269-100f-4df8-9434-7330a9b6402d => generated 1525 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:34:56.327672 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cb9c96eb-a2a2-48bf-8825-a2d32181a942 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:56.340251 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cb9c96eb-a2a2-48bf-8825-a2d32181a942 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:56.342010 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cb9c96eb-a2a2-48bf-8825-a2d32181a942 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:56.345830 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cb9c96eb-a2a2-48bf-8825-a2d32181a942 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1742 microversion: 2.20 time: 0.468522 Oct 26 13:34:56.349617 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2927/5881] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:34:55 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1742 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:34:56.572353 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-65f50bc4-4ce3-4172-946e-386d88e970fa req-17076e6c-9bd8-4b09-95e2-0543187b807b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83f99269-100f-4df8-9434-7330a9b6402d", "name": "network-vif-deleted", "tag": "d767b28f-8307-4142-a5e5-ae28db81549e"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:34:56.617066 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-65f50bc4-4ce3-4172-946e-386d88e970fa req-17076e6c-9bd8-4b09-95e2-0543187b807b service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:56.619633 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-65f50bc4-4ce3-4172-946e-386d88e970fa req-17076e6c-9bd8-4b09-95e2-0543187b807b service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:56.621757 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-65f50bc4-4ce3-4172-946e-386d88e970fa req-17076e6c-9bd8-4b09-95e2-0543187b807b service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:56.672966 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-65f50bc4-4ce3-4172-946e-386d88e970fa req-17076e6c-9bd8-4b09-95e2-0543187b807b service nova] Creating event network-vif-deleted:d767b28f-8307-4142-a5e5-ae28db81549e for instance 83f99269-100f-4df8-9434-7330a9b6402d on n-h1-862686-1 Oct 26 13:34:56.691440 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-65f50bc4-4ce3-4172-946e-386d88e970fa req-17076e6c-9bd8-4b09-95e2-0543187b807b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138372 Oct 26 13:34:56.693142 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2955/5882] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:34:57.123628 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4adafac1-9f80-4818-a15f-32225e265413 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:57.124835 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4adafac1-9f80-4818-a15f-32225e265413 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] [instance: 83f99269-100f-4df8-9434-7330a9b6402d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:57.137975 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4adafac1-9f80-4818-a15f-32225e265413 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:57.139501 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4adafac1-9f80-4818-a15f-32225e265413 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:57.143184 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4adafac1-9f80-4818-a15f-32225e265413 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:57.144500 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4adafac1-9f80-4818-a15f-32225e265413 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:57.145193 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4adafac1-9f80-4818-a15f-32225e265413 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:57.149326 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4adafac1-9f80-4818-a15f-32225e265413 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:57.197378 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:34:57.222317 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4adafac1-9f80-4818-a15f-32225e265413 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:57.223178 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4adafac1-9f80-4818-a15f-32225e265413 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:57.227062 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4adafac1-9f80-4818-a15f-32225e265413 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:57.228306 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-4adafac1-9f80-4818-a15f-32225e265413 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lazy-loading 'fault' on Instance uuid 83f99269-100f-4df8-9434-7330a9b6402d {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:34:57.382568 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-57c4b34a-b7d9-466d-afd0-4eb85326327e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:57.383867 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-57c4b34a-b7d9-466d-afd0-4eb85326327e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:57.395957 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57c4b34a-b7d9-466d-afd0-4eb85326327e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:57.399406 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57c4b34a-b7d9-466d-afd0-4eb85326327e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:57.400139 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57c4b34a-b7d9-466d-afd0-4eb85326327e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:57.401191 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57c4b34a-b7d9-466d-afd0-4eb85326327e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:57.402628 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57c4b34a-b7d9-466d-afd0-4eb85326327e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:57.404990 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57c4b34a-b7d9-466d-afd0-4eb85326327e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:57.433524 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4adafac1-9f80-4818-a15f-32225e265413 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03173a2b60b7419491112e130ca58f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd761de7e6add4f08a0ffadc7b91a6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:57.445038 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4adafac1-9f80-4818-a15f-32225e265413 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] 10.222.0.40 "GET /compute/v2.1/servers/83f99269-100f-4df8-9434-7330a9b6402d" status: 200 len: 1313 microversion: 2.1 time: 0.325902 Oct 26 13:34:57.450820 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2928/5883] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:34:57 2022] GET /compute/v2.1/servers/83f99269-100f-4df8-9434-7330a9b6402d => generated 1313 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:34:58.004936 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-57c4b34a-b7d9-466d-afd0-4eb85326327e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:58.021838 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-57c4b34a-b7d9-466d-afd0-4eb85326327e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:58.023325 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-57c4b34a-b7d9-466d-afd0-4eb85326327e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:34:58.024535 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-57c4b34a-b7d9-466d-afd0-4eb85326327e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1742 microversion: 2.20 time: 0.647698 Oct 26 13:34:58.045631 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2956/5884] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:34:57 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1742 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:34:58.474051 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-865f7a54-bdc5-40e4-8367-c47fb8231962 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:58.476339 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-865f7a54-bdc5-40e4-8367-c47fb8231962 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] [instance: 83f99269-100f-4df8-9434-7330a9b6402d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:58.493834 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-865f7a54-bdc5-40e4-8367-c47fb8231962 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:58.494462 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-865f7a54-bdc5-40e4-8367-c47fb8231962 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:58.495832 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-865f7a54-bdc5-40e4-8367-c47fb8231962 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:58.497576 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-865f7a54-bdc5-40e4-8367-c47fb8231962 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:58.500042 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-865f7a54-bdc5-40e4-8367-c47fb8231962 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:58.500601 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-865f7a54-bdc5-40e4-8367-c47fb8231962 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:58.541369 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-865f7a54-bdc5-40e4-8367-c47fb8231962 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] HTTP exception thrown: Instance 83f99269-100f-4df8-9434-7330a9b6402d could not be found. Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-865f7a54-bdc5-40e4-8367-c47fb8231962 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Request method failure captured: Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/83f99269-100f-4df8-9434-7330a9b6402d HTTP/1.1 Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTdg72D4g2VDVLzSVbWXwJjrR4L1pXnJss6P21cduWzM00kDT7qyqmSqI388a7aylDEFw1eF3tpLIyySFkHHi4tW0GZ_ZCNzQcA-lbl-_lKzg3TNhLT3UI7cuDN_JUwEgGr0_gFzg2uUEjh0lInHFkjS8vHq9VsPxtwWuJKaifD4UxU Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: d761de7e6add4f08a0ffadc7b91a6a40 Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-425983124 Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d761de7e6add4f08a0ffadc7b91a6a40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d761de7e6add4f08a0ffadc7b91a6a40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d761de7e6add4f08a0ffadc7b91a6a40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d761de7e6add4f08a0ffadc7b91a6a40"}]}] Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-425983124 Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: d761de7e6add4f08a0ffadc7b91a6a40 Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-425983124 Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServerMetadataNegativeTestJSON-425983124-project Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 03173a2b60b7419491112e130ca58f37 Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-425983124-project Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 83f99269-100f-4df8-9434-7330a9b6402d could not be found. Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '83f99269-100f-4df8-9434-7330a9b6402d'} Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83f99269-100f-4df8-9434-7330a9b6402d could not be found. Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83f99269-100f-4df8-9434-7330a9b6402d could not be found. Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:34:58.545231 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:34:58.550295 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:34:58.550295 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:34:58.550295 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:34:58.550295 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:34:58.550295 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:34:58.550295 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:34:58.550295 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83f99269-100f-4df8-9434-7330a9b6402d could not be found. Oct 26 13:34:58.550295 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:34:58.554082 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-865f7a54-bdc5-40e4-8367-c47fb8231962 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] Returning 404 to user: Instance 83f99269-100f-4df8-9434-7330a9b6402d could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:34:58.556996 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-865f7a54-bdc5-40e4-8367-c47fb8231962 tempest-ServerMetadataNegativeTestJSON-425983124 tempest-ServerMetadataNegativeTestJSON-425983124-project] 10.222.0.40 "GET /compute/v2.1/servers/83f99269-100f-4df8-9434-7330a9b6402d" status: 404 len: 111 microversion: 2.1 time: 0.088648 Oct 26 13:34:58.558115 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2929/5885] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:34:58 2022] GET /compute/v2.1/servers/83f99269-100f-4df8-9434-7330a9b6402d => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:34:59.061354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6c45987a-47b0-4180-b9b8-71e0c52a0e2f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:34:59.062028 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6c45987a-47b0-4180-b9b8-71e0c52a0e2f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:34:59.077888 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c45987a-47b0-4180-b9b8-71e0c52a0e2f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:59.078519 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c45987a-47b0-4180-b9b8-71e0c52a0e2f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:59.078949 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c45987a-47b0-4180-b9b8-71e0c52a0e2f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:34:59.079845 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c45987a-47b0-4180-b9b8-71e0c52a0e2f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:34:59.080319 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c45987a-47b0-4180-b9b8-71e0c52a0e2f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:34:59.080753 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c45987a-47b0-4180-b9b8-71e0c52a0e2f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:00.040252 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6c45987a-47b0-4180-b9b8-71e0c52a0e2f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:00.043809 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:35:00.060405 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6c45987a-47b0-4180-b9b8-71e0c52a0e2f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:00.066918 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6c45987a-47b0-4180-b9b8-71e0c52a0e2f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:00.068171 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6c45987a-47b0-4180-b9b8-71e0c52a0e2f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1742 microversion: 2.20 time: 1.012984 Oct 26 13:35:00.070974 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2957/5886] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:34:59 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1742 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:35:01.100444 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5dbc5707-6ec7-4cf2-8821-f648560a7268 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:35:01.101332 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5dbc5707-6ec7-4cf2-8821-f648560a7268 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:35:01.134134 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5dbc5707-6ec7-4cf2-8821-f648560a7268 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:01.136664 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5dbc5707-6ec7-4cf2-8821-f648560a7268 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:01.137329 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5dbc5707-6ec7-4cf2-8821-f648560a7268 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:01.138276 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5dbc5707-6ec7-4cf2-8821-f648560a7268 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:01.138909 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5dbc5707-6ec7-4cf2-8821-f648560a7268 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:01.139534 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5dbc5707-6ec7-4cf2-8821-f648560a7268 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:01.481283 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5dbc5707-6ec7-4cf2-8821-f648560a7268 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:01.498357 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5dbc5707-6ec7-4cf2-8821-f648560a7268 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:01.505390 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5dbc5707-6ec7-4cf2-8821-f648560a7268 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:01.514684 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5dbc5707-6ec7-4cf2-8821-f648560a7268 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1724 microversion: 2.20 time: 0.419899 Oct 26 13:35:01.520033 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2930/5887] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:35:01 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1724 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:35:02.551789 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b793efe8-1fe4-4e78-b877-75c6d7f5529b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:35:02.553085 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b793efe8-1fe4-4e78-b877-75c6d7f5529b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:35:02.570665 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b793efe8-1fe4-4e78-b877-75c6d7f5529b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:02.574428 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b793efe8-1fe4-4e78-b877-75c6d7f5529b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:02.575091 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b793efe8-1fe4-4e78-b877-75c6d7f5529b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:02.578000 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b793efe8-1fe4-4e78-b877-75c6d7f5529b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:02.584906 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b793efe8-1fe4-4e78-b877-75c6d7f5529b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:02.590705 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b793efe8-1fe4-4e78-b877-75c6d7f5529b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:03.055672 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b793efe8-1fe4-4e78-b877-75c6d7f5529b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:03.080200 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b793efe8-1fe4-4e78-b877-75c6d7f5529b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:03.089424 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b793efe8-1fe4-4e78-b877-75c6d7f5529b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:03.097323 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b793efe8-1fe4-4e78-b877-75c6d7f5529b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1724 microversion: 2.20 time: 0.550551 Oct 26 13:35:03.098934 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2958/5888] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:35:02 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1724 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:35:04.129688 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c5b767ab-0758-439f-b512-7363b612c766 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:35:04.133714 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c5b767ab-0758-439f-b512-7363b612c766 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:35:04.140594 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:35:04.180413 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c5b767ab-0758-439f-b512-7363b612c766 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:04.185983 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c5b767ab-0758-439f-b512-7363b612c766 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:04.190426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c5b767ab-0758-439f-b512-7363b612c766 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:04.193174 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c5b767ab-0758-439f-b512-7363b612c766 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:04.197102 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c5b767ab-0758-439f-b512-7363b612c766 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:04.200009 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c5b767ab-0758-439f-b512-7363b612c766 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:05.245058 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c5b767ab-0758-439f-b512-7363b612c766 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:05.257655 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c5b767ab-0758-439f-b512-7363b612c766 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:05.264691 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c5b767ab-0758-439f-b512-7363b612c766 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:05.268850 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c5b767ab-0758-439f-b512-7363b612c766 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1724 microversion: 2.20 time: 1.143209 Oct 26 13:35:05.269763 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2931/5889] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:35:04 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1724 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:35:05.879624 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-ce523d5d-cd96-4109-a6ad-c7780e8f4faa req-484ca7ae-4019-4349-bf30-657ddfe35093 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c95d88e-349c-4594-b0a2-351b507f34f9", "name": "network-vif-unplugged", "status": "completed", "tag": "f0e9fd1e-4a27-44e9-903e-5bbaaf376cb8"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:35:05.951923 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=38 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:35:05.989698 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ce523d5d-cd96-4109-a6ad-c7780e8f4faa req-484ca7ae-4019-4349-bf30-657ddfe35093 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:05.990367 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ce523d5d-cd96-4109-a6ad-c7780e8f4faa req-484ca7ae-4019-4349-bf30-657ddfe35093 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:05.990958 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ce523d5d-cd96-4109-a6ad-c7780e8f4faa req-484ca7ae-4019-4349-bf30-657ddfe35093 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:06.088013 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-ce523d5d-cd96-4109-a6ad-c7780e8f4faa req-484ca7ae-4019-4349-bf30-657ddfe35093 service nova] Creating event network-vif-unplugged:f0e9fd1e-4a27-44e9-903e-5bbaaf376cb8 for instance 6c95d88e-349c-4594-b0a2-351b507f34f9 on n-h2-862686-1 Oct 26 13:35:06.143033 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-ce523d5d-cd96-4109-a6ad-c7780e8f4faa req-484ca7ae-4019-4349-bf30-657ddfe35093 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.262590 Oct 26 13:35:06.151327 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2959/5890] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:35:06.300453 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-12011639-8283-4aa1-ac88-341842da3997 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:35:06.302047 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-12011639-8283-4aa1-ac88-341842da3997 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:35:06.318178 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-12011639-8283-4aa1-ac88-341842da3997 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:06.318938 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-12011639-8283-4aa1-ac88-341842da3997 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:06.319588 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-12011639-8283-4aa1-ac88-341842da3997 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:06.323463 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-12011639-8283-4aa1-ac88-341842da3997 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:06.325712 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-12011639-8283-4aa1-ac88-341842da3997 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:06.326598 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-12011639-8283-4aa1-ac88-341842da3997 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:06.926772 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-12011639-8283-4aa1-ac88-341842da3997 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:06.944627 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-12011639-8283-4aa1-ac88-341842da3997 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:06.946741 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-12011639-8283-4aa1-ac88-341842da3997 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:06.951588 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-12011639-8283-4aa1-ac88-341842da3997 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1724 microversion: 2.20 time: 0.655266 Oct 26 13:35:06.966724 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2932/5891] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:35:06 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1724 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:35:07.984042 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d171fe7d-de24-4b12-a875-fe81641206b9 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:35:07.985049 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d171fe7d-de24-4b12-a875-fe81641206b9 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:35:08.001349 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d171fe7d-de24-4b12-a875-fe81641206b9 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:08.003507 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d171fe7d-de24-4b12-a875-fe81641206b9 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:08.004145 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d171fe7d-de24-4b12-a875-fe81641206b9 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:08.005177 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d171fe7d-de24-4b12-a875-fe81641206b9 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:08.008464 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d171fe7d-de24-4b12-a875-fe81641206b9 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:08.009332 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d171fe7d-de24-4b12-a875-fe81641206b9 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:08.519764 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d171fe7d-de24-4b12-a875-fe81641206b9 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:08.532343 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d171fe7d-de24-4b12-a875-fe81641206b9 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:08.534151 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d171fe7d-de24-4b12-a875-fe81641206b9 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:08.538025 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d171fe7d-de24-4b12-a875-fe81641206b9 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1667 microversion: 2.20 time: 0.557465 Oct 26 13:35:08.567403 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-19b3acc3-4542-44f2-a88f-1794ecedfc3d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a3633aa-4ff4-4e29-8bec-bd627addad51"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:35:08.586766 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-19b3acc3-4542-44f2-a88f-1794ecedfc3d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:35:08.590333 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2960/5892] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:35:07 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1667 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:35:08.595737 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-19b3acc3-4542-44f2-a88f-1794ecedfc3d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:08.600815 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-19b3acc3-4542-44f2-a88f-1794ecedfc3d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:08.610972 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-19b3acc3-4542-44f2-a88f-1794ecedfc3d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:08.611999 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-19b3acc3-4542-44f2-a88f-1794ecedfc3d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:08.612474 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-19b3acc3-4542-44f2-a88f-1794ecedfc3d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:08.612908 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-19b3acc3-4542-44f2-a88f-1794ecedfc3d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:09.219659 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-19b3acc3-4542-44f2-a88f-1794ecedfc3d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "POST /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.656231 Oct 26 13:35:09.220355 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2933/5893] 10.222.0.40 () {62 vars in 1364 bytes} [Wed Oct 26 13:35:08 2022] POST /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9/os-volume_attachments => generated 188 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:35:09.590838 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-096ae2e7-4ff5-417a-9044-5f1bdd4f3d55 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:35:09.591448 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-096ae2e7-4ff5-417a-9044-5f1bdd4f3d55 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:35:09.607046 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-096ae2e7-4ff5-417a-9044-5f1bdd4f3d55 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:09.607548 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-096ae2e7-4ff5-417a-9044-5f1bdd4f3d55 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:09.607995 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-096ae2e7-4ff5-417a-9044-5f1bdd4f3d55 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:09.613279 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-096ae2e7-4ff5-417a-9044-5f1bdd4f3d55 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:09.617002 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-096ae2e7-4ff5-417a-9044-5f1bdd4f3d55 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:09.617519 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-096ae2e7-4ff5-417a-9044-5f1bdd4f3d55 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:09.711063 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-096ae2e7-4ff5-417a-9044-5f1bdd4f3d55 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120598) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 26 13:35:09.986869 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-096ae2e7-4ff5-417a-9044-5f1bdd4f3d55 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "POST /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9/action" status: 202 len: 0 microversion: 2.20 time: 0.400971 Oct 26 13:35:09.997887 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2961/5894] 10.222.0.40 () {62 vars in 1319 bytes} [Wed Oct 26 13:35:09 2022] POST /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9/action => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:35:10.003015 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8303e60a-47a9-4ff8-8420-a440de0b39a2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:35:10.003754 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8303e60a-47a9-4ff8-8420-a440de0b39a2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:35:10.055910 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8303e60a-47a9-4ff8-8420-a440de0b39a2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:10.060594 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8303e60a-47a9-4ff8-8420-a440de0b39a2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:10.066737 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8303e60a-47a9-4ff8-8420-a440de0b39a2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:10.068431 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8303e60a-47a9-4ff8-8420-a440de0b39a2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:10.072283 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8303e60a-47a9-4ff8-8420-a440de0b39a2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:10.073057 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8303e60a-47a9-4ff8-8420-a440de0b39a2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:11.065619 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8303e60a-47a9-4ff8-8420-a440de0b39a2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:11.077669 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8303e60a-47a9-4ff8-8420-a440de0b39a2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:11.078986 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8303e60a-47a9-4ff8-8420-a440de0b39a2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:11.080182 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8303e60a-47a9-4ff8-8420-a440de0b39a2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1753 microversion: 2.20 time: 1.082821 Oct 26 13:35:11.091577 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2934/5895] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:35:09 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1753 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:35:12.114693 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a7f26b3b-c130-45ca-82c4-4238bc6d8be7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:35:12.116075 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a7f26b3b-c130-45ca-82c4-4238bc6d8be7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:35:12.136838 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a7f26b3b-c130-45ca-82c4-4238bc6d8be7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:12.137427 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a7f26b3b-c130-45ca-82c4-4238bc6d8be7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:12.137907 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a7f26b3b-c130-45ca-82c4-4238bc6d8be7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:12.138651 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a7f26b3b-c130-45ca-82c4-4238bc6d8be7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:12.150398 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a7f26b3b-c130-45ca-82c4-4238bc6d8be7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:12.150966 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a7f26b3b-c130-45ca-82c4-4238bc6d8be7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:12.960494 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a7f26b3b-c130-45ca-82c4-4238bc6d8be7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:12.988586 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a7f26b3b-c130-45ca-82c4-4238bc6d8be7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:12.991789 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a7f26b3b-c130-45ca-82c4-4238bc6d8be7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:13.002504 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a7f26b3b-c130-45ca-82c4-4238bc6d8be7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1753 microversion: 2.20 time: 0.893389 Oct 26 13:35:13.003004 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2962/5896] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:35:12 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1753 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:35:13.326060 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3fc5de5c-9029-4041-b3c7-ea5bf85e19d0 tempest-ExtensionsTest-1212955117 tempest-ExtensionsTest-1212955117-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:35:13.328346 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3fc5de5c-9029-4041-b3c7-ea5bf85e19d0 tempest-ExtensionsTest-1212955117 tempest-ExtensionsTest-1212955117-project] 10.222.0.40 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.336573 Oct 26 13:35:13.329350 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2935/5897] 10.222.0.40 () {58 vars in 1170 bytes} [Wed Oct 26 13:35:12 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:35:13.339036 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0d3fa294-403f-4165-b871-e8ab343004aa tempest-ExtensionsTest-1212955117 tempest-ExtensionsTest-1212955117-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:35:13.342691 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0d3fa294-403f-4165-b871-e8ab343004aa tempest-ExtensionsTest-1212955117 tempest-ExtensionsTest-1212955117-project] 10.222.0.40 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.008509 Oct 26 13:35:13.343535 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2963/5898] 10.222.0.40 () {58 vars in 1134 bytes} [Wed Oct 26 13:35:13 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:35:14.046277 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8d1a72b0-15bc-4e75-8de4-42f4b42a2d87 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:35:14.047158 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8d1a72b0-15bc-4e75-8de4-42f4b42a2d87 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:35:14.056704 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d1a72b0-15bc-4e75-8de4-42f4b42a2d87 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:14.057468 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d1a72b0-15bc-4e75-8de4-42f4b42a2d87 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:14.058154 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d1a72b0-15bc-4e75-8de4-42f4b42a2d87 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:14.059331 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d1a72b0-15bc-4e75-8de4-42f4b42a2d87 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:14.060167 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d1a72b0-15bc-4e75-8de4-42f4b42a2d87 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:14.060785 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d1a72b0-15bc-4e75-8de4-42f4b42a2d87 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:15.368750 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8d1a72b0-15bc-4e75-8de4-42f4b42a2d87 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:15.394031 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8d1a72b0-15bc-4e75-8de4-42f4b42a2d87 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:15.398336 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8d1a72b0-15bc-4e75-8de4-42f4b42a2d87 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:15.404358 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8d1a72b0-15bc-4e75-8de4-42f4b42a2d87 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1755 microversion: 2.20 time: 1.375137 Oct 26 13:35:15.413663 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2936/5899] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:35:14 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1755 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:35:16.433777 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b0f5d9b0-6ac1-4ded-b547-5ad9d8fb1a40 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:35:16.434409 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b0f5d9b0-6ac1-4ded-b547-5ad9d8fb1a40 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:35:16.450909 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b0f5d9b0-6ac1-4ded-b547-5ad9d8fb1a40 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:16.451522 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b0f5d9b0-6ac1-4ded-b547-5ad9d8fb1a40 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:16.451859 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b0f5d9b0-6ac1-4ded-b547-5ad9d8fb1a40 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:16.452587 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b0f5d9b0-6ac1-4ded-b547-5ad9d8fb1a40 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:16.453053 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b0f5d9b0-6ac1-4ded-b547-5ad9d8fb1a40 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:16.453524 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b0f5d9b0-6ac1-4ded-b547-5ad9d8fb1a40 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:17.195430 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b0f5d9b0-6ac1-4ded-b547-5ad9d8fb1a40 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:17.210918 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b0f5d9b0-6ac1-4ded-b547-5ad9d8fb1a40 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:17.238911 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b0f5d9b0-6ac1-4ded-b547-5ad9d8fb1a40 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:17.241597 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b0f5d9b0-6ac1-4ded-b547-5ad9d8fb1a40 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1755 microversion: 2.20 time: 0.812716 Oct 26 13:35:17.262369 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2964/5900] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:35:16 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1755 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:35:18.273840 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7158a377-80b0-4c3b-95d4-e6ac6dd50401 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:35:18.274631 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7158a377-80b0-4c3b-95d4-e6ac6dd50401 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:35:18.285230 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7158a377-80b0-4c3b-95d4-e6ac6dd50401 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:18.301874 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7158a377-80b0-4c3b-95d4-e6ac6dd50401 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:18.303168 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7158a377-80b0-4c3b-95d4-e6ac6dd50401 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:18.311698 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7158a377-80b0-4c3b-95d4-e6ac6dd50401 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:18.312906 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7158a377-80b0-4c3b-95d4-e6ac6dd50401 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:18.319847 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7158a377-80b0-4c3b-95d4-e6ac6dd50401 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:19.078665 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b0f5d9b0-6ac1-4ded-b547-5ad9d8fb1a40 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:35:19.079748 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b0f5d9b0-6ac1-4ded-b547-5ad9d8fb1a40 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001469 Oct 26 13:35:19.086608 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2965/5901] 10.222.0.40 () {56 vars in 886 bytes} [Wed Oct 26 13:35:19 2022] GET /compute/ => generated 377 bytes in 10 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 26 13:35:19.092571 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7158a377-80b0-4c3b-95d4-e6ac6dd50401 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:19.095602 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b0f5d9b0-6ac1-4ded-b547-5ad9d8fb1a40 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:35:19.096983 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b0f5d9b0-6ac1-4ded-b547-5ad9d8fb1a40 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002611 Oct 26 13:35:19.098934 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2966/5902] 10.222.0.40 () {54 vars in 1035 bytes} [Wed Oct 26 13:35:19 2022] GET /compute/v2/ => generated 379 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 221 bytes (2 switches on core 0) Oct 26 13:35:19.107283 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b0f5d9b0-6ac1-4ded-b547-5ad9d8fb1a40 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:35:19.108337 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b0f5d9b0-6ac1-4ded-b547-5ad9d8fb1a40 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001462 Oct 26 13:35:19.108923 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2967/5903] 10.222.0.40 () {54 vars in 1041 bytes} [Wed Oct 26 13:35:19 2022] GET /compute/v2.1/ => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:35:19.113736 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7158a377-80b0-4c3b-95d4-e6ac6dd50401 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:19.117115 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7158a377-80b0-4c3b-95d4-e6ac6dd50401 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:19.118378 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b0f5d9b0-6ac1-4ded-b547-5ad9d8fb1a40 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:35:19.120331 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b0f5d9b0-6ac1-4ded-b547-5ad9d8fb1a40 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002990 Oct 26 13:35:19.122794 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7158a377-80b0-4c3b-95d4-e6ac6dd50401 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1755 microversion: 2.20 time: 0.852306 Oct 26 13:35:19.122957 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2968/5904] 10.222.0.40 () {56 vars in 886 bytes} [Wed Oct 26 13:35:19 2022] GET /compute/ => generated 377 bytes in 6 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Oct 26 13:35:19.134532 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2937/5905] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:35:18 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1755 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:35:20.163700 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7b35f617-6096-4804-a3c8-21b67e3d9a3b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:35:20.166192 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7b35f617-6096-4804-a3c8-21b67e3d9a3b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:35:20.196582 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7b35f617-6096-4804-a3c8-21b67e3d9a3b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:20.197471 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7b35f617-6096-4804-a3c8-21b67e3d9a3b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:20.199047 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7b35f617-6096-4804-a3c8-21b67e3d9a3b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:20.203783 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7b35f617-6096-4804-a3c8-21b67e3d9a3b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:20.205676 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7b35f617-6096-4804-a3c8-21b67e3d9a3b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:20.206449 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7b35f617-6096-4804-a3c8-21b67e3d9a3b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:21.472144 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7b35f617-6096-4804-a3c8-21b67e3d9a3b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:21.487673 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7b35f617-6096-4804-a3c8-21b67e3d9a3b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:21.499999 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7b35f617-6096-4804-a3c8-21b67e3d9a3b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:21.501270 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7b35f617-6096-4804-a3c8-21b67e3d9a3b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1755 microversion: 2.20 time: 1.342159 Oct 26 13:35:21.503303 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2969/5906] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:35:20 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1755 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:35:22.532466 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a7df2d29-2fab-4617-8905-96bbfd8a3541 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:35:22.533282 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a7df2d29-2fab-4617-8905-96bbfd8a3541 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:35:22.560285 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7df2d29-2fab-4617-8905-96bbfd8a3541 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:22.561226 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7df2d29-2fab-4617-8905-96bbfd8a3541 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:22.563508 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7df2d29-2fab-4617-8905-96bbfd8a3541 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:22.564434 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7df2d29-2fab-4617-8905-96bbfd8a3541 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:22.564927 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7df2d29-2fab-4617-8905-96bbfd8a3541 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:22.565375 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a7df2d29-2fab-4617-8905-96bbfd8a3541 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:23.254439 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a7df2d29-2fab-4617-8905-96bbfd8a3541 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:23.267635 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a7df2d29-2fab-4617-8905-96bbfd8a3541 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:23.279439 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a7df2d29-2fab-4617-8905-96bbfd8a3541 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:23.280944 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a7df2d29-2fab-4617-8905-96bbfd8a3541 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1755 microversion: 2.20 time: 0.753865 Oct 26 13:35:23.282095 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2938/5907] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:35:22 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1755 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:35:24.308859 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1e244ccd-ebda-488d-8c89-aa68e72c691b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:35:24.310221 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1e244ccd-ebda-488d-8c89-aa68e72c691b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:35:24.324458 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1e244ccd-ebda-488d-8c89-aa68e72c691b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:24.325199 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1e244ccd-ebda-488d-8c89-aa68e72c691b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:24.325907 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1e244ccd-ebda-488d-8c89-aa68e72c691b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:24.332850 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1e244ccd-ebda-488d-8c89-aa68e72c691b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:24.337857 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1e244ccd-ebda-488d-8c89-aa68e72c691b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:24.338806 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1e244ccd-ebda-488d-8c89-aa68e72c691b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:24.786551 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1e244ccd-ebda-488d-8c89-aa68e72c691b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:24.799134 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1e244ccd-ebda-488d-8c89-aa68e72c691b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:24.800646 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1e244ccd-ebda-488d-8c89-aa68e72c691b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:24.801945 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1e244ccd-ebda-488d-8c89-aa68e72c691b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1755 microversion: 2.20 time: 0.497183 Oct 26 13:35:24.817520 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2970/5908] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:35:24 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1755 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:35:25.835513 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5d870a5e-0057-426f-84b1-b5d26a3a5234 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:35:25.836219 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5d870a5e-0057-426f-84b1-b5d26a3a5234 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:35:25.855934 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d870a5e-0057-426f-84b1-b5d26a3a5234 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:25.856745 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d870a5e-0057-426f-84b1-b5d26a3a5234 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:25.857366 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d870a5e-0057-426f-84b1-b5d26a3a5234 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:25.858359 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d870a5e-0057-426f-84b1-b5d26a3a5234 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:25.858990 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d870a5e-0057-426f-84b1-b5d26a3a5234 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:25.859619 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d870a5e-0057-426f-84b1-b5d26a3a5234 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:26.206268 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5d870a5e-0057-426f-84b1-b5d26a3a5234 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:26.230510 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5d870a5e-0057-426f-84b1-b5d26a3a5234 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:26.231991 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5d870a5e-0057-426f-84b1-b5d26a3a5234 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:26.233206 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5d870a5e-0057-426f-84b1-b5d26a3a5234 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1755 microversion: 2.20 time: 0.402462 Oct 26 13:35:26.242504 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2939/5909] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:35:25 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1755 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:35:27.273934 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cf5f1a28-8e88-43d3-8b28-76c9bfe1a9ad tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:35:27.274698 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cf5f1a28-8e88-43d3-8b28-76c9bfe1a9ad tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:35:27.284794 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf5f1a28-8e88-43d3-8b28-76c9bfe1a9ad tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:27.285604 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf5f1a28-8e88-43d3-8b28-76c9bfe1a9ad tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:27.286220 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf5f1a28-8e88-43d3-8b28-76c9bfe1a9ad tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:27.287803 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf5f1a28-8e88-43d3-8b28-76c9bfe1a9ad tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:27.290050 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf5f1a28-8e88-43d3-8b28-76c9bfe1a9ad tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:27.295356 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf5f1a28-8e88-43d3-8b28-76c9bfe1a9ad tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:28.121856 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-cf5f1a28-8e88-43d3-8b28-76c9bfe1a9ad tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:28.138843 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-cf5f1a28-8e88-43d3-8b28-76c9bfe1a9ad tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:28.141506 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-cf5f1a28-8e88-43d3-8b28-76c9bfe1a9ad tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:28.144218 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cf5f1a28-8e88-43d3-8b28-76c9bfe1a9ad tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1755 microversion: 2.20 time: 0.879864 Oct 26 13:35:28.147448 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2971/5910] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:35:27 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1755 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:35:29.175550 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-856cda7c-2ed1-4969-8214-bf9707663852 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:35:29.176137 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-856cda7c-2ed1-4969-8214-bf9707663852 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:35:29.192490 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-856cda7c-2ed1-4969-8214-bf9707663852 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:29.193060 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-856cda7c-2ed1-4969-8214-bf9707663852 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:29.197898 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-856cda7c-2ed1-4969-8214-bf9707663852 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:29.208034 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-856cda7c-2ed1-4969-8214-bf9707663852 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:29.209986 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-856cda7c-2ed1-4969-8214-bf9707663852 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:29.210548 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-856cda7c-2ed1-4969-8214-bf9707663852 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:29.223327 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=71,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:35:29.723381 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-856cda7c-2ed1-4969-8214-bf9707663852 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:29.745145 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-856cda7c-2ed1-4969-8214-bf9707663852 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:29.749339 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-856cda7c-2ed1-4969-8214-bf9707663852 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:29.752858 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-856cda7c-2ed1-4969-8214-bf9707663852 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1755 microversion: 2.20 time: 0.581862 Oct 26 13:35:29.754020 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2940/5911] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:35:29 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1755 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:35:30.784317 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1d7548c8-5458-4bb7-8afc-b00f75a7a8cb tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:35:30.785189 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1d7548c8-5458-4bb7-8afc-b00f75a7a8cb tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:35:30.810652 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1d7548c8-5458-4bb7-8afc-b00f75a7a8cb tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:30.812881 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1d7548c8-5458-4bb7-8afc-b00f75a7a8cb tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:30.813554 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1d7548c8-5458-4bb7-8afc-b00f75a7a8cb tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:30.816723 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1d7548c8-5458-4bb7-8afc-b00f75a7a8cb tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:30.819518 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1d7548c8-5458-4bb7-8afc-b00f75a7a8cb tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:30.820233 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1d7548c8-5458-4bb7-8afc-b00f75a7a8cb tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:30.868149 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:35:31.507788 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1d7548c8-5458-4bb7-8afc-b00f75a7a8cb tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:31.523566 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1d7548c8-5458-4bb7-8afc-b00f75a7a8cb tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:31.525253 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1d7548c8-5458-4bb7-8afc-b00f75a7a8cb tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:31.531019 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1d7548c8-5458-4bb7-8afc-b00f75a7a8cb tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1755 microversion: 2.20 time: 0.753074 Oct 26 13:35:31.532170 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2972/5912] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:35:30 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1755 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:35:32.563264 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-995431c7-41f4-43c0-8094-7162c311c316 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:35:32.563881 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-995431c7-41f4-43c0-8094-7162c311c316 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:35:32.578660 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-995431c7-41f4-43c0-8094-7162c311c316 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:32.579574 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-995431c7-41f4-43c0-8094-7162c311c316 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:32.580425 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-995431c7-41f4-43c0-8094-7162c311c316 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:32.583797 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-995431c7-41f4-43c0-8094-7162c311c316 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:32.584539 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-995431c7-41f4-43c0-8094-7162c311c316 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:32.585374 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-995431c7-41f4-43c0-8094-7162c311c316 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:33.796323 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-995431c7-41f4-43c0-8094-7162c311c316 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:33.808894 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-995431c7-41f4-43c0-8094-7162c311c316 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:33.811666 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-995431c7-41f4-43c0-8094-7162c311c316 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:33.812912 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-995431c7-41f4-43c0-8094-7162c311c316 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1755 microversion: 2.20 time: 1.259580 Oct 26 13:35:33.833467 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2941/5913] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:35:32 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1755 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:35:34.841013 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-77d4399e-40c2-4f92-a04b-0c5e11d53194 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:35:34.841660 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-77d4399e-40c2-4f92-a04b-0c5e11d53194 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:35:34.854248 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77d4399e-40c2-4f92-a04b-0c5e11d53194 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:34.857398 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77d4399e-40c2-4f92-a04b-0c5e11d53194 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:34.877882 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77d4399e-40c2-4f92-a04b-0c5e11d53194 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:34.878685 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77d4399e-40c2-4f92-a04b-0c5e11d53194 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:34.879171 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77d4399e-40c2-4f92-a04b-0c5e11d53194 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:34.879653 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-77d4399e-40c2-4f92-a04b-0c5e11d53194 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:35.580351 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-77d4399e-40c2-4f92-a04b-0c5e11d53194 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:35.594285 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-77d4399e-40c2-4f92-a04b-0c5e11d53194 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:35.596811 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-77d4399e-40c2-4f92-a04b-0c5e11d53194 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:35.600630 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-77d4399e-40c2-4f92-a04b-0c5e11d53194 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1811 microversion: 2.20 time: 0.764104 Oct 26 13:35:35.606203 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2973/5914] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:35:34 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1811 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:35:36.632069 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a2f0472d-d987-4235-b775-2b918a00d3c0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:35:36.632547 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a2f0472d-d987-4235-b775-2b918a00d3c0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:35:36.640220 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=20 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:35:36.642930 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2f0472d-d987-4235-b775-2b918a00d3c0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:36.643726 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2f0472d-d987-4235-b775-2b918a00d3c0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:36.644394 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2f0472d-d987-4235-b775-2b918a00d3c0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:36.645517 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2f0472d-d987-4235-b775-2b918a00d3c0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:36.646267 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2f0472d-d987-4235-b775-2b918a00d3c0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:36.646993 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2f0472d-d987-4235-b775-2b918a00d3c0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:36.994989 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a2f0472d-d987-4235-b775-2b918a00d3c0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:37.013997 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a2f0472d-d987-4235-b775-2b918a00d3c0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:37.022540 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a2f0472d-d987-4235-b775-2b918a00d3c0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:37.026870 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a2f0472d-d987-4235-b775-2b918a00d3c0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1811 microversion: 2.20 time: 0.404207 Oct 26 13:35:37.030699 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2942/5915] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:35:36 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1811 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:35:38.066807 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a0d2221f-130a-43e2-a196-bed7a9c2ec70 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:35:38.073171 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a0d2221f-130a-43e2-a196-bed7a9c2ec70 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:35:38.085198 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:35:38.095454 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0d2221f-130a-43e2-a196-bed7a9c2ec70 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:38.095970 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0d2221f-130a-43e2-a196-bed7a9c2ec70 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:38.096410 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0d2221f-130a-43e2-a196-bed7a9c2ec70 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:38.097138 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0d2221f-130a-43e2-a196-bed7a9c2ec70 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:38.110990 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0d2221f-130a-43e2-a196-bed7a9c2ec70 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:38.111462 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0d2221f-130a-43e2-a196-bed7a9c2ec70 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:38.998737 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a0d2221f-130a-43e2-a196-bed7a9c2ec70 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:39.012483 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a0d2221f-130a-43e2-a196-bed7a9c2ec70 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:39.022814 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a0d2221f-130a-43e2-a196-bed7a9c2ec70 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:39.026007 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a0d2221f-130a-43e2-a196-bed7a9c2ec70 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1811 microversion: 2.20 time: 0.963089 Oct 26 13:35:39.028871 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2974/5916] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:35:38 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1811 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:35:40.055848 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bf60bd6d-9452-4f26-a0ba-208d66a266e2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:35:40.058775 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bf60bd6d-9452-4f26-a0ba-208d66a266e2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:35:40.108157 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf60bd6d-9452-4f26-a0ba-208d66a266e2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:40.116100 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf60bd6d-9452-4f26-a0ba-208d66a266e2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:40.124400 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf60bd6d-9452-4f26-a0ba-208d66a266e2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:40.128717 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf60bd6d-9452-4f26-a0ba-208d66a266e2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:40.132659 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf60bd6d-9452-4f26-a0ba-208d66a266e2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:40.137784 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf60bd6d-9452-4f26-a0ba-208d66a266e2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:41.065887 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bf60bd6d-9452-4f26-a0ba-208d66a266e2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:41.081165 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bf60bd6d-9452-4f26-a0ba-208d66a266e2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:41.082751 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bf60bd6d-9452-4f26-a0ba-208d66a266e2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:41.084136 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bf60bd6d-9452-4f26-a0ba-208d66a266e2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1811 microversion: 2.20 time: 1.033484 Oct 26 13:35:41.089358 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2943/5917] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:35:40 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1811 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:35:42.120640 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ef091c10-3c1b-40d8-8eca-8e88d9f32be7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:35:42.125450 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ef091c10-3c1b-40d8-8eca-8e88d9f32be7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:35:42.138116 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef091c10-3c1b-40d8-8eca-8e88d9f32be7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:42.151456 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef091c10-3c1b-40d8-8eca-8e88d9f32be7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:42.154137 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef091c10-3c1b-40d8-8eca-8e88d9f32be7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:42.155150 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef091c10-3c1b-40d8-8eca-8e88d9f32be7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:42.157244 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef091c10-3c1b-40d8-8eca-8e88d9f32be7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:42.157951 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef091c10-3c1b-40d8-8eca-8e88d9f32be7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:42.873918 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ef091c10-3c1b-40d8-8eca-8e88d9f32be7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:42.888601 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ef091c10-3c1b-40d8-8eca-8e88d9f32be7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:42.893681 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ef091c10-3c1b-40d8-8eca-8e88d9f32be7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:42.896403 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ef091c10-3c1b-40d8-8eca-8e88d9f32be7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1811 microversion: 2.20 time: 0.778433 Oct 26 13:35:42.902908 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2975/5918] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:35:42 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1811 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:35:43.937050 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1bb10193-206e-4ceb-95c2-6985fcb682ee tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:35:43.939122 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1bb10193-206e-4ceb-95c2-6985fcb682ee tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:35:43.963227 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1bb10193-206e-4ceb-95c2-6985fcb682ee tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:43.963742 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1bb10193-206e-4ceb-95c2-6985fcb682ee tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:43.964196 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1bb10193-206e-4ceb-95c2-6985fcb682ee tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:43.970525 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1bb10193-206e-4ceb-95c2-6985fcb682ee tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:43.971187 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1bb10193-206e-4ceb-95c2-6985fcb682ee tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:43.971645 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1bb10193-206e-4ceb-95c2-6985fcb682ee tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:44.895309 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1bb10193-206e-4ceb-95c2-6985fcb682ee tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:44.915133 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1bb10193-206e-4ceb-95c2-6985fcb682ee tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:44.932600 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1bb10193-206e-4ceb-95c2-6985fcb682ee tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:44.937055 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1bb10193-206e-4ceb-95c2-6985fcb682ee tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1811 microversion: 2.20 time: 1.005692 Oct 26 13:35:44.947909 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2944/5919] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:35:43 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1811 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:35:45.968151 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a22c0115-56fa-4e9e-bdc1-e7962197dece tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:35:45.970415 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a22c0115-56fa-4e9e-bdc1-e7962197dece tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:35:46.009992 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a22c0115-56fa-4e9e-bdc1-e7962197dece tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:46.022095 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a22c0115-56fa-4e9e-bdc1-e7962197dece tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:46.025578 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a22c0115-56fa-4e9e-bdc1-e7962197dece tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:46.027180 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a22c0115-56fa-4e9e-bdc1-e7962197dece tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:46.032144 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a22c0115-56fa-4e9e-bdc1-e7962197dece tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:46.034235 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a22c0115-56fa-4e9e-bdc1-e7962197dece tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:47.055178 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a22c0115-56fa-4e9e-bdc1-e7962197dece tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:47.086216 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a22c0115-56fa-4e9e-bdc1-e7962197dece tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:47.097858 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a22c0115-56fa-4e9e-bdc1-e7962197dece tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:47.105353 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a22c0115-56fa-4e9e-bdc1-e7962197dece tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1811 microversion: 2.20 time: 1.142403 Oct 26 13:35:47.121583 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2976/5920] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:35:45 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1811 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:35:48.144150 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-307317b1-70ae-4c7b-a69a-80d3622d0e99 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:35:48.153105 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-307317b1-70ae-4c7b-a69a-80d3622d0e99 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:35:48.165798 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-307317b1-70ae-4c7b-a69a-80d3622d0e99 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:48.170142 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-307317b1-70ae-4c7b-a69a-80d3622d0e99 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:48.171325 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-307317b1-70ae-4c7b-a69a-80d3622d0e99 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:48.172371 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-307317b1-70ae-4c7b-a69a-80d3622d0e99 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:48.173210 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-307317b1-70ae-4c7b-a69a-80d3622d0e99 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:48.178233 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-307317b1-70ae-4c7b-a69a-80d3622d0e99 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:48.986106 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-307317b1-70ae-4c7b-a69a-80d3622d0e99 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:49.009973 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-307317b1-70ae-4c7b-a69a-80d3622d0e99 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:49.015199 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-307317b1-70ae-4c7b-a69a-80d3622d0e99 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:49.021513 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-307317b1-70ae-4c7b-a69a-80d3622d0e99 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1811 microversion: 2.20 time: 0.881096 Oct 26 13:35:49.028394 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2945/5921] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:35:48 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1811 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:35:50.063401 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-df760af6-79db-4907-8e5d-84e6f8a066a6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:35:50.065051 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-df760af6-79db-4907-8e5d-84e6f8a066a6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:35:50.079970 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df760af6-79db-4907-8e5d-84e6f8a066a6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:50.082375 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df760af6-79db-4907-8e5d-84e6f8a066a6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:50.084480 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df760af6-79db-4907-8e5d-84e6f8a066a6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:50.085775 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df760af6-79db-4907-8e5d-84e6f8a066a6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:50.088220 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df760af6-79db-4907-8e5d-84e6f8a066a6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:50.089108 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df760af6-79db-4907-8e5d-84e6f8a066a6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:51.030510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-df760af6-79db-4907-8e5d-84e6f8a066a6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:51.049861 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-df760af6-79db-4907-8e5d-84e6f8a066a6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:51.051379 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-df760af6-79db-4907-8e5d-84e6f8a066a6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:51.053110 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-df760af6-79db-4907-8e5d-84e6f8a066a6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1811 microversion: 2.20 time: 0.993648 Oct 26 13:35:51.073847 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2977/5922] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:35:50 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1811 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:35:52.107226 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-59a19d5f-a538-418f-a5b0-90c2582651a7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:35:52.108044 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-59a19d5f-a538-418f-a5b0-90c2582651a7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:35:52.120128 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59a19d5f-a538-418f-a5b0-90c2582651a7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:52.123432 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59a19d5f-a538-418f-a5b0-90c2582651a7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:52.124029 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59a19d5f-a538-418f-a5b0-90c2582651a7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:52.125162 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59a19d5f-a538-418f-a5b0-90c2582651a7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:52.126528 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59a19d5f-a538-418f-a5b0-90c2582651a7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:52.133474 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59a19d5f-a538-418f-a5b0-90c2582651a7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:52.735606 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-59a19d5f-a538-418f-a5b0-90c2582651a7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:52.745095 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-59a19d5f-a538-418f-a5b0-90c2582651a7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:52.757126 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-59a19d5f-a538-418f-a5b0-90c2582651a7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:52.758674 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-59a19d5f-a538-418f-a5b0-90c2582651a7 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1811 microversion: 2.20 time: 0.656377 Oct 26 13:35:52.759511 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2946/5923] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:35:52 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1811 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:35:53.791799 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-97f6bba9-b1fe-45a4-a168-8d1bad2c3cae tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:35:53.793147 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-97f6bba9-b1fe-45a4-a168-8d1bad2c3cae tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:35:53.815545 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97f6bba9-b1fe-45a4-a168-8d1bad2c3cae tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:53.816437 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97f6bba9-b1fe-45a4-a168-8d1bad2c3cae tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:53.818315 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97f6bba9-b1fe-45a4-a168-8d1bad2c3cae tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:53.820715 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97f6bba9-b1fe-45a4-a168-8d1bad2c3cae tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:53.826293 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97f6bba9-b1fe-45a4-a168-8d1bad2c3cae tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:53.827029 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97f6bba9-b1fe-45a4-a168-8d1bad2c3cae tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:54.500698 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-97f6bba9-b1fe-45a4-a168-8d1bad2c3cae tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:54.510246 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-97f6bba9-b1fe-45a4-a168-8d1bad2c3cae tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:54.515288 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-97f6bba9-b1fe-45a4-a168-8d1bad2c3cae tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:54.519900 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-97f6bba9-b1fe-45a4-a168-8d1bad2c3cae tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1811 microversion: 2.20 time: 0.733245 Oct 26 13:35:54.523475 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2978/5924] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:35:53 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1811 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:35:55.556514 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-81677a7f-277c-4c9f-a4d9-e6d564f9ffa0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:35:55.557905 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-81677a7f-277c-4c9f-a4d9-e6d564f9ffa0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:35:55.576104 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81677a7f-277c-4c9f-a4d9-e6d564f9ffa0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:55.576619 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81677a7f-277c-4c9f-a4d9-e6d564f9ffa0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:55.577062 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81677a7f-277c-4c9f-a4d9-e6d564f9ffa0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:55.577998 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81677a7f-277c-4c9f-a4d9-e6d564f9ffa0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:55.578655 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81677a7f-277c-4c9f-a4d9-e6d564f9ffa0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:55.579261 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81677a7f-277c-4c9f-a4d9-e6d564f9ffa0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:55.765744 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-81677a7f-277c-4c9f-a4d9-e6d564f9ffa0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:55.777909 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-81677a7f-277c-4c9f-a4d9-e6d564f9ffa0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:55.779869 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-81677a7f-277c-4c9f-a4d9-e6d564f9ffa0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:55.781373 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-81677a7f-277c-4c9f-a4d9-e6d564f9ffa0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1811 microversion: 2.20 time: 0.229763 Oct 26 13:35:55.782642 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2947/5925] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:35:55 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1811 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:35:56.816292 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0199f27f-75a6-465a-82ce-d6f465e0bc7c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:35:56.816945 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0199f27f-75a6-465a-82ce-d6f465e0bc7c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:35:56.825953 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0199f27f-75a6-465a-82ce-d6f465e0bc7c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:56.827110 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0199f27f-75a6-465a-82ce-d6f465e0bc7c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:56.827623 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0199f27f-75a6-465a-82ce-d6f465e0bc7c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:56.828359 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0199f27f-75a6-465a-82ce-d6f465e0bc7c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:56.829036 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0199f27f-75a6-465a-82ce-d6f465e0bc7c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:56.829511 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0199f27f-75a6-465a-82ce-d6f465e0bc7c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:57.322978 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0199f27f-75a6-465a-82ce-d6f465e0bc7c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:57.402198 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0199f27f-75a6-465a-82ce-d6f465e0bc7c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:57.409650 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0199f27f-75a6-465a-82ce-d6f465e0bc7c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:57.413812 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0199f27f-75a6-465a-82ce-d6f465e0bc7c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1811 microversion: 2.20 time: 0.601991 Oct 26 13:35:57.445797 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2979/5926] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:35:56 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1811 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:35:58.467624 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8cc7b847-d220-497b-87c8-a1c1bd834f27 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:35:58.467624 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8cc7b847-d220-497b-87c8-a1c1bd834f27 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:35:58.475333 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8cc7b847-d220-497b-87c8-a1c1bd834f27 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:58.480716 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8cc7b847-d220-497b-87c8-a1c1bd834f27 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:58.481404 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8cc7b847-d220-497b-87c8-a1c1bd834f27 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:58.482959 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8cc7b847-d220-497b-87c8-a1c1bd834f27 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:35:58.482959 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8cc7b847-d220-497b-87c8-a1c1bd834f27 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:35:58.483209 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8cc7b847-d220-497b-87c8-a1c1bd834f27 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:35:59.064100 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8cc7b847-d220-497b-87c8-a1c1bd834f27 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:59.085084 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8cc7b847-d220-497b-87c8-a1c1bd834f27 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:59.095121 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8cc7b847-d220-497b-87c8-a1c1bd834f27 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:35:59.100076 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8cc7b847-d220-497b-87c8-a1c1bd834f27 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1811 microversion: 2.20 time: 0.639026 Oct 26 13:35:59.113123 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2948/5927] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:35:58 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1811 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:36:00.127266 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-285440a7-d6d3-49fb-bc75-1e29b45a58cb tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:36:00.138397 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-285440a7-d6d3-49fb-bc75-1e29b45a58cb tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:36:00.163726 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-285440a7-d6d3-49fb-bc75-1e29b45a58cb tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:00.164231 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-285440a7-d6d3-49fb-bc75-1e29b45a58cb tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:00.164680 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-285440a7-d6d3-49fb-bc75-1e29b45a58cb tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:00.170482 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-285440a7-d6d3-49fb-bc75-1e29b45a58cb tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:00.171075 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-285440a7-d6d3-49fb-bc75-1e29b45a58cb tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:00.171539 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-285440a7-d6d3-49fb-bc75-1e29b45a58cb tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:00.650053 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-285440a7-d6d3-49fb-bc75-1e29b45a58cb tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:36:00.659198 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-285440a7-d6d3-49fb-bc75-1e29b45a58cb tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:36:00.660938 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-285440a7-d6d3-49fb-bc75-1e29b45a58cb tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:36:00.671237 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-285440a7-d6d3-49fb-bc75-1e29b45a58cb tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1811 microversion: 2.20 time: 0.547837 Oct 26 13:36:00.690255 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2980/5928] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:36:00 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1811 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:36:01.721308 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2646eb9e-5737-495b-a4a6-e974021e318c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:36:01.722285 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2646eb9e-5737-495b-a4a6-e974021e318c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:36:01.736720 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2646eb9e-5737-495b-a4a6-e974021e318c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:01.746443 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2646eb9e-5737-495b-a4a6-e974021e318c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:01.746998 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2646eb9e-5737-495b-a4a6-e974021e318c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:01.759657 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2646eb9e-5737-495b-a4a6-e974021e318c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:01.760265 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2646eb9e-5737-495b-a4a6-e974021e318c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:01.768747 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2646eb9e-5737-495b-a4a6-e974021e318c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:01.773247 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=54 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:36:02.509924 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2646eb9e-5737-495b-a4a6-e974021e318c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:36:02.527990 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2646eb9e-5737-495b-a4a6-e974021e318c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:36:02.533270 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2646eb9e-5737-495b-a4a6-e974021e318c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:36:02.539778 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2646eb9e-5737-495b-a4a6-e974021e318c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1811 microversion: 2.20 time: 0.823403 Oct 26 13:36:02.545369 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2949/5929] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:36:01 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1811 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:36:03.575758 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-763bb22a-b86e-4d9b-8d2e-101fe9c402e0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:36:03.576464 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-763bb22a-b86e-4d9b-8d2e-101fe9c402e0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:36:03.607724 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-763bb22a-b86e-4d9b-8d2e-101fe9c402e0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:03.609808 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-763bb22a-b86e-4d9b-8d2e-101fe9c402e0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:03.610297 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-763bb22a-b86e-4d9b-8d2e-101fe9c402e0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:03.611035 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-763bb22a-b86e-4d9b-8d2e-101fe9c402e0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:03.612959 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-763bb22a-b86e-4d9b-8d2e-101fe9c402e0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:03.613392 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-763bb22a-b86e-4d9b-8d2e-101fe9c402e0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:03.714526 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=54 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:36:03.945107 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-d99fc287-a4f7-40ed-91ac-1e6cd3905401 req-0709e69c-f051-4663-a7a7-df14994f2a44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c95d88e-349c-4594-b0a2-351b507f34f9", "name": "network-vif-plugged", "status": "completed", "tag": "f0e9fd1e-4a27-44e9-903e-5bbaaf376cb8"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:36:03.980581 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d99fc287-a4f7-40ed-91ac-1e6cd3905401 req-0709e69c-f051-4663-a7a7-df14994f2a44 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:03.982985 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d99fc287-a4f7-40ed-91ac-1e6cd3905401 req-0709e69c-f051-4663-a7a7-df14994f2a44 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:03.984290 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d99fc287-a4f7-40ed-91ac-1e6cd3905401 req-0709e69c-f051-4663-a7a7-df14994f2a44 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:04.031038 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-d99fc287-a4f7-40ed-91ac-1e6cd3905401 req-0709e69c-f051-4663-a7a7-df14994f2a44 service nova] Creating event network-vif-plugged:f0e9fd1e-4a27-44e9-903e-5bbaaf376cb8 for instance 6c95d88e-349c-4594-b0a2-351b507f34f9 on n-h2-862686-1 Oct 26 13:36:04.054464 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-d99fc287-a4f7-40ed-91ac-1e6cd3905401 req-0709e69c-f051-4663-a7a7-df14994f2a44 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114228 Oct 26 13:36:04.059454 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2950/5930] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:36:04.216768 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-763bb22a-b86e-4d9b-8d2e-101fe9c402e0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:36:04.240748 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-763bb22a-b86e-4d9b-8d2e-101fe9c402e0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:36:04.253112 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-763bb22a-b86e-4d9b-8d2e-101fe9c402e0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:36:04.256297 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-763bb22a-b86e-4d9b-8d2e-101fe9c402e0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1811 microversion: 2.20 time: 0.688570 Oct 26 13:36:04.262593 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2981/5931] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:36:03 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1811 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:36:05.294428 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c7b29249-03a2-4b1e-a8d1-a53670538abf tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:36:05.295124 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c7b29249-03a2-4b1e-a8d1-a53670538abf tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:36:05.310357 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c7b29249-03a2-4b1e-a8d1-a53670538abf tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:05.310844 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c7b29249-03a2-4b1e-a8d1-a53670538abf tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:05.311281 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c7b29249-03a2-4b1e-a8d1-a53670538abf tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:05.312101 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c7b29249-03a2-4b1e-a8d1-a53670538abf tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:05.312556 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c7b29249-03a2-4b1e-a8d1-a53670538abf tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:05.313075 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c7b29249-03a2-4b1e-a8d1-a53670538abf tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:05.756356 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c7b29249-03a2-4b1e-a8d1-a53670538abf tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:36:05.770191 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c7b29249-03a2-4b1e-a8d1-a53670538abf tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:36:05.772510 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c7b29249-03a2-4b1e-a8d1-a53670538abf tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:36:05.778955 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c7b29249-03a2-4b1e-a8d1-a53670538abf tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1811 microversion: 2.20 time: 0.488813 Oct 26 13:36:05.790053 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2951/5932] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:36:05 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1811 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:36:06.811328 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6479b6aa-e6e4-4444-8b46-17b502bacf30 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:36:06.812141 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6479b6aa-e6e4-4444-8b46-17b502bacf30 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:36:06.822805 n-d-862686-1 devstack@n-api.service[120598]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 13:36:06.823384 n-d-862686-1 devstack@n-api.service[120598]: Wed Oct 26 13:36:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 (ip 10.222.0.40) !!! Oct 26 13:36:06.849445 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6479b6aa-e6e4-4444-8b46-17b502bacf30 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:06.862564 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6479b6aa-e6e4-4444-8b46-17b502bacf30 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:06.869584 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6479b6aa-e6e4-4444-8b46-17b502bacf30 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:06.872196 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6479b6aa-e6e4-4444-8b46-17b502bacf30 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:06.879747 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6479b6aa-e6e4-4444-8b46-17b502bacf30 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:06.881166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6479b6aa-e6e4-4444-8b46-17b502bacf30 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:07.421188 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6479b6aa-e6e4-4444-8b46-17b502bacf30 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:36:07.437263 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6479b6aa-e6e4-4444-8b46-17b502bacf30 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:36:07.439750 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6479b6aa-e6e4-4444-8b46-17b502bacf30 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:36:07.441233 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6479b6aa-e6e4-4444-8b46-17b502bacf30 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1811 microversion: 2.20 time: 0.635656 Oct 26 13:36:07.442130 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2982/5933] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:36:06 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1811 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:36:08.471706 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5ab4e603-626c-4844-8fd6-6dbf996c9d57 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:36:08.472319 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5ab4e603-626c-4844-8fd6-6dbf996c9d57 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:36:08.476633 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=20 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:36:08.504874 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ab4e603-626c-4844-8fd6-6dbf996c9d57 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:08.505556 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ab4e603-626c-4844-8fd6-6dbf996c9d57 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:08.505962 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ab4e603-626c-4844-8fd6-6dbf996c9d57 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:08.506873 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ab4e603-626c-4844-8fd6-6dbf996c9d57 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:08.507158 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ab4e603-626c-4844-8fd6-6dbf996c9d57 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:08.507591 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ab4e603-626c-4844-8fd6-6dbf996c9d57 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:09.088003 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5ab4e603-626c-4844-8fd6-6dbf996c9d57 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:36:09.104197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5ab4e603-626c-4844-8fd6-6dbf996c9d57 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:36:09.107025 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5ab4e603-626c-4844-8fd6-6dbf996c9d57 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:36:09.108733 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5ab4e603-626c-4844-8fd6-6dbf996c9d57 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1798 microversion: 2.20 time: 0.641264 Oct 26 13:36:09.125518 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2952/5934] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:36:08 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1798 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:36:41.051282 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d81ca3d3-e2cf-4ce5-be5b-1b15248651e1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:36:41.051963 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d81ca3d3-e2cf-4ce5-be5b-1b15248651e1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:36:41.060407 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=17 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:36:41.062814 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=11 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:36:41.076128 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d81ca3d3-e2cf-4ce5-be5b-1b15248651e1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:41.077645 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d81ca3d3-e2cf-4ce5-be5b-1b15248651e1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:41.078900 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d81ca3d3-e2cf-4ce5-be5b-1b15248651e1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:41.084631 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d81ca3d3-e2cf-4ce5-be5b-1b15248651e1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:41.090092 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d81ca3d3-e2cf-4ce5-be5b-1b15248651e1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:41.092820 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d81ca3d3-e2cf-4ce5-be5b-1b15248651e1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:41.216465 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d81ca3d3-e2cf-4ce5-be5b-1b15248651e1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9/os-volume_attachments/7a3633aa-4ff4-4e29-8bec-bd627addad51" status: 200 len: 194 microversion: 2.20 time: 0.169232 Oct 26 13:36:41.226203 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2983/5935] 10.222.0.40 () {60 vars in 1454 bytes} [Wed Oct 26 13:36:41 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9/os-volume_attachments/7a3633aa-4ff4-4e29-8bec-bd627addad51 => generated 194 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:36:41.431739 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:36:41.433702 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=19 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:36:41.439930 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9ee7a609-39ac-4d95-ac00-d646649b064d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:36:41.440679 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9ee7a609-39ac-4d95-ac00-d646649b064d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:36:41.469742 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9ee7a609-39ac-4d95-ac00-d646649b064d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:41.470251 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9ee7a609-39ac-4d95-ac00-d646649b064d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:41.474028 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9ee7a609-39ac-4d95-ac00-d646649b064d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:41.482029 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9ee7a609-39ac-4d95-ac00-d646649b064d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:41.485904 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9ee7a609-39ac-4d95-ac00-d646649b064d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:41.486930 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9ee7a609-39ac-4d95-ac00-d646649b064d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:41.726032 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-9ee7a609-39ac-4d95-ac00-d646649b064d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lazy-loading 'services' on Instance uuid 6c95d88e-349c-4594-b0a2-351b507f34f9 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:36:41.947587 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9ee7a609-39ac-4d95-ac00-d646649b064d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9/os-volume_attachments/7a3633aa-4ff4-4e29-8bec-bd627addad51" status: 202 len: 0 microversion: 2.20 time: 0.515561 Oct 26 13:36:41.949278 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2953/5936] 10.222.0.40 () {60 vars in 1457 bytes} [Wed Oct 26 13:36:41 2022] DELETE /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9/os-volume_attachments/7a3633aa-4ff4-4e29-8bec-bd627addad51 => generated 0 bytes in 520 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 26 13:36:41.966050 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2a85bfff-2eff-4856-a68d-2dbd3ab5f96c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:36:41.971976 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2a85bfff-2eff-4856-a68d-2dbd3ab5f96c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:36:42.010008 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2a85bfff-2eff-4856-a68d-2dbd3ab5f96c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:42.010918 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2a85bfff-2eff-4856-a68d-2dbd3ab5f96c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:42.012102 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2a85bfff-2eff-4856-a68d-2dbd3ab5f96c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:42.016484 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2a85bfff-2eff-4856-a68d-2dbd3ab5f96c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:42.018205 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2a85bfff-2eff-4856-a68d-2dbd3ab5f96c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:42.020864 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2a85bfff-2eff-4856-a68d-2dbd3ab5f96c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:42.136348 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2a85bfff-2eff-4856-a68d-2dbd3ab5f96c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.182532 Oct 26 13:36:42.144517 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2984/5937] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Oct 26 13:36:41 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9/os-volume_attachments => generated 197 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:36:43.155588 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-91e71cba-6b9f-4e08-bc89-9fbc3432095b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:36:43.159321 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-91e71cba-6b9f-4e08-bc89-9fbc3432095b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:36:43.182367 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91e71cba-6b9f-4e08-bc89-9fbc3432095b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:43.183083 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91e71cba-6b9f-4e08-bc89-9fbc3432095b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:43.183709 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91e71cba-6b9f-4e08-bc89-9fbc3432095b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:43.184606 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91e71cba-6b9f-4e08-bc89-9fbc3432095b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:43.185381 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91e71cba-6b9f-4e08-bc89-9fbc3432095b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:43.186018 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91e71cba-6b9f-4e08-bc89-9fbc3432095b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:43.298034 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-91e71cba-6b9f-4e08-bc89-9fbc3432095b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.150841 Oct 26 13:36:43.304688 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2954/5938] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Oct 26 13:36:43 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:36:44.311720 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b9aa72ac-a002-49d6-bdf8-6b2641d74330 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:36:44.322942 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b9aa72ac-a002-49d6-bdf8-6b2641d74330 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:36:44.339474 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9aa72ac-a002-49d6-bdf8-6b2641d74330 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:44.347797 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9aa72ac-a002-49d6-bdf8-6b2641d74330 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:44.349295 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9aa72ac-a002-49d6-bdf8-6b2641d74330 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:44.350345 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9aa72ac-a002-49d6-bdf8-6b2641d74330 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:44.351018 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9aa72ac-a002-49d6-bdf8-6b2641d74330 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:44.351632 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9aa72ac-a002-49d6-bdf8-6b2641d74330 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:44.443900 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b9aa72ac-a002-49d6-bdf8-6b2641d74330 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.136231 Oct 26 13:36:44.487456 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2985/5939] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Oct 26 13:36:44 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9/os-volume_attachments => generated 197 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:36:45.467154 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b08bbba5-6a29-4abd-b2c4-1f44c1a19afc tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:36:45.469820 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b08bbba5-6a29-4abd-b2c4-1f44c1a19afc tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:36:45.504991 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b08bbba5-6a29-4abd-b2c4-1f44c1a19afc tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:45.505509 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b08bbba5-6a29-4abd-b2c4-1f44c1a19afc tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:45.505958 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b08bbba5-6a29-4abd-b2c4-1f44c1a19afc tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:45.513727 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b08bbba5-6a29-4abd-b2c4-1f44c1a19afc tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:45.516878 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b08bbba5-6a29-4abd-b2c4-1f44c1a19afc tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:45.517565 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b08bbba5-6a29-4abd-b2c4-1f44c1a19afc tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:45.634004 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b08bbba5-6a29-4abd-b2c4-1f44c1a19afc tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.180825 Oct 26 13:36:45.688257 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2955/5940] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Oct 26 13:36:45 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9/os-volume_attachments => generated 197 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:36:46.695311 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-eda8eadf-503c-46b1-bbf3-d4cdc952a5e5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:36:46.698881 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-eda8eadf-503c-46b1-bbf3-d4cdc952a5e5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:36:46.751471 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eda8eadf-503c-46b1-bbf3-d4cdc952a5e5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:46.751996 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eda8eadf-503c-46b1-bbf3-d4cdc952a5e5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:46.757004 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eda8eadf-503c-46b1-bbf3-d4cdc952a5e5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:46.757869 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eda8eadf-503c-46b1-bbf3-d4cdc952a5e5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:46.758365 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eda8eadf-503c-46b1-bbf3-d4cdc952a5e5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:46.758856 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eda8eadf-503c-46b1-bbf3-d4cdc952a5e5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:46.930918 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-eda8eadf-503c-46b1-bbf3-d4cdc952a5e5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.248907 Oct 26 13:36:46.939781 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2986/5941] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Oct 26 13:36:46 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9/os-volume_attachments => generated 197 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:36:47.945830 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-160af31c-6008-418a-8df8-fbaf0510a3d0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:36:47.948180 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-160af31c-6008-418a-8df8-fbaf0510a3d0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:36:47.979841 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-160af31c-6008-418a-8df8-fbaf0510a3d0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:47.984386 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-160af31c-6008-418a-8df8-fbaf0510a3d0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:47.985036 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-160af31c-6008-418a-8df8-fbaf0510a3d0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:47.987182 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-160af31c-6008-418a-8df8-fbaf0510a3d0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:47.991352 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-160af31c-6008-418a-8df8-fbaf0510a3d0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:47.992624 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-160af31c-6008-418a-8df8-fbaf0510a3d0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:48.207138 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-160af31c-6008-418a-8df8-fbaf0510a3d0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.258081 Oct 26 13:36:48.225256 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2956/5942] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Oct 26 13:36:47 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9/os-volume_attachments => generated 197 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:36:49.220781 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3e661b8d-36f6-48f4-a022-bb5dec47fa6a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:36:49.224097 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3e661b8d-36f6-48f4-a022-bb5dec47fa6a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:36:49.263001 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3e661b8d-36f6-48f4-a022-bb5dec47fa6a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:49.275339 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3e661b8d-36f6-48f4-a022-bb5dec47fa6a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:49.276991 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3e661b8d-36f6-48f4-a022-bb5dec47fa6a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:49.278083 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3e661b8d-36f6-48f4-a022-bb5dec47fa6a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:49.278970 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3e661b8d-36f6-48f4-a022-bb5dec47fa6a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:49.279644 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3e661b8d-36f6-48f4-a022-bb5dec47fa6a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:49.354946 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3e661b8d-36f6-48f4-a022-bb5dec47fa6a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.133793 Oct 26 13:36:49.356238 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2987/5943] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Oct 26 13:36:49 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:36:50.370395 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3e477942-c100-4b50-b869-65b380b3eb78 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:36:50.374013 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3e477942-c100-4b50-b869-65b380b3eb78 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:36:50.398557 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3e477942-c100-4b50-b869-65b380b3eb78 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:50.404547 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3e477942-c100-4b50-b869-65b380b3eb78 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:50.405147 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3e477942-c100-4b50-b869-65b380b3eb78 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:50.406811 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3e477942-c100-4b50-b869-65b380b3eb78 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:50.408183 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3e477942-c100-4b50-b869-65b380b3eb78 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:50.408742 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3e477942-c100-4b50-b869-65b380b3eb78 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:50.501426 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3e477942-c100-4b50-b869-65b380b3eb78 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.135252 Oct 26 13:36:50.523818 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2957/5944] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Oct 26 13:36:50 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:36:51.515213 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e12afbcd-496f-4f3d-aa2a-bc7339a474e2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:36:51.518233 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e12afbcd-496f-4f3d-aa2a-bc7339a474e2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:36:51.550406 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e12afbcd-496f-4f3d-aa2a-bc7339a474e2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:51.554678 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e12afbcd-496f-4f3d-aa2a-bc7339a474e2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:51.555428 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e12afbcd-496f-4f3d-aa2a-bc7339a474e2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:51.556273 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e12afbcd-496f-4f3d-aa2a-bc7339a474e2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:51.557754 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e12afbcd-496f-4f3d-aa2a-bc7339a474e2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:51.562335 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e12afbcd-496f-4f3d-aa2a-bc7339a474e2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:51.631901 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e12afbcd-496f-4f3d-aa2a-bc7339a474e2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.121182 Oct 26 13:36:51.635166 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2988/5945] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Oct 26 13:36:51 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:36:51.748384 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a3e69343-4832-442c-8ed4-4f326117fb5a tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1279997328", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "0f29f5ba-7035-45a3-b34e-7bdf182d867f"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:36:51.887848 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-a3e69343-4832-442c-8ed4-4f326117fb5a tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] validate_networks() for [('0f29f5ba-7035-45a3-b34e-7bdf182d867f', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:36:52.646823 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d0323401-67bc-452d-b122-7c253a8d6c64 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:36:52.649144 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d0323401-67bc-452d-b122-7c253a8d6c64 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:36:52.663912 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0323401-67bc-452d-b122-7c253a8d6c64 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:52.664683 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0323401-67bc-452d-b122-7c253a8d6c64 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:52.669073 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0323401-67bc-452d-b122-7c253a8d6c64 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:52.670154 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0323401-67bc-452d-b122-7c253a8d6c64 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:52.670818 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0323401-67bc-452d-b122-7c253a8d6c64 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:52.671432 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0323401-67bc-452d-b122-7c253a8d6c64 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:52.739646 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d0323401-67bc-452d-b122-7c253a8d6c64 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.097237 Oct 26 13:36:52.741754 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2989/5946] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Oct 26 13:36:52 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 26 13:36:53.387802 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-a3e69343-4832-442c-8ed4-4f326117fb5a tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:36:53.388921 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-a3e69343-4832-442c-8ed4-4f326117fb5a tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:36:53.389603 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-a3e69343-4832-442c-8ed4-4f326117fb5a tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:36:53.390190 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-a3e69343-4832-442c-8ed4-4f326117fb5a tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:36:53.390771 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-a3e69343-4832-442c-8ed4-4f326117fb5a tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:36:53.415265 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a3e69343-4832-442c-8ed4-4f326117fb5a tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:53.417162 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a3e69343-4832-442c-8ed4-4f326117fb5a tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:53.419890 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a3e69343-4832-442c-8ed4-4f326117fb5a tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:53.421733 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a3e69343-4832-442c-8ed4-4f326117fb5a tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:53.424619 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a3e69343-4832-442c-8ed4-4f326117fb5a tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:53.428447 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a3e69343-4832-442c-8ed4-4f326117fb5a tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:53.471857 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-a3e69343-4832-442c-8ed4-4f326117fb5a tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Getting quotas for project 6fd47c4f41a64b56b1b571ab5bcd9bef. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:36:53.483756 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-a3e69343-4832-442c-8ed4-4f326117fb5a tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Getting quotas for user 6c55ea80b2e14c99baf3d551f00bfa68 and project 6fd47c4f41a64b56b1b571ab5bcd9bef. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:36:53.505249 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a3e69343-4832-442c-8ed4-4f326117fb5a tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:36:53.508834 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a3e69343-4832-442c-8ed4-4f326117fb5a tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: 01414eaf-51ba-4f6a-b53a-3bf52d82ace4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:36:53.575867 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a3e69343-4832-442c-8ed4-4f326117fb5a tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.834455 Oct 26 13:36:53.577397 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2958/5947] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:36:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:36:53.591492 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fb2027c0-c84a-4764-a907-867c2b29b44e tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:36:53.592536 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fb2027c0-c84a-4764-a907-867c2b29b44e tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: 01414eaf-51ba-4f6a-b53a-3bf52d82ace4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:36:53.711741 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fb2027c0-c84a-4764-a907-867c2b29b44e tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c55ea80b2e14c99baf3d551f00bfa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd47c4f41a64b56b1b571ab5bcd9bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:36:53.731811 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fb2027c0-c84a-4764-a907-867c2b29b44e tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "GET /compute/v2.1/servers/01414eaf-51ba-4f6a-b53a-3bf52d82ace4" status: 200 len: 1219 microversion: 2.1 time: 0.146519 Oct 26 13:36:53.733784 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2990/5948] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:36:53 2022] GET /compute/v2.1/servers/01414eaf-51ba-4f6a-b53a-3bf52d82ace4 => generated 1219 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:36:53.758353 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1b0fb013-37d8-4004-aec5-5e0e84b681b2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:36:53.762484 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1b0fb013-37d8-4004-aec5-5e0e84b681b2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:36:53.772693 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b0fb013-37d8-4004-aec5-5e0e84b681b2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:53.773928 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b0fb013-37d8-4004-aec5-5e0e84b681b2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:53.775448 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b0fb013-37d8-4004-aec5-5e0e84b681b2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:53.777007 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b0fb013-37d8-4004-aec5-5e0e84b681b2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:53.779870 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b0fb013-37d8-4004-aec5-5e0e84b681b2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:53.780598 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b0fb013-37d8-4004-aec5-5e0e84b681b2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:53.844617 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1b0fb013-37d8-4004-aec5-5e0e84b681b2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.095322 Oct 26 13:36:53.852132 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2959/5949] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Oct 26 13:36:53 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:36:54.766440 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-566c1514-e780-407d-bed8-166b253c107c tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:36:54.767243 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-566c1514-e780-407d-bed8-166b253c107c tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: 01414eaf-51ba-4f6a-b53a-3bf52d82ace4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:36:54.859599 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1e5a452b-b500-4bbc-861c-5bb655a43825 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:36:54.861913 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1e5a452b-b500-4bbc-861c-5bb655a43825 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:36:54.884159 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1e5a452b-b500-4bbc-861c-5bb655a43825 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:54.887637 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1e5a452b-b500-4bbc-861c-5bb655a43825 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:54.890025 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1e5a452b-b500-4bbc-861c-5bb655a43825 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:54.892521 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1e5a452b-b500-4bbc-861c-5bb655a43825 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:54.893984 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1e5a452b-b500-4bbc-861c-5bb655a43825 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:54.896674 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1e5a452b-b500-4bbc-861c-5bb655a43825 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:54.982163 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1e5a452b-b500-4bbc-861c-5bb655a43825 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.127073 Oct 26 13:36:54.987128 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2960/5950] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Oct 26 13:36:54 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:36:55.270815 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-566c1514-e780-407d-bed8-166b253c107c tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c55ea80b2e14c99baf3d551f00bfa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd47c4f41a64b56b1b571ab5bcd9bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:36:55.289294 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-566c1514-e780-407d-bed8-166b253c107c tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "GET /compute/v2.1/servers/01414eaf-51ba-4f6a-b53a-3bf52d82ace4" status: 200 len: 1219 microversion: 2.1 time: 0.536805 Oct 26 13:36:55.296642 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2991/5951] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:36:54 2022] GET /compute/v2.1/servers/01414eaf-51ba-4f6a-b53a-3bf52d82ace4 => generated 1219 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:36:56.010894 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d444309b-cf8d-4d4a-b90e-0a6c3d1ebe2b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:36:56.024139 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d444309b-cf8d-4d4a-b90e-0a6c3d1ebe2b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:36:56.056195 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d444309b-cf8d-4d4a-b90e-0a6c3d1ebe2b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:56.056997 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d444309b-cf8d-4d4a-b90e-0a6c3d1ebe2b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:56.057638 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d444309b-cf8d-4d4a-b90e-0a6c3d1ebe2b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:56.059673 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d444309b-cf8d-4d4a-b90e-0a6c3d1ebe2b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:56.060479 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d444309b-cf8d-4d4a-b90e-0a6c3d1ebe2b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:56.061172 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d444309b-cf8d-4d4a-b90e-0a6c3d1ebe2b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:56.113257 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d444309b-cf8d-4d4a-b90e-0a6c3d1ebe2b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.120090 Oct 26 13:36:56.123842 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2961/5952] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Oct 26 13:36:55 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9/os-volume_attachments => generated 25 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:36:56.234625 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-acc47a6b-6fd6-4762-b65e-615fb3d4734b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:36:56.235125 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-acc47a6b-6fd6-4762-b65e-615fb3d4734b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:36:56.251059 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-acc47a6b-6fd6-4762-b65e-615fb3d4734b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:56.251563 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-acc47a6b-6fd6-4762-b65e-615fb3d4734b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:56.252003 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-acc47a6b-6fd6-4762-b65e-615fb3d4734b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:56.252724 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-acc47a6b-6fd6-4762-b65e-615fb3d4734b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:56.253176 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-acc47a6b-6fd6-4762-b65e-615fb3d4734b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:56.253634 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-acc47a6b-6fd6-4762-b65e-615fb3d4734b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:56.321330 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-00e6f7c6-2a15-459e-bc41-c7424e96775b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:36:56.322354 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-00e6f7c6-2a15-459e-bc41-c7424e96775b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: 01414eaf-51ba-4f6a-b53a-3bf52d82ace4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:36:56.327098 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-acc47a6b-6fd6-4762-b65e-615fb3d4734b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:36:56.333237 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-00e6f7c6-2a15-459e-bc41-c7424e96775b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:56.336370 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-00e6f7c6-2a15-459e-bc41-c7424e96775b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:56.338005 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-00e6f7c6-2a15-459e-bc41-c7424e96775b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:56.339104 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-00e6f7c6-2a15-459e-bc41-c7424e96775b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:56.342168 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-00e6f7c6-2a15-459e-bc41-c7424e96775b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:56.344097 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-00e6f7c6-2a15-459e-bc41-c7424e96775b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:56.575189 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-acc47a6b-6fd6-4762-b65e-615fb3d4734b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 204 len: 0 microversion: 2.20 time: 0.342847 Oct 26 13:36:56.575942 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2992/5953] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 26 13:36:56 2022] DELETE /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 13:36:56.595084 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-43791c7b-3ddd-474d-b730-83f5a6394839 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:36:56.598522 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-43791c7b-3ddd-474d-b730-83f5a6394839 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:36:56.615192 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-43791c7b-3ddd-474d-b730-83f5a6394839 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:56.615726 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-43791c7b-3ddd-474d-b730-83f5a6394839 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:56.616175 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-43791c7b-3ddd-474d-b730-83f5a6394839 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:56.616899 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-43791c7b-3ddd-474d-b730-83f5a6394839 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:56.617356 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-43791c7b-3ddd-474d-b730-83f5a6394839 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:56.617807 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-43791c7b-3ddd-474d-b730-83f5a6394839 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:56.687296 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-00e6f7c6-2a15-459e-bc41-c7424e96775b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c55ea80b2e14c99baf3d551f00bfa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd47c4f41a64b56b1b571ab5bcd9bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:36:56.703235 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-00e6f7c6-2a15-459e-bc41-c7424e96775b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "GET /compute/v2.1/servers/01414eaf-51ba-4f6a-b53a-3bf52d82ace4" status: 200 len: 1223 microversion: 2.1 time: 0.386458 Oct 26 13:36:56.709404 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2962/5954] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:36:56 2022] GET /compute/v2.1/servers/01414eaf-51ba-4f6a-b53a-3bf52d82ace4 => generated 1223 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:36:57.397853 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-43791c7b-3ddd-474d-b730-83f5a6394839 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:36:57.409548 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-43791c7b-3ddd-474d-b730-83f5a6394839 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:36:57.421855 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-43791c7b-3ddd-474d-b730-83f5a6394839 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:36:57.423412 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-43791c7b-3ddd-474d-b730-83f5a6394839 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1726 microversion: 2.20 time: 0.841218 Oct 26 13:36:57.424755 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2993/5955] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:36:56 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1726 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:36:57.735490 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bc5b7d29-b760-46a3-811c-2ea482f8cfaa tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:36:57.736727 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bc5b7d29-b760-46a3-811c-2ea482f8cfaa tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: 01414eaf-51ba-4f6a-b53a-3bf52d82ace4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:36:57.764565 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc5b7d29-b760-46a3-811c-2ea482f8cfaa tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:57.765849 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc5b7d29-b760-46a3-811c-2ea482f8cfaa tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:57.767562 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc5b7d29-b760-46a3-811c-2ea482f8cfaa tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:57.770469 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc5b7d29-b760-46a3-811c-2ea482f8cfaa tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:57.774987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc5b7d29-b760-46a3-811c-2ea482f8cfaa tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:57.775706 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bc5b7d29-b760-46a3-811c-2ea482f8cfaa tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:58.108297 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bc5b7d29-b760-46a3-811c-2ea482f8cfaa tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c55ea80b2e14c99baf3d551f00bfa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd47c4f41a64b56b1b571ab5bcd9bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:36:58.126433 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bc5b7d29-b760-46a3-811c-2ea482f8cfaa tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "GET /compute/v2.1/servers/01414eaf-51ba-4f6a-b53a-3bf52d82ace4" status: 200 len: 1279 microversion: 2.1 time: 0.394649 Oct 26 13:36:58.175053 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2963/5956] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:36:57 2022] GET /compute/v2.1/servers/01414eaf-51ba-4f6a-b53a-3bf52d82ace4 => generated 1279 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:36:58.455304 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bed5127c-748f-4bcf-8eea-f412cf6ffdbb tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:36:58.456045 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bed5127c-748f-4bcf-8eea-f412cf6ffdbb tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:36:58.473900 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bed5127c-748f-4bcf-8eea-f412cf6ffdbb tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:58.475349 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bed5127c-748f-4bcf-8eea-f412cf6ffdbb tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:58.476508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bed5127c-748f-4bcf-8eea-f412cf6ffdbb tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:58.479065 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bed5127c-748f-4bcf-8eea-f412cf6ffdbb tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:58.484065 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bed5127c-748f-4bcf-8eea-f412cf6ffdbb tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:58.484884 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bed5127c-748f-4bcf-8eea-f412cf6ffdbb tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:59.150985 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1ac65db7-4db5-4f21-9621-bf9287dfb720 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:36:59.152572 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1ac65db7-4db5-4f21-9621-bf9287dfb720 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: 01414eaf-51ba-4f6a-b53a-3bf52d82ace4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:36:59.166927 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1ac65db7-4db5-4f21-9621-bf9287dfb720 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:59.170197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1ac65db7-4db5-4f21-9621-bf9287dfb720 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:59.170895 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1ac65db7-4db5-4f21-9621-bf9287dfb720 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:59.173536 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1ac65db7-4db5-4f21-9621-bf9287dfb720 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:36:59.174216 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1ac65db7-4db5-4f21-9621-bf9287dfb720 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:36:59.175998 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1ac65db7-4db5-4f21-9621-bf9287dfb720 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:36:59.703152 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bed5127c-748f-4bcf-8eea-f412cf6ffdbb tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:36:59.716557 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bed5127c-748f-4bcf-8eea-f412cf6ffdbb tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:36:59.719791 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bed5127c-748f-4bcf-8eea-f412cf6ffdbb tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:36:59.725167 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bed5127c-748f-4bcf-8eea-f412cf6ffdbb tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1726 microversion: 2.20 time: 1.273827 Oct 26 13:36:59.726164 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2994/5957] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:36:58 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1726 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:36:59.779759 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1ac65db7-4db5-4f21-9621-bf9287dfb720 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c55ea80b2e14c99baf3d551f00bfa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd47c4f41a64b56b1b571ab5bcd9bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:36:59.796706 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1ac65db7-4db5-4f21-9621-bf9287dfb720 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "GET /compute/v2.1/servers/01414eaf-51ba-4f6a-b53a-3bf52d82ace4" status: 200 len: 1277 microversion: 2.1 time: 0.649874 Oct 26 13:36:59.797883 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2964/5958] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:36:59 2022] GET /compute/v2.1/servers/01414eaf-51ba-4f6a-b53a-3bf52d82ace4 => generated 1277 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:37:00.751620 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7a557073-f534-421c-9997-1d121881abc5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:37:00.755630 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7a557073-f534-421c-9997-1d121881abc5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:37:00.768404 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a557073-f534-421c-9997-1d121881abc5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:00.769504 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a557073-f534-421c-9997-1d121881abc5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:00.770942 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a557073-f534-421c-9997-1d121881abc5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:00.774477 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a557073-f534-421c-9997-1d121881abc5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:00.776257 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a557073-f534-421c-9997-1d121881abc5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:00.776989 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a557073-f534-421c-9997-1d121881abc5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:00.824261 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f090382e-4386-43d7-ae06-3662c13be898 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:37:00.825638 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f090382e-4386-43d7-ae06-3662c13be898 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: 01414eaf-51ba-4f6a-b53a-3bf52d82ace4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:37:00.879707 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f090382e-4386-43d7-ae06-3662c13be898 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:00.880344 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f090382e-4386-43d7-ae06-3662c13be898 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:00.880800 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f090382e-4386-43d7-ae06-3662c13be898 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:00.881573 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f090382e-4386-43d7-ae06-3662c13be898 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:00.882555 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f090382e-4386-43d7-ae06-3662c13be898 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:00.882555 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f090382e-4386-43d7-ae06-3662c13be898 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:01.232129 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7a557073-f534-421c-9997-1d121881abc5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:01.249674 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7a557073-f534-421c-9997-1d121881abc5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:01.261792 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7a557073-f534-421c-9997-1d121881abc5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:01.264304 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7a557073-f534-421c-9997-1d121881abc5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1726 microversion: 2.20 time: 0.515709 Oct 26 13:37:01.281625 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2995/5959] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:37:00 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1726 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:37:01.875438 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f090382e-4386-43d7-ae06-3662c13be898 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c55ea80b2e14c99baf3d551f00bfa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd47c4f41a64b56b1b571ab5bcd9bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:01.896860 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f090382e-4386-43d7-ae06-3662c13be898 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "GET /compute/v2.1/servers/01414eaf-51ba-4f6a-b53a-3bf52d82ace4" status: 200 len: 1319 microversion: 2.1 time: 1.071867 Oct 26 13:37:01.901134 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2965/5960] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:37:00 2022] GET /compute/v2.1/servers/01414eaf-51ba-4f6a-b53a-3bf52d82ace4 => generated 1319 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:37:02.299552 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5afa6a96-c308-44cb-8c66-d1e490e5ea20 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:37:02.301651 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5afa6a96-c308-44cb-8c66-d1e490e5ea20 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:37:02.335237 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5afa6a96-c308-44cb-8c66-d1e490e5ea20 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:02.336868 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5afa6a96-c308-44cb-8c66-d1e490e5ea20 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:02.338770 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5afa6a96-c308-44cb-8c66-d1e490e5ea20 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:02.341461 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5afa6a96-c308-44cb-8c66-d1e490e5ea20 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:02.345265 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5afa6a96-c308-44cb-8c66-d1e490e5ea20 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:02.346576 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5afa6a96-c308-44cb-8c66-d1e490e5ea20 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:02.698177 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5afa6a96-c308-44cb-8c66-d1e490e5ea20 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:02.709922 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5afa6a96-c308-44cb-8c66-d1e490e5ea20 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:02.719018 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5afa6a96-c308-44cb-8c66-d1e490e5ea20 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:02.722021 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5afa6a96-c308-44cb-8c66-d1e490e5ea20 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1658 microversion: 2.20 time: 0.426548 Oct 26 13:37:02.725348 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2996/5961] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:37:02 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1658 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:37:02.929223 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9c141f06-c80a-432f-9629-f167db2f2f1b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:37:02.930180 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9c141f06-c80a-432f-9629-f167db2f2f1b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: 01414eaf-51ba-4f6a-b53a-3bf52d82ace4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:37:02.943750 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c141f06-c80a-432f-9629-f167db2f2f1b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:02.944246 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c141f06-c80a-432f-9629-f167db2f2f1b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:02.944688 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c141f06-c80a-432f-9629-f167db2f2f1b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:02.948488 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c141f06-c80a-432f-9629-f167db2f2f1b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:02.953428 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c141f06-c80a-432f-9629-f167db2f2f1b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:02.953854 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c141f06-c80a-432f-9629-f167db2f2f1b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:03.324226 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9c141f06-c80a-432f-9629-f167db2f2f1b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c55ea80b2e14c99baf3d551f00bfa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd47c4f41a64b56b1b571ab5bcd9bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:03.344622 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9c141f06-c80a-432f-9629-f167db2f2f1b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "GET /compute/v2.1/servers/01414eaf-51ba-4f6a-b53a-3bf52d82ace4" status: 200 len: 1319 microversion: 2.1 time: 0.423173 Oct 26 13:37:03.345243 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2966/5962] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:37:02 2022] GET /compute/v2.1/servers/01414eaf-51ba-4f6a-b53a-3bf52d82ace4 => generated 1319 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:37:03.764228 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4b46c636-8a50-42a3-b3db-c3f8bdf50b2f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:37:03.764855 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4b46c636-8a50-42a3-b3db-c3f8bdf50b2f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:37:03.767039 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:37:03.767882 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:37:03.787982 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4b46c636-8a50-42a3-b3db-c3f8bdf50b2f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:03.788474 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4b46c636-8a50-42a3-b3db-c3f8bdf50b2f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:03.788917 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4b46c636-8a50-42a3-b3db-c3f8bdf50b2f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:03.789667 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4b46c636-8a50-42a3-b3db-c3f8bdf50b2f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:03.790129 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4b46c636-8a50-42a3-b3db-c3f8bdf50b2f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:03.790561 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4b46c636-8a50-42a3-b3db-c3f8bdf50b2f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:03.910217 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-03ba5155-b7d1-4a62-ad94-41448b3979ae req-a0ce54e5-a28c-4093-b02e-5e4f9e804896 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c95d88e-349c-4594-b0a2-351b507f34f9", "name": "network-vif-deleted", "tag": "f0e9fd1e-4a27-44e9-903e-5bbaaf376cb8"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:37:03.929993 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-03ba5155-b7d1-4a62-ad94-41448b3979ae req-a0ce54e5-a28c-4093-b02e-5e4f9e804896 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:03.932823 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-03ba5155-b7d1-4a62-ad94-41448b3979ae req-a0ce54e5-a28c-4093-b02e-5e4f9e804896 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:03.933690 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-03ba5155-b7d1-4a62-ad94-41448b3979ae req-a0ce54e5-a28c-4093-b02e-5e4f9e804896 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:03.958345 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4b46c636-8a50-42a3-b3db-c3f8bdf50b2f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:03.958942 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4b46c636-8a50-42a3-b3db-c3f8bdf50b2f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:03.959267 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4b46c636-8a50-42a3-b3db-c3f8bdf50b2f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:03.974993 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-4b46c636-8a50-42a3-b3db-c3f8bdf50b2f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lazy-loading 'fault' on Instance uuid 6c95d88e-349c-4594-b0a2-351b507f34f9 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:37:03.987203 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-03ba5155-b7d1-4a62-ad94-41448b3979ae req-a0ce54e5-a28c-4093-b02e-5e4f9e804896 service nova] Creating event network-vif-deleted:f0e9fd1e-4a27-44e9-903e-5bbaaf376cb8 for instance 6c95d88e-349c-4594-b0a2-351b507f34f9 on n-h2-862686-1 Oct 26 13:37:03.997993 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-03ba5155-b7d1-4a62-ad94-41448b3979ae req-a0ce54e5-a28c-4093-b02e-5e4f9e804896 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.577552 Oct 26 13:37:04.003956 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2997/5963] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:37:04.375348 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0c8e5c9d-f94b-4394-9f52-a49e69f3d285 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:37:04.376210 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0c8e5c9d-f94b-4394-9f52-a49e69f3d285 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: 01414eaf-51ba-4f6a-b53a-3bf52d82ace4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:37:04.390142 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0c8e5c9d-f94b-4394-9f52-a49e69f3d285 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:04.390658 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0c8e5c9d-f94b-4394-9f52-a49e69f3d285 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:04.391112 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0c8e5c9d-f94b-4394-9f52-a49e69f3d285 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:04.409237 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0c8e5c9d-f94b-4394-9f52-a49e69f3d285 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:04.412240 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0c8e5c9d-f94b-4394-9f52-a49e69f3d285 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:04.412924 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0c8e5c9d-f94b-4394-9f52-a49e69f3d285 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:04.677442 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4b46c636-8a50-42a3-b3db-c3f8bdf50b2f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:04.685311 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4b46c636-8a50-42a3-b3db-c3f8bdf50b2f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:04.695466 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4b46c636-8a50-42a3-b3db-c3f8bdf50b2f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:04.696700 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4b46c636-8a50-42a3-b3db-c3f8bdf50b2f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 200 len: 1372 microversion: 2.20 time: 0.937145 Oct 26 13:37:04.697270 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2967/5964] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:37:03 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 1372 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:37:05.289639 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=4 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:37:05.314179 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0c8e5c9d-f94b-4394-9f52-a49e69f3d285 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c55ea80b2e14c99baf3d551f00bfa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd47c4f41a64b56b1b571ab5bcd9bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:05.330813 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0c8e5c9d-f94b-4394-9f52-a49e69f3d285 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "GET /compute/v2.1/servers/01414eaf-51ba-4f6a-b53a-3bf52d82ace4" status: 200 len: 1319 microversion: 2.1 time: 0.961899 Oct 26 13:37:05.333766 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2998/5965] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:37:04 2022] GET /compute/v2.1/servers/01414eaf-51ba-4f6a-b53a-3bf52d82ace4 => generated 1319 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:37:05.731979 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-33e092ec-192f-4239-846e-001f7fcb70ea tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:37:05.736391 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-33e092ec-192f-4239-846e-001f7fcb70ea tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:37:05.745747 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-33e092ec-192f-4239-846e-001f7fcb70ea tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:05.750174 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-33e092ec-192f-4239-846e-001f7fcb70ea tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:05.751477 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-33e092ec-192f-4239-846e-001f7fcb70ea tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:05.755075 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-33e092ec-192f-4239-846e-001f7fcb70ea tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:05.755781 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-33e092ec-192f-4239-846e-001f7fcb70ea tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:05.756593 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-33e092ec-192f-4239-846e-001f7fcb70ea tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:05.788643 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-33e092ec-192f-4239-846e-001f7fcb70ea tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] HTTP exception thrown: Instance 6c95d88e-349c-4594-b0a2-351b507f34f9 could not be found. Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-33e092ec-192f-4239-846e-001f7fcb70ea tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Request method failure captured: Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 HTTP/1.1 Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTb_SeVtemuJoE-71HmnihPaaJODA1AQWjpkEt0luprtCRN4_bHwtOXFjQ32WbAFpXXcnTxvDO9VucoT3yEAu2b90JvvWgE57_hUXg8ZYvPGr30mOSBo5xhgO2akhVaBje7aa2nlEAIIXas1qs2AGbNhTOJH956A7IRZisbUICAaREg Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: X-Openstack-Nova-Api-Version: 2.20 Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: b383d6b193c64891ac63f3a26c996e20 Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1662277167 Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b383d6b193c64891ac63f3a26c996e20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b383d6b193c64891ac63f3a26c996e20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b383d6b193c64891ac63f3a26c996e20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b383d6b193c64891ac63f3a26c996e20"}]}] Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1662277167 Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: b383d6b193c64891ac63f3a26c996e20 Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1662277167 Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-AttachVolumeShelveTestJSON-1662277167-project Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: ac38637c647f4ddc84566bc6896ebabb Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1662277167-project Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 6c95d88e-349c-4594-b0a2-351b507f34f9 could not be found. Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '6c95d88e-349c-4594-b0a2-351b507f34f9'} Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c95d88e-349c-4594-b0a2-351b507f34f9 could not be found. Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c95d88e-349c-4594-b0a2-351b507f34f9 could not be found. Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:37:05.798504 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:37:05.804433 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:37:05.804433 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:37:05.804433 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:37:05.804433 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:37:05.804433 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:37:05.804433 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:37:05.804433 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c95d88e-349c-4594-b0a2-351b507f34f9 could not be found. Oct 26 13:37:05.804433 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:37:05.806251 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-33e092ec-192f-4239-846e-001f7fcb70ea tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Returning 404 to user: Instance 6c95d88e-349c-4594-b0a2-351b507f34f9 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:37:05.807319 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-33e092ec-192f-4239-846e-001f7fcb70ea tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 404 len: 111 microversion: 2.20 time: 0.082106 Oct 26 13:37:05.808086 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2968/5966] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:37:05 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:37:05.818654 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a87d1af0-67c9-49ea-b4d1-9f7811fd1aca tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '.version_select at 0x7f6731f54ca0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:37:05.852555 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a87d1af0-67c9-49ea-b4d1-9f7811fd1aca tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1716804817" status: 204 len: 0 microversion: 2.20 time: 0.038216 Oct 26 13:37:05.853946 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2999/5967] 10.222.0.40 () {60 vars in 1262 bytes} [Wed Oct 26 13:37:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1716804817 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 13:37:06.359484 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4e6b8184-020c-4d57-9b70-45639d5976a6 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:37:06.360181 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4e6b8184-020c-4d57-9b70-45639d5976a6 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: 01414eaf-51ba-4f6a-b53a-3bf52d82ace4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:37:06.368478 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e6b8184-020c-4d57-9b70-45639d5976a6 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:06.369669 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e6b8184-020c-4d57-9b70-45639d5976a6 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:06.370594 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e6b8184-020c-4d57-9b70-45639d5976a6 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:06.379433 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e6b8184-020c-4d57-9b70-45639d5976a6 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:06.380473 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e6b8184-020c-4d57-9b70-45639d5976a6 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:06.381112 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e6b8184-020c-4d57-9b70-45639d5976a6 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:06.650880 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-8b8db3e1-5020-4e50-a708-096d3ee0fee9 req-baf02eb1-28ba-4723-b5b5-3050878cc062 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01414eaf-51ba-4f6a-b53a-3bf52d82ace4", "tag": "9486eb9b-f355-4c77-ae1f-4f228757810d"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:37:06.663930 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8b8db3e1-5020-4e50-a708-096d3ee0fee9 req-baf02eb1-28ba-4723-b5b5-3050878cc062 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:06.664694 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8b8db3e1-5020-4e50-a708-096d3ee0fee9 req-baf02eb1-28ba-4723-b5b5-3050878cc062 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:06.665248 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8b8db3e1-5020-4e50-a708-096d3ee0fee9 req-baf02eb1-28ba-4723-b5b5-3050878cc062 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:06.686521 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-8b8db3e1-5020-4e50-a708-096d3ee0fee9 req-baf02eb1-28ba-4723-b5b5-3050878cc062 service nova] Creating event network-changed:9486eb9b-f355-4c77-ae1f-4f228757810d for instance 01414eaf-51ba-4f6a-b53a-3bf52d82ace4 on n-h1-862686-1 Oct 26 13:37:06.701258 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-8b8db3e1-5020-4e50-a708-096d3ee0fee9 req-baf02eb1-28ba-4723-b5b5-3050878cc062 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054414 Oct 26 13:37:06.705390 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3000/5968] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:37:07.027149 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4e6b8184-020c-4d57-9b70-45639d5976a6 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c55ea80b2e14c99baf3d551f00bfa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd47c4f41a64b56b1b571ab5bcd9bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:07.034836 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:37:07.041425 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4e6b8184-020c-4d57-9b70-45639d5976a6 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "GET /compute/v2.1/servers/01414eaf-51ba-4f6a-b53a-3bf52d82ace4" status: 200 len: 1319 microversion: 2.1 time: 0.685742 Oct 26 13:37:07.043923 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2969/5969] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:37:06 2022] GET /compute/v2.1/servers/01414eaf-51ba-4f6a-b53a-3bf52d82ace4 => generated 1319 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:37:08.043691 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e491a47b-54d0-41a3-92fa-c0cc0bbb0218 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Action: 'create', calling method: .version_select at 0x7f6732442f70>, body: {"keypair": {"name": "tempest-keypair-2030326391", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCptOzacbB3RbIHREjbSC0EwX9yGRjJk2spnZY9hlLqWkdjtepsE3akO1HUtCv4Jlc6c19uKsmaK7jERL/4o3k4kN21JQVWFzhFEwJx0IDIuGmi/EeHgj1AtWG4IvXKqw=="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:37:08.071576 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8208a51e-55e1-4a0e-955c-26705fcce0ab tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:37:08.072720 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8208a51e-55e1-4a0e-955c-26705fcce0ab tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: 01414eaf-51ba-4f6a-b53a-3bf52d82ace4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:37:08.098885 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8208a51e-55e1-4a0e-955c-26705fcce0ab tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:08.099541 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8208a51e-55e1-4a0e-955c-26705fcce0ab tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:08.099912 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8208a51e-55e1-4a0e-955c-26705fcce0ab tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:08.100686 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8208a51e-55e1-4a0e-955c-26705fcce0ab tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:08.101182 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8208a51e-55e1-4a0e-955c-26705fcce0ab tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:08.121841 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8208a51e-55e1-4a0e-955c-26705fcce0ab tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:08.126205 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-e491a47b-54d0-41a3-92fa-c0cc0bbb0218 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Getting quotas for project b383d6b193c64891ac63f3a26c996e20. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:37:08.149847 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-e491a47b-54d0-41a3-92fa-c0cc0bbb0218 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Getting quotas for user ac38637c647f4ddc84566bc6896ebabb and project b383d6b193c64891ac63f3a26c996e20. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:37:08.239800 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e491a47b-54d0-41a3-92fa-c0cc0bbb0218 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.200636 Oct 26 13:37:08.244780 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3001/5970] 10.222.0.40 () {62 vars in 1200 bytes} [Wed Oct 26 13:37:08 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 204 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 26 13:37:08.724835 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8208a51e-55e1-4a0e-955c-26705fcce0ab tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c55ea80b2e14c99baf3d551f00bfa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd47c4f41a64b56b1b571ab5bcd9bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:08.735282 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8208a51e-55e1-4a0e-955c-26705fcce0ab tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "GET /compute/v2.1/servers/01414eaf-51ba-4f6a-b53a-3bf52d82ace4" status: 200 len: 1319 microversion: 2.1 time: 0.669054 Oct 26 13:37:08.757627 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2970/5971] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:37:08 2022] GET /compute/v2.1/servers/01414eaf-51ba-4f6a-b53a-3bf52d82ace4 => generated 1319 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:37:09.768919 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c723ee98-7d56-42dc-a417-16c0a997fdd2 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:37:09.772108 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c723ee98-7d56-42dc-a417-16c0a997fdd2 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: 01414eaf-51ba-4f6a-b53a-3bf52d82ace4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:37:09.788912 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c723ee98-7d56-42dc-a417-16c0a997fdd2 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:09.794671 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c723ee98-7d56-42dc-a417-16c0a997fdd2 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:09.799500 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c723ee98-7d56-42dc-a417-16c0a997fdd2 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:09.800516 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c723ee98-7d56-42dc-a417-16c0a997fdd2 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:09.803186 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c723ee98-7d56-42dc-a417-16c0a997fdd2 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:09.806021 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c723ee98-7d56-42dc-a417-16c0a997fdd2 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:10.412297 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c723ee98-7d56-42dc-a417-16c0a997fdd2 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c55ea80b2e14c99baf3d551f00bfa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd47c4f41a64b56b1b571ab5bcd9bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:10.423208 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c723ee98-7d56-42dc-a417-16c0a997fdd2 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "GET /compute/v2.1/servers/01414eaf-51ba-4f6a-b53a-3bf52d82ace4" status: 200 len: 1319 microversion: 2.1 time: 0.661018 Oct 26 13:37:10.441635 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3002/5972] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:37:09 2022] GET /compute/v2.1/servers/01414eaf-51ba-4f6a-b53a-3bf52d82ace4 => generated 1319 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:37:11.463067 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c8cc5860-c05a-46f5-aa27-77f88314a9db tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:37:11.463709 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c8cc5860-c05a-46f5-aa27-77f88314a9db tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: 01414eaf-51ba-4f6a-b53a-3bf52d82ace4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:37:11.484742 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c8cc5860-c05a-46f5-aa27-77f88314a9db tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:11.487813 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c8cc5860-c05a-46f5-aa27-77f88314a9db tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:11.489860 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c8cc5860-c05a-46f5-aa27-77f88314a9db tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:11.490767 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c8cc5860-c05a-46f5-aa27-77f88314a9db tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:11.493157 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c8cc5860-c05a-46f5-aa27-77f88314a9db tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:11.493820 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c8cc5860-c05a-46f5-aa27-77f88314a9db tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:12.059504 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-373ccada-096d-4668-a917-2cfc901d8822 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1194497320", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "01e7b1be-b19e-4ce7-aa3b-91385c11c108"}], "security_groups": [{"name": "tempest-securitygroup--1333907111"}], "key_name": "tempest-keypair-2030326391", "user_data": "}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:37:12.080472 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:37:12.256563 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c8cc5860-c05a-46f5-aa27-77f88314a9db tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c55ea80b2e14c99baf3d551f00bfa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd47c4f41a64b56b1b571ab5bcd9bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:12.279982 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-373ccada-096d-4668-a917-2cfc901d8822 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] validate_networks() for [('01e7b1be-b19e-4ce7-aa3b-91385c11c108', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:37:12.314510 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c8cc5860-c05a-46f5-aa27-77f88314a9db tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "GET /compute/v2.1/servers/01414eaf-51ba-4f6a-b53a-3bf52d82ace4" status: 200 len: 1319 microversion: 2.1 time: 0.861505 Oct 26 13:37:12.321534 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2971/5973] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:37:11 2022] GET /compute/v2.1/servers/01414eaf-51ba-4f6a-b53a-3bf52d82ace4 => generated 1319 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:37:12.987836 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-373ccada-096d-4668-a917-2cfc901d8822 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:37:12.988878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-373ccada-096d-4668-a917-2cfc901d8822 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:37:12.989603 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-373ccada-096d-4668-a917-2cfc901d8822 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:37:12.990222 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-373ccada-096d-4668-a917-2cfc901d8822 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:37:12.990847 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-373ccada-096d-4668-a917-2cfc901d8822 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:37:13.014269 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-373ccada-096d-4668-a917-2cfc901d8822 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:13.014786 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-373ccada-096d-4668-a917-2cfc901d8822 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:13.015236 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-373ccada-096d-4668-a917-2cfc901d8822 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:13.015989 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-373ccada-096d-4668-a917-2cfc901d8822 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:13.016453 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-373ccada-096d-4668-a917-2cfc901d8822 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:13.016888 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-373ccada-096d-4668-a917-2cfc901d8822 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:13.032040 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:37:13.050250 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-373ccada-096d-4668-a917-2cfc901d8822 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Getting quotas for project b383d6b193c64891ac63f3a26c996e20. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:37:13.062086 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-373ccada-096d-4668-a917-2cfc901d8822 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Getting quotas for user ac38637c647f4ddc84566bc6896ebabb and project b383d6b193c64891ac63f3a26c996e20. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:37:13.077611 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-373ccada-096d-4668-a917-2cfc901d8822 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:37:13.091136 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-373ccada-096d-4668-a917-2cfc901d8822 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:37:13.157245 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-373ccada-096d-4668-a917-2cfc901d8822 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.102804 Oct 26 13:37:13.164973 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3003/5974] 10.222.0.40 () {62 vars in 1188 bytes} [Wed Oct 26 13:37:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 1111 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 26 13:37:13.169610 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0c5b9489-2ae0-4116-8ca7-09e1140c566f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:37:13.170229 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0c5b9489-2ae0-4116-8ca7-09e1140c566f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:37:13.172950 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:37:13.342703 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-33109adf-7db3-41a3-b76e-f9075705fdb9 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:37:13.343568 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-33109adf-7db3-41a3-b76e-f9075705fdb9 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: 01414eaf-51ba-4f6a-b53a-3bf52d82ace4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:37:13.358234 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33109adf-7db3-41a3-b76e-f9075705fdb9 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:13.359407 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33109adf-7db3-41a3-b76e-f9075705fdb9 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:13.364585 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33109adf-7db3-41a3-b76e-f9075705fdb9 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:13.366791 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33109adf-7db3-41a3-b76e-f9075705fdb9 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:13.370145 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33109adf-7db3-41a3-b76e-f9075705fdb9 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:13.372764 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33109adf-7db3-41a3-b76e-f9075705fdb9 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:13.385904 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0c5b9489-2ae0-4116-8ca7-09e1140c566f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:13.403029 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0c5b9489-2ae0-4116-8ca7-09e1140c566f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:13.409908 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0c5b9489-2ae0-4116-8ca7-09e1140c566f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:13.413381 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0c5b9489-2ae0-4116-8ca7-09e1140c566f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1282 microversion: 2.20 time: 0.247709 Oct 26 13:37:13.415797 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2972/5975] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:37:13 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1282 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:37:13.882552 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-efc849a3-4d50-4071-b810-405d0d83f1f7 req-e58de251-f595-41d1-ba94-4852f6408741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01414eaf-51ba-4f6a-b53a-3bf52d82ace4", "name": "network-vif-plugged", "status": "completed", "tag": "9486eb9b-f355-4c77-ae1f-4f228757810d"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:37:13.929295 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-efc849a3-4d50-4071-b810-405d0d83f1f7 req-e58de251-f595-41d1-ba94-4852f6408741 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:13.929880 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-efc849a3-4d50-4071-b810-405d0d83f1f7 req-e58de251-f595-41d1-ba94-4852f6408741 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:13.930326 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-efc849a3-4d50-4071-b810-405d0d83f1f7 req-e58de251-f595-41d1-ba94-4852f6408741 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:13.949665 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-efc849a3-4d50-4071-b810-405d0d83f1f7 req-e58de251-f595-41d1-ba94-4852f6408741 service nova] Creating event network-vif-plugged:9486eb9b-f355-4c77-ae1f-4f228757810d for instance 01414eaf-51ba-4f6a-b53a-3bf52d82ace4 on n-h1-862686-1 Oct 26 13:37:13.956530 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-efc849a3-4d50-4071-b810-405d0d83f1f7 req-e58de251-f595-41d1-ba94-4852f6408741 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102430 Oct 26 13:37:13.959128 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2973/5976] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:37:14.447234 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a89b5450-081c-4f30-92cb-a1de216a1df6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:37:14.449408 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a89b5450-081c-4f30-92cb-a1de216a1df6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:37:14.479891 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a89b5450-081c-4f30-92cb-a1de216a1df6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:14.480658 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a89b5450-081c-4f30-92cb-a1de216a1df6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:14.482192 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a89b5450-081c-4f30-92cb-a1de216a1df6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:14.483098 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a89b5450-081c-4f30-92cb-a1de216a1df6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:14.486639 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a89b5450-081c-4f30-92cb-a1de216a1df6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:14.487241 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a89b5450-081c-4f30-92cb-a1de216a1df6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:14.693040 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-33109adf-7db3-41a3-b76e-f9075705fdb9 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c55ea80b2e14c99baf3d551f00bfa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd47c4f41a64b56b1b571ab5bcd9bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:14.716653 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-33109adf-7db3-41a3-b76e-f9075705fdb9 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "GET /compute/v2.1/servers/01414eaf-51ba-4f6a-b53a-3bf52d82ace4" status: 200 len: 1319 microversion: 2.1 time: 1.378492 Oct 26 13:37:14.727697 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3004/5977] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:37:13 2022] GET /compute/v2.1/servers/01414eaf-51ba-4f6a-b53a-3bf52d82ace4 => generated 1319 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:37:14.823252 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a89b5450-081c-4f30-92cb-a1de216a1df6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:14.840729 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a89b5450-081c-4f30-92cb-a1de216a1df6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:14.842489 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a89b5450-081c-4f30-92cb-a1de216a1df6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:14.843653 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a89b5450-081c-4f30-92cb-a1de216a1df6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1334 microversion: 2.20 time: 0.402059 Oct 26 13:37:14.862108 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2974/5978] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:37:14 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1334 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:37:15.748910 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b9819215-103b-446c-a28a-c1279dfb845b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:37:15.751788 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b9819215-103b-446c-a28a-c1279dfb845b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: 01414eaf-51ba-4f6a-b53a-3bf52d82ace4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:37:15.771115 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9819215-103b-446c-a28a-c1279dfb845b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:15.774239 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9819215-103b-446c-a28a-c1279dfb845b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:15.774842 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9819215-103b-446c-a28a-c1279dfb845b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:15.776652 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9819215-103b-446c-a28a-c1279dfb845b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:15.780106 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9819215-103b-446c-a28a-c1279dfb845b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:15.780890 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9819215-103b-446c-a28a-c1279dfb845b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:15.884550 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0b932e96-6b40-4168-b896-2a5d6d7126b1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:37:15.885732 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0b932e96-6b40-4168-b896-2a5d6d7126b1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:37:15.897837 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b932e96-6b40-4168-b896-2a5d6d7126b1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:15.903163 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b932e96-6b40-4168-b896-2a5d6d7126b1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:15.904157 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b932e96-6b40-4168-b896-2a5d6d7126b1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:15.905064 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b932e96-6b40-4168-b896-2a5d6d7126b1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:15.906366 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b932e96-6b40-4168-b896-2a5d6d7126b1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:15.906946 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b932e96-6b40-4168-b896-2a5d6d7126b1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:16.024598 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0b932e96-6b40-4168-b896-2a5d6d7126b1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:16.033538 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0b932e96-6b40-4168-b896-2a5d6d7126b1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:16.039982 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0b932e96-6b40-4168-b896-2a5d6d7126b1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:16.046019 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0b932e96-6b40-4168-b896-2a5d6d7126b1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1340 microversion: 2.20 time: 0.169527 Oct 26 13:37:16.046818 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2975/5979] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:37:15 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1340 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:37:16.419395 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b9819215-103b-446c-a28a-c1279dfb845b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c55ea80b2e14c99baf3d551f00bfa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd47c4f41a64b56b1b571ab5bcd9bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:16.437171 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b9819215-103b-446c-a28a-c1279dfb845b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "GET /compute/v2.1/servers/01414eaf-51ba-4f6a-b53a-3bf52d82ace4" status: 200 len: 1319 microversion: 2.1 time: 0.696451 Oct 26 13:37:16.452514 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3005/5980] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:37:15 2022] GET /compute/v2.1/servers/01414eaf-51ba-4f6a-b53a-3bf52d82ace4 => generated 1319 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:37:17.076931 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9865650e-3206-43b0-a887-34ac4105f059 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:37:17.078121 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9865650e-3206-43b0-a887-34ac4105f059 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:37:17.097469 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9865650e-3206-43b0-a887-34ac4105f059 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:17.098765 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9865650e-3206-43b0-a887-34ac4105f059 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:17.099420 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9865650e-3206-43b0-a887-34ac4105f059 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:17.100320 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9865650e-3206-43b0-a887-34ac4105f059 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:17.101062 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9865650e-3206-43b0-a887-34ac4105f059 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:17.101699 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9865650e-3206-43b0-a887-34ac4105f059 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:17.400265 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9865650e-3206-43b0-a887-34ac4105f059 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:17.446599 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9865650e-3206-43b0-a887-34ac4105f059 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:17.453352 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9865650e-3206-43b0-a887-34ac4105f059 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:17.462364 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bb3eab97-d0c8-4bad-a370-d938e4fd358f tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:37:17.465689 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9865650e-3206-43b0-a887-34ac4105f059 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1340 microversion: 2.20 time: 0.392781 Oct 26 13:37:17.465925 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bb3eab97-d0c8-4bad-a370-d938e4fd358f tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: 01414eaf-51ba-4f6a-b53a-3bf52d82ace4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:37:17.472312 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2976/5981] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:37:17 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1340 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:37:17.487594 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb3eab97-d0c8-4bad-a370-d938e4fd358f tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:17.488417 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb3eab97-d0c8-4bad-a370-d938e4fd358f tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:17.489008 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb3eab97-d0c8-4bad-a370-d938e4fd358f tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:17.489962 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb3eab97-d0c8-4bad-a370-d938e4fd358f tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:17.490595 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb3eab97-d0c8-4bad-a370-d938e4fd358f tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:17.491164 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb3eab97-d0c8-4bad-a370-d938e4fd358f tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:18.108368 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bb3eab97-d0c8-4bad-a370-d938e4fd358f tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c55ea80b2e14c99baf3d551f00bfa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd47c4f41a64b56b1b571ab5bcd9bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:18.120382 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bb3eab97-d0c8-4bad-a370-d938e4fd358f tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "GET /compute/v2.1/servers/01414eaf-51ba-4f6a-b53a-3bf52d82ace4" status: 200 len: 1508 microversion: 2.1 time: 0.661541 Oct 26 13:37:18.143682 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3006/5982] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:37:17 2022] GET /compute/v2.1/servers/01414eaf-51ba-4f6a-b53a-3bf52d82ace4 => generated 1508 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:37:18.508845 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-21e63a93-9839-4f38-944e-c9814f52cfb8 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:37:18.511136 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-21e63a93-9839-4f38-944e-c9814f52cfb8 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:37:18.542188 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-21e63a93-9839-4f38-944e-c9814f52cfb8 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:18.543854 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-21e63a93-9839-4f38-944e-c9814f52cfb8 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:18.547733 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-21e63a93-9839-4f38-944e-c9814f52cfb8 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:18.550114 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-21e63a93-9839-4f38-944e-c9814f52cfb8 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:18.553140 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-21e63a93-9839-4f38-944e-c9814f52cfb8 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:18.553901 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-21e63a93-9839-4f38-944e-c9814f52cfb8 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:19.751754 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-21e63a93-9839-4f38-944e-c9814f52cfb8 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:19.766431 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-21e63a93-9839-4f38-944e-c9814f52cfb8 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:19.788971 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-21e63a93-9839-4f38-944e-c9814f52cfb8 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:19.792240 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-21e63a93-9839-4f38-944e-c9814f52cfb8 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1408 microversion: 2.20 time: 1.294791 Oct 26 13:37:19.792822 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2977/5983] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:37:18 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1408 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:37:20.688824 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-d6ed8a47-f2d9-499f-96d1-2f30403c552f req-0aba4100-3923-4d3b-90eb-a601b2afdcb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52b4e824-6117-46a5-a005-0bef3bc75052", "tag": "86120fac-67e2-4ce8-a98b-0f683e946ba4"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:37:20.760038 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-d6ed8a47-f2d9-499f-96d1-2f30403c552f req-0aba4100-3923-4d3b-90eb-a601b2afdcb8 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:20.762261 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-d6ed8a47-f2d9-499f-96d1-2f30403c552f req-0aba4100-3923-4d3b-90eb-a601b2afdcb8 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:20.762719 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-d6ed8a47-f2d9-499f-96d1-2f30403c552f req-0aba4100-3923-4d3b-90eb-a601b2afdcb8 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:20.792783 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-d6ed8a47-f2d9-499f-96d1-2f30403c552f req-0aba4100-3923-4d3b-90eb-a601b2afdcb8 service nova] Creating event network-changed:86120fac-67e2-4ce8-a98b-0f683e946ba4 for instance 52b4e824-6117-46a5-a005-0bef3bc75052 on n-h2-862686-1 Oct 26 13:37:20.800363 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-d6ed8a47-f2d9-499f-96d1-2f30403c552f req-0aba4100-3923-4d3b-90eb-a601b2afdcb8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124338 Oct 26 13:37:20.802342 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3007/5984] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:37:20.828822 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-001ef0f5-f81e-4db7-a1b7-5edaf33c6c1a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:37:20.829575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-001ef0f5-f81e-4db7-a1b7-5edaf33c6c1a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:37:20.843264 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-001ef0f5-f81e-4db7-a1b7-5edaf33c6c1a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:20.843755 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-001ef0f5-f81e-4db7-a1b7-5edaf33c6c1a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:20.844194 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-001ef0f5-f81e-4db7-a1b7-5edaf33c6c1a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:20.849437 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-001ef0f5-f81e-4db7-a1b7-5edaf33c6c1a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:20.850018 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-001ef0f5-f81e-4db7-a1b7-5edaf33c6c1a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:20.851030 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-001ef0f5-f81e-4db7-a1b7-5edaf33c6c1a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:21.960508 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-001ef0f5-f81e-4db7-a1b7-5edaf33c6c1a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:21.977072 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-001ef0f5-f81e-4db7-a1b7-5edaf33c6c1a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:21.979039 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-001ef0f5-f81e-4db7-a1b7-5edaf33c6c1a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:21.980735 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-001ef0f5-f81e-4db7-a1b7-5edaf33c6c1a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1408 microversion: 2.20 time: 1.162405 Oct 26 13:37:22.004407 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2978/5985] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:37:20 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1408 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:37:23.015187 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-da9c9ab1-a418-4379-ac02-665ddfa59804 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:37:23.016062 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-da9c9ab1-a418-4379-ac02-665ddfa59804 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:37:23.035298 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:37:23.046361 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da9c9ab1-a418-4379-ac02-665ddfa59804 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:23.049571 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da9c9ab1-a418-4379-ac02-665ddfa59804 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:23.050509 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da9c9ab1-a418-4379-ac02-665ddfa59804 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:23.052365 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da9c9ab1-a418-4379-ac02-665ddfa59804 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:23.055791 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da9c9ab1-a418-4379-ac02-665ddfa59804 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:23.059340 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da9c9ab1-a418-4379-ac02-665ddfa59804 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:23.140057 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=10 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:37:23.943116 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-da9c9ab1-a418-4379-ac02-665ddfa59804 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:23.979770 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-da9c9ab1-a418-4379-ac02-665ddfa59804 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:23.981430 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-da9c9ab1-a418-4379-ac02-665ddfa59804 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:23.982647 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-da9c9ab1-a418-4379-ac02-665ddfa59804 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1408 microversion: 2.20 time: 0.973600 Oct 26 13:37:23.997572 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3008/5986] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:37:23 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1408 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:37:25.011120 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d1bd7c91-9bf0-42a1-bf3c-00bc23f11e1d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:37:25.012417 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d1bd7c91-9bf0-42a1-bf3c-00bc23f11e1d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:37:25.023134 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:37:25.029915 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d1bd7c91-9bf0-42a1-bf3c-00bc23f11e1d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:25.035962 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d1bd7c91-9bf0-42a1-bf3c-00bc23f11e1d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:25.036768 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d1bd7c91-9bf0-42a1-bf3c-00bc23f11e1d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:25.040744 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d1bd7c91-9bf0-42a1-bf3c-00bc23f11e1d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:25.041556 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d1bd7c91-9bf0-42a1-bf3c-00bc23f11e1d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:25.045366 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d1bd7c91-9bf0-42a1-bf3c-00bc23f11e1d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:26.139116 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d1bd7c91-9bf0-42a1-bf3c-00bc23f11e1d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:26.185059 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d1bd7c91-9bf0-42a1-bf3c-00bc23f11e1d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:26.188545 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d1bd7c91-9bf0-42a1-bf3c-00bc23f11e1d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:26.191210 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d1bd7c91-9bf0-42a1-bf3c-00bc23f11e1d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1408 microversion: 2.20 time: 1.183144 Oct 26 13:37:26.209981 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2979/5987] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:37:25 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1408 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:37:27.218473 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-58f2e761-4adf-4b08-a28d-3168560cf58e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:37:27.219012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-58f2e761-4adf-4b08-a28d-3168560cf58e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:37:27.239122 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-58f2e761-4adf-4b08-a28d-3168560cf58e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:27.239631 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-58f2e761-4adf-4b08-a28d-3168560cf58e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:27.240081 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-58f2e761-4adf-4b08-a28d-3168560cf58e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:27.252291 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-58f2e761-4adf-4b08-a28d-3168560cf58e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:27.256347 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-58f2e761-4adf-4b08-a28d-3168560cf58e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:27.257935 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-58f2e761-4adf-4b08-a28d-3168560cf58e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:28.483022 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-58f2e761-4adf-4b08-a28d-3168560cf58e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:28.499357 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-58f2e761-4adf-4b08-a28d-3168560cf58e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:28.526405 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-58f2e761-4adf-4b08-a28d-3168560cf58e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:28.529874 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-58f2e761-4adf-4b08-a28d-3168560cf58e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1408 microversion: 2.20 time: 1.315165 Oct 26 13:37:28.533561 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3009/5988] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:37:27 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1408 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:37:29.560061 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cf11d7a4-2d32-400e-a5d3-d2ba5120e4a2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:37:29.562493 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cf11d7a4-2d32-400e-a5d3-d2ba5120e4a2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:37:29.577007 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf11d7a4-2d32-400e-a5d3-d2ba5120e4a2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:29.585794 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf11d7a4-2d32-400e-a5d3-d2ba5120e4a2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:29.586482 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf11d7a4-2d32-400e-a5d3-d2ba5120e4a2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:29.587404 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf11d7a4-2d32-400e-a5d3-d2ba5120e4a2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:29.588010 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf11d7a4-2d32-400e-a5d3-d2ba5120e4a2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:29.589943 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf11d7a4-2d32-400e-a5d3-d2ba5120e4a2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:30.274631 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cf11d7a4-2d32-400e-a5d3-d2ba5120e4a2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:30.283720 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cf11d7a4-2d32-400e-a5d3-d2ba5120e4a2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:30.290617 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cf11d7a4-2d32-400e-a5d3-d2ba5120e4a2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:30.292085 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cf11d7a4-2d32-400e-a5d3-d2ba5120e4a2 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1408 microversion: 2.20 time: 0.736111 Oct 26 13:37:30.311460 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2980/5989] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:37:29 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1408 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:37:31.324397 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9529bb2c-3f93-44a2-839f-f9e39c6f8b69 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:37:31.325874 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9529bb2c-3f93-44a2-839f-f9e39c6f8b69 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:37:31.335187 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9529bb2c-3f93-44a2-839f-f9e39c6f8b69 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:31.344245 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9529bb2c-3f93-44a2-839f-f9e39c6f8b69 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:31.344941 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9529bb2c-3f93-44a2-839f-f9e39c6f8b69 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:31.346045 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9529bb2c-3f93-44a2-839f-f9e39c6f8b69 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:31.346658 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9529bb2c-3f93-44a2-839f-f9e39c6f8b69 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:31.347233 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9529bb2c-3f93-44a2-839f-f9e39c6f8b69 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:31.755532 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9529bb2c-3f93-44a2-839f-f9e39c6f8b69 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:31.764554 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9529bb2c-3f93-44a2-839f-f9e39c6f8b69 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:31.766048 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9529bb2c-3f93-44a2-839f-f9e39c6f8b69 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:31.768143 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9529bb2c-3f93-44a2-839f-f9e39c6f8b69 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1408 microversion: 2.20 time: 0.447893 Oct 26 13:37:31.770305 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3010/5990] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:37:31 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1408 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:37:32.794470 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-f7bb8566-a7f9-44b4-b52b-ce56d2aa1a97 req-be045646-27cc-4337-bbb3-8821fe4affb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52b4e824-6117-46a5-a005-0bef3bc75052", "name": "network-vif-plugged", "status": "completed", "tag": "86120fac-67e2-4ce8-a98b-0f683e946ba4"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:37:32.796518 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-844577d5-9e69-4b63-a87d-ac24a555c40a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:37:32.797922 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-844577d5-9e69-4b63-a87d-ac24a555c40a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:37:32.812998 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-844577d5-9e69-4b63-a87d-ac24a555c40a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:32.815993 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-844577d5-9e69-4b63-a87d-ac24a555c40a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:32.816882 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-844577d5-9e69-4b63-a87d-ac24a555c40a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:32.818509 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-844577d5-9e69-4b63-a87d-ac24a555c40a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:32.820253 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-844577d5-9e69-4b63-a87d-ac24a555c40a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:32.822197 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-844577d5-9e69-4b63-a87d-ac24a555c40a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:32.853308 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-f7bb8566-a7f9-44b4-b52b-ce56d2aa1a97 req-be045646-27cc-4337-bbb3-8821fe4affb1 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:32.853835 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-f7bb8566-a7f9-44b4-b52b-ce56d2aa1a97 req-be045646-27cc-4337-bbb3-8821fe4affb1 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:32.854282 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-f7bb8566-a7f9-44b4-b52b-ce56d2aa1a97 req-be045646-27cc-4337-bbb3-8821fe4affb1 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:32.940359 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-f7bb8566-a7f9-44b4-b52b-ce56d2aa1a97 req-be045646-27cc-4337-bbb3-8821fe4affb1 service nova] Creating event network-vif-plugged:86120fac-67e2-4ce8-a98b-0f683e946ba4 for instance 52b4e824-6117-46a5-a005-0bef3bc75052 on n-h2-862686-1 Oct 26 13:37:32.957245 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-f7bb8566-a7f9-44b4-b52b-ce56d2aa1a97 req-be045646-27cc-4337-bbb3-8821fe4affb1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164342 Oct 26 13:37:32.961951 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2981/5991] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:37:33.303336 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-844577d5-9e69-4b63-a87d-ac24a555c40a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:33.316722 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-844577d5-9e69-4b63-a87d-ac24a555c40a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:33.319610 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-844577d5-9e69-4b63-a87d-ac24a555c40a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:33.322474 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-844577d5-9e69-4b63-a87d-ac24a555c40a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1408 microversion: 2.20 time: 0.530089 Oct 26 13:37:33.329887 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3011/5992] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:37:32 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1408 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:37:34.354969 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-50a3283f-1401-4d83-9181-594279b17c4c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:37:34.355754 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-50a3283f-1401-4d83-9181-594279b17c4c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:37:34.390791 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-50a3283f-1401-4d83-9181-594279b17c4c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:34.392216 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-50a3283f-1401-4d83-9181-594279b17c4c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:34.395731 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-50a3283f-1401-4d83-9181-594279b17c4c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:34.396507 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-50a3283f-1401-4d83-9181-594279b17c4c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:34.396982 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-50a3283f-1401-4d83-9181-594279b17c4c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:34.397420 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-50a3283f-1401-4d83-9181-594279b17c4c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:35.125459 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-50a3283f-1401-4d83-9181-594279b17c4c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:35.135487 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-50a3283f-1401-4d83-9181-594279b17c4c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:35.148965 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-50a3283f-1401-4d83-9181-594279b17c4c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:35.153022 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-50a3283f-1401-4d83-9181-594279b17c4c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1408 microversion: 2.20 time: 0.803742 Oct 26 13:37:35.153788 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2982/5993] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:37:34 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1408 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:37:36.180985 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0ee54e99-4d74-43ee-858d-aced3030d82d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:37:36.181745 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0ee54e99-4d74-43ee-858d-aced3030d82d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:37:36.209149 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ee54e99-4d74-43ee-858d-aced3030d82d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:36.211239 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ee54e99-4d74-43ee-858d-aced3030d82d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:36.211772 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ee54e99-4d74-43ee-858d-aced3030d82d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:36.212761 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ee54e99-4d74-43ee-858d-aced3030d82d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:36.213427 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ee54e99-4d74-43ee-858d-aced3030d82d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:36.216335 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ee54e99-4d74-43ee-858d-aced3030d82d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:36.597103 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0ee54e99-4d74-43ee-858d-aced3030d82d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:36.626078 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0ee54e99-4d74-43ee-858d-aced3030d82d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:36.630983 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0ee54e99-4d74-43ee-858d-aced3030d82d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:37:36.632398 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0ee54e99-4d74-43ee-858d-aced3030d82d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1601 microversion: 2.20 time: 0.457121 Oct 26 13:37:36.651266 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3012/5994] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:37:36 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1601 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:37:36.665673 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f431bb32-aaae-49d0-8097-d806cafb9e27 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:37:36.666871 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f431bb32-aaae-49d0-8097-d806cafb9e27 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:37:36.704160 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f431bb32-aaae-49d0-8097-d806cafb9e27 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:36.704878 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f431bb32-aaae-49d0-8097-d806cafb9e27 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:36.705615 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f431bb32-aaae-49d0-8097-d806cafb9e27 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:36.707980 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f431bb32-aaae-49d0-8097-d806cafb9e27 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:36.710345 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f431bb32-aaae-49d0-8097-d806cafb9e27 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:36.710634 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f431bb32-aaae-49d0-8097-d806cafb9e27 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:36.944288 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f431bb32-aaae-49d0-8097-d806cafb9e27 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.286079 Oct 26 13:37:36.944979 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2983/5995] 10.222.0.40 () {60 vars in 1316 bytes} [Wed Oct 26 13:37:36 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052/os-interface => generated 285 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:37:42.093346 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-321c0402-1585-4252-8ee7-40e0daf9861c req-f57fe265-0c63-4272-9a27-78243d17d73c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52b4e824-6117-46a5-a005-0bef3bc75052", "tag": "86120fac-67e2-4ce8-a98b-0f683e946ba4"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:37:42.118886 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-321c0402-1585-4252-8ee7-40e0daf9861c req-f57fe265-0c63-4272-9a27-78243d17d73c service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:42.119891 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-321c0402-1585-4252-8ee7-40e0daf9861c req-f57fe265-0c63-4272-9a27-78243d17d73c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:42.120513 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-321c0402-1585-4252-8ee7-40e0daf9861c req-f57fe265-0c63-4272-9a27-78243d17d73c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:42.204226 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-321c0402-1585-4252-8ee7-40e0daf9861c req-f57fe265-0c63-4272-9a27-78243d17d73c service nova] Creating event network-changed:86120fac-67e2-4ce8-a98b-0f683e946ba4 for instance 52b4e824-6117-46a5-a005-0bef3bc75052 on n-h2-862686-1 Oct 26 13:37:42.216711 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-321c0402-1585-4252-8ee7-40e0daf9861c req-f57fe265-0c63-4272-9a27-78243d17d73c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125164 Oct 26 13:37:42.220252 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3013/5996] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:37:57.823442 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4aaa41b5-bfb0-4231-9a99-fe6497b581df tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81c6babb-15d4-4295-83d1-c4f1637f6e48", "device": "/dev/sdb"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:37:57.826067 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4aaa41b5-bfb0-4231-9a99-fe6497b581df tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: 01414eaf-51ba-4f6a-b53a-3bf52d82ace4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:37:57.835715 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=25 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:37:57.836988 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=68 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:37:57.840876 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4aaa41b5-bfb0-4231-9a99-fe6497b581df tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:57.841558 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4aaa41b5-bfb0-4231-9a99-fe6497b581df tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:57.842262 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4aaa41b5-bfb0-4231-9a99-fe6497b581df tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:57.843114 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4aaa41b5-bfb0-4231-9a99-fe6497b581df tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:37:57.843737 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4aaa41b5-bfb0-4231-9a99-fe6497b581df tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:37:57.844318 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4aaa41b5-bfb0-4231-9a99-fe6497b581df tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:37:58.691772 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4aaa41b5-bfb0-4231-9a99-fe6497b581df tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "POST /compute/v2.1/servers/01414eaf-51ba-4f6a-b53a-3bf52d82ace4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.867123 Oct 26 13:37:58.697708 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2984/5997] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Oct 26 13:37:57 2022] POST /compute/v2.1/servers/01414eaf-51ba-4f6a-b53a-3bf52d82ace4/os-volume_attachments => generated 194 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:38:02.689452 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8d57cce5-af20-45c2-8d4d-2eee92cbe819 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Action: 'create', calling method: .version_select at 0x7f67327b5790>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1563979469", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFkj63MZdQZDoqS/5JDZsXm8Trkphy1tTgmaVajZuvvFB4A+/zg0jSPEyeUVCJwu3XTptuGZB9bDEZ+WOrIX61AbBnNJyLo87la80EceVd3RqMZN47slZqJRJ6L6wGM9Zw=="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:38:02.706854 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:38:02.712382 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=53 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:38:02.735811 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-8d57cce5-af20-45c2-8d4d-2eee92cbe819 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Getting quotas for project 13767903b18d44608a0ca38724c0d10a. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:38:02.747940 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-8d57cce5-af20-45c2-8d4d-2eee92cbe819 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Getting quotas for user 35782c90feff41dea454598bb3630c02 and project 13767903b18d44608a0ca38724c0d10a. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:38:02.797597 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8d57cce5-af20-45c2-8d4d-2eee92cbe819 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.112758 Oct 26 13:38:02.798978 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3014/5998] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 13:38:02 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:38:05.951178 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d0c9ca90-71ea-4232-b27e-7d8ac7ee7845 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1945005821", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "200aeb16-b90d-4eb2-b807-48447cd72d7f", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1563979469", "security_groups": [{"name": "tempest-secgroup-smoke-1285751559"}], "networks": [{"uuid": "0822645e-7c9d-487c-988d-e50c148d43ff"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:38:06.249777 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-d0c9ca90-71ea-4232-b27e-7d8ac7ee7845 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] validate_networks() for [('0822645e-7c9d-487c-988d-e50c148d43ff', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:38:07.011594 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-d0c9ca90-71ea-4232-b27e-7d8ac7ee7845 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:38:07.012747 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-d0c9ca90-71ea-4232-b27e-7d8ac7ee7845 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:38:07.013406 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-d0c9ca90-71ea-4232-b27e-7d8ac7ee7845 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:38:07.013984 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-d0c9ca90-71ea-4232-b27e-7d8ac7ee7845 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:38:07.014549 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-d0c9ca90-71ea-4232-b27e-7d8ac7ee7845 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:38:07.037136 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d0c9ca90-71ea-4232-b27e-7d8ac7ee7845 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:07.037969 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d0c9ca90-71ea-4232-b27e-7d8ac7ee7845 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:07.038900 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d0c9ca90-71ea-4232-b27e-7d8ac7ee7845 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:07.040350 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d0c9ca90-71ea-4232-b27e-7d8ac7ee7845 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:07.040973 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d0c9ca90-71ea-4232-b27e-7d8ac7ee7845 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:07.041653 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d0c9ca90-71ea-4232-b27e-7d8ac7ee7845 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:07.068522 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-d0c9ca90-71ea-4232-b27e-7d8ac7ee7845 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Getting quotas for project 13767903b18d44608a0ca38724c0d10a. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:38:07.075885 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-d0c9ca90-71ea-4232-b27e-7d8ac7ee7845 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Getting quotas for user 35782c90feff41dea454598bb3630c02 and project 13767903b18d44608a0ca38724c0d10a. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:38:07.195785 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d0c9ca90-71ea-4232-b27e-7d8ac7ee7845 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:38:07.198300 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d0c9ca90-71ea-4232-b27e-7d8ac7ee7845 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] [instance: 65e73a8e-e75d-4efe-a886-7328b0414a1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='200aeb16-b90d-4eb2-b807-48447cd72d7f',volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:38:07.479188 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d0c9ca90-71ea-4232-b27e-7d8ac7ee7845 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.533317 Oct 26 13:38:07.479940 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2985/5999] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:38:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 1535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:38:07.493247 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3bd080b5-c2c6-483e-9cff-ae262216e3e7 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:07.494844 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3bd080b5-c2c6-483e-9cff-ae262216e3e7 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] [instance: 65e73a8e-e75d-4efe-a886-7328b0414a1e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:07.999796 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3bd080b5-c2c6-483e-9cff-ae262216e3e7 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35782c90feff41dea454598bb3630c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13767903b18d44608a0ca38724c0d10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:08.016429 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3bd080b5-c2c6-483e-9cff-ae262216e3e7 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] 10.222.0.40 "GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e" status: 200 len: 1099 microversion: 2.1 time: 0.529016 Oct 26 13:38:08.033121 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3015/6000] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:38:07 2022] GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e => generated 1099 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:38:09.043493 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a8d15041-c5b4-4705-ad98-f735be05539d tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:09.044194 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a8d15041-c5b4-4705-ad98-f735be05539d tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] [instance: 65e73a8e-e75d-4efe-a886-7328b0414a1e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:09.056960 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8d15041-c5b4-4705-ad98-f735be05539d tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:09.059383 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8d15041-c5b4-4705-ad98-f735be05539d tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:09.059899 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8d15041-c5b4-4705-ad98-f735be05539d tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:09.060833 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8d15041-c5b4-4705-ad98-f735be05539d tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:09.062715 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8d15041-c5b4-4705-ad98-f735be05539d tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:09.063324 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8d15041-c5b4-4705-ad98-f735be05539d tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:09.504682 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a8d15041-c5b4-4705-ad98-f735be05539d tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35782c90feff41dea454598bb3630c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13767903b18d44608a0ca38724c0d10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:09.519845 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a8d15041-c5b4-4705-ad98-f735be05539d tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] 10.222.0.40 "GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e" status: 200 len: 1197 microversion: 2.1 time: 0.480921 Oct 26 13:38:09.532330 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2986/6001] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:38:09 2022] GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e => generated 1197 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:38:10.548499 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-726bb98f-642b-4b8f-ae87-450653b88117 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:10.554989 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-726bb98f-642b-4b8f-ae87-450653b88117 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] [instance: 65e73a8e-e75d-4efe-a886-7328b0414a1e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:10.575561 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-726bb98f-642b-4b8f-ae87-450653b88117 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:10.578804 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-726bb98f-642b-4b8f-ae87-450653b88117 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:10.581185 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-726bb98f-642b-4b8f-ae87-450653b88117 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:10.588767 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-726bb98f-642b-4b8f-ae87-450653b88117 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:10.589755 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-726bb98f-642b-4b8f-ae87-450653b88117 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:10.590996 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-726bb98f-642b-4b8f-ae87-450653b88117 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:10.847779 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-726bb98f-642b-4b8f-ae87-450653b88117 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35782c90feff41dea454598bb3630c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13767903b18d44608a0ca38724c0d10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:10.882991 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-726bb98f-642b-4b8f-ae87-450653b88117 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] 10.222.0.40 "GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e" status: 200 len: 1215 microversion: 2.1 time: 0.339209 Oct 26 13:38:10.897926 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3016/6002] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:38:10 2022] GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e => generated 1215 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:38:11.700458 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1253c139-46fa-4da6-89f9-dc6d206f6add tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:11.700928 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1253c139-46fa-4da6-89f9-dc6d206f6add tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:11.715633 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1253c139-46fa-4da6-89f9-dc6d206f6add tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:11.716018 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1253c139-46fa-4da6-89f9-dc6d206f6add tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:11.716456 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1253c139-46fa-4da6-89f9-dc6d206f6add tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:11.717328 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1253c139-46fa-4da6-89f9-dc6d206f6add tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:11.717816 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1253c139-46fa-4da6-89f9-dc6d206f6add tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:11.719978 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1253c139-46fa-4da6-89f9-dc6d206f6add tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:11.756028 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1253c139-46fa-4da6-89f9-dc6d206f6add tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052/ips" status: 200 len: 153 microversion: 2.20 time: 0.257596 Oct 26 13:38:11.756849 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2987/6003] 10.222.0.40 () {60 vars in 1289 bytes} [Wed Oct 26 13:38:11 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052/ips => generated 153 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 26 13:38:11.912413 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0ebcd937-58c0-44a9-8c81-19281369f307 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:11.913063 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0ebcd937-58c0-44a9-8c81-19281369f307 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] [instance: 65e73a8e-e75d-4efe-a886-7328b0414a1e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:11.925266 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ebcd937-58c0-44a9-8c81-19281369f307 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:11.925781 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ebcd937-58c0-44a9-8c81-19281369f307 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:11.926217 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ebcd937-58c0-44a9-8c81-19281369f307 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:11.932831 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ebcd937-58c0-44a9-8c81-19281369f307 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:11.933325 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ebcd937-58c0-44a9-8c81-19281369f307 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:11.933809 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ebcd937-58c0-44a9-8c81-19281369f307 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:12.160775 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0ebcd937-58c0-44a9-8c81-19281369f307 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35782c90feff41dea454598bb3630c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13767903b18d44608a0ca38724c0d10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:12.171950 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0ebcd937-58c0-44a9-8c81-19281369f307 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] 10.222.0.40 "GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e" status: 200 len: 1215 microversion: 2.1 time: 0.264700 Oct 26 13:38:12.182245 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3017/6004] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:38:11 2022] GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e => generated 1215 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:38:13.209992 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-83b20f5d-c9d8-4114-9cf9-3dea4ee7c0d9 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:13.211564 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-83b20f5d-c9d8-4114-9cf9-3dea4ee7c0d9 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] [instance: 65e73a8e-e75d-4efe-a886-7328b0414a1e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:13.220089 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-83b20f5d-c9d8-4114-9cf9-3dea4ee7c0d9 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:13.220867 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-83b20f5d-c9d8-4114-9cf9-3dea4ee7c0d9 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:13.221661 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-83b20f5d-c9d8-4114-9cf9-3dea4ee7c0d9 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:13.223109 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-83b20f5d-c9d8-4114-9cf9-3dea4ee7c0d9 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:13.223716 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-83b20f5d-c9d8-4114-9cf9-3dea4ee7c0d9 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:13.224440 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-83b20f5d-c9d8-4114-9cf9-3dea4ee7c0d9 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:13.482146 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-83b20f5d-c9d8-4114-9cf9-3dea4ee7c0d9 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35782c90feff41dea454598bb3630c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13767903b18d44608a0ca38724c0d10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:13.495115 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-83b20f5d-c9d8-4114-9cf9-3dea4ee7c0d9 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] 10.222.0.40 "GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e" status: 200 len: 1283 microversion: 2.1 time: 0.289805 Oct 26 13:38:13.497455 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2988/6005] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:38:13 2022] GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e => generated 1283 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:38:14.524497 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bab11616-cb10-424a-92d8-5b4a92ef7dd9 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:14.525774 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bab11616-cb10-424a-92d8-5b4a92ef7dd9 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] [instance: 65e73a8e-e75d-4efe-a886-7328b0414a1e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:14.560283 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bab11616-cb10-424a-92d8-5b4a92ef7dd9 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:14.561455 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bab11616-cb10-424a-92d8-5b4a92ef7dd9 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:14.562964 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bab11616-cb10-424a-92d8-5b4a92ef7dd9 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:14.565144 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bab11616-cb10-424a-92d8-5b4a92ef7dd9 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:14.568204 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bab11616-cb10-424a-92d8-5b4a92ef7dd9 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:14.569233 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bab11616-cb10-424a-92d8-5b4a92ef7dd9 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:15.160704 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bab11616-cb10-424a-92d8-5b4a92ef7dd9 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35782c90feff41dea454598bb3630c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13767903b18d44608a0ca38724c0d10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:15.171131 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bab11616-cb10-424a-92d8-5b4a92ef7dd9 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] 10.222.0.40 "GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e" status: 200 len: 1283 microversion: 2.1 time: 0.652881 Oct 26 13:38:15.173975 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3018/6006] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:38:14 2022] GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e => generated 1283 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:38:15.673190 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-87f70289-f34e-4675-b96b-16453e0b0de0 req-60bda3c8-b4e8-4b9e-af50-8a2c836093e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65e73a8e-e75d-4efe-a886-7328b0414a1e", "tag": "24ca771f-2301-436c-8a32-78c33e5269cd"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:38:15.697713 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-87f70289-f34e-4675-b96b-16453e0b0de0 req-60bda3c8-b4e8-4b9e-af50-8a2c836093e2 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:15.698200 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-87f70289-f34e-4675-b96b-16453e0b0de0 req-60bda3c8-b4e8-4b9e-af50-8a2c836093e2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:15.698638 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-87f70289-f34e-4675-b96b-16453e0b0de0 req-60bda3c8-b4e8-4b9e-af50-8a2c836093e2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:15.727679 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-87f70289-f34e-4675-b96b-16453e0b0de0 req-60bda3c8-b4e8-4b9e-af50-8a2c836093e2 service nova] Creating event network-changed:24ca771f-2301-436c-8a32-78c33e5269cd for instance 65e73a8e-e75d-4efe-a886-7328b0414a1e on n-h1-862686-1 Oct 26 13:38:15.738654 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-87f70289-f34e-4675-b96b-16453e0b0de0 req-60bda3c8-b4e8-4b9e-af50-8a2c836093e2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069817 Oct 26 13:38:15.739295 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2989/6007] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:38:16.200439 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1f8b5373-7fb0-406b-95ef-2d3604085a32 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:16.201047 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1f8b5373-7fb0-406b-95ef-2d3604085a32 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] [instance: 65e73a8e-e75d-4efe-a886-7328b0414a1e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:16.217125 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f8b5373-7fb0-406b-95ef-2d3604085a32 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:16.217736 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f8b5373-7fb0-406b-95ef-2d3604085a32 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:16.220178 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f8b5373-7fb0-406b-95ef-2d3604085a32 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:16.220924 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f8b5373-7fb0-406b-95ef-2d3604085a32 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:16.221393 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f8b5373-7fb0-406b-95ef-2d3604085a32 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:16.222484 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f8b5373-7fb0-406b-95ef-2d3604085a32 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:17.178233 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1f8b5373-7fb0-406b-95ef-2d3604085a32 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35782c90feff41dea454598bb3630c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13767903b18d44608a0ca38724c0d10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:17.195180 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1f8b5373-7fb0-406b-95ef-2d3604085a32 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] 10.222.0.40 "GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e" status: 200 len: 1283 microversion: 2.1 time: 0.998613 Oct 26 13:38:17.196074 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3019/6008] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:38:16 2022] GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e => generated 1283 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:38:18.219615 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:38:18.220545 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:38:18.226628 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7d815fae-3c74-44bd-aad4-fe12031b6b64 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:18.232010 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7d815fae-3c74-44bd-aad4-fe12031b6b64 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] [instance: 65e73a8e-e75d-4efe-a886-7328b0414a1e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:18.244187 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d815fae-3c74-44bd-aad4-fe12031b6b64 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:18.244688 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d815fae-3c74-44bd-aad4-fe12031b6b64 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:18.246482 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d815fae-3c74-44bd-aad4-fe12031b6b64 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:18.247270 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d815fae-3c74-44bd-aad4-fe12031b6b64 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:18.247747 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d815fae-3c74-44bd-aad4-fe12031b6b64 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:18.248189 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d815fae-3c74-44bd-aad4-fe12031b6b64 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:18.874755 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7d815fae-3c74-44bd-aad4-fe12031b6b64 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35782c90feff41dea454598bb3630c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13767903b18d44608a0ca38724c0d10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:18.887405 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7d815fae-3c74-44bd-aad4-fe12031b6b64 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] 10.222.0.40 "GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e" status: 200 len: 1283 microversion: 2.1 time: 0.669474 Oct 26 13:38:18.895629 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2990/6009] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:38:18 2022] GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e => generated 1283 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:38:19.921801 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-25c4a4b6-db51-4bf0-b57e-58ef5762adae tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:19.924372 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-25c4a4b6-db51-4bf0-b57e-58ef5762adae tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] [instance: 65e73a8e-e75d-4efe-a886-7328b0414a1e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:19.939347 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:38:19.944444 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25c4a4b6-db51-4bf0-b57e-58ef5762adae tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:19.948488 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25c4a4b6-db51-4bf0-b57e-58ef5762adae tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:19.949209 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25c4a4b6-db51-4bf0-b57e-58ef5762adae tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:19.950202 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25c4a4b6-db51-4bf0-b57e-58ef5762adae tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:19.951192 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25c4a4b6-db51-4bf0-b57e-58ef5762adae tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:19.951841 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25c4a4b6-db51-4bf0-b57e-58ef5762adae tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:20.376968 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-25c4a4b6-db51-4bf0-b57e-58ef5762adae tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35782c90feff41dea454598bb3630c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13767903b18d44608a0ca38724c0d10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:20.392899 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-25c4a4b6-db51-4bf0-b57e-58ef5762adae tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] 10.222.0.40 "GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e" status: 200 len: 1283 microversion: 2.1 time: 0.476224 Oct 26 13:38:20.397342 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3020/6010] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:38:19 2022] GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e => generated 1283 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:38:21.423537 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bd707a3a-f4d2-46e6-b640-97a0be05f666 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:21.425720 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bd707a3a-f4d2-46e6-b640-97a0be05f666 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] [instance: 65e73a8e-e75d-4efe-a886-7328b0414a1e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:21.446304 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd707a3a-f4d2-46e6-b640-97a0be05f666 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:21.452556 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd707a3a-f4d2-46e6-b640-97a0be05f666 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:21.453330 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd707a3a-f4d2-46e6-b640-97a0be05f666 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:21.454362 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd707a3a-f4d2-46e6-b640-97a0be05f666 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:21.456855 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd707a3a-f4d2-46e6-b640-97a0be05f666 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:21.462532 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd707a3a-f4d2-46e6-b640-97a0be05f666 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:22.082737 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bd707a3a-f4d2-46e6-b640-97a0be05f666 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35782c90feff41dea454598bb3630c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13767903b18d44608a0ca38724c0d10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:22.100887 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bd707a3a-f4d2-46e6-b640-97a0be05f666 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] 10.222.0.40 "GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e" status: 200 len: 1283 microversion: 2.1 time: 0.681734 Oct 26 13:38:22.106631 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2991/6011] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:38:21 2022] GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e => generated 1283 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:38:23.125787 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7eb1d640-99b7-4865-a949-1fa5bdc1f534 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:23.126898 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7eb1d640-99b7-4865-a949-1fa5bdc1f534 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] [instance: 65e73a8e-e75d-4efe-a886-7328b0414a1e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:23.158932 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7eb1d640-99b7-4865-a949-1fa5bdc1f534 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:23.165633 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7eb1d640-99b7-4865-a949-1fa5bdc1f534 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:23.166379 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7eb1d640-99b7-4865-a949-1fa5bdc1f534 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:23.167158 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7eb1d640-99b7-4865-a949-1fa5bdc1f534 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:23.167639 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7eb1d640-99b7-4865-a949-1fa5bdc1f534 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:23.168072 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7eb1d640-99b7-4865-a949-1fa5bdc1f534 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:23.650327 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7eb1d640-99b7-4865-a949-1fa5bdc1f534 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35782c90feff41dea454598bb3630c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13767903b18d44608a0ca38724c0d10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:23.661296 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7eb1d640-99b7-4865-a949-1fa5bdc1f534 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] 10.222.0.40 "GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e" status: 200 len: 1283 microversion: 2.1 time: 0.540043 Oct 26 13:38:23.666614 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3021/6012] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:38:23 2022] GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e => generated 1283 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:38:24.015303 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c69b9601-d5df-496f-9342-9e0a8d5ddd6f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:38:24.016415 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c69b9601-d5df-496f-9342-9e0a8d5ddd6f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:24.023244 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c69b9601-d5df-496f-9342-9e0a8d5ddd6f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:24.023742 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c69b9601-d5df-496f-9342-9e0a8d5ddd6f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:24.030773 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c69b9601-d5df-496f-9342-9e0a8d5ddd6f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:24.031787 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c69b9601-d5df-496f-9342-9e0a8d5ddd6f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:24.032408 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c69b9601-d5df-496f-9342-9e0a8d5ddd6f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:24.032986 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c69b9601-d5df-496f-9342-9e0a8d5ddd6f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:24.100447 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-c69b9601-d5df-496f-9342-9e0a8d5ddd6f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lazy-loading 'flavor' on Instance uuid 52b4e824-6117-46a5-a005-0bef3bc75052 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:38:24.468360 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c69b9601-d5df-496f-9342-9e0a8d5ddd6f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "POST /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052/action" status: 202 len: 0 microversion: 2.20 time: 0.456895 Oct 26 13:38:24.473395 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2992/6013] 10.222.0.40 () {62 vars in 1319 bytes} [Wed Oct 26 13:38:24 2022] POST /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052/action => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:38:24.480098 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8cf88b51-7052-4c93-9727-30a4739038ac tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:24.480935 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8cf88b51-7052-4c93-9727-30a4739038ac tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:24.493253 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8cf88b51-7052-4c93-9727-30a4739038ac tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:24.494234 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8cf88b51-7052-4c93-9727-30a4739038ac tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:24.495594 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8cf88b51-7052-4c93-9727-30a4739038ac tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:24.496750 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8cf88b51-7052-4c93-9727-30a4739038ac tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:24.497776 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8cf88b51-7052-4c93-9727-30a4739038ac tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:24.498767 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8cf88b51-7052-4c93-9727-30a4739038ac tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:24.691011 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0742ce62-c5d2-40c1-8e97-69e8fcf93ab2 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:24.691726 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0742ce62-c5d2-40c1-8e97-69e8fcf93ab2 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] [instance: 65e73a8e-e75d-4efe-a886-7328b0414a1e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:24.700802 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0742ce62-c5d2-40c1-8e97-69e8fcf93ab2 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:24.701310 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0742ce62-c5d2-40c1-8e97-69e8fcf93ab2 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:24.701788 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0742ce62-c5d2-40c1-8e97-69e8fcf93ab2 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:24.702511 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0742ce62-c5d2-40c1-8e97-69e8fcf93ab2 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:24.702970 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0742ce62-c5d2-40c1-8e97-69e8fcf93ab2 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:24.703405 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0742ce62-c5d2-40c1-8e97-69e8fcf93ab2 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:25.195674 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0742ce62-c5d2-40c1-8e97-69e8fcf93ab2 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35782c90feff41dea454598bb3630c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13767903b18d44608a0ca38724c0d10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:25.214037 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0742ce62-c5d2-40c1-8e97-69e8fcf93ab2 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] 10.222.0.40 "GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e" status: 200 len: 1271 microversion: 2.1 time: 0.527208 Oct 26 13:38:25.219875 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2993/6014] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:38:24 2022] GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e => generated 1271 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:38:25.394493 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8cf88b51-7052-4c93-9727-30a4739038ac tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:25.403650 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8cf88b51-7052-4c93-9727-30a4739038ac tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:25.405117 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8cf88b51-7052-4c93-9727-30a4739038ac tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:25.412448 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8cf88b51-7052-4c93-9727-30a4739038ac tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1726 microversion: 2.20 time: 0.931806 Oct 26 13:38:25.413123 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3022/6015] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:38:24 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1726 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:38:26.242894 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8be3f38b-db96-43f7-b303-e8704fe3e4f6 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:26.243511 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8be3f38b-db96-43f7-b303-e8704fe3e4f6 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] [instance: 65e73a8e-e75d-4efe-a886-7328b0414a1e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:26.260562 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8be3f38b-db96-43f7-b303-e8704fe3e4f6 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:26.270096 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8be3f38b-db96-43f7-b303-e8704fe3e4f6 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:26.270668 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8be3f38b-db96-43f7-b303-e8704fe3e4f6 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:26.271447 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8be3f38b-db96-43f7-b303-e8704fe3e4f6 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:26.271928 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8be3f38b-db96-43f7-b303-e8704fe3e4f6 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:26.272363 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8be3f38b-db96-43f7-b303-e8704fe3e4f6 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:26.445229 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e0a4b037-ae67-491c-844a-b48006262e69 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:26.446818 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e0a4b037-ae67-491c-844a-b48006262e69 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:26.475342 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0a4b037-ae67-491c-844a-b48006262e69 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:26.476142 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0a4b037-ae67-491c-844a-b48006262e69 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:26.480153 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0a4b037-ae67-491c-844a-b48006262e69 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:26.492395 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0a4b037-ae67-491c-844a-b48006262e69 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:26.494714 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0a4b037-ae67-491c-844a-b48006262e69 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:26.495498 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0a4b037-ae67-491c-844a-b48006262e69 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:26.734715 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8be3f38b-db96-43f7-b303-e8704fe3e4f6 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35782c90feff41dea454598bb3630c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13767903b18d44608a0ca38724c0d10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:26.744636 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8be3f38b-db96-43f7-b303-e8704fe3e4f6 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] 10.222.0.40 "GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e" status: 200 len: 1271 microversion: 2.1 time: 0.505621 Oct 26 13:38:26.753969 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2994/6016] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:38:26 2022] GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e => generated 1271 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:38:27.105306 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e0a4b037-ae67-491c-844a-b48006262e69 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:27.118498 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e0a4b037-ae67-491c-844a-b48006262e69 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:27.131326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e0a4b037-ae67-491c-844a-b48006262e69 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:27.133030 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e0a4b037-ae67-491c-844a-b48006262e69 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1726 microversion: 2.20 time: 0.693935 Oct 26 13:38:27.133867 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3023/6017] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:38:26 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1726 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:38:27.781112 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cb51113f-f1ab-4456-a3f1-b099ef0028ad tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:27.781582 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cb51113f-f1ab-4456-a3f1-b099ef0028ad tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] [instance: 65e73a8e-e75d-4efe-a886-7328b0414a1e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:27.797701 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb51113f-f1ab-4456-a3f1-b099ef0028ad tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:27.799561 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb51113f-f1ab-4456-a3f1-b099ef0028ad tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:27.800804 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb51113f-f1ab-4456-a3f1-b099ef0028ad tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:27.802714 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb51113f-f1ab-4456-a3f1-b099ef0028ad tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:27.805257 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb51113f-f1ab-4456-a3f1-b099ef0028ad tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:27.805797 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb51113f-f1ab-4456-a3f1-b099ef0028ad tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:27.880724 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:38:28.160362 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-17aedef9-5af7-47a7-99e5-07a7f7a17c7c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:28.161124 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-17aedef9-5af7-47a7-99e5-07a7f7a17c7c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:28.177097 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17aedef9-5af7-47a7-99e5-07a7f7a17c7c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:28.177626 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17aedef9-5af7-47a7-99e5-07a7f7a17c7c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:28.178069 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17aedef9-5af7-47a7-99e5-07a7f7a17c7c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:28.178795 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17aedef9-5af7-47a7-99e5-07a7f7a17c7c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:28.179251 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17aedef9-5af7-47a7-99e5-07a7f7a17c7c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:28.179680 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17aedef9-5af7-47a7-99e5-07a7f7a17c7c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:28.675982 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cb51113f-f1ab-4456-a3f1-b099ef0028ad tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35782c90feff41dea454598bb3630c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13767903b18d44608a0ca38724c0d10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:28.685063 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cb51113f-f1ab-4456-a3f1-b099ef0028ad tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] 10.222.0.40 "GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e" status: 200 len: 1271 microversion: 2.1 time: 0.909725 Oct 26 13:38:28.702071 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2995/6018] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:38:27 2022] GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e => generated 1271 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:38:28.720799 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-17aedef9-5af7-47a7-99e5-07a7f7a17c7c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:28.733761 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-17aedef9-5af7-47a7-99e5-07a7f7a17c7c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:28.735288 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-17aedef9-5af7-47a7-99e5-07a7f7a17c7c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:28.736539 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-17aedef9-5af7-47a7-99e5-07a7f7a17c7c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1726 microversion: 2.20 time: 0.581097 Oct 26 13:38:28.763242 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3024/6019] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:38:28 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1726 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:38:29.716607 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-25a94a3d-e145-4345-b664-ff6af5c98f5b tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:29.717888 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-25a94a3d-e145-4345-b664-ff6af5c98f5b tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] [instance: 65e73a8e-e75d-4efe-a886-7328b0414a1e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:29.730646 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:38:29.733771 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-25a94a3d-e145-4345-b664-ff6af5c98f5b tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:29.734862 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-25a94a3d-e145-4345-b664-ff6af5c98f5b tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:29.735600 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-25a94a3d-e145-4345-b664-ff6af5c98f5b tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:29.740609 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-25a94a3d-e145-4345-b664-ff6af5c98f5b tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:29.742347 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-25a94a3d-e145-4345-b664-ff6af5c98f5b tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:29.746699 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-25a94a3d-e145-4345-b664-ff6af5c98f5b tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:29.795242 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e4f9def0-8b7a-4e6c-aa07-ab6791075d38 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:29.795919 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e4f9def0-8b7a-4e6c-aa07-ab6791075d38 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:29.812270 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4f9def0-8b7a-4e6c-aa07-ab6791075d38 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:29.812765 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4f9def0-8b7a-4e6c-aa07-ab6791075d38 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:29.813211 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4f9def0-8b7a-4e6c-aa07-ab6791075d38 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:29.822302 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4f9def0-8b7a-4e6c-aa07-ab6791075d38 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:29.822820 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4f9def0-8b7a-4e6c-aa07-ab6791075d38 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:29.823269 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4f9def0-8b7a-4e6c-aa07-ab6791075d38 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:30.053929 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-25a94a3d-e145-4345-b664-ff6af5c98f5b tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35782c90feff41dea454598bb3630c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13767903b18d44608a0ca38724c0d10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:30.091504 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-25a94a3d-e145-4345-b664-ff6af5c98f5b tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] 10.222.0.40 "GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e" status: 200 len: 1271 microversion: 2.1 time: 0.379482 Oct 26 13:38:30.106881 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2996/6020] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:38:29 2022] GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e => generated 1271 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:38:30.352558 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e4f9def0-8b7a-4e6c-aa07-ab6791075d38 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:30.366420 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e4f9def0-8b7a-4e6c-aa07-ab6791075d38 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:30.368498 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e4f9def0-8b7a-4e6c-aa07-ab6791075d38 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:30.369952 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e4f9def0-8b7a-4e6c-aa07-ab6791075d38 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1726 microversion: 2.20 time: 0.581790 Oct 26 13:38:30.370995 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3025/6021] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:38:29 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1726 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:38:31.129934 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-24bdab0b-d25f-46e4-8773-7b340d990592 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:31.130569 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-24bdab0b-d25f-46e4-8773-7b340d990592 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] [instance: 65e73a8e-e75d-4efe-a886-7328b0414a1e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:31.148889 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-24bdab0b-d25f-46e4-8773-7b340d990592 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:31.149392 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-24bdab0b-d25f-46e4-8773-7b340d990592 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:31.149868 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-24bdab0b-d25f-46e4-8773-7b340d990592 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:31.152741 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-24bdab0b-d25f-46e4-8773-7b340d990592 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:31.153676 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-24bdab0b-d25f-46e4-8773-7b340d990592 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:31.154316 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-24bdab0b-d25f-46e4-8773-7b340d990592 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:31.399671 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-27eec944-e362-4a8d-a373-cc7af31d0aca tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:31.400254 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-27eec944-e362-4a8d-a373-cc7af31d0aca tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:31.422725 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-27eec944-e362-4a8d-a373-cc7af31d0aca tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:31.423215 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-27eec944-e362-4a8d-a373-cc7af31d0aca tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:31.423745 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-27eec944-e362-4a8d-a373-cc7af31d0aca tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:31.424373 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-27eec944-e362-4a8d-a373-cc7af31d0aca tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:31.426133 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-27eec944-e362-4a8d-a373-cc7af31d0aca tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:31.437150 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-27eec944-e362-4a8d-a373-cc7af31d0aca tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:31.977815 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-27eec944-e362-4a8d-a373-cc7af31d0aca tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:32.000527 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-27eec944-e362-4a8d-a373-cc7af31d0aca tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:32.004105 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-27eec944-e362-4a8d-a373-cc7af31d0aca tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:32.011949 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-27eec944-e362-4a8d-a373-cc7af31d0aca tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1726 microversion: 2.20 time: 0.616259 Oct 26 13:38:32.015075 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3026/6022] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:38:31 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1726 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:38:32.228762 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-24bdab0b-d25f-46e4-8773-7b340d990592 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35782c90feff41dea454598bb3630c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13767903b18d44608a0ca38724c0d10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:32.238340 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-24bdab0b-d25f-46e4-8773-7b340d990592 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] 10.222.0.40 "GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e" status: 200 len: 1271 microversion: 2.1 time: 1.125925 Oct 26 13:38:32.247089 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2997/6023] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:38:31 2022] GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e => generated 1271 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:38:33.043272 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-47e57050-9150-4cda-8a6b-1169dc6e5e9c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:33.043887 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-47e57050-9150-4cda-8a6b-1169dc6e5e9c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:33.056630 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:38:33.058277 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47e57050-9150-4cda-8a6b-1169dc6e5e9c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:33.058714 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47e57050-9150-4cda-8a6b-1169dc6e5e9c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:33.059150 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47e57050-9150-4cda-8a6b-1169dc6e5e9c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:33.059872 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47e57050-9150-4cda-8a6b-1169dc6e5e9c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:33.060334 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47e57050-9150-4cda-8a6b-1169dc6e5e9c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:33.060763 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47e57050-9150-4cda-8a6b-1169dc6e5e9c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:33.064216 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=67 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:38:33.272293 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9210374f-bedb-44ac-b310-74a791aeff8f tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:33.274488 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9210374f-bedb-44ac-b310-74a791aeff8f tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] [instance: 65e73a8e-e75d-4efe-a886-7328b0414a1e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:33.289081 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9210374f-bedb-44ac-b310-74a791aeff8f tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:33.289843 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9210374f-bedb-44ac-b310-74a791aeff8f tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:33.290520 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9210374f-bedb-44ac-b310-74a791aeff8f tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:33.291926 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9210374f-bedb-44ac-b310-74a791aeff8f tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:33.294090 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9210374f-bedb-44ac-b310-74a791aeff8f tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:33.298182 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9210374f-bedb-44ac-b310-74a791aeff8f tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:33.552807 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-47e57050-9150-4cda-8a6b-1169dc6e5e9c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:33.578068 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-47e57050-9150-4cda-8a6b-1169dc6e5e9c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:33.579609 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-47e57050-9150-4cda-8a6b-1169dc6e5e9c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:33.593983 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-47e57050-9150-4cda-8a6b-1169dc6e5e9c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1726 microversion: 2.20 time: 0.552546 Oct 26 13:38:33.594639 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3027/6024] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:38:33 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1726 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:38:33.683660 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9210374f-bedb-44ac-b310-74a791aeff8f tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35782c90feff41dea454598bb3630c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13767903b18d44608a0ca38724c0d10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:33.700154 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9210374f-bedb-44ac-b310-74a791aeff8f tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] 10.222.0.40 "GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e" status: 200 len: 1271 microversion: 2.1 time: 0.432265 Oct 26 13:38:33.704889 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2998/6025] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:38:33 2022] GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e => generated 1271 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:38:34.631659 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6c98c43e-c9fc-4b38-b9fa-c1431138cb19 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:34.632778 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6c98c43e-c9fc-4b38-b9fa-c1431138cb19 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:34.641326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c98c43e-c9fc-4b38-b9fa-c1431138cb19 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:34.642125 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c98c43e-c9fc-4b38-b9fa-c1431138cb19 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:34.642790 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c98c43e-c9fc-4b38-b9fa-c1431138cb19 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:34.644448 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c98c43e-c9fc-4b38-b9fa-c1431138cb19 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:34.645427 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c98c43e-c9fc-4b38-b9fa-c1431138cb19 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:34.646031 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c98c43e-c9fc-4b38-b9fa-c1431138cb19 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:34.738335 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c644d04e-5234-4b59-aa27-c37f3e212a04 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:34.744817 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c644d04e-5234-4b59-aa27-c37f3e212a04 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] [instance: 65e73a8e-e75d-4efe-a886-7328b0414a1e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:34.760185 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c644d04e-5234-4b59-aa27-c37f3e212a04 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:34.760973 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c644d04e-5234-4b59-aa27-c37f3e212a04 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:34.761592 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c644d04e-5234-4b59-aa27-c37f3e212a04 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:34.762465 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c644d04e-5234-4b59-aa27-c37f3e212a04 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:34.763071 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c644d04e-5234-4b59-aa27-c37f3e212a04 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:34.763725 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c644d04e-5234-4b59-aa27-c37f3e212a04 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:35.059936 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c644d04e-5234-4b59-aa27-c37f3e212a04 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35782c90feff41dea454598bb3630c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13767903b18d44608a0ca38724c0d10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:35.088235 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c644d04e-5234-4b59-aa27-c37f3e212a04 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] 10.222.0.40 "GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e" status: 200 len: 1271 microversion: 2.1 time: 0.358989 Oct 26 13:38:35.090184 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2999/6026] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:38:34 2022] GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e => generated 1271 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:38:35.618788 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6c98c43e-c9fc-4b38-b9fa-c1431138cb19 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:35.621457 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-a1ff42b0-b046-426c-b353-13d8b8734b9f req-4f2c4318-4560-4bff-8cc2-167838c0a206 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65e73a8e-e75d-4efe-a886-7328b0414a1e", "name": "network-vif-plugged", "status": "completed", "tag": "24ca771f-2301-436c-8a32-78c33e5269cd"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:38:35.641076 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a1ff42b0-b046-426c-b353-13d8b8734b9f req-4f2c4318-4560-4bff-8cc2-167838c0a206 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:35.641883 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a1ff42b0-b046-426c-b353-13d8b8734b9f req-4f2c4318-4560-4bff-8cc2-167838c0a206 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:35.642779 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a1ff42b0-b046-426c-b353-13d8b8734b9f req-4f2c4318-4560-4bff-8cc2-167838c0a206 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:35.654843 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6c98c43e-c9fc-4b38-b9fa-c1431138cb19 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:35.669742 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-a1ff42b0-b046-426c-b353-13d8b8734b9f req-4f2c4318-4560-4bff-8cc2-167838c0a206 service nova] Creating event network-vif-plugged:24ca771f-2301-436c-8a32-78c33e5269cd for instance 65e73a8e-e75d-4efe-a886-7328b0414a1e on n-h1-862686-1 Oct 26 13:38:35.674092 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6c98c43e-c9fc-4b38-b9fa-c1431138cb19 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:35.676861 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6c98c43e-c9fc-4b38-b9fa-c1431138cb19 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1726 microversion: 2.20 time: 1.060255 Oct 26 13:38:35.678745 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3028/6027] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:38:34 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1726 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:38:35.712133 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-a1ff42b0-b046-426c-b353-13d8b8734b9f req-4f2c4318-4560-4bff-8cc2-167838c0a206 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095155 Oct 26 13:38:35.712763 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3000/6028] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:38:36.122552 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8f41d913-7a1a-4343-bb59-e4e02b282ecd tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:36.123230 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8f41d913-7a1a-4343-bb59-e4e02b282ecd tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] [instance: 65e73a8e-e75d-4efe-a886-7328b0414a1e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:36.159846 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f41d913-7a1a-4343-bb59-e4e02b282ecd tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:36.160260 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f41d913-7a1a-4343-bb59-e4e02b282ecd tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:36.160703 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f41d913-7a1a-4343-bb59-e4e02b282ecd tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:36.161423 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f41d913-7a1a-4343-bb59-e4e02b282ecd tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:36.162493 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f41d913-7a1a-4343-bb59-e4e02b282ecd tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:36.163290 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f41d913-7a1a-4343-bb59-e4e02b282ecd tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:36.603144 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8f41d913-7a1a-4343-bb59-e4e02b282ecd tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35782c90feff41dea454598bb3630c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13767903b18d44608a0ca38724c0d10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:36.630584 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8f41d913-7a1a-4343-bb59-e4e02b282ecd tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] 10.222.0.40 "GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e" status: 200 len: 1271 microversion: 2.1 time: 0.519374 Oct 26 13:38:36.642872 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3029/6029] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:38:36 2022] GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e => generated 1271 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:38:36.708567 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-919d9b6a-ed08-426f-ad99-e3cc717e024e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:36.709410 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-919d9b6a-ed08-426f-ad99-e3cc717e024e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:36.722957 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-919d9b6a-ed08-426f-ad99-e3cc717e024e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:36.727973 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-919d9b6a-ed08-426f-ad99-e3cc717e024e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:36.728671 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-919d9b6a-ed08-426f-ad99-e3cc717e024e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:36.729662 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-919d9b6a-ed08-426f-ad99-e3cc717e024e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:36.730334 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-919d9b6a-ed08-426f-ad99-e3cc717e024e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:36.730997 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-919d9b6a-ed08-426f-ad99-e3cc717e024e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:37.206549 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-919d9b6a-ed08-426f-ad99-e3cc717e024e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:37.251727 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-919d9b6a-ed08-426f-ad99-e3cc717e024e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:37.258656 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-919d9b6a-ed08-426f-ad99-e3cc717e024e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:37.264520 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-919d9b6a-ed08-426f-ad99-e3cc717e024e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1747 microversion: 2.20 time: 0.560853 Oct 26 13:38:37.278225 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3001/6030] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:38:36 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1747 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:38:37.664715 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b660a0d8-7cb9-471f-93a8-85b36e9ea878 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:37.665877 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b660a0d8-7cb9-471f-93a8-85b36e9ea878 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] [instance: 65e73a8e-e75d-4efe-a886-7328b0414a1e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:37.692477 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b660a0d8-7cb9-471f-93a8-85b36e9ea878 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:37.693340 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b660a0d8-7cb9-471f-93a8-85b36e9ea878 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:37.694042 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b660a0d8-7cb9-471f-93a8-85b36e9ea878 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:37.695016 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b660a0d8-7cb9-471f-93a8-85b36e9ea878 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:37.695687 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b660a0d8-7cb9-471f-93a8-85b36e9ea878 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:37.696339 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b660a0d8-7cb9-471f-93a8-85b36e9ea878 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:38.164733 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b660a0d8-7cb9-471f-93a8-85b36e9ea878 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35782c90feff41dea454598bb3630c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13767903b18d44608a0ca38724c0d10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:38.184816 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b660a0d8-7cb9-471f-93a8-85b36e9ea878 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] 10.222.0.40 "GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e" status: 200 len: 1460 microversion: 2.1 time: 0.524118 Oct 26 13:38:38.187215 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3030/6031] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:38:37 2022] GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e => generated 1460 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:38:38.211200 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bb6a7be3-a774-46c4-95ac-8ec1aa58d9a3 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:38.211816 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bb6a7be3-a774-46c4-95ac-8ec1aa58d9a3 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] [instance: 65e73a8e-e75d-4efe-a886-7328b0414a1e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:38.236902 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb6a7be3-a774-46c4-95ac-8ec1aa58d9a3 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:38.237944 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb6a7be3-a774-46c4-95ac-8ec1aa58d9a3 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:38.238848 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb6a7be3-a774-46c4-95ac-8ec1aa58d9a3 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:38.243557 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb6a7be3-a774-46c4-95ac-8ec1aa58d9a3 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:38.245153 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb6a7be3-a774-46c4-95ac-8ec1aa58d9a3 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:38.246143 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb6a7be3-a774-46c4-95ac-8ec1aa58d9a3 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:38.308328 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-53934ae4-029b-446e-83cd-965387406a7a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:38.310059 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-53934ae4-029b-446e-83cd-965387406a7a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:38.323914 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-53934ae4-029b-446e-83cd-965387406a7a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:38.330108 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-53934ae4-029b-446e-83cd-965387406a7a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:38.330860 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-53934ae4-029b-446e-83cd-965387406a7a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:38.332352 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-53934ae4-029b-446e-83cd-965387406a7a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:38.332874 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-53934ae4-029b-446e-83cd-965387406a7a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:38.355471 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-53934ae4-029b-446e-83cd-965387406a7a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:38.901920 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bb6a7be3-a774-46c4-95ac-8ec1aa58d9a3 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35782c90feff41dea454598bb3630c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13767903b18d44608a0ca38724c0d10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:38.918271 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bb6a7be3-a774-46c4-95ac-8ec1aa58d9a3 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] 10.222.0.40 "GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e" status: 200 len: 1460 microversion: 2.1 time: 0.712488 Oct 26 13:38:38.930340 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3002/6032] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:38:38 2022] GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e => generated 1460 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:38:38.999003 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-53934ae4-029b-446e-83cd-965387406a7a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:39.013103 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-53934ae4-029b-446e-83cd-965387406a7a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:39.022242 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-53934ae4-029b-446e-83cd-965387406a7a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:39.038532 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-53934ae4-029b-446e-83cd-965387406a7a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1742 microversion: 2.20 time: 0.725208 Oct 26 13:38:39.039526 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3031/6033] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:38:38 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1742 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:38:40.070802 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-76b4fb20-01dc-4ce5-a5a9-b49abed5f087 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:40.071603 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-76b4fb20-01dc-4ce5-a5a9-b49abed5f087 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:40.089269 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-76b4fb20-01dc-4ce5-a5a9-b49abed5f087 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:40.098246 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-76b4fb20-01dc-4ce5-a5a9-b49abed5f087 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:40.098887 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-76b4fb20-01dc-4ce5-a5a9-b49abed5f087 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:40.107798 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-76b4fb20-01dc-4ce5-a5a9-b49abed5f087 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:40.115450 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-76b4fb20-01dc-4ce5-a5a9-b49abed5f087 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:40.116020 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-76b4fb20-01dc-4ce5-a5a9-b49abed5f087 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:40.598946 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-f4db1095-94f3-41c3-8419-48227de866b9 req-878216da-94f2-4155-822e-2ea86daac5d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52b4e824-6117-46a5-a005-0bef3bc75052", "name": "network-vif-plugged", "status": "completed", "tag": "86120fac-67e2-4ce8-a98b-0f683e946ba4"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:38:40.632627 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f4db1095-94f3-41c3-8419-48227de866b9 req-878216da-94f2-4155-822e-2ea86daac5d5 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:40.636468 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f4db1095-94f3-41c3-8419-48227de866b9 req-878216da-94f2-4155-822e-2ea86daac5d5 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:40.637066 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f4db1095-94f3-41c3-8419-48227de866b9 req-878216da-94f2-4155-822e-2ea86daac5d5 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:40.679390 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-f4db1095-94f3-41c3-8419-48227de866b9 req-878216da-94f2-4155-822e-2ea86daac5d5 service nova] Creating event network-vif-plugged:86120fac-67e2-4ce8-a98b-0f683e946ba4 for instance 52b4e824-6117-46a5-a005-0bef3bc75052 on n-h2-862686-1 Oct 26 13:38:40.723299 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-f4db1095-94f3-41c3-8419-48227de866b9 req-878216da-94f2-4155-822e-2ea86daac5d5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128127 Oct 26 13:38:40.726344 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3032/6034] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:38:41.303020 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-76b4fb20-01dc-4ce5-a5a9-b49abed5f087 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:41.319567 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-76b4fb20-01dc-4ce5-a5a9-b49abed5f087 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:41.325532 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-76b4fb20-01dc-4ce5-a5a9-b49abed5f087 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:41.327142 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-76b4fb20-01dc-4ce5-a5a9-b49abed5f087 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1742 microversion: 2.20 time: 1.260282 Oct 26 13:38:41.327939 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3003/6035] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:38:40 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1742 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:38:42.359413 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d5ebc722-b176-4f37-8a47-a35cea1e5e6e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:42.360351 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d5ebc722-b176-4f37-8a47-a35cea1e5e6e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:42.377829 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5ebc722-b176-4f37-8a47-a35cea1e5e6e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:42.384432 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5ebc722-b176-4f37-8a47-a35cea1e5e6e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:42.386267 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5ebc722-b176-4f37-8a47-a35cea1e5e6e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:42.389274 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5ebc722-b176-4f37-8a47-a35cea1e5e6e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:42.392192 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5ebc722-b176-4f37-8a47-a35cea1e5e6e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:42.395315 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5ebc722-b176-4f37-8a47-a35cea1e5e6e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:43.118514 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d5ebc722-b176-4f37-8a47-a35cea1e5e6e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:43.132229 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d5ebc722-b176-4f37-8a47-a35cea1e5e6e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:43.134196 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d5ebc722-b176-4f37-8a47-a35cea1e5e6e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:43.135698 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d5ebc722-b176-4f37-8a47-a35cea1e5e6e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1742 microversion: 2.20 time: 0.781787 Oct 26 13:38:43.139782 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3033/6036] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:38:42 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1742 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:38:44.167701 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bf4d106b-1070-4ce6-bc1b-5cf2a2339fc1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:44.168331 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bf4d106b-1070-4ce6-bc1b-5cf2a2339fc1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:44.179832 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf4d106b-1070-4ce6-bc1b-5cf2a2339fc1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:44.180357 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf4d106b-1070-4ce6-bc1b-5cf2a2339fc1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:44.180812 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf4d106b-1070-4ce6-bc1b-5cf2a2339fc1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:44.181599 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf4d106b-1070-4ce6-bc1b-5cf2a2339fc1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:44.182039 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf4d106b-1070-4ce6-bc1b-5cf2a2339fc1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:44.182476 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf4d106b-1070-4ce6-bc1b-5cf2a2339fc1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:44.821263 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bf4d106b-1070-4ce6-bc1b-5cf2a2339fc1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:44.850058 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bf4d106b-1070-4ce6-bc1b-5cf2a2339fc1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:44.853832 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bf4d106b-1070-4ce6-bc1b-5cf2a2339fc1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:44.865185 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bf4d106b-1070-4ce6-bc1b-5cf2a2339fc1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1742 microversion: 2.20 time: 0.698020 Oct 26 13:38:44.866308 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3004/6037] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:38:44 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1742 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:38:45.905409 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bb79c06e-6366-457d-800d-bbb869c0c3af tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:45.907771 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bb79c06e-6366-457d-800d-bbb869c0c3af tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:45.921982 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb79c06e-6366-457d-800d-bbb869c0c3af tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:45.924250 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb79c06e-6366-457d-800d-bbb869c0c3af tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:45.926548 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb79c06e-6366-457d-800d-bbb869c0c3af tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:45.928951 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb79c06e-6366-457d-800d-bbb869c0c3af tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:45.930591 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb79c06e-6366-457d-800d-bbb869c0c3af tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:45.931325 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb79c06e-6366-457d-800d-bbb869c0c3af tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:46.741924 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bb79c06e-6366-457d-800d-bbb869c0c3af tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:46.772773 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bb79c06e-6366-457d-800d-bbb869c0c3af tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:46.777998 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bb79c06e-6366-457d-800d-bbb869c0c3af tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:46.782761 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bb79c06e-6366-457d-800d-bbb869c0c3af tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1742 microversion: 2.20 time: 0.884155 Oct 26 13:38:46.786955 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3034/6038] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:38:45 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1742 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:38:47.534730 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-223ed3e1-70d1-4c9e-b062-6282836fc809 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1248595261", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "2ef7937d-4967-40bd-9b03-58aca3725d14"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:38:47.716884 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-223ed3e1-70d1-4c9e-b062-6282836fc809 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] validate_networks() for [('2ef7937d-4967-40bd-9b03-58aca3725d14', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:38:47.817186 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e9093cf7-45b1-4cad-99c3-688b4a3d7dda tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:47.820067 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e9093cf7-45b1-4cad-99c3-688b4a3d7dda tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:47.834879 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e9093cf7-45b1-4cad-99c3-688b4a3d7dda tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:47.844878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e9093cf7-45b1-4cad-99c3-688b4a3d7dda tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:47.845920 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e9093cf7-45b1-4cad-99c3-688b4a3d7dda tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:47.847667 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e9093cf7-45b1-4cad-99c3-688b4a3d7dda tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:47.852952 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e9093cf7-45b1-4cad-99c3-688b4a3d7dda tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:47.853473 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e9093cf7-45b1-4cad-99c3-688b4a3d7dda tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:48.907073 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-223ed3e1-70d1-4c9e-b062-6282836fc809 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:38:48.908068 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-223ed3e1-70d1-4c9e-b062-6282836fc809 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:38:48.908564 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-223ed3e1-70d1-4c9e-b062-6282836fc809 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:38:48.909069 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-223ed3e1-70d1-4c9e-b062-6282836fc809 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:38:48.909518 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-223ed3e1-70d1-4c9e-b062-6282836fc809 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:38:48.933048 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-223ed3e1-70d1-4c9e-b062-6282836fc809 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:48.933631 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-223ed3e1-70d1-4c9e-b062-6282836fc809 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:48.934081 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-223ed3e1-70d1-4c9e-b062-6282836fc809 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:48.934868 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-223ed3e1-70d1-4c9e-b062-6282836fc809 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:48.935377 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-223ed3e1-70d1-4c9e-b062-6282836fc809 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:48.935815 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-223ed3e1-70d1-4c9e-b062-6282836fc809 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:48.995962 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-223ed3e1-70d1-4c9e-b062-6282836fc809 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Getting quotas for project 9d55b2072282496ca5ebc5f73b5b8bb4. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:38:49.019575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-223ed3e1-70d1-4c9e-b062-6282836fc809 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Getting quotas for user 703c6fdda52948f6acc9698a4bdb189d and project 9d55b2072282496ca5ebc5f73b5b8bb4. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:38:49.053599 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-223ed3e1-70d1-4c9e-b062-6282836fc809 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:38:49.056403 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-223ed3e1-70d1-4c9e-b062-6282836fc809 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] [instance: 6e20f2e4-4511-44d1-81a0-094aab3801a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:38:49.194602 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-223ed3e1-70d1-4c9e-b062-6282836fc809 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.935857 Oct 26 13:38:49.202727 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3005/6039] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:38:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:38:49.210420 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-ef1a4db7-9de5-45a0-9950-fdec8773f69c req-42df7834-d151-4285-a18b-e6a82b148324 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65e73a8e-e75d-4efe-a886-7328b0414a1e", "tag": "24ca771f-2301-436c-8a32-78c33e5269cd"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:38:49.239550 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ef1a4db7-9de5-45a0-9950-fdec8773f69c req-42df7834-d151-4285-a18b-e6a82b148324 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:49.240463 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ef1a4db7-9de5-45a0-9950-fdec8773f69c req-42df7834-d151-4285-a18b-e6a82b148324 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:49.241183 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ef1a4db7-9de5-45a0-9950-fdec8773f69c req-42df7834-d151-4285-a18b-e6a82b148324 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:49.274392 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e9093cf7-45b1-4cad-99c3-688b4a3d7dda tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:49.281723 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-ef1a4db7-9de5-45a0-9950-fdec8773f69c req-42df7834-d151-4285-a18b-e6a82b148324 service nova] Creating event network-changed:24ca771f-2301-436c-8a32-78c33e5269cd for instance 65e73a8e-e75d-4efe-a886-7328b0414a1e on n-h1-862686-1 Oct 26 13:38:49.287840 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e9093cf7-45b1-4cad-99c3-688b4a3d7dda tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:49.293439 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e9093cf7-45b1-4cad-99c3-688b4a3d7dda tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:49.295323 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e9093cf7-45b1-4cad-99c3-688b4a3d7dda tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1742 microversion: 2.20 time: 1.483023 Oct 26 13:38:49.296202 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3035/6040] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:38:47 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1742 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:38:49.298276 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-ef1a4db7-9de5-45a0-9950-fdec8773f69c req-42df7834-d151-4285-a18b-e6a82b148324 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093964 Oct 26 13:38:49.313713 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0e97dc09-a3c3-4579-93be-f17bae40470b tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:49.314435 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3006/6041] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:38:49.316040 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0e97dc09-a3c3-4579-93be-f17bae40470b tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] [instance: 6e20f2e4-4511-44d1-81a0-094aab3801a2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:49.482259 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0e97dc09-a3c3-4579-93be-f17bae40470b tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703c6fdda52948f6acc9698a4bdb189d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d55b2072282496ca5ebc5f73b5b8bb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:49.492268 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0e97dc09-a3c3-4579-93be-f17bae40470b tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] 10.222.0.40 "GET /compute/v2.1/servers/6e20f2e4-4511-44d1-81a0-094aab3801a2" status: 200 len: 1214 microversion: 2.1 time: 0.192658 Oct 26 13:38:49.497299 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3036/6042] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:38:49 2022] GET /compute/v2.1/servers/6e20f2e4-4511-44d1-81a0-094aab3801a2 => generated 1214 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:38:50.328956 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f52d5d1e-7e1c-48c5-a8ad-88a86b9cb717 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:50.329818 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f52d5d1e-7e1c-48c5-a8ad-88a86b9cb717 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:50.361607 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f52d5d1e-7e1c-48c5-a8ad-88a86b9cb717 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:50.362416 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f52d5d1e-7e1c-48c5-a8ad-88a86b9cb717 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:50.362777 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f52d5d1e-7e1c-48c5-a8ad-88a86b9cb717 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:50.363505 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f52d5d1e-7e1c-48c5-a8ad-88a86b9cb717 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:50.363969 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f52d5d1e-7e1c-48c5-a8ad-88a86b9cb717 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:50.364403 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f52d5d1e-7e1c-48c5-a8ad-88a86b9cb717 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:50.522184 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1340e880-e0c0-43ee-9074-5222c4b53b59 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:50.522761 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1340e880-e0c0-43ee-9074-5222c4b53b59 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] [instance: 6e20f2e4-4511-44d1-81a0-094aab3801a2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:50.546569 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1340e880-e0c0-43ee-9074-5222c4b53b59 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:50.547183 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1340e880-e0c0-43ee-9074-5222c4b53b59 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:50.547525 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1340e880-e0c0-43ee-9074-5222c4b53b59 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:50.549371 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1340e880-e0c0-43ee-9074-5222c4b53b59 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:50.555446 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1340e880-e0c0-43ee-9074-5222c4b53b59 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:50.555941 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1340e880-e0c0-43ee-9074-5222c4b53b59 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:51.147089 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1340e880-e0c0-43ee-9074-5222c4b53b59 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703c6fdda52948f6acc9698a4bdb189d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d55b2072282496ca5ebc5f73b5b8bb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:51.156383 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1340e880-e0c0-43ee-9074-5222c4b53b59 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] 10.222.0.40 "GET /compute/v2.1/servers/6e20f2e4-4511-44d1-81a0-094aab3801a2" status: 200 len: 1218 microversion: 2.1 time: 0.638678 Oct 26 13:38:51.169597 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3037/6043] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:38:50 2022] GET /compute/v2.1/servers/6e20f2e4-4511-44d1-81a0-094aab3801a2 => generated 1218 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:38:51.178298 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f97597d2-c40d-422e-98c2-2c47eb24e47e tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:51.178812 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f97597d2-c40d-422e-98c2-2c47eb24e47e tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: 01414eaf-51ba-4f6a-b53a-3bf52d82ace4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:51.212687 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f97597d2-c40d-422e-98c2-2c47eb24e47e tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:51.213204 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f97597d2-c40d-422e-98c2-2c47eb24e47e tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:51.213687 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f97597d2-c40d-422e-98c2-2c47eb24e47e tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:51.214436 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f97597d2-c40d-422e-98c2-2c47eb24e47e tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:51.214904 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f97597d2-c40d-422e-98c2-2c47eb24e47e tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:51.225632 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f97597d2-c40d-422e-98c2-2c47eb24e47e tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:51.400923 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f52d5d1e-7e1c-48c5-a8ad-88a86b9cb717 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:51.418452 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f52d5d1e-7e1c-48c5-a8ad-88a86b9cb717 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:51.423010 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f52d5d1e-7e1c-48c5-a8ad-88a86b9cb717 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:51.430813 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f52d5d1e-7e1c-48c5-a8ad-88a86b9cb717 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1742 microversion: 2.20 time: 1.105172 Oct 26 13:38:51.445515 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-f97597d2-c40d-422e-98c2-2c47eb24e47e tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lazy-loading 'services' on Instance uuid 01414eaf-51ba-4f6a-b53a-3bf52d82ace4 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:38:51.445753 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3007/6044] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:38:50 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1742 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:38:51.664653 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f97597d2-c40d-422e-98c2-2c47eb24e47e tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "DELETE /compute/v2.1/servers/01414eaf-51ba-4f6a-b53a-3bf52d82ace4/os-volume_attachments/81c6babb-15d4-4295-83d1-c4f1637f6e48" status: 202 len: 0 microversion: 2.1 time: 0.496251 Oct 26 13:38:51.672609 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3038/6045] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Oct 26 13:38:51 2022] DELETE /compute/v2.1/servers/01414eaf-51ba-4f6a-b53a-3bf52d82ace4/os-volume_attachments/81c6babb-15d4-4295-83d1-c4f1637f6e48 => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:38:52.191235 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bcf153da-4879-49c9-8daf-929da322ec23 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:52.191971 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bcf153da-4879-49c9-8daf-929da322ec23 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] [instance: 6e20f2e4-4511-44d1-81a0-094aab3801a2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:52.216371 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bcf153da-4879-49c9-8daf-929da322ec23 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:52.218308 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bcf153da-4879-49c9-8daf-929da322ec23 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:52.218856 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bcf153da-4879-49c9-8daf-929da322ec23 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:52.219626 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bcf153da-4879-49c9-8daf-929da322ec23 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:52.223983 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bcf153da-4879-49c9-8daf-929da322ec23 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:52.225654 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bcf153da-4879-49c9-8daf-929da322ec23 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:52.462292 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3d5abec2-1dd4-4cc7-9986-584e0a4dbda8 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:52.463245 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3d5abec2-1dd4-4cc7-9986-584e0a4dbda8 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:52.479101 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3d5abec2-1dd4-4cc7-9986-584e0a4dbda8 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:52.479887 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3d5abec2-1dd4-4cc7-9986-584e0a4dbda8 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:52.480492 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3d5abec2-1dd4-4cc7-9986-584e0a4dbda8 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:52.481407 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3d5abec2-1dd4-4cc7-9986-584e0a4dbda8 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:52.482048 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3d5abec2-1dd4-4cc7-9986-584e0a4dbda8 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:52.482795 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3d5abec2-1dd4-4cc7-9986-584e0a4dbda8 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:52.662364 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bcf153da-4879-49c9-8daf-929da322ec23 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703c6fdda52948f6acc9698a4bdb189d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d55b2072282496ca5ebc5f73b5b8bb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:52.677743 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bcf153da-4879-49c9-8daf-929da322ec23 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] 10.222.0.40 "GET /compute/v2.1/servers/6e20f2e4-4511-44d1-81a0-094aab3801a2" status: 200 len: 1272 microversion: 2.1 time: 0.498201 Oct 26 13:38:52.680386 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3008/6046] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:38:52 2022] GET /compute/v2.1/servers/6e20f2e4-4511-44d1-81a0-094aab3801a2 => generated 1272 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:38:52.764958 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3d5abec2-1dd4-4cc7-9986-584e0a4dbda8 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:52.780061 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3d5abec2-1dd4-4cc7-9986-584e0a4dbda8 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:52.781803 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3d5abec2-1dd4-4cc7-9986-584e0a4dbda8 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:52.783009 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3d5abec2-1dd4-4cc7-9986-584e0a4dbda8 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1742 microversion: 2.20 time: 0.325251 Oct 26 13:38:52.784773 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3039/6047] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:38:52 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1742 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:38:53.505536 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-923d6de5-1ad6-481f-b9c1-b359650b6ba6 req-ac618898-8cf9-4427-b434-3da98a4da74b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65e73a8e-e75d-4efe-a886-7328b0414a1e", "tag": "24ca771f-2301-436c-8a32-78c33e5269cd"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:38:53.535275 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-923d6de5-1ad6-481f-b9c1-b359650b6ba6 req-ac618898-8cf9-4427-b434-3da98a4da74b service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:53.536713 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-923d6de5-1ad6-481f-b9c1-b359650b6ba6 req-ac618898-8cf9-4427-b434-3da98a4da74b service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:53.538770 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-923d6de5-1ad6-481f-b9c1-b359650b6ba6 req-ac618898-8cf9-4427-b434-3da98a4da74b service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:53.571464 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-923d6de5-1ad6-481f-b9c1-b359650b6ba6 req-ac618898-8cf9-4427-b434-3da98a4da74b service nova] Creating event network-changed:24ca771f-2301-436c-8a32-78c33e5269cd for instance 65e73a8e-e75d-4efe-a886-7328b0414a1e on n-h1-862686-1 Oct 26 13:38:53.588195 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-923d6de5-1ad6-481f-b9c1-b359650b6ba6 req-ac618898-8cf9-4427-b434-3da98a4da74b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086941 Oct 26 13:38:53.592386 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3009/6048] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:38:53.704228 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5270a040-ba50-485f-92fa-93051266260c tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:53.705101 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5270a040-ba50-485f-92fa-93051266260c tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] [instance: 6e20f2e4-4511-44d1-81a0-094aab3801a2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:53.722484 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5270a040-ba50-485f-92fa-93051266260c tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:53.723340 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5270a040-ba50-485f-92fa-93051266260c tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:53.723945 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5270a040-ba50-485f-92fa-93051266260c tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:53.724858 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5270a040-ba50-485f-92fa-93051266260c tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:53.725497 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5270a040-ba50-485f-92fa-93051266260c tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:53.730192 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5270a040-ba50-485f-92fa-93051266260c tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:53.815450 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6181b48e-0187-407a-a55d-1619d5cef2ba tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:53.816483 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6181b48e-0187-407a-a55d-1619d5cef2ba tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:53.837527 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6181b48e-0187-407a-a55d-1619d5cef2ba tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:53.841103 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6181b48e-0187-407a-a55d-1619d5cef2ba tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:53.841758 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6181b48e-0187-407a-a55d-1619d5cef2ba tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:53.843651 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6181b48e-0187-407a-a55d-1619d5cef2ba tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:53.848432 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6181b48e-0187-407a-a55d-1619d5cef2ba tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:53.850639 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6181b48e-0187-407a-a55d-1619d5cef2ba tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:54.068795 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5270a040-ba50-485f-92fa-93051266260c tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703c6fdda52948f6acc9698a4bdb189d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d55b2072282496ca5ebc5f73b5b8bb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:54.079340 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5270a040-ba50-485f-92fa-93051266260c tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] 10.222.0.40 "GET /compute/v2.1/servers/6e20f2e4-4511-44d1-81a0-094aab3801a2" status: 200 len: 1272 microversion: 2.1 time: 0.378882 Oct 26 13:38:54.082617 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3040/6049] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:38:53 2022] GET /compute/v2.1/servers/6e20f2e4-4511-44d1-81a0-094aab3801a2 => generated 1272 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:38:55.110142 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f1418299-ecee-4878-8cf4-8178782d184e tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:55.111849 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f1418299-ecee-4878-8cf4-8178782d184e tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] [instance: 6e20f2e4-4511-44d1-81a0-094aab3801a2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:55.129789 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1418299-ecee-4878-8cf4-8178782d184e tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:55.130675 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1418299-ecee-4878-8cf4-8178782d184e tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:55.131506 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1418299-ecee-4878-8cf4-8178782d184e tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:55.132497 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1418299-ecee-4878-8cf4-8178782d184e tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:55.133152 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1418299-ecee-4878-8cf4-8178782d184e tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:55.133884 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1418299-ecee-4878-8cf4-8178782d184e tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:55.307099 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f1418299-ecee-4878-8cf4-8178782d184e tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703c6fdda52948f6acc9698a4bdb189d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d55b2072282496ca5ebc5f73b5b8bb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:55.316732 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f1418299-ecee-4878-8cf4-8178782d184e tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] 10.222.0.40 "GET /compute/v2.1/servers/6e20f2e4-4511-44d1-81a0-094aab3801a2" status: 200 len: 1272 microversion: 2.1 time: 0.211159 Oct 26 13:38:55.321230 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3041/6050] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:38:55 2022] GET /compute/v2.1/servers/6e20f2e4-4511-44d1-81a0-094aab3801a2 => generated 1272 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:38:55.588834 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6181b48e-0187-407a-a55d-1619d5cef2ba tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:55.605795 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6181b48e-0187-407a-a55d-1619d5cef2ba tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:55.611095 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6181b48e-0187-407a-a55d-1619d5cef2ba tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:55.623988 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6181b48e-0187-407a-a55d-1619d5cef2ba tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1742 microversion: 2.20 time: 1.813138 Oct 26 13:38:55.625605 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3010/6051] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:38:53 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1742 bytes in 1816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:38:55.685746 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-8e5c55b2-1ee8-4f81-bdc0-804cbc147bc9 req-ad63177e-a050-473c-a498-182426a372a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65e73a8e-e75d-4efe-a886-7328b0414a1e", "tag": "24ca771f-2301-436c-8a32-78c33e5269cd"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:38:55.704698 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8e5c55b2-1ee8-4f81-bdc0-804cbc147bc9 req-ad63177e-a050-473c-a498-182426a372a5 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:55.706670 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8e5c55b2-1ee8-4f81-bdc0-804cbc147bc9 req-ad63177e-a050-473c-a498-182426a372a5 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:55.707973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8e5c55b2-1ee8-4f81-bdc0-804cbc147bc9 req-ad63177e-a050-473c-a498-182426a372a5 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:55.762747 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-8e5c55b2-1ee8-4f81-bdc0-804cbc147bc9 req-ad63177e-a050-473c-a498-182426a372a5 service nova] Creating event network-changed:24ca771f-2301-436c-8a32-78c33e5269cd for instance 65e73a8e-e75d-4efe-a886-7328b0414a1e on n-h1-862686-1 Oct 26 13:38:55.782145 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-8e5c55b2-1ee8-4f81-bdc0-804cbc147bc9 req-ad63177e-a050-473c-a498-182426a372a5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101898 Oct 26 13:38:55.786646 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3042/6052] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:38:56.351501 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cb1b6b2f-346c-4967-9c2f-682fd811790d tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:56.352736 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cb1b6b2f-346c-4967-9c2f-682fd811790d tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] [instance: 6e20f2e4-4511-44d1-81a0-094aab3801a2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:56.370144 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb1b6b2f-346c-4967-9c2f-682fd811790d tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:56.381921 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb1b6b2f-346c-4967-9c2f-682fd811790d tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:56.386461 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb1b6b2f-346c-4967-9c2f-682fd811790d tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:56.387658 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb1b6b2f-346c-4967-9c2f-682fd811790d tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:56.390844 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb1b6b2f-346c-4967-9c2f-682fd811790d tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:56.391765 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb1b6b2f-346c-4967-9c2f-682fd811790d tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:56.661131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-490cfc51-72df-4bc7-9975-5684d0861dc8 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:56.661131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-490cfc51-72df-4bc7-9975-5684d0861dc8 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:56.670899 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-490cfc51-72df-4bc7-9975-5684d0861dc8 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:56.671597 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-490cfc51-72df-4bc7-9975-5684d0861dc8 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:56.671837 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-490cfc51-72df-4bc7-9975-5684d0861dc8 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:56.683712 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-490cfc51-72df-4bc7-9975-5684d0861dc8 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:56.684716 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-490cfc51-72df-4bc7-9975-5684d0861dc8 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:56.694069 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-490cfc51-72df-4bc7-9975-5684d0861dc8 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:57.163548 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-490cfc51-72df-4bc7-9975-5684d0861dc8 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:57.185760 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-490cfc51-72df-4bc7-9975-5684d0861dc8 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:57.193750 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-490cfc51-72df-4bc7-9975-5684d0861dc8 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:57.198536 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-490cfc51-72df-4bc7-9975-5684d0861dc8 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1742 microversion: 2.20 time: 0.548142 Oct 26 13:38:57.222989 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3043/6053] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:38:56 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1742 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:38:57.733526 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cb1b6b2f-346c-4967-9c2f-682fd811790d tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703c6fdda52948f6acc9698a4bdb189d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d55b2072282496ca5ebc5f73b5b8bb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:57.762826 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cb1b6b2f-346c-4967-9c2f-682fd811790d tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] 10.222.0.40 "GET /compute/v2.1/servers/6e20f2e4-4511-44d1-81a0-094aab3801a2" status: 200 len: 1314 microversion: 2.1 time: 1.415937 Oct 26 13:38:57.766111 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3011/6054] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:38:56 2022] GET /compute/v2.1/servers/6e20f2e4-4511-44d1-81a0-094aab3801a2 => generated 1314 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:38:58.229453 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b92790d4-7476-4e07-80e9-f75982b6d0c6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:58.230122 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b92790d4-7476-4e07-80e9-f75982b6d0c6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:58.250888 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b92790d4-7476-4e07-80e9-f75982b6d0c6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:58.253653 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b92790d4-7476-4e07-80e9-f75982b6d0c6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:58.254288 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b92790d4-7476-4e07-80e9-f75982b6d0c6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:58.259289 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b92790d4-7476-4e07-80e9-f75982b6d0c6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:58.259773 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b92790d4-7476-4e07-80e9-f75982b6d0c6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:58.260354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b92790d4-7476-4e07-80e9-f75982b6d0c6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:58.790073 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-88f151fe-817a-4df4-92b1-593c8d53b1fb tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:38:58.790715 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-88f151fe-817a-4df4-92b1-593c8d53b1fb tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] [instance: 6e20f2e4-4511-44d1-81a0-094aab3801a2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:38:58.811705 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88f151fe-817a-4df4-92b1-593c8d53b1fb tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:58.812255 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88f151fe-817a-4df4-92b1-593c8d53b1fb tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:58.812732 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88f151fe-817a-4df4-92b1-593c8d53b1fb tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:58.813459 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88f151fe-817a-4df4-92b1-593c8d53b1fb tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:38:58.813988 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88f151fe-817a-4df4-92b1-593c8d53b1fb tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:38:58.814485 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88f151fe-817a-4df4-92b1-593c8d53b1fb tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:38:58.848302 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=86 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:38:58.959799 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:38:59.035103 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:38:59.198701 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b92790d4-7476-4e07-80e9-f75982b6d0c6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:59.221904 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b92790d4-7476-4e07-80e9-f75982b6d0c6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:59.226079 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b92790d4-7476-4e07-80e9-f75982b6d0c6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:38:59.231076 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b92790d4-7476-4e07-80e9-f75982b6d0c6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1742 microversion: 2.20 time: 1.005687 Oct 26 13:38:59.234273 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3044/6055] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:38:58 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1742 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:39:00.107888 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-88f151fe-817a-4df4-92b1-593c8d53b1fb tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703c6fdda52948f6acc9698a4bdb189d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d55b2072282496ca5ebc5f73b5b8bb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:00.121990 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-88f151fe-817a-4df4-92b1-593c8d53b1fb tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] 10.222.0.40 "GET /compute/v2.1/servers/6e20f2e4-4511-44d1-81a0-094aab3801a2" status: 200 len: 1314 microversion: 2.1 time: 1.336927 Oct 26 13:39:00.126007 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3012/6056] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:38:58 2022] GET /compute/v2.1/servers/6e20f2e4-4511-44d1-81a0-094aab3801a2 => generated 1314 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:39:00.265794 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ad12427e-21a9-4b77-93e4-3f48ebde466d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:00.266551 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ad12427e-21a9-4b77-93e4-3f48ebde466d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:00.279249 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:39:00.288275 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ad12427e-21a9-4b77-93e4-3f48ebde466d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:00.288886 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ad12427e-21a9-4b77-93e4-3f48ebde466d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:00.292215 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ad12427e-21a9-4b77-93e4-3f48ebde466d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:00.293287 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ad12427e-21a9-4b77-93e4-3f48ebde466d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:00.294444 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ad12427e-21a9-4b77-93e4-3f48ebde466d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:00.295437 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ad12427e-21a9-4b77-93e4-3f48ebde466d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:00.338939 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:39:00.980317 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-d0172a3e-a8a4-43ce-abb2-70b3c0abc8b3 req-5a41d0a7-6396-4157-acc4-c8c8e7c18eb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e20f2e4-4511-44d1-81a0-094aab3801a2", "tag": "c4011853-bd70-4bac-99e2-3dd643ed7c4a"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:39:01.005156 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:39:01.029560 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d0172a3e-a8a4-43ce-abb2-70b3c0abc8b3 req-5a41d0a7-6396-4157-acc4-c8c8e7c18eb3 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:01.031859 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d0172a3e-a8a4-43ce-abb2-70b3c0abc8b3 req-5a41d0a7-6396-4157-acc4-c8c8e7c18eb3 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:01.032551 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d0172a3e-a8a4-43ce-abb2-70b3c0abc8b3 req-5a41d0a7-6396-4157-acc4-c8c8e7c18eb3 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:01.093503 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-d0172a3e-a8a4-43ce-abb2-70b3c0abc8b3 req-5a41d0a7-6396-4157-acc4-c8c8e7c18eb3 service nova] Creating event network-changed:c4011853-bd70-4bac-99e2-3dd643ed7c4a for instance 6e20f2e4-4511-44d1-81a0-094aab3801a2 on n-h2-862686-1 Oct 26 13:39:01.121803 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-d0172a3e-a8a4-43ce-abb2-70b3c0abc8b3 req-5a41d0a7-6396-4157-acc4-c8c8e7c18eb3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155683 Oct 26 13:39:01.123217 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3013/6057] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:39:01.156845 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9c841af5-07f1-42d0-9484-f431bef286c1 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:01.157827 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9c841af5-07f1-42d0-9484-f431bef286c1 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] [instance: 6e20f2e4-4511-44d1-81a0-094aab3801a2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:01.170460 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c841af5-07f1-42d0-9484-f431bef286c1 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:01.172184 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c841af5-07f1-42d0-9484-f431bef286c1 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:01.172817 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c841af5-07f1-42d0-9484-f431bef286c1 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:01.175993 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c841af5-07f1-42d0-9484-f431bef286c1 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:01.176675 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c841af5-07f1-42d0-9484-f431bef286c1 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:01.177994 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c841af5-07f1-42d0-9484-f431bef286c1 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:01.246803 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ad12427e-21a9-4b77-93e4-3f48ebde466d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:01.267141 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ad12427e-21a9-4b77-93e4-3f48ebde466d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:01.293147 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ad12427e-21a9-4b77-93e4-3f48ebde466d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:01.296410 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ad12427e-21a9-4b77-93e4-3f48ebde466d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1742 microversion: 2.20 time: 1.034929 Oct 26 13:39:01.300347 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3045/6058] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:39:00 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1742 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:39:02.022492 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9c841af5-07f1-42d0-9484-f431bef286c1 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703c6fdda52948f6acc9698a4bdb189d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d55b2072282496ca5ebc5f73b5b8bb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:02.033554 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9c841af5-07f1-42d0-9484-f431bef286c1 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] 10.222.0.40 "GET /compute/v2.1/servers/6e20f2e4-4511-44d1-81a0-094aab3801a2" status: 200 len: 1314 microversion: 2.1 time: 0.880909 Oct 26 13:39:02.044724 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3014/6059] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:01 2022] GET /compute/v2.1/servers/6e20f2e4-4511-44d1-81a0-094aab3801a2 => generated 1314 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:39:02.328854 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-25a69977-855d-4d0a-98d3-f696890a6a42 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:02.329613 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-25a69977-855d-4d0a-98d3-f696890a6a42 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:02.370464 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25a69977-855d-4d0a-98d3-f696890a6a42 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:02.389179 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25a69977-855d-4d0a-98d3-f696890a6a42 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:02.393698 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25a69977-855d-4d0a-98d3-f696890a6a42 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:02.396150 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25a69977-855d-4d0a-98d3-f696890a6a42 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:02.402287 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25a69977-855d-4d0a-98d3-f696890a6a42 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:02.403741 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25a69977-855d-4d0a-98d3-f696890a6a42 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:02.964756 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-25a69977-855d-4d0a-98d3-f696890a6a42 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:02.976926 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-25a69977-855d-4d0a-98d3-f696890a6a42 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:02.983089 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-25a69977-855d-4d0a-98d3-f696890a6a42 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:02.984629 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-25a69977-855d-4d0a-98d3-f696890a6a42 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1742 microversion: 2.20 time: 0.660454 Oct 26 13:39:02.989949 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3046/6060] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:39:02 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1742 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:39:03.067323 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-31b6b225-c10a-4426-92ad-43762ad6bdb0 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:03.068743 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-31b6b225-c10a-4426-92ad-43762ad6bdb0 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] [instance: 6e20f2e4-4511-44d1-81a0-094aab3801a2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:03.090914 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31b6b225-c10a-4426-92ad-43762ad6bdb0 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:03.092923 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31b6b225-c10a-4426-92ad-43762ad6bdb0 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:03.098615 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31b6b225-c10a-4426-92ad-43762ad6bdb0 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:03.099865 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31b6b225-c10a-4426-92ad-43762ad6bdb0 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:03.109618 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31b6b225-c10a-4426-92ad-43762ad6bdb0 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:03.110337 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31b6b225-c10a-4426-92ad-43762ad6bdb0 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:03.639482 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-31b6b225-c10a-4426-92ad-43762ad6bdb0 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703c6fdda52948f6acc9698a4bdb189d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d55b2072282496ca5ebc5f73b5b8bb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:03.668169 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-31b6b225-c10a-4426-92ad-43762ad6bdb0 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] 10.222.0.40 "GET /compute/v2.1/servers/6e20f2e4-4511-44d1-81a0-094aab3801a2" status: 200 len: 1314 microversion: 2.1 time: 0.606308 Oct 26 13:39:03.671821 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3015/6061] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:03 2022] GET /compute/v2.1/servers/6e20f2e4-4511-44d1-81a0-094aab3801a2 => generated 1314 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:39:04.021025 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4e4add1e-edf1-4ff3-b3da-a629645f5ce6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:04.021913 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4e4add1e-edf1-4ff3-b3da-a629645f5ce6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:04.034913 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=42 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:39:04.038942 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e4add1e-edf1-4ff3-b3da-a629645f5ce6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:04.041868 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e4add1e-edf1-4ff3-b3da-a629645f5ce6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:04.042459 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e4add1e-edf1-4ff3-b3da-a629645f5ce6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:04.045911 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e4add1e-edf1-4ff3-b3da-a629645f5ce6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:04.046717 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e4add1e-edf1-4ff3-b3da-a629645f5ce6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:04.049967 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e4add1e-edf1-4ff3-b3da-a629645f5ce6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:04.333027 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-57442636-833e-4858-a86c-0895fcee6ed6 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:04.334702 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-57442636-833e-4858-a86c-0895fcee6ed6 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: 01414eaf-51ba-4f6a-b53a-3bf52d82ace4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:04.357711 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57442636-833e-4858-a86c-0895fcee6ed6 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:04.360275 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57442636-833e-4858-a86c-0895fcee6ed6 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:04.360827 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57442636-833e-4858-a86c-0895fcee6ed6 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:04.363835 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57442636-833e-4858-a86c-0895fcee6ed6 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:04.364721 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57442636-833e-4858-a86c-0895fcee6ed6 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:04.367268 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57442636-833e-4858-a86c-0895fcee6ed6 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:04.426854 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-57442636-833e-4858-a86c-0895fcee6ed6 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: 01414eaf-51ba-4f6a-b53a-3bf52d82ace4] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:39:04.671409 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-57442636-833e-4858-a86c-0895fcee6ed6 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "DELETE /compute/v2.1/servers/01414eaf-51ba-4f6a-b53a-3bf52d82ace4" status: 204 len: 0 microversion: 2.1 time: 0.344898 Oct 26 13:39:04.676094 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3016/6062] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:39:04 2022] DELETE /compute/v2.1/servers/01414eaf-51ba-4f6a-b53a-3bf52d82ace4 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:39:04.728512 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b8ee4c44-6493-4c56-990d-d5028eb18fab tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:04.729627 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b8ee4c44-6493-4c56-990d-d5028eb18fab tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: 01414eaf-51ba-4f6a-b53a-3bf52d82ace4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:04.771508 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8ee4c44-6493-4c56-990d-d5028eb18fab tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:04.776884 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8ee4c44-6493-4c56-990d-d5028eb18fab tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:04.777873 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8ee4c44-6493-4c56-990d-d5028eb18fab tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:04.779995 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8ee4c44-6493-4c56-990d-d5028eb18fab tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:04.781958 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8ee4c44-6493-4c56-990d-d5028eb18fab tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:04.782592 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8ee4c44-6493-4c56-990d-d5028eb18fab tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:04.907176 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4e4add1e-edf1-4ff3-b3da-a629645f5ce6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:04.932702 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4e4add1e-edf1-4ff3-b3da-a629645f5ce6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:04.935969 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4e4add1e-edf1-4ff3-b3da-a629645f5ce6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:04.941122 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4e4add1e-edf1-4ff3-b3da-a629645f5ce6 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1742 microversion: 2.20 time: 0.923699 Oct 26 13:39:04.967921 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3047/6063] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:39:04 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1742 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:39:04.976367 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-26a8588d-ebb7-4f29-93dc-6bf4e9bd7b13 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:04.979173 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-26a8588d-ebb7-4f29-93dc-6bf4e9bd7b13 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] [instance: 6e20f2e4-4511-44d1-81a0-094aab3801a2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:04.989469 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26a8588d-ebb7-4f29-93dc-6bf4e9bd7b13 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:04.990562 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26a8588d-ebb7-4f29-93dc-6bf4e9bd7b13 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:04.991185 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26a8588d-ebb7-4f29-93dc-6bf4e9bd7b13 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:04.992279 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26a8588d-ebb7-4f29-93dc-6bf4e9bd7b13 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:04.993206 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26a8588d-ebb7-4f29-93dc-6bf4e9bd7b13 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:04.994082 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26a8588d-ebb7-4f29-93dc-6bf4e9bd7b13 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:05.293167 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b8ee4c44-6493-4c56-990d-d5028eb18fab tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c55ea80b2e14c99baf3d551f00bfa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd47c4f41a64b56b1b571ab5bcd9bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:05.325855 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b8ee4c44-6493-4c56-990d-d5028eb18fab tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "GET /compute/v2.1/servers/01414eaf-51ba-4f6a-b53a-3bf52d82ace4" status: 200 len: 1514 microversion: 2.1 time: 0.641508 Oct 26 13:39:05.334073 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3017/6064] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:04 2022] GET /compute/v2.1/servers/01414eaf-51ba-4f6a-b53a-3bf52d82ace4 => generated 1514 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:39:05.695129 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-26a8588d-ebb7-4f29-93dc-6bf4e9bd7b13 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703c6fdda52948f6acc9698a4bdb189d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d55b2072282496ca5ebc5f73b5b8bb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:05.711797 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-26a8588d-ebb7-4f29-93dc-6bf4e9bd7b13 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] 10.222.0.40 "GET /compute/v2.1/servers/6e20f2e4-4511-44d1-81a0-094aab3801a2" status: 200 len: 1314 microversion: 2.1 time: 0.741447 Oct 26 13:39:05.712573 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3048/6065] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:04 2022] GET /compute/v2.1/servers/6e20f2e4-4511-44d1-81a0-094aab3801a2 => generated 1314 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:39:05.973395 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3fac28f6-1145-472f-b62d-f743d13bd729 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:05.974057 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3fac28f6-1145-472f-b62d-f743d13bd729 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:05.999268 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3fac28f6-1145-472f-b62d-f743d13bd729 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:06.001276 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3fac28f6-1145-472f-b62d-f743d13bd729 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:06.007154 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3fac28f6-1145-472f-b62d-f743d13bd729 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:06.008162 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3fac28f6-1145-472f-b62d-f743d13bd729 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:06.011651 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3fac28f6-1145-472f-b62d-f743d13bd729 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:06.012313 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3fac28f6-1145-472f-b62d-f743d13bd729 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:06.243955 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3fac28f6-1145-472f-b62d-f743d13bd729 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:06.254293 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3fac28f6-1145-472f-b62d-f743d13bd729 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:06.255771 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3fac28f6-1145-472f-b62d-f743d13bd729 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:06.256977 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3fac28f6-1145-472f-b62d-f743d13bd729 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1742 microversion: 2.20 time: 0.287670 Oct 26 13:39:06.265543 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3018/6066] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:39:05 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1742 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:39:06.368705 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-64a6e9d1-693c-44c1-a2b8-b2046c39ffeb tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:06.371306 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-64a6e9d1-693c-44c1-a2b8-b2046c39ffeb tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: 01414eaf-51ba-4f6a-b53a-3bf52d82ace4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:06.379391 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64a6e9d1-693c-44c1-a2b8-b2046c39ffeb tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:06.379843 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64a6e9d1-693c-44c1-a2b8-b2046c39ffeb tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:06.380278 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64a6e9d1-693c-44c1-a2b8-b2046c39ffeb tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:06.381174 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64a6e9d1-693c-44c1-a2b8-b2046c39ffeb tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:06.381694 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64a6e9d1-693c-44c1-a2b8-b2046c39ffeb tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:06.382131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64a6e9d1-693c-44c1-a2b8-b2046c39ffeb tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:06.741159 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8f6a542f-a05f-4be5-b5c3-eeb4c20e0295 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:06.742927 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8f6a542f-a05f-4be5-b5c3-eeb4c20e0295 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] [instance: 6e20f2e4-4511-44d1-81a0-094aab3801a2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:06.754665 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8f6a542f-a05f-4be5-b5c3-eeb4c20e0295 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:06.755584 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8f6a542f-a05f-4be5-b5c3-eeb4c20e0295 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:06.756302 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8f6a542f-a05f-4be5-b5c3-eeb4c20e0295 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:06.757767 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8f6a542f-a05f-4be5-b5c3-eeb4c20e0295 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:06.759063 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8f6a542f-a05f-4be5-b5c3-eeb4c20e0295 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:06.761071 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8f6a542f-a05f-4be5-b5c3-eeb4c20e0295 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:06.897293 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-64a6e9d1-693c-44c1-a2b8-b2046c39ffeb tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c55ea80b2e14c99baf3d551f00bfa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd47c4f41a64b56b1b571ab5bcd9bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:06.910049 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-64a6e9d1-693c-44c1-a2b8-b2046c39ffeb tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "GET /compute/v2.1/servers/01414eaf-51ba-4f6a-b53a-3bf52d82ace4" status: 200 len: 1514 microversion: 2.1 time: 0.545253 Oct 26 13:39:06.911389 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3049/6067] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:06 2022] GET /compute/v2.1/servers/01414eaf-51ba-4f6a-b53a-3bf52d82ace4 => generated 1514 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:39:07.015854 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8f6a542f-a05f-4be5-b5c3-eeb4c20e0295 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703c6fdda52948f6acc9698a4bdb189d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d55b2072282496ca5ebc5f73b5b8bb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:07.035642 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8f6a542f-a05f-4be5-b5c3-eeb4c20e0295 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] 10.222.0.40 "GET /compute/v2.1/servers/6e20f2e4-4511-44d1-81a0-094aab3801a2" status: 200 len: 1314 microversion: 2.1 time: 0.299276 Oct 26 13:39:07.036943 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3019/6068] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:06 2022] GET /compute/v2.1/servers/6e20f2e4-4511-44d1-81a0-094aab3801a2 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:39:07.283662 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a49a5bb3-14aa-46d8-b89d-f4ad53b7c28e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:07.284448 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a49a5bb3-14aa-46d8-b89d-f4ad53b7c28e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:07.291820 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a49a5bb3-14aa-46d8-b89d-f4ad53b7c28e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:07.292375 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a49a5bb3-14aa-46d8-b89d-f4ad53b7c28e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:07.292824 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a49a5bb3-14aa-46d8-b89d-f4ad53b7c28e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:07.293578 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a49a5bb3-14aa-46d8-b89d-f4ad53b7c28e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:07.294047 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a49a5bb3-14aa-46d8-b89d-f4ad53b7c28e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:07.294632 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a49a5bb3-14aa-46d8-b89d-f4ad53b7c28e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:07.726962 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a49a5bb3-14aa-46d8-b89d-f4ad53b7c28e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:07.737091 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a49a5bb3-14aa-46d8-b89d-f4ad53b7c28e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:07.739216 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a49a5bb3-14aa-46d8-b89d-f4ad53b7c28e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:07.740825 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a49a5bb3-14aa-46d8-b89d-f4ad53b7c28e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1724 microversion: 2.20 time: 0.461627 Oct 26 13:39:07.742081 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3050/6069] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:39:07 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1724 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:39:07.935006 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-50c710bf-1226-4b71-84a1-7fa2855ef144 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:07.935886 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-50c710bf-1226-4b71-84a1-7fa2855ef144 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: 01414eaf-51ba-4f6a-b53a-3bf52d82ace4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:07.943320 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-50c710bf-1226-4b71-84a1-7fa2855ef144 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:07.944591 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-50c710bf-1226-4b71-84a1-7fa2855ef144 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:07.946923 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-50c710bf-1226-4b71-84a1-7fa2855ef144 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:07.948446 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-50c710bf-1226-4b71-84a1-7fa2855ef144 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:07.949509 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-50c710bf-1226-4b71-84a1-7fa2855ef144 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:07.950280 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-50c710bf-1226-4b71-84a1-7fa2855ef144 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:08.002724 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-753092ae-f622-4dc5-9b4e-bfdc714746a3 req-845d2116-a31a-4020-a317-a51780a4232e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01414eaf-51ba-4f6a-b53a-3bf52d82ace4", "name": "network-vif-deleted", "tag": "9486eb9b-f355-4c77-ae1f-4f228757810d"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:39:08.016394 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-753092ae-f622-4dc5-9b4e-bfdc714746a3 req-845d2116-a31a-4020-a317-a51780a4232e service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:08.016884 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-753092ae-f622-4dc5-9b4e-bfdc714746a3 req-845d2116-a31a-4020-a317-a51780a4232e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:08.017325 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-753092ae-f622-4dc5-9b4e-bfdc714746a3 req-845d2116-a31a-4020-a317-a51780a4232e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:08.047035 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-753092ae-f622-4dc5-9b4e-bfdc714746a3 req-845d2116-a31a-4020-a317-a51780a4232e service nova] Creating event network-vif-deleted:9486eb9b-f355-4c77-ae1f-4f228757810d for instance 01414eaf-51ba-4f6a-b53a-3bf52d82ace4 on n-h1-862686-1 Oct 26 13:39:08.064987 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-753092ae-f622-4dc5-9b4e-bfdc714746a3 req-845d2116-a31a-4020-a317-a51780a4232e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065669 Oct 26 13:39:08.066464 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3051/6070] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:39:08.079264 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-50c710bf-1226-4b71-84a1-7fa2855ef144 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c55ea80b2e14c99baf3d551f00bfa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd47c4f41a64b56b1b571ab5bcd9bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:08.092018 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-925d30a2-2da8-41b7-92e5-3e3341e48479 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:08.092912 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-925d30a2-2da8-41b7-92e5-3e3341e48479 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] [instance: 6e20f2e4-4511-44d1-81a0-094aab3801a2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:08.093513 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-50c710bf-1226-4b71-84a1-7fa2855ef144 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "GET /compute/v2.1/servers/01414eaf-51ba-4f6a-b53a-3bf52d82ace4" status: 200 len: 1472 microversion: 2.1 time: 0.162598 Oct 26 13:39:08.094942 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3020/6071] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:07 2022] GET /compute/v2.1/servers/01414eaf-51ba-4f6a-b53a-3bf52d82ace4 => generated 1472 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:39:08.111868 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-925d30a2-2da8-41b7-92e5-3e3341e48479 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:08.117594 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-925d30a2-2da8-41b7-92e5-3e3341e48479 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:08.119033 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-925d30a2-2da8-41b7-92e5-3e3341e48479 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:08.120336 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-925d30a2-2da8-41b7-92e5-3e3341e48479 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:08.121561 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-925d30a2-2da8-41b7-92e5-3e3341e48479 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:08.122419 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-925d30a2-2da8-41b7-92e5-3e3341e48479 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:08.579723 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-925d30a2-2da8-41b7-92e5-3e3341e48479 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703c6fdda52948f6acc9698a4bdb189d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d55b2072282496ca5ebc5f73b5b8bb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:08.600211 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-925d30a2-2da8-41b7-92e5-3e3341e48479 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] 10.222.0.40 "GET /compute/v2.1/servers/6e20f2e4-4511-44d1-81a0-094aab3801a2" status: 200 len: 1314 microversion: 2.1 time: 0.528939 Oct 26 13:39:08.600820 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3052/6072] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:08 2022] GET /compute/v2.1/servers/6e20f2e4-4511-44d1-81a0-094aab3801a2 => generated 1314 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:39:08.786169 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-d7beb846-773a-4e1f-9889-2ad43be57bcd req-05f27d7b-75dd-4e06-91f9-3b9465321a64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e20f2e4-4511-44d1-81a0-094aab3801a2", "name": "network-vif-plugged", "status": "completed", "tag": "c4011853-bd70-4bac-99e2-3dd643ed7c4a"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:39:08.787020 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ce4b850c-78e8-45a9-8f76-dd60babc7cfa tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:08.790106 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ce4b850c-78e8-45a9-8f76-dd60babc7cfa tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:08.821883 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce4b850c-78e8-45a9-8f76-dd60babc7cfa tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:08.826344 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce4b850c-78e8-45a9-8f76-dd60babc7cfa tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:08.828280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-d7beb846-773a-4e1f-9889-2ad43be57bcd req-05f27d7b-75dd-4e06-91f9-3b9465321a64 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:08.828959 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-d7beb846-773a-4e1f-9889-2ad43be57bcd req-05f27d7b-75dd-4e06-91f9-3b9465321a64 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:08.829580 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-d7beb846-773a-4e1f-9889-2ad43be57bcd req-05f27d7b-75dd-4e06-91f9-3b9465321a64 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:08.829790 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce4b850c-78e8-45a9-8f76-dd60babc7cfa tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:08.853629 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce4b850c-78e8-45a9-8f76-dd60babc7cfa tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:08.855197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce4b850c-78e8-45a9-8f76-dd60babc7cfa tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:08.862541 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce4b850c-78e8-45a9-8f76-dd60babc7cfa tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:08.865587 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-d7beb846-773a-4e1f-9889-2ad43be57bcd req-05f27d7b-75dd-4e06-91f9-3b9465321a64 service nova] Creating event network-vif-plugged:c4011853-bd70-4bac-99e2-3dd643ed7c4a for instance 6e20f2e4-4511-44d1-81a0-094aab3801a2 on n-h2-862686-1 Oct 26 13:39:08.883426 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-d7beb846-773a-4e1f-9889-2ad43be57bcd req-05f27d7b-75dd-4e06-91f9-3b9465321a64 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106829 Oct 26 13:39:08.884488 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3053/6073] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:39:09.122584 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9315daf8-adfd-4927-aafe-55c3b816d22f tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:09.124940 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9315daf8-adfd-4927-aafe-55c3b816d22f tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: 01414eaf-51ba-4f6a-b53a-3bf52d82ace4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:09.145905 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9315daf8-adfd-4927-aafe-55c3b816d22f tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:09.148747 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9315daf8-adfd-4927-aafe-55c3b816d22f tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:09.149257 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9315daf8-adfd-4927-aafe-55c3b816d22f tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:09.154835 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9315daf8-adfd-4927-aafe-55c3b816d22f tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:09.172205 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9315daf8-adfd-4927-aafe-55c3b816d22f tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:09.173348 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9315daf8-adfd-4927-aafe-55c3b816d22f tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:09.216872 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ce4b850c-78e8-45a9-8f76-dd60babc7cfa tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:09.234321 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ce4b850c-78e8-45a9-8f76-dd60babc7cfa tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:09.238624 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ce4b850c-78e8-45a9-8f76-dd60babc7cfa tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:09.242519 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ce4b850c-78e8-45a9-8f76-dd60babc7cfa tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1724 microversion: 2.20 time: 0.473657 Oct 26 13:39:09.243897 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3021/6074] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:39:08 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1724 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:39:09.247941 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-9315daf8-adfd-4927-aafe-55c3b816d22f tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] HTTP exception thrown: Instance 01414eaf-51ba-4f6a-b53a-3bf52d82ace4 could not be found. Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9315daf8-adfd-4927-aafe-55c3b816d22f tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Request method failure captured: Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/01414eaf-51ba-4f6a-b53a-3bf52d82ace4 HTTP/1.1 Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTd3s029S2vWcxXX1HNq3_cJELQ7oHEhx1FdEw_oQLXUKIu-0G2nh3zOcZjtG6srzLeGond5R9LvL0kxRbtdlHtwEX9d8CurFdNtvTRT9COj1PoVNkpV0aGriAAHPzZL1A3-Wsoe3rUQML2vS7ilZh0X6Ay7bGxMgU-bJxPAxnlN65g Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 6fd47c4f41a64b56b1b571ab5bcd9bef Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1884786847 Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6fd47c4f41a64b56b1b571ab5bcd9bef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6fd47c4f41a64b56b1b571ab5bcd9bef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6fd47c4f41a64b56b1b571ab5bcd9bef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6fd47c4f41a64b56b1b571ab5bcd9bef"}]}] Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-VolumesSnapshotTestJSON-1884786847 Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 6fd47c4f41a64b56b1b571ab5bcd9bef Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1884786847 Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-VolumesSnapshotTestJSON-1884786847-project Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 6c55ea80b2e14c99baf3d551f00bfa68 Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-VolumesSnapshotTestJSON-1884786847-project Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 01414eaf-51ba-4f6a-b53a-3bf52d82ace4 could not be found. Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '01414eaf-51ba-4f6a-b53a-3bf52d82ace4'} Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01414eaf-51ba-4f6a-b53a-3bf52d82ace4 could not be found. Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01414eaf-51ba-4f6a-b53a-3bf52d82ace4 could not be found. Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:39:09.253170 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:39:09.261190 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:39:09.261190 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:39:09.261190 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:39:09.261190 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:39:09.261190 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:39:09.261190 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01414eaf-51ba-4f6a-b53a-3bf52d82ace4 could not be found. Oct 26 13:39:09.261190 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:39:09.261190 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9315daf8-adfd-4927-aafe-55c3b816d22f tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Returning 404 to user: Instance 01414eaf-51ba-4f6a-b53a-3bf52d82ace4 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:39:09.261190 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9315daf8-adfd-4927-aafe-55c3b816d22f tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "GET /compute/v2.1/servers/01414eaf-51ba-4f6a-b53a-3bf52d82ace4" status: 404 len: 111 microversion: 2.1 time: 0.142426 Oct 26 13:39:09.265286 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3054/6075] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:09 2022] GET /compute/v2.1/servers/01414eaf-51ba-4f6a-b53a-3bf52d82ace4 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:39:09.627303 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-373ee140-4dc2-4eec-b39c-1895077cb7d9 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:09.627934 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-373ee140-4dc2-4eec-b39c-1895077cb7d9 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] [instance: 6e20f2e4-4511-44d1-81a0-094aab3801a2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:09.643951 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-373ee140-4dc2-4eec-b39c-1895077cb7d9 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:09.644405 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-373ee140-4dc2-4eec-b39c-1895077cb7d9 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:09.644859 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-373ee140-4dc2-4eec-b39c-1895077cb7d9 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:09.649786 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-373ee140-4dc2-4eec-b39c-1895077cb7d9 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:09.650344 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-373ee140-4dc2-4eec-b39c-1895077cb7d9 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:09.651269 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-373ee140-4dc2-4eec-b39c-1895077cb7d9 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:10.021818 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-373ee140-4dc2-4eec-b39c-1895077cb7d9 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703c6fdda52948f6acc9698a4bdb189d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d55b2072282496ca5ebc5f73b5b8bb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:10.032859 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-373ee140-4dc2-4eec-b39c-1895077cb7d9 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] 10.222.0.40 "GET /compute/v2.1/servers/6e20f2e4-4511-44d1-81a0-094aab3801a2" status: 200 len: 1314 microversion: 2.1 time: 0.411362 Oct 26 13:39:10.034153 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3022/6076] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:09 2022] GET /compute/v2.1/servers/6e20f2e4-4511-44d1-81a0-094aab3801a2 => generated 1314 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:39:10.280001 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c1158bd7-de1d-4827-b403-eeb8a819cbc1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:10.282148 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c1158bd7-de1d-4827-b403-eeb8a819cbc1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:10.297429 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c1158bd7-de1d-4827-b403-eeb8a819cbc1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:10.298360 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c1158bd7-de1d-4827-b403-eeb8a819cbc1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:10.299259 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c1158bd7-de1d-4827-b403-eeb8a819cbc1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:10.307827 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c1158bd7-de1d-4827-b403-eeb8a819cbc1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:10.310353 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c1158bd7-de1d-4827-b403-eeb8a819cbc1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:10.311932 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c1158bd7-de1d-4827-b403-eeb8a819cbc1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:11.057512 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-644e5c32-f62a-4723-83c1-5b5534fc328f tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:11.059069 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-644e5c32-f62a-4723-83c1-5b5534fc328f tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] [instance: 6e20f2e4-4511-44d1-81a0-094aab3801a2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:11.073228 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-644e5c32-f62a-4723-83c1-5b5534fc328f tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:11.076278 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-644e5c32-f62a-4723-83c1-5b5534fc328f tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:11.077049 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-644e5c32-f62a-4723-83c1-5b5534fc328f tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:11.078475 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-644e5c32-f62a-4723-83c1-5b5534fc328f tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:11.080001 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-644e5c32-f62a-4723-83c1-5b5534fc328f tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:11.081596 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-644e5c32-f62a-4723-83c1-5b5534fc328f tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:11.100546 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c1158bd7-de1d-4827-b403-eeb8a819cbc1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:11.112816 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c1158bd7-de1d-4827-b403-eeb8a819cbc1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:11.114400 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c1158bd7-de1d-4827-b403-eeb8a819cbc1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:11.126980 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c1158bd7-de1d-4827-b403-eeb8a819cbc1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1727 microversion: 2.20 time: 0.859791 Oct 26 13:39:11.135656 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3055/6077] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:39:10 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1727 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:39:11.161806 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b4aae316-d5e3-4634-83d7-66768d47d5e5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "967c65b1-6e4d-4fb2-9354-9e911dd74972"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:39:11.164594 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b4aae316-d5e3-4634-83d7-66768d47d5e5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:11.187565 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b4aae316-d5e3-4634-83d7-66768d47d5e5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:11.188732 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b4aae316-d5e3-4634-83d7-66768d47d5e5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:11.190218 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b4aae316-d5e3-4634-83d7-66768d47d5e5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:11.191269 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b4aae316-d5e3-4634-83d7-66768d47d5e5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:11.192023 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b4aae316-d5e3-4634-83d7-66768d47d5e5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:11.192409 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b4aae316-d5e3-4634-83d7-66768d47d5e5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:11.891841 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b4aae316-d5e3-4634-83d7-66768d47d5e5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "POST /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.731411 Oct 26 13:39:11.894513 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3056/6078] 10.222.0.40 () {62 vars in 1364 bytes} [Wed Oct 26 13:39:11 2022] POST /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052/os-volume_attachments => generated 188 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 26 13:39:11.906189 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-edc5a708-eb3b-4f17-8f78-741600b0d163 req-b26a2777-ee66-4b42-bcab-682cf5779eb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52b4e824-6117-46a5-a005-0bef3bc75052", "name": "network-vif-unplugged", "status": "completed", "tag": "86120fac-67e2-4ce8-a98b-0f683e946ba4"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:39:11.950882 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-edc5a708-eb3b-4f17-8f78-741600b0d163 req-b26a2777-ee66-4b42-bcab-682cf5779eb5 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:11.951543 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-edc5a708-eb3b-4f17-8f78-741600b0d163 req-b26a2777-ee66-4b42-bcab-682cf5779eb5 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:11.952119 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-edc5a708-eb3b-4f17-8f78-741600b0d163 req-b26a2777-ee66-4b42-bcab-682cf5779eb5 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:11.991364 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.compute.server_external_events [req-edc5a708-eb3b-4f17-8f78-741600b0d163 req-b26a2777-ee66-4b42-bcab-682cf5779eb5 service nova] Unable to find a host for instance 52b4e824-6117-46a5-a005-0bef3bc75052. Dropping event network-vif-unplugged {{(pid=120598) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 26 13:39:11.996530 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-edc5a708-eb3b-4f17-8f78-741600b0d163 req-b26a2777-ee66-4b42-bcab-682cf5779eb5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.099634 Oct 26 13:39:12.003013 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3057/6079] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 108 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 26 13:39:12.164427 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e4528d9b-cbcc-4b02-b5f5-3da128ac3f89 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:12.165118 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e4528d9b-cbcc-4b02-b5f5-3da128ac3f89 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:12.176425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4528d9b-cbcc-4b02-b5f5-3da128ac3f89 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:12.177290 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4528d9b-cbcc-4b02-b5f5-3da128ac3f89 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:12.178415 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4528d9b-cbcc-4b02-b5f5-3da128ac3f89 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:12.182379 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4528d9b-cbcc-4b02-b5f5-3da128ac3f89 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:12.183016 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4528d9b-cbcc-4b02-b5f5-3da128ac3f89 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:12.184531 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4528d9b-cbcc-4b02-b5f5-3da128ac3f89 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:12.262883 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-644e5c32-f62a-4723-83c1-5b5534fc328f tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703c6fdda52948f6acc9698a4bdb189d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d55b2072282496ca5ebc5f73b5b8bb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:12.316266 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-644e5c32-f62a-4723-83c1-5b5534fc328f tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] 10.222.0.40 "GET /compute/v2.1/servers/6e20f2e4-4511-44d1-81a0-094aab3801a2" status: 200 len: 1498 microversion: 2.1 time: 1.263604 Oct 26 13:39:12.319075 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3023/6080] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:11 2022] GET /compute/v2.1/servers/6e20f2e4-4511-44d1-81a0-094aab3801a2 => generated 1498 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:39:12.981896 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e4528d9b-cbcc-4b02-b5f5-3da128ac3f89 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "DELETE /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052/os-volume_attachments/967c65b1-6e4d-4fb2-9354-9e911dd74972" status: 202 len: 0 microversion: 2.20 time: 0.825010 Oct 26 13:39:12.985472 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3058/6081] 10.222.0.40 () {60 vars in 1457 bytes} [Wed Oct 26 13:39:12 2022] DELETE /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052/os-volume_attachments/967c65b1-6e4d-4fb2-9354-9e911dd74972 => generated 0 bytes in 829 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 26 13:39:13.222352 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-96f60974-1df2-449e-ad74-eb1234bc9064 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:39:13.225798 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-96f60974-1df2-449e-ad74-eb1234bc9064 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:13.241660 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96f60974-1df2-449e-ad74-eb1234bc9064 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:13.242256 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96f60974-1df2-449e-ad74-eb1234bc9064 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:13.242736 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96f60974-1df2-449e-ad74-eb1234bc9064 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:13.243702 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96f60974-1df2-449e-ad74-eb1234bc9064 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:13.246635 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96f60974-1df2-449e-ad74-eb1234bc9064 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:13.247707 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96f60974-1df2-449e-ad74-eb1234bc9064 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:13.380041 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-96f60974-1df2-449e-ad74-eb1234bc9064 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120597) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 26 13:39:13.583871 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-96f60974-1df2-449e-ad74-eb1234bc9064 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "POST /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052/action" status: 202 len: 0 microversion: 2.20 time: 0.367298 Oct 26 13:39:13.587430 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3024/6082] 10.222.0.40 () {62 vars in 1319 bytes} [Wed Oct 26 13:39:13 2022] POST /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052/action => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:39:13.596691 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-86ca405b-5ed3-47a4-aaff-a301e6ea6000 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:13.597536 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-86ca405b-5ed3-47a4-aaff-a301e6ea6000 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:13.618185 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-86ca405b-5ed3-47a4-aaff-a301e6ea6000 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:13.619902 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-86ca405b-5ed3-47a4-aaff-a301e6ea6000 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:13.620597 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-86ca405b-5ed3-47a4-aaff-a301e6ea6000 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:13.629088 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-86ca405b-5ed3-47a4-aaff-a301e6ea6000 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:13.630315 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-86ca405b-5ed3-47a4-aaff-a301e6ea6000 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:13.632285 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-86ca405b-5ed3-47a4-aaff-a301e6ea6000 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:13.682141 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:39:14.178659 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-86ca405b-5ed3-47a4-aaff-a301e6ea6000 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:14.193958 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-86ca405b-5ed3-47a4-aaff-a301e6ea6000 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:14.201760 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-86ca405b-5ed3-47a4-aaff-a301e6ea6000 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:14.209265 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-86ca405b-5ed3-47a4-aaff-a301e6ea6000 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1675 microversion: 2.20 time: 0.617792 Oct 26 13:39:14.210551 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3059/6083] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:39:13 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1675 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:39:15.242196 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7112b8a5-2a65-4758-a775-9f4250d6a285 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:15.242853 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7112b8a5-2a65-4758-a775-9f4250d6a285 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:15.263762 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7112b8a5-2a65-4758-a775-9f4250d6a285 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:15.264159 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7112b8a5-2a65-4758-a775-9f4250d6a285 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:15.264600 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7112b8a5-2a65-4758-a775-9f4250d6a285 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:15.265322 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7112b8a5-2a65-4758-a775-9f4250d6a285 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:15.265809 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7112b8a5-2a65-4758-a775-9f4250d6a285 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:15.266238 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7112b8a5-2a65-4758-a775-9f4250d6a285 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:15.941170 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7112b8a5-2a65-4758-a775-9f4250d6a285 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:15.953296 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7112b8a5-2a65-4758-a775-9f4250d6a285 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:15.963492 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7112b8a5-2a65-4758-a775-9f4250d6a285 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:15.967249 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7112b8a5-2a65-4758-a775-9f4250d6a285 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1675 microversion: 2.20 time: 0.730945 Oct 26 13:39:15.983576 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3025/6084] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:39:15 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1675 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:39:17.014837 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-50ece167-a96f-4af9-ad86-4992f5f48280 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:17.016174 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-50ece167-a96f-4af9-ad86-4992f5f48280 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:17.026381 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50ece167-a96f-4af9-ad86-4992f5f48280 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:17.030650 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50ece167-a96f-4af9-ad86-4992f5f48280 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:17.034698 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50ece167-a96f-4af9-ad86-4992f5f48280 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:17.035787 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50ece167-a96f-4af9-ad86-4992f5f48280 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:17.036501 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50ece167-a96f-4af9-ad86-4992f5f48280 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:17.037164 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50ece167-a96f-4af9-ad86-4992f5f48280 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:17.893696 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-50ece167-a96f-4af9-ad86-4992f5f48280 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:17.902817 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-50ece167-a96f-4af9-ad86-4992f5f48280 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:17.915542 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-50ece167-a96f-4af9-ad86-4992f5f48280 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:17.923812 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-50ece167-a96f-4af9-ad86-4992f5f48280 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1733 microversion: 2.20 time: 0.913262 Oct 26 13:39:17.936312 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3060/6085] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:39:17 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1733 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:39:18.205383 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-367e42ca-83d1-4c3f-9f2a-26d3bb05bc48 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:18.206168 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-367e42ca-83d1-4c3f-9f2a-26d3bb05bc48 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] [instance: 6e20f2e4-4511-44d1-81a0-094aab3801a2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:18.217219 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-367e42ca-83d1-4c3f-9f2a-26d3bb05bc48 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:18.225826 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-367e42ca-83d1-4c3f-9f2a-26d3bb05bc48 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:18.226692 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-367e42ca-83d1-4c3f-9f2a-26d3bb05bc48 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:18.234536 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-367e42ca-83d1-4c3f-9f2a-26d3bb05bc48 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:18.242238 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-367e42ca-83d1-4c3f-9f2a-26d3bb05bc48 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:18.242857 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-367e42ca-83d1-4c3f-9f2a-26d3bb05bc48 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:18.340676 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-367e42ca-83d1-4c3f-9f2a-26d3bb05bc48 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] [instance: 6e20f2e4-4511-44d1-81a0-094aab3801a2] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:39:18.379670 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:39:18.594744 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-367e42ca-83d1-4c3f-9f2a-26d3bb05bc48 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6e20f2e4-4511-44d1-81a0-094aab3801a2" status: 204 len: 0 microversion: 2.1 time: 0.393437 Oct 26 13:39:18.596662 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3026/6086] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:39:18 2022] DELETE /compute/v2.1/servers/6e20f2e4-4511-44d1-81a0-094aab3801a2 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:39:18.605777 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-86a67b4d-258e-42d3-ac98-b1b6d1aac1d5 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:18.606769 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-86a67b4d-258e-42d3-ac98-b1b6d1aac1d5 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] [instance: 6e20f2e4-4511-44d1-81a0-094aab3801a2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:18.636136 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-86a67b4d-258e-42d3-ac98-b1b6d1aac1d5 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:18.637077 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-86a67b4d-258e-42d3-ac98-b1b6d1aac1d5 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:18.638113 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-86a67b4d-258e-42d3-ac98-b1b6d1aac1d5 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:18.641065 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-86a67b4d-258e-42d3-ac98-b1b6d1aac1d5 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:18.641800 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-86a67b4d-258e-42d3-ac98-b1b6d1aac1d5 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:18.642352 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-86a67b4d-258e-42d3-ac98-b1b6d1aac1d5 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:18.964887 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-05694beb-fce8-49b4-b874-1d50c0f13491 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:18.967520 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-05694beb-fce8-49b4-b874-1d50c0f13491 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:18.986089 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05694beb-fce8-49b4-b874-1d50c0f13491 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:18.994238 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05694beb-fce8-49b4-b874-1d50c0f13491 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:18.994706 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05694beb-fce8-49b4-b874-1d50c0f13491 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:18.995631 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05694beb-fce8-49b4-b874-1d50c0f13491 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:18.996244 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05694beb-fce8-49b4-b874-1d50c0f13491 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:18.996925 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05694beb-fce8-49b4-b874-1d50c0f13491 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:19.469411 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-05694beb-fce8-49b4-b874-1d50c0f13491 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:19.491293 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-05694beb-fce8-49b4-b874-1d50c0f13491 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:19.496162 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-05694beb-fce8-49b4-b874-1d50c0f13491 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:19.501828 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-05694beb-fce8-49b4-b874-1d50c0f13491 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1733 microversion: 2.20 time: 0.541821 Oct 26 13:39:19.504188 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3027/6087] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:39:18 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1733 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:39:20.272617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-86a67b4d-258e-42d3-ac98-b1b6d1aac1d5 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703c6fdda52948f6acc9698a4bdb189d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d55b2072282496ca5ebc5f73b5b8bb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:20.287400 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-86a67b4d-258e-42d3-ac98-b1b6d1aac1d5 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] 10.222.0.40 "GET /compute/v2.1/servers/6e20f2e4-4511-44d1-81a0-094aab3801a2" status: 200 len: 1504 microversion: 2.1 time: 1.686266 Oct 26 13:39:20.291284 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3061/6088] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:18 2022] GET /compute/v2.1/servers/6e20f2e4-4511-44d1-81a0-094aab3801a2 => generated 1504 bytes in 1691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:39:20.542491 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-20572e43-f842-4056-a6ab-c2d266a5b8ff tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:20.543244 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-20572e43-f842-4056-a6ab-c2d266a5b8ff tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:20.559569 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20572e43-f842-4056-a6ab-c2d266a5b8ff tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:20.562395 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20572e43-f842-4056-a6ab-c2d266a5b8ff tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:20.562871 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20572e43-f842-4056-a6ab-c2d266a5b8ff tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:20.568481 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20572e43-f842-4056-a6ab-c2d266a5b8ff tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:20.568992 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20572e43-f842-4056-a6ab-c2d266a5b8ff tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:20.569442 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20572e43-f842-4056-a6ab-c2d266a5b8ff tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:21.319373 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-da5533fd-78f1-4c42-a48e-833b61249e88 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:21.320212 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-da5533fd-78f1-4c42-a48e-833b61249e88 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] [instance: 6e20f2e4-4511-44d1-81a0-094aab3801a2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:21.339967 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da5533fd-78f1-4c42-a48e-833b61249e88 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:21.343096 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da5533fd-78f1-4c42-a48e-833b61249e88 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:21.344726 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da5533fd-78f1-4c42-a48e-833b61249e88 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:21.349148 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da5533fd-78f1-4c42-a48e-833b61249e88 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:21.352007 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da5533fd-78f1-4c42-a48e-833b61249e88 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:21.353080 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da5533fd-78f1-4c42-a48e-833b61249e88 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:21.724509 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-20572e43-f842-4056-a6ab-c2d266a5b8ff tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:21.747356 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-20572e43-f842-4056-a6ab-c2d266a5b8ff tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:21.749972 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-20572e43-f842-4056-a6ab-c2d266a5b8ff tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:21.756159 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-20572e43-f842-4056-a6ab-c2d266a5b8ff tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1733 microversion: 2.20 time: 1.221699 Oct 26 13:39:21.757270 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3028/6089] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:39:20 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1733 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:39:22.013068 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-da5533fd-78f1-4c42-a48e-833b61249e88 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703c6fdda52948f6acc9698a4bdb189d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d55b2072282496ca5ebc5f73b5b8bb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:22.030574 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-da5533fd-78f1-4c42-a48e-833b61249e88 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] 10.222.0.40 "GET /compute/v2.1/servers/6e20f2e4-4511-44d1-81a0-094aab3801a2" status: 200 len: 1504 microversion: 2.1 time: 0.715577 Oct 26 13:39:22.032283 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3062/6090] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:21 2022] GET /compute/v2.1/servers/6e20f2e4-4511-44d1-81a0-094aab3801a2 => generated 1504 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:39:22.598999 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-04202c4b-2ff2-45e5-b852-42d74660ca94 req-5fbf9d53-a4ba-4dc1-b7d9-1662b31c19cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e20f2e4-4511-44d1-81a0-094aab3801a2", "name": "network-vif-deleted", "tag": "c4011853-bd70-4bac-99e2-3dd643ed7c4a"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:39:22.674980 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-0f849a68-1286-4aec-8336-82cf3dd42205 req-5c15415c-041c-4b64-b306-c3fa5306dcef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52b4e824-6117-46a5-a005-0bef3bc75052", "tag": "86120fac-67e2-4ce8-a98b-0f683e946ba4"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:39:22.721566 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-04202c4b-2ff2-45e5-b852-42d74660ca94 req-5fbf9d53-a4ba-4dc1-b7d9-1662b31c19cf service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:22.724948 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-04202c4b-2ff2-45e5-b852-42d74660ca94 req-5fbf9d53-a4ba-4dc1-b7d9-1662b31c19cf service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:22.750087 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-04202c4b-2ff2-45e5-b852-42d74660ca94 req-5fbf9d53-a4ba-4dc1-b7d9-1662b31c19cf service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:22.793769 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-0f849a68-1286-4aec-8336-82cf3dd42205 req-5c15415c-041c-4b64-b306-c3fa5306dcef service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:22.795654 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-0f849a68-1286-4aec-8336-82cf3dd42205 req-5c15415c-041c-4b64-b306-c3fa5306dcef service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:22.798593 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-0f849a68-1286-4aec-8336-82cf3dd42205 req-5c15415c-041c-4b64-b306-c3fa5306dcef service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:22.817080 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-04202c4b-2ff2-45e5-b852-42d74660ca94 req-5fbf9d53-a4ba-4dc1-b7d9-1662b31c19cf service nova] Creating event network-vif-deleted:c4011853-bd70-4bac-99e2-3dd643ed7c4a for instance 6e20f2e4-4511-44d1-81a0-094aab3801a2 on n-h2-862686-1 Oct 26 13:39:22.840597 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-04202c4b-2ff2-45e5-b852-42d74660ca94 req-5fbf9d53-a4ba-4dc1-b7d9-1662b31c19cf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.254379 Oct 26 13:39:22.845388 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3029/6091] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:39:22.849056 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-0f849a68-1286-4aec-8336-82cf3dd42205 req-5c15415c-041c-4b64-b306-c3fa5306dcef service nova] Creating event network-changed:86120fac-67e2-4ce8-a98b-0f683e946ba4 for instance 52b4e824-6117-46a5-a005-0bef3bc75052 on n-h1-862686-1 Oct 26 13:39:22.862995 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4fbd4f5d-ee89-4a8f-a53e-024c1a958153 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:22.865240 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-0f849a68-1286-4aec-8336-82cf3dd42205 req-5c15415c-041c-4b64-b306-c3fa5306dcef service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.200694 Oct 26 13:39:22.867495 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4fbd4f5d-ee89-4a8f-a53e-024c1a958153 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:22.869017 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3063/6092] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:39:22.879897 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4fbd4f5d-ee89-4a8f-a53e-024c1a958153 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:22.880678 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4fbd4f5d-ee89-4a8f-a53e-024c1a958153 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:22.881363 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4fbd4f5d-ee89-4a8f-a53e-024c1a958153 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:22.883249 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4fbd4f5d-ee89-4a8f-a53e-024c1a958153 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:22.885176 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4fbd4f5d-ee89-4a8f-a53e-024c1a958153 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:22.886384 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4fbd4f5d-ee89-4a8f-a53e-024c1a958153 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:23.068082 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-00d9cc03-d563-4d01-b69c-01a64ea72216 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:23.068858 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-00d9cc03-d563-4d01-b69c-01a64ea72216 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] [instance: 6e20f2e4-4511-44d1-81a0-094aab3801a2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:23.105675 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-00d9cc03-d563-4d01-b69c-01a64ea72216 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:23.108224 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-00d9cc03-d563-4d01-b69c-01a64ea72216 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:23.108700 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-00d9cc03-d563-4d01-b69c-01a64ea72216 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:23.116003 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-00d9cc03-d563-4d01-b69c-01a64ea72216 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:23.116945 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-00d9cc03-d563-4d01-b69c-01a64ea72216 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:23.120072 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-00d9cc03-d563-4d01-b69c-01a64ea72216 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:23.362865 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-00d9cc03-d563-4d01-b69c-01a64ea72216 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:23.363602 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-00d9cc03-d563-4d01-b69c-01a64ea72216 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:23.364207 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-00d9cc03-d563-4d01-b69c-01a64ea72216 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:23.364848 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-00d9cc03-d563-4d01-b69c-01a64ea72216 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lazy-loading 'fault' on Instance uuid 6e20f2e4-4511-44d1-81a0-094aab3801a2 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:39:23.574615 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-00d9cc03-d563-4d01-b69c-01a64ea72216 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703c6fdda52948f6acc9698a4bdb189d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d55b2072282496ca5ebc5f73b5b8bb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:23.594265 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-00d9cc03-d563-4d01-b69c-01a64ea72216 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] 10.222.0.40 "GET /compute/v2.1/servers/6e20f2e4-4511-44d1-81a0-094aab3801a2" status: 200 len: 1304 microversion: 2.1 time: 0.527791 Oct 26 13:39:23.606868 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3064/6093] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:23 2022] GET /compute/v2.1/servers/6e20f2e4-4511-44d1-81a0-094aab3801a2 => generated 1304 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:39:23.834760 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4fbd4f5d-ee89-4a8f-a53e-024c1a958153 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:23.853443 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4fbd4f5d-ee89-4a8f-a53e-024c1a958153 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:23.859095 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4fbd4f5d-ee89-4a8f-a53e-024c1a958153 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:23.860832 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4fbd4f5d-ee89-4a8f-a53e-024c1a958153 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1733 microversion: 2.20 time: 1.012498 Oct 26 13:39:23.862537 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3030/6094] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:39:22 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1733 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:39:23.889076 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4dcf8fef-cd2e-4d59-8b6c-f4a2475e5905 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-527238673", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "0f29f5ba-7035-45a3-b34e-7bdf182d867f"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:39:24.007625 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-4dcf8fef-cd2e-4d59-8b6c-f4a2475e5905 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] validate_networks() for [('0f29f5ba-7035-45a3-b34e-7bdf182d867f', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:39:24.626931 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5fbe3c03-5e41-49b9-9c2e-53df55f45d23 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:24.628443 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5fbe3c03-5e41-49b9-9c2e-53df55f45d23 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] [instance: 6e20f2e4-4511-44d1-81a0-094aab3801a2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:24.642449 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5fbe3c03-5e41-49b9-9c2e-53df55f45d23 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:24.643105 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5fbe3c03-5e41-49b9-9c2e-53df55f45d23 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:24.643660 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5fbe3c03-5e41-49b9-9c2e-53df55f45d23 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:24.645532 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5fbe3c03-5e41-49b9-9c2e-53df55f45d23 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:24.646519 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5fbe3c03-5e41-49b9-9c2e-53df55f45d23 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:24.648699 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5fbe3c03-5e41-49b9-9c2e-53df55f45d23 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:24.703206 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-5fbe3c03-5e41-49b9-9c2e-53df55f45d23 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] HTTP exception thrown: Instance 6e20f2e4-4511-44d1-81a0-094aab3801a2 could not be found. Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5fbe3c03-5e41-49b9-9c2e-53df55f45d23 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Request method failure captured: Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/6e20f2e4-4511-44d1-81a0-094aab3801a2 HTTP/1.1 Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWThfvfifymT59nTY1TtHzkvChG4vR_pjMejGU2MDRXz_MpfwymwgmVm6cDL5rSlsUkWvIHNHBxF7ILFnkh1nMXOendBbmlqevahL3vjPp9UdY_8n9br3euN4gYPOFEv9iVNpi_Ns_Hkob78oWQyWBMZrZs-Fpc3aCHwObsq0TFrU7j0 Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 9d55b2072282496ca5ebc5f73b5b8bb4 Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-VolumesActionsTest-2078526673 Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9d55b2072282496ca5ebc5f73b5b8bb4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9d55b2072282496ca5ebc5f73b5b8bb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9d55b2072282496ca5ebc5f73b5b8bb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9d55b2072282496ca5ebc5f73b5b8bb4"}]}] Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-VolumesActionsTest-2078526673 Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 9d55b2072282496ca5ebc5f73b5b8bb4 Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-VolumesActionsTest-2078526673 Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-VolumesActionsTest-2078526673-project Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 703c6fdda52948f6acc9698a4bdb189d Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-VolumesActionsTest-2078526673-project Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 6e20f2e4-4511-44d1-81a0-094aab3801a2 could not be found. Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '6e20f2e4-4511-44d1-81a0-094aab3801a2'} Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e20f2e4-4511-44d1-81a0-094aab3801a2 could not be found. Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e20f2e4-4511-44d1-81a0-094aab3801a2 could not be found. Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:39:24.728515 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:39:24.732215 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:39:24.732215 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:39:24.732215 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:39:24.732215 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:39:24.732215 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:39:24.732215 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e20f2e4-4511-44d1-81a0-094aab3801a2 could not be found. Oct 26 13:39:24.732215 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:39:24.732215 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5fbe3c03-5e41-49b9-9c2e-53df55f45d23 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] Returning 404 to user: Instance 6e20f2e4-4511-44d1-81a0-094aab3801a2 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:39:24.732215 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5fbe3c03-5e41-49b9-9c2e-53df55f45d23 tempest-VolumesActionsTest-2078526673 tempest-VolumesActionsTest-2078526673-project] 10.222.0.40 "GET /compute/v2.1/servers/6e20f2e4-4511-44d1-81a0-094aab3801a2" status: 404 len: 111 microversion: 2.1 time: 0.099663 Oct 26 13:39:24.732215 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3031/6095] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:24 2022] GET /compute/v2.1/servers/6e20f2e4-4511-44d1-81a0-094aab3801a2 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 13:39:24.892282 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0e0718b0-54af-44d5-8619-380558e2808e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:24.893702 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0e0718b0-54af-44d5-8619-380558e2808e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:24.912563 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0e0718b0-54af-44d5-8619-380558e2808e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:24.920573 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0e0718b0-54af-44d5-8619-380558e2808e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:24.921204 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0e0718b0-54af-44d5-8619-380558e2808e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:24.929625 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0e0718b0-54af-44d5-8619-380558e2808e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:24.932236 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0e0718b0-54af-44d5-8619-380558e2808e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:24.932858 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0e0718b0-54af-44d5-8619-380558e2808e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:25.628828 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-4dcf8fef-cd2e-4d59-8b6c-f4a2475e5905 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:39:25.629824 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-4dcf8fef-cd2e-4d59-8b6c-f4a2475e5905 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:39:25.630545 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-4dcf8fef-cd2e-4d59-8b6c-f4a2475e5905 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:39:25.631194 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-4dcf8fef-cd2e-4d59-8b6c-f4a2475e5905 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:39:25.632089 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-4dcf8fef-cd2e-4d59-8b6c-f4a2475e5905 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:39:25.657863 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4dcf8fef-cd2e-4d59-8b6c-f4a2475e5905 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:25.658595 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4dcf8fef-cd2e-4d59-8b6c-f4a2475e5905 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:25.663435 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4dcf8fef-cd2e-4d59-8b6c-f4a2475e5905 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:25.664422 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4dcf8fef-cd2e-4d59-8b6c-f4a2475e5905 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:25.665046 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4dcf8fef-cd2e-4d59-8b6c-f4a2475e5905 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:25.674227 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4dcf8fef-cd2e-4d59-8b6c-f4a2475e5905 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:25.748297 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-4dcf8fef-cd2e-4d59-8b6c-f4a2475e5905 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Getting quotas for project 6fd47c4f41a64b56b1b571ab5bcd9bef. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:39:25.764725 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-4dcf8fef-cd2e-4d59-8b6c-f4a2475e5905 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Getting quotas for user 6c55ea80b2e14c99baf3d551f00bfa68 and project 6fd47c4f41a64b56b1b571ab5bcd9bef. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:39:25.795170 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4dcf8fef-cd2e-4d59-8b6c-f4a2475e5905 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:39:25.797634 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4dcf8fef-cd2e-4d59-8b6c-f4a2475e5905 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: d470b39a-b9d6-476b-a720-1d61204c3d1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:39:25.913392 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0e0718b0-54af-44d5-8619-380558e2808e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:25.921108 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4dcf8fef-cd2e-4d59-8b6c-f4a2475e5905 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.043736 Oct 26 13:39:25.926292 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3065/6096] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:39:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 2050 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:39:25.934467 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-101011d9-5566-47f0-8d5d-8c49a561dc2b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:25.935116 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-101011d9-5566-47f0-8d5d-8c49a561dc2b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: d470b39a-b9d6-476b-a720-1d61204c3d1c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:25.952813 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0e0718b0-54af-44d5-8619-380558e2808e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:25.957636 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0e0718b0-54af-44d5-8619-380558e2808e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:25.959144 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0e0718b0-54af-44d5-8619-380558e2808e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1733 microversion: 2.20 time: 1.070904 Oct 26 13:39:25.991558 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3032/6097] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:39:24 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1733 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:39:26.247040 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-101011d9-5566-47f0-8d5d-8c49a561dc2b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c55ea80b2e14c99baf3d551f00bfa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd47c4f41a64b56b1b571ab5bcd9bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:26.257694 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-101011d9-5566-47f0-8d5d-8c49a561dc2b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c" status: 200 len: 1218 microversion: 2.1 time: 0.326675 Oct 26 13:39:26.277514 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3066/6098] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:25 2022] GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c => generated 1218 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:39:26.936293 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e5147374-9f98-4c2c-8d63-d6d78cb47f79 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:26.936728 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e5147374-9f98-4c2c-8d63-d6d78cb47f79 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] [instance: 65e73a8e-e75d-4efe-a886-7328b0414a1e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:26.958371 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e5147374-9f98-4c2c-8d63-d6d78cb47f79 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:26.958967 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e5147374-9f98-4c2c-8d63-d6d78cb47f79 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:26.959431 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e5147374-9f98-4c2c-8d63-d6d78cb47f79 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:26.960817 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-10303304-e385-490a-9674-eafe7e516584 req-248636f6-1a37-4a0a-adc0-fcec6c658b9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65e73a8e-e75d-4efe-a886-7328b0414a1e", "tag": "24ca771f-2301-436c-8a32-78c33e5269cd"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:39:26.966825 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e5147374-9f98-4c2c-8d63-d6d78cb47f79 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:26.967571 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e5147374-9f98-4c2c-8d63-d6d78cb47f79 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:26.968077 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e5147374-9f98-4c2c-8d63-d6d78cb47f79 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:26.993330 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-10303304-e385-490a-9674-eafe7e516584 req-248636f6-1a37-4a0a-adc0-fcec6c658b9a service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:26.993953 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-10303304-e385-490a-9674-eafe7e516584 req-248636f6-1a37-4a0a-adc0-fcec6c658b9a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:26.995063 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-10303304-e385-490a-9674-eafe7e516584 req-248636f6-1a37-4a0a-adc0-fcec6c658b9a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:27.057509 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e5147374-9f98-4c2c-8d63-d6d78cb47f79 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] [instance: 65e73a8e-e75d-4efe-a886-7328b0414a1e] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:39:27.089582 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-10303304-e385-490a-9674-eafe7e516584 req-248636f6-1a37-4a0a-adc0-fcec6c658b9a service nova] Creating event network-changed:24ca771f-2301-436c-8a32-78c33e5269cd for instance 65e73a8e-e75d-4efe-a886-7328b0414a1e on n-h1-862686-1 Oct 26 13:39:27.111543 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-10303304-e385-490a-9674-eafe7e516584 req-248636f6-1a37-4a0a-adc0-fcec6c658b9a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153099 Oct 26 13:39:27.115052 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3067/6099] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:39:27.128673 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b3eb22ec-280e-43ff-ad3e-aed39d748096 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:27.130775 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b3eb22ec-280e-43ff-ad3e-aed39d748096 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:27.151185 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3eb22ec-280e-43ff-ad3e-aed39d748096 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:27.152918 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3eb22ec-280e-43ff-ad3e-aed39d748096 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:27.153508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3eb22ec-280e-43ff-ad3e-aed39d748096 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:27.156544 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3eb22ec-280e-43ff-ad3e-aed39d748096 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:27.157797 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3eb22ec-280e-43ff-ad3e-aed39d748096 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:27.158679 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3eb22ec-280e-43ff-ad3e-aed39d748096 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:27.457065 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e5147374-9f98-4c2c-8d63-d6d78cb47f79 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] 10.222.0.40 "DELETE /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e" status: 204 len: 0 microversion: 2.1 time: 0.524364 Oct 26 13:39:27.460247 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3033/6100] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:39:26 2022] DELETE /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e => generated 0 bytes in 530 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:39:27.490155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a32fa057-4a8f-4f41-9480-7c248356ca5b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:27.493792 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a32fa057-4a8f-4f41-9480-7c248356ca5b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: d470b39a-b9d6-476b-a720-1d61204c3d1c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:27.511602 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a32fa057-4a8f-4f41-9480-7c248356ca5b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:27.512100 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a32fa057-4a8f-4f41-9480-7c248356ca5b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:27.512543 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a32fa057-4a8f-4f41-9480-7c248356ca5b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:27.518308 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a32fa057-4a8f-4f41-9480-7c248356ca5b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:27.519045 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a32fa057-4a8f-4f41-9480-7c248356ca5b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:27.519646 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a32fa057-4a8f-4f41-9480-7c248356ca5b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:27.826132 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a32fa057-4a8f-4f41-9480-7c248356ca5b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c55ea80b2e14c99baf3d551f00bfa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd47c4f41a64b56b1b571ab5bcd9bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:27.840575 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a32fa057-4a8f-4f41-9480-7c248356ca5b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c" status: 200 len: 1214 microversion: 2.1 time: 0.378112 Oct 26 13:39:27.841244 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3034/6101] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:27 2022] GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c => generated 1214 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:39:27.879296 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c97007c0-a93d-41e9-a457-04f4f07f3c67 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:27.879935 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c97007c0-a93d-41e9-a457-04f4f07f3c67 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] [instance: 65e73a8e-e75d-4efe-a886-7328b0414a1e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:27.905053 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c97007c0-a93d-41e9-a457-04f4f07f3c67 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:27.905711 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c97007c0-a93d-41e9-a457-04f4f07f3c67 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:27.906407 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c97007c0-a93d-41e9-a457-04f4f07f3c67 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:27.907392 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c97007c0-a93d-41e9-a457-04f4f07f3c67 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:27.908109 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c97007c0-a93d-41e9-a457-04f4f07f3c67 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:27.908987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c97007c0-a93d-41e9-a457-04f4f07f3c67 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:27.928159 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b3eb22ec-280e-43ff-ad3e-aed39d748096 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:27.944929 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b3eb22ec-280e-43ff-ad3e-aed39d748096 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:27.951911 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b3eb22ec-280e-43ff-ad3e-aed39d748096 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:27.956704 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b3eb22ec-280e-43ff-ad3e-aed39d748096 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1733 microversion: 2.20 time: 0.839691 Oct 26 13:39:27.960862 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3068/6102] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:39:27 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1733 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:39:28.414705 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c97007c0-a93d-41e9-a457-04f4f07f3c67 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35782c90feff41dea454598bb3630c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13767903b18d44608a0ca38724c0d10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:28.424943 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c97007c0-a93d-41e9-a457-04f4f07f3c67 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] 10.222.0.40 "GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e" status: 200 len: 1585 microversion: 2.1 time: 0.582620 Oct 26 13:39:28.430018 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3035/6103] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:27 2022] GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e => generated 1585 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:39:28.866215 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-406bd979-91c1-45c9-9fc2-b012cbb354a0 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:28.867318 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-406bd979-91c1-45c9-9fc2-b012cbb354a0 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: d470b39a-b9d6-476b-a720-1d61204c3d1c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:28.885248 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-406bd979-91c1-45c9-9fc2-b012cbb354a0 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:28.885853 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-406bd979-91c1-45c9-9fc2-b012cbb354a0 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:28.886317 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-406bd979-91c1-45c9-9fc2-b012cbb354a0 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:28.890152 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-406bd979-91c1-45c9-9fc2-b012cbb354a0 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:28.892555 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-406bd979-91c1-45c9-9fc2-b012cbb354a0 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:28.893027 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-406bd979-91c1-45c9-9fc2-b012cbb354a0 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:28.987425 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ee881537-d78d-41f4-9bcf-3a04e07c64d3 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:28.988591 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ee881537-d78d-41f4-9bcf-3a04e07c64d3 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:29.006631 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ee881537-d78d-41f4-9bcf-3a04e07c64d3 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:29.008046 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ee881537-d78d-41f4-9bcf-3a04e07c64d3 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:29.009057 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ee881537-d78d-41f4-9bcf-3a04e07c64d3 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:29.013735 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ee881537-d78d-41f4-9bcf-3a04e07c64d3 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:29.014474 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ee881537-d78d-41f4-9bcf-3a04e07c64d3 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:29.015501 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ee881537-d78d-41f4-9bcf-3a04e07c64d3 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:29.608635 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-406bd979-91c1-45c9-9fc2-b012cbb354a0 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c55ea80b2e14c99baf3d551f00bfa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd47c4f41a64b56b1b571ab5bcd9bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:29.616828 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-406bd979-91c1-45c9-9fc2-b012cbb354a0 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c" status: 200 len: 1276 microversion: 2.1 time: 0.755104 Oct 26 13:39:29.621149 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3069/6104] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:28 2022] GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c => generated 1276 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:39:29.625915 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d74ccfb1-eba4-4e8e-8f08-38d73df88c97 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:29.626542 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d74ccfb1-eba4-4e8e-8f08-38d73df88c97 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] [instance: 65e73a8e-e75d-4efe-a886-7328b0414a1e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:29.652137 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d74ccfb1-eba4-4e8e-8f08-38d73df88c97 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:29.652641 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d74ccfb1-eba4-4e8e-8f08-38d73df88c97 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:29.653082 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d74ccfb1-eba4-4e8e-8f08-38d73df88c97 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:29.662377 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d74ccfb1-eba4-4e8e-8f08-38d73df88c97 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:29.663256 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d74ccfb1-eba4-4e8e-8f08-38d73df88c97 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:29.663726 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d74ccfb1-eba4-4e8e-8f08-38d73df88c97 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:30.200608 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d74ccfb1-eba4-4e8e-8f08-38d73df88c97 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35782c90feff41dea454598bb3630c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13767903b18d44608a0ca38724c0d10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:30.217968 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d74ccfb1-eba4-4e8e-8f08-38d73df88c97 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] 10.222.0.40 "GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e" status: 200 len: 1585 microversion: 2.1 time: 0.593358 Oct 26 13:39:30.222224 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3070/6105] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:29 2022] GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e => generated 1585 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:39:30.576101 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ee881537-d78d-41f4-9bcf-3a04e07c64d3 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:30.593988 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ee881537-d78d-41f4-9bcf-3a04e07c64d3 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:30.596368 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ee881537-d78d-41f4-9bcf-3a04e07c64d3 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:30.602291 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ee881537-d78d-41f4-9bcf-3a04e07c64d3 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1733 microversion: 2.20 time: 1.619660 Oct 26 13:39:30.608997 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3036/6106] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:39:28 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1733 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:39:30.649279 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e4218aec-ad51-4b0c-b901-7441ac95b7d7 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:30.649929 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e4218aec-ad51-4b0c-b901-7441ac95b7d7 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: d470b39a-b9d6-476b-a720-1d61204c3d1c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:30.669206 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4218aec-ad51-4b0c-b901-7441ac95b7d7 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:30.676983 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4218aec-ad51-4b0c-b901-7441ac95b7d7 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:30.696486 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4218aec-ad51-4b0c-b901-7441ac95b7d7 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:30.698982 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4218aec-ad51-4b0c-b901-7441ac95b7d7 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:30.706313 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4218aec-ad51-4b0c-b901-7441ac95b7d7 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:30.708711 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4218aec-ad51-4b0c-b901-7441ac95b7d7 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:31.246186 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5f5b6da7-0f9f-40b6-88e3-66b720318271 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:31.246975 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5f5b6da7-0f9f-40b6-88e3-66b720318271 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] [instance: 65e73a8e-e75d-4efe-a886-7328b0414a1e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:31.250885 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=4 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:39:31.280191 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5f5b6da7-0f9f-40b6-88e3-66b720318271 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:31.282179 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5f5b6da7-0f9f-40b6-88e3-66b720318271 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:31.286367 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5f5b6da7-0f9f-40b6-88e3-66b720318271 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:31.288887 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5f5b6da7-0f9f-40b6-88e3-66b720318271 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:31.290242 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5f5b6da7-0f9f-40b6-88e3-66b720318271 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:31.294657 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5f5b6da7-0f9f-40b6-88e3-66b720318271 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:32.314371 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5f5b6da7-0f9f-40b6-88e3-66b720318271 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35782c90feff41dea454598bb3630c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13767903b18d44608a0ca38724c0d10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:32.332690 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5f5b6da7-0f9f-40b6-88e3-66b720318271 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] 10.222.0.40 "GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e" status: 200 len: 1585 microversion: 2.1 time: 1.087016 Oct 26 13:39:32.333779 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3037/6107] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:31 2022] GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e => generated 1585 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:39:32.345397 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d7974e3b-ba40-44cc-8c27-aaec865b7df0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:32.346941 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d7974e3b-ba40-44cc-8c27-aaec865b7df0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:32.362608 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7974e3b-ba40-44cc-8c27-aaec865b7df0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:32.363636 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7974e3b-ba40-44cc-8c27-aaec865b7df0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:32.365569 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7974e3b-ba40-44cc-8c27-aaec865b7df0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:32.367776 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7974e3b-ba40-44cc-8c27-aaec865b7df0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:32.368487 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7974e3b-ba40-44cc-8c27-aaec865b7df0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:32.370630 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7974e3b-ba40-44cc-8c27-aaec865b7df0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:32.487257 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e4218aec-ad51-4b0c-b901-7441ac95b7d7 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c55ea80b2e14c99baf3d551f00bfa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd47c4f41a64b56b1b571ab5bcd9bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:32.506170 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e4218aec-ad51-4b0c-b901-7441ac95b7d7 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c" status: 200 len: 1318 microversion: 2.1 time: 1.854312 Oct 26 13:39:32.522846 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3071/6108] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:30 2022] GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c => generated 1318 bytes in 1879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:39:32.835493 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d7974e3b-ba40-44cc-8c27-aaec865b7df0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:32.860032 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d7974e3b-ba40-44cc-8c27-aaec865b7df0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:32.869508 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d7974e3b-ba40-44cc-8c27-aaec865b7df0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:32.871484 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d7974e3b-ba40-44cc-8c27-aaec865b7df0 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1733 microversion: 2.20 time: 0.536207 Oct 26 13:39:32.872740 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3038/6109] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:39:32 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1733 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:39:33.374470 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0e72b0d7-0ca3-440f-9689-187bb34b488b tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:33.376123 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0e72b0d7-0ca3-440f-9689-187bb34b488b tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] [instance: 65e73a8e-e75d-4efe-a886-7328b0414a1e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:33.419957 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0e72b0d7-0ca3-440f-9689-187bb34b488b tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:33.424414 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0e72b0d7-0ca3-440f-9689-187bb34b488b tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:33.425278 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0e72b0d7-0ca3-440f-9689-187bb34b488b tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:33.427167 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0e72b0d7-0ca3-440f-9689-187bb34b488b tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:33.429157 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0e72b0d7-0ca3-440f-9689-187bb34b488b tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:33.431096 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0e72b0d7-0ca3-440f-9689-187bb34b488b tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:33.534126 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6d33ef56-5e13-4813-8bd5-a9e8abdc990d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:33.535419 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6d33ef56-5e13-4813-8bd5-a9e8abdc990d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: d470b39a-b9d6-476b-a720-1d61204c3d1c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:33.558025 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6d33ef56-5e13-4813-8bd5-a9e8abdc990d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:33.558832 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6d33ef56-5e13-4813-8bd5-a9e8abdc990d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:33.559555 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6d33ef56-5e13-4813-8bd5-a9e8abdc990d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:33.562704 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6d33ef56-5e13-4813-8bd5-a9e8abdc990d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:33.568827 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6d33ef56-5e13-4813-8bd5-a9e8abdc990d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:33.569920 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6d33ef56-5e13-4813-8bd5-a9e8abdc990d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:33.683508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0e72b0d7-0ca3-440f-9689-187bb34b488b tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35782c90feff41dea454598bb3630c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13767903b18d44608a0ca38724c0d10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:33.708492 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0e72b0d7-0ca3-440f-9689-187bb34b488b tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] 10.222.0.40 "GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e" status: 200 len: 1398 microversion: 2.1 time: 0.348212 Oct 26 13:39:33.709116 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3072/6110] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:33 2022] GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e => generated 1398 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:39:33.884120 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-0b013728-0f9c-48b3-b20a-a521b4858b1d req-27498317-98f2-4a82-a9cd-386b3cbe69b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65e73a8e-e75d-4efe-a886-7328b0414a1e", "name": "network-vif-deleted", "tag": "24ca771f-2301-436c-8a32-78c33e5269cd"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:39:33.944593 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-0b013728-0f9c-48b3-b20a-a521b4858b1d req-27498317-98f2-4a82-a9cd-386b3cbe69b3 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:33.945317 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-0b013728-0f9c-48b3-b20a-a521b4858b1d req-27498317-98f2-4a82-a9cd-386b3cbe69b3 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:33.946864 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-0b013728-0f9c-48b3-b20a-a521b4858b1d req-27498317-98f2-4a82-a9cd-386b3cbe69b3 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:34.004221 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-0b013728-0f9c-48b3-b20a-a521b4858b1d req-27498317-98f2-4a82-a9cd-386b3cbe69b3 service nova] Creating event network-vif-deleted:24ca771f-2301-436c-8a32-78c33e5269cd for instance 65e73a8e-e75d-4efe-a886-7328b0414a1e on n-h1-862686-1 Oct 26 13:39:34.027932 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-0b013728-0f9c-48b3-b20a-a521b4858b1d req-27498317-98f2-4a82-a9cd-386b3cbe69b3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153279 Oct 26 13:39:34.031840 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3073/6111] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:39:34.061511 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-81d60ee4-1e05-42cb-9f4c-a058a04a9e2e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:34.062480 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-81d60ee4-1e05-42cb-9f4c-a058a04a9e2e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:34.076097 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:39:34.135094 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81d60ee4-1e05-42cb-9f4c-a058a04a9e2e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:34.137068 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81d60ee4-1e05-42cb-9f4c-a058a04a9e2e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:34.138583 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81d60ee4-1e05-42cb-9f4c-a058a04a9e2e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:34.140477 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81d60ee4-1e05-42cb-9f4c-a058a04a9e2e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:34.142016 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81d60ee4-1e05-42cb-9f4c-a058a04a9e2e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:34.144204 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81d60ee4-1e05-42cb-9f4c-a058a04a9e2e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:34.849747 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6d33ef56-5e13-4813-8bd5-a9e8abdc990d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c55ea80b2e14c99baf3d551f00bfa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd47c4f41a64b56b1b571ab5bcd9bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:34.874678 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6d33ef56-5e13-4813-8bd5-a9e8abdc990d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c" status: 200 len: 1318 microversion: 2.1 time: 1.345771 Oct 26 13:39:34.875463 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3039/6112] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:33 2022] GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c => generated 1318 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:39:34.909367 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-7ed0f63c-1d4a-41c9-8b5b-25f5516ab7ce req-45ec4b5d-5b53-4d66-b86b-0fcb968b3078 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d470b39a-b9d6-476b-a720-1d61204c3d1c", "tag": "ed2bdc64-bf6d-416e-a577-cd8eea2349ac"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:39:34.948578 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-7ed0f63c-1d4a-41c9-8b5b-25f5516ab7ce req-45ec4b5d-5b53-4d66-b86b-0fcb968b3078 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:34.955436 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-7ed0f63c-1d4a-41c9-8b5b-25f5516ab7ce req-45ec4b5d-5b53-4d66-b86b-0fcb968b3078 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:34.957937 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-7ed0f63c-1d4a-41c9-8b5b-25f5516ab7ce req-45ec4b5d-5b53-4d66-b86b-0fcb968b3078 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:35.010158 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-81d60ee4-1e05-42cb-9f4c-a058a04a9e2e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:35.015163 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-7ed0f63c-1d4a-41c9-8b5b-25f5516ab7ce req-45ec4b5d-5b53-4d66-b86b-0fcb968b3078 service nova] Creating event network-changed:ed2bdc64-bf6d-416e-a577-cd8eea2349ac for instance d470b39a-b9d6-476b-a720-1d61204c3d1c on n-h2-862686-1 Oct 26 13:39:35.031354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-81d60ee4-1e05-42cb-9f4c-a058a04a9e2e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:35.036544 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-7ed0f63c-1d4a-41c9-8b5b-25f5516ab7ce req-45ec4b5d-5b53-4d66-b86b-0fcb968b3078 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154526 Oct 26 13:39:35.040142 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3040/6113] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:39:35.047903 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-81d60ee4-1e05-42cb-9f4c-a058a04a9e2e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:35.056128 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-81d60ee4-1e05-42cb-9f4c-a058a04a9e2e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1733 microversion: 2.20 time: 1.022527 Oct 26 13:39:35.056746 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3074/6114] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:39:34 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1733 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:39:35.091703 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c189be94-e52e-425b-9502-9225b2519241 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:35.094010 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c189be94-e52e-425b-9502-9225b2519241 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] [instance: 65e73a8e-e75d-4efe-a886-7328b0414a1e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:35.118220 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c189be94-e52e-425b-9502-9225b2519241 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:35.126262 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c189be94-e52e-425b-9502-9225b2519241 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:35.127098 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c189be94-e52e-425b-9502-9225b2519241 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:35.128254 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c189be94-e52e-425b-9502-9225b2519241 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:35.128880 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c189be94-e52e-425b-9502-9225b2519241 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:35.129630 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c189be94-e52e-425b-9502-9225b2519241 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:35.634869 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c189be94-e52e-425b-9502-9225b2519241 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35782c90feff41dea454598bb3630c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13767903b18d44608a0ca38724c0d10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:35.644334 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c189be94-e52e-425b-9502-9225b2519241 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] 10.222.0.40 "GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e" status: 200 len: 1230 microversion: 2.1 time: 0.602756 Oct 26 13:39:35.644929 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3041/6115] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:35 2022] GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e => generated 1230 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:39:35.899840 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cc75c55a-bdea-42e5-a169-7349ff1f8f3e tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:35.901532 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cc75c55a-bdea-42e5-a169-7349ff1f8f3e tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: d470b39a-b9d6-476b-a720-1d61204c3d1c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:35.912505 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:39:35.914988 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cc75c55a-bdea-42e5-a169-7349ff1f8f3e tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:35.916036 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cc75c55a-bdea-42e5-a169-7349ff1f8f3e tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:35.916762 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cc75c55a-bdea-42e5-a169-7349ff1f8f3e tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:35.917719 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cc75c55a-bdea-42e5-a169-7349ff1f8f3e tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:35.918346 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cc75c55a-bdea-42e5-a169-7349ff1f8f3e tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:35.918941 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cc75c55a-bdea-42e5-a169-7349ff1f8f3e tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:36.088006 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a392af45-4974-4b5b-b66c-5a00addc55be tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:36.088529 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a392af45-4974-4b5b-b66c-5a00addc55be tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:36.099197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a392af45-4974-4b5b-b66c-5a00addc55be tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:36.099710 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a392af45-4974-4b5b-b66c-5a00addc55be tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:36.100159 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a392af45-4974-4b5b-b66c-5a00addc55be tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:36.104277 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a392af45-4974-4b5b-b66c-5a00addc55be tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:36.106282 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a392af45-4974-4b5b-b66c-5a00addc55be tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:36.110010 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a392af45-4974-4b5b-b66c-5a00addc55be tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:36.120860 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:39:36.255221 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=8 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:39:36.325058 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-cc75c55a-bdea-42e5-a169-7349ff1f8f3e tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c55ea80b2e14c99baf3d551f00bfa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd47c4f41a64b56b1b571ab5bcd9bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:36.339233 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cc75c55a-bdea-42e5-a169-7349ff1f8f3e tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c" status: 200 len: 1318 microversion: 2.1 time: 0.443335 Oct 26 13:39:36.340145 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3075/6116] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:35 2022] GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c => generated 1318 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:39:36.668915 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a04b3f53-9722-4ece-b19e-bb3ea706e964 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:36.669588 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a04b3f53-9722-4ece-b19e-bb3ea706e964 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] [instance: 65e73a8e-e75d-4efe-a886-7328b0414a1e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:36.691344 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a04b3f53-9722-4ece-b19e-bb3ea706e964 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:36.693200 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a04b3f53-9722-4ece-b19e-bb3ea706e964 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:36.696183 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a04b3f53-9722-4ece-b19e-bb3ea706e964 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:36.701740 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a04b3f53-9722-4ece-b19e-bb3ea706e964 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:36.702270 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a04b3f53-9722-4ece-b19e-bb3ea706e964 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:36.702730 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a04b3f53-9722-4ece-b19e-bb3ea706e964 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:36.929989 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a04b3f53-9722-4ece-b19e-bb3ea706e964 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35782c90feff41dea454598bb3630c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13767903b18d44608a0ca38724c0d10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:36.942641 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a04b3f53-9722-4ece-b19e-bb3ea706e964 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] 10.222.0.40 "GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e" status: 200 len: 1230 microversion: 2.1 time: 0.279172 Oct 26 13:39:36.952148 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3076/6117] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:36 2022] GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e => generated 1230 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:39:37.371364 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-de1d8536-2744-443b-805f-2f339c84824d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:37.372677 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-de1d8536-2744-443b-805f-2f339c84824d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: d470b39a-b9d6-476b-a720-1d61204c3d1c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:37.385372 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de1d8536-2744-443b-805f-2f339c84824d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:37.402324 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de1d8536-2744-443b-805f-2f339c84824d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:37.408391 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de1d8536-2744-443b-805f-2f339c84824d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:37.410645 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de1d8536-2744-443b-805f-2f339c84824d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:37.412757 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de1d8536-2744-443b-805f-2f339c84824d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:37.414047 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de1d8536-2744-443b-805f-2f339c84824d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:37.837726 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-de1d8536-2744-443b-805f-2f339c84824d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c55ea80b2e14c99baf3d551f00bfa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd47c4f41a64b56b1b571ab5bcd9bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:37.847990 n-d-862686-1 devstack@n-api.service[120597]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 13:39:37.848555 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-de1d8536-2744-443b-805f-2f339c84824d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c" status: 200 len: 1318 microversion: 2.1 time: 0.481085 Oct 26 13:39:37.848680 n-d-862686-1 devstack@n-api.service[120597]: Wed Oct 26 13:39:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 (ip 10.222.0.40) !!! Oct 26 13:39:37.913469 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3077/6118] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:37 2022] GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c => generated 1318 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:39:37.980446 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cb81e94f-7cb6-497b-9e40-6a9663b3d198 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:37.991841 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cb81e94f-7cb6-497b-9e40-6a9663b3d198 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] [instance: 65e73a8e-e75d-4efe-a886-7328b0414a1e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:38.016446 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cb81e94f-7cb6-497b-9e40-6a9663b3d198 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:38.017977 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cb81e94f-7cb6-497b-9e40-6a9663b3d198 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:38.018691 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cb81e94f-7cb6-497b-9e40-6a9663b3d198 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:38.019758 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cb81e94f-7cb6-497b-9e40-6a9663b3d198 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:38.020545 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cb81e94f-7cb6-497b-9e40-6a9663b3d198 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:38.021137 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cb81e94f-7cb6-497b-9e40-6a9663b3d198 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:38.199521 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-cb81e94f-7cb6-497b-9e40-6a9663b3d198 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35782c90feff41dea454598bb3630c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13767903b18d44608a0ca38724c0d10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:38.213329 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cb81e94f-7cb6-497b-9e40-6a9663b3d198 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] 10.222.0.40 "GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e" status: 200 len: 1230 microversion: 2.1 time: 0.238246 Oct 26 13:39:38.220629 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3078/6119] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:37 2022] GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e => generated 1230 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:39:38.471281 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a392af45-4974-4b5b-b66c-5a00addc55be tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:38.480982 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a392af45-4974-4b5b-b66c-5a00addc55be tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:38.497729 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a392af45-4974-4b5b-b66c-5a00addc55be tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:38.498999 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a392af45-4974-4b5b-b66c-5a00addc55be tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1733 microversion: 2.20 time: 2.415589 Oct 26 13:39:38.510535 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3042/6120] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:39:36 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1733 bytes in 2428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:39:38.939555 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7bd4ffbf-87d6-4982-9f97-90ea7803132f tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:38.940941 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7bd4ffbf-87d6-4982-9f97-90ea7803132f tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: d470b39a-b9d6-476b-a720-1d61204c3d1c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:38.952213 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7bd4ffbf-87d6-4982-9f97-90ea7803132f tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:38.953893 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7bd4ffbf-87d6-4982-9f97-90ea7803132f tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:38.958471 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7bd4ffbf-87d6-4982-9f97-90ea7803132f tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:38.959395 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7bd4ffbf-87d6-4982-9f97-90ea7803132f tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:38.962016 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7bd4ffbf-87d6-4982-9f97-90ea7803132f tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:38.967051 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7bd4ffbf-87d6-4982-9f97-90ea7803132f tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:39.050426 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:39:39.240331 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0efd53d2-6cca-41b4-8622-e35adee8c02c tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:39.240964 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0efd53d2-6cca-41b4-8622-e35adee8c02c tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] [instance: 65e73a8e-e75d-4efe-a886-7328b0414a1e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:39.294801 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0efd53d2-6cca-41b4-8622-e35adee8c02c tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:39.299399 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0efd53d2-6cca-41b4-8622-e35adee8c02c tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:39.300373 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0efd53d2-6cca-41b4-8622-e35adee8c02c tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:39.302897 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0efd53d2-6cca-41b4-8622-e35adee8c02c tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:39.311252 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0efd53d2-6cca-41b4-8622-e35adee8c02c tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:39.315174 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0efd53d2-6cca-41b4-8622-e35adee8c02c tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:39.521426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0efd53d2-6cca-41b4-8622-e35adee8c02c tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35782c90feff41dea454598bb3630c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13767903b18d44608a0ca38724c0d10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:39.542545 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0efd53d2-6cca-41b4-8622-e35adee8c02c tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] 10.222.0.40 "GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e" status: 200 len: 1230 microversion: 2.1 time: 0.306989 Oct 26 13:39:39.553908 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3043/6121] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:39 2022] GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e => generated 1230 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:39:39.562199 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-77648a63-e234-49c5-8698-39da87ae203a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:39.573542 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-77648a63-e234-49c5-8698-39da87ae203a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:39.593567 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-77648a63-e234-49c5-8698-39da87ae203a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:39.593567 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-77648a63-e234-49c5-8698-39da87ae203a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:39.593567 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-77648a63-e234-49c5-8698-39da87ae203a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:39.601320 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-77648a63-e234-49c5-8698-39da87ae203a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:39.601921 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-77648a63-e234-49c5-8698-39da87ae203a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:39.602384 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-77648a63-e234-49c5-8698-39da87ae203a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:39.655174 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7bd4ffbf-87d6-4982-9f97-90ea7803132f tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c55ea80b2e14c99baf3d551f00bfa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd47c4f41a64b56b1b571ab5bcd9bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:39.667973 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7bd4ffbf-87d6-4982-9f97-90ea7803132f tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c" status: 200 len: 1318 microversion: 2.1 time: 0.732686 Oct 26 13:39:39.676265 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3079/6122] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:38 2022] GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c => generated 1318 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:39:40.568030 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-77648a63-e234-49c5-8698-39da87ae203a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:40.581122 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-77648a63-e234-49c5-8698-39da87ae203a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:40.582637 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-77648a63-e234-49c5-8698-39da87ae203a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:40.583850 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-77648a63-e234-49c5-8698-39da87ae203a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1733 microversion: 2.20 time: 1.028673 Oct 26 13:39:40.583978 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e23aead7-867d-419c-b1cd-a7f00c9519c2 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:40.585139 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e23aead7-867d-419c-b1cd-a7f00c9519c2 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] [instance: 65e73a8e-e75d-4efe-a886-7328b0414a1e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:40.597622 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e23aead7-867d-419c-b1cd-a7f00c9519c2 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:40.613509 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3044/6123] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:39:39 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1733 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:39:40.624560 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e23aead7-867d-419c-b1cd-a7f00c9519c2 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:40.625272 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e23aead7-867d-419c-b1cd-a7f00c9519c2 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:40.633620 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e23aead7-867d-419c-b1cd-a7f00c9519c2 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:40.641741 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e23aead7-867d-419c-b1cd-a7f00c9519c2 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:40.642572 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e23aead7-867d-419c-b1cd-a7f00c9519c2 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:40.695252 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-af77ee5c-ccc1-4055-a82d-7fd98dac726b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:40.695894 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-af77ee5c-ccc1-4055-a82d-7fd98dac726b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: d470b39a-b9d6-476b-a720-1d61204c3d1c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:40.710688 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af77ee5c-ccc1-4055-a82d-7fd98dac726b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:40.713607 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af77ee5c-ccc1-4055-a82d-7fd98dac726b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:40.715319 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af77ee5c-ccc1-4055-a82d-7fd98dac726b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:40.719095 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af77ee5c-ccc1-4055-a82d-7fd98dac726b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:40.719656 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af77ee5c-ccc1-4055-a82d-7fd98dac726b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:40.725143 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af77ee5c-ccc1-4055-a82d-7fd98dac726b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:40.911533 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e23aead7-867d-419c-b1cd-a7f00c9519c2 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35782c90feff41dea454598bb3630c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13767903b18d44608a0ca38724c0d10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:40.920789 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e23aead7-867d-419c-b1cd-a7f00c9519c2 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] 10.222.0.40 "GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e" status: 200 len: 1230 microversion: 2.1 time: 0.341380 Oct 26 13:39:40.951558 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3080/6124] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:40 2022] GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e => generated 1230 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:39:41.630439 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-184356e4-03d1-4b93-b622-e1c60ba26048 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:41.631917 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-184356e4-03d1-4b93-b622-e1c60ba26048 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:41.643701 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-184356e4-03d1-4b93-b622-e1c60ba26048 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:41.649646 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-184356e4-03d1-4b93-b622-e1c60ba26048 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:41.652114 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-184356e4-03d1-4b93-b622-e1c60ba26048 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:41.653092 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-184356e4-03d1-4b93-b622-e1c60ba26048 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:41.656772 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-184356e4-03d1-4b93-b622-e1c60ba26048 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:41.665045 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-184356e4-03d1-4b93-b622-e1c60ba26048 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:41.789919 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-af77ee5c-ccc1-4055-a82d-7fd98dac726b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c55ea80b2e14c99baf3d551f00bfa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd47c4f41a64b56b1b571ab5bcd9bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:41.809187 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-af77ee5c-ccc1-4055-a82d-7fd98dac726b tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c" status: 200 len: 1318 microversion: 2.1 time: 1.116357 Oct 26 13:39:41.809868 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3045/6125] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:40 2022] GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c => generated 1318 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:39:41.965623 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-501ab512-3e35-488a-9aed-21d7b951684c tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:41.966660 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-501ab512-3e35-488a-9aed-21d7b951684c tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] [instance: 65e73a8e-e75d-4efe-a886-7328b0414a1e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:41.992135 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-501ab512-3e35-488a-9aed-21d7b951684c tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:41.992645 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-501ab512-3e35-488a-9aed-21d7b951684c tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:41.993088 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-501ab512-3e35-488a-9aed-21d7b951684c tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:41.993879 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-501ab512-3e35-488a-9aed-21d7b951684c tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:41.994344 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-501ab512-3e35-488a-9aed-21d7b951684c tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:41.994775 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-501ab512-3e35-488a-9aed-21d7b951684c tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:42.382428 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-501ab512-3e35-488a-9aed-21d7b951684c tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35782c90feff41dea454598bb3630c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13767903b18d44608a0ca38724c0d10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:42.397144 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-501ab512-3e35-488a-9aed-21d7b951684c tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] 10.222.0.40 "GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e" status: 200 len: 1230 microversion: 2.1 time: 0.435987 Oct 26 13:39:42.419359 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3046/6126] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:41 2022] GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e => generated 1230 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:39:42.838987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dd761c24-70a3-4a00-9e87-c7171fffda9e tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:42.839537 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-dd761c24-70a3-4a00-9e87-c7171fffda9e tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: d470b39a-b9d6-476b-a720-1d61204c3d1c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:42.849440 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd761c24-70a3-4a00-9e87-c7171fffda9e tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:42.855872 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd761c24-70a3-4a00-9e87-c7171fffda9e tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:42.856490 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd761c24-70a3-4a00-9e87-c7171fffda9e tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:42.874978 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd761c24-70a3-4a00-9e87-c7171fffda9e tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:42.875982 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd761c24-70a3-4a00-9e87-c7171fffda9e tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:42.883589 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd761c24-70a3-4a00-9e87-c7171fffda9e tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:43.189867 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-184356e4-03d1-4b93-b622-e1c60ba26048 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:43.224584 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-184356e4-03d1-4b93-b622-e1c60ba26048 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:43.237878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-184356e4-03d1-4b93-b622-e1c60ba26048 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:43.240196 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-184356e4-03d1-4b93-b622-e1c60ba26048 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1733 microversion: 2.20 time: 1.614101 Oct 26 13:39:43.269287 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3081/6127] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:39:41 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1733 bytes in 1644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:39:43.426780 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fb05e74a-2912-4a78-9d83-7f7c491400d4 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:43.427462 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fb05e74a-2912-4a78-9d83-7f7c491400d4 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] [instance: 65e73a8e-e75d-4efe-a886-7328b0414a1e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:43.442987 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fb05e74a-2912-4a78-9d83-7f7c491400d4 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:43.443493 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fb05e74a-2912-4a78-9d83-7f7c491400d4 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:43.454482 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fb05e74a-2912-4a78-9d83-7f7c491400d4 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:43.459474 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fb05e74a-2912-4a78-9d83-7f7c491400d4 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:43.460179 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fb05e74a-2912-4a78-9d83-7f7c491400d4 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:43.461614 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fb05e74a-2912-4a78-9d83-7f7c491400d4 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:43.816365 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fb05e74a-2912-4a78-9d83-7f7c491400d4 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35782c90feff41dea454598bb3630c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13767903b18d44608a0ca38724c0d10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:43.827931 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fb05e74a-2912-4a78-9d83-7f7c491400d4 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] 10.222.0.40 "GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e" status: 200 len: 1230 microversion: 2.1 time: 0.406202 Oct 26 13:39:43.837398 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3082/6128] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:43 2022] GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e => generated 1230 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:39:44.272003 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4a91f320-8409-4cd9-afe9-7f7d2faa0e50 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:44.272710 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4a91f320-8409-4cd9-afe9-7f7d2faa0e50 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:44.287310 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a91f320-8409-4cd9-afe9-7f7d2faa0e50 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:44.288004 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a91f320-8409-4cd9-afe9-7f7d2faa0e50 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:44.297689 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a91f320-8409-4cd9-afe9-7f7d2faa0e50 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:44.299677 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a91f320-8409-4cd9-afe9-7f7d2faa0e50 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:44.300348 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a91f320-8409-4cd9-afe9-7f7d2faa0e50 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:44.303016 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a91f320-8409-4cd9-afe9-7f7d2faa0e50 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:44.578075 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-dd761c24-70a3-4a00-9e87-c7171fffda9e tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c55ea80b2e14c99baf3d551f00bfa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd47c4f41a64b56b1b571ab5bcd9bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:44.594253 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-dd761c24-70a3-4a00-9e87-c7171fffda9e tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c" status: 200 len: 1318 microversion: 2.1 time: 1.758852 Oct 26 13:39:44.616709 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3047/6129] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:42 2022] GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c => generated 1318 bytes in 1783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:39:44.863822 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-91565ef8-7a90-46e5-aa26-c159b802f81c tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:44.864604 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-91565ef8-7a90-46e5-aa26-c159b802f81c tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] [instance: 65e73a8e-e75d-4efe-a886-7328b0414a1e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:44.877618 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91565ef8-7a90-46e5-aa26-c159b802f81c tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:44.882379 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91565ef8-7a90-46e5-aa26-c159b802f81c tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:44.884095 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91565ef8-7a90-46e5-aa26-c159b802f81c tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:44.884981 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91565ef8-7a90-46e5-aa26-c159b802f81c tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:44.887575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91565ef8-7a90-46e5-aa26-c159b802f81c tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:44.888764 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91565ef8-7a90-46e5-aa26-c159b802f81c tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:45.228271 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-91565ef8-7a90-46e5-aa26-c159b802f81c tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35782c90feff41dea454598bb3630c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13767903b18d44608a0ca38724c0d10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:45.239900 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-91565ef8-7a90-46e5-aa26-c159b802f81c tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] 10.222.0.40 "GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e" status: 200 len: 1230 microversion: 2.1 time: 0.380144 Oct 26 13:39:45.249521 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3048/6130] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:44 2022] GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e => generated 1230 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:39:45.557744 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4a91f320-8409-4cd9-afe9-7f7d2faa0e50 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:45.569182 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4a91f320-8409-4cd9-afe9-7f7d2faa0e50 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:45.578367 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4a91f320-8409-4cd9-afe9-7f7d2faa0e50 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:45.580546 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4a91f320-8409-4cd9-afe9-7f7d2faa0e50 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1733 microversion: 2.20 time: 1.312934 Oct 26 13:39:45.584259 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3083/6131] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:39:44 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1733 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:39:45.626288 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-18d24b44-57d1-4d67-a253-be84e3d1618a tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:45.627273 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-18d24b44-57d1-4d67-a253-be84e3d1618a tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: d470b39a-b9d6-476b-a720-1d61204c3d1c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:45.641598 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18d24b44-57d1-4d67-a253-be84e3d1618a tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:45.647068 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18d24b44-57d1-4d67-a253-be84e3d1618a tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:45.647665 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18d24b44-57d1-4d67-a253-be84e3d1618a tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:45.650159 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18d24b44-57d1-4d67-a253-be84e3d1618a tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:45.656867 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18d24b44-57d1-4d67-a253-be84e3d1618a tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:45.657475 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18d24b44-57d1-4d67-a253-be84e3d1618a tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:46.276402 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-eacfca6e-968f-47fd-b575-79ec738eaf68 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:46.277022 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-eacfca6e-968f-47fd-b575-79ec738eaf68 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] [instance: 65e73a8e-e75d-4efe-a886-7328b0414a1e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:46.300184 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eacfca6e-968f-47fd-b575-79ec738eaf68 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:46.300676 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eacfca6e-968f-47fd-b575-79ec738eaf68 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:46.301117 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eacfca6e-968f-47fd-b575-79ec738eaf68 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:46.301866 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eacfca6e-968f-47fd-b575-79ec738eaf68 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:46.302320 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eacfca6e-968f-47fd-b575-79ec738eaf68 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:46.302746 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eacfca6e-968f-47fd-b575-79ec738eaf68 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:46.529497 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-eacfca6e-968f-47fd-b575-79ec738eaf68 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35782c90feff41dea454598bb3630c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13767903b18d44608a0ca38724c0d10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:46.539064 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-eacfca6e-968f-47fd-b575-79ec738eaf68 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] 10.222.0.40 "GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e" status: 200 len: 1230 microversion: 2.1 time: 0.266623 Oct 26 13:39:46.549896 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3084/6132] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:46 2022] GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e => generated 1230 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:39:46.613990 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5b364a95-4d78-4371-9209-17613d3748d1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:46.616801 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5b364a95-4d78-4371-9209-17613d3748d1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:46.631792 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b364a95-4d78-4371-9209-17613d3748d1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:46.632576 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b364a95-4d78-4371-9209-17613d3748d1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:46.633187 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b364a95-4d78-4371-9209-17613d3748d1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:46.634108 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b364a95-4d78-4371-9209-17613d3748d1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:46.634714 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b364a95-4d78-4371-9209-17613d3748d1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:46.635295 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b364a95-4d78-4371-9209-17613d3748d1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:47.228679 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5b364a95-4d78-4371-9209-17613d3748d1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:47.252139 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5b364a95-4d78-4371-9209-17613d3748d1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:47.260184 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5b364a95-4d78-4371-9209-17613d3748d1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:47.266047 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5b364a95-4d78-4371-9209-17613d3748d1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1733 microversion: 2.20 time: 0.657104 Oct 26 13:39:47.285526 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3085/6133] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:39:46 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1733 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:39:47.323782 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-18d24b44-57d1-4d67-a253-be84e3d1618a tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c55ea80b2e14c99baf3d551f00bfa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd47c4f41a64b56b1b571ab5bcd9bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:47.333396 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-18d24b44-57d1-4d67-a253-be84e3d1618a tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c" status: 200 len: 1318 microversion: 2.1 time: 1.711105 Oct 26 13:39:47.356301 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3049/6134] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:45 2022] GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c => generated 1318 bytes in 1735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:39:47.573636 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c4200484-bbf0-4954-ad1f-af0b12a80c49 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:47.575230 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c4200484-bbf0-4954-ad1f-af0b12a80c49 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] [instance: 65e73a8e-e75d-4efe-a886-7328b0414a1e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:47.584910 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4200484-bbf0-4954-ad1f-af0b12a80c49 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:47.585774 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4200484-bbf0-4954-ad1f-af0b12a80c49 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:47.586473 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4200484-bbf0-4954-ad1f-af0b12a80c49 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:47.587721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4200484-bbf0-4954-ad1f-af0b12a80c49 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:47.588496 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4200484-bbf0-4954-ad1f-af0b12a80c49 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:47.590011 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4200484-bbf0-4954-ad1f-af0b12a80c49 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:47.800966 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4200484-bbf0-4954-ad1f-af0b12a80c49 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:47.802489 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4200484-bbf0-4954-ad1f-af0b12a80c49 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:47.804029 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4200484-bbf0-4954-ad1f-af0b12a80c49 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:47.805968 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-c4200484-bbf0-4954-ad1f-af0b12a80c49 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lazy-loading 'fault' on Instance uuid 65e73a8e-e75d-4efe-a886-7328b0414a1e {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:39:47.931413 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c4200484-bbf0-4954-ad1f-af0b12a80c49 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35782c90feff41dea454598bb3630c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13767903b18d44608a0ca38724c0d10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:47.957234 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c4200484-bbf0-4954-ad1f-af0b12a80c49 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] 10.222.0.40 "GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e" status: 200 len: 1235 microversion: 2.1 time: 0.389119 Oct 26 13:39:47.964039 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3086/6135] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:47 2022] GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e => generated 1235 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:39:48.301365 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-306425e3-7bc2-4f0b-ab26-270869ac8264 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:48.303168 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-306425e3-7bc2-4f0b-ab26-270869ac8264 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:48.327736 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-306425e3-7bc2-4f0b-ab26-270869ac8264 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:48.328954 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-306425e3-7bc2-4f0b-ab26-270869ac8264 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:48.329621 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-306425e3-7bc2-4f0b-ab26-270869ac8264 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:48.330778 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-306425e3-7bc2-4f0b-ab26-270869ac8264 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:48.331445 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-306425e3-7bc2-4f0b-ab26-270869ac8264 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:48.332032 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-306425e3-7bc2-4f0b-ab26-270869ac8264 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:48.519077 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-22d1acf8-41d4-4b9f-9add-265e5d858db3 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:48.519774 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-22d1acf8-41d4-4b9f-9add-265e5d858db3 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: d470b39a-b9d6-476b-a720-1d61204c3d1c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:48.535020 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22d1acf8-41d4-4b9f-9add-265e5d858db3 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:48.536288 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22d1acf8-41d4-4b9f-9add-265e5d858db3 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:48.536741 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22d1acf8-41d4-4b9f-9add-265e5d858db3 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:48.539482 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22d1acf8-41d4-4b9f-9add-265e5d858db3 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:48.540910 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22d1acf8-41d4-4b9f-9add-265e5d858db3 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:48.541493 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22d1acf8-41d4-4b9f-9add-265e5d858db3 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:48.907120 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-306425e3-7bc2-4f0b-ab26-270869ac8264 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:48.930027 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-306425e3-7bc2-4f0b-ab26-270869ac8264 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:48.931867 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-306425e3-7bc2-4f0b-ab26-270869ac8264 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:48.933290 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-306425e3-7bc2-4f0b-ab26-270869ac8264 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1733 microversion: 2.20 time: 0.637986 Oct 26 13:39:48.964780 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3050/6136] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:39:48 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1733 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:39:48.984652 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-754f1c11-2131-4347-87c8-1adfd23dfcae tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:48.985547 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-754f1c11-2131-4347-87c8-1adfd23dfcae tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] [instance: 65e73a8e-e75d-4efe-a886-7328b0414a1e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:49.003673 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-754f1c11-2131-4347-87c8-1adfd23dfcae tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:49.004177 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-754f1c11-2131-4347-87c8-1adfd23dfcae tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:49.014240 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-22d1acf8-41d4-4b9f-9add-265e5d858db3 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c55ea80b2e14c99baf3d551f00bfa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd47c4f41a64b56b1b571ab5bcd9bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:49.024005 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-22d1acf8-41d4-4b9f-9add-265e5d858db3 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c" status: 200 len: 1318 microversion: 2.1 time: 0.664444 Oct 26 13:39:49.024826 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-754f1c11-2131-4347-87c8-1adfd23dfcae tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:49.026283 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-754f1c11-2131-4347-87c8-1adfd23dfcae tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:49.026918 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-754f1c11-2131-4347-87c8-1adfd23dfcae tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:49.027678 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3087/6137] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:48 2022] GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c => generated 1318 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:39:49.028344 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-754f1c11-2131-4347-87c8-1adfd23dfcae tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:49.062378 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-754f1c11-2131-4347-87c8-1adfd23dfcae tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] HTTP exception thrown: Instance 65e73a8e-e75d-4efe-a886-7328b0414a1e could not be found. Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-754f1c11-2131-4347-87c8-1adfd23dfcae tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Request method failure captured: Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e HTTP/1.1 Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTcgvrpXjncEEQ7iEMpDsgtjT7kjc7K4HY_nJ62MxT4xdWuO2lv6ezfmw1PPEZ9iXqLnO7RbSY402pQDX1OH904XplTO5-OAXNM1UoYW9sO2TfCQrvbu_wEuXSBZLp4HSjuolfHdBEZIUVfRAa3rHm9tBOlC6Z4TZfhmey45vtG28jk Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 13767903b18d44608a0ca38724c0d10a Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-TestVolumeBackupRestore-856357903 Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/13767903b18d44608a0ca38724c0d10a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/13767903b18d44608a0ca38724c0d10a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_13767903b18d44608a0ca38724c0d10a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/13767903b18d44608a0ca38724c0d10a"}]}] Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-TestVolumeBackupRestore-856357903 Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 13767903b18d44608a0ca38724c0d10a Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-TestVolumeBackupRestore-856357903 Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-TestVolumeBackupRestore-856357903-project Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 35782c90feff41dea454598bb3630c02 Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-TestVolumeBackupRestore-856357903-project Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 65e73a8e-e75d-4efe-a886-7328b0414a1e could not be found. Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '65e73a8e-e75d-4efe-a886-7328b0414a1e'} Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65e73a8e-e75d-4efe-a886-7328b0414a1e could not be found. Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65e73a8e-e75d-4efe-a886-7328b0414a1e could not be found. Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:39:49.071876 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:39:49.076549 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:39:49.076549 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:39:49.076549 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:39:49.076549 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:39:49.076549 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:39:49.076549 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65e73a8e-e75d-4efe-a886-7328b0414a1e could not be found. Oct 26 13:39:49.076549 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:39:49.079192 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-754f1c11-2131-4347-87c8-1adfd23dfcae tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Returning 404 to user: Instance 65e73a8e-e75d-4efe-a886-7328b0414a1e could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:39:49.082436 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-754f1c11-2131-4347-87c8-1adfd23dfcae tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] 10.222.0.40 "GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e" status: 404 len: 111 microversion: 2.1 time: 0.101815 Oct 26 13:39:49.086585 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3051/6138] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:48 2022] GET /compute/v2.1/servers/65e73a8e-e75d-4efe-a886-7328b0414a1e => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 13:39:49.721676 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-dbff3a38-5402-4824-8c2a-00fd6ba5f015 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] Calling method '.version_select at 0x7f67328f3160>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:49.759892 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-dbff3a38-5402-4824-8c2a-00fd6ba5f015 tempest-TestVolumeBackupRestore-856357903 tempest-TestVolumeBackupRestore-856357903-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1563979469" status: 202 len: 0 microversion: 2.1 time: 0.042601 Oct 26 13:39:49.760504 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3088/6139] 10.222.0.40 () {58 vars in 1269 bytes} [Wed Oct 26 13:39:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1563979469 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:39:49.970155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-73283bb8-2868-4289-b135-fcce7eda5cc5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:49.971354 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-73283bb8-2868-4289-b135-fcce7eda5cc5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:49.989020 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73283bb8-2868-4289-b135-fcce7eda5cc5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:49.989950 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73283bb8-2868-4289-b135-fcce7eda5cc5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:49.993855 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73283bb8-2868-4289-b135-fcce7eda5cc5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:49.994981 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73283bb8-2868-4289-b135-fcce7eda5cc5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:49.998223 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73283bb8-2868-4289-b135-fcce7eda5cc5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:50.005010 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73283bb8-2868-4289-b135-fcce7eda5cc5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:50.056170 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-583ef776-46fd-42e5-8b88-151c62649fb1 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:50.056916 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-583ef776-46fd-42e5-8b88-151c62649fb1 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: d470b39a-b9d6-476b-a720-1d61204c3d1c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:50.074396 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-583ef776-46fd-42e5-8b88-151c62649fb1 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:50.080895 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-583ef776-46fd-42e5-8b88-151c62649fb1 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:50.083567 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-583ef776-46fd-42e5-8b88-151c62649fb1 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:50.084485 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-583ef776-46fd-42e5-8b88-151c62649fb1 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:50.087449 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-583ef776-46fd-42e5-8b88-151c62649fb1 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:50.088974 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-583ef776-46fd-42e5-8b88-151c62649fb1 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:50.510193 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-583ef776-46fd-42e5-8b88-151c62649fb1 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c55ea80b2e14c99baf3d551f00bfa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd47c4f41a64b56b1b571ab5bcd9bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:50.520970 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-583ef776-46fd-42e5-8b88-151c62649fb1 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c" status: 200 len: 1318 microversion: 2.1 time: 0.472641 Oct 26 13:39:50.530553 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3089/6140] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:50 2022] GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c => generated 1318 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:39:51.085918 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-73283bb8-2868-4289-b135-fcce7eda5cc5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:51.105402 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-73283bb8-2868-4289-b135-fcce7eda5cc5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:51.113041 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-73283bb8-2868-4289-b135-fcce7eda5cc5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:51.116421 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-73283bb8-2868-4289-b135-fcce7eda5cc5 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1733 microversion: 2.20 time: 1.150092 Oct 26 13:39:51.122122 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3052/6141] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:39:49 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1733 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:39:51.554323 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-255882f9-0432-4b9a-a73d-6fa695dd656d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:51.555080 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-255882f9-0432-4b9a-a73d-6fa695dd656d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: d470b39a-b9d6-476b-a720-1d61204c3d1c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:51.567557 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-255882f9-0432-4b9a-a73d-6fa695dd656d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:51.570927 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-255882f9-0432-4b9a-a73d-6fa695dd656d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:51.571557 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-255882f9-0432-4b9a-a73d-6fa695dd656d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:51.581883 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-255882f9-0432-4b9a-a73d-6fa695dd656d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:51.583222 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-255882f9-0432-4b9a-a73d-6fa695dd656d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:51.586500 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-255882f9-0432-4b9a-a73d-6fa695dd656d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:52.064880 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-255882f9-0432-4b9a-a73d-6fa695dd656d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c55ea80b2e14c99baf3d551f00bfa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd47c4f41a64b56b1b571ab5bcd9bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:52.084187 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-255882f9-0432-4b9a-a73d-6fa695dd656d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c" status: 200 len: 1318 microversion: 2.1 time: 0.533287 Oct 26 13:39:52.087980 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3090/6142] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:51 2022] GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c => generated 1318 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:39:52.157053 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2647a0e9-281e-45cb-8f12-4c10882d10cc tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:52.157917 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2647a0e9-281e-45cb-8f12-4c10882d10cc tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:52.175783 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2647a0e9-281e-45cb-8f12-4c10882d10cc tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:52.176298 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2647a0e9-281e-45cb-8f12-4c10882d10cc tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:52.176741 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2647a0e9-281e-45cb-8f12-4c10882d10cc tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:52.177466 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2647a0e9-281e-45cb-8f12-4c10882d10cc tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:52.177986 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2647a0e9-281e-45cb-8f12-4c10882d10cc tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:52.178424 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2647a0e9-281e-45cb-8f12-4c10882d10cc tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:52.841559 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2647a0e9-281e-45cb-8f12-4c10882d10cc tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:52.882898 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2647a0e9-281e-45cb-8f12-4c10882d10cc tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:52.884449 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2647a0e9-281e-45cb-8f12-4c10882d10cc tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:52.890503 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2647a0e9-281e-45cb-8f12-4c10882d10cc tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1733 microversion: 2.20 time: 0.737223 Oct 26 13:39:52.913685 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3053/6143] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:39:52 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1733 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:39:53.113040 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5d266649-3a41-419c-9dbe-3cfcf0d2466e tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:53.114606 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5d266649-3a41-419c-9dbe-3cfcf0d2466e tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: d470b39a-b9d6-476b-a720-1d61204c3d1c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:53.140091 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5d266649-3a41-419c-9dbe-3cfcf0d2466e tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:53.140091 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5d266649-3a41-419c-9dbe-3cfcf0d2466e tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:53.140091 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5d266649-3a41-419c-9dbe-3cfcf0d2466e tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:53.154182 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5d266649-3a41-419c-9dbe-3cfcf0d2466e tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:53.154182 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5d266649-3a41-419c-9dbe-3cfcf0d2466e tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:53.154182 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5d266649-3a41-419c-9dbe-3cfcf0d2466e tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:53.820175 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5d266649-3a41-419c-9dbe-3cfcf0d2466e tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c55ea80b2e14c99baf3d551f00bfa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd47c4f41a64b56b1b571ab5bcd9bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:53.836690 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5d266649-3a41-419c-9dbe-3cfcf0d2466e tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c" status: 200 len: 1318 microversion: 2.1 time: 0.727618 Oct 26 13:39:53.838177 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3091/6144] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:53 2022] GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c => generated 1318 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:39:53.921288 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-220727fe-c0c2-4a9d-9d36-b098774a6c33 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:53.922081 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-220727fe-c0c2-4a9d-9d36-b098774a6c33 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:53.958932 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-220727fe-c0c2-4a9d-9d36-b098774a6c33 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:53.963173 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-220727fe-c0c2-4a9d-9d36-b098774a6c33 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:53.966492 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-220727fe-c0c2-4a9d-9d36-b098774a6c33 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:53.967762 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-220727fe-c0c2-4a9d-9d36-b098774a6c33 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:53.974255 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-220727fe-c0c2-4a9d-9d36-b098774a6c33 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:53.977760 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-220727fe-c0c2-4a9d-9d36-b098774a6c33 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:54.861856 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-54bf00c7-8c3e-4eea-bb7a-2b5dfdf1a070 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:54.862526 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-54bf00c7-8c3e-4eea-bb7a-2b5dfdf1a070 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: d470b39a-b9d6-476b-a720-1d61204c3d1c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:54.871644 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54bf00c7-8c3e-4eea-bb7a-2b5dfdf1a070 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:54.874000 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54bf00c7-8c3e-4eea-bb7a-2b5dfdf1a070 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:54.877812 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54bf00c7-8c3e-4eea-bb7a-2b5dfdf1a070 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:54.878836 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54bf00c7-8c3e-4eea-bb7a-2b5dfdf1a070 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:54.879528 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54bf00c7-8c3e-4eea-bb7a-2b5dfdf1a070 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:54.880169 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54bf00c7-8c3e-4eea-bb7a-2b5dfdf1a070 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:55.258317 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-54bf00c7-8c3e-4eea-bb7a-2b5dfdf1a070 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c55ea80b2e14c99baf3d551f00bfa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd47c4f41a64b56b1b571ab5bcd9bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:55.269365 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-54bf00c7-8c3e-4eea-bb7a-2b5dfdf1a070 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c" status: 200 len: 1318 microversion: 2.1 time: 0.412005 Oct 26 13:39:55.277018 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3092/6145] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:54 2022] GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c => generated 1318 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:39:56.234190 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-220727fe-c0c2-4a9d-9d36-b098774a6c33 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:56.247199 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-220727fe-c0c2-4a9d-9d36-b098774a6c33 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:56.251218 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-220727fe-c0c2-4a9d-9d36-b098774a6c33 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:56.272585 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-220727fe-c0c2-4a9d-9d36-b098774a6c33 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1733 microversion: 2.20 time: 2.336221 Oct 26 13:39:56.273657 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3054/6146] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:39:53 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1733 bytes in 2358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:39:56.304429 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3bd04c6d-b996-49a4-82ac-a7bb6d5546c4 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:56.305891 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3bd04c6d-b996-49a4-82ac-a7bb6d5546c4 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: d470b39a-b9d6-476b-a720-1d61204c3d1c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:56.337340 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bd04c6d-b996-49a4-82ac-a7bb6d5546c4 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:56.337573 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bd04c6d-b996-49a4-82ac-a7bb6d5546c4 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:56.338141 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bd04c6d-b996-49a4-82ac-a7bb6d5546c4 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:56.341782 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bd04c6d-b996-49a4-82ac-a7bb6d5546c4 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:56.342559 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bd04c6d-b996-49a4-82ac-a7bb6d5546c4 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:56.344904 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bd04c6d-b996-49a4-82ac-a7bb6d5546c4 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:56.652509 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-85e888a1-5cbc-4705-a999-8238ab5f5743 req-20327b21-66d3-462b-aa70-b022e41f4e81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d470b39a-b9d6-476b-a720-1d61204c3d1c", "name": "network-vif-plugged", "status": "completed", "tag": "ed2bdc64-bf6d-416e-a577-cd8eea2349ac"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:39:56.683843 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-85e888a1-5cbc-4705-a999-8238ab5f5743 req-20327b21-66d3-462b-aa70-b022e41f4e81 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:56.684473 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-85e888a1-5cbc-4705-a999-8238ab5f5743 req-20327b21-66d3-462b-aa70-b022e41f4e81 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:56.685615 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-85e888a1-5cbc-4705-a999-8238ab5f5743 req-20327b21-66d3-462b-aa70-b022e41f4e81 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:56.723820 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-85e888a1-5cbc-4705-a999-8238ab5f5743 req-20327b21-66d3-462b-aa70-b022e41f4e81 service nova] Creating event network-vif-plugged:ed2bdc64-bf6d-416e-a577-cd8eea2349ac for instance d470b39a-b9d6-476b-a720-1d61204c3d1c on n-h2-862686-1 Oct 26 13:39:56.739721 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-85e888a1-5cbc-4705-a999-8238ab5f5743 req-20327b21-66d3-462b-aa70-b022e41f4e81 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.343122 Oct 26 13:39:56.753859 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3055/6147] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:39:56.762879 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3bd04c6d-b996-49a4-82ac-a7bb6d5546c4 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c55ea80b2e14c99baf3d551f00bfa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd47c4f41a64b56b1b571ab5bcd9bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:56.778946 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3bd04c6d-b996-49a4-82ac-a7bb6d5546c4 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c" status: 200 len: 1318 microversion: 2.1 time: 0.478652 Oct 26 13:39:56.780352 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3093/6148] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:56 2022] GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c => generated 1318 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:39:57.302281 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-05bef0bf-51e4-4611-9e0b-6439d74305c1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:57.303159 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-05bef0bf-51e4-4611-9e0b-6439d74305c1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:57.333927 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05bef0bf-51e4-4611-9e0b-6439d74305c1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:57.336957 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05bef0bf-51e4-4611-9e0b-6439d74305c1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:57.337865 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05bef0bf-51e4-4611-9e0b-6439d74305c1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:57.338880 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05bef0bf-51e4-4611-9e0b-6439d74305c1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:57.346436 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05bef0bf-51e4-4611-9e0b-6439d74305c1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:57.349880 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05bef0bf-51e4-4611-9e0b-6439d74305c1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:57.805700 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-aa3b810b-55f5-4d8d-ba09-c9e8937ede24 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:57.806333 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-aa3b810b-55f5-4d8d-ba09-c9e8937ede24 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: d470b39a-b9d6-476b-a720-1d61204c3d1c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:57.846124 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa3b810b-55f5-4d8d-ba09-c9e8937ede24 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:57.849954 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa3b810b-55f5-4d8d-ba09-c9e8937ede24 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:57.850490 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa3b810b-55f5-4d8d-ba09-c9e8937ede24 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:57.871157 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa3b810b-55f5-4d8d-ba09-c9e8937ede24 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:57.871673 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa3b810b-55f5-4d8d-ba09-c9e8937ede24 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:57.872134 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa3b810b-55f5-4d8d-ba09-c9e8937ede24 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:58.340225 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-05bef0bf-51e4-4611-9e0b-6439d74305c1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:58.354953 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-05bef0bf-51e4-4611-9e0b-6439d74305c1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:58.363907 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-05bef0bf-51e4-4611-9e0b-6439d74305c1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:58.367798 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-05bef0bf-51e4-4611-9e0b-6439d74305c1 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1733 microversion: 2.20 time: 1.070805 Oct 26 13:39:58.374232 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3056/6149] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:39:57 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1733 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:39:58.379631 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-aa3b810b-55f5-4d8d-ba09-c9e8937ede24 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c55ea80b2e14c99baf3d551f00bfa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd47c4f41a64b56b1b571ab5bcd9bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:39:58.422021 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-aa3b810b-55f5-4d8d-ba09-c9e8937ede24 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c" status: 200 len: 1318 microversion: 2.1 time: 0.611781 Oct 26 13:39:58.440175 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3094/6150] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:57 2022] GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c => generated 1318 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:39:59.414869 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5afb9f70-9543-4271-8db2-f59af1d7710d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:59.416217 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5afb9f70-9543-4271-8db2-f59af1d7710d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:59.450572 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d9f0f3f2-0cdd-44bf-a011-f9d748d69d18 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:39:59.451826 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d9f0f3f2-0cdd-44bf-a011-f9d748d69d18 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: d470b39a-b9d6-476b-a720-1d61204c3d1c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:39:59.465426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5afb9f70-9543-4271-8db2-f59af1d7710d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:59.465975 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5afb9f70-9543-4271-8db2-f59af1d7710d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:59.466430 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5afb9f70-9543-4271-8db2-f59af1d7710d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:59.467179 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5afb9f70-9543-4271-8db2-f59af1d7710d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:59.467655 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5afb9f70-9543-4271-8db2-f59af1d7710d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:59.468083 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5afb9f70-9543-4271-8db2-f59af1d7710d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:59.472751 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9f0f3f2-0cdd-44bf-a011-f9d748d69d18 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:59.473131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9f0f3f2-0cdd-44bf-a011-f9d748d69d18 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:59.491683 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9f0f3f2-0cdd-44bf-a011-f9d748d69d18 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:39:59.496464 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9f0f3f2-0cdd-44bf-a011-f9d748d69d18 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:39:59.500157 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9f0f3f2-0cdd-44bf-a011-f9d748d69d18 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:39:59.502055 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9f0f3f2-0cdd-44bf-a011-f9d748d69d18 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:40:00.063787 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5afb9f70-9543-4271-8db2-f59af1d7710d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:40:00.072927 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5afb9f70-9543-4271-8db2-f59af1d7710d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:40:00.091056 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5afb9f70-9543-4271-8db2-f59af1d7710d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:40:00.092417 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5afb9f70-9543-4271-8db2-f59af1d7710d tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1733 microversion: 2.20 time: 0.693556 Oct 26 13:40:00.093051 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3057/6151] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:39:59 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1733 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:40:00.190131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d9f0f3f2-0cdd-44bf-a011-f9d748d69d18 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c55ea80b2e14c99baf3d551f00bfa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd47c4f41a64b56b1b571ab5bcd9bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:40:00.203558 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d9f0f3f2-0cdd-44bf-a011-f9d748d69d18 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c" status: 200 len: 1318 microversion: 2.1 time: 0.755382 Oct 26 13:40:00.213976 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3095/6152] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:39:59 2022] GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c => generated 1318 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:40:00.855115 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-e541331e-dc25-443c-abfd-d12d15569c0b req-fdf19dc5-4f2f-4527-9e80-7804b49e1ea5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52b4e824-6117-46a5-a005-0bef3bc75052", "name": "network-vif-plugged", "status": "completed", "tag": "86120fac-67e2-4ce8-a98b-0f683e946ba4"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:40:00.901193 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-e541331e-dc25-443c-abfd-d12d15569c0b req-fdf19dc5-4f2f-4527-9e80-7804b49e1ea5 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:40:00.902099 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-e541331e-dc25-443c-abfd-d12d15569c0b req-fdf19dc5-4f2f-4527-9e80-7804b49e1ea5 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:40:00.902642 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-e541331e-dc25-443c-abfd-d12d15569c0b req-fdf19dc5-4f2f-4527-9e80-7804b49e1ea5 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:40:00.938528 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-e541331e-dc25-443c-abfd-d12d15569c0b req-fdf19dc5-4f2f-4527-9e80-7804b49e1ea5 service nova] Creating event network-vif-plugged:86120fac-67e2-4ce8-a98b-0f683e946ba4 for instance 52b4e824-6117-46a5-a005-0bef3bc75052 on n-h1-862686-1 Oct 26 13:40:00.954061 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-e541331e-dc25-443c-abfd-d12d15569c0b req-fdf19dc5-4f2f-4527-9e80-7804b49e1ea5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102449 Oct 26 13:40:00.955988 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3058/6153] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:40:01.128878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-beb9d462-ac5d-4794-9afe-fedf44c08755 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:40:01.140077 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-beb9d462-ac5d-4794-9afe-fedf44c08755 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:40:01.159917 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-beb9d462-ac5d-4794-9afe-fedf44c08755 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:40:01.160872 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-beb9d462-ac5d-4794-9afe-fedf44c08755 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:40:01.166889 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-beb9d462-ac5d-4794-9afe-fedf44c08755 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:40:01.168557 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-beb9d462-ac5d-4794-9afe-fedf44c08755 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:40:01.170056 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-beb9d462-ac5d-4794-9afe-fedf44c08755 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:40:01.174431 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-beb9d462-ac5d-4794-9afe-fedf44c08755 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:40:01.232799 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-62b73c0f-740e-48e1-87b1-472325ca1e3d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:40:01.233718 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-62b73c0f-740e-48e1-87b1-472325ca1e3d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: d470b39a-b9d6-476b-a720-1d61204c3d1c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:40:01.247568 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-62b73c0f-740e-48e1-87b1-472325ca1e3d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:40:01.252532 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-62b73c0f-740e-48e1-87b1-472325ca1e3d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:40:01.253397 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-62b73c0f-740e-48e1-87b1-472325ca1e3d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:40:01.254518 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-62b73c0f-740e-48e1-87b1-472325ca1e3d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:40:01.256195 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-62b73c0f-740e-48e1-87b1-472325ca1e3d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:40:01.257069 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-62b73c0f-740e-48e1-87b1-472325ca1e3d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:40:02.202324 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-beb9d462-ac5d-4794-9afe-fedf44c08755 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:40:02.209298 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:40:02.212525 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-beb9d462-ac5d-4794-9afe-fedf44c08755 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:40:02.234362 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-beb9d462-ac5d-4794-9afe-fedf44c08755 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:40:02.241665 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-beb9d462-ac5d-4794-9afe-fedf44c08755 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1733 microversion: 2.20 time: 1.122755 Oct 26 13:40:02.242521 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3096/6154] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:40:01 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1733 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:40:02.508370 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-62b73c0f-740e-48e1-87b1-472325ca1e3d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c55ea80b2e14c99baf3d551f00bfa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd47c4f41a64b56b1b571ab5bcd9bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:40:02.521977 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-62b73c0f-740e-48e1-87b1-472325ca1e3d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c" status: 200 len: 1506 microversion: 2.1 time: 1.295802 Oct 26 13:40:02.545153 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3059/6155] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:40:01 2022] GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c => generated 1506 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:40:02.554586 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d8dde8ba-d340-4ce9-af7b-401ea18d3c7d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5f6f680-43e8-4a2e-b5e6-142c2ddbf65d", "device": "/dev/sdb"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:40:02.557896 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d8dde8ba-d340-4ce9-af7b-401ea18d3c7d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: d470b39a-b9d6-476b-a720-1d61204c3d1c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:40:02.574069 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8dde8ba-d340-4ce9-af7b-401ea18d3c7d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:40:02.574945 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8dde8ba-d340-4ce9-af7b-401ea18d3c7d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:40:02.576135 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8dde8ba-d340-4ce9-af7b-401ea18d3c7d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:40:02.577209 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8dde8ba-d340-4ce9-af7b-401ea18d3c7d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:40:02.578412 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8dde8ba-d340-4ce9-af7b-401ea18d3c7d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:40:02.587596 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8dde8ba-d340-4ce9-af7b-401ea18d3c7d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:40:03.085669 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d8dde8ba-d340-4ce9-af7b-401ea18d3c7d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "POST /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.538155 Oct 26 13:40:03.091914 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3097/6156] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Oct 26 13:40:02 2022] POST /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c/os-volume_attachments => generated 194 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:40:03.272520 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8751a2b8-73b8-4004-a184-169be8d30a0c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:40:03.272665 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8751a2b8-73b8-4004-a184-169be8d30a0c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:40:03.284277 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=46 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:40:03.290721 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8751a2b8-73b8-4004-a184-169be8d30a0c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:40:03.294077 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8751a2b8-73b8-4004-a184-169be8d30a0c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:40:03.295049 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8751a2b8-73b8-4004-a184-169be8d30a0c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:40:03.296921 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8751a2b8-73b8-4004-a184-169be8d30a0c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:40:03.297741 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8751a2b8-73b8-4004-a184-169be8d30a0c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:40:03.301546 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8751a2b8-73b8-4004-a184-169be8d30a0c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:40:06.182458 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8751a2b8-73b8-4004-a184-169be8d30a0c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:40:06.185375 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:40:06.201331 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8751a2b8-73b8-4004-a184-169be8d30a0c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:40:06.207878 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8751a2b8-73b8-4004-a184-169be8d30a0c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:40:06.209872 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8751a2b8-73b8-4004-a184-169be8d30a0c tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1733 microversion: 2.20 time: 2.942284 Oct 26 13:40:06.213530 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3060/6157] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:40:03 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1733 bytes in 2947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:40:07.241880 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4775d1e3-8b81-406d-b485-f7a9b915c852 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:40:07.243255 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4775d1e3-8b81-406d-b485-f7a9b915c852 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:40:07.267043 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:40:07.270673 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4775d1e3-8b81-406d-b485-f7a9b915c852 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:40:07.277363 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4775d1e3-8b81-406d-b485-f7a9b915c852 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:40:07.278231 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4775d1e3-8b81-406d-b485-f7a9b915c852 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:40:07.279196 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4775d1e3-8b81-406d-b485-f7a9b915c852 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:40:07.288931 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4775d1e3-8b81-406d-b485-f7a9b915c852 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:40:07.289998 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4775d1e3-8b81-406d-b485-f7a9b915c852 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:40:08.334660 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4775d1e3-8b81-406d-b485-f7a9b915c852 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:40:08.351975 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4775d1e3-8b81-406d-b485-f7a9b915c852 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:40:08.356449 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4775d1e3-8b81-406d-b485-f7a9b915c852 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:40:08.360134 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4775d1e3-8b81-406d-b485-f7a9b915c852 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1720 microversion: 2.20 time: 1.122761 Oct 26 13:40:08.360747 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3098/6158] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:40:07 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1720 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:40:37.811860 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-33006a1f-9680-478d-842c-2c94aa457954 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:40:37.814506 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-33006a1f-9680-478d-842c-2c94aa457954 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:40:37.817523 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:40:37.818200 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:40:37.837193 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-33006a1f-9680-478d-842c-2c94aa457954 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:40:37.837781 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-33006a1f-9680-478d-842c-2c94aa457954 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:40:37.838227 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-33006a1f-9680-478d-842c-2c94aa457954 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:40:37.838952 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-33006a1f-9680-478d-842c-2c94aa457954 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:40:37.839409 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-33006a1f-9680-478d-842c-2c94aa457954 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:40:37.840028 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-33006a1f-9680-478d-842c-2c94aa457954 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:40:37.910483 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-33006a1f-9680-478d-842c-2c94aa457954 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.103041 Oct 26 13:40:37.911327 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3061/6159] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Oct 26 13:40:37 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052/os-volume_attachments => generated 25 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:40:38.025724 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4c6ee71a-55f6-4270-9538-0aecfddc5feb tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:40:38.026241 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4c6ee71a-55f6-4270-9538-0aecfddc5feb tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:40:38.032762 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:40:38.041641 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:40:38.048023 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c6ee71a-55f6-4270-9538-0aecfddc5feb tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:40:38.048718 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c6ee71a-55f6-4270-9538-0aecfddc5feb tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:40:38.049329 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c6ee71a-55f6-4270-9538-0aecfddc5feb tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:40:38.050198 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c6ee71a-55f6-4270-9538-0aecfddc5feb tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:40:38.050741 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c6ee71a-55f6-4270-9538-0aecfddc5feb tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:40:38.051411 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c6ee71a-55f6-4270-9538-0aecfddc5feb tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:40:38.111694 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4c6ee71a-55f6-4270-9538-0aecfddc5feb tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:40:38.313038 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4c6ee71a-55f6-4270-9538-0aecfddc5feb tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "DELETE /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 204 len: 0 microversion: 2.20 time: 0.292348 Oct 26 13:40:38.316921 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3099/6160] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 26 13:40:38 2022] DELETE /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 13:40:38.328193 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6e4671c4-8fc9-4b22-9c9b-ba39ba79588b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:40:38.329114 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6e4671c4-8fc9-4b22-9c9b-ba39ba79588b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:40:38.344023 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e4671c4-8fc9-4b22-9c9b-ba39ba79588b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:40:38.346963 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e4671c4-8fc9-4b22-9c9b-ba39ba79588b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:40:38.347770 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e4671c4-8fc9-4b22-9c9b-ba39ba79588b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:40:38.350357 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e4671c4-8fc9-4b22-9c9b-ba39ba79588b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:40:38.351295 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e4671c4-8fc9-4b22-9c9b-ba39ba79588b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:40:38.352109 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e4671c4-8fc9-4b22-9c9b-ba39ba79588b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:40:39.089082 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6e4671c4-8fc9-4b22-9c9b-ba39ba79588b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:40:39.106259 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6e4671c4-8fc9-4b22-9c9b-ba39ba79588b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:40:39.107814 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6e4671c4-8fc9-4b22-9c9b-ba39ba79588b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:40:39.108993 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6e4671c4-8fc9-4b22-9c9b-ba39ba79588b tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1726 microversion: 2.20 time: 0.787167 Oct 26 13:40:39.109923 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3062/6161] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:40:38 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1726 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:40:40.137739 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-94afa756-d173-4cb3-ba33-98740144bb0e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:40:40.138569 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-94afa756-d173-4cb3-ba33-98740144bb0e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:40:40.147486 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-94afa756-d173-4cb3-ba33-98740144bb0e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:40:40.147985 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-94afa756-d173-4cb3-ba33-98740144bb0e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:40:40.148433 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-94afa756-d173-4cb3-ba33-98740144bb0e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:40:40.149149 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-94afa756-d173-4cb3-ba33-98740144bb0e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:40:40.149654 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-94afa756-d173-4cb3-ba33-98740144bb0e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:40:40.150091 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-94afa756-d173-4cb3-ba33-98740144bb0e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:40:40.374968 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-be9f541c-fecd-4ab9-a668-898d63d6aa7d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:40:40.376168 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-be9f541c-fecd-4ab9-a668-898d63d6aa7d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: d470b39a-b9d6-476b-a720-1d61204c3d1c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:40:40.383478 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-be9f541c-fecd-4ab9-a668-898d63d6aa7d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:40:40.384162 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-be9f541c-fecd-4ab9-a668-898d63d6aa7d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:40:40.384784 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-be9f541c-fecd-4ab9-a668-898d63d6aa7d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:40:40.385766 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-be9f541c-fecd-4ab9-a668-898d63d6aa7d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:40:40.386380 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-be9f541c-fecd-4ab9-a668-898d63d6aa7d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:40:40.386971 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-be9f541c-fecd-4ab9-a668-898d63d6aa7d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:40:40.406226 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-94afa756-d173-4cb3-ba33-98740144bb0e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:40:40.419897 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-94afa756-d173-4cb3-ba33-98740144bb0e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:40:40.424889 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-94afa756-d173-4cb3-ba33-98740144bb0e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:40:40.429559 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-94afa756-d173-4cb3-ba33-98740144bb0e tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1726 microversion: 2.20 time: 0.297445 Oct 26 13:40:40.430156 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3100/6162] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:40:40 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1726 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 13:40:40.506426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-be9f541c-fecd-4ab9-a668-898d63d6aa7d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lazy-loading 'services' on Instance uuid d470b39a-b9d6-476b-a720-1d61204c3d1c {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:40:40.600319 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-be9f541c-fecd-4ab9-a668-898d63d6aa7d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c/os-volume_attachments/f5f6f680-43e8-4a2e-b5e6-142c2ddbf65d" status: 202 len: 0 microversion: 2.1 time: 0.229461 Oct 26 13:40:40.601801 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3063/6163] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Oct 26 13:40:40 2022] DELETE /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c/os-volume_attachments/f5f6f680-43e8-4a2e-b5e6-142c2ddbf65d => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:40:41.457262 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5d02314d-2002-48a9-8520-939f4296e76a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:40:41.458407 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5d02314d-2002-48a9-8520-939f4296e76a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:40:41.487508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5d02314d-2002-48a9-8520-939f4296e76a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:40:41.488049 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5d02314d-2002-48a9-8520-939f4296e76a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:40:41.491127 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5d02314d-2002-48a9-8520-939f4296e76a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:40:41.491994 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5d02314d-2002-48a9-8520-939f4296e76a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:40:41.492491 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5d02314d-2002-48a9-8520-939f4296e76a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:40:41.496763 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5d02314d-2002-48a9-8520-939f4296e76a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:40:41.917620 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5d02314d-2002-48a9-8520-939f4296e76a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:40:41.934529 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5d02314d-2002-48a9-8520-939f4296e76a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:40:41.936420 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5d02314d-2002-48a9-8520-939f4296e76a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac38637c647f4ddc84566bc6896ebabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b383d6b193c64891ac63f3a26c996e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:40:41.937945 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5d02314d-2002-48a9-8520-939f4296e76a tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 200 len: 1658 microversion: 2.20 time: 0.486465 Oct 26 13:40:41.941033 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3101/6164] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:40:41 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 1658 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 13:40:42.853695 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-9c380a0a-62a9-4cdb-b0a5-97a8a1fd3f79 req-9ce3a965-7a64-414d-b47c-fde92165f3a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52b4e824-6117-46a5-a005-0bef3bc75052", "name": "network-vif-deleted", "tag": "86120fac-67e2-4ce8-a98b-0f683e946ba4"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:40:42.872765 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9c380a0a-62a9-4cdb-b0a5-97a8a1fd3f79 req-9ce3a965-7a64-414d-b47c-fde92165f3a4 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:40:42.874414 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9c380a0a-62a9-4cdb-b0a5-97a8a1fd3f79 req-9ce3a965-7a64-414d-b47c-fde92165f3a4 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:40:42.875064 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9c380a0a-62a9-4cdb-b0a5-97a8a1fd3f79 req-9ce3a965-7a64-414d-b47c-fde92165f3a4 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:40:42.894638 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-9c380a0a-62a9-4cdb-b0a5-97a8a1fd3f79 req-9ce3a965-7a64-414d-b47c-fde92165f3a4 service nova] Creating event network-vif-deleted:86120fac-67e2-4ce8-a98b-0f683e946ba4 for instance 52b4e824-6117-46a5-a005-0bef3bc75052 on n-h1-862686-1 Oct 26 13:40:42.903284 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-9c380a0a-62a9-4cdb-b0a5-97a8a1fd3f79 req-9ce3a965-7a64-414d-b47c-fde92165f3a4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.600846 Oct 26 13:40:42.910474 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3064/6165] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:40:42.967284 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-71e56f76-5824-4cf1-99a4-7b98db1fd108 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:40:42.967898 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-71e56f76-5824-4cf1-99a4-7b98db1fd108 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:40:42.977773 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-71e56f76-5824-4cf1-99a4-7b98db1fd108 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:40:42.978272 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-71e56f76-5824-4cf1-99a4-7b98db1fd108 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:40:42.978714 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-71e56f76-5824-4cf1-99a4-7b98db1fd108 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:40:42.984073 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-71e56f76-5824-4cf1-99a4-7b98db1fd108 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:40:42.984426 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-71e56f76-5824-4cf1-99a4-7b98db1fd108 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:40:42.985812 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-71e56f76-5824-4cf1-99a4-7b98db1fd108 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:40:43.022890 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-71e56f76-5824-4cf1-99a4-7b98db1fd108 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] HTTP exception thrown: Instance 52b4e824-6117-46a5-a005-0bef3bc75052 could not be found. Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-71e56f76-5824-4cf1-99a4-7b98db1fd108 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Request method failure captured: Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 HTTP/1.1 Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTb_SeVtemuJoE-71HmnihPaaJODA1AQWjpkEt0luprtCRN4_bHwtOXFjQ32WbAFpXXcnTxvDO9VucoT3yEAu2b90JvvWgE57_hUXg8ZYvPGr30mOSBo5xhgO2akhVaBje7aa2nlEAIIXas1qs2AGbNhTOJH956A7IRZisbUICAaREg Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: X-Openstack-Nova-Api-Version: 2.20 Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: b383d6b193c64891ac63f3a26c996e20 Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1662277167 Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b383d6b193c64891ac63f3a26c996e20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b383d6b193c64891ac63f3a26c996e20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b383d6b193c64891ac63f3a26c996e20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b383d6b193c64891ac63f3a26c996e20"}]}] Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1662277167 Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: b383d6b193c64891ac63f3a26c996e20 Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1662277167 Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-AttachVolumeShelveTestJSON-1662277167-project Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: ac38637c647f4ddc84566bc6896ebabb Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1662277167-project Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 52b4e824-6117-46a5-a005-0bef3bc75052 could not be found. Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '52b4e824-6117-46a5-a005-0bef3bc75052'} Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52b4e824-6117-46a5-a005-0bef3bc75052 could not be found. Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52b4e824-6117-46a5-a005-0bef3bc75052 could not be found. Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:40:43.025217 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:40:43.031575 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:40:43.031575 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:40:43.031575 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:40:43.031575 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:40:43.031575 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:40:43.031575 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:40:43.031575 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52b4e824-6117-46a5-a005-0bef3bc75052 could not be found. Oct 26 13:40:43.031575 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:40:43.031575 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-71e56f76-5824-4cf1-99a4-7b98db1fd108 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Returning 404 to user: Instance 52b4e824-6117-46a5-a005-0bef3bc75052 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:40:43.033607 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-71e56f76-5824-4cf1-99a4-7b98db1fd108 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 404 len: 111 microversion: 2.20 time: 0.064140 Oct 26 13:40:43.037756 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3102/6166] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:40:42 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:40:43.044739 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-161e6ec8-b9e6-4ed9-82b1-11244aa9b269 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '.version_select at 0x7f673197ddc0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:40:43.087455 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-161e6ec8-b9e6-4ed9-82b1-11244aa9b269 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2030326391" status: 204 len: 0 microversion: 2.20 time: 0.047787 Oct 26 13:40:43.089166 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3065/6167] 10.222.0.40 () {60 vars in 1262 bytes} [Wed Oct 26 13:40:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2030326391 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 13:40:48.936051 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-218fe86f-47db-41b3-8717-999e01012f05 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:40:48.940869 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-218fe86f-47db-41b3-8717-999e01012f05 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:40:48.970040 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-218fe86f-47db-41b3-8717-999e01012f05 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:40:48.971442 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-218fe86f-47db-41b3-8717-999e01012f05 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:40:48.975346 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-218fe86f-47db-41b3-8717-999e01012f05 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:40:48.979518 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-218fe86f-47db-41b3-8717-999e01012f05 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:40:48.981444 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-218fe86f-47db-41b3-8717-999e01012f05 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:40:48.983808 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-218fe86f-47db-41b3-8717-999e01012f05 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:40:49.042773 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-218fe86f-47db-41b3-8717-999e01012f05 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] HTTP exception thrown: Instance 52b4e824-6117-46a5-a005-0bef3bc75052 could not be found. Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-218fe86f-47db-41b3-8717-999e01012f05 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Request method failure captured: Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: request: DELETE /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 HTTP/1.1 Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTb_SeVtemuJoE-71HmnihPaaJODA1AQWjpkEt0luprtCRN4_bHwtOXFjQ32WbAFpXXcnTxvDO9VucoT3yEAu2b90JvvWgE57_hUXg8ZYvPGr30mOSBo5xhgO2akhVaBje7aa2nlEAIIXas1qs2AGbNhTOJH956A7IRZisbUICAaREg Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: X-Openstack-Nova-Api-Version: 2.20 Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: b383d6b193c64891ac63f3a26c996e20 Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1662277167 Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b383d6b193c64891ac63f3a26c996e20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b383d6b193c64891ac63f3a26c996e20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b383d6b193c64891ac63f3a26c996e20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b383d6b193c64891ac63f3a26c996e20"}]}] Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1662277167 Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: b383d6b193c64891ac63f3a26c996e20 Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1662277167 Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-AttachVolumeShelveTestJSON-1662277167-project Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: ac38637c647f4ddc84566bc6896ebabb Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1662277167-project Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 52b4e824-6117-46a5-a005-0bef3bc75052 could not be found. Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '52b4e824-6117-46a5-a005-0bef3bc75052'} Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52b4e824-6117-46a5-a005-0bef3bc75052 could not be found. Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:40:49.044897 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:40:49.052972 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52b4e824-6117-46a5-a005-0bef3bc75052 could not be found. Oct 26 13:40:49.052972 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:40:49.052972 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:40:49.052972 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:40:49.052972 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:40:49.052972 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:40:49.052972 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:40:49.052972 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:40:49.052972 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:40:49.052972 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52b4e824-6117-46a5-a005-0bef3bc75052 could not be found. Oct 26 13:40:49.052972 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:40:49.052972 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-218fe86f-47db-41b3-8717-999e01012f05 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Returning 404 to user: Instance 52b4e824-6117-46a5-a005-0bef3bc75052 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:40:49.052972 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-218fe86f-47db-41b3-8717-999e01012f05 tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "DELETE /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 404 len: 111 microversion: 2.20 time: 0.117849 Oct 26 13:40:49.052972 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3103/6168] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 26 13:40:48 2022] DELETE /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:40:49.057303 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-31b23455-5efc-46ed-b415-b5fd6f09c2ba tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:40:49.069929 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-31b23455-5efc-46ed-b415-b5fd6f09c2ba tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 52b4e824-6117-46a5-a005-0bef3bc75052] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:40:49.082016 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31b23455-5efc-46ed-b415-b5fd6f09c2ba tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:40:49.088495 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31b23455-5efc-46ed-b415-b5fd6f09c2ba tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:40:49.088894 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31b23455-5efc-46ed-b415-b5fd6f09c2ba tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:40:49.089673 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31b23455-5efc-46ed-b415-b5fd6f09c2ba tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:40:49.090139 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31b23455-5efc-46ed-b415-b5fd6f09c2ba tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:40:49.090578 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31b23455-5efc-46ed-b415-b5fd6f09c2ba tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:40:49.142996 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-31b23455-5efc-46ed-b415-b5fd6f09c2ba tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] HTTP exception thrown: Instance 52b4e824-6117-46a5-a005-0bef3bc75052 could not be found. Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-31b23455-5efc-46ed-b415-b5fd6f09c2ba tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Request method failure captured: Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 HTTP/1.1 Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTb_SeVtemuJoE-71HmnihPaaJODA1AQWjpkEt0luprtCRN4_bHwtOXFjQ32WbAFpXXcnTxvDO9VucoT3yEAu2b90JvvWgE57_hUXg8ZYvPGr30mOSBo5xhgO2akhVaBje7aa2nlEAIIXas1qs2AGbNhTOJH956A7IRZisbUICAaREg Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: X-Openstack-Nova-Api-Version: 2.20 Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: b383d6b193c64891ac63f3a26c996e20 Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1662277167 Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b383d6b193c64891ac63f3a26c996e20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b383d6b193c64891ac63f3a26c996e20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b383d6b193c64891ac63f3a26c996e20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b383d6b193c64891ac63f3a26c996e20"}]}] Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1662277167 Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: b383d6b193c64891ac63f3a26c996e20 Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1662277167 Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-AttachVolumeShelveTestJSON-1662277167-project Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: ac38637c647f4ddc84566bc6896ebabb Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1662277167-project Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 52b4e824-6117-46a5-a005-0bef3bc75052 could not be found. Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '52b4e824-6117-46a5-a005-0bef3bc75052'} Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52b4e824-6117-46a5-a005-0bef3bc75052 could not be found. Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52b4e824-6117-46a5-a005-0bef3bc75052 could not be found. Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:40:49.144907 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:40:49.148887 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:40:49.148887 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:40:49.148887 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:40:49.148887 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:40:49.148887 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:40:49.148887 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:40:49.148887 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52b4e824-6117-46a5-a005-0bef3bc75052 could not be found. Oct 26 13:40:49.148887 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:40:49.154937 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-31b23455-5efc-46ed-b415-b5fd6f09c2ba tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Returning 404 to user: Instance 52b4e824-6117-46a5-a005-0bef3bc75052 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:40:49.169449 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-31b23455-5efc-46ed-b415-b5fd6f09c2ba tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052" status: 404 len: 111 microversion: 2.20 time: 0.103921 Oct 26 13:40:49.171205 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3066/6169] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:40:49 2022] GET /compute/v2.1/servers/52b4e824-6117-46a5-a005-0bef3bc75052 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:40:49.302905 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d88a35a4-d955-4de8-930a-35ab3fb4ec73 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:40:49.303813 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d88a35a4-d955-4de8-930a-35ab3fb4ec73 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: d470b39a-b9d6-476b-a720-1d61204c3d1c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:40:49.318918 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d88a35a4-d955-4de8-930a-35ab3fb4ec73 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:40:49.320335 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d88a35a4-d955-4de8-930a-35ab3fb4ec73 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:40:49.321373 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d88a35a4-d955-4de8-930a-35ab3fb4ec73 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:40:49.323534 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d88a35a4-d955-4de8-930a-35ab3fb4ec73 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:40:49.336267 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d88a35a4-d955-4de8-930a-35ab3fb4ec73 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:40:49.337728 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d88a35a4-d955-4de8-930a-35ab3fb4ec73 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:40:49.386978 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d88a35a4-d955-4de8-930a-35ab3fb4ec73 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: d470b39a-b9d6-476b-a720-1d61204c3d1c] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:40:49.555969 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d88a35a4-d955-4de8-930a-35ab3fb4ec73 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c" status: 204 len: 0 microversion: 2.1 time: 0.259876 Oct 26 13:40:49.558326 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3104/6170] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:40:49 2022] DELETE /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:40:49.568248 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2ab8725c-ce71-423e-9a59-e5bedb1f008f tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:40:49.570836 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2ab8725c-ce71-423e-9a59-e5bedb1f008f tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: d470b39a-b9d6-476b-a720-1d61204c3d1c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:40:49.595859 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ab8725c-ce71-423e-9a59-e5bedb1f008f tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:40:49.597220 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ab8725c-ce71-423e-9a59-e5bedb1f008f tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:40:49.597964 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ab8725c-ce71-423e-9a59-e5bedb1f008f tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:40:49.598988 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ab8725c-ce71-423e-9a59-e5bedb1f008f tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:40:49.603088 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ab8725c-ce71-423e-9a59-e5bedb1f008f tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:40:49.603859 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ab8725c-ce71-423e-9a59-e5bedb1f008f tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:40:50.102879 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2ab8725c-ce71-423e-9a59-e5bedb1f008f tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c55ea80b2e14c99baf3d551f00bfa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd47c4f41a64b56b1b571ab5bcd9bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:40:50.113269 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2ab8725c-ce71-423e-9a59-e5bedb1f008f tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c" status: 200 len: 1512 microversion: 2.1 time: 0.550420 Oct 26 13:40:50.123507 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3067/6171] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:40:49 2022] GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c => generated 1512 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:40:51.148493 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-46db1554-0268-4c9c-be63-d46632e5bfc9 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:40:51.149211 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-46db1554-0268-4c9c-be63-d46632e5bfc9 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: d470b39a-b9d6-476b-a720-1d61204c3d1c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:40:51.187771 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46db1554-0268-4c9c-be63-d46632e5bfc9 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:40:51.189049 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46db1554-0268-4c9c-be63-d46632e5bfc9 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:40:51.190829 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46db1554-0268-4c9c-be63-d46632e5bfc9 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:40:51.191831 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46db1554-0268-4c9c-be63-d46632e5bfc9 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:40:51.203921 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46db1554-0268-4c9c-be63-d46632e5bfc9 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:40:51.204387 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-46db1554-0268-4c9c-be63-d46632e5bfc9 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:40:51.590113 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-46db1554-0268-4c9c-be63-d46632e5bfc9 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c55ea80b2e14c99baf3d551f00bfa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd47c4f41a64b56b1b571ab5bcd9bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:40:51.605677 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-46db1554-0268-4c9c-be63-d46632e5bfc9 tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c" status: 200 len: 1512 microversion: 2.1 time: 0.461801 Oct 26 13:40:51.609536 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3105/6172] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:40:51 2022] GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c => generated 1512 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:40:52.638237 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-29c22882-883b-4466-a9be-e76cd430d8fd tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:40:52.638912 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-29c22882-883b-4466-a9be-e76cd430d8fd tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: d470b39a-b9d6-476b-a720-1d61204c3d1c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:40:52.656114 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-29c22882-883b-4466-a9be-e76cd430d8fd tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:40:52.656620 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-29c22882-883b-4466-a9be-e76cd430d8fd tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:40:52.657827 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-29c22882-883b-4466-a9be-e76cd430d8fd tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:40:52.658723 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-29c22882-883b-4466-a9be-e76cd430d8fd tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:40:52.659215 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-29c22882-883b-4466-a9be-e76cd430d8fd tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:40:52.659645 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-29c22882-883b-4466-a9be-e76cd430d8fd tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:40:52.964734 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-62d5de26-12aa-41b2-aefc-bc935a1a6f24 req-23047bd8-0bf3-4911-b813-fcfa5b03fd65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d470b39a-b9d6-476b-a720-1d61204c3d1c", "name": "network-vif-deleted", "tag": "ed2bdc64-bf6d-416e-a577-cd8eea2349ac"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:40:52.971817 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-29c22882-883b-4466-a9be-e76cd430d8fd tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c55ea80b2e14c99baf3d551f00bfa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd47c4f41a64b56b1b571ab5bcd9bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:40:52.982507 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-29c22882-883b-4466-a9be-e76cd430d8fd tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c" status: 200 len: 1470 microversion: 2.1 time: 0.348501 Oct 26 13:40:52.990366 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3068/6173] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:40:52 2022] GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c => generated 1470 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:40:53.000035 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-62d5de26-12aa-41b2-aefc-bc935a1a6f24 req-23047bd8-0bf3-4911-b813-fcfa5b03fd65 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:40:53.001346 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-62d5de26-12aa-41b2-aefc-bc935a1a6f24 req-23047bd8-0bf3-4911-b813-fcfa5b03fd65 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:40:53.004451 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-62d5de26-12aa-41b2-aefc-bc935a1a6f24 req-23047bd8-0bf3-4911-b813-fcfa5b03fd65 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:40:53.042405 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-62d5de26-12aa-41b2-aefc-bc935a1a6f24 req-23047bd8-0bf3-4911-b813-fcfa5b03fd65 service nova] Creating event network-vif-deleted:ed2bdc64-bf6d-416e-a577-cd8eea2349ac for instance d470b39a-b9d6-476b-a720-1d61204c3d1c on n-h2-862686-1 Oct 26 13:40:53.060286 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-62d5de26-12aa-41b2-aefc-bc935a1a6f24 req-23047bd8-0bf3-4911-b813-fcfa5b03fd65 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099542 Oct 26 13:40:53.067369 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3106/6174] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:40:54.020608 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f51e5ddd-bfa3-48af-b966-0090b5694b1d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:40:54.021228 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f51e5ddd-bfa3-48af-b966-0090b5694b1d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] [instance: d470b39a-b9d6-476b-a720-1d61204c3d1c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:40:54.041371 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f51e5ddd-bfa3-48af-b966-0090b5694b1d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:40:54.041919 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f51e5ddd-bfa3-48af-b966-0090b5694b1d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:40:54.042366 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f51e5ddd-bfa3-48af-b966-0090b5694b1d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:40:54.043086 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f51e5ddd-bfa3-48af-b966-0090b5694b1d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:40:54.043545 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f51e5ddd-bfa3-48af-b966-0090b5694b1d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:40:54.043971 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f51e5ddd-bfa3-48af-b966-0090b5694b1d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:40:54.090494 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-f51e5ddd-bfa3-48af-b966-0090b5694b1d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] HTTP exception thrown: Instance d470b39a-b9d6-476b-a720-1d61204c3d1c could not be found. Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f51e5ddd-bfa3-48af-b966-0090b5694b1d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Request method failure captured: Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c HTTP/1.1 Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTd3s029S2vWcxXX1HNq3_cJELQ7oHEhx1FdEw_oQLXUKIu-0G2nh3zOcZjtG6srzLeGond5R9LvL0kxRbtdlHtwEX9d8CurFdNtvTRT9COj1PoVNkpV0aGriAAHPzZL1A3-Wsoe3rUQML2vS7ilZh0X6Ay7bGxMgU-bJxPAxnlN65g Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 6fd47c4f41a64b56b1b571ab5bcd9bef Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1884786847 Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6fd47c4f41a64b56b1b571ab5bcd9bef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6fd47c4f41a64b56b1b571ab5bcd9bef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6fd47c4f41a64b56b1b571ab5bcd9bef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6fd47c4f41a64b56b1b571ab5bcd9bef"}]}] Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-VolumesSnapshotTestJSON-1884786847 Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 6fd47c4f41a64b56b1b571ab5bcd9bef Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1884786847 Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-VolumesSnapshotTestJSON-1884786847-project Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 6c55ea80b2e14c99baf3d551f00bfa68 Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-VolumesSnapshotTestJSON-1884786847-project Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance d470b39a-b9d6-476b-a720-1d61204c3d1c could not be found. Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'd470b39a-b9d6-476b-a720-1d61204c3d1c'} Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d470b39a-b9d6-476b-a720-1d61204c3d1c could not be found. Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d470b39a-b9d6-476b-a720-1d61204c3d1c could not be found. Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:40:54.093084 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:40:54.099290 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:40:54.099290 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:40:54.099290 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:40:54.099290 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:40:54.099290 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:40:54.099290 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d470b39a-b9d6-476b-a720-1d61204c3d1c could not be found. Oct 26 13:40:54.099290 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:40:54.100605 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f51e5ddd-bfa3-48af-b966-0090b5694b1d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] Returning 404 to user: Instance d470b39a-b9d6-476b-a720-1d61204c3d1c could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:40:54.101808 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f51e5ddd-bfa3-48af-b966-0090b5694b1d tempest-VolumesSnapshotTestJSON-1884786847 tempest-VolumesSnapshotTestJSON-1884786847-project] 10.222.0.40 "GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c" status: 404 len: 111 microversion: 2.1 time: 0.086670 Oct 26 13:40:54.105038 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3069/6175] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:40:54 2022] GET /compute/v2.1/servers/d470b39a-b9d6-476b-a720-1d61204c3d1c => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:41:00.690696 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-975c7fc2-6aa6-41e1-8e62-59a371566c9f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:41:00.692002 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-975c7fc2-6aa6-41e1-8e62-59a371566c9f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:41:00.706433 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-975c7fc2-6aa6-41e1-8e62-59a371566c9f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:41:00.709024 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-975c7fc2-6aa6-41e1-8e62-59a371566c9f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:41:00.711482 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-975c7fc2-6aa6-41e1-8e62-59a371566c9f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:41:00.714196 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-975c7fc2-6aa6-41e1-8e62-59a371566c9f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:41:00.716220 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-975c7fc2-6aa6-41e1-8e62-59a371566c9f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:41:00.718636 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-975c7fc2-6aa6-41e1-8e62-59a371566c9f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:41:00.802687 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-975c7fc2-6aa6-41e1-8e62-59a371566c9f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] HTTP exception thrown: Instance 6c95d88e-349c-4594-b0a2-351b507f34f9 could not be found. Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-975c7fc2-6aa6-41e1-8e62-59a371566c9f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Request method failure captured: Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: request: DELETE /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 HTTP/1.1 Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTb_SeVtemuJoE-71HmnihPaaJODA1AQWjpkEt0luprtCRN4_bHwtOXFjQ32WbAFpXXcnTxvDO9VucoT3yEAu2b90JvvWgE57_hUXg8ZYvPGr30mOSBo5xhgO2akhVaBje7aa2nlEAIIXas1qs2AGbNhTOJH956A7IRZisbUICAaREg Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: X-Openstack-Nova-Api-Version: 2.20 Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: b383d6b193c64891ac63f3a26c996e20 Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1662277167 Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b383d6b193c64891ac63f3a26c996e20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b383d6b193c64891ac63f3a26c996e20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b383d6b193c64891ac63f3a26c996e20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b383d6b193c64891ac63f3a26c996e20"}]}] Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1662277167 Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: b383d6b193c64891ac63f3a26c996e20 Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1662277167 Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-AttachVolumeShelveTestJSON-1662277167-project Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: ac38637c647f4ddc84566bc6896ebabb Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1662277167-project Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 6c95d88e-349c-4594-b0a2-351b507f34f9 could not be found. Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '6c95d88e-349c-4594-b0a2-351b507f34f9'} Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c95d88e-349c-4594-b0a2-351b507f34f9 could not be found. Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:41:00.809312 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:41:00.813678 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c95d88e-349c-4594-b0a2-351b507f34f9 could not be found. Oct 26 13:41:00.813678 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:41:00.813678 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:41:00.813678 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:41:00.813678 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:41:00.813678 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:41:00.813678 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:41:00.813678 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:41:00.813678 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:41:00.813678 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c95d88e-349c-4594-b0a2-351b507f34f9 could not be found. Oct 26 13:41:00.813678 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:41:00.813678 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-975c7fc2-6aa6-41e1-8e62-59a371566c9f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Returning 404 to user: Instance 6c95d88e-349c-4594-b0a2-351b507f34f9 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:41:00.813678 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-975c7fc2-6aa6-41e1-8e62-59a371566c9f tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 404 len: 111 microversion: 2.20 time: 0.126582 Oct 26 13:41:00.813678 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3107/6176] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 26 13:41:00 2022] DELETE /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:41:00.823582 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-580d159a-59c4-4084-8475-c49ca8ecafcf tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:41:00.824979 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-580d159a-59c4-4084-8475-c49ca8ecafcf tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] [instance: 6c95d88e-349c-4594-b0a2-351b507f34f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:41:00.853187 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-580d159a-59c4-4084-8475-c49ca8ecafcf tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:41:00.854079 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-580d159a-59c4-4084-8475-c49ca8ecafcf tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:41:00.855361 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-580d159a-59c4-4084-8475-c49ca8ecafcf tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:41:00.856489 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-580d159a-59c4-4084-8475-c49ca8ecafcf tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:41:00.857174 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-580d159a-59c4-4084-8475-c49ca8ecafcf tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:41:00.858071 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-580d159a-59c4-4084-8475-c49ca8ecafcf tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:41:00.905438 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-580d159a-59c4-4084-8475-c49ca8ecafcf tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] HTTP exception thrown: Instance 6c95d88e-349c-4594-b0a2-351b507f34f9 could not be found. Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-580d159a-59c4-4084-8475-c49ca8ecafcf tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Request method failure captured: Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 HTTP/1.1 Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTb_SeVtemuJoE-71HmnihPaaJODA1AQWjpkEt0luprtCRN4_bHwtOXFjQ32WbAFpXXcnTxvDO9VucoT3yEAu2b90JvvWgE57_hUXg8ZYvPGr30mOSBo5xhgO2akhVaBje7aa2nlEAIIXas1qs2AGbNhTOJH956A7IRZisbUICAaREg Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: X-Openstack-Nova-Api-Version: 2.20 Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: b383d6b193c64891ac63f3a26c996e20 Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1662277167 Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b383d6b193c64891ac63f3a26c996e20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b383d6b193c64891ac63f3a26c996e20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b383d6b193c64891ac63f3a26c996e20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b383d6b193c64891ac63f3a26c996e20"}]}] Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1662277167 Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: b383d6b193c64891ac63f3a26c996e20 Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1662277167 Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-AttachVolumeShelveTestJSON-1662277167-project Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: ac38637c647f4ddc84566bc6896ebabb Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1662277167-project Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 6c95d88e-349c-4594-b0a2-351b507f34f9 could not be found. Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '6c95d88e-349c-4594-b0a2-351b507f34f9'} Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c95d88e-349c-4594-b0a2-351b507f34f9 could not be found. Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c95d88e-349c-4594-b0a2-351b507f34f9 could not be found. Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:41:00.913417 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:41:00.919596 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:41:00.919596 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:41:00.919596 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:41:00.919596 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:41:00.919596 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:41:00.919596 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:41:00.919596 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c95d88e-349c-4594-b0a2-351b507f34f9 could not be found. Oct 26 13:41:00.919596 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:41:00.925103 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-580d159a-59c4-4084-8475-c49ca8ecafcf tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] Returning 404 to user: Instance 6c95d88e-349c-4594-b0a2-351b507f34f9 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:41:00.928345 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-580d159a-59c4-4084-8475-c49ca8ecafcf tempest-AttachVolumeShelveTestJSON-1662277167 tempest-AttachVolumeShelveTestJSON-1662277167-project] 10.222.0.40 "GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9" status: 404 len: 111 microversion: 2.20 time: 0.108494 Oct 26 13:41:00.929830 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3070/6177] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 26 13:41:00 2022] GET /compute/v2.1/servers/6c95d88e-349c-4594-b0a2-351b507f34f9 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 13:42:05.237864 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-240f5164-595b-4c54-ae45-1b4a378d7d5d tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-294553439", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:42:05.265575 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:42:05.265575 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:42:05.289644 n-d-862686-1 devstack@n-api.service[120598]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 13:42:05.289850 n-d-862686-1 devstack@n-api.service[120598]: Wed Oct 26 13:42:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.40) !!! Oct 26 13:42:05.426530 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-240f5164-595b-4c54-ae45-1b4a378d7d5d tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] validate_networks() for None {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:42:06.388006 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-240f5164-595b-4c54-ae45-1b4a378d7d5d tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:42:06.389191 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-240f5164-595b-4c54-ae45-1b4a378d7d5d tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:42:06.390008 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-240f5164-595b-4c54-ae45-1b4a378d7d5d tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:42:06.391105 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-240f5164-595b-4c54-ae45-1b4a378d7d5d tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:42:06.392147 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-240f5164-595b-4c54-ae45-1b4a378d7d5d tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:42:06.409102 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-240f5164-595b-4c54-ae45-1b4a378d7d5d tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:42:06.409909 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-240f5164-595b-4c54-ae45-1b4a378d7d5d tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:42:06.410578 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-240f5164-595b-4c54-ae45-1b4a378d7d5d tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:42:06.411678 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-240f5164-595b-4c54-ae45-1b4a378d7d5d tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:42:06.412354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-240f5164-595b-4c54-ae45-1b4a378d7d5d tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:42:06.413126 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-240f5164-595b-4c54-ae45-1b4a378d7d5d tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:42:06.436833 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-240f5164-595b-4c54-ae45-1b4a378d7d5d tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Getting quotas for project 47c3346c500e4487aac0c901cd41c761. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:42:06.460366 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-240f5164-595b-4c54-ae45-1b4a378d7d5d tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Getting quotas for user 990a93fcc17345368cb2798065a354e2 and project 47c3346c500e4487aac0c901cd41c761. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:42:06.494138 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-240f5164-595b-4c54-ae45-1b4a378d7d5d tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:42:06.497315 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-240f5164-595b-4c54-ae45-1b4a378d7d5d tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] [instance: c1d6ccec-fd9c-4303-b214-c247e85ec362] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:42:06.592805 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-240f5164-595b-4c54-ae45-1b4a378d7d5d tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.361487 Oct 26 13:42:06.603736 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3108/6178] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:42:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1374 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:42:06.611493 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:42:06.612999 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:42:06.616388 n-d-862686-1 devstack@n-api.service[120597]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 13:42:06.616541 n-d-862686-1 devstack@n-api.service[120597]: Wed Oct 26 13:42:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c1d6ccec-fd9c-4303-b214-c247e85ec362 (ip 10.222.0.40) !!! Oct 26 13:42:06.623742 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a0dc412f-e02a-4bbd-823f-48d0ef938538 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:42:06.631077 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a0dc412f-e02a-4bbd-823f-48d0ef938538 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] [instance: c1d6ccec-fd9c-4303-b214-c247e85ec362] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:42:06.767240 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a0dc412f-e02a-4bbd-823f-48d0ef938538 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a93fcc17345368cb2798065a354e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c3346c500e4487aac0c901cd41c761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:42:06.778901 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a0dc412f-e02a-4bbd-823f-48d0ef938538 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] 10.222.0.40 "GET /compute/v2.1/servers/c1d6ccec-fd9c-4303-b214-c247e85ec362" status: 200 len: 1214 microversion: 2.1 time: 0.169080 Oct 26 13:42:06.780029 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3071/6179] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:42:06 2022] GET /compute/v2.1/servers/c1d6ccec-fd9c-4303-b214-c247e85ec362 => generated 1214 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:42:07.817597 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1772b4e8-3212-4e6c-8dfb-3d079597483b tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:42:07.824720 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1772b4e8-3212-4e6c-8dfb-3d079597483b tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] [instance: c1d6ccec-fd9c-4303-b214-c247e85ec362] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:42:08.042414 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1772b4e8-3212-4e6c-8dfb-3d079597483b tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a93fcc17345368cb2798065a354e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c3346c500e4487aac0c901cd41c761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:42:08.051348 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1772b4e8-3212-4e6c-8dfb-3d079597483b tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] 10.222.0.40 "GET /compute/v2.1/servers/c1d6ccec-fd9c-4303-b214-c247e85ec362" status: 200 len: 1214 microversion: 2.1 time: 0.243515 Oct 26 13:42:08.067480 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3109/6180] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:42:07 2022] GET /compute/v2.1/servers/c1d6ccec-fd9c-4303-b214-c247e85ec362 => generated 1214 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:42:09.086752 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dc5394e4-bbe8-4b7e-a3d7-00c0a28647e6 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:42:09.087599 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-dc5394e4-bbe8-4b7e-a3d7-00c0a28647e6 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] [instance: c1d6ccec-fd9c-4303-b214-c247e85ec362] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:42:09.112254 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc5394e4-bbe8-4b7e-a3d7-00c0a28647e6 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:42:09.113609 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc5394e4-bbe8-4b7e-a3d7-00c0a28647e6 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:42:09.115414 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc5394e4-bbe8-4b7e-a3d7-00c0a28647e6 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:42:09.118777 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc5394e4-bbe8-4b7e-a3d7-00c0a28647e6 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:42:09.119572 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc5394e4-bbe8-4b7e-a3d7-00c0a28647e6 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:42:09.122347 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc5394e4-bbe8-4b7e-a3d7-00c0a28647e6 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:42:09.513691 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-dc5394e4-bbe8-4b7e-a3d7-00c0a28647e6 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a93fcc17345368cb2798065a354e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c3346c500e4487aac0c901cd41c761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:42:09.528426 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-dc5394e4-bbe8-4b7e-a3d7-00c0a28647e6 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] 10.222.0.40 "GET /compute/v2.1/servers/c1d6ccec-fd9c-4303-b214-c247e85ec362" status: 200 len: 1274 microversion: 2.1 time: 0.450620 Oct 26 13:42:09.531852 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3072/6181] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:42:09 2022] GET /compute/v2.1/servers/c1d6ccec-fd9c-4303-b214-c247e85ec362 => generated 1274 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:42:10.557468 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-dde98827-4427-46aa-a706-de51f83e1b2b tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:42:10.558158 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-dde98827-4427-46aa-a706-de51f83e1b2b tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] [instance: c1d6ccec-fd9c-4303-b214-c247e85ec362] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:42:10.584834 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dde98827-4427-46aa-a706-de51f83e1b2b tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:42:10.586009 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dde98827-4427-46aa-a706-de51f83e1b2b tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:42:10.586723 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dde98827-4427-46aa-a706-de51f83e1b2b tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:42:10.588006 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dde98827-4427-46aa-a706-de51f83e1b2b tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:42:10.588746 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dde98827-4427-46aa-a706-de51f83e1b2b tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:42:10.589666 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dde98827-4427-46aa-a706-de51f83e1b2b tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:42:10.966288 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-dde98827-4427-46aa-a706-de51f83e1b2b tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a93fcc17345368cb2798065a354e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c3346c500e4487aac0c901cd41c761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:42:10.975672 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-dde98827-4427-46aa-a706-de51f83e1b2b tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] 10.222.0.40 "GET /compute/v2.1/servers/c1d6ccec-fd9c-4303-b214-c247e85ec362" status: 200 len: 1314 microversion: 2.1 time: 0.422797 Oct 26 13:42:10.981159 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3110/6182] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:42:10 2022] GET /compute/v2.1/servers/c1d6ccec-fd9c-4303-b214-c247e85ec362 => generated 1314 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:42:12.006482 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9e65365e-a2b4-4082-9318-ca23dfc443b3 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:42:12.007025 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9e65365e-a2b4-4082-9318-ca23dfc443b3 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] [instance: c1d6ccec-fd9c-4303-b214-c247e85ec362] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:42:12.022207 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9e65365e-a2b4-4082-9318-ca23dfc443b3 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:42:12.026311 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9e65365e-a2b4-4082-9318-ca23dfc443b3 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:42:12.026939 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9e65365e-a2b4-4082-9318-ca23dfc443b3 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:42:12.027842 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9e65365e-a2b4-4082-9318-ca23dfc443b3 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:42:12.031486 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9e65365e-a2b4-4082-9318-ca23dfc443b3 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:42:12.032196 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9e65365e-a2b4-4082-9318-ca23dfc443b3 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:42:12.588069 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9e65365e-a2b4-4082-9318-ca23dfc443b3 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a93fcc17345368cb2798065a354e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c3346c500e4487aac0c901cd41c761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:42:12.629120 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9e65365e-a2b4-4082-9318-ca23dfc443b3 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] 10.222.0.40 "GET /compute/v2.1/servers/c1d6ccec-fd9c-4303-b214-c247e85ec362" status: 200 len: 1314 microversion: 2.1 time: 0.632919 Oct 26 13:42:12.630002 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3073/6183] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:42:11 2022] GET /compute/v2.1/servers/c1d6ccec-fd9c-4303-b214-c247e85ec362 => generated 1314 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:42:13.052139 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-9d325cf3-0536-4014-8f43-675c4653f940 req-7d1f333c-24b0-4b04-a71d-73ad47c97335 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1d6ccec-fd9c-4303-b214-c247e85ec362", "tag": "1916afff-e4b8-42a0-ae72-524ff8288e7c"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:42:13.071936 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9d325cf3-0536-4014-8f43-675c4653f940 req-7d1f333c-24b0-4b04-a71d-73ad47c97335 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:42:13.072699 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9d325cf3-0536-4014-8f43-675c4653f940 req-7d1f333c-24b0-4b04-a71d-73ad47c97335 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:42:13.074254 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9d325cf3-0536-4014-8f43-675c4653f940 req-7d1f333c-24b0-4b04-a71d-73ad47c97335 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:42:13.099107 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-9d325cf3-0536-4014-8f43-675c4653f940 req-7d1f333c-24b0-4b04-a71d-73ad47c97335 service nova] Creating event network-changed:1916afff-e4b8-42a0-ae72-524ff8288e7c for instance c1d6ccec-fd9c-4303-b214-c247e85ec362 on n-h2-862686-1 Oct 26 13:42:13.114025 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-9d325cf3-0536-4014-8f43-675c4653f940 req-7d1f333c-24b0-4b04-a71d-73ad47c97335 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.649583 Oct 26 13:42:13.116715 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3111/6184] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:42:13.665090 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1111817e-1cf5-418a-b18d-9f19645bc45f tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:42:13.668264 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1111817e-1cf5-418a-b18d-9f19645bc45f tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] [instance: c1d6ccec-fd9c-4303-b214-c247e85ec362] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:42:13.685802 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1111817e-1cf5-418a-b18d-9f19645bc45f tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:42:13.686355 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1111817e-1cf5-418a-b18d-9f19645bc45f tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:42:13.686804 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1111817e-1cf5-418a-b18d-9f19645bc45f tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:42:13.688148 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1111817e-1cf5-418a-b18d-9f19645bc45f tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:42:13.688612 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1111817e-1cf5-418a-b18d-9f19645bc45f tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:42:13.689041 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1111817e-1cf5-418a-b18d-9f19645bc45f tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:42:13.976952 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1111817e-1cf5-418a-b18d-9f19645bc45f tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a93fcc17345368cb2798065a354e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c3346c500e4487aac0c901cd41c761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:42:13.988916 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1111817e-1cf5-418a-b18d-9f19645bc45f tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] 10.222.0.40 "GET /compute/v2.1/servers/c1d6ccec-fd9c-4303-b214-c247e85ec362" status: 200 len: 1314 microversion: 2.1 time: 0.336118 Oct 26 13:42:14.008281 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3074/6185] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:42:13 2022] GET /compute/v2.1/servers/c1d6ccec-fd9c-4303-b214-c247e85ec362 => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:42:15.022188 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-da9ae125-8b4a-41ce-b792-d333cc4e7b65 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:42:15.023988 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-da9ae125-8b4a-41ce-b792-d333cc4e7b65 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] [instance: c1d6ccec-fd9c-4303-b214-c247e85ec362] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:42:15.040237 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da9ae125-8b4a-41ce-b792-d333cc4e7b65 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:42:15.040237 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da9ae125-8b4a-41ce-b792-d333cc4e7b65 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:42:15.054755 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da9ae125-8b4a-41ce-b792-d333cc4e7b65 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:42:15.055639 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da9ae125-8b4a-41ce-b792-d333cc4e7b65 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:42:15.056241 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da9ae125-8b4a-41ce-b792-d333cc4e7b65 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:42:15.056604 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da9ae125-8b4a-41ce-b792-d333cc4e7b65 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:42:15.306571 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-da9ae125-8b4a-41ce-b792-d333cc4e7b65 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a93fcc17345368cb2798065a354e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c3346c500e4487aac0c901cd41c761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:42:15.323229 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-da9ae125-8b4a-41ce-b792-d333cc4e7b65 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] 10.222.0.40 "GET /compute/v2.1/servers/c1d6ccec-fd9c-4303-b214-c247e85ec362" status: 200 len: 1314 microversion: 2.1 time: 0.309313 Oct 26 13:42:15.341406 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3112/6186] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:42:15 2022] GET /compute/v2.1/servers/c1d6ccec-fd9c-4303-b214-c247e85ec362 => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:42:16.347478 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-59fd5622-378e-47b0-9861-7ac9389360c8 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:42:16.348092 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-59fd5622-378e-47b0-9861-7ac9389360c8 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] [instance: c1d6ccec-fd9c-4303-b214-c247e85ec362] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:42:16.362958 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59fd5622-378e-47b0-9861-7ac9389360c8 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:42:16.363471 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59fd5622-378e-47b0-9861-7ac9389360c8 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:42:16.363947 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59fd5622-378e-47b0-9861-7ac9389360c8 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:42:16.364730 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59fd5622-378e-47b0-9861-7ac9389360c8 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:42:16.365379 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59fd5622-378e-47b0-9861-7ac9389360c8 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:42:16.365992 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59fd5622-378e-47b0-9861-7ac9389360c8 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:42:16.622571 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-59fd5622-378e-47b0-9861-7ac9389360c8 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a93fcc17345368cb2798065a354e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c3346c500e4487aac0c901cd41c761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:42:16.632614 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-59fd5622-378e-47b0-9861-7ac9389360c8 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] 10.222.0.40 "GET /compute/v2.1/servers/c1d6ccec-fd9c-4303-b214-c247e85ec362" status: 200 len: 1314 microversion: 2.1 time: 0.289640 Oct 26 13:42:16.633205 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3075/6187] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:42:16 2022] GET /compute/v2.1/servers/c1d6ccec-fd9c-4303-b214-c247e85ec362 => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:42:16.858839 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:42:16.882600 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-efebefb9-9823-40fe-b9f6-2e24c5dcc57a req-cb7f2bdd-c7cb-4a16-aebe-b00fd16c0b6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1d6ccec-fd9c-4303-b214-c247e85ec362", "name": "network-vif-plugged", "status": "completed", "tag": "1916afff-e4b8-42a0-ae72-524ff8288e7c"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:42:16.913893 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-efebefb9-9823-40fe-b9f6-2e24c5dcc57a req-cb7f2bdd-c7cb-4a16-aebe-b00fd16c0b6f service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:42:16.914673 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-efebefb9-9823-40fe-b9f6-2e24c5dcc57a req-cb7f2bdd-c7cb-4a16-aebe-b00fd16c0b6f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:42:16.916104 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-efebefb9-9823-40fe-b9f6-2e24c5dcc57a req-cb7f2bdd-c7cb-4a16-aebe-b00fd16c0b6f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:42:16.958417 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-efebefb9-9823-40fe-b9f6-2e24c5dcc57a req-cb7f2bdd-c7cb-4a16-aebe-b00fd16c0b6f service nova] Creating event network-vif-plugged:1916afff-e4b8-42a0-ae72-524ff8288e7c for instance c1d6ccec-fd9c-4303-b214-c247e85ec362 on n-h2-862686-1 Oct 26 13:42:16.971273 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-efebefb9-9823-40fe-b9f6-2e24c5dcc57a req-cb7f2bdd-c7cb-4a16-aebe-b00fd16c0b6f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114005 Oct 26 13:42:16.975867 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3113/6188] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:42:17.657682 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-45366df4-0666-4ba7-8af7-f5c9919cc2c0 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:42:17.658221 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-45366df4-0666-4ba7-8af7-f5c9919cc2c0 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] [instance: c1d6ccec-fd9c-4303-b214-c247e85ec362] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:42:17.660164 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:42:17.677538 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-45366df4-0666-4ba7-8af7-f5c9919cc2c0 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:42:17.678047 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-45366df4-0666-4ba7-8af7-f5c9919cc2c0 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:42:17.678581 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-45366df4-0666-4ba7-8af7-f5c9919cc2c0 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:42:17.679559 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-45366df4-0666-4ba7-8af7-f5c9919cc2c0 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:42:17.680210 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-45366df4-0666-4ba7-8af7-f5c9919cc2c0 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:42:17.680836 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-45366df4-0666-4ba7-8af7-f5c9919cc2c0 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:42:17.992010 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-45366df4-0666-4ba7-8af7-f5c9919cc2c0 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a93fcc17345368cb2798065a354e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c3346c500e4487aac0c901cd41c761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:42:18.000378 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-45366df4-0666-4ba7-8af7-f5c9919cc2c0 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] 10.222.0.40 "GET /compute/v2.1/servers/c1d6ccec-fd9c-4303-b214-c247e85ec362" status: 200 len: 1314 microversion: 2.1 time: 0.348044 Oct 26 13:42:18.017386 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3076/6189] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:42:17 2022] GET /compute/v2.1/servers/c1d6ccec-fd9c-4303-b214-c247e85ec362 => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:42:19.022644 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=8 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:42:19.027889 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f8cf3e21-8694-4e95-a7bc-2e09d492c9b7 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:42:19.029126 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f8cf3e21-8694-4e95-a7bc-2e09d492c9b7 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] [instance: c1d6ccec-fd9c-4303-b214-c247e85ec362] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:42:19.043535 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8cf3e21-8694-4e95-a7bc-2e09d492c9b7 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:42:19.044283 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8cf3e21-8694-4e95-a7bc-2e09d492c9b7 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:42:19.045046 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8cf3e21-8694-4e95-a7bc-2e09d492c9b7 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:42:19.046370 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8cf3e21-8694-4e95-a7bc-2e09d492c9b7 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:42:19.047830 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8cf3e21-8694-4e95-a7bc-2e09d492c9b7 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:42:19.048568 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8cf3e21-8694-4e95-a7bc-2e09d492c9b7 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:42:19.393510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f8cf3e21-8694-4e95-a7bc-2e09d492c9b7 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a93fcc17345368cb2798065a354e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c3346c500e4487aac0c901cd41c761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:42:19.407590 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f8cf3e21-8694-4e95-a7bc-2e09d492c9b7 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] 10.222.0.40 "GET /compute/v2.1/servers/c1d6ccec-fd9c-4303-b214-c247e85ec362" status: 200 len: 1314 microversion: 2.1 time: 0.387325 Oct 26 13:42:19.408202 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3114/6190] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:42:19 2022] GET /compute/v2.1/servers/c1d6ccec-fd9c-4303-b214-c247e85ec362 => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:42:20.431418 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-851c1b74-9176-49ab-a8ed-af79c73cfbb1 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:42:20.432419 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-851c1b74-9176-49ab-a8ed-af79c73cfbb1 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] [instance: c1d6ccec-fd9c-4303-b214-c247e85ec362] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:42:20.442921 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-851c1b74-9176-49ab-a8ed-af79c73cfbb1 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:42:20.446006 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-851c1b74-9176-49ab-a8ed-af79c73cfbb1 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:42:20.446368 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-851c1b74-9176-49ab-a8ed-af79c73cfbb1 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:42:20.447157 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-851c1b74-9176-49ab-a8ed-af79c73cfbb1 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:42:20.453646 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-851c1b74-9176-49ab-a8ed-af79c73cfbb1 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:42:20.454290 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-851c1b74-9176-49ab-a8ed-af79c73cfbb1 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:42:20.782313 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-851c1b74-9176-49ab-a8ed-af79c73cfbb1 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a93fcc17345368cb2798065a354e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c3346c500e4487aac0c901cd41c761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:42:20.824010 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-851c1b74-9176-49ab-a8ed-af79c73cfbb1 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] 10.222.0.40 "GET /compute/v2.1/servers/c1d6ccec-fd9c-4303-b214-c247e85ec362" status: 200 len: 1463 microversion: 2.1 time: 0.386517 Oct 26 13:42:20.824742 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3077/6191] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:42:20 2022] GET /compute/v2.1/servers/c1d6ccec-fd9c-4303-b214-c247e85ec362 => generated 1463 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:42:20.922356 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9306ba65-f21a-4e16-9c10-418dad7313fa tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:42:20.923665 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9306ba65-f21a-4e16-9c10-418dad7313fa tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] [instance: c1d6ccec-fd9c-4303-b214-c247e85ec362] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:42:20.943126 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9306ba65-f21a-4e16-9c10-418dad7313fa tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:42:20.943552 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9306ba65-f21a-4e16-9c10-418dad7313fa tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:42:20.943966 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9306ba65-f21a-4e16-9c10-418dad7313fa tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:42:20.945639 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9306ba65-f21a-4e16-9c10-418dad7313fa tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:42:20.948540 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9306ba65-f21a-4e16-9c10-418dad7313fa tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:42:20.949237 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9306ba65-f21a-4e16-9c10-418dad7313fa tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:42:21.039026 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9306ba65-f21a-4e16-9c10-418dad7313fa tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] [instance: c1d6ccec-fd9c-4303-b214-c247e85ec362] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:42:21.251063 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9306ba65-f21a-4e16-9c10-418dad7313fa tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c1d6ccec-fd9c-4303-b214-c247e85ec362" status: 204 len: 0 microversion: 2.1 time: 0.333870 Oct 26 13:42:21.251718 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3115/6192] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:42:20 2022] DELETE /compute/v2.1/servers/c1d6ccec-fd9c-4303-b214-c247e85ec362 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:42:21.266227 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-716548ad-c794-4fce-b832-b30a22df94c4 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:42:21.266864 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-716548ad-c794-4fce-b832-b30a22df94c4 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] [instance: c1d6ccec-fd9c-4303-b214-c247e85ec362] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:42:21.282948 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-716548ad-c794-4fce-b832-b30a22df94c4 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:42:21.284379 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-716548ad-c794-4fce-b832-b30a22df94c4 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:42:21.284962 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-716548ad-c794-4fce-b832-b30a22df94c4 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:42:21.289030 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-716548ad-c794-4fce-b832-b30a22df94c4 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:42:21.291426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-716548ad-c794-4fce-b832-b30a22df94c4 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:42:21.292104 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-716548ad-c794-4fce-b832-b30a22df94c4 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:42:21.896775 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-716548ad-c794-4fce-b832-b30a22df94c4 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a93fcc17345368cb2798065a354e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c3346c500e4487aac0c901cd41c761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:42:21.920013 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-716548ad-c794-4fce-b832-b30a22df94c4 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] 10.222.0.40 "GET /compute/v2.1/servers/c1d6ccec-fd9c-4303-b214-c247e85ec362" status: 200 len: 1469 microversion: 2.1 time: 0.662783 Oct 26 13:42:21.921622 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3078/6193] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:42:21 2022] GET /compute/v2.1/servers/c1d6ccec-fd9c-4303-b214-c247e85ec362 => generated 1469 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:42:22.946555 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d20aeb5e-5af0-416c-b00f-433bb178ff60 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:42:22.948697 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d20aeb5e-5af0-416c-b00f-433bb178ff60 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] [instance: c1d6ccec-fd9c-4303-b214-c247e85ec362] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:42:22.964624 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d20aeb5e-5af0-416c-b00f-433bb178ff60 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:42:22.967122 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d20aeb5e-5af0-416c-b00f-433bb178ff60 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:42:22.968763 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d20aeb5e-5af0-416c-b00f-433bb178ff60 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:42:22.970968 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d20aeb5e-5af0-416c-b00f-433bb178ff60 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:42:22.972118 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d20aeb5e-5af0-416c-b00f-433bb178ff60 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:42:22.975845 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d20aeb5e-5af0-416c-b00f-433bb178ff60 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:42:23.199950 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d20aeb5e-5af0-416c-b00f-433bb178ff60 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a93fcc17345368cb2798065a354e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c3346c500e4487aac0c901cd41c761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:42:23.210363 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d20aeb5e-5af0-416c-b00f-433bb178ff60 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] 10.222.0.40 "GET /compute/v2.1/servers/c1d6ccec-fd9c-4303-b214-c247e85ec362" status: 200 len: 1469 microversion: 2.1 time: 0.268887 Oct 26 13:42:23.213680 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3116/6194] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:42:22 2022] GET /compute/v2.1/servers/c1d6ccec-fd9c-4303-b214-c247e85ec362 => generated 1469 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:42:23.953171 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-32df0040-8164-4ae9-92f3-e86b4fdbee04 req-cf5a20a3-2b9c-4603-a485-49bc5bde5534 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1d6ccec-fd9c-4303-b214-c247e85ec362", "name": "network-vif-deleted", "tag": "1916afff-e4b8-42a0-ae72-524ff8288e7c"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:42:23.990567 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-32df0040-8164-4ae9-92f3-e86b4fdbee04 req-cf5a20a3-2b9c-4603-a485-49bc5bde5534 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:42:23.991957 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-32df0040-8164-4ae9-92f3-e86b4fdbee04 req-cf5a20a3-2b9c-4603-a485-49bc5bde5534 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:42:23.992631 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-32df0040-8164-4ae9-92f3-e86b4fdbee04 req-cf5a20a3-2b9c-4603-a485-49bc5bde5534 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:42:24.052362 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-32df0040-8164-4ae9-92f3-e86b4fdbee04 req-cf5a20a3-2b9c-4603-a485-49bc5bde5534 service nova] Creating event network-vif-deleted:1916afff-e4b8-42a0-ae72-524ff8288e7c for instance c1d6ccec-fd9c-4303-b214-c247e85ec362 on n-h2-862686-1 Oct 26 13:42:24.060827 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-32df0040-8164-4ae9-92f3-e86b4fdbee04 req-cf5a20a3-2b9c-4603-a485-49bc5bde5534 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113672 Oct 26 13:42:24.067768 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3079/6195] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:42:24.248489 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ca2d2342-9222-418b-a555-dfb41bc0ca3a tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:42:24.249550 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ca2d2342-9222-418b-a555-dfb41bc0ca3a tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] [instance: c1d6ccec-fd9c-4303-b214-c247e85ec362] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:42:24.262170 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca2d2342-9222-418b-a555-dfb41bc0ca3a tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:42:24.262850 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca2d2342-9222-418b-a555-dfb41bc0ca3a tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:42:24.265288 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca2d2342-9222-418b-a555-dfb41bc0ca3a tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:42:24.269798 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca2d2342-9222-418b-a555-dfb41bc0ca3a tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:42:24.272576 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca2d2342-9222-418b-a555-dfb41bc0ca3a tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:42:24.273340 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca2d2342-9222-418b-a555-dfb41bc0ca3a tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:42:24.360704 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca2d2342-9222-418b-a555-dfb41bc0ca3a tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:42:24.373085 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca2d2342-9222-418b-a555-dfb41bc0ca3a tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:42:24.374892 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca2d2342-9222-418b-a555-dfb41bc0ca3a tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:42:24.377268 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-ca2d2342-9222-418b-a555-dfb41bc0ca3a tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lazy-loading 'fault' on Instance uuid c1d6ccec-fd9c-4303-b214-c247e85ec362 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:42:24.724229 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ca2d2342-9222-418b-a555-dfb41bc0ca3a tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990a93fcc17345368cb2798065a354e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c3346c500e4487aac0c901cd41c761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:42:24.747065 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ca2d2342-9222-418b-a555-dfb41bc0ca3a tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] 10.222.0.40 "GET /compute/v2.1/servers/c1d6ccec-fd9c-4303-b214-c247e85ec362" status: 200 len: 1304 microversion: 2.1 time: 0.509360 Oct 26 13:42:24.778092 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3117/6196] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:42:24 2022] GET /compute/v2.1/servers/c1d6ccec-fd9c-4303-b214-c247e85ec362 => generated 1304 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:42:25.786107 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-418afa8c-8107-458d-9dc3-84b92a4aee88 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:42:25.786833 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-418afa8c-8107-458d-9dc3-84b92a4aee88 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] [instance: c1d6ccec-fd9c-4303-b214-c247e85ec362] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:42:25.799920 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-418afa8c-8107-458d-9dc3-84b92a4aee88 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:42:25.800426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-418afa8c-8107-458d-9dc3-84b92a4aee88 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:42:25.804797 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-418afa8c-8107-458d-9dc3-84b92a4aee88 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:42:25.805706 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-418afa8c-8107-458d-9dc3-84b92a4aee88 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:42:25.806202 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-418afa8c-8107-458d-9dc3-84b92a4aee88 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:42:25.806987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-418afa8c-8107-458d-9dc3-84b92a4aee88 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:42:25.830633 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-418afa8c-8107-458d-9dc3-84b92a4aee88 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] HTTP exception thrown: Instance c1d6ccec-fd9c-4303-b214-c247e85ec362 could not be found. Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-418afa8c-8107-458d-9dc3-84b92a4aee88 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Request method failure captured: Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/c1d6ccec-fd9c-4303-b214-c247e85ec362 HTTP/1.1 Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTkpzvyxYBbM6C6wL130mziEptKDGf8pE-debHS1gGnNiegabeY5p6wv2num17cEFy3q26qDpeAeRfHbtWi4gNBdLDVViNE4y2E_KKRa9alhW32ER6eINsFfphzT2bvxBixRbQTvGJbM74ub0LrxKWOElq3RLHJq4CcnDtPqpGLcbiM Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 47c3346c500e4487aac0c901cd41c761 Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-VolumesNegativeTest-29107921 Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/47c3346c500e4487aac0c901cd41c761"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/47c3346c500e4487aac0c901cd41c761"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_47c3346c500e4487aac0c901cd41c761"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/47c3346c500e4487aac0c901cd41c761"}]}] Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-VolumesNegativeTest-29107921 Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 47c3346c500e4487aac0c901cd41c761 Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-VolumesNegativeTest-29107921 Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-VolumesNegativeTest-29107921-project Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 990a93fcc17345368cb2798065a354e2 Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-VolumesNegativeTest-29107921-project Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance c1d6ccec-fd9c-4303-b214-c247e85ec362 could not be found. Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'c1d6ccec-fd9c-4303-b214-c247e85ec362'} Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1d6ccec-fd9c-4303-b214-c247e85ec362 could not be found. Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1d6ccec-fd9c-4303-b214-c247e85ec362 could not be found. Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:42:25.841527 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:42:25.847677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:42:25.847677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:42:25.847677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:42:25.847677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:42:25.847677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:42:25.847677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1d6ccec-fd9c-4303-b214-c247e85ec362 could not be found. Oct 26 13:42:25.847677 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:42:25.847677 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-418afa8c-8107-458d-9dc3-84b92a4aee88 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] Returning 404 to user: Instance c1d6ccec-fd9c-4303-b214-c247e85ec362 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:42:25.847677 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-418afa8c-8107-458d-9dc3-84b92a4aee88 tempest-VolumesNegativeTest-29107921 tempest-VolumesNegativeTest-29107921-project] 10.222.0.40 "GET /compute/v2.1/servers/c1d6ccec-fd9c-4303-b214-c247e85ec362" status: 404 len: 111 microversion: 2.1 time: 0.065999 Oct 26 13:42:25.847677 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3080/6197] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:42:25 2022] GET /compute/v2.1/servers/c1d6ccec-fd9c-4303-b214-c247e85ec362 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:42:47.696598 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-467bd121-81b9-47f0-9b7a-6463c8d6dbac tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Action: 'create', calling method: .version_select at 0x7f67367f4160>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-142505396", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFd0YzMP+/hPKlnxGcz5lZa3dur5y7hlsUFNcqLp8ej/6kpOJvQrkis+A9rxH6otJAnOTwDTqruVGfUZLKFumvcI2XwhSICg9w9WMUXxsFti2wiiincDY89mOx24+3hP7A=="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:42:47.724637 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:42:47.725952 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:42:47.765976 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-467bd121-81b9-47f0-9b7a-6463c8d6dbac tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Getting quotas for project 8af2ca8f7890421180d124123db3387f. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:42:47.779536 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-467bd121-81b9-47f0-9b7a-6463c8d6dbac tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Getting quotas for user 3fe5aa8de6e24f1faf309f7e3e9a478c and project 8af2ca8f7890421180d124123db3387f. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:42:47.822086 n-d-862686-1 devstack@n-api.service[120598]: ERROR oslo.messaging._drivers.impl_rabbit [None req-467bd121-81b9-47f0-9b7a-6463c8d6dbac tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [0362c2d3-00d1-4a1b-ad97-c2830bfc3f47] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 26 13:42:48.831314 n-d-862686-1 devstack@n-api.service[120598]: INFO oslo.messaging._drivers.impl_rabbit [None req-467bd121-81b9-47f0-9b7a-6463c8d6dbac tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [0362c2d3-00d1-4a1b-ad97-c2830bfc3f47] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 55372. Oct 26 13:42:48.866694 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-467bd121-81b9-47f0-9b7a-6463c8d6dbac tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.177134 Oct 26 13:42:48.867693 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3118/6198] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 13:42:47 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:42:49.915290 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=22 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:42:49.917411 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=46 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:42:50.278576 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d933b269-dcd0-4ba4-a56f-f5f645fdd42a tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Action: 'create', calling method: .version_select at 0x7f6732144940>, body: {"keypair": {"name": "tempest-TestServerBasicOps-209691635", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI431T+PsUCCRRVcsw+LRWEC6dFewx2NFNdRIYEaFdvvmCPDy9rt3JaMiX9qfC86UoYNdoQGwDb6mERAcQKqQR1SrPijrvLV4jHmrVvvzDXxQ1EoeVduz5ZeJdbIqHfVGw=="}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:42:50.338271 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-d933b269-dcd0-4ba4-a56f-f5f645fdd42a tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Getting quotas for project 0ffe02c0779d465f93762150cb94114f. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:42:50.353847 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-d933b269-dcd0-4ba4-a56f-f5f645fdd42a tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Getting quotas for user 725949c28f9742beb622b98e84c67646 and project 0ffe02c0779d465f93762150cb94114f. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:42:50.412838 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d933b269-dcd0-4ba4-a56f-f5f645fdd42a tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.503721 Oct 26 13:42:50.420644 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3081/6199] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 13:42:49 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:42:53.913910 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-42fceaad-6408-4c97-b409-db6fcf39c445 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-505892550", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "d0c80626-0c17-4e72-a908-ec24858ee9a0"}], "key_name": "tempest-TestNetworkBasicOps-142505396", "security_groups": [{"name": "tempest-secgroup-smoke-16003444"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:42:54.164337 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-42fceaad-6408-4c97-b409-db6fcf39c445 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] validate_networks() for [('d0c80626-0c17-4e72-a908-ec24858ee9a0', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:42:54.366761 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-22e1e694-aca6-4467-b7f5-fb02a9ca2c6c tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-897444992", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-209691635", "security_groups": [{"name": "tempest-secgroup-smoke-974620096"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "0af9112d-c42a-4448-a71f-e72c7c686d11"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:42:54.690284 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-22e1e694-aca6-4467-b7f5-fb02a9ca2c6c tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] validate_networks() for [('0af9112d-c42a-4448-a71f-e72c7c686d11', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:42:55.473638 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-22e1e694-aca6-4467-b7f5-fb02a9ca2c6c tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Getting quotas for project 0ffe02c0779d465f93762150cb94114f. Resources: dict_keys(['metadata_items']) {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:42:55.479441 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-22e1e694-aca6-4467-b7f5-fb02a9ca2c6c tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Getting quotas for user 725949c28f9742beb622b98e84c67646 and project 0ffe02c0779d465f93762150cb94114f. Resources: dict_keys(['metadata_items']) {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:42:55.494671 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-22e1e694-aca6-4467-b7f5-fb02a9ca2c6c tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:42:55.495092 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-22e1e694-aca6-4467-b7f5-fb02a9ca2c6c tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:42:55.495569 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-22e1e694-aca6-4467-b7f5-fb02a9ca2c6c tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:42:55.495979 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-22e1e694-aca6-4467-b7f5-fb02a9ca2c6c tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:42:55.496544 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-22e1e694-aca6-4467-b7f5-fb02a9ca2c6c tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:42:55.506307 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22e1e694-aca6-4467-b7f5-fb02a9ca2c6c tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:42:55.507202 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22e1e694-aca6-4467-b7f5-fb02a9ca2c6c tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:42:55.507762 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22e1e694-aca6-4467-b7f5-fb02a9ca2c6c tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:42:55.508516 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22e1e694-aca6-4467-b7f5-fb02a9ca2c6c tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:42:55.509193 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22e1e694-aca6-4467-b7f5-fb02a9ca2c6c tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:42:55.509655 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22e1e694-aca6-4467-b7f5-fb02a9ca2c6c tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:42:55.534106 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-22e1e694-aca6-4467-b7f5-fb02a9ca2c6c tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Getting quotas for project 0ffe02c0779d465f93762150cb94114f. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:42:55.540700 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-22e1e694-aca6-4467-b7f5-fb02a9ca2c6c tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Getting quotas for user 725949c28f9742beb622b98e84c67646 and project 0ffe02c0779d465f93762150cb94114f. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:42:55.554914 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-22e1e694-aca6-4467-b7f5-fb02a9ca2c6c tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:42:55.557225 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-22e1e694-aca6-4467-b7f5-fb02a9ca2c6c tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] [instance: 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:42:55.623144 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-22e1e694-aca6-4467-b7f5-fb02a9ca2c6c tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.265985 Oct 26 13:42:55.625968 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3082/6200] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:42:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 1270 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:42:55.638549 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6e7c9e29-fcdf-4f71-8415-f12a70319908 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:42:55.642279 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6e7c9e29-fcdf-4f71-8415-f12a70319908 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] [instance: 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:42:55.717378 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6e7c9e29-fcdf-4f71-8415-f12a70319908 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725949c28f9742beb622b98e84c67646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffe02c0779d465f93762150cb94114f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:42:55.735300 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6e7c9e29-fcdf-4f71-8415-f12a70319908 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] 10.222.0.40 "GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce" status: 200 len: 1301 microversion: 2.1 time: 0.101750 Oct 26 13:42:55.740744 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3083/6201] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:42:55 2022] GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce => generated 1301 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:42:55.950616 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-42fceaad-6408-4c97-b409-db6fcf39c445 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:42:55.951556 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-42fceaad-6408-4c97-b409-db6fcf39c445 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:42:55.952753 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-42fceaad-6408-4c97-b409-db6fcf39c445 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:42:55.954135 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-42fceaad-6408-4c97-b409-db6fcf39c445 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:42:55.954927 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-42fceaad-6408-4c97-b409-db6fcf39c445 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:42:55.966438 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42fceaad-6408-4c97-b409-db6fcf39c445 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:42:55.967150 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42fceaad-6408-4c97-b409-db6fcf39c445 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:42:55.968033 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42fceaad-6408-4c97-b409-db6fcf39c445 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:42:55.969584 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42fceaad-6408-4c97-b409-db6fcf39c445 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:42:55.970582 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42fceaad-6408-4c97-b409-db6fcf39c445 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:42:55.971213 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42fceaad-6408-4c97-b409-db6fcf39c445 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:42:55.991627 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-42fceaad-6408-4c97-b409-db6fcf39c445 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Getting quotas for project 8af2ca8f7890421180d124123db3387f. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:42:55.998934 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-42fceaad-6408-4c97-b409-db6fcf39c445 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Getting quotas for user 3fe5aa8de6e24f1faf309f7e3e9a478c and project 8af2ca8f7890421180d124123db3387f. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:42:56.018185 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-42fceaad-6408-4c97-b409-db6fcf39c445 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:42:56.021278 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-42fceaad-6408-4c97-b409-db6fcf39c445 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: 2afb9959-a444-4fe1-802b-fdf00cb7fca1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:42:56.102772 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-42fceaad-6408-4c97-b409-db6fcf39c445 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.193198 Oct 26 13:42:56.106285 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3119/6202] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:42:53 2022] POST /compute/v2.1/servers => generated 404 bytes in 2197 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:42:56.119491 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-079ea855-7e66-4dde-bc71-411bb2a801a9 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:42:56.120527 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-079ea855-7e66-4dde-bc71-411bb2a801a9 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: 2afb9959-a444-4fe1-802b-fdf00cb7fca1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:42:56.274858 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-079ea855-7e66-4dde-bc71-411bb2a801a9 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe5aa8de6e24f1faf309f7e3e9a478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2ca8f7890421180d124123db3387f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:42:56.285911 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-079ea855-7e66-4dde-bc71-411bb2a801a9 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/2afb9959-a444-4fe1-802b-fdf00cb7fca1" status: 200 len: 1247 microversion: 2.1 time: 0.171242 Oct 26 13:42:56.286554 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3084/6203] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:42:56 2022] GET /compute/v2.1/servers/2afb9959-a444-4fe1-802b-fdf00cb7fca1 => generated 1247 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:42:56.765227 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5d7ba3ac-9194-4f80-a639-8beab992c8e7 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:42:56.766211 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5d7ba3ac-9194-4f80-a639-8beab992c8e7 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] [instance: 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:42:56.804598 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5d7ba3ac-9194-4f80-a639-8beab992c8e7 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:42:56.809997 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5d7ba3ac-9194-4f80-a639-8beab992c8e7 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:42:56.809997 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5d7ba3ac-9194-4f80-a639-8beab992c8e7 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:42:56.811389 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5d7ba3ac-9194-4f80-a639-8beab992c8e7 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:42:56.816639 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5d7ba3ac-9194-4f80-a639-8beab992c8e7 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:42:56.818541 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5d7ba3ac-9194-4f80-a639-8beab992c8e7 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:42:57.038831 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5d7ba3ac-9194-4f80-a639-8beab992c8e7 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725949c28f9742beb622b98e84c67646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffe02c0779d465f93762150cb94114f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:42:57.050134 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5d7ba3ac-9194-4f80-a639-8beab992c8e7 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] 10.222.0.40 "GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce" status: 200 len: 1353 microversion: 2.1 time: 0.293656 Oct 26 13:42:57.085546 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3120/6204] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:42:56 2022] GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce => generated 1353 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:42:57.321217 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c7e0605a-067d-42a2-964c-ace03259ffa3 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:42:57.321933 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c7e0605a-067d-42a2-964c-ace03259ffa3 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: 2afb9959-a444-4fe1-802b-fdf00cb7fca1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:42:57.347952 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c7e0605a-067d-42a2-964c-ace03259ffa3 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:42:57.352652 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c7e0605a-067d-42a2-964c-ace03259ffa3 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:42:57.355640 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c7e0605a-067d-42a2-964c-ace03259ffa3 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:42:57.357860 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c7e0605a-067d-42a2-964c-ace03259ffa3 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:42:57.360575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c7e0605a-067d-42a2-964c-ace03259ffa3 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:42:57.361099 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c7e0605a-067d-42a2-964c-ace03259ffa3 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:42:57.721669 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c7e0605a-067d-42a2-964c-ace03259ffa3 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe5aa8de6e24f1faf309f7e3e9a478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2ca8f7890421180d124123db3387f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:42:57.735645 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c7e0605a-067d-42a2-964c-ace03259ffa3 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/2afb9959-a444-4fe1-802b-fdf00cb7fca1" status: 200 len: 1251 microversion: 2.1 time: 0.424968 Oct 26 13:42:57.736356 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3085/6205] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:42:57 2022] GET /compute/v2.1/servers/2afb9959-a444-4fe1-802b-fdf00cb7fca1 => generated 1251 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:42:58.082127 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a76adced-c202-4d69-83cf-24341751791f tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:42:58.082748 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a76adced-c202-4d69-83cf-24341751791f tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] [instance: 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:42:58.095920 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a76adced-c202-4d69-83cf-24341751791f tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:42:58.096415 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a76adced-c202-4d69-83cf-24341751791f tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:42:58.096848 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a76adced-c202-4d69-83cf-24341751791f tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:42:58.100039 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a76adced-c202-4d69-83cf-24341751791f tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:42:58.100580 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a76adced-c202-4d69-83cf-24341751791f tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:42:58.101021 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a76adced-c202-4d69-83cf-24341751791f tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:42:58.232071 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a76adced-c202-4d69-83cf-24341751791f tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725949c28f9742beb622b98e84c67646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffe02c0779d465f93762150cb94114f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:42:58.242788 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a76adced-c202-4d69-83cf-24341751791f tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] 10.222.0.40 "GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce" status: 200 len: 1359 microversion: 2.1 time: 0.170479 Oct 26 13:42:58.244578 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3121/6206] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:42:58 2022] GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:42:58.771345 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2949da5f-ab1c-42de-b840-77ae245be5b2 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:42:58.772849 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2949da5f-ab1c-42de-b840-77ae245be5b2 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: 2afb9959-a444-4fe1-802b-fdf00cb7fca1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:42:58.787223 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2949da5f-ab1c-42de-b840-77ae245be5b2 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:42:58.790937 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2949da5f-ab1c-42de-b840-77ae245be5b2 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:42:58.792521 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2949da5f-ab1c-42de-b840-77ae245be5b2 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:42:58.794690 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2949da5f-ab1c-42de-b840-77ae245be5b2 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:42:58.796795 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2949da5f-ab1c-42de-b840-77ae245be5b2 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:42:58.798798 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2949da5f-ab1c-42de-b840-77ae245be5b2 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:42:59.273297 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4defcf70-a99d-4526-a528-a8c889559bcd tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:42:59.275500 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4defcf70-a99d-4526-a528-a8c889559bcd tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] [instance: 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:42:59.294248 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4defcf70-a99d-4526-a528-a8c889559bcd tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:42:59.300795 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4defcf70-a99d-4526-a528-a8c889559bcd tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:42:59.301576 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4defcf70-a99d-4526-a528-a8c889559bcd tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:42:59.305188 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4defcf70-a99d-4526-a528-a8c889559bcd tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:42:59.306083 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4defcf70-a99d-4526-a528-a8c889559bcd tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:42:59.307782 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4defcf70-a99d-4526-a528-a8c889559bcd tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:42:59.490717 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4defcf70-a99d-4526-a528-a8c889559bcd tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725949c28f9742beb622b98e84c67646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffe02c0779d465f93762150cb94114f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:42:59.501662 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4defcf70-a99d-4526-a528-a8c889559bcd tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] 10.222.0.40 "GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce" status: 200 len: 1359 microversion: 2.1 time: 0.233779 Oct 26 13:42:59.504209 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3122/6207] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:42:59 2022] GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce => generated 1359 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:43:00.082232 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2949da5f-ab1c-42de-b840-77ae245be5b2 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe5aa8de6e24f1faf309f7e3e9a478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2ca8f7890421180d124123db3387f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:43:00.091528 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2949da5f-ab1c-42de-b840-77ae245be5b2 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/2afb9959-a444-4fe1-802b-fdf00cb7fca1" status: 200 len: 1305 microversion: 2.1 time: 1.327015 Oct 26 13:43:00.094482 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3086/6208] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:42:58 2022] GET /compute/v2.1/servers/2afb9959-a444-4fe1-802b-fdf00cb7fca1 => generated 1305 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:43:00.526867 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d748c7af-36ee-4c98-bb67-f2be6b6f250f tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:00.527486 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d748c7af-36ee-4c98-bb67-f2be6b6f250f tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] [instance: 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:00.536521 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d748c7af-36ee-4c98-bb67-f2be6b6f250f tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:00.537021 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d748c7af-36ee-4c98-bb67-f2be6b6f250f tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:00.537472 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d748c7af-36ee-4c98-bb67-f2be6b6f250f tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:00.538216 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d748c7af-36ee-4c98-bb67-f2be6b6f250f tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:00.538684 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d748c7af-36ee-4c98-bb67-f2be6b6f250f tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:00.539106 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d748c7af-36ee-4c98-bb67-f2be6b6f250f tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:00.920631 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d748c7af-36ee-4c98-bb67-f2be6b6f250f tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725949c28f9742beb622b98e84c67646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffe02c0779d465f93762150cb94114f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:43:00.938217 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d748c7af-36ee-4c98-bb67-f2be6b6f250f tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] 10.222.0.40 "GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce" status: 200 len: 1359 microversion: 2.1 time: 0.416113 Oct 26 13:43:00.939164 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3123/6209] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:00 2022] GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce => generated 1359 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:43:01.119432 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b91e5777-b18e-43c5-819b-d78655a0c7da tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:01.120606 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b91e5777-b18e-43c5-819b-d78655a0c7da tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: 2afb9959-a444-4fe1-802b-fdf00cb7fca1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:01.139255 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b91e5777-b18e-43c5-819b-d78655a0c7da tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:01.147685 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b91e5777-b18e-43c5-819b-d78655a0c7da tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:01.148817 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b91e5777-b18e-43c5-819b-d78655a0c7da tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:01.149857 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b91e5777-b18e-43c5-819b-d78655a0c7da tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:01.151669 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b91e5777-b18e-43c5-819b-d78655a0c7da tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:01.152700 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b91e5777-b18e-43c5-819b-d78655a0c7da tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:01.473767 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b91e5777-b18e-43c5-819b-d78655a0c7da tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe5aa8de6e24f1faf309f7e3e9a478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2ca8f7890421180d124123db3387f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:43:01.493766 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b91e5777-b18e-43c5-819b-d78655a0c7da tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/2afb9959-a444-4fe1-802b-fdf00cb7fca1" status: 200 len: 1305 microversion: 2.1 time: 0.370111 Oct 26 13:43:01.494748 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3087/6210] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:01 2022] GET /compute/v2.1/servers/2afb9959-a444-4fe1-802b-fdf00cb7fca1 => generated 1305 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:43:01.971866 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f879a9dc-36e9-4173-8a83-74b03383ea3c tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:01.973475 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f879a9dc-36e9-4173-8a83-74b03383ea3c tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] [instance: 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:01.998012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f879a9dc-36e9-4173-8a83-74b03383ea3c tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:02.006892 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f879a9dc-36e9-4173-8a83-74b03383ea3c tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:02.007467 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f879a9dc-36e9-4173-8a83-74b03383ea3c tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:02.008391 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f879a9dc-36e9-4173-8a83-74b03383ea3c tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:02.008910 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f879a9dc-36e9-4173-8a83-74b03383ea3c tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:02.009376 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f879a9dc-36e9-4173-8a83-74b03383ea3c tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:02.523432 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ac2d2b64-83fe-4979-8b5c-687d105f6802 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:02.524072 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ac2d2b64-83fe-4979-8b5c-687d105f6802 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: 2afb9959-a444-4fe1-802b-fdf00cb7fca1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:02.543013 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ac2d2b64-83fe-4979-8b5c-687d105f6802 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:02.547316 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ac2d2b64-83fe-4979-8b5c-687d105f6802 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:02.547853 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ac2d2b64-83fe-4979-8b5c-687d105f6802 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:02.550974 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ac2d2b64-83fe-4979-8b5c-687d105f6802 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:02.551906 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ac2d2b64-83fe-4979-8b5c-687d105f6802 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:02.552556 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ac2d2b64-83fe-4979-8b5c-687d105f6802 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:02.984642 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ac2d2b64-83fe-4979-8b5c-687d105f6802 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe5aa8de6e24f1faf309f7e3e9a478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2ca8f7890421180d124123db3387f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:43:02.994572 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ac2d2b64-83fe-4979-8b5c-687d105f6802 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/2afb9959-a444-4fe1-802b-fdf00cb7fca1" status: 200 len: 1371 microversion: 2.1 time: 0.478019 Oct 26 13:43:02.995191 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3088/6211] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:02 2022] GET /compute/v2.1/servers/2afb9959-a444-4fe1-802b-fdf00cb7fca1 => generated 1371 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:43:03.754131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f879a9dc-36e9-4173-8a83-74b03383ea3c tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725949c28f9742beb622b98e84c67646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffe02c0779d465f93762150cb94114f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:43:03.766995 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f879a9dc-36e9-4173-8a83-74b03383ea3c tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] 10.222.0.40 "GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce" status: 200 len: 1426 microversion: 2.1 time: 1.799558 Oct 26 13:43:03.767897 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3124/6212] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:01 2022] GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce => generated 1426 bytes in 1805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:43:04.024643 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-96ccaa57-07ad-4bb3-b583-2b072c0f6423 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:04.025412 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-96ccaa57-07ad-4bb3-b583-2b072c0f6423 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: 2afb9959-a444-4fe1-802b-fdf00cb7fca1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:04.038911 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96ccaa57-07ad-4bb3-b583-2b072c0f6423 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:04.041896 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96ccaa57-07ad-4bb3-b583-2b072c0f6423 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:04.045021 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96ccaa57-07ad-4bb3-b583-2b072c0f6423 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:04.048576 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96ccaa57-07ad-4bb3-b583-2b072c0f6423 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:04.049404 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96ccaa57-07ad-4bb3-b583-2b072c0f6423 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:04.051699 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96ccaa57-07ad-4bb3-b583-2b072c0f6423 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:04.793048 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1adc294b-ec5b-4c2a-b335-6587435a9b12 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:04.793550 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1adc294b-ec5b-4c2a-b335-6587435a9b12 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] [instance: 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:04.806016 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1adc294b-ec5b-4c2a-b335-6587435a9b12 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:04.813873 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1adc294b-ec5b-4c2a-b335-6587435a9b12 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:04.814528 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1adc294b-ec5b-4c2a-b335-6587435a9b12 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:04.815394 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1adc294b-ec5b-4c2a-b335-6587435a9b12 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:04.815951 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1adc294b-ec5b-4c2a-b335-6587435a9b12 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:04.816460 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1adc294b-ec5b-4c2a-b335-6587435a9b12 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:04.912929 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-96ccaa57-07ad-4bb3-b583-2b072c0f6423 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe5aa8de6e24f1faf309f7e3e9a478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2ca8f7890421180d124123db3387f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:43:04.921610 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-96ccaa57-07ad-4bb3-b583-2b072c0f6423 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/2afb9959-a444-4fe1-802b-fdf00cb7fca1" status: 200 len: 1371 microversion: 2.1 time: 0.902584 Oct 26 13:43:04.922539 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3089/6213] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:04 2022] GET /compute/v2.1/servers/2afb9959-a444-4fe1-802b-fdf00cb7fca1 => generated 1371 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:43:05.079316 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-adb3f390-52b3-485a-b446-6cd9ddeb797c req-6e8a7f73-2ad0-4777-a23f-6fbf0be798bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce", "tag": "88ca3dcc-b3e2-41c7-9aeb-cb461f5a8f97"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:43:05.102628 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-adb3f390-52b3-485a-b446-6cd9ddeb797c req-6e8a7f73-2ad0-4777-a23f-6fbf0be798bc service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:05.121885 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-adb3f390-52b3-485a-b446-6cd9ddeb797c req-6e8a7f73-2ad0-4777-a23f-6fbf0be798bc service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:05.124997 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-adb3f390-52b3-485a-b446-6cd9ddeb797c req-6e8a7f73-2ad0-4777-a23f-6fbf0be798bc service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:05.137596 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-adb3f390-52b3-485a-b446-6cd9ddeb797c req-6e8a7f73-2ad0-4777-a23f-6fbf0be798bc service nova] Creating event network-changed:88ca3dcc-b3e2-41c7-9aeb-cb461f5a8f97 for instance 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce on n-h2-862686-1 Oct 26 13:43:05.145206 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-adb3f390-52b3-485a-b446-6cd9ddeb797c req-6e8a7f73-2ad0-4777-a23f-6fbf0be798bc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070768 Oct 26 13:43:05.146040 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3090/6214] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:43:05.296054 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1adc294b-ec5b-4c2a-b335-6587435a9b12 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725949c28f9742beb622b98e84c67646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffe02c0779d465f93762150cb94114f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:43:05.310290 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1adc294b-ec5b-4c2a-b335-6587435a9b12 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] 10.222.0.40 "GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce" status: 200 len: 1426 microversion: 2.1 time: 0.521656 Oct 26 13:43:05.310912 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3125/6215] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:04 2022] GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce => generated 1426 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:43:05.886264 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:43:05.951098 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6d214bf0-41bc-46ec-ac9d-b9c0abb1c5b2 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:05.952249 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6d214bf0-41bc-46ec-ac9d-b9c0abb1c5b2 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: 2afb9959-a444-4fe1-802b-fdf00cb7fca1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:05.968691 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d214bf0-41bc-46ec-ac9d-b9c0abb1c5b2 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:05.969199 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d214bf0-41bc-46ec-ac9d-b9c0abb1c5b2 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:05.977454 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d214bf0-41bc-46ec-ac9d-b9c0abb1c5b2 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:06.012532 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d214bf0-41bc-46ec-ac9d-b9c0abb1c5b2 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:06.031012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d214bf0-41bc-46ec-ac9d-b9c0abb1c5b2 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:06.031520 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d214bf0-41bc-46ec-ac9d-b9c0abb1c5b2 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:06.032021 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:43:06.037175 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=10 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:43:06.279312 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=18 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:43:06.346475 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fa87c893-afd7-4d6b-9c8b-bc7ed68ad8d4 tempest-TestAggregatesBasicOps-1345961877 tempest-TestAggregatesBasicOps-1345961877-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-177328725", "availability_zone": "foo_zone"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:43:06.392725 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.aggregate [None req-fa87c893-afd7-4d6b-9c8b-bc7ed68ad8d4 tempest-TestAggregatesBasicOps-1345961877 tempest-TestAggregatesBasicOps-1345961877-project-admin] Generated uuid 2c017bfe-6ab8-48d7-b0a9-4d5a8a57e648 for aggregate {{(pid=120597) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 26 13:43:06.462903 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fa87c893-afd7-4d6b-9c8b-bc7ed68ad8d4 tempest-TestAggregatesBasicOps-1345961877 tempest-TestAggregatesBasicOps-1345961877-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.585941 Oct 26 13:43:06.464774 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3091/6216] 10.222.0.40 () {60 vars in 1164 bytes} [Wed Oct 26 13:43:05 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:43:06.472437 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-63779650-ed0b-4a63-9ed1-420e292a3b5d tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:06.473191 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-63779650-ed0b-4a63-9ed1-420e292a3b5d tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] [instance: 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:06.482875 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-63779650-ed0b-4a63-9ed1-420e292a3b5d tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:06.485040 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-63779650-ed0b-4a63-9ed1-420e292a3b5d tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:06.485762 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-63779650-ed0b-4a63-9ed1-420e292a3b5d tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:06.486676 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-63779650-ed0b-4a63-9ed1-420e292a3b5d tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:06.487771 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-63779650-ed0b-4a63-9ed1-420e292a3b5d tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:06.488389 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-63779650-ed0b-4a63-9ed1-420e292a3b5d tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:06.606631 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6d214bf0-41bc-46ec-ac9d-b9c0abb1c5b2 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe5aa8de6e24f1faf309f7e3e9a478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2ca8f7890421180d124123db3387f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:43:06.621225 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6d214bf0-41bc-46ec-ac9d-b9c0abb1c5b2 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/2afb9959-a444-4fe1-802b-fdf00cb7fca1" status: 200 len: 1371 microversion: 2.1 time: 0.672385 Oct 26 13:43:06.629531 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3126/6217] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:05 2022] GET /compute/v2.1/servers/2afb9959-a444-4fe1-802b-fdf00cb7fca1 => generated 1371 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:43:06.634671 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-72b2485a-97f7-4e82-bc40-9b79ec53bde4 tempest-TestAggregatesBasicOps-1345961877 tempest-TestAggregatesBasicOps-1345961877-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:43:06.718641 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-72b2485a-97f7-4e82-bc40-9b79ec53bde4 tempest-TestAggregatesBasicOps-1345961877 tempest-TestAggregatesBasicOps-1345961877-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.093911 Oct 26 13:43:06.719963 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3127/6218] 10.222.0.40 () {60 vars in 1194 bytes} [Wed Oct 26 13:43:06 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:43:06.720618 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-63779650-ed0b-4a63-9ed1-420e292a3b5d tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725949c28f9742beb622b98e84c67646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffe02c0779d465f93762150cb94114f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:43:06.735069 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-63779650-ed0b-4a63-9ed1-420e292a3b5d tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] 10.222.0.40 "GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce" status: 200 len: 1426 microversion: 2.1 time: 0.268687 Oct 26 13:43:06.738280 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3092/6219] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:06 2022] GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce => generated 1426 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:43:06.739414 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b65a4831-ead2-4d53-8393-5ef09c1c16d6 tempest-TestAggregatesBasicOps-1345961877 tempest-TestAggregatesBasicOps-1345961877-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:06.744539 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b65a4831-ead2-4d53-8393-5ef09c1c16d6 tempest-TestAggregatesBasicOps-1345961877 tempest-TestAggregatesBasicOps-1345961877-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:06.745131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b65a4831-ead2-4d53-8393-5ef09c1c16d6 tempest-TestAggregatesBasicOps-1345961877 tempest-TestAggregatesBasicOps-1345961877-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:06.745608 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b65a4831-ead2-4d53-8393-5ef09c1c16d6 tempest-TestAggregatesBasicOps-1345961877 tempest-TestAggregatesBasicOps-1345961877-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:06.746553 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b65a4831-ead2-4d53-8393-5ef09c1c16d6 tempest-TestAggregatesBasicOps-1345961877 tempest-TestAggregatesBasicOps-1345961877-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:06.747801 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b65a4831-ead2-4d53-8393-5ef09c1c16d6 tempest-TestAggregatesBasicOps-1345961877 tempest-TestAggregatesBasicOps-1345961877-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:06.749204 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b65a4831-ead2-4d53-8393-5ef09c1c16d6 tempest-TestAggregatesBasicOps-1345961877 tempest-TestAggregatesBasicOps-1345961877-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:06.784355 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b65a4831-ead2-4d53-8393-5ef09c1c16d6 tempest-TestAggregatesBasicOps-1345961877 tempest-TestAggregatesBasicOps-1345961877-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.054598 Oct 26 13:43:06.785308 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3128/6220] 10.222.0.40 () {58 vars in 1176 bytes} [Wed Oct 26 13:43:06 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:43:06.801214 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-88cc7a95-3cb2-45fd-81b2-977b2138c1cf tempest-TestAggregatesBasicOps-1345961877 tempest-TestAggregatesBasicOps-1345961877-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:06.813241 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-88cc7a95-3cb2-45fd-81b2-977b2138c1cf tempest-TestAggregatesBasicOps-1345961877 tempest-TestAggregatesBasicOps-1345961877-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.017372 Oct 26 13:43:06.822217 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3093/6221] 10.222.0.40 () {58 vars in 1143 bytes} [Wed Oct 26 13:43:06 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:43:06.828415 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2e84aa4b-2603-4d36-967d-287c9ec4a696 tempest-TestAggregatesBasicOps-1345961877 tempest-TestAggregatesBasicOps-1345961877-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862686-1"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:43:06.847825 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e84aa4b-2603-4d36-967d-287c9ec4a696 tempest-TestAggregatesBasicOps-1345961877 tempest-TestAggregatesBasicOps-1345961877-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:06.848827 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e84aa4b-2603-4d36-967d-287c9ec4a696 tempest-TestAggregatesBasicOps-1345961877 tempest-TestAggregatesBasicOps-1345961877-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:06.849751 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e84aa4b-2603-4d36-967d-287c9ec4a696 tempest-TestAggregatesBasicOps-1345961877 tempest-TestAggregatesBasicOps-1345961877-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:07.181040 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-3fa4e4a6-dce4-4d8e-8437-6825af1a101b req-7678740f-7abd-4dfe-948f-fad3170bc89f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2afb9959-a444-4fe1-802b-fdf00cb7fca1", "tag": "6a36232d-7783-45c8-b2fd-dab0cd450464"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:43:07.208819 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-3fa4e4a6-dce4-4d8e-8437-6825af1a101b req-7678740f-7abd-4dfe-948f-fad3170bc89f service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:07.209427 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-3fa4e4a6-dce4-4d8e-8437-6825af1a101b req-7678740f-7abd-4dfe-948f-fad3170bc89f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:07.209985 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-3fa4e4a6-dce4-4d8e-8437-6825af1a101b req-7678740f-7abd-4dfe-948f-fad3170bc89f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:07.235712 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-3fa4e4a6-dce4-4d8e-8437-6825af1a101b req-7678740f-7abd-4dfe-948f-fad3170bc89f service nova] Creating event network-changed:6a36232d-7783-45c8-b2fd-dab0cd450464 for instance 2afb9959-a444-4fe1-802b-fdf00cb7fca1 on n-h2-862686-1 Oct 26 13:43:07.245835 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-3fa4e4a6-dce4-4d8e-8437-6825af1a101b req-7678740f-7abd-4dfe-948f-fad3170bc89f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065252 Oct 26 13:43:07.246574 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3094/6222] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:43:07.258090 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2e84aa4b-2603-4d36-967d-287c9ec4a696 tempest-TestAggregatesBasicOps-1345961877 tempest-TestAggregatesBasicOps-1345961877-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.434536 Oct 26 13:43:07.259405 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3129/6223] 10.222.0.40 () {60 vars in 1194 bytes} [Wed Oct 26 13:43:06 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:43:07.272185 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2df2f6d9-7396-4915-90fb-7ab665a5e2de tempest-TestAggregatesBasicOps-1345961877 tempest-TestAggregatesBasicOps-1345961877-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:07.280906 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2df2f6d9-7396-4915-90fb-7ab665a5e2de tempest-TestAggregatesBasicOps-1345961877 tempest-TestAggregatesBasicOps-1345961877-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.013306 Oct 26 13:43:07.282758 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3095/6224] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 26 13:43:07 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:43:07.294503 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b6c3bf74-3d68-4848-a1da-04bb5fbc9e97 tempest-TestAggregatesBasicOps-1345961877 tempest-TestAggregatesBasicOps-1345961877-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1252733257", "availability_zone": "foo_zone"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:43:07.349674 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b6c3bf74-3d68-4848-a1da-04bb5fbc9e97 tempest-TestAggregatesBasicOps-1345961877 tempest-TestAggregatesBasicOps-1345961877-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.059292 Oct 26 13:43:07.350219 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3130/6225] 10.222.0.40 () {60 vars in 1173 bytes} [Wed Oct 26 13:43:07 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:43:07.364439 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8ef78b22-318e-4346-a839-8dad77cf93d0 tempest-TestAggregatesBasicOps-1345961877 tempest-TestAggregatesBasicOps-1345961877-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:43:07.406264 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8ef78b22-318e-4346-a839-8dad77cf93d0 tempest-TestAggregatesBasicOps-1345961877 tempest-TestAggregatesBasicOps-1345961877-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.048146 Oct 26 13:43:07.408219 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3096/6226] 10.222.0.40 () {60 vars in 1194 bytes} [Wed Oct 26 13:43:07 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:43:07.421740 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-195d2e1c-f62e-4a83-a390-207fe459549b tempest-TestAggregatesBasicOps-1345961877 tempest-TestAggregatesBasicOps-1345961877-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:07.443796 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-195d2e1c-f62e-4a83-a390-207fe459549b tempest-TestAggregatesBasicOps-1345961877 tempest-TestAggregatesBasicOps-1345961877-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.026247 Oct 26 13:43:07.444559 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3131/6227] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 26 13:43:07 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:43:07.458063 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-10f5d543-a21b-40f3-be56-4f6d02cef5df tempest-TestAggregatesBasicOps-1345961877 tempest-TestAggregatesBasicOps-1345961877-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862686-1"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:43:07.484919 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-10f5d543-a21b-40f3-be56-4f6d02cef5df tempest-TestAggregatesBasicOps-1345961877 tempest-TestAggregatesBasicOps-1345961877-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:07.485417 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-10f5d543-a21b-40f3-be56-4f6d02cef5df tempest-TestAggregatesBasicOps-1345961877 tempest-TestAggregatesBasicOps-1345961877-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:07.485899 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-10f5d543-a21b-40f3-be56-4f6d02cef5df tempest-TestAggregatesBasicOps-1345961877 tempest-TestAggregatesBasicOps-1345961877-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:07.649624 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-365d8616-1817-4162-b595-a1b6e0cded29 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:07.650730 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-365d8616-1817-4162-b595-a1b6e0cded29 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: 2afb9959-a444-4fe1-802b-fdf00cb7fca1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:07.664582 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-365d8616-1817-4162-b595-a1b6e0cded29 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:07.665386 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-365d8616-1817-4162-b595-a1b6e0cded29 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:07.669176 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-365d8616-1817-4162-b595-a1b6e0cded29 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:07.670171 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-365d8616-1817-4162-b595-a1b6e0cded29 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:07.671233 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-365d8616-1817-4162-b595-a1b6e0cded29 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:07.671845 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-365d8616-1817-4162-b595-a1b6e0cded29 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:07.846682 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-10f5d543-a21b-40f3-be56-4f6d02cef5df tempest-TestAggregatesBasicOps-1345961877 tempest-TestAggregatesBasicOps-1345961877-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.394092 Oct 26 13:43:07.847320 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3097/6228] 10.222.0.40 () {60 vars in 1194 bytes} [Wed Oct 26 13:43:07 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:43:07.860299 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e038b825-2562-4e1c-a649-38f69947a3d5 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:07.861624 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e038b825-2562-4e1c-a649-38f69947a3d5 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] [instance: 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:07.878172 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e038b825-2562-4e1c-a649-38f69947a3d5 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:07.878960 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e038b825-2562-4e1c-a649-38f69947a3d5 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:07.879764 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e038b825-2562-4e1c-a649-38f69947a3d5 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:07.880654 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e038b825-2562-4e1c-a649-38f69947a3d5 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:07.881293 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e038b825-2562-4e1c-a649-38f69947a3d5 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:07.884537 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e038b825-2562-4e1c-a649-38f69947a3d5 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:08.161841 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-365d8616-1817-4162-b595-a1b6e0cded29 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe5aa8de6e24f1faf309f7e3e9a478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2ca8f7890421180d124123db3387f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:43:08.170123 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-365d8616-1817-4162-b595-a1b6e0cded29 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/2afb9959-a444-4fe1-802b-fdf00cb7fca1" status: 200 len: 1371 microversion: 2.1 time: 0.525646 Oct 26 13:43:08.174414 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3132/6229] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:07 2022] GET /compute/v2.1/servers/2afb9959-a444-4fe1-802b-fdf00cb7fca1 => generated 1371 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:43:08.187699 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0f084d23-b56d-4802-8388-b64be621bd80 tempest-TestAggregatesBasicOps-1345961877 tempest-TestAggregatesBasicOps-1345961877-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:08.235344 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0f084d23-b56d-4802-8388-b64be621bd80 tempest-TestAggregatesBasicOps-1345961877 tempest-TestAggregatesBasicOps-1345961877-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.059551 Oct 26 13:43:08.236848 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3133/6230] 10.222.0.40 () {58 vars in 1155 bytes} [Wed Oct 26 13:43:08 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 26 13:43:08.251145 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e038b825-2562-4e1c-a649-38f69947a3d5 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725949c28f9742beb622b98e84c67646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffe02c0779d465f93762150cb94114f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:43:08.268858 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e038b825-2562-4e1c-a649-38f69947a3d5 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] 10.222.0.40 "GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce" status: 200 len: 1426 microversion: 2.1 time: 0.413196 Oct 26 13:43:08.269561 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3098/6231] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:07 2022] GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce => generated 1426 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:43:09.200048 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-33b04e58-6dbb-4df0-b850-86a8b940a187 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:09.201368 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-33b04e58-6dbb-4df0-b850-86a8b940a187 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: 2afb9959-a444-4fe1-802b-fdf00cb7fca1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:09.221911 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33b04e58-6dbb-4df0-b850-86a8b940a187 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:09.237141 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33b04e58-6dbb-4df0-b850-86a8b940a187 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:09.237630 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33b04e58-6dbb-4df0-b850-86a8b940a187 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:09.238404 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33b04e58-6dbb-4df0-b850-86a8b940a187 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:09.238868 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33b04e58-6dbb-4df0-b850-86a8b940a187 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:09.239300 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33b04e58-6dbb-4df0-b850-86a8b940a187 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:09.298442 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f1da53ca-0d0a-4c96-8507-5a2ea326a7c9 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:09.299061 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f1da53ca-0d0a-4c96-8507-5a2ea326a7c9 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] [instance: 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:09.319774 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f1da53ca-0d0a-4c96-8507-5a2ea326a7c9 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:09.320281 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f1da53ca-0d0a-4c96-8507-5a2ea326a7c9 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:09.320724 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f1da53ca-0d0a-4c96-8507-5a2ea326a7c9 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:09.321439 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f1da53ca-0d0a-4c96-8507-5a2ea326a7c9 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:09.321916 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f1da53ca-0d0a-4c96-8507-5a2ea326a7c9 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:09.335004 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f1da53ca-0d0a-4c96-8507-5a2ea326a7c9 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:09.607758 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-33b04e58-6dbb-4df0-b850-86a8b940a187 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe5aa8de6e24f1faf309f7e3e9a478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2ca8f7890421180d124123db3387f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:43:09.622573 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-33b04e58-6dbb-4df0-b850-86a8b940a187 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/2afb9959-a444-4fe1-802b-fdf00cb7fca1" status: 200 len: 1371 microversion: 2.1 time: 0.426935 Oct 26 13:43:09.623233 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3134/6232] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:09 2022] GET /compute/v2.1/servers/2afb9959-a444-4fe1-802b-fdf00cb7fca1 => generated 1371 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:43:10.244305 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f1da53ca-0d0a-4c96-8507-5a2ea326a7c9 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725949c28f9742beb622b98e84c67646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffe02c0779d465f93762150cb94114f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:43:10.260026 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f1da53ca-0d0a-4c96-8507-5a2ea326a7c9 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] 10.222.0.40 "GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce" status: 200 len: 1426 microversion: 2.1 time: 0.961858 Oct 26 13:43:10.283560 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3099/6233] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:09 2022] GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce => generated 1426 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:43:10.650626 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1ea2cfec-695d-4e4c-995b-1e428a216c07 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:10.651876 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1ea2cfec-695d-4e4c-995b-1e428a216c07 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: 2afb9959-a444-4fe1-802b-fdf00cb7fca1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:10.660596 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ea2cfec-695d-4e4c-995b-1e428a216c07 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:10.661340 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ea2cfec-695d-4e4c-995b-1e428a216c07 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:10.661970 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ea2cfec-695d-4e4c-995b-1e428a216c07 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:10.662882 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ea2cfec-695d-4e4c-995b-1e428a216c07 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:10.663522 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ea2cfec-695d-4e4c-995b-1e428a216c07 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:10.664119 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ea2cfec-695d-4e4c-995b-1e428a216c07 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:11.017573 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1ea2cfec-695d-4e4c-995b-1e428a216c07 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe5aa8de6e24f1faf309f7e3e9a478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2ca8f7890421180d124123db3387f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:43:11.039497 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1ea2cfec-695d-4e4c-995b-1e428a216c07 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/2afb9959-a444-4fe1-802b-fdf00cb7fca1" status: 200 len: 1371 microversion: 2.1 time: 0.392882 Oct 26 13:43:11.044064 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3135/6234] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:10 2022] GET /compute/v2.1/servers/2afb9959-a444-4fe1-802b-fdf00cb7fca1 => generated 1371 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:43:11.288994 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1d8dbb21-21aa-4fed-a0c4-81c5932ee505 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:11.290335 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1d8dbb21-21aa-4fed-a0c4-81c5932ee505 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] [instance: 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:11.304680 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d8dbb21-21aa-4fed-a0c4-81c5932ee505 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:11.305499 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d8dbb21-21aa-4fed-a0c4-81c5932ee505 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:11.307962 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d8dbb21-21aa-4fed-a0c4-81c5932ee505 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:11.308863 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d8dbb21-21aa-4fed-a0c4-81c5932ee505 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:11.311966 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d8dbb21-21aa-4fed-a0c4-81c5932ee505 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:11.312667 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d8dbb21-21aa-4fed-a0c4-81c5932ee505 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:12.005046 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1d8dbb21-21aa-4fed-a0c4-81c5932ee505 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725949c28f9742beb622b98e84c67646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffe02c0779d465f93762150cb94114f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:43:12.017557 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1d8dbb21-21aa-4fed-a0c4-81c5932ee505 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] 10.222.0.40 "GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce" status: 200 len: 1426 microversion: 2.1 time: 0.730690 Oct 26 13:43:12.029514 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3100/6235] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:11 2022] GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce => generated 1426 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:43:12.074648 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ed494e5d-6043-429b-a330-6d2171a29469 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:12.075510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ed494e5d-6043-429b-a330-6d2171a29469 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: 2afb9959-a444-4fe1-802b-fdf00cb7fca1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:12.089667 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ed494e5d-6043-429b-a330-6d2171a29469 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:12.090483 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ed494e5d-6043-429b-a330-6d2171a29469 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:12.091103 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ed494e5d-6043-429b-a330-6d2171a29469 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:12.092030 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ed494e5d-6043-429b-a330-6d2171a29469 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:12.094492 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ed494e5d-6043-429b-a330-6d2171a29469 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:12.095171 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ed494e5d-6043-429b-a330-6d2171a29469 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:12.418168 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ed494e5d-6043-429b-a330-6d2171a29469 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe5aa8de6e24f1faf309f7e3e9a478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2ca8f7890421180d124123db3387f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:43:12.451360 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ed494e5d-6043-429b-a330-6d2171a29469 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/2afb9959-a444-4fe1-802b-fdf00cb7fca1" status: 200 len: 1371 microversion: 2.1 time: 0.380373 Oct 26 13:43:12.452937 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3136/6236] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:12 2022] GET /compute/v2.1/servers/2afb9959-a444-4fe1-802b-fdf00cb7fca1 => generated 1371 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:43:13.045204 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d21d9daf-5ab0-4ed7-8774-7b415f33fb32 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:13.046537 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d21d9daf-5ab0-4ed7-8774-7b415f33fb32 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] [instance: 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:13.054874 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d21d9daf-5ab0-4ed7-8774-7b415f33fb32 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:13.055657 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d21d9daf-5ab0-4ed7-8774-7b415f33fb32 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:13.057844 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d21d9daf-5ab0-4ed7-8774-7b415f33fb32 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:13.058965 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d21d9daf-5ab0-4ed7-8774-7b415f33fb32 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:13.059629 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d21d9daf-5ab0-4ed7-8774-7b415f33fb32 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:13.060444 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d21d9daf-5ab0-4ed7-8774-7b415f33fb32 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:13.320124 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-01f44514-a682-4f57-8612-e60c110f86f4 req-26d4c493-713f-429c-b81b-3aed095804db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2afb9959-a444-4fe1-802b-fdf00cb7fca1", "name": "network-vif-plugged", "status": "completed", "tag": "6a36232d-7783-45c8-b2fd-dab0cd450464"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:43:13.340624 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-01f44514-a682-4f57-8612-e60c110f86f4 req-26d4c493-713f-429c-b81b-3aed095804db service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:13.349866 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d21d9daf-5ab0-4ed7-8774-7b415f33fb32 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725949c28f9742beb622b98e84c67646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffe02c0779d465f93762150cb94114f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:43:13.350546 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-01f44514-a682-4f57-8612-e60c110f86f4 req-26d4c493-713f-429c-b81b-3aed095804db service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:13.351576 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-01f44514-a682-4f57-8612-e60c110f86f4 req-26d4c493-713f-429c-b81b-3aed095804db service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:13.363630 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d21d9daf-5ab0-4ed7-8774-7b415f33fb32 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] 10.222.0.40 "GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce" status: 200 len: 1426 microversion: 2.1 time: 0.323123 Oct 26 13:43:13.373246 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-01f44514-a682-4f57-8612-e60c110f86f4 req-26d4c493-713f-429c-b81b-3aed095804db service nova] Creating event network-vif-plugged:6a36232d-7783-45c8-b2fd-dab0cd450464 for instance 2afb9959-a444-4fe1-802b-fdf00cb7fca1 on n-h2-862686-1 Oct 26 13:43:13.386914 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-01f44514-a682-4f57-8612-e60c110f86f4 req-26d4c493-713f-429c-b81b-3aed095804db service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073745 Oct 26 13:43:13.387759 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3137/6237] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:43:13.394844 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3101/6238] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:13 2022] GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce => generated 1426 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:43:13.480534 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ea2f52b1-50ab-4c70-ac6d-c47165875bdb tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:13.481604 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ea2f52b1-50ab-4c70-ac6d-c47165875bdb tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: 2afb9959-a444-4fe1-802b-fdf00cb7fca1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:13.493826 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ea2f52b1-50ab-4c70-ac6d-c47165875bdb tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:13.495334 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ea2f52b1-50ab-4c70-ac6d-c47165875bdb tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:13.497513 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ea2f52b1-50ab-4c70-ac6d-c47165875bdb tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:13.499440 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ea2f52b1-50ab-4c70-ac6d-c47165875bdb tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:13.501737 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ea2f52b1-50ab-4c70-ac6d-c47165875bdb tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:13.503482 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ea2f52b1-50ab-4c70-ac6d-c47165875bdb tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:13.907154 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ea2f52b1-50ab-4c70-ac6d-c47165875bdb tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe5aa8de6e24f1faf309f7e3e9a478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2ca8f7890421180d124123db3387f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:43:13.925023 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ea2f52b1-50ab-4c70-ac6d-c47165875bdb tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/2afb9959-a444-4fe1-802b-fdf00cb7fca1" status: 200 len: 1371 microversion: 2.1 time: 0.449329 Oct 26 13:43:13.928627 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3138/6239] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:13 2022] GET /compute/v2.1/servers/2afb9959-a444-4fe1-802b-fdf00cb7fca1 => generated 1371 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:43:14.390025 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cffee474-9e12-44c4-825f-25ef2fedddaa tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:14.390748 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cffee474-9e12-44c4-825f-25ef2fedddaa tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] [instance: 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:14.404231 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cffee474-9e12-44c4-825f-25ef2fedddaa tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:14.406349 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cffee474-9e12-44c4-825f-25ef2fedddaa tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:14.406785 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cffee474-9e12-44c4-825f-25ef2fedddaa tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:14.407602 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cffee474-9e12-44c4-825f-25ef2fedddaa tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:14.407955 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cffee474-9e12-44c4-825f-25ef2fedddaa tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:14.408377 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cffee474-9e12-44c4-825f-25ef2fedddaa tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:14.681911 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cffee474-9e12-44c4-825f-25ef2fedddaa tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725949c28f9742beb622b98e84c67646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffe02c0779d465f93762150cb94114f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:43:14.694798 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cffee474-9e12-44c4-825f-25ef2fedddaa tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] 10.222.0.40 "GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce" status: 200 len: 1426 microversion: 2.1 time: 0.308751 Oct 26 13:43:14.700051 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3102/6240] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:14 2022] GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce => generated 1426 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:43:14.959539 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6e934dec-60e4-4092-b989-8d059801c620 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:14.966236 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6e934dec-60e4-4092-b989-8d059801c620 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: 2afb9959-a444-4fe1-802b-fdf00cb7fca1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:14.984832 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e934dec-60e4-4092-b989-8d059801c620 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:14.996186 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e934dec-60e4-4092-b989-8d059801c620 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:14.998162 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e934dec-60e4-4092-b989-8d059801c620 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:14.999358 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e934dec-60e4-4092-b989-8d059801c620 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:15.000839 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e934dec-60e4-4092-b989-8d059801c620 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:15.003147 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6e934dec-60e4-4092-b989-8d059801c620 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:15.266405 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6e934dec-60e4-4092-b989-8d059801c620 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe5aa8de6e24f1faf309f7e3e9a478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2ca8f7890421180d124123db3387f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:43:15.278749 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6e934dec-60e4-4092-b989-8d059801c620 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/2afb9959-a444-4fe1-802b-fdf00cb7fca1" status: 200 len: 1542 microversion: 2.1 time: 0.328913 Oct 26 13:43:15.293374 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3139/6241] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:14 2022] GET /compute/v2.1/servers/2afb9959-a444-4fe1-802b-fdf00cb7fca1 => generated 1542 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:43:15.303918 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2141e58a-aa5f-4a62-8438-01bb1917eab9 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:15.303918 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2141e58a-aa5f-4a62-8438-01bb1917eab9 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: 2afb9959-a444-4fe1-802b-fdf00cb7fca1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:15.307441 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:43:15.326744 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2141e58a-aa5f-4a62-8438-01bb1917eab9 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:15.327754 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2141e58a-aa5f-4a62-8438-01bb1917eab9 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:15.328196 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2141e58a-aa5f-4a62-8438-01bb1917eab9 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:15.329109 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2141e58a-aa5f-4a62-8438-01bb1917eab9 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:15.330440 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2141e58a-aa5f-4a62-8438-01bb1917eab9 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:15.330893 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2141e58a-aa5f-4a62-8438-01bb1917eab9 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:15.447682 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-14e30419-bee7-4d99-869a-b03aa2ae341c req-6de5794c-484f-46fc-9583-2314933d836e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce", "name": "network-vif-plugged", "status": "completed", "tag": "88ca3dcc-b3e2-41c7-9aeb-cb461f5a8f97"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:43:15.491084 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-14e30419-bee7-4d99-869a-b03aa2ae341c req-6de5794c-484f-46fc-9583-2314933d836e service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:15.492404 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-14e30419-bee7-4d99-869a-b03aa2ae341c req-6de5794c-484f-46fc-9583-2314933d836e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:15.493842 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-14e30419-bee7-4d99-869a-b03aa2ae341c req-6de5794c-484f-46fc-9583-2314933d836e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:15.522002 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-14e30419-bee7-4d99-869a-b03aa2ae341c req-6de5794c-484f-46fc-9583-2314933d836e service nova] Creating event network-vif-plugged:88ca3dcc-b3e2-41c7-9aeb-cb461f5a8f97 for instance 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce on n-h2-862686-1 Oct 26 13:43:15.535489 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-14e30419-bee7-4d99-869a-b03aa2ae341c req-6de5794c-484f-46fc-9583-2314933d836e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092081 Oct 26 13:43:15.536698 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3140/6242] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:43:15.624480 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2141e58a-aa5f-4a62-8438-01bb1917eab9 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe5aa8de6e24f1faf309f7e3e9a478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2ca8f7890421180d124123db3387f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:43:15.634790 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2141e58a-aa5f-4a62-8438-01bb1917eab9 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/2afb9959-a444-4fe1-802b-fdf00cb7fca1" status: 200 len: 1542 microversion: 2.1 time: 0.335352 Oct 26 13:43:15.638180 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3103/6243] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:15 2022] GET /compute/v2.1/servers/2afb9959-a444-4fe1-802b-fdf00cb7fca1 => generated 1542 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:43:15.728552 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2cc6a13f-8364-4193-9295-51854203bf09 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:15.729575 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2cc6a13f-8364-4193-9295-51854203bf09 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] [instance: 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:15.738666 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2cc6a13f-8364-4193-9295-51854203bf09 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:15.739447 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2cc6a13f-8364-4193-9295-51854203bf09 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:15.740525 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2cc6a13f-8364-4193-9295-51854203bf09 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:15.741605 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2cc6a13f-8364-4193-9295-51854203bf09 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:15.742459 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2cc6a13f-8364-4193-9295-51854203bf09 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:15.743219 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2cc6a13f-8364-4193-9295-51854203bf09 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:16.072141 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2cc6a13f-8364-4193-9295-51854203bf09 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725949c28f9742beb622b98e84c67646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffe02c0779d465f93762150cb94114f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:43:16.082071 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2cc6a13f-8364-4193-9295-51854203bf09 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] 10.222.0.40 "GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce" status: 200 len: 1426 microversion: 2.1 time: 0.357654 Oct 26 13:43:16.082670 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3141/6244] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:15 2022] GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce => generated 1426 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:43:17.113552 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4007a327-68e4-4e2f-915c-ea456cb5dccb tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:17.114235 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4007a327-68e4-4e2f-915c-ea456cb5dccb tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] [instance: 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:17.128485 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4007a327-68e4-4e2f-915c-ea456cb5dccb tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:17.129320 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4007a327-68e4-4e2f-915c-ea456cb5dccb tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:17.129993 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4007a327-68e4-4e2f-915c-ea456cb5dccb tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:17.130933 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4007a327-68e4-4e2f-915c-ea456cb5dccb tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:17.131566 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4007a327-68e4-4e2f-915c-ea456cb5dccb tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:17.132914 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4007a327-68e4-4e2f-915c-ea456cb5dccb tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:17.427554 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4007a327-68e4-4e2f-915c-ea456cb5dccb tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725949c28f9742beb622b98e84c67646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffe02c0779d465f93762150cb94114f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:43:17.439066 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4007a327-68e4-4e2f-915c-ea456cb5dccb tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] 10.222.0.40 "GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce" status: 200 len: 1605 microversion: 2.1 time: 0.331003 Oct 26 13:43:17.440038 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3104/6245] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:17 2022] GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce => generated 1605 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:43:17.473099 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c6f81943-1f23-4dc1-a4c4-53dcc4197dd7 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:17.474770 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c6f81943-1f23-4dc1-a4c4-53dcc4197dd7 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] [instance: 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:17.480888 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:43:17.485257 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:43:17.489513 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c6f81943-1f23-4dc1-a4c4-53dcc4197dd7 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:17.490342 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c6f81943-1f23-4dc1-a4c4-53dcc4197dd7 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:17.493591 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c6f81943-1f23-4dc1-a4c4-53dcc4197dd7 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:17.495098 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c6f81943-1f23-4dc1-a4c4-53dcc4197dd7 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:17.495782 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c6f81943-1f23-4dc1-a4c4-53dcc4197dd7 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:17.500293 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c6f81943-1f23-4dc1-a4c4-53dcc4197dd7 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:17.577969 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:43:18.009608 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c6f81943-1f23-4dc1-a4c4-53dcc4197dd7 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725949c28f9742beb622b98e84c67646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffe02c0779d465f93762150cb94114f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:43:18.024113 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c6f81943-1f23-4dc1-a4c4-53dcc4197dd7 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] 10.222.0.40 "GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce" status: 200 len: 1605 microversion: 2.1 time: 0.565366 Oct 26 13:43:18.027146 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3142/6246] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:17 2022] GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce => generated 1605 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:43:18.047894 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8d61a9c7-f9aa-437b-8561-085352ce838b tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:18.048679 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8d61a9c7-f9aa-437b-8561-085352ce838b tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] [instance: 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:18.055636 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d61a9c7-f9aa-437b-8561-085352ce838b tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:18.056253 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d61a9c7-f9aa-437b-8561-085352ce838b tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:18.056905 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d61a9c7-f9aa-437b-8561-085352ce838b tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:18.057964 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d61a9c7-f9aa-437b-8561-085352ce838b tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:18.058696 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d61a9c7-f9aa-437b-8561-085352ce838b tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:18.059389 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d61a9c7-f9aa-437b-8561-085352ce838b tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:18.343846 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8d61a9c7-f9aa-437b-8561-085352ce838b tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725949c28f9742beb622b98e84c67646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffe02c0779d465f93762150cb94114f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:43:18.355180 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8d61a9c7-f9aa-437b-8561-085352ce838b tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] 10.222.0.40 "GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce" status: 200 len: 1605 microversion: 2.1 time: 0.311052 Oct 26 13:43:18.355896 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3105/6247] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:18 2022] GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce => generated 1605 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:43:18.857461 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-da5f76d0-8872-4697-8907-f92577d2bc96 req-b45e070f-b8f3-4bea-bc58-2b262de76876 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2afb9959-a444-4fe1-802b-fdf00cb7fca1", "tag": "6a36232d-7783-45c8-b2fd-dab0cd450464"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:43:18.871152 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-da5f76d0-8872-4697-8907-f92577d2bc96 req-b45e070f-b8f3-4bea-bc58-2b262de76876 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:18.872179 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-da5f76d0-8872-4697-8907-f92577d2bc96 req-b45e070f-b8f3-4bea-bc58-2b262de76876 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:18.872865 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-da5f76d0-8872-4697-8907-f92577d2bc96 req-b45e070f-b8f3-4bea-bc58-2b262de76876 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:18.890689 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-da5f76d0-8872-4697-8907-f92577d2bc96 req-b45e070f-b8f3-4bea-bc58-2b262de76876 service nova] Creating event network-changed:6a36232d-7783-45c8-b2fd-dab0cd450464 for instance 2afb9959-a444-4fe1-802b-fdf00cb7fca1 on n-h2-862686-1 Oct 26 13:43:18.900727 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-da5f76d0-8872-4697-8907-f92577d2bc96 req-b45e070f-b8f3-4bea-bc58-2b262de76876 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050630 Oct 26 13:43:18.902099 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3143/6248] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:43:23.056328 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-4679461c-0e1e-400c-8dea-0000ec139cf2 req-43b5273e-5eb5-4656-888e-c3f183cc9db2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce", "tag": "88ca3dcc-b3e2-41c7-9aeb-cb461f5a8f97"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:43:23.077146 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-4679461c-0e1e-400c-8dea-0000ec139cf2 req-43b5273e-5eb5-4656-888e-c3f183cc9db2 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:23.080799 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-4679461c-0e1e-400c-8dea-0000ec139cf2 req-43b5273e-5eb5-4656-888e-c3f183cc9db2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:23.081155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-4679461c-0e1e-400c-8dea-0000ec139cf2 req-43b5273e-5eb5-4656-888e-c3f183cc9db2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:23.118745 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=95 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:43:23.121215 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-4679461c-0e1e-400c-8dea-0000ec139cf2 req-43b5273e-5eb5-4656-888e-c3f183cc9db2 service nova] Creating event network-changed:88ca3dcc-b3e2-41c7-9aeb-cb461f5a8f97 for instance 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce on n-h2-862686-1 Oct 26 13:43:23.130870 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-4679461c-0e1e-400c-8dea-0000ec139cf2 req-43b5273e-5eb5-4656-888e-c3f183cc9db2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079437 Oct 26 13:43:23.132007 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3106/6249] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:43:24.485285 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ea9632b5-52bd-4b59-9075-6ca5fd450960 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Action: 'create', calling method: .version_select at 0x7f67367f4dc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-899389863", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIaUZSKMUAwqwer4/iffBg+7qTNtA6lO1t0Wu41JDR++tatHAHti044wlwmRhFjrl+6TVod5ucYwI10BhI1mfDmBF9b3rjN/iZsg/DUqcHWA4FuQ0+1lOsmm90kn4brvw=="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:43:24.505704 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-ea9632b5-52bd-4b59-9075-6ca5fd450960 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Getting quotas for project bbc60a45db1c488ab4417c3b2c8d1983. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:43:24.513328 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-ea9632b5-52bd-4b59-9075-6ca5fd450960 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Getting quotas for user c67f61dd56b74107b828dcd7f2fc31f1 and project bbc60a45db1c488ab4417c3b2c8d1983. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:43:24.552369 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ea9632b5-52bd-4b59-9075-6ca5fd450960 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.300195 Oct 26 13:43:24.559575 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3144/6250] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 13:43:24 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:43:35.528745 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4dea8ffe-fa83-491f-8e8a-f62fe567e733 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1100387608", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "983cffcb-c21b-4383-8015-f1a542b5ad44"}], "key_name": "tempest-TestNetworkAdvancedServerOps-899389863", "security_groups": [{"name": "tempest-secgroup-smoke-1100111634"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:43:35.542325 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:43:36.209297 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-4dea8ffe-fa83-491f-8e8a-f62fe567e733 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] validate_networks() for [('983cffcb-c21b-4383-8015-f1a542b5ad44', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:43:37.427333 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-4dea8ffe-fa83-491f-8e8a-f62fe567e733 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:43:37.427946 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-4dea8ffe-fa83-491f-8e8a-f62fe567e733 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:43:37.428788 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-4dea8ffe-fa83-491f-8e8a-f62fe567e733 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:43:37.429793 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-4dea8ffe-fa83-491f-8e8a-f62fe567e733 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:43:37.430553 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-4dea8ffe-fa83-491f-8e8a-f62fe567e733 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:43:37.458016 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4dea8ffe-fa83-491f-8e8a-f62fe567e733 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:37.458571 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4dea8ffe-fa83-491f-8e8a-f62fe567e733 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:37.459030 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4dea8ffe-fa83-491f-8e8a-f62fe567e733 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:37.459849 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4dea8ffe-fa83-491f-8e8a-f62fe567e733 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:37.460310 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4dea8ffe-fa83-491f-8e8a-f62fe567e733 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:37.460744 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4dea8ffe-fa83-491f-8e8a-f62fe567e733 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:37.497189 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-4dea8ffe-fa83-491f-8e8a-f62fe567e733 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Getting quotas for project bbc60a45db1c488ab4417c3b2c8d1983. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:43:37.508526 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-4dea8ffe-fa83-491f-8e8a-f62fe567e733 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Getting quotas for user c67f61dd56b74107b828dcd7f2fc31f1 and project bbc60a45db1c488ab4417c3b2c8d1983. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:43:37.550793 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4dea8ffe-fa83-491f-8e8a-f62fe567e733 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:43:37.555082 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4dea8ffe-fa83-491f-8e8a-f62fe567e733 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:43:37.680367 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4dea8ffe-fa83-491f-8e8a-f62fe567e733 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.164178 Oct 26 13:43:37.681884 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3107/6251] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:43:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 2167 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:43:37.692616 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=4 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:43:37.698361 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=4 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:43:37.699288 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:43:37.718156 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ffce74f3-5471-4980-a481-2e4b6e135a74 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:37.719025 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ffce74f3-5471-4980-a481-2e4b6e135a74 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:37.886033 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ffce74f3-5471-4980-a481-2e4b6e135a74 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:43:37.904018 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ffce74f3-5471-4980-a481-2e4b6e135a74 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4" status: 200 len: 1266 microversion: 2.1 time: 0.214265 Oct 26 13:43:37.917521 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3145/6252] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:37 2022] GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4 => generated 1266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:43:38.931825 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f9fb7bb7-1b72-4585-841d-bc402dfcdd75 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:38.932435 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f9fb7bb7-1b72-4585-841d-bc402dfcdd75 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:38.956100 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f9fb7bb7-1b72-4585-841d-bc402dfcdd75 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:38.956611 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f9fb7bb7-1b72-4585-841d-bc402dfcdd75 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:38.957066 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f9fb7bb7-1b72-4585-841d-bc402dfcdd75 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:38.957819 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f9fb7bb7-1b72-4585-841d-bc402dfcdd75 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:38.958289 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f9fb7bb7-1b72-4585-841d-bc402dfcdd75 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:38.958721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f9fb7bb7-1b72-4585-841d-bc402dfcdd75 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:38.984796 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3cc64c25-d69e-467b-94fd-bd745919c6e4 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:38.986661 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3cc64c25-d69e-467b-94fd-bd745919c6e4 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:38.987158 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3cc64c25-d69e-467b-94fd-bd745919c6e4 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:38.987599 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3cc64c25-d69e-467b-94fd-bd745919c6e4 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:38.988348 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3cc64c25-d69e-467b-94fd-bd745919c6e4 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:38.988809 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3cc64c25-d69e-467b-94fd-bd745919c6e4 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:38.989241 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3cc64c25-d69e-467b-94fd-bd745919c6e4 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:39.077736 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3cc64c25-d69e-467b-94fd-bd745919c6e4 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] 10.222.0.40 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.364645 Oct 26 13:43:39.079084 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3108/6253] 10.222.0.40 () {58 vars in 1185 bytes} [Wed Oct 26 13:43:38 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:43:39.114624 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f9fb7bb7-1b72-4585-841d-bc402dfcdd75 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:43:39.144596 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f9fb7bb7-1b72-4585-841d-bc402dfcdd75 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4" status: 200 len: 1318 microversion: 2.1 time: 0.216607 Oct 26 13:43:39.145630 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3146/6254] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:38 2022] GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:43:39.346229 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-03f7fb78-ef57-4fb1-96ac-4e44853f948c tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-900176515", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "availability_zone": "nova:n-h2-862686-1", "networks": [{"uuid": "0977e2e9-dda4-4319-8583-43c2b66f61ca"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:43:39.471008 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-03f7fb78-ef57-4fb1-96ac-4e44853f948c tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] validate_networks() for [('0977e2e9-dda4-4319-8583-43c2b66f61ca', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:43:40.174756 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5432f0a9-d5bd-412a-920a-9acd19fbb5f1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:40.175359 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5432f0a9-d5bd-412a-920a-9acd19fbb5f1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:40.190326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5432f0a9-d5bd-412a-920a-9acd19fbb5f1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:40.191563 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5432f0a9-d5bd-412a-920a-9acd19fbb5f1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:40.192572 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5432f0a9-d5bd-412a-920a-9acd19fbb5f1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:40.194614 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5432f0a9-d5bd-412a-920a-9acd19fbb5f1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:40.196696 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5432f0a9-d5bd-412a-920a-9acd19fbb5f1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:40.197405 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5432f0a9-d5bd-412a-920a-9acd19fbb5f1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:40.276950 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5432f0a9-d5bd-412a-920a-9acd19fbb5f1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:43:40.288560 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5432f0a9-d5bd-412a-920a-9acd19fbb5f1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4" status: 200 len: 1324 microversion: 2.1 time: 0.119638 Oct 26 13:43:40.289901 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3147/6255] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:40 2022] GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4 => generated 1324 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:43:40.382425 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-03f7fb78-ef57-4fb1-96ac-4e44853f948c tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:43:40.382973 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-03f7fb78-ef57-4fb1-96ac-4e44853f948c tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:43:40.383327 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-03f7fb78-ef57-4fb1-96ac-4e44853f948c tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:43:40.383744 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-03f7fb78-ef57-4fb1-96ac-4e44853f948c tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:43:40.384387 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-03f7fb78-ef57-4fb1-96ac-4e44853f948c tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:43:40.397473 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03f7fb78-ef57-4fb1-96ac-4e44853f948c tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:40.398200 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03f7fb78-ef57-4fb1-96ac-4e44853f948c tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:40.398918 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03f7fb78-ef57-4fb1-96ac-4e44853f948c tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:40.399985 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03f7fb78-ef57-4fb1-96ac-4e44853f948c tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:40.400708 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03f7fb78-ef57-4fb1-96ac-4e44853f948c tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:40.401370 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03f7fb78-ef57-4fb1-96ac-4e44853f948c tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:40.427078 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-03f7fb78-ef57-4fb1-96ac-4e44853f948c tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Getting quotas for project 924262ce1ddf4f598b48a3e428c016d6. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:43:40.436424 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-03f7fb78-ef57-4fb1-96ac-4e44853f948c tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Getting quotas for user 7ab587dc0c72424ab5d5f2e7f25cadf3 and project 924262ce1ddf4f598b48a3e428c016d6. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:43:40.456953 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-03f7fb78-ef57-4fb1-96ac-4e44853f948c tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:43:40.460544 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-03f7fb78-ef57-4fb1-96ac-4e44853f948c tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] [instance: 54cef59c-a846-4db7-8bae-ac0e2ee71b40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:43:40.519615 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-03f7fb78-ef57-4fb1-96ac-4e44853f948c tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.179096 Oct 26 13:43:40.520911 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3109/6256] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:43:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1181 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:43:40.532977 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7b66fc17-7e2c-4c62-8b7a-f22277024ab5 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:40.537586 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7b66fc17-7e2c-4c62-8b7a-f22277024ab5 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] [instance: 54cef59c-a846-4db7-8bae-ac0e2ee71b40] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:40.724791 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7b66fc17-7e2c-4c62-8b7a-f22277024ab5 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/54cef59c-a846-4db7-8bae-ac0e2ee71b40" status: 200 len: 1328 microversion: 2.1 time: 0.196930 Oct 26 13:43:40.731378 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3148/6257] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:40 2022] GET /compute/v2.1/servers/54cef59c-a846-4db7-8bae-ac0e2ee71b40 => generated 1328 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:43:41.313944 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b6fe8526-fc37-48b4-8c46-2729360ccf58 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:41.315129 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b6fe8526-fc37-48b4-8c46-2729360ccf58 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:41.328438 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6fe8526-fc37-48b4-8c46-2729360ccf58 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:41.339212 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6fe8526-fc37-48b4-8c46-2729360ccf58 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:41.341271 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6fe8526-fc37-48b4-8c46-2729360ccf58 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:41.343416 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6fe8526-fc37-48b4-8c46-2729360ccf58 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:41.355201 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6fe8526-fc37-48b4-8c46-2729360ccf58 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:41.355672 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6fe8526-fc37-48b4-8c46-2729360ccf58 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:41.483288 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-24c80681-fdaf-4757-b9f4-e035e14e156a tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:43:41.487995 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-24c80681-fdaf-4757-b9f4-e035e14e156a tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: 2afb9959-a444-4fe1-802b-fdf00cb7fca1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:41.503200 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24c80681-fdaf-4757-b9f4-e035e14e156a tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:41.511273 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24c80681-fdaf-4757-b9f4-e035e14e156a tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:41.512409 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24c80681-fdaf-4757-b9f4-e035e14e156a tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:41.513454 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24c80681-fdaf-4757-b9f4-e035e14e156a tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:41.515556 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24c80681-fdaf-4757-b9f4-e035e14e156a tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:41.516243 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24c80681-fdaf-4757-b9f4-e035e14e156a tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:41.609281 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-24c80681-fdaf-4757-b9f4-e035e14e156a tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "POST /compute/v2.1/servers/2afb9959-a444-4fe1-802b-fdf00cb7fca1/action" status: 200 len: 24568 microversion: 2.1 time: 0.131436 Oct 26 13:43:41.611508 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3149/6258] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:43:41 2022] POST /compute/v2.1/servers/2afb9959-a444-4fe1-802b-fdf00cb7fca1/action => generated 24568 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 26 13:43:41.750640 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f981800b-05de-45a5-b5b0-f57b9afe609f tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:41.751634 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f981800b-05de-45a5-b5b0-f57b9afe609f tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] [instance: 54cef59c-a846-4db7-8bae-ac0e2ee71b40] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:41.763068 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f981800b-05de-45a5-b5b0-f57b9afe609f tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:41.764491 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f981800b-05de-45a5-b5b0-f57b9afe609f tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:41.765188 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f981800b-05de-45a5-b5b0-f57b9afe609f tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:41.766189 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f981800b-05de-45a5-b5b0-f57b9afe609f tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:41.766878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f981800b-05de-45a5-b5b0-f57b9afe609f tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:41.767568 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f981800b-05de-45a5-b5b0-f57b9afe609f tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:41.906740 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b6fe8526-fc37-48b4-8c46-2729360ccf58 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:43:41.915470 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f981800b-05de-45a5-b5b0-f57b9afe609f tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/54cef59c-a846-4db7-8bae-ac0e2ee71b40" status: 200 len: 1415 microversion: 2.1 time: 0.171077 Oct 26 13:43:41.916078 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3150/6259] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:41 2022] GET /compute/v2.1/servers/54cef59c-a846-4db7-8bae-ac0e2ee71b40 => generated 1415 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:43:41.922241 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b6fe8526-fc37-48b4-8c46-2729360ccf58 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4" status: 200 len: 1392 microversion: 2.1 time: 0.613112 Oct 26 13:43:41.939922 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3110/6260] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:41 2022] GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4 => generated 1392 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:43:42.616888 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-3883da3a-bb5b-46e5-870d-6061eb7bcc02 req-f88ca1b6-ef67-4002-b241-f6bc11fd4ffa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "911f368c-5a4e-4f89-83e8-52d02202bbc4", "tag": "01306531-3518-45b4-ae5b-35d7b905b368"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:43:42.645352 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-3883da3a-bb5b-46e5-870d-6061eb7bcc02 req-f88ca1b6-ef67-4002-b241-f6bc11fd4ffa service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:42.645894 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-3883da3a-bb5b-46e5-870d-6061eb7bcc02 req-f88ca1b6-ef67-4002-b241-f6bc11fd4ffa service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:42.646345 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-3883da3a-bb5b-46e5-870d-6061eb7bcc02 req-f88ca1b6-ef67-4002-b241-f6bc11fd4ffa service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:42.671902 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-3883da3a-bb5b-46e5-870d-6061eb7bcc02 req-f88ca1b6-ef67-4002-b241-f6bc11fd4ffa service nova] Creating event network-changed:01306531-3518-45b4-ae5b-35d7b905b368 for instance 911f368c-5a4e-4f89-83e8-52d02202bbc4 on n-h1-862686-1 Oct 26 13:43:42.682202 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-3883da3a-bb5b-46e5-870d-6061eb7bcc02 req-f88ca1b6-ef67-4002-b241-f6bc11fd4ffa service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067130 Oct 26 13:43:42.682886 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3151/6261] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:43:42.940981 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-eb1f8f0a-8e05-4c04-9efd-c58ccaa62ab8 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:42.942858 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-eb1f8f0a-8e05-4c04-9efd-c58ccaa62ab8 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] [instance: 54cef59c-a846-4db7-8bae-ac0e2ee71b40] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:42.945445 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ad6f56bb-0d3d-4ed7-8298-de686301add1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:42.946195 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ad6f56bb-0d3d-4ed7-8298-de686301add1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:42.952803 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eb1f8f0a-8e05-4c04-9efd-c58ccaa62ab8 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:42.953713 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eb1f8f0a-8e05-4c04-9efd-c58ccaa62ab8 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:42.954663 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eb1f8f0a-8e05-4c04-9efd-c58ccaa62ab8 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:42.955631 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eb1f8f0a-8e05-4c04-9efd-c58ccaa62ab8 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:42.956474 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eb1f8f0a-8e05-4c04-9efd-c58ccaa62ab8 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:42.957135 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eb1f8f0a-8e05-4c04-9efd-c58ccaa62ab8 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:42.965740 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ad6f56bb-0d3d-4ed7-8298-de686301add1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:42.966258 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ad6f56bb-0d3d-4ed7-8298-de686301add1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:42.966710 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ad6f56bb-0d3d-4ed7-8298-de686301add1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:42.970033 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ad6f56bb-0d3d-4ed7-8298-de686301add1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:42.970529 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ad6f56bb-0d3d-4ed7-8298-de686301add1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:42.970971 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ad6f56bb-0d3d-4ed7-8298-de686301add1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:43.128333 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-eb1f8f0a-8e05-4c04-9efd-c58ccaa62ab8 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/54cef59c-a846-4db7-8bae-ac0e2ee71b40" status: 200 len: 1421 microversion: 2.1 time: 0.192866 Oct 26 13:43:43.128944 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3111/6262] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:42 2022] GET /compute/v2.1/servers/54cef59c-a846-4db7-8bae-ac0e2ee71b40 => generated 1421 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:43:43.341310 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ad6f56bb-0d3d-4ed7-8298-de686301add1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:43:43.355689 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ad6f56bb-0d3d-4ed7-8298-de686301add1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4" status: 200 len: 1392 microversion: 2.1 time: 0.415184 Oct 26 13:43:43.371630 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3152/6263] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:42 2022] GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4 => generated 1392 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:43:44.153264 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f8d50783-27c0-40f8-9b98-d966ca1dbdd1 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:44.153929 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f8d50783-27c0-40f8-9b98-d966ca1dbdd1 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] [instance: 54cef59c-a846-4db7-8bae-ac0e2ee71b40] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:44.164196 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f8d50783-27c0-40f8-9b98-d966ca1dbdd1 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:44.166552 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f8d50783-27c0-40f8-9b98-d966ca1dbdd1 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:44.167714 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f8d50783-27c0-40f8-9b98-d966ca1dbdd1 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:44.168687 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f8d50783-27c0-40f8-9b98-d966ca1dbdd1 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:44.169378 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f8d50783-27c0-40f8-9b98-d966ca1dbdd1 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:44.171044 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f8d50783-27c0-40f8-9b98-d966ca1dbdd1 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:44.383738 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c6df135c-f455-4953-aa02-f0a6f867c059 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:44.384779 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c6df135c-f455-4953-aa02-f0a6f867c059 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:44.390207 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f8d50783-27c0-40f8-9b98-d966ca1dbdd1 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/54cef59c-a846-4db7-8bae-ac0e2ee71b40" status: 200 len: 1463 microversion: 2.1 time: 0.240551 Oct 26 13:43:44.405527 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c6df135c-f455-4953-aa02-f0a6f867c059 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:44.405527 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c6df135c-f455-4953-aa02-f0a6f867c059 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:44.405527 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c6df135c-f455-4953-aa02-f0a6f867c059 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:44.405527 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c6df135c-f455-4953-aa02-f0a6f867c059 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:44.405527 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c6df135c-f455-4953-aa02-f0a6f867c059 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:44.405527 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c6df135c-f455-4953-aa02-f0a6f867c059 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:44.406801 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3112/6264] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:44 2022] GET /compute/v2.1/servers/54cef59c-a846-4db7-8bae-ac0e2ee71b40 => generated 1463 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:43:44.803078 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-a7b9fbf2-990b-4234-98f7-d0643d783a2a req-9d4fcb79-f996-4b16-bb58-7cf87cb58ca9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54cef59c-a846-4db7-8bae-ac0e2ee71b40", "tag": "4bd32495-9544-4e95-952d-bc90b124eb6f"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:43:44.828240 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a7b9fbf2-990b-4234-98f7-d0643d783a2a req-9d4fcb79-f996-4b16-bb58-7cf87cb58ca9 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:44.829293 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a7b9fbf2-990b-4234-98f7-d0643d783a2a req-9d4fcb79-f996-4b16-bb58-7cf87cb58ca9 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:44.829963 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a7b9fbf2-990b-4234-98f7-d0643d783a2a req-9d4fcb79-f996-4b16-bb58-7cf87cb58ca9 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:44.847458 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-a7b9fbf2-990b-4234-98f7-d0643d783a2a req-9d4fcb79-f996-4b16-bb58-7cf87cb58ca9 service nova] Creating event network-changed:4bd32495-9544-4e95-952d-bc90b124eb6f for instance 54cef59c-a846-4db7-8bae-ac0e2ee71b40 on n-h2-862686-1 Oct 26 13:43:44.870484 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-a7b9fbf2-990b-4234-98f7-d0643d783a2a req-9d4fcb79-f996-4b16-bb58-7cf87cb58ca9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074341 Oct 26 13:43:44.880685 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3113/6265] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:43:45.086716 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c6df135c-f455-4953-aa02-f0a6f867c059 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:43:45.098276 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c6df135c-f455-4953-aa02-f0a6f867c059 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4" status: 200 len: 1392 microversion: 2.1 time: 0.718251 Oct 26 13:43:45.100218 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3153/6266] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:44 2022] GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4 => generated 1392 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:43:45.425333 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-446dc5bd-a392-47f4-8bf3-a33df2334b09 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:45.427773 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-446dc5bd-a392-47f4-8bf3-a33df2334b09 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] [instance: 54cef59c-a846-4db7-8bae-ac0e2ee71b40] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:45.435277 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-446dc5bd-a392-47f4-8bf3-a33df2334b09 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:45.436935 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-446dc5bd-a392-47f4-8bf3-a33df2334b09 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:45.437661 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-446dc5bd-a392-47f4-8bf3-a33df2334b09 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:45.438596 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-446dc5bd-a392-47f4-8bf3-a33df2334b09 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:45.439258 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-446dc5bd-a392-47f4-8bf3-a33df2334b09 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:45.439687 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-446dc5bd-a392-47f4-8bf3-a33df2334b09 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:45.608217 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-446dc5bd-a392-47f4-8bf3-a33df2334b09 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/54cef59c-a846-4db7-8bae-ac0e2ee71b40" status: 200 len: 1463 microversion: 2.1 time: 0.187205 Oct 26 13:43:45.610096 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3114/6267] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:45 2022] GET /compute/v2.1/servers/54cef59c-a846-4db7-8bae-ac0e2ee71b40 => generated 1463 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:43:46.125086 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9f8ef42c-a113-4523-bd02-8f5fbd640ba1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:46.125725 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9f8ef42c-a113-4523-bd02-8f5fbd640ba1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:46.136796 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9f8ef42c-a113-4523-bd02-8f5fbd640ba1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:46.137298 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9f8ef42c-a113-4523-bd02-8f5fbd640ba1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:46.137759 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9f8ef42c-a113-4523-bd02-8f5fbd640ba1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:46.143912 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9f8ef42c-a113-4523-bd02-8f5fbd640ba1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:46.143912 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9f8ef42c-a113-4523-bd02-8f5fbd640ba1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:46.144677 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9f8ef42c-a113-4523-bd02-8f5fbd640ba1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:46.390695 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9f8ef42c-a113-4523-bd02-8f5fbd640ba1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:43:46.407485 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9f8ef42c-a113-4523-bd02-8f5fbd640ba1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4" status: 200 len: 1392 microversion: 2.1 time: 0.286738 Oct 26 13:43:46.427308 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3154/6268] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:46 2022] GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4 => generated 1392 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:43:46.635192 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-309ce116-f207-4458-911d-cffb134bc70e tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:46.636392 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-309ce116-f207-4458-911d-cffb134bc70e tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] [instance: 54cef59c-a846-4db7-8bae-ac0e2ee71b40] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:46.643206 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-309ce116-f207-4458-911d-cffb134bc70e tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:46.643702 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-309ce116-f207-4458-911d-cffb134bc70e tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:46.644137 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-309ce116-f207-4458-911d-cffb134bc70e tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:46.644833 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-309ce116-f207-4458-911d-cffb134bc70e tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:46.645281 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-309ce116-f207-4458-911d-cffb134bc70e tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:46.645904 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-309ce116-f207-4458-911d-cffb134bc70e tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:47.178781 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-309ce116-f207-4458-911d-cffb134bc70e tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/54cef59c-a846-4db7-8bae-ac0e2ee71b40" status: 200 len: 1463 microversion: 2.1 time: 0.546903 Oct 26 13:43:47.179926 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3115/6269] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:46 2022] GET /compute/v2.1/servers/54cef59c-a846-4db7-8bae-ac0e2ee71b40 => generated 1463 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:43:47.434463 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1c21b975-c96e-42c5-abe9-05e4147db0d2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:47.436034 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1c21b975-c96e-42c5-abe9-05e4147db0d2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:47.443674 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c21b975-c96e-42c5-abe9-05e4147db0d2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:47.444466 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c21b975-c96e-42c5-abe9-05e4147db0d2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:47.445095 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c21b975-c96e-42c5-abe9-05e4147db0d2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:47.446329 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c21b975-c96e-42c5-abe9-05e4147db0d2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:47.447219 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c21b975-c96e-42c5-abe9-05e4147db0d2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:47.447886 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c21b975-c96e-42c5-abe9-05e4147db0d2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:47.785860 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1c21b975-c96e-42c5-abe9-05e4147db0d2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:43:47.795621 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1c21b975-c96e-42c5-abe9-05e4147db0d2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4" status: 200 len: 1392 microversion: 2.1 time: 0.363615 Oct 26 13:43:47.795621 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3155/6270] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:47 2022] GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4 => generated 1392 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:43:48.205330 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-64e6b97e-f8ff-47c3-a32b-ce162fb1493e tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:48.205978 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-64e6b97e-f8ff-47c3-a32b-ce162fb1493e tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] [instance: 54cef59c-a846-4db7-8bae-ac0e2ee71b40] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:48.212735 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64e6b97e-f8ff-47c3-a32b-ce162fb1493e tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:48.213221 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64e6b97e-f8ff-47c3-a32b-ce162fb1493e tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:48.213699 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64e6b97e-f8ff-47c3-a32b-ce162fb1493e tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:48.214398 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64e6b97e-f8ff-47c3-a32b-ce162fb1493e tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:48.214853 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64e6b97e-f8ff-47c3-a32b-ce162fb1493e tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:48.215281 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64e6b97e-f8ff-47c3-a32b-ce162fb1493e tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:48.431346 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-64e6b97e-f8ff-47c3-a32b-ce162fb1493e tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/54cef59c-a846-4db7-8bae-ac0e2ee71b40" status: 200 len: 1463 microversion: 2.1 time: 0.230884 Oct 26 13:43:48.431948 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3116/6271] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:48 2022] GET /compute/v2.1/servers/54cef59c-a846-4db7-8bae-ac0e2ee71b40 => generated 1463 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:43:48.817822 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a76e8956-9ce1-48f9-b5e0-97372a09ab43 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:48.819060 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a76e8956-9ce1-48f9-b5e0-97372a09ab43 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:48.826161 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a76e8956-9ce1-48f9-b5e0-97372a09ab43 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:48.826663 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a76e8956-9ce1-48f9-b5e0-97372a09ab43 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:48.827108 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a76e8956-9ce1-48f9-b5e0-97372a09ab43 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:48.828028 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a76e8956-9ce1-48f9-b5e0-97372a09ab43 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:48.828496 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a76e8956-9ce1-48f9-b5e0-97372a09ab43 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:48.828931 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a76e8956-9ce1-48f9-b5e0-97372a09ab43 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:48.989122 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a76e8956-9ce1-48f9-b5e0-97372a09ab43 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:43:48.999346 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a76e8956-9ce1-48f9-b5e0-97372a09ab43 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4" status: 200 len: 1392 microversion: 2.1 time: 0.186412 Oct 26 13:43:49.000500 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3156/6272] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:48 2022] GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4 => generated 1392 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:43:49.455259 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-79b6f0cd-d60c-4dfb-ab7a-bf8693381bb1 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:49.457032 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-79b6f0cd-d60c-4dfb-ab7a-bf8693381bb1 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] [instance: 54cef59c-a846-4db7-8bae-ac0e2ee71b40] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:49.469430 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-79b6f0cd-d60c-4dfb-ab7a-bf8693381bb1 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:49.471243 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-79b6f0cd-d60c-4dfb-ab7a-bf8693381bb1 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:49.471737 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-79b6f0cd-d60c-4dfb-ab7a-bf8693381bb1 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:49.472478 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-79b6f0cd-d60c-4dfb-ab7a-bf8693381bb1 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:49.474047 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-79b6f0cd-d60c-4dfb-ab7a-bf8693381bb1 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:49.474491 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-79b6f0cd-d60c-4dfb-ab7a-bf8693381bb1 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:49.554553 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-1e893cec-9914-48b6-a40f-a5e3f599d0c7 req-927ec8a5-a440-42ce-b639-5ce0df703d69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "911f368c-5a4e-4f89-83e8-52d02202bbc4", "name": "network-vif-plugged", "status": "completed", "tag": "01306531-3518-45b4-ae5b-35d7b905b368"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:43:49.571136 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-1e893cec-9914-48b6-a40f-a5e3f599d0c7 req-927ec8a5-a440-42ce-b639-5ce0df703d69 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:49.571672 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-1e893cec-9914-48b6-a40f-a5e3f599d0c7 req-927ec8a5-a440-42ce-b639-5ce0df703d69 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:49.572104 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-1e893cec-9914-48b6-a40f-a5e3f599d0c7 req-927ec8a5-a440-42ce-b639-5ce0df703d69 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:49.585258 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-1e893cec-9914-48b6-a40f-a5e3f599d0c7 req-927ec8a5-a440-42ce-b639-5ce0df703d69 service nova] Creating event network-vif-plugged:01306531-3518-45b4-ae5b-35d7b905b368 for instance 911f368c-5a4e-4f89-83e8-52d02202bbc4 on n-h1-862686-1 Oct 26 13:43:49.591755 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-1e893cec-9914-48b6-a40f-a5e3f599d0c7 req-927ec8a5-a440-42ce-b639-5ce0df703d69 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041120 Oct 26 13:43:49.593326 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3157/6273] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:43:49.727728 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-79b6f0cd-d60c-4dfb-ab7a-bf8693381bb1 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/54cef59c-a846-4db7-8bae-ac0e2ee71b40" status: 200 len: 1463 microversion: 2.1 time: 0.276333 Oct 26 13:43:49.733053 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3117/6274] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:49 2022] GET /compute/v2.1/servers/54cef59c-a846-4db7-8bae-ac0e2ee71b40 => generated 1463 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:43:50.027741 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ea96cbe1-341f-40e8-9c4a-c24384c973f6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:50.028447 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ea96cbe1-341f-40e8-9c4a-c24384c973f6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:50.036185 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ea96cbe1-341f-40e8-9c4a-c24384c973f6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:50.036587 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ea96cbe1-341f-40e8-9c4a-c24384c973f6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:50.037248 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ea96cbe1-341f-40e8-9c4a-c24384c973f6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:50.038022 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ea96cbe1-341f-40e8-9c4a-c24384c973f6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:50.038482 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ea96cbe1-341f-40e8-9c4a-c24384c973f6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:50.039100 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ea96cbe1-341f-40e8-9c4a-c24384c973f6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:50.189164 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ea96cbe1-341f-40e8-9c4a-c24384c973f6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:43:50.198303 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ea96cbe1-341f-40e8-9c4a-c24384c973f6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4" status: 200 len: 1392 microversion: 2.1 time: 0.175629 Oct 26 13:43:50.198928 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3158/6275] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:50 2022] GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4 => generated 1392 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:43:50.761231 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3426493d-0551-4c74-88f0-b898f76fa6e2 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:50.762003 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3426493d-0551-4c74-88f0-b898f76fa6e2 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] [instance: 54cef59c-a846-4db7-8bae-ac0e2ee71b40] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:50.765585 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:43:50.766381 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=12 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:43:50.771635 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3426493d-0551-4c74-88f0-b898f76fa6e2 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:50.772127 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3426493d-0551-4c74-88f0-b898f76fa6e2 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:50.772563 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3426493d-0551-4c74-88f0-b898f76fa6e2 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:50.773552 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3426493d-0551-4c74-88f0-b898f76fa6e2 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:50.774171 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3426493d-0551-4c74-88f0-b898f76fa6e2 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:50.774787 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3426493d-0551-4c74-88f0-b898f76fa6e2 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:50.945632 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3426493d-0551-4c74-88f0-b898f76fa6e2 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/54cef59c-a846-4db7-8bae-ac0e2ee71b40" status: 200 len: 1463 microversion: 2.1 time: 0.189269 Oct 26 13:43:50.946313 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3118/6276] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:50 2022] GET /compute/v2.1/servers/54cef59c-a846-4db7-8bae-ac0e2ee71b40 => generated 1463 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:43:51.223284 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8e457447-ca1d-4e66-8650-7a40d831b13c tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:51.223911 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8e457447-ca1d-4e66-8650-7a40d831b13c tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:51.226149 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=4 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:43:51.233568 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e457447-ca1d-4e66-8650-7a40d831b13c tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:51.234390 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e457447-ca1d-4e66-8650-7a40d831b13c tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:51.235018 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e457447-ca1d-4e66-8650-7a40d831b13c tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:51.235941 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e457447-ca1d-4e66-8650-7a40d831b13c tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:51.236578 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e457447-ca1d-4e66-8650-7a40d831b13c tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:51.237180 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e457447-ca1d-4e66-8650-7a40d831b13c tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:51.381875 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8e457447-ca1d-4e66-8650-7a40d831b13c tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:43:51.392573 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8e457447-ca1d-4e66-8650-7a40d831b13c tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4" status: 200 len: 1564 microversion: 2.1 time: 0.173004 Oct 26 13:43:51.405506 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3159/6277] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:51 2022] GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4 => generated 1564 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:43:51.419631 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c7169541-0c20-4463-aa4f-2a5bb8258038 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:51.421019 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c7169541-0c20-4463-aa4f-2a5bb8258038 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:51.430628 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c7169541-0c20-4463-aa4f-2a5bb8258038 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:51.431124 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c7169541-0c20-4463-aa4f-2a5bb8258038 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:51.431565 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c7169541-0c20-4463-aa4f-2a5bb8258038 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:51.432269 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c7169541-0c20-4463-aa4f-2a5bb8258038 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:51.432727 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c7169541-0c20-4463-aa4f-2a5bb8258038 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:51.433158 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c7169541-0c20-4463-aa4f-2a5bb8258038 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:51.609569 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-32b4b876-7dee-4f81-bf69-dd6a3e03db7f req-4e2a7e69-96da-401d-a98f-2ed95ccd791a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54cef59c-a846-4db7-8bae-ac0e2ee71b40", "name": "network-vif-plugged", "status": "completed", "tag": "4bd32495-9544-4e95-952d-bc90b124eb6f"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:43:51.619420 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-32b4b876-7dee-4f81-bf69-dd6a3e03db7f req-4e2a7e69-96da-401d-a98f-2ed95ccd791a service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:51.620010 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-32b4b876-7dee-4f81-bf69-dd6a3e03db7f req-4e2a7e69-96da-401d-a98f-2ed95ccd791a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:51.620732 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-32b4b876-7dee-4f81-bf69-dd6a3e03db7f req-4e2a7e69-96da-401d-a98f-2ed95ccd791a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:51.633680 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-32b4b876-7dee-4f81-bf69-dd6a3e03db7f req-4e2a7e69-96da-401d-a98f-2ed95ccd791a service nova] Creating event network-vif-plugged:4bd32495-9544-4e95-952d-bc90b124eb6f for instance 54cef59c-a846-4db7-8bae-ac0e2ee71b40 on n-h2-862686-1 Oct 26 13:43:51.635891 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c7169541-0c20-4463-aa4f-2a5bb8258038 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:43:51.638971 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-32b4b876-7dee-4f81-bf69-dd6a3e03db7f req-4e2a7e69-96da-401d-a98f-2ed95ccd791a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035258 Oct 26 13:43:51.639947 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3160/6278] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:43:51.649139 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c7169541-0c20-4463-aa4f-2a5bb8258038 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4" status: 200 len: 1564 microversion: 2.1 time: 0.232965 Oct 26 13:43:51.650432 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3119/6279] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:51 2022] GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4 => generated 1564 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:43:51.971198 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8c2313f1-d4b3-45d0-89e9-3949a983375c tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:51.971960 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8c2313f1-d4b3-45d0-89e9-3949a983375c tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] [instance: 54cef59c-a846-4db7-8bae-ac0e2ee71b40] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:51.978103 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8c2313f1-d4b3-45d0-89e9-3949a983375c tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:51.978601 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8c2313f1-d4b3-45d0-89e9-3949a983375c tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:51.979045 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8c2313f1-d4b3-45d0-89e9-3949a983375c tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:51.979854 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8c2313f1-d4b3-45d0-89e9-3949a983375c tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:51.980509 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8c2313f1-d4b3-45d0-89e9-3949a983375c tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:51.981021 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8c2313f1-d4b3-45d0-89e9-3949a983375c tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:52.239063 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8c2313f1-d4b3-45d0-89e9-3949a983375c tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/54cef59c-a846-4db7-8bae-ac0e2ee71b40" status: 200 len: 1463 microversion: 2.1 time: 0.272362 Oct 26 13:43:52.241520 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3161/6280] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:51 2022] GET /compute/v2.1/servers/54cef59c-a846-4db7-8bae-ac0e2ee71b40 => generated 1463 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:43:53.263091 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4e5f2fdc-fc02-4b9a-ae9c-9bc2fa9680cb tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:53.264244 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4e5f2fdc-fc02-4b9a-ae9c-9bc2fa9680cb tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] [instance: 54cef59c-a846-4db7-8bae-ac0e2ee71b40] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:53.270989 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e5f2fdc-fc02-4b9a-ae9c-9bc2fa9680cb tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:53.271703 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e5f2fdc-fc02-4b9a-ae9c-9bc2fa9680cb tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:53.272332 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e5f2fdc-fc02-4b9a-ae9c-9bc2fa9680cb tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:53.273220 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e5f2fdc-fc02-4b9a-ae9c-9bc2fa9680cb tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:53.273871 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e5f2fdc-fc02-4b9a-ae9c-9bc2fa9680cb tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:53.274468 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e5f2fdc-fc02-4b9a-ae9c-9bc2fa9680cb tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:53.506378 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4e5f2fdc-fc02-4b9a-ae9c-9bc2fa9680cb tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/54cef59c-a846-4db7-8bae-ac0e2ee71b40" status: 200 len: 1647 microversion: 2.1 time: 0.246860 Oct 26 13:43:53.517686 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3120/6281] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:53 2022] GET /compute/v2.1/servers/54cef59c-a846-4db7-8bae-ac0e2ee71b40 => generated 1647 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:43:53.529745 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-689050e5-a84d-47c8-833a-b285b57b3aaf tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:53.530518 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-689050e5-a84d-47c8-833a-b285b57b3aaf tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] [instance: 54cef59c-a846-4db7-8bae-ac0e2ee71b40] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:53.537560 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-689050e5-a84d-47c8-833a-b285b57b3aaf tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:53.538059 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-689050e5-a84d-47c8-833a-b285b57b3aaf tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:53.538518 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-689050e5-a84d-47c8-833a-b285b57b3aaf tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:53.539215 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-689050e5-a84d-47c8-833a-b285b57b3aaf tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:53.539674 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-689050e5-a84d-47c8-833a-b285b57b3aaf tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:53.540101 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-689050e5-a84d-47c8-833a-b285b57b3aaf tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:53.751928 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-689050e5-a84d-47c8-833a-b285b57b3aaf tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/54cef59c-a846-4db7-8bae-ac0e2ee71b40" status: 200 len: 1647 microversion: 2.1 time: 0.226334 Oct 26 13:43:53.766094 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3162/6282] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:53 2022] GET /compute/v2.1/servers/54cef59c-a846-4db7-8bae-ac0e2ee71b40 => generated 1647 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:43:53.775495 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a0102fe3-9076-4ce8-9d39-f1ce19b62431 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:53.776751 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a0102fe3-9076-4ce8-9d39-f1ce19b62431 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] [instance: 54cef59c-a846-4db7-8bae-ac0e2ee71b40] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:53.784408 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0102fe3-9076-4ce8-9d39-f1ce19b62431 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:53.785156 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0102fe3-9076-4ce8-9d39-f1ce19b62431 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:53.785793 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0102fe3-9076-4ce8-9d39-f1ce19b62431 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:53.786668 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0102fe3-9076-4ce8-9d39-f1ce19b62431 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:53.787328 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0102fe3-9076-4ce8-9d39-f1ce19b62431 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:53.788137 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0102fe3-9076-4ce8-9d39-f1ce19b62431 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:53.817108 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a91bbdd7-cc2e-4ab4-a8a0-c770ce0470c1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:53.818102 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a91bbdd7-cc2e-4ab4-a8a0-c770ce0470c1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:53.824605 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a91bbdd7-cc2e-4ab4-a8a0-c770ce0470c1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:53.829913 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a91bbdd7-cc2e-4ab4-a8a0-c770ce0470c1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:53.830381 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a91bbdd7-cc2e-4ab4-a8a0-c770ce0470c1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:53.831136 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a91bbdd7-cc2e-4ab4-a8a0-c770ce0470c1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:53.831608 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a91bbdd7-cc2e-4ab4-a8a0-c770ce0470c1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:53.832043 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a91bbdd7-cc2e-4ab4-a8a0-c770ce0470c1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:53.980729 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a0102fe3-9076-4ce8-9d39-f1ce19b62431 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/54cef59c-a846-4db7-8bae-ac0e2ee71b40" status: 200 len: 1647 microversion: 2.1 time: 0.209285 Oct 26 13:43:53.986372 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3121/6283] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:53 2022] GET /compute/v2.1/servers/54cef59c-a846-4db7-8bae-ac0e2ee71b40 => generated 1647 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:43:53.987035 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-10e0730f-bd55-47ff-b6eb-2881eae2db03 req-6bc84cc2-709d-4c51-9c5a-44bc0401890c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "911f368c-5a4e-4f89-83e8-52d02202bbc4", "tag": "01306531-3518-45b4-ae5b-35d7b905b368"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:43:53.998834 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-10e0730f-bd55-47ff-b6eb-2881eae2db03 req-6bc84cc2-709d-4c51-9c5a-44bc0401890c service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:53.999573 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-10e0730f-bd55-47ff-b6eb-2881eae2db03 req-6bc84cc2-709d-4c51-9c5a-44bc0401890c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:54.000025 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-10e0730f-bd55-47ff-b6eb-2881eae2db03 req-6bc84cc2-709d-4c51-9c5a-44bc0401890c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:54.028207 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-10e0730f-bd55-47ff-b6eb-2881eae2db03 req-6bc84cc2-709d-4c51-9c5a-44bc0401890c service nova] Creating event network-changed:01306531-3518-45b4-ae5b-35d7b905b368 for instance 911f368c-5a4e-4f89-83e8-52d02202bbc4 on n-h1-862686-1 Oct 26 13:43:54.039966 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-10e0730f-bd55-47ff-b6eb-2881eae2db03 req-6bc84cc2-709d-4c51-9c5a-44bc0401890c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057368 Oct 26 13:43:54.041679 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3122/6284] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:43:54.066672 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f2baa7e1-5177-47a3-9190-b338847422ce tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-55488287", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "availability_zone": "nova:n-h1-862686-1", "networks": [{"uuid": "0977e2e9-dda4-4319-8583-43c2b66f61ca"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:43:54.110585 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a91bbdd7-cc2e-4ab4-a8a0-c770ce0470c1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:43:54.122260 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a91bbdd7-cc2e-4ab4-a8a0-c770ce0470c1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4" status: 200 len: 1564 microversion: 2.1 time: 0.309956 Oct 26 13:43:54.122970 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3163/6285] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:53 2022] GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4 => generated 1564 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:43:54.143433 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-f2baa7e1-5177-47a3-9190-b338847422ce tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] validate_networks() for [('0977e2e9-dda4-4319-8583-43c2b66f61ca', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:43:54.599398 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-f2baa7e1-5177-47a3-9190-b338847422ce tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:43:54.599999 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-f2baa7e1-5177-47a3-9190-b338847422ce tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:43:54.600291 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-f2baa7e1-5177-47a3-9190-b338847422ce tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:43:54.600701 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-f2baa7e1-5177-47a3-9190-b338847422ce tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:43:54.601325 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-f2baa7e1-5177-47a3-9190-b338847422ce tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:43:54.611471 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2baa7e1-5177-47a3-9190-b338847422ce tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:54.611959 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2baa7e1-5177-47a3-9190-b338847422ce tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:54.612404 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2baa7e1-5177-47a3-9190-b338847422ce tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:54.613312 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2baa7e1-5177-47a3-9190-b338847422ce tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:54.613954 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2baa7e1-5177-47a3-9190-b338847422ce tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:54.614596 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f2baa7e1-5177-47a3-9190-b338847422ce tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:54.633149 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-f2baa7e1-5177-47a3-9190-b338847422ce tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Getting quotas for project 924262ce1ddf4f598b48a3e428c016d6. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:43:54.638550 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-f2baa7e1-5177-47a3-9190-b338847422ce tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Getting quotas for user 7ab587dc0c72424ab5d5f2e7f25cadf3 and project 924262ce1ddf4f598b48a3e428c016d6. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:43:54.651987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f2baa7e1-5177-47a3-9190-b338847422ce tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:43:54.654635 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f2baa7e1-5177-47a3-9190-b338847422ce tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] [instance: 737c3161-0344-4f8d-a69e-7c94ab9d5b11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:43:54.704498 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f2baa7e1-5177-47a3-9190-b338847422ce tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.642097 Oct 26 13:43:54.711458 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3123/6286] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:43:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:43:54.718430 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b31a67b1-16d1-4bc4-961a-6a3b0d273158 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:54.719657 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b31a67b1-16d1-4bc4-961a-6a3b0d273158 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] [instance: 737c3161-0344-4f8d-a69e-7c94ab9d5b11] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:54.859128 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b31a67b1-16d1-4bc4-961a-6a3b0d273158 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/737c3161-0344-4f8d-a69e-7c94ab9d5b11" status: 200 len: 1327 microversion: 2.1 time: 0.145634 Oct 26 13:43:54.881759 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3164/6287] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:54 2022] GET /compute/v2.1/servers/737c3161-0344-4f8d-a69e-7c94ab9d5b11 => generated 1327 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:43:55.891382 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b055e63d-536d-46bc-8303-373762b0619a tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:55.892010 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b055e63d-536d-46bc-8303-373762b0619a tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] [instance: 737c3161-0344-4f8d-a69e-7c94ab9d5b11] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:55.919491 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b055e63d-536d-46bc-8303-373762b0619a tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:55.920710 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b055e63d-536d-46bc-8303-373762b0619a tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:55.921013 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b055e63d-536d-46bc-8303-373762b0619a tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:55.922767 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b055e63d-536d-46bc-8303-373762b0619a tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:55.923237 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b055e63d-536d-46bc-8303-373762b0619a tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:55.923674 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b055e63d-536d-46bc-8303-373762b0619a tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:56.079395 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b055e63d-536d-46bc-8303-373762b0619a tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/737c3161-0344-4f8d-a69e-7c94ab9d5b11" status: 200 len: 1414 microversion: 2.1 time: 0.194910 Oct 26 13:43:56.081258 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3124/6288] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:55 2022] GET /compute/v2.1/servers/737c3161-0344-4f8d-a69e-7c94ab9d5b11 => generated 1414 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:43:56.758014 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6f6578b5-3c2f-46ff-ad52-9c53f6669de6 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Action: 'create', calling method: .version_select at 0x7f673121e940>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-886371877", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPgBMrIsW6//C82ldqKjOJsv9PbS6PORV1V5bVzqULlff6O6qaENp/mqpSDpDFvgq9jL+RyomqcmdSsj5qYClh9RNHRkIhZ7o12LwlXc2F3txTyGqqkp+Qp7ThF5p7xDag=="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:43:56.779665 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-6f6578b5-3c2f-46ff-ad52-9c53f6669de6 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Getting quotas for project 8af2ca8f7890421180d124123db3387f. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:43:56.785731 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-6f6578b5-3c2f-46ff-ad52-9c53f6669de6 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Getting quotas for user 3fe5aa8de6e24f1faf309f7e3e9a478c and project 8af2ca8f7890421180d124123db3387f. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:43:56.815729 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6f6578b5-3c2f-46ff-ad52-9c53f6669de6 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.061573 Oct 26 13:43:56.817053 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3165/6289] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 13:43:56 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:43:57.108936 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6b8cf032-6059-45ac-bef4-60b27f1f6ede tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:57.110367 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6b8cf032-6059-45ac-bef4-60b27f1f6ede tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] [instance: 737c3161-0344-4f8d-a69e-7c94ab9d5b11] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:57.119043 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b8cf032-6059-45ac-bef4-60b27f1f6ede tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:57.119724 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b8cf032-6059-45ac-bef4-60b27f1f6ede tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:57.120417 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b8cf032-6059-45ac-bef4-60b27f1f6ede tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:57.121435 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b8cf032-6059-45ac-bef4-60b27f1f6ede tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:57.122589 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b8cf032-6059-45ac-bef4-60b27f1f6ede tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:57.123587 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b8cf032-6059-45ac-bef4-60b27f1f6ede tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:57.411157 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6b8cf032-6059-45ac-bef4-60b27f1f6ede tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/737c3161-0344-4f8d-a69e-7c94ab9d5b11" status: 200 len: 1462 microversion: 2.1 time: 0.308223 Oct 26 13:43:57.417831 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3125/6290] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:57 2022] GET /compute/v2.1/servers/737c3161-0344-4f8d-a69e-7c94ab9d5b11 => generated 1462 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:43:58.437834 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-391985c9-4fe1-43dd-bbb4-4548693c62c7 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:58.438462 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-391985c9-4fe1-43dd-bbb4-4548693c62c7 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] [instance: 737c3161-0344-4f8d-a69e-7c94ab9d5b11] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:58.448778 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-391985c9-4fe1-43dd-bbb4-4548693c62c7 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:58.451630 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-391985c9-4fe1-43dd-bbb4-4548693c62c7 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:58.452384 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-391985c9-4fe1-43dd-bbb4-4548693c62c7 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:58.454080 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-391985c9-4fe1-43dd-bbb4-4548693c62c7 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:58.454843 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-391985c9-4fe1-43dd-bbb4-4548693c62c7 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:58.455549 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-391985c9-4fe1-43dd-bbb4-4548693c62c7 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:58.713788 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-391985c9-4fe1-43dd-bbb4-4548693c62c7 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/737c3161-0344-4f8d-a69e-7c94ab9d5b11" status: 200 len: 1462 microversion: 2.1 time: 0.279003 Oct 26 13:43:58.714425 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3166/6291] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:58 2022] GET /compute/v2.1/servers/737c3161-0344-4f8d-a69e-7c94ab9d5b11 => generated 1462 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:43:58.860201 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-c3eae686-2400-4a24-b31e-77486de938e5 req-379e19f1-0458-4591-a8f5-1e9b76d6a3ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "737c3161-0344-4f8d-a69e-7c94ab9d5b11", "tag": "4c154951-4126-41e1-bd35-f03903d38498"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:43:58.908280 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-c3eae686-2400-4a24-b31e-77486de938e5 req-379e19f1-0458-4591-a8f5-1e9b76d6a3ee service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:58.908789 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-c3eae686-2400-4a24-b31e-77486de938e5 req-379e19f1-0458-4591-a8f5-1e9b76d6a3ee service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:58.909227 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-c3eae686-2400-4a24-b31e-77486de938e5 req-379e19f1-0458-4591-a8f5-1e9b76d6a3ee service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:58.946932 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-c3eae686-2400-4a24-b31e-77486de938e5 req-379e19f1-0458-4591-a8f5-1e9b76d6a3ee service nova] Creating event network-changed:4c154951-4126-41e1-bd35-f03903d38498 for instance 737c3161-0344-4f8d-a69e-7c94ab9d5b11 on n-h1-862686-1 Oct 26 13:43:58.966157 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-c3eae686-2400-4a24-b31e-77486de938e5 req-379e19f1-0458-4591-a8f5-1e9b76d6a3ee service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111163 Oct 26 13:43:58.968964 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3126/6292] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:43:59.084979 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ef95ce67-f80c-4e5f-8e83-9524096bc0c3 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1130046314", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "0b600914-91f1-408c-9745-63b4a275db10"}], "key_name": "tempest-TestNetworkBasicOps-886371877", "security_groups": [{"name": "tempest-secgroup-smoke-543430490"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:43:59.237424 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c03732a9-e481-40a2-963d-4608080fcdb3 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:59.238047 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c03732a9-e481-40a2-963d-4608080fcdb3 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] [instance: 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:59.238586 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-ef95ce67-f80c-4e5f-8e83-9524096bc0c3 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] validate_networks() for [('0b600914-91f1-408c-9745-63b4a275db10', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:43:59.245119 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c03732a9-e481-40a2-963d-4608080fcdb3 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:59.246627 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c03732a9-e481-40a2-963d-4608080fcdb3 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:59.247327 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c03732a9-e481-40a2-963d-4608080fcdb3 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:59.248453 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c03732a9-e481-40a2-963d-4608080fcdb3 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:59.249171 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c03732a9-e481-40a2-963d-4608080fcdb3 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:59.249708 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c03732a9-e481-40a2-963d-4608080fcdb3 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:59.283526 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c03732a9-e481-40a2-963d-4608080fcdb3 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] 10.222.0.40 "GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.051560 Oct 26 13:43:59.284289 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3127/6293] 10.222.0.40 () {58 vars in 1293 bytes} [Wed Oct 26 13:43:59 2022] GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce/os-server-password => generated 116 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:43:59.740121 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e36000f1-5998-41d7-977b-9117899c9c91 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:43:59.740744 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e36000f1-5998-41d7-977b-9117899c9c91 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] [instance: 737c3161-0344-4f8d-a69e-7c94ab9d5b11] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:43:59.755681 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e36000f1-5998-41d7-977b-9117899c9c91 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:59.756193 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e36000f1-5998-41d7-977b-9117899c9c91 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:59.757180 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e36000f1-5998-41d7-977b-9117899c9c91 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:59.758088 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e36000f1-5998-41d7-977b-9117899c9c91 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:59.758566 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e36000f1-5998-41d7-977b-9117899c9c91 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:59.759200 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e36000f1-5998-41d7-977b-9117899c9c91 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:59.790030 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:43:59.956283 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-ef95ce67-f80c-4e5f-8e83-9524096bc0c3 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:43:59.957052 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-ef95ce67-f80c-4e5f-8e83-9524096bc0c3 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:43:59.957559 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-ef95ce67-f80c-4e5f-8e83-9524096bc0c3 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:43:59.958168 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-ef95ce67-f80c-4e5f-8e83-9524096bc0c3 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:43:59.958797 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-ef95ce67-f80c-4e5f-8e83-9524096bc0c3 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:43:59.965455 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e36000f1-5998-41d7-977b-9117899c9c91 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/737c3161-0344-4f8d-a69e-7c94ab9d5b11" status: 200 len: 1462 microversion: 2.1 time: 0.229033 Oct 26 13:43:59.967626 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3128/6294] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:43:59 2022] GET /compute/v2.1/servers/737c3161-0344-4f8d-a69e-7c94ab9d5b11 => generated 1462 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:43:59.974255 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef95ce67-f80c-4e5f-8e83-9524096bc0c3 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:59.975349 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef95ce67-f80c-4e5f-8e83-9524096bc0c3 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:59.976427 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef95ce67-f80c-4e5f-8e83-9524096bc0c3 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:43:59.978028 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef95ce67-f80c-4e5f-8e83-9524096bc0c3 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:43:59.978678 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef95ce67-f80c-4e5f-8e83-9524096bc0c3 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:43:59.979287 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef95ce67-f80c-4e5f-8e83-9524096bc0c3 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:00.001766 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-ef95ce67-f80c-4e5f-8e83-9524096bc0c3 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Getting quotas for project 8af2ca8f7890421180d124123db3387f. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:44:00.008093 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-ef95ce67-f80c-4e5f-8e83-9524096bc0c3 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Getting quotas for user 3fe5aa8de6e24f1faf309f7e3e9a478c and project 8af2ca8f7890421180d124123db3387f. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:44:00.023436 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ef95ce67-f80c-4e5f-8e83-9524096bc0c3 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:44:00.026353 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ef95ce67-f80c-4e5f-8e83-9524096bc0c3 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: b16632fa-a05c-47bc-b83a-fc5c77b64c15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:44:00.080605 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ef95ce67-f80c-4e5f-8e83-9524096bc0c3 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.999469 Oct 26 13:44:00.087618 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3167/6295] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:43:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 1001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:44:00.094219 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1ab74bca-070d-4d61-afd8-c639e0559afc tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:00.094964 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1ab74bca-070d-4d61-afd8-c639e0559afc tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: b16632fa-a05c-47bc-b83a-fc5c77b64c15] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:00.168450 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1ab74bca-070d-4d61-afd8-c639e0559afc tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe5aa8de6e24f1faf309f7e3e9a478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2ca8f7890421180d124123db3387f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:00.178969 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1ab74bca-070d-4d61-afd8-c639e0559afc tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/b16632fa-a05c-47bc-b83a-fc5c77b64c15" status: 200 len: 1248 microversion: 2.1 time: 0.089618 Oct 26 13:44:00.180189 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3129/6296] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:00 2022] GET /compute/v2.1/servers/b16632fa-a05c-47bc-b83a-fc5c77b64c15 => generated 1248 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:00.991845 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a06aa41f-b9d2-4453-ac70-f30b984f9d76 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:00.993596 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a06aa41f-b9d2-4453-ac70-f30b984f9d76 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] [instance: 737c3161-0344-4f8d-a69e-7c94ab9d5b11] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:01.001550 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a06aa41f-b9d2-4453-ac70-f30b984f9d76 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:01.002131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a06aa41f-b9d2-4453-ac70-f30b984f9d76 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:01.002682 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a06aa41f-b9d2-4453-ac70-f30b984f9d76 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:01.003519 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a06aa41f-b9d2-4453-ac70-f30b984f9d76 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:01.004050 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a06aa41f-b9d2-4453-ac70-f30b984f9d76 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:01.004704 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a06aa41f-b9d2-4453-ac70-f30b984f9d76 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:01.031601 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:44:01.165147 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a06aa41f-b9d2-4453-ac70-f30b984f9d76 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/737c3161-0344-4f8d-a69e-7c94ab9d5b11" status: 200 len: 1462 microversion: 2.1 time: 0.178669 Oct 26 13:44:01.165759 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3168/6297] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:00 2022] GET /compute/v2.1/servers/737c3161-0344-4f8d-a69e-7c94ab9d5b11 => generated 1462 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:01.204636 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f1397a27-f043-4f1e-afb2-ae6c13cbce29 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:01.205257 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f1397a27-f043-4f1e-afb2-ae6c13cbce29 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: b16632fa-a05c-47bc-b83a-fc5c77b64c15] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:01.209169 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:44:01.214163 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f1397a27-f043-4f1e-afb2-ae6c13cbce29 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:01.214724 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f1397a27-f043-4f1e-afb2-ae6c13cbce29 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:01.215102 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f1397a27-f043-4f1e-afb2-ae6c13cbce29 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:01.215798 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f1397a27-f043-4f1e-afb2-ae6c13cbce29 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:01.216258 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f1397a27-f043-4f1e-afb2-ae6c13cbce29 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:01.216914 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f1397a27-f043-4f1e-afb2-ae6c13cbce29 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:01.299320 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f1397a27-f043-4f1e-afb2-ae6c13cbce29 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe5aa8de6e24f1faf309f7e3e9a478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2ca8f7890421180d124123db3387f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:01.308633 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f1397a27-f043-4f1e-afb2-ae6c13cbce29 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/b16632fa-a05c-47bc-b83a-fc5c77b64c15" status: 200 len: 1300 microversion: 2.1 time: 0.108119 Oct 26 13:44:01.322520 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3130/6298] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:01 2022] GET /compute/v2.1/servers/b16632fa-a05c-47bc-b83a-fc5c77b64c15 => generated 1300 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:02.190875 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-909aa09f-d59d-4dbd-aee3-4ef66807ad62 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:02.192274 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-909aa09f-d59d-4dbd-aee3-4ef66807ad62 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] [instance: 737c3161-0344-4f8d-a69e-7c94ab9d5b11] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:02.202428 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-909aa09f-d59d-4dbd-aee3-4ef66807ad62 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:02.203997 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-909aa09f-d59d-4dbd-aee3-4ef66807ad62 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:02.204843 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-909aa09f-d59d-4dbd-aee3-4ef66807ad62 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:02.206524 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-909aa09f-d59d-4dbd-aee3-4ef66807ad62 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:02.207220 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-909aa09f-d59d-4dbd-aee3-4ef66807ad62 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:02.208420 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-909aa09f-d59d-4dbd-aee3-4ef66807ad62 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:02.336469 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-99d7275a-ea0c-49e0-b87c-25895ec61715 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:02.340154 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-99d7275a-ea0c-49e0-b87c-25895ec61715 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: b16632fa-a05c-47bc-b83a-fc5c77b64c15] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:02.347754 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-99d7275a-ea0c-49e0-b87c-25895ec61715 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:02.348465 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-99d7275a-ea0c-49e0-b87c-25895ec61715 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:02.349041 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-99d7275a-ea0c-49e0-b87c-25895ec61715 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:02.349788 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-99d7275a-ea0c-49e0-b87c-25895ec61715 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:02.350430 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-99d7275a-ea0c-49e0-b87c-25895ec61715 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:02.350864 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-99d7275a-ea0c-49e0-b87c-25895ec61715 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:02.490291 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-909aa09f-d59d-4dbd-aee3-4ef66807ad62 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/737c3161-0344-4f8d-a69e-7c94ab9d5b11" status: 200 len: 1462 microversion: 2.1 time: 0.303479 Oct 26 13:44:02.492546 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3169/6299] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:02 2022] GET /compute/v2.1/servers/737c3161-0344-4f8d-a69e-7c94ab9d5b11 => generated 1462 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:02.540240 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-99d7275a-ea0c-49e0-b87c-25895ec61715 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe5aa8de6e24f1faf309f7e3e9a478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2ca8f7890421180d124123db3387f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:02.552841 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-99d7275a-ea0c-49e0-b87c-25895ec61715 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/b16632fa-a05c-47bc-b83a-fc5c77b64c15" status: 200 len: 1373 microversion: 2.1 time: 0.219952 Oct 26 13:44:02.560917 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3131/6300] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:02 2022] GET /compute/v2.1/servers/b16632fa-a05c-47bc-b83a-fc5c77b64c15 => generated 1373 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:44:03.518279 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9a65fadf-fb39-46eb-8a62-a3f3e5c2ce38 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:03.519045 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9a65fadf-fb39-46eb-8a62-a3f3e5c2ce38 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] [instance: 737c3161-0344-4f8d-a69e-7c94ab9d5b11] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:03.530059 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a65fadf-fb39-46eb-8a62-a3f3e5c2ce38 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:03.534727 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a65fadf-fb39-46eb-8a62-a3f3e5c2ce38 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:03.535422 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a65fadf-fb39-46eb-8a62-a3f3e5c2ce38 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:03.536162 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a65fadf-fb39-46eb-8a62-a3f3e5c2ce38 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:03.536632 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a65fadf-fb39-46eb-8a62-a3f3e5c2ce38 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:03.545221 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a65fadf-fb39-46eb-8a62-a3f3e5c2ce38 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:03.578284 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0f48c86c-43a6-4299-aff6-cdfe3a5d8053 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:03.579514 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0f48c86c-43a6-4299-aff6-cdfe3a5d8053 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: b16632fa-a05c-47bc-b83a-fc5c77b64c15] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:03.586828 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0f48c86c-43a6-4299-aff6-cdfe3a5d8053 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:03.587531 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0f48c86c-43a6-4299-aff6-cdfe3a5d8053 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:03.588175 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0f48c86c-43a6-4299-aff6-cdfe3a5d8053 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:03.589055 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0f48c86c-43a6-4299-aff6-cdfe3a5d8053 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:03.589728 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0f48c86c-43a6-4299-aff6-cdfe3a5d8053 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:03.590330 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0f48c86c-43a6-4299-aff6-cdfe3a5d8053 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:03.743209 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0f48c86c-43a6-4299-aff6-cdfe3a5d8053 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe5aa8de6e24f1faf309f7e3e9a478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2ca8f7890421180d124123db3387f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:03.754855 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0f48c86c-43a6-4299-aff6-cdfe3a5d8053 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/b16632fa-a05c-47bc-b83a-fc5c77b64c15" status: 200 len: 1373 microversion: 2.1 time: 0.180952 Oct 26 13:44:03.755453 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3132/6301] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:03 2022] GET /compute/v2.1/servers/b16632fa-a05c-47bc-b83a-fc5c77b64c15 => generated 1373 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:03.785724 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-1993b561-b5f5-47c3-b1ac-765abe58e22d req-dba8afec-8765-4b68-846c-2493cf1d28bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b16632fa-a05c-47bc-b83a-fc5c77b64c15", "tag": "272a719b-73cd-4787-a848-b4395df9932d"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:44:03.802488 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-1993b561-b5f5-47c3-b1ac-765abe58e22d req-dba8afec-8765-4b68-846c-2493cf1d28bb service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:03.804105 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-1993b561-b5f5-47c3-b1ac-765abe58e22d req-dba8afec-8765-4b68-846c-2493cf1d28bb service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:03.804549 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-1993b561-b5f5-47c3-b1ac-765abe58e22d req-dba8afec-8765-4b68-846c-2493cf1d28bb service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:03.817536 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-1993b561-b5f5-47c3-b1ac-765abe58e22d req-dba8afec-8765-4b68-846c-2493cf1d28bb service nova] Creating event network-changed:272a719b-73cd-4787-a848-b4395df9932d for instance b16632fa-a05c-47bc-b83a-fc5c77b64c15 on n-h1-862686-1 Oct 26 13:44:03.823566 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-1993b561-b5f5-47c3-b1ac-765abe58e22d req-dba8afec-8765-4b68-846c-2493cf1d28bb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041777 Oct 26 13:44:03.824895 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3133/6302] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:44:03.902812 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9a65fadf-fb39-46eb-8a62-a3f3e5c2ce38 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/737c3161-0344-4f8d-a69e-7c94ab9d5b11" status: 200 len: 1462 microversion: 2.1 time: 0.389592 Oct 26 13:44:03.904850 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3170/6303] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:03 2022] GET /compute/v2.1/servers/737c3161-0344-4f8d-a69e-7c94ab9d5b11 => generated 1462 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:04.778919 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-26b48820-fccb-4e4d-bc21-9d2c7e446c24 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:04.780341 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-26b48820-fccb-4e4d-bc21-9d2c7e446c24 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: b16632fa-a05c-47bc-b83a-fc5c77b64c15] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:04.784464 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:44:04.789652 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26b48820-fccb-4e4d-bc21-9d2c7e446c24 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:04.790422 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26b48820-fccb-4e4d-bc21-9d2c7e446c24 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:04.790871 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26b48820-fccb-4e4d-bc21-9d2c7e446c24 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:04.791601 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26b48820-fccb-4e4d-bc21-9d2c7e446c24 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:04.792068 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26b48820-fccb-4e4d-bc21-9d2c7e446c24 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:04.792753 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26b48820-fccb-4e4d-bc21-9d2c7e446c24 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:04.927188 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ef33e373-820e-48b5-b5ba-b7cc9510ce3b tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:04.928018 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ef33e373-820e-48b5-b5ba-b7cc9510ce3b tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] [instance: 737c3161-0344-4f8d-a69e-7c94ab9d5b11] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:04.940813 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef33e373-820e-48b5-b5ba-b7cc9510ce3b tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:04.941550 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef33e373-820e-48b5-b5ba-b7cc9510ce3b tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:04.942764 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef33e373-820e-48b5-b5ba-b7cc9510ce3b tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:04.943667 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef33e373-820e-48b5-b5ba-b7cc9510ce3b tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:04.944123 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef33e373-820e-48b5-b5ba-b7cc9510ce3b tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:04.944674 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef33e373-820e-48b5-b5ba-b7cc9510ce3b tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:05.022287 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-26b48820-fccb-4e4d-bc21-9d2c7e446c24 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe5aa8de6e24f1faf309f7e3e9a478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2ca8f7890421180d124123db3387f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:05.034749 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-26b48820-fccb-4e4d-bc21-9d2c7e446c24 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/b16632fa-a05c-47bc-b83a-fc5c77b64c15" status: 200 len: 1373 microversion: 2.1 time: 0.259906 Oct 26 13:44:05.035970 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3134/6304] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:04 2022] GET /compute/v2.1/servers/b16632fa-a05c-47bc-b83a-fc5c77b64c15 => generated 1373 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:05.178386 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ef33e373-820e-48b5-b5ba-b7cc9510ce3b tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/737c3161-0344-4f8d-a69e-7c94ab9d5b11" status: 200 len: 1462 microversion: 2.1 time: 0.255120 Oct 26 13:44:05.179455 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3171/6305] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:04 2022] GET /compute/v2.1/servers/737c3161-0344-4f8d-a69e-7c94ab9d5b11 => generated 1462 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:05.526817 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-e3b80b7f-6ff0-4fa2-a424-73922afb8c8c req-735e9030-e619-4e9c-89fa-6b674762920f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "737c3161-0344-4f8d-a69e-7c94ab9d5b11", "name": "network-vif-plugged", "status": "completed", "tag": "4c154951-4126-41e1-bd35-f03903d38498"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:44:05.542949 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-e3b80b7f-6ff0-4fa2-a424-73922afb8c8c req-735e9030-e619-4e9c-89fa-6b674762920f service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:05.544404 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-e3b80b7f-6ff0-4fa2-a424-73922afb8c8c req-735e9030-e619-4e9c-89fa-6b674762920f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:05.545806 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-e3b80b7f-6ff0-4fa2-a424-73922afb8c8c req-735e9030-e619-4e9c-89fa-6b674762920f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:05.559216 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-e3b80b7f-6ff0-4fa2-a424-73922afb8c8c req-735e9030-e619-4e9c-89fa-6b674762920f service nova] Creating event network-vif-plugged:4c154951-4126-41e1-bd35-f03903d38498 for instance 737c3161-0344-4f8d-a69e-7c94ab9d5b11 on n-h1-862686-1 Oct 26 13:44:05.565307 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-e3b80b7f-6ff0-4fa2-a424-73922afb8c8c req-735e9030-e619-4e9c-89fa-6b674762920f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042503 Oct 26 13:44:05.566687 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3135/6306] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:44:06.079545 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9de54d74-fdaf-474e-8ee6-f5febb3531b1 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:06.082920 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9de54d74-fdaf-474e-8ee6-f5febb3531b1 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: b16632fa-a05c-47bc-b83a-fc5c77b64c15] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:06.101852 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9de54d74-fdaf-474e-8ee6-f5febb3531b1 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:06.102686 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9de54d74-fdaf-474e-8ee6-f5febb3531b1 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:06.103511 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9de54d74-fdaf-474e-8ee6-f5febb3531b1 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:06.104452 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9de54d74-fdaf-474e-8ee6-f5febb3531b1 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:06.105339 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9de54d74-fdaf-474e-8ee6-f5febb3531b1 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:06.106048 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9de54d74-fdaf-474e-8ee6-f5febb3531b1 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:06.209956 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-414b24c0-347d-4d6b-a927-8cd184259059 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:06.211913 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-414b24c0-347d-4d6b-a927-8cd184259059 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] [instance: 737c3161-0344-4f8d-a69e-7c94ab9d5b11] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:06.225013 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-414b24c0-347d-4d6b-a927-8cd184259059 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:06.225845 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-414b24c0-347d-4d6b-a927-8cd184259059 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:06.226528 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-414b24c0-347d-4d6b-a927-8cd184259059 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:06.227666 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-414b24c0-347d-4d6b-a927-8cd184259059 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:06.228419 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-414b24c0-347d-4d6b-a927-8cd184259059 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:06.231048 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-414b24c0-347d-4d6b-a927-8cd184259059 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:06.385808 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9de54d74-fdaf-474e-8ee6-f5febb3531b1 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe5aa8de6e24f1faf309f7e3e9a478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2ca8f7890421180d124123db3387f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:06.399713 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9de54d74-fdaf-474e-8ee6-f5febb3531b1 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/b16632fa-a05c-47bc-b83a-fc5c77b64c15" status: 200 len: 1373 microversion: 2.1 time: 0.339375 Oct 26 13:44:06.414950 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3172/6307] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:06 2022] GET /compute/v2.1/servers/b16632fa-a05c-47bc-b83a-fc5c77b64c15 => generated 1373 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:06.509224 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-414b24c0-347d-4d6b-a927-8cd184259059 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/737c3161-0344-4f8d-a69e-7c94ab9d5b11" status: 200 len: 1462 microversion: 2.1 time: 0.303379 Oct 26 13:44:06.522098 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3136/6308] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:06 2022] GET /compute/v2.1/servers/737c3161-0344-4f8d-a69e-7c94ab9d5b11 => generated 1462 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:07.428703 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9816a086-37f2-4d53-b324-39f1cfde5fc9 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:07.429771 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9816a086-37f2-4d53-b324-39f1cfde5fc9 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: b16632fa-a05c-47bc-b83a-fc5c77b64c15] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:07.441101 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9816a086-37f2-4d53-b324-39f1cfde5fc9 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:07.441843 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9816a086-37f2-4d53-b324-39f1cfde5fc9 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:07.442670 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9816a086-37f2-4d53-b324-39f1cfde5fc9 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:07.444683 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9816a086-37f2-4d53-b324-39f1cfde5fc9 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:07.445352 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9816a086-37f2-4d53-b324-39f1cfde5fc9 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:07.445986 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9816a086-37f2-4d53-b324-39f1cfde5fc9 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:07.541462 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-98be5c5b-452c-44f8-94bb-5ffe934c6370 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:07.543415 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-98be5c5b-452c-44f8-94bb-5ffe934c6370 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] [instance: 737c3161-0344-4f8d-a69e-7c94ab9d5b11] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:07.559391 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-98be5c5b-452c-44f8-94bb-5ffe934c6370 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:07.568749 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-98be5c5b-452c-44f8-94bb-5ffe934c6370 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:07.576983 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-98be5c5b-452c-44f8-94bb-5ffe934c6370 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:07.578026 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-98be5c5b-452c-44f8-94bb-5ffe934c6370 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:07.578026 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-98be5c5b-452c-44f8-94bb-5ffe934c6370 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:07.578312 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-98be5c5b-452c-44f8-94bb-5ffe934c6370 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:07.894447 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9816a086-37f2-4d53-b324-39f1cfde5fc9 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe5aa8de6e24f1faf309f7e3e9a478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2ca8f7890421180d124123db3387f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:07.916741 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9816a086-37f2-4d53-b324-39f1cfde5fc9 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/b16632fa-a05c-47bc-b83a-fc5c77b64c15" status: 200 len: 1373 microversion: 2.1 time: 0.494359 Oct 26 13:44:07.917683 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3173/6309] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:07 2022] GET /compute/v2.1/servers/b16632fa-a05c-47bc-b83a-fc5c77b64c15 => generated 1373 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:08.200003 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-98be5c5b-452c-44f8-94bb-5ffe934c6370 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/737c3161-0344-4f8d-a69e-7c94ab9d5b11" status: 200 len: 1645 microversion: 2.1 time: 0.666032 Oct 26 13:44:08.200918 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3137/6310] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:07 2022] GET /compute/v2.1/servers/737c3161-0344-4f8d-a69e-7c94ab9d5b11 => generated 1645 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:08.224162 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-37f9106b-5f73-40a1-8078-682cff6faf9b tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:08.225107 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-37f9106b-5f73-40a1-8078-682cff6faf9b tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] [instance: 737c3161-0344-4f8d-a69e-7c94ab9d5b11] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:08.233076 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:44:08.235004 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-37f9106b-5f73-40a1-8078-682cff6faf9b tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:08.235772 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-37f9106b-5f73-40a1-8078-682cff6faf9b tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:08.236382 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-37f9106b-5f73-40a1-8078-682cff6faf9b tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:08.237544 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-37f9106b-5f73-40a1-8078-682cff6faf9b tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:08.238177 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-37f9106b-5f73-40a1-8078-682cff6faf9b tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:08.238794 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-37f9106b-5f73-40a1-8078-682cff6faf9b tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:08.480191 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-37f9106b-5f73-40a1-8078-682cff6faf9b tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/737c3161-0344-4f8d-a69e-7c94ab9d5b11" status: 200 len: 1645 microversion: 2.1 time: 0.260223 Oct 26 13:44:08.481924 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3174/6311] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:08 2022] GET /compute/v2.1/servers/737c3161-0344-4f8d-a69e-7c94ab9d5b11 => generated 1645 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:08.504963 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dcc85496-0a78-46f8-82d1-c2bb54c4d2ff tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:08.505919 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-dcc85496-0a78-46f8-82d1-c2bb54c4d2ff tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] [instance: 737c3161-0344-4f8d-a69e-7c94ab9d5b11] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:08.514411 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dcc85496-0a78-46f8-82d1-c2bb54c4d2ff tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:08.514910 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dcc85496-0a78-46f8-82d1-c2bb54c4d2ff tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:08.515574 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dcc85496-0a78-46f8-82d1-c2bb54c4d2ff tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:08.516474 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dcc85496-0a78-46f8-82d1-c2bb54c4d2ff tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:08.517106 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dcc85496-0a78-46f8-82d1-c2bb54c4d2ff tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:08.517735 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dcc85496-0a78-46f8-82d1-c2bb54c4d2ff tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:08.772538 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-dcc85496-0a78-46f8-82d1-c2bb54c4d2ff tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/737c3161-0344-4f8d-a69e-7c94ab9d5b11" status: 200 len: 1645 microversion: 2.1 time: 0.270893 Oct 26 13:44:08.774703 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3138/6312] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:08 2022] GET /compute/v2.1/servers/737c3161-0344-4f8d-a69e-7c94ab9d5b11 => generated 1645 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:44:08.799040 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-aa932bcd-67f8-422a-bcb4-01a655731974 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:08.799837 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-aa932bcd-67f8-422a-bcb4-01a655731974 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] [instance: 737c3161-0344-4f8d-a69e-7c94ab9d5b11] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:08.808982 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa932bcd-67f8-422a-bcb4-01a655731974 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:08.809815 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa932bcd-67f8-422a-bcb4-01a655731974 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:08.810803 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa932bcd-67f8-422a-bcb4-01a655731974 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:08.812435 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa932bcd-67f8-422a-bcb4-01a655731974 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:08.813217 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa932bcd-67f8-422a-bcb4-01a655731974 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:08.813865 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa932bcd-67f8-422a-bcb4-01a655731974 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:08.844439 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-aa932bcd-67f8-422a-bcb4-01a655731974 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] [instance: 737c3161-0344-4f8d-a69e-7c94ab9d5b11] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:44:08.941581 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-71726749-2877-4ddd-a0fb-209ef2dc5844 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:08.942252 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-71726749-2877-4ddd-a0fb-209ef2dc5844 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: b16632fa-a05c-47bc-b83a-fc5c77b64c15] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:08.956538 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71726749-2877-4ddd-a0fb-209ef2dc5844 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:08.958167 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71726749-2877-4ddd-a0fb-209ef2dc5844 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:08.961405 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71726749-2877-4ddd-a0fb-209ef2dc5844 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:08.963600 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71726749-2877-4ddd-a0fb-209ef2dc5844 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:08.964707 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71726749-2877-4ddd-a0fb-209ef2dc5844 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:08.965425 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71726749-2877-4ddd-a0fb-209ef2dc5844 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:08.972195 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-aa932bcd-67f8-422a-bcb4-01a655731974 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] 10.222.0.40 "DELETE /compute/v2.1/servers/737c3161-0344-4f8d-a69e-7c94ab9d5b11" status: 204 len: 0 microversion: 2.1 time: 0.176781 Oct 26 13:44:08.972982 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3175/6313] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:44:08 2022] DELETE /compute/v2.1/servers/737c3161-0344-4f8d-a69e-7c94ab9d5b11 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:44:08.984602 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-03032c13-7e7b-43bb-9ea7-1c6e666dd997 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:08.985599 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-03032c13-7e7b-43bb-9ea7-1c6e666dd997 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] [instance: 737c3161-0344-4f8d-a69e-7c94ab9d5b11] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:08.993073 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03032c13-7e7b-43bb-9ea7-1c6e666dd997 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:08.996280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03032c13-7e7b-43bb-9ea7-1c6e666dd997 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:08.996280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03032c13-7e7b-43bb-9ea7-1c6e666dd997 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:08.996280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03032c13-7e7b-43bb-9ea7-1c6e666dd997 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:08.996280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03032c13-7e7b-43bb-9ea7-1c6e666dd997 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:08.997369 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03032c13-7e7b-43bb-9ea7-1c6e666dd997 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:09.154752 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-71726749-2877-4ddd-a0fb-209ef2dc5844 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe5aa8de6e24f1faf309f7e3e9a478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2ca8f7890421180d124123db3387f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:09.166047 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-71726749-2877-4ddd-a0fb-209ef2dc5844 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/b16632fa-a05c-47bc-b83a-fc5c77b64c15" status: 200 len: 1373 microversion: 2.1 time: 0.228989 Oct 26 13:44:09.166917 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3139/6314] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:08 2022] GET /compute/v2.1/servers/b16632fa-a05c-47bc-b83a-fc5c77b64c15 => generated 1373 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:44:09.234428 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-03032c13-7e7b-43bb-9ea7-1c6e666dd997 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/737c3161-0344-4f8d-a69e-7c94ab9d5b11" status: 200 len: 1651 microversion: 2.1 time: 0.256135 Oct 26 13:44:09.239306 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3176/6315] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:08 2022] GET /compute/v2.1/servers/737c3161-0344-4f8d-a69e-7c94ab9d5b11 => generated 1651 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:10.191644 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1525e716-f47d-4818-a48a-04220665b35e tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:10.192261 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1525e716-f47d-4818-a48a-04220665b35e tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: b16632fa-a05c-47bc-b83a-fc5c77b64c15] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:10.195274 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=8 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:44:10.201844 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1525e716-f47d-4818-a48a-04220665b35e tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:10.202186 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1525e716-f47d-4818-a48a-04220665b35e tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:10.202634 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1525e716-f47d-4818-a48a-04220665b35e tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:10.203356 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1525e716-f47d-4818-a48a-04220665b35e tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:10.203820 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1525e716-f47d-4818-a48a-04220665b35e tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:10.204251 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1525e716-f47d-4818-a48a-04220665b35e tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:10.263206 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7ce11e99-2c44-431c-a5b5-049da3409199 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:10.264147 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7ce11e99-2c44-431c-a5b5-049da3409199 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] [instance: 737c3161-0344-4f8d-a69e-7c94ab9d5b11] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:10.267502 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:44:10.268401 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=12 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:44:10.275316 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ce11e99-2c44-431c-a5b5-049da3409199 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:10.275972 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ce11e99-2c44-431c-a5b5-049da3409199 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:10.276419 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ce11e99-2c44-431c-a5b5-049da3409199 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:10.277351 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ce11e99-2c44-431c-a5b5-049da3409199 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:10.277864 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ce11e99-2c44-431c-a5b5-049da3409199 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:10.278327 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ce11e99-2c44-431c-a5b5-049da3409199 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:10.356919 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1525e716-f47d-4818-a48a-04220665b35e tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe5aa8de6e24f1faf309f7e3e9a478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2ca8f7890421180d124123db3387f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:10.365660 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1525e716-f47d-4818-a48a-04220665b35e tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/b16632fa-a05c-47bc-b83a-fc5c77b64c15" status: 200 len: 1373 microversion: 2.1 time: 0.177876 Oct 26 13:44:10.366261 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3140/6316] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:10 2022] GET /compute/v2.1/servers/b16632fa-a05c-47bc-b83a-fc5c77b64c15 => generated 1373 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:44:10.614713 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7ce11e99-2c44-431c-a5b5-049da3409199 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/737c3161-0344-4f8d-a69e-7c94ab9d5b11" status: 200 len: 1651 microversion: 2.1 time: 0.355008 Oct 26 13:44:10.615376 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3177/6317] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:10 2022] GET /compute/v2.1/servers/737c3161-0344-4f8d-a69e-7c94ab9d5b11 => generated 1651 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:44:10.994409 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-faf5b026-f665-43dd-b1c0-7b760d9711ee req-02012e72-6a91-465d-b9cf-b620851567b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "737c3161-0344-4f8d-a69e-7c94ab9d5b11", "name": "network-vif-deleted", "tag": "4c154951-4126-41e1-bd35-f03903d38498"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:44:11.023244 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-faf5b026-f665-43dd-b1c0-7b760d9711ee req-02012e72-6a91-465d-b9cf-b620851567b8 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:11.024196 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-faf5b026-f665-43dd-b1c0-7b760d9711ee req-02012e72-6a91-465d-b9cf-b620851567b8 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:11.024867 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-faf5b026-f665-43dd-b1c0-7b760d9711ee req-02012e72-6a91-465d-b9cf-b620851567b8 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:11.039298 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-faf5b026-f665-43dd-b1c0-7b760d9711ee req-02012e72-6a91-465d-b9cf-b620851567b8 service nova] Creating event network-vif-deleted:4c154951-4126-41e1-bd35-f03903d38498 for instance 737c3161-0344-4f8d-a69e-7c94ab9d5b11 on n-h1-862686-1 Oct 26 13:44:11.045757 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-faf5b026-f665-43dd-b1c0-7b760d9711ee req-02012e72-6a91-465d-b9cf-b620851567b8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057852 Oct 26 13:44:11.047354 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3141/6318] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:44:11.392769 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-436e6d1e-ebfa-44da-ae28-dcb5bf8f0cb1 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:11.393611 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-436e6d1e-ebfa-44da-ae28-dcb5bf8f0cb1 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: b16632fa-a05c-47bc-b83a-fc5c77b64c15] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:11.403527 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-436e6d1e-ebfa-44da-ae28-dcb5bf8f0cb1 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:11.404435 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-436e6d1e-ebfa-44da-ae28-dcb5bf8f0cb1 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:11.404902 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-436e6d1e-ebfa-44da-ae28-dcb5bf8f0cb1 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:11.405817 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-436e6d1e-ebfa-44da-ae28-dcb5bf8f0cb1 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:11.406303 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-436e6d1e-ebfa-44da-ae28-dcb5bf8f0cb1 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:11.406733 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-436e6d1e-ebfa-44da-ae28-dcb5bf8f0cb1 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:11.583747 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-436e6d1e-ebfa-44da-ae28-dcb5bf8f0cb1 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe5aa8de6e24f1faf309f7e3e9a478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2ca8f7890421180d124123db3387f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:11.608624 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-436e6d1e-ebfa-44da-ae28-dcb5bf8f0cb1 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/b16632fa-a05c-47bc-b83a-fc5c77b64c15" status: 200 len: 1373 microversion: 2.1 time: 0.222146 Oct 26 13:44:11.609224 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3178/6319] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:11 2022] GET /compute/v2.1/servers/b16632fa-a05c-47bc-b83a-fc5c77b64c15 => generated 1373 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:11.644837 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e28bf816-9462-4a06-bbfc-d9c7ef2b66d6 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:11.650234 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e28bf816-9462-4a06-bbfc-d9c7ef2b66d6 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] [instance: 737c3161-0344-4f8d-a69e-7c94ab9d5b11] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:11.664292 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e28bf816-9462-4a06-bbfc-d9c7ef2b66d6 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:11.667786 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e28bf816-9462-4a06-bbfc-d9c7ef2b66d6 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:11.669262 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e28bf816-9462-4a06-bbfc-d9c7ef2b66d6 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:11.670738 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e28bf816-9462-4a06-bbfc-d9c7ef2b66d6 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:11.672668 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e28bf816-9462-4a06-bbfc-d9c7ef2b66d6 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:11.673124 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e28bf816-9462-4a06-bbfc-d9c7ef2b66d6 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:11.690391 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-e28bf816-9462-4a06-bbfc-d9c7ef2b66d6 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] HTTP exception thrown: Instance 737c3161-0344-4f8d-a69e-7c94ab9d5b11 could not be found. Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e28bf816-9462-4a06-bbfc-d9c7ef2b66d6 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Request method failure captured: Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/737c3161-0344-4f8d-a69e-7c94ab9d5b11 HTTP/1.1 Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTmKz_IEyFRbWMfvSCnIZD-PASkSMNQICvQe1xnQqr54fcPvSzpvW7KNnpn0zbsFX5K8aEC-qj884A5vB0VeeM3D-tz0h6gDNNUVH3Jm1bApqkSiql7AVSVY7_QQAYxO41QbdZDuzrOuiLPHgoQHDoG4HhjTMyrHXJx8ZpdqWUWeOBE Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 924262ce1ddf4f598b48a3e428c016d6 Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-TestServerMultinode-446878058 Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: X-Role: admin,member,reader Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: admin,member,reader Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/924262ce1ddf4f598b48a3e428c016d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/924262ce1ddf4f598b48a3e428c016d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_924262ce1ddf4f598b48a3e428c016d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/924262ce1ddf4f598b48a3e428c016d6"}]}] Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-TestServerMultinode-446878058 Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 924262ce1ddf4f598b48a3e428c016d6 Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-TestServerMultinode-446878058 Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-TestServerMultinode-446878058-project-admin Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 7ab587dc0c72424ab5d5f2e7f25cadf3 Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-TestServerMultinode-446878058-project-admin Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 737c3161-0344-4f8d-a69e-7c94ab9d5b11 could not be found. Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '737c3161-0344-4f8d-a69e-7c94ab9d5b11'} Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 737c3161-0344-4f8d-a69e-7c94ab9d5b11 could not be found. Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 737c3161-0344-4f8d-a69e-7c94ab9d5b11 could not be found. Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:44:11.692107 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:44:11.696939 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:44:11.696939 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:44:11.696939 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:44:11.696939 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:44:11.696939 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:44:11.696939 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 737c3161-0344-4f8d-a69e-7c94ab9d5b11 could not be found. Oct 26 13:44:11.696939 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:44:11.696939 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e28bf816-9462-4a06-bbfc-d9c7ef2b66d6 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Returning 404 to user: Instance 737c3161-0344-4f8d-a69e-7c94ab9d5b11 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:44:11.696939 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e28bf816-9462-4a06-bbfc-d9c7ef2b66d6 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/737c3161-0344-4f8d-a69e-7c94ab9d5b11" status: 404 len: 111 microversion: 2.1 time: 0.056732 Oct 26 13:44:11.696939 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3142/6320] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:11 2022] GET /compute/v2.1/servers/737c3161-0344-4f8d-a69e-7c94ab9d5b11 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:44:11.703042 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-89531c06-6b25-4e6c-be09-f4f0fc4bb41f tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:11.703552 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-89531c06-6b25-4e6c-be09-f4f0fc4bb41f tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] [instance: 54cef59c-a846-4db7-8bae-ac0e2ee71b40] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:11.710083 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-89531c06-6b25-4e6c-be09-f4f0fc4bb41f tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:11.710563 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-89531c06-6b25-4e6c-be09-f4f0fc4bb41f tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:11.711001 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-89531c06-6b25-4e6c-be09-f4f0fc4bb41f tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:11.711996 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-89531c06-6b25-4e6c-be09-f4f0fc4bb41f tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:11.712157 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-89531c06-6b25-4e6c-be09-f4f0fc4bb41f tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:11.712790 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-89531c06-6b25-4e6c-be09-f4f0fc4bb41f tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:11.727605 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-f122fe3c-0fed-40fd-ac31-9a233a5ffdab req-f364d7c2-5d74-48dc-8a0d-b9d7e957a13e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b16632fa-a05c-47bc-b83a-fc5c77b64c15", "name": "network-vif-plugged", "status": "completed", "tag": "272a719b-73cd-4787-a848-b4395df9932d"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:44:11.740285 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-f122fe3c-0fed-40fd-ac31-9a233a5ffdab req-f364d7c2-5d74-48dc-8a0d-b9d7e957a13e service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:11.740873 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-f122fe3c-0fed-40fd-ac31-9a233a5ffdab req-f364d7c2-5d74-48dc-8a0d-b9d7e957a13e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:11.741676 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-f122fe3c-0fed-40fd-ac31-9a233a5ffdab req-f364d7c2-5d74-48dc-8a0d-b9d7e957a13e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:11.742705 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-89531c06-6b25-4e6c-be09-f4f0fc4bb41f tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] [instance: 54cef59c-a846-4db7-8bae-ac0e2ee71b40] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:44:11.755923 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-f122fe3c-0fed-40fd-ac31-9a233a5ffdab req-f364d7c2-5d74-48dc-8a0d-b9d7e957a13e service nova] Creating event network-vif-plugged:272a719b-73cd-4787-a848-b4395df9932d for instance b16632fa-a05c-47bc-b83a-fc5c77b64c15 on n-h1-862686-1 Oct 26 13:44:11.761909 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-f122fe3c-0fed-40fd-ac31-9a233a5ffdab req-f364d7c2-5d74-48dc-8a0d-b9d7e957a13e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038067 Oct 26 13:44:11.763948 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3143/6321] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:44:11.832455 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-89531c06-6b25-4e6c-be09-f4f0fc4bb41f tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] 10.222.0.40 "DELETE /compute/v2.1/servers/54cef59c-a846-4db7-8bae-ac0e2ee71b40" status: 204 len: 0 microversion: 2.1 time: 0.133674 Oct 26 13:44:11.833649 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3179/6322] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:44:11 2022] DELETE /compute/v2.1/servers/54cef59c-a846-4db7-8bae-ac0e2ee71b40 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 26 13:44:11.843568 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8032321c-027a-4b99-a53d-d9c96bef39bc tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:11.844569 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8032321c-027a-4b99-a53d-d9c96bef39bc tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] [instance: 54cef59c-a846-4db7-8bae-ac0e2ee71b40] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:11.854593 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8032321c-027a-4b99-a53d-d9c96bef39bc tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:11.855218 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8032321c-027a-4b99-a53d-d9c96bef39bc tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:11.855812 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8032321c-027a-4b99-a53d-d9c96bef39bc tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:11.856633 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8032321c-027a-4b99-a53d-d9c96bef39bc tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:11.857413 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8032321c-027a-4b99-a53d-d9c96bef39bc tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:11.858091 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8032321c-027a-4b99-a53d-d9c96bef39bc tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:12.002919 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8032321c-027a-4b99-a53d-d9c96bef39bc tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/54cef59c-a846-4db7-8bae-ac0e2ee71b40" status: 200 len: 1653 microversion: 2.1 time: 0.163369 Oct 26 13:44:12.002919 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3144/6323] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:11 2022] GET /compute/v2.1/servers/54cef59c-a846-4db7-8bae-ac0e2ee71b40 => generated 1653 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:12.636524 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c825064f-1c6f-4a0d-9506-a5a121d9181c tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:12.637250 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c825064f-1c6f-4a0d-9506-a5a121d9181c tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: b16632fa-a05c-47bc-b83a-fc5c77b64c15] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:12.647920 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c825064f-1c6f-4a0d-9506-a5a121d9181c tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:12.649290 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c825064f-1c6f-4a0d-9506-a5a121d9181c tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:12.650246 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c825064f-1c6f-4a0d-9506-a5a121d9181c tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:12.650989 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c825064f-1c6f-4a0d-9506-a5a121d9181c tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:12.651457 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c825064f-1c6f-4a0d-9506-a5a121d9181c tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:12.651890 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c825064f-1c6f-4a0d-9506-a5a121d9181c tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:12.890512 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c825064f-1c6f-4a0d-9506-a5a121d9181c tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe5aa8de6e24f1faf309f7e3e9a478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2ca8f7890421180d124123db3387f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:12.898426 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c825064f-1c6f-4a0d-9506-a5a121d9181c tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/b16632fa-a05c-47bc-b83a-fc5c77b64c15" status: 200 len: 1373 microversion: 2.1 time: 0.267863 Oct 26 13:44:12.899012 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3180/6324] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:12 2022] GET /compute/v2.1/servers/b16632fa-a05c-47bc-b83a-fc5c77b64c15 => generated 1373 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:13.026098 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f23fa7c5-5122-402b-8b0b-0a7b4b199f8a tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:13.026788 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f23fa7c5-5122-402b-8b0b-0a7b4b199f8a tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] [instance: 54cef59c-a846-4db7-8bae-ac0e2ee71b40] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:13.034496 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f23fa7c5-5122-402b-8b0b-0a7b4b199f8a tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:13.034998 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f23fa7c5-5122-402b-8b0b-0a7b4b199f8a tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:13.035446 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f23fa7c5-5122-402b-8b0b-0a7b4b199f8a tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:13.036165 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f23fa7c5-5122-402b-8b0b-0a7b4b199f8a tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:13.036630 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f23fa7c5-5122-402b-8b0b-0a7b4b199f8a tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:13.037097 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f23fa7c5-5122-402b-8b0b-0a7b4b199f8a tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:13.276015 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f23fa7c5-5122-402b-8b0b-0a7b4b199f8a tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/54cef59c-a846-4db7-8bae-ac0e2ee71b40" status: 200 len: 1653 microversion: 2.1 time: 0.253059 Oct 26 13:44:13.276634 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3145/6325] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:13 2022] GET /compute/v2.1/servers/54cef59c-a846-4db7-8bae-ac0e2ee71b40 => generated 1653 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:13.928250 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-9e6b7480-96a3-438c-a187-1e12b7ef163b req-d0e59b2a-f9c1-4f7d-a4ca-0fcdfe2cfb66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54cef59c-a846-4db7-8bae-ac0e2ee71b40", "name": "network-vif-deleted", "tag": "4bd32495-9544-4e95-952d-bc90b124eb6f"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:44:13.934132 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b4d5e256-46b4-48fc-b03f-981e4be3bf96 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:13.937836 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b4d5e256-46b4-48fc-b03f-981e4be3bf96 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: b16632fa-a05c-47bc-b83a-fc5c77b64c15] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:13.953838 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b4d5e256-46b4-48fc-b03f-981e4be3bf96 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:13.956012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b4d5e256-46b4-48fc-b03f-981e4be3bf96 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:13.956429 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b4d5e256-46b4-48fc-b03f-981e4be3bf96 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:13.956923 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9e6b7480-96a3-438c-a187-1e12b7ef163b req-d0e59b2a-f9c1-4f7d-a4ca-0fcdfe2cfb66 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:13.957642 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9e6b7480-96a3-438c-a187-1e12b7ef163b req-d0e59b2a-f9c1-4f7d-a4ca-0fcdfe2cfb66 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:13.958848 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b4d5e256-46b4-48fc-b03f-981e4be3bf96 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:13.959791 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9e6b7480-96a3-438c-a187-1e12b7ef163b req-d0e59b2a-f9c1-4f7d-a4ca-0fcdfe2cfb66 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:13.960773 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b4d5e256-46b4-48fc-b03f-981e4be3bf96 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:13.962191 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b4d5e256-46b4-48fc-b03f-981e4be3bf96 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:13.991878 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-9e6b7480-96a3-438c-a187-1e12b7ef163b req-d0e59b2a-f9c1-4f7d-a4ca-0fcdfe2cfb66 service nova] Creating event network-vif-deleted:4bd32495-9544-4e95-952d-bc90b124eb6f for instance 54cef59c-a846-4db7-8bae-ac0e2ee71b40 on n-h2-862686-1 Oct 26 13:44:14.006086 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-9e6b7480-96a3-438c-a187-1e12b7ef163b req-d0e59b2a-f9c1-4f7d-a4ca-0fcdfe2cfb66 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084127 Oct 26 13:44:14.007407 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3146/6326] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:44:14.194463 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b4d5e256-46b4-48fc-b03f-981e4be3bf96 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe5aa8de6e24f1faf309f7e3e9a478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2ca8f7890421180d124123db3387f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:14.202684 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:44:14.212895 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b4d5e256-46b4-48fc-b03f-981e4be3bf96 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/b16632fa-a05c-47bc-b83a-fc5c77b64c15" status: 200 len: 1546 microversion: 2.1 time: 0.294175 Oct 26 13:44:14.214008 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3181/6327] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:13 2022] GET /compute/v2.1/servers/b16632fa-a05c-47bc-b83a-fc5c77b64c15 => generated 1546 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:14.237918 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ddc4636c-cd08-45e1-9c9b-873eacc11339 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:14.239688 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ddc4636c-cd08-45e1-9c9b-873eacc11339 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: b16632fa-a05c-47bc-b83a-fc5c77b64c15] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:14.248954 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ddc4636c-cd08-45e1-9c9b-873eacc11339 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:14.251298 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ddc4636c-cd08-45e1-9c9b-873eacc11339 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:14.252147 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ddc4636c-cd08-45e1-9c9b-873eacc11339 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:14.252868 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ddc4636c-cd08-45e1-9c9b-873eacc11339 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:14.253544 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ddc4636c-cd08-45e1-9c9b-873eacc11339 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:14.254300 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ddc4636c-cd08-45e1-9c9b-873eacc11339 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:14.303161 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e14e8cfe-8c08-42af-af02-7701fbde2517 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:14.304141 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e14e8cfe-8c08-42af-af02-7701fbde2517 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] [instance: 54cef59c-a846-4db7-8bae-ac0e2ee71b40] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:14.315528 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e14e8cfe-8c08-42af-af02-7701fbde2517 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:14.316241 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e14e8cfe-8c08-42af-af02-7701fbde2517 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:14.320506 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e14e8cfe-8c08-42af-af02-7701fbde2517 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:14.321525 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e14e8cfe-8c08-42af-af02-7701fbde2517 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:14.322196 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e14e8cfe-8c08-42af-af02-7701fbde2517 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:14.322831 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e14e8cfe-8c08-42af-af02-7701fbde2517 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:14.365022 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e14e8cfe-8c08-42af-af02-7701fbde2517 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:14.365877 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e14e8cfe-8c08-42af-af02-7701fbde2517 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:14.366405 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e14e8cfe-8c08-42af-af02-7701fbde2517 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:14.367650 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-e14e8cfe-8c08-42af-af02-7701fbde2517 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lazy-loading 'fault' on Instance uuid 54cef59c-a846-4db7-8bae-ac0e2ee71b40 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:44:14.436732 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e14e8cfe-8c08-42af-af02-7701fbde2517 tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/54cef59c-a846-4db7-8bae-ac0e2ee71b40" status: 200 len: 1453 microversion: 2.1 time: 0.140620 Oct 26 13:44:14.450339 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3182/6328] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:14 2022] GET /compute/v2.1/servers/54cef59c-a846-4db7-8bae-ac0e2ee71b40 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:44:14.506524 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ddc4636c-cd08-45e1-9c9b-873eacc11339 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe5aa8de6e24f1faf309f7e3e9a478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2ca8f7890421180d124123db3387f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:14.506524 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ddc4636c-cd08-45e1-9c9b-873eacc11339 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/b16632fa-a05c-47bc-b83a-fc5c77b64c15" status: 200 len: 1546 microversion: 2.1 time: 0.262191 Oct 26 13:44:14.506524 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3147/6329] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:14 2022] GET /compute/v2.1/servers/b16632fa-a05c-47bc-b83a-fc5c77b64c15 => generated 1546 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:44:15.461502 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bc942474-4084-4dec-91fc-678c38477b6e tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:15.462793 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bc942474-4084-4dec-91fc-678c38477b6e tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] [instance: 54cef59c-a846-4db7-8bae-ac0e2ee71b40] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:15.470413 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc942474-4084-4dec-91fc-678c38477b6e tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:15.471242 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc942474-4084-4dec-91fc-678c38477b6e tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:15.473149 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc942474-4084-4dec-91fc-678c38477b6e tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:15.474158 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc942474-4084-4dec-91fc-678c38477b6e tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:15.475161 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc942474-4084-4dec-91fc-678c38477b6e tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:15.475949 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc942474-4084-4dec-91fc-678c38477b6e tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:15.492581 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-bc942474-4084-4dec-91fc-678c38477b6e tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] HTTP exception thrown: Instance 54cef59c-a846-4db7-8bae-ac0e2ee71b40 could not be found. Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bc942474-4084-4dec-91fc-678c38477b6e tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Request method failure captured: Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/54cef59c-a846-4db7-8bae-ac0e2ee71b40 HTTP/1.1 Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTmKz_IEyFRbWMfvSCnIZD-PASkSMNQICvQe1xnQqr54fcPvSzpvW7KNnpn0zbsFX5K8aEC-qj884A5vB0VeeM3D-tz0h6gDNNUVH3Jm1bApqkSiql7AVSVY7_QQAYxO41QbdZDuzrOuiLPHgoQHDoG4HhjTMyrHXJx8ZpdqWUWeOBE Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 924262ce1ddf4f598b48a3e428c016d6 Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-TestServerMultinode-446878058 Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: X-Role: admin,member,reader Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: admin,member,reader Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/924262ce1ddf4f598b48a3e428c016d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/924262ce1ddf4f598b48a3e428c016d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_924262ce1ddf4f598b48a3e428c016d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/924262ce1ddf4f598b48a3e428c016d6"}]}] Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-TestServerMultinode-446878058 Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 924262ce1ddf4f598b48a3e428c016d6 Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-TestServerMultinode-446878058 Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-TestServerMultinode-446878058-project-admin Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 7ab587dc0c72424ab5d5f2e7f25cadf3 Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-TestServerMultinode-446878058-project-admin Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 54cef59c-a846-4db7-8bae-ac0e2ee71b40 could not be found. Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '54cef59c-a846-4db7-8bae-ac0e2ee71b40'} Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54cef59c-a846-4db7-8bae-ac0e2ee71b40 could not be found. Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54cef59c-a846-4db7-8bae-ac0e2ee71b40 could not be found. Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:44:15.494979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:44:15.502845 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:44:15.502845 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:44:15.502845 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:44:15.502845 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:44:15.502845 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:44:15.502845 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54cef59c-a846-4db7-8bae-ac0e2ee71b40 could not be found. Oct 26 13:44:15.502845 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:44:15.502845 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bc942474-4084-4dec-91fc-678c38477b6e tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] Returning 404 to user: Instance 54cef59c-a846-4db7-8bae-ac0e2ee71b40 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:44:15.502845 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bc942474-4084-4dec-91fc-678c38477b6e tempest-TestServerMultinode-446878058 tempest-TestServerMultinode-446878058-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/54cef59c-a846-4db7-8bae-ac0e2ee71b40" status: 404 len: 111 microversion: 2.1 time: 0.038843 Oct 26 13:44:15.502845 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3183/6330] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:15 2022] GET /compute/v2.1/servers/54cef59c-a846-4db7-8bae-ac0e2ee71b40 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:44:16.614630 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1d14f38d-8060-4dbd-b6d9-959068ea2b29 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:44:16.617962 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1d14f38d-8060-4dbd-b6d9-959068ea2b29 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:16.625961 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d14f38d-8060-4dbd-b6d9-959068ea2b29 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:16.626712 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d14f38d-8060-4dbd-b6d9-959068ea2b29 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:16.627381 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d14f38d-8060-4dbd-b6d9-959068ea2b29 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:16.628301 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d14f38d-8060-4dbd-b6d9-959068ea2b29 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:16.628957 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d14f38d-8060-4dbd-b6d9-959068ea2b29 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:16.629636 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d14f38d-8060-4dbd-b6d9-959068ea2b29 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:16.683352 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1d14f38d-8060-4dbd-b6d9-959068ea2b29 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "POST /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4/action" status: 200 len: 24571 microversion: 2.1 time: 0.072696 Oct 26 13:44:16.684261 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3148/6331] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:44:16 2022] POST /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4/action => generated 24571 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:44:27.546606 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-983218eb-9f50-40d4-b84a-09b2ac103bbd tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:27.547961 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-983218eb-9f50-40d4-b84a-09b2ac103bbd tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:27.555525 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:44:27.556727 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=10 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:44:27.558851 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-983218eb-9f50-40d4-b84a-09b2ac103bbd tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:27.559556 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-983218eb-9f50-40d4-b84a-09b2ac103bbd tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:27.561511 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-983218eb-9f50-40d4-b84a-09b2ac103bbd tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:27.562483 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-983218eb-9f50-40d4-b84a-09b2ac103bbd tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:27.563025 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-983218eb-9f50-40d4-b84a-09b2ac103bbd tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:27.563485 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-983218eb-9f50-40d4-b84a-09b2ac103bbd tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:28.156240 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-983218eb-9f50-40d4-b84a-09b2ac103bbd tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4" status: 200 len: 1833 microversion: 2.1 time: 0.614917 Oct 26 13:44:28.157030 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3184/6332] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:27 2022] GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4 => generated 1833 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:28.181917 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4fbad295-5600-49aa-8673-913fc8c5665d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:28.183515 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4fbad295-5600-49aa-8673-913fc8c5665d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:28.189293 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=36 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:44:28.190773 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=91 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:44:28.196839 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4fbad295-5600-49aa-8673-913fc8c5665d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:28.197905 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4fbad295-5600-49aa-8673-913fc8c5665d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:28.198952 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4fbad295-5600-49aa-8673-913fc8c5665d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:28.202250 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4fbad295-5600-49aa-8673-913fc8c5665d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:28.202940 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4fbad295-5600-49aa-8673-913fc8c5665d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:28.203539 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4fbad295-5600-49aa-8673-913fc8c5665d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:28.394723 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4fbad295-5600-49aa-8673-913fc8c5665d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:28.403442 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4fbad295-5600-49aa-8673-913fc8c5665d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4" status: 200 len: 1682 microversion: 2.1 time: 0.226744 Oct 26 13:44:28.405299 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3149/6333] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:28 2022] GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4 => generated 1682 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:28.564556 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1f9c70ac-0304-449c-91f6-050bb8901864 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:44:28.568001 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1f9c70ac-0304-449c-91f6-050bb8901864 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:28.576874 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f9c70ac-0304-449c-91f6-050bb8901864 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:28.577654 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f9c70ac-0304-449c-91f6-050bb8901864 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:28.578264 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f9c70ac-0304-449c-91f6-050bb8901864 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:28.579149 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f9c70ac-0304-449c-91f6-050bb8901864 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:28.579771 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f9c70ac-0304-449c-91f6-050bb8901864 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:28.580602 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f9c70ac-0304-449c-91f6-050bb8901864 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:28.645845 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1f9c70ac-0304-449c-91f6-050bb8901864 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "POST /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4/action" status: 200 len: 32639 microversion: 2.1 time: 0.088434 Oct 26 13:44:28.647527 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3185/6334] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:44:28 2022] POST /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4/action => generated 32639 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:44:28.850297 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f7db3be2-d741-4a15-9892-33053a904922 tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:44:28.851105 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f7db3be2-d741-4a15-9892-33053a904922 tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:28.862173 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f7db3be2-d741-4a15-9892-33053a904922 tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:28.863731 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f7db3be2-d741-4a15-9892-33053a904922 tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:28.864978 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f7db3be2-d741-4a15-9892-33053a904922 tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:28.866010 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f7db3be2-d741-4a15-9892-33053a904922 tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:28.866566 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f7db3be2-d741-4a15-9892-33053a904922 tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:28.867197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f7db3be2-d741-4a15-9892-33053a904922 tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:28.962599 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f7db3be2-d741-4a15-9892-33053a904922 tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd26bd347f4044fe1b4c01c28436d7f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ff981f6bd24b90b2980babf75b5194', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:28.963203 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f7db3be2-d741-4a15-9892-33053a904922 tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] flavor_id is None. Assuming migration. {{(pid=120597) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 26 13:44:28.963671 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f7db3be2-d741-4a15-9892-33053a904922 tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120597) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 26 13:44:29.141264 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f7db3be2-d741-4a15-9892-33053a904922 tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4/action" status: 202 len: 0 microversion: 2.1 time: 0.295629 Oct 26 13:44:29.142662 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3150/6335] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:44:28 2022] POST /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:44:29.151260 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-855e7a1f-8fde-4b9d-96db-6da3d93d1cc4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:29.151965 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-855e7a1f-8fde-4b9d-96db-6da3d93d1cc4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:29.160641 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-855e7a1f-8fde-4b9d-96db-6da3d93d1cc4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:29.160876 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-855e7a1f-8fde-4b9d-96db-6da3d93d1cc4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:29.161313 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-855e7a1f-8fde-4b9d-96db-6da3d93d1cc4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:29.162001 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-855e7a1f-8fde-4b9d-96db-6da3d93d1cc4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:29.162472 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-855e7a1f-8fde-4b9d-96db-6da3d93d1cc4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:29.162896 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-855e7a1f-8fde-4b9d-96db-6da3d93d1cc4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:29.397227 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-855e7a1f-8fde-4b9d-96db-6da3d93d1cc4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:29.417291 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-855e7a1f-8fde-4b9d-96db-6da3d93d1cc4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4" status: 200 len: 1691 microversion: 2.1 time: 0.270200 Oct 26 13:44:29.418163 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3186/6336] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:29 2022] GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4 => generated 1691 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:30.443623 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d35112c1-8ee2-4550-8811-5cb219365bb5 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:30.444252 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d35112c1-8ee2-4550-8811-5cb219365bb5 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:30.469952 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d35112c1-8ee2-4550-8811-5cb219365bb5 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:30.470461 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d35112c1-8ee2-4550-8811-5cb219365bb5 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:30.470908 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d35112c1-8ee2-4550-8811-5cb219365bb5 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:30.471627 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d35112c1-8ee2-4550-8811-5cb219365bb5 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:30.472088 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d35112c1-8ee2-4550-8811-5cb219365bb5 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:30.491267 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d35112c1-8ee2-4550-8811-5cb219365bb5 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:30.875165 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d35112c1-8ee2-4550-8811-5cb219365bb5 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:30.891235 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d35112c1-8ee2-4550-8811-5cb219365bb5 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4" status: 200 len: 1691 microversion: 2.1 time: 0.449968 Oct 26 13:44:30.892263 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3151/6337] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:30 2022] GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4 => generated 1691 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:31.916282 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a7f1e2a9-344a-4063-a2ec-806857b4c05d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:31.917382 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a7f1e2a9-344a-4063-a2ec-806857b4c05d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:31.926682 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a7f1e2a9-344a-4063-a2ec-806857b4c05d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:31.927187 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a7f1e2a9-344a-4063-a2ec-806857b4c05d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:31.927637 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a7f1e2a9-344a-4063-a2ec-806857b4c05d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:31.928514 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a7f1e2a9-344a-4063-a2ec-806857b4c05d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:31.928990 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a7f1e2a9-344a-4063-a2ec-806857b4c05d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:31.929424 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a7f1e2a9-344a-4063-a2ec-806857b4c05d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:32.243927 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a7f1e2a9-344a-4063-a2ec-806857b4c05d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:32.256977 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a7f1e2a9-344a-4063-a2ec-806857b4c05d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4" status: 200 len: 1691 microversion: 2.1 time: 0.343604 Oct 26 13:44:32.257520 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3187/6338] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:31 2022] GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4 => generated 1691 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:33.282667 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-71cbe649-4f44-4f9b-b8c6-adecc263ff91 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:33.284814 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-71cbe649-4f44-4f9b-b8c6-adecc263ff91 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:33.299477 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71cbe649-4f44-4f9b-b8c6-adecc263ff91 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:33.300224 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71cbe649-4f44-4f9b-b8c6-adecc263ff91 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:33.301193 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71cbe649-4f44-4f9b-b8c6-adecc263ff91 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:33.302124 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71cbe649-4f44-4f9b-b8c6-adecc263ff91 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:33.302743 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71cbe649-4f44-4f9b-b8c6-adecc263ff91 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:33.303352 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71cbe649-4f44-4f9b-b8c6-adecc263ff91 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:33.953639 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-71cbe649-4f44-4f9b-b8c6-adecc263ff91 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:33.962473 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-71cbe649-4f44-4f9b-b8c6-adecc263ff91 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4" status: 200 len: 1696 microversion: 2.1 time: 0.684304 Oct 26 13:44:33.971475 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3152/6339] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:33 2022] GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4 => generated 1696 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:44:34.987352 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b8d40ea1-5930-4d14-9a88-e28cfab96e1f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:34.988118 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b8d40ea1-5930-4d14-9a88-e28cfab96e1f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:34.995210 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b8d40ea1-5930-4d14-9a88-e28cfab96e1f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:34.995832 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b8d40ea1-5930-4d14-9a88-e28cfab96e1f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:34.996550 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b8d40ea1-5930-4d14-9a88-e28cfab96e1f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:34.997626 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b8d40ea1-5930-4d14-9a88-e28cfab96e1f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:34.999059 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b8d40ea1-5930-4d14-9a88-e28cfab96e1f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:34.999710 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b8d40ea1-5930-4d14-9a88-e28cfab96e1f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:35.240192 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b8d40ea1-5930-4d14-9a88-e28cfab96e1f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:35.254467 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b8d40ea1-5930-4d14-9a88-e28cfab96e1f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4" status: 200 len: 1696 microversion: 2.1 time: 0.271075 Oct 26 13:44:35.274655 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3188/6340] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:34 2022] GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4 => generated 1696 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:36.287641 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7de46d83-8d5e-4027-9d0d-9cea3cadafbc tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:36.288945 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7de46d83-8d5e-4027-9d0d-9cea3cadafbc tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:36.299196 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7de46d83-8d5e-4027-9d0d-9cea3cadafbc tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:36.300203 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7de46d83-8d5e-4027-9d0d-9cea3cadafbc tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:36.300826 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7de46d83-8d5e-4027-9d0d-9cea3cadafbc tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:36.301950 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7de46d83-8d5e-4027-9d0d-9cea3cadafbc tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:36.302584 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7de46d83-8d5e-4027-9d0d-9cea3cadafbc tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:36.303860 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7de46d83-8d5e-4027-9d0d-9cea3cadafbc tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:36.602547 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7de46d83-8d5e-4027-9d0d-9cea3cadafbc tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:36.613426 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7de46d83-8d5e-4027-9d0d-9cea3cadafbc tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4" status: 200 len: 1696 microversion: 2.1 time: 0.335496 Oct 26 13:44:36.619078 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3153/6341] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:36 2022] GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4 => generated 1696 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:37.648112 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-41a79655-47ce-4f62-a034-04a7da07ee0f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:37.648739 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-41a79655-47ce-4f62-a034-04a7da07ee0f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:37.667265 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-41a79655-47ce-4f62-a034-04a7da07ee0f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:37.668117 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-41a79655-47ce-4f62-a034-04a7da07ee0f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:37.668573 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-41a79655-47ce-4f62-a034-04a7da07ee0f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:37.682965 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-41a79655-47ce-4f62-a034-04a7da07ee0f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:37.683599 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-41a79655-47ce-4f62-a034-04a7da07ee0f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:37.694695 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-41a79655-47ce-4f62-a034-04a7da07ee0f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:38.015867 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-41a79655-47ce-4f62-a034-04a7da07ee0f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:38.024746 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-41a79655-47ce-4f62-a034-04a7da07ee0f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4" status: 200 len: 1696 microversion: 2.1 time: 0.380494 Oct 26 13:44:38.025341 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3189/6342] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:37 2022] GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4 => generated 1696 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:39.053438 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-597e4a16-bec4-4012-be2d-f30a2f56ba79 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:39.054154 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-597e4a16-bec4-4012-be2d-f30a2f56ba79 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:39.065652 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-597e4a16-bec4-4012-be2d-f30a2f56ba79 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:39.066078 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-597e4a16-bec4-4012-be2d-f30a2f56ba79 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:39.066528 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-597e4a16-bec4-4012-be2d-f30a2f56ba79 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:39.070939 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-597e4a16-bec4-4012-be2d-f30a2f56ba79 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:39.072070 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-597e4a16-bec4-4012-be2d-f30a2f56ba79 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:39.072522 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-597e4a16-bec4-4012-be2d-f30a2f56ba79 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:39.296873 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-597e4a16-bec4-4012-be2d-f30a2f56ba79 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:39.307671 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-597e4a16-bec4-4012-be2d-f30a2f56ba79 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4" status: 200 len: 1696 microversion: 2.1 time: 0.261832 Oct 26 13:44:39.308739 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3154/6343] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:39 2022] GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4 => generated 1696 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:44:40.335704 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-efe013fd-1ffb-482c-8450-d02f903a6e17 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:40.336154 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-efe013fd-1ffb-482c-8450-d02f903a6e17 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:40.352777 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-efe013fd-1ffb-482c-8450-d02f903a6e17 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:40.360533 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-efe013fd-1ffb-482c-8450-d02f903a6e17 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:40.360533 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-efe013fd-1ffb-482c-8450-d02f903a6e17 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:40.360533 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-efe013fd-1ffb-482c-8450-d02f903a6e17 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:40.360533 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-efe013fd-1ffb-482c-8450-d02f903a6e17 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:40.364014 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-efe013fd-1ffb-482c-8450-d02f903a6e17 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:40.759869 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-efe013fd-1ffb-482c-8450-d02f903a6e17 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:40.770219 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-efe013fd-1ffb-482c-8450-d02f903a6e17 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4" status: 200 len: 1696 microversion: 2.1 time: 0.439548 Oct 26 13:44:40.772297 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3190/6344] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:40 2022] GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4 => generated 1696 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:41.688128 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0b976e21-4e98-4547-a3dc-3cb3cbab0cea tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:41.689504 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0b976e21-4e98-4547-a3dc-3cb3cbab0cea tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: b16632fa-a05c-47bc-b83a-fc5c77b64c15] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:41.710031 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b976e21-4e98-4547-a3dc-3cb3cbab0cea tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:41.710533 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b976e21-4e98-4547-a3dc-3cb3cbab0cea tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:41.710966 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b976e21-4e98-4547-a3dc-3cb3cbab0cea tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:41.715234 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b976e21-4e98-4547-a3dc-3cb3cbab0cea tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:41.716837 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b976e21-4e98-4547-a3dc-3cb3cbab0cea tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:41.719141 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b976e21-4e98-4547-a3dc-3cb3cbab0cea tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:41.772402 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0b976e21-4e98-4547-a3dc-3cb3cbab0cea tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: b16632fa-a05c-47bc-b83a-fc5c77b64c15] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:44:41.803293 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-347c609a-dd11-4ff8-9e7c-b54f11319c9b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:41.806499 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-347c609a-dd11-4ff8-9e7c-b54f11319c9b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:41.818841 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-347c609a-dd11-4ff8-9e7c-b54f11319c9b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:41.820651 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-347c609a-dd11-4ff8-9e7c-b54f11319c9b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:41.820651 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-347c609a-dd11-4ff8-9e7c-b54f11319c9b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:41.820651 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-347c609a-dd11-4ff8-9e7c-b54f11319c9b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:41.821138 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-347c609a-dd11-4ff8-9e7c-b54f11319c9b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:41.821254 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-347c609a-dd11-4ff8-9e7c-b54f11319c9b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:42.016875 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0b976e21-4e98-4547-a3dc-3cb3cbab0cea tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b16632fa-a05c-47bc-b83a-fc5c77b64c15" status: 204 len: 0 microversion: 2.1 time: 0.338613 Oct 26 13:44:42.019520 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3155/6345] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:44:41 2022] DELETE /compute/v2.1/servers/b16632fa-a05c-47bc-b83a-fc5c77b64c15 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:44:42.035545 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7b07c2ef-4fc8-4878-b8dd-299e5b982da0 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:42.036381 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7b07c2ef-4fc8-4878-b8dd-299e5b982da0 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: b16632fa-a05c-47bc-b83a-fc5c77b64c15] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:42.063427 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b07c2ef-4fc8-4878-b8dd-299e5b982da0 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:42.068598 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b07c2ef-4fc8-4878-b8dd-299e5b982da0 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:42.069053 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b07c2ef-4fc8-4878-b8dd-299e5b982da0 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:42.070156 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b07c2ef-4fc8-4878-b8dd-299e5b982da0 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:42.079298 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b07c2ef-4fc8-4878-b8dd-299e5b982da0 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:42.080308 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b07c2ef-4fc8-4878-b8dd-299e5b982da0 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:42.128198 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-347c609a-dd11-4ff8-9e7c-b54f11319c9b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:42.139533 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-347c609a-dd11-4ff8-9e7c-b54f11319c9b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4" status: 200 len: 1696 microversion: 2.1 time: 0.341175 Oct 26 13:44:42.147383 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3191/6346] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:41 2022] GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4 => generated 1696 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:44:42.152742 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-939cd2c3-3023-487a-ab57-51eb9ee4b3fc tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1141474226", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "20f53897-7ad5-48ed-8c87-a9a1b566bc20", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a3a29c91-9973-4a7f-99bf-5b84e6501fd2"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:44:42.271401 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-939cd2c3-3023-487a-ab57-51eb9ee4b3fc tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] validate_networks() for [('a3a29c91-9973-4a7f-99bf-5b84e6501fd2', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:44:42.293135 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7b07c2ef-4fc8-4878-b8dd-299e5b982da0 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe5aa8de6e24f1faf309f7e3e9a478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2ca8f7890421180d124123db3387f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:42.308420 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7b07c2ef-4fc8-4878-b8dd-299e5b982da0 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/b16632fa-a05c-47bc-b83a-fc5c77b64c15" status: 200 len: 1552 microversion: 2.1 time: 0.283957 Oct 26 13:44:42.309517 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3156/6347] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:42 2022] GET /compute/v2.1/servers/b16632fa-a05c-47bc-b83a-fc5c77b64c15 => generated 1552 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:43.019397 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-939cd2c3-3023-487a-ab57-51eb9ee4b3fc tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:44:43.023216 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-939cd2c3-3023-487a-ab57-51eb9ee4b3fc tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:44:43.023988 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-939cd2c3-3023-487a-ab57-51eb9ee4b3fc tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:44:43.024639 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-939cd2c3-3023-487a-ab57-51eb9ee4b3fc tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:44:43.026407 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-939cd2c3-3023-487a-ab57-51eb9ee4b3fc tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:44:43.069321 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-939cd2c3-3023-487a-ab57-51eb9ee4b3fc tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:43.069875 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-939cd2c3-3023-487a-ab57-51eb9ee4b3fc tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:43.070318 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-939cd2c3-3023-487a-ab57-51eb9ee4b3fc tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:43.071051 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-939cd2c3-3023-487a-ab57-51eb9ee4b3fc tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:43.071520 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-939cd2c3-3023-487a-ab57-51eb9ee4b3fc tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:43.071950 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-939cd2c3-3023-487a-ab57-51eb9ee4b3fc tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:43.115478 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-939cd2c3-3023-487a-ab57-51eb9ee4b3fc tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Getting quotas for project 2a1602330aa340b890bac76a120f74e8. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:44:43.123002 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-939cd2c3-3023-487a-ab57-51eb9ee4b3fc tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Getting quotas for user df8b67aae3ea4f17bfa684681311dec5 and project 2a1602330aa340b890bac76a120f74e8. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:44:43.174457 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-27f4b8ae-c597-458b-aa75-ee026048ad8c tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:43.175074 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-27f4b8ae-c597-458b-aa75-ee026048ad8c tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:43.183380 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-27f4b8ae-c597-458b-aa75-ee026048ad8c tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:43.183881 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-27f4b8ae-c597-458b-aa75-ee026048ad8c tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:43.184379 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-27f4b8ae-c597-458b-aa75-ee026048ad8c tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:43.185503 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-27f4b8ae-c597-458b-aa75-ee026048ad8c tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:43.188246 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-27f4b8ae-c597-458b-aa75-ee026048ad8c tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:43.188684 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-27f4b8ae-c597-458b-aa75-ee026048ad8c tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:43.214513 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-939cd2c3-3023-487a-ab57-51eb9ee4b3fc tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:44:43.217520 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-939cd2c3-3023-487a-ab57-51eb9ee4b3fc tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 11e7b2ee-c8f4-4c95-a107-57bfb4ed0135] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='20f53897-7ad5-48ed-8c87-a9a1b566bc20',volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:44:43.469103 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-27f4b8ae-c597-458b-aa75-ee026048ad8c tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:43.481142 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-27f4b8ae-c597-458b-aa75-ee026048ad8c tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4" status: 200 len: 1696 microversion: 2.1 time: 0.309948 Oct 26 13:44:43.484102 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3157/6348] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:43 2022] GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4 => generated 1696 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:43.503364 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1f560b08-98da-42f0-b738-2cd33a4722aa tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:43.504257 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1f560b08-98da-42f0-b738-2cd33a4722aa tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: b16632fa-a05c-47bc-b83a-fc5c77b64c15] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:43.523183 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1f560b08-98da-42f0-b738-2cd33a4722aa tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:43.523496 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1f560b08-98da-42f0-b738-2cd33a4722aa tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:43.523941 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1f560b08-98da-42f0-b738-2cd33a4722aa tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:43.524662 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1f560b08-98da-42f0-b738-2cd33a4722aa tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:43.525116 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1f560b08-98da-42f0-b738-2cd33a4722aa tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:43.525609 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1f560b08-98da-42f0-b738-2cd33a4722aa tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:43.577285 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-939cd2c3-3023-487a-ab57-51eb9ee4b3fc tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.428370 Oct 26 13:44:43.578437 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3192/6349] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:44:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:44:43.590010 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7fa63cf6-7da1-4ff5-951e-302745adeed9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:43.591608 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7fa63cf6-7da1-4ff5-951e-302745adeed9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 11e7b2ee-c8f4-4c95-a107-57bfb4ed0135] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:43.781059 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7fa63cf6-7da1-4ff5-951e-302745adeed9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:43.794517 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7fa63cf6-7da1-4ff5-951e-302745adeed9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135" status: 200 len: 1057 microversion: 2.1 time: 0.208398 Oct 26 13:44:43.795128 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3193/6350] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:43 2022] GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135 => generated 1057 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:44:43.835629 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1f560b08-98da-42f0-b738-2cd33a4722aa tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe5aa8de6e24f1faf309f7e3e9a478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2ca8f7890421180d124123db3387f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:43.853082 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1f560b08-98da-42f0-b738-2cd33a4722aa tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/b16632fa-a05c-47bc-b83a-fc5c77b64c15" status: 200 len: 1552 microversion: 2.1 time: 0.367578 Oct 26 13:44:43.853920 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3158/6351] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:43 2022] GET /compute/v2.1/servers/b16632fa-a05c-47bc-b83a-fc5c77b64c15 => generated 1552 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:44.512889 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5bfd7c79-506d-40ba-baff-45f2573d51ab tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:44.514378 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5bfd7c79-506d-40ba-baff-45f2573d51ab tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:44.527815 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5bfd7c79-506d-40ba-baff-45f2573d51ab tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:44.528322 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5bfd7c79-506d-40ba-baff-45f2573d51ab tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:44.529595 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5bfd7c79-506d-40ba-baff-45f2573d51ab tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:44.534905 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5bfd7c79-506d-40ba-baff-45f2573d51ab tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:44.535407 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5bfd7c79-506d-40ba-baff-45f2573d51ab tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:44.535860 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5bfd7c79-506d-40ba-baff-45f2573d51ab tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:44.687835 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-89216afe-022f-427f-96ec-5c4fdb3a85e8 req-f5c9b7c3-b1d5-417b-8220-2cd9b7539dbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b16632fa-a05c-47bc-b83a-fc5c77b64c15", "name": "network-vif-deleted", "tag": "272a719b-73cd-4787-a848-b4395df9932d"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:44:44.705574 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-89216afe-022f-427f-96ec-5c4fdb3a85e8 req-f5c9b7c3-b1d5-417b-8220-2cd9b7539dbf service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:44.706129 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-89216afe-022f-427f-96ec-5c4fdb3a85e8 req-f5c9b7c3-b1d5-417b-8220-2cd9b7539dbf service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:44.706895 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-89216afe-022f-427f-96ec-5c4fdb3a85e8 req-f5c9b7c3-b1d5-417b-8220-2cd9b7539dbf service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:44.726461 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-89216afe-022f-427f-96ec-5c4fdb3a85e8 req-f5c9b7c3-b1d5-417b-8220-2cd9b7539dbf service nova] Creating event network-vif-deleted:272a719b-73cd-4787-a848-b4395df9932d for instance b16632fa-a05c-47bc-b83a-fc5c77b64c15 on n-h1-862686-1 Oct 26 13:44:44.751604 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-89216afe-022f-427f-96ec-5c4fdb3a85e8 req-f5c9b7c3-b1d5-417b-8220-2cd9b7539dbf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075331 Oct 26 13:44:44.754268 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3159/6352] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:44:44.810499 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5bfd7c79-506d-40ba-baff-45f2573d51ab tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:44.826501 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-80ba5120-d2d5-4e13-a62e-faaeb8a4eae9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:44.827358 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-80ba5120-d2d5-4e13-a62e-faaeb8a4eae9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 11e7b2ee-c8f4-4c95-a107-57bfb4ed0135] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:44.832665 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5bfd7c79-506d-40ba-baff-45f2573d51ab tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4" status: 200 len: 1696 microversion: 2.1 time: 0.325017 Oct 26 13:44:44.833264 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3194/6353] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:44 2022] GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4 => generated 1696 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:44.859586 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-80ba5120-d2d5-4e13-a62e-faaeb8a4eae9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:44.860031 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-80ba5120-d2d5-4e13-a62e-faaeb8a4eae9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:44.860476 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-80ba5120-d2d5-4e13-a62e-faaeb8a4eae9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:44.861201 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-80ba5120-d2d5-4e13-a62e-faaeb8a4eae9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:44.861690 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-80ba5120-d2d5-4e13-a62e-faaeb8a4eae9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:44.862556 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-80ba5120-d2d5-4e13-a62e-faaeb8a4eae9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:44.897561 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7a6c22b1-ecff-47e9-b3b5-0fa0d78be91d tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:44.898260 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7a6c22b1-ecff-47e9-b3b5-0fa0d78be91d tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: b16632fa-a05c-47bc-b83a-fc5c77b64c15] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:44.907787 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a6c22b1-ecff-47e9-b3b5-0fa0d78be91d tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:44.912766 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a6c22b1-ecff-47e9-b3b5-0fa0d78be91d tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:44.913271 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a6c22b1-ecff-47e9-b3b5-0fa0d78be91d tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:44.914046 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a6c22b1-ecff-47e9-b3b5-0fa0d78be91d tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:44.927984 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a6c22b1-ecff-47e9-b3b5-0fa0d78be91d tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:44.928477 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a6c22b1-ecff-47e9-b3b5-0fa0d78be91d tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:44.967155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-80ba5120-d2d5-4e13-a62e-faaeb8a4eae9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:44.976533 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-80ba5120-d2d5-4e13-a62e-faaeb8a4eae9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135" status: 200 len: 1099 microversion: 2.1 time: 0.154665 Oct 26 13:44:44.978278 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3160/6354] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:44 2022] GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135 => generated 1099 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:45.064621 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7a6c22b1-ecff-47e9-b3b5-0fa0d78be91d tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe5aa8de6e24f1faf309f7e3e9a478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2ca8f7890421180d124123db3387f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:45.077166 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7a6c22b1-ecff-47e9-b3b5-0fa0d78be91d tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/b16632fa-a05c-47bc-b83a-fc5c77b64c15" status: 200 len: 1485 microversion: 2.1 time: 0.183623 Oct 26 13:44:45.081350 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3195/6355] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:44 2022] GET /compute/v2.1/servers/b16632fa-a05c-47bc-b83a-fc5c77b64c15 => generated 1485 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:44:45.860776 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ca1a17c3-466a-4f6a-89a5-31893481d5ad tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:45.861617 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ca1a17c3-466a-4f6a-89a5-31893481d5ad tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:45.885098 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ca1a17c3-466a-4f6a-89a5-31893481d5ad tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:45.890512 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ca1a17c3-466a-4f6a-89a5-31893481d5ad tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:45.891270 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ca1a17c3-466a-4f6a-89a5-31893481d5ad tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:45.892239 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ca1a17c3-466a-4f6a-89a5-31893481d5ad tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:45.892720 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ca1a17c3-466a-4f6a-89a5-31893481d5ad tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:45.893184 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ca1a17c3-466a-4f6a-89a5-31893481d5ad tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:46.002490 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b1f1900b-626f-4aed-bfe7-90d8e8a0d3f0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:46.003633 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b1f1900b-626f-4aed-bfe7-90d8e8a0d3f0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 11e7b2ee-c8f4-4c95-a107-57bfb4ed0135] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:46.018203 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1f1900b-626f-4aed-bfe7-90d8e8a0d3f0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:46.018997 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1f1900b-626f-4aed-bfe7-90d8e8a0d3f0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:46.019980 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1f1900b-626f-4aed-bfe7-90d8e8a0d3f0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:46.020886 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1f1900b-626f-4aed-bfe7-90d8e8a0d3f0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:46.021567 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1f1900b-626f-4aed-bfe7-90d8e8a0d3f0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:46.022164 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1f1900b-626f-4aed-bfe7-90d8e8a0d3f0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:46.191852 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b1f1900b-626f-4aed-bfe7-90d8e8a0d3f0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:46.208036 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b1f1900b-626f-4aed-bfe7-90d8e8a0d3f0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135" status: 200 len: 1173 microversion: 2.1 time: 0.209803 Oct 26 13:44:46.218188 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3196/6356] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:45 2022] GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135 => generated 1173 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:44:46.228719 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7fece9a4-14a4-4cc4-9a40-71fbde918ce3 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:46.235060 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7fece9a4-14a4-4cc4-9a40-71fbde918ce3 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: b16632fa-a05c-47bc-b83a-fc5c77b64c15] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:46.250851 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7fece9a4-14a4-4cc4-9a40-71fbde918ce3 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:46.254250 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7fece9a4-14a4-4cc4-9a40-71fbde918ce3 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:46.255185 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7fece9a4-14a4-4cc4-9a40-71fbde918ce3 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:46.256479 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7fece9a4-14a4-4cc4-9a40-71fbde918ce3 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:46.268271 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7fece9a4-14a4-4cc4-9a40-71fbde918ce3 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:46.268895 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7fece9a4-14a4-4cc4-9a40-71fbde918ce3 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:46.328269 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-7fece9a4-14a4-4cc4-9a40-71fbde918ce3 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] HTTP exception thrown: Instance b16632fa-a05c-47bc-b83a-fc5c77b64c15 could not be found. Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7fece9a4-14a4-4cc4-9a40-71fbde918ce3 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Request method failure captured: Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/b16632fa-a05c-47bc-b83a-fc5c77b64c15 HTTP/1.1 Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTlB6nx7WIoeAKoM5LmzE-4SdNpuo3oUw-CyeEspHcaHQXu00Wl-HTDBmplEdxIaAqaNrKwBolo-ROn9MG_a4bhX3BTPKJJ36Xqej37oQSYPtCyku0xHVQI25kxNIyyK8P_UAdFLPKWjkrVxVkhoEUb5sPKI4bF5Bflqagh3alz1u-s Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 8af2ca8f7890421180d124123db3387f Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-TestNetworkBasicOps-144239929 Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8af2ca8f7890421180d124123db3387f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8af2ca8f7890421180d124123db3387f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8af2ca8f7890421180d124123db3387f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8af2ca8f7890421180d124123db3387f"}]}] Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-TestNetworkBasicOps-144239929 Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 8af2ca8f7890421180d124123db3387f Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-TestNetworkBasicOps-144239929 Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-TestNetworkBasicOps-144239929-project Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 3fe5aa8de6e24f1faf309f7e3e9a478c Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-TestNetworkBasicOps-144239929-project Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance b16632fa-a05c-47bc-b83a-fc5c77b64c15 could not be found. Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'b16632fa-a05c-47bc-b83a-fc5c77b64c15'} Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b16632fa-a05c-47bc-b83a-fc5c77b64c15 could not be found. Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b16632fa-a05c-47bc-b83a-fc5c77b64c15 could not be found. Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:44:46.342247 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:44:46.355014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:44:46.355014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:44:46.355014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:44:46.355014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:44:46.355014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:44:46.355014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b16632fa-a05c-47bc-b83a-fc5c77b64c15 could not be found. Oct 26 13:44:46.355014 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:44:46.362116 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7fece9a4-14a4-4cc4-9a40-71fbde918ce3 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Returning 404 to user: Instance b16632fa-a05c-47bc-b83a-fc5c77b64c15 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:44:46.371743 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7fece9a4-14a4-4cc4-9a40-71fbde918ce3 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/b16632fa-a05c-47bc-b83a-fc5c77b64c15" status: 404 len: 111 microversion: 2.1 time: 0.147882 Oct 26 13:44:46.372975 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3197/6357] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:46 2022] GET /compute/v2.1/servers/b16632fa-a05c-47bc-b83a-fc5c77b64c15 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:44:46.776264 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ca1a17c3-466a-4f6a-89a5-31893481d5ad tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:46.794723 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-878d478c-85c5-4eea-8f34-8a4dfe28fe1a tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '.version_select at 0x7f6732807e50>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:46.799284 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ca1a17c3-466a-4f6a-89a5-31893481d5ad tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4" status: 200 len: 1695 microversion: 2.1 time: 0.943099 Oct 26 13:44:46.814049 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3161/6358] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:45 2022] GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4 => generated 1695 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:46.903004 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-878d478c-85c5-4eea-8f34-8a4dfe28fe1a tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-886371877" status: 202 len: 0 microversion: 2.1 time: 0.129221 Oct 26 13:44:46.935679 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3198/6359] 10.222.0.40 () {58 vars in 1254 bytes} [Wed Oct 26 13:44:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-886371877 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 13:44:47.240990 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9da297d7-c81a-46b7-bd08-3620d353bda6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:47.241633 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9da297d7-c81a-46b7-bd08-3620d353bda6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 11e7b2ee-c8f4-4c95-a107-57bfb4ed0135] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:47.255507 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9da297d7-c81a-46b7-bd08-3620d353bda6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:47.256007 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9da297d7-c81a-46b7-bd08-3620d353bda6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:47.258988 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9da297d7-c81a-46b7-bd08-3620d353bda6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:47.260682 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9da297d7-c81a-46b7-bd08-3620d353bda6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:47.261506 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9da297d7-c81a-46b7-bd08-3620d353bda6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:47.262942 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9da297d7-c81a-46b7-bd08-3620d353bda6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:47.410548 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9da297d7-c81a-46b7-bd08-3620d353bda6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:47.425680 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:44:47.442244 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9da297d7-c81a-46b7-bd08-3620d353bda6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135" status: 200 len: 1173 microversion: 2.1 time: 0.205533 Oct 26 13:44:47.445540 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3162/6360] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:47 2022] GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135 => generated 1173 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:47.445850 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-72ebbf7e-7a43-4ead-9746-1fe9d4b5ab89 req-b616b4d2-a1e8-40be-9e56-7c78a4a3b120 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "911f368c-5a4e-4f89-83e8-52d02202bbc4", "name": "network-vif-unplugged", "status": "completed", "tag": "01306531-3518-45b4-ae5b-35d7b905b368"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:44:47.473011 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-72ebbf7e-7a43-4ead-9746-1fe9d4b5ab89 req-b616b4d2-a1e8-40be-9e56-7c78a4a3b120 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:47.473405 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-72ebbf7e-7a43-4ead-9746-1fe9d4b5ab89 req-b616b4d2-a1e8-40be-9e56-7c78a4a3b120 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:47.473864 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-72ebbf7e-7a43-4ead-9746-1fe9d4b5ab89 req-b616b4d2-a1e8-40be-9e56-7c78a4a3b120 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:47.493072 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-72ebbf7e-7a43-4ead-9746-1fe9d4b5ab89 req-b616b4d2-a1e8-40be-9e56-7c78a4a3b120 service nova] Creating event network-vif-unplugged:01306531-3518-45b4-ae5b-35d7b905b368 for instance 911f368c-5a4e-4f89-83e8-52d02202bbc4 on n-h2-862686-1 Oct 26 13:44:47.500016 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [req-72ebbf7e-7a43-4ead-9746-1fe9d4b5ab89 req-b616b4d2-a1e8-40be-9e56-7c78a4a3b120 service nova] Instance 911f368c-5a4e-4f89-83e8-52d02202bbc4 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862686-1', 'n-h1-862686-1'} {{(pid=120598) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 13:44:47.512159 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-72ebbf7e-7a43-4ead-9746-1fe9d4b5ab89 req-b616b4d2-a1e8-40be-9e56-7c78a4a3b120 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070588 Oct 26 13:44:47.513785 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3199/6361] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:44:47.834194 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7f463b50-e4f1-49b5-b56b-024bd578afa4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:47.835565 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7f463b50-e4f1-49b5-b56b-024bd578afa4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:47.844493 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f463b50-e4f1-49b5-b56b-024bd578afa4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:47.845787 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f463b50-e4f1-49b5-b56b-024bd578afa4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:47.846494 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f463b50-e4f1-49b5-b56b-024bd578afa4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:47.847465 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f463b50-e4f1-49b5-b56b-024bd578afa4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:47.848186 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f463b50-e4f1-49b5-b56b-024bd578afa4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:47.848862 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f463b50-e4f1-49b5-b56b-024bd578afa4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:48.161439 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7f463b50-e4f1-49b5-b56b-024bd578afa4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:48.188511 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7f463b50-e4f1-49b5-b56b-024bd578afa4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4" status: 200 len: 1695 microversion: 2.1 time: 0.358106 Oct 26 13:44:48.189793 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3163/6362] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:47 2022] GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4 => generated 1695 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:48.470061 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7f2a2141-54a9-4cec-ac2e-15dc5d04e941 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:48.470857 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7f2a2141-54a9-4cec-ac2e-15dc5d04e941 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 11e7b2ee-c8f4-4c95-a107-57bfb4ed0135] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:48.486710 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f2a2141-54a9-4cec-ac2e-15dc5d04e941 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:48.487418 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f2a2141-54a9-4cec-ac2e-15dc5d04e941 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:48.487881 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f2a2141-54a9-4cec-ac2e-15dc5d04e941 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:48.488587 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f2a2141-54a9-4cec-ac2e-15dc5d04e941 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:48.489041 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f2a2141-54a9-4cec-ac2e-15dc5d04e941 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:48.489467 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f2a2141-54a9-4cec-ac2e-15dc5d04e941 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:48.683888 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7f2a2141-54a9-4cec-ac2e-15dc5d04e941 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:48.704144 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7f2a2141-54a9-4cec-ac2e-15dc5d04e941 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135" status: 200 len: 1215 microversion: 2.1 time: 0.239510 Oct 26 13:44:48.705669 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3200/6363] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:48 2022] GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135 => generated 1215 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:49.213759 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ab8f0d9b-0619-48ed-91d5-5a7cc10c3a7b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:49.215034 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ab8f0d9b-0619-48ed-91d5-5a7cc10c3a7b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:49.230060 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ab8f0d9b-0619-48ed-91d5-5a7cc10c3a7b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:49.233320 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ab8f0d9b-0619-48ed-91d5-5a7cc10c3a7b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:49.234068 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ab8f0d9b-0619-48ed-91d5-5a7cc10c3a7b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:49.236228 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ab8f0d9b-0619-48ed-91d5-5a7cc10c3a7b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:49.237882 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ab8f0d9b-0619-48ed-91d5-5a7cc10c3a7b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:49.238580 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ab8f0d9b-0619-48ed-91d5-5a7cc10c3a7b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:49.547881 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-7f625aa1-79ad-4199-b23b-fa18db288d52 req-5ffe9455-a63a-4a1e-a4eb-53a5c7dd5c7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "911f368c-5a4e-4f89-83e8-52d02202bbc4", "tag": "01306531-3518-45b4-ae5b-35d7b905b368"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:44:49.572309 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-7f625aa1-79ad-4199-b23b-fa18db288d52 req-5ffe9455-a63a-4a1e-a4eb-53a5c7dd5c7e service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:49.575148 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-7f625aa1-79ad-4199-b23b-fa18db288d52 req-5ffe9455-a63a-4a1e-a4eb-53a5c7dd5c7e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:49.577883 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-7f625aa1-79ad-4199-b23b-fa18db288d52 req-5ffe9455-a63a-4a1e-a4eb-53a5c7dd5c7e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:49.588903 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ab8f0d9b-0619-48ed-91d5-5a7cc10c3a7b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:49.609201 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-7f625aa1-79ad-4199-b23b-fa18db288d52 req-5ffe9455-a63a-4a1e-a4eb-53a5c7dd5c7e service nova] Creating event network-changed:01306531-3518-45b4-ae5b-35d7b905b368 for instance 911f368c-5a4e-4f89-83e8-52d02202bbc4 on n-h2-862686-1 Oct 26 13:44:49.611562 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ab8f0d9b-0619-48ed-91d5-5a7cc10c3a7b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4" status: 200 len: 1695 microversion: 2.1 time: 0.400573 Oct 26 13:44:49.615564 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3164/6364] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:49 2022] GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4 => generated 1695 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:49.630384 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [req-7f625aa1-79ad-4199-b23b-fa18db288d52 req-5ffe9455-a63a-4a1e-a4eb-53a5c7dd5c7e service nova] Instance 911f368c-5a4e-4f89-83e8-52d02202bbc4 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862686-1', 'n-h1-862686-1'} {{(pid=120598) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 13:44:49.660384 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-7f625aa1-79ad-4199-b23b-fa18db288d52 req-5ffe9455-a63a-4a1e-a4eb-53a5c7dd5c7e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117455 Oct 26 13:44:49.661923 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3201/6365] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:44:49.731769 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-626def7d-f5fc-4b27-ad1a-271188c73704 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:49.733023 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-626def7d-f5fc-4b27-ad1a-271188c73704 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 11e7b2ee-c8f4-4c95-a107-57bfb4ed0135] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:49.741788 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-626def7d-f5fc-4b27-ad1a-271188c73704 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:49.746405 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-626def7d-f5fc-4b27-ad1a-271188c73704 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:49.749041 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-626def7d-f5fc-4b27-ad1a-271188c73704 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:49.750047 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-626def7d-f5fc-4b27-ad1a-271188c73704 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:49.753615 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-626def7d-f5fc-4b27-ad1a-271188c73704 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:49.754181 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-626def7d-f5fc-4b27-ad1a-271188c73704 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:50.548537 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-626def7d-f5fc-4b27-ad1a-271188c73704 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:50.563192 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-626def7d-f5fc-4b27-ad1a-271188c73704 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135" status: 200 len: 1215 microversion: 2.1 time: 0.838390 Oct 26 13:44:50.564489 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3165/6366] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:49 2022] GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135 => generated 1215 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:50.643199 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4262fc90-dcfb-4f9a-af50-f9492eb32d6e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:50.644685 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4262fc90-dcfb-4f9a-af50-f9492eb32d6e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:50.658915 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4262fc90-dcfb-4f9a-af50-f9492eb32d6e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:50.661938 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4262fc90-dcfb-4f9a-af50-f9492eb32d6e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:50.662510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4262fc90-dcfb-4f9a-af50-f9492eb32d6e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:50.663338 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4262fc90-dcfb-4f9a-af50-f9492eb32d6e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:50.664057 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4262fc90-dcfb-4f9a-af50-f9492eb32d6e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:50.664782 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4262fc90-dcfb-4f9a-af50-f9492eb32d6e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:51.007395 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9c0a0bde-7890-4250-a04d-a2cba3571733 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:51.008077 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9c0a0bde-7890-4250-a04d-a2cba3571733 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: 2afb9959-a444-4fe1-802b-fdf00cb7fca1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:51.019439 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c0a0bde-7890-4250-a04d-a2cba3571733 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:51.021105 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c0a0bde-7890-4250-a04d-a2cba3571733 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:51.023137 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c0a0bde-7890-4250-a04d-a2cba3571733 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:51.026786 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c0a0bde-7890-4250-a04d-a2cba3571733 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:51.027375 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c0a0bde-7890-4250-a04d-a2cba3571733 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:51.027828 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c0a0bde-7890-4250-a04d-a2cba3571733 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:51.108452 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9c0a0bde-7890-4250-a04d-a2cba3571733 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: 2afb9959-a444-4fe1-802b-fdf00cb7fca1] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:44:51.176215 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4262fc90-dcfb-4f9a-af50-f9492eb32d6e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:51.196977 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4262fc90-dcfb-4f9a-af50-f9492eb32d6e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4" status: 200 len: 1695 microversion: 2.1 time: 0.558852 Oct 26 13:44:51.197592 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3202/6367] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:50 2022] GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4 => generated 1695 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:51.230149 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-596d1c34-8438-4e06-bf3e-718ee1849fe0 req-62216dd0-117f-43ec-ac2a-f1c7cbbe5081 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2afb9959-a444-4fe1-802b-fdf00cb7fca1", "tag": "6a36232d-7783-45c8-b2fd-dab0cd450464"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:44:51.267919 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-596d1c34-8438-4e06-bf3e-718ee1849fe0 req-62216dd0-117f-43ec-ac2a-f1c7cbbe5081 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:51.268415 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-596d1c34-8438-4e06-bf3e-718ee1849fe0 req-62216dd0-117f-43ec-ac2a-f1c7cbbe5081 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:51.268857 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-596d1c34-8438-4e06-bf3e-718ee1849fe0 req-62216dd0-117f-43ec-ac2a-f1c7cbbe5081 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:51.307360 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-596d1c34-8438-4e06-bf3e-718ee1849fe0 req-62216dd0-117f-43ec-ac2a-f1c7cbbe5081 service nova] Creating event network-changed:6a36232d-7783-45c8-b2fd-dab0cd450464 for instance 2afb9959-a444-4fe1-802b-fdf00cb7fca1 on n-h2-862686-1 Oct 26 13:44:51.323512 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-596d1c34-8438-4e06-bf3e-718ee1849fe0 req-62216dd0-117f-43ec-ac2a-f1c7cbbe5081 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107542 Oct 26 13:44:51.331787 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3203/6368] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:44:51.352664 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9c0a0bde-7890-4250-a04d-a2cba3571733 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2afb9959-a444-4fe1-802b-fdf00cb7fca1" status: 204 len: 0 microversion: 2.1 time: 0.347189 Oct 26 13:44:51.353604 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3166/6369] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:44:51 2022] DELETE /compute/v2.1/servers/2afb9959-a444-4fe1-802b-fdf00cb7fca1 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:44:51.362989 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-44e07f9f-fdaf-4288-a504-9ab72c4b85bf tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:51.363705 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-44e07f9f-fdaf-4288-a504-9ab72c4b85bf tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: 2afb9959-a444-4fe1-802b-fdf00cb7fca1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:51.373437 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-44e07f9f-fdaf-4288-a504-9ab72c4b85bf tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:51.374035 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-44e07f9f-fdaf-4288-a504-9ab72c4b85bf tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:51.374477 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-44e07f9f-fdaf-4288-a504-9ab72c4b85bf tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:51.375827 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-44e07f9f-fdaf-4288-a504-9ab72c4b85bf tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:51.376295 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-44e07f9f-fdaf-4288-a504-9ab72c4b85bf tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:51.377215 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-44e07f9f-fdaf-4288-a504-9ab72c4b85bf tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:51.588825 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-351b55eb-daf0-40be-b250-9b638e56ae4f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:51.590234 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-44e07f9f-fdaf-4288-a504-9ab72c4b85bf tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe5aa8de6e24f1faf309f7e3e9a478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2ca8f7890421180d124123db3387f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:51.595745 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-351b55eb-daf0-40be-b250-9b638e56ae4f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 11e7b2ee-c8f4-4c95-a107-57bfb4ed0135] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:51.599746 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-44e07f9f-fdaf-4288-a504-9ab72c4b85bf tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/2afb9959-a444-4fe1-802b-fdf00cb7fca1" status: 200 len: 1667 microversion: 2.1 time: 0.241085 Oct 26 13:44:51.604568 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3204/6370] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:51 2022] GET /compute/v2.1/servers/2afb9959-a444-4fe1-802b-fdf00cb7fca1 => generated 1667 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:51.608473 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-351b55eb-daf0-40be-b250-9b638e56ae4f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:51.609262 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-351b55eb-daf0-40be-b250-9b638e56ae4f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:51.609974 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-351b55eb-daf0-40be-b250-9b638e56ae4f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:51.610936 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-351b55eb-daf0-40be-b250-9b638e56ae4f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:51.611657 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-351b55eb-daf0-40be-b250-9b638e56ae4f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:51.612460 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-351b55eb-daf0-40be-b250-9b638e56ae4f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:51.693860 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-d7b6f491-2dff-4130-897f-f23b24e30465 req-2d614ee6-f590-4862-b120-33222e69704d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11e7b2ee-c8f4-4c95-a107-57bfb4ed0135", "tag": "f58b9e38-5b3b-49c0-b1d1-988c685368cc"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:44:51.707795 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-d7b6f491-2dff-4130-897f-f23b24e30465 req-2d614ee6-f590-4862-b120-33222e69704d service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:51.708615 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-d7b6f491-2dff-4130-897f-f23b24e30465 req-2d614ee6-f590-4862-b120-33222e69704d service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:51.709266 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-d7b6f491-2dff-4130-897f-f23b24e30465 req-2d614ee6-f590-4862-b120-33222e69704d service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:51.725755 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-d7b6f491-2dff-4130-897f-f23b24e30465 req-2d614ee6-f590-4862-b120-33222e69704d service nova] Creating event network-changed:f58b9e38-5b3b-49c0-b1d1-988c685368cc for instance 11e7b2ee-c8f4-4c95-a107-57bfb4ed0135 on n-h2-862686-1 Oct 26 13:44:51.732139 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-d7b6f491-2dff-4130-897f-f23b24e30465 req-2d614ee6-f590-4862-b120-33222e69704d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043036 Oct 26 13:44:51.733653 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3205/6371] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:44:51.795909 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-351b55eb-daf0-40be-b250-9b638e56ae4f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:51.805955 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-351b55eb-daf0-40be-b250-9b638e56ae4f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135" status: 200 len: 1215 microversion: 2.1 time: 0.221164 Oct 26 13:44:51.823108 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3167/6372] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:51 2022] GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135 => generated 1215 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:52.227192 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-620a7901-7a07-4923-8705-108898c87cf6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:52.227897 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-620a7901-7a07-4923-8705-108898c87cf6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:52.243529 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-620a7901-7a07-4923-8705-108898c87cf6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:52.244033 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-620a7901-7a07-4923-8705-108898c87cf6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:52.244478 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-620a7901-7a07-4923-8705-108898c87cf6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:52.245199 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-620a7901-7a07-4923-8705-108898c87cf6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:52.245686 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-620a7901-7a07-4923-8705-108898c87cf6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:52.246337 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-620a7901-7a07-4923-8705-108898c87cf6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:52.251378 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:44:52.572534 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-620a7901-7a07-4923-8705-108898c87cf6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:52.583259 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-620a7901-7a07-4923-8705-108898c87cf6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4" status: 200 len: 1693 microversion: 2.1 time: 0.360328 Oct 26 13:44:52.584745 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3206/6373] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:52 2022] GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4 => generated 1693 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:52.627935 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a720dd2e-5df0-47ca-a875-f82c267e5663 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:52.629130 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a720dd2e-5df0-47ca-a875-f82c267e5663 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: 2afb9959-a444-4fe1-802b-fdf00cb7fca1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:52.636605 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a720dd2e-5df0-47ca-a875-f82c267e5663 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:52.637184 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a720dd2e-5df0-47ca-a875-f82c267e5663 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:52.638134 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a720dd2e-5df0-47ca-a875-f82c267e5663 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:52.639288 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a720dd2e-5df0-47ca-a875-f82c267e5663 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:52.639811 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a720dd2e-5df0-47ca-a875-f82c267e5663 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:52.640435 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a720dd2e-5df0-47ca-a875-f82c267e5663 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:52.830252 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-be5ab1b2-e10f-4d20-8cb9-1af1d75996a7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:52.830846 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-be5ab1b2-e10f-4d20-8cb9-1af1d75996a7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 11e7b2ee-c8f4-4c95-a107-57bfb4ed0135] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:52.836135 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a720dd2e-5df0-47ca-a875-f82c267e5663 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe5aa8de6e24f1faf309f7e3e9a478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2ca8f7890421180d124123db3387f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:52.837862 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be5ab1b2-e10f-4d20-8cb9-1af1d75996a7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:52.838347 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be5ab1b2-e10f-4d20-8cb9-1af1d75996a7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:52.838782 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be5ab1b2-e10f-4d20-8cb9-1af1d75996a7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:52.839478 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be5ab1b2-e10f-4d20-8cb9-1af1d75996a7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:52.839932 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be5ab1b2-e10f-4d20-8cb9-1af1d75996a7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:52.840355 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be5ab1b2-e10f-4d20-8cb9-1af1d75996a7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:52.846772 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a720dd2e-5df0-47ca-a875-f82c267e5663 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/2afb9959-a444-4fe1-802b-fdf00cb7fca1" status: 200 len: 1667 microversion: 2.1 time: 0.224716 Oct 26 13:44:52.849578 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3168/6374] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:52 2022] GET /compute/v2.1/servers/2afb9959-a444-4fe1-802b-fdf00cb7fca1 => generated 1667 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:52.994747 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-be5ab1b2-e10f-4d20-8cb9-1af1d75996a7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:53.002802 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-be5ab1b2-e10f-4d20-8cb9-1af1d75996a7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135" status: 200 len: 1215 microversion: 2.1 time: 0.176525 Oct 26 13:44:53.003380 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3207/6375] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:52 2022] GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135 => generated 1215 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:44:53.610697 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5f844fce-9a93-4a6c-8599-dbf4e245c2bc tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:53.611310 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5f844fce-9a93-4a6c-8599-dbf4e245c2bc tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:53.617258 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5f844fce-9a93-4a6c-8599-dbf4e245c2bc tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:53.617793 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5f844fce-9a93-4a6c-8599-dbf4e245c2bc tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:53.618289 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5f844fce-9a93-4a6c-8599-dbf4e245c2bc tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:53.618994 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5f844fce-9a93-4a6c-8599-dbf4e245c2bc tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:53.619406 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5f844fce-9a93-4a6c-8599-dbf4e245c2bc tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:53.619825 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5f844fce-9a93-4a6c-8599-dbf4e245c2bc tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:53.763070 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5f844fce-9a93-4a6c-8599-dbf4e245c2bc tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:53.770909 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5f844fce-9a93-4a6c-8599-dbf4e245c2bc tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4" status: 200 len: 1693 microversion: 2.1 time: 0.164385 Oct 26 13:44:53.771481 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3169/6376] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:53 2022] GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4 => generated 1693 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:53.879901 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ce50f567-b046-4ecc-abf6-def76abe44a2 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:53.880502 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ce50f567-b046-4ecc-abf6-def76abe44a2 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: 2afb9959-a444-4fe1-802b-fdf00cb7fca1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:53.882560 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:44:53.883262 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=8 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:44:53.890441 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ce50f567-b046-4ecc-abf6-def76abe44a2 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:53.890922 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ce50f567-b046-4ecc-abf6-def76abe44a2 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:53.891479 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ce50f567-b046-4ecc-abf6-def76abe44a2 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:53.892176 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ce50f567-b046-4ecc-abf6-def76abe44a2 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:53.892632 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ce50f567-b046-4ecc-abf6-def76abe44a2 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:53.893235 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ce50f567-b046-4ecc-abf6-def76abe44a2 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:54.026014 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-08bc0069-1ef5-4ea8-8edd-b9a205111608 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:54.026887 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-08bc0069-1ef5-4ea8-8edd-b9a205111608 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 11e7b2ee-c8f4-4c95-a107-57bfb4ed0135] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:54.033861 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-08bc0069-1ef5-4ea8-8edd-b9a205111608 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:54.034631 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-08bc0069-1ef5-4ea8-8edd-b9a205111608 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:54.035244 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-08bc0069-1ef5-4ea8-8edd-b9a205111608 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:54.036666 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-08bc0069-1ef5-4ea8-8edd-b9a205111608 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:54.037303 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-08bc0069-1ef5-4ea8-8edd-b9a205111608 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:54.037924 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-08bc0069-1ef5-4ea8-8edd-b9a205111608 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:54.053446 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ce50f567-b046-4ecc-abf6-def76abe44a2 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe5aa8de6e24f1faf309f7e3e9a478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2ca8f7890421180d124123db3387f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:54.063153 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ce50f567-b046-4ecc-abf6-def76abe44a2 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/2afb9959-a444-4fe1-802b-fdf00cb7fca1" status: 200 len: 1667 microversion: 2.1 time: 0.187423 Oct 26 13:44:54.081520 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3208/6377] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:53 2022] GET /compute/v2.1/servers/2afb9959-a444-4fe1-802b-fdf00cb7fca1 => generated 1667 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:54.616324 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-e5d8e8b2-c6de-402c-b19c-efb3ebd40532 req-ba14523e-41f2-426a-bbbb-ac981045fb3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2afb9959-a444-4fe1-802b-fdf00cb7fca1", "name": "network-vif-deleted", "tag": "6a36232d-7783-45c8-b2fd-dab0cd450464"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:44:54.627775 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e5d8e8b2-c6de-402c-b19c-efb3ebd40532 req-ba14523e-41f2-426a-bbbb-ac981045fb3c service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:54.628263 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e5d8e8b2-c6de-402c-b19c-efb3ebd40532 req-ba14523e-41f2-426a-bbbb-ac981045fb3c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:54.629161 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e5d8e8b2-c6de-402c-b19c-efb3ebd40532 req-ba14523e-41f2-426a-bbbb-ac981045fb3c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:54.643713 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-e5d8e8b2-c6de-402c-b19c-efb3ebd40532 req-ba14523e-41f2-426a-bbbb-ac981045fb3c service nova] Creating event network-vif-deleted:6a36232d-7783-45c8-b2fd-dab0cd450464 for instance 2afb9959-a444-4fe1-802b-fdf00cb7fca1 on n-h2-862686-1 Oct 26 13:44:54.651203 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-e5d8e8b2-c6de-402c-b19c-efb3ebd40532 req-ba14523e-41f2-426a-bbbb-ac981045fb3c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038713 Oct 26 13:44:54.657151 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3209/6378] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:44:54.674504 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-08bc0069-1ef5-4ea8-8edd-b9a205111608 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:54.684399 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-08bc0069-1ef5-4ea8-8edd-b9a205111608 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135" status: 200 len: 1215 microversion: 2.1 time: 0.662257 Oct 26 13:44:54.697510 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3170/6379] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:54 2022] GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135 => generated 1215 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:44:54.796390 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-78f1df35-9795-41cc-b0d7-1a0847128b33 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:54.797106 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-78f1df35-9795-41cc-b0d7-1a0847128b33 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:54.803762 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78f1df35-9795-41cc-b0d7-1a0847128b33 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:54.804494 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78f1df35-9795-41cc-b0d7-1a0847128b33 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:54.805122 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78f1df35-9795-41cc-b0d7-1a0847128b33 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:54.806474 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78f1df35-9795-41cc-b0d7-1a0847128b33 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:54.807118 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78f1df35-9795-41cc-b0d7-1a0847128b33 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:54.807714 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78f1df35-9795-41cc-b0d7-1a0847128b33 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:55.057879 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-78f1df35-9795-41cc-b0d7-1a0847128b33 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:55.067863 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-78f1df35-9795-41cc-b0d7-1a0847128b33 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4" status: 200 len: 1690 microversion: 2.1 time: 0.277063 Oct 26 13:44:55.068452 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3210/6380] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:54 2022] GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4 => generated 1690 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:55.092847 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2f2f8072-bb62-4aeb-bc09-a969461776d0 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:44:55.093426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2f2f8072-bb62-4aeb-bc09-a969461776d0 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:55.094078 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d3d327c8-c34d-47ab-8307-4ff224ddb204 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:55.094695 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d3d327c8-c34d-47ab-8307-4ff224ddb204 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: 2afb9959-a444-4fe1-802b-fdf00cb7fca1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:55.100727 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2f2f8072-bb62-4aeb-bc09-a969461776d0 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:55.100923 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3d327c8-c34d-47ab-8307-4ff224ddb204 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:55.101215 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3d327c8-c34d-47ab-8307-4ff224ddb204 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:55.101363 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2f2f8072-bb62-4aeb-bc09-a969461776d0 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:55.101683 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2f2f8072-bb62-4aeb-bc09-a969461776d0 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:55.101803 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3d327c8-c34d-47ab-8307-4ff224ddb204 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:55.102392 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2f2f8072-bb62-4aeb-bc09-a969461776d0 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:55.102910 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3d327c8-c34d-47ab-8307-4ff224ddb204 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:55.103044 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2f2f8072-bb62-4aeb-bc09-a969461776d0 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:55.103371 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3d327c8-c34d-47ab-8307-4ff224ddb204 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:55.103486 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2f2f8072-bb62-4aeb-bc09-a969461776d0 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:55.103795 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3d327c8-c34d-47ab-8307-4ff224ddb204 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:55.140985 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3d327c8-c34d-47ab-8307-4ff224ddb204 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:55.141554 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3d327c8-c34d-47ab-8307-4ff224ddb204 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:55.141941 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3d327c8-c34d-47ab-8307-4ff224ddb204 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:55.142392 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-d3d327c8-c34d-47ab-8307-4ff224ddb204 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lazy-loading 'fault' on Instance uuid 2afb9959-a444-4fe1-802b-fdf00cb7fca1 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:44:55.172667 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2f2f8072-bb62-4aeb-bc09-a969461776d0 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "POST /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4/action" status: 204 len: 0 microversion: 2.1 time: 0.083957 Oct 26 13:44:55.173848 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3171/6381] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:44:55 2022] POST /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4/action => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:44:55.185355 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-add8baea-3807-429f-ab56-c01dfcd5acaa tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:55.186824 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-add8baea-3807-429f-ab56-c01dfcd5acaa tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:55.196772 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-add8baea-3807-429f-ab56-c01dfcd5acaa tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:55.197518 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-add8baea-3807-429f-ab56-c01dfcd5acaa tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:55.198023 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-add8baea-3807-429f-ab56-c01dfcd5acaa tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:55.198885 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-add8baea-3807-429f-ab56-c01dfcd5acaa tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:55.199930 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-add8baea-3807-429f-ab56-c01dfcd5acaa tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:55.199930 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-add8baea-3807-429f-ab56-c01dfcd5acaa tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:55.213762 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d3d327c8-c34d-47ab-8307-4ff224ddb204 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe5aa8de6e24f1faf309f7e3e9a478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2ca8f7890421180d124123db3387f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:55.225765 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d3d327c8-c34d-47ab-8307-4ff224ddb204 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/2afb9959-a444-4fe1-802b-fdf00cb7fca1" status: 200 len: 1337 microversion: 2.1 time: 0.135587 Oct 26 13:44:55.226608 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3211/6382] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:55 2022] GET /compute/v2.1/servers/2afb9959-a444-4fe1-802b-fdf00cb7fca1 => generated 1337 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:44:55.404804 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-add8baea-3807-429f-ab56-c01dfcd5acaa tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:55.413053 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-add8baea-3807-429f-ab56-c01dfcd5acaa tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4" status: 200 len: 1690 microversion: 2.1 time: 0.234710 Oct 26 13:44:55.418428 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3172/6383] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:55 2022] GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4 => generated 1690 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:55.708431 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f933af4b-4340-484d-9847-aedf8360d650 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:55.709081 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f933af4b-4340-484d-9847-aedf8360d650 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 11e7b2ee-c8f4-4c95-a107-57bfb4ed0135] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:55.716214 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f933af4b-4340-484d-9847-aedf8360d650 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:55.716708 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f933af4b-4340-484d-9847-aedf8360d650 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:55.717148 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f933af4b-4340-484d-9847-aedf8360d650 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:55.717882 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f933af4b-4340-484d-9847-aedf8360d650 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:55.719056 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f933af4b-4340-484d-9847-aedf8360d650 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:55.719550 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f933af4b-4340-484d-9847-aedf8360d650 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:55.970686 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f933af4b-4340-484d-9847-aedf8360d650 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:55.982815 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f933af4b-4340-484d-9847-aedf8360d650 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135" status: 200 len: 1203 microversion: 2.1 time: 0.277306 Oct 26 13:44:55.984081 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3212/6384] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:55 2022] GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135 => generated 1203 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:56.250149 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-00eb4d8f-6d34-49fa-90c4-487aa1bd0a87 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:56.250722 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-00eb4d8f-6d34-49fa-90c4-487aa1bd0a87 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: 2afb9959-a444-4fe1-802b-fdf00cb7fca1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:56.257842 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-00eb4d8f-6d34-49fa-90c4-487aa1bd0a87 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:56.258337 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-00eb4d8f-6d34-49fa-90c4-487aa1bd0a87 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:56.258785 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-00eb4d8f-6d34-49fa-90c4-487aa1bd0a87 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:56.259499 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-00eb4d8f-6d34-49fa-90c4-487aa1bd0a87 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:56.259949 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-00eb4d8f-6d34-49fa-90c4-487aa1bd0a87 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:56.260377 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-00eb4d8f-6d34-49fa-90c4-487aa1bd0a87 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:56.276936 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-00eb4d8f-6d34-49fa-90c4-487aa1bd0a87 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] HTTP exception thrown: Instance 2afb9959-a444-4fe1-802b-fdf00cb7fca1 could not be found. Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-00eb4d8f-6d34-49fa-90c4-487aa1bd0a87 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Request method failure captured: Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/2afb9959-a444-4fe1-802b-fdf00cb7fca1 HTTP/1.1 Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTlB6nx7WIoeAKoM5LmzE-4SdNpuo3oUw-CyeEspHcaHQXu00Wl-HTDBmplEdxIaAqaNrKwBolo-ROn9MG_a4bhX3BTPKJJ36Xqej37oQSYPtCyku0xHVQI25kxNIyyK8P_UAdFLPKWjkrVxVkhoEUb5sPKI4bF5Bflqagh3alz1u-s Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 8af2ca8f7890421180d124123db3387f Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-TestNetworkBasicOps-144239929 Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8af2ca8f7890421180d124123db3387f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8af2ca8f7890421180d124123db3387f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8af2ca8f7890421180d124123db3387f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8af2ca8f7890421180d124123db3387f"}]}] Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-TestNetworkBasicOps-144239929 Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 8af2ca8f7890421180d124123db3387f Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-TestNetworkBasicOps-144239929 Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-TestNetworkBasicOps-144239929-project Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 3fe5aa8de6e24f1faf309f7e3e9a478c Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-TestNetworkBasicOps-144239929-project Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 2afb9959-a444-4fe1-802b-fdf00cb7fca1 could not be found. Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '2afb9959-a444-4fe1-802b-fdf00cb7fca1'} Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2afb9959-a444-4fe1-802b-fdf00cb7fca1 could not be found. Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2afb9959-a444-4fe1-802b-fdf00cb7fca1 could not be found. Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:44:56.279570 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:44:56.287713 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:44:56.287713 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:44:56.287713 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:44:56.287713 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:44:56.287713 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:44:56.287713 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2afb9959-a444-4fe1-802b-fdf00cb7fca1 could not be found. Oct 26 13:44:56.287713 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:44:56.287713 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-00eb4d8f-6d34-49fa-90c4-487aa1bd0a87 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Returning 404 to user: Instance 2afb9959-a444-4fe1-802b-fdf00cb7fca1 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:44:56.287713 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-00eb4d8f-6d34-49fa-90c4-487aa1bd0a87 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/2afb9959-a444-4fe1-802b-fdf00cb7fca1" status: 404 len: 111 microversion: 2.1 time: 0.035153 Oct 26 13:44:56.293673 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3173/6385] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:56 2022] GET /compute/v2.1/servers/2afb9959-a444-4fe1-802b-fdf00cb7fca1 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:44:56.445966 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1f28e62e-2835-46ae-a1c5-025bceaa6d7c tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:56.451119 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1f28e62e-2835-46ae-a1c5-025bceaa6d7c tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:56.458033 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f28e62e-2835-46ae-a1c5-025bceaa6d7c tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:56.459396 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f28e62e-2835-46ae-a1c5-025bceaa6d7c tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:56.459813 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f28e62e-2835-46ae-a1c5-025bceaa6d7c tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:56.463739 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f28e62e-2835-46ae-a1c5-025bceaa6d7c tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:56.464464 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f28e62e-2835-46ae-a1c5-025bceaa6d7c tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:56.465125 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f28e62e-2835-46ae-a1c5-025bceaa6d7c tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:56.469665 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b182adc4-d02e-457e-9fde-7e1359170e35 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '.version_select at 0x7f67322649d0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:56.493834 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b182adc4-d02e-457e-9fde-7e1359170e35 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-142505396" status: 202 len: 0 microversion: 2.1 time: 0.029562 Oct 26 13:44:56.494420 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3174/6386] 10.222.0.40 () {58 vars in 1254 bytes} [Wed Oct 26 13:44:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-142505396 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 13:44:56.647075 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1f28e62e-2835-46ae-a1c5-025bceaa6d7c tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:56.659038 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1f28e62e-2835-46ae-a1c5-025bceaa6d7c tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4" status: 200 len: 1690 microversion: 2.1 time: 0.220803 Oct 26 13:44:56.660318 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3213/6387] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:56 2022] GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4 => generated 1690 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:44:57.006787 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7b0b2be7-850d-4f4b-b7ab-0e497cf6824d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:57.007410 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7b0b2be7-850d-4f4b-b7ab-0e497cf6824d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 11e7b2ee-c8f4-4c95-a107-57bfb4ed0135] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:57.018817 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b0b2be7-850d-4f4b-b7ab-0e497cf6824d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:57.019613 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b0b2be7-850d-4f4b-b7ab-0e497cf6824d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:57.020230 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b0b2be7-850d-4f4b-b7ab-0e497cf6824d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:57.021880 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b0b2be7-850d-4f4b-b7ab-0e497cf6824d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:57.022538 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b0b2be7-850d-4f4b-b7ab-0e497cf6824d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:57.023697 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b0b2be7-850d-4f4b-b7ab-0e497cf6824d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:57.282954 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7b0b2be7-850d-4f4b-b7ab-0e497cf6824d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:57.291222 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7b0b2be7-850d-4f4b-b7ab-0e497cf6824d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135" status: 200 len: 1203 microversion: 2.1 time: 0.288832 Oct 26 13:44:57.291878 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3175/6388] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:57 2022] GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135 => generated 1203 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:57.687697 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e814a86c-67ee-4cb6-be85-d3e3cec6fe1d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:57.688603 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e814a86c-67ee-4cb6-be85-d3e3cec6fe1d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:57.701475 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e814a86c-67ee-4cb6-be85-d3e3cec6fe1d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:57.702358 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e814a86c-67ee-4cb6-be85-d3e3cec6fe1d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:57.703943 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e814a86c-67ee-4cb6-be85-d3e3cec6fe1d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:57.708100 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e814a86c-67ee-4cb6-be85-d3e3cec6fe1d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:57.708820 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e814a86c-67ee-4cb6-be85-d3e3cec6fe1d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:57.712310 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e814a86c-67ee-4cb6-be85-d3e3cec6fe1d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:57.724429 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-4c34736d-88d9-4f10-a6b2-8d519ec6fce0 req-2d0d9ceb-2d34-49ed-9ac8-1e697fe199e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "911f368c-5a4e-4f89-83e8-52d02202bbc4", "name": "network-vif-plugged", "status": "completed", "tag": "01306531-3518-45b4-ae5b-35d7b905b368"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:44:57.743160 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:44:57.749876 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-4c34736d-88d9-4f10-a6b2-8d519ec6fce0 req-2d0d9ceb-2d34-49ed-9ac8-1e697fe199e9 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:57.750441 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-4c34736d-88d9-4f10-a6b2-8d519ec6fce0 req-2d0d9ceb-2d34-49ed-9ac8-1e697fe199e9 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:57.750882 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-4c34736d-88d9-4f10-a6b2-8d519ec6fce0 req-2d0d9ceb-2d34-49ed-9ac8-1e697fe199e9 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:57.783309 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-4c34736d-88d9-4f10-a6b2-8d519ec6fce0 req-2d0d9ceb-2d34-49ed-9ac8-1e697fe199e9 service nova] Creating event network-vif-plugged:01306531-3518-45b4-ae5b-35d7b905b368 for instance 911f368c-5a4e-4f89-83e8-52d02202bbc4 on n-h2-862686-1 Oct 26 13:44:57.805707 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-4c34736d-88d9-4f10-a6b2-8d519ec6fce0 req-2d0d9ceb-2d34-49ed-9ac8-1e697fe199e9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.303833 Oct 26 13:44:57.806344 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3214/6389] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:44:58.316187 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e76dbb2b-9f7f-47bb-a5ea-3a100aed9058 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:58.316902 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e76dbb2b-9f7f-47bb-a5ea-3a100aed9058 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 11e7b2ee-c8f4-4c95-a107-57bfb4ed0135] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:58.323391 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e76dbb2b-9f7f-47bb-a5ea-3a100aed9058 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:58.323908 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e76dbb2b-9f7f-47bb-a5ea-3a100aed9058 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:58.324423 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e76dbb2b-9f7f-47bb-a5ea-3a100aed9058 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:58.325046 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e76dbb2b-9f7f-47bb-a5ea-3a100aed9058 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:58.325878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e76dbb2b-9f7f-47bb-a5ea-3a100aed9058 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:58.326416 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e76dbb2b-9f7f-47bb-a5ea-3a100aed9058 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:58.351055 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e814a86c-67ee-4cb6-be85-d3e3cec6fe1d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:58.360763 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e814a86c-67ee-4cb6-be85-d3e3cec6fe1d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4" status: 200 len: 1682 microversion: 2.1 time: 0.677996 Oct 26 13:44:58.361667 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3176/6390] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:57 2022] GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4 => generated 1682 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:44:58.540344 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e76dbb2b-9f7f-47bb-a5ea-3a100aed9058 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:58.549933 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e76dbb2b-9f7f-47bb-a5ea-3a100aed9058 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135" status: 200 len: 1203 microversion: 2.1 time: 0.238880 Oct 26 13:44:58.561470 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3215/6391] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:58 2022] GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135 => generated 1203 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:44:59.574200 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a3c20821-2f1d-4f1e-b0f6-3164bd1f1c17 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:44:59.575567 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a3c20821-2f1d-4f1e-b0f6-3164bd1f1c17 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 11e7b2ee-c8f4-4c95-a107-57bfb4ed0135] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:44:59.587030 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:44:59.590538 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a3c20821-2f1d-4f1e-b0f6-3164bd1f1c17 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:59.592730 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a3c20821-2f1d-4f1e-b0f6-3164bd1f1c17 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:59.594138 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a3c20821-2f1d-4f1e-b0f6-3164bd1f1c17 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:59.596447 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a3c20821-2f1d-4f1e-b0f6-3164bd1f1c17 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:44:59.597108 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a3c20821-2f1d-4f1e-b0f6-3164bd1f1c17 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:44:59.598114 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a3c20821-2f1d-4f1e-b0f6-3164bd1f1c17 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:44:59.904035 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a3c20821-2f1d-4f1e-b0f6-3164bd1f1c17 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:44:59.915725 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a3c20821-2f1d-4f1e-b0f6-3164bd1f1c17 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135" status: 200 len: 1203 microversion: 2.1 time: 0.347237 Oct 26 13:44:59.936056 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3177/6392] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:44:59 2022] GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135 => generated 1203 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:00.952879 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-80a4cfce-c54e-4d2d-b480-d30e652ac5c2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:00.954192 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-80a4cfce-c54e-4d2d-b480-d30e652ac5c2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 11e7b2ee-c8f4-4c95-a107-57bfb4ed0135] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:00.960997 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-80a4cfce-c54e-4d2d-b480-d30e652ac5c2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:00.961460 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-80a4cfce-c54e-4d2d-b480-d30e652ac5c2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:00.961945 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-80a4cfce-c54e-4d2d-b480-d30e652ac5c2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:00.962639 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-80a4cfce-c54e-4d2d-b480-d30e652ac5c2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:00.963103 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-80a4cfce-c54e-4d2d-b480-d30e652ac5c2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:00.963521 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-80a4cfce-c54e-4d2d-b480-d30e652ac5c2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:01.256498 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-80a4cfce-c54e-4d2d-b480-d30e652ac5c2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:01.267229 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-80a4cfce-c54e-4d2d-b480-d30e652ac5c2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135" status: 200 len: 1203 microversion: 2.1 time: 0.326677 Oct 26 13:45:01.269241 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3216/6393] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:00 2022] GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135 => generated 1203 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:02.291983 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c279ccaf-7491-4707-ad85-dc2aca4cdf0f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:02.292614 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c279ccaf-7491-4707-ad85-dc2aca4cdf0f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 11e7b2ee-c8f4-4c95-a107-57bfb4ed0135] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:02.301134 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c279ccaf-7491-4707-ad85-dc2aca4cdf0f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:02.301660 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c279ccaf-7491-4707-ad85-dc2aca4cdf0f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:02.302484 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c279ccaf-7491-4707-ad85-dc2aca4cdf0f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:02.303623 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c279ccaf-7491-4707-ad85-dc2aca4cdf0f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:02.305061 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c279ccaf-7491-4707-ad85-dc2aca4cdf0f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:02.305762 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c279ccaf-7491-4707-ad85-dc2aca4cdf0f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:02.354691 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:45:02.502031 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c279ccaf-7491-4707-ad85-dc2aca4cdf0f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:02.522765 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c279ccaf-7491-4707-ad85-dc2aca4cdf0f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135" status: 200 len: 1203 microversion: 2.1 time: 0.236564 Oct 26 13:45:02.534443 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3178/6394] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:02 2022] GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135 => generated 1203 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:03.550626 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-50ed8c50-c620-4de1-8edc-53f5c9cc1a42 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:03.551260 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-50ed8c50-c620-4de1-8edc-53f5c9cc1a42 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 11e7b2ee-c8f4-4c95-a107-57bfb4ed0135] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:03.564890 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50ed8c50-c620-4de1-8edc-53f5c9cc1a42 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:03.567285 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50ed8c50-c620-4de1-8edc-53f5c9cc1a42 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:03.567811 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50ed8c50-c620-4de1-8edc-53f5c9cc1a42 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:03.571526 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50ed8c50-c620-4de1-8edc-53f5c9cc1a42 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:03.572070 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50ed8c50-c620-4de1-8edc-53f5c9cc1a42 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:03.574300 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50ed8c50-c620-4de1-8edc-53f5c9cc1a42 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:03.788795 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-50ed8c50-c620-4de1-8edc-53f5c9cc1a42 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:03.799005 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-50ed8c50-c620-4de1-8edc-53f5c9cc1a42 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135" status: 200 len: 1203 microversion: 2.1 time: 0.253685 Oct 26 13:45:03.814341 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3217/6395] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:03 2022] GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135 => generated 1203 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:04.823609 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-077e7855-24de-428d-b0e3-c243cde16243 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:04.824378 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-077e7855-24de-428d-b0e3-c243cde16243 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 11e7b2ee-c8f4-4c95-a107-57bfb4ed0135] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:04.839729 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-077e7855-24de-428d-b0e3-c243cde16243 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:04.841220 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-077e7855-24de-428d-b0e3-c243cde16243 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:04.841939 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-077e7855-24de-428d-b0e3-c243cde16243 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:04.842683 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-077e7855-24de-428d-b0e3-c243cde16243 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:04.843156 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-077e7855-24de-428d-b0e3-c243cde16243 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:04.843598 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-077e7855-24de-428d-b0e3-c243cde16243 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:05.006248 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-077e7855-24de-428d-b0e3-c243cde16243 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:05.014291 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-077e7855-24de-428d-b0e3-c243cde16243 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135" status: 200 len: 1203 microversion: 2.1 time: 0.194561 Oct 26 13:45:05.014875 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3179/6396] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:04 2022] GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135 => generated 1203 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:05.554865 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-150627c5-7cbc-426d-adaf-e74c4e1b60a2 req-7f6a0cdb-fbcd-49ca-bda5-bb33a986301d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11e7b2ee-c8f4-4c95-a107-57bfb4ed0135", "name": "network-vif-plugged", "status": "completed", "tag": "f58b9e38-5b3b-49c0-b1d1-988c685368cc"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:45:05.570742 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-150627c5-7cbc-426d-adaf-e74c4e1b60a2 req-7f6a0cdb-fbcd-49ca-bda5-bb33a986301d service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:05.571328 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-150627c5-7cbc-426d-adaf-e74c4e1b60a2 req-7f6a0cdb-fbcd-49ca-bda5-bb33a986301d service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:05.571853 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-150627c5-7cbc-426d-adaf-e74c4e1b60a2 req-7f6a0cdb-fbcd-49ca-bda5-bb33a986301d service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:05.599650 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-150627c5-7cbc-426d-adaf-e74c4e1b60a2 req-7f6a0cdb-fbcd-49ca-bda5-bb33a986301d service nova] Creating event network-vif-plugged:f58b9e38-5b3b-49c0-b1d1-988c685368cc for instance 11e7b2ee-c8f4-4c95-a107-57bfb4ed0135 on n-h2-862686-1 Oct 26 13:45:05.613034 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-150627c5-7cbc-426d-adaf-e74c4e1b60a2 req-7f6a0cdb-fbcd-49ca-bda5-bb33a986301d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059115 Oct 26 13:45:05.614150 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3218/6397] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:45:06.037919 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e7b843b4-e19f-4dc0-8c42-130aae4e0e47 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:06.039311 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e7b843b4-e19f-4dc0-8c42-130aae4e0e47 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 11e7b2ee-c8f4-4c95-a107-57bfb4ed0135] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:06.047072 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e7b843b4-e19f-4dc0-8c42-130aae4e0e47 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:06.047571 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e7b843b4-e19f-4dc0-8c42-130aae4e0e47 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:06.048016 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e7b843b4-e19f-4dc0-8c42-130aae4e0e47 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:06.048729 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e7b843b4-e19f-4dc0-8c42-130aae4e0e47 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:06.049186 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e7b843b4-e19f-4dc0-8c42-130aae4e0e47 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:06.049656 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e7b843b4-e19f-4dc0-8c42-130aae4e0e47 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:06.192730 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e18cf205-63a3-4f94-b8f8-2f717f15bbbb tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Action: 'create', calling method: .version_select at 0x7f6736854670>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2086387703", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/wt/UgfyOmUvU0R2rxtcBZi4Ldk6HUbqzREL0noFHoBBmMjnJE22V7GR77IeOHqart8XVXjIR/P20eDDIx4lEckN7y1R0ukp+YpFCvpQvnK402eFk4VFnW/+UdK7bMiw=="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:45:06.225309 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-e18cf205-63a3-4f94-b8f8-2f717f15bbbb tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Getting quotas for project 8af2ca8f7890421180d124123db3387f. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:45:06.232869 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-e18cf205-63a3-4f94-b8f8-2f717f15bbbb tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Getting quotas for user 3fe5aa8de6e24f1faf309f7e3e9a478c and project 8af2ca8f7890421180d124123db3387f. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:45:06.249857 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e7b843b4-e19f-4dc0-8c42-130aae4e0e47 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:06.274362 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e18cf205-63a3-4f94-b8f8-2f717f15bbbb tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.087241 Oct 26 13:45:06.275388 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3219/6398] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 13:45:06 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:45:06.281813 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e7b843b4-e19f-4dc0-8c42-130aae4e0e47 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135" status: 200 len: 1203 microversion: 2.1 time: 0.246927 Oct 26 13:45:06.283066 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3180/6399] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:06 2022] GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135 => generated 1203 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:07.306313 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-705329e1-68c3-4a4d-bb9f-96d5e0bf8642 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:07.307139 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-705329e1-68c3-4a4d-bb9f-96d5e0bf8642 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 11e7b2ee-c8f4-4c95-a107-57bfb4ed0135] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:07.317911 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-705329e1-68c3-4a4d-bb9f-96d5e0bf8642 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:07.318779 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-705329e1-68c3-4a4d-bb9f-96d5e0bf8642 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:07.319514 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-705329e1-68c3-4a4d-bb9f-96d5e0bf8642 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:07.320389 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-705329e1-68c3-4a4d-bb9f-96d5e0bf8642 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:07.321014 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-705329e1-68c3-4a4d-bb9f-96d5e0bf8642 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:07.321636 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-705329e1-68c3-4a4d-bb9f-96d5e0bf8642 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:07.611173 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-705329e1-68c3-4a4d-bb9f-96d5e0bf8642 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:07.619918 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-705329e1-68c3-4a4d-bb9f-96d5e0bf8642 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135" status: 200 len: 1391 microversion: 2.1 time: 0.317460 Oct 26 13:45:07.620510 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3220/6400] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:07 2022] GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135 => generated 1391 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:07.644404 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-26f37f3a-3e71-4337-ae28-55e61ce0fee3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:07.645652 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-26f37f3a-3e71-4337-ae28-55e61ce0fee3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 11e7b2ee-c8f4-4c95-a107-57bfb4ed0135] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:07.652821 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26f37f3a-3e71-4337-ae28-55e61ce0fee3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:07.654464 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26f37f3a-3e71-4337-ae28-55e61ce0fee3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:07.655184 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26f37f3a-3e71-4337-ae28-55e61ce0fee3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:07.656188 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26f37f3a-3e71-4337-ae28-55e61ce0fee3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:07.656861 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26f37f3a-3e71-4337-ae28-55e61ce0fee3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:07.657555 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26f37f3a-3e71-4337-ae28-55e61ce0fee3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:07.688615 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a15d29d1-6c91-4a52-a7ea-6d706d6d2522 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1191151886", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "58b747d6-ce6c-4265-86f2-d9ba6735b9ec"}], "key_name": "tempest-TestNetworkBasicOps-2086387703", "security_groups": [{"name": "tempest-secgroup-smoke-1387253237"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:45:07.858371 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-26f37f3a-3e71-4337-ae28-55e61ce0fee3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:07.868753 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-26f37f3a-3e71-4337-ae28-55e61ce0fee3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135" status: 200 len: 1391 microversion: 2.1 time: 0.228477 Oct 26 13:45:07.888345 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3181/6401] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:07 2022] GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135 => generated 1391 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:07.895676 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-abafca43-1e56-475b-b053-2b649ea6f342 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:07.897071 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-abafca43-1e56-475b-b053-2b649ea6f342 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 11e7b2ee-c8f4-4c95-a107-57bfb4ed0135] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:07.904636 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-abafca43-1e56-475b-b053-2b649ea6f342 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:07.905634 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-abafca43-1e56-475b-b053-2b649ea6f342 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:07.906427 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-abafca43-1e56-475b-b053-2b649ea6f342 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:07.907828 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-abafca43-1e56-475b-b053-2b649ea6f342 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:07.908516 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-abafca43-1e56-475b-b053-2b649ea6f342 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:07.909179 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-abafca43-1e56-475b-b053-2b649ea6f342 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:07.911933 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-a15d29d1-6c91-4a52-a7ea-6d706d6d2522 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] validate_networks() for [('58b747d6-ce6c-4265-86f2-d9ba6735b9ec', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:45:08.116159 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-abafca43-1e56-475b-b053-2b649ea6f342 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:08.129830 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-abafca43-1e56-475b-b053-2b649ea6f342 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135" status: 200 len: 1391 microversion: 2.1 time: 0.238334 Oct 26 13:45:08.131750 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3182/6402] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:07 2022] GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135 => generated 1391 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:45:08.162956 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-98df01d3-90f5-42ff-b32e-2d65d6342856 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:08.163512 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-98df01d3-90f5-42ff-b32e-2d65d6342856 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 11e7b2ee-c8f4-4c95-a107-57bfb4ed0135] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:08.170977 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-98df01d3-90f5-42ff-b32e-2d65d6342856 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:08.171498 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-98df01d3-90f5-42ff-b32e-2d65d6342856 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:08.172054 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-98df01d3-90f5-42ff-b32e-2d65d6342856 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:08.172797 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-98df01d3-90f5-42ff-b32e-2d65d6342856 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:08.174035 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-98df01d3-90f5-42ff-b32e-2d65d6342856 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:08.174757 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-98df01d3-90f5-42ff-b32e-2d65d6342856 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:08.224849 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-98df01d3-90f5-42ff-b32e-2d65d6342856 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 11e7b2ee-c8f4-4c95-a107-57bfb4ed0135] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:45:08.323747 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-98df01d3-90f5-42ff-b32e-2d65d6342856 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "DELETE /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135" status: 204 len: 0 microversion: 2.1 time: 0.163293 Oct 26 13:45:08.324019 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3183/6403] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:45:08 2022] DELETE /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:45:08.333845 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-70f0eab6-44f1-4a9f-88d0-afac6e7bd8d7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:08.335034 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-70f0eab6-44f1-4a9f-88d0-afac6e7bd8d7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 11e7b2ee-c8f4-4c95-a107-57bfb4ed0135] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:08.341632 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-70f0eab6-44f1-4a9f-88d0-afac6e7bd8d7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:08.342135 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-70f0eab6-44f1-4a9f-88d0-afac6e7bd8d7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:08.342623 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-70f0eab6-44f1-4a9f-88d0-afac6e7bd8d7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:08.343342 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-70f0eab6-44f1-4a9f-88d0-afac6e7bd8d7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:08.343803 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-70f0eab6-44f1-4a9f-88d0-afac6e7bd8d7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:08.344226 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-70f0eab6-44f1-4a9f-88d0-afac6e7bd8d7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:08.522682 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-a15d29d1-6c91-4a52-a7ea-6d706d6d2522 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:45:08.523244 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-a15d29d1-6c91-4a52-a7ea-6d706d6d2522 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:45:08.523593 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-a15d29d1-6c91-4a52-a7ea-6d706d6d2522 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:45:08.524011 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-a15d29d1-6c91-4a52-a7ea-6d706d6d2522 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:45:08.524430 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-a15d29d1-6c91-4a52-a7ea-6d706d6d2522 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:45:08.527244 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-70f0eab6-44f1-4a9f-88d0-afac6e7bd8d7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:08.537280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a15d29d1-6c91-4a52-a7ea-6d706d6d2522 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:08.537842 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a15d29d1-6c91-4a52-a7ea-6d706d6d2522 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:08.538292 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a15d29d1-6c91-4a52-a7ea-6d706d6d2522 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:08.539037 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-70f0eab6-44f1-4a9f-88d0-afac6e7bd8d7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135" status: 200 len: 1397 microversion: 2.1 time: 0.209134 Oct 26 13:45:08.539828 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a15d29d1-6c91-4a52-a7ea-6d706d6d2522 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:08.540660 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a15d29d1-6c91-4a52-a7ea-6d706d6d2522 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:08.541341 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a15d29d1-6c91-4a52-a7ea-6d706d6d2522 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:08.546459 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3184/6404] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:08 2022] GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135 => generated 1397 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:45:08.569029 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-a15d29d1-6c91-4a52-a7ea-6d706d6d2522 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Getting quotas for project 8af2ca8f7890421180d124123db3387f. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:45:08.575225 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-a15d29d1-6c91-4a52-a7ea-6d706d6d2522 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Getting quotas for user 3fe5aa8de6e24f1faf309f7e3e9a478c and project 8af2ca8f7890421180d124123db3387f. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:45:08.593393 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a15d29d1-6c91-4a52-a7ea-6d706d6d2522 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:45:08.596211 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a15d29d1-6c91-4a52-a7ea-6d706d6d2522 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: c2f26f30-0505-403e-a11c-260fc8d49892] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:45:08.666307 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a15d29d1-6c91-4a52-a7ea-6d706d6d2522 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.980174 Oct 26 13:45:08.667682 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3221/6405] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:45:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:45:08.680324 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-840cba91-c029-493e-90ca-b9fa591f8deb tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:08.681104 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-840cba91-c029-493e-90ca-b9fa591f8deb tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: c2f26f30-0505-403e-a11c-260fc8d49892] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:08.752252 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-840cba91-c029-493e-90ca-b9fa591f8deb tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe5aa8de6e24f1faf309f7e3e9a478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2ca8f7890421180d124123db3387f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:08.761236 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-840cba91-c029-493e-90ca-b9fa591f8deb tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/c2f26f30-0505-403e-a11c-260fc8d49892" status: 200 len: 1249 microversion: 2.1 time: 0.084784 Oct 26 13:45:08.763088 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3185/6406] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:08 2022] GET /compute/v2.1/servers/c2f26f30-0505-403e-a11c-260fc8d49892 => generated 1249 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:09.578234 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-73d77f7a-ebee-4f60-b58e-4486aed137b0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:09.579131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-73d77f7a-ebee-4f60-b58e-4486aed137b0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 11e7b2ee-c8f4-4c95-a107-57bfb4ed0135] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:09.608782 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73d77f7a-ebee-4f60-b58e-4486aed137b0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:09.609699 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73d77f7a-ebee-4f60-b58e-4486aed137b0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:09.610351 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73d77f7a-ebee-4f60-b58e-4486aed137b0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:09.611282 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73d77f7a-ebee-4f60-b58e-4486aed137b0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:09.611927 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73d77f7a-ebee-4f60-b58e-4486aed137b0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:09.612540 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73d77f7a-ebee-4f60-b58e-4486aed137b0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:09.789534 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dcf81613-899d-4906-ac07-4c5b7b014090 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:09.790794 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-dcf81613-899d-4906-ac07-4c5b7b014090 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: c2f26f30-0505-403e-a11c-260fc8d49892] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:09.812048 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dcf81613-899d-4906-ac07-4c5b7b014090 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:09.812876 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dcf81613-899d-4906-ac07-4c5b7b014090 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:09.818340 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dcf81613-899d-4906-ac07-4c5b7b014090 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:09.819232 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dcf81613-899d-4906-ac07-4c5b7b014090 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:09.819884 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dcf81613-899d-4906-ac07-4c5b7b014090 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:09.820338 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dcf81613-899d-4906-ac07-4c5b7b014090 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:09.870848 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-73d77f7a-ebee-4f60-b58e-4486aed137b0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:09.892469 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-73d77f7a-ebee-4f60-b58e-4486aed137b0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135" status: 200 len: 1397 microversion: 2.1 time: 0.319743 Oct 26 13:45:09.893532 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3222/6407] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:09 2022] GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135 => generated 1397 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:09.945879 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-dcf81613-899d-4906-ac07-4c5b7b014090 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe5aa8de6e24f1faf309f7e3e9a478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2ca8f7890421180d124123db3387f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:09.956159 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-dcf81613-899d-4906-ac07-4c5b7b014090 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/c2f26f30-0505-403e-a11c-260fc8d49892" status: 200 len: 1301 microversion: 2.1 time: 0.172777 Oct 26 13:45:09.957766 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3186/6408] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:09 2022] GET /compute/v2.1/servers/c2f26f30-0505-403e-a11c-260fc8d49892 => generated 1301 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:10.919521 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7bbb9a31-d21a-4954-ab22-792899e2cf7f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:10.921087 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7bbb9a31-d21a-4954-ab22-792899e2cf7f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 11e7b2ee-c8f4-4c95-a107-57bfb4ed0135] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:10.943429 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7bbb9a31-d21a-4954-ab22-792899e2cf7f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:10.946655 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7bbb9a31-d21a-4954-ab22-792899e2cf7f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:10.950465 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7bbb9a31-d21a-4954-ab22-792899e2cf7f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:10.955248 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7bbb9a31-d21a-4954-ab22-792899e2cf7f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:10.964347 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7bbb9a31-d21a-4954-ab22-792899e2cf7f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:10.972912 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-d6310f5f-b8f6-4e89-86d8-3ab63ed463b3 req-7d9d46f2-d822-4fe4-9329-d42a1f4fe178 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11e7b2ee-c8f4-4c95-a107-57bfb4ed0135", "name": "network-vif-deleted", "tag": "f58b9e38-5b3b-49c0-b1d1-988c685368cc"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:45:10.978593 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7bbb9a31-d21a-4954-ab22-792899e2cf7f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:10.989620 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d6310f5f-b8f6-4e89-86d8-3ab63ed463b3 req-7d9d46f2-d822-4fe4-9329-d42a1f4fe178 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:10.990420 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d6310f5f-b8f6-4e89-86d8-3ab63ed463b3 req-7d9d46f2-d822-4fe4-9329-d42a1f4fe178 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:10.991073 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d6310f5f-b8f6-4e89-86d8-3ab63ed463b3 req-7d9d46f2-d822-4fe4-9329-d42a1f4fe178 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:11.010132 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-d6310f5f-b8f6-4e89-86d8-3ab63ed463b3 req-7d9d46f2-d822-4fe4-9329-d42a1f4fe178 service nova] Creating event network-vif-deleted:f58b9e38-5b3b-49c0-b1d1-988c685368cc for instance 11e7b2ee-c8f4-4c95-a107-57bfb4ed0135 on n-h2-862686-1 Oct 26 13:45:11.024424 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-d6310f5f-b8f6-4e89-86d8-3ab63ed463b3 req-7d9d46f2-d822-4fe4-9329-d42a1f4fe178 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055426 Oct 26 13:45:11.029099 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3187/6409] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:45:11.039720 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9aba3d72-1ddb-4567-9698-84ef0076d2ba tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:11.040658 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9aba3d72-1ddb-4567-9698-84ef0076d2ba tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: c2f26f30-0505-403e-a11c-260fc8d49892] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:11.052253 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9aba3d72-1ddb-4567-9698-84ef0076d2ba tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:11.053061 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9aba3d72-1ddb-4567-9698-84ef0076d2ba tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:11.067548 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9aba3d72-1ddb-4567-9698-84ef0076d2ba tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:11.068890 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9aba3d72-1ddb-4567-9698-84ef0076d2ba tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:11.070384 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9aba3d72-1ddb-4567-9698-84ef0076d2ba tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:11.071400 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9aba3d72-1ddb-4567-9698-84ef0076d2ba tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:11.165668 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7bbb9a31-d21a-4954-ab22-792899e2cf7f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:11.175077 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7bbb9a31-d21a-4954-ab22-792899e2cf7f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135" status: 200 len: 1355 microversion: 2.1 time: 0.260787 Oct 26 13:45:11.181109 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3223/6410] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:10 2022] GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135 => generated 1355 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:11.212692 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9aba3d72-1ddb-4567-9698-84ef0076d2ba tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe5aa8de6e24f1faf309f7e3e9a478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2ca8f7890421180d124123db3387f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:11.223240 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9aba3d72-1ddb-4567-9698-84ef0076d2ba tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/c2f26f30-0505-403e-a11c-260fc8d49892" status: 200 len: 1307 microversion: 2.1 time: 0.192453 Oct 26 13:45:11.225178 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3188/6411] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:11 2022] GET /compute/v2.1/servers/c2f26f30-0505-403e-a11c-260fc8d49892 => generated 1307 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:12.204695 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1b5962de-ebe1-4b4e-b533-a2b107f606da tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:12.206680 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1b5962de-ebe1-4b4e-b533-a2b107f606da tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 11e7b2ee-c8f4-4c95-a107-57bfb4ed0135] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:12.214218 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b5962de-ebe1-4b4e-b533-a2b107f606da tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:12.217040 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b5962de-ebe1-4b4e-b533-a2b107f606da tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:12.217735 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b5962de-ebe1-4b4e-b533-a2b107f606da tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:12.218637 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b5962de-ebe1-4b4e-b533-a2b107f606da tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:12.219272 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b5962de-ebe1-4b4e-b533-a2b107f606da tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:12.219890 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b5962de-ebe1-4b4e-b533-a2b107f606da tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:12.252442 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-48d06e44-1ab5-4f0b-86db-3cb8e2c8cbbe tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:12.253015 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-48d06e44-1ab5-4f0b-86db-3cb8e2c8cbbe tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: c2f26f30-0505-403e-a11c-260fc8d49892] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:12.259525 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-48d06e44-1ab5-4f0b-86db-3cb8e2c8cbbe tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:12.260015 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-48d06e44-1ab5-4f0b-86db-3cb8e2c8cbbe tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:12.260455 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-48d06e44-1ab5-4f0b-86db-3cb8e2c8cbbe tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:12.261157 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-48d06e44-1ab5-4f0b-86db-3cb8e2c8cbbe tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:12.268558 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-48d06e44-1ab5-4f0b-86db-3cb8e2c8cbbe tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:12.269155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-48d06e44-1ab5-4f0b-86db-3cb8e2c8cbbe tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:12.304422 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1b5962de-ebe1-4b4e-b533-a2b107f606da tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:12.316624 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1b5962de-ebe1-4b4e-b533-a2b107f606da tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135" status: 200 len: 1188 microversion: 2.1 time: 0.116450 Oct 26 13:45:12.334580 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3224/6412] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:12 2022] GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135 => generated 1188 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:12.428027 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-48d06e44-1ab5-4f0b-86db-3cb8e2c8cbbe tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe5aa8de6e24f1faf309f7e3e9a478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2ca8f7890421180d124123db3387f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:12.437972 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-48d06e44-1ab5-4f0b-86db-3cb8e2c8cbbe tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/c2f26f30-0505-403e-a11c-260fc8d49892" status: 200 len: 1375 microversion: 2.1 time: 0.189278 Oct 26 13:45:12.440063 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3189/6413] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:12 2022] GET /compute/v2.1/servers/c2f26f30-0505-403e-a11c-260fc8d49892 => generated 1375 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:13.048502 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-11673445-b122-4b93-8234-e857403f133a req-f0771ae5-0775-4e12-a0c3-305316413b8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2f26f30-0505-403e-a11c-260fc8d49892", "tag": "ccf3bba9-fb31-4df3-9464-35b3266ab518"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:45:13.058390 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-11673445-b122-4b93-8234-e857403f133a req-f0771ae5-0775-4e12-a0c3-305316413b8b service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:13.058990 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-11673445-b122-4b93-8234-e857403f133a req-f0771ae5-0775-4e12-a0c3-305316413b8b service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:13.059560 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-11673445-b122-4b93-8234-e857403f133a req-f0771ae5-0775-4e12-a0c3-305316413b8b service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:13.071528 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-11673445-b122-4b93-8234-e857403f133a req-f0771ae5-0775-4e12-a0c3-305316413b8b service nova] Creating event network-changed:ccf3bba9-fb31-4df3-9464-35b3266ab518 for instance c2f26f30-0505-403e-a11c-260fc8d49892 on n-h1-862686-1 Oct 26 13:45:13.076788 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-11673445-b122-4b93-8234-e857403f133a req-f0771ae5-0775-4e12-a0c3-305316413b8b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032771 Oct 26 13:45:13.077517 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3225/6414] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:45:13.343043 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ae027231-7c99-4059-9aca-58c9597d453e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:13.343585 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ae027231-7c99-4059-9aca-58c9597d453e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 11e7b2ee-c8f4-4c95-a107-57bfb4ed0135] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:13.350720 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae027231-7c99-4059-9aca-58c9597d453e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:13.351206 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae027231-7c99-4059-9aca-58c9597d453e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:13.351642 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae027231-7c99-4059-9aca-58c9597d453e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:13.352331 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae027231-7c99-4059-9aca-58c9597d453e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:13.352783 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae027231-7c99-4059-9aca-58c9597d453e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:13.353207 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae027231-7c99-4059-9aca-58c9597d453e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:13.424640 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ae027231-7c99-4059-9aca-58c9597d453e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:13.438542 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ae027231-7c99-4059-9aca-58c9597d453e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135" status: 200 len: 1188 microversion: 2.1 time: 0.099854 Oct 26 13:45:13.454595 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3190/6415] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:13 2022] GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135 => generated 1188 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:13.466090 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6f12f5c0-52d4-43d6-9a9d-57d2511d2cb0 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:13.467078 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6f12f5c0-52d4-43d6-9a9d-57d2511d2cb0 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: c2f26f30-0505-403e-a11c-260fc8d49892] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:13.485140 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6f12f5c0-52d4-43d6-9a9d-57d2511d2cb0 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:13.488711 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6f12f5c0-52d4-43d6-9a9d-57d2511d2cb0 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:13.489397 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6f12f5c0-52d4-43d6-9a9d-57d2511d2cb0 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:13.490240 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6f12f5c0-52d4-43d6-9a9d-57d2511d2cb0 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:13.490797 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6f12f5c0-52d4-43d6-9a9d-57d2511d2cb0 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:13.491294 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6f12f5c0-52d4-43d6-9a9d-57d2511d2cb0 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:13.636820 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6f12f5c0-52d4-43d6-9a9d-57d2511d2cb0 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe5aa8de6e24f1faf309f7e3e9a478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2ca8f7890421180d124123db3387f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:13.641570 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:45:13.647572 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6f12f5c0-52d4-43d6-9a9d-57d2511d2cb0 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/c2f26f30-0505-403e-a11c-260fc8d49892" status: 200 len: 1375 microversion: 2.1 time: 0.186990 Oct 26 13:45:13.648493 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3226/6416] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:13 2022] GET /compute/v2.1/servers/c2f26f30-0505-403e-a11c-260fc8d49892 => generated 1375 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:14.463680 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fdd22d99-759f-4af4-b3bd-e8ccc21d16ca tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:14.464468 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fdd22d99-759f-4af4-b3bd-e8ccc21d16ca tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 11e7b2ee-c8f4-4c95-a107-57bfb4ed0135] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:14.472602 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fdd22d99-759f-4af4-b3bd-e8ccc21d16ca tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:14.473391 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fdd22d99-759f-4af4-b3bd-e8ccc21d16ca tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:14.474107 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fdd22d99-759f-4af4-b3bd-e8ccc21d16ca tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:14.475033 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fdd22d99-759f-4af4-b3bd-e8ccc21d16ca tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:14.475708 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fdd22d99-759f-4af4-b3bd-e8ccc21d16ca tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:14.476396 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fdd22d99-759f-4af4-b3bd-e8ccc21d16ca tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:14.556202 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fdd22d99-759f-4af4-b3bd-e8ccc21d16ca tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:14.565659 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fdd22d99-759f-4af4-b3bd-e8ccc21d16ca tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135" status: 200 len: 1188 microversion: 2.1 time: 0.105698 Oct 26 13:45:14.575307 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3191/6417] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:14 2022] GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135 => generated 1188 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:14.674769 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ea356a46-e953-4fe6-8476-b10055146b1e tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:14.675387 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ea356a46-e953-4fe6-8476-b10055146b1e tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: c2f26f30-0505-403e-a11c-260fc8d49892] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:14.691243 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ea356a46-e953-4fe6-8476-b10055146b1e tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:14.691900 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ea356a46-e953-4fe6-8476-b10055146b1e tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:14.692450 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ea356a46-e953-4fe6-8476-b10055146b1e tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:14.693284 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ea356a46-e953-4fe6-8476-b10055146b1e tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:14.693883 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ea356a46-e953-4fe6-8476-b10055146b1e tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:14.694584 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ea356a46-e953-4fe6-8476-b10055146b1e tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:14.880550 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ea356a46-e953-4fe6-8476-b10055146b1e tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe5aa8de6e24f1faf309f7e3e9a478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2ca8f7890421180d124123db3387f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:14.889215 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ea356a46-e953-4fe6-8476-b10055146b1e tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/c2f26f30-0505-403e-a11c-260fc8d49892" status: 200 len: 1375 microversion: 2.1 time: 0.221001 Oct 26 13:45:14.889831 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3227/6418] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:14 2022] GET /compute/v2.1/servers/c2f26f30-0505-403e-a11c-260fc8d49892 => generated 1375 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:15.594632 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c785c986-d63b-45a1-a521-0ce39213a0e3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:15.597905 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c785c986-d63b-45a1-a521-0ce39213a0e3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 11e7b2ee-c8f4-4c95-a107-57bfb4ed0135] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:15.607556 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c785c986-d63b-45a1-a521-0ce39213a0e3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:15.608190 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c785c986-d63b-45a1-a521-0ce39213a0e3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:15.608729 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c785c986-d63b-45a1-a521-0ce39213a0e3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:15.609712 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c785c986-d63b-45a1-a521-0ce39213a0e3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:15.610373 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c785c986-d63b-45a1-a521-0ce39213a0e3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:15.611587 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c785c986-d63b-45a1-a521-0ce39213a0e3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:15.685931 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c785c986-d63b-45a1-a521-0ce39213a0e3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:15.694838 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c785c986-d63b-45a1-a521-0ce39213a0e3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135" status: 200 len: 1188 microversion: 2.1 time: 0.107862 Oct 26 13:45:15.695743 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3192/6419] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:15 2022] GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135 => generated 1188 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:15.913830 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-85625d67-2193-4b7d-bc2a-6e4dcbc59bda tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:15.914448 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-85625d67-2193-4b7d-bc2a-6e4dcbc59bda tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: c2f26f30-0505-403e-a11c-260fc8d49892] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:15.922472 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-85625d67-2193-4b7d-bc2a-6e4dcbc59bda tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:15.922962 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-85625d67-2193-4b7d-bc2a-6e4dcbc59bda tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:15.923418 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-85625d67-2193-4b7d-bc2a-6e4dcbc59bda tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:15.924108 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-85625d67-2193-4b7d-bc2a-6e4dcbc59bda tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:15.924564 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-85625d67-2193-4b7d-bc2a-6e4dcbc59bda tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:15.924990 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-85625d67-2193-4b7d-bc2a-6e4dcbc59bda tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:16.064459 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-85625d67-2193-4b7d-bc2a-6e4dcbc59bda tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe5aa8de6e24f1faf309f7e3e9a478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2ca8f7890421180d124123db3387f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:16.072867 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-85625d67-2193-4b7d-bc2a-6e4dcbc59bda tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/c2f26f30-0505-403e-a11c-260fc8d49892" status: 200 len: 1375 microversion: 2.1 time: 0.163041 Oct 26 13:45:16.073439 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3228/6420] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:15 2022] GET /compute/v2.1/servers/c2f26f30-0505-403e-a11c-260fc8d49892 => generated 1375 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:16.718832 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fc65b622-524a-4e30-8aa8-651240e13ce9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:16.719451 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fc65b622-524a-4e30-8aa8-651240e13ce9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 11e7b2ee-c8f4-4c95-a107-57bfb4ed0135] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:16.726320 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fc65b622-524a-4e30-8aa8-651240e13ce9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:16.726816 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fc65b622-524a-4e30-8aa8-651240e13ce9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:16.727261 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fc65b622-524a-4e30-8aa8-651240e13ce9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:16.727962 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fc65b622-524a-4e30-8aa8-651240e13ce9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:16.728421 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fc65b622-524a-4e30-8aa8-651240e13ce9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:16.728853 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fc65b622-524a-4e30-8aa8-651240e13ce9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:16.742985 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-fc65b622-524a-4e30-8aa8-651240e13ce9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] HTTP exception thrown: Instance 11e7b2ee-c8f4-4c95-a107-57bfb4ed0135 could not be found. Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fc65b622-524a-4e30-8aa8-651240e13ce9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Request method failure captured: Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135 HTTP/1.1 Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTnApzC1uv7RYc2W5kY-bKNxAsuZUBfTmQjsjWgzUuX11tX2R8DM_Fw7sVvtXRV9882pAeMKhCsEaXlaTjkLCgPxZsqy0UGzQzulFtHD7rhQ8cnkvWXYr0SPAMtN1JLnqGya627Ln2uWIw1ej-ApXw_efP2G5pRjjzhMaFQwCWIvwTI Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 2a1602330aa340b890bac76a120f74e8 Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-TestVolumeBootPattern-608207068 Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2a1602330aa340b890bac76a120f74e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2a1602330aa340b890bac76a120f74e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2a1602330aa340b890bac76a120f74e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2a1602330aa340b890bac76a120f74e8"}]}] Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-TestVolumeBootPattern-608207068 Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 2a1602330aa340b890bac76a120f74e8 Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-TestVolumeBootPattern-608207068 Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-TestVolumeBootPattern-608207068-project Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: df8b67aae3ea4f17bfa684681311dec5 Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-TestVolumeBootPattern-608207068-project Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 11e7b2ee-c8f4-4c95-a107-57bfb4ed0135 could not be found. Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '11e7b2ee-c8f4-4c95-a107-57bfb4ed0135'} Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11e7b2ee-c8f4-4c95-a107-57bfb4ed0135 could not be found. Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11e7b2ee-c8f4-4c95-a107-57bfb4ed0135 could not be found. Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:45:16.744641 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:45:16.750568 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:45:16.750568 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:45:16.750568 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:45:16.750568 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:45:16.750568 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:45:16.750568 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11e7b2ee-c8f4-4c95-a107-57bfb4ed0135 could not be found. Oct 26 13:45:16.750568 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:45:16.750568 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fc65b622-524a-4e30-8aa8-651240e13ce9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Returning 404 to user: Instance 11e7b2ee-c8f4-4c95-a107-57bfb4ed0135 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:45:16.750568 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fc65b622-524a-4e30-8aa8-651240e13ce9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135" status: 404 len: 111 microversion: 2.1 time: 0.031651 Oct 26 13:45:16.750568 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3193/6421] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:16 2022] GET /compute/v2.1/servers/11e7b2ee-c8f4-4c95-a107-57bfb4ed0135 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:45:17.097096 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7f7e2d09-7ae3-4c2c-be35-237a41e795ec tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:17.097652 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7f7e2d09-7ae3-4c2c-be35-237a41e795ec tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: c2f26f30-0505-403e-a11c-260fc8d49892] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:17.104789 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f7e2d09-7ae3-4c2c-be35-237a41e795ec tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:17.105306 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f7e2d09-7ae3-4c2c-be35-237a41e795ec tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:17.106534 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f7e2d09-7ae3-4c2c-be35-237a41e795ec tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:17.107339 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f7e2d09-7ae3-4c2c-be35-237a41e795ec tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:17.107806 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f7e2d09-7ae3-4c2c-be35-237a41e795ec tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:17.108242 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7f7e2d09-7ae3-4c2c-be35-237a41e795ec tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:17.248554 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7f7e2d09-7ae3-4c2c-be35-237a41e795ec tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe5aa8de6e24f1faf309f7e3e9a478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2ca8f7890421180d124123db3387f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:17.257526 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7f7e2d09-7ae3-4c2c-be35-237a41e795ec tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/c2f26f30-0505-403e-a11c-260fc8d49892" status: 200 len: 1375 microversion: 2.1 time: 0.164401 Oct 26 13:45:17.265500 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3229/6422] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:17 2022] GET /compute/v2.1/servers/c2f26f30-0505-403e-a11c-260fc8d49892 => generated 1375 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:17.488943 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-1db2952a-0ac6-4be3-97ab-21a1ee2fe25e req-64f02270-d607-4e0f-b923-400fc1b1fd43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2f26f30-0505-403e-a11c-260fc8d49892", "name": "network-vif-plugged", "status": "completed", "tag": "ccf3bba9-fb31-4df3-9464-35b3266ab518"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:45:17.500079 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-1db2952a-0ac6-4be3-97ab-21a1ee2fe25e req-64f02270-d607-4e0f-b923-400fc1b1fd43 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:17.500607 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-1db2952a-0ac6-4be3-97ab-21a1ee2fe25e req-64f02270-d607-4e0f-b923-400fc1b1fd43 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:17.501307 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-1db2952a-0ac6-4be3-97ab-21a1ee2fe25e req-64f02270-d607-4e0f-b923-400fc1b1fd43 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:17.516606 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-1db2952a-0ac6-4be3-97ab-21a1ee2fe25e req-64f02270-d607-4e0f-b923-400fc1b1fd43 service nova] Creating event network-vif-plugged:ccf3bba9-fb31-4df3-9464-35b3266ab518 for instance c2f26f30-0505-403e-a11c-260fc8d49892 on n-h1-862686-1 Oct 26 13:45:17.522277 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-1db2952a-0ac6-4be3-97ab-21a1ee2fe25e req-64f02270-d607-4e0f-b923-400fc1b1fd43 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037384 Oct 26 13:45:17.523406 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3194/6423] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:45:18.282484 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e2ced32e-58d6-479e-9f1c-3b43370d84f0 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:18.283533 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e2ced32e-58d6-479e-9f1c-3b43370d84f0 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: c2f26f30-0505-403e-a11c-260fc8d49892] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:18.291203 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e2ced32e-58d6-479e-9f1c-3b43370d84f0 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:18.292037 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e2ced32e-58d6-479e-9f1c-3b43370d84f0 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:18.292675 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e2ced32e-58d6-479e-9f1c-3b43370d84f0 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:18.294847 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e2ced32e-58d6-479e-9f1c-3b43370d84f0 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:18.295316 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e2ced32e-58d6-479e-9f1c-3b43370d84f0 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:18.295744 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e2ced32e-58d6-479e-9f1c-3b43370d84f0 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:18.433633 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e2ced32e-58d6-479e-9f1c-3b43370d84f0 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe5aa8de6e24f1faf309f7e3e9a478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2ca8f7890421180d124123db3387f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:18.441803 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e2ced32e-58d6-479e-9f1c-3b43370d84f0 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/c2f26f30-0505-403e-a11c-260fc8d49892" status: 200 len: 1375 microversion: 2.1 time: 0.164566 Oct 26 13:45:18.442507 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3230/6424] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:18 2022] GET /compute/v2.1/servers/c2f26f30-0505-403e-a11c-260fc8d49892 => generated 1375 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:19.464223 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:45:19.469663 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1a17eb48-679d-4216-ae86-3a40a6dec4e8 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:19.470483 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1a17eb48-679d-4216-ae86-3a40a6dec4e8 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: c2f26f30-0505-403e-a11c-260fc8d49892] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:19.480815 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a17eb48-679d-4216-ae86-3a40a6dec4e8 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:19.480815 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a17eb48-679d-4216-ae86-3a40a6dec4e8 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:19.482114 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a17eb48-679d-4216-ae86-3a40a6dec4e8 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:19.483045 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a17eb48-679d-4216-ae86-3a40a6dec4e8 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:19.483871 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a17eb48-679d-4216-ae86-3a40a6dec4e8 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:19.484364 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a17eb48-679d-4216-ae86-3a40a6dec4e8 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:19.636202 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1a17eb48-679d-4216-ae86-3a40a6dec4e8 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe5aa8de6e24f1faf309f7e3e9a478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2ca8f7890421180d124123db3387f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:19.645064 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1a17eb48-679d-4216-ae86-3a40a6dec4e8 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/c2f26f30-0505-403e-a11c-260fc8d49892" status: 200 len: 1547 microversion: 2.1 time: 0.183102 Oct 26 13:45:19.645772 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3195/6425] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:19 2022] GET /compute/v2.1/servers/c2f26f30-0505-403e-a11c-260fc8d49892 => generated 1547 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:19.669330 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4f5b5605-a7c2-40fb-8aad-ab6e47117fef tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:19.670175 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4f5b5605-a7c2-40fb-8aad-ab6e47117fef tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: c2f26f30-0505-403e-a11c-260fc8d49892] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:19.672380 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:45:19.673167 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=10 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:45:19.681503 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f5b5605-a7c2-40fb-8aad-ab6e47117fef tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:19.682331 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f5b5605-a7c2-40fb-8aad-ab6e47117fef tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:19.683040 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f5b5605-a7c2-40fb-8aad-ab6e47117fef tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:19.684558 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f5b5605-a7c2-40fb-8aad-ab6e47117fef tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:19.685180 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f5b5605-a7c2-40fb-8aad-ab6e47117fef tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:19.685855 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f5b5605-a7c2-40fb-8aad-ab6e47117fef tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:19.827603 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4f5b5605-a7c2-40fb-8aad-ab6e47117fef tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe5aa8de6e24f1faf309f7e3e9a478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2ca8f7890421180d124123db3387f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:19.835594 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4f5b5605-a7c2-40fb-8aad-ab6e47117fef tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/c2f26f30-0505-403e-a11c-260fc8d49892" status: 200 len: 1547 microversion: 2.1 time: 0.171469 Oct 26 13:45:19.836100 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3231/6426] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:19 2022] GET /compute/v2.1/servers/c2f26f30-0505-403e-a11c-260fc8d49892 => generated 1547 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:20.610774 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4425c21f-e0c1-474f-a0d1-fde9bc22e388 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:45:20.613507 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4425c21f-e0c1-474f-a0d1-fde9bc22e388 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:20.635734 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4425c21f-e0c1-474f-a0d1-fde9bc22e388 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:20.638291 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4425c21f-e0c1-474f-a0d1-fde9bc22e388 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:20.642201 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4425c21f-e0c1-474f-a0d1-fde9bc22e388 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:20.642201 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4425c21f-e0c1-474f-a0d1-fde9bc22e388 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:20.642635 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4425c21f-e0c1-474f-a0d1-fde9bc22e388 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:20.643534 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4425c21f-e0c1-474f-a0d1-fde9bc22e388 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:20.662927 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:45:20.713974 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4425c21f-e0c1-474f-a0d1-fde9bc22e388 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "POST /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4/action" status: 200 len: 24580 microversion: 2.1 time: 0.109463 Oct 26 13:45:20.722267 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3196/6427] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:45:20 2022] POST /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4/action => generated 24580 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:45:21.982617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-3f8c7589-eee3-4813-8a89-6f4465ef42a5 req-aa7264a2-d90d-4552-95b6-5f88331b940d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2f26f30-0505-403e-a11c-260fc8d49892", "tag": "ccf3bba9-fb31-4df3-9464-35b3266ab518"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:45:21.996887 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-3f8c7589-eee3-4813-8a89-6f4465ef42a5 req-aa7264a2-d90d-4552-95b6-5f88331b940d service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:21.997364 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-3f8c7589-eee3-4813-8a89-6f4465ef42a5 req-aa7264a2-d90d-4552-95b6-5f88331b940d service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:21.997817 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-3f8c7589-eee3-4813-8a89-6f4465ef42a5 req-aa7264a2-d90d-4552-95b6-5f88331b940d service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:22.010110 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-3f8c7589-eee3-4813-8a89-6f4465ef42a5 req-aa7264a2-d90d-4552-95b6-5f88331b940d service nova] Creating event network-changed:ccf3bba9-fb31-4df3-9464-35b3266ab518 for instance c2f26f30-0505-403e-a11c-260fc8d49892 on n-h1-862686-1 Oct 26 13:45:22.016329 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-3f8c7589-eee3-4813-8a89-6f4465ef42a5 req-aa7264a2-d90d-4552-95b6-5f88331b940d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043834 Oct 26 13:45:22.017738 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3232/6428] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:45:23.090167 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-70504401-2d5b-476b-8796-dea8e53515cd tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1680902025", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "e049636a-5abe-4335-a09e-b7cd76f68b40", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a3a29c91-9973-4a7f-99bf-5b84e6501fd2"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:45:23.189211 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-70504401-2d5b-476b-8796-dea8e53515cd tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] validate_networks() for [('a3a29c91-9973-4a7f-99bf-5b84e6501fd2', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:45:23.567965 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-70504401-2d5b-476b-8796-dea8e53515cd tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:45:23.568471 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-70504401-2d5b-476b-8796-dea8e53515cd tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:45:23.569152 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-70504401-2d5b-476b-8796-dea8e53515cd tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:45:23.569600 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-70504401-2d5b-476b-8796-dea8e53515cd tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:45:23.570022 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-70504401-2d5b-476b-8796-dea8e53515cd tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:45:23.580452 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-70504401-2d5b-476b-8796-dea8e53515cd tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:23.581015 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-70504401-2d5b-476b-8796-dea8e53515cd tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:23.581454 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-70504401-2d5b-476b-8796-dea8e53515cd tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:23.582214 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-70504401-2d5b-476b-8796-dea8e53515cd tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:23.582660 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-70504401-2d5b-476b-8796-dea8e53515cd tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:23.583089 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-70504401-2d5b-476b-8796-dea8e53515cd tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:23.604099 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-70504401-2d5b-476b-8796-dea8e53515cd tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Getting quotas for project 2a1602330aa340b890bac76a120f74e8. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:45:23.610179 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-70504401-2d5b-476b-8796-dea8e53515cd tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Getting quotas for user df8b67aae3ea4f17bfa684681311dec5 and project 2a1602330aa340b890bac76a120f74e8. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:45:23.670325 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-70504401-2d5b-476b-8796-dea8e53515cd tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:45:23.672607 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-70504401-2d5b-476b-8796-dea8e53515cd tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 031fe207-e80b-4c5f-a6df-bac922745198] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e049636a-5abe-4335-a09e-b7cd76f68b40',volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:45:23.808181 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-70504401-2d5b-476b-8796-dea8e53515cd tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.722331 Oct 26 13:45:23.815695 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3197/6429] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:45:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:45:23.821565 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b8ded49d-1f06-4270-8771-10abe7dec0d8 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:23.822222 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b8ded49d-1f06-4270-8771-10abe7dec0d8 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 031fe207-e80b-4c5f-a6df-bac922745198] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:23.892044 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b8ded49d-1f06-4270-8771-10abe7dec0d8 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:23.898886 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b8ded49d-1f06-4270-8771-10abe7dec0d8 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198" status: 200 len: 1057 microversion: 2.1 time: 0.081592 Oct 26 13:45:23.899525 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3233/6430] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:23 2022] GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198 => generated 1057 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:24.923260 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f1109922-73e8-4efd-904a-3134739dece4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:24.924125 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f1109922-73e8-4efd-904a-3134739dece4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 031fe207-e80b-4c5f-a6df-bac922745198] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:24.931885 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f1109922-73e8-4efd-904a-3134739dece4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:24.932369 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f1109922-73e8-4efd-904a-3134739dece4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:24.932805 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f1109922-73e8-4efd-904a-3134739dece4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:24.933579 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f1109922-73e8-4efd-904a-3134739dece4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:24.934031 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f1109922-73e8-4efd-904a-3134739dece4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:24.934454 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f1109922-73e8-4efd-904a-3134739dece4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:25.003751 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f1109922-73e8-4efd-904a-3134739dece4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:25.014029 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f1109922-73e8-4efd-904a-3134739dece4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198" status: 200 len: 1155 microversion: 2.1 time: 0.094797 Oct 26 13:45:25.015055 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3198/6431] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:24 2022] GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198 => generated 1155 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:26.038019 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f5320441-b91f-499e-99da-fce0d7d2b105 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:26.038719 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f5320441-b91f-499e-99da-fce0d7d2b105 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 031fe207-e80b-4c5f-a6df-bac922745198] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:26.071334 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5320441-b91f-499e-99da-fce0d7d2b105 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:26.071936 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5320441-b91f-499e-99da-fce0d7d2b105 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:26.072679 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5320441-b91f-499e-99da-fce0d7d2b105 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:26.073467 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5320441-b91f-499e-99da-fce0d7d2b105 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:26.074052 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5320441-b91f-499e-99da-fce0d7d2b105 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:26.074551 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5320441-b91f-499e-99da-fce0d7d2b105 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:26.347967 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f5320441-b91f-499e-99da-fce0d7d2b105 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:26.357818 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f5320441-b91f-499e-99da-fce0d7d2b105 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198" status: 200 len: 1215 microversion: 2.1 time: 0.323476 Oct 26 13:45:26.359268 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3234/6432] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:26 2022] GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198 => generated 1215 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:26.680341 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-078f99f7-5a2a-4dd3-b08c-18ecf47290ee req-07b745ff-a86b-4b74-aa16-25af74e1a285 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "031fe207-e80b-4c5f-a6df-bac922745198", "tag": "e159cf33-0ba0-4807-9672-126b931fa0f2"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:45:26.705095 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-078f99f7-5a2a-4dd3-b08c-18ecf47290ee req-07b745ff-a86b-4b74-aa16-25af74e1a285 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:26.708759 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-078f99f7-5a2a-4dd3-b08c-18ecf47290ee req-07b745ff-a86b-4b74-aa16-25af74e1a285 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:26.709569 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-078f99f7-5a2a-4dd3-b08c-18ecf47290ee req-07b745ff-a86b-4b74-aa16-25af74e1a285 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:26.737226 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-078f99f7-5a2a-4dd3-b08c-18ecf47290ee req-07b745ff-a86b-4b74-aa16-25af74e1a285 service nova] Creating event network-changed:e159cf33-0ba0-4807-9672-126b931fa0f2 for instance 031fe207-e80b-4c5f-a6df-bac922745198 on n-h2-862686-1 Oct 26 13:45:26.742977 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-078f99f7-5a2a-4dd3-b08c-18ecf47290ee req-07b745ff-a86b-4b74-aa16-25af74e1a285 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076065 Oct 26 13:45:26.744631 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3199/6433] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:45:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:45:26.927996 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4cc0a687-81f5-4938-802e-879e62983e8b tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:26.928548 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4cc0a687-81f5-4938-802e-879e62983e8b tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:26.934949 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cc0a687-81f5-4938-802e-879e62983e8b tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:26.935446 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cc0a687-81f5-4938-802e-879e62983e8b tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:26.935909 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cc0a687-81f5-4938-802e-879e62983e8b tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:26.937050 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cc0a687-81f5-4938-802e-879e62983e8b tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:26.937546 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cc0a687-81f5-4938-802e-879e62983e8b tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:26.938198 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cc0a687-81f5-4938-802e-879e62983e8b tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:27.223247 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4cc0a687-81f5-4938-802e-879e62983e8b tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4" status: 200 len: 1833 microversion: 2.1 time: 0.302573 Oct 26 13:45:27.224839 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3235/6434] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:26 2022] GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4 => generated 1833 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:27.389293 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6c23f1cc-600a-45f6-b961-380c6ee20ea0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:27.390121 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6c23f1cc-600a-45f6-b961-380c6ee20ea0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 031fe207-e80b-4c5f-a6df-bac922745198] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:27.400263 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6c23f1cc-600a-45f6-b961-380c6ee20ea0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:27.401038 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6c23f1cc-600a-45f6-b961-380c6ee20ea0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:27.401808 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6c23f1cc-600a-45f6-b961-380c6ee20ea0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:27.403202 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6c23f1cc-600a-45f6-b961-380c6ee20ea0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:27.403968 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6c23f1cc-600a-45f6-b961-380c6ee20ea0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:27.404692 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6c23f1cc-600a-45f6-b961-380c6ee20ea0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:27.628106 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6c23f1cc-600a-45f6-b961-380c6ee20ea0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:27.637112 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6c23f1cc-600a-45f6-b961-380c6ee20ea0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198" status: 200 len: 1215 microversion: 2.1 time: 0.253605 Oct 26 13:45:27.638099 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3200/6435] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:27 2022] GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198 => generated 1215 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:28.659595 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-587d2429-2d5b-4b5c-97e9-bb3a08cea8b7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:28.660844 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-587d2429-2d5b-4b5c-97e9-bb3a08cea8b7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 031fe207-e80b-4c5f-a6df-bac922745198] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:28.671606 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=4 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:45:28.682991 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-587d2429-2d5b-4b5c-97e9-bb3a08cea8b7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:28.684468 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-587d2429-2d5b-4b5c-97e9-bb3a08cea8b7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:28.685105 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-587d2429-2d5b-4b5c-97e9-bb3a08cea8b7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:28.686069 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-587d2429-2d5b-4b5c-97e9-bb3a08cea8b7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:28.686707 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-587d2429-2d5b-4b5c-97e9-bb3a08cea8b7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:28.687311 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-587d2429-2d5b-4b5c-97e9-bb3a08cea8b7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:28.689253 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-262decf7-8aab-4b2f-add1-f1f60c2bc858 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:28.690595 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-262decf7-8aab-4b2f-add1-f1f60c2bc858 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:28.706345 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-262decf7-8aab-4b2f-add1-f1f60c2bc858 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:28.708055 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-262decf7-8aab-4b2f-add1-f1f60c2bc858 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:28.709130 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-262decf7-8aab-4b2f-add1-f1f60c2bc858 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:28.709948 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-262decf7-8aab-4b2f-add1-f1f60c2bc858 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:28.710488 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-262decf7-8aab-4b2f-add1-f1f60c2bc858 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:28.710979 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-262decf7-8aab-4b2f-add1-f1f60c2bc858 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:28.741636 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-262decf7-8aab-4b2f-add1-f1f60c2bc858 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:45:28.842898 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-262decf7-8aab-4b2f-add1-f1f60c2bc858 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "DELETE /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4" status: 204 len: 0 microversion: 2.1 time: 0.157845 Oct 26 13:45:28.847513 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3201/6436] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:45:28 2022] DELETE /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 26 13:45:28.856822 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-03747473-5659-4b27-b9ba-4c481db4ad10 req-efcf218e-373b-44c1-8b42-e49f9e35f832 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "911f368c-5a4e-4f89-83e8-52d02202bbc4", "tag": "01306531-3518-45b4-ae5b-35d7b905b368"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:45:28.870382 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-03747473-5659-4b27-b9ba-4c481db4ad10 req-efcf218e-373b-44c1-8b42-e49f9e35f832 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:28.871469 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-03747473-5659-4b27-b9ba-4c481db4ad10 req-efcf218e-373b-44c1-8b42-e49f9e35f832 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:28.872094 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-03747473-5659-4b27-b9ba-4c481db4ad10 req-efcf218e-373b-44c1-8b42-e49f9e35f832 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:28.887091 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-03747473-5659-4b27-b9ba-4c481db4ad10 req-efcf218e-373b-44c1-8b42-e49f9e35f832 service nova] Creating event network-changed:01306531-3518-45b4-ae5b-35d7b905b368 for instance 911f368c-5a4e-4f89-83e8-52d02202bbc4 on n-h2-862686-1 Oct 26 13:45:28.894210 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-03747473-5659-4b27-b9ba-4c481db4ad10 req-efcf218e-373b-44c1-8b42-e49f9e35f832 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045103 Oct 26 13:45:28.899734 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3202/6437] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:45:28.906644 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-87d9e970-fa30-45fb-889c-81b43227896d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:28.907589 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-87d9e970-fa30-45fb-889c-81b43227896d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:28.917188 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-87d9e970-fa30-45fb-889c-81b43227896d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:28.918737 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-87d9e970-fa30-45fb-889c-81b43227896d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:28.919385 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-87d9e970-fa30-45fb-889c-81b43227896d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:28.920180 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-87d9e970-fa30-45fb-889c-81b43227896d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:28.920738 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-87d9e970-fa30-45fb-889c-81b43227896d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:28.921315 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-87d9e970-fa30-45fb-889c-81b43227896d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:28.960622 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-587d2429-2d5b-4b5c-97e9-bb3a08cea8b7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:28.970216 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-587d2429-2d5b-4b5c-97e9-bb3a08cea8b7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198" status: 200 len: 1215 microversion: 2.1 time: 0.314383 Oct 26 13:45:28.978690 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3236/6438] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:28 2022] GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198 => generated 1215 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:29.090961 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-87d9e970-fa30-45fb-889c-81b43227896d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:29.101673 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-87d9e970-fa30-45fb-889c-81b43227896d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4" status: 200 len: 1688 microversion: 2.1 time: 0.200394 Oct 26 13:45:29.114880 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3203/6439] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:28 2022] GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4 => generated 1688 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:30.001105 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-529fda8b-1e57-446e-a0ed-579080f8ccd7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:30.001866 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-529fda8b-1e57-446e-a0ed-579080f8ccd7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 031fe207-e80b-4c5f-a6df-bac922745198] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:30.022858 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-529fda8b-1e57-446e-a0ed-579080f8ccd7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:30.023514 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-529fda8b-1e57-446e-a0ed-579080f8ccd7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:30.024213 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-529fda8b-1e57-446e-a0ed-579080f8ccd7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:30.025291 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-529fda8b-1e57-446e-a0ed-579080f8ccd7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:30.025855 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-529fda8b-1e57-446e-a0ed-579080f8ccd7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:30.026531 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-529fda8b-1e57-446e-a0ed-579080f8ccd7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:30.126274 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b71d2b73-634d-4309-a053-0c78eff48123 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:30.127162 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b71d2b73-634d-4309-a053-0c78eff48123 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:30.130205 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:45:30.137781 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b71d2b73-634d-4309-a053-0c78eff48123 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:30.138432 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b71d2b73-634d-4309-a053-0c78eff48123 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:30.138968 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b71d2b73-634d-4309-a053-0c78eff48123 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:30.141049 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b71d2b73-634d-4309-a053-0c78eff48123 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:30.141754 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b71d2b73-634d-4309-a053-0c78eff48123 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:30.142454 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b71d2b73-634d-4309-a053-0c78eff48123 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:30.190429 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-529fda8b-1e57-446e-a0ed-579080f8ccd7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:30.207015 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-529fda8b-1e57-446e-a0ed-579080f8ccd7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198" status: 200 len: 1215 microversion: 2.1 time: 0.209884 Oct 26 13:45:30.207607 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3237/6440] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:29 2022] GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198 => generated 1215 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:30.496136 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b71d2b73-634d-4309-a053-0c78eff48123 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:30.508260 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b71d2b73-634d-4309-a053-0c78eff48123 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4" status: 200 len: 1688 microversion: 2.1 time: 0.381965 Oct 26 13:45:30.509464 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3204/6441] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:30 2022] GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4 => generated 1688 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:30.939423 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-123ec9f9-f184-47c2-8f1e-148143c4f379 req-dc017d5f-a15c-42f4-84f3-4b6fe0e05b78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "911f368c-5a4e-4f89-83e8-52d02202bbc4", "name": "network-vif-deleted", "tag": "01306531-3518-45b4-ae5b-35d7b905b368"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:45:30.950636 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-123ec9f9-f184-47c2-8f1e-148143c4f379 req-dc017d5f-a15c-42f4-84f3-4b6fe0e05b78 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:30.951243 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-123ec9f9-f184-47c2-8f1e-148143c4f379 req-dc017d5f-a15c-42f4-84f3-4b6fe0e05b78 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:30.951757 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-123ec9f9-f184-47c2-8f1e-148143c4f379 req-dc017d5f-a15c-42f4-84f3-4b6fe0e05b78 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:30.962898 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-123ec9f9-f184-47c2-8f1e-148143c4f379 req-dc017d5f-a15c-42f4-84f3-4b6fe0e05b78 service nova] Creating event network-vif-deleted:01306531-3518-45b4-ae5b-35d7b905b368 for instance 911f368c-5a4e-4f89-83e8-52d02202bbc4 on n-h2-862686-1 Oct 26 13:45:30.968561 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-123ec9f9-f184-47c2-8f1e-148143c4f379 req-dc017d5f-a15c-42f4-84f3-4b6fe0e05b78 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032788 Oct 26 13:45:30.969288 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3238/6442] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:45:31.233090 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-beb8c1e7-b027-4b15-b6d2-1e78a5aeae53 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:31.233837 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-beb8c1e7-b027-4b15-b6d2-1e78a5aeae53 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 031fe207-e80b-4c5f-a6df-bac922745198] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:31.240969 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-beb8c1e7-b027-4b15-b6d2-1e78a5aeae53 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:31.241633 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-beb8c1e7-b027-4b15-b6d2-1e78a5aeae53 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:31.242144 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-beb8c1e7-b027-4b15-b6d2-1e78a5aeae53 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:31.242914 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-beb8c1e7-b027-4b15-b6d2-1e78a5aeae53 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:31.243452 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-beb8c1e7-b027-4b15-b6d2-1e78a5aeae53 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:31.243943 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-beb8c1e7-b027-4b15-b6d2-1e78a5aeae53 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:31.410278 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-beb8c1e7-b027-4b15-b6d2-1e78a5aeae53 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:31.428783 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-beb8c1e7-b027-4b15-b6d2-1e78a5aeae53 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198" status: 200 len: 1203 microversion: 2.1 time: 0.201710 Oct 26 13:45:31.429937 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3205/6443] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:31 2022] GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198 => generated 1203 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:31.537139 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-73f0e9e3-c303-4c9f-bccd-fee144119fe9 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:31.538283 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-73f0e9e3-c303-4c9f-bccd-fee144119fe9 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:31.548933 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73f0e9e3-c303-4c9f-bccd-fee144119fe9 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:31.549426 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73f0e9e3-c303-4c9f-bccd-fee144119fe9 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:31.549898 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73f0e9e3-c303-4c9f-bccd-fee144119fe9 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:31.550614 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73f0e9e3-c303-4c9f-bccd-fee144119fe9 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:31.551290 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73f0e9e3-c303-4c9f-bccd-fee144119fe9 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:31.551726 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73f0e9e3-c303-4c9f-bccd-fee144119fe9 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:31.590365 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73f0e9e3-c303-4c9f-bccd-fee144119fe9 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:31.590574 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73f0e9e3-c303-4c9f-bccd-fee144119fe9 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:31.591266 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73f0e9e3-c303-4c9f-bccd-fee144119fe9 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:31.591779 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-73f0e9e3-c303-4c9f-bccd-fee144119fe9 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lazy-loading 'fault' on Instance uuid 911f368c-5a4e-4f89-83e8-52d02202bbc4 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:45:31.647539 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-73f0e9e3-c303-4c9f-bccd-fee144119fe9 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:31.663404 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-73f0e9e3-c303-4c9f-bccd-fee144119fe9 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4" status: 200 len: 1356 microversion: 2.1 time: 0.131656 Oct 26 13:45:31.664004 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3239/6444] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:31 2022] GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4 => generated 1356 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:32.452882 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-76faa1ca-0fa9-432d-9d67-6f5cb1c0aae5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:32.453547 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-76faa1ca-0fa9-432d-9d67-6f5cb1c0aae5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 031fe207-e80b-4c5f-a6df-bac922745198] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:32.460616 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-76faa1ca-0fa9-432d-9d67-6f5cb1c0aae5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:32.461108 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-76faa1ca-0fa9-432d-9d67-6f5cb1c0aae5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:32.461573 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-76faa1ca-0fa9-432d-9d67-6f5cb1c0aae5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:32.462282 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-76faa1ca-0fa9-432d-9d67-6f5cb1c0aae5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:32.462736 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-76faa1ca-0fa9-432d-9d67-6f5cb1c0aae5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:32.463254 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-76faa1ca-0fa9-432d-9d67-6f5cb1c0aae5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:32.607563 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-76faa1ca-0fa9-432d-9d67-6f5cb1c0aae5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:32.615722 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-76faa1ca-0fa9-432d-9d67-6f5cb1c0aae5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198" status: 200 len: 1203 microversion: 2.1 time: 0.166890 Oct 26 13:45:32.616324 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3206/6445] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:32 2022] GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198 => generated 1203 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:32.687683 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e98d7174-e839-4201-9e36-36b0c414c1a4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:32.688236 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e98d7174-e839-4201-9e36-36b0c414c1a4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 911f368c-5a4e-4f89-83e8-52d02202bbc4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:32.695486 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e98d7174-e839-4201-9e36-36b0c414c1a4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:32.695980 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e98d7174-e839-4201-9e36-36b0c414c1a4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:32.696421 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e98d7174-e839-4201-9e36-36b0c414c1a4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:32.697127 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e98d7174-e839-4201-9e36-36b0c414c1a4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:32.697618 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e98d7174-e839-4201-9e36-36b0c414c1a4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:32.698052 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e98d7174-e839-4201-9e36-36b0c414c1a4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:32.712910 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-e98d7174-e839-4201-9e36-36b0c414c1a4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] HTTP exception thrown: Instance 911f368c-5a4e-4f89-83e8-52d02202bbc4 could not be found. Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e98d7174-e839-4201-9e36-36b0c414c1a4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Request method failure captured: Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4 HTTP/1.1 Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTl7vHGITUnSIjOoYHssXC10IwUcwveqrJ7Ebb5cmEfkFD9JMguSExqSXPNP7Ag-JuWcpR1m7T1_23uQXjoVepH6MjM-90GyPgiU7IyFq1opWMTLN8Bh1kpzqNFJZ8A9zq3q3AuJcUUCnd4kdwPdeBkozWabTG-a7qC9_ycsvQK-bH8 Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: bbc60a45db1c488ab4417c3b2c8d1983 Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1564668813 Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bbc60a45db1c488ab4417c3b2c8d1983"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bbc60a45db1c488ab4417c3b2c8d1983"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bbc60a45db1c488ab4417c3b2c8d1983"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bbc60a45db1c488ab4417c3b2c8d1983"}]}] Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1564668813 Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: bbc60a45db1c488ab4417c3b2c8d1983 Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1564668813 Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-TestNetworkAdvancedServerOps-1564668813-project Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: c67f61dd56b74107b828dcd7f2fc31f1 Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1564668813-project Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 911f368c-5a4e-4f89-83e8-52d02202bbc4 could not be found. Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '911f368c-5a4e-4f89-83e8-52d02202bbc4'} Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 911f368c-5a4e-4f89-83e8-52d02202bbc4 could not be found. Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 911f368c-5a4e-4f89-83e8-52d02202bbc4 could not be found. Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:45:32.714580 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:45:32.720053 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:45:32.720053 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:45:32.720053 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:45:32.720053 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:45:32.720053 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:45:32.720053 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:45:32.720053 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 911f368c-5a4e-4f89-83e8-52d02202bbc4 could not be found. Oct 26 13:45:32.720053 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:45:32.720053 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e98d7174-e839-4201-9e36-36b0c414c1a4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Returning 404 to user: Instance 911f368c-5a4e-4f89-83e8-52d02202bbc4 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:45:32.720053 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e98d7174-e839-4201-9e36-36b0c414c1a4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4" status: 404 len: 111 microversion: 2.1 time: 0.033084 Oct 26 13:45:32.720053 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3240/6446] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:32 2022] GET /compute/v2.1/servers/911f368c-5a4e-4f89-83e8-52d02202bbc4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:45:33.640607 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-de61c4e3-85a1-459d-8b9d-7aaeeaa5ea8d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:33.641454 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-de61c4e3-85a1-459d-8b9d-7aaeeaa5ea8d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 031fe207-e80b-4c5f-a6df-bac922745198] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:33.644703 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:45:33.645512 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:45:33.653076 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-de61c4e3-85a1-459d-8b9d-7aaeeaa5ea8d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:33.653702 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-de61c4e3-85a1-459d-8b9d-7aaeeaa5ea8d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:33.654256 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-de61c4e3-85a1-459d-8b9d-7aaeeaa5ea8d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:33.654976 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-de61c4e3-85a1-459d-8b9d-7aaeeaa5ea8d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:33.656392 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-de61c4e3-85a1-459d-8b9d-7aaeeaa5ea8d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:33.656392 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-de61c4e3-85a1-459d-8b9d-7aaeeaa5ea8d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:33.963859 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-de61c4e3-85a1-459d-8b9d-7aaeeaa5ea8d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:33.972941 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-de61c4e3-85a1-459d-8b9d-7aaeeaa5ea8d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198" status: 200 len: 1203 microversion: 2.1 time: 0.337484 Oct 26 13:45:33.973646 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3207/6447] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:33 2022] GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198 => generated 1203 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:34.997996 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4c961288-156f-433d-b8a8-fc2b515dc3c0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:34.998622 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4c961288-156f-433d-b8a8-fc2b515dc3c0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 031fe207-e80b-4c5f-a6df-bac922745198] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:35.001457 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:45:35.010753 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c961288-156f-433d-b8a8-fc2b515dc3c0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:35.011788 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c961288-156f-433d-b8a8-fc2b515dc3c0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:35.012238 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c961288-156f-433d-b8a8-fc2b515dc3c0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:35.013077 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c961288-156f-433d-b8a8-fc2b515dc3c0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:35.013567 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c961288-156f-433d-b8a8-fc2b515dc3c0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:35.014166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c961288-156f-433d-b8a8-fc2b515dc3c0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:35.252296 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4c961288-156f-433d-b8a8-fc2b515dc3c0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:35.261932 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4c961288-156f-433d-b8a8-fc2b515dc3c0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198" status: 200 len: 1203 microversion: 2.1 time: 0.267967 Oct 26 13:45:35.263510 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3241/6448] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:34 2022] GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198 => generated 1203 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:36.287544 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-54418659-8804-4662-9357-75547a019067 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:36.288168 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-54418659-8804-4662-9357-75547a019067 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 031fe207-e80b-4c5f-a6df-bac922745198] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:36.295531 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54418659-8804-4662-9357-75547a019067 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:36.296023 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54418659-8804-4662-9357-75547a019067 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:36.296462 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54418659-8804-4662-9357-75547a019067 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:36.297598 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54418659-8804-4662-9357-75547a019067 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:36.298067 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54418659-8804-4662-9357-75547a019067 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:36.298498 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54418659-8804-4662-9357-75547a019067 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:36.351969 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e7d4806e-b140-4649-a4b3-abc4550f6b73 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '.version_select at 0x7f67321a1af0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:36.408024 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e7d4806e-b140-4649-a4b3-abc4550f6b73 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-899389863" status: 202 len: 0 microversion: 2.1 time: 0.059962 Oct 26 13:45:36.408984 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3242/6449] 10.222.0.40 () {58 vars in 1281 bytes} [Wed Oct 26 13:45:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-899389863 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:45:36.441910 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f77d2027-ba42-45f8-9e5f-1428f8ac07e6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Action: 'create', calling method: .version_select at 0x7f6732a10310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-735004815", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC67AZ/qcpGQJFjjHKw1oHbT8QuF8kO8nvAdoA1g0vyAYqVIOcWX5eSbPhRz/ha0g+p6YEzvrAEREQmn/G1Tr8icljcMDfekuI72/AFYBHzRsPlxJ3ifvJuzmpZGh8l4kw=="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:45:36.464033 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-f77d2027-ba42-45f8-9e5f-1428f8ac07e6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Getting quotas for project bbc60a45db1c488ab4417c3b2c8d1983. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:45:36.470740 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-f77d2027-ba42-45f8-9e5f-1428f8ac07e6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Getting quotas for user c67f61dd56b74107b828dcd7f2fc31f1 and project bbc60a45db1c488ab4417c3b2c8d1983. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:45:36.487611 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-54418659-8804-4662-9357-75547a019067 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:36.496396 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-54418659-8804-4662-9357-75547a019067 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198" status: 200 len: 1203 microversion: 2.1 time: 0.212373 Oct 26 13:45:36.497405 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3208/6450] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:36 2022] GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198 => generated 1203 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:36.512212 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f77d2027-ba42-45f8-9e5f-1428f8ac07e6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.074161 Oct 26 13:45:36.512945 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3243/6451] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 13:45:36 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:45:37.521004 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dbd8edd9-1237-4d47-8749-b94b75b408c6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:37.522217 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-dbd8edd9-1237-4d47-8749-b94b75b408c6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 031fe207-e80b-4c5f-a6df-bac922745198] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:37.530225 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dbd8edd9-1237-4d47-8749-b94b75b408c6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:37.530982 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dbd8edd9-1237-4d47-8749-b94b75b408c6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:37.531595 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dbd8edd9-1237-4d47-8749-b94b75b408c6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:37.532600 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dbd8edd9-1237-4d47-8749-b94b75b408c6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:37.533236 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dbd8edd9-1237-4d47-8749-b94b75b408c6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:37.533865 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dbd8edd9-1237-4d47-8749-b94b75b408c6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:37.706577 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-dbd8edd9-1237-4d47-8749-b94b75b408c6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:37.716606 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-dbd8edd9-1237-4d47-8749-b94b75b408c6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198" status: 200 len: 1203 microversion: 2.1 time: 0.198508 Oct 26 13:45:37.717013 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3209/6452] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:37 2022] GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198 => generated 1203 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:38.743303 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-70d4de25-dc41-4ec3-923c-aae06297e628 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:38.744070 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-70d4de25-dc41-4ec3-923c-aae06297e628 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 031fe207-e80b-4c5f-a6df-bac922745198] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:38.750191 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70d4de25-dc41-4ec3-923c-aae06297e628 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:38.750678 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70d4de25-dc41-4ec3-923c-aae06297e628 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:38.751112 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70d4de25-dc41-4ec3-923c-aae06297e628 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:38.751809 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70d4de25-dc41-4ec3-923c-aae06297e628 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:38.752261 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70d4de25-dc41-4ec3-923c-aae06297e628 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:38.752766 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70d4de25-dc41-4ec3-923c-aae06297e628 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:39.006725 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-70d4de25-dc41-4ec3-923c-aae06297e628 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:39.016196 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-70d4de25-dc41-4ec3-923c-aae06297e628 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198" status: 200 len: 1203 microversion: 2.1 time: 0.279137 Oct 26 13:45:39.016798 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3244/6453] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:38 2022] GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198 => generated 1203 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:40.040418 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2ded2fe4-c601-424f-9a15-a9ca1effc9ed tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:40.042578 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2ded2fe4-c601-424f-9a15-a9ca1effc9ed tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 031fe207-e80b-4c5f-a6df-bac922745198] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:40.051502 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ded2fe4-c601-424f-9a15-a9ca1effc9ed tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:40.052309 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ded2fe4-c601-424f-9a15-a9ca1effc9ed tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:40.052988 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ded2fe4-c601-424f-9a15-a9ca1effc9ed tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:40.054079 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ded2fe4-c601-424f-9a15-a9ca1effc9ed tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:40.054896 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ded2fe4-c601-424f-9a15-a9ca1effc9ed tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:40.055560 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ded2fe4-c601-424f-9a15-a9ca1effc9ed tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:40.246672 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2ded2fe4-c601-424f-9a15-a9ca1effc9ed tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:40.256487 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2ded2fe4-c601-424f-9a15-a9ca1effc9ed tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198" status: 200 len: 1203 microversion: 2.1 time: 0.220076 Oct 26 13:45:40.257433 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3210/6454] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:40 2022] GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198 => generated 1203 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:41.286805 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0625e7cf-a10f-467c-8c63-2a5acdfe669c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:41.287534 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0625e7cf-a10f-467c-8c63-2a5acdfe669c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 031fe207-e80b-4c5f-a6df-bac922745198] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:41.298516 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0625e7cf-a10f-467c-8c63-2a5acdfe669c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:41.299021 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0625e7cf-a10f-467c-8c63-2a5acdfe669c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:41.299467 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0625e7cf-a10f-467c-8c63-2a5acdfe669c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:41.300193 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0625e7cf-a10f-467c-8c63-2a5acdfe669c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:41.300650 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0625e7cf-a10f-467c-8c63-2a5acdfe669c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:41.301081 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0625e7cf-a10f-467c-8c63-2a5acdfe669c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:41.559683 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0625e7cf-a10f-467c-8c63-2a5acdfe669c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:41.571144 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0625e7cf-a10f-467c-8c63-2a5acdfe669c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198" status: 200 len: 1203 microversion: 2.1 time: 0.288405 Oct 26 13:45:41.572512 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3245/6455] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:41 2022] GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198 => generated 1203 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:45:42.030989 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-0ab2b378-19eb-4527-b5a3-e0238e1aa9d2 req-eae8d26f-2bbf-4cda-8319-32684153b50b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "031fe207-e80b-4c5f-a6df-bac922745198", "name": "network-vif-plugged", "status": "completed", "tag": "e159cf33-0ba0-4807-9672-126b931fa0f2"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:45:42.054885 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-0ab2b378-19eb-4527-b5a3-e0238e1aa9d2 req-eae8d26f-2bbf-4cda-8319-32684153b50b service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:42.055752 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-0ab2b378-19eb-4527-b5a3-e0238e1aa9d2 req-eae8d26f-2bbf-4cda-8319-32684153b50b service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:42.057346 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-0ab2b378-19eb-4527-b5a3-e0238e1aa9d2 req-eae8d26f-2bbf-4cda-8319-32684153b50b service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:42.106054 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-0ab2b378-19eb-4527-b5a3-e0238e1aa9d2 req-eae8d26f-2bbf-4cda-8319-32684153b50b service nova] Creating event network-vif-plugged:e159cf33-0ba0-4807-9672-126b931fa0f2 for instance 031fe207-e80b-4c5f-a6df-bac922745198 on n-h2-862686-1 Oct 26 13:45:42.113618 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-0ab2b378-19eb-4527-b5a3-e0238e1aa9d2 req-eae8d26f-2bbf-4cda-8319-32684153b50b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087049 Oct 26 13:45:42.114256 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3211/6456] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:45:42.606114 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a4d4e0af-39a2-450d-a88b-99938be57f4d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:42.606731 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a4d4e0af-39a2-450d-a88b-99938be57f4d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 031fe207-e80b-4c5f-a6df-bac922745198] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:42.618777 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4d4e0af-39a2-450d-a88b-99938be57f4d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:42.618777 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4d4e0af-39a2-450d-a88b-99938be57f4d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:42.619157 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4d4e0af-39a2-450d-a88b-99938be57f4d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:42.620552 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4d4e0af-39a2-450d-a88b-99938be57f4d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:42.621293 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4d4e0af-39a2-450d-a88b-99938be57f4d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:42.629757 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4d4e0af-39a2-450d-a88b-99938be57f4d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:42.847744 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a4d4e0af-39a2-450d-a88b-99938be57f4d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:42.862697 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a4d4e0af-39a2-450d-a88b-99938be57f4d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198" status: 200 len: 1203 microversion: 2.1 time: 0.267303 Oct 26 13:45:42.864325 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3246/6457] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:42 2022] GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198 => generated 1203 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:43.241684 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4bec4be3-3e53-4150-b9e8-ff9572c04428 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1195226343", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "476244df-5d52-4c4f-8fb1-36d009eb2203"}], "key_name": "tempest-TestNetworkAdvancedServerOps-735004815", "security_groups": [{"name": "tempest-secgroup-smoke-629835250"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:45:43.372175 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-4bec4be3-3e53-4150-b9e8-ff9572c04428 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] validate_networks() for [('476244df-5d52-4c4f-8fb1-36d009eb2203', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:45:43.889661 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8aeea78e-9f7a-48a1-a8e0-ed6cc64f3f80 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:43.890524 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8aeea78e-9f7a-48a1-a8e0-ed6cc64f3f80 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 031fe207-e80b-4c5f-a6df-bac922745198] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:43.904408 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8aeea78e-9f7a-48a1-a8e0-ed6cc64f3f80 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:43.907166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8aeea78e-9f7a-48a1-a8e0-ed6cc64f3f80 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:43.908849 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8aeea78e-9f7a-48a1-a8e0-ed6cc64f3f80 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:43.910798 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8aeea78e-9f7a-48a1-a8e0-ed6cc64f3f80 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:43.914537 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8aeea78e-9f7a-48a1-a8e0-ed6cc64f3f80 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:43.915093 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8aeea78e-9f7a-48a1-a8e0-ed6cc64f3f80 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:43.965983 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-4bec4be3-3e53-4150-b9e8-ff9572c04428 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:45:43.966704 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-4bec4be3-3e53-4150-b9e8-ff9572c04428 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:45:43.967356 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-4bec4be3-3e53-4150-b9e8-ff9572c04428 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:45:43.968197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-4bec4be3-3e53-4150-b9e8-ff9572c04428 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:45:43.969179 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-4bec4be3-3e53-4150-b9e8-ff9572c04428 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:45:43.980992 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4bec4be3-3e53-4150-b9e8-ff9572c04428 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:43.981531 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4bec4be3-3e53-4150-b9e8-ff9572c04428 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:43.981950 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4bec4be3-3e53-4150-b9e8-ff9572c04428 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:43.982721 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4bec4be3-3e53-4150-b9e8-ff9572c04428 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:43.983181 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4bec4be3-3e53-4150-b9e8-ff9572c04428 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:43.983773 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4bec4be3-3e53-4150-b9e8-ff9572c04428 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:44.004651 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-4bec4be3-3e53-4150-b9e8-ff9572c04428 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Getting quotas for project bbc60a45db1c488ab4417c3b2c8d1983. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:45:44.015510 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-4bec4be3-3e53-4150-b9e8-ff9572c04428 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Getting quotas for user c67f61dd56b74107b828dcd7f2fc31f1 and project bbc60a45db1c488ab4417c3b2c8d1983. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:45:44.030486 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4bec4be3-3e53-4150-b9e8-ff9572c04428 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:45:44.033193 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4bec4be3-3e53-4150-b9e8-ff9572c04428 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:45:44.121562 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4bec4be3-3e53-4150-b9e8-ff9572c04428 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.885005 Oct 26 13:45:44.122934 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3212/6458] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:45:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:45:44.139263 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-675497b0-408a-4d62-be19-61b3a280448d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:44.140213 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-675497b0-408a-4d62-be19-61b3a280448d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:44.254105 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8aeea78e-9f7a-48a1-a8e0-ed6cc64f3f80 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:44.260875 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-675497b0-408a-4d62-be19-61b3a280448d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:44.268002 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8aeea78e-9f7a-48a1-a8e0-ed6cc64f3f80 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198" status: 200 len: 1390 microversion: 2.1 time: 0.382553 Oct 26 13:45:44.269169 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3247/6459] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:43 2022] GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198 => generated 1390 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:44.282075 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-675497b0-408a-4d62-be19-61b3a280448d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7" status: 200 len: 1266 microversion: 2.1 time: 0.151876 Oct 26 13:45:44.297654 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3213/6460] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:44 2022] GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:44.315095 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b1cfa96d-68e9-42c4-b6fc-58e3dd5e140c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:44.315783 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b1cfa96d-68e9-42c4-b6fc-58e3dd5e140c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 031fe207-e80b-4c5f-a6df-bac922745198] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:44.323664 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e5de6142-a2c8-4d5c-9775-acad227c0555 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:45:44.334328 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1cfa96d-68e9-42c4-b6fc-58e3dd5e140c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:44.334991 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1cfa96d-68e9-42c4-b6fc-58e3dd5e140c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:44.337130 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1cfa96d-68e9-42c4-b6fc-58e3dd5e140c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:44.339205 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e5de6142-a2c8-4d5c-9775-acad227c0555 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: c2f26f30-0505-403e-a11c-260fc8d49892] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:44.339963 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1cfa96d-68e9-42c4-b6fc-58e3dd5e140c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:44.340550 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1cfa96d-68e9-42c4-b6fc-58e3dd5e140c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:44.343602 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1cfa96d-68e9-42c4-b6fc-58e3dd5e140c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:44.356591 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e5de6142-a2c8-4d5c-9775-acad227c0555 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:44.357092 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e5de6142-a2c8-4d5c-9775-acad227c0555 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:44.357625 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e5de6142-a2c8-4d5c-9775-acad227c0555 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:44.361474 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e5de6142-a2c8-4d5c-9775-acad227c0555 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:44.362224 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e5de6142-a2c8-4d5c-9775-acad227c0555 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:44.362816 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e5de6142-a2c8-4d5c-9775-acad227c0555 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:44.404069 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:45:44.454828 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e5de6142-a2c8-4d5c-9775-acad227c0555 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "POST /compute/v2.1/servers/c2f26f30-0505-403e-a11c-260fc8d49892/action" status: 200 len: 24570 microversion: 2.1 time: 0.135596 Oct 26 13:45:44.455757 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3214/6461] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:45:44 2022] POST /compute/v2.1/servers/c2f26f30-0505-403e-a11c-260fc8d49892/action => generated 24570 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:45:44.629280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b1cfa96d-68e9-42c4-b6fc-58e3dd5e140c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:44.641865 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b1cfa96d-68e9-42c4-b6fc-58e3dd5e140c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198" status: 200 len: 1390 microversion: 2.1 time: 0.336186 Oct 26 13:45:44.650432 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3248/6462] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:44 2022] GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198 => generated 1390 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:44.674916 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bef16496-f8ea-47ca-8f1b-09050eb0e49b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:44.675663 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bef16496-f8ea-47ca-8f1b-09050eb0e49b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 031fe207-e80b-4c5f-a6df-bac922745198] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:44.685879 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bef16496-f8ea-47ca-8f1b-09050eb0e49b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:44.686473 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bef16496-f8ea-47ca-8f1b-09050eb0e49b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:44.686928 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bef16496-f8ea-47ca-8f1b-09050eb0e49b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:44.687677 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bef16496-f8ea-47ca-8f1b-09050eb0e49b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:44.688162 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bef16496-f8ea-47ca-8f1b-09050eb0e49b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:44.688701 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bef16496-f8ea-47ca-8f1b-09050eb0e49b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:44.943515 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bef16496-f8ea-47ca-8f1b-09050eb0e49b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:44.952664 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bef16496-f8ea-47ca-8f1b-09050eb0e49b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198" status: 200 len: 1390 microversion: 2.1 time: 0.281891 Oct 26 13:45:44.953268 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3215/6463] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:44 2022] GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198 => generated 1390 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:44.982242 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-117612b9-17d7-4f7e-8b1d-71d6fe0368d7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:44.983651 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-117612b9-17d7-4f7e-8b1d-71d6fe0368d7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 031fe207-e80b-4c5f-a6df-bac922745198] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:44.991694 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-117612b9-17d7-4f7e-8b1d-71d6fe0368d7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:44.992444 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-117612b9-17d7-4f7e-8b1d-71d6fe0368d7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:44.993058 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-117612b9-17d7-4f7e-8b1d-71d6fe0368d7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:44.994166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-117612b9-17d7-4f7e-8b1d-71d6fe0368d7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:44.994915 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-117612b9-17d7-4f7e-8b1d-71d6fe0368d7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:44.995663 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-117612b9-17d7-4f7e-8b1d-71d6fe0368d7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:45.032080 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-117612b9-17d7-4f7e-8b1d-71d6fe0368d7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 031fe207-e80b-4c5f-a6df-bac922745198] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:45:45.169999 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-117612b9-17d7-4f7e-8b1d-71d6fe0368d7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "DELETE /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198" status: 204 len: 0 microversion: 2.1 time: 0.191874 Oct 26 13:45:45.170611 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3249/6464] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:45:44 2022] DELETE /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:45:45.179375 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ecc6d3ea-039b-4b25-baec-1a164e10ceaa tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:45.180274 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ecc6d3ea-039b-4b25-baec-1a164e10ceaa tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 031fe207-e80b-4c5f-a6df-bac922745198] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:45.188473 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ecc6d3ea-039b-4b25-baec-1a164e10ceaa tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:45.189223 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ecc6d3ea-039b-4b25-baec-1a164e10ceaa tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:45.189876 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ecc6d3ea-039b-4b25-baec-1a164e10ceaa tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:45.190615 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ecc6d3ea-039b-4b25-baec-1a164e10ceaa tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:45.191201 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ecc6d3ea-039b-4b25-baec-1a164e10ceaa tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:45.191627 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ecc6d3ea-039b-4b25-baec-1a164e10ceaa tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:45.212184 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:45:45.320196 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4b5d91af-b535-487c-9963-ed2b013893ac tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:45.321174 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4b5d91af-b535-487c-9963-ed2b013893ac tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:45.341511 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4b5d91af-b535-487c-9963-ed2b013893ac tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:45.342365 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4b5d91af-b535-487c-9963-ed2b013893ac tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:45.343036 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4b5d91af-b535-487c-9963-ed2b013893ac tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:45.344046 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4b5d91af-b535-487c-9963-ed2b013893ac tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:45.349453 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4b5d91af-b535-487c-9963-ed2b013893ac tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:45.350251 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4b5d91af-b535-487c-9963-ed2b013893ac tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:45.429296 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ecc6d3ea-039b-4b25-baec-1a164e10ceaa tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:45.447971 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ecc6d3ea-039b-4b25-baec-1a164e10ceaa tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198" status: 200 len: 1396 microversion: 2.1 time: 0.272643 Oct 26 13:45:45.448713 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3216/6465] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:45 2022] GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198 => generated 1396 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:45:45.482695 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4b5d91af-b535-487c-9963-ed2b013893ac tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:45.498506 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4b5d91af-b535-487c-9963-ed2b013893ac tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7" status: 200 len: 1318 microversion: 2.1 time: 0.181467 Oct 26 13:45:45.499805 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3250/6466] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:45 2022] GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:45:46.495954 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c058b7d7-878b-4bee-8f36-ad293c6d9d4f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:46.502484 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c058b7d7-878b-4bee-8f36-ad293c6d9d4f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 031fe207-e80b-4c5f-a6df-bac922745198] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:46.518189 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c058b7d7-878b-4bee-8f36-ad293c6d9d4f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:46.518189 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c058b7d7-878b-4bee-8f36-ad293c6d9d4f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:46.518189 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c058b7d7-878b-4bee-8f36-ad293c6d9d4f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:46.523862 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-538d0727-98d6-4821-9854-132596292edb tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:46.524549 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-538d0727-98d6-4821-9854-132596292edb tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:46.529609 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c058b7d7-878b-4bee-8f36-ad293c6d9d4f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:46.530314 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c058b7d7-878b-4bee-8f36-ad293c6d9d4f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:46.530834 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c058b7d7-878b-4bee-8f36-ad293c6d9d4f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:46.535092 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=4 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:45:46.536942 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-538d0727-98d6-4821-9854-132596292edb tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:46.537444 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-538d0727-98d6-4821-9854-132596292edb tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:46.540967 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-538d0727-98d6-4821-9854-132596292edb tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:46.542743 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-538d0727-98d6-4821-9854-132596292edb tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:46.546280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-538d0727-98d6-4821-9854-132596292edb tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:46.547014 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-538d0727-98d6-4821-9854-132596292edb tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:46.681831 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-538d0727-98d6-4821-9854-132596292edb tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:46.694986 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-538d0727-98d6-4821-9854-132596292edb tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7" status: 200 len: 1324 microversion: 2.1 time: 0.176145 Oct 26 13:45:46.696295 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3251/6467] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:46 2022] GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 => generated 1324 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:45:46.743193 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c058b7d7-878b-4bee-8f36-ad293c6d9d4f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:46.754067 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c058b7d7-878b-4bee-8f36-ad293c6d9d4f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198" status: 200 len: 1396 microversion: 2.1 time: 0.273632 Oct 26 13:45:46.755247 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3217/6468] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:46 2022] GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198 => generated 1396 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:47.720968 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fdff56c1-f7e2-445a-860f-3ff7af0229c2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:47.722306 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fdff56c1-f7e2-445a-860f-3ff7af0229c2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:47.738496 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fdff56c1-f7e2-445a-860f-3ff7af0229c2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:47.739901 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fdff56c1-f7e2-445a-860f-3ff7af0229c2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:47.744117 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fdff56c1-f7e2-445a-860f-3ff7af0229c2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:47.745233 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fdff56c1-f7e2-445a-860f-3ff7af0229c2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:47.746119 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fdff56c1-f7e2-445a-860f-3ff7af0229c2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:47.746788 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fdff56c1-f7e2-445a-860f-3ff7af0229c2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:47.779811 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-38ae034a-58aa-45c8-b601-503e95516db1 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:47.781004 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-38ae034a-58aa-45c8-b601-503e95516db1 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 031fe207-e80b-4c5f-a6df-bac922745198] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:47.797962 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38ae034a-58aa-45c8-b601-503e95516db1 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:47.798782 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38ae034a-58aa-45c8-b601-503e95516db1 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:47.800196 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38ae034a-58aa-45c8-b601-503e95516db1 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:47.802694 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38ae034a-58aa-45c8-b601-503e95516db1 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:47.804186 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38ae034a-58aa-45c8-b601-503e95516db1 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:47.805540 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38ae034a-58aa-45c8-b601-503e95516db1 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:48.017936 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-38ae034a-58aa-45c8-b601-503e95516db1 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:48.039298 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-38ae034a-58aa-45c8-b601-503e95516db1 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198" status: 200 len: 1354 microversion: 2.1 time: 0.265215 Oct 26 13:45:48.043323 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3218/6469] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:47 2022] GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198 => generated 1354 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:48.201639 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-4cc9e4ed-71ae-4b23-9168-ca1af406fd48 req-7fe300db-6f9a-4639-b0fa-493fb877aa9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "031fe207-e80b-4c5f-a6df-bac922745198", "name": "network-vif-deleted", "tag": "e159cf33-0ba0-4807-9672-126b931fa0f2"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:45:48.218747 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-4cc9e4ed-71ae-4b23-9168-ca1af406fd48 req-7fe300db-6f9a-4639-b0fa-493fb877aa9e service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:48.221051 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-4cc9e4ed-71ae-4b23-9168-ca1af406fd48 req-7fe300db-6f9a-4639-b0fa-493fb877aa9e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:48.221850 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-4cc9e4ed-71ae-4b23-9168-ca1af406fd48 req-7fe300db-6f9a-4639-b0fa-493fb877aa9e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:48.231685 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fdff56c1-f7e2-445a-860f-3ff7af0229c2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:48.251042 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fdff56c1-f7e2-445a-860f-3ff7af0229c2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7" status: 200 len: 1391 microversion: 2.1 time: 0.525845 Oct 26 13:45:48.255614 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3252/6470] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:47 2022] GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 => generated 1391 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:48.287487 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-4cc9e4ed-71ae-4b23-9168-ca1af406fd48 req-7fe300db-6f9a-4639-b0fa-493fb877aa9e service nova] Creating event network-vif-deleted:e159cf33-0ba0-4807-9672-126b931fa0f2 for instance 031fe207-e80b-4c5f-a6df-bac922745198 on n-h2-862686-1 Oct 26 13:45:48.296013 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-4cc9e4ed-71ae-4b23-9168-ca1af406fd48 req-7fe300db-6f9a-4639-b0fa-493fb877aa9e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098462 Oct 26 13:45:48.305430 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3219/6471] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:45:48.573897 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-a4ad5a53-bf76-4681-8122-98c1a336659b req-80dfd35f-607e-4661-8e0b-b5fa00f9e269 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57c44677-5ded-4172-973e-691ee46a58e7", "tag": "13b722da-4749-4dbc-8041-62e84c5e59df"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:45:48.590769 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-a4ad5a53-bf76-4681-8122-98c1a336659b req-80dfd35f-607e-4661-8e0b-b5fa00f9e269 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:48.591662 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-a4ad5a53-bf76-4681-8122-98c1a336659b req-80dfd35f-607e-4661-8e0b-b5fa00f9e269 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:48.592353 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-a4ad5a53-bf76-4681-8122-98c1a336659b req-80dfd35f-607e-4661-8e0b-b5fa00f9e269 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:48.609290 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-a4ad5a53-bf76-4681-8122-98c1a336659b req-80dfd35f-607e-4661-8e0b-b5fa00f9e269 service nova] Creating event network-changed:13b722da-4749-4dbc-8041-62e84c5e59df for instance 57c44677-5ded-4172-973e-691ee46a58e7 on n-h1-862686-1 Oct 26 13:45:48.617770 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-a4ad5a53-bf76-4681-8122-98c1a336659b req-80dfd35f-607e-4661-8e0b-b5fa00f9e269 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.317355 Oct 26 13:45:48.619031 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3253/6472] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:45:49.071065 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3d2d4472-880e-46a7-848f-d96ea906999a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:49.073215 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3d2d4472-880e-46a7-848f-d96ea906999a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 031fe207-e80b-4c5f-a6df-bac922745198] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:49.082853 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3d2d4472-880e-46a7-848f-d96ea906999a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:49.083861 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3d2d4472-880e-46a7-848f-d96ea906999a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:49.084593 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3d2d4472-880e-46a7-848f-d96ea906999a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:49.085853 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3d2d4472-880e-46a7-848f-d96ea906999a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:49.086542 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3d2d4472-880e-46a7-848f-d96ea906999a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:49.087338 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3d2d4472-880e-46a7-848f-d96ea906999a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:49.199807 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3d2d4472-880e-46a7-848f-d96ea906999a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:49.208466 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3d2d4472-880e-46a7-848f-d96ea906999a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198" status: 200 len: 1188 microversion: 2.1 time: 0.141962 Oct 26 13:45:49.209318 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3220/6473] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:49 2022] GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198 => generated 1188 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:49.280647 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d3560131-5b29-4ee3-8fdb-e947d225d440 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:49.281362 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d3560131-5b29-4ee3-8fdb-e947d225d440 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:49.297573 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3560131-5b29-4ee3-8fdb-e947d225d440 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:49.298214 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3560131-5b29-4ee3-8fdb-e947d225d440 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:49.298770 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3560131-5b29-4ee3-8fdb-e947d225d440 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:49.299554 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3560131-5b29-4ee3-8fdb-e947d225d440 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:49.300000 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3560131-5b29-4ee3-8fdb-e947d225d440 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:49.300441 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3560131-5b29-4ee3-8fdb-e947d225d440 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:49.467750 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d3560131-5b29-4ee3-8fdb-e947d225d440 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:49.476073 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d3560131-5b29-4ee3-8fdb-e947d225d440 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7" status: 200 len: 1391 microversion: 2.1 time: 0.201211 Oct 26 13:45:49.476748 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3254/6474] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:49 2022] GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 => generated 1391 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:50.232985 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-47ad1577-a2d5-4685-b582-abe54b0d943f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:50.233679 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-47ad1577-a2d5-4685-b582-abe54b0d943f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 031fe207-e80b-4c5f-a6df-bac922745198] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:50.242572 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-47ad1577-a2d5-4685-b582-abe54b0d943f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:50.243080 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-47ad1577-a2d5-4685-b582-abe54b0d943f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:50.243530 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-47ad1577-a2d5-4685-b582-abe54b0d943f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:50.244246 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-47ad1577-a2d5-4685-b582-abe54b0d943f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:50.245583 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-47ad1577-a2d5-4685-b582-abe54b0d943f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:50.246049 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-47ad1577-a2d5-4685-b582-abe54b0d943f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:50.324639 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-47ad1577-a2d5-4685-b582-abe54b0d943f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:50.333691 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-47ad1577-a2d5-4685-b582-abe54b0d943f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198" status: 200 len: 1188 microversion: 2.1 time: 0.105163 Oct 26 13:45:50.334269 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3221/6475] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:50 2022] GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198 => generated 1188 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:50.500368 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4f562304-9c3e-4465-88bc-0faebd90c56f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:50.501585 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4f562304-9c3e-4465-88bc-0faebd90c56f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:50.513118 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f562304-9c3e-4465-88bc-0faebd90c56f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:50.513648 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f562304-9c3e-4465-88bc-0faebd90c56f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:50.514088 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f562304-9c3e-4465-88bc-0faebd90c56f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:50.515166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f562304-9c3e-4465-88bc-0faebd90c56f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:50.515677 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f562304-9c3e-4465-88bc-0faebd90c56f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:50.516395 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f562304-9c3e-4465-88bc-0faebd90c56f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:50.687195 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4f562304-9c3e-4465-88bc-0faebd90c56f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:50.694901 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4f562304-9c3e-4465-88bc-0faebd90c56f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7" status: 200 len: 1391 microversion: 2.1 time: 0.198549 Oct 26 13:45:50.709173 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3255/6476] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:50 2022] GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 => generated 1391 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:51.357585 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-419d4165-e9d5-4c27-9efe-202b7495dfad tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:51.358212 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-419d4165-e9d5-4c27-9efe-202b7495dfad tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 031fe207-e80b-4c5f-a6df-bac922745198] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:51.365343 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-419d4165-e9d5-4c27-9efe-202b7495dfad tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:51.365868 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-419d4165-e9d5-4c27-9efe-202b7495dfad tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:51.366306 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-419d4165-e9d5-4c27-9efe-202b7495dfad tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:51.367006 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-419d4165-e9d5-4c27-9efe-202b7495dfad tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:51.367810 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-419d4165-e9d5-4c27-9efe-202b7495dfad tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:51.368242 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-419d4165-e9d5-4c27-9efe-202b7495dfad tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:51.450374 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-419d4165-e9d5-4c27-9efe-202b7495dfad tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:51.459619 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-419d4165-e9d5-4c27-9efe-202b7495dfad tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198" status: 200 len: 1188 microversion: 2.1 time: 0.106852 Oct 26 13:45:51.460214 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3222/6477] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:51 2022] GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198 => generated 1188 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:51.720219 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-34170ede-1fb5-478a-90fe-87e5b7cd03f7 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:51.721514 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-34170ede-1fb5-478a-90fe-87e5b7cd03f7 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:51.731034 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-34170ede-1fb5-478a-90fe-87e5b7cd03f7 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:51.731854 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-34170ede-1fb5-478a-90fe-87e5b7cd03f7 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:51.733241 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-34170ede-1fb5-478a-90fe-87e5b7cd03f7 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:51.734206 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-34170ede-1fb5-478a-90fe-87e5b7cd03f7 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:51.735246 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-34170ede-1fb5-478a-90fe-87e5b7cd03f7 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:51.735942 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-34170ede-1fb5-478a-90fe-87e5b7cd03f7 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:51.913777 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-34170ede-1fb5-478a-90fe-87e5b7cd03f7 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:51.917390 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-34170ede-1fb5-478a-90fe-87e5b7cd03f7 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7" status: 200 len: 1391 microversion: 2.1 time: 0.201819 Oct 26 13:45:51.918130 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3256/6478] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:51 2022] GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 => generated 1391 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:52.484442 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-80594302-23af-47c6-b8ad-cb983a070add tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:52.486196 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-80594302-23af-47c6-b8ad-cb983a070add tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 031fe207-e80b-4c5f-a6df-bac922745198] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:52.493905 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-80594302-23af-47c6-b8ad-cb983a070add tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:52.494936 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-80594302-23af-47c6-b8ad-cb983a070add tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:52.495745 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-80594302-23af-47c6-b8ad-cb983a070add tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:52.496782 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-80594302-23af-47c6-b8ad-cb983a070add tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:52.497509 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-80594302-23af-47c6-b8ad-cb983a070add tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:52.498124 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-80594302-23af-47c6-b8ad-cb983a070add tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:52.570086 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-80594302-23af-47c6-b8ad-cb983a070add tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:52.578890 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-80594302-23af-47c6-b8ad-cb983a070add tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198" status: 200 len: 1188 microversion: 2.1 time: 0.099282 Oct 26 13:45:52.579466 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3223/6479] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:52 2022] GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198 => generated 1188 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:52.941468 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b5d289d8-1fa3-4784-ad35-993ab16697d8 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:52.942128 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b5d289d8-1fa3-4784-ad35-993ab16697d8 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:52.949444 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5d289d8-1fa3-4784-ad35-993ab16697d8 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:52.950110 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5d289d8-1fa3-4784-ad35-993ab16697d8 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:52.950430 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5d289d8-1fa3-4784-ad35-993ab16697d8 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:52.951162 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5d289d8-1fa3-4784-ad35-993ab16697d8 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:52.951644 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5d289d8-1fa3-4784-ad35-993ab16697d8 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:52.952247 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b5d289d8-1fa3-4784-ad35-993ab16697d8 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:53.094159 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b5d289d8-1fa3-4784-ad35-993ab16697d8 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:53.104535 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b5d289d8-1fa3-4784-ad35-993ab16697d8 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7" status: 200 len: 1391 microversion: 2.1 time: 0.166141 Oct 26 13:45:53.105354 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3257/6480] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:52 2022] GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:53.602061 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-66dd620b-2084-4388-9c58-1569aca272cc tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:53.602829 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-66dd620b-2084-4388-9c58-1569aca272cc tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 031fe207-e80b-4c5f-a6df-bac922745198] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:53.610651 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-66dd620b-2084-4388-9c58-1569aca272cc tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:53.611410 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-66dd620b-2084-4388-9c58-1569aca272cc tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:53.612297 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-66dd620b-2084-4388-9c58-1569aca272cc tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:53.613088 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-66dd620b-2084-4388-9c58-1569aca272cc tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:53.613679 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-66dd620b-2084-4388-9c58-1569aca272cc tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:53.614310 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-66dd620b-2084-4388-9c58-1569aca272cc tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:53.631149 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-66dd620b-2084-4388-9c58-1569aca272cc tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] HTTP exception thrown: Instance 031fe207-e80b-4c5f-a6df-bac922745198 could not be found. Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-66dd620b-2084-4388-9c58-1569aca272cc tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Request method failure captured: Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198 HTTP/1.1 Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTnApzC1uv7RYc2W5kY-bKNxAsuZUBfTmQjsjWgzUuX11tX2R8DM_Fw7sVvtXRV9882pAeMKhCsEaXlaTjkLCgPxZsqy0UGzQzulFtHD7rhQ8cnkvWXYr0SPAMtN1JLnqGya627Ln2uWIw1ej-ApXw_efP2G5pRjjzhMaFQwCWIvwTI Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 2a1602330aa340b890bac76a120f74e8 Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-TestVolumeBootPattern-608207068 Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2a1602330aa340b890bac76a120f74e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2a1602330aa340b890bac76a120f74e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2a1602330aa340b890bac76a120f74e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2a1602330aa340b890bac76a120f74e8"}]}] Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-TestVolumeBootPattern-608207068 Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 2a1602330aa340b890bac76a120f74e8 Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-TestVolumeBootPattern-608207068 Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-TestVolumeBootPattern-608207068-project Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: df8b67aae3ea4f17bfa684681311dec5 Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-TestVolumeBootPattern-608207068-project Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 031fe207-e80b-4c5f-a6df-bac922745198 could not be found. Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '031fe207-e80b-4c5f-a6df-bac922745198'} Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 031fe207-e80b-4c5f-a6df-bac922745198 could not be found. Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 031fe207-e80b-4c5f-a6df-bac922745198 could not be found. Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:45:53.633198 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:45:53.637372 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:45:53.637372 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:45:53.637372 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:45:53.637372 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:45:53.637372 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:45:53.637372 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 031fe207-e80b-4c5f-a6df-bac922745198 could not be found. Oct 26 13:45:53.637372 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:45:53.639094 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-66dd620b-2084-4388-9c58-1569aca272cc tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Returning 404 to user: Instance 031fe207-e80b-4c5f-a6df-bac922745198 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:45:53.640515 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-66dd620b-2084-4388-9c58-1569aca272cc tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198" status: 404 len: 111 microversion: 2.1 time: 0.042867 Oct 26 13:45:53.641571 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3224/6481] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:53 2022] GET /compute/v2.1/servers/031fe207-e80b-4c5f-a6df-bac922745198 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:45:53.664440 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-5a7d92c9-a0eb-4188-b8b6-c206957f17a5 req-da4fdc0a-8f16-4683-a6a1-2ddfdce26848 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57c44677-5ded-4172-973e-691ee46a58e7", "name": "network-vif-plugged", "status": "completed", "tag": "13b722da-4749-4dbc-8041-62e84c5e59df"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:45:53.676656 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-5a7d92c9-a0eb-4188-b8b6-c206957f17a5 req-da4fdc0a-8f16-4683-a6a1-2ddfdce26848 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:53.677393 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-5a7d92c9-a0eb-4188-b8b6-c206957f17a5 req-da4fdc0a-8f16-4683-a6a1-2ddfdce26848 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:53.677954 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-5a7d92c9-a0eb-4188-b8b6-c206957f17a5 req-da4fdc0a-8f16-4683-a6a1-2ddfdce26848 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:53.694695 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-5a7d92c9-a0eb-4188-b8b6-c206957f17a5 req-da4fdc0a-8f16-4683-a6a1-2ddfdce26848 service nova] Creating event network-vif-plugged:13b722da-4749-4dbc-8041-62e84c5e59df for instance 57c44677-5ded-4172-973e-691ee46a58e7 on n-h1-862686-1 Oct 26 13:45:53.702821 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-5a7d92c9-a0eb-4188-b8b6-c206957f17a5 req-da4fdc0a-8f16-4683-a6a1-2ddfdce26848 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042926 Oct 26 13:45:53.703869 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3258/6482] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:45:54.127956 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f0150f0c-d98a-45e2-bf79-f9c712b95ac8 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:54.128794 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f0150f0c-d98a-45e2-bf79-f9c712b95ac8 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:54.131802 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:45:54.137851 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f0150f0c-d98a-45e2-bf79-f9c712b95ac8 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:54.138340 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f0150f0c-d98a-45e2-bf79-f9c712b95ac8 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:54.138811 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f0150f0c-d98a-45e2-bf79-f9c712b95ac8 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:54.139516 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f0150f0c-d98a-45e2-bf79-f9c712b95ac8 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:54.139966 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f0150f0c-d98a-45e2-bf79-f9c712b95ac8 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:54.140388 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f0150f0c-d98a-45e2-bf79-f9c712b95ac8 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:54.274161 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=8 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:45:54.294691 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f0150f0c-d98a-45e2-bf79-f9c712b95ac8 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:54.303751 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f0150f0c-d98a-45e2-bf79-f9c712b95ac8 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7" status: 200 len: 1391 microversion: 2.1 time: 0.179527 Oct 26 13:45:54.304927 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3225/6483] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:54 2022] GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 => generated 1391 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:55.329537 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-319e5be2-3f52-4847-b17f-4bef55a1dc96 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:55.330189 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-319e5be2-3f52-4847-b17f-4bef55a1dc96 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:55.346224 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-319e5be2-3f52-4847-b17f-4bef55a1dc96 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:55.347604 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-319e5be2-3f52-4847-b17f-4bef55a1dc96 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:55.348080 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-319e5be2-3f52-4847-b17f-4bef55a1dc96 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:55.348813 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-319e5be2-3f52-4847-b17f-4bef55a1dc96 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:55.349809 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-319e5be2-3f52-4847-b17f-4bef55a1dc96 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:55.350278 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-319e5be2-3f52-4847-b17f-4bef55a1dc96 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:55.582828 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-319e5be2-3f52-4847-b17f-4bef55a1dc96 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:55.604700 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-319e5be2-3f52-4847-b17f-4bef55a1dc96 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7" status: 200 len: 1562 microversion: 2.1 time: 0.267774 Oct 26 13:45:55.605841 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3259/6484] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:55 2022] GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 => generated 1562 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:55.632370 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3490c3b8-0e1d-46a5-a091-e67af6d2b151 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:55.632988 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3490c3b8-0e1d-46a5-a091-e67af6d2b151 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:55.639767 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a8b87600-a23e-4793-9615-ae9cdf42aed2 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:45:55.646563 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a8b87600-a23e-4793-9615-ae9cdf42aed2 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: c2f26f30-0505-403e-a11c-260fc8d49892] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:55.658456 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3490c3b8-0e1d-46a5-a091-e67af6d2b151 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:55.660674 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3490c3b8-0e1d-46a5-a091-e67af6d2b151 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:55.661855 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3490c3b8-0e1d-46a5-a091-e67af6d2b151 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:55.663216 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3490c3b8-0e1d-46a5-a091-e67af6d2b151 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:55.665119 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3490c3b8-0e1d-46a5-a091-e67af6d2b151 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:55.667780 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8b87600-a23e-4793-9615-ae9cdf42aed2 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:55.667981 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3490c3b8-0e1d-46a5-a091-e67af6d2b151 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:55.668969 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8b87600-a23e-4793-9615-ae9cdf42aed2 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:55.671947 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8b87600-a23e-4793-9615-ae9cdf42aed2 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:55.673220 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8b87600-a23e-4793-9615-ae9cdf42aed2 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:55.673969 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8b87600-a23e-4793-9615-ae9cdf42aed2 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:55.677265 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8b87600-a23e-4793-9615-ae9cdf42aed2 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:55.788967 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a8b87600-a23e-4793-9615-ae9cdf42aed2 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "POST /compute/v2.1/servers/c2f26f30-0505-403e-a11c-260fc8d49892/action" status: 200 len: 32634 microversion: 2.1 time: 0.154126 Oct 26 13:45:55.790027 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3226/6485] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:45:55 2022] POST /compute/v2.1/servers/c2f26f30-0505-403e-a11c-260fc8d49892/action => generated 32634 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:45:55.947087 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3490c3b8-0e1d-46a5-a091-e67af6d2b151 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:55.962938 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3490c3b8-0e1d-46a5-a091-e67af6d2b151 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7" status: 200 len: 1562 microversion: 2.1 time: 0.334195 Oct 26 13:45:55.964081 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3260/6486] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:55 2022] GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 => generated 1562 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:57.342114 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ba26e51d-c93a-4672-8b8f-b3a1f9ece5a4 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:57.343253 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ba26e51d-c93a-4672-8b8f-b3a1f9ece5a4 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: c2f26f30-0505-403e-a11c-260fc8d49892] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:57.366543 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ba26e51d-c93a-4672-8b8f-b3a1f9ece5a4 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:57.366824 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-e00d053c-a1bc-45c6-bedb-c89bb2095835 req-40924bb5-b2e0-4dc2-a2a2-a04bac477f1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2f26f30-0505-403e-a11c-260fc8d49892", "tag": "ccf3bba9-fb31-4df3-9464-35b3266ab518"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:45:57.367306 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ba26e51d-c93a-4672-8b8f-b3a1f9ece5a4 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:57.367474 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ba26e51d-c93a-4672-8b8f-b3a1f9ece5a4 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:57.374796 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ba26e51d-c93a-4672-8b8f-b3a1f9ece5a4 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:57.374796 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ba26e51d-c93a-4672-8b8f-b3a1f9ece5a4 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:57.375107 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ba26e51d-c93a-4672-8b8f-b3a1f9ece5a4 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:57.397361 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e00d053c-a1bc-45c6-bedb-c89bb2095835 req-40924bb5-b2e0-4dc2-a2a2-a04bac477f1a service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:57.398099 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e00d053c-a1bc-45c6-bedb-c89bb2095835 req-40924bb5-b2e0-4dc2-a2a2-a04bac477f1a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:57.401048 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e00d053c-a1bc-45c6-bedb-c89bb2095835 req-40924bb5-b2e0-4dc2-a2a2-a04bac477f1a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:57.437083 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-e00d053c-a1bc-45c6-bedb-c89bb2095835 req-40924bb5-b2e0-4dc2-a2a2-a04bac477f1a service nova] Creating event network-changed:ccf3bba9-fb31-4df3-9464-35b3266ab518 for instance c2f26f30-0505-403e-a11c-260fc8d49892 on n-h1-862686-1 Oct 26 13:45:57.449159 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-e00d053c-a1bc-45c6-bedb-c89bb2095835 req-40924bb5-b2e0-4dc2-a2a2-a04bac477f1a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087299 Oct 26 13:45:57.452453 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3261/6487] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:45:57.461143 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ba26e51d-c93a-4672-8b8f-b3a1f9ece5a4 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: c2f26f30-0505-403e-a11c-260fc8d49892] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:45:57.683528 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ba26e51d-c93a-4672-8b8f-b3a1f9ece5a4 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c2f26f30-0505-403e-a11c-260fc8d49892" status: 204 len: 0 microversion: 2.1 time: 0.342628 Oct 26 13:45:57.684654 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3227/6488] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:45:57 2022] DELETE /compute/v2.1/servers/c2f26f30-0505-403e-a11c-260fc8d49892 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:45:57.693362 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ef4c05b5-b54e-4849-bbeb-27af8aef0baa tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:57.694098 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ef4c05b5-b54e-4849-bbeb-27af8aef0baa tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: c2f26f30-0505-403e-a11c-260fc8d49892] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:57.708323 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef4c05b5-b54e-4849-bbeb-27af8aef0baa tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:57.708922 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef4c05b5-b54e-4849-bbeb-27af8aef0baa tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:57.709371 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef4c05b5-b54e-4849-bbeb-27af8aef0baa tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:57.710262 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef4c05b5-b54e-4849-bbeb-27af8aef0baa tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:57.710899 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef4c05b5-b54e-4849-bbeb-27af8aef0baa tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:57.711477 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef4c05b5-b54e-4849-bbeb-27af8aef0baa tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:58.081738 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ef4c05b5-b54e-4849-bbeb-27af8aef0baa tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe5aa8de6e24f1faf309f7e3e9a478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2ca8f7890421180d124123db3387f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:58.099446 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ef4c05b5-b54e-4849-bbeb-27af8aef0baa tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/c2f26f30-0505-403e-a11c-260fc8d49892" status: 200 len: 1672 microversion: 2.1 time: 0.410177 Oct 26 13:45:58.113508 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3262/6489] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:57 2022] GET /compute/v2.1/servers/c2f26f30-0505-403e-a11c-260fc8d49892 => generated 1672 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:58.532750 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e1aa8f30-66f8-452e-b412-acff74b3f64f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:58.534180 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e1aa8f30-66f8-452e-b412-acff74b3f64f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:58.545187 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-e49ddbeb-b593-4e3a-8037-0d9cba094c98 req-530b3187-5c18-41c3-bfdd-b0e8d04afba4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57c44677-5ded-4172-973e-691ee46a58e7", "tag": "13b722da-4749-4dbc-8041-62e84c5e59df"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:45:58.549365 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1aa8f30-66f8-452e-b412-acff74b3f64f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:58.552052 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1aa8f30-66f8-452e-b412-acff74b3f64f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:58.553872 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1aa8f30-66f8-452e-b412-acff74b3f64f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:58.557098 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1aa8f30-66f8-452e-b412-acff74b3f64f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:58.557848 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1aa8f30-66f8-452e-b412-acff74b3f64f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:58.560684 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1aa8f30-66f8-452e-b412-acff74b3f64f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:58.569447 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e49ddbeb-b593-4e3a-8037-0d9cba094c98 req-530b3187-5c18-41c3-bfdd-b0e8d04afba4 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:58.570193 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e49ddbeb-b593-4e3a-8037-0d9cba094c98 req-530b3187-5c18-41c3-bfdd-b0e8d04afba4 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:58.570838 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e49ddbeb-b593-4e3a-8037-0d9cba094c98 req-530b3187-5c18-41c3-bfdd-b0e8d04afba4 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:58.589033 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-e49ddbeb-b593-4e3a-8037-0d9cba094c98 req-530b3187-5c18-41c3-bfdd-b0e8d04afba4 service nova] Creating event network-changed:13b722da-4749-4dbc-8041-62e84c5e59df for instance 57c44677-5ded-4172-973e-691ee46a58e7 on n-h1-862686-1 Oct 26 13:45:58.595439 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-e49ddbeb-b593-4e3a-8037-0d9cba094c98 req-530b3187-5c18-41c3-bfdd-b0e8d04afba4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054594 Oct 26 13:45:58.596496 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3263/6490] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:45:58.808371 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-883c31a4-bb1f-47e7-ba48-62fa074d1bb0 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1831425185", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "8d76b343-64bc-4d76-b7dc-5af1d9af92fc"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:45:58.849954 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:45:58.889900 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e1aa8f30-66f8-452e-b412-acff74b3f64f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:58.905588 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e1aa8f30-66f8-452e-b412-acff74b3f64f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7" status: 200 len: 1562 microversion: 2.1 time: 0.377258 Oct 26 13:45:58.906760 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3228/6491] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:58 2022] GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 => generated 1562 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:58.965774 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-883c31a4-bb1f-47e7-ba48-62fa074d1bb0 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] validate_networks() for [('8d76b343-64bc-4d76-b7dc-5af1d9af92fc', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:45:59.127650 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bfc17506-8e77-490c-bc1e-36539d440185 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:45:59.128565 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bfc17506-8e77-490c-bc1e-36539d440185 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: c2f26f30-0505-403e-a11c-260fc8d49892] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:45:59.139870 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bfc17506-8e77-490c-bc1e-36539d440185 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:59.141302 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bfc17506-8e77-490c-bc1e-36539d440185 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:59.143671 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bfc17506-8e77-490c-bc1e-36539d440185 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:59.144588 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bfc17506-8e77-490c-bc1e-36539d440185 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:59.145171 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bfc17506-8e77-490c-bc1e-36539d440185 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:59.147204 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bfc17506-8e77-490c-bc1e-36539d440185 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:59.537856 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bfc17506-8e77-490c-bc1e-36539d440185 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe5aa8de6e24f1faf309f7e3e9a478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2ca8f7890421180d124123db3387f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:45:59.556458 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bfc17506-8e77-490c-bc1e-36539d440185 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/c2f26f30-0505-403e-a11c-260fc8d49892" status: 200 len: 1672 microversion: 2.1 time: 0.434020 Oct 26 13:45:59.557735 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3229/6492] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:45:59 2022] GET /compute/v2.1/servers/c2f26f30-0505-403e-a11c-260fc8d49892 => generated 1672 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:45:59.940883 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-d5eea1cf-e972-43af-abdf-af08dc2be69a req-2ab0e896-2f0f-4f55-a25c-5d8f0c7bfc8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2f26f30-0505-403e-a11c-260fc8d49892", "name": "network-vif-deleted", "tag": "ccf3bba9-fb31-4df3-9464-35b3266ab518"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:45:59.953308 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d5eea1cf-e972-43af-abdf-af08dc2be69a req-2ab0e896-2f0f-4f55-a25c-5d8f0c7bfc8e service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:45:59.954643 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d5eea1cf-e972-43af-abdf-af08dc2be69a req-2ab0e896-2f0f-4f55-a25c-5d8f0c7bfc8e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:45:59.955096 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d5eea1cf-e972-43af-abdf-af08dc2be69a req-2ab0e896-2f0f-4f55-a25c-5d8f0c7bfc8e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:45:59.970134 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-d5eea1cf-e972-43af-abdf-af08dc2be69a req-2ab0e896-2f0f-4f55-a25c-5d8f0c7bfc8e service nova] Creating event network-vif-deleted:ccf3bba9-fb31-4df3-9464-35b3266ab518 for instance c2f26f30-0505-403e-a11c-260fc8d49892 on n-h1-862686-1 Oct 26 13:45:59.977395 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-d5eea1cf-e972-43af-abdf-af08dc2be69a req-2ab0e896-2f0f-4f55-a25c-5d8f0c7bfc8e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040102 Oct 26 13:45:59.979123 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3230/6493] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:46:00.381742 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-883c31a4-bb1f-47e7-ba48-62fa074d1bb0 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:46:00.382225 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-883c31a4-bb1f-47e7-ba48-62fa074d1bb0 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:46:00.383020 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-883c31a4-bb1f-47e7-ba48-62fa074d1bb0 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:46:00.383444 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-883c31a4-bb1f-47e7-ba48-62fa074d1bb0 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:46:00.383889 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-883c31a4-bb1f-47e7-ba48-62fa074d1bb0 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:46:00.393994 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-883c31a4-bb1f-47e7-ba48-62fa074d1bb0 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:00.394485 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-883c31a4-bb1f-47e7-ba48-62fa074d1bb0 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:00.394919 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-883c31a4-bb1f-47e7-ba48-62fa074d1bb0 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:00.395646 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-883c31a4-bb1f-47e7-ba48-62fa074d1bb0 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:00.396105 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-883c31a4-bb1f-47e7-ba48-62fa074d1bb0 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:00.396520 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-883c31a4-bb1f-47e7-ba48-62fa074d1bb0 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:00.418288 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-883c31a4-bb1f-47e7-ba48-62fa074d1bb0 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Getting quotas for project f6a7679918e944ec85906869a33579ce. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:46:00.423682 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-883c31a4-bb1f-47e7-ba48-62fa074d1bb0 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Getting quotas for user 6d385f50cd7c47f698bb2b1fc69af46a and project f6a7679918e944ec85906869a33579ce. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:46:00.436978 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-883c31a4-bb1f-47e7-ba48-62fa074d1bb0 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:46:00.439425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-883c31a4-bb1f-47e7-ba48-62fa074d1bb0 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] [instance: 6535462e-bca9-4ef4-9185-d7de4cbb03f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:46:00.489476 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-883c31a4-bb1f-47e7-ba48-62fa074d1bb0 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.689220 Oct 26 13:46:00.501053 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3264/6494] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:45:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:46:00.507901 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-705f23a5-38e5-4c8f-be9a-953808aa163a tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:00.508861 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-705f23a5-38e5-4c8f-be9a-953808aa163a tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] [instance: 6535462e-bca9-4ef4-9185-d7de4cbb03f6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:00.521363 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:46:00.587116 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d0b3e07e-2530-43e8-8fe7-47d9e5ef3269 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:00.589506 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d0b3e07e-2530-43e8-8fe7-47d9e5ef3269 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: c2f26f30-0505-403e-a11c-260fc8d49892] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:00.608336 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0b3e07e-2530-43e8-8fe7-47d9e5ef3269 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:00.612577 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0b3e07e-2530-43e8-8fe7-47d9e5ef3269 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:00.613924 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0b3e07e-2530-43e8-8fe7-47d9e5ef3269 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:00.615487 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0b3e07e-2530-43e8-8fe7-47d9e5ef3269 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:00.616826 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0b3e07e-2530-43e8-8fe7-47d9e5ef3269 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:00.618659 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0b3e07e-2530-43e8-8fe7-47d9e5ef3269 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:00.627427 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-705f23a5-38e5-4c8f-be9a-953808aa163a tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d385f50cd7c47f698bb2b1fc69af46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a7679918e944ec85906869a33579ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:00.639835 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-705f23a5-38e5-4c8f-be9a-953808aa163a tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] 10.222.0.40 "GET /compute/v2.1/servers/6535462e-bca9-4ef4-9185-d7de4cbb03f6" status: 200 len: 1214 microversion: 2.1 time: 0.137033 Oct 26 13:46:00.650776 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3231/6495] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:00 2022] GET /compute/v2.1/servers/6535462e-bca9-4ef4-9185-d7de4cbb03f6 => generated 1214 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:00.689904 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0b3e07e-2530-43e8-8fe7-47d9e5ef3269 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:00.690484 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0b3e07e-2530-43e8-8fe7-47d9e5ef3269 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:00.690996 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0b3e07e-2530-43e8-8fe7-47d9e5ef3269 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:00.691519 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-d0b3e07e-2530-43e8-8fe7-47d9e5ef3269 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lazy-loading 'fault' on Instance uuid c2f26f30-0505-403e-a11c-260fc8d49892 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:46:00.786467 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d0b3e07e-2530-43e8-8fe7-47d9e5ef3269 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe5aa8de6e24f1faf309f7e3e9a478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2ca8f7890421180d124123db3387f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:00.797210 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d0b3e07e-2530-43e8-8fe7-47d9e5ef3269 tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/c2f26f30-0505-403e-a11c-260fc8d49892" status: 200 len: 1339 microversion: 2.1 time: 0.216227 Oct 26 13:46:00.810864 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3265/6496] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:00 2022] GET /compute/v2.1/servers/c2f26f30-0505-403e-a11c-260fc8d49892 => generated 1339 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:46:01.663429 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7471e4f0-b528-463c-b863-123429ec521f tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:01.663964 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7471e4f0-b528-463c-b863-123429ec521f tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] [instance: 6535462e-bca9-4ef4-9185-d7de4cbb03f6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:01.675490 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7471e4f0-b528-463c-b863-123429ec521f tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:01.676880 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7471e4f0-b528-463c-b863-123429ec521f tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:01.677331 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7471e4f0-b528-463c-b863-123429ec521f tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:01.678531 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7471e4f0-b528-463c-b863-123429ec521f tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:01.679018 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7471e4f0-b528-463c-b863-123429ec521f tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:01.679452 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7471e4f0-b528-463c-b863-123429ec521f tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:01.751043 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7471e4f0-b528-463c-b863-123429ec521f tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d385f50cd7c47f698bb2b1fc69af46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a7679918e944ec85906869a33579ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:01.760110 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7471e4f0-b528-463c-b863-123429ec521f tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] 10.222.0.40 "GET /compute/v2.1/servers/6535462e-bca9-4ef4-9185-d7de4cbb03f6" status: 200 len: 1266 microversion: 2.1 time: 0.100049 Oct 26 13:46:01.761017 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3232/6497] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:01 2022] GET /compute/v2.1/servers/6535462e-bca9-4ef4-9185-d7de4cbb03f6 => generated 1266 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:01.821416 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e0a5e7bf-7cb5-48c3-837b-6d30bcdbfe4d tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:01.824697 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e0a5e7bf-7cb5-48c3-837b-6d30bcdbfe4d tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] [instance: c2f26f30-0505-403e-a11c-260fc8d49892] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:01.834279 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0a5e7bf-7cb5-48c3-837b-6d30bcdbfe4d tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:01.835052 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0a5e7bf-7cb5-48c3-837b-6d30bcdbfe4d tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:01.835695 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0a5e7bf-7cb5-48c3-837b-6d30bcdbfe4d tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:01.836657 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0a5e7bf-7cb5-48c3-837b-6d30bcdbfe4d tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:01.837198 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0a5e7bf-7cb5-48c3-837b-6d30bcdbfe4d tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:01.838429 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0a5e7bf-7cb5-48c3-837b-6d30bcdbfe4d tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:01.843512 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:46:01.863520 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-e0a5e7bf-7cb5-48c3-837b-6d30bcdbfe4d tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] HTTP exception thrown: Instance c2f26f30-0505-403e-a11c-260fc8d49892 could not be found. Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e0a5e7bf-7cb5-48c3-837b-6d30bcdbfe4d tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Request method failure captured: Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/c2f26f30-0505-403e-a11c-260fc8d49892 HTTP/1.1 Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTlB6nx7WIoeAKoM5LmzE-4SdNpuo3oUw-CyeEspHcaHQXu00Wl-HTDBmplEdxIaAqaNrKwBolo-ROn9MG_a4bhX3BTPKJJ36Xqej37oQSYPtCyku0xHVQI25kxNIyyK8P_UAdFLPKWjkrVxVkhoEUb5sPKI4bF5Bflqagh3alz1u-s Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 8af2ca8f7890421180d124123db3387f Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-TestNetworkBasicOps-144239929 Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8af2ca8f7890421180d124123db3387f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8af2ca8f7890421180d124123db3387f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8af2ca8f7890421180d124123db3387f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8af2ca8f7890421180d124123db3387f"}]}] Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-TestNetworkBasicOps-144239929 Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 8af2ca8f7890421180d124123db3387f Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-TestNetworkBasicOps-144239929 Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-TestNetworkBasicOps-144239929-project Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 3fe5aa8de6e24f1faf309f7e3e9a478c Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-TestNetworkBasicOps-144239929-project Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance c2f26f30-0505-403e-a11c-260fc8d49892 could not be found. Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'c2f26f30-0505-403e-a11c-260fc8d49892'} Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2f26f30-0505-403e-a11c-260fc8d49892 could not be found. Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2f26f30-0505-403e-a11c-260fc8d49892 could not be found. Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:46:01.865637 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:46:01.870037 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:46:01.870037 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:46:01.870037 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:46:01.870037 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:46:01.870037 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:46:01.870037 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2f26f30-0505-403e-a11c-260fc8d49892 could not be found. Oct 26 13:46:01.870037 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:46:01.871636 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e0a5e7bf-7cb5-48c3-837b-6d30bcdbfe4d tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Returning 404 to user: Instance c2f26f30-0505-403e-a11c-260fc8d49892 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:46:01.872653 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e0a5e7bf-7cb5-48c3-837b-6d30bcdbfe4d tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "GET /compute/v2.1/servers/c2f26f30-0505-403e-a11c-260fc8d49892" status: 404 len: 111 microversion: 2.1 time: 0.056338 Oct 26 13:46:01.877188 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3266/6498] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:01 2022] GET /compute/v2.1/servers/c2f26f30-0505-403e-a11c-260fc8d49892 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:46:02.075123 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-903fb6c8-2377-4cba-843c-33e4b688bd7b tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] Calling method '.version_select at 0x7f6731b3e5e0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:02.107204 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-903fb6c8-2377-4cba-843c-33e4b688bd7b tempest-TestNetworkBasicOps-144239929 tempest-TestNetworkBasicOps-144239929-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2086387703" status: 202 len: 0 microversion: 2.1 time: 0.035837 Oct 26 13:46:02.108300 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3233/6499] 10.222.0.40 () {58 vars in 1257 bytes} [Wed Oct 26 13:46:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2086387703 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:46:02.784160 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4d061049-d7bb-4d5c-9313-3d64c0ec36ad tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:02.784772 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4d061049-d7bb-4d5c-9313-3d64c0ec36ad tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] [instance: 6535462e-bca9-4ef4-9185-d7de4cbb03f6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:02.792226 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d061049-d7bb-4d5c-9313-3d64c0ec36ad tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:02.795323 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d061049-d7bb-4d5c-9313-3d64c0ec36ad tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:02.796196 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d061049-d7bb-4d5c-9313-3d64c0ec36ad tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:02.797151 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d061049-d7bb-4d5c-9313-3d64c0ec36ad tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:02.797845 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d061049-d7bb-4d5c-9313-3d64c0ec36ad tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:02.798463 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d061049-d7bb-4d5c-9313-3d64c0ec36ad tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:03.050615 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4d061049-d7bb-4d5c-9313-3d64c0ec36ad tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d385f50cd7c47f698bb2b1fc69af46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a7679918e944ec85906869a33579ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:03.069706 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4d061049-d7bb-4d5c-9313-3d64c0ec36ad tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] 10.222.0.40 "GET /compute/v2.1/servers/6535462e-bca9-4ef4-9185-d7de4cbb03f6" status: 200 len: 1314 microversion: 2.1 time: 0.288891 Oct 26 13:46:03.070587 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3267/6500] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:02 2022] GET /compute/v2.1/servers/6535462e-bca9-4ef4-9185-d7de4cbb03f6 => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:03.350630 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-4238ee88-5a3b-411d-8841-2ff320aea10b req-bf2a191e-4ad3-4799-a6c9-90303c84c8e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6535462e-bca9-4ef4-9185-d7de4cbb03f6", "tag": "bb31dcf2-3e34-452c-8eea-f27e1c5f4841"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:46:03.371681 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-4238ee88-5a3b-411d-8841-2ff320aea10b req-bf2a191e-4ad3-4799-a6c9-90303c84c8e0 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:03.373781 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-4238ee88-5a3b-411d-8841-2ff320aea10b req-bf2a191e-4ad3-4799-a6c9-90303c84c8e0 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:03.375839 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-4238ee88-5a3b-411d-8841-2ff320aea10b req-bf2a191e-4ad3-4799-a6c9-90303c84c8e0 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:03.399491 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-4238ee88-5a3b-411d-8841-2ff320aea10b req-bf2a191e-4ad3-4799-a6c9-90303c84c8e0 service nova] Creating event network-changed:bb31dcf2-3e34-452c-8eea-f27e1c5f4841 for instance 6535462e-bca9-4ef4-9185-d7de4cbb03f6 on n-h2-862686-1 Oct 26 13:46:03.409906 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-4238ee88-5a3b-411d-8841-2ff320aea10b req-bf2a191e-4ad3-4799-a6c9-90303c84c8e0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066364 Oct 26 13:46:03.411344 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3234/6501] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:46:04.094488 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-02b4376f-ca42-408f-ae9a-628cb05bb1f8 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:04.096353 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-02b4376f-ca42-408f-ae9a-628cb05bb1f8 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] [instance: 6535462e-bca9-4ef4-9185-d7de4cbb03f6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:04.110845 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02b4376f-ca42-408f-ae9a-628cb05bb1f8 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:04.113154 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02b4376f-ca42-408f-ae9a-628cb05bb1f8 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:04.114606 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02b4376f-ca42-408f-ae9a-628cb05bb1f8 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:04.115523 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02b4376f-ca42-408f-ae9a-628cb05bb1f8 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:04.118217 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02b4376f-ca42-408f-ae9a-628cb05bb1f8 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:04.119362 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02b4376f-ca42-408f-ae9a-628cb05bb1f8 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:04.389457 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-02b4376f-ca42-408f-ae9a-628cb05bb1f8 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d385f50cd7c47f698bb2b1fc69af46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a7679918e944ec85906869a33579ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:04.402890 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-02b4376f-ca42-408f-ae9a-628cb05bb1f8 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] 10.222.0.40 "GET /compute/v2.1/servers/6535462e-bca9-4ef4-9185-d7de4cbb03f6" status: 200 len: 1314 microversion: 2.1 time: 0.313722 Oct 26 13:46:04.403679 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3268/6502] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:04 2022] GET /compute/v2.1/servers/6535462e-bca9-4ef4-9185-d7de4cbb03f6 => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:05.429278 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-09119693-50d2-4332-960e-4df01db4833d tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:05.430163 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-09119693-50d2-4332-960e-4df01db4833d tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] [instance: 6535462e-bca9-4ef4-9185-d7de4cbb03f6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:05.437155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09119693-50d2-4332-960e-4df01db4833d tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:05.437937 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09119693-50d2-4332-960e-4df01db4833d tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:05.438372 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09119693-50d2-4332-960e-4df01db4833d tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:05.439345 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09119693-50d2-4332-960e-4df01db4833d tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:05.440381 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09119693-50d2-4332-960e-4df01db4833d tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:05.441199 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09119693-50d2-4332-960e-4df01db4833d tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:05.822697 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-09119693-50d2-4332-960e-4df01db4833d tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d385f50cd7c47f698bb2b1fc69af46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a7679918e944ec85906869a33579ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:05.834827 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-09119693-50d2-4332-960e-4df01db4833d tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] 10.222.0.40 "GET /compute/v2.1/servers/6535462e-bca9-4ef4-9185-d7de4cbb03f6" status: 200 len: 1314 microversion: 2.1 time: 0.411858 Oct 26 13:46:05.839188 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3235/6503] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:05 2022] GET /compute/v2.1/servers/6535462e-bca9-4ef4-9185-d7de4cbb03f6 => generated 1314 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:06.858818 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f4c21419-c009-4cd8-b084-c9617e312e87 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:06.860505 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f4c21419-c009-4cd8-b084-c9617e312e87 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] [instance: 6535462e-bca9-4ef4-9185-d7de4cbb03f6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:06.870541 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4c21419-c009-4cd8-b084-c9617e312e87 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:06.871354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4c21419-c009-4cd8-b084-c9617e312e87 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:06.871905 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4c21419-c009-4cd8-b084-c9617e312e87 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:06.872749 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4c21419-c009-4cd8-b084-c9617e312e87 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:06.873274 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4c21419-c009-4cd8-b084-c9617e312e87 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:06.873786 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4c21419-c009-4cd8-b084-c9617e312e87 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:07.032004 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f4c21419-c009-4cd8-b084-c9617e312e87 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d385f50cd7c47f698bb2b1fc69af46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a7679918e944ec85906869a33579ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:07.040883 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f4c21419-c009-4cd8-b084-c9617e312e87 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] 10.222.0.40 "GET /compute/v2.1/servers/6535462e-bca9-4ef4-9185-d7de4cbb03f6" status: 200 len: 1314 microversion: 2.1 time: 0.186159 Oct 26 13:46:07.042172 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3269/6504] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:06 2022] GET /compute/v2.1/servers/6535462e-bca9-4ef4-9185-d7de4cbb03f6 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:08.064070 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a64f1cc1-b78d-475a-a654-6f1e990bba44 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:08.064761 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a64f1cc1-b78d-475a-a654-6f1e990bba44 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] [instance: 6535462e-bca9-4ef4-9185-d7de4cbb03f6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:08.072566 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a64f1cc1-b78d-475a-a654-6f1e990bba44 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:08.073283 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a64f1cc1-b78d-475a-a654-6f1e990bba44 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:08.073748 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a64f1cc1-b78d-475a-a654-6f1e990bba44 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:08.074667 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a64f1cc1-b78d-475a-a654-6f1e990bba44 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:08.075129 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a64f1cc1-b78d-475a-a654-6f1e990bba44 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:08.075558 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a64f1cc1-b78d-475a-a654-6f1e990bba44 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:08.093429 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:46:08.274364 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a64f1cc1-b78d-475a-a654-6f1e990bba44 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d385f50cd7c47f698bb2b1fc69af46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a7679918e944ec85906869a33579ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:08.286698 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a64f1cc1-b78d-475a-a654-6f1e990bba44 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] 10.222.0.40 "GET /compute/v2.1/servers/6535462e-bca9-4ef4-9185-d7de4cbb03f6" status: 200 len: 1314 microversion: 2.1 time: 0.226337 Oct 26 13:46:08.288125 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3236/6505] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:08 2022] GET /compute/v2.1/servers/6535462e-bca9-4ef4-9185-d7de4cbb03f6 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:09.312842 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-59920122-2bb0-4840-b8c8-21ff2bcab03e tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:09.313496 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-59920122-2bb0-4840-b8c8-21ff2bcab03e tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] [instance: 6535462e-bca9-4ef4-9185-d7de4cbb03f6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:09.324839 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-59920122-2bb0-4840-b8c8-21ff2bcab03e tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:09.326794 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-59920122-2bb0-4840-b8c8-21ff2bcab03e tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:09.327261 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-59920122-2bb0-4840-b8c8-21ff2bcab03e tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:09.329129 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-59920122-2bb0-4840-b8c8-21ff2bcab03e tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:09.334800 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-59920122-2bb0-4840-b8c8-21ff2bcab03e tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:09.335569 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-59920122-2bb0-4840-b8c8-21ff2bcab03e tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:09.535681 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-59920122-2bb0-4840-b8c8-21ff2bcab03e tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d385f50cd7c47f698bb2b1fc69af46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a7679918e944ec85906869a33579ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:09.546977 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-59920122-2bb0-4840-b8c8-21ff2bcab03e tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] 10.222.0.40 "GET /compute/v2.1/servers/6535462e-bca9-4ef4-9185-d7de4cbb03f6" status: 200 len: 1314 microversion: 2.1 time: 0.239731 Oct 26 13:46:09.547570 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3270/6506] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:09 2022] GET /compute/v2.1/servers/6535462e-bca9-4ef4-9185-d7de4cbb03f6 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:09.846402 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-a612c914-cc5e-45f9-b395-9c0e1cee640e req-58831784-0967-4f36-9309-05d587ef2a54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6535462e-bca9-4ef4-9185-d7de4cbb03f6", "name": "network-vif-plugged", "status": "completed", "tag": "bb31dcf2-3e34-452c-8eea-f27e1c5f4841"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:46:09.858672 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a612c914-cc5e-45f9-b395-9c0e1cee640e req-58831784-0967-4f36-9309-05d587ef2a54 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:09.859351 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a612c914-cc5e-45f9-b395-9c0e1cee640e req-58831784-0967-4f36-9309-05d587ef2a54 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:09.859933 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a612c914-cc5e-45f9-b395-9c0e1cee640e req-58831784-0967-4f36-9309-05d587ef2a54 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:09.877602 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-a612c914-cc5e-45f9-b395-9c0e1cee640e req-58831784-0967-4f36-9309-05d587ef2a54 service nova] Creating event network-vif-plugged:bb31dcf2-3e34-452c-8eea-f27e1c5f4841 for instance 6535462e-bca9-4ef4-9185-d7de4cbb03f6 on n-h2-862686-1 Oct 26 13:46:09.884509 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-a612c914-cc5e-45f9-b395-9c0e1cee640e req-58831784-0967-4f36-9309-05d587ef2a54 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041569 Oct 26 13:46:09.886923 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3237/6507] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:46:10.572102 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e1fb88d2-bb4c-4903-bf40-e9fccb31b3e4 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:10.573442 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e1fb88d2-bb4c-4903-bf40-e9fccb31b3e4 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] [instance: 6535462e-bca9-4ef4-9185-d7de4cbb03f6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:10.576458 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:46:10.577371 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:46:10.584662 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e1fb88d2-bb4c-4903-bf40-e9fccb31b3e4 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:10.585160 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e1fb88d2-bb4c-4903-bf40-e9fccb31b3e4 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:10.585630 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e1fb88d2-bb4c-4903-bf40-e9fccb31b3e4 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:10.586530 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e1fb88d2-bb4c-4903-bf40-e9fccb31b3e4 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:10.587268 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e1fb88d2-bb4c-4903-bf40-e9fccb31b3e4 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:10.587769 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e1fb88d2-bb4c-4903-bf40-e9fccb31b3e4 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:10.734595 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e1fb88d2-bb4c-4903-bf40-e9fccb31b3e4 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d385f50cd7c47f698bb2b1fc69af46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a7679918e944ec85906869a33579ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:10.744922 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e1fb88d2-bb4c-4903-bf40-e9fccb31b3e4 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] 10.222.0.40 "GET /compute/v2.1/servers/6535462e-bca9-4ef4-9185-d7de4cbb03f6" status: 200 len: 1314 microversion: 2.1 time: 0.178310 Oct 26 13:46:10.746257 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3271/6508] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:10 2022] GET /compute/v2.1/servers/6535462e-bca9-4ef4-9185-d7de4cbb03f6 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:11.764975 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:46:11.770009 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6b50f00e-0dd9-4ab9-82e7-ce5a7c54a803 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:11.771546 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6b50f00e-0dd9-4ab9-82e7-ce5a7c54a803 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] [instance: 6535462e-bca9-4ef4-9185-d7de4cbb03f6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:11.780697 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b50f00e-0dd9-4ab9-82e7-ce5a7c54a803 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:11.781280 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b50f00e-0dd9-4ab9-82e7-ce5a7c54a803 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:11.781722 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b50f00e-0dd9-4ab9-82e7-ce5a7c54a803 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:11.782564 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b50f00e-0dd9-4ab9-82e7-ce5a7c54a803 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:11.783087 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b50f00e-0dd9-4ab9-82e7-ce5a7c54a803 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:11.783496 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b50f00e-0dd9-4ab9-82e7-ce5a7c54a803 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:11.943313 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6b50f00e-0dd9-4ab9-82e7-ce5a7c54a803 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d385f50cd7c47f698bb2b1fc69af46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a7679918e944ec85906869a33579ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:11.954752 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6b50f00e-0dd9-4ab9-82e7-ce5a7c54a803 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] 10.222.0.40 "GET /compute/v2.1/servers/6535462e-bca9-4ef4-9185-d7de4cbb03f6" status: 200 len: 1498 microversion: 2.1 time: 0.190519 Oct 26 13:46:11.955471 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3238/6509] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:11 2022] GET /compute/v2.1/servers/6535462e-bca9-4ef4-9185-d7de4cbb03f6 => generated 1498 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:12.409613 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-023e30f4-5b9b-4386-8787-343179290211 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:12.410728 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-023e30f4-5b9b-4386-8787-343179290211 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] [instance: 6535462e-bca9-4ef4-9185-d7de4cbb03f6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:12.420825 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-023e30f4-5b9b-4386-8787-343179290211 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:12.421695 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-023e30f4-5b9b-4386-8787-343179290211 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:12.422339 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-023e30f4-5b9b-4386-8787-343179290211 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:12.423292 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-023e30f4-5b9b-4386-8787-343179290211 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:12.424004 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-023e30f4-5b9b-4386-8787-343179290211 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:12.424629 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-023e30f4-5b9b-4386-8787-343179290211 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:12.457751 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-023e30f4-5b9b-4386-8787-343179290211 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] [instance: 6535462e-bca9-4ef4-9185-d7de4cbb03f6] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:46:12.560250 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-023e30f4-5b9b-4386-8787-343179290211 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6535462e-bca9-4ef4-9185-d7de4cbb03f6" status: 204 len: 0 microversion: 2.1 time: 0.154383 Oct 26 13:46:12.561167 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3272/6510] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:46:12 2022] DELETE /compute/v2.1/servers/6535462e-bca9-4ef4-9185-d7de4cbb03f6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:46:12.569433 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-74dd6652-e0ad-4e0b-86cf-ad8f454a90ef tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:12.570085 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-74dd6652-e0ad-4e0b-86cf-ad8f454a90ef tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] [instance: 6535462e-bca9-4ef4-9185-d7de4cbb03f6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:12.579552 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-74dd6652-e0ad-4e0b-86cf-ad8f454a90ef tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:12.580314 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-74dd6652-e0ad-4e0b-86cf-ad8f454a90ef tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:12.580907 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-74dd6652-e0ad-4e0b-86cf-ad8f454a90ef tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:12.582621 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-74dd6652-e0ad-4e0b-86cf-ad8f454a90ef tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:12.583209 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-74dd6652-e0ad-4e0b-86cf-ad8f454a90ef tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:12.583712 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-74dd6652-e0ad-4e0b-86cf-ad8f454a90ef tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:12.734996 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-74dd6652-e0ad-4e0b-86cf-ad8f454a90ef tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d385f50cd7c47f698bb2b1fc69af46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a7679918e944ec85906869a33579ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:12.748860 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-74dd6652-e0ad-4e0b-86cf-ad8f454a90ef tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] 10.222.0.40 "GET /compute/v2.1/servers/6535462e-bca9-4ef4-9185-d7de4cbb03f6" status: 200 len: 1504 microversion: 2.1 time: 0.183272 Oct 26 13:46:12.749694 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3239/6511] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:12 2022] GET /compute/v2.1/servers/6535462e-bca9-4ef4-9185-d7de4cbb03f6 => generated 1504 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:13.773859 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b39f2de3-b746-4059-9007-d643d415f151 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:13.781998 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b39f2de3-b746-4059-9007-d643d415f151 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] [instance: 6535462e-bca9-4ef4-9185-d7de4cbb03f6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:13.790350 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b39f2de3-b746-4059-9007-d643d415f151 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:13.795531 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b39f2de3-b746-4059-9007-d643d415f151 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:13.797289 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b39f2de3-b746-4059-9007-d643d415f151 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:13.798283 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b39f2de3-b746-4059-9007-d643d415f151 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:13.798952 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b39f2de3-b746-4059-9007-d643d415f151 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:13.799594 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b39f2de3-b746-4059-9007-d643d415f151 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:14.221583 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b39f2de3-b746-4059-9007-d643d415f151 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d385f50cd7c47f698bb2b1fc69af46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a7679918e944ec85906869a33579ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:14.231047 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b39f2de3-b746-4059-9007-d643d415f151 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] 10.222.0.40 "GET /compute/v2.1/servers/6535462e-bca9-4ef4-9185-d7de4cbb03f6" status: 200 len: 1504 microversion: 2.1 time: 0.461909 Oct 26 13:46:14.232792 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3273/6512] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:13 2022] GET /compute/v2.1/servers/6535462e-bca9-4ef4-9185-d7de4cbb03f6 => generated 1504 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:46:14.978795 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-9f24bd39-c8a7-4295-b16a-0f31dd541c00 req-bf472ce6-d0b3-4824-8ecb-2290e3de42c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6535462e-bca9-4ef4-9185-d7de4cbb03f6", "name": "network-vif-deleted", "tag": "bb31dcf2-3e34-452c-8eea-f27e1c5f4841"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:46:14.991959 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9f24bd39-c8a7-4295-b16a-0f31dd541c00 req-bf472ce6-d0b3-4824-8ecb-2290e3de42c5 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:14.992768 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9f24bd39-c8a7-4295-b16a-0f31dd541c00 req-bf472ce6-d0b3-4824-8ecb-2290e3de42c5 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:14.993953 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9f24bd39-c8a7-4295-b16a-0f31dd541c00 req-bf472ce6-d0b3-4824-8ecb-2290e3de42c5 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:15.009283 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-9f24bd39-c8a7-4295-b16a-0f31dd541c00 req-bf472ce6-d0b3-4824-8ecb-2290e3de42c5 service nova] Creating event network-vif-deleted:bb31dcf2-3e34-452c-8eea-f27e1c5f4841 for instance 6535462e-bca9-4ef4-9185-d7de4cbb03f6 on n-h2-862686-1 Oct 26 13:46:15.015814 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-9f24bd39-c8a7-4295-b16a-0f31dd541c00 req-bf472ce6-d0b3-4824-8ecb-2290e3de42c5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040616 Oct 26 13:46:15.016747 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3240/6513] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:46:15.256287 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-188946c4-890f-465f-9e84-a178c6ef549d tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:15.256902 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-188946c4-890f-465f-9e84-a178c6ef549d tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] [instance: 6535462e-bca9-4ef4-9185-d7de4cbb03f6] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:15.270837 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-188946c4-890f-465f-9e84-a178c6ef549d tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:15.271788 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-188946c4-890f-465f-9e84-a178c6ef549d tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:15.272534 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-188946c4-890f-465f-9e84-a178c6ef549d tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:15.273295 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-188946c4-890f-465f-9e84-a178c6ef549d tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:15.273843 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-188946c4-890f-465f-9e84-a178c6ef549d tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:15.292810 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-188946c4-890f-465f-9e84-a178c6ef549d tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:15.359971 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-188946c4-890f-465f-9e84-a178c6ef549d tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:15.361239 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-188946c4-890f-465f-9e84-a178c6ef549d tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:15.361999 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-188946c4-890f-465f-9e84-a178c6ef549d tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:15.362675 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-188946c4-890f-465f-9e84-a178c6ef549d tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lazy-loading 'fault' on Instance uuid 6535462e-bca9-4ef4-9185-d7de4cbb03f6 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:46:15.424592 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-188946c4-890f-465f-9e84-a178c6ef549d tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d385f50cd7c47f698bb2b1fc69af46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a7679918e944ec85906869a33579ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:15.435138 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-188946c4-890f-465f-9e84-a178c6ef549d tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] 10.222.0.40 "GET /compute/v2.1/servers/6535462e-bca9-4ef4-9185-d7de4cbb03f6" status: 200 len: 1304 microversion: 2.1 time: 0.182818 Oct 26 13:46:15.436252 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3274/6514] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:15 2022] GET /compute/v2.1/servers/6535462e-bca9-4ef4-9185-d7de4cbb03f6 => generated 1304 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:16.462878 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ce66d1aa-3836-45c4-bd79-80849193dcdd tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:16.463772 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ce66d1aa-3836-45c4-bd79-80849193dcdd tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] [instance: 6535462e-bca9-4ef4-9185-d7de4cbb03f6] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:16.470817 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce66d1aa-3836-45c4-bd79-80849193dcdd tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:16.471566 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce66d1aa-3836-45c4-bd79-80849193dcdd tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:16.472190 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce66d1aa-3836-45c4-bd79-80849193dcdd tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:16.473340 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce66d1aa-3836-45c4-bd79-80849193dcdd tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:16.474297 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce66d1aa-3836-45c4-bd79-80849193dcdd tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:16.478179 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce66d1aa-3836-45c4-bd79-80849193dcdd tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:16.503959 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-ce66d1aa-3836-45c4-bd79-80849193dcdd tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] HTTP exception thrown: Instance 6535462e-bca9-4ef4-9185-d7de4cbb03f6 could not be found. Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ce66d1aa-3836-45c4-bd79-80849193dcdd tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Request method failure captured: Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/6535462e-bca9-4ef4-9185-d7de4cbb03f6 HTTP/1.1 Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWToTREHg5BYdoquq6SsMtPkx7s1tNKwfvEE1fYIn-X8gpMyIM06jPmU5OQK2MLGsDvv5nn675U11fe1pUCZ9NumLqmjRtNImpzL_5alRtFq3l4yMBWRwvL7fbCf8BIHm3Ah6JDOypikRpfAVqhNLTUZmuQogRl4bweY_Rw53c3uhTi8 Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: f6a7679918e944ec85906869a33579ce Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-VolumesActionsTest-2047937803 Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f6a7679918e944ec85906869a33579ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f6a7679918e944ec85906869a33579ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f6a7679918e944ec85906869a33579ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f6a7679918e944ec85906869a33579ce"}]}] Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-VolumesActionsTest-2047937803 Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: f6a7679918e944ec85906869a33579ce Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-VolumesActionsTest-2047937803 Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-VolumesActionsTest-2047937803-project Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 6d385f50cd7c47f698bb2b1fc69af46a Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-VolumesActionsTest-2047937803-project Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 6535462e-bca9-4ef4-9185-d7de4cbb03f6 could not be found. Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '6535462e-bca9-4ef4-9185-d7de4cbb03f6'} Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6535462e-bca9-4ef4-9185-d7de4cbb03f6 could not be found. Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6535462e-bca9-4ef4-9185-d7de4cbb03f6 could not be found. Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:46:16.506999 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:46:16.511330 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:46:16.511330 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:46:16.511330 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:46:16.511330 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:46:16.511330 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:46:16.511330 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6535462e-bca9-4ef4-9185-d7de4cbb03f6 could not be found. Oct 26 13:46:16.511330 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:46:16.513603 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ce66d1aa-3836-45c4-bd79-80849193dcdd tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Returning 404 to user: Instance 6535462e-bca9-4ef4-9185-d7de4cbb03f6 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:46:16.515012 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ce66d1aa-3836-45c4-bd79-80849193dcdd tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] 10.222.0.40 "GET /compute/v2.1/servers/6535462e-bca9-4ef4-9185-d7de4cbb03f6" status: 404 len: 111 microversion: 2.1 time: 0.059648 Oct 26 13:46:16.516107 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3241/6515] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:16 2022] GET /compute/v2.1/servers/6535462e-bca9-4ef4-9185-d7de4cbb03f6 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:46:16.720818 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-65d0cbc7-6c7f-4a46-9876-6f7347ce6917 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-997118736", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "8d76b343-64bc-4d76-b7dc-5af1d9af92fc"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:46:16.795069 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-65d0cbc7-6c7f-4a46-9876-6f7347ce6917 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] validate_networks() for [('8d76b343-64bc-4d76-b7dc-5af1d9af92fc', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:46:17.285900 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-65d0cbc7-6c7f-4a46-9876-6f7347ce6917 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:46:17.286488 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-65d0cbc7-6c7f-4a46-9876-6f7347ce6917 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:46:17.287116 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-65d0cbc7-6c7f-4a46-9876-6f7347ce6917 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:46:17.287694 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-65d0cbc7-6c7f-4a46-9876-6f7347ce6917 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:46:17.288259 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-65d0cbc7-6c7f-4a46-9876-6f7347ce6917 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:46:17.315070 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65d0cbc7-6c7f-4a46-9876-6f7347ce6917 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:17.315574 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65d0cbc7-6c7f-4a46-9876-6f7347ce6917 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:17.316016 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65d0cbc7-6c7f-4a46-9876-6f7347ce6917 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:17.316743 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65d0cbc7-6c7f-4a46-9876-6f7347ce6917 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:17.317201 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65d0cbc7-6c7f-4a46-9876-6f7347ce6917 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:17.317666 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65d0cbc7-6c7f-4a46-9876-6f7347ce6917 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:17.361461 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-65d0cbc7-6c7f-4a46-9876-6f7347ce6917 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Getting quotas for project f6a7679918e944ec85906869a33579ce. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:46:17.376771 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-65d0cbc7-6c7f-4a46-9876-6f7347ce6917 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Getting quotas for user 6d385f50cd7c47f698bb2b1fc69af46a and project f6a7679918e944ec85906869a33579ce. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:46:17.408068 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-65d0cbc7-6c7f-4a46-9876-6f7347ce6917 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:46:17.410440 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-65d0cbc7-6c7f-4a46-9876-6f7347ce6917 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] [instance: b140d740-f9cf-4a73-a163-eee625a828e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:46:17.493959 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-65d0cbc7-6c7f-4a46-9876-6f7347ce6917 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.776347 Oct 26 13:46:17.503476 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3275/6516] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:46:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:46:17.524691 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7291b6df-e393-4f18-b58a-44a9cc65ae46 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:17.526202 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7291b6df-e393-4f18-b58a-44a9cc65ae46 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] [instance: b140d740-f9cf-4a73-a163-eee625a828e9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:17.646726 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7291b6df-e393-4f18-b58a-44a9cc65ae46 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d385f50cd7c47f698bb2b1fc69af46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a7679918e944ec85906869a33579ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:17.659677 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7291b6df-e393-4f18-b58a-44a9cc65ae46 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] 10.222.0.40 "GET /compute/v2.1/servers/b140d740-f9cf-4a73-a163-eee625a828e9" status: 200 len: 1213 microversion: 2.1 time: 0.155028 Oct 26 13:46:17.671194 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3242/6517] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:17 2022] GET /compute/v2.1/servers/b140d740-f9cf-4a73-a163-eee625a828e9 => generated 1213 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:46:18.687131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-be238a0d-6742-421e-868d-fdfb70646cba tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:18.687809 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-be238a0d-6742-421e-868d-fdfb70646cba tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] [instance: b140d740-f9cf-4a73-a163-eee625a828e9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:18.700275 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be238a0d-6742-421e-868d-fdfb70646cba tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:18.701064 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be238a0d-6742-421e-868d-fdfb70646cba tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:18.706078 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be238a0d-6742-421e-868d-fdfb70646cba tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:18.706915 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be238a0d-6742-421e-868d-fdfb70646cba tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:18.707390 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be238a0d-6742-421e-868d-fdfb70646cba tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:18.707909 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be238a0d-6742-421e-868d-fdfb70646cba tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:18.797385 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-be238a0d-6742-421e-868d-fdfb70646cba tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d385f50cd7c47f698bb2b1fc69af46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a7679918e944ec85906869a33579ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:18.810605 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-be238a0d-6742-421e-868d-fdfb70646cba tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] 10.222.0.40 "GET /compute/v2.1/servers/b140d740-f9cf-4a73-a163-eee625a828e9" status: 200 len: 1265 microversion: 2.1 time: 0.127841 Oct 26 13:46:18.811700 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3276/6518] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:18 2022] GET /compute/v2.1/servers/b140d740-f9cf-4a73-a163-eee625a828e9 => generated 1265 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:19.835799 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b22ae831-6ccc-43e6-a240-761c23437c4a tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:19.836308 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b22ae831-6ccc-43e6-a240-761c23437c4a tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] [instance: b140d740-f9cf-4a73-a163-eee625a828e9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:19.849010 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b22ae831-6ccc-43e6-a240-761c23437c4a tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:19.849513 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b22ae831-6ccc-43e6-a240-761c23437c4a tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:19.852666 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b22ae831-6ccc-43e6-a240-761c23437c4a tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:19.853966 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b22ae831-6ccc-43e6-a240-761c23437c4a tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:19.854437 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b22ae831-6ccc-43e6-a240-761c23437c4a tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:19.861916 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b22ae831-6ccc-43e6-a240-761c23437c4a tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:20.121894 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b22ae831-6ccc-43e6-a240-761c23437c4a tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d385f50cd7c47f698bb2b1fc69af46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a7679918e944ec85906869a33579ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:20.130875 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b22ae831-6ccc-43e6-a240-761c23437c4a tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] 10.222.0.40 "GET /compute/v2.1/servers/b140d740-f9cf-4a73-a163-eee625a828e9" status: 200 len: 1313 microversion: 2.1 time: 0.299651 Oct 26 13:46:20.146281 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3243/6519] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:19 2022] GET /compute/v2.1/servers/b140d740-f9cf-4a73-a163-eee625a828e9 => generated 1313 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:20.942472 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-47882201-461f-407f-af1b-1f0ad45bb84b req-bcc32208-92b7-49a6-8139-b9d28df4e2c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b140d740-f9cf-4a73-a163-eee625a828e9", "tag": "50a66ed1-4fca-42f1-930f-5d78c7bffddc"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:46:20.970768 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-47882201-461f-407f-af1b-1f0ad45bb84b req-bcc32208-92b7-49a6-8139-b9d28df4e2c2 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:20.971461 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-47882201-461f-407f-af1b-1f0ad45bb84b req-bcc32208-92b7-49a6-8139-b9d28df4e2c2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:20.972972 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-47882201-461f-407f-af1b-1f0ad45bb84b req-bcc32208-92b7-49a6-8139-b9d28df4e2c2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:20.998771 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-47882201-461f-407f-af1b-1f0ad45bb84b req-bcc32208-92b7-49a6-8139-b9d28df4e2c2 service nova] Creating event network-changed:50a66ed1-4fca-42f1-930f-5d78c7bffddc for instance b140d740-f9cf-4a73-a163-eee625a828e9 on n-h2-862686-1 Oct 26 13:46:21.007364 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-47882201-461f-407f-af1b-1f0ad45bb84b req-bcc32208-92b7-49a6-8139-b9d28df4e2c2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083313 Oct 26 13:46:21.009634 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3277/6520] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:46:21.159130 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-89344eec-7b6a-435d-ab3a-8511707e47d2 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:21.159741 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-89344eec-7b6a-435d-ab3a-8511707e47d2 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] [instance: b140d740-f9cf-4a73-a163-eee625a828e9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:21.171245 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89344eec-7b6a-435d-ab3a-8511707e47d2 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:21.172104 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89344eec-7b6a-435d-ab3a-8511707e47d2 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:21.172706 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89344eec-7b6a-435d-ab3a-8511707e47d2 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:21.173743 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89344eec-7b6a-435d-ab3a-8511707e47d2 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:21.177580 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9707d14f-eaa1-45ec-a1ad-c66a0cd7a4b2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-848253607", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "1acc543b-0823-48ba-8736-48ba858849a2", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "a3a29c91-9973-4a7f-99bf-5b84e6501fd2"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:46:21.178225 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89344eec-7b6a-435d-ab3a-8511707e47d2 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:21.179010 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89344eec-7b6a-435d-ab3a-8511707e47d2 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:21.324381 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-9707d14f-eaa1-45ec-a1ad-c66a0cd7a4b2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] validate_networks() for [('a3a29c91-9973-4a7f-99bf-5b84e6501fd2', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:46:21.522504 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-89344eec-7b6a-435d-ab3a-8511707e47d2 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d385f50cd7c47f698bb2b1fc69af46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a7679918e944ec85906869a33579ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:21.546861 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-89344eec-7b6a-435d-ab3a-8511707e47d2 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] 10.222.0.40 "GET /compute/v2.1/servers/b140d740-f9cf-4a73-a163-eee625a828e9" status: 200 len: 1313 microversion: 2.1 time: 0.391651 Oct 26 13:46:21.550369 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3244/6521] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:21 2022] GET /compute/v2.1/servers/b140d740-f9cf-4a73-a163-eee625a828e9 => generated 1313 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:21.579731 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d2c30517-0655-4e01-9c8b-5f5a1c804761 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:46:21.588459 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d2c30517-0655-4e01-9c8b-5f5a1c804761 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:21.603826 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d2c30517-0655-4e01-9c8b-5f5a1c804761 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:21.604964 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d2c30517-0655-4e01-9c8b-5f5a1c804761 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:21.607181 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d2c30517-0655-4e01-9c8b-5f5a1c804761 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:21.608181 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d2c30517-0655-4e01-9c8b-5f5a1c804761 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:21.609320 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d2c30517-0655-4e01-9c8b-5f5a1c804761 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:21.613924 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d2c30517-0655-4e01-9c8b-5f5a1c804761 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:21.683064 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d2c30517-0655-4e01-9c8b-5f5a1c804761 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "POST /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7/action" status: 200 len: 24572 microversion: 2.1 time: 0.117620 Oct 26 13:46:21.684578 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3245/6522] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:46:21 2022] POST /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7/action => generated 24572 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:46:22.228866 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-9707d14f-eaa1-45ec-a1ad-c66a0cd7a4b2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:46:22.229360 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-9707d14f-eaa1-45ec-a1ad-c66a0cd7a4b2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:46:22.229798 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-9707d14f-eaa1-45ec-a1ad-c66a0cd7a4b2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:46:22.230784 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-9707d14f-eaa1-45ec-a1ad-c66a0cd7a4b2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:46:22.231218 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-9707d14f-eaa1-45ec-a1ad-c66a0cd7a4b2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:46:22.252649 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9707d14f-eaa1-45ec-a1ad-c66a0cd7a4b2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:22.253402 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9707d14f-eaa1-45ec-a1ad-c66a0cd7a4b2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:22.254110 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9707d14f-eaa1-45ec-a1ad-c66a0cd7a4b2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:22.255052 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9707d14f-eaa1-45ec-a1ad-c66a0cd7a4b2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:22.255748 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9707d14f-eaa1-45ec-a1ad-c66a0cd7a4b2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:22.256395 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9707d14f-eaa1-45ec-a1ad-c66a0cd7a4b2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:22.279712 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-9707d14f-eaa1-45ec-a1ad-c66a0cd7a4b2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Getting quotas for project 2a1602330aa340b890bac76a120f74e8. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:46:22.285466 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-9707d14f-eaa1-45ec-a1ad-c66a0cd7a4b2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Getting quotas for user df8b67aae3ea4f17bfa684681311dec5 and project 2a1602330aa340b890bac76a120f74e8. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:46:22.301394 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9707d14f-eaa1-45ec-a1ad-c66a0cd7a4b2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:46:22.303729 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9707d14f-eaa1-45ec-a1ad-c66a0cd7a4b2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: d7c4949c-2a1b-4880-bf18-f5f1115b66de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='1acc543b-0823-48ba-8736-48ba858849a2',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:46:22.412065 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9707d14f-eaa1-45ec-a1ad-c66a0cd7a4b2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.236503 Oct 26 13:46:22.415452 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3278/6523] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:46:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1243 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 26 13:46:22.427487 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ab4e4db1-929d-4506-8818-b1337d0cc07b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:22.428211 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ab4e4db1-929d-4506-8818-b1337d0cc07b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: d7c4949c-2a1b-4880-bf18-f5f1115b66de] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:22.577693 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a3945e3d-6f24-404b-8d6d-2f28e88c2cfb tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:22.578212 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a3945e3d-6f24-404b-8d6d-2f28e88c2cfb tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] [instance: b140d740-f9cf-4a73-a163-eee625a828e9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:22.586123 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a3945e3d-6f24-404b-8d6d-2f28e88c2cfb tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:22.587420 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a3945e3d-6f24-404b-8d6d-2f28e88c2cfb tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:22.587927 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a3945e3d-6f24-404b-8d6d-2f28e88c2cfb tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:22.588671 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a3945e3d-6f24-404b-8d6d-2f28e88c2cfb tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:22.589131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a3945e3d-6f24-404b-8d6d-2f28e88c2cfb tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:22.589600 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a3945e3d-6f24-404b-8d6d-2f28e88c2cfb tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:22.778945 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a3945e3d-6f24-404b-8d6d-2f28e88c2cfb tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d385f50cd7c47f698bb2b1fc69af46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a7679918e944ec85906869a33579ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:22.788111 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a3945e3d-6f24-404b-8d6d-2f28e88c2cfb tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] 10.222.0.40 "GET /compute/v2.1/servers/b140d740-f9cf-4a73-a163-eee625a828e9" status: 200 len: 1313 microversion: 2.1 time: 0.214616 Oct 26 13:46:22.788912 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3279/6524] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:22 2022] GET /compute/v2.1/servers/b140d740-f9cf-4a73-a163-eee625a828e9 => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:46:22.843769 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ab4e4db1-929d-4506-8818-b1337d0cc07b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:22.854829 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ab4e4db1-929d-4506-8818-b1337d0cc07b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de" status: 200 len: 1056 microversion: 2.1 time: 0.431608 Oct 26 13:46:22.855714 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3246/6525] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:22 2022] GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de => generated 1056 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:23.821833 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9d7d54e0-5fac-4065-926b-94a86989422c tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:23.822767 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9d7d54e0-5fac-4065-926b-94a86989422c tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] [instance: b140d740-f9cf-4a73-a163-eee625a828e9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:23.846827 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d7d54e0-5fac-4065-926b-94a86989422c tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:23.847741 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d7d54e0-5fac-4065-926b-94a86989422c tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:23.850022 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d7d54e0-5fac-4065-926b-94a86989422c tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:23.851308 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d7d54e0-5fac-4065-926b-94a86989422c tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:23.855379 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d7d54e0-5fac-4065-926b-94a86989422c tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:23.855379 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d7d54e0-5fac-4065-926b-94a86989422c tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:23.886090 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dfb2e567-446b-443c-9755-7197a890116e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:23.886715 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-dfb2e567-446b-443c-9755-7197a890116e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: d7c4949c-2a1b-4880-bf18-f5f1115b66de] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:23.906693 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dfb2e567-446b-443c-9755-7197a890116e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:23.907326 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dfb2e567-446b-443c-9755-7197a890116e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:23.907809 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dfb2e567-446b-443c-9755-7197a890116e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:23.908574 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dfb2e567-446b-443c-9755-7197a890116e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:23.909041 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dfb2e567-446b-443c-9755-7197a890116e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:23.915065 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dfb2e567-446b-443c-9755-7197a890116e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:24.071202 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-dfb2e567-446b-443c-9755-7197a890116e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:24.080151 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-dfb2e567-446b-443c-9755-7197a890116e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de" status: 200 len: 1116 microversion: 2.1 time: 0.198398 Oct 26 13:46:24.080740 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3247/6526] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:23 2022] GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de => generated 1116 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:24.182837 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9d7d54e0-5fac-4065-926b-94a86989422c tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d385f50cd7c47f698bb2b1fc69af46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a7679918e944ec85906869a33579ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:24.191537 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9d7d54e0-5fac-4065-926b-94a86989422c tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] 10.222.0.40 "GET /compute/v2.1/servers/b140d740-f9cf-4a73-a163-eee625a828e9" status: 200 len: 1313 microversion: 2.1 time: 0.382892 Oct 26 13:46:24.192365 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3280/6527] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:23 2022] GET /compute/v2.1/servers/b140d740-f9cf-4a73-a163-eee625a828e9 => generated 1313 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:25.107064 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-faea6874-ebc4-4feb-9c70-070f84336ea3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:25.107678 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-faea6874-ebc4-4feb-9c70-070f84336ea3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: d7c4949c-2a1b-4880-bf18-f5f1115b66de] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:25.127988 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-faea6874-ebc4-4feb-9c70-070f84336ea3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:25.128780 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-faea6874-ebc4-4feb-9c70-070f84336ea3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:25.129248 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-faea6874-ebc4-4feb-9c70-070f84336ea3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:25.129990 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-faea6874-ebc4-4feb-9c70-070f84336ea3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:25.130456 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-faea6874-ebc4-4feb-9c70-070f84336ea3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:25.130892 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-faea6874-ebc4-4feb-9c70-070f84336ea3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:25.218050 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-572bf8a8-766c-453b-8b57-7d7964f34992 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:25.218790 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-572bf8a8-766c-453b-8b57-7d7964f34992 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] [instance: b140d740-f9cf-4a73-a163-eee625a828e9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:25.230229 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-572bf8a8-766c-453b-8b57-7d7964f34992 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:25.230854 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-572bf8a8-766c-453b-8b57-7d7964f34992 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:25.234797 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-572bf8a8-766c-453b-8b57-7d7964f34992 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:25.235659 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-572bf8a8-766c-453b-8b57-7d7964f34992 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:25.236430 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-572bf8a8-766c-453b-8b57-7d7964f34992 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:25.236964 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-572bf8a8-766c-453b-8b57-7d7964f34992 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:25.310437 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-faea6874-ebc4-4feb-9c70-070f84336ea3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:25.328922 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-faea6874-ebc4-4feb-9c70-070f84336ea3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de" status: 200 len: 1168 microversion: 2.1 time: 0.225607 Oct 26 13:46:25.358465 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3248/6528] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:25 2022] GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de => generated 1168 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:25.588478 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-572bf8a8-766c-453b-8b57-7d7964f34992 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d385f50cd7c47f698bb2b1fc69af46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a7679918e944ec85906869a33579ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:25.597109 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-572bf8a8-766c-453b-8b57-7d7964f34992 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] 10.222.0.40 "GET /compute/v2.1/servers/b140d740-f9cf-4a73-a163-eee625a828e9" status: 200 len: 1313 microversion: 2.1 time: 0.383237 Oct 26 13:46:25.606121 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3281/6529] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:25 2022] GET /compute/v2.1/servers/b140d740-f9cf-4a73-a163-eee625a828e9 => generated 1313 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:25.824602 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-5cbc35b2-ba8b-436c-bc58-0349e6df2684 req-b7355acb-96aa-41f2-a128-2961a040e053 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7c4949c-2a1b-4880-bf18-f5f1115b66de", "tag": "a27c2647-7a0d-4d9e-b310-2c0696574598"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:46:25.844250 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-5cbc35b2-ba8b-436c-bc58-0349e6df2684 req-b7355acb-96aa-41f2-a128-2961a040e053 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:25.844850 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-5cbc35b2-ba8b-436c-bc58-0349e6df2684 req-b7355acb-96aa-41f2-a128-2961a040e053 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:25.845591 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-5cbc35b2-ba8b-436c-bc58-0349e6df2684 req-b7355acb-96aa-41f2-a128-2961a040e053 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:25.874015 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-5cbc35b2-ba8b-436c-bc58-0349e6df2684 req-b7355acb-96aa-41f2-a128-2961a040e053 service nova] Creating event network-changed:a27c2647-7a0d-4d9e-b310-2c0696574598 for instance d7c4949c-2a1b-4880-bf18-f5f1115b66de on n-h1-862686-1 Oct 26 13:46:25.881509 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-5cbc35b2-ba8b-436c-bc58-0349e6df2684 req-b7355acb-96aa-41f2-a128-2961a040e053 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060597 Oct 26 13:46:25.882733 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3249/6530] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:46:26.357298 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7584bb29-53f9-4169-b289-b9cefd35af95 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:26.358784 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7584bb29-53f9-4169-b289-b9cefd35af95 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: d7c4949c-2a1b-4880-bf18-f5f1115b66de] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:26.366592 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7584bb29-53f9-4169-b289-b9cefd35af95 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:26.367438 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7584bb29-53f9-4169-b289-b9cefd35af95 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:26.367842 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7584bb29-53f9-4169-b289-b9cefd35af95 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:26.368776 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7584bb29-53f9-4169-b289-b9cefd35af95 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:26.369237 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7584bb29-53f9-4169-b289-b9cefd35af95 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:26.369691 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7584bb29-53f9-4169-b289-b9cefd35af95 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:26.637717 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e1e2b7a8-7270-4b7f-bd34-41981ae1eb74 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:26.638429 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e1e2b7a8-7270-4b7f-bd34-41981ae1eb74 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] [instance: b140d740-f9cf-4a73-a163-eee625a828e9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:26.645267 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1e2b7a8-7270-4b7f-bd34-41981ae1eb74 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:26.645795 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1e2b7a8-7270-4b7f-bd34-41981ae1eb74 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:26.646239 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1e2b7a8-7270-4b7f-bd34-41981ae1eb74 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:26.646946 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1e2b7a8-7270-4b7f-bd34-41981ae1eb74 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:26.647407 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1e2b7a8-7270-4b7f-bd34-41981ae1eb74 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:26.647838 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1e2b7a8-7270-4b7f-bd34-41981ae1eb74 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:26.657796 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7584bb29-53f9-4169-b289-b9cefd35af95 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:26.667882 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7584bb29-53f9-4169-b289-b9cefd35af95 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de" status: 200 len: 1168 microversion: 2.1 time: 0.314420 Oct 26 13:46:26.669412 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3282/6531] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:26 2022] GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de => generated 1168 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:46:26.815092 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e1e2b7a8-7270-4b7f-bd34-41981ae1eb74 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d385f50cd7c47f698bb2b1fc69af46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a7679918e944ec85906869a33579ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:26.824223 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e1e2b7a8-7270-4b7f-bd34-41981ae1eb74 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] 10.222.0.40 "GET /compute/v2.1/servers/b140d740-f9cf-4a73-a163-eee625a828e9" status: 200 len: 1313 microversion: 2.1 time: 0.192975 Oct 26 13:46:26.825360 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3250/6532] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:26 2022] GET /compute/v2.1/servers/b140d740-f9cf-4a73-a163-eee625a828e9 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:27.695459 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-05818930-f2da-47ef-9cd0-4f9f4fc4a9c5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:27.696613 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-05818930-f2da-47ef-9cd0-4f9f4fc4a9c5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: d7c4949c-2a1b-4880-bf18-f5f1115b66de] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:27.704821 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05818930-f2da-47ef-9cd0-4f9f4fc4a9c5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:27.705314 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05818930-f2da-47ef-9cd0-4f9f4fc4a9c5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:27.705776 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05818930-f2da-47ef-9cd0-4f9f4fc4a9c5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:27.706480 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05818930-f2da-47ef-9cd0-4f9f4fc4a9c5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:27.706939 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05818930-f2da-47ef-9cd0-4f9f4fc4a9c5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:27.707428 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05818930-f2da-47ef-9cd0-4f9f4fc4a9c5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:27.728974 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:46:27.848544 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-98015a85-5a2b-4363-b9b4-475f1bd8ed2c tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:27.853314 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-98015a85-5a2b-4363-b9b4-475f1bd8ed2c tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] [instance: b140d740-f9cf-4a73-a163-eee625a828e9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:27.865645 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-98015a85-5a2b-4363-b9b4-475f1bd8ed2c tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:27.870204 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-98015a85-5a2b-4363-b9b4-475f1bd8ed2c tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:27.870818 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-98015a85-5a2b-4363-b9b4-475f1bd8ed2c tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:27.871988 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-98015a85-5a2b-4363-b9b4-475f1bd8ed2c tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:27.875321 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-98015a85-5a2b-4363-b9b4-475f1bd8ed2c tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:27.876036 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-98015a85-5a2b-4363-b9b4-475f1bd8ed2c tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:27.883939 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-05818930-f2da-47ef-9cd0-4f9f4fc4a9c5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:27.904014 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-05818930-f2da-47ef-9cd0-4f9f4fc4a9c5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de" status: 200 len: 1168 microversion: 2.1 time: 0.215838 Oct 26 13:46:27.909300 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3283/6533] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:27 2022] GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de => generated 1168 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:46:27.990011 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-b6507c85-5107-41ca-82f6-f33de6151de2 req-ed020aa6-71e2-4b9f-8e05-71d93e87f4d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b140d740-f9cf-4a73-a163-eee625a828e9", "name": "network-vif-plugged", "status": "completed", "tag": "50a66ed1-4fca-42f1-930f-5d78c7bffddc"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:46:28.008857 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b6507c85-5107-41ca-82f6-f33de6151de2 req-ed020aa6-71e2-4b9f-8e05-71d93e87f4d1 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:28.010206 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b6507c85-5107-41ca-82f6-f33de6151de2 req-ed020aa6-71e2-4b9f-8e05-71d93e87f4d1 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:28.010206 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b6507c85-5107-41ca-82f6-f33de6151de2 req-ed020aa6-71e2-4b9f-8e05-71d93e87f4d1 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:28.028830 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-b6507c85-5107-41ca-82f6-f33de6151de2 req-ed020aa6-71e2-4b9f-8e05-71d93e87f4d1 service nova] Creating event network-vif-plugged:50a66ed1-4fca-42f1-930f-5d78c7bffddc for instance b140d740-f9cf-4a73-a163-eee625a828e9 on n-h2-862686-1 Oct 26 13:46:28.037126 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-b6507c85-5107-41ca-82f6-f33de6151de2 req-ed020aa6-71e2-4b9f-8e05-71d93e87f4d1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052413 Oct 26 13:46:28.038574 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3284/6534] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:46:28.133000 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-98015a85-5a2b-4363-b9b4-475f1bd8ed2c tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d385f50cd7c47f698bb2b1fc69af46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a7679918e944ec85906869a33579ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:28.141681 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-98015a85-5a2b-4363-b9b4-475f1bd8ed2c tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] 10.222.0.40 "GET /compute/v2.1/servers/b140d740-f9cf-4a73-a163-eee625a828e9" status: 200 len: 1313 microversion: 2.1 time: 0.297365 Oct 26 13:46:28.142792 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3251/6535] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:27 2022] GET /compute/v2.1/servers/b140d740-f9cf-4a73-a163-eee625a828e9 => generated 1313 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:46:28.936139 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-310aea06-fd5f-4473-aeef-fe228a4f59d9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:28.937792 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-310aea06-fd5f-4473-aeef-fe228a4f59d9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: d7c4949c-2a1b-4880-bf18-f5f1115b66de] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:28.940876 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:46:28.947695 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-310aea06-fd5f-4473-aeef-fe228a4f59d9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:28.948523 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-310aea06-fd5f-4473-aeef-fe228a4f59d9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:28.949672 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-310aea06-fd5f-4473-aeef-fe228a4f59d9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:28.950577 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-310aea06-fd5f-4473-aeef-fe228a4f59d9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:28.951044 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-310aea06-fd5f-4473-aeef-fe228a4f59d9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:28.951480 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-310aea06-fd5f-4473-aeef-fe228a4f59d9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:29.142124 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-310aea06-fd5f-4473-aeef-fe228a4f59d9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:29.155039 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-310aea06-fd5f-4473-aeef-fe228a4f59d9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de" status: 200 len: 1168 microversion: 2.1 time: 0.225730 Oct 26 13:46:29.155984 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3285/6536] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:28 2022] GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de => generated 1168 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:29.166545 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-90ff255e-a04f-4fc9-a448-77395681c746 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:29.167667 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-90ff255e-a04f-4fc9-a448-77395681c746 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] [instance: b140d740-f9cf-4a73-a163-eee625a828e9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:29.174522 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90ff255e-a04f-4fc9-a448-77395681c746 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:29.175187 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90ff255e-a04f-4fc9-a448-77395681c746 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:29.175787 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90ff255e-a04f-4fc9-a448-77395681c746 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:29.176984 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90ff255e-a04f-4fc9-a448-77395681c746 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:29.177466 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90ff255e-a04f-4fc9-a448-77395681c746 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:29.177941 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90ff255e-a04f-4fc9-a448-77395681c746 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:29.357267 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-90ff255e-a04f-4fc9-a448-77395681c746 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d385f50cd7c47f698bb2b1fc69af46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a7679918e944ec85906869a33579ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:29.370060 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-90ff255e-a04f-4fc9-a448-77395681c746 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] 10.222.0.40 "GET /compute/v2.1/servers/b140d740-f9cf-4a73-a163-eee625a828e9" status: 200 len: 1313 microversion: 2.1 time: 0.207411 Oct 26 13:46:29.370760 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3252/6537] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:29 2022] GET /compute/v2.1/servers/b140d740-f9cf-4a73-a163-eee625a828e9 => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:30.183154 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-df760589-a7a6-40e3-8369-4a50f01c1824 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:30.183950 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-df760589-a7a6-40e3-8369-4a50f01c1824 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: d7c4949c-2a1b-4880-bf18-f5f1115b66de] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:30.192235 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df760589-a7a6-40e3-8369-4a50f01c1824 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:30.193103 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df760589-a7a6-40e3-8369-4a50f01c1824 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:30.193634 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df760589-a7a6-40e3-8369-4a50f01c1824 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:30.194516 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df760589-a7a6-40e3-8369-4a50f01c1824 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:30.194974 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df760589-a7a6-40e3-8369-4a50f01c1824 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:30.195594 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df760589-a7a6-40e3-8369-4a50f01c1824 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:30.376090 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-df760589-a7a6-40e3-8369-4a50f01c1824 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:30.383979 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-df760589-a7a6-40e3-8369-4a50f01c1824 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de" status: 200 len: 1168 microversion: 2.1 time: 0.205922 Oct 26 13:46:30.384687 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3286/6538] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:30 2022] GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de => generated 1168 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:30.394168 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-eba885b5-5d51-4624-bf06-d440bbdfa219 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:30.395867 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-eba885b5-5d51-4624-bf06-d440bbdfa219 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] [instance: b140d740-f9cf-4a73-a163-eee625a828e9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:30.403913 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eba885b5-5d51-4624-bf06-d440bbdfa219 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:30.404480 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eba885b5-5d51-4624-bf06-d440bbdfa219 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:30.404950 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eba885b5-5d51-4624-bf06-d440bbdfa219 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:30.407031 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eba885b5-5d51-4624-bf06-d440bbdfa219 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:30.407745 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eba885b5-5d51-4624-bf06-d440bbdfa219 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:30.408303 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eba885b5-5d51-4624-bf06-d440bbdfa219 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:30.568208 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-eba885b5-5d51-4624-bf06-d440bbdfa219 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d385f50cd7c47f698bb2b1fc69af46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a7679918e944ec85906869a33579ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:30.577154 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-eba885b5-5d51-4624-bf06-d440bbdfa219 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] 10.222.0.40 "GET /compute/v2.1/servers/b140d740-f9cf-4a73-a163-eee625a828e9" status: 200 len: 1497 microversion: 2.1 time: 0.186972 Oct 26 13:46:30.577988 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3253/6539] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:30 2022] GET /compute/v2.1/servers/b140d740-f9cf-4a73-a163-eee625a828e9 => generated 1497 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:31.106514 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-14485c44-3c2d-4f55-8c8a-c6863e954e2b tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:31.107304 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-14485c44-3c2d-4f55-8c8a-c6863e954e2b tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] [instance: b140d740-f9cf-4a73-a163-eee625a828e9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:31.113445 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-14485c44-3c2d-4f55-8c8a-c6863e954e2b tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:31.115156 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-14485c44-3c2d-4f55-8c8a-c6863e954e2b tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:31.115156 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-14485c44-3c2d-4f55-8c8a-c6863e954e2b tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:31.115156 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-14485c44-3c2d-4f55-8c8a-c6863e954e2b tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:31.115600 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-14485c44-3c2d-4f55-8c8a-c6863e954e2b tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:31.116018 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-14485c44-3c2d-4f55-8c8a-c6863e954e2b tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:31.145604 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-14485c44-3c2d-4f55-8c8a-c6863e954e2b tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] [instance: b140d740-f9cf-4a73-a163-eee625a828e9] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:46:31.228644 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-14485c44-3c2d-4f55-8c8a-c6863e954e2b tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b140d740-f9cf-4a73-a163-eee625a828e9" status: 204 len: 0 microversion: 2.1 time: 0.126593 Oct 26 13:46:31.229394 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3287/6540] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:46:31 2022] DELETE /compute/v2.1/servers/b140d740-f9cf-4a73-a163-eee625a828e9 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:46:31.239561 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-89a107e6-9e29-4968-809e-9cfe30ca632f tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:31.240158 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-89a107e6-9e29-4968-809e-9cfe30ca632f tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] [instance: b140d740-f9cf-4a73-a163-eee625a828e9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:31.244394 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:46:31.248415 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89a107e6-9e29-4968-809e-9cfe30ca632f tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:31.248892 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89a107e6-9e29-4968-809e-9cfe30ca632f tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:31.249318 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89a107e6-9e29-4968-809e-9cfe30ca632f tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:31.250188 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89a107e6-9e29-4968-809e-9cfe30ca632f tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:31.250885 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89a107e6-9e29-4968-809e-9cfe30ca632f tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:31.251312 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89a107e6-9e29-4968-809e-9cfe30ca632f tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:31.391036 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-89a107e6-9e29-4968-809e-9cfe30ca632f tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d385f50cd7c47f698bb2b1fc69af46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a7679918e944ec85906869a33579ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:31.399459 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-89a107e6-9e29-4968-809e-9cfe30ca632f tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] 10.222.0.40 "GET /compute/v2.1/servers/b140d740-f9cf-4a73-a163-eee625a828e9" status: 200 len: 1503 microversion: 2.1 time: 0.165148 Oct 26 13:46:31.401791 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3254/6541] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:31 2022] GET /compute/v2.1/servers/b140d740-f9cf-4a73-a163-eee625a828e9 => generated 1503 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:31.407779 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-93dce411-f977-4918-a57e-818c38f0945a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:31.408482 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-93dce411-f977-4918-a57e-818c38f0945a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: d7c4949c-2a1b-4880-bf18-f5f1115b66de] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:31.421093 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-93dce411-f977-4918-a57e-818c38f0945a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:31.421844 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-93dce411-f977-4918-a57e-818c38f0945a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:31.422168 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-93dce411-f977-4918-a57e-818c38f0945a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:31.422675 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-93dce411-f977-4918-a57e-818c38f0945a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:31.423280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-93dce411-f977-4918-a57e-818c38f0945a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:31.423852 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-93dce411-f977-4918-a57e-818c38f0945a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:31.560844 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-93dce411-f977-4918-a57e-818c38f0945a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:31.568721 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-93dce411-f977-4918-a57e-818c38f0945a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de" status: 200 len: 1168 microversion: 2.1 time: 0.165359 Oct 26 13:46:31.569294 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3288/6542] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:31 2022] GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de => generated 1168 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:32.424334 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8e8ee26a-59e2-4d98-9eaf-7d7c5d4bb970 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:32.425774 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8e8ee26a-59e2-4d98-9eaf-7d7c5d4bb970 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] [instance: b140d740-f9cf-4a73-a163-eee625a828e9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:32.432850 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8e8ee26a-59e2-4d98-9eaf-7d7c5d4bb970 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:32.433449 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8e8ee26a-59e2-4d98-9eaf-7d7c5d4bb970 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:32.434016 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8e8ee26a-59e2-4d98-9eaf-7d7c5d4bb970 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:32.434840 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8e8ee26a-59e2-4d98-9eaf-7d7c5d4bb970 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:32.435295 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8e8ee26a-59e2-4d98-9eaf-7d7c5d4bb970 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:32.435732 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8e8ee26a-59e2-4d98-9eaf-7d7c5d4bb970 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:32.593650 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9853c82a-7d61-4ed1-8195-e1670f1e2f48 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:32.594129 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9853c82a-7d61-4ed1-8195-e1670f1e2f48 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: d7c4949c-2a1b-4880-bf18-f5f1115b66de] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:32.598144 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=4 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:46:32.599464 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=12 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:46:32.605065 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9853c82a-7d61-4ed1-8195-e1670f1e2f48 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:32.606146 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9853c82a-7d61-4ed1-8195-e1670f1e2f48 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:32.606308 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9853c82a-7d61-4ed1-8195-e1670f1e2f48 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:32.606956 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9853c82a-7d61-4ed1-8195-e1670f1e2f48 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:32.607561 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9853c82a-7d61-4ed1-8195-e1670f1e2f48 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:32.608166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9853c82a-7d61-4ed1-8195-e1670f1e2f48 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:32.637977 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8e8ee26a-59e2-4d98-9eaf-7d7c5d4bb970 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d385f50cd7c47f698bb2b1fc69af46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a7679918e944ec85906869a33579ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:32.647260 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8e8ee26a-59e2-4d98-9eaf-7d7c5d4bb970 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] 10.222.0.40 "GET /compute/v2.1/servers/b140d740-f9cf-4a73-a163-eee625a828e9" status: 200 len: 1503 microversion: 2.1 time: 0.226810 Oct 26 13:46:32.653866 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3255/6543] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:32 2022] GET /compute/v2.1/servers/b140d740-f9cf-4a73-a163-eee625a828e9 => generated 1503 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:32.728808 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d4da8975-2e4d-4bcb-b10f-81e126821d72 tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:32.729889 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d4da8975-2e4d-4bcb-b10f-81e126821d72 tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:32.736434 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d4da8975-2e4d-4bcb-b10f-81e126821d72 tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:32.737181 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d4da8975-2e4d-4bcb-b10f-81e126821d72 tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:32.737849 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d4da8975-2e4d-4bcb-b10f-81e126821d72 tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:32.740266 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d4da8975-2e4d-4bcb-b10f-81e126821d72 tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:32.740911 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d4da8975-2e4d-4bcb-b10f-81e126821d72 tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:32.741618 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d4da8975-2e4d-4bcb-b10f-81e126821d72 tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:32.854647 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=4 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:46:32.864932 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9853c82a-7d61-4ed1-8195-e1670f1e2f48 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:32.874247 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9853c82a-7d61-4ed1-8195-e1670f1e2f48 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de" status: 200 len: 1168 microversion: 2.1 time: 0.284807 Oct 26 13:46:32.874840 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3289/6544] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:32 2022] GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de => generated 1168 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:46:32.911506 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d4da8975-2e4d-4bcb-b10f-81e126821d72 tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7" status: 200 len: 1831 microversion: 2.1 time: 0.186603 Oct 26 13:46:32.912119 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3256/6545] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:32 2022] GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 => generated 1831 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:46:32.936362 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-590c7177-4125-495b-81af-67eca74d9d3a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:32.937023 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-590c7177-4125-495b-81af-67eca74d9d3a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:32.943353 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-590c7177-4125-495b-81af-67eca74d9d3a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:32.943841 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-590c7177-4125-495b-81af-67eca74d9d3a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:32.944283 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-590c7177-4125-495b-81af-67eca74d9d3a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:32.944983 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-590c7177-4125-495b-81af-67eca74d9d3a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:32.946203 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-590c7177-4125-495b-81af-67eca74d9d3a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:32.946620 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-590c7177-4125-495b-81af-67eca74d9d3a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:33.155793 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-590c7177-4125-495b-81af-67eca74d9d3a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:33.163661 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-590c7177-4125-495b-81af-67eca74d9d3a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7" status: 200 len: 1680 microversion: 2.1 time: 0.231666 Oct 26 13:46:33.165174 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3290/6546] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:32 2022] GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 => generated 1680 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:33.279137 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cd7ce8f4-ad2f-4509-9187-5038d011d83a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:46:33.281461 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cd7ce8f4-ad2f-4509-9187-5038d011d83a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:33.287656 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cd7ce8f4-ad2f-4509-9187-5038d011d83a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:33.288202 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cd7ce8f4-ad2f-4509-9187-5038d011d83a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:33.288646 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cd7ce8f4-ad2f-4509-9187-5038d011d83a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:33.289918 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cd7ce8f4-ad2f-4509-9187-5038d011d83a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:33.290380 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cd7ce8f4-ad2f-4509-9187-5038d011d83a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:33.291063 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cd7ce8f4-ad2f-4509-9187-5038d011d83a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:33.329329 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-37b1b2a1-476a-439b-9c9e-1f927c2e0f67 req-11ae9675-e1cf-4ce0-ba90-45caeacbfde4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b140d740-f9cf-4a73-a163-eee625a828e9", "name": "network-vif-deleted", "tag": "50a66ed1-4fca-42f1-930f-5d78c7bffddc"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:46:33.338881 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-37b1b2a1-476a-439b-9c9e-1f927c2e0f67 req-11ae9675-e1cf-4ce0-ba90-45caeacbfde4 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:33.339363 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-37b1b2a1-476a-439b-9c9e-1f927c2e0f67 req-11ae9675-e1cf-4ce0-ba90-45caeacbfde4 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:33.339795 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-37b1b2a1-476a-439b-9c9e-1f927c2e0f67 req-11ae9675-e1cf-4ce0-ba90-45caeacbfde4 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:33.346572 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cd7ce8f4-ad2f-4509-9187-5038d011d83a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "POST /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7/action" status: 200 len: 32639 microversion: 2.1 time: 0.071438 Oct 26 13:46:33.347330 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3257/6547] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:46:33 2022] POST /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7/action => generated 32639 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:46:33.352243 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-37b1b2a1-476a-439b-9c9e-1f927c2e0f67 req-11ae9675-e1cf-4ce0-ba90-45caeacbfde4 service nova] Creating event network-vif-deleted:50a66ed1-4fca-42f1-930f-5d78c7bffddc for instance b140d740-f9cf-4a73-a163-eee625a828e9 on n-h2-862686-1 Oct 26 13:46:33.358363 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-37b1b2a1-476a-439b-9c9e-1f927c2e0f67 req-11ae9675-e1cf-4ce0-ba90-45caeacbfde4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032804 Oct 26 13:46:33.358976 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3291/6548] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:46:33.508616 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fa28e45b-83bb-4fbc-9c4e-4ee2ebae0508 tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:46:33.509269 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fa28e45b-83bb-4fbc-9c4e-4ee2ebae0508 tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:33.517432 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa28e45b-83bb-4fbc-9c4e-4ee2ebae0508 tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:33.517945 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa28e45b-83bb-4fbc-9c4e-4ee2ebae0508 tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:33.518471 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa28e45b-83bb-4fbc-9c4e-4ee2ebae0508 tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:33.519159 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa28e45b-83bb-4fbc-9c4e-4ee2ebae0508 tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:33.519610 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa28e45b-83bb-4fbc-9c4e-4ee2ebae0508 tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:33.520033 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa28e45b-83bb-4fbc-9c4e-4ee2ebae0508 tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:33.538089 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:46:33.551997 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fa28e45b-83bb-4fbc-9c4e-4ee2ebae0508 tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd26bd347f4044fe1b4c01c28436d7f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ff981f6bd24b90b2980babf75b5194', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:33.552561 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fa28e45b-83bb-4fbc-9c4e-4ee2ebae0508 tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] flavor_id is None. Assuming migration. {{(pid=120597) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 26 13:46:33.552996 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fa28e45b-83bb-4fbc-9c4e-4ee2ebae0508 tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120597) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 26 13:46:33.667438 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fa28e45b-83bb-4fbc-9c4e-4ee2ebae0508 tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7/action" status: 202 len: 0 microversion: 2.1 time: 0.163459 Oct 26 13:46:33.668076 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3258/6549] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:46:33 2022] POST /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:46:33.677883 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-eb94eb6f-4177-4e95-890a-c3219d82c9a5 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:33.678711 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-eb94eb6f-4177-4e95-890a-c3219d82c9a5 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:33.679073 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-96f76109-0f37-428d-a572-136f604b0a05 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:33.679846 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-96f76109-0f37-428d-a572-136f604b0a05 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] [instance: b140d740-f9cf-4a73-a163-eee625a828e9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:33.686124 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96f76109-0f37-428d-a572-136f604b0a05 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:33.686393 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb94eb6f-4177-4e95-890a-c3219d82c9a5 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:33.686497 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96f76109-0f37-428d-a572-136f604b0a05 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:33.686803 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb94eb6f-4177-4e95-890a-c3219d82c9a5 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:33.686912 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96f76109-0f37-428d-a572-136f604b0a05 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:33.687242 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb94eb6f-4177-4e95-890a-c3219d82c9a5 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:33.687613 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96f76109-0f37-428d-a572-136f604b0a05 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:33.688109 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb94eb6f-4177-4e95-890a-c3219d82c9a5 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:33.688226 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96f76109-0f37-428d-a572-136f604b0a05 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:33.688571 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb94eb6f-4177-4e95-890a-c3219d82c9a5 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:33.688730 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96f76109-0f37-428d-a572-136f604b0a05 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:33.689008 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb94eb6f-4177-4e95-890a-c3219d82c9a5 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:33.729222 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96f76109-0f37-428d-a572-136f604b0a05 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:33.729871 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96f76109-0f37-428d-a572-136f604b0a05 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:33.730319 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96f76109-0f37-428d-a572-136f604b0a05 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:33.730774 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-96f76109-0f37-428d-a572-136f604b0a05 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lazy-loading 'fault' on Instance uuid b140d740-f9cf-4a73-a163-eee625a828e9 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:46:33.776548 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-96f76109-0f37-428d-a572-136f604b0a05 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d385f50cd7c47f698bb2b1fc69af46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a7679918e944ec85906869a33579ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:33.784797 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-96f76109-0f37-428d-a572-136f604b0a05 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] 10.222.0.40 "GET /compute/v2.1/servers/b140d740-f9cf-4a73-a163-eee625a828e9" status: 200 len: 1303 microversion: 2.1 time: 0.109370 Oct 26 13:46:33.788094 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3259/6550] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:33 2022] GET /compute/v2.1/servers/b140d740-f9cf-4a73-a163-eee625a828e9 => generated 1303 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:46:33.893609 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-eb94eb6f-4177-4e95-890a-c3219d82c9a5 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:33.899322 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a4a6bbf8-f243-41a9-b6f3-9043f4322aa6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:33.900048 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a4a6bbf8-f243-41a9-b6f3-9043f4322aa6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: d7c4949c-2a1b-4880-bf18-f5f1115b66de] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:33.907112 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4a6bbf8-f243-41a9-b6f3-9043f4322aa6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:33.907286 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-eb94eb6f-4177-4e95-890a-c3219d82c9a5 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7" status: 200 len: 1689 microversion: 2.1 time: 0.234427 Oct 26 13:46:33.907995 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4a6bbf8-f243-41a9-b6f3-9043f4322aa6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:33.909582 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4a6bbf8-f243-41a9-b6f3-9043f4322aa6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:33.910299 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4a6bbf8-f243-41a9-b6f3-9043f4322aa6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:33.910899 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4a6bbf8-f243-41a9-b6f3-9043f4322aa6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:33.911644 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4a6bbf8-f243-41a9-b6f3-9043f4322aa6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:33.925056 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3292/6551] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:33 2022] GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 => generated 1689 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:46:34.094496 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a4a6bbf8-f243-41a9-b6f3-9043f4322aa6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:34.103153 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a4a6bbf8-f243-41a9-b6f3-9043f4322aa6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de" status: 200 len: 1168 microversion: 2.1 time: 0.209744 Oct 26 13:46:34.103758 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3260/6552] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:33 2022] GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de => generated 1168 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:34.812228 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9e7779ca-1a05-4858-8ba4-1390f27a0c28 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:34.812842 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9e7779ca-1a05-4858-8ba4-1390f27a0c28 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] [instance: b140d740-f9cf-4a73-a163-eee625a828e9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:34.819895 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e7779ca-1a05-4858-8ba4-1390f27a0c28 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:34.820900 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e7779ca-1a05-4858-8ba4-1390f27a0c28 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:34.821432 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e7779ca-1a05-4858-8ba4-1390f27a0c28 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:34.822159 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e7779ca-1a05-4858-8ba4-1390f27a0c28 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:34.822616 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e7779ca-1a05-4858-8ba4-1390f27a0c28 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:34.823067 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e7779ca-1a05-4858-8ba4-1390f27a0c28 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:34.837327 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-9e7779ca-1a05-4858-8ba4-1390f27a0c28 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] HTTP exception thrown: Instance b140d740-f9cf-4a73-a163-eee625a828e9 could not be found. Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9e7779ca-1a05-4858-8ba4-1390f27a0c28 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Request method failure captured: Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/b140d740-f9cf-4a73-a163-eee625a828e9 HTTP/1.1 Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWToTREHg5BYdoquq6SsMtPkx7s1tNKwfvEE1fYIn-X8gpMyIM06jPmU5OQK2MLGsDvv5nn675U11fe1pUCZ9NumLqmjRtNImpzL_5alRtFq3l4yMBWRwvL7fbCf8BIHm3Ah6JDOypikRpfAVqhNLTUZmuQogRl4bweY_Rw53c3uhTi8 Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: f6a7679918e944ec85906869a33579ce Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-VolumesActionsTest-2047937803 Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f6a7679918e944ec85906869a33579ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f6a7679918e944ec85906869a33579ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f6a7679918e944ec85906869a33579ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f6a7679918e944ec85906869a33579ce"}]}] Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-VolumesActionsTest-2047937803 Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: f6a7679918e944ec85906869a33579ce Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-VolumesActionsTest-2047937803 Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-VolumesActionsTest-2047937803-project Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 6d385f50cd7c47f698bb2b1fc69af46a Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-VolumesActionsTest-2047937803-project Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance b140d740-f9cf-4a73-a163-eee625a828e9 could not be found. Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'b140d740-f9cf-4a73-a163-eee625a828e9'} Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b140d740-f9cf-4a73-a163-eee625a828e9 could not be found. Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b140d740-f9cf-4a73-a163-eee625a828e9 could not be found. Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:46:34.839021 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:46:34.842495 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:46:34.842495 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:46:34.842495 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:46:34.842495 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:46:34.842495 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:46:34.842495 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b140d740-f9cf-4a73-a163-eee625a828e9 could not be found. Oct 26 13:46:34.842495 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:46:34.842495 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9e7779ca-1a05-4858-8ba4-1390f27a0c28 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] Returning 404 to user: Instance b140d740-f9cf-4a73-a163-eee625a828e9 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:46:34.842495 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9e7779ca-1a05-4858-8ba4-1390f27a0c28 tempest-VolumesActionsTest-2047937803 tempest-VolumesActionsTest-2047937803-project] 10.222.0.40 "GET /compute/v2.1/servers/b140d740-f9cf-4a73-a163-eee625a828e9" status: 404 len: 111 microversion: 2.1 time: 0.032065 Oct 26 13:46:34.842495 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3293/6553] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:34 2022] GET /compute/v2.1/servers/b140d740-f9cf-4a73-a163-eee625a828e9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:46:34.944968 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-25d442a6-5d06-42f3-a0d4-e18c7c956624 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:34.944968 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-25d442a6-5d06-42f3-a0d4-e18c7c956624 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:34.944968 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-25d442a6-5d06-42f3-a0d4-e18c7c956624 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:34.944968 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-25d442a6-5d06-42f3-a0d4-e18c7c956624 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:34.944968 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-25d442a6-5d06-42f3-a0d4-e18c7c956624 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:34.944968 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-25d442a6-5d06-42f3-a0d4-e18c7c956624 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:34.944968 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-25d442a6-5d06-42f3-a0d4-e18c7c956624 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:34.944968 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-25d442a6-5d06-42f3-a0d4-e18c7c956624 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:35.100825 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-25d442a6-5d06-42f3-a0d4-e18c7c956624 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:35.122967 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-25d442a6-5d06-42f3-a0d4-e18c7c956624 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7" status: 200 len: 1689 microversion: 2.1 time: 0.194505 Oct 26 13:46:35.123984 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3261/6554] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:34 2022] GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 => generated 1689 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:35.128882 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-63ffafdf-0f92-4798-a208-7d6f32a9598d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:35.130026 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-63ffafdf-0f92-4798-a208-7d6f32a9598d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: d7c4949c-2a1b-4880-bf18-f5f1115b66de] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:35.138184 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63ffafdf-0f92-4798-a208-7d6f32a9598d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:35.139016 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63ffafdf-0f92-4798-a208-7d6f32a9598d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:35.139670 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63ffafdf-0f92-4798-a208-7d6f32a9598d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:35.141345 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63ffafdf-0f92-4798-a208-7d6f32a9598d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:35.141837 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63ffafdf-0f92-4798-a208-7d6f32a9598d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:35.142267 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63ffafdf-0f92-4798-a208-7d6f32a9598d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:35.410201 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-63ffafdf-0f92-4798-a208-7d6f32a9598d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:35.427773 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-63ffafdf-0f92-4798-a208-7d6f32a9598d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de" status: 200 len: 1168 microversion: 2.1 time: 0.304783 Oct 26 13:46:35.428999 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3294/6555] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:35 2022] GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de => generated 1168 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:36.147880 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3e9aa581-670d-4b56-bd36-03137fe6315b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:36.148578 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3e9aa581-670d-4b56-bd36-03137fe6315b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:36.155923 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3e9aa581-670d-4b56-bd36-03137fe6315b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:36.156441 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3e9aa581-670d-4b56-bd36-03137fe6315b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:36.156886 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3e9aa581-670d-4b56-bd36-03137fe6315b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:36.157625 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3e9aa581-670d-4b56-bd36-03137fe6315b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:36.158079 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3e9aa581-670d-4b56-bd36-03137fe6315b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:36.158503 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3e9aa581-670d-4b56-bd36-03137fe6315b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:36.311725 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3e9aa581-670d-4b56-bd36-03137fe6315b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:36.322673 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3e9aa581-670d-4b56-bd36-03137fe6315b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7" status: 200 len: 1694 microversion: 2.1 time: 0.178498 Oct 26 13:46:36.323538 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3262/6556] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:36 2022] GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 => generated 1694 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:36.451539 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c9bc668c-9cfe-41fa-b0aa-e7895bc6b312 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:36.452154 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c9bc668c-9cfe-41fa-b0aa-e7895bc6b312 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: d7c4949c-2a1b-4880-bf18-f5f1115b66de] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:36.461177 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9bc668c-9cfe-41fa-b0aa-e7895bc6b312 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:36.462048 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9bc668c-9cfe-41fa-b0aa-e7895bc6b312 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:36.462488 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9bc668c-9cfe-41fa-b0aa-e7895bc6b312 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:36.463359 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9bc668c-9cfe-41fa-b0aa-e7895bc6b312 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:36.463826 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9bc668c-9cfe-41fa-b0aa-e7895bc6b312 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:36.464254 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9bc668c-9cfe-41fa-b0aa-e7895bc6b312 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:36.616328 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c9bc668c-9cfe-41fa-b0aa-e7895bc6b312 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:36.625667 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c9bc668c-9cfe-41fa-b0aa-e7895bc6b312 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de" status: 200 len: 1168 microversion: 2.1 time: 0.177940 Oct 26 13:46:36.626813 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3295/6557] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:36 2022] GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de => generated 1168 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:37.347479 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d3e17a17-2896-4913-9882-050464e02e47 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:37.348637 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d3e17a17-2896-4913-9882-050464e02e47 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:37.359480 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d3e17a17-2896-4913-9882-050464e02e47 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:37.360300 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d3e17a17-2896-4913-9882-050464e02e47 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:37.361030 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d3e17a17-2896-4913-9882-050464e02e47 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:37.361984 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d3e17a17-2896-4913-9882-050464e02e47 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:37.362650 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d3e17a17-2896-4913-9882-050464e02e47 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:37.363235 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d3e17a17-2896-4913-9882-050464e02e47 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:37.582040 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d3e17a17-2896-4913-9882-050464e02e47 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:37.596086 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d3e17a17-2896-4913-9882-050464e02e47 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7" status: 200 len: 1694 microversion: 2.1 time: 0.252566 Oct 26 13:46:37.597310 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3263/6558] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:37 2022] GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 => generated 1694 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:37.653140 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-eb4f4bd7-2fc2-46d9-8f62-a795c6b4c614 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:37.654349 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-eb4f4bd7-2fc2-46d9-8f62-a795c6b4c614 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: d7c4949c-2a1b-4880-bf18-f5f1115b66de] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:37.663342 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb4f4bd7-2fc2-46d9-8f62-a795c6b4c614 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:37.664695 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb4f4bd7-2fc2-46d9-8f62-a795c6b4c614 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:37.665142 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb4f4bd7-2fc2-46d9-8f62-a795c6b4c614 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:37.668374 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb4f4bd7-2fc2-46d9-8f62-a795c6b4c614 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:37.669452 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb4f4bd7-2fc2-46d9-8f62-a795c6b4c614 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:37.671707 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb4f4bd7-2fc2-46d9-8f62-a795c6b4c614 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:37.917160 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-eb4f4bd7-2fc2-46d9-8f62-a795c6b4c614 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:37.926304 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-eb4f4bd7-2fc2-46d9-8f62-a795c6b4c614 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de" status: 200 len: 1168 microversion: 2.1 time: 0.277879 Oct 26 13:46:37.927216 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3296/6559] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:37 2022] GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de => generated 1168 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:38.624396 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-79ab11d2-7e25-442a-92eb-8aaa90183ec6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:38.625699 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-79ab11d2-7e25-442a-92eb-8aaa90183ec6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:38.636091 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-79ab11d2-7e25-442a-92eb-8aaa90183ec6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:38.636610 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-79ab11d2-7e25-442a-92eb-8aaa90183ec6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:38.637443 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-79ab11d2-7e25-442a-92eb-8aaa90183ec6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:38.641223 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-79ab11d2-7e25-442a-92eb-8aaa90183ec6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:38.641763 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-79ab11d2-7e25-442a-92eb-8aaa90183ec6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:38.643805 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-79ab11d2-7e25-442a-92eb-8aaa90183ec6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:38.852180 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-79ab11d2-7e25-442a-92eb-8aaa90183ec6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:38.863911 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-79ab11d2-7e25-442a-92eb-8aaa90183ec6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7" status: 200 len: 1694 microversion: 2.1 time: 0.242960 Oct 26 13:46:38.864749 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3264/6560] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:38 2022] GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 => generated 1694 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:38.950893 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-163901a0-2c42-4f62-8fd4-40fbae896a4a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:38.952080 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-163901a0-2c42-4f62-8fd4-40fbae896a4a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: d7c4949c-2a1b-4880-bf18-f5f1115b66de] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:38.959399 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-163901a0-2c42-4f62-8fd4-40fbae896a4a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:38.960078 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-163901a0-2c42-4f62-8fd4-40fbae896a4a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:38.960812 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-163901a0-2c42-4f62-8fd4-40fbae896a4a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:38.961708 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-163901a0-2c42-4f62-8fd4-40fbae896a4a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:38.962315 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-163901a0-2c42-4f62-8fd4-40fbae896a4a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:38.962896 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-163901a0-2c42-4f62-8fd4-40fbae896a4a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:39.181856 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-163901a0-2c42-4f62-8fd4-40fbae896a4a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:39.193312 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-163901a0-2c42-4f62-8fd4-40fbae896a4a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de" status: 200 len: 1168 microversion: 2.1 time: 0.246079 Oct 26 13:46:39.194608 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3297/6561] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:38 2022] GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de => generated 1168 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:39.888300 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a5bf013d-e184-46f1-b631-e5d4b8a4201e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:39.888970 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a5bf013d-e184-46f1-b631-e5d4b8a4201e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:39.895698 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5bf013d-e184-46f1-b631-e5d4b8a4201e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:39.896192 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5bf013d-e184-46f1-b631-e5d4b8a4201e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:39.896637 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5bf013d-e184-46f1-b631-e5d4b8a4201e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:39.897553 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5bf013d-e184-46f1-b631-e5d4b8a4201e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:39.898875 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5bf013d-e184-46f1-b631-e5d4b8a4201e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:39.899506 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5bf013d-e184-46f1-b631-e5d4b8a4201e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:40.049595 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a5bf013d-e184-46f1-b631-e5d4b8a4201e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:40.057592 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a5bf013d-e184-46f1-b631-e5d4b8a4201e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7" status: 200 len: 1694 microversion: 2.1 time: 0.173385 Oct 26 13:46:40.070160 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3265/6562] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:39 2022] GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 => generated 1694 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:40.218636 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a1bd390c-7b21-42ac-b026-8ee018992e6c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:40.219372 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a1bd390c-7b21-42ac-b026-8ee018992e6c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: d7c4949c-2a1b-4880-bf18-f5f1115b66de] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:40.226777 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a1bd390c-7b21-42ac-b026-8ee018992e6c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:40.227502 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a1bd390c-7b21-42ac-b026-8ee018992e6c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:40.228151 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a1bd390c-7b21-42ac-b026-8ee018992e6c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:40.229010 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a1bd390c-7b21-42ac-b026-8ee018992e6c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:40.229639 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a1bd390c-7b21-42ac-b026-8ee018992e6c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:40.230295 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a1bd390c-7b21-42ac-b026-8ee018992e6c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:40.384766 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a1bd390c-7b21-42ac-b026-8ee018992e6c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:40.394241 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a1bd390c-7b21-42ac-b026-8ee018992e6c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de" status: 200 len: 1202 microversion: 2.1 time: 0.179396 Oct 26 13:46:40.395056 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3298/6563] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:40 2022] GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de => generated 1202 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:41.083122 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-491630ca-c257-4780-b1fc-3c5de97ab841 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:41.083846 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-491630ca-c257-4780-b1fc-3c5de97ab841 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:41.091706 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-491630ca-c257-4780-b1fc-3c5de97ab841 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:41.092199 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-491630ca-c257-4780-b1fc-3c5de97ab841 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:41.092643 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-491630ca-c257-4780-b1fc-3c5de97ab841 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:41.093414 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-491630ca-c257-4780-b1fc-3c5de97ab841 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:41.093900 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-491630ca-c257-4780-b1fc-3c5de97ab841 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:41.094330 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-491630ca-c257-4780-b1fc-3c5de97ab841 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:41.267287 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-491630ca-c257-4780-b1fc-3c5de97ab841 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:41.278683 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-491630ca-c257-4780-b1fc-3c5de97ab841 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7" status: 200 len: 1694 microversion: 2.1 time: 0.199473 Oct 26 13:46:41.279367 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3266/6564] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:41 2022] GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 => generated 1694 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:41.418572 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1e59bd20-9e93-4c05-94cd-708845398364 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:41.419177 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1e59bd20-9e93-4c05-94cd-708845398364 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: d7c4949c-2a1b-4880-bf18-f5f1115b66de] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:41.426432 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1e59bd20-9e93-4c05-94cd-708845398364 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:41.426922 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1e59bd20-9e93-4c05-94cd-708845398364 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:41.427354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1e59bd20-9e93-4c05-94cd-708845398364 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:41.428056 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1e59bd20-9e93-4c05-94cd-708845398364 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:41.428505 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1e59bd20-9e93-4c05-94cd-708845398364 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:41.428986 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1e59bd20-9e93-4c05-94cd-708845398364 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:41.575979 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1e59bd20-9e93-4c05-94cd-708845398364 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:41.586337 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1e59bd20-9e93-4c05-94cd-708845398364 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de" status: 200 len: 1202 microversion: 2.1 time: 0.170892 Oct 26 13:46:41.587123 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3299/6565] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:41 2022] GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de => generated 1202 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:42.307129 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c23bde19-02eb-462a-ad29-49042e271c5d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:42.307921 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c23bde19-02eb-462a-ad29-49042e271c5d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:42.315365 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c23bde19-02eb-462a-ad29-49042e271c5d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:42.315858 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c23bde19-02eb-462a-ad29-49042e271c5d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:42.316301 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c23bde19-02eb-462a-ad29-49042e271c5d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:42.317004 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c23bde19-02eb-462a-ad29-49042e271c5d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:42.317465 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c23bde19-02eb-462a-ad29-49042e271c5d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:42.317923 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c23bde19-02eb-462a-ad29-49042e271c5d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:42.463524 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c23bde19-02eb-462a-ad29-49042e271c5d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:42.472902 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c23bde19-02eb-462a-ad29-49042e271c5d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7" status: 200 len: 1694 microversion: 2.1 time: 0.170206 Oct 26 13:46:42.473709 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3267/6566] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:42 2022] GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 => generated 1694 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:42.612527 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1491b6cb-2427-4b5b-a915-84ac32d3a0d9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:42.613080 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1491b6cb-2427-4b5b-a915-84ac32d3a0d9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: d7c4949c-2a1b-4880-bf18-f5f1115b66de] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:42.621993 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1491b6cb-2427-4b5b-a915-84ac32d3a0d9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:42.629167 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1491b6cb-2427-4b5b-a915-84ac32d3a0d9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:42.629685 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1491b6cb-2427-4b5b-a915-84ac32d3a0d9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:42.630439 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1491b6cb-2427-4b5b-a915-84ac32d3a0d9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:42.630918 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1491b6cb-2427-4b5b-a915-84ac32d3a0d9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:42.631352 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1491b6cb-2427-4b5b-a915-84ac32d3a0d9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:42.662998 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:46:42.789935 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1491b6cb-2427-4b5b-a915-84ac32d3a0d9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:42.798558 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1491b6cb-2427-4b5b-a915-84ac32d3a0d9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de" status: 200 len: 1202 microversion: 2.1 time: 0.189939 Oct 26 13:46:42.799183 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3300/6567] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:42 2022] GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de => generated 1202 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:43.497849 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b9103300-e48a-461c-8b1f-5ccf04ea71bc tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:43.499181 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b9103300-e48a-461c-8b1f-5ccf04ea71bc tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:43.507994 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b9103300-e48a-461c-8b1f-5ccf04ea71bc tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:43.508847 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b9103300-e48a-461c-8b1f-5ccf04ea71bc tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:43.509387 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b9103300-e48a-461c-8b1f-5ccf04ea71bc tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:43.510391 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b9103300-e48a-461c-8b1f-5ccf04ea71bc tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:43.510914 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b9103300-e48a-461c-8b1f-5ccf04ea71bc tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:43.511412 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b9103300-e48a-461c-8b1f-5ccf04ea71bc tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:43.689804 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b9103300-e48a-461c-8b1f-5ccf04ea71bc tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:43.700345 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b9103300-e48a-461c-8b1f-5ccf04ea71bc tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7" status: 200 len: 1694 microversion: 2.1 time: 0.207317 Oct 26 13:46:43.700964 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3268/6568] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:43 2022] GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 => generated 1694 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:43.823428 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-332f9d8b-604c-4d5a-9116-ab9bb8289134 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:43.824128 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-332f9d8b-604c-4d5a-9116-ab9bb8289134 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: d7c4949c-2a1b-4880-bf18-f5f1115b66de] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:43.831983 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-332f9d8b-604c-4d5a-9116-ab9bb8289134 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:43.832636 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-332f9d8b-604c-4d5a-9116-ab9bb8289134 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:43.833082 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-332f9d8b-604c-4d5a-9116-ab9bb8289134 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:43.833811 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-332f9d8b-604c-4d5a-9116-ab9bb8289134 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:43.834572 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-332f9d8b-604c-4d5a-9116-ab9bb8289134 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:43.836405 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-332f9d8b-604c-4d5a-9116-ab9bb8289134 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:44.011476 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-332f9d8b-604c-4d5a-9116-ab9bb8289134 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:44.020945 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-332f9d8b-604c-4d5a-9116-ab9bb8289134 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de" status: 200 len: 1202 microversion: 2.1 time: 0.202874 Oct 26 13:46:44.021879 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3301/6569] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:43 2022] GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de => generated 1202 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:44.724655 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-183989ab-f145-4f7a-931a-4565c5f4b8d3 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:44.725515 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-183989ab-f145-4f7a-931a-4565c5f4b8d3 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:44.734135 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-183989ab-f145-4f7a-931a-4565c5f4b8d3 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:44.735158 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-183989ab-f145-4f7a-931a-4565c5f4b8d3 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:44.735825 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-183989ab-f145-4f7a-931a-4565c5f4b8d3 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:44.736903 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-183989ab-f145-4f7a-931a-4565c5f4b8d3 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:44.737610 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-183989ab-f145-4f7a-931a-4565c5f4b8d3 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:44.738247 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-183989ab-f145-4f7a-931a-4565c5f4b8d3 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:44.900814 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-183989ab-f145-4f7a-931a-4565c5f4b8d3 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:44.909197 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-183989ab-f145-4f7a-931a-4565c5f4b8d3 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7" status: 200 len: 1694 microversion: 2.1 time: 0.188834 Oct 26 13:46:44.910562 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3269/6570] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:44 2022] GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 => generated 1694 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:45.049253 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e90d4079-06ae-4be8-b03c-81d22e39452d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:45.049950 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e90d4079-06ae-4be8-b03c-81d22e39452d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: d7c4949c-2a1b-4880-bf18-f5f1115b66de] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:45.070362 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e90d4079-06ae-4be8-b03c-81d22e39452d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:45.070945 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e90d4079-06ae-4be8-b03c-81d22e39452d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:45.071309 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e90d4079-06ae-4be8-b03c-81d22e39452d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:45.072498 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e90d4079-06ae-4be8-b03c-81d22e39452d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:45.075457 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e90d4079-06ae-4be8-b03c-81d22e39452d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:45.075925 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e90d4079-06ae-4be8-b03c-81d22e39452d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:45.320723 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e90d4079-06ae-4be8-b03c-81d22e39452d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:45.330758 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e90d4079-06ae-4be8-b03c-81d22e39452d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de" status: 200 len: 1202 microversion: 2.1 time: 0.289916 Oct 26 13:46:45.341542 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3302/6571] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:45 2022] GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de => generated 1202 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:45.937557 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e91fe189-e3b2-44d9-bd66-77b5c6529644 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:45.939453 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e91fe189-e3b2-44d9-bd66-77b5c6529644 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:45.952466 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e91fe189-e3b2-44d9-bd66-77b5c6529644 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:45.952967 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e91fe189-e3b2-44d9-bd66-77b5c6529644 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:45.954678 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e91fe189-e3b2-44d9-bd66-77b5c6529644 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:45.956344 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e91fe189-e3b2-44d9-bd66-77b5c6529644 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:45.957524 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e91fe189-e3b2-44d9-bd66-77b5c6529644 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:45.958606 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e91fe189-e3b2-44d9-bd66-77b5c6529644 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:46.138814 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e91fe189-e3b2-44d9-bd66-77b5c6529644 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:46.148026 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e91fe189-e3b2-44d9-bd66-77b5c6529644 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7" status: 200 len: 1694 microversion: 2.1 time: 0.217391 Oct 26 13:46:46.158372 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3270/6572] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:45 2022] GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 => generated 1694 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:46.365251 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f196387c-e7d7-4237-bd41-316ad407f435 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:46.365899 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f196387c-e7d7-4237-bd41-316ad407f435 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: d7c4949c-2a1b-4880-bf18-f5f1115b66de] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:46.373979 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f196387c-e7d7-4237-bd41-316ad407f435 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:46.374737 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f196387c-e7d7-4237-bd41-316ad407f435 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:46.375371 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f196387c-e7d7-4237-bd41-316ad407f435 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:46.376287 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f196387c-e7d7-4237-bd41-316ad407f435 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:46.376745 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f196387c-e7d7-4237-bd41-316ad407f435 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:46.377376 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f196387c-e7d7-4237-bd41-316ad407f435 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:46.543709 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f196387c-e7d7-4237-bd41-316ad407f435 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:46.555113 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f196387c-e7d7-4237-bd41-316ad407f435 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de" status: 200 len: 1202 microversion: 2.1 time: 0.194557 Oct 26 13:46:46.571756 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3303/6573] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:46 2022] GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de => generated 1202 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:47.172357 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-72fcad89-90cb-4b09-b415-e833c8c5e73f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:47.172997 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-72fcad89-90cb-4b09-b415-e833c8c5e73f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:47.180687 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-72fcad89-90cb-4b09-b415-e833c8c5e73f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:47.181191 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-72fcad89-90cb-4b09-b415-e833c8c5e73f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:47.181683 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-72fcad89-90cb-4b09-b415-e833c8c5e73f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:47.184492 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-72fcad89-90cb-4b09-b415-e833c8c5e73f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:47.185004 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-72fcad89-90cb-4b09-b415-e833c8c5e73f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:47.185437 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-72fcad89-90cb-4b09-b415-e833c8c5e73f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:47.341834 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-72fcad89-90cb-4b09-b415-e833c8c5e73f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:47.350462 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-72fcad89-90cb-4b09-b415-e833c8c5e73f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7" status: 200 len: 1694 microversion: 2.1 time: 0.181917 Oct 26 13:46:47.351683 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3271/6574] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:47 2022] GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 => generated 1694 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:47.580672 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-878e532c-dd85-49f9-936a-8c730b8da17f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:47.581418 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-878e532c-dd85-49f9-936a-8c730b8da17f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: d7c4949c-2a1b-4880-bf18-f5f1115b66de] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:47.589818 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-878e532c-dd85-49f9-936a-8c730b8da17f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:47.590739 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-878e532c-dd85-49f9-936a-8c730b8da17f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:47.591354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-878e532c-dd85-49f9-936a-8c730b8da17f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:47.592068 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-878e532c-dd85-49f9-936a-8c730b8da17f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:47.592538 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-878e532c-dd85-49f9-936a-8c730b8da17f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:47.595276 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-878e532c-dd85-49f9-936a-8c730b8da17f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:47.747811 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-878e532c-dd85-49f9-936a-8c730b8da17f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:47.755964 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-878e532c-dd85-49f9-936a-8c730b8da17f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de" status: 200 len: 1202 microversion: 2.1 time: 0.179555 Oct 26 13:46:47.763559 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3304/6575] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:47 2022] GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de => generated 1202 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:48.374434 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a931ba96-a74f-4e7d-8e24-789e0ccdbca9 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:48.375597 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a931ba96-a74f-4e7d-8e24-789e0ccdbca9 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:48.383748 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a931ba96-a74f-4e7d-8e24-789e0ccdbca9 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:48.384969 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a931ba96-a74f-4e7d-8e24-789e0ccdbca9 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:48.385632 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a931ba96-a74f-4e7d-8e24-789e0ccdbca9 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:48.386509 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a931ba96-a74f-4e7d-8e24-789e0ccdbca9 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:48.387113 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a931ba96-a74f-4e7d-8e24-789e0ccdbca9 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:48.387690 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a931ba96-a74f-4e7d-8e24-789e0ccdbca9 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:48.573395 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a931ba96-a74f-4e7d-8e24-789e0ccdbca9 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:48.581846 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a931ba96-a74f-4e7d-8e24-789e0ccdbca9 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7" status: 200 len: 1694 microversion: 2.1 time: 0.211290 Oct 26 13:46:48.582419 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3272/6576] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:48 2022] GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 => generated 1694 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:48.778823 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-43d79ff5-5379-48a9-8792-bc6a1ca55569 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:48.780030 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-43d79ff5-5379-48a9-8792-bc6a1ca55569 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: d7c4949c-2a1b-4880-bf18-f5f1115b66de] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:48.787282 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-43d79ff5-5379-48a9-8792-bc6a1ca55569 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:48.787993 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-43d79ff5-5379-48a9-8792-bc6a1ca55569 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:48.788690 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-43d79ff5-5379-48a9-8792-bc6a1ca55569 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:48.789592 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-43d79ff5-5379-48a9-8792-bc6a1ca55569 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:48.790201 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-43d79ff5-5379-48a9-8792-bc6a1ca55569 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:48.791023 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-43d79ff5-5379-48a9-8792-bc6a1ca55569 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:48.952811 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-43d79ff5-5379-48a9-8792-bc6a1ca55569 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:48.963022 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-43d79ff5-5379-48a9-8792-bc6a1ca55569 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de" status: 200 len: 1202 microversion: 2.1 time: 0.187755 Oct 26 13:46:48.964179 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3305/6577] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:48 2022] GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de => generated 1202 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:49.605618 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7f0ff9f8-8d53-48a0-9e28-78249986002e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:49.606933 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7f0ff9f8-8d53-48a0-9e28-78249986002e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:49.617044 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f0ff9f8-8d53-48a0-9e28-78249986002e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:49.617984 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f0ff9f8-8d53-48a0-9e28-78249986002e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:49.618515 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f0ff9f8-8d53-48a0-9e28-78249986002e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:49.619321 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f0ff9f8-8d53-48a0-9e28-78249986002e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:49.620129 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f0ff9f8-8d53-48a0-9e28-78249986002e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:49.620741 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f0ff9f8-8d53-48a0-9e28-78249986002e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:49.623813 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:46:49.781763 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7f0ff9f8-8d53-48a0-9e28-78249986002e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:49.793250 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7f0ff9f8-8d53-48a0-9e28-78249986002e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7" status: 200 len: 1694 microversion: 2.1 time: 0.191822 Oct 26 13:46:49.794213 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3273/6578] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:49 2022] GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 => generated 1694 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:49.991213 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-72815e86-33f6-4bca-aba6-f2e1fd254098 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:49.993442 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-72815e86-33f6-4bca-aba6-f2e1fd254098 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: d7c4949c-2a1b-4880-bf18-f5f1115b66de] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:50.018392 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72815e86-33f6-4bca-aba6-f2e1fd254098 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:50.028004 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-80789bae-fbbe-48cc-b154-36574ec33058 req-2410ee5f-d7fb-4288-853d-467d4980c35f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7c4949c-2a1b-4880-bf18-f5f1115b66de", "name": "network-vif-plugged", "status": "completed", "tag": "a27c2647-7a0d-4d9e-b310-2c0696574598"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:46:50.036758 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72815e86-33f6-4bca-aba6-f2e1fd254098 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:50.039153 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72815e86-33f6-4bca-aba6-f2e1fd254098 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:50.043765 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72815e86-33f6-4bca-aba6-f2e1fd254098 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:50.045782 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72815e86-33f6-4bca-aba6-f2e1fd254098 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:50.046450 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72815e86-33f6-4bca-aba6-f2e1fd254098 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:50.059915 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-80789bae-fbbe-48cc-b154-36574ec33058 req-2410ee5f-d7fb-4288-853d-467d4980c35f service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:50.062057 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-80789bae-fbbe-48cc-b154-36574ec33058 req-2410ee5f-d7fb-4288-853d-467d4980c35f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:50.065498 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-80789bae-fbbe-48cc-b154-36574ec33058 req-2410ee5f-d7fb-4288-853d-467d4980c35f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:50.097594 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-80789bae-fbbe-48cc-b154-36574ec33058 req-2410ee5f-d7fb-4288-853d-467d4980c35f service nova] Creating event network-vif-plugged:a27c2647-7a0d-4d9e-b310-2c0696574598 for instance d7c4949c-2a1b-4880-bf18-f5f1115b66de on n-h1-862686-1 Oct 26 13:46:50.110463 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-80789bae-fbbe-48cc-b154-36574ec33058 req-2410ee5f-d7fb-4288-853d-467d4980c35f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088408 Oct 26 13:46:50.112428 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3274/6579] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:46:50.295168 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-72815e86-33f6-4bca-aba6-f2e1fd254098 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:50.304845 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-72815e86-33f6-4bca-aba6-f2e1fd254098 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de" status: 200 len: 1202 microversion: 2.1 time: 0.320491 Oct 26 13:46:50.305763 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3306/6580] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:49 2022] GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de => generated 1202 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:50.817715 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d95a9695-2c40-4b9d-91f5-e75a8d47d72d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:50.818501 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d95a9695-2c40-4b9d-91f5-e75a8d47d72d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:50.827995 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d95a9695-2c40-4b9d-91f5-e75a8d47d72d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:50.828487 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d95a9695-2c40-4b9d-91f5-e75a8d47d72d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:50.829095 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d95a9695-2c40-4b9d-91f5-e75a8d47d72d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:50.829826 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d95a9695-2c40-4b9d-91f5-e75a8d47d72d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:50.830287 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d95a9695-2c40-4b9d-91f5-e75a8d47d72d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:50.830711 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d95a9695-2c40-4b9d-91f5-e75a8d47d72d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:50.999150 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d95a9695-2c40-4b9d-91f5-e75a8d47d72d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:51.008678 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d95a9695-2c40-4b9d-91f5-e75a8d47d72d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7" status: 200 len: 1694 microversion: 2.1 time: 0.196015 Oct 26 13:46:51.009743 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3275/6581] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:50 2022] GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 => generated 1694 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:51.327380 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-645fb112-fdc1-4d72-b209-0e7308c195e7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:51.328276 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-645fb112-fdc1-4d72-b209-0e7308c195e7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: d7c4949c-2a1b-4880-bf18-f5f1115b66de] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:51.339992 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-645fb112-fdc1-4d72-b209-0e7308c195e7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:51.340517 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-645fb112-fdc1-4d72-b209-0e7308c195e7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:51.340962 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-645fb112-fdc1-4d72-b209-0e7308c195e7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:51.341706 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-645fb112-fdc1-4d72-b209-0e7308c195e7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:51.342170 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-645fb112-fdc1-4d72-b209-0e7308c195e7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:51.342602 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-645fb112-fdc1-4d72-b209-0e7308c195e7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:51.518382 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-645fb112-fdc1-4d72-b209-0e7308c195e7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:51.528773 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-645fb112-fdc1-4d72-b209-0e7308c195e7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de" status: 200 len: 1202 microversion: 2.1 time: 0.205324 Oct 26 13:46:51.529596 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3307/6582] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:51 2022] GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de => generated 1202 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:52.032232 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4aea0d72-f575-4458-99ef-0f699aa8b111 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:52.032830 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4aea0d72-f575-4458-99ef-0f699aa8b111 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:52.040845 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4aea0d72-f575-4458-99ef-0f699aa8b111 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:52.041588 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4aea0d72-f575-4458-99ef-0f699aa8b111 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:52.042202 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4aea0d72-f575-4458-99ef-0f699aa8b111 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:52.044453 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4aea0d72-f575-4458-99ef-0f699aa8b111 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:52.045120 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4aea0d72-f575-4458-99ef-0f699aa8b111 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:52.045897 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4aea0d72-f575-4458-99ef-0f699aa8b111 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:52.207654 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4aea0d72-f575-4458-99ef-0f699aa8b111 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:52.216913 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4aea0d72-f575-4458-99ef-0f699aa8b111 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7" status: 200 len: 1694 microversion: 2.1 time: 0.188601 Oct 26 13:46:52.218066 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3276/6583] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:52 2022] GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 => generated 1694 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:52.554617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b061fac3-db87-48a2-a132-25ff8134390e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:52.555681 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b061fac3-db87-48a2-a132-25ff8134390e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: d7c4949c-2a1b-4880-bf18-f5f1115b66de] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:52.562664 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b061fac3-db87-48a2-a132-25ff8134390e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:52.563146 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b061fac3-db87-48a2-a132-25ff8134390e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:52.563581 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b061fac3-db87-48a2-a132-25ff8134390e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:52.564274 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b061fac3-db87-48a2-a132-25ff8134390e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:52.564728 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b061fac3-db87-48a2-a132-25ff8134390e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:52.565174 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b061fac3-db87-48a2-a132-25ff8134390e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:52.699046 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b061fac3-db87-48a2-a132-25ff8134390e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:52.707071 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b061fac3-db87-48a2-a132-25ff8134390e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de" status: 200 len: 1389 microversion: 2.1 time: 0.157031 Oct 26 13:46:52.707648 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3308/6584] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:52 2022] GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de => generated 1389 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:52.731575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bbcb0ef9-b66c-40ef-bd49-b39eda7db1cd tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:52.732601 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bbcb0ef9-b66c-40ef-bd49-b39eda7db1cd tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: d7c4949c-2a1b-4880-bf18-f5f1115b66de] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:52.739010 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bbcb0ef9-b66c-40ef-bd49-b39eda7db1cd tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:52.739509 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bbcb0ef9-b66c-40ef-bd49-b39eda7db1cd tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:52.739977 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bbcb0ef9-b66c-40ef-bd49-b39eda7db1cd tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:52.740678 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bbcb0ef9-b66c-40ef-bd49-b39eda7db1cd tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:52.741526 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bbcb0ef9-b66c-40ef-bd49-b39eda7db1cd tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:52.742062 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bbcb0ef9-b66c-40ef-bd49-b39eda7db1cd tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:52.877741 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bbcb0ef9-b66c-40ef-bd49-b39eda7db1cd tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:52.887285 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bbcb0ef9-b66c-40ef-bd49-b39eda7db1cd tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de" status: 200 len: 1389 microversion: 2.1 time: 0.160467 Oct 26 13:46:52.888241 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3277/6585] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:52 2022] GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de => generated 1389 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:52.911519 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9149bc09-9f9d-4a0a-8ed7-f7e78db0990d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:52.912129 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9149bc09-9f9d-4a0a-8ed7-f7e78db0990d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: d7c4949c-2a1b-4880-bf18-f5f1115b66de] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:52.919700 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9149bc09-9f9d-4a0a-8ed7-f7e78db0990d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:52.920173 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9149bc09-9f9d-4a0a-8ed7-f7e78db0990d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:52.921274 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9149bc09-9f9d-4a0a-8ed7-f7e78db0990d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:52.922312 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9149bc09-9f9d-4a0a-8ed7-f7e78db0990d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:52.922770 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9149bc09-9f9d-4a0a-8ed7-f7e78db0990d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:52.923196 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9149bc09-9f9d-4a0a-8ed7-f7e78db0990d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:53.240540 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-94a25d93-2ce5-43b2-b3ec-a3ea17c84949 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:53.241875 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-94a25d93-2ce5-43b2-b3ec-a3ea17c84949 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:53.249355 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-94a25d93-2ce5-43b2-b3ec-a3ea17c84949 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:53.250031 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-94a25d93-2ce5-43b2-b3ec-a3ea17c84949 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:53.250577 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-94a25d93-2ce5-43b2-b3ec-a3ea17c84949 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:53.251600 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-94a25d93-2ce5-43b2-b3ec-a3ea17c84949 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:53.252177 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-94a25d93-2ce5-43b2-b3ec-a3ea17c84949 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:53.252704 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-94a25d93-2ce5-43b2-b3ec-a3ea17c84949 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:53.405266 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-94a25d93-2ce5-43b2-b3ec-a3ea17c84949 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:53.417434 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-94a25d93-2ce5-43b2-b3ec-a3ea17c84949 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7" status: 200 len: 1693 microversion: 2.1 time: 0.180720 Oct 26 13:46:53.418231 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3278/6586] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:53 2022] GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 => generated 1693 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:53.516255 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9149bc09-9f9d-4a0a-8ed7-f7e78db0990d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:53.524471 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9149bc09-9f9d-4a0a-8ed7-f7e78db0990d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de" status: 200 len: 1389 microversion: 2.1 time: 0.616803 Oct 26 13:46:53.525061 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3309/6587] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:52 2022] GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de => generated 1389 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:53.616873 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cf1a7dbd-ebd8-41c8-a236-e7e04f50eeae tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:53.617379 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cf1a7dbd-ebd8-41c8-a236-e7e04f50eeae tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: d7c4949c-2a1b-4880-bf18-f5f1115b66de] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:53.623787 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf1a7dbd-ebd8-41c8-a236-e7e04f50eeae tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:53.624282 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf1a7dbd-ebd8-41c8-a236-e7e04f50eeae tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:53.624896 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf1a7dbd-ebd8-41c8-a236-e7e04f50eeae tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:53.625628 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf1a7dbd-ebd8-41c8-a236-e7e04f50eeae tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:53.626247 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf1a7dbd-ebd8-41c8-a236-e7e04f50eeae tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:53.626786 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf1a7dbd-ebd8-41c8-a236-e7e04f50eeae tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:53.659121 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cf1a7dbd-ebd8-41c8-a236-e7e04f50eeae tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: d7c4949c-2a1b-4880-bf18-f5f1115b66de] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:46:53.751145 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cf1a7dbd-ebd8-41c8-a236-e7e04f50eeae tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de" status: 204 len: 0 microversion: 2.1 time: 0.137892 Oct 26 13:46:53.751924 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3279/6588] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:46:53 2022] DELETE /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:46:53.762526 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-dd933f23-2257-4095-abeb-f1a986ca8232 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:53.763978 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-dd933f23-2257-4095-abeb-f1a986ca8232 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: d7c4949c-2a1b-4880-bf18-f5f1115b66de] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:53.773871 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dd933f23-2257-4095-abeb-f1a986ca8232 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:53.774712 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dd933f23-2257-4095-abeb-f1a986ca8232 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:53.775403 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dd933f23-2257-4095-abeb-f1a986ca8232 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:53.777361 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dd933f23-2257-4095-abeb-f1a986ca8232 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:53.777978 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dd933f23-2257-4095-abeb-f1a986ca8232 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:53.778487 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dd933f23-2257-4095-abeb-f1a986ca8232 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:53.902658 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-bc632a87-3c60-40a4-8446-ea2ac7b4eaf7 req-ec58ea0a-2d94-4046-a0c0-0781cd8e53d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57c44677-5ded-4172-973e-691ee46a58e7", "name": "network-vif-unplugged", "status": "completed", "tag": "13b722da-4749-4dbc-8041-62e84c5e59df"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:46:53.912870 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-bc632a87-3c60-40a4-8446-ea2ac7b4eaf7 req-ec58ea0a-2d94-4046-a0c0-0781cd8e53d7 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:53.913724 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-bc632a87-3c60-40a4-8446-ea2ac7b4eaf7 req-ec58ea0a-2d94-4046-a0c0-0781cd8e53d7 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:53.914308 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-bc632a87-3c60-40a4-8446-ea2ac7b4eaf7 req-ec58ea0a-2d94-4046-a0c0-0781cd8e53d7 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:53.928488 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-bc632a87-3c60-40a4-8446-ea2ac7b4eaf7 req-ec58ea0a-2d94-4046-a0c0-0781cd8e53d7 service nova] Creating event network-vif-unplugged:13b722da-4749-4dbc-8041-62e84c5e59df for instance 57c44677-5ded-4172-973e-691ee46a58e7 on n-h2-862686-1 Oct 26 13:46:53.935278 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [req-bc632a87-3c60-40a4-8446-ea2ac7b4eaf7 req-ec58ea0a-2d94-4046-a0c0-0781cd8e53d7 service nova] Instance 57c44677-5ded-4172-973e-691ee46a58e7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862686-1', 'n-h1-862686-1'} {{(pid=120597) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 13:46:53.957015 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-bc632a87-3c60-40a4-8446-ea2ac7b4eaf7 req-ec58ea0a-2d94-4046-a0c0-0781cd8e53d7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060807 Oct 26 13:46:53.958679 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3280/6589] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:46:54.142819 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-dd933f23-2257-4095-abeb-f1a986ca8232 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:54.152155 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-dd933f23-2257-4095-abeb-f1a986ca8232 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de" status: 200 len: 1395 microversion: 2.1 time: 0.395694 Oct 26 13:46:54.152753 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3310/6590] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:53 2022] GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de => generated 1395 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:54.443708 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-32a3bf2d-a2ef-4b9b-9eda-b06c771a5ac0 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:54.444457 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-32a3bf2d-a2ef-4b9b-9eda-b06c771a5ac0 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:54.451180 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32a3bf2d-a2ef-4b9b-9eda-b06c771a5ac0 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:54.451865 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32a3bf2d-a2ef-4b9b-9eda-b06c771a5ac0 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:54.452314 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32a3bf2d-a2ef-4b9b-9eda-b06c771a5ac0 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:54.453274 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32a3bf2d-a2ef-4b9b-9eda-b06c771a5ac0 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:54.453913 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32a3bf2d-a2ef-4b9b-9eda-b06c771a5ac0 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:54.454491 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32a3bf2d-a2ef-4b9b-9eda-b06c771a5ac0 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:54.599491 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-32a3bf2d-a2ef-4b9b-9eda-b06c771a5ac0 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:54.609707 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-32a3bf2d-a2ef-4b9b-9eda-b06c771a5ac0 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7" status: 200 len: 1693 microversion: 2.1 time: 0.171403 Oct 26 13:46:54.610308 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3281/6591] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:54 2022] GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 => generated 1693 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:55.176003 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-374fc810-0760-4aad-88b7-d88ba39199f3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:55.176637 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-374fc810-0760-4aad-88b7-d88ba39199f3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: d7c4949c-2a1b-4880-bf18-f5f1115b66de] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:55.183588 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-374fc810-0760-4aad-88b7-d88ba39199f3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:55.184076 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-374fc810-0760-4aad-88b7-d88ba39199f3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:55.184512 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-374fc810-0760-4aad-88b7-d88ba39199f3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:55.185220 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-374fc810-0760-4aad-88b7-d88ba39199f3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:55.185704 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-374fc810-0760-4aad-88b7-d88ba39199f3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:55.186133 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-374fc810-0760-4aad-88b7-d88ba39199f3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:55.332136 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-374fc810-0760-4aad-88b7-d88ba39199f3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:55.340707 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-374fc810-0760-4aad-88b7-d88ba39199f3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de" status: 200 len: 1395 microversion: 2.1 time: 0.168597 Oct 26 13:46:55.341302 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3311/6592] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:55 2022] GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de => generated 1395 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:55.634037 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e5703db6-717d-4e61-8f18-419c8070ce30 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:55.634917 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e5703db6-717d-4e61-8f18-419c8070ce30 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:55.642186 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e5703db6-717d-4e61-8f18-419c8070ce30 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:55.642763 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e5703db6-717d-4e61-8f18-419c8070ce30 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:55.643395 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e5703db6-717d-4e61-8f18-419c8070ce30 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:55.644099 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e5703db6-717d-4e61-8f18-419c8070ce30 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:55.644722 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e5703db6-717d-4e61-8f18-419c8070ce30 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:55.645284 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e5703db6-717d-4e61-8f18-419c8070ce30 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:55.823466 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e5703db6-717d-4e61-8f18-419c8070ce30 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:55.832429 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e5703db6-717d-4e61-8f18-419c8070ce30 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7" status: 200 len: 1691 microversion: 2.1 time: 0.202814 Oct 26 13:46:55.833222 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3282/6593] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:55 2022] GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 => generated 1691 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:56.025263 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-22661a3f-67a3-425d-b3c0-0a7c774387d6 req-28158e62-4216-4434-8732-77d32dd8dbae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57c44677-5ded-4172-973e-691ee46a58e7", "tag": "13b722da-4749-4dbc-8041-62e84c5e59df"}, {"server_uuid": "d7c4949c-2a1b-4880-bf18-f5f1115b66de", "name": "network-vif-deleted", "tag": "a27c2647-7a0d-4d9e-b310-2c0696574598"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:46:56.037920 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-22661a3f-67a3-425d-b3c0-0a7c774387d6 req-28158e62-4216-4434-8732-77d32dd8dbae service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:56.038795 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-22661a3f-67a3-425d-b3c0-0a7c774387d6 req-28158e62-4216-4434-8732-77d32dd8dbae service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:56.039038 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-22661a3f-67a3-425d-b3c0-0a7c774387d6 req-28158e62-4216-4434-8732-77d32dd8dbae service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:56.054648 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-22661a3f-67a3-425d-b3c0-0a7c774387d6 req-28158e62-4216-4434-8732-77d32dd8dbae service nova] Creating event network-changed:13b722da-4749-4dbc-8041-62e84c5e59df for instance 57c44677-5ded-4172-973e-691ee46a58e7 on n-h2-862686-1 Oct 26 13:46:56.055458 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-22661a3f-67a3-425d-b3c0-0a7c774387d6 req-28158e62-4216-4434-8732-77d32dd8dbae service nova] Creating event network-vif-deleted:a27c2647-7a0d-4d9e-b310-2c0696574598 for instance d7c4949c-2a1b-4880-bf18-f5f1115b66de on n-h1-862686-1 Oct 26 13:46:56.061308 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [req-22661a3f-67a3-425d-b3c0-0a7c774387d6 req-28158e62-4216-4434-8732-77d32dd8dbae service nova] Instance 57c44677-5ded-4172-973e-691ee46a58e7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862686-1', 'n-h1-862686-1'} {{(pid=120598) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 13:46:56.074556 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-22661a3f-67a3-425d-b3c0-0a7c774387d6 req-28158e62-4216-4434-8732-77d32dd8dbae service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.053936 Oct 26 13:46:56.075115 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3312/6594] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:46:56.363986 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1fd152c7-51ea-48bb-ade6-1a943c31af48 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:56.364527 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1fd152c7-51ea-48bb-ade6-1a943c31af48 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: d7c4949c-2a1b-4880-bf18-f5f1115b66de] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:56.373801 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1fd152c7-51ea-48bb-ade6-1a943c31af48 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:56.374291 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1fd152c7-51ea-48bb-ade6-1a943c31af48 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:56.374736 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1fd152c7-51ea-48bb-ade6-1a943c31af48 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:56.375452 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1fd152c7-51ea-48bb-ade6-1a943c31af48 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:56.375918 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1fd152c7-51ea-48bb-ade6-1a943c31af48 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:56.376354 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1fd152c7-51ea-48bb-ade6-1a943c31af48 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:56.496896 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1fd152c7-51ea-48bb-ade6-1a943c31af48 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:56.513032 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1fd152c7-51ea-48bb-ade6-1a943c31af48 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de" status: 200 len: 1187 microversion: 2.1 time: 0.153293 Oct 26 13:46:56.514361 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3283/6595] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:56 2022] GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de => generated 1187 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:56.863853 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e624cc37-1922-412b-a2de-93e0b9a08d9e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:56.864972 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e624cc37-1922-412b-a2de-93e0b9a08d9e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:56.893629 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e624cc37-1922-412b-a2de-93e0b9a08d9e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:56.894304 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e624cc37-1922-412b-a2de-93e0b9a08d9e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:56.894950 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e624cc37-1922-412b-a2de-93e0b9a08d9e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:56.895844 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e624cc37-1922-412b-a2de-93e0b9a08d9e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:56.896600 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e624cc37-1922-412b-a2de-93e0b9a08d9e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:56.912611 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e624cc37-1922-412b-a2de-93e0b9a08d9e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:57.217216 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e624cc37-1922-412b-a2de-93e0b9a08d9e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:57.227881 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e624cc37-1922-412b-a2de-93e0b9a08d9e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7" status: 200 len: 1691 microversion: 2.1 time: 0.372913 Oct 26 13:46:57.229090 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3313/6596] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:56 2022] GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 => generated 1691 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:57.536055 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d205fad0-a27e-4ea9-878c-fd11943f34b2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:57.536673 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d205fad0-a27e-4ea9-878c-fd11943f34b2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: d7c4949c-2a1b-4880-bf18-f5f1115b66de] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:57.544722 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d205fad0-a27e-4ea9-878c-fd11943f34b2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:57.545635 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d205fad0-a27e-4ea9-878c-fd11943f34b2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:57.546081 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d205fad0-a27e-4ea9-878c-fd11943f34b2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:57.546794 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d205fad0-a27e-4ea9-878c-fd11943f34b2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:57.547630 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d205fad0-a27e-4ea9-878c-fd11943f34b2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:57.548262 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d205fad0-a27e-4ea9-878c-fd11943f34b2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:57.626023 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d205fad0-a27e-4ea9-878c-fd11943f34b2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:57.636188 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d205fad0-a27e-4ea9-878c-fd11943f34b2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de" status: 200 len: 1187 microversion: 2.1 time: 0.103948 Oct 26 13:46:57.637217 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3284/6597] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:57 2022] GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de => generated 1187 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:58.254396 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-854c96b4-8bf5-43ee-8e37-666d45670a6a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:58.255017 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-854c96b4-8bf5-43ee-8e37-666d45670a6a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:58.264213 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-854c96b4-8bf5-43ee-8e37-666d45670a6a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:58.264712 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-854c96b4-8bf5-43ee-8e37-666d45670a6a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:58.265252 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-854c96b4-8bf5-43ee-8e37-666d45670a6a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:58.265952 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-854c96b4-8bf5-43ee-8e37-666d45670a6a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:58.266398 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-854c96b4-8bf5-43ee-8e37-666d45670a6a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:58.267003 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-854c96b4-8bf5-43ee-8e37-666d45670a6a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:58.417013 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-854c96b4-8bf5-43ee-8e37-666d45670a6a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:58.425641 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-854c96b4-8bf5-43ee-8e37-666d45670a6a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7" status: 200 len: 1688 microversion: 2.1 time: 0.176915 Oct 26 13:46:58.426224 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3314/6598] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:58 2022] GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 => generated 1688 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:58.450794 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-26951ef2-79ef-41c9-bbc9-9b41b67fb0ae tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:46:58.451328 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-26951ef2-79ef-41c9-bbc9-9b41b67fb0ae tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:58.462531 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26951ef2-79ef-41c9-bbc9-9b41b67fb0ae tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:58.463162 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26951ef2-79ef-41c9-bbc9-9b41b67fb0ae tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:58.463606 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26951ef2-79ef-41c9-bbc9-9b41b67fb0ae tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:58.464481 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26951ef2-79ef-41c9-bbc9-9b41b67fb0ae tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:58.465092 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26951ef2-79ef-41c9-bbc9-9b41b67fb0ae tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:58.466553 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26951ef2-79ef-41c9-bbc9-9b41b67fb0ae tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:58.609438 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-26951ef2-79ef-41c9-bbc9-9b41b67fb0ae tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "POST /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7/action" status: 202 len: 0 microversion: 2.1 time: 0.162227 Oct 26 13:46:58.610951 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3285/6599] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:46:58 2022] POST /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:46:58.627744 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a0efb075-93f7-4c13-b130-21280e54ca40 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:58.628409 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a0efb075-93f7-4c13-b130-21280e54ca40 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:58.642182 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0efb075-93f7-4c13-b130-21280e54ca40 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:58.646141 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0efb075-93f7-4c13-b130-21280e54ca40 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:58.646630 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0efb075-93f7-4c13-b130-21280e54ca40 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:58.647925 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0efb075-93f7-4c13-b130-21280e54ca40 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:58.666109 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7127f08a-74ef-4669-9332-3db2082fe9e4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:58.666894 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7127f08a-74ef-4669-9332-3db2082fe9e4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: d7c4949c-2a1b-4880-bf18-f5f1115b66de] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:58.670237 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0efb075-93f7-4c13-b130-21280e54ca40 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:58.670732 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0efb075-93f7-4c13-b130-21280e54ca40 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:58.702798 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7127f08a-74ef-4669-9332-3db2082fe9e4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:58.703313 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7127f08a-74ef-4669-9332-3db2082fe9e4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:58.703757 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7127f08a-74ef-4669-9332-3db2082fe9e4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:58.705885 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7127f08a-74ef-4669-9332-3db2082fe9e4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:58.709236 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7127f08a-74ef-4669-9332-3db2082fe9e4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:58.710003 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7127f08a-74ef-4669-9332-3db2082fe9e4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:58.797454 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7127f08a-74ef-4669-9332-3db2082fe9e4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:58.808449 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7127f08a-74ef-4669-9332-3db2082fe9e4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de" status: 200 len: 1187 microversion: 2.1 time: 0.151334 Oct 26 13:46:58.822512 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3286/6600] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:58 2022] GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de => generated 1187 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:58.921885 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a0efb075-93f7-4c13-b130-21280e54ca40 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:58.931608 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a0efb075-93f7-4c13-b130-21280e54ca40 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7" status: 200 len: 1687 microversion: 2.1 time: 0.313389 Oct 26 13:46:58.932305 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3315/6601] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:58 2022] GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 => generated 1687 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:46:59.836674 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a406cf53-e70d-44ef-adab-53dc59c6d747 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:59.837258 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a406cf53-e70d-44ef-adab-53dc59c6d747 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: d7c4949c-2a1b-4880-bf18-f5f1115b66de] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:59.844282 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a406cf53-e70d-44ef-adab-53dc59c6d747 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:59.844775 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a406cf53-e70d-44ef-adab-53dc59c6d747 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:59.845429 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a406cf53-e70d-44ef-adab-53dc59c6d747 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:59.846159 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a406cf53-e70d-44ef-adab-53dc59c6d747 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:59.846781 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a406cf53-e70d-44ef-adab-53dc59c6d747 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:59.847215 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a406cf53-e70d-44ef-adab-53dc59c6d747 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:59.851538 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:46:59.954140 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a406cf53-e70d-44ef-adab-53dc59c6d747 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:46:59.970806 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a2833178-c317-4fac-87a9-f2dc72ba6957 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:46:59.970806 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a2833178-c317-4fac-87a9-f2dc72ba6957 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:46:59.978042 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a406cf53-e70d-44ef-adab-53dc59c6d747 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de" status: 200 len: 1187 microversion: 2.1 time: 0.146324 Oct 26 13:46:59.979602 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:46:59.981395 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a2833178-c317-4fac-87a9-f2dc72ba6957 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:59.982437 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a2833178-c317-4fac-87a9-f2dc72ba6957 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:59.983139 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a2833178-c317-4fac-87a9-f2dc72ba6957 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:59.984362 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a2833178-c317-4fac-87a9-f2dc72ba6957 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:46:59.984971 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a2833178-c317-4fac-87a9-f2dc72ba6957 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:46:59.985810 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a2833178-c317-4fac-87a9-f2dc72ba6957 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:46:59.989790 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3287/6602] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:59 2022] GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de => generated 1187 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:47:00.145793 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-2abd6337-8e2e-4e14-85ba-409a9a48c9c2 req-9e156146-038c-48fb-b99f-6743b846d168 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57c44677-5ded-4172-973e-691ee46a58e7", "name": "network-vif-plugged", "status": "completed", "tag": "13b722da-4749-4dbc-8041-62e84c5e59df"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:47:00.164646 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2abd6337-8e2e-4e14-85ba-409a9a48c9c2 req-9e156146-038c-48fb-b99f-6743b846d168 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:00.165404 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2abd6337-8e2e-4e14-85ba-409a9a48c9c2 req-9e156146-038c-48fb-b99f-6743b846d168 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:00.165870 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2abd6337-8e2e-4e14-85ba-409a9a48c9c2 req-9e156146-038c-48fb-b99f-6743b846d168 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:00.177956 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a2833178-c317-4fac-87a9-f2dc72ba6957 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:47:00.187556 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-2abd6337-8e2e-4e14-85ba-409a9a48c9c2 req-9e156146-038c-48fb-b99f-6743b846d168 service nova] Creating event network-vif-plugged:13b722da-4749-4dbc-8041-62e84c5e59df for instance 57c44677-5ded-4172-973e-691ee46a58e7 on n-h2-862686-1 Oct 26 13:47:00.187850 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a2833178-c317-4fac-87a9-f2dc72ba6957 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7" status: 200 len: 1687 microversion: 2.1 time: 0.230583 Oct 26 13:47:00.190003 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3316/6603] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:46:59 2022] GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 => generated 1687 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:47:00.213255 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [req-2abd6337-8e2e-4e14-85ba-409a9a48c9c2 req-9e156146-038c-48fb-b99f-6743b846d168 service nova] Instance 57c44677-5ded-4172-973e-691ee46a58e7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862686-1', 'n-h1-862686-1'} {{(pid=120597) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 13:47:00.230160 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-2abd6337-8e2e-4e14-85ba-409a9a48c9c2 req-9e156146-038c-48fb-b99f-6743b846d168 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088681 Oct 26 13:47:00.231386 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3288/6604] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:47:01.003425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-63c63130-e816-4659-ac0c-686c108568c2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:47:01.003980 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-63c63130-e816-4659-ac0c-686c108568c2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: d7c4949c-2a1b-4880-bf18-f5f1115b66de] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:47:01.013192 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63c63130-e816-4659-ac0c-686c108568c2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:01.015892 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63c63130-e816-4659-ac0c-686c108568c2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:01.017434 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63c63130-e816-4659-ac0c-686c108568c2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:01.018342 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63c63130-e816-4659-ac0c-686c108568c2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:01.019999 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63c63130-e816-4659-ac0c-686c108568c2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:01.022801 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63c63130-e816-4659-ac0c-686c108568c2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:01.064388 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:47:01.083611 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63c63130-e816-4659-ac0c-686c108568c2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:01.084334 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63c63130-e816-4659-ac0c-686c108568c2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:01.085511 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63c63130-e816-4659-ac0c-686c108568c2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:01.086520 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-63c63130-e816-4659-ac0c-686c108568c2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lazy-loading 'fault' on Instance uuid d7c4949c-2a1b-4880-bf18-f5f1115b66de {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:47:01.154715 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-63c63130-e816-4659-ac0c-686c108568c2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:47:01.164493 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-63c63130-e816-4659-ac0c-686c108568c2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de" status: 200 len: 1192 microversion: 2.1 time: 0.165818 Oct 26 13:47:01.165527 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3317/6605] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:47:00 2022] GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de => generated 1192 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:47:01.218949 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f133bef2-a6a6-4891-a187-905cc332f735 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:47:01.219594 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f133bef2-a6a6-4891-a187-905cc332f735 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:47:01.227466 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f133bef2-a6a6-4891-a187-905cc332f735 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:01.227958 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f133bef2-a6a6-4891-a187-905cc332f735 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:01.228392 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f133bef2-a6a6-4891-a187-905cc332f735 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:01.229098 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f133bef2-a6a6-4891-a187-905cc332f735 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:01.229593 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f133bef2-a6a6-4891-a187-905cc332f735 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:01.230018 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f133bef2-a6a6-4891-a187-905cc332f735 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:01.384410 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f133bef2-a6a6-4891-a187-905cc332f735 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:47:01.393009 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f133bef2-a6a6-4891-a187-905cc332f735 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7" status: 200 len: 1687 microversion: 2.1 time: 0.179843 Oct 26 13:47:01.399056 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3289/6606] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:47:01 2022] GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 => generated 1687 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:47:02.188148 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-62c70ff5-d821-480c-9831-5499b4bb967c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:47:02.188929 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-62c70ff5-d821-480c-9831-5499b4bb967c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: d7c4949c-2a1b-4880-bf18-f5f1115b66de] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:47:02.204940 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-62c70ff5-d821-480c-9831-5499b4bb967c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:02.205476 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-62c70ff5-d821-480c-9831-5499b4bb967c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:02.206502 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-62c70ff5-d821-480c-9831-5499b4bb967c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:02.206623 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-62c70ff5-d821-480c-9831-5499b4bb967c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:02.207112 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-62c70ff5-d821-480c-9831-5499b4bb967c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:02.207482 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-62c70ff5-d821-480c-9831-5499b4bb967c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:02.234978 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-62c70ff5-d821-480c-9831-5499b4bb967c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] HTTP exception thrown: Instance d7c4949c-2a1b-4880-bf18-f5f1115b66de could not be found. Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-62c70ff5-d821-480c-9831-5499b4bb967c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Request method failure captured: Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de HTTP/1.1 Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTnApzC1uv7RYc2W5kY-bKNxAsuZUBfTmQjsjWgzUuX11tX2R8DM_Fw7sVvtXRV9882pAeMKhCsEaXlaTjkLCgPxZsqy0UGzQzulFtHD7rhQ8cnkvWXYr0SPAMtN1JLnqGya627Ln2uWIw1ej-ApXw_efP2G5pRjjzhMaFQwCWIvwTI Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 2a1602330aa340b890bac76a120f74e8 Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-TestVolumeBootPattern-608207068 Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2a1602330aa340b890bac76a120f74e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2a1602330aa340b890bac76a120f74e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2a1602330aa340b890bac76a120f74e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2a1602330aa340b890bac76a120f74e8"}]}] Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-TestVolumeBootPattern-608207068 Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 2a1602330aa340b890bac76a120f74e8 Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-TestVolumeBootPattern-608207068 Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-TestVolumeBootPattern-608207068-project Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: df8b67aae3ea4f17bfa684681311dec5 Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-TestVolumeBootPattern-608207068-project Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance d7c4949c-2a1b-4880-bf18-f5f1115b66de could not be found. Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'd7c4949c-2a1b-4880-bf18-f5f1115b66de'} Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7c4949c-2a1b-4880-bf18-f5f1115b66de could not be found. Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7c4949c-2a1b-4880-bf18-f5f1115b66de could not be found. Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:47:02.236662 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:47:02.240352 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:47:02.240352 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:47:02.240352 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:47:02.240352 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:47:02.240352 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:47:02.240352 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7c4949c-2a1b-4880-bf18-f5f1115b66de could not be found. Oct 26 13:47:02.240352 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:47:02.240352 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-62c70ff5-d821-480c-9831-5499b4bb967c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Returning 404 to user: Instance d7c4949c-2a1b-4880-bf18-f5f1115b66de could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:47:02.240352 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-62c70ff5-d821-480c-9831-5499b4bb967c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de" status: 404 len: 111 microversion: 2.1 time: 0.053869 Oct 26 13:47:02.260032 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3318/6607] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:47:02 2022] GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:47:02.417634 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cb01d5f2-3c1b-4b7c-9020-0727026728f8 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:47:02.418889 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cb01d5f2-3c1b-4b7c-9020-0727026728f8 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:47:02.427780 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:47:02.432023 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb01d5f2-3c1b-4b7c-9020-0727026728f8 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:02.435065 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb01d5f2-3c1b-4b7c-9020-0727026728f8 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:02.435859 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb01d5f2-3c1b-4b7c-9020-0727026728f8 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:02.439434 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb01d5f2-3c1b-4b7c-9020-0727026728f8 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:02.440185 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb01d5f2-3c1b-4b7c-9020-0727026728f8 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:02.440783 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb01d5f2-3c1b-4b7c-9020-0727026728f8 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:02.626441 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-abdfb208-91cb-48f1-b914-14d5732e07eb req-80830645-1445-4ba5-a9ce-04beaefd3b29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57c44677-5ded-4172-973e-691ee46a58e7", "name": "network-vif-unplugged", "status": "completed", "tag": "13b722da-4749-4dbc-8041-62e84c5e59df"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:47:02.648338 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-abdfb208-91cb-48f1-b914-14d5732e07eb req-80830645-1445-4ba5-a9ce-04beaefd3b29 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:02.648846 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-abdfb208-91cb-48f1-b914-14d5732e07eb req-80830645-1445-4ba5-a9ce-04beaefd3b29 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:02.649250 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-abdfb208-91cb-48f1-b914-14d5732e07eb req-80830645-1445-4ba5-a9ce-04beaefd3b29 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:02.681203 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-abdfb208-91cb-48f1-b914-14d5732e07eb req-80830645-1445-4ba5-a9ce-04beaefd3b29 service nova] Creating event network-vif-unplugged:13b722da-4749-4dbc-8041-62e84c5e59df for instance 57c44677-5ded-4172-973e-691ee46a58e7 on n-h1-862686-1 Oct 26 13:47:02.688056 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [req-abdfb208-91cb-48f1-b914-14d5732e07eb req-80830645-1445-4ba5-a9ce-04beaefd3b29 service nova] Instance 57c44677-5ded-4172-973e-691ee46a58e7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862686-1', 'n-h1-862686-1'} {{(pid=120598) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 13:47:02.709302 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-abdfb208-91cb-48f1-b914-14d5732e07eb req-80830645-1445-4ba5-a9ce-04beaefd3b29 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087229 Oct 26 13:47:02.710526 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3319/6608] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:47:02.714328 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cb01d5f2-3c1b-4b7c-9020-0727026728f8 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:47:02.727461 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cb01d5f2-3c1b-4b7c-9020-0727026728f8 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7" status: 200 len: 1687 microversion: 2.1 time: 0.310761 Oct 26 13:47:02.741639 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3290/6609] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:47:02 2022] GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 => generated 1687 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:47:03.755614 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bac7738e-b14d-4485-8d7a-f02df31b8ed8 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:47:03.756852 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bac7738e-b14d-4485-8d7a-f02df31b8ed8 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:47:03.764916 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bac7738e-b14d-4485-8d7a-f02df31b8ed8 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:03.766058 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bac7738e-b14d-4485-8d7a-f02df31b8ed8 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:03.766660 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bac7738e-b14d-4485-8d7a-f02df31b8ed8 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:03.767904 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bac7738e-b14d-4485-8d7a-f02df31b8ed8 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:03.768770 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bac7738e-b14d-4485-8d7a-f02df31b8ed8 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:03.769328 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bac7738e-b14d-4485-8d7a-f02df31b8ed8 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:04.049542 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bac7738e-b14d-4485-8d7a-f02df31b8ed8 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:47:04.061369 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bac7738e-b14d-4485-8d7a-f02df31b8ed8 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7" status: 200 len: 1687 microversion: 2.1 time: 0.313094 Oct 26 13:47:04.062507 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3320/6610] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:47:03 2022] GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 => generated 1687 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:47:04.448356 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c366d8e1-f17c-4fba-a91b-0fa6b31aec60 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:47:04.449070 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c366d8e1-f17c-4fba-a91b-0fa6b31aec60 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: d7c4949c-2a1b-4880-bf18-f5f1115b66de] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:47:04.458722 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c366d8e1-f17c-4fba-a91b-0fa6b31aec60 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:04.459387 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c366d8e1-f17c-4fba-a91b-0fa6b31aec60 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:04.460478 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c366d8e1-f17c-4fba-a91b-0fa6b31aec60 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:04.461725 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c366d8e1-f17c-4fba-a91b-0fa6b31aec60 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:04.462355 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c366d8e1-f17c-4fba-a91b-0fa6b31aec60 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:04.463478 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c366d8e1-f17c-4fba-a91b-0fa6b31aec60 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:04.500945 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-c366d8e1-f17c-4fba-a91b-0fa6b31aec60 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] HTTP exception thrown: Instance d7c4949c-2a1b-4880-bf18-f5f1115b66de could not be found. Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c366d8e1-f17c-4fba-a91b-0fa6b31aec60 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Request method failure captured: Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de HTTP/1.1 Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTnApzC1uv7RYc2W5kY-bKNxAsuZUBfTmQjsjWgzUuX11tX2R8DM_Fw7sVvtXRV9882pAeMKhCsEaXlaTjkLCgPxZsqy0UGzQzulFtHD7rhQ8cnkvWXYr0SPAMtN1JLnqGya627Ln2uWIw1ej-ApXw_efP2G5pRjjzhMaFQwCWIvwTI Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 2a1602330aa340b890bac76a120f74e8 Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-TestVolumeBootPattern-608207068 Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2a1602330aa340b890bac76a120f74e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2a1602330aa340b890bac76a120f74e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2a1602330aa340b890bac76a120f74e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2a1602330aa340b890bac76a120f74e8"}]}] Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-TestVolumeBootPattern-608207068 Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 2a1602330aa340b890bac76a120f74e8 Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-TestVolumeBootPattern-608207068 Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-TestVolumeBootPattern-608207068-project Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: df8b67aae3ea4f17bfa684681311dec5 Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-TestVolumeBootPattern-608207068-project Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance d7c4949c-2a1b-4880-bf18-f5f1115b66de could not be found. Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'd7c4949c-2a1b-4880-bf18-f5f1115b66de'} Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7c4949c-2a1b-4880-bf18-f5f1115b66de could not be found. Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:47:04.504276 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:47:04.508467 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7c4949c-2a1b-4880-bf18-f5f1115b66de could not be found. Oct 26 13:47:04.508467 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:47:04.508467 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:47:04.508467 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:47:04.508467 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:47:04.508467 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:47:04.508467 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:47:04.508467 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:47:04.508467 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:47:04.508467 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7c4949c-2a1b-4880-bf18-f5f1115b66de could not be found. Oct 26 13:47:04.508467 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:47:04.510074 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c366d8e1-f17c-4fba-a91b-0fa6b31aec60 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Returning 404 to user: Instance d7c4949c-2a1b-4880-bf18-f5f1115b66de could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:47:04.511115 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c366d8e1-f17c-4fba-a91b-0fa6b31aec60 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de" status: 404 len: 111 microversion: 2.1 time: 0.068962 Oct 26 13:47:04.511907 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3291/6611] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:47:04 2022] DELETE /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:47:04.520625 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-63bf8262-4802-4f35-9bd9-431f0caf157b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:47:04.521437 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-63bf8262-4802-4f35-9bd9-431f0caf157b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: d7c4949c-2a1b-4880-bf18-f5f1115b66de] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:47:04.529318 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63bf8262-4802-4f35-9bd9-431f0caf157b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:04.530022 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63bf8262-4802-4f35-9bd9-431f0caf157b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:04.530466 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63bf8262-4802-4f35-9bd9-431f0caf157b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:04.531173 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63bf8262-4802-4f35-9bd9-431f0caf157b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:04.531633 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63bf8262-4802-4f35-9bd9-431f0caf157b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:04.532064 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63bf8262-4802-4f35-9bd9-431f0caf157b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:04.549822 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-63bf8262-4802-4f35-9bd9-431f0caf157b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] HTTP exception thrown: Instance d7c4949c-2a1b-4880-bf18-f5f1115b66de could not be found. Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-63bf8262-4802-4f35-9bd9-431f0caf157b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Request method failure captured: Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de HTTP/1.1 Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTnApzC1uv7RYc2W5kY-bKNxAsuZUBfTmQjsjWgzUuX11tX2R8DM_Fw7sVvtXRV9882pAeMKhCsEaXlaTjkLCgPxZsqy0UGzQzulFtHD7rhQ8cnkvWXYr0SPAMtN1JLnqGya627Ln2uWIw1ej-ApXw_efP2G5pRjjzhMaFQwCWIvwTI Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 2a1602330aa340b890bac76a120f74e8 Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-TestVolumeBootPattern-608207068 Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2a1602330aa340b890bac76a120f74e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2a1602330aa340b890bac76a120f74e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2a1602330aa340b890bac76a120f74e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2a1602330aa340b890bac76a120f74e8"}]}] Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-TestVolumeBootPattern-608207068 Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 2a1602330aa340b890bac76a120f74e8 Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-TestVolumeBootPattern-608207068 Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-TestVolumeBootPattern-608207068-project Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: df8b67aae3ea4f17bfa684681311dec5 Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-TestVolumeBootPattern-608207068-project Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance d7c4949c-2a1b-4880-bf18-f5f1115b66de could not be found. Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'd7c4949c-2a1b-4880-bf18-f5f1115b66de'} Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7c4949c-2a1b-4880-bf18-f5f1115b66de could not be found. Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7c4949c-2a1b-4880-bf18-f5f1115b66de could not be found. Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:47:04.551477 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:47:04.555554 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:47:04.555554 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:47:04.555554 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:47:04.555554 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:47:04.555554 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:47:04.555554 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7c4949c-2a1b-4880-bf18-f5f1115b66de could not be found. Oct 26 13:47:04.555554 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:47:04.555554 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-63bf8262-4802-4f35-9bd9-431f0caf157b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Returning 404 to user: Instance d7c4949c-2a1b-4880-bf18-f5f1115b66de could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:47:04.555554 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-63bf8262-4802-4f35-9bd9-431f0caf157b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de" status: 404 len: 111 microversion: 2.1 time: 0.036463 Oct 26 13:47:04.555554 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3321/6612] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:47:04 2022] GET /compute/v2.1/servers/d7c4949c-2a1b-4880-bf18-f5f1115b66de => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:47:04.743029 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-d4270e3f-b583-4762-9ec3-84fdf655d89e req-247705ba-197f-4dcf-9976-6e360fc3b10b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57c44677-5ded-4172-973e-691ee46a58e7", "tag": "13b722da-4749-4dbc-8041-62e84c5e59df"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:47:04.753302 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d4270e3f-b583-4762-9ec3-84fdf655d89e req-247705ba-197f-4dcf-9976-6e360fc3b10b service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:04.754161 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d4270e3f-b583-4762-9ec3-84fdf655d89e req-247705ba-197f-4dcf-9976-6e360fc3b10b service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:04.754792 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d4270e3f-b583-4762-9ec3-84fdf655d89e req-247705ba-197f-4dcf-9976-6e360fc3b10b service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:04.769708 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-d4270e3f-b583-4762-9ec3-84fdf655d89e req-247705ba-197f-4dcf-9976-6e360fc3b10b service nova] Creating event network-changed:13b722da-4749-4dbc-8041-62e84c5e59df for instance 57c44677-5ded-4172-973e-691ee46a58e7 on n-h1-862686-1 Oct 26 13:47:04.776414 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [req-d4270e3f-b583-4762-9ec3-84fdf655d89e req-247705ba-197f-4dcf-9976-6e360fc3b10b service nova] Instance 57c44677-5ded-4172-973e-691ee46a58e7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862686-1', 'n-h1-862686-1'} {{(pid=120597) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 13:47:04.789721 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-d4270e3f-b583-4762-9ec3-84fdf655d89e req-247705ba-197f-4dcf-9976-6e360fc3b10b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050941 Oct 26 13:47:04.790997 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3292/6613] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:47:05.084477 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3a64312b-23c9-4a77-a512-37df16a4cb60 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:47:05.085205 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3a64312b-23c9-4a77-a512-37df16a4cb60 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:47:05.098296 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3a64312b-23c9-4a77-a512-37df16a4cb60 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:05.098888 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3a64312b-23c9-4a77-a512-37df16a4cb60 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:05.099335 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3a64312b-23c9-4a77-a512-37df16a4cb60 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:05.100582 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3a64312b-23c9-4a77-a512-37df16a4cb60 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:05.101046 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3a64312b-23c9-4a77-a512-37df16a4cb60 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:05.101471 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3a64312b-23c9-4a77-a512-37df16a4cb60 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:05.627766 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3a64312b-23c9-4a77-a512-37df16a4cb60 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:47:05.637311 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3a64312b-23c9-4a77-a512-37df16a4cb60 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7" status: 200 len: 1687 microversion: 2.1 time: 0.556692 Oct 26 13:47:05.641428 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3322/6614] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:47:05 2022] GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 => generated 1687 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:47:06.669346 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-411211bc-4fd5-48ab-950c-56486fe74684 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:47:06.670773 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-411211bc-4fd5-48ab-950c-56486fe74684 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:47:06.683221 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-411211bc-4fd5-48ab-950c-56486fe74684 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:06.684437 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-411211bc-4fd5-48ab-950c-56486fe74684 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:06.685310 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-411211bc-4fd5-48ab-950c-56486fe74684 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:06.686448 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-411211bc-4fd5-48ab-950c-56486fe74684 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:06.687132 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-411211bc-4fd5-48ab-950c-56486fe74684 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:06.687848 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-411211bc-4fd5-48ab-950c-56486fe74684 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:06.866474 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-411211bc-4fd5-48ab-950c-56486fe74684 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:47:06.878242 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-411211bc-4fd5-48ab-950c-56486fe74684 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7" status: 200 len: 1680 microversion: 2.1 time: 0.217423 Oct 26 13:47:06.879819 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3293/6615] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:47:06 2022] GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 => generated 1680 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:47:10.288343 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-dd527442-8b24-4386-a4e0-ff0a9fb36562 req-d7fe34f3-7f8a-492e-8c86-0e344e67ff68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57c44677-5ded-4172-973e-691ee46a58e7", "name": "network-vif-plugged", "status": "completed", "tag": "13b722da-4749-4dbc-8041-62e84c5e59df"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:47:10.303453 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-dd527442-8b24-4386-a4e0-ff0a9fb36562 req-d7fe34f3-7f8a-492e-8c86-0e344e67ff68 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:10.304135 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-dd527442-8b24-4386-a4e0-ff0a9fb36562 req-d7fe34f3-7f8a-492e-8c86-0e344e67ff68 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:10.304720 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-dd527442-8b24-4386-a4e0-ff0a9fb36562 req-d7fe34f3-7f8a-492e-8c86-0e344e67ff68 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:10.326942 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-dd527442-8b24-4386-a4e0-ff0a9fb36562 req-d7fe34f3-7f8a-492e-8c86-0e344e67ff68 service nova] Creating event network-vif-plugged:13b722da-4749-4dbc-8041-62e84c5e59df for instance 57c44677-5ded-4172-973e-691ee46a58e7 on n-h1-862686-1 Oct 26 13:47:10.337078 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-dd527442-8b24-4386-a4e0-ff0a9fb36562 req-d7fe34f3-7f8a-492e-8c86-0e344e67ff68 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052910 Oct 26 13:47:10.340295 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3323/6616] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:47:26.791148 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-960ae7de-c70b-4990-a376-ee250aaceaf8 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-563506363", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "4475aa50-7ed1-4661-97dd-79f98e39aef7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "a3a29c91-9973-4a7f-99bf-5b84e6501fd2"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:47:26.802441 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=7 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:47:26.804284 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=32 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:47:26.861763 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-960ae7de-c70b-4990-a376-ee250aaceaf8 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] validate_networks() for [('a3a29c91-9973-4a7f-99bf-5b84e6501fd2', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:47:27.241961 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-960ae7de-c70b-4990-a376-ee250aaceaf8 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:47:27.242468 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-960ae7de-c70b-4990-a376-ee250aaceaf8 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:47:27.243059 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-960ae7de-c70b-4990-a376-ee250aaceaf8 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:47:27.243546 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-960ae7de-c70b-4990-a376-ee250aaceaf8 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:47:27.244038 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-960ae7de-c70b-4990-a376-ee250aaceaf8 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:47:27.253370 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-960ae7de-c70b-4990-a376-ee250aaceaf8 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:27.254047 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-960ae7de-c70b-4990-a376-ee250aaceaf8 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:27.254970 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-960ae7de-c70b-4990-a376-ee250aaceaf8 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:27.256781 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-960ae7de-c70b-4990-a376-ee250aaceaf8 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:27.257257 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-960ae7de-c70b-4990-a376-ee250aaceaf8 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:27.257716 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-960ae7de-c70b-4990-a376-ee250aaceaf8 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:27.278342 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-960ae7de-c70b-4990-a376-ee250aaceaf8 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Getting quotas for project 2a1602330aa340b890bac76a120f74e8. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:47:27.283891 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-960ae7de-c70b-4990-a376-ee250aaceaf8 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Getting quotas for user df8b67aae3ea4f17bfa684681311dec5 and project 2a1602330aa340b890bac76a120f74e8. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:47:27.344767 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-960ae7de-c70b-4990-a376-ee250aaceaf8 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:47:27.347114 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-960ae7de-c70b-4990-a376-ee250aaceaf8 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: dc15c7f0-e789-418e-9213-26c34bcf3f69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4475aa50-7ed1-4661-97dd-79f98e39aef7',volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:47:27.477071 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-960ae7de-c70b-4990-a376-ee250aaceaf8 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.690713 Oct 26 13:47:27.478062 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3294/6617] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:47:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:47:27.489777 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e4f59164-d892-4a77-ba78-e923ada6ed70 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:47:27.490795 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e4f59164-d892-4a77-ba78-e923ada6ed70 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: dc15c7f0-e789-418e-9213-26c34bcf3f69] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:47:27.494947 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=17 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:47:27.495591 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=26 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:47:27.552025 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e4f59164-d892-4a77-ba78-e923ada6ed70 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:47:27.564663 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e4f59164-d892-4a77-ba78-e923ada6ed70 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69" status: 200 len: 1070 microversion: 2.1 time: 0.079420 Oct 26 13:47:27.565271 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3324/6618] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:47:27 2022] GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69 => generated 1070 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:47:28.588597 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6eb0db83-c2b9-4477-b987-c15948275254 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:47:28.589352 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6eb0db83-c2b9-4477-b987-c15948275254 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: dc15c7f0-e789-418e-9213-26c34bcf3f69] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:47:28.597007 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6eb0db83-c2b9-4477-b987-c15948275254 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:28.597506 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6eb0db83-c2b9-4477-b987-c15948275254 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:28.597955 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6eb0db83-c2b9-4477-b987-c15948275254 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:28.598654 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6eb0db83-c2b9-4477-b987-c15948275254 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:28.599154 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6eb0db83-c2b9-4477-b987-c15948275254 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:28.599699 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6eb0db83-c2b9-4477-b987-c15948275254 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:28.672398 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6eb0db83-c2b9-4477-b987-c15948275254 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:47:28.683228 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6eb0db83-c2b9-4477-b987-c15948275254 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69" status: 200 len: 1168 microversion: 2.1 time: 0.098446 Oct 26 13:47:28.683996 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3295/6619] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:47:28 2022] GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69 => generated 1168 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:47:29.707146 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0b414032-9bf8-476c-a7b9-d7a9f1863622 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:47:29.708214 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0b414032-9bf8-476c-a7b9-d7a9f1863622 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: dc15c7f0-e789-418e-9213-26c34bcf3f69] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:47:29.719827 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0b414032-9bf8-476c-a7b9-d7a9f1863622 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:29.720526 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0b414032-9bf8-476c-a7b9-d7a9f1863622 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:29.723156 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0b414032-9bf8-476c-a7b9-d7a9f1863622 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:29.724676 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0b414032-9bf8-476c-a7b9-d7a9f1863622 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:29.725454 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0b414032-9bf8-476c-a7b9-d7a9f1863622 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:29.730430 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0b414032-9bf8-476c-a7b9-d7a9f1863622 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:30.121390 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0b414032-9bf8-476c-a7b9-d7a9f1863622 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:47:30.130292 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0b414032-9bf8-476c-a7b9-d7a9f1863622 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69" status: 200 len: 1228 microversion: 2.1 time: 0.426919 Oct 26 13:47:30.164152 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3325/6620] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:47:29 2022] GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69 => generated 1228 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:47:30.466873 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-a4e5cd0b-1d38-45ff-87d8-3846a238b38a req-20edb85a-5239-4bc8-8c95-dee8f03eef26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc15c7f0-e789-418e-9213-26c34bcf3f69", "tag": "ec55774c-025c-4930-ab07-e2158d02179a"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:47:30.485136 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a4e5cd0b-1d38-45ff-87d8-3846a238b38a req-20edb85a-5239-4bc8-8c95-dee8f03eef26 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:30.485653 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a4e5cd0b-1d38-45ff-87d8-3846a238b38a req-20edb85a-5239-4bc8-8c95-dee8f03eef26 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:30.486087 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a4e5cd0b-1d38-45ff-87d8-3846a238b38a req-20edb85a-5239-4bc8-8c95-dee8f03eef26 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:30.517054 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-a4e5cd0b-1d38-45ff-87d8-3846a238b38a req-20edb85a-5239-4bc8-8c95-dee8f03eef26 service nova] Creating event network-changed:ec55774c-025c-4930-ab07-e2158d02179a for instance dc15c7f0-e789-418e-9213-26c34bcf3f69 on n-h1-862686-1 Oct 26 13:47:30.524391 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-a4e5cd0b-1d38-45ff-87d8-3846a238b38a req-20edb85a-5239-4bc8-8c95-dee8f03eef26 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062136 Oct 26 13:47:30.525213 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3296/6621] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:47:31.159233 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4222573d-b1d2-4aee-8280-ef90c673feee tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:47:31.162663 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ab3f471a-1307-4f81-aaa2-e146c62a8c07 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:47:31.163282 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4222573d-b1d2-4aee-8280-ef90c673feee tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:47:31.164154 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ab3f471a-1307-4f81-aaa2-e146c62a8c07 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: dc15c7f0-e789-418e-9213-26c34bcf3f69] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:47:31.171031 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ab3f471a-1307-4f81-aaa2-e146c62a8c07 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:31.171737 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ab3f471a-1307-4f81-aaa2-e146c62a8c07 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:31.172321 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ab3f471a-1307-4f81-aaa2-e146c62a8c07 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:31.173250 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ab3f471a-1307-4f81-aaa2-e146c62a8c07 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:31.174067 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ab3f471a-1307-4f81-aaa2-e146c62a8c07 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:31.174489 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ab3f471a-1307-4f81-aaa2-e146c62a8c07 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:31.181729 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4222573d-b1d2-4aee-8280-ef90c673feee tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:31.182340 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4222573d-b1d2-4aee-8280-ef90c673feee tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:31.182861 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4222573d-b1d2-4aee-8280-ef90c673feee tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:31.183659 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4222573d-b1d2-4aee-8280-ef90c673feee tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:31.187504 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4222573d-b1d2-4aee-8280-ef90c673feee tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:31.188243 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4222573d-b1d2-4aee-8280-ef90c673feee tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:31.288037 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4222573d-b1d2-4aee-8280-ef90c673feee tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "POST /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7/action" status: 200 len: 63244 microversion: 2.1 time: 0.132652 Oct 26 13:47:31.299868 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3326/6622] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:47:31 2022] POST /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7/action => generated 63244 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:47:31.328288 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ab3f471a-1307-4f81-aaa2-e146c62a8c07 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:47:31.339173 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ab3f471a-1307-4f81-aaa2-e146c62a8c07 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69" status: 200 len: 1228 microversion: 2.1 time: 0.181439 Oct 26 13:47:31.340940 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3297/6623] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:47:31 2022] GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69 => generated 1228 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:47:32.369152 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-25145d30-31bc-4767-ab27-ad612edfb184 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:47:32.370247 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-25145d30-31bc-4767-ab27-ad612edfb184 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: dc15c7f0-e789-418e-9213-26c34bcf3f69] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:47:32.378352 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25145d30-31bc-4767-ab27-ad612edfb184 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:32.378940 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25145d30-31bc-4767-ab27-ad612edfb184 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:32.379452 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25145d30-31bc-4767-ab27-ad612edfb184 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:32.381054 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25145d30-31bc-4767-ab27-ad612edfb184 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:32.381614 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25145d30-31bc-4767-ab27-ad612edfb184 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:32.382122 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25145d30-31bc-4767-ab27-ad612edfb184 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:32.546487 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-25145d30-31bc-4767-ab27-ad612edfb184 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:47:32.559973 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-25145d30-31bc-4767-ab27-ad612edfb184 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69" status: 200 len: 1228 microversion: 2.1 time: 0.195469 Oct 26 13:47:32.560954 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3327/6624] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:47:32 2022] GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69 => generated 1228 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:47:33.584409 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-14683fc9-4f1a-474c-a7d1-2482808bdf51 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:47:33.584959 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-14683fc9-4f1a-474c-a7d1-2482808bdf51 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: dc15c7f0-e789-418e-9213-26c34bcf3f69] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:47:33.595231 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-14683fc9-4f1a-474c-a7d1-2482808bdf51 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:33.595982 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-14683fc9-4f1a-474c-a7d1-2482808bdf51 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:33.596435 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-14683fc9-4f1a-474c-a7d1-2482808bdf51 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:33.597166 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-14683fc9-4f1a-474c-a7d1-2482808bdf51 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:33.597658 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-14683fc9-4f1a-474c-a7d1-2482808bdf51 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:33.598133 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-14683fc9-4f1a-474c-a7d1-2482808bdf51 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:33.739512 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-14683fc9-4f1a-474c-a7d1-2482808bdf51 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:47:33.750760 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-14683fc9-4f1a-474c-a7d1-2482808bdf51 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69" status: 200 len: 1228 microversion: 2.1 time: 0.170737 Oct 26 13:47:33.751623 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3298/6625] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:47:33 2022] GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69 => generated 1228 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:47:34.774395 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-70ba3b27-8441-4ff7-8dc0-e4a4cd56aea4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:47:34.775018 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-70ba3b27-8441-4ff7-8dc0-e4a4cd56aea4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: dc15c7f0-e789-418e-9213-26c34bcf3f69] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:47:34.782655 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70ba3b27-8441-4ff7-8dc0-e4a4cd56aea4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:34.783149 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70ba3b27-8441-4ff7-8dc0-e4a4cd56aea4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:34.783586 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70ba3b27-8441-4ff7-8dc0-e4a4cd56aea4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:34.784291 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70ba3b27-8441-4ff7-8dc0-e4a4cd56aea4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:34.784759 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70ba3b27-8441-4ff7-8dc0-e4a4cd56aea4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:34.785572 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70ba3b27-8441-4ff7-8dc0-e4a4cd56aea4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:34.925783 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-70ba3b27-8441-4ff7-8dc0-e4a4cd56aea4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:47:34.934254 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-70ba3b27-8441-4ff7-8dc0-e4a4cd56aea4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69" status: 200 len: 1216 microversion: 2.1 time: 0.164301 Oct 26 13:47:34.937264 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3328/6626] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:47:34 2022] GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69 => generated 1216 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:47:35.960294 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-88fd3bb0-31df-42f4-8f8c-c25d429ea4a6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:47:35.960903 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-88fd3bb0-31df-42f4-8f8c-c25d429ea4a6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: dc15c7f0-e789-418e-9213-26c34bcf3f69] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:47:35.970319 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88fd3bb0-31df-42f4-8f8c-c25d429ea4a6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:35.970827 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88fd3bb0-31df-42f4-8f8c-c25d429ea4a6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:35.971275 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88fd3bb0-31df-42f4-8f8c-c25d429ea4a6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:35.971999 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88fd3bb0-31df-42f4-8f8c-c25d429ea4a6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:35.972476 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88fd3bb0-31df-42f4-8f8c-c25d429ea4a6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:35.972954 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88fd3bb0-31df-42f4-8f8c-c25d429ea4a6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:36.121860 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-88fd3bb0-31df-42f4-8f8c-c25d429ea4a6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:47:36.133351 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-88fd3bb0-31df-42f4-8f8c-c25d429ea4a6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69" status: 200 len: 1216 microversion: 2.1 time: 0.176934 Oct 26 13:47:36.134065 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3299/6627] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:47:35 2022] GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69 => generated 1216 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:47:37.156164 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c9fb545e-8adf-4017-b40d-53112a1baf9c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:47:37.156901 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c9fb545e-8adf-4017-b40d-53112a1baf9c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: dc15c7f0-e789-418e-9213-26c34bcf3f69] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:47:37.164765 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9fb545e-8adf-4017-b40d-53112a1baf9c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:37.165251 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9fb545e-8adf-4017-b40d-53112a1baf9c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:37.165713 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9fb545e-8adf-4017-b40d-53112a1baf9c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:37.166688 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9fb545e-8adf-4017-b40d-53112a1baf9c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:37.167181 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9fb545e-8adf-4017-b40d-53112a1baf9c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:37.167613 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9fb545e-8adf-4017-b40d-53112a1baf9c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:37.313363 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c9fb545e-8adf-4017-b40d-53112a1baf9c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:47:37.324356 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c9fb545e-8adf-4017-b40d-53112a1baf9c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69" status: 200 len: 1216 microversion: 2.1 time: 0.171643 Oct 26 13:47:37.324967 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3329/6628] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:47:37 2022] GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69 => generated 1216 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:47:37.568322 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ce077e25-461a-4a83-9b9e-1d4399d3102f tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:47:37.568930 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ce077e25-461a-4a83-9b9e-1d4399d3102f tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:47:37.571756 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:47:37.572456 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:47:37.578996 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce077e25-461a-4a83-9b9e-1d4399d3102f tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:37.579483 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce077e25-461a-4a83-9b9e-1d4399d3102f tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:37.579919 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce077e25-461a-4a83-9b9e-1d4399d3102f tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:37.580612 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce077e25-461a-4a83-9b9e-1d4399d3102f tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:37.581070 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce077e25-461a-4a83-9b9e-1d4399d3102f tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:37.581507 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce077e25-461a-4a83-9b9e-1d4399d3102f tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:37.715005 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ce077e25-461a-4a83-9b9e-1d4399d3102f tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7" status: 200 len: 1831 microversion: 2.1 time: 0.150881 Oct 26 13:47:37.715576 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3300/6629] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:47:37 2022] GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 => generated 1831 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:47:38.347212 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-adb29dc4-84c5-4e6b-9c39-28bbdf2ab759 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:47:38.348317 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-adb29dc4-84c5-4e6b-9c39-28bbdf2ab759 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: dc15c7f0-e789-418e-9213-26c34bcf3f69] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:47:38.352047 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:47:38.360559 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-adb29dc4-84c5-4e6b-9c39-28bbdf2ab759 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:38.361503 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-adb29dc4-84c5-4e6b-9c39-28bbdf2ab759 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:38.362358 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-adb29dc4-84c5-4e6b-9c39-28bbdf2ab759 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:38.363230 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-adb29dc4-84c5-4e6b-9c39-28bbdf2ab759 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:38.364109 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-adb29dc4-84c5-4e6b-9c39-28bbdf2ab759 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:38.364979 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-adb29dc4-84c5-4e6b-9c39-28bbdf2ab759 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:38.940132 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-adb29dc4-84c5-4e6b-9c39-28bbdf2ab759 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:47:38.948910 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-adb29dc4-84c5-4e6b-9c39-28bbdf2ab759 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69" status: 200 len: 1216 microversion: 2.1 time: 0.605606 Oct 26 13:47:38.958504 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3330/6630] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:47:38 2022] GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69 => generated 1216 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:47:39.053432 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-619bdb52-3de5-46bd-9ccd-64b7e854d56f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:47:39.054064 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-619bdb52-3de5-46bd-9ccd-64b7e854d56f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:47:39.061151 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-09197eb0-814f-4f3b-b3fb-5f91b0d5cdc3 req-92338318-f9e4-4dd1-a0d0-2f906efbe1b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57c44677-5ded-4172-973e-691ee46a58e7", "tag": "13b722da-4749-4dbc-8041-62e84c5e59df"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:47:39.069992 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-619bdb52-3de5-46bd-9ccd-64b7e854d56f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:39.070494 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-619bdb52-3de5-46bd-9ccd-64b7e854d56f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:39.070940 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-619bdb52-3de5-46bd-9ccd-64b7e854d56f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:39.071649 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-619bdb52-3de5-46bd-9ccd-64b7e854d56f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:39.073595 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-619bdb52-3de5-46bd-9ccd-64b7e854d56f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:39.074276 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-619bdb52-3de5-46bd-9ccd-64b7e854d56f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:39.077388 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-09197eb0-814f-4f3b-b3fb-5f91b0d5cdc3 req-92338318-f9e4-4dd1-a0d0-2f906efbe1b5 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:39.077912 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-09197eb0-814f-4f3b-b3fb-5f91b0d5cdc3 req-92338318-f9e4-4dd1-a0d0-2f906efbe1b5 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:39.078349 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-09197eb0-814f-4f3b-b3fb-5f91b0d5cdc3 req-92338318-f9e4-4dd1-a0d0-2f906efbe1b5 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:39.093960 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-09197eb0-814f-4f3b-b3fb-5f91b0d5cdc3 req-92338318-f9e4-4dd1-a0d0-2f906efbe1b5 service nova] Creating event network-changed:13b722da-4749-4dbc-8041-62e84c5e59df for instance 57c44677-5ded-4172-973e-691ee46a58e7 on n-h1-862686-1 Oct 26 13:47:39.102763 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-09197eb0-814f-4f3b-b3fb-5f91b0d5cdc3 req-92338318-f9e4-4dd1-a0d0-2f906efbe1b5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054561 Oct 26 13:47:39.105848 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-619bdb52-3de5-46bd-9ccd-64b7e854d56f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:47:39.106487 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3331/6631] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:47:39.212666 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-619bdb52-3de5-46bd-9ccd-64b7e854d56f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "DELETE /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7" status: 204 len: 0 microversion: 2.1 time: 0.168354 Oct 26 13:47:39.213270 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3301/6632] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:47:39 2022] DELETE /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:47:39.222741 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b86c4426-abe6-433f-b8a7-12fdabd0dab2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:47:39.223636 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b86c4426-abe6-433f-b8a7-12fdabd0dab2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:47:39.230823 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b86c4426-abe6-433f-b8a7-12fdabd0dab2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:39.231503 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b86c4426-abe6-433f-b8a7-12fdabd0dab2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:39.232032 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b86c4426-abe6-433f-b8a7-12fdabd0dab2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:39.232929 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b86c4426-abe6-433f-b8a7-12fdabd0dab2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:39.233456 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b86c4426-abe6-433f-b8a7-12fdabd0dab2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:39.234003 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b86c4426-abe6-433f-b8a7-12fdabd0dab2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:39.395241 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b86c4426-abe6-433f-b8a7-12fdabd0dab2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:47:39.404673 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b86c4426-abe6-433f-b8a7-12fdabd0dab2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7" status: 200 len: 1686 microversion: 2.1 time: 0.186294 Oct 26 13:47:39.405274 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3332/6633] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:47:39 2022] GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 => generated 1686 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:47:39.979690 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-08bfa5dd-b35b-4546-94f7-f9dbe2dbde96 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:47:39.980834 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-08bfa5dd-b35b-4546-94f7-f9dbe2dbde96 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: dc15c7f0-e789-418e-9213-26c34bcf3f69] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:47:39.998572 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-08bfa5dd-b35b-4546-94f7-f9dbe2dbde96 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:39.999102 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-08bfa5dd-b35b-4546-94f7-f9dbe2dbde96 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:39.999559 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-08bfa5dd-b35b-4546-94f7-f9dbe2dbde96 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:40.000305 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-08bfa5dd-b35b-4546-94f7-f9dbe2dbde96 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:40.000771 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-08bfa5dd-b35b-4546-94f7-f9dbe2dbde96 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:40.001197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-08bfa5dd-b35b-4546-94f7-f9dbe2dbde96 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:40.149566 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-08bfa5dd-b35b-4546-94f7-f9dbe2dbde96 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:47:40.157701 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-08bfa5dd-b35b-4546-94f7-f9dbe2dbde96 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69" status: 200 len: 1216 microversion: 2.1 time: 0.189555 Oct 26 13:47:40.159132 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3302/6634] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:47:39 2022] GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69 => generated 1216 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:47:40.428215 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-29207a6c-fc19-403e-b919-4bc18e782b40 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:47:40.429061 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-29207a6c-fc19-403e-b919-4bc18e782b40 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:47:40.436386 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29207a6c-fc19-403e-b919-4bc18e782b40 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:40.436908 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29207a6c-fc19-403e-b919-4bc18e782b40 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:40.437353 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29207a6c-fc19-403e-b919-4bc18e782b40 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:40.438275 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29207a6c-fc19-403e-b919-4bc18e782b40 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:40.438747 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29207a6c-fc19-403e-b919-4bc18e782b40 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:40.439186 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29207a6c-fc19-403e-b919-4bc18e782b40 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:40.614794 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-29207a6c-fc19-403e-b919-4bc18e782b40 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:47:40.622654 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-29207a6c-fc19-403e-b919-4bc18e782b40 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7" status: 200 len: 1686 microversion: 2.1 time: 0.198423 Oct 26 13:47:40.623277 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3333/6635] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:47:40 2022] GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 => generated 1686 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:47:41.188091 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9c212d7c-5c14-4656-a021-b568c5b65be8 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:47:41.189933 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9c212d7c-5c14-4656-a021-b568c5b65be8 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: dc15c7f0-e789-418e-9213-26c34bcf3f69] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:47:41.201893 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c212d7c-5c14-4656-a021-b568c5b65be8 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:41.202915 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c212d7c-5c14-4656-a021-b568c5b65be8 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:41.203263 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c212d7c-5c14-4656-a021-b568c5b65be8 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:41.204561 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c212d7c-5c14-4656-a021-b568c5b65be8 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:41.205853 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c212d7c-5c14-4656-a021-b568c5b65be8 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:41.207731 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c212d7c-5c14-4656-a021-b568c5b65be8 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:41.363786 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9c212d7c-5c14-4656-a021-b568c5b65be8 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:47:41.372884 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9c212d7c-5c14-4656-a021-b568c5b65be8 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69" status: 200 len: 1216 microversion: 2.1 time: 0.188999 Oct 26 13:47:41.374035 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3303/6636] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:47:41 2022] GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69 => generated 1216 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:47:41.648898 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-39b5a20b-fec2-4d42-954f-0e95a4352a99 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:47:41.649827 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-39b5a20b-fec2-4d42-954f-0e95a4352a99 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:47:41.656934 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39b5a20b-fec2-4d42-954f-0e95a4352a99 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:41.657708 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39b5a20b-fec2-4d42-954f-0e95a4352a99 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:41.658377 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39b5a20b-fec2-4d42-954f-0e95a4352a99 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:41.659307 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39b5a20b-fec2-4d42-954f-0e95a4352a99 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:41.660203 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39b5a20b-fec2-4d42-954f-0e95a4352a99 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:41.661062 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39b5a20b-fec2-4d42-954f-0e95a4352a99 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:41.923062 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-39b5a20b-fec2-4d42-954f-0e95a4352a99 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:47:41.928245 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-9039f3cf-a6da-4af2-8676-420282ab94f9 req-3acf972a-f3ae-4a3d-a8a9-803cc1e6938f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57c44677-5ded-4172-973e-691ee46a58e7", "name": "network-vif-deleted", "tag": "13b722da-4749-4dbc-8041-62e84c5e59df"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:47:41.939835 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9039f3cf-a6da-4af2-8676-420282ab94f9 req-3acf972a-f3ae-4a3d-a8a9-803cc1e6938f service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:41.940590 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9039f3cf-a6da-4af2-8676-420282ab94f9 req-3acf972a-f3ae-4a3d-a8a9-803cc1e6938f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:41.941020 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9039f3cf-a6da-4af2-8676-420282ab94f9 req-3acf972a-f3ae-4a3d-a8a9-803cc1e6938f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:41.952849 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-39b5a20b-fec2-4d42-954f-0e95a4352a99 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7" status: 200 len: 1568 microversion: 2.1 time: 0.306612 Oct 26 13:47:41.956615 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-9039f3cf-a6da-4af2-8676-420282ab94f9 req-3acf972a-f3ae-4a3d-a8a9-803cc1e6938f service nova] Creating event network-vif-deleted:13b722da-4749-4dbc-8041-62e84c5e59df for instance 57c44677-5ded-4172-973e-691ee46a58e7 on n-h1-862686-1 Oct 26 13:47:41.964042 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-9039f3cf-a6da-4af2-8676-420282ab94f9 req-3acf972a-f3ae-4a3d-a8a9-803cc1e6938f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041750 Oct 26 13:47:41.964934 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3304/6637] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:47:41.966036 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3334/6638] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:47:41 2022] GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 => generated 1568 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:47:42.397990 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0b2ee008-f419-42e5-b795-5d2303eca234 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:47:42.398689 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0b2ee008-f419-42e5-b795-5d2303eca234 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: dc15c7f0-e789-418e-9213-26c34bcf3f69] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:47:42.406120 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b2ee008-f419-42e5-b795-5d2303eca234 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:42.406602 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b2ee008-f419-42e5-b795-5d2303eca234 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:42.407034 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b2ee008-f419-42e5-b795-5d2303eca234 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:42.407716 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b2ee008-f419-42e5-b795-5d2303eca234 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:42.408170 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b2ee008-f419-42e5-b795-5d2303eca234 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:42.408589 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b2ee008-f419-42e5-b795-5d2303eca234 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:42.564660 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0b2ee008-f419-42e5-b795-5d2303eca234 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:47:42.576340 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0b2ee008-f419-42e5-b795-5d2303eca234 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69" status: 200 len: 1216 microversion: 2.1 time: 0.183752 Oct 26 13:47:42.577460 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3305/6639] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:47:42 2022] GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69 => generated 1216 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:47:42.978938 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9afe9f4f-e52c-4156-9452-3792935666bf tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:47:42.979576 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9afe9f4f-e52c-4156-9452-3792935666bf tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 57c44677-5ded-4172-973e-691ee46a58e7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:47:42.986436 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9afe9f4f-e52c-4156-9452-3792935666bf tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:42.986921 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9afe9f4f-e52c-4156-9452-3792935666bf tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:42.987361 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9afe9f4f-e52c-4156-9452-3792935666bf tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:42.988064 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9afe9f4f-e52c-4156-9452-3792935666bf tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:42.988524 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9afe9f4f-e52c-4156-9452-3792935666bf tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:42.988954 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9afe9f4f-e52c-4156-9452-3792935666bf tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:43.002449 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-9afe9f4f-e52c-4156-9452-3792935666bf tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] HTTP exception thrown: Instance 57c44677-5ded-4172-973e-691ee46a58e7 could not be found. Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9afe9f4f-e52c-4156-9452-3792935666bf tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Request method failure captured: Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 HTTP/1.1 Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTl7vHGITUnSIjOoYHssXC10IwUcwveqrJ7Ebb5cmEfkFD9JMguSExqSXPNP7Ag-JuWcpR1m7T1_23uQXjoVepH6MjM-90GyPgiU7IyFq1opWMTLN8Bh1kpzqNFJZ8A9zq3q3AuJcUUCnd4kdwPdeBkozWabTG-a7qC9_ycsvQK-bH8 Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: bbc60a45db1c488ab4417c3b2c8d1983 Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1564668813 Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bbc60a45db1c488ab4417c3b2c8d1983"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bbc60a45db1c488ab4417c3b2c8d1983"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bbc60a45db1c488ab4417c3b2c8d1983"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bbc60a45db1c488ab4417c3b2c8d1983"}]}] Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1564668813 Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: bbc60a45db1c488ab4417c3b2c8d1983 Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1564668813 Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-TestNetworkAdvancedServerOps-1564668813-project Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: c67f61dd56b74107b828dcd7f2fc31f1 Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1564668813-project Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 57c44677-5ded-4172-973e-691ee46a58e7 could not be found. Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '57c44677-5ded-4172-973e-691ee46a58e7'} Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57c44677-5ded-4172-973e-691ee46a58e7 could not be found. Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57c44677-5ded-4172-973e-691ee46a58e7 could not be found. Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:47:43.004078 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:47:43.008669 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:47:43.008669 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:47:43.008669 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:47:43.008669 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:47:43.008669 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:47:43.008669 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:47:43.008669 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57c44677-5ded-4172-973e-691ee46a58e7 could not be found. Oct 26 13:47:43.008669 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:47:43.008669 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9afe9f4f-e52c-4156-9452-3792935666bf tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Returning 404 to user: Instance 57c44677-5ded-4172-973e-691ee46a58e7 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:47:43.008669 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9afe9f4f-e52c-4156-9452-3792935666bf tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7" status: 404 len: 111 microversion: 2.1 time: 0.030576 Oct 26 13:47:43.016963 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3335/6640] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:47:42 2022] GET /compute/v2.1/servers/57c44677-5ded-4172-973e-691ee46a58e7 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:47:43.601414 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8d24c780-1723-4451-8cf4-4bcf31ef0e45 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:47:43.602294 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8d24c780-1723-4451-8cf4-4bcf31ef0e45 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: dc15c7f0-e789-418e-9213-26c34bcf3f69] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:47:43.609349 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d24c780-1723-4451-8cf4-4bcf31ef0e45 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:43.609876 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d24c780-1723-4451-8cf4-4bcf31ef0e45 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:43.610319 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d24c780-1723-4451-8cf4-4bcf31ef0e45 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:43.611054 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d24c780-1723-4451-8cf4-4bcf31ef0e45 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:43.611680 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d24c780-1723-4451-8cf4-4bcf31ef0e45 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:43.612116 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d24c780-1723-4451-8cf4-4bcf31ef0e45 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:43.760228 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8d24c780-1723-4451-8cf4-4bcf31ef0e45 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:47:43.769015 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8d24c780-1723-4451-8cf4-4bcf31ef0e45 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69" status: 200 len: 1216 microversion: 2.1 time: 0.172412 Oct 26 13:47:43.769746 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3306/6641] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:47:43 2022] GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69 => generated 1216 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:47:44.796930 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a416d78c-ca6f-48cf-9da4-08d2bf572929 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:47:44.798780 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a416d78c-ca6f-48cf-9da4-08d2bf572929 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: dc15c7f0-e789-418e-9213-26c34bcf3f69] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:47:44.816290 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a416d78c-ca6f-48cf-9da4-08d2bf572929 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:44.817309 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a416d78c-ca6f-48cf-9da4-08d2bf572929 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:44.818247 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a416d78c-ca6f-48cf-9da4-08d2bf572929 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:44.819448 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a416d78c-ca6f-48cf-9da4-08d2bf572929 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:44.820048 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a416d78c-ca6f-48cf-9da4-08d2bf572929 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:44.820979 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a416d78c-ca6f-48cf-9da4-08d2bf572929 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:45.089194 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a416d78c-ca6f-48cf-9da4-08d2bf572929 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:47:45.108687 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a416d78c-ca6f-48cf-9da4-08d2bf572929 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69" status: 200 len: 1216 microversion: 2.1 time: 0.319430 Oct 26 13:47:45.110605 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3336/6642] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:47:44 2022] GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69 => generated 1216 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:47:46.133908 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-da715788-6892-4503-a346-d017732d0631 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:47:46.134634 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-da715788-6892-4503-a346-d017732d0631 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: dc15c7f0-e789-418e-9213-26c34bcf3f69] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:47:46.153924 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-da715788-6892-4503-a346-d017732d0631 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:46.154550 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-da715788-6892-4503-a346-d017732d0631 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:46.154865 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-da715788-6892-4503-a346-d017732d0631 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:46.155585 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-da715788-6892-4503-a346-d017732d0631 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:46.156054 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-da715788-6892-4503-a346-d017732d0631 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:46.156491 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-da715788-6892-4503-a346-d017732d0631 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:46.402482 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-da715788-6892-4503-a346-d017732d0631 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:47:46.411128 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-da715788-6892-4503-a346-d017732d0631 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69" status: 200 len: 1216 microversion: 2.1 time: 0.281782 Oct 26 13:47:46.422701 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3307/6643] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:47:46 2022] GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69 => generated 1216 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:47:46.651246 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-65a29e08-a2c8-4775-bbaf-9ecee7414a72 req-005bb873-66f8-42bc-b76b-9629f6e86907 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc15c7f0-e789-418e-9213-26c34bcf3f69", "name": "network-vif-plugged", "status": "completed", "tag": "ec55774c-025c-4930-ab07-e2158d02179a"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:47:46.701452 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-65a29e08-a2c8-4775-bbaf-9ecee7414a72 req-005bb873-66f8-42bc-b76b-9629f6e86907 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:46.703436 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-65a29e08-a2c8-4775-bbaf-9ecee7414a72 req-005bb873-66f8-42bc-b76b-9629f6e86907 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:46.704282 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-65a29e08-a2c8-4775-bbaf-9ecee7414a72 req-005bb873-66f8-42bc-b76b-9629f6e86907 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:46.726021 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-65a29e08-a2c8-4775-bbaf-9ecee7414a72 req-005bb873-66f8-42bc-b76b-9629f6e86907 service nova] Creating event network-vif-plugged:ec55774c-025c-4930-ab07-e2158d02179a for instance dc15c7f0-e789-418e-9213-26c34bcf3f69 on n-h1-862686-1 Oct 26 13:47:46.732951 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-65a29e08-a2c8-4775-bbaf-9ecee7414a72 req-005bb873-66f8-42bc-b76b-9629f6e86907 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088352 Oct 26 13:47:46.734650 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3337/6644] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:47:47.232076 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-89eb9890-0c9c-4d03-b873-db1b797ce321 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '.version_select at 0x7f6732318b80>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:47:47.257385 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-89eb9890-0c9c-4d03-b873-db1b797ce321 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-735004815" status: 202 len: 0 microversion: 2.1 time: 0.029076 Oct 26 13:47:47.258658 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3308/6645] 10.222.0.40 () {58 vars in 1281 bytes} [Wed Oct 26 13:47:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-735004815 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:47:47.292185 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a0457902-362d-4cb0-b025-39b50ff5f783 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Action: 'create', calling method: .version_select at 0x7f6731125e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1401637738", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJYGMhCGCqCpx4tDysAC0DMPTK/h4Hle9AxQ9aJMdSsoUgeZTR9iqxRGPTWi6lc/tSOzCtsyMKC3D6w9JS/w5V16E8WZN2bA0bPLsyVqZCdU0fSk7+Sgp+T6JXPO16Ukw=="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:47:47.309061 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-a0457902-362d-4cb0-b025-39b50ff5f783 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Getting quotas for project bbc60a45db1c488ab4417c3b2c8d1983. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:47:47.314232 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-a0457902-362d-4cb0-b025-39b50ff5f783 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Getting quotas for user c67f61dd56b74107b828dcd7f2fc31f1 and project bbc60a45db1c488ab4417c3b2c8d1983. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:47:47.338253 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a0457902-362d-4cb0-b025-39b50ff5f783 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050718 Oct 26 13:47:47.338872 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3338/6646] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 13:47:47 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:47:47.451196 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6028f475-c1c1-46de-861e-ad3d9cda6bae tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:47:47.451683 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6028f475-c1c1-46de-861e-ad3d9cda6bae tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: dc15c7f0-e789-418e-9213-26c34bcf3f69] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:47:47.463153 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6028f475-c1c1-46de-861e-ad3d9cda6bae tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:47.463950 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6028f475-c1c1-46de-861e-ad3d9cda6bae tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:47.464587 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6028f475-c1c1-46de-861e-ad3d9cda6bae tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:47.465642 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6028f475-c1c1-46de-861e-ad3d9cda6bae tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:47.466328 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6028f475-c1c1-46de-861e-ad3d9cda6bae tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:47.466985 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6028f475-c1c1-46de-861e-ad3d9cda6bae tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:47.658177 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6028f475-c1c1-46de-861e-ad3d9cda6bae tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:47:47.671636 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6028f475-c1c1-46de-861e-ad3d9cda6bae tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69" status: 200 len: 1216 microversion: 2.1 time: 0.225776 Oct 26 13:47:47.678162 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3309/6647] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:47:47 2022] GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69 => generated 1216 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:47:48.700611 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9d44cb8e-a2a2-44e2-923d-31dabbfc4bbb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:47:48.702578 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9d44cb8e-a2a2-44e2-923d-31dabbfc4bbb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: dc15c7f0-e789-418e-9213-26c34bcf3f69] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:47:48.713153 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d44cb8e-a2a2-44e2-923d-31dabbfc4bbb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:48.714010 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d44cb8e-a2a2-44e2-923d-31dabbfc4bbb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:48.714694 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d44cb8e-a2a2-44e2-923d-31dabbfc4bbb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:48.715757 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d44cb8e-a2a2-44e2-923d-31dabbfc4bbb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:48.716661 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d44cb8e-a2a2-44e2-923d-31dabbfc4bbb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:48.717338 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d44cb8e-a2a2-44e2-923d-31dabbfc4bbb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:49.392665 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9d44cb8e-a2a2-44e2-923d-31dabbfc4bbb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:47:49.400656 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9d44cb8e-a2a2-44e2-923d-31dabbfc4bbb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69" status: 200 len: 1404 microversion: 2.1 time: 0.705058 Oct 26 13:47:49.401212 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3339/6648] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:47:48 2022] GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69 => generated 1404 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:47:49.423639 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-86162727-5e6d-4790-a127-0f740365cd39 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:47:49.424257 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-86162727-5e6d-4790-a127-0f740365cd39 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: dc15c7f0-e789-418e-9213-26c34bcf3f69] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:47:49.432211 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-86162727-5e6d-4790-a127-0f740365cd39 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:49.432705 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-86162727-5e6d-4790-a127-0f740365cd39 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:49.433157 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-86162727-5e6d-4790-a127-0f740365cd39 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:49.433899 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-86162727-5e6d-4790-a127-0f740365cd39 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:49.434363 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-86162727-5e6d-4790-a127-0f740365cd39 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:49.434793 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-86162727-5e6d-4790-a127-0f740365cd39 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:49.572498 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-86162727-5e6d-4790-a127-0f740365cd39 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:47:49.581137 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-86162727-5e6d-4790-a127-0f740365cd39 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69" status: 200 len: 1404 microversion: 2.1 time: 0.161716 Oct 26 13:47:49.581755 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3310/6649] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:47:49 2022] GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69 => generated 1404 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:47:49.604873 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-75bd8445-a95e-4bb4-b5f8-f6f46ea6d05f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-243410470"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:47:49.607243 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-75bd8445-a95e-4bb4-b5f8-f6f46ea6d05f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: dc15c7f0-e789-418e-9213-26c34bcf3f69] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:47:49.613449 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-75bd8445-a95e-4bb4-b5f8-f6f46ea6d05f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:49.613991 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-75bd8445-a95e-4bb4-b5f8-f6f46ea6d05f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:49.614422 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-75bd8445-a95e-4bb4-b5f8-f6f46ea6d05f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:49.615111 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-75bd8445-a95e-4bb4-b5f8-f6f46ea6d05f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:49.615562 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-75bd8445-a95e-4bb4-b5f8-f6f46ea6d05f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:49.615980 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-75bd8445-a95e-4bb4-b5f8-f6f46ea6d05f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:49.711499 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.compute.api [None req-75bd8445-a95e-4bb4-b5f8-f6f46ea6d05f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: dc15c7f0-e789-418e-9213-26c34bcf3f69] Attempting to quiesce instance before volume snapshot. Oct 26 13:47:49.789288 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.compute.api [None req-75bd8445-a95e-4bb4-b5f8-f6f46ea6d05f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: dc15c7f0-e789-418e-9213-26c34bcf3f69] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 26 13:47:49.861522 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-75bd8445-a95e-4bb4-b5f8-f6f46ea6d05f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: dc15c7f0-e789-418e-9213-26c34bcf3f69] Creating snapshot from volume 4475aa50-7ed1-4661-97dd-79f98e39aef7. {{(pid=120598) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 26 13:47:50.982058 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-75bd8445-a95e-4bb4-b5f8-f6f46ea6d05f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "POST /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69/action" status: 202 len: 0 microversion: 2.1 time: 1.381100 Oct 26 13:47:50.982728 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3340/6650] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:47:49 2022] POST /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69/action => generated 0 bytes in 1383 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 26 13:47:53.296861 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e90085c6-cdb8-481c-931b-a4976c619439 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-549101597", "imageRef": "0711887b-9add-4f9c-830f-78f84a884860", "flavorRef": "452", "networks": [{"uuid": "a3a29c91-9973-4a7f-99bf-5b84e6501fd2"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:47:53.391665 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-e90085c6-cdb8-481c-931b-a4976c619439 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] validate_networks() for [('a3a29c91-9973-4a7f-99bf-5b84e6501fd2', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:47:53.918684 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-e90085c6-cdb8-481c-931b-a4976c619439 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:47:53.919336 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-e90085c6-cdb8-481c-931b-a4976c619439 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:47:53.919812 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-e90085c6-cdb8-481c-931b-a4976c619439 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:47:53.920218 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-e90085c6-cdb8-481c-931b-a4976c619439 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:47:53.920625 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-e90085c6-cdb8-481c-931b-a4976c619439 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:47:53.937257 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e90085c6-cdb8-481c-931b-a4976c619439 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:53.938015 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e90085c6-cdb8-481c-931b-a4976c619439 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:53.943275 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e90085c6-cdb8-481c-931b-a4976c619439 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:53.944755 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e90085c6-cdb8-481c-931b-a4976c619439 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:53.945459 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e90085c6-cdb8-481c-931b-a4976c619439 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:53.946062 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e90085c6-cdb8-481c-931b-a4976c619439 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:53.970427 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-e90085c6-cdb8-481c-931b-a4976c619439 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Getting quotas for project 2a1602330aa340b890bac76a120f74e8. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:47:53.981703 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-e90085c6-cdb8-481c-931b-a4976c619439 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Getting quotas for user df8b67aae3ea4f17bfa684681311dec5 and project 2a1602330aa340b890bac76a120f74e8. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:47:53.997200 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e90085c6-cdb8-481c-931b-a4976c619439 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:47:54.002914 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e90085c6-cdb8-481c-931b-a4976c619439 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: a8fe4a06-f75b-41c4-a716-976652361744] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='abdad824-bd58-4ac3-aedf-3cc2101993c9',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:47:54.116723 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e90085c6-cdb8-481c-931b-a4976c619439 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.824678 Oct 26 13:47:54.118013 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3311/6651] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:47:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:47:54.130512 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-34e05881-262a-4422-ba07-289e89e757ad tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:47:54.131986 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-34e05881-262a-4422-ba07-289e89e757ad tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: a8fe4a06-f75b-41c4-a716-976652361744] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:47:54.277858 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-34e05881-262a-4422-ba07-289e89e757ad tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:47:54.290550 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-34e05881-262a-4422-ba07-289e89e757ad tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744" status: 200 len: 1229 microversion: 2.1 time: 0.164402 Oct 26 13:47:54.305766 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3341/6652] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:47:54 2022] GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744 => generated 1229 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:47:55.130665 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-17ede0ac-38b3-49a8-a8e0-8d98bb97a5bf tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2133219473", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "e6873e42-b314-4a16-ab08-a6b60ad81952"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1401637738", "security_groups": [{"name": "tempest-secgroup-smoke-2029678888"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:47:55.275925 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-17ede0ac-38b3-49a8-a8e0-8d98bb97a5bf tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] validate_networks() for [('e6873e42-b314-4a16-ab08-a6b60ad81952', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:47:55.320304 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-620f7f6e-2179-4642-9849-daa0b6c9cbfb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:47:55.321560 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-620f7f6e-2179-4642-9849-daa0b6c9cbfb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: a8fe4a06-f75b-41c4-a716-976652361744] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:47:55.334254 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-620f7f6e-2179-4642-9849-daa0b6c9cbfb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:55.335483 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-620f7f6e-2179-4642-9849-daa0b6c9cbfb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:55.336017 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-620f7f6e-2179-4642-9849-daa0b6c9cbfb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:55.336891 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-620f7f6e-2179-4642-9849-daa0b6c9cbfb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:55.337436 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-620f7f6e-2179-4642-9849-daa0b6c9cbfb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:55.338226 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-620f7f6e-2179-4642-9849-daa0b6c9cbfb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:55.509209 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-620f7f6e-2179-4642-9849-daa0b6c9cbfb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:47:55.537621 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-620f7f6e-2179-4642-9849-daa0b6c9cbfb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744" status: 200 len: 1281 microversion: 2.1 time: 0.222090 Oct 26 13:47:55.539229 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3342/6653] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:47:55 2022] GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744 => generated 1281 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:47:56.039629 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-17ede0ac-38b3-49a8-a8e0-8d98bb97a5bf tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:47:56.040352 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-17ede0ac-38b3-49a8-a8e0-8d98bb97a5bf tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:47:56.041003 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-17ede0ac-38b3-49a8-a8e0-8d98bb97a5bf tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:47:56.041893 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-17ede0ac-38b3-49a8-a8e0-8d98bb97a5bf tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:47:56.043013 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-17ede0ac-38b3-49a8-a8e0-8d98bb97a5bf tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:47:56.054715 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17ede0ac-38b3-49a8-a8e0-8d98bb97a5bf tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:56.055465 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17ede0ac-38b3-49a8-a8e0-8d98bb97a5bf tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:56.056091 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17ede0ac-38b3-49a8-a8e0-8d98bb97a5bf tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:56.057204 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17ede0ac-38b3-49a8-a8e0-8d98bb97a5bf tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:56.058078 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17ede0ac-38b3-49a8-a8e0-8d98bb97a5bf tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:56.058779 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17ede0ac-38b3-49a8-a8e0-8d98bb97a5bf tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:56.098930 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-17ede0ac-38b3-49a8-a8e0-8d98bb97a5bf tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Getting quotas for project bbc60a45db1c488ab4417c3b2c8d1983. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:47:56.112944 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-17ede0ac-38b3-49a8-a8e0-8d98bb97a5bf tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Getting quotas for user c67f61dd56b74107b828dcd7f2fc31f1 and project bbc60a45db1c488ab4417c3b2c8d1983. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:47:56.131521 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-17ede0ac-38b3-49a8-a8e0-8d98bb97a5bf tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:47:56.135914 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-17ede0ac-38b3-49a8-a8e0-8d98bb97a5bf tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 06916a99-825b-43f6-9887-15064c6f9f0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:47:56.216905 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-17ede0ac-38b3-49a8-a8e0-8d98bb97a5bf tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.091995 Oct 26 13:47:56.218038 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3312/6654] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:47:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 1094 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:47:56.232152 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-965de0e8-2912-4282-979e-ec6e0bb01cdb tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:47:56.233009 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-965de0e8-2912-4282-979e-ec6e0bb01cdb tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 06916a99-825b-43f6-9887-15064c6f9f0f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:47:56.354239 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-965de0e8-2912-4282-979e-ec6e0bb01cdb tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:47:56.366300 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-965de0e8-2912-4282-979e-ec6e0bb01cdb tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f" status: 200 len: 1267 microversion: 2.1 time: 0.139042 Oct 26 13:47:56.367405 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3343/6655] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:47:56 2022] GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f => generated 1267 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:47:56.561517 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-017accce-aa1f-424e-8594-5dfc9914a063 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:47:56.562303 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-017accce-aa1f-424e-8594-5dfc9914a063 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: a8fe4a06-f75b-41c4-a716-976652361744] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:47:56.577500 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-017accce-aa1f-424e-8594-5dfc9914a063 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:56.578062 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-017accce-aa1f-424e-8594-5dfc9914a063 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:56.578511 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-017accce-aa1f-424e-8594-5dfc9914a063 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:56.579230 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-017accce-aa1f-424e-8594-5dfc9914a063 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:56.579689 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-017accce-aa1f-424e-8594-5dfc9914a063 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:56.580122 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-017accce-aa1f-424e-8594-5dfc9914a063 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:56.592975 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:47:56.748004 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-017accce-aa1f-424e-8594-5dfc9914a063 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:47:56.759188 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-017accce-aa1f-424e-8594-5dfc9914a063 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744" status: 200 len: 1299 microversion: 2.1 time: 0.201508 Oct 26 13:47:56.760577 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3313/6656] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:47:56 2022] GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744 => generated 1299 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:47:57.392930 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-153e7334-0c2e-4b1c-9a22-24b9056f30a6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:47:57.393910 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-153e7334-0c2e-4b1c-9a22-24b9056f30a6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 06916a99-825b-43f6-9887-15064c6f9f0f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:47:57.405539 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-153e7334-0c2e-4b1c-9a22-24b9056f30a6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:57.409946 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-153e7334-0c2e-4b1c-9a22-24b9056f30a6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:57.412264 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-153e7334-0c2e-4b1c-9a22-24b9056f30a6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:57.415871 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-153e7334-0c2e-4b1c-9a22-24b9056f30a6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:57.416878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-153e7334-0c2e-4b1c-9a22-24b9056f30a6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:57.417569 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-153e7334-0c2e-4b1c-9a22-24b9056f30a6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:57.508186 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-153e7334-0c2e-4b1c-9a22-24b9056f30a6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:47:57.515232 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:47:57.520662 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-153e7334-0c2e-4b1c-9a22-24b9056f30a6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f" status: 200 len: 1263 microversion: 2.1 time: 0.133129 Oct 26 13:47:57.523997 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3344/6657] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:47:57 2022] GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f => generated 1263 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:47:57.784265 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e42267de-bd7f-4264-ac73-d8a4f9a0f12b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:47:57.786384 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e42267de-bd7f-4264-ac73-d8a4f9a0f12b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: a8fe4a06-f75b-41c4-a716-976652361744] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:47:57.791247 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=9,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:47:57.795591 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e42267de-bd7f-4264-ac73-d8a4f9a0f12b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:57.803568 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e42267de-bd7f-4264-ac73-d8a4f9a0f12b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:57.804139 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e42267de-bd7f-4264-ac73-d8a4f9a0f12b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:57.804909 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e42267de-bd7f-4264-ac73-d8a4f9a0f12b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:57.805389 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e42267de-bd7f-4264-ac73-d8a4f9a0f12b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:57.809709 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e42267de-bd7f-4264-ac73-d8a4f9a0f12b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:58.241974 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e42267de-bd7f-4264-ac73-d8a4f9a0f12b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:47:58.257840 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e42267de-bd7f-4264-ac73-d8a4f9a0f12b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744" status: 200 len: 1341 microversion: 2.1 time: 0.475166 Oct 26 13:47:58.259459 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3314/6658] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:47:57 2022] GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744 => generated 1341 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:47:58.548033 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-06dd8d91-3904-4cf5-bdbc-96f6fb575285 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:47:58.549373 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-06dd8d91-3904-4cf5-bdbc-96f6fb575285 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 06916a99-825b-43f6-9887-15064c6f9f0f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:47:58.561557 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:47:58.568347 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06dd8d91-3904-4cf5-bdbc-96f6fb575285 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:58.573595 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06dd8d91-3904-4cf5-bdbc-96f6fb575285 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:58.574434 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06dd8d91-3904-4cf5-bdbc-96f6fb575285 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:58.575248 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06dd8d91-3904-4cf5-bdbc-96f6fb575285 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:58.575753 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06dd8d91-3904-4cf5-bdbc-96f6fb575285 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:58.576197 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06dd8d91-3904-4cf5-bdbc-96f6fb575285 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:58.981760 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-06dd8d91-3904-4cf5-bdbc-96f6fb575285 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:47:58.990959 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-06dd8d91-3904-4cf5-bdbc-96f6fb575285 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f" status: 200 len: 1325 microversion: 2.1 time: 0.446776 Oct 26 13:47:58.995256 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3345/6659] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:47:58 2022] GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f => generated 1325 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:47:59.176546 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-3127991c-308d-44bb-b57b-3425a6045be4 req-6360a9fe-3b85-4820-8cae-73511d7cfee8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8fe4a06-f75b-41c4-a716-976652361744", "tag": "7a51b387-00fd-405a-a777-75be8875aa41"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:47:59.224095 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-3127991c-308d-44bb-b57b-3425a6045be4 req-6360a9fe-3b85-4820-8cae-73511d7cfee8 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:59.224644 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-3127991c-308d-44bb-b57b-3425a6045be4 req-6360a9fe-3b85-4820-8cae-73511d7cfee8 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:59.225158 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-3127991c-308d-44bb-b57b-3425a6045be4 req-6360a9fe-3b85-4820-8cae-73511d7cfee8 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:59.242258 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-3127991c-308d-44bb-b57b-3425a6045be4 req-6360a9fe-3b85-4820-8cae-73511d7cfee8 service nova] Creating event network-changed:7a51b387-00fd-405a-a777-75be8875aa41 for instance a8fe4a06-f75b-41c4-a716-976652361744 on n-h2-862686-1 Oct 26 13:47:59.250478 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-3127991c-308d-44bb-b57b-3425a6045be4 req-6360a9fe-3b85-4820-8cae-73511d7cfee8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077940 Oct 26 13:47:59.252071 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3315/6660] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:47:59.287500 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cac55b18-5186-4770-bfc5-f0431db83437 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:47:59.288560 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cac55b18-5186-4770-bfc5-f0431db83437 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: a8fe4a06-f75b-41c4-a716-976652361744] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:47:59.317635 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cac55b18-5186-4770-bfc5-f0431db83437 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:59.318627 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cac55b18-5186-4770-bfc5-f0431db83437 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:59.319376 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cac55b18-5186-4770-bfc5-f0431db83437 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:59.320761 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cac55b18-5186-4770-bfc5-f0431db83437 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:47:59.321460 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cac55b18-5186-4770-bfc5-f0431db83437 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:47:59.322388 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cac55b18-5186-4770-bfc5-f0431db83437 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:47:59.979976 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-cac55b18-5186-4770-bfc5-f0431db83437 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:47:59.991376 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cac55b18-5186-4770-bfc5-f0431db83437 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744" status: 200 len: 1341 microversion: 2.1 time: 0.709604 Oct 26 13:47:59.992772 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3346/6661] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:47:59 2022] GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744 => generated 1341 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:00.029797 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-17d9321f-4f71-4e39-b753-85e5fdb223f9 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:00.031035 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-17d9321f-4f71-4e39-b753-85e5fdb223f9 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 06916a99-825b-43f6-9887-15064c6f9f0f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:00.066587 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17d9321f-4f71-4e39-b753-85e5fdb223f9 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:00.067591 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17d9321f-4f71-4e39-b753-85e5fdb223f9 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:00.068173 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17d9321f-4f71-4e39-b753-85e5fdb223f9 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:00.069212 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17d9321f-4f71-4e39-b753-85e5fdb223f9 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:00.069969 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17d9321f-4f71-4e39-b753-85e5fdb223f9 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:00.070558 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17d9321f-4f71-4e39-b753-85e5fdb223f9 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:00.429915 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-17d9321f-4f71-4e39-b753-85e5fdb223f9 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:00.447527 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-17d9321f-4f71-4e39-b753-85e5fdb223f9 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f" status: 200 len: 1325 microversion: 2.1 time: 0.430606 Oct 26 13:48:00.448694 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3316/6662] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:00 2022] GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f => generated 1325 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:01.015317 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-74cf509a-0d34-440d-977d-abfe0b07b406 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:01.016128 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-74cf509a-0d34-440d-977d-abfe0b07b406 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: a8fe4a06-f75b-41c4-a716-976652361744] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:01.023960 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74cf509a-0d34-440d-977d-abfe0b07b406 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:01.024453 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74cf509a-0d34-440d-977d-abfe0b07b406 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:01.024905 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74cf509a-0d34-440d-977d-abfe0b07b406 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:01.025872 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74cf509a-0d34-440d-977d-abfe0b07b406 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:01.026508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74cf509a-0d34-440d-977d-abfe0b07b406 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:01.026962 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74cf509a-0d34-440d-977d-abfe0b07b406 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:01.473649 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c5973874-7639-47b2-b820-18116bf433cc tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:01.474779 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c5973874-7639-47b2-b820-18116bf433cc tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 06916a99-825b-43f6-9887-15064c6f9f0f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:01.481275 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c5973874-7639-47b2-b820-18116bf433cc tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:01.481976 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c5973874-7639-47b2-b820-18116bf433cc tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:01.482576 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c5973874-7639-47b2-b820-18116bf433cc tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:01.483442 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c5973874-7639-47b2-b820-18116bf433cc tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:01.484047 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c5973874-7639-47b2-b820-18116bf433cc tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:01.484622 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c5973874-7639-47b2-b820-18116bf433cc tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:01.546538 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-74cf509a-0d34-440d-977d-abfe0b07b406 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:01.555315 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-74cf509a-0d34-440d-977d-abfe0b07b406 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744" status: 200 len: 1341 microversion: 2.1 time: 0.543827 Oct 26 13:48:01.578321 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3347/6663] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:01 2022] GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744 => generated 1341 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:01.786984 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c5973874-7639-47b2-b820-18116bf433cc tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:01.796963 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c5973874-7639-47b2-b820-18116bf433cc tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f" status: 200 len: 1393 microversion: 2.1 time: 0.328832 Oct 26 13:48:01.826071 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3317/6664] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:01 2022] GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f => generated 1393 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:02.292757 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-19b01719-0f0b-40f4-bfeb-6f5b5942c242 req-1c3065da-96d6-4088-bb51-b849143a0f0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06916a99-825b-43f6-9887-15064c6f9f0f", "tag": "0b277019-c139-4f21-84fc-f272d97bdd6a"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:48:02.322371 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-19b01719-0f0b-40f4-bfeb-6f5b5942c242 req-1c3065da-96d6-4088-bb51-b849143a0f0c service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:02.323133 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-19b01719-0f0b-40f4-bfeb-6f5b5942c242 req-1c3065da-96d6-4088-bb51-b849143a0f0c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:02.323722 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-19b01719-0f0b-40f4-bfeb-6f5b5942c242 req-1c3065da-96d6-4088-bb51-b849143a0f0c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:02.348424 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-19b01719-0f0b-40f4-bfeb-6f5b5942c242 req-1c3065da-96d6-4088-bb51-b849143a0f0c service nova] Creating event network-changed:0b277019-c139-4f21-84fc-f272d97bdd6a for instance 06916a99-825b-43f6-9887-15064c6f9f0f on n-h1-862686-1 Oct 26 13:48:02.356866 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-19b01719-0f0b-40f4-bfeb-6f5b5942c242 req-1c3065da-96d6-4088-bb51-b849143a0f0c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069330 Oct 26 13:48:02.358364 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3348/6665] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:48:02.612232 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-abc74d72-b99e-4f2e-97dc-3befc6659651 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:02.614713 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-abc74d72-b99e-4f2e-97dc-3befc6659651 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: a8fe4a06-f75b-41c4-a716-976652361744] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:02.623521 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-abc74d72-b99e-4f2e-97dc-3befc6659651 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:02.624455 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-abc74d72-b99e-4f2e-97dc-3befc6659651 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:02.625106 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-abc74d72-b99e-4f2e-97dc-3befc6659651 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:02.626089 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-abc74d72-b99e-4f2e-97dc-3befc6659651 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:02.626759 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-abc74d72-b99e-4f2e-97dc-3befc6659651 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:02.627394 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-abc74d72-b99e-4f2e-97dc-3befc6659651 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:02.814370 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-abc74d72-b99e-4f2e-97dc-3befc6659651 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:02.823942 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-abc74d72-b99e-4f2e-97dc-3befc6659651 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744" status: 200 len: 1341 microversion: 2.1 time: 0.223515 Oct 26 13:48:02.840216 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3318/6666] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:02 2022] GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744 => generated 1341 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:02.845999 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ca3f5cc3-28ac-4b7f-9b61-7f71a729028b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:02.847208 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ca3f5cc3-28ac-4b7f-9b61-7f71a729028b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 06916a99-825b-43f6-9887-15064c6f9f0f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:02.877180 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ca3f5cc3-28ac-4b7f-9b61-7f71a729028b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:02.881370 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ca3f5cc3-28ac-4b7f-9b61-7f71a729028b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:02.884733 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ca3f5cc3-28ac-4b7f-9b61-7f71a729028b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:02.886468 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ca3f5cc3-28ac-4b7f-9b61-7f71a729028b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:02.886468 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ca3f5cc3-28ac-4b7f-9b61-7f71a729028b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:02.890168 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ca3f5cc3-28ac-4b7f-9b61-7f71a729028b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:03.059067 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9dc2976e-bef0-4b1a-ab69-2967406b32e2 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:03.059912 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9dc2976e-bef0-4b1a-ab69-2967406b32e2 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] [instance: 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:03.078165 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9dc2976e-bef0-4b1a-ab69-2967406b32e2 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:03.079326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9dc2976e-bef0-4b1a-ab69-2967406b32e2 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:03.079437 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9dc2976e-bef0-4b1a-ab69-2967406b32e2 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:03.080238 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9dc2976e-bef0-4b1a-ab69-2967406b32e2 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:03.082244 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9dc2976e-bef0-4b1a-ab69-2967406b32e2 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:03.083721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9dc2976e-bef0-4b1a-ab69-2967406b32e2 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:03.150259 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9dc2976e-bef0-4b1a-ab69-2967406b32e2 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] [instance: 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:48:03.169150 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ca3f5cc3-28ac-4b7f-9b61-7f71a729028b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:03.179254 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ca3f5cc3-28ac-4b7f-9b61-7f71a729028b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f" status: 200 len: 1393 microversion: 2.1 time: 0.337693 Oct 26 13:48:03.179849 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3319/6667] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:02 2022] GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f => generated 1393 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:03.293226 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9dc2976e-bef0-4b1a-ab69-2967406b32e2 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce" status: 204 len: 0 microversion: 2.1 time: 0.450922 Oct 26 13:48:03.294740 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3349/6668] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:48:02 2022] DELETE /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:48:03.304608 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1beba2e3-63a7-4920-bd94-bb661f9ff50b tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:03.305648 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1beba2e3-63a7-4920-bd94-bb661f9ff50b tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] [instance: 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:03.313851 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1beba2e3-63a7-4920-bd94-bb661f9ff50b tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:03.314641 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1beba2e3-63a7-4920-bd94-bb661f9ff50b tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:03.315124 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1beba2e3-63a7-4920-bd94-bb661f9ff50b tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:03.315819 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1beba2e3-63a7-4920-bd94-bb661f9ff50b tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:03.317117 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1beba2e3-63a7-4920-bd94-bb661f9ff50b tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:03.317959 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1beba2e3-63a7-4920-bd94-bb661f9ff50b tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:03.557295 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1beba2e3-63a7-4920-bd94-bb661f9ff50b tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725949c28f9742beb622b98e84c67646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffe02c0779d465f93762150cb94114f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:03.565855 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1beba2e3-63a7-4920-bd94-bb661f9ff50b tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] 10.222.0.40 "GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce" status: 200 len: 1729 microversion: 2.1 time: 0.266607 Oct 26 13:48:03.589820 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3320/6669] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:03 2022] GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce => generated 1729 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:03.850567 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-79bb9c33-632f-48fd-b685-d4a3f2c52068 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:03.851332 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-79bb9c33-632f-48fd-b685-d4a3f2c52068 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: a8fe4a06-f75b-41c4-a716-976652361744] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:03.858655 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-79bb9c33-632f-48fd-b685-d4a3f2c52068 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:03.859169 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-79bb9c33-632f-48fd-b685-d4a3f2c52068 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:03.859628 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-79bb9c33-632f-48fd-b685-d4a3f2c52068 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:03.860362 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-79bb9c33-632f-48fd-b685-d4a3f2c52068 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:03.860842 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-79bb9c33-632f-48fd-b685-d4a3f2c52068 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:03.861300 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-79bb9c33-632f-48fd-b685-d4a3f2c52068 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:04.030043 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-79bb9c33-632f-48fd-b685-d4a3f2c52068 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:04.041381 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-79bb9c33-632f-48fd-b685-d4a3f2c52068 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744" status: 200 len: 1341 microversion: 2.1 time: 0.196143 Oct 26 13:48:04.043490 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3350/6670] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:03 2022] GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744 => generated 1341 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:48:04.202045 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f9063ced-9f12-4000-bb3a-912500f328d2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:04.203992 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f9063ced-9f12-4000-bb3a-912500f328d2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 06916a99-825b-43f6-9887-15064c6f9f0f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:04.211611 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f9063ced-9f12-4000-bb3a-912500f328d2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:04.212604 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f9063ced-9f12-4000-bb3a-912500f328d2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:04.213276 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f9063ced-9f12-4000-bb3a-912500f328d2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:04.214116 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f9063ced-9f12-4000-bb3a-912500f328d2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:04.214764 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f9063ced-9f12-4000-bb3a-912500f328d2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:04.215190 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f9063ced-9f12-4000-bb3a-912500f328d2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:04.399479 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f9063ced-9f12-4000-bb3a-912500f328d2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:04.422694 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f9063ced-9f12-4000-bb3a-912500f328d2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f" status: 200 len: 1393 microversion: 2.1 time: 0.222555 Oct 26 13:48:04.424316 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3321/6671] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:04 2022] GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f => generated 1393 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:04.609523 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4547fc8d-4432-4959-beee-fcd5e2f84e51 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:04.611721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4547fc8d-4432-4959-beee-fcd5e2f84e51 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] [instance: 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:04.621441 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4547fc8d-4432-4959-beee-fcd5e2f84e51 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:04.622115 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4547fc8d-4432-4959-beee-fcd5e2f84e51 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:04.622993 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4547fc8d-4432-4959-beee-fcd5e2f84e51 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:04.625128 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4547fc8d-4432-4959-beee-fcd5e2f84e51 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:04.625863 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4547fc8d-4432-4959-beee-fcd5e2f84e51 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:04.626606 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4547fc8d-4432-4959-beee-fcd5e2f84e51 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:05.004907 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4547fc8d-4432-4959-beee-fcd5e2f84e51 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725949c28f9742beb622b98e84c67646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffe02c0779d465f93762150cb94114f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:05.015644 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4547fc8d-4432-4959-beee-fcd5e2f84e51 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] 10.222.0.40 "GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce" status: 200 len: 1729 microversion: 2.1 time: 0.412981 Oct 26 13:48:05.017055 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3351/6672] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:04 2022] GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce => generated 1729 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:05.069659 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a2361feb-89f5-41fd-9211-13b470eb33ad tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:05.070288 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a2361feb-89f5-41fd-9211-13b470eb33ad tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: a8fe4a06-f75b-41c4-a716-976652361744] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:05.077160 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2361feb-89f5-41fd-9211-13b470eb33ad tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:05.077160 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2361feb-89f5-41fd-9211-13b470eb33ad tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:05.077987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2361feb-89f5-41fd-9211-13b470eb33ad tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:05.078555 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2361feb-89f5-41fd-9211-13b470eb33ad tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:05.079225 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2361feb-89f5-41fd-9211-13b470eb33ad tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:05.080078 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2361feb-89f5-41fd-9211-13b470eb33ad tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:05.304710 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a2361feb-89f5-41fd-9211-13b470eb33ad tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:05.314350 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a2361feb-89f5-41fd-9211-13b470eb33ad tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744" status: 200 len: 1341 microversion: 2.1 time: 0.249304 Oct 26 13:48:05.329595 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3322/6673] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:05 2022] GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744 => generated 1341 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:05.458800 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-83412e0c-80e2-4094-bbc8-fd588c72380b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:05.459899 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-83412e0c-80e2-4094-bbc8-fd588c72380b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 06916a99-825b-43f6-9887-15064c6f9f0f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:05.477018 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83412e0c-80e2-4094-bbc8-fd588c72380b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:05.477819 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83412e0c-80e2-4094-bbc8-fd588c72380b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:05.478456 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83412e0c-80e2-4094-bbc8-fd588c72380b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:05.479186 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83412e0c-80e2-4094-bbc8-fd588c72380b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:05.479826 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83412e0c-80e2-4094-bbc8-fd588c72380b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:05.480424 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-83412e0c-80e2-4094-bbc8-fd588c72380b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:06.072906 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bb533abb-b4b3-46eb-a014-13d57f5b27c0 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:06.073540 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bb533abb-b4b3-46eb-a014-13d57f5b27c0 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] [instance: 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:06.086802 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=4 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:48:06.088737 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb533abb-b4b3-46eb-a014-13d57f5b27c0 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:06.089470 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb533abb-b4b3-46eb-a014-13d57f5b27c0 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:06.090171 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb533abb-b4b3-46eb-a014-13d57f5b27c0 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:06.091013 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb533abb-b4b3-46eb-a014-13d57f5b27c0 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:06.091608 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb533abb-b4b3-46eb-a014-13d57f5b27c0 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:06.092160 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb533abb-b4b3-46eb-a014-13d57f5b27c0 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:06.127775 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=12 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:48:06.359875 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=8 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:48:06.399996 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-83412e0c-80e2-4094-bbc8-fd588c72380b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:06.410163 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-83412e0c-80e2-4094-bbc8-fd588c72380b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f" status: 200 len: 1393 microversion: 2.1 time: 0.958099 Oct 26 13:48:06.424127 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3352/6674] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:05 2022] GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f => generated 1393 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:06.424127 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d0dfbb13-9a03-4f95-924f-8b5745a9d69e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:06.424452 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d0dfbb13-9a03-4f95-924f-8b5745a9d69e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: a8fe4a06-f75b-41c4-a716-976652361744] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:06.444273 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0dfbb13-9a03-4f95-924f-8b5745a9d69e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:06.446240 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0dfbb13-9a03-4f95-924f-8b5745a9d69e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:06.447189 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0dfbb13-9a03-4f95-924f-8b5745a9d69e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:06.451988 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0dfbb13-9a03-4f95-924f-8b5745a9d69e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:06.452740 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0dfbb13-9a03-4f95-924f-8b5745a9d69e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:06.453381 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0dfbb13-9a03-4f95-924f-8b5745a9d69e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:06.497827 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bb533abb-b4b3-46eb-a014-13d57f5b27c0 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725949c28f9742beb622b98e84c67646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffe02c0779d465f93762150cb94114f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:06.527271 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bb533abb-b4b3-46eb-a014-13d57f5b27c0 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] 10.222.0.40 "GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce" status: 200 len: 1729 microversion: 2.1 time: 0.458039 Oct 26 13:48:06.528151 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3323/6675] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:06 2022] GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce => generated 1729 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:48:06.840203 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d0dfbb13-9a03-4f95-924f-8b5745a9d69e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:06.855169 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d0dfbb13-9a03-4f95-924f-8b5745a9d69e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744" status: 200 len: 1341 microversion: 2.1 time: 0.440120 Oct 26 13:48:06.855988 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3353/6676] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:06 2022] GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744 => generated 1341 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:07.444984 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a4a37cf7-2e4f-49da-8aaf-9781d7ebcf31 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:07.445898 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a4a37cf7-2e4f-49da-8aaf-9781d7ebcf31 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 06916a99-825b-43f6-9887-15064c6f9f0f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:07.456570 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4a37cf7-2e4f-49da-8aaf-9781d7ebcf31 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:07.458317 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4a37cf7-2e4f-49da-8aaf-9781d7ebcf31 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:07.458937 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4a37cf7-2e4f-49da-8aaf-9781d7ebcf31 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:07.460194 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4a37cf7-2e4f-49da-8aaf-9781d7ebcf31 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:07.460816 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4a37cf7-2e4f-49da-8aaf-9781d7ebcf31 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:07.461411 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4a37cf7-2e4f-49da-8aaf-9781d7ebcf31 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:07.557392 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a4cc04ec-02d7-488a-b713-b1af5de9cf8b tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:07.557960 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a4cc04ec-02d7-488a-b713-b1af5de9cf8b tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] [instance: 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:07.580235 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4cc04ec-02d7-488a-b713-b1af5de9cf8b tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:07.581128 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4cc04ec-02d7-488a-b713-b1af5de9cf8b tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:07.582422 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4cc04ec-02d7-488a-b713-b1af5de9cf8b tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:07.583400 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4cc04ec-02d7-488a-b713-b1af5de9cf8b tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:07.584037 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4cc04ec-02d7-488a-b713-b1af5de9cf8b tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:07.584625 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4cc04ec-02d7-488a-b713-b1af5de9cf8b tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:07.673030 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a4a37cf7-2e4f-49da-8aaf-9781d7ebcf31 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:07.689619 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a4a37cf7-2e4f-49da-8aaf-9781d7ebcf31 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f" status: 200 len: 1393 microversion: 2.1 time: 0.251078 Oct 26 13:48:07.703034 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3324/6677] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:07 2022] GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f => generated 1393 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:48:07.848353 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a4cc04ec-02d7-488a-b713-b1af5de9cf8b tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725949c28f9742beb622b98e84c67646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffe02c0779d465f93762150cb94114f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:07.850741 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-99bf788f-d353-43aa-8de9-f762bbf0c06e req-0421f012-5941-4b1b-a124-0d82b8628561 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce", "name": "network-vif-deleted", "tag": "88ca3dcc-b3e2-41c7-9aeb-cb461f5a8f97"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:48:07.861593 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a4cc04ec-02d7-488a-b713-b1af5de9cf8b tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] 10.222.0.40 "GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce" status: 200 len: 1662 microversion: 2.1 time: 0.308043 Oct 26 13:48:07.867318 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-99bf788f-d353-43aa-8de9-f762bbf0c06e req-0421f012-5941-4b1b-a124-0d82b8628561 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:07.869618 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3354/6678] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:07 2022] GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce => generated 1662 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:07.870500 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-99bf788f-d353-43aa-8de9-f762bbf0c06e req-0421f012-5941-4b1b-a124-0d82b8628561 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:07.872407 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-99bf788f-d353-43aa-8de9-f762bbf0c06e req-0421f012-5941-4b1b-a124-0d82b8628561 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:07.884190 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d3bcfe52-eac7-424a-ae56-b4c8d5787fc8 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:07.884831 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d3bcfe52-eac7-424a-ae56-b4c8d5787fc8 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: a8fe4a06-f75b-41c4-a716-976652361744] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:07.888658 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-99bf788f-d353-43aa-8de9-f762bbf0c06e req-0421f012-5941-4b1b-a124-0d82b8628561 service nova] Creating event network-vif-deleted:88ca3dcc-b3e2-41c7-9aeb-cb461f5a8f97 for instance 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce on n-h2-862686-1 Oct 26 13:48:07.897870 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-99bf788f-d353-43aa-8de9-f762bbf0c06e req-0421f012-5941-4b1b-a124-0d82b8628561 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053040 Oct 26 13:48:07.898804 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3325/6679] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:48:07.908445 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3bcfe52-eac7-424a-ae56-b4c8d5787fc8 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:07.908971 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3bcfe52-eac7-424a-ae56-b4c8d5787fc8 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:07.909447 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3bcfe52-eac7-424a-ae56-b4c8d5787fc8 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:07.910846 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3bcfe52-eac7-424a-ae56-b4c8d5787fc8 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:07.911430 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3bcfe52-eac7-424a-ae56-b4c8d5787fc8 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:07.917934 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3bcfe52-eac7-424a-ae56-b4c8d5787fc8 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:08.532174 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d3bcfe52-eac7-424a-ae56-b4c8d5787fc8 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:08.549059 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-79da7293-4c0c-445e-b8c8-e03c860f1a40 req-17decf87-3f24-4311-985a-adda2d023b4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06916a99-825b-43f6-9887-15064c6f9f0f", "name": "network-vif-plugged", "status": "completed", "tag": "0b277019-c139-4f21-84fc-f272d97bdd6a"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:48:08.579426 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d3bcfe52-eac7-424a-ae56-b4c8d5787fc8 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744" status: 200 len: 1341 microversion: 2.1 time: 0.703036 Oct 26 13:48:08.582693 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3355/6680] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:07 2022] GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744 => generated 1341 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:48:08.596107 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-79da7293-4c0c-445e-b8c8-e03c860f1a40 req-17decf87-3f24-4311-985a-adda2d023b4c service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:08.596816 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-79da7293-4c0c-445e-b8c8-e03c860f1a40 req-17decf87-3f24-4311-985a-adda2d023b4c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:08.598938 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-79da7293-4c0c-445e-b8c8-e03c860f1a40 req-17decf87-3f24-4311-985a-adda2d023b4c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:08.662855 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-79da7293-4c0c-445e-b8c8-e03c860f1a40 req-17decf87-3f24-4311-985a-adda2d023b4c service nova] Creating event network-vif-plugged:0b277019-c139-4f21-84fc-f272d97bdd6a for instance 06916a99-825b-43f6-9887-15064c6f9f0f on n-h1-862686-1 Oct 26 13:48:08.678663 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-79da7293-4c0c-445e-b8c8-e03c860f1a40 req-17decf87-3f24-4311-985a-adda2d023b4c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151436 Oct 26 13:48:08.681616 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3326/6681] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:48:08.715696 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-aac77c74-e098-4196-b5bf-48dec9cd3813 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:08.716518 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-aac77c74-e098-4196-b5bf-48dec9cd3813 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 06916a99-825b-43f6-9887-15064c6f9f0f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:08.727187 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aac77c74-e098-4196-b5bf-48dec9cd3813 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:08.727948 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aac77c74-e098-4196-b5bf-48dec9cd3813 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:08.728783 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aac77c74-e098-4196-b5bf-48dec9cd3813 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:08.736795 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aac77c74-e098-4196-b5bf-48dec9cd3813 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:08.739234 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aac77c74-e098-4196-b5bf-48dec9cd3813 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:08.740953 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aac77c74-e098-4196-b5bf-48dec9cd3813 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:08.898786 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2a0f426c-d8ad-47be-a274-c092942b2712 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:08.900017 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2a0f426c-d8ad-47be-a274-c092942b2712 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] [instance: 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:08.933394 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2a0f426c-d8ad-47be-a274-c092942b2712 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:08.934221 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2a0f426c-d8ad-47be-a274-c092942b2712 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:08.935074 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2a0f426c-d8ad-47be-a274-c092942b2712 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:08.936289 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2a0f426c-d8ad-47be-a274-c092942b2712 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:08.937334 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2a0f426c-d8ad-47be-a274-c092942b2712 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:08.939336 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2a0f426c-d8ad-47be-a274-c092942b2712 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:09.047111 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-aac77c74-e098-4196-b5bf-48dec9cd3813 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:09.062566 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2a0f426c-d8ad-47be-a274-c092942b2712 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:09.065099 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-aac77c74-e098-4196-b5bf-48dec9cd3813 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f" status: 200 len: 1393 microversion: 2.1 time: 0.354287 Oct 26 13:48:09.067426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2a0f426c-d8ad-47be-a274-c092942b2712 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:09.070445 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3356/6682] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:08 2022] GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f => generated 1393 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:09.070683 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2a0f426c-d8ad-47be-a274-c092942b2712 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:09.071386 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-2a0f426c-d8ad-47be-a274-c092942b2712 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lazy-loading 'fault' on Instance uuid 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:48:09.138514 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2a0f426c-d8ad-47be-a274-c092942b2712 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725949c28f9742beb622b98e84c67646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffe02c0779d465f93762150cb94114f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:09.149227 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2a0f426c-d8ad-47be-a274-c092942b2712 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] 10.222.0.40 "GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce" status: 200 len: 1387 microversion: 2.1 time: 0.257959 Oct 26 13:48:09.151091 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3327/6683] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:08 2022] GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce => generated 1387 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:09.607197 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-14eaa4cd-a947-4455-a4fb-d614efc091f9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:09.608040 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-14eaa4cd-a947-4455-a4fb-d614efc091f9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: a8fe4a06-f75b-41c4-a716-976652361744] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:09.615755 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-14eaa4cd-a947-4455-a4fb-d614efc091f9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:09.617802 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-14eaa4cd-a947-4455-a4fb-d614efc091f9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:09.617802 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-14eaa4cd-a947-4455-a4fb-d614efc091f9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:09.617802 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-14eaa4cd-a947-4455-a4fb-d614efc091f9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:09.618297 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-14eaa4cd-a947-4455-a4fb-d614efc091f9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:09.618820 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-14eaa4cd-a947-4455-a4fb-d614efc091f9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:09.788899 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-14eaa4cd-a947-4455-a4fb-d614efc091f9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:09.799165 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-14eaa4cd-a947-4455-a4fb-d614efc091f9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744" status: 200 len: 1341 microversion: 2.1 time: 0.196034 Oct 26 13:48:09.799979 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3357/6684] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:09 2022] GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744 => generated 1341 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:10.105174 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b8f950c1-5356-4ad3-ad80-c4458d64bc85 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:10.105841 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b8f950c1-5356-4ad3-ad80-c4458d64bc85 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 06916a99-825b-43f6-9887-15064c6f9f0f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:10.112731 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8f950c1-5356-4ad3-ad80-c4458d64bc85 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:10.114021 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8f950c1-5356-4ad3-ad80-c4458d64bc85 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:10.114462 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8f950c1-5356-4ad3-ad80-c4458d64bc85 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:10.115186 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8f950c1-5356-4ad3-ad80-c4458d64bc85 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:10.115643 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8f950c1-5356-4ad3-ad80-c4458d64bc85 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:10.116069 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8f950c1-5356-4ad3-ad80-c4458d64bc85 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:10.173805 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b2876623-3f36-45a8-a8f7-2af0515d448d tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:10.174477 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b2876623-3f36-45a8-a8f7-2af0515d448d tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] [instance: 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:10.180799 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b2876623-3f36-45a8-a8f7-2af0515d448d tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:10.181382 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b2876623-3f36-45a8-a8f7-2af0515d448d tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:10.182060 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b2876623-3f36-45a8-a8f7-2af0515d448d tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:10.182864 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b2876623-3f36-45a8-a8f7-2af0515d448d tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:10.183527 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b2876623-3f36-45a8-a8f7-2af0515d448d tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:10.184034 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b2876623-3f36-45a8-a8f7-2af0515d448d tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:10.207348 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-b2876623-3f36-45a8-a8f7-2af0515d448d tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] HTTP exception thrown: Instance 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce could not be found. Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b2876623-3f36-45a8-a8f7-2af0515d448d tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Request method failure captured: Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce HTTP/1.1 Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTlJdi0Qj4j8pSavB0j-PiQDGDD6HfdrGefUm12d9_-MYAMFiMsp7Rlp_s2PJl771WI1Rsh_7PTuIAtLjYEinAe1uFydkFty9puzs4mISqutxcUi2BKEVeb73eklOGrFIcRezSNuMidpX9whLeZcsKOO3DT6eFfs9hcaXQhbl4IWkqk Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 0ffe02c0779d465f93762150cb94114f Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-TestServerBasicOps-1180858215 Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0ffe02c0779d465f93762150cb94114f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0ffe02c0779d465f93762150cb94114f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0ffe02c0779d465f93762150cb94114f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0ffe02c0779d465f93762150cb94114f"}]}] Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-TestServerBasicOps-1180858215 Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 0ffe02c0779d465f93762150cb94114f Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-TestServerBasicOps-1180858215 Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-TestServerBasicOps-1180858215-project Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 725949c28f9742beb622b98e84c67646 Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-TestServerBasicOps-1180858215-project Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce could not be found. Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce'} Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce could not be found. Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce could not be found. Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:48:10.211274 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:48:10.215407 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:48:10.215407 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:48:10.215407 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:48:10.215407 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:48:10.215407 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:48:10.215407 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce could not be found. Oct 26 13:48:10.215407 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:48:10.215407 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b2876623-3f36-45a8-a8f7-2af0515d448d tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Returning 404 to user: Instance 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:48:10.215407 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b2876623-3f36-45a8-a8f7-2af0515d448d tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] 10.222.0.40 "GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce" status: 404 len: 111 microversion: 2.1 time: 0.043326 Oct 26 13:48:10.221642 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3358/6685] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:10 2022] GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 13:48:10.292623 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b8f950c1-5356-4ad3-ad80-c4458d64bc85 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:10.301905 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b8f950c1-5356-4ad3-ad80-c4458d64bc85 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f" status: 200 len: 1393 microversion: 2.1 time: 0.206626 Oct 26 13:48:10.302578 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3328/6686] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:10 2022] GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f => generated 1393 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:10.723261 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b9bf8a5e-766f-4536-a96f-335d831b9498 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:10.723845 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b9bf8a5e-766f-4536-a96f-335d831b9498 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] [instance: 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:10.731157 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9bf8a5e-766f-4536-a96f-335d831b9498 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:10.731655 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9bf8a5e-766f-4536-a96f-335d831b9498 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:10.732155 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9bf8a5e-766f-4536-a96f-335d831b9498 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:10.732860 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9bf8a5e-766f-4536-a96f-335d831b9498 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:10.733328 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9bf8a5e-766f-4536-a96f-335d831b9498 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:10.733933 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9bf8a5e-766f-4536-a96f-335d831b9498 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:10.748864 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-b9bf8a5e-766f-4536-a96f-335d831b9498 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] HTTP exception thrown: Instance 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce could not be found. Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b9bf8a5e-766f-4536-a96f-335d831b9498 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Request method failure captured: Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: request: DELETE /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce HTTP/1.1 Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTlJdi0Qj4j8pSavB0j-PiQDGDD6HfdrGefUm12d9_-MYAMFiMsp7Rlp_s2PJl771WI1Rsh_7PTuIAtLjYEinAe1uFydkFty9puzs4mISqutxcUi2BKEVeb73eklOGrFIcRezSNuMidpX9whLeZcsKOO3DT6eFfs9hcaXQhbl4IWkqk Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 0ffe02c0779d465f93762150cb94114f Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-TestServerBasicOps-1180858215 Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0ffe02c0779d465f93762150cb94114f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0ffe02c0779d465f93762150cb94114f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0ffe02c0779d465f93762150cb94114f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0ffe02c0779d465f93762150cb94114f"}]}] Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-TestServerBasicOps-1180858215 Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 0ffe02c0779d465f93762150cb94114f Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-TestServerBasicOps-1180858215 Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-TestServerBasicOps-1180858215-project Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 725949c28f9742beb622b98e84c67646 Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-TestServerBasicOps-1180858215-project Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce could not be found. Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce'} Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce could not be found. Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:48:10.750581 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:48:10.757954 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce could not be found. Oct 26 13:48:10.757954 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:48:10.757954 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:48:10.757954 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:48:10.757954 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:48:10.757954 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:48:10.757954 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:48:10.757954 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:48:10.757954 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:48:10.757954 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce could not be found. Oct 26 13:48:10.757954 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:48:10.757954 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b9bf8a5e-766f-4536-a96f-335d831b9498 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Returning 404 to user: Instance 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:48:10.757954 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b9bf8a5e-766f-4536-a96f-335d831b9498 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce" status: 404 len: 111 microversion: 2.1 time: 0.032820 Oct 26 13:48:10.757954 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3359/6687] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:48:10 2022] DELETE /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:48:10.763186 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c4e615d3-04be-4944-9ca7-1ae4d3cd3326 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:10.763828 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c4e615d3-04be-4944-9ca7-1ae4d3cd3326 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] [instance: 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:10.770347 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4e615d3-04be-4944-9ca7-1ae4d3cd3326 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:10.770887 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4e615d3-04be-4944-9ca7-1ae4d3cd3326 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:10.771332 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4e615d3-04be-4944-9ca7-1ae4d3cd3326 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:10.772027 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4e615d3-04be-4944-9ca7-1ae4d3cd3326 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:10.772485 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4e615d3-04be-4944-9ca7-1ae4d3cd3326 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:10.772913 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4e615d3-04be-4944-9ca7-1ae4d3cd3326 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:10.787807 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-c4e615d3-04be-4944-9ca7-1ae4d3cd3326 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] HTTP exception thrown: Instance 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce could not be found. Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c4e615d3-04be-4944-9ca7-1ae4d3cd3326 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Request method failure captured: Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce HTTP/1.1 Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTlJdi0Qj4j8pSavB0j-PiQDGDD6HfdrGefUm12d9_-MYAMFiMsp7Rlp_s2PJl771WI1Rsh_7PTuIAtLjYEinAe1uFydkFty9puzs4mISqutxcUi2BKEVeb73eklOGrFIcRezSNuMidpX9whLeZcsKOO3DT6eFfs9hcaXQhbl4IWkqk Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 0ffe02c0779d465f93762150cb94114f Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-TestServerBasicOps-1180858215 Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0ffe02c0779d465f93762150cb94114f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0ffe02c0779d465f93762150cb94114f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0ffe02c0779d465f93762150cb94114f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0ffe02c0779d465f93762150cb94114f"}]}] Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-TestServerBasicOps-1180858215 Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 0ffe02c0779d465f93762150cb94114f Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-TestServerBasicOps-1180858215 Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-TestServerBasicOps-1180858215-project Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 725949c28f9742beb622b98e84c67646 Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-TestServerBasicOps-1180858215-project Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce could not be found. Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce'} Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce could not be found. Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce could not be found. Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:48:10.790077 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:48:10.794356 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:48:10.794356 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:48:10.794356 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:48:10.794356 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:48:10.794356 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:48:10.794356 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce could not be found. Oct 26 13:48:10.794356 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:48:10.794356 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c4e615d3-04be-4944-9ca7-1ae4d3cd3326 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Returning 404 to user: Instance 3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:48:10.794356 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c4e615d3-04be-4944-9ca7-1ae4d3cd3326 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] 10.222.0.40 "GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce" status: 404 len: 111 microversion: 2.1 time: 0.032815 Oct 26 13:48:10.795448 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3329/6688] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:10 2022] GET /compute/v2.1/servers/3cb68495-7bbf-4195-9f2f-1b5fd7ab75ce => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:48:10.824418 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-15511c4b-2b6d-4a2d-a156-83f4ceba887a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:10.825047 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-15511c4b-2b6d-4a2d-a156-83f4ceba887a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: a8fe4a06-f75b-41c4-a716-976652361744] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:10.831779 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15511c4b-2b6d-4a2d-a156-83f4ceba887a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:10.832315 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15511c4b-2b6d-4a2d-a156-83f4ceba887a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:10.832947 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15511c4b-2b6d-4a2d-a156-83f4ceba887a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:10.833966 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15511c4b-2b6d-4a2d-a156-83f4ceba887a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:10.834623 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15511c4b-2b6d-4a2d-a156-83f4ceba887a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:10.835188 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15511c4b-2b6d-4a2d-a156-83f4ceba887a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:11.011766 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-15511c4b-2b6d-4a2d-a156-83f4ceba887a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:11.022654 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f52d265b-003e-402c-960a-95ed1fd1b872 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] Calling method '.version_select at 0x7f673151bb80>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:11.052516 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-15511c4b-2b6d-4a2d-a156-83f4ceba887a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744" status: 200 len: 1341 microversion: 2.1 time: 0.231414 Oct 26 13:48:11.053126 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3360/6689] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:10 2022] GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744 => generated 1341 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:11.082367 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f52d265b-003e-402c-960a-95ed1fd1b872 tempest-TestServerBasicOps-1180858215 tempest-TestServerBasicOps-1180858215-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-209691635" status: 202 len: 0 microversion: 2.1 time: 0.084077 Oct 26 13:48:11.083031 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3330/6690] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Oct 26 13:48:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-209691635 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:48:11.327646 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-32072d87-ad7f-487d-84b3-4380b796661e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:11.328584 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-32072d87-ad7f-487d-84b3-4380b796661e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 06916a99-825b-43f6-9887-15064c6f9f0f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:11.348358 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32072d87-ad7f-487d-84b3-4380b796661e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:11.349205 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32072d87-ad7f-487d-84b3-4380b796661e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:11.349987 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32072d87-ad7f-487d-84b3-4380b796661e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:11.350942 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32072d87-ad7f-487d-84b3-4380b796661e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:11.351605 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32072d87-ad7f-487d-84b3-4380b796661e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:11.352293 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32072d87-ad7f-487d-84b3-4380b796661e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:11.605938 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-32072d87-ad7f-487d-84b3-4380b796661e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:11.608330 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:48:11.620682 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-32072d87-ad7f-487d-84b3-4380b796661e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f" status: 200 len: 1566 microversion: 2.1 time: 0.297815 Oct 26 13:48:11.632791 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3361/6691] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:11 2022] GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f => generated 1566 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:11.650294 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-423690ea-f944-457c-8ea6-efe436fc9ca4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:11.651518 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-423690ea-f944-457c-8ea6-efe436fc9ca4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 06916a99-825b-43f6-9887-15064c6f9f0f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:11.661887 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-423690ea-f944-457c-8ea6-efe436fc9ca4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:11.662638 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-423690ea-f944-457c-8ea6-efe436fc9ca4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:11.663290 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-423690ea-f944-457c-8ea6-efe436fc9ca4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:11.664482 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-423690ea-f944-457c-8ea6-efe436fc9ca4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:11.667187 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-423690ea-f944-457c-8ea6-efe436fc9ca4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:11.667801 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-423690ea-f944-457c-8ea6-efe436fc9ca4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:11.826713 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-423690ea-f944-457c-8ea6-efe436fc9ca4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:11.836585 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-423690ea-f944-457c-8ea6-efe436fc9ca4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f" status: 200 len: 1566 microversion: 2.1 time: 0.193947 Oct 26 13:48:11.841536 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3331/6692] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:11 2022] GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f => generated 1566 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:12.077289 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-002d60cc-3a10-4a48-b3c1-28f6c5b9bbfa tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:12.077944 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-002d60cc-3a10-4a48-b3c1-28f6c5b9bbfa tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: a8fe4a06-f75b-41c4-a716-976652361744] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:12.101245 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-002d60cc-3a10-4a48-b3c1-28f6c5b9bbfa tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:12.102950 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-002d60cc-3a10-4a48-b3c1-28f6c5b9bbfa tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:12.103642 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-002d60cc-3a10-4a48-b3c1-28f6c5b9bbfa tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:12.104850 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-002d60cc-3a10-4a48-b3c1-28f6c5b9bbfa tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:12.106483 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-002d60cc-3a10-4a48-b3c1-28f6c5b9bbfa tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:12.107406 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-002d60cc-3a10-4a48-b3c1-28f6c5b9bbfa tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:12.367284 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-002d60cc-3a10-4a48-b3c1-28f6c5b9bbfa tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:12.386333 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-002d60cc-3a10-4a48-b3c1-28f6c5b9bbfa tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744" status: 200 len: 1341 microversion: 2.1 time: 0.313834 Oct 26 13:48:12.388689 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3362/6693] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:12 2022] GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744 => generated 1341 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:13.428520 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c0cad611-d43a-47ab-a507-b3113cec526b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:13.430349 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c0cad611-d43a-47ab-a507-b3113cec526b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: a8fe4a06-f75b-41c4-a716-976652361744] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:13.453050 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0cad611-d43a-47ab-a507-b3113cec526b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:13.456129 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0cad611-d43a-47ab-a507-b3113cec526b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:13.458736 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0cad611-d43a-47ab-a507-b3113cec526b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:13.460324 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0cad611-d43a-47ab-a507-b3113cec526b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:13.461207 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0cad611-d43a-47ab-a507-b3113cec526b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:13.463880 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0cad611-d43a-47ab-a507-b3113cec526b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:13.838186 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c0cad611-d43a-47ab-a507-b3113cec526b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:13.846311 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c0cad611-d43a-47ab-a507-b3113cec526b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744" status: 200 len: 1341 microversion: 2.1 time: 0.436473 Oct 26 13:48:13.859334 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3332/6694] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:13 2022] GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744 => generated 1341 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:14.876538 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-87b45aae-35d8-4ee7-9c0d-f0120df75f07 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:14.877169 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-87b45aae-35d8-4ee7-9c0d-f0120df75f07 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: a8fe4a06-f75b-41c4-a716-976652361744] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:14.891599 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87b45aae-35d8-4ee7-9c0d-f0120df75f07 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:14.892115 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87b45aae-35d8-4ee7-9c0d-f0120df75f07 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:14.898388 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87b45aae-35d8-4ee7-9c0d-f0120df75f07 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:14.901511 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87b45aae-35d8-4ee7-9c0d-f0120df75f07 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:14.902235 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87b45aae-35d8-4ee7-9c0d-f0120df75f07 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:14.902743 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87b45aae-35d8-4ee7-9c0d-f0120df75f07 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:14.992946 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c2a74ad6-7138-4f0b-a178-d7dd1b744e5a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:14.993595 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c2a74ad6-7138-4f0b-a178-d7dd1b744e5a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 06916a99-825b-43f6-9887-15064c6f9f0f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:15.009840 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c2a74ad6-7138-4f0b-a178-d7dd1b744e5a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:15.011784 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c2a74ad6-7138-4f0b-a178-d7dd1b744e5a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:15.012256 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c2a74ad6-7138-4f0b-a178-d7dd1b744e5a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:15.013813 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c2a74ad6-7138-4f0b-a178-d7dd1b744e5a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:15.014290 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c2a74ad6-7138-4f0b-a178-d7dd1b744e5a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:15.014851 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c2a74ad6-7138-4f0b-a178-d7dd1b744e5a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:15.024721 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:48:15.278618 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c2a74ad6-7138-4f0b-a178-d7dd1b744e5a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:15.285001 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-87b45aae-35d8-4ee7-9c0d-f0120df75f07 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:15.298085 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-87b45aae-35d8-4ee7-9c0d-f0120df75f07 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744" status: 200 len: 1341 microversion: 2.1 time: 0.425480 Oct 26 13:48:15.308965 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c2a74ad6-7138-4f0b-a178-d7dd1b744e5a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f" status: 200 len: 1566 microversion: 2.1 time: 0.321806 Oct 26 13:48:15.309828 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3333/6695] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:14 2022] GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f => generated 1566 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:48:15.316971 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3363/6696] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:14 2022] GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744 => generated 1341 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:15.492481 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-ff4e0249-e994-4130-b668-71bb60478608 req-65789225-91e7-4db3-902e-128eb39e4de7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06916a99-825b-43f6-9887-15064c6f9f0f", "tag": "0b277019-c139-4f21-84fc-f272d97bdd6a"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:48:15.503968 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ff4e0249-e994-4130-b668-71bb60478608 req-65789225-91e7-4db3-902e-128eb39e4de7 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:15.504696 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ff4e0249-e994-4130-b668-71bb60478608 req-65789225-91e7-4db3-902e-128eb39e4de7 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:15.505343 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ff4e0249-e994-4130-b668-71bb60478608 req-65789225-91e7-4db3-902e-128eb39e4de7 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:15.541642 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-ff4e0249-e994-4130-b668-71bb60478608 req-65789225-91e7-4db3-902e-128eb39e4de7 service nova] Creating event network-changed:0b277019-c139-4f21-84fc-f272d97bdd6a for instance 06916a99-825b-43f6-9887-15064c6f9f0f on n-h1-862686-1 Oct 26 13:48:15.557259 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-ff4e0249-e994-4130-b668-71bb60478608 req-65789225-91e7-4db3-902e-128eb39e4de7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.245905 Oct 26 13:48:15.557916 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3334/6697] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:48:16.342398 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c89a22eb-d217-4f2f-908a-7f97e4f8c14b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:16.343819 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c89a22eb-d217-4f2f-908a-7f97e4f8c14b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: a8fe4a06-f75b-41c4-a716-976652361744] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:16.354041 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c89a22eb-d217-4f2f-908a-7f97e4f8c14b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:16.355260 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c89a22eb-d217-4f2f-908a-7f97e4f8c14b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:16.355960 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c89a22eb-d217-4f2f-908a-7f97e4f8c14b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:16.357164 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c89a22eb-d217-4f2f-908a-7f97e4f8c14b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:16.358209 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c89a22eb-d217-4f2f-908a-7f97e4f8c14b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:16.358899 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c89a22eb-d217-4f2f-908a-7f97e4f8c14b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:16.716062 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c89a22eb-d217-4f2f-908a-7f97e4f8c14b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:16.728937 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c89a22eb-d217-4f2f-908a-7f97e4f8c14b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744" status: 200 len: 1387 microversion: 2.1 time: 0.390602 Oct 26 13:48:16.729813 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3364/6698] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:16 2022] GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744 => generated 1387 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:17.757229 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2b1c0610-b23a-4bb4-9196-5d30fd8d2a54 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:17.758153 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2b1c0610-b23a-4bb4-9196-5d30fd8d2a54 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: a8fe4a06-f75b-41c4-a716-976652361744] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:17.765068 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b1c0610-b23a-4bb4-9196-5d30fd8d2a54 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:17.765592 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b1c0610-b23a-4bb4-9196-5d30fd8d2a54 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:17.766091 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b1c0610-b23a-4bb4-9196-5d30fd8d2a54 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:17.766820 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b1c0610-b23a-4bb4-9196-5d30fd8d2a54 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:17.767260 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b1c0610-b23a-4bb4-9196-5d30fd8d2a54 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:17.767722 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b1c0610-b23a-4bb4-9196-5d30fd8d2a54 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:17.944140 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2b1c0610-b23a-4bb4-9196-5d30fd8d2a54 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:17.954084 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2b1c0610-b23a-4bb4-9196-5d30fd8d2a54 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744" status: 200 len: 1375 microversion: 2.1 time: 0.204190 Oct 26 13:48:17.977321 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3335/6699] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:17 2022] GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744 => generated 1375 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:18.988183 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b772c791-acff-4e5a-84fb-3b1cd1b59f43 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:18.989178 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b772c791-acff-4e5a-84fb-3b1cd1b59f43 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: a8fe4a06-f75b-41c4-a716-976652361744] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:19.005011 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b772c791-acff-4e5a-84fb-3b1cd1b59f43 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:19.005888 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b772c791-acff-4e5a-84fb-3b1cd1b59f43 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:19.006759 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b772c791-acff-4e5a-84fb-3b1cd1b59f43 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:19.007795 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b772c791-acff-4e5a-84fb-3b1cd1b59f43 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:19.008501 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b772c791-acff-4e5a-84fb-3b1cd1b59f43 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:19.009298 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b772c791-acff-4e5a-84fb-3b1cd1b59f43 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:19.219193 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b772c791-acff-4e5a-84fb-3b1cd1b59f43 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:19.227928 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b772c791-acff-4e5a-84fb-3b1cd1b59f43 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744" status: 200 len: 1375 microversion: 2.1 time: 0.248828 Oct 26 13:48:19.241614 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3365/6700] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:18 2022] GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744 => generated 1375 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:20.254817 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-198f2621-741c-45fe-932f-1c70e6797579 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:20.255744 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-198f2621-741c-45fe-932f-1c70e6797579 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: a8fe4a06-f75b-41c4-a716-976652361744] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:20.274637 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-198f2621-741c-45fe-932f-1c70e6797579 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:20.275432 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-198f2621-741c-45fe-932f-1c70e6797579 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:20.276380 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-198f2621-741c-45fe-932f-1c70e6797579 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:20.278028 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-198f2621-741c-45fe-932f-1c70e6797579 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:20.279349 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-198f2621-741c-45fe-932f-1c70e6797579 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:20.280945 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-198f2621-741c-45fe-932f-1c70e6797579 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:20.518093 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-198f2621-741c-45fe-932f-1c70e6797579 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:20.544780 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-198f2621-741c-45fe-932f-1c70e6797579 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744" status: 200 len: 1375 microversion: 2.1 time: 0.296022 Oct 26 13:48:20.551290 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3336/6701] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:20 2022] GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744 => generated 1375 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:21.573525 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-798347cb-5568-4236-9c7f-f743b826bd3b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:21.574727 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-798347cb-5568-4236-9c7f-f743b826bd3b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: a8fe4a06-f75b-41c4-a716-976652361744] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:21.584162 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-798347cb-5568-4236-9c7f-f743b826bd3b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:21.584889 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-798347cb-5568-4236-9c7f-f743b826bd3b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:21.585661 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-798347cb-5568-4236-9c7f-f743b826bd3b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:21.586565 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-798347cb-5568-4236-9c7f-f743b826bd3b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:21.587192 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-798347cb-5568-4236-9c7f-f743b826bd3b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:21.587815 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-798347cb-5568-4236-9c7f-f743b826bd3b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:21.807730 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-798347cb-5568-4236-9c7f-f743b826bd3b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:21.817909 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-798347cb-5568-4236-9c7f-f743b826bd3b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744" status: 200 len: 1375 microversion: 2.1 time: 0.249855 Oct 26 13:48:21.833960 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3366/6702] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:21 2022] GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744 => generated 1375 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:22.844126 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b9b389f6-ae46-41f6-b684-bc76a5814f33 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:22.844737 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b9b389f6-ae46-41f6-b684-bc76a5814f33 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: a8fe4a06-f75b-41c4-a716-976652361744] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:22.853017 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b9b389f6-ae46-41f6-b684-bc76a5814f33 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:22.853528 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b9b389f6-ae46-41f6-b684-bc76a5814f33 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:22.853972 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b9b389f6-ae46-41f6-b684-bc76a5814f33 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:22.854678 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b9b389f6-ae46-41f6-b684-bc76a5814f33 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:22.855153 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b9b389f6-ae46-41f6-b684-bc76a5814f33 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:22.855583 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b9b389f6-ae46-41f6-b684-bc76a5814f33 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:22.998187 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b9b389f6-ae46-41f6-b684-bc76a5814f33 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:23.007263 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b9b389f6-ae46-41f6-b684-bc76a5814f33 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744" status: 200 len: 1375 microversion: 2.1 time: 0.167651 Oct 26 13:48:23.007932 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3337/6703] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:22 2022] GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744 => generated 1375 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:24.033862 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-157564c5-a723-4b6a-8bc2-8cdcbdee1b41 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:24.035148 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-157564c5-a723-4b6a-8bc2-8cdcbdee1b41 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: a8fe4a06-f75b-41c4-a716-976652361744] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:24.043261 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-157564c5-a723-4b6a-8bc2-8cdcbdee1b41 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:24.043803 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-157564c5-a723-4b6a-8bc2-8cdcbdee1b41 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:24.044391 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-157564c5-a723-4b6a-8bc2-8cdcbdee1b41 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:24.045297 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-157564c5-a723-4b6a-8bc2-8cdcbdee1b41 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:24.045829 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-157564c5-a723-4b6a-8bc2-8cdcbdee1b41 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:24.046317 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-157564c5-a723-4b6a-8bc2-8cdcbdee1b41 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:24.188213 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-157564c5-a723-4b6a-8bc2-8cdcbdee1b41 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:24.196868 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-157564c5-a723-4b6a-8bc2-8cdcbdee1b41 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744" status: 200 len: 1375 microversion: 2.1 time: 0.167155 Oct 26 13:48:24.197795 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3367/6704] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:24 2022] GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744 => generated 1375 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:25.222139 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9cedeb52-c5ca-4403-be76-aa99f1c18b5c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:25.222861 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9cedeb52-c5ca-4403-be76-aa99f1c18b5c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: a8fe4a06-f75b-41c4-a716-976652361744] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:25.230566 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9cedeb52-c5ca-4403-be76-aa99f1c18b5c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:25.231109 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9cedeb52-c5ca-4403-be76-aa99f1c18b5c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:25.231641 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9cedeb52-c5ca-4403-be76-aa99f1c18b5c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:25.232458 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9cedeb52-c5ca-4403-be76-aa99f1c18b5c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:25.232944 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9cedeb52-c5ca-4403-be76-aa99f1c18b5c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:25.233414 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9cedeb52-c5ca-4403-be76-aa99f1c18b5c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:25.391786 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9cedeb52-c5ca-4403-be76-aa99f1c18b5c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:25.403483 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9cedeb52-c5ca-4403-be76-aa99f1c18b5c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744" status: 200 len: 1375 microversion: 2.1 time: 0.185467 Oct 26 13:48:25.404499 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3338/6705] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:25 2022] GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744 => generated 1375 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:26.427570 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bcdbfad0-dbf1-4494-bec7-b43d6affd2b0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:26.428118 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bcdbfad0-dbf1-4494-bec7-b43d6affd2b0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: a8fe4a06-f75b-41c4-a716-976652361744] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:26.434303 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bcdbfad0-dbf1-4494-bec7-b43d6affd2b0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:26.435008 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bcdbfad0-dbf1-4494-bec7-b43d6affd2b0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:26.435647 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bcdbfad0-dbf1-4494-bec7-b43d6affd2b0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:26.436568 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bcdbfad0-dbf1-4494-bec7-b43d6affd2b0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:26.437198 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bcdbfad0-dbf1-4494-bec7-b43d6affd2b0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:26.437839 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bcdbfad0-dbf1-4494-bec7-b43d6affd2b0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:26.451105 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-0cf3adda-a522-4f51-b63c-5a5c83a431ad req-cf99f8b8-c687-455c-870d-c03a79398226 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8fe4a06-f75b-41c4-a716-976652361744", "name": "network-vif-plugged", "status": "completed", "tag": "7a51b387-00fd-405a-a777-75be8875aa41"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:48:26.475825 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-0cf3adda-a522-4f51-b63c-5a5c83a431ad req-cf99f8b8-c687-455c-870d-c03a79398226 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:26.477636 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-0cf3adda-a522-4f51-b63c-5a5c83a431ad req-cf99f8b8-c687-455c-870d-c03a79398226 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:26.478314 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-0cf3adda-a522-4f51-b63c-5a5c83a431ad req-cf99f8b8-c687-455c-870d-c03a79398226 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:26.507039 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-0cf3adda-a522-4f51-b63c-5a5c83a431ad req-cf99f8b8-c687-455c-870d-c03a79398226 service nova] Creating event network-vif-plugged:7a51b387-00fd-405a-a777-75be8875aa41 for instance a8fe4a06-f75b-41c4-a716-976652361744 on n-h2-862686-1 Oct 26 13:48:26.538076 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-0cf3adda-a522-4f51-b63c-5a5c83a431ad req-cf99f8b8-c687-455c-870d-c03a79398226 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093328 Oct 26 13:48:26.543748 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3339/6706] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:48:26.634081 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bcdbfad0-dbf1-4494-bec7-b43d6affd2b0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:26.644839 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bcdbfad0-dbf1-4494-bec7-b43d6affd2b0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744" status: 200 len: 1375 microversion: 2.1 time: 0.221452 Oct 26 13:48:26.645802 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3368/6707] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:26 2022] GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744 => generated 1375 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:27.670602 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8ba11f65-2bd6-4970-a045-c79077693479 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:27.671866 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8ba11f65-2bd6-4970-a045-c79077693479 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: a8fe4a06-f75b-41c4-a716-976652361744] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:27.679526 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8ba11f65-2bd6-4970-a045-c79077693479 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:27.680199 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8ba11f65-2bd6-4970-a045-c79077693479 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:27.680632 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8ba11f65-2bd6-4970-a045-c79077693479 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:27.681327 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8ba11f65-2bd6-4970-a045-c79077693479 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:27.681801 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8ba11f65-2bd6-4970-a045-c79077693479 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:27.682396 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8ba11f65-2bd6-4970-a045-c79077693479 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:27.860753 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8ba11f65-2bd6-4970-a045-c79077693479 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:27.876435 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8ba11f65-2bd6-4970-a045-c79077693479 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744" status: 200 len: 1375 microversion: 2.1 time: 0.205426 Oct 26 13:48:27.877664 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3340/6708] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:27 2022] GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744 => generated 1375 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:28.904161 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1fad2254-b97b-4ff5-8c51-bfb043ffbfd6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:28.904910 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1fad2254-b97b-4ff5-8c51-bfb043ffbfd6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: a8fe4a06-f75b-41c4-a716-976652361744] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:28.907757 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:48:28.915140 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1fad2254-b97b-4ff5-8c51-bfb043ffbfd6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:28.915717 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1fad2254-b97b-4ff5-8c51-bfb043ffbfd6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:28.916256 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1fad2254-b97b-4ff5-8c51-bfb043ffbfd6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:28.917051 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1fad2254-b97b-4ff5-8c51-bfb043ffbfd6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:28.917550 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1fad2254-b97b-4ff5-8c51-bfb043ffbfd6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:28.917992 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1fad2254-b97b-4ff5-8c51-bfb043ffbfd6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:29.056997 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1fad2254-b97b-4ff5-8c51-bfb043ffbfd6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:29.065816 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1fad2254-b97b-4ff5-8c51-bfb043ffbfd6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744" status: 200 len: 1563 microversion: 2.1 time: 0.165583 Oct 26 13:48:29.066401 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3369/6709] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:28 2022] GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744 => generated 1563 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:29.087556 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c43ba357-2d04-4306-a54e-98b73425514e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:29.088173 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c43ba357-2d04-4306-a54e-98b73425514e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: a8fe4a06-f75b-41c4-a716-976652361744] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:29.090924 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:48:29.096210 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c43ba357-2d04-4306-a54e-98b73425514e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:29.097188 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c43ba357-2d04-4306-a54e-98b73425514e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:29.098229 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c43ba357-2d04-4306-a54e-98b73425514e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:29.098929 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c43ba357-2d04-4306-a54e-98b73425514e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:29.099384 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c43ba357-2d04-4306-a54e-98b73425514e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:29.099807 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c43ba357-2d04-4306-a54e-98b73425514e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:29.233005 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c43ba357-2d04-4306-a54e-98b73425514e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:29.241509 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c43ba357-2d04-4306-a54e-98b73425514e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744" status: 200 len: 1563 microversion: 2.1 time: 0.157747 Oct 26 13:48:29.242095 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3341/6710] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:29 2022] GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:29.324109 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c1521285-c17a-4431-8991-3fcf016f7b41 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:29.324621 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c1521285-c17a-4431-8991-3fcf016f7b41 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: a8fe4a06-f75b-41c4-a716-976652361744] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:29.330624 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c1521285-c17a-4431-8991-3fcf016f7b41 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:29.331703 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c1521285-c17a-4431-8991-3fcf016f7b41 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:29.332156 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c1521285-c17a-4431-8991-3fcf016f7b41 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:29.332859 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c1521285-c17a-4431-8991-3fcf016f7b41 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:29.333326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c1521285-c17a-4431-8991-3fcf016f7b41 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:29.333792 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c1521285-c17a-4431-8991-3fcf016f7b41 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:29.360347 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c1521285-c17a-4431-8991-3fcf016f7b41 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: a8fe4a06-f75b-41c4-a716-976652361744] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:48:29.439608 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c1521285-c17a-4431-8991-3fcf016f7b41 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744" status: 204 len: 0 microversion: 2.1 time: 0.119084 Oct 26 13:48:29.440479 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3370/6711] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:48:29 2022] DELETE /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:48:29.449261 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5917e29e-2109-4c2a-a6d5-ec7a5c342e6c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:29.449913 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5917e29e-2109-4c2a-a6d5-ec7a5c342e6c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: a8fe4a06-f75b-41c4-a716-976652361744] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:29.456612 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5917e29e-2109-4c2a-a6d5-ec7a5c342e6c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:29.457238 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5917e29e-2109-4c2a-a6d5-ec7a5c342e6c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:29.457719 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5917e29e-2109-4c2a-a6d5-ec7a5c342e6c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:29.458414 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5917e29e-2109-4c2a-a6d5-ec7a5c342e6c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:29.458873 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5917e29e-2109-4c2a-a6d5-ec7a5c342e6c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:29.459296 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5917e29e-2109-4c2a-a6d5-ec7a5c342e6c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:29.589528 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5917e29e-2109-4c2a-a6d5-ec7a5c342e6c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:29.598580 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5917e29e-2109-4c2a-a6d5-ec7a5c342e6c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744" status: 200 len: 1569 microversion: 2.1 time: 0.153517 Oct 26 13:48:29.599410 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3342/6712] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:29 2022] GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:30.622619 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0e8db873-ec7f-4161-ae61-c9989d8f1717 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:30.623321 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0e8db873-ec7f-4161-ae61-c9989d8f1717 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: a8fe4a06-f75b-41c4-a716-976652361744] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:30.630905 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0e8db873-ec7f-4161-ae61-c9989d8f1717 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:30.631393 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0e8db873-ec7f-4161-ae61-c9989d8f1717 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:30.631846 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0e8db873-ec7f-4161-ae61-c9989d8f1717 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:30.632546 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0e8db873-ec7f-4161-ae61-c9989d8f1717 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:30.633009 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0e8db873-ec7f-4161-ae61-c9989d8f1717 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:30.633440 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0e8db873-ec7f-4161-ae61-c9989d8f1717 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:30.764456 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0e8db873-ec7f-4161-ae61-c9989d8f1717 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:30.772668 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0e8db873-ec7f-4161-ae61-c9989d8f1717 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744" status: 200 len: 1569 microversion: 2.1 time: 0.154328 Oct 26 13:48:30.773233 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3371/6713] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:30 2022] GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:31.491654 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-c9b42da0-ed4c-4323-930a-23d34846e8f1 req-1c4c10c7-5334-4f7a-bbde-3681e4b46401 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8fe4a06-f75b-41c4-a716-976652361744", "name": "network-vif-deleted", "tag": "7a51b387-00fd-405a-a777-75be8875aa41"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:48:31.502943 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-c9b42da0-ed4c-4323-930a-23d34846e8f1 req-1c4c10c7-5334-4f7a-bbde-3681e4b46401 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:31.504052 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-c9b42da0-ed4c-4323-930a-23d34846e8f1 req-1c4c10c7-5334-4f7a-bbde-3681e4b46401 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:31.510891 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-c9b42da0-ed4c-4323-930a-23d34846e8f1 req-1c4c10c7-5334-4f7a-bbde-3681e4b46401 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:31.524471 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-c9b42da0-ed4c-4323-930a-23d34846e8f1 req-1c4c10c7-5334-4f7a-bbde-3681e4b46401 service nova] Creating event network-vif-deleted:7a51b387-00fd-405a-a777-75be8875aa41 for instance a8fe4a06-f75b-41c4-a716-976652361744 on n-h2-862686-1 Oct 26 13:48:31.530412 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-c9b42da0-ed4c-4323-930a-23d34846e8f1 req-1c4c10c7-5334-4f7a-bbde-3681e4b46401 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042460 Oct 26 13:48:31.531676 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3343/6714] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:48:31.796344 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ae187b2b-4cf7-4f35-a1d7-f0133da6c89d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:31.796979 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ae187b2b-4cf7-4f35-a1d7-f0133da6c89d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: a8fe4a06-f75b-41c4-a716-976652361744] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:31.804852 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae187b2b-4cf7-4f35-a1d7-f0133da6c89d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:31.805350 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae187b2b-4cf7-4f35-a1d7-f0133da6c89d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:31.805834 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae187b2b-4cf7-4f35-a1d7-f0133da6c89d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:31.806546 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae187b2b-4cf7-4f35-a1d7-f0133da6c89d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:31.807014 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae187b2b-4cf7-4f35-a1d7-f0133da6c89d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:31.807474 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae187b2b-4cf7-4f35-a1d7-f0133da6c89d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:31.880529 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ae187b2b-4cf7-4f35-a1d7-f0133da6c89d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:31.888656 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ae187b2b-4cf7-4f35-a1d7-f0133da6c89d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744" status: 200 len: 1360 microversion: 2.1 time: 0.096350 Oct 26 13:48:31.889226 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3372/6715] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:31 2022] GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744 => generated 1360 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:32.912890 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-41b2ab35-c808-47de-b661-1656c0ae2000 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:32.913955 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-41b2ab35-c808-47de-b661-1656c0ae2000 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: a8fe4a06-f75b-41c4-a716-976652361744] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:32.920228 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41b2ab35-c808-47de-b661-1656c0ae2000 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:32.920743 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41b2ab35-c808-47de-b661-1656c0ae2000 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:32.921420 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41b2ab35-c808-47de-b661-1656c0ae2000 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:32.922073 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41b2ab35-c808-47de-b661-1656c0ae2000 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:32.922525 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41b2ab35-c808-47de-b661-1656c0ae2000 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:32.922949 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41b2ab35-c808-47de-b661-1656c0ae2000 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:32.992557 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-41b2ab35-c808-47de-b661-1656c0ae2000 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:33.000636 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-41b2ab35-c808-47de-b661-1656c0ae2000 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744" status: 200 len: 1360 microversion: 2.1 time: 0.093067 Oct 26 13:48:33.001208 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3344/6716] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:32 2022] GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744 => generated 1360 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:34.024581 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f06b130a-c003-45cf-b1b4-428ccc348a5d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:34.025379 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f06b130a-c003-45cf-b1b4-428ccc348a5d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: a8fe4a06-f75b-41c4-a716-976652361744] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:34.032679 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f06b130a-c003-45cf-b1b4-428ccc348a5d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:34.033195 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f06b130a-c003-45cf-b1b4-428ccc348a5d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:34.033681 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f06b130a-c003-45cf-b1b4-428ccc348a5d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:34.034432 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f06b130a-c003-45cf-b1b4-428ccc348a5d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:34.035033 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f06b130a-c003-45cf-b1b4-428ccc348a5d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:34.035611 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f06b130a-c003-45cf-b1b4-428ccc348a5d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:34.105131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f06b130a-c003-45cf-b1b4-428ccc348a5d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:34.113976 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f06b130a-c003-45cf-b1b4-428ccc348a5d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744" status: 200 len: 1360 microversion: 2.1 time: 0.093333 Oct 26 13:48:34.114576 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3373/6717] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:34 2022] GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744 => generated 1360 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:35.138123 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5c41515e-b3a9-42ef-b5ed-36be4a2c0558 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:35.138737 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5c41515e-b3a9-42ef-b5ed-36be4a2c0558 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: a8fe4a06-f75b-41c4-a716-976652361744] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:35.147350 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c41515e-b3a9-42ef-b5ed-36be4a2c0558 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:35.147871 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c41515e-b3a9-42ef-b5ed-36be4a2c0558 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:35.148311 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c41515e-b3a9-42ef-b5ed-36be4a2c0558 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:35.149009 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c41515e-b3a9-42ef-b5ed-36be4a2c0558 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:35.149463 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c41515e-b3a9-42ef-b5ed-36be4a2c0558 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:35.149905 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c41515e-b3a9-42ef-b5ed-36be4a2c0558 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:35.213434 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5c41515e-b3a9-42ef-b5ed-36be4a2c0558 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:35.221707 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5c41515e-b3a9-42ef-b5ed-36be4a2c0558 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744" status: 200 len: 1360 microversion: 2.1 time: 0.087562 Oct 26 13:48:35.222994 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3345/6718] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:35 2022] GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744 => generated 1360 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:36.096553 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-56509c86-0221-4577-9c47-772c9380761d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:48:36.099699 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-56509c86-0221-4577-9c47-772c9380761d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 06916a99-825b-43f6-9887-15064c6f9f0f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:36.106330 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-56509c86-0221-4577-9c47-772c9380761d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:36.106872 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-56509c86-0221-4577-9c47-772c9380761d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:36.107327 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-56509c86-0221-4577-9c47-772c9380761d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:36.108228 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-56509c86-0221-4577-9c47-772c9380761d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:36.108737 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-56509c86-0221-4577-9c47-772c9380761d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:36.109151 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-56509c86-0221-4577-9c47-772c9380761d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:36.167546 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-56509c86-0221-4577-9c47-772c9380761d tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "POST /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f/action" status: 200 len: 24570 microversion: 2.1 time: 0.370142 Oct 26 13:48:36.168243 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3374/6719] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:48:35 2022] POST /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f/action => generated 24570 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:48:36.247322 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d5e4c9d9-6bce-4bc6-81dc-b6dcbc79a39b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:36.247937 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d5e4c9d9-6bce-4bc6-81dc-b6dcbc79a39b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: a8fe4a06-f75b-41c4-a716-976652361744] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:36.257075 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d5e4c9d9-6bce-4bc6-81dc-b6dcbc79a39b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:36.257812 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d5e4c9d9-6bce-4bc6-81dc-b6dcbc79a39b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:36.258418 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d5e4c9d9-6bce-4bc6-81dc-b6dcbc79a39b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:36.259357 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d5e4c9d9-6bce-4bc6-81dc-b6dcbc79a39b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:36.259831 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d5e4c9d9-6bce-4bc6-81dc-b6dcbc79a39b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:36.260379 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d5e4c9d9-6bce-4bc6-81dc-b6dcbc79a39b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:36.299277 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d5e4c9d9-6bce-4bc6-81dc-b6dcbc79a39b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:36.299850 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d5e4c9d9-6bce-4bc6-81dc-b6dcbc79a39b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:36.300513 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d5e4c9d9-6bce-4bc6-81dc-b6dcbc79a39b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:36.300513 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-d5e4c9d9-6bce-4bc6-81dc-b6dcbc79a39b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lazy-loading 'fault' on Instance uuid a8fe4a06-f75b-41c4-a716-976652361744 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:48:36.360305 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d5e4c9d9-6bce-4bc6-81dc-b6dcbc79a39b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:36.370147 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d5e4c9d9-6bce-4bc6-81dc-b6dcbc79a39b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744" status: 200 len: 1365 microversion: 2.1 time: 0.127349 Oct 26 13:48:36.370865 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3346/6720] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:36 2022] GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744 => generated 1365 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:37.395308 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9e212ccd-57a3-49ea-bc90-c14ef140cc17 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:37.396196 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9e212ccd-57a3-49ea-bc90-c14ef140cc17 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: a8fe4a06-f75b-41c4-a716-976652361744] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:37.404534 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e212ccd-57a3-49ea-bc90-c14ef140cc17 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:37.405091 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e212ccd-57a3-49ea-bc90-c14ef140cc17 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:37.405637 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e212ccd-57a3-49ea-bc90-c14ef140cc17 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:37.406442 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e212ccd-57a3-49ea-bc90-c14ef140cc17 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:37.406945 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e212ccd-57a3-49ea-bc90-c14ef140cc17 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:37.407395 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e212ccd-57a3-49ea-bc90-c14ef140cc17 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:37.425655 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-9e212ccd-57a3-49ea-bc90-c14ef140cc17 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] HTTP exception thrown: Instance a8fe4a06-f75b-41c4-a716-976652361744 could not be found. Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9e212ccd-57a3-49ea-bc90-c14ef140cc17 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Request method failure captured: Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744 HTTP/1.1 Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTnApzC1uv7RYc2W5kY-bKNxAsuZUBfTmQjsjWgzUuX11tX2R8DM_Fw7sVvtXRV9882pAeMKhCsEaXlaTjkLCgPxZsqy0UGzQzulFtHD7rhQ8cnkvWXYr0SPAMtN1JLnqGya627Ln2uWIw1ej-ApXw_efP2G5pRjjzhMaFQwCWIvwTI Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 2a1602330aa340b890bac76a120f74e8 Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-TestVolumeBootPattern-608207068 Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2a1602330aa340b890bac76a120f74e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2a1602330aa340b890bac76a120f74e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2a1602330aa340b890bac76a120f74e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2a1602330aa340b890bac76a120f74e8"}]}] Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-TestVolumeBootPattern-608207068 Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 2a1602330aa340b890bac76a120f74e8 Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-TestVolumeBootPattern-608207068 Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-TestVolumeBootPattern-608207068-project Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: df8b67aae3ea4f17bfa684681311dec5 Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-TestVolumeBootPattern-608207068-project Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance a8fe4a06-f75b-41c4-a716-976652361744 could not be found. Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'a8fe4a06-f75b-41c4-a716-976652361744'} Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8fe4a06-f75b-41c4-a716-976652361744 could not be found. Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8fe4a06-f75b-41c4-a716-976652361744 could not be found. Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:48:37.427431 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:48:37.431703 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:48:37.431703 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:48:37.431703 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:48:37.431703 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:48:37.431703 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:48:37.431703 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8fe4a06-f75b-41c4-a716-976652361744 could not be found. Oct 26 13:48:37.431703 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:48:37.431703 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9e212ccd-57a3-49ea-bc90-c14ef140cc17 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Returning 404 to user: Instance a8fe4a06-f75b-41c4-a716-976652361744 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:48:37.431703 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9e212ccd-57a3-49ea-bc90-c14ef140cc17 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744" status: 404 len: 111 microversion: 2.1 time: 0.039006 Oct 26 13:48:37.431703 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3375/6721] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:37 2022] GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:48:41.713767 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-97b077fc-7881-40c3-911d-0faf95acf2fd tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:41.714262 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-97b077fc-7881-40c3-911d-0faf95acf2fd tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: dc15c7f0-e789-418e-9213-26c34bcf3f69] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:41.721546 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-97b077fc-7881-40c3-911d-0faf95acf2fd tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:41.722080 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-97b077fc-7881-40c3-911d-0faf95acf2fd tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:41.722518 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-97b077fc-7881-40c3-911d-0faf95acf2fd tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:41.723225 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-97b077fc-7881-40c3-911d-0faf95acf2fd tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:41.723676 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-97b077fc-7881-40c3-911d-0faf95acf2fd tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:41.724098 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-97b077fc-7881-40c3-911d-0faf95acf2fd tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:41.751914 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-97b077fc-7881-40c3-911d-0faf95acf2fd tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: dc15c7f0-e789-418e-9213-26c34bcf3f69] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:48:41.827066 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-97b077fc-7881-40c3-911d-0faf95acf2fd tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "DELETE /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69" status: 204 len: 0 microversion: 2.1 time: 0.116796 Oct 26 13:48:41.827738 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3347/6722] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:48:41 2022] DELETE /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 26 13:48:41.836501 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d61f5aa3-834f-4e72-8aa8-2d95d8820528 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:41.837150 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d61f5aa3-834f-4e72-8aa8-2d95d8820528 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: dc15c7f0-e789-418e-9213-26c34bcf3f69] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:41.844107 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d61f5aa3-834f-4e72-8aa8-2d95d8820528 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:41.844607 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d61f5aa3-834f-4e72-8aa8-2d95d8820528 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:41.845059 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d61f5aa3-834f-4e72-8aa8-2d95d8820528 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:41.845801 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d61f5aa3-834f-4e72-8aa8-2d95d8820528 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:41.846275 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d61f5aa3-834f-4e72-8aa8-2d95d8820528 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:41.846721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d61f5aa3-834f-4e72-8aa8-2d95d8820528 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:41.977599 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d61f5aa3-834f-4e72-8aa8-2d95d8820528 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:41.985310 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d61f5aa3-834f-4e72-8aa8-2d95d8820528 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69" status: 200 len: 1410 microversion: 2.1 time: 0.153361 Oct 26 13:48:41.985914 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3376/6723] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:41 2022] GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69 => generated 1410 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:48:43.009283 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3c522b32-49ec-4268-85ad-5b0232fd30fb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:43.010046 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3c522b32-49ec-4268-85ad-5b0232fd30fb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: dc15c7f0-e789-418e-9213-26c34bcf3f69] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:43.016773 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3c522b32-49ec-4268-85ad-5b0232fd30fb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:43.017252 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3c522b32-49ec-4268-85ad-5b0232fd30fb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:43.017722 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3c522b32-49ec-4268-85ad-5b0232fd30fb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:43.018403 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3c522b32-49ec-4268-85ad-5b0232fd30fb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:43.018854 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3c522b32-49ec-4268-85ad-5b0232fd30fb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:43.019274 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3c522b32-49ec-4268-85ad-5b0232fd30fb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:43.151450 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3c522b32-49ec-4268-85ad-5b0232fd30fb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:43.159152 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3c522b32-49ec-4268-85ad-5b0232fd30fb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69" status: 200 len: 1410 microversion: 2.1 time: 0.154727 Oct 26 13:48:43.159722 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3348/6724] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:43 2022] GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69 => generated 1410 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:44.184039 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-adad8abf-3c89-4498-823f-9d8996de5e03 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:44.184575 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-adad8abf-3c89-4498-823f-9d8996de5e03 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: dc15c7f0-e789-418e-9213-26c34bcf3f69] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:44.191373 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-adad8abf-3c89-4498-823f-9d8996de5e03 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:44.191911 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-adad8abf-3c89-4498-823f-9d8996de5e03 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:44.192454 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-adad8abf-3c89-4498-823f-9d8996de5e03 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:44.193170 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-adad8abf-3c89-4498-823f-9d8996de5e03 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:44.193800 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-adad8abf-3c89-4498-823f-9d8996de5e03 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:44.194247 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-adad8abf-3c89-4498-823f-9d8996de5e03 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:44.198446 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:48:44.297326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-adad8abf-3c89-4498-823f-9d8996de5e03 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:44.305186 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-adad8abf-3c89-4498-823f-9d8996de5e03 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69" status: 200 len: 1368 microversion: 2.1 time: 0.125311 Oct 26 13:48:44.305790 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3377/6725] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:44 2022] GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69 => generated 1368 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:44.345508 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-3c1835bc-298e-4f95-8edb-0ef6f080ff90 req-f3578108-5f88-4de2-9893-8082064d870a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc15c7f0-e789-418e-9213-26c34bcf3f69", "name": "network-vif-deleted", "tag": "ec55774c-025c-4930-ab07-e2158d02179a"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:48:44.356515 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-3c1835bc-298e-4f95-8edb-0ef6f080ff90 req-f3578108-5f88-4de2-9893-8082064d870a service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:44.356997 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-3c1835bc-298e-4f95-8edb-0ef6f080ff90 req-f3578108-5f88-4de2-9893-8082064d870a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:44.357432 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-3c1835bc-298e-4f95-8edb-0ef6f080ff90 req-f3578108-5f88-4de2-9893-8082064d870a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:44.368633 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-3c1835bc-298e-4f95-8edb-0ef6f080ff90 req-f3578108-5f88-4de2-9893-8082064d870a service nova] Creating event network-vif-deleted:ec55774c-025c-4930-ab07-e2158d02179a for instance dc15c7f0-e789-418e-9213-26c34bcf3f69 on n-h1-862686-1 Oct 26 13:48:44.373332 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-3c1835bc-298e-4f95-8edb-0ef6f080ff90 req-f3578108-5f88-4de2-9893-8082064d870a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031588 Oct 26 13:48:44.373964 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3349/6726] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:48:45.328345 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-31da4189-70e9-43e4-b85c-784c7db3e4f2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:45.329037 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-31da4189-70e9-43e4-b85c-784c7db3e4f2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: dc15c7f0-e789-418e-9213-26c34bcf3f69] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:45.336783 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31da4189-70e9-43e4-b85c-784c7db3e4f2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:45.337275 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31da4189-70e9-43e4-b85c-784c7db3e4f2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:45.337748 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31da4189-70e9-43e4-b85c-784c7db3e4f2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:45.338449 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31da4189-70e9-43e4-b85c-784c7db3e4f2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:45.338915 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31da4189-70e9-43e4-b85c-784c7db3e4f2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:45.339352 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-31da4189-70e9-43e4-b85c-784c7db3e4f2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:45.406240 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-31da4189-70e9-43e4-b85c-784c7db3e4f2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:45.415365 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-31da4189-70e9-43e4-b85c-784c7db3e4f2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69" status: 200 len: 1201 microversion: 2.1 time: 0.090816 Oct 26 13:48:45.416160 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3378/6727] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:45 2022] GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69 => generated 1201 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:46.439948 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4c6d23c6-288c-4147-a42f-5cd10f52937b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:46.440651 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4c6d23c6-288c-4147-a42f-5cd10f52937b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: dc15c7f0-e789-418e-9213-26c34bcf3f69] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:46.447815 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4c6d23c6-288c-4147-a42f-5cd10f52937b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:46.448308 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4c6d23c6-288c-4147-a42f-5cd10f52937b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:46.448750 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4c6d23c6-288c-4147-a42f-5cd10f52937b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:46.449448 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4c6d23c6-288c-4147-a42f-5cd10f52937b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:46.449941 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4c6d23c6-288c-4147-a42f-5cd10f52937b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:46.450378 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4c6d23c6-288c-4147-a42f-5cd10f52937b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:46.453015 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:48:46.517274 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4c6d23c6-288c-4147-a42f-5cd10f52937b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:46.525876 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4c6d23c6-288c-4147-a42f-5cd10f52937b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69" status: 200 len: 1201 microversion: 2.1 time: 0.091235 Oct 26 13:48:46.526457 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3350/6728] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:46 2022] GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69 => generated 1201 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:47.187950 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-737a0a00-391d-4c7d-b568-de71209dc7b5 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:47.188478 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-737a0a00-391d-4c7d-b568-de71209dc7b5 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 06916a99-825b-43f6-9887-15064c6f9f0f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:47.195800 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-737a0a00-391d-4c7d-b568-de71209dc7b5 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:47.196294 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-737a0a00-391d-4c7d-b568-de71209dc7b5 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:47.196743 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-737a0a00-391d-4c7d-b568-de71209dc7b5 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:47.197444 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-737a0a00-391d-4c7d-b568-de71209dc7b5 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:47.197933 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-737a0a00-391d-4c7d-b568-de71209dc7b5 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:47.198365 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-737a0a00-391d-4c7d-b568-de71209dc7b5 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:47.334049 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-737a0a00-391d-4c7d-b568-de71209dc7b5 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:47.342028 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-737a0a00-391d-4c7d-b568-de71209dc7b5 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f" status: 200 len: 1684 microversion: 2.1 time: 0.158010 Oct 26 13:48:47.342596 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3379/6729] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:47 2022] GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:47.440697 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-19e68d5d-ccfe-482e-bba0-67d0439fdc27 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:48:47.443133 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-19e68d5d-ccfe-482e-bba0-67d0439fdc27 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 06916a99-825b-43f6-9887-15064c6f9f0f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:47.451268 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-19e68d5d-ccfe-482e-bba0-67d0439fdc27 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:47.451761 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-19e68d5d-ccfe-482e-bba0-67d0439fdc27 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:47.452207 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-19e68d5d-ccfe-482e-bba0-67d0439fdc27 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:47.452904 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-19e68d5d-ccfe-482e-bba0-67d0439fdc27 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:47.453363 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-19e68d5d-ccfe-482e-bba0-67d0439fdc27 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:47.453820 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-19e68d5d-ccfe-482e-bba0-67d0439fdc27 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:47.515512 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-19e68d5d-ccfe-482e-bba0-67d0439fdc27 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "POST /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f/action" status: 200 len: 32643 microversion: 2.1 time: 0.078712 Oct 26 13:48:47.523420 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3351/6730] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:48:47 2022] POST /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f/action => generated 32643 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:48:47.548408 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5968e5c9-3973-4bdc-9ed6-6f98fa4f1047 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:47.549048 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5968e5c9-3973-4bdc-9ed6-6f98fa4f1047 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: dc15c7f0-e789-418e-9213-26c34bcf3f69] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:47.556068 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5968e5c9-3973-4bdc-9ed6-6f98fa4f1047 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:47.556586 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5968e5c9-3973-4bdc-9ed6-6f98fa4f1047 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:47.557043 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5968e5c9-3973-4bdc-9ed6-6f98fa4f1047 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:47.557809 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5968e5c9-3973-4bdc-9ed6-6f98fa4f1047 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:47.558287 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5968e5c9-3973-4bdc-9ed6-6f98fa4f1047 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:47.558734 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5968e5c9-3973-4bdc-9ed6-6f98fa4f1047 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:47.625413 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5968e5c9-3973-4bdc-9ed6-6f98fa4f1047 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:47.634072 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5968e5c9-3973-4bdc-9ed6-6f98fa4f1047 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69" status: 200 len: 1201 microversion: 2.1 time: 0.089721 Oct 26 13:48:47.634648 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3380/6731] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:47 2022] GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69 => generated 1201 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:47.802574 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a1c2e684-d30c-4b45-8ac3-77074dbc6bcd tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:47.803280 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a1c2e684-d30c-4b45-8ac3-77074dbc6bcd tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] [instance: 06916a99-825b-43f6-9887-15064c6f9f0f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:47.810212 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a1c2e684-d30c-4b45-8ac3-77074dbc6bcd tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:47.810701 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a1c2e684-d30c-4b45-8ac3-77074dbc6bcd tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:47.811140 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a1c2e684-d30c-4b45-8ac3-77074dbc6bcd tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:47.811834 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a1c2e684-d30c-4b45-8ac3-77074dbc6bcd tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:47.812289 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a1c2e684-d30c-4b45-8ac3-77074dbc6bcd tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:47.812717 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a1c2e684-d30c-4b45-8ac3-77074dbc6bcd tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:47.945799 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a1c2e684-d30c-4b45-8ac3-77074dbc6bcd tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f" status: 200 len: 1835 microversion: 2.1 time: 0.262024 Oct 26 13:48:47.946312 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3352/6732] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:47 2022] GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f => generated 1835 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:47.976641 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-47254d37-6908-4da3-81dc-6129596a4c8a tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:48:47.979201 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-47254d37-6908-4da3-81dc-6129596a4c8a tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] [instance: 06916a99-825b-43f6-9887-15064c6f9f0f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:47.985275 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47254d37-6908-4da3-81dc-6129596a4c8a tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:47.985811 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47254d37-6908-4da3-81dc-6129596a4c8a tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:47.986266 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47254d37-6908-4da3-81dc-6129596a4c8a tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:47.986977 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47254d37-6908-4da3-81dc-6129596a4c8a tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:47.987450 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47254d37-6908-4da3-81dc-6129596a4c8a tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:47.987891 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47254d37-6908-4da3-81dc-6129596a4c8a tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:48.125180 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-47254d37-6908-4da3-81dc-6129596a4c8a tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Lazy-loading 'flavor' on Instance uuid 06916a99-825b-43f6-9887-15064c6f9f0f {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:48:48.139208 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-47254d37-6908-4da3-81dc-6129596a4c8a tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] [instance: 06916a99-825b-43f6-9887-15064c6f9f0f] Going to try to live migrate instance to another host {{(pid=120598) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 26 13:48:48.658908 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-258b1cbb-6767-449c-a672-a62ac05c6e0c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:48.660348 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-258b1cbb-6767-449c-a672-a62ac05c6e0c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: dc15c7f0-e789-418e-9213-26c34bcf3f69] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:48.670575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-258b1cbb-6767-449c-a672-a62ac05c6e0c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:48.671127 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-258b1cbb-6767-449c-a672-a62ac05c6e0c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:48.671581 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-258b1cbb-6767-449c-a672-a62ac05c6e0c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:48.672284 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-258b1cbb-6767-449c-a672-a62ac05c6e0c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:48.673063 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-258b1cbb-6767-449c-a672-a62ac05c6e0c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:48.673724 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-258b1cbb-6767-449c-a672-a62ac05c6e0c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:48.716429 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-258b1cbb-6767-449c-a672-a62ac05c6e0c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:48.716921 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-258b1cbb-6767-449c-a672-a62ac05c6e0c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:48.717362 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-258b1cbb-6767-449c-a672-a62ac05c6e0c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:48.717843 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-258b1cbb-6767-449c-a672-a62ac05c6e0c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lazy-loading 'fault' on Instance uuid dc15c7f0-e789-418e-9213-26c34bcf3f69 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:48:48.765571 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-258b1cbb-6767-449c-a672-a62ac05c6e0c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:48.776137 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-258b1cbb-6767-449c-a672-a62ac05c6e0c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69" status: 200 len: 1206 microversion: 2.1 time: 0.121952 Oct 26 13:48:48.777006 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3353/6733] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:48 2022] GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69 => generated 1206 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:48:49.552222 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-47254d37-6908-4da3-81dc-6129596a4c8a tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f/action" status: 202 len: 0 microversion: 2.1 time: 1.578779 Oct 26 13:48:49.554068 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3381/6734] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:48:47 2022] POST /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f/action => generated 0 bytes in 1582 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:48:49.565057 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e9db3cd5-8e75-41a1-b680-91e7a9743ebb tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:49.565795 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e9db3cd5-8e75-41a1-b680-91e7a9743ebb tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 06916a99-825b-43f6-9887-15064c6f9f0f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:49.572767 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e9db3cd5-8e75-41a1-b680-91e7a9743ebb tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:49.573380 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e9db3cd5-8e75-41a1-b680-91e7a9743ebb tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:49.574080 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e9db3cd5-8e75-41a1-b680-91e7a9743ebb tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:49.574973 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e9db3cd5-8e75-41a1-b680-91e7a9743ebb tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:49.575436 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e9db3cd5-8e75-41a1-b680-91e7a9743ebb tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:49.575861 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e9db3cd5-8e75-41a1-b680-91e7a9743ebb tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:49.716922 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e9db3cd5-8e75-41a1-b680-91e7a9743ebb tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:49.725850 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e9db3cd5-8e75-41a1-b680-91e7a9743ebb tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f" status: 200 len: 1694 microversion: 2.1 time: 0.166874 Oct 26 13:48:49.726534 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3354/6735] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:49 2022] GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f => generated 1694 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:49.800266 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f2558748-af80-49fa-bbfa-9212c8b7d8e9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:49.801115 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f2558748-af80-49fa-bbfa-9212c8b7d8e9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: dc15c7f0-e789-418e-9213-26c34bcf3f69] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:49.811967 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f2558748-af80-49fa-bbfa-9212c8b7d8e9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:49.812618 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f2558748-af80-49fa-bbfa-9212c8b7d8e9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:49.813200 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f2558748-af80-49fa-bbfa-9212c8b7d8e9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:49.814037 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f2558748-af80-49fa-bbfa-9212c8b7d8e9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:49.814611 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f2558748-af80-49fa-bbfa-9212c8b7d8e9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:49.815155 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f2558748-af80-49fa-bbfa-9212c8b7d8e9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:49.830073 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-f2558748-af80-49fa-bbfa-9212c8b7d8e9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] HTTP exception thrown: Instance dc15c7f0-e789-418e-9213-26c34bcf3f69 could not be found. Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f2558748-af80-49fa-bbfa-9212c8b7d8e9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Request method failure captured: Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69 HTTP/1.1 Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTnApzC1uv7RYc2W5kY-bKNxAsuZUBfTmQjsjWgzUuX11tX2R8DM_Fw7sVvtXRV9882pAeMKhCsEaXlaTjkLCgPxZsqy0UGzQzulFtHD7rhQ8cnkvWXYr0SPAMtN1JLnqGya627Ln2uWIw1ej-ApXw_efP2G5pRjjzhMaFQwCWIvwTI Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 2a1602330aa340b890bac76a120f74e8 Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-TestVolumeBootPattern-608207068 Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2a1602330aa340b890bac76a120f74e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2a1602330aa340b890bac76a120f74e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2a1602330aa340b890bac76a120f74e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2a1602330aa340b890bac76a120f74e8"}]}] Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-TestVolumeBootPattern-608207068 Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 2a1602330aa340b890bac76a120f74e8 Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-TestVolumeBootPattern-608207068 Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-TestVolumeBootPattern-608207068-project Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: df8b67aae3ea4f17bfa684681311dec5 Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-TestVolumeBootPattern-608207068-project Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance dc15c7f0-e789-418e-9213-26c34bcf3f69 could not be found. Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'dc15c7f0-e789-418e-9213-26c34bcf3f69'} Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc15c7f0-e789-418e-9213-26c34bcf3f69 could not be found. Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc15c7f0-e789-418e-9213-26c34bcf3f69 could not be found. Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:48:49.831708 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:48:49.838208 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:48:49.838208 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:48:49.838208 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:48:49.838208 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:48:49.838208 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:48:49.838208 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc15c7f0-e789-418e-9213-26c34bcf3f69 could not be found. Oct 26 13:48:49.838208 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:48:49.838208 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f2558748-af80-49fa-bbfa-9212c8b7d8e9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Returning 404 to user: Instance dc15c7f0-e789-418e-9213-26c34bcf3f69 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:48:49.838208 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f2558748-af80-49fa-bbfa-9212c8b7d8e9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69" status: 404 len: 111 microversion: 2.1 time: 0.038436 Oct 26 13:48:49.839089 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3382/6736] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:49 2022] GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:48:50.706030 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-2cb58301-9369-49c9-aea3-625acf3230cd req-5af7f32d-f951-48bd-ae53-d06b40b7d701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06916a99-825b-43f6-9887-15064c6f9f0f", "name": "network-vif-unplugged", "status": "completed", "tag": "0b277019-c139-4f21-84fc-f272d97bdd6a"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:48:50.716648 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2cb58301-9369-49c9-aea3-625acf3230cd req-5af7f32d-f951-48bd-ae53-d06b40b7d701 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:50.717124 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2cb58301-9369-49c9-aea3-625acf3230cd req-5af7f32d-f951-48bd-ae53-d06b40b7d701 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:50.718219 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2cb58301-9369-49c9-aea3-625acf3230cd req-5af7f32d-f951-48bd-ae53-d06b40b7d701 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:50.730718 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-2cb58301-9369-49c9-aea3-625acf3230cd req-5af7f32d-f951-48bd-ae53-d06b40b7d701 service nova] Creating event network-vif-unplugged:0b277019-c139-4f21-84fc-f272d97bdd6a for instance 06916a99-825b-43f6-9887-15064c6f9f0f on n-h1-862686-1 Oct 26 13:48:50.736462 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-2cb58301-9369-49c9-aea3-625acf3230cd req-5af7f32d-f951-48bd-ae53-d06b40b7d701 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035016 Oct 26 13:48:50.737439 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3355/6737] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:48:50.750387 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0505dc87-8f36-43d3-8ec8-c503954873ec tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:50.751015 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0505dc87-8f36-43d3-8ec8-c503954873ec tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 06916a99-825b-43f6-9887-15064c6f9f0f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:50.759697 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0505dc87-8f36-43d3-8ec8-c503954873ec tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:50.760444 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0505dc87-8f36-43d3-8ec8-c503954873ec tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:50.760898 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0505dc87-8f36-43d3-8ec8-c503954873ec tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:50.761674 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0505dc87-8f36-43d3-8ec8-c503954873ec tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:50.762131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0505dc87-8f36-43d3-8ec8-c503954873ec tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:50.762573 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0505dc87-8f36-43d3-8ec8-c503954873ec tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:50.983997 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0505dc87-8f36-43d3-8ec8-c503954873ec tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:50.993896 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0505dc87-8f36-43d3-8ec8-c503954873ec tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f" status: 200 len: 1694 microversion: 2.1 time: 0.247097 Oct 26 13:48:50.995025 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3383/6738] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:50 2022] GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f => generated 1694 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:52.006297 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-877b7f68-b776-450f-8ea9-c8022884c689 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:52.006893 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-877b7f68-b776-450f-8ea9-c8022884c689 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: a8fe4a06-f75b-41c4-a716-976652361744] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:52.013549 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-877b7f68-b776-450f-8ea9-c8022884c689 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:52.014235 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-877b7f68-b776-450f-8ea9-c8022884c689 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:52.014839 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-877b7f68-b776-450f-8ea9-c8022884c689 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:52.015825 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-877b7f68-b776-450f-8ea9-c8022884c689 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:52.016433 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-877b7f68-b776-450f-8ea9-c8022884c689 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:52.017010 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-877b7f68-b776-450f-8ea9-c8022884c689 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:52.017954 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c16d8a53-b9a2-4ed8-8f76-d425a1f7d51a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:52.018582 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c16d8a53-b9a2-4ed8-8f76-d425a1f7d51a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 06916a99-825b-43f6-9887-15064c6f9f0f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:52.025830 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c16d8a53-b9a2-4ed8-8f76-d425a1f7d51a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:52.026426 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c16d8a53-b9a2-4ed8-8f76-d425a1f7d51a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:52.026980 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c16d8a53-b9a2-4ed8-8f76-d425a1f7d51a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:52.027804 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c16d8a53-b9a2-4ed8-8f76-d425a1f7d51a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:52.028455 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c16d8a53-b9a2-4ed8-8f76-d425a1f7d51a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:52.029000 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c16d8a53-b9a2-4ed8-8f76-d425a1f7d51a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:52.031304 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-877b7f68-b776-450f-8ea9-c8022884c689 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] HTTP exception thrown: Instance a8fe4a06-f75b-41c4-a716-976652361744 could not be found. Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-877b7f68-b776-450f-8ea9-c8022884c689 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Request method failure captured: Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744 HTTP/1.1 Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTnApzC1uv7RYc2W5kY-bKNxAsuZUBfTmQjsjWgzUuX11tX2R8DM_Fw7sVvtXRV9882pAeMKhCsEaXlaTjkLCgPxZsqy0UGzQzulFtHD7rhQ8cnkvWXYr0SPAMtN1JLnqGya627Ln2uWIw1ej-ApXw_efP2G5pRjjzhMaFQwCWIvwTI Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 2a1602330aa340b890bac76a120f74e8 Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-TestVolumeBootPattern-608207068 Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2a1602330aa340b890bac76a120f74e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2a1602330aa340b890bac76a120f74e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2a1602330aa340b890bac76a120f74e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2a1602330aa340b890bac76a120f74e8"}]}] Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-TestVolumeBootPattern-608207068 Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 2a1602330aa340b890bac76a120f74e8 Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-TestVolumeBootPattern-608207068 Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-TestVolumeBootPattern-608207068-project Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: df8b67aae3ea4f17bfa684681311dec5 Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-TestVolumeBootPattern-608207068-project Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance a8fe4a06-f75b-41c4-a716-976652361744 could not be found. Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'a8fe4a06-f75b-41c4-a716-976652361744'} Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8fe4a06-f75b-41c4-a716-976652361744 could not be found. Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:48:52.033003 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:48:52.036859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8fe4a06-f75b-41c4-a716-976652361744 could not be found. Oct 26 13:48:52.036859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:48:52.036859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:48:52.036859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:48:52.036859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:48:52.036859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:48:52.036859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:48:52.036859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:48:52.036859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:48:52.036859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8fe4a06-f75b-41c4-a716-976652361744 could not be found. Oct 26 13:48:52.036859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:48:52.036859 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-877b7f68-b776-450f-8ea9-c8022884c689 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Returning 404 to user: Instance a8fe4a06-f75b-41c4-a716-976652361744 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:48:52.036859 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-877b7f68-b776-450f-8ea9-c8022884c689 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744" status: 404 len: 111 microversion: 2.1 time: 0.034485 Oct 26 13:48:52.036859 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3356/6739] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:48:51 2022] DELETE /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:48:52.043301 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-545483a4-5181-4cfc-b30d-794f205607b0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:52.043910 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-545483a4-5181-4cfc-b30d-794f205607b0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: a8fe4a06-f75b-41c4-a716-976652361744] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:52.049892 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-545483a4-5181-4cfc-b30d-794f205607b0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:52.050380 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-545483a4-5181-4cfc-b30d-794f205607b0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:52.050822 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-545483a4-5181-4cfc-b30d-794f205607b0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:52.052271 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-545483a4-5181-4cfc-b30d-794f205607b0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:52.052873 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-545483a4-5181-4cfc-b30d-794f205607b0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:52.053311 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-545483a4-5181-4cfc-b30d-794f205607b0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:52.068000 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-545483a4-5181-4cfc-b30d-794f205607b0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] HTTP exception thrown: Instance a8fe4a06-f75b-41c4-a716-976652361744 could not be found. Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-545483a4-5181-4cfc-b30d-794f205607b0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Request method failure captured: Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744 HTTP/1.1 Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTnApzC1uv7RYc2W5kY-bKNxAsuZUBfTmQjsjWgzUuX11tX2R8DM_Fw7sVvtXRV9882pAeMKhCsEaXlaTjkLCgPxZsqy0UGzQzulFtHD7rhQ8cnkvWXYr0SPAMtN1JLnqGya627Ln2uWIw1ej-ApXw_efP2G5pRjjzhMaFQwCWIvwTI Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 2a1602330aa340b890bac76a120f74e8 Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-TestVolumeBootPattern-608207068 Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2a1602330aa340b890bac76a120f74e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2a1602330aa340b890bac76a120f74e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2a1602330aa340b890bac76a120f74e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2a1602330aa340b890bac76a120f74e8"}]}] Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-TestVolumeBootPattern-608207068 Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 2a1602330aa340b890bac76a120f74e8 Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-TestVolumeBootPattern-608207068 Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-TestVolumeBootPattern-608207068-project Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: df8b67aae3ea4f17bfa684681311dec5 Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-TestVolumeBootPattern-608207068-project Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance a8fe4a06-f75b-41c4-a716-976652361744 could not be found. Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'a8fe4a06-f75b-41c4-a716-976652361744'} Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8fe4a06-f75b-41c4-a716-976652361744 could not be found. Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8fe4a06-f75b-41c4-a716-976652361744 could not be found. Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:48:52.069739 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:48:52.073239 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:48:52.073239 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:48:52.073239 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:48:52.073239 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:48:52.073239 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:48:52.073239 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8fe4a06-f75b-41c4-a716-976652361744 could not be found. Oct 26 13:48:52.073239 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:48:52.073239 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-545483a4-5181-4cfc-b30d-794f205607b0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Returning 404 to user: Instance a8fe4a06-f75b-41c4-a716-976652361744 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:48:52.073239 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-545483a4-5181-4cfc-b30d-794f205607b0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744" status: 404 len: 111 microversion: 2.1 time: 0.031536 Oct 26 13:48:52.074976 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3357/6740] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:52 2022] GET /compute/v2.1/servers/a8fe4a06-f75b-41c4-a716-976652361744 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 13:48:52.174041 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c16d8a53-b9a2-4ed8-8f76-d425a1f7d51a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:52.184569 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c16d8a53-b9a2-4ed8-8f76-d425a1f7d51a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f" status: 200 len: 1694 microversion: 2.1 time: 0.169877 Oct 26 13:48:52.185301 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3384/6741] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:52 2022] GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f => generated 1694 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:52.607924 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-57580440-d93f-4e5a-bbb0-ee12621c143a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:52.608430 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-57580440-d93f-4e5a-bbb0-ee12621c143a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: dc15c7f0-e789-418e-9213-26c34bcf3f69] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:52.615338 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57580440-d93f-4e5a-bbb0-ee12621c143a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:52.615837 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57580440-d93f-4e5a-bbb0-ee12621c143a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:52.616285 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57580440-d93f-4e5a-bbb0-ee12621c143a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:52.616995 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57580440-d93f-4e5a-bbb0-ee12621c143a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:52.617455 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57580440-d93f-4e5a-bbb0-ee12621c143a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:52.617909 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57580440-d93f-4e5a-bbb0-ee12621c143a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:52.633283 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-57580440-d93f-4e5a-bbb0-ee12621c143a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] HTTP exception thrown: Instance dc15c7f0-e789-418e-9213-26c34bcf3f69 could not be found. Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-57580440-d93f-4e5a-bbb0-ee12621c143a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Request method failure captured: Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69 HTTP/1.1 Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTnApzC1uv7RYc2W5kY-bKNxAsuZUBfTmQjsjWgzUuX11tX2R8DM_Fw7sVvtXRV9882pAeMKhCsEaXlaTjkLCgPxZsqy0UGzQzulFtHD7rhQ8cnkvWXYr0SPAMtN1JLnqGya627Ln2uWIw1ej-ApXw_efP2G5pRjjzhMaFQwCWIvwTI Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 2a1602330aa340b890bac76a120f74e8 Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-TestVolumeBootPattern-608207068 Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2a1602330aa340b890bac76a120f74e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2a1602330aa340b890bac76a120f74e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2a1602330aa340b890bac76a120f74e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2a1602330aa340b890bac76a120f74e8"}]}] Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-TestVolumeBootPattern-608207068 Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 2a1602330aa340b890bac76a120f74e8 Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-TestVolumeBootPattern-608207068 Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-TestVolumeBootPattern-608207068-project Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: df8b67aae3ea4f17bfa684681311dec5 Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-TestVolumeBootPattern-608207068-project Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance dc15c7f0-e789-418e-9213-26c34bcf3f69 could not be found. Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'dc15c7f0-e789-418e-9213-26c34bcf3f69'} Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc15c7f0-e789-418e-9213-26c34bcf3f69 could not be found. Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:48:52.634912 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:48:52.642665 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc15c7f0-e789-418e-9213-26c34bcf3f69 could not be found. Oct 26 13:48:52.642665 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:48:52.642665 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:48:52.642665 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:48:52.642665 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:48:52.642665 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:48:52.642665 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:48:52.642665 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:48:52.642665 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:48:52.642665 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc15c7f0-e789-418e-9213-26c34bcf3f69 could not be found. Oct 26 13:48:52.642665 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:48:52.642665 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-57580440-d93f-4e5a-bbb0-ee12621c143a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Returning 404 to user: Instance dc15c7f0-e789-418e-9213-26c34bcf3f69 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:48:52.642665 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-57580440-d93f-4e5a-bbb0-ee12621c143a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "DELETE /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69" status: 404 len: 111 microversion: 2.1 time: 0.032528 Oct 26 13:48:52.642665 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3358/6742] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:48:52 2022] DELETE /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 13:48:52.648958 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-95c67a29-8d3f-44ac-9b86-3877d375a769 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:52.649620 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-95c67a29-8d3f-44ac-9b86-3877d375a769 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: dc15c7f0-e789-418e-9213-26c34bcf3f69] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:52.656278 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-95c67a29-8d3f-44ac-9b86-3877d375a769 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:52.656782 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-95c67a29-8d3f-44ac-9b86-3877d375a769 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:52.657239 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-95c67a29-8d3f-44ac-9b86-3877d375a769 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:52.658047 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-95c67a29-8d3f-44ac-9b86-3877d375a769 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:52.658554 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-95c67a29-8d3f-44ac-9b86-3877d375a769 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:52.659236 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-95c67a29-8d3f-44ac-9b86-3877d375a769 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:52.673918 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-95c67a29-8d3f-44ac-9b86-3877d375a769 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] HTTP exception thrown: Instance dc15c7f0-e789-418e-9213-26c34bcf3f69 could not be found. Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-95c67a29-8d3f-44ac-9b86-3877d375a769 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Request method failure captured: Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69 HTTP/1.1 Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTnApzC1uv7RYc2W5kY-bKNxAsuZUBfTmQjsjWgzUuX11tX2R8DM_Fw7sVvtXRV9882pAeMKhCsEaXlaTjkLCgPxZsqy0UGzQzulFtHD7rhQ8cnkvWXYr0SPAMtN1JLnqGya627Ln2uWIw1ej-ApXw_efP2G5pRjjzhMaFQwCWIvwTI Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 2a1602330aa340b890bac76a120f74e8 Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-TestVolumeBootPattern-608207068 Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2a1602330aa340b890bac76a120f74e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2a1602330aa340b890bac76a120f74e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2a1602330aa340b890bac76a120f74e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2a1602330aa340b890bac76a120f74e8"}]}] Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-TestVolumeBootPattern-608207068 Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 2a1602330aa340b890bac76a120f74e8 Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-TestVolumeBootPattern-608207068 Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-TestVolumeBootPattern-608207068-project Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: df8b67aae3ea4f17bfa684681311dec5 Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-TestVolumeBootPattern-608207068-project Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance dc15c7f0-e789-418e-9213-26c34bcf3f69 could not be found. Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'dc15c7f0-e789-418e-9213-26c34bcf3f69'} Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc15c7f0-e789-418e-9213-26c34bcf3f69 could not be found. Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc15c7f0-e789-418e-9213-26c34bcf3f69 could not be found. Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:48:52.675516 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:48:52.680213 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:48:52.680213 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:48:52.680213 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:48:52.680213 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:48:52.680213 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:48:52.680213 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc15c7f0-e789-418e-9213-26c34bcf3f69 could not be found. Oct 26 13:48:52.680213 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:48:52.680213 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-95c67a29-8d3f-44ac-9b86-3877d375a769 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Returning 404 to user: Instance dc15c7f0-e789-418e-9213-26c34bcf3f69 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:48:52.680213 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-95c67a29-8d3f-44ac-9b86-3877d375a769 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69" status: 404 len: 111 microversion: 2.1 time: 0.032811 Oct 26 13:48:52.680213 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3385/6743] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:52 2022] GET /compute/v2.1/servers/dc15c7f0-e789-418e-9213-26c34bcf3f69 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:48:52.751937 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9b06c44e-1b40-4123-9f4f-3c59c41f639f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Action: 'create', calling method: .version_select at 0x7f6731240c10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1766855477", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUc25Pvf50bopCVee9svkk/+T9VxfNXm3RS47e22zIRAKq6rjmRhlLZv/7rn0e0yzwR2Vuug+IG3V9xC7bzCYB8m2ntSaTmylEuFZkkQqgl10AbAG7fJgjKw4bkkxioOQ=="}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:48:52.755166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-4c846267-2a3d-4472-a0d3-1befd9397076 req-03024731-edd6-477e-a61c-1c2aa67cba90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06916a99-825b-43f6-9887-15064c6f9f0f", "tag": "0b277019-c139-4f21-84fc-f272d97bdd6a"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:48:52.767721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-4c846267-2a3d-4472-a0d3-1befd9397076 req-03024731-edd6-477e-a61c-1c2aa67cba90 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:52.768636 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-4c846267-2a3d-4472-a0d3-1befd9397076 req-03024731-edd6-477e-a61c-1c2aa67cba90 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:52.769453 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-4c846267-2a3d-4472-a0d3-1befd9397076 req-03024731-edd6-477e-a61c-1c2aa67cba90 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:52.770136 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-9b06c44e-1b40-4123-9f4f-3c59c41f639f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Getting quotas for project 2a1602330aa340b890bac76a120f74e8. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:48:52.775974 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-9b06c44e-1b40-4123-9f4f-3c59c41f639f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Getting quotas for user df8b67aae3ea4f17bfa684681311dec5 and project 2a1602330aa340b890bac76a120f74e8. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:48:52.781793 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-4c846267-2a3d-4472-a0d3-1befd9397076 req-03024731-edd6-477e-a61c-1c2aa67cba90 service nova] Creating event network-changed:0b277019-c139-4f21-84fc-f272d97bdd6a for instance 06916a99-825b-43f6-9887-15064c6f9f0f on n-h1-862686-1 Oct 26 13:48:52.786905 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-4c846267-2a3d-4472-a0d3-1befd9397076 req-03024731-edd6-477e-a61c-1c2aa67cba90 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036249 Oct 26 13:48:52.787526 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3386/6744] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:48:52.799548 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9b06c44e-1b40-4123-9f4f-3c59c41f639f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.051592 Oct 26 13:48:52.800130 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3359/6745] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 13:48:52 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:48:53.211423 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-917b2386-e829-4e11-bd8f-ea30240f9690 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:53.212227 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-917b2386-e829-4e11-bd8f-ea30240f9690 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 06916a99-825b-43f6-9887-15064c6f9f0f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:53.218672 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-917b2386-e829-4e11-bd8f-ea30240f9690 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:53.219179 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-917b2386-e829-4e11-bd8f-ea30240f9690 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:53.219636 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-917b2386-e829-4e11-bd8f-ea30240f9690 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:53.220355 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-917b2386-e829-4e11-bd8f-ea30240f9690 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:53.220827 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-917b2386-e829-4e11-bd8f-ea30240f9690 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:53.221268 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-917b2386-e829-4e11-bd8f-ea30240f9690 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:53.491071 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-917b2386-e829-4e11-bd8f-ea30240f9690 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:53.499850 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-917b2386-e829-4e11-bd8f-ea30240f9690 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f" status: 200 len: 1694 microversion: 2.1 time: 0.294184 Oct 26 13:48:53.500493 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3387/6746] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:53 2022] GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f => generated 1694 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:54.524895 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-20c56d6b-3247-4e78-b7e3-f81e4190c4ef tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:54.525641 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-20c56d6b-3247-4e78-b7e3-f81e4190c4ef tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 06916a99-825b-43f6-9887-15064c6f9f0f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:54.532569 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20c56d6b-3247-4e78-b7e3-f81e4190c4ef tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:54.533060 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20c56d6b-3247-4e78-b7e3-f81e4190c4ef tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:54.533514 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20c56d6b-3247-4e78-b7e3-f81e4190c4ef tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:54.534218 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20c56d6b-3247-4e78-b7e3-f81e4190c4ef tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:54.534683 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20c56d6b-3247-4e78-b7e3-f81e4190c4ef tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:54.535111 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20c56d6b-3247-4e78-b7e3-f81e4190c4ef tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:54.687349 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-20c56d6b-3247-4e78-b7e3-f81e4190c4ef tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:54.695998 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-20c56d6b-3247-4e78-b7e3-f81e4190c4ef tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f" status: 200 len: 1694 microversion: 2.1 time: 0.176506 Oct 26 13:48:54.696897 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3360/6747] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:54 2022] GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f => generated 1694 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:55.721820 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-33e1f1d5-3b7c-4280-b619-c8e66176498e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:55.722439 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-33e1f1d5-3b7c-4280-b619-c8e66176498e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 06916a99-825b-43f6-9887-15064c6f9f0f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:55.730033 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33e1f1d5-3b7c-4280-b619-c8e66176498e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:55.730535 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33e1f1d5-3b7c-4280-b619-c8e66176498e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:55.730987 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33e1f1d5-3b7c-4280-b619-c8e66176498e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:55.731706 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33e1f1d5-3b7c-4280-b619-c8e66176498e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:55.732171 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33e1f1d5-3b7c-4280-b619-c8e66176498e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:55.732610 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33e1f1d5-3b7c-4280-b619-c8e66176498e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:55.869603 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-33e1f1d5-3b7c-4280-b619-c8e66176498e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:55.878621 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-33e1f1d5-3b7c-4280-b619-c8e66176498e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f" status: 200 len: 1694 microversion: 2.1 time: 0.160236 Oct 26 13:48:55.878941 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3388/6748] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:55 2022] GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:56.904992 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1a2549ab-188a-43aa-ab9e-52d66339c042 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:56.905557 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1a2549ab-188a-43aa-ab9e-52d66339c042 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 06916a99-825b-43f6-9887-15064c6f9f0f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:56.913552 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a2549ab-188a-43aa-ab9e-52d66339c042 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:56.914510 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a2549ab-188a-43aa-ab9e-52d66339c042 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:56.915344 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a2549ab-188a-43aa-ab9e-52d66339c042 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:56.916055 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a2549ab-188a-43aa-ab9e-52d66339c042 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:56.916702 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a2549ab-188a-43aa-ab9e-52d66339c042 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:56.917098 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a2549ab-188a-43aa-ab9e-52d66339c042 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:57.064350 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1a2549ab-188a-43aa-ab9e-52d66339c042 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:57.073768 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1a2549ab-188a-43aa-ab9e-52d66339c042 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f" status: 200 len: 1694 microversion: 2.1 time: 0.172583 Oct 26 13:48:57.074369 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3361/6749] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:56 2022] GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f => generated 1694 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:58.099777 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1f150cba-e4ad-46bb-9bdc-5a54be22c2a2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:58.100439 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1f150cba-e4ad-46bb-9bdc-5a54be22c2a2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 06916a99-825b-43f6-9887-15064c6f9f0f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:58.108973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f150cba-e4ad-46bb-9bdc-5a54be22c2a2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:58.109501 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f150cba-e4ad-46bb-9bdc-5a54be22c2a2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:58.110142 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f150cba-e4ad-46bb-9bdc-5a54be22c2a2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:58.110878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f150cba-e4ad-46bb-9bdc-5a54be22c2a2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:58.111343 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f150cba-e4ad-46bb-9bdc-5a54be22c2a2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:58.111778 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f150cba-e4ad-46bb-9bdc-5a54be22c2a2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:58.280963 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1f150cba-e4ad-46bb-9bdc-5a54be22c2a2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:58.289366 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1f150cba-e4ad-46bb-9bdc-5a54be22c2a2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f" status: 200 len: 1684 microversion: 2.1 time: 0.194843 Oct 26 13:48:58.290090 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3389/6750] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:58 2022] GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f => generated 1684 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:58.312033 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5151d3dc-f6e7-445d-babe-35a9151409f1 tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:58.312572 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5151d3dc-f6e7-445d-babe-35a9151409f1 tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] [instance: 06916a99-825b-43f6-9887-15064c6f9f0f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:58.320404 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5151d3dc-f6e7-445d-babe-35a9151409f1 tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:58.321121 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5151d3dc-f6e7-445d-babe-35a9151409f1 tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:58.321849 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5151d3dc-f6e7-445d-babe-35a9151409f1 tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:58.322852 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5151d3dc-f6e7-445d-babe-35a9151409f1 tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:58.323394 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5151d3dc-f6e7-445d-babe-35a9151409f1 tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:58.323898 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5151d3dc-f6e7-445d-babe-35a9151409f1 tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:58.461494 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5151d3dc-f6e7-445d-babe-35a9151409f1 tempest-TestNetworkAdvancedServerOps-1975390522 tempest-TestNetworkAdvancedServerOps-1975390522-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f" status: 200 len: 1835 microversion: 2.1 time: 0.153163 Oct 26 13:48:58.462110 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3362/6751] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:58 2022] GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f => generated 1835 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:58.484635 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0728c58f-81ed-44a3-b972-224ed215602a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:48:58.485264 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0728c58f-81ed-44a3-b972-224ed215602a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 06916a99-825b-43f6-9887-15064c6f9f0f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:58.491561 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0728c58f-81ed-44a3-b972-224ed215602a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:58.492342 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0728c58f-81ed-44a3-b972-224ed215602a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:58.492807 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0728c58f-81ed-44a3-b972-224ed215602a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:58.493557 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0728c58f-81ed-44a3-b972-224ed215602a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:58.494480 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0728c58f-81ed-44a3-b972-224ed215602a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:58.495088 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0728c58f-81ed-44a3-b972-224ed215602a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:58.659602 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0728c58f-81ed-44a3-b972-224ed215602a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:48:58.669410 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0728c58f-81ed-44a3-b972-224ed215602a tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f" status: 200 len: 1684 microversion: 2.1 time: 0.188577 Oct 26 13:48:58.670119 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3390/6752] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:48:58 2022] GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f => generated 1684 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:48:58.772237 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-84a0b373-b712-4a9b-b9b6-3471fb9cf1b1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:48:58.774535 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-84a0b373-b712-4a9b-b9b6-3471fb9cf1b1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 06916a99-825b-43f6-9887-15064c6f9f0f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:48:58.780609 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-84a0b373-b712-4a9b-b9b6-3471fb9cf1b1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:58.781095 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-84a0b373-b712-4a9b-b9b6-3471fb9cf1b1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:58.781574 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-84a0b373-b712-4a9b-b9b6-3471fb9cf1b1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:58.782276 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-84a0b373-b712-4a9b-b9b6-3471fb9cf1b1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:48:58.782730 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-84a0b373-b712-4a9b-b9b6-3471fb9cf1b1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:48:58.783154 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-84a0b373-b712-4a9b-b9b6-3471fb9cf1b1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:48:58.849007 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-84a0b373-b712-4a9b-b9b6-3471fb9cf1b1 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "POST /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f/action" status: 200 len: 38638 microversion: 2.1 time: 0.081691 Oct 26 13:48:58.849613 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3363/6753] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:48:58 2022] POST /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f/action => generated 38638 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:49:00.224662 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cf33e22c-8f38-4d98-a859-1431eed6deb3 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:49:00.225166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cf33e22c-8f38-4d98-a859-1431eed6deb3 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 06916a99-825b-43f6-9887-15064c6f9f0f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:49:00.227980 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:49:00.229828 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-115c729e-1d7d-4212-a9f6-f7bfd6da072a req-0e88e026-357c-4802-9379-00104408626d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06916a99-825b-43f6-9887-15064c6f9f0f", "tag": "0b277019-c139-4f21-84fc-f272d97bdd6a"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:49:00.238804 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf33e22c-8f38-4d98-a859-1431eed6deb3 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:00.239402 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf33e22c-8f38-4d98-a859-1431eed6deb3 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:00.239857 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf33e22c-8f38-4d98-a859-1431eed6deb3 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:00.240577 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf33e22c-8f38-4d98-a859-1431eed6deb3 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:00.241042 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf33e22c-8f38-4d98-a859-1431eed6deb3 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:00.241492 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf33e22c-8f38-4d98-a859-1431eed6deb3 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:00.244045 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:49:00.246520 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-115c729e-1d7d-4212-a9f6-f7bfd6da072a req-0e88e026-357c-4802-9379-00104408626d service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:00.247054 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-115c729e-1d7d-4212-a9f6-f7bfd6da072a req-0e88e026-357c-4802-9379-00104408626d service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:00.247487 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-115c729e-1d7d-4212-a9f6-f7bfd6da072a req-0e88e026-357c-4802-9379-00104408626d service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:00.264261 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-115c729e-1d7d-4212-a9f6-f7bfd6da072a req-0e88e026-357c-4802-9379-00104408626d service nova] Creating event network-changed:0b277019-c139-4f21-84fc-f272d97bdd6a for instance 06916a99-825b-43f6-9887-15064c6f9f0f on n-h2-862686-1 Oct 26 13:49:00.272070 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-115c729e-1d7d-4212-a9f6-f7bfd6da072a req-0e88e026-357c-4802-9379-00104408626d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047390 Oct 26 13:49:00.273808 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3364/6754] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:49:00.285227 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cf33e22c-8f38-4d98-a859-1431eed6deb3 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 06916a99-825b-43f6-9887-15064c6f9f0f] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:49:00.386646 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cf33e22c-8f38-4d98-a859-1431eed6deb3 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "DELETE /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f" status: 204 len: 0 microversion: 2.1 time: 0.165393 Oct 26 13:49:00.387860 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3391/6755] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:49:00 2022] DELETE /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:49:00.398923 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f19b9f00-69ec-4621-b618-b35c47a01cd7 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:49:00.399901 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f19b9f00-69ec-4621-b618-b35c47a01cd7 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 06916a99-825b-43f6-9887-15064c6f9f0f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:49:00.424428 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f19b9f00-69ec-4621-b618-b35c47a01cd7 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:00.433590 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f19b9f00-69ec-4621-b618-b35c47a01cd7 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:00.434565 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f19b9f00-69ec-4621-b618-b35c47a01cd7 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:00.435487 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f19b9f00-69ec-4621-b618-b35c47a01cd7 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:00.436123 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f19b9f00-69ec-4621-b618-b35c47a01cd7 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:00.436705 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f19b9f00-69ec-4621-b618-b35c47a01cd7 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:00.627811 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f19b9f00-69ec-4621-b618-b35c47a01cd7 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:49:00.639603 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f19b9f00-69ec-4621-b618-b35c47a01cd7 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f" status: 200 len: 1690 microversion: 2.1 time: 0.246986 Oct 26 13:49:00.640389 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3365/6756] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:49:00 2022] GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f => generated 1690 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:49:01.435317 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-31a18c57-80bc-4a37-a0e6-17e4442878fb req-21dd6908-6635-43ef-9f24-319d638c6ca0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06916a99-825b-43f6-9887-15064c6f9f0f", "name": "network-vif-deleted", "tag": "0b277019-c139-4f21-84fc-f272d97bdd6a"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:49:01.455456 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-31a18c57-80bc-4a37-a0e6-17e4442878fb req-21dd6908-6635-43ef-9f24-319d638c6ca0 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:01.456208 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-31a18c57-80bc-4a37-a0e6-17e4442878fb req-21dd6908-6635-43ef-9f24-319d638c6ca0 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:01.456959 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-31a18c57-80bc-4a37-a0e6-17e4442878fb req-21dd6908-6635-43ef-9f24-319d638c6ca0 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:01.470478 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-31a18c57-80bc-4a37-a0e6-17e4442878fb req-21dd6908-6635-43ef-9f24-319d638c6ca0 service nova] Creating event network-vif-deleted:0b277019-c139-4f21-84fc-f272d97bdd6a for instance 06916a99-825b-43f6-9887-15064c6f9f0f on n-h2-862686-1 Oct 26 13:49:01.477649 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-31a18c57-80bc-4a37-a0e6-17e4442878fb req-21dd6908-6635-43ef-9f24-319d638c6ca0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046447 Oct 26 13:49:01.479250 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3392/6757] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:49:01.668214 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a2edda66-d244-4af8-a716-be8899e57a99 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:49:01.668765 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a2edda66-d244-4af8-a716-be8899e57a99 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 06916a99-825b-43f6-9887-15064c6f9f0f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:49:01.675007 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2edda66-d244-4af8-a716-be8899e57a99 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:01.675488 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2edda66-d244-4af8-a716-be8899e57a99 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:01.675965 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2edda66-d244-4af8-a716-be8899e57a99 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:01.677018 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2edda66-d244-4af8-a716-be8899e57a99 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:01.677559 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2edda66-d244-4af8-a716-be8899e57a99 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:01.678400 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2edda66-d244-4af8-a716-be8899e57a99 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:01.717907 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2edda66-d244-4af8-a716-be8899e57a99 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:01.718654 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2edda66-d244-4af8-a716-be8899e57a99 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:01.719442 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2edda66-d244-4af8-a716-be8899e57a99 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:01.724427 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-a2edda66-d244-4af8-a716-be8899e57a99 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lazy-loading 'fault' on Instance uuid 06916a99-825b-43f6-9887-15064c6f9f0f {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:49:01.776661 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a2edda66-d244-4af8-a716-be8899e57a99 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:49:01.785530 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a2edda66-d244-4af8-a716-be8899e57a99 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f" status: 200 len: 1357 microversion: 2.1 time: 0.122182 Oct 26 13:49:01.786471 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3366/6758] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:49:01 2022] GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f => generated 1357 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:49:02.812703 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f73ba927-d303-46a1-b229-ede391ee3020 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:49:02.813462 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f73ba927-d303-46a1-b229-ede391ee3020 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: 06916a99-825b-43f6-9887-15064c6f9f0f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:49:02.820256 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f73ba927-d303-46a1-b229-ede391ee3020 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:02.820763 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f73ba927-d303-46a1-b229-ede391ee3020 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:02.821224 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f73ba927-d303-46a1-b229-ede391ee3020 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:02.821970 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f73ba927-d303-46a1-b229-ede391ee3020 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:02.822523 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f73ba927-d303-46a1-b229-ede391ee3020 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:02.823104 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f73ba927-d303-46a1-b229-ede391ee3020 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:02.825951 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:49:02.838668 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-f73ba927-d303-46a1-b229-ede391ee3020 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] HTTP exception thrown: Instance 06916a99-825b-43f6-9887-15064c6f9f0f could not be found. Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f73ba927-d303-46a1-b229-ede391ee3020 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Request method failure captured: Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f HTTP/1.1 Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTl7vHGITUnSIjOoYHssXC10IwUcwveqrJ7Ebb5cmEfkFD9JMguSExqSXPNP7Ag-JuWcpR1m7T1_23uQXjoVepH6MjM-90GyPgiU7IyFq1opWMTLN8Bh1kpzqNFJZ8A9zq3q3AuJcUUCnd4kdwPdeBkozWabTG-a7qC9_ycsvQK-bH8 Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: bbc60a45db1c488ab4417c3b2c8d1983 Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1564668813 Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bbc60a45db1c488ab4417c3b2c8d1983"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bbc60a45db1c488ab4417c3b2c8d1983"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bbc60a45db1c488ab4417c3b2c8d1983"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bbc60a45db1c488ab4417c3b2c8d1983"}]}] Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1564668813 Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: bbc60a45db1c488ab4417c3b2c8d1983 Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1564668813 Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-TestNetworkAdvancedServerOps-1564668813-project Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: c67f61dd56b74107b828dcd7f2fc31f1 Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1564668813-project Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 06916a99-825b-43f6-9887-15064c6f9f0f could not be found. Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '06916a99-825b-43f6-9887-15064c6f9f0f'} Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06916a99-825b-43f6-9887-15064c6f9f0f could not be found. Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06916a99-825b-43f6-9887-15064c6f9f0f could not be found. Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:49:02.840367 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:49:02.844305 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:49:02.844305 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:49:02.844305 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:49:02.844305 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:49:02.844305 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:49:02.844305 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:49:02.844305 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06916a99-825b-43f6-9887-15064c6f9f0f could not be found. Oct 26 13:49:02.844305 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:49:02.844305 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f73ba927-d303-46a1-b229-ede391ee3020 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Returning 404 to user: Instance 06916a99-825b-43f6-9887-15064c6f9f0f could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:49:02.844305 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f73ba927-d303-46a1-b229-ede391ee3020 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f" status: 404 len: 111 microversion: 2.1 time: 0.037392 Oct 26 13:49:02.844305 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3393/6759] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:49:02 2022] GET /compute/v2.1/servers/06916a99-825b-43f6-9887-15064c6f9f0f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:49:06.405274 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9ceaabf4-1546-437a-9ee4-99b6fe53d80f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '.version_select at 0x7f6732ea8af0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:49:06.423242 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=4 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:49:06.464466 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9ceaabf4-1546-437a-9ee4-99b6fe53d80f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1401637738" status: 202 len: 0 microversion: 2.1 time: 0.062948 Oct 26 13:49:06.464994 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3367/6760] 10.222.0.40 () {58 vars in 1284 bytes} [Wed Oct 26 13:49:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1401637738 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:49:06.497961 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7cb9ab0c-89d0-4bf3-92c4-3424e83bb84e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Action: 'create', calling method: .version_select at 0x7f6731155b80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-253517291", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIoI1NZlvD6S/caXsZX9HIbjYsi8M/EGb6ij9QNOSX/SxzKbLFfUbkXZxk8dd+ZLFKPDglJ8sagrOAXR+3apRBKjMcaHd0iMX1NDsItLJODr6hW6zsfN9jjwY5sAjBT2vg=="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:49:06.516275 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-7cb9ab0c-89d0-4bf3-92c4-3424e83bb84e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Getting quotas for project bbc60a45db1c488ab4417c3b2c8d1983. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:49:06.522897 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-7cb9ab0c-89d0-4bf3-92c4-3424e83bb84e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Getting quotas for user c67f61dd56b74107b828dcd7f2fc31f1 and project bbc60a45db1c488ab4417c3b2c8d1983. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:49:06.547597 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7cb9ab0c-89d0-4bf3-92c4-3424e83bb84e tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.054168 Oct 26 13:49:06.548287 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3394/6761] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 13:49:06 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:49:11.710588 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-14f816e5-3755-4148-9455-1a12728e4211 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1507045994", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1766855477", "security_groups": [{"name": "tempest-secgroup-smoke-287163440"}], "block_device_mapping_v2": [{"uuid": "f2ac38fa-bd39-4ea6-9925-1c3d8715ed8d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a3a29c91-9973-4a7f-99bf-5b84e6501fd2"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:49:11.780884 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=75 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:49:11.902908 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-14f816e5-3755-4148-9455-1a12728e4211 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] validate_networks() for [('a3a29c91-9973-4a7f-99bf-5b84e6501fd2', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:49:12.638487 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-14f816e5-3755-4148-9455-1a12728e4211 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:49:12.639149 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-14f816e5-3755-4148-9455-1a12728e4211 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:49:12.639693 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-14f816e5-3755-4148-9455-1a12728e4211 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:49:12.640358 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-14f816e5-3755-4148-9455-1a12728e4211 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:49:12.640860 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-14f816e5-3755-4148-9455-1a12728e4211 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:49:12.651294 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-14f816e5-3755-4148-9455-1a12728e4211 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:12.651778 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-14f816e5-3755-4148-9455-1a12728e4211 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:12.652216 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-14f816e5-3755-4148-9455-1a12728e4211 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:12.652941 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-14f816e5-3755-4148-9455-1a12728e4211 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:12.653704 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-14f816e5-3755-4148-9455-1a12728e4211 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:12.654225 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-14f816e5-3755-4148-9455-1a12728e4211 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:12.676330 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-14f816e5-3755-4148-9455-1a12728e4211 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Getting quotas for project 2a1602330aa340b890bac76a120f74e8. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:49:12.682337 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-14f816e5-3755-4148-9455-1a12728e4211 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Getting quotas for user df8b67aae3ea4f17bfa684681311dec5 and project 2a1602330aa340b890bac76a120f74e8. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:49:12.779455 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-14f816e5-3755-4148-9455-1a12728e4211 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:49:12.781749 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-14f816e5-3755-4148-9455-1a12728e4211 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: b0226ba0-3c5e-4f29-8e6e-55bd62d754f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f2ac38fa-bd39-4ea6-9925-1c3d8715ed8d',volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:49:12.969436 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-14f816e5-3755-4148-9455-1a12728e4211 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.264905 Oct 26 13:49:12.970379 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3368/6762] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:49:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 1267 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:49:12.984318 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-323e44df-b4e0-43f8-9f18-161c1ccc803f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:49:12.985126 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-323e44df-b4e0-43f8-9f18-161c1ccc803f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: b0226ba0-3c5e-4f29-8e6e-55bd62d754f1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:49:13.086191 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-323e44df-b4e0-43f8-9f18-161c1ccc803f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:49:13.094504 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-323e44df-b4e0-43f8-9f18-161c1ccc803f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1" status: 200 len: 1095 microversion: 2.1 time: 0.116420 Oct 26 13:49:13.109815 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3395/6763] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:49:12 2022] GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 => generated 1095 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:49:13.408012 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-637fbd27-d41b-4484-ac23-28bbd48dc759 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-74816387", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "9cbd5ba4-53c6-41cc-bb79-91c04c1dcd6f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-253517291", "security_groups": [{"name": "tempest-secgroup-smoke-759130221"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:49:13.569005 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-637fbd27-d41b-4484-ac23-28bbd48dc759 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] validate_networks() for [('9cbd5ba4-53c6-41cc-bb79-91c04c1dcd6f', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:49:14.008063 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-637fbd27-d41b-4484-ac23-28bbd48dc759 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:49:14.008556 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-637fbd27-d41b-4484-ac23-28bbd48dc759 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:49:14.008954 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-637fbd27-d41b-4484-ac23-28bbd48dc759 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:49:14.009368 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-637fbd27-d41b-4484-ac23-28bbd48dc759 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:49:14.010144 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-637fbd27-d41b-4484-ac23-28bbd48dc759 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:49:14.019374 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-637fbd27-d41b-4484-ac23-28bbd48dc759 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:14.020010 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-637fbd27-d41b-4484-ac23-28bbd48dc759 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:14.020460 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-637fbd27-d41b-4484-ac23-28bbd48dc759 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:14.021275 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-637fbd27-d41b-4484-ac23-28bbd48dc759 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:14.021751 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-637fbd27-d41b-4484-ac23-28bbd48dc759 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:14.022178 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-637fbd27-d41b-4484-ac23-28bbd48dc759 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:14.041328 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-637fbd27-d41b-4484-ac23-28bbd48dc759 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Getting quotas for project bbc60a45db1c488ab4417c3b2c8d1983. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:49:14.047295 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-637fbd27-d41b-4484-ac23-28bbd48dc759 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Getting quotas for user c67f61dd56b74107b828dcd7f2fc31f1 and project bbc60a45db1c488ab4417c3b2c8d1983. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:49:14.061834 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-637fbd27-d41b-4484-ac23-28bbd48dc759 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:49:14.064129 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-637fbd27-d41b-4484-ac23-28bbd48dc759 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: d809a6d9-ee29-40bb-a935-2ad14b121952] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:49:14.114872 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-637fbd27-d41b-4484-ac23-28bbd48dc759 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.716049 Oct 26 13:49:14.116441 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3369/6764] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:49:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:49:14.127348 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2fdf24c6-cec8-4bb8-bc0e-f7e0b82ae404 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:49:14.128653 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2fdf24c6-cec8-4bb8-bc0e-f7e0b82ae404 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: b0226ba0-3c5e-4f29-8e6e-55bd62d754f1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:49:14.130781 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4ce99f7f-7f5b-4f20-83bd-508d676eda48 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:49:14.131435 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4ce99f7f-7f5b-4f20-83bd-508d676eda48 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: d809a6d9-ee29-40bb-a935-2ad14b121952] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:49:14.137408 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2fdf24c6-cec8-4bb8-bc0e-f7e0b82ae404 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:14.138223 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2fdf24c6-cec8-4bb8-bc0e-f7e0b82ae404 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:14.138896 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2fdf24c6-cec8-4bb8-bc0e-f7e0b82ae404 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:14.139857 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2fdf24c6-cec8-4bb8-bc0e-f7e0b82ae404 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:14.140670 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2fdf24c6-cec8-4bb8-bc0e-f7e0b82ae404 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:14.141434 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2fdf24c6-cec8-4bb8-bc0e-f7e0b82ae404 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:14.216414 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2fdf24c6-cec8-4bb8-bc0e-f7e0b82ae404 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:49:14.227994 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2fdf24c6-cec8-4bb8-bc0e-f7e0b82ae404 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1" status: 200 len: 1193 microversion: 2.1 time: 0.112731 Oct 26 13:49:14.238278 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4ce99f7f-7f5b-4f20-83bd-508d676eda48 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:49:14.243058 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3396/6765] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:49:14 2022] GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 => generated 1193 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:49:14.247605 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4ce99f7f-7f5b-4f20-83bd-508d676eda48 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952" status: 200 len: 1264 microversion: 2.1 time: 0.124015 Oct 26 13:49:14.271376 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3370/6766] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:49:14 2022] GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952 => generated 1264 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:49:15.253974 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ad54e23c-f62d-4058-9aed-519f66bef58d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:49:15.255291 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ad54e23c-f62d-4058-9aed-519f66bef58d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: b0226ba0-3c5e-4f29-8e6e-55bd62d754f1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:49:15.279117 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3a21239d-e64b-49db-9c49-6aeb431b1152 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:49:15.279657 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3a21239d-e64b-49db-9c49-6aeb431b1152 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: d809a6d9-ee29-40bb-a935-2ad14b121952] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:49:15.284899 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ad54e23c-f62d-4058-9aed-519f66bef58d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:15.285974 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ad54e23c-f62d-4058-9aed-519f66bef58d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:15.286699 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ad54e23c-f62d-4058-9aed-519f66bef58d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:15.288100 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ad54e23c-f62d-4058-9aed-519f66bef58d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:15.288826 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ad54e23c-f62d-4058-9aed-519f66bef58d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:15.289469 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ad54e23c-f62d-4058-9aed-519f66bef58d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:15.296047 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a21239d-e64b-49db-9c49-6aeb431b1152 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:15.296731 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a21239d-e64b-49db-9c49-6aeb431b1152 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:15.299098 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a21239d-e64b-49db-9c49-6aeb431b1152 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:15.301405 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a21239d-e64b-49db-9c49-6aeb431b1152 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:15.301964 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a21239d-e64b-49db-9c49-6aeb431b1152 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:15.302410 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a21239d-e64b-49db-9c49-6aeb431b1152 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:15.449449 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3a21239d-e64b-49db-9c49-6aeb431b1152 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:49:15.460505 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3a21239d-e64b-49db-9c49-6aeb431b1152 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952" status: 200 len: 1316 microversion: 2.1 time: 0.185142 Oct 26 13:49:15.461510 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3371/6767] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:49:15 2022] GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952 => generated 1316 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:49:15.561405 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ad54e23c-f62d-4058-9aed-519f66bef58d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:49:15.579041 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ad54e23c-f62d-4058-9aed-519f66bef58d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1" status: 200 len: 1278 microversion: 2.1 time: 0.329388 Oct 26 13:49:15.580053 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3397/6768] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:49:15 2022] GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 => generated 1278 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:49:16.487784 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d6941959-b415-441d-bc4a-d0f04a294d6f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:49:16.489221 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d6941959-b415-441d-bc4a-d0f04a294d6f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: d809a6d9-ee29-40bb-a935-2ad14b121952] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:49:16.503710 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6941959-b415-441d-bc4a-d0f04a294d6f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:16.508388 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6941959-b415-441d-bc4a-d0f04a294d6f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:16.509102 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6941959-b415-441d-bc4a-d0f04a294d6f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:16.510923 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6941959-b415-441d-bc4a-d0f04a294d6f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:16.511573 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6941959-b415-441d-bc4a-d0f04a294d6f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:16.512444 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6941959-b415-441d-bc4a-d0f04a294d6f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:16.613045 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-71a6c7d1-10b2-49a2-a1dd-c5094c3ccfff tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:49:16.620883 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-71a6c7d1-10b2-49a2-a1dd-c5094c3ccfff tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: b0226ba0-3c5e-4f29-8e6e-55bd62d754f1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:49:16.637862 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-71a6c7d1-10b2-49a2-a1dd-c5094c3ccfff tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:16.640514 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-71a6c7d1-10b2-49a2-a1dd-c5094c3ccfff tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:16.641729 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-71a6c7d1-10b2-49a2-a1dd-c5094c3ccfff tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:16.642801 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-71a6c7d1-10b2-49a2-a1dd-c5094c3ccfff tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:16.644086 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-71a6c7d1-10b2-49a2-a1dd-c5094c3ccfff tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:16.645060 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-71a6c7d1-10b2-49a2-a1dd-c5094c3ccfff tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:16.672629 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d6941959-b415-441d-bc4a-d0f04a294d6f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:49:16.682026 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d6941959-b415-441d-bc4a-d0f04a294d6f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952" status: 200 len: 1322 microversion: 2.1 time: 0.200031 Oct 26 13:49:16.682638 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3372/6769] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:49:16 2022] GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952 => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:49:16.705132 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-3dd58c71-e7a4-4580-85e6-210ac0b475e0 req-5f171720-5029-4b8f-86e8-f43630790246 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0226ba0-3c5e-4f29-8e6e-55bd62d754f1", "tag": "8b702b7d-e7c9-49da-a332-975c389e741b"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:49:16.740717 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-3dd58c71-e7a4-4580-85e6-210ac0b475e0 req-5f171720-5029-4b8f-86e8-f43630790246 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:16.741195 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-3dd58c71-e7a4-4580-85e6-210ac0b475e0 req-5f171720-5029-4b8f-86e8-f43630790246 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:16.741661 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-3dd58c71-e7a4-4580-85e6-210ac0b475e0 req-5f171720-5029-4b8f-86e8-f43630790246 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:16.765910 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-3dd58c71-e7a4-4580-85e6-210ac0b475e0 req-5f171720-5029-4b8f-86e8-f43630790246 service nova] Creating event network-changed:8b702b7d-e7c9-49da-a332-975c389e741b for instance b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 on n-h2-862686-1 Oct 26 13:49:16.806203 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-3dd58c71-e7a4-4580-85e6-210ac0b475e0 req-5f171720-5029-4b8f-86e8-f43630790246 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119281 Oct 26 13:49:16.814602 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3373/6770] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:49:16.972622 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-71a6c7d1-10b2-49a2-a1dd-c5094c3ccfff tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:49:16.981348 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-71a6c7d1-10b2-49a2-a1dd-c5094c3ccfff tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1" status: 200 len: 1278 microversion: 2.1 time: 0.380164 Oct 26 13:49:16.982694 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3398/6771] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:49:16 2022] GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 => generated 1278 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:49:17.713611 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-5f61537b-a471-499f-978d-74893f41526c req-5fe7648e-11d1-472d-b7eb-ccdc93aed9c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d809a6d9-ee29-40bb-a935-2ad14b121952", "tag": "1c1e9dda-6b21-4f88-bdf3-f055403450a2"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:49:17.721148 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a80c6834-5e3c-44bf-b085-c3f9351a59d5 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:49:17.725301 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a80c6834-5e3c-44bf-b085-c3f9351a59d5 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: d809a6d9-ee29-40bb-a935-2ad14b121952] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:49:17.743282 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a80c6834-5e3c-44bf-b085-c3f9351a59d5 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:17.745055 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a80c6834-5e3c-44bf-b085-c3f9351a59d5 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:17.745336 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-5f61537b-a471-499f-978d-74893f41526c req-5fe7648e-11d1-472d-b7eb-ccdc93aed9c9 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:17.746484 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a80c6834-5e3c-44bf-b085-c3f9351a59d5 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:17.746855 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-5f61537b-a471-499f-978d-74893f41526c req-5fe7648e-11d1-472d-b7eb-ccdc93aed9c9 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:17.748447 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-5f61537b-a471-499f-978d-74893f41526c req-5fe7648e-11d1-472d-b7eb-ccdc93aed9c9 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:17.750368 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a80c6834-5e3c-44bf-b085-c3f9351a59d5 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:17.751058 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a80c6834-5e3c-44bf-b085-c3f9351a59d5 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:17.751737 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a80c6834-5e3c-44bf-b085-c3f9351a59d5 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:17.777142 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-5f61537b-a471-499f-978d-74893f41526c req-5fe7648e-11d1-472d-b7eb-ccdc93aed9c9 service nova] Creating event network-changed:1c1e9dda-6b21-4f88-bdf3-f055403450a2 for instance d809a6d9-ee29-40bb-a935-2ad14b121952 on n-h1-862686-1 Oct 26 13:49:17.793326 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-5f61537b-a471-499f-978d-74893f41526c req-5fe7648e-11d1-472d-b7eb-ccdc93aed9c9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087450 Oct 26 13:49:17.794328 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3399/6772] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:49:17.956931 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a80c6834-5e3c-44bf-b085-c3f9351a59d5 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:49:17.969758 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a80c6834-5e3c-44bf-b085-c3f9351a59d5 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952" status: 200 len: 1389 microversion: 2.1 time: 0.266891 Oct 26 13:49:17.970703 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3374/6773] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:49:17 2022] GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952 => generated 1389 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:49:18.009968 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-777a6784-e513-436e-99d1-3295751caab9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:49:18.010958 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-777a6784-e513-436e-99d1-3295751caab9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: b0226ba0-3c5e-4f29-8e6e-55bd62d754f1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:49:18.017376 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-777a6784-e513-436e-99d1-3295751caab9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:18.017922 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-777a6784-e513-436e-99d1-3295751caab9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:18.018400 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-777a6784-e513-436e-99d1-3295751caab9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:18.019922 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-777a6784-e513-436e-99d1-3295751caab9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:18.020155 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-777a6784-e513-436e-99d1-3295751caab9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:18.020601 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-777a6784-e513-436e-99d1-3295751caab9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:18.232450 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-777a6784-e513-436e-99d1-3295751caab9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:49:18.243383 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-777a6784-e513-436e-99d1-3295751caab9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1" status: 200 len: 1278 microversion: 2.1 time: 0.237508 Oct 26 13:49:18.257517 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3400/6774] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:49:18 2022] GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 => generated 1278 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:49:18.992630 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3cd3ed14-85c3-42a0-97a4-c808106de433 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:49:18.993250 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3cd3ed14-85c3-42a0-97a4-c808106de433 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: d809a6d9-ee29-40bb-a935-2ad14b121952] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:49:19.000204 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3cd3ed14-85c3-42a0-97a4-c808106de433 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:19.000685 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3cd3ed14-85c3-42a0-97a4-c808106de433 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:19.001119 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3cd3ed14-85c3-42a0-97a4-c808106de433 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:19.001857 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3cd3ed14-85c3-42a0-97a4-c808106de433 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:19.002309 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3cd3ed14-85c3-42a0-97a4-c808106de433 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:19.002736 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3cd3ed14-85c3-42a0-97a4-c808106de433 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:19.146442 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3cd3ed14-85c3-42a0-97a4-c808106de433 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:49:19.154627 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3cd3ed14-85c3-42a0-97a4-c808106de433 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952" status: 200 len: 1389 microversion: 2.1 time: 0.166168 Oct 26 13:49:19.155227 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3375/6775] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:49:18 2022] GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952 => generated 1389 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:49:19.267623 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7e2b601a-ae51-4a4c-b7ec-56a6edadbf20 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:49:19.268282 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7e2b601a-ae51-4a4c-b7ec-56a6edadbf20 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: b0226ba0-3c5e-4f29-8e6e-55bd62d754f1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:49:19.275951 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e2b601a-ae51-4a4c-b7ec-56a6edadbf20 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:19.276459 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e2b601a-ae51-4a4c-b7ec-56a6edadbf20 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:19.276912 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e2b601a-ae51-4a4c-b7ec-56a6edadbf20 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:19.277669 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e2b601a-ae51-4a4c-b7ec-56a6edadbf20 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:19.278152 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e2b601a-ae51-4a4c-b7ec-56a6edadbf20 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:19.278588 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e2b601a-ae51-4a4c-b7ec-56a6edadbf20 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:19.492299 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7e2b601a-ae51-4a4c-b7ec-56a6edadbf20 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:49:19.500743 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7e2b601a-ae51-4a4c-b7ec-56a6edadbf20 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1" status: 200 len: 1278 microversion: 2.1 time: 0.236920 Oct 26 13:49:19.501919 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3401/6776] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:49:19 2022] GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 => generated 1278 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:49:20.179528 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5f5408b6-83cf-4402-995b-b5e13854e882 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:49:20.180153 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5f5408b6-83cf-4402-995b-b5e13854e882 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: d809a6d9-ee29-40bb-a935-2ad14b121952] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:49:20.187934 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5f5408b6-83cf-4402-995b-b5e13854e882 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:20.188428 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5f5408b6-83cf-4402-995b-b5e13854e882 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:20.188877 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5f5408b6-83cf-4402-995b-b5e13854e882 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:20.189622 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5f5408b6-83cf-4402-995b-b5e13854e882 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:20.190088 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5f5408b6-83cf-4402-995b-b5e13854e882 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:20.190570 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5f5408b6-83cf-4402-995b-b5e13854e882 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:20.329674 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5f5408b6-83cf-4402-995b-b5e13854e882 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:49:20.338110 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5f5408b6-83cf-4402-995b-b5e13854e882 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952" status: 200 len: 1389 microversion: 2.1 time: 0.163825 Oct 26 13:49:20.338686 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3376/6777] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:49:20 2022] GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952 => generated 1389 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:49:20.524750 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1315a1ef-9b3c-4e43-9a83-82693441f11d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:49:20.525310 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1315a1ef-9b3c-4e43-9a83-82693441f11d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: b0226ba0-3c5e-4f29-8e6e-55bd62d754f1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:49:20.532208 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1315a1ef-9b3c-4e43-9a83-82693441f11d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:20.532712 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1315a1ef-9b3c-4e43-9a83-82693441f11d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:20.533173 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1315a1ef-9b3c-4e43-9a83-82693441f11d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:20.533910 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1315a1ef-9b3c-4e43-9a83-82693441f11d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:20.534388 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1315a1ef-9b3c-4e43-9a83-82693441f11d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:20.534834 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1315a1ef-9b3c-4e43-9a83-82693441f11d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:20.669978 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1315a1ef-9b3c-4e43-9a83-82693441f11d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:49:20.678185 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1315a1ef-9b3c-4e43-9a83-82693441f11d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1" status: 200 len: 1266 microversion: 2.1 time: 0.157934 Oct 26 13:49:20.678766 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3402/6778] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:49:20 2022] GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:49:21.361319 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e6afeae9-6c4d-418a-bfe4-0f275fb7bc0b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:49:21.361964 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e6afeae9-6c4d-418a-bfe4-0f275fb7bc0b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: d809a6d9-ee29-40bb-a935-2ad14b121952] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:49:21.369853 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e6afeae9-6c4d-418a-bfe4-0f275fb7bc0b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:21.370337 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e6afeae9-6c4d-418a-bfe4-0f275fb7bc0b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:21.370773 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e6afeae9-6c4d-418a-bfe4-0f275fb7bc0b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:21.371460 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e6afeae9-6c4d-418a-bfe4-0f275fb7bc0b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:21.371909 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e6afeae9-6c4d-418a-bfe4-0f275fb7bc0b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:21.372333 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e6afeae9-6c4d-418a-bfe4-0f275fb7bc0b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:21.500154 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e6afeae9-6c4d-418a-bfe4-0f275fb7bc0b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:49:21.508258 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e6afeae9-6c4d-418a-bfe4-0f275fb7bc0b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952" status: 200 len: 1389 microversion: 2.1 time: 0.150890 Oct 26 13:49:21.508826 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3377/6779] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:49:21 2022] GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952 => generated 1389 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:49:21.701710 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-032964a5-965b-422d-84af-fa2350df09a7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:49:21.702337 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-032964a5-965b-422d-84af-fa2350df09a7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: b0226ba0-3c5e-4f29-8e6e-55bd62d754f1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:49:21.709617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-032964a5-965b-422d-84af-fa2350df09a7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:21.710120 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-032964a5-965b-422d-84af-fa2350df09a7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:21.710578 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-032964a5-965b-422d-84af-fa2350df09a7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:21.711290 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-032964a5-965b-422d-84af-fa2350df09a7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:21.711760 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-032964a5-965b-422d-84af-fa2350df09a7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:21.712205 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-032964a5-965b-422d-84af-fa2350df09a7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:21.842351 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-032964a5-965b-422d-84af-fa2350df09a7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:49:21.850965 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-032964a5-965b-422d-84af-fa2350df09a7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1" status: 200 len: 1266 microversion: 2.1 time: 0.153364 Oct 26 13:49:21.851540 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3403/6780] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:49:21 2022] GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:49:22.531147 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ad6d7215-f2e6-464b-8ae9-505808846486 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:49:22.531806 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ad6d7215-f2e6-464b-8ae9-505808846486 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: d809a6d9-ee29-40bb-a935-2ad14b121952] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:49:22.539503 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad6d7215-f2e6-464b-8ae9-505808846486 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:22.540009 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad6d7215-f2e6-464b-8ae9-505808846486 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:22.540447 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad6d7215-f2e6-464b-8ae9-505808846486 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:22.541133 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad6d7215-f2e6-464b-8ae9-505808846486 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:22.541613 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad6d7215-f2e6-464b-8ae9-505808846486 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:22.542034 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad6d7215-f2e6-464b-8ae9-505808846486 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:22.683428 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ad6d7215-f2e6-464b-8ae9-505808846486 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:49:22.691318 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ad6d7215-f2e6-464b-8ae9-505808846486 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952" status: 200 len: 1389 microversion: 2.1 time: 0.164011 Oct 26 13:49:22.691760 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3378/6781] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:49:22 2022] GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952 => generated 1389 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:49:22.873834 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2309e4a6-4024-4361-88f5-39660449c690 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:49:22.874389 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2309e4a6-4024-4361-88f5-39660449c690 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: b0226ba0-3c5e-4f29-8e6e-55bd62d754f1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:49:22.881450 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2309e4a6-4024-4361-88f5-39660449c690 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:22.882051 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2309e4a6-4024-4361-88f5-39660449c690 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:22.882502 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2309e4a6-4024-4361-88f5-39660449c690 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:22.883213 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2309e4a6-4024-4361-88f5-39660449c690 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:22.883683 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2309e4a6-4024-4361-88f5-39660449c690 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:22.884131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2309e4a6-4024-4361-88f5-39660449c690 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:23.180176 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:49:23.291805 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2309e4a6-4024-4361-88f5-39660449c690 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:49:23.299529 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2309e4a6-4024-4361-88f5-39660449c690 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1" status: 200 len: 1266 microversion: 2.1 time: 0.429775 Oct 26 13:49:23.300093 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3404/6782] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:49:22 2022] GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 => generated 1266 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:49:23.714827 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-58a135be-d071-4003-8176-7cd9dae9183b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:49:23.715363 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-58a135be-d071-4003-8176-7cd9dae9183b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: d809a6d9-ee29-40bb-a935-2ad14b121952] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:49:23.721886 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-58a135be-d071-4003-8176-7cd9dae9183b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:23.722387 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-58a135be-d071-4003-8176-7cd9dae9183b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:23.722827 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-58a135be-d071-4003-8176-7cd9dae9183b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:23.723554 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-58a135be-d071-4003-8176-7cd9dae9183b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:23.724014 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-58a135be-d071-4003-8176-7cd9dae9183b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:23.724442 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-58a135be-d071-4003-8176-7cd9dae9183b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:23.855442 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-58a135be-d071-4003-8176-7cd9dae9183b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:49:23.863403 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-58a135be-d071-4003-8176-7cd9dae9183b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952" status: 200 len: 1389 microversion: 2.1 time: 0.152727 Oct 26 13:49:23.863977 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3379/6783] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:49:23 2022] GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952 => generated 1389 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:49:24.324417 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-057dee74-e1b4-4cc6-8f2e-36e4aea2284d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:49:24.325063 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-057dee74-e1b4-4cc6-8f2e-36e4aea2284d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: b0226ba0-3c5e-4f29-8e6e-55bd62d754f1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:49:24.331749 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-057dee74-e1b4-4cc6-8f2e-36e4aea2284d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:24.332241 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-057dee74-e1b4-4cc6-8f2e-36e4aea2284d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:24.332691 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-057dee74-e1b4-4cc6-8f2e-36e4aea2284d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:24.333564 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-057dee74-e1b4-4cc6-8f2e-36e4aea2284d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:24.334034 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-057dee74-e1b4-4cc6-8f2e-36e4aea2284d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:24.334470 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-057dee74-e1b4-4cc6-8f2e-36e4aea2284d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:24.468066 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-057dee74-e1b4-4cc6-8f2e-36e4aea2284d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:49:24.476968 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-057dee74-e1b4-4cc6-8f2e-36e4aea2284d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1" status: 200 len: 1266 microversion: 2.1 time: 0.156877 Oct 26 13:49:24.477536 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3405/6784] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:49:24 2022] GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:49:24.654357 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-d9dddb07-be74-469d-a0f1-1500ee41e6cc req-e510cc75-08a2-4f0e-a5a1-580454a291ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d809a6d9-ee29-40bb-a935-2ad14b121952", "name": "network-vif-plugged", "status": "completed", "tag": "1c1e9dda-6b21-4f88-bdf3-f055403450a2"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:49:24.660401 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=4 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:49:24.661808 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=14 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:49:24.666933 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d9dddb07-be74-469d-a0f1-1500ee41e6cc req-e510cc75-08a2-4f0e-a5a1-580454a291ff service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:24.667417 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d9dddb07-be74-469d-a0f1-1500ee41e6cc req-e510cc75-08a2-4f0e-a5a1-580454a291ff service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:24.667850 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d9dddb07-be74-469d-a0f1-1500ee41e6cc req-e510cc75-08a2-4f0e-a5a1-580454a291ff service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:24.680645 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-d9dddb07-be74-469d-a0f1-1500ee41e6cc req-e510cc75-08a2-4f0e-a5a1-580454a291ff service nova] Creating event network-vif-plugged:1c1e9dda-6b21-4f88-bdf3-f055403450a2 for instance d809a6d9-ee29-40bb-a935-2ad14b121952 on n-h1-862686-1 Oct 26 13:49:24.685843 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-d9dddb07-be74-469d-a0f1-1500ee41e6cc req-e510cc75-08a2-4f0e-a5a1-580454a291ff service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035351 Oct 26 13:49:24.687071 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3380/6785] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:49:24.888210 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e730d838-a918-4504-b087-1baecc840613 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:49:24.888845 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e730d838-a918-4504-b087-1baecc840613 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: d809a6d9-ee29-40bb-a935-2ad14b121952] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:49:24.894823 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e730d838-a918-4504-b087-1baecc840613 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:24.895893 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e730d838-a918-4504-b087-1baecc840613 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:24.896387 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e730d838-a918-4504-b087-1baecc840613 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:24.897102 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e730d838-a918-4504-b087-1baecc840613 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:24.897602 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e730d838-a918-4504-b087-1baecc840613 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:24.898045 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e730d838-a918-4504-b087-1baecc840613 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:25.032216 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e730d838-a918-4504-b087-1baecc840613 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:49:25.040923 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e730d838-a918-4504-b087-1baecc840613 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952" status: 200 len: 1389 microversion: 2.1 time: 0.156700 Oct 26 13:49:25.041507 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3406/6786] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:49:24 2022] GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952 => generated 1389 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:49:25.501002 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c33c03a1-5561-492b-a21a-0f594a285d5e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:49:25.501727 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c33c03a1-5561-492b-a21a-0f594a285d5e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: b0226ba0-3c5e-4f29-8e6e-55bd62d754f1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:49:25.508574 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c33c03a1-5561-492b-a21a-0f594a285d5e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:25.509059 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c33c03a1-5561-492b-a21a-0f594a285d5e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:25.509517 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c33c03a1-5561-492b-a21a-0f594a285d5e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:25.510276 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c33c03a1-5561-492b-a21a-0f594a285d5e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:25.510736 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c33c03a1-5561-492b-a21a-0f594a285d5e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:25.511163 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c33c03a1-5561-492b-a21a-0f594a285d5e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:25.643786 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c33c03a1-5561-492b-a21a-0f594a285d5e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:49:25.651825 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c33c03a1-5561-492b-a21a-0f594a285d5e tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1" status: 200 len: 1266 microversion: 2.1 time: 0.155940 Oct 26 13:49:25.652438 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3381/6787] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:49:25 2022] GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:49:26.063463 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c9f0eff0-bcfa-4c1b-a6a5-26dbd8aa8169 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:49:26.064095 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c9f0eff0-bcfa-4c1b-a6a5-26dbd8aa8169 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: d809a6d9-ee29-40bb-a935-2ad14b121952] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:49:26.072537 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9f0eff0-bcfa-4c1b-a6a5-26dbd8aa8169 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:26.073046 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9f0eff0-bcfa-4c1b-a6a5-26dbd8aa8169 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:26.073525 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9f0eff0-bcfa-4c1b-a6a5-26dbd8aa8169 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:26.074247 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9f0eff0-bcfa-4c1b-a6a5-26dbd8aa8169 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:26.074726 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9f0eff0-bcfa-4c1b-a6a5-26dbd8aa8169 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:26.075174 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c9f0eff0-bcfa-4c1b-a6a5-26dbd8aa8169 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:26.206775 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c9f0eff0-bcfa-4c1b-a6a5-26dbd8aa8169 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:49:26.216059 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c9f0eff0-bcfa-4c1b-a6a5-26dbd8aa8169 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952" status: 200 len: 1561 microversion: 2.1 time: 0.156497 Oct 26 13:49:26.216628 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3407/6788] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:49:26 2022] GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:49:26.238450 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a2783435-0045-441a-bffc-bc36d7b40df0 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:49:26.239217 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a2783435-0045-441a-bffc-bc36d7b40df0 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: d809a6d9-ee29-40bb-a935-2ad14b121952] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:49:26.245349 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2783435-0045-441a-bffc-bc36d7b40df0 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:26.245836 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2783435-0045-441a-bffc-bc36d7b40df0 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:26.246308 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2783435-0045-441a-bffc-bc36d7b40df0 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:26.246998 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2783435-0045-441a-bffc-bc36d7b40df0 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:26.247457 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2783435-0045-441a-bffc-bc36d7b40df0 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:26.247887 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2783435-0045-441a-bffc-bc36d7b40df0 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:26.377797 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a2783435-0045-441a-bffc-bc36d7b40df0 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:49:26.385647 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a2783435-0045-441a-bffc-bc36d7b40df0 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952" status: 200 len: 1561 microversion: 2.1 time: 0.151043 Oct 26 13:49:26.386229 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3382/6789] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:49:26 2022] GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:49:26.674758 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-94914208-441f-4cbd-b8c2-a244226b5a57 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:49:26.675384 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-94914208-441f-4cbd-b8c2-a244226b5a57 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: b0226ba0-3c5e-4f29-8e6e-55bd62d754f1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:49:26.681430 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-94914208-441f-4cbd-b8c2-a244226b5a57 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:26.681958 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-94914208-441f-4cbd-b8c2-a244226b5a57 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:26.682406 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-94914208-441f-4cbd-b8c2-a244226b5a57 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:26.683108 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-94914208-441f-4cbd-b8c2-a244226b5a57 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:26.683572 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-94914208-441f-4cbd-b8c2-a244226b5a57 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:26.684013 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-94914208-441f-4cbd-b8c2-a244226b5a57 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:26.814944 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-94914208-441f-4cbd-b8c2-a244226b5a57 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:49:26.823612 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-94914208-441f-4cbd-b8c2-a244226b5a57 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1" status: 200 len: 1266 microversion: 2.1 time: 0.152681 Oct 26 13:49:26.824191 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3408/6790] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:49:26 2022] GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:49:27.847583 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6421d1b6-9f08-4753-bef6-9e6b0d070399 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:49:27.848270 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6421d1b6-9f08-4753-bef6-9e6b0d070399 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: b0226ba0-3c5e-4f29-8e6e-55bd62d754f1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:49:27.855786 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6421d1b6-9f08-4753-bef6-9e6b0d070399 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:27.856272 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6421d1b6-9f08-4753-bef6-9e6b0d070399 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:27.856709 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6421d1b6-9f08-4753-bef6-9e6b0d070399 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:27.857404 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6421d1b6-9f08-4753-bef6-9e6b0d070399 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:27.857888 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6421d1b6-9f08-4753-bef6-9e6b0d070399 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:27.858313 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6421d1b6-9f08-4753-bef6-9e6b0d070399 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:28.070678 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6421d1b6-9f08-4753-bef6-9e6b0d070399 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:49:28.078626 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6421d1b6-9f08-4753-bef6-9e6b0d070399 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1" status: 200 len: 1266 microversion: 2.1 time: 0.235146 Oct 26 13:49:28.079139 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3383/6791] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:49:27 2022] GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 => generated 1266 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:49:28.376738 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bd8345b1-f87e-4410-9daf-75b6e01e0a39 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:49:28.377376 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bd8345b1-f87e-4410-9daf-75b6e01e0a39 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: d809a6d9-ee29-40bb-a935-2ad14b121952] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:49:28.386813 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-0cbf4e58-ee8a-4e75-bac5-59e2b37cdc6d req-90da3cc3-fd80-488f-bf93-1e5a31f08828 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d809a6d9-ee29-40bb-a935-2ad14b121952", "tag": "1c1e9dda-6b21-4f88-bdf3-f055403450a2"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:49:28.396575 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd8345b1-f87e-4410-9daf-75b6e01e0a39 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:28.397096 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd8345b1-f87e-4410-9daf-75b6e01e0a39 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:28.397816 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd8345b1-f87e-4410-9daf-75b6e01e0a39 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:28.398552 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd8345b1-f87e-4410-9daf-75b6e01e0a39 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:28.399036 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd8345b1-f87e-4410-9daf-75b6e01e0a39 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:28.399490 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd8345b1-f87e-4410-9daf-75b6e01e0a39 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:28.400973 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-0cbf4e58-ee8a-4e75-bac5-59e2b37cdc6d req-90da3cc3-fd80-488f-bf93-1e5a31f08828 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:28.401611 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-0cbf4e58-ee8a-4e75-bac5-59e2b37cdc6d req-90da3cc3-fd80-488f-bf93-1e5a31f08828 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:28.402061 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-0cbf4e58-ee8a-4e75-bac5-59e2b37cdc6d req-90da3cc3-fd80-488f-bf93-1e5a31f08828 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:28.413922 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-0cbf4e58-ee8a-4e75-bac5-59e2b37cdc6d req-90da3cc3-fd80-488f-bf93-1e5a31f08828 service nova] Creating event network-changed:1c1e9dda-6b21-4f88-bdf3-f055403450a2 for instance d809a6d9-ee29-40bb-a935-2ad14b121952 on n-h1-862686-1 Oct 26 13:49:28.419319 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-0cbf4e58-ee8a-4e75-bac5-59e2b37cdc6d req-90da3cc3-fd80-488f-bf93-1e5a31f08828 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040431 Oct 26 13:49:28.420160 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3384/6792] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:49:28.625742 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bd8345b1-f87e-4410-9daf-75b6e01e0a39 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:49:28.634441 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bd8345b1-f87e-4410-9daf-75b6e01e0a39 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952" status: 200 len: 1561 microversion: 2.1 time: 0.261721 Oct 26 13:49:28.635320 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3409/6793] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:49:28 2022] GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952 => generated 1561 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:49:29.102707 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-26b5d8cb-38f0-495a-895b-a67224ffdbe7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:49:29.103448 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-26b5d8cb-38f0-495a-895b-a67224ffdbe7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: b0226ba0-3c5e-4f29-8e6e-55bd62d754f1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:49:29.111426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26b5d8cb-38f0-495a-895b-a67224ffdbe7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:29.111978 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26b5d8cb-38f0-495a-895b-a67224ffdbe7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:29.112507 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26b5d8cb-38f0-495a-895b-a67224ffdbe7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:29.113309 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26b5d8cb-38f0-495a-895b-a67224ffdbe7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:29.114253 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26b5d8cb-38f0-495a-895b-a67224ffdbe7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:29.114790 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26b5d8cb-38f0-495a-895b-a67224ffdbe7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:29.260001 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-26b5d8cb-38f0-495a-895b-a67224ffdbe7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:49:29.268405 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-26b5d8cb-38f0-495a-895b-a67224ffdbe7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1" status: 200 len: 1266 microversion: 2.1 time: 0.170333 Oct 26 13:49:29.269192 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3385/6794] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:49:29 2022] GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:49:30.292116 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a1b09ba9-aad7-4bee-810e-9463ef6ff875 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:49:30.292750 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a1b09ba9-aad7-4bee-810e-9463ef6ff875 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: b0226ba0-3c5e-4f29-8e6e-55bd62d754f1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:49:30.295469 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:49:30.300842 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a1b09ba9-aad7-4bee-810e-9463ef6ff875 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:30.301347 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a1b09ba9-aad7-4bee-810e-9463ef6ff875 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:30.301912 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a1b09ba9-aad7-4bee-810e-9463ef6ff875 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:30.302687 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a1b09ba9-aad7-4bee-810e-9463ef6ff875 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:30.303165 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a1b09ba9-aad7-4bee-810e-9463ef6ff875 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:30.303609 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a1b09ba9-aad7-4bee-810e-9463ef6ff875 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:30.442816 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a1b09ba9-aad7-4bee-810e-9463ef6ff875 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:49:30.450708 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a1b09ba9-aad7-4bee-810e-9463ef6ff875 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1" status: 200 len: 1266 microversion: 2.1 time: 0.162544 Oct 26 13:49:30.451288 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3410/6795] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:49:30 2022] GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:49:30.850679 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-0bc81686-3f31-40fd-bc49-e799b2b19eb2 req-e8d32553-20d4-4640-a5ab-b412e868aed8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0226ba0-3c5e-4f29-8e6e-55bd62d754f1", "name": "network-vif-plugged", "status": "completed", "tag": "8b702b7d-e7c9-49da-a332-975c389e741b"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:49:30.857035 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:49:30.864368 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-0bc81686-3f31-40fd-bc49-e799b2b19eb2 req-e8d32553-20d4-4640-a5ab-b412e868aed8 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:30.865073 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-0bc81686-3f31-40fd-bc49-e799b2b19eb2 req-e8d32553-20d4-4640-a5ab-b412e868aed8 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:30.865844 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-0bc81686-3f31-40fd-bc49-e799b2b19eb2 req-e8d32553-20d4-4640-a5ab-b412e868aed8 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:30.878706 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-0bc81686-3f31-40fd-bc49-e799b2b19eb2 req-e8d32553-20d4-4640-a5ab-b412e868aed8 service nova] Creating event network-vif-plugged:8b702b7d-e7c9-49da-a332-975c389e741b for instance b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 on n-h2-862686-1 Oct 26 13:49:30.884364 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-0bc81686-3f31-40fd-bc49-e799b2b19eb2 req-e8d32553-20d4-4640-a5ab-b412e868aed8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037590 Oct 26 13:49:30.884977 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3386/6796] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:49:31.474497 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1538f70c-3ede-4550-bc4c-4d646ce84220 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:49:31.475112 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1538f70c-3ede-4550-bc4c-4d646ce84220 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: b0226ba0-3c5e-4f29-8e6e-55bd62d754f1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:49:31.481996 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1538f70c-3ede-4550-bc4c-4d646ce84220 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:31.482486 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1538f70c-3ede-4550-bc4c-4d646ce84220 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:31.482932 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1538f70c-3ede-4550-bc4c-4d646ce84220 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:31.483630 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1538f70c-3ede-4550-bc4c-4d646ce84220 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:31.484099 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1538f70c-3ede-4550-bc4c-4d646ce84220 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:31.484533 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1538f70c-3ede-4550-bc4c-4d646ce84220 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:31.614333 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1538f70c-3ede-4550-bc4c-4d646ce84220 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:49:31.622387 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1538f70c-3ede-4550-bc4c-4d646ce84220 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1" status: 200 len: 1266 microversion: 2.1 time: 0.152575 Oct 26 13:49:31.622964 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3411/6797] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:49:31 2022] GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:49:32.645248 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-00b00f76-ef80-4f4b-8765-c9fc9db551f5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:49:32.646336 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-00b00f76-ef80-4f4b-8765-c9fc9db551f5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: b0226ba0-3c5e-4f29-8e6e-55bd62d754f1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:49:32.654217 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-00b00f76-ef80-4f4b-8765-c9fc9db551f5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:32.654702 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-00b00f76-ef80-4f4b-8765-c9fc9db551f5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:32.655167 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-00b00f76-ef80-4f4b-8765-c9fc9db551f5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:32.655884 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-00b00f76-ef80-4f4b-8765-c9fc9db551f5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:32.656332 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-00b00f76-ef80-4f4b-8765-c9fc9db551f5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:32.656756 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-00b00f76-ef80-4f4b-8765-c9fc9db551f5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:32.793619 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-00b00f76-ef80-4f4b-8765-c9fc9db551f5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:49:32.801380 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-00b00f76-ef80-4f4b-8765-c9fc9db551f5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1" status: 200 len: 1454 microversion: 2.1 time: 0.160757 Oct 26 13:49:32.802631 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3387/6798] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:49:32 2022] GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 => generated 1454 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:49:32.824018 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-32b013ba-e1b1-4637-aae2-fd27c9d358e5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:49:32.824677 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-32b013ba-e1b1-4637-aae2-fd27c9d358e5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: b0226ba0-3c5e-4f29-8e6e-55bd62d754f1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:49:32.831462 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32b013ba-e1b1-4637-aae2-fd27c9d358e5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:32.831949 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32b013ba-e1b1-4637-aae2-fd27c9d358e5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:32.832396 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32b013ba-e1b1-4637-aae2-fd27c9d358e5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:32.833100 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32b013ba-e1b1-4637-aae2-fd27c9d358e5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:32.833922 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32b013ba-e1b1-4637-aae2-fd27c9d358e5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:32.834182 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32b013ba-e1b1-4637-aae2-fd27c9d358e5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:32.963777 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-32b013ba-e1b1-4637-aae2-fd27c9d358e5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:49:32.971461 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-32b013ba-e1b1-4637-aae2-fd27c9d358e5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1" status: 200 len: 1454 microversion: 2.1 time: 0.151431 Oct 26 13:49:32.972025 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3412/6799] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:49:32 2022] GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:49:34.876659 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-48493298-3c3f-4a53-af03-d71d82c78c9e req-e5233f31-1853-43c1-a646-c9023f60f40a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0226ba0-3c5e-4f29-8e6e-55bd62d754f1", "tag": "8b702b7d-e7c9-49da-a332-975c389e741b"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:49:34.888105 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-48493298-3c3f-4a53-af03-d71d82c78c9e req-e5233f31-1853-43c1-a646-c9023f60f40a service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:34.888717 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-48493298-3c3f-4a53-af03-d71d82c78c9e req-e5233f31-1853-43c1-a646-c9023f60f40a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:34.889147 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-48493298-3c3f-4a53-af03-d71d82c78c9e req-e5233f31-1853-43c1-a646-c9023f60f40a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:34.900902 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-48493298-3c3f-4a53-af03-d71d82c78c9e req-e5233f31-1853-43c1-a646-c9023f60f40a service nova] Creating event network-changed:8b702b7d-e7c9-49da-a332-975c389e741b for instance b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 on n-h2-862686-1 Oct 26 13:49:34.905892 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-48493298-3c3f-4a53-af03-d71d82c78c9e req-e5233f31-1853-43c1-a646-c9023f60f40a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032841 Oct 26 13:49:34.906671 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3388/6800] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:49:51.938178 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-da167329-ebdb-4778-8c69-ef8fb42e44e7 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:49:51.940441 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-da167329-ebdb-4778-8c69-ef8fb42e44e7 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: d809a6d9-ee29-40bb-a935-2ad14b121952] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:49:51.943586 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=5 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:49:51.944260 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=99 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:49:51.950384 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da167329-ebdb-4778-8c69-ef8fb42e44e7 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:51.950911 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da167329-ebdb-4778-8c69-ef8fb42e44e7 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:51.951605 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da167329-ebdb-4778-8c69-ef8fb42e44e7 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:51.952558 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da167329-ebdb-4778-8c69-ef8fb42e44e7 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:49:51.953088 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da167329-ebdb-4778-8c69-ef8fb42e44e7 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:49:51.953618 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da167329-ebdb-4778-8c69-ef8fb42e44e7 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:49:52.008360 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-da167329-ebdb-4778-8c69-ef8fb42e44e7 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "POST /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952/action" status: 200 len: 24570 microversion: 2.1 time: 0.074180 Oct 26 13:49:52.008984 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3413/6801] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:49:51 2022] POST /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952/action => generated 24570 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:50:02.959967 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bd6a2afc-ac29-4bab-91a3-345db68e415f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:50:02.962790 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bd6a2afc-ac29-4bab-91a3-345db68e415f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: d809a6d9-ee29-40bb-a935-2ad14b121952] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:50:02.965229 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=5 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:50:02.965892 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=92 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:50:02.971895 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd6a2afc-ac29-4bab-91a3-345db68e415f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:50:02.972384 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd6a2afc-ac29-4bab-91a3-345db68e415f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:50:02.972824 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd6a2afc-ac29-4bab-91a3-345db68e415f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:50:02.973540 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd6a2afc-ac29-4bab-91a3-345db68e415f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:50:02.974002 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd6a2afc-ac29-4bab-91a3-345db68e415f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:50:02.974440 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd6a2afc-ac29-4bab-91a3-345db68e415f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:50:03.053654 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-bd6a2afc-ac29-4bab-91a3-345db68e415f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:50:03.054080 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-bd6a2afc-ac29-4bab-91a3-345db68e415f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:50:03.054555 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-bd6a2afc-ac29-4bab-91a3-345db68e415f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:50:03.054964 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-bd6a2afc-ac29-4bab-91a3-345db68e415f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:50:03.055386 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-bd6a2afc-ac29-4bab-91a3-345db68e415f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:50:03.117106 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bd6a2afc-ac29-4bab-91a3-345db68e415f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: d809a6d9-ee29-40bb-a935-2ad14b121952] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:50:03.123137 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd6a2afc-ac29-4bab-91a3-345db68e415f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:50:03.123632 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd6a2afc-ac29-4bab-91a3-345db68e415f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:50:03.124075 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd6a2afc-ac29-4bab-91a3-345db68e415f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:50:03.124776 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd6a2afc-ac29-4bab-91a3-345db68e415f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:50:03.125237 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd6a2afc-ac29-4bab-91a3-345db68e415f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:50:03.125819 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd6a2afc-ac29-4bab-91a3-345db68e415f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:50:03.154024 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bd6a2afc-ac29-4bab-91a3-345db68e415f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "POST /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952/action" status: 202 len: 1136 microversion: 2.1 time: 0.198333 Oct 26 13:50:03.154866 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3389/6802] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:50:02 2022] POST /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952/action => generated 1136 bytes in 200 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 26 13:50:03.176004 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9d974ea0-992c-4327-b4ef-dc2fa04af314 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:50:03.176741 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9d974ea0-992c-4327-b4ef-dc2fa04af314 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: d809a6d9-ee29-40bb-a935-2ad14b121952] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:50:03.180351 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:50:03.181033 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=4 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:50:03.186909 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d974ea0-992c-4327-b4ef-dc2fa04af314 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:50:03.187416 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d974ea0-992c-4327-b4ef-dc2fa04af314 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:50:03.187874 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d974ea0-992c-4327-b4ef-dc2fa04af314 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:50:03.188599 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d974ea0-992c-4327-b4ef-dc2fa04af314 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:50:03.189076 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d974ea0-992c-4327-b4ef-dc2fa04af314 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:50:03.189570 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d974ea0-992c-4327-b4ef-dc2fa04af314 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:50:03.326080 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9d974ea0-992c-4327-b4ef-dc2fa04af314 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:50:03.334048 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9d974ea0-992c-4327-b4ef-dc2fa04af314 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952" status: 200 len: 1689 microversion: 2.1 time: 0.162455 Oct 26 13:50:03.334621 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3414/6803] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:50:03 2022] GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952 => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:50:04.357120 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-66ae1fda-4159-41a9-a1e2-2de498aaaf03 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:50:04.357765 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-66ae1fda-4159-41a9-a1e2-2de498aaaf03 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: d809a6d9-ee29-40bb-a935-2ad14b121952] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:50:04.364755 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-66ae1fda-4159-41a9-a1e2-2de498aaaf03 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:50:04.365243 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-66ae1fda-4159-41a9-a1e2-2de498aaaf03 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:50:04.365719 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-66ae1fda-4159-41a9-a1e2-2de498aaaf03 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:50:04.367166 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-66ae1fda-4159-41a9-a1e2-2de498aaaf03 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:50:04.367623 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-66ae1fda-4159-41a9-a1e2-2de498aaaf03 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:50:04.368049 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-66ae1fda-4159-41a9-a1e2-2de498aaaf03 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:50:04.498760 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-66ae1fda-4159-41a9-a1e2-2de498aaaf03 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:50:04.506488 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-66ae1fda-4159-41a9-a1e2-2de498aaaf03 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952" status: 200 len: 1689 microversion: 2.1 time: 0.153230 Oct 26 13:50:04.508128 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3390/6804] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:50:04 2022] GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952 => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:50:05.531225 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-80a0eae1-4ea9-43f2-adbd-c5cdecacb421 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:50:05.531848 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-80a0eae1-4ea9-43f2-adbd-c5cdecacb421 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: d809a6d9-ee29-40bb-a935-2ad14b121952] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:50:05.543418 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-80a0eae1-4ea9-43f2-adbd-c5cdecacb421 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:50:05.543932 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-80a0eae1-4ea9-43f2-adbd-c5cdecacb421 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:50:05.544423 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-80a0eae1-4ea9-43f2-adbd-c5cdecacb421 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:50:05.545162 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-80a0eae1-4ea9-43f2-adbd-c5cdecacb421 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:50:05.545795 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-80a0eae1-4ea9-43f2-adbd-c5cdecacb421 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:50:05.546238 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-80a0eae1-4ea9-43f2-adbd-c5cdecacb421 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:50:05.681838 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-80a0eae1-4ea9-43f2-adbd-c5cdecacb421 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:50:05.689685 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-80a0eae1-4ea9-43f2-adbd-c5cdecacb421 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952" status: 200 len: 1689 microversion: 2.1 time: 0.162396 Oct 26 13:50:05.690254 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3415/6805] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:50:05 2022] GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952 => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:50:06.714590 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3807cf19-cc25-4b05-8d06-a8b5ffc7eafe tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:50:06.715188 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3807cf19-cc25-4b05-8d06-a8b5ffc7eafe tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: d809a6d9-ee29-40bb-a935-2ad14b121952] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:50:06.721415 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3807cf19-cc25-4b05-8d06-a8b5ffc7eafe tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:50:06.721938 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3807cf19-cc25-4b05-8d06-a8b5ffc7eafe tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:50:06.722408 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3807cf19-cc25-4b05-8d06-a8b5ffc7eafe tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:50:06.723092 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3807cf19-cc25-4b05-8d06-a8b5ffc7eafe tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:50:06.723551 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3807cf19-cc25-4b05-8d06-a8b5ffc7eafe tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:50:06.723979 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3807cf19-cc25-4b05-8d06-a8b5ffc7eafe tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:50:06.859327 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3807cf19-cc25-4b05-8d06-a8b5ffc7eafe tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:50:06.869608 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3807cf19-cc25-4b05-8d06-a8b5ffc7eafe tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952" status: 200 len: 1689 microversion: 2.1 time: 0.159901 Oct 26 13:50:06.871206 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3391/6806] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:50:06 2022] GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:50:07.894341 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-55824596-bc42-450b-bda0-a8c01b5618a2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:50:07.895217 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-55824596-bc42-450b-bda0-a8c01b5618a2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: d809a6d9-ee29-40bb-a935-2ad14b121952] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:50:07.902798 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55824596-bc42-450b-bda0-a8c01b5618a2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:50:07.903297 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55824596-bc42-450b-bda0-a8c01b5618a2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:50:07.903984 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55824596-bc42-450b-bda0-a8c01b5618a2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:50:07.904815 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55824596-bc42-450b-bda0-a8c01b5618a2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:50:07.905282 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55824596-bc42-450b-bda0-a8c01b5618a2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:50:07.905745 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55824596-bc42-450b-bda0-a8c01b5618a2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:50:08.038884 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-55824596-bc42-450b-bda0-a8c01b5618a2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:50:08.047032 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-55824596-bc42-450b-bda0-a8c01b5618a2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952" status: 200 len: 1689 microversion: 2.1 time: 0.157330 Oct 26 13:50:08.047610 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3416/6807] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:50:07 2022] GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:50:09.071959 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cb3b0d7f-a36c-49ed-9a1f-798c8ca12ee7 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:50:09.072628 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cb3b0d7f-a36c-49ed-9a1f-798c8ca12ee7 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: d809a6d9-ee29-40bb-a935-2ad14b121952] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:50:09.079683 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb3b0d7f-a36c-49ed-9a1f-798c8ca12ee7 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:50:09.080183 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb3b0d7f-a36c-49ed-9a1f-798c8ca12ee7 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:50:09.080625 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb3b0d7f-a36c-49ed-9a1f-798c8ca12ee7 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:50:09.081334 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb3b0d7f-a36c-49ed-9a1f-798c8ca12ee7 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:50:09.081817 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb3b0d7f-a36c-49ed-9a1f-798c8ca12ee7 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:50:09.082258 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb3b0d7f-a36c-49ed-9a1f-798c8ca12ee7 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:50:09.239164 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cb3b0d7f-a36c-49ed-9a1f-798c8ca12ee7 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:50:09.248233 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cb3b0d7f-a36c-49ed-9a1f-798c8ca12ee7 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952" status: 200 len: 1689 microversion: 2.1 time: 0.181168 Oct 26 13:50:09.248801 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3392/6808] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:50:09 2022] GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952 => generated 1689 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:50:10.272598 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d586ee53-71c8-4844-a069-af25234ef2b2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:50:10.273227 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d586ee53-71c8-4844-a069-af25234ef2b2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: d809a6d9-ee29-40bb-a935-2ad14b121952] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:50:10.281534 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d586ee53-71c8-4844-a069-af25234ef2b2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:50:10.282040 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d586ee53-71c8-4844-a069-af25234ef2b2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:50:10.282490 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d586ee53-71c8-4844-a069-af25234ef2b2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:50:10.283212 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d586ee53-71c8-4844-a069-af25234ef2b2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:50:10.283684 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d586ee53-71c8-4844-a069-af25234ef2b2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:50:10.284156 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d586ee53-71c8-4844-a069-af25234ef2b2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:50:10.429304 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d586ee53-71c8-4844-a069-af25234ef2b2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:50:10.439407 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d586ee53-71c8-4844-a069-af25234ef2b2 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952" status: 200 len: 1689 microversion: 2.1 time: 0.170837 Oct 26 13:50:10.439991 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3417/6809] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:50:10 2022] GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952 => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:50:11.464733 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f9b731e4-bf6a-4c21-b672-029e1ded3e76 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:50:11.465388 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f9b731e4-bf6a-4c21-b672-029e1ded3e76 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: d809a6d9-ee29-40bb-a935-2ad14b121952] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:50:11.472777 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f9b731e4-bf6a-4c21-b672-029e1ded3e76 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:50:11.473255 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f9b731e4-bf6a-4c21-b672-029e1ded3e76 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:50:11.473777 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f9b731e4-bf6a-4c21-b672-029e1ded3e76 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:50:11.474562 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f9b731e4-bf6a-4c21-b672-029e1ded3e76 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:50:11.476323 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f9b731e4-bf6a-4c21-b672-029e1ded3e76 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:50:11.476733 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f9b731e4-bf6a-4c21-b672-029e1ded3e76 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:50:11.879967 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f9b731e4-bf6a-4c21-b672-029e1ded3e76 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:50:11.888554 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f9b731e4-bf6a-4c21-b672-029e1ded3e76 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952" status: 200 len: 1689 microversion: 2.1 time: 0.429128 Oct 26 13:50:11.889141 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3393/6810] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:50:11 2022] GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952 => generated 1689 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:50:12.912202 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c8feacb0-5f40-47e5-a2e0-598f8355be17 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:50:12.912826 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c8feacb0-5f40-47e5-a2e0-598f8355be17 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: d809a6d9-ee29-40bb-a935-2ad14b121952] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:50:12.920319 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c8feacb0-5f40-47e5-a2e0-598f8355be17 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:50:12.920813 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c8feacb0-5f40-47e5-a2e0-598f8355be17 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:50:12.921264 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c8feacb0-5f40-47e5-a2e0-598f8355be17 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:50:12.922009 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c8feacb0-5f40-47e5-a2e0-598f8355be17 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:50:12.922485 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c8feacb0-5f40-47e5-a2e0-598f8355be17 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:50:12.922923 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c8feacb0-5f40-47e5-a2e0-598f8355be17 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:50:13.056010 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c8feacb0-5f40-47e5-a2e0-598f8355be17 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:50:13.063735 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c8feacb0-5f40-47e5-a2e0-598f8355be17 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952" status: 200 len: 1689 microversion: 2.1 time: 0.155766 Oct 26 13:50:13.064304 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3418/6811] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:50:12 2022] GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952 => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:50:14.087575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ff042993-b0f4-42f3-a1ed-98027b489f60 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:50:14.088208 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ff042993-b0f4-42f3-a1ed-98027b489f60 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: d809a6d9-ee29-40bb-a935-2ad14b121952] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:50:14.095203 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff042993-b0f4-42f3-a1ed-98027b489f60 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:50:14.095693 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff042993-b0f4-42f3-a1ed-98027b489f60 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:50:14.096136 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff042993-b0f4-42f3-a1ed-98027b489f60 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:50:14.096828 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff042993-b0f4-42f3-a1ed-98027b489f60 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:50:14.097285 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff042993-b0f4-42f3-a1ed-98027b489f60 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:50:14.097749 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff042993-b0f4-42f3-a1ed-98027b489f60 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:50:14.233164 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ff042993-b0f4-42f3-a1ed-98027b489f60 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:50:14.240822 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ff042993-b0f4-42f3-a1ed-98027b489f60 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952" status: 200 len: 1689 microversion: 2.1 time: 0.157752 Oct 26 13:50:14.241379 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3394/6812] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:50:14 2022] GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:50:15.264870 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-520f4339-051e-4d3d-81ec-dc91bdec41c6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:50:15.265527 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-520f4339-051e-4d3d-81ec-dc91bdec41c6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: d809a6d9-ee29-40bb-a935-2ad14b121952] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:50:15.272293 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-520f4339-051e-4d3d-81ec-dc91bdec41c6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:50:15.272795 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-520f4339-051e-4d3d-81ec-dc91bdec41c6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:50:15.274046 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-520f4339-051e-4d3d-81ec-dc91bdec41c6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:50:15.274776 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-520f4339-051e-4d3d-81ec-dc91bdec41c6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:50:15.275257 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-520f4339-051e-4d3d-81ec-dc91bdec41c6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:50:15.275704 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-520f4339-051e-4d3d-81ec-dc91bdec41c6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:50:15.405876 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-520f4339-051e-4d3d-81ec-dc91bdec41c6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:50:15.414404 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-520f4339-051e-4d3d-81ec-dc91bdec41c6 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952" status: 200 len: 1695 microversion: 2.1 time: 0.152979 Oct 26 13:50:15.415048 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3419/6813] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:50:15 2022] GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952 => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:50:16.438572 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-769eedfe-6254-4f7d-a545-dd795e0d35c4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:50:16.439248 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-769eedfe-6254-4f7d-a545-dd795e0d35c4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: d809a6d9-ee29-40bb-a935-2ad14b121952] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:50:16.446694 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-769eedfe-6254-4f7d-a545-dd795e0d35c4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:50:16.447168 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-769eedfe-6254-4f7d-a545-dd795e0d35c4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:50:16.447612 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-769eedfe-6254-4f7d-a545-dd795e0d35c4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:50:16.448307 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-769eedfe-6254-4f7d-a545-dd795e0d35c4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:50:16.448766 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-769eedfe-6254-4f7d-a545-dd795e0d35c4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:50:16.449201 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-769eedfe-6254-4f7d-a545-dd795e0d35c4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:50:16.581305 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-769eedfe-6254-4f7d-a545-dd795e0d35c4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:50:16.589230 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-769eedfe-6254-4f7d-a545-dd795e0d35c4 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952" status: 200 len: 1695 microversion: 2.1 time: 0.154562 Oct 26 13:50:16.589822 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3395/6814] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:50:16 2022] GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952 => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:50:17.612216 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d0ccf828-7806-4469-a004-21343e3bd8df tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:50:17.612835 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d0ccf828-7806-4469-a004-21343e3bd8df tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: d809a6d9-ee29-40bb-a935-2ad14b121952] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:50:17.620985 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0ccf828-7806-4469-a004-21343e3bd8df tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:50:17.621499 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0ccf828-7806-4469-a004-21343e3bd8df tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:50:17.621952 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0ccf828-7806-4469-a004-21343e3bd8df tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:50:17.622655 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0ccf828-7806-4469-a004-21343e3bd8df tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:50:17.623121 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0ccf828-7806-4469-a004-21343e3bd8df tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:50:17.623585 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0ccf828-7806-4469-a004-21343e3bd8df tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:50:17.755518 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d0ccf828-7806-4469-a004-21343e3bd8df tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:50:17.763984 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d0ccf828-7806-4469-a004-21343e3bd8df tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952" status: 200 len: 1680 microversion: 2.1 time: 0.155724 Oct 26 13:50:17.764551 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3420/6815] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:50:17 2022] GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:50:19.081803 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-4815831d-3446-4725-84e9-69f0f0e3b8f0 req-0c78491e-c6f6-4c70-9c8f-b5d810bb5d44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d809a6d9-ee29-40bb-a935-2ad14b121952", "name": "network-vif-unplugged", "status": "completed", "tag": "1c1e9dda-6b21-4f88-bdf3-f055403450a2"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:50:19.096141 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-4815831d-3446-4725-84e9-69f0f0e3b8f0 req-0c78491e-c6f6-4c70-9c8f-b5d810bb5d44 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:50:19.096632 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-4815831d-3446-4725-84e9-69f0f0e3b8f0 req-0c78491e-c6f6-4c70-9c8f-b5d810bb5d44 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:50:19.097075 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-4815831d-3446-4725-84e9-69f0f0e3b8f0 req-0c78491e-c6f6-4c70-9c8f-b5d810bb5d44 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:50:19.108592 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-4815831d-3446-4725-84e9-69f0f0e3b8f0 req-0c78491e-c6f6-4c70-9c8f-b5d810bb5d44 service nova] Creating event network-vif-unplugged:1c1e9dda-6b21-4f88-bdf3-f055403450a2 for instance d809a6d9-ee29-40bb-a935-2ad14b121952 on n-h1-862686-1 Oct 26 13:50:19.113792 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-4815831d-3446-4725-84e9-69f0f0e3b8f0 req-0c78491e-c6f6-4c70-9c8f-b5d810bb5d44 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108719 Oct 26 13:50:19.114438 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3396/6816] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:50:21.132226 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-537ac525-ea76-4970-be46-c69ae1057e6a req-a946206e-358e-4d99-bf17-2a74a627fc87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d809a6d9-ee29-40bb-a935-2ad14b121952", "name": "network-vif-plugged", "status": "completed", "tag": "1c1e9dda-6b21-4f88-bdf3-f055403450a2"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:50:21.143060 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-537ac525-ea76-4970-be46-c69ae1057e6a req-a946206e-358e-4d99-bf17-2a74a627fc87 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:50:21.143558 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-537ac525-ea76-4970-be46-c69ae1057e6a req-a946206e-358e-4d99-bf17-2a74a627fc87 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:50:21.144009 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-537ac525-ea76-4970-be46-c69ae1057e6a req-a946206e-358e-4d99-bf17-2a74a627fc87 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:50:21.155366 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-537ac525-ea76-4970-be46-c69ae1057e6a req-a946206e-358e-4d99-bf17-2a74a627fc87 service nova] Creating event network-vif-plugged:1c1e9dda-6b21-4f88-bdf3-f055403450a2 for instance d809a6d9-ee29-40bb-a935-2ad14b121952 on n-h1-862686-1 Oct 26 13:50:21.160744 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-537ac525-ea76-4970-be46-c69ae1057e6a req-a946206e-358e-4d99-bf17-2a74a627fc87 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032252 Oct 26 13:50:21.162022 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3421/6817] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:50:43.970240 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=20 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:50:43.970983 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:50:43.975876 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0ed0b0a0-9738-4884-9cd7-433832dce296 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:50:43.979011 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0ed0b0a0-9738-4884-9cd7-433832dce296 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: d809a6d9-ee29-40bb-a935-2ad14b121952] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:50:43.987235 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ed0b0a0-9738-4884-9cd7-433832dce296 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:50:43.987813 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ed0b0a0-9738-4884-9cd7-433832dce296 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:50:43.988251 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ed0b0a0-9738-4884-9cd7-433832dce296 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:50:43.988938 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ed0b0a0-9738-4884-9cd7-433832dce296 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:50:43.989602 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ed0b0a0-9738-4884-9cd7-433832dce296 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:50:43.990035 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ed0b0a0-9738-4884-9cd7-433832dce296 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:50:44.041848 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0ed0b0a0-9738-4884-9cd7-433832dce296 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "POST /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952/action" status: 200 len: 24568 microversion: 2.1 time: 0.073971 Oct 26 13:50:44.042474 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3397/6818] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:50:43 2022] POST /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952/action => generated 24568 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 13:50:55.833370 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-75d5beec-d850-43b8-bbb5-21ed1447975b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:50:55.837442 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:50:55.838131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-75d5beec-d850-43b8-bbb5-21ed1447975b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: d809a6d9-ee29-40bb-a935-2ad14b121952] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:50:55.838639 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=4 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:50:55.843053 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-d84e1039-0a08-4ce3-bbc1-3895155c3636 req-e6207f5f-f386-4e6d-b6e9-3d2c80c74b29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d809a6d9-ee29-40bb-a935-2ad14b121952", "tag": "1c1e9dda-6b21-4f88-bdf3-f055403450a2"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:50:55.843457 n-d-862686-1 devstack@n-api.service[120598]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 26 13:50:55.844172 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=16 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:50:55.845034 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=44 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:50:55.852675 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-75d5beec-d850-43b8-bbb5-21ed1447975b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:50:55.853218 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-75d5beec-d850-43b8-bbb5-21ed1447975b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:50:55.853706 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-75d5beec-d850-43b8-bbb5-21ed1447975b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:50:55.854904 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-75d5beec-d850-43b8-bbb5-21ed1447975b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:50:55.855065 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-75d5beec-d850-43b8-bbb5-21ed1447975b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:50:55.855508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-75d5beec-d850-43b8-bbb5-21ed1447975b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:50:55.862550 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d84e1039-0a08-4ce3-bbc1-3895155c3636 req-e6207f5f-f386-4e6d-b6e9-3d2c80c74b29 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:50:55.863307 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d84e1039-0a08-4ce3-bbc1-3895155c3636 req-e6207f5f-f386-4e6d-b6e9-3d2c80c74b29 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:50:55.863976 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d84e1039-0a08-4ce3-bbc1-3895155c3636 req-e6207f5f-f386-4e6d-b6e9-3d2c80c74b29 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:50:55.882107 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-d84e1039-0a08-4ce3-bbc1-3895155c3636 req-e6207f5f-f386-4e6d-b6e9-3d2c80c74b29 service nova] Creating event network-changed:1c1e9dda-6b21-4f88-bdf3-f055403450a2 for instance d809a6d9-ee29-40bb-a935-2ad14b121952 on n-h1-862686-1 Oct 26 13:50:55.888328 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-75d5beec-d850-43b8-bbb5-21ed1447975b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: d809a6d9-ee29-40bb-a935-2ad14b121952] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:50:55.888667 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-d84e1039-0a08-4ce3-bbc1-3895155c3636 req-e6207f5f-f386-4e6d-b6e9-3d2c80c74b29 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053145 Oct 26 13:50:55.889622 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3398/6819] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:50:55.979096 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-75d5beec-d850-43b8-bbb5-21ed1447975b tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952" status: 204 len: 0 microversion: 2.1 time: 0.149891 Oct 26 13:50:55.980082 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3422/6820] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:50:55 2022] DELETE /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:50:55.989712 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4f28bef6-ca04-4599-80d2-7f7f188f781f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:50:55.990427 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4f28bef6-ca04-4599-80d2-7f7f188f781f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: d809a6d9-ee29-40bb-a935-2ad14b121952] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:50:55.997130 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f28bef6-ca04-4599-80d2-7f7f188f781f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:50:55.997659 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f28bef6-ca04-4599-80d2-7f7f188f781f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:50:55.998100 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f28bef6-ca04-4599-80d2-7f7f188f781f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:50:55.998807 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f28bef6-ca04-4599-80d2-7f7f188f781f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:50:55.999264 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f28bef6-ca04-4599-80d2-7f7f188f781f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:50:55.999691 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f28bef6-ca04-4599-80d2-7f7f188f781f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:50:56.144478 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4f28bef6-ca04-4599-80d2-7f7f188f781f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:50:56.152518 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4f28bef6-ca04-4599-80d2-7f7f188f781f tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952" status: 200 len: 1686 microversion: 2.1 time: 0.167670 Oct 26 13:50:56.153087 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3399/6821] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:50:55 2022] GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952 => generated 1686 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:50:57.177254 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e184b09f-d683-4f01-a10b-9a7d4fc9c616 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:50:57.178003 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e184b09f-d683-4f01-a10b-9a7d4fc9c616 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: d809a6d9-ee29-40bb-a935-2ad14b121952] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:50:57.185372 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e184b09f-d683-4f01-a10b-9a7d4fc9c616 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:50:57.185927 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e184b09f-d683-4f01-a10b-9a7d4fc9c616 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:50:57.186406 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e184b09f-d683-4f01-a10b-9a7d4fc9c616 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:50:57.187129 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e184b09f-d683-4f01-a10b-9a7d4fc9c616 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:50:57.187599 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e184b09f-d683-4f01-a10b-9a7d4fc9c616 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:50:57.188074 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e184b09f-d683-4f01-a10b-9a7d4fc9c616 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:50:57.327541 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e184b09f-d683-4f01-a10b-9a7d4fc9c616 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:50:57.335315 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e184b09f-d683-4f01-a10b-9a7d4fc9c616 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952" status: 200 len: 1686 microversion: 2.1 time: 0.162477 Oct 26 13:50:57.337133 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3423/6822] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:50:57 2022] GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952 => generated 1686 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:50:58.136389 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-17a9304b-54ac-482c-a8e7-13f5b5792795 req-4d6ad521-204e-4208-8f68-98ceec4a3d8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d809a6d9-ee29-40bb-a935-2ad14b121952", "name": "network-vif-deleted", "tag": "1c1e9dda-6b21-4f88-bdf3-f055403450a2"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:50:58.147674 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-17a9304b-54ac-482c-a8e7-13f5b5792795 req-4d6ad521-204e-4208-8f68-98ceec4a3d8f service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:50:58.148192 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-17a9304b-54ac-482c-a8e7-13f5b5792795 req-4d6ad521-204e-4208-8f68-98ceec4a3d8f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:50:58.148632 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-17a9304b-54ac-482c-a8e7-13f5b5792795 req-4d6ad521-204e-4208-8f68-98ceec4a3d8f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:50:58.159782 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-17a9304b-54ac-482c-a8e7-13f5b5792795 req-4d6ad521-204e-4208-8f68-98ceec4a3d8f service nova] Creating event network-vif-deleted:1c1e9dda-6b21-4f88-bdf3-f055403450a2 for instance d809a6d9-ee29-40bb-a935-2ad14b121952 on n-h1-862686-1 Oct 26 13:50:58.166007 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-17a9304b-54ac-482c-a8e7-13f5b5792795 req-4d6ad521-204e-4208-8f68-98ceec4a3d8f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159915 Oct 26 13:50:58.166606 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3400/6823] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:50:58.360404 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-aa6ee089-4a93-46ca-8d86-060b07d08e71 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:50:58.361032 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-aa6ee089-4a93-46ca-8d86-060b07d08e71 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: d809a6d9-ee29-40bb-a935-2ad14b121952] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:50:58.368545 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa6ee089-4a93-46ca-8d86-060b07d08e71 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:50:58.369057 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa6ee089-4a93-46ca-8d86-060b07d08e71 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:50:58.369548 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa6ee089-4a93-46ca-8d86-060b07d08e71 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:50:58.370282 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa6ee089-4a93-46ca-8d86-060b07d08e71 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:50:58.370754 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa6ee089-4a93-46ca-8d86-060b07d08e71 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:50:58.371197 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa6ee089-4a93-46ca-8d86-060b07d08e71 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:50:58.404511 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa6ee089-4a93-46ca-8d86-060b07d08e71 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:50:58.404679 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa6ee089-4a93-46ca-8d86-060b07d08e71 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:50:58.405138 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa6ee089-4a93-46ca-8d86-060b07d08e71 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:50:58.405659 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-aa6ee089-4a93-46ca-8d86-060b07d08e71 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lazy-loading 'fault' on Instance uuid d809a6d9-ee29-40bb-a935-2ad14b121952 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:50:58.447132 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-aa6ee089-4a93-46ca-8d86-060b07d08e71 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67f61dd56b74107b828dcd7f2fc31f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc60a45db1c488ab4417c3b2c8d1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:50:58.454756 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-aa6ee089-4a93-46ca-8d86-060b07d08e71 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952" status: 200 len: 1354 microversion: 2.1 time: 0.098352 Oct 26 13:50:58.455330 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3424/6824] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:50:58 2022] GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952 => generated 1354 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:50:59.479698 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-05bd2154-bcea-4e92-8871-9a472e080a46 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:50:59.480394 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-05bd2154-bcea-4e92-8871-9a472e080a46 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] [instance: d809a6d9-ee29-40bb-a935-2ad14b121952] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:50:59.487366 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05bd2154-bcea-4e92-8871-9a472e080a46 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:50:59.487850 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05bd2154-bcea-4e92-8871-9a472e080a46 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:50:59.488287 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05bd2154-bcea-4e92-8871-9a472e080a46 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:50:59.488975 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05bd2154-bcea-4e92-8871-9a472e080a46 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:50:59.489428 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05bd2154-bcea-4e92-8871-9a472e080a46 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:50:59.489876 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05bd2154-bcea-4e92-8871-9a472e080a46 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:50:59.503524 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-05bd2154-bcea-4e92-8871-9a472e080a46 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] HTTP exception thrown: Instance d809a6d9-ee29-40bb-a935-2ad14b121952 could not be found. Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-05bd2154-bcea-4e92-8871-9a472e080a46 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Request method failure captured: Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952 HTTP/1.1 Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTl7vHGITUnSIjOoYHssXC10IwUcwveqrJ7Ebb5cmEfkFD9JMguSExqSXPNP7Ag-JuWcpR1m7T1_23uQXjoVepH6MjM-90GyPgiU7IyFq1opWMTLN8Bh1kpzqNFJZ8A9zq3q3AuJcUUCnd4kdwPdeBkozWabTG-a7qC9_ycsvQK-bH8 Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: bbc60a45db1c488ab4417c3b2c8d1983 Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1564668813 Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bbc60a45db1c488ab4417c3b2c8d1983"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bbc60a45db1c488ab4417c3b2c8d1983"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bbc60a45db1c488ab4417c3b2c8d1983"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bbc60a45db1c488ab4417c3b2c8d1983"}]}] Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1564668813 Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: bbc60a45db1c488ab4417c3b2c8d1983 Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1564668813 Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-TestNetworkAdvancedServerOps-1564668813-project Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: c67f61dd56b74107b828dcd7f2fc31f1 Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1564668813-project Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance d809a6d9-ee29-40bb-a935-2ad14b121952 could not be found. Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'd809a6d9-ee29-40bb-a935-2ad14b121952'} Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d809a6d9-ee29-40bb-a935-2ad14b121952 could not be found. Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d809a6d9-ee29-40bb-a935-2ad14b121952 could not be found. Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:50:59.505130 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:50:59.509678 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:50:59.509678 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:50:59.509678 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:50:59.509678 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:50:59.509678 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:50:59.509678 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:50:59.509678 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d809a6d9-ee29-40bb-a935-2ad14b121952 could not be found. Oct 26 13:50:59.509678 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:50:59.509678 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-05bd2154-bcea-4e92-8871-9a472e080a46 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Returning 404 to user: Instance d809a6d9-ee29-40bb-a935-2ad14b121952 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:50:59.509678 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-05bd2154-bcea-4e92-8871-9a472e080a46 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952" status: 404 len: 111 microversion: 2.1 time: 0.031659 Oct 26 13:50:59.509678 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3401/6825] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:50:59 2022] GET /compute/v2.1/servers/d809a6d9-ee29-40bb-a935-2ad14b121952 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:51:02.868638 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-53721863-98b3-490d-8d48-138c17bf59e9 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] Calling method '.version_select at 0x7f6731193940>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:02.897100 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-53721863-98b3-490d-8d48-138c17bf59e9 tempest-TestNetworkAdvancedServerOps-1564668813 tempest-TestNetworkAdvancedServerOps-1564668813-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-253517291" status: 202 len: 0 microversion: 2.1 time: 0.032825 Oct 26 13:51:02.897903 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3425/6826] 10.222.0.40 () {58 vars in 1281 bytes} [Wed Oct 26 13:51:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-253517291 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:51:06.915319 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-80a5dca1-7752-4450-95b5-8d96af2053b0 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-578260980", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "084d64c1-b4c7-4b4f-b18a-73a6afacbe08"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:51:06.968130 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-80a5dca1-7752-4450-95b5-8d96af2053b0 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] validate_networks() for [('084d64c1-b4c7-4b4f-b18a-73a6afacbe08', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:51:07.324200 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-80a5dca1-7752-4450-95b5-8d96af2053b0 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:51:07.324624 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-80a5dca1-7752-4450-95b5-8d96af2053b0 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:51:07.325124 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-80a5dca1-7752-4450-95b5-8d96af2053b0 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:51:07.325570 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-80a5dca1-7752-4450-95b5-8d96af2053b0 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:51:07.325988 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-80a5dca1-7752-4450-95b5-8d96af2053b0 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:51:07.334816 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-80a5dca1-7752-4450-95b5-8d96af2053b0 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:07.335927 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-80a5dca1-7752-4450-95b5-8d96af2053b0 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:07.336352 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-80a5dca1-7752-4450-95b5-8d96af2053b0 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:07.337088 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-80a5dca1-7752-4450-95b5-8d96af2053b0 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:07.337580 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-80a5dca1-7752-4450-95b5-8d96af2053b0 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:07.338015 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-80a5dca1-7752-4450-95b5-8d96af2053b0 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:07.355382 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-80a5dca1-7752-4450-95b5-8d96af2053b0 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Getting quotas for project 90d9df031f794bb1a6b0d087985bbfdc. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:51:07.360546 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-80a5dca1-7752-4450-95b5-8d96af2053b0 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Getting quotas for user 7efc67113a174239b834a3e0b6c5e4f2 and project 90d9df031f794bb1a6b0d087985bbfdc. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:51:07.373240 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-80a5dca1-7752-4450-95b5-8d96af2053b0 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:51:07.375575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-80a5dca1-7752-4450-95b5-8d96af2053b0 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] [instance: fb930031-9954-4c51-97c3-53bafc7f5254] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:51:07.421760 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-80a5dca1-7752-4450-95b5-8d96af2053b0 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.623939 Oct 26 13:51:07.422990 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3402/6827] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:51:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:51:07.435769 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-68b836ae-0cfd-40f5-9cb1-e1debd2d00d7 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:07.436398 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-68b836ae-0cfd-40f5-9cb1-e1debd2d00d7 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] [instance: fb930031-9954-4c51-97c3-53bafc7f5254] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:07.494763 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-68b836ae-0cfd-40f5-9cb1-e1debd2d00d7 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efc67113a174239b834a3e0b6c5e4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9df031f794bb1a6b0d087985bbfdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:51:07.501778 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-68b836ae-0cfd-40f5-9cb1-e1debd2d00d7 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] 10.222.0.40 "GET /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254" status: 200 len: 1214 microversion: 2.1 time: 0.071167 Oct 26 13:51:07.502354 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3426/6828] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:51:07 2022] GET /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:51:08.525769 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4741f7fc-2ee0-434f-be01-0336ebe946aa tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:08.526381 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4741f7fc-2ee0-434f-be01-0336ebe946aa tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] [instance: fb930031-9954-4c51-97c3-53bafc7f5254] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:08.533132 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4741f7fc-2ee0-434f-be01-0336ebe946aa tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:08.533662 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4741f7fc-2ee0-434f-be01-0336ebe946aa tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:08.534098 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4741f7fc-2ee0-434f-be01-0336ebe946aa tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:08.534787 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4741f7fc-2ee0-434f-be01-0336ebe946aa tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:08.535241 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4741f7fc-2ee0-434f-be01-0336ebe946aa tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:08.535666 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4741f7fc-2ee0-434f-be01-0336ebe946aa tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:08.597580 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4741f7fc-2ee0-434f-be01-0336ebe946aa tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efc67113a174239b834a3e0b6c5e4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9df031f794bb1a6b0d087985bbfdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:51:08.605717 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4741f7fc-2ee0-434f-be01-0336ebe946aa tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] 10.222.0.40 "GET /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254" status: 200 len: 1274 microversion: 2.1 time: 0.085423 Oct 26 13:51:08.606274 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3403/6829] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:51:08 2022] GET /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254 => generated 1274 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:51:09.630107 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3de4b831-94c7-48e2-99dd-a5750d00f6db tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:09.630644 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3de4b831-94c7-48e2-99dd-a5750d00f6db tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] [instance: fb930031-9954-4c51-97c3-53bafc7f5254] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:09.634167 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:51:09.640271 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3de4b831-94c7-48e2-99dd-a5750d00f6db tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:09.640793 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3de4b831-94c7-48e2-99dd-a5750d00f6db tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:09.641252 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3de4b831-94c7-48e2-99dd-a5750d00f6db tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:09.642073 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3de4b831-94c7-48e2-99dd-a5750d00f6db tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:09.642541 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3de4b831-94c7-48e2-99dd-a5750d00f6db tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:09.643077 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3de4b831-94c7-48e2-99dd-a5750d00f6db tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:09.856562 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3de4b831-94c7-48e2-99dd-a5750d00f6db tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efc67113a174239b834a3e0b6c5e4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9df031f794bb1a6b0d087985bbfdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:51:09.866360 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3de4b831-94c7-48e2-99dd-a5750d00f6db tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] 10.222.0.40 "GET /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254" status: 200 len: 1314 microversion: 2.1 time: 0.240513 Oct 26 13:51:09.867003 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3427/6830] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:51:09 2022] GET /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:51:10.158537 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-c78ee59a-0c68-4c0d-a5f1-ed86a542c9aa req-ac9aa2c7-6345-42bf-b1f1-08638d6837ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb930031-9954-4c51-97c3-53bafc7f5254", "tag": "f8c11160-ea81-43f3-b9c4-e211f5563853"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:51:10.171009 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-c78ee59a-0c68-4c0d-a5f1-ed86a542c9aa req-ac9aa2c7-6345-42bf-b1f1-08638d6837ca service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:10.171489 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-c78ee59a-0c68-4c0d-a5f1-ed86a542c9aa req-ac9aa2c7-6345-42bf-b1f1-08638d6837ca service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:10.171953 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-c78ee59a-0c68-4c0d-a5f1-ed86a542c9aa req-ac9aa2c7-6345-42bf-b1f1-08638d6837ca service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:10.184212 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-c78ee59a-0c68-4c0d-a5f1-ed86a542c9aa req-ac9aa2c7-6345-42bf-b1f1-08638d6837ca service nova] Creating event network-changed:f8c11160-ea81-43f3-b9c4-e211f5563853 for instance fb930031-9954-4c51-97c3-53bafc7f5254 on n-h1-862686-1 Oct 26 13:51:10.190349 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-c78ee59a-0c68-4c0d-a5f1-ed86a542c9aa req-ac9aa2c7-6345-42bf-b1f1-08638d6837ca service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036893 Oct 26 13:51:10.191267 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3404/6831] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:51:10.889986 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9836bfed-b89f-43d0-9c28-314441312418 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:10.890644 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9836bfed-b89f-43d0-9c28-314441312418 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] [instance: fb930031-9954-4c51-97c3-53bafc7f5254] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:10.898905 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9836bfed-b89f-43d0-9c28-314441312418 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:10.899399 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9836bfed-b89f-43d0-9c28-314441312418 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:10.899878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9836bfed-b89f-43d0-9c28-314441312418 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:10.900725 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9836bfed-b89f-43d0-9c28-314441312418 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:10.901201 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9836bfed-b89f-43d0-9c28-314441312418 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:10.901670 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9836bfed-b89f-43d0-9c28-314441312418 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:11.054096 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9836bfed-b89f-43d0-9c28-314441312418 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efc67113a174239b834a3e0b6c5e4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9df031f794bb1a6b0d087985bbfdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:51:11.062741 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9836bfed-b89f-43d0-9c28-314441312418 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] 10.222.0.40 "GET /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254" status: 200 len: 1314 microversion: 2.1 time: 0.176806 Oct 26 13:51:11.063468 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3428/6832] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:51:10 2022] GET /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:51:12.091822 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8bbea3e9-7081-4c74-8615-4fb482aebb18 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:12.092435 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8bbea3e9-7081-4c74-8615-4fb482aebb18 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] [instance: fb930031-9954-4c51-97c3-53bafc7f5254] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:12.100112 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8bbea3e9-7081-4c74-8615-4fb482aebb18 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:12.101796 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8bbea3e9-7081-4c74-8615-4fb482aebb18 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:12.101947 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8bbea3e9-7081-4c74-8615-4fb482aebb18 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:12.102613 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8bbea3e9-7081-4c74-8615-4fb482aebb18 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:12.103248 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8bbea3e9-7081-4c74-8615-4fb482aebb18 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:12.103684 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8bbea3e9-7081-4c74-8615-4fb482aebb18 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:12.276095 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8bbea3e9-7081-4c74-8615-4fb482aebb18 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efc67113a174239b834a3e0b6c5e4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9df031f794bb1a6b0d087985bbfdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:51:12.285391 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8bbea3e9-7081-4c74-8615-4fb482aebb18 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] 10.222.0.40 "GET /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254" status: 200 len: 1314 microversion: 2.1 time: 0.200734 Oct 26 13:51:12.286269 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3405/6833] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:51:12 2022] GET /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:51:13.311419 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-05597492-ef78-40a5-ad18-377496ce7140 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:13.312055 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-05597492-ef78-40a5-ad18-377496ce7140 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] [instance: fb930031-9954-4c51-97c3-53bafc7f5254] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:13.318758 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05597492-ef78-40a5-ad18-377496ce7140 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:13.320115 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05597492-ef78-40a5-ad18-377496ce7140 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:13.320653 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05597492-ef78-40a5-ad18-377496ce7140 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:13.321373 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05597492-ef78-40a5-ad18-377496ce7140 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:13.321878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05597492-ef78-40a5-ad18-377496ce7140 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:13.322325 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-05597492-ef78-40a5-ad18-377496ce7140 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:13.457661 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-05597492-ef78-40a5-ad18-377496ce7140 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efc67113a174239b834a3e0b6c5e4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9df031f794bb1a6b0d087985bbfdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:51:13.473015 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-05597492-ef78-40a5-ad18-377496ce7140 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] 10.222.0.40 "GET /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254" status: 200 len: 1314 microversion: 2.1 time: 0.165383 Oct 26 13:51:13.473660 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3429/6834] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:51:13 2022] GET /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:51:14.497205 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-20490c4c-e532-43f9-b6a3-6760c12aa4c4 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:14.497846 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-20490c4c-e532-43f9-b6a3-6760c12aa4c4 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] [instance: fb930031-9954-4c51-97c3-53bafc7f5254] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:14.504557 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20490c4c-e532-43f9-b6a3-6760c12aa4c4 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:14.505041 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20490c4c-e532-43f9-b6a3-6760c12aa4c4 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:14.505497 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20490c4c-e532-43f9-b6a3-6760c12aa4c4 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:14.506181 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20490c4c-e532-43f9-b6a3-6760c12aa4c4 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:14.506680 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20490c4c-e532-43f9-b6a3-6760c12aa4c4 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:14.507365 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20490c4c-e532-43f9-b6a3-6760c12aa4c4 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:14.641279 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-20490c4c-e532-43f9-b6a3-6760c12aa4c4 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efc67113a174239b834a3e0b6c5e4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9df031f794bb1a6b0d087985bbfdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:51:14.649654 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-20490c4c-e532-43f9-b6a3-6760c12aa4c4 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] 10.222.0.40 "GET /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254" status: 200 len: 1314 microversion: 2.1 time: 0.156625 Oct 26 13:51:14.650219 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3406/6835] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:51:14 2022] GET /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:51:15.134424 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-0be4a62d-7b01-40f7-97c4-f8529267a545 req-3a140d7a-b0d8-466e-9f7b-0b2a61841f96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb930031-9954-4c51-97c3-53bafc7f5254", "name": "network-vif-plugged", "status": "completed", "tag": "f8c11160-ea81-43f3-b9c4-e211f5563853"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:51:15.146433 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-0be4a62d-7b01-40f7-97c4-f8529267a545 req-3a140d7a-b0d8-466e-9f7b-0b2a61841f96 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:15.146924 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-0be4a62d-7b01-40f7-97c4-f8529267a545 req-3a140d7a-b0d8-466e-9f7b-0b2a61841f96 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:15.147857 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-0be4a62d-7b01-40f7-97c4-f8529267a545 req-3a140d7a-b0d8-466e-9f7b-0b2a61841f96 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:15.159383 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-0be4a62d-7b01-40f7-97c4-f8529267a545 req-3a140d7a-b0d8-466e-9f7b-0b2a61841f96 service nova] Creating event network-vif-plugged:f8c11160-ea81-43f3-b9c4-e211f5563853 for instance fb930031-9954-4c51-97c3-53bafc7f5254 on n-h1-862686-1 Oct 26 13:51:15.165284 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-0be4a62d-7b01-40f7-97c4-f8529267a545 req-3a140d7a-b0d8-466e-9f7b-0b2a61841f96 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034756 Oct 26 13:51:15.165909 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3430/6836] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:51:15.673562 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-abc7dcf9-4e30-4d08-a4bc-02c202c84b88 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:15.674250 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-abc7dcf9-4e30-4d08-a4bc-02c202c84b88 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] [instance: fb930031-9954-4c51-97c3-53bafc7f5254] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:15.682923 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-abc7dcf9-4e30-4d08-a4bc-02c202c84b88 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:15.683424 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-abc7dcf9-4e30-4d08-a4bc-02c202c84b88 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:15.683874 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-abc7dcf9-4e30-4d08-a4bc-02c202c84b88 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:15.684664 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-abc7dcf9-4e30-4d08-a4bc-02c202c84b88 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:15.685133 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-abc7dcf9-4e30-4d08-a4bc-02c202c84b88 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:15.685698 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-abc7dcf9-4e30-4d08-a4bc-02c202c84b88 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:15.903759 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-abc7dcf9-4e30-4d08-a4bc-02c202c84b88 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efc67113a174239b834a3e0b6c5e4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9df031f794bb1a6b0d087985bbfdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:51:15.911925 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-abc7dcf9-4e30-4d08-a4bc-02c202c84b88 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] 10.222.0.40 "GET /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254" status: 200 len: 1314 microversion: 2.1 time: 0.243183 Oct 26 13:51:15.912517 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3407/6837] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:51:15 2022] GET /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:51:16.936012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ac22a945-98a3-462c-8bd3-35a8acc50318 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:16.936756 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ac22a945-98a3-462c-8bd3-35a8acc50318 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] [instance: fb930031-9954-4c51-97c3-53bafc7f5254] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:16.943718 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac22a945-98a3-462c-8bd3-35a8acc50318 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:16.944261 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac22a945-98a3-462c-8bd3-35a8acc50318 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:16.944708 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac22a945-98a3-462c-8bd3-35a8acc50318 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:16.945407 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac22a945-98a3-462c-8bd3-35a8acc50318 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:16.945900 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac22a945-98a3-462c-8bd3-35a8acc50318 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:16.946338 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac22a945-98a3-462c-8bd3-35a8acc50318 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:17.078252 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ac22a945-98a3-462c-8bd3-35a8acc50318 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efc67113a174239b834a3e0b6c5e4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9df031f794bb1a6b0d087985bbfdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:51:17.086667 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ac22a945-98a3-462c-8bd3-35a8acc50318 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] 10.222.0.40 "GET /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254" status: 200 len: 1501 microversion: 2.1 time: 0.154923 Oct 26 13:51:17.087251 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3431/6838] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:51:16 2022] GET /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254 => generated 1501 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:51:17.109870 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-457903b9-b253-4b5d-bb82-eb2532b03dd0 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:17.110570 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-457903b9-b253-4b5d-bb82-eb2532b03dd0 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] [instance: fb930031-9954-4c51-97c3-53bafc7f5254] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:17.117184 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-457903b9-b253-4b5d-bb82-eb2532b03dd0 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:17.117709 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-457903b9-b253-4b5d-bb82-eb2532b03dd0 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:17.118163 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-457903b9-b253-4b5d-bb82-eb2532b03dd0 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:17.118859 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-457903b9-b253-4b5d-bb82-eb2532b03dd0 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:17.119321 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-457903b9-b253-4b5d-bb82-eb2532b03dd0 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:17.119755 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-457903b9-b253-4b5d-bb82-eb2532b03dd0 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:17.250305 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-457903b9-b253-4b5d-bb82-eb2532b03dd0 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efc67113a174239b834a3e0b6c5e4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9df031f794bb1a6b0d087985bbfdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:51:17.258591 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-457903b9-b253-4b5d-bb82-eb2532b03dd0 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] 10.222.0.40 "GET /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254" status: 200 len: 1501 microversion: 2.1 time: 0.152882 Oct 26 13:51:17.259166 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3408/6839] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:51:17 2022] GET /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254 => generated 1501 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:51:17.281067 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-aac9c086-ec5d-47b5-a9e9-764891dcb459 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:51:17.281686 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-aac9c086-ec5d-47b5-a9e9-764891dcb459 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] [instance: fb930031-9954-4c51-97c3-53bafc7f5254] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:17.288605 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aac9c086-ec5d-47b5-a9e9-764891dcb459 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:17.289097 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aac9c086-ec5d-47b5-a9e9-764891dcb459 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:17.289582 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aac9c086-ec5d-47b5-a9e9-764891dcb459 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:17.290309 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aac9c086-ec5d-47b5-a9e9-764891dcb459 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:17.290783 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aac9c086-ec5d-47b5-a9e9-764891dcb459 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:17.291229 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aac9c086-ec5d-47b5-a9e9-764891dcb459 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:17.314086 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-aac9c086-ec5d-47b5-a9e9-764891dcb459 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lazy-loading 'flavor' on Instance uuid fb930031-9954-4c51-97c3-53bafc7f5254 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:51:17.379943 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-aac9c086-ec5d-47b5-a9e9-764891dcb459 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] 10.222.0.40 "POST /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254/action" status: 202 len: 0 microversion: 2.1 time: 0.102656 Oct 26 13:51:17.380681 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3432/6840] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:51:17 2022] POST /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:51:17.388993 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6f9496ad-63ff-4efc-8169-c222e4228873 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:17.389641 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6f9496ad-63ff-4efc-8169-c222e4228873 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] [instance: fb930031-9954-4c51-97c3-53bafc7f5254] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:17.391611 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:51:17.392290 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:51:17.399145 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f9496ad-63ff-4efc-8169-c222e4228873 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:17.399639 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f9496ad-63ff-4efc-8169-c222e4228873 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:17.400085 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f9496ad-63ff-4efc-8169-c222e4228873 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:17.400793 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f9496ad-63ff-4efc-8169-c222e4228873 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:17.401277 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f9496ad-63ff-4efc-8169-c222e4228873 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:17.401733 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f9496ad-63ff-4efc-8169-c222e4228873 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:17.530935 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6f9496ad-63ff-4efc-8169-c222e4228873 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efc67113a174239b834a3e0b6c5e4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9df031f794bb1a6b0d087985bbfdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:51:17.539433 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6f9496ad-63ff-4efc-8169-c222e4228873 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] 10.222.0.40 "GET /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254" status: 200 len: 1509 microversion: 2.1 time: 0.154361 Oct 26 13:51:17.540009 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3409/6841] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:51:17 2022] GET /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:51:18.559954 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:51:18.570742 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-74e8bcba-cc11-4e59-aa4d-be4ee7b1e3ad tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:18.571469 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-74e8bcba-cc11-4e59-aa4d-be4ee7b1e3ad tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] [instance: fb930031-9954-4c51-97c3-53bafc7f5254] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:18.578080 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74e8bcba-cc11-4e59-aa4d-be4ee7b1e3ad tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:18.578580 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74e8bcba-cc11-4e59-aa4d-be4ee7b1e3ad tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:18.579031 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74e8bcba-cc11-4e59-aa4d-be4ee7b1e3ad tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:18.579739 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74e8bcba-cc11-4e59-aa4d-be4ee7b1e3ad tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:18.580211 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74e8bcba-cc11-4e59-aa4d-be4ee7b1e3ad tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:18.580651 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74e8bcba-cc11-4e59-aa4d-be4ee7b1e3ad tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:18.714127 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-74e8bcba-cc11-4e59-aa4d-be4ee7b1e3ad tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efc67113a174239b834a3e0b6c5e4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9df031f794bb1a6b0d087985bbfdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:51:18.722229 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-74e8bcba-cc11-4e59-aa4d-be4ee7b1e3ad tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] 10.222.0.40 "GET /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254" status: 200 len: 1492 microversion: 2.1 time: 0.163298 Oct 26 13:51:18.722808 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3433/6842] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:51:18 2022] GET /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254 => generated 1492 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:51:18.745988 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1a71d1b4-d7c7-4201-8842-ad8091496692 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:51:18.746521 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1a71d1b4-d7c7-4201-8842-ad8091496692 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] [instance: fb930031-9954-4c51-97c3-53bafc7f5254] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:18.753358 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a71d1b4-d7c7-4201-8842-ad8091496692 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:18.753965 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a71d1b4-d7c7-4201-8842-ad8091496692 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:18.754405 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a71d1b4-d7c7-4201-8842-ad8091496692 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:18.755086 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a71d1b4-d7c7-4201-8842-ad8091496692 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:18.755561 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a71d1b4-d7c7-4201-8842-ad8091496692 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:18.755985 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a71d1b4-d7c7-4201-8842-ad8091496692 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:18.822166 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1a71d1b4-d7c7-4201-8842-ad8091496692 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] 10.222.0.40 "POST /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254/action" status: 202 len: 0 microversion: 2.1 time: 0.080854 Oct 26 13:51:18.822718 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3410/6843] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:51:18 2022] POST /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:51:18.830753 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3ccdc033-1fb2-459c-9586-b2528752505b tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:18.831395 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3ccdc033-1fb2-459c-9586-b2528752505b tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] [instance: fb930031-9954-4c51-97c3-53bafc7f5254] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:18.837507 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3ccdc033-1fb2-459c-9586-b2528752505b tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:18.838467 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3ccdc033-1fb2-459c-9586-b2528752505b tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:18.838467 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3ccdc033-1fb2-459c-9586-b2528752505b tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:18.839188 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3ccdc033-1fb2-459c-9586-b2528752505b tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:18.839663 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3ccdc033-1fb2-459c-9586-b2528752505b tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:18.840349 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3ccdc033-1fb2-459c-9586-b2528752505b tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:19.021980 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3ccdc033-1fb2-459c-9586-b2528752505b tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efc67113a174239b834a3e0b6c5e4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9df031f794bb1a6b0d087985bbfdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:51:19.030557 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3ccdc033-1fb2-459c-9586-b2528752505b tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] 10.222.0.40 "GET /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254" status: 200 len: 1498 microversion: 2.1 time: 0.203671 Oct 26 13:51:19.031148 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3434/6844] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:51:18 2022] GET /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254 => generated 1498 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:51:20.056716 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-26aa24a3-c5a6-4a8b-b6e4-38fd35c98936 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:20.057459 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-26aa24a3-c5a6-4a8b-b6e4-38fd35c98936 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] [instance: fb930031-9954-4c51-97c3-53bafc7f5254] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:20.063739 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26aa24a3-c5a6-4a8b-b6e4-38fd35c98936 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:20.064212 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26aa24a3-c5a6-4a8b-b6e4-38fd35c98936 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:20.064652 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26aa24a3-c5a6-4a8b-b6e4-38fd35c98936 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:20.065343 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26aa24a3-c5a6-4a8b-b6e4-38fd35c98936 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:20.065824 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26aa24a3-c5a6-4a8b-b6e4-38fd35c98936 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:20.066254 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26aa24a3-c5a6-4a8b-b6e4-38fd35c98936 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:20.201263 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-26aa24a3-c5a6-4a8b-b6e4-38fd35c98936 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efc67113a174239b834a3e0b6c5e4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9df031f794bb1a6b0d087985bbfdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:51:20.208969 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-26aa24a3-c5a6-4a8b-b6e4-38fd35c98936 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] 10.222.0.40 "GET /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254" status: 200 len: 1501 microversion: 2.1 time: 0.158080 Oct 26 13:51:20.210241 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3411/6845] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:51:20 2022] GET /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254 => generated 1501 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:51:20.233027 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-922255e7-ea14-45ea-bb22-1d0205f09f18 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:51:20.233603 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-922255e7-ea14-45ea-bb22-1d0205f09f18 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] [instance: fb930031-9954-4c51-97c3-53bafc7f5254] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:20.240488 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-922255e7-ea14-45ea-bb22-1d0205f09f18 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:20.241241 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-922255e7-ea14-45ea-bb22-1d0205f09f18 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:20.241555 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-922255e7-ea14-45ea-bb22-1d0205f09f18 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:20.242274 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-922255e7-ea14-45ea-bb22-1d0205f09f18 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:20.242748 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-922255e7-ea14-45ea-bb22-1d0205f09f18 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:20.243319 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-922255e7-ea14-45ea-bb22-1d0205f09f18 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:20.266328 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-922255e7-ea14-45ea-bb22-1d0205f09f18 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lazy-loading 'flavor' on Instance uuid fb930031-9954-4c51-97c3-53bafc7f5254 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:51:20.329636 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-922255e7-ea14-45ea-bb22-1d0205f09f18 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] 10.222.0.40 "POST /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254/action" status: 202 len: 0 microversion: 2.1 time: 0.100447 Oct 26 13:51:20.330344 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3435/6846] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:51:20 2022] POST /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:51:20.340029 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2be68a77-53b3-4298-bf8e-5ac0b5eaa3ab tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:20.340649 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2be68a77-53b3-4298-bf8e-5ac0b5eaa3ab tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] [instance: fb930031-9954-4c51-97c3-53bafc7f5254] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:20.346695 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2be68a77-53b3-4298-bf8e-5ac0b5eaa3ab tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:20.347227 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2be68a77-53b3-4298-bf8e-5ac0b5eaa3ab tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:20.347645 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2be68a77-53b3-4298-bf8e-5ac0b5eaa3ab tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:20.348334 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2be68a77-53b3-4298-bf8e-5ac0b5eaa3ab tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:20.348902 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2be68a77-53b3-4298-bf8e-5ac0b5eaa3ab tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:20.349842 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2be68a77-53b3-4298-bf8e-5ac0b5eaa3ab tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:20.480881 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2be68a77-53b3-4298-bf8e-5ac0b5eaa3ab tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efc67113a174239b834a3e0b6c5e4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9df031f794bb1a6b0d087985bbfdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:51:20.488570 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2be68a77-53b3-4298-bf8e-5ac0b5eaa3ab tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] 10.222.0.40 "GET /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254" status: 200 len: 1509 microversion: 2.1 time: 0.152763 Oct 26 13:51:20.489139 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3412/6847] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:51:20 2022] GET /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:51:21.512666 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d6ed3a27-ec3f-4375-bce6-3a5883e64a3e tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:21.513382 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d6ed3a27-ec3f-4375-bce6-3a5883e64a3e tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] [instance: fb930031-9954-4c51-97c3-53bafc7f5254] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:21.519655 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6ed3a27-ec3f-4375-bce6-3a5883e64a3e tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:21.520157 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6ed3a27-ec3f-4375-bce6-3a5883e64a3e tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:21.520613 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6ed3a27-ec3f-4375-bce6-3a5883e64a3e tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:21.521324 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6ed3a27-ec3f-4375-bce6-3a5883e64a3e tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:21.521834 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6ed3a27-ec3f-4375-bce6-3a5883e64a3e tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:21.522535 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6ed3a27-ec3f-4375-bce6-3a5883e64a3e tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:21.656303 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d6ed3a27-ec3f-4375-bce6-3a5883e64a3e tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efc67113a174239b834a3e0b6c5e4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9df031f794bb1a6b0d087985bbfdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:51:21.664292 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d6ed3a27-ec3f-4375-bce6-3a5883e64a3e tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] 10.222.0.40 "GET /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254" status: 200 len: 1492 microversion: 2.1 time: 0.156871 Oct 26 13:51:21.664862 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3436/6848] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:51:21 2022] GET /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254 => generated 1492 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:51:21.687248 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c399d341-8d88-4165-b2b2-1c00e2df8951 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:51:21.687777 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c399d341-8d88-4165-b2b2-1c00e2df8951 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] [instance: fb930031-9954-4c51-97c3-53bafc7f5254] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:21.695369 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c399d341-8d88-4165-b2b2-1c00e2df8951 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:21.695855 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c399d341-8d88-4165-b2b2-1c00e2df8951 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:21.696295 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c399d341-8d88-4165-b2b2-1c00e2df8951 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:21.696983 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c399d341-8d88-4165-b2b2-1c00e2df8951 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:21.697442 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c399d341-8d88-4165-b2b2-1c00e2df8951 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:21.697900 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c399d341-8d88-4165-b2b2-1c00e2df8951 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:21.765801 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c399d341-8d88-4165-b2b2-1c00e2df8951 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] 10.222.0.40 "POST /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254/action" status: 202 len: 0 microversion: 2.1 time: 0.082175 Oct 26 13:51:21.769110 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3413/6849] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:51:21 2022] POST /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:51:21.775822 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f80a23dc-e6fd-46f9-90a0-a086afde7ec8 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:21.776450 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f80a23dc-e6fd-46f9-90a0-a086afde7ec8 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] [instance: fb930031-9954-4c51-97c3-53bafc7f5254] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:21.782480 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f80a23dc-e6fd-46f9-90a0-a086afde7ec8 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:21.782976 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f80a23dc-e6fd-46f9-90a0-a086afde7ec8 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:21.783424 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f80a23dc-e6fd-46f9-90a0-a086afde7ec8 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:21.784128 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f80a23dc-e6fd-46f9-90a0-a086afde7ec8 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:21.784687 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f80a23dc-e6fd-46f9-90a0-a086afde7ec8 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:21.785045 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f80a23dc-e6fd-46f9-90a0-a086afde7ec8 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:22.008034 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f80a23dc-e6fd-46f9-90a0-a086afde7ec8 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efc67113a174239b834a3e0b6c5e4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9df031f794bb1a6b0d087985bbfdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:51:22.016026 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f80a23dc-e6fd-46f9-90a0-a086afde7ec8 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] 10.222.0.40 "GET /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254" status: 200 len: 1498 microversion: 2.1 time: 0.245380 Oct 26 13:51:22.016616 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3437/6850] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:51:21 2022] GET /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254 => generated 1498 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:51:23.041232 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3f023648-4ce1-4868-9f36-736676002937 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:23.042666 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3f023648-4ce1-4868-9f36-736676002937 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] [instance: fb930031-9954-4c51-97c3-53bafc7f5254] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:23.051156 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3f023648-4ce1-4868-9f36-736676002937 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:23.051825 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3f023648-4ce1-4868-9f36-736676002937 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:23.052449 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3f023648-4ce1-4868-9f36-736676002937 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:23.054031 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3f023648-4ce1-4868-9f36-736676002937 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:23.054521 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3f023648-4ce1-4868-9f36-736676002937 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:23.055454 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3f023648-4ce1-4868-9f36-736676002937 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:23.189890 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3f023648-4ce1-4868-9f36-736676002937 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efc67113a174239b834a3e0b6c5e4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9df031f794bb1a6b0d087985bbfdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:51:23.198093 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3f023648-4ce1-4868-9f36-736676002937 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] 10.222.0.40 "GET /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254" status: 200 len: 1501 microversion: 2.1 time: 0.162333 Oct 26 13:51:23.198658 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3414/6851] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:51:23 2022] GET /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254 => generated 1501 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:51:23.221105 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1bf7a0d1-7675-4023-88ab-08999caaa21f tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:23.221799 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1bf7a0d1-7675-4023-88ab-08999caaa21f tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] [instance: fb930031-9954-4c51-97c3-53bafc7f5254] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:23.229580 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1bf7a0d1-7675-4023-88ab-08999caaa21f tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:23.230107 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1bf7a0d1-7675-4023-88ab-08999caaa21f tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:23.230553 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1bf7a0d1-7675-4023-88ab-08999caaa21f tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:23.231252 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1bf7a0d1-7675-4023-88ab-08999caaa21f tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:23.231721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1bf7a0d1-7675-4023-88ab-08999caaa21f tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:23.232155 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1bf7a0d1-7675-4023-88ab-08999caaa21f tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:23.260394 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1bf7a0d1-7675-4023-88ab-08999caaa21f tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] [instance: fb930031-9954-4c51-97c3-53bafc7f5254] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:51:23.337091 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1bf7a0d1-7675-4023-88ab-08999caaa21f tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] 10.222.0.40 "DELETE /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254" status: 204 len: 0 microversion: 2.1 time: 0.119851 Oct 26 13:51:23.337724 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3438/6852] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:51:23 2022] DELETE /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:51:23.347805 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-48f61720-5289-48e4-9d9c-b67125c36596 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:23.348427 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-48f61720-5289-48e4-9d9c-b67125c36596 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] [instance: fb930031-9954-4c51-97c3-53bafc7f5254] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:23.355103 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-48f61720-5289-48e4-9d9c-b67125c36596 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:23.355583 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-48f61720-5289-48e4-9d9c-b67125c36596 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:23.356020 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-48f61720-5289-48e4-9d9c-b67125c36596 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:23.356708 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-48f61720-5289-48e4-9d9c-b67125c36596 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:23.357164 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-48f61720-5289-48e4-9d9c-b67125c36596 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:23.357619 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-48f61720-5289-48e4-9d9c-b67125c36596 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:23.489584 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-48f61720-5289-48e4-9d9c-b67125c36596 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efc67113a174239b834a3e0b6c5e4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9df031f794bb1a6b0d087985bbfdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:51:23.493745 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:51:23.498994 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-48f61720-5289-48e4-9d9c-b67125c36596 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] 10.222.0.40 "GET /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254" status: 200 len: 1507 microversion: 2.1 time: 0.156577 Oct 26 13:51:23.499760 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3415/6853] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:51:23 2022] GET /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:51:24.523637 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ec3f70d1-ed58-457f-b98e-5144b4518d4d tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:24.524357 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ec3f70d1-ed58-457f-b98e-5144b4518d4d tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] [instance: fb930031-9954-4c51-97c3-53bafc7f5254] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:24.530997 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec3f70d1-ed58-457f-b98e-5144b4518d4d tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:24.531495 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec3f70d1-ed58-457f-b98e-5144b4518d4d tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:24.531949 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec3f70d1-ed58-457f-b98e-5144b4518d4d tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:24.532656 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec3f70d1-ed58-457f-b98e-5144b4518d4d tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:24.533123 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec3f70d1-ed58-457f-b98e-5144b4518d4d tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:24.533594 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec3f70d1-ed58-457f-b98e-5144b4518d4d tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:24.538533 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:51:24.675857 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ec3f70d1-ed58-457f-b98e-5144b4518d4d tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efc67113a174239b834a3e0b6c5e4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9df031f794bb1a6b0d087985bbfdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:51:24.683700 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ec3f70d1-ed58-457f-b98e-5144b4518d4d tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] 10.222.0.40 "GET /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254" status: 200 len: 1507 microversion: 2.1 time: 0.164610 Oct 26 13:51:24.684282 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3439/6854] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:51:24 2022] GET /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254 => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:51:25.708109 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dfa1fbf6-a444-4848-90ec-9675db7a55c9 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:25.708652 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-dfa1fbf6-a444-4848-90ec-9675db7a55c9 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] [instance: fb930031-9954-4c51-97c3-53bafc7f5254] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:25.717571 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dfa1fbf6-a444-4848-90ec-9675db7a55c9 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:25.718069 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dfa1fbf6-a444-4848-90ec-9675db7a55c9 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:25.718512 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dfa1fbf6-a444-4848-90ec-9675db7a55c9 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:25.719220 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dfa1fbf6-a444-4848-90ec-9675db7a55c9 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:25.719685 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dfa1fbf6-a444-4848-90ec-9675db7a55c9 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:25.720122 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dfa1fbf6-a444-4848-90ec-9675db7a55c9 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:25.855126 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-dfa1fbf6-a444-4848-90ec-9675db7a55c9 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efc67113a174239b834a3e0b6c5e4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9df031f794bb1a6b0d087985bbfdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:51:25.863422 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-dfa1fbf6-a444-4848-90ec-9675db7a55c9 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] 10.222.0.40 "GET /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254" status: 200 len: 1507 microversion: 2.1 time: 0.159971 Oct 26 13:51:25.863966 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3416/6855] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:51:25 2022] GET /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:51:26.018098 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-f74471ca-0755-4f3b-a5be-560b5cf6596e req-905254c5-d893-47f2-92e1-d89bf85dee9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb930031-9954-4c51-97c3-53bafc7f5254", "name": "network-vif-deleted", "tag": "f8c11160-ea81-43f3-b9c4-e211f5563853"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:51:26.025498 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:51:26.031673 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f74471ca-0755-4f3b-a5be-560b5cf6596e req-905254c5-d893-47f2-92e1-d89bf85dee9d service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:26.032175 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f74471ca-0755-4f3b-a5be-560b5cf6596e req-905254c5-d893-47f2-92e1-d89bf85dee9d service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:26.032624 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f74471ca-0755-4f3b-a5be-560b5cf6596e req-905254c5-d893-47f2-92e1-d89bf85dee9d service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:26.046734 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-f74471ca-0755-4f3b-a5be-560b5cf6596e req-905254c5-d893-47f2-92e1-d89bf85dee9d service nova] Creating event network-vif-deleted:f8c11160-ea81-43f3-b9c4-e211f5563853 for instance fb930031-9954-4c51-97c3-53bafc7f5254 on n-h1-862686-1 Oct 26 13:51:26.052467 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-f74471ca-0755-4f3b-a5be-560b5cf6596e req-905254c5-d893-47f2-92e1-d89bf85dee9d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038072 Oct 26 13:51:26.053729 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3440/6856] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:51:26.887334 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-def9a6e2-ad6b-4585-a24f-ac738f8cb188 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:26.887951 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-def9a6e2-ad6b-4585-a24f-ac738f8cb188 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] [instance: fb930031-9954-4c51-97c3-53bafc7f5254] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:26.890662 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:51:26.896013 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-def9a6e2-ad6b-4585-a24f-ac738f8cb188 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:26.896505 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-def9a6e2-ad6b-4585-a24f-ac738f8cb188 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:26.897333 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-def9a6e2-ad6b-4585-a24f-ac738f8cb188 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:26.898063 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-def9a6e2-ad6b-4585-a24f-ac738f8cb188 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:26.898525 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-def9a6e2-ad6b-4585-a24f-ac738f8cb188 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:26.898958 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-def9a6e2-ad6b-4585-a24f-ac738f8cb188 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:26.913308 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-def9a6e2-ad6b-4585-a24f-ac738f8cb188 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] HTTP exception thrown: Instance fb930031-9954-4c51-97c3-53bafc7f5254 could not be found. Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-def9a6e2-ad6b-4585-a24f-ac738f8cb188 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Request method failure captured: Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254 HTTP/1.1 Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTtJ_pcTQzDADO0N-8w1xoMS51x4Hx7AUbvq5S1GFO6vx_RpTLB8k8ugY0U4KyU8LZovlb3AXeHiMby__p1X3YxWSlvVTnAuAiLJQvEUIU6vJ6K9b_rsfnEMwSARjn_BrNBZ0BHB6QO5bfKyGW1pzolqigjgpdvssstWc2AgJULbBno Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 90d9df031f794bb1a6b0d087985bbfdc Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-TestServerAdvancedOps-1007324922 Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/90d9df031f794bb1a6b0d087985bbfdc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/90d9df031f794bb1a6b0d087985bbfdc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_90d9df031f794bb1a6b0d087985bbfdc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/90d9df031f794bb1a6b0d087985bbfdc"}]}] Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-TestServerAdvancedOps-1007324922 Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 90d9df031f794bb1a6b0d087985bbfdc Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-TestServerAdvancedOps-1007324922 Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-TestServerAdvancedOps-1007324922-project Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 7efc67113a174239b834a3e0b6c5e4f2 Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-TestServerAdvancedOps-1007324922-project Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance fb930031-9954-4c51-97c3-53bafc7f5254 could not be found. Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'fb930031-9954-4c51-97c3-53bafc7f5254'} Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb930031-9954-4c51-97c3-53bafc7f5254 could not be found. Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb930031-9954-4c51-97c3-53bafc7f5254 could not be found. Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:51:26.914987 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:51:26.919698 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:51:26.919698 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:51:26.919698 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:51:26.919698 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:51:26.919698 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:51:26.919698 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb930031-9954-4c51-97c3-53bafc7f5254 could not be found. Oct 26 13:51:26.919698 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:51:26.919698 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-def9a6e2-ad6b-4585-a24f-ac738f8cb188 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] Returning 404 to user: Instance fb930031-9954-4c51-97c3-53bafc7f5254 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:51:26.919698 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-def9a6e2-ad6b-4585-a24f-ac738f8cb188 tempest-TestServerAdvancedOps-1007324922 tempest-TestServerAdvancedOps-1007324922-project] 10.222.0.40 "GET /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254" status: 404 len: 111 microversion: 2.1 time: 0.033048 Oct 26 13:51:26.919698 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3417/6857] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:51:26 2022] GET /compute/v2.1/servers/fb930031-9954-4c51-97c3-53bafc7f5254 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:51:31.298449 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-95176fba-e5b3-4eab-ae52-14e88d98b23a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:31.299048 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-95176fba-e5b3-4eab-ae52-14e88d98b23a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: b0226ba0-3c5e-4f29-8e6e-55bd62d754f1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:31.305928 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-95176fba-e5b3-4eab-ae52-14e88d98b23a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:31.306441 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-95176fba-e5b3-4eab-ae52-14e88d98b23a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:31.306887 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-95176fba-e5b3-4eab-ae52-14e88d98b23a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:31.307585 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-95176fba-e5b3-4eab-ae52-14e88d98b23a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:31.308049 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-95176fba-e5b3-4eab-ae52-14e88d98b23a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:31.308482 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-95176fba-e5b3-4eab-ae52-14e88d98b23a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:31.333530 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-95176fba-e5b3-4eab-ae52-14e88d98b23a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: b0226ba0-3c5e-4f29-8e6e-55bd62d754f1] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:51:31.408963 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-95176fba-e5b3-4eab-ae52-14e88d98b23a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1" status: 204 len: 0 microversion: 2.1 time: 0.341837 Oct 26 13:51:31.409505 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3441/6858] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:51:31 2022] DELETE /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:51:31.418672 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-73158413-8d52-474a-9dac-3b359e0796d7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:31.419296 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-73158413-8d52-474a-9dac-3b359e0796d7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: b0226ba0-3c5e-4f29-8e6e-55bd62d754f1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:31.426360 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73158413-8d52-474a-9dac-3b359e0796d7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:31.426852 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73158413-8d52-474a-9dac-3b359e0796d7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:31.427295 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73158413-8d52-474a-9dac-3b359e0796d7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:31.428359 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73158413-8d52-474a-9dac-3b359e0796d7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:31.428475 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73158413-8d52-474a-9dac-3b359e0796d7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:31.428872 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73158413-8d52-474a-9dac-3b359e0796d7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:31.563535 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-73158413-8d52-474a-9dac-3b359e0796d7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:51:31.571355 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-73158413-8d52-474a-9dac-3b359e0796d7 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1" status: 200 len: 1579 microversion: 2.1 time: 0.156708 Oct 26 13:51:31.571920 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3418/6859] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:51:31 2022] GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 => generated 1579 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:51:32.596797 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-84a288fe-d132-4e9e-a849-89302fbf4dbb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:32.597530 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-84a288fe-d132-4e9e-a849-89302fbf4dbb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: b0226ba0-3c5e-4f29-8e6e-55bd62d754f1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:32.604404 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84a288fe-d132-4e9e-a849-89302fbf4dbb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:32.604876 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84a288fe-d132-4e9e-a849-89302fbf4dbb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:32.605321 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84a288fe-d132-4e9e-a849-89302fbf4dbb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:32.606040 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84a288fe-d132-4e9e-a849-89302fbf4dbb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:32.606506 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84a288fe-d132-4e9e-a849-89302fbf4dbb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:32.606940 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-84a288fe-d132-4e9e-a849-89302fbf4dbb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:32.739228 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-84a288fe-d132-4e9e-a849-89302fbf4dbb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:51:32.747519 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-84a288fe-d132-4e9e-a849-89302fbf4dbb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1" status: 200 len: 1579 microversion: 2.1 time: 0.155013 Oct 26 13:51:32.748143 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3442/6860] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:51:32 2022] GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 => generated 1579 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:51:33.772890 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a03c3b70-ce5b-4c28-8678-7a1a2ce65402 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:33.773544 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a03c3b70-ce5b-4c28-8678-7a1a2ce65402 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: b0226ba0-3c5e-4f29-8e6e-55bd62d754f1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:33.780519 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a03c3b70-ce5b-4c28-8678-7a1a2ce65402 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:33.781019 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a03c3b70-ce5b-4c28-8678-7a1a2ce65402 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:33.781469 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a03c3b70-ce5b-4c28-8678-7a1a2ce65402 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:33.782198 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a03c3b70-ce5b-4c28-8678-7a1a2ce65402 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:33.783269 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a03c3b70-ce5b-4c28-8678-7a1a2ce65402 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:33.783714 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a03c3b70-ce5b-4c28-8678-7a1a2ce65402 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:33.853458 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a03c3b70-ce5b-4c28-8678-7a1a2ce65402 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:51:33.861364 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a03c3b70-ce5b-4c28-8678-7a1a2ce65402 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1" status: 200 len: 1512 microversion: 2.1 time: 0.093027 Oct 26 13:51:33.862027 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3419/6861] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:51:33 2022] GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 => generated 1512 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:51:34.380284 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-ffd93cce-6002-4de7-8f1a-fb63fe7f2333 req-85b0b68b-ed94-408f-849a-99f3331d28d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0226ba0-3c5e-4f29-8e6e-55bd62d754f1", "name": "network-vif-deleted", "tag": "8b702b7d-e7c9-49da-a332-975c389e741b"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:51:34.393610 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ffd93cce-6002-4de7-8f1a-fb63fe7f2333 req-85b0b68b-ed94-408f-849a-99f3331d28d3 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:34.394380 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ffd93cce-6002-4de7-8f1a-fb63fe7f2333 req-85b0b68b-ed94-408f-849a-99f3331d28d3 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:34.394993 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ffd93cce-6002-4de7-8f1a-fb63fe7f2333 req-85b0b68b-ed94-408f-849a-99f3331d28d3 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:34.407122 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-ffd93cce-6002-4de7-8f1a-fb63fe7f2333 req-85b0b68b-ed94-408f-849a-99f3331d28d3 service nova] Creating event network-vif-deleted:8b702b7d-e7c9-49da-a332-975c389e741b for instance b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 on n-h2-862686-1 Oct 26 13:51:34.413652 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-ffd93cce-6002-4de7-8f1a-fb63fe7f2333 req-85b0b68b-ed94-408f-849a-99f3331d28d3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038166 Oct 26 13:51:34.414256 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3443/6862] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:51:34.885567 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8fb2eba0-694b-45dc-8cbf-d9477bf57d8c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:34.886319 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8fb2eba0-694b-45dc-8cbf-d9477bf57d8c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: b0226ba0-3c5e-4f29-8e6e-55bd62d754f1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:34.893869 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8fb2eba0-694b-45dc-8cbf-d9477bf57d8c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:34.894518 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8fb2eba0-694b-45dc-8cbf-d9477bf57d8c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:34.895060 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8fb2eba0-694b-45dc-8cbf-d9477bf57d8c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:34.895858 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8fb2eba0-694b-45dc-8cbf-d9477bf57d8c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:34.896496 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8fb2eba0-694b-45dc-8cbf-d9477bf57d8c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:34.897167 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8fb2eba0-694b-45dc-8cbf-d9477bf57d8c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:34.965889 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8fb2eba0-694b-45dc-8cbf-d9477bf57d8c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:51:34.974101 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8fb2eba0-694b-45dc-8cbf-d9477bf57d8c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1" status: 200 len: 1226 microversion: 2.1 time: 0.093633 Oct 26 13:51:34.977727 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3420/6863] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:51:34 2022] GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:51:35.997573 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-add7706a-fabc-4acf-9eeb-c259a6e082f1 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:35.999006 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-add7706a-fabc-4acf-9eeb-c259a6e082f1 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: b0226ba0-3c5e-4f29-8e6e-55bd62d754f1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:36.007066 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-add7706a-fabc-4acf-9eeb-c259a6e082f1 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:36.007574 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-add7706a-fabc-4acf-9eeb-c259a6e082f1 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:36.008025 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-add7706a-fabc-4acf-9eeb-c259a6e082f1 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:36.008753 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-add7706a-fabc-4acf-9eeb-c259a6e082f1 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:36.009220 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-add7706a-fabc-4acf-9eeb-c259a6e082f1 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:36.009692 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-add7706a-fabc-4acf-9eeb-c259a6e082f1 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:36.079406 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-add7706a-fabc-4acf-9eeb-c259a6e082f1 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:51:36.087539 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-add7706a-fabc-4acf-9eeb-c259a6e082f1 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1" status: 200 len: 1226 microversion: 2.1 time: 0.094348 Oct 26 13:51:36.088133 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3444/6864] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:51:35 2022] GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:51:37.110912 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7d64a2c2-a25d-4155-8244-9790b0e55bf2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:37.111428 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7d64a2c2-a25d-4155-8244-9790b0e55bf2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: b0226ba0-3c5e-4f29-8e6e-55bd62d754f1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:37.119522 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d64a2c2-a25d-4155-8244-9790b0e55bf2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:37.120019 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d64a2c2-a25d-4155-8244-9790b0e55bf2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:37.120465 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d64a2c2-a25d-4155-8244-9790b0e55bf2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:37.121176 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d64a2c2-a25d-4155-8244-9790b0e55bf2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:37.121775 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d64a2c2-a25d-4155-8244-9790b0e55bf2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:37.122216 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d64a2c2-a25d-4155-8244-9790b0e55bf2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:37.186336 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7d64a2c2-a25d-4155-8244-9790b0e55bf2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:51:37.195223 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7d64a2c2-a25d-4155-8244-9790b0e55bf2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1" status: 200 len: 1226 microversion: 2.1 time: 0.088335 Oct 26 13:51:37.195983 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3421/6865] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:51:37 2022] GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:51:38.218447 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c5c0ca7b-6b9b-47b1-a36e-0a1c0346a293 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:38.219017 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c5c0ca7b-6b9b-47b1-a36e-0a1c0346a293 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: b0226ba0-3c5e-4f29-8e6e-55bd62d754f1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:38.227348 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c5c0ca7b-6b9b-47b1-a36e-0a1c0346a293 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:38.227855 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c5c0ca7b-6b9b-47b1-a36e-0a1c0346a293 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:38.228312 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c5c0ca7b-6b9b-47b1-a36e-0a1c0346a293 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:38.229028 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c5c0ca7b-6b9b-47b1-a36e-0a1c0346a293 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:38.229523 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c5c0ca7b-6b9b-47b1-a36e-0a1c0346a293 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:38.229967 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c5c0ca7b-6b9b-47b1-a36e-0a1c0346a293 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:38.297007 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c5c0ca7b-6b9b-47b1-a36e-0a1c0346a293 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:51:38.304991 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c5c0ca7b-6b9b-47b1-a36e-0a1c0346a293 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1" status: 200 len: 1226 microversion: 2.1 time: 0.090603 Oct 26 13:51:38.305575 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3445/6866] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:51:38 2022] GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:51:39.327505 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-027a2503-5a6c-44bf-a408-3f60e5b1fcb6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:39.328109 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-027a2503-5a6c-44bf-a408-3f60e5b1fcb6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: b0226ba0-3c5e-4f29-8e6e-55bd62d754f1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:39.335574 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-027a2503-5a6c-44bf-a408-3f60e5b1fcb6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:39.336062 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-027a2503-5a6c-44bf-a408-3f60e5b1fcb6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:39.336502 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-027a2503-5a6c-44bf-a408-3f60e5b1fcb6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:39.337196 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-027a2503-5a6c-44bf-a408-3f60e5b1fcb6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:39.337679 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-027a2503-5a6c-44bf-a408-3f60e5b1fcb6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:39.338109 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-027a2503-5a6c-44bf-a408-3f60e5b1fcb6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:39.352328 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-027a2503-5a6c-44bf-a408-3f60e5b1fcb6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] HTTP exception thrown: Instance b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 could not be found. Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-027a2503-5a6c-44bf-a408-3f60e5b1fcb6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Request method failure captured: Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 HTTP/1.1 Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTnApzC1uv7RYc2W5kY-bKNxAsuZUBfTmQjsjWgzUuX11tX2R8DM_Fw7sVvtXRV9882pAeMKhCsEaXlaTjkLCgPxZsqy0UGzQzulFtHD7rhQ8cnkvWXYr0SPAMtN1JLnqGya627Ln2uWIw1ej-ApXw_efP2G5pRjjzhMaFQwCWIvwTI Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 2a1602330aa340b890bac76a120f74e8 Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-TestVolumeBootPattern-608207068 Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2a1602330aa340b890bac76a120f74e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2a1602330aa340b890bac76a120f74e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2a1602330aa340b890bac76a120f74e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2a1602330aa340b890bac76a120f74e8"}]}] Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-TestVolumeBootPattern-608207068 Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 2a1602330aa340b890bac76a120f74e8 Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-TestVolumeBootPattern-608207068 Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-TestVolumeBootPattern-608207068-project Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: df8b67aae3ea4f17bfa684681311dec5 Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-TestVolumeBootPattern-608207068-project Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 could not be found. Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'b0226ba0-3c5e-4f29-8e6e-55bd62d754f1'} Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 could not be found. Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 could not be found. Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:51:39.353858 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:51:39.358024 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:51:39.358024 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:51:39.358024 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:51:39.358024 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:51:39.358024 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:51:39.358024 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 could not be found. Oct 26 13:51:39.358024 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:51:39.358024 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-027a2503-5a6c-44bf-a408-3f60e5b1fcb6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Returning 404 to user: Instance b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:51:39.358024 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-027a2503-5a6c-44bf-a408-3f60e5b1fcb6 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1" status: 404 len: 111 microversion: 2.1 time: 0.031678 Oct 26 13:51:39.358024 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3422/6867] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:51:39 2022] GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:51:39.403846 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5904e496-3df3-45d7-aa66-1c03c9dfca7f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1021221245", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1766855477", "security_groups": [{"name": "tempest-secgroup-smoke-287163440"}], "block_device_mapping_v2": [{"uuid": "f2ac38fa-bd39-4ea6-9925-1c3d8715ed8d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a3a29c91-9973-4a7f-99bf-5b84e6501fd2"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:51:39.531064 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-5904e496-3df3-45d7-aa66-1c03c9dfca7f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] validate_networks() for [('a3a29c91-9973-4a7f-99bf-5b84e6501fd2', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:51:39.930651 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-5904e496-3df3-45d7-aa66-1c03c9dfca7f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:51:39.931081 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-5904e496-3df3-45d7-aa66-1c03c9dfca7f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:51:39.931565 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-5904e496-3df3-45d7-aa66-1c03c9dfca7f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:51:39.931984 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-5904e496-3df3-45d7-aa66-1c03c9dfca7f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:51:39.932405 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-5904e496-3df3-45d7-aa66-1c03c9dfca7f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:51:39.941202 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5904e496-3df3-45d7-aa66-1c03c9dfca7f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:39.941735 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5904e496-3df3-45d7-aa66-1c03c9dfca7f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:39.942184 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5904e496-3df3-45d7-aa66-1c03c9dfca7f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:39.943450 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5904e496-3df3-45d7-aa66-1c03c9dfca7f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:39.944005 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5904e496-3df3-45d7-aa66-1c03c9dfca7f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:39.944358 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5904e496-3df3-45d7-aa66-1c03c9dfca7f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:39.961487 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-5904e496-3df3-45d7-aa66-1c03c9dfca7f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Getting quotas for project 2a1602330aa340b890bac76a120f74e8. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:51:39.966684 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-5904e496-3df3-45d7-aa66-1c03c9dfca7f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Getting quotas for user df8b67aae3ea4f17bfa684681311dec5 and project 2a1602330aa340b890bac76a120f74e8. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:51:40.026680 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5904e496-3df3-45d7-aa66-1c03c9dfca7f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:51:40.028805 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5904e496-3df3-45d7-aa66-1c03c9dfca7f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 5702aa80-8d46-465d-9f15-2dd7964330b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f2ac38fa-bd39-4ea6-9925-1c3d8715ed8d',volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:51:40.160774 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5904e496-3df3-45d7-aa66-1c03c9dfca7f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.760408 Oct 26 13:51:40.161348 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3446/6868] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:51:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:51:40.173514 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-56fd0bfd-7650-4d82-96dd-85484ed411a9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:40.174158 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-56fd0bfd-7650-4d82-96dd-85484ed411a9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 5702aa80-8d46-465d-9f15-2dd7964330b0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:40.231935 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-56fd0bfd-7650-4d82-96dd-85484ed411a9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:51:40.238882 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-56fd0bfd-7650-4d82-96dd-85484ed411a9 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0" status: 200 len: 1095 microversion: 2.1 time: 0.069273 Oct 26 13:51:40.239454 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3423/6869] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:51:40 2022] GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0 => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:51:41.261796 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b17ba3a8-b2e0-4f36-89dc-e39aea919bae tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:41.262354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b17ba3a8-b2e0-4f36-89dc-e39aea919bae tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 5702aa80-8d46-465d-9f15-2dd7964330b0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:41.269546 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b17ba3a8-b2e0-4f36-89dc-e39aea919bae tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:41.270051 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b17ba3a8-b2e0-4f36-89dc-e39aea919bae tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:41.270514 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b17ba3a8-b2e0-4f36-89dc-e39aea919bae tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:41.271773 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b17ba3a8-b2e0-4f36-89dc-e39aea919bae tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:41.272846 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b17ba3a8-b2e0-4f36-89dc-e39aea919bae tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:41.273623 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b17ba3a8-b2e0-4f36-89dc-e39aea919bae tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:41.340391 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b17ba3a8-b2e0-4f36-89dc-e39aea919bae tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:51:41.348210 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b17ba3a8-b2e0-4f36-89dc-e39aea919bae tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0" status: 200 len: 1193 microversion: 2.1 time: 0.090802 Oct 26 13:51:41.348786 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3447/6870] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:51:41 2022] GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0 => generated 1193 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:51:42.372580 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-05057c33-a38d-4e5d-b430-a8da18357e7f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:42.373812 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-05057c33-a38d-4e5d-b430-a8da18357e7f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 5702aa80-8d46-465d-9f15-2dd7964330b0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:42.388122 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05057c33-a38d-4e5d-b430-a8da18357e7f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:42.388896 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05057c33-a38d-4e5d-b430-a8da18357e7f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:42.389907 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05057c33-a38d-4e5d-b430-a8da18357e7f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:42.391626 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05057c33-a38d-4e5d-b430-a8da18357e7f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:42.392378 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05057c33-a38d-4e5d-b430-a8da18357e7f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:42.393841 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05057c33-a38d-4e5d-b430-a8da18357e7f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:42.545830 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-05057c33-a38d-4e5d-b430-a8da18357e7f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:51:42.555030 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-05057c33-a38d-4e5d-b430-a8da18357e7f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0" status: 200 len: 1278 microversion: 2.1 time: 0.187391 Oct 26 13:51:42.571740 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3424/6871] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:51:42 2022] GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0 => generated 1278 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:51:42.903532 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-39c10031-67ec-4ce0-ae9c-7dd3321c3606 req-48828e2b-2bb2-4cbd-8bf7-7b59da99ad70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5702aa80-8d46-465d-9f15-2dd7964330b0", "tag": "96ea7d25-1b9b-4405-b06e-0e3695e542f0"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:51:42.925647 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-39c10031-67ec-4ce0-ae9c-7dd3321c3606 req-48828e2b-2bb2-4cbd-8bf7-7b59da99ad70 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:42.926096 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-39c10031-67ec-4ce0-ae9c-7dd3321c3606 req-48828e2b-2bb2-4cbd-8bf7-7b59da99ad70 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:42.926544 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-39c10031-67ec-4ce0-ae9c-7dd3321c3606 req-48828e2b-2bb2-4cbd-8bf7-7b59da99ad70 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:42.940107 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-39c10031-67ec-4ce0-ae9c-7dd3321c3606 req-48828e2b-2bb2-4cbd-8bf7-7b59da99ad70 service nova] Creating event network-changed:96ea7d25-1b9b-4405-b06e-0e3695e542f0 for instance 5702aa80-8d46-465d-9f15-2dd7964330b0 on n-h1-862686-1 Oct 26 13:51:42.945852 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-39c10031-67ec-4ce0-ae9c-7dd3321c3606 req-48828e2b-2bb2-4cbd-8bf7-7b59da99ad70 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046187 Oct 26 13:51:42.946528 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3448/6872] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:51:43.584596 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-78032b92-4abb-47d8-9d4d-68830eb1ac1f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:43.586651 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-78032b92-4abb-47d8-9d4d-68830eb1ac1f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 5702aa80-8d46-465d-9f15-2dd7964330b0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:43.593229 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78032b92-4abb-47d8-9d4d-68830eb1ac1f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:43.593748 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78032b92-4abb-47d8-9d4d-68830eb1ac1f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:43.594198 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78032b92-4abb-47d8-9d4d-68830eb1ac1f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:43.594904 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78032b92-4abb-47d8-9d4d-68830eb1ac1f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:43.595362 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78032b92-4abb-47d8-9d4d-68830eb1ac1f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:43.595792 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78032b92-4abb-47d8-9d4d-68830eb1ac1f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:43.739384 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-78032b92-4abb-47d8-9d4d-68830eb1ac1f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:51:43.747817 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-78032b92-4abb-47d8-9d4d-68830eb1ac1f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0" status: 200 len: 1278 microversion: 2.1 time: 0.172269 Oct 26 13:51:43.748597 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3425/6873] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:51:43 2022] GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0 => generated 1278 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:51:44.773968 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0d6677ff-c6a1-441b-b344-ff0fccecf6eb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:44.774685 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0d6677ff-c6a1-441b-b344-ff0fccecf6eb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 5702aa80-8d46-465d-9f15-2dd7964330b0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:44.780950 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d6677ff-c6a1-441b-b344-ff0fccecf6eb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:44.781453 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d6677ff-c6a1-441b-b344-ff0fccecf6eb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:44.781937 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d6677ff-c6a1-441b-b344-ff0fccecf6eb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:44.782649 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d6677ff-c6a1-441b-b344-ff0fccecf6eb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:44.783123 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d6677ff-c6a1-441b-b344-ff0fccecf6eb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:44.783561 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d6677ff-c6a1-441b-b344-ff0fccecf6eb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:44.920217 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0d6677ff-c6a1-441b-b344-ff0fccecf6eb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:51:44.929116 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0d6677ff-c6a1-441b-b344-ff0fccecf6eb tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0" status: 200 len: 1278 microversion: 2.1 time: 0.161016 Oct 26 13:51:44.929720 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3449/6874] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:51:44 2022] GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0 => generated 1278 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:51:45.953449 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6e3c90ba-bc30-43b2-949f-a919edd7d872 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:45.954098 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6e3c90ba-bc30-43b2-949f-a919edd7d872 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 5702aa80-8d46-465d-9f15-2dd7964330b0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:45.962122 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e3c90ba-bc30-43b2-949f-a919edd7d872 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:45.962732 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e3c90ba-bc30-43b2-949f-a919edd7d872 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:45.963253 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e3c90ba-bc30-43b2-949f-a919edd7d872 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:45.964029 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e3c90ba-bc30-43b2-949f-a919edd7d872 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:45.964566 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e3c90ba-bc30-43b2-949f-a919edd7d872 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:45.965068 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e3c90ba-bc30-43b2-949f-a919edd7d872 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:46.113507 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6e3c90ba-bc30-43b2-949f-a919edd7d872 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:51:46.121607 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6e3c90ba-bc30-43b2-949f-a919edd7d872 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0" status: 200 len: 1278 microversion: 2.1 time: 0.172329 Oct 26 13:51:46.122187 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3426/6875] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:51:45 2022] GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0 => generated 1278 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:51:47.144582 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fbf79a1e-16c1-4321-bf90-e5ab695060c2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:47.145109 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fbf79a1e-16c1-4321-bf90-e5ab695060c2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 5702aa80-8d46-465d-9f15-2dd7964330b0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:47.152637 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fbf79a1e-16c1-4321-bf90-e5ab695060c2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:47.153137 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fbf79a1e-16c1-4321-bf90-e5ab695060c2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:47.153614 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fbf79a1e-16c1-4321-bf90-e5ab695060c2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:47.154332 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fbf79a1e-16c1-4321-bf90-e5ab695060c2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:47.154807 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fbf79a1e-16c1-4321-bf90-e5ab695060c2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:47.155255 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fbf79a1e-16c1-4321-bf90-e5ab695060c2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:47.285658 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fbf79a1e-16c1-4321-bf90-e5ab695060c2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:51:47.294035 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fbf79a1e-16c1-4321-bf90-e5ab695060c2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0" status: 200 len: 1266 microversion: 2.1 time: 0.153556 Oct 26 13:51:47.294612 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3450/6876] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:51:47 2022] GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:51:48.317035 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6d0c37f8-84d7-46e4-b7a1-ae032357c62c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:48.318181 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6d0c37f8-84d7-46e4-b7a1-ae032357c62c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 5702aa80-8d46-465d-9f15-2dd7964330b0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:48.324817 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6d0c37f8-84d7-46e4-b7a1-ae032357c62c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:48.325313 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6d0c37f8-84d7-46e4-b7a1-ae032357c62c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:48.325793 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6d0c37f8-84d7-46e4-b7a1-ae032357c62c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:48.326491 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6d0c37f8-84d7-46e4-b7a1-ae032357c62c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:48.326957 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6d0c37f8-84d7-46e4-b7a1-ae032357c62c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:48.327390 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6d0c37f8-84d7-46e4-b7a1-ae032357c62c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:48.455337 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6d0c37f8-84d7-46e4-b7a1-ae032357c62c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:51:48.463682 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6d0c37f8-84d7-46e4-b7a1-ae032357c62c tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0" status: 200 len: 1266 microversion: 2.1 time: 0.150765 Oct 26 13:51:48.464256 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3427/6877] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:51:48 2022] GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:51:49.486170 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4c468430-4917-4747-9ccb-7f5102dedc17 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:49.486791 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4c468430-4917-4747-9ccb-7f5102dedc17 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 5702aa80-8d46-465d-9f15-2dd7964330b0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:49.493815 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c468430-4917-4747-9ccb-7f5102dedc17 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:49.494306 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c468430-4917-4747-9ccb-7f5102dedc17 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:49.494749 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c468430-4917-4747-9ccb-7f5102dedc17 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:49.495449 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c468430-4917-4747-9ccb-7f5102dedc17 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:49.495913 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c468430-4917-4747-9ccb-7f5102dedc17 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:49.496347 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c468430-4917-4747-9ccb-7f5102dedc17 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:49.634837 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4c468430-4917-4747-9ccb-7f5102dedc17 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:51:49.642483 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4c468430-4917-4747-9ccb-7f5102dedc17 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0" status: 200 len: 1266 microversion: 2.1 time: 0.160274 Oct 26 13:51:49.643063 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3451/6878] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:51:49 2022] GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:51:50.666361 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e14f4d79-3d0a-45a8-8a1f-521285c727b4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:50.666975 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e14f4d79-3d0a-45a8-8a1f-521285c727b4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 5702aa80-8d46-465d-9f15-2dd7964330b0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:50.669687 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:51:50.675649 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e14f4d79-3d0a-45a8-8a1f-521285c727b4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:50.676139 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e14f4d79-3d0a-45a8-8a1f-521285c727b4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:50.676582 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e14f4d79-3d0a-45a8-8a1f-521285c727b4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:50.677946 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e14f4d79-3d0a-45a8-8a1f-521285c727b4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:50.678412 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e14f4d79-3d0a-45a8-8a1f-521285c727b4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:50.678845 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e14f4d79-3d0a-45a8-8a1f-521285c727b4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:50.813340 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e14f4d79-3d0a-45a8-8a1f-521285c727b4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:51:50.821298 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e14f4d79-3d0a-45a8-8a1f-521285c727b4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0" status: 200 len: 1266 microversion: 2.1 time: 0.158844 Oct 26 13:51:50.821917 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3428/6879] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:51:50 2022] GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:51:51.844327 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-754fa07d-8d0f-4133-94ab-f0273ca48cba tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:51.844959 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-754fa07d-8d0f-4133-94ab-f0273ca48cba tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 5702aa80-8d46-465d-9f15-2dd7964330b0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:51.846986 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:51:51.847803 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:51:51.855282 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-754fa07d-8d0f-4133-94ab-f0273ca48cba tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:51.855790 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-754fa07d-8d0f-4133-94ab-f0273ca48cba tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:51.856250 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-754fa07d-8d0f-4133-94ab-f0273ca48cba tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:51.856972 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-754fa07d-8d0f-4133-94ab-f0273ca48cba tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:51.857449 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-754fa07d-8d0f-4133-94ab-f0273ca48cba tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:51.857918 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-754fa07d-8d0f-4133-94ab-f0273ca48cba tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:51.989393 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-754fa07d-8d0f-4133-94ab-f0273ca48cba tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:51:51.997348 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-754fa07d-8d0f-4133-94ab-f0273ca48cba tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0" status: 200 len: 1266 microversion: 2.1 time: 0.156993 Oct 26 13:51:51.997938 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3452/6880] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:51:51 2022] GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:51:53.020590 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bb7f2612-34c2-4ebb-b540-425df786c383 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:53.021869 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bb7f2612-34c2-4ebb-b540-425df786c383 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 5702aa80-8d46-465d-9f15-2dd7964330b0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:53.028585 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb7f2612-34c2-4ebb-b540-425df786c383 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:53.029076 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb7f2612-34c2-4ebb-b540-425df786c383 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:53.029539 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb7f2612-34c2-4ebb-b540-425df786c383 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:53.030255 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb7f2612-34c2-4ebb-b540-425df786c383 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:53.030705 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb7f2612-34c2-4ebb-b540-425df786c383 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:53.031133 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb7f2612-34c2-4ebb-b540-425df786c383 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:53.163977 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bb7f2612-34c2-4ebb-b540-425df786c383 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:51:53.171739 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bb7f2612-34c2-4ebb-b540-425df786c383 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0" status: 200 len: 1266 microversion: 2.1 time: 0.155209 Oct 26 13:51:53.172309 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3429/6881] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:51:53 2022] GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:51:54.195786 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-891263c0-50e2-481c-9db9-8a44739cee01 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:54.196340 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-891263c0-50e2-481c-9db9-8a44739cee01 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 5702aa80-8d46-465d-9f15-2dd7964330b0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:54.203250 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-891263c0-50e2-481c-9db9-8a44739cee01 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:54.203755 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-891263c0-50e2-481c-9db9-8a44739cee01 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:54.204208 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-891263c0-50e2-481c-9db9-8a44739cee01 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:54.204921 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-891263c0-50e2-481c-9db9-8a44739cee01 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:54.205399 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-891263c0-50e2-481c-9db9-8a44739cee01 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:54.205870 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-891263c0-50e2-481c-9db9-8a44739cee01 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:54.343338 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-891263c0-50e2-481c-9db9-8a44739cee01 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:51:54.351081 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-891263c0-50e2-481c-9db9-8a44739cee01 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0" status: 200 len: 1266 microversion: 2.1 time: 0.159961 Oct 26 13:51:54.351644 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3453/6882] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:51:54 2022] GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:51:55.374154 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-201cf1e6-a47c-4e20-99db-cd792193b130 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:55.374905 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-201cf1e6-a47c-4e20-99db-cd792193b130 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 5702aa80-8d46-465d-9f15-2dd7964330b0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:55.382234 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-201cf1e6-a47c-4e20-99db-cd792193b130 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:55.382718 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-201cf1e6-a47c-4e20-99db-cd792193b130 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:55.383150 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-201cf1e6-a47c-4e20-99db-cd792193b130 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:55.383842 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-201cf1e6-a47c-4e20-99db-cd792193b130 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:55.384297 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-201cf1e6-a47c-4e20-99db-cd792193b130 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:55.384719 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-201cf1e6-a47c-4e20-99db-cd792193b130 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:55.518550 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-201cf1e6-a47c-4e20-99db-cd792193b130 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:51:55.527137 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-201cf1e6-a47c-4e20-99db-cd792193b130 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0" status: 200 len: 1266 microversion: 2.1 time: 0.157010 Oct 26 13:51:55.527742 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3430/6883] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:51:55 2022] GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:51:56.550935 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ffe2bbf2-3650-473a-a95d-aecadd5c6e00 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:56.551560 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ffe2bbf2-3650-473a-a95d-aecadd5c6e00 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 5702aa80-8d46-465d-9f15-2dd7964330b0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:56.554424 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:51:56.559685 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ffe2bbf2-3650-473a-a95d-aecadd5c6e00 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:56.560179 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ffe2bbf2-3650-473a-a95d-aecadd5c6e00 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:56.560634 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ffe2bbf2-3650-473a-a95d-aecadd5c6e00 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:56.561348 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ffe2bbf2-3650-473a-a95d-aecadd5c6e00 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:56.561909 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ffe2bbf2-3650-473a-a95d-aecadd5c6e00 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:56.562344 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ffe2bbf2-3650-473a-a95d-aecadd5c6e00 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:56.565618 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:51:56.695543 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ffe2bbf2-3650-473a-a95d-aecadd5c6e00 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:51:56.703355 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ffe2bbf2-3650-473a-a95d-aecadd5c6e00 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0" status: 200 len: 1266 microversion: 2.1 time: 0.156350 Oct 26 13:51:56.703924 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3454/6884] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:51:56 2022] GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:51:57.430622 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-430e8cb6-c60d-42a2-8c03-eaa9d2a22429 req-41ec4c25-8499-47e9-a567-4946f16f2164 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5702aa80-8d46-465d-9f15-2dd7964330b0", "name": "network-vif-plugged", "status": "completed", "tag": "96ea7d25-1b9b-4405-b06e-0e3695e542f0"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:51:57.438097 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=30 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:51:57.443297 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-430e8cb6-c60d-42a2-8c03-eaa9d2a22429 req-41ec4c25-8499-47e9-a567-4946f16f2164 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:57.443869 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-430e8cb6-c60d-42a2-8c03-eaa9d2a22429 req-41ec4c25-8499-47e9-a567-4946f16f2164 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:57.444309 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-430e8cb6-c60d-42a2-8c03-eaa9d2a22429 req-41ec4c25-8499-47e9-a567-4946f16f2164 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:57.448538 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=77 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:51:57.456541 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-430e8cb6-c60d-42a2-8c03-eaa9d2a22429 req-41ec4c25-8499-47e9-a567-4946f16f2164 service nova] Creating event network-vif-plugged:96ea7d25-1b9b-4405-b06e-0e3695e542f0 for instance 5702aa80-8d46-465d-9f15-2dd7964330b0 on n-h1-862686-1 Oct 26 13:51:57.461777 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-430e8cb6-c60d-42a2-8c03-eaa9d2a22429 req-41ec4c25-8499-47e9-a567-4946f16f2164 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035525 Oct 26 13:51:57.462387 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3431/6885] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:51:57.727214 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b40ab3ff-7478-4fd1-930e-c5e5657c4217 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:57.727879 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b40ab3ff-7478-4fd1-930e-c5e5657c4217 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 5702aa80-8d46-465d-9f15-2dd7964330b0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:57.735052 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b40ab3ff-7478-4fd1-930e-c5e5657c4217 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:57.735555 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b40ab3ff-7478-4fd1-930e-c5e5657c4217 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:57.736013 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b40ab3ff-7478-4fd1-930e-c5e5657c4217 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:57.736727 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b40ab3ff-7478-4fd1-930e-c5e5657c4217 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:57.737276 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b40ab3ff-7478-4fd1-930e-c5e5657c4217 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:57.737751 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b40ab3ff-7478-4fd1-930e-c5e5657c4217 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:57.871016 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b40ab3ff-7478-4fd1-930e-c5e5657c4217 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:51:57.878988 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b40ab3ff-7478-4fd1-930e-c5e5657c4217 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0" status: 200 len: 1266 microversion: 2.1 time: 0.156365 Oct 26 13:51:57.879565 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3455/6886] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:51:57 2022] GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:51:58.903155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-79378eb0-2d4f-4870-8c0b-6c2e1dfce3a0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:58.903881 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-79378eb0-2d4f-4870-8c0b-6c2e1dfce3a0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 5702aa80-8d46-465d-9f15-2dd7964330b0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:58.910054 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-79378eb0-2d4f-4870-8c0b-6c2e1dfce3a0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:58.910802 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-79378eb0-2d4f-4870-8c0b-6c2e1dfce3a0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:58.911246 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-79378eb0-2d4f-4870-8c0b-6c2e1dfce3a0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:58.912775 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-79378eb0-2d4f-4870-8c0b-6c2e1dfce3a0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:58.913036 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-79378eb0-2d4f-4870-8c0b-6c2e1dfce3a0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:58.913459 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-79378eb0-2d4f-4870-8c0b-6c2e1dfce3a0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:59.048495 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-79378eb0-2d4f-4870-8c0b-6c2e1dfce3a0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:51:59.056364 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-79378eb0-2d4f-4870-8c0b-6c2e1dfce3a0 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0" status: 200 len: 1453 microversion: 2.1 time: 0.158301 Oct 26 13:51:59.056944 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3432/6887] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:51:58 2022] GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0 => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:51:59.078593 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-512c04a0-875c-4398-8e98-6878c350eb2f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:51:59.079225 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-512c04a0-875c-4398-8e98-6878c350eb2f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 5702aa80-8d46-465d-9f15-2dd7964330b0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:51:59.087826 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-512c04a0-875c-4398-8e98-6878c350eb2f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:59.088338 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-512c04a0-875c-4398-8e98-6878c350eb2f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:59.088796 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-512c04a0-875c-4398-8e98-6878c350eb2f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:59.089539 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-512c04a0-875c-4398-8e98-6878c350eb2f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:51:59.090290 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-512c04a0-875c-4398-8e98-6878c350eb2f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:51:59.090776 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-512c04a0-875c-4398-8e98-6878c350eb2f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:51:59.223588 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-512c04a0-875c-4398-8e98-6878c350eb2f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:51:59.232847 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-512c04a0-875c-4398-8e98-6878c350eb2f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0" status: 200 len: 1453 microversion: 2.1 time: 0.158248 Oct 26 13:51:59.233418 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3456/6888] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:51:59 2022] GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:52:01.322274 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-223c46be-a46d-4500-8a1e-4d32f5542b7e req-e1335fa8-9de7-45ec-8c39-299de1919785 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5702aa80-8d46-465d-9f15-2dd7964330b0", "tag": "96ea7d25-1b9b-4405-b06e-0e3695e542f0"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:52:01.333322 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-223c46be-a46d-4500-8a1e-4d32f5542b7e req-e1335fa8-9de7-45ec-8c39-299de1919785 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:52:01.333956 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-223c46be-a46d-4500-8a1e-4d32f5542b7e req-e1335fa8-9de7-45ec-8c39-299de1919785 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:52:01.333956 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-223c46be-a46d-4500-8a1e-4d32f5542b7e req-e1335fa8-9de7-45ec-8c39-299de1919785 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:52:01.346631 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-223c46be-a46d-4500-8a1e-4d32f5542b7e req-e1335fa8-9de7-45ec-8c39-299de1919785 service nova] Creating event network-changed:96ea7d25-1b9b-4405-b06e-0e3695e542f0 for instance 5702aa80-8d46-465d-9f15-2dd7964330b0 on n-h1-862686-1 Oct 26 13:52:01.352031 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-223c46be-a46d-4500-8a1e-4d32f5542b7e req-e1335fa8-9de7-45ec-8c39-299de1919785 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034070 Oct 26 13:52:01.352710 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3433/6889] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:53:43.573087 n-d-862686-1 devstack@n-api.service[120598]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b813bc1f-3720-4149-820f-44a58aef8a8e] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 26 13:53:43.573998 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=5 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:53:43.574786 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=17 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:53:43.579963 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7bb17c21-ac13-40b1-a469-e54a0e9ae748 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2029681885", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1766855477", "security_groups": [{"name": "tempest-secgroup-smoke-287163440"}], "block_device_mapping_v2": [{"uuid": "2dfbe837-2d06-402e-934e-1dc3248ca8e6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a3a29c91-9973-4a7f-99bf-5b84e6501fd2"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:53:43.839555 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-7bb17c21-ac13-40b1-a469-e54a0e9ae748 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] validate_networks() for [('a3a29c91-9973-4a7f-99bf-5b84e6501fd2', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:53:44.220060 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-7bb17c21-ac13-40b1-a469-e54a0e9ae748 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:53:44.220497 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-7bb17c21-ac13-40b1-a469-e54a0e9ae748 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:53:44.220976 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-7bb17c21-ac13-40b1-a469-e54a0e9ae748 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:53:44.221391 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-7bb17c21-ac13-40b1-a469-e54a0e9ae748 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:53:44.221831 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-7bb17c21-ac13-40b1-a469-e54a0e9ae748 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:53:44.231126 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7bb17c21-ac13-40b1-a469-e54a0e9ae748 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:53:44.231617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7bb17c21-ac13-40b1-a469-e54a0e9ae748 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:53:44.232083 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7bb17c21-ac13-40b1-a469-e54a0e9ae748 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:53:44.232808 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7bb17c21-ac13-40b1-a469-e54a0e9ae748 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:53:44.233274 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7bb17c21-ac13-40b1-a469-e54a0e9ae748 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:53:44.233737 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7bb17c21-ac13-40b1-a469-e54a0e9ae748 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:53:44.251410 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-7bb17c21-ac13-40b1-a469-e54a0e9ae748 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Getting quotas for project 2a1602330aa340b890bac76a120f74e8. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:53:44.256535 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-7bb17c21-ac13-40b1-a469-e54a0e9ae748 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Getting quotas for user df8b67aae3ea4f17bfa684681311dec5 and project 2a1602330aa340b890bac76a120f74e8. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:53:44.316445 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7bb17c21-ac13-40b1-a469-e54a0e9ae748 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:53:44.318661 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7bb17c21-ac13-40b1-a469-e54a0e9ae748 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 6afa82cf-9ed5-4a0e-a0c9-643178807f3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2dfbe837-2d06-402e-934e-1dc3248ca8e6',volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:53:44.447024 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7bb17c21-ac13-40b1-a469-e54a0e9ae748 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.876654 Oct 26 13:53:44.447782 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3457/6890] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:53:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:53:44.458304 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=5 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:53:44.459538 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=9 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:53:44.460868 n-d-862686-1 devstack@n-api.service[120597]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 13:53:44.461002 n-d-862686-1 devstack@n-api.service[120597]: Wed Oct 26 13:53:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b (ip 10.222.0.40) !!! Oct 26 13:53:44.468714 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1cb03d53-6730-4049-b7ff-91f81dde0c4f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:53:44.469471 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1cb03d53-6730-4049-b7ff-91f81dde0c4f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 6afa82cf-9ed5-4a0e-a0c9-643178807f3b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:53:44.623884 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1cb03d53-6730-4049-b7ff-91f81dde0c4f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:53:44.631274 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1cb03d53-6730-4049-b7ff-91f81dde0c4f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b" status: 200 len: 1095 microversion: 2.1 time: 0.175965 Oct 26 13:53:44.631924 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3434/6891] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:53:44 2022] GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b => generated 1095 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:53:45.657461 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-903875bc-11a8-49e6-8a47-a8027314c595 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:53:45.658773 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-903875bc-11a8-49e6-8a47-a8027314c595 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 6afa82cf-9ed5-4a0e-a0c9-643178807f3b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:53:45.668018 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-903875bc-11a8-49e6-8a47-a8027314c595 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:53:45.668843 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-903875bc-11a8-49e6-8a47-a8027314c595 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:53:45.669555 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-903875bc-11a8-49e6-8a47-a8027314c595 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:53:45.670590 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-903875bc-11a8-49e6-8a47-a8027314c595 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:53:45.671150 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-903875bc-11a8-49e6-8a47-a8027314c595 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:53:45.671743 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-903875bc-11a8-49e6-8a47-a8027314c595 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:53:45.675689 n-d-862686-1 devstack@n-api.service[120598]: INFO oslo.messaging._drivers.impl_rabbit [-] [b813bc1f-3720-4149-820f-44a58aef8a8e] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 33098. Oct 26 13:53:45.737653 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-903875bc-11a8-49e6-8a47-a8027314c595 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:53:45.746559 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-903875bc-11a8-49e6-8a47-a8027314c595 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b" status: 200 len: 1211 microversion: 2.1 time: 0.095442 Oct 26 13:53:45.747335 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3458/6892] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:53:45 2022] GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b => generated 1211 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:53:46.771047 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-10a94fda-9a9a-4b3e-b9ae-40d8ec0b643f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:53:46.771671 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-10a94fda-9a9a-4b3e-b9ae-40d8ec0b643f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 6afa82cf-9ed5-4a0e-a0c9-643178807f3b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:53:46.778813 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-10a94fda-9a9a-4b3e-b9ae-40d8ec0b643f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:53:46.779307 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-10a94fda-9a9a-4b3e-b9ae-40d8ec0b643f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:53:46.779751 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-10a94fda-9a9a-4b3e-b9ae-40d8ec0b643f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:53:46.780461 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-10a94fda-9a9a-4b3e-b9ae-40d8ec0b643f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:53:46.781260 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-10a94fda-9a9a-4b3e-b9ae-40d8ec0b643f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:53:46.781356 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-10a94fda-9a9a-4b3e-b9ae-40d8ec0b643f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:53:47.009886 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-10a94fda-9a9a-4b3e-b9ae-40d8ec0b643f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:53:47.018577 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-10a94fda-9a9a-4b3e-b9ae-40d8ec0b643f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b" status: 200 len: 1278 microversion: 2.1 time: 0.251856 Oct 26 13:53:47.019282 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3435/6893] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:53:46 2022] GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b => generated 1278 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:53:47.293863 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-540442c0-03c1-4828-8787-6a86560838f4 req-4dd9906c-5ff7-4619-ad2e-a0f8b5098ef1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6afa82cf-9ed5-4a0e-a0c9-643178807f3b", "tag": "df439229-0722-49ee-a7a8-0163e1f46372"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:53:47.305588 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-540442c0-03c1-4828-8787-6a86560838f4 req-4dd9906c-5ff7-4619-ad2e-a0f8b5098ef1 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:53:47.306103 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-540442c0-03c1-4828-8787-6a86560838f4 req-4dd9906c-5ff7-4619-ad2e-a0f8b5098ef1 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:53:47.306544 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-540442c0-03c1-4828-8787-6a86560838f4 req-4dd9906c-5ff7-4619-ad2e-a0f8b5098ef1 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:53:47.319096 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-540442c0-03c1-4828-8787-6a86560838f4 req-4dd9906c-5ff7-4619-ad2e-a0f8b5098ef1 service nova] Creating event network-changed:df439229-0722-49ee-a7a8-0163e1f46372 for instance 6afa82cf-9ed5-4a0e-a0c9-643178807f3b on n-h2-862686-1 Oct 26 13:53:47.325699 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-540442c0-03c1-4828-8787-6a86560838f4 req-4dd9906c-5ff7-4619-ad2e-a0f8b5098ef1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135075 Oct 26 13:53:47.326595 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3459/6894] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:53:48.042782 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-676d9ec0-249a-4dc0-a0f9-d6681c7cf695 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:53:48.043390 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-676d9ec0-249a-4dc0-a0f9-d6681c7cf695 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 6afa82cf-9ed5-4a0e-a0c9-643178807f3b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:53:48.051045 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-676d9ec0-249a-4dc0-a0f9-d6681c7cf695 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:53:48.051546 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-676d9ec0-249a-4dc0-a0f9-d6681c7cf695 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:53:48.051996 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-676d9ec0-249a-4dc0-a0f9-d6681c7cf695 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:53:48.052722 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-676d9ec0-249a-4dc0-a0f9-d6681c7cf695 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:53:48.053365 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-676d9ec0-249a-4dc0-a0f9-d6681c7cf695 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:53:48.053825 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-676d9ec0-249a-4dc0-a0f9-d6681c7cf695 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:53:48.274400 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-676d9ec0-249a-4dc0-a0f9-d6681c7cf695 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:53:48.290320 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-676d9ec0-249a-4dc0-a0f9-d6681c7cf695 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b" status: 200 len: 1278 microversion: 2.1 time: 0.252168 Oct 26 13:53:48.291055 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3436/6895] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:53:48 2022] GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b => generated 1278 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:53:49.314763 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-df19df89-1e0f-40f5-ab8f-cf65240d7243 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:53:49.315488 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-df19df89-1e0f-40f5-ab8f-cf65240d7243 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 6afa82cf-9ed5-4a0e-a0c9-643178807f3b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:53:49.321958 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df19df89-1e0f-40f5-ab8f-cf65240d7243 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:53:49.322461 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df19df89-1e0f-40f5-ab8f-cf65240d7243 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:53:49.322916 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df19df89-1e0f-40f5-ab8f-cf65240d7243 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:53:49.323630 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df19df89-1e0f-40f5-ab8f-cf65240d7243 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:53:49.324105 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df19df89-1e0f-40f5-ab8f-cf65240d7243 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:53:49.324556 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df19df89-1e0f-40f5-ab8f-cf65240d7243 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:53:49.457117 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-df19df89-1e0f-40f5-ab8f-cf65240d7243 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:53:49.465280 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-df19df89-1e0f-40f5-ab8f-cf65240d7243 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b" status: 200 len: 1278 microversion: 2.1 time: 0.155731 Oct 26 13:53:49.465903 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3460/6896] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:53:49 2022] GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:53:50.488506 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-04e8b50d-2735-4c1b-be94-d4d79df707ac tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:53:50.489121 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-04e8b50d-2735-4c1b-be94-d4d79df707ac tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 6afa82cf-9ed5-4a0e-a0c9-643178807f3b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:53:50.496955 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-04e8b50d-2735-4c1b-be94-d4d79df707ac tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:53:50.497448 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-04e8b50d-2735-4c1b-be94-d4d79df707ac tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:53:50.497920 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-04e8b50d-2735-4c1b-be94-d4d79df707ac tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:53:50.498622 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-04e8b50d-2735-4c1b-be94-d4d79df707ac tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:53:50.499081 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-04e8b50d-2735-4c1b-be94-d4d79df707ac tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:53:50.499538 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-04e8b50d-2735-4c1b-be94-d4d79df707ac tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:53:50.637952 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-04e8b50d-2735-4c1b-be94-d4d79df707ac tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:53:50.646081 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-04e8b50d-2735-4c1b-be94-d4d79df707ac tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b" status: 200 len: 1278 microversion: 2.1 time: 0.161581 Oct 26 13:53:50.646742 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3437/6897] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:53:50 2022] GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b => generated 1278 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:53:51.668989 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f958c7b8-77f1-4924-8464-9e65d44d1481 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:53:51.669649 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f958c7b8-77f1-4924-8464-9e65d44d1481 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 6afa82cf-9ed5-4a0e-a0c9-643178807f3b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:53:51.676687 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f958c7b8-77f1-4924-8464-9e65d44d1481 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:53:51.677191 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f958c7b8-77f1-4924-8464-9e65d44d1481 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:53:51.677677 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f958c7b8-77f1-4924-8464-9e65d44d1481 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:53:51.678386 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f958c7b8-77f1-4924-8464-9e65d44d1481 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:53:51.678858 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f958c7b8-77f1-4924-8464-9e65d44d1481 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:53:51.679930 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f958c7b8-77f1-4924-8464-9e65d44d1481 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:53:51.814044 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f958c7b8-77f1-4924-8464-9e65d44d1481 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:53:51.821882 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f958c7b8-77f1-4924-8464-9e65d44d1481 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b" status: 200 len: 1266 microversion: 2.1 time: 0.156806 Oct 26 13:53:51.822452 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3461/6898] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:53:51 2022] GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:53:52.844329 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0d1bf966-7ca4-4f5f-a3b4-ca316b985d9b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:53:52.844904 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0d1bf966-7ca4-4f5f-a3b4-ca316b985d9b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 6afa82cf-9ed5-4a0e-a0c9-643178807f3b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:53:52.851751 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0d1bf966-7ca4-4f5f-a3b4-ca316b985d9b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:53:52.852244 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0d1bf966-7ca4-4f5f-a3b4-ca316b985d9b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:53:52.852690 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0d1bf966-7ca4-4f5f-a3b4-ca316b985d9b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:53:52.853387 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0d1bf966-7ca4-4f5f-a3b4-ca316b985d9b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:53:52.853878 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0d1bf966-7ca4-4f5f-a3b4-ca316b985d9b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:53:52.854310 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0d1bf966-7ca4-4f5f-a3b4-ca316b985d9b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:53:52.990134 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0d1bf966-7ca4-4f5f-a3b4-ca316b985d9b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:53:52.997903 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0d1bf966-7ca4-4f5f-a3b4-ca316b985d9b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b" status: 200 len: 1266 microversion: 2.1 time: 0.157555 Oct 26 13:53:52.998465 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3438/6899] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:53:52 2022] GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:53:54.020303 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f71382ca-8bf1-4da2-a671-441eee82faa3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:53:54.021020 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f71382ca-8bf1-4da2-a671-441eee82faa3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 6afa82cf-9ed5-4a0e-a0c9-643178807f3b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:53:54.028673 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f71382ca-8bf1-4da2-a671-441eee82faa3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:53:54.029169 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f71382ca-8bf1-4da2-a671-441eee82faa3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:53:54.029648 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f71382ca-8bf1-4da2-a671-441eee82faa3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:53:54.030351 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f71382ca-8bf1-4da2-a671-441eee82faa3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:53:54.030818 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f71382ca-8bf1-4da2-a671-441eee82faa3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:53:54.031255 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f71382ca-8bf1-4da2-a671-441eee82faa3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:53:54.173174 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f71382ca-8bf1-4da2-a671-441eee82faa3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:53:54.182785 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f71382ca-8bf1-4da2-a671-441eee82faa3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b" status: 200 len: 1266 microversion: 2.1 time: 0.166427 Oct 26 13:53:54.183390 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3462/6900] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:53:54 2022] GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:53:55.207879 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-088f0a4e-6301-4cc3-ab7c-49910442e223 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:53:55.208412 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-088f0a4e-6301-4cc3-ab7c-49910442e223 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 6afa82cf-9ed5-4a0e-a0c9-643178807f3b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:53:55.212246 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:53:55.219543 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-088f0a4e-6301-4cc3-ab7c-49910442e223 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:53:55.220453 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-088f0a4e-6301-4cc3-ab7c-49910442e223 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:53:55.221217 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-088f0a4e-6301-4cc3-ab7c-49910442e223 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:53:55.221940 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-088f0a4e-6301-4cc3-ab7c-49910442e223 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:53:55.222606 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-088f0a4e-6301-4cc3-ab7c-49910442e223 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:53:55.223403 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-088f0a4e-6301-4cc3-ab7c-49910442e223 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:53:55.364583 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-088f0a4e-6301-4cc3-ab7c-49910442e223 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:53:55.372803 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-088f0a4e-6301-4cc3-ab7c-49910442e223 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b" status: 200 len: 1266 microversion: 2.1 time: 0.169169 Oct 26 13:53:55.373369 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3439/6901] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:53:55 2022] GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:53:56.396308 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4251211f-2e74-41c0-acb2-92971604f273 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:53:56.396932 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4251211f-2e74-41c0-acb2-92971604f273 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 6afa82cf-9ed5-4a0e-a0c9-643178807f3b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:53:56.398931 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:53:56.400565 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:53:56.406557 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4251211f-2e74-41c0-acb2-92971604f273 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:53:56.407054 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4251211f-2e74-41c0-acb2-92971604f273 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:53:56.407500 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4251211f-2e74-41c0-acb2-92971604f273 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:53:56.408201 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4251211f-2e74-41c0-acb2-92971604f273 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:53:56.408667 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4251211f-2e74-41c0-acb2-92971604f273 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:53:56.409102 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4251211f-2e74-41c0-acb2-92971604f273 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:53:56.558307 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4251211f-2e74-41c0-acb2-92971604f273 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:53:56.566806 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4251211f-2e74-41c0-acb2-92971604f273 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b" status: 200 len: 1266 microversion: 2.1 time: 0.174588 Oct 26 13:53:56.567388 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3463/6902] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:53:56 2022] GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:53:57.592628 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-db4214f9-27d1-47e4-8640-caf16b575abe tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:53:57.593248 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-db4214f9-27d1-47e4-8640-caf16b575abe tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 6afa82cf-9ed5-4a0e-a0c9-643178807f3b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:53:57.599710 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-db4214f9-27d1-47e4-8640-caf16b575abe tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:53:57.600148 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-db4214f9-27d1-47e4-8640-caf16b575abe tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:53:57.600650 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-db4214f9-27d1-47e4-8640-caf16b575abe tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:53:57.601546 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-db4214f9-27d1-47e4-8640-caf16b575abe tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:53:57.602002 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-db4214f9-27d1-47e4-8640-caf16b575abe tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:53:57.602511 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-db4214f9-27d1-47e4-8640-caf16b575abe tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:53:57.755521 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-db4214f9-27d1-47e4-8640-caf16b575abe tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:53:57.763812 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-db4214f9-27d1-47e4-8640-caf16b575abe tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b" status: 200 len: 1266 microversion: 2.1 time: 0.177340 Oct 26 13:53:57.764385 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3440/6903] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:53:57 2022] GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:53:58.787329 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bc2a01d5-4182-41ad-8175-7bdb3522b09d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:53:58.787956 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bc2a01d5-4182-41ad-8175-7bdb3522b09d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 6afa82cf-9ed5-4a0e-a0c9-643178807f3b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:53:58.795522 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc2a01d5-4182-41ad-8175-7bdb3522b09d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:53:58.796027 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc2a01d5-4182-41ad-8175-7bdb3522b09d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:53:58.796481 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc2a01d5-4182-41ad-8175-7bdb3522b09d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:53:58.797191 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc2a01d5-4182-41ad-8175-7bdb3522b09d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:53:58.797703 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc2a01d5-4182-41ad-8175-7bdb3522b09d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:53:58.798146 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bc2a01d5-4182-41ad-8175-7bdb3522b09d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:53:58.932904 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bc2a01d5-4182-41ad-8175-7bdb3522b09d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:53:58.940668 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bc2a01d5-4182-41ad-8175-7bdb3522b09d tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b" status: 200 len: 1266 microversion: 2.1 time: 0.157592 Oct 26 13:53:58.941252 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3464/6904] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:53:58 2022] GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:53:59.964117 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fbeb0037-88ef-4d36-8e63-156be27fe6c4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:53:59.964747 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fbeb0037-88ef-4d36-8e63-156be27fe6c4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 6afa82cf-9ed5-4a0e-a0c9-643178807f3b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:53:59.971728 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fbeb0037-88ef-4d36-8e63-156be27fe6c4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:53:59.972221 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fbeb0037-88ef-4d36-8e63-156be27fe6c4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:53:59.972669 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fbeb0037-88ef-4d36-8e63-156be27fe6c4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:53:59.973412 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fbeb0037-88ef-4d36-8e63-156be27fe6c4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:53:59.973914 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fbeb0037-88ef-4d36-8e63-156be27fe6c4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:53:59.974369 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fbeb0037-88ef-4d36-8e63-156be27fe6c4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:54:00.114607 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fbeb0037-88ef-4d36-8e63-156be27fe6c4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:54:00.123426 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fbeb0037-88ef-4d36-8e63-156be27fe6c4 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b" status: 200 len: 1266 microversion: 2.1 time: 0.163397 Oct 26 13:54:00.124005 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3441/6905] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:53:59 2022] GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:54:01.147240 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2802df0e-07e2-49cc-9dc9-bfdc99d8b0ff tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:54:01.147896 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2802df0e-07e2-49cc-9dc9-bfdc99d8b0ff tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 6afa82cf-9ed5-4a0e-a0c9-643178807f3b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:54:01.155357 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2802df0e-07e2-49cc-9dc9-bfdc99d8b0ff tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:54:01.155858 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2802df0e-07e2-49cc-9dc9-bfdc99d8b0ff tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:54:01.156313 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2802df0e-07e2-49cc-9dc9-bfdc99d8b0ff tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:54:01.157017 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2802df0e-07e2-49cc-9dc9-bfdc99d8b0ff tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:54:01.157500 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2802df0e-07e2-49cc-9dc9-bfdc99d8b0ff tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:54:01.157950 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2802df0e-07e2-49cc-9dc9-bfdc99d8b0ff tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:54:01.290594 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2802df0e-07e2-49cc-9dc9-bfdc99d8b0ff tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:54:01.298327 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2802df0e-07e2-49cc-9dc9-bfdc99d8b0ff tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b" status: 200 len: 1266 microversion: 2.1 time: 0.155057 Oct 26 13:54:01.298902 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3465/6906] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:54:01 2022] GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:54:02.124872 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-2853700b-f377-4388-91d0-f4453a2adfb8 req-2a8b3a2d-3b66-416c-a494-93fa3c554174 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6afa82cf-9ed5-4a0e-a0c9-643178807f3b", "name": "network-vif-plugged", "status": "completed", "tag": "df439229-0722-49ee-a7a8-0163e1f46372"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:54:02.135899 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2853700b-f377-4388-91d0-f4453a2adfb8 req-2a8b3a2d-3b66-416c-a494-93fa3c554174 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:54:02.136389 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2853700b-f377-4388-91d0-f4453a2adfb8 req-2a8b3a2d-3b66-416c-a494-93fa3c554174 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:54:02.136830 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2853700b-f377-4388-91d0-f4453a2adfb8 req-2a8b3a2d-3b66-416c-a494-93fa3c554174 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:54:02.148085 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-2853700b-f377-4388-91d0-f4453a2adfb8 req-2a8b3a2d-3b66-416c-a494-93fa3c554174 service nova] Creating event network-vif-plugged:df439229-0722-49ee-a7a8-0163e1f46372 for instance 6afa82cf-9ed5-4a0e-a0c9-643178807f3b on n-h2-862686-1 Oct 26 13:54:02.153351 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-2853700b-f377-4388-91d0-f4453a2adfb8 req-2a8b3a2d-3b66-416c-a494-93fa3c554174 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032254 Oct 26 13:54:02.154002 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3442/6907] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:54:02.321076 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-573d306e-dc74-4247-b0d0-81442d74a99a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:54:02.321745 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-573d306e-dc74-4247-b0d0-81442d74a99a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 6afa82cf-9ed5-4a0e-a0c9-643178807f3b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:54:02.328755 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-573d306e-dc74-4247-b0d0-81442d74a99a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:54:02.329253 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-573d306e-dc74-4247-b0d0-81442d74a99a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:54:02.329732 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-573d306e-dc74-4247-b0d0-81442d74a99a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:54:02.330446 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-573d306e-dc74-4247-b0d0-81442d74a99a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:54:02.330917 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-573d306e-dc74-4247-b0d0-81442d74a99a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:54:02.331355 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-573d306e-dc74-4247-b0d0-81442d74a99a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:54:02.467451 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-573d306e-dc74-4247-b0d0-81442d74a99a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:54:02.475259 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-573d306e-dc74-4247-b0d0-81442d74a99a tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b" status: 200 len: 1266 microversion: 2.1 time: 0.158231 Oct 26 13:54:02.475831 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3466/6908] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:54:02 2022] GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:54:03.501024 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-10930d14-0519-42c9-802e-9756a880cd8f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:54:03.501770 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-10930d14-0519-42c9-802e-9756a880cd8f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 6afa82cf-9ed5-4a0e-a0c9-643178807f3b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:54:03.508088 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-10930d14-0519-42c9-802e-9756a880cd8f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:54:03.509695 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-10930d14-0519-42c9-802e-9756a880cd8f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:54:03.510143 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-10930d14-0519-42c9-802e-9756a880cd8f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:54:03.510843 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-10930d14-0519-42c9-802e-9756a880cd8f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:54:03.511915 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-10930d14-0519-42c9-802e-9756a880cd8f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:54:03.512352 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-10930d14-0519-42c9-802e-9756a880cd8f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:54:03.657347 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-10930d14-0519-42c9-802e-9756a880cd8f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:54:03.665798 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-10930d14-0519-42c9-802e-9756a880cd8f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b" status: 200 len: 1266 microversion: 2.1 time: 0.169895 Oct 26 13:54:03.666373 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3443/6909] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:54:03 2022] GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:54:04.688916 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e161b49e-0091-4ead-8f9e-3c5a4e31c939 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:54:04.689578 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e161b49e-0091-4ead-8f9e-3c5a4e31c939 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 6afa82cf-9ed5-4a0e-a0c9-643178807f3b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:54:04.697091 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e161b49e-0091-4ead-8f9e-3c5a4e31c939 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:54:04.697650 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e161b49e-0091-4ead-8f9e-3c5a4e31c939 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:54:04.698106 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e161b49e-0091-4ead-8f9e-3c5a4e31c939 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:54:04.698823 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e161b49e-0091-4ead-8f9e-3c5a4e31c939 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:54:04.699298 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e161b49e-0091-4ead-8f9e-3c5a4e31c939 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:54:04.699746 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e161b49e-0091-4ead-8f9e-3c5a4e31c939 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:54:04.829609 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e161b49e-0091-4ead-8f9e-3c5a4e31c939 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:54:04.837956 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e161b49e-0091-4ead-8f9e-3c5a4e31c939 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b" status: 200 len: 1454 microversion: 2.1 time: 0.153176 Oct 26 13:54:04.838539 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3467/6910] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:54:04 2022] GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:54:04.860711 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d32e796e-0b6f-45e5-90aa-504a612af2db tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:54:04.861458 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d32e796e-0b6f-45e5-90aa-504a612af2db tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 6afa82cf-9ed5-4a0e-a0c9-643178807f3b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:54:04.869833 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d32e796e-0b6f-45e5-90aa-504a612af2db tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:54:04.870326 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d32e796e-0b6f-45e5-90aa-504a612af2db tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:54:04.870772 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d32e796e-0b6f-45e5-90aa-504a612af2db tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:54:04.871473 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d32e796e-0b6f-45e5-90aa-504a612af2db tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:54:04.871931 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d32e796e-0b6f-45e5-90aa-504a612af2db tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:54:04.872360 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d32e796e-0b6f-45e5-90aa-504a612af2db tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:54:05.002787 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d32e796e-0b6f-45e5-90aa-504a612af2db tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:54:05.011351 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d32e796e-0b6f-45e5-90aa-504a612af2db tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b" status: 200 len: 1454 microversion: 2.1 time: 0.154578 Oct 26 13:54:05.011934 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3444/6911] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:54:04 2022] GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:54:06.603778 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-85047ccf-d7fe-4291-b7cb-cd7d4f43bbf0 req-baeabfa4-0a32-48ca-9f0f-6ad406cc8eb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6afa82cf-9ed5-4a0e-a0c9-643178807f3b", "tag": "df439229-0722-49ee-a7a8-0163e1f46372"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:54:06.614916 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-85047ccf-d7fe-4291-b7cb-cd7d4f43bbf0 req-baeabfa4-0a32-48ca-9f0f-6ad406cc8eb9 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:54:06.615401 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-85047ccf-d7fe-4291-b7cb-cd7d4f43bbf0 req-baeabfa4-0a32-48ca-9f0f-6ad406cc8eb9 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:54:06.615840 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-85047ccf-d7fe-4291-b7cb-cd7d4f43bbf0 req-baeabfa4-0a32-48ca-9f0f-6ad406cc8eb9 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:54:06.627043 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-85047ccf-d7fe-4291-b7cb-cd7d4f43bbf0 req-baeabfa4-0a32-48ca-9f0f-6ad406cc8eb9 service nova] Creating event network-changed:df439229-0722-49ee-a7a8-0163e1f46372 for instance 6afa82cf-9ed5-4a0e-a0c9-643178807f3b on n-h2-862686-1 Oct 26 13:54:06.632284 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-85047ccf-d7fe-4291-b7cb-cd7d4f43bbf0 req-baeabfa4-0a32-48ca-9f0f-6ad406cc8eb9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032277 Oct 26 13:54:06.632896 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3468/6912] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:55:46.722325 n-d-862686-1 devstack@n-api.service[120598]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bbf40942-d6c8-479f-a0f4-15bbba6fd52c] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 26 13:55:46.724662 n-d-862686-1 devstack@n-api.service[120598]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b813bc1f-3720-4149-820f-44a58aef8a8e] AMQP server on 10.222.0.40:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 26 13:55:46.725142 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-954a119d-85a6-4567-8d5e-6279b65129ff tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:55:46.725691 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:55:46.725806 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-954a119d-85a6-4567-8d5e-6279b65129ff tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 6afa82cf-9ed5-4a0e-a0c9-643178807f3b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:55:46.726293 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=60 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:55:46.727148 n-d-862686-1 devstack@n-api.service[120598]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 13:55:46.727498 n-d-862686-1 devstack@n-api.service[120598]: Wed Oct 26 13:55:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.40) !!! Oct 26 13:55:46.733282 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=24 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:55:46.734363 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=56 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:55:46.735344 n-d-862686-1 devstack@n-api.service[120597]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 13:55:46.735523 n-d-862686-1 devstack@n-api.service[120597]: Wed Oct 26 13:55:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b (ip 10.222.0.40) !!! Oct 26 13:55:46.736438 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-cfa198b2-f4e6-410c-bf90-400f74ccb04f req-d0b9f1b1-e7b9-494e-aa90-a2d349204ffa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6afa82cf-9ed5-4a0e-a0c9-643178807f3b", "tag": "df439229-0722-49ee-a7a8-0163e1f46372"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:55:46.751661 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-954a119d-85a6-4567-8d5e-6279b65129ff tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:55:46.752295 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-954a119d-85a6-4567-8d5e-6279b65129ff tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:55:46.752897 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-954a119d-85a6-4567-8d5e-6279b65129ff tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:55:46.753898 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-954a119d-85a6-4567-8d5e-6279b65129ff tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:55:46.754361 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-954a119d-85a6-4567-8d5e-6279b65129ff tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:55:46.754789 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-954a119d-85a6-4567-8d5e-6279b65129ff tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:55:46.757531 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-cfa198b2-f4e6-410c-bf90-400f74ccb04f req-d0b9f1b1-e7b9-494e-aa90-a2d349204ffa service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:55:46.757531 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-cfa198b2-f4e6-410c-bf90-400f74ccb04f req-d0b9f1b1-e7b9-494e-aa90-a2d349204ffa service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:55:46.757817 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-cfa198b2-f4e6-410c-bf90-400f74ccb04f req-d0b9f1b1-e7b9-494e-aa90-a2d349204ffa service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:55:46.770072 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-cfa198b2-f4e6-410c-bf90-400f74ccb04f req-d0b9f1b1-e7b9-494e-aa90-a2d349204ffa service nova] Creating event network-changed:df439229-0722-49ee-a7a8-0163e1f46372 for instance 6afa82cf-9ed5-4a0e-a0c9-643178807f3b on n-h2-862686-1 Oct 26 13:55:46.775349 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-cfa198b2-f4e6-410c-bf90-400f74ccb04f req-d0b9f1b1-e7b9-494e-aa90-a2d349204ffa service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054752 Oct 26 13:55:46.776202 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3469/6913] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:55:46.784481 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-954a119d-85a6-4567-8d5e-6279b65129ff tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 6afa82cf-9ed5-4a0e-a0c9-643178807f3b] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:55:46.890394 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-954a119d-85a6-4567-8d5e-6279b65129ff tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b" status: 204 len: 0 microversion: 2.1 time: 0.171911 Oct 26 13:55:46.892166 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3445/6914] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:55:46 2022] DELETE /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:55:46.901051 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0395fdd3-87df-4585-ac82-a1e6e5024394 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:55:46.902226 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0395fdd3-87df-4585-ac82-a1e6e5024394 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 6afa82cf-9ed5-4a0e-a0c9-643178807f3b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:55:46.912655 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0395fdd3-87df-4585-ac82-a1e6e5024394 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:55:46.913152 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0395fdd3-87df-4585-ac82-a1e6e5024394 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:55:46.913630 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0395fdd3-87df-4585-ac82-a1e6e5024394 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:55:46.914357 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0395fdd3-87df-4585-ac82-a1e6e5024394 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:55:46.914822 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0395fdd3-87df-4585-ac82-a1e6e5024394 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:55:46.915587 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0395fdd3-87df-4585-ac82-a1e6e5024394 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:55:47.054694 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0395fdd3-87df-4585-ac82-a1e6e5024394 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:55:47.063340 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0395fdd3-87df-4585-ac82-a1e6e5024394 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b" status: 200 len: 1578 microversion: 2.1 time: 0.166687 Oct 26 13:55:47.063961 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3470/6915] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:55:46 2022] GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:55:48.087942 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cc40ab4a-aa23-4105-8da3-9927be5710aa tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:55:48.088641 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cc40ab4a-aa23-4105-8da3-9927be5710aa tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 6afa82cf-9ed5-4a0e-a0c9-643178807f3b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:55:48.095851 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc40ab4a-aa23-4105-8da3-9927be5710aa tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:55:48.096336 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc40ab4a-aa23-4105-8da3-9927be5710aa tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:55:48.096805 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc40ab4a-aa23-4105-8da3-9927be5710aa tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:55:48.097546 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc40ab4a-aa23-4105-8da3-9927be5710aa tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:55:48.097997 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc40ab4a-aa23-4105-8da3-9927be5710aa tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:55:48.098423 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc40ab4a-aa23-4105-8da3-9927be5710aa tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:55:48.255790 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cc40ab4a-aa23-4105-8da3-9927be5710aa tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:55:48.264583 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cc40ab4a-aa23-4105-8da3-9927be5710aa tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b" status: 200 len: 1578 microversion: 2.1 time: 0.181124 Oct 26 13:55:48.265183 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3446/6916] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:55:48 2022] GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b => generated 1578 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:55:49.083712 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-af76631a-11aa-447b-9803-57cbc8450822 req-7e193911-1b0c-4c55-8084-5f69ad457ab7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6afa82cf-9ed5-4a0e-a0c9-643178807f3b", "name": "network-vif-deleted", "tag": "df439229-0722-49ee-a7a8-0163e1f46372"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:55:49.097712 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-af76631a-11aa-447b-9803-57cbc8450822 req-7e193911-1b0c-4c55-8084-5f69ad457ab7 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:55:49.098214 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-af76631a-11aa-447b-9803-57cbc8450822 req-7e193911-1b0c-4c55-8084-5f69ad457ab7 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:55:49.098654 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-af76631a-11aa-447b-9803-57cbc8450822 req-7e193911-1b0c-4c55-8084-5f69ad457ab7 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:55:49.112855 n-d-862686-1 devstack@n-api.service[120598]: INFO oslo.messaging._drivers.impl_rabbit [-] [b813bc1f-3720-4149-820f-44a58aef8a8e] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 33206. Oct 26 13:55:49.113614 n-d-862686-1 devstack@n-api.service[120598]: INFO oslo.messaging._drivers.impl_rabbit [-] [bbf40942-d6c8-479f-a0f4-15bbba6fd52c] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 33204. Oct 26 13:55:49.115488 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-af76631a-11aa-447b-9803-57cbc8450822 req-7e193911-1b0c-4c55-8084-5f69ad457ab7 service nova] Creating event network-vif-deleted:df439229-0722-49ee-a7a8-0163e1f46372 for instance 6afa82cf-9ed5-4a0e-a0c9-643178807f3b on n-h2-862686-1 Oct 26 13:55:49.122183 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-af76631a-11aa-447b-9803-57cbc8450822 req-7e193911-1b0c-4c55-8084-5f69ad457ab7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041126 Oct 26 13:55:49.122615 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3471/6917] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:55:49.287590 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cdea8a17-916d-4a1e-84af-d9a6f09eebea tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:55:49.288332 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cdea8a17-916d-4a1e-84af-d9a6f09eebea tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 6afa82cf-9ed5-4a0e-a0c9-643178807f3b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:55:49.295868 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cdea8a17-916d-4a1e-84af-d9a6f09eebea tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:55:49.296289 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cdea8a17-916d-4a1e-84af-d9a6f09eebea tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:55:49.296726 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cdea8a17-916d-4a1e-84af-d9a6f09eebea tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:55:49.297423 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cdea8a17-916d-4a1e-84af-d9a6f09eebea tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:55:49.297906 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cdea8a17-916d-4a1e-84af-d9a6f09eebea tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:55:49.298388 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cdea8a17-916d-4a1e-84af-d9a6f09eebea tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:55:49.363199 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cdea8a17-916d-4a1e-84af-d9a6f09eebea tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:55:49.376135 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cdea8a17-916d-4a1e-84af-d9a6f09eebea tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b" status: 200 len: 1226 microversion: 2.1 time: 0.092681 Oct 26 13:55:49.376725 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3447/6918] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:55:49 2022] GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:55:50.400847 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3b977eb3-18c4-45f0-9cd5-7c9e9cea9de3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:55:50.401583 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3b977eb3-18c4-45f0-9cd5-7c9e9cea9de3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 6afa82cf-9ed5-4a0e-a0c9-643178807f3b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:55:50.409251 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b977eb3-18c4-45f0-9cd5-7c9e9cea9de3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:55:50.409776 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b977eb3-18c4-45f0-9cd5-7c9e9cea9de3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:55:50.410226 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b977eb3-18c4-45f0-9cd5-7c9e9cea9de3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:55:50.410934 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b977eb3-18c4-45f0-9cd5-7c9e9cea9de3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:55:50.411397 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b977eb3-18c4-45f0-9cd5-7c9e9cea9de3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:55:50.411834 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b977eb3-18c4-45f0-9cd5-7c9e9cea9de3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:55:50.479200 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3b977eb3-18c4-45f0-9cd5-7c9e9cea9de3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:55:50.487863 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3b977eb3-18c4-45f0-9cd5-7c9e9cea9de3 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b" status: 200 len: 1226 microversion: 2.1 time: 0.092220 Oct 26 13:55:50.488457 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3472/6919] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:55:50 2022] GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:55:51.511951 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-734d5bc2-0622-41cf-8799-0f589f910dd5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:55:51.512565 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-734d5bc2-0622-41cf-8799-0f589f910dd5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 6afa82cf-9ed5-4a0e-a0c9-643178807f3b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:55:51.519763 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-734d5bc2-0622-41cf-8799-0f589f910dd5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:55:51.520266 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-734d5bc2-0622-41cf-8799-0f589f910dd5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:55:51.520711 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-734d5bc2-0622-41cf-8799-0f589f910dd5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:55:51.521426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-734d5bc2-0622-41cf-8799-0f589f910dd5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:55:51.521911 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-734d5bc2-0622-41cf-8799-0f589f910dd5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:55:51.522341 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-734d5bc2-0622-41cf-8799-0f589f910dd5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:55:51.589151 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-734d5bc2-0622-41cf-8799-0f589f910dd5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:55:51.597805 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-734d5bc2-0622-41cf-8799-0f589f910dd5 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b" status: 200 len: 1226 microversion: 2.1 time: 0.090389 Oct 26 13:55:51.598393 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3448/6920] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:55:51 2022] GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:55:52.623496 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-12cd7caa-8709-4ed9-b7d8-2e5601c9cf1f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:55:52.624134 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-12cd7caa-8709-4ed9-b7d8-2e5601c9cf1f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 6afa82cf-9ed5-4a0e-a0c9-643178807f3b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:55:52.631798 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-12cd7caa-8709-4ed9-b7d8-2e5601c9cf1f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:55:52.632386 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-12cd7caa-8709-4ed9-b7d8-2e5601c9cf1f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:55:52.632910 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-12cd7caa-8709-4ed9-b7d8-2e5601c9cf1f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:55:52.634236 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-12cd7caa-8709-4ed9-b7d8-2e5601c9cf1f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:55:52.634710 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-12cd7caa-8709-4ed9-b7d8-2e5601c9cf1f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:55:52.635156 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-12cd7caa-8709-4ed9-b7d8-2e5601c9cf1f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:55:52.699787 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-12cd7caa-8709-4ed9-b7d8-2e5601c9cf1f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:55:52.708045 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-12cd7caa-8709-4ed9-b7d8-2e5601c9cf1f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b" status: 200 len: 1226 microversion: 2.1 time: 0.091056 Oct 26 13:55:52.708625 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3473/6921] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:55:52 2022] GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:55:53.732481 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3272ee42-919a-4e78-8730-83daae30130b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:55:53.733091 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3272ee42-919a-4e78-8730-83daae30130b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 6afa82cf-9ed5-4a0e-a0c9-643178807f3b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:55:53.739497 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3272ee42-919a-4e78-8730-83daae30130b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:55:53.739986 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3272ee42-919a-4e78-8730-83daae30130b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:55:53.740493 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3272ee42-919a-4e78-8730-83daae30130b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:55:53.741236 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3272ee42-919a-4e78-8730-83daae30130b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:55:53.741846 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3272ee42-919a-4e78-8730-83daae30130b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:55:53.742291 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3272ee42-919a-4e78-8730-83daae30130b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:55:53.757002 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-3272ee42-919a-4e78-8730-83daae30130b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] HTTP exception thrown: Instance 6afa82cf-9ed5-4a0e-a0c9-643178807f3b could not be found. Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3272ee42-919a-4e78-8730-83daae30130b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Request method failure captured: Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b HTTP/1.1 Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTnApzC1uv7RYc2W5kY-bKNxAsuZUBfTmQjsjWgzUuX11tX2R8DM_Fw7sVvtXRV9882pAeMKhCsEaXlaTjkLCgPxZsqy0UGzQzulFtHD7rhQ8cnkvWXYr0SPAMtN1JLnqGya627Ln2uWIw1ej-ApXw_efP2G5pRjjzhMaFQwCWIvwTI Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 2a1602330aa340b890bac76a120f74e8 Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-TestVolumeBootPattern-608207068 Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2a1602330aa340b890bac76a120f74e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2a1602330aa340b890bac76a120f74e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2a1602330aa340b890bac76a120f74e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2a1602330aa340b890bac76a120f74e8"}]}] Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-TestVolumeBootPattern-608207068 Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 2a1602330aa340b890bac76a120f74e8 Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-TestVolumeBootPattern-608207068 Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-TestVolumeBootPattern-608207068-project Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: df8b67aae3ea4f17bfa684681311dec5 Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-TestVolumeBootPattern-608207068-project Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 6afa82cf-9ed5-4a0e-a0c9-643178807f3b could not be found. Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '6afa82cf-9ed5-4a0e-a0c9-643178807f3b'} Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6afa82cf-9ed5-4a0e-a0c9-643178807f3b could not be found. Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6afa82cf-9ed5-4a0e-a0c9-643178807f3b could not be found. Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:55:53.758732 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:55:53.763141 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:55:53.763141 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:55:53.763141 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:55:53.763141 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:55:53.763141 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:55:53.763141 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6afa82cf-9ed5-4a0e-a0c9-643178807f3b could not be found. Oct 26 13:55:53.763141 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:55:53.763141 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3272ee42-919a-4e78-8730-83daae30130b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Returning 404 to user: Instance 6afa82cf-9ed5-4a0e-a0c9-643178807f3b could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:55:53.763141 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3272ee42-919a-4e78-8730-83daae30130b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b" status: 404 len: 111 microversion: 2.1 time: 0.032126 Oct 26 13:55:53.763141 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3449/6922] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:55:53 2022] GET /compute/v2.1/servers/6afa82cf-9ed5-4a0e-a0c9-643178807f3b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:55:59.997210 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5c09de9f-a3c5-4182-9b44-6f7571a059be tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:55:59.997854 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5c09de9f-a3c5-4182-9b44-6f7571a059be tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 5702aa80-8d46-465d-9f15-2dd7964330b0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:56:00.005077 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c09de9f-a3c5-4182-9b44-6f7571a059be tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:00.005652 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c09de9f-a3c5-4182-9b44-6f7571a059be tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:00.006664 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c09de9f-a3c5-4182-9b44-6f7571a059be tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:00.006806 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c09de9f-a3c5-4182-9b44-6f7571a059be tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:00.007268 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c09de9f-a3c5-4182-9b44-6f7571a059be tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:00.007892 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c09de9f-a3c5-4182-9b44-6f7571a059be tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:00.035725 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5c09de9f-a3c5-4182-9b44-6f7571a059be tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 5702aa80-8d46-465d-9f15-2dd7964330b0] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:56:00.071177 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-efdf9848-8ef9-4413-bf6f-ca7fcb309519 req-3a09b5d2-8321-4f03-9fd7-8b7d8daa26f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5702aa80-8d46-465d-9f15-2dd7964330b0", "tag": "96ea7d25-1b9b-4405-b06e-0e3695e542f0"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:56:00.088964 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-efdf9848-8ef9-4413-bf6f-ca7fcb309519 req-3a09b5d2-8321-4f03-9fd7-8b7d8daa26f5 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:00.090814 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-efdf9848-8ef9-4413-bf6f-ca7fcb309519 req-3a09b5d2-8321-4f03-9fd7-8b7d8daa26f5 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:00.091355 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-efdf9848-8ef9-4413-bf6f-ca7fcb309519 req-3a09b5d2-8321-4f03-9fd7-8b7d8daa26f5 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:00.104008 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-efdf9848-8ef9-4413-bf6f-ca7fcb309519 req-3a09b5d2-8321-4f03-9fd7-8b7d8daa26f5 service nova] Creating event network-changed:96ea7d25-1b9b-4405-b06e-0e3695e542f0 for instance 5702aa80-8d46-465d-9f15-2dd7964330b0 on n-h1-862686-1 Oct 26 13:56:00.110570 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-efdf9848-8ef9-4413-bf6f-ca7fcb309519 req-3a09b5d2-8321-4f03-9fd7-8b7d8daa26f5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115362 Oct 26 13:56:00.111765 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3450/6923] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:56:00.128488 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5c09de9f-a3c5-4182-9b44-6f7571a059be tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0" status: 204 len: 0 microversion: 2.1 time: 0.135383 Oct 26 13:56:00.130472 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3474/6924] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:55:59 2022] DELETE /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:56:00.140790 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-244cf03d-11c3-47a7-b717-ccf3156bc406 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:56:00.141551 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-244cf03d-11c3-47a7-b717-ccf3156bc406 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 5702aa80-8d46-465d-9f15-2dd7964330b0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:56:00.148236 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-244cf03d-11c3-47a7-b717-ccf3156bc406 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:00.148731 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-244cf03d-11c3-47a7-b717-ccf3156bc406 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:00.149213 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-244cf03d-11c3-47a7-b717-ccf3156bc406 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:00.149993 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-244cf03d-11c3-47a7-b717-ccf3156bc406 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:00.150446 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-244cf03d-11c3-47a7-b717-ccf3156bc406 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:00.150879 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-244cf03d-11c3-47a7-b717-ccf3156bc406 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:00.295510 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-244cf03d-11c3-47a7-b717-ccf3156bc406 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:56:00.303378 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-244cf03d-11c3-47a7-b717-ccf3156bc406 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0" status: 200 len: 1578 microversion: 2.1 time: 0.168205 Oct 26 13:56:00.303962 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3451/6925] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:56:00 2022] GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0 => generated 1578 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:56:01.327764 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-38520078-92d3-43df-b4bf-ee10dee9dad1 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:56:01.330293 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-38520078-92d3-43df-b4bf-ee10dee9dad1 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 5702aa80-8d46-465d-9f15-2dd7964330b0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:56:01.337202 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38520078-92d3-43df-b4bf-ee10dee9dad1 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:01.337774 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38520078-92d3-43df-b4bf-ee10dee9dad1 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:01.338232 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38520078-92d3-43df-b4bf-ee10dee9dad1 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:01.338947 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38520078-92d3-43df-b4bf-ee10dee9dad1 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:01.339934 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38520078-92d3-43df-b4bf-ee10dee9dad1 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:01.340054 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38520078-92d3-43df-b4bf-ee10dee9dad1 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:01.529856 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-38520078-92d3-43df-b4bf-ee10dee9dad1 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:56:01.537869 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-38520078-92d3-43df-b4bf-ee10dee9dad1 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0" status: 200 len: 1578 microversion: 2.1 time: 0.214671 Oct 26 13:56:01.538445 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3475/6926] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:56:01 2022] GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0 => generated 1578 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:56:02.496941 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-8c314164-4890-465e-abfb-767a8c82d6b2 req-d6301647-bbe0-4eba-a47d-ee67a478b154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5702aa80-8d46-465d-9f15-2dd7964330b0", "name": "network-vif-deleted", "tag": "96ea7d25-1b9b-4405-b06e-0e3695e542f0"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:56:02.518019 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-8c314164-4890-465e-abfb-767a8c82d6b2 req-d6301647-bbe0-4eba-a47d-ee67a478b154 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:02.518562 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-8c314164-4890-465e-abfb-767a8c82d6b2 req-d6301647-bbe0-4eba-a47d-ee67a478b154 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:02.518950 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-8c314164-4890-465e-abfb-767a8c82d6b2 req-d6301647-bbe0-4eba-a47d-ee67a478b154 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:02.533941 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-8c314164-4890-465e-abfb-767a8c82d6b2 req-d6301647-bbe0-4eba-a47d-ee67a478b154 service nova] Creating event network-vif-deleted:96ea7d25-1b9b-4405-b06e-0e3695e542f0 for instance 5702aa80-8d46-465d-9f15-2dd7964330b0 on n-h1-862686-1 Oct 26 13:56:02.538987 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-8c314164-4890-465e-abfb-767a8c82d6b2 req-d6301647-bbe0-4eba-a47d-ee67a478b154 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046312 Oct 26 13:56:02.539625 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3452/6927] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:56:02.562533 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9a2306af-f50f-4de9-bc33-3230ed8af911 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:56:02.563171 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9a2306af-f50f-4de9-bc33-3230ed8af911 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 5702aa80-8d46-465d-9f15-2dd7964330b0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:56:02.570232 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a2306af-f50f-4de9-bc33-3230ed8af911 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:02.570738 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a2306af-f50f-4de9-bc33-3230ed8af911 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:02.571193 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a2306af-f50f-4de9-bc33-3230ed8af911 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:02.571903 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a2306af-f50f-4de9-bc33-3230ed8af911 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:02.572378 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a2306af-f50f-4de9-bc33-3230ed8af911 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:02.572823 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a2306af-f50f-4de9-bc33-3230ed8af911 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:02.638826 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9a2306af-f50f-4de9-bc33-3230ed8af911 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:56:02.651145 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9a2306af-f50f-4de9-bc33-3230ed8af911 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0" status: 200 len: 1226 microversion: 2.1 time: 0.092865 Oct 26 13:56:02.652319 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3476/6928] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:56:02 2022] GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:56:03.676690 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c721a0f4-d0fe-4755-86b1-ad0fc4ef44af tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:56:03.677440 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c721a0f4-d0fe-4755-86b1-ad0fc4ef44af tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 5702aa80-8d46-465d-9f15-2dd7964330b0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:56:03.683946 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c721a0f4-d0fe-4755-86b1-ad0fc4ef44af tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:03.684462 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c721a0f4-d0fe-4755-86b1-ad0fc4ef44af tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:03.684904 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c721a0f4-d0fe-4755-86b1-ad0fc4ef44af tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:03.685627 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c721a0f4-d0fe-4755-86b1-ad0fc4ef44af tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:03.686085 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c721a0f4-d0fe-4755-86b1-ad0fc4ef44af tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:03.686507 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c721a0f4-d0fe-4755-86b1-ad0fc4ef44af tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:03.750510 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c721a0f4-d0fe-4755-86b1-ad0fc4ef44af tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:56:03.758458 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c721a0f4-d0fe-4755-86b1-ad0fc4ef44af tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0" status: 200 len: 1226 microversion: 2.1 time: 0.087451 Oct 26 13:56:03.759039 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3453/6929] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:56:03 2022] GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:56:04.782253 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5b26fc46-14c6-44f9-9dfe-98c2af13e771 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:56:04.783033 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5b26fc46-14c6-44f9-9dfe-98c2af13e771 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 5702aa80-8d46-465d-9f15-2dd7964330b0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:56:04.790375 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b26fc46-14c6-44f9-9dfe-98c2af13e771 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:04.790875 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b26fc46-14c6-44f9-9dfe-98c2af13e771 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:04.791326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b26fc46-14c6-44f9-9dfe-98c2af13e771 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:04.792046 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b26fc46-14c6-44f9-9dfe-98c2af13e771 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:04.792892 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b26fc46-14c6-44f9-9dfe-98c2af13e771 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:04.793183 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b26fc46-14c6-44f9-9dfe-98c2af13e771 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:04.863606 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5b26fc46-14c6-44f9-9dfe-98c2af13e771 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:56:04.872584 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5b26fc46-14c6-44f9-9dfe-98c2af13e771 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0" status: 200 len: 1226 microversion: 2.1 time: 0.094221 Oct 26 13:56:04.873274 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3477/6930] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:56:04 2022] GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:56:05.896191 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-49f56bad-9130-4334-9eb2-0e52ed2dfa9b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:56:05.896861 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-49f56bad-9130-4334-9eb2-0e52ed2dfa9b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 5702aa80-8d46-465d-9f15-2dd7964330b0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:56:05.904629 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49f56bad-9130-4334-9eb2-0e52ed2dfa9b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:05.905120 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49f56bad-9130-4334-9eb2-0e52ed2dfa9b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:05.905580 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49f56bad-9130-4334-9eb2-0e52ed2dfa9b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:05.906284 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49f56bad-9130-4334-9eb2-0e52ed2dfa9b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:05.906740 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49f56bad-9130-4334-9eb2-0e52ed2dfa9b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:05.907168 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49f56bad-9130-4334-9eb2-0e52ed2dfa9b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:05.970375 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-49f56bad-9130-4334-9eb2-0e52ed2dfa9b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:56:05.978315 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-49f56bad-9130-4334-9eb2-0e52ed2dfa9b tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0" status: 200 len: 1226 microversion: 2.1 time: 0.086138 Oct 26 13:56:05.978891 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3454/6931] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:56:05 2022] GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:56:07.001460 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1a064b60-26d6-4560-91c9-d8b9b255ef25 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:56:07.002156 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1a064b60-26d6-4560-91c9-d8b9b255ef25 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 5702aa80-8d46-465d-9f15-2dd7964330b0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:56:07.010102 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a064b60-26d6-4560-91c9-d8b9b255ef25 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:07.010612 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a064b60-26d6-4560-91c9-d8b9b255ef25 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:07.011069 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a064b60-26d6-4560-91c9-d8b9b255ef25 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:07.011935 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a064b60-26d6-4560-91c9-d8b9b255ef25 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:07.012569 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a064b60-26d6-4560-91c9-d8b9b255ef25 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:07.013269 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a064b60-26d6-4560-91c9-d8b9b255ef25 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:07.051660 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a064b60-26d6-4560-91c9-d8b9b255ef25 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:07.052163 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a064b60-26d6-4560-91c9-d8b9b255ef25 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:07.052615 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a064b60-26d6-4560-91c9-d8b9b255ef25 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:07.053075 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-1a064b60-26d6-4560-91c9-d8b9b255ef25 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lazy-loading 'fault' on Instance uuid 5702aa80-8d46-465d-9f15-2dd7964330b0 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:56:07.097328 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1a064b60-26d6-4560-91c9-d8b9b255ef25 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8b67aae3ea4f17bfa684681311dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1602330aa340b890bac76a120f74e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:56:07.106077 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1a064b60-26d6-4560-91c9-d8b9b255ef25 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0" status: 200 len: 1231 microversion: 2.1 time: 0.108507 Oct 26 13:56:07.106680 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3478/6932] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:56:06 2022] GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0 => generated 1231 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:56:08.130185 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9fafee2d-dbd0-441b-92ed-ea7cef85f4ac tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:56:08.130741 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9fafee2d-dbd0-441b-92ed-ea7cef85f4ac tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: 5702aa80-8d46-465d-9f15-2dd7964330b0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:56:08.137784 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9fafee2d-dbd0-441b-92ed-ea7cef85f4ac tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:08.138276 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9fafee2d-dbd0-441b-92ed-ea7cef85f4ac tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:08.138722 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9fafee2d-dbd0-441b-92ed-ea7cef85f4ac tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:08.139422 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9fafee2d-dbd0-441b-92ed-ea7cef85f4ac tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:08.139886 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9fafee2d-dbd0-441b-92ed-ea7cef85f4ac tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:08.140319 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9fafee2d-dbd0-441b-92ed-ea7cef85f4ac tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:08.153694 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-9fafee2d-dbd0-441b-92ed-ea7cef85f4ac tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] HTTP exception thrown: Instance 5702aa80-8d46-465d-9f15-2dd7964330b0 could not be found. Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9fafee2d-dbd0-441b-92ed-ea7cef85f4ac tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Request method failure captured: Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0 HTTP/1.1 Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTnApzC1uv7RYc2W5kY-bKNxAsuZUBfTmQjsjWgzUuX11tX2R8DM_Fw7sVvtXRV9882pAeMKhCsEaXlaTjkLCgPxZsqy0UGzQzulFtHD7rhQ8cnkvWXYr0SPAMtN1JLnqGya627Ln2uWIw1ej-ApXw_efP2G5pRjjzhMaFQwCWIvwTI Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 2a1602330aa340b890bac76a120f74e8 Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-TestVolumeBootPattern-608207068 Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2a1602330aa340b890bac76a120f74e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2a1602330aa340b890bac76a120f74e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2a1602330aa340b890bac76a120f74e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2a1602330aa340b890bac76a120f74e8"}]}] Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-TestVolumeBootPattern-608207068 Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 2a1602330aa340b890bac76a120f74e8 Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-TestVolumeBootPattern-608207068 Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-TestVolumeBootPattern-608207068-project Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: df8b67aae3ea4f17bfa684681311dec5 Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-TestVolumeBootPattern-608207068-project Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 5702aa80-8d46-465d-9f15-2dd7964330b0 could not be found. Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '5702aa80-8d46-465d-9f15-2dd7964330b0'} Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5702aa80-8d46-465d-9f15-2dd7964330b0 could not be found. Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5702aa80-8d46-465d-9f15-2dd7964330b0 could not be found. Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:56:08.155392 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:56:08.159859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:56:08.159859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:56:08.159859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:56:08.159859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:56:08.159859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:56:08.159859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5702aa80-8d46-465d-9f15-2dd7964330b0 could not be found. Oct 26 13:56:08.159859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:56:08.159859 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9fafee2d-dbd0-441b-92ed-ea7cef85f4ac tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Returning 404 to user: Instance 5702aa80-8d46-465d-9f15-2dd7964330b0 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:56:08.159859 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9fafee2d-dbd0-441b-92ed-ea7cef85f4ac tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0" status: 404 len: 111 microversion: 2.1 time: 0.030715 Oct 26 13:56:08.159859 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3455/6933] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:56:08 2022] GET /compute/v2.1/servers/5702aa80-8d46-465d-9f15-2dd7964330b0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:56:08.610963 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-63f35b0a-78d1-41e0-8f92-70dcfc8ad7b2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:56:08.611479 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-63f35b0a-78d1-41e0-8f92-70dcfc8ad7b2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: b0226ba0-3c5e-4f29-8e6e-55bd62d754f1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:56:08.618354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63f35b0a-78d1-41e0-8f92-70dcfc8ad7b2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:08.618847 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63f35b0a-78d1-41e0-8f92-70dcfc8ad7b2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:08.619296 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63f35b0a-78d1-41e0-8f92-70dcfc8ad7b2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:08.619993 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63f35b0a-78d1-41e0-8f92-70dcfc8ad7b2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:08.620942 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63f35b0a-78d1-41e0-8f92-70dcfc8ad7b2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:08.621392 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63f35b0a-78d1-41e0-8f92-70dcfc8ad7b2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:08.634615 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-63f35b0a-78d1-41e0-8f92-70dcfc8ad7b2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] HTTP exception thrown: Instance b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 could not be found. Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-63f35b0a-78d1-41e0-8f92-70dcfc8ad7b2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Request method failure captured: Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: request: DELETE /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 HTTP/1.1 Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTnApzC1uv7RYc2W5kY-bKNxAsuZUBfTmQjsjWgzUuX11tX2R8DM_Fw7sVvtXRV9882pAeMKhCsEaXlaTjkLCgPxZsqy0UGzQzulFtHD7rhQ8cnkvWXYr0SPAMtN1JLnqGya627Ln2uWIw1ej-ApXw_efP2G5pRjjzhMaFQwCWIvwTI Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 2a1602330aa340b890bac76a120f74e8 Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-TestVolumeBootPattern-608207068 Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2a1602330aa340b890bac76a120f74e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2a1602330aa340b890bac76a120f74e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2a1602330aa340b890bac76a120f74e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2a1602330aa340b890bac76a120f74e8"}]}] Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-TestVolumeBootPattern-608207068 Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 2a1602330aa340b890bac76a120f74e8 Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-TestVolumeBootPattern-608207068 Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-TestVolumeBootPattern-608207068-project Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: df8b67aae3ea4f17bfa684681311dec5 Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-TestVolumeBootPattern-608207068-project Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 could not be found. Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'b0226ba0-3c5e-4f29-8e6e-55bd62d754f1'} Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 could not be found. Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:56:08.637245 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:56:08.641949 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 could not be found. Oct 26 13:56:08.641949 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:56:08.641949 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:56:08.641949 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:56:08.641949 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:56:08.641949 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:56:08.641949 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:56:08.641949 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:56:08.641949 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:56:08.641949 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 could not be found. Oct 26 13:56:08.641949 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:56:08.641949 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-63f35b0a-78d1-41e0-8f92-70dcfc8ad7b2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Returning 404 to user: Instance b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:56:08.641949 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-63f35b0a-78d1-41e0-8f92-70dcfc8ad7b2 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1" status: 404 len: 111 microversion: 2.1 time: 0.031753 Oct 26 13:56:08.641949 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3479/6934] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:56:08 2022] DELETE /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:56:08.647360 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2ec3a41a-0d00-4ce5-9a57-e45076f87142 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:56:08.647978 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2ec3a41a-0d00-4ce5-9a57-e45076f87142 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] [instance: b0226ba0-3c5e-4f29-8e6e-55bd62d754f1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:56:08.654739 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ec3a41a-0d00-4ce5-9a57-e45076f87142 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:08.655232 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ec3a41a-0d00-4ce5-9a57-e45076f87142 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:08.655681 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ec3a41a-0d00-4ce5-9a57-e45076f87142 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:08.656377 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ec3a41a-0d00-4ce5-9a57-e45076f87142 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:08.656839 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ec3a41a-0d00-4ce5-9a57-e45076f87142 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:08.657322 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ec3a41a-0d00-4ce5-9a57-e45076f87142 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:08.674652 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-2ec3a41a-0d00-4ce5-9a57-e45076f87142 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] HTTP exception thrown: Instance b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 could not be found. Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2ec3a41a-0d00-4ce5-9a57-e45076f87142 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Request method failure captured: Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 HTTP/1.1 Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTnApzC1uv7RYc2W5kY-bKNxAsuZUBfTmQjsjWgzUuX11tX2R8DM_Fw7sVvtXRV9882pAeMKhCsEaXlaTjkLCgPxZsqy0UGzQzulFtHD7rhQ8cnkvWXYr0SPAMtN1JLnqGya627Ln2uWIw1ej-ApXw_efP2G5pRjjzhMaFQwCWIvwTI Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 2a1602330aa340b890bac76a120f74e8 Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-TestVolumeBootPattern-608207068 Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2a1602330aa340b890bac76a120f74e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2a1602330aa340b890bac76a120f74e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2a1602330aa340b890bac76a120f74e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2a1602330aa340b890bac76a120f74e8"}]}] Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-TestVolumeBootPattern-608207068 Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 2a1602330aa340b890bac76a120f74e8 Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-TestVolumeBootPattern-608207068 Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-TestVolumeBootPattern-608207068-project Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: df8b67aae3ea4f17bfa684681311dec5 Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-TestVolumeBootPattern-608207068-project Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 could not be found. Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'b0226ba0-3c5e-4f29-8e6e-55bd62d754f1'} Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 could not be found. Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 could not be found. Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:56:08.676205 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:56:08.680804 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:56:08.680804 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:56:08.680804 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:56:08.680804 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:56:08.680804 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:56:08.680804 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 could not be found. Oct 26 13:56:08.680804 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:56:08.680804 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2ec3a41a-0d00-4ce5-9a57-e45076f87142 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Returning 404 to user: Instance b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:56:08.680804 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2ec3a41a-0d00-4ce5-9a57-e45076f87142 tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1" status: 404 len: 111 microversion: 2.1 time: 0.034165 Oct 26 13:56:08.680804 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3456/6935] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:56:08 2022] GET /compute/v2.1/servers/b0226ba0-3c5e-4f29-8e6e-55bd62d754f1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:56:12.103493 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b177e0bd-0adf-4e4f-94b9-ca5c4cd8d25f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] Calling method '.version_select at 0x7f67324d23a0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:56:12.132549 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b177e0bd-0adf-4e4f-94b9-ca5c4cd8d25f tempest-TestVolumeBootPattern-608207068 tempest-TestVolumeBootPattern-608207068-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1766855477" status: 202 len: 0 microversion: 2.1 time: 0.033234 Oct 26 13:56:12.133063 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3480/6936] 10.222.0.40 () {58 vars in 1263 bytes} [Wed Oct 26 13:56:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1766855477 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:56:30.790597 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:56:30.791347 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:56:30.905632 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f8a752cb-f158-4d5d-8d42-4fdd5d4c4c02 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-143696469", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:56:30.961005 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-f8a752cb-f158-4d5d-8d42-4fdd5d4c4c02 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] validate_networks() for None {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:56:31.146134 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-f8a752cb-f158-4d5d-8d42-4fdd5d4c4c02 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:56:31.146559 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-f8a752cb-f158-4d5d-8d42-4fdd5d4c4c02 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:56:31.147031 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-f8a752cb-f158-4d5d-8d42-4fdd5d4c4c02 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:56:31.147469 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-f8a752cb-f158-4d5d-8d42-4fdd5d4c4c02 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:56:31.147879 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-f8a752cb-f158-4d5d-8d42-4fdd5d4c4c02 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:56:31.157140 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f8a752cb-f158-4d5d-8d42-4fdd5d4c4c02 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:31.157663 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f8a752cb-f158-4d5d-8d42-4fdd5d4c4c02 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:31.158105 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f8a752cb-f158-4d5d-8d42-4fdd5d4c4c02 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:31.159089 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f8a752cb-f158-4d5d-8d42-4fdd5d4c4c02 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:31.159549 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f8a752cb-f158-4d5d-8d42-4fdd5d4c4c02 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:31.159979 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f8a752cb-f158-4d5d-8d42-4fdd5d4c4c02 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:31.177112 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-f8a752cb-f158-4d5d-8d42-4fdd5d4c4c02 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Getting quotas for project 8a17f61718664cc6b1dd8e93297f8330. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:56:31.182361 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-f8a752cb-f158-4d5d-8d42-4fdd5d4c4c02 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Getting quotas for user 6f87eb1c04f9402c8f2c3bc25f2cd4eb and project 8a17f61718664cc6b1dd8e93297f8330. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:56:31.195017 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f8a752cb-f158-4d5d-8d42-4fdd5d4c4c02 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:56:31.197293 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f8a752cb-f158-4d5d-8d42-4fdd5d4c4c02 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] [instance: a1f2c668-5e24-4d40-9453-ba50a8fcfbdc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:56:31.242484 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f8a752cb-f158-4d5d-8d42-4fdd5d4c4c02 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.456986 Oct 26 13:56:31.243189 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3457/6937] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:56:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 458 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:56:31.254442 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:56:31.255460 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:56:31.262823 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cd16c7a6-351e-4c93-85b7-921dc4497ff1 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:56:31.263973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cd16c7a6-351e-4c93-85b7-921dc4497ff1 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] [instance: a1f2c668-5e24-4d40-9453-ba50a8fcfbdc] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:56:31.322726 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-cd16c7a6-351e-4c93-85b7-921dc4497ff1 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f87eb1c04f9402c8f2c3bc25f2cd4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a17f61718664cc6b1dd8e93297f8330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:56:31.330264 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cd16c7a6-351e-4c93-85b7-921dc4497ff1 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] 10.222.0.40 "GET /compute/v2.1/servers/a1f2c668-5e24-4d40-9453-ba50a8fcfbdc" status: 200 len: 1221 microversion: 2.1 time: 0.077756 Oct 26 13:56:31.330829 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3481/6938] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:56:31 2022] GET /compute/v2.1/servers/a1f2c668-5e24-4d40-9453-ba50a8fcfbdc => generated 1221 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:56:32.354602 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a95a3ec3-f01e-411a-865c-288c07394ed6 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:56:32.356448 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a95a3ec3-f01e-411a-865c-288c07394ed6 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] [instance: a1f2c668-5e24-4d40-9453-ba50a8fcfbdc] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:56:32.363540 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a95a3ec3-f01e-411a-865c-288c07394ed6 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:32.364038 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a95a3ec3-f01e-411a-865c-288c07394ed6 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:32.364488 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a95a3ec3-f01e-411a-865c-288c07394ed6 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:32.365206 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a95a3ec3-f01e-411a-865c-288c07394ed6 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:32.365701 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a95a3ec3-f01e-411a-865c-288c07394ed6 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:32.366134 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a95a3ec3-f01e-411a-865c-288c07394ed6 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:32.439383 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a95a3ec3-f01e-411a-865c-288c07394ed6 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f87eb1c04f9402c8f2c3bc25f2cd4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a17f61718664cc6b1dd8e93297f8330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:56:32.447489 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a95a3ec3-f01e-411a-865c-288c07394ed6 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] 10.222.0.40 "GET /compute/v2.1/servers/a1f2c668-5e24-4d40-9453-ba50a8fcfbdc" status: 200 len: 1281 microversion: 2.1 time: 0.097634 Oct 26 13:56:32.448591 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3458/6939] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:56:32 2022] GET /compute/v2.1/servers/a1f2c668-5e24-4d40-9453-ba50a8fcfbdc => generated 1281 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:56:33.471706 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-810c07dd-31ae-4db5-a5bb-aca7ff875f29 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:56:33.472262 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-810c07dd-31ae-4db5-a5bb-aca7ff875f29 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] [instance: a1f2c668-5e24-4d40-9453-ba50a8fcfbdc] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:56:33.479055 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-810c07dd-31ae-4db5-a5bb-aca7ff875f29 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:33.479548 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-810c07dd-31ae-4db5-a5bb-aca7ff875f29 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:33.480007 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-810c07dd-31ae-4db5-a5bb-aca7ff875f29 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:33.480748 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-810c07dd-31ae-4db5-a5bb-aca7ff875f29 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:33.481218 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-810c07dd-31ae-4db5-a5bb-aca7ff875f29 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:33.481881 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-810c07dd-31ae-4db5-a5bb-aca7ff875f29 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:33.698838 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-810c07dd-31ae-4db5-a5bb-aca7ff875f29 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f87eb1c04f9402c8f2c3bc25f2cd4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a17f61718664cc6b1dd8e93297f8330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:56:33.707290 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-810c07dd-31ae-4db5-a5bb-aca7ff875f29 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] 10.222.0.40 "GET /compute/v2.1/servers/a1f2c668-5e24-4d40-9453-ba50a8fcfbdc" status: 200 len: 1321 microversion: 2.1 time: 0.239719 Oct 26 13:56:33.707883 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3482/6940] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:56:33 2022] GET /compute/v2.1/servers/a1f2c668-5e24-4d40-9453-ba50a8fcfbdc => generated 1321 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:56:33.922621 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-808b45cb-fb72-450a-98d3-d1eb586c0012 req-326c9474-8973-4b97-8cf0-381b3ee2782c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1f2c668-5e24-4d40-9453-ba50a8fcfbdc", "tag": "ad1264dc-a528-4ca5-bbae-bee297c8f25f"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:56:33.933362 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-808b45cb-fb72-450a-98d3-d1eb586c0012 req-326c9474-8973-4b97-8cf0-381b3ee2782c service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:33.934351 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-808b45cb-fb72-450a-98d3-d1eb586c0012 req-326c9474-8973-4b97-8cf0-381b3ee2782c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:33.934351 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-808b45cb-fb72-450a-98d3-d1eb586c0012 req-326c9474-8973-4b97-8cf0-381b3ee2782c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:33.947005 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-808b45cb-fb72-450a-98d3-d1eb586c0012 req-326c9474-8973-4b97-8cf0-381b3ee2782c service nova] Creating event network-changed:ad1264dc-a528-4ca5-bbae-bee297c8f25f for instance a1f2c668-5e24-4d40-9453-ba50a8fcfbdc on n-h2-862686-1 Oct 26 13:56:33.951866 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-808b45cb-fb72-450a-98d3-d1eb586c0012 req-326c9474-8973-4b97-8cf0-381b3ee2782c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033663 Oct 26 13:56:33.952483 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3459/6941] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:56:34.731516 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8d7a42fe-8dc7-4325-bbe2-3808025462e4 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:56:34.732131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8d7a42fe-8dc7-4325-bbe2-3808025462e4 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] [instance: a1f2c668-5e24-4d40-9453-ba50a8fcfbdc] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:56:34.738987 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d7a42fe-8dc7-4325-bbe2-3808025462e4 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:34.739478 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d7a42fe-8dc7-4325-bbe2-3808025462e4 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:34.739921 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d7a42fe-8dc7-4325-bbe2-3808025462e4 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:34.740620 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d7a42fe-8dc7-4325-bbe2-3808025462e4 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:34.741113 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d7a42fe-8dc7-4325-bbe2-3808025462e4 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:34.741573 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d7a42fe-8dc7-4325-bbe2-3808025462e4 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:34.879840 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8d7a42fe-8dc7-4325-bbe2-3808025462e4 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f87eb1c04f9402c8f2c3bc25f2cd4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a17f61718664cc6b1dd8e93297f8330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:56:34.887688 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8d7a42fe-8dc7-4325-bbe2-3808025462e4 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] 10.222.0.40 "GET /compute/v2.1/servers/a1f2c668-5e24-4d40-9453-ba50a8fcfbdc" status: 200 len: 1321 microversion: 2.1 time: 0.160413 Oct 26 13:56:34.888255 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3483/6942] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:56:34 2022] GET /compute/v2.1/servers/a1f2c668-5e24-4d40-9453-ba50a8fcfbdc => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:56:35.912122 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-148569c4-44cf-4eb2-92a2-3017f50824c1 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:56:35.912821 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-148569c4-44cf-4eb2-92a2-3017f50824c1 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] [instance: a1f2c668-5e24-4d40-9453-ba50a8fcfbdc] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:56:35.919521 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-148569c4-44cf-4eb2-92a2-3017f50824c1 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:35.920005 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-148569c4-44cf-4eb2-92a2-3017f50824c1 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:35.920510 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-148569c4-44cf-4eb2-92a2-3017f50824c1 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:35.921202 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-148569c4-44cf-4eb2-92a2-3017f50824c1 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:35.921699 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-148569c4-44cf-4eb2-92a2-3017f50824c1 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:35.922130 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-148569c4-44cf-4eb2-92a2-3017f50824c1 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:36.051902 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-148569c4-44cf-4eb2-92a2-3017f50824c1 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f87eb1c04f9402c8f2c3bc25f2cd4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a17f61718664cc6b1dd8e93297f8330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:56:36.060241 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-148569c4-44cf-4eb2-92a2-3017f50824c1 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] 10.222.0.40 "GET /compute/v2.1/servers/a1f2c668-5e24-4d40-9453-ba50a8fcfbdc" status: 200 len: 1321 microversion: 2.1 time: 0.153489 Oct 26 13:56:36.060841 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3460/6943] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:56:35 2022] GET /compute/v2.1/servers/a1f2c668-5e24-4d40-9453-ba50a8fcfbdc => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:56:37.083062 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4c38270d-d2e6-4daa-97e4-45eb995b38fe tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:56:37.083631 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4c38270d-d2e6-4daa-97e4-45eb995b38fe tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] [instance: a1f2c668-5e24-4d40-9453-ba50a8fcfbdc] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:56:37.090723 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c38270d-d2e6-4daa-97e4-45eb995b38fe tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:37.091236 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c38270d-d2e6-4daa-97e4-45eb995b38fe tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:37.091692 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c38270d-d2e6-4daa-97e4-45eb995b38fe tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:37.092411 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c38270d-d2e6-4daa-97e4-45eb995b38fe tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:37.092889 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c38270d-d2e6-4daa-97e4-45eb995b38fe tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:37.093339 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c38270d-d2e6-4daa-97e4-45eb995b38fe tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:37.222240 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4c38270d-d2e6-4daa-97e4-45eb995b38fe tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f87eb1c04f9402c8f2c3bc25f2cd4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a17f61718664cc6b1dd8e93297f8330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:56:37.230022 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4c38270d-d2e6-4daa-97e4-45eb995b38fe tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] 10.222.0.40 "GET /compute/v2.1/servers/a1f2c668-5e24-4d40-9453-ba50a8fcfbdc" status: 200 len: 1321 microversion: 2.1 time: 0.151013 Oct 26 13:56:37.230600 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3484/6944] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:56:37 2022] GET /compute/v2.1/servers/a1f2c668-5e24-4d40-9453-ba50a8fcfbdc => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:56:38.254366 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-03947483-e258-49ca-80ef-85c5d92e5db6 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:56:38.254929 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-03947483-e258-49ca-80ef-85c5d92e5db6 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] [instance: a1f2c668-5e24-4d40-9453-ba50a8fcfbdc] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:56:38.261649 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03947483-e258-49ca-80ef-85c5d92e5db6 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:38.262131 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03947483-e258-49ca-80ef-85c5d92e5db6 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:38.263775 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03947483-e258-49ca-80ef-85c5d92e5db6 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:38.264474 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03947483-e258-49ca-80ef-85c5d92e5db6 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:38.264933 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03947483-e258-49ca-80ef-85c5d92e5db6 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:38.265360 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03947483-e258-49ca-80ef-85c5d92e5db6 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:38.399484 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-03947483-e258-49ca-80ef-85c5d92e5db6 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f87eb1c04f9402c8f2c3bc25f2cd4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a17f61718664cc6b1dd8e93297f8330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:56:38.407442 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-03947483-e258-49ca-80ef-85c5d92e5db6 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] 10.222.0.40 "GET /compute/v2.1/servers/a1f2c668-5e24-4d40-9453-ba50a8fcfbdc" status: 200 len: 1321 microversion: 2.1 time: 0.157043 Oct 26 13:56:38.408009 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3461/6945] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:56:38 2022] GET /compute/v2.1/servers/a1f2c668-5e24-4d40-9453-ba50a8fcfbdc => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:56:39.042248 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-39b6d334-0c8c-40ad-bf3f-15f33541ad99 req-dcc2a39c-4a9c-428d-aff4-1bf7c3e18bb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1f2c668-5e24-4d40-9453-ba50a8fcfbdc", "name": "network-vif-plugged", "status": "completed", "tag": "ad1264dc-a528-4ca5-bbae-bee297c8f25f"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:56:39.052944 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-39b6d334-0c8c-40ad-bf3f-15f33541ad99 req-dcc2a39c-4a9c-428d-aff4-1bf7c3e18bb1 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:39.053377 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-39b6d334-0c8c-40ad-bf3f-15f33541ad99 req-dcc2a39c-4a9c-428d-aff4-1bf7c3e18bb1 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:39.053869 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-39b6d334-0c8c-40ad-bf3f-15f33541ad99 req-dcc2a39c-4a9c-428d-aff4-1bf7c3e18bb1 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:39.064918 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-39b6d334-0c8c-40ad-bf3f-15f33541ad99 req-dcc2a39c-4a9c-428d-aff4-1bf7c3e18bb1 service nova] Creating event network-vif-plugged:ad1264dc-a528-4ca5-bbae-bee297c8f25f for instance a1f2c668-5e24-4d40-9453-ba50a8fcfbdc on n-h2-862686-1 Oct 26 13:56:39.069971 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-39b6d334-0c8c-40ad-bf3f-15f33541ad99 req-dcc2a39c-4a9c-428d-aff4-1bf7c3e18bb1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101446 Oct 26 13:56:39.070558 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3485/6946] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:56:39.430766 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-91754b5d-0280-48b5-8dfe-b88de6654480 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:56:39.431352 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-91754b5d-0280-48b5-8dfe-b88de6654480 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] [instance: a1f2c668-5e24-4d40-9453-ba50a8fcfbdc] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:56:39.438346 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91754b5d-0280-48b5-8dfe-b88de6654480 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:39.438832 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91754b5d-0280-48b5-8dfe-b88de6654480 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:39.439271 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91754b5d-0280-48b5-8dfe-b88de6654480 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:39.439958 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91754b5d-0280-48b5-8dfe-b88de6654480 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:39.440414 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91754b5d-0280-48b5-8dfe-b88de6654480 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:39.440842 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91754b5d-0280-48b5-8dfe-b88de6654480 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:39.570291 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-91754b5d-0280-48b5-8dfe-b88de6654480 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f87eb1c04f9402c8f2c3bc25f2cd4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a17f61718664cc6b1dd8e93297f8330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:56:39.578697 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-91754b5d-0280-48b5-8dfe-b88de6654480 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] 10.222.0.40 "GET /compute/v2.1/servers/a1f2c668-5e24-4d40-9453-ba50a8fcfbdc" status: 200 len: 1321 microversion: 2.1 time: 0.151979 Oct 26 13:56:39.579275 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3462/6947] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:56:39 2022] GET /compute/v2.1/servers/a1f2c668-5e24-4d40-9453-ba50a8fcfbdc => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:56:40.603712 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2db41761-c6fb-4b10-af12-306d180859ce tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:56:40.604426 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2db41761-c6fb-4b10-af12-306d180859ce tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] [instance: a1f2c668-5e24-4d40-9453-ba50a8fcfbdc] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:56:40.611524 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2db41761-c6fb-4b10-af12-306d180859ce tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:40.612028 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2db41761-c6fb-4b10-af12-306d180859ce tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:40.612485 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2db41761-c6fb-4b10-af12-306d180859ce tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:40.613191 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2db41761-c6fb-4b10-af12-306d180859ce tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:40.613716 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2db41761-c6fb-4b10-af12-306d180859ce tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:40.614161 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2db41761-c6fb-4b10-af12-306d180859ce tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:40.746971 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2db41761-c6fb-4b10-af12-306d180859ce tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f87eb1c04f9402c8f2c3bc25f2cd4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a17f61718664cc6b1dd8e93297f8330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:56:40.754712 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2db41761-c6fb-4b10-af12-306d180859ce tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] 10.222.0.40 "GET /compute/v2.1/servers/a1f2c668-5e24-4d40-9453-ba50a8fcfbdc" status: 200 len: 1470 microversion: 2.1 time: 0.156398 Oct 26 13:56:40.755463 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3486/6948] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:56:40 2022] GET /compute/v2.1/servers/a1f2c668-5e24-4d40-9453-ba50a8fcfbdc => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:56:40.829258 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5a87ba34-246a-45ab-8499-09941f2d3da0 tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] Calling method '.version_select at 0x7f67311f3700>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:56:40.896653 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5a87ba34-246a-45ab-8499-09941f2d3da0 tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/d1f4d0f060c74e37b9f8a065d3e4ddbb" status: 200 len: 371 microversion: 2.1 time: 0.120747 Oct 26 13:56:40.897231 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3463/6949] 10.222.0.40 () {58 vars in 1242 bytes} [Wed Oct 26 13:56:40 2022] GET /compute/v2.1/os-quota-sets/d1f4d0f060c74e37b9f8a065d3e4ddbb => generated 371 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:56:40.910515 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f61c194c-1553-49be-963d-1ef265e89c42 tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1443076115", "id": 1031218858, "os-flavor-access:is_public": "True"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:56:40.928473 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f61c194c-1553-49be-963d-1ef265e89c42 tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.022022 Oct 26 13:56:40.929042 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3487/6950] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:56:40 2022] POST /compute/v2.1/flavors => generated 438 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:56:40.942324 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a27d4e4b-df14-400e-a163-7cb36b70ee38 tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1031218858"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:56:40.944606 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a27d4e4b-df14-400e-a163-7cb36b70ee38 tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] [instance: a1f2c668-5e24-4d40-9453-ba50a8fcfbdc] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:56:40.950673 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a27d4e4b-df14-400e-a163-7cb36b70ee38 tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:40.951153 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a27d4e4b-df14-400e-a163-7cb36b70ee38 tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:40.951590 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a27d4e4b-df14-400e-a163-7cb36b70ee38 tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:40.952287 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a27d4e4b-df14-400e-a163-7cb36b70ee38 tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:40.952742 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a27d4e4b-df14-400e-a163-7cb36b70ee38 tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:40.953169 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a27d4e4b-df14-400e-a163-7cb36b70ee38 tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:41.139954 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a27d4e4b-df14-400e-a163-7cb36b70ee38 tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'abf0b252d4494ba29d9c2503aaa15636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f4d0f060c74e37b9f8a065d3e4ddbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:56:41.146111 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a27d4e4b-df14-400e-a163-7cb36b70ee38 tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] [instance: a1f2c668-5e24-4d40-9453-ba50a8fcfbdc] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1443076115 {{(pid=120597) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 26 13:56:41.152685 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a27d4e4b-df14-400e-a163-7cb36b70ee38 tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:41.153922 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a27d4e4b-df14-400e-a163-7cb36b70ee38 tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:41.154431 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a27d4e4b-df14-400e-a163-7cb36b70ee38 tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:41.155150 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a27d4e4b-df14-400e-a163-7cb36b70ee38 tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:41.155602 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a27d4e4b-df14-400e-a163-7cb36b70ee38 tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:41.156026 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a27d4e4b-df14-400e-a163-7cb36b70ee38 tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:41.177899 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-a27d4e4b-df14-400e-a163-7cb36b70ee38 tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] Getting quotas for project 8a17f61718664cc6b1dd8e93297f8330. Resources: {'cores', 'ram'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:56:41.182879 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-a27d4e4b-df14-400e-a163-7cb36b70ee38 tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] Getting quotas for user 6f87eb1c04f9402c8f2c3bc25f2cd4eb and project 8a17f61718664cc6b1dd8e93297f8330. Resources: {'cores', 'ram'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:56:41.197908 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.compute.api [None req-a27d4e4b-df14-400e-a163-7cb36b70ee38 tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] ram quota exceeded for d1f4d0f060c74e37b9f8a065d3e4ddbb, tried to resize instance. Oct 26 13:56:41.198449 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-a27d4e4b-df14-400e-a163-7cb36b70ee38 tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a27d4e4b-df14-400e-a163-7cb36b70ee38 tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] Request method failure captured: Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/servers/a1f2c668-5e24-4d40-9453-ba50a8fcfbdc/action HTTP/1.1 Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 39 Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTyOw3KGBVdkX2BO9haQd3uJn5ncvBio7KyZ8arSfSFbp3DvTLQYRUKrI57Zl4ivR_Tj79Mlnzu3VwMKsxixAMH7CgG9j-IufuNC7z-ByF-EYX1swoY81LzL51bs5CiNIM8tbIMbstvch7xJqyZKsbbcvzZT87OIo3qFAINe_7zUAp0 Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: d1f4d0f060c74e37b9f8a065d3e4ddbb Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1629161057 Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: X-Role: admin,member,reader Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: admin,member,reader Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d1f4d0f060c74e37b9f8a065d3e4ddbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d1f4d0f060c74e37b9f8a065d3e4ddbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d1f4d0f060c74e37b9f8a065d3e4ddbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d1f4d0f060c74e37b9f8a065d3e4ddbb"}]}] Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1629161057 Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: d1f4d0f060c74e37b9f8a065d3e4ddbb Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1629161057 Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersAdminNegativeTestJSON-1629161057-project-admin Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: abf0b252d4494ba29d9c2503aaa15636 Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1629161057-project-admin Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: {"resize": {"flavorRef": "1031218858"}} Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'a1f2c668-5e24-4d40-9453-ba50a8fcfbdc', 'body': {'resize': {'flavorRef': '1031218858'}}} Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 13:56:41.201277 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 26 13:56:41.205326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 26 13:56:41.205326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 26 13:56:41.205326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 26 13:56:41.205326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 26 13:56:41.205326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 13:56:41.205326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 26 13:56:41.205326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 26 13:56:41.205326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 26 13:56:41.205326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 13:56:41.205326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 26 13:56:41.205326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 26 13:56:41.205326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 26 13:56:41.205326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 26 13:56:41.205326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 26 13:56:41.205326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:56:41.205326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:56:41.205326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:56:41.205326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:56:41.205326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:56:41.205326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:56:41.205326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:56:41.205326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:56:41.205326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:56:41.205326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:56:41.205326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:56:41.205326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:56:41.205326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 26 13:56:41.205326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 26 13:56:41.205326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 26 13:56:41.205326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 26 13:56:41.205326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 26 13:56:41.205326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:56:41.205326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:56:41.205326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:56:41.205326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:56:41.205326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:56:41.205326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:56:41.205326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:56:41.205326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:56:41.205326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 26 13:56:41.205326 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:56:41.205326 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a27d4e4b-df14-400e-a163-7cb36b70ee38 tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:56:41.205326 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a27d4e4b-df14-400e-a163-7cb36b70ee38 tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/a1f2c668-5e24-4d40-9453-ba50a8fcfbdc/action" status: 403 len: 118 microversion: 2.1 time: 0.264420 Oct 26 13:56:41.205326 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3464/6951] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:56:40 2022] POST /compute/v2.1/servers/a1f2c668-5e24-4d40-9453-ba50a8fcfbdc/action => generated 118 bytes in 266 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:56:41.211541 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e11d09ea-7a9e-454e-993f-961798ddb1af tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:56:41.228149 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e11d09ea-7a9e-454e-993f-961798ddb1af tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1031218858" status: 202 len: 0 microversion: 2.1 time: 0.020300 Oct 26 13:56:41.228707 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3488/6952] 10.222.0.40 () {58 vars in 1161 bytes} [Wed Oct 26 13:56:41 2022] DELETE /compute/v2.1/flavors/1031218858 => generated 0 bytes in 21 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:56:41.236696 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2027ba76-0a77-4108-bfd3-5bb32f54a37a tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:56:41.257403 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2027ba76-0a77-4108-bfd3-5bb32f54a37a tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024348 Oct 26 13:56:41.258013 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3465/6953] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:56:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:56:41.279589 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9773c6ba-9ac6-441d-b8d3-e75e1b5ae8a1 tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] Calling method '.version_select at 0x7f6731911f70>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:56:41.327330 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:56:41.350677 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9773c6ba-9ac6-441d-b8d3-e75e1b5ae8a1 tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/d1f4d0f060c74e37b9f8a065d3e4ddbb" status: 200 len: 371 microversion: 2.1 time: 0.075424 Oct 26 13:56:41.351267 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3489/6954] 10.222.0.40 () {58 vars in 1242 bytes} [Wed Oct 26 13:56:41 2022] GET /compute/v2.1/os-quota-sets/d1f4d0f060c74e37b9f8a065d3e4ddbb => generated 371 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:56:41.363074 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f1725c4c-319d-41e7-8784-8b8bc9ec43f2 tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1652537429", "id": 1745416538, "os-flavor-access:is_public": "True"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:56:41.380918 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f1725c4c-319d-41e7-8784-8b8bc9ec43f2 tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.021450 Oct 26 13:56:41.381438 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3466/6955] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:56:41 2022] POST /compute/v2.1/flavors => generated 437 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:56:41.394609 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-faaa4964-9f17-4c8b-b48c-59d6e9deb0ff tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1745416538"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:56:41.397013 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-faaa4964-9f17-4c8b-b48c-59d6e9deb0ff tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] [instance: a1f2c668-5e24-4d40-9453-ba50a8fcfbdc] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:56:41.403013 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-faaa4964-9f17-4c8b-b48c-59d6e9deb0ff tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:41.403511 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-faaa4964-9f17-4c8b-b48c-59d6e9deb0ff tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:41.403964 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-faaa4964-9f17-4c8b-b48c-59d6e9deb0ff tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:41.404702 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-faaa4964-9f17-4c8b-b48c-59d6e9deb0ff tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:41.405171 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-faaa4964-9f17-4c8b-b48c-59d6e9deb0ff tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:41.405648 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-faaa4964-9f17-4c8b-b48c-59d6e9deb0ff tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:41.544990 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-faaa4964-9f17-4c8b-b48c-59d6e9deb0ff tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'abf0b252d4494ba29d9c2503aaa15636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f4d0f060c74e37b9f8a065d3e4ddbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:56:41.551186 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-faaa4964-9f17-4c8b-b48c-59d6e9deb0ff tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] [instance: a1f2c668-5e24-4d40-9453-ba50a8fcfbdc] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1652537429 {{(pid=120598) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 26 13:56:41.557746 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-faaa4964-9f17-4c8b-b48c-59d6e9deb0ff tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:41.558237 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-faaa4964-9f17-4c8b-b48c-59d6e9deb0ff tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:41.558706 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-faaa4964-9f17-4c8b-b48c-59d6e9deb0ff tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:41.560036 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-faaa4964-9f17-4c8b-b48c-59d6e9deb0ff tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:41.560498 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-faaa4964-9f17-4c8b-b48c-59d6e9deb0ff tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:41.560972 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-faaa4964-9f17-4c8b-b48c-59d6e9deb0ff tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:41.581538 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-faaa4964-9f17-4c8b-b48c-59d6e9deb0ff tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] Getting quotas for project 8a17f61718664cc6b1dd8e93297f8330. Resources: {'cores', 'ram'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:56:41.586556 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-faaa4964-9f17-4c8b-b48c-59d6e9deb0ff tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] Getting quotas for user 6f87eb1c04f9402c8f2c3bc25f2cd4eb and project 8a17f61718664cc6b1dd8e93297f8330. Resources: {'cores', 'ram'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:56:41.598361 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.compute.api [None req-faaa4964-9f17-4c8b-b48c-59d6e9deb0ff tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] cores quota exceeded for d1f4d0f060c74e37b9f8a065d3e4ddbb, tried to resize instance. Oct 26 13:56:41.598912 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-faaa4964-9f17-4c8b-b48c-59d6e9deb0ff tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-faaa4964-9f17-4c8b-b48c-59d6e9deb0ff tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] Request method failure captured: Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/servers/a1f2c668-5e24-4d40-9453-ba50a8fcfbdc/action HTTP/1.1 Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 39 Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTyOw3KGBVdkX2BO9haQd3uJn5ncvBio7KyZ8arSfSFbp3DvTLQYRUKrI57Zl4ivR_Tj79Mlnzu3VwMKsxixAMH7CgG9j-IufuNC7z-ByF-EYX1swoY81LzL51bs5CiNIM8tbIMbstvch7xJqyZKsbbcvzZT87OIo3qFAINe_7zUAp0 Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: d1f4d0f060c74e37b9f8a065d3e4ddbb Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1629161057 Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: X-Role: admin,member,reader Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: admin,member,reader Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d1f4d0f060c74e37b9f8a065d3e4ddbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d1f4d0f060c74e37b9f8a065d3e4ddbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d1f4d0f060c74e37b9f8a065d3e4ddbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d1f4d0f060c74e37b9f8a065d3e4ddbb"}]}] Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1629161057 Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: d1f4d0f060c74e37b9f8a065d3e4ddbb Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1629161057 Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersAdminNegativeTestJSON-1629161057-project-admin Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: abf0b252d4494ba29d9c2503aaa15636 Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1629161057-project-admin Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: {"resize": {"flavorRef": "1745416538"}} Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'a1f2c668-5e24-4d40-9453-ba50a8fcfbdc', 'body': {'resize': {'flavorRef': '1745416538'}}} Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 13:56:41.600972 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 26 13:56:41.605859 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 26 13:56:41.605859 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 26 13:56:41.605859 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 26 13:56:41.605859 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 26 13:56:41.605859 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 13:56:41.605859 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 26 13:56:41.605859 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 26 13:56:41.605859 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 26 13:56:41.605859 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 13:56:41.605859 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 26 13:56:41.605859 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 26 13:56:41.605859 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 26 13:56:41.605859 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 26 13:56:41.605859 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 26 13:56:41.605859 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:56:41.605859 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:56:41.605859 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:56:41.605859 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:56:41.605859 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:56:41.605859 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:56:41.605859 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:56:41.605859 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:56:41.605859 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:56:41.605859 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:56:41.605859 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 13:56:41.605859 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 13:56:41.605859 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 26 13:56:41.605859 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 26 13:56:41.605859 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 26 13:56:41.605859 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 26 13:56:41.605859 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 26 13:56:41.605859 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:56:41.605859 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:56:41.605859 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:56:41.605859 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:56:41.605859 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:56:41.605859 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:56:41.605859 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:56:41.605859 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:56:41.605859 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 26 13:56:41.605859 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:56:41.605859 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-faaa4964-9f17-4c8b-b48c-59d6e9deb0ff tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:56:41.605859 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-faaa4964-9f17-4c8b-b48c-59d6e9deb0ff tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/a1f2c668-5e24-4d40-9453-ba50a8fcfbdc/action" status: 403 len: 113 microversion: 2.1 time: 0.211813 Oct 26 13:56:41.605859 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3490/6956] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:56:41 2022] POST /compute/v2.1/servers/a1f2c668-5e24-4d40-9453-ba50a8fcfbdc/action => generated 113 bytes in 213 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:56:41.612087 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1a793677-c829-40ff-a38f-f88684c4f3c0 tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:56:41.629121 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1a793677-c829-40ff-a38f-f88684c4f3c0 tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1745416538" status: 202 len: 0 microversion: 2.1 time: 0.020796 Oct 26 13:56:41.629722 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3467/6957] 10.222.0.40 () {58 vars in 1161 bytes} [Wed Oct 26 13:56:41 2022] DELETE /compute/v2.1/flavors/1745416538 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:56:41.637883 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6161f418-e14a-4172-9f01-0b7799bb3ff8 tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:56:41.661107 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6161f418-e14a-4172-9f01-0b7799bb3ff8 tempest-ServersAdminNegativeTestJSON-1629161057 tempest-ServersAdminNegativeTestJSON-1629161057-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027035 Oct 26 13:56:41.662327 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3491/6958] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 26 13:56:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:56:41.683147 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0734aab7-e5e2-4e2d-ab00-51ddf1307a05 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:56:41.683653 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0734aab7-e5e2-4e2d-ab00-51ddf1307a05 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] [instance: a1f2c668-5e24-4d40-9453-ba50a8fcfbdc] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:56:41.690398 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0734aab7-e5e2-4e2d-ab00-51ddf1307a05 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:41.690885 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0734aab7-e5e2-4e2d-ab00-51ddf1307a05 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:41.691325 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0734aab7-e5e2-4e2d-ab00-51ddf1307a05 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:41.692045 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0734aab7-e5e2-4e2d-ab00-51ddf1307a05 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:41.692504 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0734aab7-e5e2-4e2d-ab00-51ddf1307a05 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:41.692941 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0734aab7-e5e2-4e2d-ab00-51ddf1307a05 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:41.717951 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0734aab7-e5e2-4e2d-ab00-51ddf1307a05 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] [instance: a1f2c668-5e24-4d40-9453-ba50a8fcfbdc] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:56:41.792680 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0734aab7-e5e2-4e2d-ab00-51ddf1307a05 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a1f2c668-5e24-4d40-9453-ba50a8fcfbdc" status: 204 len: 0 microversion: 2.1 time: 0.113271 Oct 26 13:56:41.793275 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3468/6959] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:56:41 2022] DELETE /compute/v2.1/servers/a1f2c668-5e24-4d40-9453-ba50a8fcfbdc => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:56:41.803261 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6de57d9a-53a4-405c-952b-7ca3f73c77aa tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:56:41.803886 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6de57d9a-53a4-405c-952b-7ca3f73c77aa tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] [instance: a1f2c668-5e24-4d40-9453-ba50a8fcfbdc] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:56:41.810555 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6de57d9a-53a4-405c-952b-7ca3f73c77aa tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:41.811048 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6de57d9a-53a4-405c-952b-7ca3f73c77aa tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:41.811498 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6de57d9a-53a4-405c-952b-7ca3f73c77aa tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:41.812201 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6de57d9a-53a4-405c-952b-7ca3f73c77aa tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:41.812666 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6de57d9a-53a4-405c-952b-7ca3f73c77aa tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:41.813101 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6de57d9a-53a4-405c-952b-7ca3f73c77aa tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:41.946470 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6de57d9a-53a4-405c-952b-7ca3f73c77aa tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f87eb1c04f9402c8f2c3bc25f2cd4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a17f61718664cc6b1dd8e93297f8330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:56:41.954400 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6de57d9a-53a4-405c-952b-7ca3f73c77aa tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] 10.222.0.40 "GET /compute/v2.1/servers/a1f2c668-5e24-4d40-9453-ba50a8fcfbdc" status: 200 len: 1476 microversion: 2.1 time: 0.155971 Oct 26 13:56:41.954974 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3492/6960] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:56:41 2022] GET /compute/v2.1/servers/a1f2c668-5e24-4d40-9453-ba50a8fcfbdc => generated 1476 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:56:42.977744 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3ca3bd8c-4fc0-4177-b44a-0d48153e3e05 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:56:42.978453 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3ca3bd8c-4fc0-4177-b44a-0d48153e3e05 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] [instance: a1f2c668-5e24-4d40-9453-ba50a8fcfbdc] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:56:42.986291 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3ca3bd8c-4fc0-4177-b44a-0d48153e3e05 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:42.986782 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3ca3bd8c-4fc0-4177-b44a-0d48153e3e05 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:42.987235 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3ca3bd8c-4fc0-4177-b44a-0d48153e3e05 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:42.987937 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3ca3bd8c-4fc0-4177-b44a-0d48153e3e05 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:42.988399 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3ca3bd8c-4fc0-4177-b44a-0d48153e3e05 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:42.988831 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3ca3bd8c-4fc0-4177-b44a-0d48153e3e05 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:43.116986 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3ca3bd8c-4fc0-4177-b44a-0d48153e3e05 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f87eb1c04f9402c8f2c3bc25f2cd4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a17f61718664cc6b1dd8e93297f8330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:56:43.125576 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3ca3bd8c-4fc0-4177-b44a-0d48153e3e05 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] 10.222.0.40 "GET /compute/v2.1/servers/a1f2c668-5e24-4d40-9453-ba50a8fcfbdc" status: 200 len: 1476 microversion: 2.1 time: 0.152138 Oct 26 13:56:43.126163 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3469/6961] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:56:42 2022] GET /compute/v2.1/servers/a1f2c668-5e24-4d40-9453-ba50a8fcfbdc => generated 1476 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:56:43.639484 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-ad7a9241-773b-4e2c-8717-8d8ddaef513d req-d45d06ed-245f-475b-ba90-f821447f6088 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1f2c668-5e24-4d40-9453-ba50a8fcfbdc", "name": "network-vif-deleted", "tag": "ad1264dc-a528-4ca5-bbae-bee297c8f25f"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:56:43.651242 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ad7a9241-773b-4e2c-8717-8d8ddaef513d req-d45d06ed-245f-475b-ba90-f821447f6088 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:43.651742 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ad7a9241-773b-4e2c-8717-8d8ddaef513d req-d45d06ed-245f-475b-ba90-f821447f6088 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:43.652186 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ad7a9241-773b-4e2c-8717-8d8ddaef513d req-d45d06ed-245f-475b-ba90-f821447f6088 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:43.672444 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-ad7a9241-773b-4e2c-8717-8d8ddaef513d req-d45d06ed-245f-475b-ba90-f821447f6088 service nova] Creating event network-vif-deleted:ad1264dc-a528-4ca5-bbae-bee297c8f25f for instance a1f2c668-5e24-4d40-9453-ba50a8fcfbdc on n-h2-862686-1 Oct 26 13:56:43.678685 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-ad7a9241-773b-4e2c-8717-8d8ddaef513d req-d45d06ed-245f-475b-ba90-f821447f6088 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043059 Oct 26 13:56:43.680356 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3493/6962] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:56:44.149449 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9a57109a-2433-4445-bdcb-e2042f9a2f3a tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:56:44.150086 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9a57109a-2433-4445-bdcb-e2042f9a2f3a tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] [instance: a1f2c668-5e24-4d40-9453-ba50a8fcfbdc] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:56:44.157617 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9a57109a-2433-4445-bdcb-e2042f9a2f3a tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:44.158113 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9a57109a-2433-4445-bdcb-e2042f9a2f3a tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:44.158808 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9a57109a-2433-4445-bdcb-e2042f9a2f3a tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:44.159522 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9a57109a-2433-4445-bdcb-e2042f9a2f3a tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:44.160021 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9a57109a-2433-4445-bdcb-e2042f9a2f3a tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:44.160456 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9a57109a-2433-4445-bdcb-e2042f9a2f3a tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:44.196002 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9a57109a-2433-4445-bdcb-e2042f9a2f3a tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:44.196490 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9a57109a-2433-4445-bdcb-e2042f9a2f3a tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:44.196957 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9a57109a-2433-4445-bdcb-e2042f9a2f3a tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:44.197407 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-9a57109a-2433-4445-bdcb-e2042f9a2f3a tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lazy-loading 'fault' on Instance uuid a1f2c668-5e24-4d40-9453-ba50a8fcfbdc {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 13:56:44.245279 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9a57109a-2433-4445-bdcb-e2042f9a2f3a tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f87eb1c04f9402c8f2c3bc25f2cd4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a17f61718664cc6b1dd8e93297f8330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:56:44.254628 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9a57109a-2433-4445-bdcb-e2042f9a2f3a tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] 10.222.0.40 "GET /compute/v2.1/servers/a1f2c668-5e24-4d40-9453-ba50a8fcfbdc" status: 200 len: 1311 microversion: 2.1 time: 0.109014 Oct 26 13:56:44.255982 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3470/6963] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:56:44 2022] GET /compute/v2.1/servers/a1f2c668-5e24-4d40-9453-ba50a8fcfbdc => generated 1311 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:56:45.281918 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6aa4cea0-5221-41f0-af7d-3387fc26a188 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:56:45.282634 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6aa4cea0-5221-41f0-af7d-3387fc26a188 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] [instance: a1f2c668-5e24-4d40-9453-ba50a8fcfbdc] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:56:45.290227 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6aa4cea0-5221-41f0-af7d-3387fc26a188 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:45.290734 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6aa4cea0-5221-41f0-af7d-3387fc26a188 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:45.291179 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6aa4cea0-5221-41f0-af7d-3387fc26a188 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:45.291890 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6aa4cea0-5221-41f0-af7d-3387fc26a188 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:45.292354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6aa4cea0-5221-41f0-af7d-3387fc26a188 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:45.292801 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6aa4cea0-5221-41f0-af7d-3387fc26a188 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:45.307517 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-6aa4cea0-5221-41f0-af7d-3387fc26a188 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] HTTP exception thrown: Instance a1f2c668-5e24-4d40-9453-ba50a8fcfbdc could not be found. Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6aa4cea0-5221-41f0-af7d-3387fc26a188 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Request method failure captured: Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/a1f2c668-5e24-4d40-9453-ba50a8fcfbdc HTTP/1.1 Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTyO1i9eP8SRdb5UyPjw6xroN2ZuHKuNwEL-VY21G-eMCHenCGXHfDT45F2ZoPNrMiuA4_qDAotz8KgzhpnTsSx8MeJgJUaO5KvXV4eHPtaglJj_A9biZgCc7FZhYXOCFX99zcAB0Dlh5nWiDi7ifhWGG0Sy8rJddpS0e1Dpjszvlc0 Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 8a17f61718664cc6b1dd8e93297f8330 Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-421165822 Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8a17f61718664cc6b1dd8e93297f8330"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8a17f61718664cc6b1dd8e93297f8330"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8a17f61718664cc6b1dd8e93297f8330"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8a17f61718664cc6b1dd8e93297f8330"}]}] Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersAdminNegativeTestJSON-421165822 Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 8a17f61718664cc6b1dd8e93297f8330 Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-421165822 Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersAdminNegativeTestJSON-421165822-project Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 6f87eb1c04f9402c8f2c3bc25f2cd4eb Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersAdminNegativeTestJSON-421165822-project Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance a1f2c668-5e24-4d40-9453-ba50a8fcfbdc could not be found. Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'a1f2c668-5e24-4d40-9453-ba50a8fcfbdc'} Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1f2c668-5e24-4d40-9453-ba50a8fcfbdc could not be found. Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1f2c668-5e24-4d40-9453-ba50a8fcfbdc could not be found. Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:56:45.310459 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:56:45.315177 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:56:45.315177 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:56:45.315177 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:56:45.315177 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:56:45.315177 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:56:45.315177 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:56:45.315177 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1f2c668-5e24-4d40-9453-ba50a8fcfbdc could not be found. Oct 26 13:56:45.315177 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:56:45.315177 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6aa4cea0-5221-41f0-af7d-3387fc26a188 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] Returning 404 to user: Instance a1f2c668-5e24-4d40-9453-ba50a8fcfbdc could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:56:45.315177 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6aa4cea0-5221-41f0-af7d-3387fc26a188 tempest-ServersAdminNegativeTestJSON-421165822 tempest-ServersAdminNegativeTestJSON-421165822-project] 10.222.0.40 "GET /compute/v2.1/servers/a1f2c668-5e24-4d40-9453-ba50a8fcfbdc" status: 404 len: 111 microversion: 2.1 time: 0.034922 Oct 26 13:56:45.315177 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3494/6964] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:56:45 2022] GET /compute/v2.1/servers/a1f2c668-5e24-4d40-9453-ba50a8fcfbdc => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:56:51.434663 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=8 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:56:51.436729 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=5 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:56:51.550696 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-176ec72b-1d23-4d56-86cb-863851f9052e tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1714180958", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "6c145e4a-7b5c-40b0-8a16-ee6fd2ca774c"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:56:51.603786 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-176ec72b-1d23-4d56-86cb-863851f9052e tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] validate_networks() for [('6c145e4a-7b5c-40b0-8a16-ee6fd2ca774c', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:56:51.977307 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-176ec72b-1d23-4d56-86cb-863851f9052e tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:56:51.977756 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-176ec72b-1d23-4d56-86cb-863851f9052e tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:56:51.978241 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-176ec72b-1d23-4d56-86cb-863851f9052e tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:56:51.978648 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-176ec72b-1d23-4d56-86cb-863851f9052e tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:56:51.979057 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-176ec72b-1d23-4d56-86cb-863851f9052e tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:56:51.989032 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-176ec72b-1d23-4d56-86cb-863851f9052e tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:51.989564 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-176ec72b-1d23-4d56-86cb-863851f9052e tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:51.990006 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-176ec72b-1d23-4d56-86cb-863851f9052e tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:51.990838 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-176ec72b-1d23-4d56-86cb-863851f9052e tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:51.991179 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-176ec72b-1d23-4d56-86cb-863851f9052e tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:51.991602 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-176ec72b-1d23-4d56-86cb-863851f9052e tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:52.008969 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-176ec72b-1d23-4d56-86cb-863851f9052e tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Getting quotas for project 401134781af34fdb8c48d8b07bb6a82a. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:56:52.014654 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-176ec72b-1d23-4d56-86cb-863851f9052e tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Getting quotas for user 15c674279db249deaa437c1788371370 and project 401134781af34fdb8c48d8b07bb6a82a. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:56:52.026881 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-176ec72b-1d23-4d56-86cb-863851f9052e tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:56:52.029796 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-176ec72b-1d23-4d56-86cb-863851f9052e tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:56:52.077018 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-176ec72b-1d23-4d56-86cb-863851f9052e tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.647862 Oct 26 13:56:52.077701 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3471/6965] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:56:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:56:52.089854 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0fd628a6-6739-4392-92d7-d188072e785a tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:56:52.091046 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0fd628a6-6739-4392-92d7-d188072e785a tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:56:52.095545 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:56:52.096312 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:56:52.167926 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0fd628a6-6739-4392-92d7-d188072e785a tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c674279db249deaa437c1788371370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401134781af34fdb8c48d8b07bb6a82a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:56:52.176563 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0fd628a6-6739-4392-92d7-d188072e785a tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] 10.222.0.40 "GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824" status: 200 len: 1215 microversion: 2.1 time: 0.091611 Oct 26 13:56:52.182784 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3495/6966] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:56:52 2022] GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 => generated 1215 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:56:53.199587 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7137102e-5937-4f9e-8149-754f89008b51 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:56:53.200201 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7137102e-5937-4f9e-8149-754f89008b51 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:56:53.208345 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7137102e-5937-4f9e-8149-754f89008b51 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:53.208916 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7137102e-5937-4f9e-8149-754f89008b51 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:53.209359 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7137102e-5937-4f9e-8149-754f89008b51 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:53.210112 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7137102e-5937-4f9e-8149-754f89008b51 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:53.210572 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7137102e-5937-4f9e-8149-754f89008b51 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:53.211001 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7137102e-5937-4f9e-8149-754f89008b51 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:53.670419 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7137102e-5937-4f9e-8149-754f89008b51 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c674279db249deaa437c1788371370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401134781af34fdb8c48d8b07bb6a82a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:56:53.678482 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7137102e-5937-4f9e-8149-754f89008b51 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] 10.222.0.40 "GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824" status: 200 len: 1267 microversion: 2.1 time: 0.483052 Oct 26 13:56:53.681870 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3472/6967] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:56:53 2022] GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 => generated 1267 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:56:54.704881 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-422b643e-abcc-467b-997f-ef4e6b43aaa5 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:56:54.705550 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-422b643e-abcc-467b-997f-ef4e6b43aaa5 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:56:54.713952 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-422b643e-abcc-467b-997f-ef4e6b43aaa5 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:54.714461 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-422b643e-abcc-467b-997f-ef4e6b43aaa5 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:54.714917 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-422b643e-abcc-467b-997f-ef4e6b43aaa5 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:54.715634 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-422b643e-abcc-467b-997f-ef4e6b43aaa5 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:54.716163 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-422b643e-abcc-467b-997f-ef4e6b43aaa5 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:54.716612 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-422b643e-abcc-467b-997f-ef4e6b43aaa5 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:54.944032 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-6878b755-d444-43b3-8617-3bce1b9633c6 req-712ea7c2-54cf-421c-aece-17024ccbad72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc99856b-2fa5-4c1b-972e-3de9e06e9824", "tag": "d94d533b-5ace-4a40-893c-ad1b43672001"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:56:54.949287 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-422b643e-abcc-467b-997f-ef4e6b43aaa5 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c674279db249deaa437c1788371370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401134781af34fdb8c48d8b07bb6a82a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:56:54.959254 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-6878b755-d444-43b3-8617-3bce1b9633c6 req-712ea7c2-54cf-421c-aece-17024ccbad72 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:54.959984 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-6878b755-d444-43b3-8617-3bce1b9633c6 req-712ea7c2-54cf-421c-aece-17024ccbad72 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:54.960604 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-6878b755-d444-43b3-8617-3bce1b9633c6 req-712ea7c2-54cf-421c-aece-17024ccbad72 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:54.967103 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-422b643e-abcc-467b-997f-ef4e6b43aaa5 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] 10.222.0.40 "GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824" status: 200 len: 1315 microversion: 2.1 time: 0.266888 Oct 26 13:56:54.969640 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3496/6968] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:56:54 2022] GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:56:54.995160 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-6878b755-d444-43b3-8617-3bce1b9633c6 req-712ea7c2-54cf-421c-aece-17024ccbad72 service nova] Creating event network-changed:d94d533b-5ace-4a40-893c-ad1b43672001 for instance fc99856b-2fa5-4c1b-972e-3de9e06e9824 on n-h2-862686-1 Oct 26 13:56:55.002580 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-6878b755-d444-43b3-8617-3bce1b9633c6 req-712ea7c2-54cf-421c-aece-17024ccbad72 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062051 Oct 26 13:56:55.003908 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3473/6969] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:56:55.994634 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-37a2ecc9-44f5-4de5-a22d-1020cd84cc70 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:56:55.995263 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-37a2ecc9-44f5-4de5-a22d-1020cd84cc70 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:56:56.002177 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-37a2ecc9-44f5-4de5-a22d-1020cd84cc70 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:56.002682 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-37a2ecc9-44f5-4de5-a22d-1020cd84cc70 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:56.003138 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-37a2ecc9-44f5-4de5-a22d-1020cd84cc70 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:56.003848 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-37a2ecc9-44f5-4de5-a22d-1020cd84cc70 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:56.004327 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-37a2ecc9-44f5-4de5-a22d-1020cd84cc70 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:56.004767 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-37a2ecc9-44f5-4de5-a22d-1020cd84cc70 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:56.140488 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-37a2ecc9-44f5-4de5-a22d-1020cd84cc70 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c674279db249deaa437c1788371370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401134781af34fdb8c48d8b07bb6a82a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:56:56.148962 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-37a2ecc9-44f5-4de5-a22d-1020cd84cc70 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] 10.222.0.40 "GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824" status: 200 len: 1315 microversion: 2.1 time: 0.158256 Oct 26 13:56:56.149765 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3497/6970] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:56:55 2022] GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:56:57.174540 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-17391c54-9277-48cc-ab87-c27b9304c535 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:56:57.175251 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-17391c54-9277-48cc-ab87-c27b9304c535 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:56:57.181490 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17391c54-9277-48cc-ab87-c27b9304c535 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:57.182002 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17391c54-9277-48cc-ab87-c27b9304c535 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:57.182446 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17391c54-9277-48cc-ab87-c27b9304c535 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:57.183147 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17391c54-9277-48cc-ab87-c27b9304c535 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:57.183604 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17391c54-9277-48cc-ab87-c27b9304c535 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:57.184032 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17391c54-9277-48cc-ab87-c27b9304c535 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:57.314685 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-17391c54-9277-48cc-ab87-c27b9304c535 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c674279db249deaa437c1788371370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401134781af34fdb8c48d8b07bb6a82a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:56:57.322372 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-17391c54-9277-48cc-ab87-c27b9304c535 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] 10.222.0.40 "GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824" status: 200 len: 1315 microversion: 2.1 time: 0.153880 Oct 26 13:56:57.322946 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3474/6971] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:56:57 2022] GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:56:58.345317 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fcda6a63-d16b-4c49-ab32-127e28339d4e tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:56:58.345976 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fcda6a63-d16b-4c49-ab32-127e28339d4e tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:56:58.352877 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fcda6a63-d16b-4c49-ab32-127e28339d4e tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:58.353378 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fcda6a63-d16b-4c49-ab32-127e28339d4e tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:58.353862 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fcda6a63-d16b-4c49-ab32-127e28339d4e tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:58.354570 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fcda6a63-d16b-4c49-ab32-127e28339d4e tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:58.355042 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fcda6a63-d16b-4c49-ab32-127e28339d4e tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:58.355486 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fcda6a63-d16b-4c49-ab32-127e28339d4e tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:58.491224 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fcda6a63-d16b-4c49-ab32-127e28339d4e tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c674279db249deaa437c1788371370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401134781af34fdb8c48d8b07bb6a82a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:56:58.499000 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fcda6a63-d16b-4c49-ab32-127e28339d4e tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] 10.222.0.40 "GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824" status: 200 len: 1315 microversion: 2.1 time: 0.157757 Oct 26 13:56:58.499582 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3498/6972] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:56:58 2022] GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:56:59.522194 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0afc1c0b-297b-4b81-807e-be4b17e32524 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:56:59.522806 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0afc1c0b-297b-4b81-807e-be4b17e32524 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:56:59.530266 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0afc1c0b-297b-4b81-807e-be4b17e32524 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:59.530747 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0afc1c0b-297b-4b81-807e-be4b17e32524 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:59.531182 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0afc1c0b-297b-4b81-807e-be4b17e32524 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:59.531869 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0afc1c0b-297b-4b81-807e-be4b17e32524 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:56:59.532325 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0afc1c0b-297b-4b81-807e-be4b17e32524 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:56:59.532776 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0afc1c0b-297b-4b81-807e-be4b17e32524 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:56:59.665199 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0afc1c0b-297b-4b81-807e-be4b17e32524 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c674279db249deaa437c1788371370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401134781af34fdb8c48d8b07bb6a82a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:56:59.674054 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0afc1c0b-297b-4b81-807e-be4b17e32524 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] 10.222.0.40 "GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824" status: 200 len: 1315 microversion: 2.1 time: 0.155784 Oct 26 13:56:59.674621 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3475/6973] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:56:59 2022] GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:57:00.697724 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e660c9e2-bfb2-4800-859e-d259dd0f44c8 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:57:00.698368 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e660c9e2-bfb2-4800-859e-d259dd0f44c8 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:57:00.705975 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e660c9e2-bfb2-4800-859e-d259dd0f44c8 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:00.706482 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e660c9e2-bfb2-4800-859e-d259dd0f44c8 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:00.706943 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e660c9e2-bfb2-4800-859e-d259dd0f44c8 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:00.707664 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e660c9e2-bfb2-4800-859e-d259dd0f44c8 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:00.708144 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e660c9e2-bfb2-4800-859e-d259dd0f44c8 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:00.708595 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e660c9e2-bfb2-4800-859e-d259dd0f44c8 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:00.837904 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e660c9e2-bfb2-4800-859e-d259dd0f44c8 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c674279db249deaa437c1788371370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401134781af34fdb8c48d8b07bb6a82a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:57:00.845784 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e660c9e2-bfb2-4800-859e-d259dd0f44c8 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] 10.222.0.40 "GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824" status: 200 len: 1315 microversion: 2.1 time: 0.152079 Oct 26 13:57:00.846365 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3499/6974] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:57:00 2022] GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:57:01.045912 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-e86cb360-7323-4382-9404-f6cd3aa4123b req-0a191a68-bcbf-4e3f-84ed-57ec5ecf8f5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc99856b-2fa5-4c1b-972e-3de9e06e9824", "name": "network-vif-plugged", "status": "completed", "tag": "d94d533b-5ace-4a40-893c-ad1b43672001"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:57:01.051766 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:57:01.059341 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-e86cb360-7323-4382-9404-f6cd3aa4123b req-0a191a68-bcbf-4e3f-84ed-57ec5ecf8f5b service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:01.060576 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-e86cb360-7323-4382-9404-f6cd3aa4123b req-0a191a68-bcbf-4e3f-84ed-57ec5ecf8f5b service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:01.061013 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-e86cb360-7323-4382-9404-f6cd3aa4123b req-0a191a68-bcbf-4e3f-84ed-57ec5ecf8f5b service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:01.066088 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:57:01.073971 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-e86cb360-7323-4382-9404-f6cd3aa4123b req-0a191a68-bcbf-4e3f-84ed-57ec5ecf8f5b service nova] Creating event network-vif-plugged:d94d533b-5ace-4a40-893c-ad1b43672001 for instance fc99856b-2fa5-4c1b-972e-3de9e06e9824 on n-h2-862686-1 Oct 26 13:57:01.079836 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-e86cb360-7323-4382-9404-f6cd3aa4123b req-0a191a68-bcbf-4e3f-84ed-57ec5ecf8f5b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038545 Oct 26 13:57:01.080432 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3476/6975] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:57:01.868508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f71f6c2a-d3c7-4252-b38b-dc6203e95a4a tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:57:01.869136 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f71f6c2a-d3c7-4252-b38b-dc6203e95a4a tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:57:01.871848 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:57:01.878665 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f71f6c2a-d3c7-4252-b38b-dc6203e95a4a tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:01.879221 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f71f6c2a-d3c7-4252-b38b-dc6203e95a4a tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:01.879674 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f71f6c2a-d3c7-4252-b38b-dc6203e95a4a tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:01.880392 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f71f6c2a-d3c7-4252-b38b-dc6203e95a4a tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:01.880866 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f71f6c2a-d3c7-4252-b38b-dc6203e95a4a tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:01.881303 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f71f6c2a-d3c7-4252-b38b-dc6203e95a4a tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:01.884517 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=74 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:57:02.010916 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f71f6c2a-d3c7-4252-b38b-dc6203e95a4a tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c674279db249deaa437c1788371370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401134781af34fdb8c48d8b07bb6a82a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:57:02.019133 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f71f6c2a-d3c7-4252-b38b-dc6203e95a4a tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] 10.222.0.40 "GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824" status: 200 len: 1315 microversion: 2.1 time: 0.154612 Oct 26 13:57:02.019704 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3500/6976] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:57:01 2022] GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:57:03.041092 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:57:03.041703 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:57:03.047834 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5402cd45-16cd-44e8-a0d7-7fb235927a4c tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:57:03.048548 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5402cd45-16cd-44e8-a0d7-7fb235927a4c tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:57:03.057794 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5402cd45-16cd-44e8-a0d7-7fb235927a4c tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:03.058290 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5402cd45-16cd-44e8-a0d7-7fb235927a4c tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:03.058730 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5402cd45-16cd-44e8-a0d7-7fb235927a4c tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:03.059439 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5402cd45-16cd-44e8-a0d7-7fb235927a4c tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:03.059942 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5402cd45-16cd-44e8-a0d7-7fb235927a4c tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:03.060489 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5402cd45-16cd-44e8-a0d7-7fb235927a4c tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:03.190117 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5402cd45-16cd-44e8-a0d7-7fb235927a4c tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c674279db249deaa437c1788371370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401134781af34fdb8c48d8b07bb6a82a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:57:03.197866 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5402cd45-16cd-44e8-a0d7-7fb235927a4c tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] 10.222.0.40 "GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824" status: 200 len: 1502 microversion: 2.1 time: 0.158358 Oct 26 13:57:03.198445 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3477/6977] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:57:03 2022] GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 => generated 1502 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:57:03.221073 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-62902392-3dcd-44a5-9bba-cd2fc9b8ab92 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:57:03.223451 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-62902392-3dcd-44a5-9bba-cd2fc9b8ab92 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:57:03.225465 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:57:03.232678 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-62902392-3dcd-44a5-9bba-cd2fc9b8ab92 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:03.233171 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-62902392-3dcd-44a5-9bba-cd2fc9b8ab92 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:03.233653 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-62902392-3dcd-44a5-9bba-cd2fc9b8ab92 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:03.234355 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-62902392-3dcd-44a5-9bba-cd2fc9b8ab92 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:03.234822 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-62902392-3dcd-44a5-9bba-cd2fc9b8ab92 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:03.235261 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-62902392-3dcd-44a5-9bba-cd2fc9b8ab92 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:03.265988 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-62902392-3dcd-44a5-9bba-cd2fc9b8ab92 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '15c674279db249deaa437c1788371370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401134781af34fdb8c48d8b07bb6a82a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:57:03.271442 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-62902392-3dcd-44a5-9bba-cd2fc9b8ab92 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Old instance type m1.heat2, new instance type m1.heat {{(pid=120598) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 26 13:57:03.277944 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-62902392-3dcd-44a5-9bba-cd2fc9b8ab92 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:57:03.279054 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-62902392-3dcd-44a5-9bba-cd2fc9b8ab92 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:57:03.279545 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-62902392-3dcd-44a5-9bba-cd2fc9b8ab92 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:57:03.279967 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-62902392-3dcd-44a5-9bba-cd2fc9b8ab92 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:57:03.280389 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-62902392-3dcd-44a5-9bba-cd2fc9b8ab92 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:57:03.340724 n-d-862686-1 devstack@n-api.service[120598]: ERROR oslo.messaging._drivers.impl_rabbit [None req-62902392-3dcd-44a5-9bba-cd2fc9b8ab92 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [a19bc7ee-b554-454e-9109-925b78fc62ba] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 26 13:57:04.350649 n-d-862686-1 devstack@n-api.service[120598]: INFO oslo.messaging._drivers.impl_rabbit [None req-62902392-3dcd-44a5-9bba-cd2fc9b8ab92 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [a19bc7ee-b554-454e-9109-925b78fc62ba] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 33576. Oct 26 13:57:04.354094 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-62902392-3dcd-44a5-9bba-cd2fc9b8ab92 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] 10.222.0.40 "POST /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824/action" status: 202 len: 0 microversion: 2.1 time: 1.137073 Oct 26 13:57:04.354903 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3501/6978] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:57:03 2022] POST /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824/action => generated 0 bytes in 1139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:57:04.363340 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a39a2fb5-ec40-4f2e-8a6c-a2893baae3c7 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:57:04.363956 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a39a2fb5-ec40-4f2e-8a6c-a2893baae3c7 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:57:04.371022 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a39a2fb5-ec40-4f2e-8a6c-a2893baae3c7 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:04.371522 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a39a2fb5-ec40-4f2e-8a6c-a2893baae3c7 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:04.371988 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a39a2fb5-ec40-4f2e-8a6c-a2893baae3c7 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:04.373337 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a39a2fb5-ec40-4f2e-8a6c-a2893baae3c7 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:04.373823 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a39a2fb5-ec40-4f2e-8a6c-a2893baae3c7 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:04.374257 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a39a2fb5-ec40-4f2e-8a6c-a2893baae3c7 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:04.510794 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a39a2fb5-ec40-4f2e-8a6c-a2893baae3c7 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c674279db249deaa437c1788371370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401134781af34fdb8c48d8b07bb6a82a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:57:04.519491 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a39a2fb5-ec40-4f2e-8a6c-a2893baae3c7 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] 10.222.0.40 "GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824" status: 200 len: 1511 microversion: 2.1 time: 0.159937 Oct 26 13:57:04.520107 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3478/6979] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:57:04 2022] GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 => generated 1511 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:57:05.544605 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-954d59c1-6d4e-49c3-89db-f072ee0747c1 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:57:05.545269 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-954d59c1-6d4e-49c3-89db-f072ee0747c1 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:57:05.551673 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-954d59c1-6d4e-49c3-89db-f072ee0747c1 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:05.552177 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-954d59c1-6d4e-49c3-89db-f072ee0747c1 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:05.552641 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-954d59c1-6d4e-49c3-89db-f072ee0747c1 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:05.553622 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-954d59c1-6d4e-49c3-89db-f072ee0747c1 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:05.554287 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-954d59c1-6d4e-49c3-89db-f072ee0747c1 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:05.554717 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-954d59c1-6d4e-49c3-89db-f072ee0747c1 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:05.695338 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-954d59c1-6d4e-49c3-89db-f072ee0747c1 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c674279db249deaa437c1788371370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401134781af34fdb8c48d8b07bb6a82a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:57:05.703238 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-954d59c1-6d4e-49c3-89db-f072ee0747c1 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] 10.222.0.40 "GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824" status: 200 len: 1511 microversion: 2.1 time: 0.164350 Oct 26 13:57:05.703816 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3502/6980] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:57:05 2022] GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 => generated 1511 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:57:06.726522 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-598e84dd-2ed2-4fa9-b4ab-d1b3755e7e2d tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:57:06.727141 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-598e84dd-2ed2-4fa9-b4ab-d1b3755e7e2d tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:57:06.734877 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-598e84dd-2ed2-4fa9-b4ab-d1b3755e7e2d tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:06.735368 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-598e84dd-2ed2-4fa9-b4ab-d1b3755e7e2d tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:06.735813 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-598e84dd-2ed2-4fa9-b4ab-d1b3755e7e2d tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:06.736506 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-598e84dd-2ed2-4fa9-b4ab-d1b3755e7e2d tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:06.736967 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-598e84dd-2ed2-4fa9-b4ab-d1b3755e7e2d tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:06.737396 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-598e84dd-2ed2-4fa9-b4ab-d1b3755e7e2d tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:06.867033 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-598e84dd-2ed2-4fa9-b4ab-d1b3755e7e2d tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c674279db249deaa437c1788371370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401134781af34fdb8c48d8b07bb6a82a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:57:06.875571 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-598e84dd-2ed2-4fa9-b4ab-d1b3755e7e2d tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] 10.222.0.40 "GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824" status: 200 len: 1516 microversion: 2.1 time: 0.152917 Oct 26 13:57:06.876152 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3479/6981] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:57:06 2022] GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:57:07.898808 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-490549c7-2742-4b06-93fd-c9370dfc94c9 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:57:07.899445 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-490549c7-2742-4b06-93fd-c9370dfc94c9 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:57:07.906745 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-490549c7-2742-4b06-93fd-c9370dfc94c9 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:07.907257 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-490549c7-2742-4b06-93fd-c9370dfc94c9 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:07.907715 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-490549c7-2742-4b06-93fd-c9370dfc94c9 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:07.908431 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-490549c7-2742-4b06-93fd-c9370dfc94c9 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:07.909163 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-490549c7-2742-4b06-93fd-c9370dfc94c9 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:07.909639 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-490549c7-2742-4b06-93fd-c9370dfc94c9 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:08.045176 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-490549c7-2742-4b06-93fd-c9370dfc94c9 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c674279db249deaa437c1788371370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401134781af34fdb8c48d8b07bb6a82a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:57:08.052928 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-490549c7-2742-4b06-93fd-c9370dfc94c9 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] 10.222.0.40 "GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824" status: 200 len: 1516 microversion: 2.1 time: 0.158074 Oct 26 13:57:08.053529 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3503/6982] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:57:07 2022] GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:57:09.076543 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2518d06e-8738-48b9-8bba-f47ae98703b4 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:57:09.077160 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2518d06e-8738-48b9-8bba-f47ae98703b4 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:57:09.084095 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2518d06e-8738-48b9-8bba-f47ae98703b4 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:09.084585 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2518d06e-8738-48b9-8bba-f47ae98703b4 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:09.085035 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2518d06e-8738-48b9-8bba-f47ae98703b4 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:09.085757 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2518d06e-8738-48b9-8bba-f47ae98703b4 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:09.086219 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2518d06e-8738-48b9-8bba-f47ae98703b4 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:09.086654 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2518d06e-8738-48b9-8bba-f47ae98703b4 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:09.223373 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2518d06e-8738-48b9-8bba-f47ae98703b4 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c674279db249deaa437c1788371370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401134781af34fdb8c48d8b07bb6a82a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:57:09.232074 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2518d06e-8738-48b9-8bba-f47ae98703b4 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] 10.222.0.40 "GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824" status: 200 len: 1516 microversion: 2.1 time: 0.158961 Oct 26 13:57:09.232790 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3480/6983] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:57:09 2022] GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:57:10.256342 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6c1d29a0-0a12-4e0a-94ce-8af4e188d52a tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:57:10.256934 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6c1d29a0-0a12-4e0a-94ce-8af4e188d52a tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:57:10.264434 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c1d29a0-0a12-4e0a-94ce-8af4e188d52a tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:10.264936 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c1d29a0-0a12-4e0a-94ce-8af4e188d52a tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:10.265397 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c1d29a0-0a12-4e0a-94ce-8af4e188d52a tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:10.266139 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c1d29a0-0a12-4e0a-94ce-8af4e188d52a tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:10.266614 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c1d29a0-0a12-4e0a-94ce-8af4e188d52a tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:10.267061 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c1d29a0-0a12-4e0a-94ce-8af4e188d52a tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:10.394435 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6c1d29a0-0a12-4e0a-94ce-8af4e188d52a tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c674279db249deaa437c1788371370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401134781af34fdb8c48d8b07bb6a82a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:57:10.402124 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6c1d29a0-0a12-4e0a-94ce-8af4e188d52a tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] 10.222.0.40 "GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824" status: 200 len: 1516 microversion: 2.1 time: 0.149936 Oct 26 13:57:10.402691 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3504/6984] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:57:10 2022] GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:57:11.425670 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7c77c66c-de61-4dfc-a057-bbcfb219fd14 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:57:11.426279 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7c77c66c-de61-4dfc-a057-bbcfb219fd14 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:57:11.433094 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7c77c66c-de61-4dfc-a057-bbcfb219fd14 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:11.433606 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7c77c66c-de61-4dfc-a057-bbcfb219fd14 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:11.434049 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7c77c66c-de61-4dfc-a057-bbcfb219fd14 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:11.434831 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7c77c66c-de61-4dfc-a057-bbcfb219fd14 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:11.435287 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7c77c66c-de61-4dfc-a057-bbcfb219fd14 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:11.435721 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7c77c66c-de61-4dfc-a057-bbcfb219fd14 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:11.562155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7c77c66c-de61-4dfc-a057-bbcfb219fd14 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c674279db249deaa437c1788371370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401134781af34fdb8c48d8b07bb6a82a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:57:11.569766 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7c77c66c-de61-4dfc-a057-bbcfb219fd14 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] 10.222.0.40 "GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824" status: 200 len: 1516 microversion: 2.1 time: 0.148072 Oct 26 13:57:11.570342 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3481/6985] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:57:11 2022] GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 => generated 1516 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:57:12.592960 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e1bd48c3-8904-4b4d-ae71-82f15c9c5d86 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:57:12.593613 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e1bd48c3-8904-4b4d-ae71-82f15c9c5d86 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:57:12.600687 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e1bd48c3-8904-4b4d-ae71-82f15c9c5d86 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:12.601180 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e1bd48c3-8904-4b4d-ae71-82f15c9c5d86 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:12.601658 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e1bd48c3-8904-4b4d-ae71-82f15c9c5d86 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:12.602360 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e1bd48c3-8904-4b4d-ae71-82f15c9c5d86 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:12.602828 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e1bd48c3-8904-4b4d-ae71-82f15c9c5d86 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:12.603266 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e1bd48c3-8904-4b4d-ae71-82f15c9c5d86 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:12.736581 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e1bd48c3-8904-4b4d-ae71-82f15c9c5d86 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c674279db249deaa437c1788371370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401134781af34fdb8c48d8b07bb6a82a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:57:12.744412 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e1bd48c3-8904-4b4d-ae71-82f15c9c5d86 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] 10.222.0.40 "GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824" status: 200 len: 1516 microversion: 2.1 time: 0.155484 Oct 26 13:57:12.744990 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3505/6986] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:57:12 2022] GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:57:13.768193 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cbaa6191-6870-4404-8c95-5a4332d33f9f tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:57:13.768795 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cbaa6191-6870-4404-8c95-5a4332d33f9f tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:57:13.775757 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cbaa6191-6870-4404-8c95-5a4332d33f9f tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:13.776246 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cbaa6191-6870-4404-8c95-5a4332d33f9f tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:13.776683 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cbaa6191-6870-4404-8c95-5a4332d33f9f tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:13.777370 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cbaa6191-6870-4404-8c95-5a4332d33f9f tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:13.777848 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cbaa6191-6870-4404-8c95-5a4332d33f9f tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:13.778479 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cbaa6191-6870-4404-8c95-5a4332d33f9f tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:13.906573 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cbaa6191-6870-4404-8c95-5a4332d33f9f tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c674279db249deaa437c1788371370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401134781af34fdb8c48d8b07bb6a82a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:57:13.914596 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cbaa6191-6870-4404-8c95-5a4332d33f9f tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] 10.222.0.40 "GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824" status: 200 len: 1516 microversion: 2.1 time: 0.150341 Oct 26 13:57:13.915173 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3482/6987] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:57:13 2022] GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:57:14.939010 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6092ac7d-3a48-4f29-9309-62c831cf4481 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:57:14.939675 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6092ac7d-3a48-4f29-9309-62c831cf4481 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:57:14.946682 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6092ac7d-3a48-4f29-9309-62c831cf4481 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:14.947188 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6092ac7d-3a48-4f29-9309-62c831cf4481 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:14.947649 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6092ac7d-3a48-4f29-9309-62c831cf4481 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:14.948365 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6092ac7d-3a48-4f29-9309-62c831cf4481 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:14.948846 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6092ac7d-3a48-4f29-9309-62c831cf4481 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:14.949294 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6092ac7d-3a48-4f29-9309-62c831cf4481 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:15.079968 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6092ac7d-3a48-4f29-9309-62c831cf4481 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c674279db249deaa437c1788371370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401134781af34fdb8c48d8b07bb6a82a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:57:15.087599 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6092ac7d-3a48-4f29-9309-62c831cf4481 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] 10.222.0.40 "GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824" status: 200 len: 1516 microversion: 2.1 time: 0.153087 Oct 26 13:57:15.088224 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3506/6988] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:57:14 2022] GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:57:16.111248 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b470f81c-c247-404c-8999-1e98755184ac tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:57:16.111961 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b470f81c-c247-404c-8999-1e98755184ac tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:57:16.119413 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b470f81c-c247-404c-8999-1e98755184ac tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:16.119930 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b470f81c-c247-404c-8999-1e98755184ac tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:16.120368 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b470f81c-c247-404c-8999-1e98755184ac tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:16.121092 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b470f81c-c247-404c-8999-1e98755184ac tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:16.121650 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b470f81c-c247-404c-8999-1e98755184ac tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:16.122236 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b470f81c-c247-404c-8999-1e98755184ac tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:16.261237 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b470f81c-c247-404c-8999-1e98755184ac tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c674279db249deaa437c1788371370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401134781af34fdb8c48d8b07bb6a82a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:57:16.269643 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b470f81c-c247-404c-8999-1e98755184ac tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] 10.222.0.40 "GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824" status: 200 len: 1516 microversion: 2.1 time: 0.162899 Oct 26 13:57:16.270219 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3483/6989] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:57:16 2022] GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:57:17.293318 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6936cef0-0abd-4ddd-a6f0-5dfe53bde330 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:57:17.293969 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6936cef0-0abd-4ddd-a6f0-5dfe53bde330 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:57:17.303113 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6936cef0-0abd-4ddd-a6f0-5dfe53bde330 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:17.303620 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6936cef0-0abd-4ddd-a6f0-5dfe53bde330 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:17.304068 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6936cef0-0abd-4ddd-a6f0-5dfe53bde330 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:17.304779 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6936cef0-0abd-4ddd-a6f0-5dfe53bde330 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:17.305244 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6936cef0-0abd-4ddd-a6f0-5dfe53bde330 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:17.305709 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6936cef0-0abd-4ddd-a6f0-5dfe53bde330 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:17.441208 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6936cef0-0abd-4ddd-a6f0-5dfe53bde330 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c674279db249deaa437c1788371370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401134781af34fdb8c48d8b07bb6a82a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:57:17.449089 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6936cef0-0abd-4ddd-a6f0-5dfe53bde330 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] 10.222.0.40 "GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824" status: 200 len: 1516 microversion: 2.1 time: 0.159736 Oct 26 13:57:17.449705 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3507/6990] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:57:17 2022] GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:57:18.472395 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ab475498-a90d-418f-807a-1d037b5b6e5b tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:57:18.473016 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ab475498-a90d-418f-807a-1d037b5b6e5b tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:57:18.480022 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ab475498-a90d-418f-807a-1d037b5b6e5b tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:18.480514 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ab475498-a90d-418f-807a-1d037b5b6e5b tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:18.480960 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ab475498-a90d-418f-807a-1d037b5b6e5b tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:18.482197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ab475498-a90d-418f-807a-1d037b5b6e5b tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:18.482758 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ab475498-a90d-418f-807a-1d037b5b6e5b tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:18.483196 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ab475498-a90d-418f-807a-1d037b5b6e5b tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:18.632253 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ab475498-a90d-418f-807a-1d037b5b6e5b tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c674279db249deaa437c1788371370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401134781af34fdb8c48d8b07bb6a82a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:57:18.641169 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ab475498-a90d-418f-807a-1d037b5b6e5b tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] 10.222.0.40 "GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824" status: 200 len: 1516 microversion: 2.1 time: 0.172708 Oct 26 13:57:18.641822 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3484/6991] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:57:18 2022] GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 => generated 1516 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:57:19.664863 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bdcab1ef-b467-4227-b6bb-45bc34bcf0ba tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:57:19.665509 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bdcab1ef-b467-4227-b6bb-45bc34bcf0ba tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:57:19.672685 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bdcab1ef-b467-4227-b6bb-45bc34bcf0ba tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:19.673182 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bdcab1ef-b467-4227-b6bb-45bc34bcf0ba tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:19.673665 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bdcab1ef-b467-4227-b6bb-45bc34bcf0ba tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:19.674374 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bdcab1ef-b467-4227-b6bb-45bc34bcf0ba tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:19.674848 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bdcab1ef-b467-4227-b6bb-45bc34bcf0ba tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:19.675288 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bdcab1ef-b467-4227-b6bb-45bc34bcf0ba tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:19.807858 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bdcab1ef-b467-4227-b6bb-45bc34bcf0ba tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c674279db249deaa437c1788371370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401134781af34fdb8c48d8b07bb6a82a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:57:19.815769 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bdcab1ef-b467-4227-b6bb-45bc34bcf0ba tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] 10.222.0.40 "GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824" status: 200 len: 1516 microversion: 2.1 time: 0.155148 Oct 26 13:57:19.816342 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3508/6992] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:57:19 2022] GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:57:20.839457 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bb4987f2-c3a3-4b24-bf35-2b5b2d2e38a0 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:57:20.840071 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bb4987f2-c3a3-4b24-bf35-2b5b2d2e38a0 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:57:20.847817 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb4987f2-c3a3-4b24-bf35-2b5b2d2e38a0 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:20.848300 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb4987f2-c3a3-4b24-bf35-2b5b2d2e38a0 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:20.848741 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb4987f2-c3a3-4b24-bf35-2b5b2d2e38a0 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:20.849428 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb4987f2-c3a3-4b24-bf35-2b5b2d2e38a0 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:20.849909 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb4987f2-c3a3-4b24-bf35-2b5b2d2e38a0 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:20.850337 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb4987f2-c3a3-4b24-bf35-2b5b2d2e38a0 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:20.984482 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bb4987f2-c3a3-4b24-bf35-2b5b2d2e38a0 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c674279db249deaa437c1788371370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401134781af34fdb8c48d8b07bb6a82a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:57:20.992446 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bb4987f2-c3a3-4b24-bf35-2b5b2d2e38a0 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] 10.222.0.40 "GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824" status: 200 len: 1516 microversion: 2.1 time: 0.156950 Oct 26 13:57:20.993024 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3485/6993] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:57:20 2022] GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:57:22.016136 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2638af71-ff48-4036-9e12-d832fadcbf44 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:57:22.016761 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2638af71-ff48-4036-9e12-d832fadcbf44 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:57:22.023617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2638af71-ff48-4036-9e12-d832fadcbf44 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:22.024112 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2638af71-ff48-4036-9e12-d832fadcbf44 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:22.024561 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2638af71-ff48-4036-9e12-d832fadcbf44 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:22.025264 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2638af71-ff48-4036-9e12-d832fadcbf44 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:22.025758 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2638af71-ff48-4036-9e12-d832fadcbf44 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:22.026204 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2638af71-ff48-4036-9e12-d832fadcbf44 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:22.155759 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2638af71-ff48-4036-9e12-d832fadcbf44 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c674279db249deaa437c1788371370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401134781af34fdb8c48d8b07bb6a82a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:57:22.163764 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2638af71-ff48-4036-9e12-d832fadcbf44 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] 10.222.0.40 "GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824" status: 200 len: 1516 microversion: 2.1 time: 0.152123 Oct 26 13:57:22.164329 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3509/6994] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:57:22 2022] GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:57:23.188011 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2e4751ee-12ec-472d-acdf-2b867158a345 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:57:23.188561 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2e4751ee-12ec-472d-acdf-2b867158a345 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:57:23.195241 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e4751ee-12ec-472d-acdf-2b867158a345 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:23.195750 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e4751ee-12ec-472d-acdf-2b867158a345 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:23.196191 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e4751ee-12ec-472d-acdf-2b867158a345 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:23.196883 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e4751ee-12ec-472d-acdf-2b867158a345 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:23.197341 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e4751ee-12ec-472d-acdf-2b867158a345 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:23.197804 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e4751ee-12ec-472d-acdf-2b867158a345 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:23.327314 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2e4751ee-12ec-472d-acdf-2b867158a345 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c674279db249deaa437c1788371370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401134781af34fdb8c48d8b07bb6a82a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:57:23.335095 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2e4751ee-12ec-472d-acdf-2b867158a345 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] 10.222.0.40 "GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824" status: 200 len: 1516 microversion: 2.1 time: 0.151763 Oct 26 13:57:23.335669 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3486/6995] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:57:23 2022] GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:57:24.358263 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f61eafc7-d0e9-4b9e-b7e0-d6eaa9732d46 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:57:24.358896 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f61eafc7-d0e9-4b9e-b7e0-d6eaa9732d46 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:57:24.365775 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f61eafc7-d0e9-4b9e-b7e0-d6eaa9732d46 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:24.366273 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f61eafc7-d0e9-4b9e-b7e0-d6eaa9732d46 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:24.366728 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f61eafc7-d0e9-4b9e-b7e0-d6eaa9732d46 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:24.367434 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f61eafc7-d0e9-4b9e-b7e0-d6eaa9732d46 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:24.367906 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f61eafc7-d0e9-4b9e-b7e0-d6eaa9732d46 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:24.368376 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f61eafc7-d0e9-4b9e-b7e0-d6eaa9732d46 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:24.496968 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f61eafc7-d0e9-4b9e-b7e0-d6eaa9732d46 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c674279db249deaa437c1788371370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401134781af34fdb8c48d8b07bb6a82a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:57:24.504777 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f61eafc7-d0e9-4b9e-b7e0-d6eaa9732d46 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] 10.222.0.40 "GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824" status: 200 len: 1516 microversion: 2.1 time: 0.150612 Oct 26 13:57:24.505352 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3510/6996] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:57:24 2022] GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:57:25.528354 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c84caf3f-c1b9-4d61-b4c6-aa6346dffaad tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:57:25.528956 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c84caf3f-c1b9-4d61-b4c6-aa6346dffaad tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:57:25.536878 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c84caf3f-c1b9-4d61-b4c6-aa6346dffaad tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:25.537372 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c84caf3f-c1b9-4d61-b4c6-aa6346dffaad tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:25.537843 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c84caf3f-c1b9-4d61-b4c6-aa6346dffaad tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:25.538543 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c84caf3f-c1b9-4d61-b4c6-aa6346dffaad tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:25.539006 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c84caf3f-c1b9-4d61-b4c6-aa6346dffaad tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:25.539439 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c84caf3f-c1b9-4d61-b4c6-aa6346dffaad tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:25.668033 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c84caf3f-c1b9-4d61-b4c6-aa6346dffaad tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c674279db249deaa437c1788371370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401134781af34fdb8c48d8b07bb6a82a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:57:25.676996 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c84caf3f-c1b9-4d61-b4c6-aa6346dffaad tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] 10.222.0.40 "GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824" status: 200 len: 1516 microversion: 2.1 time: 0.152669 Oct 26 13:57:25.677596 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3487/6997] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:57:25 2022] GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:57:26.700140 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-838aa6d2-54b0-45c3-b3b9-55b18bc34a49 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:57:26.700765 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-838aa6d2-54b0-45c3-b3b9-55b18bc34a49 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:57:26.708365 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-838aa6d2-54b0-45c3-b3b9-55b18bc34a49 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:26.708857 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-838aa6d2-54b0-45c3-b3b9-55b18bc34a49 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:26.709303 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-838aa6d2-54b0-45c3-b3b9-55b18bc34a49 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:26.710030 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-838aa6d2-54b0-45c3-b3b9-55b18bc34a49 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:26.710502 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-838aa6d2-54b0-45c3-b3b9-55b18bc34a49 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:26.710940 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-838aa6d2-54b0-45c3-b3b9-55b18bc34a49 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:26.842277 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-838aa6d2-54b0-45c3-b3b9-55b18bc34a49 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c674279db249deaa437c1788371370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401134781af34fdb8c48d8b07bb6a82a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:57:26.850362 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-838aa6d2-54b0-45c3-b3b9-55b18bc34a49 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] 10.222.0.40 "GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824" status: 200 len: 1516 microversion: 2.1 time: 0.154173 Oct 26 13:57:26.850945 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3511/6998] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:57:26 2022] GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:57:27.873442 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-26a97329-ad46-4fbe-9bba-37c9196d7db8 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:57:27.874805 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-26a97329-ad46-4fbe-9bba-37c9196d7db8 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:57:27.878058 n-d-862686-1 devstack@n-api.service[120597]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 13:57:27.878224 n-d-862686-1 devstack@n-api.service[120597]: Wed Oct 26 13:57:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 (ip 10.222.0.40) !!! Oct 26 13:57:27.886713 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26a97329-ad46-4fbe-9bba-37c9196d7db8 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:27.887202 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26a97329-ad46-4fbe-9bba-37c9196d7db8 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:27.887650 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26a97329-ad46-4fbe-9bba-37c9196d7db8 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:27.888352 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26a97329-ad46-4fbe-9bba-37c9196d7db8 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:27.888812 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26a97329-ad46-4fbe-9bba-37c9196d7db8 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:27.889245 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26a97329-ad46-4fbe-9bba-37c9196d7db8 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:28.023085 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-26a97329-ad46-4fbe-9bba-37c9196d7db8 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c674279db249deaa437c1788371370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401134781af34fdb8c48d8b07bb6a82a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:57:28.031421 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-26a97329-ad46-4fbe-9bba-37c9196d7db8 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] 10.222.0.40 "GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824" status: 200 len: 1516 microversion: 2.1 time: 0.161352 Oct 26 13:57:28.031998 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3488/6999] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:57:27 2022] GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:57:29.054876 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-03fe83ea-5b46-4b47-8a73-1e5f1fcd2d06 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:57:29.055533 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-03fe83ea-5b46-4b47-8a73-1e5f1fcd2d06 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:57:29.063949 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03fe83ea-5b46-4b47-8a73-1e5f1fcd2d06 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:29.064449 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03fe83ea-5b46-4b47-8a73-1e5f1fcd2d06 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:29.064901 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03fe83ea-5b46-4b47-8a73-1e5f1fcd2d06 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:29.065688 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03fe83ea-5b46-4b47-8a73-1e5f1fcd2d06 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:29.066166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03fe83ea-5b46-4b47-8a73-1e5f1fcd2d06 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:29.066610 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03fe83ea-5b46-4b47-8a73-1e5f1fcd2d06 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:29.197951 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-03fe83ea-5b46-4b47-8a73-1e5f1fcd2d06 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c674279db249deaa437c1788371370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401134781af34fdb8c48d8b07bb6a82a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:57:29.207263 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-03fe83ea-5b46-4b47-8a73-1e5f1fcd2d06 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] 10.222.0.40 "GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824" status: 200 len: 1516 microversion: 2.1 time: 0.156546 Oct 26 13:57:29.214409 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3512/7000] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:57:29 2022] GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:57:30.229993 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b5d8db8d-5e9c-404d-b0de-88c48996b173 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:57:30.230608 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b5d8db8d-5e9c-404d-b0de-88c48996b173 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:57:30.237649 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b5d8db8d-5e9c-404d-b0de-88c48996b173 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:30.238139 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b5d8db8d-5e9c-404d-b0de-88c48996b173 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:30.238580 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b5d8db8d-5e9c-404d-b0de-88c48996b173 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:30.239277 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b5d8db8d-5e9c-404d-b0de-88c48996b173 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:30.239737 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b5d8db8d-5e9c-404d-b0de-88c48996b173 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:30.240168 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b5d8db8d-5e9c-404d-b0de-88c48996b173 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:30.369296 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b5d8db8d-5e9c-404d-b0de-88c48996b173 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c674279db249deaa437c1788371370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401134781af34fdb8c48d8b07bb6a82a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:57:30.377439 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b5d8db8d-5e9c-404d-b0de-88c48996b173 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] 10.222.0.40 "GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824" status: 200 len: 1516 microversion: 2.1 time: 0.151413 Oct 26 13:57:30.378053 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3489/7001] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:57:30 2022] GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:57:31.400217 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9c6562a9-e0df-4dc0-a718-48b4cc279a20 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:57:31.400848 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9c6562a9-e0df-4dc0-a718-48b4cc279a20 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:57:31.408727 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c6562a9-e0df-4dc0-a718-48b4cc279a20 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:31.409291 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c6562a9-e0df-4dc0-a718-48b4cc279a20 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:31.409772 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c6562a9-e0df-4dc0-a718-48b4cc279a20 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:31.410483 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c6562a9-e0df-4dc0-a718-48b4cc279a20 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:31.410955 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c6562a9-e0df-4dc0-a718-48b4cc279a20 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:31.411404 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c6562a9-e0df-4dc0-a718-48b4cc279a20 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:31.545168 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9c6562a9-e0df-4dc0-a718-48b4cc279a20 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c674279db249deaa437c1788371370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401134781af34fdb8c48d8b07bb6a82a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:57:31.553657 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9c6562a9-e0df-4dc0-a718-48b4cc279a20 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] 10.222.0.40 "GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824" status: 200 len: 1516 microversion: 2.1 time: 0.157353 Oct 26 13:57:31.554255 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3513/7002] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:57:31 2022] GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:57:32.576447 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1004af69-2e81-4eb7-8b39-820303b4cf67 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:57:32.577128 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1004af69-2e81-4eb7-8b39-820303b4cf67 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:57:32.584264 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1004af69-2e81-4eb7-8b39-820303b4cf67 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:32.584756 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1004af69-2e81-4eb7-8b39-820303b4cf67 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:32.585205 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1004af69-2e81-4eb7-8b39-820303b4cf67 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:32.585943 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1004af69-2e81-4eb7-8b39-820303b4cf67 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:32.586410 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1004af69-2e81-4eb7-8b39-820303b4cf67 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:32.586844 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1004af69-2e81-4eb7-8b39-820303b4cf67 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:32.725617 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1004af69-2e81-4eb7-8b39-820303b4cf67 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c674279db249deaa437c1788371370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401134781af34fdb8c48d8b07bb6a82a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:57:32.733508 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1004af69-2e81-4eb7-8b39-820303b4cf67 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] 10.222.0.40 "GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824" status: 200 len: 1516 microversion: 2.1 time: 0.161162 Oct 26 13:57:32.734091 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3490/7003] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:57:32 2022] GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:57:33.756814 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f1200c95-1180-4d25-9797-0b9c3930f2ca tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:57:33.757414 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f1200c95-1180-4d25-9797-0b9c3930f2ca tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:57:33.760173 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=32 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:57:33.765446 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1200c95-1180-4d25-9797-0b9c3930f2ca tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:33.766127 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1200c95-1180-4d25-9797-0b9c3930f2ca tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:33.766633 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1200c95-1180-4d25-9797-0b9c3930f2ca tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:33.767382 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1200c95-1180-4d25-9797-0b9c3930f2ca tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:33.767858 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1200c95-1180-4d25-9797-0b9c3930f2ca tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:33.768303 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1200c95-1180-4d25-9797-0b9c3930f2ca tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:33.771209 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:57:33.966060 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f1200c95-1180-4d25-9797-0b9c3930f2ca tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c674279db249deaa437c1788371370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401134781af34fdb8c48d8b07bb6a82a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:57:33.975373 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f1200c95-1180-4d25-9797-0b9c3930f2ca tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] 10.222.0.40 "GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824" status: 200 len: 1515 microversion: 2.1 time: 0.222838 Oct 26 13:57:33.975985 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3514/7004] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:57:33 2022] GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 => generated 1515 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:57:34.279756 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-ed2eccf4-5cf6-4fa3-8b20-1d027678b79e req-1141f650-6e2c-4f55-8413-1ce50ecc2a4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc99856b-2fa5-4c1b-972e-3de9e06e9824", "name": "network-vif-unplugged", "status": "completed", "tag": "d94d533b-5ace-4a40-893c-ad1b43672001"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:57:34.286747 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=30 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:57:34.293285 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ed2eccf4-5cf6-4fa3-8b20-1d027678b79e req-1141f650-6e2c-4f55-8413-1ce50ecc2a4e service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:34.293821 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ed2eccf4-5cf6-4fa3-8b20-1d027678b79e req-1141f650-6e2c-4f55-8413-1ce50ecc2a4e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:34.294264 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ed2eccf4-5cf6-4fa3-8b20-1d027678b79e req-1141f650-6e2c-4f55-8413-1ce50ecc2a4e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:34.299304 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=86 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:57:34.307452 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-ed2eccf4-5cf6-4fa3-8b20-1d027678b79e req-1141f650-6e2c-4f55-8413-1ce50ecc2a4e service nova] Creating event network-vif-unplugged:d94d533b-5ace-4a40-893c-ad1b43672001 for instance fc99856b-2fa5-4c1b-972e-3de9e06e9824 on n-h1-862686-1 Oct 26 13:57:34.313643 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [req-ed2eccf4-5cf6-4fa3-8b20-1d027678b79e req-1141f650-6e2c-4f55-8413-1ce50ecc2a4e service nova] Instance fc99856b-2fa5-4c1b-972e-3de9e06e9824 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862686-1', 'n-h1-862686-1'} {{(pid=120597) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 13:57:34.324561 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-ed2eccf4-5cf6-4fa3-8b20-1d027678b79e req-1141f650-6e2c-4f55-8413-1ce50ecc2a4e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048497 Oct 26 13:57:34.325182 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3491/7005] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:57:34.999464 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b341e76f-b617-4845-9406-1b5d85d6a2f8 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:57:35.001355 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b341e76f-b617-4845-9406-1b5d85d6a2f8 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:57:35.008564 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b341e76f-b617-4845-9406-1b5d85d6a2f8 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:35.009071 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b341e76f-b617-4845-9406-1b5d85d6a2f8 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:35.009666 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b341e76f-b617-4845-9406-1b5d85d6a2f8 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:35.010386 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b341e76f-b617-4845-9406-1b5d85d6a2f8 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:35.010886 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b341e76f-b617-4845-9406-1b5d85d6a2f8 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:35.011325 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b341e76f-b617-4845-9406-1b5d85d6a2f8 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:35.166283 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b341e76f-b617-4845-9406-1b5d85d6a2f8 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c674279db249deaa437c1788371370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401134781af34fdb8c48d8b07bb6a82a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:57:35.174898 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b341e76f-b617-4845-9406-1b5d85d6a2f8 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] 10.222.0.40 "GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824" status: 200 len: 1515 microversion: 2.1 time: 0.179369 Oct 26 13:57:35.175488 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3515/7006] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:57:34 2022] GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 => generated 1515 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:57:36.200027 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4d12a794-b752-4c02-be09-2d272107aa26 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:57:36.200758 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4d12a794-b752-4c02-be09-2d272107aa26 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:57:36.207945 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4d12a794-b752-4c02-be09-2d272107aa26 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:36.208435 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4d12a794-b752-4c02-be09-2d272107aa26 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:36.208879 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4d12a794-b752-4c02-be09-2d272107aa26 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:36.209645 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4d12a794-b752-4c02-be09-2d272107aa26 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:36.210115 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4d12a794-b752-4c02-be09-2d272107aa26 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:36.210552 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4d12a794-b752-4c02-be09-2d272107aa26 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:36.339747 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4d12a794-b752-4c02-be09-2d272107aa26 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c674279db249deaa437c1788371370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401134781af34fdb8c48d8b07bb6a82a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:57:36.350876 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4d12a794-b752-4c02-be09-2d272107aa26 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] 10.222.0.40 "GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824" status: 200 len: 1513 microversion: 2.1 time: 0.155971 Oct 26 13:57:36.351482 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3492/7007] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:57:36 2022] GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:57:36.352944 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-93514191-9785-4f19-9d9a-a210fc1f63c1 req-177fd613-f6de-4772-be75-271fb32f9a52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc99856b-2fa5-4c1b-972e-3de9e06e9824", "tag": "d94d533b-5ace-4a40-893c-ad1b43672001"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:57:36.363092 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-93514191-9785-4f19-9d9a-a210fc1f63c1 req-177fd613-f6de-4772-be75-271fb32f9a52 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:36.363586 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-93514191-9785-4f19-9d9a-a210fc1f63c1 req-177fd613-f6de-4772-be75-271fb32f9a52 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:36.364032 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-93514191-9785-4f19-9d9a-a210fc1f63c1 req-177fd613-f6de-4772-be75-271fb32f9a52 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:36.375782 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-93514191-9785-4f19-9d9a-a210fc1f63c1 req-177fd613-f6de-4772-be75-271fb32f9a52 service nova] Creating event network-changed:d94d533b-5ace-4a40-893c-ad1b43672001 for instance fc99856b-2fa5-4c1b-972e-3de9e06e9824 on n-h1-862686-1 Oct 26 13:57:36.381098 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [req-93514191-9785-4f19-9d9a-a210fc1f63c1 req-177fd613-f6de-4772-be75-271fb32f9a52 service nova] Instance fc99856b-2fa5-4c1b-972e-3de9e06e9824 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862686-1', 'n-h1-862686-1'} {{(pid=120598) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 13:57:36.392420 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-93514191-9785-4f19-9d9a-a210fc1f63c1 req-177fd613-f6de-4772-be75-271fb32f9a52 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043166 Oct 26 13:57:36.393017 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3516/7008] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:57:37.376559 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e3291233-46be-41d7-8e91-d344d9686c25 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:57:37.377208 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e3291233-46be-41d7-8e91-d344d9686c25 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:57:37.384573 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3291233-46be-41d7-8e91-d344d9686c25 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:37.385161 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3291233-46be-41d7-8e91-d344d9686c25 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:37.385705 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3291233-46be-41d7-8e91-d344d9686c25 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:37.386420 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3291233-46be-41d7-8e91-d344d9686c25 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:37.386883 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3291233-46be-41d7-8e91-d344d9686c25 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:37.387316 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3291233-46be-41d7-8e91-d344d9686c25 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:37.524670 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e3291233-46be-41d7-8e91-d344d9686c25 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c674279db249deaa437c1788371370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401134781af34fdb8c48d8b07bb6a82a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:57:37.533080 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e3291233-46be-41d7-8e91-d344d9686c25 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] 10.222.0.40 "GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824" status: 200 len: 1510 microversion: 2.1 time: 0.160790 Oct 26 13:57:37.533960 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3493/7009] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:57:37 2022] GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:57:37.558831 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1f6e3ddc-3ea5-4b1b-a138-29ecafa05965 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:57:37.559559 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1f6e3ddc-3ea5-4b1b-a138-29ecafa05965 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:57:37.566223 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f6e3ddc-3ea5-4b1b-a138-29ecafa05965 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:37.566814 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f6e3ddc-3ea5-4b1b-a138-29ecafa05965 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:37.567336 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f6e3ddc-3ea5-4b1b-a138-29ecafa05965 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:37.568122 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f6e3ddc-3ea5-4b1b-a138-29ecafa05965 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:37.568657 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f6e3ddc-3ea5-4b1b-a138-29ecafa05965 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:37.569163 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f6e3ddc-3ea5-4b1b-a138-29ecafa05965 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:37.596822 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1f6e3ddc-3ea5-4b1b-a138-29ecafa05965 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:57:37.650720 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.compute.api [None req-1f6e3ddc-3ea5-4b1b-a138-29ecafa05965 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Found an unconfirmed migration during delete, id: 16, status: finished Oct 26 13:57:39.174653 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1f6e3ddc-3ea5-4b1b-a138-29ecafa05965 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] 10.222.0.40 "DELETE /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824" status: 204 len: 0 microversion: 2.1 time: 1.620743 Oct 26 13:57:39.175537 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3517/7010] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:57:37 2022] DELETE /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 => generated 0 bytes in 1622 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:57:39.183516 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5f93a658-1646-4d55-a70c-0eaab51ee8a0 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:57:39.184132 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5f93a658-1646-4d55-a70c-0eaab51ee8a0 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:57:39.191873 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5f93a658-1646-4d55-a70c-0eaab51ee8a0 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:39.192363 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5f93a658-1646-4d55-a70c-0eaab51ee8a0 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:39.192804 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5f93a658-1646-4d55-a70c-0eaab51ee8a0 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:39.193527 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5f93a658-1646-4d55-a70c-0eaab51ee8a0 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:39.193990 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5f93a658-1646-4d55-a70c-0eaab51ee8a0 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:39.194421 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5f93a658-1646-4d55-a70c-0eaab51ee8a0 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:39.330114 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5f93a658-1646-4d55-a70c-0eaab51ee8a0 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c674279db249deaa437c1788371370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401134781af34fdb8c48d8b07bb6a82a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:57:39.338180 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5f93a658-1646-4d55-a70c-0eaab51ee8a0 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] 10.222.0.40 "GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824" status: 200 len: 1502 microversion: 2.1 time: 0.158642 Oct 26 13:57:39.338760 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3494/7011] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:57:39 2022] GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 => generated 1502 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:57:40.362359 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9737235e-caad-4fd9-8b5a-b6c6e34721c8 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:57:40.363078 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9737235e-caad-4fd9-8b5a-b6c6e34721c8 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:57:40.370115 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9737235e-caad-4fd9-8b5a-b6c6e34721c8 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:40.370614 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9737235e-caad-4fd9-8b5a-b6c6e34721c8 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:40.371068 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9737235e-caad-4fd9-8b5a-b6c6e34721c8 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:40.371777 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9737235e-caad-4fd9-8b5a-b6c6e34721c8 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:40.372250 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9737235e-caad-4fd9-8b5a-b6c6e34721c8 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:40.372692 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9737235e-caad-4fd9-8b5a-b6c6e34721c8 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:40.506548 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9737235e-caad-4fd9-8b5a-b6c6e34721c8 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c674279db249deaa437c1788371370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401134781af34fdb8c48d8b07bb6a82a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:57:40.514452 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9737235e-caad-4fd9-8b5a-b6c6e34721c8 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] 10.222.0.40 "GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824" status: 200 len: 1502 microversion: 2.1 time: 0.156575 Oct 26 13:57:40.515028 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3518/7012] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:57:40 2022] GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 => generated 1502 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:57:41.139020 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-6f478b2a-ef8f-406d-936e-53384005507a req-2b179fff-fa22-4751-a3b2-ccd718823432 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc99856b-2fa5-4c1b-972e-3de9e06e9824", "name": "network-vif-deleted", "tag": "d94d533b-5ace-4a40-893c-ad1b43672001"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:57:41.151696 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-6f478b2a-ef8f-406d-936e-53384005507a req-2b179fff-fa22-4751-a3b2-ccd718823432 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:41.152534 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-6f478b2a-ef8f-406d-936e-53384005507a req-2b179fff-fa22-4751-a3b2-ccd718823432 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:41.153070 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-6f478b2a-ef8f-406d-936e-53384005507a req-2b179fff-fa22-4751-a3b2-ccd718823432 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:41.166357 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-6f478b2a-ef8f-406d-936e-53384005507a req-2b179fff-fa22-4751-a3b2-ccd718823432 service nova] Creating event network-vif-deleted:d94d533b-5ace-4a40-893c-ad1b43672001 for instance fc99856b-2fa5-4c1b-972e-3de9e06e9824 on n-h1-862686-1 Oct 26 13:57:41.172883 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-6f478b2a-ef8f-406d-936e-53384005507a req-2b179fff-fa22-4751-a3b2-ccd718823432 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036625 Oct 26 13:57:41.173323 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3495/7013] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:57:41.538320 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f4736f3a-dbc6-4cbc-a21c-5917411929db tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:57:41.538982 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f4736f3a-dbc6-4cbc-a21c-5917411929db tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:57:41.545861 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4736f3a-dbc6-4cbc-a21c-5917411929db tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:41.546355 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4736f3a-dbc6-4cbc-a21c-5917411929db tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:41.547431 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4736f3a-dbc6-4cbc-a21c-5917411929db tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:41.548132 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4736f3a-dbc6-4cbc-a21c-5917411929db tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:41.548600 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4736f3a-dbc6-4cbc-a21c-5917411929db tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:41.549041 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4736f3a-dbc6-4cbc-a21c-5917411929db tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:41.562899 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-f4736f3a-dbc6-4cbc-a21c-5917411929db tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] HTTP exception thrown: Instance fc99856b-2fa5-4c1b-972e-3de9e06e9824 could not be found. Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f4736f3a-dbc6-4cbc-a21c-5917411929db tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Request method failure captured: Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 HTTP/1.1 Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTyjE3X69cNLi1_H377UJw6bg3-FrkK-sgW1UiyljZqqS46OPXI0BlpRbqD250BTYfkR1ul1ERW_Gm-lSTi8IRZRXrkdvh_TduTHfzGJFBf6hIn3up60_vyvB513H79UvsRX8Ky5U8nfMLaJKsR5_Hsk6XiJi0M5GhZwEeG-Vhq-FDk Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 401134781af34fdb8c48d8b07bb6a82a Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-DeleteServersTestJSON-133103711 Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/401134781af34fdb8c48d8b07bb6a82a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/401134781af34fdb8c48d8b07bb6a82a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_401134781af34fdb8c48d8b07bb6a82a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/401134781af34fdb8c48d8b07bb6a82a"}]}] Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-DeleteServersTestJSON-133103711 Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 401134781af34fdb8c48d8b07bb6a82a Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-DeleteServersTestJSON-133103711 Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-DeleteServersTestJSON-133103711-project Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 15c674279db249deaa437c1788371370 Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-DeleteServersTestJSON-133103711-project Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance fc99856b-2fa5-4c1b-972e-3de9e06e9824 could not be found. Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'fc99856b-2fa5-4c1b-972e-3de9e06e9824'} Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc99856b-2fa5-4c1b-972e-3de9e06e9824 could not be found. Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc99856b-2fa5-4c1b-972e-3de9e06e9824 could not be found. Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:57:41.564604 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:57:41.569386 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:57:41.569386 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:57:41.569386 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:57:41.569386 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:57:41.569386 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:57:41.569386 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc99856b-2fa5-4c1b-972e-3de9e06e9824 could not be found. Oct 26 13:57:41.569386 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:57:41.569386 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f4736f3a-dbc6-4cbc-a21c-5917411929db tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Returning 404 to user: Instance fc99856b-2fa5-4c1b-972e-3de9e06e9824 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:57:41.569386 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f4736f3a-dbc6-4cbc-a21c-5917411929db tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] 10.222.0.40 "GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824" status: 404 len: 111 microversion: 2.1 time: 0.031701 Oct 26 13:57:41.569386 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3519/7014] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:57:41 2022] GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 13:57:41.579966 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9120860a-ed15-4bf2-9386-69c73644f81d tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:57:41.580561 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9120860a-ed15-4bf2-9386-69c73644f81d tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:57:41.587117 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9120860a-ed15-4bf2-9386-69c73644f81d tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:41.587604 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9120860a-ed15-4bf2-9386-69c73644f81d tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:41.588049 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9120860a-ed15-4bf2-9386-69c73644f81d tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:41.588756 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9120860a-ed15-4bf2-9386-69c73644f81d tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:41.589233 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9120860a-ed15-4bf2-9386-69c73644f81d tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:41.589701 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9120860a-ed15-4bf2-9386-69c73644f81d tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:41.603282 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-9120860a-ed15-4bf2-9386-69c73644f81d tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] HTTP exception thrown: Instance fc99856b-2fa5-4c1b-972e-3de9e06e9824 could not be found. Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9120860a-ed15-4bf2-9386-69c73644f81d tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Request method failure captured: Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 HTTP/1.1 Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTyjE3X69cNLi1_H377UJw6bg3-FrkK-sgW1UiyljZqqS46OPXI0BlpRbqD250BTYfkR1ul1ERW_Gm-lSTi8IRZRXrkdvh_TduTHfzGJFBf6hIn3up60_vyvB513H79UvsRX8Ky5U8nfMLaJKsR5_Hsk6XiJi0M5GhZwEeG-Vhq-FDk Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 401134781af34fdb8c48d8b07bb6a82a Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-DeleteServersTestJSON-133103711 Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/401134781af34fdb8c48d8b07bb6a82a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/401134781af34fdb8c48d8b07bb6a82a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_401134781af34fdb8c48d8b07bb6a82a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/401134781af34fdb8c48d8b07bb6a82a"}]}] Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-DeleteServersTestJSON-133103711 Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 401134781af34fdb8c48d8b07bb6a82a Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-DeleteServersTestJSON-133103711 Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-DeleteServersTestJSON-133103711-project Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 15c674279db249deaa437c1788371370 Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-DeleteServersTestJSON-133103711-project Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance fc99856b-2fa5-4c1b-972e-3de9e06e9824 could not be found. Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'fc99856b-2fa5-4c1b-972e-3de9e06e9824'} Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc99856b-2fa5-4c1b-972e-3de9e06e9824 could not be found. Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:57:41.604938 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:57:41.609881 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc99856b-2fa5-4c1b-972e-3de9e06e9824 could not be found. Oct 26 13:57:41.609881 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:57:41.609881 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:57:41.609881 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:57:41.609881 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:57:41.609881 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:57:41.609881 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:57:41.609881 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:57:41.609881 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:57:41.609881 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc99856b-2fa5-4c1b-972e-3de9e06e9824 could not be found. Oct 26 13:57:41.609881 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:57:41.609881 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9120860a-ed15-4bf2-9386-69c73644f81d tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Returning 404 to user: Instance fc99856b-2fa5-4c1b-972e-3de9e06e9824 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:57:41.609881 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9120860a-ed15-4bf2-9386-69c73644f81d tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] 10.222.0.40 "DELETE /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824" status: 404 len: 111 microversion: 2.1 time: 0.030896 Oct 26 13:57:41.609881 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3496/7015] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:57:41 2022] DELETE /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:57:41.615602 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-11c15a52-9fa9-4fbc-a216-6809c47e88a0 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:57:41.616230 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-11c15a52-9fa9-4fbc-a216-6809c47e88a0 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] [instance: fc99856b-2fa5-4c1b-972e-3de9e06e9824] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:57:41.622187 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11c15a52-9fa9-4fbc-a216-6809c47e88a0 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:41.622676 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11c15a52-9fa9-4fbc-a216-6809c47e88a0 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:41.623123 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11c15a52-9fa9-4fbc-a216-6809c47e88a0 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:41.623820 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11c15a52-9fa9-4fbc-a216-6809c47e88a0 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:41.624293 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11c15a52-9fa9-4fbc-a216-6809c47e88a0 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:41.625335 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11c15a52-9fa9-4fbc-a216-6809c47e88a0 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:41.642240 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-11c15a52-9fa9-4fbc-a216-6809c47e88a0 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] HTTP exception thrown: Instance fc99856b-2fa5-4c1b-972e-3de9e06e9824 could not be found. Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-11c15a52-9fa9-4fbc-a216-6809c47e88a0 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Request method failure captured: Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 HTTP/1.1 Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTyjE3X69cNLi1_H377UJw6bg3-FrkK-sgW1UiyljZqqS46OPXI0BlpRbqD250BTYfkR1ul1ERW_Gm-lSTi8IRZRXrkdvh_TduTHfzGJFBf6hIn3up60_vyvB513H79UvsRX8Ky5U8nfMLaJKsR5_Hsk6XiJi0M5GhZwEeG-Vhq-FDk Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 401134781af34fdb8c48d8b07bb6a82a Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-DeleteServersTestJSON-133103711 Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/401134781af34fdb8c48d8b07bb6a82a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/401134781af34fdb8c48d8b07bb6a82a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_401134781af34fdb8c48d8b07bb6a82a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/401134781af34fdb8c48d8b07bb6a82a"}]}] Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-DeleteServersTestJSON-133103711 Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 401134781af34fdb8c48d8b07bb6a82a Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-DeleteServersTestJSON-133103711 Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-DeleteServersTestJSON-133103711-project Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 15c674279db249deaa437c1788371370 Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-DeleteServersTestJSON-133103711-project Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance fc99856b-2fa5-4c1b-972e-3de9e06e9824 could not be found. Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'fc99856b-2fa5-4c1b-972e-3de9e06e9824'} Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc99856b-2fa5-4c1b-972e-3de9e06e9824 could not be found. Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc99856b-2fa5-4c1b-972e-3de9e06e9824 could not be found. Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:57:41.643770 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:57:41.648535 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:57:41.648535 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:57:41.648535 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:57:41.648535 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:57:41.648535 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:57:41.648535 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc99856b-2fa5-4c1b-972e-3de9e06e9824 could not be found. Oct 26 13:57:41.648535 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:57:41.648535 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-11c15a52-9fa9-4fbc-a216-6809c47e88a0 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] Returning 404 to user: Instance fc99856b-2fa5-4c1b-972e-3de9e06e9824 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:57:41.648535 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-11c15a52-9fa9-4fbc-a216-6809c47e88a0 tempest-DeleteServersTestJSON-133103711 tempest-DeleteServersTestJSON-133103711-project] 10.222.0.40 "GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824" status: 404 len: 111 microversion: 2.1 time: 0.033428 Oct 26 13:57:41.648535 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3520/7016] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:57:41 2022] GET /compute/v2.1/servers/fc99856b-2fa5-4c1b-972e-3de9e06e9824 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 13:57:50.082692 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0cc6cd58-a10a-4044-829b-71a76d731eaf tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-828099062", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "f5055157-7f14-4f0e-937e-8d68e67d66e0"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:57:50.143216 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-0cc6cd58-a10a-4044-829b-71a76d731eaf tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] validate_networks() for [('f5055157-7f14-4f0e-937e-8d68e67d66e0', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:57:50.554495 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-0cc6cd58-a10a-4044-829b-71a76d731eaf tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:57:50.554918 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-0cc6cd58-a10a-4044-829b-71a76d731eaf tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:57:50.555395 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-0cc6cd58-a10a-4044-829b-71a76d731eaf tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:57:50.555815 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-0cc6cd58-a10a-4044-829b-71a76d731eaf tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:57:50.556231 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-0cc6cd58-a10a-4044-829b-71a76d731eaf tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:57:50.566346 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0cc6cd58-a10a-4044-829b-71a76d731eaf tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:50.566842 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0cc6cd58-a10a-4044-829b-71a76d731eaf tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:50.567284 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0cc6cd58-a10a-4044-829b-71a76d731eaf tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:50.568038 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0cc6cd58-a10a-4044-829b-71a76d731eaf tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:50.568480 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0cc6cd58-a10a-4044-829b-71a76d731eaf tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:50.568918 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0cc6cd58-a10a-4044-829b-71a76d731eaf tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:50.586934 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-0cc6cd58-a10a-4044-829b-71a76d731eaf tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Getting quotas for project 726b21631dc54c5b8acb4840ca9fd26d. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:57:50.593795 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-0cc6cd58-a10a-4044-829b-71a76d731eaf tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Getting quotas for user b7e18c48f4b14f6bae21de79f785e93e and project 726b21631dc54c5b8acb4840ca9fd26d. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:57:50.607228 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0cc6cd58-a10a-4044-829b-71a76d731eaf tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:57:50.610129 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0cc6cd58-a10a-4044-829b-71a76d731eaf tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:57:50.662058 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0cc6cd58-a10a-4044-829b-71a76d731eaf tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.728212 Oct 26 13:57:50.662741 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3497/7017] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:57:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 26 13:57:50.674871 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9b63c344-a318-4e84-96fd-cc9fd1c29a4f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:57:50.675768 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9b63c344-a318-4e84-96fd-cc9fd1c29a4f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:57:50.732218 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9b63c344-a318-4e84-96fd-cc9fd1c29a4f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:57:50.741381 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9b63c344-a318-4e84-96fd-cc9fd1c29a4f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 200 len: 1217 microversion: 2.1 time: 0.071284 Oct 26 13:57:50.742177 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3521/7018] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:57:50 2022] GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 1217 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:57:51.767093 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-821400f3-da29-4cfe-bc53-4259eb88d2f6 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:57:51.767709 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-821400f3-da29-4cfe-bc53-4259eb88d2f6 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:57:51.776667 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-821400f3-da29-4cfe-bc53-4259eb88d2f6 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:51.777159 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-821400f3-da29-4cfe-bc53-4259eb88d2f6 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:51.777756 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-821400f3-da29-4cfe-bc53-4259eb88d2f6 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:51.778458 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-821400f3-da29-4cfe-bc53-4259eb88d2f6 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:51.779076 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-821400f3-da29-4cfe-bc53-4259eb88d2f6 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:51.779665 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-821400f3-da29-4cfe-bc53-4259eb88d2f6 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:51.884800 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-821400f3-da29-4cfe-bc53-4259eb88d2f6 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:57:51.898269 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-821400f3-da29-4cfe-bc53-4259eb88d2f6 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 200 len: 1277 microversion: 2.1 time: 0.136926 Oct 26 13:57:51.899119 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3498/7019] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:57:51 2022] GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 1277 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:57:52.923953 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0977fb67-bc10-4df7-8449-0dd6268f7832 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:57:52.924688 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0977fb67-bc10-4df7-8449-0dd6268f7832 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:57:52.927367 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:57:52.935742 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0977fb67-bc10-4df7-8449-0dd6268f7832 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:52.936355 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0977fb67-bc10-4df7-8449-0dd6268f7832 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:52.937934 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0977fb67-bc10-4df7-8449-0dd6268f7832 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:52.938912 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0977fb67-bc10-4df7-8449-0dd6268f7832 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:52.939453 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0977fb67-bc10-4df7-8449-0dd6268f7832 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:52.939962 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0977fb67-bc10-4df7-8449-0dd6268f7832 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:53.169789 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0977fb67-bc10-4df7-8449-0dd6268f7832 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:57:53.178710 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0977fb67-bc10-4df7-8449-0dd6268f7832 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 200 len: 1317 microversion: 2.1 time: 0.260386 Oct 26 13:57:53.180184 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3522/7020] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:57:52 2022] GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 1317 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:57:53.338014 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-d99b96af-8136-4cfe-a39e-10211c41392c req-7263a16f-bd76-47df-be04-ce7adeb9f5ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d62339f-8ae9-4dc9-b99d-9227d2194d1f", "tag": "ab37bb42-741a-4d52-a4ea-11f9adef66b5"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:57:53.354399 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d99b96af-8136-4cfe-a39e-10211c41392c req-7263a16f-bd76-47df-be04-ce7adeb9f5ae service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:53.355161 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d99b96af-8136-4cfe-a39e-10211c41392c req-7263a16f-bd76-47df-be04-ce7adeb9f5ae service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:53.355748 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d99b96af-8136-4cfe-a39e-10211c41392c req-7263a16f-bd76-47df-be04-ce7adeb9f5ae service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:53.368576 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-d99b96af-8136-4cfe-a39e-10211c41392c req-7263a16f-bd76-47df-be04-ce7adeb9f5ae service nova] Creating event network-changed:ab37bb42-741a-4d52-a4ea-11f9adef66b5 for instance 0d62339f-8ae9-4dc9-b99d-9227d2194d1f on n-h1-862686-1 Oct 26 13:57:53.373766 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-d99b96af-8136-4cfe-a39e-10211c41392c req-7263a16f-bd76-47df-be04-ce7adeb9f5ae service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039420 Oct 26 13:57:53.374922 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3499/7021] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:57:54.204372 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4b96833a-4a0d-40ad-b90b-beb9d5c40539 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:57:54.205112 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4b96833a-4a0d-40ad-b90b-beb9d5c40539 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:57:54.212071 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4b96833a-4a0d-40ad-b90b-beb9d5c40539 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:54.212568 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4b96833a-4a0d-40ad-b90b-beb9d5c40539 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:54.213019 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4b96833a-4a0d-40ad-b90b-beb9d5c40539 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:54.213751 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4b96833a-4a0d-40ad-b90b-beb9d5c40539 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:54.214226 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4b96833a-4a0d-40ad-b90b-beb9d5c40539 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:54.214668 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4b96833a-4a0d-40ad-b90b-beb9d5c40539 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:54.355070 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4b96833a-4a0d-40ad-b90b-beb9d5c40539 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:57:54.363088 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4b96833a-4a0d-40ad-b90b-beb9d5c40539 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 200 len: 1317 microversion: 2.1 time: 0.163050 Oct 26 13:57:54.363675 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3523/7022] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:57:54 2022] GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:57:55.387172 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-315b9e3c-e0a0-44b9-a0aa-e1ea6270a495 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:57:55.387912 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-315b9e3c-e0a0-44b9-a0aa-e1ea6270a495 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:57:55.397039 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-315b9e3c-e0a0-44b9-a0aa-e1ea6270a495 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:55.397609 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-315b9e3c-e0a0-44b9-a0aa-e1ea6270a495 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:55.397971 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-315b9e3c-e0a0-44b9-a0aa-e1ea6270a495 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:55.398662 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-315b9e3c-e0a0-44b9-a0aa-e1ea6270a495 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:55.399115 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-315b9e3c-e0a0-44b9-a0aa-e1ea6270a495 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:55.399550 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-315b9e3c-e0a0-44b9-a0aa-e1ea6270a495 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:55.531750 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-315b9e3c-e0a0-44b9-a0aa-e1ea6270a495 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:57:55.539662 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-315b9e3c-e0a0-44b9-a0aa-e1ea6270a495 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 200 len: 1317 microversion: 2.1 time: 0.157209 Oct 26 13:57:55.540235 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3500/7023] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:57:55 2022] GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:57:56.562567 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2d7f193d-2d42-4aab-b870-396043f34a99 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:57:56.563239 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2d7f193d-2d42-4aab-b870-396043f34a99 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:57:56.570391 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d7f193d-2d42-4aab-b870-396043f34a99 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:56.570897 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d7f193d-2d42-4aab-b870-396043f34a99 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:56.571355 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d7f193d-2d42-4aab-b870-396043f34a99 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:56.572071 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d7f193d-2d42-4aab-b870-396043f34a99 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:56.572548 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d7f193d-2d42-4aab-b870-396043f34a99 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:56.572998 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d7f193d-2d42-4aab-b870-396043f34a99 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:56.709369 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2d7f193d-2d42-4aab-b870-396043f34a99 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:57:56.717105 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2d7f193d-2d42-4aab-b870-396043f34a99 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 200 len: 1317 microversion: 2.1 time: 0.158659 Oct 26 13:57:56.717722 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3524/7024] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:57:56 2022] GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:57:57.741097 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-67f6d135-d37a-469f-976a-5cdeee1ef75f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:57:57.741674 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-67f6d135-d37a-469f-976a-5cdeee1ef75f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:57:57.748722 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-67f6d135-d37a-469f-976a-5cdeee1ef75f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:57.749208 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-67f6d135-d37a-469f-976a-5cdeee1ef75f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:57.749683 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-67f6d135-d37a-469f-976a-5cdeee1ef75f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:57.750509 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-67f6d135-d37a-469f-976a-5cdeee1ef75f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:57.750966 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-67f6d135-d37a-469f-976a-5cdeee1ef75f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:57.751402 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-67f6d135-d37a-469f-976a-5cdeee1ef75f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:57.884655 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-67f6d135-d37a-469f-976a-5cdeee1ef75f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:57:57.892951 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-67f6d135-d37a-469f-976a-5cdeee1ef75f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 200 len: 1317 microversion: 2.1 time: 0.155832 Oct 26 13:57:57.893540 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3501/7025] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:57:57 2022] GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:57:58.916371 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2ae319ad-99c2-4eaa-abe5-8f3f8f5a0dc3 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:57:58.916998 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2ae319ad-99c2-4eaa-abe5-8f3f8f5a0dc3 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:57:58.924552 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ae319ad-99c2-4eaa-abe5-8f3f8f5a0dc3 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:58.925048 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ae319ad-99c2-4eaa-abe5-8f3f8f5a0dc3 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:58.925520 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ae319ad-99c2-4eaa-abe5-8f3f8f5a0dc3 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:58.926228 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ae319ad-99c2-4eaa-abe5-8f3f8f5a0dc3 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:58.926698 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ae319ad-99c2-4eaa-abe5-8f3f8f5a0dc3 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:58.927140 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ae319ad-99c2-4eaa-abe5-8f3f8f5a0dc3 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:59.059660 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2ae319ad-99c2-4eaa-abe5-8f3f8f5a0dc3 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:57:59.067658 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2ae319ad-99c2-4eaa-abe5-8f3f8f5a0dc3 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 200 len: 1317 microversion: 2.1 time: 0.155291 Oct 26 13:57:59.068236 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3525/7026] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:57:58 2022] GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:57:59.106376 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-165ce846-31c2-496e-a156-393dd6ab8ee3 req-8982c98b-5d27-4a0b-8aa8-f387f21642b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d62339f-8ae9-4dc9-b99d-9227d2194d1f", "name": "network-vif-plugged", "status": "completed", "tag": "ab37bb42-741a-4d52-a4ea-11f9adef66b5"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:57:59.117932 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-165ce846-31c2-496e-a156-393dd6ab8ee3 req-8982c98b-5d27-4a0b-8aa8-f387f21642b8 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:57:59.118435 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-165ce846-31c2-496e-a156-393dd6ab8ee3 req-8982c98b-5d27-4a0b-8aa8-f387f21642b8 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:57:59.118867 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-165ce846-31c2-496e-a156-393dd6ab8ee3 req-8982c98b-5d27-4a0b-8aa8-f387f21642b8 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:57:59.130567 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-165ce846-31c2-496e-a156-393dd6ab8ee3 req-8982c98b-5d27-4a0b-8aa8-f387f21642b8 service nova] Creating event network-vif-plugged:ab37bb42-741a-4d52-a4ea-11f9adef66b5 for instance 0d62339f-8ae9-4dc9-b99d-9227d2194d1f on n-h1-862686-1 Oct 26 13:57:59.135715 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-165ce846-31c2-496e-a156-393dd6ab8ee3 req-8982c98b-5d27-4a0b-8aa8-f387f21642b8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033122 Oct 26 13:57:59.136693 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3502/7027] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:58:00.090657 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a63fca1b-cf01-4121-8d1f-3af874d629ae tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:00.091280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a63fca1b-cf01-4121-8d1f-3af874d629ae tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:00.098236 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a63fca1b-cf01-4121-8d1f-3af874d629ae tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:00.098732 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a63fca1b-cf01-4121-8d1f-3af874d629ae tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:00.099178 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a63fca1b-cf01-4121-8d1f-3af874d629ae tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:00.099881 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a63fca1b-cf01-4121-8d1f-3af874d629ae tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:00.100348 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a63fca1b-cf01-4121-8d1f-3af874d629ae tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:00.100784 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a63fca1b-cf01-4121-8d1f-3af874d629ae tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:00.232899 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a63fca1b-cf01-4121-8d1f-3af874d629ae tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:00.241193 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a63fca1b-cf01-4121-8d1f-3af874d629ae tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 200 len: 1317 microversion: 2.1 time: 0.154455 Oct 26 13:58:00.241794 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3526/7028] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:00 2022] GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:01.262375 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:58:01.263090 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:58:01.267913 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c8b15ef2-20e6-4a90-9af2-24c217696abd tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:01.268612 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c8b15ef2-20e6-4a90-9af2-24c217696abd tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:01.275651 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c8b15ef2-20e6-4a90-9af2-24c217696abd tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:01.276137 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c8b15ef2-20e6-4a90-9af2-24c217696abd tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:01.276581 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c8b15ef2-20e6-4a90-9af2-24c217696abd tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:01.277279 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c8b15ef2-20e6-4a90-9af2-24c217696abd tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:01.277769 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c8b15ef2-20e6-4a90-9af2-24c217696abd tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:01.278196 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c8b15ef2-20e6-4a90-9af2-24c217696abd tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:01.406366 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c8b15ef2-20e6-4a90-9af2-24c217696abd tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:01.414508 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c8b15ef2-20e6-4a90-9af2-24c217696abd tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 200 len: 1507 microversion: 2.1 time: 0.154002 Oct 26 13:58:01.415095 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3503/7029] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:01 2022] GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:01.438011 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e982d98d-7805-439b-a11e-f9560dd4e3f2 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:01.438645 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e982d98d-7805-439b-a11e-f9560dd4e3f2 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:01.440576 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:58:01.446749 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e982d98d-7805-439b-a11e-f9560dd4e3f2 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:01.447203 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e982d98d-7805-439b-a11e-f9560dd4e3f2 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:01.447656 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e982d98d-7805-439b-a11e-f9560dd4e3f2 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:01.448365 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e982d98d-7805-439b-a11e-f9560dd4e3f2 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:01.448840 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e982d98d-7805-439b-a11e-f9560dd4e3f2 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:01.449279 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e982d98d-7805-439b-a11e-f9560dd4e3f2 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:01.580075 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e982d98d-7805-439b-a11e-f9560dd4e3f2 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:01.587836 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e982d98d-7805-439b-a11e-f9560dd4e3f2 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 200 len: 1507 microversion: 2.1 time: 0.154490 Oct 26 13:58:01.588425 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3527/7030] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:01 2022] GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:01.609932 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-55d1b280-0e6d-46f8-b747-01e7b281ef64 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:58:01.612401 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-55d1b280-0e6d-46f8-b747-01e7b281ef64 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:01.618378 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-55d1b280-0e6d-46f8-b747-01e7b281ef64 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:01.618870 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-55d1b280-0e6d-46f8-b747-01e7b281ef64 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:01.619312 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-55d1b280-0e6d-46f8-b747-01e7b281ef64 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:01.620003 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-55d1b280-0e6d-46f8-b747-01e7b281ef64 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:01.620464 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-55d1b280-0e6d-46f8-b747-01e7b281ef64 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:01.620889 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-55d1b280-0e6d-46f8-b747-01e7b281ef64 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:01.685967 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-55d1b280-0e6d-46f8-b747-01e7b281ef64 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "PUT /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 200 len: 1079 microversion: 2.1 time: 0.079812 Oct 26 13:58:01.686701 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3504/7031] 10.222.0.40 () {60 vars in 1256 bytes} [Wed Oct 26 13:58:01 2022] PUT /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 1079 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:01.706446 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1f7df816-2253-4c37-ba0c-7f40d38faafa tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:01.707067 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1f7df816-2253-4c37-ba0c-7f40d38faafa tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:01.713079 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f7df816-2253-4c37-ba0c-7f40d38faafa tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:01.713615 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f7df816-2253-4c37-ba0c-7f40d38faafa tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:01.714065 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f7df816-2253-4c37-ba0c-7f40d38faafa tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:01.714762 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f7df816-2253-4c37-ba0c-7f40d38faafa tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:01.715226 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f7df816-2253-4c37-ba0c-7f40d38faafa tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:01.715663 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f7df816-2253-4c37-ba0c-7f40d38faafa tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:01.845590 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1f7df816-2253-4c37-ba0c-7f40d38faafa tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:01.853287 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1f7df816-2253-4c37-ba0c-7f40d38faafa tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 200 len: 1505 microversion: 2.1 time: 0.151476 Oct 26 13:58:01.853889 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3528/7032] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:01 2022] GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:01.876951 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a60c56a9-54f7-496e-81d6-d65213de5782 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:01.877632 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a60c56a9-54f7-496e-81d6-d65213de5782 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:01.883781 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a60c56a9-54f7-496e-81d6-d65213de5782 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:01.884264 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a60c56a9-54f7-496e-81d6-d65213de5782 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:01.884702 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a60c56a9-54f7-496e-81d6-d65213de5782 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:01.885390 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a60c56a9-54f7-496e-81d6-d65213de5782 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:01.885871 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a60c56a9-54f7-496e-81d6-d65213de5782 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:01.886295 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a60c56a9-54f7-496e-81d6-d65213de5782 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:02.020930 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a60c56a9-54f7-496e-81d6-d65213de5782 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:02.028734 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a60c56a9-54f7-496e-81d6-d65213de5782 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 200 len: 1505 microversion: 2.1 time: 0.157051 Oct 26 13:58:02.029312 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3505/7033] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:01 2022] GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:02.051404 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-79cc8101-9552-4468-9378-49c71029878d tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:58:02.053773 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-79cc8101-9552-4468-9378-49c71029878d tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:02.059671 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-79cc8101-9552-4468-9378-49c71029878d tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:02.060174 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-79cc8101-9552-4468-9378-49c71029878d tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:02.060629 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-79cc8101-9552-4468-9378-49c71029878d tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:02.061333 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-79cc8101-9552-4468-9378-49c71029878d tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:02.061833 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-79cc8101-9552-4468-9378-49c71029878d tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:02.062968 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-79cc8101-9552-4468-9378-49c71029878d tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:02.091548 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-79cc8101-9552-4468-9378-49c71029878d tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:02.097086 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-79cc8101-9552-4468-9378-49c71029878d tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Old instance type m1.heat2, new instance type m1.heat {{(pid=120598) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 26 13:58:02.103601 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-79cc8101-9552-4468-9378-49c71029878d tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:58:02.104039 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-79cc8101-9552-4468-9378-49c71029878d tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:58:02.104524 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-79cc8101-9552-4468-9378-49c71029878d tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:58:02.104951 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-79cc8101-9552-4468-9378-49c71029878d tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:58:02.105383 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-79cc8101-9552-4468-9378-49c71029878d tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:58:02.168809 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-79cc8101-9552-4468-9378-49c71029878d tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "POST /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f/action" status: 202 len: 0 microversion: 2.1 time: 0.121518 Oct 26 13:58:02.169424 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3529/7034] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:58:02 2022] POST /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:58:02.177661 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a3c5a8a3-b4de-4dc9-95a0-31641c6e1526 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:02.178298 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a3c5a8a3-b4de-4dc9-95a0-31641c6e1526 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:02.184465 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a3c5a8a3-b4de-4dc9-95a0-31641c6e1526 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:02.184957 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a3c5a8a3-b4de-4dc9-95a0-31641c6e1526 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:02.185404 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a3c5a8a3-b4de-4dc9-95a0-31641c6e1526 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:02.186134 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a3c5a8a3-b4de-4dc9-95a0-31641c6e1526 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:02.186595 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a3c5a8a3-b4de-4dc9-95a0-31641c6e1526 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:02.187027 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a3c5a8a3-b4de-4dc9-95a0-31641c6e1526 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:02.327582 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a3c5a8a3-b4de-4dc9-95a0-31641c6e1526 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:02.335842 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a3c5a8a3-b4de-4dc9-95a0-31641c6e1526 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 200 len: 1516 microversion: 2.1 time: 0.162158 Oct 26 13:58:02.336418 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3506/7035] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:02 2022] GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:03.360800 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b2d0b61c-4123-4911-98a2-19b3feb8236d tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:03.361461 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b2d0b61c-4123-4911-98a2-19b3feb8236d tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:03.368456 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b2d0b61c-4123-4911-98a2-19b3feb8236d tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:03.368958 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b2d0b61c-4123-4911-98a2-19b3feb8236d tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:03.369411 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b2d0b61c-4123-4911-98a2-19b3feb8236d tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:03.370155 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b2d0b61c-4123-4911-98a2-19b3feb8236d tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:03.370629 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b2d0b61c-4123-4911-98a2-19b3feb8236d tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:03.371074 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b2d0b61c-4123-4911-98a2-19b3feb8236d tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:03.588979 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b2d0b61c-4123-4911-98a2-19b3feb8236d tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:03.597497 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b2d0b61c-4123-4911-98a2-19b3feb8236d tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 200 len: 1516 microversion: 2.1 time: 0.241860 Oct 26 13:58:03.598097 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3530/7036] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:03 2022] GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 1516 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:04.620173 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e7064da8-da6f-4adb-8f65-aeebc43ebeee tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:04.620791 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e7064da8-da6f-4adb-8f65-aeebc43ebeee tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:04.623498 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:58:04.628897 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e7064da8-da6f-4adb-8f65-aeebc43ebeee tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:04.629418 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e7064da8-da6f-4adb-8f65-aeebc43ebeee tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:04.629886 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e7064da8-da6f-4adb-8f65-aeebc43ebeee tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:04.630581 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e7064da8-da6f-4adb-8f65-aeebc43ebeee tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:04.631040 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e7064da8-da6f-4adb-8f65-aeebc43ebeee tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:04.631474 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e7064da8-da6f-4adb-8f65-aeebc43ebeee tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:04.634758 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:58:04.765708 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e7064da8-da6f-4adb-8f65-aeebc43ebeee tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:04.773246 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e7064da8-da6f-4adb-8f65-aeebc43ebeee tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 200 len: 1521 microversion: 2.1 time: 0.156989 Oct 26 13:58:04.773860 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3507/7037] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:04 2022] GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:05.796259 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2114d87d-cd30-415f-a0a5-7442d43ad52c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:05.796957 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2114d87d-cd30-415f-a0a5-7442d43ad52c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:05.799638 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:58:05.805002 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2114d87d-cd30-415f-a0a5-7442d43ad52c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:05.805534 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2114d87d-cd30-415f-a0a5-7442d43ad52c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:05.805990 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2114d87d-cd30-415f-a0a5-7442d43ad52c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:05.806707 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2114d87d-cd30-415f-a0a5-7442d43ad52c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:05.807185 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2114d87d-cd30-415f-a0a5-7442d43ad52c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:05.807635 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2114d87d-cd30-415f-a0a5-7442d43ad52c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:05.944213 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2114d87d-cd30-415f-a0a5-7442d43ad52c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:05.951998 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2114d87d-cd30-415f-a0a5-7442d43ad52c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 200 len: 1521 microversion: 2.1 time: 0.159739 Oct 26 13:58:05.952596 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3531/7038] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:05 2022] GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:06.975546 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-166fe68f-3fe6-40d8-b58c-10de4717bbd3 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:06.976166 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-166fe68f-3fe6-40d8-b58c-10de4717bbd3 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:06.983133 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-166fe68f-3fe6-40d8-b58c-10de4717bbd3 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:06.983621 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-166fe68f-3fe6-40d8-b58c-10de4717bbd3 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:06.984102 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-166fe68f-3fe6-40d8-b58c-10de4717bbd3 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:06.984873 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-166fe68f-3fe6-40d8-b58c-10de4717bbd3 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:06.985338 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-166fe68f-3fe6-40d8-b58c-10de4717bbd3 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:06.985797 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-166fe68f-3fe6-40d8-b58c-10de4717bbd3 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:07.112867 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-166fe68f-3fe6-40d8-b58c-10de4717bbd3 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:07.120576 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-166fe68f-3fe6-40d8-b58c-10de4717bbd3 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 200 len: 1521 microversion: 2.1 time: 0.148984 Oct 26 13:58:07.121177 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3508/7039] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:06 2022] GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:08.144863 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e4b5ff7a-54fe-4faf-acfa-913b2e4bcda4 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:08.145427 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e4b5ff7a-54fe-4faf-acfa-913b2e4bcda4 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:08.152222 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4b5ff7a-54fe-4faf-acfa-913b2e4bcda4 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:08.152714 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4b5ff7a-54fe-4faf-acfa-913b2e4bcda4 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:08.153161 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4b5ff7a-54fe-4faf-acfa-913b2e4bcda4 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:08.153904 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4b5ff7a-54fe-4faf-acfa-913b2e4bcda4 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:08.154369 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4b5ff7a-54fe-4faf-acfa-913b2e4bcda4 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:08.154806 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4b5ff7a-54fe-4faf-acfa-913b2e4bcda4 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:08.284538 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e4b5ff7a-54fe-4faf-acfa-913b2e4bcda4 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:08.292271 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e4b5ff7a-54fe-4faf-acfa-913b2e4bcda4 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 200 len: 1521 microversion: 2.1 time: 0.151409 Oct 26 13:58:08.292840 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3532/7040] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:08 2022] GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:09.316760 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-241e5bef-1039-4a93-9c3f-ad8e9d9eaf3c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:09.317508 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-241e5bef-1039-4a93-9c3f-ad8e9d9eaf3c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:09.324537 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-241e5bef-1039-4a93-9c3f-ad8e9d9eaf3c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:09.325017 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-241e5bef-1039-4a93-9c3f-ad8e9d9eaf3c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:09.325451 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-241e5bef-1039-4a93-9c3f-ad8e9d9eaf3c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:09.326162 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-241e5bef-1039-4a93-9c3f-ad8e9d9eaf3c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:09.326613 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-241e5bef-1039-4a93-9c3f-ad8e9d9eaf3c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:09.327037 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-241e5bef-1039-4a93-9c3f-ad8e9d9eaf3c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:09.456372 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-241e5bef-1039-4a93-9c3f-ad8e9d9eaf3c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:09.464037 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-241e5bef-1039-4a93-9c3f-ad8e9d9eaf3c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 200 len: 1521 microversion: 2.1 time: 0.152152 Oct 26 13:58:09.464605 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3509/7041] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:09 2022] GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:10.487851 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f02fac6d-44f8-4b85-a412-5b3d4e91cd4c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:10.488418 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f02fac6d-44f8-4b85-a412-5b3d4e91cd4c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:10.495397 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f02fac6d-44f8-4b85-a412-5b3d4e91cd4c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:10.495890 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f02fac6d-44f8-4b85-a412-5b3d4e91cd4c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:10.496338 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f02fac6d-44f8-4b85-a412-5b3d4e91cd4c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:10.497032 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f02fac6d-44f8-4b85-a412-5b3d4e91cd4c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:10.497517 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f02fac6d-44f8-4b85-a412-5b3d4e91cd4c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:10.497957 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f02fac6d-44f8-4b85-a412-5b3d4e91cd4c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:10.633974 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f02fac6d-44f8-4b85-a412-5b3d4e91cd4c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:10.642382 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f02fac6d-44f8-4b85-a412-5b3d4e91cd4c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 200 len: 1521 microversion: 2.1 time: 0.158653 Oct 26 13:58:10.642955 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3533/7042] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:10 2022] GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:11.665429 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b0ed80e9-c64a-48d4-94cd-dcb70e6fdb3c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:11.666066 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b0ed80e9-c64a-48d4-94cd-dcb70e6fdb3c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:11.673690 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b0ed80e9-c64a-48d4-94cd-dcb70e6fdb3c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:11.674173 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b0ed80e9-c64a-48d4-94cd-dcb70e6fdb3c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:11.674609 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b0ed80e9-c64a-48d4-94cd-dcb70e6fdb3c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:11.675297 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b0ed80e9-c64a-48d4-94cd-dcb70e6fdb3c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:11.675750 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b0ed80e9-c64a-48d4-94cd-dcb70e6fdb3c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:11.676173 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b0ed80e9-c64a-48d4-94cd-dcb70e6fdb3c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:11.807444 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b0ed80e9-c64a-48d4-94cd-dcb70e6fdb3c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:11.815904 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b0ed80e9-c64a-48d4-94cd-dcb70e6fdb3c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 200 len: 1521 microversion: 2.1 time: 0.154335 Oct 26 13:58:11.816480 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3510/7043] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:11 2022] GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:12.839649 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b3f2143f-5687-4a08-a928-f56361c077a6 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:12.840274 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b3f2143f-5687-4a08-a928-f56361c077a6 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:12.847372 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3f2143f-5687-4a08-a928-f56361c077a6 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:12.847866 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3f2143f-5687-4a08-a928-f56361c077a6 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:12.848317 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3f2143f-5687-4a08-a928-f56361c077a6 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:12.849021 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3f2143f-5687-4a08-a928-f56361c077a6 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:12.849509 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3f2143f-5687-4a08-a928-f56361c077a6 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:12.849957 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3f2143f-5687-4a08-a928-f56361c077a6 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:12.978977 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b3f2143f-5687-4a08-a928-f56361c077a6 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:12.987655 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b3f2143f-5687-4a08-a928-f56361c077a6 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 200 len: 1521 microversion: 2.1 time: 0.151982 Oct 26 13:58:12.988230 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3534/7044] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:12 2022] GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:14.011067 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ed003044-4a1d-49e0-b8fb-d72248855fab tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:14.011687 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ed003044-4a1d-49e0-b8fb-d72248855fab tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:14.019786 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed003044-4a1d-49e0-b8fb-d72248855fab tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:14.020278 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed003044-4a1d-49e0-b8fb-d72248855fab tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:14.020722 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed003044-4a1d-49e0-b8fb-d72248855fab tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:14.021420 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed003044-4a1d-49e0-b8fb-d72248855fab tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:14.021908 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed003044-4a1d-49e0-b8fb-d72248855fab tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:14.022343 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed003044-4a1d-49e0-b8fb-d72248855fab tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:14.154192 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ed003044-4a1d-49e0-b8fb-d72248855fab tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:14.162685 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ed003044-4a1d-49e0-b8fb-d72248855fab tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 200 len: 1521 microversion: 2.1 time: 0.155532 Oct 26 13:58:14.163258 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3511/7045] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:14 2022] GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:58:15.185816 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0d4bf0b5-8163-4156-9a73-811d8fd2eb3a tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:15.186370 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0d4bf0b5-8163-4156-9a73-811d8fd2eb3a tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:15.193300 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d4bf0b5-8163-4156-9a73-811d8fd2eb3a tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:15.194184 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d4bf0b5-8163-4156-9a73-811d8fd2eb3a tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:15.194977 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d4bf0b5-8163-4156-9a73-811d8fd2eb3a tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:15.196244 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d4bf0b5-8163-4156-9a73-811d8fd2eb3a tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:15.197130 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d4bf0b5-8163-4156-9a73-811d8fd2eb3a tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:15.197978 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0d4bf0b5-8163-4156-9a73-811d8fd2eb3a tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:15.330435 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0d4bf0b5-8163-4156-9a73-811d8fd2eb3a tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:15.338149 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0d4bf0b5-8163-4156-9a73-811d8fd2eb3a tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 200 len: 1521 microversion: 2.1 time: 0.156477 Oct 26 13:58:15.338724 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3535/7046] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:15 2022] GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:16.362488 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1d407284-dfd9-474e-9923-df8b2a507379 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:16.363101 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1d407284-dfd9-474e-9923-df8b2a507379 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:16.369610 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d407284-dfd9-474e-9923-df8b2a507379 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:16.370104 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d407284-dfd9-474e-9923-df8b2a507379 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:16.370549 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d407284-dfd9-474e-9923-df8b2a507379 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:16.371248 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d407284-dfd9-474e-9923-df8b2a507379 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:16.371742 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d407284-dfd9-474e-9923-df8b2a507379 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:16.372176 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d407284-dfd9-474e-9923-df8b2a507379 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:16.505379 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1d407284-dfd9-474e-9923-df8b2a507379 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:16.513144 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1d407284-dfd9-474e-9923-df8b2a507379 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 200 len: 1521 microversion: 2.1 time: 0.154902 Oct 26 13:58:16.513757 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3512/7047] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:16 2022] GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:17.537305 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d854e702-260f-4658-a194-84d92055813f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:17.537971 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d854e702-260f-4658-a194-84d92055813f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:17.545080 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d854e702-260f-4658-a194-84d92055813f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:17.545621 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d854e702-260f-4658-a194-84d92055813f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:17.547821 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d854e702-260f-4658-a194-84d92055813f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:17.548562 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d854e702-260f-4658-a194-84d92055813f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:17.549043 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d854e702-260f-4658-a194-84d92055813f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:17.549504 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d854e702-260f-4658-a194-84d92055813f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:17.707586 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d854e702-260f-4658-a194-84d92055813f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:17.715344 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d854e702-260f-4658-a194-84d92055813f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 200 len: 1521 microversion: 2.1 time: 0.182301 Oct 26 13:58:17.715919 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3536/7048] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:17 2022] GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:18.739569 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4d6bbaec-97e4-4760-91aa-edbce4cf4b4b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:18.740606 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4d6bbaec-97e4-4760-91aa-edbce4cf4b4b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:18.749851 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4d6bbaec-97e4-4760-91aa-edbce4cf4b4b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:18.750351 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4d6bbaec-97e4-4760-91aa-edbce4cf4b4b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:18.750800 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4d6bbaec-97e4-4760-91aa-edbce4cf4b4b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:18.751513 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4d6bbaec-97e4-4760-91aa-edbce4cf4b4b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:18.752004 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4d6bbaec-97e4-4760-91aa-edbce4cf4b4b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:18.752438 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4d6bbaec-97e4-4760-91aa-edbce4cf4b4b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:18.900684 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4d6bbaec-97e4-4760-91aa-edbce4cf4b4b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:18.911282 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4d6bbaec-97e4-4760-91aa-edbce4cf4b4b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 200 len: 1521 microversion: 2.1 time: 0.175536 Oct 26 13:58:18.912263 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3513/7049] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:18 2022] GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:58:19.943876 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-40817061-f329-471e-a5df-f5b74dad1397 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:19.944550 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-40817061-f329-471e-a5df-f5b74dad1397 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:19.950853 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-40817061-f329-471e-a5df-f5b74dad1397 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:19.951351 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-40817061-f329-471e-a5df-f5b74dad1397 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:19.951800 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-40817061-f329-471e-a5df-f5b74dad1397 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:19.952504 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-40817061-f329-471e-a5df-f5b74dad1397 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:19.952971 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-40817061-f329-471e-a5df-f5b74dad1397 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:19.953410 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-40817061-f329-471e-a5df-f5b74dad1397 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:19.957403 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:58:20.085304 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-40817061-f329-471e-a5df-f5b74dad1397 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:20.093893 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-40817061-f329-471e-a5df-f5b74dad1397 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 200 len: 1521 microversion: 2.1 time: 0.153907 Oct 26 13:58:20.094424 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3537/7050] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:19 2022] GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:21.117652 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8f93510b-6a13-4b96-aaf2-8a951164444b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:21.118294 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8f93510b-6a13-4b96-aaf2-8a951164444b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:21.125766 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8f93510b-6a13-4b96-aaf2-8a951164444b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:21.126260 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8f93510b-6a13-4b96-aaf2-8a951164444b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:21.126704 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8f93510b-6a13-4b96-aaf2-8a951164444b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:21.127405 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8f93510b-6a13-4b96-aaf2-8a951164444b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:21.127917 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8f93510b-6a13-4b96-aaf2-8a951164444b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:21.128340 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8f93510b-6a13-4b96-aaf2-8a951164444b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:21.265733 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8f93510b-6a13-4b96-aaf2-8a951164444b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:21.273466 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8f93510b-6a13-4b96-aaf2-8a951164444b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 200 len: 1521 microversion: 2.1 time: 0.159778 Oct 26 13:58:21.274058 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3514/7051] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:21 2022] GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:22.297239 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-67b77823-fd8a-4463-9bc1-99b296a6c26c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:22.297893 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-67b77823-fd8a-4463-9bc1-99b296a6c26c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:22.304651 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-67b77823-fd8a-4463-9bc1-99b296a6c26c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:22.305150 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-67b77823-fd8a-4463-9bc1-99b296a6c26c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:22.305642 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-67b77823-fd8a-4463-9bc1-99b296a6c26c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:22.306350 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-67b77823-fd8a-4463-9bc1-99b296a6c26c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:22.306826 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-67b77823-fd8a-4463-9bc1-99b296a6c26c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:22.307263 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-67b77823-fd8a-4463-9bc1-99b296a6c26c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:22.434640 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-67b77823-fd8a-4463-9bc1-99b296a6c26c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:22.443056 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-67b77823-fd8a-4463-9bc1-99b296a6c26c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 200 len: 1521 microversion: 2.1 time: 0.150112 Oct 26 13:58:22.443631 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3538/7052] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:22 2022] GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:23.467233 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-50705a6b-6ee9-444f-8251-91e37bff6529 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:23.468995 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-50705a6b-6ee9-444f-8251-91e37bff6529 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:23.475820 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-50705a6b-6ee9-444f-8251-91e37bff6529 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:23.476297 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-50705a6b-6ee9-444f-8251-91e37bff6529 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:23.476728 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-50705a6b-6ee9-444f-8251-91e37bff6529 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:23.477421 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-50705a6b-6ee9-444f-8251-91e37bff6529 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:23.477903 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-50705a6b-6ee9-444f-8251-91e37bff6529 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:23.478328 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-50705a6b-6ee9-444f-8251-91e37bff6529 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:23.606684 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-50705a6b-6ee9-444f-8251-91e37bff6529 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:23.614816 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-50705a6b-6ee9-444f-8251-91e37bff6529 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 200 len: 1521 microversion: 2.1 time: 0.151455 Oct 26 13:58:23.615433 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3515/7053] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:23 2022] GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:24.638302 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d55088b9-50c1-45b1-90b2-aed9c7e6ed79 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:24.638994 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d55088b9-50c1-45b1-90b2-aed9c7e6ed79 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:24.646304 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d55088b9-50c1-45b1-90b2-aed9c7e6ed79 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:24.646805 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d55088b9-50c1-45b1-90b2-aed9c7e6ed79 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:24.647264 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d55088b9-50c1-45b1-90b2-aed9c7e6ed79 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:24.647979 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d55088b9-50c1-45b1-90b2-aed9c7e6ed79 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:24.648557 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d55088b9-50c1-45b1-90b2-aed9c7e6ed79 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:24.649003 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d55088b9-50c1-45b1-90b2-aed9c7e6ed79 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:24.788405 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d55088b9-50c1-45b1-90b2-aed9c7e6ed79 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:24.796754 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d55088b9-50c1-45b1-90b2-aed9c7e6ed79 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 200 len: 1521 microversion: 2.1 time: 0.162033 Oct 26 13:58:24.797326 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3539/7054] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:24 2022] GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:58:25.819875 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5ef7455e-9e13-425f-ab8a-50626967e64e tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:25.820497 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5ef7455e-9e13-425f-ab8a-50626967e64e tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:25.827841 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ef7455e-9e13-425f-ab8a-50626967e64e tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:25.828335 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ef7455e-9e13-425f-ab8a-50626967e64e tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:25.828766 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ef7455e-9e13-425f-ab8a-50626967e64e tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:25.829454 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ef7455e-9e13-425f-ab8a-50626967e64e tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:25.829933 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ef7455e-9e13-425f-ab8a-50626967e64e tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:25.830360 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ef7455e-9e13-425f-ab8a-50626967e64e tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:25.961432 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5ef7455e-9e13-425f-ab8a-50626967e64e tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:25.970521 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5ef7455e-9e13-425f-ab8a-50626967e64e tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 200 len: 1521 microversion: 2.1 time: 0.154706 Oct 26 13:58:25.971090 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3516/7055] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:25 2022] GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:26.994554 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1b9e86f6-80aa-4222-91bc-953091b360b2 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:26.995178 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1b9e86f6-80aa-4222-91bc-953091b360b2 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:27.002493 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b9e86f6-80aa-4222-91bc-953091b360b2 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:27.002981 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b9e86f6-80aa-4222-91bc-953091b360b2 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:27.003428 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b9e86f6-80aa-4222-91bc-953091b360b2 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:27.004125 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b9e86f6-80aa-4222-91bc-953091b360b2 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:27.004593 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b9e86f6-80aa-4222-91bc-953091b360b2 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:27.005030 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b9e86f6-80aa-4222-91bc-953091b360b2 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:27.134831 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1b9e86f6-80aa-4222-91bc-953091b360b2 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:27.143094 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1b9e86f6-80aa-4222-91bc-953091b360b2 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 200 len: 1521 microversion: 2.1 time: 0.153097 Oct 26 13:58:27.143660 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3540/7056] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:26 2022] GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:28.167157 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-abbe308c-25e4-466b-b6b1-65d28891e143 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:28.167778 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-abbe308c-25e4-466b-b6b1-65d28891e143 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:28.175382 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-abbe308c-25e4-466b-b6b1-65d28891e143 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:28.175866 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-abbe308c-25e4-466b-b6b1-65d28891e143 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:28.176303 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-abbe308c-25e4-466b-b6b1-65d28891e143 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:28.176993 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-abbe308c-25e4-466b-b6b1-65d28891e143 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:28.177449 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-abbe308c-25e4-466b-b6b1-65d28891e143 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:28.177907 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-abbe308c-25e4-466b-b6b1-65d28891e143 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:28.315652 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-abbe308c-25e4-466b-b6b1-65d28891e143 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:28.323547 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-abbe308c-25e4-466b-b6b1-65d28891e143 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 200 len: 1521 microversion: 2.1 time: 0.160329 Oct 26 13:58:28.324130 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3517/7057] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:28 2022] GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:29.346986 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-90ad8c11-d7c8-44f0-beb3-e3a647a3be9f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:29.347605 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-90ad8c11-d7c8-44f0-beb3-e3a647a3be9f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:29.354501 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90ad8c11-d7c8-44f0-beb3-e3a647a3be9f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:29.354994 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90ad8c11-d7c8-44f0-beb3-e3a647a3be9f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:29.355439 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90ad8c11-d7c8-44f0-beb3-e3a647a3be9f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:29.356136 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90ad8c11-d7c8-44f0-beb3-e3a647a3be9f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:29.356608 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90ad8c11-d7c8-44f0-beb3-e3a647a3be9f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:29.357044 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90ad8c11-d7c8-44f0-beb3-e3a647a3be9f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:29.497188 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-90ad8c11-d7c8-44f0-beb3-e3a647a3be9f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:29.505972 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-90ad8c11-d7c8-44f0-beb3-e3a647a3be9f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 200 len: 1521 microversion: 2.1 time: 0.163388 Oct 26 13:58:29.506936 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3541/7058] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:29 2022] GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:30.528383 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-68a82f6f-6812-4e58-a1e6-830878fd8a35 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:30.528995 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-68a82f6f-6812-4e58-a1e6-830878fd8a35 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:30.536156 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-68a82f6f-6812-4e58-a1e6-830878fd8a35 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:30.536639 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-68a82f6f-6812-4e58-a1e6-830878fd8a35 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:30.537077 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-68a82f6f-6812-4e58-a1e6-830878fd8a35 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:30.537783 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-68a82f6f-6812-4e58-a1e6-830878fd8a35 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:30.538239 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-68a82f6f-6812-4e58-a1e6-830878fd8a35 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:30.538664 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-68a82f6f-6812-4e58-a1e6-830878fd8a35 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:30.667283 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-68a82f6f-6812-4e58-a1e6-830878fd8a35 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:30.675430 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-68a82f6f-6812-4e58-a1e6-830878fd8a35 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 200 len: 1521 microversion: 2.1 time: 0.150966 Oct 26 13:58:30.676000 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3518/7059] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:30 2022] GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:31.698946 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-760b19cb-d2c7-45d2-b31a-28005fb192f3 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:31.699691 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-760b19cb-d2c7-45d2-b31a-28005fb192f3 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:31.706706 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-760b19cb-d2c7-45d2-b31a-28005fb192f3 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:31.707210 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-760b19cb-d2c7-45d2-b31a-28005fb192f3 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:31.707659 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-760b19cb-d2c7-45d2-b31a-28005fb192f3 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:31.708372 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-760b19cb-d2c7-45d2-b31a-28005fb192f3 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:31.708841 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-760b19cb-d2c7-45d2-b31a-28005fb192f3 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:31.709278 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-760b19cb-d2c7-45d2-b31a-28005fb192f3 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:31.916889 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-760b19cb-d2c7-45d2-b31a-28005fb192f3 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:31.925460 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-760b19cb-d2c7-45d2-b31a-28005fb192f3 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 200 len: 1520 microversion: 2.1 time: 0.230450 Oct 26 13:58:31.926073 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3542/7060] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:31 2022] GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 1520 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:31.966549 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-227d1950-c507-4676-b135-3e1577c6df55 req-12a2ee2a-f8e7-43ee-9a6f-3cb547c77924 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d62339f-8ae9-4dc9-b99d-9227d2194d1f", "name": "network-vif-unplugged", "status": "completed", "tag": "ab37bb42-741a-4d52-a4ea-11f9adef66b5"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:58:31.977108 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-227d1950-c507-4676-b135-3e1577c6df55 req-12a2ee2a-f8e7-43ee-9a6f-3cb547c77924 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:31.977629 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-227d1950-c507-4676-b135-3e1577c6df55 req-12a2ee2a-f8e7-43ee-9a6f-3cb547c77924 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:31.978069 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-227d1950-c507-4676-b135-3e1577c6df55 req-12a2ee2a-f8e7-43ee-9a6f-3cb547c77924 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:31.991516 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-227d1950-c507-4676-b135-3e1577c6df55 req-12a2ee2a-f8e7-43ee-9a6f-3cb547c77924 service nova] Creating event network-vif-unplugged:ab37bb42-741a-4d52-a4ea-11f9adef66b5 for instance 0d62339f-8ae9-4dc9-b99d-9227d2194d1f on n-h2-862686-1 Oct 26 13:58:31.997147 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [req-227d1950-c507-4676-b135-3e1577c6df55 req-12a2ee2a-f8e7-43ee-9a6f-3cb547c77924 service nova] Instance 0d62339f-8ae9-4dc9-b99d-9227d2194d1f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862686-1', 'n-h1-862686-1'} {{(pid=120597) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 13:58:32.009385 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-227d1950-c507-4676-b135-3e1577c6df55 req-12a2ee2a-f8e7-43ee-9a6f-3cb547c77924 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046639 Oct 26 13:58:32.010254 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3519/7061] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:58:32.949716 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ac4e5d6d-ca95-489f-bd1f-155d28d0fd03 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:32.950276 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ac4e5d6d-ca95-489f-bd1f-155d28d0fd03 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:32.957329 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac4e5d6d-ca95-489f-bd1f-155d28d0fd03 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:32.957857 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac4e5d6d-ca95-489f-bd1f-155d28d0fd03 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:32.958312 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac4e5d6d-ca95-489f-bd1f-155d28d0fd03 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:32.959031 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac4e5d6d-ca95-489f-bd1f-155d28d0fd03 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:32.959510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac4e5d6d-ca95-489f-bd1f-155d28d0fd03 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:32.959957 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac4e5d6d-ca95-489f-bd1f-155d28d0fd03 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:33.098165 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ac4e5d6d-ca95-489f-bd1f-155d28d0fd03 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:33.106490 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ac4e5d6d-ca95-489f-bd1f-155d28d0fd03 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 200 len: 1518 microversion: 2.1 time: 0.160755 Oct 26 13:58:33.107058 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3543/7062] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:32 2022] GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:34.026407 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-3533ac1a-53c5-47bb-a635-b508ad0c9635 req-be1a086d-09b0-4c03-91b9-5a8a727d2fc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d62339f-8ae9-4dc9-b99d-9227d2194d1f", "tag": "ab37bb42-741a-4d52-a4ea-11f9adef66b5"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:58:34.036963 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-3533ac1a-53c5-47bb-a635-b508ad0c9635 req-be1a086d-09b0-4c03-91b9-5a8a727d2fc5 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:34.037429 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-3533ac1a-53c5-47bb-a635-b508ad0c9635 req-be1a086d-09b0-4c03-91b9-5a8a727d2fc5 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:34.037889 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-3533ac1a-53c5-47bb-a635-b508ad0c9635 req-be1a086d-09b0-4c03-91b9-5a8a727d2fc5 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:34.049153 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-3533ac1a-53c5-47bb-a635-b508ad0c9635 req-be1a086d-09b0-4c03-91b9-5a8a727d2fc5 service nova] Creating event network-changed:ab37bb42-741a-4d52-a4ea-11f9adef66b5 for instance 0d62339f-8ae9-4dc9-b99d-9227d2194d1f on n-h2-862686-1 Oct 26 13:58:34.054224 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [req-3533ac1a-53c5-47bb-a635-b508ad0c9635 req-be1a086d-09b0-4c03-91b9-5a8a727d2fc5 service nova] Instance 0d62339f-8ae9-4dc9-b99d-9227d2194d1f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862686-1', 'n-h1-862686-1'} {{(pid=120597) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 13:58:34.064972 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-3533ac1a-53c5-47bb-a635-b508ad0c9635 req-be1a086d-09b0-4c03-91b9-5a8a727d2fc5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043638 Oct 26 13:58:34.065626 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3520/7063] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:58:34.130214 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c1e5dc1a-922e-4a90-add2-60e441881cc0 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:34.130840 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c1e5dc1a-922e-4a90-add2-60e441881cc0 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:34.137736 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c1e5dc1a-922e-4a90-add2-60e441881cc0 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:34.138302 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c1e5dc1a-922e-4a90-add2-60e441881cc0 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:34.138701 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c1e5dc1a-922e-4a90-add2-60e441881cc0 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:34.140524 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c1e5dc1a-922e-4a90-add2-60e441881cc0 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:34.141110 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c1e5dc1a-922e-4a90-add2-60e441881cc0 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:34.141578 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c1e5dc1a-922e-4a90-add2-60e441881cc0 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:34.351512 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c1e5dc1a-922e-4a90-add2-60e441881cc0 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:34.359711 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c1e5dc1a-922e-4a90-add2-60e441881cc0 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 200 len: 1518 microversion: 2.1 time: 0.233390 Oct 26 13:58:34.360301 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3544/7064] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:34 2022] GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 1518 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:35.385220 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d77682b7-95b9-47fe-9742-38c503b7234b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:35.385949 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d77682b7-95b9-47fe-9742-38c503b7234b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:35.387875 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=28 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:58:35.401038 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d77682b7-95b9-47fe-9742-38c503b7234b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:35.401547 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d77682b7-95b9-47fe-9742-38c503b7234b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:35.401989 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d77682b7-95b9-47fe-9742-38c503b7234b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:35.402689 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d77682b7-95b9-47fe-9742-38c503b7234b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:35.403142 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d77682b7-95b9-47fe-9742-38c503b7234b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:35.403565 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d77682b7-95b9-47fe-9742-38c503b7234b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:35.408319 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=80 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:58:35.553591 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d77682b7-95b9-47fe-9742-38c503b7234b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:35.562028 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d77682b7-95b9-47fe-9742-38c503b7234b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 200 len: 1515 microversion: 2.1 time: 0.181442 Oct 26 13:58:35.562602 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3521/7065] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:35 2022] GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 1515 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:35.583940 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5a9b0164-9e35-4c81-844c-ee8a8d702bb8 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:58:35.585113 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5a9b0164-9e35-4c81-844c-ee8a8d702bb8 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:35.592534 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a9b0164-9e35-4c81-844c-ee8a8d702bb8 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:35.593389 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a9b0164-9e35-4c81-844c-ee8a8d702bb8 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:35.593889 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a9b0164-9e35-4c81-844c-ee8a8d702bb8 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:35.594670 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a9b0164-9e35-4c81-844c-ee8a8d702bb8 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:35.595151 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a9b0164-9e35-4c81-844c-ee8a8d702bb8 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:35.595601 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a9b0164-9e35-4c81-844c-ee8a8d702bb8 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:35.661183 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5a9b0164-9e35-4c81-844c-ee8a8d702bb8 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "POST /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f/action" status: 204 len: 0 microversion: 2.1 time: 0.080877 Oct 26 13:58:35.661794 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3545/7066] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:58:35 2022] POST /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f/action => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:58:35.671585 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-68d5b31f-60a0-4f31-ba1a-1b5965bd7f0b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:35.672524 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-68d5b31f-60a0-4f31-ba1a-1b5965bd7f0b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:35.678733 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-68d5b31f-60a0-4f31-ba1a-1b5965bd7f0b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:35.679224 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-68d5b31f-60a0-4f31-ba1a-1b5965bd7f0b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:35.679856 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-68d5b31f-60a0-4f31-ba1a-1b5965bd7f0b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:35.680631 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-68d5b31f-60a0-4f31-ba1a-1b5965bd7f0b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:35.681130 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-68d5b31f-60a0-4f31-ba1a-1b5965bd7f0b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:35.681793 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-68d5b31f-60a0-4f31-ba1a-1b5965bd7f0b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:35.820703 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-68d5b31f-60a0-4f31-ba1a-1b5965bd7f0b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:35.828780 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-68d5b31f-60a0-4f31-ba1a-1b5965bd7f0b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 200 len: 1515 microversion: 2.1 time: 0.162622 Oct 26 13:58:35.829367 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3522/7067] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:35 2022] GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:58:36.853957 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6849ced2-a864-4a92-821f-0fa404d8de21 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:36.854589 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6849ced2-a864-4a92-821f-0fa404d8de21 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:36.856588 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=30 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:58:36.863217 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6849ced2-a864-4a92-821f-0fa404d8de21 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:36.863968 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6849ced2-a864-4a92-821f-0fa404d8de21 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:36.864476 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6849ced2-a864-4a92-821f-0fa404d8de21 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:36.865231 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6849ced2-a864-4a92-821f-0fa404d8de21 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:36.865809 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6849ced2-a864-4a92-821f-0fa404d8de21 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:36.866449 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6849ced2-a864-4a92-821f-0fa404d8de21 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:36.999742 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6849ced2-a864-4a92-821f-0fa404d8de21 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:37.007762 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6849ced2-a864-4a92-821f-0fa404d8de21 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 200 len: 1515 microversion: 2.1 time: 0.159087 Oct 26 13:58:37.008349 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3546/7068] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:36 2022] GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:37.448897 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-ac1541ab-a49d-45db-8f34-1c13ad71f03a req-70c92dc6-3f64-413e-98ca-6b68ede4906c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d62339f-8ae9-4dc9-b99d-9227d2194d1f", "name": "network-vif-plugged", "status": "completed", "tag": "ab37bb42-741a-4d52-a4ea-11f9adef66b5"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:58:37.460736 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ac1541ab-a49d-45db-8f34-1c13ad71f03a req-70c92dc6-3f64-413e-98ca-6b68ede4906c service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:37.461284 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ac1541ab-a49d-45db-8f34-1c13ad71f03a req-70c92dc6-3f64-413e-98ca-6b68ede4906c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:37.461741 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ac1541ab-a49d-45db-8f34-1c13ad71f03a req-70c92dc6-3f64-413e-98ca-6b68ede4906c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:37.473854 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-ac1541ab-a49d-45db-8f34-1c13ad71f03a req-70c92dc6-3f64-413e-98ca-6b68ede4906c service nova] Creating event network-vif-plugged:ab37bb42-741a-4d52-a4ea-11f9adef66b5 for instance 0d62339f-8ae9-4dc9-b99d-9227d2194d1f on n-h2-862686-1 Oct 26 13:58:37.478916 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-ac1541ab-a49d-45db-8f34-1c13ad71f03a req-70c92dc6-3f64-413e-98ca-6b68ede4906c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034250 Oct 26 13:58:37.479649 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3523/7069] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:58:38.031124 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d66a7f28-0d36-42cf-b5b3-73ecbb5ae8c8 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:38.031829 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d66a7f28-0d36-42cf-b5b3-73ecbb5ae8c8 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:38.038965 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d66a7f28-0d36-42cf-b5b3-73ecbb5ae8c8 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:38.039466 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d66a7f28-0d36-42cf-b5b3-73ecbb5ae8c8 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:38.039923 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d66a7f28-0d36-42cf-b5b3-73ecbb5ae8c8 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:38.040630 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d66a7f28-0d36-42cf-b5b3-73ecbb5ae8c8 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:38.041102 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d66a7f28-0d36-42cf-b5b3-73ecbb5ae8c8 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:38.041568 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d66a7f28-0d36-42cf-b5b3-73ecbb5ae8c8 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:38.176065 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d66a7f28-0d36-42cf-b5b3-73ecbb5ae8c8 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:38.183779 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d66a7f28-0d36-42cf-b5b3-73ecbb5ae8c8 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 200 len: 1507 microversion: 2.1 time: 0.156806 Oct 26 13:58:38.184357 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3547/7070] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:38 2022] GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:38.208120 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7ef2bd65-83c3-488e-9360-5eddafbd5211 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:38.208816 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7ef2bd65-83c3-488e-9360-5eddafbd5211 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:38.215004 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ef2bd65-83c3-488e-9360-5eddafbd5211 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:38.215486 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ef2bd65-83c3-488e-9360-5eddafbd5211 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:38.215918 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ef2bd65-83c3-488e-9360-5eddafbd5211 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:38.216601 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ef2bd65-83c3-488e-9360-5eddafbd5211 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:38.217054 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ef2bd65-83c3-488e-9360-5eddafbd5211 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:38.217511 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7ef2bd65-83c3-488e-9360-5eddafbd5211 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:38.346802 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7ef2bd65-83c3-488e-9360-5eddafbd5211 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:38.354591 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7ef2bd65-83c3-488e-9360-5eddafbd5211 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 200 len: 1507 microversion: 2.1 time: 0.150670 Oct 26 13:58:38.355183 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3524/7071] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:38 2022] GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:58:38.380142 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-be08da09-5f91-48ab-aade-d333cb9f1bfc tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Action: 'create', calling method: .version_select at 0x7f6732981d30>, body: {"keypair": {"name": "tempest-keypair-1602818080", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKS57bBreUNvsC0gu76Qq0H2EKx2HtLeWc8Trb09c8HKma2/BPdwaolW3TFxlSbUUAYtvK+Q2TGG0y78reugYMUS9sRYaNbOEPbqvIlvimMuZhVbcXZK61rxg9EwRjV0Q=="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:58:38.396529 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-be08da09-5f91-48ab-aade-d333cb9f1bfc tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Getting quotas for project 726b21631dc54c5b8acb4840ca9fd26d. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:58:38.401632 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-be08da09-5f91-48ab-aade-d333cb9f1bfc tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Getting quotas for user b7e18c48f4b14f6bae21de79f785e93e and project 726b21631dc54c5b8acb4840ca9fd26d. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:58:38.427230 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-be08da09-5f91-48ab-aade-d333cb9f1bfc tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050975 Oct 26 13:58:38.427837 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3548/7072] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 13:58:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:58:39.580391 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-558e5132-3b37-46e1-9c15-8f88b2448281 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:39.581002 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-558e5132-3b37-46e1-9c15-8f88b2448281 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:39.587994 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-558e5132-3b37-46e1-9c15-8f88b2448281 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:39.588472 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-558e5132-3b37-46e1-9c15-8f88b2448281 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:39.588906 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-558e5132-3b37-46e1-9c15-8f88b2448281 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:39.589646 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-558e5132-3b37-46e1-9c15-8f88b2448281 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:39.590098 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-558e5132-3b37-46e1-9c15-8f88b2448281 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:39.590548 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-558e5132-3b37-46e1-9c15-8f88b2448281 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:39.725034 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-558e5132-3b37-46e1-9c15-8f88b2448281 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:39.732803 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-558e5132-3b37-46e1-9c15-8f88b2448281 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 200 len: 1507 microversion: 2.1 time: 0.157017 Oct 26 13:58:39.733319 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3525/7073] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:39 2022] GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:39.756732 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7fa3305d-f99c-4f83-b5c6-d209d446b017 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:39.757249 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7fa3305d-f99c-4f83-b5c6-d209d446b017 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:39.763995 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7fa3305d-f99c-4f83-b5c6-d209d446b017 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:39.764494 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7fa3305d-f99c-4f83-b5c6-d209d446b017 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:39.765561 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7fa3305d-f99c-4f83-b5c6-d209d446b017 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:39.766275 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7fa3305d-f99c-4f83-b5c6-d209d446b017 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:39.766750 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7fa3305d-f99c-4f83-b5c6-d209d446b017 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:39.767190 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7fa3305d-f99c-4f83-b5c6-d209d446b017 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:39.792469 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7fa3305d-f99c-4f83-b5c6-d209d446b017 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:58:39.868035 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7fa3305d-f99c-4f83-b5c6-d209d446b017 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 204 len: 0 microversion: 2.1 time: 0.116104 Oct 26 13:58:39.868630 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3549/7074] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:58:39 2022] DELETE /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:58:39.926925 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0679e0c0-67bc-4818-880e-0a3449b4e727 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1968876674", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "f5055157-7f14-4f0e-937e-8d68e67d66e0"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:58:39.978659 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-0679e0c0-67bc-4818-880e-0a3449b4e727 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] validate_networks() for [('f5055157-7f14-4f0e-937e-8d68e67d66e0', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:58:40.344613 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-0679e0c0-67bc-4818-880e-0a3449b4e727 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:58:40.345036 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-0679e0c0-67bc-4818-880e-0a3449b4e727 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:58:40.345536 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-0679e0c0-67bc-4818-880e-0a3449b4e727 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:58:40.345955 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-0679e0c0-67bc-4818-880e-0a3449b4e727 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:58:40.346370 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-0679e0c0-67bc-4818-880e-0a3449b4e727 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:58:40.355241 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0679e0c0-67bc-4818-880e-0a3449b4e727 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:40.355724 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0679e0c0-67bc-4818-880e-0a3449b4e727 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:40.356168 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0679e0c0-67bc-4818-880e-0a3449b4e727 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:40.356898 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0679e0c0-67bc-4818-880e-0a3449b4e727 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:40.357352 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0679e0c0-67bc-4818-880e-0a3449b4e727 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:40.357807 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0679e0c0-67bc-4818-880e-0a3449b4e727 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:40.374986 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-0679e0c0-67bc-4818-880e-0a3449b4e727 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Getting quotas for project 726b21631dc54c5b8acb4840ca9fd26d. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:58:40.380121 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-0679e0c0-67bc-4818-880e-0a3449b4e727 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Getting quotas for user b7e18c48f4b14f6bae21de79f785e93e and project 726b21631dc54c5b8acb4840ca9fd26d. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:58:40.392528 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0679e0c0-67bc-4818-880e-0a3449b4e727 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:58:40.394871 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0679e0c0-67bc-4818-880e-0a3449b4e727 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:58:40.440888 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0679e0c0-67bc-4818-880e-0a3449b4e727 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.517952 Oct 26 13:58:40.441594 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3526/7075] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:58:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:58:40.453471 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bc2402ee-2de0-42e9-b370-7560bc673f5a tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:40.454213 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bc2402ee-2de0-42e9-b370-7560bc673f5a tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:40.509394 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bc2402ee-2de0-42e9-b370-7560bc673f5a tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:40.516752 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bc2402ee-2de0-42e9-b370-7560bc673f5a tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 200 len: 1218 microversion: 2.1 time: 0.067862 Oct 26 13:58:40.517389 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3550/7076] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:40 2022] GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:41.541254 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-45d9b7d2-84b5-4b9f-8f3a-5c2d7f739b0a tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:41.541895 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-45d9b7d2-84b5-4b9f-8f3a-5c2d7f739b0a tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:41.549289 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-45d9b7d2-84b5-4b9f-8f3a-5c2d7f739b0a tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:41.549793 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-45d9b7d2-84b5-4b9f-8f3a-5c2d7f739b0a tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:41.550229 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-45d9b7d2-84b5-4b9f-8f3a-5c2d7f739b0a tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:41.550920 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-45d9b7d2-84b5-4b9f-8f3a-5c2d7f739b0a tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:41.551371 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-45d9b7d2-84b5-4b9f-8f3a-5c2d7f739b0a tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:41.551790 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-45d9b7d2-84b5-4b9f-8f3a-5c2d7f739b0a tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:41.616364 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-45d9b7d2-84b5-4b9f-8f3a-5c2d7f739b0a tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:41.624154 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-45d9b7d2-84b5-4b9f-8f3a-5c2d7f739b0a tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 200 len: 1270 microversion: 2.1 time: 0.087814 Oct 26 13:58:41.624730 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3527/7077] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:41 2022] GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 1270 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:41.835236 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-56762e7a-9f8a-48e1-891e-e24b845358f0 req-dd59262e-2095-4521-9357-02d359fb866a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d62339f-8ae9-4dc9-b99d-9227d2194d1f", "name": "network-vif-deleted", "tag": "ab37bb42-741a-4d52-a4ea-11f9adef66b5"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:58:41.851726 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-56762e7a-9f8a-48e1-891e-e24b845358f0 req-dd59262e-2095-4521-9357-02d359fb866a service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:41.852618 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-56762e7a-9f8a-48e1-891e-e24b845358f0 req-dd59262e-2095-4521-9357-02d359fb866a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:41.853070 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-56762e7a-9f8a-48e1-891e-e24b845358f0 req-dd59262e-2095-4521-9357-02d359fb866a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:41.875859 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-56762e7a-9f8a-48e1-891e-e24b845358f0 req-dd59262e-2095-4521-9357-02d359fb866a service nova] Creating event network-vif-deleted:ab37bb42-741a-4d52-a4ea-11f9adef66b5 for instance 0d62339f-8ae9-4dc9-b99d-9227d2194d1f on n-h2-862686-1 Oct 26 13:58:41.892231 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-56762e7a-9f8a-48e1-891e-e24b845358f0 req-dd59262e-2095-4521-9357-02d359fb866a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063092 Oct 26 13:58:41.893191 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3551/7078] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:58:42.650569 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6f514fbc-23d6-41a6-b7de-70a882e7d83b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:42.652096 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6f514fbc-23d6-41a6-b7de-70a882e7d83b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:42.659532 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f514fbc-23d6-41a6-b7de-70a882e7d83b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:42.660073 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f514fbc-23d6-41a6-b7de-70a882e7d83b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:42.660697 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f514fbc-23d6-41a6-b7de-70a882e7d83b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:42.661443 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f514fbc-23d6-41a6-b7de-70a882e7d83b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:42.661962 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f514fbc-23d6-41a6-b7de-70a882e7d83b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:42.662412 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f514fbc-23d6-41a6-b7de-70a882e7d83b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:42.795933 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6f514fbc-23d6-41a6-b7de-70a882e7d83b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:42.804208 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6f514fbc-23d6-41a6-b7de-70a882e7d83b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 200 len: 1318 microversion: 2.1 time: 0.160072 Oct 26 13:58:42.804790 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3528/7079] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:42 2022] GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:43.830744 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0005ffc9-d521-4b4a-aaa0-764b18a2184a tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:43.831458 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0005ffc9-d521-4b4a-aaa0-764b18a2184a tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:43.837733 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0005ffc9-d521-4b4a-aaa0-764b18a2184a tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:43.838228 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0005ffc9-d521-4b4a-aaa0-764b18a2184a tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:43.838707 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0005ffc9-d521-4b4a-aaa0-764b18a2184a tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:43.839407 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0005ffc9-d521-4b4a-aaa0-764b18a2184a tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:43.839868 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0005ffc9-d521-4b4a-aaa0-764b18a2184a tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:43.840301 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0005ffc9-d521-4b4a-aaa0-764b18a2184a tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:43.945182 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-d42f2f31-a2d9-4586-81ac-8d5b574e5c9c req-73829ea3-7295-4ec0-bf77-95b4e5cd3622 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb7d16d8-10eb-4217-a169-da9fdd146035", "tag": "644507cd-f45d-4473-b6f1-ae4d8fd539e9"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:58:43.956256 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d42f2f31-a2d9-4586-81ac-8d5b574e5c9c req-73829ea3-7295-4ec0-bf77-95b4e5cd3622 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:43.956751 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d42f2f31-a2d9-4586-81ac-8d5b574e5c9c req-73829ea3-7295-4ec0-bf77-95b4e5cd3622 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:43.957424 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d42f2f31-a2d9-4586-81ac-8d5b574e5c9c req-73829ea3-7295-4ec0-bf77-95b4e5cd3622 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:43.968572 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-d42f2f31-a2d9-4586-81ac-8d5b574e5c9c req-73829ea3-7295-4ec0-bf77-95b4e5cd3622 service nova] Creating event network-changed:644507cd-f45d-4473-b6f1-ae4d8fd539e9 for instance bb7d16d8-10eb-4217-a169-da9fdd146035 on n-h2-862686-1 Oct 26 13:58:43.974488 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-d42f2f31-a2d9-4586-81ac-8d5b574e5c9c req-73829ea3-7295-4ec0-bf77-95b4e5cd3622 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032977 Oct 26 13:58:43.975263 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3529/7080] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 13:58:44.074656 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0005ffc9-d521-4b4a-aaa0-764b18a2184a tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:44.083831 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0005ffc9-d521-4b4a-aaa0-764b18a2184a tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 200 len: 1318 microversion: 2.1 time: 0.259497 Oct 26 13:58:44.084412 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3552/7081] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:43 2022] GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:45.107729 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e6342d9e-1f40-4f64-be8c-96054c5f9023 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:45.108621 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e6342d9e-1f40-4f64-be8c-96054c5f9023 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:45.116141 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e6342d9e-1f40-4f64-be8c-96054c5f9023 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:45.116709 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e6342d9e-1f40-4f64-be8c-96054c5f9023 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:45.117286 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e6342d9e-1f40-4f64-be8c-96054c5f9023 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:45.118149 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e6342d9e-1f40-4f64-be8c-96054c5f9023 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:45.118718 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e6342d9e-1f40-4f64-be8c-96054c5f9023 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:45.119246 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e6342d9e-1f40-4f64-be8c-96054c5f9023 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:45.318996 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e6342d9e-1f40-4f64-be8c-96054c5f9023 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:45.328064 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e6342d9e-1f40-4f64-be8c-96054c5f9023 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 200 len: 1318 microversion: 2.1 time: 0.225726 Oct 26 13:58:45.329180 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3530/7082] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:45 2022] GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:46.352293 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d36b6da5-2c90-4855-92fa-1f609542e99e tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:46.352924 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d36b6da5-2c90-4855-92fa-1f609542e99e tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:46.359994 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d36b6da5-2c90-4855-92fa-1f609542e99e tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:46.360507 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d36b6da5-2c90-4855-92fa-1f609542e99e tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:46.360949 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d36b6da5-2c90-4855-92fa-1f609542e99e tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:46.361686 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d36b6da5-2c90-4855-92fa-1f609542e99e tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:46.362158 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d36b6da5-2c90-4855-92fa-1f609542e99e tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:46.362602 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d36b6da5-2c90-4855-92fa-1f609542e99e tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:46.500556 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d36b6da5-2c90-4855-92fa-1f609542e99e tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:46.502961 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:58:46.510033 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d36b6da5-2c90-4855-92fa-1f609542e99e tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 200 len: 1318 microversion: 2.1 time: 0.161679 Oct 26 13:58:46.510610 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3553/7083] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:46 2022] GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:47.535150 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2b0bd7a3-21b4-4e54-b094-17febe171b12 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:47.535788 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2b0bd7a3-21b4-4e54-b094-17febe171b12 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:47.543149 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b0bd7a3-21b4-4e54-b094-17febe171b12 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:47.543676 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b0bd7a3-21b4-4e54-b094-17febe171b12 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:47.544115 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b0bd7a3-21b4-4e54-b094-17febe171b12 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:47.544828 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b0bd7a3-21b4-4e54-b094-17febe171b12 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:47.545289 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b0bd7a3-21b4-4e54-b094-17febe171b12 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:47.545743 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b0bd7a3-21b4-4e54-b094-17febe171b12 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:47.678048 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2b0bd7a3-21b4-4e54-b094-17febe171b12 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:47.685857 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2b0bd7a3-21b4-4e54-b094-17febe171b12 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 200 len: 1318 microversion: 2.1 time: 0.156315 Oct 26 13:58:47.686410 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3531/7084] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:47 2022] GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:48.709836 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d75b0508-08b3-494c-bfd2-738b048dcbe6 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:48.710464 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d75b0508-08b3-494c-bfd2-738b048dcbe6 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:48.718272 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d75b0508-08b3-494c-bfd2-738b048dcbe6 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:48.718806 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d75b0508-08b3-494c-bfd2-738b048dcbe6 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:48.719353 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d75b0508-08b3-494c-bfd2-738b048dcbe6 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:48.720156 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d75b0508-08b3-494c-bfd2-738b048dcbe6 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:48.720637 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d75b0508-08b3-494c-bfd2-738b048dcbe6 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:48.721083 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d75b0508-08b3-494c-bfd2-738b048dcbe6 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:48.849621 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d75b0508-08b3-494c-bfd2-738b048dcbe6 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:48.857394 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d75b0508-08b3-494c-bfd2-738b048dcbe6 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 200 len: 1318 microversion: 2.1 time: 0.151530 Oct 26 13:58:48.858009 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3554/7085] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:48 2022] GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:49.522675 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-40c94b72-1157-4698-8e4f-095d0478af81 req-73ab78b3-ac86-4cfb-920e-f8a9a15ccaf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb7d16d8-10eb-4217-a169-da9fdd146035", "name": "network-vif-plugged", "status": "completed", "tag": "644507cd-f45d-4473-b6f1-ae4d8fd539e9"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:58:49.534662 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-40c94b72-1157-4698-8e4f-095d0478af81 req-73ab78b3-ac86-4cfb-920e-f8a9a15ccaf9 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:49.535515 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-40c94b72-1157-4698-8e4f-095d0478af81 req-73ab78b3-ac86-4cfb-920e-f8a9a15ccaf9 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:49.535947 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-40c94b72-1157-4698-8e4f-095d0478af81 req-73ab78b3-ac86-4cfb-920e-f8a9a15ccaf9 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:49.550907 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-40c94b72-1157-4698-8e4f-095d0478af81 req-73ab78b3-ac86-4cfb-920e-f8a9a15ccaf9 service nova] Creating event network-vif-plugged:644507cd-f45d-4473-b6f1-ae4d8fd539e9 for instance bb7d16d8-10eb-4217-a169-da9fdd146035 on n-h2-862686-1 Oct 26 13:58:49.556262 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-40c94b72-1157-4698-8e4f-095d0478af81 req-73ab78b3-ac86-4cfb-920e-f8a9a15ccaf9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037115 Oct 26 13:58:49.557028 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3532/7086] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:58:49.882009 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8290837e-7196-487f-80b7-81a966f44f81 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:49.882654 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8290837e-7196-487f-80b7-81a966f44f81 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:49.888968 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8290837e-7196-487f-80b7-81a966f44f81 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:49.889459 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8290837e-7196-487f-80b7-81a966f44f81 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:49.889937 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8290837e-7196-487f-80b7-81a966f44f81 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:49.890636 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8290837e-7196-487f-80b7-81a966f44f81 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:49.891587 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8290837e-7196-487f-80b7-81a966f44f81 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:49.892026 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8290837e-7196-487f-80b7-81a966f44f81 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:50.021934 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8290837e-7196-487f-80b7-81a966f44f81 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:50.029644 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8290837e-7196-487f-80b7-81a966f44f81 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 200 len: 1318 microversion: 2.1 time: 0.151560 Oct 26 13:58:50.030219 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3555/7087] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:49 2022] GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:51.050781 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:58:51.051553 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:58:51.056738 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0c07e567-fcaf-4460-a262-bdf2b59969d1 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:51.057467 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0c07e567-fcaf-4460-a262-bdf2b59969d1 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:51.065257 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c07e567-fcaf-4460-a262-bdf2b59969d1 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:51.065767 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c07e567-fcaf-4460-a262-bdf2b59969d1 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:51.066207 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c07e567-fcaf-4460-a262-bdf2b59969d1 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:51.066893 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c07e567-fcaf-4460-a262-bdf2b59969d1 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:51.067345 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c07e567-fcaf-4460-a262-bdf2b59969d1 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:51.067767 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c07e567-fcaf-4460-a262-bdf2b59969d1 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:51.197495 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0c07e567-fcaf-4460-a262-bdf2b59969d1 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:51.205604 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0c07e567-fcaf-4460-a262-bdf2b59969d1 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 200 len: 1508 microversion: 2.1 time: 0.155811 Oct 26 13:58:51.206171 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3533/7088] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:51 2022] GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:51.228003 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8e25bd6d-855e-4878-b64a-79afc8c736b7 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:51.228631 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8e25bd6d-855e-4878-b64a-79afc8c736b7 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:51.230554 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:58:51.238026 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e25bd6d-855e-4878-b64a-79afc8c736b7 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:51.238526 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e25bd6d-855e-4878-b64a-79afc8c736b7 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:51.238980 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e25bd6d-855e-4878-b64a-79afc8c736b7 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:51.239690 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e25bd6d-855e-4878-b64a-79afc8c736b7 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:51.240165 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e25bd6d-855e-4878-b64a-79afc8c736b7 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:51.240607 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e25bd6d-855e-4878-b64a-79afc8c736b7 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:51.368289 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8e25bd6d-855e-4878-b64a-79afc8c736b7 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:51.376673 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8e25bd6d-855e-4878-b64a-79afc8c736b7 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 200 len: 1508 microversion: 2.1 time: 0.152677 Oct 26 13:58:51.377253 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3556/7089] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:51 2022] GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:51.399331 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f6d09f20-4a03-422d-a277-66d10a83f977 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:58:51.401576 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f6d09f20-4a03-422d-a277-66d10a83f977 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:51.407576 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f6d09f20-4a03-422d-a277-66d10a83f977 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:51.408063 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f6d09f20-4a03-422d-a277-66d10a83f977 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:51.408771 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f6d09f20-4a03-422d-a277-66d10a83f977 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:51.409462 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f6d09f20-4a03-422d-a277-66d10a83f977 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:51.409980 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f6d09f20-4a03-422d-a277-66d10a83f977 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:51.410411 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f6d09f20-4a03-422d-a277-66d10a83f977 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:51.439019 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f6d09f20-4a03-422d-a277-66d10a83f977 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:51.444382 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f6d09f20-4a03-422d-a277-66d10a83f977 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Old instance type m1.heat2, new instance type m1.heat {{(pid=120597) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 26 13:58:51.450926 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-f6d09f20-4a03-422d-a277-66d10a83f977 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:58:51.451361 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-f6d09f20-4a03-422d-a277-66d10a83f977 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:58:51.452140 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-f6d09f20-4a03-422d-a277-66d10a83f977 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:58:51.452233 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-f6d09f20-4a03-422d-a277-66d10a83f977 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:58:51.452662 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-f6d09f20-4a03-422d-a277-66d10a83f977 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:58:51.516249 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f6d09f20-4a03-422d-a277-66d10a83f977 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "POST /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035/action" status: 202 len: 0 microversion: 2.1 time: 0.120970 Oct 26 13:58:51.517027 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3534/7090] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:58:51 2022] POST /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:58:51.525181 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9f98e389-3e3b-4f6c-9e1c-166863eaa970 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:51.525858 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9f98e389-3e3b-4f6c-9e1c-166863eaa970 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:51.532287 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9f98e389-3e3b-4f6c-9e1c-166863eaa970 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:51.532768 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9f98e389-3e3b-4f6c-9e1c-166863eaa970 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:51.533216 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9f98e389-3e3b-4f6c-9e1c-166863eaa970 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:51.534215 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9f98e389-3e3b-4f6c-9e1c-166863eaa970 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:51.534686 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9f98e389-3e3b-4f6c-9e1c-166863eaa970 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:51.535123 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9f98e389-3e3b-4f6c-9e1c-166863eaa970 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:51.695997 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9f98e389-3e3b-4f6c-9e1c-166863eaa970 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:51.703821 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9f98e389-3e3b-4f6c-9e1c-166863eaa970 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 200 len: 1515 microversion: 2.1 time: 0.182515 Oct 26 13:58:51.704417 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3557/7091] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:51 2022] GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 1515 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:58:52.728911 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7f0e2d7b-7f92-4bc3-8bbb-2d8a0738bc19 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:52.729559 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7f0e2d7b-7f92-4bc3-8bbb-2d8a0738bc19 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:52.736390 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f0e2d7b-7f92-4bc3-8bbb-2d8a0738bc19 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:52.736872 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f0e2d7b-7f92-4bc3-8bbb-2d8a0738bc19 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:52.737308 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f0e2d7b-7f92-4bc3-8bbb-2d8a0738bc19 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:52.738027 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f0e2d7b-7f92-4bc3-8bbb-2d8a0738bc19 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:52.738478 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f0e2d7b-7f92-4bc3-8bbb-2d8a0738bc19 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:52.738899 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f0e2d7b-7f92-4bc3-8bbb-2d8a0738bc19 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:52.876574 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7f0e2d7b-7f92-4bc3-8bbb-2d8a0738bc19 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:52.884671 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7f0e2d7b-7f92-4bc3-8bbb-2d8a0738bc19 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 200 len: 1515 microversion: 2.1 time: 0.162028 Oct 26 13:58:52.885249 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3535/7092] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:52 2022] GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:53.908207 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d113368b-a061-40c2-a8e4-d27f2330621b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:53.909100 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d113368b-a061-40c2-a8e4-d27f2330621b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:53.915973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d113368b-a061-40c2-a8e4-d27f2330621b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:53.916470 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d113368b-a061-40c2-a8e4-d27f2330621b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:53.916922 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d113368b-a061-40c2-a8e4-d27f2330621b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:53.917665 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d113368b-a061-40c2-a8e4-d27f2330621b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:53.918141 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d113368b-a061-40c2-a8e4-d27f2330621b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:53.918583 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d113368b-a061-40c2-a8e4-d27f2330621b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:54.050269 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d113368b-a061-40c2-a8e4-d27f2330621b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:54.057865 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d113368b-a061-40c2-a8e4-d27f2330621b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 200 len: 1520 microversion: 2.1 time: 0.153667 Oct 26 13:58:54.058445 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3558/7093] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:53 2022] GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:55.082164 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a4307631-5825-4e77-a63b-56507ae68354 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:55.082770 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a4307631-5825-4e77-a63b-56507ae68354 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:55.089735 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4307631-5825-4e77-a63b-56507ae68354 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:55.090215 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4307631-5825-4e77-a63b-56507ae68354 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:55.090652 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4307631-5825-4e77-a63b-56507ae68354 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:55.091334 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4307631-5825-4e77-a63b-56507ae68354 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:55.091786 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4307631-5825-4e77-a63b-56507ae68354 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:55.092209 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4307631-5825-4e77-a63b-56507ae68354 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:55.224199 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a4307631-5825-4e77-a63b-56507ae68354 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:55.232283 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a4307631-5825-4e77-a63b-56507ae68354 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 200 len: 1520 microversion: 2.1 time: 0.154062 Oct 26 13:58:55.232851 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3536/7094] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:55 2022] GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:56.257306 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c3aa5cfb-9910-46bf-b38a-9efc75d0d947 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:56.258036 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c3aa5cfb-9910-46bf-b38a-9efc75d0d947 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:56.264854 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c3aa5cfb-9910-46bf-b38a-9efc75d0d947 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:56.265351 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c3aa5cfb-9910-46bf-b38a-9efc75d0d947 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:56.266391 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c3aa5cfb-9910-46bf-b38a-9efc75d0d947 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:56.267101 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c3aa5cfb-9910-46bf-b38a-9efc75d0d947 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:56.267568 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c3aa5cfb-9910-46bf-b38a-9efc75d0d947 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:56.268007 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c3aa5cfb-9910-46bf-b38a-9efc75d0d947 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:56.397734 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c3aa5cfb-9910-46bf-b38a-9efc75d0d947 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:56.405575 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c3aa5cfb-9910-46bf-b38a-9efc75d0d947 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 200 len: 1520 microversion: 2.1 time: 0.152591 Oct 26 13:58:56.406088 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3559/7095] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:56 2022] GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:57.428784 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fd0cb7f5-a62b-4a08-9f0b-9229774710ad tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:57.429436 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fd0cb7f5-a62b-4a08-9f0b-9229774710ad tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:57.436298 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd0cb7f5-a62b-4a08-9f0b-9229774710ad tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:57.436789 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd0cb7f5-a62b-4a08-9f0b-9229774710ad tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:57.437233 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd0cb7f5-a62b-4a08-9f0b-9229774710ad tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:57.438118 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd0cb7f5-a62b-4a08-9f0b-9229774710ad tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:57.438582 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd0cb7f5-a62b-4a08-9f0b-9229774710ad tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:57.439017 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd0cb7f5-a62b-4a08-9f0b-9229774710ad tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:57.569841 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fd0cb7f5-a62b-4a08-9f0b-9229774710ad tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:57.577607 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fd0cb7f5-a62b-4a08-9f0b-9229774710ad tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 200 len: 1520 microversion: 2.1 time: 0.152760 Oct 26 13:58:57.578879 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3537/7096] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:57 2022] GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:58.601565 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5bff1409-c910-43b5-b8b9-816ad4c6df50 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:58.602189 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5bff1409-c910-43b5-b8b9-816ad4c6df50 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:58.608879 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5bff1409-c910-43b5-b8b9-816ad4c6df50 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:58.609475 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5bff1409-c910-43b5-b8b9-816ad4c6df50 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:58.609951 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5bff1409-c910-43b5-b8b9-816ad4c6df50 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:58.610650 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5bff1409-c910-43b5-b8b9-816ad4c6df50 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:58.611121 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5bff1409-c910-43b5-b8b9-816ad4c6df50 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:58.611558 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5bff1409-c910-43b5-b8b9-816ad4c6df50 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:58.747019 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5bff1409-c910-43b5-b8b9-816ad4c6df50 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:58.755089 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5bff1409-c910-43b5-b8b9-816ad4c6df50 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 200 len: 1520 microversion: 2.1 time: 0.157488 Oct 26 13:58:58.755685 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3560/7097] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:58 2022] GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:58:59.778749 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b73ec8b0-1953-4838-afae-23e9d8f56b64 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:58:59.779354 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b73ec8b0-1953-4838-afae-23e9d8f56b64 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:58:59.787306 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b73ec8b0-1953-4838-afae-23e9d8f56b64 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:59.787788 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b73ec8b0-1953-4838-afae-23e9d8f56b64 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:59.788225 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b73ec8b0-1953-4838-afae-23e9d8f56b64 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:59.788911 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b73ec8b0-1953-4838-afae-23e9d8f56b64 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:58:59.789450 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b73ec8b0-1953-4838-afae-23e9d8f56b64 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:58:59.789902 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b73ec8b0-1953-4838-afae-23e9d8f56b64 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:58:59.922811 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b73ec8b0-1953-4838-afae-23e9d8f56b64 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:58:59.930554 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b73ec8b0-1953-4838-afae-23e9d8f56b64 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 200 len: 1520 microversion: 2.1 time: 0.155736 Oct 26 13:58:59.931121 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3538/7098] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:58:59 2022] GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:59:00.953843 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5115b98d-0cd9-49f5-b662-822ed3b96d2f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:59:00.954505 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5115b98d-0cd9-49f5-b662-822ed3b96d2f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:59:00.961580 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5115b98d-0cd9-49f5-b662-822ed3b96d2f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:00.962081 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5115b98d-0cd9-49f5-b662-822ed3b96d2f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:00.962556 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5115b98d-0cd9-49f5-b662-822ed3b96d2f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:00.963246 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5115b98d-0cd9-49f5-b662-822ed3b96d2f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:00.963725 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5115b98d-0cd9-49f5-b662-822ed3b96d2f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:00.964171 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5115b98d-0cd9-49f5-b662-822ed3b96d2f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:01.092347 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5115b98d-0cd9-49f5-b662-822ed3b96d2f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:59:01.100275 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5115b98d-0cd9-49f5-b662-822ed3b96d2f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 200 len: 1520 microversion: 2.1 time: 0.150440 Oct 26 13:59:01.100853 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3561/7099] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:59:00 2022] GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:59:02.123675 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d0a06625-60f3-437d-9523-9e581303fc9b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:59:02.124293 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d0a06625-60f3-437d-9523-9e581303fc9b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:59:02.131400 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d0a06625-60f3-437d-9523-9e581303fc9b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:02.131826 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d0a06625-60f3-437d-9523-9e581303fc9b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:02.132264 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d0a06625-60f3-437d-9523-9e581303fc9b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:02.132959 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d0a06625-60f3-437d-9523-9e581303fc9b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:02.133413 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d0a06625-60f3-437d-9523-9e581303fc9b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:02.133873 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d0a06625-60f3-437d-9523-9e581303fc9b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:02.137760 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:59:02.271428 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d0a06625-60f3-437d-9523-9e581303fc9b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:59:02.279227 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d0a06625-60f3-437d-9523-9e581303fc9b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 200 len: 1520 microversion: 2.1 time: 0.159488 Oct 26 13:59:02.279795 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3539/7100] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:59:02 2022] GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:59:03.303945 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3afd6e8a-1c6e-4aca-bca4-165ea36063ba tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:59:03.304568 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3afd6e8a-1c6e-4aca-bca4-165ea36063ba tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:59:03.311504 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3afd6e8a-1c6e-4aca-bca4-165ea36063ba tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:03.311991 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3afd6e8a-1c6e-4aca-bca4-165ea36063ba tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:03.313721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3afd6e8a-1c6e-4aca-bca4-165ea36063ba tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:03.314431 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3afd6e8a-1c6e-4aca-bca4-165ea36063ba tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:03.314902 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3afd6e8a-1c6e-4aca-bca4-165ea36063ba tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:03.315342 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3afd6e8a-1c6e-4aca-bca4-165ea36063ba tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:03.449179 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3afd6e8a-1c6e-4aca-bca4-165ea36063ba tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:59:03.457014 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3afd6e8a-1c6e-4aca-bca4-165ea36063ba tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 200 len: 1520 microversion: 2.1 time: 0.157050 Oct 26 13:59:03.457619 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3562/7101] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:59:03 2022] GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:59:04.480351 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-89b2b43a-0389-4d22-8192-b3ebb5db303f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:59:04.480861 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-89b2b43a-0389-4d22-8192-b3ebb5db303f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:59:04.487706 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89b2b43a-0389-4d22-8192-b3ebb5db303f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:04.488184 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89b2b43a-0389-4d22-8192-b3ebb5db303f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:04.488624 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89b2b43a-0389-4d22-8192-b3ebb5db303f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:04.489305 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89b2b43a-0389-4d22-8192-b3ebb5db303f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:04.489780 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89b2b43a-0389-4d22-8192-b3ebb5db303f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:04.490206 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89b2b43a-0389-4d22-8192-b3ebb5db303f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:04.618523 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-89b2b43a-0389-4d22-8192-b3ebb5db303f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:59:04.627313 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-89b2b43a-0389-4d22-8192-b3ebb5db303f tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 200 len: 1520 microversion: 2.1 time: 0.151019 Oct 26 13:59:04.627879 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3540/7102] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:59:04 2022] GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:59:05.651200 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e185bc9a-d6ca-4249-88dd-9561c5a4c898 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:59:05.651833 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e185bc9a-d6ca-4249-88dd-9561c5a4c898 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:59:05.659267 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e185bc9a-d6ca-4249-88dd-9561c5a4c898 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:05.659773 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e185bc9a-d6ca-4249-88dd-9561c5a4c898 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:05.660231 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e185bc9a-d6ca-4249-88dd-9561c5a4c898 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:05.660947 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e185bc9a-d6ca-4249-88dd-9561c5a4c898 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:05.661423 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e185bc9a-d6ca-4249-88dd-9561c5a4c898 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:05.661895 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e185bc9a-d6ca-4249-88dd-9561c5a4c898 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:05.792250 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e185bc9a-d6ca-4249-88dd-9561c5a4c898 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:59:05.801029 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e185bc9a-d6ca-4249-88dd-9561c5a4c898 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 200 len: 1520 microversion: 2.1 time: 0.153824 Oct 26 13:59:05.801633 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3563/7103] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:59:05 2022] GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:59:06.823769 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1b226a09-2730-45ba-bcb8-94bc5829d51a tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:59:06.824376 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1b226a09-2730-45ba-bcb8-94bc5829d51a tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:59:06.827058 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:59:06.832987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b226a09-2730-45ba-bcb8-94bc5829d51a tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:06.833470 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b226a09-2730-45ba-bcb8-94bc5829d51a tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:06.833938 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b226a09-2730-45ba-bcb8-94bc5829d51a tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:06.834628 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b226a09-2730-45ba-bcb8-94bc5829d51a tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:06.835082 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b226a09-2730-45ba-bcb8-94bc5829d51a tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:06.835521 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b226a09-2730-45ba-bcb8-94bc5829d51a tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:06.968186 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1b226a09-2730-45ba-bcb8-94bc5829d51a tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:59:06.975855 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1b226a09-2730-45ba-bcb8-94bc5829d51a tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 200 len: 1520 microversion: 2.1 time: 0.155972 Oct 26 13:59:06.976446 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3541/7104] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:59:06 2022] GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:59:08.000150 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-940600ab-279e-471d-bd78-6d76e19d2ecc tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:59:08.000794 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-940600ab-279e-471d-bd78-6d76e19d2ecc tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:59:08.004096 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:59:08.010021 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-940600ab-279e-471d-bd78-6d76e19d2ecc tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:08.010552 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-940600ab-279e-471d-bd78-6d76e19d2ecc tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:08.011007 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-940600ab-279e-471d-bd78-6d76e19d2ecc tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:08.011720 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-940600ab-279e-471d-bd78-6d76e19d2ecc tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:08.012199 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-940600ab-279e-471d-bd78-6d76e19d2ecc tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:08.012641 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-940600ab-279e-471d-bd78-6d76e19d2ecc tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:08.147501 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-940600ab-279e-471d-bd78-6d76e19d2ecc tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:59:08.155251 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-940600ab-279e-471d-bd78-6d76e19d2ecc tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 200 len: 1520 microversion: 2.1 time: 0.159617 Oct 26 13:59:08.155840 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3564/7105] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:59:07 2022] GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:59:09.178333 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-46038e3e-7174-48c6-bd3a-b51f0b1ccfc4 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:59:09.178948 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-46038e3e-7174-48c6-bd3a-b51f0b1ccfc4 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:59:09.186348 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-46038e3e-7174-48c6-bd3a-b51f0b1ccfc4 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:09.186833 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-46038e3e-7174-48c6-bd3a-b51f0b1ccfc4 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:09.187971 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-46038e3e-7174-48c6-bd3a-b51f0b1ccfc4 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:09.188666 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-46038e3e-7174-48c6-bd3a-b51f0b1ccfc4 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:09.189127 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-46038e3e-7174-48c6-bd3a-b51f0b1ccfc4 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:09.189583 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-46038e3e-7174-48c6-bd3a-b51f0b1ccfc4 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:09.317535 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-46038e3e-7174-48c6-bd3a-b51f0b1ccfc4 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:59:09.325186 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-46038e3e-7174-48c6-bd3a-b51f0b1ccfc4 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 200 len: 1520 microversion: 2.1 time: 0.150811 Oct 26 13:59:09.325788 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3542/7106] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:59:09 2022] GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:59:10.348293 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e4dc2356-be24-47d2-b183-d7a080ef3db7 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:59:10.348923 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e4dc2356-be24-47d2-b183-d7a080ef3db7 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:59:10.355819 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4dc2356-be24-47d2-b183-d7a080ef3db7 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:10.356315 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4dc2356-be24-47d2-b183-d7a080ef3db7 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:10.356768 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4dc2356-be24-47d2-b183-d7a080ef3db7 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:10.357473 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4dc2356-be24-47d2-b183-d7a080ef3db7 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:10.357970 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4dc2356-be24-47d2-b183-d7a080ef3db7 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:10.358412 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e4dc2356-be24-47d2-b183-d7a080ef3db7 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:10.488172 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e4dc2356-be24-47d2-b183-d7a080ef3db7 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:59:10.495973 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e4dc2356-be24-47d2-b183-d7a080ef3db7 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 200 len: 1520 microversion: 2.1 time: 0.151693 Oct 26 13:59:10.496550 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3565/7107] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:59:10 2022] GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:59:11.519858 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7098a8b3-c767-4aae-ab0c-d732852dab63 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:59:11.520497 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7098a8b3-c767-4aae-ab0c-d732852dab63 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:59:11.527341 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7098a8b3-c767-4aae-ab0c-d732852dab63 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:11.527820 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7098a8b3-c767-4aae-ab0c-d732852dab63 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:11.528260 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7098a8b3-c767-4aae-ab0c-d732852dab63 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:11.528944 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7098a8b3-c767-4aae-ab0c-d732852dab63 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:11.529396 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7098a8b3-c767-4aae-ab0c-d732852dab63 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:11.529848 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7098a8b3-c767-4aae-ab0c-d732852dab63 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:11.659178 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7098a8b3-c767-4aae-ab0c-d732852dab63 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:59:11.666935 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7098a8b3-c767-4aae-ab0c-d732852dab63 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 200 len: 1520 microversion: 2.1 time: 0.152109 Oct 26 13:59:11.667518 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3543/7108] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:59:11 2022] GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:59:12.690391 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-239867d4-d2ae-4f9e-bbf7-264dad3398e1 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:59:12.691018 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-239867d4-d2ae-4f9e-bbf7-264dad3398e1 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:59:12.697855 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-239867d4-d2ae-4f9e-bbf7-264dad3398e1 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:12.698356 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-239867d4-d2ae-4f9e-bbf7-264dad3398e1 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:12.698806 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-239867d4-d2ae-4f9e-bbf7-264dad3398e1 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:12.699516 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-239867d4-d2ae-4f9e-bbf7-264dad3398e1 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:12.699990 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-239867d4-d2ae-4f9e-bbf7-264dad3398e1 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:12.700439 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-239867d4-d2ae-4f9e-bbf7-264dad3398e1 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:12.835597 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-239867d4-d2ae-4f9e-bbf7-264dad3398e1 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:59:12.843987 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-239867d4-d2ae-4f9e-bbf7-264dad3398e1 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 200 len: 1520 microversion: 2.1 time: 0.157095 Oct 26 13:59:12.844570 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3566/7109] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:59:12 2022] GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:59:13.866631 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-130fa93a-7234-4dca-9d96-964e1de427f0 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:59:13.867239 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-130fa93a-7234-4dca-9d96-964e1de427f0 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:59:13.874309 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-130fa93a-7234-4dca-9d96-964e1de427f0 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:13.876039 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-130fa93a-7234-4dca-9d96-964e1de427f0 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:13.876489 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-130fa93a-7234-4dca-9d96-964e1de427f0 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:13.877187 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-130fa93a-7234-4dca-9d96-964e1de427f0 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:13.877859 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-130fa93a-7234-4dca-9d96-964e1de427f0 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:13.878085 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-130fa93a-7234-4dca-9d96-964e1de427f0 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:14.011861 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-130fa93a-7234-4dca-9d96-964e1de427f0 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:59:14.019915 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-130fa93a-7234-4dca-9d96-964e1de427f0 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 200 len: 1520 microversion: 2.1 time: 0.157189 Oct 26 13:59:14.020499 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3544/7110] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:59:13 2022] GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:59:15.044073 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-11781764-49a6-4aa2-b84a-edb087c88cd9 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:59:15.044709 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-11781764-49a6-4aa2-b84a-edb087c88cd9 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:59:15.051960 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11781764-49a6-4aa2-b84a-edb087c88cd9 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:15.052466 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11781764-49a6-4aa2-b84a-edb087c88cd9 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:15.052921 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11781764-49a6-4aa2-b84a-edb087c88cd9 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:15.053673 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11781764-49a6-4aa2-b84a-edb087c88cd9 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:15.054156 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11781764-49a6-4aa2-b84a-edb087c88cd9 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:15.054602 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11781764-49a6-4aa2-b84a-edb087c88cd9 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:15.188187 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-11781764-49a6-4aa2-b84a-edb087c88cd9 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:59:15.195932 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-11781764-49a6-4aa2-b84a-edb087c88cd9 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 200 len: 1520 microversion: 2.1 time: 0.155968 Oct 26 13:59:15.196509 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3567/7111] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:59:15 2022] GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:59:16.218895 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a9e1b3be-edb7-4e5a-b7c0-4929163ee7c2 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:59:16.219595 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a9e1b3be-edb7-4e5a-b7c0-4929163ee7c2 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:59:16.226059 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a9e1b3be-edb7-4e5a-b7c0-4929163ee7c2 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:16.226542 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a9e1b3be-edb7-4e5a-b7c0-4929163ee7c2 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:16.226984 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a9e1b3be-edb7-4e5a-b7c0-4929163ee7c2 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:16.227674 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a9e1b3be-edb7-4e5a-b7c0-4929163ee7c2 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:16.228131 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a9e1b3be-edb7-4e5a-b7c0-4929163ee7c2 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:16.228556 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a9e1b3be-edb7-4e5a-b7c0-4929163ee7c2 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:16.358673 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a9e1b3be-edb7-4e5a-b7c0-4929163ee7c2 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:59:16.367283 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a9e1b3be-edb7-4e5a-b7c0-4929163ee7c2 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 200 len: 1520 microversion: 2.1 time: 0.153082 Oct 26 13:59:16.367855 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3545/7112] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:59:16 2022] GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:59:17.390356 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a9b50b1a-971e-4ba8-a8a6-65294f9ea423 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:59:17.391060 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a9b50b1a-971e-4ba8-a8a6-65294f9ea423 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:59:17.399187 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a9b50b1a-971e-4ba8-a8a6-65294f9ea423 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:17.399695 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a9b50b1a-971e-4ba8-a8a6-65294f9ea423 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:17.400149 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a9b50b1a-971e-4ba8-a8a6-65294f9ea423 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:17.400865 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a9b50b1a-971e-4ba8-a8a6-65294f9ea423 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:17.401337 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a9b50b1a-971e-4ba8-a8a6-65294f9ea423 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:17.401809 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a9b50b1a-971e-4ba8-a8a6-65294f9ea423 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:17.532430 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a9b50b1a-971e-4ba8-a8a6-65294f9ea423 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:59:17.540515 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a9b50b1a-971e-4ba8-a8a6-65294f9ea423 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 200 len: 1520 microversion: 2.1 time: 0.154221 Oct 26 13:59:17.541093 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3568/7113] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:59:17 2022] GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:59:18.564299 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-42c57c97-72f3-49a1-8120-9fafeb1b211b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:59:18.564941 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-42c57c97-72f3-49a1-8120-9fafeb1b211b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:59:18.571809 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-42c57c97-72f3-49a1-8120-9fafeb1b211b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:18.572296 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-42c57c97-72f3-49a1-8120-9fafeb1b211b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:18.572737 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-42c57c97-72f3-49a1-8120-9fafeb1b211b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:18.573431 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-42c57c97-72f3-49a1-8120-9fafeb1b211b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:18.573918 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-42c57c97-72f3-49a1-8120-9fafeb1b211b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:18.574353 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-42c57c97-72f3-49a1-8120-9fafeb1b211b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:18.706170 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-42c57c97-72f3-49a1-8120-9fafeb1b211b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:59:18.713929 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-42c57c97-72f3-49a1-8120-9fafeb1b211b tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 200 len: 1520 microversion: 2.1 time: 0.154102 Oct 26 13:59:18.714511 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3546/7114] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:59:18 2022] GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:59:19.737374 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d6906906-760b-4c4b-852b-8dc4a651fee0 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:59:19.738017 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d6906906-760b-4c4b-852b-8dc4a651fee0 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:59:19.744582 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6906906-760b-4c4b-852b-8dc4a651fee0 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:19.745087 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6906906-760b-4c4b-852b-8dc4a651fee0 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:19.745577 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6906906-760b-4c4b-852b-8dc4a651fee0 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:19.746298 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6906906-760b-4c4b-852b-8dc4a651fee0 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:19.746776 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6906906-760b-4c4b-852b-8dc4a651fee0 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:19.747224 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6906906-760b-4c4b-852b-8dc4a651fee0 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:19.751498 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=92 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:59:19.898539 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d6906906-760b-4c4b-852b-8dc4a651fee0 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:59:19.909314 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d6906906-760b-4c4b-852b-8dc4a651fee0 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 200 len: 1520 microversion: 2.1 time: 0.175649 Oct 26 13:59:19.910315 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3569/7115] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:59:19 2022] GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:59:20.935952 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a5d07af5-47e2-4b89-a08b-024ff0d53d66 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:59:20.936758 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a5d07af5-47e2-4b89-a08b-024ff0d53d66 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:59:20.944463 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5d07af5-47e2-4b89-a08b-024ff0d53d66 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:20.944951 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5d07af5-47e2-4b89-a08b-024ff0d53d66 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:20.945398 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5d07af5-47e2-4b89-a08b-024ff0d53d66 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:20.946146 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5d07af5-47e2-4b89-a08b-024ff0d53d66 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:20.946612 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5d07af5-47e2-4b89-a08b-024ff0d53d66 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:20.947181 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5d07af5-47e2-4b89-a08b-024ff0d53d66 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:21.024422 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-8064fa77-ea6e-4038-8bff-aa14d165a6d9 req-4c427961-ae3e-49b4-9734-937459325edd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb7d16d8-10eb-4217-a169-da9fdd146035", "name": "network-vif-unplugged", "status": "completed", "tag": "644507cd-f45d-4473-b6f1-ae4d8fd539e9"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:59:21.036066 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8064fa77-ea6e-4038-8bff-aa14d165a6d9 req-4c427961-ae3e-49b4-9734-937459325edd service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:21.036568 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8064fa77-ea6e-4038-8bff-aa14d165a6d9 req-4c427961-ae3e-49b4-9734-937459325edd service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:21.037023 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8064fa77-ea6e-4038-8bff-aa14d165a6d9 req-4c427961-ae3e-49b4-9734-937459325edd service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:21.049967 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-8064fa77-ea6e-4038-8bff-aa14d165a6d9 req-4c427961-ae3e-49b4-9734-937459325edd service nova] Creating event network-vif-unplugged:644507cd-f45d-4473-b6f1-ae4d8fd539e9 for instance bb7d16d8-10eb-4217-a169-da9fdd146035 on n-h1-862686-1 Oct 26 13:59:21.056263 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [req-8064fa77-ea6e-4038-8bff-aa14d165a6d9 req-4c427961-ae3e-49b4-9734-937459325edd service nova] Instance bb7d16d8-10eb-4217-a169-da9fdd146035 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862686-1', 'n-h1-862686-1'} {{(pid=120598) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 13:59:21.068883 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-8064fa77-ea6e-4038-8bff-aa14d165a6d9 req-4c427961-ae3e-49b4-9734-937459325edd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048473 Oct 26 13:59:21.069683 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3570/7116] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:59:21.086233 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a5d07af5-47e2-4b89-a08b-024ff0d53d66 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:59:21.094803 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a5d07af5-47e2-4b89-a08b-024ff0d53d66 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 200 len: 1519 microversion: 2.1 time: 0.162854 Oct 26 13:59:21.095384 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3547/7117] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:59:20 2022] GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:59:22.119342 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2321b625-5736-4b08-904c-0afff86715c8 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:59:22.120051 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2321b625-5736-4b08-904c-0afff86715c8 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:59:22.126834 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2321b625-5736-4b08-904c-0afff86715c8 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:22.127274 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2321b625-5736-4b08-904c-0afff86715c8 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:22.127724 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2321b625-5736-4b08-904c-0afff86715c8 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:22.128420 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2321b625-5736-4b08-904c-0afff86715c8 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:22.128893 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2321b625-5736-4b08-904c-0afff86715c8 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:22.129330 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2321b625-5736-4b08-904c-0afff86715c8 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:22.264504 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2321b625-5736-4b08-904c-0afff86715c8 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:59:22.273705 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2321b625-5736-4b08-904c-0afff86715c8 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 200 len: 1517 microversion: 2.1 time: 0.159400 Oct 26 13:59:22.274320 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3571/7118] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:59:22 2022] GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:59:23.086021 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-2c7bcf48-3feb-4238-a10b-9389649ae59f req-ab5a9e73-0902-4334-b662-840636345451 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb7d16d8-10eb-4217-a169-da9fdd146035", "tag": "644507cd-f45d-4473-b6f1-ae4d8fd539e9"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:59:23.097174 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2c7bcf48-3feb-4238-a10b-9389649ae59f req-ab5a9e73-0902-4334-b662-840636345451 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:23.097790 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2c7bcf48-3feb-4238-a10b-9389649ae59f req-ab5a9e73-0902-4334-b662-840636345451 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:23.098283 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2c7bcf48-3feb-4238-a10b-9389649ae59f req-ab5a9e73-0902-4334-b662-840636345451 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:23.110886 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-2c7bcf48-3feb-4238-a10b-9389649ae59f req-ab5a9e73-0902-4334-b662-840636345451 service nova] Creating event network-changed:644507cd-f45d-4473-b6f1-ae4d8fd539e9 for instance bb7d16d8-10eb-4217-a169-da9fdd146035 on n-h1-862686-1 Oct 26 13:59:23.116148 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [req-2c7bcf48-3feb-4238-a10b-9389649ae59f req-ab5a9e73-0902-4334-b662-840636345451 service nova] Instance bb7d16d8-10eb-4217-a169-da9fdd146035 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862686-1', 'n-h1-862686-1'} {{(pid=120597) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 13:59:23.127666 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-2c7bcf48-3feb-4238-a10b-9389649ae59f req-ab5a9e73-0902-4334-b662-840636345451 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045337 Oct 26 13:59:23.128252 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3548/7119] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:59:23.298122 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e060764d-1ad1-4388-a1d1-13dafa5af7f0 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:59:23.298752 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e060764d-1ad1-4388-a1d1-13dafa5af7f0 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:59:23.305697 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e060764d-1ad1-4388-a1d1-13dafa5af7f0 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:23.306205 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e060764d-1ad1-4388-a1d1-13dafa5af7f0 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:23.306638 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e060764d-1ad1-4388-a1d1-13dafa5af7f0 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:23.307349 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e060764d-1ad1-4388-a1d1-13dafa5af7f0 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:23.307811 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e060764d-1ad1-4388-a1d1-13dafa5af7f0 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:23.308245 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e060764d-1ad1-4388-a1d1-13dafa5af7f0 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:23.627943 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e060764d-1ad1-4388-a1d1-13dafa5af7f0 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:59:23.637234 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e060764d-1ad1-4388-a1d1-13dafa5af7f0 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 200 len: 1517 microversion: 2.1 time: 0.343707 Oct 26 13:59:23.638276 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3572/7120] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:59:23 2022] GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 1517 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:59:24.663938 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-664ffe29-0de0-4b13-810c-48f8d357f3df tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:59:24.664641 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-664ffe29-0de0-4b13-810c-48f8d357f3df tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:59:24.672401 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-664ffe29-0de0-4b13-810c-48f8d357f3df tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:24.672894 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-664ffe29-0de0-4b13-810c-48f8d357f3df tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:24.673328 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-664ffe29-0de0-4b13-810c-48f8d357f3df tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:24.674111 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-664ffe29-0de0-4b13-810c-48f8d357f3df tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:24.674572 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-664ffe29-0de0-4b13-810c-48f8d357f3df tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:24.675003 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-664ffe29-0de0-4b13-810c-48f8d357f3df tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:24.808850 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-664ffe29-0de0-4b13-810c-48f8d357f3df tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:59:24.817227 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-664ffe29-0de0-4b13-810c-48f8d357f3df tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 200 len: 1514 microversion: 2.1 time: 0.157636 Oct 26 13:59:24.817847 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3549/7121] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:59:24 2022] GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:59:24.840409 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d22fcc4e-12de-438f-a525-91de5d92648d tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:59:24.840955 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d22fcc4e-12de-438f-a525-91de5d92648d tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:59:24.848453 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d22fcc4e-12de-438f-a525-91de5d92648d tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:24.848956 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d22fcc4e-12de-438f-a525-91de5d92648d tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:24.849408 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d22fcc4e-12de-438f-a525-91de5d92648d tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:24.850140 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d22fcc4e-12de-438f-a525-91de5d92648d tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:24.850614 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d22fcc4e-12de-438f-a525-91de5d92648d tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:24.851075 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d22fcc4e-12de-438f-a525-91de5d92648d tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:24.912693 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d22fcc4e-12de-438f-a525-91de5d92648d tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "POST /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035/action" status: 204 len: 0 microversion: 2.1 time: 0.076398 Oct 26 13:59:24.913409 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3573/7122] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 13:59:24 2022] POST /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:59:24.921638 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1c4c40e6-8bf5-45f4-96db-e75ac0a91998 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:59:24.922301 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1c4c40e6-8bf5-45f4-96db-e75ac0a91998 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:59:24.928543 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1c4c40e6-8bf5-45f4-96db-e75ac0a91998 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:24.929022 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1c4c40e6-8bf5-45f4-96db-e75ac0a91998 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:24.929517 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1c4c40e6-8bf5-45f4-96db-e75ac0a91998 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:24.930243 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1c4c40e6-8bf5-45f4-96db-e75ac0a91998 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:24.930692 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1c4c40e6-8bf5-45f4-96db-e75ac0a91998 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:24.931124 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1c4c40e6-8bf5-45f4-96db-e75ac0a91998 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:25.414560 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1c4c40e6-8bf5-45f4-96db-e75ac0a91998 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:59:25.425021 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1c4c40e6-8bf5-45f4-96db-e75ac0a91998 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 200 len: 1514 microversion: 2.1 time: 0.507354 Oct 26 13:59:25.425862 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3550/7123] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:59:24 2022] GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 1514 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:59:26.449610 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-15f00d99-45ce-4135-ac67-84ef4db4d602 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:59:26.450244 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-15f00d99-45ce-4135-ac67-84ef4db4d602 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:59:26.456848 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15f00d99-45ce-4135-ac67-84ef4db4d602 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:26.457342 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15f00d99-45ce-4135-ac67-84ef4db4d602 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:26.457835 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15f00d99-45ce-4135-ac67-84ef4db4d602 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:26.458535 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15f00d99-45ce-4135-ac67-84ef4db4d602 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:26.459007 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15f00d99-45ce-4135-ac67-84ef4db4d602 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:26.459444 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15f00d99-45ce-4135-ac67-84ef4db4d602 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:26.590415 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-15f00d99-45ce-4135-ac67-84ef4db4d602 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:59:26.599305 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-15f00d99-45ce-4135-ac67-84ef4db4d602 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 200 len: 1506 microversion: 2.1 time: 0.155123 Oct 26 13:59:26.599884 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3574/7124] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:59:26 2022] GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:59:26.621701 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-47edc6d0-6980-49db-92e8-93480bac1dda tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:59:26.622318 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-47edc6d0-6980-49db-92e8-93480bac1dda tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:59:26.629262 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-47edc6d0-6980-49db-92e8-93480bac1dda tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:26.629777 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-47edc6d0-6980-49db-92e8-93480bac1dda tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:26.630214 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-47edc6d0-6980-49db-92e8-93480bac1dda tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:26.630938 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-47edc6d0-6980-49db-92e8-93480bac1dda tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:26.631395 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-47edc6d0-6980-49db-92e8-93480bac1dda tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:26.631820 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-47edc6d0-6980-49db-92e8-93480bac1dda tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:26.761885 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-47edc6d0-6980-49db-92e8-93480bac1dda tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:59:26.770160 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-47edc6d0-6980-49db-92e8-93480bac1dda tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 200 len: 1506 microversion: 2.1 time: 0.152405 Oct 26 13:59:26.770733 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3551/7125] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:59:26 2022] GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:59:26.792417 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0b6bf448-d0b8-4e31-bcce-78d63fdee0a2 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:59:26.793075 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0b6bf448-d0b8-4e31-bcce-78d63fdee0a2 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:59:26.799090 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0b6bf448-d0b8-4e31-bcce-78d63fdee0a2 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:26.799591 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0b6bf448-d0b8-4e31-bcce-78d63fdee0a2 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:26.800047 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0b6bf448-d0b8-4e31-bcce-78d63fdee0a2 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:26.800750 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0b6bf448-d0b8-4e31-bcce-78d63fdee0a2 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:26.801221 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0b6bf448-d0b8-4e31-bcce-78d63fdee0a2 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:26.801693 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0b6bf448-d0b8-4e31-bcce-78d63fdee0a2 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:26.933300 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0b6bf448-d0b8-4e31-bcce-78d63fdee0a2 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:59:26.941747 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0b6bf448-d0b8-4e31-bcce-78d63fdee0a2 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 200 len: 1506 microversion: 2.1 time: 0.153261 Oct 26 13:59:26.942337 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3575/7126] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:59:26 2022] GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:59:26.964761 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b0004856-6e86-4fd0-993d-d8c8d06f3ebe tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:59:26.965211 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b0004856-6e86-4fd0-993d-d8c8d06f3ebe tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:59:26.971191 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b0004856-6e86-4fd0-993d-d8c8d06f3ebe tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:26.971671 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b0004856-6e86-4fd0-993d-d8c8d06f3ebe tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:26.972266 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b0004856-6e86-4fd0-993d-d8c8d06f3ebe tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:26.972951 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b0004856-6e86-4fd0-993d-d8c8d06f3ebe tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:26.973405 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b0004856-6e86-4fd0-993d-d8c8d06f3ebe tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:26.973858 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b0004856-6e86-4fd0-993d-d8c8d06f3ebe tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:26.997934 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b0004856-6e86-4fd0-993d-d8c8d06f3ebe tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:59:27.071862 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b0004856-6e86-4fd0-993d-d8c8d06f3ebe tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "DELETE /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 204 len: 0 microversion: 2.1 time: 0.110780 Oct 26 13:59:27.072488 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3552/7127] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:59:26 2022] DELETE /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:59:27.090511 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-472c9a55-e223-45df-a6ed-e071f90a3c59 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:59:27.091022 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-472c9a55-e223-45df-a6ed-e071f90a3c59 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:59:27.097304 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-472c9a55-e223-45df-a6ed-e071f90a3c59 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:27.097834 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-472c9a55-e223-45df-a6ed-e071f90a3c59 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:27.098279 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-472c9a55-e223-45df-a6ed-e071f90a3c59 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:27.098973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-472c9a55-e223-45df-a6ed-e071f90a3c59 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:27.099436 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-472c9a55-e223-45df-a6ed-e071f90a3c59 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:27.099926 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-472c9a55-e223-45df-a6ed-e071f90a3c59 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:27.125784 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-472c9a55-e223-45df-a6ed-e071f90a3c59 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 13:59:27.172055 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.compute.api [None req-472c9a55-e223-45df-a6ed-e071f90a3c59 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Instance is already in deleting state, ignoring this request Oct 26 13:59:27.172896 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-472c9a55-e223-45df-a6ed-e071f90a3c59 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "DELETE /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 204 len: 0 microversion: 2.1 time: 0.086590 Oct 26 13:59:27.173459 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3576/7128] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:59:27 2022] DELETE /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 13:59:27.182130 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-90527595-b97c-49c8-bb31-f646a0ef7289 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:59:27.182832 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-90527595-b97c-49c8-bb31-f646a0ef7289 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:59:27.189356 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90527595-b97c-49c8-bb31-f646a0ef7289 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:27.189880 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90527595-b97c-49c8-bb31-f646a0ef7289 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:27.190323 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90527595-b97c-49c8-bb31-f646a0ef7289 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:27.191022 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90527595-b97c-49c8-bb31-f646a0ef7289 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:27.191480 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90527595-b97c-49c8-bb31-f646a0ef7289 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:27.191914 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-90527595-b97c-49c8-bb31-f646a0ef7289 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:27.325686 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-90527595-b97c-49c8-bb31-f646a0ef7289 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:59:27.334274 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-90527595-b97c-49c8-bb31-f646a0ef7289 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 200 len: 1512 microversion: 2.1 time: 0.156376 Oct 26 13:59:27.334862 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3553/7129] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:59:27 2022] GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:59:27.471993 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-3a5046a8-a8c9-4e1a-bb8a-3d6578d32eca req-64fe1c01-6ad2-4982-9cf6-7af6865981f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb7d16d8-10eb-4217-a169-da9fdd146035", "name": "network-vif-plugged", "status": "completed", "tag": "644507cd-f45d-4473-b6f1-ae4d8fd539e9"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:59:27.482313 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-3a5046a8-a8c9-4e1a-bb8a-3d6578d32eca req-64fe1c01-6ad2-4982-9cf6-7af6865981f5 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:27.482810 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-3a5046a8-a8c9-4e1a-bb8a-3d6578d32eca req-64fe1c01-6ad2-4982-9cf6-7af6865981f5 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:27.483253 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-3a5046a8-a8c9-4e1a-bb8a-3d6578d32eca req-64fe1c01-6ad2-4982-9cf6-7af6865981f5 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:27.495115 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-3a5046a8-a8c9-4e1a-bb8a-3d6578d32eca req-64fe1c01-6ad2-4982-9cf6-7af6865981f5 service nova] Creating event network-vif-plugged:644507cd-f45d-4473-b6f1-ae4d8fd539e9 for instance bb7d16d8-10eb-4217-a169-da9fdd146035 on n-h1-862686-1 Oct 26 13:59:27.501282 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-3a5046a8-a8c9-4e1a-bb8a-3d6578d32eca req-64fe1c01-6ad2-4982-9cf6-7af6865981f5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032516 Oct 26 13:59:27.501934 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3577/7130] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:59:28.358645 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f5559285-6301-49fe-9555-062f65f42eeb tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:59:28.359348 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f5559285-6301-49fe-9555-062f65f42eeb tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:59:28.366365 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f5559285-6301-49fe-9555-062f65f42eeb tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:28.366877 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f5559285-6301-49fe-9555-062f65f42eeb tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:28.367313 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f5559285-6301-49fe-9555-062f65f42eeb tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:28.368004 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f5559285-6301-49fe-9555-062f65f42eeb tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:28.368460 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f5559285-6301-49fe-9555-062f65f42eeb tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:28.368887 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f5559285-6301-49fe-9555-062f65f42eeb tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:28.384417 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:59:28.497928 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f5559285-6301-49fe-9555-062f65f42eeb tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e18c48f4b14f6bae21de79f785e93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b21631dc54c5b8acb4840ca9fd26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:59:28.506414 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f5559285-6301-49fe-9555-062f65f42eeb tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 200 len: 1512 microversion: 2.1 time: 0.151781 Oct 26 13:59:28.506986 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3554/7131] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:59:28 2022] GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:59:28.961937 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-33124ccb-56d7-48d4-aafd-e786336e425b req-46abfb11-b8ed-4755-baa2-abc27231a1d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb7d16d8-10eb-4217-a169-da9fdd146035", "name": "network-vif-deleted", "tag": "644507cd-f45d-4473-b6f1-ae4d8fd539e9"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:59:28.979132 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-33124ccb-56d7-48d4-aafd-e786336e425b req-46abfb11-b8ed-4755-baa2-abc27231a1d6 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:28.979904 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-33124ccb-56d7-48d4-aafd-e786336e425b req-46abfb11-b8ed-4755-baa2-abc27231a1d6 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:28.980354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-33124ccb-56d7-48d4-aafd-e786336e425b req-46abfb11-b8ed-4755-baa2-abc27231a1d6 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:28.996872 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-33124ccb-56d7-48d4-aafd-e786336e425b req-46abfb11-b8ed-4755-baa2-abc27231a1d6 service nova] Creating event network-vif-deleted:644507cd-f45d-4473-b6f1-ae4d8fd539e9 for instance bb7d16d8-10eb-4217-a169-da9fdd146035 on n-h1-862686-1 Oct 26 13:59:29.002882 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-33124ccb-56d7-48d4-aafd-e786336e425b req-46abfb11-b8ed-4755-baa2-abc27231a1d6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045088 Oct 26 13:59:29.003840 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3578/7132] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:59:29.530651 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cac5e561-aa64-4768-b7d0-f6ede5e9c7c8 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:59:29.532225 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cac5e561-aa64-4768-b7d0-f6ede5e9c7c8 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: bb7d16d8-10eb-4217-a169-da9fdd146035] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:59:29.538853 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cac5e561-aa64-4768-b7d0-f6ede5e9c7c8 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:29.539335 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cac5e561-aa64-4768-b7d0-f6ede5e9c7c8 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:29.539768 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cac5e561-aa64-4768-b7d0-f6ede5e9c7c8 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:29.540449 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cac5e561-aa64-4768-b7d0-f6ede5e9c7c8 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:29.540899 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cac5e561-aa64-4768-b7d0-f6ede5e9c7c8 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:29.541322 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cac5e561-aa64-4768-b7d0-f6ede5e9c7c8 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:29.554584 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-cac5e561-aa64-4768-b7d0-f6ede5e9c7c8 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] HTTP exception thrown: Instance bb7d16d8-10eb-4217-a169-da9fdd146035 could not be found. Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cac5e561-aa64-4768-b7d0-f6ede5e9c7c8 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Request method failure captured: Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 HTTP/1.1 Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTzdIywedfEPAHGmeoRf98mct0KvOHDyuN11ykp0Kx40aFPYyUDmFfBWQhyLB8HEo7n7I9OnDda8xh0rmJqHq4oLCw_EzqdTo7Fl7qJzZD5Q1xxO_npoSQujLaO-UKOzd_ixruOAeluufD3pXpkonpol4X-6gNePaZmcYOzyHTuab_k Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 726b21631dc54c5b8acb4840ca9fd26d Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServerDiskConfigTestJSON-94270247 Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/726b21631dc54c5b8acb4840ca9fd26d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/726b21631dc54c5b8acb4840ca9fd26d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_726b21631dc54c5b8acb4840ca9fd26d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/726b21631dc54c5b8acb4840ca9fd26d"}]}] Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServerDiskConfigTestJSON-94270247 Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 726b21631dc54c5b8acb4840ca9fd26d Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-94270247 Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServerDiskConfigTestJSON-94270247-project Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: b7e18c48f4b14f6bae21de79f785e93e Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServerDiskConfigTestJSON-94270247-project Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance bb7d16d8-10eb-4217-a169-da9fdd146035 could not be found. Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'bb7d16d8-10eb-4217-a169-da9fdd146035'} Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb7d16d8-10eb-4217-a169-da9fdd146035 could not be found. Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb7d16d8-10eb-4217-a169-da9fdd146035 could not be found. Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:59:29.556209 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:59:29.560975 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:59:29.560975 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:59:29.560975 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:59:29.560975 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:59:29.560975 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:59:29.560975 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb7d16d8-10eb-4217-a169-da9fdd146035 could not be found. Oct 26 13:59:29.560975 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:59:29.560975 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cac5e561-aa64-4768-b7d0-f6ede5e9c7c8 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Returning 404 to user: Instance bb7d16d8-10eb-4217-a169-da9fdd146035 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:59:29.560975 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cac5e561-aa64-4768-b7d0-f6ede5e9c7c8 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035" status: 404 len: 111 microversion: 2.1 time: 0.031147 Oct 26 13:59:29.560975 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3555/7133] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:59:29 2022] GET /compute/v2.1/servers/bb7d16d8-10eb-4217-a169-da9fdd146035 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:59:29.567111 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-48a2ea3a-a7d4-4cdb-8b85-70cc4f9f4ba7 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '.version_select at 0x7f6731f65700>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:59:29.588954 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-48a2ea3a-a7d4-4cdb-8b85-70cc4f9f4ba7 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1602818080" status: 202 len: 0 microversion: 2.1 time: 0.026121 Oct 26 13:59:29.589713 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3579/7134] 10.222.0.40 () {58 vars in 1221 bytes} [Wed Oct 26 13:59:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1602818080 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 13:59:30.198614 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1cb6fb4e-e9b9-4cbf-a576-a4103d22f65c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:59:30.199108 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1cb6fb4e-e9b9-4cbf-a576-a4103d22f65c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:59:30.205767 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1cb6fb4e-e9b9-4cbf-a576-a4103d22f65c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:30.206250 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1cb6fb4e-e9b9-4cbf-a576-a4103d22f65c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:30.206682 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1cb6fb4e-e9b9-4cbf-a576-a4103d22f65c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:30.207363 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1cb6fb4e-e9b9-4cbf-a576-a4103d22f65c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:30.207816 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1cb6fb4e-e9b9-4cbf-a576-a4103d22f65c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:30.208239 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1cb6fb4e-e9b9-4cbf-a576-a4103d22f65c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:30.224095 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-1cb6fb4e-e9b9-4cbf-a576-a4103d22f65c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] HTTP exception thrown: Instance 0d62339f-8ae9-4dc9-b99d-9227d2194d1f could not be found. Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1cb6fb4e-e9b9-4cbf-a576-a4103d22f65c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Request method failure captured: Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f HTTP/1.1 Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWTzdIywedfEPAHGmeoRf98mct0KvOHDyuN11ykp0Kx40aFPYyUDmFfBWQhyLB8HEo7n7I9OnDda8xh0rmJqHq4oLCw_EzqdTo7Fl7qJzZD5Q1xxO_npoSQujLaO-UKOzd_ixruOAeluufD3pXpkonpol4X-6gNePaZmcYOzyHTuab_k Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 726b21631dc54c5b8acb4840ca9fd26d Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServerDiskConfigTestJSON-94270247 Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/726b21631dc54c5b8acb4840ca9fd26d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/726b21631dc54c5b8acb4840ca9fd26d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_726b21631dc54c5b8acb4840ca9fd26d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/726b21631dc54c5b8acb4840ca9fd26d"}]}] Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServerDiskConfigTestJSON-94270247 Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 726b21631dc54c5b8acb4840ca9fd26d Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-94270247 Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServerDiskConfigTestJSON-94270247-project Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: b7e18c48f4b14f6bae21de79f785e93e Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServerDiskConfigTestJSON-94270247-project Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 0d62339f-8ae9-4dc9-b99d-9227d2194d1f could not be found. Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '0d62339f-8ae9-4dc9-b99d-9227d2194d1f'} Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d62339f-8ae9-4dc9-b99d-9227d2194d1f could not be found. Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:59:30.226047 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:59:30.230360 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d62339f-8ae9-4dc9-b99d-9227d2194d1f could not be found. Oct 26 13:59:30.230360 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:59:30.230360 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:59:30.230360 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:59:30.230360 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:59:30.230360 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:59:30.230360 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:59:30.230360 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:59:30.230360 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:59:30.230360 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d62339f-8ae9-4dc9-b99d-9227d2194d1f could not be found. Oct 26 13:59:30.230360 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 13:59:30.230360 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1cb6fb4e-e9b9-4cbf-a576-a4103d22f65c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Returning 404 to user: Instance 0d62339f-8ae9-4dc9-b99d-9227d2194d1f could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:59:30.230360 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1cb6fb4e-e9b9-4cbf-a576-a4103d22f65c tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 404 len: 111 microversion: 2.1 time: 0.032907 Oct 26 13:59:30.230360 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3556/7135] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 13:59:30 2022] DELETE /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:59:30.239125 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-aa1488ff-28c5-48c6-a273-3c738ca02695 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:59:30.239866 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-aa1488ff-28c5-48c6-a273-3c738ca02695 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] [instance: 0d62339f-8ae9-4dc9-b99d-9227d2194d1f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:59:30.246665 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa1488ff-28c5-48c6-a273-3c738ca02695 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:30.247156 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa1488ff-28c5-48c6-a273-3c738ca02695 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:30.247604 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa1488ff-28c5-48c6-a273-3c738ca02695 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:30.248299 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa1488ff-28c5-48c6-a273-3c738ca02695 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:30.248763 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa1488ff-28c5-48c6-a273-3c738ca02695 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:30.249199 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa1488ff-28c5-48c6-a273-3c738ca02695 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:30.264409 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-aa1488ff-28c5-48c6-a273-3c738ca02695 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] HTTP exception thrown: Instance 0d62339f-8ae9-4dc9-b99d-9227d2194d1f could not be found. Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-aa1488ff-28c5-48c6-a273-3c738ca02695 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Request method failure captured: Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f HTTP/1.1 Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWTzdIywedfEPAHGmeoRf98mct0KvOHDyuN11ykp0Kx40aFPYyUDmFfBWQhyLB8HEo7n7I9OnDda8xh0rmJqHq4oLCw_EzqdTo7Fl7qJzZD5Q1xxO_npoSQujLaO-UKOzd_ixruOAeluufD3pXpkonpol4X-6gNePaZmcYOzyHTuab_k Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 726b21631dc54c5b8acb4840ca9fd26d Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServerDiskConfigTestJSON-94270247 Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/726b21631dc54c5b8acb4840ca9fd26d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/726b21631dc54c5b8acb4840ca9fd26d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_726b21631dc54c5b8acb4840ca9fd26d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/726b21631dc54c5b8acb4840ca9fd26d"}]}] Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServerDiskConfigTestJSON-94270247 Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 726b21631dc54c5b8acb4840ca9fd26d Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-94270247 Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServerDiskConfigTestJSON-94270247-project Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: b7e18c48f4b14f6bae21de79f785e93e Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServerDiskConfigTestJSON-94270247-project Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 0d62339f-8ae9-4dc9-b99d-9227d2194d1f could not be found. Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '0d62339f-8ae9-4dc9-b99d-9227d2194d1f'} Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d62339f-8ae9-4dc9-b99d-9227d2194d1f could not be found. Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d62339f-8ae9-4dc9-b99d-9227d2194d1f could not be found. Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 13:59:30.266605 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:59:30.271180 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 13:59:30.271180 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 13:59:30.271180 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 13:59:30.271180 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 13:59:30.271180 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 13:59:30.271180 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d62339f-8ae9-4dc9-b99d-9227d2194d1f could not be found. Oct 26 13:59:30.271180 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 13:59:30.271180 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-aa1488ff-28c5-48c6-a273-3c738ca02695 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] Returning 404 to user: Instance 0d62339f-8ae9-4dc9-b99d-9227d2194d1f could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 13:59:30.271180 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-aa1488ff-28c5-48c6-a273-3c738ca02695 tempest-ServerDiskConfigTestJSON-94270247 tempest-ServerDiskConfigTestJSON-94270247-project] 10.222.0.40 "GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f" status: 404 len: 111 microversion: 2.1 time: 0.034991 Oct 26 13:59:30.271180 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3580/7136] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:59:30 2022] GET /compute/v2.1/servers/0d62339f-8ae9-4dc9-b99d-9227d2194d1f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 13:59:38.889000 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2d1237a6-ef0d-4869-a7f2-b87124c5f9f3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Action: 'create', calling method: .version_select at 0x7f673213b5e0>, body: {"keypair": {"name": "tempest-keypair-908741287", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFwx9wsqXZqdnBVriB6JN8dMCYs31VkEr3ACZUgnlxQDQyg6lhrejyZNk5qzW1Nd70TYcoZJJqle2X3C0+DPoFjRo6hRX7X6lbzgguSuztrqtFpxNYuP+e7j/XxX9TGaw=="}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:59:38.895490 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:59:38.909185 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-2d1237a6-ef0d-4869-a7f2-b87124c5f9f3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Getting quotas for project 73688cef84664d7db69a39fcbffb6e65. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:59:38.914627 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-2d1237a6-ef0d-4869-a7f2-b87124c5f9f3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Getting quotas for user dc4fe5238edd40db8d203790e2aab143 and project 73688cef84664d7db69a39fcbffb6e65. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:59:38.945856 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2d1237a6-ef0d-4869-a7f2-b87124c5f9f3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.187344 Oct 26 13:59:38.946466 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3557/7137] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 13:59:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:59:40.215715 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-022d8171-f08b-4eab-a3ee-214bca8797ae tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1371206606", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2cd9056a-bda2-4cf3-a05f-b03f797a2eee"}], "security_groups": [{"name": "tempest-securitygroup--2110277177"}], "key_name": "tempest-keypair-908741287", "user_data": "}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:59:40.227032 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:59:40.255389 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:59:40.333867 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-022d8171-f08b-4eab-a3ee-214bca8797ae tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] validate_networks() for [('2cd9056a-bda2-4cf3-a05f-b03f797a2eee', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 13:59:40.722789 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-022d8171-f08b-4eab-a3ee-214bca8797ae tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 13:59:40.723243 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-022d8171-f08b-4eab-a3ee-214bca8797ae tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 13:59:40.724209 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-022d8171-f08b-4eab-a3ee-214bca8797ae tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 13:59:40.725021 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-022d8171-f08b-4eab-a3ee-214bca8797ae tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 13:59:40.725462 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-022d8171-f08b-4eab-a3ee-214bca8797ae tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 13:59:40.735903 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-022d8171-f08b-4eab-a3ee-214bca8797ae tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:40.736440 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-022d8171-f08b-4eab-a3ee-214bca8797ae tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:40.736847 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-022d8171-f08b-4eab-a3ee-214bca8797ae tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:40.737621 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-022d8171-f08b-4eab-a3ee-214bca8797ae tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:40.738094 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-022d8171-f08b-4eab-a3ee-214bca8797ae tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:40.738839 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-022d8171-f08b-4eab-a3ee-214bca8797ae tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:40.755884 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-022d8171-f08b-4eab-a3ee-214bca8797ae tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Getting quotas for project 73688cef84664d7db69a39fcbffb6e65. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 13:59:40.761202 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-022d8171-f08b-4eab-a3ee-214bca8797ae tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Getting quotas for user dc4fe5238edd40db8d203790e2aab143 and project 73688cef84664d7db69a39fcbffb6e65. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 13:59:40.774451 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-022d8171-f08b-4eab-a3ee-214bca8797ae tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 13:59:40.776805 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-022d8171-f08b-4eab-a3ee-214bca8797ae tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 13:59:40.828218 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-022d8171-f08b-4eab-a3ee-214bca8797ae tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.616311 Oct 26 13:59:40.829075 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3581/7138] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 13:59:40 2022] POST /compute/v2.1/servers => generated 409 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 13:59:40.837610 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=7 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:59:40.842499 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a2763383-239f-4f2c-b355-09f3c6cd45f5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:59:40.843745 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a2763383-239f-4f2c-b355-09f3c6cd45f5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:59:40.909966 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a2763383-239f-4f2c-b355-09f3c6cd45f5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:59:40.916916 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a2763383-239f-4f2c-b355-09f3c6cd45f5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae" status: 200 len: 1238 microversion: 2.1 time: 0.080814 Oct 26 13:59:40.918045 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3558/7139] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:59:40 2022] GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae => generated 1238 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:59:41.940961 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6ac699b4-5c87-4cd3-8177-6ed68a173a62 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:59:41.941723 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6ac699b4-5c87-4cd3-8177-6ed68a173a62 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:59:41.949797 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ac699b4-5c87-4cd3-8177-6ed68a173a62 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:41.950384 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ac699b4-5c87-4cd3-8177-6ed68a173a62 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:41.950906 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ac699b4-5c87-4cd3-8177-6ed68a173a62 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:41.951686 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ac699b4-5c87-4cd3-8177-6ed68a173a62 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:41.952850 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ac699b4-5c87-4cd3-8177-6ed68a173a62 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:41.953556 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ac699b4-5c87-4cd3-8177-6ed68a173a62 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:42.021528 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6ac699b4-5c87-4cd3-8177-6ed68a173a62 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:59:42.029805 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6ac699b4-5c87-4cd3-8177-6ed68a173a62 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae" status: 200 len: 1290 microversion: 2.1 time: 0.093458 Oct 26 13:59:42.030529 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3582/7140] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:59:41 2022] GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae => generated 1290 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:59:43.054032 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2f519f96-1416-4f51-a1eb-e375124fedcc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:59:43.054805 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2f519f96-1416-4f51-a1eb-e375124fedcc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:59:43.062571 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2f519f96-1416-4f51-a1eb-e375124fedcc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:43.063154 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2f519f96-1416-4f51-a1eb-e375124fedcc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:43.063687 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2f519f96-1416-4f51-a1eb-e375124fedcc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:43.064473 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2f519f96-1416-4f51-a1eb-e375124fedcc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:43.064958 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2f519f96-1416-4f51-a1eb-e375124fedcc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:43.065374 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2f519f96-1416-4f51-a1eb-e375124fedcc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:43.210815 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2f519f96-1416-4f51-a1eb-e375124fedcc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:59:43.219482 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2f519f96-1416-4f51-a1eb-e375124fedcc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae" status: 200 len: 1364 microversion: 2.1 time: 0.169044 Oct 26 13:59:43.220168 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3559/7141] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:59:43 2022] GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:59:43.598283 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-9cd5fe55-5120-400d-a7b0-db878f4cd34d req-539bcea2-0d80-4dc0-b531-f14d9d936408 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a810e13d-99f4-4c1b-83d6-8f06f9249fae", "tag": "bdf20b35-e026-4d53-90e2-af6d1020339c"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:59:43.614199 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9cd5fe55-5120-400d-a7b0-db878f4cd34d req-539bcea2-0d80-4dc0-b531-f14d9d936408 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:43.614686 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9cd5fe55-5120-400d-a7b0-db878f4cd34d req-539bcea2-0d80-4dc0-b531-f14d9d936408 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:43.615128 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9cd5fe55-5120-400d-a7b0-db878f4cd34d req-539bcea2-0d80-4dc0-b531-f14d9d936408 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:43.629186 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-9cd5fe55-5120-400d-a7b0-db878f4cd34d req-539bcea2-0d80-4dc0-b531-f14d9d936408 service nova] Creating event network-changed:bdf20b35-e026-4d53-90e2-af6d1020339c for instance a810e13d-99f4-4c1b-83d6-8f06f9249fae on n-h1-862686-1 Oct 26 13:59:43.634397 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-9cd5fe55-5120-400d-a7b0-db878f4cd34d req-539bcea2-0d80-4dc0-b531-f14d9d936408 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039941 Oct 26 13:59:43.634997 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3583/7142] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:59:44.243010 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6e68aef5-988c-40ef-8ff7-9fca54758f8e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:59:44.243382 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6e68aef5-988c-40ef-8ff7-9fca54758f8e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:59:44.250577 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e68aef5-988c-40ef-8ff7-9fca54758f8e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:44.251061 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e68aef5-988c-40ef-8ff7-9fca54758f8e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:44.251497 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e68aef5-988c-40ef-8ff7-9fca54758f8e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:44.252201 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e68aef5-988c-40ef-8ff7-9fca54758f8e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:44.252658 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e68aef5-988c-40ef-8ff7-9fca54758f8e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:44.253084 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e68aef5-988c-40ef-8ff7-9fca54758f8e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:44.387637 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6e68aef5-988c-40ef-8ff7-9fca54758f8e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:59:44.396042 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6e68aef5-988c-40ef-8ff7-9fca54758f8e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae" status: 200 len: 1364 microversion: 2.1 time: 0.157275 Oct 26 13:59:44.396620 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3560/7143] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:59:44 2022] GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:59:45.420417 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-49b39995-9a00-42f3-af8a-f104e3cfaa25 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:59:45.422460 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-49b39995-9a00-42f3-af8a-f104e3cfaa25 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:59:45.430017 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-49b39995-9a00-42f3-af8a-f104e3cfaa25 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:45.431138 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-49b39995-9a00-42f3-af8a-f104e3cfaa25 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:45.431962 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-49b39995-9a00-42f3-af8a-f104e3cfaa25 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:45.432613 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-49b39995-9a00-42f3-af8a-f104e3cfaa25 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:45.433335 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-49b39995-9a00-42f3-af8a-f104e3cfaa25 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:45.433802 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-49b39995-9a00-42f3-af8a-f104e3cfaa25 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:45.590700 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-49b39995-9a00-42f3-af8a-f104e3cfaa25 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:59:45.599355 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-49b39995-9a00-42f3-af8a-f104e3cfaa25 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae" status: 200 len: 1364 microversion: 2.1 time: 0.183689 Oct 26 13:59:45.600053 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3584/7144] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:59:45 2022] GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:59:46.623071 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-91389600-53f8-48d1-881f-72a32e844106 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:59:46.623685 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-91389600-53f8-48d1-881f-72a32e844106 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:59:46.630618 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91389600-53f8-48d1-881f-72a32e844106 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:46.631107 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91389600-53f8-48d1-881f-72a32e844106 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:46.631549 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91389600-53f8-48d1-881f-72a32e844106 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:46.632242 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91389600-53f8-48d1-881f-72a32e844106 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:46.632702 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91389600-53f8-48d1-881f-72a32e844106 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:46.633133 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91389600-53f8-48d1-881f-72a32e844106 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:46.766719 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-91389600-53f8-48d1-881f-72a32e844106 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:59:46.774436 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-91389600-53f8-48d1-881f-72a32e844106 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae" status: 200 len: 1364 microversion: 2.1 time: 0.155335 Oct 26 13:59:46.775010 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3561/7145] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:59:46 2022] GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:59:47.798547 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-997fb503-e253-470e-a484-6fb57705d5af tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:59:47.799175 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-997fb503-e253-470e-a484-6fb57705d5af tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:59:47.806382 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-997fb503-e253-470e-a484-6fb57705d5af tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:47.806880 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-997fb503-e253-470e-a484-6fb57705d5af tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:47.807330 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-997fb503-e253-470e-a484-6fb57705d5af tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:47.808041 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-997fb503-e253-470e-a484-6fb57705d5af tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:47.808510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-997fb503-e253-470e-a484-6fb57705d5af tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:47.808953 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-997fb503-e253-470e-a484-6fb57705d5af tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:47.945931 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-997fb503-e253-470e-a484-6fb57705d5af tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:59:47.954108 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-997fb503-e253-470e-a484-6fb57705d5af tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae" status: 200 len: 1364 microversion: 2.1 time: 0.160102 Oct 26 13:59:47.954683 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3585/7146] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:59:47 2022] GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:59:48.977108 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bb5224eb-4635-4afc-b2f6-f8ae07c2c47a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:59:48.977778 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bb5224eb-4635-4afc-b2f6-f8ae07c2c47a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:59:48.985007 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb5224eb-4635-4afc-b2f6-f8ae07c2c47a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:48.985529 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb5224eb-4635-4afc-b2f6-f8ae07c2c47a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:48.985974 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb5224eb-4635-4afc-b2f6-f8ae07c2c47a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:48.986670 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb5224eb-4635-4afc-b2f6-f8ae07c2c47a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:48.987129 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb5224eb-4635-4afc-b2f6-f8ae07c2c47a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:48.987558 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb5224eb-4635-4afc-b2f6-f8ae07c2c47a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:49.117354 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bb5224eb-4635-4afc-b2f6-f8ae07c2c47a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:59:49.125053 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bb5224eb-4635-4afc-b2f6-f8ae07c2c47a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae" status: 200 len: 1364 microversion: 2.1 time: 0.151870 Oct 26 13:59:49.125664 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3562/7147] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:59:48 2022] GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:59:49.521418 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-0ae76845-5936-4fbb-a64f-e1fb5f9bd6d2 req-ff4710b9-f074-4cd9-a180-6c79c8204bdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a810e13d-99f4-4c1b-83d6-8f06f9249fae", "name": "network-vif-plugged", "status": "completed", "tag": "bdf20b35-e026-4d53-90e2-af6d1020339c"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:59:49.531767 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-0ae76845-5936-4fbb-a64f-e1fb5f9bd6d2 req-ff4710b9-f074-4cd9-a180-6c79c8204bdf service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:49.532542 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-0ae76845-5936-4fbb-a64f-e1fb5f9bd6d2 req-ff4710b9-f074-4cd9-a180-6c79c8204bdf service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:49.532991 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-0ae76845-5936-4fbb-a64f-e1fb5f9bd6d2 req-ff4710b9-f074-4cd9-a180-6c79c8204bdf service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:49.544643 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-0ae76845-5936-4fbb-a64f-e1fb5f9bd6d2 req-ff4710b9-f074-4cd9-a180-6c79c8204bdf service nova] Creating event network-vif-plugged:bdf20b35-e026-4d53-90e2-af6d1020339c for instance a810e13d-99f4-4c1b-83d6-8f06f9249fae on n-h1-862686-1 Oct 26 13:59:49.550587 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-0ae76845-5936-4fbb-a64f-e1fb5f9bd6d2 req-ff4710b9-f074-4cd9-a180-6c79c8204bdf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032929 Oct 26 13:59:49.551856 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3586/7148] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:59:50.148117 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-335e89dd-fbf3-49d1-b7a2-7babc2af6c01 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:59:50.148729 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-335e89dd-fbf3-49d1-b7a2-7babc2af6c01 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:59:50.155667 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-335e89dd-fbf3-49d1-b7a2-7babc2af6c01 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:50.156155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-335e89dd-fbf3-49d1-b7a2-7babc2af6c01 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:50.157401 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-335e89dd-fbf3-49d1-b7a2-7babc2af6c01 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:50.158034 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-335e89dd-fbf3-49d1-b7a2-7babc2af6c01 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:50.158751 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-335e89dd-fbf3-49d1-b7a2-7babc2af6c01 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:50.159182 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-335e89dd-fbf3-49d1-b7a2-7babc2af6c01 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:50.294536 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-335e89dd-fbf3-49d1-b7a2-7babc2af6c01 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:59:50.302331 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-335e89dd-fbf3-49d1-b7a2-7babc2af6c01 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae" status: 200 len: 1364 microversion: 2.1 time: 0.158205 Oct 26 13:59:50.302917 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3563/7149] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:59:50 2022] GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 13:59:51.323534 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:59:51.324327 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:59:51.328631 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5eb77361-2849-419c-ae21-9cc88eba59fa tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:59:51.329389 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5eb77361-2849-419c-ae21-9cc88eba59fa tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:59:51.336587 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5eb77361-2849-419c-ae21-9cc88eba59fa tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:51.337084 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5eb77361-2849-419c-ae21-9cc88eba59fa tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:51.337572 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5eb77361-2849-419c-ae21-9cc88eba59fa tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:51.338287 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5eb77361-2849-419c-ae21-9cc88eba59fa tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:51.338764 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5eb77361-2849-419c-ae21-9cc88eba59fa tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:51.339210 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5eb77361-2849-419c-ae21-9cc88eba59fa tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:51.474795 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5eb77361-2849-419c-ae21-9cc88eba59fa tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 13:59:51.482580 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5eb77361-2849-419c-ae21-9cc88eba59fa tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae" status: 200 len: 1552 microversion: 2.1 time: 0.160885 Oct 26 13:59:51.483161 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3587/7150] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 13:59:51 2022] GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae => generated 1552 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 13:59:51.506233 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1459813d-8f4a-4357-b78f-b86efaf1721f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 13:59:51.506750 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1459813d-8f4a-4357-b78f-b86efaf1721f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 13:59:51.508627 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 13:59:51.514762 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1459813d-8f4a-4357-b78f-b86efaf1721f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:51.515251 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1459813d-8f4a-4357-b78f-b86efaf1721f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:51.515689 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1459813d-8f4a-4357-b78f-b86efaf1721f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:51.516383 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1459813d-8f4a-4357-b78f-b86efaf1721f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:51.516871 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1459813d-8f4a-4357-b78f-b86efaf1721f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:51.517301 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1459813d-8f4a-4357-b78f-b86efaf1721f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:51.594548 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1459813d-8f4a-4357-b78f-b86efaf1721f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092427 Oct 26 13:59:51.595162 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3564/7151] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 26 13:59:51 2022] GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 13:59:52.590647 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-e7b7ddc6-9555-4cae-abff-1f0e8a1d46a4 req-7ec2ad24-909e-4e9c-b789-adf1d9556ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a810e13d-99f4-4c1b-83d6-8f06f9249fae", "tag": "bdf20b35-e026-4d53-90e2-af6d1020339c"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 13:59:52.601463 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e7b7ddc6-9555-4cae-abff-1f0e8a1d46a4 req-7ec2ad24-909e-4e9c-b789-adf1d9556ed3 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 13:59:52.601976 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e7b7ddc6-9555-4cae-abff-1f0e8a1d46a4 req-7ec2ad24-909e-4e9c-b789-adf1d9556ed3 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 13:59:52.602419 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e7b7ddc6-9555-4cae-abff-1f0e8a1d46a4 req-7ec2ad24-909e-4e9c-b789-adf1d9556ed3 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 13:59:52.614708 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-e7b7ddc6-9555-4cae-abff-1f0e8a1d46a4 req-7ec2ad24-909e-4e9c-b789-adf1d9556ed3 service nova] Creating event network-changed:bdf20b35-e026-4d53-90e2-af6d1020339c for instance a810e13d-99f4-4c1b-83d6-8f06f9249fae on n-h1-862686-1 Oct 26 13:59:52.620060 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-e7b7ddc6-9555-4cae-abff-1f0e8a1d46a4 req-7ec2ad24-909e-4e9c-b789-adf1d9556ed3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104777 Oct 26 13:59:52.620933 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3588/7152] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 13:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:00:28.809210 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:00:28.810050 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=34 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:00:28.814171 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f296d75e-e4ae-43c6-b98a-33e9aa85964d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:00:28.814780 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f296d75e-e4ae-43c6-b98a-33e9aa85964d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:00:28.822292 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f296d75e-e4ae-43c6-b98a-33e9aa85964d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:28.822772 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f296d75e-e4ae-43c6-b98a-33e9aa85964d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:28.823210 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f296d75e-e4ae-43c6-b98a-33e9aa85964d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:28.823903 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f296d75e-e4ae-43c6-b98a-33e9aa85964d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:28.824356 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f296d75e-e4ae-43c6-b98a-33e9aa85964d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:28.824779 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f296d75e-e4ae-43c6-b98a-33e9aa85964d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:28.958494 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f296d75e-e4ae-43c6-b98a-33e9aa85964d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:00:28.966277 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f296d75e-e4ae-43c6-b98a-33e9aa85964d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae" status: 200 len: 1671 microversion: 2.1 time: 0.159151 Oct 26 14:00:28.966848 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3565/7153] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:00:28 2022] GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae => generated 1671 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:00:28.989375 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ac448524-f9dc-4046-8675-582912833be5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:00:28.990143 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ac448524-f9dc-4046-8675-582912833be5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:00:28.993073 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:00:28.993897 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=32 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:00:29.000431 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac448524-f9dc-4046-8675-582912833be5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:29.001178 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac448524-f9dc-4046-8675-582912833be5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:29.001669 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac448524-f9dc-4046-8675-582912833be5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:29.002385 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac448524-f9dc-4046-8675-582912833be5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:29.002857 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac448524-f9dc-4046-8675-582912833be5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:29.003299 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac448524-f9dc-4046-8675-582912833be5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:29.137822 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ac448524-f9dc-4046-8675-582912833be5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:00:29.145586 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ac448524-f9dc-4046-8675-582912833be5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae" status: 200 len: 1671 microversion: 2.1 time: 0.160715 Oct 26 14:00:29.146156 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3589/7154] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:00:28 2022] GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae => generated 1671 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:00:29.169025 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-471c4bf6-da0c-4330-9601-20f38422445b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:00:29.169679 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-471c4bf6-da0c-4330-9601-20f38422445b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:00:29.175592 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-471c4bf6-da0c-4330-9601-20f38422445b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:29.176081 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-471c4bf6-da0c-4330-9601-20f38422445b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:29.176525 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-471c4bf6-da0c-4330-9601-20f38422445b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:29.177216 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-471c4bf6-da0c-4330-9601-20f38422445b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:29.177712 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-471c4bf6-da0c-4330-9601-20f38422445b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:29.178142 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-471c4bf6-da0c-4330-9601-20f38422445b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:29.309577 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-471c4bf6-da0c-4330-9601-20f38422445b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:00:29.317392 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-471c4bf6-da0c-4330-9601-20f38422445b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae" status: 200 len: 1671 microversion: 2.1 time: 0.152284 Oct 26 14:00:29.318002 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3566/7155] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:00:29 2022] GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:00:29.339853 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0bba119c-bb49-4b8d-bfb2-a75b884f7b26 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:00:29.342229 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0bba119c-bb49-4b8d-bfb2-a75b884f7b26 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:00:29.348248 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0bba119c-bb49-4b8d-bfb2-a75b884f7b26 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:29.348743 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0bba119c-bb49-4b8d-bfb2-a75b884f7b26 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:29.349189 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0bba119c-bb49-4b8d-bfb2-a75b884f7b26 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:29.349917 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0bba119c-bb49-4b8d-bfb2-a75b884f7b26 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:29.350382 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0bba119c-bb49-4b8d-bfb2-a75b884f7b26 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:29.350827 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0bba119c-bb49-4b8d-bfb2-a75b884f7b26 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:29.381739 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0bba119c-bb49-4b8d-bfb2-a75b884f7b26 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:00:29.387267 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0bba119c-bb49-4b8d-bfb2-a75b884f7b26 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Old instance type m1.heat2, new instance type m1.heat {{(pid=120598) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 26 14:00:29.393616 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-0bba119c-bb49-4b8d-bfb2-a75b884f7b26 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 14:00:29.394051 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-0bba119c-bb49-4b8d-bfb2-a75b884f7b26 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 14:00:29.394534 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-0bba119c-bb49-4b8d-bfb2-a75b884f7b26 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 14:00:29.394952 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-0bba119c-bb49-4b8d-bfb2-a75b884f7b26 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 14:00:29.395375 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-0bba119c-bb49-4b8d-bfb2-a75b884f7b26 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 14:00:29.458304 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0bba119c-bb49-4b8d-bfb2-a75b884f7b26 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "POST /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae/action" status: 202 len: 0 microversion: 2.1 time: 0.122910 Oct 26 14:00:29.461532 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3590/7156] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 14:00:29 2022] POST /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 14:00:29.467708 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-39dbe429-b268-4b91-b95c-7aca82932f1f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:00:29.468324 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-39dbe429-b268-4b91-b95c-7aca82932f1f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:00:29.474380 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39dbe429-b268-4b91-b95c-7aca82932f1f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:29.474873 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39dbe429-b268-4b91-b95c-7aca82932f1f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:29.475315 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39dbe429-b268-4b91-b95c-7aca82932f1f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:29.476626 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39dbe429-b268-4b91-b95c-7aca82932f1f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:29.477203 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39dbe429-b268-4b91-b95c-7aca82932f1f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:29.477667 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39dbe429-b268-4b91-b95c-7aca82932f1f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:29.618657 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-39dbe429-b268-4b91-b95c-7aca82932f1f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:00:29.626648 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-39dbe429-b268-4b91-b95c-7aca82932f1f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae" status: 200 len: 1680 microversion: 2.1 time: 0.162802 Oct 26 14:00:29.627227 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3567/7157] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:00:29 2022] GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:00:30.651464 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-87548127-0966-4f45-863b-e29899e6d413 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:00:30.652110 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-87548127-0966-4f45-863b-e29899e6d413 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:00:30.659980 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87548127-0966-4f45-863b-e29899e6d413 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:30.660475 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87548127-0966-4f45-863b-e29899e6d413 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:30.660923 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87548127-0966-4f45-863b-e29899e6d413 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:30.661660 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87548127-0966-4f45-863b-e29899e6d413 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:30.662522 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87548127-0966-4f45-863b-e29899e6d413 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:30.663046 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87548127-0966-4f45-863b-e29899e6d413 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:30.874718 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-87548127-0966-4f45-863b-e29899e6d413 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:00:30.883322 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-87548127-0966-4f45-863b-e29899e6d413 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae" status: 200 len: 1680 microversion: 2.1 time: 0.236771 Oct 26 14:00:30.883934 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3591/7158] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:00:30 2022] GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae => generated 1680 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:00:31.906623 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fb23c256-36a6-432c-9b5e-1e7e7153e376 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:00:31.907258 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fb23c256-36a6-432c-9b5e-1e7e7153e376 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:00:31.915279 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fb23c256-36a6-432c-9b5e-1e7e7153e376 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:31.916375 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fb23c256-36a6-432c-9b5e-1e7e7153e376 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:31.916375 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fb23c256-36a6-432c-9b5e-1e7e7153e376 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:31.916849 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fb23c256-36a6-432c-9b5e-1e7e7153e376 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:31.917302 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fb23c256-36a6-432c-9b5e-1e7e7153e376 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:31.917757 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fb23c256-36a6-432c-9b5e-1e7e7153e376 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:32.047610 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fb23c256-36a6-432c-9b5e-1e7e7153e376 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:00:32.055970 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fb23c256-36a6-432c-9b5e-1e7e7153e376 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae" status: 200 len: 1685 microversion: 2.1 time: 0.153284 Oct 26 14:00:32.056546 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3568/7159] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:00:31 2022] GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae => generated 1685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:00:33.079701 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f542d9ee-1bf1-4480-909a-91f9d0e18fd9 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:00:33.080366 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f542d9ee-1bf1-4480-909a-91f9d0e18fd9 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:00:33.087317 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f542d9ee-1bf1-4480-909a-91f9d0e18fd9 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:33.087812 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f542d9ee-1bf1-4480-909a-91f9d0e18fd9 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:33.088266 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f542d9ee-1bf1-4480-909a-91f9d0e18fd9 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:33.088978 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f542d9ee-1bf1-4480-909a-91f9d0e18fd9 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:33.089451 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f542d9ee-1bf1-4480-909a-91f9d0e18fd9 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:33.089942 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f542d9ee-1bf1-4480-909a-91f9d0e18fd9 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:33.220058 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f542d9ee-1bf1-4480-909a-91f9d0e18fd9 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:00:33.228501 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f542d9ee-1bf1-4480-909a-91f9d0e18fd9 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae" status: 200 len: 1685 microversion: 2.1 time: 0.152704 Oct 26 14:00:33.229072 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3592/7160] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:00:33 2022] GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae => generated 1685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:00:34.251801 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-87c6f69f-57d1-42d3-a8d8-e9ea8befd7ef tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:00:34.252419 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-87c6f69f-57d1-42d3-a8d8-e9ea8befd7ef tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:00:34.259819 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-87c6f69f-57d1-42d3-a8d8-e9ea8befd7ef tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:34.260325 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-87c6f69f-57d1-42d3-a8d8-e9ea8befd7ef tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:34.260902 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-87c6f69f-57d1-42d3-a8d8-e9ea8befd7ef tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:34.261778 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-87c6f69f-57d1-42d3-a8d8-e9ea8befd7ef tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:34.262883 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-87c6f69f-57d1-42d3-a8d8-e9ea8befd7ef tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:34.262883 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-87c6f69f-57d1-42d3-a8d8-e9ea8befd7ef tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:34.396880 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-87c6f69f-57d1-42d3-a8d8-e9ea8befd7ef tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:00:34.404702 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-87c6f69f-57d1-42d3-a8d8-e9ea8befd7ef tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae" status: 200 len: 1685 microversion: 2.1 time: 0.156850 Oct 26 14:00:34.405283 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3569/7161] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:00:34 2022] GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae => generated 1685 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:00:35.428322 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-796ec8c9-28ac-4ddc-969e-f5dc09bc7a00 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:00:35.429103 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-796ec8c9-28ac-4ddc-969e-f5dc09bc7a00 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:00:35.436072 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-796ec8c9-28ac-4ddc-969e-f5dc09bc7a00 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:35.436572 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-796ec8c9-28ac-4ddc-969e-f5dc09bc7a00 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:35.437030 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-796ec8c9-28ac-4ddc-969e-f5dc09bc7a00 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:35.437762 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-796ec8c9-28ac-4ddc-969e-f5dc09bc7a00 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:35.438239 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-796ec8c9-28ac-4ddc-969e-f5dc09bc7a00 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:35.438684 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-796ec8c9-28ac-4ddc-969e-f5dc09bc7a00 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:35.572829 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-796ec8c9-28ac-4ddc-969e-f5dc09bc7a00 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:00:35.580605 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-796ec8c9-28ac-4ddc-969e-f5dc09bc7a00 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae" status: 200 len: 1685 microversion: 2.1 time: 0.156290 Oct 26 14:00:35.581188 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3593/7162] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:00:35 2022] GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae => generated 1685 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:00:36.604381 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1944814a-b3a2-40c3-a14a-23b8a031060b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:00:36.605004 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1944814a-b3a2-40c3-a14a-23b8a031060b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:00:36.611902 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1944814a-b3a2-40c3-a14a-23b8a031060b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:36.612388 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1944814a-b3a2-40c3-a14a-23b8a031060b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:36.612825 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1944814a-b3a2-40c3-a14a-23b8a031060b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:36.613534 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1944814a-b3a2-40c3-a14a-23b8a031060b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:36.613994 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1944814a-b3a2-40c3-a14a-23b8a031060b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:36.614424 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1944814a-b3a2-40c3-a14a-23b8a031060b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:36.798998 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1944814a-b3a2-40c3-a14a-23b8a031060b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:00:36.807455 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1944814a-b3a2-40c3-a14a-23b8a031060b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae" status: 200 len: 1685 microversion: 2.1 time: 0.207065 Oct 26 14:00:36.808055 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3570/7163] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:00:36 2022] GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae => generated 1685 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:00:37.831376 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-22b2d533-75ed-44c5-99c4-3a4d22326eef tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:00:37.832003 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-22b2d533-75ed-44c5-99c4-3a4d22326eef tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:00:37.839492 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22b2d533-75ed-44c5-99c4-3a4d22326eef tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:37.839987 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22b2d533-75ed-44c5-99c4-3a4d22326eef tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:37.840438 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22b2d533-75ed-44c5-99c4-3a4d22326eef tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:37.841140 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22b2d533-75ed-44c5-99c4-3a4d22326eef tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:37.841659 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22b2d533-75ed-44c5-99c4-3a4d22326eef tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:37.842146 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22b2d533-75ed-44c5-99c4-3a4d22326eef tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:38.013524 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-22b2d533-75ed-44c5-99c4-3a4d22326eef tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:00:38.021224 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-22b2d533-75ed-44c5-99c4-3a4d22326eef tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae" status: 200 len: 1685 microversion: 2.1 time: 0.193754 Oct 26 14:00:38.021826 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3594/7164] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:00:37 2022] GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae => generated 1685 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:00:39.044693 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b3dc6f38-fd28-40ea-804b-7640648eae45 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:00:39.045304 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b3dc6f38-fd28-40ea-804b-7640648eae45 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:00:39.052230 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b3dc6f38-fd28-40ea-804b-7640648eae45 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:39.052711 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b3dc6f38-fd28-40ea-804b-7640648eae45 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:39.053150 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b3dc6f38-fd28-40ea-804b-7640648eae45 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:39.054369 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b3dc6f38-fd28-40ea-804b-7640648eae45 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:39.054983 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b3dc6f38-fd28-40ea-804b-7640648eae45 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:39.055413 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b3dc6f38-fd28-40ea-804b-7640648eae45 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:39.188428 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b3dc6f38-fd28-40ea-804b-7640648eae45 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:00:39.197306 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b3dc6f38-fd28-40ea-804b-7640648eae45 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae" status: 200 len: 1685 microversion: 2.1 time: 0.156526 Oct 26 14:00:39.197920 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3571/7165] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:00:39 2022] GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae => generated 1685 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:00:40.220269 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-478b0957-1f83-46a5-b387-7d8aba893f3c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:00:40.220897 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-478b0957-1f83-46a5-b387-7d8aba893f3c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:00:40.228926 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-478b0957-1f83-46a5-b387-7d8aba893f3c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:40.229417 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-478b0957-1f83-46a5-b387-7d8aba893f3c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:40.229895 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-478b0957-1f83-46a5-b387-7d8aba893f3c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:40.230596 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-478b0957-1f83-46a5-b387-7d8aba893f3c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:40.231063 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-478b0957-1f83-46a5-b387-7d8aba893f3c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:40.231500 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-478b0957-1f83-46a5-b387-7d8aba893f3c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:40.366431 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-478b0957-1f83-46a5-b387-7d8aba893f3c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:00:40.374146 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-478b0957-1f83-46a5-b387-7d8aba893f3c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae" status: 200 len: 1685 microversion: 2.1 time: 0.157906 Oct 26 14:00:40.374723 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3595/7166] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:00:40 2022] GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:00:41.398399 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b1763a55-3534-49d5-92df-44e71c6c1ded tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:00:41.399053 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b1763a55-3534-49d5-92df-44e71c6c1ded tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:00:41.405795 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b1763a55-3534-49d5-92df-44e71c6c1ded tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:41.406284 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b1763a55-3534-49d5-92df-44e71c6c1ded tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:41.406727 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b1763a55-3534-49d5-92df-44e71c6c1ded tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:41.407420 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b1763a55-3534-49d5-92df-44e71c6c1ded tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:41.407914 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b1763a55-3534-49d5-92df-44e71c6c1ded tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:41.408345 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b1763a55-3534-49d5-92df-44e71c6c1ded tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:41.538505 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b1763a55-3534-49d5-92df-44e71c6c1ded tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:00:41.546211 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b1763a55-3534-49d5-92df-44e71c6c1ded tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae" status: 200 len: 1685 microversion: 2.1 time: 0.152345 Oct 26 14:00:41.546784 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3572/7167] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:00:41 2022] GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae => generated 1685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:00:42.570004 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ca989a5d-7f43-4f0c-af15-228efc98ab0d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:00:42.570666 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ca989a5d-7f43-4f0c-af15-228efc98ab0d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:00:42.577470 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca989a5d-7f43-4f0c-af15-228efc98ab0d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:42.577996 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca989a5d-7f43-4f0c-af15-228efc98ab0d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:42.578453 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca989a5d-7f43-4f0c-af15-228efc98ab0d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:42.579164 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca989a5d-7f43-4f0c-af15-228efc98ab0d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:42.579641 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca989a5d-7f43-4f0c-af15-228efc98ab0d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:42.580086 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ca989a5d-7f43-4f0c-af15-228efc98ab0d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:42.712890 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ca989a5d-7f43-4f0c-af15-228efc98ab0d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:00:42.720720 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ca989a5d-7f43-4f0c-af15-228efc98ab0d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae" status: 200 len: 1685 microversion: 2.1 time: 0.155283 Oct 26 14:00:42.721287 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3596/7168] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:00:42 2022] GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:00:43.746127 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2fc4e1c6-9365-4dab-aad9-242a79a20cee tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:00:43.747010 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2fc4e1c6-9365-4dab-aad9-242a79a20cee tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:00:43.754204 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2fc4e1c6-9365-4dab-aad9-242a79a20cee tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:43.754687 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2fc4e1c6-9365-4dab-aad9-242a79a20cee tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:43.755134 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2fc4e1c6-9365-4dab-aad9-242a79a20cee tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:43.755833 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2fc4e1c6-9365-4dab-aad9-242a79a20cee tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:43.756295 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2fc4e1c6-9365-4dab-aad9-242a79a20cee tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:43.756791 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2fc4e1c6-9365-4dab-aad9-242a79a20cee tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:43.887814 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2fc4e1c6-9365-4dab-aad9-242a79a20cee tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:00:43.895481 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2fc4e1c6-9365-4dab-aad9-242a79a20cee tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae" status: 200 len: 1685 microversion: 2.1 time: 0.154872 Oct 26 14:00:43.896057 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3573/7169] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:00:43 2022] GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:00:44.920233 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-358b4951-ef6e-4ef7-9cb4-d268dc1d3449 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:00:44.920905 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-358b4951-ef6e-4ef7-9cb4-d268dc1d3449 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:00:44.927910 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-358b4951-ef6e-4ef7-9cb4-d268dc1d3449 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:44.928402 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-358b4951-ef6e-4ef7-9cb4-d268dc1d3449 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:44.929377 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-358b4951-ef6e-4ef7-9cb4-d268dc1d3449 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:44.930117 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-358b4951-ef6e-4ef7-9cb4-d268dc1d3449 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:44.930585 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-358b4951-ef6e-4ef7-9cb4-d268dc1d3449 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:44.931029 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-358b4951-ef6e-4ef7-9cb4-d268dc1d3449 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:45.150459 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-358b4951-ef6e-4ef7-9cb4-d268dc1d3449 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:00:45.158327 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-358b4951-ef6e-4ef7-9cb4-d268dc1d3449 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae" status: 200 len: 1685 microversion: 2.1 time: 0.242028 Oct 26 14:00:45.159161 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3597/7170] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:00:44 2022] GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae => generated 1685 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:00:46.184478 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e635e982-e2a5-4f0c-b0fc-39150d060657 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:00:46.185089 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e635e982-e2a5-4f0c-b0fc-39150d060657 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:00:46.191528 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e635e982-e2a5-4f0c-b0fc-39150d060657 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:46.192006 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e635e982-e2a5-4f0c-b0fc-39150d060657 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:46.192438 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e635e982-e2a5-4f0c-b0fc-39150d060657 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:46.193114 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e635e982-e2a5-4f0c-b0fc-39150d060657 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:46.193602 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e635e982-e2a5-4f0c-b0fc-39150d060657 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:46.194080 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e635e982-e2a5-4f0c-b0fc-39150d060657 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:46.410510 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e635e982-e2a5-4f0c-b0fc-39150d060657 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:00:46.419179 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e635e982-e2a5-4f0c-b0fc-39150d060657 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae" status: 200 len: 1685 microversion: 2.1 time: 0.238866 Oct 26 14:00:46.419691 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3574/7171] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:00:46 2022] GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae => generated 1685 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:00:47.442732 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4357367a-956e-41dc-ac19-135ce95fc13c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:00:47.443362 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4357367a-956e-41dc-ac19-135ce95fc13c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:00:47.450429 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4357367a-956e-41dc-ac19-135ce95fc13c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:47.450933 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4357367a-956e-41dc-ac19-135ce95fc13c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:47.451384 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4357367a-956e-41dc-ac19-135ce95fc13c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:47.452098 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4357367a-956e-41dc-ac19-135ce95fc13c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:47.452573 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4357367a-956e-41dc-ac19-135ce95fc13c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:47.453015 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4357367a-956e-41dc-ac19-135ce95fc13c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:47.581990 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4357367a-956e-41dc-ac19-135ce95fc13c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:00:47.590457 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4357367a-956e-41dc-ac19-135ce95fc13c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae" status: 200 len: 1685 microversion: 2.1 time: 0.151719 Oct 26 14:00:47.591031 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3598/7172] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:00:47 2022] GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae => generated 1685 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:00:48.614036 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-401c4d35-73ac-4a86-9f17-c421b51222d2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:00:48.614762 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-401c4d35-73ac-4a86-9f17-c421b51222d2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:00:48.622378 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-401c4d35-73ac-4a86-9f17-c421b51222d2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:48.622939 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-401c4d35-73ac-4a86-9f17-c421b51222d2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:48.623383 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-401c4d35-73ac-4a86-9f17-c421b51222d2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:48.624075 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-401c4d35-73ac-4a86-9f17-c421b51222d2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:48.624526 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-401c4d35-73ac-4a86-9f17-c421b51222d2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:48.624953 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-401c4d35-73ac-4a86-9f17-c421b51222d2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:48.758071 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-401c4d35-73ac-4a86-9f17-c421b51222d2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:00:48.766288 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-401c4d35-73ac-4a86-9f17-c421b51222d2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae" status: 200 len: 1684 microversion: 2.1 time: 0.156852 Oct 26 14:00:48.766879 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3575/7173] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:00:48 2022] GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:00:48.931608 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-f4c045e3-6d09-472a-945a-665286f88185 req-dfbc87ff-4dff-44d5-976a-1d6ec1205b9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a810e13d-99f4-4c1b-83d6-8f06f9249fae", "name": "network-vif-unplugged", "status": "completed", "tag": "bdf20b35-e026-4d53-90e2-af6d1020339c"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:00:48.945194 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f4c045e3-6d09-472a-945a-665286f88185 req-dfbc87ff-4dff-44d5-976a-1d6ec1205b9a service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:48.945736 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f4c045e3-6d09-472a-945a-665286f88185 req-dfbc87ff-4dff-44d5-976a-1d6ec1205b9a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:48.946189 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f4c045e3-6d09-472a-945a-665286f88185 req-dfbc87ff-4dff-44d5-976a-1d6ec1205b9a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:48.957386 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-f4c045e3-6d09-472a-945a-665286f88185 req-dfbc87ff-4dff-44d5-976a-1d6ec1205b9a service nova] Creating event network-vif-unplugged:bdf20b35-e026-4d53-90e2-af6d1020339c for instance a810e13d-99f4-4c1b-83d6-8f06f9249fae on n-h2-862686-1 Oct 26 14:00:48.963085 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [req-f4c045e3-6d09-472a-945a-665286f88185 req-dfbc87ff-4dff-44d5-976a-1d6ec1205b9a service nova] Instance a810e13d-99f4-4c1b-83d6-8f06f9249fae is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862686-1', 'n-h1-862686-1'} {{(pid=120598) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 14:00:48.974209 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-f4c045e3-6d09-472a-945a-665286f88185 req-dfbc87ff-4dff-44d5-976a-1d6ec1205b9a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047498 Oct 26 14:00:48.974828 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3599/7174] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:00:49.790119 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d7873613-30d5-44e0-857b-2376839351d4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:00:49.790735 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d7873613-30d5-44e0-857b-2376839351d4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:00:49.798787 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7873613-30d5-44e0-857b-2376839351d4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:49.799280 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7873613-30d5-44e0-857b-2376839351d4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:49.799719 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7873613-30d5-44e0-857b-2376839351d4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:49.800427 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7873613-30d5-44e0-857b-2376839351d4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:49.800885 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7873613-30d5-44e0-857b-2376839351d4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:49.801311 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d7873613-30d5-44e0-857b-2376839351d4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:49.946726 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d7873613-30d5-44e0-857b-2376839351d4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:00:49.954855 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d7873613-30d5-44e0-857b-2376839351d4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae" status: 200 len: 1684 microversion: 2.1 time: 0.168569 Oct 26 14:00:49.955360 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3576/7175] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:00:49 2022] GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:00:50.980237 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fa5daf6e-67e8-472e-9f10-392d7a4bca18 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:00:50.980977 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fa5daf6e-67e8-472e-9f10-392d7a4bca18 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:00:50.987206 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa5daf6e-67e8-472e-9f10-392d7a4bca18 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:50.987703 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa5daf6e-67e8-472e-9f10-392d7a4bca18 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:50.988156 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa5daf6e-67e8-472e-9f10-392d7a4bca18 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:50.988866 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa5daf6e-67e8-472e-9f10-392d7a4bca18 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:50.989340 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa5daf6e-67e8-472e-9f10-392d7a4bca18 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:50.989813 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fa5daf6e-67e8-472e-9f10-392d7a4bca18 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:51.008290 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-10975229-24eb-483f-8593-cd1d3a994d2b req-ce51f335-50e6-4bc2-b004-1c83ade389e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a810e13d-99f4-4c1b-83d6-8f06f9249fae", "tag": "bdf20b35-e026-4d53-90e2-af6d1020339c"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:00:51.018577 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-10975229-24eb-483f-8593-cd1d3a994d2b req-ce51f335-50e6-4bc2-b004-1c83ade389e4 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:51.019050 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-10975229-24eb-483f-8593-cd1d3a994d2b req-ce51f335-50e6-4bc2-b004-1c83ade389e4 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:51.019481 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-10975229-24eb-483f-8593-cd1d3a994d2b req-ce51f335-50e6-4bc2-b004-1c83ade389e4 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:51.031123 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-10975229-24eb-483f-8593-cd1d3a994d2b req-ce51f335-50e6-4bc2-b004-1c83ade389e4 service nova] Creating event network-changed:bdf20b35-e026-4d53-90e2-af6d1020339c for instance a810e13d-99f4-4c1b-83d6-8f06f9249fae on n-h2-862686-1 Oct 26 14:00:51.036888 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [req-10975229-24eb-483f-8593-cd1d3a994d2b req-ce51f335-50e6-4bc2-b004-1c83ade389e4 service nova] Instance a810e13d-99f4-4c1b-83d6-8f06f9249fae is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862686-1', 'n-h1-862686-1'} {{(pid=120597) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 14:00:51.048241 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-10975229-24eb-483f-8593-cd1d3a994d2b req-ce51f335-50e6-4bc2-b004-1c83ade389e4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044345 Oct 26 14:00:51.048851 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3577/7176] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 14:00:51.176680 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fa5daf6e-67e8-472e-9f10-392d7a4bca18 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:00:51.185128 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fa5daf6e-67e8-472e-9f10-392d7a4bca18 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae" status: 200 len: 1682 microversion: 2.1 time: 0.210460 Oct 26 14:00:51.185939 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3600/7177] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:00:50 2022] GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae => generated 1682 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:00:52.210118 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fa5a63e1-59bc-4408-b2c6-0c0164c25635 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:00:52.211515 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fa5a63e1-59bc-4408-b2c6-0c0164c25635 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:00:52.218884 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa5a63e1-59bc-4408-b2c6-0c0164c25635 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:52.219370 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa5a63e1-59bc-4408-b2c6-0c0164c25635 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:52.219807 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa5a63e1-59bc-4408-b2c6-0c0164c25635 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:52.220519 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa5a63e1-59bc-4408-b2c6-0c0164c25635 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:52.220959 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa5a63e1-59bc-4408-b2c6-0c0164c25635 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:52.221380 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa5a63e1-59bc-4408-b2c6-0c0164c25635 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:52.359493 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fa5a63e1-59bc-4408-b2c6-0c0164c25635 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:00:52.369624 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fa5a63e1-59bc-4408-b2c6-0c0164c25635 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae" status: 200 len: 1679 microversion: 2.1 time: 0.163732 Oct 26 14:00:52.370216 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3578/7178] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:00:52 2022] GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:00:52.393467 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2df0daa2-ff87-415f-8730-508c60af87f2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:00:52.394050 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2df0daa2-ff87-415f-8730-508c60af87f2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:00:52.401943 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2df0daa2-ff87-415f-8730-508c60af87f2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:52.402509 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2df0daa2-ff87-415f-8730-508c60af87f2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:52.403058 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2df0daa2-ff87-415f-8730-508c60af87f2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:52.403809 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2df0daa2-ff87-415f-8730-508c60af87f2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:52.404299 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2df0daa2-ff87-415f-8730-508c60af87f2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:52.404790 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2df0daa2-ff87-415f-8730-508c60af87f2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:52.465785 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2df0daa2-ff87-415f-8730-508c60af87f2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "POST /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae/action" status: 204 len: 0 microversion: 2.1 time: 0.075898 Oct 26 14:00:52.466422 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3601/7179] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 14:00:52 2022] POST /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 26 14:00:52.474437 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-49fe781a-03a0-4a97-812b-0d04e438bd7c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:00:52.475044 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-49fe781a-03a0-4a97-812b-0d04e438bd7c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:00:52.482029 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49fe781a-03a0-4a97-812b-0d04e438bd7c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:52.482789 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49fe781a-03a0-4a97-812b-0d04e438bd7c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:52.483363 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49fe781a-03a0-4a97-812b-0d04e438bd7c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:52.484216 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49fe781a-03a0-4a97-812b-0d04e438bd7c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:52.484847 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49fe781a-03a0-4a97-812b-0d04e438bd7c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:52.485327 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49fe781a-03a0-4a97-812b-0d04e438bd7c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:52.630649 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-49fe781a-03a0-4a97-812b-0d04e438bd7c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:00:52.638968 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-49fe781a-03a0-4a97-812b-0d04e438bd7c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae" status: 200 len: 1679 microversion: 2.1 time: 0.168383 Oct 26 14:00:52.639577 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3579/7180] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:00:52 2022] GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:00:53.663889 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-be7ca303-dd95-4547-b7eb-9feb4706a302 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:00:53.664513 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-be7ca303-dd95-4547-b7eb-9feb4706a302 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:00:53.671667 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be7ca303-dd95-4547-b7eb-9feb4706a302 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:53.672166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be7ca303-dd95-4547-b7eb-9feb4706a302 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:53.672626 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be7ca303-dd95-4547-b7eb-9feb4706a302 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:53.673335 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be7ca303-dd95-4547-b7eb-9feb4706a302 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:53.673833 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be7ca303-dd95-4547-b7eb-9feb4706a302 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:53.674276 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be7ca303-dd95-4547-b7eb-9feb4706a302 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:53.820076 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-be7ca303-dd95-4547-b7eb-9feb4706a302 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:00:53.828050 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-be7ca303-dd95-4547-b7eb-9feb4706a302 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae" status: 200 len: 1679 microversion: 2.1 time: 0.169368 Oct 26 14:00:53.828649 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3602/7181] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:00:53 2022] GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:00:54.172074 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-22340556-8c8c-46e8-b6cb-a79ce3044101 req-2f72190d-d50e-4a66-a633-f00a248b4a12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a810e13d-99f4-4c1b-83d6-8f06f9249fae", "name": "network-vif-plugged", "status": "completed", "tag": "bdf20b35-e026-4d53-90e2-af6d1020339c"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:00:54.182962 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-22340556-8c8c-46e8-b6cb-a79ce3044101 req-2f72190d-d50e-4a66-a633-f00a248b4a12 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:54.183484 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-22340556-8c8c-46e8-b6cb-a79ce3044101 req-2f72190d-d50e-4a66-a633-f00a248b4a12 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:54.183920 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-22340556-8c8c-46e8-b6cb-a79ce3044101 req-2f72190d-d50e-4a66-a633-f00a248b4a12 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:54.196107 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-22340556-8c8c-46e8-b6cb-a79ce3044101 req-2f72190d-d50e-4a66-a633-f00a248b4a12 service nova] Creating event network-vif-plugged:bdf20b35-e026-4d53-90e2-af6d1020339c for instance a810e13d-99f4-4c1b-83d6-8f06f9249fae on n-h2-862686-1 Oct 26 14:00:54.200959 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-22340556-8c8c-46e8-b6cb-a79ce3044101 req-2f72190d-d50e-4a66-a633-f00a248b4a12 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032580 Oct 26 14:00:54.201587 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3580/7182] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:00:54.852538 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-062af66c-4611-436f-af3b-4703960c4165 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:00:54.853162 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-062af66c-4611-436f-af3b-4703960c4165 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:00:54.860070 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-062af66c-4611-436f-af3b-4703960c4165 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:54.860568 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-062af66c-4611-436f-af3b-4703960c4165 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:54.861019 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-062af66c-4611-436f-af3b-4703960c4165 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:54.861762 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-062af66c-4611-436f-af3b-4703960c4165 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:54.862229 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-062af66c-4611-436f-af3b-4703960c4165 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:54.862669 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-062af66c-4611-436f-af3b-4703960c4165 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:54.877828 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:00:54.998537 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-062af66c-4611-436f-af3b-4703960c4165 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:00:55.006315 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-062af66c-4611-436f-af3b-4703960c4165 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae" status: 200 len: 1671 microversion: 2.1 time: 0.158284 Oct 26 14:00:55.007383 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3603/7183] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:00:54 2022] GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae => generated 1671 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:00:55.030430 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e8fb67ac-c36f-40f8-be08-26c5ca2407ac tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:00:55.031125 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e8fb67ac-c36f-40f8-be08-26c5ca2407ac tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:00:55.037389 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e8fb67ac-c36f-40f8-be08-26c5ca2407ac tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:55.038365 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e8fb67ac-c36f-40f8-be08-26c5ca2407ac tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:55.038809 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e8fb67ac-c36f-40f8-be08-26c5ca2407ac tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:55.039495 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e8fb67ac-c36f-40f8-be08-26c5ca2407ac tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:55.039949 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e8fb67ac-c36f-40f8-be08-26c5ca2407ac tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:55.040376 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e8fb67ac-c36f-40f8-be08-26c5ca2407ac tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:55.167956 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e8fb67ac-c36f-40f8-be08-26c5ca2407ac tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:00:55.175845 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e8fb67ac-c36f-40f8-be08-26c5ca2407ac tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae" status: 200 len: 1671 microversion: 2.1 time: 0.149577 Oct 26 14:00:55.176408 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3581/7184] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:00:55 2022] GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae => generated 1671 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:00:55.198677 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-df0f545e-a53a-4c11-9f3d-0e977d0ac869 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:00:55.199311 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-df0f545e-a53a-4c11-9f3d-0e977d0ac869 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:00:55.205241 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df0f545e-a53a-4c11-9f3d-0e977d0ac869 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:55.205781 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df0f545e-a53a-4c11-9f3d-0e977d0ac869 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:55.206246 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df0f545e-a53a-4c11-9f3d-0e977d0ac869 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:55.206962 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df0f545e-a53a-4c11-9f3d-0e977d0ac869 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:55.207441 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df0f545e-a53a-4c11-9f3d-0e977d0ac869 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:55.207888 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df0f545e-a53a-4c11-9f3d-0e977d0ac869 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:55.336482 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-df0f545e-a53a-4c11-9f3d-0e977d0ac869 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:00:55.344372 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-df0f545e-a53a-4c11-9f3d-0e977d0ac869 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae" status: 200 len: 1671 microversion: 2.1 time: 0.150356 Oct 26 14:00:55.344965 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3604/7185] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:00:55 2022] GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae => generated 1671 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:00:55.368518 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5e6d5bce-d0dc-4975-bf99-0a3bece566d3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:00:55.368959 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5e6d5bce-d0dc-4975-bf99-0a3bece566d3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:00:55.375853 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5e6d5bce-d0dc-4975-bf99-0a3bece566d3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:55.376346 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5e6d5bce-d0dc-4975-bf99-0a3bece566d3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:55.376786 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5e6d5bce-d0dc-4975-bf99-0a3bece566d3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:55.377499 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5e6d5bce-d0dc-4975-bf99-0a3bece566d3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:55.377961 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5e6d5bce-d0dc-4975-bf99-0a3bece566d3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:55.378389 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5e6d5bce-d0dc-4975-bf99-0a3bece566d3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:55.396852 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:00:55.404921 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5e6d5bce-d0dc-4975-bf99-0a3bece566d3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 14:00:55.479023 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5e6d5bce-d0dc-4975-bf99-0a3bece566d3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae" status: 204 len: 0 microversion: 2.1 time: 0.114943 Oct 26 14:00:55.479656 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3582/7186] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 14:00:55 2022] DELETE /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 14:00:55.488945 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-217d2d15-1cc4-4639-8356-f4f6b55dc688 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:00:55.489621 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-217d2d15-1cc4-4639-8356-f4f6b55dc688 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:00:55.496661 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-217d2d15-1cc4-4639-8356-f4f6b55dc688 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:55.497158 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-217d2d15-1cc4-4639-8356-f4f6b55dc688 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:55.497691 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-217d2d15-1cc4-4639-8356-f4f6b55dc688 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:55.498395 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-217d2d15-1cc4-4639-8356-f4f6b55dc688 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:55.498863 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-217d2d15-1cc4-4639-8356-f4f6b55dc688 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:55.499304 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-217d2d15-1cc4-4639-8356-f4f6b55dc688 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:55.628651 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-217d2d15-1cc4-4639-8356-f4f6b55dc688 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:00:55.637196 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-217d2d15-1cc4-4639-8356-f4f6b55dc688 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae" status: 200 len: 1677 microversion: 2.1 time: 0.152853 Oct 26 14:00:55.637797 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3605/7187] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:00:55 2022] GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 14:00:56.661640 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e30a4033-8f9e-40fc-a6fa-31902d6f3453 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:00:56.662362 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e30a4033-8f9e-40fc-a6fa-31902d6f3453 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:00:56.671072 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e30a4033-8f9e-40fc-a6fa-31902d6f3453 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:56.671559 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e30a4033-8f9e-40fc-a6fa-31902d6f3453 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:56.671996 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e30a4033-8f9e-40fc-a6fa-31902d6f3453 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:56.673022 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e30a4033-8f9e-40fc-a6fa-31902d6f3453 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:56.673560 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e30a4033-8f9e-40fc-a6fa-31902d6f3453 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:56.673941 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e30a4033-8f9e-40fc-a6fa-31902d6f3453 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:56.809126 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e30a4033-8f9e-40fc-a6fa-31902d6f3453 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:00:56.817003 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e30a4033-8f9e-40fc-a6fa-31902d6f3453 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae" status: 200 len: 1677 microversion: 2.1 time: 0.160034 Oct 26 14:00:56.817609 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3583/7188] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:00:56 2022] GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:00:57.762418 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-6842e504-f2bf-4072-b48a-444428bf1bb4 req-c63bcd76-3a3f-4414-a1d3-496b676f3f56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a810e13d-99f4-4c1b-83d6-8f06f9249fae", "name": "network-vif-deleted", "tag": "bdf20b35-e026-4d53-90e2-af6d1020339c"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:00:57.774224 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-6842e504-f2bf-4072-b48a-444428bf1bb4 req-c63bcd76-3a3f-4414-a1d3-496b676f3f56 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:57.774834 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-6842e504-f2bf-4072-b48a-444428bf1bb4 req-c63bcd76-3a3f-4414-a1d3-496b676f3f56 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:57.775353 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-6842e504-f2bf-4072-b48a-444428bf1bb4 req-c63bcd76-3a3f-4414-a1d3-496b676f3f56 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:57.787825 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-6842e504-f2bf-4072-b48a-444428bf1bb4 req-c63bcd76-3a3f-4414-a1d3-496b676f3f56 service nova] Creating event network-vif-deleted:bdf20b35-e026-4d53-90e2-af6d1020339c for instance a810e13d-99f4-4c1b-83d6-8f06f9249fae on n-h2-862686-1 Oct 26 14:00:57.793628 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-6842e504-f2bf-4072-b48a-444428bf1bb4 req-c63bcd76-3a3f-4414-a1d3-496b676f3f56 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035061 Oct 26 14:00:57.794505 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3606/7189] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:00:57.841849 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-07f3c739-3e86-4dfa-85e2-2a187c5562e1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:00:57.842577 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-07f3c739-3e86-4dfa-85e2-2a187c5562e1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:00:57.849848 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-07f3c739-3e86-4dfa-85e2-2a187c5562e1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:57.850606 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-07f3c739-3e86-4dfa-85e2-2a187c5562e1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:57.851128 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-07f3c739-3e86-4dfa-85e2-2a187c5562e1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:57.852060 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-07f3c739-3e86-4dfa-85e2-2a187c5562e1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:57.852748 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-07f3c739-3e86-4dfa-85e2-2a187c5562e1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:57.853203 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-07f3c739-3e86-4dfa-85e2-2a187c5562e1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:57.897820 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-07f3c739-3e86-4dfa-85e2-2a187c5562e1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:57.898383 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-07f3c739-3e86-4dfa-85e2-2a187c5562e1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:57.898827 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-07f3c739-3e86-4dfa-85e2-2a187c5562e1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:57.899279 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-07f3c739-3e86-4dfa-85e2-2a187c5562e1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lazy-loading 'fault' on Instance uuid a810e13d-99f4-4c1b-83d6-8f06f9249fae {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 14:00:57.949510 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-07f3c739-3e86-4dfa-85e2-2a187c5562e1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:00:57.960579 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-07f3c739-3e86-4dfa-85e2-2a187c5562e1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae" status: 200 len: 1328 microversion: 2.1 time: 0.123714 Oct 26 14:00:57.961467 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3584/7190] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:00:57 2022] GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae => generated 1328 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:00:58.985795 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3fb20c67-69e7-4666-b1a1-c009b0d95fed tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:00:58.986515 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3fb20c67-69e7-4666-b1a1-c009b0d95fed tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:00:58.993567 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3fb20c67-69e7-4666-b1a1-c009b0d95fed tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:58.994074 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3fb20c67-69e7-4666-b1a1-c009b0d95fed tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:58.994526 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3fb20c67-69e7-4666-b1a1-c009b0d95fed tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:58.995236 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3fb20c67-69e7-4666-b1a1-c009b0d95fed tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:58.995709 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3fb20c67-69e7-4666-b1a1-c009b0d95fed tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:58.996153 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3fb20c67-69e7-4666-b1a1-c009b0d95fed tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:59.009574 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-3fb20c67-69e7-4666-b1a1-c009b0d95fed tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] HTTP exception thrown: Instance a810e13d-99f4-4c1b-83d6-8f06f9249fae could not be found. Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3fb20c67-69e7-4666-b1a1-c009b0d95fed tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Request method failure captured: Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae HTTP/1.1 Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWT1KEf5RrnueWN8kvjsLURQZMRFC3vXj7EkFIPWPtwUH5p4vA-FoRCpopRC9DSlZE_HC0WGwzVujJC0KQhUWeAqCdZ-AE7FaQcXN_vov0P3H2esfpvK2-XfZnMMJsEhdmjY6sxfgyMT-XdJMLKubEhpiDdQ4UTp8oG--QBn1oDlg3bQ Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 73688cef84664d7db69a39fcbffb6e65 Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServerActionsTestJSON-646524856 Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/73688cef84664d7db69a39fcbffb6e65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/73688cef84664d7db69a39fcbffb6e65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_73688cef84664d7db69a39fcbffb6e65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/73688cef84664d7db69a39fcbffb6e65"}]}] Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServerActionsTestJSON-646524856 Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 73688cef84664d7db69a39fcbffb6e65 Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServerActionsTestJSON-646524856 Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServerActionsTestJSON-646524856-project Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: dc4fe5238edd40db8d203790e2aab143 Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServerActionsTestJSON-646524856-project Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance a810e13d-99f4-4c1b-83d6-8f06f9249fae could not be found. Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'a810e13d-99f4-4c1b-83d6-8f06f9249fae'} Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a810e13d-99f4-4c1b-83d6-8f06f9249fae could not be found. Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a810e13d-99f4-4c1b-83d6-8f06f9249fae could not be found. Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:00:59.011131 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:00:59.015969 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:00:59.015969 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:00:59.015969 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:00:59.015969 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 14:00:59.015969 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 14:00:59.015969 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a810e13d-99f4-4c1b-83d6-8f06f9249fae could not be found. Oct 26 14:00:59.015969 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:00:59.015969 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3fb20c67-69e7-4666-b1a1-c009b0d95fed tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Returning 404 to user: Instance a810e13d-99f4-4c1b-83d6-8f06f9249fae could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 14:00:59.015969 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3fb20c67-69e7-4666-b1a1-c009b0d95fed tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae" status: 404 len: 111 microversion: 2.1 time: 0.032082 Oct 26 14:00:59.015969 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3607/7191] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:00:58 2022] GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 14:00:59.026165 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bdab6c87-5cc8-4343-b288-4331f291849c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:00:59.026833 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bdab6c87-5cc8-4343-b288-4331f291849c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:00:59.029674 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:00:59.035367 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bdab6c87-5cc8-4343-b288-4331f291849c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:59.035851 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bdab6c87-5cc8-4343-b288-4331f291849c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:59.036289 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bdab6c87-5cc8-4343-b288-4331f291849c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:59.036972 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bdab6c87-5cc8-4343-b288-4331f291849c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:59.037425 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bdab6c87-5cc8-4343-b288-4331f291849c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:59.038950 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bdab6c87-5cc8-4343-b288-4331f291849c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:59.054548 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-bdab6c87-5cc8-4343-b288-4331f291849c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] HTTP exception thrown: Instance a810e13d-99f4-4c1b-83d6-8f06f9249fae could not be found. Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bdab6c87-5cc8-4343-b288-4331f291849c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Request method failure captured: Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae HTTP/1.1 Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWT1KEf5RrnueWN8kvjsLURQZMRFC3vXj7EkFIPWPtwUH5p4vA-FoRCpopRC9DSlZE_HC0WGwzVujJC0KQhUWeAqCdZ-AE7FaQcXN_vov0P3H2esfpvK2-XfZnMMJsEhdmjY6sxfgyMT-XdJMLKubEhpiDdQ4UTp8oG--QBn1oDlg3bQ Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 73688cef84664d7db69a39fcbffb6e65 Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServerActionsTestJSON-646524856 Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/73688cef84664d7db69a39fcbffb6e65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/73688cef84664d7db69a39fcbffb6e65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_73688cef84664d7db69a39fcbffb6e65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/73688cef84664d7db69a39fcbffb6e65"}]}] Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServerActionsTestJSON-646524856 Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 73688cef84664d7db69a39fcbffb6e65 Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServerActionsTestJSON-646524856 Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServerActionsTestJSON-646524856-project Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: dc4fe5238edd40db8d203790e2aab143 Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServerActionsTestJSON-646524856-project Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance a810e13d-99f4-4c1b-83d6-8f06f9249fae could not be found. Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'a810e13d-99f4-4c1b-83d6-8f06f9249fae'} Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a810e13d-99f4-4c1b-83d6-8f06f9249fae could not be found. Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a810e13d-99f4-4c1b-83d6-8f06f9249fae could not be found. Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:00:59.056447 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:00:59.061374 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:00:59.061374 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:00:59.061374 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:00:59.061374 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 14:00:59.061374 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 14:00:59.061374 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a810e13d-99f4-4c1b-83d6-8f06f9249fae could not be found. Oct 26 14:00:59.061374 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:00:59.061374 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bdab6c87-5cc8-4343-b288-4331f291849c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Returning 404 to user: Instance a810e13d-99f4-4c1b-83d6-8f06f9249fae could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 14:00:59.061374 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bdab6c87-5cc8-4343-b288-4331f291849c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae" status: 404 len: 111 microversion: 2.1 time: 0.036317 Oct 26 14:00:59.061374 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3585/7192] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:00:59 2022] GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 14:00:59.108088 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-45e10330-d5c6-491b-a1b3-09f02aa68a46 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-658999743", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "2cd9056a-bda2-4cf3-a05f-b03f797a2eee"}], "security_groups": [{"name": "tempest-securitygroup--2110277177"}], "key_name": "tempest-keypair-908741287", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:00:59.117381 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=43 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:00:59.215228 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-45e10330-d5c6-491b-a1b3-09f02aa68a46 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] validate_networks() for [('2cd9056a-bda2-4cf3-a05f-b03f797a2eee', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 14:00:59.578382 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-45e10330-d5c6-491b-a1b3-09f02aa68a46 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 14:00:59.578855 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-45e10330-d5c6-491b-a1b3-09f02aa68a46 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 14:00:59.579353 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-45e10330-d5c6-491b-a1b3-09f02aa68a46 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 14:00:59.579780 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-45e10330-d5c6-491b-a1b3-09f02aa68a46 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 14:00:59.580214 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-45e10330-d5c6-491b-a1b3-09f02aa68a46 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 14:00:59.589177 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45e10330-d5c6-491b-a1b3-09f02aa68a46 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:59.589718 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45e10330-d5c6-491b-a1b3-09f02aa68a46 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:59.590173 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45e10330-d5c6-491b-a1b3-09f02aa68a46 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:59.590918 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45e10330-d5c6-491b-a1b3-09f02aa68a46 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:00:59.591392 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45e10330-d5c6-491b-a1b3-09f02aa68a46 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:00:59.591837 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45e10330-d5c6-491b-a1b3-09f02aa68a46 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:00:59.609122 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-45e10330-d5c6-491b-a1b3-09f02aa68a46 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Getting quotas for project 73688cef84664d7db69a39fcbffb6e65. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 14:00:59.614397 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-45e10330-d5c6-491b-a1b3-09f02aa68a46 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Getting quotas for user dc4fe5238edd40db8d203790e2aab143 and project 73688cef84664d7db69a39fcbffb6e65. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 14:00:59.627344 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-45e10330-d5c6-491b-a1b3-09f02aa68a46 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 14:00:59.629724 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-45e10330-d5c6-491b-a1b3-09f02aa68a46 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 14:00:59.676658 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-45e10330-d5c6-491b-a1b3-09f02aa68a46 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.572493 Oct 26 14:00:59.677325 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3608/7193] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 14:00:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 14:00:59.689115 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-70a81b92-65f3-4f61-8916-8b9daf2a60a4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:00:59.689771 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-70a81b92-65f3-4f61-8916-8b9daf2a60a4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:00:59.744850 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-70a81b92-65f3-4f61-8916-8b9daf2a60a4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:00:59.751787 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-70a81b92-65f3-4f61-8916-8b9daf2a60a4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0" status: 200 len: 1237 microversion: 2.1 time: 0.066551 Oct 26 14:00:59.752373 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3586/7194] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:00:59 2022] GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:01:00.776073 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-937b8c82-2184-4ba5-a771-e2c338fe8615 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:01:00.776711 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-937b8c82-2184-4ba5-a771-e2c338fe8615 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:01:00.785128 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-937b8c82-2184-4ba5-a771-e2c338fe8615 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:00.785689 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-937b8c82-2184-4ba5-a771-e2c338fe8615 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:00.786153 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-937b8c82-2184-4ba5-a771-e2c338fe8615 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:00.787063 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-937b8c82-2184-4ba5-a771-e2c338fe8615 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:00.787805 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-937b8c82-2184-4ba5-a771-e2c338fe8615 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:00.788471 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-937b8c82-2184-4ba5-a771-e2c338fe8615 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:00.864012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-937b8c82-2184-4ba5-a771-e2c338fe8615 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:01:00.872985 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-937b8c82-2184-4ba5-a771-e2c338fe8615 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0" status: 200 len: 1297 microversion: 2.1 time: 0.100897 Oct 26 14:01:00.873855 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3609/7195] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:01:00 2022] GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 => generated 1297 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:01:01.898546 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-23c18335-7e91-4265-922b-b05d4329168e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:01:01.899171 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-23c18335-7e91-4265-922b-b05d4329168e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:01:01.907047 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-23c18335-7e91-4265-922b-b05d4329168e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:01.907483 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-23c18335-7e91-4265-922b-b05d4329168e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:01.907941 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-23c18335-7e91-4265-922b-b05d4329168e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:01.908901 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-23c18335-7e91-4265-922b-b05d4329168e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:01.909498 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-23c18335-7e91-4265-922b-b05d4329168e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:01.909944 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-23c18335-7e91-4265-922b-b05d4329168e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:02.050626 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-23c18335-7e91-4265-922b-b05d4329168e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:01:02.059272 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-23c18335-7e91-4265-922b-b05d4329168e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0" status: 200 len: 1363 microversion: 2.1 time: 0.164881 Oct 26 14:01:02.059903 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3587/7196] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:01:01 2022] GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:01:02.345627 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-8e106a9b-48a7-476d-9517-4699f40c5633 req-0aef483a-8f62-4664-ab4c-28dc9aebec10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ff5656c-f0da-4aa5-a2c2-bbc920567cf0", "tag": "6a04d7a5-d377-4315-985d-5f8288fcc399"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:01:02.357280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8e106a9b-48a7-476d-9517-4699f40c5633 req-0aef483a-8f62-4664-ab4c-28dc9aebec10 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:02.357804 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8e106a9b-48a7-476d-9517-4699f40c5633 req-0aef483a-8f62-4664-ab4c-28dc9aebec10 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:02.358256 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8e106a9b-48a7-476d-9517-4699f40c5633 req-0aef483a-8f62-4664-ab4c-28dc9aebec10 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:02.369915 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-8e106a9b-48a7-476d-9517-4699f40c5633 req-0aef483a-8f62-4664-ab4c-28dc9aebec10 service nova] Creating event network-changed:6a04d7a5-d377-4315-985d-5f8288fcc399 for instance 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 on n-h1-862686-1 Oct 26 14:01:02.375677 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-8e106a9b-48a7-476d-9517-4699f40c5633 req-0aef483a-8f62-4664-ab4c-28dc9aebec10 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107535 Oct 26 14:01:02.376305 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3610/7197] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:01:03.083210 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e446122e-a04a-49dc-acc8-3f512146d106 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:01:03.083820 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e446122e-a04a-49dc-acc8-3f512146d106 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:01:03.091198 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e446122e-a04a-49dc-acc8-3f512146d106 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:03.091679 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e446122e-a04a-49dc-acc8-3f512146d106 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:03.092134 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e446122e-a04a-49dc-acc8-3f512146d106 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:03.092839 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e446122e-a04a-49dc-acc8-3f512146d106 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:03.093384 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e446122e-a04a-49dc-acc8-3f512146d106 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:03.093860 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e446122e-a04a-49dc-acc8-3f512146d106 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:03.223151 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e446122e-a04a-49dc-acc8-3f512146d106 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:01:03.231790 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e446122e-a04a-49dc-acc8-3f512146d106 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0" status: 200 len: 1363 microversion: 2.1 time: 0.152545 Oct 26 14:01:03.232371 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3588/7198] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:01:03 2022] GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:01:04.259569 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-472182af-c054-45a8-b0a0-dccdc2dd1e28 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:01:04.260756 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-472182af-c054-45a8-b0a0-dccdc2dd1e28 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:01:04.270428 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-472182af-c054-45a8-b0a0-dccdc2dd1e28 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:04.270973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-472182af-c054-45a8-b0a0-dccdc2dd1e28 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:04.271415 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-472182af-c054-45a8-b0a0-dccdc2dd1e28 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:04.272757 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-472182af-c054-45a8-b0a0-dccdc2dd1e28 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:04.273513 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-472182af-c054-45a8-b0a0-dccdc2dd1e28 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:04.274202 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-472182af-c054-45a8-b0a0-dccdc2dd1e28 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:04.404819 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-472182af-c054-45a8-b0a0-dccdc2dd1e28 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:01:04.412754 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-472182af-c054-45a8-b0a0-dccdc2dd1e28 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0" status: 200 len: 1363 microversion: 2.1 time: 0.160283 Oct 26 14:01:04.413337 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3611/7199] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:01:04 2022] GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:01:05.436507 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1ab50dee-d359-403f-808a-6eb1766f1807 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:01:05.437120 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1ab50dee-d359-403f-808a-6eb1766f1807 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:01:05.444073 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1ab50dee-d359-403f-808a-6eb1766f1807 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:05.444568 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1ab50dee-d359-403f-808a-6eb1766f1807 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:05.445016 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1ab50dee-d359-403f-808a-6eb1766f1807 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:05.445735 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1ab50dee-d359-403f-808a-6eb1766f1807 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:05.446192 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1ab50dee-d359-403f-808a-6eb1766f1807 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:05.446617 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1ab50dee-d359-403f-808a-6eb1766f1807 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:05.574768 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1ab50dee-d359-403f-808a-6eb1766f1807 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:01:05.582422 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1ab50dee-d359-403f-808a-6eb1766f1807 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0" status: 200 len: 1363 microversion: 2.1 time: 0.149836 Oct 26 14:01:05.583002 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3589/7200] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:01:05 2022] GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:01:06.607093 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ccb3d3d5-0d45-4215-afa6-58bf239690c1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:01:06.607716 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ccb3d3d5-0d45-4215-afa6-58bf239690c1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:01:06.614567 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ccb3d3d5-0d45-4215-afa6-58bf239690c1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:06.615069 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ccb3d3d5-0d45-4215-afa6-58bf239690c1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:06.615517 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ccb3d3d5-0d45-4215-afa6-58bf239690c1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:06.616771 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ccb3d3d5-0d45-4215-afa6-58bf239690c1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:06.617245 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ccb3d3d5-0d45-4215-afa6-58bf239690c1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:06.617716 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ccb3d3d5-0d45-4215-afa6-58bf239690c1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:06.750249 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ccb3d3d5-0d45-4215-afa6-58bf239690c1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:01:06.758402 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ccb3d3d5-0d45-4215-afa6-58bf239690c1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0" status: 200 len: 1363 microversion: 2.1 time: 0.155243 Oct 26 14:01:06.758989 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3612/7201] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:01:06 2022] GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:01:07.782107 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-aed8d3d7-696e-4997-be36-0510e9eb254c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:01:07.782744 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-aed8d3d7-696e-4997-be36-0510e9eb254c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:01:07.790479 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aed8d3d7-696e-4997-be36-0510e9eb254c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:07.790979 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aed8d3d7-696e-4997-be36-0510e9eb254c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:07.791426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aed8d3d7-696e-4997-be36-0510e9eb254c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:07.792142 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aed8d3d7-696e-4997-be36-0510e9eb254c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:07.792605 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aed8d3d7-696e-4997-be36-0510e9eb254c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:07.793042 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aed8d3d7-696e-4997-be36-0510e9eb254c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:07.937343 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-59989262-b4e0-4df1-9bf3-d394e1754ea6 req-0a403eff-2f8b-4772-a160-41ba9a963736 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ff5656c-f0da-4aa5-a2c2-bbc920567cf0", "name": "network-vif-plugged", "status": "completed", "tag": "6a04d7a5-d377-4315-985d-5f8288fcc399"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:01:07.944986 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-aed8d3d7-696e-4997-be36-0510e9eb254c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:01:07.950489 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-59989262-b4e0-4df1-9bf3-d394e1754ea6 req-0a403eff-2f8b-4772-a160-41ba9a963736 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:07.951072 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-59989262-b4e0-4df1-9bf3-d394e1754ea6 req-0a403eff-2f8b-4772-a160-41ba9a963736 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:07.951592 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-59989262-b4e0-4df1-9bf3-d394e1754ea6 req-0a403eff-2f8b-4772-a160-41ba9a963736 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:07.953898 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-aed8d3d7-696e-4997-be36-0510e9eb254c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0" status: 200 len: 1363 microversion: 2.1 time: 0.175689 Oct 26 14:01:07.954677 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3590/7202] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:01:07 2022] GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:01:07.963812 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-59989262-b4e0-4df1-9bf3-d394e1754ea6 req-0a403eff-2f8b-4772-a160-41ba9a963736 service nova] Creating event network-vif-plugged:6a04d7a5-d377-4315-985d-5f8288fcc399 for instance 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 on n-h1-862686-1 Oct 26 14:01:07.968958 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-59989262-b4e0-4df1-9bf3-d394e1754ea6 req-0a403eff-2f8b-4772-a160-41ba9a963736 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035763 Oct 26 14:01:07.969687 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3613/7203] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:01:08.978797 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9c6c9bdc-da27-4c40-bc8a-bc1a5e4dde41 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:01:08.979411 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9c6c9bdc-da27-4c40-bc8a-bc1a5e4dde41 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:01:08.986251 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c6c9bdc-da27-4c40-bc8a-bc1a5e4dde41 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:08.986732 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c6c9bdc-da27-4c40-bc8a-bc1a5e4dde41 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:08.987165 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c6c9bdc-da27-4c40-bc8a-bc1a5e4dde41 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:08.987853 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c6c9bdc-da27-4c40-bc8a-bc1a5e4dde41 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:08.988330 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c6c9bdc-da27-4c40-bc8a-bc1a5e4dde41 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:08.988752 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c6c9bdc-da27-4c40-bc8a-bc1a5e4dde41 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:09.120267 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9c6c9bdc-da27-4c40-bc8a-bc1a5e4dde41 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:01:09.128252 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9c6c9bdc-da27-4c40-bc8a-bc1a5e4dde41 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0" status: 200 len: 1363 microversion: 2.1 time: 0.153707 Oct 26 14:01:09.128762 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3591/7204] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:01:08 2022] GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:01:10.150889 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:01:10.151675 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:01:10.155992 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b7f09724-303f-4380-a5af-33f9c7b70e6d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:01:10.156711 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b7f09724-303f-4380-a5af-33f9c7b70e6d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:01:10.164101 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b7f09724-303f-4380-a5af-33f9c7b70e6d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:10.164606 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b7f09724-303f-4380-a5af-33f9c7b70e6d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:10.165062 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b7f09724-303f-4380-a5af-33f9c7b70e6d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:10.165802 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b7f09724-303f-4380-a5af-33f9c7b70e6d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:10.166278 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b7f09724-303f-4380-a5af-33f9c7b70e6d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:10.166725 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b7f09724-303f-4380-a5af-33f9c7b70e6d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:10.298158 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b7f09724-303f-4380-a5af-33f9c7b70e6d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:01:10.306675 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b7f09724-303f-4380-a5af-33f9c7b70e6d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0" status: 200 len: 1550 microversion: 2.1 time: 0.157634 Oct 26 14:01:10.307271 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3614/7205] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:01:10 2022] GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 => generated 1550 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:01:10.329837 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dc47bc6d-9e96-4067-a62a-cde83820dea4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:01:10.330346 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-dc47bc6d-9e96-4067-a62a-cde83820dea4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:01:10.332110 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:01:10.338814 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc47bc6d-9e96-4067-a62a-cde83820dea4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:10.339293 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc47bc6d-9e96-4067-a62a-cde83820dea4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:10.339724 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc47bc6d-9e96-4067-a62a-cde83820dea4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:10.340404 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc47bc6d-9e96-4067-a62a-cde83820dea4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:10.340856 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc47bc6d-9e96-4067-a62a-cde83820dea4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:10.341277 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc47bc6d-9e96-4067-a62a-cde83820dea4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:10.418559 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-dc47bc6d-9e96-4067-a62a-cde83820dea4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092671 Oct 26 14:01:10.419183 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3592/7206] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 26 14:01:10 2022] GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 14:01:11.779788 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-362bc53f-ea59-4128-954a-0fd8ecdfc3bd req-03a10cfd-8883-47c3-a646-c44d75c3c68d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ff5656c-f0da-4aa5-a2c2-bbc920567cf0", "tag": "6a04d7a5-d377-4315-985d-5f8288fcc399"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:01:11.789656 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-362bc53f-ea59-4128-954a-0fd8ecdfc3bd req-03a10cfd-8883-47c3-a646-c44d75c3c68d service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:11.790233 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-362bc53f-ea59-4128-954a-0fd8ecdfc3bd req-03a10cfd-8883-47c3-a646-c44d75c3c68d service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:11.790748 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-362bc53f-ea59-4128-954a-0fd8ecdfc3bd req-03a10cfd-8883-47c3-a646-c44d75c3c68d service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:11.801924 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-362bc53f-ea59-4128-954a-0fd8ecdfc3bd req-03a10cfd-8883-47c3-a646-c44d75c3c68d service nova] Creating event network-changed:6a04d7a5-d377-4315-985d-5f8288fcc399 for instance 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 on n-h1-862686-1 Oct 26 14:01:11.807667 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-362bc53f-ea59-4128-954a-0fd8ecdfc3bd req-03a10cfd-8883-47c3-a646-c44d75c3c68d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082447 Oct 26 14:01:11.808339 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3615/7207] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:01:44.893002 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=17 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:01:44.894131 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:01:44.899309 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b6ed9d87-1fb1-4964-8cb2-38cdb5181b15 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:01:44.906574 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6ed9d87-1fb1-4964-8cb2-38cdb5181b15 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:44.907220 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6ed9d87-1fb1-4964-8cb2-38cdb5181b15 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:44.907665 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6ed9d87-1fb1-4964-8cb2-38cdb5181b15 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:44.931232 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b6ed9d87-1fb1-4964-8cb2-38cdb5181b15 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] Going to try to stop instance {{(pid=120597) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 26 14:01:44.977496 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b6ed9d87-1fb1-4964-8cb2-38cdb5181b15 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "POST /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0/action" status: 202 len: 0 microversion: 2.1 time: 0.086839 Oct 26 14:01:44.978145 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3593/7208] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 14:01:44 2022] POST /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 14:01:44.984924 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:01:44.986251 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=51 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:01:44.991189 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-24d28fce-ab05-4852-97e3-3d8d4589c88e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:01:44.991925 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-24d28fce-ab05-4852-97e3-3d8d4589c88e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:01:45.003048 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24d28fce-ab05-4852-97e3-3d8d4589c88e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:45.003560 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24d28fce-ab05-4852-97e3-3d8d4589c88e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:45.004020 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24d28fce-ab05-4852-97e3-3d8d4589c88e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:45.004755 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24d28fce-ab05-4852-97e3-3d8d4589c88e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:45.005233 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24d28fce-ab05-4852-97e3-3d8d4589c88e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:45.005710 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24d28fce-ab05-4852-97e3-3d8d4589c88e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:45.143240 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-24d28fce-ab05-4852-97e3-3d8d4589c88e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:01:45.151376 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-24d28fce-ab05-4852-97e3-3d8d4589c88e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0" status: 200 len: 1679 microversion: 2.1 time: 0.168725 Oct 26 14:01:45.151957 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3616/7209] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:01:44 2022] GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 14:01:46.176917 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-56522098-0516-4e8d-b44b-b17ce9b2fe6a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:01:46.177648 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-56522098-0516-4e8d-b44b-b17ce9b2fe6a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:01:46.184569 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-56522098-0516-4e8d-b44b-b17ce9b2fe6a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:46.185056 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-56522098-0516-4e8d-b44b-b17ce9b2fe6a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:46.185511 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-56522098-0516-4e8d-b44b-b17ce9b2fe6a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:46.186209 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-56522098-0516-4e8d-b44b-b17ce9b2fe6a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:46.186669 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-56522098-0516-4e8d-b44b-b17ce9b2fe6a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:46.187102 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-56522098-0516-4e8d-b44b-b17ce9b2fe6a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:46.317082 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-56522098-0516-4e8d-b44b-b17ce9b2fe6a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:01:46.325720 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-56522098-0516-4e8d-b44b-b17ce9b2fe6a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0" status: 200 len: 1679 microversion: 2.1 time: 0.153452 Oct 26 14:01:46.326294 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3594/7210] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:01:46 2022] GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:01:47.348720 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d5ae7735-c4e9-4bde-a32b-deb52b13de47 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:01:47.349362 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d5ae7735-c4e9-4bde-a32b-deb52b13de47 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:01:47.357012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5ae7735-c4e9-4bde-a32b-deb52b13de47 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:47.357549 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5ae7735-c4e9-4bde-a32b-deb52b13de47 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:47.358015 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5ae7735-c4e9-4bde-a32b-deb52b13de47 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:47.358733 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5ae7735-c4e9-4bde-a32b-deb52b13de47 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:47.359212 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5ae7735-c4e9-4bde-a32b-deb52b13de47 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:47.359662 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5ae7735-c4e9-4bde-a32b-deb52b13de47 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:47.485585 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d5ae7735-c4e9-4bde-a32b-deb52b13de47 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:01:47.493412 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d5ae7735-c4e9-4bde-a32b-deb52b13de47 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0" status: 200 len: 1679 microversion: 2.1 time: 0.148725 Oct 26 14:01:47.494020 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3617/7211] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:01:47 2022] GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:01:48.519597 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-28e6523f-eeb3-48cc-808e-a3b1222fec02 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:01:48.520220 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-28e6523f-eeb3-48cc-808e-a3b1222fec02 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:01:48.527419 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-28e6523f-eeb3-48cc-808e-a3b1222fec02 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:48.527933 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-28e6523f-eeb3-48cc-808e-a3b1222fec02 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:48.528377 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-28e6523f-eeb3-48cc-808e-a3b1222fec02 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:48.529084 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-28e6523f-eeb3-48cc-808e-a3b1222fec02 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:48.529572 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-28e6523f-eeb3-48cc-808e-a3b1222fec02 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:48.530043 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-28e6523f-eeb3-48cc-808e-a3b1222fec02 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:48.660075 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-28e6523f-eeb3-48cc-808e-a3b1222fec02 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:01:48.668850 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-28e6523f-eeb3-48cc-808e-a3b1222fec02 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0" status: 200 len: 1679 microversion: 2.1 time: 0.153377 Oct 26 14:01:48.669417 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3595/7212] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:01:48 2022] GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:01:49.692354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a4aaa52e-cf9c-4cd5-8065-f4a058394b7d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:01:49.692997 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a4aaa52e-cf9c-4cd5-8065-f4a058394b7d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:01:49.699336 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4aaa52e-cf9c-4cd5-8065-f4a058394b7d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:49.699828 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4aaa52e-cf9c-4cd5-8065-f4a058394b7d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:49.700280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4aaa52e-cf9c-4cd5-8065-f4a058394b7d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:49.700973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4aaa52e-cf9c-4cd5-8065-f4a058394b7d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:49.701439 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4aaa52e-cf9c-4cd5-8065-f4a058394b7d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:49.701895 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4aaa52e-cf9c-4cd5-8065-f4a058394b7d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:49.834138 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a4aaa52e-cf9c-4cd5-8065-f4a058394b7d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:01:49.841750 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a4aaa52e-cf9c-4cd5-8065-f4a058394b7d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0" status: 200 len: 1679 microversion: 2.1 time: 0.153461 Oct 26 14:01:49.842331 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3618/7213] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:01:49 2022] GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:01:50.865632 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e624b76c-ef04-4f18-b231-7f553d23aa66 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:01:50.866242 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e624b76c-ef04-4f18-b231-7f553d23aa66 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:01:50.873194 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e624b76c-ef04-4f18-b231-7f553d23aa66 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:50.873710 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e624b76c-ef04-4f18-b231-7f553d23aa66 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:50.874153 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e624b76c-ef04-4f18-b231-7f553d23aa66 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:50.874841 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e624b76c-ef04-4f18-b231-7f553d23aa66 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:50.875293 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e624b76c-ef04-4f18-b231-7f553d23aa66 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:50.875714 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e624b76c-ef04-4f18-b231-7f553d23aa66 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:51.006143 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e624b76c-ef04-4f18-b231-7f553d23aa66 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:01:51.014280 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e624b76c-ef04-4f18-b231-7f553d23aa66 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0" status: 200 len: 1679 microversion: 2.1 time: 0.152610 Oct 26 14:01:51.014856 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3596/7214] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:01:50 2022] GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:01:52.036902 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5c73de3e-87b2-465c-94c2-65a079c9ba6f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:01:52.037542 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5c73de3e-87b2-465c-94c2-65a079c9ba6f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:01:52.045062 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c73de3e-87b2-465c-94c2-65a079c9ba6f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:52.045523 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c73de3e-87b2-465c-94c2-65a079c9ba6f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:52.045980 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c73de3e-87b2-465c-94c2-65a079c9ba6f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:52.046676 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c73de3e-87b2-465c-94c2-65a079c9ba6f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:52.047143 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c73de3e-87b2-465c-94c2-65a079c9ba6f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:52.047578 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c73de3e-87b2-465c-94c2-65a079c9ba6f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:52.182417 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5c73de3e-87b2-465c-94c2-65a079c9ba6f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:01:52.190166 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5c73de3e-87b2-465c-94c2-65a079c9ba6f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0" status: 200 len: 1679 microversion: 2.1 time: 0.157456 Oct 26 14:01:52.190740 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3619/7215] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:01:52 2022] GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:01:53.214528 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3dec0608-8ac2-471f-b233-9186a274c320 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:01:53.215133 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3dec0608-8ac2-471f-b233-9186a274c320 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:01:53.221737 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3dec0608-8ac2-471f-b233-9186a274c320 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:53.222224 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3dec0608-8ac2-471f-b233-9186a274c320 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:53.222662 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3dec0608-8ac2-471f-b233-9186a274c320 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:53.223347 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3dec0608-8ac2-471f-b233-9186a274c320 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:53.223801 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3dec0608-8ac2-471f-b233-9186a274c320 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:53.224222 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3dec0608-8ac2-471f-b233-9186a274c320 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:53.351049 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3dec0608-8ac2-471f-b233-9186a274c320 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:01:53.359652 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3dec0608-8ac2-471f-b233-9186a274c320 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0" status: 200 len: 1679 microversion: 2.1 time: 0.149608 Oct 26 14:01:53.360217 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3597/7216] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:01:53 2022] GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:01:54.383426 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1a798b37-bd3c-40d9-aea0-c634455efa58 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:01:54.384052 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1a798b37-bd3c-40d9-aea0-c634455efa58 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:01:54.390893 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a798b37-bd3c-40d9-aea0-c634455efa58 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:54.391390 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a798b37-bd3c-40d9-aea0-c634455efa58 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:54.391843 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a798b37-bd3c-40d9-aea0-c634455efa58 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:54.392546 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a798b37-bd3c-40d9-aea0-c634455efa58 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:54.393016 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a798b37-bd3c-40d9-aea0-c634455efa58 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:54.393458 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a798b37-bd3c-40d9-aea0-c634455efa58 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:54.526161 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1a798b37-bd3c-40d9-aea0-c634455efa58 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:01:54.534119 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1a798b37-bd3c-40d9-aea0-c634455efa58 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0" status: 200 len: 1679 microversion: 2.1 time: 0.154464 Oct 26 14:01:54.534685 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3620/7217] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:01:54 2022] GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:01:55.558157 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cb91e5ab-8539-4c2f-ab7a-358f2b7ae14a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:01:55.558756 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cb91e5ab-8539-4c2f-ab7a-358f2b7ae14a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:01:55.568128 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb91e5ab-8539-4c2f-ab7a-358f2b7ae14a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:55.568615 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb91e5ab-8539-4c2f-ab7a-358f2b7ae14a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:55.569057 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb91e5ab-8539-4c2f-ab7a-358f2b7ae14a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:55.569790 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb91e5ab-8539-4c2f-ab7a-358f2b7ae14a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:55.570334 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb91e5ab-8539-4c2f-ab7a-358f2b7ae14a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:55.571421 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb91e5ab-8539-4c2f-ab7a-358f2b7ae14a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:55.704362 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cb91e5ab-8539-4c2f-ab7a-358f2b7ae14a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:01:55.712292 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cb91e5ab-8539-4c2f-ab7a-358f2b7ae14a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0" status: 200 len: 1656 microversion: 2.1 time: 0.158643 Oct 26 14:01:55.712872 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3598/7218] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:01:55 2022] GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 => generated 1656 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:01:55.735393 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4dccad79-c6a0-4cbe-80ad-ab70b45ff263 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:01:55.737895 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4dccad79-c6a0-4cbe-80ad-ab70b45ff263 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:01:55.745416 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4dccad79-c6a0-4cbe-80ad-ab70b45ff263 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:55.745938 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4dccad79-c6a0-4cbe-80ad-ab70b45ff263 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:55.746381 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4dccad79-c6a0-4cbe-80ad-ab70b45ff263 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:55.747078 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4dccad79-c6a0-4cbe-80ad-ab70b45ff263 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:55.747543 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4dccad79-c6a0-4cbe-80ad-ab70b45ff263 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:55.747977 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4dccad79-c6a0-4cbe-80ad-ab70b45ff263 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:55.779981 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4dccad79-c6a0-4cbe-80ad-ab70b45ff263 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:01:55.788007 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4dccad79-c6a0-4cbe-80ad-ab70b45ff263 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] Old instance type m1.heat2, new instance type m1.heat {{(pid=120598) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 26 14:01:55.795671 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-4dccad79-c6a0-4cbe-80ad-ab70b45ff263 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 14:01:55.796131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-4dccad79-c6a0-4cbe-80ad-ab70b45ff263 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 14:01:55.796614 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-4dccad79-c6a0-4cbe-80ad-ab70b45ff263 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 14:01:55.797033 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-4dccad79-c6a0-4cbe-80ad-ab70b45ff263 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 14:01:55.797453 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-4dccad79-c6a0-4cbe-80ad-ab70b45ff263 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 14:01:55.861250 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4dccad79-c6a0-4cbe-80ad-ab70b45ff263 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "POST /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0/action" status: 202 len: 0 microversion: 2.1 time: 0.129742 Oct 26 14:01:55.862070 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3621/7219] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 14:01:55 2022] POST /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 14:01:55.871061 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-36b0e6f1-ff8b-46d1-8387-6666776aa2ab tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:01:55.871985 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-36b0e6f1-ff8b-46d1-8387-6666776aa2ab tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:01:55.878423 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-36b0e6f1-ff8b-46d1-8387-6666776aa2ab tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:55.878898 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-36b0e6f1-ff8b-46d1-8387-6666776aa2ab tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:55.879341 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-36b0e6f1-ff8b-46d1-8387-6666776aa2ab tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:55.880040 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-36b0e6f1-ff8b-46d1-8387-6666776aa2ab tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:55.880500 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-36b0e6f1-ff8b-46d1-8387-6666776aa2ab tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:55.880930 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-36b0e6f1-ff8b-46d1-8387-6666776aa2ab tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:56.018104 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-36b0e6f1-ff8b-46d1-8387-6666776aa2ab tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:01:56.026766 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-36b0e6f1-ff8b-46d1-8387-6666776aa2ab tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0" status: 200 len: 1679 microversion: 2.1 time: 0.160477 Oct 26 14:01:56.027353 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3599/7220] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:01:55 2022] GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 14:01:57.051937 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-78ab3f3e-d150-4e61-967e-178a01d89835 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:01:57.052562 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-78ab3f3e-d150-4e61-967e-178a01d89835 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:01:57.060973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78ab3f3e-d150-4e61-967e-178a01d89835 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:57.061498 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78ab3f3e-d150-4e61-967e-178a01d89835 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:57.061957 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78ab3f3e-d150-4e61-967e-178a01d89835 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:57.062668 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78ab3f3e-d150-4e61-967e-178a01d89835 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:57.063142 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78ab3f3e-d150-4e61-967e-178a01d89835 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:57.063584 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78ab3f3e-d150-4e61-967e-178a01d89835 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:57.195655 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-78ab3f3e-d150-4e61-967e-178a01d89835 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:01:57.203852 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-78ab3f3e-d150-4e61-967e-178a01d89835 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0" status: 200 len: 1679 microversion: 2.1 time: 0.155842 Oct 26 14:01:57.204871 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3622/7221] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:01:57 2022] GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:01:58.228777 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fe2bf1f1-a0f2-44fa-81ec-800b2f67f58e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:01:58.229386 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fe2bf1f1-a0f2-44fa-81ec-800b2f67f58e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:01:58.236273 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fe2bf1f1-a0f2-44fa-81ec-800b2f67f58e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:58.236763 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fe2bf1f1-a0f2-44fa-81ec-800b2f67f58e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:58.237205 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fe2bf1f1-a0f2-44fa-81ec-800b2f67f58e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:58.237932 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fe2bf1f1-a0f2-44fa-81ec-800b2f67f58e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:58.238428 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fe2bf1f1-a0f2-44fa-81ec-800b2f67f58e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:58.238860 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fe2bf1f1-a0f2-44fa-81ec-800b2f67f58e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:58.373683 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fe2bf1f1-a0f2-44fa-81ec-800b2f67f58e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:01:58.381628 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fe2bf1f1-a0f2-44fa-81ec-800b2f67f58e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0" status: 200 len: 1684 microversion: 2.1 time: 0.157404 Oct 26 14:01:58.382216 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3600/7222] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:01:58 2022] GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:01:59.406519 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a9ac63e8-5b94-4dd2-ad1f-2928e7c05157 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:01:59.407140 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a9ac63e8-5b94-4dd2-ad1f-2928e7c05157 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:01:59.415006 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a9ac63e8-5b94-4dd2-ad1f-2928e7c05157 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:59.415553 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a9ac63e8-5b94-4dd2-ad1f-2928e7c05157 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:59.416008 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a9ac63e8-5b94-4dd2-ad1f-2928e7c05157 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:59.416718 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a9ac63e8-5b94-4dd2-ad1f-2928e7c05157 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:01:59.417228 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a9ac63e8-5b94-4dd2-ad1f-2928e7c05157 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:01:59.417700 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a9ac63e8-5b94-4dd2-ad1f-2928e7c05157 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:01:59.547278 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a9ac63e8-5b94-4dd2-ad1f-2928e7c05157 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:01:59.555648 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a9ac63e8-5b94-4dd2-ad1f-2928e7c05157 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0" status: 200 len: 1684 microversion: 2.1 time: 0.152559 Oct 26 14:01:59.556229 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3623/7223] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:01:59 2022] GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:02:00.471046 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-0587a997-81df-45d6-b5bd-5343181934ca req-d91ea5d2-03ac-4c21-95a6-3a21078783ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ff5656c-f0da-4aa5-a2c2-bbc920567cf0", "name": "network-vif-unplugged", "status": "completed", "tag": "6a04d7a5-d377-4315-985d-5f8288fcc399"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:02:00.481537 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-0587a997-81df-45d6-b5bd-5343181934ca req-d91ea5d2-03ac-4c21-95a6-3a21078783ab service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:00.482123 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-0587a997-81df-45d6-b5bd-5343181934ca req-d91ea5d2-03ac-4c21-95a6-3a21078783ab service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:00.482622 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-0587a997-81df-45d6-b5bd-5343181934ca req-d91ea5d2-03ac-4c21-95a6-3a21078783ab service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:00.495412 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-0587a997-81df-45d6-b5bd-5343181934ca req-d91ea5d2-03ac-4c21-95a6-3a21078783ab service nova] Creating event network-vif-unplugged:6a04d7a5-d377-4315-985d-5f8288fcc399 for instance 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 on n-h2-862686-1 Oct 26 14:02:00.501455 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [req-0587a997-81df-45d6-b5bd-5343181934ca req-d91ea5d2-03ac-4c21-95a6-3a21078783ab service nova] Instance 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862686-1', 'n-h1-862686-1'} {{(pid=120597) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 14:02:00.512378 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-0587a997-81df-45d6-b5bd-5343181934ca req-d91ea5d2-03ac-4c21-95a6-3a21078783ab service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096699 Oct 26 14:02:00.513003 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3601/7224] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:02:00.579425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2d60779e-c8a5-4ce0-b1dc-e0034acf759e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:02:00.580192 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2d60779e-c8a5-4ce0-b1dc-e0034acf759e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:02:00.587557 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d60779e-c8a5-4ce0-b1dc-e0034acf759e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:00.588062 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d60779e-c8a5-4ce0-b1dc-e0034acf759e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:00.588515 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d60779e-c8a5-4ce0-b1dc-e0034acf759e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:00.589230 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d60779e-c8a5-4ce0-b1dc-e0034acf759e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:00.589731 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d60779e-c8a5-4ce0-b1dc-e0034acf759e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:00.590213 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d60779e-c8a5-4ce0-b1dc-e0034acf759e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:00.805841 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2d60779e-c8a5-4ce0-b1dc-e0034acf759e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:02:00.814027 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2d60779e-c8a5-4ce0-b1dc-e0034acf759e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0" status: 200 len: 1683 microversion: 2.1 time: 0.238595 Oct 26 14:02:00.814796 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3624/7225] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:02:00 2022] GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 => generated 1683 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:02:01.839013 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-de0b9fc6-4d06-4ff5-a2fe-6ca13a1c6f97 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:02:01.839631 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-de0b9fc6-4d06-4ff5-a2fe-6ca13a1c6f97 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:02:01.846290 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-de0b9fc6-4d06-4ff5-a2fe-6ca13a1c6f97 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:01.846772 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-de0b9fc6-4d06-4ff5-a2fe-6ca13a1c6f97 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:01.847207 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-de0b9fc6-4d06-4ff5-a2fe-6ca13a1c6f97 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:01.847898 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-de0b9fc6-4d06-4ff5-a2fe-6ca13a1c6f97 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:01.848351 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-de0b9fc6-4d06-4ff5-a2fe-6ca13a1c6f97 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:01.848775 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-de0b9fc6-4d06-4ff5-a2fe-6ca13a1c6f97 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:01.982618 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-de0b9fc6-4d06-4ff5-a2fe-6ca13a1c6f97 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:02:01.990441 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-de0b9fc6-4d06-4ff5-a2fe-6ca13a1c6f97 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0" status: 200 len: 1681 microversion: 2.1 time: 0.156827 Oct 26 14:02:01.991017 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3602/7226] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:02:01 2022] GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:02:02.527592 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-d74c729b-aa1c-4520-9673-d94abeaf6e5f req-18496232-c7ca-4d5b-a416-e1474674187c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ff5656c-f0da-4aa5-a2c2-bbc920567cf0", "tag": "6a04d7a5-d377-4315-985d-5f8288fcc399"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:02:02.539155 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-d74c729b-aa1c-4520-9673-d94abeaf6e5f req-18496232-c7ca-4d5b-a416-e1474674187c service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:02.539679 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-d74c729b-aa1c-4520-9673-d94abeaf6e5f req-18496232-c7ca-4d5b-a416-e1474674187c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:02.540193 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-d74c729b-aa1c-4520-9673-d94abeaf6e5f req-18496232-c7ca-4d5b-a416-e1474674187c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:02.552783 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-d74c729b-aa1c-4520-9673-d94abeaf6e5f req-18496232-c7ca-4d5b-a416-e1474674187c service nova] Creating event network-changed:6a04d7a5-d377-4315-985d-5f8288fcc399 for instance 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 on n-h2-862686-1 Oct 26 14:02:02.558652 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [req-d74c729b-aa1c-4520-9673-d94abeaf6e5f req-18496232-c7ca-4d5b-a416-e1474674187c service nova] Instance 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862686-1', 'n-h1-862686-1'} {{(pid=120598) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 14:02:02.569442 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-d74c729b-aa1c-4520-9673-d94abeaf6e5f req-18496232-c7ca-4d5b-a416-e1474674187c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046350 Oct 26 14:02:02.570081 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3625/7227] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:02:03.014698 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-413bea23-cc58-42ca-99ed-2e96031ab79a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:02:03.015388 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-413bea23-cc58-42ca-99ed-2e96031ab79a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:02:03.022604 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-413bea23-cc58-42ca-99ed-2e96031ab79a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:03.023100 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-413bea23-cc58-42ca-99ed-2e96031ab79a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:03.023687 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-413bea23-cc58-42ca-99ed-2e96031ab79a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:03.024392 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-413bea23-cc58-42ca-99ed-2e96031ab79a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:03.024889 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-413bea23-cc58-42ca-99ed-2e96031ab79a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:03.025316 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-413bea23-cc58-42ca-99ed-2e96031ab79a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:03.163840 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-413bea23-cc58-42ca-99ed-2e96031ab79a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:02:03.172397 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-413bea23-cc58-42ca-99ed-2e96031ab79a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0" status: 200 len: 1677 microversion: 2.1 time: 0.162498 Oct 26 14:02:03.172989 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3603/7228] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:02:03 2022] GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:02:03.195874 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5782ad14-c1d6-4011-b151-6b2dda6030ab tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:02:03.196561 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5782ad14-c1d6-4011-b151-6b2dda6030ab tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:02:03.202971 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5782ad14-c1d6-4011-b151-6b2dda6030ab tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:03.203476 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5782ad14-c1d6-4011-b151-6b2dda6030ab tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:03.203931 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5782ad14-c1d6-4011-b151-6b2dda6030ab tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:03.204647 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5782ad14-c1d6-4011-b151-6b2dda6030ab tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:03.205120 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5782ad14-c1d6-4011-b151-6b2dda6030ab tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:03.205596 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5782ad14-c1d6-4011-b151-6b2dda6030ab tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:03.265295 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5782ad14-c1d6-4011-b151-6b2dda6030ab tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "POST /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0/action" status: 204 len: 0 microversion: 2.1 time: 0.073439 Oct 26 14:02:03.266149 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3626/7229] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 14:02:03 2022] POST /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 14:02:03.275852 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-35c2b908-b6d4-4f82-bd67-32b45842d5fc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:02:03.277148 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-35c2b908-b6d4-4f82-bd67-32b45842d5fc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:02:03.283899 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-35c2b908-b6d4-4f82-bd67-32b45842d5fc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:03.284659 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-35c2b908-b6d4-4f82-bd67-32b45842d5fc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:03.285323 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-35c2b908-b6d4-4f82-bd67-32b45842d5fc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:03.286276 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-35c2b908-b6d4-4f82-bd67-32b45842d5fc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:03.286952 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-35c2b908-b6d4-4f82-bd67-32b45842d5fc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:03.287816 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-35c2b908-b6d4-4f82-bd67-32b45842d5fc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:03.427997 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-35c2b908-b6d4-4f82-bd67-32b45842d5fc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:02:03.436900 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-35c2b908-b6d4-4f82-bd67-32b45842d5fc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0" status: 200 len: 1677 microversion: 2.1 time: 0.166435 Oct 26 14:02:03.438434 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3604/7230] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:02:03 2022] GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:02:04.463556 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3351a8e0-bac7-4e55-a528-c436c02965dc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:02:04.464394 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3351a8e0-bac7-4e55-a528-c436c02965dc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:02:04.471132 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3351a8e0-bac7-4e55-a528-c436c02965dc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:04.471644 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3351a8e0-bac7-4e55-a528-c436c02965dc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:04.472105 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3351a8e0-bac7-4e55-a528-c436c02965dc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:04.472837 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3351a8e0-bac7-4e55-a528-c436c02965dc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:04.473310 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3351a8e0-bac7-4e55-a528-c436c02965dc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:04.473784 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3351a8e0-bac7-4e55-a528-c436c02965dc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:04.620996 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3351a8e0-bac7-4e55-a528-c436c02965dc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:02:04.630560 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3351a8e0-bac7-4e55-a528-c436c02965dc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0" status: 200 len: 1677 microversion: 2.1 time: 0.172580 Oct 26 14:02:04.648470 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3627/7231] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:02:04 2022] GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 => generated 1677 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:02:05.655702 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e0662b56-d9e6-4148-9ea0-1dc5df54d817 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:02:05.656249 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e0662b56-d9e6-4148-9ea0-1dc5df54d817 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:02:05.663769 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e0662b56-d9e6-4148-9ea0-1dc5df54d817 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:05.664256 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e0662b56-d9e6-4148-9ea0-1dc5df54d817 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:05.664698 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e0662b56-d9e6-4148-9ea0-1dc5df54d817 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:05.665454 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e0662b56-d9e6-4148-9ea0-1dc5df54d817 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:05.665948 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e0662b56-d9e6-4148-9ea0-1dc5df54d817 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:05.666375 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e0662b56-d9e6-4148-9ea0-1dc5df54d817 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:05.793906 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e0662b56-d9e6-4148-9ea0-1dc5df54d817 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:02:05.801707 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e0662b56-d9e6-4148-9ea0-1dc5df54d817 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0" status: 200 len: 1656 microversion: 2.1 time: 0.149986 Oct 26 14:02:05.802280 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3605/7232] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:02:05 2022] GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 => generated 1656 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 14:02:05.824856 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-dbd34996-0241-4e55-9b45-6552759f8f75 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:02:05.825501 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-dbd34996-0241-4e55-9b45-6552759f8f75 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:02:05.832438 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dbd34996-0241-4e55-9b45-6552759f8f75 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:05.832926 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dbd34996-0241-4e55-9b45-6552759f8f75 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:05.833373 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dbd34996-0241-4e55-9b45-6552759f8f75 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:05.834099 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dbd34996-0241-4e55-9b45-6552759f8f75 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:05.834563 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dbd34996-0241-4e55-9b45-6552759f8f75 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:05.834996 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dbd34996-0241-4e55-9b45-6552759f8f75 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:05.966812 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-dbd34996-0241-4e55-9b45-6552759f8f75 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:02:05.974557 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-dbd34996-0241-4e55-9b45-6552759f8f75 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0" status: 200 len: 1656 microversion: 2.1 time: 0.154301 Oct 26 14:02:05.975122 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3628/7233] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:02:05 2022] GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 => generated 1656 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:02:05.997309 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5d5d876c-eb79-45a0-831c-68de4e62dda4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:02:06.003322 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d5d876c-eb79-45a0-831c-68de4e62dda4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:06.003797 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d5d876c-eb79-45a0-831c-68de4e62dda4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:06.004227 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d5d876c-eb79-45a0-831c-68de4e62dda4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:06.026733 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5d5d876c-eb79-45a0-831c-68de4e62dda4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] Going to try to start instance {{(pid=120597) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 26 14:02:06.069940 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5d5d876c-eb79-45a0-831c-68de4e62dda4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "POST /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0/action" status: 202 len: 0 microversion: 2.1 time: 0.076905 Oct 26 14:02:06.070540 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3606/7234] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 14:02:05 2022] POST /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 14:02:06.079555 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d96e3e20-1da7-4fac-ae27-dc8955c46e97 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:02:06.080313 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d96e3e20-1da7-4fac-ae27-dc8955c46e97 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:02:06.086525 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d96e3e20-1da7-4fac-ae27-dc8955c46e97 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:06.087491 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d96e3e20-1da7-4fac-ae27-dc8955c46e97 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:06.087491 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d96e3e20-1da7-4fac-ae27-dc8955c46e97 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:06.088522 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d96e3e20-1da7-4fac-ae27-dc8955c46e97 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:06.088986 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d96e3e20-1da7-4fac-ae27-dc8955c46e97 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:06.089807 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d96e3e20-1da7-4fac-ae27-dc8955c46e97 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:06.276781 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d96e3e20-1da7-4fac-ae27-dc8955c46e97 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:02:06.285015 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d96e3e20-1da7-4fac-ae27-dc8955c46e97 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0" status: 200 len: 1665 microversion: 2.1 time: 0.209495 Oct 26 14:02:06.285610 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3629/7235] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:02:06 2022] GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 => generated 1665 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:02:06.579274 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-e23e5c75-533a-4bf8-b730-a661d66da3f9 req-8d35cf73-eba4-4c5c-9a10-54e58484c777 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ff5656c-f0da-4aa5-a2c2-bbc920567cf0", "name": "network-vif-plugged", "status": "completed", "tag": "6a04d7a5-d377-4315-985d-5f8288fcc399"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:02:06.589305 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-e23e5c75-533a-4bf8-b730-a661d66da3f9 req-8d35cf73-eba4-4c5c-9a10-54e58484c777 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:06.589822 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-e23e5c75-533a-4bf8-b730-a661d66da3f9 req-8d35cf73-eba4-4c5c-9a10-54e58484c777 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:06.590259 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-e23e5c75-533a-4bf8-b730-a661d66da3f9 req-8d35cf73-eba4-4c5c-9a10-54e58484c777 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:06.601637 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-e23e5c75-533a-4bf8-b730-a661d66da3f9 req-8d35cf73-eba4-4c5c-9a10-54e58484c777 service nova] Creating event network-vif-plugged:6a04d7a5-d377-4315-985d-5f8288fcc399 for instance 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 on n-h2-862686-1 Oct 26 14:02:06.607002 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-e23e5c75-533a-4bf8-b730-a661d66da3f9 req-8d35cf73-eba4-4c5c-9a10-54e58484c777 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095289 Oct 26 14:02:06.607610 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3607/7236] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:02:07.308794 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-22a91fed-a77b-49de-8c30-f48e7b749ca4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:02:07.309339 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-22a91fed-a77b-49de-8c30-f48e7b749ca4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:02:07.316793 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22a91fed-a77b-49de-8c30-f48e7b749ca4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:07.317288 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22a91fed-a77b-49de-8c30-f48e7b749ca4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:07.317757 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22a91fed-a77b-49de-8c30-f48e7b749ca4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:07.318461 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22a91fed-a77b-49de-8c30-f48e7b749ca4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:07.318926 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22a91fed-a77b-49de-8c30-f48e7b749ca4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:07.319360 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22a91fed-a77b-49de-8c30-f48e7b749ca4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:07.334387 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:02:07.451214 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-22a91fed-a77b-49de-8c30-f48e7b749ca4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:02:07.459767 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-22a91fed-a77b-49de-8c30-f48e7b749ca4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0" status: 200 len: 1669 microversion: 2.1 time: 0.155059 Oct 26 14:02:07.460338 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3630/7237] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:02:07 2022] GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 => generated 1669 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:02:07.484362 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-997d0947-117b-499c-a71a-2d3982fc5302 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:02:07.484950 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-997d0947-117b-499c-a71a-2d3982fc5302 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:02:07.491919 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-997d0947-117b-499c-a71a-2d3982fc5302 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:07.492402 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-997d0947-117b-499c-a71a-2d3982fc5302 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:07.492862 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-997d0947-117b-499c-a71a-2d3982fc5302 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:07.494098 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-997d0947-117b-499c-a71a-2d3982fc5302 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:07.494558 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-997d0947-117b-499c-a71a-2d3982fc5302 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:07.494983 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-997d0947-117b-499c-a71a-2d3982fc5302 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:07.513504 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:02:07.521924 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-997d0947-117b-499c-a71a-2d3982fc5302 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 14:02:07.599515 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-997d0947-117b-499c-a71a-2d3982fc5302 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0" status: 204 len: 0 microversion: 2.1 time: 0.119249 Oct 26 14:02:07.600108 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3608/7238] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 14:02:07 2022] DELETE /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 14:02:07.609738 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e3134c4c-4f63-432f-b7d2-0b8eea2dea78 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:02:07.610366 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e3134c4c-4f63-432f-b7d2-0b8eea2dea78 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:02:07.616380 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e3134c4c-4f63-432f-b7d2-0b8eea2dea78 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:07.616884 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e3134c4c-4f63-432f-b7d2-0b8eea2dea78 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:07.617339 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e3134c4c-4f63-432f-b7d2-0b8eea2dea78 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:07.618083 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e3134c4c-4f63-432f-b7d2-0b8eea2dea78 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:07.618667 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e3134c4c-4f63-432f-b7d2-0b8eea2dea78 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:07.619108 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e3134c4c-4f63-432f-b7d2-0b8eea2dea78 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:07.754243 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e3134c4c-4f63-432f-b7d2-0b8eea2dea78 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:02:07.762334 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e3134c4c-4f63-432f-b7d2-0b8eea2dea78 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0" status: 200 len: 1675 microversion: 2.1 time: 0.156613 Oct 26 14:02:07.762906 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3631/7239] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:02:07 2022] GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:02:08.785703 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bd771b62-2f3c-4004-9a07-13673f121dc5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:02:08.786512 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bd771b62-2f3c-4004-9a07-13673f121dc5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:02:08.793916 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd771b62-2f3c-4004-9a07-13673f121dc5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:08.794577 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd771b62-2f3c-4004-9a07-13673f121dc5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:08.795081 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd771b62-2f3c-4004-9a07-13673f121dc5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:08.795909 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd771b62-2f3c-4004-9a07-13673f121dc5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:08.796442 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd771b62-2f3c-4004-9a07-13673f121dc5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:08.796943 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd771b62-2f3c-4004-9a07-13673f121dc5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:08.933988 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bd771b62-2f3c-4004-9a07-13673f121dc5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:02:08.941785 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bd771b62-2f3c-4004-9a07-13673f121dc5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0" status: 200 len: 1675 microversion: 2.1 time: 0.160572 Oct 26 14:02:08.942356 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3609/7240] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:02:08 2022] GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:02:09.967445 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d03f2ec4-9e3e-4b7c-b17b-4caa55234aef tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:02:09.968288 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d03f2ec4-9e3e-4b7c-b17b-4caa55234aef tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:02:09.975464 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d03f2ec4-9e3e-4b7c-b17b-4caa55234aef tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:09.976315 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d03f2ec4-9e3e-4b7c-b17b-4caa55234aef tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:09.977009 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d03f2ec4-9e3e-4b7c-b17b-4caa55234aef tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:09.977911 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d03f2ec4-9e3e-4b7c-b17b-4caa55234aef tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:09.978479 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d03f2ec4-9e3e-4b7c-b17b-4caa55234aef tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:09.979149 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d03f2ec4-9e3e-4b7c-b17b-4caa55234aef tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:10.054536 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d03f2ec4-9e3e-4b7c-b17b-4caa55234aef tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:02:10.062911 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d03f2ec4-9e3e-4b7c-b17b-4caa55234aef tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0" status: 200 len: 1607 microversion: 2.1 time: 0.100307 Oct 26 14:02:10.063586 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3632/7241] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:02:09 2022] GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 => generated 1607 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:02:10.225112 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-92849e0c-a9e9-4583-9edf-375a3cea8c55 req-01508587-cf2e-4dae-ab16-fb8b7129c07a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ff5656c-f0da-4aa5-a2c2-bbc920567cf0", "name": "network-vif-deleted", "tag": "6a04d7a5-d377-4315-985d-5f8288fcc399"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:02:10.251332 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-92849e0c-a9e9-4583-9edf-375a3cea8c55 req-01508587-cf2e-4dae-ab16-fb8b7129c07a service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:10.251774 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-92849e0c-a9e9-4583-9edf-375a3cea8c55 req-01508587-cf2e-4dae-ab16-fb8b7129c07a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:10.252351 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-92849e0c-a9e9-4583-9edf-375a3cea8c55 req-01508587-cf2e-4dae-ab16-fb8b7129c07a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:10.269606 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-92849e0c-a9e9-4583-9edf-375a3cea8c55 req-01508587-cf2e-4dae-ab16-fb8b7129c07a service nova] Creating event network-vif-deleted:6a04d7a5-d377-4315-985d-5f8288fcc399 for instance 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 on n-h2-862686-1 Oct 26 14:02:10.275191 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-92849e0c-a9e9-4583-9edf-375a3cea8c55 req-01508587-cf2e-4dae-ab16-fb8b7129c07a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054154 Oct 26 14:02:10.275984 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3610/7242] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:02:11.086870 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d25de8ab-0b59-4a98-bb83-32291a9caee8 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:02:11.087497 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d25de8ab-0b59-4a98-bb83-32291a9caee8 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:02:11.094723 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d25de8ab-0b59-4a98-bb83-32291a9caee8 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:11.095222 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d25de8ab-0b59-4a98-bb83-32291a9caee8 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:11.095673 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d25de8ab-0b59-4a98-bb83-32291a9caee8 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:11.096419 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d25de8ab-0b59-4a98-bb83-32291a9caee8 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:11.096901 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d25de8ab-0b59-4a98-bb83-32291a9caee8 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:11.097345 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d25de8ab-0b59-4a98-bb83-32291a9caee8 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:11.111490 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-d25de8ab-0b59-4a98-bb83-32291a9caee8 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] HTTP exception thrown: Instance 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 could not be found. Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d25de8ab-0b59-4a98-bb83-32291a9caee8 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Request method failure captured: Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 HTTP/1.1 Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWT1KEf5RrnueWN8kvjsLURQZMRFC3vXj7EkFIPWPtwUH5p4vA-FoRCpopRC9DSlZE_HC0WGwzVujJC0KQhUWeAqCdZ-AE7FaQcXN_vov0P3H2esfpvK2-XfZnMMJsEhdmjY6sxfgyMT-XdJMLKubEhpiDdQ4UTp8oG--QBn1oDlg3bQ Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 73688cef84664d7db69a39fcbffb6e65 Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServerActionsTestJSON-646524856 Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/73688cef84664d7db69a39fcbffb6e65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/73688cef84664d7db69a39fcbffb6e65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_73688cef84664d7db69a39fcbffb6e65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/73688cef84664d7db69a39fcbffb6e65"}]}] Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServerActionsTestJSON-646524856 Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 73688cef84664d7db69a39fcbffb6e65 Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServerActionsTestJSON-646524856 Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServerActionsTestJSON-646524856-project Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: dc4fe5238edd40db8d203790e2aab143 Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServerActionsTestJSON-646524856-project Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 could not be found. Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '4ff5656c-f0da-4aa5-a2c2-bbc920567cf0'} Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 could not be found. Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 could not be found. Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:02:11.113319 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:02:11.117832 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:02:11.117832 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:02:11.117832 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:02:11.117832 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 14:02:11.117832 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 14:02:11.117832 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 could not be found. Oct 26 14:02:11.117832 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:02:11.117832 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d25de8ab-0b59-4a98-bb83-32291a9caee8 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Returning 404 to user: Instance 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 14:02:11.117832 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d25de8ab-0b59-4a98-bb83-32291a9caee8 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0" status: 404 len: 111 microversion: 2.1 time: 0.031910 Oct 26 14:02:11.117832 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3633/7243] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:02:11 2022] GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 14:02:11.136223 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0a78272d-9830-49d4-b585-958ca9d87229 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:02:11.137039 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0a78272d-9830-49d4-b585-958ca9d87229 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:02:11.143247 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0a78272d-9830-49d4-b585-958ca9d87229 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:11.143737 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0a78272d-9830-49d4-b585-958ca9d87229 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:11.144181 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0a78272d-9830-49d4-b585-958ca9d87229 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:11.144882 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0a78272d-9830-49d4-b585-958ca9d87229 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:11.145356 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0a78272d-9830-49d4-b585-958ca9d87229 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:11.145798 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0a78272d-9830-49d4-b585-958ca9d87229 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:11.159501 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-0a78272d-9830-49d4-b585-958ca9d87229 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] HTTP exception thrown: Instance 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 could not be found. Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0a78272d-9830-49d4-b585-958ca9d87229 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Request method failure captured: Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 HTTP/1.1 Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWT1KEf5RrnueWN8kvjsLURQZMRFC3vXj7EkFIPWPtwUH5p4vA-FoRCpopRC9DSlZE_HC0WGwzVujJC0KQhUWeAqCdZ-AE7FaQcXN_vov0P3H2esfpvK2-XfZnMMJsEhdmjY6sxfgyMT-XdJMLKubEhpiDdQ4UTp8oG--QBn1oDlg3bQ Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 73688cef84664d7db69a39fcbffb6e65 Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServerActionsTestJSON-646524856 Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/73688cef84664d7db69a39fcbffb6e65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/73688cef84664d7db69a39fcbffb6e65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_73688cef84664d7db69a39fcbffb6e65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/73688cef84664d7db69a39fcbffb6e65"}]}] Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServerActionsTestJSON-646524856 Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 73688cef84664d7db69a39fcbffb6e65 Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServerActionsTestJSON-646524856 Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServerActionsTestJSON-646524856-project Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: dc4fe5238edd40db8d203790e2aab143 Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServerActionsTestJSON-646524856-project Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 could not be found. Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '4ff5656c-f0da-4aa5-a2c2-bbc920567cf0'} Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 could not be found. Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 could not be found. Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:02:11.161142 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:02:11.166138 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:02:11.166138 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:02:11.166138 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:02:11.166138 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 14:02:11.166138 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 14:02:11.166138 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 could not be found. Oct 26 14:02:11.166138 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:02:11.166138 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0a78272d-9830-49d4-b585-958ca9d87229 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Returning 404 to user: Instance 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 14:02:11.166138 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0a78272d-9830-49d4-b585-958ca9d87229 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0" status: 404 len: 111 microversion: 2.1 time: 0.031739 Oct 26 14:02:11.166138 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3611/7244] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:02:11 2022] GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 14:02:11.217081 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b021598c-04fc-4636-a0c6-1fdd2b137a19 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-427716362", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "2cd9056a-bda2-4cf3-a05f-b03f797a2eee"}], "security_groups": [{"name": "tempest-securitygroup--2110277177"}], "key_name": "tempest-keypair-908741287", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:02:11.326503 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-b021598c-04fc-4636-a0c6-1fdd2b137a19 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] validate_networks() for [('2cd9056a-bda2-4cf3-a05f-b03f797a2eee', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 14:02:11.797798 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-b021598c-04fc-4636-a0c6-1fdd2b137a19 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 14:02:11.798231 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-b021598c-04fc-4636-a0c6-1fdd2b137a19 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 14:02:11.798714 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-b021598c-04fc-4636-a0c6-1fdd2b137a19 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 14:02:11.799161 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-b021598c-04fc-4636-a0c6-1fdd2b137a19 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 14:02:11.799610 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-b021598c-04fc-4636-a0c6-1fdd2b137a19 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 14:02:11.811385 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b021598c-04fc-4636-a0c6-1fdd2b137a19 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:11.811914 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b021598c-04fc-4636-a0c6-1fdd2b137a19 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:11.812366 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b021598c-04fc-4636-a0c6-1fdd2b137a19 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:11.813140 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b021598c-04fc-4636-a0c6-1fdd2b137a19 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:11.813644 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b021598c-04fc-4636-a0c6-1fdd2b137a19 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:11.814088 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b021598c-04fc-4636-a0c6-1fdd2b137a19 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:11.833507 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-b021598c-04fc-4636-a0c6-1fdd2b137a19 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Getting quotas for project 73688cef84664d7db69a39fcbffb6e65. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 14:02:11.839413 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-b021598c-04fc-4636-a0c6-1fdd2b137a19 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Getting quotas for user dc4fe5238edd40db8d203790e2aab143 and project 73688cef84664d7db69a39fcbffb6e65. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 14:02:11.851742 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b021598c-04fc-4636-a0c6-1fdd2b137a19 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 14:02:11.854837 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b021598c-04fc-4636-a0c6-1fdd2b137a19 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 14:02:11.901682 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b021598c-04fc-4636-a0c6-1fdd2b137a19 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.688458 Oct 26 14:02:11.902337 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3634/7245] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 14:02:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 14:02:11.914182 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-25f9ac80-425f-4da0-91ff-088d0fb0ae62 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:02:11.914802 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-25f9ac80-425f-4da0-91ff-088d0fb0ae62 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:02:11.970236 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-25f9ac80-425f-4da0-91ff-088d0fb0ae62 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:02:11.981533 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-25f9ac80-425f-4da0-91ff-088d0fb0ae62 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9" status: 200 len: 1237 microversion: 2.1 time: 0.071227 Oct 26 14:02:11.982293 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3612/7246] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:02:11 2022] GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9 => generated 1237 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:02:13.005504 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3f6a120c-bcd0-47f5-bf0f-630ef14e7155 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:02:13.006500 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3f6a120c-bcd0-47f5-bf0f-630ef14e7155 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:02:13.014664 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3f6a120c-bcd0-47f5-bf0f-630ef14e7155 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:13.015175 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3f6a120c-bcd0-47f5-bf0f-630ef14e7155 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:13.015853 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3f6a120c-bcd0-47f5-bf0f-630ef14e7155 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:13.016623 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3f6a120c-bcd0-47f5-bf0f-630ef14e7155 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:13.017100 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3f6a120c-bcd0-47f5-bf0f-630ef14e7155 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:13.017744 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3f6a120c-bcd0-47f5-bf0f-630ef14e7155 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:13.108455 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3f6a120c-bcd0-47f5-bf0f-630ef14e7155 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:02:13.116250 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3f6a120c-bcd0-47f5-bf0f-630ef14e7155 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9" status: 200 len: 1297 microversion: 2.1 time: 0.115920 Oct 26 14:02:13.116830 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3635/7247] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:02:12 2022] GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9 => generated 1297 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:02:14.140987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-34d6b7ce-6a34-4c45-8ae3-1e2c7f77dec2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:02:14.141635 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-34d6b7ce-6a34-4c45-8ae3-1e2c7f77dec2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:02:14.148803 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-34d6b7ce-6a34-4c45-8ae3-1e2c7f77dec2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:14.149295 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-34d6b7ce-6a34-4c45-8ae3-1e2c7f77dec2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:14.149771 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-34d6b7ce-6a34-4c45-8ae3-1e2c7f77dec2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:14.150515 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-34d6b7ce-6a34-4c45-8ae3-1e2c7f77dec2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:14.151066 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-34d6b7ce-6a34-4c45-8ae3-1e2c7f77dec2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:14.151498 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-34d6b7ce-6a34-4c45-8ae3-1e2c7f77dec2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:14.292206 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-34d6b7ce-6a34-4c45-8ae3-1e2c7f77dec2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:02:14.300134 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-34d6b7ce-6a34-4c45-8ae3-1e2c7f77dec2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9" status: 200 len: 1363 microversion: 2.1 time: 0.163199 Oct 26 14:02:14.300826 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3613/7248] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:02:14 2022] GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:02:14.366004 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-e4f44ba9-094f-4e5f-8a59-a6526655b418 req-a390baef-bb51-49ee-a856-ad71dbab416e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81783e43-115f-4ce7-a164-0020ff0e37a9", "tag": "46054f94-a6e7-4ac4-b884-657a7f0b0efd"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:02:14.378813 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e4f44ba9-094f-4e5f-8a59-a6526655b418 req-a390baef-bb51-49ee-a856-ad71dbab416e service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:14.379493 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e4f44ba9-094f-4e5f-8a59-a6526655b418 req-a390baef-bb51-49ee-a856-ad71dbab416e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:14.380103 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e4f44ba9-094f-4e5f-8a59-a6526655b418 req-a390baef-bb51-49ee-a856-ad71dbab416e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:14.394487 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-e4f44ba9-094f-4e5f-8a59-a6526655b418 req-a390baef-bb51-49ee-a856-ad71dbab416e service nova] Creating event network-changed:46054f94-a6e7-4ac4-b884-657a7f0b0efd for instance 81783e43-115f-4ce7-a164-0020ff0e37a9 on n-h1-862686-1 Oct 26 14:02:14.401655 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-e4f44ba9-094f-4e5f-8a59-a6526655b418 req-a390baef-bb51-49ee-a856-ad71dbab416e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038986 Oct 26 14:02:14.402521 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3636/7249] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:02:15.324231 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7e1606c7-19c0-41e0-bb20-10f393483fdd tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:02:15.324833 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7e1606c7-19c0-41e0-bb20-10f393483fdd tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:02:15.327643 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:02:15.333072 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e1606c7-19c0-41e0-bb20-10f393483fdd tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:15.333578 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e1606c7-19c0-41e0-bb20-10f393483fdd tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:15.334016 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e1606c7-19c0-41e0-bb20-10f393483fdd tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:15.334701 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e1606c7-19c0-41e0-bb20-10f393483fdd tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:15.335152 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e1606c7-19c0-41e0-bb20-10f393483fdd tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:15.335575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e1606c7-19c0-41e0-bb20-10f393483fdd tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:15.469627 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7e1606c7-19c0-41e0-bb20-10f393483fdd tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:02:15.477572 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7e1606c7-19c0-41e0-bb20-10f393483fdd tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9" status: 200 len: 1363 microversion: 2.1 time: 0.157469 Oct 26 14:02:15.478150 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3614/7250] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:02:15 2022] GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:02:16.502694 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f7d1c260-f69b-4541-987f-2b6ca93873cc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:02:16.503351 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f7d1c260-f69b-4541-987f-2b6ca93873cc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:02:16.505316 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:02:16.511833 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7d1c260-f69b-4541-987f-2b6ca93873cc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:16.512333 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7d1c260-f69b-4541-987f-2b6ca93873cc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:16.512817 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7d1c260-f69b-4541-987f-2b6ca93873cc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:16.513558 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7d1c260-f69b-4541-987f-2b6ca93873cc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:16.514028 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7d1c260-f69b-4541-987f-2b6ca93873cc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:16.514466 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f7d1c260-f69b-4541-987f-2b6ca93873cc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:16.650863 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f7d1c260-f69b-4541-987f-2b6ca93873cc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:02:16.658924 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f7d1c260-f69b-4541-987f-2b6ca93873cc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9" status: 200 len: 1363 microversion: 2.1 time: 0.161242 Oct 26 14:02:16.659501 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3637/7251] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:02:16 2022] GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:02:17.683515 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a8f8de03-a72d-4f0c-a012-da6b6b621f68 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:02:17.684108 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a8f8de03-a72d-4f0c-a012-da6b6b621f68 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:02:17.690925 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8f8de03-a72d-4f0c-a012-da6b6b621f68 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:17.691408 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8f8de03-a72d-4f0c-a012-da6b6b621f68 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:17.691845 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8f8de03-a72d-4f0c-a012-da6b6b621f68 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:17.692534 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8f8de03-a72d-4f0c-a012-da6b6b621f68 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:17.692988 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8f8de03-a72d-4f0c-a012-da6b6b621f68 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:17.693415 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8f8de03-a72d-4f0c-a012-da6b6b621f68 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:17.828144 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a8f8de03-a72d-4f0c-a012-da6b6b621f68 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:02:17.835920 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a8f8de03-a72d-4f0c-a012-da6b6b621f68 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9" status: 200 len: 1363 microversion: 2.1 time: 0.157190 Oct 26 14:02:17.836497 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3615/7252] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:02:17 2022] GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:02:18.860384 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-946c48c7-4a2c-47b4-ae5b-55339a91897b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:02:18.861031 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-946c48c7-4a2c-47b4-ae5b-55339a91897b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:02:18.868073 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-946c48c7-4a2c-47b4-ae5b-55339a91897b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:18.868649 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-946c48c7-4a2c-47b4-ae5b-55339a91897b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:18.869725 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-946c48c7-4a2c-47b4-ae5b-55339a91897b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:18.870442 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-946c48c7-4a2c-47b4-ae5b-55339a91897b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:18.870913 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-946c48c7-4a2c-47b4-ae5b-55339a91897b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:18.871371 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-946c48c7-4a2c-47b4-ae5b-55339a91897b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:19.000716 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-946c48c7-4a2c-47b4-ae5b-55339a91897b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:02:19.008372 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-946c48c7-4a2c-47b4-ae5b-55339a91897b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9" status: 200 len: 1363 microversion: 2.1 time: 0.151999 Oct 26 14:02:19.008941 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3638/7253] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:02:18 2022] GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:02:20.032428 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bbbf545c-e0e9-44bf-9b36-a30bb2307bda tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:02:20.033046 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bbbf545c-e0e9-44bf-9b36-a30bb2307bda tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:02:20.040138 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bbbf545c-e0e9-44bf-9b36-a30bb2307bda tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:20.040684 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bbbf545c-e0e9-44bf-9b36-a30bb2307bda tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:20.041131 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bbbf545c-e0e9-44bf-9b36-a30bb2307bda tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:20.041868 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bbbf545c-e0e9-44bf-9b36-a30bb2307bda tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:20.042331 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bbbf545c-e0e9-44bf-9b36-a30bb2307bda tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:20.042760 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bbbf545c-e0e9-44bf-9b36-a30bb2307bda tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:20.178629 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bbbf545c-e0e9-44bf-9b36-a30bb2307bda tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:02:20.187374 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bbbf545c-e0e9-44bf-9b36-a30bb2307bda tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9" status: 200 len: 1363 microversion: 2.1 time: 0.159634 Oct 26 14:02:20.187958 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3616/7254] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:02:20 2022] GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:02:20.197587 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-1fc747c9-f1b1-431d-9e97-d92f06273c9f req-382c1525-131b-4795-a62f-b1eb0665b774 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81783e43-115f-4ce7-a164-0020ff0e37a9", "name": "network-vif-plugged", "status": "completed", "tag": "46054f94-a6e7-4ac4-b884-657a7f0b0efd"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:02:20.207864 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-1fc747c9-f1b1-431d-9e97-d92f06273c9f req-382c1525-131b-4795-a62f-b1eb0665b774 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:20.208350 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-1fc747c9-f1b1-431d-9e97-d92f06273c9f req-382c1525-131b-4795-a62f-b1eb0665b774 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:20.208799 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-1fc747c9-f1b1-431d-9e97-d92f06273c9f req-382c1525-131b-4795-a62f-b1eb0665b774 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:20.223297 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-1fc747c9-f1b1-431d-9e97-d92f06273c9f req-382c1525-131b-4795-a62f-b1eb0665b774 service nova] Creating event network-vif-plugged:46054f94-a6e7-4ac4-b884-657a7f0b0efd for instance 81783e43-115f-4ce7-a164-0020ff0e37a9 on n-h1-862686-1 Oct 26 14:02:20.228797 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-1fc747c9-f1b1-431d-9e97-d92f06273c9f req-382c1525-131b-4795-a62f-b1eb0665b774 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036356 Oct 26 14:02:20.229646 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3639/7255] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:02:21.211025 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d2681693-1f1f-4a01-9271-2246f670a344 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:02:21.211595 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d2681693-1f1f-4a01-9271-2246f670a344 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:02:21.219466 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d2681693-1f1f-4a01-9271-2246f670a344 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:21.219962 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d2681693-1f1f-4a01-9271-2246f670a344 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:21.220410 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d2681693-1f1f-4a01-9271-2246f670a344 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:21.221136 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d2681693-1f1f-4a01-9271-2246f670a344 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:21.221664 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d2681693-1f1f-4a01-9271-2246f670a344 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:21.222103 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d2681693-1f1f-4a01-9271-2246f670a344 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:21.350884 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d2681693-1f1f-4a01-9271-2246f670a344 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:02:21.359402 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d2681693-1f1f-4a01-9271-2246f670a344 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9" status: 200 len: 1363 microversion: 2.1 time: 0.152282 Oct 26 14:02:21.359973 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3617/7256] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:02:21 2022] GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:02:22.381617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:02:22.382396 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:02:22.387727 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6de44e41-15fc-4829-b2ac-3dceecca35a5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:02:22.388447 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6de44e41-15fc-4829-b2ac-3dceecca35a5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:02:22.395433 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6de44e41-15fc-4829-b2ac-3dceecca35a5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:22.395936 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6de44e41-15fc-4829-b2ac-3dceecca35a5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:22.396393 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6de44e41-15fc-4829-b2ac-3dceecca35a5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:22.397102 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6de44e41-15fc-4829-b2ac-3dceecca35a5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:22.397613 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6de44e41-15fc-4829-b2ac-3dceecca35a5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:22.398059 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6de44e41-15fc-4829-b2ac-3dceecca35a5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:22.528450 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6de44e41-15fc-4829-b2ac-3dceecca35a5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:02:22.536552 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6de44e41-15fc-4829-b2ac-3dceecca35a5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9" status: 200 len: 1550 microversion: 2.1 time: 0.156811 Oct 26 14:02:22.537129 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3640/7257] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:02:22 2022] GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9 => generated 1550 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:02:22.559802 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1e84c02b-bacb-4ac3-8883-9aa624a403f8 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:02:22.560296 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1e84c02b-bacb-4ac3-8883-9aa624a403f8 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:02:22.562347 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:02:22.568365 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1e84c02b-bacb-4ac3-8883-9aa624a403f8 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:22.568848 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1e84c02b-bacb-4ac3-8883-9aa624a403f8 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:22.569288 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1e84c02b-bacb-4ac3-8883-9aa624a403f8 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:22.570021 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1e84c02b-bacb-4ac3-8883-9aa624a403f8 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:22.570511 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1e84c02b-bacb-4ac3-8883-9aa624a403f8 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:22.570945 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1e84c02b-bacb-4ac3-8883-9aa624a403f8 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:22.646707 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1e84c02b-bacb-4ac3-8883-9aa624a403f8 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091304 Oct 26 14:02:22.647319 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3618/7258] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 26 14:02:22 2022] GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:02:23.584499 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-b9aea2dc-ed4b-46c7-a0aa-299b6e155918 req-fad5b628-5b0c-4acb-88ab-7e5391ea63aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81783e43-115f-4ce7-a164-0020ff0e37a9", "tag": "46054f94-a6e7-4ac4-b884-657a7f0b0efd"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:02:23.596134 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b9aea2dc-ed4b-46c7-a0aa-299b6e155918 req-fad5b628-5b0c-4acb-88ab-7e5391ea63aa service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:23.596623 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b9aea2dc-ed4b-46c7-a0aa-299b6e155918 req-fad5b628-5b0c-4acb-88ab-7e5391ea63aa service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:23.597066 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b9aea2dc-ed4b-46c7-a0aa-299b6e155918 req-fad5b628-5b0c-4acb-88ab-7e5391ea63aa service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:23.608924 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-b9aea2dc-ed4b-46c7-a0aa-299b6e155918 req-fad5b628-5b0c-4acb-88ab-7e5391ea63aa service nova] Creating event network-changed:46054f94-a6e7-4ac4-b884-657a7f0b0efd for instance 81783e43-115f-4ce7-a164-0020ff0e37a9 on n-h1-862686-1 Oct 26 14:02:23.613954 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-b9aea2dc-ed4b-46c7-a0aa-299b6e155918 req-fad5b628-5b0c-4acb-88ab-7e5391ea63aa service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033126 Oct 26 14:02:23.614632 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3641/7259] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:02:56.654401 n-d-862686-1 devstack@n-api.service[120597]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 14:02:56.654974 n-d-862686-1 devstack@n-api.service[120597]: Wed Oct 26 14:02:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9/action (ip 10.222.0.40) !!! Oct 26 14:02:56.655597 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=9 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:02:56.656415 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:02:56.660612 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4202794a-5907-443c-9cf9-3f7c60ac0061 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:02:56.662827 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4202794a-5907-443c-9cf9-3f7c60ac0061 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:02:56.679043 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4202794a-5907-443c-9cf9-3f7c60ac0061 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:56.679527 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4202794a-5907-443c-9cf9-3f7c60ac0061 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:56.679963 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4202794a-5907-443c-9cf9-3f7c60ac0061 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:56.680656 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4202794a-5907-443c-9cf9-3f7c60ac0061 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:56.681110 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4202794a-5907-443c-9cf9-3f7c60ac0061 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:56.682043 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4202794a-5907-443c-9cf9-3f7c60ac0061 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:56.709535 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4202794a-5907-443c-9cf9-3f7c60ac0061 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:02:56.715060 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4202794a-5907-443c-9cf9-3f7c60ac0061 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] Old instance type m1.heat2, new instance type m1.heat {{(pid=120597) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 26 14:02:56.721403 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-4202794a-5907-443c-9cf9-3f7c60ac0061 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 14:02:56.721849 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-4202794a-5907-443c-9cf9-3f7c60ac0061 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 14:02:56.722318 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-4202794a-5907-443c-9cf9-3f7c60ac0061 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 14:02:56.722729 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-4202794a-5907-443c-9cf9-3f7c60ac0061 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 14:02:56.723133 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-4202794a-5907-443c-9cf9-3f7c60ac0061 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 14:02:56.787487 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4202794a-5907-443c-9cf9-3f7c60ac0061 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "POST /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9/action" status: 202 len: 0 microversion: 2.1 time: 0.135731 Oct 26 14:02:56.788111 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3619/7260] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 14:02:56 2022] POST /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 14:02:56.795476 n-d-862686-1 devstack@n-api.service[120598]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 14:02:56.795987 n-d-862686-1 devstack@n-api.service[120598]: Wed Oct 26 14:02:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9 (ip 10.222.0.40) !!! Oct 26 14:02:56.797421 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=9 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:02:56.798320 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=49 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:02:56.802529 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1268eb53-41f1-4331-8d19-bf8b1ac4fbb6 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:02:56.803245 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1268eb53-41f1-4331-8d19-bf8b1ac4fbb6 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:02:56.814936 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1268eb53-41f1-4331-8d19-bf8b1ac4fbb6 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:56.815435 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1268eb53-41f1-4331-8d19-bf8b1ac4fbb6 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:56.815882 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1268eb53-41f1-4331-8d19-bf8b1ac4fbb6 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:56.816607 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1268eb53-41f1-4331-8d19-bf8b1ac4fbb6 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:56.817086 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1268eb53-41f1-4331-8d19-bf8b1ac4fbb6 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:56.817610 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1268eb53-41f1-4331-8d19-bf8b1ac4fbb6 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:56.984713 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1268eb53-41f1-4331-8d19-bf8b1ac4fbb6 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:02:56.992667 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1268eb53-41f1-4331-8d19-bf8b1ac4fbb6 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9" status: 200 len: 1678 microversion: 2.1 time: 0.199916 Oct 26 14:02:56.993200 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3642/7261] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:02:56 2022] GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9 => generated 1678 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:02:58.021601 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3231d9fc-9ee3-4101-ba01-2379894be7d2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:02:58.022221 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3231d9fc-9ee3-4101-ba01-2379894be7d2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:02:58.032760 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3231d9fc-9ee3-4101-ba01-2379894be7d2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:58.033279 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3231d9fc-9ee3-4101-ba01-2379894be7d2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:58.034011 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3231d9fc-9ee3-4101-ba01-2379894be7d2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:58.034710 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3231d9fc-9ee3-4101-ba01-2379894be7d2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:58.035169 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3231d9fc-9ee3-4101-ba01-2379894be7d2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:58.035597 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3231d9fc-9ee3-4101-ba01-2379894be7d2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:58.182458 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3231d9fc-9ee3-4101-ba01-2379894be7d2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:02:58.190241 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3231d9fc-9ee3-4101-ba01-2379894be7d2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9" status: 200 len: 1678 microversion: 2.1 time: 0.173443 Oct 26 14:02:58.190814 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3620/7262] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:02:58 2022] GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9 => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:02:59.213863 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d22e01a3-0660-4476-9842-45798d69ce60 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:02:59.214413 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d22e01a3-0660-4476-9842-45798d69ce60 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:02:59.223447 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d22e01a3-0660-4476-9842-45798d69ce60 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:59.223953 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d22e01a3-0660-4476-9842-45798d69ce60 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:59.224406 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d22e01a3-0660-4476-9842-45798d69ce60 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:59.225119 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d22e01a3-0660-4476-9842-45798d69ce60 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:02:59.225626 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d22e01a3-0660-4476-9842-45798d69ce60 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:02:59.226069 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d22e01a3-0660-4476-9842-45798d69ce60 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:02:59.359835 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d22e01a3-0660-4476-9842-45798d69ce60 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:02:59.367809 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d22e01a3-0660-4476-9842-45798d69ce60 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9" status: 200 len: 1683 microversion: 2.1 time: 0.158200 Oct 26 14:02:59.368377 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3643/7263] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:02:59 2022] GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:03:00.392568 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-af5f2e08-6e80-442e-8c32-a33b9f338a50 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:03:00.393215 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-af5f2e08-6e80-442e-8c32-a33b9f338a50 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:03:00.401080 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af5f2e08-6e80-442e-8c32-a33b9f338a50 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:00.401599 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af5f2e08-6e80-442e-8c32-a33b9f338a50 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:00.402048 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af5f2e08-6e80-442e-8c32-a33b9f338a50 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:00.402750 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af5f2e08-6e80-442e-8c32-a33b9f338a50 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:00.403211 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af5f2e08-6e80-442e-8c32-a33b9f338a50 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:00.403646 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af5f2e08-6e80-442e-8c32-a33b9f338a50 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:00.537225 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-af5f2e08-6e80-442e-8c32-a33b9f338a50 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:03:00.544900 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-af5f2e08-6e80-442e-8c32-a33b9f338a50 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9" status: 200 len: 1683 microversion: 2.1 time: 0.156535 Oct 26 14:03:00.545469 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3621/7264] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:03:00 2022] GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:03:01.568593 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-08eff2f3-b105-4296-a674-8b01e6e87bb8 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:03:01.569254 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-08eff2f3-b105-4296-a674-8b01e6e87bb8 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:03:01.578969 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-08eff2f3-b105-4296-a674-8b01e6e87bb8 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:01.579469 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-08eff2f3-b105-4296-a674-8b01e6e87bb8 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:01.579925 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-08eff2f3-b105-4296-a674-8b01e6e87bb8 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:01.580648 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-08eff2f3-b105-4296-a674-8b01e6e87bb8 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:01.581108 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-08eff2f3-b105-4296-a674-8b01e6e87bb8 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:01.581586 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-08eff2f3-b105-4296-a674-8b01e6e87bb8 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:01.712023 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-08eff2f3-b105-4296-a674-8b01e6e87bb8 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:03:01.720139 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-08eff2f3-b105-4296-a674-8b01e6e87bb8 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9" status: 200 len: 1683 microversion: 2.1 time: 0.155551 Oct 26 14:03:01.720708 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3644/7265] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:03:01 2022] GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:03:02.744244 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1e42080b-f480-4f91-ac9f-13cb3e3f674d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:03:02.744846 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1e42080b-f480-4f91-ac9f-13cb3e3f674d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:03:02.751562 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1e42080b-f480-4f91-ac9f-13cb3e3f674d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:02.752044 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1e42080b-f480-4f91-ac9f-13cb3e3f674d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:02.752484 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1e42080b-f480-4f91-ac9f-13cb3e3f674d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:02.753171 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1e42080b-f480-4f91-ac9f-13cb3e3f674d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:02.753663 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1e42080b-f480-4f91-ac9f-13cb3e3f674d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:02.754090 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1e42080b-f480-4f91-ac9f-13cb3e3f674d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:02.887875 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1e42080b-f480-4f91-ac9f-13cb3e3f674d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:03:02.896166 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1e42080b-f480-4f91-ac9f-13cb3e3f674d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9" status: 200 len: 1683 microversion: 2.1 time: 0.155829 Oct 26 14:03:02.896742 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3622/7266] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:03:02 2022] GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:03:03.920715 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a283e001-2559-4953-87cf-670162746787 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:03:03.921350 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a283e001-2559-4953-87cf-670162746787 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:03:03.930305 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a283e001-2559-4953-87cf-670162746787 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:03.930796 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a283e001-2559-4953-87cf-670162746787 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:03.931249 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a283e001-2559-4953-87cf-670162746787 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:03.933090 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a283e001-2559-4953-87cf-670162746787 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:03.933586 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a283e001-2559-4953-87cf-670162746787 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:03.934031 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a283e001-2559-4953-87cf-670162746787 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:04.061035 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a283e001-2559-4953-87cf-670162746787 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:03:04.068768 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a283e001-2559-4953-87cf-670162746787 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9" status: 200 len: 1683 microversion: 2.1 time: 0.152985 Oct 26 14:03:04.069345 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3645/7267] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:03:03 2022] GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 14:03:05.092153 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f5ed922e-ec26-4fce-8df6-a9a73eb0425b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:03:05.092762 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f5ed922e-ec26-4fce-8df6-a9a73eb0425b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:03:05.099764 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f5ed922e-ec26-4fce-8df6-a9a73eb0425b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:05.100279 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f5ed922e-ec26-4fce-8df6-a9a73eb0425b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:05.100722 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f5ed922e-ec26-4fce-8df6-a9a73eb0425b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:05.101411 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f5ed922e-ec26-4fce-8df6-a9a73eb0425b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:05.101913 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f5ed922e-ec26-4fce-8df6-a9a73eb0425b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:05.102337 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f5ed922e-ec26-4fce-8df6-a9a73eb0425b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:05.228902 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f5ed922e-ec26-4fce-8df6-a9a73eb0425b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:03:05.236602 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f5ed922e-ec26-4fce-8df6-a9a73eb0425b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9" status: 200 len: 1683 microversion: 2.1 time: 0.148839 Oct 26 14:03:05.237173 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3623/7268] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:03:05 2022] GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9 => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:03:06.260923 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-df725a6d-bd68-4492-ad32-f309b05cc2c1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:03:06.261617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-df725a6d-bd68-4492-ad32-f309b05cc2c1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:03:06.268582 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df725a6d-bd68-4492-ad32-f309b05cc2c1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:06.269099 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df725a6d-bd68-4492-ad32-f309b05cc2c1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:06.269621 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df725a6d-bd68-4492-ad32-f309b05cc2c1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:06.270376 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df725a6d-bd68-4492-ad32-f309b05cc2c1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:06.270854 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df725a6d-bd68-4492-ad32-f309b05cc2c1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:06.271304 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df725a6d-bd68-4492-ad32-f309b05cc2c1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:06.411136 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-df725a6d-bd68-4492-ad32-f309b05cc2c1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:03:06.419016 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-df725a6d-bd68-4492-ad32-f309b05cc2c1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9" status: 200 len: 1683 microversion: 2.1 time: 0.162769 Oct 26 14:03:06.419602 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3646/7269] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:03:06 2022] GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9 => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:03:07.442744 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f0507d37-9031-473a-90da-61cafd16758d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:03:07.443409 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f0507d37-9031-473a-90da-61cafd16758d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:03:07.450535 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f0507d37-9031-473a-90da-61cafd16758d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:07.451026 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f0507d37-9031-473a-90da-61cafd16758d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:07.451473 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f0507d37-9031-473a-90da-61cafd16758d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:07.452175 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f0507d37-9031-473a-90da-61cafd16758d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:07.452640 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f0507d37-9031-473a-90da-61cafd16758d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:07.453077 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f0507d37-9031-473a-90da-61cafd16758d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:07.583888 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f0507d37-9031-473a-90da-61cafd16758d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:03:07.592549 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f0507d37-9031-473a-90da-61cafd16758d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9" status: 200 len: 1683 microversion: 2.1 time: 0.153837 Oct 26 14:03:07.593132 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3624/7270] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:03:07 2022] GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:03:08.615982 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b1d3324d-0d49-49f4-b4ae-f6b59430e372 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:03:08.616537 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b1d3324d-0d49-49f4-b4ae-f6b59430e372 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:03:08.624231 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1d3324d-0d49-49f4-b4ae-f6b59430e372 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:08.624733 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1d3324d-0d49-49f4-b4ae-f6b59430e372 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:08.625192 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1d3324d-0d49-49f4-b4ae-f6b59430e372 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:08.625931 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1d3324d-0d49-49f4-b4ae-f6b59430e372 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:08.626406 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1d3324d-0d49-49f4-b4ae-f6b59430e372 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:08.626851 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1d3324d-0d49-49f4-b4ae-f6b59430e372 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:08.756729 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b1d3324d-0d49-49f4-b4ae-f6b59430e372 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:03:08.764483 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b1d3324d-0d49-49f4-b4ae-f6b59430e372 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9" status: 200 len: 1683 microversion: 2.1 time: 0.152555 Oct 26 14:03:08.765060 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3647/7271] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:03:08 2022] GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:03:09.788730 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c45a73ca-5d88-47a0-8a9d-9da79d8bcaa6 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:03:09.789365 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c45a73ca-5d88-47a0-8a9d-9da79d8bcaa6 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:03:09.796839 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c45a73ca-5d88-47a0-8a9d-9da79d8bcaa6 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:09.797320 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c45a73ca-5d88-47a0-8a9d-9da79d8bcaa6 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:09.797798 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c45a73ca-5d88-47a0-8a9d-9da79d8bcaa6 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:09.798483 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c45a73ca-5d88-47a0-8a9d-9da79d8bcaa6 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:09.798934 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c45a73ca-5d88-47a0-8a9d-9da79d8bcaa6 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:09.799356 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c45a73ca-5d88-47a0-8a9d-9da79d8bcaa6 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:09.936149 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c45a73ca-5d88-47a0-8a9d-9da79d8bcaa6 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:03:09.943782 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c45a73ca-5d88-47a0-8a9d-9da79d8bcaa6 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9" status: 200 len: 1683 microversion: 2.1 time: 0.158955 Oct 26 14:03:09.944356 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3625/7272] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:03:09 2022] GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:03:10.968736 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ba33a302-b9ee-4f82-baf1-eabf42a36a17 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:03:10.969348 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ba33a302-b9ee-4f82-baf1-eabf42a36a17 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:03:10.976801 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ba33a302-b9ee-4f82-baf1-eabf42a36a17 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:10.977354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ba33a302-b9ee-4f82-baf1-eabf42a36a17 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:10.977859 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ba33a302-b9ee-4f82-baf1-eabf42a36a17 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:10.978622 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ba33a302-b9ee-4f82-baf1-eabf42a36a17 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:10.979109 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ba33a302-b9ee-4f82-baf1-eabf42a36a17 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:10.979555 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ba33a302-b9ee-4f82-baf1-eabf42a36a17 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:11.167142 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ba33a302-b9ee-4f82-baf1-eabf42a36a17 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:03:11.175735 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ba33a302-b9ee-4f82-baf1-eabf42a36a17 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9" status: 200 len: 1682 microversion: 2.1 time: 0.211625 Oct 26 14:03:11.176327 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3648/7273] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:03:10 2022] GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9 => generated 1682 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:03:11.480042 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-bf3054fe-6009-4db0-aff1-10c89548c495 req-9b534562-a6c8-46e1-aaac-9cd33726b67f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81783e43-115f-4ce7-a164-0020ff0e37a9", "name": "network-vif-unplugged", "status": "completed", "tag": "46054f94-a6e7-4ac4-b884-657a7f0b0efd"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:03:11.493052 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-bf3054fe-6009-4db0-aff1-10c89548c495 req-9b534562-a6c8-46e1-aaac-9cd33726b67f service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:11.493594 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-bf3054fe-6009-4db0-aff1-10c89548c495 req-9b534562-a6c8-46e1-aaac-9cd33726b67f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:11.494048 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-bf3054fe-6009-4db0-aff1-10c89548c495 req-9b534562-a6c8-46e1-aaac-9cd33726b67f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:11.506532 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-bf3054fe-6009-4db0-aff1-10c89548c495 req-9b534562-a6c8-46e1-aaac-9cd33726b67f service nova] Creating event network-vif-unplugged:46054f94-a6e7-4ac4-b884-657a7f0b0efd for instance 81783e43-115f-4ce7-a164-0020ff0e37a9 on n-h2-862686-1 Oct 26 14:03:11.512855 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [req-bf3054fe-6009-4db0-aff1-10c89548c495 req-9b534562-a6c8-46e1-aaac-9cd33726b67f service nova] Instance 81783e43-115f-4ce7-a164-0020ff0e37a9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862686-1', 'n-h1-862686-1'} {{(pid=120597) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 14:03:11.523371 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-bf3054fe-6009-4db0-aff1-10c89548c495 req-9b534562-a6c8-46e1-aaac-9cd33726b67f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047077 Oct 26 14:03:11.524186 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3626/7274] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:03:12.200038 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-dc81c632-9ddc-4a05-aa05-c1cace28d1a8 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:03:12.200661 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-dc81c632-9ddc-4a05-aa05-c1cace28d1a8 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:03:12.207502 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc81c632-9ddc-4a05-aa05-c1cace28d1a8 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:12.207998 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc81c632-9ddc-4a05-aa05-c1cace28d1a8 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:12.208453 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc81c632-9ddc-4a05-aa05-c1cace28d1a8 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:12.209163 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc81c632-9ddc-4a05-aa05-c1cace28d1a8 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:12.210330 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc81c632-9ddc-4a05-aa05-c1cace28d1a8 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:12.210775 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc81c632-9ddc-4a05-aa05-c1cace28d1a8 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:12.425503 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-dc81c632-9ddc-4a05-aa05-c1cace28d1a8 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:03:12.433961 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-dc81c632-9ddc-4a05-aa05-c1cace28d1a8 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9" status: 200 len: 1682 microversion: 2.1 time: 0.237827 Oct 26 14:03:12.434557 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3649/7275] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:03:12 2022] GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9 => generated 1682 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:03:13.459199 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c1eebc03-7c4a-4eea-b99b-2f2df36a8086 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:03:13.459903 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c1eebc03-7c4a-4eea-b99b-2f2df36a8086 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:03:13.466176 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c1eebc03-7c4a-4eea-b99b-2f2df36a8086 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:13.466838 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c1eebc03-7c4a-4eea-b99b-2f2df36a8086 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:13.467280 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c1eebc03-7c4a-4eea-b99b-2f2df36a8086 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:13.467976 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c1eebc03-7c4a-4eea-b99b-2f2df36a8086 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:13.468435 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c1eebc03-7c4a-4eea-b99b-2f2df36a8086 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:13.468866 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c1eebc03-7c4a-4eea-b99b-2f2df36a8086 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:13.566916 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-e2cc96fa-57d3-4cee-9f5d-499bae98971b req-4ad96d1b-479f-4446-a738-50c45b0c11c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81783e43-115f-4ce7-a164-0020ff0e37a9", "tag": "46054f94-a6e7-4ac4-b884-657a7f0b0efd"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:03:13.577774 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e2cc96fa-57d3-4cee-9f5d-499bae98971b req-4ad96d1b-479f-4446-a738-50c45b0c11c4 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:13.578272 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e2cc96fa-57d3-4cee-9f5d-499bae98971b req-4ad96d1b-479f-4446-a738-50c45b0c11c4 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:13.578718 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e2cc96fa-57d3-4cee-9f5d-499bae98971b req-4ad96d1b-479f-4446-a738-50c45b0c11c4 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:13.591501 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-e2cc96fa-57d3-4cee-9f5d-499bae98971b req-4ad96d1b-479f-4446-a738-50c45b0c11c4 service nova] Creating event network-changed:46054f94-a6e7-4ac4-b884-657a7f0b0efd for instance 81783e43-115f-4ce7-a164-0020ff0e37a9 on n-h2-862686-1 Oct 26 14:03:13.597228 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [req-e2cc96fa-57d3-4cee-9f5d-499bae98971b req-4ad96d1b-479f-4446-a738-50c45b0c11c4 service nova] Instance 81783e43-115f-4ce7-a164-0020ff0e37a9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862686-1', 'n-h1-862686-1'} {{(pid=120598) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 14:03:13.604851 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c1eebc03-7c4a-4eea-b99b-2f2df36a8086 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:03:13.612997 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-e2cc96fa-57d3-4cee-9f5d-499bae98971b req-4ad96d1b-479f-4446-a738-50c45b0c11c4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049649 Oct 26 14:03:13.613674 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c1eebc03-7c4a-4eea-b99b-2f2df36a8086 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9" status: 200 len: 1680 microversion: 2.1 time: 0.159544 Oct 26 14:03:13.613884 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3650/7276] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 14:03:13.619002 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3627/7277] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:03:13 2022] GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:03:14.641344 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ee459cdb-b58b-4728-a3db-81745aa790a1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:03:14.642592 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ee459cdb-b58b-4728-a3db-81745aa790a1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:03:14.648981 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee459cdb-b58b-4728-a3db-81745aa790a1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:14.649506 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee459cdb-b58b-4728-a3db-81745aa790a1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:14.649976 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee459cdb-b58b-4728-a3db-81745aa790a1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:14.650697 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee459cdb-b58b-4728-a3db-81745aa790a1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:14.651172 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee459cdb-b58b-4728-a3db-81745aa790a1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:14.651640 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee459cdb-b58b-4728-a3db-81745aa790a1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:14.882578 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ee459cdb-b58b-4728-a3db-81745aa790a1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:03:14.890891 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ee459cdb-b58b-4728-a3db-81745aa790a1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9" status: 200 len: 1677 microversion: 2.1 time: 0.255407 Oct 26 14:03:14.891477 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3651/7278] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:03:14 2022] GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9 => generated 1677 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:03:14.913893 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b54b7b65-d897-428a-818e-79d7d2d54668 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:03:14.914471 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b54b7b65-d897-428a-818e-79d7d2d54668 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:03:14.921900 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b54b7b65-d897-428a-818e-79d7d2d54668 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:14.922398 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b54b7b65-d897-428a-818e-79d7d2d54668 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:14.922845 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b54b7b65-d897-428a-818e-79d7d2d54668 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:14.923548 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b54b7b65-d897-428a-818e-79d7d2d54668 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:14.924014 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b54b7b65-d897-428a-818e-79d7d2d54668 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:14.924449 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b54b7b65-d897-428a-818e-79d7d2d54668 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:14.962059 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b54b7b65-d897-428a-818e-79d7d2d54668 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:14.962556 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b54b7b65-d897-428a-818e-79d7d2d54668 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:14.962997 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b54b7b65-d897-428a-818e-79d7d2d54668 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:14.963727 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b54b7b65-d897-428a-818e-79d7d2d54668 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:14.964193 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b54b7b65-d897-428a-818e-79d7d2d54668 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:14.964626 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b54b7b65-d897-428a-818e-79d7d2d54668 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:14.988636 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-b54b7b65-d897-428a-818e-79d7d2d54668 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Getting quotas for project 73688cef84664d7db69a39fcbffb6e65. Resources: {'cores', 'ram'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 14:03:14.994551 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-b54b7b65-d897-428a-818e-79d7d2d54668 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Getting quotas for user dc4fe5238edd40db8d203790e2aab143 and project 73688cef84664d7db69a39fcbffb6e65. Resources: {'cores', 'ram'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 14:03:15.095140 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b54b7b65-d897-428a-818e-79d7d2d54668 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "POST /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9/action" status: 202 len: 0 microversion: 2.1 time: 0.185047 Oct 26 14:03:15.095934 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3628/7279] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 14:03:14 2022] POST /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 14:03:15.104198 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c1d8abd5-4270-4b33-a69a-50aac1158116 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:03:15.104930 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c1d8abd5-4270-4b33-a69a-50aac1158116 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:03:15.111649 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c1d8abd5-4270-4b33-a69a-50aac1158116 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:15.112158 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c1d8abd5-4270-4b33-a69a-50aac1158116 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:15.112617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c1d8abd5-4270-4b33-a69a-50aac1158116 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:15.113410 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c1d8abd5-4270-4b33-a69a-50aac1158116 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:15.113916 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c1d8abd5-4270-4b33-a69a-50aac1158116 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:15.114431 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c1d8abd5-4270-4b33-a69a-50aac1158116 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:15.319877 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c1d8abd5-4270-4b33-a69a-50aac1158116 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:03:15.328015 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c1d8abd5-4270-4b33-a69a-50aac1158116 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9" status: 200 len: 1676 microversion: 2.1 time: 0.227769 Oct 26 14:03:15.328615 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3652/7280] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:03:15 2022] GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9 => generated 1676 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:03:16.353399 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-504aaf59-e347-4ca2-ab65-c1c17256b529 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:03:16.354133 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-504aaf59-e347-4ca2-ab65-c1c17256b529 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:03:16.362156 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-504aaf59-e347-4ca2-ab65-c1c17256b529 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:16.362745 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-504aaf59-e347-4ca2-ab65-c1c17256b529 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:16.363204 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-504aaf59-e347-4ca2-ab65-c1c17256b529 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:16.364016 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-504aaf59-e347-4ca2-ab65-c1c17256b529 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:16.364489 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-504aaf59-e347-4ca2-ab65-c1c17256b529 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:16.364917 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-504aaf59-e347-4ca2-ab65-c1c17256b529 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:16.497554 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-504aaf59-e347-4ca2-ab65-c1c17256b529 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:03:16.505325 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-504aaf59-e347-4ca2-ab65-c1c17256b529 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9" status: 200 len: 1676 microversion: 2.1 time: 0.157147 Oct 26 14:03:16.505927 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3629/7281] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:03:16 2022] GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:03:17.529470 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-857256da-94f4-4d76-8cc1-226cbb06ef75 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:03:17.530055 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-857256da-94f4-4d76-8cc1-226cbb06ef75 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:03:17.537069 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-857256da-94f4-4d76-8cc1-226cbb06ef75 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:17.537597 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-857256da-94f4-4d76-8cc1-226cbb06ef75 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:17.538047 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-857256da-94f4-4d76-8cc1-226cbb06ef75 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:17.538749 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-857256da-94f4-4d76-8cc1-226cbb06ef75 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:17.539222 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-857256da-94f4-4d76-8cc1-226cbb06ef75 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:17.539661 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-857256da-94f4-4d76-8cc1-226cbb06ef75 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:17.678866 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-857256da-94f4-4d76-8cc1-226cbb06ef75 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:03:17.688079 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-857256da-94f4-4d76-8cc1-226cbb06ef75 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9" status: 200 len: 1676 microversion: 2.1 time: 0.162800 Oct 26 14:03:17.688757 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3653/7282] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:03:17 2022] GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9 => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:03:18.712780 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-81ac6563-ed3a-4fe8-b36e-0ec1e8ecdc24 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:03:18.713310 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-81ac6563-ed3a-4fe8-b36e-0ec1e8ecdc24 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:03:18.721286 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81ac6563-ed3a-4fe8-b36e-0ec1e8ecdc24 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:18.721821 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81ac6563-ed3a-4fe8-b36e-0ec1e8ecdc24 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:18.722265 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81ac6563-ed3a-4fe8-b36e-0ec1e8ecdc24 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:18.722969 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81ac6563-ed3a-4fe8-b36e-0ec1e8ecdc24 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:18.723424 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81ac6563-ed3a-4fe8-b36e-0ec1e8ecdc24 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:18.723878 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-81ac6563-ed3a-4fe8-b36e-0ec1e8ecdc24 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:18.879658 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-81ac6563-ed3a-4fe8-b36e-0ec1e8ecdc24 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:03:18.889281 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-81ac6563-ed3a-4fe8-b36e-0ec1e8ecdc24 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9" status: 200 len: 1676 microversion: 2.1 time: 0.180432 Oct 26 14:03:18.889909 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3630/7283] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:03:18 2022] GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9 => generated 1676 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:03:18.943314 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-dc0679dc-827e-4029-b0b1-a165f7f25244 req-69988cad-4b14-4135-8092-ae3dd7705fb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81783e43-115f-4ce7-a164-0020ff0e37a9", "tag": "46054f94-a6e7-4ac4-b884-657a7f0b0efd"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:03:18.957512 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-dc0679dc-827e-4029-b0b1-a165f7f25244 req-69988cad-4b14-4135-8092-ae3dd7705fb5 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:18.958004 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-dc0679dc-827e-4029-b0b1-a165f7f25244 req-69988cad-4b14-4135-8092-ae3dd7705fb5 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:18.958454 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-dc0679dc-827e-4029-b0b1-a165f7f25244 req-69988cad-4b14-4135-8092-ae3dd7705fb5 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:18.971161 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-dc0679dc-827e-4029-b0b1-a165f7f25244 req-69988cad-4b14-4135-8092-ae3dd7705fb5 service nova] Creating event network-changed:46054f94-a6e7-4ac4-b884-657a7f0b0efd for instance 81783e43-115f-4ce7-a164-0020ff0e37a9 on n-h1-862686-1 Oct 26 14:03:18.976404 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [req-dc0679dc-827e-4029-b0b1-a165f7f25244 req-69988cad-4b14-4135-8092-ae3dd7705fb5 service nova] Instance 81783e43-115f-4ce7-a164-0020ff0e37a9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862686-1', 'n-h1-862686-1'} {{(pid=120598) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 14:03:18.988041 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-dc0679dc-827e-4029-b0b1-a165f7f25244 req-69988cad-4b14-4135-8092-ae3dd7705fb5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049144 Oct 26 14:03:18.988632 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3654/7284] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:03:19.914185 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e8a488f8-e002-4fae-98f2-2ac527dc5359 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:03:19.914928 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e8a488f8-e002-4fae-98f2-2ac527dc5359 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:03:19.921926 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e8a488f8-e002-4fae-98f2-2ac527dc5359 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:19.922419 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e8a488f8-e002-4fae-98f2-2ac527dc5359 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:19.922890 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e8a488f8-e002-4fae-98f2-2ac527dc5359 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:19.923600 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e8a488f8-e002-4fae-98f2-2ac527dc5359 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:19.924062 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e8a488f8-e002-4fae-98f2-2ac527dc5359 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:19.924500 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e8a488f8-e002-4fae-98f2-2ac527dc5359 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:19.942230 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:03:20.054088 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e8a488f8-e002-4fae-98f2-2ac527dc5359 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:03:20.061925 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e8a488f8-e002-4fae-98f2-2ac527dc5359 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9" status: 200 len: 1676 microversion: 2.1 time: 0.151766 Oct 26 14:03:20.062493 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3631/7285] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:03:19 2022] GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 14:03:21.087329 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6b6daf7a-0703-4a76-93f0-0a65ee33d2a3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:03:21.088037 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6b6daf7a-0703-4a76-93f0-0a65ee33d2a3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:03:21.094993 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6b6daf7a-0703-4a76-93f0-0a65ee33d2a3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:21.095474 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6b6daf7a-0703-4a76-93f0-0a65ee33d2a3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:21.095928 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6b6daf7a-0703-4a76-93f0-0a65ee33d2a3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:21.096661 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6b6daf7a-0703-4a76-93f0-0a65ee33d2a3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:21.097131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6b6daf7a-0703-4a76-93f0-0a65ee33d2a3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:21.097599 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6b6daf7a-0703-4a76-93f0-0a65ee33d2a3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:21.228621 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6b6daf7a-0703-4a76-93f0-0a65ee33d2a3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:03:21.237119 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6b6daf7a-0703-4a76-93f0-0a65ee33d2a3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9" status: 200 len: 1676 microversion: 2.1 time: 0.155115 Oct 26 14:03:21.237757 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3655/7286] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:03:21 2022] GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:03:22.260796 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5e263cca-29d7-466d-a11c-e83c2801f19e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:03:22.261323 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5e263cca-29d7-466d-a11c-e83c2801f19e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:03:22.269450 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5e263cca-29d7-466d-a11c-e83c2801f19e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:22.269970 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5e263cca-29d7-466d-a11c-e83c2801f19e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:22.270412 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5e263cca-29d7-466d-a11c-e83c2801f19e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:22.271107 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5e263cca-29d7-466d-a11c-e83c2801f19e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:22.271563 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5e263cca-29d7-466d-a11c-e83c2801f19e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:22.271987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5e263cca-29d7-466d-a11c-e83c2801f19e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:22.415593 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5e263cca-29d7-466d-a11c-e83c2801f19e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:03:22.424150 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5e263cca-29d7-466d-a11c-e83c2801f19e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9" status: 200 len: 1669 microversion: 2.1 time: 0.167351 Oct 26 14:03:22.424977 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3632/7287] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:03:22 2022] GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9 => generated 1669 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:03:22.447100 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-92586b8f-f2f9-4ee2-94c9-87a0e7f9c526 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:03:22.448354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-92586b8f-f2f9-4ee2-94c9-87a0e7f9c526 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:03:22.456249 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-92586b8f-f2f9-4ee2-94c9-87a0e7f9c526 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:22.456757 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-92586b8f-f2f9-4ee2-94c9-87a0e7f9c526 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:22.457380 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-92586b8f-f2f9-4ee2-94c9-87a0e7f9c526 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:22.458137 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-92586b8f-f2f9-4ee2-94c9-87a0e7f9c526 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:22.458616 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-92586b8f-f2f9-4ee2-94c9-87a0e7f9c526 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:22.459226 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-92586b8f-f2f9-4ee2-94c9-87a0e7f9c526 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:22.608620 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-92586b8f-f2f9-4ee2-94c9-87a0e7f9c526 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:03:22.617099 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-92586b8f-f2f9-4ee2-94c9-87a0e7f9c526 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9" status: 200 len: 1669 microversion: 2.1 time: 0.173864 Oct 26 14:03:22.617743 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3656/7288] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:03:22 2022] GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9 => generated 1669 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:03:22.641021 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2490eec3-da5c-4e0a-a965-6b9bb661dcb1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:03:22.641706 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2490eec3-da5c-4e0a-a965-6b9bb661dcb1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:03:22.648041 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2490eec3-da5c-4e0a-a965-6b9bb661dcb1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:22.648544 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2490eec3-da5c-4e0a-a965-6b9bb661dcb1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:22.648987 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2490eec3-da5c-4e0a-a965-6b9bb661dcb1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:22.649731 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2490eec3-da5c-4e0a-a965-6b9bb661dcb1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:22.650198 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2490eec3-da5c-4e0a-a965-6b9bb661dcb1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:22.650632 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2490eec3-da5c-4e0a-a965-6b9bb661dcb1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:22.788384 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2490eec3-da5c-4e0a-a965-6b9bb661dcb1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:03:22.796908 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2490eec3-da5c-4e0a-a965-6b9bb661dcb1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9" status: 200 len: 1669 microversion: 2.1 time: 0.160472 Oct 26 14:03:22.797502 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3633/7289] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:03:22 2022] GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9 => generated 1669 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:03:22.819726 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-783bde69-790c-4088-872a-4cfbcb4528ac tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:03:22.820297 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-783bde69-790c-4088-872a-4cfbcb4528ac tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:03:22.826856 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-783bde69-790c-4088-872a-4cfbcb4528ac tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:22.827317 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-783bde69-790c-4088-872a-4cfbcb4528ac tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:22.827768 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-783bde69-790c-4088-872a-4cfbcb4528ac tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:22.828490 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-783bde69-790c-4088-872a-4cfbcb4528ac tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:22.828968 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-783bde69-790c-4088-872a-4cfbcb4528ac tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:22.829415 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-783bde69-790c-4088-872a-4cfbcb4528ac tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:22.854567 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-783bde69-790c-4088-872a-4cfbcb4528ac tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 14:03:22.902633 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:03:22.939181 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-783bde69-790c-4088-872a-4cfbcb4528ac tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "DELETE /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9" status: 204 len: 0 microversion: 2.1 time: 0.123054 Oct 26 14:03:22.940148 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3657/7290] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 14:03:22 2022] DELETE /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 14:03:22.948583 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-19f51ef8-7fc2-4019-be31-69ba2b7eddad tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:03:22.949233 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-19f51ef8-7fc2-4019-be31-69ba2b7eddad tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:03:22.955456 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-19f51ef8-7fc2-4019-be31-69ba2b7eddad tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:22.955725 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-19f51ef8-7fc2-4019-be31-69ba2b7eddad tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:22.956165 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-19f51ef8-7fc2-4019-be31-69ba2b7eddad tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:22.956915 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-19f51ef8-7fc2-4019-be31-69ba2b7eddad tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:22.957446 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-19f51ef8-7fc2-4019-be31-69ba2b7eddad tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:22.957905 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-19f51ef8-7fc2-4019-be31-69ba2b7eddad tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:23.089473 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-19f51ef8-7fc2-4019-be31-69ba2b7eddad tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:03:23.097383 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-19f51ef8-7fc2-4019-be31-69ba2b7eddad tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9" status: 200 len: 1675 microversion: 2.1 time: 0.152768 Oct 26 14:03:23.097974 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3634/7291] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:03:22 2022] GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:03:24.122416 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-91d15403-aa5f-414b-b3ef-f848ff60fd28 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:03:24.123571 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-91d15403-aa5f-414b-b3ef-f848ff60fd28 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:03:24.130938 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91d15403-aa5f-414b-b3ef-f848ff60fd28 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:24.131438 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91d15403-aa5f-414b-b3ef-f848ff60fd28 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:24.131888 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91d15403-aa5f-414b-b3ef-f848ff60fd28 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:24.132602 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91d15403-aa5f-414b-b3ef-f848ff60fd28 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:24.133075 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91d15403-aa5f-414b-b3ef-f848ff60fd28 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:24.133533 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91d15403-aa5f-414b-b3ef-f848ff60fd28 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:24.265629 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-91d15403-aa5f-414b-b3ef-f848ff60fd28 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:03:24.276482 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-91d15403-aa5f-414b-b3ef-f848ff60fd28 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9" status: 200 len: 1675 microversion: 2.1 time: 0.158839 Oct 26 14:03:24.277143 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3658/7292] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:03:24 2022] GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9 => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:03:24.521312 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-4c90faaa-73ef-4bce-9c25-442f530cee65 req-1086b2aa-8ebc-40dd-9dc0-0097607acfdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81783e43-115f-4ce7-a164-0020ff0e37a9", "name": "network-vif-plugged", "status": "completed", "tag": "46054f94-a6e7-4ac4-b884-657a7f0b0efd"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:03:24.532711 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-4c90faaa-73ef-4bce-9c25-442f530cee65 req-1086b2aa-8ebc-40dd-9dc0-0097607acfdd service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:24.533187 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-4c90faaa-73ef-4bce-9c25-442f530cee65 req-1086b2aa-8ebc-40dd-9dc0-0097607acfdd service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:24.534635 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-4c90faaa-73ef-4bce-9c25-442f530cee65 req-1086b2aa-8ebc-40dd-9dc0-0097607acfdd service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:24.552927 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-4c90faaa-73ef-4bce-9c25-442f530cee65 req-1086b2aa-8ebc-40dd-9dc0-0097607acfdd service nova] Creating event network-vif-plugged:46054f94-a6e7-4ac4-b884-657a7f0b0efd for instance 81783e43-115f-4ce7-a164-0020ff0e37a9 on n-h1-862686-1 Oct 26 14:03:24.558587 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-4c90faaa-73ef-4bce-9c25-442f530cee65 req-1086b2aa-8ebc-40dd-9dc0-0097607acfdd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041049 Oct 26 14:03:24.560175 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3635/7293] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:03:25.302017 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-08cb77de-e901-4b50-82d1-ce553fd66ba0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:03:25.302770 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-08cb77de-e901-4b50-82d1-ce553fd66ba0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:03:25.315097 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-08cb77de-e901-4b50-82d1-ce553fd66ba0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:25.315775 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-08cb77de-e901-4b50-82d1-ce553fd66ba0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:25.316416 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-08cb77de-e901-4b50-82d1-ce553fd66ba0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:25.322090 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-08cb77de-e901-4b50-82d1-ce553fd66ba0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:25.322601 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-08cb77de-e901-4b50-82d1-ce553fd66ba0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:25.323061 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-08cb77de-e901-4b50-82d1-ce553fd66ba0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:25.438445 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-08cb77de-e901-4b50-82d1-ce553fd66ba0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:03:25.446853 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-08cb77de-e901-4b50-82d1-ce553fd66ba0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9" status: 200 len: 1607 microversion: 2.1 time: 0.148857 Oct 26 14:03:25.447666 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3659/7294] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:03:25 2022] GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9 => generated 1607 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 14:03:25.643725 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:03:25.649063 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-869e1957-3fc0-49fa-925d-c8c43c212fff req-b6940650-1b72-4ea8-afb4-82f46869f456 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81783e43-115f-4ce7-a164-0020ff0e37a9", "name": "network-vif-deleted", "tag": "46054f94-a6e7-4ac4-b884-657a7f0b0efd"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:03:25.662502 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-869e1957-3fc0-49fa-925d-c8c43c212fff req-b6940650-1b72-4ea8-afb4-82f46869f456 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:25.662909 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-869e1957-3fc0-49fa-925d-c8c43c212fff req-b6940650-1b72-4ea8-afb4-82f46869f456 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:25.663352 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-869e1957-3fc0-49fa-925d-c8c43c212fff req-b6940650-1b72-4ea8-afb4-82f46869f456 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:25.676056 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-869e1957-3fc0-49fa-925d-c8c43c212fff req-b6940650-1b72-4ea8-afb4-82f46869f456 service nova] Creating event network-vif-deleted:46054f94-a6e7-4ac4-b884-657a7f0b0efd for instance 81783e43-115f-4ce7-a164-0020ff0e37a9 on n-h1-862686-1 Oct 26 14:03:25.681833 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-869e1957-3fc0-49fa-925d-c8c43c212fff req-b6940650-1b72-4ea8-afb4-82f46869f456 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038813 Oct 26 14:03:25.682454 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3636/7295] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:03:26.471859 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5c574ea1-c5e7-4bf0-9e4f-bc20a4e5c7fd tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:03:26.472486 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5c574ea1-c5e7-4bf0-9e4f-bc20a4e5c7fd tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:03:26.479265 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c574ea1-c5e7-4bf0-9e4f-bc20a4e5c7fd tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:26.479764 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c574ea1-c5e7-4bf0-9e4f-bc20a4e5c7fd tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:26.480219 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c574ea1-c5e7-4bf0-9e4f-bc20a4e5c7fd tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:26.480922 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c574ea1-c5e7-4bf0-9e4f-bc20a4e5c7fd tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:26.481453 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c574ea1-c5e7-4bf0-9e4f-bc20a4e5c7fd tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:26.482028 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c574ea1-c5e7-4bf0-9e4f-bc20a4e5c7fd tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:26.496066 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-5c574ea1-c5e7-4bf0-9e4f-bc20a4e5c7fd tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] HTTP exception thrown: Instance 81783e43-115f-4ce7-a164-0020ff0e37a9 could not be found. Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5c574ea1-c5e7-4bf0-9e4f-bc20a4e5c7fd tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Request method failure captured: Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9 HTTP/1.1 Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWT1KEf5RrnueWN8kvjsLURQZMRFC3vXj7EkFIPWPtwUH5p4vA-FoRCpopRC9DSlZE_HC0WGwzVujJC0KQhUWeAqCdZ-AE7FaQcXN_vov0P3H2esfpvK2-XfZnMMJsEhdmjY6sxfgyMT-XdJMLKubEhpiDdQ4UTp8oG--QBn1oDlg3bQ Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 73688cef84664d7db69a39fcbffb6e65 Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServerActionsTestJSON-646524856 Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/73688cef84664d7db69a39fcbffb6e65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/73688cef84664d7db69a39fcbffb6e65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_73688cef84664d7db69a39fcbffb6e65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/73688cef84664d7db69a39fcbffb6e65"}]}] Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServerActionsTestJSON-646524856 Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 73688cef84664d7db69a39fcbffb6e65 Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServerActionsTestJSON-646524856 Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServerActionsTestJSON-646524856-project Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: dc4fe5238edd40db8d203790e2aab143 Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServerActionsTestJSON-646524856-project Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 81783e43-115f-4ce7-a164-0020ff0e37a9 could not be found. Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '81783e43-115f-4ce7-a164-0020ff0e37a9'} Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81783e43-115f-4ce7-a164-0020ff0e37a9 could not be found. Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81783e43-115f-4ce7-a164-0020ff0e37a9 could not be found. Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:03:26.498564 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:03:26.503022 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:03:26.503022 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:03:26.503022 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:03:26.503022 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 14:03:26.503022 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 14:03:26.503022 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81783e43-115f-4ce7-a164-0020ff0e37a9 could not be found. Oct 26 14:03:26.503022 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:03:26.503022 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5c574ea1-c5e7-4bf0-9e4f-bc20a4e5c7fd tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Returning 404 to user: Instance 81783e43-115f-4ce7-a164-0020ff0e37a9 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 14:03:26.503022 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5c574ea1-c5e7-4bf0-9e4f-bc20a4e5c7fd tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9" status: 404 len: 111 microversion: 2.1 time: 0.032174 Oct 26 14:03:26.503022 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3660/7296] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:03:26 2022] GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 14:03:26.516943 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c8e5ab4b-8218-4162-b08d-c38ee9ecfc38 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:03:26.517781 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c8e5ab4b-8218-4162-b08d-c38ee9ecfc38 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:03:26.524263 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c8e5ab4b-8218-4162-b08d-c38ee9ecfc38 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:26.524833 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c8e5ab4b-8218-4162-b08d-c38ee9ecfc38 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:26.525432 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c8e5ab4b-8218-4162-b08d-c38ee9ecfc38 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:26.526235 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c8e5ab4b-8218-4162-b08d-c38ee9ecfc38 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:26.526774 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c8e5ab4b-8218-4162-b08d-c38ee9ecfc38 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:26.527279 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c8e5ab4b-8218-4162-b08d-c38ee9ecfc38 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:26.542489 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-c8e5ab4b-8218-4162-b08d-c38ee9ecfc38 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] HTTP exception thrown: Instance 81783e43-115f-4ce7-a164-0020ff0e37a9 could not be found. Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c8e5ab4b-8218-4162-b08d-c38ee9ecfc38 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Request method failure captured: Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9 HTTP/1.1 Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWT1KEf5RrnueWN8kvjsLURQZMRFC3vXj7EkFIPWPtwUH5p4vA-FoRCpopRC9DSlZE_HC0WGwzVujJC0KQhUWeAqCdZ-AE7FaQcXN_vov0P3H2esfpvK2-XfZnMMJsEhdmjY6sxfgyMT-XdJMLKubEhpiDdQ4UTp8oG--QBn1oDlg3bQ Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 73688cef84664d7db69a39fcbffb6e65 Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServerActionsTestJSON-646524856 Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/73688cef84664d7db69a39fcbffb6e65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/73688cef84664d7db69a39fcbffb6e65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_73688cef84664d7db69a39fcbffb6e65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/73688cef84664d7db69a39fcbffb6e65"}]}] Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServerActionsTestJSON-646524856 Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 73688cef84664d7db69a39fcbffb6e65 Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServerActionsTestJSON-646524856 Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServerActionsTestJSON-646524856-project Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: dc4fe5238edd40db8d203790e2aab143 Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServerActionsTestJSON-646524856-project Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 81783e43-115f-4ce7-a164-0020ff0e37a9 could not be found. Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '81783e43-115f-4ce7-a164-0020ff0e37a9'} Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81783e43-115f-4ce7-a164-0020ff0e37a9 could not be found. Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81783e43-115f-4ce7-a164-0020ff0e37a9 could not be found. Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:03:26.544476 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:03:26.550728 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:03:26.550728 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:03:26.550728 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:03:26.550728 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 14:03:26.550728 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 14:03:26.550728 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81783e43-115f-4ce7-a164-0020ff0e37a9 could not be found. Oct 26 14:03:26.550728 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:03:26.550728 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c8e5ab4b-8218-4162-b08d-c38ee9ecfc38 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Returning 404 to user: Instance 81783e43-115f-4ce7-a164-0020ff0e37a9 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 14:03:26.550728 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c8e5ab4b-8218-4162-b08d-c38ee9ecfc38 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9" status: 404 len: 111 microversion: 2.1 time: 0.034424 Oct 26 14:03:26.550728 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3637/7297] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:03:26 2022] GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 14:03:26.603507 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2ce4aff1-72ae-4539-95b1-23d008f7c13f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1943301119", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "2cd9056a-bda2-4cf3-a05f-b03f797a2eee"}], "security_groups": [{"name": "tempest-securitygroup--2110277177"}], "key_name": "tempest-keypair-908741287", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:03:26.716921 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-2ce4aff1-72ae-4539-95b1-23d008f7c13f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] validate_networks() for [('2cd9056a-bda2-4cf3-a05f-b03f797a2eee', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 14:03:26.893737 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:03:27.085165 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-2ce4aff1-72ae-4539-95b1-23d008f7c13f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 14:03:27.085639 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-2ce4aff1-72ae-4539-95b1-23d008f7c13f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 14:03:27.086124 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-2ce4aff1-72ae-4539-95b1-23d008f7c13f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 14:03:27.086540 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-2ce4aff1-72ae-4539-95b1-23d008f7c13f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 14:03:27.086963 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-2ce4aff1-72ae-4539-95b1-23d008f7c13f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 14:03:27.096766 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ce4aff1-72ae-4539-95b1-23d008f7c13f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:27.097261 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ce4aff1-72ae-4539-95b1-23d008f7c13f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:27.097741 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ce4aff1-72ae-4539-95b1-23d008f7c13f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:27.098480 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ce4aff1-72ae-4539-95b1-23d008f7c13f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:27.098945 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ce4aff1-72ae-4539-95b1-23d008f7c13f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:27.099385 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ce4aff1-72ae-4539-95b1-23d008f7c13f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:27.116678 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-2ce4aff1-72ae-4539-95b1-23d008f7c13f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Getting quotas for project 73688cef84664d7db69a39fcbffb6e65. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 14:03:27.121830 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-2ce4aff1-72ae-4539-95b1-23d008f7c13f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Getting quotas for user dc4fe5238edd40db8d203790e2aab143 and project 73688cef84664d7db69a39fcbffb6e65. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 14:03:27.134461 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2ce4aff1-72ae-4539-95b1-23d008f7c13f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 14:03:27.136793 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2ce4aff1-72ae-4539-95b1-23d008f7c13f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 14:03:27.185395 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2ce4aff1-72ae-4539-95b1-23d008f7c13f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.591580 Oct 26 14:03:27.186087 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3661/7298] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 14:03:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 14:03:27.197423 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ef363008-38a4-4606-8aa9-070c3fdb4683 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:03:27.198068 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ef363008-38a4-4606-8aa9-070c3fdb4683 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:03:27.200838 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:03:27.256410 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ef363008-38a4-4606-8aa9-070c3fdb4683 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:03:27.265128 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ef363008-38a4-4606-8aa9-070c3fdb4683 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1238 microversion: 2.1 time: 0.071520 Oct 26 14:03:27.265725 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3638/7299] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:03:27 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1238 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:03:28.291045 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-88dba334-d2db-4143-981a-e24b530ef742 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:03:28.291742 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-88dba334-d2db-4143-981a-e24b530ef742 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:03:28.301346 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88dba334-d2db-4143-981a-e24b530ef742 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:28.301845 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88dba334-d2db-4143-981a-e24b530ef742 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:28.302641 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88dba334-d2db-4143-981a-e24b530ef742 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:28.303697 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88dba334-d2db-4143-981a-e24b530ef742 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:28.304772 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88dba334-d2db-4143-981a-e24b530ef742 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:28.305234 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88dba334-d2db-4143-981a-e24b530ef742 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:28.394034 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-88dba334-d2db-4143-981a-e24b530ef742 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:03:28.407911 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-88dba334-d2db-4143-981a-e24b530ef742 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1308 microversion: 2.1 time: 0.120829 Oct 26 14:03:28.408623 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3662/7300] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:03:28 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1308 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:03:29.432440 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4a519297-eab0-49c9-8618-cb1472f4e937 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:03:29.433110 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4a519297-eab0-49c9-8618-cb1472f4e937 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:03:29.440413 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4a519297-eab0-49c9-8618-cb1472f4e937 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:29.440903 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4a519297-eab0-49c9-8618-cb1472f4e937 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:29.441343 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4a519297-eab0-49c9-8618-cb1472f4e937 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:29.442080 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4a519297-eab0-49c9-8618-cb1472f4e937 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:29.442540 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4a519297-eab0-49c9-8618-cb1472f4e937 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:29.442974 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4a519297-eab0-49c9-8618-cb1472f4e937 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:29.583611 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4a519297-eab0-49c9-8618-cb1472f4e937 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:03:29.591747 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4a519297-eab0-49c9-8618-cb1472f4e937 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1364 microversion: 2.1 time: 0.163123 Oct 26 14:03:29.592332 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3639/7301] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:03:29 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:03:29.714521 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-984abc42-fd64-4a60-a3c9-1c26d77fde5b req-1d79cbd6-4b5b-4b19-98a0-c7d0cb9e0a18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a3c104a-e134-4a65-9cbe-4c8960b1c244", "tag": "9193c976-4d09-4352-890e-7cdcc0a3c8db"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:03:29.725729 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-984abc42-fd64-4a60-a3c9-1c26d77fde5b req-1d79cbd6-4b5b-4b19-98a0-c7d0cb9e0a18 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:29.726455 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-984abc42-fd64-4a60-a3c9-1c26d77fde5b req-1d79cbd6-4b5b-4b19-98a0-c7d0cb9e0a18 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:29.726908 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-984abc42-fd64-4a60-a3c9-1c26d77fde5b req-1d79cbd6-4b5b-4b19-98a0-c7d0cb9e0a18 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:29.738892 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-984abc42-fd64-4a60-a3c9-1c26d77fde5b req-1d79cbd6-4b5b-4b19-98a0-c7d0cb9e0a18 service nova] Creating event network-changed:9193c976-4d09-4352-890e-7cdcc0a3c8db for instance 0a3c104a-e134-4a65-9cbe-4c8960b1c244 on n-h2-862686-1 Oct 26 14:03:29.743679 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-984abc42-fd64-4a60-a3c9-1c26d77fde5b req-1d79cbd6-4b5b-4b19-98a0-c7d0cb9e0a18 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033279 Oct 26 14:03:29.744575 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3663/7302] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:03:30.616275 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-88fc9295-8d11-43c7-b74c-64ab8520ae8d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:03:30.616925 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-88fc9295-8d11-43c7-b74c-64ab8520ae8d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:03:30.623902 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88fc9295-8d11-43c7-b74c-64ab8520ae8d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:30.624385 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88fc9295-8d11-43c7-b74c-64ab8520ae8d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:30.624822 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88fc9295-8d11-43c7-b74c-64ab8520ae8d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:30.625544 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88fc9295-8d11-43c7-b74c-64ab8520ae8d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:30.626008 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88fc9295-8d11-43c7-b74c-64ab8520ae8d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:30.626436 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88fc9295-8d11-43c7-b74c-64ab8520ae8d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:30.769087 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-88fc9295-8d11-43c7-b74c-64ab8520ae8d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:03:30.777256 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-88fc9295-8d11-43c7-b74c-64ab8520ae8d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1364 microversion: 2.1 time: 0.164886 Oct 26 14:03:30.777881 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3640/7303] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:03:30 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:03:31.802444 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-64eecf1c-577d-4e9e-89b5-31200babe715 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:03:31.803159 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-64eecf1c-577d-4e9e-89b5-31200babe715 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:03:31.809286 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64eecf1c-577d-4e9e-89b5-31200babe715 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:31.810096 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64eecf1c-577d-4e9e-89b5-31200babe715 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:31.810549 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64eecf1c-577d-4e9e-89b5-31200babe715 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:31.811251 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64eecf1c-577d-4e9e-89b5-31200babe715 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:31.811718 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64eecf1c-577d-4e9e-89b5-31200babe715 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:31.812155 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64eecf1c-577d-4e9e-89b5-31200babe715 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:31.942972 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-64eecf1c-577d-4e9e-89b5-31200babe715 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:03:31.951165 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-64eecf1c-577d-4e9e-89b5-31200babe715 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1364 microversion: 2.1 time: 0.153833 Oct 26 14:03:31.951738 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3664/7304] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:03:31 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:03:32.975149 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0bce20c0-8fa8-4323-94c9-82e9fb64ca77 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:03:32.975764 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0bce20c0-8fa8-4323-94c9-82e9fb64ca77 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:03:32.983130 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0bce20c0-8fa8-4323-94c9-82e9fb64ca77 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:32.983618 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0bce20c0-8fa8-4323-94c9-82e9fb64ca77 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:32.984061 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0bce20c0-8fa8-4323-94c9-82e9fb64ca77 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:32.984756 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0bce20c0-8fa8-4323-94c9-82e9fb64ca77 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:32.985217 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0bce20c0-8fa8-4323-94c9-82e9fb64ca77 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:32.985682 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0bce20c0-8fa8-4323-94c9-82e9fb64ca77 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:33.119986 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0bce20c0-8fa8-4323-94c9-82e9fb64ca77 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:03:33.128848 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0bce20c0-8fa8-4323-94c9-82e9fb64ca77 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1364 microversion: 2.1 time: 0.157632 Oct 26 14:03:33.129449 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3641/7305] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:03:32 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:03:34.152631 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6a88452a-dab0-42d3-9ddb-43e4f5817f62 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:03:34.153806 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6a88452a-dab0-42d3-9ddb-43e4f5817f62 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:03:34.160900 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a88452a-dab0-42d3-9ddb-43e4f5817f62 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:34.161402 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a88452a-dab0-42d3-9ddb-43e4f5817f62 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:34.161891 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a88452a-dab0-42d3-9ddb-43e4f5817f62 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:34.162602 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a88452a-dab0-42d3-9ddb-43e4f5817f62 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:34.163076 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a88452a-dab0-42d3-9ddb-43e4f5817f62 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:34.163518 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a88452a-dab0-42d3-9ddb-43e4f5817f62 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:34.295949 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6a88452a-dab0-42d3-9ddb-43e4f5817f62 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:03:34.303818 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6a88452a-dab0-42d3-9ddb-43e4f5817f62 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1364 microversion: 2.1 time: 0.155448 Oct 26 14:03:34.309820 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3665/7306] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:03:34 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:03:34.826125 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-5e9afde9-a9f8-4a9f-aa82-be3df04127fb req-c7f70832-e55b-4df9-ae55-378115efa8d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a3c104a-e134-4a65-9cbe-4c8960b1c244", "name": "network-vif-plugged", "status": "completed", "tag": "9193c976-4d09-4352-890e-7cdcc0a3c8db"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:03:34.837084 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-5e9afde9-a9f8-4a9f-aa82-be3df04127fb req-c7f70832-e55b-4df9-ae55-378115efa8d0 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:34.837619 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-5e9afde9-a9f8-4a9f-aa82-be3df04127fb req-c7f70832-e55b-4df9-ae55-378115efa8d0 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:34.838041 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-5e9afde9-a9f8-4a9f-aa82-be3df04127fb req-c7f70832-e55b-4df9-ae55-378115efa8d0 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:34.849426 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-5e9afde9-a9f8-4a9f-aa82-be3df04127fb req-c7f70832-e55b-4df9-ae55-378115efa8d0 service nova] Creating event network-vif-plugged:9193c976-4d09-4352-890e-7cdcc0a3c8db for instance 0a3c104a-e134-4a65-9cbe-4c8960b1c244 on n-h2-862686-1 Oct 26 14:03:34.854482 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-5e9afde9-a9f8-4a9f-aa82-be3df04127fb req-c7f70832-e55b-4df9-ae55-378115efa8d0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032774 Oct 26 14:03:34.855439 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3642/7307] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:03:35.327122 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-aa9a90ec-641e-4f5e-9c24-cce77e432e77 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:03:35.327757 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-aa9a90ec-641e-4f5e-9c24-cce77e432e77 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:03:35.334622 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa9a90ec-641e-4f5e-9c24-cce77e432e77 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:35.335125 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa9a90ec-641e-4f5e-9c24-cce77e432e77 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:35.335581 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa9a90ec-641e-4f5e-9c24-cce77e432e77 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:35.336293 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa9a90ec-641e-4f5e-9c24-cce77e432e77 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:35.336768 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa9a90ec-641e-4f5e-9c24-cce77e432e77 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:35.337215 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa9a90ec-641e-4f5e-9c24-cce77e432e77 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:35.473650 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-aa9a90ec-641e-4f5e-9c24-cce77e432e77 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:03:35.482065 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-aa9a90ec-641e-4f5e-9c24-cce77e432e77 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1364 microversion: 2.1 time: 0.158268 Oct 26 14:03:35.482766 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3666/7308] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:03:35 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:03:36.507519 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e37ae3a8-b13c-4300-a430-38a3a5bcc176 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:03:36.508167 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e37ae3a8-b13c-4300-a430-38a3a5bcc176 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:03:36.515004 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e37ae3a8-b13c-4300-a430-38a3a5bcc176 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:36.515496 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e37ae3a8-b13c-4300-a430-38a3a5bcc176 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:36.515938 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e37ae3a8-b13c-4300-a430-38a3a5bcc176 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:36.516637 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e37ae3a8-b13c-4300-a430-38a3a5bcc176 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:36.517096 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e37ae3a8-b13c-4300-a430-38a3a5bcc176 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:36.517552 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e37ae3a8-b13c-4300-a430-38a3a5bcc176 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:36.655447 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e37ae3a8-b13c-4300-a430-38a3a5bcc176 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:03:36.663446 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e37ae3a8-b13c-4300-a430-38a3a5bcc176 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1552 microversion: 2.1 time: 0.161347 Oct 26 14:03:36.664021 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3643/7309] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:03:36 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1552 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:03:36.687386 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-daaf8713-4ae1-4c07-b97a-a323012487cf tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:03:36.687945 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-daaf8713-4ae1-4c07-b97a-a323012487cf tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:03:36.694708 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-daaf8713-4ae1-4c07-b97a-a323012487cf tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:36.695210 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-daaf8713-4ae1-4c07-b97a-a323012487cf tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:36.695667 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-daaf8713-4ae1-4c07-b97a-a323012487cf tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:36.696381 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-daaf8713-4ae1-4c07-b97a-a323012487cf tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:36.696852 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-daaf8713-4ae1-4c07-b97a-a323012487cf tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:36.697299 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-daaf8713-4ae1-4c07-b97a-a323012487cf tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:36.775421 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-daaf8713-4ae1-4c07-b97a-a323012487cf tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091938 Oct 26 14:03:36.776067 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3667/7310] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 26 14:03:36 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:03:37.695963 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-d672afe1-af42-45e2-b058-2d5dbb8aaf61 req-fe4b3ee6-d632-4d3e-93eb-3def78c1e3fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a3c104a-e134-4a65-9cbe-4c8960b1c244", "tag": "9193c976-4d09-4352-890e-7cdcc0a3c8db"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:03:37.700923 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:03:37.708077 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d672afe1-af42-45e2-b058-2d5dbb8aaf61 req-fe4b3ee6-d632-4d3e-93eb-3def78c1e3fc service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:03:37.708563 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d672afe1-af42-45e2-b058-2d5dbb8aaf61 req-fe4b3ee6-d632-4d3e-93eb-3def78c1e3fc service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:03:37.708998 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d672afe1-af42-45e2-b058-2d5dbb8aaf61 req-fe4b3ee6-d632-4d3e-93eb-3def78c1e3fc service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:03:37.720507 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-d672afe1-af42-45e2-b058-2d5dbb8aaf61 req-fe4b3ee6-d632-4d3e-93eb-3def78c1e3fc service nova] Creating event network-changed:9193c976-4d09-4352-890e-7cdcc0a3c8db for instance 0a3c104a-e134-4a65-9cbe-4c8960b1c244 on n-h2-862686-1 Oct 26 14:03:37.725999 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-d672afe1-af42-45e2-b058-2d5dbb8aaf61 req-fe4b3ee6-d632-4d3e-93eb-3def78c1e3fc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033693 Oct 26 14:03:37.726612 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3644/7311] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:04:19.895879 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:04:19.896624 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:04:19.899828 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:04:19.900682 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:04:19.906022 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9d814736-3f24-4222-82a0-e187dbda346b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:04:19.906652 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9d814736-3f24-4222-82a0-e187dbda346b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:04:19.915366 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d814736-3f24-4222-82a0-e187dbda346b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:19.916067 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d814736-3f24-4222-82a0-e187dbda346b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:19.916728 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d814736-3f24-4222-82a0-e187dbda346b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:19.917676 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d814736-3f24-4222-82a0-e187dbda346b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:19.918157 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d814736-3f24-4222-82a0-e187dbda346b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:19.918630 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d814736-3f24-4222-82a0-e187dbda346b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:20.051551 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9d814736-3f24-4222-82a0-e187dbda346b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:04:20.059331 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9d814736-3f24-4222-82a0-e187dbda346b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1671 microversion: 2.1 time: 0.164368 Oct 26 14:04:20.059899 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3668/7312] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:04:19 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1671 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:04:20.081218 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=15 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:04:20.082044 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=54 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:04:20.086370 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b5d84006-8c87-4440-8435-58c4f33b88d0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41a52a37-f7b5-495a-80cc-8bef94595c70"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:04:20.088807 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b5d84006-8c87-4440-8435-58c4f33b88d0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:04:20.096114 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b5d84006-8c87-4440-8435-58c4f33b88d0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:20.096605 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b5d84006-8c87-4440-8435-58c4f33b88d0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:20.097044 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b5d84006-8c87-4440-8435-58c4f33b88d0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:20.097786 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b5d84006-8c87-4440-8435-58c4f33b88d0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:20.098248 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b5d84006-8c87-4440-8435-58c4f33b88d0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:20.098678 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b5d84006-8c87-4440-8435-58c4f33b88d0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:20.337958 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b5d84006-8c87-4440-8435-58c4f33b88d0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "POST /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258604 Oct 26 14:04:20.338567 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3645/7313] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Oct 26 14:04:20 2022] POST /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:04:31.069128 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e07a00a6-b1ce-42a4-9a5b-6769c7bc4449 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:04:31.071567 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e07a00a6-b1ce-42a4-9a5b-6769c7bc4449 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:04:31.074354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:04:31.075181 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:04:31.081724 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e07a00a6-b1ce-42a4-9a5b-6769c7bc4449 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:31.082223 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e07a00a6-b1ce-42a4-9a5b-6769c7bc4449 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:31.082673 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e07a00a6-b1ce-42a4-9a5b-6769c7bc4449 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:31.083372 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e07a00a6-b1ce-42a4-9a5b-6769c7bc4449 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:31.083843 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e07a00a6-b1ce-42a4-9a5b-6769c7bc4449 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:31.084274 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e07a00a6-b1ce-42a4-9a5b-6769c7bc4449 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:31.114911 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e07a00a6-b1ce-42a4-9a5b-6769c7bc4449 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:04:31.120617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e07a00a6-b1ce-42a4-9a5b-6769c7bc4449 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Old instance type m1.heat2, new instance type m1.heat {{(pid=120598) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 26 14:04:31.128899 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-e07a00a6-b1ce-42a4-9a5b-6769c7bc4449 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 14:04:31.129264 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-e07a00a6-b1ce-42a4-9a5b-6769c7bc4449 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 14:04:31.129782 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-e07a00a6-b1ce-42a4-9a5b-6769c7bc4449 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 14:04:31.130239 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-e07a00a6-b1ce-42a4-9a5b-6769c7bc4449 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 14:04:31.130665 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-e07a00a6-b1ce-42a4-9a5b-6769c7bc4449 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 14:04:31.197929 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e07a00a6-b1ce-42a4-9a5b-6769c7bc4449 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "POST /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244/action" status: 202 len: 0 microversion: 2.1 time: 0.132717 Oct 26 14:04:31.198804 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3669/7314] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 14:04:31 2022] POST /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 14:04:31.205742 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:04:31.206521 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:04:31.210615 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3b95d123-42ec-4abb-859d-949e34496233 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:04:31.211775 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3b95d123-42ec-4abb-859d-949e34496233 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:04:31.219338 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3b95d123-42ec-4abb-859d-949e34496233 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:31.219938 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3b95d123-42ec-4abb-859d-949e34496233 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:31.220262 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3b95d123-42ec-4abb-859d-949e34496233 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:31.220966 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3b95d123-42ec-4abb-859d-949e34496233 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:31.221463 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3b95d123-42ec-4abb-859d-949e34496233 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:31.221903 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3b95d123-42ec-4abb-859d-949e34496233 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:31.366317 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-3b95d123-42ec-4abb-859d-949e34496233 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:04:31.376466 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3b95d123-42ec-4abb-859d-949e34496233 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1726 microversion: 2.1 time: 0.172623 Oct 26 14:04:31.377046 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3646/7315] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:04:31 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1726 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:04:32.401124 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b1f5ca3c-58e4-4b2c-84c4-bc6c66245458 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:04:32.401794 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b1f5ca3c-58e4-4b2c-84c4-bc6c66245458 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:04:32.410467 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1f5ca3c-58e4-4b2c-84c4-bc6c66245458 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:32.410981 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1f5ca3c-58e4-4b2c-84c4-bc6c66245458 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:32.411442 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1f5ca3c-58e4-4b2c-84c4-bc6c66245458 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:32.412158 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1f5ca3c-58e4-4b2c-84c4-bc6c66245458 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:32.412637 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1f5ca3c-58e4-4b2c-84c4-bc6c66245458 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:32.413115 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1f5ca3c-58e4-4b2c-84c4-bc6c66245458 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:32.969607 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b1f5ca3c-58e4-4b2c-84c4-bc6c66245458 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:04:32.977809 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b1f5ca3c-58e4-4b2c-84c4-bc6c66245458 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1726 microversion: 2.1 time: 0.581482 Oct 26 14:04:32.978319 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3670/7316] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:04:32 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1726 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:04:34.001008 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f20e3c5f-ac9b-473b-8024-40d460064d88 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:04:34.001656 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f20e3c5f-ac9b-473b-8024-40d460064d88 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:04:34.008426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f20e3c5f-ac9b-473b-8024-40d460064d88 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:34.008911 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f20e3c5f-ac9b-473b-8024-40d460064d88 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:34.009356 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f20e3c5f-ac9b-473b-8024-40d460064d88 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:34.010083 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f20e3c5f-ac9b-473b-8024-40d460064d88 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:34.010542 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f20e3c5f-ac9b-473b-8024-40d460064d88 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:34.010971 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f20e3c5f-ac9b-473b-8024-40d460064d88 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:34.147182 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f20e3c5f-ac9b-473b-8024-40d460064d88 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:04:34.155602 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f20e3c5f-ac9b-473b-8024-40d460064d88 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1731 microversion: 2.1 time: 0.158545 Oct 26 14:04:34.156175 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3647/7317] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:04:33 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:04:35.180698 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fef928a6-53c9-4581-8130-75f3e127de20 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:04:35.181238 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fef928a6-53c9-4581-8130-75f3e127de20 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:04:35.188334 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fef928a6-53c9-4581-8130-75f3e127de20 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:35.188866 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fef928a6-53c9-4581-8130-75f3e127de20 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:35.189320 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fef928a6-53c9-4581-8130-75f3e127de20 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:35.190050 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fef928a6-53c9-4581-8130-75f3e127de20 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:35.190519 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fef928a6-53c9-4581-8130-75f3e127de20 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:35.190956 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fef928a6-53c9-4581-8130-75f3e127de20 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:35.324059 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fef928a6-53c9-4581-8130-75f3e127de20 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:04:35.332220 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fef928a6-53c9-4581-8130-75f3e127de20 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1731 microversion: 2.1 time: 0.155903 Oct 26 14:04:35.332794 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3671/7318] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:04:35 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:04:36.356409 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f3a826e6-877e-418a-92f0-28d49772bbdc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:04:36.357024 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f3a826e6-877e-418a-92f0-28d49772bbdc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:04:36.365186 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3a826e6-877e-418a-92f0-28d49772bbdc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:36.365708 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3a826e6-877e-418a-92f0-28d49772bbdc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:36.366266 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3a826e6-877e-418a-92f0-28d49772bbdc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:36.366876 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3a826e6-877e-418a-92f0-28d49772bbdc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:36.367331 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3a826e6-877e-418a-92f0-28d49772bbdc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:36.367759 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f3a826e6-877e-418a-92f0-28d49772bbdc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:36.499040 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f3a826e6-877e-418a-92f0-28d49772bbdc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:04:36.508387 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f3a826e6-877e-418a-92f0-28d49772bbdc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1731 microversion: 2.1 time: 0.155863 Oct 26 14:04:36.508975 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3648/7319] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:04:36 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:04:37.532317 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-dda6803f-3aa6-4f3c-af6b-a8f8f2ae34d1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:04:37.532944 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-dda6803f-3aa6-4f3c-af6b-a8f8f2ae34d1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:04:37.540612 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dda6803f-3aa6-4f3c-af6b-a8f8f2ae34d1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:37.541101 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dda6803f-3aa6-4f3c-af6b-a8f8f2ae34d1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:37.541582 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dda6803f-3aa6-4f3c-af6b-a8f8f2ae34d1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:37.542684 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dda6803f-3aa6-4f3c-af6b-a8f8f2ae34d1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:37.543151 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dda6803f-3aa6-4f3c-af6b-a8f8f2ae34d1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:37.543587 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dda6803f-3aa6-4f3c-af6b-a8f8f2ae34d1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:37.671825 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-dda6803f-3aa6-4f3c-af6b-a8f8f2ae34d1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:04:37.680109 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-dda6803f-3aa6-4f3c-af6b-a8f8f2ae34d1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1731 microversion: 2.1 time: 0.151965 Oct 26 14:04:37.680685 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3672/7320] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:04:37 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:04:38.704803 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7c17c88f-78ec-4a9d-bc5e-348c73993374 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:04:38.705343 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7c17c88f-78ec-4a9d-bc5e-348c73993374 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:04:38.712794 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7c17c88f-78ec-4a9d-bc5e-348c73993374 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:38.713279 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7c17c88f-78ec-4a9d-bc5e-348c73993374 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:38.713747 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7c17c88f-78ec-4a9d-bc5e-348c73993374 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:38.714438 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7c17c88f-78ec-4a9d-bc5e-348c73993374 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:38.714900 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7c17c88f-78ec-4a9d-bc5e-348c73993374 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:38.715326 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7c17c88f-78ec-4a9d-bc5e-348c73993374 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:38.848500 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7c17c88f-78ec-4a9d-bc5e-348c73993374 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:04:38.856755 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7c17c88f-78ec-4a9d-bc5e-348c73993374 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1731 microversion: 2.1 time: 0.156680 Oct 26 14:04:38.857337 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3649/7321] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:04:38 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:04:39.944121 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d0137725-46f9-405a-ac2a-3e2aee19d24c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:04:39.944859 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d0137725-46f9-405a-ac2a-3e2aee19d24c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:04:39.950900 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0137725-46f9-405a-ac2a-3e2aee19d24c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:39.951405 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0137725-46f9-405a-ac2a-3e2aee19d24c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:39.951868 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0137725-46f9-405a-ac2a-3e2aee19d24c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:39.952579 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0137725-46f9-405a-ac2a-3e2aee19d24c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:39.953058 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0137725-46f9-405a-ac2a-3e2aee19d24c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:39.953525 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0137725-46f9-405a-ac2a-3e2aee19d24c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:40.090655 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d0137725-46f9-405a-ac2a-3e2aee19d24c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:04:40.099864 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d0137725-46f9-405a-ac2a-3e2aee19d24c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1731 microversion: 2.1 time: 0.222907 Oct 26 14:04:40.100450 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3673/7322] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:04:39 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1731 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:04:41.123117 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6d9bbdac-2560-4edd-afbe-1db5dec38a15 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:04:41.123734 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6d9bbdac-2560-4edd-afbe-1db5dec38a15 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:04:41.131195 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6d9bbdac-2560-4edd-afbe-1db5dec38a15 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:41.131621 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6d9bbdac-2560-4edd-afbe-1db5dec38a15 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:41.132067 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6d9bbdac-2560-4edd-afbe-1db5dec38a15 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:41.132767 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6d9bbdac-2560-4edd-afbe-1db5dec38a15 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:41.133227 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6d9bbdac-2560-4edd-afbe-1db5dec38a15 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:41.133684 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6d9bbdac-2560-4edd-afbe-1db5dec38a15 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:41.262153 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6d9bbdac-2560-4edd-afbe-1db5dec38a15 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:04:41.270504 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6d9bbdac-2560-4edd-afbe-1db5dec38a15 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1731 microversion: 2.1 time: 0.151304 Oct 26 14:04:41.271083 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3650/7323] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:04:41 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:04:42.294714 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-62b8a57c-00b8-4a3b-b0cd-3cf51d219b58 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:04:42.295347 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-62b8a57c-00b8-4a3b-b0cd-3cf51d219b58 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:04:42.302818 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-62b8a57c-00b8-4a3b-b0cd-3cf51d219b58 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:42.303315 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-62b8a57c-00b8-4a3b-b0cd-3cf51d219b58 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:42.303787 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-62b8a57c-00b8-4a3b-b0cd-3cf51d219b58 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:42.304477 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-62b8a57c-00b8-4a3b-b0cd-3cf51d219b58 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:42.304945 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-62b8a57c-00b8-4a3b-b0cd-3cf51d219b58 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:42.305383 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-62b8a57c-00b8-4a3b-b0cd-3cf51d219b58 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:42.434889 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-62b8a57c-00b8-4a3b-b0cd-3cf51d219b58 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:04:42.443886 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-62b8a57c-00b8-4a3b-b0cd-3cf51d219b58 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1731 microversion: 2.1 time: 0.153096 Oct 26 14:04:42.444466 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3674/7324] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:04:42 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:04:43.467257 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-63828138-eff4-4015-bfa6-459c4bfa97cd tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:04:43.467876 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-63828138-eff4-4015-bfa6-459c4bfa97cd tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:04:43.474880 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-63828138-eff4-4015-bfa6-459c4bfa97cd tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:43.475381 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-63828138-eff4-4015-bfa6-459c4bfa97cd tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:43.475818 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-63828138-eff4-4015-bfa6-459c4bfa97cd tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:43.476514 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-63828138-eff4-4015-bfa6-459c4bfa97cd tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:43.476999 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-63828138-eff4-4015-bfa6-459c4bfa97cd tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:43.477426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-63828138-eff4-4015-bfa6-459c4bfa97cd tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:43.613458 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-63828138-eff4-4015-bfa6-459c4bfa97cd tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:04:43.621768 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-63828138-eff4-4015-bfa6-459c4bfa97cd tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1731 microversion: 2.1 time: 0.158406 Oct 26 14:04:43.622342 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3651/7325] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:04:43 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:04:44.646080 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fe92ec57-5f8e-45bd-9d3e-27d07c429ebd tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:04:44.646662 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fe92ec57-5f8e-45bd-9d3e-27d07c429ebd tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:04:44.653441 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe92ec57-5f8e-45bd-9d3e-27d07c429ebd tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:44.653970 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe92ec57-5f8e-45bd-9d3e-27d07c429ebd tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:44.654422 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe92ec57-5f8e-45bd-9d3e-27d07c429ebd tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:44.655140 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe92ec57-5f8e-45bd-9d3e-27d07c429ebd tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:44.655608 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe92ec57-5f8e-45bd-9d3e-27d07c429ebd tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:44.656049 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe92ec57-5f8e-45bd-9d3e-27d07c429ebd tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:44.789441 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fe92ec57-5f8e-45bd-9d3e-27d07c429ebd tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:04:44.797748 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fe92ec57-5f8e-45bd-9d3e-27d07c429ebd tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1731 microversion: 2.1 time: 0.155627 Oct 26 14:04:44.798330 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3675/7326] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:04:44 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:04:45.820944 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c5cbb46f-91f7-4a00-9c8a-2b91339291c3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:04:45.821575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c5cbb46f-91f7-4a00-9c8a-2b91339291c3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:04:45.828931 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c5cbb46f-91f7-4a00-9c8a-2b91339291c3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:45.829421 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c5cbb46f-91f7-4a00-9c8a-2b91339291c3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:45.829884 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c5cbb46f-91f7-4a00-9c8a-2b91339291c3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:45.830575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c5cbb46f-91f7-4a00-9c8a-2b91339291c3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:45.831034 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c5cbb46f-91f7-4a00-9c8a-2b91339291c3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:45.831459 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c5cbb46f-91f7-4a00-9c8a-2b91339291c3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:45.973863 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c5cbb46f-91f7-4a00-9c8a-2b91339291c3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:04:45.982647 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c5cbb46f-91f7-4a00-9c8a-2b91339291c3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1731 microversion: 2.1 time: 0.165602 Oct 26 14:04:45.983247 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3652/7327] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:04:45 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:04:47.007406 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0973638e-098f-4a78-969b-f23e2e47d3b1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:04:47.008031 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0973638e-098f-4a78-969b-f23e2e47d3b1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:04:47.014841 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0973638e-098f-4a78-969b-f23e2e47d3b1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:47.015337 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0973638e-098f-4a78-969b-f23e2e47d3b1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:47.015792 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0973638e-098f-4a78-969b-f23e2e47d3b1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:47.016657 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0973638e-098f-4a78-969b-f23e2e47d3b1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:47.017127 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0973638e-098f-4a78-969b-f23e2e47d3b1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:47.017591 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0973638e-098f-4a78-969b-f23e2e47d3b1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:47.156123 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0973638e-098f-4a78-969b-f23e2e47d3b1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:04:47.165498 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0973638e-098f-4a78-969b-f23e2e47d3b1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1731 microversion: 2.1 time: 0.161987 Oct 26 14:04:47.166077 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3676/7328] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:04:47 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:04:48.190606 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-69fe7497-7e16-4a28-8afe-09f2747ff202 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:04:48.191236 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-69fe7497-7e16-4a28-8afe-09f2747ff202 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:04:48.198205 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69fe7497-7e16-4a28-8afe-09f2747ff202 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:48.198773 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69fe7497-7e16-4a28-8afe-09f2747ff202 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:48.199264 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69fe7497-7e16-4a28-8afe-09f2747ff202 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:48.200000 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69fe7497-7e16-4a28-8afe-09f2747ff202 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:48.200494 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69fe7497-7e16-4a28-8afe-09f2747ff202 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:48.200916 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69fe7497-7e16-4a28-8afe-09f2747ff202 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:48.333873 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-69fe7497-7e16-4a28-8afe-09f2747ff202 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:04:48.342085 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-69fe7497-7e16-4a28-8afe-09f2747ff202 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1730 microversion: 2.1 time: 0.156390 Oct 26 14:04:48.342669 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3653/7329] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:04:48 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:04:48.451928 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-18797251-69d0-4a4f-abc0-5c9ba6eecc0b req-6d16e434-240c-4476-b702-c9692f1258b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a3c104a-e134-4a65-9cbe-4c8960b1c244", "name": "network-vif-unplugged", "status": "completed", "tag": "9193c976-4d09-4352-890e-7cdcc0a3c8db"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:04:48.462388 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-18797251-69d0-4a4f-abc0-5c9ba6eecc0b req-6d16e434-240c-4476-b702-c9692f1258b7 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:48.462982 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-18797251-69d0-4a4f-abc0-5c9ba6eecc0b req-6d16e434-240c-4476-b702-c9692f1258b7 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:48.463611 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-18797251-69d0-4a4f-abc0-5c9ba6eecc0b req-6d16e434-240c-4476-b702-c9692f1258b7 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:48.476214 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-18797251-69d0-4a4f-abc0-5c9ba6eecc0b req-6d16e434-240c-4476-b702-c9692f1258b7 service nova] Creating event network-vif-unplugged:9193c976-4d09-4352-890e-7cdcc0a3c8db for instance 0a3c104a-e134-4a65-9cbe-4c8960b1c244 on n-h1-862686-1 Oct 26 14:04:48.481600 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [req-18797251-69d0-4a4f-abc0-5c9ba6eecc0b req-6d16e434-240c-4476-b702-c9692f1258b7 service nova] Instance 0a3c104a-e134-4a65-9cbe-4c8960b1c244 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862686-1', 'n-h1-862686-1'} {{(pid=120598) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 14:04:48.493444 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-18797251-69d0-4a4f-abc0-5c9ba6eecc0b req-6d16e434-240c-4476-b702-c9692f1258b7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045685 Oct 26 14:04:48.494087 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3677/7330] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:04:49.366796 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a6b72626-af72-4aba-a071-12f02e141adf tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:04:49.367627 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a6b72626-af72-4aba-a071-12f02e141adf tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:04:49.374887 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a6b72626-af72-4aba-a071-12f02e141adf tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:49.376087 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a6b72626-af72-4aba-a071-12f02e141adf tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:49.376707 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a6b72626-af72-4aba-a071-12f02e141adf tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:49.377711 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a6b72626-af72-4aba-a071-12f02e141adf tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:49.378610 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a6b72626-af72-4aba-a071-12f02e141adf tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:49.379131 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a6b72626-af72-4aba-a071-12f02e141adf tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:49.520956 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a6b72626-af72-4aba-a071-12f02e141adf tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:04:49.529539 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a6b72626-af72-4aba-a071-12f02e141adf tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1730 microversion: 2.1 time: 0.166743 Oct 26 14:04:49.530267 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3654/7331] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:04:49 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:04:50.512329 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-280ce6bf-60c3-4a7c-a029-cda48c069857 req-4d12ef6d-a7a0-4edd-8177-87b2a6a29105 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a3c104a-e134-4a65-9cbe-4c8960b1c244", "tag": "9193c976-4d09-4352-890e-7cdcc0a3c8db"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:04:50.522965 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-280ce6bf-60c3-4a7c-a029-cda48c069857 req-4d12ef6d-a7a0-4edd-8177-87b2a6a29105 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:50.523452 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-280ce6bf-60c3-4a7c-a029-cda48c069857 req-4d12ef6d-a7a0-4edd-8177-87b2a6a29105 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:50.523907 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-280ce6bf-60c3-4a7c-a029-cda48c069857 req-4d12ef6d-a7a0-4edd-8177-87b2a6a29105 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:50.536005 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-280ce6bf-60c3-4a7c-a029-cda48c069857 req-4d12ef6d-a7a0-4edd-8177-87b2a6a29105 service nova] Creating event network-changed:9193c976-4d09-4352-890e-7cdcc0a3c8db for instance 0a3c104a-e134-4a65-9cbe-4c8960b1c244 on n-h1-862686-1 Oct 26 14:04:50.541548 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [req-280ce6bf-60c3-4a7c-a029-cda48c069857 req-4d12ef6d-a7a0-4edd-8177-87b2a6a29105 service nova] Instance 0a3c104a-e134-4a65-9cbe-4c8960b1c244 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862686-1', 'n-h1-862686-1'} {{(pid=120598) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 14:04:50.552970 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-280ce6bf-60c3-4a7c-a029-cda48c069857 req-4d12ef6d-a7a0-4edd-8177-87b2a6a29105 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045750 Oct 26 14:04:50.553755 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3678/7332] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:04:50.557057 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a75a4d8b-2ddc-4192-8644-76a5aa0334e7 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:04:50.557706 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a75a4d8b-2ddc-4192-8644-76a5aa0334e7 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:04:50.566079 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a75a4d8b-2ddc-4192-8644-76a5aa0334e7 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:50.567063 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a75a4d8b-2ddc-4192-8644-76a5aa0334e7 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:50.567720 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a75a4d8b-2ddc-4192-8644-76a5aa0334e7 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:50.568605 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a75a4d8b-2ddc-4192-8644-76a5aa0334e7 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:50.569220 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a75a4d8b-2ddc-4192-8644-76a5aa0334e7 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:50.569824 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a75a4d8b-2ddc-4192-8644-76a5aa0334e7 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:50.711745 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a75a4d8b-2ddc-4192-8644-76a5aa0334e7 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:04:50.721114 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a75a4d8b-2ddc-4192-8644-76a5aa0334e7 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1728 microversion: 2.1 time: 0.169350 Oct 26 14:04:50.721974 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3655/7333] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:04:50 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:04:51.746826 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0f1cd6c2-70ab-4853-bea3-b76115e885f3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:04:51.747475 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0f1cd6c2-70ab-4853-bea3-b76115e885f3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:04:51.754899 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f1cd6c2-70ab-4853-bea3-b76115e885f3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:51.755418 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f1cd6c2-70ab-4853-bea3-b76115e885f3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:51.755876 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f1cd6c2-70ab-4853-bea3-b76115e885f3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:51.756608 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f1cd6c2-70ab-4853-bea3-b76115e885f3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:51.757085 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f1cd6c2-70ab-4853-bea3-b76115e885f3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:51.757553 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f1cd6c2-70ab-4853-bea3-b76115e885f3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:51.897929 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0f1cd6c2-70ab-4853-bea3-b76115e885f3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:04:51.906244 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0f1cd6c2-70ab-4853-bea3-b76115e885f3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1728 microversion: 2.1 time: 0.164789 Oct 26 14:04:51.906962 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3679/7334] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:04:51 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:04:52.930705 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-49a5b9ee-57dd-44eb-a8c0-3975d33cd8c2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:04:52.931326 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-49a5b9ee-57dd-44eb-a8c0-3975d33cd8c2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:04:52.937956 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49a5b9ee-57dd-44eb-a8c0-3975d33cd8c2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:52.938449 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49a5b9ee-57dd-44eb-a8c0-3975d33cd8c2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:52.938893 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49a5b9ee-57dd-44eb-a8c0-3975d33cd8c2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:52.939590 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49a5b9ee-57dd-44eb-a8c0-3975d33cd8c2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:52.940048 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49a5b9ee-57dd-44eb-a8c0-3975d33cd8c2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:52.940477 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-49a5b9ee-57dd-44eb-a8c0-3975d33cd8c2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:53.077141 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-49a5b9ee-57dd-44eb-a8c0-3975d33cd8c2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:04:53.086171 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-49a5b9ee-57dd-44eb-a8c0-3975d33cd8c2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1728 microversion: 2.1 time: 0.159403 Oct 26 14:04:53.086750 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3656/7335] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:04:52 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:04:54.110033 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-33be3f1e-b386-47f0-9047-64bd73070f28 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:04:54.110792 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-33be3f1e-b386-47f0-9047-64bd73070f28 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:04:54.118215 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33be3f1e-b386-47f0-9047-64bd73070f28 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:54.118729 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33be3f1e-b386-47f0-9047-64bd73070f28 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:54.119230 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33be3f1e-b386-47f0-9047-64bd73070f28 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:54.119967 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33be3f1e-b386-47f0-9047-64bd73070f28 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:54.120515 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33be3f1e-b386-47f0-9047-64bd73070f28 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:54.121343 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33be3f1e-b386-47f0-9047-64bd73070f28 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:54.260342 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-33be3f1e-b386-47f0-9047-64bd73070f28 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:04:54.269669 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-33be3f1e-b386-47f0-9047-64bd73070f28 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1728 microversion: 2.1 time: 0.163855 Oct 26 14:04:54.270253 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3680/7336] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:04:54 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:04:55.295840 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-86ed21af-3bf6-4889-8ede-145edaba78b4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:04:55.296452 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-86ed21af-3bf6-4889-8ede-145edaba78b4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:04:55.304217 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-86ed21af-3bf6-4889-8ede-145edaba78b4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:55.304703 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-86ed21af-3bf6-4889-8ede-145edaba78b4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:55.305142 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-86ed21af-3bf6-4889-8ede-145edaba78b4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:55.305855 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-86ed21af-3bf6-4889-8ede-145edaba78b4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:55.306309 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-86ed21af-3bf6-4889-8ede-145edaba78b4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:55.306735 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-86ed21af-3bf6-4889-8ede-145edaba78b4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:55.439247 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-86ed21af-3bf6-4889-8ede-145edaba78b4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:04:55.447479 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-86ed21af-3bf6-4889-8ede-145edaba78b4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1728 microversion: 2.1 time: 0.155536 Oct 26 14:04:55.448048 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3657/7337] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:04:55 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:04:56.471600 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0ee26a25-ac8a-4f55-aa12-18f4245591a0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:04:56.472239 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0ee26a25-ac8a-4f55-aa12-18f4245591a0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:04:56.479109 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ee26a25-ac8a-4f55-aa12-18f4245591a0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:56.479608 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ee26a25-ac8a-4f55-aa12-18f4245591a0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:56.480061 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ee26a25-ac8a-4f55-aa12-18f4245591a0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:56.480761 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ee26a25-ac8a-4f55-aa12-18f4245591a0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:56.481230 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ee26a25-ac8a-4f55-aa12-18f4245591a0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:56.481777 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ee26a25-ac8a-4f55-aa12-18f4245591a0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:56.614250 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0ee26a25-ac8a-4f55-aa12-18f4245591a0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:04:56.622535 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0ee26a25-ac8a-4f55-aa12-18f4245591a0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1728 microversion: 2.1 time: 0.155631 Oct 26 14:04:56.623110 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3681/7338] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:04:56 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:04:57.646799 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a5ce759c-5d2d-4d63-ae21-0343cf02a22b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:04:57.647419 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a5ce759c-5d2d-4d63-ae21-0343cf02a22b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:04:57.654360 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5ce759c-5d2d-4d63-ae21-0343cf02a22b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:57.654844 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5ce759c-5d2d-4d63-ae21-0343cf02a22b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:57.655284 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5ce759c-5d2d-4d63-ae21-0343cf02a22b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:57.655975 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5ce759c-5d2d-4d63-ae21-0343cf02a22b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:57.656435 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5ce759c-5d2d-4d63-ae21-0343cf02a22b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:57.656865 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5ce759c-5d2d-4d63-ae21-0343cf02a22b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:57.784731 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a5ce759c-5d2d-4d63-ae21-0343cf02a22b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:04:57.793001 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a5ce759c-5d2d-4d63-ae21-0343cf02a22b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1728 microversion: 2.1 time: 0.150884 Oct 26 14:04:57.793600 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3658/7339] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:04:57 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:04:58.817908 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8250e745-e850-4d51-af91-5f2f33834cff tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:04:58.818570 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8250e745-e850-4d51-af91-5f2f33834cff tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:04:58.825454 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8250e745-e850-4d51-af91-5f2f33834cff tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:58.825986 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8250e745-e850-4d51-af91-5f2f33834cff tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:58.826450 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8250e745-e850-4d51-af91-5f2f33834cff tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:58.827165 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8250e745-e850-4d51-af91-5f2f33834cff tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:58.827642 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8250e745-e850-4d51-af91-5f2f33834cff tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:04:58.828270 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8250e745-e850-4d51-af91-5f2f33834cff tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:04:58.960083 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8250e745-e850-4d51-af91-5f2f33834cff tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:04:58.968444 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8250e745-e850-4d51-af91-5f2f33834cff tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1728 microversion: 2.1 time: 0.155321 Oct 26 14:04:58.969022 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3682/7340] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:04:58 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:04:59.991901 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cf279aae-2252-48e8-91f3-d2f3c3f06a4d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:04:59.992521 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cf279aae-2252-48e8-91f3-d2f3c3f06a4d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:04:59.999384 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf279aae-2252-48e8-91f3-d2f3c3f06a4d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:04:59.999880 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf279aae-2252-48e8-91f3-d2f3c3f06a4d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:00.000325 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf279aae-2252-48e8-91f3-d2f3c3f06a4d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:00.001026 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf279aae-2252-48e8-91f3-d2f3c3f06a4d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:00.001643 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf279aae-2252-48e8-91f3-d2f3c3f06a4d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:00.002108 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf279aae-2252-48e8-91f3-d2f3c3f06a4d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:00.132156 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cf279aae-2252-48e8-91f3-d2f3c3f06a4d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:05:00.140366 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cf279aae-2252-48e8-91f3-d2f3c3f06a4d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1728 microversion: 2.1 time: 0.152462 Oct 26 14:05:00.140945 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3659/7341] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:04:59 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:05:01.164043 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fc34e0fb-440f-49a6-8391-21f1113c1d43 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:01.164581 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fc34e0fb-440f-49a6-8391-21f1113c1d43 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:01.167377 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=33 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:05:01.172715 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fc34e0fb-440f-49a6-8391-21f1113c1d43 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:01.173281 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fc34e0fb-440f-49a6-8391-21f1113c1d43 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:01.173883 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fc34e0fb-440f-49a6-8391-21f1113c1d43 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:01.174617 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fc34e0fb-440f-49a6-8391-21f1113c1d43 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:01.175092 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fc34e0fb-440f-49a6-8391-21f1113c1d43 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:01.175537 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fc34e0fb-440f-49a6-8391-21f1113c1d43 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:01.178345 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:05:01.312354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fc34e0fb-440f-49a6-8391-21f1113c1d43 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:05:01.321191 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fc34e0fb-440f-49a6-8391-21f1113c1d43 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1728 microversion: 2.1 time: 0.161577 Oct 26 14:05:01.321810 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3683/7342] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:05:01 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:05:02.346017 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0c265d81-5e5b-4eb5-875f-e7bd301a064e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:02.346638 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0c265d81-5e5b-4eb5-875f-e7bd301a064e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:02.349338 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=29 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:05:02.354700 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c265d81-5e5b-4eb5-875f-e7bd301a064e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:02.355186 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c265d81-5e5b-4eb5-875f-e7bd301a064e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:02.355627 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c265d81-5e5b-4eb5-875f-e7bd301a064e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:02.356326 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c265d81-5e5b-4eb5-875f-e7bd301a064e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:02.356786 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c265d81-5e5b-4eb5-875f-e7bd301a064e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:02.357220 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c265d81-5e5b-4eb5-875f-e7bd301a064e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:02.359988 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=85 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:05:02.489505 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0c265d81-5e5b-4eb5-875f-e7bd301a064e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:05:02.497739 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0c265d81-5e5b-4eb5-875f-e7bd301a064e tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1725 microversion: 2.1 time: 0.156351 Oct 26 14:05:02.498324 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3660/7343] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:05:02 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:05:02.520949 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d7220c96-8bd2-4176-8d8f-af5947a7a577 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:05:02.521526 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d7220c96-8bd2-4176-8d8f-af5947a7a577 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:02.528292 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d7220c96-8bd2-4176-8d8f-af5947a7a577 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:02.528793 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d7220c96-8bd2-4176-8d8f-af5947a7a577 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:02.529247 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d7220c96-8bd2-4176-8d8f-af5947a7a577 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:02.529982 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d7220c96-8bd2-4176-8d8f-af5947a7a577 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:02.530456 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d7220c96-8bd2-4176-8d8f-af5947a7a577 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:02.530900 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d7220c96-8bd2-4176-8d8f-af5947a7a577 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:02.569873 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d7220c96-8bd2-4176-8d8f-af5947a7a577 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:02.570379 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d7220c96-8bd2-4176-8d8f-af5947a7a577 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:02.570831 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d7220c96-8bd2-4176-8d8f-af5947a7a577 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:02.571572 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d7220c96-8bd2-4176-8d8f-af5947a7a577 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:02.572041 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d7220c96-8bd2-4176-8d8f-af5947a7a577 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:02.572481 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d7220c96-8bd2-4176-8d8f-af5947a7a577 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:02.592670 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-d7220c96-8bd2-4176-8d8f-af5947a7a577 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Getting quotas for project 73688cef84664d7db69a39fcbffb6e65. Resources: {'cores', 'ram'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 14:05:02.598614 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-d7220c96-8bd2-4176-8d8f-af5947a7a577 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Getting quotas for user dc4fe5238edd40db8d203790e2aab143 and project 73688cef84664d7db69a39fcbffb6e65. Resources: {'cores', 'ram'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 14:05:02.699249 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d7220c96-8bd2-4176-8d8f-af5947a7a577 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "POST /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244/action" status: 202 len: 0 microversion: 2.1 time: 0.182065 Oct 26 14:05:02.699860 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3684/7344] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 14:05:02 2022] POST /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 14:05:02.708650 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0e05ee05-549d-4be9-9470-96c35535cd22 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:02.709305 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0e05ee05-549d-4be9-9470-96c35535cd22 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:02.715487 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0e05ee05-549d-4be9-9470-96c35535cd22 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:02.716277 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0e05ee05-549d-4be9-9470-96c35535cd22 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:02.716396 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0e05ee05-549d-4be9-9470-96c35535cd22 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:02.717099 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0e05ee05-549d-4be9-9470-96c35535cd22 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:02.717621 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0e05ee05-549d-4be9-9470-96c35535cd22 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:02.718051 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0e05ee05-549d-4be9-9470-96c35535cd22 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:02.860338 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0e05ee05-549d-4be9-9470-96c35535cd22 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:05:02.869425 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0e05ee05-549d-4be9-9470-96c35535cd22 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1724 microversion: 2.1 time: 0.165171 Oct 26 14:05:02.870136 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3661/7345] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:05:02 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:05:03.895852 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-386a1b2f-e8ea-4b5c-8d0f-6848eb92115a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:03.896565 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-386a1b2f-e8ea-4b5c-8d0f-6848eb92115a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:03.903575 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-386a1b2f-e8ea-4b5c-8d0f-6848eb92115a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:03.904098 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-386a1b2f-e8ea-4b5c-8d0f-6848eb92115a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:03.904551 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-386a1b2f-e8ea-4b5c-8d0f-6848eb92115a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:03.905283 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-386a1b2f-e8ea-4b5c-8d0f-6848eb92115a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:03.905789 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-386a1b2f-e8ea-4b5c-8d0f-6848eb92115a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:03.906230 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-386a1b2f-e8ea-4b5c-8d0f-6848eb92115a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:04.039012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-386a1b2f-e8ea-4b5c-8d0f-6848eb92115a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:05:04.047194 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-386a1b2f-e8ea-4b5c-8d0f-6848eb92115a tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1724 microversion: 2.1 time: 0.156658 Oct 26 14:05:04.047761 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3685/7346] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:05:03 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:05:04.886415 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-25ce8bfe-1585-4f1b-b73a-d6afcb65a216 req-a1b175ee-8a66-4223-a29a-424e9286e8fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a3c104a-e134-4a65-9cbe-4c8960b1c244", "name": "network-vif-plugged", "status": "completed", "tag": "9193c976-4d09-4352-890e-7cdcc0a3c8db"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:05:04.897311 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-25ce8bfe-1585-4f1b-b73a-d6afcb65a216 req-a1b175ee-8a66-4223-a29a-424e9286e8fd service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:04.897941 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-25ce8bfe-1585-4f1b-b73a-d6afcb65a216 req-a1b175ee-8a66-4223-a29a-424e9286e8fd service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:04.898385 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-25ce8bfe-1585-4f1b-b73a-d6afcb65a216 req-a1b175ee-8a66-4223-a29a-424e9286e8fd service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:04.911502 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-25ce8bfe-1585-4f1b-b73a-d6afcb65a216 req-a1b175ee-8a66-4223-a29a-424e9286e8fd service nova] Creating event network-vif-plugged:9193c976-4d09-4352-890e-7cdcc0a3c8db for instance 0a3c104a-e134-4a65-9cbe-4c8960b1c244 on n-h1-862686-1 Oct 26 14:05:04.916981 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [req-25ce8bfe-1585-4f1b-b73a-d6afcb65a216 req-a1b175ee-8a66-4223-a29a-424e9286e8fd service nova] Instance 0a3c104a-e134-4a65-9cbe-4c8960b1c244 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862686-1', 'n-h1-862686-1'} {{(pid=120597) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 14:05:04.929699 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-25ce8bfe-1585-4f1b-b73a-d6afcb65a216 req-a1b175ee-8a66-4223-a29a-424e9286e8fd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046910 Oct 26 14:05:04.930323 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3662/7347] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:05:05.071340 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-49fd66f6-9e39-4e7c-867d-0b01fe46a6b5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:05.071977 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-49fd66f6-9e39-4e7c-867d-0b01fe46a6b5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:05.078854 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-49fd66f6-9e39-4e7c-867d-0b01fe46a6b5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:05.079465 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-49fd66f6-9e39-4e7c-867d-0b01fe46a6b5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:05.079942 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-49fd66f6-9e39-4e7c-867d-0b01fe46a6b5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:05.080694 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-49fd66f6-9e39-4e7c-867d-0b01fe46a6b5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:05.081167 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-49fd66f6-9e39-4e7c-867d-0b01fe46a6b5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:05.081647 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-49fd66f6-9e39-4e7c-867d-0b01fe46a6b5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:05.215601 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-49fd66f6-9e39-4e7c-867d-0b01fe46a6b5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:05:05.224601 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-49fd66f6-9e39-4e7c-867d-0b01fe46a6b5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1724 microversion: 2.1 time: 0.157408 Oct 26 14:05:05.225166 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3686/7348] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:05:05 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:05:06.249914 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6749e4a2-412d-49df-84f8-e5ded7856861 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:06.251283 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6749e4a2-412d-49df-84f8-e5ded7856861 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:06.258148 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6749e4a2-412d-49df-84f8-e5ded7856861 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:06.258631 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6749e4a2-412d-49df-84f8-e5ded7856861 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:06.259079 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6749e4a2-412d-49df-84f8-e5ded7856861 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:06.259785 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6749e4a2-412d-49df-84f8-e5ded7856861 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:06.260251 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6749e4a2-412d-49df-84f8-e5ded7856861 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:06.260689 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6749e4a2-412d-49df-84f8-e5ded7856861 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:06.396850 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6749e4a2-412d-49df-84f8-e5ded7856861 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:05:06.406584 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6749e4a2-412d-49df-84f8-e5ded7856861 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1724 microversion: 2.1 time: 0.162049 Oct 26 14:05:06.407166 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3663/7349] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:05:06 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:05:07.432882 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d48880bd-c409-42b5-8bab-47132c45a47b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:07.433454 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d48880bd-c409-42b5-8bab-47132c45a47b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:07.440924 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d48880bd-c409-42b5-8bab-47132c45a47b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:07.441500 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d48880bd-c409-42b5-8bab-47132c45a47b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:07.441958 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d48880bd-c409-42b5-8bab-47132c45a47b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:07.442663 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d48880bd-c409-42b5-8bab-47132c45a47b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:07.443132 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d48880bd-c409-42b5-8bab-47132c45a47b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:07.443567 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d48880bd-c409-42b5-8bab-47132c45a47b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:07.579081 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d48880bd-c409-42b5-8bab-47132c45a47b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:05:07.588004 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d48880bd-c409-42b5-8bab-47132c45a47b tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1724 microversion: 2.1 time: 0.159187 Oct 26 14:05:07.588581 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3687/7350] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:05:07 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:05:08.207063 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-fb0dc04c-9fed-4dec-8bce-3b6716e422e4 req-e978dbab-89c8-44d9-979c-2e7a4e5db026 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a3c104a-e134-4a65-9cbe-4c8960b1c244", "name": "network-vif-unplugged", "status": "completed", "tag": "9193c976-4d09-4352-890e-7cdcc0a3c8db"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:05:08.217744 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-fb0dc04c-9fed-4dec-8bce-3b6716e422e4 req-e978dbab-89c8-44d9-979c-2e7a4e5db026 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:08.218324 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-fb0dc04c-9fed-4dec-8bce-3b6716e422e4 req-e978dbab-89c8-44d9-979c-2e7a4e5db026 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:08.218832 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-fb0dc04c-9fed-4dec-8bce-3b6716e422e4 req-e978dbab-89c8-44d9-979c-2e7a4e5db026 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:08.232987 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-fb0dc04c-9fed-4dec-8bce-3b6716e422e4 req-e978dbab-89c8-44d9-979c-2e7a4e5db026 service nova] Creating event network-vif-unplugged:9193c976-4d09-4352-890e-7cdcc0a3c8db for instance 0a3c104a-e134-4a65-9cbe-4c8960b1c244 on n-h2-862686-1 Oct 26 14:05:08.238586 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [req-fb0dc04c-9fed-4dec-8bce-3b6716e422e4 req-e978dbab-89c8-44d9-979c-2e7a4e5db026 service nova] Instance 0a3c104a-e134-4a65-9cbe-4c8960b1c244 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862686-1', 'n-h1-862686-1'} {{(pid=120597) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 14:05:08.249738 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-fb0dc04c-9fed-4dec-8bce-3b6716e422e4 req-e978dbab-89c8-44d9-979c-2e7a4e5db026 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046921 Oct 26 14:05:08.250366 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3664/7351] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:05:08.613998 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2ead077a-2c8e-4dcc-8e74-c29283fcf1dc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:08.614813 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2ead077a-2c8e-4dcc-8e74-c29283fcf1dc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:08.622953 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ead077a-2c8e-4dcc-8e74-c29283fcf1dc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:08.623491 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ead077a-2c8e-4dcc-8e74-c29283fcf1dc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:08.623984 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ead077a-2c8e-4dcc-8e74-c29283fcf1dc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:08.624666 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ead077a-2c8e-4dcc-8e74-c29283fcf1dc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:08.625143 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ead077a-2c8e-4dcc-8e74-c29283fcf1dc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:08.625621 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ead077a-2c8e-4dcc-8e74-c29283fcf1dc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:08.864233 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2ead077a-2c8e-4dcc-8e74-c29283fcf1dc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:05:08.873338 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2ead077a-2c8e-4dcc-8e74-c29283fcf1dc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1724 microversion: 2.1 time: 0.265958 Oct 26 14:05:08.873970 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3688/7352] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:05:08 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1724 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:05:09.898205 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-248d832f-c911-4436-91fd-3ea3823136c0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:09.899021 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-248d832f-c911-4436-91fd-3ea3823136c0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:09.906497 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-248d832f-c911-4436-91fd-3ea3823136c0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:09.907118 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-248d832f-c911-4436-91fd-3ea3823136c0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:09.907570 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-248d832f-c911-4436-91fd-3ea3823136c0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:09.908295 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-248d832f-c911-4436-91fd-3ea3823136c0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:09.908760 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-248d832f-c911-4436-91fd-3ea3823136c0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:09.910478 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-248d832f-c911-4436-91fd-3ea3823136c0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:10.043741 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-248d832f-c911-4436-91fd-3ea3823136c0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:05:10.052937 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-248d832f-c911-4436-91fd-3ea3823136c0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1724 microversion: 2.1 time: 0.159149 Oct 26 14:05:10.053554 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3665/7353] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:05:09 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:05:10.288091 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-8d868d94-b4f0-447a-8909-272b6f4c7f74 req-2bd6cb68-87c2-4536-bfe6-b65f7ae6ec44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a3c104a-e134-4a65-9cbe-4c8960b1c244", "tag": "9193c976-4d09-4352-890e-7cdcc0a3c8db"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:05:10.298427 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8d868d94-b4f0-447a-8909-272b6f4c7f74 req-2bd6cb68-87c2-4536-bfe6-b65f7ae6ec44 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:10.298923 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8d868d94-b4f0-447a-8909-272b6f4c7f74 req-2bd6cb68-87c2-4536-bfe6-b65f7ae6ec44 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:10.299371 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8d868d94-b4f0-447a-8909-272b6f4c7f74 req-2bd6cb68-87c2-4536-bfe6-b65f7ae6ec44 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:10.311965 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-8d868d94-b4f0-447a-8909-272b6f4c7f74 req-2bd6cb68-87c2-4536-bfe6-b65f7ae6ec44 service nova] Creating event network-changed:9193c976-4d09-4352-890e-7cdcc0a3c8db for instance 0a3c104a-e134-4a65-9cbe-4c8960b1c244 on n-h2-862686-1 Oct 26 14:05:10.317287 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [req-8d868d94-b4f0-447a-8909-272b6f4c7f74 req-2bd6cb68-87c2-4536-bfe6-b65f7ae6ec44 service nova] Instance 0a3c104a-e134-4a65-9cbe-4c8960b1c244 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862686-1', 'n-h1-862686-1'} {{(pid=120598) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 14:05:10.328121 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-8d868d94-b4f0-447a-8909-272b6f4c7f74 req-2bd6cb68-87c2-4536-bfe6-b65f7ae6ec44 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044601 Oct 26 14:05:10.329103 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3689/7354] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:05:11.076200 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c077a1ac-f07e-4695-9b34-6dab351b74e5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:11.077525 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c077a1ac-f07e-4695-9b34-6dab351b74e5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:11.085257 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c077a1ac-f07e-4695-9b34-6dab351b74e5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:11.085902 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c077a1ac-f07e-4695-9b34-6dab351b74e5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:11.086348 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c077a1ac-f07e-4695-9b34-6dab351b74e5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:11.087048 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c077a1ac-f07e-4695-9b34-6dab351b74e5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:11.087506 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c077a1ac-f07e-4695-9b34-6dab351b74e5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:11.087948 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c077a1ac-f07e-4695-9b34-6dab351b74e5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:11.232291 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c077a1ac-f07e-4695-9b34-6dab351b74e5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:05:11.241028 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c077a1ac-f07e-4695-9b34-6dab351b74e5 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1724 microversion: 2.1 time: 0.168890 Oct 26 14:05:11.241836 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3666/7355] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:05:11 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:05:12.266014 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c0bfb8aa-eb39-442d-9e13-5752ce55616d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:12.266635 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c0bfb8aa-eb39-442d-9e13-5752ce55616d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:12.273883 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0bfb8aa-eb39-442d-9e13-5752ce55616d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:12.274391 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0bfb8aa-eb39-442d-9e13-5752ce55616d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:12.274839 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0bfb8aa-eb39-442d-9e13-5752ce55616d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:12.275560 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0bfb8aa-eb39-442d-9e13-5752ce55616d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:12.276027 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0bfb8aa-eb39-442d-9e13-5752ce55616d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:12.276461 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0bfb8aa-eb39-442d-9e13-5752ce55616d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:12.416543 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c0bfb8aa-eb39-442d-9e13-5752ce55616d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:05:12.425683 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c0bfb8aa-eb39-442d-9e13-5752ce55616d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1724 microversion: 2.1 time: 0.165038 Oct 26 14:05:12.426268 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3690/7356] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:05:12 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:05:13.448564 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ea6c87ba-ea19-4b8c-b607-840ce1760234 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:13.449107 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ea6c87ba-ea19-4b8c-b607-840ce1760234 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:13.457418 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ea6c87ba-ea19-4b8c-b607-840ce1760234 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:13.457929 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ea6c87ba-ea19-4b8c-b607-840ce1760234 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:13.458373 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ea6c87ba-ea19-4b8c-b607-840ce1760234 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:13.459104 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ea6c87ba-ea19-4b8c-b607-840ce1760234 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:13.459583 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ea6c87ba-ea19-4b8c-b607-840ce1760234 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:13.460009 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ea6c87ba-ea19-4b8c-b607-840ce1760234 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:13.594061 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ea6c87ba-ea19-4b8c-b607-840ce1760234 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:05:13.603241 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ea6c87ba-ea19-4b8c-b607-840ce1760234 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1724 microversion: 2.1 time: 0.158817 Oct 26 14:05:13.603822 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3667/7357] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:05:13 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 14:05:14.626716 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-71c0ae1b-8b33-48f0-b88e-c7bf1df3ede0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:14.627265 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-71c0ae1b-8b33-48f0-b88e-c7bf1df3ede0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:14.629368 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:05:14.635744 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-71c0ae1b-8b33-48f0-b88e-c7bf1df3ede0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:14.636235 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-71c0ae1b-8b33-48f0-b88e-c7bf1df3ede0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:14.636681 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-71c0ae1b-8b33-48f0-b88e-c7bf1df3ede0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:14.637380 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-71c0ae1b-8b33-48f0-b88e-c7bf1df3ede0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:14.637872 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-71c0ae1b-8b33-48f0-b88e-c7bf1df3ede0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:14.638309 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-71c0ae1b-8b33-48f0-b88e-c7bf1df3ede0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:14.781300 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-71c0ae1b-8b33-48f0-b88e-c7bf1df3ede0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:05:14.790697 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-71c0ae1b-8b33-48f0-b88e-c7bf1df3ede0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1724 microversion: 2.1 time: 0.168069 Oct 26 14:05:14.791282 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3691/7358] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:05:14 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 14:05:15.816011 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-55152e08-b0af-4b40-8507-9e2e9e38d022 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:15.816657 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-55152e08-b0af-4b40-8507-9e2e9e38d022 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:15.823604 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-55152e08-b0af-4b40-8507-9e2e9e38d022 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:15.824096 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-55152e08-b0af-4b40-8507-9e2e9e38d022 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:15.824549 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-55152e08-b0af-4b40-8507-9e2e9e38d022 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:15.825250 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-55152e08-b0af-4b40-8507-9e2e9e38d022 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:15.825745 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-55152e08-b0af-4b40-8507-9e2e9e38d022 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:15.826177 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-55152e08-b0af-4b40-8507-9e2e9e38d022 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:15.962636 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-55152e08-b0af-4b40-8507-9e2e9e38d022 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:05:15.971030 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-55152e08-b0af-4b40-8507-9e2e9e38d022 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1724 microversion: 2.1 time: 0.159586 Oct 26 14:05:15.972257 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3668/7359] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:05:15 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:05:16.996305 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-72a24bbf-96ac-4cfa-bf38-d9bdb66b6008 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:16.997146 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-72a24bbf-96ac-4cfa-bf38-d9bdb66b6008 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:17.004785 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72a24bbf-96ac-4cfa-bf38-d9bdb66b6008 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:17.005288 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72a24bbf-96ac-4cfa-bf38-d9bdb66b6008 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:17.005800 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72a24bbf-96ac-4cfa-bf38-d9bdb66b6008 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:17.006569 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72a24bbf-96ac-4cfa-bf38-d9bdb66b6008 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:17.007083 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72a24bbf-96ac-4cfa-bf38-d9bdb66b6008 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:17.007528 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-72a24bbf-96ac-4cfa-bf38-d9bdb66b6008 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:17.142907 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-72a24bbf-96ac-4cfa-bf38-d9bdb66b6008 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:05:17.151142 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-72a24bbf-96ac-4cfa-bf38-d9bdb66b6008 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1724 microversion: 2.1 time: 0.158797 Oct 26 14:05:17.151735 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3692/7360] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:05:16 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:05:18.174851 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-432337fb-ef9c-4d51-a6be-43570a503dfe tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:18.175531 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-432337fb-ef9c-4d51-a6be-43570a503dfe tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:18.182057 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-432337fb-ef9c-4d51-a6be-43570a503dfe tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:18.182549 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-432337fb-ef9c-4d51-a6be-43570a503dfe tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:18.182996 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-432337fb-ef9c-4d51-a6be-43570a503dfe tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:18.183691 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-432337fb-ef9c-4d51-a6be-43570a503dfe tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:18.184151 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-432337fb-ef9c-4d51-a6be-43570a503dfe tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:18.184588 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-432337fb-ef9c-4d51-a6be-43570a503dfe tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:18.314129 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-432337fb-ef9c-4d51-a6be-43570a503dfe tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:05:18.323025 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-432337fb-ef9c-4d51-a6be-43570a503dfe tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1724 microversion: 2.1 time: 0.152297 Oct 26 14:05:18.323590 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3669/7361] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:05:18 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:05:19.347841 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a4f9cbee-64d6-42bf-b723-0665f5cd6262 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:19.348529 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a4f9cbee-64d6-42bf-b723-0665f5cd6262 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:19.354900 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4f9cbee-64d6-42bf-b723-0665f5cd6262 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:19.355404 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4f9cbee-64d6-42bf-b723-0665f5cd6262 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:19.355872 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4f9cbee-64d6-42bf-b723-0665f5cd6262 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:19.356592 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4f9cbee-64d6-42bf-b723-0665f5cd6262 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:19.357102 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4f9cbee-64d6-42bf-b723-0665f5cd6262 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:19.357577 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a4f9cbee-64d6-42bf-b723-0665f5cd6262 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:19.489144 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a4f9cbee-64d6-42bf-b723-0665f5cd6262 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:05:19.497384 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a4f9cbee-64d6-42bf-b723-0665f5cd6262 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1724 microversion: 2.1 time: 0.154197 Oct 26 14:05:19.497992 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3693/7362] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:05:19 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:05:20.520251 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f9e602af-a740-4548-b9ad-8febf826abb1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:20.520857 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f9e602af-a740-4548-b9ad-8febf826abb1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:20.528108 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f9e602af-a740-4548-b9ad-8febf826abb1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:20.528604 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f9e602af-a740-4548-b9ad-8febf826abb1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:20.529044 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f9e602af-a740-4548-b9ad-8febf826abb1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:20.529770 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f9e602af-a740-4548-b9ad-8febf826abb1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:20.530231 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f9e602af-a740-4548-b9ad-8febf826abb1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:20.530659 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f9e602af-a740-4548-b9ad-8febf826abb1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:20.665229 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f9e602af-a740-4548-b9ad-8febf826abb1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:05:20.673420 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f9e602af-a740-4548-b9ad-8febf826abb1 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1724 microversion: 2.1 time: 0.157231 Oct 26 14:05:20.674016 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3670/7363] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:05:20 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:05:21.697842 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b3dff9f1-2079-4ab3-8a0d-d74935ff6fc4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:21.698465 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b3dff9f1-2079-4ab3-8a0d-d74935ff6fc4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:21.704862 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3dff9f1-2079-4ab3-8a0d-d74935ff6fc4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:21.705351 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3dff9f1-2079-4ab3-8a0d-d74935ff6fc4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:21.706353 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3dff9f1-2079-4ab3-8a0d-d74935ff6fc4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:21.707056 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3dff9f1-2079-4ab3-8a0d-d74935ff6fc4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:21.707518 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3dff9f1-2079-4ab3-8a0d-d74935ff6fc4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:21.707952 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3dff9f1-2079-4ab3-8a0d-d74935ff6fc4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:21.849099 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b3dff9f1-2079-4ab3-8a0d-d74935ff6fc4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:05:21.858030 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b3dff9f1-2079-4ab3-8a0d-d74935ff6fc4 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1717 microversion: 2.1 time: 0.163977 Oct 26 14:05:21.858851 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3694/7364] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:05:21 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1717 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:05:21.881978 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dc332115-f2e9-434b-adb6-0643650185c3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:21.882590 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-dc332115-f2e9-434b-adb6-0643650185c3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:21.889571 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc332115-f2e9-434b-adb6-0643650185c3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:21.890061 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc332115-f2e9-434b-adb6-0643650185c3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:21.890497 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc332115-f2e9-434b-adb6-0643650185c3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:21.891194 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc332115-f2e9-434b-adb6-0643650185c3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:21.891644 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc332115-f2e9-434b-adb6-0643650185c3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:21.892068 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc332115-f2e9-434b-adb6-0643650185c3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:22.023632 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-dc332115-f2e9-434b-adb6-0643650185c3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:05:22.031874 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-dc332115-f2e9-434b-adb6-0643650185c3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1717 microversion: 2.1 time: 0.154500 Oct 26 14:05:22.032472 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3671/7365] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:05:21 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1717 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:05:22.054463 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0707907e-ecfd-4aef-9615-f5798696d79d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:22.055087 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0707907e-ecfd-4aef-9615-f5798696d79d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:22.060940 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0707907e-ecfd-4aef-9615-f5798696d79d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:22.061434 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0707907e-ecfd-4aef-9615-f5798696d79d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:22.061921 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0707907e-ecfd-4aef-9615-f5798696d79d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:22.062633 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0707907e-ecfd-4aef-9615-f5798696d79d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:22.063102 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0707907e-ecfd-4aef-9615-f5798696d79d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:22.063543 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0707907e-ecfd-4aef-9615-f5798696d79d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:22.198025 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0707907e-ecfd-4aef-9615-f5798696d79d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:05:22.206831 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0707907e-ecfd-4aef-9615-f5798696d79d tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1717 microversion: 2.1 time: 0.156252 Oct 26 14:05:22.207407 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3695/7366] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:05:22 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1717 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:05:22.229414 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dd036ec9-aa5e-48ce-84ce-5b2dd2ff15d0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:22.229901 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-dd036ec9-aa5e-48ce-84ce-5b2dd2ff15d0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:22.235917 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd036ec9-aa5e-48ce-84ce-5b2dd2ff15d0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:22.236401 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd036ec9-aa5e-48ce-84ce-5b2dd2ff15d0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:22.237304 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd036ec9-aa5e-48ce-84ce-5b2dd2ff15d0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:22.238065 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd036ec9-aa5e-48ce-84ce-5b2dd2ff15d0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:22.238520 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd036ec9-aa5e-48ce-84ce-5b2dd2ff15d0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:22.238949 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dd036ec9-aa5e-48ce-84ce-5b2dd2ff15d0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:22.264468 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-dd036ec9-aa5e-48ce-84ce-5b2dd2ff15d0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 14:05:22.342558 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-dd036ec9-aa5e-48ce-84ce-5b2dd2ff15d0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 204 len: 0 microversion: 2.1 time: 0.116800 Oct 26 14:05:22.343280 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3672/7367] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 14:05:22 2022] DELETE /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 14:05:22.353326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6332bc4f-e6d1-4a4c-a0d2-ba932667f0f3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:22.354089 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6332bc4f-e6d1-4a4c-a0d2-ba932667f0f3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:22.360072 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6332bc4f-e6d1-4a4c-a0d2-ba932667f0f3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:22.360565 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6332bc4f-e6d1-4a4c-a0d2-ba932667f0f3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:22.361034 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6332bc4f-e6d1-4a4c-a0d2-ba932667f0f3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:22.362314 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6332bc4f-e6d1-4a4c-a0d2-ba932667f0f3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:22.363043 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6332bc4f-e6d1-4a4c-a0d2-ba932667f0f3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:22.363261 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6332bc4f-e6d1-4a4c-a0d2-ba932667f0f3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:22.492893 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6332bc4f-e6d1-4a4c-a0d2-ba932667f0f3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:05:22.501254 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6332bc4f-e6d1-4a4c-a0d2-ba932667f0f3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1723 microversion: 2.1 time: 0.152898 Oct 26 14:05:22.501872 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3696/7368] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:05:22 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:05:23.416193 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-735c7af4-0334-406f-8e43-99a2e2c66c2d req-2e86aba7-184b-4365-a41e-cd850320e854 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a3c104a-e134-4a65-9cbe-4c8960b1c244", "name": "network-vif-plugged", "status": "completed", "tag": "9193c976-4d09-4352-890e-7cdcc0a3c8db"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:05:23.426736 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-735c7af4-0334-406f-8e43-99a2e2c66c2d req-2e86aba7-184b-4365-a41e-cd850320e854 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:23.427421 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-735c7af4-0334-406f-8e43-99a2e2c66c2d req-2e86aba7-184b-4365-a41e-cd850320e854 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:23.427687 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-735c7af4-0334-406f-8e43-99a2e2c66c2d req-2e86aba7-184b-4365-a41e-cd850320e854 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:23.439501 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-735c7af4-0334-406f-8e43-99a2e2c66c2d req-2e86aba7-184b-4365-a41e-cd850320e854 service nova] Creating event network-vif-plugged:9193c976-4d09-4352-890e-7cdcc0a3c8db for instance 0a3c104a-e134-4a65-9cbe-4c8960b1c244 on n-h2-862686-1 Oct 26 14:05:23.444404 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-735c7af4-0334-406f-8e43-99a2e2c66c2d req-2e86aba7-184b-4365-a41e-cd850320e854 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032487 Oct 26 14:05:23.445012 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3673/7369] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:05:23.581197 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-903f7ed2-5d57-4153-93dc-e2e439dd2463 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:23.581922 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-903f7ed2-5d57-4153-93dc-e2e439dd2463 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:23.588726 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-903f7ed2-5d57-4153-93dc-e2e439dd2463 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:23.589230 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-903f7ed2-5d57-4153-93dc-e2e439dd2463 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:23.589718 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-903f7ed2-5d57-4153-93dc-e2e439dd2463 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:23.590432 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-903f7ed2-5d57-4153-93dc-e2e439dd2463 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:23.590913 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-903f7ed2-5d57-4153-93dc-e2e439dd2463 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:23.591358 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-903f7ed2-5d57-4153-93dc-e2e439dd2463 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:23.595323 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:05:23.726278 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-903f7ed2-5d57-4153-93dc-e2e439dd2463 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:05:23.734598 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-903f7ed2-5d57-4153-93dc-e2e439dd2463 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1723 microversion: 2.1 time: 0.158015 Oct 26 14:05:23.735249 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3697/7370] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:05:23 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:05:24.759990 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c8c8c1bf-9f5b-4fa1-918b-2ccc91f0ca10 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:24.760701 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c8c8c1bf-9f5b-4fa1-918b-2ccc91f0ca10 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:24.769916 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c8c8c1bf-9f5b-4fa1-918b-2ccc91f0ca10 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:24.770825 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c8c8c1bf-9f5b-4fa1-918b-2ccc91f0ca10 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:24.771372 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c8c8c1bf-9f5b-4fa1-918b-2ccc91f0ca10 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:24.772323 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c8c8c1bf-9f5b-4fa1-918b-2ccc91f0ca10 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:24.772896 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c8c8c1bf-9f5b-4fa1-918b-2ccc91f0ca10 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:24.773398 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c8c8c1bf-9f5b-4fa1-918b-2ccc91f0ca10 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:24.843501 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c8c8c1bf-9f5b-4fa1-918b-2ccc91f0ca10 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:05:24.852195 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c8c8c1bf-9f5b-4fa1-918b-2ccc91f0ca10 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1655 microversion: 2.1 time: 0.097330 Oct 26 14:05:24.852858 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3674/7371] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:05:24 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1655 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:05:24.932879 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-02bf76fb-d5e1-4560-bcac-2009c5bceb50 req-c0ccc391-29b2-484b-99db-6afc82c41e51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a3c104a-e134-4a65-9cbe-4c8960b1c244", "name": "network-vif-deleted", "tag": "9193c976-4d09-4352-890e-7cdcc0a3c8db"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:05:24.946739 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-02bf76fb-d5e1-4560-bcac-2009c5bceb50 req-c0ccc391-29b2-484b-99db-6afc82c41e51 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:24.947240 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-02bf76fb-d5e1-4560-bcac-2009c5bceb50 req-c0ccc391-29b2-484b-99db-6afc82c41e51 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:24.947858 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-02bf76fb-d5e1-4560-bcac-2009c5bceb50 req-c0ccc391-29b2-484b-99db-6afc82c41e51 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:24.959737 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-02bf76fb-d5e1-4560-bcac-2009c5bceb50 req-c0ccc391-29b2-484b-99db-6afc82c41e51 service nova] Creating event network-vif-deleted:9193c976-4d09-4352-890e-7cdcc0a3c8db for instance 0a3c104a-e134-4a65-9cbe-4c8960b1c244 on n-h2-862686-1 Oct 26 14:05:24.965396 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-02bf76fb-d5e1-4560-bcac-2009c5bceb50 req-c0ccc391-29b2-484b-99db-6afc82c41e51 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036432 Oct 26 14:05:24.966035 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3698/7372] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:05:25.879771 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6565cca3-c43a-43b1-8419-02e85e3732d7 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:25.880583 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6565cca3-c43a-43b1-8419-02e85e3732d7 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:25.889597 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6565cca3-c43a-43b1-8419-02e85e3732d7 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:25.890071 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6565cca3-c43a-43b1-8419-02e85e3732d7 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:25.890832 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6565cca3-c43a-43b1-8419-02e85e3732d7 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:25.891721 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6565cca3-c43a-43b1-8419-02e85e3732d7 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:25.892180 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6565cca3-c43a-43b1-8419-02e85e3732d7 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:25.892795 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6565cca3-c43a-43b1-8419-02e85e3732d7 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:25.968326 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6565cca3-c43a-43b1-8419-02e85e3732d7 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:05:25.979835 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6565cca3-c43a-43b1-8419-02e85e3732d7 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1369 microversion: 2.1 time: 0.107177 Oct 26 14:05:25.980585 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3675/7373] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:05:25 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1369 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:05:27.005342 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8697df25-551d-4094-929a-eff112152123 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:27.005990 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8697df25-551d-4094-929a-eff112152123 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:27.013162 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8697df25-551d-4094-929a-eff112152123 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:27.013699 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8697df25-551d-4094-929a-eff112152123 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:27.014165 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8697df25-551d-4094-929a-eff112152123 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:27.014884 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8697df25-551d-4094-929a-eff112152123 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:27.015363 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8697df25-551d-4094-929a-eff112152123 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:27.015816 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8697df25-551d-4094-929a-eff112152123 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:27.084428 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8697df25-551d-4094-929a-eff112152123 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:05:27.093351 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8697df25-551d-4094-929a-eff112152123 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1369 microversion: 2.1 time: 0.093103 Oct 26 14:05:27.093982 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3699/7374] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:05:26 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:05:28.117298 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4464518d-431b-4eee-bee1-6829c9540185 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:28.118085 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4464518d-431b-4eee-bee1-6829c9540185 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:28.125140 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4464518d-431b-4eee-bee1-6829c9540185 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:28.125664 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4464518d-431b-4eee-bee1-6829c9540185 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:28.126113 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4464518d-431b-4eee-bee1-6829c9540185 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:28.126818 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4464518d-431b-4eee-bee1-6829c9540185 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:28.127425 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4464518d-431b-4eee-bee1-6829c9540185 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:28.127938 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4464518d-431b-4eee-bee1-6829c9540185 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:28.143356 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:05:28.196317 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4464518d-431b-4eee-bee1-6829c9540185 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:05:28.204593 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4464518d-431b-4eee-bee1-6829c9540185 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1369 microversion: 2.1 time: 0.091217 Oct 26 14:05:28.205166 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3676/7375] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:05:28 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:05:29.228911 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-899bce4f-d272-4111-86a7-70ce2c0e92d0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:29.229578 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-899bce4f-d272-4111-86a7-70ce2c0e92d0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:29.237009 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-899bce4f-d272-4111-86a7-70ce2c0e92d0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:29.237577 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-899bce4f-d272-4111-86a7-70ce2c0e92d0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:29.238039 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-899bce4f-d272-4111-86a7-70ce2c0e92d0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:29.238765 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-899bce4f-d272-4111-86a7-70ce2c0e92d0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:29.239265 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-899bce4f-d272-4111-86a7-70ce2c0e92d0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:29.239714 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-899bce4f-d272-4111-86a7-70ce2c0e92d0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:29.274540 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-899bce4f-d272-4111-86a7-70ce2c0e92d0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:29.275037 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-899bce4f-d272-4111-86a7-70ce2c0e92d0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:29.276110 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-899bce4f-d272-4111-86a7-70ce2c0e92d0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:29.276572 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-899bce4f-d272-4111-86a7-70ce2c0e92d0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lazy-loading 'fault' on Instance uuid 0a3c104a-e134-4a65-9cbe-4c8960b1c244 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 14:05:29.318618 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-899bce4f-d272-4111-86a7-70ce2c0e92d0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4fe5238edd40db8d203790e2aab143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73688cef84664d7db69a39fcbffb6e65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:05:29.326858 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-899bce4f-d272-4111-86a7-70ce2c0e92d0 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 200 len: 1374 microversion: 2.1 time: 0.101972 Oct 26 14:05:29.327439 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3700/7376] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:05:29 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 1374 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:05:30.351251 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6dd54659-c0b9-4f27-8c2a-e93d41b82ea2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:30.351866 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6dd54659-c0b9-4f27-8c2a-e93d41b82ea2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:30.358718 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6dd54659-c0b9-4f27-8c2a-e93d41b82ea2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:30.359207 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6dd54659-c0b9-4f27-8c2a-e93d41b82ea2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:30.359652 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6dd54659-c0b9-4f27-8c2a-e93d41b82ea2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:30.360347 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6dd54659-c0b9-4f27-8c2a-e93d41b82ea2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:30.360807 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6dd54659-c0b9-4f27-8c2a-e93d41b82ea2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:30.361240 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6dd54659-c0b9-4f27-8c2a-e93d41b82ea2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:30.375349 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-6dd54659-c0b9-4f27-8c2a-e93d41b82ea2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] HTTP exception thrown: Instance 0a3c104a-e134-4a65-9cbe-4c8960b1c244 could not be found. Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6dd54659-c0b9-4f27-8c2a-e93d41b82ea2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Request method failure captured: Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 HTTP/1.1 Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWT1KEf5RrnueWN8kvjsLURQZMRFC3vXj7EkFIPWPtwUH5p4vA-FoRCpopRC9DSlZE_HC0WGwzVujJC0KQhUWeAqCdZ-AE7FaQcXN_vov0P3H2esfpvK2-XfZnMMJsEhdmjY6sxfgyMT-XdJMLKubEhpiDdQ4UTp8oG--QBn1oDlg3bQ Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 73688cef84664d7db69a39fcbffb6e65 Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServerActionsTestJSON-646524856 Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/73688cef84664d7db69a39fcbffb6e65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/73688cef84664d7db69a39fcbffb6e65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_73688cef84664d7db69a39fcbffb6e65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/73688cef84664d7db69a39fcbffb6e65"}]}] Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServerActionsTestJSON-646524856 Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 73688cef84664d7db69a39fcbffb6e65 Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServerActionsTestJSON-646524856 Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServerActionsTestJSON-646524856-project Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: dc4fe5238edd40db8d203790e2aab143 Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServerActionsTestJSON-646524856-project Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 0a3c104a-e134-4a65-9cbe-4c8960b1c244 could not be found. Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '0a3c104a-e134-4a65-9cbe-4c8960b1c244'} Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a3c104a-e134-4a65-9cbe-4c8960b1c244 could not be found. Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a3c104a-e134-4a65-9cbe-4c8960b1c244 could not be found. Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:05:30.377061 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:05:30.382457 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:05:30.382457 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:05:30.382457 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:05:30.382457 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 14:05:30.382457 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 14:05:30.382457 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a3c104a-e134-4a65-9cbe-4c8960b1c244 could not be found. Oct 26 14:05:30.382457 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:05:30.382457 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6dd54659-c0b9-4f27-8c2a-e93d41b82ea2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Returning 404 to user: Instance 0a3c104a-e134-4a65-9cbe-4c8960b1c244 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 14:05:30.382457 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6dd54659-c0b9-4f27-8c2a-e93d41b82ea2 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 404 len: 111 microversion: 2.1 time: 0.031312 Oct 26 14:05:30.382457 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3677/7377] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:05:30 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 14:05:30.441973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0189c41a-51ec-4821-86b4-7acb93debc65 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:30.444630 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0189c41a-51ec-4821-86b4-7acb93debc65 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:30.451864 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0189c41a-51ec-4821-86b4-7acb93debc65 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:30.452363 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0189c41a-51ec-4821-86b4-7acb93debc65 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:30.452815 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0189c41a-51ec-4821-86b4-7acb93debc65 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:30.453560 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0189c41a-51ec-4821-86b4-7acb93debc65 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:30.454039 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0189c41a-51ec-4821-86b4-7acb93debc65 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:30.454484 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0189c41a-51ec-4821-86b4-7acb93debc65 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:30.467075 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-0189c41a-51ec-4821-86b4-7acb93debc65 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] HTTP exception thrown: Instance 0a3c104a-e134-4a65-9cbe-4c8960b1c244 could not be found. Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0189c41a-51ec-4821-86b4-7acb93debc65 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Request method failure captured: Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244/os-volume_attachments HTTP/1.1 Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWT1KEf5RrnueWN8kvjsLURQZMRFC3vXj7EkFIPWPtwUH5p4vA-FoRCpopRC9DSlZE_HC0WGwzVujJC0KQhUWeAqCdZ-AE7FaQcXN_vov0P3H2esfpvK2-XfZnMMJsEhdmjY6sxfgyMT-XdJMLKubEhpiDdQ4UTp8oG--QBn1oDlg3bQ Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 73688cef84664d7db69a39fcbffb6e65 Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServerActionsTestJSON-646524856 Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/73688cef84664d7db69a39fcbffb6e65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/73688cef84664d7db69a39fcbffb6e65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_73688cef84664d7db69a39fcbffb6e65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/73688cef84664d7db69a39fcbffb6e65"}]}] Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServerActionsTestJSON-646524856 Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 73688cef84664d7db69a39fcbffb6e65 Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServerActionsTestJSON-646524856 Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServerActionsTestJSON-646524856-project Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: dc4fe5238edd40db8d203790e2aab143 Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServerActionsTestJSON-646524856-project Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 0a3c104a-e134-4a65-9cbe-4c8960b1c244 could not be found. Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'server_id': '0a3c104a-e134-4a65-9cbe-4c8960b1c244'} Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a3c104a-e134-4a65-9cbe-4c8960b1c244 could not be found. Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 14:05:30.468795 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 14:05:30.474250 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a3c104a-e134-4a65-9cbe-4c8960b1c244 could not be found. Oct 26 14:05:30.474250 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:05:30.474250 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:05:30.474250 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:05:30.474250 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:05:30.474250 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:05:30.474250 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:05:30.474250 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 14:05:30.474250 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 14:05:30.474250 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a3c104a-e134-4a65-9cbe-4c8960b1c244 could not be found. Oct 26 14:05:30.474250 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:05:30.474250 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0189c41a-51ec-4821-86b4-7acb93debc65 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Returning 404 to user: Instance 0a3c104a-e134-4a65-9cbe-4c8960b1c244 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 14:05:30.474250 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0189c41a-51ec-4821-86b4-7acb93debc65 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033123 Oct 26 14:05:30.474250 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3701/7378] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 14:05:30 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 14:05:33.793957 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-78e7352b-d939-4764-a81c-ca195cdb910c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:33.794455 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-78e7352b-d939-4764-a81c-ca195cdb910c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:33.797554 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:05:33.804404 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78e7352b-d939-4764-a81c-ca195cdb910c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:33.804882 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78e7352b-d939-4764-a81c-ca195cdb910c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:33.805327 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78e7352b-d939-4764-a81c-ca195cdb910c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:33.806076 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78e7352b-d939-4764-a81c-ca195cdb910c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:33.806572 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78e7352b-d939-4764-a81c-ca195cdb910c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:33.807143 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78e7352b-d939-4764-a81c-ca195cdb910c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:33.822035 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-78e7352b-d939-4764-a81c-ca195cdb910c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] HTTP exception thrown: Instance 0a3c104a-e134-4a65-9cbe-4c8960b1c244 could not be found. Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-78e7352b-d939-4764-a81c-ca195cdb910c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Request method failure captured: Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 HTTP/1.1 Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWT1KEf5RrnueWN8kvjsLURQZMRFC3vXj7EkFIPWPtwUH5p4vA-FoRCpopRC9DSlZE_HC0WGwzVujJC0KQhUWeAqCdZ-AE7FaQcXN_vov0P3H2esfpvK2-XfZnMMJsEhdmjY6sxfgyMT-XdJMLKubEhpiDdQ4UTp8oG--QBn1oDlg3bQ Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 73688cef84664d7db69a39fcbffb6e65 Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServerActionsTestJSON-646524856 Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/73688cef84664d7db69a39fcbffb6e65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/73688cef84664d7db69a39fcbffb6e65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_73688cef84664d7db69a39fcbffb6e65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/73688cef84664d7db69a39fcbffb6e65"}]}] Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServerActionsTestJSON-646524856 Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 73688cef84664d7db69a39fcbffb6e65 Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServerActionsTestJSON-646524856 Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServerActionsTestJSON-646524856-project Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: dc4fe5238edd40db8d203790e2aab143 Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServerActionsTestJSON-646524856-project Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 0a3c104a-e134-4a65-9cbe-4c8960b1c244 could not be found. Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '0a3c104a-e134-4a65-9cbe-4c8960b1c244'} Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a3c104a-e134-4a65-9cbe-4c8960b1c244 could not be found. Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 14:05:33.823585 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 14:05:33.828144 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a3c104a-e134-4a65-9cbe-4c8960b1c244 could not be found. Oct 26 14:05:33.828144 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:05:33.828144 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:05:33.828144 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:05:33.828144 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:05:33.828144 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:05:33.828144 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:05:33.828144 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 14:05:33.828144 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 14:05:33.828144 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a3c104a-e134-4a65-9cbe-4c8960b1c244 could not be found. Oct 26 14:05:33.828144 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:05:33.828144 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-78e7352b-d939-4764-a81c-ca195cdb910c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Returning 404 to user: Instance 0a3c104a-e134-4a65-9cbe-4c8960b1c244 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 14:05:33.828144 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-78e7352b-d939-4764-a81c-ca195cdb910c tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 404 len: 111 microversion: 2.1 time: 0.035026 Oct 26 14:05:33.828144 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3678/7379] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 14:05:33 2022] DELETE /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 14:05:33.834782 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4d88fced-f908-42a7-bf97-7f74e3b803ae tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:33.835434 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4d88fced-f908-42a7-bf97-7f74e3b803ae tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 0a3c104a-e134-4a65-9cbe-4c8960b1c244] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:33.838553 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:05:33.844382 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d88fced-f908-42a7-bf97-7f74e3b803ae tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:33.844877 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d88fced-f908-42a7-bf97-7f74e3b803ae tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:33.845328 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d88fced-f908-42a7-bf97-7f74e3b803ae tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:33.846644 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d88fced-f908-42a7-bf97-7f74e3b803ae tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:33.847116 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d88fced-f908-42a7-bf97-7f74e3b803ae tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:33.847557 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4d88fced-f908-42a7-bf97-7f74e3b803ae tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:33.863203 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-4d88fced-f908-42a7-bf97-7f74e3b803ae tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] HTTP exception thrown: Instance 0a3c104a-e134-4a65-9cbe-4c8960b1c244 could not be found. Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4d88fced-f908-42a7-bf97-7f74e3b803ae tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Request method failure captured: Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 HTTP/1.1 Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWT1KEf5RrnueWN8kvjsLURQZMRFC3vXj7EkFIPWPtwUH5p4vA-FoRCpopRC9DSlZE_HC0WGwzVujJC0KQhUWeAqCdZ-AE7FaQcXN_vov0P3H2esfpvK2-XfZnMMJsEhdmjY6sxfgyMT-XdJMLKubEhpiDdQ4UTp8oG--QBn1oDlg3bQ Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 73688cef84664d7db69a39fcbffb6e65 Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServerActionsTestJSON-646524856 Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/73688cef84664d7db69a39fcbffb6e65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/73688cef84664d7db69a39fcbffb6e65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_73688cef84664d7db69a39fcbffb6e65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/73688cef84664d7db69a39fcbffb6e65"}]}] Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServerActionsTestJSON-646524856 Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 73688cef84664d7db69a39fcbffb6e65 Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServerActionsTestJSON-646524856 Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServerActionsTestJSON-646524856-project Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: dc4fe5238edd40db8d203790e2aab143 Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServerActionsTestJSON-646524856-project Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 0a3c104a-e134-4a65-9cbe-4c8960b1c244 could not be found. Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '0a3c104a-e134-4a65-9cbe-4c8960b1c244'} Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a3c104a-e134-4a65-9cbe-4c8960b1c244 could not be found. Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a3c104a-e134-4a65-9cbe-4c8960b1c244 could not be found. Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:05:33.864822 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:05:33.868941 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:05:33.868941 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:05:33.868941 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:05:33.868941 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 14:05:33.868941 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 14:05:33.868941 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a3c104a-e134-4a65-9cbe-4c8960b1c244 could not be found. Oct 26 14:05:33.868941 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:05:33.868941 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4d88fced-f908-42a7-bf97-7f74e3b803ae tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Returning 404 to user: Instance 0a3c104a-e134-4a65-9cbe-4c8960b1c244 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 14:05:33.868941 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4d88fced-f908-42a7-bf97-7f74e3b803ae tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244" status: 404 len: 111 microversion: 2.1 time: 0.035900 Oct 26 14:05:33.868941 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3702/7380] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:05:33 2022] GET /compute/v2.1/servers/0a3c104a-e134-4a65-9cbe-4c8960b1c244 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 14:05:33.875272 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b4588e29-1cd3-4c5a-802a-1ff5271d9d3f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:33.875773 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b4588e29-1cd3-4c5a-802a-1ff5271d9d3f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:33.883798 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b4588e29-1cd3-4c5a-802a-1ff5271d9d3f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:33.884294 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b4588e29-1cd3-4c5a-802a-1ff5271d9d3f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:33.884740 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b4588e29-1cd3-4c5a-802a-1ff5271d9d3f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:33.885512 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b4588e29-1cd3-4c5a-802a-1ff5271d9d3f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:33.885979 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b4588e29-1cd3-4c5a-802a-1ff5271d9d3f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:33.886412 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b4588e29-1cd3-4c5a-802a-1ff5271d9d3f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:33.901429 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-b4588e29-1cd3-4c5a-802a-1ff5271d9d3f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] HTTP exception thrown: Instance 81783e43-115f-4ce7-a164-0020ff0e37a9 could not be found. Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b4588e29-1cd3-4c5a-802a-1ff5271d9d3f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Request method failure captured: Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9 HTTP/1.1 Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWT1KEf5RrnueWN8kvjsLURQZMRFC3vXj7EkFIPWPtwUH5p4vA-FoRCpopRC9DSlZE_HC0WGwzVujJC0KQhUWeAqCdZ-AE7FaQcXN_vov0P3H2esfpvK2-XfZnMMJsEhdmjY6sxfgyMT-XdJMLKubEhpiDdQ4UTp8oG--QBn1oDlg3bQ Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 73688cef84664d7db69a39fcbffb6e65 Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServerActionsTestJSON-646524856 Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/73688cef84664d7db69a39fcbffb6e65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/73688cef84664d7db69a39fcbffb6e65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_73688cef84664d7db69a39fcbffb6e65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/73688cef84664d7db69a39fcbffb6e65"}]}] Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServerActionsTestJSON-646524856 Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 73688cef84664d7db69a39fcbffb6e65 Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServerActionsTestJSON-646524856 Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServerActionsTestJSON-646524856-project Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: dc4fe5238edd40db8d203790e2aab143 Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServerActionsTestJSON-646524856-project Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 81783e43-115f-4ce7-a164-0020ff0e37a9 could not be found. Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '81783e43-115f-4ce7-a164-0020ff0e37a9'} Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81783e43-115f-4ce7-a164-0020ff0e37a9 could not be found. Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 14:05:33.903098 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 14:05:33.909668 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81783e43-115f-4ce7-a164-0020ff0e37a9 could not be found. Oct 26 14:05:33.909668 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:05:33.909668 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:05:33.909668 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:05:33.909668 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:05:33.909668 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:05:33.909668 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:05:33.909668 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 14:05:33.909668 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 14:05:33.909668 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81783e43-115f-4ce7-a164-0020ff0e37a9 could not be found. Oct 26 14:05:33.909668 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:05:33.909668 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b4588e29-1cd3-4c5a-802a-1ff5271d9d3f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Returning 404 to user: Instance 81783e43-115f-4ce7-a164-0020ff0e37a9 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 14:05:33.909668 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b4588e29-1cd3-4c5a-802a-1ff5271d9d3f tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "DELETE /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9" status: 404 len: 111 microversion: 2.1 time: 0.033286 Oct 26 14:05:33.909668 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3679/7381] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 14:05:33 2022] DELETE /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 14:05:33.914223 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-330d09df-8468-4276-9217-f0b0a09827b3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:33.914858 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-330d09df-8468-4276-9217-f0b0a09827b3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 81783e43-115f-4ce7-a164-0020ff0e37a9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:33.921047 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-330d09df-8468-4276-9217-f0b0a09827b3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:33.921601 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-330d09df-8468-4276-9217-f0b0a09827b3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:33.922060 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-330d09df-8468-4276-9217-f0b0a09827b3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:33.922789 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-330d09df-8468-4276-9217-f0b0a09827b3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:33.923262 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-330d09df-8468-4276-9217-f0b0a09827b3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:33.923736 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-330d09df-8468-4276-9217-f0b0a09827b3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:33.939200 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-330d09df-8468-4276-9217-f0b0a09827b3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] HTTP exception thrown: Instance 81783e43-115f-4ce7-a164-0020ff0e37a9 could not be found. Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-330d09df-8468-4276-9217-f0b0a09827b3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Request method failure captured: Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9 HTTP/1.1 Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWT1KEf5RrnueWN8kvjsLURQZMRFC3vXj7EkFIPWPtwUH5p4vA-FoRCpopRC9DSlZE_HC0WGwzVujJC0KQhUWeAqCdZ-AE7FaQcXN_vov0P3H2esfpvK2-XfZnMMJsEhdmjY6sxfgyMT-XdJMLKubEhpiDdQ4UTp8oG--QBn1oDlg3bQ Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 73688cef84664d7db69a39fcbffb6e65 Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServerActionsTestJSON-646524856 Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/73688cef84664d7db69a39fcbffb6e65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/73688cef84664d7db69a39fcbffb6e65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_73688cef84664d7db69a39fcbffb6e65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/73688cef84664d7db69a39fcbffb6e65"}]}] Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServerActionsTestJSON-646524856 Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 73688cef84664d7db69a39fcbffb6e65 Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServerActionsTestJSON-646524856 Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServerActionsTestJSON-646524856-project Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: dc4fe5238edd40db8d203790e2aab143 Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServerActionsTestJSON-646524856-project Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 81783e43-115f-4ce7-a164-0020ff0e37a9 could not be found. Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '81783e43-115f-4ce7-a164-0020ff0e37a9'} Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81783e43-115f-4ce7-a164-0020ff0e37a9 could not be found. Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81783e43-115f-4ce7-a164-0020ff0e37a9 could not be found. Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:05:33.941544 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:05:33.946105 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:05:33.946105 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:05:33.946105 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:05:33.946105 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 14:05:33.946105 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 14:05:33.946105 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81783e43-115f-4ce7-a164-0020ff0e37a9 could not be found. Oct 26 14:05:33.946105 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:05:33.946105 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-330d09df-8468-4276-9217-f0b0a09827b3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Returning 404 to user: Instance 81783e43-115f-4ce7-a164-0020ff0e37a9 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 14:05:33.946105 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-330d09df-8468-4276-9217-f0b0a09827b3 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9" status: 404 len: 111 microversion: 2.1 time: 0.033421 Oct 26 14:05:33.946105 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3703/7382] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:05:33 2022] GET /compute/v2.1/servers/81783e43-115f-4ce7-a164-0020ff0e37a9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 14:05:33.953184 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-64712c75-094d-43bb-bc03-47dbeb0c3a15 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:33.953821 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-64712c75-094d-43bb-bc03-47dbeb0c3a15 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:33.960113 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64712c75-094d-43bb-bc03-47dbeb0c3a15 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:33.960607 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64712c75-094d-43bb-bc03-47dbeb0c3a15 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:33.961054 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64712c75-094d-43bb-bc03-47dbeb0c3a15 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:33.961820 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64712c75-094d-43bb-bc03-47dbeb0c3a15 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:33.962289 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64712c75-094d-43bb-bc03-47dbeb0c3a15 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:33.962724 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-64712c75-094d-43bb-bc03-47dbeb0c3a15 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:33.977645 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-64712c75-094d-43bb-bc03-47dbeb0c3a15 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] HTTP exception thrown: Instance 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 could not be found. Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-64712c75-094d-43bb-bc03-47dbeb0c3a15 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Request method failure captured: Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 HTTP/1.1 Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWT1KEf5RrnueWN8kvjsLURQZMRFC3vXj7EkFIPWPtwUH5p4vA-FoRCpopRC9DSlZE_HC0WGwzVujJC0KQhUWeAqCdZ-AE7FaQcXN_vov0P3H2esfpvK2-XfZnMMJsEhdmjY6sxfgyMT-XdJMLKubEhpiDdQ4UTp8oG--QBn1oDlg3bQ Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 73688cef84664d7db69a39fcbffb6e65 Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServerActionsTestJSON-646524856 Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/73688cef84664d7db69a39fcbffb6e65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/73688cef84664d7db69a39fcbffb6e65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_73688cef84664d7db69a39fcbffb6e65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/73688cef84664d7db69a39fcbffb6e65"}]}] Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServerActionsTestJSON-646524856 Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 73688cef84664d7db69a39fcbffb6e65 Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServerActionsTestJSON-646524856 Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServerActionsTestJSON-646524856-project Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: dc4fe5238edd40db8d203790e2aab143 Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServerActionsTestJSON-646524856-project Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 could not be found. Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '4ff5656c-f0da-4aa5-a2c2-bbc920567cf0'} Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 could not be found. Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 14:05:33.979226 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 14:05:33.983161 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 could not be found. Oct 26 14:05:33.983161 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:05:33.983161 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:05:33.983161 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:05:33.983161 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:05:33.983161 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:05:33.983161 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:05:33.983161 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 14:05:33.983161 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 14:05:33.983161 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 could not be found. Oct 26 14:05:33.983161 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:05:33.983161 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-64712c75-094d-43bb-bc03-47dbeb0c3a15 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Returning 404 to user: Instance 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 14:05:33.983161 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-64712c75-094d-43bb-bc03-47dbeb0c3a15 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0" status: 404 len: 111 microversion: 2.1 time: 0.031458 Oct 26 14:05:33.983161 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3680/7383] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 14:05:33 2022] DELETE /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 14:05:33.989996 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-44e77507-13d4-4e94-99ae-2b302d4b3ee9 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:33.990635 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-44e77507-13d4-4e94-99ae-2b302d4b3ee9 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:33.996641 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-44e77507-13d4-4e94-99ae-2b302d4b3ee9 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:33.997146 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-44e77507-13d4-4e94-99ae-2b302d4b3ee9 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:33.997644 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-44e77507-13d4-4e94-99ae-2b302d4b3ee9 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:33.998387 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-44e77507-13d4-4e94-99ae-2b302d4b3ee9 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:33.998865 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-44e77507-13d4-4e94-99ae-2b302d4b3ee9 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:33.999316 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-44e77507-13d4-4e94-99ae-2b302d4b3ee9 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:34.013139 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-44e77507-13d4-4e94-99ae-2b302d4b3ee9 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] HTTP exception thrown: Instance 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 could not be found. Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-44e77507-13d4-4e94-99ae-2b302d4b3ee9 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Request method failure captured: Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 HTTP/1.1 Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWT1KEf5RrnueWN8kvjsLURQZMRFC3vXj7EkFIPWPtwUH5p4vA-FoRCpopRC9DSlZE_HC0WGwzVujJC0KQhUWeAqCdZ-AE7FaQcXN_vov0P3H2esfpvK2-XfZnMMJsEhdmjY6sxfgyMT-XdJMLKubEhpiDdQ4UTp8oG--QBn1oDlg3bQ Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 73688cef84664d7db69a39fcbffb6e65 Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServerActionsTestJSON-646524856 Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/73688cef84664d7db69a39fcbffb6e65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/73688cef84664d7db69a39fcbffb6e65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_73688cef84664d7db69a39fcbffb6e65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/73688cef84664d7db69a39fcbffb6e65"}]}] Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServerActionsTestJSON-646524856 Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 73688cef84664d7db69a39fcbffb6e65 Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServerActionsTestJSON-646524856 Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServerActionsTestJSON-646524856-project Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: dc4fe5238edd40db8d203790e2aab143 Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServerActionsTestJSON-646524856-project Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 could not be found. Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '4ff5656c-f0da-4aa5-a2c2-bbc920567cf0'} Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 could not be found. Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 could not be found. Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:05:34.014754 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:05:34.019615 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:05:34.019615 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:05:34.019615 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:05:34.019615 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 14:05:34.019615 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 14:05:34.019615 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 could not be found. Oct 26 14:05:34.019615 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:05:34.019615 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-44e77507-13d4-4e94-99ae-2b302d4b3ee9 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Returning 404 to user: Instance 4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 14:05:34.019615 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-44e77507-13d4-4e94-99ae-2b302d4b3ee9 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0" status: 404 len: 111 microversion: 2.1 time: 0.030772 Oct 26 14:05:34.019615 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3704/7384] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:05:33 2022] GET /compute/v2.1/servers/4ff5656c-f0da-4aa5-a2c2-bbc920567cf0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 14:05:34.024831 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4f21d61c-7329-40eb-b986-c54f0614a196 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:34.025336 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4f21d61c-7329-40eb-b986-c54f0614a196 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:34.031364 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f21d61c-7329-40eb-b986-c54f0614a196 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:34.031853 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f21d61c-7329-40eb-b986-c54f0614a196 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:34.032397 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f21d61c-7329-40eb-b986-c54f0614a196 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:34.033105 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f21d61c-7329-40eb-b986-c54f0614a196 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:34.034200 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f21d61c-7329-40eb-b986-c54f0614a196 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:34.034901 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f21d61c-7329-40eb-b986-c54f0614a196 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:34.048681 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-4f21d61c-7329-40eb-b986-c54f0614a196 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] HTTP exception thrown: Instance a810e13d-99f4-4c1b-83d6-8f06f9249fae could not be found. Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4f21d61c-7329-40eb-b986-c54f0614a196 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Request method failure captured: Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae HTTP/1.1 Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWT1KEf5RrnueWN8kvjsLURQZMRFC3vXj7EkFIPWPtwUH5p4vA-FoRCpopRC9DSlZE_HC0WGwzVujJC0KQhUWeAqCdZ-AE7FaQcXN_vov0P3H2esfpvK2-XfZnMMJsEhdmjY6sxfgyMT-XdJMLKubEhpiDdQ4UTp8oG--QBn1oDlg3bQ Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 73688cef84664d7db69a39fcbffb6e65 Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServerActionsTestJSON-646524856 Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/73688cef84664d7db69a39fcbffb6e65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/73688cef84664d7db69a39fcbffb6e65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_73688cef84664d7db69a39fcbffb6e65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/73688cef84664d7db69a39fcbffb6e65"}]}] Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServerActionsTestJSON-646524856 Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 73688cef84664d7db69a39fcbffb6e65 Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServerActionsTestJSON-646524856 Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServerActionsTestJSON-646524856-project Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: dc4fe5238edd40db8d203790e2aab143 Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServerActionsTestJSON-646524856-project Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance a810e13d-99f4-4c1b-83d6-8f06f9249fae could not be found. Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'a810e13d-99f4-4c1b-83d6-8f06f9249fae'} Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a810e13d-99f4-4c1b-83d6-8f06f9249fae could not be found. Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 14:05:34.050952 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 14:05:34.054864 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a810e13d-99f4-4c1b-83d6-8f06f9249fae could not be found. Oct 26 14:05:34.054864 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:05:34.054864 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:05:34.054864 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:05:34.054864 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:05:34.054864 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:05:34.054864 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:05:34.054864 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 14:05:34.054864 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 14:05:34.054864 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a810e13d-99f4-4c1b-83d6-8f06f9249fae could not be found. Oct 26 14:05:34.054864 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:05:34.054864 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4f21d61c-7329-40eb-b986-c54f0614a196 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Returning 404 to user: Instance a810e13d-99f4-4c1b-83d6-8f06f9249fae could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 14:05:34.054864 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4f21d61c-7329-40eb-b986-c54f0614a196 tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae" status: 404 len: 111 microversion: 2.1 time: 0.031404 Oct 26 14:05:34.054864 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3681/7385] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 14:05:34 2022] DELETE /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 14:05:34.061111 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-99009edb-353a-4925-b0fa-84b11773f8dc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:34.061768 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-99009edb-353a-4925-b0fa-84b11773f8dc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] [instance: a810e13d-99f4-4c1b-83d6-8f06f9249fae] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:34.067816 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99009edb-353a-4925-b0fa-84b11773f8dc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:34.068326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99009edb-353a-4925-b0fa-84b11773f8dc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:34.068787 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99009edb-353a-4925-b0fa-84b11773f8dc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:34.069507 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99009edb-353a-4925-b0fa-84b11773f8dc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:34.069993 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99009edb-353a-4925-b0fa-84b11773f8dc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:34.070436 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99009edb-353a-4925-b0fa-84b11773f8dc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:34.084863 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-99009edb-353a-4925-b0fa-84b11773f8dc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] HTTP exception thrown: Instance a810e13d-99f4-4c1b-83d6-8f06f9249fae could not be found. Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-99009edb-353a-4925-b0fa-84b11773f8dc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Request method failure captured: Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae HTTP/1.1 Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWT1KEf5RrnueWN8kvjsLURQZMRFC3vXj7EkFIPWPtwUH5p4vA-FoRCpopRC9DSlZE_HC0WGwzVujJC0KQhUWeAqCdZ-AE7FaQcXN_vov0P3H2esfpvK2-XfZnMMJsEhdmjY6sxfgyMT-XdJMLKubEhpiDdQ4UTp8oG--QBn1oDlg3bQ Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 73688cef84664d7db69a39fcbffb6e65 Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServerActionsTestJSON-646524856 Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/73688cef84664d7db69a39fcbffb6e65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/73688cef84664d7db69a39fcbffb6e65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_73688cef84664d7db69a39fcbffb6e65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/73688cef84664d7db69a39fcbffb6e65"}]}] Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServerActionsTestJSON-646524856 Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 73688cef84664d7db69a39fcbffb6e65 Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServerActionsTestJSON-646524856 Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServerActionsTestJSON-646524856-project Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: dc4fe5238edd40db8d203790e2aab143 Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServerActionsTestJSON-646524856-project Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance a810e13d-99f4-4c1b-83d6-8f06f9249fae could not be found. Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'a810e13d-99f4-4c1b-83d6-8f06f9249fae'} Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a810e13d-99f4-4c1b-83d6-8f06f9249fae could not be found. Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a810e13d-99f4-4c1b-83d6-8f06f9249fae could not be found. Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:05:34.086473 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:05:34.092404 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:05:34.092404 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:05:34.092404 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:05:34.092404 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 14:05:34.092404 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 14:05:34.092404 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a810e13d-99f4-4c1b-83d6-8f06f9249fae could not be found. Oct 26 14:05:34.092404 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:05:34.092404 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-99009edb-353a-4925-b0fa-84b11773f8dc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Returning 404 to user: Instance a810e13d-99f4-4c1b-83d6-8f06f9249fae could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 14:05:34.092404 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-99009edb-353a-4925-b0fa-84b11773f8dc tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae" status: 404 len: 111 microversion: 2.1 time: 0.030779 Oct 26 14:05:34.092404 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3705/7386] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:05:34 2022] GET /compute/v2.1/servers/a810e13d-99f4-4c1b-83d6-8f06f9249fae => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 14:05:34.097370 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bc20b558-0bdb-489a-8368-d70c277c9cbb tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] Calling method '.version_select at 0x7f6733171700>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:34.123261 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bc20b558-0bdb-489a-8368-d70c277c9cbb tempest-ServerActionsTestJSON-646524856 tempest-ServerActionsTestJSON-646524856-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-908741287" status: 202 len: 0 microversion: 2.1 time: 0.030222 Oct 26 14:05:34.123846 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3682/7387] 10.222.0.40 () {58 vars in 1218 bytes} [Wed Oct 26 14:05:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-908741287 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 14:05:43.649302 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3c3942aa-49e7-4bcf-bcdf-4de37e6fca3f tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1588885001", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "c600a361-507c-4704-8a29-d373e06f0fae"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:05:43.707827 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-3c3942aa-49e7-4bcf-bcdf-4de37e6fca3f tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] validate_networks() for [('c600a361-507c-4704-8a29-d373e06f0fae', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 14:05:44.076127 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=31 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:05:44.108500 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-3c3942aa-49e7-4bcf-bcdf-4de37e6fca3f tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 14:05:44.108952 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-3c3942aa-49e7-4bcf-bcdf-4de37e6fca3f tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 14:05:44.109447 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-3c3942aa-49e7-4bcf-bcdf-4de37e6fca3f tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 14:05:44.109900 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-3c3942aa-49e7-4bcf-bcdf-4de37e6fca3f tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 14:05:44.110334 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-3c3942aa-49e7-4bcf-bcdf-4de37e6fca3f tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 14:05:44.119941 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c3942aa-49e7-4bcf-bcdf-4de37e6fca3f tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:44.120451 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c3942aa-49e7-4bcf-bcdf-4de37e6fca3f tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:44.120913 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c3942aa-49e7-4bcf-bcdf-4de37e6fca3f tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:44.121733 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c3942aa-49e7-4bcf-bcdf-4de37e6fca3f tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:44.122222 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c3942aa-49e7-4bcf-bcdf-4de37e6fca3f tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:44.122667 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c3942aa-49e7-4bcf-bcdf-4de37e6fca3f tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:44.140206 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-3c3942aa-49e7-4bcf-bcdf-4de37e6fca3f tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Getting quotas for project 5546bcfd4bd74e81a96c6ebd5fb273c4. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 14:05:44.146421 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-3c3942aa-49e7-4bcf-bcdf-4de37e6fca3f tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Getting quotas for user c84a63583faf47dcbefb47077b82eccc and project 5546bcfd4bd74e81a96c6ebd5fb273c4. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 14:05:44.160668 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3c3942aa-49e7-4bcf-bcdf-4de37e6fca3f tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 14:05:44.163158 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3c3942aa-49e7-4bcf-bcdf-4de37e6fca3f tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] [instance: 4bd8616d-7dc2-4ac3-96a0-0b8609933869] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 14:05:44.212214 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3c3942aa-49e7-4bcf-bcdf-4de37e6fca3f tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.739686 Oct 26 14:05:44.213070 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3706/7388] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 14:05:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 14:05:44.222196 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=13 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:05:44.223768 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:05:44.229998 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b574278c-475e-4902-9f15-8ad09e80f79a tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:44.230718 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b574278c-475e-4902-9f15-8ad09e80f79a tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] [instance: 4bd8616d-7dc2-4ac3-96a0-0b8609933869] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:44.298473 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b574278c-475e-4902-9f15-8ad09e80f79a tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84a63583faf47dcbefb47077b82eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5546bcfd4bd74e81a96c6ebd5fb273c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:05:44.306260 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b574278c-475e-4902-9f15-8ad09e80f79a tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] 10.222.0.40 "GET /compute/v2.1/servers/4bd8616d-7dc2-4ac3-96a0-0b8609933869" status: 200 len: 1217 microversion: 2.1 time: 0.086125 Oct 26 14:05:44.307370 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3683/7389] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:05:44 2022] GET /compute/v2.1/servers/4bd8616d-7dc2-4ac3-96a0-0b8609933869 => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 14:05:45.332508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5352a342-a5ea-4c14-8acd-4c071584f9bd tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:45.333142 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5352a342-a5ea-4c14-8acd-4c071584f9bd tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] [instance: 4bd8616d-7dc2-4ac3-96a0-0b8609933869] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:45.340230 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5352a342-a5ea-4c14-8acd-4c071584f9bd tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:45.340732 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5352a342-a5ea-4c14-8acd-4c071584f9bd tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:45.341188 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5352a342-a5ea-4c14-8acd-4c071584f9bd tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:45.341931 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5352a342-a5ea-4c14-8acd-4c071584f9bd tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:45.342410 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5352a342-a5ea-4c14-8acd-4c071584f9bd tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:45.342857 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5352a342-a5ea-4c14-8acd-4c071584f9bd tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:45.480189 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5352a342-a5ea-4c14-8acd-4c071584f9bd tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84a63583faf47dcbefb47077b82eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5546bcfd4bd74e81a96c6ebd5fb273c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:05:45.517213 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5352a342-a5ea-4c14-8acd-4c071584f9bd tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] 10.222.0.40 "GET /compute/v2.1/servers/4bd8616d-7dc2-4ac3-96a0-0b8609933869" status: 200 len: 1269 microversion: 2.1 time: 0.190266 Oct 26 14:05:45.522227 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3707/7390] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:05:45 2022] GET /compute/v2.1/servers/4bd8616d-7dc2-4ac3-96a0-0b8609933869 => generated 1269 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:05:46.553203 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f887bbdb-a25c-4545-af65-7b8b2ef7635a tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:46.555067 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f887bbdb-a25c-4545-af65-7b8b2ef7635a tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] [instance: 4bd8616d-7dc2-4ac3-96a0-0b8609933869] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:46.566513 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f887bbdb-a25c-4545-af65-7b8b2ef7635a tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:46.567247 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f887bbdb-a25c-4545-af65-7b8b2ef7635a tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:46.567996 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f887bbdb-a25c-4545-af65-7b8b2ef7635a tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:46.568904 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f887bbdb-a25c-4545-af65-7b8b2ef7635a tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:46.569551 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f887bbdb-a25c-4545-af65-7b8b2ef7635a tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:46.570141 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f887bbdb-a25c-4545-af65-7b8b2ef7635a tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:46.805162 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f887bbdb-a25c-4545-af65-7b8b2ef7635a tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84a63583faf47dcbefb47077b82eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5546bcfd4bd74e81a96c6ebd5fb273c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:05:46.812962 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f887bbdb-a25c-4545-af65-7b8b2ef7635a tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] 10.222.0.40 "GET /compute/v2.1/servers/4bd8616d-7dc2-4ac3-96a0-0b8609933869" status: 200 len: 1317 microversion: 2.1 time: 0.269706 Oct 26 14:05:46.813902 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3684/7391] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:05:46 2022] GET /compute/v2.1/servers/4bd8616d-7dc2-4ac3-96a0-0b8609933869 => generated 1317 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:05:47.014191 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-b98b5503-5ac0-4685-a9d0-f55f1b5e7de8 req-72036f35-4fa2-4a30-8534-734041ad77c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bd8616d-7dc2-4ac3-96a0-0b8609933869", "tag": "2b013147-aa81-48cd-9215-dba7895c7d32"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:05:47.036661 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b98b5503-5ac0-4685-a9d0-f55f1b5e7de8 req-72036f35-4fa2-4a30-8534-734041ad77c9 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:47.037406 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b98b5503-5ac0-4685-a9d0-f55f1b5e7de8 req-72036f35-4fa2-4a30-8534-734041ad77c9 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:47.038083 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b98b5503-5ac0-4685-a9d0-f55f1b5e7de8 req-72036f35-4fa2-4a30-8534-734041ad77c9 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:47.054991 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-b98b5503-5ac0-4685-a9d0-f55f1b5e7de8 req-72036f35-4fa2-4a30-8534-734041ad77c9 service nova] Creating event network-changed:2b013147-aa81-48cd-9215-dba7895c7d32 for instance 4bd8616d-7dc2-4ac3-96a0-0b8609933869 on n-h2-862686-1 Oct 26 14:05:47.060307 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-b98b5503-5ac0-4685-a9d0-f55f1b5e7de8 req-72036f35-4fa2-4a30-8534-734041ad77c9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049921 Oct 26 14:05:47.060941 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3708/7392] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:05:47.836878 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6a5a3bf3-7916-40cd-8dd1-597a8e47f912 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:47.837534 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6a5a3bf3-7916-40cd-8dd1-597a8e47f912 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] [instance: 4bd8616d-7dc2-4ac3-96a0-0b8609933869] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:47.844253 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6a5a3bf3-7916-40cd-8dd1-597a8e47f912 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:47.844729 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6a5a3bf3-7916-40cd-8dd1-597a8e47f912 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:47.845163 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6a5a3bf3-7916-40cd-8dd1-597a8e47f912 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:47.846514 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6a5a3bf3-7916-40cd-8dd1-597a8e47f912 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:47.846940 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6a5a3bf3-7916-40cd-8dd1-597a8e47f912 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:47.847368 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6a5a3bf3-7916-40cd-8dd1-597a8e47f912 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:47.980779 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6a5a3bf3-7916-40cd-8dd1-597a8e47f912 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84a63583faf47dcbefb47077b82eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5546bcfd4bd74e81a96c6ebd5fb273c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:05:47.989146 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6a5a3bf3-7916-40cd-8dd1-597a8e47f912 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] 10.222.0.40 "GET /compute/v2.1/servers/4bd8616d-7dc2-4ac3-96a0-0b8609933869" status: 200 len: 1317 microversion: 2.1 time: 0.156179 Oct 26 14:05:47.989782 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3685/7393] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:05:47 2022] GET /compute/v2.1/servers/4bd8616d-7dc2-4ac3-96a0-0b8609933869 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:05:49.013065 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f6f93504-2f39-4327-b512-824e3092d0ad tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:49.013835 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f6f93504-2f39-4327-b512-824e3092d0ad tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] [instance: 4bd8616d-7dc2-4ac3-96a0-0b8609933869] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:49.020112 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6f93504-2f39-4327-b512-824e3092d0ad tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:49.020619 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6f93504-2f39-4327-b512-824e3092d0ad tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:49.021076 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6f93504-2f39-4327-b512-824e3092d0ad tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:49.021826 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6f93504-2f39-4327-b512-824e3092d0ad tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:49.022300 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6f93504-2f39-4327-b512-824e3092d0ad tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:49.022741 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6f93504-2f39-4327-b512-824e3092d0ad tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:49.157240 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f6f93504-2f39-4327-b512-824e3092d0ad tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84a63583faf47dcbefb47077b82eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5546bcfd4bd74e81a96c6ebd5fb273c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:05:49.165741 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f6f93504-2f39-4327-b512-824e3092d0ad tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] 10.222.0.40 "GET /compute/v2.1/servers/4bd8616d-7dc2-4ac3-96a0-0b8609933869" status: 200 len: 1317 microversion: 2.1 time: 0.157777 Oct 26 14:05:49.166357 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3709/7394] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:05:49 2022] GET /compute/v2.1/servers/4bd8616d-7dc2-4ac3-96a0-0b8609933869 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:05:50.188850 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-696f6877-b629-48d5-90ac-523f4c6c14f0 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:50.190233 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-696f6877-b629-48d5-90ac-523f4c6c14f0 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] [instance: 4bd8616d-7dc2-4ac3-96a0-0b8609933869] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:50.196973 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-696f6877-b629-48d5-90ac-523f4c6c14f0 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:50.197460 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-696f6877-b629-48d5-90ac-523f4c6c14f0 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:50.197930 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-696f6877-b629-48d5-90ac-523f4c6c14f0 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:50.198622 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-696f6877-b629-48d5-90ac-523f4c6c14f0 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:50.199081 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-696f6877-b629-48d5-90ac-523f4c6c14f0 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:50.199509 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-696f6877-b629-48d5-90ac-523f4c6c14f0 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:50.325912 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-696f6877-b629-48d5-90ac-523f4c6c14f0 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84a63583faf47dcbefb47077b82eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5546bcfd4bd74e81a96c6ebd5fb273c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:05:50.334088 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-696f6877-b629-48d5-90ac-523f4c6c14f0 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] 10.222.0.40 "GET /compute/v2.1/servers/4bd8616d-7dc2-4ac3-96a0-0b8609933869" status: 200 len: 1317 microversion: 2.1 time: 0.149148 Oct 26 14:05:50.334661 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3686/7395] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:05:50 2022] GET /compute/v2.1/servers/4bd8616d-7dc2-4ac3-96a0-0b8609933869 => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:05:51.357046 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-80bb5224-597c-4876-97a9-f1fdf8217327 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:51.357700 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-80bb5224-597c-4876-97a9-f1fdf8217327 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] [instance: 4bd8616d-7dc2-4ac3-96a0-0b8609933869] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:51.364548 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-80bb5224-597c-4876-97a9-f1fdf8217327 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:51.365043 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-80bb5224-597c-4876-97a9-f1fdf8217327 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:51.365508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-80bb5224-597c-4876-97a9-f1fdf8217327 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:51.366215 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-80bb5224-597c-4876-97a9-f1fdf8217327 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:51.366678 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-80bb5224-597c-4876-97a9-f1fdf8217327 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:51.367114 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-80bb5224-597c-4876-97a9-f1fdf8217327 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:51.503982 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-80bb5224-597c-4876-97a9-f1fdf8217327 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84a63583faf47dcbefb47077b82eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5546bcfd4bd74e81a96c6ebd5fb273c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:05:51.511819 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-80bb5224-597c-4876-97a9-f1fdf8217327 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] 10.222.0.40 "GET /compute/v2.1/servers/4bd8616d-7dc2-4ac3-96a0-0b8609933869" status: 200 len: 1317 microversion: 2.1 time: 0.158633 Oct 26 14:05:51.512617 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3710/7396] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:05:51 2022] GET /compute/v2.1/servers/4bd8616d-7dc2-4ac3-96a0-0b8609933869 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:05:51.546004 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-71368366-ac10-458e-9ce6-e51142c4dd3f req-e7171f8d-140e-4c21-9cc4-9f9fbb920a6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bd8616d-7dc2-4ac3-96a0-0b8609933869", "name": "network-vif-plugged", "status": "completed", "tag": "2b013147-aa81-48cd-9215-dba7895c7d32"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:05:51.558144 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-71368366-ac10-458e-9ce6-e51142c4dd3f req-e7171f8d-140e-4c21-9cc4-9f9fbb920a6c service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:51.558633 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-71368366-ac10-458e-9ce6-e51142c4dd3f req-e7171f8d-140e-4c21-9cc4-9f9fbb920a6c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:51.559067 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-71368366-ac10-458e-9ce6-e51142c4dd3f req-e7171f8d-140e-4c21-9cc4-9f9fbb920a6c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:51.571114 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-71368366-ac10-458e-9ce6-e51142c4dd3f req-e7171f8d-140e-4c21-9cc4-9f9fbb920a6c service nova] Creating event network-vif-plugged:2b013147-aa81-48cd-9215-dba7895c7d32 for instance 4bd8616d-7dc2-4ac3-96a0-0b8609933869 on n-h2-862686-1 Oct 26 14:05:51.576281 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-71368366-ac10-458e-9ce6-e51142c4dd3f req-e7171f8d-140e-4c21-9cc4-9f9fbb920a6c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034375 Oct 26 14:05:51.576877 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3687/7397] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:05:52.536191 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6967dd06-e7df-48c8-9f79-9c21dcc55a9c tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:52.536814 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6967dd06-e7df-48c8-9f79-9c21dcc55a9c tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] [instance: 4bd8616d-7dc2-4ac3-96a0-0b8609933869] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:52.543562 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6967dd06-e7df-48c8-9f79-9c21dcc55a9c tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:52.544052 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6967dd06-e7df-48c8-9f79-9c21dcc55a9c tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:52.544500 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6967dd06-e7df-48c8-9f79-9c21dcc55a9c tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:52.545208 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6967dd06-e7df-48c8-9f79-9c21dcc55a9c tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:52.545706 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6967dd06-e7df-48c8-9f79-9c21dcc55a9c tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:52.546144 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6967dd06-e7df-48c8-9f79-9c21dcc55a9c tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:52.677474 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6967dd06-e7df-48c8-9f79-9c21dcc55a9c tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84a63583faf47dcbefb47077b82eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5546bcfd4bd74e81a96c6ebd5fb273c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:05:52.685139 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6967dd06-e7df-48c8-9f79-9c21dcc55a9c tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] 10.222.0.40 "GET /compute/v2.1/servers/4bd8616d-7dc2-4ac3-96a0-0b8609933869" status: 200 len: 1317 microversion: 2.1 time: 0.153782 Oct 26 14:05:52.685747 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3711/7398] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:05:52 2022] GET /compute/v2.1/servers/4bd8616d-7dc2-4ac3-96a0-0b8609933869 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:05:53.708963 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0387ce64-0070-40ea-865d-45a9e08e0df8 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:53.709685 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0387ce64-0070-40ea-865d-45a9e08e0df8 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] [instance: 4bd8616d-7dc2-4ac3-96a0-0b8609933869] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:53.716603 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0387ce64-0070-40ea-865d-45a9e08e0df8 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:53.717092 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0387ce64-0070-40ea-865d-45a9e08e0df8 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:53.717569 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0387ce64-0070-40ea-865d-45a9e08e0df8 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:53.718261 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0387ce64-0070-40ea-865d-45a9e08e0df8 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:53.718714 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0387ce64-0070-40ea-865d-45a9e08e0df8 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:53.719139 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0387ce64-0070-40ea-865d-45a9e08e0df8 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:53.855895 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0387ce64-0070-40ea-865d-45a9e08e0df8 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84a63583faf47dcbefb47077b82eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5546bcfd4bd74e81a96c6ebd5fb273c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:05:53.864081 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0387ce64-0070-40ea-865d-45a9e08e0df8 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] 10.222.0.40 "GET /compute/v2.1/servers/4bd8616d-7dc2-4ac3-96a0-0b8609933869" status: 200 len: 1506 microversion: 2.1 time: 0.159759 Oct 26 14:05:53.864673 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3688/7399] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:05:53 2022] GET /compute/v2.1/servers/4bd8616d-7dc2-4ac3-96a0-0b8609933869 => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:05:53.925286 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f1b8c3ff-28f2-47f7-96f3-777cd191677a tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-962628201", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "c600a361-507c-4704-8a29-d373e06f0fae"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:05:53.979194 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-f1b8c3ff-28f2-47f7-96f3-777cd191677a tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] validate_networks() for [('c600a361-507c-4704-8a29-d373e06f0fae', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 14:05:54.130762 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:05:54.157381 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:05:54.336069 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-f1b8c3ff-28f2-47f7-96f3-777cd191677a tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 14:05:54.336508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-f1b8c3ff-28f2-47f7-96f3-777cd191677a tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 14:05:54.337030 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-f1b8c3ff-28f2-47f7-96f3-777cd191677a tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 14:05:54.337451 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-f1b8c3ff-28f2-47f7-96f3-777cd191677a tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 14:05:54.337978 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-f1b8c3ff-28f2-47f7-96f3-777cd191677a tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 14:05:54.347113 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1b8c3ff-28f2-47f7-96f3-777cd191677a tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:54.347612 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1b8c3ff-28f2-47f7-96f3-777cd191677a tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:54.348060 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1b8c3ff-28f2-47f7-96f3-777cd191677a tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:54.348825 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1b8c3ff-28f2-47f7-96f3-777cd191677a tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:54.349298 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1b8c3ff-28f2-47f7-96f3-777cd191677a tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:54.349766 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1b8c3ff-28f2-47f7-96f3-777cd191677a tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:54.366466 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-f1b8c3ff-28f2-47f7-96f3-777cd191677a tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Getting quotas for project 5546bcfd4bd74e81a96c6ebd5fb273c4. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 14:05:54.371724 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-f1b8c3ff-28f2-47f7-96f3-777cd191677a tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Getting quotas for user c84a63583faf47dcbefb47077b82eccc and project 5546bcfd4bd74e81a96c6ebd5fb273c4. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 14:05:54.384585 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f1b8c3ff-28f2-47f7-96f3-777cd191677a tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 14:05:54.386946 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f1b8c3ff-28f2-47f7-96f3-777cd191677a tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] [instance: dcaef688-7dc4-4cf2-8a89-95f00127f3ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 14:05:54.431742 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f1b8c3ff-28f2-47f7-96f3-777cd191677a tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.510504 Oct 26 14:05:54.432405 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3712/7400] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 14:05:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 14:05:54.444213 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-59d3d7ea-2330-4aaa-81ba-477f01579be7 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:54.444830 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-59d3d7ea-2330-4aaa-81ba-477f01579be7 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] [instance: dcaef688-7dc4-4cf2-8a89-95f00127f3ba] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:54.446905 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:05:54.503855 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-59d3d7ea-2330-4aaa-81ba-477f01579be7 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84a63583faf47dcbefb47077b82eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5546bcfd4bd74e81a96c6ebd5fb273c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:05:54.511862 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-59d3d7ea-2330-4aaa-81ba-477f01579be7 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaef688-7dc4-4cf2-8a89-95f00127f3ba" status: 200 len: 1216 microversion: 2.1 time: 0.071699 Oct 26 14:05:54.512569 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3689/7401] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:05:54 2022] GET /compute/v2.1/servers/dcaef688-7dc4-4cf2-8a89-95f00127f3ba => generated 1216 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:05:55.536319 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f18e1581-e4d0-4426-860d-993dd49964b2 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:55.536954 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f18e1581-e4d0-4426-860d-993dd49964b2 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] [instance: dcaef688-7dc4-4cf2-8a89-95f00127f3ba] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:55.546797 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f18e1581-e4d0-4426-860d-993dd49964b2 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:55.547905 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f18e1581-e4d0-4426-860d-993dd49964b2 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:55.548686 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f18e1581-e4d0-4426-860d-993dd49964b2 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:55.549689 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f18e1581-e4d0-4426-860d-993dd49964b2 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:55.550494 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f18e1581-e4d0-4426-860d-993dd49964b2 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:55.551191 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f18e1581-e4d0-4426-860d-993dd49964b2 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:55.628390 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f18e1581-e4d0-4426-860d-993dd49964b2 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84a63583faf47dcbefb47077b82eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5546bcfd4bd74e81a96c6ebd5fb273c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:05:55.636137 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f18e1581-e4d0-4426-860d-993dd49964b2 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaef688-7dc4-4cf2-8a89-95f00127f3ba" status: 200 len: 1286 microversion: 2.1 time: 0.105286 Oct 26 14:05:55.636709 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3713/7402] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:05:55 2022] GET /compute/v2.1/servers/dcaef688-7dc4-4cf2-8a89-95f00127f3ba => generated 1286 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:05:56.660116 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ca43e16f-d6d9-4b80-bf84-f3f887f1d9ff tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:56.660726 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ca43e16f-d6d9-4b80-bf84-f3f887f1d9ff tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] [instance: dcaef688-7dc4-4cf2-8a89-95f00127f3ba] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:56.668686 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ca43e16f-d6d9-4b80-bf84-f3f887f1d9ff tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:56.669225 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ca43e16f-d6d9-4b80-bf84-f3f887f1d9ff tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:56.669941 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ca43e16f-d6d9-4b80-bf84-f3f887f1d9ff tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:56.670637 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ca43e16f-d6d9-4b80-bf84-f3f887f1d9ff tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:56.671090 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ca43e16f-d6d9-4b80-bf84-f3f887f1d9ff tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:56.671514 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ca43e16f-d6d9-4b80-bf84-f3f887f1d9ff tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:56.803205 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ca43e16f-d6d9-4b80-bf84-f3f887f1d9ff tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84a63583faf47dcbefb47077b82eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5546bcfd4bd74e81a96c6ebd5fb273c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:05:56.811541 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ca43e16f-d6d9-4b80-bf84-f3f887f1d9ff tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaef688-7dc4-4cf2-8a89-95f00127f3ba" status: 200 len: 1316 microversion: 2.1 time: 0.155766 Oct 26 14:05:56.812134 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3690/7403] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:05:56 2022] GET /compute/v2.1/servers/dcaef688-7dc4-4cf2-8a89-95f00127f3ba => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:05:57.246298 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-0c5cb67a-ab94-4767-a0af-bca822ba5a44 req-43c6170f-ed2d-439c-a07b-fab526fa4ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcaef688-7dc4-4cf2-8a89-95f00127f3ba", "tag": "c28fb13d-0b8a-43de-8a0e-c404c4107493"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:05:57.257283 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-0c5cb67a-ab94-4767-a0af-bca822ba5a44 req-43c6170f-ed2d-439c-a07b-fab526fa4ea1 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:57.257957 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-0c5cb67a-ab94-4767-a0af-bca822ba5a44 req-43c6170f-ed2d-439c-a07b-fab526fa4ea1 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:57.258411 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-0c5cb67a-ab94-4767-a0af-bca822ba5a44 req-43c6170f-ed2d-439c-a07b-fab526fa4ea1 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:57.273279 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-0c5cb67a-ab94-4767-a0af-bca822ba5a44 req-43c6170f-ed2d-439c-a07b-fab526fa4ea1 service nova] Creating event network-changed:c28fb13d-0b8a-43de-8a0e-c404c4107493 for instance dcaef688-7dc4-4cf2-8a89-95f00127f3ba on n-h1-862686-1 Oct 26 14:05:57.278313 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-0c5cb67a-ab94-4767-a0af-bca822ba5a44 req-43c6170f-ed2d-439c-a07b-fab526fa4ea1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035743 Oct 26 14:05:57.279007 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3714/7404] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:05:57.836651 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-41b103b2-a96c-4e04-9998-b67e5fdd7857 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:57.837296 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-41b103b2-a96c-4e04-9998-b67e5fdd7857 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] [instance: dcaef688-7dc4-4cf2-8a89-95f00127f3ba] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:57.844124 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41b103b2-a96c-4e04-9998-b67e5fdd7857 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:57.844611 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41b103b2-a96c-4e04-9998-b67e5fdd7857 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:57.845056 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41b103b2-a96c-4e04-9998-b67e5fdd7857 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:57.846452 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41b103b2-a96c-4e04-9998-b67e5fdd7857 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:57.846917 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41b103b2-a96c-4e04-9998-b67e5fdd7857 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:57.847353 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41b103b2-a96c-4e04-9998-b67e5fdd7857 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:57.989076 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-41b103b2-a96c-4e04-9998-b67e5fdd7857 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84a63583faf47dcbefb47077b82eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5546bcfd4bd74e81a96c6ebd5fb273c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:05:57.996716 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-41b103b2-a96c-4e04-9998-b67e5fdd7857 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaef688-7dc4-4cf2-8a89-95f00127f3ba" status: 200 len: 1316 microversion: 2.1 time: 0.164040 Oct 26 14:05:57.997288 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3691/7405] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:05:57 2022] GET /compute/v2.1/servers/dcaef688-7dc4-4cf2-8a89-95f00127f3ba => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:05:59.021743 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-056efc2e-a8b4-44b3-adab-34e36aeb3f41 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:05:59.022458 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-056efc2e-a8b4-44b3-adab-34e36aeb3f41 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] [instance: dcaef688-7dc4-4cf2-8a89-95f00127f3ba] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:05:59.028719 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-056efc2e-a8b4-44b3-adab-34e36aeb3f41 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:59.029219 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-056efc2e-a8b4-44b3-adab-34e36aeb3f41 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:59.029703 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-056efc2e-a8b4-44b3-adab-34e36aeb3f41 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:59.030414 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-056efc2e-a8b4-44b3-adab-34e36aeb3f41 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:05:59.030874 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-056efc2e-a8b4-44b3-adab-34e36aeb3f41 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:05:59.031449 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-056efc2e-a8b4-44b3-adab-34e36aeb3f41 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:05:59.228946 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-056efc2e-a8b4-44b3-adab-34e36aeb3f41 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84a63583faf47dcbefb47077b82eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5546bcfd4bd74e81a96c6ebd5fb273c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:05:59.238885 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-056efc2e-a8b4-44b3-adab-34e36aeb3f41 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaef688-7dc4-4cf2-8a89-95f00127f3ba" status: 200 len: 1316 microversion: 2.1 time: 0.222388 Oct 26 14:05:59.239498 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3715/7406] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:05:59 2022] GET /compute/v2.1/servers/dcaef688-7dc4-4cf2-8a89-95f00127f3ba => generated 1316 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 14:06:00.263600 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5242fb16-1e5a-4ac7-b543-a99b85946ea5 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:06:00.264242 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5242fb16-1e5a-4ac7-b543-a99b85946ea5 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] [instance: dcaef688-7dc4-4cf2-8a89-95f00127f3ba] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:06:00.271845 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5242fb16-1e5a-4ac7-b543-a99b85946ea5 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:00.272343 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5242fb16-1e5a-4ac7-b543-a99b85946ea5 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:00.272762 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5242fb16-1e5a-4ac7-b543-a99b85946ea5 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:00.273450 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5242fb16-1e5a-4ac7-b543-a99b85946ea5 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:00.273930 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5242fb16-1e5a-4ac7-b543-a99b85946ea5 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:00.274355 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5242fb16-1e5a-4ac7-b543-a99b85946ea5 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:00.407753 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5242fb16-1e5a-4ac7-b543-a99b85946ea5 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84a63583faf47dcbefb47077b82eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5546bcfd4bd74e81a96c6ebd5fb273c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:06:00.415837 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5242fb16-1e5a-4ac7-b543-a99b85946ea5 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaef688-7dc4-4cf2-8a89-95f00127f3ba" status: 200 len: 1316 microversion: 2.1 time: 0.157175 Oct 26 14:06:00.416429 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3692/7407] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:06:00 2022] GET /compute/v2.1/servers/dcaef688-7dc4-4cf2-8a89-95f00127f3ba => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:06:01.134814 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-81706787-09d9-463d-a5a5-f69e3f4f2e37 req-0d838ab8-95f1-4005-8a4a-2fa250606051 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcaef688-7dc4-4cf2-8a89-95f00127f3ba", "name": "network-vif-plugged", "status": "completed", "tag": "c28fb13d-0b8a-43de-8a0e-c404c4107493"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:06:01.146220 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-81706787-09d9-463d-a5a5-f69e3f4f2e37 req-0d838ab8-95f1-4005-8a4a-2fa250606051 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:01.146713 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-81706787-09d9-463d-a5a5-f69e3f4f2e37 req-0d838ab8-95f1-4005-8a4a-2fa250606051 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:01.147152 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-81706787-09d9-463d-a5a5-f69e3f4f2e37 req-0d838ab8-95f1-4005-8a4a-2fa250606051 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:01.159900 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-81706787-09d9-463d-a5a5-f69e3f4f2e37 req-0d838ab8-95f1-4005-8a4a-2fa250606051 service nova] Creating event network-vif-plugged:c28fb13d-0b8a-43de-8a0e-c404c4107493 for instance dcaef688-7dc4-4cf2-8a89-95f00127f3ba on n-h1-862686-1 Oct 26 14:06:01.164987 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-81706787-09d9-463d-a5a5-f69e3f4f2e37 req-0d838ab8-95f1-4005-8a4a-2fa250606051 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034075 Oct 26 14:06:01.165870 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3716/7408] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:06:01.438669 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a0a0eaec-bf79-4386-ac6f-2405d50251d7 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:06:01.439284 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a0a0eaec-bf79-4386-ac6f-2405d50251d7 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] [instance: dcaef688-7dc4-4cf2-8a89-95f00127f3ba] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:06:01.446126 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0a0eaec-bf79-4386-ac6f-2405d50251d7 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:01.446619 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0a0eaec-bf79-4386-ac6f-2405d50251d7 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:01.447062 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0a0eaec-bf79-4386-ac6f-2405d50251d7 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:01.447753 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0a0eaec-bf79-4386-ac6f-2405d50251d7 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:01.448208 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0a0eaec-bf79-4386-ac6f-2405d50251d7 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:01.448659 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0a0eaec-bf79-4386-ac6f-2405d50251d7 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:01.579457 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a0a0eaec-bf79-4386-ac6f-2405d50251d7 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84a63583faf47dcbefb47077b82eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5546bcfd4bd74e81a96c6ebd5fb273c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:06:01.587674 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a0a0eaec-bf79-4386-ac6f-2405d50251d7 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaef688-7dc4-4cf2-8a89-95f00127f3ba" status: 200 len: 1316 microversion: 2.1 time: 0.152989 Oct 26 14:06:01.588249 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3693/7409] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:06:01 2022] GET /compute/v2.1/servers/dcaef688-7dc4-4cf2-8a89-95f00127f3ba => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:06:02.613063 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-67e55afa-9eef-45e4-8e97-71856a657c4a tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:06:02.613816 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-67e55afa-9eef-45e4-8e97-71856a657c4a tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] [instance: dcaef688-7dc4-4cf2-8a89-95f00127f3ba] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:06:02.619908 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-67e55afa-9eef-45e4-8e97-71856a657c4a tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:02.620413 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-67e55afa-9eef-45e4-8e97-71856a657c4a tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:02.620862 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-67e55afa-9eef-45e4-8e97-71856a657c4a tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:02.621591 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-67e55afa-9eef-45e4-8e97-71856a657c4a tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:02.622065 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-67e55afa-9eef-45e4-8e97-71856a657c4a tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:02.622502 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-67e55afa-9eef-45e4-8e97-71856a657c4a tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:02.757679 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-67e55afa-9eef-45e4-8e97-71856a657c4a tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84a63583faf47dcbefb47077b82eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5546bcfd4bd74e81a96c6ebd5fb273c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:06:02.765373 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-67e55afa-9eef-45e4-8e97-71856a657c4a tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaef688-7dc4-4cf2-8a89-95f00127f3ba" status: 200 len: 1505 microversion: 2.1 time: 0.158222 Oct 26 14:06:02.766208 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3717/7410] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:06:02 2022] GET /compute/v2.1/servers/dcaef688-7dc4-4cf2-8a89-95f00127f3ba => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:06:02.789003 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0bc72100-c2e6-4f17-93de-cd636f03846e tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:06:02.789580 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0bc72100-c2e6-4f17-93de-cd636f03846e tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] [instance: dcaef688-7dc4-4cf2-8a89-95f00127f3ba] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:06:02.796232 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0bc72100-c2e6-4f17-93de-cd636f03846e tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:02.796707 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0bc72100-c2e6-4f17-93de-cd636f03846e tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:02.797142 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0bc72100-c2e6-4f17-93de-cd636f03846e tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:02.797850 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0bc72100-c2e6-4f17-93de-cd636f03846e tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:02.798304 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0bc72100-c2e6-4f17-93de-cd636f03846e tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:02.799433 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0bc72100-c2e6-4f17-93de-cd636f03846e tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:02.824721 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0bc72100-c2e6-4f17-93de-cd636f03846e tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] [instance: dcaef688-7dc4-4cf2-8a89-95f00127f3ba] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 14:06:02.901540 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0bc72100-c2e6-4f17-93de-cd636f03846e tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] 10.222.0.40 "DELETE /compute/v2.1/servers/dcaef688-7dc4-4cf2-8a89-95f00127f3ba" status: 204 len: 0 microversion: 2.1 time: 0.116136 Oct 26 14:06:02.902329 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3694/7411] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 14:06:02 2022] DELETE /compute/v2.1/servers/dcaef688-7dc4-4cf2-8a89-95f00127f3ba => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 14:06:02.911849 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1f4eb6ed-9eb9-49fc-b59c-4c55682a42b2 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:06:02.912479 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1f4eb6ed-9eb9-49fc-b59c-4c55682a42b2 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] [instance: dcaef688-7dc4-4cf2-8a89-95f00127f3ba] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:06:02.918396 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f4eb6ed-9eb9-49fc-b59c-4c55682a42b2 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:02.918893 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f4eb6ed-9eb9-49fc-b59c-4c55682a42b2 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:02.919348 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f4eb6ed-9eb9-49fc-b59c-4c55682a42b2 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:02.920052 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f4eb6ed-9eb9-49fc-b59c-4c55682a42b2 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:02.920530 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f4eb6ed-9eb9-49fc-b59c-4c55682a42b2 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:02.920970 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f4eb6ed-9eb9-49fc-b59c-4c55682a42b2 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:03.049904 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1f4eb6ed-9eb9-49fc-b59c-4c55682a42b2 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84a63583faf47dcbefb47077b82eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5546bcfd4bd74e81a96c6ebd5fb273c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:06:03.057670 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1f4eb6ed-9eb9-49fc-b59c-4c55682a42b2 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaef688-7dc4-4cf2-8a89-95f00127f3ba" status: 200 len: 1511 microversion: 2.1 time: 0.150593 Oct 26 14:06:03.058249 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3718/7412] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:06:02 2022] GET /compute/v2.1/servers/dcaef688-7dc4-4cf2-8a89-95f00127f3ba => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:06:04.081440 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f7af4c55-8886-44ce-863a-6f71022ea8b8 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:06:04.082169 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f7af4c55-8886-44ce-863a-6f71022ea8b8 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] [instance: dcaef688-7dc4-4cf2-8a89-95f00127f3ba] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:06:04.089499 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f7af4c55-8886-44ce-863a-6f71022ea8b8 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:04.090020 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f7af4c55-8886-44ce-863a-6f71022ea8b8 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:04.090463 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f7af4c55-8886-44ce-863a-6f71022ea8b8 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:04.091175 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f7af4c55-8886-44ce-863a-6f71022ea8b8 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:04.091637 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f7af4c55-8886-44ce-863a-6f71022ea8b8 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:04.092073 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f7af4c55-8886-44ce-863a-6f71022ea8b8 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:04.223202 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f7af4c55-8886-44ce-863a-6f71022ea8b8 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84a63583faf47dcbefb47077b82eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5546bcfd4bd74e81a96c6ebd5fb273c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:06:04.231488 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f7af4c55-8886-44ce-863a-6f71022ea8b8 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaef688-7dc4-4cf2-8a89-95f00127f3ba" status: 200 len: 1511 microversion: 2.1 time: 0.155072 Oct 26 14:06:04.232064 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3695/7413] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:06:04 2022] GET /compute/v2.1/servers/dcaef688-7dc4-4cf2-8a89-95f00127f3ba => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:06:04.851112 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-2dbe670b-91fe-44f2-abf3-6352934976c5 req-cb967b74-d96b-4a9f-bb33-0a5f0c09952d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcaef688-7dc4-4cf2-8a89-95f00127f3ba", "name": "network-vif-deleted", "tag": "c28fb13d-0b8a-43de-8a0e-c404c4107493"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:06:04.868047 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:06:04.879311 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:06:04.880468 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:06:04.889996 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-2dbe670b-91fe-44f2-abf3-6352934976c5 req-cb967b74-d96b-4a9f-bb33-0a5f0c09952d service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:04.890523 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-2dbe670b-91fe-44f2-abf3-6352934976c5 req-cb967b74-d96b-4a9f-bb33-0a5f0c09952d service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:04.891041 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-2dbe670b-91fe-44f2-abf3-6352934976c5 req-cb967b74-d96b-4a9f-bb33-0a5f0c09952d service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:04.909801 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-2dbe670b-91fe-44f2-abf3-6352934976c5 req-cb967b74-d96b-4a9f-bb33-0a5f0c09952d service nova] Creating event network-vif-deleted:c28fb13d-0b8a-43de-8a0e-c404c4107493 for instance dcaef688-7dc4-4cf2-8a89-95f00127f3ba on n-h1-862686-1 Oct 26 14:06:04.916078 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-2dbe670b-91fe-44f2-abf3-6352934976c5 req-cb967b74-d96b-4a9f-bb33-0a5f0c09952d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071890 Oct 26 14:06:04.917106 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3719/7414] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:06:05.256240 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bf62c244-d4b7-436e-a122-dc18331311fd tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:06:05.256789 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bf62c244-d4b7-436e-a122-dc18331311fd tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] [instance: dcaef688-7dc4-4cf2-8a89-95f00127f3ba] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:06:05.258787 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:06:05.264834 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf62c244-d4b7-436e-a122-dc18331311fd tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:05.265312 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf62c244-d4b7-436e-a122-dc18331311fd tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:05.265775 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf62c244-d4b7-436e-a122-dc18331311fd tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:05.266458 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf62c244-d4b7-436e-a122-dc18331311fd tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:05.266909 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf62c244-d4b7-436e-a122-dc18331311fd tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:05.267850 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf62c244-d4b7-436e-a122-dc18331311fd tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:05.305088 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf62c244-d4b7-436e-a122-dc18331311fd tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:05.305603 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf62c244-d4b7-436e-a122-dc18331311fd tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:05.306039 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf62c244-d4b7-436e-a122-dc18331311fd tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:05.306489 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-bf62c244-d4b7-436e-a122-dc18331311fd tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lazy-loading 'fault' on Instance uuid dcaef688-7dc4-4cf2-8a89-95f00127f3ba {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 14:06:05.347432 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bf62c244-d4b7-436e-a122-dc18331311fd tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84a63583faf47dcbefb47077b82eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5546bcfd4bd74e81a96c6ebd5fb273c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:06:05.355140 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bf62c244-d4b7-436e-a122-dc18331311fd tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaef688-7dc4-4cf2-8a89-95f00127f3ba" status: 200 len: 1306 microversion: 2.1 time: 0.103940 Oct 26 14:06:05.355751 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3696/7415] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:06:05 2022] GET /compute/v2.1/servers/dcaef688-7dc4-4cf2-8a89-95f00127f3ba => generated 1306 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:06:06.380913 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7a4c03bf-cbf0-43aa-b344-3e6d01b35beb tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:06:06.381569 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7a4c03bf-cbf0-43aa-b344-3e6d01b35beb tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] [instance: dcaef688-7dc4-4cf2-8a89-95f00127f3ba] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:06:06.387838 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a4c03bf-cbf0-43aa-b344-3e6d01b35beb tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:06.388337 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a4c03bf-cbf0-43aa-b344-3e6d01b35beb tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:06.388789 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a4c03bf-cbf0-43aa-b344-3e6d01b35beb tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:06.389517 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a4c03bf-cbf0-43aa-b344-3e6d01b35beb tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:06.390014 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a4c03bf-cbf0-43aa-b344-3e6d01b35beb tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:06.390441 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a4c03bf-cbf0-43aa-b344-3e6d01b35beb tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:06.404412 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-7a4c03bf-cbf0-43aa-b344-3e6d01b35beb tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] HTTP exception thrown: Instance dcaef688-7dc4-4cf2-8a89-95f00127f3ba could not be found. Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7a4c03bf-cbf0-43aa-b344-3e6d01b35beb tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Request method failure captured: Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/dcaef688-7dc4-4cf2-8a89-95f00127f3ba HTTP/1.1 Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWT635t6EBGcC3aRbyNTKmAIfH9x6T26gbTYj8wHMJ_AlWSOEC4PgzI8xD969qxmepWeJxMSjkzGoTQjyudvEu9ss-aqwPLgElsE6dQvDKQWOdE2Z2XMgrRaqVXzuaIKaLT15v2GGd3W3ODNVtDzZsKXdIsly5-sT9AbKx_R-vx5mvqw Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 5546bcfd4bd74e81a96c6ebd5fb273c4 Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersNegativeTestJSON-1347487351 Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5546bcfd4bd74e81a96c6ebd5fb273c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5546bcfd4bd74e81a96c6ebd5fb273c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5546bcfd4bd74e81a96c6ebd5fb273c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5546bcfd4bd74e81a96c6ebd5fb273c4"}]}] Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersNegativeTestJSON-1347487351 Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 5546bcfd4bd74e81a96c6ebd5fb273c4 Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1347487351 Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersNegativeTestJSON-1347487351-project Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: c84a63583faf47dcbefb47077b82eccc Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersNegativeTestJSON-1347487351-project Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance dcaef688-7dc4-4cf2-8a89-95f00127f3ba could not be found. Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'dcaef688-7dc4-4cf2-8a89-95f00127f3ba'} Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcaef688-7dc4-4cf2-8a89-95f00127f3ba could not be found. Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcaef688-7dc4-4cf2-8a89-95f00127f3ba could not be found. Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:06:06.406084 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:06:06.411424 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:06:06.411424 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:06:06.411424 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:06:06.411424 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 14:06:06.411424 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 14:06:06.411424 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcaef688-7dc4-4cf2-8a89-95f00127f3ba could not be found. Oct 26 14:06:06.411424 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:06:06.411424 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7a4c03bf-cbf0-43aa-b344-3e6d01b35beb tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Returning 404 to user: Instance dcaef688-7dc4-4cf2-8a89-95f00127f3ba could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 14:06:06.411424 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7a4c03bf-cbf0-43aa-b344-3e6d01b35beb tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaef688-7dc4-4cf2-8a89-95f00127f3ba" status: 404 len: 111 microversion: 2.1 time: 0.032511 Oct 26 14:06:06.411424 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3720/7416] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:06:06 2022] GET /compute/v2.1/servers/dcaef688-7dc4-4cf2-8a89-95f00127f3ba => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 14:06:06.417148 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e33e7c5a-679b-42c0-a40e-63cd2d552cef tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:06:06.417791 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e33e7c5a-679b-42c0-a40e-63cd2d552cef tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] [instance: 4bd8616d-7dc2-4ac3-96a0-0b8609933869] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:06:06.424639 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e33e7c5a-679b-42c0-a40e-63cd2d552cef tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:06.425121 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e33e7c5a-679b-42c0-a40e-63cd2d552cef tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:06.425592 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e33e7c5a-679b-42c0-a40e-63cd2d552cef tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:06.426286 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e33e7c5a-679b-42c0-a40e-63cd2d552cef tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:06.426743 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e33e7c5a-679b-42c0-a40e-63cd2d552cef tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:06.427171 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e33e7c5a-679b-42c0-a40e-63cd2d552cef tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:06.562745 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e33e7c5a-679b-42c0-a40e-63cd2d552cef tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84a63583faf47dcbefb47077b82eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5546bcfd4bd74e81a96c6ebd5fb273c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:06:06.571059 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e33e7c5a-679b-42c0-a40e-63cd2d552cef tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] 10.222.0.40 "GET /compute/v2.1/servers/4bd8616d-7dc2-4ac3-96a0-0b8609933869" status: 200 len: 1506 microversion: 2.1 time: 0.157712 Oct 26 14:06:06.571634 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3697/7417] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:06:06 2022] GET /compute/v2.1/servers/4bd8616d-7dc2-4ac3-96a0-0b8609933869 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:06:06.593830 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-64fc998f-7ad5-46c5-b72b-bd455986a47d tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:06:06.596354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-64fc998f-7ad5-46c5-b72b-bd455986a47d tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] [instance: 0bdc47a4-d777-46c3-97c6-9a8562a3770d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:06:06.601849 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-64fc998f-7ad5-46c5-b72b-bd455986a47d tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] HTTP exception thrown: Instance 0bdc47a4-d777-46c3-97c6-9a8562a3770d could not be found. Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-64fc998f-7ad5-46c5-b72b-bd455986a47d tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Request method failure captured: Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/servers/0bdc47a4-d777-46c3-97c6-9a8562a3770d/action HTTP/1.1 Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 32 Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWT635t6EBGcC3aRbyNTKmAIfH9x6T26gbTYj8wHMJ_AlWSOEC4PgzI8xD969qxmepWeJxMSjkzGoTQjyudvEu9ss-aqwPLgElsE6dQvDKQWOdE2Z2XMgrRaqVXzuaIKaLT15v2GGd3W3ODNVtDzZsKXdIsly5-sT9AbKx_R-vx5mvqw Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 5546bcfd4bd74e81a96c6ebd5fb273c4 Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersNegativeTestJSON-1347487351 Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5546bcfd4bd74e81a96c6ebd5fb273c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5546bcfd4bd74e81a96c6ebd5fb273c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5546bcfd4bd74e81a96c6ebd5fb273c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5546bcfd4bd74e81a96c6ebd5fb273c4"}]}] Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersNegativeTestJSON-1347487351 Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 5546bcfd4bd74e81a96c6ebd5fb273c4 Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1347487351 Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersNegativeTestJSON-1347487351-project Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: c84a63583faf47dcbefb47077b82eccc Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersNegativeTestJSON-1347487351-project Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: {"resize": {"flavorRef": "452"}} Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 0bdc47a4-d777-46c3-97c6-9a8562a3770d could not be found. Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '0bdc47a4-d777-46c3-97c6-9a8562a3770d', 'body': {'resize': {'flavorRef': '452'}}} Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bdc47a4-d777-46c3-97c6-9a8562a3770d could not be found. Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 14:06:06.603423 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 14:06:06.608469 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bdc47a4-d777-46c3-97c6-9a8562a3770d could not be found. Oct 26 14:06:06.608469 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:06:06.608469 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:06:06.608469 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:06:06.608469 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:06:06.608469 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:06:06.608469 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:06:06.608469 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 14:06:06.608469 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 14:06:06.608469 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bdc47a4-d777-46c3-97c6-9a8562a3770d could not be found. Oct 26 14:06:06.608469 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:06:06.608469 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-64fc998f-7ad5-46c5-b72b-bd455986a47d tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Returning 404 to user: Instance 0bdc47a4-d777-46c3-97c6-9a8562a3770d could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 14:06:06.608469 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-64fc998f-7ad5-46c5-b72b-bd455986a47d tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] 10.222.0.40 "POST /compute/v2.1/servers/0bdc47a4-d777-46c3-97c6-9a8562a3770d/action" status: 404 len: 111 microversion: 2.1 time: 0.015230 Oct 26 14:06:06.608469 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3721/7418] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 14:06:06 2022] POST /compute/v2.1/servers/0bdc47a4-d777-46c3-97c6-9a8562a3770d/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 14:06:06.613860 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1dc16a3d-3a98-4ae0-ab77-64977c12396f tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:06:06.614475 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1dc16a3d-3a98-4ae0-ab77-64977c12396f tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] [instance: 4bd8616d-7dc2-4ac3-96a0-0b8609933869] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:06:06.620332 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1dc16a3d-3a98-4ae0-ab77-64977c12396f tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:06.620814 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1dc16a3d-3a98-4ae0-ab77-64977c12396f tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:06.621254 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1dc16a3d-3a98-4ae0-ab77-64977c12396f tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:06.621980 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1dc16a3d-3a98-4ae0-ab77-64977c12396f tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:06.622436 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1dc16a3d-3a98-4ae0-ab77-64977c12396f tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:06.622860 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1dc16a3d-3a98-4ae0-ab77-64977c12396f tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:06.750896 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1dc16a3d-3a98-4ae0-ab77-64977c12396f tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84a63583faf47dcbefb47077b82eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5546bcfd4bd74e81a96c6ebd5fb273c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:06:06.759444 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1dc16a3d-3a98-4ae0-ab77-64977c12396f tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] 10.222.0.40 "GET /compute/v2.1/servers/4bd8616d-7dc2-4ac3-96a0-0b8609933869" status: 200 len: 1506 microversion: 2.1 time: 0.149987 Oct 26 14:06:06.760057 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3698/7419] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:06:06 2022] GET /compute/v2.1/servers/4bd8616d-7dc2-4ac3-96a0-0b8609933869 => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 14:06:06.782382 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8f35f531-4b74-4f3c-aa3b-5723708c059f tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:06:06.783019 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8f35f531-4b74-4f3c-aa3b-5723708c059f tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] [instance: 4bd8616d-7dc2-4ac3-96a0-0b8609933869] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:06:06.790343 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f35f531-4b74-4f3c-aa3b-5723708c059f tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:06.790849 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f35f531-4b74-4f3c-aa3b-5723708c059f tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:06.791304 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f35f531-4b74-4f3c-aa3b-5723708c059f tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:06.792016 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f35f531-4b74-4f3c-aa3b-5723708c059f tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:06.792496 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f35f531-4b74-4f3c-aa3b-5723708c059f tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:06.792942 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f35f531-4b74-4f3c-aa3b-5723708c059f tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:06.922529 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8f35f531-4b74-4f3c-aa3b-5723708c059f tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84a63583faf47dcbefb47077b82eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5546bcfd4bd74e81a96c6ebd5fb273c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:06:06.930792 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8f35f531-4b74-4f3c-aa3b-5723708c059f tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] 10.222.0.40 "GET /compute/v2.1/servers/4bd8616d-7dc2-4ac3-96a0-0b8609933869" status: 200 len: 1506 microversion: 2.1 time: 0.152309 Oct 26 14:06:06.931372 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3722/7420] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:06:06 2022] GET /compute/v2.1/servers/4bd8616d-7dc2-4ac3-96a0-0b8609933869 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:06:06.953444 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7d1b65ba-d7d7-448e-94a8-cbb63a02ea9e tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "d614e930-575e-4bba-8b70-bfa92ec3e3ab"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:06:06.955773 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7d1b65ba-d7d7-448e-94a8-cbb63a02ea9e tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] [instance: 4bd8616d-7dc2-4ac3-96a0-0b8609933869] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:06:06.961805 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d1b65ba-d7d7-448e-94a8-cbb63a02ea9e tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:06.962296 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d1b65ba-d7d7-448e-94a8-cbb63a02ea9e tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:06.962740 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d1b65ba-d7d7-448e-94a8-cbb63a02ea9e tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:06.963432 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d1b65ba-d7d7-448e-94a8-cbb63a02ea9e tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:06.963892 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d1b65ba-d7d7-448e-94a8-cbb63a02ea9e tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:06.964325 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7d1b65ba-d7d7-448e-94a8-cbb63a02ea9e tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:06.993053 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7d1b65ba-d7d7-448e-94a8-cbb63a02ea9e tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c84a63583faf47dcbefb47077b82eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5546bcfd4bd74e81a96c6ebd5fb273c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:06:06.997893 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-7d1b65ba-d7d7-448e-94a8-cbb63a02ea9e tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] HTTP exception thrown: Flavor d614e930-575e-4bba-8b70-bfa92ec3e3ab could not be found. Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7d1b65ba-d7d7-448e-94a8-cbb63a02ea9e tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Request method failure captured: Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: request: POST /compute/v2.1/servers/4bd8616d-7dc2-4ac3-96a0-0b8609933869/action HTTP/1.1 Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 65 Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWT635t6EBGcC3aRbyNTKmAIfH9x6T26gbTYj8wHMJ_AlWSOEC4PgzI8xD969qxmepWeJxMSjkzGoTQjyudvEu9ss-aqwPLgElsE6dQvDKQWOdE2Z2XMgrRaqVXzuaIKaLT15v2GGd3W3ODNVtDzZsKXdIsly5-sT9AbKx_R-vx5mvqw Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 5546bcfd4bd74e81a96c6ebd5fb273c4 Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersNegativeTestJSON-1347487351 Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5546bcfd4bd74e81a96c6ebd5fb273c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5546bcfd4bd74e81a96c6ebd5fb273c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5546bcfd4bd74e81a96c6ebd5fb273c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5546bcfd4bd74e81a96c6ebd5fb273c4"}]}] Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersNegativeTestJSON-1347487351 Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 5546bcfd4bd74e81a96c6ebd5fb273c4 Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1347487351 Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersNegativeTestJSON-1347487351-project Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: c84a63583faf47dcbefb47077b82eccc Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersNegativeTestJSON-1347487351-project Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: {"resize": {"flavorRef": "d614e930-575e-4bba-8b70-bfa92ec3e3ab"}} Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: exception: Flavor d614e930-575e-4bba-8b70-bfa92ec3e3ab could not be found. Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '4bd8616d-7dc2-4ac3-96a0-0b8609933869', 'body': {'resize': {'flavorRef': 'd614e930-575e-4bba-8b70-bfa92ec3e3ab'}}} Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 14:06:07.004911 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 26 14:06:07.009608 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 26 14:06:07.009608 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor d614e930-575e-4bba-8b70-bfa92ec3e3ab could not be found. Oct 26 14:06:07.009608 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:06:07.009608 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:06:07.009608 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:06:07.009608 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:06:07.009608 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:06:07.009608 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:06:07.009608 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 14:06:07.009608 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 14:06:07.009608 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 14:06:07.009608 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 14:06:07.009608 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 14:06:07.009608 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 14:06:07.009608 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 26 14:06:07.009608 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 26 14:06:07.009608 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 26 14:06:07.009608 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 26 14:06:07.009608 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor d614e930-575e-4bba-8b70-bfa92ec3e3ab could not be found. Oct 26 14:06:07.009608 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:06:07.009608 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:06:07.009608 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:06:07.009608 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:06:07.009608 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:06:07.009608 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:06:07.009608 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 14:06:07.009608 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 14:06:07.009608 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor d614e930-575e-4bba-8b70-bfa92ec3e3ab could not be found. Oct 26 14:06:07.009608 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:06:07.009608 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7d1b65ba-d7d7-448e-94a8-cbb63a02ea9e tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Returning 400 to user: Flavor d614e930-575e-4bba-8b70-bfa92ec3e3ab could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 14:06:07.012909 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7d1b65ba-d7d7-448e-94a8-cbb63a02ea9e tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] 10.222.0.40 "POST /compute/v2.1/servers/4bd8616d-7dc2-4ac3-96a0-0b8609933869/action" status: 400 len: 107 microversion: 2.1 time: 0.063445 Oct 26 14:06:07.014185 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3699/7421] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 14:06:06 2022] POST /compute/v2.1/servers/4bd8616d-7dc2-4ac3-96a0-0b8609933869/action => generated 107 bytes in 65 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 14:06:07.022784 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b6745280-f6c4-4446-87fe-f29e9445be09 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:06:07.023453 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b6745280-f6c4-4446-87fe-f29e9445be09 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] [instance: 4bd8616d-7dc2-4ac3-96a0-0b8609933869] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:06:07.029397 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b6745280-f6c4-4446-87fe-f29e9445be09 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:07.030005 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b6745280-f6c4-4446-87fe-f29e9445be09 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:07.030463 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b6745280-f6c4-4446-87fe-f29e9445be09 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:07.031180 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b6745280-f6c4-4446-87fe-f29e9445be09 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:07.031663 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b6745280-f6c4-4446-87fe-f29e9445be09 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:07.032112 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b6745280-f6c4-4446-87fe-f29e9445be09 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:07.163292 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b6745280-f6c4-4446-87fe-f29e9445be09 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84a63583faf47dcbefb47077b82eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5546bcfd4bd74e81a96c6ebd5fb273c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:06:07.170961 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b6745280-f6c4-4446-87fe-f29e9445be09 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] 10.222.0.40 "GET /compute/v2.1/servers/4bd8616d-7dc2-4ac3-96a0-0b8609933869" status: 200 len: 1506 microversion: 2.1 time: 0.152162 Oct 26 14:06:07.171528 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3723/7422] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:06:07 2022] GET /compute/v2.1/servers/4bd8616d-7dc2-4ac3-96a0-0b8609933869 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 14:06:07.195777 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4e170ef8-a788-4180-94e5-3efb4c131423 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:06:07.196413 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4e170ef8-a788-4180-94e5-3efb4c131423 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] [instance: 4bd8616d-7dc2-4ac3-96a0-0b8609933869] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:06:07.202504 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e170ef8-a788-4180-94e5-3efb4c131423 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:07.202982 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e170ef8-a788-4180-94e5-3efb4c131423 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:07.203414 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e170ef8-a788-4180-94e5-3efb4c131423 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:07.204145 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e170ef8-a788-4180-94e5-3efb4c131423 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:07.204575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e170ef8-a788-4180-94e5-3efb4c131423 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:07.205009 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4e170ef8-a788-4180-94e5-3efb4c131423 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:07.223877 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:06:07.342187 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4e170ef8-a788-4180-94e5-3efb4c131423 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84a63583faf47dcbefb47077b82eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5546bcfd4bd74e81a96c6ebd5fb273c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:06:07.350466 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4e170ef8-a788-4180-94e5-3efb4c131423 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] 10.222.0.40 "GET /compute/v2.1/servers/4bd8616d-7dc2-4ac3-96a0-0b8609933869" status: 200 len: 1506 microversion: 2.1 time: 0.158621 Oct 26 14:06:07.351046 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3700/7423] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:06:07 2022] GET /compute/v2.1/servers/4bd8616d-7dc2-4ac3-96a0-0b8609933869 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:06:07.373421 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a943b760-b878-4eaf-a247-4a97b3c76463 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a943b760-b878-4eaf-a247-4a97b3c76463 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Request method failure captured: Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: request: POST /compute/v2.1/servers/4bd8616d-7dc2-4ac3-96a0-0b8609933869/action HTTP/1.1 Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 29 Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWT635t6EBGcC3aRbyNTKmAIfH9x6T26gbTYj8wHMJ_AlWSOEC4PgzI8xD969qxmepWeJxMSjkzGoTQjyudvEu9ss-aqwPLgElsE6dQvDKQWOdE2Z2XMgrRaqVXzuaIKaLT15v2GGd3W3ODNVtDzZsKXdIsly5-sT9AbKx_R-vx5mvqw Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 5546bcfd4bd74e81a96c6ebd5fb273c4 Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersNegativeTestJSON-1347487351 Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5546bcfd4bd74e81a96c6ebd5fb273c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5546bcfd4bd74e81a96c6ebd5fb273c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5546bcfd4bd74e81a96c6ebd5fb273c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5546bcfd4bd74e81a96c6ebd5fb273c4"}]}] Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersNegativeTestJSON-1347487351 Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 5546bcfd4bd74e81a96c6ebd5fb273c4 Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1347487351 Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersNegativeTestJSON-1347487351-project Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: c84a63583faf47dcbefb47077b82eccc Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersNegativeTestJSON-1347487351-project Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: {"resize": {"flavorRef": ""}} Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '4bd8616d-7dc2-4ac3-96a0-0b8609933869', 'body': {'resize': {'flavorRef': ''}}} Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise error Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi '' Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:06:07.376981 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:06:07.381979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:06:07.381979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:06:07.381979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:06:07.381979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:06:07.381979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 14:06:07.381979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 14:06:07.381979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 26 14:06:07.381979 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:06:07.381979 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a943b760-b878-4eaf-a247-4a97b3c76463 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 14:06:07.381979 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a943b760-b878-4eaf-a247-4a97b3c76463 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] 10.222.0.40 "POST /compute/v2.1/servers/4bd8616d-7dc2-4ac3-96a0-0b8609933869/action" status: 400 len: 113 microversion: 2.1 time: 0.009375 Oct 26 14:06:07.381979 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3724/7424] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 14:06:07 2022] POST /compute/v2.1/servers/4bd8616d-7dc2-4ac3-96a0-0b8609933869/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 14:06:07.386813 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a2fe8512-210a-4459-a35c-527a8156f378 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:06:07.387418 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a2fe8512-210a-4459-a35c-527a8156f378 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] [instance: 4bd8616d-7dc2-4ac3-96a0-0b8609933869] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:06:07.394166 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2fe8512-210a-4459-a35c-527a8156f378 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:07.394642 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2fe8512-210a-4459-a35c-527a8156f378 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:07.395076 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2fe8512-210a-4459-a35c-527a8156f378 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:07.395758 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2fe8512-210a-4459-a35c-527a8156f378 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:07.396207 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2fe8512-210a-4459-a35c-527a8156f378 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:07.396627 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a2fe8512-210a-4459-a35c-527a8156f378 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:07.524971 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a2fe8512-210a-4459-a35c-527a8156f378 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84a63583faf47dcbefb47077b82eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5546bcfd4bd74e81a96c6ebd5fb273c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:06:07.532665 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a2fe8512-210a-4459-a35c-527a8156f378 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] 10.222.0.40 "GET /compute/v2.1/servers/4bd8616d-7dc2-4ac3-96a0-0b8609933869" status: 200 len: 1506 microversion: 2.1 time: 0.149506 Oct 26 14:06:07.533232 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3701/7425] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:06:07 2022] GET /compute/v2.1/servers/4bd8616d-7dc2-4ac3-96a0-0b8609933869 => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:06:07.559563 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-af137682-fac6-41e9-9085-1b63ce4017b8 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:06:07.560065 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-af137682-fac6-41e9-9085-1b63ce4017b8 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] [instance: dcaef688-7dc4-4cf2-8a89-95f00127f3ba] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:06:07.567715 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af137682-fac6-41e9-9085-1b63ce4017b8 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:07.568209 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af137682-fac6-41e9-9085-1b63ce4017b8 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:07.568656 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af137682-fac6-41e9-9085-1b63ce4017b8 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:07.569350 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af137682-fac6-41e9-9085-1b63ce4017b8 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:07.569847 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af137682-fac6-41e9-9085-1b63ce4017b8 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:07.570285 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af137682-fac6-41e9-9085-1b63ce4017b8 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:07.584314 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-af137682-fac6-41e9-9085-1b63ce4017b8 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] HTTP exception thrown: Instance dcaef688-7dc4-4cf2-8a89-95f00127f3ba could not be found. Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-af137682-fac6-41e9-9085-1b63ce4017b8 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Request method failure captured: Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: request: DELETE /compute/v2.1/servers/dcaef688-7dc4-4cf2-8a89-95f00127f3ba HTTP/1.1 Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWT635t6EBGcC3aRbyNTKmAIfH9x6T26gbTYj8wHMJ_AlWSOEC4PgzI8xD969qxmepWeJxMSjkzGoTQjyudvEu9ss-aqwPLgElsE6dQvDKQWOdE2Z2XMgrRaqVXzuaIKaLT15v2GGd3W3ODNVtDzZsKXdIsly5-sT9AbKx_R-vx5mvqw Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 5546bcfd4bd74e81a96c6ebd5fb273c4 Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-ServersNegativeTestJSON-1347487351 Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5546bcfd4bd74e81a96c6ebd5fb273c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5546bcfd4bd74e81a96c6ebd5fb273c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5546bcfd4bd74e81a96c6ebd5fb273c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5546bcfd4bd74e81a96c6ebd5fb273c4"}]}] Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-ServersNegativeTestJSON-1347487351 Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 5546bcfd4bd74e81a96c6ebd5fb273c4 Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1347487351 Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-ServersNegativeTestJSON-1347487351-project Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: c84a63583faf47dcbefb47077b82eccc Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-ServersNegativeTestJSON-1347487351-project Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance dcaef688-7dc4-4cf2-8a89-95f00127f3ba could not be found. Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'dcaef688-7dc4-4cf2-8a89-95f00127f3ba'} Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcaef688-7dc4-4cf2-8a89-95f00127f3ba could not be found. Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 14:06:07.585910 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 14:06:07.590020 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcaef688-7dc4-4cf2-8a89-95f00127f3ba could not be found. Oct 26 14:06:07.590020 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:06:07.590020 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:06:07.590020 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:06:07.590020 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:06:07.590020 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:06:07.590020 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:06:07.590020 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 14:06:07.590020 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 14:06:07.590020 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcaef688-7dc4-4cf2-8a89-95f00127f3ba could not be found. Oct 26 14:06:07.590020 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:06:07.590020 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-af137682-fac6-41e9-9085-1b63ce4017b8 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Returning 404 to user: Instance dcaef688-7dc4-4cf2-8a89-95f00127f3ba could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 14:06:07.590020 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-af137682-fac6-41e9-9085-1b63ce4017b8 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] 10.222.0.40 "DELETE /compute/v2.1/servers/dcaef688-7dc4-4cf2-8a89-95f00127f3ba" status: 404 len: 111 microversion: 2.1 time: 0.032404 Oct 26 14:06:07.590020 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3725/7426] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 14:06:07 2022] DELETE /compute/v2.1/servers/dcaef688-7dc4-4cf2-8a89-95f00127f3ba => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 14:06:07.595779 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dc6ae089-0c70-4f86-b07f-2355bab85ed5 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:06:07.597099 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-dc6ae089-0c70-4f86-b07f-2355bab85ed5 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] [instance: dcaef688-7dc4-4cf2-8a89-95f00127f3ba] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:06:07.603051 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc6ae089-0c70-4f86-b07f-2355bab85ed5 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:07.603525 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc6ae089-0c70-4f86-b07f-2355bab85ed5 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:07.603960 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc6ae089-0c70-4f86-b07f-2355bab85ed5 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:07.604639 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc6ae089-0c70-4f86-b07f-2355bab85ed5 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:07.605096 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc6ae089-0c70-4f86-b07f-2355bab85ed5 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:07.605540 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc6ae089-0c70-4f86-b07f-2355bab85ed5 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:07.619240 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-dc6ae089-0c70-4f86-b07f-2355bab85ed5 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] HTTP exception thrown: Instance dcaef688-7dc4-4cf2-8a89-95f00127f3ba could not be found. Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dc6ae089-0c70-4f86-b07f-2355bab85ed5 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Request method failure captured: Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/dcaef688-7dc4-4cf2-8a89-95f00127f3ba HTTP/1.1 Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWT635t6EBGcC3aRbyNTKmAIfH9x6T26gbTYj8wHMJ_AlWSOEC4PgzI8xD969qxmepWeJxMSjkzGoTQjyudvEu9ss-aqwPLgElsE6dQvDKQWOdE2Z2XMgrRaqVXzuaIKaLT15v2GGd3W3ODNVtDzZsKXdIsly5-sT9AbKx_R-vx5mvqw Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 5546bcfd4bd74e81a96c6ebd5fb273c4 Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersNegativeTestJSON-1347487351 Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5546bcfd4bd74e81a96c6ebd5fb273c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5546bcfd4bd74e81a96c6ebd5fb273c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5546bcfd4bd74e81a96c6ebd5fb273c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5546bcfd4bd74e81a96c6ebd5fb273c4"}]}] Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersNegativeTestJSON-1347487351 Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 5546bcfd4bd74e81a96c6ebd5fb273c4 Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1347487351 Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersNegativeTestJSON-1347487351-project Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: c84a63583faf47dcbefb47077b82eccc Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersNegativeTestJSON-1347487351-project Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance dcaef688-7dc4-4cf2-8a89-95f00127f3ba could not be found. Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': 'dcaef688-7dc4-4cf2-8a89-95f00127f3ba'} Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcaef688-7dc4-4cf2-8a89-95f00127f3ba could not be found. Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcaef688-7dc4-4cf2-8a89-95f00127f3ba could not be found. Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:06:07.620765 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:06:07.625450 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:06:07.625450 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:06:07.625450 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:06:07.625450 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 14:06:07.625450 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 14:06:07.625450 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcaef688-7dc4-4cf2-8a89-95f00127f3ba could not be found. Oct 26 14:06:07.625450 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:06:07.625450 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dc6ae089-0c70-4f86-b07f-2355bab85ed5 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Returning 404 to user: Instance dcaef688-7dc4-4cf2-8a89-95f00127f3ba could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 14:06:07.625450 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-dc6ae089-0c70-4f86-b07f-2355bab85ed5 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaef688-7dc4-4cf2-8a89-95f00127f3ba" status: 404 len: 111 microversion: 2.1 time: 0.030211 Oct 26 14:06:07.625450 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3702/7427] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:06:07 2022] GET /compute/v2.1/servers/dcaef688-7dc4-4cf2-8a89-95f00127f3ba => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 14:06:07.630568 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-696953a5-9928-4d04-9141-b31af33e51e0 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:06:07.631083 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-696953a5-9928-4d04-9141-b31af33e51e0 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] [instance: 4bd8616d-7dc2-4ac3-96a0-0b8609933869] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:06:07.637024 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-696953a5-9928-4d04-9141-b31af33e51e0 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:07.637549 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-696953a5-9928-4d04-9141-b31af33e51e0 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:07.638008 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-696953a5-9928-4d04-9141-b31af33e51e0 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:07.638751 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-696953a5-9928-4d04-9141-b31af33e51e0 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:07.639221 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-696953a5-9928-4d04-9141-b31af33e51e0 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:07.639663 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-696953a5-9928-4d04-9141-b31af33e51e0 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:07.665893 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-696953a5-9928-4d04-9141-b31af33e51e0 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] [instance: 4bd8616d-7dc2-4ac3-96a0-0b8609933869] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 14:06:07.742338 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-696953a5-9928-4d04-9141-b31af33e51e0 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4bd8616d-7dc2-4ac3-96a0-0b8609933869" status: 204 len: 0 microversion: 2.1 time: 0.115296 Oct 26 14:06:07.742839 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3726/7428] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 14:06:07 2022] DELETE /compute/v2.1/servers/4bd8616d-7dc2-4ac3-96a0-0b8609933869 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 14:06:07.751019 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2d22a071-eb6b-4c8f-86d1-9e7c83954111 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:06:07.751665 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2d22a071-eb6b-4c8f-86d1-9e7c83954111 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] [instance: 4bd8616d-7dc2-4ac3-96a0-0b8609933869] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:06:07.758231 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2d22a071-eb6b-4c8f-86d1-9e7c83954111 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:07.758847 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2d22a071-eb6b-4c8f-86d1-9e7c83954111 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:07.759246 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2d22a071-eb6b-4c8f-86d1-9e7c83954111 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:07.759953 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2d22a071-eb6b-4c8f-86d1-9e7c83954111 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:07.760412 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2d22a071-eb6b-4c8f-86d1-9e7c83954111 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:07.760844 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2d22a071-eb6b-4c8f-86d1-9e7c83954111 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:07.891228 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2d22a071-eb6b-4c8f-86d1-9e7c83954111 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84a63583faf47dcbefb47077b82eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5546bcfd4bd74e81a96c6ebd5fb273c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:06:07.899882 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2d22a071-eb6b-4c8f-86d1-9e7c83954111 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] 10.222.0.40 "GET /compute/v2.1/servers/4bd8616d-7dc2-4ac3-96a0-0b8609933869" status: 200 len: 1512 microversion: 2.1 time: 0.152768 Oct 26 14:06:07.900484 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3703/7429] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:06:07 2022] GET /compute/v2.1/servers/4bd8616d-7dc2-4ac3-96a0-0b8609933869 => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:06:08.923205 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e980bbd0-13c7-4d89-aa36-e9504823a4d8 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:06:08.923925 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e980bbd0-13c7-4d89-aa36-e9504823a4d8 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] [instance: 4bd8616d-7dc2-4ac3-96a0-0b8609933869] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:06:08.930687 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e980bbd0-13c7-4d89-aa36-e9504823a4d8 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:08.931185 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e980bbd0-13c7-4d89-aa36-e9504823a4d8 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:08.931647 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e980bbd0-13c7-4d89-aa36-e9504823a4d8 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:08.932353 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e980bbd0-13c7-4d89-aa36-e9504823a4d8 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:08.932824 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e980bbd0-13c7-4d89-aa36-e9504823a4d8 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:08.933266 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e980bbd0-13c7-4d89-aa36-e9504823a4d8 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:09.067853 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e980bbd0-13c7-4d89-aa36-e9504823a4d8 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84a63583faf47dcbefb47077b82eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5546bcfd4bd74e81a96c6ebd5fb273c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:06:09.075644 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e980bbd0-13c7-4d89-aa36-e9504823a4d8 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] 10.222.0.40 "GET /compute/v2.1/servers/4bd8616d-7dc2-4ac3-96a0-0b8609933869" status: 200 len: 1512 microversion: 2.1 time: 0.156848 Oct 26 14:06:09.076220 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3727/7430] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:06:08 2022] GET /compute/v2.1/servers/4bd8616d-7dc2-4ac3-96a0-0b8609933869 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:06:09.629977 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-c78a9792-1ac6-4fd4-b3a1-374d18657643 req-4c7b7b03-ea93-4c4c-9d2e-1fa0a334ce91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bd8616d-7dc2-4ac3-96a0-0b8609933869", "name": "network-vif-deleted", "tag": "2b013147-aa81-48cd-9215-dba7895c7d32"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:06:09.641821 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-c78a9792-1ac6-4fd4-b3a1-374d18657643 req-4c7b7b03-ea93-4c4c-9d2e-1fa0a334ce91 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:09.642307 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-c78a9792-1ac6-4fd4-b3a1-374d18657643 req-4c7b7b03-ea93-4c4c-9d2e-1fa0a334ce91 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:09.642803 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-c78a9792-1ac6-4fd4-b3a1-374d18657643 req-4c7b7b03-ea93-4c4c-9d2e-1fa0a334ce91 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:09.655622 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-c78a9792-1ac6-4fd4-b3a1-374d18657643 req-4c7b7b03-ea93-4c4c-9d2e-1fa0a334ce91 service nova] Creating event network-vif-deleted:2b013147-aa81-48cd-9215-dba7895c7d32 for instance 4bd8616d-7dc2-4ac3-96a0-0b8609933869 on n-h2-862686-1 Oct 26 14:06:09.661897 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-c78a9792-1ac6-4fd4-b3a1-374d18657643 req-4c7b7b03-ea93-4c4c-9d2e-1fa0a334ce91 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036174 Oct 26 14:06:09.663394 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3704/7431] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:06:10.100701 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8c1ed224-c388-489b-949f-05d860817087 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:06:10.101332 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8c1ed224-c388-489b-949f-05d860817087 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] [instance: 4bd8616d-7dc2-4ac3-96a0-0b8609933869] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:06:10.108286 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8c1ed224-c388-489b-949f-05d860817087 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:10.108842 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8c1ed224-c388-489b-949f-05d860817087 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:10.109330 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8c1ed224-c388-489b-949f-05d860817087 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:10.110075 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8c1ed224-c388-489b-949f-05d860817087 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:10.110547 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8c1ed224-c388-489b-949f-05d860817087 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:10.110989 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8c1ed224-c388-489b-949f-05d860817087 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:10.116375 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:06:10.145903 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8c1ed224-c388-489b-949f-05d860817087 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:10.146401 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8c1ed224-c388-489b-949f-05d860817087 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:10.146856 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8c1ed224-c388-489b-949f-05d860817087 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:10.147321 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-8c1ed224-c388-489b-949f-05d860817087 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lazy-loading 'fault' on Instance uuid 4bd8616d-7dc2-4ac3-96a0-0b8609933869 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 14:06:10.192192 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8c1ed224-c388-489b-949f-05d860817087 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84a63583faf47dcbefb47077b82eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5546bcfd4bd74e81a96c6ebd5fb273c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:06:10.199780 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8c1ed224-c388-489b-949f-05d860817087 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] 10.222.0.40 "GET /compute/v2.1/servers/4bd8616d-7dc2-4ac3-96a0-0b8609933869" status: 200 len: 1307 microversion: 2.1 time: 0.103338 Oct 26 14:06:10.200372 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3728/7432] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:06:10 2022] GET /compute/v2.1/servers/4bd8616d-7dc2-4ac3-96a0-0b8609933869 => generated 1307 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:06:11.224629 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-56df1479-77c8-4bba-8e81-cfc670f75c21 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:06:11.225289 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-56df1479-77c8-4bba-8e81-cfc670f75c21 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] [instance: 4bd8616d-7dc2-4ac3-96a0-0b8609933869] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:06:11.231511 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-56df1479-77c8-4bba-8e81-cfc670f75c21 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:11.232002 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-56df1479-77c8-4bba-8e81-cfc670f75c21 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:11.232452 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-56df1479-77c8-4bba-8e81-cfc670f75c21 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:11.233147 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-56df1479-77c8-4bba-8e81-cfc670f75c21 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:11.233642 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-56df1479-77c8-4bba-8e81-cfc670f75c21 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:11.234076 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-56df1479-77c8-4bba-8e81-cfc670f75c21 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:11.247879 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-56df1479-77c8-4bba-8e81-cfc670f75c21 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] HTTP exception thrown: Instance 4bd8616d-7dc2-4ac3-96a0-0b8609933869 could not be found. Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-56df1479-77c8-4bba-8e81-cfc670f75c21 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Request method failure captured: Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/4bd8616d-7dc2-4ac3-96a0-0b8609933869 HTTP/1.1 Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWT635t6EBGcC3aRbyNTKmAIfH9x6T26gbTYj8wHMJ_AlWSOEC4PgzI8xD969qxmepWeJxMSjkzGoTQjyudvEu9ss-aqwPLgElsE6dQvDKQWOdE2Z2XMgrRaqVXzuaIKaLT15v2GGd3W3ODNVtDzZsKXdIsly5-sT9AbKx_R-vx5mvqw Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 5546bcfd4bd74e81a96c6ebd5fb273c4 Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-ServersNegativeTestJSON-1347487351 Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5546bcfd4bd74e81a96c6ebd5fb273c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5546bcfd4bd74e81a96c6ebd5fb273c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5546bcfd4bd74e81a96c6ebd5fb273c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5546bcfd4bd74e81a96c6ebd5fb273c4"}]}] Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-ServersNegativeTestJSON-1347487351 Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 5546bcfd4bd74e81a96c6ebd5fb273c4 Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1347487351 Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-ServersNegativeTestJSON-1347487351-project Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: c84a63583faf47dcbefb47077b82eccc Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-ServersNegativeTestJSON-1347487351-project Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 4bd8616d-7dc2-4ac3-96a0-0b8609933869 could not be found. Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '4bd8616d-7dc2-4ac3-96a0-0b8609933869'} Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bd8616d-7dc2-4ac3-96a0-0b8609933869 could not be found. Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bd8616d-7dc2-4ac3-96a0-0b8609933869 could not be found. Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:06:11.249829 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:06:11.255174 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:06:11.255174 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:06:11.255174 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:06:11.255174 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 14:06:11.255174 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 14:06:11.255174 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bd8616d-7dc2-4ac3-96a0-0b8609933869 could not be found. Oct 26 14:06:11.255174 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:06:11.255174 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-56df1479-77c8-4bba-8e81-cfc670f75c21 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] Returning 404 to user: Instance 4bd8616d-7dc2-4ac3-96a0-0b8609933869 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 14:06:11.255174 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-56df1479-77c8-4bba-8e81-cfc670f75c21 tempest-ServersNegativeTestJSON-1347487351 tempest-ServersNegativeTestJSON-1347487351-project] 10.222.0.40 "GET /compute/v2.1/servers/4bd8616d-7dc2-4ac3-96a0-0b8609933869" status: 404 len: 111 microversion: 2.1 time: 0.031875 Oct 26 14:06:11.256079 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3705/7433] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:06:11 2022] GET /compute/v2.1/servers/4bd8616d-7dc2-4ac3-96a0-0b8609933869 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 14:06:42.276078 n-d-862686-1 devstack@n-api.service[120598]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 14:06:42.276674 n-d-862686-1 devstack@n-api.service[120598]: Wed Oct 26 14:06:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.40) !!! Oct 26 14:06:42.277200 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:06:42.277994 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:06:42.492820 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b9a8201b-e5cc-4f12-9d5d-d9ed1933e984 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Action: 'create', calling method: .version_select at 0x7f67318bcaf0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1650846962", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBceeBCuk6o32Dx0W1aIHy8YIa7DS7pTVbMqpqzHIGNvsKftE0fz52fs0QQPylv1gaiITj7m8g0xgbPVbywutJovgJ7NEmb+acOxbj+veiVutFHuUHGqqiAc8EVlSgvXVg=="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:06:42.513466 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-b9a8201b-e5cc-4f12-9d5d-d9ed1933e984 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Getting quotas for project 859b1ed863dc40c4bee23f3bf4899ea0. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 14:06:42.519653 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-b9a8201b-e5cc-4f12-9d5d-d9ed1933e984 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Getting quotas for user 878f13b9181742d982ab6c91a17204e2 and project 859b1ed863dc40c4bee23f3bf4899ea0. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 14:06:42.554306 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b9a8201b-e5cc-4f12-9d5d-d9ed1933e984 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.283664 Oct 26 14:06:42.554984 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3729/7434] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 14:06:42 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:06:42.609388 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7058e910-6a36-47c8-897a-10fbee722be9 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1310722235", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1650846962", "networks": [{"uuid": "5d1a1f5c-155c-458d-a5a4-d08f1be6d5d8"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:06:42.620959 n-d-862686-1 devstack@n-api.service[120597]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 14:06:42.621180 n-d-862686-1 devstack@n-api.service[120597]: Wed Oct 26 14:06:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.40) !!! Oct 26 14:06:42.623480 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:06:42.624380 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=20 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:06:42.685455 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-7058e910-6a36-47c8-897a-10fbee722be9 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] validate_networks() for [('5d1a1f5c-155c-458d-a5a4-d08f1be6d5d8', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 14:06:43.223921 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-7058e910-6a36-47c8-897a-10fbee722be9 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 14:06:43.224374 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-7058e910-6a36-47c8-897a-10fbee722be9 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 14:06:43.224856 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-7058e910-6a36-47c8-897a-10fbee722be9 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 14:06:43.225277 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-7058e910-6a36-47c8-897a-10fbee722be9 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 14:06:43.225781 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-7058e910-6a36-47c8-897a-10fbee722be9 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 14:06:43.235025 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7058e910-6a36-47c8-897a-10fbee722be9 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:43.235520 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7058e910-6a36-47c8-897a-10fbee722be9 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:43.236059 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7058e910-6a36-47c8-897a-10fbee722be9 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:43.236794 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7058e910-6a36-47c8-897a-10fbee722be9 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:43.237262 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7058e910-6a36-47c8-897a-10fbee722be9 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:43.237721 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7058e910-6a36-47c8-897a-10fbee722be9 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:43.255181 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-7058e910-6a36-47c8-897a-10fbee722be9 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Getting quotas for project 859b1ed863dc40c4bee23f3bf4899ea0. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 14:06:43.260393 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-7058e910-6a36-47c8-897a-10fbee722be9 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Getting quotas for user 878f13b9181742d982ab6c91a17204e2 and project 859b1ed863dc40c4bee23f3bf4899ea0. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 14:06:43.273497 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7058e910-6a36-47c8-897a-10fbee722be9 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 14:06:43.275845 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7058e910-6a36-47c8-897a-10fbee722be9 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 8c248f8a-7881-4caf-aa77-bf23f54d9b54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 14:06:43.330216 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7058e910-6a36-47c8-897a-10fbee722be9 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.723888 Oct 26 14:06:43.330944 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3706/7435] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 14:06:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 14:06:43.342788 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-512a1a5e-4250-4daf-a389-e22dc8e65cfe tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:06:43.343418 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-512a1a5e-4250-4daf-a389-e22dc8e65cfe tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 8c248f8a-7881-4caf-aa77-bf23f54d9b54] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:06:43.403070 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-512a1a5e-4250-4daf-a389-e22dc8e65cfe tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f13b9181742d982ab6c91a17204e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b1ed863dc40c4bee23f3bf4899ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:06:43.410865 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-512a1a5e-4250-4daf-a389-e22dc8e65cfe tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54" status: 200 len: 1263 microversion: 2.1 time: 0.072785 Oct 26 14:06:43.411446 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3730/7436] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:06:43 2022] GET /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54 => generated 1263 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:06:44.435447 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-995ad709-25e1-42b1-91e8-9cfa4b3c3991 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:06:44.436366 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-995ad709-25e1-42b1-91e8-9cfa4b3c3991 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 8c248f8a-7881-4caf-aa77-bf23f54d9b54] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:06:44.456661 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-995ad709-25e1-42b1-91e8-9cfa4b3c3991 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:44.457419 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-995ad709-25e1-42b1-91e8-9cfa4b3c3991 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:44.458051 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-995ad709-25e1-42b1-91e8-9cfa4b3c3991 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:44.458968 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-995ad709-25e1-42b1-91e8-9cfa4b3c3991 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:44.459595 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-995ad709-25e1-42b1-91e8-9cfa4b3c3991 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:44.460187 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-995ad709-25e1-42b1-91e8-9cfa4b3c3991 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:44.558305 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-995ad709-25e1-42b1-91e8-9cfa4b3c3991 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f13b9181742d982ab6c91a17204e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b1ed863dc40c4bee23f3bf4899ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:06:44.569284 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-995ad709-25e1-42b1-91e8-9cfa4b3c3991 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54" status: 200 len: 1323 microversion: 2.1 time: 0.139075 Oct 26 14:06:44.569954 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3707/7437] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:06:44 2022] GET /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54 => generated 1323 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:06:45.604284 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-28f32c21-8dde-4b64-bec2-d95fd25b731d tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:06:45.606214 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-28f32c21-8dde-4b64-bec2-d95fd25b731d tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 8c248f8a-7881-4caf-aa77-bf23f54d9b54] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:06:45.615205 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28f32c21-8dde-4b64-bec2-d95fd25b731d tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:45.616090 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28f32c21-8dde-4b64-bec2-d95fd25b731d tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:45.616719 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28f32c21-8dde-4b64-bec2-d95fd25b731d tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:45.620361 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28f32c21-8dde-4b64-bec2-d95fd25b731d tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:45.621570 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28f32c21-8dde-4b64-bec2-d95fd25b731d tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:45.622208 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28f32c21-8dde-4b64-bec2-d95fd25b731d tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:45.931496 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-28f32c21-8dde-4b64-bec2-d95fd25b731d tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f13b9181742d982ab6c91a17204e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b1ed863dc40c4bee23f3bf4899ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:06:45.940538 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-28f32c21-8dde-4b64-bec2-d95fd25b731d tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54" status: 200 len: 1363 microversion: 2.1 time: 0.350500 Oct 26 14:06:45.954606 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3731/7438] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:06:45 2022] GET /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54 => generated 1363 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:06:46.117932 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-aea3e141-9367-441b-b6d4-54814b42c922 req-96ac9b1d-e901-4036-83d6-aaa90dbcd6b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c248f8a-7881-4caf-aa77-bf23f54d9b54", "tag": "3e700992-7127-40ff-9052-9788572890b3"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:06:46.130389 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-aea3e141-9367-441b-b6d4-54814b42c922 req-96ac9b1d-e901-4036-83d6-aaa90dbcd6b1 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:46.130880 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-aea3e141-9367-441b-b6d4-54814b42c922 req-96ac9b1d-e901-4036-83d6-aaa90dbcd6b1 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:46.131339 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-aea3e141-9367-441b-b6d4-54814b42c922 req-96ac9b1d-e901-4036-83d6-aaa90dbcd6b1 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:46.144795 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-aea3e141-9367-441b-b6d4-54814b42c922 req-96ac9b1d-e901-4036-83d6-aaa90dbcd6b1 service nova] Creating event network-changed:3e700992-7127-40ff-9052-9788572890b3 for instance 8c248f8a-7881-4caf-aa77-bf23f54d9b54 on n-h2-862686-1 Oct 26 14:06:46.152094 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-aea3e141-9367-441b-b6d4-54814b42c922 req-96ac9b1d-e901-4036-83d6-aaa90dbcd6b1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038857 Oct 26 14:06:46.153524 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3708/7439] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:06:46.964555 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ebf1232f-e56e-4f43-8278-ba1b1fdeb1dd tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:06:46.965188 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ebf1232f-e56e-4f43-8278-ba1b1fdeb1dd tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 8c248f8a-7881-4caf-aa77-bf23f54d9b54] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:06:46.972465 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ebf1232f-e56e-4f43-8278-ba1b1fdeb1dd tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:46.972970 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ebf1232f-e56e-4f43-8278-ba1b1fdeb1dd tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:46.973431 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ebf1232f-e56e-4f43-8278-ba1b1fdeb1dd tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:46.974181 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ebf1232f-e56e-4f43-8278-ba1b1fdeb1dd tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:46.974651 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ebf1232f-e56e-4f43-8278-ba1b1fdeb1dd tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:46.975091 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ebf1232f-e56e-4f43-8278-ba1b1fdeb1dd tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:47.108829 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ebf1232f-e56e-4f43-8278-ba1b1fdeb1dd tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f13b9181742d982ab6c91a17204e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b1ed863dc40c4bee23f3bf4899ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:06:47.117128 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ebf1232f-e56e-4f43-8278-ba1b1fdeb1dd tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54" status: 200 len: 1363 microversion: 2.1 time: 0.156548 Oct 26 14:06:47.117744 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3732/7440] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:06:46 2022] GET /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:06:48.141738 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1a6b835a-e222-4007-a991-cbce0eabac84 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:06:48.143047 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1a6b835a-e222-4007-a991-cbce0eabac84 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 8c248f8a-7881-4caf-aa77-bf23f54d9b54] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:06:48.149132 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a6b835a-e222-4007-a991-cbce0eabac84 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:48.149648 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a6b835a-e222-4007-a991-cbce0eabac84 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:48.150091 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a6b835a-e222-4007-a991-cbce0eabac84 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:48.150786 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a6b835a-e222-4007-a991-cbce0eabac84 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:48.151238 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a6b835a-e222-4007-a991-cbce0eabac84 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:48.151662 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a6b835a-e222-4007-a991-cbce0eabac84 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:48.282971 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1a6b835a-e222-4007-a991-cbce0eabac84 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f13b9181742d982ab6c91a17204e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b1ed863dc40c4bee23f3bf4899ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:06:48.291848 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1a6b835a-e222-4007-a991-cbce0eabac84 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54" status: 200 len: 1363 microversion: 2.1 time: 0.155260 Oct 26 14:06:48.292929 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3709/7441] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:06:48 2022] GET /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:06:49.317072 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-db3b9a8b-4a9d-4be7-87d6-c83b22b0157b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:06:49.317735 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-db3b9a8b-4a9d-4be7-87d6-c83b22b0157b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 8c248f8a-7881-4caf-aa77-bf23f54d9b54] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:06:49.324140 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db3b9a8b-4a9d-4be7-87d6-c83b22b0157b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:49.324635 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db3b9a8b-4a9d-4be7-87d6-c83b22b0157b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:49.325082 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db3b9a8b-4a9d-4be7-87d6-c83b22b0157b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:49.325825 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db3b9a8b-4a9d-4be7-87d6-c83b22b0157b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:49.326302 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db3b9a8b-4a9d-4be7-87d6-c83b22b0157b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:49.326811 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-db3b9a8b-4a9d-4be7-87d6-c83b22b0157b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:49.458620 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-db3b9a8b-4a9d-4be7-87d6-c83b22b0157b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f13b9181742d982ab6c91a17204e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b1ed863dc40c4bee23f3bf4899ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:06:49.466277 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-db3b9a8b-4a9d-4be7-87d6-c83b22b0157b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54" status: 200 len: 1363 microversion: 2.1 time: 0.153951 Oct 26 14:06:49.466853 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3733/7442] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:06:49 2022] GET /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:06:50.489109 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a0b80345-b706-4e98-ba5f-b49abcaee12f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:06:50.489764 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a0b80345-b706-4e98-ba5f-b49abcaee12f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 8c248f8a-7881-4caf-aa77-bf23f54d9b54] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:06:50.496580 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0b80345-b706-4e98-ba5f-b49abcaee12f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:50.497093 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0b80345-b706-4e98-ba5f-b49abcaee12f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:50.497565 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0b80345-b706-4e98-ba5f-b49abcaee12f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:50.498264 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0b80345-b706-4e98-ba5f-b49abcaee12f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:50.498774 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0b80345-b706-4e98-ba5f-b49abcaee12f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:50.499153 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0b80345-b706-4e98-ba5f-b49abcaee12f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:50.633779 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a0b80345-b706-4e98-ba5f-b49abcaee12f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f13b9181742d982ab6c91a17204e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b1ed863dc40c4bee23f3bf4899ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:06:50.641462 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a0b80345-b706-4e98-ba5f-b49abcaee12f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54" status: 200 len: 1363 microversion: 2.1 time: 0.156403 Oct 26 14:06:50.642996 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3710/7443] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:06:50 2022] GET /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:06:51.665187 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6cc0f6fc-9744-4756-ac3d-2eaafa72e686 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:06:51.665865 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6cc0f6fc-9744-4756-ac3d-2eaafa72e686 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 8c248f8a-7881-4caf-aa77-bf23f54d9b54] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:06:51.672680 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6cc0f6fc-9744-4756-ac3d-2eaafa72e686 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:51.673302 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6cc0f6fc-9744-4756-ac3d-2eaafa72e686 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:51.673784 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6cc0f6fc-9744-4756-ac3d-2eaafa72e686 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:51.674487 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6cc0f6fc-9744-4756-ac3d-2eaafa72e686 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:51.674957 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6cc0f6fc-9744-4756-ac3d-2eaafa72e686 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:51.675399 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6cc0f6fc-9744-4756-ac3d-2eaafa72e686 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:51.806851 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6cc0f6fc-9744-4756-ac3d-2eaafa72e686 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f13b9181742d982ab6c91a17204e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b1ed863dc40c4bee23f3bf4899ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:06:51.814834 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6cc0f6fc-9744-4756-ac3d-2eaafa72e686 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54" status: 200 len: 1363 microversion: 2.1 time: 0.153473 Oct 26 14:06:51.815502 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3734/7444] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:06:51 2022] GET /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:06:52.081698 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-9368310d-e91d-4530-9c80-839c88294094 req-a94960bc-8e1f-4955-b644-894615f33bd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c248f8a-7881-4caf-aa77-bf23f54d9b54", "name": "network-vif-plugged", "status": "completed", "tag": "3e700992-7127-40ff-9052-9788572890b3"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:06:52.092507 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9368310d-e91d-4530-9c80-839c88294094 req-a94960bc-8e1f-4955-b644-894615f33bd2 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:52.092993 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9368310d-e91d-4530-9c80-839c88294094 req-a94960bc-8e1f-4955-b644-894615f33bd2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:52.093426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9368310d-e91d-4530-9c80-839c88294094 req-a94960bc-8e1f-4955-b644-894615f33bd2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:52.105220 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-9368310d-e91d-4530-9c80-839c88294094 req-a94960bc-8e1f-4955-b644-894615f33bd2 service nova] Creating event network-vif-plugged:3e700992-7127-40ff-9052-9788572890b3 for instance 8c248f8a-7881-4caf-aa77-bf23f54d9b54 on n-h2-862686-1 Oct 26 14:06:52.110190 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-9368310d-e91d-4530-9c80-839c88294094 req-a94960bc-8e1f-4955-b644-894615f33bd2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032960 Oct 26 14:06:52.110791 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3711/7445] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:06:52.838500 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a5609fed-e7a4-4fe9-8486-a4bb2e7946de tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:06:52.839133 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a5609fed-e7a4-4fe9-8486-a4bb2e7946de tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 8c248f8a-7881-4caf-aa77-bf23f54d9b54] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:06:52.846660 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5609fed-e7a4-4fe9-8486-a4bb2e7946de tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:52.847162 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5609fed-e7a4-4fe9-8486-a4bb2e7946de tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:52.847621 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5609fed-e7a4-4fe9-8486-a4bb2e7946de tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:52.848333 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5609fed-e7a4-4fe9-8486-a4bb2e7946de tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:52.848809 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5609fed-e7a4-4fe9-8486-a4bb2e7946de tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:52.849259 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5609fed-e7a4-4fe9-8486-a4bb2e7946de tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:52.977850 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a5609fed-e7a4-4fe9-8486-a4bb2e7946de tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f13b9181742d982ab6c91a17204e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b1ed863dc40c4bee23f3bf4899ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:06:52.986195 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a5609fed-e7a4-4fe9-8486-a4bb2e7946de tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54" status: 200 len: 1363 microversion: 2.1 time: 0.150979 Oct 26 14:06:52.986763 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3735/7446] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:06:52 2022] GET /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:06:54.006840 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:06:54.007546 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:06:54.011609 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-985d23cf-cbe0-4b79-a5f1-d8398379768f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:06:54.012301 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-985d23cf-cbe0-4b79-a5f1-d8398379768f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 8c248f8a-7881-4caf-aa77-bf23f54d9b54] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:06:54.019852 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-985d23cf-cbe0-4b79-a5f1-d8398379768f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:54.020331 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-985d23cf-cbe0-4b79-a5f1-d8398379768f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:54.020766 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-985d23cf-cbe0-4b79-a5f1-d8398379768f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:54.021447 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-985d23cf-cbe0-4b79-a5f1-d8398379768f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:54.021936 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-985d23cf-cbe0-4b79-a5f1-d8398379768f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:54.022360 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-985d23cf-cbe0-4b79-a5f1-d8398379768f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:54.157221 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-985d23cf-cbe0-4b79-a5f1-d8398379768f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f13b9181742d982ab6c91a17204e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b1ed863dc40c4bee23f3bf4899ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:06:54.165496 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-985d23cf-cbe0-4b79-a5f1-d8398379768f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54" status: 200 len: 1555 microversion: 2.1 time: 0.160583 Oct 26 14:06:54.166067 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3712/7447] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:06:54 2022] GET /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54 => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:06:54.188466 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f5da61c3-d19b-49bf-9cdb-9fa97d88e1d2 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:06:54.189779 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f5da61c3-d19b-49bf-9cdb-9fa97d88e1d2 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 8c248f8a-7881-4caf-aa77-bf23f54d9b54] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:06:54.191609 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:06:54.197607 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5da61c3-d19b-49bf-9cdb-9fa97d88e1d2 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:54.198109 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5da61c3-d19b-49bf-9cdb-9fa97d88e1d2 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:54.198566 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5da61c3-d19b-49bf-9cdb-9fa97d88e1d2 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:54.199278 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5da61c3-d19b-49bf-9cdb-9fa97d88e1d2 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:54.199752 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5da61c3-d19b-49bf-9cdb-9fa97d88e1d2 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:54.200196 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5da61c3-d19b-49bf-9cdb-9fa97d88e1d2 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:54.333535 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f5da61c3-d19b-49bf-9cdb-9fa97d88e1d2 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f13b9181742d982ab6c91a17204e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b1ed863dc40c4bee23f3bf4899ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:06:54.341327 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f5da61c3-d19b-49bf-9cdb-9fa97d88e1d2 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54" status: 200 len: 1555 microversion: 2.1 time: 0.156739 Oct 26 14:06:54.341945 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3736/7448] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:06:54 2022] GET /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:06:56.156191 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d8ced825-4304-4968-94c4-e4155d6d5124 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9763d419-f9fe-4f96-b715-34fa1a564c22"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:06:56.158677 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d8ced825-4304-4968-94c4-e4155d6d5124 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 8c248f8a-7881-4caf-aa77-bf23f54d9b54] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:06:56.165758 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8ced825-4304-4968-94c4-e4155d6d5124 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:56.166242 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8ced825-4304-4968-94c4-e4155d6d5124 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:56.166679 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8ced825-4304-4968-94c4-e4155d6d5124 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:56.167369 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8ced825-4304-4968-94c4-e4155d6d5124 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:06:56.167825 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8ced825-4304-4968-94c4-e4155d6d5124 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:06:56.168251 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8ced825-4304-4968-94c4-e4155d6d5124 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:06:56.410919 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d8ced825-4304-4968-94c4-e4155d6d5124 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "POST /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258520 Oct 26 14:06:56.411570 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3713/7449] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Oct 26 14:06:56 2022] POST /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:07:07.130168 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-122aabec-89de-4e5b-aadf-18a6902d24ba tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:07:07.130703 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-122aabec-89de-4e5b-aadf-18a6902d24ba tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 8c248f8a-7881-4caf-aa77-bf23f54d9b54] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:07:07.133436 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:07:07.134238 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=36 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:07:07.140968 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-122aabec-89de-4e5b-aadf-18a6902d24ba tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:07.141465 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-122aabec-89de-4e5b-aadf-18a6902d24ba tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:07.141930 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-122aabec-89de-4e5b-aadf-18a6902d24ba tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:07.143298 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-122aabec-89de-4e5b-aadf-18a6902d24ba tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:07.143788 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-122aabec-89de-4e5b-aadf-18a6902d24ba tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:07.144229 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-122aabec-89de-4e5b-aadf-18a6902d24ba tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:07.226077 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-122aabec-89de-4e5b-aadf-18a6902d24ba tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lazy-loading 'services' on Instance uuid 8c248f8a-7881-4caf-aa77-bf23f54d9b54 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 14:07:07.299317 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-122aabec-89de-4e5b-aadf-18a6902d24ba tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54/os-volume_attachments/9763d419-f9fe-4f96-b715-34fa1a564c22" status: 202 len: 0 microversion: 2.1 time: 0.173490 Oct 26 14:07:07.300712 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3737/7450] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Oct 26 14:07:07 2022] DELETE /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54/os-volume_attachments/9763d419-f9fe-4f96-b715-34fa1a564c22 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 14:07:07.307177 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:07:07.307967 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:07:07.312539 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0fe0a8ef-6f50-4831-bab3-b9cea26bc311 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:07:07.314960 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0fe0a8ef-6f50-4831-bab3-b9cea26bc311 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 8c248f8a-7881-4caf-aa77-bf23f54d9b54] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:07:07.322892 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0fe0a8ef-6f50-4831-bab3-b9cea26bc311 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:07.323377 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0fe0a8ef-6f50-4831-bab3-b9cea26bc311 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:07.323817 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0fe0a8ef-6f50-4831-bab3-b9cea26bc311 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:07.324519 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0fe0a8ef-6f50-4831-bab3-b9cea26bc311 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:07.324982 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0fe0a8ef-6f50-4831-bab3-b9cea26bc311 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:07.325410 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0fe0a8ef-6f50-4831-bab3-b9cea26bc311 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:07.357872 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0fe0a8ef-6f50-4831-bab3-b9cea26bc311 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052535 Oct 26 14:07:07.359089 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3714/7451] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 14:07:07 2022] GET /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:07:08.372733 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a348289d-23aa-479d-8e40-f6ed841442c3 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:07:08.375138 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a348289d-23aa-479d-8e40-f6ed841442c3 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 8c248f8a-7881-4caf-aa77-bf23f54d9b54] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:07:08.382016 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a348289d-23aa-479d-8e40-f6ed841442c3 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:08.382513 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a348289d-23aa-479d-8e40-f6ed841442c3 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:08.382959 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a348289d-23aa-479d-8e40-f6ed841442c3 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:08.383664 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a348289d-23aa-479d-8e40-f6ed841442c3 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:08.384130 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a348289d-23aa-479d-8e40-f6ed841442c3 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:08.384564 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a348289d-23aa-479d-8e40-f6ed841442c3 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:08.415461 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a348289d-23aa-479d-8e40-f6ed841442c3 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047912 Oct 26 14:07:08.416028 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3738/7452] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 14:07:08 2022] GET /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:07:09.428258 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e22b3f84-1b82-41c0-8829-5ed8d298816f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:07:09.430480 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e22b3f84-1b82-41c0-8829-5ed8d298816f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 8c248f8a-7881-4caf-aa77-bf23f54d9b54] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:07:09.437610 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e22b3f84-1b82-41c0-8829-5ed8d298816f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:09.438099 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e22b3f84-1b82-41c0-8829-5ed8d298816f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:09.438544 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e22b3f84-1b82-41c0-8829-5ed8d298816f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:09.439241 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e22b3f84-1b82-41c0-8829-5ed8d298816f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:09.439741 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e22b3f84-1b82-41c0-8829-5ed8d298816f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:09.440287 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e22b3f84-1b82-41c0-8829-5ed8d298816f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:09.469871 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e22b3f84-1b82-41c0-8829-5ed8d298816f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046234 Oct 26 14:07:09.470355 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3715/7453] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 14:07:09 2022] GET /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:07:10.482995 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1ef159ca-21ed-4cf4-8ec0-93b29dd06a57 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:07:10.485439 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1ef159ca-21ed-4cf4-8ec0-93b29dd06a57 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 8c248f8a-7881-4caf-aa77-bf23f54d9b54] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:07:10.492864 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ef159ca-21ed-4cf4-8ec0-93b29dd06a57 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:10.493360 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ef159ca-21ed-4cf4-8ec0-93b29dd06a57 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:10.493872 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ef159ca-21ed-4cf4-8ec0-93b29dd06a57 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:10.494584 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ef159ca-21ed-4cf4-8ec0-93b29dd06a57 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:10.495052 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ef159ca-21ed-4cf4-8ec0-93b29dd06a57 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:10.495495 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ef159ca-21ed-4cf4-8ec0-93b29dd06a57 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:10.526712 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1ef159ca-21ed-4cf4-8ec0-93b29dd06a57 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047778 Oct 26 14:07:10.527286 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3739/7454] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 14:07:10 2022] GET /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:07:11.539649 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-38fa8f79-a983-440f-829b-e55972419c83 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:07:11.541890 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-38fa8f79-a983-440f-829b-e55972419c83 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 8c248f8a-7881-4caf-aa77-bf23f54d9b54] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:07:11.549664 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38fa8f79-a983-440f-829b-e55972419c83 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:11.550212 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38fa8f79-a983-440f-829b-e55972419c83 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:11.550647 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38fa8f79-a983-440f-829b-e55972419c83 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:11.551348 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38fa8f79-a983-440f-829b-e55972419c83 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:11.551799 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38fa8f79-a983-440f-829b-e55972419c83 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:11.552225 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38fa8f79-a983-440f-829b-e55972419c83 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:11.583264 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-38fa8f79-a983-440f-829b-e55972419c83 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047585 Oct 26 14:07:11.583835 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3716/7455] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 14:07:11 2022] GET /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:07:12.597780 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-de2001ec-960f-4f9c-a4d1-f5f2e921d93f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:07:12.599951 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-de2001ec-960f-4f9c-a4d1-f5f2e921d93f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 8c248f8a-7881-4caf-aa77-bf23f54d9b54] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:07:12.606719 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de2001ec-960f-4f9c-a4d1-f5f2e921d93f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:12.607216 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de2001ec-960f-4f9c-a4d1-f5f2e921d93f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:12.607669 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de2001ec-960f-4f9c-a4d1-f5f2e921d93f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:12.608383 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de2001ec-960f-4f9c-a4d1-f5f2e921d93f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:12.608855 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de2001ec-960f-4f9c-a4d1-f5f2e921d93f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:12.609301 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de2001ec-960f-4f9c-a4d1-f5f2e921d93f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:12.641214 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-de2001ec-960f-4f9c-a4d1-f5f2e921d93f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047642 Oct 26 14:07:12.641832 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3740/7456] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 14:07:12 2022] GET /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 14:07:12.653130 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e3067e29-8a71-4be4-a117-d5c6211cf421 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:07:12.653654 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e3067e29-8a71-4be4-a117-d5c6211cf421 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 8c248f8a-7881-4caf-aa77-bf23f54d9b54] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:07:12.660590 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3067e29-8a71-4be4-a117-d5c6211cf421 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:12.661085 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3067e29-8a71-4be4-a117-d5c6211cf421 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:12.661550 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3067e29-8a71-4be4-a117-d5c6211cf421 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:12.662244 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3067e29-8a71-4be4-a117-d5c6211cf421 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:12.662701 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3067e29-8a71-4be4-a117-d5c6211cf421 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:12.663130 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3067e29-8a71-4be4-a117-d5c6211cf421 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:12.740855 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-e3067e29-8a71-4be4-a117-d5c6211cf421 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] HTTP exception thrown: Instance 8c248f8a-7881-4caf-aa77-bf23f54d9b54 is not attached to volume 9763d419-f9fe-4f96-b715-34fa1a564c22 Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e3067e29-8a71-4be4-a117-d5c6211cf421 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Request method failure captured: Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54/os-volume_attachments/9763d419-f9fe-4f96-b715-34fa1a564c22 HTTP/1.1 Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWT7tPtFRgi7F-xA3DOTONjqmwyYK-r4z3CdNtIVBTaSUxovOxevrmP_5W0m0T9KRIWRR8x2g3bzPpvguBMq4Nf8bEK1KKjbYSQ4D-50jyWGEpILkiLxDaEFba7B_5kvQ-VlKuP77ymAQVNU6T3ckQ7sU15A4khd16HDx_fJMS4Atuys Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 859b1ed863dc40c4bee23f3bf4899ea0 Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1286211498 Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/859b1ed863dc40c4bee23f3bf4899ea0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/859b1ed863dc40c4bee23f3bf4899ea0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_859b1ed863dc40c4bee23f3bf4899ea0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/859b1ed863dc40c4bee23f3bf4899ea0"}]}] Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-TestEncryptedCinderVolumes-1286211498 Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 859b1ed863dc40c4bee23f3bf4899ea0 Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1286211498 Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-TestEncryptedCinderVolumes-1286211498-project Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 878f13b9181742d982ab6c91a17204e2 Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-TestEncryptedCinderVolumes-1286211498-project Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 8c248f8a-7881-4caf-aa77-bf23f54d9b54 is not attached to volume 9763d419-f9fe-4f96-b715-34fa1a564c22 Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'server_id': '8c248f8a-7881-4caf-aa77-bf23f54d9b54', 'id': '9763d419-f9fe-4f96-b715-34fa1a564c22'} Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9763d419-f9fe-4f96-b715-34fa1a564c22. Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c248f8a-7881-4caf-aa77-bf23f54d9b54 is not attached to volume 9763d419-f9fe-4f96-b715-34fa1a564c22 Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:07:12.750414 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:07:12.755636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 14:07:12.755636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 14:07:12.755636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c248f8a-7881-4caf-aa77-bf23f54d9b54 is not attached to volume 9763d419-f9fe-4f96-b715-34fa1a564c22 Oct 26 14:07:12.755636 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:07:12.755636 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e3067e29-8a71-4be4-a117-d5c6211cf421 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Returning 404 to user: Instance 8c248f8a-7881-4caf-aa77-bf23f54d9b54 is not attached to volume 9763d419-f9fe-4f96-b715-34fa1a564c22 {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 14:07:12.755636 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e3067e29-8a71-4be4-a117-d5c6211cf421 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54/os-volume_attachments/9763d419-f9fe-4f96-b715-34fa1a564c22" status: 404 len: 154 microversion: 2.1 time: 0.102864 Oct 26 14:07:12.755636 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3717/7457] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Oct 26 14:07:12 2022] DELETE /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54/os-volume_attachments/9763d419-f9fe-4f96-b715-34fa1a564c22 => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 14:07:16.134420 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9ad14421-5446-48cc-a31b-ed73ce319718 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:07:16.134912 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9ad14421-5446-48cc-a31b-ed73ce319718 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 8c248f8a-7881-4caf-aa77-bf23f54d9b54] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:07:16.141849 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9ad14421-5446-48cc-a31b-ed73ce319718 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:16.142411 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9ad14421-5446-48cc-a31b-ed73ce319718 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:16.143702 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9ad14421-5446-48cc-a31b-ed73ce319718 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:16.144491 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9ad14421-5446-48cc-a31b-ed73ce319718 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:16.145047 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9ad14421-5446-48cc-a31b-ed73ce319718 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:16.145520 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9ad14421-5446-48cc-a31b-ed73ce319718 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:16.171583 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9ad14421-5446-48cc-a31b-ed73ce319718 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 8c248f8a-7881-4caf-aa77-bf23f54d9b54] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 14:07:16.251711 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9ad14421-5446-48cc-a31b-ed73ce319718 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54" status: 204 len: 0 microversion: 2.1 time: 0.121064 Oct 26 14:07:16.253176 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3741/7458] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 14:07:16 2022] DELETE /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 14:07:16.261329 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bdc11056-eae8-4a01-8036-e271da8000d3 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:07:16.262075 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bdc11056-eae8-4a01-8036-e271da8000d3 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 8c248f8a-7881-4caf-aa77-bf23f54d9b54] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:07:16.270352 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bdc11056-eae8-4a01-8036-e271da8000d3 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:16.271114 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bdc11056-eae8-4a01-8036-e271da8000d3 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:16.271864 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bdc11056-eae8-4a01-8036-e271da8000d3 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:16.273018 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bdc11056-eae8-4a01-8036-e271da8000d3 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:16.273644 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bdc11056-eae8-4a01-8036-e271da8000d3 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:16.274286 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bdc11056-eae8-4a01-8036-e271da8000d3 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:16.413011 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bdc11056-eae8-4a01-8036-e271da8000d3 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f13b9181742d982ab6c91a17204e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b1ed863dc40c4bee23f3bf4899ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:07:16.420991 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bdc11056-eae8-4a01-8036-e271da8000d3 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54" status: 200 len: 1561 microversion: 2.1 time: 0.163642 Oct 26 14:07:16.421572 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3718/7459] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:07:16 2022] GET /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:07:17.444913 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d5a31be7-7162-47ee-95c7-24c72c45332b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:07:17.445667 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d5a31be7-7162-47ee-95c7-24c72c45332b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 8c248f8a-7881-4caf-aa77-bf23f54d9b54] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:07:17.452493 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5a31be7-7162-47ee-95c7-24c72c45332b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:17.452987 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5a31be7-7162-47ee-95c7-24c72c45332b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:17.453432 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5a31be7-7162-47ee-95c7-24c72c45332b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:17.454155 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5a31be7-7162-47ee-95c7-24c72c45332b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:17.454619 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5a31be7-7162-47ee-95c7-24c72c45332b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:17.455492 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d5a31be7-7162-47ee-95c7-24c72c45332b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:17.583232 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d5a31be7-7162-47ee-95c7-24c72c45332b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f13b9181742d982ab6c91a17204e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b1ed863dc40c4bee23f3bf4899ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:07:17.590863 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d5a31be7-7162-47ee-95c7-24c72c45332b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54" status: 200 len: 1561 microversion: 2.1 time: 0.150364 Oct 26 14:07:17.591447 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3742/7460] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:07:17 2022] GET /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:07:18.491765 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-9dd825d5-843a-4a01-97f9-8dc72bb45431 req-a5c3ec04-c35d-4015-81d2-a841de4ed2be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c248f8a-7881-4caf-aa77-bf23f54d9b54", "name": "network-vif-deleted", "tag": "3e700992-7127-40ff-9052-9788572890b3"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:07:18.502879 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9dd825d5-843a-4a01-97f9-8dc72bb45431 req-a5c3ec04-c35d-4015-81d2-a841de4ed2be service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:18.503467 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9dd825d5-843a-4a01-97f9-8dc72bb45431 req-a5c3ec04-c35d-4015-81d2-a841de4ed2be service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:18.503982 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9dd825d5-843a-4a01-97f9-8dc72bb45431 req-a5c3ec04-c35d-4015-81d2-a841de4ed2be service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:18.517115 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-9dd825d5-843a-4a01-97f9-8dc72bb45431 req-a5c3ec04-c35d-4015-81d2-a841de4ed2be service nova] Creating event network-vif-deleted:3e700992-7127-40ff-9052-9788572890b3 for instance 8c248f8a-7881-4caf-aa77-bf23f54d9b54 on n-h2-862686-1 Oct 26 14:07:18.523680 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-9dd825d5-843a-4a01-97f9-8dc72bb45431 req-a5c3ec04-c35d-4015-81d2-a841de4ed2be service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105982 Oct 26 14:07:18.524381 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3719/7461] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:07:18.614796 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-838da922-05b2-4c23-8277-6270cc5486e4 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:07:18.615407 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-838da922-05b2-4c23-8277-6270cc5486e4 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 8c248f8a-7881-4caf-aa77-bf23f54d9b54] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:07:18.622196 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-838da922-05b2-4c23-8277-6270cc5486e4 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:18.622616 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-838da922-05b2-4c23-8277-6270cc5486e4 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:18.623069 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-838da922-05b2-4c23-8277-6270cc5486e4 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:18.623768 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-838da922-05b2-4c23-8277-6270cc5486e4 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:18.624258 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-838da922-05b2-4c23-8277-6270cc5486e4 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:18.624679 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-838da922-05b2-4c23-8277-6270cc5486e4 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:18.657300 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-838da922-05b2-4c23-8277-6270cc5486e4 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:18.657845 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-838da922-05b2-4c23-8277-6270cc5486e4 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:18.658483 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-838da922-05b2-4c23-8277-6270cc5486e4 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:18.658965 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-838da922-05b2-4c23-8277-6270cc5486e4 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lazy-loading 'fault' on Instance uuid 8c248f8a-7881-4caf-aa77-bf23f54d9b54 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 14:07:18.701924 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-838da922-05b2-4c23-8277-6270cc5486e4 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f13b9181742d982ab6c91a17204e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b1ed863dc40c4bee23f3bf4899ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:07:18.710043 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-838da922-05b2-4c23-8277-6270cc5486e4 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54" status: 200 len: 1353 microversion: 2.1 time: 0.100212 Oct 26 14:07:18.710618 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3743/7462] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:07:18 2022] GET /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54 => generated 1353 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:07:19.734017 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6ecdeb26-9b9a-41a0-9609-cffc98f88198 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:07:19.734777 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6ecdeb26-9b9a-41a0-9609-cffc98f88198 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 8c248f8a-7881-4caf-aa77-bf23f54d9b54] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:07:19.740963 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ecdeb26-9b9a-41a0-9609-cffc98f88198 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:19.741446 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ecdeb26-9b9a-41a0-9609-cffc98f88198 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:19.741906 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ecdeb26-9b9a-41a0-9609-cffc98f88198 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:19.742595 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ecdeb26-9b9a-41a0-9609-cffc98f88198 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:19.743046 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ecdeb26-9b9a-41a0-9609-cffc98f88198 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:19.743468 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ecdeb26-9b9a-41a0-9609-cffc98f88198 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:19.759675 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-6ecdeb26-9b9a-41a0-9609-cffc98f88198 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] HTTP exception thrown: Instance 8c248f8a-7881-4caf-aa77-bf23f54d9b54 could not be found. Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6ecdeb26-9b9a-41a0-9609-cffc98f88198 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Request method failure captured: Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54 HTTP/1.1 Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWT7tPtFRgi7F-xA3DOTONjqmwyYK-r4z3CdNtIVBTaSUxovOxevrmP_5W0m0T9KRIWRR8x2g3bzPpvguBMq4Nf8bEK1KKjbYSQ4D-50jyWGEpILkiLxDaEFba7B_5kvQ-VlKuP77ymAQVNU6T3ckQ7sU15A4khd16HDx_fJMS4Atuys Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 859b1ed863dc40c4bee23f3bf4899ea0 Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1286211498 Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/859b1ed863dc40c4bee23f3bf4899ea0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/859b1ed863dc40c4bee23f3bf4899ea0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_859b1ed863dc40c4bee23f3bf4899ea0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/859b1ed863dc40c4bee23f3bf4899ea0"}]}] Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-TestEncryptedCinderVolumes-1286211498 Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 859b1ed863dc40c4bee23f3bf4899ea0 Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1286211498 Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-TestEncryptedCinderVolumes-1286211498-project Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 878f13b9181742d982ab6c91a17204e2 Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-TestEncryptedCinderVolumes-1286211498-project Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 8c248f8a-7881-4caf-aa77-bf23f54d9b54 could not be found. Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '8c248f8a-7881-4caf-aa77-bf23f54d9b54'} Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c248f8a-7881-4caf-aa77-bf23f54d9b54 could not be found. Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c248f8a-7881-4caf-aa77-bf23f54d9b54 could not be found. Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:07:19.761296 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:07:19.765988 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:07:19.765988 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:07:19.765988 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:07:19.765988 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:07:19.765988 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 14:07:19.765988 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 14:07:19.765988 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c248f8a-7881-4caf-aa77-bf23f54d9b54 could not be found. Oct 26 14:07:19.765988 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:07:19.765988 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6ecdeb26-9b9a-41a0-9609-cffc98f88198 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Returning 404 to user: Instance 8c248f8a-7881-4caf-aa77-bf23f54d9b54 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 14:07:19.765988 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6ecdeb26-9b9a-41a0-9609-cffc98f88198 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54" status: 404 len: 111 microversion: 2.1 time: 0.033889 Oct 26 14:07:19.765988 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3720/7463] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:07:19 2022] GET /compute/v2.1/servers/8c248f8a-7881-4caf-aa77-bf23f54d9b54 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 14:07:19.772274 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-01ea587b-03ea-4a1d-9ce1-d89a2bfebffa tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '.version_select at 0x7f6731716790>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:07:19.792351 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-01ea587b-03ea-4a1d-9ce1-d89a2bfebffa tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1650846962" status: 202 len: 0 microversion: 2.1 time: 0.024604 Oct 26 14:07:19.792932 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3744/7464] 10.222.0.40 () {58 vars in 1278 bytes} [Wed Oct 26 14:07:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1650846962 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 14:07:19.810573 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-882fb630-73c8-4acc-9386-a1be6c766550 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Action: 'create', calling method: .version_select at 0x7f6731a07f70>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-777792056", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbiDlkhd8cpkownOJH/18hCmkkQdQUjRLLU4rYKnxgj37FVQuCl0okh7l7sFEGCSs97SFFtlbuce8hkLuqAAqdzSv4gH7M7CTWTWfkhski8ADT6o2eKZm4xxRq1MYKGMQ=="}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:07:19.826548 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-882fb630-73c8-4acc-9386-a1be6c766550 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Getting quotas for project 859b1ed863dc40c4bee23f3bf4899ea0. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 14:07:19.832390 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-882fb630-73c8-4acc-9386-a1be6c766550 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Getting quotas for user 878f13b9181742d982ab6c91a17204e2 and project 859b1ed863dc40c4bee23f3bf4899ea0. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 14:07:19.855608 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-882fb630-73c8-4acc-9386-a1be6c766550 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.049006 Oct 26 14:07:19.856217 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3721/7465] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 14:07:19 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:07:19.907134 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-455ca6e3-28fc-47e4-828e-b6afe942bc82 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-87833302", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-777792056", "networks": [{"uuid": "5d1a1f5c-155c-458d-a5a4-d08f1be6d5d8"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:07:19.960001 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-455ca6e3-28fc-47e4-828e-b6afe942bc82 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] validate_networks() for [('5d1a1f5c-155c-458d-a5a4-d08f1be6d5d8', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 14:07:20.369106 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-455ca6e3-28fc-47e4-828e-b6afe942bc82 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 14:07:20.369573 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-455ca6e3-28fc-47e4-828e-b6afe942bc82 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 14:07:20.370075 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-455ca6e3-28fc-47e4-828e-b6afe942bc82 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 14:07:20.370503 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-455ca6e3-28fc-47e4-828e-b6afe942bc82 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 14:07:20.370933 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-455ca6e3-28fc-47e4-828e-b6afe942bc82 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 14:07:20.379927 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-455ca6e3-28fc-47e4-828e-b6afe942bc82 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:20.380430 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-455ca6e3-28fc-47e4-828e-b6afe942bc82 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:20.380885 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-455ca6e3-28fc-47e4-828e-b6afe942bc82 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:20.381667 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-455ca6e3-28fc-47e4-828e-b6afe942bc82 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:20.382144 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-455ca6e3-28fc-47e4-828e-b6afe942bc82 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:20.382589 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-455ca6e3-28fc-47e4-828e-b6afe942bc82 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:20.399744 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-455ca6e3-28fc-47e4-828e-b6afe942bc82 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Getting quotas for project 859b1ed863dc40c4bee23f3bf4899ea0. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 14:07:20.404901 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-455ca6e3-28fc-47e4-828e-b6afe942bc82 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Getting quotas for user 878f13b9181742d982ab6c91a17204e2 and project 859b1ed863dc40c4bee23f3bf4899ea0. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 14:07:20.418196 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-455ca6e3-28fc-47e4-828e-b6afe942bc82 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 14:07:20.420533 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-455ca6e3-28fc-47e4-828e-b6afe942bc82 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 956441cb-bdae-4e60-ac01-456b6b9e2ac7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 14:07:20.468168 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-455ca6e3-28fc-47e4-828e-b6afe942bc82 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.564885 Oct 26 14:07:20.468836 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3745/7466] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 14:07:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 14:07:20.480065 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7776666c-a28f-49b7-a9a3-a48de3d72044 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:07:20.480679 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7776666c-a28f-49b7-a9a3-a48de3d72044 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 956441cb-bdae-4e60-ac01-456b6b9e2ac7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:07:20.536720 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7776666c-a28f-49b7-a9a3-a48de3d72044 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f13b9181742d982ab6c91a17204e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b1ed863dc40c4bee23f3bf4899ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:07:20.544810 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7776666c-a28f-49b7-a9a3-a48de3d72044 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7" status: 200 len: 1260 microversion: 2.1 time: 0.068663 Oct 26 14:07:20.545402 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3722/7467] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:07:20 2022] GET /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7 => generated 1260 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:07:21.570004 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2dfa8836-238d-41af-bb72-2f2a56a2b6b0 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:07:21.571620 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2dfa8836-238d-41af-bb72-2f2a56a2b6b0 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 956441cb-bdae-4e60-ac01-456b6b9e2ac7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:07:21.578464 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2dfa8836-238d-41af-bb72-2f2a56a2b6b0 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:21.578963 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2dfa8836-238d-41af-bb72-2f2a56a2b6b0 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:21.579409 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2dfa8836-238d-41af-bb72-2f2a56a2b6b0 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:21.581250 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2dfa8836-238d-41af-bb72-2f2a56a2b6b0 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:21.581759 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2dfa8836-238d-41af-bb72-2f2a56a2b6b0 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:21.582199 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2dfa8836-238d-41af-bb72-2f2a56a2b6b0 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:21.686774 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2dfa8836-238d-41af-bb72-2f2a56a2b6b0 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f13b9181742d982ab6c91a17204e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b1ed863dc40c4bee23f3bf4899ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:07:21.696306 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2dfa8836-238d-41af-bb72-2f2a56a2b6b0 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7" status: 200 len: 1320 microversion: 2.1 time: 0.132549 Oct 26 14:07:21.696891 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3746/7468] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:07:21 2022] GET /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7 => generated 1320 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:07:22.720957 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bd15ba1d-b830-4b3d-8306-2a2e728e2b39 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:07:22.722814 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bd15ba1d-b830-4b3d-8306-2a2e728e2b39 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 956441cb-bdae-4e60-ac01-456b6b9e2ac7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:07:22.729714 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd15ba1d-b830-4b3d-8306-2a2e728e2b39 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:22.730254 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd15ba1d-b830-4b3d-8306-2a2e728e2b39 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:22.730735 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd15ba1d-b830-4b3d-8306-2a2e728e2b39 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:22.731479 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd15ba1d-b830-4b3d-8306-2a2e728e2b39 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:22.731930 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd15ba1d-b830-4b3d-8306-2a2e728e2b39 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:22.732352 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd15ba1d-b830-4b3d-8306-2a2e728e2b39 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:22.867999 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bd15ba1d-b830-4b3d-8306-2a2e728e2b39 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f13b9181742d982ab6c91a17204e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b1ed863dc40c4bee23f3bf4899ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:07:22.879120 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bd15ba1d-b830-4b3d-8306-2a2e728e2b39 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7" status: 200 len: 1360 microversion: 2.1 time: 0.162132 Oct 26 14:07:22.879730 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3723/7469] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:07:22 2022] GET /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7 => generated 1360 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:07:23.025798 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-3beb3f3c-0dd5-4bb1-bb0f-ae41781faffc req-502cb065-da77-44ae-a727-57f9df5045e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "956441cb-bdae-4e60-ac01-456b6b9e2ac7", "tag": "9706ae47-0625-4785-a1f0-e1123fc6d9fe"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:07:23.037625 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-3beb3f3c-0dd5-4bb1-bb0f-ae41781faffc req-502cb065-da77-44ae-a727-57f9df5045e2 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:23.038229 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-3beb3f3c-0dd5-4bb1-bb0f-ae41781faffc req-502cb065-da77-44ae-a727-57f9df5045e2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:23.038759 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-3beb3f3c-0dd5-4bb1-bb0f-ae41781faffc req-502cb065-da77-44ae-a727-57f9df5045e2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:23.054516 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-3beb3f3c-0dd5-4bb1-bb0f-ae41781faffc req-502cb065-da77-44ae-a727-57f9df5045e2 service nova] Creating event network-changed:9706ae47-0625-4785-a1f0-e1123fc6d9fe for instance 956441cb-bdae-4e60-ac01-456b6b9e2ac7 on n-h2-862686-1 Oct 26 14:07:23.059751 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-3beb3f3c-0dd5-4bb1-bb0f-ae41781faffc req-502cb065-da77-44ae-a727-57f9df5045e2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038989 Oct 26 14:07:23.060717 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3747/7470] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:07:23.902619 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a8890ebd-65c1-4d0d-9974-a54cef0a39d8 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:07:23.903236 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a8890ebd-65c1-4d0d-9974-a54cef0a39d8 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 956441cb-bdae-4e60-ac01-456b6b9e2ac7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:07:23.910450 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8890ebd-65c1-4d0d-9974-a54cef0a39d8 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:23.910939 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8890ebd-65c1-4d0d-9974-a54cef0a39d8 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:23.911395 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8890ebd-65c1-4d0d-9974-a54cef0a39d8 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:23.912073 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8890ebd-65c1-4d0d-9974-a54cef0a39d8 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:23.912545 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8890ebd-65c1-4d0d-9974-a54cef0a39d8 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:23.912962 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a8890ebd-65c1-4d0d-9974-a54cef0a39d8 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:24.046006 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a8890ebd-65c1-4d0d-9974-a54cef0a39d8 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f13b9181742d982ab6c91a17204e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b1ed863dc40c4bee23f3bf4899ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:07:24.054159 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a8890ebd-65c1-4d0d-9974-a54cef0a39d8 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7" status: 200 len: 1360 microversion: 2.1 time: 0.155453 Oct 26 14:07:24.054743 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3724/7471] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:07:23 2022] GET /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7 => generated 1360 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:07:25.080452 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-34b9fc8d-d7d4-482a-a664-007b76709b35 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:07:25.081284 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-34b9fc8d-d7d4-482a-a664-007b76709b35 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 956441cb-bdae-4e60-ac01-456b6b9e2ac7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:07:25.087605 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-34b9fc8d-d7d4-482a-a664-007b76709b35 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:25.088105 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-34b9fc8d-d7d4-482a-a664-007b76709b35 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:25.088554 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-34b9fc8d-d7d4-482a-a664-007b76709b35 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:25.089288 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-34b9fc8d-d7d4-482a-a664-007b76709b35 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:25.089808 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-34b9fc8d-d7d4-482a-a664-007b76709b35 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:25.090243 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-34b9fc8d-d7d4-482a-a664-007b76709b35 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:25.225437 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-34b9fc8d-d7d4-482a-a664-007b76709b35 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f13b9181742d982ab6c91a17204e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b1ed863dc40c4bee23f3bf4899ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:07:25.234158 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-34b9fc8d-d7d4-482a-a664-007b76709b35 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7" status: 200 len: 1360 microversion: 2.1 time: 0.159412 Oct 26 14:07:25.234793 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3748/7472] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:07:25 2022] GET /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7 => generated 1360 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:07:26.257010 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-69b456de-ad28-444b-94de-d283e82d641d tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:07:26.257654 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-69b456de-ad28-444b-94de-d283e82d641d tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 956441cb-bdae-4e60-ac01-456b6b9e2ac7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:07:26.264620 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69b456de-ad28-444b-94de-d283e82d641d tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:26.265098 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69b456de-ad28-444b-94de-d283e82d641d tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:26.265558 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69b456de-ad28-444b-94de-d283e82d641d tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:26.266245 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69b456de-ad28-444b-94de-d283e82d641d tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:26.266697 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69b456de-ad28-444b-94de-d283e82d641d tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:26.267157 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69b456de-ad28-444b-94de-d283e82d641d tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:26.399247 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-69b456de-ad28-444b-94de-d283e82d641d tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f13b9181742d982ab6c91a17204e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b1ed863dc40c4bee23f3bf4899ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:07:26.407007 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-69b456de-ad28-444b-94de-d283e82d641d tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7" status: 200 len: 1360 microversion: 2.1 time: 0.154099 Oct 26 14:07:26.407578 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3725/7473] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:07:26 2022] GET /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7 => generated 1360 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:07:27.430630 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0e67fbfb-39e1-4f11-9868-805e4d4f55eb tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:07:27.431256 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0e67fbfb-39e1-4f11-9868-805e4d4f55eb tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 956441cb-bdae-4e60-ac01-456b6b9e2ac7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:07:27.438178 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0e67fbfb-39e1-4f11-9868-805e4d4f55eb tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:27.438671 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0e67fbfb-39e1-4f11-9868-805e4d4f55eb tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:27.439126 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0e67fbfb-39e1-4f11-9868-805e4d4f55eb tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:27.440312 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0e67fbfb-39e1-4f11-9868-805e4d4f55eb tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:27.440790 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0e67fbfb-39e1-4f11-9868-805e4d4f55eb tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:27.441406 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0e67fbfb-39e1-4f11-9868-805e4d4f55eb tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:27.577224 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0e67fbfb-39e1-4f11-9868-805e4d4f55eb tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f13b9181742d982ab6c91a17204e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b1ed863dc40c4bee23f3bf4899ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:07:27.585144 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0e67fbfb-39e1-4f11-9868-805e4d4f55eb tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7" status: 200 len: 1360 microversion: 2.1 time: 0.158468 Oct 26 14:07:27.585756 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3749/7474] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:07:27 2022] GET /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7 => generated 1360 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:07:28.211026 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-601952da-e628-4b24-bc0b-c675536b5261 req-f2e20a4f-9a11-4056-84b7-0ab6cad0e1e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "956441cb-bdae-4e60-ac01-456b6b9e2ac7", "name": "network-vif-plugged", "status": "completed", "tag": "9706ae47-0625-4785-a1f0-e1123fc6d9fe"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:07:28.220500 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-601952da-e628-4b24-bc0b-c675536b5261 req-f2e20a4f-9a11-4056-84b7-0ab6cad0e1e2 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:28.220978 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-601952da-e628-4b24-bc0b-c675536b5261 req-f2e20a4f-9a11-4056-84b7-0ab6cad0e1e2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:28.222649 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-601952da-e628-4b24-bc0b-c675536b5261 req-f2e20a4f-9a11-4056-84b7-0ab6cad0e1e2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:28.233589 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-601952da-e628-4b24-bc0b-c675536b5261 req-f2e20a4f-9a11-4056-84b7-0ab6cad0e1e2 service nova] Creating event network-vif-plugged:9706ae47-0625-4785-a1f0-e1123fc6d9fe for instance 956441cb-bdae-4e60-ac01-456b6b9e2ac7 on n-h2-862686-1 Oct 26 14:07:28.239186 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-601952da-e628-4b24-bc0b-c675536b5261 req-f2e20a4f-9a11-4056-84b7-0ab6cad0e1e2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088945 Oct 26 14:07:28.239804 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3726/7475] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:07:28.607145 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7d08d3d3-0bdf-427d-b02d-8a90dffdb610 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:07:28.607777 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7d08d3d3-0bdf-427d-b02d-8a90dffdb610 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 956441cb-bdae-4e60-ac01-456b6b9e2ac7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:07:28.614854 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7d08d3d3-0bdf-427d-b02d-8a90dffdb610 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:28.615331 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7d08d3d3-0bdf-427d-b02d-8a90dffdb610 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:28.615780 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7d08d3d3-0bdf-427d-b02d-8a90dffdb610 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:28.616485 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7d08d3d3-0bdf-427d-b02d-8a90dffdb610 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:28.616953 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7d08d3d3-0bdf-427d-b02d-8a90dffdb610 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:28.617395 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7d08d3d3-0bdf-427d-b02d-8a90dffdb610 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:28.751140 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7d08d3d3-0bdf-427d-b02d-8a90dffdb610 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f13b9181742d982ab6c91a17204e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b1ed863dc40c4bee23f3bf4899ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:07:28.759873 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7d08d3d3-0bdf-427d-b02d-8a90dffdb610 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7" status: 200 len: 1360 microversion: 2.1 time: 0.156731 Oct 26 14:07:28.760448 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3750/7476] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:07:28 2022] GET /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7 => generated 1360 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:07:29.786310 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-38af6e91-0946-4829-9687-5cae956db6fd tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:07:29.787004 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-38af6e91-0946-4829-9687-5cae956db6fd tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 956441cb-bdae-4e60-ac01-456b6b9e2ac7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:07:29.793230 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38af6e91-0946-4829-9687-5cae956db6fd tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:29.793815 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38af6e91-0946-4829-9687-5cae956db6fd tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:29.794255 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38af6e91-0946-4829-9687-5cae956db6fd tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:29.794956 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38af6e91-0946-4829-9687-5cae956db6fd tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:29.795401 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38af6e91-0946-4829-9687-5cae956db6fd tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:29.795838 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38af6e91-0946-4829-9687-5cae956db6fd tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:29.933394 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-38af6e91-0946-4829-9687-5cae956db6fd tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f13b9181742d982ab6c91a17204e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b1ed863dc40c4bee23f3bf4899ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:07:29.941699 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-38af6e91-0946-4829-9687-5cae956db6fd tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7" status: 200 len: 1552 microversion: 2.1 time: 0.161557 Oct 26 14:07:29.942370 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3727/7477] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:07:29 2022] GET /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7 => generated 1552 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:07:29.965399 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-dbf3de71-5709-4497-9650-6170c113e343 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:07:29.966055 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-dbf3de71-5709-4497-9650-6170c113e343 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 956441cb-bdae-4e60-ac01-456b6b9e2ac7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:07:29.973705 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dbf3de71-5709-4497-9650-6170c113e343 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:29.974210 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dbf3de71-5709-4497-9650-6170c113e343 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:29.974667 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dbf3de71-5709-4497-9650-6170c113e343 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:29.975437 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dbf3de71-5709-4497-9650-6170c113e343 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:29.975910 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dbf3de71-5709-4497-9650-6170c113e343 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:29.976379 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dbf3de71-5709-4497-9650-6170c113e343 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:30.121402 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-dbf3de71-5709-4497-9650-6170c113e343 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f13b9181742d982ab6c91a17204e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b1ed863dc40c4bee23f3bf4899ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:07:30.130322 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-dbf3de71-5709-4497-9650-6170c113e343 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7" status: 200 len: 1552 microversion: 2.1 time: 0.169002 Oct 26 14:07:30.130907 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3751/7478] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:07:29 2022] GET /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7 => generated 1552 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:07:31.655639 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-17484f42-13a6-4a4c-a73b-014aa0db5af2 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "00f008de-ee35-495e-9249-400f462a6455"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:07:31.658086 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-17484f42-13a6-4a4c-a73b-014aa0db5af2 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 956441cb-bdae-4e60-ac01-456b6b9e2ac7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:07:31.660663 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:07:31.666984 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17484f42-13a6-4a4c-a73b-014aa0db5af2 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:31.667473 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17484f42-13a6-4a4c-a73b-014aa0db5af2 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:31.667911 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17484f42-13a6-4a4c-a73b-014aa0db5af2 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:31.668608 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17484f42-13a6-4a4c-a73b-014aa0db5af2 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:31.669065 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17484f42-13a6-4a4c-a73b-014aa0db5af2 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:31.669508 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17484f42-13a6-4a4c-a73b-014aa0db5af2 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:31.934969 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-17484f42-13a6-4a4c-a73b-014aa0db5af2 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "POST /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283002 Oct 26 14:07:31.941913 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3728/7479] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Oct 26 14:07:31 2022] POST /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:07:42.650979 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-df1b6bae-9d2f-4c78-80d3-8f9803d2fe26 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:07:42.651520 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-df1b6bae-9d2f-4c78-80d3-8f9803d2fe26 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 956441cb-bdae-4e60-ac01-456b6b9e2ac7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:07:42.653566 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:07:42.654253 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:07:42.656152 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:07:42.656898 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:07:42.665013 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df1b6bae-9d2f-4c78-80d3-8f9803d2fe26 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:42.665539 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df1b6bae-9d2f-4c78-80d3-8f9803d2fe26 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:42.665998 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df1b6bae-9d2f-4c78-80d3-8f9803d2fe26 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:42.666712 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df1b6bae-9d2f-4c78-80d3-8f9803d2fe26 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:42.667190 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df1b6bae-9d2f-4c78-80d3-8f9803d2fe26 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:42.667634 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df1b6bae-9d2f-4c78-80d3-8f9803d2fe26 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:42.750829 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-df1b6bae-9d2f-4c78-80d3-8f9803d2fe26 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lazy-loading 'services' on Instance uuid 956441cb-bdae-4e60-ac01-456b6b9e2ac7 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 14:07:42.822104 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-df1b6bae-9d2f-4c78-80d3-8f9803d2fe26 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "DELETE /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7/os-volume_attachments/00f008de-ee35-495e-9249-400f462a6455" status: 202 len: 0 microversion: 2.1 time: 0.174891 Oct 26 14:07:42.822716 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3752/7480] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Oct 26 14:07:42 2022] DELETE /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7/os-volume_attachments/00f008de-ee35-495e-9249-400f462a6455 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 14:07:42.830140 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:07:42.831588 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:07:42.835922 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a46edde8-cca0-4537-b41e-ff58195f811b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:07:42.838289 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a46edde8-cca0-4537-b41e-ff58195f811b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 956441cb-bdae-4e60-ac01-456b6b9e2ac7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:07:42.847695 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a46edde8-cca0-4537-b41e-ff58195f811b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:42.848184 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a46edde8-cca0-4537-b41e-ff58195f811b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:42.849083 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a46edde8-cca0-4537-b41e-ff58195f811b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:42.850089 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a46edde8-cca0-4537-b41e-ff58195f811b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:42.850547 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a46edde8-cca0-4537-b41e-ff58195f811b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:42.850978 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a46edde8-cca0-4537-b41e-ff58195f811b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:42.886275 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a46edde8-cca0-4537-b41e-ff58195f811b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058917 Oct 26 14:07:42.887010 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3729/7481] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 14:07:42 2022] GET /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:07:43.901379 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5d0802db-15f1-4819-9b02-99b9be540df1 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:07:43.904019 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5d0802db-15f1-4819-9b02-99b9be540df1 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 956441cb-bdae-4e60-ac01-456b6b9e2ac7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:07:43.910765 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5d0802db-15f1-4819-9b02-99b9be540df1 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:43.911265 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5d0802db-15f1-4819-9b02-99b9be540df1 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:43.911718 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5d0802db-15f1-4819-9b02-99b9be540df1 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:43.912653 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5d0802db-15f1-4819-9b02-99b9be540df1 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:43.913129 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5d0802db-15f1-4819-9b02-99b9be540df1 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:43.913613 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5d0802db-15f1-4819-9b02-99b9be540df1 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:43.947459 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5d0802db-15f1-4819-9b02-99b9be540df1 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051332 Oct 26 14:07:43.948036 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3753/7482] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 14:07:43 2022] GET /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:07:44.960268 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4cc74bdc-f162-4305-bb69-3c596d273760 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:07:44.962709 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4cc74bdc-f162-4305-bb69-3c596d273760 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 956441cb-bdae-4e60-ac01-456b6b9e2ac7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:07:44.969901 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4cc74bdc-f162-4305-bb69-3c596d273760 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:44.970394 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4cc74bdc-f162-4305-bb69-3c596d273760 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:44.971420 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4cc74bdc-f162-4305-bb69-3c596d273760 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:44.972201 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4cc74bdc-f162-4305-bb69-3c596d273760 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:44.972780 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4cc74bdc-f162-4305-bb69-3c596d273760 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:44.973332 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4cc74bdc-f162-4305-bb69-3c596d273760 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:45.004380 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4cc74bdc-f162-4305-bb69-3c596d273760 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048894 Oct 26 14:07:45.005174 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3730/7483] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 14:07:44 2022] GET /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:07:46.016406 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d0a8949f-9788-44b3-9be8-c8da068e3fb3 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:07:46.019686 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d0a8949f-9788-44b3-9be8-c8da068e3fb3 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 956441cb-bdae-4e60-ac01-456b6b9e2ac7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:07:46.026903 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0a8949f-9788-44b3-9be8-c8da068e3fb3 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:46.027599 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0a8949f-9788-44b3-9be8-c8da068e3fb3 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:46.028068 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0a8949f-9788-44b3-9be8-c8da068e3fb3 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:46.028818 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0a8949f-9788-44b3-9be8-c8da068e3fb3 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:46.029297 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0a8949f-9788-44b3-9be8-c8da068e3fb3 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:46.029771 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d0a8949f-9788-44b3-9be8-c8da068e3fb3 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:46.062962 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d0a8949f-9788-44b3-9be8-c8da068e3fb3 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050508 Oct 26 14:07:46.063830 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3754/7484] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 14:07:46 2022] GET /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:07:47.076166 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bb1cd211-f0e5-4705-b9f1-846f159ecaeb tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:07:47.078447 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bb1cd211-f0e5-4705-b9f1-846f159ecaeb tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 956441cb-bdae-4e60-ac01-456b6b9e2ac7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:07:47.085514 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb1cd211-f0e5-4705-b9f1-846f159ecaeb tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:47.086004 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb1cd211-f0e5-4705-b9f1-846f159ecaeb tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:47.086451 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb1cd211-f0e5-4705-b9f1-846f159ecaeb tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:47.087402 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb1cd211-f0e5-4705-b9f1-846f159ecaeb tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:47.087985 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb1cd211-f0e5-4705-b9f1-846f159ecaeb tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:47.088109 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb1cd211-f0e5-4705-b9f1-846f159ecaeb tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:47.119203 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bb1cd211-f0e5-4705-b9f1-846f159ecaeb tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047104 Oct 26 14:07:47.119781 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3731/7485] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 14:07:47 2022] GET /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:07:48.132476 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-939a530f-92d5-49b4-8714-ef0c4d4306ec tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:07:48.134688 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-939a530f-92d5-49b4-8714-ef0c4d4306ec tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 956441cb-bdae-4e60-ac01-456b6b9e2ac7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:07:48.141746 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-939a530f-92d5-49b4-8714-ef0c4d4306ec tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:48.142247 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-939a530f-92d5-49b4-8714-ef0c4d4306ec tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:48.143391 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-939a530f-92d5-49b4-8714-ef0c4d4306ec tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:48.144105 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-939a530f-92d5-49b4-8714-ef0c4d4306ec tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:48.144579 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-939a530f-92d5-49b4-8714-ef0c4d4306ec tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:48.145024 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-939a530f-92d5-49b4-8714-ef0c4d4306ec tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:48.173620 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-939a530f-92d5-49b4-8714-ef0c4d4306ec tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045330 Oct 26 14:07:48.174318 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3755/7486] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 14:07:48 2022] GET /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 14:07:48.184900 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-452693d8-f184-44d7-9d12-ad3b5aab3659 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:07:48.185389 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-452693d8-f184-44d7-9d12-ad3b5aab3659 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 956441cb-bdae-4e60-ac01-456b6b9e2ac7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:07:48.193181 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-452693d8-f184-44d7-9d12-ad3b5aab3659 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:48.193684 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-452693d8-f184-44d7-9d12-ad3b5aab3659 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:48.194121 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-452693d8-f184-44d7-9d12-ad3b5aab3659 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:48.194804 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-452693d8-f184-44d7-9d12-ad3b5aab3659 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:48.195253 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-452693d8-f184-44d7-9d12-ad3b5aab3659 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:48.195675 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-452693d8-f184-44d7-9d12-ad3b5aab3659 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:48.272051 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-452693d8-f184-44d7-9d12-ad3b5aab3659 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] HTTP exception thrown: Instance 956441cb-bdae-4e60-ac01-456b6b9e2ac7 is not attached to volume 00f008de-ee35-495e-9249-400f462a6455 Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-452693d8-f184-44d7-9d12-ad3b5aab3659 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Request method failure captured: Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7/os-volume_attachments/00f008de-ee35-495e-9249-400f462a6455 HTTP/1.1 Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWT7tPtFRgi7F-xA3DOTONjqmwyYK-r4z3CdNtIVBTaSUxovOxevrmP_5W0m0T9KRIWRR8x2g3bzPpvguBMq4Nf8bEK1KKjbYSQ4D-50jyWGEpILkiLxDaEFba7B_5kvQ-VlKuP77ymAQVNU6T3ckQ7sU15A4khd16HDx_fJMS4Atuys Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 859b1ed863dc40c4bee23f3bf4899ea0 Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1286211498 Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/859b1ed863dc40c4bee23f3bf4899ea0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/859b1ed863dc40c4bee23f3bf4899ea0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_859b1ed863dc40c4bee23f3bf4899ea0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/859b1ed863dc40c4bee23f3bf4899ea0"}]}] Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-TestEncryptedCinderVolumes-1286211498 Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 859b1ed863dc40c4bee23f3bf4899ea0 Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1286211498 Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-TestEncryptedCinderVolumes-1286211498-project Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 878f13b9181742d982ab6c91a17204e2 Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-TestEncryptedCinderVolumes-1286211498-project Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 956441cb-bdae-4e60-ac01-456b6b9e2ac7 is not attached to volume 00f008de-ee35-495e-9249-400f462a6455 Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'server_id': '956441cb-bdae-4e60-ac01-456b6b9e2ac7', 'id': '00f008de-ee35-495e-9249-400f462a6455'} Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 00f008de-ee35-495e-9249-400f462a6455. Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 956441cb-bdae-4e60-ac01-456b6b9e2ac7 is not attached to volume 00f008de-ee35-495e-9249-400f462a6455 Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:07:48.273689 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:07:48.278704 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 14:07:48.278704 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 14:07:48.278704 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 956441cb-bdae-4e60-ac01-456b6b9e2ac7 is not attached to volume 00f008de-ee35-495e-9249-400f462a6455 Oct 26 14:07:48.278704 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:07:48.278704 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-452693d8-f184-44d7-9d12-ad3b5aab3659 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Returning 404 to user: Instance 956441cb-bdae-4e60-ac01-456b6b9e2ac7 is not attached to volume 00f008de-ee35-495e-9249-400f462a6455 {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 14:07:48.278704 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-452693d8-f184-44d7-9d12-ad3b5aab3659 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "DELETE /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7/os-volume_attachments/00f008de-ee35-495e-9249-400f462a6455" status: 404 len: 154 microversion: 2.1 time: 0.094241 Oct 26 14:07:48.278704 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3732/7487] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Oct 26 14:07:48 2022] DELETE /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7/os-volume_attachments/00f008de-ee35-495e-9249-400f462a6455 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 14:07:51.624967 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a6d0d8d1-c80e-497d-aae4-8ca76f1832b0 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:07:51.625507 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a6d0d8d1-c80e-497d-aae4-8ca76f1832b0 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 956441cb-bdae-4e60-ac01-456b6b9e2ac7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:07:51.632376 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a6d0d8d1-c80e-497d-aae4-8ca76f1832b0 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:51.632891 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a6d0d8d1-c80e-497d-aae4-8ca76f1832b0 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:51.633356 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a6d0d8d1-c80e-497d-aae4-8ca76f1832b0 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:51.634124 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a6d0d8d1-c80e-497d-aae4-8ca76f1832b0 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:51.634602 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a6d0d8d1-c80e-497d-aae4-8ca76f1832b0 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:51.635052 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a6d0d8d1-c80e-497d-aae4-8ca76f1832b0 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:51.662849 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a6d0d8d1-c80e-497d-aae4-8ca76f1832b0 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 956441cb-bdae-4e60-ac01-456b6b9e2ac7] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 14:07:51.740841 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a6d0d8d1-c80e-497d-aae4-8ca76f1832b0 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "DELETE /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7" status: 204 len: 0 microversion: 2.1 time: 0.119477 Oct 26 14:07:51.745568 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3756/7488] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 14:07:51 2022] DELETE /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 14:07:51.751340 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5369f2ec-bf97-4bb9-b507-5d372dc3efb3 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:07:51.752269 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5369f2ec-bf97-4bb9-b507-5d372dc3efb3 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 956441cb-bdae-4e60-ac01-456b6b9e2ac7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:07:51.761169 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5369f2ec-bf97-4bb9-b507-5d372dc3efb3 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:51.761990 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5369f2ec-bf97-4bb9-b507-5d372dc3efb3 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:51.762542 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5369f2ec-bf97-4bb9-b507-5d372dc3efb3 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:51.763548 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5369f2ec-bf97-4bb9-b507-5d372dc3efb3 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:51.764116 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5369f2ec-bf97-4bb9-b507-5d372dc3efb3 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:51.764673 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5369f2ec-bf97-4bb9-b507-5d372dc3efb3 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:51.902207 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5369f2ec-bf97-4bb9-b507-5d372dc3efb3 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f13b9181742d982ab6c91a17204e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b1ed863dc40c4bee23f3bf4899ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:07:51.910649 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5369f2ec-bf97-4bb9-b507-5d372dc3efb3 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7" status: 200 len: 1558 microversion: 2.1 time: 0.163343 Oct 26 14:07:51.911798 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3733/7489] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:07:51 2022] GET /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7 => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 14:07:52.934969 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c12b61b2-8ee7-45ca-9689-c547ecb22b1e tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:07:52.935712 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c12b61b2-8ee7-45ca-9689-c547ecb22b1e tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 956441cb-bdae-4e60-ac01-456b6b9e2ac7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:07:52.942774 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c12b61b2-8ee7-45ca-9689-c547ecb22b1e tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:52.943265 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c12b61b2-8ee7-45ca-9689-c547ecb22b1e tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:52.943716 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c12b61b2-8ee7-45ca-9689-c547ecb22b1e tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:52.944411 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c12b61b2-8ee7-45ca-9689-c547ecb22b1e tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:52.944876 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c12b61b2-8ee7-45ca-9689-c547ecb22b1e tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:52.945313 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c12b61b2-8ee7-45ca-9689-c547ecb22b1e tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:53.075841 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c12b61b2-8ee7-45ca-9689-c547ecb22b1e tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f13b9181742d982ab6c91a17204e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b1ed863dc40c4bee23f3bf4899ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:07:53.084124 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c12b61b2-8ee7-45ca-9689-c547ecb22b1e tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7" status: 200 len: 1558 microversion: 2.1 time: 0.153449 Oct 26 14:07:53.084700 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3757/7490] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:07:52 2022] GET /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:07:53.925343 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-b53c95cf-ef03-491b-a353-eae391db4a82 req-5b978c24-cf63-4c96-aa8f-8bde9d830cc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "956441cb-bdae-4e60-ac01-456b6b9e2ac7", "name": "network-vif-deleted", "tag": "9706ae47-0625-4785-a1f0-e1123fc6d9fe"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:07:53.937288 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-b53c95cf-ef03-491b-a353-eae391db4a82 req-5b978c24-cf63-4c96-aa8f-8bde9d830cc9 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:53.937818 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-b53c95cf-ef03-491b-a353-eae391db4a82 req-5b978c24-cf63-4c96-aa8f-8bde9d830cc9 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:53.938255 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-b53c95cf-ef03-491b-a353-eae391db4a82 req-5b978c24-cf63-4c96-aa8f-8bde9d830cc9 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:53.953983 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-b53c95cf-ef03-491b-a353-eae391db4a82 req-5b978c24-cf63-4c96-aa8f-8bde9d830cc9 service nova] Creating event network-vif-deleted:9706ae47-0625-4785-a1f0-e1123fc6d9fe for instance 956441cb-bdae-4e60-ac01-456b6b9e2ac7 on n-h2-862686-1 Oct 26 14:07:53.960018 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-b53c95cf-ef03-491b-a353-eae391db4a82 req-5b978c24-cf63-4c96-aa8f-8bde9d830cc9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039794 Oct 26 14:07:53.960823 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3734/7491] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:07:54.107829 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2402fbf2-4427-47a8-884b-1054d30a080a tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:07:54.108509 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2402fbf2-4427-47a8-884b-1054d30a080a tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 956441cb-bdae-4e60-ac01-456b6b9e2ac7] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:07:54.115860 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2402fbf2-4427-47a8-884b-1054d30a080a tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:54.116353 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2402fbf2-4427-47a8-884b-1054d30a080a tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:54.116813 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2402fbf2-4427-47a8-884b-1054d30a080a tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:54.117548 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2402fbf2-4427-47a8-884b-1054d30a080a tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:54.118021 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2402fbf2-4427-47a8-884b-1054d30a080a tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:54.118465 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2402fbf2-4427-47a8-884b-1054d30a080a tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:54.150690 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2402fbf2-4427-47a8-884b-1054d30a080a tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:54.151115 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2402fbf2-4427-47a8-884b-1054d30a080a tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:54.151569 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2402fbf2-4427-47a8-884b-1054d30a080a tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:54.152029 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-2402fbf2-4427-47a8-884b-1054d30a080a tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lazy-loading 'fault' on Instance uuid 956441cb-bdae-4e60-ac01-456b6b9e2ac7 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 14:07:54.193220 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2402fbf2-4427-47a8-884b-1054d30a080a tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f13b9181742d982ab6c91a17204e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b1ed863dc40c4bee23f3bf4899ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:07:54.200931 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2402fbf2-4427-47a8-884b-1054d30a080a tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7" status: 200 len: 1350 microversion: 2.1 time: 0.097100 Oct 26 14:07:54.201517 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3758/7492] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:07:54 2022] GET /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7 => generated 1350 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:07:55.226974 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-967a62a4-aa97-4770-bbb6-34f6534c7167 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:07:55.227599 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-967a62a4-aa97-4770-bbb6-34f6534c7167 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 956441cb-bdae-4e60-ac01-456b6b9e2ac7] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:07:55.233851 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-967a62a4-aa97-4770-bbb6-34f6534c7167 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:55.234343 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-967a62a4-aa97-4770-bbb6-34f6534c7167 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:55.234789 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-967a62a4-aa97-4770-bbb6-34f6534c7167 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:55.235487 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-967a62a4-aa97-4770-bbb6-34f6534c7167 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:55.235948 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-967a62a4-aa97-4770-bbb6-34f6534c7167 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:55.237040 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-967a62a4-aa97-4770-bbb6-34f6534c7167 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:55.250365 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-967a62a4-aa97-4770-bbb6-34f6534c7167 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] HTTP exception thrown: Instance 956441cb-bdae-4e60-ac01-456b6b9e2ac7 could not be found. Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-967a62a4-aa97-4770-bbb6-34f6534c7167 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Request method failure captured: Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7 HTTP/1.1 Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWT7tPtFRgi7F-xA3DOTONjqmwyYK-r4z3CdNtIVBTaSUxovOxevrmP_5W0m0T9KRIWRR8x2g3bzPpvguBMq4Nf8bEK1KKjbYSQ4D-50jyWGEpILkiLxDaEFba7B_5kvQ-VlKuP77ymAQVNU6T3ckQ7sU15A4khd16HDx_fJMS4Atuys Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 859b1ed863dc40c4bee23f3bf4899ea0 Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1286211498 Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/859b1ed863dc40c4bee23f3bf4899ea0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/859b1ed863dc40c4bee23f3bf4899ea0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_859b1ed863dc40c4bee23f3bf4899ea0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/859b1ed863dc40c4bee23f3bf4899ea0"}]}] Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-TestEncryptedCinderVolumes-1286211498 Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 859b1ed863dc40c4bee23f3bf4899ea0 Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1286211498 Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-TestEncryptedCinderVolumes-1286211498-project Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 878f13b9181742d982ab6c91a17204e2 Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-TestEncryptedCinderVolumes-1286211498-project Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 956441cb-bdae-4e60-ac01-456b6b9e2ac7 could not be found. Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '956441cb-bdae-4e60-ac01-456b6b9e2ac7'} Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 956441cb-bdae-4e60-ac01-456b6b9e2ac7 could not be found. Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 956441cb-bdae-4e60-ac01-456b6b9e2ac7 could not be found. Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:07:55.252059 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:07:55.257213 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:07:55.257213 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:07:55.257213 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:07:55.257213 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:07:55.257213 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 14:07:55.257213 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 14:07:55.257213 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 956441cb-bdae-4e60-ac01-456b6b9e2ac7 could not be found. Oct 26 14:07:55.257213 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:07:55.257213 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-967a62a4-aa97-4770-bbb6-34f6534c7167 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Returning 404 to user: Instance 956441cb-bdae-4e60-ac01-456b6b9e2ac7 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 14:07:55.257213 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-967a62a4-aa97-4770-bbb6-34f6534c7167 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7" status: 404 len: 111 microversion: 2.1 time: 0.032513 Oct 26 14:07:55.257213 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3735/7493] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:07:55 2022] GET /compute/v2.1/servers/956441cb-bdae-4e60-ac01-456b6b9e2ac7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 14:07:55.262243 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-36ffab6a-4a12-4304-889f-797fcdf9ca1a tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '.version_select at 0x7f6732b9a670>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:07:55.282118 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-36ffab6a-4a12-4304-889f-797fcdf9ca1a tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-777792056" status: 202 len: 0 microversion: 2.1 time: 0.023700 Oct 26 14:07:55.282735 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3759/7494] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 26 14:07:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-777792056 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 14:07:55.298666 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-87754584-9630-4db0-b00d-49c85d184c13 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Action: 'create', calling method: .version_select at 0x7f673143d5e0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-2015981819", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCx1sklfpoP+qMfBEhPBgzoX11eyvd4IRwM+ZmhOZ/s797ske1Dvg1801YcLJZdEcRczy+SWCpdRJMj44jFqOYyYvvF1CNgPYOYdnvyfTP98TO2IcVymk32UEvL4dJR+gA=="}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:07:55.314864 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-87754584-9630-4db0-b00d-49c85d184c13 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Getting quotas for project 859b1ed863dc40c4bee23f3bf4899ea0. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 14:07:55.320141 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-87754584-9630-4db0-b00d-49c85d184c13 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Getting quotas for user 878f13b9181742d982ab6c91a17204e2 and project 859b1ed863dc40c4bee23f3bf4899ea0. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 14:07:55.343668 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-87754584-9630-4db0-b00d-49c85d184c13 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.049303 Oct 26 14:07:55.344275 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3736/7495] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 14:07:55 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:07:55.394272 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f4eb5094-7fe0-4184-a7ec-e8132051097b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1975603620", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-2015981819", "networks": [{"uuid": "5d1a1f5c-155c-458d-a5a4-d08f1be6d5d8"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:07:55.446419 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-f4eb5094-7fe0-4184-a7ec-e8132051097b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] validate_networks() for [('5d1a1f5c-155c-458d-a5a4-d08f1be6d5d8', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 14:07:55.825364 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-f4eb5094-7fe0-4184-a7ec-e8132051097b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 14:07:55.825829 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-f4eb5094-7fe0-4184-a7ec-e8132051097b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 14:07:55.826324 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-f4eb5094-7fe0-4184-a7ec-e8132051097b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 14:07:55.826749 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-f4eb5094-7fe0-4184-a7ec-e8132051097b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 14:07:55.827176 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-f4eb5094-7fe0-4184-a7ec-e8132051097b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 14:07:55.836999 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4eb5094-7fe0-4184-a7ec-e8132051097b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:55.837520 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4eb5094-7fe0-4184-a7ec-e8132051097b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:55.837980 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4eb5094-7fe0-4184-a7ec-e8132051097b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:55.838725 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4eb5094-7fe0-4184-a7ec-e8132051097b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:55.839206 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4eb5094-7fe0-4184-a7ec-e8132051097b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:55.839652 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4eb5094-7fe0-4184-a7ec-e8132051097b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:55.856773 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-f4eb5094-7fe0-4184-a7ec-e8132051097b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Getting quotas for project 859b1ed863dc40c4bee23f3bf4899ea0. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 14:07:55.862118 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-f4eb5094-7fe0-4184-a7ec-e8132051097b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Getting quotas for user 878f13b9181742d982ab6c91a17204e2 and project 859b1ed863dc40c4bee23f3bf4899ea0. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 14:07:55.874644 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f4eb5094-7fe0-4184-a7ec-e8132051097b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 14:07:55.877621 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f4eb5094-7fe0-4184-a7ec-e8132051097b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 46713af5-7f55-4cab-8ead-91bbdc70dba0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 14:07:55.924317 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f4eb5094-7fe0-4184-a7ec-e8132051097b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.534638 Oct 26 14:07:55.924978 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3760/7496] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 14:07:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 14:07:55.936123 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-985ef1b4-1701-4f30-8dba-f8a4d6a302c3 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:07:55.936773 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-985ef1b4-1701-4f30-8dba-f8a4d6a302c3 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 46713af5-7f55-4cab-8ead-91bbdc70dba0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:07:55.996270 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-985ef1b4-1701-4f30-8dba-f8a4d6a302c3 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f13b9181742d982ab6c91a17204e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b1ed863dc40c4bee23f3bf4899ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:07:56.006609 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-985ef1b4-1701-4f30-8dba-f8a4d6a302c3 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0" status: 200 len: 1263 microversion: 2.1 time: 0.074288 Oct 26 14:07:56.007253 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3737/7497] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:07:55 2022] GET /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0 => generated 1263 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:07:57.030099 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-eb362f36-f092-45aa-aa09-4c4c4783b9e8 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:07:57.031520 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-eb362f36-f092-45aa-aa09-4c4c4783b9e8 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 46713af5-7f55-4cab-8ead-91bbdc70dba0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:07:57.040909 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb362f36-f092-45aa-aa09-4c4c4783b9e8 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:57.041838 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb362f36-f092-45aa-aa09-4c4c4783b9e8 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:57.042518 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb362f36-f092-45aa-aa09-4c4c4783b9e8 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:57.043641 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb362f36-f092-45aa-aa09-4c4c4783b9e8 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:57.044386 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb362f36-f092-45aa-aa09-4c4c4783b9e8 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:57.045099 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb362f36-f092-45aa-aa09-4c4c4783b9e8 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:57.135670 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-eb362f36-f092-45aa-aa09-4c4c4783b9e8 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f13b9181742d982ab6c91a17204e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b1ed863dc40c4bee23f3bf4899ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:07:57.144440 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-eb362f36-f092-45aa-aa09-4c4c4783b9e8 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0" status: 200 len: 1333 microversion: 2.1 time: 0.117156 Oct 26 14:07:57.144752 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3761/7498] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:07:57 2022] GET /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0 => generated 1333 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:07:58.167996 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-489ca029-ce01-424f-b35e-e0d664c221a4 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:07:58.174439 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-489ca029-ce01-424f-b35e-e0d664c221a4 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 46713af5-7f55-4cab-8ead-91bbdc70dba0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:07:58.181654 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-489ca029-ce01-424f-b35e-e0d664c221a4 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:58.182224 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-489ca029-ce01-424f-b35e-e0d664c221a4 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:58.182755 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-489ca029-ce01-424f-b35e-e0d664c221a4 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:58.183575 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-489ca029-ce01-424f-b35e-e0d664c221a4 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:58.184119 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-489ca029-ce01-424f-b35e-e0d664c221a4 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:58.184604 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-489ca029-ce01-424f-b35e-e0d664c221a4 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:58.322499 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-489ca029-ce01-424f-b35e-e0d664c221a4 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f13b9181742d982ab6c91a17204e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b1ed863dc40c4bee23f3bf4899ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:07:58.330332 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-489ca029-ce01-424f-b35e-e0d664c221a4 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0" status: 200 len: 1363 microversion: 2.1 time: 0.166280 Oct 26 14:07:58.331077 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3738/7499] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:07:58 2022] GET /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:07:58.394473 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-fcc119cc-3c2e-4ed8-a3c7-97c05769eabc req-c0e31180-bfc8-4fa9-a4d9-e13e2844a1ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46713af5-7f55-4cab-8ead-91bbdc70dba0", "tag": "ec4e1eb6-ebca-4b0b-8b50-a4390ad7f9f1"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:07:58.407250 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-fcc119cc-3c2e-4ed8-a3c7-97c05769eabc req-c0e31180-bfc8-4fa9-a4d9-e13e2844a1ef service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:58.407846 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-fcc119cc-3c2e-4ed8-a3c7-97c05769eabc req-c0e31180-bfc8-4fa9-a4d9-e13e2844a1ef service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:58.408298 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-fcc119cc-3c2e-4ed8-a3c7-97c05769eabc req-c0e31180-bfc8-4fa9-a4d9-e13e2844a1ef service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:58.421113 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-fcc119cc-3c2e-4ed8-a3c7-97c05769eabc req-c0e31180-bfc8-4fa9-a4d9-e13e2844a1ef service nova] Creating event network-changed:ec4e1eb6-ebca-4b0b-8b50-a4390ad7f9f1 for instance 46713af5-7f55-4cab-8ead-91bbdc70dba0 on n-h2-862686-1 Oct 26 14:07:58.426875 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-fcc119cc-3c2e-4ed8-a3c7-97c05769eabc req-c0e31180-bfc8-4fa9-a4d9-e13e2844a1ef service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036748 Oct 26 14:07:58.427888 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3762/7500] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:07:59.354160 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-da08b0e8-f6d8-46fa-bcc6-d49c6016d586 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:07:59.354772 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-da08b0e8-f6d8-46fa-bcc6-d49c6016d586 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 46713af5-7f55-4cab-8ead-91bbdc70dba0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:07:59.361642 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-da08b0e8-f6d8-46fa-bcc6-d49c6016d586 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:59.362400 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-da08b0e8-f6d8-46fa-bcc6-d49c6016d586 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:59.362692 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-da08b0e8-f6d8-46fa-bcc6-d49c6016d586 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:59.363385 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-da08b0e8-f6d8-46fa-bcc6-d49c6016d586 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:07:59.363846 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-da08b0e8-f6d8-46fa-bcc6-d49c6016d586 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:07:59.364278 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-da08b0e8-f6d8-46fa-bcc6-d49c6016d586 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:07:59.490675 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-da08b0e8-f6d8-46fa-bcc6-d49c6016d586 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f13b9181742d982ab6c91a17204e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b1ed863dc40c4bee23f3bf4899ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:07:59.498302 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-da08b0e8-f6d8-46fa-bcc6-d49c6016d586 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0" status: 200 len: 1363 microversion: 2.1 time: 0.148095 Oct 26 14:07:59.498867 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3739/7501] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:07:59 2022] GET /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:08:00.522327 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-79193ff2-3448-4471-aec2-7a8da9a9441c tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:08:00.523096 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-79193ff2-3448-4471-aec2-7a8da9a9441c tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 46713af5-7f55-4cab-8ead-91bbdc70dba0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:08:00.529271 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-79193ff2-3448-4471-aec2-7a8da9a9441c tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:08:00.529810 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-79193ff2-3448-4471-aec2-7a8da9a9441c tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:08:00.530325 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-79193ff2-3448-4471-aec2-7a8da9a9441c tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:08:00.531052 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-79193ff2-3448-4471-aec2-7a8da9a9441c tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:08:00.531526 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-79193ff2-3448-4471-aec2-7a8da9a9441c tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:08:00.531980 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-79193ff2-3448-4471-aec2-7a8da9a9441c tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:08:00.734021 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-79193ff2-3448-4471-aec2-7a8da9a9441c tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f13b9181742d982ab6c91a17204e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b1ed863dc40c4bee23f3bf4899ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:08:00.745447 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-79193ff2-3448-4471-aec2-7a8da9a9441c tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0" status: 200 len: 1363 microversion: 2.1 time: 0.225824 Oct 26 14:08:00.750081 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3763/7502] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:08:00 2022] GET /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0 => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:08:01.770414 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8b86085a-a930-4b01-a5e5-66e72ed4e980 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:08:01.771024 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8b86085a-a930-4b01-a5e5-66e72ed4e980 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 46713af5-7f55-4cab-8ead-91bbdc70dba0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:08:01.777951 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8b86085a-a930-4b01-a5e5-66e72ed4e980 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:08:01.778439 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8b86085a-a930-4b01-a5e5-66e72ed4e980 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:08:01.778885 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8b86085a-a930-4b01-a5e5-66e72ed4e980 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:08:01.779580 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8b86085a-a930-4b01-a5e5-66e72ed4e980 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:08:01.780043 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8b86085a-a930-4b01-a5e5-66e72ed4e980 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:08:01.780474 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8b86085a-a930-4b01-a5e5-66e72ed4e980 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:08:01.909778 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8b86085a-a930-4b01-a5e5-66e72ed4e980 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f13b9181742d982ab6c91a17204e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b1ed863dc40c4bee23f3bf4899ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:08:01.918415 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8b86085a-a930-4b01-a5e5-66e72ed4e980 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0" status: 200 len: 1363 microversion: 2.1 time: 0.152440 Oct 26 14:08:01.918984 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3740/7503] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:08:01 2022] GET /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 14:08:02.941031 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1dc2d860-d8c5-41a2-b5b6-fe2a91864adf tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:08:02.941961 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1dc2d860-d8c5-41a2-b5b6-fe2a91864adf tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 46713af5-7f55-4cab-8ead-91bbdc70dba0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:08:02.948754 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1dc2d860-d8c5-41a2-b5b6-fe2a91864adf tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:08:02.949244 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1dc2d860-d8c5-41a2-b5b6-fe2a91864adf tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:08:02.949713 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1dc2d860-d8c5-41a2-b5b6-fe2a91864adf tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:08:02.950413 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1dc2d860-d8c5-41a2-b5b6-fe2a91864adf tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:08:02.950877 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1dc2d860-d8c5-41a2-b5b6-fe2a91864adf tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:08:02.951314 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1dc2d860-d8c5-41a2-b5b6-fe2a91864adf tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:08:03.079434 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1dc2d860-d8c5-41a2-b5b6-fe2a91864adf tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f13b9181742d982ab6c91a17204e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b1ed863dc40c4bee23f3bf4899ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:08:03.087230 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1dc2d860-d8c5-41a2-b5b6-fe2a91864adf tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0" status: 200 len: 1363 microversion: 2.1 time: 0.150196 Oct 26 14:08:03.088018 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3764/7504] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:08:02 2022] GET /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:08:04.110453 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fc623427-e10e-4406-b99e-c91647283666 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:08:04.110965 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fc623427-e10e-4406-b99e-c91647283666 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 46713af5-7f55-4cab-8ead-91bbdc70dba0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:08:04.118479 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fc623427-e10e-4406-b99e-c91647283666 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:08:04.118959 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fc623427-e10e-4406-b99e-c91647283666 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:08:04.119395 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fc623427-e10e-4406-b99e-c91647283666 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:08:04.120080 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fc623427-e10e-4406-b99e-c91647283666 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:08:04.120534 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fc623427-e10e-4406-b99e-c91647283666 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:08:04.120952 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fc623427-e10e-4406-b99e-c91647283666 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:08:04.258223 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fc623427-e10e-4406-b99e-c91647283666 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f13b9181742d982ab6c91a17204e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b1ed863dc40c4bee23f3bf4899ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:08:04.265883 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fc623427-e10e-4406-b99e-c91647283666 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0" status: 200 len: 1363 microversion: 2.1 time: 0.159385 Oct 26 14:08:04.266451 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3741/7505] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:08:04 2022] GET /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:08:04.293144 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-22366d4f-7685-42cd-9ba4-022f2b230f3b req-004c5618-f171-4219-aff4-b49e548fd123 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46713af5-7f55-4cab-8ead-91bbdc70dba0", "name": "network-vif-plugged", "status": "completed", "tag": "ec4e1eb6-ebca-4b0b-8b50-a4390ad7f9f1"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:08:04.305302 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-22366d4f-7685-42cd-9ba4-022f2b230f3b req-004c5618-f171-4219-aff4-b49e548fd123 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:08:04.305874 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-22366d4f-7685-42cd-9ba4-022f2b230f3b req-004c5618-f171-4219-aff4-b49e548fd123 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:08:04.306461 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-22366d4f-7685-42cd-9ba4-022f2b230f3b req-004c5618-f171-4219-aff4-b49e548fd123 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:08:04.320644 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-22366d4f-7685-42cd-9ba4-022f2b230f3b req-004c5618-f171-4219-aff4-b49e548fd123 service nova] Creating event network-vif-plugged:ec4e1eb6-ebca-4b0b-8b50-a4390ad7f9f1 for instance 46713af5-7f55-4cab-8ead-91bbdc70dba0 on n-h2-862686-1 Oct 26 14:08:04.325723 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-22366d4f-7685-42cd-9ba4-022f2b230f3b req-004c5618-f171-4219-aff4-b49e548fd123 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036555 Oct 26 14:08:04.326327 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3765/7506] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:08:05.289657 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-98b584b2-c75e-42e2-8f11-7955d4e345a9 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:08:05.290286 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-98b584b2-c75e-42e2-8f11-7955d4e345a9 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 46713af5-7f55-4cab-8ead-91bbdc70dba0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:08:05.297652 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-98b584b2-c75e-42e2-8f11-7955d4e345a9 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:08:05.298147 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-98b584b2-c75e-42e2-8f11-7955d4e345a9 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:08:05.298623 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-98b584b2-c75e-42e2-8f11-7955d4e345a9 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:08:05.299400 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-98b584b2-c75e-42e2-8f11-7955d4e345a9 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:08:05.299860 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-98b584b2-c75e-42e2-8f11-7955d4e345a9 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:08:05.300287 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-98b584b2-c75e-42e2-8f11-7955d4e345a9 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:08:05.431773 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-98b584b2-c75e-42e2-8f11-7955d4e345a9 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f13b9181742d982ab6c91a17204e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b1ed863dc40c4bee23f3bf4899ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:08:05.439441 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-98b584b2-c75e-42e2-8f11-7955d4e345a9 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0" status: 200 len: 1363 microversion: 2.1 time: 0.154658 Oct 26 14:08:05.440018 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3742/7507] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:08:05 2022] GET /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:08:06.461173 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:08:06.461988 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:08:06.466642 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d53f689e-113a-43fb-9357-278895abe414 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:08:06.467360 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d53f689e-113a-43fb-9357-278895abe414 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 46713af5-7f55-4cab-8ead-91bbdc70dba0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:08:06.474634 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d53f689e-113a-43fb-9357-278895abe414 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:08:06.475138 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d53f689e-113a-43fb-9357-278895abe414 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:08:06.475595 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d53f689e-113a-43fb-9357-278895abe414 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:08:06.476310 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d53f689e-113a-43fb-9357-278895abe414 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:08:06.476788 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d53f689e-113a-43fb-9357-278895abe414 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:08:06.477233 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d53f689e-113a-43fb-9357-278895abe414 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:08:06.605362 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d53f689e-113a-43fb-9357-278895abe414 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f13b9181742d982ab6c91a17204e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b1ed863dc40c4bee23f3bf4899ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:08:06.613644 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d53f689e-113a-43fb-9357-278895abe414 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0" status: 200 len: 1556 microversion: 2.1 time: 0.154229 Oct 26 14:08:06.614225 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3766/7508] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:08:06 2022] GET /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0 => generated 1556 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:08:06.636390 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-65217ace-6e5c-4bc0-8543-1afb6b3fa0c0 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:08:06.637022 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-65217ace-6e5c-4bc0-8543-1afb6b3fa0c0 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 46713af5-7f55-4cab-8ead-91bbdc70dba0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:08:06.639045 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:08:06.644997 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-65217ace-6e5c-4bc0-8543-1afb6b3fa0c0 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:08:06.645497 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-65217ace-6e5c-4bc0-8543-1afb6b3fa0c0 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:08:06.645941 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-65217ace-6e5c-4bc0-8543-1afb6b3fa0c0 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:08:06.646628 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-65217ace-6e5c-4bc0-8543-1afb6b3fa0c0 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:08:06.647115 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-65217ace-6e5c-4bc0-8543-1afb6b3fa0c0 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:08:06.647542 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-65217ace-6e5c-4bc0-8543-1afb6b3fa0c0 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:08:06.778255 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-65217ace-6e5c-4bc0-8543-1afb6b3fa0c0 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f13b9181742d982ab6c91a17204e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b1ed863dc40c4bee23f3bf4899ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:08:06.787333 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-65217ace-6e5c-4bc0-8543-1afb6b3fa0c0 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0" status: 200 len: 1556 microversion: 2.1 time: 0.154785 Oct 26 14:08:06.787906 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3743/7509] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:08:06 2022] GET /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0 => generated 1556 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:08:08.281713 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d8dbf6dc-3807-46d9-95b8-dd42eade339e tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67dbba6f-789d-4072-a07d-10106cb9eb76"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:08:08.284100 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d8dbf6dc-3807-46d9-95b8-dd42eade339e tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 46713af5-7f55-4cab-8ead-91bbdc70dba0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:08:08.291241 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8dbf6dc-3807-46d9-95b8-dd42eade339e tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:08:08.291757 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8dbf6dc-3807-46d9-95b8-dd42eade339e tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:08:08.292189 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8dbf6dc-3807-46d9-95b8-dd42eade339e tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:08:08.292890 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8dbf6dc-3807-46d9-95b8-dd42eade339e tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:08:08.293360 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8dbf6dc-3807-46d9-95b8-dd42eade339e tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:08:08.293833 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8dbf6dc-3807-46d9-95b8-dd42eade339e tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:08:08.517001 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:08:08.536689 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d8dbf6dc-3807-46d9-95b8-dd42eade339e tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "POST /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258893 Oct 26 14:08:08.537306 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3767/7510] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Oct 26 14:08:08 2022] POST /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:08:19.272792 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a4d47be7-1edb-4319-b780-ad1fab9bb9f5 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:08:19.273319 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a4d47be7-1edb-4319-b780-ad1fab9bb9f5 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 46713af5-7f55-4cab-8ead-91bbdc70dba0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:08:19.275743 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:08:19.276526 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=70 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:08:19.282738 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4d47be7-1edb-4319-b780-ad1fab9bb9f5 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:08:19.283223 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4d47be7-1edb-4319-b780-ad1fab9bb9f5 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:08:19.283664 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4d47be7-1edb-4319-b780-ad1fab9bb9f5 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:08:19.284515 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4d47be7-1edb-4319-b780-ad1fab9bb9f5 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:08:19.285417 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4d47be7-1edb-4319-b780-ad1fab9bb9f5 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:08:19.285876 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4d47be7-1edb-4319-b780-ad1fab9bb9f5 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:08:19.367473 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-a4d47be7-1edb-4319-b780-ad1fab9bb9f5 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lazy-loading 'services' on Instance uuid 46713af5-7f55-4cab-8ead-91bbdc70dba0 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 14:08:19.436375 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a4d47be7-1edb-4319-b780-ad1fab9bb9f5 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "DELETE /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0/os-volume_attachments/67dbba6f-789d-4072-a07d-10106cb9eb76" status: 202 len: 0 microversion: 2.1 time: 0.168151 Oct 26 14:08:19.436970 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3744/7511] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Oct 26 14:08:19 2022] DELETE /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0/os-volume_attachments/67dbba6f-789d-4072-a07d-10106cb9eb76 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 14:08:19.444645 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:08:19.445447 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:08:19.449690 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8f07b52a-59e0-41af-9909-e79de66e6ca9 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:08:19.452041 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8f07b52a-59e0-41af-9909-e79de66e6ca9 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 46713af5-7f55-4cab-8ead-91bbdc70dba0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:08:19.459638 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f07b52a-59e0-41af-9909-e79de66e6ca9 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:08:19.460154 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f07b52a-59e0-41af-9909-e79de66e6ca9 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:08:19.460604 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f07b52a-59e0-41af-9909-e79de66e6ca9 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:08:19.461321 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f07b52a-59e0-41af-9909-e79de66e6ca9 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:08:19.461827 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f07b52a-59e0-41af-9909-e79de66e6ca9 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:08:19.462271 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f07b52a-59e0-41af-9909-e79de66e6ca9 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:08:19.497466 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8f07b52a-59e0-41af-9909-e79de66e6ca9 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055026 Oct 26 14:08:19.498099 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3768/7512] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 14:08:19 2022] GET /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:08:20.511603 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-26506947-93c3-4f33-8b22-af8d74ccaf71 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:08:20.514017 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-26506947-93c3-4f33-8b22-af8d74ccaf71 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 46713af5-7f55-4cab-8ead-91bbdc70dba0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:08:20.520805 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26506947-93c3-4f33-8b22-af8d74ccaf71 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:08:20.521286 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26506947-93c3-4f33-8b22-af8d74ccaf71 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:08:20.521754 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26506947-93c3-4f33-8b22-af8d74ccaf71 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:08:20.522447 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26506947-93c3-4f33-8b22-af8d74ccaf71 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:08:20.522898 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26506947-93c3-4f33-8b22-af8d74ccaf71 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:08:20.523323 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26506947-93c3-4f33-8b22-af8d74ccaf71 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:08:20.556583 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-26506947-93c3-4f33-8b22-af8d74ccaf71 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050133 Oct 26 14:08:20.557152 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3745/7513] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 14:08:20 2022] GET /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:08:21.569200 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a3e69bc1-0720-4995-8101-a9a0bb13bb96 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:08:21.571623 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a3e69bc1-0720-4995-8101-a9a0bb13bb96 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 46713af5-7f55-4cab-8ead-91bbdc70dba0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:08:21.578531 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a3e69bc1-0720-4995-8101-a9a0bb13bb96 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:08:21.579041 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a3e69bc1-0720-4995-8101-a9a0bb13bb96 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:08:21.579497 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a3e69bc1-0720-4995-8101-a9a0bb13bb96 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:08:21.580210 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a3e69bc1-0720-4995-8101-a9a0bb13bb96 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:08:21.580685 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a3e69bc1-0720-4995-8101-a9a0bb13bb96 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:08:21.581546 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a3e69bc1-0720-4995-8101-a9a0bb13bb96 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:08:21.611589 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a3e69bc1-0720-4995-8101-a9a0bb13bb96 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047150 Oct 26 14:08:21.612920 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3769/7514] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 14:08:21 2022] GET /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:08:22.624568 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-02a0888c-c640-4d97-92ef-1d820d872bb4 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:08:22.626751 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-02a0888c-c640-4d97-92ef-1d820d872bb4 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 46713af5-7f55-4cab-8ead-91bbdc70dba0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:08:22.635498 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-02a0888c-c640-4d97-92ef-1d820d872bb4 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:08:22.635979 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-02a0888c-c640-4d97-92ef-1d820d872bb4 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:08:22.636421 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-02a0888c-c640-4d97-92ef-1d820d872bb4 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:08:22.637110 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-02a0888c-c640-4d97-92ef-1d820d872bb4 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:08:22.637598 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-02a0888c-c640-4d97-92ef-1d820d872bb4 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:08:22.638027 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-02a0888c-c640-4d97-92ef-1d820d872bb4 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:08:22.669732 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-02a0888c-c640-4d97-92ef-1d820d872bb4 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049261 Oct 26 14:08:22.670300 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3746/7515] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 14:08:22 2022] GET /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:08:23.682180 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-90196384-2596-4a0b-b8b4-d0e0ed2afca5 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:08:23.684383 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-90196384-2596-4a0b-b8b4-d0e0ed2afca5 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 46713af5-7f55-4cab-8ead-91bbdc70dba0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:08:23.692438 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90196384-2596-4a0b-b8b4-d0e0ed2afca5 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:08:23.692928 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90196384-2596-4a0b-b8b4-d0e0ed2afca5 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:08:23.693377 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90196384-2596-4a0b-b8b4-d0e0ed2afca5 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:08:23.694119 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90196384-2596-4a0b-b8b4-d0e0ed2afca5 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:08:23.694604 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90196384-2596-4a0b-b8b4-d0e0ed2afca5 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:08:23.695018 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90196384-2596-4a0b-b8b4-d0e0ed2afca5 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:08:23.729152 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-90196384-2596-4a0b-b8b4-d0e0ed2afca5 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050960 Oct 26 14:08:23.729761 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3770/7516] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 14:08:23 2022] GET /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:08:24.742254 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c814edf8-444c-4ed7-85f9-f50289ed09e6 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:08:24.744326 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c814edf8-444c-4ed7-85f9-f50289ed09e6 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 46713af5-7f55-4cab-8ead-91bbdc70dba0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:08:24.750967 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c814edf8-444c-4ed7-85f9-f50289ed09e6 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:08:24.751443 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c814edf8-444c-4ed7-85f9-f50289ed09e6 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:08:24.751877 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c814edf8-444c-4ed7-85f9-f50289ed09e6 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:08:24.752558 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c814edf8-444c-4ed7-85f9-f50289ed09e6 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:08:24.753011 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c814edf8-444c-4ed7-85f9-f50289ed09e6 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:08:24.753434 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c814edf8-444c-4ed7-85f9-f50289ed09e6 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:08:24.782019 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c814edf8-444c-4ed7-85f9-f50289ed09e6 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044333 Oct 26 14:08:24.782565 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3747/7517] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 14:08:24 2022] GET /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 14:08:24.794570 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-88116eef-a6ae-486f-9e74-14b2b588bf1b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:08:24.795085 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-88116eef-a6ae-486f-9e74-14b2b588bf1b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 46713af5-7f55-4cab-8ead-91bbdc70dba0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:08:24.802839 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88116eef-a6ae-486f-9e74-14b2b588bf1b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:08:24.803339 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88116eef-a6ae-486f-9e74-14b2b588bf1b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:08:24.803796 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88116eef-a6ae-486f-9e74-14b2b588bf1b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:08:24.804507 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88116eef-a6ae-486f-9e74-14b2b588bf1b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:08:24.804980 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88116eef-a6ae-486f-9e74-14b2b588bf1b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:08:24.805422 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88116eef-a6ae-486f-9e74-14b2b588bf1b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:08:24.884267 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-88116eef-a6ae-486f-9e74-14b2b588bf1b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] HTTP exception thrown: Instance 46713af5-7f55-4cab-8ead-91bbdc70dba0 is not attached to volume 67dbba6f-789d-4072-a07d-10106cb9eb76 Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-88116eef-a6ae-486f-9e74-14b2b588bf1b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Request method failure captured: Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: request: DELETE /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0/os-volume_attachments/67dbba6f-789d-4072-a07d-10106cb9eb76 HTTP/1.1 Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWT7tPtFRgi7F-xA3DOTONjqmwyYK-r4z3CdNtIVBTaSUxovOxevrmP_5W0m0T9KRIWRR8x2g3bzPpvguBMq4Nf8bEK1KKjbYSQ4D-50jyWGEpILkiLxDaEFba7B_5kvQ-VlKuP77ymAQVNU6T3ckQ7sU15A4khd16HDx_fJMS4Atuys Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 859b1ed863dc40c4bee23f3bf4899ea0 Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1286211498 Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/859b1ed863dc40c4bee23f3bf4899ea0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/859b1ed863dc40c4bee23f3bf4899ea0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_859b1ed863dc40c4bee23f3bf4899ea0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/859b1ed863dc40c4bee23f3bf4899ea0"}]}] Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-TestEncryptedCinderVolumes-1286211498 Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 859b1ed863dc40c4bee23f3bf4899ea0 Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1286211498 Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-TestEncryptedCinderVolumes-1286211498-project Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 878f13b9181742d982ab6c91a17204e2 Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-TestEncryptedCinderVolumes-1286211498-project Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 46713af5-7f55-4cab-8ead-91bbdc70dba0 is not attached to volume 67dbba6f-789d-4072-a07d-10106cb9eb76 Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'server_id': '46713af5-7f55-4cab-8ead-91bbdc70dba0', 'id': '67dbba6f-789d-4072-a07d-10106cb9eb76'} Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 67dbba6f-789d-4072-a07d-10106cb9eb76. Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46713af5-7f55-4cab-8ead-91bbdc70dba0 is not attached to volume 67dbba6f-789d-4072-a07d-10106cb9eb76 Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:08:24.886236 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:08:24.891039 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 14:08:24.891039 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 14:08:24.891039 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46713af5-7f55-4cab-8ead-91bbdc70dba0 is not attached to volume 67dbba6f-789d-4072-a07d-10106cb9eb76 Oct 26 14:08:24.891039 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:08:24.891039 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-88116eef-a6ae-486f-9e74-14b2b588bf1b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Returning 404 to user: Instance 46713af5-7f55-4cab-8ead-91bbdc70dba0 is not attached to volume 67dbba6f-789d-4072-a07d-10106cb9eb76 {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 14:08:24.891039 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-88116eef-a6ae-486f-9e74-14b2b588bf1b tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "DELETE /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0/os-volume_attachments/67dbba6f-789d-4072-a07d-10106cb9eb76" status: 404 len: 154 microversion: 2.1 time: 0.097280 Oct 26 14:08:24.891039 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3771/7518] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Oct 26 14:08:24 2022] DELETE /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0/os-volume_attachments/67dbba6f-789d-4072-a07d-10106cb9eb76 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 14:08:28.242952 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-241b01d8-2c57-41b9-b891-a4c2480e9bde tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:08:28.243513 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-241b01d8-2c57-41b9-b891-a4c2480e9bde tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 46713af5-7f55-4cab-8ead-91bbdc70dba0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:08:28.250607 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-241b01d8-2c57-41b9-b891-a4c2480e9bde tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:08:28.251104 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-241b01d8-2c57-41b9-b891-a4c2480e9bde tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:08:28.251552 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-241b01d8-2c57-41b9-b891-a4c2480e9bde tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:08:28.252265 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-241b01d8-2c57-41b9-b891-a4c2480e9bde tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:08:28.252726 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-241b01d8-2c57-41b9-b891-a4c2480e9bde tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:08:28.253158 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-241b01d8-2c57-41b9-b891-a4c2480e9bde tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:08:28.280841 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-241b01d8-2c57-41b9-b891-a4c2480e9bde tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 46713af5-7f55-4cab-8ead-91bbdc70dba0] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 14:08:28.365775 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-241b01d8-2c57-41b9-b891-a4c2480e9bde tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "DELETE /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0" status: 204 len: 0 microversion: 2.1 time: 0.125999 Oct 26 14:08:28.366628 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3748/7519] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 14:08:28 2022] DELETE /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 14:08:28.374713 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6ac21dd9-6877-4812-abfc-2ce7d3de7191 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:08:28.375345 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6ac21dd9-6877-4812-abfc-2ce7d3de7191 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 46713af5-7f55-4cab-8ead-91bbdc70dba0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:08:28.383492 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ac21dd9-6877-4812-abfc-2ce7d3de7191 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:08:28.383933 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ac21dd9-6877-4812-abfc-2ce7d3de7191 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:08:28.384380 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ac21dd9-6877-4812-abfc-2ce7d3de7191 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:08:28.385089 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ac21dd9-6877-4812-abfc-2ce7d3de7191 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:08:28.385661 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ac21dd9-6877-4812-abfc-2ce7d3de7191 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:08:28.386122 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ac21dd9-6877-4812-abfc-2ce7d3de7191 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:08:28.523208 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6ac21dd9-6877-4812-abfc-2ce7d3de7191 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f13b9181742d982ab6c91a17204e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b1ed863dc40c4bee23f3bf4899ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:08:28.531110 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6ac21dd9-6877-4812-abfc-2ce7d3de7191 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0" status: 200 len: 1562 microversion: 2.1 time: 0.160340 Oct 26 14:08:28.531681 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3772/7520] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:08:28 2022] GET /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0 => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:08:29.556805 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9c88f6cf-28ba-4968-a212-9d6567985d3e tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:08:29.557598 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9c88f6cf-28ba-4968-a212-9d6567985d3e tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 46713af5-7f55-4cab-8ead-91bbdc70dba0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:08:29.564472 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c88f6cf-28ba-4968-a212-9d6567985d3e tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:08:29.564957 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c88f6cf-28ba-4968-a212-9d6567985d3e tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:08:29.565396 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c88f6cf-28ba-4968-a212-9d6567985d3e tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:08:29.566714 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c88f6cf-28ba-4968-a212-9d6567985d3e tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:08:29.567175 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c88f6cf-28ba-4968-a212-9d6567985d3e tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:08:29.567712 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c88f6cf-28ba-4968-a212-9d6567985d3e tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:08:29.699839 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9c88f6cf-28ba-4968-a212-9d6567985d3e tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f13b9181742d982ab6c91a17204e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b1ed863dc40c4bee23f3bf4899ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:08:29.707572 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9c88f6cf-28ba-4968-a212-9d6567985d3e tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0" status: 200 len: 1562 microversion: 2.1 time: 0.155149 Oct 26 14:08:29.708143 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3749/7521] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:08:29 2022] GET /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0 => generated 1562 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:08:30.514125 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-3f60b8e8-7e20-43bd-8252-09d8c2350a8e req-78709b88-8fac-4460-a910-06a74b93e3bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46713af5-7f55-4cab-8ead-91bbdc70dba0", "name": "network-vif-deleted", "tag": "ec4e1eb6-ebca-4b0b-8b50-a4390ad7f9f1"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:08:30.527242 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-3f60b8e8-7e20-43bd-8252-09d8c2350a8e req-78709b88-8fac-4460-a910-06a74b93e3bc service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:08:30.527723 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-3f60b8e8-7e20-43bd-8252-09d8c2350a8e req-78709b88-8fac-4460-a910-06a74b93e3bc service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:08:30.528173 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-3f60b8e8-7e20-43bd-8252-09d8c2350a8e req-78709b88-8fac-4460-a910-06a74b93e3bc service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:08:30.540790 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-3f60b8e8-7e20-43bd-8252-09d8c2350a8e req-78709b88-8fac-4460-a910-06a74b93e3bc service nova] Creating event network-vif-deleted:ec4e1eb6-ebca-4b0b-8b50-a4390ad7f9f1 for instance 46713af5-7f55-4cab-8ead-91bbdc70dba0 on n-h2-862686-1 Oct 26 14:08:30.546177 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-3f60b8e8-7e20-43bd-8252-09d8c2350a8e req-78709b88-8fac-4460-a910-06a74b93e3bc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035681 Oct 26 14:08:30.546967 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3773/7522] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:08:30.731166 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fe0960cb-6143-4c43-b3b3-31317041373f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:08:30.731809 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fe0960cb-6143-4c43-b3b3-31317041373f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 46713af5-7f55-4cab-8ead-91bbdc70dba0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:08:30.738886 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fe0960cb-6143-4c43-b3b3-31317041373f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:08:30.739370 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fe0960cb-6143-4c43-b3b3-31317041373f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:08:30.739808 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fe0960cb-6143-4c43-b3b3-31317041373f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:08:30.740538 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fe0960cb-6143-4c43-b3b3-31317041373f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:08:30.740991 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fe0960cb-6143-4c43-b3b3-31317041373f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:08:30.741415 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fe0960cb-6143-4c43-b3b3-31317041373f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:08:30.774610 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fe0960cb-6143-4c43-b3b3-31317041373f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:08:30.775087 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fe0960cb-6143-4c43-b3b3-31317041373f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:08:30.775520 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fe0960cb-6143-4c43-b3b3-31317041373f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:08:30.775964 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-fe0960cb-6143-4c43-b3b3-31317041373f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lazy-loading 'fault' on Instance uuid 46713af5-7f55-4cab-8ead-91bbdc70dba0 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 14:08:30.818916 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fe0960cb-6143-4c43-b3b3-31317041373f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878f13b9181742d982ab6c91a17204e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b1ed863dc40c4bee23f3bf4899ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:08:30.827401 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fe0960cb-6143-4c43-b3b3-31317041373f tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0" status: 200 len: 1353 microversion: 2.1 time: 0.100279 Oct 26 14:08:30.827995 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3750/7523] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:08:30 2022] GET /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0 => generated 1353 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:08:31.853417 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2f8e16e3-d8e5-4582-9146-5a16193a7bb5 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:08:31.854300 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2f8e16e3-d8e5-4582-9146-5a16193a7bb5 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] [instance: 46713af5-7f55-4cab-8ead-91bbdc70dba0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:08:31.860832 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f8e16e3-d8e5-4582-9146-5a16193a7bb5 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:08:31.861335 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f8e16e3-d8e5-4582-9146-5a16193a7bb5 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:08:31.861815 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f8e16e3-d8e5-4582-9146-5a16193a7bb5 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:08:31.862533 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f8e16e3-d8e5-4582-9146-5a16193a7bb5 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:08:31.863658 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f8e16e3-d8e5-4582-9146-5a16193a7bb5 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:08:31.864204 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f8e16e3-d8e5-4582-9146-5a16193a7bb5 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:08:31.877595 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-2f8e16e3-d8e5-4582-9146-5a16193a7bb5 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] HTTP exception thrown: Instance 46713af5-7f55-4cab-8ead-91bbdc70dba0 could not be found. Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2f8e16e3-d8e5-4582-9146-5a16193a7bb5 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Request method failure captured: Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0 HTTP/1.1 Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWT7tPtFRgi7F-xA3DOTONjqmwyYK-r4z3CdNtIVBTaSUxovOxevrmP_5W0m0T9KRIWRR8x2g3bzPpvguBMq4Nf8bEK1KKjbYSQ4D-50jyWGEpILkiLxDaEFba7B_5kvQ-VlKuP77ymAQVNU6T3ckQ7sU15A4khd16HDx_fJMS4Atuys Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 859b1ed863dc40c4bee23f3bf4899ea0 Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1286211498 Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/859b1ed863dc40c4bee23f3bf4899ea0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/859b1ed863dc40c4bee23f3bf4899ea0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_859b1ed863dc40c4bee23f3bf4899ea0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/859b1ed863dc40c4bee23f3bf4899ea0"}]}] Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-TestEncryptedCinderVolumes-1286211498 Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 859b1ed863dc40c4bee23f3bf4899ea0 Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1286211498 Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-TestEncryptedCinderVolumes-1286211498-project Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 878f13b9181742d982ab6c91a17204e2 Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-TestEncryptedCinderVolumes-1286211498-project Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 46713af5-7f55-4cab-8ead-91bbdc70dba0 could not be found. Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '46713af5-7f55-4cab-8ead-91bbdc70dba0'} Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46713af5-7f55-4cab-8ead-91bbdc70dba0 could not be found. Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46713af5-7f55-4cab-8ead-91bbdc70dba0 could not be found. Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:08:31.879322 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:08:31.884216 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:08:31.884216 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:08:31.884216 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:08:31.884216 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:08:31.884216 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 14:08:31.884216 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 14:08:31.884216 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46713af5-7f55-4cab-8ead-91bbdc70dba0 could not be found. Oct 26 14:08:31.884216 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:08:31.884216 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2f8e16e3-d8e5-4582-9146-5a16193a7bb5 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Returning 404 to user: Instance 46713af5-7f55-4cab-8ead-91bbdc70dba0 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 14:08:31.884216 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2f8e16e3-d8e5-4582-9146-5a16193a7bb5 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "GET /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0" status: 404 len: 111 microversion: 2.1 time: 0.032469 Oct 26 14:08:31.884216 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3774/7524] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:08:31 2022] GET /compute/v2.1/servers/46713af5-7f55-4cab-8ead-91bbdc70dba0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 14:08:31.889548 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fd4c8248-78c6-463c-9ce5-8a315ebd2605 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] Calling method '.version_select at 0x7f673198fd30>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:08:31.913422 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fd4c8248-78c6-463c-9ce5-8a315ebd2605 tempest-TestEncryptedCinderVolumes-1286211498 tempest-TestEncryptedCinderVolumes-1286211498-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2015981819" status: 202 len: 0 microversion: 2.1 time: 0.027658 Oct 26 14:08:31.914042 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3751/7525] 10.222.0.40 () {58 vars in 1278 bytes} [Wed Oct 26 14:08:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2015981819 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 14:08:58.886037 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d4451fc7-c45d-4458-87a3-d584fce0d0d9 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Action: 'create', calling method: .version_select at 0x7f67310c91f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2034763849", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHe6F4iw6vU6RDHNeL8ORpRMZMso0OIUuCXViRf4wrhCzIPyJZdwa64/YT3r6TPTY8SzA3obWW3hjHGNcsYk/keWryXOYOzOFYWsjyp79Qvi043Fe4goFVHgsd1Dur5Jew=="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:08:58.891603 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=14 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:08:58.892279 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=34 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:08:58.904312 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-d4451fc7-c45d-4458-87a3-d584fce0d0d9 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Getting quotas for project 480d8bdd36324b4ebc2b3cd7953fabe7. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 14:08:58.909269 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-d4451fc7-c45d-4458-87a3-d584fce0d0d9 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Getting quotas for user 8238828b171840e389ab38164aef51a7 and project 480d8bdd36324b4ebc2b3cd7953fabe7. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 14:08:58.933087 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d4451fc7-c45d-4458-87a3-d584fce0d0d9 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.051243 Oct 26 14:08:58.933826 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3775/7526] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 14:08:58 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:08:58.982277 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:08:58.983046 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:08:58.987145 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6b23b3bf-a8bb-4698-bdcb-a167657806d6 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-513269810", "imageRef": "f5708ecc-a8e6-43d4-9086-6f66ecce984b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2034763849", "networks": [{"uuid": "aa7c6fba-43af-4a48-8015-74df55f672ac"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:08:59.040437 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-6b23b3bf-a8bb-4698-bdcb-a167657806d6 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] validate_networks() for [('aa7c6fba-43af-4a48-8015-74df55f672ac', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 14:08:59.409276 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-6b23b3bf-a8bb-4698-bdcb-a167657806d6 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 14:08:59.409737 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-6b23b3bf-a8bb-4698-bdcb-a167657806d6 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 14:08:59.410217 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-6b23b3bf-a8bb-4698-bdcb-a167657806d6 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 14:08:59.410982 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-6b23b3bf-a8bb-4698-bdcb-a167657806d6 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 14:08:59.411426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-6b23b3bf-a8bb-4698-bdcb-a167657806d6 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 14:08:59.420610 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b23b3bf-a8bb-4698-bdcb-a167657806d6 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:08:59.421112 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b23b3bf-a8bb-4698-bdcb-a167657806d6 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:08:59.421584 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b23b3bf-a8bb-4698-bdcb-a167657806d6 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:08:59.422312 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b23b3bf-a8bb-4698-bdcb-a167657806d6 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:08:59.422767 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b23b3bf-a8bb-4698-bdcb-a167657806d6 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:08:59.423194 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b23b3bf-a8bb-4698-bdcb-a167657806d6 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:08:59.440728 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-6b23b3bf-a8bb-4698-bdcb-a167657806d6 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Getting quotas for project 480d8bdd36324b4ebc2b3cd7953fabe7. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 14:08:59.446903 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-6b23b3bf-a8bb-4698-bdcb-a167657806d6 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Getting quotas for user 8238828b171840e389ab38164aef51a7 and project 480d8bdd36324b4ebc2b3cd7953fabe7. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 14:08:59.460146 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6b23b3bf-a8bb-4698-bdcb-a167657806d6 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 14:08:59.462396 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6b23b3bf-a8bb-4698-bdcb-a167657806d6 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: d03537cc-5960-46ea-ab2d-a1e3ef1092b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5708ecc-a8e6-43d4-9086-6f66ecce984b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 14:08:59.508686 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6b23b3bf-a8bb-4698-bdcb-a167657806d6 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.528305 Oct 26 14:08:59.509336 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3752/7527] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 14:08:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 14:08:59.520391 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bf4f6c65-2543-4ae3-bc3b-52d5755f21ee tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:08:59.522456 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bf4f6c65-2543-4ae3-bc3b-52d5755f21ee tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: d03537cc-5960-46ea-ab2d-a1e3ef1092b0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:08:59.813270 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bf4f6c65-2543-4ae3-bc3b-52d5755f21ee tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:08:59.821507 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bf4f6c65-2543-4ae3-bc3b-52d5755f21ee tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0" status: 200 len: 1258 microversion: 2.1 time: 0.305136 Oct 26 14:08:59.822076 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3776/7528] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:08:59 2022] GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0 => generated 1258 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:09:00.844445 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d6b73095-481f-4e48-b5e2-111de781b565 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:09:00.845064 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d6b73095-481f-4e48-b5e2-111de781b565 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: d03537cc-5960-46ea-ab2d-a1e3ef1092b0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:09:00.852616 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6b73095-481f-4e48-b5e2-111de781b565 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:09:00.853309 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6b73095-481f-4e48-b5e2-111de781b565 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:09:00.853870 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6b73095-481f-4e48-b5e2-111de781b565 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:09:00.854672 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6b73095-481f-4e48-b5e2-111de781b565 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:09:00.855328 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6b73095-481f-4e48-b5e2-111de781b565 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:09:00.855764 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6b73095-481f-4e48-b5e2-111de781b565 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:09:00.921952 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d6b73095-481f-4e48-b5e2-111de781b565 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:09:00.930096 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d6b73095-481f-4e48-b5e2-111de781b565 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0" status: 200 len: 1316 microversion: 2.1 time: 0.089694 Oct 26 14:09:00.931153 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3753/7529] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:09:00 2022] GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0 => generated 1316 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:09:01.955478 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-07165a31-18f6-4e98-8292-e98a2aeff530 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:09:01.956155 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-07165a31-18f6-4e98-8292-e98a2aeff530 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: d03537cc-5960-46ea-ab2d-a1e3ef1092b0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:09:01.964008 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07165a31-18f6-4e98-8292-e98a2aeff530 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:09:01.964514 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07165a31-18f6-4e98-8292-e98a2aeff530 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:09:01.964951 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07165a31-18f6-4e98-8292-e98a2aeff530 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:09:01.965689 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07165a31-18f6-4e98-8292-e98a2aeff530 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:09:01.966160 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07165a31-18f6-4e98-8292-e98a2aeff530 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:09:01.966624 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07165a31-18f6-4e98-8292-e98a2aeff530 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:09:02.107139 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-07165a31-18f6-4e98-8292-e98a2aeff530 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:09:02.116515 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-07165a31-18f6-4e98-8292-e98a2aeff530 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0" status: 200 len: 1358 microversion: 2.1 time: 0.164854 Oct 26 14:09:02.117130 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3777/7530] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:09:01 2022] GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:09:03.144532 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-42290617-442b-449b-9612-57e50e65fbb0 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:09:03.145431 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-42290617-442b-449b-9612-57e50e65fbb0 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: d03537cc-5960-46ea-ab2d-a1e3ef1092b0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:09:03.157128 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-42290617-442b-449b-9612-57e50e65fbb0 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:09:03.157983 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-42290617-442b-449b-9612-57e50e65fbb0 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:09:03.158719 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-42290617-442b-449b-9612-57e50e65fbb0 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:09:03.159894 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-42290617-442b-449b-9612-57e50e65fbb0 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:09:03.160927 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-42290617-442b-449b-9612-57e50e65fbb0 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:09:03.162191 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-42290617-442b-449b-9612-57e50e65fbb0 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:09:03.318104 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-42290617-442b-449b-9612-57e50e65fbb0 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:09:03.328322 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-42290617-442b-449b-9612-57e50e65fbb0 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0" status: 200 len: 1358 microversion: 2.1 time: 0.191296 Oct 26 14:09:03.332509 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3754/7531] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:09:03 2022] GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0 => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:09:04.351447 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e7023225-6939-4ea0-bb3a-97caaf7c9799 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:09:04.352318 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e7023225-6939-4ea0-bb3a-97caaf7c9799 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: d03537cc-5960-46ea-ab2d-a1e3ef1092b0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:09:04.359332 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e7023225-6939-4ea0-bb3a-97caaf7c9799 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:09:04.360183 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e7023225-6939-4ea0-bb3a-97caaf7c9799 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:09:04.360930 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e7023225-6939-4ea0-bb3a-97caaf7c9799 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:09:04.361940 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e7023225-6939-4ea0-bb3a-97caaf7c9799 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:09:04.362638 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e7023225-6939-4ea0-bb3a-97caaf7c9799 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:09:04.363319 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e7023225-6939-4ea0-bb3a-97caaf7c9799 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:09:04.509564 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e7023225-6939-4ea0-bb3a-97caaf7c9799 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:09:04.517945 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e7023225-6939-4ea0-bb3a-97caaf7c9799 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0" status: 200 len: 1358 microversion: 2.1 time: 0.170512 Oct 26 14:09:04.518542 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3778/7532] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:09:04 2022] GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:09:05.542651 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ff63db51-28cc-42ae-82a2-325242b68854 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:09:05.544485 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ff63db51-28cc-42ae-82a2-325242b68854 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: d03537cc-5960-46ea-ab2d-a1e3ef1092b0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:09:05.552153 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff63db51-28cc-42ae-82a2-325242b68854 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:09:05.552669 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff63db51-28cc-42ae-82a2-325242b68854 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:09:05.553308 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff63db51-28cc-42ae-82a2-325242b68854 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:09:05.554362 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff63db51-28cc-42ae-82a2-325242b68854 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:09:05.554924 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff63db51-28cc-42ae-82a2-325242b68854 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:09:05.555359 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff63db51-28cc-42ae-82a2-325242b68854 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:09:05.710777 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ff63db51-28cc-42ae-82a2-325242b68854 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:09:05.719031 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ff63db51-28cc-42ae-82a2-325242b68854 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0" status: 200 len: 1358 microversion: 2.1 time: 0.181838 Oct 26 14:09:05.719625 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3755/7533] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:09:05 2022] GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:09:06.743352 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6abf3b48-3752-4bdf-ada6-86c2ad1bc002 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:09:06.743976 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6abf3b48-3752-4bdf-ada6-86c2ad1bc002 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: d03537cc-5960-46ea-ab2d-a1e3ef1092b0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:09:06.751091 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6abf3b48-3752-4bdf-ada6-86c2ad1bc002 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:09:06.751606 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6abf3b48-3752-4bdf-ada6-86c2ad1bc002 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:09:06.752061 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6abf3b48-3752-4bdf-ada6-86c2ad1bc002 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:09:06.752790 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6abf3b48-3752-4bdf-ada6-86c2ad1bc002 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:09:06.753260 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6abf3b48-3752-4bdf-ada6-86c2ad1bc002 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:09:06.753930 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6abf3b48-3752-4bdf-ada6-86c2ad1bc002 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:09:06.899124 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6abf3b48-3752-4bdf-ada6-86c2ad1bc002 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:09:06.907037 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6abf3b48-3752-4bdf-ada6-86c2ad1bc002 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0" status: 200 len: 1358 microversion: 2.1 time: 0.168672 Oct 26 14:09:06.907622 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3779/7534] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:09:06 2022] GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:09:07.932436 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0f8a14a7-8fe6-498c-b4fb-b5340a53ab55 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:09:07.933168 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0f8a14a7-8fe6-498c-b4fb-b5340a53ab55 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: d03537cc-5960-46ea-ab2d-a1e3ef1092b0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:09:07.941190 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0f8a14a7-8fe6-498c-b4fb-b5340a53ab55 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:09:07.941721 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0f8a14a7-8fe6-498c-b4fb-b5340a53ab55 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:09:07.942167 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0f8a14a7-8fe6-498c-b4fb-b5340a53ab55 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:09:07.943044 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0f8a14a7-8fe6-498c-b4fb-b5340a53ab55 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:09:07.943499 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0f8a14a7-8fe6-498c-b4fb-b5340a53ab55 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:09:07.943923 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0f8a14a7-8fe6-498c-b4fb-b5340a53ab55 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:09:08.081839 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0f8a14a7-8fe6-498c-b4fb-b5340a53ab55 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:09:08.090133 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0f8a14a7-8fe6-498c-b4fb-b5340a53ab55 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0" status: 200 len: 1358 microversion: 2.1 time: 0.162282 Oct 26 14:09:08.091024 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3756/7535] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:09:07 2022] GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:09:09.114498 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-80206704-6265-4713-9459-942aa6af8289 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:09:09.115155 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-80206704-6265-4713-9459-942aa6af8289 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: d03537cc-5960-46ea-ab2d-a1e3ef1092b0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:09:09.122545 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-80206704-6265-4713-9459-942aa6af8289 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:09:09.123104 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-80206704-6265-4713-9459-942aa6af8289 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:09:09.123560 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-80206704-6265-4713-9459-942aa6af8289 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:09:09.124276 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-80206704-6265-4713-9459-942aa6af8289 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:09:09.124777 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-80206704-6265-4713-9459-942aa6af8289 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:09:09.125223 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-80206704-6265-4713-9459-942aa6af8289 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:09:09.272877 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-80206704-6265-4713-9459-942aa6af8289 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:09:09.280595 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-80206704-6265-4713-9459-942aa6af8289 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0" status: 200 len: 1358 microversion: 2.1 time: 0.170068 Oct 26 14:09:09.281209 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3780/7536] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:09:09 2022] GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:09:09.894699 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-1bd15cfd-26e8-4875-ac67-bfd3dd97a6dc req-d7c88726-24b4-4cac-848e-a01ccc4eccdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d03537cc-5960-46ea-ab2d-a1e3ef1092b0", "tag": "b78728ed-254d-48b9-b048-c151250650ac"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:09:09.908784 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:09:09.909662 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:09:09.918524 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-1bd15cfd-26e8-4875-ac67-bfd3dd97a6dc req-d7c88726-24b4-4cac-848e-a01ccc4eccdb service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:09:09.919283 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-1bd15cfd-26e8-4875-ac67-bfd3dd97a6dc req-d7c88726-24b4-4cac-848e-a01ccc4eccdb service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:09:09.919746 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-1bd15cfd-26e8-4875-ac67-bfd3dd97a6dc req-d7c88726-24b4-4cac-848e-a01ccc4eccdb service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:09:09.932737 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-1bd15cfd-26e8-4875-ac67-bfd3dd97a6dc req-d7c88726-24b4-4cac-848e-a01ccc4eccdb service nova] Creating event network-changed:b78728ed-254d-48b9-b048-c151250650ac for instance d03537cc-5960-46ea-ab2d-a1e3ef1092b0 on n-h1-862686-1 Oct 26 14:09:09.938332 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-1bd15cfd-26e8-4875-ac67-bfd3dd97a6dc req-d7c88726-24b4-4cac-848e-a01ccc4eccdb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047359 Oct 26 14:09:09.939064 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3757/7537] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:09:10.305129 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ddb44b41-eedc-429e-940a-bea70ea591af tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:09:10.306105 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ddb44b41-eedc-429e-940a-bea70ea591af tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: d03537cc-5960-46ea-ab2d-a1e3ef1092b0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:09:10.308015 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:09:10.314197 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ddb44b41-eedc-429e-940a-bea70ea591af tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:09:10.314704 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ddb44b41-eedc-429e-940a-bea70ea591af tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:09:10.315159 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ddb44b41-eedc-429e-940a-bea70ea591af tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:09:10.315910 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ddb44b41-eedc-429e-940a-bea70ea591af tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:09:10.316382 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ddb44b41-eedc-429e-940a-bea70ea591af tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:09:10.316851 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ddb44b41-eedc-429e-940a-bea70ea591af tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:09:10.450195 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ddb44b41-eedc-429e-940a-bea70ea591af tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:09:10.457816 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ddb44b41-eedc-429e-940a-bea70ea591af tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0" status: 200 len: 1358 microversion: 2.1 time: 0.157374 Oct 26 14:09:10.458390 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3781/7538] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:09:10 2022] GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:09:11.481839 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d995de48-b96b-43d6-b79a-359a7f260625 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:09:11.482548 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d995de48-b96b-43d6-b79a-359a7f260625 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: d03537cc-5960-46ea-ab2d-a1e3ef1092b0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:09:11.488701 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d995de48-b96b-43d6-b79a-359a7f260625 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:09:11.489191 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d995de48-b96b-43d6-b79a-359a7f260625 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:09:11.489751 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d995de48-b96b-43d6-b79a-359a7f260625 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:09:11.490454 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d995de48-b96b-43d6-b79a-359a7f260625 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:09:11.490995 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d995de48-b96b-43d6-b79a-359a7f260625 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:09:11.491612 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d995de48-b96b-43d6-b79a-359a7f260625 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:09:11.625388 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d995de48-b96b-43d6-b79a-359a7f260625 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:09:11.634202 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d995de48-b96b-43d6-b79a-359a7f260625 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0" status: 200 len: 1358 microversion: 2.1 time: 0.157463 Oct 26 14:09:11.634791 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3758/7539] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:09:11 2022] GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:09:12.657806 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-20983dd1-c819-4f25-b9d0-d485c29015b3 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:09:12.658434 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-20983dd1-c819-4f25-b9d0-d485c29015b3 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: d03537cc-5960-46ea-ab2d-a1e3ef1092b0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:09:12.666277 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-20983dd1-c819-4f25-b9d0-d485c29015b3 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:09:12.666776 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-20983dd1-c819-4f25-b9d0-d485c29015b3 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:09:12.667231 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-20983dd1-c819-4f25-b9d0-d485c29015b3 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:09:12.667938 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-20983dd1-c819-4f25-b9d0-d485c29015b3 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:09:12.668411 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-20983dd1-c819-4f25-b9d0-d485c29015b3 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:09:12.668855 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-20983dd1-c819-4f25-b9d0-d485c29015b3 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:09:12.797751 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-20983dd1-c819-4f25-b9d0-d485c29015b3 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:09:12.806085 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-20983dd1-c819-4f25-b9d0-d485c29015b3 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0" status: 200 len: 1358 microversion: 2.1 time: 0.152238 Oct 26 14:09:12.806661 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3782/7540] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:09:12 2022] GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:09:13.829337 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-79ca2073-64f4-4f94-abd1-4fd5a18eb0b8 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:09:13.830008 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-79ca2073-64f4-4f94-abd1-4fd5a18eb0b8 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: d03537cc-5960-46ea-ab2d-a1e3ef1092b0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:09:13.836836 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-79ca2073-64f4-4f94-abd1-4fd5a18eb0b8 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:09:13.837321 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-79ca2073-64f4-4f94-abd1-4fd5a18eb0b8 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:09:13.837794 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-79ca2073-64f4-4f94-abd1-4fd5a18eb0b8 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:09:13.838492 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-79ca2073-64f4-4f94-abd1-4fd5a18eb0b8 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:09:13.838952 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-79ca2073-64f4-4f94-abd1-4fd5a18eb0b8 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:09:13.839381 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-79ca2073-64f4-4f94-abd1-4fd5a18eb0b8 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:09:13.970576 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-79ca2073-64f4-4f94-abd1-4fd5a18eb0b8 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:09:13.979416 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-79ca2073-64f4-4f94-abd1-4fd5a18eb0b8 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0" status: 200 len: 1358 microversion: 2.1 time: 0.154024 Oct 26 14:09:13.979997 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3759/7541] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:09:13 2022] GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:09:15.002649 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1b473d44-05d0-421f-98e3-bb0dfa2f5f69 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:09:15.003306 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1b473d44-05d0-421f-98e3-bb0dfa2f5f69 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: d03537cc-5960-46ea-ab2d-a1e3ef1092b0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:09:15.010235 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b473d44-05d0-421f-98e3-bb0dfa2f5f69 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:09:15.010725 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b473d44-05d0-421f-98e3-bb0dfa2f5f69 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:09:15.011174 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b473d44-05d0-421f-98e3-bb0dfa2f5f69 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:09:15.011872 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b473d44-05d0-421f-98e3-bb0dfa2f5f69 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:09:15.012337 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b473d44-05d0-421f-98e3-bb0dfa2f5f69 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:09:15.012773 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b473d44-05d0-421f-98e3-bb0dfa2f5f69 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:09:15.142982 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1b473d44-05d0-421f-98e3-bb0dfa2f5f69 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:09:15.151185 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1b473d44-05d0-421f-98e3-bb0dfa2f5f69 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0" status: 200 len: 1358 microversion: 2.1 time: 0.152445 Oct 26 14:09:15.151764 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3783/7542] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:09:14 2022] GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:09:15.993262 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-bcb9d4ea-0f50-4e73-acce-9eb3b041f53d req-19ad7132-4068-416c-a900-a6337b65bd7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d03537cc-5960-46ea-ab2d-a1e3ef1092b0", "name": "network-vif-plugged", "status": "completed", "tag": "b78728ed-254d-48b9-b048-c151250650ac"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:09:16.004000 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-bcb9d4ea-0f50-4e73-acce-9eb3b041f53d req-19ad7132-4068-416c-a900-a6337b65bd7f service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:09:16.004458 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-bcb9d4ea-0f50-4e73-acce-9eb3b041f53d req-19ad7132-4068-416c-a900-a6337b65bd7f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:09:16.004892 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-bcb9d4ea-0f50-4e73-acce-9eb3b041f53d req-19ad7132-4068-416c-a900-a6337b65bd7f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:09:16.017757 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-bcb9d4ea-0f50-4e73-acce-9eb3b041f53d req-19ad7132-4068-416c-a900-a6337b65bd7f service nova] Creating event network-vif-plugged:b78728ed-254d-48b9-b048-c151250650ac for instance d03537cc-5960-46ea-ab2d-a1e3ef1092b0 on n-h1-862686-1 Oct 26 14:09:16.022726 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-bcb9d4ea-0f50-4e73-acce-9eb3b041f53d req-19ad7132-4068-416c-a900-a6337b65bd7f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033212 Oct 26 14:09:16.024137 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3760/7543] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:09:16.175188 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-447dd22e-859f-4754-918b-2645895f15ef tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:09:16.175809 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-447dd22e-859f-4754-918b-2645895f15ef tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: d03537cc-5960-46ea-ab2d-a1e3ef1092b0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:09:16.183315 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-447dd22e-859f-4754-918b-2645895f15ef tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:09:16.183809 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-447dd22e-859f-4754-918b-2645895f15ef tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:09:16.184260 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-447dd22e-859f-4754-918b-2645895f15ef tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:09:16.184971 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-447dd22e-859f-4754-918b-2645895f15ef tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:09:16.185436 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-447dd22e-859f-4754-918b-2645895f15ef tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:09:16.185897 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-447dd22e-859f-4754-918b-2645895f15ef tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:09:16.315125 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-447dd22e-859f-4754-918b-2645895f15ef tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:09:16.322912 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-447dd22e-859f-4754-918b-2645895f15ef tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0" status: 200 len: 1358 microversion: 2.1 time: 0.151854 Oct 26 14:09:16.323488 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3784/7544] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:09:16 2022] GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:09:17.349604 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-38cc67a8-b60c-4e20-bd5b-bc90a1d5c469 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:09:17.350298 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-38cc67a8-b60c-4e20-bd5b-bc90a1d5c469 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: d03537cc-5960-46ea-ab2d-a1e3ef1092b0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:09:17.356576 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38cc67a8-b60c-4e20-bd5b-bc90a1d5c469 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:09:17.357057 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38cc67a8-b60c-4e20-bd5b-bc90a1d5c469 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:09:17.357509 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38cc67a8-b60c-4e20-bd5b-bc90a1d5c469 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:09:17.358207 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38cc67a8-b60c-4e20-bd5b-bc90a1d5c469 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:09:17.358656 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38cc67a8-b60c-4e20-bd5b-bc90a1d5c469 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:09:17.359077 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38cc67a8-b60c-4e20-bd5b-bc90a1d5c469 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:09:17.490340 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-38cc67a8-b60c-4e20-bd5b-bc90a1d5c469 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:09:17.499102 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-38cc67a8-b60c-4e20-bd5b-bc90a1d5c469 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0" status: 200 len: 1547 microversion: 2.1 time: 0.155799 Oct 26 14:09:17.499682 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3761/7545] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:09:17 2022] GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0 => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:09:17.521865 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-93bc2fbd-f590-491e-afcf-7ef5c4283168 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:09:17.522491 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-93bc2fbd-f590-491e-afcf-7ef5c4283168 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: d03537cc-5960-46ea-ab2d-a1e3ef1092b0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:09:17.529549 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-93bc2fbd-f590-491e-afcf-7ef5c4283168 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:09:17.530058 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-93bc2fbd-f590-491e-afcf-7ef5c4283168 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:09:17.530514 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-93bc2fbd-f590-491e-afcf-7ef5c4283168 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:09:17.531223 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-93bc2fbd-f590-491e-afcf-7ef5c4283168 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:09:17.531695 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-93bc2fbd-f590-491e-afcf-7ef5c4283168 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:09:17.532139 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-93bc2fbd-f590-491e-afcf-7ef5c4283168 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:09:17.665340 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-93bc2fbd-f590-491e-afcf-7ef5c4283168 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:09:17.673727 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-93bc2fbd-f590-491e-afcf-7ef5c4283168 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0" status: 200 len: 1547 microversion: 2.1 time: 0.155811 Oct 26 14:09:17.674307 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3785/7546] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:09:17 2022] GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0 => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:09:17.695975 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5583161f-104b-40c5-9f5d-2fb4558f6c4a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:09:17.700808 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5583161f-104b-40c5-9f5d-2fb4558f6c4a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:09:17.701684 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5583161f-104b-40c5-9f5d-2fb4558f6c4a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Searching by: {'deleted': False, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7'} {{(pid=120597) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 14:09:17.707190 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5583161f-104b-40c5-9f5d-2fb4558f6c4a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:09:17.707669 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5583161f-104b-40c5-9f5d-2fb4558f6c4a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:09:17.708109 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5583161f-104b-40c5-9f5d-2fb4558f6c4a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:09:17.708868 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5583161f-104b-40c5-9f5d-2fb4558f6c4a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:09:17.709324 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5583161f-104b-40c5-9f5d-2fb4558f6c4a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:09:17.709787 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5583161f-104b-40c5-9f5d-2fb4558f6c4a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:09:17.733705 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.multi_cell_list [None req-5583161f-104b-40c5-9f5d-2fb4558f6c4a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120597) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 14:09:17.763124 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5583161f-104b-40c5-9f5d-2fb4558f6c4a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.070871 Oct 26 14:09:17.763711 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3762/7547] 10.222.0.40 () {58 vars in 1125 bytes} [Wed Oct 26 14:09:17 2022] GET /compute/v2.1/servers => generated 342 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:09:17.775745 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0908a84c-ba25-4318-b55a-ac97dee38f64 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:09:17.776364 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0908a84c-ba25-4318-b55a-ac97dee38f64 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: d03537cc-5960-46ea-ab2d-a1e3ef1092b0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:09:17.782584 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0908a84c-ba25-4318-b55a-ac97dee38f64 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:09:17.783073 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0908a84c-ba25-4318-b55a-ac97dee38f64 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:09:17.783519 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0908a84c-ba25-4318-b55a-ac97dee38f64 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:09:17.784220 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0908a84c-ba25-4318-b55a-ac97dee38f64 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:09:17.784684 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0908a84c-ba25-4318-b55a-ac97dee38f64 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:09:17.785121 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0908a84c-ba25-4318-b55a-ac97dee38f64 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:09:17.914140 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0908a84c-ba25-4318-b55a-ac97dee38f64 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:09:17.922570 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0908a84c-ba25-4318-b55a-ac97dee38f64 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0" status: 200 len: 1547 microversion: 2.1 time: 0.151136 Oct 26 14:09:17.923177 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3786/7548] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:09:17 2022] GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0 => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:09:19.471344 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-02196d78-153d-4094-ba6e-bd94caaca9a6 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f5ea582-591d-4489-b85d-abd1d9bc3472"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:09:19.473720 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-02196d78-153d-4094-ba6e-bd94caaca9a6 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: d03537cc-5960-46ea-ab2d-a1e3ef1092b0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:09:19.481562 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-02196d78-153d-4094-ba6e-bd94caaca9a6 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:09:19.482045 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-02196d78-153d-4094-ba6e-bd94caaca9a6 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:09:19.482478 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-02196d78-153d-4094-ba6e-bd94caaca9a6 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:09:19.483158 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-02196d78-153d-4094-ba6e-bd94caaca9a6 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:09:19.483613 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-02196d78-153d-4094-ba6e-bd94caaca9a6 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:09:19.484038 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-02196d78-153d-4094-ba6e-bd94caaca9a6 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:09:19.719594 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-02196d78-153d-4094-ba6e-bd94caaca9a6 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "POST /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.252066 Oct 26 14:09:19.720244 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3763/7549] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Oct 26 14:09:19 2022] POST /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0/os-volume_attachments => generated 194 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:09:32.771900 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-47d50a00-6ce7-4016-b8c6-6620f427bd2f tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:09:32.772520 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-47d50a00-6ce7-4016-b8c6-6620f427bd2f tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: d03537cc-5960-46ea-ab2d-a1e3ef1092b0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:09:32.774833 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:09:32.776160 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=60 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:09:32.783271 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47d50a00-6ce7-4016-b8c6-6620f427bd2f tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:09:32.783780 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47d50a00-6ce7-4016-b8c6-6620f427bd2f tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:09:32.784237 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47d50a00-6ce7-4016-b8c6-6620f427bd2f tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:09:32.784954 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47d50a00-6ce7-4016-b8c6-6620f427bd2f tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:09:32.785429 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47d50a00-6ce7-4016-b8c6-6620f427bd2f tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:09:32.786149 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47d50a00-6ce7-4016-b8c6-6620f427bd2f tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:09:32.918708 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-47d50a00-6ce7-4016-b8c6-6620f427bd2f tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:09:32.926946 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-47d50a00-6ce7-4016-b8c6-6620f427bd2f tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0" status: 200 len: 1593 microversion: 2.1 time: 0.159174 Oct 26 14:09:32.927520 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3787/7550] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:09:32 2022] GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0 => generated 1593 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:09:34.957721 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:09:34.958512 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:09:34.959267 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:09:34.965433 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-fe3ab872-953f-4be1-b70a-da8874452355 req-752c6594-0737-4370-81d2-9dc825fd3f77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d03537cc-5960-46ea-ab2d-a1e3ef1092b0", "tag": "b78728ed-254d-48b9-b048-c151250650ac"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:09:34.981137 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-fe3ab872-953f-4be1-b70a-da8874452355 req-752c6594-0737-4370-81d2-9dc825fd3f77 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:09:34.981683 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-fe3ab872-953f-4be1-b70a-da8874452355 req-752c6594-0737-4370-81d2-9dc825fd3f77 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:09:34.982116 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-fe3ab872-953f-4be1-b70a-da8874452355 req-752c6594-0737-4370-81d2-9dc825fd3f77 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:09:34.996528 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-fe3ab872-953f-4be1-b70a-da8874452355 req-752c6594-0737-4370-81d2-9dc825fd3f77 service nova] Creating event network-changed:b78728ed-254d-48b9-b048-c151250650ac for instance d03537cc-5960-46ea-ab2d-a1e3ef1092b0 on n-h1-862686-1 Oct 26 14:09:35.002293 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-fe3ab872-953f-4be1-b70a-da8874452355 req-752c6594-0737-4370-81d2-9dc825fd3f77 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050074 Oct 26 14:09:35.003539 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3764/7551] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:09:35.987313 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-703ebd0c-8823-4449-9615-82606913b8c1 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1413135857"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:09:35.987850 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-703ebd0c-8823-4449-9615-82606913b8c1 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: d03537cc-5960-46ea-ab2d-a1e3ef1092b0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:09:35.994736 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-703ebd0c-8823-4449-9615-82606913b8c1 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:09:35.995241 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-703ebd0c-8823-4449-9615-82606913b8c1 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:09:35.995694 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-703ebd0c-8823-4449-9615-82606913b8c1 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:09:35.996416 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-703ebd0c-8823-4449-9615-82606913b8c1 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:09:35.996893 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-703ebd0c-8823-4449-9615-82606913b8c1 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:09:35.997340 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-703ebd0c-8823-4449-9615-82606913b8c1 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:09:36.159576 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.network.security_group_api [None req-703ebd0c-8823-4449-9615-82606913b8c1 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Adding security group 6b434943-f627-4208-81c0-98066924d6a7 to port b78728ed-254d-48b9-b048-c151250650ac Oct 26 14:09:36.483700 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-703ebd0c-8823-4449-9615-82606913b8c1 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "POST /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0/action" status: 202 len: 0 microversion: 2.1 time: 0.500228 Oct 26 14:09:36.484767 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3788/7552] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 14:09:35 2022] POST /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0/action => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 14:09:36.493547 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1133a606-fec1-4828-a9d8-ca2426ad6e3a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:09:36.494519 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1133a606-fec1-4828-a9d8-ca2426ad6e3a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: d03537cc-5960-46ea-ab2d-a1e3ef1092b0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:09:36.502309 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1133a606-fec1-4828-a9d8-ca2426ad6e3a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:09:36.503141 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1133a606-fec1-4828-a9d8-ca2426ad6e3a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:09:36.503710 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1133a606-fec1-4828-a9d8-ca2426ad6e3a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:09:36.504919 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1133a606-fec1-4828-a9d8-ca2426ad6e3a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:09:36.505568 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1133a606-fec1-4828-a9d8-ca2426ad6e3a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:09:36.506164 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1133a606-fec1-4828-a9d8-ca2426ad6e3a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:09:36.668967 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1133a606-fec1-4828-a9d8-ca2426ad6e3a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:09:36.677500 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1133a606-fec1-4828-a9d8-ca2426ad6e3a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0" status: 200 len: 1758 microversion: 2.1 time: 0.188507 Oct 26 14:09:36.678176 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3765/7553] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:09:36 2022] GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0 => generated 1758 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 14:09:37.019387 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-4bf15bee-f585-4ca6-ad16-68f79726aecc req-a0f7aa7e-c084-4fe6-8a3e-f039a549374d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d03537cc-5960-46ea-ab2d-a1e3ef1092b0", "tag": "b78728ed-254d-48b9-b048-c151250650ac"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:09:37.029793 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-4bf15bee-f585-4ca6-ad16-68f79726aecc req-a0f7aa7e-c084-4fe6-8a3e-f039a549374d service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:09:37.030292 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-4bf15bee-f585-4ca6-ad16-68f79726aecc req-a0f7aa7e-c084-4fe6-8a3e-f039a549374d service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:09:37.030758 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-4bf15bee-f585-4ca6-ad16-68f79726aecc req-a0f7aa7e-c084-4fe6-8a3e-f039a549374d service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:09:37.044509 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-4bf15bee-f585-4ca6-ad16-68f79726aecc req-a0f7aa7e-c084-4fe6-8a3e-f039a549374d service nova] Creating event network-changed:b78728ed-254d-48b9-b048-c151250650ac for instance d03537cc-5960-46ea-ab2d-a1e3ef1092b0 on n-h1-862686-1 Oct 26 14:09:37.050328 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-4bf15bee-f585-4ca6-ad16-68f79726aecc req-a0f7aa7e-c084-4fe6-8a3e-f039a549374d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035917 Oct 26 14:09:37.050985 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3789/7554] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:11:16.819794 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=4 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:11:16.820597 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=8 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:11:16.822670 n-d-862686-1 devstack@n-api.service[120597]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 26 14:11:16.822839 n-d-862686-1 devstack@n-api.service[120597]: Wed Oct 26 14:11:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0/action (ip 10.222.0.40) !!! Oct 26 14:11:16.828764 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-de84884e-8272-4b6f-9668-8e2b41fdd991 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:11:16.830972 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-de84884e-8272-4b6f-9668-8e2b41fdd991 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: d03537cc-5960-46ea-ab2d-a1e3ef1092b0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:11:16.841980 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-de84884e-8272-4b6f-9668-8e2b41fdd991 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:11:16.842502 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-de84884e-8272-4b6f-9668-8e2b41fdd991 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:11:16.842941 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-de84884e-8272-4b6f-9668-8e2b41fdd991 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:11:16.843641 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-de84884e-8272-4b6f-9668-8e2b41fdd991 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:11:16.844097 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-de84884e-8272-4b6f-9668-8e2b41fdd991 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:11:16.844525 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-de84884e-8272-4b6f-9668-8e2b41fdd991 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:11:16.918001 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-de84884e-8272-4b6f-9668-8e2b41fdd991 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "POST /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0/action" status: 202 len: 0 microversion: 2.1 time: 0.100088 Oct 26 14:11:16.918819 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3766/7555] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 14:11:16 2022] POST /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 14:11:16.926231 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:11:16.927127 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=12 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:11:16.928341 n-d-862686-1 devstack@n-api.service[120598]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 14:11:16.928551 n-d-862686-1 devstack@n-api.service[120598]: Wed Oct 26 14:11:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0 (ip 10.222.0.40) !!! Oct 26 14:11:16.937472 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2456adb7-8206-47f2-ac1b-dfa3e696835c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:11:16.938562 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2456adb7-8206-47f2-ac1b-dfa3e696835c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: d03537cc-5960-46ea-ab2d-a1e3ef1092b0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:11:16.950089 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2456adb7-8206-47f2-ac1b-dfa3e696835c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:11:16.950713 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2456adb7-8206-47f2-ac1b-dfa3e696835c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:11:16.951178 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2456adb7-8206-47f2-ac1b-dfa3e696835c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:11:16.952042 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2456adb7-8206-47f2-ac1b-dfa3e696835c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:11:16.952525 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2456adb7-8206-47f2-ac1b-dfa3e696835c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:11:16.952973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2456adb7-8206-47f2-ac1b-dfa3e696835c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:11:17.378523 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2456adb7-8206-47f2-ac1b-dfa3e696835c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:11:17.388010 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2456adb7-8206-47f2-ac1b-dfa3e696835c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0" status: 200 len: 1760 microversion: 2.1 time: 0.464909 Oct 26 14:11:17.388606 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3790/7556] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:11:16 2022] GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0 => generated 1760 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:11:18.413531 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1d55d9a7-feab-48e2-9e60-8bd6ab462fea tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:11:18.414238 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1d55d9a7-feab-48e2-9e60-8bd6ab462fea tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: d03537cc-5960-46ea-ab2d-a1e3ef1092b0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:11:18.421146 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d55d9a7-feab-48e2-9e60-8bd6ab462fea tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:11:18.421670 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d55d9a7-feab-48e2-9e60-8bd6ab462fea tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:11:18.422113 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d55d9a7-feab-48e2-9e60-8bd6ab462fea tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:11:18.422801 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d55d9a7-feab-48e2-9e60-8bd6ab462fea tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:11:18.423262 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d55d9a7-feab-48e2-9e60-8bd6ab462fea tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:11:18.423688 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d55d9a7-feab-48e2-9e60-8bd6ab462fea tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:11:18.637192 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1d55d9a7-feab-48e2-9e60-8bd6ab462fea tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:11:18.645412 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1d55d9a7-feab-48e2-9e60-8bd6ab462fea tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0" status: 200 len: 1758 microversion: 2.1 time: 0.238329 Oct 26 14:11:18.646007 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3767/7557] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:11:18 2022] GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0 => generated 1758 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 14:12:32.494879 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:12:32.495683 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:12:32.500159 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a1723e56-24f8-4f1e-b5e5-9323ca139d40 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1413135857"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:12:32.500881 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a1723e56-24f8-4f1e-b5e5-9323ca139d40 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: d03537cc-5960-46ea-ab2d-a1e3ef1092b0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:12:32.507544 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a1723e56-24f8-4f1e-b5e5-9323ca139d40 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:12:32.508044 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a1723e56-24f8-4f1e-b5e5-9323ca139d40 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:12:32.508494 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a1723e56-24f8-4f1e-b5e5-9323ca139d40 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:12:32.509204 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a1723e56-24f8-4f1e-b5e5-9323ca139d40 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:12:32.509720 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a1723e56-24f8-4f1e-b5e5-9323ca139d40 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:12:32.510171 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a1723e56-24f8-4f1e-b5e5-9323ca139d40 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:12:32.643595 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.network.security_group_api [None req-a1723e56-24f8-4f1e-b5e5-9323ca139d40 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Removing security group 6b434943-f627-4208-81c0-98066924d6a7 from port b78728ed-254d-48b9-b048-c151250650ac Oct 26 14:12:32.954367 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a1723e56-24f8-4f1e-b5e5-9323ca139d40 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "POST /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0/action" status: 202 len: 0 microversion: 2.1 time: 0.460269 Oct 26 14:12:32.958418 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3791/7558] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 14:12:32 2022] POST /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0/action => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 14:12:32.964324 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=4 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:12:32.965344 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:12:33.039276 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-9c709030-0809-4bd4-9c64-33d3b124d1f5 req-79999715-f8fa-424f-b55b-81856d1d7cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d03537cc-5960-46ea-ab2d-a1e3ef1092b0", "tag": "b78728ed-254d-48b9-b048-c151250650ac"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:12:33.060703 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9c709030-0809-4bd4-9c64-33d3b124d1f5 req-79999715-f8fa-424f-b55b-81856d1d7cc8 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:12:33.063674 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9c709030-0809-4bd4-9c64-33d3b124d1f5 req-79999715-f8fa-424f-b55b-81856d1d7cc8 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:12:33.063674 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9c709030-0809-4bd4-9c64-33d3b124d1f5 req-79999715-f8fa-424f-b55b-81856d1d7cc8 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:12:33.080176 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-9c709030-0809-4bd4-9c64-33d3b124d1f5 req-79999715-f8fa-424f-b55b-81856d1d7cc8 service nova] Creating event network-changed:b78728ed-254d-48b9-b048-c151250650ac for instance d03537cc-5960-46ea-ab2d-a1e3ef1092b0 on n-h1-862686-1 Oct 26 14:12:33.092381 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-9c709030-0809-4bd4-9c64-33d3b124d1f5 req-79999715-f8fa-424f-b55b-81856d1d7cc8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133884 Oct 26 14:12:33.093622 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3768/7559] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 14:12:34.293043 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b5195e3e-2167-4f51-bd18-2f73facd185a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:12:34.293647 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b5195e3e-2167-4f51-bd18-2f73facd185a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: d03537cc-5960-46ea-ab2d-a1e3ef1092b0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:12:34.301522 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b5195e3e-2167-4f51-bd18-2f73facd185a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:12:34.302131 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b5195e3e-2167-4f51-bd18-2f73facd185a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:12:34.302570 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b5195e3e-2167-4f51-bd18-2f73facd185a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:12:34.303271 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b5195e3e-2167-4f51-bd18-2f73facd185a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:12:34.303727 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b5195e3e-2167-4f51-bd18-2f73facd185a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:12:34.305081 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b5195e3e-2167-4f51-bd18-2f73facd185a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:12:34.313576 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-e115fd91-54d5-41b9-9aed-97e529696a0a req-05b9c79f-3616-4e92-8464-8e1d722ced5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d03537cc-5960-46ea-ab2d-a1e3ef1092b0", "tag": "b78728ed-254d-48b9-b048-c151250650ac"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:12:34.329975 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e115fd91-54d5-41b9-9aed-97e529696a0a req-05b9c79f-3616-4e92-8464-8e1d722ced5e service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:12:34.331456 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e115fd91-54d5-41b9-9aed-97e529696a0a req-05b9c79f-3616-4e92-8464-8e1d722ced5e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:12:34.332115 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e115fd91-54d5-41b9-9aed-97e529696a0a req-05b9c79f-3616-4e92-8464-8e1d722ced5e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:12:34.356068 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-e115fd91-54d5-41b9-9aed-97e529696a0a req-05b9c79f-3616-4e92-8464-8e1d722ced5e service nova] Creating event network-changed:b78728ed-254d-48b9-b048-c151250650ac for instance d03537cc-5960-46ea-ab2d-a1e3ef1092b0 on n-h1-862686-1 Oct 26 14:12:34.360475 n-d-862686-1 devstack@n-api.service[120598]: ERROR oslo.messaging._drivers.impl_rabbit [req-e115fd91-54d5-41b9-9aed-97e529696a0a req-05b9c79f-3616-4e92-8464-8e1d722ced5e service nova] [772d4b27-d35f-4ae6-924a-6ffe7b858711] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 26 14:12:34.405186 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-b5195e3e-2167-4f51-bd18-2f73facd185a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lazy-loading 'services' on Instance uuid d03537cc-5960-46ea-ab2d-a1e3ef1092b0 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 14:12:34.488112 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b5195e3e-2167-4f51-bd18-2f73facd185a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0/os-volume_attachments/6f5ea582-591d-4489-b85d-abd1d9bc3472" status: 202 len: 0 microversion: 2.1 time: 0.199048 Oct 26 14:12:34.488724 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3769/7560] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Oct 26 14:12:34 2022] DELETE /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0/os-volume_attachments/6f5ea582-591d-4489-b85d-abd1d9bc3472 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 14:12:34.497973 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1deeccb3-6d52-4db9-a08d-608cf53372e1 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:12:34.501135 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1deeccb3-6d52-4db9-a08d-608cf53372e1 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: d03537cc-5960-46ea-ab2d-a1e3ef1092b0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:12:34.507998 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1deeccb3-6d52-4db9-a08d-608cf53372e1 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:12:34.508491 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1deeccb3-6d52-4db9-a08d-608cf53372e1 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:12:34.508931 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1deeccb3-6d52-4db9-a08d-608cf53372e1 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:12:34.509765 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1deeccb3-6d52-4db9-a08d-608cf53372e1 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:12:34.510223 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1deeccb3-6d52-4db9-a08d-608cf53372e1 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:12:34.510852 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1deeccb3-6d52-4db9-a08d-608cf53372e1 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:12:34.546305 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1deeccb3-6d52-4db9-a08d-608cf53372e1 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052747 Oct 26 14:12:34.547618 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3770/7561] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 14:12:34 2022] GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 14:12:35.370800 n-d-862686-1 devstack@n-api.service[120598]: INFO oslo.messaging._drivers.impl_rabbit [req-e115fd91-54d5-41b9-9aed-97e529696a0a req-05b9c79f-3616-4e92-8464-8e1d722ced5e service nova] [772d4b27-d35f-4ae6-924a-6ffe7b858711] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 36406. Oct 26 14:12:35.374604 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-e115fd91-54d5-41b9-9aed-97e529696a0a req-05b9c79f-3616-4e92-8464-8e1d722ced5e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.137546 Oct 26 14:12:35.376085 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3792/7562] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:12:35.560510 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4777878e-5ed8-403a-b9af-57f8041db81a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:12:35.563438 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4777878e-5ed8-403a-b9af-57f8041db81a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: d03537cc-5960-46ea-ab2d-a1e3ef1092b0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:12:35.570516 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4777878e-5ed8-403a-b9af-57f8041db81a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:12:35.571006 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4777878e-5ed8-403a-b9af-57f8041db81a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:12:35.571472 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4777878e-5ed8-403a-b9af-57f8041db81a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:12:35.572378 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4777878e-5ed8-403a-b9af-57f8041db81a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:12:35.572840 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4777878e-5ed8-403a-b9af-57f8041db81a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:12:35.573272 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4777878e-5ed8-403a-b9af-57f8041db81a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:12:35.604411 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4777878e-5ed8-403a-b9af-57f8041db81a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047956 Oct 26 14:12:35.604993 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3771/7563] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 14:12:35 2022] GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:12:36.618798 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6c6063ae-0412-4ecd-a6c3-58d9ff48e945 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:12:36.621038 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6c6063ae-0412-4ecd-a6c3-58d9ff48e945 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: d03537cc-5960-46ea-ab2d-a1e3ef1092b0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:12:36.628645 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c6063ae-0412-4ecd-a6c3-58d9ff48e945 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:12:36.629136 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c6063ae-0412-4ecd-a6c3-58d9ff48e945 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:12:36.629609 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c6063ae-0412-4ecd-a6c3-58d9ff48e945 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:12:36.630317 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c6063ae-0412-4ecd-a6c3-58d9ff48e945 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:12:36.630839 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c6063ae-0412-4ecd-a6c3-58d9ff48e945 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:12:36.631287 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c6063ae-0412-4ecd-a6c3-58d9ff48e945 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:12:36.664717 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6c6063ae-0412-4ecd-a6c3-58d9ff48e945 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051190 Oct 26 14:12:36.665308 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3793/7564] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 14:12:36 2022] GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:12:37.677035 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e3fbf16a-df48-4386-bdb6-7a6703b6abbd tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:12:37.679304 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e3fbf16a-df48-4386-bdb6-7a6703b6abbd tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: d03537cc-5960-46ea-ab2d-a1e3ef1092b0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:12:37.686333 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3fbf16a-df48-4386-bdb6-7a6703b6abbd tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:12:37.686824 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3fbf16a-df48-4386-bdb6-7a6703b6abbd tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:12:37.687955 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3fbf16a-df48-4386-bdb6-7a6703b6abbd tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:12:37.688661 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3fbf16a-df48-4386-bdb6-7a6703b6abbd tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:12:37.689146 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3fbf16a-df48-4386-bdb6-7a6703b6abbd tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:12:37.689797 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3fbf16a-df48-4386-bdb6-7a6703b6abbd tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:12:37.719005 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e3fbf16a-df48-4386-bdb6-7a6703b6abbd tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045919 Oct 26 14:12:37.719571 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3772/7565] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 14:12:37 2022] GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:12:38.731631 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e9861b32-f80a-4cd4-bbcb-84c25f8122bc tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:12:38.733874 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e9861b32-f80a-4cd4-bbcb-84c25f8122bc tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: d03537cc-5960-46ea-ab2d-a1e3ef1092b0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:12:38.741606 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e9861b32-f80a-4cd4-bbcb-84c25f8122bc tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:12:38.742106 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e9861b32-f80a-4cd4-bbcb-84c25f8122bc tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:12:38.742555 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e9861b32-f80a-4cd4-bbcb-84c25f8122bc tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:12:38.743256 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e9861b32-f80a-4cd4-bbcb-84c25f8122bc tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:12:38.743719 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e9861b32-f80a-4cd4-bbcb-84c25f8122bc tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:12:38.744156 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e9861b32-f80a-4cd4-bbcb-84c25f8122bc tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:12:38.772814 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e9861b32-f80a-4cd4-bbcb-84c25f8122bc tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045204 Oct 26 14:12:38.773377 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3794/7566] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 14:12:38 2022] GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:12:39.787926 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7eea07c0-47aa-43b1-85bc-9807c1c21321 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:12:39.790152 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7eea07c0-47aa-43b1-85bc-9807c1c21321 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: d03537cc-5960-46ea-ab2d-a1e3ef1092b0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:12:39.798063 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7eea07c0-47aa-43b1-85bc-9807c1c21321 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:12:39.798551 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7eea07c0-47aa-43b1-85bc-9807c1c21321 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:12:39.798986 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7eea07c0-47aa-43b1-85bc-9807c1c21321 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:12:39.799674 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7eea07c0-47aa-43b1-85bc-9807c1c21321 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:12:39.800126 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7eea07c0-47aa-43b1-85bc-9807c1c21321 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:12:39.800549 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7eea07c0-47aa-43b1-85bc-9807c1c21321 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:12:39.829793 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7eea07c0-47aa-43b1-85bc-9807c1c21321 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046130 Oct 26 14:12:39.830344 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3773/7567] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 14:12:39 2022] GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 14:12:39.841090 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-20811f63-e316-4441-a76a-2adcd3fe038c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:12:39.841637 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-20811f63-e316-4441-a76a-2adcd3fe038c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: d03537cc-5960-46ea-ab2d-a1e3ef1092b0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:12:39.849373 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-20811f63-e316-4441-a76a-2adcd3fe038c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:12:39.849905 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-20811f63-e316-4441-a76a-2adcd3fe038c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:12:39.850656 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-20811f63-e316-4441-a76a-2adcd3fe038c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:12:39.851393 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-20811f63-e316-4441-a76a-2adcd3fe038c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:12:39.851861 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-20811f63-e316-4441-a76a-2adcd3fe038c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:12:39.852328 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-20811f63-e316-4441-a76a-2adcd3fe038c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:12:39.927869 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-20811f63-e316-4441-a76a-2adcd3fe038c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] HTTP exception thrown: Instance d03537cc-5960-46ea-ab2d-a1e3ef1092b0 is not attached to volume 6f5ea582-591d-4489-b85d-abd1d9bc3472 Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-20811f63-e316-4441-a76a-2adcd3fe038c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Request method failure captured: Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: request: DELETE /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0/os-volume_attachments/6f5ea582-591d-4489-b85d-abd1d9bc3472 HTTP/1.1 Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWT9smXbEsRyP43Tg1cfL9l_R_8Yre990l1kmtlC0si1BTz0nBwxXODXkeIghnmCg3dlmpSn27i5nTIgFP_uBW9U916Qe1L5i4pJL8Y0hUkLQheLuKmeZ5TXyUQNYWwGUCuqWdTJSZbmeXKQCDZGPQqWB2xh59denLPA0MEu1rD_97Rg Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 480d8bdd36324b4ebc2b3cd7953fabe7 Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-TestMinimumBasicScenario-415447413 Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/480d8bdd36324b4ebc2b3cd7953fabe7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/480d8bdd36324b4ebc2b3cd7953fabe7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_480d8bdd36324b4ebc2b3cd7953fabe7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/480d8bdd36324b4ebc2b3cd7953fabe7"}]}] Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-TestMinimumBasicScenario-415447413 Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 480d8bdd36324b4ebc2b3cd7953fabe7 Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-TestMinimumBasicScenario-415447413 Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-TestMinimumBasicScenario-415447413-project Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 8238828b171840e389ab38164aef51a7 Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-TestMinimumBasicScenario-415447413-project Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance d03537cc-5960-46ea-ab2d-a1e3ef1092b0 is not attached to volume 6f5ea582-591d-4489-b85d-abd1d9bc3472 Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'server_id': 'd03537cc-5960-46ea-ab2d-a1e3ef1092b0', 'id': '6f5ea582-591d-4489-b85d-abd1d9bc3472'} Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6f5ea582-591d-4489-b85d-abd1d9bc3472. Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d03537cc-5960-46ea-ab2d-a1e3ef1092b0 is not attached to volume 6f5ea582-591d-4489-b85d-abd1d9bc3472 Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:12:39.929521 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:12:39.933896 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 14:12:39.933896 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 14:12:39.933896 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d03537cc-5960-46ea-ab2d-a1e3ef1092b0 is not attached to volume 6f5ea582-591d-4489-b85d-abd1d9bc3472 Oct 26 14:12:39.933896 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:12:39.933896 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-20811f63-e316-4441-a76a-2adcd3fe038c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Returning 404 to user: Instance d03537cc-5960-46ea-ab2d-a1e3ef1092b0 is not attached to volume 6f5ea582-591d-4489-b85d-abd1d9bc3472 {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 14:12:39.933896 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-20811f63-e316-4441-a76a-2adcd3fe038c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0/os-volume_attachments/6f5ea582-591d-4489-b85d-abd1d9bc3472" status: 404 len: 154 microversion: 2.1 time: 0.093941 Oct 26 14:12:39.933896 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3795/7568] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Oct 26 14:12:39 2022] DELETE /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0/os-volume_attachments/6f5ea582-591d-4489-b85d-abd1d9bc3472 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 14:12:43.180483 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-51eee663-9f12-489b-9667-94efd8e177d9 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:12:43.181021 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-51eee663-9f12-489b-9667-94efd8e177d9 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: d03537cc-5960-46ea-ab2d-a1e3ef1092b0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:12:43.188247 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-51eee663-9f12-489b-9667-94efd8e177d9 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:12:43.188736 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-51eee663-9f12-489b-9667-94efd8e177d9 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:12:43.189181 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-51eee663-9f12-489b-9667-94efd8e177d9 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:12:43.189906 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-51eee663-9f12-489b-9667-94efd8e177d9 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:12:43.190369 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-51eee663-9f12-489b-9667-94efd8e177d9 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:12:43.190802 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-51eee663-9f12-489b-9667-94efd8e177d9 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:12:43.215693 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-51eee663-9f12-489b-9667-94efd8e177d9 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: d03537cc-5960-46ea-ab2d-a1e3ef1092b0] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 14:12:43.298905 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-51eee663-9f12-489b-9667-94efd8e177d9 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0" status: 204 len: 0 microversion: 2.1 time: 0.122009 Oct 26 14:12:43.300013 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3774/7569] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 14:12:43 2022] DELETE /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 14:12:43.309276 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ff233fdc-e60f-4a16-a048-49773b078ef7 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:12:43.309982 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ff233fdc-e60f-4a16-a048-49773b078ef7 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: d03537cc-5960-46ea-ab2d-a1e3ef1092b0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:12:43.319081 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ff233fdc-e60f-4a16-a048-49773b078ef7 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:12:43.319709 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ff233fdc-e60f-4a16-a048-49773b078ef7 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:12:43.320165 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ff233fdc-e60f-4a16-a048-49773b078ef7 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:12:43.320891 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ff233fdc-e60f-4a16-a048-49773b078ef7 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:12:43.321394 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ff233fdc-e60f-4a16-a048-49773b078ef7 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:12:43.322097 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ff233fdc-e60f-4a16-a048-49773b078ef7 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:12:43.458207 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ff233fdc-e60f-4a16-a048-49773b078ef7 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:12:43.466171 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ff233fdc-e60f-4a16-a048-49773b078ef7 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0" status: 200 len: 1553 microversion: 2.1 time: 0.161660 Oct 26 14:12:43.466849 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3796/7570] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:12:43 2022] GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0 => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:12:44.491448 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-722aa59d-c541-4840-b0e6-5e956a6bca8b tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:12:44.492075 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-722aa59d-c541-4840-b0e6-5e956a6bca8b tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: d03537cc-5960-46ea-ab2d-a1e3ef1092b0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:12:44.502527 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-722aa59d-c541-4840-b0e6-5e956a6bca8b tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:12:44.503019 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-722aa59d-c541-4840-b0e6-5e956a6bca8b tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:12:44.503464 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-722aa59d-c541-4840-b0e6-5e956a6bca8b tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:12:44.504164 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-722aa59d-c541-4840-b0e6-5e956a6bca8b tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:12:44.504626 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-722aa59d-c541-4840-b0e6-5e956a6bca8b tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:12:44.505082 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-722aa59d-c541-4840-b0e6-5e956a6bca8b tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:12:44.633862 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-722aa59d-c541-4840-b0e6-5e956a6bca8b tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:12:44.641852 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-722aa59d-c541-4840-b0e6-5e956a6bca8b tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0" status: 200 len: 1553 microversion: 2.1 time: 0.154733 Oct 26 14:12:44.642428 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3775/7571] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:12:44 2022] GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0 => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 14:12:45.582806 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-303f1257-4bec-4ebc-8e15-57beee2a2c82 req-d348b375-7a8c-4739-b23d-0bb7802f8516 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d03537cc-5960-46ea-ab2d-a1e3ef1092b0", "name": "network-vif-deleted", "tag": "b78728ed-254d-48b9-b048-c151250650ac"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:12:45.596216 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-303f1257-4bec-4ebc-8e15-57beee2a2c82 req-d348b375-7a8c-4739-b23d-0bb7802f8516 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:12:45.596982 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-303f1257-4bec-4ebc-8e15-57beee2a2c82 req-d348b375-7a8c-4739-b23d-0bb7802f8516 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:12:45.598240 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-303f1257-4bec-4ebc-8e15-57beee2a2c82 req-d348b375-7a8c-4739-b23d-0bb7802f8516 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:12:45.612698 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-303f1257-4bec-4ebc-8e15-57beee2a2c82 req-d348b375-7a8c-4739-b23d-0bb7802f8516 service nova] Creating event network-vif-deleted:b78728ed-254d-48b9-b048-c151250650ac for instance d03537cc-5960-46ea-ab2d-a1e3ef1092b0 on n-h1-862686-1 Oct 26 14:12:45.618179 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-303f1257-4bec-4ebc-8e15-57beee2a2c82 req-d348b375-7a8c-4739-b23d-0bb7802f8516 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040503 Oct 26 14:12:45.618883 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3797/7572] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:12:45.665568 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d75986bf-e7fe-40e5-ad38-1c47bfe362d5 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:12:45.666183 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d75986bf-e7fe-40e5-ad38-1c47bfe362d5 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: d03537cc-5960-46ea-ab2d-a1e3ef1092b0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:12:45.674730 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d75986bf-e7fe-40e5-ad38-1c47bfe362d5 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:12:45.675603 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d75986bf-e7fe-40e5-ad38-1c47bfe362d5 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:12:45.676226 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d75986bf-e7fe-40e5-ad38-1c47bfe362d5 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:12:45.676941 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d75986bf-e7fe-40e5-ad38-1c47bfe362d5 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:12:45.677502 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d75986bf-e7fe-40e5-ad38-1c47bfe362d5 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:12:45.677978 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d75986bf-e7fe-40e5-ad38-1c47bfe362d5 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:12:45.715299 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d75986bf-e7fe-40e5-ad38-1c47bfe362d5 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:12:45.716010 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d75986bf-e7fe-40e5-ad38-1c47bfe362d5 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:12:45.716561 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d75986bf-e7fe-40e5-ad38-1c47bfe362d5 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:12:45.717022 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-d75986bf-e7fe-40e5-ad38-1c47bfe362d5 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lazy-loading 'fault' on Instance uuid d03537cc-5960-46ea-ab2d-a1e3ef1092b0 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 14:12:45.765161 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d75986bf-e7fe-40e5-ad38-1c47bfe362d5 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:12:45.774029 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d75986bf-e7fe-40e5-ad38-1c47bfe362d5 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0" status: 200 len: 1348 microversion: 2.1 time: 0.113340 Oct 26 14:12:45.774821 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3776/7573] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:12:45 2022] GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0 => generated 1348 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:12:46.800288 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cc739e60-260e-442b-8b37-4bf1e25b9df3 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:12:46.801024 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cc739e60-260e-442b-8b37-4bf1e25b9df3 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: d03537cc-5960-46ea-ab2d-a1e3ef1092b0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:12:46.807140 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cc739e60-260e-442b-8b37-4bf1e25b9df3 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:12:46.807627 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cc739e60-260e-442b-8b37-4bf1e25b9df3 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:12:46.808070 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cc739e60-260e-442b-8b37-4bf1e25b9df3 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:12:46.808753 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cc739e60-260e-442b-8b37-4bf1e25b9df3 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:12:46.809222 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cc739e60-260e-442b-8b37-4bf1e25b9df3 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:12:46.809681 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cc739e60-260e-442b-8b37-4bf1e25b9df3 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:12:46.823732 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-cc739e60-260e-442b-8b37-4bf1e25b9df3 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] HTTP exception thrown: Instance d03537cc-5960-46ea-ab2d-a1e3ef1092b0 could not be found. Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cc739e60-260e-442b-8b37-4bf1e25b9df3 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Request method failure captured: Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0 HTTP/1.1 Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWT9smXbEsRyP43Tg1cfL9l_R_8Yre990l1kmtlC0si1BTz0nBwxXODXkeIghnmCg3dlmpSn27i5nTIgFP_uBW9U916Qe1L5i4pJL8Y0hUkLQheLuKmeZ5TXyUQNYWwGUCuqWdTJSZbmeXKQCDZGPQqWB2xh59denLPA0MEu1rD_97Rg Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 480d8bdd36324b4ebc2b3cd7953fabe7 Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-TestMinimumBasicScenario-415447413 Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/480d8bdd36324b4ebc2b3cd7953fabe7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/480d8bdd36324b4ebc2b3cd7953fabe7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_480d8bdd36324b4ebc2b3cd7953fabe7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/480d8bdd36324b4ebc2b3cd7953fabe7"}]}] Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-TestMinimumBasicScenario-415447413 Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 480d8bdd36324b4ebc2b3cd7953fabe7 Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-TestMinimumBasicScenario-415447413 Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-TestMinimumBasicScenario-415447413-project Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 8238828b171840e389ab38164aef51a7 Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-TestMinimumBasicScenario-415447413-project Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance d03537cc-5960-46ea-ab2d-a1e3ef1092b0 could not be found. Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'd03537cc-5960-46ea-ab2d-a1e3ef1092b0'} Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d03537cc-5960-46ea-ab2d-a1e3ef1092b0 could not be found. Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d03537cc-5960-46ea-ab2d-a1e3ef1092b0 could not be found. Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:12:46.825337 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:12:46.830678 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:12:46.830678 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:12:46.830678 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:12:46.830678 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 14:12:46.830678 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 14:12:46.830678 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d03537cc-5960-46ea-ab2d-a1e3ef1092b0 could not be found. Oct 26 14:12:46.830678 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:12:46.830678 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cc739e60-260e-442b-8b37-4bf1e25b9df3 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Returning 404 to user: Instance d03537cc-5960-46ea-ab2d-a1e3ef1092b0 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 14:12:46.830678 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cc739e60-260e-442b-8b37-4bf1e25b9df3 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0" status: 404 len: 111 microversion: 2.1 time: 0.032575 Oct 26 14:12:46.830678 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3798/7574] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:12:46 2022] GET /compute/v2.1/servers/d03537cc-5960-46ea-ab2d-a1e3ef1092b0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 14:12:46.835606 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f586aa2c-027b-4d87-87a0-181e65da5f3c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '.version_select at 0x7f6732264a60>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:12:46.860266 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f586aa2c-027b-4d87-87a0-181e65da5f3c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2034763849" status: 202 len: 0 microversion: 2.1 time: 0.028327 Oct 26 14:12:46.861093 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3777/7575] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 26 14:12:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2034763849 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 14:12:55.923305 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fb620894-cbd1-4b07-a0f7-4ee3772c6005 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Action: 'create', calling method: .version_select at 0x7f6731091820>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1730186299", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPj/4Foukc6mwcFyjVqwn5lsoSW1chdrYmbbzL74wjPDptE6GWq/iTGxBEdJ+6womLgvQ48q64pQKQLcLyJbw1HSkUK5/PUnOXbkmlpzMKN/nvKdE1cyUz7N27C4xAFt0A=="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:12:55.939278 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-fb620894-cbd1-4b07-a0f7-4ee3772c6005 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Getting quotas for project 480d8bdd36324b4ebc2b3cd7953fabe7. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 14:12:55.944333 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-fb620894-cbd1-4b07-a0f7-4ee3772c6005 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Getting quotas for user 8238828b171840e389ab38164aef51a7 and project 480d8bdd36324b4ebc2b3cd7953fabe7. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 14:12:55.957225 n-d-862686-1 devstack@n-api.service[120598]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fb620894-cbd1-4b07-a0f7-4ee3772c6005 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [0362c2d3-00d1-4a1b-ad97-c2830bfc3f47] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 26 14:12:56.816016 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=34 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:12:56.963162 n-d-862686-1 devstack@n-api.service[120598]: INFO oslo.messaging._drivers.impl_rabbit [None req-fb620894-cbd1-4b07-a0f7-4ee3772c6005 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [0362c2d3-00d1-4a1b-ad97-c2830bfc3f47] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 36536. Oct 26 14:12:56.977365 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fb620894-cbd1-4b07-a0f7-4ee3772c6005 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 1.058842 Oct 26 14:12:56.978045 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3799/7576] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 14:12:55 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:12:57.028613 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ff162b5d-d78d-4fdc-99b5-fde5507eec20 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1370258346", "imageRef": "07a54dbc-a8de-4e3f-8f01-ca2a84a97f36", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1730186299", "networks": [{"uuid": "aa7c6fba-43af-4a48-8015-74df55f672ac"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:12:57.038765 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=63,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:12:57.039731 n-d-862686-1 devstack@n-api.service[120597]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 14:12:57.039884 n-d-862686-1 devstack@n-api.service[120597]: Wed Oct 26 14:12:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.40) !!! Oct 26 14:12:57.041071 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:12:57.088223 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-ff162b5d-d78d-4fdc-99b5-fde5507eec20 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] validate_networks() for [('aa7c6fba-43af-4a48-8015-74df55f672ac', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 14:12:57.523990 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-ff162b5d-d78d-4fdc-99b5-fde5507eec20 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 14:12:57.524407 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-ff162b5d-d78d-4fdc-99b5-fde5507eec20 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 14:12:57.524871 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-ff162b5d-d78d-4fdc-99b5-fde5507eec20 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 14:12:57.525270 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-ff162b5d-d78d-4fdc-99b5-fde5507eec20 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 14:12:57.525711 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-ff162b5d-d78d-4fdc-99b5-fde5507eec20 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 14:12:57.534643 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff162b5d-d78d-4fdc-99b5-fde5507eec20 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:12:57.535120 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff162b5d-d78d-4fdc-99b5-fde5507eec20 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:12:57.535549 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff162b5d-d78d-4fdc-99b5-fde5507eec20 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:12:57.536265 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff162b5d-d78d-4fdc-99b5-fde5507eec20 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:12:57.536968 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff162b5d-d78d-4fdc-99b5-fde5507eec20 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:12:57.537391 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff162b5d-d78d-4fdc-99b5-fde5507eec20 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:12:57.556014 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-ff162b5d-d78d-4fdc-99b5-fde5507eec20 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Getting quotas for project 480d8bdd36324b4ebc2b3cd7953fabe7. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 14:12:57.561731 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-ff162b5d-d78d-4fdc-99b5-fde5507eec20 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Getting quotas for user 8238828b171840e389ab38164aef51a7 and project 480d8bdd36324b4ebc2b3cd7953fabe7. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 14:12:57.574767 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ff162b5d-d78d-4fdc-99b5-fde5507eec20 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 14:12:57.577117 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ff162b5d-d78d-4fdc-99b5-fde5507eec20 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='07a54dbc-a8de-4e3f-8f01-ca2a84a97f36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 14:12:57.623460 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ff162b5d-d78d-4fdc-99b5-fde5507eec20 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.598799 Oct 26 14:12:57.625108 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3778/7577] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 14:12:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 14:12:57.636163 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-dfa24705-7dfb-4ed6-bec8-edb5367776b5 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:12:57.636879 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-dfa24705-7dfb-4ed6-bec8-edb5367776b5 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:12:57.698384 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-dfa24705-7dfb-4ed6-bec8-edb5367776b5 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:12:57.705579 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-dfa24705-7dfb-4ed6-bec8-edb5367776b5 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b" status: 200 len: 1259 microversion: 2.1 time: 0.073440 Oct 26 14:12:57.719004 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3800/7578] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:12:57 2022] GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b => generated 1259 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:12:58.729087 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-92a66a2c-01e7-41fb-b3a8-5230aaa3d849 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:12:58.729660 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-92a66a2c-01e7-41fb-b3a8-5230aaa3d849 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:12:58.736327 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-92a66a2c-01e7-41fb-b3a8-5230aaa3d849 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:12:58.736816 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-92a66a2c-01e7-41fb-b3a8-5230aaa3d849 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:12:58.737261 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-92a66a2c-01e7-41fb-b3a8-5230aaa3d849 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:12:58.737986 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-92a66a2c-01e7-41fb-b3a8-5230aaa3d849 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:12:58.738447 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-92a66a2c-01e7-41fb-b3a8-5230aaa3d849 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:12:58.738873 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-92a66a2c-01e7-41fb-b3a8-5230aaa3d849 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:12:58.806699 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-92a66a2c-01e7-41fb-b3a8-5230aaa3d849 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:12:58.816142 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-92a66a2c-01e7-41fb-b3a8-5230aaa3d849 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b" status: 200 len: 1311 microversion: 2.1 time: 0.091798 Oct 26 14:12:58.817587 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3779/7579] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:12:58 2022] GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b => generated 1311 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:12:59.841809 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1f82755f-e407-434e-a2ee-26c6474cbdd0 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:12:59.844287 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1f82755f-e407-434e-a2ee-26c6474cbdd0 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:12:59.853123 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f82755f-e407-434e-a2ee-26c6474cbdd0 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:12:59.853941 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f82755f-e407-434e-a2ee-26c6474cbdd0 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:12:59.854565 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f82755f-e407-434e-a2ee-26c6474cbdd0 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:12:59.861550 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f82755f-e407-434e-a2ee-26c6474cbdd0 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:12:59.862320 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f82755f-e407-434e-a2ee-26c6474cbdd0 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:12:59.863125 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f82755f-e407-434e-a2ee-26c6474cbdd0 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:00.043605 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1f82755f-e407-434e-a2ee-26c6474cbdd0 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:13:00.053719 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1f82755f-e407-434e-a2ee-26c6474cbdd0 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b" status: 200 len: 1359 microversion: 2.1 time: 0.216532 Oct 26 14:13:00.054594 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3801/7580] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:12:59 2022] GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b => generated 1359 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:13:01.078913 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-73cf667d-805c-4577-b23f-ef9981e64a8c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:13:01.080417 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-73cf667d-805c-4577-b23f-ef9981e64a8c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:13:01.099076 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73cf667d-805c-4577-b23f-ef9981e64a8c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:01.099076 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73cf667d-805c-4577-b23f-ef9981e64a8c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:01.099076 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73cf667d-805c-4577-b23f-ef9981e64a8c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:01.099076 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73cf667d-805c-4577-b23f-ef9981e64a8c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:01.099076 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73cf667d-805c-4577-b23f-ef9981e64a8c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:01.099076 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73cf667d-805c-4577-b23f-ef9981e64a8c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:01.235137 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-73cf667d-805c-4577-b23f-ef9981e64a8c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:13:01.243172 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-73cf667d-805c-4577-b23f-ef9981e64a8c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b" status: 200 len: 1359 microversion: 2.1 time: 0.169081 Oct 26 14:13:01.243761 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3780/7581] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:13:01 2022] GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:13:02.267257 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-59dedbc4-76cc-4a6b-a7ce-bbf13b04b00c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:13:02.268065 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-59dedbc4-76cc-4a6b-a7ce-bbf13b04b00c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:13:02.274985 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-59dedbc4-76cc-4a6b-a7ce-bbf13b04b00c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:02.275491 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-59dedbc4-76cc-4a6b-a7ce-bbf13b04b00c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:02.275946 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-59dedbc4-76cc-4a6b-a7ce-bbf13b04b00c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:02.276675 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-59dedbc4-76cc-4a6b-a7ce-bbf13b04b00c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:02.277175 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-59dedbc4-76cc-4a6b-a7ce-bbf13b04b00c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:02.277613 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-59dedbc4-76cc-4a6b-a7ce-bbf13b04b00c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:02.425377 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-59dedbc4-76cc-4a6b-a7ce-bbf13b04b00c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:13:02.433388 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-59dedbc4-76cc-4a6b-a7ce-bbf13b04b00c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b" status: 200 len: 1359 microversion: 2.1 time: 0.170420 Oct 26 14:13:02.434053 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3802/7582] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:13:02 2022] GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:13:03.458591 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0d733e89-2665-4b8c-9346-988d3706309d tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:13:03.460844 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0d733e89-2665-4b8c-9346-988d3706309d tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:13:03.470388 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0d733e89-2665-4b8c-9346-988d3706309d tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:03.470964 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0d733e89-2665-4b8c-9346-988d3706309d tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:03.471483 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0d733e89-2665-4b8c-9346-988d3706309d tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:03.472288 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0d733e89-2665-4b8c-9346-988d3706309d tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:03.472828 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0d733e89-2665-4b8c-9346-988d3706309d tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:03.473421 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0d733e89-2665-4b8c-9346-988d3706309d tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:03.623879 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0d733e89-2665-4b8c-9346-988d3706309d tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:13:03.632053 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0d733e89-2665-4b8c-9346-988d3706309d tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b" status: 200 len: 1359 microversion: 2.1 time: 0.178626 Oct 26 14:13:03.632627 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3781/7583] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:13:03 2022] GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:13:04.656187 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1f75d1d8-1786-4e3f-b9b4-610aa7a26ac9 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:13:04.656834 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1f75d1d8-1786-4e3f-b9b4-610aa7a26ac9 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:13:04.659510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:13:04.665080 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f75d1d8-1786-4e3f-b9b4-610aa7a26ac9 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:04.665606 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f75d1d8-1786-4e3f-b9b4-610aa7a26ac9 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:04.666055 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f75d1d8-1786-4e3f-b9b4-610aa7a26ac9 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:04.666758 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f75d1d8-1786-4e3f-b9b4-610aa7a26ac9 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:04.667222 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f75d1d8-1786-4e3f-b9b4-610aa7a26ac9 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:04.667662 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f75d1d8-1786-4e3f-b9b4-610aa7a26ac9 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:04.816382 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1f75d1d8-1786-4e3f-b9b4-610aa7a26ac9 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:13:04.825715 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1f75d1d8-1786-4e3f-b9b4-610aa7a26ac9 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b" status: 200 len: 1359 microversion: 2.1 time: 0.173753 Oct 26 14:13:04.826717 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3803/7584] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:13:04 2022] GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:13:05.849946 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4735435a-3eb6-4d5f-9031-56597122ba4b tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:13:05.850558 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4735435a-3eb6-4d5f-9031-56597122ba4b tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:13:05.857295 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4735435a-3eb6-4d5f-9031-56597122ba4b tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:05.857812 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4735435a-3eb6-4d5f-9031-56597122ba4b tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:05.858252 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4735435a-3eb6-4d5f-9031-56597122ba4b tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:05.860131 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4735435a-3eb6-4d5f-9031-56597122ba4b tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:05.860591 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4735435a-3eb6-4d5f-9031-56597122ba4b tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:05.861031 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4735435a-3eb6-4d5f-9031-56597122ba4b tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:06.000701 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4735435a-3eb6-4d5f-9031-56597122ba4b tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:13:06.008471 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4735435a-3eb6-4d5f-9031-56597122ba4b tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b" status: 200 len: 1359 microversion: 2.1 time: 0.162390 Oct 26 14:13:06.009051 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3782/7585] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:13:05 2022] GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:13:07.032759 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-74c0788e-c8f4-4a94-9a00-2916e5d58242 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:13:07.033386 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-74c0788e-c8f4-4a94-9a00-2916e5d58242 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:13:07.040554 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74c0788e-c8f4-4a94-9a00-2916e5d58242 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:07.041052 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74c0788e-c8f4-4a94-9a00-2916e5d58242 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:07.041565 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74c0788e-c8f4-4a94-9a00-2916e5d58242 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:07.042500 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74c0788e-c8f4-4a94-9a00-2916e5d58242 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:07.042985 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74c0788e-c8f4-4a94-9a00-2916e5d58242 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:07.043427 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74c0788e-c8f4-4a94-9a00-2916e5d58242 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:07.174499 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-74c0788e-c8f4-4a94-9a00-2916e5d58242 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:13:07.182107 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-74c0788e-c8f4-4a94-9a00-2916e5d58242 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b" status: 200 len: 1359 microversion: 2.1 time: 0.153849 Oct 26 14:13:07.182682 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3804/7586] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:13:07 2022] GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:13:08.206543 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9924b624-f2f8-4c56-bd8e-1b49d83a9d31 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:13:08.207787 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9924b624-f2f8-4c56-bd8e-1b49d83a9d31 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:13:08.210541 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:13:08.211340 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:13:08.217643 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9924b624-f2f8-4c56-bd8e-1b49d83a9d31 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:08.218360 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9924b624-f2f8-4c56-bd8e-1b49d83a9d31 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:08.218801 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9924b624-f2f8-4c56-bd8e-1b49d83a9d31 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:08.219497 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9924b624-f2f8-4c56-bd8e-1b49d83a9d31 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:08.219952 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9924b624-f2f8-4c56-bd8e-1b49d83a9d31 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:08.220377 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9924b624-f2f8-4c56-bd8e-1b49d83a9d31 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:08.278821 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-54ec01d7-05ad-49ba-a453-7856a2b32fbf req-f55914c7-e307-4dc9-9391-cddb6ab774de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee93b669-c8c0-4215-82f4-2dcf2d68a10b", "tag": "9652650e-b088-4fdc-bb0d-2117c41eb2cf"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:13:08.284162 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:13:08.292841 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-54ec01d7-05ad-49ba-a453-7856a2b32fbf req-f55914c7-e307-4dc9-9391-cddb6ab774de service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:08.293987 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-54ec01d7-05ad-49ba-a453-7856a2b32fbf req-f55914c7-e307-4dc9-9391-cddb6ab774de service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:08.294761 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-54ec01d7-05ad-49ba-a453-7856a2b32fbf req-f55914c7-e307-4dc9-9391-cddb6ab774de service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:08.310543 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-54ec01d7-05ad-49ba-a453-7856a2b32fbf req-f55914c7-e307-4dc9-9391-cddb6ab774de service nova] Creating event network-changed:9652650e-b088-4fdc-bb0d-2117c41eb2cf for instance ee93b669-c8c0-4215-82f4-2dcf2d68a10b on n-h2-862686-1 Oct 26 14:13:08.316973 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-54ec01d7-05ad-49ba-a453-7856a2b32fbf req-f55914c7-e307-4dc9-9391-cddb6ab774de service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042360 Oct 26 14:13:08.318198 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3805/7587] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 14:13:08.374731 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9924b624-f2f8-4c56-bd8e-1b49d83a9d31 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:13:08.383213 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9924b624-f2f8-4c56-bd8e-1b49d83a9d31 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b" status: 200 len: 1359 microversion: 2.1 time: 0.181777 Oct 26 14:13:08.384001 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3783/7588] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:13:08 2022] GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b => generated 1359 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:13:09.407563 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5f2b4975-e644-4ed8-88f8-b0d576b569a6 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:13:09.408271 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5f2b4975-e644-4ed8-88f8-b0d576b569a6 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:13:09.415526 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5f2b4975-e644-4ed8-88f8-b0d576b569a6 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:09.416018 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5f2b4975-e644-4ed8-88f8-b0d576b569a6 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:09.416495 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5f2b4975-e644-4ed8-88f8-b0d576b569a6 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:09.417202 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5f2b4975-e644-4ed8-88f8-b0d576b569a6 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:09.417695 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5f2b4975-e644-4ed8-88f8-b0d576b569a6 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:09.418133 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5f2b4975-e644-4ed8-88f8-b0d576b569a6 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:09.551280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5f2b4975-e644-4ed8-88f8-b0d576b569a6 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:13:09.558950 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5f2b4975-e644-4ed8-88f8-b0d576b569a6 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b" status: 200 len: 1359 microversion: 2.1 time: 0.156277 Oct 26 14:13:09.559522 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3806/7589] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:13:09 2022] GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:13:10.582399 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7fcee021-1815-4148-b6f5-c5aa8339c702 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:13:10.583016 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7fcee021-1815-4148-b6f5-c5aa8339c702 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:13:10.589980 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7fcee021-1815-4148-b6f5-c5aa8339c702 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:10.590477 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7fcee021-1815-4148-b6f5-c5aa8339c702 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:10.590925 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7fcee021-1815-4148-b6f5-c5aa8339c702 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:10.591619 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7fcee021-1815-4148-b6f5-c5aa8339c702 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:10.592078 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7fcee021-1815-4148-b6f5-c5aa8339c702 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:10.592506 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7fcee021-1815-4148-b6f5-c5aa8339c702 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:10.725461 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7fcee021-1815-4148-b6f5-c5aa8339c702 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:13:10.733090 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7fcee021-1815-4148-b6f5-c5aa8339c702 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b" status: 200 len: 1359 microversion: 2.1 time: 0.154682 Oct 26 14:13:10.734323 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3784/7590] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:13:10 2022] GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:13:11.756399 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ee177edd-164b-4094-8634-0983cd306181 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:13:11.757031 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ee177edd-164b-4094-8634-0983cd306181 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:13:11.763878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee177edd-164b-4094-8634-0983cd306181 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:11.764377 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee177edd-164b-4094-8634-0983cd306181 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:11.764882 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee177edd-164b-4094-8634-0983cd306181 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:11.765708 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee177edd-164b-4094-8634-0983cd306181 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:11.766260 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee177edd-164b-4094-8634-0983cd306181 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:11.766860 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee177edd-164b-4094-8634-0983cd306181 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:11.907136 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ee177edd-164b-4094-8634-0983cd306181 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:13:11.915074 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ee177edd-164b-4094-8634-0983cd306181 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b" status: 200 len: 1359 microversion: 2.1 time: 0.162690 Oct 26 14:13:11.915653 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3807/7591] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:13:11 2022] GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:13:12.939742 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-22416669-16bd-4824-bd83-80e11c5cdf12 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:13:12.940366 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-22416669-16bd-4824-bd83-80e11c5cdf12 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:13:12.947297 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22416669-16bd-4824-bd83-80e11c5cdf12 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:12.947787 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22416669-16bd-4824-bd83-80e11c5cdf12 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:12.948237 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22416669-16bd-4824-bd83-80e11c5cdf12 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:12.948935 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22416669-16bd-4824-bd83-80e11c5cdf12 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:12.949397 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22416669-16bd-4824-bd83-80e11c5cdf12 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:12.949864 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22416669-16bd-4824-bd83-80e11c5cdf12 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:13.077853 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-22416669-16bd-4824-bd83-80e11c5cdf12 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:13:13.085512 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-22416669-16bd-4824-bd83-80e11c5cdf12 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b" status: 200 len: 1359 microversion: 2.1 time: 0.150367 Oct 26 14:13:13.086089 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3785/7592] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:13:12 2022] GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 14:13:14.013516 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-f20d2503-cb71-4af9-a9d3-19b6d626fe33 req-25ad4a5a-d0c9-4b38-82a5-8131b985e91e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee93b669-c8c0-4215-82f4-2dcf2d68a10b", "name": "network-vif-plugged", "status": "completed", "tag": "9652650e-b088-4fdc-bb0d-2117c41eb2cf"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:13:14.023597 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f20d2503-cb71-4af9-a9d3-19b6d626fe33 req-25ad4a5a-d0c9-4b38-82a5-8131b985e91e service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:14.024091 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f20d2503-cb71-4af9-a9d3-19b6d626fe33 req-25ad4a5a-d0c9-4b38-82a5-8131b985e91e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:14.024534 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f20d2503-cb71-4af9-a9d3-19b6d626fe33 req-25ad4a5a-d0c9-4b38-82a5-8131b985e91e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:14.039002 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-f20d2503-cb71-4af9-a9d3-19b6d626fe33 req-25ad4a5a-d0c9-4b38-82a5-8131b985e91e service nova] Creating event network-vif-plugged:9652650e-b088-4fdc-bb0d-2117c41eb2cf for instance ee93b669-c8c0-4215-82f4-2dcf2d68a10b on n-h2-862686-1 Oct 26 14:13:14.043902 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-f20d2503-cb71-4af9-a9d3-19b6d626fe33 req-25ad4a5a-d0c9-4b38-82a5-8131b985e91e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088480 Oct 26 14:13:14.044984 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3808/7593] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:13:14.108346 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ceab791e-e878-4b4c-a163-0af264ca0688 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:13:14.108942 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ceab791e-e878-4b4c-a163-0af264ca0688 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:13:14.115774 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ceab791e-e878-4b4c-a163-0af264ca0688 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:14.116260 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ceab791e-e878-4b4c-a163-0af264ca0688 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:14.116704 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ceab791e-e878-4b4c-a163-0af264ca0688 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:14.117400 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ceab791e-e878-4b4c-a163-0af264ca0688 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:14.117898 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ceab791e-e878-4b4c-a163-0af264ca0688 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:14.118329 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ceab791e-e878-4b4c-a163-0af264ca0688 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:14.252737 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ceab791e-e878-4b4c-a163-0af264ca0688 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:13:14.260597 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ceab791e-e878-4b4c-a163-0af264ca0688 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b" status: 200 len: 1359 microversion: 2.1 time: 0.156255 Oct 26 14:13:14.261183 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3786/7594] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:13:14 2022] GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:13:15.285997 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3e9eaf35-6ee0-442c-a344-70db9c8bb2a7 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:13:15.286708 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3e9eaf35-6ee0-442c-a344-70db9c8bb2a7 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:13:15.292960 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3e9eaf35-6ee0-442c-a344-70db9c8bb2a7 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:15.293454 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3e9eaf35-6ee0-442c-a344-70db9c8bb2a7 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:15.293937 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3e9eaf35-6ee0-442c-a344-70db9c8bb2a7 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:15.294636 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3e9eaf35-6ee0-442c-a344-70db9c8bb2a7 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:15.295101 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3e9eaf35-6ee0-442c-a344-70db9c8bb2a7 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:15.295535 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3e9eaf35-6ee0-442c-a344-70db9c8bb2a7 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:15.431918 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3e9eaf35-6ee0-442c-a344-70db9c8bb2a7 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:13:15.440849 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3e9eaf35-6ee0-442c-a344-70db9c8bb2a7 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b" status: 200 len: 1359 microversion: 2.1 time: 0.160924 Oct 26 14:13:15.441562 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3809/7595] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:13:15 2022] GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:13:16.464449 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-960f3a5c-04ad-4fcf-addb-d96777a96044 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:13:16.465058 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-960f3a5c-04ad-4fcf-addb-d96777a96044 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:13:16.472670 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-960f3a5c-04ad-4fcf-addb-d96777a96044 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:16.473149 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-960f3a5c-04ad-4fcf-addb-d96777a96044 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:16.473621 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-960f3a5c-04ad-4fcf-addb-d96777a96044 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:16.474301 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-960f3a5c-04ad-4fcf-addb-d96777a96044 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:16.474753 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-960f3a5c-04ad-4fcf-addb-d96777a96044 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:16.475172 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-960f3a5c-04ad-4fcf-addb-d96777a96044 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:16.603521 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-960f3a5c-04ad-4fcf-addb-d96777a96044 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:13:16.611706 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-960f3a5c-04ad-4fcf-addb-d96777a96044 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b" status: 200 len: 1549 microversion: 2.1 time: 0.151170 Oct 26 14:13:16.612283 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3787/7596] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:13:16 2022] GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:13:16.633913 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-45cb0569-4500-4e7e-a3ae-2cd3b7d0f7ef tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:13:16.634538 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-45cb0569-4500-4e7e-a3ae-2cd3b7d0f7ef tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:13:16.641960 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45cb0569-4500-4e7e-a3ae-2cd3b7d0f7ef tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:16.642457 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45cb0569-4500-4e7e-a3ae-2cd3b7d0f7ef tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:16.642908 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45cb0569-4500-4e7e-a3ae-2cd3b7d0f7ef tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:16.643616 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45cb0569-4500-4e7e-a3ae-2cd3b7d0f7ef tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:16.644085 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45cb0569-4500-4e7e-a3ae-2cd3b7d0f7ef tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:16.644528 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45cb0569-4500-4e7e-a3ae-2cd3b7d0f7ef tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:16.771735 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-45cb0569-4500-4e7e-a3ae-2cd3b7d0f7ef tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:13:16.779781 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-45cb0569-4500-4e7e-a3ae-2cd3b7d0f7ef tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b" status: 200 len: 1549 microversion: 2.1 time: 0.149864 Oct 26 14:13:16.780904 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3810/7597] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:13:16 2022] GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:13:16.802754 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e08c2a8f-ae80-409b-b254-c87880b96608 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:13:16.807620 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e08c2a8f-ae80-409b-b254-c87880b96608 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:13:16.808387 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e08c2a8f-ae80-409b-b254-c87880b96608 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Searching by: {'deleted': False, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7'} {{(pid=120597) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 14:13:16.813920 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e08c2a8f-ae80-409b-b254-c87880b96608 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:16.814409 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e08c2a8f-ae80-409b-b254-c87880b96608 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:16.814848 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e08c2a8f-ae80-409b-b254-c87880b96608 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:16.815579 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e08c2a8f-ae80-409b-b254-c87880b96608 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:16.816069 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e08c2a8f-ae80-409b-b254-c87880b96608 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:16.816504 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e08c2a8f-ae80-409b-b254-c87880b96608 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:16.845207 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.multi_cell_list [None req-e08c2a8f-ae80-409b-b254-c87880b96608 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120597) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 14:13:16.872194 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e08c2a8f-ae80-409b-b254-c87880b96608 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.073223 Oct 26 14:13:16.872775 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3788/7598] 10.222.0.40 () {58 vars in 1125 bytes} [Wed Oct 26 14:13:16 2022] GET /compute/v2.1/servers => generated 343 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:13:16.885301 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6ece4869-8fad-4acb-a988-ffc0ee360ea6 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:13:16.885948 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6ece4869-8fad-4acb-a988-ffc0ee360ea6 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:13:16.893039 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ece4869-8fad-4acb-a988-ffc0ee360ea6 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:16.893558 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ece4869-8fad-4acb-a988-ffc0ee360ea6 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:16.894008 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ece4869-8fad-4acb-a988-ffc0ee360ea6 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:16.894705 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ece4869-8fad-4acb-a988-ffc0ee360ea6 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:16.895169 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ece4869-8fad-4acb-a988-ffc0ee360ea6 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:16.895604 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ece4869-8fad-4acb-a988-ffc0ee360ea6 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:17.033510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6ece4869-8fad-4acb-a988-ffc0ee360ea6 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:13:17.041524 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6ece4869-8fad-4acb-a988-ffc0ee360ea6 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b" status: 200 len: 1549 microversion: 2.1 time: 0.160305 Oct 26 14:13:17.042107 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3811/7599] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:13:16 2022] GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b => generated 1549 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:13:18.556515 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fc65d9f9-2be8-4a6a-83e1-b40c7656b8b8 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef2e2b7b-8913-4875-898e-d2a103ac54da"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:13:18.558995 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fc65d9f9-2be8-4a6a-83e1-b40c7656b8b8 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:13:18.566477 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fc65d9f9-2be8-4a6a-83e1-b40c7656b8b8 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:18.566965 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fc65d9f9-2be8-4a6a-83e1-b40c7656b8b8 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:18.567407 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fc65d9f9-2be8-4a6a-83e1-b40c7656b8b8 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:18.568097 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fc65d9f9-2be8-4a6a-83e1-b40c7656b8b8 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:18.568555 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fc65d9f9-2be8-4a6a-83e1-b40c7656b8b8 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:18.569001 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fc65d9f9-2be8-4a6a-83e1-b40c7656b8b8 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:18.806879 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fc65d9f9-2be8-4a6a-83e1-b40c7656b8b8 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "POST /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254260 Oct 26 14:13:18.807493 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3789/7600] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Oct 26 14:13:18 2022] POST /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:13:29.578681 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-afa4c57d-1584-4b12-817c-ea60486386bc tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:13:29.579315 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-afa4c57d-1584-4b12-817c-ea60486386bc tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:13:29.581613 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=17 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:13:29.582544 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=58 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:13:29.588206 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afa4c57d-1584-4b12-817c-ea60486386bc tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:29.588707 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afa4c57d-1584-4b12-817c-ea60486386bc tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:29.589160 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afa4c57d-1584-4b12-817c-ea60486386bc tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:29.589911 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afa4c57d-1584-4b12-817c-ea60486386bc tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:29.590383 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afa4c57d-1584-4b12-817c-ea60486386bc tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:29.590855 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afa4c57d-1584-4b12-817c-ea60486386bc tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:29.720119 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-afa4c57d-1584-4b12-817c-ea60486386bc tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:13:29.728783 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-afa4c57d-1584-4b12-817c-ea60486386bc tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b" status: 200 len: 1595 microversion: 2.1 time: 0.154668 Oct 26 14:13:29.729376 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3812/7601] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:13:29 2022] GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b => generated 1595 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:13:31.299851 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:13:31.300750 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:13:31.301693 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:13:31.306244 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-6dbbf41c-8c0e-4304-83d1-59899d7302ef req-bb7cdfbf-842f-494c-8d56-b5412712fb68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee93b669-c8c0-4215-82f4-2dcf2d68a10b", "tag": "9652650e-b088-4fdc-bb0d-2117c41eb2cf"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:13:31.318064 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-6dbbf41c-8c0e-4304-83d1-59899d7302ef req-bb7cdfbf-842f-494c-8d56-b5412712fb68 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:31.318684 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-6dbbf41c-8c0e-4304-83d1-59899d7302ef req-bb7cdfbf-842f-494c-8d56-b5412712fb68 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:31.319300 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-6dbbf41c-8c0e-4304-83d1-59899d7302ef req-bb7cdfbf-842f-494c-8d56-b5412712fb68 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:31.335381 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-6dbbf41c-8c0e-4304-83d1-59899d7302ef req-bb7cdfbf-842f-494c-8d56-b5412712fb68 service nova] Creating event network-changed:9652650e-b088-4fdc-bb0d-2117c41eb2cf for instance ee93b669-c8c0-4215-82f4-2dcf2d68a10b on n-h2-862686-1 Oct 26 14:13:31.341083 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-6dbbf41c-8c0e-4304-83d1-59899d7302ef req-bb7cdfbf-842f-494c-8d56-b5412712fb68 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043232 Oct 26 14:13:31.341739 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3790/7602] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:13:32.542889 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6370fa97-2a9f-4a94-a2d1-5619a171fd7d tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-638329824"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:13:32.543450 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6370fa97-2a9f-4a94-a2d1-5619a171fd7d tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:13:32.550577 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6370fa97-2a9f-4a94-a2d1-5619a171fd7d tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:32.551085 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6370fa97-2a9f-4a94-a2d1-5619a171fd7d tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:32.551540 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6370fa97-2a9f-4a94-a2d1-5619a171fd7d tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:32.552255 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6370fa97-2a9f-4a94-a2d1-5619a171fd7d tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:32.552729 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6370fa97-2a9f-4a94-a2d1-5619a171fd7d tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:32.553173 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6370fa97-2a9f-4a94-a2d1-5619a171fd7d tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:32.692395 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.network.security_group_api [None req-6370fa97-2a9f-4a94-a2d1-5619a171fd7d tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Adding security group f5f75167-4dcb-4a45-b0aa-eb4bc2ab1dd4 to port 9652650e-b088-4fdc-bb0d-2117c41eb2cf Oct 26 14:13:32.999850 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6370fa97-2a9f-4a94-a2d1-5619a171fd7d tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "POST /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b/action" status: 202 len: 0 microversion: 2.1 time: 0.460951 Oct 26 14:13:33.000929 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3813/7603] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 14:13:32 2022] POST /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b/action => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 14:13:33.018711 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-a2901003-8ed6-491f-8da7-2bc9ee4e77a2 req-9ce26730-8e90-4a45-887d-be274608f424 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee93b669-c8c0-4215-82f4-2dcf2d68a10b", "tag": "9652650e-b088-4fdc-bb0d-2117c41eb2cf"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:13:33.023496 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-657e99e7-8671-4061-84d2-cd421c19600d tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:13:33.024204 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-657e99e7-8671-4061-84d2-cd421c19600d tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:13:33.037995 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-657e99e7-8671-4061-84d2-cd421c19600d tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:33.038491 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-657e99e7-8671-4061-84d2-cd421c19600d tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:33.038932 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-657e99e7-8671-4061-84d2-cd421c19600d tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:33.039645 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-657e99e7-8671-4061-84d2-cd421c19600d tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:33.040099 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-657e99e7-8671-4061-84d2-cd421c19600d tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:33.044002 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-a2901003-8ed6-491f-8da7-2bc9ee4e77a2 req-9ce26730-8e90-4a45-887d-be274608f424 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:33.044496 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-a2901003-8ed6-491f-8da7-2bc9ee4e77a2 req-9ce26730-8e90-4a45-887d-be274608f424 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:33.044947 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-a2901003-8ed6-491f-8da7-2bc9ee4e77a2 req-9ce26730-8e90-4a45-887d-be274608f424 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:33.048501 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-657e99e7-8671-4061-84d2-cd421c19600d tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:33.069384 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-a2901003-8ed6-491f-8da7-2bc9ee4e77a2 req-9ce26730-8e90-4a45-887d-be274608f424 service nova] Creating event network-changed:9652650e-b088-4fdc-bb0d-2117c41eb2cf for instance ee93b669-c8c0-4215-82f4-2dcf2d68a10b on n-h2-862686-1 Oct 26 14:13:33.074978 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-a2901003-8ed6-491f-8da7-2bc9ee4e77a2 req-9ce26730-8e90-4a45-887d-be274608f424 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061873 Oct 26 14:13:33.075862 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3814/7604] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:13:33.213560 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-657e99e7-8671-4061-84d2-cd421c19600d tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:13:33.224808 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-657e99e7-8671-4061-84d2-cd421c19600d tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b" status: 200 len: 1760 microversion: 2.1 time: 0.219570 Oct 26 14:13:33.226123 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3791/7605] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:13:33 2022] GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b => generated 1760 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:13:54.960815 n-d-862686-1 devstack@n-api.service[120598]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b813bc1f-3720-4149-820f-44a58aef8a8e] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 26 14:13:54.961671 n-d-862686-1 devstack@n-api.service[120598]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bbf40942-d6c8-479f-a0f4-15bbba6fd52c] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 26 14:13:54.962258 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:13:54.963024 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=12 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:13:55.014057 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2a765293-43ee-406c-a666-7b750b7a3bc2 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:13:55.016763 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2a765293-43ee-406c-a666-7b750b7a3bc2 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:13:55.022946 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2a765293-43ee-406c-a666-7b750b7a3bc2 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:55.023467 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2a765293-43ee-406c-a666-7b750b7a3bc2 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:55.023902 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2a765293-43ee-406c-a666-7b750b7a3bc2 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:55.024613 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2a765293-43ee-406c-a666-7b750b7a3bc2 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:55.025086 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2a765293-43ee-406c-a666-7b750b7a3bc2 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:55.025550 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2a765293-43ee-406c-a666-7b750b7a3bc2 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:55.098519 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2a765293-43ee-406c-a666-7b750b7a3bc2 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "POST /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b/action" status: 202 len: 0 microversion: 2.1 time: 0.138937 Oct 26 14:13:55.099131 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3815/7606] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 14:13:54 2022] POST /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 14:13:55.105820 n-d-862686-1 devstack@n-api.service[120597]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c037a1b0-cfe5-48ae-b7c7-2931306917f8] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 26 14:13:55.110488 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-95b48dc6-90e2-4f7b-9498-85c4e12c10e8 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:13:55.111100 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-95b48dc6-90e2-4f7b-9498-85c4e12c10e8 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:13:55.113509 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=4 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:13:55.114297 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=8 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:13:55.121973 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-95b48dc6-90e2-4f7b-9498-85c4e12c10e8 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:55.122462 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-95b48dc6-90e2-4f7b-9498-85c4e12c10e8 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:55.123658 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-95b48dc6-90e2-4f7b-9498-85c4e12c10e8 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:55.125267 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-95b48dc6-90e2-4f7b-9498-85c4e12c10e8 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:55.125893 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-95b48dc6-90e2-4f7b-9498-85c4e12c10e8 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:55.126328 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-95b48dc6-90e2-4f7b-9498-85c4e12c10e8 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:55.274527 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-95b48dc6-90e2-4f7b-9498-85c4e12c10e8 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:13:55.283663 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-95b48dc6-90e2-4f7b-9498-85c4e12c10e8 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b" status: 200 len: 1752 microversion: 2.1 time: 0.179347 Oct 26 14:13:55.284254 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3792/7607] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:13:55 2022] GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b => generated 1752 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:13:56.308524 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-14bbef34-ea9e-4052-ba4d-e10fd9c42925 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:13:56.309242 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-14bbef34-ea9e-4052-ba4d-e10fd9c42925 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:13:56.324700 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-14bbef34-ea9e-4052-ba4d-e10fd9c42925 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:56.325213 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-14bbef34-ea9e-4052-ba4d-e10fd9c42925 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:56.325819 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-14bbef34-ea9e-4052-ba4d-e10fd9c42925 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:56.326737 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-14bbef34-ea9e-4052-ba4d-e10fd9c42925 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:56.327256 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-14bbef34-ea9e-4052-ba4d-e10fd9c42925 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:56.327700 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-14bbef34-ea9e-4052-ba4d-e10fd9c42925 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:56.335023 n-d-862686-1 devstack@n-api.service[120598]: INFO oslo.messaging._drivers.impl_rabbit [-] [bbf40942-d6c8-479f-a0f4-15bbba6fd52c] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 36742. Oct 26 14:13:56.338130 n-d-862686-1 devstack@n-api.service[120598]: INFO oslo.messaging._drivers.impl_rabbit [-] [b813bc1f-3720-4149-820f-44a58aef8a8e] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 36740. Oct 26 14:13:56.481269 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-14bbef34-ea9e-4052-ba4d-e10fd9c42925 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:13:56.490268 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-14bbef34-ea9e-4052-ba4d-e10fd9c42925 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b" status: 200 len: 1757 microversion: 2.1 time: 0.186055 Oct 26 14:13:56.490846 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3816/7608] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:13:56 2022] GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b => generated 1757 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:13:57.515397 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0cee39ea-998f-4387-b44b-0813dba21bf0 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:13:57.515992 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0cee39ea-998f-4387-b44b-0813dba21bf0 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:13:57.528083 n-d-862686-1 devstack@n-api.service[120597]: INFO oslo.messaging._drivers.impl_rabbit [-] [c037a1b0-cfe5-48ae-b7c7-2931306917f8] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 36746. Oct 26 14:13:57.530510 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0cee39ea-998f-4387-b44b-0813dba21bf0 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:57.531020 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0cee39ea-998f-4387-b44b-0813dba21bf0 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:57.531489 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0cee39ea-998f-4387-b44b-0813dba21bf0 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:57.532181 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0cee39ea-998f-4387-b44b-0813dba21bf0 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:57.532640 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0cee39ea-998f-4387-b44b-0813dba21bf0 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:57.533067 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0cee39ea-998f-4387-b44b-0813dba21bf0 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:57.681307 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0cee39ea-998f-4387-b44b-0813dba21bf0 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:13:57.690545 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0cee39ea-998f-4387-b44b-0813dba21bf0 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b" status: 200 len: 1757 microversion: 2.1 time: 0.179664 Oct 26 14:13:57.691492 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3793/7609] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:13:57 2022] GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b => generated 1757 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:13:58.715203 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1c50f843-506d-4ee7-b023-a0bd87022361 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:13:58.715966 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1c50f843-506d-4ee7-b023-a0bd87022361 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:13:58.723590 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c50f843-506d-4ee7-b023-a0bd87022361 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:58.724089 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c50f843-506d-4ee7-b023-a0bd87022361 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:58.724542 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c50f843-506d-4ee7-b023-a0bd87022361 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:58.725246 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c50f843-506d-4ee7-b023-a0bd87022361 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:58.725745 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c50f843-506d-4ee7-b023-a0bd87022361 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:58.726189 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c50f843-506d-4ee7-b023-a0bd87022361 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:58.873209 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1c50f843-506d-4ee7-b023-a0bd87022361 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:13:58.881664 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1c50f843-506d-4ee7-b023-a0bd87022361 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b" status: 200 len: 1757 microversion: 2.1 time: 0.171021 Oct 26 14:13:58.882180 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3817/7610] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:13:58 2022] GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:13:59.906078 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bedc7085-a407-4bb8-89b4-6ccb4926a940 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:13:59.906717 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bedc7085-a407-4bb8-89b4-6ccb4926a940 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:13:59.913851 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bedc7085-a407-4bb8-89b4-6ccb4926a940 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:59.914338 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bedc7085-a407-4bb8-89b4-6ccb4926a940 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:59.914780 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bedc7085-a407-4bb8-89b4-6ccb4926a940 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:13:59.915477 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bedc7085-a407-4bb8-89b4-6ccb4926a940 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:13:59.915934 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bedc7085-a407-4bb8-89b4-6ccb4926a940 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:13:59.916366 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bedc7085-a407-4bb8-89b4-6ccb4926a940 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:00.059840 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bedc7085-a407-4bb8-89b4-6ccb4926a940 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:14:00.068392 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bedc7085-a407-4bb8-89b4-6ccb4926a940 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b" status: 200 len: 1757 microversion: 2.1 time: 0.166814 Oct 26 14:14:00.068974 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3794/7611] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:13:59 2022] GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:14:01.092256 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-26cce310-416d-4df1-8252-ddb6c7c70221 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:14:01.092889 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-26cce310-416d-4df1-8252-ddb6c7c70221 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:14:01.099699 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26cce310-416d-4df1-8252-ddb6c7c70221 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:01.100192 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26cce310-416d-4df1-8252-ddb6c7c70221 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:01.100638 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26cce310-416d-4df1-8252-ddb6c7c70221 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:01.101341 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26cce310-416d-4df1-8252-ddb6c7c70221 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:01.101833 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26cce310-416d-4df1-8252-ddb6c7c70221 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:01.102271 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26cce310-416d-4df1-8252-ddb6c7c70221 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:01.243981 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-26cce310-416d-4df1-8252-ddb6c7c70221 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:14:01.252408 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-26cce310-416d-4df1-8252-ddb6c7c70221 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b" status: 200 len: 1757 microversion: 2.1 time: 0.164151 Oct 26 14:14:01.252989 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3818/7612] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:14:01 2022] GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:14:02.275652 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bf28fcba-7e4d-4871-8313-531febf20b3c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:14:02.276255 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bf28fcba-7e4d-4871-8313-531febf20b3c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:14:02.283372 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf28fcba-7e4d-4871-8313-531febf20b3c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:02.283847 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf28fcba-7e4d-4871-8313-531febf20b3c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:02.284284 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf28fcba-7e4d-4871-8313-531febf20b3c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:02.284966 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf28fcba-7e4d-4871-8313-531febf20b3c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:02.285415 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf28fcba-7e4d-4871-8313-531febf20b3c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:02.285861 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf28fcba-7e4d-4871-8313-531febf20b3c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:02.427801 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bf28fcba-7e4d-4871-8313-531febf20b3c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:14:02.437230 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bf28fcba-7e4d-4871-8313-531febf20b3c tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b" status: 200 len: 1757 microversion: 2.1 time: 0.165529 Oct 26 14:14:02.437832 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3795/7613] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:14:02 2022] GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:14:03.460513 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d252c044-1839-4e75-b8bb-6c6ccf788def tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:14:03.461130 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d252c044-1839-4e75-b8bb-6c6ccf788def tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:14:03.467932 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d252c044-1839-4e75-b8bb-6c6ccf788def tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:03.468408 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d252c044-1839-4e75-b8bb-6c6ccf788def tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:03.468853 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d252c044-1839-4e75-b8bb-6c6ccf788def tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:03.469581 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d252c044-1839-4e75-b8bb-6c6ccf788def tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:03.470049 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d252c044-1839-4e75-b8bb-6c6ccf788def tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:03.470480 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d252c044-1839-4e75-b8bb-6c6ccf788def tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:03.615558 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d252c044-1839-4e75-b8bb-6c6ccf788def tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:14:03.624626 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d252c044-1839-4e75-b8bb-6c6ccf788def tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b" status: 200 len: 1757 microversion: 2.1 time: 0.168119 Oct 26 14:14:03.625370 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3819/7614] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:14:03 2022] GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:14:04.648043 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-efcfe355-d46a-44d6-a795-fe65ca8c2569 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:14:04.648658 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-efcfe355-d46a-44d6-a795-fe65ca8c2569 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:14:04.656117 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-efcfe355-d46a-44d6-a795-fe65ca8c2569 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:04.656597 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-efcfe355-d46a-44d6-a795-fe65ca8c2569 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:04.657032 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-efcfe355-d46a-44d6-a795-fe65ca8c2569 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:04.657756 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-efcfe355-d46a-44d6-a795-fe65ca8c2569 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:04.658209 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-efcfe355-d46a-44d6-a795-fe65ca8c2569 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:04.658633 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-efcfe355-d46a-44d6-a795-fe65ca8c2569 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:04.803428 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-efcfe355-d46a-44d6-a795-fe65ca8c2569 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:14:04.811829 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-efcfe355-d46a-44d6-a795-fe65ca8c2569 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b" status: 200 len: 1757 microversion: 2.1 time: 0.167650 Oct 26 14:14:04.812403 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3796/7615] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:14:04 2022] GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:14:05.836001 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1a7ed430-3d4b-43c6-868d-539351fd2a11 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:14:05.836678 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1a7ed430-3d4b-43c6-868d-539351fd2a11 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:14:05.844208 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a7ed430-3d4b-43c6-868d-539351fd2a11 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:05.844705 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a7ed430-3d4b-43c6-868d-539351fd2a11 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:05.845159 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a7ed430-3d4b-43c6-868d-539351fd2a11 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:05.845896 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a7ed430-3d4b-43c6-868d-539351fd2a11 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:05.846368 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a7ed430-3d4b-43c6-868d-539351fd2a11 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:05.846810 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a7ed430-3d4b-43c6-868d-539351fd2a11 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:05.988685 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1a7ed430-3d4b-43c6-868d-539351fd2a11 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:14:05.996870 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1a7ed430-3d4b-43c6-868d-539351fd2a11 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b" status: 200 len: 1757 microversion: 2.1 time: 0.164822 Oct 26 14:14:05.997454 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3820/7616] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:14:05 2022] GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:14:07.020008 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-db48784b-3aae-4aa2-97b0-303196d553d5 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:14:07.020621 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-db48784b-3aae-4aa2-97b0-303196d553d5 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:14:07.027543 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-db48784b-3aae-4aa2-97b0-303196d553d5 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:07.028025 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-db48784b-3aae-4aa2-97b0-303196d553d5 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:07.028470 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-db48784b-3aae-4aa2-97b0-303196d553d5 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:07.029178 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-db48784b-3aae-4aa2-97b0-303196d553d5 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:07.029664 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-db48784b-3aae-4aa2-97b0-303196d553d5 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:07.030094 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-db48784b-3aae-4aa2-97b0-303196d553d5 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:07.172338 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-db48784b-3aae-4aa2-97b0-303196d553d5 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:14:07.180519 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-db48784b-3aae-4aa2-97b0-303196d553d5 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b" status: 200 len: 1757 microversion: 2.1 time: 0.164448 Oct 26 14:14:07.181086 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3797/7617] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:14:07 2022] GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:14:08.204988 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-260e290a-6747-40b1-ad66-2b4745a9bf5b tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:14:08.205598 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-260e290a-6747-40b1-ad66-2b4745a9bf5b tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:14:08.212354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-260e290a-6747-40b1-ad66-2b4745a9bf5b tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:08.212856 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-260e290a-6747-40b1-ad66-2b4745a9bf5b tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:08.213310 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-260e290a-6747-40b1-ad66-2b4745a9bf5b tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:08.214048 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-260e290a-6747-40b1-ad66-2b4745a9bf5b tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:08.214532 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-260e290a-6747-40b1-ad66-2b4745a9bf5b tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:08.214974 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-260e290a-6747-40b1-ad66-2b4745a9bf5b tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:08.361061 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-260e290a-6747-40b1-ad66-2b4745a9bf5b tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:14:08.369257 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-260e290a-6747-40b1-ad66-2b4745a9bf5b tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b" status: 200 len: 1757 microversion: 2.1 time: 0.168940 Oct 26 14:14:08.369859 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3821/7618] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:14:08 2022] GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:14:09.394104 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-605768de-ea98-4c17-8fb0-b9c3822639b0 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:14:09.394694 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-605768de-ea98-4c17-8fb0-b9c3822639b0 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:14:09.401442 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-605768de-ea98-4c17-8fb0-b9c3822639b0 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:09.401976 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-605768de-ea98-4c17-8fb0-b9c3822639b0 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:09.402407 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-605768de-ea98-4c17-8fb0-b9c3822639b0 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:09.403086 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-605768de-ea98-4c17-8fb0-b9c3822639b0 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:09.403535 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-605768de-ea98-4c17-8fb0-b9c3822639b0 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:09.404273 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-605768de-ea98-4c17-8fb0-b9c3822639b0 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:09.546896 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-605768de-ea98-4c17-8fb0-b9c3822639b0 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:14:09.555151 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-605768de-ea98-4c17-8fb0-b9c3822639b0 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b" status: 200 len: 1757 microversion: 2.1 time: 0.164998 Oct 26 14:14:09.555716 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3798/7619] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:14:09 2022] GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 14:14:10.579800 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-880ccd5a-d1d1-4263-8410-4fa86099a8a2 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:14:10.580426 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-880ccd5a-d1d1-4263-8410-4fa86099a8a2 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:14:10.587314 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-880ccd5a-d1d1-4263-8410-4fa86099a8a2 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:10.587808 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-880ccd5a-d1d1-4263-8410-4fa86099a8a2 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:10.588259 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-880ccd5a-d1d1-4263-8410-4fa86099a8a2 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:10.588966 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-880ccd5a-d1d1-4263-8410-4fa86099a8a2 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:10.589433 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-880ccd5a-d1d1-4263-8410-4fa86099a8a2 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:10.589896 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-880ccd5a-d1d1-4263-8410-4fa86099a8a2 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:10.734416 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-880ccd5a-d1d1-4263-8410-4fa86099a8a2 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:14:10.742610 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-880ccd5a-d1d1-4263-8410-4fa86099a8a2 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b" status: 200 len: 1757 microversion: 2.1 time: 0.167294 Oct 26 14:14:10.743193 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3822/7620] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:14:10 2022] GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:14:11.766192 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f17e1ec2-4601-45f8-8e22-f453d7256707 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:14:11.766799 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f17e1ec2-4601-45f8-8e22-f453d7256707 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:14:11.773640 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f17e1ec2-4601-45f8-8e22-f453d7256707 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:11.774121 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f17e1ec2-4601-45f8-8e22-f453d7256707 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:11.774556 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f17e1ec2-4601-45f8-8e22-f453d7256707 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:11.775238 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f17e1ec2-4601-45f8-8e22-f453d7256707 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:11.775686 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f17e1ec2-4601-45f8-8e22-f453d7256707 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:11.776108 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f17e1ec2-4601-45f8-8e22-f453d7256707 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:11.919062 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f17e1ec2-4601-45f8-8e22-f453d7256707 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:14:11.927974 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f17e1ec2-4601-45f8-8e22-f453d7256707 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b" status: 200 len: 1760 microversion: 2.1 time: 0.165722 Oct 26 14:14:11.928551 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3799/7621] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:14:11 2022] GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b => generated 1760 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:14:44.344692 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1bd07a0c-8b62-4a82-9e64-1e7a9981488d tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-638329824"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:14:44.345307 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1bd07a0c-8b62-4a82-9e64-1e7a9981488d tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:14:44.347590 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=16 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:14:44.348381 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:14:44.349267 n-d-862686-1 devstack@n-api.service[120598]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 14:14:44.349428 n-d-862686-1 devstack@n-api.service[120598]: Wed Oct 26 14:14:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b/action (ip 10.222.0.40) !!! Oct 26 14:14:44.357004 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1bd07a0c-8b62-4a82-9e64-1e7a9981488d tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:44.357521 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1bd07a0c-8b62-4a82-9e64-1e7a9981488d tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:44.357977 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1bd07a0c-8b62-4a82-9e64-1e7a9981488d tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:44.359181 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1bd07a0c-8b62-4a82-9e64-1e7a9981488d tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:44.359652 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1bd07a0c-8b62-4a82-9e64-1e7a9981488d tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:44.360096 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1bd07a0c-8b62-4a82-9e64-1e7a9981488d tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:44.487777 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.network.security_group_api [None req-1bd07a0c-8b62-4a82-9e64-1e7a9981488d tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Removing security group f5f75167-4dcb-4a45-b0aa-eb4bc2ab1dd4 from port 9652650e-b088-4fdc-bb0d-2117c41eb2cf Oct 26 14:14:44.794405 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1bd07a0c-8b62-4a82-9e64-1e7a9981488d tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "POST /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b/action" status: 202 len: 0 microversion: 2.1 time: 0.453878 Oct 26 14:14:44.800419 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3823/7622] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 14:14:44 2022] POST /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b/action => generated 0 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 14:14:44.812450 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-cff8e402-ffc5-4b9d-8a32-0affe074be75 req-cfe7c0de-48bf-4355-8d34-ee85f0c3d896 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee93b669-c8c0-4215-82f4-2dcf2d68a10b", "tag": "9652650e-b088-4fdc-bb0d-2117c41eb2cf"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:14:44.826528 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=16 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:14:44.828003 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=48 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:14:44.837777 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-cff8e402-ffc5-4b9d-8a32-0affe074be75 req-cfe7c0de-48bf-4355-8d34-ee85f0c3d896 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:44.838264 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-cff8e402-ffc5-4b9d-8a32-0affe074be75 req-cfe7c0de-48bf-4355-8d34-ee85f0c3d896 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:44.838699 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-cff8e402-ffc5-4b9d-8a32-0affe074be75 req-cfe7c0de-48bf-4355-8d34-ee85f0c3d896 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:44.865589 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-cff8e402-ffc5-4b9d-8a32-0affe074be75 req-cfe7c0de-48bf-4355-8d34-ee85f0c3d896 service nova] Creating event network-changed:9652650e-b088-4fdc-bb0d-2117c41eb2cf for instance ee93b669-c8c0-4215-82f4-2dcf2d68a10b on n-h2-862686-1 Oct 26 14:14:44.879266 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-cff8e402-ffc5-4b9d-8a32-0affe074be75 req-cfe7c0de-48bf-4355-8d34-ee85f0c3d896 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078675 Oct 26 14:14:44.880252 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3800/7623] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:14:46.250455 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-54befd22-f748-4067-97ec-0e63a76e875b tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:14:46.251019 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-54befd22-f748-4067-97ec-0e63a76e875b tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:14:46.251952 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-361b4c0f-455e-444d-8520-bf2113fa5d75 req-497ad797-05de-4bd6-aad5-86db06a2ea62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee93b669-c8c0-4215-82f4-2dcf2d68a10b", "tag": "9652650e-b088-4fdc-bb0d-2117c41eb2cf"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:14:46.258047 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54befd22-f748-4067-97ec-0e63a76e875b tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:46.258619 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54befd22-f748-4067-97ec-0e63a76e875b tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:46.259135 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54befd22-f748-4067-97ec-0e63a76e875b tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:46.260100 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54befd22-f748-4067-97ec-0e63a76e875b tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:46.260769 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54befd22-f748-4067-97ec-0e63a76e875b tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:46.261205 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54befd22-f748-4067-97ec-0e63a76e875b tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:46.262258 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-361b4c0f-455e-444d-8520-bf2113fa5d75 req-497ad797-05de-4bd6-aad5-86db06a2ea62 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:46.262743 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-361b4c0f-455e-444d-8520-bf2113fa5d75 req-497ad797-05de-4bd6-aad5-86db06a2ea62 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:46.263182 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-361b4c0f-455e-444d-8520-bf2113fa5d75 req-497ad797-05de-4bd6-aad5-86db06a2ea62 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:46.277129 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-361b4c0f-455e-444d-8520-bf2113fa5d75 req-497ad797-05de-4bd6-aad5-86db06a2ea62 service nova] Creating event network-changed:9652650e-b088-4fdc-bb0d-2117c41eb2cf for instance ee93b669-c8c0-4215-82f4-2dcf2d68a10b on n-h2-862686-1 Oct 26 14:14:46.282946 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-361b4c0f-455e-444d-8520-bf2113fa5d75 req-497ad797-05de-4bd6-aad5-86db06a2ea62 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035965 Oct 26 14:14:46.283569 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3801/7624] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 14:14:46.353893 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-54befd22-f748-4067-97ec-0e63a76e875b tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lazy-loading 'services' on Instance uuid ee93b669-c8c0-4215-82f4-2dcf2d68a10b {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 14:14:46.439173 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-54befd22-f748-4067-97ec-0e63a76e875b tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b/os-volume_attachments/ef2e2b7b-8913-4875-898e-d2a103ac54da" status: 202 len: 0 microversion: 2.1 time: 0.194535 Oct 26 14:14:46.443417 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3824/7625] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Oct 26 14:14:46 2022] DELETE /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b/os-volume_attachments/ef2e2b7b-8913-4875-898e-d2a103ac54da => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 14:14:46.448877 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-af2fba3c-2b8a-44d5-8e27-07aa9b8ab605 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:14:46.451263 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-af2fba3c-2b8a-44d5-8e27-07aa9b8ab605 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:14:46.458316 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af2fba3c-2b8a-44d5-8e27-07aa9b8ab605 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:46.459080 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af2fba3c-2b8a-44d5-8e27-07aa9b8ab605 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:46.459704 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af2fba3c-2b8a-44d5-8e27-07aa9b8ab605 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:46.460613 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af2fba3c-2b8a-44d5-8e27-07aa9b8ab605 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:46.461061 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af2fba3c-2b8a-44d5-8e27-07aa9b8ab605 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:46.461509 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af2fba3c-2b8a-44d5-8e27-07aa9b8ab605 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:46.493269 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-af2fba3c-2b8a-44d5-8e27-07aa9b8ab605 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048735 Oct 26 14:14:46.493872 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3802/7626] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 14:14:46 2022] GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 14:14:47.508781 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f1fe1a91-5a30-411e-be2b-106004afd92f tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:14:47.511077 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f1fe1a91-5a30-411e-be2b-106004afd92f tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:14:47.517444 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1fe1a91-5a30-411e-be2b-106004afd92f tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:47.518491 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1fe1a91-5a30-411e-be2b-106004afd92f tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:47.518951 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1fe1a91-5a30-411e-be2b-106004afd92f tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:47.519674 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1fe1a91-5a30-411e-be2b-106004afd92f tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:47.520151 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1fe1a91-5a30-411e-be2b-106004afd92f tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:47.520601 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f1fe1a91-5a30-411e-be2b-106004afd92f tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:47.551884 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f1fe1a91-5a30-411e-be2b-106004afd92f tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048465 Oct 26 14:14:47.552466 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3825/7627] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 14:14:47 2022] GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:14:48.565143 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6ed8da75-b05d-486c-a695-e6bc11fc1286 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:14:48.567389 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6ed8da75-b05d-486c-a695-e6bc11fc1286 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:14:48.574619 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ed8da75-b05d-486c-a695-e6bc11fc1286 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:48.575104 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ed8da75-b05d-486c-a695-e6bc11fc1286 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:48.575537 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ed8da75-b05d-486c-a695-e6bc11fc1286 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:48.576236 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ed8da75-b05d-486c-a695-e6bc11fc1286 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:48.576689 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ed8da75-b05d-486c-a695-e6bc11fc1286 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:48.578234 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ed8da75-b05d-486c-a695-e6bc11fc1286 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:48.609622 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6ed8da75-b05d-486c-a695-e6bc11fc1286 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049084 Oct 26 14:14:48.610404 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3803/7628] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 14:14:48 2022] GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:14:49.622327 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-87995b21-121a-4af8-a770-4088a3688b44 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:14:49.625114 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-87995b21-121a-4af8-a770-4088a3688b44 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:14:49.631926 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87995b21-121a-4af8-a770-4088a3688b44 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:49.632424 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87995b21-121a-4af8-a770-4088a3688b44 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:49.632876 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87995b21-121a-4af8-a770-4088a3688b44 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:49.633610 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87995b21-121a-4af8-a770-4088a3688b44 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:49.634081 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87995b21-121a-4af8-a770-4088a3688b44 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:49.634520 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87995b21-121a-4af8-a770-4088a3688b44 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:49.663522 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-87995b21-121a-4af8-a770-4088a3688b44 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045244 Oct 26 14:14:49.664302 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3826/7629] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 14:14:49 2022] GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:14:50.676076 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e5472cd0-8aa5-4706-b5ca-fa7121ba181a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:14:50.678277 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e5472cd0-8aa5-4706-b5ca-fa7121ba181a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:14:50.685253 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e5472cd0-8aa5-4706-b5ca-fa7121ba181a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:50.685766 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e5472cd0-8aa5-4706-b5ca-fa7121ba181a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:50.686750 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e5472cd0-8aa5-4706-b5ca-fa7121ba181a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:50.687516 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e5472cd0-8aa5-4706-b5ca-fa7121ba181a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:50.687969 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e5472cd0-8aa5-4706-b5ca-fa7121ba181a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:50.688397 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e5472cd0-8aa5-4706-b5ca-fa7121ba181a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:50.718913 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e5472cd0-8aa5-4706-b5ca-fa7121ba181a tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046775 Oct 26 14:14:50.719488 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3804/7630] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 14:14:50 2022] GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:14:51.731274 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-160884ce-7410-4ecc-a597-ae905ee10c19 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:14:51.733607 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-160884ce-7410-4ecc-a597-ae905ee10c19 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:14:51.740296 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-160884ce-7410-4ecc-a597-ae905ee10c19 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:51.740794 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-160884ce-7410-4ecc-a597-ae905ee10c19 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:51.741245 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-160884ce-7410-4ecc-a597-ae905ee10c19 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:51.741974 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-160884ce-7410-4ecc-a597-ae905ee10c19 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:51.742445 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-160884ce-7410-4ecc-a597-ae905ee10c19 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:51.742886 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-160884ce-7410-4ecc-a597-ae905ee10c19 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:51.771523 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-160884ce-7410-4ecc-a597-ae905ee10c19 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044306 Oct 26 14:14:51.772083 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3827/7631] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 26 14:14:51 2022] GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 14:14:51.783257 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5e8f69ef-17da-44a2-90d6-56cd6865cef7 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:14:51.783744 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5e8f69ef-17da-44a2-90d6-56cd6865cef7 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:14:51.790793 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5e8f69ef-17da-44a2-90d6-56cd6865cef7 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:51.791281 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5e8f69ef-17da-44a2-90d6-56cd6865cef7 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:51.791720 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5e8f69ef-17da-44a2-90d6-56cd6865cef7 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:51.792407 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5e8f69ef-17da-44a2-90d6-56cd6865cef7 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:51.792862 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5e8f69ef-17da-44a2-90d6-56cd6865cef7 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:51.793315 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5e8f69ef-17da-44a2-90d6-56cd6865cef7 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:51.868261 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-5e8f69ef-17da-44a2-90d6-56cd6865cef7 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] HTTP exception thrown: Instance ee93b669-c8c0-4215-82f4-2dcf2d68a10b is not attached to volume ef2e2b7b-8913-4875-898e-d2a103ac54da Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5e8f69ef-17da-44a2-90d6-56cd6865cef7 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Request method failure captured: Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: request: DELETE /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b/os-volume_attachments/ef2e2b7b-8913-4875-898e-d2a103ac54da HTTP/1.1 Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWT9smXbEsRyP43Tg1cfL9l_R_8Yre990l1kmtlC0si1BTz0nBwxXODXkeIghnmCg3dlmpSn27i5nTIgFP_uBW9U916Qe1L5i4pJL8Y0hUkLQheLuKmeZ5TXyUQNYWwGUCuqWdTJSZbmeXKQCDZGPQqWB2xh59denLPA0MEu1rD_97Rg Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: 480d8bdd36324b4ebc2b3cd7953fabe7 Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-TestMinimumBasicScenario-415447413 Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/480d8bdd36324b4ebc2b3cd7953fabe7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/480d8bdd36324b4ebc2b3cd7953fabe7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_480d8bdd36324b4ebc2b3cd7953fabe7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/480d8bdd36324b4ebc2b3cd7953fabe7"}]}] Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-TestMinimumBasicScenario-415447413 Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: 480d8bdd36324b4ebc2b3cd7953fabe7 Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-TestMinimumBasicScenario-415447413 Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-TestMinimumBasicScenario-415447413-project Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 8238828b171840e389ab38164aef51a7 Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-TestMinimumBasicScenario-415447413-project Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance ee93b669-c8c0-4215-82f4-2dcf2d68a10b is not attached to volume ef2e2b7b-8913-4875-898e-d2a103ac54da Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'server_id': 'ee93b669-c8c0-4215-82f4-2dcf2d68a10b', 'id': 'ef2e2b7b-8913-4875-898e-d2a103ac54da'} Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ef2e2b7b-8913-4875-898e-d2a103ac54da. Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee93b669-c8c0-4215-82f4-2dcf2d68a10b is not attached to volume ef2e2b7b-8913-4875-898e-d2a103ac54da Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:14:51.869890 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:14:51.875727 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 14:14:51.875727 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 14:14:51.875727 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee93b669-c8c0-4215-82f4-2dcf2d68a10b is not attached to volume ef2e2b7b-8913-4875-898e-d2a103ac54da Oct 26 14:14:51.875727 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:14:51.875727 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5e8f69ef-17da-44a2-90d6-56cd6865cef7 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Returning 404 to user: Instance ee93b669-c8c0-4215-82f4-2dcf2d68a10b is not attached to volume ef2e2b7b-8913-4875-898e-d2a103ac54da {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 14:14:51.875727 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5e8f69ef-17da-44a2-90d6-56cd6865cef7 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b/os-volume_attachments/ef2e2b7b-8913-4875-898e-d2a103ac54da" status: 404 len: 154 microversion: 2.1 time: 0.092739 Oct 26 14:14:51.875727 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3805/7632] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Oct 26 14:14:51 2022] DELETE /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b/os-volume_attachments/ef2e2b7b-8913-4875-898e-d2a103ac54da => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 14:14:55.125535 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-28e6ff09-3647-4141-b7ca-4cce070e36d1 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:14:55.126097 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-28e6ff09-3647-4141-b7ca-4cce070e36d1 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:14:55.133063 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28e6ff09-3647-4141-b7ca-4cce070e36d1 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:55.133510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28e6ff09-3647-4141-b7ca-4cce070e36d1 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:55.133986 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28e6ff09-3647-4141-b7ca-4cce070e36d1 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:55.134697 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28e6ff09-3647-4141-b7ca-4cce070e36d1 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:55.135163 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28e6ff09-3647-4141-b7ca-4cce070e36d1 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:55.135597 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28e6ff09-3647-4141-b7ca-4cce070e36d1 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:55.163623 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-28e6ff09-3647-4141-b7ca-4cce070e36d1 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 14:14:55.243667 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-28e6ff09-3647-4141-b7ca-4cce070e36d1 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b" status: 204 len: 0 microversion: 2.1 time: 0.122365 Oct 26 14:14:55.244625 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3828/7633] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 14:14:55 2022] DELETE /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 14:14:55.253998 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-83d8d8f9-527a-443e-9ffa-7a41db7bcc25 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:14:55.254616 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-83d8d8f9-527a-443e-9ffa-7a41db7bcc25 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:14:55.262017 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-83d8d8f9-527a-443e-9ffa-7a41db7bcc25 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:55.262490 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-83d8d8f9-527a-443e-9ffa-7a41db7bcc25 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:55.262931 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-83d8d8f9-527a-443e-9ffa-7a41db7bcc25 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:55.263626 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-83d8d8f9-527a-443e-9ffa-7a41db7bcc25 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:55.264099 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-83d8d8f9-527a-443e-9ffa-7a41db7bcc25 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:55.265141 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-83d8d8f9-527a-443e-9ffa-7a41db7bcc25 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:55.398392 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-83d8d8f9-527a-443e-9ffa-7a41db7bcc25 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:14:55.407015 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-83d8d8f9-527a-443e-9ffa-7a41db7bcc25 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b" status: 200 len: 1555 microversion: 2.1 time: 0.156908 Oct 26 14:14:55.407588 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3806/7634] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:14:55 2022] GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 14:14:56.431374 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-48f8ccbe-5f01-4bab-a968-1090dc2c57ab tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:14:56.432092 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-48f8ccbe-5f01-4bab-a968-1090dc2c57ab tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:14:56.438820 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48f8ccbe-5f01-4bab-a968-1090dc2c57ab tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:56.439322 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48f8ccbe-5f01-4bab-a968-1090dc2c57ab tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:56.439771 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48f8ccbe-5f01-4bab-a968-1090dc2c57ab tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:56.440475 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48f8ccbe-5f01-4bab-a968-1090dc2c57ab tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:56.440942 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48f8ccbe-5f01-4bab-a968-1090dc2c57ab tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:56.441383 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48f8ccbe-5f01-4bab-a968-1090dc2c57ab tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:56.578292 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-48f8ccbe-5f01-4bab-a968-1090dc2c57ab tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:14:56.586099 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-48f8ccbe-5f01-4bab-a968-1090dc2c57ab tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b" status: 200 len: 1555 microversion: 2.1 time: 0.159412 Oct 26 14:14:56.586691 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3829/7635] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:14:56 2022] GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:14:57.611218 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5df6d814-889e-4462-919b-47c544d12768 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:14:57.611922 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5df6d814-889e-4462-919b-47c544d12768 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:14:57.619034 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5df6d814-889e-4462-919b-47c544d12768 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:57.619665 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5df6d814-889e-4462-919b-47c544d12768 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:57.620249 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5df6d814-889e-4462-919b-47c544d12768 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:57.621031 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5df6d814-889e-4462-919b-47c544d12768 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:57.621726 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5df6d814-889e-4462-919b-47c544d12768 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:57.622168 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5df6d814-889e-4462-919b-47c544d12768 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:57.638348 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-e53e4949-148e-4f9b-9b45-c8a1cc7e74c5 req-e424e1a0-3743-4564-ae59-d1a9fc1cdc11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee93b669-c8c0-4215-82f4-2dcf2d68a10b", "name": "network-vif-deleted", "tag": "9652650e-b088-4fdc-bb0d-2117c41eb2cf"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:14:57.652598 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e53e4949-148e-4f9b-9b45-c8a1cc7e74c5 req-e424e1a0-3743-4564-ae59-d1a9fc1cdc11 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:57.653427 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e53e4949-148e-4f9b-9b45-c8a1cc7e74c5 req-e424e1a0-3743-4564-ae59-d1a9fc1cdc11 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:57.654090 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e53e4949-148e-4f9b-9b45-c8a1cc7e74c5 req-e424e1a0-3743-4564-ae59-d1a9fc1cdc11 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:57.669523 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-e53e4949-148e-4f9b-9b45-c8a1cc7e74c5 req-e424e1a0-3743-4564-ae59-d1a9fc1cdc11 service nova] Creating event network-vif-deleted:9652650e-b088-4fdc-bb0d-2117c41eb2cf for instance ee93b669-c8c0-4215-82f4-2dcf2d68a10b on n-h2-862686-1 Oct 26 14:14:57.675228 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-e53e4949-148e-4f9b-9b45-c8a1cc7e74c5 req-e424e1a0-3743-4564-ae59-d1a9fc1cdc11 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041294 Oct 26 14:14:57.680224 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3830/7636] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:14:57.693639 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5df6d814-889e-4462-919b-47c544d12768 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8238828b171840e389ab38164aef51a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480d8bdd36324b4ebc2b3cd7953fabe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:14:57.703657 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5df6d814-889e-4462-919b-47c544d12768 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b" status: 200 len: 1513 microversion: 2.1 time: 0.097538 Oct 26 14:14:57.710381 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3807/7637] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:14:57 2022] GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b => generated 1513 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:14:58.728240 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-253cad94-c7e3-46fc-81cf-20a017878218 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:14:58.728958 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-253cad94-c7e3-46fc-81cf-20a017878218 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] [instance: ee93b669-c8c0-4215-82f4-2dcf2d68a10b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:14:58.736505 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-253cad94-c7e3-46fc-81cf-20a017878218 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:58.737012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-253cad94-c7e3-46fc-81cf-20a017878218 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:58.737455 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-253cad94-c7e3-46fc-81cf-20a017878218 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:58.738193 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-253cad94-c7e3-46fc-81cf-20a017878218 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:14:58.738655 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-253cad94-c7e3-46fc-81cf-20a017878218 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:14:58.739089 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-253cad94-c7e3-46fc-81cf-20a017878218 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:14:58.752298 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-253cad94-c7e3-46fc-81cf-20a017878218 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] HTTP exception thrown: Instance ee93b669-c8c0-4215-82f4-2dcf2d68a10b could not be found. Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-253cad94-c7e3-46fc-81cf-20a017878218 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Request method failure captured: Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b HTTP/1.1 Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWT9smXbEsRyP43Tg1cfL9l_R_8Yre990l1kmtlC0si1BTz0nBwxXODXkeIghnmCg3dlmpSn27i5nTIgFP_uBW9U916Qe1L5i4pJL8Y0hUkLQheLuKmeZ5TXyUQNYWwGUCuqWdTJSZbmeXKQCDZGPQqWB2xh59denLPA0MEu1rD_97Rg Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: 480d8bdd36324b4ebc2b3cd7953fabe7 Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-TestMinimumBasicScenario-415447413 Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/480d8bdd36324b4ebc2b3cd7953fabe7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/480d8bdd36324b4ebc2b3cd7953fabe7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_480d8bdd36324b4ebc2b3cd7953fabe7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/480d8bdd36324b4ebc2b3cd7953fabe7"}]}] Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-TestMinimumBasicScenario-415447413 Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: 480d8bdd36324b4ebc2b3cd7953fabe7 Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-TestMinimumBasicScenario-415447413 Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-TestMinimumBasicScenario-415447413-project Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 8238828b171840e389ab38164aef51a7 Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-TestMinimumBasicScenario-415447413-project Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance ee93b669-c8c0-4215-82f4-2dcf2d68a10b could not be found. Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'ee93b669-c8c0-4215-82f4-2dcf2d68a10b'} Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee93b669-c8c0-4215-82f4-2dcf2d68a10b could not be found. Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee93b669-c8c0-4215-82f4-2dcf2d68a10b could not be found. Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:14:58.753937 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:14:58.759266 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:14:58.759266 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:14:58.759266 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:14:58.759266 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 14:14:58.759266 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 14:14:58.759266 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee93b669-c8c0-4215-82f4-2dcf2d68a10b could not be found. Oct 26 14:14:58.759266 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:14:58.759266 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-253cad94-c7e3-46fc-81cf-20a017878218 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Returning 404 to user: Instance ee93b669-c8c0-4215-82f4-2dcf2d68a10b could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 14:14:58.759266 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-253cad94-c7e3-46fc-81cf-20a017878218 tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b" status: 404 len: 111 microversion: 2.1 time: 0.031385 Oct 26 14:14:58.759266 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3831/7638] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:14:58 2022] GET /compute/v2.1/servers/ee93b669-c8c0-4215-82f4-2dcf2d68a10b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 14:14:58.765541 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-df969540-794a-4c4a-8ee9-2446c4a1f88b tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] Calling method '.version_select at 0x7f6731197e50>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:14:58.786255 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-df969540-794a-4c4a-8ee9-2446c4a1f88b tempest-TestMinimumBasicScenario-415447413 tempest-TestMinimumBasicScenario-415447413-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1730186299" status: 202 len: 0 microversion: 2.1 time: 0.025506 Oct 26 14:14:58.786834 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3808/7639] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 26 14:14:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1730186299 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 14:15:08.061740 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4d174ca0-3fac-4ce2-83a8-88d93737f1d4 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Action: 'create', calling method: .version_select at 0x7f67310c9b80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-921057030", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkn2sur+8ShAP9eZx88LaIb1fjWnC4ECfqGKmQ/EZ1my8XaL2W2uHNdc/DuSZuqW61NZ21hONVm6UiindLN9ofbbHEqtyCOrqc5vp/j6VBkjU2wNKuPHj7BBrYigBgNqA=="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:15:08.077670 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-4d174ca0-3fac-4ce2-83a8-88d93737f1d4 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Getting quotas for project ba91e9b802254871b5153158707cb180. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 14:15:08.083647 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-4d174ca0-3fac-4ce2-83a8-88d93737f1d4 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Getting quotas for user 18876f18c54a4579a554e52225b24c74 and project ba91e9b802254871b5153158707cb180. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 14:15:08.108088 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4d174ca0-3fac-4ce2-83a8-88d93737f1d4 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.217506 Oct 26 14:15:08.108722 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3832/7640] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 14:15:07 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:15:14.178611 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=40 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:15:14.180129 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:15:14.184396 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3bd5c3a9-a466-4755-9936-fbfbed2900b2 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1575758142", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "0c912ca4-e686-43b1-af29-e3d59762a887"}], "key_name": "tempest-TestNetworkAdvancedServerOps-921057030", "security_groups": [{"name": "tempest-secgroup-smoke-30529779"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:15:14.317167 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-3bd5c3a9-a466-4755-9936-fbfbed2900b2 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] validate_networks() for [('0c912ca4-e686-43b1-af29-e3d59762a887', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 14:15:14.714749 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-3bd5c3a9-a466-4755-9936-fbfbed2900b2 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 14:15:14.715270 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-3bd5c3a9-a466-4755-9936-fbfbed2900b2 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 14:15:14.715850 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-3bd5c3a9-a466-4755-9936-fbfbed2900b2 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 14:15:14.716589 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-3bd5c3a9-a466-4755-9936-fbfbed2900b2 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 14:15:14.717125 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-3bd5c3a9-a466-4755-9936-fbfbed2900b2 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 14:15:14.726995 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3bd5c3a9-a466-4755-9936-fbfbed2900b2 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:15:14.727487 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3bd5c3a9-a466-4755-9936-fbfbed2900b2 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:15:14.728135 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3bd5c3a9-a466-4755-9936-fbfbed2900b2 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:15:14.728964 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3bd5c3a9-a466-4755-9936-fbfbed2900b2 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:15:14.729317 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3bd5c3a9-a466-4755-9936-fbfbed2900b2 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:15:14.729779 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3bd5c3a9-a466-4755-9936-fbfbed2900b2 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:15:14.750040 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-3bd5c3a9-a466-4755-9936-fbfbed2900b2 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Getting quotas for project ba91e9b802254871b5153158707cb180. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 14:15:14.755381 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-3bd5c3a9-a466-4755-9936-fbfbed2900b2 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Getting quotas for user 18876f18c54a4579a554e52225b24c74 and project ba91e9b802254871b5153158707cb180. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 14:15:14.769819 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3bd5c3a9-a466-4755-9936-fbfbed2900b2 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 14:15:14.771821 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3bd5c3a9-a466-4755-9936-fbfbed2900b2 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 0fe1d46e-50b3-4fbc-8556-8c64b571cf00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 14:15:14.823238 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3bd5c3a9-a466-4755-9936-fbfbed2900b2 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.646404 Oct 26 14:15:14.824092 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3809/7641] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 14:15:14 2022] POST /compute/v2.1/servers => generated 404 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 14:15:14.833161 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:15:14.838199 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-70107185-b159-400f-ba19-0673928679f2 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:15:14.839061 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-70107185-b159-400f-ba19-0673928679f2 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 0fe1d46e-50b3-4fbc-8556-8c64b571cf00] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:15:14.841129 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:15:14.913935 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-70107185-b159-400f-ba19-0673928679f2 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:15:14.923240 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-70107185-b159-400f-ba19-0673928679f2 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00" status: 200 len: 1266 microversion: 2.1 time: 0.090842 Oct 26 14:15:14.923828 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3833/7642] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:15:14 2022] GET /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00 => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:15:15.947495 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-08a4da50-8086-4f91-b37d-95574c0d87cf tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:15:15.948106 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-08a4da50-8086-4f91-b37d-95574c0d87cf tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 0fe1d46e-50b3-4fbc-8556-8c64b571cf00] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:15:15.958595 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-08a4da50-8086-4f91-b37d-95574c0d87cf tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:15:15.959088 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-08a4da50-8086-4f91-b37d-95574c0d87cf tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:15:15.959531 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-08a4da50-8086-4f91-b37d-95574c0d87cf tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:15:15.960251 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-08a4da50-8086-4f91-b37d-95574c0d87cf tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:15:15.960715 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-08a4da50-8086-4f91-b37d-95574c0d87cf tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:15:15.961143 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-08a4da50-8086-4f91-b37d-95574c0d87cf tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:15:16.032058 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-08a4da50-8086-4f91-b37d-95574c0d87cf tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:15:16.044312 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-08a4da50-8086-4f91-b37d-95574c0d87cf tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00" status: 200 len: 1318 microversion: 2.1 time: 0.101459 Oct 26 14:15:16.045102 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3810/7643] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:15:15 2022] GET /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00 => generated 1318 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:15:17.069555 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cfe9be98-d87c-4b55-941f-c80f564713dc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:15:17.070723 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cfe9be98-d87c-4b55-941f-c80f564713dc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 0fe1d46e-50b3-4fbc-8556-8c64b571cf00] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:15:17.082456 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cfe9be98-d87c-4b55-941f-c80f564713dc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:15:17.083618 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cfe9be98-d87c-4b55-941f-c80f564713dc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:15:17.084266 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cfe9be98-d87c-4b55-941f-c80f564713dc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:15:17.085806 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cfe9be98-d87c-4b55-941f-c80f564713dc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:15:17.086294 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cfe9be98-d87c-4b55-941f-c80f564713dc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:15:17.086744 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cfe9be98-d87c-4b55-941f-c80f564713dc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:15:17.356166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-cfe9be98-d87c-4b55-941f-c80f564713dc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:15:17.364551 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cfe9be98-d87c-4b55-941f-c80f564713dc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00" status: 200 len: 1390 microversion: 2.1 time: 0.300099 Oct 26 14:15:17.365144 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3834/7644] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:15:17 2022] GET /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00 => generated 1390 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:15:17.758388 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-04782c30-cd7f-4e33-b3ed-c5c10ad23847 req-5a4d1ea5-79d8-402b-9f6a-e9b245c02a9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fe1d46e-50b3-4fbc-8556-8c64b571cf00", "tag": "5c7b145d-a9bc-42fd-b207-dc17051e1c5d"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:15:17.771396 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-04782c30-cd7f-4e33-b3ed-c5c10ad23847 req-5a4d1ea5-79d8-402b-9f6a-e9b245c02a9f service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:15:17.771872 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-04782c30-cd7f-4e33-b3ed-c5c10ad23847 req-5a4d1ea5-79d8-402b-9f6a-e9b245c02a9f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:15:17.772299 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-04782c30-cd7f-4e33-b3ed-c5c10ad23847 req-5a4d1ea5-79d8-402b-9f6a-e9b245c02a9f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:15:17.785708 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-04782c30-cd7f-4e33-b3ed-c5c10ad23847 req-5a4d1ea5-79d8-402b-9f6a-e9b245c02a9f service nova] Creating event network-changed:5c7b145d-a9bc-42fd-b207-dc17051e1c5d for instance 0fe1d46e-50b3-4fbc-8556-8c64b571cf00 on n-h1-862686-1 Oct 26 14:15:17.791055 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-04782c30-cd7f-4e33-b3ed-c5c10ad23847 req-5a4d1ea5-79d8-402b-9f6a-e9b245c02a9f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037131 Oct 26 14:15:17.791666 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3811/7645] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:15:18.388304 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-236edf45-f1cb-411f-a90f-2b84acebdccc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:15:18.389016 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-236edf45-f1cb-411f-a90f-2b84acebdccc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 0fe1d46e-50b3-4fbc-8556-8c64b571cf00] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:15:18.396074 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-236edf45-f1cb-411f-a90f-2b84acebdccc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:15:18.396570 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-236edf45-f1cb-411f-a90f-2b84acebdccc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:15:18.397017 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-236edf45-f1cb-411f-a90f-2b84acebdccc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:15:18.397832 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-236edf45-f1cb-411f-a90f-2b84acebdccc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:15:18.398298 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-236edf45-f1cb-411f-a90f-2b84acebdccc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:15:18.398740 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-236edf45-f1cb-411f-a90f-2b84acebdccc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:15:18.528929 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-236edf45-f1cb-411f-a90f-2b84acebdccc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:15:18.537473 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-236edf45-f1cb-411f-a90f-2b84acebdccc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00" status: 200 len: 1390 microversion: 2.1 time: 0.153157 Oct 26 14:15:18.538330 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3835/7646] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:15:18 2022] GET /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00 => generated 1390 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:15:19.561941 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8bd45d12-6c6b-45f4-bf03-3b587d52566b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:15:19.562809 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8bd45d12-6c6b-45f4-bf03-3b587d52566b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 0fe1d46e-50b3-4fbc-8556-8c64b571cf00] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:15:19.570379 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8bd45d12-6c6b-45f4-bf03-3b587d52566b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:15:19.570867 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8bd45d12-6c6b-45f4-bf03-3b587d52566b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:15:19.571308 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8bd45d12-6c6b-45f4-bf03-3b587d52566b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:15:19.572014 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8bd45d12-6c6b-45f4-bf03-3b587d52566b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:15:19.572473 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8bd45d12-6c6b-45f4-bf03-3b587d52566b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:15:19.572904 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8bd45d12-6c6b-45f4-bf03-3b587d52566b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:15:19.710483 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8bd45d12-6c6b-45f4-bf03-3b587d52566b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:15:19.718364 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8bd45d12-6c6b-45f4-bf03-3b587d52566b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00" status: 200 len: 1390 microversion: 2.1 time: 0.161460 Oct 26 14:15:19.718947 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3812/7647] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:15:19 2022] GET /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00 => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:15:20.741462 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ea3732c8-7896-4ca9-992e-d2c3f7a97c65 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:15:20.742107 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ea3732c8-7896-4ca9-992e-d2c3f7a97c65 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 0fe1d46e-50b3-4fbc-8556-8c64b571cf00] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:15:20.749547 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ea3732c8-7896-4ca9-992e-d2c3f7a97c65 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:15:20.750040 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ea3732c8-7896-4ca9-992e-d2c3f7a97c65 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:15:20.750489 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ea3732c8-7896-4ca9-992e-d2c3f7a97c65 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:15:20.751188 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ea3732c8-7896-4ca9-992e-d2c3f7a97c65 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:15:20.751653 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ea3732c8-7896-4ca9-992e-d2c3f7a97c65 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:15:20.752088 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ea3732c8-7896-4ca9-992e-d2c3f7a97c65 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:15:20.882463 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ea3732c8-7896-4ca9-992e-d2c3f7a97c65 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:15:20.890756 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ea3732c8-7896-4ca9-992e-d2c3f7a97c65 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00" status: 200 len: 1390 microversion: 2.1 time: 0.153241 Oct 26 14:15:20.891325 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3836/7648] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:15:20 2022] GET /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00 => generated 1390 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:15:21.914262 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dadc8a9a-4006-4d28-b66f-db2581fe7221 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:15:21.914883 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-dadc8a9a-4006-4d28-b66f-db2581fe7221 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 0fe1d46e-50b3-4fbc-8556-8c64b571cf00] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:15:21.921813 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dadc8a9a-4006-4d28-b66f-db2581fe7221 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:15:21.922314 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dadc8a9a-4006-4d28-b66f-db2581fe7221 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:15:21.922737 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dadc8a9a-4006-4d28-b66f-db2581fe7221 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:15:21.923426 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dadc8a9a-4006-4d28-b66f-db2581fe7221 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:15:21.923884 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dadc8a9a-4006-4d28-b66f-db2581fe7221 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:15:21.924309 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dadc8a9a-4006-4d28-b66f-db2581fe7221 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:15:22.059653 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-dadc8a9a-4006-4d28-b66f-db2581fe7221 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:15:22.068091 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-dadc8a9a-4006-4d28-b66f-db2581fe7221 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00" status: 200 len: 1390 microversion: 2.1 time: 0.158172 Oct 26 14:15:22.068680 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3813/7649] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:15:21 2022] GET /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00 => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:15:23.092695 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4487098a-0433-4ab5-86fc-a141990f4350 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:15:23.093331 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4487098a-0433-4ab5-86fc-a141990f4350 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 0fe1d46e-50b3-4fbc-8556-8c64b571cf00] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:15:23.100217 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4487098a-0433-4ab5-86fc-a141990f4350 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:15:23.100732 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4487098a-0433-4ab5-86fc-a141990f4350 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:15:23.101180 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4487098a-0433-4ab5-86fc-a141990f4350 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:15:23.101903 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4487098a-0433-4ab5-86fc-a141990f4350 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:15:23.102362 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4487098a-0433-4ab5-86fc-a141990f4350 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:15:23.102803 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4487098a-0433-4ab5-86fc-a141990f4350 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:15:23.238145 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4487098a-0433-4ab5-86fc-a141990f4350 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:15:23.245790 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4487098a-0433-4ab5-86fc-a141990f4350 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00" status: 200 len: 1390 microversion: 2.1 time: 0.157603 Oct 26 14:15:23.246495 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3837/7650] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:15:23 2022] GET /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00 => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:15:23.850628 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-35dd7d77-de94-4299-9049-e06520a731c8 req-a39d2bd4-b21c-451a-aba4-9e6770b0c317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fe1d46e-50b3-4fbc-8556-8c64b571cf00", "name": "network-vif-plugged", "status": "completed", "tag": "5c7b145d-a9bc-42fd-b207-dc17051e1c5d"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:15:23.865701 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-35dd7d77-de94-4299-9049-e06520a731c8 req-a39d2bd4-b21c-451a-aba4-9e6770b0c317 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:15:23.866394 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-35dd7d77-de94-4299-9049-e06520a731c8 req-a39d2bd4-b21c-451a-aba4-9e6770b0c317 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:15:23.866835 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-35dd7d77-de94-4299-9049-e06520a731c8 req-a39d2bd4-b21c-451a-aba4-9e6770b0c317 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:15:23.879121 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-35dd7d77-de94-4299-9049-e06520a731c8 req-a39d2bd4-b21c-451a-aba4-9e6770b0c317 service nova] Creating event network-vif-plugged:5c7b145d-a9bc-42fd-b207-dc17051e1c5d for instance 0fe1d46e-50b3-4fbc-8556-8c64b571cf00 on n-h1-862686-1 Oct 26 14:15:23.884082 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-35dd7d77-de94-4299-9049-e06520a731c8 req-a39d2bd4-b21c-451a-aba4-9e6770b0c317 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037265 Oct 26 14:15:23.884969 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3814/7651] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:15:24.268303 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0e55c854-715b-4864-b809-b14a86aff6c8 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:15:24.268959 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0e55c854-715b-4864-b809-b14a86aff6c8 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 0fe1d46e-50b3-4fbc-8556-8c64b571cf00] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:15:24.275962 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0e55c854-715b-4864-b809-b14a86aff6c8 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:15:24.276465 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0e55c854-715b-4864-b809-b14a86aff6c8 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:15:24.276914 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0e55c854-715b-4864-b809-b14a86aff6c8 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:15:24.277672 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0e55c854-715b-4864-b809-b14a86aff6c8 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:15:24.278143 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0e55c854-715b-4864-b809-b14a86aff6c8 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:15:24.278583 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0e55c854-715b-4864-b809-b14a86aff6c8 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:15:24.416395 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0e55c854-715b-4864-b809-b14a86aff6c8 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:15:24.424719 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0e55c854-715b-4864-b809-b14a86aff6c8 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00" status: 200 len: 1390 microversion: 2.1 time: 0.160328 Oct 26 14:15:24.425313 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3838/7652] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:15:24 2022] GET /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00 => generated 1390 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:15:25.448934 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-86ec2c01-7e44-477d-894b-2b2a1e13073b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:15:25.449659 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-86ec2c01-7e44-477d-894b-2b2a1e13073b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 0fe1d46e-50b3-4fbc-8556-8c64b571cf00] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:15:25.452629 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:15:25.453294 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:15:25.460807 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-86ec2c01-7e44-477d-894b-2b2a1e13073b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:15:25.461290 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-86ec2c01-7e44-477d-894b-2b2a1e13073b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:15:25.461753 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-86ec2c01-7e44-477d-894b-2b2a1e13073b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:15:25.462438 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-86ec2c01-7e44-477d-894b-2b2a1e13073b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:15:25.462890 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-86ec2c01-7e44-477d-894b-2b2a1e13073b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:15:25.463311 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-86ec2c01-7e44-477d-894b-2b2a1e13073b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:15:25.596561 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-86ec2c01-7e44-477d-894b-2b2a1e13073b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:15:25.604491 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-86ec2c01-7e44-477d-894b-2b2a1e13073b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00" status: 200 len: 1562 microversion: 2.1 time: 0.159804 Oct 26 14:15:25.605074 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3815/7653] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:15:25 2022] GET /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00 => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:15:25.628761 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-175133c5-5f9c-4308-b104-604f6cf0e9d5 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:15:25.629416 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-175133c5-5f9c-4308-b104-604f6cf0e9d5 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 0fe1d46e-50b3-4fbc-8556-8c64b571cf00] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:15:25.631272 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:15:25.637423 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-175133c5-5f9c-4308-b104-604f6cf0e9d5 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:15:25.637955 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-175133c5-5f9c-4308-b104-604f6cf0e9d5 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:15:25.638456 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-175133c5-5f9c-4308-b104-604f6cf0e9d5 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:15:25.639226 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-175133c5-5f9c-4308-b104-604f6cf0e9d5 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:15:25.639695 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-175133c5-5f9c-4308-b104-604f6cf0e9d5 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:15:25.640133 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-175133c5-5f9c-4308-b104-604f6cf0e9d5 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:15:25.772960 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-175133c5-5f9c-4308-b104-604f6cf0e9d5 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:15:25.780966 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-175133c5-5f9c-4308-b104-604f6cf0e9d5 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00" status: 200 len: 1562 microversion: 2.1 time: 0.156145 Oct 26 14:15:25.781560 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3839/7654] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:15:25 2022] GET /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00 => generated 1562 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:15:27.629952 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-08521b41-349b-451a-8d39-3da564459650 req-8ea46781-0228-4be0-a9c1-7a7d62ddaadf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fe1d46e-50b3-4fbc-8556-8c64b571cf00", "tag": "5c7b145d-a9bc-42fd-b207-dc17051e1c5d"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:15:27.635630 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-68dc1316-d347-4b51-b4fb-8954fb0272dc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:15:27.636849 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-68dc1316-d347-4b51-b4fb-8954fb0272dc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 0fe1d46e-50b3-4fbc-8556-8c64b571cf00] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:15:27.650861 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-08521b41-349b-451a-8d39-3da564459650 req-8ea46781-0228-4be0-a9c1-7a7d62ddaadf service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:15:27.651116 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-68dc1316-d347-4b51-b4fb-8954fb0272dc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:15:27.651355 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-08521b41-349b-451a-8d39-3da564459650 req-8ea46781-0228-4be0-a9c1-7a7d62ddaadf service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:15:27.651730 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-68dc1316-d347-4b51-b4fb-8954fb0272dc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:15:27.651864 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-08521b41-349b-451a-8d39-3da564459650 req-8ea46781-0228-4be0-a9c1-7a7d62ddaadf service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:15:27.652447 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-68dc1316-d347-4b51-b4fb-8954fb0272dc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:15:27.653412 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-68dc1316-d347-4b51-b4fb-8954fb0272dc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:15:27.654313 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-68dc1316-d347-4b51-b4fb-8954fb0272dc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:15:27.655379 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-68dc1316-d347-4b51-b4fb-8954fb0272dc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:15:27.663732 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-08521b41-349b-451a-8d39-3da564459650 req-8ea46781-0228-4be0-a9c1-7a7d62ddaadf service nova] Creating event network-changed:5c7b145d-a9bc-42fd-b207-dc17051e1c5d for instance 0fe1d46e-50b3-4fbc-8556-8c64b571cf00 on n-h1-862686-1 Oct 26 14:15:27.669151 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-08521b41-349b-451a-8d39-3da564459650 req-8ea46781-0228-4be0-a9c1-7a7d62ddaadf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043628 Oct 26 14:15:27.670087 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3840/7655] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 14:15:27.817407 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-68dc1316-d347-4b51-b4fb-8954fb0272dc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:15:27.825201 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-68dc1316-d347-4b51-b4fb-8954fb0272dc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00" status: 200 len: 1562 microversion: 2.1 time: 0.203386 Oct 26 14:15:27.842185 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3816/7656] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:15:27 2022] GET /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00 => generated 1562 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:15:51.133798 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=17 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:15:51.134566 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=38 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:15:51.138886 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1a4ed05a-e640-4a41-afd6-d193e65315af tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:15:51.141804 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1a4ed05a-e640-4a41-afd6-d193e65315af tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 0fe1d46e-50b3-4fbc-8556-8c64b571cf00] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:15:51.148696 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a4ed05a-e640-4a41-afd6-d193e65315af tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:15:51.149196 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a4ed05a-e640-4a41-afd6-d193e65315af tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:15:51.149717 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a4ed05a-e640-4a41-afd6-d193e65315af tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:15:51.150427 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a4ed05a-e640-4a41-afd6-d193e65315af tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:15:51.150895 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a4ed05a-e640-4a41-afd6-d193e65315af tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:15:51.151334 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1a4ed05a-e640-4a41-afd6-d193e65315af tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:15:51.204141 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1a4ed05a-e640-4a41-afd6-d193e65315af tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "POST /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00/action" status: 200 len: 24579 microversion: 2.1 time: 0.072131 Oct 26 14:15:51.205071 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3841/7657] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 14:15:51 2022] POST /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00/action => generated 24579 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 14:16:01.909465 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8f32e72c-aff4-4fa2-8a08-5337e2a902a9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:16:01.910063 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8f32e72c-aff4-4fa2-8a08-5337e2a902a9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 0fe1d46e-50b3-4fbc-8556-8c64b571cf00] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:16:01.912289 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:16:01.913197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=36 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:16:01.919508 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8f32e72c-aff4-4fa2-8a08-5337e2a902a9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:01.919989 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8f32e72c-aff4-4fa2-8a08-5337e2a902a9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:01.920425 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8f32e72c-aff4-4fa2-8a08-5337e2a902a9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:01.921112 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8f32e72c-aff4-4fa2-8a08-5337e2a902a9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:01.921650 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8f32e72c-aff4-4fa2-8a08-5337e2a902a9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:01.922083 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8f32e72c-aff4-4fa2-8a08-5337e2a902a9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:01.990286 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8f32e72c-aff4-4fa2-8a08-5337e2a902a9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "POST /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00/action" status: 202 len: 0 microversion: 2.1 time: 0.084927 Oct 26 14:16:01.991260 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3817/7658] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 14:16:01 2022] POST /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 14:16:02.000881 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-988f8e80-2c78-461f-94c1-8cb1f2ae2b7d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:16:02.001792 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-988f8e80-2c78-461f-94c1-8cb1f2ae2b7d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 0fe1d46e-50b3-4fbc-8556-8c64b571cf00] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:16:02.004481 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:16:02.005211 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=4 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:16:02.012159 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-988f8e80-2c78-461f-94c1-8cb1f2ae2b7d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:02.012669 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-988f8e80-2c78-461f-94c1-8cb1f2ae2b7d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:02.013128 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-988f8e80-2c78-461f-94c1-8cb1f2ae2b7d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:02.013878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-988f8e80-2c78-461f-94c1-8cb1f2ae2b7d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:02.014356 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-988f8e80-2c78-461f-94c1-8cb1f2ae2b7d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:02.014807 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-988f8e80-2c78-461f-94c1-8cb1f2ae2b7d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:02.152396 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-988f8e80-2c78-461f-94c1-8cb1f2ae2b7d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:16:02.161076 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-988f8e80-2c78-461f-94c1-8cb1f2ae2b7d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00" status: 200 len: 1686 microversion: 2.1 time: 0.165075 Oct 26 14:16:02.161703 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3842/7659] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:16:01 2022] GET /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00 => generated 1686 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:16:03.186567 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-72dfd30d-468b-4664-b151-44c49c0344fe tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:16:03.187680 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-72dfd30d-468b-4664-b151-44c49c0344fe tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 0fe1d46e-50b3-4fbc-8556-8c64b571cf00] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:16:03.195083 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-72dfd30d-468b-4664-b151-44c49c0344fe tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:03.195565 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-72dfd30d-468b-4664-b151-44c49c0344fe tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:03.196003 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-72dfd30d-468b-4664-b151-44c49c0344fe tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:03.196696 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-72dfd30d-468b-4664-b151-44c49c0344fe tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:03.197148 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-72dfd30d-468b-4664-b151-44c49c0344fe tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:03.197597 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-72dfd30d-468b-4664-b151-44c49c0344fe tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:03.332818 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-72dfd30d-468b-4664-b151-44c49c0344fe tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:16:03.341093 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-72dfd30d-468b-4664-b151-44c49c0344fe tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00" status: 200 len: 1666 microversion: 2.1 time: 0.158925 Oct 26 14:16:03.341698 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3818/7660] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:16:03 2022] GET /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00 => generated 1666 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:16:04.434293 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f04e6062-bd02-48fb-a91e-a9f4f186339c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:16:04.436481 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f04e6062-bd02-48fb-a91e-a9f4f186339c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 0fe1d46e-50b3-4fbc-8556-8c64b571cf00] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:16:04.444799 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f04e6062-bd02-48fb-a91e-a9f4f186339c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:04.445292 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f04e6062-bd02-48fb-a91e-a9f4f186339c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:04.445776 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f04e6062-bd02-48fb-a91e-a9f4f186339c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:04.446474 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f04e6062-bd02-48fb-a91e-a9f4f186339c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:04.446936 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f04e6062-bd02-48fb-a91e-a9f4f186339c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:04.447368 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f04e6062-bd02-48fb-a91e-a9f4f186339c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:04.505432 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f04e6062-bd02-48fb-a91e-a9f4f186339c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "POST /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00/action" status: 200 len: 32642 microversion: 2.1 time: 0.074926 Oct 26 14:16:04.506121 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3843/7661] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 14:16:04 2022] POST /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00/action => generated 32642 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 14:16:04.517845 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7783a169-2743-433b-b0fd-571802530853 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:16:04.518413 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7783a169-2743-433b-b0fd-571802530853 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 0fe1d46e-50b3-4fbc-8556-8c64b571cf00] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:16:04.525222 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7783a169-2743-433b-b0fd-571802530853 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:04.525735 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7783a169-2743-433b-b0fd-571802530853 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:04.526175 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7783a169-2743-433b-b0fd-571802530853 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:04.526865 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7783a169-2743-433b-b0fd-571802530853 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:04.527316 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7783a169-2743-433b-b0fd-571802530853 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:04.527739 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7783a169-2743-433b-b0fd-571802530853 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:04.592084 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7783a169-2743-433b-b0fd-571802530853 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "POST /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00/action" status: 202 len: 0 microversion: 2.1 time: 0.078058 Oct 26 14:16:04.592704 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3819/7662] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 14:16:04 2022] POST /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 14:16:04.603039 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3b01d81a-c67a-414f-b952-ede219c39458 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:16:04.603684 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3b01d81a-c67a-414f-b952-ede219c39458 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 0fe1d46e-50b3-4fbc-8556-8c64b571cf00] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:16:04.611519 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b01d81a-c67a-414f-b952-ede219c39458 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:04.612021 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b01d81a-c67a-414f-b952-ede219c39458 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:04.612864 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b01d81a-c67a-414f-b952-ede219c39458 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:04.613910 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b01d81a-c67a-414f-b952-ede219c39458 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:04.614620 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b01d81a-c67a-414f-b952-ede219c39458 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:04.615163 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b01d81a-c67a-414f-b952-ede219c39458 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:04.756016 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3b01d81a-c67a-414f-b952-ede219c39458 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:16:04.764048 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3b01d81a-c67a-414f-b952-ede219c39458 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00" status: 200 len: 1673 microversion: 2.1 time: 0.166110 Oct 26 14:16:04.764762 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3844/7663] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:16:04 2022] GET /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00 => generated 1673 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:16:05.789414 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4819a2a3-1785-4545-bfc4-8155a2928b2d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:16:05.790173 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4819a2a3-1785-4545-bfc4-8155a2928b2d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 0fe1d46e-50b3-4fbc-8556-8c64b571cf00] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:16:05.796451 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4819a2a3-1785-4545-bfc4-8155a2928b2d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:05.796929 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4819a2a3-1785-4545-bfc4-8155a2928b2d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:05.797365 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4819a2a3-1785-4545-bfc4-8155a2928b2d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:05.798079 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4819a2a3-1785-4545-bfc4-8155a2928b2d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:05.798525 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4819a2a3-1785-4545-bfc4-8155a2928b2d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:05.798944 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4819a2a3-1785-4545-bfc4-8155a2928b2d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:05.933194 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4819a2a3-1785-4545-bfc4-8155a2928b2d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:16:05.941682 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4819a2a3-1785-4545-bfc4-8155a2928b2d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00" status: 200 len: 1681 microversion: 2.1 time: 0.157661 Oct 26 14:16:05.942350 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3820/7664] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:16:05 2022] GET /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:16:06.035639 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-189f545e-25a3-472b-9d94-fba29c91e484 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:16:06.037853 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-189f545e-25a3-472b-9d94-fba29c91e484 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 0fe1d46e-50b3-4fbc-8556-8c64b571cf00] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:16:06.048856 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-189f545e-25a3-472b-9d94-fba29c91e484 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:06.049348 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-189f545e-25a3-472b-9d94-fba29c91e484 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:06.049949 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-189f545e-25a3-472b-9d94-fba29c91e484 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:06.050657 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-189f545e-25a3-472b-9d94-fba29c91e484 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:06.051124 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-189f545e-25a3-472b-9d94-fba29c91e484 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:06.051561 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-189f545e-25a3-472b-9d94-fba29c91e484 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:06.110498 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-189f545e-25a3-472b-9d94-fba29c91e484 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "POST /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00/action" status: 200 len: 38402 microversion: 2.1 time: 0.078658 Oct 26 14:16:06.111179 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3845/7665] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 14:16:06 2022] POST /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00/action => generated 38402 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 14:16:07.117249 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-05b080cc-7979-426d-b253-6ff94cabcf94 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:16:07.117796 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-05b080cc-7979-426d-b253-6ff94cabcf94 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 0fe1d46e-50b3-4fbc-8556-8c64b571cf00] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:16:07.119512 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-defbffe3-8e2d-4586-9577-ffe513c6b065 req-58f8e072-dd88-452e-869e-3990caa6be0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fe1d46e-50b3-4fbc-8556-8c64b571cf00", "tag": "5c7b145d-a9bc-42fd-b207-dc17051e1c5d"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:16:07.126251 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05b080cc-7979-426d-b253-6ff94cabcf94 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:07.126748 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05b080cc-7979-426d-b253-6ff94cabcf94 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:07.127197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05b080cc-7979-426d-b253-6ff94cabcf94 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:07.127913 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05b080cc-7979-426d-b253-6ff94cabcf94 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:07.128375 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05b080cc-7979-426d-b253-6ff94cabcf94 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:07.129023 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-05b080cc-7979-426d-b253-6ff94cabcf94 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:07.132770 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-defbffe3-8e2d-4586-9577-ffe513c6b065 req-58f8e072-dd88-452e-869e-3990caa6be0c service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:07.133539 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-defbffe3-8e2d-4586-9577-ffe513c6b065 req-58f8e072-dd88-452e-869e-3990caa6be0c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:07.134189 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-defbffe3-8e2d-4586-9577-ffe513c6b065 req-58f8e072-dd88-452e-869e-3990caa6be0c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:07.147596 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-defbffe3-8e2d-4586-9577-ffe513c6b065 req-58f8e072-dd88-452e-869e-3990caa6be0c service nova] Creating event network-changed:5c7b145d-a9bc-42fd-b207-dc17051e1c5d for instance 0fe1d46e-50b3-4fbc-8556-8c64b571cf00 on n-h1-862686-1 Oct 26 14:16:07.152498 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-defbffe3-8e2d-4586-9577-ffe513c6b065 req-58f8e072-dd88-452e-869e-3990caa6be0c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037212 Oct 26 14:16:07.153422 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3846/7666] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 14:16:07.157402 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-05b080cc-7979-426d-b253-6ff94cabcf94 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 0fe1d46e-50b3-4fbc-8556-8c64b571cf00] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 14:16:07.249966 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-05b080cc-7979-426d-b253-6ff94cabcf94 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00" status: 204 len: 0 microversion: 2.1 time: 0.135691 Oct 26 14:16:07.251799 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3821/7667] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 14:16:07 2022] DELETE /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 14:16:07.260201 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-55e30c7f-bc08-4673-ad4b-fb626accb9dc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:16:07.260917 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-55e30c7f-bc08-4673-ad4b-fb626accb9dc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 0fe1d46e-50b3-4fbc-8556-8c64b571cf00] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:16:07.268935 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55e30c7f-bc08-4673-ad4b-fb626accb9dc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:07.269437 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55e30c7f-bc08-4673-ad4b-fb626accb9dc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:07.269915 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55e30c7f-bc08-4673-ad4b-fb626accb9dc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:07.270632 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55e30c7f-bc08-4673-ad4b-fb626accb9dc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:07.271099 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55e30c7f-bc08-4673-ad4b-fb626accb9dc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:07.271534 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-55e30c7f-bc08-4673-ad4b-fb626accb9dc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:07.428297 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-55e30c7f-bc08-4673-ad4b-fb626accb9dc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:16:07.436178 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-55e30c7f-bc08-4673-ad4b-fb626accb9dc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00" status: 200 len: 1687 microversion: 2.1 time: 0.180248 Oct 26 14:16:07.436765 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3847/7668] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:16:07 2022] GET /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00 => generated 1687 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:16:08.462114 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1a7e4996-385c-4376-b6f8-d40e3ff5cc87 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:16:08.462695 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1a7e4996-385c-4376-b6f8-d40e3ff5cc87 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 0fe1d46e-50b3-4fbc-8556-8c64b571cf00] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:16:08.470165 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a7e4996-385c-4376-b6f8-d40e3ff5cc87 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:08.470644 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a7e4996-385c-4376-b6f8-d40e3ff5cc87 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:08.471079 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a7e4996-385c-4376-b6f8-d40e3ff5cc87 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:08.471767 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a7e4996-385c-4376-b6f8-d40e3ff5cc87 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:08.472218 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a7e4996-385c-4376-b6f8-d40e3ff5cc87 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:08.472639 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a7e4996-385c-4376-b6f8-d40e3ff5cc87 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:08.606462 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1a7e4996-385c-4376-b6f8-d40e3ff5cc87 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:16:08.614380 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1a7e4996-385c-4376-b6f8-d40e3ff5cc87 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00" status: 200 len: 1687 microversion: 2.1 time: 0.156685 Oct 26 14:16:08.614954 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3822/7669] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:16:08 2022] GET /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00 => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:16:09.637961 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-eb1f8697-ca34-4dc2-90cf-741b4e240c5c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:16:09.638673 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-eb1f8697-ca34-4dc2-90cf-741b4e240c5c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 0fe1d46e-50b3-4fbc-8556-8c64b571cf00] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:16:09.645922 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb1f8697-ca34-4dc2-90cf-741b4e240c5c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:09.646487 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb1f8697-ca34-4dc2-90cf-741b4e240c5c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:09.647001 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb1f8697-ca34-4dc2-90cf-741b4e240c5c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:09.647770 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb1f8697-ca34-4dc2-90cf-741b4e240c5c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:09.648242 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb1f8697-ca34-4dc2-90cf-741b4e240c5c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:09.648674 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eb1f8697-ca34-4dc2-90cf-741b4e240c5c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:09.844143 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-eb1f8697-ca34-4dc2-90cf-741b4e240c5c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:16:09.851802 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-eb1f8697-ca34-4dc2-90cf-741b4e240c5c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00" status: 200 len: 1568 microversion: 2.1 time: 0.217781 Oct 26 14:16:09.852376 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3848/7670] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:16:09 2022] GET /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00 => generated 1568 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:16:09.926508 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-fc810de5-eca6-49b4-bec8-3ec2e138f631 req-ff004dd8-8bb8-45ba-b897-b1428cb5c6e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fe1d46e-50b3-4fbc-8556-8c64b571cf00", "name": "network-vif-deleted", "tag": "5c7b145d-a9bc-42fd-b207-dc17051e1c5d"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:16:09.937742 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-fc810de5-eca6-49b4-bec8-3ec2e138f631 req-ff004dd8-8bb8-45ba-b897-b1428cb5c6e3 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:09.938801 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-fc810de5-eca6-49b4-bec8-3ec2e138f631 req-ff004dd8-8bb8-45ba-b897-b1428cb5c6e3 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:09.939366 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-fc810de5-eca6-49b4-bec8-3ec2e138f631 req-ff004dd8-8bb8-45ba-b897-b1428cb5c6e3 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:09.955347 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-fc810de5-eca6-49b4-bec8-3ec2e138f631 req-ff004dd8-8bb8-45ba-b897-b1428cb5c6e3 service nova] Creating event network-vif-deleted:5c7b145d-a9bc-42fd-b207-dc17051e1c5d for instance 0fe1d46e-50b3-4fbc-8556-8c64b571cf00 on n-h1-862686-1 Oct 26 14:16:09.960071 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-fc810de5-eca6-49b4-bec8-3ec2e138f631 req-ff004dd8-8bb8-45ba-b897-b1428cb5c6e3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037277 Oct 26 14:16:09.960679 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3823/7671] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 14:16:10.877408 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e7ff2ade-1da8-479d-ab69-74981e3fff24 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:16:10.877957 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e7ff2ade-1da8-479d-ab69-74981e3fff24 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 0fe1d46e-50b3-4fbc-8556-8c64b571cf00] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:16:10.884660 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e7ff2ade-1da8-479d-ab69-74981e3fff24 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:10.885154 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e7ff2ade-1da8-479d-ab69-74981e3fff24 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:10.885640 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e7ff2ade-1da8-479d-ab69-74981e3fff24 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:10.886342 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e7ff2ade-1da8-479d-ab69-74981e3fff24 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:10.886811 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e7ff2ade-1da8-479d-ab69-74981e3fff24 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:10.887243 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e7ff2ade-1da8-479d-ab69-74981e3fff24 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:10.900884 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-e7ff2ade-1da8-479d-ab69-74981e3fff24 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] HTTP exception thrown: Instance 0fe1d46e-50b3-4fbc-8556-8c64b571cf00 could not be found. Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e7ff2ade-1da8-479d-ab69-74981e3fff24 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Request method failure captured: Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00 HTTP/1.1 Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWUDr33jAxtjEebp3Gj9k8Lbc1SrqwHm7Mcup79l6KuQSwXiy4o2KjnHZEkbB8fkd5uIcGtGt55Uhtw3xdnKaU85Pw2G7l54JmBa0kbYJ4z4No_CAY6Y63JfScReC0DCePeGpVkaUJplfHKvIPPZMxJQQn7G18wWCdYlRSKYCWbu3jAw Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: ba91e9b802254871b5153158707cb180 Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-72818388 Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ba91e9b802254871b5153158707cb180"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ba91e9b802254871b5153158707cb180"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ba91e9b802254871b5153158707cb180"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ba91e9b802254871b5153158707cb180"}]}] Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-TestNetworkAdvancedServerOps-72818388 Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: ba91e9b802254871b5153158707cb180 Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-72818388 Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-TestNetworkAdvancedServerOps-72818388-project Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 18876f18c54a4579a554e52225b24c74 Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-TestNetworkAdvancedServerOps-72818388-project Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 0fe1d46e-50b3-4fbc-8556-8c64b571cf00 could not be found. Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '0fe1d46e-50b3-4fbc-8556-8c64b571cf00'} Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fe1d46e-50b3-4fbc-8556-8c64b571cf00 could not be found. Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fe1d46e-50b3-4fbc-8556-8c64b571cf00 could not be found. Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:16:10.902547 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:16:10.907618 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:16:10.907618 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:16:10.907618 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:16:10.907618 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:16:10.907618 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 14:16:10.907618 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 14:16:10.907618 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fe1d46e-50b3-4fbc-8556-8c64b571cf00 could not be found. Oct 26 14:16:10.907618 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:16:10.907618 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e7ff2ade-1da8-479d-ab69-74981e3fff24 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Returning 404 to user: Instance 0fe1d46e-50b3-4fbc-8556-8c64b571cf00 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 14:16:10.907618 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e7ff2ade-1da8-479d-ab69-74981e3fff24 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00" status: 404 len: 111 microversion: 2.1 time: 0.031679 Oct 26 14:16:10.907618 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3849/7672] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:16:10 2022] GET /compute/v2.1/servers/0fe1d46e-50b3-4fbc-8556-8c64b571cf00 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 14:16:13.996350 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c384187d-076c-470b-bab8-bf6fa21d7930 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '.version_select at 0x7f67319bedc0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:16:14.021278 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c384187d-076c-470b-bab8-bf6fa21d7930 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-921057030" status: 202 len: 0 microversion: 2.1 time: 0.030149 Oct 26 14:16:14.022004 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3824/7673] 10.222.0.40 () {58 vars in 1281 bytes} [Wed Oct 26 14:16:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-921057030 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 14:16:14.048951 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c776e5e0-b369-4eb7-afd5-9f18f527c5d9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Action: 'create', calling method: .version_select at 0x7f673181ddc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2108560624", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBk+LloiH8qc6Vdj8YKc7LawIY/wucovZP4vZvUB2u3m6xP9AHk2ibYthNYNr22WWHTeIUM67ArxH6ng77aUb3uAaU7Us0hNg2Zd7KNhjV8DjvL3JGK52SIjP3JE9Q+Ulg=="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:16:14.067006 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-c776e5e0-b369-4eb7-afd5-9f18f527c5d9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Getting quotas for project ba91e9b802254871b5153158707cb180. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 14:16:14.072139 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-c776e5e0-b369-4eb7-afd5-9f18f527c5d9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Getting quotas for user 18876f18c54a4579a554e52225b24c74 and project ba91e9b802254871b5153158707cb180. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 14:16:14.099343 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c776e5e0-b369-4eb7-afd5-9f18f527c5d9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.054497 Oct 26 14:16:14.099956 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3850/7674] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 14:16:14 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:16:19.576524 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0085aed7-1e19-4b34-850b-ba3db379f7f9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1882566764", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "6e325fe3-6e1a-46f2-b31d-7c89de2d8e16"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2108560624", "security_groups": [{"name": "tempest-secgroup-smoke-644212574"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:16:19.819416 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-0085aed7-1e19-4b34-850b-ba3db379f7f9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] validate_networks() for [('6e325fe3-6e1a-46f2-b31d-7c89de2d8e16', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 14:16:19.944315 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:16:20.271532 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-0085aed7-1e19-4b34-850b-ba3db379f7f9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 14:16:20.271978 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-0085aed7-1e19-4b34-850b-ba3db379f7f9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 14:16:20.272446 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-0085aed7-1e19-4b34-850b-ba3db379f7f9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 14:16:20.272853 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-0085aed7-1e19-4b34-850b-ba3db379f7f9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 14:16:20.273259 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-0085aed7-1e19-4b34-850b-ba3db379f7f9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 14:16:20.284034 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0085aed7-1e19-4b34-850b-ba3db379f7f9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:20.284519 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0085aed7-1e19-4b34-850b-ba3db379f7f9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:20.284952 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0085aed7-1e19-4b34-850b-ba3db379f7f9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:20.285699 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0085aed7-1e19-4b34-850b-ba3db379f7f9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:20.286152 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0085aed7-1e19-4b34-850b-ba3db379f7f9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:20.286571 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0085aed7-1e19-4b34-850b-ba3db379f7f9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:20.305586 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-0085aed7-1e19-4b34-850b-ba3db379f7f9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Getting quotas for project ba91e9b802254871b5153158707cb180. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 14:16:20.310881 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-0085aed7-1e19-4b34-850b-ba3db379f7f9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Getting quotas for user 18876f18c54a4579a554e52225b24c74 and project ba91e9b802254871b5153158707cb180. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 14:16:20.324695 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0085aed7-1e19-4b34-850b-ba3db379f7f9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 14:16:20.328172 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0085aed7-1e19-4b34-850b-ba3db379f7f9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 6e59d90c-a3f6-4728-9ad6-a241895413e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 14:16:20.386368 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0085aed7-1e19-4b34-850b-ba3db379f7f9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.814919 Oct 26 14:16:20.396396 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3825/7675] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 14:16:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 14:16:20.399671 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-15a072d6-f0fa-4eba-a19f-13abf968828e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:16:20.401014 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-15a072d6-f0fa-4eba-a19f-13abf968828e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 6e59d90c-a3f6-4728-9ad6-a241895413e0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:16:20.543882 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-15a072d6-f0fa-4eba-a19f-13abf968828e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:16:20.551376 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-15a072d6-f0fa-4eba-a19f-13abf968828e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0" status: 200 len: 1267 microversion: 2.1 time: 0.156247 Oct 26 14:16:20.552854 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3851/7676] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:16:20 2022] GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:16:21.576327 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4bd784d9-406a-47d5-8683-a9de879c4fd7 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:16:21.577020 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4bd784d9-406a-47d5-8683-a9de879c4fd7 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 6e59d90c-a3f6-4728-9ad6-a241895413e0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:16:21.586044 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4bd784d9-406a-47d5-8683-a9de879c4fd7 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:21.586628 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4bd784d9-406a-47d5-8683-a9de879c4fd7 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:21.587143 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4bd784d9-406a-47d5-8683-a9de879c4fd7 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:21.588791 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4bd784d9-406a-47d5-8683-a9de879c4fd7 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:21.589334 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4bd784d9-406a-47d5-8683-a9de879c4fd7 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:21.589803 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4bd784d9-406a-47d5-8683-a9de879c4fd7 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:21.686070 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4bd784d9-406a-47d5-8683-a9de879c4fd7 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:16:21.696215 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4bd784d9-406a-47d5-8683-a9de879c4fd7 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0" status: 200 len: 1327 microversion: 2.1 time: 0.124564 Oct 26 14:16:21.697473 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3826/7677] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:16:21 2022] GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0 => generated 1327 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:16:22.726437 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3de37330-9cb5-4ef1-918e-71d663839660 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:16:22.728296 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3de37330-9cb5-4ef1-918e-71d663839660 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 6e59d90c-a3f6-4728-9ad6-a241895413e0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:16:22.730573 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=36 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:16:22.738043 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3de37330-9cb5-4ef1-918e-71d663839660 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:22.738926 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3de37330-9cb5-4ef1-918e-71d663839660 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:22.739052 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3de37330-9cb5-4ef1-918e-71d663839660 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:22.739677 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3de37330-9cb5-4ef1-918e-71d663839660 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:22.740319 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3de37330-9cb5-4ef1-918e-71d663839660 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:22.740947 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3de37330-9cb5-4ef1-918e-71d663839660 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:22.978420 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3de37330-9cb5-4ef1-918e-71d663839660 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:16:22.989049 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3de37330-9cb5-4ef1-918e-71d663839660 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0" status: 200 len: 1392 microversion: 2.1 time: 0.272691 Oct 26 14:16:23.000282 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3852/7678] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:16:22 2022] GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0 => generated 1392 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:16:23.159780 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-de0775ff-b701-4b0f-bfe0-e55c583b53d4 req-452fe224-d24f-457e-8f08-b81d99beccc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e59d90c-a3f6-4728-9ad6-a241895413e0", "tag": "37141a76-c83d-4fb6-89e0-2aceafe1fdf4"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:16:23.171156 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-de0775ff-b701-4b0f-bfe0-e55c583b53d4 req-452fe224-d24f-457e-8f08-b81d99beccc9 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:23.171634 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-de0775ff-b701-4b0f-bfe0-e55c583b53d4 req-452fe224-d24f-457e-8f08-b81d99beccc9 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:23.172724 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-de0775ff-b701-4b0f-bfe0-e55c583b53d4 req-452fe224-d24f-457e-8f08-b81d99beccc9 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:23.184006 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-de0775ff-b701-4b0f-bfe0-e55c583b53d4 req-452fe224-d24f-457e-8f08-b81d99beccc9 service nova] Creating event network-changed:37141a76-c83d-4fb6-89e0-2aceafe1fdf4 for instance 6e59d90c-a3f6-4728-9ad6-a241895413e0 on n-h2-862686-1 Oct 26 14:16:23.190478 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-de0775ff-b701-4b0f-bfe0-e55c583b53d4 req-452fe224-d24f-457e-8f08-b81d99beccc9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034502 Oct 26 14:16:23.191113 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3827/7679] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:16:24.011969 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4b827066-8bb9-47e5-8cdc-cada7c7b02a8 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:16:24.012597 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4b827066-8bb9-47e5-8cdc-cada7c7b02a8 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 6e59d90c-a3f6-4728-9ad6-a241895413e0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:16:24.019625 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4b827066-8bb9-47e5-8cdc-cada7c7b02a8 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:24.020121 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4b827066-8bb9-47e5-8cdc-cada7c7b02a8 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:24.020573 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4b827066-8bb9-47e5-8cdc-cada7c7b02a8 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:24.021280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4b827066-8bb9-47e5-8cdc-cada7c7b02a8 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:24.021778 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4b827066-8bb9-47e5-8cdc-cada7c7b02a8 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:24.022220 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4b827066-8bb9-47e5-8cdc-cada7c7b02a8 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:24.154667 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4b827066-8bb9-47e5-8cdc-cada7c7b02a8 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:16:24.162584 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4b827066-8bb9-47e5-8cdc-cada7c7b02a8 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0" status: 200 len: 1392 microversion: 2.1 time: 0.154583 Oct 26 14:16:24.163420 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3853/7680] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:16:24 2022] GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 14:16:25.188799 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-95f472b3-9f39-4547-9714-a77b5b04276b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:16:25.189522 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-95f472b3-9f39-4547-9714-a77b5b04276b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 6e59d90c-a3f6-4728-9ad6-a241895413e0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:16:25.196101 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-95f472b3-9f39-4547-9714-a77b5b04276b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:25.196593 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-95f472b3-9f39-4547-9714-a77b5b04276b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:25.197033 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-95f472b3-9f39-4547-9714-a77b5b04276b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:25.197760 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-95f472b3-9f39-4547-9714-a77b5b04276b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:25.198224 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-95f472b3-9f39-4547-9714-a77b5b04276b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:25.198656 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-95f472b3-9f39-4547-9714-a77b5b04276b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:25.339689 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-95f472b3-9f39-4547-9714-a77b5b04276b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:16:25.347634 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-95f472b3-9f39-4547-9714-a77b5b04276b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0" status: 200 len: 1392 microversion: 2.1 time: 0.165123 Oct 26 14:16:25.348211 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3828/7681] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:16:25 2022] GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:16:26.371748 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a8b424e5-1e6c-4667-8fd0-775c57b33660 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:16:26.372351 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a8b424e5-1e6c-4667-8fd0-775c57b33660 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 6e59d90c-a3f6-4728-9ad6-a241895413e0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:16:26.379832 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a8b424e5-1e6c-4667-8fd0-775c57b33660 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:26.380321 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a8b424e5-1e6c-4667-8fd0-775c57b33660 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:26.380765 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a8b424e5-1e6c-4667-8fd0-775c57b33660 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:26.381461 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a8b424e5-1e6c-4667-8fd0-775c57b33660 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:26.381947 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a8b424e5-1e6c-4667-8fd0-775c57b33660 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:26.382383 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a8b424e5-1e6c-4667-8fd0-775c57b33660 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:26.513573 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a8b424e5-1e6c-4667-8fd0-775c57b33660 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:16:26.521970 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a8b424e5-1e6c-4667-8fd0-775c57b33660 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0" status: 200 len: 1392 microversion: 2.1 time: 0.154268 Oct 26 14:16:26.522548 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3854/7682] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:16:26 2022] GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:16:27.544435 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b1b4ea54-2893-4634-8bdf-8bc33769a97e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:16:27.545044 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b1b4ea54-2893-4634-8bdf-8bc33769a97e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 6e59d90c-a3f6-4728-9ad6-a241895413e0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:16:27.552197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b1b4ea54-2893-4634-8bdf-8bc33769a97e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:27.552672 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b1b4ea54-2893-4634-8bdf-8bc33769a97e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:27.553107 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b1b4ea54-2893-4634-8bdf-8bc33769a97e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:27.553824 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b1b4ea54-2893-4634-8bdf-8bc33769a97e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:27.554276 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b1b4ea54-2893-4634-8bdf-8bc33769a97e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:27.554690 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b1b4ea54-2893-4634-8bdf-8bc33769a97e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:27.691637 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b1b4ea54-2893-4634-8bdf-8bc33769a97e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:16:27.699495 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b1b4ea54-2893-4634-8bdf-8bc33769a97e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0" status: 200 len: 1392 microversion: 2.1 time: 0.158918 Oct 26 14:16:27.700068 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3829/7683] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:16:27 2022] GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:16:28.723365 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-abbe96a9-3057-4aea-aa48-e6f70e13ba04 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:16:28.723985 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-abbe96a9-3057-4aea-aa48-e6f70e13ba04 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 6e59d90c-a3f6-4728-9ad6-a241895413e0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:16:28.730918 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-abbe96a9-3057-4aea-aa48-e6f70e13ba04 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:28.731412 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-abbe96a9-3057-4aea-aa48-e6f70e13ba04 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:28.731854 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-abbe96a9-3057-4aea-aa48-e6f70e13ba04 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:28.732558 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-abbe96a9-3057-4aea-aa48-e6f70e13ba04 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:28.733019 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-abbe96a9-3057-4aea-aa48-e6f70e13ba04 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:28.733580 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-abbe96a9-3057-4aea-aa48-e6f70e13ba04 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:28.849368 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-288b9715-3db3-4ed9-b1dc-c8c34163c607 req-7309760e-3ed7-4496-bc43-8c07290b3b06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e59d90c-a3f6-4728-9ad6-a241895413e0", "name": "network-vif-plugged", "status": "completed", "tag": "37141a76-c83d-4fb6-89e0-2aceafe1fdf4"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:16:28.860532 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-288b9715-3db3-4ed9-b1dc-c8c34163c607 req-7309760e-3ed7-4496-bc43-8c07290b3b06 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:28.861201 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-288b9715-3db3-4ed9-b1dc-c8c34163c607 req-7309760e-3ed7-4496-bc43-8c07290b3b06 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:28.861666 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-288b9715-3db3-4ed9-b1dc-c8c34163c607 req-7309760e-3ed7-4496-bc43-8c07290b3b06 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:28.872141 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-abbe96a9-3057-4aea-aa48-e6f70e13ba04 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:16:28.873628 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-288b9715-3db3-4ed9-b1dc-c8c34163c607 req-7309760e-3ed7-4496-bc43-8c07290b3b06 service nova] Creating event network-vif-plugged:37141a76-c83d-4fb6-89e0-2aceafe1fdf4 for instance 6e59d90c-a3f6-4728-9ad6-a241895413e0 on n-h2-862686-1 Oct 26 14:16:28.880861 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-288b9715-3db3-4ed9-b1dc-c8c34163c607 req-7309760e-3ed7-4496-bc43-8c07290b3b06 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034687 Oct 26 14:16:28.881331 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3830/7684] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:16:28.883852 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-abbe96a9-3057-4aea-aa48-e6f70e13ba04 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0" status: 200 len: 1392 microversion: 2.1 time: 0.165459 Oct 26 14:16:28.884454 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3855/7685] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:16:28 2022] GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:16:29.909824 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a6aacf26-2fc2-4b06-b0b1-6b874584e997 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:16:29.910518 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a6aacf26-2fc2-4b06-b0b1-6b874584e997 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 6e59d90c-a3f6-4728-9ad6-a241895413e0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:16:29.916834 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a6aacf26-2fc2-4b06-b0b1-6b874584e997 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:29.917310 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a6aacf26-2fc2-4b06-b0b1-6b874584e997 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:29.917766 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a6aacf26-2fc2-4b06-b0b1-6b874584e997 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:29.918444 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a6aacf26-2fc2-4b06-b0b1-6b874584e997 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:29.918892 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a6aacf26-2fc2-4b06-b0b1-6b874584e997 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:29.919308 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a6aacf26-2fc2-4b06-b0b1-6b874584e997 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:30.054540 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a6aacf26-2fc2-4b06-b0b1-6b874584e997 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:16:30.062156 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a6aacf26-2fc2-4b06-b0b1-6b874584e997 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0" status: 200 len: 1392 microversion: 2.1 time: 0.158467 Oct 26 14:16:30.063052 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3831/7686] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:16:29 2022] GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:16:31.161811 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-29cb97fc-a2c0-4e9b-944e-1e45a0f2b0f1 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:16:31.162499 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-29cb97fc-a2c0-4e9b-944e-1e45a0f2b0f1 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 6e59d90c-a3f6-4728-9ad6-a241895413e0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:16:31.165672 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:16:31.171430 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29cb97fc-a2c0-4e9b-944e-1e45a0f2b0f1 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:31.171958 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29cb97fc-a2c0-4e9b-944e-1e45a0f2b0f1 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:31.172536 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29cb97fc-a2c0-4e9b-944e-1e45a0f2b0f1 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:31.173240 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29cb97fc-a2c0-4e9b-944e-1e45a0f2b0f1 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:31.173740 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29cb97fc-a2c0-4e9b-944e-1e45a0f2b0f1 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:31.174187 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29cb97fc-a2c0-4e9b-944e-1e45a0f2b0f1 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:31.304374 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-29cb97fc-a2c0-4e9b-944e-1e45a0f2b0f1 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:16:31.312071 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-29cb97fc-a2c0-4e9b-944e-1e45a0f2b0f1 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0" status: 200 len: 1564 microversion: 2.1 time: 0.154487 Oct 26 14:16:31.313153 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3856/7687] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:16:31 2022] GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0 => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 14:16:31.335346 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-702f10fb-d279-431f-9f77-d7d16a7cc1bf tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:16:31.336151 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-702f10fb-d279-431f-9f77-d7d16a7cc1bf tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 6e59d90c-a3f6-4728-9ad6-a241895413e0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:16:31.338030 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:16:31.338693 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:16:31.345727 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-702f10fb-d279-431f-9f77-d7d16a7cc1bf tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:31.346221 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-702f10fb-d279-431f-9f77-d7d16a7cc1bf tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:31.346664 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-702f10fb-d279-431f-9f77-d7d16a7cc1bf tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:31.347371 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-702f10fb-d279-431f-9f77-d7d16a7cc1bf tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:31.347825 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-702f10fb-d279-431f-9f77-d7d16a7cc1bf tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:31.348260 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-702f10fb-d279-431f-9f77-d7d16a7cc1bf tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:31.481104 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-702f10fb-d279-431f-9f77-d7d16a7cc1bf tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:16:31.489428 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-702f10fb-d279-431f-9f77-d7d16a7cc1bf tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0" status: 200 len: 1564 microversion: 2.1 time: 0.157897 Oct 26 14:16:31.490036 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3832/7688] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:16:31 2022] GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0 => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:16:33.100081 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-5f1a5dba-4361-493d-a340-beed8afb2f78 req-31645361-ccfd-4c14-858b-28a461692fe1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e59d90c-a3f6-4728-9ad6-a241895413e0", "tag": "37141a76-c83d-4fb6-89e0-2aceafe1fdf4"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:16:33.102519 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f705fee8-f65d-49a7-ae89-6ea6aea59cab tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:16:33.103151 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f705fee8-f65d-49a7-ae89-6ea6aea59cab tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 6e59d90c-a3f6-4728-9ad6-a241895413e0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:16:33.105903 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:16:33.112356 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:16:33.117053 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f705fee8-f65d-49a7-ae89-6ea6aea59cab tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:33.117585 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f705fee8-f65d-49a7-ae89-6ea6aea59cab tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:33.118035 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f705fee8-f65d-49a7-ae89-6ea6aea59cab tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:33.118750 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f705fee8-f65d-49a7-ae89-6ea6aea59cab tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:33.119214 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f705fee8-f65d-49a7-ae89-6ea6aea59cab tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:33.119667 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f705fee8-f65d-49a7-ae89-6ea6aea59cab tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:33.127350 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-5f1a5dba-4361-493d-a340-beed8afb2f78 req-31645361-ccfd-4c14-858b-28a461692fe1 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:33.127882 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-5f1a5dba-4361-493d-a340-beed8afb2f78 req-31645361-ccfd-4c14-858b-28a461692fe1 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:33.128257 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-5f1a5dba-4361-493d-a340-beed8afb2f78 req-31645361-ccfd-4c14-858b-28a461692fe1 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:33.144895 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-5f1a5dba-4361-493d-a340-beed8afb2f78 req-31645361-ccfd-4c14-858b-28a461692fe1 service nova] Creating event network-changed:37141a76-c83d-4fb6-89e0-2aceafe1fdf4 for instance 6e59d90c-a3f6-4728-9ad6-a241895413e0 on n-h2-862686-1 Oct 26 14:16:33.160249 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-5f1a5dba-4361-493d-a340-beed8afb2f78 req-31645361-ccfd-4c14-858b-28a461692fe1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063821 Oct 26 14:16:33.161322 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3833/7689] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:16:33.379748 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f705fee8-f65d-49a7-ae89-6ea6aea59cab tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:16:33.387757 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f705fee8-f65d-49a7-ae89-6ea6aea59cab tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0" status: 200 len: 1564 microversion: 2.1 time: 0.297232 Oct 26 14:16:33.388345 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3857/7690] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:16:33 2022] GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0 => generated 1564 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:16:56.667377 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=38 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:16:56.671992 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-06881a44-1bba-46c8-acee-fbc62ef6cebd tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:16:56.674681 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-06881a44-1bba-46c8-acee-fbc62ef6cebd tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 6e59d90c-a3f6-4728-9ad6-a241895413e0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:16:56.681209 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-06881a44-1bba-46c8-acee-fbc62ef6cebd tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:56.681716 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-06881a44-1bba-46c8-acee-fbc62ef6cebd tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:56.682152 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-06881a44-1bba-46c8-acee-fbc62ef6cebd tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:56.682841 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-06881a44-1bba-46c8-acee-fbc62ef6cebd tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:16:56.683293 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-06881a44-1bba-46c8-acee-fbc62ef6cebd tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:16:56.683711 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-06881a44-1bba-46c8-acee-fbc62ef6cebd tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:16:56.735715 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-06881a44-1bba-46c8-acee-fbc62ef6cebd tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "POST /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0/action" status: 200 len: 24569 microversion: 2.1 time: 0.069980 Oct 26 14:16:56.736354 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3834/7691] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 14:16:56 2022] POST /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0/action => generated 24569 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 14:17:07.673226 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-28453afe-c8e5-46a4-8887-484378071be0 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:17:07.675555 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-28453afe-c8e5-46a4-8887-484378071be0 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 6e59d90c-a3f6-4728-9ad6-a241895413e0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:17:07.677655 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:17:07.678319 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=36 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:17:07.684125 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28453afe-c8e5-46a4-8887-484378071be0 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:17:07.684624 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28453afe-c8e5-46a4-8887-484378071be0 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:17:07.685073 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28453afe-c8e5-46a4-8887-484378071be0 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:17:07.685919 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28453afe-c8e5-46a4-8887-484378071be0 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:17:07.686387 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28453afe-c8e5-46a4-8887-484378071be0 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:17:07.686828 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28453afe-c8e5-46a4-8887-484378071be0 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:17:07.759629 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-28453afe-c8e5-46a4-8887-484378071be0 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "POST /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0/action" status: 202 len: 0 microversion: 2.1 time: 0.090459 Oct 26 14:17:07.760466 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3858/7692] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 14:17:07 2022] POST /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 14:17:07.770806 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-23799ded-2914-406b-9ed2-40aaf6eada3f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:17:07.771531 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-23799ded-2914-406b-9ed2-40aaf6eada3f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 6e59d90c-a3f6-4728-9ad6-a241895413e0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:17:07.774238 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:17:07.774991 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=4 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:17:07.780626 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-23799ded-2914-406b-9ed2-40aaf6eada3f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:17:07.781121 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-23799ded-2914-406b-9ed2-40aaf6eada3f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:17:07.781600 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-23799ded-2914-406b-9ed2-40aaf6eada3f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:17:07.782384 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-23799ded-2914-406b-9ed2-40aaf6eada3f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:17:07.783043 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-23799ded-2914-406b-9ed2-40aaf6eada3f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:17:07.783473 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-23799ded-2914-406b-9ed2-40aaf6eada3f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:17:07.928438 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-23799ded-2914-406b-9ed2-40aaf6eada3f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:17:07.936257 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-23799ded-2914-406b-9ed2-40aaf6eada3f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0" status: 200 len: 1675 microversion: 2.1 time: 0.170710 Oct 26 14:17:07.936829 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3835/7693] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:17:07 2022] GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0 => generated 1675 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:17:08.963206 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8ccadc58-7498-492e-bca6-3b956d724287 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:17:08.963930 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8ccadc58-7498-492e-bca6-3b956d724287 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 6e59d90c-a3f6-4728-9ad6-a241895413e0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:17:08.970930 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8ccadc58-7498-492e-bca6-3b956d724287 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:17:08.971440 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8ccadc58-7498-492e-bca6-3b956d724287 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:17:08.971898 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8ccadc58-7498-492e-bca6-3b956d724287 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:17:08.972609 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8ccadc58-7498-492e-bca6-3b956d724287 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:17:08.973086 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8ccadc58-7498-492e-bca6-3b956d724287 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:17:08.973562 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8ccadc58-7498-492e-bca6-3b956d724287 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:17:09.113128 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8ccadc58-7498-492e-bca6-3b956d724287 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:17:09.120817 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8ccadc58-7498-492e-bca6-3b956d724287 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0" status: 200 len: 1680 microversion: 2.1 time: 0.163182 Oct 26 14:17:09.121388 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3859/7694] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:17:08 2022] GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:17:10.145936 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-989327ac-cb6a-490f-a045-fa539be87c2c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:17:10.146490 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-989327ac-cb6a-490f-a045-fa539be87c2c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 6e59d90c-a3f6-4728-9ad6-a241895413e0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:17:10.153355 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-989327ac-cb6a-490f-a045-fa539be87c2c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:17:10.153874 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-989327ac-cb6a-490f-a045-fa539be87c2c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:17:10.154317 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-989327ac-cb6a-490f-a045-fa539be87c2c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:17:10.155012 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-989327ac-cb6a-490f-a045-fa539be87c2c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:17:10.155469 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-989327ac-cb6a-490f-a045-fa539be87c2c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:17:10.155903 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-989327ac-cb6a-490f-a045-fa539be87c2c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:17:10.286888 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-989327ac-cb6a-490f-a045-fa539be87c2c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:17:10.294823 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-989327ac-cb6a-490f-a045-fa539be87c2c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0" status: 200 len: 1680 microversion: 2.1 time: 0.153498 Oct 26 14:17:10.295393 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3836/7695] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:17:10 2022] GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:17:11.318858 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3ffd5104-cadb-4d9c-a644-cbf538365c2d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:17:11.319485 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3ffd5104-cadb-4d9c-a644-cbf538365c2d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 6e59d90c-a3f6-4728-9ad6-a241895413e0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:17:11.326307 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3ffd5104-cadb-4d9c-a644-cbf538365c2d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:17:11.326802 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3ffd5104-cadb-4d9c-a644-cbf538365c2d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:17:11.327255 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3ffd5104-cadb-4d9c-a644-cbf538365c2d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:17:11.327955 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3ffd5104-cadb-4d9c-a644-cbf538365c2d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:17:11.328425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3ffd5104-cadb-4d9c-a644-cbf538365c2d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:17:11.328865 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3ffd5104-cadb-4d9c-a644-cbf538365c2d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:17:11.459119 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3ffd5104-cadb-4d9c-a644-cbf538365c2d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:17:11.466787 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3ffd5104-cadb-4d9c-a644-cbf538365c2d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0" status: 200 len: 1680 microversion: 2.1 time: 0.151882 Oct 26 14:17:11.467355 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3860/7696] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:17:11 2022] GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:17:12.490959 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-73bddb03-0645-494b-8340-57860d635d90 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:17:12.491639 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-73bddb03-0645-494b-8340-57860d635d90 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 6e59d90c-a3f6-4728-9ad6-a241895413e0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:17:12.498398 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73bddb03-0645-494b-8340-57860d635d90 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:17:12.498881 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73bddb03-0645-494b-8340-57860d635d90 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:17:12.499321 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73bddb03-0645-494b-8340-57860d635d90 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:17:12.500009 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73bddb03-0645-494b-8340-57860d635d90 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:17:12.500470 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73bddb03-0645-494b-8340-57860d635d90 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:17:12.500936 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73bddb03-0645-494b-8340-57860d635d90 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:17:12.635279 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-73bddb03-0645-494b-8340-57860d635d90 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:17:12.643530 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-73bddb03-0645-494b-8340-57860d635d90 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0" status: 200 len: 1680 microversion: 2.1 time: 0.156561 Oct 26 14:17:12.644093 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3837/7697] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:17:12 2022] GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:17:13.667682 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d8df0678-0dc5-4016-9dee-e2f7687cd4a3 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:17:13.668335 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d8df0678-0dc5-4016-9dee-e2f7687cd4a3 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 6e59d90c-a3f6-4728-9ad6-a241895413e0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:17:13.675747 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8df0678-0dc5-4016-9dee-e2f7687cd4a3 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:17:13.676246 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8df0678-0dc5-4016-9dee-e2f7687cd4a3 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:17:13.676697 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8df0678-0dc5-4016-9dee-e2f7687cd4a3 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:17:13.677407 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8df0678-0dc5-4016-9dee-e2f7687cd4a3 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:17:13.677902 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8df0678-0dc5-4016-9dee-e2f7687cd4a3 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:17:13.678341 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8df0678-0dc5-4016-9dee-e2f7687cd4a3 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:17:13.811549 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d8df0678-0dc5-4016-9dee-e2f7687cd4a3 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:17:13.819432 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d8df0678-0dc5-4016-9dee-e2f7687cd4a3 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0" status: 200 len: 1680 microversion: 2.1 time: 0.155990 Oct 26 14:17:13.820010 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3861/7698] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:17:13 2022] GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:17:14.843068 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-03ceffeb-ed0d-472e-b525-36a01bcce77c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:17:14.843684 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-03ceffeb-ed0d-472e-b525-36a01bcce77c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 6e59d90c-a3f6-4728-9ad6-a241895413e0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:17:14.850649 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03ceffeb-ed0d-472e-b525-36a01bcce77c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:17:14.851133 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03ceffeb-ed0d-472e-b525-36a01bcce77c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:17:14.851571 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03ceffeb-ed0d-472e-b525-36a01bcce77c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:17:14.852261 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03ceffeb-ed0d-472e-b525-36a01bcce77c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:17:14.852716 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03ceffeb-ed0d-472e-b525-36a01bcce77c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:17:14.853143 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03ceffeb-ed0d-472e-b525-36a01bcce77c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:17:14.983152 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-03ceffeb-ed0d-472e-b525-36a01bcce77c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:17:14.991860 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-03ceffeb-ed0d-472e-b525-36a01bcce77c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0" status: 200 len: 1680 microversion: 2.1 time: 0.152657 Oct 26 14:17:14.992373 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3838/7699] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:17:14 2022] GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 14:17:16.016114 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-529dff18-4c78-439d-bf65-e6343636f119 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:17:16.016777 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-529dff18-4c78-439d-bf65-e6343636f119 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 6e59d90c-a3f6-4728-9ad6-a241895413e0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:17:16.024549 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-529dff18-4c78-439d-bf65-e6343636f119 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:17:16.025044 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-529dff18-4c78-439d-bf65-e6343636f119 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:17:16.025505 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-529dff18-4c78-439d-bf65-e6343636f119 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:17:16.026211 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-529dff18-4c78-439d-bf65-e6343636f119 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:17:16.026676 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-529dff18-4c78-439d-bf65-e6343636f119 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:17:16.027115 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-529dff18-4c78-439d-bf65-e6343636f119 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:17:16.159944 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-529dff18-4c78-439d-bf65-e6343636f119 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:17:16.167859 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-529dff18-4c78-439d-bf65-e6343636f119 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0" status: 200 len: 1680 microversion: 2.1 time: 0.155665 Oct 26 14:17:16.168436 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3862/7700] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:17:16 2022] GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:17:17.191452 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c37a62d8-71e8-4d6d-9364-e919edfc8feb tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:17:17.192075 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c37a62d8-71e8-4d6d-9364-e919edfc8feb tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 6e59d90c-a3f6-4728-9ad6-a241895413e0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:17:17.198980 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c37a62d8-71e8-4d6d-9364-e919edfc8feb tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:17:17.199469 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c37a62d8-71e8-4d6d-9364-e919edfc8feb tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:17:17.199914 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c37a62d8-71e8-4d6d-9364-e919edfc8feb tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:17:17.200611 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c37a62d8-71e8-4d6d-9364-e919edfc8feb tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:17:17.201107 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c37a62d8-71e8-4d6d-9364-e919edfc8feb tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:17:17.201562 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c37a62d8-71e8-4d6d-9364-e919edfc8feb tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:17:17.337632 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c37a62d8-71e8-4d6d-9364-e919edfc8feb tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:17:17.346788 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c37a62d8-71e8-4d6d-9364-e919edfc8feb tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0" status: 200 len: 1680 microversion: 2.1 time: 0.158702 Oct 26 14:17:17.347558 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3839/7701] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:17:17 2022] GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:17:18.370473 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3b612e72-0758-4ecd-ae67-b74a99c6f2ab tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:17:18.371129 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3b612e72-0758-4ecd-ae67-b74a99c6f2ab tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 6e59d90c-a3f6-4728-9ad6-a241895413e0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:17:18.378593 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b612e72-0758-4ecd-ae67-b74a99c6f2ab tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:17:18.379116 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b612e72-0758-4ecd-ae67-b74a99c6f2ab tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:17:18.379572 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b612e72-0758-4ecd-ae67-b74a99c6f2ab tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:17:18.380282 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b612e72-0758-4ecd-ae67-b74a99c6f2ab tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:17:18.380752 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b612e72-0758-4ecd-ae67-b74a99c6f2ab tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:17:18.381195 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b612e72-0758-4ecd-ae67-b74a99c6f2ab tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:17:18.510947 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3b612e72-0758-4ecd-ae67-b74a99c6f2ab tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:17:18.519705 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3b612e72-0758-4ecd-ae67-b74a99c6f2ab tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0" status: 200 len: 1680 microversion: 2.1 time: 0.153164 Oct 26 14:17:18.520276 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3863/7702] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:17:18 2022] GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:17:19.543332 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ad80efaf-f003-4b4b-8087-485b1f57dd3f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:17:19.543936 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ad80efaf-f003-4b4b-8087-485b1f57dd3f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 6e59d90c-a3f6-4728-9ad6-a241895413e0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:17:19.551394 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad80efaf-f003-4b4b-8087-485b1f57dd3f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:17:19.551874 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad80efaf-f003-4b4b-8087-485b1f57dd3f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:17:19.552317 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad80efaf-f003-4b4b-8087-485b1f57dd3f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:17:19.553015 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad80efaf-f003-4b4b-8087-485b1f57dd3f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:17:19.553469 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad80efaf-f003-4b4b-8087-485b1f57dd3f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:17:19.553922 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad80efaf-f003-4b4b-8087-485b1f57dd3f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:17:19.683542 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ad80efaf-f003-4b4b-8087-485b1f57dd3f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:17:19.691442 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ad80efaf-f003-4b4b-8087-485b1f57dd3f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0" status: 200 len: 1683 microversion: 2.1 time: 0.152025 Oct 26 14:17:19.692018 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3840/7703] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:17:19 2022] GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:17:45.887833 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ce1f49a8-c92d-4833-8bfb-6c970379723d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:17:45.890039 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ce1f49a8-c92d-4833-8bfb-6c970379723d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 6e59d90c-a3f6-4728-9ad6-a241895413e0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:17:45.892314 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=12 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:17:45.892982 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:17:45.900243 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ce1f49a8-c92d-4833-8bfb-6c970379723d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:17:45.900736 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ce1f49a8-c92d-4833-8bfb-6c970379723d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:17:45.901184 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ce1f49a8-c92d-4833-8bfb-6c970379723d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:17:45.901919 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ce1f49a8-c92d-4833-8bfb-6c970379723d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:17:45.902382 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ce1f49a8-c92d-4833-8bfb-6c970379723d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:17:45.902813 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ce1f49a8-c92d-4833-8bfb-6c970379723d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:17:45.968690 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ce1f49a8-c92d-4833-8bfb-6c970379723d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "POST /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0/action" status: 200 len: 69006 microversion: 2.1 time: 0.084734 Oct 26 14:17:45.969371 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3864/7704] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 14:17:45 2022] POST /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0/action => generated 69006 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 14:17:53.008158 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-96ee3ff5-e617-48ed-806d-ee53a041964b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:17:53.008967 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-96ee3ff5-e617-48ed-806d-ee53a041964b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 6e59d90c-a3f6-4728-9ad6-a241895413e0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:17:53.017838 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=12 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:17:53.019410 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=36 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:17:53.025622 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96ee3ff5-e617-48ed-806d-ee53a041964b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:17:53.026120 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96ee3ff5-e617-48ed-806d-ee53a041964b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:17:53.026596 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96ee3ff5-e617-48ed-806d-ee53a041964b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:17:53.027310 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96ee3ff5-e617-48ed-806d-ee53a041964b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:17:53.027769 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96ee3ff5-e617-48ed-806d-ee53a041964b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:17:53.028197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96ee3ff5-e617-48ed-806d-ee53a041964b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:17:53.056002 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-96ee3ff5-e617-48ed-806d-ee53a041964b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 6e59d90c-a3f6-4728-9ad6-a241895413e0] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 14:17:53.075289 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-dce42e9e-44e4-4653-b0f9-a8c602ced413 req-d36e7933-2743-47e8-87b1-4c5ccee28542 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e59d90c-a3f6-4728-9ad6-a241895413e0", "tag": "37141a76-c83d-4fb6-89e0-2aceafe1fdf4"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:17:53.089247 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-dce42e9e-44e4-4653-b0f9-a8c602ced413 req-d36e7933-2743-47e8-87b1-4c5ccee28542 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:17:53.091072 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-dce42e9e-44e4-4653-b0f9-a8c602ced413 req-d36e7933-2743-47e8-87b1-4c5ccee28542 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:17:53.091733 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-dce42e9e-44e4-4653-b0f9-a8c602ced413 req-d36e7933-2743-47e8-87b1-4c5ccee28542 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:17:53.105261 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-dce42e9e-44e4-4653-b0f9-a8c602ced413 req-d36e7933-2743-47e8-87b1-4c5ccee28542 service nova] Creating event network-changed:37141a76-c83d-4fb6-89e0-2aceafe1fdf4 for instance 6e59d90c-a3f6-4728-9ad6-a241895413e0 on n-h2-862686-1 Oct 26 14:17:53.112054 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-dce42e9e-44e4-4653-b0f9-a8c602ced413 req-d36e7933-2743-47e8-87b1-4c5ccee28542 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100940 Oct 26 14:17:53.113963 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3865/7705] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:17:53.138811 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-96ee3ff5-e617-48ed-806d-ee53a041964b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0" status: 204 len: 0 microversion: 2.1 time: 0.134607 Oct 26 14:17:53.139405 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3841/7706] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 14:17:53 2022] DELETE /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 14:17:53.169523 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8abc59dc-0911-4c45-b11e-43ca00a067a4 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:17:53.170231 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8abc59dc-0911-4c45-b11e-43ca00a067a4 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 6e59d90c-a3f6-4728-9ad6-a241895413e0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:17:53.182413 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8abc59dc-0911-4c45-b11e-43ca00a067a4 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:17:53.183119 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8abc59dc-0911-4c45-b11e-43ca00a067a4 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:17:53.183971 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8abc59dc-0911-4c45-b11e-43ca00a067a4 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:17:53.184847 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8abc59dc-0911-4c45-b11e-43ca00a067a4 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:17:53.185553 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8abc59dc-0911-4c45-b11e-43ca00a067a4 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:17:53.186214 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8abc59dc-0911-4c45-b11e-43ca00a067a4 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:17:53.326056 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8abc59dc-0911-4c45-b11e-43ca00a067a4 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:17:53.334563 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8abc59dc-0911-4c45-b11e-43ca00a067a4 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0" status: 200 len: 1689 microversion: 2.1 time: 0.189142 Oct 26 14:17:53.335150 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3866/7707] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:17:53 2022] GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0 => generated 1689 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:17:54.360851 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ce9e51ff-9412-4315-9d6d-46d08f0b5049 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:17:54.361577 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ce9e51ff-9412-4315-9d6d-46d08f0b5049 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 6e59d90c-a3f6-4728-9ad6-a241895413e0] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:17:54.368357 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce9e51ff-9412-4315-9d6d-46d08f0b5049 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:17:54.368839 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce9e51ff-9412-4315-9d6d-46d08f0b5049 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:17:54.369276 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce9e51ff-9412-4315-9d6d-46d08f0b5049 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:17:54.369990 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce9e51ff-9412-4315-9d6d-46d08f0b5049 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:17:54.370439 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce9e51ff-9412-4315-9d6d-46d08f0b5049 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:17:54.370861 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce9e51ff-9412-4315-9d6d-46d08f0b5049 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:17:54.507834 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ce9e51ff-9412-4315-9d6d-46d08f0b5049 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:17:54.515515 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ce9e51ff-9412-4315-9d6d-46d08f0b5049 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0" status: 200 len: 1689 microversion: 2.1 time: 0.158989 Oct 26 14:17:54.516368 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3842/7708] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:17:54 2022] GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:17:55.539583 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e6fca3ba-d997-4e47-8a80-e85cecb4e133 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:17:55.540234 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e6fca3ba-d997-4e47-8a80-e85cecb4e133 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 6e59d90c-a3f6-4728-9ad6-a241895413e0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:17:55.547166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6fca3ba-d997-4e47-8a80-e85cecb4e133 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:17:55.547642 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6fca3ba-d997-4e47-8a80-e85cecb4e133 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:17:55.548091 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6fca3ba-d997-4e47-8a80-e85cecb4e133 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:17:55.548802 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6fca3ba-d997-4e47-8a80-e85cecb4e133 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:17:55.549272 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6fca3ba-d997-4e47-8a80-e85cecb4e133 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:17:55.549736 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6fca3ba-d997-4e47-8a80-e85cecb4e133 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:17:55.633966 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e6fca3ba-d997-4e47-8a80-e85cecb4e133 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:17:55.641728 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e6fca3ba-d997-4e47-8a80-e85cecb4e133 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0" status: 200 len: 1503 microversion: 2.1 time: 0.106406 Oct 26 14:17:55.642654 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3867/7709] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:17:55 2022] GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0 => generated 1503 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:17:55.664735 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-d12e9cb6-81ed-4307-a819-136c827a988e req-3857d40e-c634-494f-b166-e53468ac1774 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e59d90c-a3f6-4728-9ad6-a241895413e0", "name": "network-vif-deleted", "tag": "37141a76-c83d-4fb6-89e0-2aceafe1fdf4"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:17:55.675920 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d12e9cb6-81ed-4307-a819-136c827a988e req-3857d40e-c634-494f-b166-e53468ac1774 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:17:55.676484 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d12e9cb6-81ed-4307-a819-136c827a988e req-3857d40e-c634-494f-b166-e53468ac1774 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:17:55.676923 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d12e9cb6-81ed-4307-a819-136c827a988e req-3857d40e-c634-494f-b166-e53468ac1774 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:17:55.688169 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-d12e9cb6-81ed-4307-a819-136c827a988e req-3857d40e-c634-494f-b166-e53468ac1774 service nova] Creating event network-vif-deleted:37141a76-c83d-4fb6-89e0-2aceafe1fdf4 for instance 6e59d90c-a3f6-4728-9ad6-a241895413e0 on n-h2-862686-1 Oct 26 14:17:55.693684 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-d12e9cb6-81ed-4307-a819-136c827a988e req-3857d40e-c634-494f-b166-e53468ac1774 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033007 Oct 26 14:17:55.694293 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3843/7710] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:17:56.666462 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a386f031-a008-44bc-b13a-372ae78f1c2b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:17:56.667080 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a386f031-a008-44bc-b13a-372ae78f1c2b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 6e59d90c-a3f6-4728-9ad6-a241895413e0] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:17:56.673677 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a386f031-a008-44bc-b13a-372ae78f1c2b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:17:56.674173 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a386f031-a008-44bc-b13a-372ae78f1c2b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:17:56.674626 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a386f031-a008-44bc-b13a-372ae78f1c2b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:17:56.675608 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a386f031-a008-44bc-b13a-372ae78f1c2b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:17:56.676082 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a386f031-a008-44bc-b13a-372ae78f1c2b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:17:56.676524 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a386f031-a008-44bc-b13a-372ae78f1c2b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:17:56.689818 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-a386f031-a008-44bc-b13a-372ae78f1c2b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] HTTP exception thrown: Instance 6e59d90c-a3f6-4728-9ad6-a241895413e0 could not be found. Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a386f031-a008-44bc-b13a-372ae78f1c2b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Request method failure captured: Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0 HTTP/1.1 Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWUDr33jAxtjEebp3Gj9k8Lbc1SrqwHm7Mcup79l6KuQSwXiy4o2KjnHZEkbB8fkd5uIcGtGt55Uhtw3xdnKaU85Pw2G7l54JmBa0kbYJ4z4No_CAY6Y63JfScReC0DCePeGpVkaUJplfHKvIPPZMxJQQn7G18wWCdYlRSKYCWbu3jAw Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: ba91e9b802254871b5153158707cb180 Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-72818388 Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ba91e9b802254871b5153158707cb180"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ba91e9b802254871b5153158707cb180"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ba91e9b802254871b5153158707cb180"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ba91e9b802254871b5153158707cb180"}]}] Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-TestNetworkAdvancedServerOps-72818388 Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: ba91e9b802254871b5153158707cb180 Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-72818388 Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-TestNetworkAdvancedServerOps-72818388-project Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 18876f18c54a4579a554e52225b24c74 Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-TestNetworkAdvancedServerOps-72818388-project Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance 6e59d90c-a3f6-4728-9ad6-a241895413e0 could not be found. Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': '6e59d90c-a3f6-4728-9ad6-a241895413e0'} Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e59d90c-a3f6-4728-9ad6-a241895413e0 could not be found. Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e59d90c-a3f6-4728-9ad6-a241895413e0 could not be found. Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:17:56.692146 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:17:56.697505 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:17:56.697505 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:17:56.697505 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:17:56.697505 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:17:56.697505 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 14:17:56.697505 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 14:17:56.697505 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e59d90c-a3f6-4728-9ad6-a241895413e0 could not be found. Oct 26 14:17:56.697505 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:17:56.697505 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a386f031-a008-44bc-b13a-372ae78f1c2b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Returning 404 to user: Instance 6e59d90c-a3f6-4728-9ad6-a241895413e0 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 14:17:56.697505 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a386f031-a008-44bc-b13a-372ae78f1c2b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0" status: 404 len: 111 microversion: 2.1 time: 0.031586 Oct 26 14:17:56.697505 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3868/7711] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:17:56 2022] GET /compute/v2.1/servers/6e59d90c-a3f6-4728-9ad6-a241895413e0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 14:18:00.058441 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-54892a28-176c-4df6-9048-875759f7905d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '.version_select at 0x7f67313c6b80>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:18:00.080559 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-54892a28-176c-4df6-9048-875759f7905d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2108560624" status: 202 len: 0 microversion: 2.1 time: 0.027373 Oct 26 14:18:00.081369 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3844/7712] 10.222.0.40 () {58 vars in 1284 bytes} [Wed Oct 26 14:18:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2108560624 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 14:18:00.110738 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1e0d7bbe-f639-406c-b006-f9e58d0c652c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Action: 'create', calling method: .version_select at 0x7f67310899d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-822342596", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwwJQdA4zH/Ti6T+rA47EHfePyOPsAZXV7nBl8P3cxMrbeLIc+aaiCUCWMADVi/78qjgd5QnkZsNdxCC9soXqGKnp8n/j8uI/NBrbxbzPuwHBf/3JO/XDe3oWz5dZt4/g=="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:18:00.127779 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-1e0d7bbe-f639-406c-b006-f9e58d0c652c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Getting quotas for project ba91e9b802254871b5153158707cb180. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 14:18:00.133977 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-1e0d7bbe-f639-406c-b006-f9e58d0c652c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Getting quotas for user 18876f18c54a4579a554e52225b24c74 and project ba91e9b802254871b5153158707cb180. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 14:18:00.157042 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1e0d7bbe-f639-406c-b006-f9e58d0c652c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.050502 Oct 26 14:18:00.157669 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3869/7713] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 14:18:00 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:18:05.388065 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c4b19c95-a6c0-4d52-a00b-524f2cdb4dbe tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-232100802", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "4c3bed12-c091-45b4-90cb-427c69936423"}], "key_name": "tempest-TestNetworkAdvancedServerOps-822342596", "security_groups": [{"name": "tempest-secgroup-smoke-1863422713"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:18:05.511772 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-c4b19c95-a6c0-4d52-a00b-524f2cdb4dbe tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] validate_networks() for [('4c3bed12-c091-45b4-90cb-427c69936423', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 14:18:05.682131 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:18:06.027041 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-c4b19c95-a6c0-4d52-a00b-524f2cdb4dbe tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 14:18:06.027469 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-c4b19c95-a6c0-4d52-a00b-524f2cdb4dbe tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 14:18:06.027972 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-c4b19c95-a6c0-4d52-a00b-524f2cdb4dbe tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 14:18:06.028385 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-c4b19c95-a6c0-4d52-a00b-524f2cdb4dbe tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 14:18:06.028801 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-c4b19c95-a6c0-4d52-a00b-524f2cdb4dbe tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 14:18:06.040900 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4b19c95-a6c0-4d52-a00b-524f2cdb4dbe tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:18:06.041393 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4b19c95-a6c0-4d52-a00b-524f2cdb4dbe tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:18:06.041871 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4b19c95-a6c0-4d52-a00b-524f2cdb4dbe tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:18:06.042604 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4b19c95-a6c0-4d52-a00b-524f2cdb4dbe tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:18:06.043067 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4b19c95-a6c0-4d52-a00b-524f2cdb4dbe tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:18:06.043499 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4b19c95-a6c0-4d52-a00b-524f2cdb4dbe tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:18:06.062833 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-c4b19c95-a6c0-4d52-a00b-524f2cdb4dbe tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Getting quotas for project ba91e9b802254871b5153158707cb180. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 14:18:06.068788 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-c4b19c95-a6c0-4d52-a00b-524f2cdb4dbe tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Getting quotas for user 18876f18c54a4579a554e52225b24c74 and project ba91e9b802254871b5153158707cb180. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 14:18:06.083524 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c4b19c95-a6c0-4d52-a00b-524f2cdb4dbe tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 14:18:06.085933 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c4b19c95-a6c0-4d52-a00b-524f2cdb4dbe tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: d0e49430-bf57-4571-9631-451c09957845] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 14:18:06.138039 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c4b19c95-a6c0-4d52-a00b-524f2cdb4dbe tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.753483 Oct 26 14:18:06.139197 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3845/7714] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 14:18:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 14:18:06.151624 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6d924630-e9eb-4a20-82cf-daed9447b6b0 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:18:06.152391 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6d924630-e9eb-4a20-82cf-daed9447b6b0 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: d0e49430-bf57-4571-9631-451c09957845] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:18:06.226097 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6d924630-e9eb-4a20-82cf-daed9447b6b0 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:18:06.237747 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6d924630-e9eb-4a20-82cf-daed9447b6b0 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845" status: 200 len: 1265 microversion: 2.1 time: 0.090481 Oct 26 14:18:06.238905 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3870/7715] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:18:06 2022] GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845 => generated 1265 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:18:07.263648 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-276cf7f4-95e6-4b84-ae2f-2ac014dc2736 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:18:07.264416 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-276cf7f4-95e6-4b84-ae2f-2ac014dc2736 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: d0e49430-bf57-4571-9631-451c09957845] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:18:07.272684 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-276cf7f4-95e6-4b84-ae2f-2ac014dc2736 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:18:07.280373 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-276cf7f4-95e6-4b84-ae2f-2ac014dc2736 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:18:07.281095 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-276cf7f4-95e6-4b84-ae2f-2ac014dc2736 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:18:07.282148 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-276cf7f4-95e6-4b84-ae2f-2ac014dc2736 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:18:07.282868 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-276cf7f4-95e6-4b84-ae2f-2ac014dc2736 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:18:07.283725 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-276cf7f4-95e6-4b84-ae2f-2ac014dc2736 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:18:07.376445 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-276cf7f4-95e6-4b84-ae2f-2ac014dc2736 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:18:07.386808 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-276cf7f4-95e6-4b84-ae2f-2ac014dc2736 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845" status: 200 len: 1325 microversion: 2.1 time: 0.129144 Oct 26 14:18:07.387414 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3846/7716] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:18:07 2022] GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845 => generated 1325 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:18:08.410217 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7136a6af-fce0-48a9-aa9a-9376df2fca91 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:18:08.411019 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7136a6af-fce0-48a9-aa9a-9376df2fca91 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: d0e49430-bf57-4571-9631-451c09957845] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:18:08.413520 n-d-862686-1 devstack@n-api.service[120598]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 14:18:08.413958 n-d-862686-1 devstack@n-api.service[120598]: Wed Oct 26 14:18:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845 (ip 10.222.0.40) !!! Oct 26 14:18:08.414956 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=20 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:18:08.423878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7136a6af-fce0-48a9-aa9a-9376df2fca91 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:18:08.424451 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7136a6af-fce0-48a9-aa9a-9376df2fca91 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:18:08.424853 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7136a6af-fce0-48a9-aa9a-9376df2fca91 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:18:08.425820 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7136a6af-fce0-48a9-aa9a-9376df2fca91 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:18:08.426296 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7136a6af-fce0-48a9-aa9a-9376df2fca91 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:18:08.426739 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7136a6af-fce0-48a9-aa9a-9376df2fca91 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:18:08.692381 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7136a6af-fce0-48a9-aa9a-9376df2fca91 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:18:08.700601 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7136a6af-fce0-48a9-aa9a-9376df2fca91 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845" status: 200 len: 1391 microversion: 2.1 time: 0.294643 Oct 26 14:18:08.701196 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3871/7717] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:18:08 2022] GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845 => generated 1391 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:18:09.001961 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-5dad4141-808b-45cb-a1de-e243508cc277 req-89ad82a0-ab16-436b-88f3-6f9e99750176 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0e49430-bf57-4571-9631-451c09957845", "tag": "c2a1d150-a988-4f62-b9b0-c2ac025a6eb4"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:18:09.013510 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-5dad4141-808b-45cb-a1de-e243508cc277 req-89ad82a0-ab16-436b-88f3-6f9e99750176 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:18:09.014005 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-5dad4141-808b-45cb-a1de-e243508cc277 req-89ad82a0-ab16-436b-88f3-6f9e99750176 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:18:09.014450 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-5dad4141-808b-45cb-a1de-e243508cc277 req-89ad82a0-ab16-436b-88f3-6f9e99750176 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:18:09.028352 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-5dad4141-808b-45cb-a1de-e243508cc277 req-89ad82a0-ab16-436b-88f3-6f9e99750176 service nova] Creating event network-changed:c2a1d150-a988-4f62-b9b0-c2ac025a6eb4 for instance d0e49430-bf57-4571-9631-451c09957845 on n-h1-862686-1 Oct 26 14:18:09.033304 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-5dad4141-808b-45cb-a1de-e243508cc277 req-89ad82a0-ab16-436b-88f3-6f9e99750176 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110833 Oct 26 14:18:09.035294 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3847/7718] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:18:09.724805 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-82b7eacf-0f89-4e3e-a6f5-743e266df93f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:18:09.725348 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-82b7eacf-0f89-4e3e-a6f5-743e266df93f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: d0e49430-bf57-4571-9631-451c09957845] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:18:09.732195 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-82b7eacf-0f89-4e3e-a6f5-743e266df93f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:18:09.732693 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-82b7eacf-0f89-4e3e-a6f5-743e266df93f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:18:09.733147 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-82b7eacf-0f89-4e3e-a6f5-743e266df93f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:18:09.733896 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-82b7eacf-0f89-4e3e-a6f5-743e266df93f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:18:09.734371 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-82b7eacf-0f89-4e3e-a6f5-743e266df93f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:18:09.734814 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-82b7eacf-0f89-4e3e-a6f5-743e266df93f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:18:09.871446 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-82b7eacf-0f89-4e3e-a6f5-743e266df93f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:18:09.879987 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-82b7eacf-0f89-4e3e-a6f5-743e266df93f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845" status: 200 len: 1391 microversion: 2.1 time: 0.159850 Oct 26 14:18:09.880565 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3872/7719] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:18:09 2022] GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:18:10.904785 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ef74b914-1c5c-41cb-b3ae-434db253bb8a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:18:10.905489 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ef74b914-1c5c-41cb-b3ae-434db253bb8a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: d0e49430-bf57-4571-9631-451c09957845] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:18:10.912235 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ef74b914-1c5c-41cb-b3ae-434db253bb8a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:18:10.912659 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ef74b914-1c5c-41cb-b3ae-434db253bb8a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:18:10.913094 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ef74b914-1c5c-41cb-b3ae-434db253bb8a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:18:10.914213 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ef74b914-1c5c-41cb-b3ae-434db253bb8a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:18:10.914673 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ef74b914-1c5c-41cb-b3ae-434db253bb8a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:18:10.915097 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ef74b914-1c5c-41cb-b3ae-434db253bb8a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:18:11.051192 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ef74b914-1c5c-41cb-b3ae-434db253bb8a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:18:11.058877 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ef74b914-1c5c-41cb-b3ae-434db253bb8a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845" status: 200 len: 1391 microversion: 2.1 time: 0.159255 Oct 26 14:18:11.059454 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3848/7720] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:18:10 2022] GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:18:12.082444 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-66dcfcd9-39dd-4388-8e08-7ccb32029e49 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:18:12.083064 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-66dcfcd9-39dd-4388-8e08-7ccb32029e49 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: d0e49430-bf57-4571-9631-451c09957845] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:18:12.090381 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-66dcfcd9-39dd-4388-8e08-7ccb32029e49 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:18:12.090879 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-66dcfcd9-39dd-4388-8e08-7ccb32029e49 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:18:12.091327 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-66dcfcd9-39dd-4388-8e08-7ccb32029e49 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:18:12.092029 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-66dcfcd9-39dd-4388-8e08-7ccb32029e49 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:18:12.092491 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-66dcfcd9-39dd-4388-8e08-7ccb32029e49 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:18:12.092928 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-66dcfcd9-39dd-4388-8e08-7ccb32029e49 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:18:12.230177 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-66dcfcd9-39dd-4388-8e08-7ccb32029e49 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:18:12.237936 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-66dcfcd9-39dd-4388-8e08-7ccb32029e49 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845" status: 200 len: 1391 microversion: 2.1 time: 0.159696 Oct 26 14:18:12.238516 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3873/7721] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:18:12 2022] GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:18:13.261989 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b76ef7b7-b153-4e29-858d-ae0ad91a9dcf tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:18:13.262514 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b76ef7b7-b153-4e29-858d-ae0ad91a9dcf tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: d0e49430-bf57-4571-9631-451c09957845] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:18:13.269378 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b76ef7b7-b153-4e29-858d-ae0ad91a9dcf tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:18:13.269886 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b76ef7b7-b153-4e29-858d-ae0ad91a9dcf tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:18:13.270344 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b76ef7b7-b153-4e29-858d-ae0ad91a9dcf tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:18:13.271014 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b76ef7b7-b153-4e29-858d-ae0ad91a9dcf tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:18:13.271473 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b76ef7b7-b153-4e29-858d-ae0ad91a9dcf tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:18:13.271897 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b76ef7b7-b153-4e29-858d-ae0ad91a9dcf tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:18:13.411579 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b76ef7b7-b153-4e29-858d-ae0ad91a9dcf tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:18:13.419570 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b76ef7b7-b153-4e29-858d-ae0ad91a9dcf tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845" status: 200 len: 1391 microversion: 2.1 time: 0.161584 Oct 26 14:18:13.420138 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3849/7722] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:18:13 2022] GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:18:14.428032 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-a5d43202-fa32-42ed-8caf-0d45b02c8054 req-6b99871a-6d27-4c55-bee9-b6d785eb0be6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0e49430-bf57-4571-9631-451c09957845", "name": "network-vif-plugged", "status": "completed", "tag": "c2a1d150-a988-4f62-b9b0-c2ac025a6eb4"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:18:14.439332 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-a5d43202-fa32-42ed-8caf-0d45b02c8054 req-6b99871a-6d27-4c55-bee9-b6d785eb0be6 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:18:14.439835 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-a5d43202-fa32-42ed-8caf-0d45b02c8054 req-6b99871a-6d27-4c55-bee9-b6d785eb0be6 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:18:14.440831 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-a5d43202-fa32-42ed-8caf-0d45b02c8054 req-6b99871a-6d27-4c55-bee9-b6d785eb0be6 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:18:14.444313 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8c4ef257-a32a-4c58-b9df-4652909eda7d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:18:14.444924 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8c4ef257-a32a-4c58-b9df-4652909eda7d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: d0e49430-bf57-4571-9631-451c09957845] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:18:14.451592 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8c4ef257-a32a-4c58-b9df-4652909eda7d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:18:14.452082 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8c4ef257-a32a-4c58-b9df-4652909eda7d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:18:14.452518 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8c4ef257-a32a-4c58-b9df-4652909eda7d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:18:14.453217 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8c4ef257-a32a-4c58-b9df-4652909eda7d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:18:14.453722 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8c4ef257-a32a-4c58-b9df-4652909eda7d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:18:14.454145 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8c4ef257-a32a-4c58-b9df-4652909eda7d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:18:14.454958 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-a5d43202-fa32-42ed-8caf-0d45b02c8054 req-6b99871a-6d27-4c55-bee9-b6d785eb0be6 service nova] Creating event network-vif-plugged:c2a1d150-a988-4f62-b9b0-c2ac025a6eb4 for instance d0e49430-bf57-4571-9631-451c09957845 on n-h1-862686-1 Oct 26 14:18:14.460670 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-a5d43202-fa32-42ed-8caf-0d45b02c8054 req-6b99871a-6d27-4c55-bee9-b6d785eb0be6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096467 Oct 26 14:18:14.461284 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3874/7723] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:18:14.596074 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8c4ef257-a32a-4c58-b9df-4652909eda7d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:18:14.604080 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8c4ef257-a32a-4c58-b9df-4652909eda7d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845" status: 200 len: 1391 microversion: 2.1 time: 0.164974 Oct 26 14:18:14.604806 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3850/7724] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:18:14 2022] GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845 => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 14:18:15.628546 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5e5e1cb8-7cb4-49fe-9f67-4d0fbc898416 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:18:15.629260 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5e5e1cb8-7cb4-49fe-9f67-4d0fbc898416 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: d0e49430-bf57-4571-9631-451c09957845] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:18:15.635425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5e5e1cb8-7cb4-49fe-9f67-4d0fbc898416 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:18:15.635931 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5e5e1cb8-7cb4-49fe-9f67-4d0fbc898416 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:18:15.636388 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5e5e1cb8-7cb4-49fe-9f67-4d0fbc898416 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:18:15.637097 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5e5e1cb8-7cb4-49fe-9f67-4d0fbc898416 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:18:15.637600 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5e5e1cb8-7cb4-49fe-9f67-4d0fbc898416 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:18:15.638044 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5e5e1cb8-7cb4-49fe-9f67-4d0fbc898416 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:18:15.775789 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5e5e1cb8-7cb4-49fe-9f67-4d0fbc898416 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:18:15.785776 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5e5e1cb8-7cb4-49fe-9f67-4d0fbc898416 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845" status: 200 len: 1391 microversion: 2.1 time: 0.162385 Oct 26 14:18:15.786362 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3875/7725] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:18:15 2022] GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:18:16.808485 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fa417354-9dba-4f6f-876c-1224c8a8f796 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:18:16.809097 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fa417354-9dba-4f6f-876c-1224c8a8f796 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: d0e49430-bf57-4571-9631-451c09957845] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:18:16.811555 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:18:16.812236 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:18:16.819446 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa417354-9dba-4f6f-876c-1224c8a8f796 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:18:16.819937 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa417354-9dba-4f6f-876c-1224c8a8f796 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:18:16.820379 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa417354-9dba-4f6f-876c-1224c8a8f796 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:18:16.821076 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa417354-9dba-4f6f-876c-1224c8a8f796 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:18:16.821562 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa417354-9dba-4f6f-876c-1224c8a8f796 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:18:16.821995 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa417354-9dba-4f6f-876c-1224c8a8f796 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:18:16.952938 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fa417354-9dba-4f6f-876c-1224c8a8f796 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:18:16.961847 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fa417354-9dba-4f6f-876c-1224c8a8f796 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845" status: 200 len: 1562 microversion: 2.1 time: 0.157313 Oct 26 14:18:16.962422 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3851/7726] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:18:16 2022] GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845 => generated 1562 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:18:16.983889 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b6665a5c-59f1-4a99-b2fa-cee0108821fd tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:18:16.984504 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b6665a5c-59f1-4a99-b2fa-cee0108821fd tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: d0e49430-bf57-4571-9631-451c09957845] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:18:16.986502 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:18:16.988539 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:18:16.994641 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b6665a5c-59f1-4a99-b2fa-cee0108821fd tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:18:16.995135 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b6665a5c-59f1-4a99-b2fa-cee0108821fd tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:18:16.995583 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b6665a5c-59f1-4a99-b2fa-cee0108821fd tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:18:16.996281 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b6665a5c-59f1-4a99-b2fa-cee0108821fd tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:18:16.996748 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b6665a5c-59f1-4a99-b2fa-cee0108821fd tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:18:16.997184 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b6665a5c-59f1-4a99-b2fa-cee0108821fd tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:18:17.132309 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b6665a5c-59f1-4a99-b2fa-cee0108821fd tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:18:17.139941 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b6665a5c-59f1-4a99-b2fa-cee0108821fd tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845" status: 200 len: 1562 microversion: 2.1 time: 0.159988 Oct 26 14:18:17.140512 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3876/7727] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:18:16 2022] GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845 => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:18:19.046628 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9869ef76-ed70-4618-9954-ab1860df205b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:18:19.047239 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9869ef76-ed70-4618-9954-ab1860df205b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: d0e49430-bf57-4571-9631-451c09957845] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:18:19.049012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-da11015c-47c3-4f91-87f8-ade8492362da req-50342105-04d6-4fee-8c7a-5e0d134b4868 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0e49430-bf57-4571-9631-451c09957845", "tag": "c2a1d150-a988-4f62-b9b0-c2ac025a6eb4"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:18:19.055292 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9869ef76-ed70-4618-9954-ab1860df205b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:18:19.055783 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9869ef76-ed70-4618-9954-ab1860df205b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:18:19.056222 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9869ef76-ed70-4618-9954-ab1860df205b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:18:19.056926 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9869ef76-ed70-4618-9954-ab1860df205b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:18:19.057377 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9869ef76-ed70-4618-9954-ab1860df205b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:18:19.057830 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9869ef76-ed70-4618-9954-ab1860df205b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:18:19.060808 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-da11015c-47c3-4f91-87f8-ade8492362da req-50342105-04d6-4fee-8c7a-5e0d134b4868 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:18:19.061372 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-da11015c-47c3-4f91-87f8-ade8492362da req-50342105-04d6-4fee-8c7a-5e0d134b4868 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:18:19.061907 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-da11015c-47c3-4f91-87f8-ade8492362da req-50342105-04d6-4fee-8c7a-5e0d134b4868 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:18:19.076059 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-da11015c-47c3-4f91-87f8-ade8492362da req-50342105-04d6-4fee-8c7a-5e0d134b4868 service nova] Creating event network-changed:c2a1d150-a988-4f62-b9b0-c2ac025a6eb4 for instance d0e49430-bf57-4571-9631-451c09957845 on n-h1-862686-1 Oct 26 14:18:19.082162 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-da11015c-47c3-4f91-87f8-ade8492362da req-50342105-04d6-4fee-8c7a-5e0d134b4868 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036646 Oct 26 14:18:19.083657 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3877/7728] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 14:18:19.202970 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-9869ef76-ed70-4618-9954-ab1860df205b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:18:19.213631 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9869ef76-ed70-4618-9954-ab1860df205b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845" status: 200 len: 1562 microversion: 2.1 time: 0.170716 Oct 26 14:18:19.214219 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3852/7729] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:18:19 2022] GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845 => generated 1562 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:18:42.514006 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:18:42.514770 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=34 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:18:42.519028 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-dc9fa2e9-cf74-4d39-a189-e4e36305d806 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:18:42.521921 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-dc9fa2e9-cf74-4d39-a189-e4e36305d806 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: d0e49430-bf57-4571-9631-451c09957845] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:18:42.528835 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc9fa2e9-cf74-4d39-a189-e4e36305d806 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:18:42.529353 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc9fa2e9-cf74-4d39-a189-e4e36305d806 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:18:42.529838 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc9fa2e9-cf74-4d39-a189-e4e36305d806 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:18:42.530541 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc9fa2e9-cf74-4d39-a189-e4e36305d806 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:18:42.531009 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc9fa2e9-cf74-4d39-a189-e4e36305d806 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:18:42.531448 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc9fa2e9-cf74-4d39-a189-e4e36305d806 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:18:42.586869 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-dc9fa2e9-cf74-4d39-a189-e4e36305d806 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "POST /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845/action" status: 200 len: 24568 microversion: 2.1 time: 0.074705 Oct 26 14:18:42.587792 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3878/7730] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 14:18:42 2022] POST /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845/action => generated 24568 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 14:18:53.655811 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8511b467-6e75-4822-815c-9e83a2b53cbf tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:18:53.658145 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8511b467-6e75-4822-815c-9e83a2b53cbf tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: d0e49430-bf57-4571-9631-451c09957845] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:18:53.660172 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:18:53.660980 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=40 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:18:53.667663 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8511b467-6e75-4822-815c-9e83a2b53cbf tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:18:53.668147 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8511b467-6e75-4822-815c-9e83a2b53cbf tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:18:53.668587 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8511b467-6e75-4822-815c-9e83a2b53cbf tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:18:53.669285 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8511b467-6e75-4822-815c-9e83a2b53cbf tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:18:53.669774 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8511b467-6e75-4822-815c-9e83a2b53cbf tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:18:53.670201 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8511b467-6e75-4822-815c-9e83a2b53cbf tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:18:53.715129 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8511b467-6e75-4822-815c-9e83a2b53cbf tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:18:53.721159 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8511b467-6e75-4822-815c-9e83a2b53cbf tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: d0e49430-bf57-4571-9631-451c09957845] Old instance type m1.heat2, new instance type m1.heat {{(pid=120597) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 26 14:18:53.728595 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-8511b467-6e75-4822-815c-9e83a2b53cbf tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 14:18:53.729049 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-8511b467-6e75-4822-815c-9e83a2b53cbf tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 14:18:53.729553 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-8511b467-6e75-4822-815c-9e83a2b53cbf tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 14:18:53.729965 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-8511b467-6e75-4822-815c-9e83a2b53cbf tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 14:18:53.730374 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-8511b467-6e75-4822-815c-9e83a2b53cbf tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 14:18:53.794750 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8511b467-6e75-4822-815c-9e83a2b53cbf tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "POST /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845/action" status: 202 len: 0 microversion: 2.1 time: 0.143122 Oct 26 14:18:53.795470 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3853/7731] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 14:18:53 2022] POST /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 14:18:53.804379 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c4496e31-b448-40d4-a0a3-b96cf8572038 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:18:53.805085 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c4496e31-b448-40d4-a0a3-b96cf8572038 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: d0e49430-bf57-4571-9631-451c09957845] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:18:53.808011 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:18:53.808684 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=4 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:18:53.816680 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4496e31-b448-40d4-a0a3-b96cf8572038 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:18:53.817392 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4496e31-b448-40d4-a0a3-b96cf8572038 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:18:53.818059 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4496e31-b448-40d4-a0a3-b96cf8572038 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:18:53.819027 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4496e31-b448-40d4-a0a3-b96cf8572038 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:18:53.819679 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4496e31-b448-40d4-a0a3-b96cf8572038 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:18:53.820127 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4496e31-b448-40d4-a0a3-b96cf8572038 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:18:53.965564 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-c4496e31-b448-40d4-a0a3-b96cf8572038 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:18:53.973156 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c4496e31-b448-40d4-a0a3-b96cf8572038 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845" status: 200 len: 1690 microversion: 2.1 time: 0.173110 Oct 26 14:18:53.973868 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3879/7732] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:18:53 2022] GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845 => generated 1690 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 14:18:54.998524 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f20dee58-1f75-4b46-8020-4e4f603ff08a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:18:54.999272 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f20dee58-1f75-4b46-8020-4e4f603ff08a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: d0e49430-bf57-4571-9631-451c09957845] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:18:55.007277 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f20dee58-1f75-4b46-8020-4e4f603ff08a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:18:55.007918 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f20dee58-1f75-4b46-8020-4e4f603ff08a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:18:55.008452 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f20dee58-1f75-4b46-8020-4e4f603ff08a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:18:55.009184 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f20dee58-1f75-4b46-8020-4e4f603ff08a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:18:55.009816 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f20dee58-1f75-4b46-8020-4e4f603ff08a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:18:55.010255 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f20dee58-1f75-4b46-8020-4e4f603ff08a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:18:55.151454 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f20dee58-1f75-4b46-8020-4e4f603ff08a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:18:55.159226 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f20dee58-1f75-4b46-8020-4e4f603ff08a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845" status: 200 len: 1690 microversion: 2.1 time: 0.164964 Oct 26 14:18:55.159803 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3854/7733] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:18:54 2022] GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845 => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:18:56.182932 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4cee1ab9-eb65-4681-8dde-2c6cc7ecf8df tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:18:56.183530 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4cee1ab9-eb65-4681-8dde-2c6cc7ecf8df tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: d0e49430-bf57-4571-9631-451c09957845] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:18:56.191120 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cee1ab9-eb65-4681-8dde-2c6cc7ecf8df tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:18:56.191605 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cee1ab9-eb65-4681-8dde-2c6cc7ecf8df tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:18:56.192048 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cee1ab9-eb65-4681-8dde-2c6cc7ecf8df tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:18:56.192766 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cee1ab9-eb65-4681-8dde-2c6cc7ecf8df tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:18:56.193229 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cee1ab9-eb65-4681-8dde-2c6cc7ecf8df tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:18:56.193692 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4cee1ab9-eb65-4681-8dde-2c6cc7ecf8df tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:18:56.326443 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4cee1ab9-eb65-4681-8dde-2c6cc7ecf8df tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:18:56.334406 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4cee1ab9-eb65-4681-8dde-2c6cc7ecf8df tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845" status: 200 len: 1695 microversion: 2.1 time: 0.155370 Oct 26 14:18:56.334982 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3880/7734] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:18:56 2022] GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845 => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:18:57.359305 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d49716d7-83a6-4462-bc52-e5e6e6ad7052 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:18:57.359916 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d49716d7-83a6-4462-bc52-e5e6e6ad7052 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: d0e49430-bf57-4571-9631-451c09957845] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:18:57.366837 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d49716d7-83a6-4462-bc52-e5e6e6ad7052 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:18:57.367325 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d49716d7-83a6-4462-bc52-e5e6e6ad7052 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:18:57.367970 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d49716d7-83a6-4462-bc52-e5e6e6ad7052 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:18:57.368664 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d49716d7-83a6-4462-bc52-e5e6e6ad7052 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:18:57.369123 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d49716d7-83a6-4462-bc52-e5e6e6ad7052 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:18:57.369578 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d49716d7-83a6-4462-bc52-e5e6e6ad7052 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:18:57.500150 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d49716d7-83a6-4462-bc52-e5e6e6ad7052 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:18:57.508313 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d49716d7-83a6-4462-bc52-e5e6e6ad7052 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845" status: 200 len: 1695 microversion: 2.1 time: 0.152438 Oct 26 14:18:57.508892 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3855/7735] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:18:57 2022] GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845 => generated 1695 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:18:58.532157 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2c78ad56-f5a0-4926-9276-a63a57d5716a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:18:58.532782 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2c78ad56-f5a0-4926-9276-a63a57d5716a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: d0e49430-bf57-4571-9631-451c09957845] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:18:58.540496 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2c78ad56-f5a0-4926-9276-a63a57d5716a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:18:58.540988 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2c78ad56-f5a0-4926-9276-a63a57d5716a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:18:58.541441 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2c78ad56-f5a0-4926-9276-a63a57d5716a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:18:58.542166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2c78ad56-f5a0-4926-9276-a63a57d5716a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:18:58.542634 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2c78ad56-f5a0-4926-9276-a63a57d5716a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:18:58.543076 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2c78ad56-f5a0-4926-9276-a63a57d5716a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:18:58.681724 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2c78ad56-f5a0-4926-9276-a63a57d5716a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:18:58.689497 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2c78ad56-f5a0-4926-9276-a63a57d5716a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845" status: 200 len: 1695 microversion: 2.1 time: 0.161339 Oct 26 14:18:58.690095 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3881/7736] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:18:58 2022] GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845 => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:18:59.712991 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-aeed2514-f3d0-4500-92bc-95a907a790a7 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:18:59.713619 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-aeed2514-f3d0-4500-92bc-95a907a790a7 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: d0e49430-bf57-4571-9631-451c09957845] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:18:59.720013 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aeed2514-f3d0-4500-92bc-95a907a790a7 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:18:59.720520 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aeed2514-f3d0-4500-92bc-95a907a790a7 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:18:59.720955 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aeed2514-f3d0-4500-92bc-95a907a790a7 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:18:59.721671 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aeed2514-f3d0-4500-92bc-95a907a790a7 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:18:59.722123 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aeed2514-f3d0-4500-92bc-95a907a790a7 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:18:59.722546 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aeed2514-f3d0-4500-92bc-95a907a790a7 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:18:59.857513 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-aeed2514-f3d0-4500-92bc-95a907a790a7 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:18:59.865297 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-aeed2514-f3d0-4500-92bc-95a907a790a7 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845" status: 200 len: 1695 microversion: 2.1 time: 0.156368 Oct 26 14:18:59.865892 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3856/7737] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:18:59 2022] GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845 => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:19:00.888865 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-de05835a-8b1b-4f24-a47c-7fce73cd01e3 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:19:00.889499 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-de05835a-8b1b-4f24-a47c-7fce73cd01e3 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: d0e49430-bf57-4571-9631-451c09957845] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:19:00.896268 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de05835a-8b1b-4f24-a47c-7fce73cd01e3 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:00.896761 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de05835a-8b1b-4f24-a47c-7fce73cd01e3 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:00.897212 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de05835a-8b1b-4f24-a47c-7fce73cd01e3 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:00.897937 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de05835a-8b1b-4f24-a47c-7fce73cd01e3 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:00.898899 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de05835a-8b1b-4f24-a47c-7fce73cd01e3 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:00.899510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de05835a-8b1b-4f24-a47c-7fce73cd01e3 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:01.030015 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-de05835a-8b1b-4f24-a47c-7fce73cd01e3 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:19:01.037740 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-de05835a-8b1b-4f24-a47c-7fce73cd01e3 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845" status: 200 len: 1695 microversion: 2.1 time: 0.152700 Oct 26 14:19:01.038254 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3882/7738] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:19:00 2022] GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845 => generated 1695 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:19:02.061953 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f35cbded-4f8c-4432-8205-652f33712781 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:19:02.062563 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f35cbded-4f8c-4432-8205-652f33712781 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: d0e49430-bf57-4571-9631-451c09957845] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:19:02.069298 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f35cbded-4f8c-4432-8205-652f33712781 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:02.069817 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f35cbded-4f8c-4432-8205-652f33712781 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:02.070869 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f35cbded-4f8c-4432-8205-652f33712781 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:02.071560 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f35cbded-4f8c-4432-8205-652f33712781 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:02.072015 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f35cbded-4f8c-4432-8205-652f33712781 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:02.072442 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f35cbded-4f8c-4432-8205-652f33712781 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:02.203528 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f35cbded-4f8c-4432-8205-652f33712781 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:19:02.211668 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f35cbded-4f8c-4432-8205-652f33712781 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845" status: 200 len: 1695 microversion: 2.1 time: 0.153607 Oct 26 14:19:02.212237 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3857/7739] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:19:02 2022] GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845 => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:19:03.238005 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b25f228b-24e4-4a69-a84a-398b3fe01446 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:19:03.238633 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b25f228b-24e4-4a69-a84a-398b3fe01446 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: d0e49430-bf57-4571-9631-451c09957845] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:19:03.246155 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b25f228b-24e4-4a69-a84a-398b3fe01446 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:03.246653 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b25f228b-24e4-4a69-a84a-398b3fe01446 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:03.247105 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b25f228b-24e4-4a69-a84a-398b3fe01446 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:03.247814 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b25f228b-24e4-4a69-a84a-398b3fe01446 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:03.248280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b25f228b-24e4-4a69-a84a-398b3fe01446 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:03.248721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b25f228b-24e4-4a69-a84a-398b3fe01446 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:03.385108 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b25f228b-24e4-4a69-a84a-398b3fe01446 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:19:03.392734 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b25f228b-24e4-4a69-a84a-398b3fe01446 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845" status: 200 len: 1695 microversion: 2.1 time: 0.160780 Oct 26 14:19:03.393304 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3883/7740] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:19:03 2022] GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845 => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:19:04.417066 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-32b9f0ac-bfed-4c8b-a20f-91ec5d216af8 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:19:04.417712 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-32b9f0ac-bfed-4c8b-a20f-91ec5d216af8 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: d0e49430-bf57-4571-9631-451c09957845] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:19:04.424967 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32b9f0ac-bfed-4c8b-a20f-91ec5d216af8 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:04.425458 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32b9f0ac-bfed-4c8b-a20f-91ec5d216af8 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:04.425928 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32b9f0ac-bfed-4c8b-a20f-91ec5d216af8 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:04.426627 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32b9f0ac-bfed-4c8b-a20f-91ec5d216af8 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:04.427087 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32b9f0ac-bfed-4c8b-a20f-91ec5d216af8 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:04.427514 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-32b9f0ac-bfed-4c8b-a20f-91ec5d216af8 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:04.564779 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-32b9f0ac-bfed-4c8b-a20f-91ec5d216af8 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:19:04.573694 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-32b9f0ac-bfed-4c8b-a20f-91ec5d216af8 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845" status: 200 len: 1695 microversion: 2.1 time: 0.160908 Oct 26 14:19:04.574267 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3858/7741] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:19:04 2022] GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845 => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:19:05.597069 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f2eb2092-49b5-41f6-b6fc-cd695e723c3e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:19:05.597728 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f2eb2092-49b5-41f6-b6fc-cd695e723c3e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: d0e49430-bf57-4571-9631-451c09957845] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:19:05.605281 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f2eb2092-49b5-41f6-b6fc-cd695e723c3e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:05.605806 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f2eb2092-49b5-41f6-b6fc-cd695e723c3e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:05.606256 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f2eb2092-49b5-41f6-b6fc-cd695e723c3e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:05.606961 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f2eb2092-49b5-41f6-b6fc-cd695e723c3e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:05.607431 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f2eb2092-49b5-41f6-b6fc-cd695e723c3e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:05.607870 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f2eb2092-49b5-41f6-b6fc-cd695e723c3e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:05.743388 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f2eb2092-49b5-41f6-b6fc-cd695e723c3e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:19:05.751293 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f2eb2092-49b5-41f6-b6fc-cd695e723c3e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845" status: 200 len: 1695 microversion: 2.1 time: 0.158147 Oct 26 14:19:05.751865 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3884/7742] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:19:05 2022] GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845 => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:19:06.776012 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2ddf6c96-8223-4793-8694-272c9f08dd69 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:19:06.776621 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2ddf6c96-8223-4793-8694-272c9f08dd69 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: d0e49430-bf57-4571-9631-451c09957845] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:19:06.783678 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ddf6c96-8223-4793-8694-272c9f08dd69 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:06.784162 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ddf6c96-8223-4793-8694-272c9f08dd69 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:06.784589 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ddf6c96-8223-4793-8694-272c9f08dd69 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:06.785273 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ddf6c96-8223-4793-8694-272c9f08dd69 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:06.785751 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ddf6c96-8223-4793-8694-272c9f08dd69 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:06.786175 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ddf6c96-8223-4793-8694-272c9f08dd69 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:06.918911 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2ddf6c96-8223-4793-8694-272c9f08dd69 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:19:06.926652 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2ddf6c96-8223-4793-8694-272c9f08dd69 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845" status: 200 len: 1695 microversion: 2.1 time: 0.155289 Oct 26 14:19:06.927219 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3859/7743] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:19:06 2022] GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845 => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:19:07.950646 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9cd2b1e6-b414-4aba-8703-8075ac176218 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:19:07.951302 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9cd2b1e6-b414-4aba-8703-8075ac176218 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: d0e49430-bf57-4571-9631-451c09957845] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:19:07.958182 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9cd2b1e6-b414-4aba-8703-8075ac176218 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:07.958679 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9cd2b1e6-b414-4aba-8703-8075ac176218 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:07.959127 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9cd2b1e6-b414-4aba-8703-8075ac176218 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:07.959885 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9cd2b1e6-b414-4aba-8703-8075ac176218 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:07.960314 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9cd2b1e6-b414-4aba-8703-8075ac176218 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:07.960790 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9cd2b1e6-b414-4aba-8703-8075ac176218 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:08.090880 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9cd2b1e6-b414-4aba-8703-8075ac176218 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:19:08.098564 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9cd2b1e6-b414-4aba-8703-8075ac176218 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845" status: 200 len: 1695 microversion: 2.1 time: 0.151904 Oct 26 14:19:08.099134 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3885/7744] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:19:07 2022] GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845 => generated 1695 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:19:09.122116 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e1633dc7-4ed2-4b59-81dc-e470cf318efd tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:19:09.122681 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e1633dc7-4ed2-4b59-81dc-e470cf318efd tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: d0e49430-bf57-4571-9631-451c09957845] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:19:09.129472 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1633dc7-4ed2-4b59-81dc-e470cf318efd tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:09.129986 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1633dc7-4ed2-4b59-81dc-e470cf318efd tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:09.130425 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1633dc7-4ed2-4b59-81dc-e470cf318efd tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:09.131114 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1633dc7-4ed2-4b59-81dc-e470cf318efd tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:09.131566 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1633dc7-4ed2-4b59-81dc-e470cf318efd tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:09.131994 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e1633dc7-4ed2-4b59-81dc-e470cf318efd tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:09.266081 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e1633dc7-4ed2-4b59-81dc-e470cf318efd tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:19:09.274742 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e1633dc7-4ed2-4b59-81dc-e470cf318efd tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845" status: 200 len: 1695 microversion: 2.1 time: 0.156621 Oct 26 14:19:09.275313 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3860/7745] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:19:09 2022] GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845 => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:19:10.299464 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7ae5cb3e-755d-4707-944b-a033e55aeb9a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:19:10.300088 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7ae5cb3e-755d-4707-944b-a033e55aeb9a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: d0e49430-bf57-4571-9631-451c09957845] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:19:10.306971 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ae5cb3e-755d-4707-944b-a033e55aeb9a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:10.307462 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ae5cb3e-755d-4707-944b-a033e55aeb9a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:10.307906 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ae5cb3e-755d-4707-944b-a033e55aeb9a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:10.308604 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ae5cb3e-755d-4707-944b-a033e55aeb9a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:10.309065 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ae5cb3e-755d-4707-944b-a033e55aeb9a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:10.309523 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ae5cb3e-755d-4707-944b-a033e55aeb9a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:10.445160 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7ae5cb3e-755d-4707-944b-a033e55aeb9a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:19:10.452933 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7ae5cb3e-755d-4707-944b-a033e55aeb9a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845" status: 200 len: 1695 microversion: 2.1 time: 0.157421 Oct 26 14:19:10.453533 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3886/7746] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:19:10 2022] GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845 => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:19:11.477093 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5bd81ec4-49be-4d4a-bb62-f11ad9053365 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:19:11.477715 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5bd81ec4-49be-4d4a-bb62-f11ad9053365 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: d0e49430-bf57-4571-9631-451c09957845] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:19:11.484556 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bd81ec4-49be-4d4a-bb62-f11ad9053365 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:11.485041 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bd81ec4-49be-4d4a-bb62-f11ad9053365 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:11.485775 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bd81ec4-49be-4d4a-bb62-f11ad9053365 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:11.486464 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bd81ec4-49be-4d4a-bb62-f11ad9053365 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:11.486918 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bd81ec4-49be-4d4a-bb62-f11ad9053365 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:11.487344 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bd81ec4-49be-4d4a-bb62-f11ad9053365 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:11.622209 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5bd81ec4-49be-4d4a-bb62-f11ad9053365 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:19:11.629844 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5bd81ec4-49be-4d4a-bb62-f11ad9053365 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845" status: 200 len: 1695 microversion: 2.1 time: 0.156877 Oct 26 14:19:11.630416 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3861/7747] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:19:11 2022] GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845 => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:19:12.653615 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7a89b8ca-5785-41b7-9a1a-6dc7810204de tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:19:12.654228 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7a89b8ca-5785-41b7-9a1a-6dc7810204de tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: d0e49430-bf57-4571-9631-451c09957845] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:19:12.661037 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a89b8ca-5785-41b7-9a1a-6dc7810204de tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:12.661849 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a89b8ca-5785-41b7-9a1a-6dc7810204de tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:12.662294 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a89b8ca-5785-41b7-9a1a-6dc7810204de tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:12.662990 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a89b8ca-5785-41b7-9a1a-6dc7810204de tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:12.664534 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a89b8ca-5785-41b7-9a1a-6dc7810204de tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:12.664974 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a89b8ca-5785-41b7-9a1a-6dc7810204de tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:12.800322 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7a89b8ca-5785-41b7-9a1a-6dc7810204de tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:19:12.808362 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7a89b8ca-5785-41b7-9a1a-6dc7810204de tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845" status: 200 len: 1695 microversion: 2.1 time: 0.158697 Oct 26 14:19:12.808945 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3887/7748] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:19:12 2022] GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:19:13.547862 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-326df79a-d117-4b97-b456-036b98006839 req-3bd3f9c6-4d98-480c-b40f-d73798d3bca2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0e49430-bf57-4571-9631-451c09957845", "name": "network-vif-unplugged", "status": "completed", "tag": "c2a1d150-a988-4f62-b9b0-c2ac025a6eb4"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:19:13.558422 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-326df79a-d117-4b97-b456-036b98006839 req-3bd3f9c6-4d98-480c-b40f-d73798d3bca2 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:13.558904 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-326df79a-d117-4b97-b456-036b98006839 req-3bd3f9c6-4d98-480c-b40f-d73798d3bca2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:13.559294 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-326df79a-d117-4b97-b456-036b98006839 req-3bd3f9c6-4d98-480c-b40f-d73798d3bca2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:13.571206 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-326df79a-d117-4b97-b456-036b98006839 req-3bd3f9c6-4d98-480c-b40f-d73798d3bca2 service nova] Creating event network-vif-unplugged:c2a1d150-a988-4f62-b9b0-c2ac025a6eb4 for instance d0e49430-bf57-4571-9631-451c09957845 on n-h2-862686-1 Oct 26 14:19:13.576595 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [req-326df79a-d117-4b97-b456-036b98006839 req-3bd3f9c6-4d98-480c-b40f-d73798d3bca2 service nova] Instance d0e49430-bf57-4571-9631-451c09957845 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862686-1', 'n-h1-862686-1'} {{(pid=120597) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 14:19:13.587990 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-326df79a-d117-4b97-b456-036b98006839 req-3bd3f9c6-4d98-480c-b40f-d73798d3bca2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043845 Oct 26 14:19:13.588790 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3862/7749] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:19:13.834020 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d6de7ff6-5653-4e05-8ab6-5edc0e2008e4 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:19:13.835768 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d6de7ff6-5653-4e05-8ab6-5edc0e2008e4 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: d0e49430-bf57-4571-9631-451c09957845] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:19:13.842662 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6de7ff6-5653-4e05-8ab6-5edc0e2008e4 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:13.843167 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6de7ff6-5653-4e05-8ab6-5edc0e2008e4 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:13.843623 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6de7ff6-5653-4e05-8ab6-5edc0e2008e4 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:13.844363 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6de7ff6-5653-4e05-8ab6-5edc0e2008e4 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:13.844838 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6de7ff6-5653-4e05-8ab6-5edc0e2008e4 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:13.845282 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6de7ff6-5653-4e05-8ab6-5edc0e2008e4 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:13.988090 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d6de7ff6-5653-4e05-8ab6-5edc0e2008e4 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:19:13.996641 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d6de7ff6-5653-4e05-8ab6-5edc0e2008e4 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845" status: 200 len: 1694 microversion: 2.1 time: 0.166452 Oct 26 14:19:14.009507 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3888/7750] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:19:13 2022] GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845 => generated 1694 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:19:15.023643 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-986e10a8-0ac5-4317-b399-839ccfdbf47e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:19:15.024467 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-986e10a8-0ac5-4317-b399-839ccfdbf47e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: d0e49430-bf57-4571-9631-451c09957845] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:19:15.030623 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-986e10a8-0ac5-4317-b399-839ccfdbf47e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:15.031109 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-986e10a8-0ac5-4317-b399-839ccfdbf47e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:15.031549 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-986e10a8-0ac5-4317-b399-839ccfdbf47e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:15.032237 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-986e10a8-0ac5-4317-b399-839ccfdbf47e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:15.032730 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-986e10a8-0ac5-4317-b399-839ccfdbf47e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:15.033157 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-986e10a8-0ac5-4317-b399-839ccfdbf47e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:15.165046 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-986e10a8-0ac5-4317-b399-839ccfdbf47e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:19:15.172827 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-986e10a8-0ac5-4317-b399-839ccfdbf47e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845" status: 200 len: 1692 microversion: 2.1 time: 0.155120 Oct 26 14:19:15.173409 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3863/7751] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:19:15 2022] GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:19:15.603099 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-188d731a-1fa8-40ac-9139-3d4d6441c0c8 req-2ea04f3c-0710-40f6-b242-4bed92e49520 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0e49430-bf57-4571-9631-451c09957845", "tag": "c2a1d150-a988-4f62-b9b0-c2ac025a6eb4"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:19:15.613352 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-188d731a-1fa8-40ac-9139-3d4d6441c0c8 req-2ea04f3c-0710-40f6-b242-4bed92e49520 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:15.613874 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-188d731a-1fa8-40ac-9139-3d4d6441c0c8 req-2ea04f3c-0710-40f6-b242-4bed92e49520 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:15.614316 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-188d731a-1fa8-40ac-9139-3d4d6441c0c8 req-2ea04f3c-0710-40f6-b242-4bed92e49520 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:15.626681 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-188d731a-1fa8-40ac-9139-3d4d6441c0c8 req-2ea04f3c-0710-40f6-b242-4bed92e49520 service nova] Creating event network-changed:c2a1d150-a988-4f62-b9b0-c2ac025a6eb4 for instance d0e49430-bf57-4571-9631-451c09957845 on n-h2-862686-1 Oct 26 14:19:15.633172 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [req-188d731a-1fa8-40ac-9139-3d4d6441c0c8 req-2ea04f3c-0710-40f6-b242-4bed92e49520 service nova] Instance d0e49430-bf57-4571-9631-451c09957845 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862686-1', 'n-h1-862686-1'} {{(pid=120598) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 14:19:15.644476 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-188d731a-1fa8-40ac-9139-3d4d6441c0c8 req-2ea04f3c-0710-40f6-b242-4bed92e49520 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045035 Oct 26 14:19:15.644988 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3889/7752] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:19:16.196432 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-435c9116-9905-496c-b353-160d8c59349f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:19:16.197085 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-435c9116-9905-496c-b353-160d8c59349f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: d0e49430-bf57-4571-9631-451c09957845] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:19:16.204580 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-435c9116-9905-496c-b353-160d8c59349f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:16.205073 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-435c9116-9905-496c-b353-160d8c59349f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:16.205544 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-435c9116-9905-496c-b353-160d8c59349f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:16.206245 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-435c9116-9905-496c-b353-160d8c59349f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:16.206706 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-435c9116-9905-496c-b353-160d8c59349f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:16.207135 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-435c9116-9905-496c-b353-160d8c59349f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:16.386701 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-435c9116-9905-496c-b353-160d8c59349f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:19:16.394864 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-435c9116-9905-496c-b353-160d8c59349f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845" status: 200 len: 1692 microversion: 2.1 time: 0.202542 Oct 26 14:19:16.395478 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3864/7753] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:19:16 2022] GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845 => generated 1692 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:19:17.420722 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9425a59f-2de2-4e28-8fd7-7bb5edf7e062 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:19:17.421430 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9425a59f-2de2-4e28-8fd7-7bb5edf7e062 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: d0e49430-bf57-4571-9631-451c09957845] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:19:17.427644 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9425a59f-2de2-4e28-8fd7-7bb5edf7e062 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:17.428142 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9425a59f-2de2-4e28-8fd7-7bb5edf7e062 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:17.428594 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9425a59f-2de2-4e28-8fd7-7bb5edf7e062 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:17.429858 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9425a59f-2de2-4e28-8fd7-7bb5edf7e062 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:17.430359 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9425a59f-2de2-4e28-8fd7-7bb5edf7e062 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:17.430797 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9425a59f-2de2-4e28-8fd7-7bb5edf7e062 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:17.563688 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9425a59f-2de2-4e28-8fd7-7bb5edf7e062 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:19:17.571998 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9425a59f-2de2-4e28-8fd7-7bb5edf7e062 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845" status: 200 len: 1689 microversion: 2.1 time: 0.156483 Oct 26 14:19:17.572578 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3890/7754] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:19:17 2022] GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:19:17.594499 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b030a501-8b07-40bd-b7a6-44665dbed025 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:19:17.595028 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b030a501-8b07-40bd-b7a6-44665dbed025 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: d0e49430-bf57-4571-9631-451c09957845] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:19:17.602463 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b030a501-8b07-40bd-b7a6-44665dbed025 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:17.602948 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b030a501-8b07-40bd-b7a6-44665dbed025 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:17.603383 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b030a501-8b07-40bd-b7a6-44665dbed025 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:17.604078 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b030a501-8b07-40bd-b7a6-44665dbed025 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:17.604979 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b030a501-8b07-40bd-b7a6-44665dbed025 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:17.604979 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b030a501-8b07-40bd-b7a6-44665dbed025 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:17.671250 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b030a501-8b07-40bd-b7a6-44665dbed025 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "POST /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845/action" status: 204 len: 0 microversion: 2.1 time: 0.080286 Oct 26 14:19:17.672441 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3865/7755] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 14:19:17 2022] POST /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845/action => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 14:19:17.682591 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f4ba023b-fe12-4211-97f2-6a73cd36a159 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:19:17.683489 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f4ba023b-fe12-4211-97f2-6a73cd36a159 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: d0e49430-bf57-4571-9631-451c09957845] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:19:17.690174 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4ba023b-fe12-4211-97f2-6a73cd36a159 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:17.690649 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4ba023b-fe12-4211-97f2-6a73cd36a159 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:17.691088 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4ba023b-fe12-4211-97f2-6a73cd36a159 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:17.692225 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4ba023b-fe12-4211-97f2-6a73cd36a159 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:17.693055 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4ba023b-fe12-4211-97f2-6a73cd36a159 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:17.693740 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4ba023b-fe12-4211-97f2-6a73cd36a159 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:17.951653 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f4ba023b-fe12-4211-97f2-6a73cd36a159 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:19:17.959381 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f4ba023b-fe12-4211-97f2-6a73cd36a159 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845" status: 200 len: 1689 microversion: 2.1 time: 0.282618 Oct 26 14:19:17.959964 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3891/7756] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:19:17 2022] GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845 => generated 1689 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:19:17.982499 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-02318b1f-dce3-4370-b436-cf69c0dbb94a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:19:17.983208 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-02318b1f-dce3-4370-b436-cf69c0dbb94a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: d0e49430-bf57-4571-9631-451c09957845] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:19:17.989997 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-02318b1f-dce3-4370-b436-cf69c0dbb94a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:17.990485 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-02318b1f-dce3-4370-b436-cf69c0dbb94a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:17.990924 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-02318b1f-dce3-4370-b436-cf69c0dbb94a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:17.992290 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-02318b1f-dce3-4370-b436-cf69c0dbb94a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:17.992754 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-02318b1f-dce3-4370-b436-cf69c0dbb94a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:17.993179 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-02318b1f-dce3-4370-b436-cf69c0dbb94a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:18.135773 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-02318b1f-dce3-4370-b436-cf69c0dbb94a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:19:18.144660 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-02318b1f-dce3-4370-b436-cf69c0dbb94a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845" status: 200 len: 1689 microversion: 2.1 time: 0.165750 Oct 26 14:19:18.145305 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3866/7757] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:19:17 2022] GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845 => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:19:19.169408 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d4546aef-7f9e-4623-bc2a-ed5c1a3bf0bd tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:19:19.170039 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d4546aef-7f9e-4623-bc2a-ed5c1a3bf0bd tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: d0e49430-bf57-4571-9631-451c09957845] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:19:19.176778 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4546aef-7f9e-4623-bc2a-ed5c1a3bf0bd tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:19.177271 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4546aef-7f9e-4623-bc2a-ed5c1a3bf0bd tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:19.177762 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4546aef-7f9e-4623-bc2a-ed5c1a3bf0bd tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:19.178649 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4546aef-7f9e-4623-bc2a-ed5c1a3bf0bd tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:19.179774 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4546aef-7f9e-4623-bc2a-ed5c1a3bf0bd tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:19.180489 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4546aef-7f9e-4623-bc2a-ed5c1a3bf0bd tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:19.324792 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d4546aef-7f9e-4623-bc2a-ed5c1a3bf0bd tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:19:19.332536 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d4546aef-7f9e-4623-bc2a-ed5c1a3bf0bd tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845" status: 200 len: 1681 microversion: 2.1 time: 0.167100 Oct 26 14:19:19.333117 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3892/7758] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:19:19 2022] GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845 => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:19:19.795796 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-258c1be9-0679-4f8a-8fb6-ab9daa79647d req-0080dbd7-c594-48d6-85b4-1b7a2f63d51e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0e49430-bf57-4571-9631-451c09957845", "name": "network-vif-plugged", "status": "completed", "tag": "c2a1d150-a988-4f62-b9b0-c2ac025a6eb4"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:19:19.806619 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-258c1be9-0679-4f8a-8fb6-ab9daa79647d req-0080dbd7-c594-48d6-85b4-1b7a2f63d51e service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:19.807234 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-258c1be9-0679-4f8a-8fb6-ab9daa79647d req-0080dbd7-c594-48d6-85b4-1b7a2f63d51e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:19.807606 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-258c1be9-0679-4f8a-8fb6-ab9daa79647d req-0080dbd7-c594-48d6-85b4-1b7a2f63d51e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:19.819060 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-258c1be9-0679-4f8a-8fb6-ab9daa79647d req-0080dbd7-c594-48d6-85b4-1b7a2f63d51e service nova] Creating event network-vif-plugged:c2a1d150-a988-4f62-b9b0-c2ac025a6eb4 for instance d0e49430-bf57-4571-9631-451c09957845 on n-h2-862686-1 Oct 26 14:19:19.824132 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-258c1be9-0679-4f8a-8fb6-ab9daa79647d req-0080dbd7-c594-48d6-85b4-1b7a2f63d51e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032031 Oct 26 14:19:19.824919 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3867/7759] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:19:43.522058 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c2f17d7e-ba27-4457-950e-33fbc35c628b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:19:43.524263 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c2f17d7e-ba27-4457-950e-33fbc35c628b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: d0e49430-bf57-4571-9631-451c09957845] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:19:43.527241 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=28 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:19:43.527914 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=82 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:19:43.533502 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2f17d7e-ba27-4457-950e-33fbc35c628b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:43.534022 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2f17d7e-ba27-4457-950e-33fbc35c628b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:43.534472 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2f17d7e-ba27-4457-950e-33fbc35c628b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:43.535201 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2f17d7e-ba27-4457-950e-33fbc35c628b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:43.535672 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2f17d7e-ba27-4457-950e-33fbc35c628b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:43.536111 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2f17d7e-ba27-4457-950e-33fbc35c628b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:43.593223 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c2f17d7e-ba27-4457-950e-33fbc35c628b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "POST /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845/action" status: 200 len: 24566 microversion: 2.1 time: 0.075128 Oct 26 14:19:43.593890 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3893/7760] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 14:19:43 2022] POST /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845/action => generated 24566 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 14:19:51.086311 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-afe6651e-2e0c-49e3-9f94-d880cd1a9733 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:19:51.086930 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-afe6651e-2e0c-49e3-9f94-d880cd1a9733 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: d0e49430-bf57-4571-9631-451c09957845] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:19:51.089710 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-99430b84-8b0c-453c-8c2d-ee48115d6fd4 req-ba2e7769-7c5c-4de4-8008-42bd9270ea58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0e49430-bf57-4571-9631-451c09957845", "tag": "c2a1d150-a988-4f62-b9b0-c2ac025a6eb4"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:19:51.092828 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=34 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:19:51.093509 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:19:51.100316 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-afe6651e-2e0c-49e3-9f94-d880cd1a9733 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:51.100316 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-afe6651e-2e0c-49e3-9f94-d880cd1a9733 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:51.100765 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-afe6651e-2e0c-49e3-9f94-d880cd1a9733 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:51.101464 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-afe6651e-2e0c-49e3-9f94-d880cd1a9733 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:51.102308 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-afe6651e-2e0c-49e3-9f94-d880cd1a9733 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:51.102448 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-afe6651e-2e0c-49e3-9f94-d880cd1a9733 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:51.104084 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-99430b84-8b0c-453c-8c2d-ee48115d6fd4 req-ba2e7769-7c5c-4de4-8008-42bd9270ea58 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:51.105065 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-99430b84-8b0c-453c-8c2d-ee48115d6fd4 req-ba2e7769-7c5c-4de4-8008-42bd9270ea58 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:51.105644 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-99430b84-8b0c-453c-8c2d-ee48115d6fd4 req-ba2e7769-7c5c-4de4-8008-42bd9270ea58 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:51.118143 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-99430b84-8b0c-453c-8c2d-ee48115d6fd4 req-ba2e7769-7c5c-4de4-8008-42bd9270ea58 service nova] Creating event network-changed:c2a1d150-a988-4f62-b9b0-c2ac025a6eb4 for instance d0e49430-bf57-4571-9631-451c09957845 on n-h2-862686-1 Oct 26 14:19:51.123846 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-99430b84-8b0c-453c-8c2d-ee48115d6fd4 req-ba2e7769-7c5c-4de4-8008-42bd9270ea58 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039323 Oct 26 14:19:51.124865 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3894/7761] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 14:19:51.133355 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-afe6651e-2e0c-49e3-9f94-d880cd1a9733 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: d0e49430-bf57-4571-9631-451c09957845] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 14:19:51.224406 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-afe6651e-2e0c-49e3-9f94-d880cd1a9733 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845" status: 204 len: 0 microversion: 2.1 time: 0.142255 Oct 26 14:19:51.229508 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3868/7762] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 14:19:51 2022] DELETE /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 14:19:51.236116 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-35b86642-aa27-4bb9-ad85-a1230638e0c3 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:19:51.237061 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-35b86642-aa27-4bb9-ad85-a1230638e0c3 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: d0e49430-bf57-4571-9631-451c09957845] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:19:51.251156 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-35b86642-aa27-4bb9-ad85-a1230638e0c3 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:51.252009 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-35b86642-aa27-4bb9-ad85-a1230638e0c3 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:51.252724 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-35b86642-aa27-4bb9-ad85-a1230638e0c3 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:51.253673 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-35b86642-aa27-4bb9-ad85-a1230638e0c3 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:51.254318 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-35b86642-aa27-4bb9-ad85-a1230638e0c3 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:51.254833 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-35b86642-aa27-4bb9-ad85-a1230638e0c3 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:51.398824 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-35b86642-aa27-4bb9-ad85-a1230638e0c3 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:19:51.408081 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-35b86642-aa27-4bb9-ad85-a1230638e0c3 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845" status: 200 len: 1687 microversion: 2.1 time: 0.176281 Oct 26 14:19:51.408673 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3895/7763] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:19:51 2022] GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845 => generated 1687 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:19:52.434880 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-57eb5928-70c4-4977-b4a9-406722a29b0f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:19:52.435532 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-57eb5928-70c4-4977-b4a9-406722a29b0f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: d0e49430-bf57-4571-9631-451c09957845] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:19:52.442312 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57eb5928-70c4-4977-b4a9-406722a29b0f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:52.442796 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57eb5928-70c4-4977-b4a9-406722a29b0f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:52.443232 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57eb5928-70c4-4977-b4a9-406722a29b0f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:52.443919 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57eb5928-70c4-4977-b4a9-406722a29b0f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:52.444373 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57eb5928-70c4-4977-b4a9-406722a29b0f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:52.444797 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57eb5928-70c4-4977-b4a9-406722a29b0f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:52.646279 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-57eb5928-70c4-4977-b4a9-406722a29b0f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:19:52.654195 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-57eb5928-70c4-4977-b4a9-406722a29b0f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845" status: 200 len: 1687 microversion: 2.1 time: 0.224452 Oct 26 14:19:52.654773 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3869/7764] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:19:52 2022] GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845 => generated 1687 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:19:53.286452 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-9bdf10c4-5e96-4002-9b98-e7c48a87b6d3 req-ef54c2fe-6047-4735-aaf9-2fd7f5f5c6d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0e49430-bf57-4571-9631-451c09957845", "name": "network-vif-deleted", "tag": "c2a1d150-a988-4f62-b9b0-c2ac025a6eb4"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:19:53.298627 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9bdf10c4-5e96-4002-9b98-e7c48a87b6d3 req-ef54c2fe-6047-4735-aaf9-2fd7f5f5c6d3 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:53.299207 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9bdf10c4-5e96-4002-9b98-e7c48a87b6d3 req-ef54c2fe-6047-4735-aaf9-2fd7f5f5c6d3 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:53.299655 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9bdf10c4-5e96-4002-9b98-e7c48a87b6d3 req-ef54c2fe-6047-4735-aaf9-2fd7f5f5c6d3 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:53.311393 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-9bdf10c4-5e96-4002-9b98-e7c48a87b6d3 req-ef54c2fe-6047-4735-aaf9-2fd7f5f5c6d3 service nova] Creating event network-vif-deleted:c2a1d150-a988-4f62-b9b0-c2ac025a6eb4 for instance d0e49430-bf57-4571-9631-451c09957845 on n-h2-862686-1 Oct 26 14:19:53.317057 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-9bdf10c4-5e96-4002-9b98-e7c48a87b6d3 req-ef54c2fe-6047-4735-aaf9-2fd7f5f5c6d3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034345 Oct 26 14:19:53.317730 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3896/7765] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:19:53.678635 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-91455800-2f50-4089-ac81-c16d9e1398fe tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:19:53.679245 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-91455800-2f50-4089-ac81-c16d9e1398fe tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: d0e49430-bf57-4571-9631-451c09957845] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:19:53.687373 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91455800-2f50-4089-ac81-c16d9e1398fe tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:53.687867 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91455800-2f50-4089-ac81-c16d9e1398fe tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:53.688317 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91455800-2f50-4089-ac81-c16d9e1398fe tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:53.689245 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91455800-2f50-4089-ac81-c16d9e1398fe tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:53.689738 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91455800-2f50-4089-ac81-c16d9e1398fe tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:53.690171 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91455800-2f50-4089-ac81-c16d9e1398fe tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:53.724778 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91455800-2f50-4089-ac81-c16d9e1398fe tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:53.725260 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91455800-2f50-4089-ac81-c16d9e1398fe tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:53.725724 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91455800-2f50-4089-ac81-c16d9e1398fe tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:53.726176 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-91455800-2f50-4089-ac81-c16d9e1398fe tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lazy-loading 'fault' on Instance uuid d0e49430-bf57-4571-9631-451c09957845 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 14:19:53.774665 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-91455800-2f50-4089-ac81-c16d9e1398fe tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:19:53.783390 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-91455800-2f50-4089-ac81-c16d9e1398fe tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845" status: 200 len: 1355 microversion: 2.1 time: 0.108636 Oct 26 14:19:53.784056 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3870/7766] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:19:53 2022] GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845 => generated 1355 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:19:54.809846 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c1171d5d-ced8-4f55-9e86-b3464a5e7f2e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:19:54.810594 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c1171d5d-ced8-4f55-9e86-b3464a5e7f2e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: d0e49430-bf57-4571-9631-451c09957845] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:19:54.817068 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c1171d5d-ced8-4f55-9e86-b3464a5e7f2e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:54.817585 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c1171d5d-ced8-4f55-9e86-b3464a5e7f2e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:54.818037 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c1171d5d-ced8-4f55-9e86-b3464a5e7f2e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:54.818833 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c1171d5d-ced8-4f55-9e86-b3464a5e7f2e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:19:54.819191 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c1171d5d-ced8-4f55-9e86-b3464a5e7f2e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:19:54.819626 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c1171d5d-ced8-4f55-9e86-b3464a5e7f2e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:19:54.832695 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-c1171d5d-ced8-4f55-9e86-b3464a5e7f2e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] HTTP exception thrown: Instance d0e49430-bf57-4571-9631-451c09957845 could not be found. Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c1171d5d-ced8-4f55-9e86-b3464a5e7f2e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Request method failure captured: Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845 HTTP/1.1 Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWUDr33jAxtjEebp3Gj9k8Lbc1SrqwHm7Mcup79l6KuQSwXiy4o2KjnHZEkbB8fkd5uIcGtGt55Uhtw3xdnKaU85Pw2G7l54JmBa0kbYJ4z4No_CAY6Y63JfScReC0DCePeGpVkaUJplfHKvIPPZMxJQQn7G18wWCdYlRSKYCWbu3jAw Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: ba91e9b802254871b5153158707cb180 Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-72818388 Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ba91e9b802254871b5153158707cb180"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ba91e9b802254871b5153158707cb180"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ba91e9b802254871b5153158707cb180"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ba91e9b802254871b5153158707cb180"}]}] Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-TestNetworkAdvancedServerOps-72818388 Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: ba91e9b802254871b5153158707cb180 Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-72818388 Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-TestNetworkAdvancedServerOps-72818388-project Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 18876f18c54a4579a554e52225b24c74 Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-TestNetworkAdvancedServerOps-72818388-project Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance d0e49430-bf57-4571-9631-451c09957845 could not be found. Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'd0e49430-bf57-4571-9631-451c09957845'} Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0e49430-bf57-4571-9631-451c09957845 could not be found. Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0e49430-bf57-4571-9631-451c09957845 could not be found. Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:19:54.834365 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:19:54.839218 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:19:54.839218 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:19:54.839218 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:19:54.839218 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:19:54.839218 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 14:19:54.839218 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 14:19:54.839218 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0e49430-bf57-4571-9631-451c09957845 could not be found. Oct 26 14:19:54.839218 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:19:54.839218 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c1171d5d-ced8-4f55-9e86-b3464a5e7f2e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Returning 404 to user: Instance d0e49430-bf57-4571-9631-451c09957845 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 14:19:54.839218 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c1171d5d-ced8-4f55-9e86-b3464a5e7f2e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845" status: 404 len: 111 microversion: 2.1 time: 0.031815 Oct 26 14:19:54.839218 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3897/7767] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:19:54 2022] GET /compute/v2.1/servers/d0e49430-bf57-4571-9631-451c09957845 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 14:19:58.193848 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7006b6e0-3517-4514-9947-d67e26e7f199 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '.version_select at 0x7f67311a51f0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:19:58.217250 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7006b6e0-3517-4514-9947-d67e26e7f199 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-822342596" status: 202 len: 0 microversion: 2.1 time: 0.027283 Oct 26 14:19:58.218183 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3871/7768] 10.222.0.40 () {58 vars in 1281 bytes} [Wed Oct 26 14:19:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-822342596 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 14:19:58.243029 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-06356367-b7c1-4ea8-b1ff-7e600744415f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Action: 'create', calling method: .version_select at 0x7f6731089700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1433024703", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOTtlIQ4orzSEDDW8jKKNqO4SxxnE8Wu0PpsYfZJZH0i2rHvSDawPxTPqrZRx4xQBPik4UZaD5AC2lwT15c0rTWXtGuv3Pmi0smSD4nmm0F++sF3OfNyvdRaIA4QtKS9Q=="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:19:58.258834 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-06356367-b7c1-4ea8-b1ff-7e600744415f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Getting quotas for project ba91e9b802254871b5153158707cb180. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 14:19:58.264847 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-06356367-b7c1-4ea8-b1ff-7e600744415f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Getting quotas for user 18876f18c54a4579a554e52225b24c74 and project ba91e9b802254871b5153158707cb180. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 14:19:58.288846 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-06356367-b7c1-4ea8-b1ff-7e600744415f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.049950 Oct 26 14:19:58.289714 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3898/7769] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 14:19:58 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:20:03.671364 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4209e914-e462-4cc1-8472-edcbe191e128 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2038684083", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "089b81b9-3fa2-4f92-bf67-aa1e54cbf5b4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1433024703", "security_groups": [{"name": "tempest-secgroup-smoke-1153618706"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:20:03.780365 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:20:03.790376 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-4209e914-e462-4cc1-8472-edcbe191e128 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] validate_networks() for [('089b81b9-3fa2-4f92-bf67-aa1e54cbf5b4', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 14:20:04.613116 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-4209e914-e462-4cc1-8472-edcbe191e128 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 14:20:04.613792 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-4209e914-e462-4cc1-8472-edcbe191e128 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 14:20:04.614271 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-4209e914-e462-4cc1-8472-edcbe191e128 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 14:20:04.614685 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-4209e914-e462-4cc1-8472-edcbe191e128 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 14:20:04.615100 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-4209e914-e462-4cc1-8472-edcbe191e128 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 14:20:04.625371 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4209e914-e462-4cc1-8472-edcbe191e128 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:20:04.625898 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4209e914-e462-4cc1-8472-edcbe191e128 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:20:04.626336 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4209e914-e462-4cc1-8472-edcbe191e128 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:20:04.627071 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4209e914-e462-4cc1-8472-edcbe191e128 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:20:04.627528 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4209e914-e462-4cc1-8472-edcbe191e128 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:20:04.627959 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4209e914-e462-4cc1-8472-edcbe191e128 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:20:04.648197 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-4209e914-e462-4cc1-8472-edcbe191e128 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Getting quotas for project ba91e9b802254871b5153158707cb180. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 14:20:04.654598 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-4209e914-e462-4cc1-8472-edcbe191e128 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Getting quotas for user 18876f18c54a4579a554e52225b24c74 and project ba91e9b802254871b5153158707cb180. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 14:20:04.668989 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4209e914-e462-4cc1-8472-edcbe191e128 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 14:20:04.671480 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4209e914-e462-4cc1-8472-edcbe191e128 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 3c6fb8fb-bfd1-4818-934f-f96684b7fd63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 14:20:04.724094 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4209e914-e462-4cc1-8472-edcbe191e128 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.056717 Oct 26 14:20:04.732022 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3872/7770] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 14:20:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 1058 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 26 14:20:04.738052 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6ce9645e-ec35-4695-9807-4ef52e545b32 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:20:04.738687 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6ce9645e-ec35-4695-9807-4ef52e545b32 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 3c6fb8fb-bfd1-4818-934f-f96684b7fd63] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:20:04.806386 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6ce9645e-ec35-4695-9807-4ef52e545b32 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:20:04.814400 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6ce9645e-ec35-4695-9807-4ef52e545b32 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63" status: 200 len: 1267 microversion: 2.1 time: 0.080797 Oct 26 14:20:04.815007 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3899/7771] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:20:04 2022] GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63 => generated 1267 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:20:05.842006 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fc8f5af1-743e-4c2f-a71e-1d450d173f43 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:20:05.842639 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fc8f5af1-743e-4c2f-a71e-1d450d173f43 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 3c6fb8fb-bfd1-4818-934f-f96684b7fd63] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:20:05.851123 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fc8f5af1-743e-4c2f-a71e-1d450d173f43 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:20:05.851624 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fc8f5af1-743e-4c2f-a71e-1d450d173f43 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:20:05.852305 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fc8f5af1-743e-4c2f-a71e-1d450d173f43 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:20:05.853352 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fc8f5af1-743e-4c2f-a71e-1d450d173f43 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:20:05.862541 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fc8f5af1-743e-4c2f-a71e-1d450d173f43 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:20:05.863351 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fc8f5af1-743e-4c2f-a71e-1d450d173f43 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:20:05.950210 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fc8f5af1-743e-4c2f-a71e-1d450d173f43 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:20:05.959536 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fc8f5af1-743e-4c2f-a71e-1d450d173f43 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63" status: 200 len: 1327 microversion: 2.1 time: 0.123023 Oct 26 14:20:05.960749 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3873/7772] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:20:05 2022] GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63 => generated 1327 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:20:06.983839 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fce5ffe5-604d-43b3-9801-7e7796072fff tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:20:06.984834 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fce5ffe5-604d-43b3-9801-7e7796072fff tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 3c6fb8fb-bfd1-4818-934f-f96684b7fd63] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:20:06.987919 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=16 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:20:06.993958 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fce5ffe5-604d-43b3-9801-7e7796072fff tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:20:06.994563 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fce5ffe5-604d-43b3-9801-7e7796072fff tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:20:06.995214 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fce5ffe5-604d-43b3-9801-7e7796072fff tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:20:06.995942 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fce5ffe5-604d-43b3-9801-7e7796072fff tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:20:06.996410 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fce5ffe5-604d-43b3-9801-7e7796072fff tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:20:06.996848 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fce5ffe5-604d-43b3-9801-7e7796072fff tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:20:07.235521 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fce5ffe5-604d-43b3-9801-7e7796072fff tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:20:07.243152 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fce5ffe5-604d-43b3-9801-7e7796072fff tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63" status: 200 len: 1393 microversion: 2.1 time: 0.263334 Oct 26 14:20:07.243725 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3900/7773] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:20:06 2022] GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63 => generated 1393 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 14:20:07.722897 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-8c359c72-5012-4b06-a168-68ae3b2f4c23 req-a27019aa-a924-4566-b7f2-8cca413d8aaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c6fb8fb-bfd1-4818-934f-f96684b7fd63", "tag": "ede85e95-1864-4844-a0ec-6d3eb8a89e10"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:20:07.734770 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-8c359c72-5012-4b06-a168-68ae3b2f4c23 req-a27019aa-a924-4566-b7f2-8cca413d8aaf service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:20:07.735246 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-8c359c72-5012-4b06-a168-68ae3b2f4c23 req-a27019aa-a924-4566-b7f2-8cca413d8aaf service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:20:07.735675 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-8c359c72-5012-4b06-a168-68ae3b2f4c23 req-a27019aa-a924-4566-b7f2-8cca413d8aaf service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:20:07.751414 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-8c359c72-5012-4b06-a168-68ae3b2f4c23 req-a27019aa-a924-4566-b7f2-8cca413d8aaf service nova] Creating event network-changed:ede85e95-1864-4844-a0ec-6d3eb8a89e10 for instance 3c6fb8fb-bfd1-4818-934f-f96684b7fd63 on n-h1-862686-1 Oct 26 14:20:07.756837 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-8c359c72-5012-4b06-a168-68ae3b2f4c23 req-a27019aa-a924-4566-b7f2-8cca413d8aaf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038428 Oct 26 14:20:07.757771 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3874/7774] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:20:08.312457 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-54154323-b6d0-49bc-920c-4f1ed103e665 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:20:08.313078 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-54154323-b6d0-49bc-920c-4f1ed103e665 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 3c6fb8fb-bfd1-4818-934f-f96684b7fd63] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:20:08.319072 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54154323-b6d0-49bc-920c-4f1ed103e665 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:20:08.319571 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54154323-b6d0-49bc-920c-4f1ed103e665 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:20:08.320017 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54154323-b6d0-49bc-920c-4f1ed103e665 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:20:08.320716 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54154323-b6d0-49bc-920c-4f1ed103e665 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:20:08.321181 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54154323-b6d0-49bc-920c-4f1ed103e665 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:20:08.321654 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54154323-b6d0-49bc-920c-4f1ed103e665 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:20:08.457243 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-54154323-b6d0-49bc-920c-4f1ed103e665 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:20:08.466027 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-54154323-b6d0-49bc-920c-4f1ed103e665 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63" status: 200 len: 1393 microversion: 2.1 time: 0.203103 Oct 26 14:20:08.466542 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3901/7775] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:20:08 2022] GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63 => generated 1393 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:20:09.488895 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-99f5e741-ed64-453a-ad71-c22572737f7b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:20:09.489642 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-99f5e741-ed64-453a-ad71-c22572737f7b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 3c6fb8fb-bfd1-4818-934f-f96684b7fd63] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:20:09.497530 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-99f5e741-ed64-453a-ad71-c22572737f7b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:20:09.498006 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-99f5e741-ed64-453a-ad71-c22572737f7b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:20:09.498449 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-99f5e741-ed64-453a-ad71-c22572737f7b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:20:09.499159 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-99f5e741-ed64-453a-ad71-c22572737f7b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:20:09.499624 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-99f5e741-ed64-453a-ad71-c22572737f7b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:20:09.500066 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-99f5e741-ed64-453a-ad71-c22572737f7b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:20:09.639050 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-99f5e741-ed64-453a-ad71-c22572737f7b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:20:09.646812 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-99f5e741-ed64-453a-ad71-c22572737f7b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63" status: 200 len: 1393 microversion: 2.1 time: 0.162248 Oct 26 14:20:09.647386 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3875/7776] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:20:09 2022] GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63 => generated 1393 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 14:20:10.671293 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-88f24391-ee8c-4c8f-b270-7dd5f2d08676 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:20:10.671962 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-88f24391-ee8c-4c8f-b270-7dd5f2d08676 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 3c6fb8fb-bfd1-4818-934f-f96684b7fd63] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:20:10.678844 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88f24391-ee8c-4c8f-b270-7dd5f2d08676 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:20:10.679339 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88f24391-ee8c-4c8f-b270-7dd5f2d08676 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:20:10.679791 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88f24391-ee8c-4c8f-b270-7dd5f2d08676 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:20:10.680495 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88f24391-ee8c-4c8f-b270-7dd5f2d08676 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:20:10.680970 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88f24391-ee8c-4c8f-b270-7dd5f2d08676 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:20:10.681415 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88f24391-ee8c-4c8f-b270-7dd5f2d08676 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:20:10.820957 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-88f24391-ee8c-4c8f-b270-7dd5f2d08676 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:20:10.829020 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-88f24391-ee8c-4c8f-b270-7dd5f2d08676 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63" status: 200 len: 1393 microversion: 2.1 time: 0.161787 Oct 26 14:20:10.829615 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3902/7777] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:20:10 2022] GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63 => generated 1393 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:20:11.852341 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5403acb1-ebbe-4cb4-8072-124890980f9a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:20:11.852952 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5403acb1-ebbe-4cb4-8072-124890980f9a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 3c6fb8fb-bfd1-4818-934f-f96684b7fd63] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:20:11.860564 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5403acb1-ebbe-4cb4-8072-124890980f9a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:20:11.861045 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5403acb1-ebbe-4cb4-8072-124890980f9a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:20:11.861506 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5403acb1-ebbe-4cb4-8072-124890980f9a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:20:11.862198 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5403acb1-ebbe-4cb4-8072-124890980f9a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:20:11.862651 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5403acb1-ebbe-4cb4-8072-124890980f9a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:20:11.863076 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5403acb1-ebbe-4cb4-8072-124890980f9a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:20:11.993370 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5403acb1-ebbe-4cb4-8072-124890980f9a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:20:12.001795 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5403acb1-ebbe-4cb4-8072-124890980f9a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63" status: 200 len: 1393 microversion: 2.1 time: 0.153261 Oct 26 14:20:12.002365 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3876/7778] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:20:11 2022] GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63 => generated 1393 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:20:12.851706 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-bd6d3b8a-70a0-4ebc-bafd-073590fc2c1f req-f936054a-0619-4be5-8588-7a229e81009b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c6fb8fb-bfd1-4818-934f-f96684b7fd63", "name": "network-vif-plugged", "status": "completed", "tag": "ede85e95-1864-4844-a0ec-6d3eb8a89e10"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:20:12.863538 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-bd6d3b8a-70a0-4ebc-bafd-073590fc2c1f req-f936054a-0619-4be5-8588-7a229e81009b service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:20:12.864092 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-bd6d3b8a-70a0-4ebc-bafd-073590fc2c1f req-f936054a-0619-4be5-8588-7a229e81009b service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:20:12.864472 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-bd6d3b8a-70a0-4ebc-bafd-073590fc2c1f req-f936054a-0619-4be5-8588-7a229e81009b service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:20:12.876000 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-bd6d3b8a-70a0-4ebc-bafd-073590fc2c1f req-f936054a-0619-4be5-8588-7a229e81009b service nova] Creating event network-vif-plugged:ede85e95-1864-4844-a0ec-6d3eb8a89e10 for instance 3c6fb8fb-bfd1-4818-934f-f96684b7fd63 on n-h1-862686-1 Oct 26 14:20:12.881164 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-bd6d3b8a-70a0-4ebc-bafd-073590fc2c1f req-f936054a-0619-4be5-8588-7a229e81009b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033079 Oct 26 14:20:12.882006 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3903/7779] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:20:13.024226 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-17645104-1023-4ef2-b03d-0f1579cf8689 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:20:13.024956 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-17645104-1023-4ef2-b03d-0f1579cf8689 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 3c6fb8fb-bfd1-4818-934f-f96684b7fd63] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:20:13.032643 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17645104-1023-4ef2-b03d-0f1579cf8689 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:20:13.033125 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17645104-1023-4ef2-b03d-0f1579cf8689 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:20:13.033583 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17645104-1023-4ef2-b03d-0f1579cf8689 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:20:13.034282 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17645104-1023-4ef2-b03d-0f1579cf8689 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:20:13.034729 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17645104-1023-4ef2-b03d-0f1579cf8689 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:20:13.035151 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-17645104-1023-4ef2-b03d-0f1579cf8689 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:20:13.163804 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-17645104-1023-4ef2-b03d-0f1579cf8689 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:20:13.171817 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-17645104-1023-4ef2-b03d-0f1579cf8689 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63" status: 200 len: 1393 microversion: 2.1 time: 0.151457 Oct 26 14:20:13.172396 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3877/7780] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:20:13 2022] GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63 => generated 1393 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:20:14.196249 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-28a465d0-4af2-4c2c-8736-593fe783703a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:20:14.197867 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-28a465d0-4af2-4c2c-8736-593fe783703a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 3c6fb8fb-bfd1-4818-934f-f96684b7fd63] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:20:14.201321 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:20:14.208542 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28a465d0-4af2-4c2c-8736-593fe783703a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:20:14.209039 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28a465d0-4af2-4c2c-8736-593fe783703a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:20:14.209562 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28a465d0-4af2-4c2c-8736-593fe783703a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:20:14.210276 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28a465d0-4af2-4c2c-8736-593fe783703a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:20:14.210747 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28a465d0-4af2-4c2c-8736-593fe783703a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:20:14.211181 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-28a465d0-4af2-4c2c-8736-593fe783703a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:20:14.353837 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-28a465d0-4af2-4c2c-8736-593fe783703a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:20:14.361696 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-28a465d0-4af2-4c2c-8736-593fe783703a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63" status: 200 len: 1566 microversion: 2.1 time: 0.169927 Oct 26 14:20:14.362290 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3904/7781] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:20:14 2022] GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63 => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:20:14.384111 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bfe95287-db4d-4742-b8db-c4eea8bb073f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:20:14.385216 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bfe95287-db4d-4742-b8db-c4eea8bb073f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 3c6fb8fb-bfd1-4818-934f-f96684b7fd63] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:20:14.392067 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bfe95287-db4d-4742-b8db-c4eea8bb073f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:20:14.392556 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bfe95287-db4d-4742-b8db-c4eea8bb073f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:20:14.393000 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bfe95287-db4d-4742-b8db-c4eea8bb073f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:20:14.393722 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bfe95287-db4d-4742-b8db-c4eea8bb073f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:20:14.394185 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bfe95287-db4d-4742-b8db-c4eea8bb073f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:20:14.394617 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bfe95287-db4d-4742-b8db-c4eea8bb073f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:20:14.529216 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-bfe95287-db4d-4742-b8db-c4eea8bb073f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:20:14.537064 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bfe95287-db4d-4742-b8db-c4eea8bb073f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63" status: 200 len: 1566 microversion: 2.1 time: 0.156804 Oct 26 14:20:14.537681 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3878/7782] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:20:14 2022] GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:20:16.168290 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-02783551-f4ee-42f6-97c6-88bf9c80f875 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:20:16.168897 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-02783551-f4ee-42f6-97c6-88bf9c80f875 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 3c6fb8fb-bfd1-4818-934f-f96684b7fd63] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:20:16.171451 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-35684aaf-e41f-4136-91b5-dd6d30309896 req-5d561788-844f-4fae-821c-8531e4f35cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c6fb8fb-bfd1-4818-934f-f96684b7fd63", "tag": "ede85e95-1864-4844-a0ec-6d3eb8a89e10"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:20:16.174513 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:20:16.176634 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:20:16.177741 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:20:16.178052 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02783551-f4ee-42f6-97c6-88bf9c80f875 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:20:16.178613 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02783551-f4ee-42f6-97c6-88bf9c80f875 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:20:16.179110 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02783551-f4ee-42f6-97c6-88bf9c80f875 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:20:16.180062 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02783551-f4ee-42f6-97c6-88bf9c80f875 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:20:16.180871 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02783551-f4ee-42f6-97c6-88bf9c80f875 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:20:16.182218 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02783551-f4ee-42f6-97c6-88bf9c80f875 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:20:16.187480 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-35684aaf-e41f-4136-91b5-dd6d30309896 req-5d561788-844f-4fae-821c-8531e4f35cd5 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:20:16.187960 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-35684aaf-e41f-4136-91b5-dd6d30309896 req-5d561788-844f-4fae-821c-8531e4f35cd5 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:20:16.188384 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-35684aaf-e41f-4136-91b5-dd6d30309896 req-5d561788-844f-4fae-821c-8531e4f35cd5 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:20:16.201754 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-35684aaf-e41f-4136-91b5-dd6d30309896 req-5d561788-844f-4fae-821c-8531e4f35cd5 service nova] Creating event network-changed:ede85e95-1864-4844-a0ec-6d3eb8a89e10 for instance 3c6fb8fb-bfd1-4818-934f-f96684b7fd63 on n-h1-862686-1 Oct 26 14:20:16.207915 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-35684aaf-e41f-4136-91b5-dd6d30309896 req-5d561788-844f-4fae-821c-8531e4f35cd5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040298 Oct 26 14:20:16.208650 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3879/7783] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:20:16.663965 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-02783551-f4ee-42f6-97c6-88bf9c80f875 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:20:16.672615 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-02783551-f4ee-42f6-97c6-88bf9c80f875 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63" status: 200 len: 1566 microversion: 2.1 time: 0.508481 Oct 26 14:20:16.673201 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3905/7784] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:20:16 2022] GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63 => generated 1566 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:20:39.925728 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-842554d8-8431-4fa8-bbda-967ab22fa025 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:20:39.928009 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-842554d8-8431-4fa8-bbda-967ab22fa025 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 3c6fb8fb-bfd1-4818-934f-f96684b7fd63] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:20:39.930660 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:20:39.931562 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=36 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:20:39.937889 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-842554d8-8431-4fa8-bbda-967ab22fa025 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:20:39.938406 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-842554d8-8431-4fa8-bbda-967ab22fa025 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:20:39.938835 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-842554d8-8431-4fa8-bbda-967ab22fa025 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:20:39.939517 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-842554d8-8431-4fa8-bbda-967ab22fa025 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:20:39.939964 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-842554d8-8431-4fa8-bbda-967ab22fa025 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:20:39.940381 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-842554d8-8431-4fa8-bbda-967ab22fa025 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:20:39.994871 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-842554d8-8431-4fa8-bbda-967ab22fa025 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "POST /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63/action" status: 200 len: 24569 microversion: 2.1 time: 0.073459 Oct 26 14:20:39.995488 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3880/7785] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 14:20:39 2022] POST /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63/action => generated 24569 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 14:20:51.062889 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e824d848-6112-459e-a6bf-9bebc1691458 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:20:51.065125 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:20:51.065888 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=32 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:20:51.071526 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e824d848-6112-459e-a6bf-9bebc1691458 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:20:51.072028 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e824d848-6112-459e-a6bf-9bebc1691458 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:20:51.072566 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e824d848-6112-459e-a6bf-9bebc1691458 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:20:51.095406 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e824d848-6112-459e-a6bf-9bebc1691458 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 3c6fb8fb-bfd1-4818-934f-f96684b7fd63] Going to try to stop instance {{(pid=120598) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 26 14:20:51.137856 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e824d848-6112-459e-a6bf-9bebc1691458 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "POST /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63/action" status: 202 len: 0 microversion: 2.1 time: 0.078898 Oct 26 14:20:51.138458 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3906/7786] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 14:20:51 2022] POST /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 14:20:51.147176 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-caeb86d0-c4be-4f96-b6f1-b90cff8395ad tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:20:51.147885 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-caeb86d0-c4be-4f96-b6f1-b90cff8395ad tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 3c6fb8fb-bfd1-4818-934f-f96684b7fd63] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:20:51.153113 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=4 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:20:51.153787 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:20:51.159663 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-caeb86d0-c4be-4f96-b6f1-b90cff8395ad tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:20:51.160484 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-caeb86d0-c4be-4f96-b6f1-b90cff8395ad tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:20:51.161131 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-caeb86d0-c4be-4f96-b6f1-b90cff8395ad tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:20:51.162322 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-caeb86d0-c4be-4f96-b6f1-b90cff8395ad tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:20:51.162806 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-caeb86d0-c4be-4f96-b6f1-b90cff8395ad tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:20:51.163243 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-caeb86d0-c4be-4f96-b6f1-b90cff8395ad tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:20:51.299314 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-caeb86d0-c4be-4f96-b6f1-b90cff8395ad tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:20:51.308215 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-caeb86d0-c4be-4f96-b6f1-b90cff8395ad tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63" status: 200 len: 1695 microversion: 2.1 time: 0.165185 Oct 26 14:20:51.308805 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3881/7787] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:20:51 2022] GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63 => generated 1695 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:20:52.332603 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b353d15b-4813-4a28-83e5-c9fbbdbd5f34 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:20:52.333311 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b353d15b-4813-4a28-83e5-c9fbbdbd5f34 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 3c6fb8fb-bfd1-4818-934f-f96684b7fd63] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:20:52.340870 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b353d15b-4813-4a28-83e5-c9fbbdbd5f34 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:20:52.341350 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b353d15b-4813-4a28-83e5-c9fbbdbd5f34 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:20:52.341826 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b353d15b-4813-4a28-83e5-c9fbbdbd5f34 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:20:52.342525 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b353d15b-4813-4a28-83e5-c9fbbdbd5f34 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:20:52.342991 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b353d15b-4813-4a28-83e5-c9fbbdbd5f34 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:20:52.343423 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b353d15b-4813-4a28-83e5-c9fbbdbd5f34 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:20:52.473263 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b353d15b-4813-4a28-83e5-c9fbbdbd5f34 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:20:52.481570 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b353d15b-4813-4a28-83e5-c9fbbdbd5f34 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63" status: 200 len: 1695 microversion: 2.1 time: 0.153183 Oct 26 14:20:52.482142 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3907/7788] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:20:52 2022] GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63 => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:20:53.504817 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-80b4b1ab-4f51-4f52-af7e-072c9bff17eb tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:20:53.505429 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-80b4b1ab-4f51-4f52-af7e-072c9bff17eb tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 3c6fb8fb-bfd1-4818-934f-f96684b7fd63] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:20:53.512880 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-80b4b1ab-4f51-4f52-af7e-072c9bff17eb tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:20:53.513359 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-80b4b1ab-4f51-4f52-af7e-072c9bff17eb tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:20:53.513818 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-80b4b1ab-4f51-4f52-af7e-072c9bff17eb tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:20:53.514500 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-80b4b1ab-4f51-4f52-af7e-072c9bff17eb tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:20:53.514950 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-80b4b1ab-4f51-4f52-af7e-072c9bff17eb tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:20:53.515372 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-80b4b1ab-4f51-4f52-af7e-072c9bff17eb tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:20:53.650439 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-80b4b1ab-4f51-4f52-af7e-072c9bff17eb tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:20:53.658154 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-80b4b1ab-4f51-4f52-af7e-072c9bff17eb tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63" status: 200 len: 1695 microversion: 2.1 time: 0.157290 Oct 26 14:20:53.658931 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3882/7789] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:20:53 2022] GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63 => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:20:54.681182 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1aee9c17-c3cf-40cd-b210-eafdb0c0f49f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:20:54.682166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1aee9c17-c3cf-40cd-b210-eafdb0c0f49f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 3c6fb8fb-bfd1-4818-934f-f96684b7fd63] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:20:54.688591 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1aee9c17-c3cf-40cd-b210-eafdb0c0f49f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:20:54.689084 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1aee9c17-c3cf-40cd-b210-eafdb0c0f49f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:20:54.689568 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1aee9c17-c3cf-40cd-b210-eafdb0c0f49f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:20:54.690274 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1aee9c17-c3cf-40cd-b210-eafdb0c0f49f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:20:54.690747 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1aee9c17-c3cf-40cd-b210-eafdb0c0f49f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:20:54.691218 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1aee9c17-c3cf-40cd-b210-eafdb0c0f49f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:20:54.820518 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1aee9c17-c3cf-40cd-b210-eafdb0c0f49f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:20:54.828740 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1aee9c17-c3cf-40cd-b210-eafdb0c0f49f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63" status: 200 len: 1695 microversion: 2.1 time: 0.151595 Oct 26 14:20:54.829313 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3908/7790] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:20:54 2022] GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63 => generated 1695 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:20:55.852776 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b80dbd4f-1f27-4938-bc9a-471313d09f67 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:20:55.854091 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b80dbd4f-1f27-4938-bc9a-471313d09f67 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 3c6fb8fb-bfd1-4818-934f-f96684b7fd63] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:20:55.861003 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b80dbd4f-1f27-4938-bc9a-471313d09f67 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:20:55.861512 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b80dbd4f-1f27-4938-bc9a-471313d09f67 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:20:55.861956 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b80dbd4f-1f27-4938-bc9a-471313d09f67 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:20:55.862708 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b80dbd4f-1f27-4938-bc9a-471313d09f67 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:20:55.863163 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b80dbd4f-1f27-4938-bc9a-471313d09f67 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:20:55.863587 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b80dbd4f-1f27-4938-bc9a-471313d09f67 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:20:55.992811 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b80dbd4f-1f27-4938-bc9a-471313d09f67 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:20:56.000624 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b80dbd4f-1f27-4938-bc9a-471313d09f67 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63" status: 200 len: 1695 microversion: 2.1 time: 0.151770 Oct 26 14:20:56.001195 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3883/7791] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:20:55 2022] GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63 => generated 1695 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:20:57.024117 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3b27375f-e64d-46a6-a237-06839942f105 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:20:57.024745 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3b27375f-e64d-46a6-a237-06839942f105 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 3c6fb8fb-bfd1-4818-934f-f96684b7fd63] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:20:57.031899 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b27375f-e64d-46a6-a237-06839942f105 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:20:57.032395 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b27375f-e64d-46a6-a237-06839942f105 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:20:57.032873 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b27375f-e64d-46a6-a237-06839942f105 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:20:57.033610 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b27375f-e64d-46a6-a237-06839942f105 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:20:57.034086 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b27375f-e64d-46a6-a237-06839942f105 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:20:57.034528 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b27375f-e64d-46a6-a237-06839942f105 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:20:57.168969 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3b27375f-e64d-46a6-a237-06839942f105 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:20:57.176685 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3b27375f-e64d-46a6-a237-06839942f105 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63" status: 200 len: 1695 microversion: 2.1 time: 0.156526 Oct 26 14:20:57.177259 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3909/7792] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:20:57 2022] GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63 => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:20:58.199408 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b3ea08af-cdc6-49dc-92e7-8a27afbde653 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:20:58.200025 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b3ea08af-cdc6-49dc-92e7-8a27afbde653 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 3c6fb8fb-bfd1-4818-934f-f96684b7fd63] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:20:58.206578 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b3ea08af-cdc6-49dc-92e7-8a27afbde653 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:20:58.207066 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b3ea08af-cdc6-49dc-92e7-8a27afbde653 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:20:58.207510 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b3ea08af-cdc6-49dc-92e7-8a27afbde653 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:20:58.208201 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b3ea08af-cdc6-49dc-92e7-8a27afbde653 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:20:58.208664 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b3ea08af-cdc6-49dc-92e7-8a27afbde653 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:20:58.209092 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b3ea08af-cdc6-49dc-92e7-8a27afbde653 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:20:58.344315 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b3ea08af-cdc6-49dc-92e7-8a27afbde653 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:20:58.352049 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b3ea08af-cdc6-49dc-92e7-8a27afbde653 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63" status: 200 len: 1695 microversion: 2.1 time: 0.156777 Oct 26 14:20:58.352613 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3884/7793] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:20:58 2022] GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63 => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:20:59.376054 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-03183dd9-9970-44e4-9688-9c3379b3af15 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:20:59.376672 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-03183dd9-9970-44e4-9688-9c3379b3af15 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 3c6fb8fb-bfd1-4818-934f-f96684b7fd63] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:20:59.383433 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03183dd9-9970-44e4-9688-9c3379b3af15 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:20:59.383920 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03183dd9-9970-44e4-9688-9c3379b3af15 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:20:59.384366 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03183dd9-9970-44e4-9688-9c3379b3af15 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:20:59.385109 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03183dd9-9970-44e4-9688-9c3379b3af15 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:20:59.385597 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03183dd9-9970-44e4-9688-9c3379b3af15 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:20:59.386032 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03183dd9-9970-44e4-9688-9c3379b3af15 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:20:59.519928 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-03183dd9-9970-44e4-9688-9c3379b3af15 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:20:59.528203 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-03183dd9-9970-44e4-9688-9c3379b3af15 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63" status: 200 len: 1695 microversion: 2.1 time: 0.156152 Oct 26 14:20:59.528773 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3910/7794] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:20:59 2022] GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63 => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:21:00.552669 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cbd17658-e80e-49f2-88c7-f8227864a65b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:21:00.553281 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cbd17658-e80e-49f2-88c7-f8227864a65b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 3c6fb8fb-bfd1-4818-934f-f96684b7fd63] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:21:00.560673 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cbd17658-e80e-49f2-88c7-f8227864a65b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:21:00.561158 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cbd17658-e80e-49f2-88c7-f8227864a65b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:21:00.561635 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cbd17658-e80e-49f2-88c7-f8227864a65b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:21:00.562329 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cbd17658-e80e-49f2-88c7-f8227864a65b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:21:00.562784 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cbd17658-e80e-49f2-88c7-f8227864a65b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:21:00.563209 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cbd17658-e80e-49f2-88c7-f8227864a65b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:21:00.695780 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cbd17658-e80e-49f2-88c7-f8227864a65b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:21:00.703640 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cbd17658-e80e-49f2-88c7-f8227864a65b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63" status: 200 len: 1695 microversion: 2.1 time: 0.154845 Oct 26 14:21:00.704220 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3885/7795] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:21:00 2022] GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63 => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:21:01.727541 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f83fda2d-0e13-4532-b824-4f905bf9a369 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:21:01.728700 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f83fda2d-0e13-4532-b824-4f905bf9a369 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 3c6fb8fb-bfd1-4818-934f-f96684b7fd63] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:21:01.736052 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f83fda2d-0e13-4532-b824-4f905bf9a369 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:21:01.736544 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f83fda2d-0e13-4532-b824-4f905bf9a369 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:21:01.736994 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f83fda2d-0e13-4532-b824-4f905bf9a369 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:21:01.737717 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f83fda2d-0e13-4532-b824-4f905bf9a369 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:21:01.738190 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f83fda2d-0e13-4532-b824-4f905bf9a369 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:21:01.738624 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f83fda2d-0e13-4532-b824-4f905bf9a369 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:21:01.875854 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f83fda2d-0e13-4532-b824-4f905bf9a369 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:21:01.883715 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f83fda2d-0e13-4532-b824-4f905bf9a369 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63" status: 200 len: 1672 microversion: 2.1 time: 0.160126 Oct 26 14:21:01.884286 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3911/7796] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:21:01 2022] GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63 => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:21:02.979226 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2e925489-9df5-4985-b94b-b79082d2296d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:21:02.981317 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2e925489-9df5-4985-b94b-b79082d2296d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 3c6fb8fb-bfd1-4818-934f-f96684b7fd63] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:21:02.988293 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e925489-9df5-4985-b94b-b79082d2296d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:21:02.988783 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e925489-9df5-4985-b94b-b79082d2296d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:21:02.989229 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e925489-9df5-4985-b94b-b79082d2296d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:21:02.989949 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e925489-9df5-4985-b94b-b79082d2296d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:21:02.990411 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e925489-9df5-4985-b94b-b79082d2296d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:21:02.990835 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e925489-9df5-4985-b94b-b79082d2296d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:21:03.320955 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2e925489-9df5-4985-b94b-b79082d2296d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "POST /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63/action" status: 200 len: 38417 microversion: 2.1 time: 0.345567 Oct 26 14:21:03.322808 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3886/7797] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 14:21:02 2022] POST /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63/action => generated 38417 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 14:21:03.334667 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ddb0ca37-8d6c-4bf0-8a2f-c887a6dcd1d6 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:21:03.342344 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ddb0ca37-8d6c-4bf0-8a2f-c887a6dcd1d6 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:21:03.342841 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ddb0ca37-8d6c-4bf0-8a2f-c887a6dcd1d6 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:21:03.343290 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ddb0ca37-8d6c-4bf0-8a2f-c887a6dcd1d6 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:21:03.366108 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ddb0ca37-8d6c-4bf0-8a2f-c887a6dcd1d6 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 3c6fb8fb-bfd1-4818-934f-f96684b7fd63] Going to try to start instance {{(pid=120598) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 26 14:21:03.407973 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ddb0ca37-8d6c-4bf0-8a2f-c887a6dcd1d6 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "POST /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63/action" status: 202 len: 0 microversion: 2.1 time: 0.077136 Oct 26 14:21:03.408570 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3912/7798] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 14:21:03 2022] POST /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 14:21:03.418075 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1eae1804-c976-4694-95f4-b3844201358c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:21:03.418773 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1eae1804-c976-4694-95f4-b3844201358c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 3c6fb8fb-bfd1-4818-934f-f96684b7fd63] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:21:03.425847 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1eae1804-c976-4694-95f4-b3844201358c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:21:03.426361 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1eae1804-c976-4694-95f4-b3844201358c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:21:03.426766 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1eae1804-c976-4694-95f4-b3844201358c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:21:03.427468 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1eae1804-c976-4694-95f4-b3844201358c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:21:03.427916 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1eae1804-c976-4694-95f4-b3844201358c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:21:03.428341 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1eae1804-c976-4694-95f4-b3844201358c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:21:03.570277 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1eae1804-c976-4694-95f4-b3844201358c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:21:03.579110 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1eae1804-c976-4694-95f4-b3844201358c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63" status: 200 len: 1681 microversion: 2.1 time: 0.165720 Oct 26 14:21:03.579684 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3887/7799] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:21:03 2022] GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:21:04.605109 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8bac198e-6ae2-446d-86fa-ffc46736a022 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:21:04.606508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8bac198e-6ae2-446d-86fa-ffc46736a022 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 3c6fb8fb-bfd1-4818-934f-f96684b7fd63] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:21:04.613586 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8bac198e-6ae2-446d-86fa-ffc46736a022 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:21:04.614318 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8bac198e-6ae2-446d-86fa-ffc46736a022 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:21:04.615407 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8bac198e-6ae2-446d-86fa-ffc46736a022 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:21:04.616142 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8bac198e-6ae2-446d-86fa-ffc46736a022 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:21:04.616614 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8bac198e-6ae2-446d-86fa-ffc46736a022 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:21:04.617239 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8bac198e-6ae2-446d-86fa-ffc46736a022 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:21:04.750365 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8bac198e-6ae2-446d-86fa-ffc46736a022 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:21:04.758123 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8bac198e-6ae2-446d-86fa-ffc46736a022 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63" status: 200 len: 1685 microversion: 2.1 time: 0.158754 Oct 26 14:21:04.758702 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3913/7800] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:21:04 2022] GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63 => generated 1685 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 14:21:30.957800 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7fbf6dd7-5016-4819-86d3-5e56b4baab9e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:21:30.959972 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7fbf6dd7-5016-4819-86d3-5e56b4baab9e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 3c6fb8fb-bfd1-4818-934f-f96684b7fd63] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:21:30.962562 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=14 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:21:30.963220 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=40 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:21:30.969753 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7fbf6dd7-5016-4819-86d3-5e56b4baab9e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:21:30.970240 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7fbf6dd7-5016-4819-86d3-5e56b4baab9e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:21:30.970687 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7fbf6dd7-5016-4819-86d3-5e56b4baab9e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:21:30.971376 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7fbf6dd7-5016-4819-86d3-5e56b4baab9e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:21:30.971830 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7fbf6dd7-5016-4819-86d3-5e56b4baab9e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:21:30.972255 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7fbf6dd7-5016-4819-86d3-5e56b4baab9e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:21:31.027599 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7fbf6dd7-5016-4819-86d3-5e56b4baab9e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "POST /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63/action" status: 200 len: 62980 microversion: 2.1 time: 0.073589 Oct 26 14:21:31.028587 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3888/7801] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 14:21:30 2022] POST /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63/action => generated 62980 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 14:21:38.343278 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-126d2076-0f13-4a70-842e-e61ad674878b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:21:38.344412 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-126d2076-0f13-4a70-842e-e61ad674878b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 3c6fb8fb-bfd1-4818-934f-f96684b7fd63] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:21:38.345285 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-736cd042-aeba-4083-9e8b-285476b0e1a5 req-5ba37c43-182e-42c5-a3db-fb19abc83b88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c6fb8fb-bfd1-4818-934f-f96684b7fd63", "tag": "ede85e95-1864-4844-a0ec-6d3eb8a89e10"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:21:38.346622 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=16 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:21:38.347454 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:21:38.349174 n-d-862686-1 devstack@n-api.service[120598]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 14:21:38.349313 n-d-862686-1 devstack@n-api.service[120598]: Wed Oct 26 14:21:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63 (ip 10.222.0.40) !!! Oct 26 14:21:38.363440 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-736cd042-aeba-4083-9e8b-285476b0e1a5 req-5ba37c43-182e-42c5-a3db-fb19abc83b88 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:21:38.364339 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-736cd042-aeba-4083-9e8b-285476b0e1a5 req-5ba37c43-182e-42c5-a3db-fb19abc83b88 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:21:38.364774 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-736cd042-aeba-4083-9e8b-285476b0e1a5 req-5ba37c43-182e-42c5-a3db-fb19abc83b88 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:21:38.367966 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-126d2076-0f13-4a70-842e-e61ad674878b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:21:38.368474 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-126d2076-0f13-4a70-842e-e61ad674878b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:21:38.369704 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-126d2076-0f13-4a70-842e-e61ad674878b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:21:38.369858 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-126d2076-0f13-4a70-842e-e61ad674878b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:21:38.377530 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-736cd042-aeba-4083-9e8b-285476b0e1a5 req-5ba37c43-182e-42c5-a3db-fb19abc83b88 service nova] Creating event network-changed:ede85e95-1864-4844-a0ec-6d3eb8a89e10 for instance 3c6fb8fb-bfd1-4818-934f-f96684b7fd63 on n-h1-862686-1 Oct 26 14:21:38.380813 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-126d2076-0f13-4a70-842e-e61ad674878b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:21:38.382438 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-126d2076-0f13-4a70-842e-e61ad674878b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:21:38.383680 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-736cd042-aeba-4083-9e8b-285476b0e1a5 req-5ba37c43-182e-42c5-a3db-fb19abc83b88 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042446 Oct 26 14:21:38.387289 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3889/7802] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 14:21:38.412096 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-126d2076-0f13-4a70-842e-e61ad674878b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 3c6fb8fb-bfd1-4818-934f-f96684b7fd63] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 14:21:38.499841 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-126d2076-0f13-4a70-842e-e61ad674878b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63" status: 204 len: 0 microversion: 2.1 time: 0.161571 Oct 26 14:21:38.500702 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3914/7803] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 14:21:38 2022] DELETE /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 14:21:38.509731 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1485c587-b80d-4c15-89e4-cdf5fea7db29 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:21:38.510431 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1485c587-b80d-4c15-89e4-cdf5fea7db29 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 3c6fb8fb-bfd1-4818-934f-f96684b7fd63] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:21:38.520309 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1485c587-b80d-4c15-89e4-cdf5fea7db29 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:21:38.520809 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1485c587-b80d-4c15-89e4-cdf5fea7db29 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:21:38.521257 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1485c587-b80d-4c15-89e4-cdf5fea7db29 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:21:38.521992 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1485c587-b80d-4c15-89e4-cdf5fea7db29 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:21:38.522445 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1485c587-b80d-4c15-89e4-cdf5fea7db29 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:21:38.522869 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1485c587-b80d-4c15-89e4-cdf5fea7db29 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:21:38.737320 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1485c587-b80d-4c15-89e4-cdf5fea7db29 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:21:38.745636 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1485c587-b80d-4c15-89e4-cdf5fea7db29 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63" status: 200 len: 1691 microversion: 2.1 time: 0.240542 Oct 26 14:21:38.746869 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3890/7804] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:21:38 2022] GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63 => generated 1691 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:21:39.772788 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d3a824d0-4488-4bfa-af32-20767acf52d4 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:21:39.773524 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d3a824d0-4488-4bfa-af32-20767acf52d4 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 3c6fb8fb-bfd1-4818-934f-f96684b7fd63] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:21:39.781178 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3a824d0-4488-4bfa-af32-20767acf52d4 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:21:39.781715 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3a824d0-4488-4bfa-af32-20767acf52d4 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:21:39.782171 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3a824d0-4488-4bfa-af32-20767acf52d4 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:21:39.782886 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3a824d0-4488-4bfa-af32-20767acf52d4 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:21:39.783359 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3a824d0-4488-4bfa-af32-20767acf52d4 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:21:39.783806 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d3a824d0-4488-4bfa-af32-20767acf52d4 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:21:40.032773 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d3a824d0-4488-4bfa-af32-20767acf52d4 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:21:40.041318 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d3a824d0-4488-4bfa-af32-20767acf52d4 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63" status: 200 len: 1691 microversion: 2.1 time: 0.272837 Oct 26 14:21:40.041998 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3915/7805] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:21:39 2022] GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63 => generated 1691 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:21:40.737309 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-388a7887-f152-4d83-a0d3-18ba6e95a926 req-7e3aa6fc-7aa8-4c7b-99d6-a5e70b92f3d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c6fb8fb-bfd1-4818-934f-f96684b7fd63", "name": "network-vif-deleted", "tag": "ede85e95-1864-4844-a0ec-6d3eb8a89e10"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:21:40.748790 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-388a7887-f152-4d83-a0d3-18ba6e95a926 req-7e3aa6fc-7aa8-4c7b-99d6-a5e70b92f3d2 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:21:40.749298 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-388a7887-f152-4d83-a0d3-18ba6e95a926 req-7e3aa6fc-7aa8-4c7b-99d6-a5e70b92f3d2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:21:40.749771 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-388a7887-f152-4d83-a0d3-18ba6e95a926 req-7e3aa6fc-7aa8-4c7b-99d6-a5e70b92f3d2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:21:40.760318 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-388a7887-f152-4d83-a0d3-18ba6e95a926 req-7e3aa6fc-7aa8-4c7b-99d6-a5e70b92f3d2 service nova] Creating event network-vif-deleted:ede85e95-1864-4844-a0ec-6d3eb8a89e10 for instance 3c6fb8fb-bfd1-4818-934f-f96684b7fd63 on n-h1-862686-1 Oct 26 14:21:40.765866 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-388a7887-f152-4d83-a0d3-18ba6e95a926 req-7e3aa6fc-7aa8-4c7b-99d6-a5e70b92f3d2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032306 Oct 26 14:21:40.766473 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3891/7806] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:21:41.065569 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7085b7aa-98bb-46c0-98d6-0b6ab534246b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:21:41.066377 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7085b7aa-98bb-46c0-98d6-0b6ab534246b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 3c6fb8fb-bfd1-4818-934f-f96684b7fd63] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:21:41.073375 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7085b7aa-98bb-46c0-98d6-0b6ab534246b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:21:41.074524 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7085b7aa-98bb-46c0-98d6-0b6ab534246b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:21:41.074981 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7085b7aa-98bb-46c0-98d6-0b6ab534246b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:21:41.075747 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7085b7aa-98bb-46c0-98d6-0b6ab534246b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:21:41.076228 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7085b7aa-98bb-46c0-98d6-0b6ab534246b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:21:41.076832 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7085b7aa-98bb-46c0-98d6-0b6ab534246b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:21:41.114329 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7085b7aa-98bb-46c0-98d6-0b6ab534246b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:21:41.114858 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7085b7aa-98bb-46c0-98d6-0b6ab534246b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:21:41.115296 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7085b7aa-98bb-46c0-98d6-0b6ab534246b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:21:41.115772 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-7085b7aa-98bb-46c0-98d6-0b6ab534246b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lazy-loading 'fault' on Instance uuid 3c6fb8fb-bfd1-4818-934f-f96684b7fd63 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 14:21:41.158660 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7085b7aa-98bb-46c0-98d6-0b6ab534246b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:21:41.167031 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7085b7aa-98bb-46c0-98d6-0b6ab534246b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63" status: 200 len: 1357 microversion: 2.1 time: 0.105447 Oct 26 14:21:41.167774 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3916/7807] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:21:41 2022] GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63 => generated 1357 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:21:42.191878 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b042a441-5686-46c4-aedf-22d70f2c7f7b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:21:42.192563 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b042a441-5686-46c4-aedf-22d70f2c7f7b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 3c6fb8fb-bfd1-4818-934f-f96684b7fd63] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:21:42.198956 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b042a441-5686-46c4-aedf-22d70f2c7f7b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:21:42.199451 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b042a441-5686-46c4-aedf-22d70f2c7f7b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:21:42.199893 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b042a441-5686-46c4-aedf-22d70f2c7f7b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:21:42.200588 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b042a441-5686-46c4-aedf-22d70f2c7f7b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:21:42.201046 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b042a441-5686-46c4-aedf-22d70f2c7f7b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:21:42.201473 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b042a441-5686-46c4-aedf-22d70f2c7f7b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:21:42.215257 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-b042a441-5686-46c4-aedf-22d70f2c7f7b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] HTTP exception thrown: Instance 3c6fb8fb-bfd1-4818-934f-f96684b7fd63 could not be found. Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b042a441-5686-46c4-aedf-22d70f2c7f7b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Request method failure captured: Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63 HTTP/1.1 Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWUDr33jAxtjEebp3Gj9k8Lbc1SrqwHm7Mcup79l6KuQSwXiy4o2KjnHZEkbB8fkd5uIcGtGt55Uhtw3xdnKaU85Pw2G7l54JmBa0kbYJ4z4No_CAY6Y63JfScReC0DCePeGpVkaUJplfHKvIPPZMxJQQn7G18wWCdYlRSKYCWbu3jAw Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: ba91e9b802254871b5153158707cb180 Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-72818388 Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ba91e9b802254871b5153158707cb180"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ba91e9b802254871b5153158707cb180"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ba91e9b802254871b5153158707cb180"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ba91e9b802254871b5153158707cb180"}]}] Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-TestNetworkAdvancedServerOps-72818388 Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: ba91e9b802254871b5153158707cb180 Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-72818388 Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-TestNetworkAdvancedServerOps-72818388-project Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 18876f18c54a4579a554e52225b24c74 Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-TestNetworkAdvancedServerOps-72818388-project Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 3c6fb8fb-bfd1-4818-934f-f96684b7fd63 could not be found. Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '3c6fb8fb-bfd1-4818-934f-f96684b7fd63'} Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c6fb8fb-bfd1-4818-934f-f96684b7fd63 could not be found. Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c6fb8fb-bfd1-4818-934f-f96684b7fd63 could not be found. Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:21:42.216884 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:21:42.221895 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:21:42.221895 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:21:42.221895 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:21:42.221895 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:21:42.221895 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 14:21:42.221895 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 14:21:42.221895 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c6fb8fb-bfd1-4818-934f-f96684b7fd63 could not be found. Oct 26 14:21:42.221895 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:21:42.221895 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b042a441-5686-46c4-aedf-22d70f2c7f7b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Returning 404 to user: Instance 3c6fb8fb-bfd1-4818-934f-f96684b7fd63 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 14:21:42.221895 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b042a441-5686-46c4-aedf-22d70f2c7f7b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63" status: 404 len: 111 microversion: 2.1 time: 0.031728 Oct 26 14:21:42.221895 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3892/7808] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:21:42 2022] GET /compute/v2.1/servers/3c6fb8fb-bfd1-4818-934f-f96684b7fd63 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 14:21:45.598321 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-04c1c985-95a0-4290-9d9f-2472cfb9fd8a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '.version_select at 0x7f6731f30b80>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:21:45.629115 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-04c1c985-95a0-4290-9d9f-2472cfb9fd8a tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1433024703" status: 202 len: 0 microversion: 2.1 time: 0.034642 Oct 26 14:21:45.629660 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3917/7809] 10.222.0.40 () {58 vars in 1284 bytes} [Wed Oct 26 14:21:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1433024703 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 14:21:45.658789 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c05a7c9b-4d4a-49a2-9c0a-57c5f8647315 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Action: 'create', calling method: .version_select at 0x7f67313553a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-541256615", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBzxlwHtvIIa+OsFsEOzXhHgKKfxH+xw2QmYuCF2C3zWUck/mTdPTctBRFihO6dNL8RvJDhEwHriGcQ4E4il/BCUeXyWxpRCPC0KSynPg0DuNObQltswBeFCdua1QbXZaA=="}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:21:45.678529 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-c05a7c9b-4d4a-49a2-9c0a-57c5f8647315 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Getting quotas for project ba91e9b802254871b5153158707cb180. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 14:21:45.684369 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-c05a7c9b-4d4a-49a2-9c0a-57c5f8647315 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Getting quotas for user 18876f18c54a4579a554e52225b24c74 and project ba91e9b802254871b5153158707cb180. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 14:21:45.709695 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c05a7c9b-4d4a-49a2-9c0a-57c5f8647315 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.054662 Oct 26 14:21:45.710973 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3893/7810] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 14:21:45 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:21:51.311012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d66326de-0696-4a1a-a389-e5f27a79acdc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-998227344", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "networks": [{"uuid": "8076701b-6682-4a70-a5ae-1c7a51830fd0"}], "key_name": "tempest-TestNetworkAdvancedServerOps-541256615", "security_groups": [{"name": "tempest-secgroup-smoke-1599067921"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:21:51.333548 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:21:51.453742 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-d66326de-0696-4a1a-a389-e5f27a79acdc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] validate_networks() for [('8076701b-6682-4a70-a5ae-1c7a51830fd0', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 14:21:51.918571 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-d66326de-0696-4a1a-a389-e5f27a79acdc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 14:21:51.919014 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-d66326de-0696-4a1a-a389-e5f27a79acdc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 14:21:51.919514 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-d66326de-0696-4a1a-a389-e5f27a79acdc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 14:21:51.919942 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-d66326de-0696-4a1a-a389-e5f27a79acdc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 14:21:51.920376 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-d66326de-0696-4a1a-a389-e5f27a79acdc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 14:21:51.929338 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d66326de-0696-4a1a-a389-e5f27a79acdc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:21:51.929872 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d66326de-0696-4a1a-a389-e5f27a79acdc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:21:51.930323 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d66326de-0696-4a1a-a389-e5f27a79acdc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:21:51.931073 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d66326de-0696-4a1a-a389-e5f27a79acdc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:21:51.931547 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d66326de-0696-4a1a-a389-e5f27a79acdc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:21:51.932111 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d66326de-0696-4a1a-a389-e5f27a79acdc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:21:51.949831 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-d66326de-0696-4a1a-a389-e5f27a79acdc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Getting quotas for project ba91e9b802254871b5153158707cb180. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 14:21:51.955211 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-d66326de-0696-4a1a-a389-e5f27a79acdc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Getting quotas for user 18876f18c54a4579a554e52225b24c74 and project ba91e9b802254871b5153158707cb180. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 14:21:51.968822 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d66326de-0696-4a1a-a389-e5f27a79acdc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 14:21:51.971321 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d66326de-0696-4a1a-a389-e5f27a79acdc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 34622441-1e6c-4084-b4ed-9ffb66e49786] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 14:21:52.024357 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d66326de-0696-4a1a-a389-e5f27a79acdc tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.717938 Oct 26 14:21:52.025201 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3918/7811] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 14:21:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 26 14:21:52.038171 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0aae1492-22a5-48fb-ba44-be4cb2d426b6 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:21:52.038778 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0aae1492-22a5-48fb-ba44-be4cb2d426b6 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 34622441-1e6c-4084-b4ed-9ffb66e49786] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:21:52.098273 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0aae1492-22a5-48fb-ba44-be4cb2d426b6 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:21:52.106072 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0aae1492-22a5-48fb-ba44-be4cb2d426b6 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786" status: 200 len: 1265 microversion: 2.1 time: 0.072714 Oct 26 14:21:52.106663 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3894/7812] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:21:52 2022] GET /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786 => generated 1265 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 14:21:53.130433 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8f3fd380-dec3-4ae7-b956-3e90b3b589db tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:21:53.131632 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8f3fd380-dec3-4ae7-b956-3e90b3b589db tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 34622441-1e6c-4084-b4ed-9ffb66e49786] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:21:53.160400 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f3fd380-dec3-4ae7-b956-3e90b3b589db tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:21:53.163230 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f3fd380-dec3-4ae7-b956-3e90b3b589db tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:21:53.164034 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f3fd380-dec3-4ae7-b956-3e90b3b589db tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:21:53.164954 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f3fd380-dec3-4ae7-b956-3e90b3b589db tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:21:53.165880 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f3fd380-dec3-4ae7-b956-3e90b3b589db tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:21:53.166509 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f3fd380-dec3-4ae7-b956-3e90b3b589db tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:21:53.266592 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8f3fd380-dec3-4ae7-b956-3e90b3b589db tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:21:53.276916 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8f3fd380-dec3-4ae7-b956-3e90b3b589db tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786" status: 200 len: 1325 microversion: 2.1 time: 0.150316 Oct 26 14:21:53.289611 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3919/7813] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:21:53 2022] GET /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786 => generated 1325 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:21:54.310198 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5c75081d-6239-452e-82c3-37d53f42aea5 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:21:54.311866 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5c75081d-6239-452e-82c3-37d53f42aea5 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 34622441-1e6c-4084-b4ed-9ffb66e49786] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:21:54.314482 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=16 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:21:54.324668 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c75081d-6239-452e-82c3-37d53f42aea5 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:21:54.325251 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c75081d-6239-452e-82c3-37d53f42aea5 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:21:54.325800 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c75081d-6239-452e-82c3-37d53f42aea5 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:21:54.326590 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c75081d-6239-452e-82c3-37d53f42aea5 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:21:54.327151 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c75081d-6239-452e-82c3-37d53f42aea5 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:21:54.327657 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c75081d-6239-452e-82c3-37d53f42aea5 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:21:54.461892 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5c75081d-6239-452e-82c3-37d53f42aea5 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:21:54.470290 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5c75081d-6239-452e-82c3-37d53f42aea5 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786" status: 200 len: 1391 microversion: 2.1 time: 0.164658 Oct 26 14:21:54.470885 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3895/7814] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:21:54 2022] GET /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786 => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:21:55.010182 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-42e22756-7c01-41ff-bf8d-b8d228e9224c req-5906e948-9c22-49f0-a359-0b28abc456f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34622441-1e6c-4084-b4ed-9ffb66e49786", "tag": "87d7cf9f-357a-4019-ac4d-28f9a8239759"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:21:55.022251 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-42e22756-7c01-41ff-bf8d-b8d228e9224c req-5906e948-9c22-49f0-a359-0b28abc456f7 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:21:55.022871 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-42e22756-7c01-41ff-bf8d-b8d228e9224c req-5906e948-9c22-49f0-a359-0b28abc456f7 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:21:55.023382 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-42e22756-7c01-41ff-bf8d-b8d228e9224c req-5906e948-9c22-49f0-a359-0b28abc456f7 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:21:55.035922 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-42e22756-7c01-41ff-bf8d-b8d228e9224c req-5906e948-9c22-49f0-a359-0b28abc456f7 service nova] Creating event network-changed:87d7cf9f-357a-4019-ac4d-28f9a8239759 for instance 34622441-1e6c-4084-b4ed-9ffb66e49786 on n-h2-862686-1 Oct 26 14:21:55.041910 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-42e22756-7c01-41ff-bf8d-b8d228e9224c req-5906e948-9c22-49f0-a359-0b28abc456f7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035458 Oct 26 14:21:55.043244 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3920/7815] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:21:55.494533 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-60949352-7c6b-472b-8e11-a61b2fe9d5b2 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:21:55.495622 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-60949352-7c6b-472b-8e11-a61b2fe9d5b2 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 34622441-1e6c-4084-b4ed-9ffb66e49786] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:21:55.503059 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-60949352-7c6b-472b-8e11-a61b2fe9d5b2 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:21:55.503548 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-60949352-7c6b-472b-8e11-a61b2fe9d5b2 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:21:55.503994 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-60949352-7c6b-472b-8e11-a61b2fe9d5b2 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:21:55.504696 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-60949352-7c6b-472b-8e11-a61b2fe9d5b2 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:21:55.505157 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-60949352-7c6b-472b-8e11-a61b2fe9d5b2 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:21:55.505631 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-60949352-7c6b-472b-8e11-a61b2fe9d5b2 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:21:55.640043 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-60949352-7c6b-472b-8e11-a61b2fe9d5b2 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:21:55.647775 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-60949352-7c6b-472b-8e11-a61b2fe9d5b2 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786" status: 200 len: 1391 microversion: 2.1 time: 0.157293 Oct 26 14:21:55.648356 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3896/7816] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:21:55 2022] GET /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:21:56.672972 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-154612cf-ffe7-4c84-b05a-f79706685c32 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:21:56.673841 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-154612cf-ffe7-4c84-b05a-f79706685c32 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 34622441-1e6c-4084-b4ed-9ffb66e49786] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:21:56.680257 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-154612cf-ffe7-4c84-b05a-f79706685c32 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:21:56.680763 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-154612cf-ffe7-4c84-b05a-f79706685c32 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:21:56.681218 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-154612cf-ffe7-4c84-b05a-f79706685c32 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:21:56.681966 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-154612cf-ffe7-4c84-b05a-f79706685c32 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:21:56.682445 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-154612cf-ffe7-4c84-b05a-f79706685c32 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:21:56.682895 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-154612cf-ffe7-4c84-b05a-f79706685c32 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:21:56.898844 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-154612cf-ffe7-4c84-b05a-f79706685c32 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:21:56.907570 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-154612cf-ffe7-4c84-b05a-f79706685c32 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786" status: 200 len: 1391 microversion: 2.1 time: 0.239869 Oct 26 14:21:56.908432 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3921/7817] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:21:56 2022] GET /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786 => generated 1391 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:21:57.930489 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5bcb805a-9992-4681-baf9-6a5ee175d465 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:21:57.931100 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5bcb805a-9992-4681-baf9-6a5ee175d465 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 34622441-1e6c-4084-b4ed-9ffb66e49786] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:21:57.938332 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bcb805a-9992-4681-baf9-6a5ee175d465 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:21:57.938818 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bcb805a-9992-4681-baf9-6a5ee175d465 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:21:57.939251 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bcb805a-9992-4681-baf9-6a5ee175d465 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:21:57.939938 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bcb805a-9992-4681-baf9-6a5ee175d465 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:21:57.940391 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bcb805a-9992-4681-baf9-6a5ee175d465 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:21:57.940816 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bcb805a-9992-4681-baf9-6a5ee175d465 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:21:58.072706 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5bcb805a-9992-4681-baf9-6a5ee175d465 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:21:58.080986 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5bcb805a-9992-4681-baf9-6a5ee175d465 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786" status: 200 len: 1391 microversion: 2.1 time: 0.154431 Oct 26 14:21:58.085319 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3897/7818] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:21:57 2022] GET /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:21:59.104850 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-25d22e47-1ded-40cf-b620-23eeda002a27 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:21:59.105521 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-25d22e47-1ded-40cf-b620-23eeda002a27 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 34622441-1e6c-4084-b4ed-9ffb66e49786] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:21:59.112388 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25d22e47-1ded-40cf-b620-23eeda002a27 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:21:59.112887 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25d22e47-1ded-40cf-b620-23eeda002a27 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:21:59.113342 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25d22e47-1ded-40cf-b620-23eeda002a27 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:21:59.114092 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25d22e47-1ded-40cf-b620-23eeda002a27 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:21:59.114565 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25d22e47-1ded-40cf-b620-23eeda002a27 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:21:59.115008 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25d22e47-1ded-40cf-b620-23eeda002a27 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:21:59.249429 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-25d22e47-1ded-40cf-b620-23eeda002a27 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:21:59.257072 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-25d22e47-1ded-40cf-b620-23eeda002a27 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786" status: 200 len: 1391 microversion: 2.1 time: 0.156763 Oct 26 14:21:59.257671 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3922/7819] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:21:59 2022] GET /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:22:00.281173 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-94e2ff26-9e3d-4dc3-a03b-63def6c2d4f1 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:22:00.281817 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-94e2ff26-9e3d-4dc3-a03b-63def6c2d4f1 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 34622441-1e6c-4084-b4ed-9ffb66e49786] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:22:00.288447 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-94e2ff26-9e3d-4dc3-a03b-63def6c2d4f1 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:22:00.288931 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-94e2ff26-9e3d-4dc3-a03b-63def6c2d4f1 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:22:00.289368 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-94e2ff26-9e3d-4dc3-a03b-63def6c2d4f1 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:22:00.290347 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-94e2ff26-9e3d-4dc3-a03b-63def6c2d4f1 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:22:00.290795 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-94e2ff26-9e3d-4dc3-a03b-63def6c2d4f1 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:22:00.291217 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-94e2ff26-9e3d-4dc3-a03b-63def6c2d4f1 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:22:00.382619 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-70cb938b-1449-4173-b795-593fd70e06c3 req-da9f514e-6843-43e6-b948-725e30a8c650 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34622441-1e6c-4084-b4ed-9ffb66e49786", "name": "network-vif-plugged", "status": "completed", "tag": "87d7cf9f-357a-4019-ac4d-28f9a8239759"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:22:00.395726 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-70cb938b-1449-4173-b795-593fd70e06c3 req-da9f514e-6843-43e6-b948-725e30a8c650 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:22:00.396255 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-70cb938b-1449-4173-b795-593fd70e06c3 req-da9f514e-6843-43e6-b948-725e30a8c650 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:22:00.396701 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-70cb938b-1449-4173-b795-593fd70e06c3 req-da9f514e-6843-43e6-b948-725e30a8c650 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:22:00.409739 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-70cb938b-1449-4173-b795-593fd70e06c3 req-da9f514e-6843-43e6-b948-725e30a8c650 service nova] Creating event network-vif-plugged:87d7cf9f-357a-4019-ac4d-28f9a8239759 for instance 34622441-1e6c-4084-b4ed-9ffb66e49786 on n-h2-862686-1 Oct 26 14:22:00.416137 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-70cb938b-1449-4173-b795-593fd70e06c3 req-da9f514e-6843-43e6-b948-725e30a8c650 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037169 Oct 26 14:22:00.416879 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3923/7820] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:22:00.441469 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-94e2ff26-9e3d-4dc3-a03b-63def6c2d4f1 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:22:00.455029 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-94e2ff26-9e3d-4dc3-a03b-63def6c2d4f1 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786" status: 200 len: 1391 microversion: 2.1 time: 0.178571 Oct 26 14:22:00.455625 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3898/7821] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:22:00 2022] GET /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786 => generated 1391 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:22:01.481145 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1b4a6114-a1bb-4200-9429-255a99631eb9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:22:01.481880 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1b4a6114-a1bb-4200-9429-255a99631eb9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 34622441-1e6c-4084-b4ed-9ffb66e49786] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:22:01.488309 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b4a6114-a1bb-4200-9429-255a99631eb9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:22:01.488804 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b4a6114-a1bb-4200-9429-255a99631eb9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:22:01.489254 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b4a6114-a1bb-4200-9429-255a99631eb9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:22:01.489976 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b4a6114-a1bb-4200-9429-255a99631eb9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:22:01.490446 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b4a6114-a1bb-4200-9429-255a99631eb9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:22:01.490884 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b4a6114-a1bb-4200-9429-255a99631eb9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:22:01.633744 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1b4a6114-a1bb-4200-9429-255a99631eb9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:22:01.642141 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1b4a6114-a1bb-4200-9429-255a99631eb9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786" status: 200 len: 1391 microversion: 2.1 time: 0.167062 Oct 26 14:22:01.642726 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3924/7822] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:22:01 2022] GET /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786 => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:22:02.666813 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1992c9c5-3f8e-4aaa-a9f7-7fc0a5103cbb tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:22:02.667532 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1992c9c5-3f8e-4aaa-a9f7-7fc0a5103cbb tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 34622441-1e6c-4084-b4ed-9ffb66e49786] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:22:02.670134 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:22:02.670805 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:22:02.676804 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1992c9c5-3f8e-4aaa-a9f7-7fc0a5103cbb tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:22:02.677297 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1992c9c5-3f8e-4aaa-a9f7-7fc0a5103cbb tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:22:02.677766 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1992c9c5-3f8e-4aaa-a9f7-7fc0a5103cbb tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:22:02.678474 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1992c9c5-3f8e-4aaa-a9f7-7fc0a5103cbb tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:22:02.678935 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1992c9c5-3f8e-4aaa-a9f7-7fc0a5103cbb tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:22:02.679367 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1992c9c5-3f8e-4aaa-a9f7-7fc0a5103cbb tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:22:02.813120 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1992c9c5-3f8e-4aaa-a9f7-7fc0a5103cbb tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:22:02.821169 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1992c9c5-3f8e-4aaa-a9f7-7fc0a5103cbb tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786" status: 200 len: 1562 microversion: 2.1 time: 0.158617 Oct 26 14:22:02.821773 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3899/7823] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:22:02 2022] GET /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786 => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:22:02.844383 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ea04fb9c-481b-4dec-8a3c-8eb76561db5f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:22:02.845000 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ea04fb9c-481b-4dec-8a3c-8eb76561db5f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 34622441-1e6c-4084-b4ed-9ffb66e49786] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:22:02.846967 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:22:02.847756 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:22:02.854259 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ea04fb9c-481b-4dec-8a3c-8eb76561db5f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:22:02.854826 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ea04fb9c-481b-4dec-8a3c-8eb76561db5f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:22:02.855289 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ea04fb9c-481b-4dec-8a3c-8eb76561db5f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:22:02.855999 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ea04fb9c-481b-4dec-8a3c-8eb76561db5f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:22:02.856467 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ea04fb9c-481b-4dec-8a3c-8eb76561db5f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:22:02.856904 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ea04fb9c-481b-4dec-8a3c-8eb76561db5f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:22:02.987955 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ea04fb9c-481b-4dec-8a3c-8eb76561db5f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:22:02.996711 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ea04fb9c-481b-4dec-8a3c-8eb76561db5f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786" status: 200 len: 1562 microversion: 2.1 time: 0.156182 Oct 26 14:22:02.997286 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3925/7824] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:22:02 2022] GET /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786 => generated 1562 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 14:22:04.582170 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-eb47a2ba-0261-4fd2-bafd-79dd3cf387f9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:22:04.582787 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-eb47a2ba-0261-4fd2-bafd-79dd3cf387f9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 34622441-1e6c-4084-b4ed-9ffb66e49786] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:22:04.589374 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eb47a2ba-0261-4fd2-bafd-79dd3cf387f9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:22:04.594421 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-f186e7b6-7fad-48af-9e8b-397f732f2788 req-568f2736-05db-4d9c-95ef-78e2122546bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34622441-1e6c-4084-b4ed-9ffb66e49786", "tag": "87d7cf9f-357a-4019-ac4d-28f9a8239759"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:22:04.601449 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eb47a2ba-0261-4fd2-bafd-79dd3cf387f9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:22:04.601936 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eb47a2ba-0261-4fd2-bafd-79dd3cf387f9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:22:04.602674 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eb47a2ba-0261-4fd2-bafd-79dd3cf387f9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:22:04.603147 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eb47a2ba-0261-4fd2-bafd-79dd3cf387f9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:22:04.603576 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eb47a2ba-0261-4fd2-bafd-79dd3cf387f9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:22:04.611472 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f186e7b6-7fad-48af-9e8b-397f732f2788 req-568f2736-05db-4d9c-95ef-78e2122546bd service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:22:04.611976 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f186e7b6-7fad-48af-9e8b-397f732f2788 req-568f2736-05db-4d9c-95ef-78e2122546bd service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:22:04.612423 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f186e7b6-7fad-48af-9e8b-397f732f2788 req-568f2736-05db-4d9c-95ef-78e2122546bd service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:22:04.624539 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-f186e7b6-7fad-48af-9e8b-397f732f2788 req-568f2736-05db-4d9c-95ef-78e2122546bd service nova] Creating event network-changed:87d7cf9f-357a-4019-ac4d-28f9a8239759 for instance 34622441-1e6c-4084-b4ed-9ffb66e49786 on n-h2-862686-1 Oct 26 14:22:04.629949 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-f186e7b6-7fad-48af-9e8b-397f732f2788 req-568f2736-05db-4d9c-95ef-78e2122546bd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039079 Oct 26 14:22:04.631537 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3926/7825] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:22:04.750681 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-eb47a2ba-0261-4fd2-bafd-79dd3cf387f9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:22:04.758781 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-eb47a2ba-0261-4fd2-bafd-79dd3cf387f9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786" status: 200 len: 1562 microversion: 2.1 time: 0.180842 Oct 26 14:22:04.759508 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3900/7826] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:22:04 2022] GET /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786 => generated 1562 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:22:28.006084 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:22:28.006785 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=38 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:22:28.010966 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0354ec21-3b29-4d5a-93d1-a03fdb7b0a2c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:22:28.013275 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0354ec21-3b29-4d5a-93d1-a03fdb7b0a2c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 34622441-1e6c-4084-b4ed-9ffb66e49786] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:22:28.020533 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0354ec21-3b29-4d5a-93d1-a03fdb7b0a2c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:22:28.021039 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0354ec21-3b29-4d5a-93d1-a03fdb7b0a2c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:22:28.021570 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0354ec21-3b29-4d5a-93d1-a03fdb7b0a2c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:22:28.022257 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0354ec21-3b29-4d5a-93d1-a03fdb7b0a2c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:22:28.022734 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0354ec21-3b29-4d5a-93d1-a03fdb7b0a2c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:22:28.023177 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0354ec21-3b29-4d5a-93d1-a03fdb7b0a2c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:22:28.079331 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0354ec21-3b29-4d5a-93d1-a03fdb7b0a2c tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "POST /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786/action" status: 200 len: 24567 microversion: 2.1 time: 0.075165 Oct 26 14:22:28.079975 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3927/7827] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 14:22:28 2022] POST /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786/action => generated 24567 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 14:22:38.976837 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9a4286aa-8cd9-47e4-9d27-dd211fb994e2 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:22:38.977363 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9a4286aa-8cd9-47e4-9d27-dd211fb994e2 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 34622441-1e6c-4084-b4ed-9ffb66e49786] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:22:38.979927 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:22:38.980585 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=36 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:22:38.986454 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9a4286aa-8cd9-47e4-9d27-dd211fb994e2 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:22:38.986937 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9a4286aa-8cd9-47e4-9d27-dd211fb994e2 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:22:38.987373 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9a4286aa-8cd9-47e4-9d27-dd211fb994e2 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:22:38.988064 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9a4286aa-8cd9-47e4-9d27-dd211fb994e2 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:22:38.988525 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9a4286aa-8cd9-47e4-9d27-dd211fb994e2 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:22:38.988952 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9a4286aa-8cd9-47e4-9d27-dd211fb994e2 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:22:39.015211 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-9a4286aa-8cd9-47e4-9d27-dd211fb994e2 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lazy-loading 'flavor' on Instance uuid 34622441-1e6c-4084-b4ed-9ffb66e49786 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 14:22:39.080444 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9a4286aa-8cd9-47e4-9d27-dd211fb994e2 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "POST /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786/action" status: 202 len: 0 microversion: 2.1 time: 0.107547 Oct 26 14:22:39.081110 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3901/7828] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 14:22:38 2022] POST /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 14:22:39.089959 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5969745c-62f5-45b7-96ef-54d2914555c1 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:22:39.090648 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5969745c-62f5-45b7-96ef-54d2914555c1 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 34622441-1e6c-4084-b4ed-9ffb66e49786] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:22:39.093584 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:22:39.094265 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=4 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:22:39.100438 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5969745c-62f5-45b7-96ef-54d2914555c1 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:22:39.101002 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5969745c-62f5-45b7-96ef-54d2914555c1 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:22:39.101453 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5969745c-62f5-45b7-96ef-54d2914555c1 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:22:39.102191 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5969745c-62f5-45b7-96ef-54d2914555c1 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:22:39.102670 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5969745c-62f5-45b7-96ef-54d2914555c1 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:22:39.103116 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5969745c-62f5-45b7-96ef-54d2914555c1 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:22:39.241957 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5969745c-62f5-45b7-96ef-54d2914555c1 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:22:39.250413 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5969745c-62f5-45b7-96ef-54d2914555c1 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786" status: 200 len: 1688 microversion: 2.1 time: 0.164903 Oct 26 14:22:39.250977 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3928/7829] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:22:39 2022] GET /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786 => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:22:40.276155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-20fdf2f8-c940-43f7-aaa5-e6512873918f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:22:40.277281 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-20fdf2f8-c940-43f7-aaa5-e6512873918f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 34622441-1e6c-4084-b4ed-9ffb66e49786] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:22:40.283410 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20fdf2f8-c940-43f7-aaa5-e6512873918f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:22:40.283895 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20fdf2f8-c940-43f7-aaa5-e6512873918f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:22:40.284331 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20fdf2f8-c940-43f7-aaa5-e6512873918f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:22:40.285017 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20fdf2f8-c940-43f7-aaa5-e6512873918f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:22:40.285470 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20fdf2f8-c940-43f7-aaa5-e6512873918f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:22:40.285916 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20fdf2f8-c940-43f7-aaa5-e6512873918f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:22:40.423931 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-20fdf2f8-c940-43f7-aaa5-e6512873918f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:22:40.431606 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-20fdf2f8-c940-43f7-aaa5-e6512873918f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786" status: 200 len: 1671 microversion: 2.1 time: 0.160899 Oct 26 14:22:40.432209 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3902/7830] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:22:40 2022] GET /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786 => generated 1671 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:22:41.526117 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-99a2e248-e226-463f-927a-9c4c472599f3 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:22:41.528334 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-99a2e248-e226-463f-927a-9c4c472599f3 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 34622441-1e6c-4084-b4ed-9ffb66e49786] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:22:41.535998 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99a2e248-e226-463f-927a-9c4c472599f3 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:22:41.536508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99a2e248-e226-463f-927a-9c4c472599f3 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:22:41.536961 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99a2e248-e226-463f-927a-9c4c472599f3 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:22:41.537700 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99a2e248-e226-463f-927a-9c4c472599f3 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:22:41.538175 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99a2e248-e226-463f-927a-9c4c472599f3 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:22:41.538626 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99a2e248-e226-463f-927a-9c4c472599f3 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:22:41.601661 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-99a2e248-e226-463f-927a-9c4c472599f3 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "POST /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786/action" status: 200 len: 38371 microversion: 2.1 time: 0.079315 Oct 26 14:22:41.602607 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3929/7831] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 14:22:41 2022] POST /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786/action => generated 38371 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 26 14:22:41.614837 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-edc7f17c-dd53-419b-9cea-eb547bb36211 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:22:41.615386 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-edc7f17c-dd53-419b-9cea-eb547bb36211 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 34622441-1e6c-4084-b4ed-9ffb66e49786] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:22:41.623035 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-edc7f17c-dd53-419b-9cea-eb547bb36211 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:22:41.623533 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-edc7f17c-dd53-419b-9cea-eb547bb36211 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:22:41.623970 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-edc7f17c-dd53-419b-9cea-eb547bb36211 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:22:41.624665 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-edc7f17c-dd53-419b-9cea-eb547bb36211 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:22:41.625127 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-edc7f17c-dd53-419b-9cea-eb547bb36211 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:22:41.625596 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-edc7f17c-dd53-419b-9cea-eb547bb36211 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:22:41.691122 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-edc7f17c-dd53-419b-9cea-eb547bb36211 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "POST /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786/action" status: 202 len: 0 microversion: 2.1 time: 0.079980 Oct 26 14:22:41.691749 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3903/7832] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 14:22:41 2022] POST /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 14:22:41.701992 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-055af8d1-a388-4a4e-be02-96678f3abb8d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:22:41.702712 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-055af8d1-a388-4a4e-be02-96678f3abb8d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 34622441-1e6c-4084-b4ed-9ffb66e49786] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:22:41.709852 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-055af8d1-a388-4a4e-be02-96678f3abb8d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:22:41.710527 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-055af8d1-a388-4a4e-be02-96678f3abb8d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:22:41.710984 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-055af8d1-a388-4a4e-be02-96678f3abb8d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:22:41.711919 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-055af8d1-a388-4a4e-be02-96678f3abb8d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:22:41.712422 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-055af8d1-a388-4a4e-be02-96678f3abb8d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:22:41.712868 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-055af8d1-a388-4a4e-be02-96678f3abb8d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:22:41.903322 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-055af8d1-a388-4a4e-be02-96678f3abb8d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:22:41.911201 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-055af8d1-a388-4a4e-be02-96678f3abb8d tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786" status: 200 len: 1677 microversion: 2.1 time: 0.214945 Oct 26 14:22:41.911776 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3930/7833] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:22:41 2022] GET /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786 => generated 1677 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 14:22:42.938393 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-43ff4923-be90-456c-8bc0-ae333d80fa5e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:22:42.939099 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-43ff4923-be90-456c-8bc0-ae333d80fa5e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 34622441-1e6c-4084-b4ed-9ffb66e49786] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:22:42.945293 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-43ff4923-be90-456c-8bc0-ae333d80fa5e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:22:42.945888 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-43ff4923-be90-456c-8bc0-ae333d80fa5e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:22:42.946333 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-43ff4923-be90-456c-8bc0-ae333d80fa5e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:22:42.947025 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-43ff4923-be90-456c-8bc0-ae333d80fa5e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:22:42.947482 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-43ff4923-be90-456c-8bc0-ae333d80fa5e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:22:42.948730 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-43ff4923-be90-456c-8bc0-ae333d80fa5e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:22:43.079397 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-43ff4923-be90-456c-8bc0-ae333d80fa5e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:22:43.087200 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-43ff4923-be90-456c-8bc0-ae333d80fa5e tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786" status: 200 len: 1677 microversion: 2.1 time: 0.154764 Oct 26 14:22:43.087774 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3904/7834] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:22:42 2022] GET /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:22:44.110499 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e6a4932c-c277-4c26-9545-e632742c3d4f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:22:44.111119 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e6a4932c-c277-4c26-9545-e632742c3d4f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 34622441-1e6c-4084-b4ed-9ffb66e49786] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:22:44.122348 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6a4932c-c277-4c26-9545-e632742c3d4f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:22:44.122844 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6a4932c-c277-4c26-9545-e632742c3d4f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:22:44.123294 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6a4932c-c277-4c26-9545-e632742c3d4f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:22:44.124011 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6a4932c-c277-4c26-9545-e632742c3d4f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:22:44.124479 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6a4932c-c277-4c26-9545-e632742c3d4f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:22:44.124919 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6a4932c-c277-4c26-9545-e632742c3d4f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:22:44.261043 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e6a4932c-c277-4c26-9545-e632742c3d4f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:22:44.268849 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e6a4932c-c277-4c26-9545-e632742c3d4f tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786" status: 200 len: 1680 microversion: 2.1 time: 0.162310 Oct 26 14:22:44.269444 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3931/7835] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:22:44 2022] GET /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:22:44.363012 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-79f33264-4c06-4656-91c0-c1fd94049860 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:22:44.365238 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-79f33264-4c06-4656-91c0-c1fd94049860 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 34622441-1e6c-4084-b4ed-9ffb66e49786] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:22:44.373792 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-79f33264-4c06-4656-91c0-c1fd94049860 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:22:44.374418 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-79f33264-4c06-4656-91c0-c1fd94049860 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:22:44.375002 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-79f33264-4c06-4656-91c0-c1fd94049860 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:22:44.375737 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-79f33264-4c06-4656-91c0-c1fd94049860 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:22:44.376200 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-79f33264-4c06-4656-91c0-c1fd94049860 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:22:44.376635 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-79f33264-4c06-4656-91c0-c1fd94049860 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:22:44.418371 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-79f33264-4c06-4656-91c0-c1fd94049860 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "POST /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786/action" status: 200 len: 38371 microversion: 2.1 time: 0.059036 Oct 26 14:22:44.418942 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3905/7836] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 14:22:44 2022] POST /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786/action => generated 38371 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 14:22:45.401254 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0494c609-2863-4f54-a8cd-4417b280d179 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:22:45.401865 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0494c609-2863-4f54-a8cd-4417b280d179 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 34622441-1e6c-4084-b4ed-9ffb66e49786] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:22:45.403824 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-995e2c3a-decf-44c8-b61d-4e3c2bb70397 req-da04bd4a-37e1-4e33-b570-4d20e7831a80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34622441-1e6c-4084-b4ed-9ffb66e49786", "tag": "87d7cf9f-357a-4019-ac4d-28f9a8239759"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:22:45.408915 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0494c609-2863-4f54-a8cd-4417b280d179 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:22:45.409698 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0494c609-2863-4f54-a8cd-4417b280d179 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:22:45.410151 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0494c609-2863-4f54-a8cd-4417b280d179 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:22:45.410873 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0494c609-2863-4f54-a8cd-4417b280d179 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:22:45.411346 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0494c609-2863-4f54-a8cd-4417b280d179 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:22:45.411789 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0494c609-2863-4f54-a8cd-4417b280d179 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:22:45.414793 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-995e2c3a-decf-44c8-b61d-4e3c2bb70397 req-da04bd4a-37e1-4e33-b570-4d20e7831a80 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:22:45.415270 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-995e2c3a-decf-44c8-b61d-4e3c2bb70397 req-da04bd4a-37e1-4e33-b570-4d20e7831a80 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:22:45.415949 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-995e2c3a-decf-44c8-b61d-4e3c2bb70397 req-da04bd4a-37e1-4e33-b570-4d20e7831a80 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:22:45.428448 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-995e2c3a-decf-44c8-b61d-4e3c2bb70397 req-da04bd4a-37e1-4e33-b570-4d20e7831a80 service nova] Creating event network-changed:87d7cf9f-357a-4019-ac4d-28f9a8239759 for instance 34622441-1e6c-4084-b4ed-9ffb66e49786 on n-h2-862686-1 Oct 26 14:22:45.434385 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-995e2c3a-decf-44c8-b61d-4e3c2bb70397 req-da04bd4a-37e1-4e33-b570-4d20e7831a80 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034528 Oct 26 14:22:45.435202 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3906/7837] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 14:22:45.442315 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0494c609-2863-4f54-a8cd-4417b280d179 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 34622441-1e6c-4084-b4ed-9ffb66e49786] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 14:22:45.552038 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0494c609-2863-4f54-a8cd-4417b280d179 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "DELETE /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786" status: 204 len: 0 microversion: 2.1 time: 0.154588 Oct 26 14:22:45.555590 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3932/7838] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 14:22:45 2022] DELETE /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 14:22:45.563997 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2cfdd04c-7ea7-4ce6-8468-3b12858a9d5b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:22:45.565236 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2cfdd04c-7ea7-4ce6-8468-3b12858a9d5b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 34622441-1e6c-4084-b4ed-9ffb66e49786] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:22:45.573814 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2cfdd04c-7ea7-4ce6-8468-3b12858a9d5b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:22:45.575172 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2cfdd04c-7ea7-4ce6-8468-3b12858a9d5b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:22:45.575841 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2cfdd04c-7ea7-4ce6-8468-3b12858a9d5b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:22:45.576792 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2cfdd04c-7ea7-4ce6-8468-3b12858a9d5b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:22:45.577501 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2cfdd04c-7ea7-4ce6-8468-3b12858a9d5b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:22:45.578126 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2cfdd04c-7ea7-4ce6-8468-3b12858a9d5b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:22:45.746804 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2cfdd04c-7ea7-4ce6-8468-3b12858a9d5b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:22:45.755138 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2cfdd04c-7ea7-4ce6-8468-3b12858a9d5b tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786" status: 200 len: 1686 microversion: 2.1 time: 0.196607 Oct 26 14:22:45.756020 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3907/7839] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:22:45 2022] GET /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786 => generated 1686 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:22:46.780867 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b4932815-e3db-4ff4-bcf7-9f23351688ad tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:22:46.781654 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b4932815-e3db-4ff4-bcf7-9f23351688ad tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 34622441-1e6c-4084-b4ed-9ffb66e49786] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:22:46.788737 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b4932815-e3db-4ff4-bcf7-9f23351688ad tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:22:46.789240 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b4932815-e3db-4ff4-bcf7-9f23351688ad tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:22:46.789728 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b4932815-e3db-4ff4-bcf7-9f23351688ad tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:22:46.790707 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b4932815-e3db-4ff4-bcf7-9f23351688ad tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:22:46.791180 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b4932815-e3db-4ff4-bcf7-9f23351688ad tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:22:46.792336 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b4932815-e3db-4ff4-bcf7-9f23351688ad tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:22:46.939586 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b4932815-e3db-4ff4-bcf7-9f23351688ad tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:22:46.947454 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b4932815-e3db-4ff4-bcf7-9f23351688ad tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786" status: 200 len: 1686 microversion: 2.1 time: 0.171567 Oct 26 14:22:46.948560 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3933/7840] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:22:46 2022] GET /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786 => generated 1686 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:22:47.795632 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-9727943e-efb9-4726-b16b-94c124333950 req-8e80f7b2-96f9-4ad2-8d34-5b5bb4211258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34622441-1e6c-4084-b4ed-9ffb66e49786", "name": "network-vif-deleted", "tag": "87d7cf9f-357a-4019-ac4d-28f9a8239759"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:22:47.807996 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9727943e-efb9-4726-b16b-94c124333950 req-8e80f7b2-96f9-4ad2-8d34-5b5bb4211258 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:22:47.808572 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9727943e-efb9-4726-b16b-94c124333950 req-8e80f7b2-96f9-4ad2-8d34-5b5bb4211258 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:22:47.808990 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9727943e-efb9-4726-b16b-94c124333950 req-8e80f7b2-96f9-4ad2-8d34-5b5bb4211258 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:22:47.821777 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-9727943e-efb9-4726-b16b-94c124333950 req-8e80f7b2-96f9-4ad2-8d34-5b5bb4211258 service nova] Creating event network-vif-deleted:87d7cf9f-357a-4019-ac4d-28f9a8239759 for instance 34622441-1e6c-4084-b4ed-9ffb66e49786 on n-h2-862686-1 Oct 26 14:22:47.828459 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-9727943e-efb9-4726-b16b-94c124333950 req-8e80f7b2-96f9-4ad2-8d34-5b5bb4211258 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036564 Oct 26 14:22:47.829063 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3908/7841] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:22:47.974701 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5c388e3a-9a0c-4b0b-a11d-3302475838a9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:22:47.975344 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5c388e3a-9a0c-4b0b-a11d-3302475838a9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 34622441-1e6c-4084-b4ed-9ffb66e49786] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:22:47.982627 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c388e3a-9a0c-4b0b-a11d-3302475838a9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:22:47.983135 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c388e3a-9a0c-4b0b-a11d-3302475838a9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:22:47.983596 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c388e3a-9a0c-4b0b-a11d-3302475838a9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:22:47.984313 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c388e3a-9a0c-4b0b-a11d-3302475838a9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:22:47.984790 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c388e3a-9a0c-4b0b-a11d-3302475838a9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:22:47.985236 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c388e3a-9a0c-4b0b-a11d-3302475838a9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:22:48.018122 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c388e3a-9a0c-4b0b-a11d-3302475838a9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:22:48.018623 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c388e3a-9a0c-4b0b-a11d-3302475838a9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:22:48.019077 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c388e3a-9a0c-4b0b-a11d-3302475838a9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:22:48.019537 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-5c388e3a-9a0c-4b0b-a11d-3302475838a9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lazy-loading 'fault' on Instance uuid 34622441-1e6c-4084-b4ed-9ffb66e49786 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 14:22:48.060958 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5c388e3a-9a0c-4b0b-a11d-3302475838a9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18876f18c54a4579a554e52225b24c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba91e9b802254871b5153158707cb180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:22:48.068844 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5c388e3a-9a0c-4b0b-a11d-3302475838a9 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786" status: 200 len: 1355 microversion: 2.1 time: 0.098115 Oct 26 14:22:48.069422 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3934/7842] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:22:47 2022] GET /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786 => generated 1355 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:22:49.093674 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5ada2f26-f381-435a-a0a0-b0c88b2831b5 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:22:49.094376 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5ada2f26-f381-435a-a0a0-b0c88b2831b5 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] [instance: 34622441-1e6c-4084-b4ed-9ffb66e49786] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:22:49.101562 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ada2f26-f381-435a-a0a0-b0c88b2831b5 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:22:49.102050 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ada2f26-f381-435a-a0a0-b0c88b2831b5 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:22:49.102496 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ada2f26-f381-435a-a0a0-b0c88b2831b5 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:22:49.103248 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ada2f26-f381-435a-a0a0-b0c88b2831b5 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:22:49.103711 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ada2f26-f381-435a-a0a0-b0c88b2831b5 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:22:49.104139 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ada2f26-f381-435a-a0a0-b0c88b2831b5 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:22:49.117302 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-5ada2f26-f381-435a-a0a0-b0c88b2831b5 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] HTTP exception thrown: Instance 34622441-1e6c-4084-b4ed-9ffb66e49786 could not be found. Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5ada2f26-f381-435a-a0a0-b0c88b2831b5 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Request method failure captured: Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786 HTTP/1.1 Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWUDr33jAxtjEebp3Gj9k8Lbc1SrqwHm7Mcup79l6KuQSwXiy4o2KjnHZEkbB8fkd5uIcGtGt55Uhtw3xdnKaU85Pw2G7l54JmBa0kbYJ4z4No_CAY6Y63JfScReC0DCePeGpVkaUJplfHKvIPPZMxJQQn7G18wWCdYlRSKYCWbu3jAw Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: ba91e9b802254871b5153158707cb180 Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-72818388 Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ba91e9b802254871b5153158707cb180"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ba91e9b802254871b5153158707cb180"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ba91e9b802254871b5153158707cb180"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ba91e9b802254871b5153158707cb180"}]}] Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-TestNetworkAdvancedServerOps-72818388 Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: ba91e9b802254871b5153158707cb180 Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-72818388 Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-TestNetworkAdvancedServerOps-72818388-project Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 18876f18c54a4579a554e52225b24c74 Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-TestNetworkAdvancedServerOps-72818388-project Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 34622441-1e6c-4084-b4ed-9ffb66e49786 could not be found. Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '34622441-1e6c-4084-b4ed-9ffb66e49786'} Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34622441-1e6c-4084-b4ed-9ffb66e49786 could not be found. Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34622441-1e6c-4084-b4ed-9ffb66e49786 could not be found. Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:22:49.118951 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:22:49.124486 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:22:49.124486 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:22:49.124486 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:22:49.124486 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:22:49.124486 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 14:22:49.124486 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 14:22:49.124486 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34622441-1e6c-4084-b4ed-9ffb66e49786 could not be found. Oct 26 14:22:49.124486 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:22:49.124486 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5ada2f26-f381-435a-a0a0-b0c88b2831b5 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Returning 404 to user: Instance 34622441-1e6c-4084-b4ed-9ffb66e49786 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 14:22:49.124486 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5ada2f26-f381-435a-a0a0-b0c88b2831b5 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "GET /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786" status: 404 len: 111 microversion: 2.1 time: 0.031621 Oct 26 14:22:49.124486 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3909/7843] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:22:49 2022] GET /compute/v2.1/servers/34622441-1e6c-4084-b4ed-9ffb66e49786 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 14:22:52.182840 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9e47ed79-2d27-471c-bc47-4c292aec62b0 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] Calling method '.version_select at 0x7f6731936af0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:22:52.207175 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9e47ed79-2d27-471c-bc47-4c292aec62b0 tempest-TestNetworkAdvancedServerOps-72818388 tempest-TestNetworkAdvancedServerOps-72818388-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-541256615" status: 202 len: 0 microversion: 2.1 time: 0.028141 Oct 26 14:22:52.207827 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3935/7844] 10.222.0.40 () {58 vars in 1281 bytes} [Wed Oct 26 14:22:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-541256615 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 14:23:03.545511 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=18 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:23:03.546456 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:23:03.777656 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2debf864-e651-4ab4-8c7a-0cae108df895 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Action: 'create', calling method: .version_select at 0x7f6732dc3310>, body: {"keypair": {"name": "tempest-TestShelveInstance-2005565263", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9XIyy8laJNB3HaFvqeT63XjTt1CFxQwrhcwUIOlHMqy/iRbCqwVN16/bRxduh2U+xx4Xl5uOXQUt3gdoGZuhwOHRXyRtD+O8yXN+yJTkpfYv0nqgwwbEIYu+qv0zLcng=="}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:23:03.794873 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-2debf864-e651-4ab4-8c7a-0cae108df895 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Getting quotas for project ccbff35dfa5d49dabac384d92e5ddea6. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 14:23:03.800287 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-2debf864-e651-4ab4-8c7a-0cae108df895 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Getting quotas for user 926665a856ff4ab0883995386bc5b46a and project ccbff35dfa5d49dabac384d92e5ddea6. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 14:23:03.827197 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2debf864-e651-4ab4-8c7a-0cae108df895 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.287998 Oct 26 14:23:03.827803 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3910/7845] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 14:23:03 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:23:04.825420 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9b51ee5c-2d13-4168-9726-968b5361099e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2100752754", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2005565263", "security_groups": [{"name": "tempest-secgroup-smoke-800022260"}], "networks": [{"uuid": "28223c2e-0f8a-4645-98bc-7fd16d77390f"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:23:04.835980 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:23:04.836781 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:23:04.954711 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-9b51ee5c-2d13-4168-9726-968b5361099e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] validate_networks() for [('28223c2e-0f8a-4645-98bc-7fd16d77390f', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 14:23:05.391182 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-9b51ee5c-2d13-4168-9726-968b5361099e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 14:23:05.391626 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-9b51ee5c-2d13-4168-9726-968b5361099e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 14:23:05.392373 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-9b51ee5c-2d13-4168-9726-968b5361099e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 14:23:05.392811 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-9b51ee5c-2d13-4168-9726-968b5361099e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 14:23:05.393246 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-9b51ee5c-2d13-4168-9726-968b5361099e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 14:23:05.402746 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b51ee5c-2d13-4168-9726-968b5361099e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:23:05.403685 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b51ee5c-2d13-4168-9726-968b5361099e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:23:05.403980 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b51ee5c-2d13-4168-9726-968b5361099e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:23:05.404839 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b51ee5c-2d13-4168-9726-968b5361099e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:23:05.405324 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b51ee5c-2d13-4168-9726-968b5361099e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:23:05.405800 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9b51ee5c-2d13-4168-9726-968b5361099e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:23:05.424329 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-9b51ee5c-2d13-4168-9726-968b5361099e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Getting quotas for project ccbff35dfa5d49dabac384d92e5ddea6. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 14:23:05.429817 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-9b51ee5c-2d13-4168-9726-968b5361099e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Getting quotas for user 926665a856ff4ab0883995386bc5b46a and project ccbff35dfa5d49dabac384d92e5ddea6. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 14:23:05.443665 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9b51ee5c-2d13-4168-9726-968b5361099e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 14:23:05.446044 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9b51ee5c-2d13-4168-9726-968b5361099e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 14:23:05.495472 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9b51ee5c-2d13-4168-9726-968b5361099e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.673864 Oct 26 14:23:05.496063 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3936/7846] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 14:23:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 14:23:05.508281 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b8205b84-eafa-4f8c-b74a-87020de1c4c0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:23:05.509000 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b8205b84-eafa-4f8c-b74a-87020de1c4c0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:23:05.567148 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b8205b84-eafa-4f8c-b74a-87020de1c4c0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:23:05.574461 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b8205b84-eafa-4f8c-b74a-87020de1c4c0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1247 microversion: 2.1 time: 0.070984 Oct 26 14:23:05.575121 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3911/7847] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:23:05 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1247 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:23:06.598163 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9d478589-5517-4dcf-a829-121a67d8b790 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:23:06.598881 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9d478589-5517-4dcf-a829-121a67d8b790 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:23:06.606316 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d478589-5517-4dcf-a829-121a67d8b790 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:23:06.606937 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d478589-5517-4dcf-a829-121a67d8b790 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:23:06.607473 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d478589-5517-4dcf-a829-121a67d8b790 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:23:06.608207 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d478589-5517-4dcf-a829-121a67d8b790 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:23:06.608689 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d478589-5517-4dcf-a829-121a67d8b790 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:23:06.609300 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d478589-5517-4dcf-a829-121a67d8b790 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:23:06.680867 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9d478589-5517-4dcf-a829-121a67d8b790 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:23:06.689593 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9d478589-5517-4dcf-a829-121a67d8b790 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1299 microversion: 2.1 time: 0.095593 Oct 26 14:23:06.690219 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3937/7848] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:23:06 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1299 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:23:07.713425 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d159120d-af98-4612-b9cf-1e74e31041cc tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:23:07.714709 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d159120d-af98-4612-b9cf-1e74e31041cc tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:23:07.722873 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d159120d-af98-4612-b9cf-1e74e31041cc tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:23:07.723363 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d159120d-af98-4612-b9cf-1e74e31041cc tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:23:07.723805 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d159120d-af98-4612-b9cf-1e74e31041cc tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:23:07.724519 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d159120d-af98-4612-b9cf-1e74e31041cc tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:23:07.724971 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d159120d-af98-4612-b9cf-1e74e31041cc tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:23:07.725399 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d159120d-af98-4612-b9cf-1e74e31041cc tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:23:07.888188 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d159120d-af98-4612-b9cf-1e74e31041cc tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:23:07.896355 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d159120d-af98-4612-b9cf-1e74e31041cc tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1372 microversion: 2.1 time: 0.187247 Oct 26 14:23:07.908739 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3912/7849] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:23:07 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1372 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:23:08.376916 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-ed32c3dc-c883-4e89-96f7-fb254ee7e248 req-ac509028-2608-492d-a1bf-a6576d6f5fb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "535eb280-08e2-4639-92bd-b939fe9b3623", "tag": "5fd7250c-04a4-4b75-b729-c9c47ef151ae"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:23:08.387895 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ed32c3dc-c883-4e89-96f7-fb254ee7e248 req-ac509028-2608-492d-a1bf-a6576d6f5fb5 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:23:08.388394 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ed32c3dc-c883-4e89-96f7-fb254ee7e248 req-ac509028-2608-492d-a1bf-a6576d6f5fb5 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:23:08.388844 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ed32c3dc-c883-4e89-96f7-fb254ee7e248 req-ac509028-2608-492d-a1bf-a6576d6f5fb5 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:23:08.400933 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-ed32c3dc-c883-4e89-96f7-fb254ee7e248 req-ac509028-2608-492d-a1bf-a6576d6f5fb5 service nova] Creating event network-changed:5fd7250c-04a4-4b75-b729-c9c47ef151ae for instance 535eb280-08e2-4639-92bd-b939fe9b3623 on n-h1-862686-1 Oct 26 14:23:08.406034 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-ed32c3dc-c883-4e89-96f7-fb254ee7e248 req-ac509028-2608-492d-a1bf-a6576d6f5fb5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100906 Oct 26 14:23:08.406639 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3938/7850] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:23:08.922188 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8006219a-812a-4ad8-bde3-563fd7a254e4 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:23:08.922851 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8006219a-812a-4ad8-bde3-563fd7a254e4 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:23:08.930020 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8006219a-812a-4ad8-bde3-563fd7a254e4 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:23:08.930511 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8006219a-812a-4ad8-bde3-563fd7a254e4 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:23:08.930953 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8006219a-812a-4ad8-bde3-563fd7a254e4 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:23:08.932146 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8006219a-812a-4ad8-bde3-563fd7a254e4 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:23:08.932655 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8006219a-812a-4ad8-bde3-563fd7a254e4 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:23:08.933148 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8006219a-812a-4ad8-bde3-563fd7a254e4 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:23:09.071806 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8006219a-812a-4ad8-bde3-563fd7a254e4 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:23:09.081031 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8006219a-812a-4ad8-bde3-563fd7a254e4 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1372 microversion: 2.1 time: 0.164270 Oct 26 14:23:09.081854 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3913/7851] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:23:08 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:23:10.105938 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-42567d59-73e5-41b2-b9a8-6d1aa360f914 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:23:10.106589 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-42567d59-73e5-41b2-b9a8-6d1aa360f914 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:23:10.112737 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42567d59-73e5-41b2-b9a8-6d1aa360f914 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:23:10.113244 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42567d59-73e5-41b2-b9a8-6d1aa360f914 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:23:10.113742 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42567d59-73e5-41b2-b9a8-6d1aa360f914 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:23:10.114453 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42567d59-73e5-41b2-b9a8-6d1aa360f914 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:23:10.114974 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42567d59-73e5-41b2-b9a8-6d1aa360f914 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:23:10.115421 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42567d59-73e5-41b2-b9a8-6d1aa360f914 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:23:10.314427 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-42567d59-73e5-41b2-b9a8-6d1aa360f914 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:23:10.322781 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-42567d59-73e5-41b2-b9a8-6d1aa360f914 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1372 microversion: 2.1 time: 0.221791 Oct 26 14:23:10.323370 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3939/7852] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:23:10 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1372 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:23:11.346598 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-29ba34c3-791c-4c70-b171-8fcebad2b30f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:23:11.347167 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-29ba34c3-791c-4c70-b171-8fcebad2b30f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:23:11.355203 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-29ba34c3-791c-4c70-b171-8fcebad2b30f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:23:11.355692 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-29ba34c3-791c-4c70-b171-8fcebad2b30f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:23:11.356131 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-29ba34c3-791c-4c70-b171-8fcebad2b30f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:23:11.356824 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-29ba34c3-791c-4c70-b171-8fcebad2b30f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:23:11.357283 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-29ba34c3-791c-4c70-b171-8fcebad2b30f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:23:11.357746 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-29ba34c3-791c-4c70-b171-8fcebad2b30f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:23:11.488614 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-29ba34c3-791c-4c70-b171-8fcebad2b30f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:23:11.497571 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-29ba34c3-791c-4c70-b171-8fcebad2b30f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1372 microversion: 2.1 time: 0.154772 Oct 26 14:23:11.498397 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3914/7853] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:23:11 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:23:12.520270 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-adcc3c27-7c94-4717-a52b-efb7108bcb2e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:23:12.520888 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-adcc3c27-7c94-4717-a52b-efb7108bcb2e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:23:12.528307 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-adcc3c27-7c94-4717-a52b-efb7108bcb2e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:23:12.528794 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-adcc3c27-7c94-4717-a52b-efb7108bcb2e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:23:12.529240 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-adcc3c27-7c94-4717-a52b-efb7108bcb2e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:23:12.529960 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-adcc3c27-7c94-4717-a52b-efb7108bcb2e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:23:12.530421 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-adcc3c27-7c94-4717-a52b-efb7108bcb2e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:23:12.530852 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-adcc3c27-7c94-4717-a52b-efb7108bcb2e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:23:12.664402 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-adcc3c27-7c94-4717-a52b-efb7108bcb2e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:23:12.673329 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-adcc3c27-7c94-4717-a52b-efb7108bcb2e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1372 microversion: 2.1 time: 0.157030 Oct 26 14:23:12.673933 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3940/7854] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:23:12 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:23:13.696263 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-284c88f8-0bea-4f78-8854-c66032622cc1 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:23:13.698612 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-284c88f8-0bea-4f78-8854-c66032622cc1 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:23:13.705830 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-284c88f8-0bea-4f78-8854-c66032622cc1 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:23:13.706558 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-284c88f8-0bea-4f78-8854-c66032622cc1 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:23:13.707169 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-284c88f8-0bea-4f78-8854-c66032622cc1 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:23:13.708060 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-284c88f8-0bea-4f78-8854-c66032622cc1 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:23:13.708692 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-284c88f8-0bea-4f78-8854-c66032622cc1 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:23:13.715216 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-24b6f1b1-57e2-44ea-978a-bafb67da88e9 req-effc1450-5564-4cf4-b827-695447f9328b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "535eb280-08e2-4639-92bd-b939fe9b3623", "name": "network-vif-plugged", "status": "completed", "tag": "5fd7250c-04a4-4b75-b729-c9c47ef151ae"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:23:13.719300 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-284c88f8-0bea-4f78-8854-c66032622cc1 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:23:13.729993 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-24b6f1b1-57e2-44ea-978a-bafb67da88e9 req-effc1450-5564-4cf4-b827-695447f9328b service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:23:13.730483 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-24b6f1b1-57e2-44ea-978a-bafb67da88e9 req-effc1450-5564-4cf4-b827-695447f9328b service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:23:13.730923 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-24b6f1b1-57e2-44ea-978a-bafb67da88e9 req-effc1450-5564-4cf4-b827-695447f9328b service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:23:13.742067 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-24b6f1b1-57e2-44ea-978a-bafb67da88e9 req-effc1450-5564-4cf4-b827-695447f9328b service nova] Creating event network-vif-plugged:5fd7250c-04a4-4b75-b729-c9c47ef151ae for instance 535eb280-08e2-4639-92bd-b939fe9b3623 on n-h1-862686-1 Oct 26 14:23:13.747828 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-24b6f1b1-57e2-44ea-978a-bafb67da88e9 req-effc1450-5564-4cf4-b827-695447f9328b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093791 Oct 26 14:23:13.748422 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3915/7855] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:23:13.893600 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-284c88f8-0bea-4f78-8854-c66032622cc1 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:23:13.902002 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-284c88f8-0bea-4f78-8854-c66032622cc1 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1372 microversion: 2.1 time: 0.209536 Oct 26 14:23:13.917515 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3941/7856] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:23:13 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1372 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 14:23:14.926946 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-065ba157-7ba1-4ba6-a1ef-cde81b54bd33 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:23:14.927654 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-065ba157-7ba1-4ba6-a1ef-cde81b54bd33 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:23:14.934564 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-065ba157-7ba1-4ba6-a1ef-cde81b54bd33 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:23:14.935048 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-065ba157-7ba1-4ba6-a1ef-cde81b54bd33 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:23:14.935488 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-065ba157-7ba1-4ba6-a1ef-cde81b54bd33 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:23:14.936181 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-065ba157-7ba1-4ba6-a1ef-cde81b54bd33 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:23:14.936642 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-065ba157-7ba1-4ba6-a1ef-cde81b54bd33 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:23:14.937071 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-065ba157-7ba1-4ba6-a1ef-cde81b54bd33 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:23:15.072503 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-065ba157-7ba1-4ba6-a1ef-cde81b54bd33 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:23:15.080628 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-065ba157-7ba1-4ba6-a1ef-cde81b54bd33 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1372 microversion: 2.1 time: 0.158858 Oct 26 14:23:15.081224 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3916/7857] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:23:14 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:23:16.104691 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-823feeca-4035-4176-8d9d-4038d629a57d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:23:16.105323 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-823feeca-4035-4176-8d9d-4038d629a57d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:23:16.108134 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:23:16.108825 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:23:16.114468 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-823feeca-4035-4176-8d9d-4038d629a57d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:23:16.114959 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-823feeca-4035-4176-8d9d-4038d629a57d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:23:16.115407 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-823feeca-4035-4176-8d9d-4038d629a57d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:23:16.116106 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-823feeca-4035-4176-8d9d-4038d629a57d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:23:16.116573 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-823feeca-4035-4176-8d9d-4038d629a57d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:23:16.117008 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-823feeca-4035-4176-8d9d-4038d629a57d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:23:16.250168 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-823feeca-4035-4176-8d9d-4038d629a57d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:23:16.258110 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-823feeca-4035-4176-8d9d-4038d629a57d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1555 microversion: 2.1 time: 0.157877 Oct 26 14:23:16.258720 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3942/7858] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:23:16 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:23:16.282345 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d3347fc1-f7dd-45f3-a174-3f5d47dc51f0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:23:16.282956 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d3347fc1-f7dd-45f3-a174-3f5d47dc51f0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:23:16.284888 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:23:16.290957 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d3347fc1-f7dd-45f3-a174-3f5d47dc51f0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:23:16.291613 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d3347fc1-f7dd-45f3-a174-3f5d47dc51f0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:23:16.292040 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d3347fc1-f7dd-45f3-a174-3f5d47dc51f0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:23:16.293347 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d3347fc1-f7dd-45f3-a174-3f5d47dc51f0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:23:16.293835 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d3347fc1-f7dd-45f3-a174-3f5d47dc51f0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:23:16.294266 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d3347fc1-f7dd-45f3-a174-3f5d47dc51f0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:23:16.430162 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d3347fc1-f7dd-45f3-a174-3f5d47dc51f0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:23:16.438578 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d3347fc1-f7dd-45f3-a174-3f5d47dc51f0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1555 microversion: 2.1 time: 0.160294 Oct 26 14:23:16.439154 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3917/7859] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:23:16 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:23:18.396555 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-4743e7ab-3dc8-4052-9e72-2c04058474a5 req-6647ba6b-ddfe-4306-94b2-44e0f5210ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "535eb280-08e2-4639-92bd-b939fe9b3623", "tag": "5fd7250c-04a4-4b75-b729-c9c47ef151ae"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:23:18.409543 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-4743e7ab-3dc8-4052-9e72-2c04058474a5 req-6647ba6b-ddfe-4306-94b2-44e0f5210ed2 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:23:18.410051 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-4743e7ab-3dc8-4052-9e72-2c04058474a5 req-6647ba6b-ddfe-4306-94b2-44e0f5210ed2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:23:18.410498 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-4743e7ab-3dc8-4052-9e72-2c04058474a5 req-6647ba6b-ddfe-4306-94b2-44e0f5210ed2 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:23:18.422351 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-4743e7ab-3dc8-4052-9e72-2c04058474a5 req-6647ba6b-ddfe-4306-94b2-44e0f5210ed2 service nova] Creating event network-changed:5fd7250c-04a4-4b75-b729-c9c47ef151ae for instance 535eb280-08e2-4639-92bd-b939fe9b3623 on n-h1-862686-1 Oct 26 14:23:18.427671 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-4743e7ab-3dc8-4052-9e72-2c04058474a5 req-6647ba6b-ddfe-4306-94b2-44e0f5210ed2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034754 Oct 26 14:23:18.428366 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3943/7860] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:25:13.750193 n-d-862686-1 devstack@n-api.service[120597]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c037a1b0-cfe5-48ae-b7c7-2931306917f8] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 26 14:25:13.751355 n-d-862686-1 devstack@n-api.service[120597]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 14:25:13.751495 n-d-862686-1 devstack@n-api.service[120597]: Wed Oct 26 14:25:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623/action (ip 10.222.0.40) !!! Oct 26 14:25:13.753451 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:25:13.754267 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=32 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:25:13.764694 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d18349f2-d2d3-41ec-ab04-703807d7dd30 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:25:13.765257 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d18349f2-d2d3-41ec-ab04-703807d7dd30 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:25:13.773250 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d18349f2-d2d3-41ec-ab04-703807d7dd30 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:13.773757 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d18349f2-d2d3-41ec-ab04-703807d7dd30 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:13.774194 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d18349f2-d2d3-41ec-ab04-703807d7dd30 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:13.774886 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d18349f2-d2d3-41ec-ab04-703807d7dd30 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:13.775338 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d18349f2-d2d3-41ec-ab04-703807d7dd30 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:13.775759 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d18349f2-d2d3-41ec-ab04-703807d7dd30 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:13.800335 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-d18349f2-d2d3-41ec-ab04-703807d7dd30 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lazy-loading 'flavor' on Instance uuid 535eb280-08e2-4639-92bd-b939fe9b3623 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 14:25:13.993779 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d18349f2-d2d3-41ec-ab04-703807d7dd30 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "POST /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623/action" status: 202 len: 0 microversion: 2.1 time: 0.246563 Oct 26 14:25:13.994396 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3918/7861] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 14:25:13 2022] POST /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 14:25:14.001258 n-d-862686-1 devstack@n-api.service[120598]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b813bc1f-3720-4149-820f-44a58aef8a8e] AMQP server on 10.222.0.40:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 26 14:25:14.002138 n-d-862686-1 devstack@n-api.service[120598]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bbf40942-d6c8-479f-a0f4-15bbba6fd52c] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 26 14:25:14.002770 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:25:14.003939 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=36 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:25:14.005731 n-d-862686-1 devstack@n-api.service[120598]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 14:25:14.005888 n-d-862686-1 devstack@n-api.service[120598]: Wed Oct 26 14:25:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 (ip 10.222.0.40) !!! Oct 26 14:25:14.012146 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-33515a26-9b43-4981-a275-4d1ac908e978 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:25:14.012878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-33515a26-9b43-4981-a275-4d1ac908e978 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:25:14.021401 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33515a26-9b43-4981-a275-4d1ac908e978 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:14.021953 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33515a26-9b43-4981-a275-4d1ac908e978 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:14.022410 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33515a26-9b43-4981-a275-4d1ac908e978 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:14.023126 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33515a26-9b43-4981-a275-4d1ac908e978 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:14.023602 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33515a26-9b43-4981-a275-4d1ac908e978 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:14.024045 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-33515a26-9b43-4981-a275-4d1ac908e978 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:14.164492 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-33515a26-9b43-4981-a275-4d1ac908e978 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:25:14.173250 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-33515a26-9b43-4981-a275-4d1ac908e978 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1680 microversion: 2.1 time: 0.174205 Oct 26 14:25:14.173878 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3944/7862] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:25:13 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:25:15.199841 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-85206a71-d1f0-43a6-9b1a-637f856a86af tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:25:15.200457 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-85206a71-d1f0-43a6-9b1a-637f856a86af tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:25:15.208640 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-85206a71-d1f0-43a6-9b1a-637f856a86af tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:15.209120 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-85206a71-d1f0-43a6-9b1a-637f856a86af tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:15.209583 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-85206a71-d1f0-43a6-9b1a-637f856a86af tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:15.210302 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-85206a71-d1f0-43a6-9b1a-637f856a86af tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:15.210760 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-85206a71-d1f0-43a6-9b1a-637f856a86af tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:15.211179 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-85206a71-d1f0-43a6-9b1a-637f856a86af tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:15.216484 n-d-862686-1 devstack@n-api.service[120597]: INFO oslo.messaging._drivers.impl_rabbit [-] [c037a1b0-cfe5-48ae-b7c7-2931306917f8] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 38164. Oct 26 14:25:15.345216 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-85206a71-d1f0-43a6-9b1a-637f856a86af tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:25:15.352890 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-85206a71-d1f0-43a6-9b1a-637f856a86af tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1680 microversion: 2.1 time: 0.158907 Oct 26 14:25:15.353462 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3919/7863] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:25:15 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:25:16.376483 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8d3f4581-ad0d-4202-9282-f07504831bb8 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:25:16.377142 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8d3f4581-ad0d-4202-9282-f07504831bb8 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:25:16.385921 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d3f4581-ad0d-4202-9282-f07504831bb8 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:16.386422 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d3f4581-ad0d-4202-9282-f07504831bb8 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:16.386907 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d3f4581-ad0d-4202-9282-f07504831bb8 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:16.387586 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d3f4581-ad0d-4202-9282-f07504831bb8 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:16.388136 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d3f4581-ad0d-4202-9282-f07504831bb8 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:16.388585 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8d3f4581-ad0d-4202-9282-f07504831bb8 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:16.394852 n-d-862686-1 devstack@n-api.service[120598]: INFO oslo.messaging._drivers.impl_rabbit [-] [bbf40942-d6c8-479f-a0f4-15bbba6fd52c] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 38172. Oct 26 14:25:16.406404 n-d-862686-1 devstack@n-api.service[120598]: INFO oslo.messaging._drivers.impl_rabbit [-] [b813bc1f-3720-4149-820f-44a58aef8a8e] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 38170. Oct 26 14:25:16.527159 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8d3f4581-ad0d-4202-9282-f07504831bb8 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:25:16.535608 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8d3f4581-ad0d-4202-9282-f07504831bb8 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1680 microversion: 2.1 time: 0.163064 Oct 26 14:25:16.536159 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3945/7864] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:25:16 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:25:17.560142 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b07dd65f-7d52-4cbe-a3f6-3b1379135297 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:25:17.560752 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b07dd65f-7d52-4cbe-a3f6-3b1379135297 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:25:17.567755 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b07dd65f-7d52-4cbe-a3f6-3b1379135297 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:17.568245 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b07dd65f-7d52-4cbe-a3f6-3b1379135297 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:17.568689 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b07dd65f-7d52-4cbe-a3f6-3b1379135297 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:17.569390 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b07dd65f-7d52-4cbe-a3f6-3b1379135297 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:17.569948 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b07dd65f-7d52-4cbe-a3f6-3b1379135297 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:17.570383 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b07dd65f-7d52-4cbe-a3f6-3b1379135297 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:17.705243 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b07dd65f-7d52-4cbe-a3f6-3b1379135297 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:25:17.713025 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b07dd65f-7d52-4cbe-a3f6-3b1379135297 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1680 microversion: 2.1 time: 0.157012 Oct 26 14:25:17.713624 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3920/7865] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:25:17 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:25:18.736202 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5304f865-aef5-4008-bff3-21b3841e0892 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:25:18.736836 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5304f865-aef5-4008-bff3-21b3841e0892 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:25:18.743827 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5304f865-aef5-4008-bff3-21b3841e0892 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:18.744333 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5304f865-aef5-4008-bff3-21b3841e0892 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:18.744788 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5304f865-aef5-4008-bff3-21b3841e0892 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:18.745529 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5304f865-aef5-4008-bff3-21b3841e0892 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:18.746018 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5304f865-aef5-4008-bff3-21b3841e0892 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:18.746464 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5304f865-aef5-4008-bff3-21b3841e0892 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:18.875889 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5304f865-aef5-4008-bff3-21b3841e0892 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:25:18.883789 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5304f865-aef5-4008-bff3-21b3841e0892 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1680 microversion: 2.1 time: 0.152173 Oct 26 14:25:18.884367 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3946/7866] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:25:18 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:25:19.907946 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-644b79c7-22ea-499b-8b40-f5b8e079780e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:25:19.908564 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-644b79c7-22ea-499b-8b40-f5b8e079780e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:25:19.915423 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-644b79c7-22ea-499b-8b40-f5b8e079780e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:19.915908 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-644b79c7-22ea-499b-8b40-f5b8e079780e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:19.916609 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-644b79c7-22ea-499b-8b40-f5b8e079780e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:19.917299 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-644b79c7-22ea-499b-8b40-f5b8e079780e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:19.917779 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-644b79c7-22ea-499b-8b40-f5b8e079780e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:19.918208 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-644b79c7-22ea-499b-8b40-f5b8e079780e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:20.050125 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-644b79c7-22ea-499b-8b40-f5b8e079780e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:25:20.058222 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-644b79c7-22ea-499b-8b40-f5b8e079780e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1680 microversion: 2.1 time: 0.154754 Oct 26 14:25:20.058805 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3921/7867] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:25:19 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:25:21.081049 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-064ae99d-5780-49ae-b3a7-9849cba5c002 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:25:21.081707 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-064ae99d-5780-49ae-b3a7-9849cba5c002 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:25:21.088543 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-064ae99d-5780-49ae-b3a7-9849cba5c002 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:21.089044 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-064ae99d-5780-49ae-b3a7-9849cba5c002 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:21.089509 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-064ae99d-5780-49ae-b3a7-9849cba5c002 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:21.090231 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-064ae99d-5780-49ae-b3a7-9849cba5c002 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:21.090704 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-064ae99d-5780-49ae-b3a7-9849cba5c002 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:21.091147 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-064ae99d-5780-49ae-b3a7-9849cba5c002 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:21.224113 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-064ae99d-5780-49ae-b3a7-9849cba5c002 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:25:21.231722 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-064ae99d-5780-49ae-b3a7-9849cba5c002 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1680 microversion: 2.1 time: 0.154690 Oct 26 14:25:21.232307 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3947/7868] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:25:21 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:25:22.255695 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b5b7ee52-4f52-4aa1-807d-ae4b897e6251 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:25:22.256288 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b5b7ee52-4f52-4aa1-807d-ae4b897e6251 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:25:22.263458 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b5b7ee52-4f52-4aa1-807d-ae4b897e6251 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:22.263936 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b5b7ee52-4f52-4aa1-807d-ae4b897e6251 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:22.265556 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b5b7ee52-4f52-4aa1-807d-ae4b897e6251 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:22.266252 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b5b7ee52-4f52-4aa1-807d-ae4b897e6251 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:22.266710 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b5b7ee52-4f52-4aa1-807d-ae4b897e6251 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:22.267136 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b5b7ee52-4f52-4aa1-807d-ae4b897e6251 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:22.404238 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b5b7ee52-4f52-4aa1-807d-ae4b897e6251 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:25:22.412470 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b5b7ee52-4f52-4aa1-807d-ae4b897e6251 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1680 microversion: 2.1 time: 0.160797 Oct 26 14:25:22.413036 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3922/7869] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:25:22 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:25:23.436795 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1c9f4445-e0e2-4b50-a6bf-1c6e4a02f94d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:25:23.437465 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1c9f4445-e0e2-4b50-a6bf-1c6e4a02f94d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:25:23.444321 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c9f4445-e0e2-4b50-a6bf-1c6e4a02f94d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:23.444828 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c9f4445-e0e2-4b50-a6bf-1c6e4a02f94d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:23.445285 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c9f4445-e0e2-4b50-a6bf-1c6e4a02f94d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:23.446033 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c9f4445-e0e2-4b50-a6bf-1c6e4a02f94d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:23.446511 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c9f4445-e0e2-4b50-a6bf-1c6e4a02f94d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:23.446961 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1c9f4445-e0e2-4b50-a6bf-1c6e4a02f94d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:23.578059 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1c9f4445-e0e2-4b50-a6bf-1c6e4a02f94d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:25:23.585814 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1c9f4445-e0e2-4b50-a6bf-1c6e4a02f94d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1680 microversion: 2.1 time: 0.153107 Oct 26 14:25:23.586392 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3948/7870] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:25:23 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:25:24.610672 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ae096321-9356-4818-8aac-628140009ef2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:25:24.611264 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ae096321-9356-4818-8aac-628140009ef2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:25:24.618145 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae096321-9356-4818-8aac-628140009ef2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:24.618637 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae096321-9356-4818-8aac-628140009ef2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:24.619084 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae096321-9356-4818-8aac-628140009ef2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:24.619781 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae096321-9356-4818-8aac-628140009ef2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:24.620251 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae096321-9356-4818-8aac-628140009ef2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:24.620683 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ae096321-9356-4818-8aac-628140009ef2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:24.750538 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ae096321-9356-4818-8aac-628140009ef2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:25:24.758373 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ae096321-9356-4818-8aac-628140009ef2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1701 microversion: 2.1 time: 0.151938 Oct 26 14:25:24.758948 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3923/7871] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:25:24 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1701 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:25:25.783150 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7d98fccc-5904-4502-a6c4-c02d436cd8ac tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:25:25.783780 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7d98fccc-5904-4502-a6c4-c02d436cd8ac tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:25:25.790700 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7d98fccc-5904-4502-a6c4-c02d436cd8ac tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:25.791201 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7d98fccc-5904-4502-a6c4-c02d436cd8ac tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:25.791930 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7d98fccc-5904-4502-a6c4-c02d436cd8ac tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:25.792622 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7d98fccc-5904-4502-a6c4-c02d436cd8ac tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:25.793098 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7d98fccc-5904-4502-a6c4-c02d436cd8ac tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:25.793572 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7d98fccc-5904-4502-a6c4-c02d436cd8ac tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:25.925431 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7d98fccc-5904-4502-a6c4-c02d436cd8ac tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:25:25.933238 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7d98fccc-5904-4502-a6c4-c02d436cd8ac tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1701 microversion: 2.1 time: 0.154323 Oct 26 14:25:25.933838 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3949/7872] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:25:25 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1701 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:25:26.957305 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2c52d30a-5c8e-4481-b788-c38841031567 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:25:26.958450 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2c52d30a-5c8e-4481-b788-c38841031567 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:25:26.965161 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2c52d30a-5c8e-4481-b788-c38841031567 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:26.965931 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2c52d30a-5c8e-4481-b788-c38841031567 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:26.966381 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2c52d30a-5c8e-4481-b788-c38841031567 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:26.967601 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2c52d30a-5c8e-4481-b788-c38841031567 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:26.968462 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2c52d30a-5c8e-4481-b788-c38841031567 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:26.968906 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2c52d30a-5c8e-4481-b788-c38841031567 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:27.115549 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2c52d30a-5c8e-4481-b788-c38841031567 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:25:27.127756 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2c52d30a-5c8e-4481-b788-c38841031567 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1696 microversion: 2.1 time: 0.174360 Oct 26 14:25:27.128921 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3924/7873] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:25:26 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1696 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:25:28.152924 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-abe312d2-9763-4994-a54f-34127c1557a2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:25:28.157184 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-abe312d2-9763-4994-a54f-34127c1557a2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:25:28.165421 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-abe312d2-9763-4994-a54f-34127c1557a2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:28.166281 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-abe312d2-9763-4994-a54f-34127c1557a2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:28.167395 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-abe312d2-9763-4994-a54f-34127c1557a2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:28.168347 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-abe312d2-9763-4994-a54f-34127c1557a2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:28.169038 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-abe312d2-9763-4994-a54f-34127c1557a2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:28.169725 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-abe312d2-9763-4994-a54f-34127c1557a2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:28.350655 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-abe312d2-9763-4994-a54f-34127c1557a2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:25:28.361691 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-abe312d2-9763-4994-a54f-34127c1557a2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1696 microversion: 2.1 time: 0.212773 Oct 26 14:25:28.366767 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-7ecce52e-0781-44c1-8cd0-0795912ab571 req-f0eed4ea-c592-40c1-a223-f2f47655aadb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "535eb280-08e2-4639-92bd-b939fe9b3623", "name": "network-vif-plugged", "status": "completed", "tag": "5fd7250c-04a4-4b75-b729-c9c47ef151ae"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:25:28.378614 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3950/7874] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:25:28 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1696 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:25:28.394626 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-7ecce52e-0781-44c1-8cd0-0795912ab571 req-f0eed4ea-c592-40c1-a223-f2f47655aadb service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:28.395129 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-7ecce52e-0781-44c1-8cd0-0795912ab571 req-f0eed4ea-c592-40c1-a223-f2f47655aadb service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:28.395715 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-7ecce52e-0781-44c1-8cd0-0795912ab571 req-f0eed4ea-c592-40c1-a223-f2f47655aadb service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:28.412821 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-7ecce52e-0781-44c1-8cd0-0795912ab571 req-f0eed4ea-c592-40c1-a223-f2f47655aadb service nova] Creating event network-vif-plugged:5fd7250c-04a4-4b75-b729-c9c47ef151ae for instance 535eb280-08e2-4639-92bd-b939fe9b3623 on n-h1-862686-1 Oct 26 14:25:28.419117 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-7ecce52e-0781-44c1-8cd0-0795912ab571 req-f0eed4ea-c592-40c1-a223-f2f47655aadb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056954 Oct 26 14:25:28.420517 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3925/7875] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 14:25:29.387997 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6b242b26-84c6-46dc-8942-47b8cb013e94 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:25:29.388631 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6b242b26-84c6-46dc-8942-47b8cb013e94 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:25:29.399937 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6b242b26-84c6-46dc-8942-47b8cb013e94 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:29.400816 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6b242b26-84c6-46dc-8942-47b8cb013e94 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:29.401449 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6b242b26-84c6-46dc-8942-47b8cb013e94 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:29.402689 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6b242b26-84c6-46dc-8942-47b8cb013e94 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:29.403172 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6b242b26-84c6-46dc-8942-47b8cb013e94 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:29.403656 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6b242b26-84c6-46dc-8942-47b8cb013e94 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:29.550639 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6b242b26-84c6-46dc-8942-47b8cb013e94 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:25:29.559371 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6b242b26-84c6-46dc-8942-47b8cb013e94 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1696 microversion: 2.1 time: 0.176730 Oct 26 14:25:29.560108 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3951/7876] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:25:29 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1696 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:25:30.587190 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f0eb068c-b9e9-47ab-93df-da7af5d29fae tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:25:30.587889 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f0eb068c-b9e9-47ab-93df-da7af5d29fae tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:25:30.598534 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f0eb068c-b9e9-47ab-93df-da7af5d29fae tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:30.599101 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f0eb068c-b9e9-47ab-93df-da7af5d29fae tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:30.599538 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f0eb068c-b9e9-47ab-93df-da7af5d29fae tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:30.600238 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f0eb068c-b9e9-47ab-93df-da7af5d29fae tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:30.600696 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f0eb068c-b9e9-47ab-93df-da7af5d29fae tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:30.601117 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f0eb068c-b9e9-47ab-93df-da7af5d29fae tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:30.769857 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f0eb068c-b9e9-47ab-93df-da7af5d29fae tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:25:30.778806 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f0eb068c-b9e9-47ab-93df-da7af5d29fae tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1696 microversion: 2.1 time: 0.196579 Oct 26 14:25:30.781318 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3926/7877] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:25:30 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1696 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:25:31.803938 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-97908573-fdc1-4698-bec5-250aadf54c94 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:25:31.804796 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-97908573-fdc1-4698-bec5-250aadf54c94 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:25:31.812494 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97908573-fdc1-4698-bec5-250aadf54c94 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:31.813334 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97908573-fdc1-4698-bec5-250aadf54c94 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:31.814060 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97908573-fdc1-4698-bec5-250aadf54c94 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:31.815061 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97908573-fdc1-4698-bec5-250aadf54c94 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:31.815773 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97908573-fdc1-4698-bec5-250aadf54c94 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:31.816579 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97908573-fdc1-4698-bec5-250aadf54c94 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:31.972102 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-97908573-fdc1-4698-bec5-250aadf54c94 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:25:31.984406 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-97908573-fdc1-4698-bec5-250aadf54c94 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1696 microversion: 2.1 time: 0.184258 Oct 26 14:25:31.985003 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3952/7878] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:25:31 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1696 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:25:33.008711 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dc87ec04-8bef-437c-a732-304f340395fd tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:25:33.010024 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-dc87ec04-8bef-437c-a732-304f340395fd tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:25:33.017088 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc87ec04-8bef-437c-a732-304f340395fd tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:33.017820 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc87ec04-8bef-437c-a732-304f340395fd tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:33.018435 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc87ec04-8bef-437c-a732-304f340395fd tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:33.019306 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc87ec04-8bef-437c-a732-304f340395fd tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:33.019938 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc87ec04-8bef-437c-a732-304f340395fd tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:33.020527 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc87ec04-8bef-437c-a732-304f340395fd tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:33.172422 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-dc87ec04-8bef-437c-a732-304f340395fd tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:25:33.180816 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-dc87ec04-8bef-437c-a732-304f340395fd tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1696 microversion: 2.1 time: 0.176009 Oct 26 14:25:33.181986 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3927/7879] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:25:33 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1696 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:25:34.205614 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-dc3a69ad-a392-4890-9a31-dba6bdb0cccc tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:25:34.207300 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-dc3a69ad-a392-4890-9a31-dba6bdb0cccc tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:25:34.214670 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc3a69ad-a392-4890-9a31-dba6bdb0cccc tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:34.217575 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc3a69ad-a392-4890-9a31-dba6bdb0cccc tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:34.217575 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc3a69ad-a392-4890-9a31-dba6bdb0cccc tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:34.217575 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc3a69ad-a392-4890-9a31-dba6bdb0cccc tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:34.217575 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc3a69ad-a392-4890-9a31-dba6bdb0cccc tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:34.218865 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc3a69ad-a392-4890-9a31-dba6bdb0cccc tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:34.364585 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-dc3a69ad-a392-4890-9a31-dba6bdb0cccc tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:25:34.375478 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-dc3a69ad-a392-4890-9a31-dba6bdb0cccc tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1696 microversion: 2.1 time: 0.174906 Oct 26 14:25:34.376082 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3953/7880] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:25:34 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1696 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:25:35.399300 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-627a6849-dacc-4089-aec2-fb34ca3538e6 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:25:35.399841 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-627a6849-dacc-4089-aec2-fb34ca3538e6 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:25:35.410839 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-627a6849-dacc-4089-aec2-fb34ca3538e6 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:35.411339 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-627a6849-dacc-4089-aec2-fb34ca3538e6 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:35.411848 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-627a6849-dacc-4089-aec2-fb34ca3538e6 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:35.412628 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-627a6849-dacc-4089-aec2-fb34ca3538e6 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:35.412991 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-627a6849-dacc-4089-aec2-fb34ca3538e6 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:35.413421 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-627a6849-dacc-4089-aec2-fb34ca3538e6 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:35.570558 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-627a6849-dacc-4089-aec2-fb34ca3538e6 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:25:35.580490 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-627a6849-dacc-4089-aec2-fb34ca3538e6 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1696 microversion: 2.1 time: 0.185317 Oct 26 14:25:35.581372 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3928/7881] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:25:35 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1696 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:25:36.605793 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8196e902-636b-4eec-adc9-e3c6f11d251f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:25:36.606481 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8196e902-636b-4eec-adc9-e3c6f11d251f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:25:36.618172 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8196e902-636b-4eec-adc9-e3c6f11d251f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:36.619374 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8196e902-636b-4eec-adc9-e3c6f11d251f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:36.620167 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8196e902-636b-4eec-adc9-e3c6f11d251f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:36.621097 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8196e902-636b-4eec-adc9-e3c6f11d251f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:36.621889 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8196e902-636b-4eec-adc9-e3c6f11d251f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:36.623734 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8196e902-636b-4eec-adc9-e3c6f11d251f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:36.846601 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8196e902-636b-4eec-adc9-e3c6f11d251f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:25:36.854384 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8196e902-636b-4eec-adc9-e3c6f11d251f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1678 microversion: 2.1 time: 0.252662 Oct 26 14:25:36.854976 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3954/7882] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:25:36 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1678 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:25:37.878692 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5d2ab087-a5d2-48df-bcbb-7363d93a8ac6 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:25:37.879314 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5d2ab087-a5d2-48df-bcbb-7363d93a8ac6 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:25:37.886217 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d2ab087-a5d2-48df-bcbb-7363d93a8ac6 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:37.886704 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d2ab087-a5d2-48df-bcbb-7363d93a8ac6 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:37.887148 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d2ab087-a5d2-48df-bcbb-7363d93a8ac6 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:37.887846 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d2ab087-a5d2-48df-bcbb-7363d93a8ac6 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:37.888310 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d2ab087-a5d2-48df-bcbb-7363d93a8ac6 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:37.889233 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5d2ab087-a5d2-48df-bcbb-7363d93a8ac6 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:38.027736 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5d2ab087-a5d2-48df-bcbb-7363d93a8ac6 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:25:38.035927 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5d2ab087-a5d2-48df-bcbb-7363d93a8ac6 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1678 microversion: 2.1 time: 0.161180 Oct 26 14:25:38.036504 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3929/7883] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:25:37 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:25:39.059819 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-336ffcc1-d9a6-4aa2-b140-3e749dece3e7 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:25:39.060448 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-336ffcc1-d9a6-4aa2-b140-3e749dece3e7 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:25:39.067798 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-336ffcc1-d9a6-4aa2-b140-3e749dece3e7 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:39.068293 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-336ffcc1-d9a6-4aa2-b140-3e749dece3e7 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:39.068745 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-336ffcc1-d9a6-4aa2-b140-3e749dece3e7 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:39.069449 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-336ffcc1-d9a6-4aa2-b140-3e749dece3e7 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:39.069943 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-336ffcc1-d9a6-4aa2-b140-3e749dece3e7 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:39.070385 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-336ffcc1-d9a6-4aa2-b140-3e749dece3e7 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:39.210066 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-336ffcc1-d9a6-4aa2-b140-3e749dece3e7 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:25:39.218675 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-336ffcc1-d9a6-4aa2-b140-3e749dece3e7 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1681 microversion: 2.1 time: 0.162794 Oct 26 14:25:39.219254 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3955/7884] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:25:39 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:25:39.243060 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-85f906ec-9f51-4f47-b9fe-620ecba375eb tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:25:39.243588 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-85f906ec-9f51-4f47-b9fe-620ecba375eb tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:25:39.251142 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-85f906ec-9f51-4f47-b9fe-620ecba375eb tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:39.251631 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-85f906ec-9f51-4f47-b9fe-620ecba375eb tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:39.252067 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-85f906ec-9f51-4f47-b9fe-620ecba375eb tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:39.252767 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-85f906ec-9f51-4f47-b9fe-620ecba375eb tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:39.253221 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-85f906ec-9f51-4f47-b9fe-620ecba375eb tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:39.253677 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-85f906ec-9f51-4f47-b9fe-620ecba375eb tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:39.347617 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-85f906ec-9f51-4f47-b9fe-620ecba375eb tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120597) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 26 14:25:39.415162 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-85f906ec-9f51-4f47-b9fe-620ecba375eb tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "POST /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623/action" status: 202 len: 0 microversion: 2.1 time: 0.175977 Oct 26 14:25:39.415785 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3930/7885] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 14:25:39 2022] POST /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 14:25:39.424581 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b091407b-f68d-447c-b742-bb4eb52b0529 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:25:39.425213 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b091407b-f68d-447c-b742-bb4eb52b0529 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:25:39.431388 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b091407b-f68d-447c-b742-bb4eb52b0529 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:39.431777 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b091407b-f68d-447c-b742-bb4eb52b0529 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:39.432203 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b091407b-f68d-447c-b742-bb4eb52b0529 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:39.432919 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b091407b-f68d-447c-b742-bb4eb52b0529 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:39.433397 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b091407b-f68d-447c-b742-bb4eb52b0529 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:39.433871 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b091407b-f68d-447c-b742-bb4eb52b0529 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:39.574902 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b091407b-f68d-447c-b742-bb4eb52b0529 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:25:39.583406 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b091407b-f68d-447c-b742-bb4eb52b0529 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1629 microversion: 2.1 time: 0.162991 Oct 26 14:25:39.584150 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3956/7886] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:25:39 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1629 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:25:40.314432 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-45342584-ac32-46ac-be81-2b3cf2307cf0 req-541424d0-d377-4ee3-82be-c09138edf9ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "535eb280-08e2-4639-92bd-b939fe9b3623", "name": "network-vif-unplugged", "status": "completed", "tag": "5fd7250c-04a4-4b75-b729-c9c47ef151ae"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:25:40.328060 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-45342584-ac32-46ac-be81-2b3cf2307cf0 req-541424d0-d377-4ee3-82be-c09138edf9ba service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:40.328751 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-45342584-ac32-46ac-be81-2b3cf2307cf0 req-541424d0-d377-4ee3-82be-c09138edf9ba service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:40.329379 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-45342584-ac32-46ac-be81-2b3cf2307cf0 req-541424d0-d377-4ee3-82be-c09138edf9ba service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:40.343601 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.compute.server_external_events [req-45342584-ac32-46ac-be81-2b3cf2307cf0 req-541424d0-d377-4ee3-82be-c09138edf9ba service nova] Unable to find a host for instance 535eb280-08e2-4639-92bd-b939fe9b3623. Dropping event network-vif-unplugged {{(pid=120597) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 26 14:25:40.344763 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-45342584-ac32-46ac-be81-2b3cf2307cf0 req-541424d0-d377-4ee3-82be-c09138edf9ba service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035417 Oct 26 14:25:40.346342 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3931/7887] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 26 14:25:40.606196 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e012f8ee-075f-43b6-80a6-d74152c660b3 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:25:40.606820 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e012f8ee-075f-43b6-80a6-d74152c660b3 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:25:40.614484 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e012f8ee-075f-43b6-80a6-d74152c660b3 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:40.614978 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e012f8ee-075f-43b6-80a6-d74152c660b3 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:40.615424 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e012f8ee-075f-43b6-80a6-d74152c660b3 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:40.616121 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e012f8ee-075f-43b6-80a6-d74152c660b3 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:40.616588 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e012f8ee-075f-43b6-80a6-d74152c660b3 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:40.617026 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e012f8ee-075f-43b6-80a6-d74152c660b3 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:40.751688 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e012f8ee-075f-43b6-80a6-d74152c660b3 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:25:40.759735 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e012f8ee-075f-43b6-80a6-d74152c660b3 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1687 microversion: 2.1 time: 0.157435 Oct 26 14:25:40.760320 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3957/7888] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:25:40 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:25:41.785403 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cb63bd19-9e2c-41a7-87e0-497bf1bd2591 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:25:41.786050 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cb63bd19-9e2c-41a7-87e0-497bf1bd2591 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:25:41.794886 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cb63bd19-9e2c-41a7-87e0-497bf1bd2591 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:41.795397 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cb63bd19-9e2c-41a7-87e0-497bf1bd2591 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:41.796090 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cb63bd19-9e2c-41a7-87e0-497bf1bd2591 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:41.797131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cb63bd19-9e2c-41a7-87e0-497bf1bd2591 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:41.797838 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cb63bd19-9e2c-41a7-87e0-497bf1bd2591 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:41.798448 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cb63bd19-9e2c-41a7-87e0-497bf1bd2591 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:41.821460 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-63cf8356-ff16-4e35-9481-b480455a404f req-80e9939d-8871-4ca4-9825-c88a73bb437d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "535eb280-08e2-4639-92bd-b939fe9b3623", "tag": "5fd7250c-04a4-4b75-b729-c9c47ef151ae"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:25:41.832542 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-63cf8356-ff16-4e35-9481-b480455a404f req-80e9939d-8871-4ca4-9825-c88a73bb437d service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:41.833110 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-63cf8356-ff16-4e35-9481-b480455a404f req-80e9939d-8871-4ca4-9825-c88a73bb437d service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:41.833674 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-63cf8356-ff16-4e35-9481-b480455a404f req-80e9939d-8871-4ca4-9825-c88a73bb437d service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:41.849844 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-63cf8356-ff16-4e35-9481-b480455a404f req-80e9939d-8871-4ca4-9825-c88a73bb437d service nova] Creating event network-changed:5fd7250c-04a4-4b75-b729-c9c47ef151ae for instance 535eb280-08e2-4639-92bd-b939fe9b3623 on n-h2-862686-1 Oct 26 14:25:41.854908 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-63cf8356-ff16-4e35-9481-b480455a404f req-80e9939d-8871-4ca4-9825-c88a73bb437d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100592 Oct 26 14:25:41.859556 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3932/7889] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:25:41.957305 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-cb63bd19-9e2c-41a7-87e0-497bf1bd2591 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:25:41.965405 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cb63bd19-9e2c-41a7-87e0-497bf1bd2591 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1687 microversion: 2.1 time: 0.184616 Oct 26 14:25:41.966199 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3958/7890] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:25:41 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1687 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 14:25:43.000619 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5a7afc07-086a-4c01-9102-c085e06af485 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:25:43.003187 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5a7afc07-086a-4c01-9102-c085e06af485 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:25:43.012604 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5a7afc07-086a-4c01-9102-c085e06af485 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:43.013353 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5a7afc07-086a-4c01-9102-c085e06af485 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:43.013888 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5a7afc07-086a-4c01-9102-c085e06af485 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:43.014573 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5a7afc07-086a-4c01-9102-c085e06af485 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:43.015206 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5a7afc07-086a-4c01-9102-c085e06af485 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:43.015634 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5a7afc07-086a-4c01-9102-c085e06af485 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:43.035699 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:25:43.169933 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5a7afc07-086a-4c01-9102-c085e06af485 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:25:43.179763 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5a7afc07-086a-4c01-9102-c085e06af485 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1687 microversion: 2.1 time: 0.193997 Oct 26 14:25:43.181020 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3933/7891] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:25:42 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1687 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:25:44.208926 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cf15c441-3d15-48ca-b7a3-9f881b7eb904 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:25:44.210393 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cf15c441-3d15-48ca-b7a3-9f881b7eb904 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:25:44.213509 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=31 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:25:44.220751 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf15c441-3d15-48ca-b7a3-9f881b7eb904 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:44.221691 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf15c441-3d15-48ca-b7a3-9f881b7eb904 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:44.222509 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf15c441-3d15-48ca-b7a3-9f881b7eb904 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:44.223606 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf15c441-3d15-48ca-b7a3-9f881b7eb904 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:44.224388 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf15c441-3d15-48ca-b7a3-9f881b7eb904 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:44.224910 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf15c441-3d15-48ca-b7a3-9f881b7eb904 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:44.228857 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=91 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:25:44.363164 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-cf15c441-3d15-48ca-b7a3-9f881b7eb904 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:25:44.370963 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cf15c441-3d15-48ca-b7a3-9f881b7eb904 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1687 microversion: 2.1 time: 0.168130 Oct 26 14:25:44.371536 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3959/7892] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:25:44 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1687 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:25:45.396439 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f4f6275e-a4e3-4b72-bf93-31948df2647b tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:25:45.397046 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f4f6275e-a4e3-4b72-bf93-31948df2647b tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:25:45.399497 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:25:45.406250 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f4f6275e-a4e3-4b72-bf93-31948df2647b tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:45.406735 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f4f6275e-a4e3-4b72-bf93-31948df2647b tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:45.407171 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f4f6275e-a4e3-4b72-bf93-31948df2647b tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:45.407859 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f4f6275e-a4e3-4b72-bf93-31948df2647b tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:45.408309 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f4f6275e-a4e3-4b72-bf93-31948df2647b tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:45.408730 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f4f6275e-a4e3-4b72-bf93-31948df2647b tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:45.565785 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f4f6275e-a4e3-4b72-bf93-31948df2647b tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:25:45.574572 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f4f6275e-a4e3-4b72-bf93-31948df2647b tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1687 microversion: 2.1 time: 0.181932 Oct 26 14:25:45.592829 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3934/7893] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:25:45 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1687 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:25:46.601927 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7286c9ce-9ecf-4d6a-a808-4cec4b79ba23 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:25:46.603612 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7286c9ce-9ecf-4d6a-a808-4cec4b79ba23 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:25:46.616964 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7286c9ce-9ecf-4d6a-a808-4cec4b79ba23 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:46.617608 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7286c9ce-9ecf-4d6a-a808-4cec4b79ba23 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:46.618131 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7286c9ce-9ecf-4d6a-a808-4cec4b79ba23 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:46.618890 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7286c9ce-9ecf-4d6a-a808-4cec4b79ba23 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:46.619363 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7286c9ce-9ecf-4d6a-a808-4cec4b79ba23 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:46.619802 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7286c9ce-9ecf-4d6a-a808-4cec4b79ba23 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:46.773011 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7286c9ce-9ecf-4d6a-a808-4cec4b79ba23 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:25:46.782535 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7286c9ce-9ecf-4d6a-a808-4cec4b79ba23 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1687 microversion: 2.1 time: 0.185598 Oct 26 14:25:46.783341 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3960/7894] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:25:46 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1687 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 14:25:47.808404 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-518a6030-e0fc-4bd0-8dd9-fe03b8a55438 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:25:47.809018 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-518a6030-e0fc-4bd0-8dd9-fe03b8a55438 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:25:47.819019 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-518a6030-e0fc-4bd0-8dd9-fe03b8a55438 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:47.819520 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-518a6030-e0fc-4bd0-8dd9-fe03b8a55438 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:47.820139 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-518a6030-e0fc-4bd0-8dd9-fe03b8a55438 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:47.821215 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-518a6030-e0fc-4bd0-8dd9-fe03b8a55438 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:47.822125 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-518a6030-e0fc-4bd0-8dd9-fe03b8a55438 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:47.822621 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-518a6030-e0fc-4bd0-8dd9-fe03b8a55438 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:47.991271 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-518a6030-e0fc-4bd0-8dd9-fe03b8a55438 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:25:48.005687 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-518a6030-e0fc-4bd0-8dd9-fe03b8a55438 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1687 microversion: 2.1 time: 0.200696 Oct 26 14:25:48.018035 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3935/7895] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:25:47 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1687 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 14:25:49.039190 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fc9d0b4d-01f0-434d-b679-44f647c8b54a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:25:49.039914 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fc9d0b4d-01f0-434d-b679-44f647c8b54a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:25:49.047496 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fc9d0b4d-01f0-434d-b679-44f647c8b54a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:49.047999 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fc9d0b4d-01f0-434d-b679-44f647c8b54a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:49.048454 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fc9d0b4d-01f0-434d-b679-44f647c8b54a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:49.049167 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fc9d0b4d-01f0-434d-b679-44f647c8b54a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:49.049688 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fc9d0b4d-01f0-434d-b679-44f647c8b54a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:49.050125 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fc9d0b4d-01f0-434d-b679-44f647c8b54a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:49.193622 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fc9d0b4d-01f0-434d-b679-44f647c8b54a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:25:49.203319 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fc9d0b4d-01f0-434d-b679-44f647c8b54a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1687 microversion: 2.1 time: 0.168045 Oct 26 14:25:49.218693 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3961/7896] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:25:49 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1687 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:25:50.228245 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f65a00db-ca9d-43db-a565-13edab461a67 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:25:50.228894 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f65a00db-ca9d-43db-a565-13edab461a67 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:25:50.237015 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f65a00db-ca9d-43db-a565-13edab461a67 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:50.237519 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f65a00db-ca9d-43db-a565-13edab461a67 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:50.237970 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f65a00db-ca9d-43db-a565-13edab461a67 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:50.238679 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f65a00db-ca9d-43db-a565-13edab461a67 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:50.239141 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f65a00db-ca9d-43db-a565-13edab461a67 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:50.239574 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f65a00db-ca9d-43db-a565-13edab461a67 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:50.377516 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f65a00db-ca9d-43db-a565-13edab461a67 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:25:50.385343 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f65a00db-ca9d-43db-a565-13edab461a67 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1687 microversion: 2.1 time: 0.161015 Oct 26 14:25:50.385973 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3936/7897] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:25:50 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1687 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:25:51.411188 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-604d3f93-d23b-4968-9f75-6e0b7a998f05 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:25:51.411848 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-604d3f93-d23b-4968-9f75-6e0b7a998f05 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:25:51.419184 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-604d3f93-d23b-4968-9f75-6e0b7a998f05 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:51.419686 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-604d3f93-d23b-4968-9f75-6e0b7a998f05 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:51.420139 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-604d3f93-d23b-4968-9f75-6e0b7a998f05 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:51.421451 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-604d3f93-d23b-4968-9f75-6e0b7a998f05 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:51.422598 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-604d3f93-d23b-4968-9f75-6e0b7a998f05 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:51.423046 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-604d3f93-d23b-4968-9f75-6e0b7a998f05 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:51.564911 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-604d3f93-d23b-4968-9f75-6e0b7a998f05 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:25:51.572980 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-604d3f93-d23b-4968-9f75-6e0b7a998f05 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1687 microversion: 2.1 time: 0.165787 Oct 26 14:25:51.573587 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3962/7898] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:25:51 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1687 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:25:52.596991 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cf6e6fa2-c74d-4081-afdc-4bb5841b4d47 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:25:52.597650 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cf6e6fa2-c74d-4081-afdc-4bb5841b4d47 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:25:52.604429 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf6e6fa2-c74d-4081-afdc-4bb5841b4d47 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:52.604898 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf6e6fa2-c74d-4081-afdc-4bb5841b4d47 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:52.605397 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf6e6fa2-c74d-4081-afdc-4bb5841b4d47 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:52.606125 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf6e6fa2-c74d-4081-afdc-4bb5841b4d47 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:52.606584 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf6e6fa2-c74d-4081-afdc-4bb5841b4d47 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:52.607012 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cf6e6fa2-c74d-4081-afdc-4bb5841b4d47 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:52.740118 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-cf6e6fa2-c74d-4081-afdc-4bb5841b4d47 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:25:52.747912 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cf6e6fa2-c74d-4081-afdc-4bb5841b4d47 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1687 microversion: 2.1 time: 0.155421 Oct 26 14:25:52.748487 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3937/7899] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:25:52 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1687 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:25:53.771757 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9e70ff15-0f4a-4881-8df2-4b1f0b8dc311 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:25:53.772392 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9e70ff15-0f4a-4881-8df2-4b1f0b8dc311 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:25:53.779342 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e70ff15-0f4a-4881-8df2-4b1f0b8dc311 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:53.779848 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e70ff15-0f4a-4881-8df2-4b1f0b8dc311 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:53.780905 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e70ff15-0f4a-4881-8df2-4b1f0b8dc311 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:53.781664 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e70ff15-0f4a-4881-8df2-4b1f0b8dc311 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:53.782149 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e70ff15-0f4a-4881-8df2-4b1f0b8dc311 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:53.782603 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e70ff15-0f4a-4881-8df2-4b1f0b8dc311 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:53.922922 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9e70ff15-0f4a-4881-8df2-4b1f0b8dc311 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:25:53.930719 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9e70ff15-0f4a-4881-8df2-4b1f0b8dc311 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1687 microversion: 2.1 time: 0.163036 Oct 26 14:25:53.931302 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3963/7900] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:25:53 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1687 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:25:54.954103 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e62923fe-8495-4108-ba65-b19e2d7d11a6 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:25:54.954656 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e62923fe-8495-4108-ba65-b19e2d7d11a6 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:25:54.961475 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e62923fe-8495-4108-ba65-b19e2d7d11a6 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:54.961995 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e62923fe-8495-4108-ba65-b19e2d7d11a6 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:54.962439 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e62923fe-8495-4108-ba65-b19e2d7d11a6 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:54.963134 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e62923fe-8495-4108-ba65-b19e2d7d11a6 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:54.963597 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e62923fe-8495-4108-ba65-b19e2d7d11a6 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:54.964031 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e62923fe-8495-4108-ba65-b19e2d7d11a6 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:55.098825 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e62923fe-8495-4108-ba65-b19e2d7d11a6 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:25:55.106506 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e62923fe-8495-4108-ba65-b19e2d7d11a6 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1687 microversion: 2.1 time: 0.156500 Oct 26 14:25:55.107079 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3938/7901] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:25:54 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:25:56.131380 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-61036891-3258-41a5-bfec-21631da6fddf tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:25:56.131933 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-61036891-3258-41a5-bfec-21631da6fddf tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:25:56.138634 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-61036891-3258-41a5-bfec-21631da6fddf tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:56.139129 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-61036891-3258-41a5-bfec-21631da6fddf tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:56.139578 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-61036891-3258-41a5-bfec-21631da6fddf tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:56.140808 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-61036891-3258-41a5-bfec-21631da6fddf tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:56.141291 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-61036891-3258-41a5-bfec-21631da6fddf tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:56.141758 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-61036891-3258-41a5-bfec-21631da6fddf tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:56.275920 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-61036891-3258-41a5-bfec-21631da6fddf tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:25:56.285623 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-61036891-3258-41a5-bfec-21631da6fddf tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1687 microversion: 2.1 time: 0.158244 Oct 26 14:25:56.286206 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3964/7902] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:25:56 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1687 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:25:57.309935 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fbff6c85-3018-4124-abb5-d641b4ce75fe tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:25:57.310550 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fbff6c85-3018-4124-abb5-d641b4ce75fe tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:25:57.318328 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fbff6c85-3018-4124-abb5-d641b4ce75fe tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:57.318805 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fbff6c85-3018-4124-abb5-d641b4ce75fe tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:57.319240 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fbff6c85-3018-4124-abb5-d641b4ce75fe tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:57.319984 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fbff6c85-3018-4124-abb5-d641b4ce75fe tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:57.320434 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fbff6c85-3018-4124-abb5-d641b4ce75fe tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:57.320855 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fbff6c85-3018-4124-abb5-d641b4ce75fe tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:57.454194 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fbff6c85-3018-4124-abb5-d641b4ce75fe tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:25:57.463379 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fbff6c85-3018-4124-abb5-d641b4ce75fe tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1687 microversion: 2.1 time: 0.157362 Oct 26 14:25:57.463964 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3939/7903] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:25:57 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:25:57.574430 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-7f715ba8-f35a-4921-9a4d-460adebdd451 req-5d113456-8aef-43e5-9653-6fd7657ccb90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "535eb280-08e2-4639-92bd-b939fe9b3623", "name": "network-vif-plugged", "status": "completed", "tag": "5fd7250c-04a4-4b75-b729-c9c47ef151ae"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:25:57.585199 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-7f715ba8-f35a-4921-9a4d-460adebdd451 req-5d113456-8aef-43e5-9653-6fd7657ccb90 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:57.585738 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-7f715ba8-f35a-4921-9a4d-460adebdd451 req-5d113456-8aef-43e5-9653-6fd7657ccb90 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:57.586189 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-7f715ba8-f35a-4921-9a4d-460adebdd451 req-5d113456-8aef-43e5-9653-6fd7657ccb90 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:57.597967 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-7f715ba8-f35a-4921-9a4d-460adebdd451 req-5d113456-8aef-43e5-9653-6fd7657ccb90 service nova] Creating event network-vif-plugged:5fd7250c-04a4-4b75-b729-c9c47ef151ae for instance 535eb280-08e2-4639-92bd-b939fe9b3623 on n-h2-862686-1 Oct 26 14:25:57.601536 n-d-862686-1 devstack@n-api.service[120598]: ERROR oslo.messaging._drivers.impl_rabbit [req-7f715ba8-f35a-4921-9a4d-460adebdd451 req-5d113456-8aef-43e5-9653-6fd7657ccb90 service nova] [772d4b27-d35f-4ae6-924a-6ffe7b858711] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 26 14:25:58.488270 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-697df72e-1af7-4b4f-91b2-979f5b87af9d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:25:58.488874 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-697df72e-1af7-4b4f-91b2-979f5b87af9d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:25:58.495645 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-697df72e-1af7-4b4f-91b2-979f5b87af9d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:58.496125 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-697df72e-1af7-4b4f-91b2-979f5b87af9d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:58.496570 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-697df72e-1af7-4b4f-91b2-979f5b87af9d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:58.497598 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-697df72e-1af7-4b4f-91b2-979f5b87af9d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:58.498057 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-697df72e-1af7-4b4f-91b2-979f5b87af9d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:58.498481 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-697df72e-1af7-4b4f-91b2-979f5b87af9d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:58.610268 n-d-862686-1 devstack@n-api.service[120598]: INFO oslo.messaging._drivers.impl_rabbit [req-7f715ba8-f35a-4921-9a4d-460adebdd451 req-5d113456-8aef-43e5-9653-6fd7657ccb90 service nova] [772d4b27-d35f-4ae6-924a-6ffe7b858711] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 38360. Oct 26 14:25:58.613829 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-7f715ba8-f35a-4921-9a4d-460adebdd451 req-5d113456-8aef-43e5-9653-6fd7657ccb90 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.044531 Oct 26 14:25:58.614457 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3965/7904] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:25:58.634218 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-697df72e-1af7-4b4f-91b2-979f5b87af9d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:25:58.643020 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-697df72e-1af7-4b4f-91b2-979f5b87af9d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1687 microversion: 2.1 time: 0.159187 Oct 26 14:25:58.643610 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3940/7905] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:25:58 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1687 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 14:25:59.668756 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2c447726-1028-4e03-ae8f-926bda8f11d3 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:25:59.669384 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2c447726-1028-4e03-ae8f-926bda8f11d3 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:25:59.676368 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2c447726-1028-4e03-ae8f-926bda8f11d3 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:59.676865 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2c447726-1028-4e03-ae8f-926bda8f11d3 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:59.677318 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2c447726-1028-4e03-ae8f-926bda8f11d3 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:59.678059 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2c447726-1028-4e03-ae8f-926bda8f11d3 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:25:59.678534 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2c447726-1028-4e03-ae8f-926bda8f11d3 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:25:59.679007 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2c447726-1028-4e03-ae8f-926bda8f11d3 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:25:59.811592 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2c447726-1028-4e03-ae8f-926bda8f11d3 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:25:59.820272 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2c447726-1028-4e03-ae8f-926bda8f11d3 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1687 microversion: 2.1 time: 0.157088 Oct 26 14:25:59.820851 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3966/7906] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:25:59 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:26:00.844451 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f7b11d02-006c-4c31-b8db-49855f7d7c1d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:26:00.845081 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f7b11d02-006c-4c31-b8db-49855f7d7c1d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:26:00.851856 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f7b11d02-006c-4c31-b8db-49855f7d7c1d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:26:00.852337 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f7b11d02-006c-4c31-b8db-49855f7d7c1d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:26:00.852772 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f7b11d02-006c-4c31-b8db-49855f7d7c1d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:26:00.853460 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f7b11d02-006c-4c31-b8db-49855f7d7c1d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:26:00.853937 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f7b11d02-006c-4c31-b8db-49855f7d7c1d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:26:00.854363 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f7b11d02-006c-4c31-b8db-49855f7d7c1d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:26:00.984477 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f7b11d02-006c-4c31-b8db-49855f7d7c1d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:26:00.992224 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f7b11d02-006c-4c31-b8db-49855f7d7c1d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1674 microversion: 2.1 time: 0.152100 Oct 26 14:26:00.992800 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3941/7907] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:26:00 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:27:17.636604 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=15 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:27:17.637387 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=43 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:27:17.638306 n-d-862686-1 devstack@n-api.service[120597]: ERROR oslo.messaging._drivers.impl_rabbit [-] [49d83c38-b9cd-4e3f-8d2d-83b99234c8c3] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 26 14:27:17.639056 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=15 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:27:17.639985 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=50 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:27:17.641453 n-d-862686-1 devstack@n-api.service[120597]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 14:27:17.641862 n-d-862686-1 devstack@n-api.service[120597]: Wed Oct 26 14:27:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.40) !!! Oct 26 14:27:17.642671 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1070193e-b496-4424-8029-f0aa6aacdb0e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:27:17.644326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1070193e-b496-4424-8029-f0aa6aacdb0e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:27:17.648566 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-bb5bc6d8-d007-454f-a374-f97841e1c475 req-24113e25-d9b2-40b4-9d40-845883f4b8ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "535eb280-08e2-4639-92bd-b939fe9b3623", "tag": "5fd7250c-04a4-4b75-b729-c9c47ef151ae"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:27:17.653143 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1070193e-b496-4424-8029-f0aa6aacdb0e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:17.653679 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1070193e-b496-4424-8029-f0aa6aacdb0e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:17.654140 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1070193e-b496-4424-8029-f0aa6aacdb0e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:17.654851 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1070193e-b496-4424-8029-f0aa6aacdb0e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:17.655321 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1070193e-b496-4424-8029-f0aa6aacdb0e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:17.655759 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1070193e-b496-4424-8029-f0aa6aacdb0e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:17.666137 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-bb5bc6d8-d007-454f-a374-f97841e1c475 req-24113e25-d9b2-40b4-9d40-845883f4b8ff service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:17.666647 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-bb5bc6d8-d007-454f-a374-f97841e1c475 req-24113e25-d9b2-40b4-9d40-845883f4b8ff service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:17.667328 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-bb5bc6d8-d007-454f-a374-f97841e1c475 req-24113e25-d9b2-40b4-9d40-845883f4b8ff service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:17.684312 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-bb5bc6d8-d007-454f-a374-f97841e1c475 req-24113e25-d9b2-40b4-9d40-845883f4b8ff service nova] Creating event network-changed:5fd7250c-04a4-4b75-b729-c9c47ef151ae for instance 535eb280-08e2-4639-92bd-b939fe9b3623 on n-h2-862686-1 Oct 26 14:27:17.686601 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1070193e-b496-4424-8029-f0aa6aacdb0e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 14:27:17.690106 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-bb5bc6d8-d007-454f-a374-f97841e1c475 req-24113e25-d9b2-40b4-9d40-845883f4b8ff service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053881 Oct 26 14:27:17.690635 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3942/7908] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:27:17.780916 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1070193e-b496-4424-8029-f0aa6aacdb0e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "DELETE /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 204 len: 0 microversion: 2.1 time: 0.147856 Oct 26 14:27:17.781840 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3967/7909] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 14:27:17 2022] DELETE /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 14:27:17.791159 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-aa29d0bb-38a4-4eae-be59-0b6a227cd38a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:27:17.791856 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-aa29d0bb-38a4-4eae-be59-0b6a227cd38a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:27:17.798490 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aa29d0bb-38a4-4eae-be59-0b6a227cd38a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:17.798976 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aa29d0bb-38a4-4eae-be59-0b6a227cd38a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:17.799410 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aa29d0bb-38a4-4eae-be59-0b6a227cd38a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:17.800272 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aa29d0bb-38a4-4eae-be59-0b6a227cd38a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:17.800725 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aa29d0bb-38a4-4eae-be59-0b6a227cd38a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:17.801146 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aa29d0bb-38a4-4eae-be59-0b6a227cd38a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:18.017406 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-aa29d0bb-38a4-4eae-be59-0b6a227cd38a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:27:18.025337 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-aa29d0bb-38a4-4eae-be59-0b6a227cd38a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1680 microversion: 2.1 time: 0.238811 Oct 26 14:27:18.026275 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3943/7910] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:27:17 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1680 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:27:19.050340 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9db6033b-e3f6-4a73-8821-6187a378b238 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:27:19.051095 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9db6033b-e3f6-4a73-8821-6187a378b238 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:27:19.058747 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9db6033b-e3f6-4a73-8821-6187a378b238 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:19.059244 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9db6033b-e3f6-4a73-8821-6187a378b238 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:19.059701 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9db6033b-e3f6-4a73-8821-6187a378b238 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:19.060486 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9db6033b-e3f6-4a73-8821-6187a378b238 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:19.060955 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9db6033b-e3f6-4a73-8821-6187a378b238 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:19.061394 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9db6033b-e3f6-4a73-8821-6187a378b238 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:19.253797 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9db6033b-e3f6-4a73-8821-6187a378b238 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:27:19.262271 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9db6033b-e3f6-4a73-8821-6187a378b238 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1680 microversion: 2.1 time: 0.216372 Oct 26 14:27:19.262861 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3968/7911] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:27:19 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1680 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:27:19.795748 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-5afa34d2-c32a-498d-9c4b-add851a7aa0a req-fd50a682-7c91-423c-93a7-5e3cc9e66d77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "535eb280-08e2-4639-92bd-b939fe9b3623", "name": "network-vif-deleted", "tag": "5fd7250c-04a4-4b75-b729-c9c47ef151ae"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:27:19.808773 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-5afa34d2-c32a-498d-9c4b-add851a7aa0a req-fd50a682-7c91-423c-93a7-5e3cc9e66d77 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:19.809261 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-5afa34d2-c32a-498d-9c4b-add851a7aa0a req-fd50a682-7c91-423c-93a7-5e3cc9e66d77 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:19.809733 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-5afa34d2-c32a-498d-9c4b-add851a7aa0a req-fd50a682-7c91-423c-93a7-5e3cc9e66d77 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:19.822764 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-5afa34d2-c32a-498d-9c4b-add851a7aa0a req-fd50a682-7c91-423c-93a7-5e3cc9e66d77 service nova] Creating event network-vif-deleted:5fd7250c-04a4-4b75-b729-c9c47ef151ae for instance 535eb280-08e2-4639-92bd-b939fe9b3623 on n-h2-862686-1 Oct 26 14:27:19.827849 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-5afa34d2-c32a-498d-9c4b-add851a7aa0a req-fd50a682-7c91-423c-93a7-5e3cc9e66d77 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036010 Oct 26 14:27:19.828460 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3944/7912] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:27:20.286846 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-57d630e4-bdc7-4d5e-a992-68e8e055e7d0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:27:20.287794 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-57d630e4-bdc7-4d5e-a992-68e8e055e7d0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:27:20.296080 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57d630e4-bdc7-4d5e-a992-68e8e055e7d0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:20.296709 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57d630e4-bdc7-4d5e-a992-68e8e055e7d0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:20.297294 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57d630e4-bdc7-4d5e-a992-68e8e055e7d0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:20.298180 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57d630e4-bdc7-4d5e-a992-68e8e055e7d0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:20.298894 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57d630e4-bdc7-4d5e-a992-68e8e055e7d0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:20.299478 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57d630e4-bdc7-4d5e-a992-68e8e055e7d0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:20.335683 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57d630e4-bdc7-4d5e-a992-68e8e055e7d0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:20.336290 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57d630e4-bdc7-4d5e-a992-68e8e055e7d0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:20.337205 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57d630e4-bdc7-4d5e-a992-68e8e055e7d0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:20.337855 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-57d630e4-bdc7-4d5e-a992-68e8e055e7d0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lazy-loading 'fault' on Instance uuid 535eb280-08e2-4639-92bd-b939fe9b3623 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 14:27:20.384759 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-57d630e4-bdc7-4d5e-a992-68e8e055e7d0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:27:20.391930 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-57d630e4-bdc7-4d5e-a992-68e8e055e7d0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 200 len: 1337 microversion: 2.1 time: 0.109129 Oct 26 14:27:20.392521 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3969/7913] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:27:20 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 1337 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:27:21.418676 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-59335b5c-d340-4919-8c22-1b41445104c0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:27:21.419373 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-59335b5c-d340-4919-8c22-1b41445104c0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: 535eb280-08e2-4639-92bd-b939fe9b3623] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:27:21.421525 n-d-862686-1 devstack@n-api.service[120597]: INFO oslo.messaging._drivers.impl_rabbit [-] [49d83c38-b9cd-4e3f-8d2d-83b99234c8c3] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 38450. Oct 26 14:27:21.427348 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59335b5c-d340-4919-8c22-1b41445104c0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:21.427916 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59335b5c-d340-4919-8c22-1b41445104c0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:21.428366 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59335b5c-d340-4919-8c22-1b41445104c0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:21.429064 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59335b5c-d340-4919-8c22-1b41445104c0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:21.429551 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59335b5c-d340-4919-8c22-1b41445104c0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:21.429980 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59335b5c-d340-4919-8c22-1b41445104c0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:21.444148 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-59335b5c-d340-4919-8c22-1b41445104c0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] HTTP exception thrown: Instance 535eb280-08e2-4639-92bd-b939fe9b3623 could not be found. Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-59335b5c-d340-4919-8c22-1b41445104c0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Request method failure captured: Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 HTTP/1.1 Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWULCb7XizaHX7hNRd8kc1P1Bxv_y00rLcAorSu3iD-twV0rhm5Lb4-TTUg5OYrVGZqap01eOstmCF3VlfQHy1i-5zPkl9B9XJVIjYh6Wu2n37NOX8Z39Yvpg4iOs4yn-gLezcQJt-QT-mcdPOPYscF6ZvMynroyZrUQI_vf2W4ppYCc Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: ccbff35dfa5d49dabac384d92e5ddea6 Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-TestShelveInstance-1444919419 Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ccbff35dfa5d49dabac384d92e5ddea6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ccbff35dfa5d49dabac384d92e5ddea6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ccbff35dfa5d49dabac384d92e5ddea6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ccbff35dfa5d49dabac384d92e5ddea6"}]}] Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-TestShelveInstance-1444919419 Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: ccbff35dfa5d49dabac384d92e5ddea6 Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-TestShelveInstance-1444919419 Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-TestShelveInstance-1444919419-project Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 926665a856ff4ab0883995386bc5b46a Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-TestShelveInstance-1444919419-project Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 535eb280-08e2-4639-92bd-b939fe9b3623 could not be found. Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '535eb280-08e2-4639-92bd-b939fe9b3623'} Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 535eb280-08e2-4639-92bd-b939fe9b3623 could not be found. Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 535eb280-08e2-4639-92bd-b939fe9b3623 could not be found. Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:27:21.445859 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:27:21.451436 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:27:21.451436 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:27:21.451436 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:27:21.451436 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 14:27:21.451436 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 14:27:21.451436 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 535eb280-08e2-4639-92bd-b939fe9b3623 could not be found. Oct 26 14:27:21.451436 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:27:21.451436 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-59335b5c-d340-4919-8c22-1b41445104c0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Returning 404 to user: Instance 535eb280-08e2-4639-92bd-b939fe9b3623 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 14:27:21.451436 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-59335b5c-d340-4919-8c22-1b41445104c0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623" status: 404 len: 111 microversion: 2.1 time: 0.034855 Oct 26 14:27:21.451436 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3945/7914] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:27:21 2022] GET /compute/v2.1/servers/535eb280-08e2-4639-92bd-b939fe9b3623 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 14:27:21.610936 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ec693c7e-2797-43a1-8a50-f2354bd75018 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '.version_select at 0x7f67317c4940>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:27:21.636082 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ec693c7e-2797-43a1-8a50-f2354bd75018 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2005565263" status: 202 len: 0 microversion: 2.1 time: 0.029145 Oct 26 14:27:21.636688 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3970/7915] 10.222.0.40 () {58 vars in 1254 bytes} [Wed Oct 26 14:27:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2005565263 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 14:27:21.660655 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-426ededa-5ac3-47dc-851a-965ad0108427 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Action: 'create', calling method: .version_select at 0x7f6731424040>, body: {"keypair": {"name": "tempest-TestShelveInstance-1506831500", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP8AzGnL6pe2I9zyRl/lsx04ObMMPibnXgCFat6YiC1BXjOydabq5nwhwhPv5n2ye+ESY6ve3xQgZ88//Eom1klTIyVFpxaFUHRrU6sXM6m7TjAEuujBxX6BLevh7NHXfQ=="}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:27:21.677382 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-426ededa-5ac3-47dc-851a-965ad0108427 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Getting quotas for project ccbff35dfa5d49dabac384d92e5ddea6. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 14:27:21.682708 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-426ededa-5ac3-47dc-851a-965ad0108427 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Getting quotas for user 926665a856ff4ab0883995386bc5b46a and project ccbff35dfa5d49dabac384d92e5ddea6. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 14:27:21.710058 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-426ededa-5ac3-47dc-851a-965ad0108427 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.053338 Oct 26 14:27:21.710666 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3946/7916] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 14:27:21 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:27:37.869197 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:27:37.869981 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:27:37.875221 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-61680a72-e4df-4f36-a636-224db7c57571 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1150777664", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1506831500", "security_groups": [{"name": "tempest-secgroup-smoke-1172888884"}], "networks": [{"uuid": "28223c2e-0f8a-4645-98bc-7fd16d77390f"}], "block_device_mapping_v2": [{"uuid": "cbedde80-199e-4fb1-ae8b-40a35d95e0d5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:27:37.989312 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-61680a72-e4df-4f36-a636-224db7c57571 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] validate_networks() for [('28223c2e-0f8a-4645-98bc-7fd16d77390f', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 14:27:38.397344 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-61680a72-e4df-4f36-a636-224db7c57571 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 14:27:38.397932 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-61680a72-e4df-4f36-a636-224db7c57571 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 14:27:38.398474 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-61680a72-e4df-4f36-a636-224db7c57571 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 14:27:38.399002 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-61680a72-e4df-4f36-a636-224db7c57571 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 14:27:38.399497 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-61680a72-e4df-4f36-a636-224db7c57571 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 14:27:38.409436 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-61680a72-e4df-4f36-a636-224db7c57571 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:38.409965 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-61680a72-e4df-4f36-a636-224db7c57571 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:38.410413 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-61680a72-e4df-4f36-a636-224db7c57571 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:38.411152 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-61680a72-e4df-4f36-a636-224db7c57571 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:38.411623 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-61680a72-e4df-4f36-a636-224db7c57571 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:38.412065 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-61680a72-e4df-4f36-a636-224db7c57571 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:38.429914 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-61680a72-e4df-4f36-a636-224db7c57571 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Getting quotas for project ccbff35dfa5d49dabac384d92e5ddea6. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 14:27:38.435085 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-61680a72-e4df-4f36-a636-224db7c57571 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Getting quotas for user 926665a856ff4ab0883995386bc5b46a and project ccbff35dfa5d49dabac384d92e5ddea6. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 14:27:38.494006 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-61680a72-e4df-4f36-a636-224db7c57571 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 14:27:38.496802 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-61680a72-e4df-4f36-a636-224db7c57571 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cbedde80-199e-4fb1-ae8b-40a35d95e0d5',volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 14:27:38.619492 n-d-862686-1 devstack@n-api.service[120598]: ERROR oslo.messaging._drivers.impl_rabbit [None req-61680a72-e4df-4f36-a636-224db7c57571 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [a19bc7ee-b554-454e-9109-925b78fc62ba] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 26 14:27:39.628448 n-d-862686-1 devstack@n-api.service[120598]: INFO oslo.messaging._drivers.impl_rabbit [None req-61680a72-e4df-4f36-a636-224db7c57571 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [a19bc7ee-b554-454e-9109-925b78fc62ba] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 38616. Oct 26 14:27:39.633107 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-61680a72-e4df-4f36-a636-224db7c57571 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.765785 Oct 26 14:27:39.633810 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3971/7917] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 14:27:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 1767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 14:27:39.642815 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=12 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:27:39.643580 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=4 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:27:39.644353 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:27:39.649092 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d595c488-4559-4733-aa88-1fef74789aee tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:27:39.649763 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d595c488-4559-4733-aa88-1fef74789aee tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:27:39.708018 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d595c488-4559-4733-aa88-1fef74789aee tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:27:39.715674 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d595c488-4559-4733-aa88-1fef74789aee tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1089 microversion: 2.1 time: 0.073964 Oct 26 14:27:39.716249 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3947/7918] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:27:39 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1089 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:27:40.740529 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b9c256b7-809e-4dd7-9334-d30ffd59eea0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:27:40.741084 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b9c256b7-809e-4dd7-9334-d30ffd59eea0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:27:40.747692 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9c256b7-809e-4dd7-9334-d30ffd59eea0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:40.748204 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9c256b7-809e-4dd7-9334-d30ffd59eea0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:40.748666 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9c256b7-809e-4dd7-9334-d30ffd59eea0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:40.749382 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9c256b7-809e-4dd7-9334-d30ffd59eea0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:40.749896 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9c256b7-809e-4dd7-9334-d30ffd59eea0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:40.750341 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9c256b7-809e-4dd7-9334-d30ffd59eea0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:40.814563 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b9c256b7-809e-4dd7-9334-d30ffd59eea0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:27:40.822301 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b9c256b7-809e-4dd7-9334-d30ffd59eea0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1187 microversion: 2.1 time: 0.086750 Oct 26 14:27:40.822871 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3972/7919] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:27:40 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1187 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:27:41.847914 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a69d20e3-c3c6-4c3b-a402-5bd36b0668a2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:27:41.848461 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a69d20e3-c3c6-4c3b-a402-5bd36b0668a2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:27:41.858250 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a69d20e3-c3c6-4c3b-a402-5bd36b0668a2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:41.866098 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a69d20e3-c3c6-4c3b-a402-5bd36b0668a2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:41.867002 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a69d20e3-c3c6-4c3b-a402-5bd36b0668a2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:41.867833 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a69d20e3-c3c6-4c3b-a402-5bd36b0668a2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:41.869105 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a69d20e3-c3c6-4c3b-a402-5bd36b0668a2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:41.869799 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a69d20e3-c3c6-4c3b-a402-5bd36b0668a2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:42.022172 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a69d20e3-c3c6-4c3b-a402-5bd36b0668a2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:27:42.031111 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a69d20e3-c3c6-4c3b-a402-5bd36b0668a2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1273 microversion: 2.1 time: 0.187554 Oct 26 14:27:42.031708 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3948/7920] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:27:41 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1273 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:27:42.356141 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-637c760b-30c4-45a8-94fb-2be7258ef3f7 req-7b5eed83-5dd6-48b2-a8ae-e9c287b2d2d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8a514d9-3e8c-4303-b297-392601074662", "tag": "3c5c1507-9ffe-41ce-a3c0-6be2ebd11393"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:27:42.383320 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-637c760b-30c4-45a8-94fb-2be7258ef3f7 req-7b5eed83-5dd6-48b2-a8ae-e9c287b2d2d8 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:42.383908 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-637c760b-30c4-45a8-94fb-2be7258ef3f7 req-7b5eed83-5dd6-48b2-a8ae-e9c287b2d2d8 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:42.384465 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-637c760b-30c4-45a8-94fb-2be7258ef3f7 req-7b5eed83-5dd6-48b2-a8ae-e9c287b2d2d8 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:42.398023 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-637c760b-30c4-45a8-94fb-2be7258ef3f7 req-7b5eed83-5dd6-48b2-a8ae-e9c287b2d2d8 service nova] Creating event network-changed:3c5c1507-9ffe-41ce-a3c0-6be2ebd11393 for instance e8a514d9-3e8c-4303-b297-392601074662 on n-h1-862686-1 Oct 26 14:27:42.404489 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-637c760b-30c4-45a8-94fb-2be7258ef3f7 req-7b5eed83-5dd6-48b2-a8ae-e9c287b2d2d8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057438 Oct 26 14:27:42.405970 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3973/7921] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:27:43.055718 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2e11d177-b7d1-4a5d-b2ec-c6ec30843311 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:27:43.056200 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2e11d177-b7d1-4a5d-b2ec-c6ec30843311 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:27:43.064698 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e11d177-b7d1-4a5d-b2ec-c6ec30843311 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:43.065245 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e11d177-b7d1-4a5d-b2ec-c6ec30843311 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:43.065732 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e11d177-b7d1-4a5d-b2ec-c6ec30843311 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:43.066451 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e11d177-b7d1-4a5d-b2ec-c6ec30843311 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:43.066915 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e11d177-b7d1-4a5d-b2ec-c6ec30843311 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:43.067349 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e11d177-b7d1-4a5d-b2ec-c6ec30843311 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:43.208990 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2e11d177-b7d1-4a5d-b2ec-c6ec30843311 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:27:43.218446 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2e11d177-b7d1-4a5d-b2ec-c6ec30843311 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1273 microversion: 2.1 time: 0.167139 Oct 26 14:27:43.219028 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3949/7922] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:27:43 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1273 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 14:27:44.243086 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-129e4825-1b09-467d-b483-0f46b04925d5 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:27:44.243932 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-129e4825-1b09-467d-b483-0f46b04925d5 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:27:44.250227 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-129e4825-1b09-467d-b483-0f46b04925d5 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:44.250730 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-129e4825-1b09-467d-b483-0f46b04925d5 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:44.251179 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-129e4825-1b09-467d-b483-0f46b04925d5 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:44.251891 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-129e4825-1b09-467d-b483-0f46b04925d5 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:44.252366 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-129e4825-1b09-467d-b483-0f46b04925d5 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:44.252805 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-129e4825-1b09-467d-b483-0f46b04925d5 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:44.391059 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-129e4825-1b09-467d-b483-0f46b04925d5 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:27:44.400121 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-129e4825-1b09-467d-b483-0f46b04925d5 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1273 microversion: 2.1 time: 0.162052 Oct 26 14:27:44.400775 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3974/7923] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:27:44 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1273 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:27:45.423865 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c27111f4-4781-429f-8c55-85343d75f42b tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:27:45.424630 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c27111f4-4781-429f-8c55-85343d75f42b tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:27:45.432333 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c27111f4-4781-429f-8c55-85343d75f42b tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:45.432827 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c27111f4-4781-429f-8c55-85343d75f42b tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:45.433273 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c27111f4-4781-429f-8c55-85343d75f42b tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:45.434022 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c27111f4-4781-429f-8c55-85343d75f42b tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:45.434999 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c27111f4-4781-429f-8c55-85343d75f42b tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:45.435432 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c27111f4-4781-429f-8c55-85343d75f42b tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:45.574983 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c27111f4-4781-429f-8c55-85343d75f42b tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:27:45.583066 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c27111f4-4781-429f-8c55-85343d75f42b tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1273 microversion: 2.1 time: 0.163677 Oct 26 14:27:45.583847 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3950/7924] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:27:45 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1273 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:27:46.607369 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2882b054-81ba-42c8-9c0d-10f2d467ff0d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:27:46.608115 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2882b054-81ba-42c8-9c0d-10f2d467ff0d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:27:46.614785 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2882b054-81ba-42c8-9c0d-10f2d467ff0d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:46.615282 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2882b054-81ba-42c8-9c0d-10f2d467ff0d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:46.615735 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2882b054-81ba-42c8-9c0d-10f2d467ff0d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:46.616441 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2882b054-81ba-42c8-9c0d-10f2d467ff0d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:46.616911 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2882b054-81ba-42c8-9c0d-10f2d467ff0d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:46.617348 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2882b054-81ba-42c8-9c0d-10f2d467ff0d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:46.761658 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2882b054-81ba-42c8-9c0d-10f2d467ff0d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:27:46.769596 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2882b054-81ba-42c8-9c0d-10f2d467ff0d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1261 microversion: 2.1 time: 0.167202 Oct 26 14:27:46.770179 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3975/7925] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:27:46 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1261 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 14:27:47.794421 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ec8dc76e-5efe-4b4e-aedb-18cd4355e860 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:27:47.795010 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ec8dc76e-5efe-4b4e-aedb-18cd4355e860 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:27:47.801804 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ec8dc76e-5efe-4b4e-aedb-18cd4355e860 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:47.802287 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ec8dc76e-5efe-4b4e-aedb-18cd4355e860 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:47.802724 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ec8dc76e-5efe-4b4e-aedb-18cd4355e860 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:47.803410 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ec8dc76e-5efe-4b4e-aedb-18cd4355e860 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:47.803868 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ec8dc76e-5efe-4b4e-aedb-18cd4355e860 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:47.804296 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ec8dc76e-5efe-4b4e-aedb-18cd4355e860 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:47.941466 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ec8dc76e-5efe-4b4e-aedb-18cd4355e860 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:27:47.949503 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ec8dc76e-5efe-4b4e-aedb-18cd4355e860 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1261 microversion: 2.1 time: 0.159335 Oct 26 14:27:47.950700 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3951/7926] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:27:47 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:27:48.973089 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8e2fe37f-9e4e-4d30-b290-9b03ed9c99b9 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:27:48.973748 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8e2fe37f-9e4e-4d30-b290-9b03ed9c99b9 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:27:48.976573 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:27:48.977267 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:27:48.983840 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e2fe37f-9e4e-4d30-b290-9b03ed9c99b9 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:48.984343 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e2fe37f-9e4e-4d30-b290-9b03ed9c99b9 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:48.984800 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e2fe37f-9e4e-4d30-b290-9b03ed9c99b9 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:48.985535 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e2fe37f-9e4e-4d30-b290-9b03ed9c99b9 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:48.986015 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e2fe37f-9e4e-4d30-b290-9b03ed9c99b9 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:48.986459 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8e2fe37f-9e4e-4d30-b290-9b03ed9c99b9 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:49.116443 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-8e2fe37f-9e4e-4d30-b290-9b03ed9c99b9 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:27:49.124335 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8e2fe37f-9e4e-4d30-b290-9b03ed9c99b9 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1261 microversion: 2.1 time: 0.155226 Oct 26 14:27:49.124907 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3976/7927] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:27:48 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:27:50.148283 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e5359bda-0def-4eb5-9789-d8768b3dfdb8 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:27:50.148892 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e5359bda-0def-4eb5-9789-d8768b3dfdb8 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:27:50.151736 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:27:50.161070 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e5359bda-0def-4eb5-9789-d8768b3dfdb8 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:50.161623 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e5359bda-0def-4eb5-9789-d8768b3dfdb8 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:50.162065 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e5359bda-0def-4eb5-9789-d8768b3dfdb8 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:50.162770 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e5359bda-0def-4eb5-9789-d8768b3dfdb8 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:50.163238 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e5359bda-0def-4eb5-9789-d8768b3dfdb8 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:50.163681 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e5359bda-0def-4eb5-9789-d8768b3dfdb8 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:50.307798 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e5359bda-0def-4eb5-9789-d8768b3dfdb8 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:27:50.316545 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e5359bda-0def-4eb5-9789-d8768b3dfdb8 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1261 microversion: 2.1 time: 0.172384 Oct 26 14:27:50.317225 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3952/7928] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:27:50 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1261 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:27:51.341828 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-51e08851-ffd0-4100-ae4a-30665ef6eec1 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:27:51.342460 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-51e08851-ffd0-4100-ae4a-30665ef6eec1 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:27:51.349356 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-51e08851-ffd0-4100-ae4a-30665ef6eec1 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:51.349878 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-51e08851-ffd0-4100-ae4a-30665ef6eec1 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:51.350331 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-51e08851-ffd0-4100-ae4a-30665ef6eec1 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:51.351036 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-51e08851-ffd0-4100-ae4a-30665ef6eec1 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:51.351520 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-51e08851-ffd0-4100-ae4a-30665ef6eec1 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:51.351945 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-51e08851-ffd0-4100-ae4a-30665ef6eec1 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:51.489370 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-51e08851-ffd0-4100-ae4a-30665ef6eec1 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:27:51.498112 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-51e08851-ffd0-4100-ae4a-30665ef6eec1 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1261 microversion: 2.1 time: 0.159950 Oct 26 14:27:51.498705 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3977/7929] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:27:51 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:27:52.529882 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-021302d0-6da7-47d2-8d5e-94a5209815ce tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:27:52.530502 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-021302d0-6da7-47d2-8d5e-94a5209815ce tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:27:52.537408 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-021302d0-6da7-47d2-8d5e-94a5209815ce tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:52.537936 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-021302d0-6da7-47d2-8d5e-94a5209815ce tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:52.538386 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-021302d0-6da7-47d2-8d5e-94a5209815ce tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:52.539088 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-021302d0-6da7-47d2-8d5e-94a5209815ce tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:52.539554 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-021302d0-6da7-47d2-8d5e-94a5209815ce tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:52.539988 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-021302d0-6da7-47d2-8d5e-94a5209815ce tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:52.670479 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-021302d0-6da7-47d2-8d5e-94a5209815ce tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:27:52.678421 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-021302d0-6da7-47d2-8d5e-94a5209815ce tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1261 microversion: 2.1 time: 0.153249 Oct 26 14:27:52.679005 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3953/7930] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:27:52 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:27:53.702314 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f89172d2-7947-41f9-8438-db71fc0ac5ca tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:27:53.702952 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f89172d2-7947-41f9-8438-db71fc0ac5ca tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:27:53.709768 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f89172d2-7947-41f9-8438-db71fc0ac5ca tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:53.710260 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f89172d2-7947-41f9-8438-db71fc0ac5ca tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:53.710706 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f89172d2-7947-41f9-8438-db71fc0ac5ca tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:53.711407 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f89172d2-7947-41f9-8438-db71fc0ac5ca tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:53.711871 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f89172d2-7947-41f9-8438-db71fc0ac5ca tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:53.712305 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f89172d2-7947-41f9-8438-db71fc0ac5ca tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:53.843813 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f89172d2-7947-41f9-8438-db71fc0ac5ca tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:27:53.851601 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f89172d2-7947-41f9-8438-db71fc0ac5ca tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1261 microversion: 2.1 time: 0.153758 Oct 26 14:27:53.852184 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3978/7931] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:27:53 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:27:54.876396 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fa808c76-c52e-4e63-8bc0-537b6d13fd52 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:27:54.876997 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fa808c76-c52e-4e63-8bc0-537b6d13fd52 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:27:54.884027 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa808c76-c52e-4e63-8bc0-537b6d13fd52 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:54.884522 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa808c76-c52e-4e63-8bc0-537b6d13fd52 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:54.884965 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa808c76-c52e-4e63-8bc0-537b6d13fd52 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:54.885700 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa808c76-c52e-4e63-8bc0-537b6d13fd52 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:54.886162 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa808c76-c52e-4e63-8bc0-537b6d13fd52 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:54.886593 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa808c76-c52e-4e63-8bc0-537b6d13fd52 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:55.026271 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fa808c76-c52e-4e63-8bc0-537b6d13fd52 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:27:55.034329 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fa808c76-c52e-4e63-8bc0-537b6d13fd52 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1261 microversion: 2.1 time: 0.162749 Oct 26 14:27:55.034903 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3954/7932] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:27:54 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1261 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:27:56.057419 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4488218c-c9eb-4e1b-840f-04f1cfb6e9d9 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:27:56.058097 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4488218c-c9eb-4e1b-840f-04f1cfb6e9d9 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:27:56.065981 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4488218c-c9eb-4e1b-840f-04f1cfb6e9d9 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:56.066475 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4488218c-c9eb-4e1b-840f-04f1cfb6e9d9 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:56.066923 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4488218c-c9eb-4e1b-840f-04f1cfb6e9d9 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:56.067625 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4488218c-c9eb-4e1b-840f-04f1cfb6e9d9 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:56.068125 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4488218c-c9eb-4e1b-840f-04f1cfb6e9d9 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:56.068563 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4488218c-c9eb-4e1b-840f-04f1cfb6e9d9 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:56.201999 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4488218c-c9eb-4e1b-840f-04f1cfb6e9d9 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:27:56.209718 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4488218c-c9eb-4e1b-840f-04f1cfb6e9d9 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1261 microversion: 2.1 time: 0.156255 Oct 26 14:27:56.210289 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3979/7933] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:27:56 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:27:56.907361 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-1ce9cf5d-d332-4328-a647-4769be768d4a req-cb788e7e-0cfe-4470-b3cd-804954534715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8a514d9-3e8c-4303-b297-392601074662", "name": "network-vif-plugged", "status": "completed", "tag": "3c5c1507-9ffe-41ce-a3c0-6be2ebd11393"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:27:56.921598 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-1ce9cf5d-d332-4328-a647-4769be768d4a req-cb788e7e-0cfe-4470-b3cd-804954534715 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:56.922090 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-1ce9cf5d-d332-4328-a647-4769be768d4a req-cb788e7e-0cfe-4470-b3cd-804954534715 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:56.922529 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-1ce9cf5d-d332-4328-a647-4769be768d4a req-cb788e7e-0cfe-4470-b3cd-804954534715 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:56.933652 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-1ce9cf5d-d332-4328-a647-4769be768d4a req-cb788e7e-0cfe-4470-b3cd-804954534715 service nova] Creating event network-vif-plugged:3c5c1507-9ffe-41ce-a3c0-6be2ebd11393 for instance e8a514d9-3e8c-4303-b297-392601074662 on n-h1-862686-1 Oct 26 14:27:56.939378 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-1ce9cf5d-d332-4328-a647-4769be768d4a req-cb788e7e-0cfe-4470-b3cd-804954534715 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035896 Oct 26 14:27:56.940118 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3955/7934] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:27:57.233012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d419a3cd-03ec-4a98-a7b4-3791f8e03f77 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:27:57.233682 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d419a3cd-03ec-4a98-a7b4-3791f8e03f77 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:27:57.240524 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d419a3cd-03ec-4a98-a7b4-3791f8e03f77 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:57.241030 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d419a3cd-03ec-4a98-a7b4-3791f8e03f77 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:57.241535 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d419a3cd-03ec-4a98-a7b4-3791f8e03f77 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:57.242253 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d419a3cd-03ec-4a98-a7b4-3791f8e03f77 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:57.242729 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d419a3cd-03ec-4a98-a7b4-3791f8e03f77 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:57.243174 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d419a3cd-03ec-4a98-a7b4-3791f8e03f77 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:57.374993 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d419a3cd-03ec-4a98-a7b4-3791f8e03f77 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:27:57.383004 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d419a3cd-03ec-4a98-a7b4-3791f8e03f77 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1261 microversion: 2.1 time: 0.154006 Oct 26 14:27:57.383585 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3980/7935] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:27:57 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:27:58.408478 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ad34a941-a39a-4891-9529-f996e5be87f4 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:27:58.409221 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ad34a941-a39a-4891-9529-f996e5be87f4 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:27:58.415473 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad34a941-a39a-4891-9529-f996e5be87f4 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:58.415963 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad34a941-a39a-4891-9529-f996e5be87f4 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:58.416414 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad34a941-a39a-4891-9529-f996e5be87f4 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:58.417108 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad34a941-a39a-4891-9529-f996e5be87f4 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:58.417854 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad34a941-a39a-4891-9529-f996e5be87f4 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:58.418284 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad34a941-a39a-4891-9529-f996e5be87f4 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:58.548196 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ad34a941-a39a-4891-9529-f996e5be87f4 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:27:58.556057 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ad34a941-a39a-4891-9529-f996e5be87f4 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1444 microversion: 2.1 time: 0.152932 Oct 26 14:27:58.556639 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3956/7936] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:27:58 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1444 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:27:58.579666 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ee3f6428-fd0b-4036-8578-2fe6e812b524 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:27:58.580290 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ee3f6428-fd0b-4036-8578-2fe6e812b524 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:27:58.587067 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee3f6428-fd0b-4036-8578-2fe6e812b524 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:58.587565 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee3f6428-fd0b-4036-8578-2fe6e812b524 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:58.588013 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee3f6428-fd0b-4036-8578-2fe6e812b524 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:58.588710 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee3f6428-fd0b-4036-8578-2fe6e812b524 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:27:58.589175 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee3f6428-fd0b-4036-8578-2fe6e812b524 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:27:58.589645 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee3f6428-fd0b-4036-8578-2fe6e812b524 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:27:58.724248 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ee3f6428-fd0b-4036-8578-2fe6e812b524 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:27:58.732793 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ee3f6428-fd0b-4036-8578-2fe6e812b524 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1444 microversion: 2.1 time: 0.157590 Oct 26 14:27:58.733360 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3981/7937] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:27:58 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1444 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:28:00.590142 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-a0bf6d5a-7f43-4be8-b42d-45fe1aa2ff53 req-9076109b-a2f5-434d-b772-91c2c4d449b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8a514d9-3e8c-4303-b297-392601074662", "tag": "3c5c1507-9ffe-41ce-a3c0-6be2ebd11393"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:28:00.600399 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a0bf6d5a-7f43-4be8-b42d-45fe1aa2ff53 req-9076109b-a2f5-434d-b772-91c2c4d449b9 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:28:00.600882 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a0bf6d5a-7f43-4be8-b42d-45fe1aa2ff53 req-9076109b-a2f5-434d-b772-91c2c4d449b9 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:28:00.601316 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a0bf6d5a-7f43-4be8-b42d-45fe1aa2ff53 req-9076109b-a2f5-434d-b772-91c2c4d449b9 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:28:00.613317 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-a0bf6d5a-7f43-4be8-b42d-45fe1aa2ff53 req-9076109b-a2f5-434d-b772-91c2c4d449b9 service nova] Creating event network-changed:3c5c1507-9ffe-41ce-a3c0-6be2ebd11393 for instance e8a514d9-3e8c-4303-b297-392601074662 on n-h1-862686-1 Oct 26 14:28:00.619104 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-a0bf6d5a-7f43-4be8-b42d-45fe1aa2ff53 req-9076109b-a2f5-434d-b772-91c2c4d449b9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032813 Oct 26 14:28:00.619790 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3957/7938] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:29:56.912410 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:29:56.913208 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=58 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:29:56.965285 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d853d193-bc28-41d4-8f5c-c37e37dd0d5d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:29:56.965911 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d853d193-bc28-41d4-8f5c-c37e37dd0d5d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:29:56.971959 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d853d193-bc28-41d4-8f5c-c37e37dd0d5d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:29:56.972465 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d853d193-bc28-41d4-8f5c-c37e37dd0d5d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:29:56.972921 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d853d193-bc28-41d4-8f5c-c37e37dd0d5d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:29:56.973678 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d853d193-bc28-41d4-8f5c-c37e37dd0d5d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:29:56.974155 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d853d193-bc28-41d4-8f5c-c37e37dd0d5d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:29:56.974601 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d853d193-bc28-41d4-8f5c-c37e37dd0d5d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:29:56.997040 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-d853d193-bc28-41d4-8f5c-c37e37dd0d5d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lazy-loading 'flavor' on Instance uuid e8a514d9-3e8c-4303-b297-392601074662 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 14:29:57.068706 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d853d193-bc28-41d4-8f5c-c37e37dd0d5d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "POST /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662/action" status: 202 len: 0 microversion: 2.1 time: 0.158108 Oct 26 14:29:57.069347 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3982/7939] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 14:29:56 2022] POST /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 14:29:57.076928 n-d-862686-1 devstack@n-api.service[120597]: ERROR oslo.messaging._drivers.impl_rabbit [-] [49d83c38-b9cd-4e3f-8d2d-83b99234c8c3] AMQP server on 10.222.0.40:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 26 14:29:57.078344 n-d-862686-1 devstack@n-api.service[120597]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c037a1b0-cfe5-48ae-b7c7-2931306917f8] AMQP server on 10.222.0.40:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 26 14:29:57.079542 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=24 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:29:57.080453 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=52 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:29:57.082180 n-d-862686-1 devstack@n-api.service[120597]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 14:29:57.082437 n-d-862686-1 devstack@n-api.service[120597]: Wed Oct 26 14:29:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 (ip 10.222.0.40) !!! Oct 26 14:29:57.088832 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f989c562-72ee-4ae0-82ed-11fa47b70c0f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:29:57.089718 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f989c562-72ee-4ae0-82ed-11fa47b70c0f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:29:57.099350 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f989c562-72ee-4ae0-82ed-11fa47b70c0f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:29:57.099851 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f989c562-72ee-4ae0-82ed-11fa47b70c0f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:29:57.100306 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f989c562-72ee-4ae0-82ed-11fa47b70c0f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:29:57.101018 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f989c562-72ee-4ae0-82ed-11fa47b70c0f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:29:57.101512 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f989c562-72ee-4ae0-82ed-11fa47b70c0f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:29:57.101972 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f989c562-72ee-4ae0-82ed-11fa47b70c0f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:29:57.238322 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f989c562-72ee-4ae0-82ed-11fa47b70c0f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:29:57.246101 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f989c562-72ee-4ae0-82ed-11fa47b70c0f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1568 microversion: 2.1 time: 0.171263 Oct 26 14:29:57.246674 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3958/7940] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:29:57 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:29:58.272581 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-14772440-05a5-4fec-933f-c3d38f12041c tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:29:58.273393 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-14772440-05a5-4fec-933f-c3d38f12041c tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:29:58.279588 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-14772440-05a5-4fec-933f-c3d38f12041c tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:29:58.280079 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-14772440-05a5-4fec-933f-c3d38f12041c tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:29:58.280523 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-14772440-05a5-4fec-933f-c3d38f12041c tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:29:58.281219 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-14772440-05a5-4fec-933f-c3d38f12041c tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:29:58.281716 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-14772440-05a5-4fec-933f-c3d38f12041c tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:29:58.282900 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-14772440-05a5-4fec-933f-c3d38f12041c tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:29:58.422414 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-14772440-05a5-4fec-933f-c3d38f12041c tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:29:58.430325 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-14772440-05a5-4fec-933f-c3d38f12041c tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1568 microversion: 2.1 time: 0.164258 Oct 26 14:29:58.430925 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3983/7941] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:29:58 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:29:59.454122 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8a1dbee6-3612-44a8-b0ff-a5d8fe4ecf03 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:29:59.454729 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8a1dbee6-3612-44a8-b0ff-a5d8fe4ecf03 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:29:59.462964 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8a1dbee6-3612-44a8-b0ff-a5d8fe4ecf03 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:29:59.463458 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8a1dbee6-3612-44a8-b0ff-a5d8fe4ecf03 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:29:59.463899 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8a1dbee6-3612-44a8-b0ff-a5d8fe4ecf03 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:29:59.464624 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8a1dbee6-3612-44a8-b0ff-a5d8fe4ecf03 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:29:59.465120 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8a1dbee6-3612-44a8-b0ff-a5d8fe4ecf03 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:29:59.465599 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8a1dbee6-3612-44a8-b0ff-a5d8fe4ecf03 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:29:59.486057 n-d-862686-1 devstack@n-api.service[120597]: INFO oslo.messaging._drivers.impl_rabbit [-] [c037a1b0-cfe5-48ae-b7c7-2931306917f8] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 38718. Oct 26 14:29:59.486833 n-d-862686-1 devstack@n-api.service[120597]: INFO oslo.messaging._drivers.impl_rabbit [-] [49d83c38-b9cd-4e3f-8d2d-83b99234c8c3] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 38716. Oct 26 14:29:59.603243 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8a1dbee6-3612-44a8-b0ff-a5d8fe4ecf03 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:29:59.611286 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8a1dbee6-3612-44a8-b0ff-a5d8fe4ecf03 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1568 microversion: 2.1 time: 0.161218 Oct 26 14:29:59.611884 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3959/7942] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:29:59 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:30:00.635138 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3fffe50b-043f-4fe2-b6df-785b2ebf25e9 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:30:00.635710 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3fffe50b-043f-4fe2-b6df-785b2ebf25e9 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:30:00.642696 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3fffe50b-043f-4fe2-b6df-785b2ebf25e9 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:00.643200 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3fffe50b-043f-4fe2-b6df-785b2ebf25e9 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:00.643666 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3fffe50b-043f-4fe2-b6df-785b2ebf25e9 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:00.644378 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3fffe50b-043f-4fe2-b6df-785b2ebf25e9 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:00.644854 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3fffe50b-043f-4fe2-b6df-785b2ebf25e9 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:00.645301 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3fffe50b-043f-4fe2-b6df-785b2ebf25e9 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:00.779996 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3fffe50b-043f-4fe2-b6df-785b2ebf25e9 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:30:00.788868 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3fffe50b-043f-4fe2-b6df-785b2ebf25e9 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1568 microversion: 2.1 time: 0.157904 Oct 26 14:30:00.789506 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3984/7943] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:30:00 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:30:01.813758 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c56d0e57-06a6-4438-a973-62fd051ea0f2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:30:01.814418 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c56d0e57-06a6-4438-a973-62fd051ea0f2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:30:01.821258 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c56d0e57-06a6-4438-a973-62fd051ea0f2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:01.821779 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c56d0e57-06a6-4438-a973-62fd051ea0f2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:01.822230 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c56d0e57-06a6-4438-a973-62fd051ea0f2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:01.822929 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c56d0e57-06a6-4438-a973-62fd051ea0f2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:01.823398 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c56d0e57-06a6-4438-a973-62fd051ea0f2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:01.823830 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c56d0e57-06a6-4438-a973-62fd051ea0f2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:01.956096 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c56d0e57-06a6-4438-a973-62fd051ea0f2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:30:01.972298 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c56d0e57-06a6-4438-a973-62fd051ea0f2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1568 microversion: 2.1 time: 0.163094 Oct 26 14:30:01.973000 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3960/7944] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:30:01 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:30:02.997338 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f859aacd-aa44-44e5-8266-9fe4354e9cff tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:30:02.997914 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f859aacd-aa44-44e5-8266-9fe4354e9cff tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:30:03.005284 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f859aacd-aa44-44e5-8266-9fe4354e9cff tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:03.005817 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f859aacd-aa44-44e5-8266-9fe4354e9cff tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:03.006266 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f859aacd-aa44-44e5-8266-9fe4354e9cff tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:03.006965 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f859aacd-aa44-44e5-8266-9fe4354e9cff tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:03.007431 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f859aacd-aa44-44e5-8266-9fe4354e9cff tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:03.007865 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f859aacd-aa44-44e5-8266-9fe4354e9cff tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:03.138840 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f859aacd-aa44-44e5-8266-9fe4354e9cff tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:30:03.147106 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f859aacd-aa44-44e5-8266-9fe4354e9cff tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1568 microversion: 2.1 time: 0.153783 Oct 26 14:30:03.147676 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3985/7945] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:30:02 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:30:04.171435 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e3351c55-f20c-4fb7-ac26-b45bb05cfd29 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:30:04.172005 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e3351c55-f20c-4fb7-ac26-b45bb05cfd29 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:30:04.178901 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3351c55-f20c-4fb7-ac26-b45bb05cfd29 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:04.179393 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3351c55-f20c-4fb7-ac26-b45bb05cfd29 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:04.179836 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3351c55-f20c-4fb7-ac26-b45bb05cfd29 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:04.180538 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3351c55-f20c-4fb7-ac26-b45bb05cfd29 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:04.181009 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3351c55-f20c-4fb7-ac26-b45bb05cfd29 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:04.181502 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e3351c55-f20c-4fb7-ac26-b45bb05cfd29 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:04.309308 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e3351c55-f20c-4fb7-ac26-b45bb05cfd29 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:30:04.317373 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e3351c55-f20c-4fb7-ac26-b45bb05cfd29 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1568 microversion: 2.1 time: 0.150288 Oct 26 14:30:04.317973 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3961/7946] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:30:04 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:30:05.341245 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e71736a0-262e-4c0d-89bb-da83f806e69c tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:30:05.341875 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e71736a0-262e-4c0d-89bb-da83f806e69c tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:30:05.349171 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e71736a0-262e-4c0d-89bb-da83f806e69c tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:05.349713 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e71736a0-262e-4c0d-89bb-da83f806e69c tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:05.350165 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e71736a0-262e-4c0d-89bb-da83f806e69c tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:05.350871 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e71736a0-262e-4c0d-89bb-da83f806e69c tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:05.351338 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e71736a0-262e-4c0d-89bb-da83f806e69c tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:05.351777 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e71736a0-262e-4c0d-89bb-da83f806e69c tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:05.487965 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-e71736a0-262e-4c0d-89bb-da83f806e69c tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:30:05.495796 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e71736a0-262e-4c0d-89bb-da83f806e69c tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1568 microversion: 2.1 time: 0.158432 Oct 26 14:30:05.496378 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3986/7947] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:30:05 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:30:06.520341 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-16d0f49e-48a9-42bb-bb1b-ea7032f9b3d6 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:30:06.520959 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-16d0f49e-48a9-42bb-bb1b-ea7032f9b3d6 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:30:06.527912 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-16d0f49e-48a9-42bb-bb1b-ea7032f9b3d6 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:06.528402 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-16d0f49e-48a9-42bb-bb1b-ea7032f9b3d6 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:06.528843 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-16d0f49e-48a9-42bb-bb1b-ea7032f9b3d6 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:06.529557 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-16d0f49e-48a9-42bb-bb1b-ea7032f9b3d6 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:06.530024 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-16d0f49e-48a9-42bb-bb1b-ea7032f9b3d6 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:06.530482 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-16d0f49e-48a9-42bb-bb1b-ea7032f9b3d6 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:06.659505 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-16d0f49e-48a9-42bb-bb1b-ea7032f9b3d6 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:30:06.667311 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-16d0f49e-48a9-42bb-bb1b-ea7032f9b3d6 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1568 microversion: 2.1 time: 0.151487 Oct 26 14:30:06.667917 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3962/7948] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:30:06 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:30:07.691227 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2001f056-6be8-4790-8fdb-f398117c3670 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:30:07.692657 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2001f056-6be8-4790-8fdb-f398117c3670 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:30:07.700002 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2001f056-6be8-4790-8fdb-f398117c3670 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:07.700438 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2001f056-6be8-4790-8fdb-f398117c3670 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:07.700890 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2001f056-6be8-4790-8fdb-f398117c3670 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:07.701637 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2001f056-6be8-4790-8fdb-f398117c3670 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:07.702105 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2001f056-6be8-4790-8fdb-f398117c3670 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:07.702552 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2001f056-6be8-4790-8fdb-f398117c3670 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:07.893810 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2001f056-6be8-4790-8fdb-f398117c3670 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:30:07.901648 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2001f056-6be8-4790-8fdb-f398117c3670 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1568 microversion: 2.1 time: 0.214836 Oct 26 14:30:07.902227 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3987/7949] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:30:07 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1568 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:30:08.926615 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6f075316-2b95-4d0c-9211-81f5c14c2fe7 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:30:08.927241 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6f075316-2b95-4d0c-9211-81f5c14c2fe7 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:30:08.934220 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f075316-2b95-4d0c-9211-81f5c14c2fe7 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:08.934722 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f075316-2b95-4d0c-9211-81f5c14c2fe7 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:08.935170 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f075316-2b95-4d0c-9211-81f5c14c2fe7 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:08.935868 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f075316-2b95-4d0c-9211-81f5c14c2fe7 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:08.936332 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f075316-2b95-4d0c-9211-81f5c14c2fe7 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:08.936770 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f075316-2b95-4d0c-9211-81f5c14c2fe7 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:09.069456 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6f075316-2b95-4d0c-9211-81f5c14c2fe7 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:30:09.077222 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6f075316-2b95-4d0c-9211-81f5c14c2fe7 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1568 microversion: 2.1 time: 0.155307 Oct 26 14:30:09.077832 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3963/7950] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:30:08 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:30:10.102042 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fb8060e4-cabc-4563-8684-6b6e21271951 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:30:10.102619 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fb8060e4-cabc-4563-8684-6b6e21271951 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:30:10.110647 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fb8060e4-cabc-4563-8684-6b6e21271951 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:10.111190 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fb8060e4-cabc-4563-8684-6b6e21271951 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:10.111730 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fb8060e4-cabc-4563-8684-6b6e21271951 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:10.112828 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fb8060e4-cabc-4563-8684-6b6e21271951 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:10.113520 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fb8060e4-cabc-4563-8684-6b6e21271951 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:10.113963 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fb8060e4-cabc-4563-8684-6b6e21271951 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:10.254359 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-fb8060e4-cabc-4563-8684-6b6e21271951 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:30:10.263048 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fb8060e4-cabc-4563-8684-6b6e21271951 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1568 microversion: 2.1 time: 0.165415 Oct 26 14:30:10.263756 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3988/7951] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:30:10 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:30:11.287403 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-29b48ed0-90be-4ec4-b823-ebdc00dba39b tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:30:11.288053 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-29b48ed0-90be-4ec4-b823-ebdc00dba39b tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:30:11.295208 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-29b48ed0-90be-4ec4-b823-ebdc00dba39b tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:11.295698 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-29b48ed0-90be-4ec4-b823-ebdc00dba39b tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:11.296138 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-29b48ed0-90be-4ec4-b823-ebdc00dba39b tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:11.296842 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-29b48ed0-90be-4ec4-b823-ebdc00dba39b tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:11.297975 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-29b48ed0-90be-4ec4-b823-ebdc00dba39b tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:11.298576 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-29b48ed0-90be-4ec4-b823-ebdc00dba39b tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:11.437387 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-29b48ed0-90be-4ec4-b823-ebdc00dba39b tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:30:11.446429 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-29b48ed0-90be-4ec4-b823-ebdc00dba39b tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1568 microversion: 2.1 time: 0.163310 Oct 26 14:30:11.447025 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3964/7952] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:30:11 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:30:12.469998 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a00737bb-6b99-41e0-b71c-0e3c4325e153 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:30:12.470659 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a00737bb-6b99-41e0-b71c-0e3c4325e153 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:30:12.477446 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a00737bb-6b99-41e0-b71c-0e3c4325e153 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:12.478412 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a00737bb-6b99-41e0-b71c-0e3c4325e153 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:12.478911 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a00737bb-6b99-41e0-b71c-0e3c4325e153 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:12.479837 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a00737bb-6b99-41e0-b71c-0e3c4325e153 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:12.480310 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a00737bb-6b99-41e0-b71c-0e3c4325e153 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:12.480753 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a00737bb-6b99-41e0-b71c-0e3c4325e153 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:12.616354 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-a00737bb-6b99-41e0-b71c-0e3c4325e153 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:30:12.624097 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a00737bb-6b99-41e0-b71c-0e3c4325e153 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1509 microversion: 2.1 time: 0.158364 Oct 26 14:30:12.624679 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3989/7953] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:30:12 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:30:12.647136 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8fc91337-e5d5-432d-a035-5a4f56cd6f01 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:30:12.647750 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8fc91337-e5d5-432d-a035-5a4f56cd6f01 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:30:12.654695 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8fc91337-e5d5-432d-a035-5a4f56cd6f01 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:12.655185 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8fc91337-e5d5-432d-a035-5a4f56cd6f01 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:12.655627 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8fc91337-e5d5-432d-a035-5a4f56cd6f01 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:12.656322 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8fc91337-e5d5-432d-a035-5a4f56cd6f01 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:12.657314 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8fc91337-e5d5-432d-a035-5a4f56cd6f01 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:12.657779 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8fc91337-e5d5-432d-a035-5a4f56cd6f01 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:12.689861 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8fc91337-e5d5-432d-a035-5a4f56cd6f01 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120597) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 26 14:30:12.754450 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8fc91337-e5d5-432d-a035-5a4f56cd6f01 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "POST /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662/action" status: 202 len: 0 microversion: 2.1 time: 0.111140 Oct 26 14:30:12.755373 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3965/7954] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 14:30:12 2022] POST /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 14:30:12.763266 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7fad96ba-ce8a-40d5-8be6-08bf4cda9dfd tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:30:12.763925 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7fad96ba-ce8a-40d5-8be6-08bf4cda9dfd tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:30:12.770146 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7fad96ba-ce8a-40d5-8be6-08bf4cda9dfd tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:12.770648 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7fad96ba-ce8a-40d5-8be6-08bf4cda9dfd tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:12.771106 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7fad96ba-ce8a-40d5-8be6-08bf4cda9dfd tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:12.771823 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7fad96ba-ce8a-40d5-8be6-08bf4cda9dfd tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:12.772332 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7fad96ba-ce8a-40d5-8be6-08bf4cda9dfd tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:12.772911 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7fad96ba-ce8a-40d5-8be6-08bf4cda9dfd tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:12.922644 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7fad96ba-ce8a-40d5-8be6-08bf4cda9dfd tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:30:12.930669 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7fad96ba-ce8a-40d5-8be6-08bf4cda9dfd tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1517 microversion: 2.1 time: 0.171412 Oct 26 14:30:12.931243 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3990/7955] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:30:12 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1517 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:30:13.513735 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-7d9f8fe7-a9ec-4dae-a8d0-2f5d206404a8 req-db7b26dc-b62e-49f6-9ad6-02d1e6ca94c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8a514d9-3e8c-4303-b297-392601074662", "name": "network-vif-unplugged", "status": "completed", "tag": "3c5c1507-9ffe-41ce-a3c0-6be2ebd11393"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:30:13.524104 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-7d9f8fe7-a9ec-4dae-a8d0-2f5d206404a8 req-db7b26dc-b62e-49f6-9ad6-02d1e6ca94c6 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:13.524593 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-7d9f8fe7-a9ec-4dae-a8d0-2f5d206404a8 req-db7b26dc-b62e-49f6-9ad6-02d1e6ca94c6 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:13.525027 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-7d9f8fe7-a9ec-4dae-a8d0-2f5d206404a8 req-db7b26dc-b62e-49f6-9ad6-02d1e6ca94c6 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:13.536982 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.compute.server_external_events [req-7d9f8fe7-a9ec-4dae-a8d0-2f5d206404a8 req-db7b26dc-b62e-49f6-9ad6-02d1e6ca94c6 service nova] Unable to find a host for instance e8a514d9-3e8c-4303-b297-392601074662. Dropping event network-vif-unplugged {{(pid=120597) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 26 14:30:13.537919 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-7d9f8fe7-a9ec-4dae-a8d0-2f5d206404a8 req-db7b26dc-b62e-49f6-9ad6-02d1e6ca94c6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.083620 Oct 26 14:30:13.538514 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3966/7956] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 85 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 26 14:30:13.955169 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bf818696-a5a1-464d-994f-112a77b2b68d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:30:13.955803 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bf818696-a5a1-464d-994f-112a77b2b68d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:30:13.962883 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bf818696-a5a1-464d-994f-112a77b2b68d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:13.963390 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bf818696-a5a1-464d-994f-112a77b2b68d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:13.963846 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bf818696-a5a1-464d-994f-112a77b2b68d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:13.964569 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bf818696-a5a1-464d-994f-112a77b2b68d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:13.965043 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bf818696-a5a1-464d-994f-112a77b2b68d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:13.965507 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bf818696-a5a1-464d-994f-112a77b2b68d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:14.106839 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-bf818696-a5a1-464d-994f-112a77b2b68d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:30:14.115875 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bf818696-a5a1-464d-994f-112a77b2b68d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1519 microversion: 2.1 time: 0.164678 Oct 26 14:30:14.116554 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3991/7957] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:30:13 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:30:15.140215 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b52a6627-2af3-4299-a453-ece5e5277203 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:30:15.140838 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b52a6627-2af3-4299-a453-ece5e5277203 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:30:15.148998 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b52a6627-2af3-4299-a453-ece5e5277203 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:15.149537 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b52a6627-2af3-4299-a453-ece5e5277203 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:15.149991 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b52a6627-2af3-4299-a453-ece5e5277203 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:15.150694 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b52a6627-2af3-4299-a453-ece5e5277203 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:15.151172 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b52a6627-2af3-4299-a453-ece5e5277203 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:15.151611 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b52a6627-2af3-4299-a453-ece5e5277203 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:15.282569 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-b52a6627-2af3-4299-a453-ece5e5277203 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:30:15.290571 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b52a6627-2af3-4299-a453-ece5e5277203 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1519 microversion: 2.1 time: 0.154322 Oct 26 14:30:15.291152 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3967/7958] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:30:15 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:30:16.316289 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3fb17681-b957-427a-95c7-63dc84f51e7d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:30:16.317157 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3fb17681-b957-427a-95c7-63dc84f51e7d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:30:16.324508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3fb17681-b957-427a-95c7-63dc84f51e7d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:16.325012 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3fb17681-b957-427a-95c7-63dc84f51e7d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:16.325462 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3fb17681-b957-427a-95c7-63dc84f51e7d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:16.326277 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3fb17681-b957-427a-95c7-63dc84f51e7d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:16.326748 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3fb17681-b957-427a-95c7-63dc84f51e7d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:16.327217 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3fb17681-b957-427a-95c7-63dc84f51e7d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:16.467892 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3fb17681-b957-427a-95c7-63dc84f51e7d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:30:16.475988 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3fb17681-b957-427a-95c7-63dc84f51e7d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1519 microversion: 2.1 time: 0.164492 Oct 26 14:30:16.489676 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3992/7959] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:30:16 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1519 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:30:17.499917 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-611645e2-b268-44fb-9f3f-34b609df889f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:30:17.500536 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-611645e2-b268-44fb-9f3f-34b609df889f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:30:17.508682 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-611645e2-b268-44fb-9f3f-34b609df889f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:17.509182 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-611645e2-b268-44fb-9f3f-34b609df889f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:17.509665 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-611645e2-b268-44fb-9f3f-34b609df889f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:17.510371 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-611645e2-b268-44fb-9f3f-34b609df889f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:17.510834 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-611645e2-b268-44fb-9f3f-34b609df889f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:17.511293 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-611645e2-b268-44fb-9f3f-34b609df889f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:17.644938 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-611645e2-b268-44fb-9f3f-34b609df889f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:30:17.652800 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-611645e2-b268-44fb-9f3f-34b609df889f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1519 microversion: 2.1 time: 0.156947 Oct 26 14:30:17.653386 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3968/7960] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:30:17 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:30:18.678631 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-eba22d79-9566-430b-8af6-1abb7b9e9e2e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:30:18.679184 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-eba22d79-9566-430b-8af6-1abb7b9e9e2e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:30:18.686139 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eba22d79-9566-430b-8af6-1abb7b9e9e2e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:18.686636 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eba22d79-9566-430b-8af6-1abb7b9e9e2e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:18.687091 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eba22d79-9566-430b-8af6-1abb7b9e9e2e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:18.687802 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eba22d79-9566-430b-8af6-1abb7b9e9e2e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:18.688277 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eba22d79-9566-430b-8af6-1abb7b9e9e2e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:18.689417 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-eba22d79-9566-430b-8af6-1abb7b9e9e2e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:18.909326 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-eba22d79-9566-430b-8af6-1abb7b9e9e2e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:30:18.917218 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-eba22d79-9566-430b-8af6-1abb7b9e9e2e tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1575 microversion: 2.1 time: 0.242742 Oct 26 14:30:18.917876 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3993/7961] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:30:18 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1575 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:30:19.942711 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ba4f5b64-ee46-46b9-a153-0aef6fcae242 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:30:19.943533 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ba4f5b64-ee46-46b9-a153-0aef6fcae242 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:30:19.952583 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ba4f5b64-ee46-46b9-a153-0aef6fcae242 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:19.952583 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ba4f5b64-ee46-46b9-a153-0aef6fcae242 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:19.952583 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ba4f5b64-ee46-46b9-a153-0aef6fcae242 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:19.953262 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ba4f5b64-ee46-46b9-a153-0aef6fcae242 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:19.953753 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ba4f5b64-ee46-46b9-a153-0aef6fcae242 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:19.954315 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ba4f5b64-ee46-46b9-a153-0aef6fcae242 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:20.045185 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-aeab4137-23ff-4cd7-820b-fdb5f6b8ca82 req-9ce69480-3323-486a-bbc4-4de6a41dbcb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8a514d9-3e8c-4303-b297-392601074662", "tag": "3c5c1507-9ffe-41ce-a3c0-6be2ebd11393"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:30:20.061312 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-aeab4137-23ff-4cd7-820b-fdb5f6b8ca82 req-9ce69480-3323-486a-bbc4-4de6a41dbcb8 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:20.062094 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-aeab4137-23ff-4cd7-820b-fdb5f6b8ca82 req-9ce69480-3323-486a-bbc4-4de6a41dbcb8 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:20.062545 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-aeab4137-23ff-4cd7-820b-fdb5f6b8ca82 req-9ce69480-3323-486a-bbc4-4de6a41dbcb8 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:20.077315 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-aeab4137-23ff-4cd7-820b-fdb5f6b8ca82 req-9ce69480-3323-486a-bbc4-4de6a41dbcb8 service nova] Creating event network-changed:3c5c1507-9ffe-41ce-a3c0-6be2ebd11393 for instance e8a514d9-3e8c-4303-b297-392601074662 on n-h2-862686-1 Oct 26 14:30:20.084054 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-aeab4137-23ff-4cd7-820b-fdb5f6b8ca82 req-9ce69480-3323-486a-bbc4-4de6a41dbcb8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108279 Oct 26 14:30:20.085266 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3994/7962] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:30:20.441291 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ba4f5b64-ee46-46b9-a153-0aef6fcae242 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:30:20.449155 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ba4f5b64-ee46-46b9-a153-0aef6fcae242 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1575 microversion: 2.1 time: 0.511462 Oct 26 14:30:20.449775 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3969/7963] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:30:19 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1575 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:30:21.474330 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-48186976-e155-49e7-909b-2464d2eb9ad2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:30:21.475056 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-48186976-e155-49e7-909b-2464d2eb9ad2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:30:21.481310 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48186976-e155-49e7-909b-2464d2eb9ad2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:21.481842 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48186976-e155-49e7-909b-2464d2eb9ad2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:21.482302 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48186976-e155-49e7-909b-2464d2eb9ad2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:21.483021 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48186976-e155-49e7-909b-2464d2eb9ad2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:21.483491 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48186976-e155-49e7-909b-2464d2eb9ad2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:21.483931 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-48186976-e155-49e7-909b-2464d2eb9ad2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:21.650425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-48186976-e155-49e7-909b-2464d2eb9ad2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:30:21.659080 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-48186976-e155-49e7-909b-2464d2eb9ad2 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1575 microversion: 2.1 time: 0.190777 Oct 26 14:30:21.659657 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3995/7964] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:30:21 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1575 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:30:22.682634 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1548a0d1-1554-4163-8bb3-4af92dec5e94 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:30:22.683515 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1548a0d1-1554-4163-8bb3-4af92dec5e94 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:30:22.691128 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1548a0d1-1554-4163-8bb3-4af92dec5e94 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:22.691640 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1548a0d1-1554-4163-8bb3-4af92dec5e94 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:22.692080 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1548a0d1-1554-4163-8bb3-4af92dec5e94 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:22.692767 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1548a0d1-1554-4163-8bb3-4af92dec5e94 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:22.693221 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1548a0d1-1554-4163-8bb3-4af92dec5e94 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:22.693678 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1548a0d1-1554-4163-8bb3-4af92dec5e94 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:22.823528 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1548a0d1-1554-4163-8bb3-4af92dec5e94 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:30:22.832254 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1548a0d1-1554-4163-8bb3-4af92dec5e94 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1575 microversion: 2.1 time: 0.153489 Oct 26 14:30:22.832820 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3970/7965] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:30:22 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 14:30:23.855693 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4ae90d6b-817e-401e-a9b6-3ac33a406a09 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:30:23.856330 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4ae90d6b-817e-401e-a9b6-3ac33a406a09 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:30:23.863981 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4ae90d6b-817e-401e-a9b6-3ac33a406a09 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:23.864502 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4ae90d6b-817e-401e-a9b6-3ac33a406a09 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:23.864951 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4ae90d6b-817e-401e-a9b6-3ac33a406a09 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:23.865696 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4ae90d6b-817e-401e-a9b6-3ac33a406a09 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:23.866166 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4ae90d6b-817e-401e-a9b6-3ac33a406a09 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:23.866718 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4ae90d6b-817e-401e-a9b6-3ac33a406a09 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:24.002327 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-4ae90d6b-817e-401e-a9b6-3ac33a406a09 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:30:24.010082 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4ae90d6b-817e-401e-a9b6-3ac33a406a09 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1575 microversion: 2.1 time: 0.158348 Oct 26 14:30:24.010662 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3996/7966] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:30:23 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:30:25.034205 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f72469a2-7a65-4450-90db-a20c3b9ff25f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:30:25.034808 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f72469a2-7a65-4450-90db-a20c3b9ff25f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:30:25.041808 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f72469a2-7a65-4450-90db-a20c3b9ff25f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:25.042301 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f72469a2-7a65-4450-90db-a20c3b9ff25f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:25.042742 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f72469a2-7a65-4450-90db-a20c3b9ff25f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:25.043710 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f72469a2-7a65-4450-90db-a20c3b9ff25f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:25.044254 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f72469a2-7a65-4450-90db-a20c3b9ff25f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:25.044687 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f72469a2-7a65-4450-90db-a20c3b9ff25f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:25.180408 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f72469a2-7a65-4450-90db-a20c3b9ff25f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:30:25.188182 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f72469a2-7a65-4450-90db-a20c3b9ff25f tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1575 microversion: 2.1 time: 0.158636 Oct 26 14:30:25.189354 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3971/7967] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:30:25 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:30:26.213881 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d09b6e36-0c5b-4adc-a3cb-5b72cce70a50 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:30:26.214429 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d09b6e36-0c5b-4adc-a3cb-5b72cce70a50 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:30:26.222115 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d09b6e36-0c5b-4adc-a3cb-5b72cce70a50 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:26.222615 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d09b6e36-0c5b-4adc-a3cb-5b72cce70a50 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:26.223070 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d09b6e36-0c5b-4adc-a3cb-5b72cce70a50 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:26.223785 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d09b6e36-0c5b-4adc-a3cb-5b72cce70a50 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:26.224261 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d09b6e36-0c5b-4adc-a3cb-5b72cce70a50 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:26.224706 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d09b6e36-0c5b-4adc-a3cb-5b72cce70a50 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:26.228856 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:30:26.356938 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d09b6e36-0c5b-4adc-a3cb-5b72cce70a50 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:30:26.364847 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d09b6e36-0c5b-4adc-a3cb-5b72cce70a50 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1575 microversion: 2.1 time: 0.155106 Oct 26 14:30:26.365425 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3997/7968] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:30:26 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:30:27.387926 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2d024b60-13c1-47ee-ad03-77a2a85cac98 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:30:27.388534 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2d024b60-13c1-47ee-ad03-77a2a85cac98 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:30:27.391253 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:30:27.396907 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2d024b60-13c1-47ee-ad03-77a2a85cac98 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:27.397334 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2d024b60-13c1-47ee-ad03-77a2a85cac98 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:27.397813 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2d024b60-13c1-47ee-ad03-77a2a85cac98 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:27.398504 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2d024b60-13c1-47ee-ad03-77a2a85cac98 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:27.398960 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2d024b60-13c1-47ee-ad03-77a2a85cac98 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:27.399388 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2d024b60-13c1-47ee-ad03-77a2a85cac98 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:27.404253 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:30:27.531593 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-2d024b60-13c1-47ee-ad03-77a2a85cac98 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:30:27.540297 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2d024b60-13c1-47ee-ad03-77a2a85cac98 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1575 microversion: 2.1 time: 0.156313 Oct 26 14:30:27.540860 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3972/7969] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:30:27 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:30:28.564284 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-47278acb-c9e9-413f-b342-98004322ca75 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:30:28.565719 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-47278acb-c9e9-413f-b342-98004322ca75 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:30:28.568357 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=33 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:30:28.573632 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47278acb-c9e9-413f-b342-98004322ca75 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:28.574133 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47278acb-c9e9-413f-b342-98004322ca75 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:28.574590 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47278acb-c9e9-413f-b342-98004322ca75 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:28.575304 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47278acb-c9e9-413f-b342-98004322ca75 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:28.575784 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47278acb-c9e9-413f-b342-98004322ca75 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:28.576248 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47278acb-c9e9-413f-b342-98004322ca75 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:28.713902 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-47278acb-c9e9-413f-b342-98004322ca75 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:30:28.722345 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-47278acb-c9e9-413f-b342-98004322ca75 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1575 microversion: 2.1 time: 0.162066 Oct 26 14:30:28.722933 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3998/7970] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:30:28 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:30:29.746704 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-23b62953-a1de-42a0-bfc8-d9f212524103 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:30:29.747333 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-23b62953-a1de-42a0-bfc8-d9f212524103 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:30:29.753590 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-23b62953-a1de-42a0-bfc8-d9f212524103 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:29.754077 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-23b62953-a1de-42a0-bfc8-d9f212524103 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:29.754519 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-23b62953-a1de-42a0-bfc8-d9f212524103 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:29.755208 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-23b62953-a1de-42a0-bfc8-d9f212524103 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:29.755665 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-23b62953-a1de-42a0-bfc8-d9f212524103 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:29.756098 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-23b62953-a1de-42a0-bfc8-d9f212524103 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:29.890635 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-23b62953-a1de-42a0-bfc8-d9f212524103 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:30:29.898668 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-23b62953-a1de-42a0-bfc8-d9f212524103 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1575 microversion: 2.1 time: 0.156043 Oct 26 14:30:29.899245 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3973/7971] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:30:29 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:30:30.596580 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-781c5fdf-39c8-4df3-811a-336eedcdd17e req-0f6fee13-aa08-4940-9eaa-df229cfda6d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8a514d9-3e8c-4303-b297-392601074662", "name": "network-vif-plugged", "status": "completed", "tag": "3c5c1507-9ffe-41ce-a3c0-6be2ebd11393"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:30:30.607368 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-781c5fdf-39c8-4df3-811a-336eedcdd17e req-0f6fee13-aa08-4940-9eaa-df229cfda6d3 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:30.607969 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-781c5fdf-39c8-4df3-811a-336eedcdd17e req-0f6fee13-aa08-4940-9eaa-df229cfda6d3 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:30.608424 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-781c5fdf-39c8-4df3-811a-336eedcdd17e req-0f6fee13-aa08-4940-9eaa-df229cfda6d3 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:30.620418 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-781c5fdf-39c8-4df3-811a-336eedcdd17e req-0f6fee13-aa08-4940-9eaa-df229cfda6d3 service nova] Creating event network-vif-plugged:3c5c1507-9ffe-41ce-a3c0-6be2ebd11393 for instance e8a514d9-3e8c-4303-b297-392601074662 on n-h2-862686-1 Oct 26 14:30:30.625538 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-781c5fdf-39c8-4df3-811a-336eedcdd17e req-0f6fee13-aa08-4940-9eaa-df229cfda6d3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033602 Oct 26 14:30:30.626185 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3999/7972] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:30:30.922457 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-79249953-b1c3-4ad2-90d3-a13dfc5fee7a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:30:30.923062 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-79249953-b1c3-4ad2-90d3-a13dfc5fee7a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:30:30.931051 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-79249953-b1c3-4ad2-90d3-a13dfc5fee7a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:30.931536 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-79249953-b1c3-4ad2-90d3-a13dfc5fee7a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:30.931973 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-79249953-b1c3-4ad2-90d3-a13dfc5fee7a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:30.932666 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-79249953-b1c3-4ad2-90d3-a13dfc5fee7a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:30.933120 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-79249953-b1c3-4ad2-90d3-a13dfc5fee7a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:30.933583 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-79249953-b1c3-4ad2-90d3-a13dfc5fee7a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:31.064214 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-79249953-b1c3-4ad2-90d3-a13dfc5fee7a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:30:31.072438 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-79249953-b1c3-4ad2-90d3-a13dfc5fee7a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1575 microversion: 2.1 time: 0.154257 Oct 26 14:30:31.073020 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3974/7973] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:30:30 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:30:32.097401 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-75e81d59-c59d-4246-ae4f-b96a849fe6e8 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:30:32.098151 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-75e81d59-c59d-4246-ae4f-b96a849fe6e8 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:30:32.105268 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-75e81d59-c59d-4246-ae4f-b96a849fe6e8 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:32.105800 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-75e81d59-c59d-4246-ae4f-b96a849fe6e8 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:32.106264 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-75e81d59-c59d-4246-ae4f-b96a849fe6e8 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:32.106983 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-75e81d59-c59d-4246-ae4f-b96a849fe6e8 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:30:32.107465 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-75e81d59-c59d-4246-ae4f-b96a849fe6e8 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:30:32.107912 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-75e81d59-c59d-4246-ae4f-b96a849fe6e8 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:30:32.242083 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-75e81d59-c59d-4246-ae4f-b96a849fe6e8 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:30:32.249911 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-75e81d59-c59d-4246-ae4f-b96a849fe6e8 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1562 microversion: 2.1 time: 0.157518 Oct 26 14:30:32.250497 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 4000/7974] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:30:32 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1562 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:31:46.439097 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=5 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:31:46.440079 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=17 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:31:46.441253 n-d-862686-1 devstack@n-api.service[120597]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 14:31:46.441572 n-d-862686-1 devstack@n-api.service[120597]: Wed Oct 26 14:31:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 (ip 10.222.0.40) !!! Oct 26 14:31:46.442952 n-d-862686-1 devstack@n-api.service[120597]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 14:31:46.443176 n-d-862686-1 devstack@n-api.service[120597]: Wed Oct 26 14:31:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 (ip 10.222.0.40) !!! Oct 26 14:31:46.446229 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-9b6ac749-6a39-491d-829d-c0aae7f960e2 req-328588f8-c2c8-41eb-88dc-580a651ba836 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8a514d9-3e8c-4303-b297-392601074662", "tag": "3c5c1507-9ffe-41ce-a3c0-6be2ebd11393"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:31:46.448025 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8b4bd37f-d53f-4da4-8633-1ef5877f435c tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:31:46.448616 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8b4bd37f-d53f-4da4-8633-1ef5877f435c tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:31:46.454806 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=5 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:31:46.455575 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=18 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:31:46.457000 n-d-862686-1 devstack@n-api.service[120598]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 14:31:46.457228 n-d-862686-1 devstack@n-api.service[120598]: Wed Oct 26 14:31:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.40) !!! Oct 26 14:31:46.460934 n-d-862686-1 devstack@n-api.service[120598]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 14:31:46.462093 n-d-862686-1 devstack@n-api.service[120598]: Wed Oct 26 14:31:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.40) !!! Oct 26 14:31:46.473613 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8b4bd37f-d53f-4da4-8633-1ef5877f435c tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:31:46.474685 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8b4bd37f-d53f-4da4-8633-1ef5877f435c tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:31:46.475219 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8b4bd37f-d53f-4da4-8633-1ef5877f435c tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:31:46.475948 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8b4bd37f-d53f-4da4-8633-1ef5877f435c tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:31:46.476420 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8b4bd37f-d53f-4da4-8633-1ef5877f435c tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:31:46.476869 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8b4bd37f-d53f-4da4-8633-1ef5877f435c tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:31:46.479485 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9b6ac749-6a39-491d-829d-c0aae7f960e2 req-328588f8-c2c8-41eb-88dc-580a651ba836 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:31:46.480213 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9b6ac749-6a39-491d-829d-c0aae7f960e2 req-328588f8-c2c8-41eb-88dc-580a651ba836 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:31:46.480783 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9b6ac749-6a39-491d-829d-c0aae7f960e2 req-328588f8-c2c8-41eb-88dc-580a651ba836 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:31:46.494966 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-9b6ac749-6a39-491d-829d-c0aae7f960e2 req-328588f8-c2c8-41eb-88dc-580a651ba836 service nova] Creating event network-changed:3c5c1507-9ffe-41ce-a3c0-6be2ebd11393 for instance e8a514d9-3e8c-4303-b297-392601074662 on n-h2-862686-1 Oct 26 14:31:46.501592 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-9b6ac749-6a39-491d-829d-c0aae7f960e2 req-328588f8-c2c8-41eb-88dc-580a651ba836 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062252 Oct 26 14:31:46.502225 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 4001/7975] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:31:46.521820 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8b4bd37f-d53f-4da4-8633-1ef5877f435c tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 14:31:46.602686 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8b4bd37f-d53f-4da4-8633-1ef5877f435c tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 204 len: 0 microversion: 2.1 time: 0.165752 Oct 26 14:31:46.603372 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3975/7976] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 14:31:46 2022] DELETE /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 14:31:46.614430 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f6bed891-f61e-43cd-b5e1-83f63a560524 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:31:46.615151 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f6bed891-f61e-43cd-b5e1-83f63a560524 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:31:46.621642 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6bed891-f61e-43cd-b5e1-83f63a560524 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:31:46.622420 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6bed891-f61e-43cd-b5e1-83f63a560524 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:31:46.622871 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6bed891-f61e-43cd-b5e1-83f63a560524 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:31:46.623582 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6bed891-f61e-43cd-b5e1-83f63a560524 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:31:46.624081 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6bed891-f61e-43cd-b5e1-83f63a560524 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:31:46.624665 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6bed891-f61e-43cd-b5e1-83f63a560524 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:31:46.763312 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f6bed891-f61e-43cd-b5e1-83f63a560524 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:31:46.771864 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f6bed891-f61e-43cd-b5e1-83f63a560524 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1568 microversion: 2.1 time: 0.163544 Oct 26 14:31:46.772450 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 4002/7977] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:31:46 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:31:47.796721 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d1de20fa-aefd-4d71-b26a-1dae0e0df82a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:31:47.797430 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d1de20fa-aefd-4d71-b26a-1dae0e0df82a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:31:47.805207 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d1de20fa-aefd-4d71-b26a-1dae0e0df82a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:31:47.805978 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d1de20fa-aefd-4d71-b26a-1dae0e0df82a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:31:47.806423 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d1de20fa-aefd-4d71-b26a-1dae0e0df82a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:31:47.807135 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d1de20fa-aefd-4d71-b26a-1dae0e0df82a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:31:47.807595 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d1de20fa-aefd-4d71-b26a-1dae0e0df82a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:31:47.808035 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d1de20fa-aefd-4d71-b26a-1dae0e0df82a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:31:47.946790 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d1de20fa-aefd-4d71-b26a-1dae0e0df82a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:31:47.954908 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d1de20fa-aefd-4d71-b26a-1dae0e0df82a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1568 microversion: 2.1 time: 0.163320 Oct 26 14:31:47.955491 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3976/7978] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:31:47 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:31:48.979192 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d827699d-17ca-4df6-a2d0-ab338b993a9b tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:31:48.979906 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d827699d-17ca-4df6-a2d0-ab338b993a9b tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:31:48.987829 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d827699d-17ca-4df6-a2d0-ab338b993a9b tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:31:48.988329 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d827699d-17ca-4df6-a2d0-ab338b993a9b tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:31:48.988776 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d827699d-17ca-4df6-a2d0-ab338b993a9b tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:31:48.989505 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d827699d-17ca-4df6-a2d0-ab338b993a9b tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:31:48.989983 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d827699d-17ca-4df6-a2d0-ab338b993a9b tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:31:48.990420 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d827699d-17ca-4df6-a2d0-ab338b993a9b tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:31:49.132047 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d827699d-17ca-4df6-a2d0-ab338b993a9b tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:31:49.146275 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d827699d-17ca-4df6-a2d0-ab338b993a9b tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1450 microversion: 2.1 time: 0.170865 Oct 26 14:31:49.147326 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 4003/7979] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:31:48 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1450 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:31:49.335922 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-b81f68dc-23dc-4ba7-89bb-4a395bcb8033 req-7c6ed472-f2ad-441e-bad2-f174c200f99e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8a514d9-3e8c-4303-b297-392601074662", "name": "network-vif-deleted", "tag": "3c5c1507-9ffe-41ce-a3c0-6be2ebd11393"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:31:49.346080 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-b81f68dc-23dc-4ba7-89bb-4a395bcb8033 req-7c6ed472-f2ad-441e-bad2-f174c200f99e service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:31:49.346559 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-b81f68dc-23dc-4ba7-89bb-4a395bcb8033 req-7c6ed472-f2ad-441e-bad2-f174c200f99e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:31:49.346992 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-b81f68dc-23dc-4ba7-89bb-4a395bcb8033 req-7c6ed472-f2ad-441e-bad2-f174c200f99e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:31:49.359852 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-b81f68dc-23dc-4ba7-89bb-4a395bcb8033 req-7c6ed472-f2ad-441e-bad2-f174c200f99e service nova] Creating event network-vif-deleted:3c5c1507-9ffe-41ce-a3c0-6be2ebd11393 for instance e8a514d9-3e8c-4303-b297-392601074662 on n-h2-862686-1 Oct 26 14:31:49.374179 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-b81f68dc-23dc-4ba7-89bb-4a395bcb8033 req-7c6ed472-f2ad-441e-bad2-f174c200f99e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135495 Oct 26 14:31:49.375285 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3977/7980] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:31:50.172729 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2309961d-8200-4b3b-a622-7c4a7ce07933 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:31:50.173368 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2309961d-8200-4b3b-a622-7c4a7ce07933 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:31:50.180322 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2309961d-8200-4b3b-a622-7c4a7ce07933 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:31:50.180835 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2309961d-8200-4b3b-a622-7c4a7ce07933 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:31:50.181298 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2309961d-8200-4b3b-a622-7c4a7ce07933 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:31:50.182055 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2309961d-8200-4b3b-a622-7c4a7ce07933 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:31:50.182534 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2309961d-8200-4b3b-a622-7c4a7ce07933 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:31:50.182981 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2309961d-8200-4b3b-a622-7c4a7ce07933 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:31:50.249542 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-2309961d-8200-4b3b-a622-7c4a7ce07933 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:31:50.257559 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2309961d-8200-4b3b-a622-7c4a7ce07933 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1220 microversion: 2.1 time: 0.089782 Oct 26 14:31:50.258155 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 4004/7981] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:31:50 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:31:51.281713 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6b9304b5-0a5c-4d83-84ec-463df3d1cd85 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:31:51.282456 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6b9304b5-0a5c-4d83-84ec-463df3d1cd85 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:31:51.288690 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b9304b5-0a5c-4d83-84ec-463df3d1cd85 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:31:51.289177 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b9304b5-0a5c-4d83-84ec-463df3d1cd85 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:31:51.289653 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b9304b5-0a5c-4d83-84ec-463df3d1cd85 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:31:51.290353 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b9304b5-0a5c-4d83-84ec-463df3d1cd85 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:31:51.290812 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b9304b5-0a5c-4d83-84ec-463df3d1cd85 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:31:51.291249 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b9304b5-0a5c-4d83-84ec-463df3d1cd85 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:31:51.365246 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-6b9304b5-0a5c-4d83-84ec-463df3d1cd85 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:31:51.373399 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6b9304b5-0a5c-4d83-84ec-463df3d1cd85 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1220 microversion: 2.1 time: 0.096847 Oct 26 14:31:51.374005 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3978/7982] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:31:51 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:31:52.396977 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5418a54c-93fa-49bb-9ba8-fb8133a114db tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:31:52.397646 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5418a54c-93fa-49bb-9ba8-fb8133a114db tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:31:52.405011 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5418a54c-93fa-49bb-9ba8-fb8133a114db tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:31:52.405576 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5418a54c-93fa-49bb-9ba8-fb8133a114db tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:31:52.406035 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5418a54c-93fa-49bb-9ba8-fb8133a114db tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:31:52.406758 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5418a54c-93fa-49bb-9ba8-fb8133a114db tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:31:52.407226 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5418a54c-93fa-49bb-9ba8-fb8133a114db tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:31:52.407662 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5418a54c-93fa-49bb-9ba8-fb8133a114db tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:31:52.474465 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-5418a54c-93fa-49bb-9ba8-fb8133a114db tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:31:52.482517 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5418a54c-93fa-49bb-9ba8-fb8133a114db tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1220 microversion: 2.1 time: 0.089478 Oct 26 14:31:52.483103 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 4005/7983] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:31:52 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:31:53.506335 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0e597de8-28ea-4920-878a-6a6e85b5683a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:31:53.507064 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0e597de8-28ea-4920-878a-6a6e85b5683a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:31:53.514673 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0e597de8-28ea-4920-878a-6a6e85b5683a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:31:53.515752 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0e597de8-28ea-4920-878a-6a6e85b5683a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:31:53.516335 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0e597de8-28ea-4920-878a-6a6e85b5683a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:31:53.517048 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0e597de8-28ea-4920-878a-6a6e85b5683a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:31:53.517628 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0e597de8-28ea-4920-878a-6a6e85b5683a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:31:53.518118 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0e597de8-28ea-4920-878a-6a6e85b5683a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:31:53.565140 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0e597de8-28ea-4920-878a-6a6e85b5683a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:31:53.565673 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0e597de8-28ea-4920-878a-6a6e85b5683a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:31:53.566116 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0e597de8-28ea-4920-878a-6a6e85b5683a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:31:53.566562 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-0e597de8-28ea-4920-878a-6a6e85b5683a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lazy-loading 'fault' on Instance uuid e8a514d9-3e8c-4303-b297-392601074662 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 14:31:53.610495 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0e597de8-28ea-4920-878a-6a6e85b5683a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926665a856ff4ab0883995386bc5b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbff35dfa5d49dabac384d92e5ddea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:31:53.618565 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0e597de8-28ea-4920-878a-6a6e85b5683a tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 200 len: 1225 microversion: 2.1 time: 0.116316 Oct 26 14:31:53.619153 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3979/7984] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:31:53 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 1225 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:31:54.643333 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1150bf6e-b8e0-4b2b-b062-ceffd4471f6d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:31:54.643968 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1150bf6e-b8e0-4b2b-b062-ceffd4471f6d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] [instance: e8a514d9-3e8c-4303-b297-392601074662] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:31:54.651304 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1150bf6e-b8e0-4b2b-b062-ceffd4471f6d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:31:54.651837 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1150bf6e-b8e0-4b2b-b062-ceffd4471f6d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:31:54.652294 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1150bf6e-b8e0-4b2b-b062-ceffd4471f6d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:31:54.653053 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1150bf6e-b8e0-4b2b-b062-ceffd4471f6d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:31:54.653548 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1150bf6e-b8e0-4b2b-b062-ceffd4471f6d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:31:54.653996 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1150bf6e-b8e0-4b2b-b062-ceffd4471f6d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:31:54.668412 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-1150bf6e-b8e0-4b2b-b062-ceffd4471f6d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] HTTP exception thrown: Instance e8a514d9-3e8c-4303-b297-392601074662 could not be found. Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1150bf6e-b8e0-4b2b-b062-ceffd4471f6d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Request method failure captured: Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 HTTP/1.1 Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: Accept: application/json Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: Accept-Encoding: identity Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: Connection: close Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: Content-Length: 0 Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: Content-Type: application/json Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: Host: 10.222.0.40 Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjWULCb7XizaHX7hNRd8kc1P1Bxv_y00rLcAorSu3iD-twV0rhm5Lb4-TTUg5OYrVGZqap01eOstmCF3VlfQHy1i-5zPkl9B9XJVIjYh6Wu2n37NOX8Z39Yvpg4iOs4yn-gLezcQJt-QT-mcdPOPYscF6ZvMynroyZrUQI_vf2W4ppYCc Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Id: None Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: X-Domain-Name: None Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Id: ccbff35dfa5d49dabac384d92e5ddea6 Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: X-Project-Name: tempest-TestShelveInstance-1444919419 Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: X-Role: member,reader Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: X-Roles: member,reader Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ccbff35dfa5d49dabac384d92e5ddea6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ccbff35dfa5d49dabac384d92e5ddea6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ccbff35dfa5d49dabac384d92e5ddea6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ccbff35dfa5d49dabac384d92e5ddea6"}]}] Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant: tempest-TestShelveInstance-1444919419 Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Id: ccbff35dfa5d49dabac384d92e5ddea6 Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: X-Tenant-Name: tempest-TestShelveInstance-1444919419 Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: X-User: tempest-TestShelveInstance-1444919419-project Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: X-User-Id: 926665a856ff4ab0883995386bc5b46a Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: X-User-Name: tempest-TestShelveInstance-1444919419-project Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: method: > Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: exception: Instance e8a514d9-3e8c-4303-b297-392601074662 could not be found. Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: action_args: {'id': 'e8a514d9-3e8c-4303-b297-392601074662'} Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8a514d9-3e8c-4303-b297-392601074662 could not be found. Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8a514d9-3e8c-4303-b297-392601074662 could not be found. Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:31:54.670514 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:31:54.676146 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:31:54.676146 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:31:54.676146 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:31:54.676146 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 14:31:54.676146 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 14:31:54.676146 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8a514d9-3e8c-4303-b297-392601074662 could not be found. Oct 26 14:31:54.676146 n-d-862686-1 devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 26 14:31:54.676146 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1150bf6e-b8e0-4b2b-b062-ceffd4471f6d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Returning 404 to user: Instance e8a514d9-3e8c-4303-b297-392601074662 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 14:31:54.676146 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1150bf6e-b8e0-4b2b-b062-ceffd4471f6d tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662" status: 404 len: 111 microversion: 2.1 time: 0.033742 Oct 26 14:31:54.676146 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 4006/7985] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:31:54 2022] GET /compute/v2.1/servers/e8a514d9-3e8c-4303-b297-392601074662 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 14:31:54.850989 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f42f6cea-30f6-44af-9420-b8d868667ea0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] Calling method '.version_select at 0x7f6731355430>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:31:54.885737 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f42f6cea-30f6-44af-9420-b8d868667ea0 tempest-TestShelveInstance-1444919419 tempest-TestShelveInstance-1444919419-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1506831500" status: 202 len: 0 microversion: 2.1 time: 0.038581 Oct 26 14:31:54.887753 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3980/7986] 10.222.0.40 () {58 vars in 1254 bytes} [Wed Oct 26 14:31:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1506831500 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 14:32:12.228177 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=12 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:32:12.229090 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=28 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:32:12.400372 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a52487a5-0237-4b55-8f66-b1688aea46cb tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Action: 'create', calling method: .version_select at 0x7f67318e0b80>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-341990740", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkzFPA6ZNSGuuRts/pCdy+8s2D7LLaFBnVyGRhTHSxA2Bzl0SQcK3SbJTJHYDhEoXJUHdWR5hFWY0VV3Ju0GSkT8eTQgCtc4qWwDBxbhTNbmS5PdtpROQzkZFYZNzFDFw=="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:32:12.416549 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-a52487a5-0237-4b55-8f66-b1688aea46cb tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Getting quotas for project f1e5874a55844a40ab742ed92677880a. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 14:32:12.423242 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-a52487a5-0237-4b55-8f66-b1688aea46cb tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Getting quotas for user 1b26b32a5cf64b01bdd213c66f7249b6 and project f1e5874a55844a40ab742ed92677880a. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 14:32:12.454505 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a52487a5-0237-4b55-8f66-b1688aea46cb tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.231190 Oct 26 14:32:12.455518 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 4007/7987] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 26 14:32:12 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:32:13.530550 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:32:13.531336 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:32:13.536149 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9f4f0051-16d5-49ca-9469-714f724e82eb tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-710322629", "imageRef": "762c20f4-0f9b-45cb-bd95-cf21a747b33b", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-341990740", "security_groups": [{"name": "tempest-secgroup-smoke-1666105834"}], "networks": [{"uuid": "3814a3ee-95c6-407a-903a-c65ed3805cd7"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:32:13.654103 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-9f4f0051-16d5-49ca-9469-714f724e82eb tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] validate_networks() for [('3814a3ee-95c6-407a-903a-c65ed3805cd7', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 14:32:14.154321 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-9f4f0051-16d5-49ca-9469-714f724e82eb tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 14:32:14.154693 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-9f4f0051-16d5-49ca-9469-714f724e82eb tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 14:32:14.155171 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-9f4f0051-16d5-49ca-9469-714f724e82eb tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 14:32:14.155582 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-9f4f0051-16d5-49ca-9469-714f724e82eb tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 14:32:14.155995 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-9f4f0051-16d5-49ca-9469-714f724e82eb tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 14:32:14.165574 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f4f0051-16d5-49ca-9469-714f724e82eb tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:32:14.166055 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f4f0051-16d5-49ca-9469-714f724e82eb tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:32:14.166489 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f4f0051-16d5-49ca-9469-714f724e82eb tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:32:14.167216 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f4f0051-16d5-49ca-9469-714f724e82eb tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:32:14.167673 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f4f0051-16d5-49ca-9469-714f724e82eb tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:32:14.168099 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f4f0051-16d5-49ca-9469-714f724e82eb tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:32:14.187131 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-9f4f0051-16d5-49ca-9469-714f724e82eb tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Getting quotas for project f1e5874a55844a40ab742ed92677880a. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 14:32:14.192744 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.quota [None req-9f4f0051-16d5-49ca-9469-714f724e82eb tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Getting quotas for user 1b26b32a5cf64b01bdd213c66f7249b6 and project f1e5874a55844a40ab742ed92677880a. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 14:32:14.205315 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9f4f0051-16d5-49ca-9469-714f724e82eb tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 14:32:14.207662 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9f4f0051-16d5-49ca-9469-714f724e82eb tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 7753c397-b56d-4a9e-acdb-b0f735f2755f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='762c20f4-0f9b-45cb-bd95-cf21a747b33b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 14:32:14.254594 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9f4f0051-16d5-49ca-9469-714f724e82eb tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.726008 Oct 26 14:32:14.255255 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3981/7988] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 14:32:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 14:32:14.267976 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f909f399-ebf5-4821-95f2-1a913eee7011 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:32:14.268630 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f909f399-ebf5-4821-95f2-1a913eee7011 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 7753c397-b56d-4a9e-acdb-b0f735f2755f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:32:14.323440 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-f909f399-ebf5-4821-95f2-1a913eee7011 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b26b32a5cf64b01bdd213c66f7249b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5874a55844a40ab742ed92677880a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:32:14.330497 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f909f399-ebf5-4821-95f2-1a913eee7011 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "GET /compute/v2.1/servers/7753c397-b56d-4a9e-acdb-b0f735f2755f" status: 200 len: 1247 microversion: 2.1 time: 0.068098 Oct 26 14:32:14.331080 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 4008/7989] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:32:14 2022] GET /compute/v2.1/servers/7753c397-b56d-4a9e-acdb-b0f735f2755f => generated 1247 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:32:15.356765 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-584aa4ce-660b-4292-b807-f9a903062cde tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:32:15.359017 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-584aa4ce-660b-4292-b807-f9a903062cde tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 7753c397-b56d-4a9e-acdb-b0f735f2755f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:32:15.436469 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-584aa4ce-660b-4292-b807-f9a903062cde tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b26b32a5cf64b01bdd213c66f7249b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5874a55844a40ab742ed92677880a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:32:15.444850 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-584aa4ce-660b-4292-b807-f9a903062cde tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "GET /compute/v2.1/servers/7753c397-b56d-4a9e-acdb-b0f735f2755f" status: 200 len: 1247 microversion: 2.1 time: 0.094850 Oct 26 14:32:15.445781 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3982/7990] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:32:15 2022] GET /compute/v2.1/servers/7753c397-b56d-4a9e-acdb-b0f735f2755f => generated 1247 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:32:16.469742 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9f8b6fb5-ae38-4066-b134-fd214a32e7ab tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:32:16.470863 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9f8b6fb5-ae38-4066-b134-fd214a32e7ab tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 7753c397-b56d-4a9e-acdb-b0f735f2755f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:32:16.528552 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-9f8b6fb5-ae38-4066-b134-fd214a32e7ab tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b26b32a5cf64b01bdd213c66f7249b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5874a55844a40ab742ed92677880a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:32:16.536868 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9f8b6fb5-ae38-4066-b134-fd214a32e7ab tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "GET /compute/v2.1/servers/7753c397-b56d-4a9e-acdb-b0f735f2755f" status: 200 len: 1247 microversion: 2.1 time: 0.071898 Oct 26 14:32:16.537880 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 4009/7991] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:32:16 2022] GET /compute/v2.1/servers/7753c397-b56d-4a9e-acdb-b0f735f2755f => generated 1247 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:32:17.560317 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8eb6b963-c264-404b-a811-24df826bde66 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:32:17.560944 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8eb6b963-c264-404b-a811-24df826bde66 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 7753c397-b56d-4a9e-acdb-b0f735f2755f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:32:17.675090 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-8eb6b963-c264-404b-a811-24df826bde66 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b26b32a5cf64b01bdd213c66f7249b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5874a55844a40ab742ed92677880a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:32:17.682329 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8eb6b963-c264-404b-a811-24df826bde66 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "GET /compute/v2.1/servers/7753c397-b56d-4a9e-acdb-b0f735f2755f" status: 200 len: 1247 microversion: 2.1 time: 0.125965 Oct 26 14:32:17.683005 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3983/7992] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:32:17 2022] GET /compute/v2.1/servers/7753c397-b56d-4a9e-acdb-b0f735f2755f => generated 1247 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:32:18.705317 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-06bacb4a-86d1-4a57-8ca5-22a84e4004a5 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:32:18.705976 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-06bacb4a-86d1-4a57-8ca5-22a84e4004a5 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 7753c397-b56d-4a9e-acdb-b0f735f2755f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:32:18.712895 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06bacb4a-86d1-4a57-8ca5-22a84e4004a5 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:32:18.713410 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06bacb4a-86d1-4a57-8ca5-22a84e4004a5 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:32:18.713889 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06bacb4a-86d1-4a57-8ca5-22a84e4004a5 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:32:18.714605 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06bacb4a-86d1-4a57-8ca5-22a84e4004a5 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:32:18.715084 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06bacb4a-86d1-4a57-8ca5-22a84e4004a5 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:32:18.715532 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-06bacb4a-86d1-4a57-8ca5-22a84e4004a5 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:32:18.833635 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-06bacb4a-86d1-4a57-8ca5-22a84e4004a5 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b26b32a5cf64b01bdd213c66f7249b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5874a55844a40ab742ed92677880a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:32:18.841408 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-06bacb4a-86d1-4a57-8ca5-22a84e4004a5 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "GET /compute/v2.1/servers/7753c397-b56d-4a9e-acdb-b0f735f2755f" status: 200 len: 1251 microversion: 2.1 time: 0.140166 Oct 26 14:32:18.842026 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 4010/7993] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:32:18 2022] GET /compute/v2.1/servers/7753c397-b56d-4a9e-acdb-b0f735f2755f => generated 1251 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:32:19.865905 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-23666230-9d03-436e-a656-7c469515b779 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:32:19.866780 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-23666230-9d03-436e-a656-7c469515b779 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 7753c397-b56d-4a9e-acdb-b0f735f2755f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:32:19.879638 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-23666230-9d03-436e-a656-7c469515b779 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:32:19.880153 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-23666230-9d03-436e-a656-7c469515b779 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:32:19.880620 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-23666230-9d03-436e-a656-7c469515b779 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:32:19.881342 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-23666230-9d03-436e-a656-7c469515b779 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:32:19.881825 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-23666230-9d03-436e-a656-7c469515b779 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:32:19.882286 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-23666230-9d03-436e-a656-7c469515b779 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:32:19.948923 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-23666230-9d03-436e-a656-7c469515b779 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b26b32a5cf64b01bdd213c66f7249b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5874a55844a40ab742ed92677880a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:32:19.956952 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-23666230-9d03-436e-a656-7c469515b779 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "GET /compute/v2.1/servers/7753c397-b56d-4a9e-acdb-b0f735f2755f" status: 200 len: 1305 microversion: 2.1 time: 0.095022 Oct 26 14:32:19.957789 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3984/7994] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:32:19 2022] GET /compute/v2.1/servers/7753c397-b56d-4a9e-acdb-b0f735f2755f => generated 1305 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:32:20.980271 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6a1984dd-c9ed-4f4f-b703-72d84cec56e1 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:32:20.981057 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6a1984dd-c9ed-4f4f-b703-72d84cec56e1 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 7753c397-b56d-4a9e-acdb-b0f735f2755f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:32:20.988546 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a1984dd-c9ed-4f4f-b703-72d84cec56e1 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:32:20.989051 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a1984dd-c9ed-4f4f-b703-72d84cec56e1 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:32:20.989519 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a1984dd-c9ed-4f4f-b703-72d84cec56e1 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:32:20.990237 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a1984dd-c9ed-4f4f-b703-72d84cec56e1 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:32:20.990710 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a1984dd-c9ed-4f4f-b703-72d84cec56e1 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:32:20.991223 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6a1984dd-c9ed-4f4f-b703-72d84cec56e1 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:32:21.003977 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-5a9f51a4-885e-4f2c-baad-d43e8c20f0b2 req-d0be3580-7a8f-4d9a-81b4-449316bab248 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7753c397-b56d-4a9e-acdb-b0f735f2755f", "tag": "b31e47b5-a810-448c-8997-c64906f9432a"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:32:21.015394 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-5a9f51a4-885e-4f2c-baad-d43e8c20f0b2 req-d0be3580-7a8f-4d9a-81b4-449316bab248 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:32:21.016232 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-5a9f51a4-885e-4f2c-baad-d43e8c20f0b2 req-d0be3580-7a8f-4d9a-81b4-449316bab248 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:32:21.016679 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-5a9f51a4-885e-4f2c-baad-d43e8c20f0b2 req-d0be3580-7a8f-4d9a-81b4-449316bab248 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:32:21.028669 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-5a9f51a4-885e-4f2c-baad-d43e8c20f0b2 req-d0be3580-7a8f-4d9a-81b4-449316bab248 service nova] Creating event network-changed:b31e47b5-a810-448c-8997-c64906f9432a for instance 7753c397-b56d-4a9e-acdb-b0f735f2755f on n-h1-862686-1 Oct 26 14:32:21.034508 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-5a9f51a4-885e-4f2c-baad-d43e8c20f0b2 req-d0be3580-7a8f-4d9a-81b4-449316bab248 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034199 Oct 26 14:32:21.035193 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3985/7995] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 14:32:21.249681 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-6a1984dd-c9ed-4f4f-b703-72d84cec56e1 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b26b32a5cf64b01bdd213c66f7249b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5874a55844a40ab742ed92677880a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:32:21.257593 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6a1984dd-c9ed-4f4f-b703-72d84cec56e1 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "GET /compute/v2.1/servers/7753c397-b56d-4a9e-acdb-b0f735f2755f" status: 200 len: 1373 microversion: 2.1 time: 0.281212 Oct 26 14:32:21.258624 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 4011/7996] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:32:20 2022] GET /compute/v2.1/servers/7753c397-b56d-4a9e-acdb-b0f735f2755f => generated 1373 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:32:22.281508 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7a3e86ca-958b-4aba-affa-36b4e858542d tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:32:22.282243 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7a3e86ca-958b-4aba-affa-36b4e858542d tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 7753c397-b56d-4a9e-acdb-b0f735f2755f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:32:22.288416 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7a3e86ca-958b-4aba-affa-36b4e858542d tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:32:22.288902 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7a3e86ca-958b-4aba-affa-36b4e858542d tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:32:22.289338 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7a3e86ca-958b-4aba-affa-36b4e858542d tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:32:22.290056 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7a3e86ca-958b-4aba-affa-36b4e858542d tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:32:22.290516 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7a3e86ca-958b-4aba-affa-36b4e858542d tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:32:22.290943 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7a3e86ca-958b-4aba-affa-36b4e858542d tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:32:22.420594 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-7a3e86ca-958b-4aba-affa-36b4e858542d tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b26b32a5cf64b01bdd213c66f7249b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5874a55844a40ab742ed92677880a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:32:22.429816 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7a3e86ca-958b-4aba-affa-36b4e858542d tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "GET /compute/v2.1/servers/7753c397-b56d-4a9e-acdb-b0f735f2755f" status: 200 len: 1373 microversion: 2.1 time: 0.153308 Oct 26 14:32:22.430396 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3986/7997] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:32:22 2022] GET /compute/v2.1/servers/7753c397-b56d-4a9e-acdb-b0f735f2755f => generated 1373 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:32:23.454190 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1d8b37b0-67f4-42d2-bf50-a1c0b14e8f52 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:32:23.454897 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1d8b37b0-67f4-42d2-bf50-a1c0b14e8f52 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 7753c397-b56d-4a9e-acdb-b0f735f2755f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:32:23.461967 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1d8b37b0-67f4-42d2-bf50-a1c0b14e8f52 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:32:23.462410 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1d8b37b0-67f4-42d2-bf50-a1c0b14e8f52 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:32:23.462862 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1d8b37b0-67f4-42d2-bf50-a1c0b14e8f52 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:32:23.463573 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1d8b37b0-67f4-42d2-bf50-a1c0b14e8f52 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:32:23.464046 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1d8b37b0-67f4-42d2-bf50-a1c0b14e8f52 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:32:23.464489 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1d8b37b0-67f4-42d2-bf50-a1c0b14e8f52 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:32:23.601220 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-1d8b37b0-67f4-42d2-bf50-a1c0b14e8f52 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b26b32a5cf64b01bdd213c66f7249b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5874a55844a40ab742ed92677880a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:32:23.608960 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1d8b37b0-67f4-42d2-bf50-a1c0b14e8f52 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "GET /compute/v2.1/servers/7753c397-b56d-4a9e-acdb-b0f735f2755f" status: 200 len: 1373 microversion: 2.1 time: 0.159531 Oct 26 14:32:23.609569 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 4012/7998] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:32:23 2022] GET /compute/v2.1/servers/7753c397-b56d-4a9e-acdb-b0f735f2755f => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:32:24.632428 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d0506da3-a21f-4020-9730-84419d37aeac tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:32:24.633192 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d0506da3-a21f-4020-9730-84419d37aeac tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 7753c397-b56d-4a9e-acdb-b0f735f2755f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:32:24.636125 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:32:24.641721 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d0506da3-a21f-4020-9730-84419d37aeac tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:32:24.642215 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d0506da3-a21f-4020-9730-84419d37aeac tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:32:24.642652 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d0506da3-a21f-4020-9730-84419d37aeac tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:32:24.643345 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d0506da3-a21f-4020-9730-84419d37aeac tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:32:24.643800 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d0506da3-a21f-4020-9730-84419d37aeac tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:32:24.644222 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d0506da3-a21f-4020-9730-84419d37aeac tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:32:24.777772 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-d0506da3-a21f-4020-9730-84419d37aeac tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b26b32a5cf64b01bdd213c66f7249b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5874a55844a40ab742ed92677880a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:32:24.786619 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d0506da3-a21f-4020-9730-84419d37aeac tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "GET /compute/v2.1/servers/7753c397-b56d-4a9e-acdb-b0f735f2755f" status: 200 len: 1373 microversion: 2.1 time: 0.158171 Oct 26 14:32:24.787213 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3987/7999] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:32:24 2022] GET /compute/v2.1/servers/7753c397-b56d-4a9e-acdb-b0f735f2755f => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:32:25.810313 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7bc03427-0827-4e51-bb6c-464f5e724943 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:32:25.810966 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7bc03427-0827-4e51-bb6c-464f5e724943 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 7753c397-b56d-4a9e-acdb-b0f735f2755f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:32:25.818645 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7bc03427-0827-4e51-bb6c-464f5e724943 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:32:25.819142 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7bc03427-0827-4e51-bb6c-464f5e724943 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:32:25.819594 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7bc03427-0827-4e51-bb6c-464f5e724943 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:32:25.820304 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7bc03427-0827-4e51-bb6c-464f5e724943 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:32:25.820779 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7bc03427-0827-4e51-bb6c-464f5e724943 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:32:25.821222 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7bc03427-0827-4e51-bb6c-464f5e724943 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:32:25.959069 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7bc03427-0827-4e51-bb6c-464f5e724943 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b26b32a5cf64b01bdd213c66f7249b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5874a55844a40ab742ed92677880a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:32:25.966660 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7bc03427-0827-4e51-bb6c-464f5e724943 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "GET /compute/v2.1/servers/7753c397-b56d-4a9e-acdb-b0f735f2755f" status: 200 len: 1373 microversion: 2.1 time: 0.160414 Oct 26 14:32:25.967233 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 4013/8000] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:32:25 2022] GET /compute/v2.1/servers/7753c397-b56d-4a9e-acdb-b0f735f2755f => generated 1373 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:32:26.142356 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-737deb68-ca02-4092-b834-efeb91f108bc req-e3d63631-6172-45ea-bc60-8cb3a222495c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7753c397-b56d-4a9e-acdb-b0f735f2755f", "name": "network-vif-plugged", "status": "completed", "tag": "b31e47b5-a810-448c-8997-c64906f9432a"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:32:26.153290 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-737deb68-ca02-4092-b834-efeb91f108bc req-e3d63631-6172-45ea-bc60-8cb3a222495c service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:32:26.153800 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-737deb68-ca02-4092-b834-efeb91f108bc req-e3d63631-6172-45ea-bc60-8cb3a222495c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:32:26.154237 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-737deb68-ca02-4092-b834-efeb91f108bc req-e3d63631-6172-45ea-bc60-8cb3a222495c service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:32:26.166950 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-737deb68-ca02-4092-b834-efeb91f108bc req-e3d63631-6172-45ea-bc60-8cb3a222495c service nova] Creating event network-vif-plugged:b31e47b5-a810-448c-8997-c64906f9432a for instance 7753c397-b56d-4a9e-acdb-b0f735f2755f on n-h1-862686-1 Oct 26 14:32:26.172360 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-737deb68-ca02-4092-b834-efeb91f108bc req-e3d63631-6172-45ea-bc60-8cb3a222495c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033766 Oct 26 14:32:26.172969 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3988/8001] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:32:26.990509 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-176e0cc4-baba-4d64-bfb6-6276d92d87b6 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:32:26.991133 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-176e0cc4-baba-4d64-bfb6-6276d92d87b6 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 7753c397-b56d-4a9e-acdb-b0f735f2755f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:32:26.992986 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=8 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:32:26.999128 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-176e0cc4-baba-4d64-bfb6-6276d92d87b6 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:32:26.999629 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-176e0cc4-baba-4d64-bfb6-6276d92d87b6 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:32:27.000083 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-176e0cc4-baba-4d64-bfb6-6276d92d87b6 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:32:27.001025 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-176e0cc4-baba-4d64-bfb6-6276d92d87b6 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:32:27.001532 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-176e0cc4-baba-4d64-bfb6-6276d92d87b6 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:32:27.001980 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-176e0cc4-baba-4d64-bfb6-6276d92d87b6 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:32:27.136037 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-176e0cc4-baba-4d64-bfb6-6276d92d87b6 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b26b32a5cf64b01bdd213c66f7249b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5874a55844a40ab742ed92677880a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:32:27.143953 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-176e0cc4-baba-4d64-bfb6-6276d92d87b6 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "GET /compute/v2.1/servers/7753c397-b56d-4a9e-acdb-b0f735f2755f" status: 200 len: 1373 microversion: 2.1 time: 0.157496 Oct 26 14:32:27.144527 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 4014/8002] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:32:26 2022] GET /compute/v2.1/servers/7753c397-b56d-4a9e-acdb-b0f735f2755f => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:32:28.165454 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=10 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:32:28.170146 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0277b2f5-8a0c-4ffc-bc7f-ae08484bde67 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:32:28.170878 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0277b2f5-8a0c-4ffc-bc7f-ae08484bde67 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 7753c397-b56d-4a9e-acdb-b0f735f2755f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:32:28.177858 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0277b2f5-8a0c-4ffc-bc7f-ae08484bde67 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:32:28.178350 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0277b2f5-8a0c-4ffc-bc7f-ae08484bde67 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:32:28.178795 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0277b2f5-8a0c-4ffc-bc7f-ae08484bde67 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:32:28.179492 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0277b2f5-8a0c-4ffc-bc7f-ae08484bde67 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:32:28.179951 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0277b2f5-8a0c-4ffc-bc7f-ae08484bde67 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:32:28.180384 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0277b2f5-8a0c-4ffc-bc7f-ae08484bde67 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:32:28.315673 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-0277b2f5-8a0c-4ffc-bc7f-ae08484bde67 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b26b32a5cf64b01bdd213c66f7249b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5874a55844a40ab742ed92677880a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:32:28.323397 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0277b2f5-8a0c-4ffc-bc7f-ae08484bde67 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "GET /compute/v2.1/servers/7753c397-b56d-4a9e-acdb-b0f735f2755f" status: 200 len: 1558 microversion: 2.1 time: 0.159842 Oct 26 14:32:28.323982 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3989/8003] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:32:28 2022] GET /compute/v2.1/servers/7753c397-b56d-4a9e-acdb-b0f735f2755f => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:32:28.346249 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-38969806-850b-47c4-be60-495b8519cf78 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:32:28.346885 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-38969806-850b-47c4-be60-495b8519cf78 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 7753c397-b56d-4a9e-acdb-b0f735f2755f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:32:28.353648 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38969806-850b-47c4-be60-495b8519cf78 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:32:28.354142 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38969806-850b-47c4-be60-495b8519cf78 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:32:28.354592 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38969806-850b-47c4-be60-495b8519cf78 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:32:28.355297 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38969806-850b-47c4-be60-495b8519cf78 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:32:28.355764 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38969806-850b-47c4-be60-495b8519cf78 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:32:28.356202 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38969806-850b-47c4-be60-495b8519cf78 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:32:28.489014 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-38969806-850b-47c4-be60-495b8519cf78 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b26b32a5cf64b01bdd213c66f7249b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5874a55844a40ab742ed92677880a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:32:28.496686 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-38969806-850b-47c4-be60-495b8519cf78 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "GET /compute/v2.1/servers/7753c397-b56d-4a9e-acdb-b0f735f2755f" status: 200 len: 1558 microversion: 2.1 time: 0.155350 Oct 26 14:32:28.497259 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 4015/8004] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:32:28 2022] GET /compute/v2.1/servers/7753c397-b56d-4a9e-acdb-b0f735f2755f => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:32:30.404219 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-2dbe9da1-5715-4a62-a787-5783d24b0a3c req-bff31b07-67c5-4cd7-9ed5-124e183c2f30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7753c397-b56d-4a9e-acdb-b0f735f2755f", "tag": "b31e47b5-a810-448c-8997-c64906f9432a"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:32:30.414686 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2dbe9da1-5715-4a62-a787-5783d24b0a3c req-bff31b07-67c5-4cd7-9ed5-124e183c2f30 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:32:30.415175 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2dbe9da1-5715-4a62-a787-5783d24b0a3c req-bff31b07-67c5-4cd7-9ed5-124e183c2f30 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:32:30.415609 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2dbe9da1-5715-4a62-a787-5783d24b0a3c req-bff31b07-67c5-4cd7-9ed5-124e183c2f30 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:32:30.427363 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-2dbe9da1-5715-4a62-a787-5783d24b0a3c req-bff31b07-67c5-4cd7-9ed5-124e183c2f30 service nova] Creating event network-changed:b31e47b5-a810-448c-8997-c64906f9432a for instance 7753c397-b56d-4a9e-acdb-b0f735f2755f on n-h1-862686-1 Oct 26 14:32:30.432573 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-2dbe9da1-5715-4a62-a787-5783d24b0a3c req-bff31b07-67c5-4cd7-9ed5-124e183c2f30 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032110 Oct 26 14:32:30.433192 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3990/8005] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:34:27.806333 n-d-862686-1 devstack@n-api.service[120598]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bbf40942-d6c8-479f-a0f4-15bbba6fd52c] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 26 14:34:27.807246 n-d-862686-1 devstack@n-api.service[120598]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b813bc1f-3720-4149-820f-44a58aef8a8e] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 26 14:34:27.808081 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:34:27.808838 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=36 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:34:27.810476 n-d-862686-1 devstack@n-api.service[120598]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 26 14:34:27.810644 n-d-862686-1 devstack@n-api.service[120598]: Wed Oct 26 14:34:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7753c397-b56d-4a9e-acdb-b0f735f2755f/action (ip 10.222.0.40) !!! Oct 26 14:34:27.817374 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ac38ced1-4257-40dd-ab47-580afa0e81a9 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-2145801529"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:34:27.820427 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ac38ced1-4257-40dd-ab47-580afa0e81a9 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 7753c397-b56d-4a9e-acdb-b0f735f2755f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:34:27.831433 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac38ced1-4257-40dd-ab47-580afa0e81a9 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:34:27.831934 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac38ced1-4257-40dd-ab47-580afa0e81a9 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:34:27.832384 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac38ced1-4257-40dd-ab47-580afa0e81a9 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:34:27.833094 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac38ced1-4257-40dd-ab47-580afa0e81a9 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:34:27.833596 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac38ced1-4257-40dd-ab47-580afa0e81a9 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:34:27.834352 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac38ced1-4257-40dd-ab47-580afa0e81a9 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:34:28.038375 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ac38ced1-4257-40dd-ab47-580afa0e81a9 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "POST /compute/v2.1/servers/7753c397-b56d-4a9e-acdb-b0f735f2755f/action" status: 202 len: 0 microversion: 2.1 time: 0.233813 Oct 26 14:34:28.039037 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 4016/8006] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 14:34:27 2022] POST /compute/v2.1/servers/7753c397-b56d-4a9e-acdb-b0f735f2755f/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 26 14:34:32.701425 n-d-862686-1 devstack@n-api.service[120597]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c037a1b0-cfe5-48ae-b7c7-2931306917f8] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 26 14:34:32.702282 n-d-862686-1 devstack@n-api.service[120597]: ERROR oslo.messaging._drivers.impl_rabbit [-] [49d83c38-b9cd-4e3f-8d2d-83b99234c8c3] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 26 14:34:32.702885 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:34:32.704236 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=32 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:34:32.718020 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-3a2d2a0b-bed7-41c2-bb69-dcda9b5a6633 req-9c1c59c9-cfa2-4a22-8899-1e76a067df3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7753c397-b56d-4a9e-acdb-b0f735f2755f", "name": "network-vif-plugged", "status": "completed", "tag": "b31e47b5-a810-448c-8997-c64906f9432a"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:34:32.731043 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-3a2d2a0b-bed7-41c2-bb69-dcda9b5a6633 req-9c1c59c9-cfa2-4a22-8899-1e76a067df3f service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:34:32.731556 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-3a2d2a0b-bed7-41c2-bb69-dcda9b5a6633 req-9c1c59c9-cfa2-4a22-8899-1e76a067df3f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:34:32.732192 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-3a2d2a0b-bed7-41c2-bb69-dcda9b5a6633 req-9c1c59c9-cfa2-4a22-8899-1e76a067df3f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:34:32.754238 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-3a2d2a0b-bed7-41c2-bb69-dcda9b5a6633 req-9c1c59c9-cfa2-4a22-8899-1e76a067df3f service nova] Creating event network-vif-plugged:b31e47b5-a810-448c-8997-c64906f9432a for instance 7753c397-b56d-4a9e-acdb-b0f735f2755f on n-h1-862686-1 Oct 26 14:34:32.760128 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-3a2d2a0b-bed7-41c2-bb69-dcda9b5a6633 req-9c1c59c9-cfa2-4a22-8899-1e76a067df3f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060556 Oct 26 14:34:32.761032 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3991/8007] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:34:41.575914 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:34:41.576710 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:34:41.581961 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a95c2a72-f7c8-4bdc-9c3e-8da75cbfb846 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1367996630", "imageRef": "816dee6d-1337-476c-9e50-30bb5a291d0e", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-341990740", "security_groups": [{"name": "tempest-secgroup-smoke-1666105834"}], "networks": [{"uuid": "3814a3ee-95c6-407a-903a-c65ed3805cd7"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:34:41.606976 n-d-862686-1 devstack@n-api.service[120598]: INFO oslo.messaging._drivers.impl_rabbit [-] [b813bc1f-3720-4149-820f-44a58aef8a8e] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 39230. Oct 26 14:34:41.609587 n-d-862686-1 devstack@n-api.service[120598]: INFO oslo.messaging._drivers.impl_rabbit [-] [bbf40942-d6c8-479f-a0f4-15bbba6fd52c] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 39228. Oct 26 14:34:41.694249 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-a95c2a72-f7c8-4bdc-9c3e-8da75cbfb846 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] validate_networks() for [('3814a3ee-95c6-407a-903a-c65ed3805cd7', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 14:34:42.129977 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-a95c2a72-f7c8-4bdc-9c3e-8da75cbfb846 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 14:34:42.130425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-a95c2a72-f7c8-4bdc-9c3e-8da75cbfb846 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 14:34:42.130917 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-a95c2a72-f7c8-4bdc-9c3e-8da75cbfb846 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 14:34:42.131344 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-a95c2a72-f7c8-4bdc-9c3e-8da75cbfb846 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 14:34:42.131773 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-a95c2a72-f7c8-4bdc-9c3e-8da75cbfb846 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 14:34:42.140598 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a95c2a72-f7c8-4bdc-9c3e-8da75cbfb846 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:34:42.141091 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a95c2a72-f7c8-4bdc-9c3e-8da75cbfb846 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:34:42.141574 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a95c2a72-f7c8-4bdc-9c3e-8da75cbfb846 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:34:42.142313 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a95c2a72-f7c8-4bdc-9c3e-8da75cbfb846 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:34:42.143154 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a95c2a72-f7c8-4bdc-9c3e-8da75cbfb846 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:34:42.143603 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a95c2a72-f7c8-4bdc-9c3e-8da75cbfb846 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:34:42.160280 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-a95c2a72-f7c8-4bdc-9c3e-8da75cbfb846 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Getting quotas for project f1e5874a55844a40ab742ed92677880a. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 14:34:42.165641 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.quota [None req-a95c2a72-f7c8-4bdc-9c3e-8da75cbfb846 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Getting quotas for user 1b26b32a5cf64b01bdd213c66f7249b6 and project f1e5874a55844a40ab742ed92677880a. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 14:34:42.178649 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a95c2a72-f7c8-4bdc-9c3e-8da75cbfb846 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 14:34:42.181126 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a95c2a72-f7c8-4bdc-9c3e-8da75cbfb846 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 1d6c75b8-a193-4ce7-982f-be436a7e228a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='816dee6d-1337-476c-9e50-30bb5a291d0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 14:34:42.229156 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a95c2a72-f7c8-4bdc-9c3e-8da75cbfb846 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.655411 Oct 26 14:34:42.230070 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 4017/8008] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 26 14:34:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 14:34:42.245581 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c82817bf-1f24-4273-b404-4d8bd01a251c tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:34:42.246889 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c82817bf-1f24-4273-b404-4d8bd01a251c tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 1d6c75b8-a193-4ce7-982f-be436a7e228a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:34:42.259854 n-d-862686-1 devstack@n-api.service[120597]: INFO oslo.messaging._drivers.impl_rabbit [-] [49d83c38-b9cd-4e3f-8d2d-83b99234c8c3] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 39246. Oct 26 14:34:42.263057 n-d-862686-1 devstack@n-api.service[120597]: INFO oslo.messaging._drivers.impl_rabbit [-] [c037a1b0-cfe5-48ae-b7c7-2931306917f8] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 39244. Oct 26 14:34:42.312994 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-c82817bf-1f24-4273-b404-4d8bd01a251c tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b26b32a5cf64b01bdd213c66f7249b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5874a55844a40ab742ed92677880a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:34:42.321440 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c82817bf-1f24-4273-b404-4d8bd01a251c tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "GET /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a" status: 200 len: 1248 microversion: 2.1 time: 0.083797 Oct 26 14:34:42.322045 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3992/8009] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:34:42 2022] GET /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a => generated 1248 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:34:43.345682 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ff81e3c1-d8de-4f95-bd0d-5a8d59853a34 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:34:43.346355 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ff81e3c1-d8de-4f95-bd0d-5a8d59853a34 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 1d6c75b8-a193-4ce7-982f-be436a7e228a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:34:43.352738 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ff81e3c1-d8de-4f95-bd0d-5a8d59853a34 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:34:43.353237 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ff81e3c1-d8de-4f95-bd0d-5a8d59853a34 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:34:43.353722 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ff81e3c1-d8de-4f95-bd0d-5a8d59853a34 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:34:43.354427 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ff81e3c1-d8de-4f95-bd0d-5a8d59853a34 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:34:43.354896 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ff81e3c1-d8de-4f95-bd0d-5a8d59853a34 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:34:43.355335 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ff81e3c1-d8de-4f95-bd0d-5a8d59853a34 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:34:43.427329 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ff81e3c1-d8de-4f95-bd0d-5a8d59853a34 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b26b32a5cf64b01bdd213c66f7249b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5874a55844a40ab742ed92677880a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:34:43.436711 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ff81e3c1-d8de-4f95-bd0d-5a8d59853a34 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "GET /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a" status: 200 len: 1300 microversion: 2.1 time: 0.096109 Oct 26 14:34:43.437650 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 4018/8010] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:34:43 2022] GET /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a => generated 1300 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:34:44.462707 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ecc6ec1b-64aa-4f72-980a-d5c16459cb9e tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:34:44.464084 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ecc6ec1b-64aa-4f72-980a-d5c16459cb9e tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 1d6c75b8-a193-4ce7-982f-be436a7e228a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:34:44.466132 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:34:44.477792 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ecc6ec1b-64aa-4f72-980a-d5c16459cb9e tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:34:44.478649 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ecc6ec1b-64aa-4f72-980a-d5c16459cb9e tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:34:44.479315 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ecc6ec1b-64aa-4f72-980a-d5c16459cb9e tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:34:44.480101 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ecc6ec1b-64aa-4f72-980a-d5c16459cb9e tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:34:44.480635 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ecc6ec1b-64aa-4f72-980a-d5c16459cb9e tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:34:44.481125 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ecc6ec1b-64aa-4f72-980a-d5c16459cb9e tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:34:44.748584 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-f7212aef-c2ec-49d5-9d54-26ac1bd76105 req-33df0b05-e1b8-4e8d-9c67-cd622cafe1fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7753c397-b56d-4a9e-acdb-b0f735f2755f", "name": "network-vif-unplugged", "status": "completed", "tag": "b31e47b5-a810-448c-8997-c64906f9432a"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:34:44.777425 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f7212aef-c2ec-49d5-9d54-26ac1bd76105 req-33df0b05-e1b8-4e8d-9c67-cd622cafe1fe service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:34:44.778941 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f7212aef-c2ec-49d5-9d54-26ac1bd76105 req-33df0b05-e1b8-4e8d-9c67-cd622cafe1fe service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:34:44.779940 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f7212aef-c2ec-49d5-9d54-26ac1bd76105 req-33df0b05-e1b8-4e8d-9c67-cd622cafe1fe service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:34:44.802764 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-ecc6ec1b-64aa-4f72-980a-d5c16459cb9e tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b26b32a5cf64b01bdd213c66f7249b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5874a55844a40ab742ed92677880a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:34:44.816388 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ecc6ec1b-64aa-4f72-980a-d5c16459cb9e tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "GET /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a" status: 200 len: 1374 microversion: 2.1 time: 0.358871 Oct 26 14:34:44.816914 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-f7212aef-c2ec-49d5-9d54-26ac1bd76105 req-33df0b05-e1b8-4e8d-9c67-cd622cafe1fe service nova] Creating event network-vif-unplugged:b31e47b5-a810-448c-8997-c64906f9432a for instance 7753c397-b56d-4a9e-acdb-b0f735f2755f on n-h1-862686-1 Oct 26 14:34:44.818404 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3993/8011] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:34:44 2022] GET /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a => generated 1374 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 14:34:44.842994 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-f7212aef-c2ec-49d5-9d54-26ac1bd76105 req-33df0b05-e1b8-4e8d-9c67-cd622cafe1fe service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099036 Oct 26 14:34:44.843768 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 4019/8012] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:34:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 14:34:45.843523 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5ef88fc5-a8dd-481e-9201-2ec2cfdc4e57 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:34:45.844762 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5ef88fc5-a8dd-481e-9201-2ec2cfdc4e57 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 1d6c75b8-a193-4ce7-982f-be436a7e228a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:34:45.857542 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ef88fc5-a8dd-481e-9201-2ec2cfdc4e57 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:34:45.858458 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ef88fc5-a8dd-481e-9201-2ec2cfdc4e57 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:34:45.859235 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ef88fc5-a8dd-481e-9201-2ec2cfdc4e57 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:34:45.860232 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ef88fc5-a8dd-481e-9201-2ec2cfdc4e57 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:34:45.860917 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ef88fc5-a8dd-481e-9201-2ec2cfdc4e57 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:34:45.862263 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5ef88fc5-a8dd-481e-9201-2ec2cfdc4e57 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:34:46.022837 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-5ef88fc5-a8dd-481e-9201-2ec2cfdc4e57 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b26b32a5cf64b01bdd213c66f7249b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5874a55844a40ab742ed92677880a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:34:46.037864 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5ef88fc5-a8dd-481e-9201-2ec2cfdc4e57 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "GET /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a" status: 200 len: 1374 microversion: 2.1 time: 0.198822 Oct 26 14:34:46.054769 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3994/8013] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:34:45 2022] GET /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a => generated 1374 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:34:47.065170 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7aaaa079-b116-4615-bf85-9b7720323f73 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:34:47.065928 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7aaaa079-b116-4615-bf85-9b7720323f73 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 1d6c75b8-a193-4ce7-982f-be436a7e228a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:34:47.073095 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7aaaa079-b116-4615-bf85-9b7720323f73 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:34:47.073863 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7aaaa079-b116-4615-bf85-9b7720323f73 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:34:47.074469 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7aaaa079-b116-4615-bf85-9b7720323f73 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:34:47.075337 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7aaaa079-b116-4615-bf85-9b7720323f73 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:34:47.075849 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7aaaa079-b116-4615-bf85-9b7720323f73 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:34:47.076371 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7aaaa079-b116-4615-bf85-9b7720323f73 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:34:47.223079 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-7aaaa079-b116-4615-bf85-9b7720323f73 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b26b32a5cf64b01bdd213c66f7249b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5874a55844a40ab742ed92677880a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:34:47.231306 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7aaaa079-b116-4615-bf85-9b7720323f73 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "GET /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a" status: 200 len: 1374 microversion: 2.1 time: 0.171722 Oct 26 14:34:47.231894 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 4020/8014] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:34:47 2022] GET /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a => generated 1374 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:34:48.256792 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-188a5f71-cf52-4b28-8317-66de419ba7f2 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:34:48.257590 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-188a5f71-cf52-4b28-8317-66de419ba7f2 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 1d6c75b8-a193-4ce7-982f-be436a7e228a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:34:48.264812 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-188a5f71-cf52-4b28-8317-66de419ba7f2 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:34:48.265719 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-188a5f71-cf52-4b28-8317-66de419ba7f2 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:34:48.266276 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-188a5f71-cf52-4b28-8317-66de419ba7f2 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:34:48.267102 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-188a5f71-cf52-4b28-8317-66de419ba7f2 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:34:48.268834 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-188a5f71-cf52-4b28-8317-66de419ba7f2 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:34:48.269371 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-188a5f71-cf52-4b28-8317-66de419ba7f2 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:34:48.424496 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-188a5f71-cf52-4b28-8317-66de419ba7f2 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b26b32a5cf64b01bdd213c66f7249b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5874a55844a40ab742ed92677880a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:34:48.433606 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-188a5f71-cf52-4b28-8317-66de419ba7f2 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "GET /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a" status: 200 len: 1374 microversion: 2.1 time: 0.181940 Oct 26 14:34:48.445748 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3995/8015] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:34:48 2022] GET /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a => generated 1374 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:34:49.458757 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ac245dd9-30fb-483a-bf42-2d896bb12bcd tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:34:49.460302 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ac245dd9-30fb-483a-bf42-2d896bb12bcd tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 1d6c75b8-a193-4ce7-982f-be436a7e228a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:34:49.481124 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac245dd9-30fb-483a-bf42-2d896bb12bcd tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:34:49.481670 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac245dd9-30fb-483a-bf42-2d896bb12bcd tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:34:49.482148 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac245dd9-30fb-483a-bf42-2d896bb12bcd tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:34:49.483095 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac245dd9-30fb-483a-bf42-2d896bb12bcd tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:34:49.483569 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac245dd9-30fb-483a-bf42-2d896bb12bcd tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:34:49.484015 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ac245dd9-30fb-483a-bf42-2d896bb12bcd tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:34:49.682584 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-ac245dd9-30fb-483a-bf42-2d896bb12bcd tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b26b32a5cf64b01bdd213c66f7249b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5874a55844a40ab742ed92677880a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:34:49.697522 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ac245dd9-30fb-483a-bf42-2d896bb12bcd tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "GET /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a" status: 200 len: 1374 microversion: 2.1 time: 0.244034 Oct 26 14:34:49.698884 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 4021/8016] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:34:49 2022] GET /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a => generated 1374 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:34:50.724598 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e4cb1240-10b9-46e2-a65e-6ceb9ebdee52 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:34:50.726606 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e4cb1240-10b9-46e2-a65e-6ceb9ebdee52 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 1d6c75b8-a193-4ce7-982f-be436a7e228a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:34:50.734849 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e4cb1240-10b9-46e2-a65e-6ceb9ebdee52 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:34:50.736264 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e4cb1240-10b9-46e2-a65e-6ceb9ebdee52 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:34:50.737011 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e4cb1240-10b9-46e2-a65e-6ceb9ebdee52 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:34:50.738288 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e4cb1240-10b9-46e2-a65e-6ceb9ebdee52 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:34:50.738822 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e4cb1240-10b9-46e2-a65e-6ceb9ebdee52 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:34:50.739206 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e4cb1240-10b9-46e2-a65e-6ceb9ebdee52 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:34:50.891895 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-e4cb1240-10b9-46e2-a65e-6ceb9ebdee52 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b26b32a5cf64b01bdd213c66f7249b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5874a55844a40ab742ed92677880a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:34:50.900564 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e4cb1240-10b9-46e2-a65e-6ceb9ebdee52 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "GET /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a" status: 200 len: 1374 microversion: 2.1 time: 0.180611 Oct 26 14:34:50.901158 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3996/8017] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:34:50 2022] GET /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a => generated 1374 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:34:51.925258 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3005ed6f-9363-4291-b72d-7d11f8f4180c tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:34:51.925947 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3005ed6f-9363-4291-b72d-7d11f8f4180c tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 1d6c75b8-a193-4ce7-982f-be436a7e228a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:34:51.932897 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3005ed6f-9363-4291-b72d-7d11f8f4180c tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:34:51.933397 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3005ed6f-9363-4291-b72d-7d11f8f4180c tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:34:51.933895 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3005ed6f-9363-4291-b72d-7d11f8f4180c tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:34:51.934652 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3005ed6f-9363-4291-b72d-7d11f8f4180c tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:34:51.935134 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3005ed6f-9363-4291-b72d-7d11f8f4180c tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:34:51.935577 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3005ed6f-9363-4291-b72d-7d11f8f4180c tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:34:52.081375 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-3005ed6f-9363-4291-b72d-7d11f8f4180c tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b26b32a5cf64b01bdd213c66f7249b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5874a55844a40ab742ed92677880a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:34:52.089458 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3005ed6f-9363-4291-b72d-7d11f8f4180c tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "GET /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a" status: 200 len: 1374 microversion: 2.1 time: 0.169253 Oct 26 14:34:52.090064 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 4022/8018] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:34:51 2022] GET /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a => generated 1374 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:34:52.374532 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-8305416f-1e4e-456a-98db-6d8ab55a7004 req-a6b49131-5a6b-4fc6-b67f-b4e63a021f33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d6c75b8-a193-4ce7-982f-be436a7e228a", "tag": "e3d314eb-67e4-4df7-ab59-cbfae1cabd6c"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:34:52.381238 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:34:52.386936 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-8305416f-1e4e-456a-98db-6d8ab55a7004 req-a6b49131-5a6b-4fc6-b67f-b4e63a021f33 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:34:52.397813 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-8305416f-1e4e-456a-98db-6d8ab55a7004 req-a6b49131-5a6b-4fc6-b67f-b4e63a021f33 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:34:52.398246 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-8305416f-1e4e-456a-98db-6d8ab55a7004 req-a6b49131-5a6b-4fc6-b67f-b4e63a021f33 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:34:52.413222 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-8305416f-1e4e-456a-98db-6d8ab55a7004 req-a6b49131-5a6b-4fc6-b67f-b4e63a021f33 service nova] Creating event network-changed:e3d314eb-67e4-4df7-ab59-cbfae1cabd6c for instance 1d6c75b8-a193-4ce7-982f-be436a7e228a on n-h2-862686-1 Oct 26 14:34:52.418463 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-8305416f-1e4e-456a-98db-6d8ab55a7004 req-a6b49131-5a6b-4fc6-b67f-b4e63a021f33 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047592 Oct 26 14:34:52.419194 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3997/8019] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:34:53.114768 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-900f94cc-fde0-4cae-aed1-34a0e8d71681 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:34:53.115441 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-900f94cc-fde0-4cae-aed1-34a0e8d71681 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 1d6c75b8-a193-4ce7-982f-be436a7e228a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:34:53.117408 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:34:53.118402 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:34:53.125201 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-900f94cc-fde0-4cae-aed1-34a0e8d71681 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:34:53.125733 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-900f94cc-fde0-4cae-aed1-34a0e8d71681 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:34:53.126192 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-900f94cc-fde0-4cae-aed1-34a0e8d71681 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:34:53.126932 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-900f94cc-fde0-4cae-aed1-34a0e8d71681 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:34:53.127501 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-900f94cc-fde0-4cae-aed1-34a0e8d71681 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:34:53.127960 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-900f94cc-fde0-4cae-aed1-34a0e8d71681 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:34:53.261123 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-900f94cc-fde0-4cae-aed1-34a0e8d71681 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b26b32a5cf64b01bdd213c66f7249b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5874a55844a40ab742ed92677880a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:34:53.269152 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-900f94cc-fde0-4cae-aed1-34a0e8d71681 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "GET /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a" status: 200 len: 1374 microversion: 2.1 time: 0.159094 Oct 26 14:34:53.269769 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 4023/8020] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:34:53 2022] GET /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:34:54.293037 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4af97ae3-b3e4-4e29-b38d-ceb13da4894e tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:34:54.293791 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4af97ae3-b3e4-4e29-b38d-ceb13da4894e tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 1d6c75b8-a193-4ce7-982f-be436a7e228a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:34:54.300910 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4af97ae3-b3e4-4e29-b38d-ceb13da4894e tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:34:54.301403 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4af97ae3-b3e4-4e29-b38d-ceb13da4894e tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:34:54.301878 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4af97ae3-b3e4-4e29-b38d-ceb13da4894e tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:34:54.302583 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4af97ae3-b3e4-4e29-b38d-ceb13da4894e tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:34:54.303045 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4af97ae3-b3e4-4e29-b38d-ceb13da4894e tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:34:54.303475 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4af97ae3-b3e4-4e29-b38d-ceb13da4894e tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:34:54.441642 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-4af97ae3-b3e4-4e29-b38d-ceb13da4894e tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b26b32a5cf64b01bdd213c66f7249b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5874a55844a40ab742ed92677880a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:34:54.449616 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4af97ae3-b3e4-4e29-b38d-ceb13da4894e tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "GET /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a" status: 200 len: 1374 microversion: 2.1 time: 0.161617 Oct 26 14:34:54.450200 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3998/8021] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:34:54 2022] GET /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:34:55.472613 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b9910586-6153-456a-bebe-2eddb859e23f tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:34:55.473239 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b9910586-6153-456a-bebe-2eddb859e23f tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 1d6c75b8-a193-4ce7-982f-be436a7e228a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:34:55.480135 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9910586-6153-456a-bebe-2eddb859e23f tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:34:55.480637 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9910586-6153-456a-bebe-2eddb859e23f tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:34:55.481093 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9910586-6153-456a-bebe-2eddb859e23f tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:34:55.481841 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9910586-6153-456a-bebe-2eddb859e23f tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:34:55.482316 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9910586-6153-456a-bebe-2eddb859e23f tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:34:55.482760 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9910586-6153-456a-bebe-2eddb859e23f tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:34:55.615937 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b9910586-6153-456a-bebe-2eddb859e23f tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b26b32a5cf64b01bdd213c66f7249b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5874a55844a40ab742ed92677880a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:34:55.623601 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b9910586-6153-456a-bebe-2eddb859e23f tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "GET /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a" status: 200 len: 1374 microversion: 2.1 time: 0.155029 Oct 26 14:34:55.624193 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 4024/8022] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:34:55 2022] GET /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:34:56.648203 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-69bfff64-5b12-4174-a4fb-fae3a4423c36 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:34:56.648815 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-69bfff64-5b12-4174-a4fb-fae3a4423c36 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 1d6c75b8-a193-4ce7-982f-be436a7e228a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:34:56.655890 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69bfff64-5b12-4174-a4fb-fae3a4423c36 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:34:56.656373 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69bfff64-5b12-4174-a4fb-fae3a4423c36 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:34:56.656813 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69bfff64-5b12-4174-a4fb-fae3a4423c36 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:34:56.657516 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69bfff64-5b12-4174-a4fb-fae3a4423c36 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:34:56.658641 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69bfff64-5b12-4174-a4fb-fae3a4423c36 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:34:56.659155 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-69bfff64-5b12-4174-a4fb-fae3a4423c36 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:34:56.791200 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-69bfff64-5b12-4174-a4fb-fae3a4423c36 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b26b32a5cf64b01bdd213c66f7249b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5874a55844a40ab742ed92677880a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:34:56.799309 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-69bfff64-5b12-4174-a4fb-fae3a4423c36 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "GET /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a" status: 200 len: 1374 microversion: 2.1 time: 0.155025 Oct 26 14:34:56.799887 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3999/8023] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:34:56 2022] GET /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:34:57.822721 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d78f4279-2e3e-49b2-b157-64f203027a0b tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:34:57.823382 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d78f4279-2e3e-49b2-b157-64f203027a0b tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 1d6c75b8-a193-4ce7-982f-be436a7e228a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:34:57.830297 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d78f4279-2e3e-49b2-b157-64f203027a0b tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:34:57.830796 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d78f4279-2e3e-49b2-b157-64f203027a0b tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:34:57.831251 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d78f4279-2e3e-49b2-b157-64f203027a0b tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:34:57.832288 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d78f4279-2e3e-49b2-b157-64f203027a0b tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:34:57.832608 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d78f4279-2e3e-49b2-b157-64f203027a0b tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:34:57.832885 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d78f4279-2e3e-49b2-b157-64f203027a0b tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:34:57.978769 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-d78f4279-2e3e-49b2-b157-64f203027a0b tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b26b32a5cf64b01bdd213c66f7249b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5874a55844a40ab742ed92677880a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:34:57.986768 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d78f4279-2e3e-49b2-b157-64f203027a0b tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "GET /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a" status: 200 len: 1374 microversion: 2.1 time: 0.167876 Oct 26 14:34:57.987441 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 4025/8024] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:34:57 2022] GET /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a => generated 1374 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:34:59.010151 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f30f4da1-1242-41cd-81b2-872d8f914ba0 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:34:59.010806 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f30f4da1-1242-41cd-81b2-872d8f914ba0 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 1d6c75b8-a193-4ce7-982f-be436a7e228a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:34:59.018330 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f30f4da1-1242-41cd-81b2-872d8f914ba0 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:34:59.018815 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f30f4da1-1242-41cd-81b2-872d8f914ba0 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:34:59.019254 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f30f4da1-1242-41cd-81b2-872d8f914ba0 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:34:59.019944 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f30f4da1-1242-41cd-81b2-872d8f914ba0 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:34:59.020399 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f30f4da1-1242-41cd-81b2-872d8f914ba0 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:34:59.020826 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f30f4da1-1242-41cd-81b2-872d8f914ba0 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:34:59.155249 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-f30f4da1-1242-41cd-81b2-872d8f914ba0 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b26b32a5cf64b01bdd213c66f7249b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5874a55844a40ab742ed92677880a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:34:59.163960 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f30f4da1-1242-41cd-81b2-872d8f914ba0 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "GET /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a" status: 200 len: 1374 microversion: 2.1 time: 0.157768 Oct 26 14:34:59.164537 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 4000/8025] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:34:59 2022] GET /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:34:59.994103 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-33f45561-d3d0-4207-bbc7-10fcdb03a0af req-2bf181b4-aa15-4f1b-b75c-1cfdcd942a04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d6c75b8-a193-4ce7-982f-be436a7e228a", "name": "network-vif-plugged", "status": "completed", "tag": "e3d314eb-67e4-4df7-ab59-cbfae1cabd6c"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:35:00.005946 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-33f45561-d3d0-4207-bbc7-10fcdb03a0af req-2bf181b4-aa15-4f1b-b75c-1cfdcd942a04 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:35:00.006440 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-33f45561-d3d0-4207-bbc7-10fcdb03a0af req-2bf181b4-aa15-4f1b-b75c-1cfdcd942a04 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:35:00.006885 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-33f45561-d3d0-4207-bbc7-10fcdb03a0af req-2bf181b4-aa15-4f1b-b75c-1cfdcd942a04 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:35:00.019417 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-33f45561-d3d0-4207-bbc7-10fcdb03a0af req-2bf181b4-aa15-4f1b-b75c-1cfdcd942a04 service nova] Creating event network-vif-plugged:e3d314eb-67e4-4df7-ab59-cbfae1cabd6c for instance 1d6c75b8-a193-4ce7-982f-be436a7e228a on n-h2-862686-1 Oct 26 14:35:00.024587 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-33f45561-d3d0-4207-bbc7-10fcdb03a0af req-2bf181b4-aa15-4f1b-b75c-1cfdcd942a04 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034253 Oct 26 14:35:00.025198 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 4026/8026] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:35:00.187889 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1bc8facf-f9e8-421a-b31b-7674611e48aa tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:35:00.188516 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1bc8facf-f9e8-421a-b31b-7674611e48aa tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 1d6c75b8-a193-4ce7-982f-be436a7e228a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:35:00.198536 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1bc8facf-f9e8-421a-b31b-7674611e48aa tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:35:00.199033 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1bc8facf-f9e8-421a-b31b-7674611e48aa tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:35:00.199482 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1bc8facf-f9e8-421a-b31b-7674611e48aa tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:35:00.200193 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1bc8facf-f9e8-421a-b31b-7674611e48aa tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:35:00.200659 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1bc8facf-f9e8-421a-b31b-7674611e48aa tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:35:00.201096 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1bc8facf-f9e8-421a-b31b-7674611e48aa tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:35:00.335262 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1bc8facf-f9e8-421a-b31b-7674611e48aa tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b26b32a5cf64b01bdd213c66f7249b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5874a55844a40ab742ed92677880a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:35:00.343087 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1bc8facf-f9e8-421a-b31b-7674611e48aa tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "GET /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a" status: 200 len: 1374 microversion: 2.1 time: 0.159185 Oct 26 14:35:00.343661 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 4001/8027] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:35:00 2022] GET /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:35:01.368629 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-efa94eb5-2466-400b-900b-cccc486bf0bf tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:35:01.369347 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-efa94eb5-2466-400b-900b-cccc486bf0bf tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 1d6c75b8-a193-4ce7-982f-be436a7e228a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:35:01.377791 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-efa94eb5-2466-400b-900b-cccc486bf0bf tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:35:01.378315 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-efa94eb5-2466-400b-900b-cccc486bf0bf tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:35:01.378773 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-efa94eb5-2466-400b-900b-cccc486bf0bf tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:35:01.379501 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-efa94eb5-2466-400b-900b-cccc486bf0bf tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:35:01.379973 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-efa94eb5-2466-400b-900b-cccc486bf0bf tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:35:01.380413 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-efa94eb5-2466-400b-900b-cccc486bf0bf tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:35:01.519896 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-efa94eb5-2466-400b-900b-cccc486bf0bf tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b26b32a5cf64b01bdd213c66f7249b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5874a55844a40ab742ed92677880a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:35:01.527760 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-efa94eb5-2466-400b-900b-cccc486bf0bf tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "GET /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a" status: 200 len: 1374 microversion: 2.1 time: 0.164436 Oct 26 14:35:01.528344 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 4027/8028] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:35:01 2022] GET /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a => generated 1374 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:35:02.551701 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a23e7551-0ea2-48e7-8f51-7dfc3aaea596 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:35:02.552312 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a23e7551-0ea2-48e7-8f51-7dfc3aaea596 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 1d6c75b8-a193-4ce7-982f-be436a7e228a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:35:02.559772 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a23e7551-0ea2-48e7-8f51-7dfc3aaea596 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:35:02.560301 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a23e7551-0ea2-48e7-8f51-7dfc3aaea596 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:35:02.561576 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a23e7551-0ea2-48e7-8f51-7dfc3aaea596 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:35:02.562436 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a23e7551-0ea2-48e7-8f51-7dfc3aaea596 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:35:02.563249 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a23e7551-0ea2-48e7-8f51-7dfc3aaea596 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:35:02.563690 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a23e7551-0ea2-48e7-8f51-7dfc3aaea596 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:35:02.704233 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-a23e7551-0ea2-48e7-8f51-7dfc3aaea596 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b26b32a5cf64b01bdd213c66f7249b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5874a55844a40ab742ed92677880a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:35:02.712284 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a23e7551-0ea2-48e7-8f51-7dfc3aaea596 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "GET /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a" status: 200 len: 1559 microversion: 2.1 time: 0.165032 Oct 26 14:35:02.712859 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 4002/8029] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:35:02 2022] GET /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:35:02.735047 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-006aef03-00d4-4ce1-9bde-637124c28aaa tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:35:02.735674 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-006aef03-00d4-4ce1-9bde-637124c28aaa tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 1d6c75b8-a193-4ce7-982f-be436a7e228a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:35:02.742380 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-006aef03-00d4-4ce1-9bde-637124c28aaa tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:35:02.742880 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-006aef03-00d4-4ce1-9bde-637124c28aaa tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:35:02.743333 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-006aef03-00d4-4ce1-9bde-637124c28aaa tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:35:02.744037 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-006aef03-00d4-4ce1-9bde-637124c28aaa tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:35:02.744510 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-006aef03-00d4-4ce1-9bde-637124c28aaa tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:35:02.744950 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-006aef03-00d4-4ce1-9bde-637124c28aaa tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:35:02.883029 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-006aef03-00d4-4ce1-9bde-637124c28aaa tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b26b32a5cf64b01bdd213c66f7249b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5874a55844a40ab742ed92677880a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:35:02.890758 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-006aef03-00d4-4ce1-9bde-637124c28aaa tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "GET /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a" status: 200 len: 1559 microversion: 2.1 time: 0.159663 Oct 26 14:35:02.891338 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 4028/8030] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:35:02 2022] GET /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:35:04.750192 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-65f3b9f4-220d-4170-87b0-ebd4b1b2d7ec req-86969a88-9a79-4b7e-ad2a-1a2d84d77f5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d6c75b8-a193-4ce7-982f-be436a7e228a", "tag": "e3d314eb-67e4-4df7-ab59-cbfae1cabd6c"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:35:04.756926 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=27 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:35:04.762795 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-65f3b9f4-220d-4170-87b0-ebd4b1b2d7ec req-86969a88-9a79-4b7e-ad2a-1a2d84d77f5f service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:35:04.763273 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-65f3b9f4-220d-4170-87b0-ebd4b1b2d7ec req-86969a88-9a79-4b7e-ad2a-1a2d84d77f5f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:35:04.763729 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-65f3b9f4-220d-4170-87b0-ebd4b1b2d7ec req-86969a88-9a79-4b7e-ad2a-1a2d84d77f5f service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:35:04.775800 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-65f3b9f4-220d-4170-87b0-ebd4b1b2d7ec req-86969a88-9a79-4b7e-ad2a-1a2d84d77f5f service nova] Creating event network-changed:e3d314eb-67e4-4df7-ab59-cbfae1cabd6c for instance 1d6c75b8-a193-4ce7-982f-be436a7e228a on n-h2-862686-1 Oct 26 14:35:04.780897 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-65f3b9f4-220d-4170-87b0-ebd4b1b2d7ec req-86969a88-9a79-4b7e-ad2a-1a2d84d77f5f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034514 Oct 26 14:35:04.781530 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 4003/8031] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:36:43.442422 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-87ab1182-715a-4e1f-836e-2c3db5d70ea4 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1705785075"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:36:43.446157 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-87ab1182-715a-4e1f-836e-2c3db5d70ea4 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 1d6c75b8-a193-4ce7-982f-be436a7e228a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:36:43.448455 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:36:43.449124 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=60 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:36:43.450275 n-d-862686-1 devstack@n-api.service[120598]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 14:36:43.450506 n-d-862686-1 devstack@n-api.service[120598]: Wed Oct 26 14:36:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a/action (ip 10.222.0.40) !!! Oct 26 14:36:43.457904 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87ab1182-715a-4e1f-836e-2c3db5d70ea4 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:36:43.458405 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87ab1182-715a-4e1f-836e-2c3db5d70ea4 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:36:43.458855 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87ab1182-715a-4e1f-836e-2c3db5d70ea4 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:36:43.459568 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87ab1182-715a-4e1f-836e-2c3db5d70ea4 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:36:43.460042 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87ab1182-715a-4e1f-836e-2c3db5d70ea4 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:36:43.461105 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87ab1182-715a-4e1f-836e-2c3db5d70ea4 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:36:43.664753 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-87ab1182-715a-4e1f-836e-2c3db5d70ea4 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "POST /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a/action" status: 202 len: 0 microversion: 2.1 time: 0.228782 Oct 26 14:36:43.665406 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 4029/8032] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 26 14:36:43 2022] POST /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 26 14:36:48.567651 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:36:48.569288 n-d-862686-1 devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=58 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:36:48.571661 n-d-862686-1 devstack@n-api.service[120597]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 14:36:48.572198 n-d-862686-1 devstack@n-api.service[120597]: Wed Oct 26 14:36:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.40) !!! Oct 26 14:36:48.575042 n-d-862686-1 devstack@n-api.service[120597]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 14:36:48.575194 n-d-862686-1 devstack@n-api.service[120597]: Wed Oct 26 14:36:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.40) !!! Oct 26 14:36:48.700419 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-cfeaaa86-a8e3-4966-b676-b95988dee08a req-56c84164-b6db-44ff-89da-8787a16958fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d6c75b8-a193-4ce7-982f-be436a7e228a", "name": "network-vif-plugged", "status": "completed", "tag": "e3d314eb-67e4-4df7-ab59-cbfae1cabd6c"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:36:48.711701 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-cfeaaa86-a8e3-4966-b676-b95988dee08a req-56c84164-b6db-44ff-89da-8787a16958fe service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:36:48.712180 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-cfeaaa86-a8e3-4966-b676-b95988dee08a req-56c84164-b6db-44ff-89da-8787a16958fe service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:36:48.712612 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-cfeaaa86-a8e3-4966-b676-b95988dee08a req-56c84164-b6db-44ff-89da-8787a16958fe service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:36:48.727173 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-cfeaaa86-a8e3-4966-b676-b95988dee08a req-56c84164-b6db-44ff-89da-8787a16958fe service nova] Creating event network-vif-plugged:e3d314eb-67e4-4df7-ab59-cbfae1cabd6c for instance 1d6c75b8-a193-4ce7-982f-be436a7e228a on n-h2-862686-1 Oct 26 14:36:48.732425 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-cfeaaa86-a8e3-4966-b676-b95988dee08a req-56c84164-b6db-44ff-89da-8787a16958fe service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168116 Oct 26 14:36:48.733062 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 4004/8033] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:36:58.304623 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a998d9b3-2132-4e32-94f9-e351694c8b2f tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:36:58.306001 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a998d9b3-2132-4e32-94f9-e351694c8b2f tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 1d6c75b8-a193-4ce7-982f-be436a7e228a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:36:58.309655 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:36:58.310644 n-d-862686-1 devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 14:36:58.316923 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a998d9b3-2132-4e32-94f9-e351694c8b2f tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:36:58.317525 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a998d9b3-2132-4e32-94f9-e351694c8b2f tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:36:58.318188 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a998d9b3-2132-4e32-94f9-e351694c8b2f tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:36:58.318909 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a998d9b3-2132-4e32-94f9-e351694c8b2f tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:36:58.319371 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a998d9b3-2132-4e32-94f9-e351694c8b2f tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:36:58.320483 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a998d9b3-2132-4e32-94f9-e351694c8b2f tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:36:58.354218 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a998d9b3-2132-4e32-94f9-e351694c8b2f tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 1d6c75b8-a193-4ce7-982f-be436a7e228a] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 14:36:58.371578 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-c052faab-5d35-4b93-8b4c-7bec55f57ab3 req-fcf46f32-c88e-42e0-96a7-c6705732695e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d6c75b8-a193-4ce7-982f-be436a7e228a", "tag": "e3d314eb-67e4-4df7-ab59-cbfae1cabd6c"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:36:58.381827 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-c052faab-5d35-4b93-8b4c-7bec55f57ab3 req-fcf46f32-c88e-42e0-96a7-c6705732695e service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:36:58.382455 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-c052faab-5d35-4b93-8b4c-7bec55f57ab3 req-fcf46f32-c88e-42e0-96a7-c6705732695e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:36:58.383088 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-c052faab-5d35-4b93-8b4c-7bec55f57ab3 req-fcf46f32-c88e-42e0-96a7-c6705732695e service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:36:58.394605 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-c052faab-5d35-4b93-8b4c-7bec55f57ab3 req-fcf46f32-c88e-42e0-96a7-c6705732695e service nova] Creating event network-changed:e3d314eb-67e4-4df7-ab59-cbfae1cabd6c for instance 1d6c75b8-a193-4ce7-982f-be436a7e228a on n-h2-862686-1 Oct 26 14:36:58.400344 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-c052faab-5d35-4b93-8b4c-7bec55f57ab3 req-fcf46f32-c88e-42e0-96a7-c6705732695e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097983 Oct 26 14:36:58.401073 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 4005/8034] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:36:58.445329 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a998d9b3-2132-4e32-94f9-e351694c8b2f tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a" status: 204 len: 0 microversion: 2.1 time: 0.145088 Oct 26 14:36:58.446466 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 4030/8035] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 14:36:58 2022] DELETE /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 14:36:58.455675 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1e4d97c1-b9a5-4a7a-b02a-aaca92b266d5 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:36:58.456379 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1e4d97c1-b9a5-4a7a-b02a-aaca92b266d5 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 1d6c75b8-a193-4ce7-982f-be436a7e228a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:36:58.472952 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1e4d97c1-b9a5-4a7a-b02a-aaca92b266d5 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:36:58.473834 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1e4d97c1-b9a5-4a7a-b02a-aaca92b266d5 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:36:58.474457 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1e4d97c1-b9a5-4a7a-b02a-aaca92b266d5 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:36:58.475323 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1e4d97c1-b9a5-4a7a-b02a-aaca92b266d5 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:36:58.477190 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1e4d97c1-b9a5-4a7a-b02a-aaca92b266d5 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:36:58.478399 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1e4d97c1-b9a5-4a7a-b02a-aaca92b266d5 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:36:58.613693 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-1e4d97c1-b9a5-4a7a-b02a-aaca92b266d5 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b26b32a5cf64b01bdd213c66f7249b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5874a55844a40ab742ed92677880a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:36:58.622309 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1e4d97c1-b9a5-4a7a-b02a-aaca92b266d5 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "GET /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a" status: 200 len: 1684 microversion: 2.1 time: 0.171172 Oct 26 14:36:58.623022 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 4006/8036] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:36:58 2022] GET /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a => generated 1684 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:36:59.647467 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-88c11dbe-49e0-4028-92f0-00d0fcf3163a tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:36:59.649372 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-88c11dbe-49e0-4028-92f0-00d0fcf3163a tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 1d6c75b8-a193-4ce7-982f-be436a7e228a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:36:59.656153 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88c11dbe-49e0-4028-92f0-00d0fcf3163a tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:36:59.656649 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88c11dbe-49e0-4028-92f0-00d0fcf3163a tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:36:59.657095 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88c11dbe-49e0-4028-92f0-00d0fcf3163a tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:36:59.657822 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88c11dbe-49e0-4028-92f0-00d0fcf3163a tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:36:59.658294 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88c11dbe-49e0-4028-92f0-00d0fcf3163a tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:36:59.658724 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88c11dbe-49e0-4028-92f0-00d0fcf3163a tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:36:59.793309 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-88c11dbe-49e0-4028-92f0-00d0fcf3163a tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b26b32a5cf64b01bdd213c66f7249b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5874a55844a40ab742ed92677880a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:36:59.801312 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-88c11dbe-49e0-4028-92f0-00d0fcf3163a tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "GET /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a" status: 200 len: 1684 microversion: 2.1 time: 0.158123 Oct 26 14:36:59.801925 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 4031/8037] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:36:59 2022] GET /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:37:00.706748 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-b68acde5-ea01-469f-b105-e6153310a838 req-67ab88e6-aa4f-4916-8874-78a387e576c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d6c75b8-a193-4ce7-982f-be436a7e228a", "name": "network-vif-deleted", "tag": "e3d314eb-67e4-4df7-ab59-cbfae1cabd6c"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:37:00.718165 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-b68acde5-ea01-469f-b105-e6153310a838 req-67ab88e6-aa4f-4916-8874-78a387e576c0 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:37:00.718648 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-b68acde5-ea01-469f-b105-e6153310a838 req-67ab88e6-aa4f-4916-8874-78a387e576c0 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:37:00.719086 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-b68acde5-ea01-469f-b105-e6153310a838 req-67ab88e6-aa4f-4916-8874-78a387e576c0 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:37:00.731035 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-b68acde5-ea01-469f-b105-e6153310a838 req-67ab88e6-aa4f-4916-8874-78a387e576c0 service nova] Creating event network-vif-deleted:e3d314eb-67e4-4df7-ab59-cbfae1cabd6c for instance 1d6c75b8-a193-4ce7-982f-be436a7e228a on n-h2-862686-1 Oct 26 14:37:00.735875 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-b68acde5-ea01-469f-b105-e6153310a838 req-67ab88e6-aa4f-4916-8874-78a387e576c0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032967 Oct 26 14:37:00.736484 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 4007/8038] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:37:00.825185 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-be802d22-6384-475f-997c-79e1a47bba75 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:37:00.825782 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-be802d22-6384-475f-997c-79e1a47bba75 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 1d6c75b8-a193-4ce7-982f-be436a7e228a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:37:00.832770 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be802d22-6384-475f-997c-79e1a47bba75 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:37:00.833281 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be802d22-6384-475f-997c-79e1a47bba75 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:37:00.833785 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be802d22-6384-475f-997c-79e1a47bba75 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:37:00.834508 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be802d22-6384-475f-997c-79e1a47bba75 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:37:00.834983 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be802d22-6384-475f-997c-79e1a47bba75 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:37:00.835715 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be802d22-6384-475f-997c-79e1a47bba75 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:37:00.869999 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be802d22-6384-475f-997c-79e1a47bba75 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:37:00.870493 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be802d22-6384-475f-997c-79e1a47bba75 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:37:00.870941 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be802d22-6384-475f-997c-79e1a47bba75 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:37:00.871405 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-be802d22-6384-475f-997c-79e1a47bba75 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lazy-loading 'fault' on Instance uuid 1d6c75b8-a193-4ce7-982f-be436a7e228a {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 14:37:00.915954 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-be802d22-6384-475f-997c-79e1a47bba75 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b26b32a5cf64b01bdd213c66f7249b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5874a55844a40ab742ed92677880a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:37:00.924206 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-be802d22-6384-475f-997c-79e1a47bba75 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "GET /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a" status: 200 len: 1338 microversion: 2.1 time: 0.103288 Oct 26 14:37:00.924950 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 4032/8039] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:37:00 2022] GET /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a => generated 1338 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:37:01.949823 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ed981f44-6b5a-4611-9e14-803b2e2843e8 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:37:01.950536 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ed981f44-6b5a-4611-9e14-803b2e2843e8 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 1d6c75b8-a193-4ce7-982f-be436a7e228a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:37:01.956764 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed981f44-6b5a-4611-9e14-803b2e2843e8 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:37:01.957249 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed981f44-6b5a-4611-9e14-803b2e2843e8 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:37:01.957735 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed981f44-6b5a-4611-9e14-803b2e2843e8 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:37:01.958424 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed981f44-6b5a-4611-9e14-803b2e2843e8 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:37:01.958881 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed981f44-6b5a-4611-9e14-803b2e2843e8 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:37:01.959308 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ed981f44-6b5a-4611-9e14-803b2e2843e8 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:37:01.973062 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-ed981f44-6b5a-4611-9e14-803b2e2843e8 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] HTTP exception thrown: Instance 1d6c75b8-a193-4ce7-982f-be436a7e228a could not be found. Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ed981f44-6b5a-4611-9e14-803b2e2843e8 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Request method failure captured: Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a HTTP/1.1 Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWUTn6VMY2fsvDF-Pu1KQQ0gYCqSxEc7TZZaESQ6lUvx08OrxfN9NBndA9AXEZ3-FF7jl743C2jTZBLbFwBoxjfbAJasbOqVDmhP5bxdt5n2sERouZCUp0Okb2FHv83lYw4G2VChPVzRGOG0fD99i0qsP_u905U4lJlhBS_cXLtQgLnM Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: f1e5874a55844a40ab742ed92677880a Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-TestSnapshotPattern-84821267 Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f1e5874a55844a40ab742ed92677880a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f1e5874a55844a40ab742ed92677880a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f1e5874a55844a40ab742ed92677880a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f1e5874a55844a40ab742ed92677880a"}]}] Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-TestSnapshotPattern-84821267 Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: f1e5874a55844a40ab742ed92677880a Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-TestSnapshotPattern-84821267 Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-TestSnapshotPattern-84821267-project Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 1b26b32a5cf64b01bdd213c66f7249b6 Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-TestSnapshotPattern-84821267-project Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 1d6c75b8-a193-4ce7-982f-be436a7e228a could not be found. Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '1d6c75b8-a193-4ce7-982f-be436a7e228a'} Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d6c75b8-a193-4ce7-982f-be436a7e228a could not be found. Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d6c75b8-a193-4ce7-982f-be436a7e228a could not be found. Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:37:01.974709 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:37:01.980421 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:37:01.980421 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:37:01.980421 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:37:01.980421 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 14:37:01.980421 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 14:37:01.980421 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d6c75b8-a193-4ce7-982f-be436a7e228a could not be found. Oct 26 14:37:01.980421 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:37:01.980421 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ed981f44-6b5a-4611-9e14-803b2e2843e8 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Returning 404 to user: Instance 1d6c75b8-a193-4ce7-982f-be436a7e228a could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 14:37:01.980421 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ed981f44-6b5a-4611-9e14-803b2e2843e8 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "GET /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a" status: 404 len: 111 microversion: 2.1 time: 0.032200 Oct 26 14:37:01.980421 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 4008/8040] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:37:01 2022] GET /compute/v2.1/servers/1d6c75b8-a193-4ce7-982f-be436a7e228a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 14:37:03.330125 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5fe1e095-63fc-4dc6-bb5d-315cd88c757f tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:37:03.330649 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5fe1e095-63fc-4dc6-bb5d-315cd88c757f tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 7753c397-b56d-4a9e-acdb-b0f735f2755f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:37:03.333022 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-57eb575b-1402-4fc8-a2b8-1e47f0a2a3b6 req-44e25639-20b2-4ee7-97b1-ef0216f6a47a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7753c397-b56d-4a9e-acdb-b0f735f2755f", "tag": "b31e47b5-a810-448c-8997-c64906f9432a"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:37:03.338466 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5fe1e095-63fc-4dc6-bb5d-315cd88c757f tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:37:03.338982 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5fe1e095-63fc-4dc6-bb5d-315cd88c757f tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:37:03.339441 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5fe1e095-63fc-4dc6-bb5d-315cd88c757f tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:37:03.340360 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5fe1e095-63fc-4dc6-bb5d-315cd88c757f tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:37:03.340838 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5fe1e095-63fc-4dc6-bb5d-315cd88c757f tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:37:03.341287 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5fe1e095-63fc-4dc6-bb5d-315cd88c757f tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:37:03.345945 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-57eb575b-1402-4fc8-a2b8-1e47f0a2a3b6 req-44e25639-20b2-4ee7-97b1-ef0216f6a47a service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:37:03.346502 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-57eb575b-1402-4fc8-a2b8-1e47f0a2a3b6 req-44e25639-20b2-4ee7-97b1-ef0216f6a47a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:37:03.347012 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-57eb575b-1402-4fc8-a2b8-1e47f0a2a3b6 req-44e25639-20b2-4ee7-97b1-ef0216f6a47a service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:37:03.358864 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-57eb575b-1402-4fc8-a2b8-1e47f0a2a3b6 req-44e25639-20b2-4ee7-97b1-ef0216f6a47a service nova] Creating event network-changed:b31e47b5-a810-448c-8997-c64906f9432a for instance 7753c397-b56d-4a9e-acdb-b0f735f2755f on n-h1-862686-1 Oct 26 14:37:03.364269 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-57eb575b-1402-4fc8-a2b8-1e47f0a2a3b6 req-44e25639-20b2-4ee7-97b1-ef0216f6a47a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035071 Oct 26 14:37:03.364886 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 4009/8041] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:37:03.371059 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5fe1e095-63fc-4dc6-bb5d-315cd88c757f tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 7753c397-b56d-4a9e-acdb-b0f735f2755f] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 14:37:03.465607 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5fe1e095-63fc-4dc6-bb5d-315cd88c757f tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7753c397-b56d-4a9e-acdb-b0f735f2755f" status: 204 len: 0 microversion: 2.1 time: 0.138973 Oct 26 14:37:03.466327 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 4033/8042] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 26 14:37:03 2022] DELETE /compute/v2.1/servers/7753c397-b56d-4a9e-acdb-b0f735f2755f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 14:37:03.475354 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fd292d50-b1a9-4ef6-bc17-754cbf1c083f tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:37:03.476427 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fd292d50-b1a9-4ef6-bc17-754cbf1c083f tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 7753c397-b56d-4a9e-acdb-b0f735f2755f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:37:03.483139 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd292d50-b1a9-4ef6-bc17-754cbf1c083f tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:37:03.483804 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd292d50-b1a9-4ef6-bc17-754cbf1c083f tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:37:03.484420 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd292d50-b1a9-4ef6-bc17-754cbf1c083f tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:37:03.485299 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd292d50-b1a9-4ef6-bc17-754cbf1c083f tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:37:03.485904 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd292d50-b1a9-4ef6-bc17-754cbf1c083f tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:37:03.486520 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd292d50-b1a9-4ef6-bc17-754cbf1c083f tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:37:03.641624 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.policy [None req-fd292d50-b1a9-4ef6-bc17-754cbf1c083f tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b26b32a5cf64b01bdd213c66f7249b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5874a55844a40ab742ed92677880a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:37:03.650263 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fd292d50-b1a9-4ef6-bc17-754cbf1c083f tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "GET /compute/v2.1/servers/7753c397-b56d-4a9e-acdb-b0f735f2755f" status: 200 len: 1682 microversion: 2.1 time: 0.179347 Oct 26 14:37:03.650854 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 4010/8043] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:37:03 2022] GET /compute/v2.1/servers/7753c397-b56d-4a9e-acdb-b0f735f2755f => generated 1682 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:37:04.675049 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b580fbaf-df6c-49a1-8482-cbeacef8e4b3 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:37:04.675793 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b580fbaf-df6c-49a1-8482-cbeacef8e4b3 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 7753c397-b56d-4a9e-acdb-b0f735f2755f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:37:04.682995 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b580fbaf-df6c-49a1-8482-cbeacef8e4b3 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:37:04.683516 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b580fbaf-df6c-49a1-8482-cbeacef8e4b3 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:37:04.683992 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b580fbaf-df6c-49a1-8482-cbeacef8e4b3 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:37:04.684695 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b580fbaf-df6c-49a1-8482-cbeacef8e4b3 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:37:04.685162 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b580fbaf-df6c-49a1-8482-cbeacef8e4b3 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:37:04.685629 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b580fbaf-df6c-49a1-8482-cbeacef8e4b3 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:37:04.821795 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-b580fbaf-df6c-49a1-8482-cbeacef8e4b3 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b26b32a5cf64b01bdd213c66f7249b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5874a55844a40ab742ed92677880a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:37:04.829720 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b580fbaf-df6c-49a1-8482-cbeacef8e4b3 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "GET /compute/v2.1/servers/7753c397-b56d-4a9e-acdb-b0f735f2755f" status: 200 len: 1682 microversion: 2.1 time: 0.159296 Oct 26 14:37:04.830298 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 4034/8044] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:37:04 2022] GET /compute/v2.1/servers/7753c397-b56d-4a9e-acdb-b0f735f2755f => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:37:05.724375 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-4ee66156-bd0e-4a6e-9a8e-abd1aab5054d req-e2faedfc-8fcd-40ad-9d50-da900293b753 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7753c397-b56d-4a9e-acdb-b0f735f2755f", "name": "network-vif-deleted", "tag": "b31e47b5-a810-448c-8997-c64906f9432a"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 14:37:05.734175 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-4ee66156-bd0e-4a6e-9a8e-abd1aab5054d req-e2faedfc-8fcd-40ad-9d50-da900293b753 service nova] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:37:05.734744 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-4ee66156-bd0e-4a6e-9a8e-abd1aab5054d req-e2faedfc-8fcd-40ad-9d50-da900293b753 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:37:05.735256 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-4ee66156-bd0e-4a6e-9a8e-abd1aab5054d req-e2faedfc-8fcd-40ad-9d50-da900293b753 service nova] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:37:05.748293 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-4ee66156-bd0e-4a6e-9a8e-abd1aab5054d req-e2faedfc-8fcd-40ad-9d50-da900293b753 service nova] Creating event network-vif-deleted:b31e47b5-a810-448c-8997-c64906f9432a for instance 7753c397-b56d-4a9e-acdb-b0f735f2755f on n-h1-862686-1 Oct 26 14:37:05.754988 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-4ee66156-bd0e-4a6e-9a8e-abd1aab5054d req-e2faedfc-8fcd-40ad-9d50-da900293b753 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093196 Oct 26 14:37:05.755609 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 4011/8045] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 26 14:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 14:37:05.852220 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0a51af70-1176-4d31-8369-6c20d063ade6 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:37:05.852848 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0a51af70-1176-4d31-8369-6c20d063ade6 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 7753c397-b56d-4a9e-acdb-b0f735f2755f] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:37:05.860079 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0a51af70-1176-4d31-8369-6c20d063ade6 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:37:05.860577 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0a51af70-1176-4d31-8369-6c20d063ade6 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:37:05.861266 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0a51af70-1176-4d31-8369-6c20d063ade6 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:37:05.861953 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0a51af70-1176-4d31-8369-6c20d063ade6 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:37:05.862868 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0a51af70-1176-4d31-8369-6c20d063ade6 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:37:05.863310 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0a51af70-1176-4d31-8369-6c20d063ade6 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:37:05.900411 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0a51af70-1176-4d31-8369-6c20d063ade6 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:37:05.900835 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0a51af70-1176-4d31-8369-6c20d063ade6 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:37:05.901283 n-d-862686-1 devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0a51af70-1176-4d31-8369-6c20d063ade6 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:37:05.901765 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-0a51af70-1176-4d31-8369-6c20d063ade6 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lazy-loading 'fault' on Instance uuid 7753c397-b56d-4a9e-acdb-b0f735f2755f {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 14:37:05.952683 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.policy [None req-0a51af70-1176-4d31-8369-6c20d063ade6 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b26b32a5cf64b01bdd213c66f7249b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e5874a55844a40ab742ed92677880a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 14:37:05.961450 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0a51af70-1176-4d31-8369-6c20d063ade6 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "GET /compute/v2.1/servers/7753c397-b56d-4a9e-acdb-b0f735f2755f" status: 200 len: 1337 microversion: 2.1 time: 0.113090 Oct 26 14:37:05.962066 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 4035/8046] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:37:05 2022] GET /compute/v2.1/servers/7753c397-b56d-4a9e-acdb-b0f735f2755f => generated 1337 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 14:37:06.986762 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ce3548ce-1700-441b-bfbc-1da2b8366bc6 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:37:06.987466 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ce3548ce-1700-441b-bfbc-1da2b8366bc6 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] [instance: 7753c397-b56d-4a9e-acdb-b0f735f2755f] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 14:37:06.994677 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce3548ce-1700-441b-bfbc-1da2b8366bc6 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:37:06.995166 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce3548ce-1700-441b-bfbc-1da2b8366bc6 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:37:06.995606 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce3548ce-1700-441b-bfbc-1da2b8366bc6 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:37:06.996308 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce3548ce-1700-441b-bfbc-1da2b8366bc6 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Acquiring lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 14:37:06.996766 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce3548ce-1700-441b-bfbc-1da2b8366bc6 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 14:37:06.997194 n-d-862686-1 devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ce3548ce-1700-441b-bfbc-1da2b8366bc6 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Lock "2e5960f1-3c3d-401b-877c-fe82eb67bd3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 14:37:07.010365 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-ce3548ce-1700-441b-bfbc-1da2b8366bc6 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] HTTP exception thrown: Instance 7753c397-b56d-4a9e-acdb-b0f735f2755f could not be found. Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ce3548ce-1700-441b-bfbc-1da2b8366bc6 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Request method failure captured: Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/7753c397-b56d-4a9e-acdb-b0f735f2755f HTTP/1.1 Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: Accept: application/json Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: Accept-Encoding: identity Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: Connection: close Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: Content-Length: 0 Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: Content-Type: application/json Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: Host: 10.222.0.40 Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjWUTn6VMY2fsvDF-Pu1KQQ0gYCqSxEc7TZZaESQ6lUvx08OrxfN9NBndA9AXEZ3-FF7jl743C2jTZBLbFwBoxjfbAJasbOqVDmhP5bxdt5n2sERouZCUp0Okb2FHv83lYw4G2VChPVzRGOG0fD99i0qsP_u905U4lJlhBS_cXLtQgLnM Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Id: None Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: X-Domain-Name: None Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Id: f1e5874a55844a40ab742ed92677880a Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: X-Project-Name: tempest-TestSnapshotPattern-84821267 Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: X-Role: member,reader Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: X-Roles: member,reader Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f1e5874a55844a40ab742ed92677880a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f1e5874a55844a40ab742ed92677880a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f1e5874a55844a40ab742ed92677880a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f1e5874a55844a40ab742ed92677880a"}]}] Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant: tempest-TestSnapshotPattern-84821267 Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Id: f1e5874a55844a40ab742ed92677880a Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: X-Tenant-Name: tempest-TestSnapshotPattern-84821267 Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: X-User: tempest-TestSnapshotPattern-84821267-project Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: X-User-Id: 1b26b32a5cf64b01bdd213c66f7249b6 Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: X-User-Name: tempest-TestSnapshotPattern-84821267-project Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: method: > Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: exception: Instance 7753c397-b56d-4a9e-acdb-b0f735f2755f could not be found. Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: action_args: {'id': '7753c397-b56d-4a9e-acdb-b0f735f2755f'} Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7753c397-b56d-4a9e-acdb-b0f735f2755f could not be found. Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7753c397-b56d-4a9e-acdb-b0f735f2755f could not be found. Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 14:37:07.011986 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:37:07.015685 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 14:37:07.015685 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 14:37:07.015685 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 14:37:07.015685 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 14:37:07.015685 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 14:37:07.015685 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7753c397-b56d-4a9e-acdb-b0f735f2755f could not be found. Oct 26 14:37:07.015685 n-d-862686-1 devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 26 14:37:07.015685 n-d-862686-1 devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ce3548ce-1700-441b-bfbc-1da2b8366bc6 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Returning 404 to user: Instance 7753c397-b56d-4a9e-acdb-b0f735f2755f could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 14:37:07.015685 n-d-862686-1 devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ce3548ce-1700-441b-bfbc-1da2b8366bc6 tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "GET /compute/v2.1/servers/7753c397-b56d-4a9e-acdb-b0f735f2755f" status: 404 len: 111 microversion: 2.1 time: 0.030887 Oct 26 14:37:07.015685 n-d-862686-1 devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 4012/8047] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 26 14:37:06 2022] GET /compute/v2.1/servers/7753c397-b56d-4a9e-acdb-b0f735f2755f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 14:37:07.173923 n-d-862686-1 devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cbca6157-f85e-4765-984e-52438c7668ba tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] Calling method '.version_select at 0x7f6731fb5ca0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 14:37:07.199061 n-d-862686-1 devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cbca6157-f85e-4765-984e-52438c7668ba tempest-TestSnapshotPattern-84821267 tempest-TestSnapshotPattern-84821267-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-341990740" status: 202 len: 0 microversion: 2.1 time: 0.029551 Oct 26 14:37:07.199551 n-d-862686-1 devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 4036/8048] 10.222.0.40 () {58 vars in 1254 bytes} [Wed Oct 26 14:37:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-341990740 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)